2021-03-10T13:39:56.138 INFO:root:teuthology version: 1.1.0-b6eecfe8 2021-03-10T13:39:56.140 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/sage-2021-03-10_13:21:20-rados:cephadm:upgrade-wip-sage-testing-2021-03-09-1434-distro-basic-gibba/5953063 --name sage-2021-03-10_13:21:20-rados:cephadm:upgrade-wip-sage-testing-2021-03-09-1434-distro-basic-gibba --description rados:cephadm:upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait fixed-2 mon_election/connectivity} --owner scheduled_sage@teuthology -- /home/teuthworker/archive/sage-2021-03-10_13:21:20-rados:cephadm:upgrade-wip-sage-testing-2021-03-09-1434-distro-basic-gibba/5953063/orig.config.yaml 2021-03-10T13:39:56.173 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-03-10T13:39:56.235 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/sage-2021-03-10_13:21:20-rados:cephadm:upgrade-wip-sage-testing-2021-03-09-1434-distro-basic-gibba/5953063 branch: wip-sage-testing-2021-03-09-1434 description: rados:cephadm:upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait fixed-2 mon_election/connectivity} email: null first_in_suite: false job_id: '5953063' kernel: kdb: true sha1: distro last_in_suite: false machine_type: gibba name: sage-2021-03-10_13:21:20-rados:cephadm:upgrade-wip-sage-testing-2021-03-09-1434-distro-basic-gibba nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-sage-testing-2021-03-09-1434 ceph: conf: global: mon election default strategy: 3 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug filestore: 20 debug journal: 20 debug ms: 1 debug osd: 25 osd shutdown pgref assert: true log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: b26fc080937a021ce826cdc94d1adb52c064381a ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: b26fc080937a021ce826cdc94d1adb52c064381a workunit: branch: cephadm-rgw-simplification sha1: fd39f244c71b258f156a77730a6203886f27efb2 owner: scheduled_sage@teuthology priority: 75 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b sha1: b26fc080937a021ce826cdc94d1adb52c064381a sleep_before_teardown: 0 suite: rados:cephadm:upgrade suite_branch: cephadm-rgw-simplification suite_path: /home/teuthworker/src/github.com_liewegas_ceph_fd39f244c71b258f156a77730a6203886f27efb2/qa suite_relpath: qa suite_repo: https://github.com/liewegas/ceph suite_sha1: fd39f244c71b258f156a77730a6203886f27efb2 targets: gibba013.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5O2FOp5KDoAjN3ENpmxrNPGxvTLLmH2tcwMrFWHTt7OajDwbigOgPQYQeOg5cXCST8ePMgIRaUovN4wL75p9NE02JS4WANhphIpbTNBF4vNL5AmOTKCYI5gQXYiOdCyBWif7/+urzx0ClL8DDzEMDIOBKqd2gBDMeVpPhBvlgZo5mFn4BNlpiadRG/zKAc5xJt1fFr3weozbzoRqH0OkD9TkHDFoEGBh8cvLy82sE1aEwj4Z9a6kRZw0LSR3HaRiQ+nU3TUBakBsVpK2/CVfQkwanYCXTzucxCLtAuejgrdOPgUvcFrx8KPwWl8vfcIGpCHw5QLatddLRIf21Dy4xilvPTGOxRG/64wPHx97MBXcsHM5L9uuCakshi4uma/s2UCiskOhTGZeHvwqF6zYKoYJYVMGDQzVfXlWDqvMf0edAQvgRvBUzAEPEXVCJLmB6rrwS84zAkd7tPdTilpXXXJ/PsvMmAYPe0igi1/sTbp57mqiVKiprhoeggblzD08= gibba020.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDfGwuyBcpHofw6PEbUW13U7msIhosVAkidpTPllAGi0gPYqN0jHgk4CyUlBsgfBdp/kwpVG8/YxTRsA+ktyG9v10a3IoRj0SoC1f1CTD7DYMxBmghpSkJNOxm96g+iRUV3yw0WDYFHFz8+/av2BRGQJDTihCbAEFybGEUETacome2naS9zYqbkrmeGLI9CKtTbE2bk3+yOcqWclWj1WHxQAF5JMhg9bhisYfLNvF9ECwsqKgYOhhvNZZN0nmckb/PQ3oVqUZXaSGB3Y+xxcjEAN2o6etGqqysaPUZeHlGT0WJect+TbhTmVEBrWAMhfIDuzCsTltb9eaG+8QrV+09kj3c7ksT3NkjysPFFVJAzuG0aYiCCPvX09AJTa8Ig8zbW8h+V86OvOlJvzzeXsCSRBjwx2BQABBzKHVnO4gHbIJbDGK0yeo73UgUyomyjx1LqdnqypaLOvKGsVE+qwesOq48mGUm2E83vSvp6eiZzv78Pt0NWrThdRutdZikZzYM= tasks: - cephadm: allow_ptrace: false cephadm_branch: v15.2.0 cephadm_git_url: https://github.com/ceph/ceph image: docker.io/ceph/ceph:v15.2.0 - cephadm.shell: env: - sha1 mon.a: - radosgw-admin realm create --rgw-realm=r --default - radosgw-admin zonegroup create --rgw-zonegroup=default --master --default - radosgw-admin zone create --rgw-zonegroup=default --rgw-zone=z --master --default - radosgw-admin period update --rgw-realm=r --commit - ceph orch apply rgw r z --placement=1 - sleep 120 - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 mon.a: - while ceph orch upgrade status | jq '.in_progress' | grep true ; do ceph orch ps ; ceph versions ; sleep 30 ; done - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 teuthology_branch: master teuthology_sha1: b6eecfe89a4363750d696160843a096384b357a8 timestamp: 2021-03-10_13:21:20 tube: gibba user: sage verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.gibba.26181 2021-03-10T13:39:56.236 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_liewegas_ceph_fd39f244c71b258f156a77730a6203886f27efb2/qa; will attempt to use it 2021-03-10T13:39:56.237 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_liewegas_ceph_fd39f244c71b258f156a77730a6203886f27efb2/qa/tasks 2021-03-10T13:39:56.238 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-03-10T13:39:56.240 INFO:teuthology.task.internal:Checking packages... 2021-03-10T13:39:56.274 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'basic' and ceph hash 'b26fc080937a021ce826cdc94d1adb52c064381a' 2021-03-10T13:39:56.275 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-03-10T13:39:56.276 INFO:teuthology.packaging:ref: None 2021-03-10T13:39:56.276 INFO:teuthology.packaging:tag: None 2021-03-10T13:39:56.277 INFO:teuthology.packaging:branch: wip-sage-testing-2021-03-09-1434 2021-03-10T13:39:56.278 INFO:teuthology.packaging:sha1: b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T13:39:56.278 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-sage-testing-2021-03-09-1434 2021-03-10T13:39:56.423 INFO:teuthology.task.internal:Found packages for ceph version 17.0.0-1749-gb26fc080-1focal 2021-03-10T13:39:56.424 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-03-10T13:39:56.435 INFO:teuthology.task.internal:no buildpackages task found 2021-03-10T13:39:56.435 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-03-10T13:39:56.464 INFO:teuthology.task.internal:Saving configuration 2021-03-10T13:39:56.488 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-03-10T13:39:56.499 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-03-10T13:39:56.519 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-03-10 13:34:42.374425', 'description': '/home/teuthworker/archive/sage-2021-03-10_13:21:20-rados:cephadm:upgrade-wip-sage-testing-2021-03-09-1434-distro-basic-gibba/5953063', 'locked_by': 'scheduled_sage@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILJNcY77WTv2+mJ6wjNj5UNhXZOD+0s8b0BGgrvy82xq', 'os_version': '20.04', 'machine_type': 'gibba', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'gibba013.front.sepia.ceph.com'} 2021-03-10T13:39:56.537 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-03-10 13:34:42.374402', 'description': '/home/teuthworker/archive/sage-2021-03-10_13:21:20-rados:cephadm:upgrade-wip-sage-testing-2021-03-09-1434-distro-basic-gibba/5953063', 'locked_by': 'scheduled_sage@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICJpMQdw2pT6NMEvrDwON8OoxBLO2n5G89tIY79FTfYa', 'os_version': '20.04', 'machine_type': 'gibba', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'gibba020.front.sepia.ceph.com'} 2021-03-10T13:39:56.538 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-03-10T13:39:56.549 INFO:teuthology.task.internal:roles: ubuntu@gibba013.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a'] 2021-03-10T13:39:56.549 INFO:teuthology.task.internal:roles: ubuntu@gibba020.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b'] 2021-03-10T13:39:56.550 INFO:teuthology.run_tasks:Running task console_log... 2021-03-10T13:39:56.618 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1aff836598>, signals=[15]) 2021-03-10T13:39:56.619 INFO:teuthology.run_tasks:Running task internal.connect... 2021-03-10T13:39:56.629 INFO:teuthology.task.internal:Opening connections... 2021-03-10T13:39:56.629 DEBUG:teuthology.task.internal:connecting to ubuntu@gibba013.front.sepia.ceph.com 2021-03-10T13:39:56.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-10T13:39:56.667 DEBUG:teuthology.task.internal:connecting to ubuntu@gibba020.front.sepia.ceph.com 2021-03-10T13:39:56.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-10T13:39:56.704 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-03-10T13:39:56.713 DEBUG:teuthology.orchestra.run.gibba013:> uname -m 2021-03-10T13:39:56.718 INFO:teuthology.orchestra.run.gibba013.stdout:x86_64 2021-03-10T13:39:56.719 DEBUG:teuthology.orchestra.run.gibba013:> cat /etc/os-release 2021-03-10T13:39:56.765 INFO:teuthology.orchestra.run.gibba013.stdout:NAME="Ubuntu" 2021-03-10T13:39:56.766 INFO:teuthology.orchestra.run.gibba013.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-03-10T13:39:56.766 INFO:teuthology.orchestra.run.gibba013.stdout:ID=ubuntu 2021-03-10T13:39:56.766 INFO:teuthology.orchestra.run.gibba013.stdout:ID_LIKE=debian 2021-03-10T13:39:56.766 INFO:teuthology.orchestra.run.gibba013.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-03-10T13:39:56.767 INFO:teuthology.orchestra.run.gibba013.stdout:VERSION_ID="20.04" 2021-03-10T13:39:56.767 INFO:teuthology.orchestra.run.gibba013.stdout:HOME_URL="https://www.ubuntu.com/" 2021-03-10T13:39:56.767 INFO:teuthology.orchestra.run.gibba013.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-03-10T13:39:56.767 INFO:teuthology.orchestra.run.gibba013.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-03-10T13:39:56.767 INFO:teuthology.orchestra.run.gibba013.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-03-10T13:39:56.768 INFO:teuthology.orchestra.run.gibba013.stdout:VERSION_CODENAME=focal 2021-03-10T13:39:56.768 INFO:teuthology.orchestra.run.gibba013.stdout:UBUNTU_CODENAME=focal 2021-03-10T13:39:56.769 INFO:teuthology.lock.ops:Updating gibba013.front.sepia.ceph.com on lock server 2021-03-10T13:39:56.783 DEBUG:teuthology.orchestra.run.gibba020:> uname -m 2021-03-10T13:39:56.788 INFO:teuthology.orchestra.run.gibba020.stdout:x86_64 2021-03-10T13:39:56.788 DEBUG:teuthology.orchestra.run.gibba020:> cat /etc/os-release 2021-03-10T13:39:56.837 INFO:teuthology.orchestra.run.gibba020.stdout:NAME="Ubuntu" 2021-03-10T13:39:56.837 INFO:teuthology.orchestra.run.gibba020.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-03-10T13:39:56.837 INFO:teuthology.orchestra.run.gibba020.stdout:ID=ubuntu 2021-03-10T13:39:56.837 INFO:teuthology.orchestra.run.gibba020.stdout:ID_LIKE=debian 2021-03-10T13:39:56.838 INFO:teuthology.orchestra.run.gibba020.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-03-10T13:39:56.838 INFO:teuthology.orchestra.run.gibba020.stdout:VERSION_ID="20.04" 2021-03-10T13:39:56.838 INFO:teuthology.orchestra.run.gibba020.stdout:HOME_URL="https://www.ubuntu.com/" 2021-03-10T13:39:56.838 INFO:teuthology.orchestra.run.gibba020.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-03-10T13:39:56.839 INFO:teuthology.orchestra.run.gibba020.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-03-10T13:39:56.839 INFO:teuthology.orchestra.run.gibba020.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-03-10T13:39:56.839 INFO:teuthology.orchestra.run.gibba020.stdout:VERSION_CODENAME=focal 2021-03-10T13:39:56.839 INFO:teuthology.orchestra.run.gibba020.stdout:UBUNTU_CODENAME=focal 2021-03-10T13:39:56.840 INFO:teuthology.lock.ops:Updating gibba020.front.sepia.ceph.com on lock server 2021-03-10T13:39:56.853 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-03-10T13:39:56.868 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-03-10T13:39:56.880 INFO:teuthology.task.internal:Checking for old test directory... 2021-03-10T13:39:56.881 DEBUG:teuthology.orchestra.run.gibba013:> test '!' -e /home/ubuntu/cephtest 2021-03-10T13:39:56.884 DEBUG:teuthology.orchestra.run.gibba020:> test '!' -e /home/ubuntu/cephtest 2021-03-10T13:39:56.892 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-03-10T13:39:56.902 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-03-10T13:39:56.902 DEBUG:teuthology.orchestra.run.gibba013:> test -z $(ls -A /var/lib/ceph) 2021-03-10T13:39:56.931 DEBUG:teuthology.orchestra.run.gibba020:> test -z $(ls -A /var/lib/ceph) 2021-03-10T13:39:56.949 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-03-10T13:39:56.993 INFO:teuthology.run_tasks:Running task kernel... 2021-03-10T13:39:57.009 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.a': {'kdb': True, 'sha1': 'distro'}, 'alertmanager.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'osd.6': {'kdb': True, 'sha1': 'distro'}, 'osd.7': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'prometheus.a': {'kdb': True, 'sha1': 'distro'}, 'grafana.a': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.b': {'kdb': True, 'sha1': 'distro'}} 2021-03-10T13:39:57.009 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-03-10T13:39:57.009 DEBUG:teuthology.orchestra.run.gibba013:> uname -r 2021-03-10T13:39:57.018 INFO:teuthology.orchestra.run.gibba013.stdout:5.4.0-66-generic 2021-03-10T13:39:57.018 INFO:teuthology.task.kernel:Running kernel on gibba013: 5.4.0-66-generic 2021-03-10T13:39:57.019 DEBUG:teuthology.orchestra.run.gibba013:> sudo apt-get clean 2021-03-10T13:39:57.158 DEBUG:teuthology.orchestra.run.gibba013:> sudo apt-get update 2021-03-10T13:39:57.402 INFO:teuthology.orchestra.run.gibba013.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2021-03-10T13:39:57.409 INFO:teuthology.orchestra.run.gibba013.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [109 kB] 2021-03-10T13:39:57.460 INFO:teuthology.orchestra.run.gibba013.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-03-10T13:39:57.780 INFO:teuthology.orchestra.run.gibba013.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [527 kB] 2021-03-10T13:39:57.801 INFO:teuthology.orchestra.run.gibba013.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-03-10T13:39:57.905 INFO:teuthology.orchestra.run.gibba013.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [436 kB] 2021-03-10T13:39:58.035 INFO:teuthology.orchestra.run.gibba013.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [844 kB] 2021-03-10T13:39:58.068 INFO:teuthology.orchestra.run.gibba013.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [199 kB] 2021-03-10T13:39:58.083 INFO:teuthology.orchestra.run.gibba013.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [113 kB] 2021-03-10T13:39:58.092 INFO:teuthology.orchestra.run.gibba013.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [7,208 B] 2021-03-10T13:39:58.093 INFO:teuthology.orchestra.run.gibba013.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [133 kB] 2021-03-10T13:39:58.103 INFO:teuthology.orchestra.run.gibba013.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [19.5 kB] 2021-03-10T13:39:58.105 INFO:teuthology.orchestra.run.gibba013.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [431 kB] 2021-03-10T13:39:58.158 INFO:teuthology.orchestra.run.gibba013.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [202 kB] 2021-03-10T13:39:58.166 INFO:teuthology.orchestra.run.gibba013.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [545 kB] 2021-03-10T13:39:58.171 INFO:teuthology.orchestra.run.gibba013.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [12.8 kB] 2021-03-10T13:39:58.172 INFO:teuthology.orchestra.run.gibba013.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [156 kB] 2021-03-10T13:39:58.184 INFO:teuthology.orchestra.run.gibba013.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [23.3 kB] 2021-03-10T13:39:58.186 INFO:teuthology.orchestra.run.gibba013.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [558 kB] 2021-03-10T13:39:58.204 INFO:teuthology.orchestra.run.gibba013.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [79.6 kB] 2021-03-10T13:39:58.210 INFO:teuthology.orchestra.run.gibba013.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [10.5 kB] 2021-03-10T13:39:58.220 INFO:teuthology.orchestra.run.gibba013.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [749 kB] 2021-03-10T13:39:58.250 INFO:teuthology.orchestra.run.gibba013.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [157 kB] 2021-03-10T13:39:58.254 INFO:teuthology.orchestra.run.gibba013.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [16.2 kB] 2021-03-10T13:40:00.067 INFO:teuthology.orchestra.run.gibba013.stdout:Fetched 5,542 kB in 1s (4,384 kB/s) 2021-03-10T13:40:01.020 INFO:teuthology.orchestra.run.gibba013.stdout:Reading package lists... 2021-03-10T13:40:01.031 DEBUG:teuthology.orchestra.run.gibba013:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-03-10T13:40:01.066 INFO:teuthology.orchestra.run.gibba013.stdout:Reading package lists... 2021-03-10T13:40:01.160 INFO:teuthology.orchestra.run.gibba013.stdout:Building dependency tree... 2021-03-10T13:40:01.160 INFO:teuthology.orchestra.run.gibba013.stdout:Reading state information... 2021-03-10T13:40:01.203 INFO:teuthology.orchestra.run.gibba013.stderr:E: Unable to locate package linux-image-current-generic 2021-03-10T13:40:01.204 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-03-10T13:40:01.205 DEBUG:teuthology.orchestra.run.gibba013:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-03-10T13:40:01.240 INFO:teuthology.orchestra.run.gibba013.stdout:Reading package lists... 2021-03-10T13:40:01.332 INFO:teuthology.orchestra.run.gibba013.stdout:Building dependency tree... 2021-03-10T13:40:01.333 INFO:teuthology.orchestra.run.gibba013.stdout:Reading state information... 2021-03-10T13:40:01.417 INFO:teuthology.orchestra.run.gibba013.stdout:linux-image-generic is already the newest version (5.4.0.66.69). 2021-03-10T13:40:01.418 INFO:teuthology.orchestra.run.gibba013.stdout:linux-image-generic set to manually installed. 2021-03-10T13:40:01.418 INFO:teuthology.orchestra.run.gibba013.stdout:0 upgraded, 0 newly installed, 0 to remove and 9 not upgraded. 2021-03-10T13:40:01.419 DEBUG:teuthology.orchestra.run.gibba013:> dpkg -s linux-image-generic 2021-03-10T13:40:01.429 INFO:teuthology.orchestra.run.gibba013.stdout:Package: linux-image-generic 2021-03-10T13:40:01.429 INFO:teuthology.orchestra.run.gibba013.stdout:Status: install ok installed 2021-03-10T13:40:01.429 INFO:teuthology.orchestra.run.gibba013.stdout:Priority: optional 2021-03-10T13:40:01.430 INFO:teuthology.orchestra.run.gibba013.stdout:Section: kernel 2021-03-10T13:40:01.430 INFO:teuthology.orchestra.run.gibba013.stdout:Installed-Size: 18 2021-03-10T13:40:01.430 INFO:teuthology.orchestra.run.gibba013.stdout:Maintainer: Ubuntu Kernel Team 2021-03-10T13:40:01.430 INFO:teuthology.orchestra.run.gibba013.stdout:Architecture: amd64 2021-03-10T13:40:01.430 INFO:teuthology.orchestra.run.gibba013.stdout:Source: linux-meta 2021-03-10T13:40:01.431 INFO:teuthology.orchestra.run.gibba013.stdout:Version: 5.4.0.66.69 2021-03-10T13:40:01.431 INFO:teuthology.orchestra.run.gibba013.stdout:Provides: virtualbox-guest-modules (= 6.1.16-dfsg-6~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.6) 2021-03-10T13:40:01.431 INFO:teuthology.orchestra.run.gibba013.stdout:Depends: linux-image-5.4.0-66-generic, linux-modules-extra-5.4.0-66-generic, linux-firmware, intel-microcode, amd64-microcode 2021-03-10T13:40:01.431 INFO:teuthology.orchestra.run.gibba013.stdout:Recommends: thermald 2021-03-10T13:40:01.432 INFO:teuthology.orchestra.run.gibba013.stdout:Description: Generic Linux kernel image 2021-03-10T13:40:01.432 INFO:teuthology.orchestra.run.gibba013.stdout: This package will always depend on the latest generic kernel image 2021-03-10T13:40:01.432 INFO:teuthology.orchestra.run.gibba013.stdout: available. 2021-03-10T13:40:01.432 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2021-03-10T13:40:01.433 DEBUG:teuthology.orchestra.run.gibba020:> uname -r 2021-03-10T13:40:01.442 INFO:teuthology.orchestra.run.gibba020.stdout:5.4.0-66-generic 2021-03-10T13:40:01.442 INFO:teuthology.task.kernel:Running kernel on gibba020: 5.4.0-66-generic 2021-03-10T13:40:01.442 DEBUG:teuthology.orchestra.run.gibba020:> sudo apt-get clean 2021-03-10T13:40:01.516 DEBUG:teuthology.orchestra.run.gibba020:> sudo apt-get update 2021-03-10T13:40:01.945 INFO:teuthology.orchestra.run.gibba020.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2021-03-10T13:40:01.945 INFO:teuthology.orchestra.run.gibba020.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [109 kB] 2021-03-10T13:40:01.994 INFO:teuthology.orchestra.run.gibba020.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-03-10T13:40:02.309 INFO:teuthology.orchestra.run.gibba020.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [199 kB] 2021-03-10T13:40:02.325 INFO:teuthology.orchestra.run.gibba020.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-03-10T13:40:02.441 INFO:teuthology.orchestra.run.gibba020.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [844 kB] 2021-03-10T13:40:02.522 INFO:teuthology.orchestra.run.gibba020.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [527 kB] 2021-03-10T13:40:02.631 INFO:teuthology.orchestra.run.gibba020.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [436 kB] 2021-03-10T13:40:02.645 INFO:teuthology.orchestra.run.gibba020.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [113 kB] 2021-03-10T13:40:02.665 INFO:teuthology.orchestra.run.gibba020.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [7,208 B] 2021-03-10T13:40:02.667 INFO:teuthology.orchestra.run.gibba020.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [133 kB] 2021-03-10T13:40:02.672 INFO:teuthology.orchestra.run.gibba020.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [202 kB] 2021-03-10T13:40:02.684 INFO:teuthology.orchestra.run.gibba020.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [19.5 kB] 2021-03-10T13:40:02.685 INFO:teuthology.orchestra.run.gibba020.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [545 kB] 2021-03-10T13:40:02.686 INFO:teuthology.orchestra.run.gibba020.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [12.8 kB] 2021-03-10T13:40:02.687 INFO:teuthology.orchestra.run.gibba020.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [156 kB] 2021-03-10T13:40:02.699 INFO:teuthology.orchestra.run.gibba020.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [23.3 kB] 2021-03-10T13:40:02.700 INFO:teuthology.orchestra.run.gibba020.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [749 kB] 2021-03-10T13:40:02.733 INFO:teuthology.orchestra.run.gibba020.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [431 kB] 2021-03-10T13:40:02.749 INFO:teuthology.orchestra.run.gibba020.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [558 kB] 2021-03-10T13:40:02.764 INFO:teuthology.orchestra.run.gibba020.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [157 kB] 2021-03-10T13:40:02.765 INFO:teuthology.orchestra.run.gibba020.stdout:Get:22 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [79.6 kB] 2021-03-10T13:40:02.768 INFO:teuthology.orchestra.run.gibba020.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [16.2 kB] 2021-03-10T13:40:02.770 INFO:teuthology.orchestra.run.gibba020.stdout:Get:24 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [10.5 kB] 2021-03-10T13:40:04.780 INFO:teuthology.orchestra.run.gibba020.stdout:Fetched 5,542 kB in 2s (3,642 kB/s) 2021-03-10T13:40:05.772 INFO:teuthology.orchestra.run.gibba020.stdout:Reading package lists... 2021-03-10T13:40:05.783 DEBUG:teuthology.orchestra.run.gibba020:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-03-10T13:40:05.818 INFO:teuthology.orchestra.run.gibba020.stdout:Reading package lists... 2021-03-10T13:40:05.912 INFO:teuthology.orchestra.run.gibba020.stdout:Building dependency tree... 2021-03-10T13:40:05.913 INFO:teuthology.orchestra.run.gibba020.stdout:Reading state information... 2021-03-10T13:40:05.957 INFO:teuthology.orchestra.run.gibba020.stderr:E: Unable to locate package linux-image-current-generic 2021-03-10T13:40:05.957 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-03-10T13:40:05.958 DEBUG:teuthology.orchestra.run.gibba020:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-03-10T13:40:05.994 INFO:teuthology.orchestra.run.gibba020.stdout:Reading package lists... 2021-03-10T13:40:06.086 INFO:teuthology.orchestra.run.gibba020.stdout:Building dependency tree... 2021-03-10T13:40:06.087 INFO:teuthology.orchestra.run.gibba020.stdout:Reading state information... 2021-03-10T13:40:06.173 INFO:teuthology.orchestra.run.gibba020.stdout:linux-image-generic is already the newest version (5.4.0.66.69). 2021-03-10T13:40:06.173 INFO:teuthology.orchestra.run.gibba020.stdout:linux-image-generic set to manually installed. 2021-03-10T13:40:06.173 INFO:teuthology.orchestra.run.gibba020.stdout:0 upgraded, 0 newly installed, 0 to remove and 9 not upgraded. 2021-03-10T13:40:06.174 DEBUG:teuthology.orchestra.run.gibba020:> dpkg -s linux-image-generic 2021-03-10T13:40:06.228 INFO:teuthology.orchestra.run.gibba020.stdout:Package: linux-image-generic 2021-03-10T13:40:06.228 INFO:teuthology.orchestra.run.gibba020.stdout:Status: install ok installed 2021-03-10T13:40:06.228 INFO:teuthology.orchestra.run.gibba020.stdout:Priority: optional 2021-03-10T13:40:06.229 INFO:teuthology.orchestra.run.gibba020.stdout:Section: kernel 2021-03-10T13:40:06.229 INFO:teuthology.orchestra.run.gibba020.stdout:Installed-Size: 18 2021-03-10T13:40:06.229 INFO:teuthology.orchestra.run.gibba020.stdout:Maintainer: Ubuntu Kernel Team 2021-03-10T13:40:06.229 INFO:teuthology.orchestra.run.gibba020.stdout:Architecture: amd64 2021-03-10T13:40:06.230 INFO:teuthology.orchestra.run.gibba020.stdout:Source: linux-meta 2021-03-10T13:40:06.230 INFO:teuthology.orchestra.run.gibba020.stdout:Version: 5.4.0.66.69 2021-03-10T13:40:06.230 INFO:teuthology.orchestra.run.gibba020.stdout:Provides: virtualbox-guest-modules (= 6.1.16-dfsg-6~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.6) 2021-03-10T13:40:06.230 INFO:teuthology.orchestra.run.gibba020.stdout:Depends: linux-image-5.4.0-66-generic, linux-modules-extra-5.4.0-66-generic, linux-firmware, intel-microcode, amd64-microcode 2021-03-10T13:40:06.230 INFO:teuthology.orchestra.run.gibba020.stdout:Recommends: thermald 2021-03-10T13:40:06.231 INFO:teuthology.orchestra.run.gibba020.stdout:Description: Generic Linux kernel image 2021-03-10T13:40:06.231 INFO:teuthology.orchestra.run.gibba020.stdout: This package will always depend on the latest generic kernel image 2021-03-10T13:40:06.231 INFO:teuthology.orchestra.run.gibba020.stdout: available. 2021-03-10T13:40:06.231 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2021-03-10T13:40:06.232 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2021-03-10T13:40:06.232 DEBUG:teuthology.orchestra.run.gibba013:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-03-10T13:40:06.253 INFO:teuthology.orchestra.run.gibba013.stdout:ttyS1 2021-03-10T13:40:06.291 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2021-03-10T13:40:06.292 DEBUG:teuthology.orchestra.run.gibba020:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-03-10T13:40:06.309 INFO:teuthology.orchestra.run.gibba020.stdout:ttyS1 2021-03-10T13:40:06.337 INFO:teuthology.run_tasks:Running task internal.base... 2021-03-10T13:40:06.348 INFO:teuthology.task.internal:Creating test directory... 2021-03-10T13:40:06.349 DEBUG:teuthology.orchestra.run.gibba013:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-03-10T13:40:06.352 DEBUG:teuthology.orchestra.run.gibba020:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-03-10T13:40:06.386 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-03-10T13:40:06.444 INFO:teuthology.run_tasks:Running task internal.archive... 2021-03-10T13:40:06.463 INFO:teuthology.task.internal:Creating archive directory... 2021-03-10T13:40:06.464 DEBUG:teuthology.orchestra.run.gibba013:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-03-10T13:40:06.467 DEBUG:teuthology.orchestra.run.gibba020:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-03-10T13:40:06.481 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-03-10T13:40:06.492 INFO:teuthology.task.internal:Enabling coredump saving... 2021-03-10T13:40:06.493 DEBUG:teuthology.orchestra.run.gibba013:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-03-10T13:40:06.516 DEBUG:teuthology.orchestra.run.gibba020:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-03-10T13:40:06.539 INFO:teuthology.orchestra.run.gibba013.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-10T13:40:06.539 INFO:teuthology.orchestra.run.gibba020.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-10T13:40:06.542 INFO:teuthology.orchestra.run.gibba020.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-10T13:40:06.547 INFO:teuthology.orchestra.run.gibba013.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-10T13:40:06.548 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-03-10T13:40:06.558 INFO:teuthology.task.internal:Configuring sudo... 2021-03-10T13:40:06.559 DEBUG:teuthology.orchestra.run.gibba013:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-03-10T13:40:06.561 DEBUG:teuthology.orchestra.run.gibba020:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-03-10T13:40:06.569 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-03-10T13:40:06.580 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-03-10T13:40:06.581 DEBUG:teuthology.orchestra.run.gibba013:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-03-10T13:40:06.611 DEBUG:teuthology.orchestra.run.gibba020:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-03-10T13:40:06.621 DEBUG:teuthology.orchestra.run.gibba013:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-03-10T13:40:06.629 DEBUG:teuthology.orchestra.run.gibba013:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-03-10T13:40:06.638 DEBUG:teuthology.orchestra.run.gibba013:> set -ex 2021-03-10T13:40:06.638 DEBUG:teuthology.orchestra.run.gibba013:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-03-10T13:40:06.693 DEBUG:teuthology.orchestra.run.gibba020:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-03-10T13:40:06.702 DEBUG:teuthology.orchestra.run.gibba020:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-03-10T13:40:06.707 DEBUG:teuthology.orchestra.run.gibba020:> set -ex 2021-03-10T13:40:06.707 DEBUG:teuthology.orchestra.run.gibba020:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-03-10T13:40:06.718 DEBUG:teuthology.orchestra.run.gibba013:> sudo service rsyslog restart 2021-03-10T13:40:06.722 DEBUG:teuthology.orchestra.run.gibba020:> sudo service rsyslog restart 2021-03-10T13:40:06.793 INFO:teuthology.run_tasks:Running task internal.timer... 2021-03-10T13:40:06.804 INFO:teuthology.task.internal:Starting timer... 2021-03-10T13:40:06.805 INFO:teuthology.run_tasks:Running task pcp... 2021-03-10T13:40:06.823 INFO:teuthology.run_tasks:Running task selinux... 2021-03-10T13:40:06.839 DEBUG:teuthology.task.selinux:Excluding gibba013: OS 'ubuntu' does not support SELinux 2021-03-10T13:40:06.839 DEBUG:teuthology.task.selinux:Excluding gibba020: OS 'ubuntu' does not support SELinux 2021-03-10T13:40:06.840 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-03-10T13:40:06.840 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2021-03-10T13:40:06.840 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-03-10T13:40:06.840 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-03-10T13:40:06.854 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated or references a specific commit; assuming it is current 2021-03-10T13:40:06.855 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2021-03-10T13:40:06.871 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2021-03-10T13:40:06.872 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit gibba013.front.sepia.ceph.com,gibba020.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-03-10T13:40:07.219 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-03-10T13:40:07.942 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-03-10T13:40:09.821 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-03-10T13:40:09.840 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:09 +0000 (0:00:00.033) 0:00:00.033 ******* 2021-03-10T13:40:09.852 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:09 +0000 (0:00:00.012) 0:00:00.045 ******* 2021-03-10T13:40:11.611 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-03-10T13:40:11.613 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host gibba020.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [gibba020.front.sepia.ceph.com] 2021-03-10T13:40:11.662 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:11 +0000 (0:00:01.809) 0:00:01.855 ******* 2021-03-10T13:40:11.672 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host gibba013.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [gibba013.front.sepia.ceph.com] 2021-03-10T13:40:11.722 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:11 +0000 (0:00:00.059) 0:00:01.915 ******* 2021-03-10T13:40:11.872 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2021-03-10T13:40:11.874 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-03-10T13:40:11.894 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:11 +0000 (0:00:00.172) 0:00:02.087 ******* 2021-03-10T13:40:11.900 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-03-10T13:40:11.924 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:11 +0000 (0:00:00.029) 0:00:02.117 ******* 2021-03-10T13:40:12.496 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2021-03-10T13:40:12.500 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-03-10T13:40:12.519 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:12 +0000 (0:00:00.595) 0:00:02.713 ******* 2021-03-10T13:40:12.525 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-03-10T13:40:12.549 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:12 +0000 (0:00:00.029) 0:00:02.742 ******* 2021-03-10T13:40:12.802 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2021-03-10T13:40:12.803 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.041639", "end": "2021-03-10 13:40:12.748572", "rc": 0, "start": "2021-03-10 13:40:12.706933", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-03-10T13:40:12.823 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:12 +0000 (0:00:00.274) 0:00:03.017 ******* 2021-03-10T13:40:12.829 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.047512", "end": "2021-03-10 13:40:13.074171", "rc": 0, "start": "2021-03-10 13:40:13.026659", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-03-10T13:40:12.855 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:12 +0000 (0:00:00.031) 0:00:03.048 ******* 2021-03-10T13:40:13.036 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2021-03-10T13:40:13.038 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} ok: [gibba013.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-10T13:40:13.061 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:13 +0000 (0:00:00.206) 0:00:03.254 ******* 2021-03-10T13:40:13.080 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:13 +0000 (0:00:00.019) 0:00:03.273 ******* 2021-03-10T13:40:13.776 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2021-03-10T13:40:13.777 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615383613.1085267-5689-136526402619213/source", "state": "file", "uid": 0} 2021-03-10T13:40:13.798 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:13 +0000 (0:00:00.717) 0:00:03.991 ******* 2021-03-10T13:40:13.804 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615383613.089951-5685-250191275685188/source", "state": "file", "uid": 0} 2021-03-10T13:40:13.828 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:13 +0000 (0:00:00.030) 0:00:04.021 ******* 2021-03-10T13:40:14.278 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2021-03-10T13:40:14.280 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4 2021-03-10T13:40:14.282 INFO:teuthology.task.ansible.out:r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-03-10T13:40:14.306 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4 2021-03-10T13:40:14.308 INFO:teuthology.task.ansible.out:r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-03-10T13:40:14.382 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2021-03-10T13:40:14.385 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-03-10T13:40:14.543 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:14 +0000 (0:00:00.715) 0:00:04.736 ******* 2021-03-10T13:40:14.564 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:14 +0000 (0:00:00.020) 0:00:04.757 ******* 2021-03-10T13:40:15.184 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [gibba013.front.sepia.ceph.com] 2021-03-10T13:40:15.237 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2021-03-10T13:40:15.239 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:15 +0000 (0:00:00.673) 0:00:05.431 ******* 2021-03-10T13:40:15.620 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-03-10T13:40:15.622 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.136704", "end": "2021-03-10 13:40:15.600621", "rc": 0, "start": "2021-03-10 13:40:15.463917", "stderr": "", "stderr_lines": [], "stdout": "c31004c4720a55ac12a95d66c32e64f592877604", "stdout_lines": ["c31004c4720a55ac12a95d66c32e64f592877604"]} 2021-03-10T13:40:15.643 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:15 +0000 (0:00:00.405) 0:00:05.836 ******* 2021-03-10T13:40:15.751 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-03-10T13:40:15.753 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.008379", "end": "2021-03-10 13:40:16.012038", "failed_when_result": false, "rc": 0, "start": "2021-03-10 13:40:16.003659", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-03-10T13:40:15.775 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:15 +0000 (0:00:00.132) 0:00:05.969 ******* 2021-03-10T13:40:15.834 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** 2021-03-10T13:40:15.835 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:15.857 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:15 +0000 (0:00:00.081) 0:00:06.050 ******* 2021-03-10T13:40:15.925 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ 2021-03-10T13:40:15.927 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:15.947 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:15 +0000 (0:00:00.090) 0:00:06.140 ******* 2021-03-10T13:40:16.015 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2021-03-10T13:40:16.016 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:16.038 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:16 +0000 (0:00:00.091) 0:00:06.232 ******* 2021-03-10T13:40:16.106 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* 2021-03-10T13:40:16.108 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:16.128 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:16 +0000 (0:00:00.089) 0:00:06.321 ******* 2021-03-10T13:40:16.195 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2021-03-10T13:40:16.196 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:16.219 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:16 +0000 (0:00:00.090) 0:00:06.412 ******* 2021-03-10T13:40:16.229 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-03-10T13:40:16.230 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] 2021-03-10T13:40:16.283 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:16 +0000 (0:00:00.064) 0:00:06.477 ******* 2021-03-10T13:40:16.351 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-03-10T13:40:16.353 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-10T13:40:16.377 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:16 +0000 (0:00:00.093) 0:00:06.570 ******* 2021-03-10T13:40:16.572 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-03-10T13:40:16.574 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-03-10T13:40:16.646 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-03-10T13:40:16.647 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.143611", "end": "2021-03-10 13:40:16.626381", "rc": 0, "start": "2021-03-10 13:40:16.482770", "stderr": "", "stderr_lines": [], "stdout": "c31004c4720a55ac12a95d66c32e64f592877604", "stdout_lines": ["c31004c4720a55ac12a95d66c32e64f592877604"]} 2021-03-10T13:40:16.671 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:16 +0000 (0:00:00.293) 0:00:06.864 ******* 2021-03-10T13:40:16.677 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-03-10T13:40:16.677 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-03-10T13:40:16.762 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-03-10T13:40:16.763 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-03-10T13:40:16.763 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.004675", "end": "2021-03-10 13:40:16.708027", "failed_when_result": false, "rc": 0, "start": "2021-03-10 13:40:16.703352", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-03-10T13:40:16.785 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:16 +0000 (0:00:00.114) 0:00:06.978 ******* 2021-03-10T13:40:16.852 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-03-10T13:40:16.853 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} TASK [Determine if we can skip users and pubkeys updates] ********************** skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:16.875 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:16 +0000 (0:00:00.090) 0:00:07.068 ******* 2021-03-10T13:40:16.942 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-03-10T13:40:16.943 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-03-10T13:40:16.954 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ 2021-03-10T13:40:16.956 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:16.976 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:16 +0000 (0:00:00.101) 0:00:07.169 ******* 2021-03-10T13:40:17.033 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-03-10T13:40:17.035 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-03-10T13:40:17.045 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2021-03-10T13:40:17.046 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:17.070 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:17 +0000 (0:00:00.093) 0:00:07.263 ******* 2021-03-10T13:40:17.127 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-03-10T13:40:17.129 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-03-10T13:40:17.139 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* 2021-03-10T13:40:17.141 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:17.163 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:17 +0000 (0:00:00.092) 0:00:07.356 ******* 2021-03-10T13:40:17.221 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-03-10T13:40:17.222 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-03-10T13:40:17.233 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2021-03-10T13:40:17.234 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:17.257 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:17 +0000 (0:00:00.094) 0:00:07.450 ******* 2021-03-10T13:40:17.315 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-03-10T13:40:17.317 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-03-10T13:40:17.399 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-03-10T13:40:17.401 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [Create all admin users with sudo access.] ******************************** ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-03-10T13:40:17.429 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:17 +0000 (0:00:00.171) 0:00:07.622 ******* 2021-03-10T13:40:17.497 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-03-10T13:40:17.582 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-03-10T13:40:17.656 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-03-10T13:40:17.668 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-03-10T13:40:17.742 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-03-10T13:40:17.764 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-03-10T13:40:17.839 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-03-10T13:40:17.861 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-03-10T13:40:17.925 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-03-10T13:40:17.948 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-03-10T13:40:18.024 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-03-10T13:40:18.046 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-03-10T13:40:18.112 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-03-10T13:40:18.134 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-03-10T13:40:18.198 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-03-10T13:40:18.230 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-03-10T13:40:18.283 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-03-10T13:40:18.316 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-03-10T13:40:18.369 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-03-10T13:40:18.401 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-03-10T13:40:18.464 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-03-10T13:40:18.496 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-03-10T13:40:18.549 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-03-10T13:40:18.633 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-03-10T13:40:18.645 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-03-10T13:40:18.718 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-03-10T13:40:18.729 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-03-10T13:40:18.813 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-03-10T13:40:18.824 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-03-10T13:40:18.898 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-03-10T13:40:18.919 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-03-10T13:40:18.993 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-03-10T13:40:19.004 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-03-10T13:40:19.088 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-03-10T13:40:19.100 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-03-10T13:40:19.185 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-03-10T13:40:19.196 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-03-10T13:40:19.270 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-03-10T13:40:19.281 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-03-10T13:40:19.375 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-03-10T13:40:19.397 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-03-10T13:40:19.460 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-03-10T13:40:19.481 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-03-10T13:40:19.555 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-03-10T13:40:19.577 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-03-10T13:40:19.651 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-03-10T13:40:19.673 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-03-10T13:40:19.746 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-03-10T13:40:19.758 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-03-10T13:40:19.843 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-03-10T13:40:19.855 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-03-10T13:40:19.929 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-03-10T13:40:19.951 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-03-10T13:40:20.035 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-03-10T13:40:20.046 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-03-10T13:40:20.120 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-03-10T13:40:20.141 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-03-10T13:40:20.214 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-03-10T13:40:20.226 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-03-10T13:40:20.299 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-03-10T13:40:20.324 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-03-10T13:40:20.397 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-03-10T13:40:20.419 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-03-10T13:40:20.493 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-03-10T13:40:20.514 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-03-10T13:40:20.577 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-03-10T13:40:20.599 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-03-10T13:40:20.673 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-03-10T13:40:20.694 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-03-10T13:40:20.757 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-03-10T13:40:20.789 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-03-10T13:40:20.852 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-03-10T13:40:20.874 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-03-10T13:40:20.947 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-03-10T13:40:20.969 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-03-10T13:40:21.032 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-03-10T13:40:21.054 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-03-10T13:40:21.129 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-03-10T13:40:21.140 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-03-10T13:40:21.214 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-03-10T13:40:21.236 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-03-10T13:40:21.299 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-03-10T13:40:21.331 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-03-10T13:40:21.393 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-03-10T13:40:21.415 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-03-10T13:40:21.478 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-03-10T13:40:21.499 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-03-10T13:40:21.562 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-03-10T13:40:21.594 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-03-10T13:40:21.657 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-03-10T13:40:21.678 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-03-10T13:40:21.741 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-03-10T13:40:21.773 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-03-10T13:40:21.836 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-03-10T13:40:21.858 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-03-10T13:40:21.931 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-03-10T13:40:21.953 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-03-10T13:40:22.026 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-03-10T13:40:22.048 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-03-10T13:40:22.131 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-03-10T13:40:22.132 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-03-10T13:40:22.226 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-03-10T13:40:22.228 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-03-10T13:40:22.228 INFO:teuthology.task.ansible.out: 2021-03-10T13:40:22.313 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-03-10T13:40:22.314 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-03-10T13:40:22.398 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-03-10T13:40:22.409 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-03-10T13:40:22.494 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-03-10T13:40:22.495 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-03-10T13:40:22.579 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-03-10T13:40:22.601 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-03-10T13:40:22.675 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-03-10T13:40:22.688 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-03-10T13:40:22.772 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-03-10T13:40:22.774 INFO:teuthology.task.ansible.out: 2021-03-10T13:40:22.794 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-03-10T13:40:22.858 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-03-10T13:40:22.880 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-03-10T13:40:22.953 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-03-10T13:40:22.965 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-03-10T13:40:23.049 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-03-10T13:40:23.060 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-03-10T13:40:23.144 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-03-10T13:40:23.155 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-03-10T13:40:23.239 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-03-10T13:40:23.240 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-03-10T13:40:23.334 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-03-10T13:40:23.335 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-03-10T13:40:23.429 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-03-10T13:40:23.431 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-03-10T13:40:23.525 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-03-10T13:40:23.526 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-03-10T13:40:23.609 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-03-10T13:40:23.621 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-03-10T13:40:23.704 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-03-10T13:40:23.705 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-03-10T13:40:23.789 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-03-10T13:40:23.800 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-03-10T13:40:23.885 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-03-10T13:40:23.896 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-03-10T13:40:23.980 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-03-10T13:40:23.991 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-03-10T13:40:24.065 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-03-10T13:40:24.076 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-03-10T13:40:24.160 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-03-10T13:40:24.171 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-03-10T13:40:24.255 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-03-10T13:40:24.266 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-03-10T13:40:24.350 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-03-10T13:40:24.351 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-03-10T13:40:24.435 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-03-10T13:40:24.436 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-03-10T13:40:24.530 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-03-10T13:40:24.531 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-03-10T13:40:24.625 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-03-10T13:40:24.626 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-03-10T13:40:24.710 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-03-10T13:40:24.712 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-03-10T13:40:24.806 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-03-10T13:40:24.807 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-03-10T13:40:24.891 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-03-10T13:40:24.902 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-03-10T13:40:24.986 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-03-10T13:40:24.998 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-03-10T13:40:25.082 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-03-10T13:40:25.083 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-03-10T13:40:25.178 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-03-10T13:40:25.189 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-03-10T13:40:25.273 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-03-10T13:40:25.274 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-03-10T13:40:25.359 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-03-10T13:40:25.370 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-03-10T13:40:25.453 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-03-10T13:40:25.465 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-03-10T13:40:25.539 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-03-10T13:40:25.550 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-03-10T13:40:25.634 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-03-10T13:40:25.645 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-03-10T13:40:25.719 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-03-10T13:40:25.730 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-03-10T13:40:25.815 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-03-10T13:40:25.816 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-03-10T13:40:25.899 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-03-10T13:40:25.911 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-03-10T13:40:25.996 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-03-10T13:40:25.997 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-03-10T13:40:26.081 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-03-10T13:40:26.083 INFO:teuthology.task.ansible.out: 2021-03-10T13:40:26.093 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-03-10T13:40:26.177 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-03-10T13:40:26.188 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-03-10T13:40:26.272 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-03-10T13:40:26.283 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-03-10T13:40:26.367 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-03-10T13:40:26.378 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-03-10T13:40:26.452 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-03-10T13:40:26.463 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-03-10T13:40:26.546 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-03-10T13:40:26.558 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-03-10T13:40:26.641 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-03-10T13:40:26.642 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-03-10T13:40:26.726 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-03-10T13:40:26.737 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-03-10T13:40:26.820 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-03-10T13:40:26.821 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-03-10T13:40:26.915 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-03-10T13:40:26.916 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-03-10T13:40:27.000 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-03-10T13:40:27.001 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-03-10T13:40:27.094 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-03-10T13:40:27.095 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-03-10T13:40:27.179 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-03-10T13:40:27.190 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-03-10T13:40:27.274 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-03-10T13:40:27.286 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-03-10T13:40:27.369 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-03-10T13:40:27.370 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-03-10T13:40:27.454 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-03-10T13:40:27.476 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-03-10T13:40:27.549 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-03-10T13:40:27.560 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-03-10T13:40:27.633 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-03-10T13:40:27.645 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-03-10T13:40:27.728 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-03-10T13:40:27.796 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-03-10T13:40:27.823 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-03-10T13:40:27.834 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-03-10T13:40:27.907 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-03-10T13:40:27.918 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-03-10T13:40:28.001 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-03-10T13:40:28.013 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-03-10T13:40:28.096 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-03-10T13:40:28.097 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-03-10T13:40:28.192 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-03-10T13:40:28.276 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-03-10T13:40:28.308 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-03-10T13:40:28.370 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-03-10T13:40:28.402 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-03-10T13:40:28.456 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-03-10T13:40:28.498 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-03-10T13:40:28.552 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-03-10T13:40:28.594 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-03-10T13:40:28.677 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-03-10T13:40:28.678 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-03-10T13:40:28.772 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-03-10T13:40:28.773 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-03-10T13:40:28.856 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-03-10T13:40:28.867 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-03-10T13:40:28.950 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-03-10T13:40:28.962 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-03-10T13:40:29.035 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-03-10T13:40:29.056 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-03-10T13:40:29.129 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-03-10T13:40:29.151 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-03-10T13:40:29.224 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-03-10T13:40:29.246 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-03-10T13:40:29.308 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-03-10T13:40:29.330 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-03-10T13:40:29.403 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-03-10T13:40:29.425 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-03-10T13:40:29.515 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-03-10T13:40:29.538 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:29 +0000 (0:00:12.109) 0:00:19.731 ******* 2021-03-10T13:40:29.579 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-03-10T13:40:29.674 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-03-10T13:40:29.706 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-03-10T13:40:29.728 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:29 +0000 (0:00:00.189) 0:00:19.921 ******* 2021-03-10T13:40:29.764 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-03-10T13:40:29.765 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-03-10T13:40:29.808 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-03-10T13:40:29.809 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora r 2021-03-10T13:40:29.811 INFO:teuthology.task.ansible.out:T6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c 2021-03-10T13:40:29.813 INFO:teuthology.task.ansible.out:63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD 2021-03-10T13:40:29.814 INFO:teuthology.task.ansible.out:0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9d 2021-03-10T13:40:29.816 INFO:teuthology.task.ansible.out:f7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 2021-03-10T13:40:29.817 INFO:teuthology.task.ansible.out:4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953 2021-03-10T13:40:29.819 INFO:teuthology.task.ansible.out:cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9 2021-03-10T13:40:29.819 INFO:teuthology.task.ansible.out:d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7 2021-03-10T13:40:29.821 INFO:teuthology.task.ansible.out:cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef148 2021-03-10T13:40:29.823 INFO:teuthology.task.ansible.out:0c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017 2021-03-10T13:40:29.824 INFO:teuthology.task.ansible.out:b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214b 2021-03-10T13:40:29.826 INFO:teuthology.task.ansible.out:bea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez 2021-03-10T13:40:29.827 INFO:teuthology.task.ansible.out:@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed1 2021-03-10T13:40:29.829 INFO:teuthology.task.ansible.out:9b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}]}, "changed": false} 2021-03-10T13:40:29.846 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:29 +0000 (0:00:00.118) 0:00:20.039 ******* 2021-03-10T13:40:29.863 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-03-10T13:40:29.865 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-03-10T13:40:30.072 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-03-10T13:40:30.167 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-03-10T13:40:30.271 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-03-10T13:40:30.356 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-03-10T13:40:30.451 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-03-10T13:40:30.653 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:30 +0000 (0:00:00.806) 0:00:20.846 ******* 2021-03-10T13:40:30.659 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-03-10T13:40:30.660 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"after": "c31004c4720a55ac12a95d66c32e64f592877604", "attempts": 1, "before": "c31004c4720a55ac12a95d66c32e64f592877604", "changed": false, "remote_url_changed": false} 2021-03-10T13:40:30.687 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:30 +0000 (0:00:00.034) 0:00:20.880 ******* 2021-03-10T13:40:30.714 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-03-10T13:40:30.738 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:30 +0000 (0:00:00.050) 0:00:20.931 ******* 2021-03-10T13:40:30.817 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-03-10T13:40:30.819 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora r 2021-03-10T13:40:30.821 INFO:teuthology.task.ansible.out:T6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c 2021-03-10T13:40:30.823 INFO:teuthology.task.ansible.out:63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD 2021-03-10T13:40:30.824 INFO:teuthology.task.ansible.out:0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9d 2021-03-10T13:40:30.826 INFO:teuthology.task.ansible.out:f7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw 2021-03-10T13:40:30.827 INFO:teuthology.task.ansible.out: fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 2021-03-10T13:40:30.828 INFO:teuthology.task.ansible.out:4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953 2021-03-10T13:40:30.830 INFO:teuthology.task.ansible.out:cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7 2021-03-10T13:40:30.831 INFO:teuthology.task.ansible.out:cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef148 2021-03-10T13:40:30.833 INFO:teuthology.task.ansible.out:0c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017 2021-03-10T13:40:30.835 INFO:teuthology.task.ansible.out:b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArN 2021-03-10T13:40:30.835 INFO:teuthology.task.ansible.out:hsAMXq/nkSC9tKDig 131b8214b 2021-03-10T13:40:30.837 INFO:teuthology.task.ansible.out:bea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez 2021-03-10T13:40:30.838 INFO:teuthology.task.ansible.out:@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed1 2021-03-10T13:40:30.840 INFO:teuthology.task.ansible.out:9b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}]}, "changed": false} 2021-03-10T13:40:30.864 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:30 +0000 (0:00:00.126) 0:00:21.057 ******* 2021-03-10T13:40:30.880 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-10T13:40:30.881 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-03-10T13:40:30.974 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-03-10T13:40:31.068 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-03-10T13:40:31.183 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZt 2021-03-10T13:40:31.185 INFO:teuthology.task.ansible.out:IEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-03-10T13:40:31.297 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-03-10T13:40:31.401 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o 2021-03-10T13:40:31.403 INFO:teuthology.task.ansible.out:8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-03-10T13:40:31.412 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-03-10T13:40:31.414 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"after": "c31004c4720a55ac12a95d66c32e64f592877604", "attempts": 1, "before": "c31004c4720a55ac12a95d66c32e64f592877604", "changed": false, "remote_url_changed": false} 2021-03-10T13:40:31.435 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:31 +0000 (0:00:00.571) 0:00:21.629 ******* 2021-03-10T13:40:31.493 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-10T13:40:31.494 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-03-10T13:40:31.587 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-03-10T13:40:31.618 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-03-10T13:40:31.681 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-03-10T13:40:31.692 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:31.724 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-03-10T13:40:31.787 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMorb 2021-03-10T13:40:31.789 INFO:teuthology.task.ansible.out:nuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-03-10T13:40:31.829 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-03-10T13:40:31.871 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemers 2021-03-10T13:40:31.873 INFO:teuthology.task.ansible.out:on", "validate_certs": true} 2021-03-10T13:40:31.882 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:31.893 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:31.945 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZt 2021-03-10T13:40:31.947 INFO:teuthology.task.ansible.out:IEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-03-10T13:40:31.987 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-03-10T13:40:32.060 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-03-10T13:40:32.083 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSo 2021-03-10T13:40:32.084 INFO:teuthology.task.ansible.out:AWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-03-10T13:40:32.176 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o 2021-03-10T13:40:32.178 INFO:teuthology.task.ansible.out:8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-03-10T13:40:32.271 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": n 2021-03-10T13:40:32.273 INFO:teuthology.task.ansible.out:ull, "state": "present", "user": "davidz", "validate_certs": true} 2021-03-10T13:40:32.282 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-03-10T13:40:32.365 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-03-10T13:40:32.397 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-03-10T13:40:32.460 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-03-10T13:40:32.512 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-03-10T13:40:32.523 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:32.554 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-03-10T13:40:32.637 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMorb 2021-03-10T13:40:32.639 INFO:teuthology.task.ansible.out:nuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-03-10T13:40:32.648 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9C 2021-03-10T13:40:32.650 INFO:teuthology.task.ansible.out:kxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-03-10T13:40:32.742 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBYB 2021-03-10T13:40:32.744 INFO:teuthology.task.ansible.out:0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-03-10T13:40:32.753 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemers 2021-03-10T13:40:32.755 INFO:teuthology.task.ansible.out:on", "validate_certs": true} 2021-03-10T13:40:32.764 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:32.766 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:32.827 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-03-10T13:40:32.889 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-03-10T13:40:32.921 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-03-10T13:40:32.994 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSo 2021-03-10T13:40:32.996 INFO:teuthology.task.ansible.out:AWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-03-10T13:40:33.015 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46T 2021-03-10T13:40:33.017 INFO:teuthology.task.ansible.out:RJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-03-10T13:40:33.099 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-03-10T13:40:33.109 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-03-10T13:40:33.193 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-03-10T13:40:33.214 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": n 2021-03-10T13:40:33.216 INFO:teuthology.task.ansible.out:ull, "state": "present", "user": "davidz", "validate_certs": true} 2021-03-10T13:40:33.288 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-03-10T13:40:33.319 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-03-10T13:40:33.392 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-03-10T13:40:33.414 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-03-10T13:40:33.487 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-03-10T13:40:33.508 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-03-10T13:40:33.581 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvU 2021-03-10T13:40:33.583 INFO:teuthology.task.ansible.out:xUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-03-10T13:40:33.592 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9C 2021-03-10T13:40:33.594 INFO:teuthology.task.ansible.out:kxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-03-10T13:40:33.676 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-03-10T13:40:33.697 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBYB 2021-03-10T13:40:33.699 INFO:teuthology.task.ansible.out:0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-03-10T13:40:33.770 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-03-10T13:40:33.802 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-03-10T13:40:33.864 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-03-10T13:40:33.896 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-03-10T13:40:33.959 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-03-10T13:40:33.990 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46T 2021-03-10T13:40:33.992 INFO:teuthology.task.ansible.out:RJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-03-10T13:40:34.053 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2021-03-10T13:40:34.085 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-03-10T13:40:34.148 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-03-10T13:40:34.179 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-03-10T13:40:34.242 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-03-10T13:40:34.264 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-03-10T13:40:34.337 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-03-10T13:40:34.359 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-03-10T13:40:34.433 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-03-10T13:40:34.444 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-03-10T13:40:34.527 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1O 2021-03-10T13:40:34.529 INFO:teuthology.task.ansible.out:MJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-03-10T13:40:34.539 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvU 2021-03-10T13:40:34.540 INFO:teuthology.task.ansible.out:xUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-03-10T13:40:34.622 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz 2021-03-10T13:40:34.624 INFO:teuthology.task.ansible.out:2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-03-10T13:40:34.633 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-03-10T13:40:34.728 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-03-10T13:40:34.730 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-03-10T13:40:34.812 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-03-10T13:40:34.833 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-03-10T13:40:34.906 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-03-10T13:40:34.917 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-03-10T13:40:34.991 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2021-03-10T13:40:35.012 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nul 2021-03-10T13:40:35.014 INFO:teuthology.task.ansible.out:l, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-03-10T13:40:35.085 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-03-10T13:40:35.096 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEf 2021-03-10T13:40:35.098 INFO:teuthology.task.ansible.out:dVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dT 2021-03-10T13:40:35.100 INFO:teuthology.task.ansible.out:zNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-03-10T13:40:35.180 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-03-10T13:40:35.202 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-03-10T13:40:35.275 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-03-10T13:40:35.296 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-03-10T13:40:35.370 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-03-10T13:40:35.391 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-03-10T13:40:35.454 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1O 2021-03-10T13:40:35.456 INFO:teuthology.task.ansible.out:MJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-03-10T13:40:35.475 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-03-10T13:40:35.548 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz 2021-03-10T13:40:35.550 INFO:teuthology.task.ansible.out:2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-03-10T13:40:35.570 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-03-10T13:40:35.643 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-03-10T13:40:35.664 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home/ 2021-03-10T13:40:35.666 INFO:teuthology.task.ansible.out:nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-03-10T13:40:35.738 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-03-10T13:40:35.759 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-03-10T13:40:35.822 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-03-10T13:40:35.853 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-03-10T13:40:35.917 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nul 2021-03-10T13:40:35.918 INFO:teuthology.task.ansible.out:l, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-03-10T13:40:35.949 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "g 2021-03-10T13:40:35.950 INFO:teuthology.task.ansible.out:abrioux", "validate_certs": true} 2021-03-10T13:40:36.012 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEf 2021-03-10T13:40:36.014 INFO:teuthology.task.ansible.out:dVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dT 2021-03-10T13:40:36.015 INFO:teuthology.task.ansible.out:zNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-03-10T13:40:36.044 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-03-10T13:40:36.106 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-03-10T13:40:36.138 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-03-10T13:40:36.201 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-03-10T13:40:36.233 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kkk 2021-03-10T13:40:36.234 INFO:teuthology.task.ansible.out:e6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-03-10T13:40:36.295 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-03-10T13:40:36.327 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-03-10T13:40:36.390 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-03-10T13:40:36.422 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-03-10T13:40:36.474 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-03-10T13:40:36.516 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-03-10T13:40:36.578 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home/ 2021-03-10T13:40:36.580 INFO:teuthology.task.ansible.out:nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-03-10T13:40:36.600 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-03-10T13:40:36.663 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-03-10T13:40:36.695 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-03-10T13:40:36.757 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-03-10T13:40:36.779 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-03-10T13:40:36.851 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "g 2021-03-10T13:40:36.853 INFO:teuthology.task.ansible.out:abrioux", "validate_certs": true} 2021-03-10T13:40:36.883 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-03-10T13:40:36.966 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-03-10T13:40:36.988 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-03-10T13:40:37.071 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-03-10T13:40:37.113 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-03-10T13:40:37.167 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-03-10T13:40:37.229 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kkk 2021-03-10T13:40:37.231 INFO:teuthology.task.ansible.out:e6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-03-10T13:40:37.262 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-03-10T13:40:37.348 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-03-10T13:40:37.359 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-03-10T13:40:37.443 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-03-10T13:40:37.465 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-03-10T13:40:37.538 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-03-10T13:40:37.559 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-03-10T13:40:37.643 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-03-10T13:40:37.654 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-03-10T13:40:37.738 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-03-10T13:40:37.749 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-03-10T13:40:37.833 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-03-10T13:40:37.854 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-03-10T13:40:37.938 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-03-10T13:40:37.940 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-03-10T13:40:38.034 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-03-10T13:40:38.076 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-03-10T13:40:38.118 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-03-10T13:40:38.161 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-03-10T13:40:38.213 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1l 2021-03-10T13:40:38.215 INFO:teuthology.task.ansible.out:XTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-03-10T13:40:38.245 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-03-10T13:40:38.309 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-03-10T13:40:38.341 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-03-10T13:40:38.393 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-03-10T13:40:38.426 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-03-10T13:40:38.489 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-03-10T13:40:38.521 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-03-10T13:40:38.573 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-03-10T13:40:38.615 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-03-10T13:40:38.678 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.localdo 2021-03-10T13:40:38.680 INFO:teuthology.task.ansible.out:main", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-03-10T13:40:38.731 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-03-10T13:40:38.763 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2 2021-03-10T13:40:38.765 INFO:teuthology.task.ansible.out:z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-03-10T13:40:38.816 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-03-10T13:40:38.858 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-03-10T13:40:38.921 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-03-10T13:40:38.953 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-03-10T13:40:39.006 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-03-10T13:40:39.037 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-03-10T13:40:39.090 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-03-10T13:40:39.132 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-03-10T13:40:39.184 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-03-10T13:40:39.227 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-03-10T13:40:39.279 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1l 2021-03-10T13:40:39.281 INFO:teuthology.task.ansible.out:XTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-03-10T13:40:39.332 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-03-10T13:40:39.374 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-03-10T13:40:39.426 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-03-10T13:40:39.469 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-03-10T13:40:39.521 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loca 2021-03-10T13:40:39.523 INFO:teuthology.task.ansible.out:l", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-03-10T13:40:39.574 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-03-10T13:40:39.616 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-03-10T13:40:39.668 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-03-10T13:40:39.710 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-03-10T13:40:39.762 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.localdo 2021-03-10T13:40:39.764 INFO:teuthology.task.ansible.out:main", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-03-10T13:40:39.815 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-03-10T13:40:39.857 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2 2021-03-10T13:40:39.858 INFO:teuthology.task.ansible.out:z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-03-10T13:40:39.899 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-03-10T13:40:39.951 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-03-10T13:40:39.993 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-03-10T13:40:40.046 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-03-10T13:40:40.078 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-03-10T13:40:40.140 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-03-10T13:40:40.172 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", " 2021-03-10T13:40:40.174 INFO:teuthology.task.ansible.out:manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-03-10T13:40:40.225 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-03-10T13:40:40.257 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-03-10T13:40:40.320 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-03-10T13:40:40.352 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-03-10T13:40:40.425 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-03-10T13:40:40.447 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-03-10T13:40:40.520 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-03-10T13:40:40.541 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-03-10T13:40:40.614 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loca 2021-03-10T13:40:40.616 INFO:teuthology.task.ansible.out:l", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-03-10T13:40:40.636 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-03-10T13:40:40.700 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-03-10T13:40:40.721 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-03-10T13:40:40.795 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-03-10T13:40:40.806 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-03-10T13:40:40.890 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-03-10T13:40:40.901 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-03-10T13:40:40.985 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-03-10T13:40:40.996 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-03-10T13:40:41.079 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-03-10T13:40:41.081 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-03-10T13:40:41.174 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-03-10T13:40:41.185 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-03-10T13:40:41.269 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", " 2021-03-10T13:40:41.271 INFO:teuthology.task.ansible.out:manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-03-10T13:40:41.364 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-03-10T13:40:41.365 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-03-10T13:40:41.448 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-03-10T13:40:41.459 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-03-10T13:40:41.543 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-03-10T13:40:41.554 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-03-10T13:40:41.647 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-03-10T13:40:41.658 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-03-10T13:40:41.741 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-03-10T13:40:41.742 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-03-10T13:40:41.836 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-03-10T13:40:41.847 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-03-10T13:40:41.930 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-03-10T13:40:41.941 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjLd 2021-03-10T13:40:41.943 INFO:teuthology.task.ansible.out:+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-03-10T13:40:42.025 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-03-10T13:40:42.036 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-03-10T13:40:42.110 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-03-10T13:40:42.132 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-03-10T13:40:42.205 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-03-10T13:40:42.216 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-03-10T13:40:42.300 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-03-10T13:40:42.311 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-03-10T13:40:42.396 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-03-10T13:40:42.408 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-03-10T13:40:42.493 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-03-10T13:40:42.505 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-03-10T13:40:42.599 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-03-10T13:40:42.601 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-03-10T13:40:42.694 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-03-10T13:40:42.696 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-03-10T13:40:42.781 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-03-10T13:40:42.793 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-03-10T13:40:42.887 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-03-10T13:40:42.888 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-03-10T13:40:42.971 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-03-10T13:40:42.982 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-03-10T13:40:43.056 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-03-10T13:40:43.078 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjLd 2021-03-10T13:40:43.157 INFO:teuthology.task.ansible.out:+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-03-10T13:40:43.162 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-03-10T13:40:43.174 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-03-10T13:40:43.250 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-03-10T13:40:43.261 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-03-10T13:40:43.345 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-03-10T13:40:43.356 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-03-10T13:40:43.450 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-03-10T13:40:43.452 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-03-10T13:40:43.545 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-03-10T13:40:43.547 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_options": 2021-03-10T13:40:43.548 INFO:teuthology.task.ansible.out: null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-03-10T13:40:43.640 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-03-10T13:40:43.700 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-03-10T13:40:43.723 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:43 +0000 (0:00:12.287) 0:00:33.917 ******* 2021-03-10T13:40:43.775 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-03-10T13:40:43.818 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-10T13:40:43.819 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:43.829 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:43.839 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:43.841 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:43.851 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:43.852 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:43.862 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:43.873 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:43.874 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:43.884 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-10T13:40:43.886 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-03-10T13:40:43.979 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-03-10T13:40:43.981 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-10T13:40:43.981 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-03-10T13:40:43.983 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:43.993 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.077 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-10T13:40:44.079 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-10T13:40:44.079 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6 2021-03-10T13:40:44.081 INFO:teuthology.task.ansible.out:v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-03-10T13:40:44.164 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-03-10T13:40:44.174 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.176 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-03-10T13:40:44.186 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-10T13:40:44.188 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.198 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.199 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.210 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.211 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.221 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.232 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.234 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.244 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.245 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.255 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.266 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.267 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.277 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.279 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.288 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.290 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.300 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.311 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.312 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-10T13:40:44.313 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-03-10T13:40:44.314 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.325 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.327 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.336 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.338 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.348 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.349 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.359 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.370 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.371 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.381 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.383 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.392 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.394 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.404 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.405 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-03-10T13:40:44.415 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-10T13:40:44.417 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.427 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.429 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.438 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.440 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.450 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.461 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.463 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.472 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.474 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.484 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.485 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.495 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.497 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-03-10T13:40:44.507 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-10T13:40:44.509 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.519 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.520 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.530 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.541 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.552 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.553 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.563 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.574 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.575 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.585 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.586 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.597 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-10T13:40:44.599 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.601 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.611 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.613 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.622 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.625 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.633 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.644 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.646 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.655 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.657 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.667 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.668 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.678 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.689 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.690 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.700 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-10T13:40:44.702 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.702 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var" 2021-03-10T13:40:44.704 INFO:teuthology.task.ansible.out:: "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.712 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.714 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.724 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.725 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.735 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.746 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.746 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.757 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.759 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.768 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.779 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.781 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.790 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-10T13:40:44.792 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_options": 2021-03-10T13:40:44.794 INFO:teuthology.task.ansible.out: null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.803 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.804 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.814 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.815 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.825 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.836 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.837 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.847 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.849 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.858 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.869 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.871 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.881 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.882 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-03-10T13:40:44.895 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-10T13:40:44.896 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.919 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-10T13:40:44.950 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-10T13:40:44.951 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.952 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {" 2021-03-10T13:40:44.953 INFO:teuthology.task.ansible.out:ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.954 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Condit 2021-03-10T13:40:44.955 INFO:teuthology.task.ansible.out:ional result was False"} skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.978 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:44 +0000 (0:00:01.254) 0:00:35.171 ******* 2021-03-10T13:40:44.985 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.986 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:44.988 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.001 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.003 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.042 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:45 +0000 (0:00:00.063) 0:00:35.235 ******* 2021-03-10T13:40:45.059 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.060 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.070 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.071 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.082 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.092 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.094 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.104 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.105 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.115 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.138 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:45 +0000 (0:00:00.095) 0:00:35.331 ******* 2021-03-10T13:40:45.205 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-10T13:40:45.207 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-03-10T13:40:45.217 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.219 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.300 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-10T13:40:45.302 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "pres 2021-03-10T13:40:45.304 INFO:teuthology.task.ansible.out:ent", "user": "amaredia", "validate_certs": true} 2021-03-10T13:40:45.385 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-10T13:40:45.387 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [gibba020.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path" 2021-03-10T13:40:45.389 INFO:teuthology.task.ansible.out:: null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-03-10T13:40:45.398 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.399 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.409 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.420 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.422 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.432 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.433 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.443 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.444 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.455 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.456 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.466 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.477 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.478 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.488 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.490 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.499 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.510 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.512 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.522 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.523 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [gibba013.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.534 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.536 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.545 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.556 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.557 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.567 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.569 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.579 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.580 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.590 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.601 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.602 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.612 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.614 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [gibba013.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.624 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.626 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.635 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.646 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.648 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.657 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.659 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.669 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.679 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.681 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.691 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.692 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.702 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-10T13:40:45.704 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.715 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.726 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.727 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.737 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.738 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.748 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.759 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.761 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.770 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.772 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.781 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.792 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.794 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [gibba013.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-03-10T13:40:45.794 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.805 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.807 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.816 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.818 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.828 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.828 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.839 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.850 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.852 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.861 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.863 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.873 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.874 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [gibba013.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-03-10T13:40:45.884 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-10T13:40:45.886 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.896 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.898 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.907 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.908 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.919 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.930 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.931 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.941 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.943 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.952 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.963 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.965 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} TASK [Remove revoked users] **************************************************** ok: [gibba013.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-03-10T13:40:45.975 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-10T13:40:45.977 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.987 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:45.998 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:46.000 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:46.009 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:46.011 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:46.021 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:46.022 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:46.032 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:46.043 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:46.045 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:46.055 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:46.057 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [gibba013.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-03-10T13:40:46.059 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:46.068 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:46.069 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:46.080 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:46.082 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:46.091 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:46.102 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:46.104 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:46.114 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:46.116 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:46.126 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:46.127 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:46.137 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:46.139 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:46.149 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-10T13:40:46.150 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:46.161 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:46.163 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:46.172 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:46.173 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:46.184 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:46.186 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:46.196 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:46.197 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@thinkpad 5H//Tz6a0uBQDJiYlp9bIA 5ad4213c5f177c9d3586e58770208dd3e18f57d78f12d5d1a9dfa541d5c5c957\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:46.208 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:46.250 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:46 +0000 (0:00:01.112) 0:00:36.443 ******* 2021-03-10T13:40:46.257 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-10T13:40:46.259 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-03-10T13:40:46.322 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* 2021-03-10T13:40:46.324 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:46.344 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:46 +0000 (0:00:00.094) 0:00:36.538 ******* 2021-03-10T13:40:46.351 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-10T13:40:46.352 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-03-10T13:40:46.415 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-03-10T13:40:46.509 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-03-10T13:40:46.520 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-03-10T13:40:46.603 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-03-10T13:40:46.604 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-03-10T13:40:46.699 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-03-10T13:40:46.700 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-03-10T13:40:46.782 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-03-10T13:40:46.835 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-03-10T13:40:46.867 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-03-10T13:40:46.930 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-03-10T13:40:46.962 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-03-10T13:40:47.015 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-03-10T13:40:47.046 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-03-10T13:40:47.109 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-03-10T13:40:47.141 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-03-10T13:40:47.194 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-03-10T13:40:47.226 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2021-03-10T13:40:47.299 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-03-10T13:40:47.321 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-03-10T13:40:47.384 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-03-10T13:40:47.406 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-03-10T13:40:47.479 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-03-10T13:40:47.501 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-03-10T13:40:47.564 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-03-10T13:40:47.586 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-03-10T13:40:47.649 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-03-10T13:40:47.673 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-03-10T13:40:47.736 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-03-10T13:40:47.768 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-03-10T13:40:47.832 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-03-10T13:40:47.864 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-03-10T13:40:47.927 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-03-10T13:40:47.969 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-03-10T13:40:48.011 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-03-10T13:40:48.064 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-03-10T13:40:48.106 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-03-10T13:40:48.169 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-03-10T13:40:48.201 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-03-10T13:40:48.254 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-03-10T13:40:48.338 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-03-10T13:40:48.349 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-03-10T13:40:48.423 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-03-10T13:40:48.434 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-03-10T13:40:48.518 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2021-03-10T13:40:48.518 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-03-10T13:40:48.614 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-03-10T13:40:48.614 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-03-10T13:40:48.698 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-03-10T13:40:48.709 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-03-10T13:40:48.794 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-03-10T13:40:48.806 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-03-10T13:40:48.890 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-03-10T13:40:48.901 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-03-10T13:40:48.975 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-03-10T13:40:48.996 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-03-10T13:40:49.059 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-03-10T13:40:49.081 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-03-10T13:40:49.155 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-03-10T13:40:49.177 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-03-10T13:40:49.240 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-03-10T13:40:49.272 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-03-10T13:40:49.335 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-03-10T13:40:49.367 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-03-10T13:40:49.430 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-03-10T13:40:49.462 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-03-10T13:40:49.525 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-03-10T13:40:49.548 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-03-10T13:40:49.612 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-03-10T13:40:49.635 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-03-10T13:40:49.719 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-03-10T13:40:49.742 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-03-10T13:40:49.786 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:49 +0000 (0:00:03.441) 0:00:39.980 ******* 2021-03-10T13:40:49.816 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-03-10T13:40:49.900 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-03-10T13:40:49.995 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-03-10T13:40:50.089 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-03-10T13:40:50.163 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-03-10T13:40:50.164 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => {"changed": true, "checksum": "1d9711ff879c231c67cb70d00ca0088797a377d0", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "80a55def4b505d08aff3687f81f74dc2", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615383649.8890266-8136-225704693537348/source", "state": "file", "uid": 0} 2021-03-10T13:40:50.196 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:50 +0000 (0:00:00.409) 0:00:40.389 ******* 2021-03-10T13:40:50.203 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-10T13:40:50.205 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-03-10T13:40:50.267 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-03-10T13:40:50.269 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => { "msg": "Host gibba013.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-03-10T13:40:50.292 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:50 +0000 (0:00:00.096) 0:00:40.485 ******* 2021-03-10T13:40:50.299 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-10T13:40:50.301 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-03-10T13:40:50.363 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-03-10T13:40:50.365 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** ok: [gibba013.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-03-10T13:40:50.388 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:50 +0000 (0:00:00.095) 0:00:40.581 ******* 2021-03-10T13:40:50.446 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-03-10T13:40:50.448 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:50.470 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:50 +0000 (0:00:00.081) 0:00:40.663 ******* 2021-03-10T13:40:50.476 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-10T13:40:50.478 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-03-10T13:40:50.530 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-03-10T13:40:50.531 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:50.553 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:50 +0000 (0:00:00.083) 0:00:40.747 ******* 2021-03-10T13:40:50.560 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-10T13:40:50.562 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-03-10T13:40:50.613 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:50.637 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:50 +0000 (0:00:00.083) 0:00:40.831 ******* 2021-03-10T13:40:50.646 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-10T13:40:50.647 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-03-10T13:40:50.699 INFO:teuthology.task.ansible.out: 2021-03-10T13:40:50.701 INFO:teuthology.task.ansible.out:TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:50.734 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:50 +0000 (0:00:00.096) 0:00:40.927 ******* 2021-03-10T13:40:50.742 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-10T13:40:50.743 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-03-10T13:40:50.796 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:50.819 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:50 +0000 (0:00:00.085) 0:00:41.012 ******* 2021-03-10T13:40:50.838 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-10T13:40:50.840 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-03-10T13:40:50.882 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-03-10T13:40:50.884 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:50.915 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:50 +0000 (0:00:00.096) 0:00:41.108 ******* 2021-03-10T13:40:50.925 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-10T13:40:50.926 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-03-10T13:40:50.979 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:51.002 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:50 +0000 (0:00:00.086) 0:00:41.195 ******* 2021-03-10T13:40:51.009 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-10T13:40:51.011 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-03-10T13:40:51.054 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:51 +0000 (0:00:00.051) 0:00:41.247 ******* 2021-03-10T13:40:51.070 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-03-10T13:40:51.072 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:51.095 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:51 +0000 (0:00:00.040) 0:00:41.288 ******* 2021-03-10T13:40:51.163 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-03-10T13:40:51.165 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [gibba013.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T13:40:51.189 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:51 +0000 (0:00:00.093) 0:00:41.381 ******* 2021-03-10T13:40:51.257 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-03-10T13:40:51.259 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:51.281 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:51 +0000 (0:00:00.092) 0:00:41.474 ******* 2021-03-10T13:40:51.349 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-03-10T13:40:51.351 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:51.375 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:51 +0000 (0:00:00.093) 0:00:41.568 ******* 2021-03-10T13:40:51.382 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-03-10T13:40:51.383 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => {"changed": true, "checksum": "1d9711ff879c231c67cb70d00ca0088797a377d0", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "80a55def4b505d08aff3687f81f74dc2", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615383651.1379158-8253-264437172324290/source", "state": "file", "uid": 0} 2021-03-10T13:40:51.409 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:51 +0000 (0:00:00.033) 0:00:41.602 ******* 2021-03-10T13:40:51.435 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-03-10T13:40:51.437 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T13:40:51.460 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:51 +0000 (0:00:00.051) 0:00:41.654 ******* 2021-03-10T13:40:51.477 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-03-10T13:40:51.479 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => { "msg": "Host gibba020.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-03-10T13:40:51.502 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:51 +0000 (0:00:00.041) 0:00:41.695 ******* 2021-03-10T13:40:51.529 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-03-10T13:40:51.531 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:51.564 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:51 +0000 (0:00:00.062) 0:00:41.758 ******* 2021-03-10T13:40:51.585 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-03-10T13:40:51.586 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-03-10T13:40:51.617 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:51 +0000 (0:00:00.052) 0:00:41.810 ******* 2021-03-10T13:40:51.645 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-03-10T13:40:51.647 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T13:40:51.669 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:51 +0000 (0:00:00.052) 0:00:41.862 ******* 2021-03-10T13:40:51.686 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-03-10T13:40:51.688 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:51.710 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:51 +0000 (0:00:00.040) 0:00:41.903 ******* 2021-03-10T13:40:51.738 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-03-10T13:40:51.740 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:51.766 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:51 +0000 (0:00:00.055) 0:00:41.959 ******* 2021-03-10T13:40:51.785 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:51.809 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:51 +0000 (0:00:00.043) 0:00:42.002 ******* 2021-03-10T13:40:51.836 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-03-10T13:40:51.838 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:51.860 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:51 +0000 (0:00:00.050) 0:00:42.053 ******* 2021-03-10T13:40:51.877 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-03-10T13:40:51.879 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:51.901 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:51 +0000 (0:00:00.041) 0:00:42.095 ******* 2021-03-10T13:40:51.928 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-03-10T13:40:51.930 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:51.956 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:51 +0000 (0:00:00.054) 0:00:42.149 ******* 2021-03-10T13:40:51.973 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-03-10T13:40:51.975 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:51.998 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:51 +0000 (0:00:00.041) 0:00:42.191 ******* 2021-03-10T13:40:52.025 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-03-10T13:40:52.027 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:52.050 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:52 +0000 (0:00:00.052) 0:00:42.244 ******* 2021-03-10T13:40:52.067 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-03-10T13:40:52.069 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:52.092 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:52 +0000 (0:00:00.041) 0:00:42.285 ******* 2021-03-10T13:40:52.109 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-03-10T13:40:52.111 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T13:40:52.134 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:52 +0000 (0:00:00.041) 0:00:42.327 ******* 2021-03-10T13:40:52.161 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-03-10T13:40:52.163 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:52.185 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:52 +0000 (0:00:00.051) 0:00:42.379 ******* 2021-03-10T13:40:52.202 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-03-10T13:40:52.204 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:52.228 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:52 +0000 (0:00:00.042) 0:00:42.421 ******* 2021-03-10T13:40:52.256 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-03-10T13:40:52.257 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:52.281 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:52 +0000 (0:00:00.053) 0:00:42.475 ******* 2021-03-10T13:40:52.308 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-03-10T13:40:52.310 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:52.333 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:52 +0000 (0:00:00.051) 0:00:42.526 ******* 2021-03-10T13:40:52.349 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-03-10T13:40:52.351 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:52.374 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:52 +0000 (0:00:00.041) 0:00:42.567 ******* 2021-03-10T13:40:52.401 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-03-10T13:40:52.403 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:52.427 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:52 +0000 (0:00:00.052) 0:00:42.620 ******* 2021-03-10T13:40:52.443 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-03-10T13:40:52.445 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [gibba020.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T13:40:52.468 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:52 +0000 (0:00:00.041) 0:00:42.661 ******* 2021-03-10T13:40:52.494 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-03-10T13:40:52.496 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:52.523 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:52 +0000 (0:00:00.054) 0:00:42.716 ******* 2021-03-10T13:40:52.539 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-03-10T13:40:52.541 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:52.564 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:52 +0000 (0:00:00.041) 0:00:42.757 ******* 2021-03-10T13:40:52.581 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-03-10T13:40:52.582 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:52.605 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:52 +0000 (0:00:00.041) 0:00:42.799 ******* 2021-03-10T13:40:52.621 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-03-10T13:40:52.623 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:52.645 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:52 +0000 (0:00:00.039) 0:00:42.839 ******* 2021-03-10T13:40:52.662 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-03-10T13:40:52.664 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:52.690 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:52 +0000 (0:00:00.045) 0:00:42.884 ******* 2021-03-10T13:40:52.717 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-03-10T13:40:52.719 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T13:40:52.742 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:52 +0000 (0:00:00.051) 0:00:42.935 ******* 2021-03-10T13:40:52.758 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-03-10T13:40:52.759 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T13:40:52.782 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:52 +0000 (0:00:00.040) 0:00:42.975 ******* 2021-03-10T13:40:52.809 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-03-10T13:40:52.811 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:52.833 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:52 +0000 (0:00:00.051) 0:00:43.027 ******* 2021-03-10T13:40:52.849 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-03-10T13:40:52.851 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:52.873 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:52 +0000 (0:00:00.039) 0:00:43.067 ******* 2021-03-10T13:40:52.899 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-03-10T13:40:52.901 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T13:40:52.923 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:52 +0000 (0:00:00.050) 0:00:43.117 ******* 2021-03-10T13:40:52.940 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-03-10T13:40:52.942 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:52.964 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:52 +0000 (0:00:00.040) 0:00:43.158 ******* 2021-03-10T13:40:52.992 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-03-10T13:40:52.993 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:53.016 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:53 +0000 (0:00:00.051) 0:00:43.209 ******* 2021-03-10T13:40:53.043 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-03-10T13:40:53.045 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:53.070 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:53 +0000 (0:00:00.053) 0:00:43.263 ******* 2021-03-10T13:40:53.086 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-03-10T13:40:53.088 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:53.110 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:53 +0000 (0:00:00.040) 0:00:43.304 ******* 2021-03-10T13:40:53.137 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-03-10T13:40:53.138 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:53.139 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:53.162 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:53 +0000 (0:00:00.051) 0:00:43.356 ******* 2021-03-10T13:40:53.179 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-03-10T13:40:53.180 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:53.203 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:53 +0000 (0:00:00.041) 0:00:43.397 ******* 2021-03-10T13:40:53.241 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-03-10T13:40:53.243 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [gibba013.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-03-10T13:40:53.266 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:53 +0000 (0:00:00.062) 0:00:43.459 ******* 2021-03-10T13:40:53.272 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-03-10T13:40:53.274 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:53.298 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:53 +0000 (0:00:00.032) 0:00:43.491 ******* 2021-03-10T13:40:53.335 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:53.358 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:53 +0000 (0:00:00.060) 0:00:43.552 ******* 2021-03-10T13:40:53.365 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-03-10T13:40:53.366 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T13:40:53.390 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:53 +0000 (0:00:00.031) 0:00:43.584 ******* 2021-03-10T13:40:53.458 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:53.480 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:53 +0000 (0:00:00.089) 0:00:43.673 ******* 2021-03-10T13:40:53.506 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-03-10T13:40:53.508 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.009269", "end": "2021-03-10 13:40:53.770332", "rc": 0, "start": "2021-03-10 13:40:53.761063", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-03-10T13:40:53.530 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:53 +0000 (0:00:00.049) 0:00:43.723 ******* 2021-03-10T13:40:53.546 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-03-10T13:40:53.548 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:53.570 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:53 +0000 (0:00:00.040) 0:00:43.764 ******* 2021-03-10T13:40:53.597 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-03-10T13:40:53.599 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:53.620 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:53 +0000 (0:00:00.049) 0:00:43.813 ******* 2021-03-10T13:40:53.636 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-03-10T13:40:53.638 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:53.663 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:53 +0000 (0:00:00.043) 0:00:43.857 ******* 2021-03-10T13:40:53.690 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-03-10T13:40:53.692 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:53.714 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:53 +0000 (0:00:00.050) 0:00:43.907 ******* 2021-03-10T13:40:53.730 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-03-10T13:40:53.732 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:53.754 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:53 +0000 (0:00:00.040) 0:00:43.948 ******* 2021-03-10T13:40:53.822 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:53.845 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:53 +0000 (0:00:00.090) 0:00:44.038 ******* 2021-03-10T13:40:53.904 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-03-10T13:40:53.906 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:53.927 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:53 +0000 (0:00:00.081) 0:00:44.120 ******* 2021-03-10T13:40:53.983 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-03-10T13:40:53.985 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T13:40:54.006 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:53 +0000 (0:00:00.079) 0:00:44.199 ******* 2021-03-10T13:40:54.074 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-03-10T13:40:54.075 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:54.096 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:54 +0000 (0:00:00.090) 0:00:44.289 ******* 2021-03-10T13:40:54.164 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-03-10T13:40:54.165 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:54.186 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:54 +0000 (0:00:00.089) 0:00:44.379 ******* 2021-03-10T13:40:54.253 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-03-10T13:40:54.255 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Mask sleep units] *********************************************** ok: [gibba013.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-03-10T13:40:54.278 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:54 +0000 (0:00:00.091) 0:00:44.471 ******* 2021-03-10T13:40:54.356 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-03-10T13:40:54.358 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [gibba020.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:54.381 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:54 +0000 (0:00:00.102) 0:00:44.574 ******* 2021-03-10T13:40:54.387 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-03-10T13:40:54.387 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-03-10T13:40:54.450 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* skipping: [gibba020.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} 2021-03-10T13:40:54.452 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-03-10T13:40:54.474 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:54 +0000 (0:00:00.093) 0:00:44.667 ******* 2021-03-10T13:40:54.500 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-03-10T13:40:54.502 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-03-10T13:40:54.543 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:54.565 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:54 +0000 (0:00:00.090) 0:00:44.758 ******* 2021-03-10T13:40:54.611 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-03-10T13:40:54.613 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-03-10T13:40:54.651 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:54 +0000 (0:00:00.086) 0:00:44.844 ******* 2021-03-10T13:40:54.719 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-03-10T13:40:54.720 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone] *************************************** ok: [gibba020.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.012613", "end": "2021-03-10 13:40:54.660814", "rc": 0, "start": "2021-03-10 13:40:54.648201", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-03-10T13:40:54.741 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:54 +0000 (0:00:00.090) 0:00:44.935 ******* 2021-03-10T13:40:54.761 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:54 +0000 (0:00:00.019) 0:00:44.954 ******* 2021-03-10T13:40:54.798 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-03-10T13:40:54.800 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:54.825 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:54 +0000 (0:00:00.063) 0:00:45.018 ******* 2021-03-10T13:40:54.831 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-03-10T13:40:54.833 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:54.856 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:54 +0000 (0:00:00.031) 0:00:45.050 ******* 2021-03-10T13:40:54.883 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-03-10T13:40:54.885 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:54.909 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:54 +0000 (0:00:00.052) 0:00:45.102 ******* 2021-03-10T13:40:54.926 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-03-10T13:40:54.928 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:54.963 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:54 +0000 (0:00:00.054) 0:00:45.156 ******* 2021-03-10T13:40:54.983 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-03-10T13:40:54.984 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:55.007 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:55 +0000 (0:00:00.044) 0:00:45.200 ******* 2021-03-10T13:40:55.075 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-03-10T13:40:55.077 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:55.097 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:55 +0000 (0:00:00.089) 0:00:45.290 ******* 2021-03-10T13:40:55.165 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-03-10T13:40:55.167 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-03-10T13:40:55.240 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-03-10T13:40:55.241 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.050487", "end": "2021-03-10 13:40:55.500933", "rc": 0, "start": "2021-03-10 13:40:55.450446", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:40:55.263 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:55 +0000 (0:00:00.166) 0:00:45.456 ******* 2021-03-10T13:40:55.280 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-03-10T13:40:55.282 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-03-10T13:40:55.323 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-03-10T13:40:55.324 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:55.345 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:55 +0000 (0:00:00.081) 0:00:45.538 ******* 2021-03-10T13:40:55.382 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-03-10T13:40:55.384 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-03-10T13:40:55.501 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-03-10T13:40:55.527 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:55 +0000 (0:00:00.182) 0:00:45.720 ******* 2021-03-10T13:40:55.544 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ [WARNING]: Consider using the apt module rather than running 'apt-get'. If you need to use command because apt is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2021-03-10T13:40:55.546 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.007755", "end": "2021-03-10 13:40:55.804796", "rc": 0, "start": "2021-03-10 13:40:55.797041", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:40:55.569 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:55 +0000 (0:00:00.041) 0:00:45.762 ******* 2021-03-10T13:40:55.596 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-03-10T13:40:55.597 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:55.620 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:55 +0000 (0:00:00.050) 0:00:45.813 ******* 2021-03-10T13:40:55.676 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-03-10T13:40:55.678 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:55.698 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:55 +0000 (0:00:00.078) 0:00:45.892 ******* 2021-03-10T13:40:55.755 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-03-10T13:40:55.756 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:55.777 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:55 +0000 (0:00:00.078) 0:00:45.970 ******* 2021-03-10T13:40:55.844 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-03-10T13:40:55.846 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:55.866 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:55 +0000 (0:00:00.089) 0:00:46.060 ******* 2021-03-10T13:40:55.934 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:55.956 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:55 +0000 (0:00:00.090) 0:00:46.150 ******* 2021-03-10T13:40:56.560 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-03-10T13:40:56.562 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.506722", "end": "2021-03-10 13:40:56.500866", "rc": 0, "start": "2021-03-10 13:40:55.994144", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:40:56.583 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:56 +0000 (0:00:00.626) 0:00:46.776 ******* 2021-03-10T13:40:56.651 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-03-10T13:40:56.653 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:56.673 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:56 +0000 (0:00:00.090) 0:00:46.867 ******* 2021-03-10T13:40:56.825 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-03-10T13:40:56.826 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.007654", "end": "2021-03-10 13:40:56.768721", "rc": 0, "start": "2021-03-10 13:40:56.761067", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:40:56.851 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:56 +0000 (0:00:00.177) 0:00:47.044 ******* 2021-03-10T13:40:57.343 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-03-10T13:40:57.344 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1615383598, "cache_updated": false, "changed": false} 2021-03-10T13:40:57.367 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:57 +0000 (0:00:00.516) 0:00:47.560 ******* 2021-03-10T13:40:57.819 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-03-10T13:40:57.821 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"cache_update_time": 1615383598, "cache_updated": false, "changed": false} 2021-03-10T13:40:57.841 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:57 +0000 (0:00:00.474) 0:00:48.035 ******* 2021-03-10T13:40:57.899 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-03-10T13:40:57.901 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:57.922 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:57 +0000 (0:00:00.080) 0:00:48.116 ******* 2021-03-10T13:40:58.384 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-03-10T13:40:58.385 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1615383603, "cache_updated": false, "changed": false} 2021-03-10T13:40:58.406 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:58 +0000 (0:00:00.483) 0:00:48.599 ******* 2021-03-10T13:40:58.443 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-03-10T13:40:58.510 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} Wednesday 10 March 2021 13:40:58 +0000 (0:00:00.061) 0:00:48.661 ******* 2021-03-10T13:40:58.847 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-03-10T13:40:58.849 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"cache_update_time": 1615383603, "cache_updated": false, "changed": false} 2021-03-10T13:40:58.871 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:58 +0000 (0:00:00.402) 0:00:49.064 ******* 2021-03-10T13:40:58.908 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-03-10T13:40:58.910 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"cache_update_time": 1615383598, "cache_updated": false, "changed": false} 2021-03-10T13:40:58.933 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:58 +0000 (0:00:00.062) 0:00:49.126 ******* 2021-03-10T13:40:58.939 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-03-10T13:40:58.940 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:40:58.967 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:58 +0000 (0:00:00.033) 0:00:49.160 ******* 2021-03-10T13:40:59.231 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-03-10T13:40:59.233 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-03-10T13:40:59.254 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:59 +0000 (0:00:00.287) 0:00:49.447 ******* 2021-03-10T13:40:59.259 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-03-10T13:40:59.261 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-03-10T13:40:59.479 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-03-10T13:40:59.676 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-03-10T13:40:59.700 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:59 +0000 (0:00:00.445) 0:00:49.893 ******* 2021-03-10T13:40:59.737 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-03-10T13:40:59.738 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"cache_update_time": 1615383603, "cache_updated": false, "changed": false} 2021-03-10T13:40:59.761 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:59 +0000 (0:00:00.061) 0:00:49.955 ******* 2021-03-10T13:40:59.798 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-03-10T13:40:59.800 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T13:40:59.823 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:40:59 +0000 (0:00:00.061) 0:00:50.017 ******* 2021-03-10T13:41:00.036 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-03-10T13:41:00.038 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-03-10T13:41:00.089 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-03-10T13:41:00.091 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-03-10T13:41:00.244 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-03-10T13:41:00.246 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-03-10T13:41:00.318 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-03-10T13:41:00.320 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-03-10T13:41:00.453 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-03-10T13:41:00.455 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-03-10T13:41:00.478 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:00 +0000 (0:00:00.655) 0:00:50.672 ******* 2021-03-10T13:41:00.505 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-03-10T13:41:00.507 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2021-03-10T13:41:00.531 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:00 +0000 (0:00:00.052) 0:00:50.724 ******* 2021-03-10T13:41:00.567 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-03-10T13:41:00.569 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T13:41:00.590 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:00 +0000 (0:00:00.059) 0:00:50.783 ******* 2021-03-10T13:41:00.606 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-03-10T13:41:00.607 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-03-10T13:41:00.630 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:00 +0000 (0:00:00.040) 0:00:50.824 ******* 2021-03-10T13:41:00.719 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:00.740 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:00 +0000 (0:00:00.109) 0:00:50.933 ******* 2021-03-10T13:41:00.807 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-03-10T13:41:00.809 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T13:41:00.830 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:00 +0000 (0:00:00.089) 0:00:51.023 ******* 2021-03-10T13:41:00.856 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-03-10T13:41:00.858 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-03-10T13:41:00.899 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-03-10T13:41:00.900 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [gibba013.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-10T13:41:00.910 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-10T13:41:00.912 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-10T13:41:00.934 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:00 +0000 (0:00:00.103) 0:00:51.127 ******* 2021-03-10T13:41:01.001 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:01.023 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:01 +0000 (0:00:00.089) 0:00:51.217 ******* 2021-03-10T13:41:01.039 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-03-10T13:41:01.041 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-03-10T13:41:01.237 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2021-03-10T13:41:01.262 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:01 +0000 (0:00:00.238) 0:00:51.455 ******* 2021-03-10T13:41:01.330 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-03-10T13:41:01.332 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-03-10T13:41:01.353 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:01 +0000 (0:00:00.090) 0:00:51.546 ******* 2021-03-10T13:41:01.420 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:01.441 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:01 +0000 (0:00:00.088) 0:00:51.635 ******* 2021-03-10T13:41:01.488 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-03-10T13:41:01.490 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"cache_update_time": 1615383598, "cache_updated": false, "changed": false} 2021-03-10T13:41:01.512 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:01 +0000 (0:00:00.070) 0:00:51.705 ******* 2021-03-10T13:41:01.518 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-03-10T13:41:01.519 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T13:41:01.543 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:01 +0000 (0:00:00.031) 0:00:51.736 ******* 2021-03-10T13:41:01.621 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-03-10T13:41:01.623 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [gibba020.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-10T13:41:01.632 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-10T13:41:01.634 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-10T13:41:01.656 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:01 +0000 (0:00:00.112) 0:00:51.849 ******* 2021-03-10T13:41:01.723 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-03-10T13:41:01.725 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:01.749 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:01 +0000 (0:00:00.093) 0:00:51.943 ******* 2021-03-10T13:41:01.786 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-03-10T13:41:01.788 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-03-10T13:41:01.811 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:01 +0000 (0:00:00.061) 0:00:52.004 ******* 2021-03-10T13:41:02.117 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-03-10T13:41:02.119 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-03-10T13:41:02.139 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:02 +0000 (0:00:00.328) 0:00:52.333 ******* 2021-03-10T13:41:02.207 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-03-10T13:41:02.209 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"cache_update_time": 1615383603, "cache_updated": false, "changed": false} 2021-03-10T13:41:02.229 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:02 +0000 (0:00:00.089) 0:00:52.423 ******* 2021-03-10T13:41:02.328 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-03-10T13:41:02.330 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-03-10T13:41:02.412 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-03-10T13:41:02.436 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:02 +0000 (0:00:00.206) 0:00:52.630 ******* 2021-03-10T13:41:02.505 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-03-10T13:41:02.506 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-03-10T13:41:02.529 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:02 +0000 (0:00:00.092) 0:00:52.722 ******* 2021-03-10T13:41:02.607 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-03-10T13:41:02.609 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:02.630 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:02 +0000 (0:00:00.101) 0:00:52.824 ******* 2021-03-10T13:41:02.698 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-03-10T13:41:02.699 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T13:41:02.720 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:02 +0000 (0:00:00.089) 0:00:52.913 ******* 2021-03-10T13:41:02.787 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-03-10T13:41:02.788 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:02.808 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:02 +0000 (0:00:00.088) 0:00:53.002 ******* 2021-03-10T13:41:02.824 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-03-10T13:41:02.826 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-03-10T13:41:02.848 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:02 +0000 (0:00:00.039) 0:00:53.041 ******* 2021-03-10T13:41:03.009 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-03-10T13:41:03.011 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-03-10T13:41:03.062 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-03-10T13:41:03.064 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-03-10T13:41:03.088 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:03 +0000 (0:00:00.240) 0:00:53.282 ******* 2021-03-10T13:41:03.095 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-03-10T13:41:03.096 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-03-10T13:41:03.122 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:03 +0000 (0:00:00.032) 0:00:53.315 ******* 2021-03-10T13:41:03.189 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-03-10T13:41:03.190 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:03.212 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:03 +0000 (0:00:00.090) 0:00:53.405 ******* 2021-03-10T13:41:03.279 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-03-10T13:41:03.280 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T13:41:03.300 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:03 +0000 (0:00:00.088) 0:00:53.494 ******* 2021-03-10T13:41:03.307 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-03-10T13:41:03.308 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-03-10 13:39:21 UTC", "ActiveEnterTimestampMonotonic": "12423423", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "nss-lookup.target sysinit.target local-fs.target system.slice systemd-journald.socket network.target -.mount time-sync.target systemd-tmpfiles-setup.service basic.target var-run.mount remote-fs.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-03-10 13:39:21 UTC", "AssertTimestampMonotonic": "12418872", "Before": "getty@tty1.service shutdown.target xdm.service multi-user.target plymouth-quit.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-03-10 13:39:21 UTC", "Con 2021-03-10T13:41:03.310 INFO:teuthology.task.ansible.out:ditionTimestampMonotonic": "12418871", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1040", "ExecMainStartTimestamp": "Wed 2021-03-10 13:39:21 UTC", "ExecMainStartTimestampMonotonic": "12423330", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", 2021-03-10T13:41:03.311 INFO:teuthology.task.ansible.out: "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-03-10 13:39:21 UTC", "InactiveExitTimestampMonotonic": "12423423", "InvocationID": "d27605aae16e4e469b13820f7e808d14", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127828", "LimitNPROCSoft": "127828", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127828", "LimitSIGPENDINGSoft": "127828", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1040", "MemoryAccounting": "yes", "MemoryCurrent": "1384448", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", " 2021-03-10T13:41:03.313 INFO:teuthology.task.ansible.out:MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-10 13:39:21 UTC", "StateChangeTimestampMonotonic": "12423423", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", " 2021-03-10T13:41:03.314 INFO:teuthology.task.ansible.out:SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38348", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-10T13:41:03.334 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:03 +0000 (0:00:00.033) 0:00:53.527 ******* 2021-03-10T13:41:03.371 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-03-10T13:41:03.373 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:03.394 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:03 +0000 (0:00:00.060) 0:00:53.587 ******* 2021-03-10T13:41:03.403 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-03-10T13:41:03.405 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:03.429 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:03 +0000 (0:00:00.035) 0:00:53.622 ******* 2021-03-10T13:41:03.601 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:03.625 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:03 +0000 (0:00:00.195) 0:00:53.818 ******* 2021-03-10T13:41:03.799 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-03-10T13:41:03.801 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-03-10T13:41:03.822 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:03 +0000 (0:00:00.197) 0:00:54.016 ******* 2021-03-10T13:41:03.828 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-03-10T13:41:03.830 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:03.852 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:03 +0000 (0:00:00.029) 0:00:54.046 ******* 2021-03-10T13:41:04.014 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-03-10T13:41:04.016 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:04.039 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:04 +0000 (0:00:00.186) 0:00:54.233 ******* 2021-03-10T13:41:04.202 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-03-10T13:41:04.203 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-03-10 13:39:22 UTC", "ActiveEnterTimestampMonotonic": "14004811", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "var-run.mount sysinit.target systemd-journald.socket systemd-tmpfiles-setup.service system.slice basic.target network.target remote-fs.target time-sync.target -.mount local-fs.target nss-lookup.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-03-10 13:39:22 UTC", "AssertTimestampMonotonic": "13999058", "Before": "shutdown.target getty@tty1.service xdm.service plymouth-quit.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-03-10 13:39:22 UTC", "Con 2021-03-10T13:41:04.205 INFO:teuthology.task.ansible.out:ditionTimestampMonotonic": "13999058", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1365", "ExecMainStartTimestamp": "Wed 2021-03-10 13:39:22 UTC", "ExecMainStartTimestampMonotonic": "14004724", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", 2021-03-10T13:41:04.206 INFO:teuthology.task.ansible.out: "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-03-10 13:39:22 UTC", "InactiveExitTimestampMonotonic": "14004811", "InvocationID": "964bd985dd2a4832993514e9bb7cea86", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127828", "LimitNPROCSoft": "127828", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127828", "LimitSIGPENDINGSoft": "127828", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1365", "MemoryAccounting": "yes", "MemoryCurrent": "1421312", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", " 2021-03-10T13:41:04.208 INFO:teuthology.task.ansible.out:MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-10 13:39:22 UTC", "StateChangeTimestampMonotonic": "14004811", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", " 2021-03-10T13:41:04.209 INFO:teuthology.task.ansible.out:SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38348", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-10T13:41:04.225 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:04 +0000 (0:00:00.185) 0:00:54.418 ******* 2021-03-10T13:41:04.231 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-03-10T13:41:04.233 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:04.257 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:04 +0000 (0:00:00.031) 0:00:54.450 ******* 2021-03-10T13:41:04.294 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-03-10T13:41:04.296 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:04.318 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:04 +0000 (0:00:00.060) 0:00:54.511 ******* 2021-03-10T13:41:04.322 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-03-10T13:41:04.324 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:04.346 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:04 +0000 (0:00:00.028) 0:00:54.540 ******* 2021-03-10T13:41:04.382 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-03-10T13:41:04.384 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:04.405 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:04 +0000 (0:00:00.059) 0:00:54.599 ******* 2021-03-10T13:41:04.410 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-03-10T13:41:04.412 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:04.435 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:04 +0000 (0:00:00.029) 0:00:54.628 ******* 2021-03-10T13:41:04.470 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-03-10T13:41:04.473 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:04.494 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:04 +0000 (0:00:00.059) 0:00:54.687 ******* 2021-03-10T13:41:04.499 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-03-10T13:41:04.501 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:04.524 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:04 +0000 (0:00:00.030) 0:00:54.717 ******* 2021-03-10T13:41:04.561 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-03-10T13:41:04.563 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:04.585 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:04 +0000 (0:00:00.060) 0:00:54.778 ******* 2021-03-10T13:41:04.601 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-03-10T13:41:04.603 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:04.625 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:04 +0000 (0:00:00.039) 0:00:54.818 ******* 2021-03-10T13:41:04.652 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-03-10T13:41:04.654 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:04.676 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:04 +0000 (0:00:00.050) 0:00:54.869 ******* 2021-03-10T13:41:04.692 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-03-10T13:41:04.694 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:04.719 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:04 +0000 (0:00:00.042) 0:00:54.912 ******* 2021-03-10T13:41:04.746 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:04.769 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:04 +0000 (0:00:00.050) 0:00:54.962 ******* 2021-03-10T13:41:04.784 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-03-10T13:41:04.786 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-03-10T13:41:04.809 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:04 +0000 (0:00:00.039) 0:00:55.002 ******* 2021-03-10T13:41:04.836 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-03-10T13:41:04.837 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:04.860 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:04 +0000 (0:00:00.050) 0:00:55.053 ******* 2021-03-10T13:41:04.887 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-03-10T13:41:04.889 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-03-10T13:41:04.912 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:04 +0000 (0:00:00.052) 0:00:55.105 ******* 2021-03-10T13:41:04.929 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-03-10T13:41:04.931 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:04.953 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:04 +0000 (0:00:00.040) 0:00:55.146 ******* 2021-03-10T13:41:04.990 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-03-10T13:41:04.992 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-03-10T13:41:05.014 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:05 +0000 (0:00:00.061) 0:00:55.208 ******* 2021-03-10T13:41:05.020 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-03-10T13:41:05.022 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:05.045 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:05 +0000 (0:00:00.030) 0:00:55.238 ******* 2021-03-10T13:41:05.093 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-03-10T13:41:05.094 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-03-10T13:41:05.116 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:05 +0000 (0:00:00.071) 0:00:55.309 ******* 2021-03-10T13:41:05.121 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-03-10T13:41:05.123 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:05.146 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:05 +0000 (0:00:00.029) 0:00:55.339 ******* 2021-03-10T13:41:05.212 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-03-10T13:41:05.214 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} TASK [testnode : Include package type specific vars.] ************************** ok: [gibba020.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-03-10T13:41:05.234 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:05 +0000 (0:00:00.088) 0:00:55.428 ******* 2021-03-10T13:41:05.253 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:05 +0000 (0:00:00.018) 0:00:55.446 ******* 2021-03-10T13:41:05.331 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-03-10T13:41:05.333 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-03-10T13:41:05.360 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:05 +0000 (0:00:00.107) 0:00:55.553 ******* 2021-03-10T13:41:05.417 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-03-10T13:41:05.419 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-03-10T13:41:05.439 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:05 +0000 (0:00:00.079) 0:00:55.633 ******* 2021-03-10T13:41:05.445 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-03-10T13:41:05.446 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-03-10T13:41:05.471 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:05 +0000 (0:00:00.031) 0:00:55.664 ******* 2021-03-10T13:41:05.497 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-03-10T13:41:05.499 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:05.520 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:05 +0000 (0:00:00.049) 0:00:55.713 ******* 2021-03-10T13:41:05.535 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-03-10T13:41:05.537 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-03-10T13:41:05.559 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:05 +0000 (0:00:00.039) 0:00:55.752 ******* 2021-03-10T13:41:05.575 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-03-10T13:41:05.577 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:05.599 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:05 +0000 (0:00:00.039) 0:00:55.792 ******* 2021-03-10T13:41:05.656 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-03-10T13:41:05.658 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-03-10T13:41:05.679 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:05 +0000 (0:00:00.080) 0:00:55.872 ******* 2021-03-10T13:41:05.757 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-03-10T13:41:05.758 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-03-10T13:41:05.780 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:05 +0000 (0:00:00.100) 0:00:55.973 ******* 2021-03-10T13:41:05.847 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-03-10T13:41:05.849 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-03-10T13:41:05.871 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:05 +0000 (0:00:00.090) 0:00:56.064 ******* 2021-03-10T13:41:05.928 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-03-10T13:41:05.930 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:05.950 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:05 +0000 (0:00:00.079) 0:00:56.144 ******* 2021-03-10T13:41:06.017 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-03-10T13:41:06.019 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:06.040 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:06 +0000 (0:00:00.089) 0:00:56.233 ******* 2021-03-10T13:41:06.117 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-03-10T13:41:06.119 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-03-10T13:41:06.139 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:06 +0000 (0:00:00.099) 0:00:56.333 ******* 2021-03-10T13:41:06.186 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-03-10T13:41:06.188 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-03-10T13:41:06.212 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:06 +0000 (0:00:00.072) 0:00:56.406 ******* 2021-03-10T13:41:06.218 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-03-10T13:41:06.219 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "gibba013"}, "changed": false} 2021-03-10T13:41:06.242 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:06 +0000 (0:00:00.029) 0:00:56.435 ******* 2021-03-10T13:41:06.568 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-03-10T13:41:06.569 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-03-10T13:41:06.590 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:06 +0000 (0:00:00.348) 0:00:56.784 ******* 2021-03-10T13:41:06.657 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-03-10T13:41:06.659 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "gibba020"}, "changed": false} 2021-03-10T13:41:06.680 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:06 +0000 (0:00:00.089) 0:00:56.873 ******* 2021-03-10T13:41:06.881 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-03-10T13:41:06.883 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "gibba013", "ansible_hostname": "gibba013", "ansible_nodename": "gibba013"}, "changed": false, "name": "gibba013"} 2021-03-10T13:41:06.904 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:06 +0000 (0:00:00.224) 0:00:57.097 ******* 2021-03-10T13:41:06.961 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "gibba020", "ansible_hostname": "gibba020", "ansible_nodename": "gibba020"}, "changed": false, "name": "gibba020"} 2021-03-10T13:41:06.984 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:06 +0000 (0:00:00.079) 0:00:57.177 ******* 2021-03-10T13:41:07.165 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-03-10T13:41:07.167 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-03-10T13:41:07.188 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:07 +0000 (0:00:00.204) 0:00:57.382 ******* 2021-03-10T13:41:07.256 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-03-10T13:41:07.278 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:07 +0000 (0:00:00.089) 0:00:57.472 ******* 2021-03-10T13:41:07.463 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-03-10T13:41:07.464 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-03-10T13:41:07.486 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:07 +0000 (0:00:00.208) 0:00:57.680 ******* 2021-03-10T13:41:07.555 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-03-10T13:41:07.578 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:07 +0000 (0:00:00.091) 0:00:57.771 ******* 2021-03-10T13:41:07.887 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-03-10T13:41:07.888 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-03-10T13:41:07.909 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:07 +0000 (0:00:00.330) 0:00:58.102 ******* 2021-03-10T13:41:07.966 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-03-10T13:41:07.967 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:07.988 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:07 +0000 (0:00:00.079) 0:00:58.181 ******* 2021-03-10T13:41:07.994 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-03-10T13:41:07.995 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-03-10T13:41:08.018 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:08 +0000 (0:00:00.030) 0:00:58.212 ******* 2021-03-10T13:41:08.044 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-03-10T13:41:08.046 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:08.068 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:08 +0000 (0:00:00.049) 0:00:58.261 ******* 2021-03-10T13:41:08.083 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-03-10T13:41:08.085 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:08.106 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:08 +0000 (0:00:00.038) 0:00:58.299 ******* 2021-03-10T13:41:08.132 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-03-10T13:41:08.134 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:08.155 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:08 +0000 (0:00:00.048) 0:00:58.348 ******* 2021-03-10T13:41:08.170 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-03-10T13:41:08.172 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:08.194 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:08 +0000 (0:00:00.038) 0:00:58.387 ******* 2021-03-10T13:41:08.220 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-03-10T13:41:08.222 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:08.243 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:08 +0000 (0:00:00.049) 0:00:58.437 ******* 2021-03-10T13:41:08.259 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-03-10T13:41:08.261 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:08.283 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:08 +0000 (0:00:00.039) 0:00:58.476 ******* 2021-03-10T13:41:08.309 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-03-10T13:41:08.310 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:08.332 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:08 +0000 (0:00:00.049) 0:00:58.525 ******* 2021-03-10T13:41:08.348 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-03-10T13:41:08.350 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:08.371 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:08 +0000 (0:00:00.039) 0:00:58.565 ******* 2021-03-10T13:41:08.398 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-03-10T13:41:08.400 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:08.423 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:08 +0000 (0:00:00.051) 0:00:58.617 ******* 2021-03-10T13:41:08.439 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-03-10T13:41:08.440 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:08.463 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:08 +0000 (0:00:00.039) 0:00:58.656 ******* 2021-03-10T13:41:08.479 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-03-10T13:41:08.480 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:08.502 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:08 +0000 (0:00:00.039) 0:00:58.696 ******* 2021-03-10T13:41:08.518 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-03-10T13:41:08.520 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:08.542 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:08 +0000 (0:00:00.039) 0:00:58.735 ******* 2021-03-10T13:41:08.557 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-03-10T13:41:08.559 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:08.581 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:08 +0000 (0:00:00.038) 0:00:58.774 ******* 2021-03-10T13:41:08.606 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-03-10T13:41:08.608 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:08.629 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:08 +0000 (0:00:00.048) 0:00:58.823 ******* 2021-03-10T13:41:08.645 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-03-10T13:41:08.669 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:08 +0000 (0:00:00.039) 0:00:58.862 ******* 2021-03-10T13:41:08.695 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-03-10T13:41:08.697 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:08.718 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:08 +0000 (0:00:00.049) 0:00:58.911 ******* 2021-03-10T13:41:08.733 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-03-10T13:41:08.756 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:08 +0000 (0:00:00.038) 0:00:58.949 ******* 2021-03-10T13:41:08.782 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-03-10T13:41:08.805 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:08 +0000 (0:00:00.049) 0:00:58.999 ******* 2021-03-10T13:41:08.820 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-03-10T13:41:08.844 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:08 +0000 (0:00:00.038) 0:00:59.037 ******* 2021-03-10T13:41:08.870 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-03-10T13:41:08.893 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:08 +0000 (0:00:00.048) 0:00:59.086 ******* 2021-03-10T13:41:08.909 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-03-10T13:41:08.911 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:08.935 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:08 +0000 (0:00:00.042) 0:00:59.129 ******* 2021-03-10T13:41:08.953 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-03-10T13:41:08.977 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:08 +0000 (0:00:00.041) 0:00:59.171 ******* 2021-03-10T13:41:09.003 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-03-10T13:41:09.005 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-03-10T13:41:09.014 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-03-10T13:41:09.039 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:09 +0000 (0:00:00.061) 0:00:59.232 ******* 2021-03-10T13:41:09.044 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-03-10T13:41:09.045 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:09.069 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:09 +0000 (0:00:00.030) 0:00:59.263 ******* 2021-03-10T13:41:09.096 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-03-10T13:41:09.098 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:09.120 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:09 +0000 (0:00:00.050) 0:00:59.313 ******* 2021-03-10T13:41:09.136 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-03-10T13:41:09.137 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-03-10T13:41:09.147 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-03-10T13:41:09.170 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:09 +0000 (0:00:00.049) 0:00:59.363 ******* 2021-03-10T13:41:09.185 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T13:41:09.187 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:09.209 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:09 +0000 (0:00:00.038) 0:00:59.402 ******* 2021-03-10T13:41:09.235 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-03-10T13:41:09.237 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:09.258 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:09 +0000 (0:00:00.049) 0:00:59.452 ******* 2021-03-10T13:41:09.275 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:09.298 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:09 +0000 (0:00:00.039) 0:00:59.492 ******* 2021-03-10T13:41:09.324 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T13:41:09.326 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:09.347 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:09 +0000 (0:00:00.048) 0:00:59.540 ******* 2021-03-10T13:41:09.363 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-03-10T13:41:09.364 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:09.386 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:09 +0000 (0:00:00.039) 0:00:59.580 ******* 2021-03-10T13:41:09.413 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-03-10T13:41:09.414 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:09.435 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:09 +0000 (0:00:00.048) 0:00:59.628 ******* 2021-03-10T13:41:09.451 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-03-10T13:41:09.453 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:09.478 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:09 +0000 (0:00:00.043) 0:00:59.672 ******* 2021-03-10T13:41:09.504 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-03-10T13:41:09.506 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:09.527 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:09 +0000 (0:00:00.049) 0:00:59.721 ******* 2021-03-10T13:41:09.543 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-03-10T13:41:09.545 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:09.567 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:09 +0000 (0:00:00.039) 0:00:59.760 ******* 2021-03-10T13:41:09.582 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-03-10T13:41:09.583 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:09.605 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:09 +0000 (0:00:00.038) 0:00:59.798 ******* 2021-03-10T13:41:09.621 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-03-10T13:41:09.623 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:09.645 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:09 +0000 (0:00:00.039) 0:00:59.838 ******* 2021-03-10T13:41:09.660 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-03-10T13:41:09.662 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:09.684 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:09 +0000 (0:00:00.039) 0:00:59.877 ******* 2021-03-10T13:41:09.710 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-03-10T13:41:09.712 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:09.734 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:09 +0000 (0:00:00.050) 0:00:59.928 ******* 2021-03-10T13:41:09.750 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-03-10T13:41:09.752 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:09.774 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:09 +0000 (0:00:00.039) 0:00:59.967 ******* 2021-03-10T13:41:09.800 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-03-10T13:41:09.802 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:09.823 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:09 +0000 (0:00:00.049) 0:01:00.017 ******* 2021-03-10T13:41:09.839 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-03-10T13:41:09.841 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:09.862 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:09 +0000 (0:00:00.038) 0:01:00.056 ******* 2021-03-10T13:41:09.888 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-03-10T13:41:09.889 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:09.910 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:09 +0000 (0:00:00.047) 0:01:00.103 ******* 2021-03-10T13:41:09.926 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-03-10T13:41:09.928 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:09.949 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:09 +0000 (0:00:00.039) 0:01:00.142 ******* 2021-03-10T13:41:09.975 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-03-10T13:41:09.976 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:10.001 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:09 +0000 (0:00:00.052) 0:01:00.195 ******* 2021-03-10T13:41:10.017 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-03-10T13:41:10.019 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:10.041 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:10 +0000 (0:00:00.039) 0:01:00.234 ******* 2021-03-10T13:41:10.066 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-03-10T13:41:10.068 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:10.090 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:10 +0000 (0:00:00.049) 0:01:00.284 ******* 2021-03-10T13:41:10.106 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-03-10T13:41:10.108 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:10.130 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:10 +0000 (0:00:00.039) 0:01:00.323 ******* 2021-03-10T13:41:10.145 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-03-10T13:41:10.146 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:10.168 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:10 +0000 (0:00:00.038) 0:01:00.361 ******* 2021-03-10T13:41:10.195 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-03-10T13:41:10.196 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:10.218 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:10 +0000 (0:00:00.049) 0:01:00.411 ******* 2021-03-10T13:41:10.234 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-03-10T13:41:10.236 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:10.258 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:10 +0000 (0:00:00.039) 0:01:00.451 ******* 2021-03-10T13:41:10.285 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-03-10T13:41:10.286 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:10.309 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:10 +0000 (0:00:00.050) 0:01:00.502 ******* 2021-03-10T13:41:10.325 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-03-10T13:41:10.326 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:10.350 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:10 +0000 (0:00:00.041) 0:01:00.543 ******* 2021-03-10T13:41:10.376 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-03-10T13:41:10.378 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:10.399 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:10 +0000 (0:00:00.049) 0:01:00.592 ******* 2021-03-10T13:41:10.414 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-03-10T13:41:10.416 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:10.438 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:10 +0000 (0:00:00.038) 0:01:00.631 ******* 2021-03-10T13:41:10.464 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-03-10T13:41:10.466 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:10.487 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:10 +0000 (0:00:00.049) 0:01:00.681 ******* 2021-03-10T13:41:10.503 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-03-10T13:41:10.505 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:10.530 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:10 +0000 (0:00:00.042) 0:01:00.723 ******* 2021-03-10T13:41:10.556 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-03-10T13:41:10.558 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:10.581 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:10 +0000 (0:00:00.051) 0:01:00.774 ******* 2021-03-10T13:41:10.597 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-03-10T13:41:10.599 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:10.621 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:10 +0000 (0:00:00.040) 0:01:00.814 ******* 2021-03-10T13:41:10.647 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-03-10T13:41:10.648 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:10.670 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:10 +0000 (0:00:00.049) 0:01:00.864 ******* 2021-03-10T13:41:10.686 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-03-10T13:41:10.688 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:10.710 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:10 +0000 (0:00:00.039) 0:01:00.903 ******* 2021-03-10T13:41:10.726 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-03-10T13:41:10.728 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:10.750 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:10 +0000 (0:00:00.040) 0:01:00.943 ******* 2021-03-10T13:41:10.776 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-03-10T13:41:10.778 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:10.799 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:10 +0000 (0:00:00.049) 0:01:00.993 ******* 2021-03-10T13:41:10.815 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-03-10T13:41:10.816 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:10.838 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:10 +0000 (0:00:00.039) 0:01:01.032 ******* 2021-03-10T13:41:10.906 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-03-10T13:41:10.908 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:10.928 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:10 +0000 (0:00:00.089) 0:01:01.121 ******* 2021-03-10T13:41:10.934 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-03-10T13:41:10.935 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.001302", "end": "2021-03-10 13:41:11.198471", "rc": 0, "start": "2021-03-10 13:41:11.197169", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:41:10.959 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:10 +0000 (0:00:00.031) 0:01:01.153 ******* 2021-03-10T13:41:11.027 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-03-10T13:41:11.048 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:11 +0000 (0:00:00.088) 0:01:01.242 ******* 2021-03-10T13:41:11.074 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-03-10T13:41:11.076 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.001431", "end": "2021-03-10 13:41:11.014731", "rc": 0, "start": "2021-03-10 13:41:11.013300", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:41:11.098 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:11 +0000 (0:00:00.050) 0:01:01.292 ******* 2021-03-10T13:41:11.166 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-03-10T13:41:11.192 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:11 +0000 (0:00:00.094) 0:01:01.386 ******* 2021-03-10T13:41:11.322 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-03-10T13:41:11.324 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-03-10T13:41:11.345 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:11 +0000 (0:00:00.152) 0:01:01.539 ******* 2021-03-10T13:41:11.413 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-03-10T13:41:11.414 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:11.435 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:11 +0000 (0:00:00.089) 0:01:01.628 ******* 2021-03-10T13:41:11.442 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-03-10T13:41:11.444 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-03-10T13:41:11.468 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:11 +0000 (0:00:00.032) 0:01:01.661 ******* 2021-03-10T13:41:11.535 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:11.556 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:11 +0000 (0:00:00.088) 0:01:01.750 ******* 2021-03-10T13:41:12.347 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-03-10T13:41:12.349 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-03-10T13:41:12.359 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-03-10T13:41:13.092 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-03-10T13:41:13.116 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:13 +0000 (0:00:01.559) 0:01:03.310 ******* 2021-03-10T13:41:13.144 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-03-10T13:41:13.168 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:13 +0000 (0:00:00.051) 0:01:03.361 ******* 2021-03-10T13:41:13.568 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-03-10T13:41:13.570 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"cache_update_time": 1615383598, "cache_updated": false, "changed": false} 2021-03-10T13:41:13.593 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:13 +0000 (0:00:00.425) 0:01:03.786 ******* 2021-03-10T13:41:13.652 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-03-10T13:41:13.682 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:13 +0000 (0:00:00.088) 0:01:03.875 ******* 2021-03-10T13:41:13.690 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-03-10T13:41:13.692 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"cache_update_time": 1615383603, "cache_updated": false, "changed": false} 2021-03-10T13:41:13.721 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:13 +0000 (0:00:00.038) 0:01:03.914 ******* 2021-03-10T13:41:13.789 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-03-10T13:41:13.814 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:13 +0000 (0:00:00.092) 0:01:04.007 ******* 2021-03-10T13:41:13.985 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** [WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo changed: [gibba013.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.011067", "end": "2021-03-10 13:41:14.096606", "rc": 0, "start": "2021-03-10 13:41:14.085539", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} Wednesday 10 March 2021 13:41:13 +0000 (0:00:00.041) 0:01:04.049 ******* changed: [gibba020.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.010996", "end": "2021-03-10 13:41:13.915220", "rc": 0, "start": "2021-03-10 13:41:13.904224", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:41:13.999 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:13 +0000 (0:00:00.143) 0:01:04.193 ******* 2021-03-10T13:41:15.420 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-03-10T13:41:15.422 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"cache_update_time": 1615383598, "cache_updated": false, "changed": false} 2021-03-10T13:41:15.445 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:15 +0000 (0:00:01.445) 0:01:05.638 ******* 2021-03-10T13:41:15.641 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"cache_update_time": 1615383603, "cache_updated": false, "changed": false} 2021-03-10T13:41:15.664 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:15 +0000 (0:00:00.219) 0:01:05.857 ******* 2021-03-10T13:41:24.121 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-03-10T13:41:24.123 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0\n libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla\n libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0\n libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf\n qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 9 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 101691 files and directories currently installed.)\r\nR 2021-03-10T13:41:24.124 INFO:teuthology.task.ansible.out:emoving qemu-utils (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...\r\nRemoving librbd1 (15.2.8-0ubuntu0.20.04.1) ...\r\nRemoving librados2 (15.2.8-0ubuntu0.20.04.1) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0", " libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla", " libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0", " libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf", " qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 9 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading 2021-03-10T13:41:24.126 INFO:teuthology.task.ansible.out: database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 101691 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.14) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.14) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.14) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...", "Removing librbd1 (15.2.8-0ubuntu0.20.04.1) ...", "Removing librados2 (15.2.8-0ubuntu0.20.04.1) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-03-10T13:41:24.144 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:24 +0000 (0:00:08.479) 0:01:14.338 ******* 2021-03-10T13:41:24.369 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0\n libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla\n libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0\n libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf\n qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 9 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 101691 files and directories currently installed.)\r\nR 2021-03-10T13:41:24.371 INFO:teuthology.task.ansible.out:emoving qemu-utils (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...\r\nRemoving librbd1 (15.2.8-0ubuntu0.20.04.1) ...\r\nRemoving librados2 (15.2.8-0ubuntu0.20.04.1) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0", " libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla", " libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0", " libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf", " qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 9 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading 2021-03-10T13:41:24.372 INFO:teuthology.task.ansible.out: database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 101691 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.14) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.14) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.14) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...", "Removing librbd1 (15.2.8-0ubuntu0.20.04.1) ...", "Removing librados2 (15.2.8-0ubuntu0.20.04.1) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-03-10T13:41:24.394 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:24 +0000 (0:00:00.249) 0:01:14.587 ******* 2021-03-10T13:41:24.596 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-03-10T13:41:24.598 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"cache_update_time": 1615383598, "cache_updated": false, "changed": false} 2021-03-10T13:41:24.619 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:24 +0000 (0:00:00.225) 0:01:14.813 ******* 2021-03-10T13:41:24.687 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-03-10T13:41:24.688 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:24.710 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:24 +0000 (0:00:00.090) 0:01:14.903 ******* 2021-03-10T13:41:24.841 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-03-10T13:41:24.843 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"cache_update_time": 1615383603, "cache_updated": false, "changed": false} 2021-03-10T13:41:24.865 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:24 +0000 (0:00:00.154) 0:01:15.058 ******* 2021-03-10T13:41:24.934 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-03-10T13:41:24.936 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:24.959 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:24 +0000 (0:00:00.093) 0:01:15.152 ******* 2021-03-10T13:41:34.162 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-03-10T13:41:34.164 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => {"cache_update_time": 1615383598, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk\n gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n git\n1 upgraded, 6 newly installed, 0 to remove and 8 not upgraded.\nNeed to get 18.2 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.1 [4557 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.8-0ubuntu0.20.04.1 [3209 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.8-0ubuntu0.20.04.1 [1615 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.14 [53.1 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.14 [1055 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.14 [6726 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.14 [975 kB]\nFetched 18.2 MB in 1s (14.3 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading databas 2021-03-10T13:41:34.166 INFO:teuthology.task.ansible.out:e ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 101619 files and directories currently installed.)\r\nPreparing to unpack .../0-git_1%3a2.25.1-1ubuntu3.1_amd64.deb ...\r\nUnpacking git (1:2.25.1-1ubuntu3.1) over (1:2.25.1-1ubuntu3) ...\r\nSelecting previously unselected package librados2.\r\nPreparing to unpack .../1-librados2_15.2.8-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.8-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../2-librbd1_15.2.8-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.8-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../3-qemu-block-extra_1%3a4.2-3ubuntu6.14_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../4-qemu-system-common_1%3a4.2-3ubuntu6.14_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.14) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../5-qemu-system-x86_1%3a4.2-3ubuntu6.14_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.14) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../6-qemu-utils_1%3a4.2-3ubuntu6.14_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.14) ...\r\nSetting up librados2 (15.2.8-0ubuntu0.20.04.1) ...\r\nSetting up git (1:2.25.1-1ubuntu3.1) ...\r\nSetting up librbd1 (15.2.8-0ubuntu0.20.04.1) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) 2021-03-10T13:41:34.167 INFO:teuthology.task.ansible.out:...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.14) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.14) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.14) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk", " gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " git", "1 upgraded, 6 newly installed, 0 to remove and 8 not upgraded.", "Need to get 18.2 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.1 [4557 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.8-0ubuntu0.20.04.1 [3209 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.8-0ubuntu0.20.04.1 [1615 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.14 [53.1 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.14 [1055 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.14 [6726 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.14 [975 kB]", "Fetched 18.2 MB in 1s (14.3 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", " 2021-03-10T13:41:34.169 INFO:teuthology.task.ansible.out:(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 101619 files and directories currently installed.)", "Preparing to unpack .../0-git_1%3a2.25.1-1ubuntu3.1_amd64.deb ...", "Unpacking git (1:2.25.1-1ubuntu3.1) over (1:2.25.1-1ubuntu3) ...", "Selecting previously unselected package librados2.", "Preparing to unpack .../1-librados2_15.2.8-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librados2 (15.2.8-0ubuntu0.20.04.1) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../2-librbd1_15.2.8-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.8-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../3-qemu-block-extra_1%3a4.2-3ubuntu6.14_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../4-qemu-system-common_1%3a4.2-3ubuntu6.14_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.14) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../5-qemu-system-x86_1%3a4.2-3ubuntu6.14_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.14) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../6-qemu-utils_1%3a4.2-3ubuntu6.14_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.14) ...", "Setting up librados2 (15.2.8-0ubuntu0.20.04.1) ...", "Setting up git (1:2.25.1-1ubuntu3.1) ...", "Setting up librbd1 (15.2.8-0ubuntu0.20.04.1) ...", "Sett 2021-03-10T13:41:34.170 INFO:teuthology.task.ansible.out:ing up qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.14) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.14) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.14) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-03-10T13:41:34.187 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:34 +0000 (0:00:09.228) 0:01:24.381 ******* 2021-03-10T13:41:34.588 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => {"cache_update_time": 1615383603, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk\n gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n git\n1 upgraded, 6 newly installed, 0 to remove and 8 not upgraded.\nNeed to get 18.2 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.1 [4557 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.8-0ubuntu0.20.04.1 [3209 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.8-0ubuntu0.20.04.1 [1615 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.14 [53.1 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.14 [1055 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.14 [6726 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.14 [975 kB]\nFetched 18.2 MB in 1s (14.1 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading databas 2021-03-10T13:41:34.589 INFO:teuthology.task.ansible.out:e ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 101619 files and directories currently installed.)\r\nPreparing to unpack .../0-git_1%3a2.25.1-1ubuntu3.1_amd64.deb ...\r\nUnpacking git (1:2.25.1-1ubuntu3.1) over (1:2.25.1-1ubuntu3) ...\r\nSelecting previously unselected package librados2.\r\nPreparing to unpack .../1-librados2_15.2.8-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.8-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../2-librbd1_15.2.8-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.8-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../3-qemu-block-extra_1%3a4.2-3ubuntu6.14_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../4-qemu-system-common_1%3a4.2-3ubuntu6.14_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.14) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../5-qemu-system-x86_1%3a4.2-3ubuntu6.14_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.14) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../6-qemu-utils_1%3a4.2-3ubuntu6.14_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.14) ...\r\nSetting up librados2 (15.2.8-0ubuntu0.20.04.1) ...\r\nSetting up git (1:2.25.1-1ubuntu3.1) ...\r\nSetting up librbd1 (15.2.8-0ubuntu0.20.04.1) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) 2021-03-10T13:41:34.591 INFO:teuthology.task.ansible.out:...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.14) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.14) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.14) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk", " gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " git", "1 upgraded, 6 newly installed, 0 to remove and 8 not upgraded.", "Need to get 18.2 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.1 [4557 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.8-0ubuntu0.20.04.1 [3209 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.8-0ubuntu0.20.04.1 [1615 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.14 [53.1 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.14 [1055 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.14 [6726 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.14 [975 kB]", "Fetched 18.2 MB in 1s (14.1 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", " 2021-03-10T13:41:34.593 INFO:teuthology.task.ansible.out:(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 101619 files and directories currently installed.)", "Preparing to unpack .../0-git_1%3a2.25.1-1ubuntu3.1_amd64.deb ...", "Unpacking git (1:2.25.1-1ubuntu3.1) over (1:2.25.1-1ubuntu3) ...", "Selecting previously unselected package librados2.", "Preparing to unpack .../1-librados2_15.2.8-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librados2 (15.2.8-0ubuntu0.20.04.1) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../2-librbd1_15.2.8-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.8-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../3-qemu-block-extra_1%3a4.2-3ubuntu6.14_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../4-qemu-system-common_1%3a4.2-3ubuntu6.14_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.14) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../5-qemu-system-x86_1%3a4.2-3ubuntu6.14_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.14) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../6-qemu-utils_1%3a4.2-3ubuntu6.14_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.14) ...", "Setting up librados2 (15.2.8-0ubuntu0.20.04.1) ...", "Setting up git (1:2.25.1-1ubuntu3.1) ...", "Setting up librbd1 (15.2.8-0ubuntu0.20.04.1) ...", "Sett 2021-03-10T13:41:34.594 INFO:teuthology.task.ansible.out:ing up qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.14) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.14) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.14) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-03-10T13:41:34.612 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:34 +0000 (0:00:00.424) 0:01:24.805 ******* 2021-03-10T13:41:34.638 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-03-10T13:41:34.640 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"cache_update_time": 1615383598, "cache_updated": false, "changed": false} 2021-03-10T13:41:34.663 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:34 +0000 (0:00:00.051) 0:01:24.856 ******* 2021-03-10T13:41:35.052 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"cache_update_time": 1615383603, "cache_updated": false, "changed": false} 2021-03-10T13:41:35.075 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:35 +0000 (0:00:00.412) 0:01:25.269 ******* 2021-03-10T13:41:35.101 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-03-10T13:41:35.103 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"cache_update_time": 1615383598, "cache_updated": false, "changed": false} 2021-03-10T13:41:35.126 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:35 +0000 (0:00:00.050) 0:01:25.319 ******* 2021-03-10T13:41:35.255 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-03-10T13:41:35.257 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-03-10T13:41:35.278 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:35 +0000 (0:00:00.152) 0:01:25.471 ******* 2021-03-10T13:41:35.345 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-03-10T13:41:35.346 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:35.370 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:35 +0000 (0:00:00.091) 0:01:25.563 ******* 2021-03-10T13:41:35.510 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-03-10T13:41:35.511 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-03-10T13:41:35.532 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:35 +0000 (0:00:00.162) 0:01:25.725 ******* 2021-03-10T13:41:35.538 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-03-10T13:41:35.540 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"cache_update_time": 1615383603, "cache_updated": false, "changed": false} 2021-03-10T13:41:35.564 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:35 +0000 (0:00:00.030) 0:01:25.756 ******* 2021-03-10T13:41:35.716 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-03-10T13:41:35.718 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-03-10T13:41:35.739 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:35 +0000 (0:00:00.176) 0:01:25.932 ******* 2021-03-10T13:41:35.805 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-03-10T13:41:35.807 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:35.827 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:35 +0000 (0:00:00.088) 0:01:26.021 ******* 2021-03-10T13:41:35.832 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-03-10T13:41:35.833 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-03-10T13:41:35.857 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:35 +0000 (0:00:00.029) 0:01:26.050 ******* 2021-03-10T13:41:35.966 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-03-10T13:41:35.968 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-03-10T13:41:35.988 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:35 +0000 (0:00:00.131) 0:01:26.182 ******* 2021-03-10T13:41:36.015 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-03-10T13:41:36.017 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-03-10T13:41:36.041 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:36 +0000 (0:00:00.053) 0:01:26.235 ******* 2021-03-10T13:41:36.223 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-03-10T13:41:36.224 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-10T13:41:36.246 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:36 +0000 (0:00:00.204) 0:01:26.439 ******* 2021-03-10T13:41:36.271 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-03-10T13:41:36.273 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-03-10T13:41:36.296 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:36 +0000 (0:00:00.050) 0:01:26.489 ******* 2021-03-10T13:41:36.489 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-03-10T13:41:36.490 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Wed 2021-03-10 13:39:22 UTC", "ActiveEnterTimestampMonotonic": "13151907", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target -.mount sysinit.target systemd-journald.socket systemd-tmpfiles-setup.service system.slice basic.target nss-lookup.target remote-fs.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-03-10 13:39:21 UTC", "AssertTimestampMonotonic": "12318854", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-03-10 13:39:21 UTC", "ConditionTimestampMonotonic": "12318854", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": 2021-03-10T13:41:36.492 INFO:teuthology.task.ansible.out: "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1395", "ExecMainStartTimestamp": "Wed 2021-03-10 13:39:22 UTC", "ExecMainStartTimestampMonotonic": "13151897", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709 2021-03-10T13:41:36.493 INFO:teuthology.task.ansible.out:551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-03-10 13:39:21 UTC", "InactiveExitTimestampMonotonic": "12319467", "InvocationID": "5dd8c63fd9474e89b7804d82de14c402", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127828", "LimitNPROCSoft": "127828", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127828", "LimitSIGPENDINGSoft": "127828", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1395", "MemoryAccounting": "yes", "MemoryCurrent": "10661888", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPoli 2021-03-10T13:41:36.495 INFO:teuthology.task.ansible.out:cy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-10 13:39:22 UTC", "StateChangeTimestampMonotonic": "13151907", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38348", "TimeoutAbortUSec": 2021-03-10T13:41:36.496 INFO:teuthology.task.ansible.out: "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ ok: [gibba020.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-03-10T13:41:36.515 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:36 +0000 (0:00:00.218) 0:01:26.708 ******* 2021-03-10T13:41:36.534 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:36 +0000 (0:00:00.019) 0:01:26.727 ******* 2021-03-10T13:41:36.582 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-03-10T13:41:36.584 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:36.606 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:36 +0000 (0:00:00.071) 0:01:26.799 ******* 2021-03-10T13:41:36.663 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-03-10T13:41:36.665 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:36.685 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:36 +0000 (0:00:00.078) 0:01:26.878 ******* 2021-03-10T13:41:36.721 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-03-10T13:41:36.723 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-10T13:41:36.745 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:36 +0000 (0:00:00.060) 0:01:26.938 ******* 2021-03-10T13:41:36.750 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-03-10T13:41:36.752 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:36.775 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:36 +0000 (0:00:00.030) 0:01:26.968 ******* 2021-03-10T13:41:36.843 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-03-10T13:41:36.845 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:36.865 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:36 +0000 (0:00:00.090) 0:01:27.059 ******* 2021-03-10T13:41:36.932 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-03-10T13:41:36.934 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:36.954 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:36 +0000 (0:00:00.088) 0:01:27.147 ******* 2021-03-10T13:41:36.961 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-03-10T13:41:36.963 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Wed 2021-03-10 13:39:23 UTC", "ActiveEnterTimestampMonotonic": "15093367", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service basic.target nss-lookup.target network.target -.mount system.slice remote-fs.target sysinit.target systemd-journald.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-03-10 13:39:22 UTC", "AssertTimestampMonotonic": "13926836", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-03-10 13:39:22 UTC", "ConditionTimestampMonotonic": "13926836", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": 2021-03-10T13:41:36.964 INFO:teuthology.task.ansible.out: "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1527", "ExecMainStartTimestamp": "Wed 2021-03-10 13:39:23 UTC", "ExecMainStartTimestampMonotonic": "15093350", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709 2021-03-10T13:41:36.966 INFO:teuthology.task.ansible.out:551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-03-10 13:39:22 UTC", "InactiveExitTimestampMonotonic": "13928045", "InvocationID": "5eca67e4e175484a999ffc55ff3f2e35", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127828", "LimitNPROCSoft": "127828", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127828", "LimitSIGPENDINGSoft": "127828", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1527", "MemoryAccounting": "yes", "MemoryCurrent": "10584064", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPoli 2021-03-10T13:41:36.968 INFO:teuthology.task.ansible.out:cy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-10 13:39:23 UTC", "StateChangeTimestampMonotonic": "15093367", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38348", "TimeoutAbortUSec": 2021-03-10T13:41:36.969 INFO:teuthology.task.ansible.out: "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-10T13:41:36.989 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:36 +0000 (0:00:00.035) 0:01:27.183 ******* 2021-03-10T13:41:37.016 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-03-10T13:41:37.018 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:37.039 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:37 +0000 (0:00:00.049) 0:01:27.233 ******* 2021-03-10T13:41:37.055 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-03-10T13:41:37.057 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:37.079 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:37 +0000 (0:00:00.039) 0:01:27.272 ******* 2021-03-10T13:41:37.094 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-03-10T13:41:37.096 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:37.118 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:37 +0000 (0:00:00.038) 0:01:27.311 ******* 2021-03-10T13:41:37.134 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-03-10T13:41:37.136 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:37.158 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:37 +0000 (0:00:00.039) 0:01:27.351 ******* 2021-03-10T13:41:37.173 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-03-10T13:41:37.175 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:37.197 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:37 +0000 (0:00:00.039) 0:01:27.390 ******* 2021-03-10T13:41:37.224 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-03-10T13:41:37.226 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:37.247 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:37 +0000 (0:00:00.049) 0:01:27.440 ******* 2021-03-10T13:41:37.263 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T13:41:37.265 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:37.287 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:37 +0000 (0:00:00.039) 0:01:27.480 ******* 2021-03-10T13:41:37.314 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-03-10T13:41:37.316 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:37.337 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:37 +0000 (0:00:00.050) 0:01:27.530 ******* 2021-03-10T13:41:37.353 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-03-10T13:41:37.355 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:37.378 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:37 +0000 (0:00:00.040) 0:01:27.571 ******* 2021-03-10T13:41:37.405 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-03-10T13:41:37.407 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:37.429 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:37 +0000 (0:00:00.050) 0:01:27.622 ******* 2021-03-10T13:41:37.445 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-03-10T13:41:37.446 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:37.469 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:37 +0000 (0:00:00.040) 0:01:27.662 ******* 2021-03-10T13:41:37.496 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-03-10T13:41:37.497 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:37.522 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:37 +0000 (0:00:00.053) 0:01:27.716 ******* 2021-03-10T13:41:37.539 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-03-10T13:41:37.541 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:37.564 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:37 +0000 (0:00:00.041) 0:01:27.757 ******* 2021-03-10T13:41:37.580 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-03-10T13:41:37.582 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:37.605 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:37 +0000 (0:00:00.041) 0:01:27.798 ******* 2021-03-10T13:41:37.631 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-03-10T13:41:37.633 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:37.655 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:37 +0000 (0:00:00.050) 0:01:27.848 ******* 2021-03-10T13:41:37.675 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-03-10T13:41:37.677 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:37.700 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:37 +0000 (0:00:00.044) 0:01:27.893 ******* 2021-03-10T13:41:37.716 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-03-10T13:41:37.717 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:37.740 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:37 +0000 (0:00:00.040) 0:01:27.934 ******* 2021-03-10T13:41:37.767 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T13:41:37.769 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:37.791 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:37 +0000 (0:00:00.050) 0:01:27.985 ******* 2021-03-10T13:41:37.808 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-03-10T13:41:37.809 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:37.832 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:37 +0000 (0:00:00.040) 0:01:28.025 ******* 2021-03-10T13:41:37.859 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-03-10T13:41:37.860 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:37.882 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:37 +0000 (0:00:00.050) 0:01:28.076 ******* 2021-03-10T13:41:37.899 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-10T13:41:37.900 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:37.923 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:37 +0000 (0:00:00.040) 0:01:28.116 ******* 2021-03-10T13:41:37.950 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-03-10T13:41:37.952 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:37.974 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:37 +0000 (0:00:00.050) 0:01:28.167 ******* 2021-03-10T13:41:37.991 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:38.026 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:38 +0000 (0:00:00.052) 0:01:28.219 ******* 2021-03-10T13:41:38.055 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-03-10T13:41:38.057 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:38.082 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:38 +0000 (0:00:00.056) 0:01:28.276 ******* 2021-03-10T13:41:38.109 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-03-10T13:41:38.111 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:38.134 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:38 +0000 (0:00:00.051) 0:01:28.327 ******* 2021-03-10T13:41:38.150 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-03-10T13:41:38.152 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:38.175 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:38 +0000 (0:00:00.040) 0:01:28.368 ******* 2021-03-10T13:41:38.191 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-03-10T13:41:38.192 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:38.216 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:38 +0000 (0:00:00.041) 0:01:28.409 ******* 2021-03-10T13:41:38.233 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-03-10T13:41:38.234 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:38.257 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:38 +0000 (0:00:00.041) 0:01:28.450 ******* 2021-03-10T13:41:38.274 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-03-10T13:41:38.275 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:38.298 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:38 +0000 (0:00:00.040) 0:01:28.491 ******* 2021-03-10T13:41:38.325 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-03-10T13:41:38.327 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:38.349 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:38 +0000 (0:00:00.050) 0:01:28.542 ******* 2021-03-10T13:41:38.365 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-03-10T13:41:38.367 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:38.390 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:38 +0000 (0:00:00.041) 0:01:28.583 ******* 2021-03-10T13:41:38.417 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-10T13:41:38.419 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:38.440 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:38 +0000 (0:00:00.049) 0:01:28.633 ******* 2021-03-10T13:41:38.455 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-10T13:41:38.457 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:38.479 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:38 +0000 (0:00:00.038) 0:01:28.672 ******* 2021-03-10T13:41:38.505 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-03-10T13:41:38.507 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:38.528 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:38 +0000 (0:00:00.049) 0:01:28.722 ******* 2021-03-10T13:41:38.545 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-03-10T13:41:38.546 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:38.568 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:38 +0000 (0:00:00.039) 0:01:28.761 ******* 2021-03-10T13:41:38.595 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-03-10T13:41:38.596 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:38.621 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:38 +0000 (0:00:00.052) 0:01:28.814 ******* 2021-03-10T13:41:38.637 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-03-10T13:41:38.639 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:38.661 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:38 +0000 (0:00:00.039) 0:01:28.854 ******* 2021-03-10T13:41:38.677 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-03-10T13:41:38.679 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:38.700 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:38 +0000 (0:00:00.039) 0:01:28.893 ******* 2021-03-10T13:41:38.715 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-10T13:41:38.717 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:38.739 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:38 +0000 (0:00:00.038) 0:01:28.932 ******* 2021-03-10T13:41:38.755 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-03-10T13:41:38.757 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:38.779 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:38 +0000 (0:00:00.039) 0:01:28.972 ******* 2021-03-10T13:41:38.795 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-03-10T13:41:38.796 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:38.819 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:38 +0000 (0:00:00.040) 0:01:29.012 ******* 2021-03-10T13:41:38.846 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-03-10T13:41:38.847 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:38.869 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:38 +0000 (0:00:00.050) 0:01:29.062 ******* 2021-03-10T13:41:38.926 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-10T13:41:38.928 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:38.949 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:38 +0000 (0:00:00.080) 0:01:29.142 ******* 2021-03-10T13:41:38.965 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-03-10T13:41:38.967 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-03-10T13:41:38.989 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:38 +0000 (0:00:00.039) 0:01:29.182 ******* 2021-03-10T13:41:39.015 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-03-10T13:41:39.017 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:39.039 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:39 +0000 (0:00:00.049) 0:01:29.232 ******* 2021-03-10T13:41:39.106 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-03-10T13:41:39.108 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:39.129 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:39 +0000 (0:00:00.090) 0:01:29.322 ******* 2021-03-10T13:41:39.195 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-10T13:41:39.197 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:39.218 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:39 +0000 (0:00:00.089) 0:01:29.411 ******* 2021-03-10T13:41:39.266 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-03-10T13:41:39.267 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-03-10T13:41:39.293 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:39 +0000 (0:00:00.075) 0:01:29.486 ******* 2021-03-10T13:41:39.299 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-03-10T13:41:39.301 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:39.325 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:39 +0000 (0:00:00.031) 0:01:29.518 ******* 2021-03-10T13:41:39.362 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-03-10T13:41:39.363 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:39.386 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:39 +0000 (0:00:00.061) 0:01:29.579 ******* 2021-03-10T13:41:39.464 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-03-10T13:41:39.466 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-03-10T13:41:39.488 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:39 +0000 (0:00:00.101) 0:01:29.681 ******* 2021-03-10T13:41:39.649 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-03-10T13:41:39.650 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-03-10T13:41:39.673 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:39 +0000 (0:00:00.184) 0:01:29.866 ******* 2021-03-10T13:41:39.762 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-03-10T13:41:39.763 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-03-10T13:41:39.786 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:39 +0000 (0:00:00.113) 0:01:29.979 ******* 2021-03-10T13:41:39.854 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:39.876 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:39 +0000 (0:00:00.090) 0:01:30.070 ******* 2021-03-10T13:41:39.964 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-03-10T13:41:39.966 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-03-10T13:41:39.988 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:39 +0000 (0:00:00.111) 0:01:30.181 ******* 2021-03-10T13:41:40.180 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-03-10T13:41:40.182 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-03-10T13:41:40.204 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:40 +0000 (0:00:00.215) 0:01:30.397 ******* 2021-03-10T13:41:40.250 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-03-10T13:41:40.252 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-03-10T13:41:40.274 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:40 +0000 (0:00:00.070) 0:01:30.468 ******* 2021-03-10T13:41:40.418 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-03-10T13:41:40.420 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-10T13:41:40.441 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:40 +0000 (0:00:00.167) 0:01:30.635 ******* 2021-03-10T13:41:40.509 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-03-10T13:41:40.511 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:40.533 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:40 +0000 (0:00:00.091) 0:01:30.726 ******* 2021-03-10T13:41:40.559 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:40 +0000 (0:00:00.026) 0:01:30.752 ******* 2021-03-10T13:41:40.596 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-03-10T13:41:40.598 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:40.621 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:40 +0000 (0:00:00.061) 0:01:30.814 ******* 2021-03-10T13:41:40.678 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-03-10T13:41:40.679 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:40.701 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:40 +0000 (0:00:00.079) 0:01:30.894 ******* 2021-03-10T13:41:40.758 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-03-10T13:41:40.760 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:40.780 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:40 +0000 (0:00:00.079) 0:01:30.974 ******* 2021-03-10T13:41:40.837 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-03-10T13:41:40.839 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:40.860 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:40 +0000 (0:00:00.079) 0:01:31.054 ******* 2021-03-10T13:41:40.881 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:40 +0000 (0:00:00.020) 0:01:31.074 ******* 2021-03-10T13:41:40.939 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T13:41:40.941 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-03-10T13:41:40.963 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:40 +0000 (0:00:00.082) 0:01:31.156 ******* 2021-03-10T13:41:41.021 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-03-10T13:41:41.022 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-10T13:41:41.045 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:41 +0000 (0:00:00.081) 0:01:31.238 ******* 2021-03-10T13:41:41.051 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-03-10T13:41:41.053 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [gibba013.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-03-10T13:41:41.064 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-03-10T13:41:41.065 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} skipping: [gibba013.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-03-10T13:41:41.075 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-03-10T13:41:41.077 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-03-10T13:41:41.087 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-03-10T13:41:41.088 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-03-10T13:41:41.098 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-03-10T13:41:41.099 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-03-10T13:41:41.109 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-03-10T13:41:41.111 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-03-10T13:41:41.120 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:41.122 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [gibba013.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} skipping: [gibba013.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-03-10T13:41:41.148 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:41 +0000 (0:00:00.102) 0:01:31.341 ******* 2021-03-10T13:41:41.167 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:41 +0000 (0:00:00.019) 0:01:31.361 ******* 2021-03-10T13:41:41.235 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-03-10T13:41:41.237 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:41.258 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:41 +0000 (0:00:00.090) 0:01:31.451 ******* 2021-03-10T13:41:41.326 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-03-10T13:41:41.327 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:41.348 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:41 +0000 (0:00:00.090) 0:01:31.542 ******* 2021-03-10T13:41:41.365 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-03-10T13:41:41.366 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003190", "end": "2021-03-10 13:41:41.346658", "rc": 0, "start": "2021-03-10 13:41:41.343468", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_b6eecfe89a4363750d696160843a096384b357a8/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_b6eecfe89a4363750d696160843a096384b357a8/virtualenv/bin/teuthology-lock"]} 2021-03-10T13:41:41.396 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:41 +0000 (0:00:00.047) 0:01:31.589 ******* 2021-03-10T13:41:41.413 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-03-10T13:41:41.415 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:41.437 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:41 +0000 (0:00:00.041) 0:01:31.630 ******* 2021-03-10T13:41:41.464 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-03-10T13:41:41.466 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:41.490 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:41 +0000 (0:00:00.053) 0:01:31.684 ******* 2021-03-10T13:41:41.507 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-03-10T13:41:41.509 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:41.532 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:41 +0000 (0:00:00.041) 0:01:31.725 ******* 2021-03-10T13:41:41.559 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-03-10T13:41:41.561 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:41.583 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:41 +0000 (0:00:00.051) 0:01:31.776 ******* 2021-03-10T13:41:41.600 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T13:41:41.601 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-03-10T13:41:41.624 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:41 +0000 (0:00:00.040) 0:01:31.818 ******* 2021-03-10T13:41:41.651 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-03-10T13:41:41.653 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:41.676 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:41 +0000 (0:00:00.051) 0:01:31.869 ******* 2021-03-10T13:41:41.703 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-03-10T13:41:41.705 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-03-10T13:41:41.714 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-03-10T13:41:41.716 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-03-10T13:41:41.725 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-03-10T13:41:41.736 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-03-10T13:41:41.738 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-03-10T13:41:41.747 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-03-10T13:41:41.749 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-03-10T13:41:41.758 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-03-10T13:41:41.760 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-03-10T13:41:41.769 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-03-10T13:41:41.771 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-03-10T13:41:41.781 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-03-10T13:41:41.782 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-03-10T13:41:41.792 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-03-10T13:41:41.818 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:41 +0000 (0:00:00.142) 0:01:32.011 ******* 2021-03-10T13:41:42.060 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-03-10T13:41:42.062 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003027", "end": "2021-03-10 13:41:42.042412", "rc": 0, "start": "2021-03-10 13:41:42.039385", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_b6eecfe89a4363750d696160843a096384b357a8/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_b6eecfe89a4363750d696160843a096384b357a8/virtualenv/bin/teuthology-lock"]} 2021-03-10T13:41:42.085 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:42 +0000 (0:00:00.266) 0:01:32.278 ******* 2021-03-10T13:41:42.121 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-03-10T13:41:42.123 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"cache_update_time": 1615383598, "cache_updated": false, "changed": false} 2021-03-10T13:41:42.145 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:42 +0000 (0:00:00.059) 0:01:32.338 ******* 2021-03-10T13:41:42.171 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-03-10T13:41:42.173 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:42.196 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:42 +0000 (0:00:00.051) 0:01:32.390 ******* 2021-03-10T13:41:42.212 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-03-10T13:41:42.213 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:42.239 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:42 +0000 (0:00:00.042) 0:01:32.432 ******* 2021-03-10T13:41:42.266 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-03-10T13:41:42.267 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:42.289 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:42 +0000 (0:00:00.050) 0:01:32.483 ******* 2021-03-10T13:41:42.315 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-03-10T13:41:42.317 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item={'block_used': 13728329, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226366779, 'size_available': 927198326784, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 113650, 'block_size': 4096, 'inode_available': 60941326}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226366779, "block_size": 4096, "block_total": 240095108, "block_used": 13728329, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941326, "inode_total": 61054976, "inode_used": 113650, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 927198326784, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}} 2021-03-10T13:41:42.341 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:42 +0000 (0:00:00.051) 0:01:32.534 ******* 2021-03-10T13:41:42.357 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-03-10T13:41:42.359 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:42.382 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:42 +0000 (0:00:00.041) 0:01:32.575 ******* 2021-03-10T13:41:42.472 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-03-10T13:41:42.473 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.002418", "end": "2021-03-10 13:41:42.740063", "rc": 0, "start": "2021-03-10 13:41:42.737645", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:41:42.496 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:42 +0000 (0:00:00.113) 0:01:32.689 ******* 2021-03-10T13:41:42.574 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-03-10T13:41:42.575 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'block_used': 13728329, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226366779, 'size_available': 927198326784, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 113650, 'block_size': 4096, 'inode_available': 60941326}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226366779, "block_size": 4096, "block_total": 240095108, "block_used": 13728329, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941326, "inode_total": 61054976, "inode_used": 113650, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 927198326784, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:42.597 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:42 +0000 (0:00:00.101) 0:01:32.790 ******* 2021-03-10T13:41:42.664 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-03-10T13:41:42.685 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:42 +0000 (0:00:00.088) 0:01:32.879 ******* 2021-03-10T13:41:42.763 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-03-10T13:41:42.764 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:42.826 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* ok: [gibba020.front.sepia.ceph.com] => {"cache_update_time": 1615383603, "cache_updated": false, "changed": false} 2021-03-10T13:41:42.849 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:42 +0000 (0:00:00.163) 0:01:33.042 ******* 2021-03-10T13:41:42.916 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-03-10T13:41:42.918 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:42.939 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:42 +0000 (0:00:00.089) 0:01:33.132 ******* 2021-03-10T13:41:43.016 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-03-10T13:41:43.018 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item={'block_used': 13728330, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226366778, 'size_available': 927198322688, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 113650, 'block_size': 4096, 'inode_available': 60941326}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226366778, "block_size": 4096, "block_total": 240095108, "block_used": 13728330, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941326, "inode_total": 61054976, "inode_used": 113650, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 927198322688, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}} 2021-03-10T13:41:43.040 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:43 +0000 (0:00:00.101) 0:01:33.233 ******* 2021-03-10T13:41:43.178 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-03-10T13:41:43.180 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.002381", "end": "2021-03-10 13:41:43.121532", "rc": 0, "start": "2021-03-10 13:41:43.119151", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:41:43.201 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:43 +0000 (0:00:00.160) 0:01:33.394 ******* 2021-03-10T13:41:43.278 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-03-10T13:41:43.279 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'block_used': 13728330, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226366778, 'size_available': 927198322688, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 113650, 'block_size': 4096, 'inode_available': 60941326}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226366778, "block_size": 4096, "block_total": 240095108, "block_used": 13728330, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941326, "inode_total": 61054976, "inode_used": 113650, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 927198322688, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:43.301 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:43 +0000 (0:00:00.100) 0:01:33.494 ******* 2021-03-10T13:41:43.368 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-03-10T13:41:43.394 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:43 +0000 (0:00:00.092) 0:01:33.587 ******* 2021-03-10T13:41:43.472 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-03-10T13:41:43.473 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:44.532 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-OtfTk7txIuQGSpV0jpGDEPl7IlbZAfZJ1jBY5OS3mP85ZYwZtf7FyIv3ngbZYoY6'], 'uuids': ['3250f0a4-5aa6-42ea-b958-15eaf88e69cf']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.673931", "end": "2021-03-10 13:41:44.789814", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-OtfTk7txIuQGSpV0jpGDEPl7IlbZAfZJ1jBY5OS3mP85ZYwZtf7FyIv3ngbZYoY6"], "labels": [], "masters": [], "uuids": ["3250f0a4-5aa6-42ea-b958-15eaf88e69cf"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:41:43.115883", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T13:41:44.543 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:44.555 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:45.226 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-ccJYs5cDBUE354eZmSNWke5vulvEzufVN6Q20WEuq1VZ3N0Uz4AXf9A0lFTrKteM'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.657368", "end": "2021-03-10 13:41:45.158869", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-ccJYs5cDBUE354eZmSNWke5vulvEzufVN6Q20WEuq1VZ3N0Uz4AXf9A0lFTrKteM"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:41:43.501501", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T13:41:45.227 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:45.239 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:45.756 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-OtfTk7txIuQGSpV0jpGDEPl7IlbZAfZJfZNmEpywtbw73BTU5fdTYF9QzGRXzTzh'], 'uuids': ['6cc0167c-1b64-452d-9479-649e8354e7f3']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.087425", "end": "2021-03-10 13:41:46.008143", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-OtfTk7txIuQGSpV0jpGDEPl7IlbZAfZJfZNmEpywtbw73BTU5fdTYF9QzGRXzTzh"], "labels": [], "masters": [], "uuids": ["6cc0167c-1b64-452d-9479-649e8354e7f3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:41:44.920718", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T13:41:45.758 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF', 'wwn-0x50000399ab9813f5'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF-part1', 'wwn-0x50000399ab9813f5-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399ab9813f5', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I6K2L3F6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF", "wwn-0x50000399ab9813f5"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF-part1", "wwn-0x50000399ab9813f5-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I6K2L3F6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab9813f5"}}, "skip_reason": "Cond 2021-03-10T13:41:45.760 INFO:teuthology.task.ansible.out:itional result was False"} 2021-03-10T13:41:46.421 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-ccJYs5cDBUE354eZmSNWke5vulvEzufVaF2eM6NZsyS8nmANXrG8QfeQ1yq9nZ5G'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.093935", "end": "2021-03-10 13:41:46.352022", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-ccJYs5cDBUE354eZmSNWke5vulvEzufVaF2eM6NZsyS8nmANXrG8QfeQ1yq9nZ5G"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:41:45.258087", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T13:41:46.433 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I8K38OF6XF', 'wwn-0x50000399aba8166e'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I8K38OF6XF-part1', 'wwn-0x50000399aba8166e-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399aba8166e', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I8K38OF6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I8K38OF6XF", "wwn-0x50000399aba8166e"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I8K38OF6XF-part1", "wwn-0x50000399aba8166e-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I8K38OF6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399aba8166e"}}, "skip_reason": "Cond 2021-03-10T13:41:46.434 INFO:teuthology.task.ansible.out:itional result was False"} 2021-03-10T13:41:46.961 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-sw7XAS-vYAI-9g1m-k1Na-7Pb7-bWAR-BOx9Wm', 'nvme-INTEL_SSDPEL1K375GA_PHKM9200001J375A', 'nvme-nvme.8086-50484b4d393230303030314a33373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.120523", "end": "2021-03-10 13:41:47.217952", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-sw7XAS-vYAI-9g1m-k1Na-7Pb7-bWAR-BOx9Wm", "nvme-INTEL_SSDPEL1K375GA_PHKM9200001J375A", "nvme-nvme.8086-50484b4d393230303030314a33373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:41:46.097429", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures destroyed! You m 2021-03-10T13:41:46.963 INFO:teuthology.task.ansible.out:ay now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T13:41:46.973 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:46.973 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:47.655 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-aMOVYx-cWZj-2ix0-SmbC-Y3PA-1wFb-rczd1p', 'nvme-INTEL_SSDPEL1K375GA_PHKM920000CH375A', 'nvme-nvme.8086-50484b4d393230303030434833373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.115510", "end": "2021-03-10 13:41:47.589182", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-aMOVYx-cWZj-2ix0-SmbC-Y3PA-1wFb-rczd1p", "nvme-INTEL_SSDPEL1K375GA_PHKM920000CH375A", "nvme-nvme.8086-50484b4d393230303030434833373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:41:46.473672", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures destroyed! You m 2021-03-10T13:41:47.657 INFO:teuthology.task.ansible.out:ay now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T13:41:47.666 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:47.667 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:48.164 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-OtfTk7txIuQGSpV0jpGDEPl7IlbZAfZJVwhyJGcgcNv3rmP7gsB1F1IIJYdvxAcq'], 'uuids': ['93a4c719-d51f-49c2-bf89-2b12829c89f0']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.096522", "end": "2021-03-10 13:41:48.417850", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-OtfTk7txIuQGSpV0jpGDEPl7IlbZAfZJVwhyJGcgcNv3rmP7gsB1F1IIJYdvxAcq"], "labels": [], "masters": [], "uuids": ["93a4c719-d51f-49c2-bf89-2b12829c89f0"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:41:47.321328", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T13:41:48.175 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:48.176 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:48.858 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-ccJYs5cDBUE354eZmSNWke5vulvEzufVdK7ZY4PqwZeIIavfSii57cVuT478Y4Mb'], 'uuids': ['5857fe3d-9f2b-4580-afe3-0093b7199d93']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.104855", "end": "2021-03-10 13:41:48.795025", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-ccJYs5cDBUE354eZmSNWke5vulvEzufVdK7ZY4PqwZeIIavfSii57cVuT478Y4Mb"], "labels": [], "masters": [], "uuids": ["5857fe3d-9f2b-4580-afe3-0093b7199d93"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:41:47.690170", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T13:41:48.870 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:48.871 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:49.367 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-OtfTk7txIuQGSpV0jpGDEPl7IlbZAfZJKZ102k8SDDSDfczferfEGNceHXh9v7SG'], 'uuids': ['d23167e1-ecf7-450b-8dae-fc31c66bff88']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.099666", "end": "2021-03-10 13:41:49.617587", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-OtfTk7txIuQGSpV0jpGDEPl7IlbZAfZJKZ102k8SDDSDfczferfEGNceHXh9v7SG"], "labels": [], "masters": [], "uuids": ["d23167e1-ecf7-450b-8dae-fc31c66bff88"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:41:48.517921", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T13:41:49.368 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:50.050 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-ccJYs5cDBUE354eZmSNWke5vulvEzufVkjz9a6uLpSiqwoDhx5sDMY61d6nPXPop'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.093873", "end": "2021-03-10 13:41:49.986939", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-ccJYs5cDBUE354eZmSNWke5vulvEzufVkjz9a6uLpSiqwoDhx5sDMY61d6nPXPop"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:41:48.893066", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T13:41:50.062 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:50.548 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-OtfTk7txIuQGSpV0jpGDEPl7IlbZAfZJvldqPhqHLnh3FaJcnKD0gd9HklfER9OP'], 'uuids': ['38686e96-3efe-42bd-8b36-31fdf21aa54f']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.091151", "end": "2021-03-10 13:41:50.800982", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-OtfTk7txIuQGSpV0jpGDEPl7IlbZAfZJvldqPhqHLnh3FaJcnKD0gd9HklfER9OP"], "labels": [], "masters": [], "uuids": ["38686e96-3efe-42bd-8b36-31fdf21aa54f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:41:49.709831", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T13:41:50.582 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:50 +0000 (0:00:07.187) 0:01:40.775 ******* 2021-03-10T13:41:50.662 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-03-10T13:41:50.663 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:50.829 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-OtfTk7txIuQGSpV0jpGDEPl7IlbZAfZJ1jBY5OS3mP85ZYwZtf7FyIv3ngbZYoY6'], 'uuids': ['3250f0a4-5aa6-42ea-b958-15eaf88e69cf']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.077502", "end": "2021-03-10 13:41:51.091755", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-OtfTk7txIuQGSpV0jpGDEPl7IlbZAfZJ1jBY5OS3mP85ZYwZtf7FyIv3ngbZYoY6"], "labels": [], "masters": [], "uuids": ["3250f0a4-5aa6-42ea-b958-15eaf88e69cf"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:41:51.014253", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0762916 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0762916 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T13:41:50.841 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:50.966 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:51.124 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-OtfTk7txIuQGSpV0jpGDEPl7IlbZAfZJfZNmEpywtbw73BTU5fdTYF9QzGRXzTzh'], 'uuids': ['6cc0167c-1b64-452d-9479-649e8354e7f3']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.077519", "end": "2021-03-10 13:41:51.387229", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-OtfTk7txIuQGSpV0jpGDEPl7IlbZAfZJfZNmEpywtbw73BTU5fdTYF9QzGRXzTzh"], "labels": [], "masters": [], "uuids": ["6cc0167c-1b64-452d-9479-649e8354e7f3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:41:51.309710", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0762363 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0762363 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T13:41:51.136 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF', 'wwn-0x50000399ab9813f5'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF-part1', 'wwn-0x50000399ab9813f5-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399ab9813f5', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I6K2L3F6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF", "wwn-0x50000399ab9813f5"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF-part1", "wwn-0x50000399ab9813f5-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I6K2L3F6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab9813f5"}}, "skip_reason": "Cond 2021-03-10T13:41:51.138 INFO:teuthology.task.ansible.out:itional result was False"} 2021-03-10T13:41:51.242 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-sw7XAS-vYAI-9g1m-k1Na-7Pb7-bWAR-BOx9Wm', 'nvme-INTEL_SSDPEL1K375GA_PHKM9200001J375A', 'nvme-nvme.8086-50484b4d393230303030314a33373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.025267", "end": "2021-03-10 13:41:51.497660", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-sw7XAS-vYAI-9g1m-k1Na-7Pb7-bWAR-BOx9Wm", "nvme-INTEL_SSDPEL1K375GA_PHKM9200001J375A", "nvme-nvme.8086-50484b4d393230303030314a33373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:41:51.472393", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0240289 s, 4.8 GB/s", "stderr_lines": ["1 2021-03-10T13:41:51.244 INFO:teuthology.task.ansible.out:10+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0240289 s, 4.8 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T13:41:51.253 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:51.254 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-03-10T13:41:51.255 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-ccJYs5cDBUE354eZmSNWke5vulvEzufVZh6w8Y0oplojGgLkWLcIK87FesZflVm5'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.107956", "end": "2021-03-10 13:41:51.187262", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-ccJYs5cDBUE354eZmSNWke5vulvEzufVZh6w8Y0oplojGgLkWLcIK87FesZflVm5"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:41:50.079306", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T13:41:51.266 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-03-10T13:41:51.267 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:51.288 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:51 +0000 (0:00:00.706) 0:01:41.481 ******* 2021-03-10T13:41:51.409 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-OtfTk7txIuQGSpV0jpGDEPl7IlbZAfZJVwhyJGcgcNv3rmP7gsB1F1IIJYdvxAcq'], 'uuids': ['93a4c719-d51f-49c2-bf89-2b12829c89f0']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.077634", "end": "2021-03-10 13:41:51.670785", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-OtfTk7txIuQGSpV0jpGDEPl7IlbZAfZJVwhyJGcgcNv3rmP7gsB1F1IIJYdvxAcq"], "labels": [], "masters": [], "uuids": ["93a4c719-d51f-49c2-bf89-2b12829c89f0"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:41:51.593151", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0763144 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0763144 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T13:41:51.420 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:51.432 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:51.484 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:51.590 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-OtfTk7txIuQGSpV0jpGDEPl7IlbZAfZJKZ102k8SDDSDfczferfEGNceHXh9v7SG'], 'uuids': ['d23167e1-ecf7-450b-8dae-fc31c66bff88']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.078548", "end": "2021-03-10 13:41:51.852940", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-OtfTk7txIuQGSpV0jpGDEPl7IlbZAfZJKZ102k8SDDSDfczferfEGNceHXh9v7SG"], "labels": [], "masters": [], "uuids": ["d23167e1-ecf7-450b-8dae-fc31c66bff88"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:41:51.774392", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0773095 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0773095 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T13:41:51.601 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:51.655 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-ccJYs5cDBUE354eZmSNWke5vulvEzufVN6Q20WEuq1VZ3N0Uz4AXf9A0lFTrKteM'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.077924", "end": "2021-03-10 13:41:51.595547", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-ccJYs5cDBUE354eZmSNWke5vulvEzufVN6Q20WEuq1VZ3N0Uz4AXf9A0lFTrKteM"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:41:51.517623", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.076665 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.076665 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T13:41:51.667 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:51.669 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:51.763 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-OtfTk7txIuQGSpV0jpGDEPl7IlbZAfZJvldqPhqHLnh3FaJcnKD0gd9HklfER9OP'], 'uuids': ['38686e96-3efe-42bd-8b36-31fdf21aa54f']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.078311", "end": "2021-03-10 13:41:52.027985", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-OtfTk7txIuQGSpV0jpGDEPl7IlbZAfZJvldqPhqHLnh3FaJcnKD0gd9HklfER9OP"], "labels": [], "masters": [], "uuids": ["38686e96-3efe-42bd-8b36-31fdf21aa54f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:41:51.949674", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0770973 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0770973 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T13:41:51.806 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:51 +0000 (0:00:00.518) 0:01:41.999 ******* 2021-03-10T13:41:51.843 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-ccJYs5cDBUE354eZmSNWke5vulvEzufVaF2eM6NZsyS8nmANXrG8QfeQ1yq9nZ5G'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.078186", "end": "2021-03-10 13:41:51.779038", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-ccJYs5cDBUE354eZmSNWke5vulvEzufVaF2eM6NZsyS8nmANXrG8QfeQ1yq9nZ5G"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:41:51.700852", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0769868 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0769868 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T13:41:51.846 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I8K38OF6XF', 'wwn-0x50000399aba8166e'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I8K38OF6XF-part1', 'wwn-0x50000399aba8166e-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399aba8166e', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I8K38OF6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I8K38OF6XF", "wwn-0x50000399aba8166e"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I8K38OF6XF-part1", "wwn-0x50000399aba8166e-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I8K38OF6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399aba8166e"}}, "skip_reason": "Cond 2021-03-10T13:41:51.847 INFO:teuthology.task.ansible.out:itional result was False"} 2021-03-10T13:41:51.962 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-aMOVYx-cWZj-2ix0-SmbC-Y3PA-1wFb-rczd1p', 'nvme-INTEL_SSDPEL1K375GA_PHKM920000CH375A', 'nvme-nvme.8086-50484b4d393230303030434833373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.025140", "end": "2021-03-10 13:41:51.903003", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-aMOVYx-cWZj-2ix0-SmbC-Y3PA-1wFb-rczd1p", "nvme-INTEL_SSDPEL1K375GA_PHKM920000CH375A", "nvme-nvme.8086-50484b4d393230303030434833373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:41:51.877863", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0239013 s, 4.8 GB/s", "stderr_lines": ["1 2021-03-10T13:41:51.964 INFO:teuthology.task.ansible.out:10+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0239013 s, 4.8 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T13:41:51.973 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:51.975 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:52.132 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-ccJYs5cDBUE354eZmSNWke5vulvEzufVdK7ZY4PqwZeIIavfSii57cVuT478Y4Mb'], 'uuids': ['5857fe3d-9f2b-4580-afe3-0093b7199d93']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.078110", "end": "2021-03-10 13:41:52.069469", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-ccJYs5cDBUE354eZmSNWke5vulvEzufVdK7ZY4PqwZeIIavfSii57cVuT478Y4Mb"], "labels": [], "masters": [], "uuids": ["5857fe3d-9f2b-4580-afe3-0093b7199d93"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:41:51.991359", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0767869 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0767869 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T13:41:52.133 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:52.145 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:52.188 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-03-10T13:41:52.190 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.189572", "end": "2021-03-10 13:41:52.390405", "rc": 0, "start": "2021-03-10 13:41:52.200833", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:41:52.211 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:52 +0000 (0:00:00.405) 0:01:42.405 ******* 2021-03-10T13:41:52.311 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-03-10T13:41:52.311 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-ccJYs5cDBUE354eZmSNWke5vulvEzufVkjz9a6uLpSiqwoDhx5sDMY61d6nPXPop'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.078166", "end": "2021-03-10 13:41:52.248392", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-ccJYs5cDBUE354eZmSNWke5vulvEzufVkjz9a6uLpSiqwoDhx5sDMY61d6nPXPop"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:41:52.170226", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0769296 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0769296 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T13:41:52.313 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:52.396 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-03-10T13:41:52.398 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.084857", "end": "2021-03-10 13:41:52.657548", "rc": 0, "start": "2021-03-10 13:41:52.572691", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:41:52.419 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:52 +0000 (0:00:00.207) 0:01:42.612 ******* 2021-03-10T13:41:52.476 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-03-10T13:41:52.478 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [gibba020.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-ccJYs5cDBUE354eZmSNWke5vulvEzufVZh6w8Y0oplojGgLkWLcIK87FesZflVm5'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.078047", "end": "2021-03-10 13:41:52.420099", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-ccJYs5cDBUE354eZmSNWke5vulvEzufVZh6w8Y0oplojGgLkWLcIK87FesZflVm5"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 13:41:52.342052", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0768383 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0768383 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T13:41:52.532 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:52 +0000 (0:00:00.112) 0:01:42.725 ******* 2021-03-10T13:41:52.672 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:52 +0000 (0:00:00.139) 0:01:42.865 ******* 2021-03-10T13:41:52.680 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:52.710 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:52 +0000 (0:00:00.037) 0:01:42.903 ******* 2021-03-10T13:41:52.736 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-03-10T13:41:52.738 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:52.764 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:52 +0000 (0:00:00.054) 0:01:42.957 ******* 2021-03-10T13:41:52.790 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-03-10T13:41:52.792 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:52.816 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:52 +0000 (0:00:00.051) 0:01:43.009 ******* 2021-03-10T13:41:52.842 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-03-10T13:41:52.843 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:52.864 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:52 +0000 (0:00:00.048) 0:01:43.058 ******* 2021-03-10T13:41:52.954 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-03-10T13:41:52.956 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-10T13:41:52.977 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:52 +0000 (0:00:00.112) 0:01:43.170 ******* 2021-03-10T13:41:52.985 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-03-10T13:41:52.986 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.197777", "end": "2021-03-10 13:41:52.905527", "rc": 0, "start": "2021-03-10 13:41:52.707750", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:41:53.021 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:53 +0000 (0:00:00.043) 0:01:43.214 ******* 2021-03-10T13:41:53.029 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-03-10T13:41:53.029 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'block_used': 13728329, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226366779, 'size_available': 927198326784, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 113650, 'block_size': 4096, 'inode_available': 60941326}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226366779, "block_size": 4096, "block_total": 240095108, "block_used": 13728329, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941326, "inode_total": 61054976, "inode_used": 113650, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 927198326784, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:53.057 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:53 +0000 (0:00:00.036) 0:01:43.251 ******* 2021-03-10T13:41:53.084 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-03-10T13:41:53.086 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:53.108 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:53 +0000 (0:00:00.050) 0:01:43.301 ******* 2021-03-10T13:41:53.135 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T13:41:53.136 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:53.158 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:53 +0000 (0:00:00.049) 0:01:43.351 ******* 2021-03-10T13:41:53.184 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T13:41:53.186 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:53.208 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:53 +0000 (0:00:00.050) 0:01:43.401 ******* 2021-03-10T13:41:53.215 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-03-10T13:41:53.216 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.080339", "end": "2021-03-10 13:41:53.144705", "rc": 0, "start": "2021-03-10 13:41:53.064366", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:41:53.238 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:53 +0000 (0:00:00.030) 0:01:43.432 ******* 2021-03-10T13:41:53.244 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-03-10T13:41:53.245 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:53.270 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:53 +0000 (0:00:00.031) 0:01:43.463 ******* 2021-03-10T13:41:53.276 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-03-10T13:41:53.302 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:53 +0000 (0:00:00.032) 0:01:43.496 ******* 2021-03-10T13:41:53.308 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-03-10T13:41:53.310 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:53.332 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:53 +0000 (0:00:00.029) 0:01:43.525 ******* 2021-03-10T13:41:53.338 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-03-10T13:41:53.339 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:53.365 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:53 +0000 (0:00:00.032) 0:01:43.558 ******* 2021-03-10T13:41:53.370 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-03-10T13:41:53.371 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:53.394 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:53 +0000 (0:00:00.029) 0:01:43.587 ******* 2021-03-10T13:41:53.400 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-03-10T13:41:53.402 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:53.425 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:53 +0000 (0:00:00.030) 0:01:43.618 ******* 2021-03-10T13:41:53.451 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-03-10T13:41:53.453 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:53.477 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:53 +0000 (0:00:00.052) 0:01:43.670 ******* 2021-03-10T13:41:53.503 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-03-10T13:41:53.505 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:53.526 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:53 +0000 (0:00:00.049) 0:01:43.720 ******* 2021-03-10T13:41:53.625 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-03-10T13:41:53.627 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-10T13:41:53.649 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:53 +0000 (0:00:00.122) 0:01:43.842 ******* 2021-03-10T13:41:53.686 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-03-10T13:41:53.687 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'block_used': 13728330, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226366778, 'size_available': 927198322688, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 113650, 'block_size': 4096, 'inode_available': 60941326}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226366778, "block_size": 4096, "block_total": 240095108, "block_used": 13728330, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941326, "inode_total": 61054976, "inode_used": 113650, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 927198322688, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:53.710 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:53 +0000 (0:00:00.060) 0:01:43.903 ******* 2021-03-10T13:41:53.736 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-03-10T13:41:53.738 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:53.758 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:53 +0000 (0:00:00.048) 0:01:43.951 ******* 2021-03-10T13:41:53.784 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T13:41:53.786 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:53.809 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:53 +0000 (0:00:00.051) 0:01:44.003 ******* 2021-03-10T13:41:53.836 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T13:41:53.837 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:53.863 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:53 +0000 (0:00:00.053) 0:01:44.056 ******* 2021-03-10T13:41:53.889 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:53.911 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:53 +0000 (0:00:00.048) 0:01:44.105 ******* 2021-03-10T13:41:53.948 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-03-10T13:41:53.950 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:53.971 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:53 +0000 (0:00:00.059) 0:01:44.164 ******* 2021-03-10T13:41:53.978 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-03-10T13:41:53.979 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-03-10T13:41:54.004 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:53 +0000 (0:00:00.032) 0:01:44.197 ******* 2021-03-10T13:41:54.010 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-03-10T13:41:54.012 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:54.036 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:54 +0000 (0:00:00.031) 0:01:44.229 ******* 2021-03-10T13:41:54.538 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-03-10T13:41:54.540 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-03-10T13:41:54.562 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:54 +0000 (0:00:00.525) 0:01:44.755 ******* 2021-03-10T13:41:54.568 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-03-10T13:41:54.570 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T13:41:54.893 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T13:41:54.966 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T13:41:55.247 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T13:41:55.413 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T13:41:55.590 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T13:41:55.725 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T13:41:55.995 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T13:41:56.023 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:56 +0000 (0:00:01.460) 0:01:46.216 ******* 2021-03-10T13:41:56.112 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T13:41:56.133 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-03-10T13:41:56.135 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-03-10T13:41:56.157 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:56 +0000 (0:00:00.134) 0:01:46.351 ******* 2021-03-10T13:41:56.288 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-03-10T13:41:56.290 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-10T13:41:56.373 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-10T13:41:56.446 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-10T13:41:56.449 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-03-10T13:41:56.450 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T13:41:56.475 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:56 +0000 (0:00:00.317) 0:01:46.669 ******* 2021-03-10T13:41:56.522 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-03-10T13:41:56.524 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-10T13:41:56.534 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:56.560 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:56 +0000 (0:00:00.085) 0:01:46.754 ******* 2021-03-10T13:41:56.587 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-03-10T13:41:56.589 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} TASK [testnode : Create filesystems] ******************************************* skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:56.610 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:56 +0000 (0:00:00.049) 0:01:46.804 ******* 2021-03-10T13:41:56.630 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:56 +0000 (0:00:00.019) 0:01:46.824 ******* 2021-03-10T13:41:56.636 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-03-10T13:41:56.637 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:56.661 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:56 +0000 (0:00:00.030) 0:01:46.854 ******* 2021-03-10T13:41:56.761 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-03-10T13:41:56.763 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T13:41:56.785 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:56 +0000 (0:00:00.124) 0:01:46.978 ******* 2021-03-10T13:41:56.792 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-03-10T13:41:56.793 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-10T13:41:56.814 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-03-10T13:41:56.816 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-03-10T13:41:56.848 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:56 +0000 (0:00:00.062) 0:01:47.041 ******* 2021-03-10T13:41:56.868 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-03-10T13:41:56.870 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-10T13:41:56.933 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-10T13:41:57.017 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-10T13:41:57.019 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:57.054 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:57 +0000 (0:00:00.206) 0:01:47.248 ******* 2021-03-10T13:41:57.081 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-03-10T13:41:57.082 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:57.109 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:57 +0000 (0:00:00.054) 0:01:47.302 ******* 2021-03-10T13:41:57.115 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-03-10T13:41:57.117 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => {"changed": true} 2021-03-10T13:41:57.141 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:57 +0000 (0:00:00.032) 0:01:47.335 ******* 2021-03-10T13:41:57.147 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-03-10T13:41:57.149 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:57.173 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:57 +0000 (0:00:00.031) 0:01:47.366 ******* 2021-03-10T13:41:57.282 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-03-10T13:41:57.284 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T13:41:57.306 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:57 +0000 (0:00:00.133) 0:01:47.499 ******* 2021-03-10T13:41:57.343 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-03-10T13:41:57.344 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-03-10T13:41:57.366 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:57 +0000 (0:00:00.059) 0:01:47.559 ******* 2021-03-10T13:41:57.414 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-03-10T13:41:57.415 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-03-10T13:41:57.441 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:57 +0000 (0:00:00.074) 0:01:47.634 ******* 2021-03-10T13:41:57.467 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-03-10T13:41:57.469 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:57.493 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:57 +0000 (0:00:00.052) 0:01:47.686 ******* 2021-03-10T13:41:57.520 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-03-10T13:41:57.521 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [gibba020.front.sepia.ceph.com] => {"changed": true} 2021-03-10T13:41:57.543 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:57 +0000 (0:00:00.049) 0:01:47.736 ******* 2021-03-10T13:41:57.561 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:57 +0000 (0:00:00.017) 0:01:47.754 ******* 2021-03-10T13:41:57.566 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-03-10T13:41:57.567 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:57.591 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:57 +0000 (0:00:00.030) 0:01:47.784 ******* 2021-03-10T13:41:57.618 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-03-10T13:41:57.620 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:57.641 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:57 +0000 (0:00:00.050) 0:01:47.834 ******* 2021-03-10T13:41:57.720 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-03-10T13:41:57.721 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-03-10T13:41:57.744 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:57 +0000 (0:00:00.102) 0:01:47.937 ******* 2021-03-10T13:41:57.770 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-03-10T13:41:57.772 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add CPAN config directory for the teuthology user.] *********** ok: [gibba013.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-03-10T13:41:57.808 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:57 +0000 (0:00:00.064) 0:01:48.002 ******* 2021-03-10T13:41:57.833 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:57 +0000 (0:00:00.024) 0:01:48.026 ******* 2021-03-10T13:41:57.860 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-03-10T13:41:57.862 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:57.882 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:57 +0000 (0:00:00.049) 0:01:48.076 ******* 2021-03-10T13:41:57.907 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-03-10T13:41:57.909 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:57.929 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:57 +0000 (0:00:00.046) 0:01:48.122 ******* 2021-03-10T13:41:57.934 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-03-10T13:41:57.936 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T13:41:57.957 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:57 +0000 (0:00:00.028) 0:01:48.150 ******* 2021-03-10T13:41:57.962 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-03-10T13:41:57.964 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:57.987 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:57 +0000 (0:00:00.029) 0:01:48.180 ******* 2021-03-10T13:41:58.106 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-03-10T13:41:58.108 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-03-10T13:41:58.129 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:58 +0000 (0:00:00.142) 0:01:48.322 ******* 2021-03-10T13:41:58.247 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-03-10T13:41:58.249 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} TASK [testnode : Upload CPAN config for the teuthology user.] ****************** ok: [gibba013.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-03-10T13:41:58.271 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:58 +0000 (0:00:00.141) 0:01:48.464 ******* 2021-03-10T13:41:58.291 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:58 +0000 (0:00:00.020) 0:01:48.484 ******* 2021-03-10T13:41:58.505 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-03-10T13:41:58.507 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-03-10T13:41:58.529 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:58 +0000 (0:00:00.237) 0:01:48.722 ******* 2021-03-10T13:41:58.545 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-03-10T13:41:58.547 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-03-10T13:41:58.569 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:58 +0000 (0:00:00.039) 0:01:48.762 ******* 2021-03-10T13:41:58.792 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-03-10T13:41:58.793 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-03-10T13:41:58.814 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:58 +0000 (0:00:00.245) 0:01:49.007 ******* 2021-03-10T13:41:58.954 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-03-10T13:41:58.956 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"cache_update_time": 1615383598, "cache_updated": false, "changed": false} 2021-03-10T13:41:58.981 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:58 +0000 (0:00:00.166) 0:01:49.174 ******* 2021-03-10T13:41:59.214 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"cache_update_time": 1615383603, "cache_updated": false, "changed": false} 2021-03-10T13:41:59.237 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:59 +0000 (0:00:00.255) 0:01:49.430 ******* 2021-03-10T13:41:59.242 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-03-10T13:41:59.243 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.123916", "end": "2021-03-10 13:41:59.488394", "rc": 0, "start": "2021-03-10 13:41:59.364478", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-03-10T13:41:59.268 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:59 +0000 (0:00:00.030) 0:01:49.461 ******* 2021-03-10T13:41:59.293 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-03-10T13:41:59.295 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:59.316 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:59 +0000 (0:00:00.048) 0:01:49.510 ******* 2021-03-10T13:41:59.342 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-03-10T13:41:59.343 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:59.364 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:59 +0000 (0:00:00.047) 0:01:49.557 ******* 2021-03-10T13:41:59.524 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-03-10T13:41:59.525 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.158417", "end": "2021-03-10 13:41:59.446652", "rc": 0, "start": "2021-03-10 13:41:59.288235", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-03-10T13:41:59.548 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:59 +0000 (0:00:00.184) 0:01:49.742 ******* 2021-03-10T13:41:59.574 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-03-10T13:41:59.576 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:59.597 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:59 +0000 (0:00:00.048) 0:01:49.790 ******* 2021-03-10T13:41:59.622 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-03-10T13:41:59.623 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:59.645 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:59 +0000 (0:00:00.047) 0:01:49.838 ******* 2021-03-10T13:41:59.763 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-03-10T13:41:59.765 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"cache_update_time": 1615383598, "cache_updated": false, "changed": false} 2021-03-10T13:41:59.787 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:59 +0000 (0:00:00.142) 0:01:49.981 ******* 2021-03-10T13:41:59.813 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-03-10T13:41:59.815 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:41:59.835 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:41:59 +0000 (0:00:00.047) 0:01:50.029 ******* 2021-03-10T13:42:00.048 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-03-10T13:42:00.050 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"cache_update_time": 1615383603, "cache_updated": false, "changed": false} 2021-03-10T13:42:00.076 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:00 +0000 (0:00:00.240) 0:01:50.269 ******* 2021-03-10T13:42:00.082 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-03-10T13:42:00.082 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-03-10T13:42:00.105 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:00 +0000 (0:00:00.029) 0:01:50.298 ******* 2021-03-10T13:42:00.113 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-03-10T13:42:00.114 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:42:00.136 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:00 +0000 (0:00:00.031) 0:01:50.330 ******* 2021-03-10T13:42:00.141 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-03-10T13:42:00.143 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:42:00.166 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:00 +0000 (0:00:00.029) 0:01:50.359 ******* 2021-03-10T13:42:00.319 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-03-10T13:42:00.320 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-03-10 13:39:21 UTC", "ActiveEnterTimestampMonotonic": "12474536", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "system.slice network.target -.mount systemd-journald.socket basic.target sysinit.target systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-03-10 13:39:21 UTC", "AssertTimestampMonotonic": "12255684", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-03-10 13:39:21 UTC", "ConditionTimestampMonotonic": "12255683", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": 2021-03-10T13:42:00.322 INFO:teuthology.task.ansible.out:"/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "982", "ExecMainStartTimestamp": "Wed 2021-03-10 13:39:21 UTC", "ExecMainStartTimestampMonotonic": "12474528", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-03-10 13:39:21 UTC", "InactiveExitTimestampMonotonic": "12256606", "InvocationID": "c32ee99940724375b6584c90f9b901f0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Limi 2021-03-10T13:42:00.323 INFO:teuthology.task.ansible.out:tCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127828", "LimitNPROCSoft": "127828", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127828", "LimitSIGPENDINGSoft": "127828", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "982", "MemoryAccounting": "yes", "MemoryCurrent": "3858432", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "Requir 2021-03-10T13:42:00.325 INFO:teuthology.task.ansible.out:esMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-10 13:39:21 UTC", "StateChangeTimestampMonotonic": "12474536", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38348", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-10T13:42:00.344 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:00 +0000 (0:00:00.178) 0:01:50.537 ******* 2021-03-10T13:42:00.360 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-03-10T13:42:00.362 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} TASK [testnode : set_fact] ***************************************************** ok: [gibba013.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-03-10T13:42:00.385 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:00 +0000 (0:00:00.041) 0:01:50.578 ******* 2021-03-10T13:42:00.405 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:00 +0000 (0:00:00.019) 0:01:50.598 ******* 2021-03-10T13:42:00.422 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T13:42:00.424 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} TASK [testnode : Create the chrony.conf file] ********************************** skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:42:00.445 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:00 +0000 (0:00:00.040) 0:01:50.639 ******* 2021-03-10T13:42:00.465 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:00 +0000 (0:00:00.019) 0:01:50.658 ******* 2021-03-10T13:42:00.471 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-03-10T13:42:00.473 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:42:00.497 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:00 +0000 (0:00:00.031) 0:01:50.690 ******* 2021-03-10T13:42:00.628 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-03-10T13:42:00.629 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-03-10 13:39:20 UTC", "ActiveEnterTimestampMonotonic": "12439258", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket network.target -.mount systemd-tmpfiles-setup.service system.slice basic.target sysinit.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-03-10 13:39:20 UTC", "AssertTimestampMonotonic": "12206783", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-03-10 13:39:20 UTC", "ConditionTimestampMonotonic": "12206781", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": 2021-03-10T13:42:00.630 INFO:teuthology.task.ansible.out:"/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "983", "ExecMainStartTimestamp": "Wed 2021-03-10 13:39:20 UTC", "ExecMainStartTimestampMonotonic": "12439249", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-03-10 13:39:20 UTC", "InactiveExitTimestampMonotonic": "12207485", "InvocationID": "4c21d8544cad43e2a98d9a8745934598", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Limi 2021-03-10T13:42:00.632 INFO:teuthology.task.ansible.out:tCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127828", "LimitNPROCSoft": "127828", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127828", "LimitSIGPENDINGSoft": "127828", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "983", "MemoryAccounting": "yes", "MemoryCurrent": "3817472", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "Requir 2021-03-10T13:42:00.634 INFO:teuthology.task.ansible.out:esMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-10 13:39:20 UTC", "StateChangeTimestampMonotonic": "12439258", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38348", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-10T13:42:00.652 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:00 +0000 (0:00:00.155) 0:01:50.845 ******* 2021-03-10T13:42:00.678 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T13:42:00.680 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-03-10T13:42:00.700 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:00 +0000 (0:00:00.048) 0:01:50.894 ******* 2021-03-10T13:42:00.726 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T13:42:00.727 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-03-10T13:42:00.748 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:00 +0000 (0:00:00.047) 0:01:50.941 ******* 2021-03-10T13:42:00.773 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-03-10T13:42:00.775 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:42:00.796 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:00 +0000 (0:00:00.047) 0:01:50.989 ******* 2021-03-10T13:42:01.298 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-03-10T13:42:01.300 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"cache_update_time": 1615383598, "cache_updated": false, "changed": false} 2021-03-10T13:42:01.322 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:01 +0000 (0:00:00.526) 0:01:51.515 ******* 2021-03-10T13:42:01.348 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-03-10T13:42:01.350 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:42:01.371 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:01 +0000 (0:00:00.048) 0:01:51.564 ******* 2021-03-10T13:42:01.542 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-03-10T13:42:01.544 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-03-10T13:42:01.565 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:01 +0000 (0:00:00.193) 0:01:51.758 ******* 2021-03-10T13:42:01.611 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-03-10T13:42:01.613 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"cache_update_time": 1615383603, "cache_updated": false, "changed": false} 2021-03-10T13:42:01.635 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:01 +0000 (0:00:00.070) 0:01:51.829 ******* 2021-03-10T13:42:01.662 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-03-10T13:42:01.664 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:42:01.684 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:01 +0000 (0:00:00.049) 0:01:51.878 ******* 2021-03-10T13:42:01.805 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-03-10T13:42:01.806 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-03-10T13:42:01.827 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:01 +0000 (0:00:00.142) 0:01:52.020 ******* 2021-03-10T13:42:01.904 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-03-10T13:42:01.906 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-03-10T13:42:01.934 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:01 +0000 (0:00:00.106) 0:01:52.127 ******* 2021-03-10T13:42:02.117 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-03-10T13:42:02.140 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:02 +0000 (0:00:00.206) 0:01:52.334 ******* 2021-03-10T13:42:03.739 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-03-10T13:42:03.740 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-03-10T13:42:03.763 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:03 +0000 (0:00:01.622) 0:01:53.956 ******* 2021-03-10T13:42:03.800 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-03-10T13:42:03.824 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:03 +0000 (0:00:00.061) 0:01:54.018 ******* 2021-03-10T13:42:04.098 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-03-10T13:42:04.100 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"changed": false} 2021-03-10T13:42:04.123 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:04 +0000 (0:00:00.298) 0:01:54.316 ******* 2021-03-10T13:42:04.149 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-03-10T13:42:04.151 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp1s0f0"}, "changed": false} 2021-03-10T13:42:04.171 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:04 +0000 (0:00:00.048) 0:01:54.364 ******* 2021-03-10T13:42:04.187 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-03-10T13:42:04.188 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"changed": false} 2021-03-10T13:42:04.214 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:04 +0000 (0:00:00.042) 0:01:54.407 ******* 2021-03-10T13:42:04.241 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-03-10T13:42:04.242 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp1s0f0"}, "changed": false} 2021-03-10T13:42:04.262 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:04 +0000 (0:00:00.048) 0:01:54.456 ******* 2021-03-10T13:42:04.288 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-03-10T13:42:04.290 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1615383577.363297, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1615383577.3592968, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 158, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1615383577.3592968, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1582242096", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-03-10T13:42:04.314 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:04 +0000 (0:00:00.051) 0:01:54.507 ******* 2021-03-10T13:42:04.392 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1615383577.7757833, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1615383577.771783, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 158, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1615383577.771783, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1582242096", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-03-10T13:42:04.416 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:04 +0000 (0:00:00.102) 0:01:54.609 ******* 2021-03-10T13:42:04.660 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-03-10T13:42:04.662 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-03-10T13:42:04.684 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:04 +0000 (0:00:00.267) 0:01:54.877 ******* 2021-03-10T13:42:04.710 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-03-10T13:42:04.712 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [gibba013.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-03-10T13:42:04.732 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:04 +0000 (0:00:00.048) 0:01:54.925 ******* 2021-03-10T13:42:04.751 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:04 +0000 (0:00:00.018) 0:01:54.944 ******* 2021-03-10T13:42:04.756 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-03-10T13:42:04.757 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:42:04.779 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:04 +0000 (0:00:00.028) 0:01:54.972 ******* 2021-03-10T13:42:04.784 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-03-10T13:42:04.785 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-03-10T13:42:04.808 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:04 +0000 (0:00:00.029) 0:01:55.001 ******* 2021-03-10T13:42:04.833 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-03-10T13:42:04.834 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:42:04.854 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:04 +0000 (0:00:00.046) 0:01:55.048 ******* 2021-03-10T13:42:04.952 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-03-10T13:42:04.954 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-03-10T13:42:04.975 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:04 +0000 (0:00:00.120) 0:01:55.168 ******* 2021-03-10T13:42:04.981 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-03-10T13:42:05.011 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:05 +0000 (0:00:00.035) 0:01:55.204 ******* 2021-03-10T13:42:05.100 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-03-10T13:42:05.101 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-03-10T13:42:05.124 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:05 +0000 (0:00:00.112) 0:01:55.317 ******* 2021-03-10T13:42:05.130 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-03-10T13:42:05.152 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:05 +0000 (0:00:00.028) 0:01:55.346 ******* 2021-03-10T13:42:05.157 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-03-10T13:42:05.159 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:42:05.180 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:05 +0000 (0:00:00.027) 0:01:55.373 ******* 2021-03-10T13:42:05.185 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:42:05.210 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:05 +0000 (0:00:00.029) 0:01:55.403 ******* 2021-03-10T13:42:05.216 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-03-10T13:42:05.217 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-03-10T13:42:05.219 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [gibba013.front.sepia.ceph.com] => (item=enp1s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False"} 2021-03-10T13:42:05.219 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item=enp1s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False"} 2021-03-10T13:42:05.220 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-03-10T13:42:05.254 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:05 +0000 (0:00:00.044) 0:01:55.448 ******* 2021-03-10T13:42:05.260 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-03-10T13:42:05.262 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [gibba020.front.sepia.ceph.com] => (item=enp1s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False"} skipping: [gibba020.front.sepia.ceph.com] => (item=enp1s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False"} 2021-03-10T13:42:05.262 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-03-10T13:42:05.288 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:05 +0000 (0:00:00.033) 0:01:55.481 ******* 2021-03-10T13:42:05.295 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-03-10T13:42:05.296 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba013.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-10T13:42:05.297 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-10T13:42:05.308 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-10T13:42:05.309 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-10T13:42:05.334 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:05 +0000 (0:00:00.046) 0:01:55.528 ******* 2021-03-10T13:42:05.341 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-10T13:42:05.342 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-10T13:42:05.344 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba020.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-10T13:42:05.344 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-10T13:42:05.356 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T13:42:05.358 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:42:05.379 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:05 +0000 (0:00:00.044) 0:01:55.572 ******* 2021-03-10T13:42:05.397 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:05 +0000 (0:00:00.018) 0:01:55.591 ******* 2021-03-10T13:42:05.402 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-03-10T13:42:05.404 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:42:05.425 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:05 +0000 (0:00:00.027) 0:01:55.618 ******* 2021-03-10T13:42:05.430 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T13:42:05.432 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:42:05.454 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:05 +0000 (0:00:00.028) 0:01:55.647 ******* 2021-03-10T13:42:05.459 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-03-10T13:42:05.460 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:42:05.487 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:05 +0000 (0:00:00.032) 0:01:55.680 ******* 2021-03-10T13:42:05.493 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-03-10T13:42:05.495 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:42:05.517 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:05 +0000 (0:00:00.029) 0:01:55.710 ******* 2021-03-10T13:42:05.521 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-03-10T13:42:05.523 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:42:05.544 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:05 +0000 (0:00:00.027) 0:01:55.738 ******* 2021-03-10T13:42:05.549 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-03-10T13:42:05.551 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:42:05.574 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:05 +0000 (0:00:00.029) 0:01:55.768 ******* 2021-03-10T13:42:05.580 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-03-10T13:42:05.581 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:42:05.604 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:05 +0000 (0:00:00.029) 0:01:55.798 ******* 2021-03-10T13:42:05.610 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-03-10T13:42:05.611 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:42:05.632 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:05 +0000 (0:00:00.027) 0:01:55.825 ******* 2021-03-10T13:42:05.637 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-03-10T13:42:05.639 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:42:05.662 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:05 +0000 (0:00:00.029) 0:01:55.855 ******* 2021-03-10T13:42:05.667 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-03-10T13:42:05.669 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:42:05.693 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:05 +0000 (0:00:00.031) 0:01:55.887 ******* 2021-03-10T13:42:05.700 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-03-10T13:42:05.701 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:42:05.724 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:05 +0000 (0:00:00.030) 0:01:55.917 ******* 2021-03-10T13:42:05.730 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-03-10T13:42:05.732 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:42:05.755 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:05 +0000 (0:00:00.030) 0:01:55.948 ******* 2021-03-10T13:42:05.761 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-03-10T13:42:05.762 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:42:05.784 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:05 +0000 (0:00:00.029) 0:01:55.978 ******* 2021-03-10T13:42:05.790 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-03-10T13:42:05.792 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:42:05.817 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:05 +0000 (0:00:00.032) 0:01:56.011 ******* 2021-03-10T13:42:05.844 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-03-10T13:42:05.845 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:42:05.876 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:05 +0000 (0:00:00.058) 0:01:56.070 ******* 2021-03-10T13:42:05.916 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-03-10T13:42:05.918 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.002582", "end": "2021-03-10 13:42:06.173252", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-03-10 13:42:06.170670", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:42:06.011 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.002443", "end": "2021-03-10 13:42:05.946440", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-03-10 13:42:05.943997", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:42:06.022 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.001706", "end": "2021-03-10 13:42:06.274073", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-03-10 13:42:06.272367", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:42:06.116 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.001783", "end": "2021-03-10 13:42:06.048422", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-03-10 13:42:06.046639", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:42:06.117 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.001627", "end": "2021-03-10 13:42:06.370920", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-03-10 13:42:06.369293", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-03-10T13:42:06.211 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.001651", "end": "2021-03-10 13:42:06.145617", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-03-10 13:42:06.143966", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-03-10T13:42:06.233 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.018576", "end": "2021-03-10 13:42:06.494086", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-03-10 13:42:06.475510", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:42:06.269 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:06 +0000 (0:00:00.392) 0:01:56.462 ******* 2021-03-10T13:42:06.296 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-03-10T13:42:06.318 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:06 +0000 (0:00:00.049) 0:01:56.512 ******* 2021-03-10T13:42:06.335 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-03-10T13:42:06.337 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.027984", "end": "2021-03-10 13:42:06.267841", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-03-10 13:42:06.239857", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:42:06.363 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:06 +0000 (0:00:00.044) 0:01:56.556 ******* 2021-03-10T13:42:06.389 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-03-10T13:42:06.412 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:06 +0000 (0:00:00.049) 0:01:56.606 ******* 2021-03-10T13:42:06.439 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-03-10T13:42:06.440 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-03-10T13:42:06.538 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-03-10T13:42:06.603 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-03-10T13:42:06.618 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:06 +0000 (0:00:00.205) 0:01:56.812 ******* 2021-03-10T13:42:06.644 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:06 +0000 (0:00:00.025) 0:01:56.837 ******* 2021-03-10T13:42:07.366 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [gibba020.front.sepia.ceph.com] 2021-03-10T13:42:07.415 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:07 +0000 (0:00:00.771) 0:01:57.608 ******* 2021-03-10T13:42:07.425 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] 2021-03-10T13:42:07.453 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-10T13:42:07.454 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-03-10T13:42:07.474 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:07 +0000 (0:00:00.058) 0:01:57.667 ******* 2021-03-10T13:42:07.493 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:07 +0000 (0:00:00.018) 0:01:57.686 ******* 2021-03-10T13:42:07.510 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-03-10T13:42:07.532 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:07 +0000 (0:00:00.039) 0:01:57.725 ******* 2021-03-10T13:42:07.538 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-10T13:42:07.539 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:42:07.561 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:07 +0000 (0:00:00.028) 0:01:57.754 ******* 2021-03-10T13:42:07.565 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:42:07.589 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:07 +0000 (0:00:00.028) 0:01:57.782 ******* 2021-03-10T13:42:07.594 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-03-10T13:42:07.596 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-03-10T13:42:07.618 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:07 +0000 (0:00:00.029) 0:01:57.812 ******* 2021-03-10T13:42:07.624 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-03-10T13:42:07.658 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:07 +0000 (0:00:00.039) 0:01:57.852 ******* 2021-03-10T13:42:08.076 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-03-10T13:42:08.078 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"cache_update_time": 1615383603, "cache_updated": false, "changed": false} 2021-03-10T13:42:08.099 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:08 +0000 (0:00:00.440) 0:01:58.293 ******* 2021-03-10T13:42:08.115 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"cache_update_time": 1615383598, "cache_updated": false, "changed": false} 2021-03-10T13:42:08.138 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:08 +0000 (0:00:00.038) 0:01:58.331 ******* 2021-03-10T13:42:08.143 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-10T13:42:08.145 INFO:teuthology.task.ansible.out:skipping: [gibba020.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:42:08.166 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:08 +0000 (0:00:00.028) 0:01:58.359 ******* 2021-03-10T13:42:08.171 INFO:teuthology.task.ansible.out:skipping: [gibba013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T13:42:08.195 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:08 +0000 (0:00:00.029) 0:01:58.388 ******* 2021-03-10T13:42:08.200 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-10T13:42:08.202 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-03-10T13:42:08.228 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:08 +0000 (0:00:00.033) 0:01:58.421 ******* 2021-03-10T13:42:08.234 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-03-10T13:42:08.258 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:08 +0000 (0:00:00.029) 0:01:58.452 ******* 2021-03-10T13:42:08.378 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-03-10T13:42:08.380 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T13:42:08.410 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T13:42:08.484 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T13:42:08.511 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:08 +0000 (0:00:00.252) 0:01:58.704 ******* 2021-03-10T13:42:08.517 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T13:42:08.543 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:08 +0000 (0:00:00.032) 0:01:58.736 ******* 2021-03-10T13:42:08.858 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-03-10T13:42:08.859 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615383728.590981-12260-73865434258973/source", "state": "file", "uid": 0} 2021-03-10T13:42:08.890 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615383728.558239-12259-81786700357198/source", "state": "file", "uid": 0} 2021-03-10T13:42:09.127 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615383728.8729992-12260-82421889000779/source", "state": "file", "uid": 0} 2021-03-10T13:42:09.151 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:09 +0000 (0:00:00.607) 0:01:59.344 ******* 2021-03-10T13:42:09.167 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615383728.905511-12259-263967739698877/source", "state": "file", "uid": 0} 2021-03-10T13:42:09.191 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:09 +0000 (0:00:00.040) 0:01:59.384 ******* 2021-03-10T13:42:12.350 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-03-10T13:42:12.352 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-6lh5kmco\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-6lh5kmco"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-6lh5kmco\nCollecting docopt\n Downloading docopt-0.6.2.tar.gz (25 kB)\nCollecting toml\n Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)\nBuilding wheels for collected packages: registries-conf-ctl, docopt\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=6035 sha256=d065a3231928597670b0be86146bf4e86e0104e90e43d853191790fef87d2809\n Stored in directory: /tmp/pip-ephem-wheel-cache-k3ezqz3l/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\n Building wheel for docopt (setup.py): started\n Building wheel for docopt (setup.py): finished with status 'done'\n Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=a8fe95253fa3224256577451dd32b4645dfd7f0394a2937b3c11b3a145dd27a7\n Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c\nSuccessfully built registries-conf-ctl docopt\nInstalling collected packages: docopt, toml, registries-conf-ctl\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github.c 2021-03-10T13:42:12.353 INFO:teuthology.task.ansible.out:om/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-6lh5kmco", "Collecting docopt", " Downloading docopt-0.6.2.tar.gz (25 kB)", "Collecting toml", " Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)", "Building wheels for collected packages: registries-conf-ctl, docopt", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=6035 sha256=d065a3231928597670b0be86146bf4e86e0104e90e43d853191790fef87d2809", " Stored in directory: /tmp/pip-ephem-wheel-cache-k3ezqz3l/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", " Building wheel for docopt (setup.py): started", " Building wheel for docopt (setup.py): finished with status 'done'", " Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=a8fe95253fa3224256577451dd32b4645dfd7f0394a2937b3c11b3a145dd27a7", " Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c", "Successfully built registries-conf-ctl docopt", "Installing collected packages: docopt, toml, registries-conf-ctl", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-03-10T13:42:12.373 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:12 +0000 (0:00:03.181) 0:02:02.566 ******* 2021-03-10T13:42:12.464 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-yzfl6x4z\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-yzfl6x4z"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-yzfl6x4z\nCollecting docopt\n Downloading docopt-0.6.2.tar.gz (25 kB)\nCollecting toml\n Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)\nBuilding wheels for collected packages: registries-conf-ctl, docopt\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=6035 sha256=d065a3231928597670b0be86146bf4e86e0104e90e43d853191790fef87d2809\n Stored in directory: /tmp/pip-ephem-wheel-cache-qrh_e4sw/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\n Building wheel for docopt (setup.py): started\n Building wheel for docopt (setup.py): finished with status 'done'\n Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=7f1227a65262ab39cf7d60c3f8c74c71980860a7c846cb4a6b43c9edd6f6230c\n Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c\nSuccessfully built registries-conf-ctl docopt\nInstalling collected packages: docopt, toml, registries-conf-ctl\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github.c 2021-03-10T13:42:12.466 INFO:teuthology.task.ansible.out:om/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-yzfl6x4z", "Collecting docopt", " Downloading docopt-0.6.2.tar.gz (25 kB)", "Collecting toml", " Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)", "Building wheels for collected packages: registries-conf-ctl, docopt", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=6035 sha256=d065a3231928597670b0be86146bf4e86e0104e90e43d853191790fef87d2809", " Stored in directory: /tmp/pip-ephem-wheel-cache-qrh_e4sw/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", " Building wheel for docopt (setup.py): started", " Building wheel for docopt (setup.py): finished with status 'done'", " Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=7f1227a65262ab39cf7d60c3f8c74c71980860a7c846cb4a6b43c9edd6f6230c", " Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c", "Successfully built registries-conf-ctl docopt", "Installing collected packages: docopt, toml, registries-conf-ctl", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-03-10T13:42:12.489 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:12 +0000 (0:00:00.115) 0:02:02.682 ******* 2021-03-10T13:42:12.506 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-03-10T13:42:12.507 INFO:teuthology.task.ansible.out:ok: [gibba013.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-03-10T13:42:12.534 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:12 +0000 (0:00:00.044) 0:02:02.727 ******* 2021-03-10T13:42:12.613 INFO:teuthology.task.ansible.out:ok: [gibba020.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-03-10T13:42:12.638 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:12 +0000 (0:00:00.103) 0:02:02.831 ******* 2021-03-10T13:42:12.829 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-03-10T13:42:12.831 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615383732.5779562-12364-255771452101742/source", "state": "file", "uid": 0} 2021-03-10T13:42:12.855 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:12 +0000 (0:00:00.217) 0:02:03.048 ******* 2021-03-10T13:42:12.933 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615383732.6806126-12369-18806766363787/source", "state": "file", "uid": 0} 2021-03-10T13:42:12.958 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:12 +0000 (0:00:00.102) 0:02:03.151 ******* 2021-03-10T13:42:13.025 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-03-10T13:42:13.027 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.019099", "end": "2021-03-10 13:42:13.286448", "rc": 0, "start": "2021-03-10 13:42:13.267349", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:42:13.054 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:13 +0000 (0:00:00.096) 0:02:03.247 ******* 2021-03-10T13:42:13.092 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.018675", "end": "2021-03-10 13:42:13.038772", "rc": 0, "start": "2021-03-10 13:42:13.020097", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T13:42:13.117 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 13:42:13 +0000 (0:00:00.063) 0:02:03.310 ******* 2021-03-10T13:42:16.700 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-03-10T13:42:16.702 INFO:teuthology.task.ansible.out:changed: [gibba013.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "systemd-journald.socket firewalld.service docker.socket system.slice basic.target containerd.service network-online.target sysinit.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-fire 2021-03-10T13:42:16.703 INFO:teuthology.task.ansible.out:wall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", " 2021-03-10T13:42:16.705 INFO:teuthology.task.ansible.out:LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127828", "LimitSIGPENDINGSoft": "127828", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", 2021-03-10T13:42:16.706 INFO:teuthology.task.ansible.out:"RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target docker.socket system.slice", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-10 13:39:43 UTC", "StateChangeTimestampMonotonic": "34347660", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "containerd.service network-online.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-10T13:42:16.860 INFO:teuthology.task.ansible.out:changed: [gibba020.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "docker.socket containerd.service firewalld.service sysinit.target network-online.target system.slice basic.target systemd-journald.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-fire 2021-03-10T13:42:16.862 INFO:teuthology.task.ansible.out:wall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", " 2021-03-10T13:42:16.863 INFO:teuthology.task.ansible.out:LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127828", "LimitSIGPENDINGSoft": "127828", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", 2021-03-10T13:42:16.865 INFO:teuthology.task.ansible.out:"RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice docker.socket sysinit.target", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-10 13:39:45 UTC", "StateChangeTimestampMonotonic": "37370240", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "containerd.service network-online.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-10T13:42:16.925 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2021-03-10T13:42:16.926 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2021-03-10T13:42:16.928 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched PLAY RECAP ********************************************************************* gibba013.front.sepia.ceph.com : ok=129 changed=35 unreachable=0 failed=0 skipped=182 rescued=0 ignored=0 gibba020.front.sepia.ceph.com : ok=129 changed=35 unreachable=0 failed=0 skipped=182 rescued=0 ignored=0 Wednesday 10 March 2021 13:42:16 +0000 (0:00:03.810) 0:02:07.121 ******* =============================================================================== 2021-03-10T13:42:16.928 INFO:teuthology.task.ansible.out:users : Update authorized_keys using the keys repo --------------------- 12.29s Create all admin users with sudo access. ------------------------------- 12.11s testnode : Install packages --------------------------------------------- 9.23s testnode : Ensure packages are not present. ----------------------------- 8.48s testnode : Zap all non-root disks --------------------------------------- 7.19s container-host : Restart docker service --------------------------------- 3.81s Remove revoked users ---------------------------------------------------- 3.44s container-host : Install registries-conf-ctl ---------------------------- 3.18s Gathering Facts --------------------------------------------------------- 1.81s testnode : Install packages via pip ------------------------------------- 1.62s testnode : Install apt keys --------------------------------------------- 1.56s testnode : Create logical volume(s) ------------------------------------- 1.46s testnode : Update apt cache. -------------------------------------------- 1.45s 2021-03-10T13:42:16.929 INFO:teuthology.task.ansible.out:Gathering Facts --------------------------------------------------------- 0.77s ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 0.72s ansible-managed : Add authorized keys for the ansible user. ------------- 0.72s Gathering Facts --------------------------------------------------------- 0.67s common : Set the 2021-03-10T13:42:16.930 INFO:teuthology.task.ansible.out:hardware clock ----------------------------------------- 0.63s container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert --- 0.61s ansible-managed : Create the ansible user. ------------------------------ 0.60s 2021-03-10T13:42:17.200 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@gibba013.front.sepia.ceph.com'), Remote(name='ubuntu@gibba020.front.sepia.ceph.com')] 2021-03-10T13:42:17.201 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-10T13:42:17.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba013.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-10T13:42:17.236 DEBUG:teuthology.orchestra.run.gibba013:> true 2021-03-10T13:42:17.313 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-10T13:42:17.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba020.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-10T13:42:17.346 DEBUG:teuthology.orchestra.run.gibba020:> true 2021-03-10T13:42:17.425 INFO:teuthology.run_tasks:Running task clock... 2021-03-10T13:42:17.435 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-03-10T13:42:17.436 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-03-10T13:42:17.437 DEBUG:teuthology.orchestra.run.gibba013:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-03-10T13:42:17.457 INFO:teuthology.orchestra.run.gibba013.stdout:10 Mar 13:42:17 ntpd[8646]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-03-10T13:42:17.457 INFO:teuthology.orchestra.run.gibba013.stdout:10 Mar 13:42:17 ntpd[8646]: Command line: ntpd -gq 2021-03-10T13:42:17.458 INFO:teuthology.orchestra.run.gibba013.stdout:10 Mar 13:42:17 ntpd[8646]: proto: precision = 0.034 usec (-25) 2021-03-10T13:42:17.458 INFO:teuthology.orchestra.run.gibba013.stdout:10 Mar 13:42:17 ntpd[8646]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-03-10T13:42:17.458 INFO:teuthology.orchestra.run.gibba013.stdout:10 Mar 13:42:17 ntpd[8646]: restrict ::: KOD does nothing without LIMITED. 2021-03-10T13:42:17.459 INFO:teuthology.orchestra.run.gibba013.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-03-10T13:42:17.459 INFO:teuthology.orchestra.run.gibba013.stderr:restrict ::: KOD does nothing without LIMITED. 2021-03-10T13:42:17.460 INFO:teuthology.orchestra.run.gibba013.stdout:10 Mar 13:42:17 ntpd[8646]: Listen and drop on 0 v6wildcard [::]:123 2021-03-10T13:42:17.460 INFO:teuthology.orchestra.run.gibba013.stdout:10 Mar 13:42:17 ntpd[8646]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-03-10T13:42:17.460 INFO:teuthology.orchestra.run.gibba013.stdout:10 Mar 13:42:17 ntpd[8646]: Listen normally on 2 lo 127.0.0.1:123 2021-03-10T13:42:17.460 INFO:teuthology.orchestra.run.gibba013.stdout:10 Mar 13:42:17 ntpd[8646]: Listen normally on 3 enp1s0f0 172.21.2.113:123 2021-03-10T13:42:17.460 INFO:teuthology.orchestra.run.gibba013.stdout:10 Mar 13:42:17 ntpd[8646]: Listen normally on 4 lo [::1]:123 2021-03-10T13:42:17.461 INFO:teuthology.orchestra.run.gibba013.stdout:10 Mar 13:42:17 ntpd[8646]: Listen normally on 5 enp1s0f0 [fe80::3eec:efff:fe3d:8ce6%4]:123 2021-03-10T13:42:17.461 INFO:teuthology.orchestra.run.gibba013.stdout:10 Mar 13:42:17 ntpd[8646]: Listening on routing socket on fd #22 for interface updates 2021-03-10T13:42:18.458 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:18 ntpd[8646]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:18.458 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:18 ntpd[8646]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:18.459 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:18 ntpd[8646]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:18.459 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:18 ntpd[8646]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:18.459 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:18 ntpd[8646]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:42:18.460 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:18 ntpd[8646]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:42:19.459 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:19 ntpd[8646]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:19.459 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:19 ntpd[8646]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:19.459 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:19 ntpd[8646]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:19.460 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:19 ntpd[8646]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:19.460 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:19 ntpd[8646]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:19.460 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:19 ntpd[8646]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:19.460 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:19 ntpd[8646]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:42:19.461 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:19 ntpd[8646]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:42:19.461 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:19 ntpd[8646]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:19.461 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:19 ntpd[8646]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:19.461 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:19 ntpd[8646]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:42:19.461 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:19 ntpd[8646]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:42:20.459 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:20 ntpd[8646]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:20.459 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:20 ntpd[8646]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:20.459 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:20 ntpd[8646]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:20.460 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:20 ntpd[8646]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:20.460 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:20 ntpd[8646]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:42:20.460 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:20 ntpd[8646]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:42:21.459 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:21 ntpd[8646]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:21.459 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:21 ntpd[8646]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:21.460 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:21 ntpd[8646]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:21.460 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:21 ntpd[8646]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:21.460 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:21 ntpd[8646]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:21.460 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:21 ntpd[8646]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:21.460 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:21 ntpd[8646]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:42:21.461 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:21 ntpd[8646]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:42:21.461 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:21 ntpd[8646]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:21.461 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:21 ntpd[8646]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:21.461 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:21 ntpd[8646]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:42:21.461 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:21 ntpd[8646]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:42:22.459 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:22 ntpd[8646]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:22.459 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:22 ntpd[8646]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:22.459 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:22 ntpd[8646]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:22.459 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:22 ntpd[8646]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:22.460 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:22 ntpd[8646]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:22.460 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:22 ntpd[8646]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:22.460 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:22 ntpd[8646]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:42:22.460 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:22 ntpd[8646]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:42:22.460 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:22 ntpd[8646]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:22.461 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:22 ntpd[8646]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:22.461 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:22 ntpd[8646]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:42:22.461 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:22 ntpd[8646]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:42:23.458 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:23 ntpd[8646]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:23.459 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:23 ntpd[8646]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:23.459 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:23 ntpd[8646]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:23.459 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:23 ntpd[8646]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:23.460 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:23 ntpd[8646]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:23.460 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:23 ntpd[8646]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:23.460 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:23 ntpd[8646]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:42:23.460 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:23 ntpd[8646]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:42:23.460 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:23 ntpd[8646]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:23.461 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:23 ntpd[8646]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:23.461 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:23 ntpd[8646]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:42:23.461 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:23 ntpd[8646]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:42:24.459 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:24 ntpd[8646]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:24.459 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:24 ntpd[8646]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:24.459 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:24 ntpd[8646]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:24.459 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:24 ntpd[8646]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:24.460 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:24 ntpd[8646]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:24.460 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:24 ntpd[8646]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:24.460 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:24 ntpd[8646]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:42:24.460 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:24 ntpd[8646]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:42:24.461 INFO:teuthology.orchestra.run.gibba013.stdout:10 Mar 13:42:24 ntpd[8646]: ntpd: time set -0.278098 s 2021-03-10T13:42:24.461 INFO:teuthology.orchestra.run.gibba013.stdout:ntpd: time set -0.278098s 2021-03-10T13:42:24.461 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:24 ntpd[8646]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-03-10T13:42:24.462 INFO:teuthology.orchestra.run.gibba013.stderr:10 Mar 13:42:24 ntpd[8646]: can't open /var/log/ntpstats/loopstats.20210310: Permission denied 2021-03-10T13:42:24.554 INFO:teuthology.orchestra.run.gibba013.stdout: remote refid st t when poll reach delay offset jitter 2021-03-10T13:42:24.554 INFO:teuthology.orchestra.run.gibba013.stdout:============================================================================== 2021-03-10T13:42:24.554 INFO:teuthology.orchestra.run.gibba013.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-10T13:42:24.554 INFO:teuthology.orchestra.run.gibba013.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-10T13:42:24.555 INFO:teuthology.orchestra.run.gibba013.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-10T13:42:24.555 INFO:teuthology.orchestra.run.gibba013.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-10T13:42:24.555 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-03-10T13:42:24.556 DEBUG:teuthology.orchestra.run.gibba020:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-03-10T13:42:24.575 INFO:teuthology.orchestra.run.gibba020.stdout:10 Mar 13:42:24 ntpd[8672]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-03-10T13:42:24.576 INFO:teuthology.orchestra.run.gibba020.stdout:10 Mar 13:42:24 ntpd[8672]: Command line: ntpd -gq 2021-03-10T13:42:24.576 INFO:teuthology.orchestra.run.gibba020.stdout:10 Mar 13:42:24 ntpd[8672]: proto: precision = 0.034 usec (-25) 2021-03-10T13:42:24.577 INFO:teuthology.orchestra.run.gibba020.stdout:10 Mar 13:42:24 ntpd[8672]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-03-10T13:42:24.577 INFO:teuthology.orchestra.run.gibba020.stdout:10 Mar 13:42:24 ntpd[8672]: restrict ::: KOD does nothing without LIMITED. 2021-03-10T13:42:24.577 INFO:teuthology.orchestra.run.gibba020.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-03-10T13:42:24.578 INFO:teuthology.orchestra.run.gibba020.stderr:restrict ::: KOD does nothing without LIMITED. 2021-03-10T13:42:24.579 INFO:teuthology.orchestra.run.gibba020.stdout:10 Mar 13:42:24 ntpd[8672]: Listen and drop on 0 v6wildcard [::]:123 2021-03-10T13:42:24.579 INFO:teuthology.orchestra.run.gibba020.stdout:10 Mar 13:42:24 ntpd[8672]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-03-10T13:42:24.579 INFO:teuthology.orchestra.run.gibba020.stdout:10 Mar 13:42:24 ntpd[8672]: Listen normally on 2 lo 127.0.0.1:123 2021-03-10T13:42:24.580 INFO:teuthology.orchestra.run.gibba020.stdout:10 Mar 13:42:24 ntpd[8672]: Listen normally on 3 enp1s0f0 172.21.2.120:123 2021-03-10T13:42:24.580 INFO:teuthology.orchestra.run.gibba020.stdout:10 Mar 13:42:24 ntpd[8672]: Listen normally on 4 lo [::1]:123 2021-03-10T13:42:24.580 INFO:teuthology.orchestra.run.gibba020.stdout:10 Mar 13:42:24 ntpd[8672]: Listen normally on 5 enp1s0f0 [fe80::3eec:efff:fe3d:8cd4%4]:123 2021-03-10T13:42:24.580 INFO:teuthology.orchestra.run.gibba020.stdout:10 Mar 13:42:24 ntpd[8672]: Listening on routing socket on fd #22 for interface updates 2021-03-10T13:42:25.577 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:25 ntpd[8672]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:25.577 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:25 ntpd[8672]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:25.578 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:25 ntpd[8672]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:25.579 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:25 ntpd[8672]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:25.579 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:25 ntpd[8672]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:42:25.579 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:25 ntpd[8672]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:42:26.577 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:26 ntpd[8672]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:26.577 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:26 ntpd[8672]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:26.578 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:26 ntpd[8672]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:26.578 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:26 ntpd[8672]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:26.578 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:26 ntpd[8672]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:42:26.578 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:26 ntpd[8672]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:42:27.577 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:27 ntpd[8672]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:27.577 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:27 ntpd[8672]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:27.577 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:27 ntpd[8672]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:27.578 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:27 ntpd[8672]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:27.578 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:27 ntpd[8672]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:42:27.578 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:27 ntpd[8672]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:42:28.578 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:28 ntpd[8672]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:28.578 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:28 ntpd[8672]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:28.579 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:28 ntpd[8672]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:28.579 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:28 ntpd[8672]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:28.579 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:28 ntpd[8672]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:28.579 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:28 ntpd[8672]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:28.580 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:28 ntpd[8672]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:28.580 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:28 ntpd[8672]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:28.580 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:28 ntpd[8672]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:42:28.580 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:28 ntpd[8672]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:42:28.581 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:28 ntpd[8672]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:28.581 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:28 ntpd[8672]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:28.581 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:28 ntpd[8672]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:42:28.581 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:28 ntpd[8672]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:42:28.581 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:28 ntpd[8672]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:28.582 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:28 ntpd[8672]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:28.582 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:28 ntpd[8672]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:42:28.582 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:28 ntpd[8672]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:42:29.577 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:29 ntpd[8672]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:29.577 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:29 ntpd[8672]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:29.577 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:29 ntpd[8672]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:29.578 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:29 ntpd[8672]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:29.578 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:29 ntpd[8672]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:42:29.578 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:29 ntpd[8672]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:42:30.578 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:30 ntpd[8672]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:30.579 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:30 ntpd[8672]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:30.579 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:30 ntpd[8672]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:30.579 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:30 ntpd[8672]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:30.579 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:30 ntpd[8672]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:30.580 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:30 ntpd[8672]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:30.580 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:30 ntpd[8672]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:30.580 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:30 ntpd[8672]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:30.580 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:30 ntpd[8672]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:42:30.580 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:30 ntpd[8672]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:42:30.581 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:30 ntpd[8672]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:30.581 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:30 ntpd[8672]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:30.581 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:30 ntpd[8672]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:42:30.581 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:30 ntpd[8672]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:42:30.581 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:30 ntpd[8672]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:30.582 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:30 ntpd[8672]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:30.582 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:30 ntpd[8672]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:42:30.582 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:30 ntpd[8672]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:42:31.577 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:31 ntpd[8672]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:31.578 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:31 ntpd[8672]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:31.578 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:31 ntpd[8672]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T13:42:31.578 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:31 ntpd[8672]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T13:42:31.578 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:31 ntpd[8672]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T13:42:31.579 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:31 ntpd[8672]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T13:42:31.579 INFO:teuthology.orchestra.run.gibba020.stdout:10 Mar 13:42:31 ntpd[8672]: ntpd: time set +0.044576 s 2021-03-10T13:42:31.579 INFO:teuthology.orchestra.run.gibba020.stdout:ntpd: time set +0.044576s 2021-03-10T13:42:31.580 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:31 ntpd[8672]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-03-10T13:42:31.580 INFO:teuthology.orchestra.run.gibba020.stderr:10 Mar 13:42:31 ntpd[8672]: can't open /var/log/ntpstats/loopstats.20210310: Permission denied 2021-03-10T13:42:31.610 INFO:teuthology.orchestra.run.gibba020.stdout: remote refid st t when poll reach delay offset jitter 2021-03-10T13:42:31.611 INFO:teuthology.orchestra.run.gibba020.stdout:============================================================================== 2021-03-10T13:42:31.611 INFO:teuthology.orchestra.run.gibba020.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-10T13:42:31.611 INFO:teuthology.orchestra.run.gibba020.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-10T13:42:31.611 INFO:teuthology.orchestra.run.gibba020.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-10T13:42:31.612 INFO:teuthology.orchestra.run.gibba020.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-10T13:42:31.612 INFO:teuthology.run_tasks:Running task cephadm... 2021-03-10T13:42:31.670 INFO:tasks.cephadm:Config: {'allow_ptrace': False, 'cephadm_branch': 'v15.2.0', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'image': 'docker.io/ceph/ceph:v15.2.0', 'conf': {'global': {'mon election default strategy': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug filestore': 20, 'debug journal': 20, 'debug ms': 1, 'debug osd': 25, 'osd shutdown pgref assert': True}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'b26fc080937a021ce826cdc94d1adb52c064381a'} 2021-03-10T13:42:31.670 INFO:tasks.cephadm:Cluster image is docker.io/ceph/ceph:v15.2.0 2021-03-10T13:42:31.671 INFO:tasks.cephadm:Cluster fsid is 7672acc8-81a6-11eb-9080-001a4aab830c 2021-03-10T13:42:31.671 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2021-03-10T13:42:31.672 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.2.113', 'mon.c': '[v2:172.21.2.113:3301,v1:172.21.2.113:6790]', 'mon.b': '172.21.2.120'} 2021-03-10T13:42:31.672 INFO:tasks.cephadm:First mon is mon.a on gibba013 2021-03-10T13:42:31.673 INFO:tasks.cephadm:First mgr is y 2021-03-10T13:42:31.673 INFO:tasks.cephadm:Normalizing hostnames... 2021-03-10T13:42:31.673 DEBUG:teuthology.orchestra.run.gibba013:> sudo hostname $(hostname -s) 2021-03-10T13:42:31.690 DEBUG:teuthology.orchestra.run.gibba020:> sudo hostname $(hostname -s) 2021-03-10T13:42:31.707 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref v15.2.0)... 2021-03-10T13:42:31.708 DEBUG:teuthology.orchestra.run.gibba013:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v15.2.0/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2021-03-10T13:42:31.801 INFO:teuthology.orchestra.run.gibba013.stdout:-rw-rw-r-- 1 ubuntu ubuntu 151122 Mar 10 13:42 /home/ubuntu/cephtest/cephadm 2021-03-10T13:42:31.802 DEBUG:teuthology.orchestra.run.gibba020:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v15.2.0/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2021-03-10T13:42:31.895 INFO:teuthology.orchestra.run.gibba020.stdout:-rw-rw-r-- 1 ubuntu ubuntu 151122 Mar 10 13:42 /home/ubuntu/cephtest/cephadm 2021-03-10T13:42:31.896 DEBUG:teuthology.orchestra.run.gibba013:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2021-03-10T13:42:31.908 DEBUG:teuthology.orchestra.run.gibba020:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2021-03-10T13:42:31.923 DEBUG:teuthology.orchestra.run.gibba013:> sudo mkdir -p /etc/ceph 2021-03-10T13:42:31.945 DEBUG:teuthology.orchestra.run.gibba020:> sudo mkdir -p /etc/ceph 2021-03-10T13:42:31.952 DEBUG:teuthology.orchestra.run.gibba013:> sudo chmod 777 /etc/ceph 2021-03-10T13:42:31.972 DEBUG:teuthology.orchestra.run.gibba020:> sudo chmod 777 /etc/ceph 2021-03-10T13:42:31.981 INFO:tasks.cephadm:Writing seed config... 2021-03-10T13:42:31.982 INFO:tasks.cephadm: override: [global] mon election default strategy = 3 2021-03-10T13:42:31.983 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2021-03-10T13:42:31.983 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2021-03-10T13:42:31.983 INFO:tasks.cephadm: override: [mon] debug mon = 20 2021-03-10T13:42:31.983 INFO:tasks.cephadm: override: [mon] debug ms = 1 2021-03-10T13:42:31.984 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2021-03-10T13:42:31.984 INFO:tasks.cephadm: override: [osd] debug filestore = 20 2021-03-10T13:42:31.984 INFO:tasks.cephadm: override: [osd] debug journal = 20 2021-03-10T13:42:31.985 INFO:tasks.cephadm: override: [osd] debug ms = 1 2021-03-10T13:42:31.985 INFO:tasks.cephadm: override: [osd] debug osd = 25 2021-03-10T13:42:31.985 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2021-03-10T13:42:31.986 DEBUG:teuthology.orchestra.run.gibba013:> set -ex 2021-03-10T13:42:31.986 DEBUG:teuthology.orchestra.run.gibba013:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2021-03-10T13:42:32.023 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 7672acc8-81a6-11eb-9080-001a4aab830c mon election default strategy = 3 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug filestore = 20 debug journal = 20 debug ms = 1 debug osd = 25 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2021-03-10T13:42:32.023 DEBUG:teuthology.orchestra.run.gibba013:mon.a> sudo journalctl -f -n 0 -u ceph-7672acc8-81a6-11eb-9080-001a4aab830c@mon.a.service 2021-03-10T13:42:32.026 DEBUG:teuthology.orchestra.run.gibba013:mgr.y> sudo journalctl -f -n 0 -u ceph-7672acc8-81a6-11eb-9080-001a4aab830c@mgr.y.service 2021-03-10T13:42:32.029 INFO:tasks.cephadm:Bootstrapping... 2021-03-10T13:42:32.029 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 -v bootstrap --fsid 7672acc8-81a6-11eb-9080-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.2.113 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2021-03-10T13:42:32.074 INFO:journalctl@ceph.mgr.y.gibba013.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:42:32.081 INFO:journalctl@ceph.mon.a.gibba013.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:42:32.177 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Could not locate podman: podman not found 2021-03-10T13:42:32.177 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:Verifying podman|docker is present... 2021-03-10T13:42:32.177 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:Verifying lvm2 is present... 2021-03-10T13:42:32.178 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:Verifying time synchronization is in place... 2021-03-10T13:42:32.178 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chrony.service 2021-03-10T13:42:32.180 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for chrony.service: No such file or directory 2021-03-10T13:42:32.180 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: systemctl is-active chrony.service 2021-03-10T13:42:32.182 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:systemctl:stdout inactive 2021-03-10T13:42:32.182 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chronyd.service 2021-03-10T13:42:32.184 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for chronyd.service: No such file or directory 2021-03-10T13:42:32.184 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: systemctl is-active chronyd.service 2021-03-10T13:42:32.186 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:systemctl:stdout inactive 2021-03-10T13:42:32.186 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: systemctl is-enabled systemd-timesyncd.service 2021-03-10T13:42:32.188 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:systemctl:stdout masked 2021-03-10T13:42:32.188 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: systemctl is-active systemd-timesyncd.service 2021-03-10T13:42:32.190 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:systemctl:stdout inactive 2021-03-10T13:42:32.190 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: systemctl is-enabled ntpd.service 2021-03-10T13:42:32.192 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for ntpd.service: No such file or directory 2021-03-10T13:42:32.192 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: systemctl is-active ntpd.service 2021-03-10T13:42:32.194 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:systemctl:stdout inactive 2021-03-10T13:42:32.195 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: systemctl is-enabled ntp.service 2021-03-10T13:42:32.197 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:systemctl:stdout enabled 2021-03-10T13:42:32.197 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: systemctl is-active ntp.service 2021-03-10T13:42:32.199 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:systemctl:stdout active 2021-03-10T13:42:32.199 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:Unit ntp.service is enabled and running 2021-03-10T13:42:32.199 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:Repeating the final host check... 2021-03-10T13:42:32.199 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:podman|docker (/usr/bin/docker) is present 2021-03-10T13:42:32.200 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:systemctl is present 2021-03-10T13:42:32.200 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:lvcreate is present 2021-03-10T13:42:32.200 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chrony.service 2021-03-10T13:42:32.201 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for chrony.service: No such file or directory 2021-03-10T13:42:32.201 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: systemctl is-active chrony.service 2021-03-10T13:42:32.202 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:systemctl:stdout inactive 2021-03-10T13:42:32.203 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chronyd.service 2021-03-10T13:42:32.205 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for chronyd.service: No such file or directory 2021-03-10T13:42:32.205 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: systemctl is-active chronyd.service 2021-03-10T13:42:32.206 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:systemctl:stdout inactive 2021-03-10T13:42:32.207 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: systemctl is-enabled systemd-timesyncd.service 2021-03-10T13:42:32.209 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:systemctl:stdout masked 2021-03-10T13:42:32.209 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: systemctl is-active systemd-timesyncd.service 2021-03-10T13:42:32.210 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:systemctl:stdout inactive 2021-03-10T13:42:32.211 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: systemctl is-enabled ntpd.service 2021-03-10T13:42:32.212 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for ntpd.service: No such file or directory 2021-03-10T13:42:32.213 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: systemctl is-active ntpd.service 2021-03-10T13:42:32.215 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:systemctl:stdout inactive 2021-03-10T13:42:32.215 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: systemctl is-enabled ntp.service 2021-03-10T13:42:32.217 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:systemctl:stdout enabled 2021-03-10T13:42:32.217 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: systemctl is-active ntp.service 2021-03-10T13:42:32.219 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:systemctl:stdout active 2021-03-10T13:42:32.219 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:Unit ntp.service is enabled and running 2021-03-10T13:42:32.220 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:Host looks OK 2021-03-10T13:42:32.220 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:root:Cluster fsid: 7672acc8-81a6-11eb-9080-001a4aab830c 2021-03-10T13:42:32.220 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Acquiring lock 140567652278624 on /run/cephadm/7672acc8-81a6-11eb-9080-001a4aab830c.lock 2021-03-10T13:42:32.220 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Lock 140567652278624 acquired on /run/cephadm/7672acc8-81a6-11eb-9080-001a4aab830c.lock 2021-03-10T13:42:32.220 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:Verifying IP 172.21.2.113 port 3300 ... 2021-03-10T13:42:32.221 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:Verifying IP 172.21.2.113 port 6789 ... 2021-03-10T13:42:32.221 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Base mon IP is 172.21.2.113, final addrv is [v2:172.21.2.113:3300,v1:172.21.2.113:6789] 2021-03-10T13:42:32.221 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: /usr/sbin/ip route ls 2021-03-10T13:42:32.222 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/sbin/ip:stdout default via 172.21.15.254 dev enp1s0f0 2021-03-10T13:42:32.222 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/sbin/ip:stdout default via 172.21.15.254 dev enp1s0f0 proto dhcp src 172.21.2.113 metric 100 2021-03-10T13:42:32.223 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/sbin/ip:stdout 172.17.0.0/16 dev docker0 proto kernel scope link src 172.17.0.1 linkdown 2021-03-10T13:42:32.223 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/sbin/ip:stdout 172.21.0.0/20 dev enp1s0f0 proto kernel scope link src 172.21.2.113 2021-03-10T13:42:32.223 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/sbin/ip:stdout 172.21.15.254 dev enp1s0f0 proto dhcp scope link src 172.21.2.113 metric 100 2021-03-10T13:42:32.223 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:Mon IP 172.21.2.113 is in CIDR network 172.21.0.0/20 2021-03-10T13:42:32.223 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:Pulling latest docker.io/ceph/ceph:v15.2.0 container... 2021-03-10T13:42:32.224 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: /usr/bin/docker pull docker.io/ceph/ceph:v15.2.0 2021-03-10T13:42:33.252 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/docker:stdout v15.2.0: Pulling from ceph/ceph 2021-03-10T13:42:33.276 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 8a29a15cefae: Pulling fs layer 2021-03-10T13:42:33.276 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 120f0bd0d532: Pulling fs layer 2021-03-10T13:42:33.653 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 8a29a15cefae: Download complete 2021-03-10T13:42:34.227 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 120f0bd0d532: Verifying Checksum 2021-03-10T13:42:34.227 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 120f0bd0d532: Download complete 2021-03-10T13:42:35.006 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 8a29a15cefae: Pull complete 2021-03-10T13:42:38.953 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 120f0bd0d532: Pull complete 2021-03-10T13:42:39.012 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/docker:stdout Digest: sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60 2021-03-10T13:42:39.046 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/docker:stdout Status: Downloaded newer image for ceph/ceph:v15.2.0 2021-03-10T13:42:39.048 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/docker:stdout docker.io/ceph/ceph:v15.2.0 2021-03-10T13:42:39.052 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:Extracting ceph user uid/gid from container image... 2021-03-10T13:42:39.053 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba013', '--entrypoint', 'stat', 'docker.io/ceph/ceph:v15.2.0', '-c', '%u %g', '/var/lib/ceph'] 2021-03-10T13:42:39.053 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba013 --entrypoint stat docker.io/ceph/ceph:v15.2.0 -c %u %g /var/lib/ceph 2021-03-10T13:42:47.193 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:stat:stdout 167 167 2021-03-10T13:42:47.728 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:Creating initial keys... 2021-03-10T13:42:47.728 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba013', '--entrypoint', '/usr/bin/ceph-authtool', 'docker.io/ceph/ceph:v15.2.0', '--gen-print-key'] 2021-03-10T13:42:47.729 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba013 --entrypoint /usr/bin/ceph-authtool docker.io/ceph/ceph:v15.2.0 --gen-print-key 2021-03-10T13:42:48.518 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:stdout AQDYzEhgsIjKHhAAPIqkVgenLKmPvsPwa2K5mA== 2021-03-10T13:42:48.925 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba013', '--entrypoint', '/usr/bin/ceph-authtool', 'docker.io/ceph/ceph:v15.2.0', '--gen-print-key'] 2021-03-10T13:42:48.926 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba013 --entrypoint /usr/bin/ceph-authtool docker.io/ceph/ceph:v15.2.0 --gen-print-key 2021-03-10T13:42:49.609 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:stdout AQDZzEhg9vs6JBAAI4TLcNCxZM7b1ktJR+papw== 2021-03-10T13:42:50.070 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba013', '--entrypoint', '/usr/bin/ceph-authtool', 'docker.io/ceph/ceph:v15.2.0', '--gen-print-key'] 2021-03-10T13:42:50.071 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba013 --entrypoint /usr/bin/ceph-authtool docker.io/ceph/ceph:v15.2.0 --gen-print-key 2021-03-10T13:42:50.815 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:stdout AQDazEhgeomDMBAA1a3C7Hiz+rUOps5zfeIYuQ== 2021-03-10T13:42:51.260 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:Creating initial monmap... 2021-03-10T13:42:51.260 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba013', '-v', '/tmp/ceph-tmp0ci_obyp:/tmp/monmap:z', '--entrypoint', '/usr/bin/monmaptool', 'docker.io/ceph/ceph:v15.2.0', '--create', '--clobber', '--fsid', '7672acc8-81a6-11eb-9080-001a4aab830c', '--addv', 'a', '[v2:172.21.2.113:3300,v1:172.21.2.113:6789]', '/tmp/monmap'] 2021-03-10T13:42:51.260 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba013 -v /tmp/ceph-tmp0ci_obyp:/tmp/monmap:z --entrypoint /usr/bin/monmaptool docker.io/ceph/ceph:v15.2.0 --create --clobber --fsid 7672acc8-81a6-11eb-9080-001a4aab830c --addv a [v2:172.21.2.113:3300,v1:172.21.2.113:6789] /tmp/monmap 2021-03-10T13:42:52.042 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/monmaptool:stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2021-03-10T13:42:52.042 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/monmaptool:stdout /usr/bin/monmaptool: set fsid to 7672acc8-81a6-11eb-9080-001a4aab830c 2021-03-10T13:42:52.042 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/monmaptool:stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2021-03-10T13:42:52.481 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:Creating mon... 2021-03-10T13:42:52.482 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba013', '-v', '/var/log/ceph/7672acc8-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/var/lib/ceph/7672acc8-81a6-11eb-9080-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z', '-v', '/tmp/ceph-tmpe0xpmlki:/tmp/keyring:z', '-v', '/tmp/ceph-tmp0ci_obyp:/tmp/monmap:z', '--entrypoint', '/usr/bin/ceph-mon', 'docker.io/ceph/ceph:v15.2.0', '--mkfs', '-i', 'a', '--fsid', '7672acc8-81a6-11eb-9080-001a4aab830c', '-c', '/dev/null', '--monmap', '/tmp/monmap', '--keyring', '/tmp/keyring', '--setuser', 'ceph', '--setgroup', 'ceph', '--default-log-to-file=false', '--default-log-to-stderr=true', '--default-log-stderr-prefix="debug "', '--default-mon-cluster-log-to-file=false', '--default-mon-cluster-log-to-stderr=true'] 2021-03-10T13:42:52.482 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba013 -v /var/log/ceph/7672acc8-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z -v /var/lib/ceph/7672acc8-81a6-11eb-9080-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmpe0xpmlki:/tmp/keyring:z -v /tmp/ceph-tmp0ci_obyp:/tmp/monmap:z --entrypoint /usr/bin/ceph-mon docker.io/ceph/ceph:v15.2.0 --mkfs -i a --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -c /dev/null --monmap /tmp/monmap --keyring /tmp/keyring --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix="debug " --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true 2021-03-10T13:42:53.235 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 0 set uid:gid to 167:167 (ceph:ceph) 2021-03-10T13:42:53.235 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 1 imported monmap: 2021-03-10T13:42:53.236 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr epoch 0 2021-03-10T13:42:53.236 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr fsid 7672acc8-81a6-11eb-9080-001a4aab830c 2021-03-10T13:42:53.236 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr last_changed 2021-03-10T13:42:52.040457+0000 2021-03-10T13:42:53.236 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr created 2021-03-10T13:42:52.040457+0000 2021-03-10T13:42:53.237 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr min_mon_release 0 (unknown) 2021-03-10T13:42:53.237 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 0: [v2:172.21.2.113:3300/0,v1:172.21.2.113:6789/0] mon.a 2021-03-10T13:42:53.237 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:42:53.237 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 0 /usr/bin/ceph-mon: set fsid to 7672acc8-81a6-11eb-9080-001a4aab830c 2021-03-10T13:42:53.237 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 0 set rocksdb option compression = kNoCompression 2021-03-10T13:42:53.238 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2021-03-10T13:42:53.238 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 0 set rocksdb option write_buffer_size = 33554432 2021-03-10T13:42:53.238 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 0 set rocksdb option compression = kNoCompression 2021-03-10T13:42:53.238 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2021-03-10T13:42:53.239 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 0 set rocksdb option write_buffer_size = 33554432 2021-03-10T13:42:53.239 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: RocksDB version: 6.1.2 2021-03-10T13:42:53.239 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:42:53.239 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-03-10T13:42:53.239 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Compile date Mar 23 2020 2021-03-10T13:42:53.240 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: DB SUMMARY 2021-03-10T13:42:53.240 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:42:53.240 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 0, files: 2021-03-10T13:42:53.240 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:42:53.240 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 2021-03-10T13:42:53.241 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:42:53.241 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.error_if_exists: 0 2021-03-10T13:42:53.241 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.create_if_missing: 1 2021-03-10T13:42:53.241 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.paranoid_checks: 1 2021-03-10T13:42:53.241 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.env: 0x559e7e3971a0 2021-03-10T13:42:53.242 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.info_log: 0x559e80349a80 2021-03-10T13:42:53.242 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.max_file_opening_threads: 16 2021-03-10T13:42:53.242 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.statistics: (nil) 2021-03-10T13:42:53.242 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.use_fsync: 0 2021-03-10T13:42:53.242 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.max_log_file_size: 0 2021-03-10T13:42:53.243 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-03-10T13:42:53.243 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.log_file_time_to_roll: 0 2021-03-10T13:42:53.243 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.keep_log_file_num: 1000 2021-03-10T13:42:53.243 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.recycle_log_file_num: 0 2021-03-10T13:42:53.243 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.allow_fallocate: 1 2021-03-10T13:42:53.244 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.allow_mmap_reads: 0 2021-03-10T13:42:53.244 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.allow_mmap_writes: 0 2021-03-10T13:42:53.244 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.use_direct_reads: 0 2021-03-10T13:42:53.244 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-03-10T13:42:53.245 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.create_missing_column_families: 0 2021-03-10T13:42:53.245 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.db_log_dir: 2021-03-10T13:42:53.245 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2021-03-10T13:42:53.245 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.table_cache_numshardbits: 6 2021-03-10T13:42:53.245 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.max_subcompactions: 1 2021-03-10T13:42:53.246 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.max_background_flushes: -1 2021-03-10T13:42:53.246 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-03-10T13:42:53.246 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-03-10T13:42:53.246 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-03-10T13:42:53.246 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-03-10T13:42:53.247 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.advise_random_on_open: 1 2021-03-10T13:42:53.247 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.db_write_buffer_size: 0 2021-03-10T13:42:53.247 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.write_buffer_manager: 0x559e80eea120 2021-03-10T13:42:53.247 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-03-10T13:42:53.247 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-03-10T13:42:53.248 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-03-10T13:42:53.248 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.use_adaptive_mutex: 0 2021-03-10T13:42:53.248 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.rate_limiter: (nil) 2021-03-10T13:42:53.248 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-03-10T13:42:53.248 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.wal_recovery_mode: 2 2021-03-10T13:42:53.249 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.enable_thread_tracking: 0 2021-03-10T13:42:53.249 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.enable_pipelined_write: 0 2021-03-10T13:42:53.249 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-03-10T13:42:53.249 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-03-10T13:42:53.249 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-03-10T13:42:53.250 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-03-10T13:42:53.250 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.row_cache: None 2021-03-10T13:42:53.250 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.wal_filter: None 2021-03-10T13:42:53.250 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-03-10T13:42:53.251 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.allow_ingest_behind: 0 2021-03-10T13:42:53.251 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.preserve_deletes: 0 2021-03-10T13:42:53.251 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.two_write_queues: 0 2021-03-10T13:42:53.251 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.manual_wal_flush: 0 2021-03-10T13:42:53.251 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.atomic_flush: 0 2021-03-10T13:42:53.252 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-03-10T13:42:53.252 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.max_background_jobs: 2 2021-03-10T13:42:53.252 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.max_background_compactions: -1 2021-03-10T13:42:53.252 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-03-10T13:42:53.252 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-03-10T13:42:53.253 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.delayed_write_rate : 16777216 2021-03-10T13:42:53.253 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.max_total_wal_size: 0 2021-03-10T13:42:53.253 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-03-10T13:42:53.253 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.stats_dump_period_sec: 600 2021-03-10T13:42:53.253 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.stats_persist_period_sec: 600 2021-03-10T13:42:53.254 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-03-10T13:42:53.254 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.max_open_files: -1 2021-03-10T13:42:53.254 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.bytes_per_sync: 0 2021-03-10T13:42:53.254 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-03-10T13:42:53.254 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Options.compaction_readahead_size: 0 2021-03-10T13:42:53.255 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Compression algorithms supported: 2021-03-10T13:42:53.255 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-03-10T13:42:53.255 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: kZSTD supported: 0 2021-03-10T13:42:53.255 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: kXpressCompression supported: 0 2021-03-10T13:42:53.255 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: kLZ4HCCompression supported: 1 2021-03-10T13:42:53.256 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: kLZ4Compression supported: 1 2021-03-10T13:42:53.256 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: kBZip2Compression supported: 0 2021-03-10T13:42:53.256 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: kZlibCompression supported: 1 2021-03-10T13:42:53.256 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: kSnappyCompression supported: 1 2021-03-10T13:42:53.256 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-03-10T13:42:53.257 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.205+0000 7f50e1b986c0 4 rocksdb: [db/db_impl_open.cc:228] Creating manifest 1 2021-03-10T13:42:53.257 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:42:53.257 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 2021-03-10T13:42:53.257 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:42:53.258 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]: 2021-03-10T13:42:53.258 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:42:53.258 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-03-10T13:42:53.258 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.merge_operator: 2021-03-10T13:42:53.258 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.compaction_filter: None 2021-03-10T13:42:53.259 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.compaction_filter_factory: None 2021-03-10T13:42:53.259 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-03-10T13:42:53.259 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.table_factory: BlockBasedTable 2021-03-10T13:42:53.259 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x559e80272130) 2021-03-10T13:42:53.259 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr cache_index_and_filter_blocks: 1 2021-03-10T13:42:53.260 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr cache_index_and_filter_blocks_with_high_priority: 1 2021-03-10T13:42:53.260 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr pin_l0_filter_and_index_blocks_in_cache: 0 2021-03-10T13:42:53.260 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr pin_top_level_index_and_filter: 1 2021-03-10T13:42:53.260 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr index_type: 0 2021-03-10T13:42:53.260 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr data_block_index_type: 0 2021-03-10T13:42:53.261 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr data_block_hash_table_util_ratio: 0.750000 2021-03-10T13:42:53.261 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr hash_index_allow_collision: 1 2021-03-10T13:42:53.261 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr checksum: 1 2021-03-10T13:42:53.261 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr no_block_cache: 0 2021-03-10T13:42:53.261 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache: 0x559e802a8510 2021-03-10T13:42:53.262 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache_name: BinnedLRUCache 2021-03-10T13:42:53.262 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache_options: 2021-03-10T13:42:53.262 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr capacity : 536870912 2021-03-10T13:42:53.262 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr num_shard_bits : 4 2021-03-10T13:42:53.262 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr strict_capacity_limit : 0 2021-03-10T13:42:53.263 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr high_pri_pool_ratio: 0.000 2021-03-10T13:42:53.263 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache_compressed: (nil) 2021-03-10T13:42:53.263 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr persistent_cache: (nil) 2021-03-10T13:42:53.263 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_size: 4096 2021-03-10T13:42:53.263 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_size_deviation: 10 2021-03-10T13:42:53.264 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_restart_interval: 16 2021-03-10T13:42:53.264 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr index_block_restart_interval: 1 2021-03-10T13:42:53.264 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr metadata_block_size: 4096 2021-03-10T13:42:53.264 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr partition_filters: 0 2021-03-10T13:42:53.265 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr use_delta_encoding: 1 2021-03-10T13:42:53.265 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr filter_policy: rocksdb.BuiltinBloomFilter 2021-03-10T13:42:53.265 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr whole_key_filtering: 1 2021-03-10T13:42:53.265 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr verify_compression: 0 2021-03-10T13:42:53.265 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr read_amp_bytes_per_bit: 0 2021-03-10T13:42:53.266 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr format_version: 2 2021-03-10T13:42:53.266 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr enable_index_compression: 1 2021-03-10T13:42:53.266 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_align: 0 2021-03-10T13:42:53.266 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:42:53.266 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.write_buffer_size: 33554432 2021-03-10T13:42:53.267 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.max_write_buffer_number: 2 2021-03-10T13:42:53.267 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.compression: NoCompression 2021-03-10T13:42:53.267 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.bottommost_compression: Disabled 2021-03-10T13:42:53.267 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.prefix_extractor: nullptr 2021-03-10T13:42:53.267 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-03-10T13:42:53.268 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.num_levels: 7 2021-03-10T13:42:53.268 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-03-10T13:42:53.268 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-03-10T13:42:53.268 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-03-10T13:42:53.269 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-03-10T13:42:53.269 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-03-10T13:42:53.269 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-03-10T13:42:53.269 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-03-10T13:42:53.269 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-03-10T13:42:53.269 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.compression_opts.window_bits: -14 2021-03-10T13:42:53.270 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.compression_opts.level: 32767 2021-03-10T13:42:53.270 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.compression_opts.strategy: 0 2021-03-10T13:42:53.270 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-03-10T13:42:53.270 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-03-10T13:42:53.271 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.compression_opts.enabled: false 2021-03-10T13:42:53.271 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-03-10T13:42:53.271 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-03-10T13:42:53.271 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-03-10T13:42:53.271 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.target_file_size_base: 67108864 2021-03-10T13:42:53.272 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.target_file_size_multiplier: 1 2021-03-10T13:42:53.272 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-03-10T13:42:53.272 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-03-10T13:42:53.272 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-03-10T13:42:53.272 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-03-10T13:42:53.273 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-03-10T13:42:53.273 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-03-10T13:42:53.273 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-03-10T13:42:53.273 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-03-10T13:42:53.274 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-03-10T13:42:53.274 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-03-10T13:42:53.274 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-03-10T13:42:53.274 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-03-10T13:42:53.274 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.arena_block_size: 4194304 2021-03-10T13:42:53.275 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-03-10T13:42:53.275 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-03-10T13:42:53.275 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-03-10T13:42:53.275 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.disable_auto_compactions: 0 2021-03-10T13:42:53.275 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-03-10T13:42:53.276 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-03-10T13:42:53.276 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-03-10T13:42:53.276 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-03-10T13:42:53.276 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-03-10T13:42:53.276 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-03-10T13:42:53.277 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-03-10T13:42:53.277 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-03-10T13:42:53.277 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-03-10T13:42:53.277 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-03-10T13:42:53.277 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.table_properties_collectors: 2021-03-10T13:42:53.278 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.inplace_update_support: 0 2021-03-10T13:42:53.278 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-03-10T13:42:53.278 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-03-10T13:42:53.278 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-03-10T13:42:53.278 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.memtable_huge_page_size: 0 2021-03-10T13:42:53.279 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.bloom_locality: 0 2021-03-10T13:42:53.279 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.max_successive_merges: 0 2021-03-10T13:42:53.279 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-03-10T13:42:53.279 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.paranoid_file_checks: 0 2021-03-10T13:42:53.280 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.force_consistency_checks: 0 2021-03-10T13:42:53.280 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.report_bg_io_stats: 0 2021-03-10T13:42:53.280 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: Options.ttl: 0 2021-03-10T13:42:53.280 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-03-10T13:42:53.280 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:42:53.281 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 0 2021-03-10T13:42:53.281 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:42:53.281 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50e1b986c0 4 rocksdb: DB pointer 0x559e80344400 2021-03-10T13:42:53.281 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50cad59700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS ------- 2021-03-10T13:42:53.281 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.209+0000 7f50cad59700 4 rocksdb: [db/db_impl.cc:778] 2021-03-10T13:42:53.282 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** DB Stats ** 2021-03-10T13:42:53.282 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:42:53.282 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-03-10T13:42:53.282 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-03-10T13:42:53.282 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T13:42:53.283 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-03-10T13:42:53.283 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-03-10T13:42:53.283 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T13:42:53.283 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:42:53.283 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2021-03-10T13:42:53.284 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:42:53.284 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:42:53.284 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:42:53.284 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:42:53.284 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:42:53.285 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2021-03-10T13:42:53.285 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:42:53.285 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:42:53.285 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:42:53.285 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Flush(GB): cumulative 0.000, interval 0.000 2021-03-10T13:42:53.286 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T13:42:53.286 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Total Files): cumulative 0, interval 0 2021-03-10T13:42:53.286 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T13:42:53.286 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Keys): cumulative 0, interval 0 2021-03-10T13:42:53.286 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:42:53.287 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:42:53.287 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T13:42:53.287 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:42:53.287 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** File Read Latency Histogram By Level [default] ** 2021-03-10T13:42:53.287 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:42:53.288 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2021-03-10T13:42:53.288 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:42:53.288 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:42:53.288 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:42:53.288 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:42:53.289 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:42:53.289 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2021-03-10T13:42:53.289 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:42:53.289 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:42:53.290 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:42:53.290 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Flush(GB): cumulative 0.000, interval 0.000 2021-03-10T13:42:53.290 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T13:42:53.290 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Total Files): cumulative 0, interval 0 2021-03-10T13:42:53.290 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T13:42:53.291 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Keys): cumulative 0, interval 0 2021-03-10T13:42:53.291 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:42:53.291 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:42:53.291 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T13:42:53.291 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:42:53.292 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** File Read Latency Histogram By Level [default] ** 2021-03-10T13:42:53.292 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T13:42:53.292 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.213+0000 7f50e1b986c0 4 rocksdb: [db/db_impl.cc:390] Shutdown: canceling all background work 2021-03-10T13:42:53.292 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.213+0000 7f50e1b986c0 4 rocksdb: [db/db_impl.cc:563] Shutdown complete 2021-03-10T13:42:53.292 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T13:42:53.213+0000 7f50e1b986c0 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-a for mon.a 2021-03-10T13:42:53.698 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: install -d -m0770 -o 167 -g 167 /var/run/ceph/7672acc8-81a6-11eb-9080-001a4aab830c 2021-03-10T13:42:53.700 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: systemctl disable ceph.target 2021-03-10T13:42:53.802 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: systemctl enable ceph.target 2021-03-10T13:42:53.804 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /etc/systemd/system/ceph.target. 2021-03-10T13:42:53.902 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: systemctl start ceph.target 2021-03-10T13:42:53.904 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: systemctl enable ceph-7672acc8-81a6-11eb-9080-001a4aab830c.target 2021-03-10T13:42:53.906 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-7672acc8-81a6-11eb-9080-001a4aab830c.target -> /etc/systemd/system/ceph-7672acc8-81a6-11eb-9080-001a4aab830c.target. 2021-03-10T13:42:53.907 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-7672acc8-81a6-11eb-9080-001a4aab830c.target -> /etc/systemd/system/ceph-7672acc8-81a6-11eb-9080-001a4aab830c.target. 2021-03-10T13:42:54.006 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: systemctl start ceph-7672acc8-81a6-11eb-9080-001a4aab830c.target 2021-03-10T13:42:54.009 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: systemctl daemon-reload 2021-03-10T13:42:54.111 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: systemctl stop ceph-7672acc8-81a6-11eb-9080-001a4aab830c@mon.a 2021-03-10T13:42:54.117 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: systemctl reset-failed ceph-7672acc8-81a6-11eb-9080-001a4aab830c@mon.a 2021-03-10T13:42:54.119 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:systemctl:stderr Failed to reset failed state of unit ceph-7672acc8-81a6-11eb-9080-001a4aab830c@mon.a.service: Unit ceph-7672acc8-81a6-11eb-9080-001a4aab830c@mon.a.service not loaded. 2021-03-10T13:42:54.120 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: systemctl enable ceph-7672acc8-81a6-11eb-9080-001a4aab830c@mon.a 2021-03-10T13:42:54.121 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/ceph-7672acc8-81a6-11eb-9080-001a4aab830c.target.wants/ceph-7672acc8-81a6-11eb-9080-001a4aab830c@mon.a.service -> /etc/systemd/system/ceph-7672acc8-81a6-11eb-9080-001a4aab830c@.service. 2021-03-10T13:42:54.218 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: systemctl start ceph-7672acc8-81a6-11eb-9080-001a4aab830c@mon.a 2021-03-10T13:42:54.244 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:firewalld does not appear to be present 2021-03-10T13:42:54.245 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:Waiting for mon to start... 2021-03-10T13:42:54.245 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:Waiting for mon... 2021-03-10T13:42:54.245 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba013 -v /var/lib/ceph/7672acc8-81a6-11eb-9080-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmp53lxa2bo:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp7c38gcj7:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status 2021-03-10T13:42:54.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:42:54 gibba013 docker[9345]: Error: No such container: ceph-7672acc8-81a6-11eb-9080-001a4aab830c-mon.a 2021-03-10T13:42:54.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:42:54 gibba013 systemd[1]: Started Ceph mon.a for 7672acc8-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:42:55.373 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout cluster: 2021-03-10T13:42:55.373 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout id: 7672acc8-81a6-11eb-9080-001a4aab830c 2021-03-10T13:42:55.374 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout health: HEALTH_OK 2021-03-10T13:42:55.374 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T13:42:55.374 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout services: 2021-03-10T13:42:55.374 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon: 1 daemons, quorum a (age 0.127841s) 2021-03-10T13:42:55.375 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mgr: no daemons active 2021-03-10T13:42:55.375 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd: 0 osds: 0 up, 0 in 2021-03-10T13:42:55.375 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T13:42:55.375 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout data: 2021-03-10T13:42:55.376 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout pools: 0 pools, 0 pgs 2021-03-10T13:42:55.376 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout objects: 0 objects, 0 B 2021-03-10T13:42:55.376 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout usage: 0 B used, 0 B / 0 B avail 2021-03-10T13:42:55.376 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout pgs: 2021-03-10T13:42:55.377 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T13:42:55.446 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:42:55 gibba013 bash[9363]: cluster 2021-03-10T13:42:55.242987+0000 mon.a (mon.0) 0 : [INF] mkfs 7672acc8-81a6-11eb-9080-001a4aab830c 2021-03-10T13:42:55.447 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:42:55 gibba013 bash[9363]: cluster 2021-03-10T13:42:55.239361+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2021-03-10T13:42:55.898 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:Assimilating anything we can from ceph.conf... 2021-03-10T13:42:55.898 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba013', '-v', '/var/log/ceph/7672acc8-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp53lxa2bo:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmp7c38gcj7:/etc/ceph/ceph.conf:z', '-v', '/var/lib/ceph/7672acc8-81a6-11eb-9080-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'config', 'assimilate-conf', '-i', '/var/lib/ceph/mon/ceph-a/config'] 2021-03-10T13:42:55.899 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba013 -v /var/log/ceph/7672acc8-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp53lxa2bo:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp7c38gcj7:/etc/ceph/ceph.conf:z -v /var/lib/ceph/7672acc8-81a6-11eb-9080-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 config assimilate-conf -i /var/lib/ceph/mon/ceph-a/config 2021-03-10T13:42:56.550 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:42:56 gibba013 bash[9363]: cluster 2021-03-10T13:42:55.242225+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2021-03-10T13:42:56.550 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:42:56 gibba013 bash[9363]: cluster 2021-03-10T13:42:55.242548+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.2.113:3300/0,v1:172.21.2.113:6789/0]} 2021-03-10T13:42:56.550 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:42:56 gibba013 bash[9363]: cluster 2021-03-10T13:42:55.244173+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2021-03-10T13:42:56.551 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:42:56 gibba013 bash[9363]: cluster 2021-03-10T13:42:55.246096+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2021-03-10T13:42:56.551 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:42:56 gibba013 bash[9363]: cluster 2021-03-10T13:42:55.246566+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e1: no daemons active 2021-03-10T13:42:56.551 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:42:56 gibba013 bash[9363]: audit 2021-03-10T13:42:55.370044+0000 mon.a (mon.0) 7 : audit [DBG] from='client.? 172.21.2.113:0/530874759' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2021-03-10T13:42:56.774 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T13:42:56.774 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout [global] 2021-03-10T13:42:56.774 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout fsid = 7672acc8-81a6-11eb-9080-001a4aab830c 2021-03-10T13:42:56.775 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_election_default_strategy = 3 2021-03-10T13:42:56.775 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_host = [v2:172.21.2.113:3300,v1:172.21.2.113:6789] 2021-03-10T13:42:56.775 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_osd_allow_pg_remap = true 2021-03-10T13:42:56.775 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_osd_allow_primary_affinity = true 2021-03-10T13:42:56.775 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_warn_on_no_sortbitwise = false 2021-03-10T13:42:56.776 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd_crush_chooseleaf_type = 0 2021-03-10T13:42:56.776 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T13:42:56.776 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout [mgr] 2021-03-10T13:42:56.776 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mgr/telemetry/nag = false 2021-03-10T13:42:56.776 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T13:42:56.776 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout [osd] 2021-03-10T13:42:56.777 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd_map_max_advance = 10 2021-03-10T13:42:56.777 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd_sloppy_crc = true 2021-03-10T13:42:57.268 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:Generating new minimal ceph.conf... 2021-03-10T13:42:57.268 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba013', '-v', '/var/log/ceph/7672acc8-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp53lxa2bo:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmp7c38gcj7:/etc/ceph/ceph.conf:z', '-v', '/var/lib/ceph/7672acc8-81a6-11eb-9080-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'config', 'generate-minimal-conf', '-o', '/var/lib/ceph/mon/ceph-a/config'] 2021-03-10T13:42:57.269 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba013 -v /var/log/ceph/7672acc8-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp53lxa2bo:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp7c38gcj7:/etc/ceph/ceph.conf:z -v /var/lib/ceph/7672acc8-81a6-11eb-9080-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 config generate-minimal-conf -o /var/lib/ceph/mon/ceph-a/config 2021-03-10T13:42:57.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:42:57 gibba013 bash[9363]: audit 2021-03-10T13:42:56.768820+0000 mon.a (mon.0) 8 : audit [INF] from='client.? 172.21.2.113:0/3693292489' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2021-03-10T13:42:57.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:42:57 gibba013 bash[9363]: audit 2021-03-10T13:42:56.770958+0000 mon.a (mon.0) 9 : audit [INF] from='client.? 172.21.2.113:0/3693292489' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2021-03-10T13:42:58.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:42:58 gibba013 bash[9363]: audit 2021-03-10T13:42:58.149167+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.2.113:0/3407522115' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:42:58.667 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:Restarting the monitor... 2021-03-10T13:42:58.667 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: systemctl restart ceph-7672acc8-81a6-11eb-9080-001a4aab830c@mon.a 2021-03-10T13:42:59.035 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:42:58 gibba013 systemd[1]: Stopping Ceph mon.a for 7672acc8-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:42:59.035 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:42:58 gibba013 bash[9363]: debug 2021-03-10T13:42:58.741+0000 7f5ba757a700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T13:42:59.036 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:42:58 gibba013 bash[9363]: debug 2021-03-10T13:42:58.741+0000 7f5ba757a700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2021-03-10T13:42:59.347 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:Setting mon public_network... 2021-03-10T13:42:59.347 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba013', '-v', '/var/log/ceph/7672acc8-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp53lxa2bo:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmp7c38gcj7:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'config', 'set', 'mon', 'public_network', '172.21.0.0/20'] 2021-03-10T13:42:59.347 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba013 -v /var/log/ceph/7672acc8-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp53lxa2bo:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp7c38gcj7:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 config set mon public_network 172.21.0.0/20 2021-03-10T13:42:59.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:42:59 gibba013 docker[9711]: ceph-7672acc8-81a6-11eb-9080-001a4aab830c-mon.a 2021-03-10T13:42:59.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:42:59 gibba013 systemd[1]: ceph-7672acc8-81a6-11eb-9080-001a4aab830c@mon.a.service: Succeeded. 2021-03-10T13:42:59.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:42:59 gibba013 systemd[1]: Stopped Ceph mon.a for 7672acc8-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:42:59.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:42:59 gibba013 systemd[1]: Starting Ceph mon.a for 7672acc8-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:42:59.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:42:59 gibba013 docker[9747]: Error: No such container: ceph-7672acc8-81a6-11eb-9080-001a4aab830c-mon.a 2021-03-10T13:42:59.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:42:59 gibba013 systemd[1]: Started Ceph mon.a for 7672acc8-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:43:00.531 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.333+0000 7f78d4f576c0 0 set uid:gid to 167:167 (ceph:ceph) 2021-03-10T13:43:00.532 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.333+0000 7f78d4f576c0 0 ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc), process ceph-mon, pid 1 2021-03-10T13:43:00.532 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.333+0000 7f78d4f576c0 0 pidfile_write: ignore empty --pid-file 2021-03-10T13:43:00.532 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 0 load: jerasure load: lrc load: isa 2021-03-10T13:43:00.533 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 0 set rocksdb option compression = kNoCompression 2021-03-10T13:43:00.533 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2021-03-10T13:43:00.533 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 0 set rocksdb option write_buffer_size = 33554432 2021-03-10T13:43:00.533 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 0 set rocksdb option compression = kNoCompression 2021-03-10T13:43:00.533 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2021-03-10T13:43:00.534 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 0 set rocksdb option write_buffer_size = 33554432 2021-03-10T13:43:00.534 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 1 rocksdb: do_open column families: [default] 2021-03-10T13:43:00.534 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: RocksDB version: 6.1.2 2021-03-10T13:43:00.534 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-03-10T13:43:00.534 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Compile date Mar 23 2020 2021-03-10T13:43:00.535 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: DB SUMMARY 2021-03-10T13:43:00.535 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: CURRENT file: CURRENT 2021-03-10T13:43:00.535 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: IDENTITY file: IDENTITY 2021-03-10T13:43:00.535 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 109 Bytes 2021-03-10T13:43:00.535 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000004.sst 2021-03-10T13:43:00.536 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000006.log size: 69019 ; 2021-03-10T13:43:00.536 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.error_if_exists: 0 2021-03-10T13:43:00.536 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.create_if_missing: 0 2021-03-10T13:43:00.536 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.paranoid_checks: 1 2021-03-10T13:43:00.537 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.env: 0x558b929ad1a0 2021-03-10T13:43:00.537 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.info_log: 0x558b944ba9a0 2021-03-10T13:43:00.537 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.max_file_opening_threads: 16 2021-03-10T13:43:00.537 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.statistics: (nil) 2021-03-10T13:43:00.537 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.use_fsync: 0 2021-03-10T13:43:00.538 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.max_log_file_size: 0 2021-03-10T13:43:00.538 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-03-10T13:43:00.538 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.log_file_time_to_roll: 0 2021-03-10T13:43:00.538 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.keep_log_file_num: 1000 2021-03-10T13:43:00.538 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.recycle_log_file_num: 0 2021-03-10T13:43:00.539 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.allow_fallocate: 1 2021-03-10T13:43:00.539 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.allow_mmap_reads: 0 2021-03-10T13:43:00.539 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.allow_mmap_writes: 0 2021-03-10T13:43:00.539 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.use_direct_reads: 0 2021-03-10T13:43:00.539 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-03-10T13:43:00.540 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.create_missing_column_families: 0 2021-03-10T13:43:00.540 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.db_log_dir: 2021-03-10T13:43:00.540 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2021-03-10T13:43:00.540 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.table_cache_numshardbits: 6 2021-03-10T13:43:00.540 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.max_subcompactions: 1 2021-03-10T13:43:00.541 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.max_background_flushes: -1 2021-03-10T13:43:00.541 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-03-10T13:43:00.541 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-03-10T13:43:00.541 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-03-10T13:43:00.541 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-03-10T13:43:00.542 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.advise_random_on_open: 1 2021-03-10T13:43:00.542 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.db_write_buffer_size: 0 2021-03-10T13:43:00.542 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.write_buffer_manager: 0x558b95054ae0 2021-03-10T13:43:00.542 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-03-10T13:43:00.542 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-03-10T13:43:00.543 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-03-10T13:43:00.543 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.use_adaptive_mutex: 0 2021-03-10T13:43:00.543 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.rate_limiter: (nil) 2021-03-10T13:43:00.543 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-03-10T13:43:00.543 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.wal_recovery_mode: 2 2021-03-10T13:43:00.544 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.enable_thread_tracking: 0 2021-03-10T13:43:00.544 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.enable_pipelined_write: 0 2021-03-10T13:43:00.544 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-03-10T13:43:00.544 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-03-10T13:43:00.544 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-03-10T13:43:00.545 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-03-10T13:43:00.545 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.row_cache: None 2021-03-10T13:43:00.545 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.wal_filter: None 2021-03-10T13:43:00.545 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-03-10T13:43:00.545 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.allow_ingest_behind: 0 2021-03-10T13:43:00.546 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.preserve_deletes: 0 2021-03-10T13:43:00.546 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.two_write_queues: 0 2021-03-10T13:43:00.546 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.manual_wal_flush: 0 2021-03-10T13:43:00.546 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.atomic_flush: 0 2021-03-10T13:43:00.546 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-03-10T13:43:00.547 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.max_background_jobs: 2 2021-03-10T13:43:00.547 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.max_background_compactions: -1 2021-03-10T13:43:00.547 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-03-10T13:43:00.547 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-03-10T13:43:00.547 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.delayed_write_rate : 16777216 2021-03-10T13:43:00.548 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.max_total_wal_size: 0 2021-03-10T13:43:00.548 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-03-10T13:43:00.548 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.stats_dump_period_sec: 600 2021-03-10T13:43:00.548 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.stats_persist_period_sec: 600 2021-03-10T13:43:00.548 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-03-10T13:43:00.549 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.max_open_files: -1 2021-03-10T13:43:00.549 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.bytes_per_sync: 0 2021-03-10T13:43:00.549 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-03-10T13:43:00.549 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.compaction_readahead_size: 0 2021-03-10T13:43:00.549 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Compression algorithms supported: 2021-03-10T13:43:00.550 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-03-10T13:43:00.550 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: kZSTD supported: 0 2021-03-10T13:43:00.550 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: kXpressCompression supported: 0 2021-03-10T13:43:00.550 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: kLZ4HCCompression supported: 1 2021-03-10T13:43:00.551 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: kLZ4Compression supported: 1 2021-03-10T13:43:00.551 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: kBZip2Compression supported: 0 2021-03-10T13:43:00.551 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: kZlibCompression supported: 1 2021-03-10T13:43:00.551 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: kSnappyCompression supported: 1 2021-03-10T13:43:00.551 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-03-10T13:43:00.552 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2021-03-10T13:43:00.552 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]: 2021-03-10T13:43:00.552 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-03-10T13:43:00.552 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.merge_operator: 2021-03-10T13:43:00.552 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.compaction_filter: None 2021-03-10T13:43:00.553 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.compaction_filter_factory: None 2021-03-10T13:43:00.553 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-03-10T13:43:00.553 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.table_factory: BlockBasedTable 2021-03-10T13:43:00.553 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x558b943da138) 2021-03-10T13:43:00.553 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: cache_index_and_filter_blocks: 1 2021-03-10T13:43:00.554 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: cache_index_and_filter_blocks_with_high_priority: 1 2021-03-10T13:43:00.554 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-03-10T13:43:00.554 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: pin_top_level_index_and_filter: 1 2021-03-10T13:43:00.554 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: index_type: 0 2021-03-10T13:43:00.554 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: data_block_index_type: 0 2021-03-10T13:43:00.555 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: data_block_hash_table_util_ratio: 0.750000 2021-03-10T13:43:00.555 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: hash_index_allow_collision: 1 2021-03-10T13:43:00.555 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: checksum: 1 2021-03-10T13:43:00.555 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: no_block_cache: 0 2021-03-10T13:43:00.555 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: block_cache: 0x558b94410610 2021-03-10T13:43:00.556 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: block_cache_name: BinnedLRUCache 2021-03-10T13:43:00.556 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: block_cache_options: 2021-03-10T13:43:00.556 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: capacity : 536870912 2021-03-10T13:43:00.556 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: num_shard_bits : 4 2021-03-10T13:43:00.556 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: strict_capacity_limit : 0 2021-03-10T13:43:00.556 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: high_pri_pool_ratio: 0.000 2021-03-10T13:43:00.557 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: block_cache_compressed: (nil) 2021-03-10T13:43:00.557 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: persistent_cache: (nil) 2021-03-10T13:43:00.557 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: block_size: 4096 2021-03-10T13:43:00.557 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: block_size_deviation: 10 2021-03-10T13:43:00.557 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: block_restart_interval: 16 2021-03-10T13:43:00.558 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: index_block_restart_interval: 1 2021-03-10T13:43:00.558 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: metadata_block_size: 4096 2021-03-10T13:43:00.558 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: partition_filters: 0 2021-03-10T13:43:00.558 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: use_delta_encoding: 1 2021-03-10T13:43:00.558 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: filter_policy: rocksdb.BuiltinBloomFilter 2021-03-10T13:43:00.559 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: whole_key_filtering: 1 2021-03-10T13:43:00.559 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: verify_compression: 0 2021-03-10T13:43:00.559 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: read_amp_bytes_per_bit: 0 2021-03-10T13:43:00.559 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: format_version: 2 2021-03-10T13:43:00.559 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: enable_index_compression: 1 2021-03-10T13:43:00.560 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: block_align: 0 2021-03-10T13:43:00.560 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.write_buffer_size: 33554432 2021-03-10T13:43:00.560 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.max_write_buffer_number: 2 2021-03-10T13:43:00.560 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.compression: NoCompression 2021-03-10T13:43:00.560 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.bottommost_compression: Disabled 2021-03-10T13:43:00.561 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.prefix_extractor: nullptr 2021-03-10T13:43:00.561 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-03-10T13:43:00.561 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.num_levels: 7 2021-03-10T13:43:00.561 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-03-10T13:43:00.561 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-03-10T13:43:00.562 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-03-10T13:43:00.562 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-03-10T13:43:00.562 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-03-10T13:43:00.562 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-03-10T13:43:00.562 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-03-10T13:43:00.563 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-03-10T13:43:00.563 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.compression_opts.window_bits: -14 2021-03-10T13:43:00.563 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.compression_opts.level: 32767 2021-03-10T13:43:00.563 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.compression_opts.strategy: 0 2021-03-10T13:43:00.563 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-03-10T13:43:00.564 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-03-10T13:43:00.564 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.compression_opts.enabled: false 2021-03-10T13:43:00.564 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-03-10T13:43:00.564 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-03-10T13:43:00.564 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-03-10T13:43:00.565 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.target_file_size_base: 67108864 2021-03-10T13:43:00.565 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.target_file_size_multiplier: 1 2021-03-10T13:43:00.565 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-03-10T13:43:00.565 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-03-10T13:43:00.565 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-03-10T13:43:00.566 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-03-10T13:43:00.566 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-03-10T13:43:00.566 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-03-10T13:43:00.566 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-03-10T13:43:00.566 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-03-10T13:43:00.567 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-03-10T13:43:00.567 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-03-10T13:43:00.567 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-03-10T13:43:00.567 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-03-10T13:43:00.567 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.arena_block_size: 4194304 2021-03-10T13:43:00.568 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-03-10T13:43:00.568 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-03-10T13:43:00.568 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-03-10T13:43:00.568 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.disable_auto_compactions: 0 2021-03-10T13:43:00.568 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-03-10T13:43:00.569 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-03-10T13:43:00.569 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-03-10T13:43:00.569 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-03-10T13:43:00.569 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-03-10T13:43:00.569 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-03-10T13:43:00.570 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-03-10T13:43:00.570 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-03-10T13:43:00.570 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-03-10T13:43:00.570 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-03-10T13:43:00.570 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.table_properties_collectors: 2021-03-10T13:43:00.571 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.inplace_update_support: 0 2021-03-10T13:43:00.571 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-03-10T13:43:00.571 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-03-10T13:43:00.571 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-03-10T13:43:00.571 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.memtable_huge_page_size: 0 2021-03-10T13:43:00.572 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.bloom_locality: 0 2021-03-10T13:43:00.572 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.max_successive_merges: 0 2021-03-10T13:43:00.572 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-03-10T13:43:00.572 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.paranoid_file_checks: 0 2021-03-10T13:43:00.572 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.force_consistency_checks: 0 2021-03-10T13:43:00.573 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.report_bg_io_stats: 0 2021-03-10T13:43:00.573 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: Options.ttl: 0 2021-03-10T13:43:00.573 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 5, log_number is 4,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-03-10T13:43:00.573 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 4 2021-03-10T13:43:00.573 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615383780341253, "job": 1, "event": "recovery_started", "log_files": [6]} 2021-03-10T13:43:00.574 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #6 mode 2 2021-03-10T13:43:00.574 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615383780341899, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 66114, "table_properties": {"data_size": 64409, "index_size": 310, "filter_size": 581, "raw_key_size": 8602, "raw_average_key_size": 46, "raw_value_size": 59463, "raw_average_value_size": 321, "num_data_blocks": 10, "num_entries": 185, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}} 2021-03-10T13:43:00.574 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.337+0000 7f78d4f576c0 4 rocksdb: [db/version_set.cc:3036] Creating manifest 8 2021-03-10T13:43:00.574 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.341+0000 7f78d4f576c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615383780342458, "job": 1, "event": "recovery_finished"} 2021-03-10T13:43:00.575 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.341+0000 7f78d4f576c0 4 rocksdb: DB pointer 0x558b944ab200 2021-03-10T13:43:00.575 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.341+0000 7f78bc0a4700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS ------- 2021-03-10T13:43:00.575 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.341+0000 7f78bc0a4700 4 rocksdb: [db/db_impl.cc:778] 2021-03-10T13:43:00.575 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: ** DB Stats ** 2021-03-10T13:43:00.575 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:43:00.575 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-03-10T13:43:00.576 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-03-10T13:43:00.576 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T13:43:00.576 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-03-10T13:43:00.576 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-03-10T13:43:00.576 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T13:43:00.577 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: ** Compaction Stats [default] ** 2021-03-10T13:43:00.577 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:43:00.577 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:43:00.577 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: L0 2/0 66.19 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 135.0 0.00 0.00 1 0.000 0 0 2021-03-10T13:43:00.577 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: Sum 2/0 66.19 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 135.0 0.00 0.00 1 0.000 0 0 2021-03-10T13:43:00.578 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 135.0 0.00 0.00 1 0.000 0 0 2021-03-10T13:43:00.578 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: ** Compaction Stats [default] ** 2021-03-10T13:43:00.578 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:43:00.578 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:43:00.578 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 135.0 0.00 0.00 1 0.000 0 0 2021-03-10T13:43:00.579 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:43:00.579 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: Flush(GB): cumulative 0.000, interval 0.000 2021-03-10T13:43:00.579 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T13:43:00.579 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T13:43:00.580 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T13:43:00.580 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T13:43:00.580 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: Cumulative compaction: 0.00 GB write, 25.11 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:43:00.580 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: Interval compaction: 0.00 GB write, 25.11 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:43:00.580 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T13:43:00.581 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T13:43:00.581 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: ** Compaction Stats [default] ** 2021-03-10T13:43:00.581 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:43:00.581 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:43:00.581 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: L0 2/0 66.19 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 135.0 0.00 0.00 1 0.000 0 0 2021-03-10T13:43:00.582 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: Sum 2/0 66.19 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 135.0 0.00 0.00 1 0.000 0 0 2021-03-10T13:43:00.582 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:43:00.582 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: ** Compaction Stats [default] ** 2021-03-10T13:43:00.582 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:43:00.582 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:43:00.583 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 135.0 0.00 0.00 1 0.000 0 0 2021-03-10T13:43:00.583 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:43:00.583 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: Flush(GB): cumulative 0.000, interval 0.000 2021-03-10T13:43:00.583 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T13:43:00.583 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T13:43:00.584 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T13:43:00.584 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T13:43:00.584 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: Cumulative compaction: 0.00 GB write, 24.75 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:43:00.584 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:43:00.584 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T13:43:00.585 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T13:43:00.585 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.341+0000 7f78d4f576c0 0 starting mon.a rank 0 at public addrs [v2:172.21.2.113:3300/0,v1:172.21.2.113:6789/0] at bind addrs [v2:172.21.2.113:3300/0,v1:172.21.2.113:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 7672acc8-81a6-11eb-9080-001a4aab830c 2021-03-10T13:43:00.585 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.341+0000 7f78d4f576c0 1 mon.a@-1(???) e1 preinit fsid 7672acc8-81a6-11eb-9080-001a4aab830c 2021-03-10T13:43:00.585 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.341+0000 7f78d4f576c0 0 mon.a@-1(???).mds e1 new map 2021-03-10T13:43:00.585 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.341+0000 7f78d4f576c0 0 mon.a@-1(???).mds e1 print_map 2021-03-10T13:43:00.586 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: e1 2021-03-10T13:43:00.586 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: enable_multiple, ever_enabled_multiple: 0,0 2021-03-10T13:43:00.586 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-03-10T13:43:00.586 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: legacy client fscid: -1 2021-03-10T13:43:00.586 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: 2021-03-10T13:43:00.587 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: No filesystems configured 2021-03-10T13:43:00.587 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.341+0000 7f78d4f576c0 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-03-10T13:43:00.587 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.341+0000 7f78d4f576c0 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-03-10T13:43:00.587 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.341+0000 7f78d4f576c0 0 mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2021-03-10T13:43:00.587 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.341+0000 7f78d4f576c0 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-03-10T13:43:00.588 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: audit 2021-03-10T13:42:58.149167+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.2.113:0/3407522115' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:43:00.588 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.341+0000 7f78d4f576c0 1 mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2021-03-10T13:43:00.588 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.345+0000 7f78d4f576c0 20 expand_channel_meta expand map: {default=false} 2021-03-10T13:43:00.588 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.345+0000 7f78d4f576c0 20 expand_channel_meta from 'false' to 'false' 2021-03-10T13:43:00.588 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.345+0000 7f78d4f576c0 20 expand_channel_meta expanded map: {default=false} 2021-03-10T13:43:00.589 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.345+0000 7f78d4f576c0 20 expand_channel_meta expand map: {default=info} 2021-03-10T13:43:00.589 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.345+0000 7f78d4f576c0 20 expand_channel_meta from 'info' to 'info' 2021-03-10T13:43:00.589 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.345+0000 7f78d4f576c0 20 expand_channel_meta expanded map: {default=info} 2021-03-10T13:43:00.589 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.345+0000 7f78d4f576c0 20 expand_channel_meta expand map: {default=daemon} 2021-03-10T13:43:00.589 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.345+0000 7f78d4f576c0 20 expand_channel_meta from 'daemon' to 'daemon' 2021-03-10T13:43:00.590 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.345+0000 7f78d4f576c0 20 expand_channel_meta expanded map: {default=daemon} 2021-03-10T13:43:00.590 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.345+0000 7f78d4f576c0 20 expand_channel_meta expand map: {default=debug} 2021-03-10T13:43:00.590 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.345+0000 7f78d4f576c0 20 expand_channel_meta from 'debug' to 'debug' 2021-03-10T13:43:00.590 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: debug 2021-03-10T13:43:00.345+0000 7f78d4f576c0 20 expand_channel_meta expanded map: {default=debug} 2021-03-10T13:43:00.590 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: cluster 2021-03-10T13:43:00.348230+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2021-03-10T13:43:00.591 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: cluster 2021-03-10T13:43:00.348262+0000 mon.a (mon.0) 2 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.2.113:3300/0,v1:172.21.2.113:6789/0]} 2021-03-10T13:43:00.591 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: cluster 2021-03-10T13:43:00.348281+0000 mon.a (mon.0) 3 : cluster [DBG] fsmap 2021-03-10T13:43:00.591 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: cluster 2021-03-10T13:43:00.348296+0000 mon.a (mon.0) 4 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2021-03-10T13:43:00.591 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:00 gibba013 bash[9767]: cluster 2021-03-10T13:43:00.348717+0000 mon.a (mon.0) 5 : cluster [DBG] mgrmap e1: no daemons active 2021-03-10T13:43:01.026 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:Creating mgr... 2021-03-10T13:43:01.029 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: systemctl daemon-reload 2021-03-10T13:43:01.140 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: systemctl stop ceph-7672acc8-81a6-11eb-9080-001a4aab830c@mgr.y 2021-03-10T13:43:01.145 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: systemctl reset-failed ceph-7672acc8-81a6-11eb-9080-001a4aab830c@mgr.y 2021-03-10T13:43:01.147 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:systemctl:stderr Failed to reset failed state of unit ceph-7672acc8-81a6-11eb-9080-001a4aab830c@mgr.y.service: Unit ceph-7672acc8-81a6-11eb-9080-001a4aab830c@mgr.y.service not loaded. 2021-03-10T13:43:01.147 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: systemctl enable ceph-7672acc8-81a6-11eb-9080-001a4aab830c@mgr.y 2021-03-10T13:43:01.149 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/ceph-7672acc8-81a6-11eb-9080-001a4aab830c.target.wants/ceph-7672acc8-81a6-11eb-9080-001a4aab830c@mgr.y.service -> /etc/systemd/system/ceph-7672acc8-81a6-11eb-9080-001a4aab830c@.service. 2021-03-10T13:43:01.260 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: systemctl start ceph-7672acc8-81a6-11eb-9080-001a4aab830c@mgr.y 2021-03-10T13:43:01.286 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:firewalld does not appear to be present 2021-03-10T13:43:01.286 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2021-03-10T13:43:01.287 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:Wrote config to /etc/ceph/ceph.conf 2021-03-10T13:43:01.287 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:Waiting for mgr to start... 2021-03-10T13:43:01.287 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:Waiting for mgr... 2021-03-10T13:43:01.287 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba013', '-v', '/var/log/ceph/7672acc8-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp53lxa2bo:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmp7c38gcj7:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'status', '-f', 'json-pretty'] 2021-03-10T13:43:01.288 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba013 -v /var/log/ceph/7672acc8-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp53lxa2bo:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp7c38gcj7:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status -f json-pretty 2021-03-10T13:43:01.309 INFO:journalctl@ceph.mgr.y.gibba013.stdout:Mar 10 13:43:01 gibba013 docker[9988]: Error: No such container: ceph-7672acc8-81a6-11eb-9080-001a4aab830c-mgr.y 2021-03-10T13:43:01.309 INFO:journalctl@ceph.mgr.y.gibba013.stdout:Mar 10 13:43:01 gibba013 systemd[1]: Started Ceph mgr.y for 7672acc8-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:43:01.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:01 gibba013 bash[9767]: audit 2021-03-10T13:43:00.476458+0000 mon.a (mon.0) 6 : audit [INF] from='client.? 172.21.2.113:0/2730801307' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "public_network", "value": "172.21.0.0/20"}]: dispatch 2021-03-10T13:43:01.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:01 gibba013 bash[9767]: audit 2021-03-10T13:43:00.478378+0000 mon.a (mon.0) 7 : audit [INF] from='client.? 172.21.2.113:0/2730801307' entity='client.admin' cmd='[{"prefix": "config set", "who": "mon", "name": "public_network", "value": "172.21.0.0/20"}]': finished 2021-03-10T13:43:02.557 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T13:43:02.557 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:02.557 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsid": "7672acc8-81a6-11eb-9080-001a4aab830c", 2021-03-10T13:43:02.558 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "health": { 2021-03-10T13:43:02.558 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status": "HEALTH_OK", 2021-03-10T13:43:02.558 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "checks": {}, 2021-03-10T13:43:02.558 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mutes": [] 2021-03-10T13:43:02.559 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:02.559 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "election_epoch": 5, 2021-03-10T13:43:02.559 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum": [ 2021-03-10T13:43:02.559 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 0 2021-03-10T13:43:02.559 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:02.560 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_names": [ 2021-03-10T13:43:02.560 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "a" 2021-03-10T13:43:02.560 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:02.560 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_age": 2, 2021-03-10T13:43:02.560 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "monmap": { 2021-03-10T13:43:02.561 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T13:43:02.561 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_mon_release_name": "octopus", 2021-03-10T13:43:02.561 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_mons": 1 2021-03-10T13:43:02.561 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:02.561 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osdmap": { 2021-03-10T13:43:02.562 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T13:43:02.562 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_osds": 0, 2021-03-10T13:43:02.562 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_up_osds": 0, 2021-03-10T13:43:02.562 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_up_since": 0, 2021-03-10T13:43:02.562 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_in_osds": 0, 2021-03-10T13:43:02.563 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_in_since": 0, 2021-03-10T13:43:02.563 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_remapped_pgs": 0 2021-03-10T13:43:02.563 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:02.563 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgmap": { 2021-03-10T13:43:02.563 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgs_by_state": [], 2021-03-10T13:43:02.564 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pgs": 0, 2021-03-10T13:43:02.564 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pools": 0, 2021-03-10T13:43:02.564 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_objects": 0, 2021-03-10T13:43:02.564 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "data_bytes": 0, 2021-03-10T13:43:02.564 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_used": 0, 2021-03-10T13:43:02.565 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_avail": 0, 2021-03-10T13:43:02.565 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_total": 0 2021-03-10T13:43:02.565 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:02.565 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsmap": { 2021-03-10T13:43:02.565 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T13:43:02.565 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "by_rank": [], 2021-03-10T13:43:02.566 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "up:standby": 0 2021-03-10T13:43:02.566 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:02.566 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap": { 2021-03-10T13:43:02.566 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": false, 2021-03-10T13:43:02.566 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_standbys": 0, 2021-03-10T13:43:02.567 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2021-03-10T13:43:02.567 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2021-03-10T13:43:02.567 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2021-03-10T13:43:02.567 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:02.567 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2021-03-10T13:43:02.568 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:02.568 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "servicemap": { 2021-03-10T13:43:02.568 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T13:43:02.568 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modified": "2021-03-10T13:42:55.243226+0000", 2021-03-10T13:43:02.568 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2021-03-10T13:43:02.569 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:02.569 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress_events": {} 2021-03-10T13:43:02.569 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:02.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:02 gibba013 bash[9767]: audit 2021-03-10T13:43:02.550203+0000 mon.a (mon.0) 8 : audit [DBG] from='client.? 172.21.2.113:0/3918660788' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-03-10T13:43:03.084 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:mgr not available, waiting (1/10)... 2021-03-10T13:43:04.085 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba013', '-v', '/var/log/ceph/7672acc8-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp53lxa2bo:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmp7c38gcj7:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'status', '-f', 'json-pretty'] 2021-03-10T13:43:04.086 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba013 -v /var/log/ceph/7672acc8-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp53lxa2bo:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp7c38gcj7:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status -f json-pretty 2021-03-10T13:43:04.970 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T13:43:04.970 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:04.971 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsid": "7672acc8-81a6-11eb-9080-001a4aab830c", 2021-03-10T13:43:04.971 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "health": { 2021-03-10T13:43:04.971 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status": "HEALTH_OK", 2021-03-10T13:43:04.971 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "checks": {}, 2021-03-10T13:43:04.972 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mutes": [] 2021-03-10T13:43:04.972 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:04.972 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "election_epoch": 5, 2021-03-10T13:43:04.972 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum": [ 2021-03-10T13:43:04.972 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 0 2021-03-10T13:43:04.973 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:04.973 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_names": [ 2021-03-10T13:43:04.973 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "a" 2021-03-10T13:43:04.973 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:04.973 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_age": 4, 2021-03-10T13:43:04.973 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "monmap": { 2021-03-10T13:43:04.974 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T13:43:04.974 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_mon_release_name": "octopus", 2021-03-10T13:43:04.974 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_mons": 1 2021-03-10T13:43:04.974 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:04.974 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osdmap": { 2021-03-10T13:43:04.975 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T13:43:04.975 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_osds": 0, 2021-03-10T13:43:04.975 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_up_osds": 0, 2021-03-10T13:43:04.975 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_up_since": 0, 2021-03-10T13:43:04.975 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_in_osds": 0, 2021-03-10T13:43:04.976 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_in_since": 0, 2021-03-10T13:43:04.976 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_remapped_pgs": 0 2021-03-10T13:43:04.976 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:04.976 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgmap": { 2021-03-10T13:43:04.976 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgs_by_state": [], 2021-03-10T13:43:04.977 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pgs": 0, 2021-03-10T13:43:04.977 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pools": 0, 2021-03-10T13:43:04.977 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_objects": 0, 2021-03-10T13:43:04.977 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "data_bytes": 0, 2021-03-10T13:43:04.977 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_used": 0, 2021-03-10T13:43:04.977 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_avail": 0, 2021-03-10T13:43:04.978 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_total": 0 2021-03-10T13:43:04.978 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:04.978 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsmap": { 2021-03-10T13:43:04.978 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T13:43:04.978 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "by_rank": [], 2021-03-10T13:43:04.979 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "up:standby": 0 2021-03-10T13:43:04.979 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:04.979 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap": { 2021-03-10T13:43:04.979 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": false, 2021-03-10T13:43:04.979 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_standbys": 0, 2021-03-10T13:43:04.980 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2021-03-10T13:43:04.980 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2021-03-10T13:43:04.980 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2021-03-10T13:43:04.980 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:04.980 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2021-03-10T13:43:04.980 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:04.981 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "servicemap": { 2021-03-10T13:43:04.981 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T13:43:04.981 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modified": "2021-03-10T13:42:55.243226+0000", 2021-03-10T13:43:04.981 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2021-03-10T13:43:04.981 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:04.982 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress_events": {} 2021-03-10T13:43:04.982 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:05.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:05 gibba013 bash[9767]: audit 2021-03-10T13:43:04.963924+0000 mon.a (mon.0) 9 : audit [DBG] from='client.? 172.21.2.113:0/3065537941' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-03-10T13:43:05.481 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:mgr not available, waiting (2/10)... 2021-03-10T13:43:06.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:06 gibba013 bash[9767]: cluster 2021-03-10T13:43:05.193354+0000 mon.a (mon.0) 10 : cluster [INF] Activating manager daemon y 2021-03-10T13:43:06.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:06 gibba013 bash[9767]: cluster 2021-03-10T13:43:05.195262+0000 mon.a (mon.0) 11 : cluster [DBG] mgrmap e2: y(active, starting, since 0.0019672s) 2021-03-10T13:43:06.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:06 gibba013 bash[9767]: audit 2021-03-10T13:43:05.196056+0000 mon.a (mon.0) 12 : audit [DBG] from='mgr.14100 172.21.2.113:0/1897604460' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T13:43:06.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:06 gibba013 bash[9767]: audit 2021-03-10T13:43:05.196200+0000 mon.a (mon.0) 13 : audit [DBG] from='mgr.14100 172.21.2.113:0/1897604460' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T13:43:06.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:06 gibba013 bash[9767]: audit 2021-03-10T13:43:05.196321+0000 mon.a (mon.0) 14 : audit [DBG] from='mgr.14100 172.21.2.113:0/1897604460' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T13:43:06.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:06 gibba013 bash[9767]: audit 2021-03-10T13:43:05.196606+0000 mon.a (mon.0) 15 : audit [DBG] from='mgr.14100 172.21.2.113:0/1897604460' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T13:43:06.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:06 gibba013 bash[9767]: audit 2021-03-10T13:43:05.196753+0000 mon.a (mon.0) 16 : audit [DBG] from='mgr.14100 172.21.2.113:0/1897604460' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T13:43:06.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:06 gibba013 bash[9767]: cluster 2021-03-10T13:43:05.198080+0000 mon.a (mon.0) 17 : cluster [INF] Manager daemon y is now available 2021-03-10T13:43:06.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:06 gibba013 bash[9767]: audit 2021-03-10T13:43:05.209659+0000 mon.a (mon.0) 18 : audit [INF] from='mgr.14100 172.21.2.113:0/1897604460' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-03-10T13:43:06.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:06 gibba013 bash[9767]: audit 2021-03-10T13:43:05.278922+0000 mon.a (mon.0) 19 : audit [INF] from='mgr.14100 172.21.2.113:0/1897604460' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/telemetry/report_id","val":"0a038ae3-591a-4d3d-8f99-cc2827f23f36"}]: dispatch 2021-03-10T13:43:06.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:06 gibba013 bash[9767]: audit 2021-03-10T13:43:05.280794+0000 mon.a (mon.0) 20 : audit [INF] from='mgr.14100 172.21.2.113:0/1897604460' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]': finished 2021-03-10T13:43:06.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:06 gibba013 bash[9767]: cluster 2021-03-10T13:43:05.280817+0000 mon.a (mon.0) 21 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2021-03-10T13:43:06.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:06 gibba013 bash[9767]: audit 2021-03-10T13:43:05.282075+0000 mon.a (mon.0) 22 : audit [INF] from='mgr.14100 172.21.2.113:0/1897604460' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/telemetry/report_id","val":"0a038ae3-591a-4d3d-8f99-cc2827f23f36"}]': finished 2021-03-10T13:43:06.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:06 gibba013 bash[9767]: audit 2021-03-10T13:43:05.282294+0000 mon.a (mon.0) 23 : audit [INF] from='mgr.14100 172.21.2.113:0/1897604460' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2021-03-10T13:43:06.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:06 gibba013 bash[9767]: audit 2021-03-10T13:43:05.282557+0000 mon.a (mon.0) 24 : audit [INF] from='mgr.14100 172.21.2.113:0/1897604460' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/telemetry/salt","val":"8ee9472f-b3d3-40c1-8511-24e52edd1c8e"}]: dispatch 2021-03-10T13:43:06.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:06 gibba013 bash[9767]: audit 2021-03-10T13:43:05.283847+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.14100 172.21.2.113:0/1897604460' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/telemetry/salt","val":"8ee9472f-b3d3-40c1-8511-24e52edd1c8e"}]': finished 2021-03-10T13:43:06.483 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba013', '-v', '/var/log/ceph/7672acc8-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp53lxa2bo:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmp7c38gcj7:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'status', '-f', 'json-pretty'] 2021-03-10T13:43:06.483 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba013 -v /var/log/ceph/7672acc8-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp53lxa2bo:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp7c38gcj7:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status -f json-pretty 2021-03-10T13:43:07.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:07 gibba013 bash[9767]: cluster 2021-03-10T13:43:06.203875+0000 mon.a (mon.0) 26 : cluster [DBG] mgrmap e3: y(active, since 1.01058s) 2021-03-10T13:43:07.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:07 gibba013 bash[9767]: audit 2021-03-10T13:43:06.288924+0000 mon.a (mon.0) 27 : audit [INF] from='mgr.14100 172.21.2.113:0/1897604460' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2021-03-10T13:43:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:07 gibba013 bash[9767]: cluster 2021-03-10T13:43:06.289094+0000 mon.a (mon.0) 28 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2021-03-10T13:43:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:07 gibba013 bash[9767]: audit 2021-03-10T13:43:06.291709+0000 mon.a (mon.0) 29 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-03-10T13:43:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:07 gibba013 bash[9767]: audit 2021-03-10T13:43:06.477067+0000 mon.a (mon.0) 30 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-03-10T13:43:07.468 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T13:43:07.468 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:07.468 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsid": "7672acc8-81a6-11eb-9080-001a4aab830c", 2021-03-10T13:43:07.468 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "health": { 2021-03-10T13:43:07.469 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status": "HEALTH_OK", 2021-03-10T13:43:07.469 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "checks": {}, 2021-03-10T13:43:07.469 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mutes": [] 2021-03-10T13:43:07.469 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:07.469 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "election_epoch": 5, 2021-03-10T13:43:07.470 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum": [ 2021-03-10T13:43:07.470 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 0 2021-03-10T13:43:07.470 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:07.470 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_names": [ 2021-03-10T13:43:07.470 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "a" 2021-03-10T13:43:07.471 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:07.471 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_age": 7, 2021-03-10T13:43:07.471 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "monmap": { 2021-03-10T13:43:07.471 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T13:43:07.472 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_mon_release_name": "octopus", 2021-03-10T13:43:07.472 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_mons": 1 2021-03-10T13:43:07.472 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:07.472 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osdmap": { 2021-03-10T13:43:07.472 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 3, 2021-03-10T13:43:07.473 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_osds": 0, 2021-03-10T13:43:07.473 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_up_osds": 0, 2021-03-10T13:43:07.473 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_up_since": 0, 2021-03-10T13:43:07.473 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_in_osds": 0, 2021-03-10T13:43:07.473 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_in_since": 0, 2021-03-10T13:43:07.474 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_remapped_pgs": 0 2021-03-10T13:43:07.474 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:07.474 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgmap": { 2021-03-10T13:43:07.474 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgs_by_state": [], 2021-03-10T13:43:07.474 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pgs": 0, 2021-03-10T13:43:07.475 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pools": 0, 2021-03-10T13:43:07.475 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_objects": 0, 2021-03-10T13:43:07.475 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "data_bytes": 0, 2021-03-10T13:43:07.475 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_used": 0, 2021-03-10T13:43:07.475 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_avail": 0, 2021-03-10T13:43:07.476 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_total": 0 2021-03-10T13:43:07.476 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:07.476 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsmap": { 2021-03-10T13:43:07.476 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T13:43:07.477 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "by_rank": [], 2021-03-10T13:43:07.477 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "up:standby": 0 2021-03-10T13:43:07.477 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:07.477 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap": { 2021-03-10T13:43:07.477 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": true, 2021-03-10T13:43:07.478 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_standbys": 0, 2021-03-10T13:43:07.478 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2021-03-10T13:43:07.478 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2021-03-10T13:43:07.478 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2021-03-10T13:43:07.478 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:07.479 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2021-03-10T13:43:07.479 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:07.479 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "servicemap": { 2021-03-10T13:43:07.479 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T13:43:07.479 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modified": "2021-03-10T13:42:55.243226+0000", 2021-03-10T13:43:07.480 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2021-03-10T13:43:07.480 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:07.480 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress_events": {} 2021-03-10T13:43:07.480 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:07.972 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:Enabling cephadm module... 2021-03-10T13:43:07.972 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba013', '-v', '/var/log/ceph/7672acc8-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp53lxa2bo:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmp7c38gcj7:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'mgr', 'module', 'enable', 'cephadm'] 2021-03-10T13:43:07.972 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba013 -v /var/log/ceph/7672acc8-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp53lxa2bo:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp7c38gcj7:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 mgr module enable cephadm 2021-03-10T13:43:08.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:08 gibba013 bash[9767]: cluster 2021-03-10T13:43:07.285768+0000 mon.a (mon.0) 31 : cluster [DBG] mgrmap e4: y(active, since 2s) 2021-03-10T13:43:08.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:08 gibba013 bash[9767]: audit 2021-03-10T13:43:07.460685+0000 mon.a (mon.0) 32 : audit [DBG] from='client.? 172.21.2.113:0/2510790716' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-03-10T13:43:09.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:09 gibba013 bash[9767]: audit 2021-03-10T13:43:08.989787+0000 mon.a (mon.0) 33 : audit [INF] from='client.? 172.21.2.113:0/3785376420' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2021-03-10T13:43:09.631 INFO:journalctl@ceph.mgr.y.gibba013.stdout:Mar 10 13:43:09 gibba013 bash[10020]: ignoring --setuser ceph since I am not root 2021-03-10T13:43:09.631 INFO:journalctl@ceph.mgr.y.gibba013.stdout:Mar 10 13:43:09 gibba013 bash[10020]: ignoring --setgroup ceph since I am not root 2021-03-10T13:43:09.810 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba013', '-v', '/var/log/ceph/7672acc8-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp53lxa2bo:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmp7c38gcj7:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'mgr', 'dump'] 2021-03-10T13:43:09.811 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba013 -v /var/log/ceph/7672acc8-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp53lxa2bo:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp7c38gcj7:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 mgr dump 2021-03-10T13:43:10.573 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:10 gibba013 bash[9767]: audit 2021-03-10T13:43:09.299502+0000 mon.a (mon.0) 34 : audit [INF] from='client.? 172.21.2.113:0/3785376420' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2021-03-10T13:43:10.573 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:10 gibba013 bash[9767]: cluster 2021-03-10T13:43:09.299522+0000 mon.a (mon.0) 35 : cluster [DBG] mgrmap e5: y(active, since 4s) 2021-03-10T13:43:11.207 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:11.208 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 5, 2021-03-10T13:43:11.208 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_gid": 14100, 2021-03-10T13:43:11.208 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_name": "y", 2021-03-10T13:43:11.208 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addrs": { 2021-03-10T13:43:11.209 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2021-03-10T13:43:11.209 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:11.209 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2021-03-10T13:43:11.209 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.113:6800", 2021-03-10T13:43:11.209 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 2562375199 2021-03-10T13:43:11.210 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.210 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:11.210 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v1", 2021-03-10T13:43:11.210 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.113:6801", 2021-03-10T13:43:11.211 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 2562375199 2021-03-10T13:43:11.211 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.211 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T13:43:11.211 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.211 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addr": "172.21.2.113:6801/2562375199", 2021-03-10T13:43:11.212 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_change": "2021-03-10T13:43:05.193289+0000", 2021-03-10T13:43:11.212 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_mgr_features": 4540138292836696063, 2021-03-10T13:43:11.212 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": true, 2021-03-10T13:43:11.212 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standbys": [], 2021-03-10T13:43:11.212 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2021-03-10T13:43:11.213 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2021-03-10T13:43:11.213 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2021-03-10T13:43:11.213 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2021-03-10T13:43:11.213 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.213 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available_modules": [ 2021-03-10T13:43:11.214 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:11.214 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "alerts", 2021-03-10T13:43:11.214 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:11.214 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:11.214 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:11.215 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T13:43:11.215 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T13:43:11.215 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:43:11.215 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.215 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.216 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2021-03-10T13:43:11.216 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.216 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.216 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.216 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "How frequently to reexamine health status", 2021-03-10T13:43:11.217 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.217 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.217 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.217 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.217 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:11.218 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:11.218 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.218 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.218 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.218 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.219 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.219 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.219 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.219 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.219 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.220 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.220 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.220 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.220 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.220 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.221 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.221 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.221 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.221 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.221 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.222 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:11.222 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:11.222 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.222 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.222 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.223 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.223 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.223 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.223 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.223 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.224 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.224 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.224 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.224 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.224 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:11.225 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:11.225 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.225 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.225 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.225 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:11.225 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.226 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.226 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.226 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.226 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.227 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.227 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.227 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.227 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.227 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.227 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.228 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.228 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.228 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.228 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.229 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:11.229 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:11.229 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.229 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.229 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.230 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.230 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.230 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.230 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.230 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.231 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.231 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.231 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.231 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.231 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_destination": { 2021-03-10T13:43:11.232 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_destination", 2021-03-10T13:43:11.232 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.232 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.232 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.232 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.233 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.233 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.233 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.233 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email address to send alerts to", 2021-03-10T13:43:11.233 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.234 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.234 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.234 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.234 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_from_name": { 2021-03-10T13:43:11.234 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_from_name", 2021-03-10T13:43:11.235 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.235 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.235 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.235 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "Ceph", 2021-03-10T13:43:11.235 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.236 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.236 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.236 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email From: name", 2021-03-10T13:43:11.236 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.236 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.237 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.237 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.237 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_host": { 2021-03-10T13:43:11.237 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_host", 2021-03-10T13:43:11.237 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.238 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.238 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.238 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.238 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.238 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.239 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.239 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP server", 2021-03-10T13:43:11.239 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.239 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.239 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.240 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.240 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_password": { 2021-03-10T13:43:11.240 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_password", 2021-03-10T13:43:11.240 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.240 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.241 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.241 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.241 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.241 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.241 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.242 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Password to authenticate with", 2021-03-10T13:43:11.242 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.242 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.242 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.242 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.243 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_port": { 2021-03-10T13:43:11.243 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_port", 2021-03-10T13:43:11.243 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:11.243 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.243 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.244 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "465", 2021-03-10T13:43:11.244 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.244 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.244 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.244 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP port", 2021-03-10T13:43:11.245 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.245 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.245 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.245 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.245 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_sender": { 2021-03-10T13:43:11.246 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_sender", 2021-03-10T13:43:11.246 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.246 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.246 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.246 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.247 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.247 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.247 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.247 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP envelope sender", 2021-03-10T13:43:11.247 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.248 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.248 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.248 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.248 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_ssl": { 2021-03-10T13:43:11.248 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_ssl", 2021-03-10T13:43:11.249 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.249 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.249 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.249 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:11.249 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.249 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.250 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.250 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Use SSL to connect to SMTP server", 2021-03-10T13:43:11.250 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.250 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.251 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.251 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.251 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_user": { 2021-03-10T13:43:11.251 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_user", 2021-03-10T13:43:11.251 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.251 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.252 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.252 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.252 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.252 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.252 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.253 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "User to authenticate as", 2021-03-10T13:43:11.253 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.253 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.253 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.253 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.254 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.254 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.254 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:11.254 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "balancer", 2021-03-10T13:43:11.254 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:11.255 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:11.255 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:11.255 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active": { 2021-03-10T13:43:11.255 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "active", 2021-03-10T13:43:11.255 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.256 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.256 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.256 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.256 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.256 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.257 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.257 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically balance PGs across cluster", 2021-03-10T13:43:11.257 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.257 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.257 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.258 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.258 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_time": { 2021-03-10T13:43:11.258 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_time", 2021-03-10T13:43:11.258 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.258 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.259 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.259 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0000", 2021-03-10T13:43:11.259 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.259 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.259 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.260 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "beginning time of day to automatically balance", 2021-03-10T13:43:11.260 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2021-03-10T13:43:11.260 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.260 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.260 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.261 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_weekday": { 2021-03-10T13:43:11.261 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_weekday", 2021-03-10T13:43:11.261 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2021-03-10T13:43:11.261 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.261 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.262 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2021-03-10T13:43:11.262 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2021-03-10T13:43:11.262 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2021-03-10T13:43:11.262 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.262 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to this day of the week or later", 2021-03-10T13:43:11.263 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2021-03-10T13:43:11.263 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.263 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.263 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.263 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_max_iterations": { 2021-03-10T13:43:11.264 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_max_iterations", 2021-03-10T13:43:11.264 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2021-03-10T13:43:11.264 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.264 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.264 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "25", 2021-03-10T13:43:11.265 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2021-03-10T13:43:11.265 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "250", 2021-03-10T13:43:11.265 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.265 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum number of iterations to attempt optimization", 2021-03-10T13:43:11.265 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.266 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.266 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.266 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.266 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_metrics": { 2021-03-10T13:43:11.267 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_metrics", 2021-03-10T13:43:11.267 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.267 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.267 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.267 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "pgs,objects,bytes", 2021-03-10T13:43:11.267 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.268 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.268 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.268 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "metrics with which to calculate OSD utilization", 2021-03-10T13:43:11.268 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2021-03-10T13:43:11.268 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.269 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.269 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.269 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_step": { 2021-03-10T13:43:11.269 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_step", 2021-03-10T13:43:11.269 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2021-03-10T13:43:11.270 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.270 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.270 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0.5", 2021-03-10T13:43:11.270 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0.001", 2021-03-10T13:43:11.270 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "0.999", 2021-03-10T13:43:11.271 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.271 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "aggressiveness of optimization", 2021-03-10T13:43:11.271 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": ".99 is very aggressive, .01 is less aggressive", 2021-03-10T13:43:11.271 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.271 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.272 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.272 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_time": { 2021-03-10T13:43:11.272 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_time", 2021-03-10T13:43:11.272 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.272 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.273 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.273 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2400", 2021-03-10T13:43:11.273 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.273 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.273 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.274 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "ending time of day to automatically balance", 2021-03-10T13:43:11.274 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2021-03-10T13:43:11.274 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.274 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.274 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.275 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_weekday": { 2021-03-10T13:43:11.275 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_weekday", 2021-03-10T13:43:11.275 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2021-03-10T13:43:11.275 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.275 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.276 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2021-03-10T13:43:11.276 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2021-03-10T13:43:11.276 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2021-03-10T13:43:11.276 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.276 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to days of the week earlier than this", 2021-03-10T13:43:11.277 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2021-03-10T13:43:11.277 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.277 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.277 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.277 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:11.278 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:11.278 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.278 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.278 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.278 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.279 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.279 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.279 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.279 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.279 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.280 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.280 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.280 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.280 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.281 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.281 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.281 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.281 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.281 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.281 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.282 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:11.282 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:11.282 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.282 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.283 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.283 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.283 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.283 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.283 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.284 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.284 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.284 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.284 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.284 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.285 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:11.285 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:11.285 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.285 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.285 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.286 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:11.286 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.286 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.286 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.286 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.287 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.287 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.287 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.287 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.287 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.288 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.288 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.288 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.288 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.288 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.289 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.289 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:11.289 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:11.289 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.289 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.290 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.290 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.290 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.290 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.290 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.291 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.291 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.291 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.291 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.291 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.292 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_score": { 2021-03-10T13:43:11.292 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_score", 2021-03-10T13:43:11.292 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2021-03-10T13:43:11.292 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.292 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.293 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2021-03-10T13:43:11.293 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.293 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.293 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.293 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "minimum score, below which no optimization is attempted", 2021-03-10T13:43:11.294 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.294 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.294 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.294 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.294 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2021-03-10T13:43:11.295 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2021-03-10T13:43:11.295 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.295 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.295 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.295 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "none", 2021-03-10T13:43:11.296 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.296 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.296 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.296 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush-compat", 2021-03-10T13:43:11.296 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "none", 2021-03-10T13:43:11.297 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap" 2021-03-10T13:43:11.297 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.297 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Balancer mode", 2021-03-10T13:43:11.297 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.297 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.298 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.298 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.298 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_ids": { 2021-03-10T13:43:11.298 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_ids", 2021-03-10T13:43:11.299 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.299 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.299 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.299 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.299 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.299 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.300 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.300 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "pools which the automatic balancing will be limited to", 2021-03-10T13:43:11.300 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.300 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.301 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.301 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.301 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2021-03-10T13:43:11.301 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2021-03-10T13:43:11.301 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:43:11.302 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.302 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.302 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2021-03-10T13:43:11.302 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.302 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.303 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.303 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and attempt optimization", 2021-03-10T13:43:11.303 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.303 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.303 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.304 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.304 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_deviation": { 2021-03-10T13:43:11.304 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_deviation", 2021-03-10T13:43:11.304 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:11.304 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.304 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.305 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2021-03-10T13:43:11.305 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2021-03-10T13:43:11.305 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.305 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.305 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "deviation below which no optimization is attempted", 2021-03-10T13:43:11.306 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2021-03-10T13:43:11.306 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.306 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.306 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.307 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_optimizations": { 2021-03-10T13:43:11.307 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_optimizations", 2021-03-10T13:43:11.307 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2021-03-10T13:43:11.307 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.307 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.308 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2021-03-10T13:43:11.308 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.308 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.308 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.308 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum upmap optimizations to make per attempt", 2021-03-10T13:43:11.308 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.309 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.309 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.309 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.309 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.310 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.310 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:11.310 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "cephadm", 2021-03-10T13:43:11.310 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:11.310 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:11.311 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:11.311 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "allow_ptrace": { 2021-03-10T13:43:11.311 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "allow_ptrace", 2021-03-10T13:43:11.311 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.311 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.312 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.312 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.312 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.312 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.312 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.313 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "allow SYS_PTRACE capability on ceph containers", 2021-03-10T13:43:11.313 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2021-03-10T13:43:11.313 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.313 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.313 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.314 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "container_image_base": { 2021-03-10T13:43:11.314 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "container_image_base", 2021-03-10T13:43:11.314 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.314 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.314 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.315 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph/ceph", 2021-03-10T13:43:11.315 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.315 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.315 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.315 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Container image name, without the tag", 2021-03-10T13:43:11.316 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.316 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.316 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.316 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.316 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "daemon_cache_timeout": { 2021-03-10T13:43:11.317 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "daemon_cache_timeout", 2021-03-10T13:43:11.317 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:43:11.317 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.317 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.317 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2021-03-10T13:43:11.318 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.318 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.318 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.318 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache service (daemon) inventory", 2021-03-10T13:43:11.318 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.319 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.319 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.319 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.319 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_cache_timeout": { 2021-03-10T13:43:11.319 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_cache_timeout", 2021-03-10T13:43:11.320 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:43:11.320 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.320 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.320 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1800", 2021-03-10T13:43:11.320 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.321 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.321 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.321 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache device inventory", 2021-03-10T13:43:11.321 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.321 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.322 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.322 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.322 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "host_check_interval": { 2021-03-10T13:43:11.322 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "host_check_interval", 2021-03-10T13:43:11.322 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:43:11.323 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.323 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.323 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2021-03-10T13:43:11.323 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.323 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.324 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.324 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to perform a host check", 2021-03-10T13:43:11.324 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.324 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.324 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.325 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.325 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:11.325 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:11.325 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.325 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.326 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.326 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.326 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.326 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.326 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.327 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.327 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.327 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.327 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.327 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.328 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.328 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.328 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.328 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.328 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.329 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.329 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.329 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:11.329 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:11.329 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.330 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.330 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.330 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:11.330 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.331 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.331 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.331 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "log to the \"cephadm\" cluster log channel\"", 2021-03-10T13:43:11.331 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.331 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.331 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.332 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.332 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:11.332 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:11.332 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.332 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.333 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.333 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:11.333 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.333 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.333 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.334 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.334 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.334 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.334 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.334 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.335 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.335 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.335 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.335 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.335 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.335 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.336 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.336 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:11.336 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:11.336 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.336 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.337 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.337 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.337 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.337 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.337 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.337 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.338 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.338 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.338 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.338 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.338 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2021-03-10T13:43:11.339 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2021-03-10T13:43:11.339 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.339 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.339 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.339 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "root", 2021-03-10T13:43:11.340 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.340 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.340 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.340 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm-package", 2021-03-10T13:43:11.340 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "root" 2021-03-10T13:43:11.340 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.341 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "mode for remote execution of cephadm", 2021-03-10T13:43:11.341 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.341 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.341 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.341 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.342 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssh_config_file": { 2021-03-10T13:43:11.342 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssh_config_file", 2021-03-10T13:43:11.342 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.342 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.342 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.343 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:43:11.343 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.343 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.343 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.343 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "customized SSH config file to connect to managed hosts", 2021-03-10T13:43:11.344 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.344 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.344 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.344 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.344 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_failed_host_check": { 2021-03-10T13:43:11.344 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_failed_host_check", 2021-03-10T13:43:11.345 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.345 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.345 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.345 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:11.345 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.346 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.346 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.346 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if the host check fails", 2021-03-10T13:43:11.346 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.346 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.346 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.347 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.347 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_daemons": { 2021-03-10T13:43:11.347 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_daemons", 2021-03-10T13:43:11.347 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.347 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.348 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.348 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:11.348 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.348 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.348 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.349 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2021-03-10T13:43:11.349 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.349 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.349 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.349 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.349 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_hosts": { 2021-03-10T13:43:11.350 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_hosts", 2021-03-10T13:43:11.350 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.350 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.350 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.350 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:11.351 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.351 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.351 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.351 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2021-03-10T13:43:11.351 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.352 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.352 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.352 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.352 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.352 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.352 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:11.353 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crash", 2021-03-10T13:43:11.353 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:11.353 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:11.353 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:11.353 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:11.354 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:11.354 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.354 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.354 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.354 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.355 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.355 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.355 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.355 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.355 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.355 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.356 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.356 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.356 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.356 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.356 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.357 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.357 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.357 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.357 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.357 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:11.357 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:11.358 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.358 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.358 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.358 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.358 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.359 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.359 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.359 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.359 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.359 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.359 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.360 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.360 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:11.360 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:11.360 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.360 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.361 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.361 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:11.361 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.361 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.361 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.361 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.362 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.362 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.362 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.362 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.362 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.363 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.363 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.363 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.363 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.363 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.364 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.364 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:11.364 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:11.364 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.364 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.364 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.365 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.365 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.365 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.365 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.365 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.366 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.366 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.366 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.366 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.366 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retain_interval": { 2021-03-10T13:43:11.367 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retain_interval", 2021-03-10T13:43:11.367 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:43:11.367 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.367 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.367 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "31536000", 2021-03-10T13:43:11.368 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.368 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.368 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.368 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain crashes before pruning them", 2021-03-10T13:43:11.368 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.368 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.369 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.369 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.369 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_recent_interval": { 2021-03-10T13:43:11.369 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_recent_interval", 2021-03-10T13:43:11.369 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:43:11.370 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.370 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.370 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1209600", 2021-03-10T13:43:11.370 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.370 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.371 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.371 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "time interval in which to warn about recent crashes", 2021-03-10T13:43:11.371 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.371 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.371 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.371 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.372 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.372 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.372 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:11.372 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "dashboard", 2021-03-10T13:43:11.372 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:11.373 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:11.373 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:11.373 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ALERTMANAGER_API_HOST": { 2021-03-10T13:43:11.373 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ALERTMANAGER_API_HOST", 2021-03-10T13:43:11.373 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.374 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.374 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.374 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.374 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.374 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.375 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.375 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.375 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.375 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.375 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.376 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.376 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_ENABLED": { 2021-03-10T13:43:11.376 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_ENABLED", 2021-03-10T13:43:11.376 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.376 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.377 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.377 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.377 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.377 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.377 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.378 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.378 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.378 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.378 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.378 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.379 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_LOG_PAYLOAD": { 2021-03-10T13:43:11.379 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_LOG_PAYLOAD", 2021-03-10T13:43:11.379 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.379 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.380 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.380 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:11.380 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.380 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.380 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.381 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.381 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.381 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.381 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.381 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.382 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ENABLE_BROWSABLE_API": { 2021-03-10T13:43:11.382 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ENABLE_BROWSABLE_API", 2021-03-10T13:43:11.382 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.382 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.382 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.383 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:11.383 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.383 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.383 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.383 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.383 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.384 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.384 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.384 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.384 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_cephfs": { 2021-03-10T13:43:11.384 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_cephfs", 2021-03-10T13:43:11.385 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.385 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.385 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.385 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:11.385 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.386 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.386 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.386 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.386 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.386 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.387 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.387 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.387 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_iscsi": { 2021-03-10T13:43:11.387 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_iscsi", 2021-03-10T13:43:11.387 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.388 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.388 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.388 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:11.388 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.388 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.389 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.389 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.389 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.389 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.390 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.390 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.390 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_mirroring": { 2021-03-10T13:43:11.390 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_mirroring", 2021-03-10T13:43:11.390 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.391 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.391 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.391 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:11.391 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.391 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.392 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.392 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.392 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.392 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.392 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.393 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.393 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_nfs": { 2021-03-10T13:43:11.393 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_nfs", 2021-03-10T13:43:11.393 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.393 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.394 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.394 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:11.394 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.394 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.394 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.395 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.395 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.395 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.395 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.395 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.396 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rbd": { 2021-03-10T13:43:11.396 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rbd", 2021-03-10T13:43:11.396 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.396 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.396 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.397 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:11.397 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.397 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.397 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.397 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.398 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.398 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.398 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.398 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.398 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rgw": { 2021-03-10T13:43:11.399 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rgw", 2021-03-10T13:43:11.399 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.399 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.399 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.399 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:11.400 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.400 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.400 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.400 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.400 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.401 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.401 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.401 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.401 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2021-03-10T13:43:11.401 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2021-03-10T13:43:11.402 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.402 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.402 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.402 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.402 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.403 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.403 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.403 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.403 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.403 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.404 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.404 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.404 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_PASSWORD": { 2021-03-10T13:43:11.404 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_PASSWORD", 2021-03-10T13:43:11.404 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.405 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.405 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.405 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2021-03-10T13:43:11.405 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.405 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.406 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.406 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.406 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.406 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.406 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.407 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.407 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_SSL_VERIFY": { 2021-03-10T13:43:11.407 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_SSL_VERIFY", 2021-03-10T13:43:11.407 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.407 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.408 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.408 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:11.408 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.408 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.408 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.409 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.409 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.409 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.409 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.409 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.410 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_URL": { 2021-03-10T13:43:11.410 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_URL", 2021-03-10T13:43:11.410 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.410 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.411 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.411 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.411 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.411 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.411 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.412 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.412 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.412 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.412 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.412 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.413 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_USERNAME": { 2021-03-10T13:43:11.413 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_USERNAME", 2021-03-10T13:43:11.413 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.413 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.413 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.414 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2021-03-10T13:43:11.414 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.414 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.414 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.414 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.415 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.415 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.415 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.415 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.415 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_UPDATE_DASHBOARDS": { 2021-03-10T13:43:11.416 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_UPDATE_DASHBOARDS", 2021-03-10T13:43:11.416 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.416 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.416 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.416 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.417 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.417 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.417 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.417 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.417 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.418 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.418 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.418 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.418 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ISCSI_API_SSL_VERIFICATION": { 2021-03-10T13:43:11.418 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ISCSI_API_SSL_VERIFICATION", 2021-03-10T13:43:11.419 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.419 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.419 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.420 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:11.420 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.420 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.420 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.420 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.421 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.421 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.421 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.421 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.421 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PROMETHEUS_API_HOST": { 2021-03-10T13:43:11.422 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PROMETHEUS_API_HOST", 2021-03-10T13:43:11.422 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.422 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.422 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.423 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.423 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.423 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.423 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.423 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.423 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.424 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.424 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.424 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.424 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2021-03-10T13:43:11.424 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2021-03-10T13:43:11.425 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.425 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.425 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.425 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.425 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.426 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.426 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.426 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.426 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.426 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.427 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.427 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.427 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2021-03-10T13:43:11.427 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2021-03-10T13:43:11.427 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.428 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.428 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.428 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.428 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.428 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.429 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.429 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.429 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.429 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.429 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.430 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.430 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2021-03-10T13:43:11.430 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2021-03-10T13:43:11.430 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.431 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.431 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.431 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:11.431 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.431 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.431 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.432 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.432 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.432 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.432 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.432 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.433 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2021-03-10T13:43:11.433 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2021-03-10T13:43:11.433 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.433 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.433 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.434 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:11.434 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.434 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.434 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.434 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.435 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.435 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.435 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.435 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.435 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2021-03-10T13:43:11.436 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2021-03-10T13:43:11.436 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.436 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.436 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.436 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.437 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.437 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.437 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.437 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.437 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.438 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.438 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.438 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.438 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2021-03-10T13:43:11.438 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2021-03-10T13:43:11.439 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.439 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.439 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.439 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.439 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.440 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.440 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.440 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.440 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.440 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.441 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.441 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.441 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2021-03-10T13:43:11.441 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2021-03-10T13:43:11.441 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.442 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.442 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.442 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.442 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.442 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.443 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.443 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.443 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.443 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.443 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.444 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.444 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_ENABLED": { 2021-03-10T13:43:11.444 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_ENABLED", 2021-03-10T13:43:11.444 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.444 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.445 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.445 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:11.445 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.445 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.445 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.446 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.446 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.446 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.446 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.446 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.447 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_EXCLUSION_LIST": { 2021-03-10T13:43:11.447 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_EXCLUSION_LIST", 2021-03-10T13:43:11.447 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.447 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.448 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.448 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2021-03-10T13:43:11.448 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.448 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.448 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.449 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.449 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.449 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.449 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.449 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.450 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_COMPLEXITY": { 2021-03-10T13:43:11.450 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_COMPLEXITY", 2021-03-10T13:43:11.450 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:11.450 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.450 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.451 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2021-03-10T13:43:11.451 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.451 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.451 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.451 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.452 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.452 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.452 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.452 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.452 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_LENGTH": { 2021-03-10T13:43:11.453 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_LENGTH", 2021-03-10T13:43:11.453 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:11.453 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.453 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.453 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8", 2021-03-10T13:43:11.453 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.454 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.454 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.454 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.454 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.454 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.455 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.455 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.455 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "REST_REQUESTS_TIMEOUT": { 2021-03-10T13:43:11.455 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "REST_REQUESTS_TIMEOUT", 2021-03-10T13:43:11.455 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:11.456 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.456 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.456 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "45", 2021-03-10T13:43:11.456 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.456 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.456 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.457 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.457 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.457 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.457 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.457 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.458 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ACCESS_KEY": { 2021-03-10T13:43:11.458 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ACCESS_KEY", 2021-03-10T13:43:11.458 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.458 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.458 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.459 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.459 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.459 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.459 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.459 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.459 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.460 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.460 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.460 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.460 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ADMIN_RESOURCE": { 2021-03-10T13:43:11.460 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ADMIN_RESOURCE", 2021-03-10T13:43:11.461 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.461 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.461 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.461 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2021-03-10T13:43:11.461 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.462 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.462 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.462 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.462 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.462 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.462 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.463 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.463 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_HOST": { 2021-03-10T13:43:11.463 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_HOST", 2021-03-10T13:43:11.463 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.463 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.464 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.464 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.464 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.464 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.464 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.465 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.465 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.465 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.465 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.465 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.466 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_PORT": { 2021-03-10T13:43:11.466 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_PORT", 2021-03-10T13:43:11.466 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:11.466 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.466 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.466 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "80", 2021-03-10T13:43:11.467 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.467 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.467 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.467 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.467 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.468 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.468 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.468 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.468 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SCHEME": { 2021-03-10T13:43:11.468 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SCHEME", 2021-03-10T13:43:11.469 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.469 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.469 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.469 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "http", 2021-03-10T13:43:11.469 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.469 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.470 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.470 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.470 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.470 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.470 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.471 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.471 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SECRET_KEY": { 2021-03-10T13:43:11.471 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SECRET_KEY", 2021-03-10T13:43:11.471 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.471 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.472 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.472 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.472 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.472 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.472 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.473 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.473 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.473 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.473 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.473 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.473 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SSL_VERIFY": { 2021-03-10T13:43:11.474 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SSL_VERIFY", 2021-03-10T13:43:11.474 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.474 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.474 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.475 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:11.475 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.475 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.475 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.475 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.475 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.476 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.476 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.476 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.476 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_USER_ID": { 2021-03-10T13:43:11.476 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_USER_ID", 2021-03-10T13:43:11.477 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.477 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.477 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.478 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.478 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.479 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.479 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.480 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.480 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.480 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.481 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.481 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.481 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_SPAN": { 2021-03-10T13:43:11.482 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_SPAN", 2021-03-10T13:43:11.482 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:11.483 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.483 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.484 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2021-03-10T13:43:11.484 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.484 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.484 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.485 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.485 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.485 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.485 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.485 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.486 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_1": { 2021-03-10T13:43:11.486 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_1", 2021-03-10T13:43:11.486 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:11.486 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.486 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.487 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2021-03-10T13:43:11.487 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.487 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.487 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.487 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.488 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.488 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.488 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.488 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.489 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_2": { 2021-03-10T13:43:11.489 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_2", 2021-03-10T13:43:11.489 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:11.489 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.489 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.490 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2021-03-10T13:43:11.490 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.490 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.490 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.490 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.491 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.491 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.491 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.491 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.491 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crt_file": { 2021-03-10T13:43:11.492 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crt_file", 2021-03-10T13:43:11.492 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.492 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.492 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.492 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.493 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.493 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.493 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.493 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.493 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.494 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.494 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.494 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.494 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug": { 2021-03-10T13:43:11.494 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "debug", 2021-03-10T13:43:11.495 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.495 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.495 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.495 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.495 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.496 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.496 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.496 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Enable/disable debug options", 2021-03-10T13:43:11.496 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.496 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.497 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.497 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.497 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "jwt_token_ttl": { 2021-03-10T13:43:11.497 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "jwt_token_ttl", 2021-03-10T13:43:11.497 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:11.498 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.498 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.498 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "28800", 2021-03-10T13:43:11.498 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.498 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.499 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.499 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.499 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.499 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.499 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.500 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.500 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2021-03-10T13:43:11.500 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2021-03-10T13:43:11.500 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.500 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.501 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.501 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.501 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.501 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.501 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.502 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.502 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.502 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.502 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.502 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.503 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:11.503 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:11.503 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.503 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.503 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.504 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.504 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.504 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.504 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.504 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.505 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.505 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.505 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.505 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.505 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.506 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.506 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.506 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.506 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.506 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.507 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.507 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:11.507 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:11.507 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.507 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.508 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.508 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.508 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.508 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.508 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.509 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.509 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.509 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.509 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.509 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.510 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:11.510 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:11.510 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.510 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.510 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.511 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:11.511 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.511 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.511 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.511 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.512 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.512 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.512 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.512 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.512 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.513 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.513 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.513 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.513 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.513 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.514 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.514 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:11.514 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:11.514 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.514 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.515 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.515 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.515 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.515 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.515 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.516 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.516 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.516 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.516 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.516 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.517 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2021-03-10T13:43:11.517 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2021-03-10T13:43:11.517 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.517 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.517 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.518 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.518 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.518 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.518 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.518 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.519 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.519 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.519 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.519 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.519 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2021-03-10T13:43:11.520 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2021-03-10T13:43:11.520 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.520 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.520 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.520 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "::", 2021-03-10T13:43:11.521 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.521 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.521 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.521 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.521 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.522 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.522 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.522 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.522 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2021-03-10T13:43:11.522 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2021-03-10T13:43:11.523 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:11.523 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.523 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.523 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8080", 2021-03-10T13:43:11.523 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.524 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.524 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.524 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.524 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.524 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.524 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.525 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.525 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2021-03-10T13:43:11.525 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2021-03-10T13:43:11.525 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.525 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.526 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.526 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:11.526 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.526 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.526 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.527 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.527 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.527 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.527 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.527 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.528 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl_server_port": { 2021-03-10T13:43:11.528 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl_server_port", 2021-03-10T13:43:11.528 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:11.528 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.528 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.529 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8443", 2021-03-10T13:43:11.529 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.529 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.529 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.529 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.530 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.530 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.530 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.530 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.531 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_behaviour": { 2021-03-10T13:43:11.531 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_behaviour", 2021-03-10T13:43:11.531 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.531 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.531 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.532 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "redirect", 2021-03-10T13:43:11.532 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.532 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.532 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.532 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.533 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "redirect" 2021-03-10T13:43:11.533 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.533 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.533 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.533 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.534 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.534 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.534 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_error_status_code": { 2021-03-10T13:43:11.534 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_error_status_code", 2021-03-10T13:43:11.534 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:11.535 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.535 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.535 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "500", 2021-03-10T13:43:11.535 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "400", 2021-03-10T13:43:11.535 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "599", 2021-03-10T13:43:11.536 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.536 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.536 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.536 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.536 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.537 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.537 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url_prefix": { 2021-03-10T13:43:11.537 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url_prefix", 2021-03-10T13:43:11.537 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.537 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.538 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.538 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.538 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.538 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.538 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.539 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.539 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.539 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.539 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.539 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.540 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2021-03-10T13:43:11.540 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2021-03-10T13:43:11.540 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.540 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.540 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.541 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.541 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.541 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.541 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.541 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.541 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.542 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.542 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.542 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.542 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.543 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.543 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:11.543 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "devicehealth", 2021-03-10T13:43:11.543 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:11.543 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:11.544 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:11.544 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enable_monitoring": { 2021-03-10T13:43:11.544 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enable_monitoring", 2021-03-10T13:43:11.544 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.544 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.544 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.545 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:11.545 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.545 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.545 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.545 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "monitor device health metrics", 2021-03-10T13:43:11.546 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.546 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.546 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.546 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.546 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:11.547 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:11.547 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.547 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.547 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.547 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.548 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.548 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.548 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.548 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.548 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.549 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.549 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.549 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.549 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.549 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.550 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.550 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.550 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.550 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.550 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.551 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:11.551 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:11.551 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.551 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.551 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.552 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.552 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.552 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.552 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.552 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.553 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.553 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.553 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.553 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.553 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:11.554 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:11.554 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.554 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.554 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.555 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:11.555 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.555 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.555 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.555 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.556 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.556 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.556 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.556 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.556 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.557 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.557 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.557 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.557 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.557 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.557 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.558 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:11.558 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:11.558 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.558 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.559 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.559 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.559 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.559 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.559 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.560 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.560 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.560 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.560 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.560 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.561 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mark_out_threshold": { 2021-03-10T13:43:11.561 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mark_out_threshold", 2021-03-10T13:43:11.561 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:43:11.561 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.561 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.562 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2419200", 2021-03-10T13:43:11.562 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.562 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.562 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.562 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically mark OSD if it may fail before this long", 2021-03-10T13:43:11.563 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.563 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.563 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.563 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.563 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_name": { 2021-03-10T13:43:11.564 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_name", 2021-03-10T13:43:11.564 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.564 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.564 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.564 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "device_health_metrics", 2021-03-10T13:43:11.565 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.565 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.565 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.565 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name of pool in which to store device health metrics", 2021-03-10T13:43:11.565 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.566 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.566 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.566 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.566 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retention_period": { 2021-03-10T13:43:11.566 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retention_period", 2021-03-10T13:43:11.567 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:43:11.567 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.567 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.567 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15552000", 2021-03-10T13:43:11.567 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.568 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.568 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.568 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain device health metrics", 2021-03-10T13:43:11.568 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.568 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.569 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.569 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.569 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_frequency": { 2021-03-10T13:43:11.569 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_frequency", 2021-03-10T13:43:11.569 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:43:11.570 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.570 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.570 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2021-03-10T13:43:11.570 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.570 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.571 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.571 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to scrape device health metrics", 2021-03-10T13:43:11.571 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.571 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.571 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.572 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.572 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "self_heal": { 2021-03-10T13:43:11.572 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "self_heal", 2021-03-10T13:43:11.572 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.572 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.573 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.573 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:11.573 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.573 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.573 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.574 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "preemptively heal cluster around devices that may fail", 2021-03-10T13:43:11.574 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.574 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.574 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.574 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.575 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2021-03-10T13:43:11.575 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2021-03-10T13:43:11.575 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:43:11.575 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.575 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.576 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2021-03-10T13:43:11.576 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.576 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.576 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.576 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and check device health", 2021-03-10T13:43:11.577 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.577 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.577 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.577 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.577 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_threshold": { 2021-03-10T13:43:11.578 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_threshold", 2021-03-10T13:43:11.578 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:43:11.578 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.578 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.578 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7257600", 2021-03-10T13:43:11.579 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.579 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.579 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.579 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise health warning if OSD may fail before this long", 2021-03-10T13:43:11.579 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.580 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.580 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.580 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.580 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.581 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.581 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:11.581 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "diskprediction_local", 2021-03-10T13:43:11.581 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:11.581 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:11.582 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:11.582 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:11.582 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:11.582 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.582 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.583 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.583 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.583 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.583 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.583 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.584 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.584 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.584 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.584 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.584 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.585 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.585 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.585 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.585 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.585 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.586 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.586 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.586 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:11.586 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:11.586 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.587 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.587 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.587 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.587 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.587 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.588 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.588 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.588 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.588 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.588 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.589 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.589 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:11.589 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:11.589 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.589 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.590 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.590 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:11.590 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.590 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.590 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.591 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.591 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.591 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.591 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.591 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.592 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.592 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.592 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.592 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.592 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.593 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.593 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.593 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:11.593 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:11.593 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.594 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.594 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.594 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.594 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.594 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.595 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.595 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.595 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.595 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.595 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.596 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.596 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predict_interval": { 2021-03-10T13:43:11.596 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predict_interval", 2021-03-10T13:43:11.596 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.596 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.597 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.597 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2021-03-10T13:43:11.597 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.597 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.597 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.598 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.598 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.598 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.598 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.598 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.599 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predictor_model": { 2021-03-10T13:43:11.599 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predictor_model", 2021-03-10T13:43:11.599 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.599 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.599 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.600 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "prophetstor", 2021-03-10T13:43:11.600 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.600 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.600 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.600 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.601 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.601 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.601 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.601 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.602 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2021-03-10T13:43:11.602 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2021-03-10T13:43:11.602 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.602 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.602 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.603 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2021-03-10T13:43:11.603 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.603 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.603 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.603 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.604 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.604 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.604 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.604 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.604 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.605 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.605 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:11.605 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "influx", 2021-03-10T13:43:11.605 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": false, 2021-03-10T13:43:11.605 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "influxdb python module not found", 2021-03-10T13:43:11.606 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:11.606 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "batch_size": { 2021-03-10T13:43:11.606 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "batch_size", 2021-03-10T13:43:11.606 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.606 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.607 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.607 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5000", 2021-03-10T13:43:11.607 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.607 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.607 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.608 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.608 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.608 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.608 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.608 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.609 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "database": { 2021-03-10T13:43:11.609 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "database", 2021-03-10T13:43:11.609 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.609 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.609 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.610 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph", 2021-03-10T13:43:11.610 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.610 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.610 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.610 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.611 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.611 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.611 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.611 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.611 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "hostname": { 2021-03-10T13:43:11.612 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "hostname", 2021-03-10T13:43:11.612 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.612 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.612 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.612 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:43:11.613 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.613 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.613 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.613 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.614 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.614 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.614 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.614 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.614 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T13:43:11.615 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T13:43:11.615 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.615 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.615 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.615 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "30", 2021-03-10T13:43:11.615 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.616 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.616 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.616 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.616 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.616 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.617 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.617 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.617 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:11.617 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:11.617 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.618 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.618 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.618 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.618 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.618 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.619 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.619 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.619 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.619 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.619 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.620 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.620 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.620 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.620 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.620 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.621 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.621 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.621 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.621 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:11.621 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:11.622 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.622 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.622 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.622 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.622 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.623 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.623 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.623 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.623 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.623 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.624 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.624 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.624 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:11.624 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:11.624 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.625 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.625 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.625 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:11.625 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.625 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.626 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.626 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.626 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.626 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.626 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.627 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.627 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.627 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.627 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.627 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.628 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.628 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.628 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.628 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:11.628 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:11.628 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.629 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.629 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.629 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.629 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.629 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.630 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.630 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.630 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.630 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.631 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.631 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.631 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2021-03-10T13:43:11.631 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2021-03-10T13:43:11.631 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.632 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.632 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.632 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:43:11.632 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.632 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.633 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.633 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.633 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.633 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.633 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.634 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.634 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "port": { 2021-03-10T13:43:11.634 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "port", 2021-03-10T13:43:11.634 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.634 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.635 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.635 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8086", 2021-03-10T13:43:11.635 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.635 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.635 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.635 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.636 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.636 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.636 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.636 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.636 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2021-03-10T13:43:11.637 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2021-03-10T13:43:11.637 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.637 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.637 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.637 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "false", 2021-03-10T13:43:11.638 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.638 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.638 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.638 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.638 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.639 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.639 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.639 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.639 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "threads": { 2021-03-10T13:43:11.639 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "threads", 2021-03-10T13:43:11.640 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.640 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.640 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.640 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2021-03-10T13:43:11.640 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.641 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.641 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.641 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.641 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.641 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.642 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.642 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.642 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2021-03-10T13:43:11.642 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2021-03-10T13:43:11.642 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.643 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.643 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.643 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:43:11.643 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.643 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.644 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.644 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.644 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.644 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.644 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.645 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.645 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "verify_ssl": { 2021-03-10T13:43:11.645 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "verify_ssl", 2021-03-10T13:43:11.645 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.645 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.646 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.646 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "true", 2021-03-10T13:43:11.646 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.646 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.646 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.646 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.647 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.647 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.647 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.647 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.648 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.648 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.648 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:11.648 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "insights", 2021-03-10T13:43:11.648 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:11.649 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:11.649 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:11.649 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:11.649 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:11.649 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.650 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.650 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.650 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.650 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.650 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.651 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.651 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.651 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.651 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.651 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.652 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.652 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.652 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.652 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.652 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.652 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.653 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.653 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.653 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:11.653 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:11.654 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.654 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.654 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.654 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.654 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.655 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.655 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.655 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.655 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.655 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.656 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.656 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.656 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:11.656 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:11.656 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.656 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.657 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.657 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:11.657 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.657 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.657 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.658 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.658 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.658 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.658 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.659 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.659 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.659 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.659 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.659 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.660 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.660 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.660 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.660 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:11.660 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:11.661 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.661 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.661 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.661 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.661 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.661 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.662 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.662 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.662 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.662 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.662 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.663 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.663 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.663 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.663 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:11.663 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "iostat", 2021-03-10T13:43:11.664 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:11.664 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:11.664 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:11.664 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:11.664 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:11.665 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.665 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.665 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.665 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.665 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.666 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.666 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.666 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.666 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.666 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.667 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.667 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.667 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.667 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.667 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.668 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.668 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.668 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.668 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.668 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:11.669 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:11.669 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.669 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.669 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.669 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.670 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.670 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.670 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.670 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.670 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.670 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.671 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.671 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.671 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:11.671 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:11.671 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.672 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.672 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.672 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:11.672 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.672 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.673 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.673 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.673 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.673 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.673 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.674 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.674 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.674 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.674 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.674 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.675 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.675 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.675 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.675 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:11.675 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:11.676 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.676 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.676 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.676 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.676 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.677 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.677 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.677 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.677 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.677 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.678 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.678 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.678 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.678 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.679 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:11.679 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "k8sevents", 2021-03-10T13:43:11.679 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:11.679 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:11.679 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:11.680 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ceph_event_retention_days": { 2021-03-10T13:43:11.680 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ceph_event_retention_days", 2021-03-10T13:43:11.680 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:11.680 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.680 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.681 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2021-03-10T13:43:11.681 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.681 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.681 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.681 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Days to hold ceph event information within local cache", 2021-03-10T13:43:11.682 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.682 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.682 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.682 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.682 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "config_check_secs": { 2021-03-10T13:43:11.683 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "config_check_secs", 2021-03-10T13:43:11.683 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:11.683 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.683 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.683 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2021-03-10T13:43:11.684 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "10", 2021-03-10T13:43:11.684 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.684 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.684 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "interval (secs) to check for cluster configuration changes", 2021-03-10T13:43:11.684 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.684 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.685 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.685 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.685 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:11.685 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:11.685 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.686 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.686 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.686 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.686 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.686 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.687 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.687 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.687 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.687 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.687 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.688 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.688 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.688 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.688 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.689 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.689 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.689 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.689 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.690 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:11.690 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:11.690 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.690 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.690 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.691 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.691 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.691 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.691 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.692 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.692 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.692 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.692 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.692 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.693 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:11.693 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:11.693 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.693 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.693 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.693 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:11.694 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.694 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.694 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.694 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.694 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.695 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.695 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.695 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.695 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.696 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.696 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.696 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.696 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.696 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.697 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.697 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:11.697 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:11.697 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.697 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.698 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.698 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.698 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.698 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.698 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.699 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.699 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.699 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.699 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.699 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.700 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.700 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.700 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:11.700 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "localpool", 2021-03-10T13:43:11.700 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:11.701 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:11.701 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:11.701 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "failure_domain": { 2021-03-10T13:43:11.701 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "failure_domain", 2021-03-10T13:43:11.701 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.702 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.702 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.702 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "host", 2021-03-10T13:43:11.702 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.702 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.703 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.703 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "failure domain for any created local pool", 2021-03-10T13:43:11.703 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.703 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.703 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.704 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.704 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:11.704 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:11.704 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.704 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.705 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.705 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.705 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.705 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.705 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.706 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.706 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.706 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.706 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.706 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.707 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.707 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.707 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.707 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.707 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.708 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.708 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.708 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:11.708 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:11.708 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.709 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.709 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.709 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.709 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.709 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.710 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.710 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.710 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.710 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.710 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.711 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.711 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:11.711 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:11.711 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.711 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.712 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.712 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:11.712 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.712 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.712 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.713 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.713 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.713 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.713 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.714 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.714 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.714 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.714 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.714 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.715 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.715 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.715 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.715 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:11.715 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:11.716 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.716 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.716 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.716 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.716 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.716 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.717 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.717 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.717 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.717 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.717 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.718 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.718 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_size": { 2021-03-10T13:43:11.718 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_size", 2021-03-10T13:43:11.718 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:11.718 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.719 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.719 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.719 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.719 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.719 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.720 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default min_size for any created local pool", 2021-03-10T13:43:11.720 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.720 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.720 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.720 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.721 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_rep": { 2021-03-10T13:43:11.721 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "num_rep", 2021-03-10T13:43:11.721 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:11.721 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.721 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.722 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "3", 2021-03-10T13:43:11.722 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.722 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.722 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.722 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default replica count for any created local pool", 2021-03-10T13:43:11.723 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.723 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.723 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.723 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.723 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_num": { 2021-03-10T13:43:11.724 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_num", 2021-03-10T13:43:11.724 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:11.724 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.724 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.724 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "128", 2021-03-10T13:43:11.725 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.725 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.725 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.725 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default pg_num for any created local pool", 2021-03-10T13:43:11.725 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.726 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.726 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.726 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.726 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "prefix": { 2021-03-10T13:43:11.726 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prefix", 2021-03-10T13:43:11.727 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.727 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.727 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.727 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.727 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.728 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.728 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.728 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name prefix for any created local pool", 2021-03-10T13:43:11.728 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.728 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.729 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.729 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.729 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "subtree": { 2021-03-10T13:43:11.729 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "subtree", 2021-03-10T13:43:11.729 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.730 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.730 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.730 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "rack", 2021-03-10T13:43:11.730 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.730 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.731 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.731 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "CRUSH level for which to create a local pool", 2021-03-10T13:43:11.731 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.731 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.731 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.732 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.732 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.732 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.732 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:11.732 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2021-03-10T13:43:11.733 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:11.733 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:11.733 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:11.733 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:11.733 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:11.734 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.734 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.734 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.734 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.734 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.735 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.735 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.735 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.735 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.735 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.736 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.736 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.736 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.736 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.736 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.737 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.737 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.737 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.737 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.737 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:11.738 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:11.738 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.738 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.738 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.738 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.739 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.739 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.739 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.739 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.739 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.740 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.740 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.740 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.740 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:11.740 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:11.741 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.741 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.741 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.741 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:11.741 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.742 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.742 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.742 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.742 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.742 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.743 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.743 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.743 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.743 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.743 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.744 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.744 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.744 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.744 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.744 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:11.745 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:11.745 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.745 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.745 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.745 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.746 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.746 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.746 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.746 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.746 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.747 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.747 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.747 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.747 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator": { 2021-03-10T13:43:11.747 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2021-03-10T13:43:11.748 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.748 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.748 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.748 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:43:11.748 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.749 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.749 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.749 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2021-03-10T13:43:11.749 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rook", 2021-03-10T13:43:11.749 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "test_orchestrator" 2021-03-10T13:43:11.749 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.750 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Orchestrator backend", 2021-03-10T13:43:11.750 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.750 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.750 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.751 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.751 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.751 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.751 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:11.751 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "osd_support", 2021-03-10T13:43:11.751 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:11.752 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:11.752 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:11.752 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:11.752 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:11.752 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.753 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.753 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.753 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.753 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.753 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.754 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.754 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.754 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.754 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.754 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.755 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.755 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.755 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.755 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.755 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.756 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.756 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.756 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.756 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:11.756 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:11.757 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.757 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.757 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.757 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.757 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.758 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.758 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.758 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.758 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.758 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.759 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.759 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.759 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:11.759 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:11.759 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.760 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.760 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.760 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:11.760 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.760 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.761 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.761 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.761 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.761 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.761 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.762 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.762 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.762 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.762 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.762 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.763 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.763 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.763 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.763 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:11.763 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:11.764 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.764 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.764 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.764 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.764 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.765 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.765 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.765 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.765 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.765 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.766 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.766 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.766 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.766 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.767 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:11.767 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_autoscaler", 2021-03-10T13:43:11.767 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:11.767 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:11.767 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:11.768 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:11.768 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:11.768 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.768 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.768 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.769 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.769 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.769 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.769 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.769 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.770 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.770 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.770 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.770 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.770 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.771 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.771 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.771 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.771 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.771 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.772 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.772 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:11.772 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:11.772 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.773 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.773 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.773 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.773 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.773 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.773 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.774 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.774 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.774 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.774 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.775 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.775 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:11.775 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:11.775 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.775 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.776 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.776 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:11.776 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.776 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.776 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.777 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.777 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.777 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.777 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.777 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.778 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.778 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.778 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.778 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.778 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.779 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.779 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.779 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:11.779 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:11.779 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.780 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.780 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.780 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.780 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.780 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.780 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.781 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.781 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.781 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.781 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.781 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.782 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2021-03-10T13:43:11.782 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2021-03-10T13:43:11.782 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.782 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.782 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.783 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2021-03-10T13:43:11.783 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.783 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.783 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.783 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.784 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.784 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.784 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.784 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.784 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.784 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.785 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:11.785 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "progress", 2021-03-10T13:43:11.785 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:11.785 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:11.785 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:11.786 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:11.786 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:11.786 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.786 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.786 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.787 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.787 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.787 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.787 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.787 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.787 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.788 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.788 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.788 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.788 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.788 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.789 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.789 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.789 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.789 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.789 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.789 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:11.790 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:11.790 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.790 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.790 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.791 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.791 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.791 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.791 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.791 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.792 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.792 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.792 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.792 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.792 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:11.792 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:11.793 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.793 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.793 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.793 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:11.793 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.794 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.794 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.794 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.794 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.794 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.795 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.795 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.795 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.795 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.795 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.796 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.796 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.796 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.796 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.796 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:11.797 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:11.797 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.797 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.797 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.797 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.797 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.798 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.798 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.798 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.798 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.798 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.799 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.799 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.799 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max_completed_events": { 2021-03-10T13:43:11.799 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "max_completed_events", 2021-03-10T13:43:11.799 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:11.800 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.800 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.800 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "50", 2021-03-10T13:43:11.800 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.800 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.801 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.801 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "number of past completed events to remember", 2021-03-10T13:43:11.801 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.801 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.801 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.801 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.802 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "persist_interval": { 2021-03-10T13:43:11.802 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "persist_interval", 2021-03-10T13:43:11.802 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:43:11.802 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.802 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.803 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2021-03-10T13:43:11.803 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.803 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.803 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.803 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to persist completed events", 2021-03-10T13:43:11.804 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.804 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.804 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.804 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.804 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.804 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.805 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:11.805 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prometheus", 2021-03-10T13:43:11.805 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:11.805 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:11.805 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:11.806 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:11.806 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:11.806 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.806 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.806 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.807 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.807 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.807 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.807 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.807 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.807 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.808 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.808 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.808 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.808 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.808 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.809 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.809 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.809 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.809 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.809 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.809 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:11.810 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:11.810 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.810 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.810 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.811 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.811 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.811 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.811 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.811 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.812 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.812 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.812 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.812 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.812 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:11.812 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:11.813 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.813 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.813 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.813 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:11.814 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.814 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.814 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.814 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.814 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.815 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.815 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.815 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.815 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.815 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.816 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.816 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.816 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.816 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.816 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.817 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:11.817 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:11.817 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.817 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.817 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.817 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.818 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.818 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.818 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.818 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.818 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.819 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.819 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.819 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.819 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools": { 2021-03-10T13:43:11.819 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools", 2021-03-10T13:43:11.819 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.820 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.820 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.820 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.820 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.820 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.821 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.821 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.821 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.821 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.821 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.822 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.822 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools_refresh_interval": { 2021-03-10T13:43:11.822 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools_refresh_interval", 2021-03-10T13:43:11.822 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.822 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.822 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.823 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.823 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.823 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.823 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.823 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.824 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.824 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.824 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.824 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.824 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_interval": { 2021-03-10T13:43:11.824 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_interval", 2021-03-10T13:43:11.825 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.825 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.825 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.825 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.825 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.826 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.826 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.826 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.826 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.826 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.827 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.827 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.827 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2021-03-10T13:43:11.827 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2021-03-10T13:43:11.827 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.828 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.828 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.828 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.828 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.828 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.829 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.829 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.829 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.829 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.829 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.829 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.830 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2021-03-10T13:43:11.830 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2021-03-10T13:43:11.830 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.830 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.830 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.831 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.831 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.831 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.831 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.831 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.832 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.832 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.832 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.832 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.832 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.833 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.833 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:11.833 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_support", 2021-03-10T13:43:11.833 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:11.833 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:11.833 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:11.834 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:11.834 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:11.834 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.834 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.834 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.835 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.835 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.835 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.835 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.835 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.836 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.836 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.836 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.836 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.836 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.836 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.837 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.837 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.837 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.837 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.837 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.838 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:11.838 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:11.838 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.838 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.838 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.839 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.839 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.839 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.839 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.839 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.840 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.840 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.840 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.840 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.840 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:11.840 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:11.841 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.841 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.841 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.841 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:11.841 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.841 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.842 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.842 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.842 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.842 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.842 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.843 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.843 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.843 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.843 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.843 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.844 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.844 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.844 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.844 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:11.844 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:11.845 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.845 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.845 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.845 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.845 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.845 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.846 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.846 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.846 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.846 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.846 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.847 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.847 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mirror_snapshot_schedule": { 2021-03-10T13:43:11.847 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mirror_snapshot_schedule", 2021-03-10T13:43:11.847 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.847 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.848 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.848 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.848 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.848 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.848 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.848 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.849 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.849 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.849 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.849 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.849 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "trash_purge_schedule": { 2021-03-10T13:43:11.850 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "trash_purge_schedule", 2021-03-10T13:43:11.850 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.850 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.850 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.850 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.850 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.851 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.851 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.851 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.851 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.851 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.852 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.852 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.852 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.852 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.852 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:11.852 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "restful", 2021-03-10T13:43:11.853 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:11.853 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:11.853 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:11.853 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2021-03-10T13:43:11.853 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2021-03-10T13:43:11.854 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.854 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.854 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.854 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.854 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.854 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.855 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.855 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.855 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.855 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.855 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.856 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.856 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:11.856 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:11.856 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.856 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.856 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.857 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.857 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.857 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.857 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.857 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.858 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.858 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.858 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.858 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.858 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.859 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.859 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.859 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.859 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.859 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.860 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.860 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:11.860 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:11.860 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.860 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.861 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.861 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.861 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.861 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.861 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.861 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.862 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.862 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.862 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.862 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.862 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:11.863 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:11.863 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.863 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.863 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.863 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:11.863 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.864 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.864 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.864 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.864 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.864 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.865 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.865 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.865 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.865 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.865 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.866 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.866 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.866 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.866 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.866 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:11.867 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:11.867 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.867 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.867 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.867 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.867 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.868 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.868 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.868 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.868 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.868 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.869 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.869 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.869 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2021-03-10T13:43:11.869 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2021-03-10T13:43:11.869 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.870 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.870 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.870 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.870 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.870 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.871 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.871 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.871 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.871 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.871 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.872 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.872 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2021-03-10T13:43:11.872 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2021-03-10T13:43:11.872 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.872 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.872 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.873 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.873 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.873 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.873 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.873 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.874 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.874 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.874 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.874 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.874 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.875 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.875 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:11.875 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rook", 2021-03-10T13:43:11.875 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:11.875 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:11.876 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:11.876 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:11.876 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:11.876 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.876 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.877 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.877 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.877 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.877 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.877 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.877 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.878 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.878 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.878 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.878 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.878 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.879 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.879 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.879 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.879 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.879 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.880 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.880 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:11.880 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:11.880 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.880 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.880 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.881 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.881 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.881 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.881 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.881 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.882 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.882 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.882 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.882 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.882 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:11.883 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:11.883 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.883 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.883 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.883 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:11.884 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.884 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.884 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.884 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.884 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.885 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.885 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.885 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.885 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.885 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.886 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.886 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.886 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.886 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.886 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.887 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:11.887 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:11.887 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.887 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.887 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.887 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.888 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.888 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.888 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.888 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.888 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.889 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.889 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.889 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.889 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.889 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.890 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:11.890 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "selftest", 2021-03-10T13:43:11.890 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:11.890 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:11.890 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:11.891 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:11.891 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:11.891 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.891 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.891 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.892 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.892 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.892 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.892 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.892 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.893 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.893 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.893 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.893 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.893 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.894 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.894 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.894 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.894 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.894 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.895 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.895 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:11.895 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:11.895 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.895 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.896 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.896 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.896 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.896 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.896 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.897 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.897 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.897 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.897 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.897 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.898 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:11.898 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:11.898 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.898 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.898 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.899 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:11.899 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.899 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.899 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.899 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.899 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.900 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.900 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.900 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.900 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.900 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.901 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.901 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.901 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.901 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.901 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.902 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:11.902 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:11.902 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.902 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.902 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.903 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.903 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.903 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.903 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.903 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.904 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.904 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.904 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.904 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.904 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption1": { 2021-03-10T13:43:11.905 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption1", 2021-03-10T13:43:11.905 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.905 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.905 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.905 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.905 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.906 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.906 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.906 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.906 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.906 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.907 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.907 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.907 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption2": { 2021-03-10T13:43:11.907 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption2", 2021-03-10T13:43:11.907 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.907 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.908 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.908 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "xyz", 2021-03-10T13:43:11.908 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.908 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.908 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.909 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.909 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.909 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.909 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.909 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.910 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption1": { 2021-03-10T13:43:11.910 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption1", 2021-03-10T13:43:11.910 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.910 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.910 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.911 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.911 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.911 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.911 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.911 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.912 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.912 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.912 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.912 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.912 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption2": { 2021-03-10T13:43:11.913 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption2", 2021-03-10T13:43:11.913 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:11.913 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.913 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.913 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.914 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.914 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.914 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.914 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.914 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.915 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.915 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.915 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.915 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption3": { 2021-03-10T13:43:11.915 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption3", 2021-03-10T13:43:11.915 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2021-03-10T13:43:11.916 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.916 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.916 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.916 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.916 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.917 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.917 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.917 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.917 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.917 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.917 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.918 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption4": { 2021-03-10T13:43:11.918 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption4", 2021-03-10T13:43:11.918 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.918 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.919 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.919 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.919 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.919 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.919 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.919 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.920 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.920 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.920 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.920 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.920 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption5": { 2021-03-10T13:43:11.921 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption5", 2021-03-10T13:43:11.921 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.921 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.921 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.921 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.921 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.922 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.922 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.922 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.922 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.922 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.923 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.923 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.923 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption6": { 2021-03-10T13:43:11.923 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption6", 2021-03-10T13:43:11.923 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.924 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.924 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.924 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:11.924 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.924 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.924 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.925 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.925 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.925 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.925 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.925 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.926 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testkey": { 2021-03-10T13:43:11.926 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testkey", 2021-03-10T13:43:11.926 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.926 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.926 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.927 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.927 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.927 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.927 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.927 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.928 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.928 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.928 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.928 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.928 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testlkey": { 2021-03-10T13:43:11.929 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testlkey", 2021-03-10T13:43:11.929 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.929 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.929 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.929 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.930 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.930 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.930 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.930 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.930 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.930 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.931 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.931 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.931 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testnewline": { 2021-03-10T13:43:11.931 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testnewline", 2021-03-10T13:43:11.931 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.932 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.932 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.932 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.932 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.932 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.933 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.933 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.933 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.933 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.933 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.934 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.934 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.934 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.934 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:11.934 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "status", 2021-03-10T13:43:11.935 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:11.935 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:11.935 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:11.935 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:11.935 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:11.936 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.936 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.936 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.936 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.936 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.936 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.937 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.937 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.937 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.937 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.937 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.938 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.938 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.938 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.938 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.938 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.938 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.939 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.939 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.939 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:11.939 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:11.939 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.940 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.940 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.940 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.940 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.940 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.940 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.941 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.941 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.941 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.941 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.941 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.942 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:11.942 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:11.942 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.942 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.942 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.943 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:11.943 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.943 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.943 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.943 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.944 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.944 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.944 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.944 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.944 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.944 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.945 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.945 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.945 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.945 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.945 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.946 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:11.946 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:11.946 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.946 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.946 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.947 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.947 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.947 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.947 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.947 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.947 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.948 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.948 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.948 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.948 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.948 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.949 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:11.949 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telegraf", 2021-03-10T13:43:11.949 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:11.949 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:11.949 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:11.950 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "address": { 2021-03-10T13:43:11.950 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "address", 2021-03-10T13:43:11.950 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.950 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.950 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.950 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "unixgram:///tmp/telegraf.sock", 2021-03-10T13:43:11.951 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.951 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.951 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.951 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.951 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.952 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.952 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.952 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.952 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T13:43:11.952 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T13:43:11.952 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:43:11.953 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.953 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.953 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15", 2021-03-10T13:43:11.953 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.953 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.954 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.954 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.954 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.954 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.954 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.955 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.955 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:11.955 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:11.955 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.955 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.955 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.956 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.956 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.956 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.956 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.956 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.957 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.957 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.957 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.957 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.957 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.957 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.958 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.958 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.958 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.958 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.958 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.959 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:11.959 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:11.959 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.959 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.959 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.960 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.960 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.960 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.960 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.960 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.960 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.961 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.961 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.961 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.961 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:11.961 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:11.962 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.962 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.962 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.962 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:11.962 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.962 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.963 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:11.963 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:11.963 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:11.963 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:11.963 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:11.964 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:11.964 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:11.964 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:11.964 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.964 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.964 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.965 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.965 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.965 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:11.965 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:11.965 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.966 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.966 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.966 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.966 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.966 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.967 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.967 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.967 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.967 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.967 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.967 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.968 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:11.968 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.968 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:11.968 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telemetry", 2021-03-10T13:43:11.968 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:11.969 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:11.969 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:11.969 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_basic": { 2021-03-10T13:43:11.969 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_basic", 2021-03-10T13:43:11.969 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.969 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.970 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.970 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:11.970 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.970 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.970 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.971 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Share basic cluster information (size, version)", 2021-03-10T13:43:11.971 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.971 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.971 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.971 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.972 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_crash": { 2021-03-10T13:43:11.972 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_crash", 2021-03-10T13:43:11.972 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.972 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.972 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.973 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:11.973 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.973 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.973 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.973 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.973 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.974 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.974 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.974 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.974 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_device": { 2021-03-10T13:43:11.974 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_device", 2021-03-10T13:43:11.975 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.975 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.975 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.975 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:11.975 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.975 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.976 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.976 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.976 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.976 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.976 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.977 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.977 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_ident": { 2021-03-10T13:43:11.977 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_ident", 2021-03-10T13:43:11.977 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.977 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.978 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.978 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.978 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.978 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.978 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.979 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.979 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.979 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.979 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.979 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.980 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "contact": { 2021-03-10T13:43:11.980 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "contact", 2021-03-10T13:43:11.980 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.980 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.980 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.980 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:43:11.981 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.981 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.981 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.981 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.981 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.982 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.982 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.982 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.982 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "description": { 2021-03-10T13:43:11.982 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "description", 2021-03-10T13:43:11.983 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.983 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.983 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.983 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:43:11.983 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.984 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.984 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.984 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.984 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.984 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.985 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.985 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.985 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_url": { 2021-03-10T13:43:11.985 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_url", 2021-03-10T13:43:11.985 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.985 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.986 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.986 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/device", 2021-03-10T13:43:11.986 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.986 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.986 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.987 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.987 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.987 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.987 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.987 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.988 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enabled": { 2021-03-10T13:43:11.988 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enabled", 2021-03-10T13:43:11.988 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.988 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.988 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.988 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.989 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.989 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.989 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.989 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.989 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.990 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.990 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.990 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.990 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T13:43:11.990 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T13:43:11.991 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:11.991 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.991 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.991 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "24", 2021-03-10T13:43:11.991 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "8", 2021-03-10T13:43:11.991 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.992 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.992 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.992 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.992 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.992 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.993 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.993 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_opt_revision": { 2021-03-10T13:43:11.993 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "last_opt_revision", 2021-03-10T13:43:11.993 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:11.993 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.994 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.994 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1", 2021-03-10T13:43:11.994 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.994 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.994 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.995 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.995 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.995 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.995 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.995 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.995 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "leaderboard": { 2021-03-10T13:43:11.996 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "leaderboard", 2021-03-10T13:43:11.996 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:11.996 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.996 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:11.996 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:11.997 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.997 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:11.997 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:11.997 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:11.997 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:11.997 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:11.998 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:11.998 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:11.998 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:11.998 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:11.998 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:11.999 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:11.999 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:11.999 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:11.999 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:11.999 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:12.000 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:12.000 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:12.000 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:12.000 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:12.000 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:12.000 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:12.001 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:12.001 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:12.001 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:12.001 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:12.001 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:12.002 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:12.002 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:12.002 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:12.002 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:12.002 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:12.002 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:12.003 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:12.003 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:12.003 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:12.003 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:12.003 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:12.004 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:12.004 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:12.004 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:12.004 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:12.004 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:12.004 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:12.005 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:12.005 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:12.005 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:12.005 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:12.005 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:12.006 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:12.006 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:12.006 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:12.006 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:12.006 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:12.006 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:12.007 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:12.007 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:12.007 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:12.007 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:12.007 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:12.008 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:12.008 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:12.008 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:12.008 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:12.008 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:12.009 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:12.009 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:12.009 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:12.009 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:12.009 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:12.009 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:12.010 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:12.010 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:12.010 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:12.010 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:12.010 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:12.011 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:12.011 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:12.011 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "organization": { 2021-03-10T13:43:12.011 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "organization", 2021-03-10T13:43:12.011 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:12.012 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:12.012 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:12.012 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:43:12.012 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:12.012 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:12.013 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:12.013 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:12.013 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:12.013 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:12.013 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:12.014 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:12.014 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "proxy": { 2021-03-10T13:43:12.014 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "proxy", 2021-03-10T13:43:12.014 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:12.014 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:12.014 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:12.015 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:43:12.015 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:12.015 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:12.015 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:12.015 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:12.016 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:12.016 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:12.016 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:12.016 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:12.016 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url": { 2021-03-10T13:43:12.017 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url", 2021-03-10T13:43:12.017 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:12.017 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:12.017 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:12.017 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/report", 2021-03-10T13:43:12.017 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:12.018 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:12.018 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:12.018 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:12.018 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:12.018 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:12.019 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:12.019 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:12.019 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:12.019 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:12.019 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:12.019 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "test_orchestrator", 2021-03-10T13:43:12.020 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:12.020 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:12.020 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:12.020 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:12.020 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:12.021 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:12.021 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:12.021 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:12.021 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:12.021 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:12.021 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:12.022 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:12.022 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:12.022 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:12.022 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:12.022 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:12.023 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:12.023 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:12.023 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:12.023 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:12.023 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:12.024 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:12.024 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:12.024 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:12.024 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:12.024 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:12.024 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:12.025 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:12.025 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:12.025 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:12.025 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:12.025 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:12.026 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:12.026 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:12.026 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:12.026 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:12.026 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:12.026 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:12.027 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:12.027 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:12.027 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:12.027 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:12.027 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:12.028 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:12.028 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:12.028 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:12.028 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:12.028 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:12.029 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:12.029 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:12.029 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:12.029 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:12.029 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:12.030 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:12.030 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:12.030 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:12.030 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:12.030 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:12.030 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:12.031 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:12.031 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:12.031 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:12.031 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:12.031 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:12.032 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:12.032 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:12.032 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:12.032 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:12.032 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:12.032 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:12.033 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:12.033 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:12.033 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:12.033 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:12.033 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:12.034 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:12.034 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "volumes", 2021-03-10T13:43:12.034 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:12.034 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:12.034 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:12.035 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:12.035 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:12.035 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:12.035 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:12.035 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:12.036 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:12.036 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:12.036 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:12.036 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:12.036 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:12.036 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:12.037 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:12.037 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:12.037 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:12.037 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:12.037 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:12.037 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:12.038 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:12.038 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:12.038 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:12.038 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:12.038 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:12.039 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:12.039 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:12.039 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:12.039 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:12.039 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:12.040 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:12.040 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:12.040 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:12.040 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:12.040 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:12.040 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:12.041 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:12.041 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:12.041 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:12.041 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:12.041 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:12.042 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:12.042 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:12.042 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:12.042 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:12.042 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:12.043 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:12.043 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:12.043 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:12.043 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:12.043 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:12.043 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:12.044 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:12.044 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:12.044 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:12.044 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:12.044 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:12.045 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:12.045 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:12.045 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:12.045 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:12.045 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:12.045 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:12.046 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:12.046 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:12.046 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:12.046 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:12.046 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:12.047 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:12.047 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:12.047 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:12.047 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:12.047 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:12.048 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:12.048 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:12.048 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:12.048 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix", 2021-03-10T13:43:12.048 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:12.048 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:12.049 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:12.049 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "discovery_interval": { 2021-03-10T13:43:12.049 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "discovery_interval", 2021-03-10T13:43:12.049 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:12.049 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:12.050 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:12.050 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "100", 2021-03-10T13:43:12.050 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:12.050 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:12.050 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:12.051 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:12.051 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:12.051 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:12.051 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:12.051 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:12.051 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "identifier": { 2021-03-10T13:43:12.052 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "identifier", 2021-03-10T13:43:12.052 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:12.052 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:12.052 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:12.052 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:12.052 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:12.053 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:12.053 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:12.053 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:12.053 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:12.053 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:12.054 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:12.054 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:12.054 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T13:43:12.054 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T13:43:12.054 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:43:12.055 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:12.055 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:12.055 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2021-03-10T13:43:12.055 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:12.055 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:12.055 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:12.056 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:12.056 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:12.056 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:12.056 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:12.056 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:12.057 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:12.057 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:12.057 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:12.057 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:12.057 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:12.057 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:12.058 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:12.058 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:12.058 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:12.058 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:12.058 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:12.059 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:12.059 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:12.059 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:12.059 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:12.059 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:12.059 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:12.060 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:12.060 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:12.060 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:12.060 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:12.060 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:12.061 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:12.061 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:12.061 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:12.061 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:12.061 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:12.061 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:12.062 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:12.062 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:12.062 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:12.062 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:12.062 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:12.063 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:12.063 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:12.063 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:12.063 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:12.063 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:12.063 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:12.064 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:12.064 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:12.064 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:12.064 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:12.064 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:12.065 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:12.065 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:12.065 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:12.065 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:12.065 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:12.065 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:12.066 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:12.066 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:12.066 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:12.066 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:12.066 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:12.067 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:12.067 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:12.067 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:12.067 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:12.067 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:12.068 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:12.068 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:12.068 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:12.068 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:12.068 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:12.069 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:12.069 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:12.069 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:12.069 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:12.069 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:12.070 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_host": { 2021-03-10T13:43:12.070 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_host", 2021-03-10T13:43:12.070 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:12.070 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:12.070 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:12.071 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:43:12.071 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:12.071 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:12.071 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:12.071 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:12.072 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:12.072 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:12.072 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:12.072 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:12.072 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_port": { 2021-03-10T13:43:12.073 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_port", 2021-03-10T13:43:12.073 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:12.073 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:12.073 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:12.073 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10051", 2021-03-10T13:43:12.073 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:12.074 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:12.074 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:12.074 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:12.074 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:12.074 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:12.075 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:12.075 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:12.075 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_sender": { 2021-03-10T13:43:12.075 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_sender", 2021-03-10T13:43:12.075 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:12.075 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:12.076 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:12.076 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "/usr/bin/zabbix_sender", 2021-03-10T13:43:12.076 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:12.076 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:12.076 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:12.077 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:12.077 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:12.077 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:12.077 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:12.077 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:12.078 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:12.078 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:12.078 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:12.078 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {}, 2021-03-10T13:43:12.078 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "always_on_modules": { 2021-03-10T13:43:12.079 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nautilus": [ 2021-03-10T13:43:12.079 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2021-03-10T13:43:12.079 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2021-03-10T13:43:12.079 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2021-03-10T13:43:12.079 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator_cli", 2021-03-10T13:43:12.080 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2021-03-10T13:43:12.080 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2021-03-10T13:43:12.080 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2021-03-10T13:43:12.080 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2021-03-10T13:43:12.080 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:12.081 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "octopus": [ 2021-03-10T13:43:12.081 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2021-03-10T13:43:12.081 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2021-03-10T13:43:12.081 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2021-03-10T13:43:12.081 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator", 2021-03-10T13:43:12.082 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_support", 2021-03-10T13:43:12.082 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_autoscaler", 2021-03-10T13:43:12.082 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2021-03-10T13:43:12.082 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2021-03-10T13:43:12.082 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2021-03-10T13:43:12.083 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "telemetry", 2021-03-10T13:43:12.083 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2021-03-10T13:43:12.083 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:12.083 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_failure_osd_epoch": 0, 2021-03-10T13:43:12.083 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_clients": [ 2021-03-10T13:43:12.084 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:12.084 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2021-03-10T13:43:12.084 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:12.084 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2021-03-10T13:43:12.084 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.113:0", 2021-03-10T13:43:12.085 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 1874002260 2021-03-10T13:43:12.085 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:12.085 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T13:43:12.085 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:12.085 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:12.085 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2021-03-10T13:43:12.086 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:12.086 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2021-03-10T13:43:12.086 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.113:0", 2021-03-10T13:43:12.086 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 2911839215 2021-03-10T13:43:12.086 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:12.087 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T13:43:12.087 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:12.087 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:12.087 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2021-03-10T13:43:12.087 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:12.088 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2021-03-10T13:43:12.088 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.113:0", 2021-03-10T13:43:12.088 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 2306552835 2021-03-10T13:43:12.088 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:12.088 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T13:43:12.088 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:12.089 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T13:43:12.089 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:12.089 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:12.090 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:Waiting for the mgr to restart... 2021-03-10T13:43:12.090 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:Waiting for Mgr epoch 5... 2021-03-10T13:43:12.091 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba013', '-v', '/var/log/ceph/7672acc8-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp53lxa2bo:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmp7c38gcj7:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'tell', 'mgr', 'mgr_status'] 2021-03-10T13:43:12.091 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba013 -v /var/log/ceph/7672acc8-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp53lxa2bo:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp7c38gcj7:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 tell mgr mgr_status 2021-03-10T13:43:12.091 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:11 gibba013 bash[9767]: audit 2021-03-10T13:43:10.828621+0000 mon.a (mon.0) 36 : audit [DBG] from='client.? 172.21.2.113:0/1468839926' entity='client.admin' cmd=[{"prefix": "mgr dump"}]: dispatch 2021-03-10T13:43:12.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:12 gibba013 bash[9767]: cluster 2021-03-10T13:43:12.108211+0000 mon.a (mon.0) 37 : cluster [INF] Active manager daemon y restarted 2021-03-10T13:43:12.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:12 gibba013 bash[9767]: cluster 2021-03-10T13:43:12.108718+0000 mon.a (mon.0) 38 : cluster [INF] Activating manager daemon y 2021-03-10T13:43:12.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:12 gibba013 bash[9767]: cluster 2021-03-10T13:43:12.110208+0000 mon.a (mon.0) 39 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2021-03-10T13:43:13.378 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:13.378 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap_epoch": 7, 2021-03-10T13:43:13.378 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "initialized": true 2021-03-10T13:43:13.379 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:13.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:13 gibba013 bash[9767]: cluster 2021-03-10T13:43:12.362108+0000 mon.a (mon.0) 40 : cluster [DBG] mgrmap e6: y(active, starting, since 0.253426s) 2021-03-10T13:43:13.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:13 gibba013 bash[9767]: audit 2021-03-10T13:43:12.366949+0000 mon.a (mon.0) 41 : audit [DBG] from='mgr.14117 172.21.2.113:0/2312913458' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T13:43:13.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:13 gibba013 bash[9767]: audit 2021-03-10T13:43:12.368981+0000 mon.a (mon.0) 42 : audit [DBG] from='mgr.14117 172.21.2.113:0/2312913458' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T13:43:13.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:13 gibba013 bash[9767]: audit 2021-03-10T13:43:12.369594+0000 mon.a (mon.0) 43 : audit [DBG] from='mgr.14117 172.21.2.113:0/2312913458' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T13:43:13.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:13 gibba013 bash[9767]: audit 2021-03-10T13:43:12.370008+0000 mon.a (mon.0) 44 : audit [DBG] from='mgr.14117 172.21.2.113:0/2312913458' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T13:43:13.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:13 gibba013 bash[9767]: audit 2021-03-10T13:43:12.371437+0000 mon.a (mon.0) 45 : audit [DBG] from='mgr.14117 172.21.2.113:0/2312913458' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T13:43:13.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:13 gibba013 bash[9767]: audit 2021-03-10T13:43:12.373677+0000 mon.a (mon.0) 46 : audit [DBG] from='mgr.14117 172.21.2.113:0/2312913458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-03-10T13:43:13.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:13 gibba013 bash[9767]: audit 2021-03-10T13:43:12.374955+0000 mon.a (mon.0) 47 : audit [DBG] from='mgr.14117 172.21.2.113:0/2312913458' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-03-10T13:43:13.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:13 gibba013 bash[9767]: cluster 2021-03-10T13:43:12.380732+0000 mon.a (mon.0) 48 : cluster [INF] Manager daemon y is now available 2021-03-10T13:43:13.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:13 gibba013 bash[9767]: audit 2021-03-10T13:43:12.437214+0000 mon.a (mon.0) 49 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-03-10T13:43:13.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:13 gibba013 bash[9767]: audit 2021-03-10T13:43:12.629620+0000 mon.a (mon.0) 50 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-03-10T13:43:13.882 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:Setting orchestrator backend to cephadm... 2021-03-10T13:43:13.883 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba013', '-v', '/var/log/ceph/7672acc8-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp53lxa2bo:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmp7c38gcj7:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'orch', 'set', 'backend', 'cephadm'] 2021-03-10T13:43:13.883 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba013 -v /var/log/ceph/7672acc8-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp53lxa2bo:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp7c38gcj7:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 orch set backend cephadm 2021-03-10T13:43:14.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:14 gibba013 bash[9767]: cluster 2021-03-10T13:43:13.368609+0000 mon.a (mon.0) 51 : cluster [DBG] mgrmap e7: y(active, since 1.25995s) 2021-03-10T13:43:15.389 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:Generating ssh key... 2021-03-10T13:43:15.389 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba013', '-v', '/var/log/ceph/7672acc8-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp53lxa2bo:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmp7c38gcj7:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'cephadm', 'generate-key'] 2021-03-10T13:43:15.390 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba013 -v /var/log/ceph/7672acc8-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp53lxa2bo:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp7c38gcj7:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 cephadm generate-key 2021-03-10T13:43:15.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:15 gibba013 bash[9767]: cluster 2021-03-10T13:43:14.376369+0000 mon.a (mon.0) 52 : cluster [DBG] mgrmap e8: y(active, since 2s) 2021-03-10T13:43:15.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:15 gibba013 bash[9767]: audit 2021-03-10T13:43:14.873914+0000 mgr.y (mgr.14117) 1 : audit [DBG] from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:43:15.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:15 gibba013 bash[9767]: audit 2021-03-10T13:43:14.874778+0000 mon.a (mon.0) 53 : audit [INF] from='mgr.14117 172.21.2.113:0/2312913458' entity='mgr.y' cmd=[{"prefix":"config set","value":"cephadm","who":"mgr","name":"mgr/orchestrator/orchestrator"}]: dispatch 2021-03-10T13:43:15.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:15 gibba013 bash[9767]: audit 2021-03-10T13:43:14.876982+0000 mon.a (mon.0) 54 : audit [INF] from='mgr.14117 172.21.2.113:0/2312913458' entity='mgr.y' cmd='[{"prefix":"config set","value":"cephadm","who":"mgr","name":"mgr/orchestrator/orchestrator"}]': finished 2021-03-10T13:43:16.881 INFO:journalctl@ceph.mgr.y.gibba013.stdout:Mar 10 13:43:16 gibba013 bash[10020]: Generating public/private rsa key pair. 2021-03-10T13:43:16.882 INFO:journalctl@ceph.mgr.y.gibba013.stdout:Mar 10 13:43:16 gibba013 bash[10020]: Your identification has been saved in /tmp/tmpj8h0cixt/key. 2021-03-10T13:43:16.882 INFO:journalctl@ceph.mgr.y.gibba013.stdout:Mar 10 13:43:16 gibba013 bash[10020]: Your public key has been saved in /tmp/tmpj8h0cixt/key.pub. 2021-03-10T13:43:16.882 INFO:journalctl@ceph.mgr.y.gibba013.stdout:Mar 10 13:43:16 gibba013 bash[10020]: The key fingerprint is: 2021-03-10T13:43:16.882 INFO:journalctl@ceph.mgr.y.gibba013.stdout:Mar 10 13:43:16 gibba013 bash[10020]: SHA256:yGn4d5UB2HeyeX2Zi63YDjOoiauptGcdeJ3FNw1TBog ceph-7672acc8-81a6-11eb-9080-001a4aab830c 2021-03-10T13:43:16.883 INFO:journalctl@ceph.mgr.y.gibba013.stdout:Mar 10 13:43:16 gibba013 bash[10020]: The key's randomart image is: 2021-03-10T13:43:16.883 INFO:journalctl@ceph.mgr.y.gibba013.stdout:Mar 10 13:43:16 gibba013 bash[10020]: +---[RSA 3072]----+ 2021-03-10T13:43:16.883 INFO:journalctl@ceph.mgr.y.gibba013.stdout:Mar 10 13:43:16 gibba013 bash[10020]: | .oo.oo | 2021-03-10T13:43:16.883 INFO:journalctl@ceph.mgr.y.gibba013.stdout:Mar 10 13:43:16 gibba013 bash[10020]: | E...++ . | 2021-03-10T13:43:16.883 INFO:journalctl@ceph.mgr.y.gibba013.stdout:Mar 10 13:43:16 gibba013 bash[10020]: | . .== .o| 2021-03-10T13:43:16.883 INFO:journalctl@ceph.mgr.y.gibba013.stdout:Mar 10 13:43:16 gibba013 bash[10020]: | o o o oo+.oo| 2021-03-10T13:43:16.884 INFO:journalctl@ceph.mgr.y.gibba013.stdout:Mar 10 13:43:16 gibba013 bash[10020]: | o * S . +.o o| 2021-03-10T13:43:16.884 INFO:journalctl@ceph.mgr.y.gibba013.stdout:Mar 10 13:43:16 gibba013 bash[10020]: | . = o .. . o | 2021-03-10T13:43:16.884 INFO:journalctl@ceph.mgr.y.gibba013.stdout:Mar 10 13:43:16 gibba013 bash[10020]: | . o o ...+o . | 2021-03-10T13:43:16.884 INFO:journalctl@ceph.mgr.y.gibba013.stdout:Mar 10 13:43:16 gibba013 bash[10020]: |. .o....o. .+o | 2021-03-10T13:43:16.884 INFO:journalctl@ceph.mgr.y.gibba013.stdout:Mar 10 13:43:16 gibba013 bash[10020]: | o+o.o.o .. | 2021-03-10T13:43:16.885 INFO:journalctl@ceph.mgr.y.gibba013.stdout:Mar 10 13:43:16 gibba013 bash[10020]: +----[SHA256]-----+ 2021-03-10T13:43:16.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:16 gibba013 bash[9767]: audit 2021-03-10T13:43:16.481390+0000 mon.a (mon.0) 55 : audit [INF] from='mgr.14117 172.21.2.113:0/2312913458' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_key","val":"-----BEGIN OPENSSH PRIVATE KEY-----\nb3BlbnNzaC1rZXktdjEAAAAABG5vbmUAAAAEbm9uZQAAAAAAAAABAAABlwAAAAdzc2gtcn\nNhAAAAAwEAAQAAAYEA0ePemlcuYWo81ei5Cju6doX0sAXTMS6v7ygjHHRU6o06CU59ragP\nSoXQXStMl0xLerKEnexmUg5KyUFLGzhOaYo6B1NUX40taqToOejCRxfwAJQq1bJx2BN5PP\na+Oc604rl3QojMUFIiq+SHh0yGKrUdS/2hY6pXiSp58GWI+wjB5LRC9Fvwdbq2Cee6YCZy\nzpMajeBvc9kC415cr0TfG/qKE5Rb9SSNSIIVE5+pr1wkAbnt0DEv5ikFt32o1cAFVULxMU\neROBP1Jnbhyf4YNEiwRtB8P5qonUcRkPXDPn81y7AxTwubQxM/EitH8WiyuL45jsPOUv+v\nl8VwXarhnRZjXRL07COgzNMif832wQnGBUbemnNTu2wCSljk2JnJZIGBhjaKXtNl6TX/GX\nDzq505p+Ukx7ntYyHlCYuOWhKFUgpeTiCx12NbI2chUAYciEkC5gh6mfdwbtI1UgDf2Zoc\nl95evMqXJm4NTUohhCh4OGCx2v2hU4mhMi2XuCqZAAAFoClBPyYpQT8mAAAAB3NzaC1yc2\nEAAAGBANHj3ppXLmFqPNXouQo7unaF9LAF0zEur+8oIxx0VOqNOglOfa2oD0qF0F0rTJdM\nS3qyhJ3sZlIOSslBSxs4TmmKOgdTVF+NLWqk6DnowkcX8ACUKtWycdgTeTz2vjnOtOK5d0\nKIzFBSIqvkh4dMhiq1HUv9oWOqV4kqefBliPsIweS0QvRb8HW6tgnnumAmcs6TGo3gb3PZ\nAuNeXK9E3xv6ihOUW/UkjUiCFROfqa9cJAG57dAxL+YpBbd9qNXABVVC8TFHkTgT9SZ24c\nn+GDRIsEbQfD+aqJ1HEZD1wz5/NcuwMU8Lm0MTPxIrR/Fosri+OY7DzlL/r5fFcF2q4Z0W\nY10S9OwjoMzTIn/N9sEJxgVG3ppzU7tsAkpY5NiZyWSBgYY2il7TZek1/xlw86udOaflJM\ne57WMh5QmLjloShVIKXk4gsddjWyNnIVAGHIhJAuYIepn3cG7SNVIA39maHJfeXrzKlyZu\nDU1KIYQoeDhgsdr9oVOJoTItl7gqmQAAAAMBAAEAAAGBAIYejCInz3VkQ5eU7JkDbbVLB/\n5q2nc1FCtIhJcsJw7yS8GirGCJYawHMgw3HOwZTqoK5P9dDk0k4NkVpf6wzjpWn5oKv4GH\nXxwkYFiQyYRQYYadJ3oCWwjt+KziJtAdrCyswu57J8OzmIAqugfU+G7V6PCkE7ryIJl/0Q\neyegOfpvaT0a0ACvnP438U2l2SdA5YpcE/RzjJ1TShGazN35urTwwP42sUfkt1BC7T+cQa\nps+LldFRfQAf+o0z+O0Nk7JkDr6Eup9XiHA3lrdTeSYiSGys/sl/Z1/WI2HMWOuuAudb/P\n0rrQjj3HpMmMpLXa01C4DxNgwRxoqPih1quPAVq5fhtsPSM3o+XSLix2+SPe01tqTAZq3Y\nblbpjd45TaQn2xxu05XvZ7IcabwN/0wNUm1gGfUy9p8lt455E54kS8CiIaP8zH69rN/Z0D\nK5M+EA4OmsxrXXpXK52kWq+eNp/Cnjh+/GgW2BSHSuzwP7Cg7oU9bLdbGNTaOkPLw+mQAA\nAMEA4AEafP21bpxXbq9ImccH2/pklPeG+KCqYIPYpxawlFQikKar+YfJp56ULixFuVnkix\nt5eDSFhpqtI0wR66BugYU1q6w4ZbdqA52Fd35njNnMxCO5wQ1q8CAYElbSnCtW1kTbrsbV\nyhzJd7r7bKnlSogwvRC0I9j7px0/RSanQV2d23xKZNmeNCc6StebnYgVFLnHYdFMoJBQla\nCkyTJdzgRRm+9eh9fKezrA6eHGUW7HvkoFyQBZdYiFZ8w71B4+AAAAwQDwdGOqXikXwwi9\n+yIhjopwB80IkcPJk3jzgJ4J35o9BqPkJTdJYWqZPtZnZ07bhlG5Wi5JwqpzLa+FVsBrTT\nCgs6WXDgIQeZgK4jxj4+KtvFJfeel75Mt44IDSCTaNjeZEywaTlg483FqGBEF1g8S7ZXLH\ngFlLOcf1NDUXnyb1dbWRNS5iX5cA+F9FBgDBQN0sjpawTVh3C2TLKxPw8MKeUuGPkBvFHe\nDc80HUtLEiwRRGg6NkSudOBKh219qLg7MAAADBAN91oFO5iPb9xp5/ZgYMi3h0r47awH2S\nAcif1Ys4eWEVsd3259KhJEAkjdhmCLeScg/E6x2CmFft9RdMPhessYsYkXUAfpRbN7DAks\nTgyOIn8gsVOemDl+6hlbIdy0Uldv0BnQtWBCqm0d390WUJox8jL3QRd3L7rb+e1mtGVnPb\n37PWVbLQsKU7USwbqKd1W/Qh/VQ5eXA8riHznC4PitKsZzrsVR12ZZhuRpAAQmGpCBEZOm\n8GRqzmO/suBtIigwAAACljZXBoLTc2NzJhY2M4LTgxYTYtMTFlYi05MDgwLTAwMWE0YWFi\nODMwYw==\n-----END OPENSSH PRIVATE KEY-----\n"}]: dispatch 2021-03-10T13:43:16.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:16 gibba013 bash[9767]: audit 2021-03-10T13:43:16.483114+0000 mon.a (mon.0) 56 : audit [INF] from='mgr.14117 172.21.2.113:0/2312913458' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_key","val":"-----BEGIN OPENSSH PRIVATE KEY-----\nb3BlbnNzaC1rZXktdjEAAAAABG5vbmUAAAAEbm9uZQAAAAAAAAABAAABlwAAAAdzc2gtcn\nNhAAAAAwEAAQAAAYEA0ePemlcuYWo81ei5Cju6doX0sAXTMS6v7ygjHHRU6o06CU59ragP\nSoXQXStMl0xLerKEnexmUg5KyUFLGzhOaYo6B1NUX40taqToOejCRxfwAJQq1bJx2BN5PP\na+Oc604rl3QojMUFIiq+SHh0yGKrUdS/2hY6pXiSp58GWI+wjB5LRC9Fvwdbq2Cee6YCZy\nzpMajeBvc9kC415cr0TfG/qKE5Rb9SSNSIIVE5+pr1wkAbnt0DEv5ikFt32o1cAFVULxMU\neROBP1Jnbhyf4YNEiwRtB8P5qonUcRkPXDPn81y7AxTwubQxM/EitH8WiyuL45jsPOUv+v\nl8VwXarhnRZjXRL07COgzNMif832wQnGBUbemnNTu2wCSljk2JnJZIGBhjaKXtNl6TX/GX\nDzq505p+Ukx7ntYyHlCYuOWhKFUgpeTiCx12NbI2chUAYciEkC5gh6mfdwbtI1UgDf2Zoc\nl95evMqXJm4NTUohhCh4OGCx2v2hU4mhMi2XuCqZAAAFoClBPyYpQT8mAAAAB3NzaC1yc2\nEAAAGBANHj3ppXLmFqPNXouQo7unaF9LAF0zEur+8oIxx0VOqNOglOfa2oD0qF0F0rTJdM\nS3qyhJ3sZlIOSslBSxs4TmmKOgdTVF+NLWqk6DnowkcX8ACUKtWycdgTeTz2vjnOtOK5d0\nKIzFBSIqvkh4dMhiq1HUv9oWOqV4kqefBliPsIweS0QvRb8HW6tgnnumAmcs6TGo3gb3PZ\nAuNeXK9E3xv6ihOUW/UkjUiCFROfqa9cJAG57dAxL+YpBbd9qNXABVVC8TFHkTgT9SZ24c\nn+GDRIsEbQfD+aqJ1HEZD1wz5/NcuwMU8Lm0MTPxIrR/Fosri+OY7DzlL/r5fFcF2q4Z0W\nY10S9OwjoMzTIn/N9sEJxgVG3ppzU7tsAkpY5NiZyWSBgYY2il7TZek1/xlw86udOaflJM\ne57WMh5QmLjloShVIKXk4gsddjWyNnIVAGHIhJAuYIepn3cG7SNVIA39maHJfeXrzKlyZu\nDU1KIYQoeDhgsdr9oVOJoTItl7gqmQAAAAMBAAEAAAGBAIYejCInz3VkQ5eU7JkDbbVLB/\n5q2nc1FCtIhJcsJw7yS8GirGCJYawHMgw3HOwZTqoK5P9dDk0k4NkVpf6wzjpWn5oKv4GH\nXxwkYFiQyYRQYYadJ3oCWwjt+KziJtAdrCyswu57J8OzmIAqugfU+G7V6PCkE7ryIJl/0Q\neyegOfpvaT0a0ACvnP438U2l2SdA5YpcE/RzjJ1TShGazN35urTwwP42sUfkt1BC7T+cQa\nps+LldFRfQAf+o0z+O0Nk7JkDr6Eup9XiHA3lrdTeSYiSGys/sl/Z1/WI2HMWOuuAudb/P\n0rrQjj3HpMmMpLXa01C4DxNgwRxoqPih1quPAVq5fhtsPSM3o+XSLix2+SPe01tqTAZq3Y\nblbpjd45TaQn2xxu05XvZ7IcabwN/0wNUm1gGfUy9p8lt455E54kS8CiIaP8zH69rN/Z0D\nK5M+EA4OmsxrXXpXK52kWq+eNp/Cnjh+/GgW2BSHSuzwP7Cg7oU9bLdbGNTaOkPLw+mQAA\nAMEA4AEafP21bpxXbq9ImccH2/pklPeG+KCqYIPYpxawlFQikKar+YfJp56ULixFuVnkix\nt5eDSFhpqtI0wR66BugYU1q6w4ZbdqA52Fd35njNnMxCO5wQ1q8CAYElbSnCtW1kTbrsbV\nyhzJd7r7bKnlSogwvRC0I9j7px0/RSanQV2d23xKZNmeNCc6StebnYgVFLnHYdFMoJBQla\nCkyTJdzgRRm+9eh9fKezrA6eHGUW7HvkoFyQBZdYiFZ8w71B4+AAAAwQDwdGOqXikXwwi9\n+yIhjopwB80IkcPJk3jzgJ4J35o9BqPkJTdJYWqZPtZnZ07bhlG5Wi5JwqpzLa+FVsBrTT\nCgs6WXDgIQeZgK4jxj4+KtvFJfeel75Mt44IDSCTaNjeZEywaTlg483FqGBEF1g8S7ZXLH\ngFlLOcf1NDUXnyb1dbWRNS5iX5cA+F9FBgDBQN0sjpawTVh3C2TLKxPw8MKeUuGPkBvFHe\nDc80HUtLEiwRRGg6NkSudOBKh219qLg7MAAADBAN91oFO5iPb9xp5/ZgYMi3h0r47awH2S\nAcif1Ys4eWEVsd3259KhJEAkjdhmCLeScg/E6x2CmFft9RdMPhessYsYkXUAfpRbN7DAks\nTgyOIn8gsVOemDl+6hlbIdy0Uldv0BnQtWBCqm0d390WUJox8jL3QRd3L7rb+e1mtGVnPb\n37PWVbLQsKU7USwbqKd1W/Qh/VQ5eXA8riHznC4PitKsZzrsVR12ZZhuRpAAQmGpCBEZOm\n8GRqzmO/suBtIigwAAACljZXBoLTc2NzJhY2M4LTgxYTYtMTFlYi05MDgwLTAwMWE0YWFi\nODMwYw==\n-----END OPENSSH PRIVATE KEY-----\n"}]': finished 2021-03-10T13:43:16.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:16 gibba013 bash[9767]: audit 2021-03-10T13:43:16.483568+0000 mon.a (mon.0) 57 : audit [INF] from='mgr.14117 172.21.2.113:0/2312913458' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_pub","val":"ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDR496aVy5hajzV6LkKO7p2hfSwBdMxLq/vKCMcdFTqjToJTn2tqA9KhdBdK0yXTEt6soSd7GZSDkrJQUsbOE5pijoHU1RfjS1qpOg56MJHF/AAlCrVsnHYE3k89r45zrTiuXdCiMxQUiKr5IeHTIYqtR1L/aFjqleJKnnwZYj7CMHktEL0W/B1urYJ57pgJnLOkxqN4G9z2QLjXlyvRN8b+ooTlFv1JI1IghUTn6mvXCQBue3QMS/mKQW3fajVwAVVQvExR5E4E/UmduHJ/hg0SLBG0Hw/mqidRxGQ9cM+fzXLsDFPC5tDEz8SK0fxaLK4vjmOw85S/6+XxXBdquGdFmNdEvTsI6DM0yJ/zfbBCcYFRt6ac1O7bAJKWOTYmclkgYGGNope02XpNf8ZcPOrnTmn5STHue1jIeUJi45aEoVSCl5OILHXY1sjZyFQBhyISQLmCHqZ93Bu0jVSAN/ZmhyX3l68ypcmbg1NSiGEKHg4YLHa/aFTiaEyLZe4Kpk= ceph-7672acc8-81a6-11eb-9080-001a4aab830c\n"}]: dispatch 2021-03-10T13:43:16.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:16 gibba013 bash[9767]: audit 2021-03-10T13:43:16.484915+0000 mon.a (mon.0) 58 : audit [INF] from='mgr.14117 172.21.2.113:0/2312913458' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_pub","val":"ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDR496aVy5hajzV6LkKO7p2hfSwBdMxLq/vKCMcdFTqjToJTn2tqA9KhdBdK0yXTEt6soSd7GZSDkrJQUsbOE5pijoHU1RfjS1qpOg56MJHF/AAlCrVsnHYE3k89r45zrTiuXdCiMxQUiKr5IeHTIYqtR1L/aFjqleJKnnwZYj7CMHktEL0W/B1urYJ57pgJnLOkxqN4G9z2QLjXlyvRN8b+ooTlFv1JI1IghUTn6mvXCQBue3QMS/mKQW3fajVwAVVQvExR5E4E/UmduHJ/hg0SLBG0Hw/mqidRxGQ9cM+fzXLsDFPC5tDEz8SK0fxaLK4vjmOw85S/6+XxXBdquGdFmNdEvTsI6DM0yJ/zfbBCcYFRt6ac1O7bAJKWOTYmclkgYGGNope02XpNf8ZcPOrnTmn5STHue1jIeUJi45aEoVSCl5OILHXY1sjZyFQBhyISQLmCHqZ93Bu0jVSAN/ZmhyX3l68ypcmbg1NSiGEKHg4YLHa/aFTiaEyLZe4Kpk= ceph-7672acc8-81a6-11eb-9080-001a4aab830c\n"}]': finished 2021-03-10T13:43:17.037 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba013', '-v', '/var/log/ceph/7672acc8-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp53lxa2bo:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmp7c38gcj7:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'cephadm', 'get-pub-key'] 2021-03-10T13:43:17.037 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba013 -v /var/log/ceph/7672acc8-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp53lxa2bo:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp7c38gcj7:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 cephadm get-pub-key 2021-03-10T13:43:17.823 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:17 gibba013 bash[9767]: audit 2021-03-10T13:43:16.376459+0000 mgr.y (mgr.14117) 2 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:43:17.823 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:17 gibba013 bash[9767]: cephadm 2021-03-10T13:43:16.376621+0000 mgr.y (mgr.14117) 3 : cephadm [INF] Generating ssh key... 2021-03-10T13:43:18.048 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDR496aVy5hajzV6LkKO7p2hfSwBdMxLq/vKCMcdFTqjToJTn2tqA9KhdBdK0yXTEt6soSd7GZSDkrJQUsbOE5pijoHU1RfjS1qpOg56MJHF/AAlCrVsnHYE3k89r45zrTiuXdCiMxQUiKr5IeHTIYqtR1L/aFjqleJKnnwZYj7CMHktEL0W/B1urYJ57pgJnLOkxqN4G9z2QLjXlyvRN8b+ooTlFv1JI1IghUTn6mvXCQBue3QMS/mKQW3fajVwAVVQvExR5E4E/UmduHJ/hg0SLBG0Hw/mqidRxGQ9cM+fzXLsDFPC5tDEz8SK0fxaLK4vjmOw85S/6+XxXBdquGdFmNdEvTsI6DM0yJ/zfbBCcYFRt6ac1O7bAJKWOTYmclkgYGGNope02XpNf8ZcPOrnTmn5STHue1jIeUJi45aEoVSCl5OILHXY1sjZyFQBhyISQLmCHqZ93Bu0jVSAN/ZmhyX3l68ypcmbg1NSiGEKHg4YLHa/aFTiaEyLZe4Kpk= ceph-7672acc8-81a6-11eb-9080-001a4aab830c 2021-03-10T13:43:18.526 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:Wrote public SSH key to to /home/ubuntu/cephtest/ceph.pub 2021-03-10T13:43:18.527 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:Adding key to root@localhost's authorized_keys... 2021-03-10T13:43:18.527 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:Adding host gibba013... 2021-03-10T13:43:18.527 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba013', '-v', '/var/log/ceph/7672acc8-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp53lxa2bo:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmp7c38gcj7:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'orch', 'host', 'add', 'gibba013'] 2021-03-10T13:43:18.527 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba013 -v /var/log/ceph/7672acc8-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp53lxa2bo:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp7c38gcj7:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 orch host add gibba013 2021-03-10T13:43:18.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:18 gibba013 bash[9767]: audit 2021-03-10T13:43:18.046044+0000 mgr.y (mgr.14117) 4 : audit [DBG] from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:43:19.880 INFO:journalctl@ceph.mgr.y.gibba013.stdout:Mar 10 13:43:19 gibba013 bash[10020]: Warning: Permanently added 'gibba013,172.21.2.113' (ECDSA) to the list of known hosts. 2021-03-10T13:43:20.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:19 gibba013 bash[9767]: audit 2021-03-10T13:43:19.911120+0000 mon.a (mon.0) 59 : audit [INF] from='mgr.14117 172.21.2.113:0/2312913458' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"gibba013\": {\"hostname\": \"gibba013\", \"addr\": \"gibba013\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2021-03-10T13:43:20.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:19 gibba013 bash[9767]: audit 2021-03-10T13:43:19.912918+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.14117 172.21.2.113:0/2312913458' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"gibba013\": {\"hostname\": \"gibba013\", \"addr\": \"gibba013\", \"labels\": [], \"status\": \"\"}}"}]': finished 2021-03-10T13:43:20.576 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout Added host 'gibba013' 2021-03-10T13:43:21.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:20 gibba013 bash[9767]: audit 2021-03-10T13:43:19.570569+0000 mgr.y (mgr.14117) 5 : audit [DBG] from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "gibba013", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:43:21.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:20 gibba013 bash[9767]: cephadm 2021-03-10T13:43:19.913311+0000 mgr.y (mgr.14117) 6 : cephadm [INF] Added host gibba013 2021-03-10T13:43:21.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:20 gibba013 bash[9767]: audit 2021-03-10T13:43:20.026678+0000 mon.a (mon.0) 61 : audit [INF] from='mgr.14117 172.21.2.113:0/2312913458' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:43:21.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:20 gibba013 bash[9767]: audit 2021-03-10T13:43:20.028473+0000 mon.a (mon.0) 62 : audit [INF] from='mgr.14117 172.21.2.113:0/2312913458' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:43:21.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:20 gibba013 bash[9767]: audit 2021-03-10T13:43:20.029042+0000 mon.a (mon.0) 63 : audit [DBG] from='mgr.14117 172.21.2.113:0/2312913458' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:43:21.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:20 gibba013 bash[9767]: audit 2021-03-10T13:43:20.314674+0000 mon.a (mon.0) 64 : audit [INF] from='mgr.14117 172.21.2.113:0/2312913458' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:20.313233\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:20.314237\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T13:43:20.314300\", \"networks\": {}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:43:21.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:20 gibba013 bash[9767]: audit 2021-03-10T13:43:20.316569+0000 mon.a (mon.0) 65 : audit [INF] from='mgr.14117 172.21.2.113:0/2312913458' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:20.313233\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:20.314237\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T13:43:20.314300\", \"networks\": {}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:43:21.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:20 gibba013 bash[9767]: audit 2021-03-10T13:43:20.317081+0000 mon.a (mon.0) 66 : audit [DBG] from='mgr.14117 172.21.2.113:0/2312913458' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:43:21.437 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:Enabling the dashboard module... 2021-03-10T13:43:21.437 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba013', '-v', '/var/log/ceph/7672acc8-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp53lxa2bo:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmp7c38gcj7:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'mgr', 'module', 'enable', 'dashboard'] 2021-03-10T13:43:21.437 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba013 -v /var/log/ceph/7672acc8-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp53lxa2bo:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp7c38gcj7:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 mgr module enable dashboard 2021-03-10T13:43:23.358 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:23 gibba013 bash[9767]: audit 2021-03-10T13:43:22.965063+0000 mon.a (mon.0) 67 : audit [INF] from='client.? 172.21.2.113:0/3156310193' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2021-03-10T13:43:23.359 INFO:journalctl@ceph.mgr.y.gibba013.stdout:Mar 10 13:43:23 gibba013 bash[10020]: ignoring --setuser ceph since I am not root 2021-03-10T13:43:23.359 INFO:journalctl@ceph.mgr.y.gibba013.stdout:Mar 10 13:43:23 gibba013 bash[10020]: ignoring --setgroup ceph since I am not root 2021-03-10T13:43:23.822 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba013', '-v', '/var/log/ceph/7672acc8-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp53lxa2bo:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmp7c38gcj7:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'mgr', 'dump'] 2021-03-10T13:43:23.823 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba013 -v /var/log/ceph/7672acc8-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp53lxa2bo:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp7c38gcj7:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 mgr dump 2021-03-10T13:43:24.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:24 gibba013 bash[9767]: audit 2021-03-10T13:43:23.024235+0000 mon.a (mon.0) 68 : audit [INF] from='client.? 172.21.2.113:0/3156310193' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2021-03-10T13:43:24.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:24 gibba013 bash[9767]: cluster 2021-03-10T13:43:23.024351+0000 mon.a (mon.0) 69 : cluster [DBG] mgrmap e9: y(active, since 10s) 2021-03-10T13:43:25.318 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:25.318 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 9, 2021-03-10T13:43:25.318 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_gid": 14117, 2021-03-10T13:43:25.319 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_name": "y", 2021-03-10T13:43:25.319 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addrs": { 2021-03-10T13:43:25.319 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2021-03-10T13:43:25.319 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:25.319 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2021-03-10T13:43:25.320 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.113:6800", 2021-03-10T13:43:25.320 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 2579871074 2021-03-10T13:43:25.320 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.320 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:25.321 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v1", 2021-03-10T13:43:25.321 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.113:6801", 2021-03-10T13:43:25.321 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 2579871074 2021-03-10T13:43:25.321 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:25.321 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T13:43:25.321 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.322 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addr": "172.21.2.113:6801/2579871074", 2021-03-10T13:43:25.322 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_change": "2021-03-10T13:43:12.108649+0000", 2021-03-10T13:43:25.322 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_mgr_features": 4540138292836696063, 2021-03-10T13:43:25.322 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": true, 2021-03-10T13:43:25.322 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standbys": [], 2021-03-10T13:43:25.323 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2021-03-10T13:43:25.323 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2021-03-10T13:43:25.323 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "dashboard", 2021-03-10T13:43:25.323 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2021-03-10T13:43:25.323 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2021-03-10T13:43:25.324 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.324 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available_modules": [ 2021-03-10T13:43:25.324 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:25.324 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "alerts", 2021-03-10T13:43:25.324 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:25.325 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:25.325 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:25.325 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T13:43:25.325 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T13:43:25.325 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:43:25.325 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.326 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.326 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2021-03-10T13:43:25.326 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.326 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.326 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.327 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "How frequently to reexamine health status", 2021-03-10T13:43:25.327 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.327 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.327 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.327 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.328 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:25.328 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:25.328 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.328 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.328 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.329 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.329 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.329 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.329 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.329 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:25.330 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:25.330 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:25.330 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:25.330 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:25.330 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:25.330 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.331 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.331 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.331 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.331 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.331 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.332 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:25.332 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:25.332 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.332 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.332 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.333 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.333 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.333 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.333 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.333 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.333 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.334 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.334 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.334 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.334 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:25.334 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:25.335 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.335 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.335 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.335 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:25.335 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.336 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.336 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.336 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:25.336 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:25.336 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:25.337 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:25.337 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:25.337 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:25.337 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.337 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.338 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.338 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.338 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.338 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.338 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:25.339 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:25.339 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.339 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.339 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.339 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.339 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.340 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.340 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.340 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.340 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.340 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.341 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.341 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.341 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_destination": { 2021-03-10T13:43:25.341 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_destination", 2021-03-10T13:43:25.341 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.342 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.342 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.342 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.342 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.343 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.343 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.343 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email address to send alerts to", 2021-03-10T13:43:25.343 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.343 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.343 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.344 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.344 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_from_name": { 2021-03-10T13:43:25.344 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_from_name", 2021-03-10T13:43:25.344 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.344 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.345 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.345 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "Ceph", 2021-03-10T13:43:25.345 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.345 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.345 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.346 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email From: name", 2021-03-10T13:43:25.346 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.346 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.346 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.346 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.347 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_host": { 2021-03-10T13:43:25.347 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_host", 2021-03-10T13:43:25.347 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.347 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.347 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.347 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.348 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.348 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.348 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.348 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP server", 2021-03-10T13:43:25.348 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.349 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.349 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.349 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.349 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_password": { 2021-03-10T13:43:25.349 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_password", 2021-03-10T13:43:25.350 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.350 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.350 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.350 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.350 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.351 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.351 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.351 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Password to authenticate with", 2021-03-10T13:43:25.351 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.351 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.351 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.352 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.352 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_port": { 2021-03-10T13:43:25.352 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_port", 2021-03-10T13:43:25.352 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:25.352 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.353 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.353 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "465", 2021-03-10T13:43:25.353 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.353 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.353 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.353 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP port", 2021-03-10T13:43:25.354 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.354 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.354 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.354 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.354 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_sender": { 2021-03-10T13:43:25.355 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_sender", 2021-03-10T13:43:25.355 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.355 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.355 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.356 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.356 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.356 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.356 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.356 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP envelope sender", 2021-03-10T13:43:25.356 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.357 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.357 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.357 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.357 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_ssl": { 2021-03-10T13:43:25.358 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_ssl", 2021-03-10T13:43:25.358 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.358 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.358 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.358 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:25.359 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.359 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.359 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.359 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Use SSL to connect to SMTP server", 2021-03-10T13:43:25.359 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.360 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.360 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.360 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.360 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_user": { 2021-03-10T13:43:25.360 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_user", 2021-03-10T13:43:25.361 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.361 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.361 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.361 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.361 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.362 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.362 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.362 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "User to authenticate as", 2021-03-10T13:43:25.362 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.362 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.363 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.363 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:25.363 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:25.363 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.363 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:25.363 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "balancer", 2021-03-10T13:43:25.364 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:25.364 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:25.364 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:25.364 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active": { 2021-03-10T13:43:25.364 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "active", 2021-03-10T13:43:25.365 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.365 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.365 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.365 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.365 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.366 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.366 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.366 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically balance PGs across cluster", 2021-03-10T13:43:25.366 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.366 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.367 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.367 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.367 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_time": { 2021-03-10T13:43:25.367 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_time", 2021-03-10T13:43:25.367 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.367 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.368 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.368 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0000", 2021-03-10T13:43:25.368 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.368 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.368 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.369 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "beginning time of day to automatically balance", 2021-03-10T13:43:25.369 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2021-03-10T13:43:25.369 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.369 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.369 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.370 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_weekday": { 2021-03-10T13:43:25.370 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_weekday", 2021-03-10T13:43:25.370 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2021-03-10T13:43:25.370 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.370 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.371 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2021-03-10T13:43:25.371 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2021-03-10T13:43:25.371 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2021-03-10T13:43:25.371 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.371 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to this day of the week or later", 2021-03-10T13:43:25.372 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2021-03-10T13:43:25.372 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.372 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.372 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.372 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_max_iterations": { 2021-03-10T13:43:25.373 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_max_iterations", 2021-03-10T13:43:25.373 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2021-03-10T13:43:25.373 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.373 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.373 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "25", 2021-03-10T13:43:25.374 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2021-03-10T13:43:25.374 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "250", 2021-03-10T13:43:25.374 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.374 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum number of iterations to attempt optimization", 2021-03-10T13:43:25.374 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.375 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.375 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.375 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.375 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_metrics": { 2021-03-10T13:43:25.375 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_metrics", 2021-03-10T13:43:25.375 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.376 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.376 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.376 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "pgs,objects,bytes", 2021-03-10T13:43:25.376 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.376 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.377 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.377 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "metrics with which to calculate OSD utilization", 2021-03-10T13:43:25.377 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2021-03-10T13:43:25.377 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.377 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.377 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.378 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_step": { 2021-03-10T13:43:25.378 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_step", 2021-03-10T13:43:25.378 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2021-03-10T13:43:25.378 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.378 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.379 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0.5", 2021-03-10T13:43:25.379 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0.001", 2021-03-10T13:43:25.379 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "0.999", 2021-03-10T13:43:25.379 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.379 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "aggressiveness of optimization", 2021-03-10T13:43:25.379 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": ".99 is very aggressive, .01 is less aggressive", 2021-03-10T13:43:25.380 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.380 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.380 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.380 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_time": { 2021-03-10T13:43:25.380 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_time", 2021-03-10T13:43:25.381 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.381 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.381 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.381 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2400", 2021-03-10T13:43:25.381 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.382 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.382 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.382 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "ending time of day to automatically balance", 2021-03-10T13:43:25.382 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2021-03-10T13:43:25.382 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.383 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.383 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.383 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_weekday": { 2021-03-10T13:43:25.383 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_weekday", 2021-03-10T13:43:25.383 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2021-03-10T13:43:25.384 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.384 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.384 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2021-03-10T13:43:25.384 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2021-03-10T13:43:25.384 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2021-03-10T13:43:25.385 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.385 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to days of the week earlier than this", 2021-03-10T13:43:25.385 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2021-03-10T13:43:25.385 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.385 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.385 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.386 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:25.386 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:25.386 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.386 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.386 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.387 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.387 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.387 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.387 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.387 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:25.388 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:25.388 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:25.388 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:25.388 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:25.388 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:25.388 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.389 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.389 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.389 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.389 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.389 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.390 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:25.390 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:25.390 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.390 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.390 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.391 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.391 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.391 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.391 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.391 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.391 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.392 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.392 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.392 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.392 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:25.392 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:25.393 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.393 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.393 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.393 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:25.393 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.393 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.394 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.394 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:25.394 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:25.394 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:25.394 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:25.395 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:25.395 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:25.395 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.395 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.395 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.396 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.396 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.396 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.396 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:25.396 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:25.397 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.397 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.397 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.397 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.397 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.397 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.398 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.398 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.398 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.398 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.398 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.399 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.399 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_score": { 2021-03-10T13:43:25.399 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_score", 2021-03-10T13:43:25.399 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2021-03-10T13:43:25.399 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.400 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.400 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2021-03-10T13:43:25.400 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.400 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.400 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.400 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "minimum score, below which no optimization is attempted", 2021-03-10T13:43:25.401 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.401 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.401 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.401 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.401 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2021-03-10T13:43:25.402 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2021-03-10T13:43:25.402 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.402 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.402 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.402 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "none", 2021-03-10T13:43:25.403 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.403 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.403 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.403 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush-compat", 2021-03-10T13:43:25.404 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "none", 2021-03-10T13:43:25.404 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap" 2021-03-10T13:43:25.404 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.404 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Balancer mode", 2021-03-10T13:43:25.404 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.405 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.405 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.405 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.405 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_ids": { 2021-03-10T13:43:25.405 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_ids", 2021-03-10T13:43:25.406 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.406 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.406 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.406 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.406 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.407 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.407 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.407 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "pools which the automatic balancing will be limited to", 2021-03-10T13:43:25.407 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.408 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.408 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.408 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.408 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2021-03-10T13:43:25.408 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2021-03-10T13:43:25.409 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:43:25.409 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.409 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.409 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2021-03-10T13:43:25.409 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.409 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.410 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.410 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and attempt optimization", 2021-03-10T13:43:25.410 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.410 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.411 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.411 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.411 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_deviation": { 2021-03-10T13:43:25.411 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_deviation", 2021-03-10T13:43:25.411 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:25.412 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.412 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.412 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2021-03-10T13:43:25.412 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2021-03-10T13:43:25.412 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.413 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.413 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "deviation below which no optimization is attempted", 2021-03-10T13:43:25.413 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2021-03-10T13:43:25.413 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.413 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.414 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.414 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_optimizations": { 2021-03-10T13:43:25.414 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_optimizations", 2021-03-10T13:43:25.414 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2021-03-10T13:43:25.414 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.415 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.415 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2021-03-10T13:43:25.415 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.415 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.416 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.416 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum upmap optimizations to make per attempt", 2021-03-10T13:43:25.416 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.416 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.416 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.417 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:25.417 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:25.417 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.417 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:25.417 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "cephadm", 2021-03-10T13:43:25.418 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:25.418 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:25.418 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:25.418 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "allow_ptrace": { 2021-03-10T13:43:25.418 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "allow_ptrace", 2021-03-10T13:43:25.419 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.419 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.419 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.419 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.419 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.419 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.420 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.420 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "allow SYS_PTRACE capability on ceph containers", 2021-03-10T13:43:25.420 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2021-03-10T13:43:25.420 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.421 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.421 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.421 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "container_image_base": { 2021-03-10T13:43:25.421 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "container_image_base", 2021-03-10T13:43:25.421 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.421 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.422 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.422 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph/ceph", 2021-03-10T13:43:25.422 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.422 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.422 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.423 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Container image name, without the tag", 2021-03-10T13:43:25.423 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.423 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.423 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.423 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.424 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "daemon_cache_timeout": { 2021-03-10T13:43:25.424 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "daemon_cache_timeout", 2021-03-10T13:43:25.424 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:43:25.424 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.424 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.425 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2021-03-10T13:43:25.425 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.425 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.425 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.425 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache service (daemon) inventory", 2021-03-10T13:43:25.426 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.426 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.426 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.426 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.426 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_cache_timeout": { 2021-03-10T13:43:25.426 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_cache_timeout", 2021-03-10T13:43:25.427 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:43:25.427 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.427 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.427 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1800", 2021-03-10T13:43:25.427 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.428 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.428 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.428 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache device inventory", 2021-03-10T13:43:25.428 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.429 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.429 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.429 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.429 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "host_check_interval": { 2021-03-10T13:43:25.429 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "host_check_interval", 2021-03-10T13:43:25.429 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:43:25.430 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.430 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.430 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2021-03-10T13:43:25.430 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.430 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.431 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.431 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to perform a host check", 2021-03-10T13:43:25.431 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.431 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.431 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.432 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.432 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:25.432 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:25.432 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.432 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.432 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.433 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.433 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.433 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.433 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.433 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:25.434 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:25.434 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:25.434 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:25.434 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:25.434 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:25.434 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.435 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.435 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.435 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.435 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.436 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.436 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:25.436 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:25.436 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.436 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.437 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.437 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:25.437 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.437 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.437 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.438 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "log to the \"cephadm\" cluster log channel\"", 2021-03-10T13:43:25.438 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.438 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.438 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.438 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.439 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:25.439 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:25.439 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.439 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.439 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.440 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:25.440 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.440 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.440 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.440 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:25.441 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:25.441 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:25.441 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:25.441 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:25.441 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:25.442 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.442 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.442 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.442 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.442 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.443 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.443 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:25.443 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:25.443 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.443 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.444 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.444 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.444 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.444 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.444 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.445 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.445 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.445 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.445 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.445 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.446 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2021-03-10T13:43:25.446 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2021-03-10T13:43:25.446 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.446 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.446 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.447 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "root", 2021-03-10T13:43:25.447 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.447 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.447 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.447 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm-package", 2021-03-10T13:43:25.447 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "root" 2021-03-10T13:43:25.448 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.448 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "mode for remote execution of cephadm", 2021-03-10T13:43:25.448 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.448 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.448 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.449 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.449 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssh_config_file": { 2021-03-10T13:43:25.449 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssh_config_file", 2021-03-10T13:43:25.449 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.449 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.450 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.450 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:43:25.450 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.450 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.450 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.451 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "customized SSH config file to connect to managed hosts", 2021-03-10T13:43:25.451 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.451 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.451 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.451 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.451 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_failed_host_check": { 2021-03-10T13:43:25.452 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_failed_host_check", 2021-03-10T13:43:25.452 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.452 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.452 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.452 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:25.453 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.453 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.453 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.453 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if the host check fails", 2021-03-10T13:43:25.453 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.454 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.454 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.454 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.454 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_daemons": { 2021-03-10T13:43:25.454 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_daemons", 2021-03-10T13:43:25.455 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.455 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.455 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.455 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:25.455 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.455 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.456 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.456 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2021-03-10T13:43:25.456 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.456 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.457 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.457 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.457 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_hosts": { 2021-03-10T13:43:25.457 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_hosts", 2021-03-10T13:43:25.457 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.458 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.458 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.458 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:25.458 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.458 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.459 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.459 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2021-03-10T13:43:25.459 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.459 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.459 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.460 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:25.460 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:25.460 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.460 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:25.460 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crash", 2021-03-10T13:43:25.461 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:25.461 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:25.461 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:25.461 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:25.461 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:25.462 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.462 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.462 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.462 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.462 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.463 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.463 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.463 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:25.463 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:25.463 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:25.464 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:25.464 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:25.464 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:25.464 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.465 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.465 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.465 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.465 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.465 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.466 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:25.466 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:25.466 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.466 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.466 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.467 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.467 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.467 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.467 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.467 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.468 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.468 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.468 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.468 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.468 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:25.469 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:25.469 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.469 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.469 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.469 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:25.470 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.470 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.470 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.470 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:25.470 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:25.471 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:25.471 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:25.471 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:25.471 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:25.471 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.472 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.472 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.472 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.472 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.472 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.473 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:25.473 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:25.473 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.473 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.473 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.473 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.474 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.474 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.474 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.474 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.475 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.475 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.475 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.475 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.475 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retain_interval": { 2021-03-10T13:43:25.476 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retain_interval", 2021-03-10T13:43:25.476 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:43:25.476 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.476 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.476 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "31536000", 2021-03-10T13:43:25.476 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.477 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.477 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.477 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain crashes before pruning them", 2021-03-10T13:43:25.477 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.477 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.478 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.478 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.478 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_recent_interval": { 2021-03-10T13:43:25.478 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_recent_interval", 2021-03-10T13:43:25.478 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:43:25.479 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.479 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.479 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1209600", 2021-03-10T13:43:25.479 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.479 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.479 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.480 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "time interval in which to warn about recent crashes", 2021-03-10T13:43:25.480 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.480 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.480 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.480 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:25.481 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:25.481 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.481 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:25.481 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "dashboard", 2021-03-10T13:43:25.481 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:25.481 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:25.482 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:25.482 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ALERTMANAGER_API_HOST": { 2021-03-10T13:43:25.482 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ALERTMANAGER_API_HOST", 2021-03-10T13:43:25.482 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.482 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.483 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.483 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.483 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.483 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.483 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.484 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.484 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.484 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.484 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.484 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.484 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_ENABLED": { 2021-03-10T13:43:25.485 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_ENABLED", 2021-03-10T13:43:25.485 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.485 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.485 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.485 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.486 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.486 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.486 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.486 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.486 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.487 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.487 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.487 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.487 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_LOG_PAYLOAD": { 2021-03-10T13:43:25.487 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_LOG_PAYLOAD", 2021-03-10T13:43:25.487 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.488 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.488 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.488 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:25.488 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.488 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.489 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.489 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.489 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.489 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.489 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.489 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.490 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ENABLE_BROWSABLE_API": { 2021-03-10T13:43:25.490 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ENABLE_BROWSABLE_API", 2021-03-10T13:43:25.490 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.490 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.490 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.491 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:25.491 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.491 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.491 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.491 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.492 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.492 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.492 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.492 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.492 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_cephfs": { 2021-03-10T13:43:25.492 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_cephfs", 2021-03-10T13:43:25.493 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.493 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.493 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.493 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:25.493 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.494 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.494 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.494 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.494 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.494 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.494 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.495 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.495 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_iscsi": { 2021-03-10T13:43:25.495 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_iscsi", 2021-03-10T13:43:25.495 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.495 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.496 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.496 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:25.496 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.496 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.496 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.496 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.497 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.497 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.497 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.497 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.497 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_mirroring": { 2021-03-10T13:43:25.498 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_mirroring", 2021-03-10T13:43:25.498 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.498 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.498 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.498 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:25.499 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.499 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.499 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.499 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.499 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.499 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.500 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.500 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.500 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_nfs": { 2021-03-10T13:43:25.500 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_nfs", 2021-03-10T13:43:25.500 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.501 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.501 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.501 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:25.501 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.501 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.501 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.502 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.502 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.502 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.502 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.502 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.503 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rbd": { 2021-03-10T13:43:25.503 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rbd", 2021-03-10T13:43:25.503 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.503 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.503 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.504 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:25.504 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.504 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.504 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.504 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.504 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.505 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.505 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.505 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.505 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rgw": { 2021-03-10T13:43:25.505 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rgw", 2021-03-10T13:43:25.506 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.506 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.506 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.506 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:25.506 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.507 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.507 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.507 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.507 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.507 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.508 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.508 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.508 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2021-03-10T13:43:25.508 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2021-03-10T13:43:25.508 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.509 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.509 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.509 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.509 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.509 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.510 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.510 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.510 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.510 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.510 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.510 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.511 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_PASSWORD": { 2021-03-10T13:43:25.511 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_PASSWORD", 2021-03-10T13:43:25.511 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.511 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.511 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.512 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2021-03-10T13:43:25.512 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.512 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.512 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.512 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.513 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.513 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.513 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.513 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.513 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_SSL_VERIFY": { 2021-03-10T13:43:25.514 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_SSL_VERIFY", 2021-03-10T13:43:25.514 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.514 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.514 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.514 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:25.515 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.515 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.515 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.515 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.515 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.515 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.516 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.516 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.516 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_URL": { 2021-03-10T13:43:25.516 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_URL", 2021-03-10T13:43:25.516 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.517 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.517 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.517 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.517 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.517 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.517 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.518 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.518 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.518 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.518 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.518 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.519 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_USERNAME": { 2021-03-10T13:43:25.519 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_USERNAME", 2021-03-10T13:43:25.519 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.519 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.519 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.520 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2021-03-10T13:43:25.520 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.520 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.520 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.520 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.521 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.521 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.521 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.521 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.521 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_UPDATE_DASHBOARDS": { 2021-03-10T13:43:25.521 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_UPDATE_DASHBOARDS", 2021-03-10T13:43:25.522 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.522 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.522 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.522 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.522 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.523 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.523 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.523 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.523 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.523 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.523 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.524 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.524 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ISCSI_API_SSL_VERIFICATION": { 2021-03-10T13:43:25.524 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ISCSI_API_SSL_VERIFICATION", 2021-03-10T13:43:25.524 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.524 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.525 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.525 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:25.525 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.525 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.525 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.525 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.526 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.526 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.526 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.526 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.526 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PROMETHEUS_API_HOST": { 2021-03-10T13:43:25.527 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PROMETHEUS_API_HOST", 2021-03-10T13:43:25.527 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.527 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.527 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.527 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.528 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.528 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.528 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.528 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.528 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.529 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.529 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.529 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.529 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2021-03-10T13:43:25.529 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2021-03-10T13:43:25.529 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.530 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.530 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.530 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.530 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.530 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.531 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.531 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.531 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.531 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.531 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.532 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.532 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2021-03-10T13:43:25.532 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2021-03-10T13:43:25.532 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.532 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.532 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.533 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.533 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.533 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.533 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.533 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.534 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.534 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.534 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.534 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.534 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2021-03-10T13:43:25.534 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2021-03-10T13:43:25.535 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.535 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.535 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.535 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:25.535 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.536 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.536 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.536 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.536 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.536 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.537 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.537 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.537 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2021-03-10T13:43:25.537 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2021-03-10T13:43:25.537 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.537 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.538 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.538 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:25.538 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.538 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.538 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.539 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.539 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.539 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.539 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.539 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.540 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2021-03-10T13:43:25.540 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2021-03-10T13:43:25.540 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.540 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.540 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.540 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.541 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.541 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.541 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.541 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.541 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.542 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.542 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.542 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.542 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2021-03-10T13:43:25.542 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2021-03-10T13:43:25.543 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.543 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.543 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.543 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.543 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.543 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.544 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.544 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.544 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.544 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.544 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.545 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.545 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2021-03-10T13:43:25.545 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2021-03-10T13:43:25.545 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.545 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.545 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.546 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.546 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.546 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.546 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.546 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.547 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.547 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.547 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.547 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.547 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_ENABLED": { 2021-03-10T13:43:25.548 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_ENABLED", 2021-03-10T13:43:25.548 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.548 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.548 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.548 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:25.548 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.549 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.549 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.549 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.549 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.549 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.550 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.550 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.550 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_EXCLUSION_LIST": { 2021-03-10T13:43:25.550 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_EXCLUSION_LIST", 2021-03-10T13:43:25.550 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.551 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.551 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.551 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2021-03-10T13:43:25.551 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.551 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.551 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.552 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.552 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.552 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.552 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.552 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.553 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_COMPLEXITY": { 2021-03-10T13:43:25.553 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_COMPLEXITY", 2021-03-10T13:43:25.553 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:25.553 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.553 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.553 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2021-03-10T13:43:25.554 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.554 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.554 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.554 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.554 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.555 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.555 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.555 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.555 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_LENGTH": { 2021-03-10T13:43:25.555 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_LENGTH", 2021-03-10T13:43:25.556 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:25.556 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.556 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.556 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8", 2021-03-10T13:43:25.556 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.556 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.557 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.557 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.557 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.557 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.557 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.558 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.558 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "REST_REQUESTS_TIMEOUT": { 2021-03-10T13:43:25.558 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "REST_REQUESTS_TIMEOUT", 2021-03-10T13:43:25.558 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:25.559 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.559 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.559 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "45", 2021-03-10T13:43:25.559 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.559 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.560 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.560 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.560 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.560 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.560 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.561 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.561 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ACCESS_KEY": { 2021-03-10T13:43:25.561 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ACCESS_KEY", 2021-03-10T13:43:25.561 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.561 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.561 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.562 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.562 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.562 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.562 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.562 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.563 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.563 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.563 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.563 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.563 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ADMIN_RESOURCE": { 2021-03-10T13:43:25.564 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ADMIN_RESOURCE", 2021-03-10T13:43:25.564 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.564 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.564 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.564 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2021-03-10T13:43:25.565 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.565 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.565 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.565 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.565 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.566 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.566 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.566 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.566 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_HOST": { 2021-03-10T13:43:25.566 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_HOST", 2021-03-10T13:43:25.567 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.567 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.567 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.567 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.567 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.568 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.568 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.568 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.568 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.568 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.569 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.569 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.569 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_PORT": { 2021-03-10T13:43:25.569 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_PORT", 2021-03-10T13:43:25.569 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:25.570 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.570 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.570 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "80", 2021-03-10T13:43:25.570 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.571 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.571 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.571 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.571 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.571 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.572 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.572 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.572 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SCHEME": { 2021-03-10T13:43:25.572 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SCHEME", 2021-03-10T13:43:25.572 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.573 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.573 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.573 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "http", 2021-03-10T13:43:25.573 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.573 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.574 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.574 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.574 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.574 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.574 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.575 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.575 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SECRET_KEY": { 2021-03-10T13:43:25.575 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SECRET_KEY", 2021-03-10T13:43:25.575 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.576 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.576 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.576 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.576 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.576 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.577 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.577 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.577 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.577 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.577 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.577 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.578 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SSL_VERIFY": { 2021-03-10T13:43:25.578 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SSL_VERIFY", 2021-03-10T13:43:25.578 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.578 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.579 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.579 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:25.579 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.579 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.579 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.580 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.580 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.580 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.580 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.580 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.581 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_USER_ID": { 2021-03-10T13:43:25.581 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_USER_ID", 2021-03-10T13:43:25.581 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.581 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.581 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.581 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.582 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.582 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.582 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.582 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.582 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.583 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.583 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.583 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.583 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_SPAN": { 2021-03-10T13:43:25.583 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_SPAN", 2021-03-10T13:43:25.584 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:25.584 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.584 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.584 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2021-03-10T13:43:25.584 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.585 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.585 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.585 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.585 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.585 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.585 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.586 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.586 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_1": { 2021-03-10T13:43:25.586 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_1", 2021-03-10T13:43:25.586 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:25.586 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.587 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.587 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2021-03-10T13:43:25.587 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.587 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.587 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.588 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.588 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.588 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.588 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.588 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.589 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_2": { 2021-03-10T13:43:25.589 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_2", 2021-03-10T13:43:25.589 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:25.589 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.590 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.590 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2021-03-10T13:43:25.590 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.590 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.590 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.591 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.591 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.591 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.591 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.591 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.592 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crt_file": { 2021-03-10T13:43:25.592 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crt_file", 2021-03-10T13:43:25.592 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.592 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.592 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.593 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.593 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.593 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.593 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.593 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.594 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.594 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.594 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.594 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.594 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug": { 2021-03-10T13:43:25.595 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "debug", 2021-03-10T13:43:25.595 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.595 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.595 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.595 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.596 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.596 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.596 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.596 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Enable/disable debug options", 2021-03-10T13:43:25.596 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.596 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.597 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.597 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.597 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "jwt_token_ttl": { 2021-03-10T13:43:25.597 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "jwt_token_ttl", 2021-03-10T13:43:25.597 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:25.598 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.598 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.598 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "28800", 2021-03-10T13:43:25.598 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.599 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.599 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.599 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.599 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.599 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.599 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.600 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.600 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2021-03-10T13:43:25.600 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2021-03-10T13:43:25.600 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.600 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.601 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.601 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.601 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.601 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.601 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.602 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.602 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.602 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.602 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.602 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.602 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:25.603 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:25.603 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.603 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.603 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.603 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.604 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.604 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.604 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.604 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:25.605 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:25.605 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:25.605 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:25.605 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:25.605 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:25.606 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.606 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.606 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.606 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.606 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.607 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.607 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:25.607 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:25.607 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.607 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.608 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.608 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.608 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.608 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.608 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.609 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.609 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.609 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.609 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.609 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.610 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:25.610 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:25.610 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.610 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.610 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.611 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:25.611 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.611 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.611 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.611 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:25.611 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:25.612 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:25.612 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:25.612 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:25.612 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:25.612 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.613 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.613 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.613 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.613 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.613 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.613 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:25.614 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:25.614 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.614 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.614 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.614 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.615 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.615 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.615 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.615 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.615 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.616 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.616 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.616 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.616 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2021-03-10T13:43:25.616 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2021-03-10T13:43:25.616 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.617 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.617 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.617 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.617 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.617 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.618 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.618 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.618 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.618 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.618 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.618 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.619 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2021-03-10T13:43:25.619 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2021-03-10T13:43:25.619 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.619 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.619 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.620 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "::", 2021-03-10T13:43:25.620 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.620 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.620 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.620 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.620 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.621 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.621 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.621 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.621 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2021-03-10T13:43:25.621 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2021-03-10T13:43:25.622 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:25.622 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.622 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.622 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8080", 2021-03-10T13:43:25.622 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.623 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.623 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.623 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.623 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.623 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.623 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.624 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.624 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2021-03-10T13:43:25.624 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2021-03-10T13:43:25.624 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.624 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.625 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.625 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:25.625 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.625 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.625 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.625 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.626 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.626 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.626 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.626 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.626 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl_server_port": { 2021-03-10T13:43:25.627 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl_server_port", 2021-03-10T13:43:25.627 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:25.627 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.627 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.627 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8443", 2021-03-10T13:43:25.627 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.628 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.628 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.628 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.628 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.628 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.629 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.629 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.629 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_behaviour": { 2021-03-10T13:43:25.629 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_behaviour", 2021-03-10T13:43:25.629 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.630 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.630 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.630 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "redirect", 2021-03-10T13:43:25.630 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.630 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.630 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.631 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:25.631 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "redirect" 2021-03-10T13:43:25.631 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.631 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.631 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.632 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.632 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.632 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.632 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_error_status_code": { 2021-03-10T13:43:25.632 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_error_status_code", 2021-03-10T13:43:25.632 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:25.633 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.633 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.633 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "500", 2021-03-10T13:43:25.633 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "400", 2021-03-10T13:43:25.633 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "599", 2021-03-10T13:43:25.634 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.634 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.634 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.634 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.634 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.635 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.635 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url_prefix": { 2021-03-10T13:43:25.635 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url_prefix", 2021-03-10T13:43:25.635 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.635 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.636 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.636 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.636 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.636 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.636 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.636 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.637 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.637 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.637 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.637 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.637 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2021-03-10T13:43:25.638 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2021-03-10T13:43:25.638 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.638 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.638 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.639 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.639 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.639 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.639 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.639 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.640 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.640 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.640 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.640 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:25.640 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:25.640 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.641 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:25.641 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "devicehealth", 2021-03-10T13:43:25.641 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:25.641 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:25.641 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:25.642 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enable_monitoring": { 2021-03-10T13:43:25.642 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enable_monitoring", 2021-03-10T13:43:25.642 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.642 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.642 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.643 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:25.643 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.643 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.643 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.643 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "monitor device health metrics", 2021-03-10T13:43:25.644 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.644 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.644 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.644 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.644 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:25.645 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:25.645 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.645 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.645 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.645 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.646 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.646 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.646 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.646 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:25.646 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:25.647 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:25.647 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:25.647 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:25.647 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:25.647 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.648 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.648 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.648 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.648 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.648 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.648 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:25.649 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:25.649 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.649 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.649 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.649 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.650 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.650 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.650 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.650 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.650 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.651 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.651 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.651 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.651 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:25.651 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:25.652 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.652 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.652 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.652 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:25.652 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.653 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.653 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.653 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:25.653 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:25.653 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:25.654 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:25.654 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:25.654 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:25.654 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.654 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.655 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.655 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.655 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.655 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.655 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:25.655 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:25.656 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.656 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.656 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.656 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.656 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.657 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.657 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.657 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.657 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.657 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.657 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.658 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.658 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mark_out_threshold": { 2021-03-10T13:43:25.658 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mark_out_threshold", 2021-03-10T13:43:25.658 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:43:25.659 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.659 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.659 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2419200", 2021-03-10T13:43:25.659 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.659 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.660 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.660 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically mark OSD if it may fail before this long", 2021-03-10T13:43:25.660 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.660 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.660 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.660 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.661 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_name": { 2021-03-10T13:43:25.661 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_name", 2021-03-10T13:43:25.661 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.661 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.661 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.662 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "device_health_metrics", 2021-03-10T13:43:25.662 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.662 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.662 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.662 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name of pool in which to store device health metrics", 2021-03-10T13:43:25.663 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.663 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.663 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.663 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.663 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retention_period": { 2021-03-10T13:43:25.663 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retention_period", 2021-03-10T13:43:25.664 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:43:25.664 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.664 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.664 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15552000", 2021-03-10T13:43:25.664 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.665 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.665 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.665 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain device health metrics", 2021-03-10T13:43:25.665 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.665 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.665 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.666 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.666 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_frequency": { 2021-03-10T13:43:25.666 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_frequency", 2021-03-10T13:43:25.666 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:43:25.666 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.667 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.667 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2021-03-10T13:43:25.667 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.667 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.667 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.668 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to scrape device health metrics", 2021-03-10T13:43:25.668 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.668 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.668 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.668 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.669 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "self_heal": { 2021-03-10T13:43:25.669 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "self_heal", 2021-03-10T13:43:25.669 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.669 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.669 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.669 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:25.670 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.670 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.670 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.670 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "preemptively heal cluster around devices that may fail", 2021-03-10T13:43:25.671 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.671 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.671 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.671 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.671 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2021-03-10T13:43:25.672 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2021-03-10T13:43:25.672 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:43:25.672 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.672 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.672 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2021-03-10T13:43:25.673 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.673 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.673 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.673 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and check device health", 2021-03-10T13:43:25.673 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.674 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.674 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.674 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.674 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_threshold": { 2021-03-10T13:43:25.674 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_threshold", 2021-03-10T13:43:25.675 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:43:25.675 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.675 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.675 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7257600", 2021-03-10T13:43:25.675 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.676 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.676 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.676 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise health warning if OSD may fail before this long", 2021-03-10T13:43:25.676 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.676 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.677 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.677 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:25.677 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:25.677 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.677 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:25.677 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "diskprediction_local", 2021-03-10T13:43:25.678 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:25.678 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:25.678 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:25.678 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:25.679 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:25.679 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.679 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.679 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.679 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.679 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.680 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.680 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.680 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:25.680 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:25.680 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:25.681 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:25.681 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:25.681 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:25.681 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.681 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.681 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.682 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.682 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.682 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.682 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:25.682 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:25.683 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.683 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.683 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.683 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.683 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.683 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.684 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.684 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.684 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.684 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.684 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.685 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.685 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:25.685 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:25.685 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.685 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.685 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.686 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:25.686 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.686 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.686 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.686 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:25.687 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:25.687 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:25.687 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:25.687 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:25.687 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:25.688 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.688 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.688 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.688 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.688 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.688 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.689 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:25.689 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:25.689 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.689 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.689 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.690 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.690 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.690 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.690 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.690 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.690 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.691 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.691 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.691 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.691 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predict_interval": { 2021-03-10T13:43:25.691 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predict_interval", 2021-03-10T13:43:25.692 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.692 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.692 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.692 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2021-03-10T13:43:25.692 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.693 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.693 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.693 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.693 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.693 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.693 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.694 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.694 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predictor_model": { 2021-03-10T13:43:25.694 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predictor_model", 2021-03-10T13:43:25.694 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.694 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.695 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.695 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "prophetstor", 2021-03-10T13:43:25.695 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.695 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.695 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.696 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.696 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.696 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.696 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.696 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.697 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2021-03-10T13:43:25.697 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2021-03-10T13:43:25.697 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.697 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.697 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.698 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2021-03-10T13:43:25.698 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.698 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.698 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.698 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.699 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.699 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.699 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.699 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:25.699 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:25.700 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.700 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:25.700 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "influx", 2021-03-10T13:43:25.700 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": false, 2021-03-10T13:43:25.700 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "influxdb python module not found", 2021-03-10T13:43:25.700 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:25.701 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "batch_size": { 2021-03-10T13:43:25.701 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "batch_size", 2021-03-10T13:43:25.701 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.701 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.701 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.702 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5000", 2021-03-10T13:43:25.702 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.702 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.702 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.702 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.703 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.703 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.703 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.703 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.704 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "database": { 2021-03-10T13:43:25.704 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "database", 2021-03-10T13:43:25.704 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.704 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.704 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.705 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph", 2021-03-10T13:43:25.705 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.705 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.705 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.705 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.705 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.706 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.706 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.706 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.706 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "hostname": { 2021-03-10T13:43:25.706 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "hostname", 2021-03-10T13:43:25.707 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.707 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.707 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.707 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:43:25.708 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.708 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.708 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.708 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.708 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.709 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.709 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.709 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.709 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T13:43:25.709 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T13:43:25.710 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.710 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.710 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.710 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "30", 2021-03-10T13:43:25.710 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.711 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.711 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.711 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.711 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.711 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.711 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.712 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.712 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:25.712 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:25.712 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.712 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.713 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.713 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.713 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.713 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.713 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.714 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:25.714 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:25.714 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:25.714 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:25.714 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:25.714 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:25.715 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.715 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.715 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.715 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.715 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.716 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.716 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:25.716 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:25.716 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.716 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.717 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.717 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.717 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.717 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.717 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.717 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.718 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.718 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.718 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.718 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.718 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:25.719 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:25.719 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.719 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.719 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.719 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:25.720 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.720 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.720 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.720 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:25.720 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:25.720 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:25.721 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:25.721 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:25.721 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:25.721 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.721 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.722 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.722 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.722 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.722 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.722 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:25.723 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:25.723 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.723 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.723 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.723 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.723 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.724 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.724 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.724 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.724 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.724 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.725 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.725 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.725 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2021-03-10T13:43:25.725 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2021-03-10T13:43:25.725 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.725 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.726 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.726 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:43:25.726 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.726 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.726 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.727 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.727 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.727 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.727 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.727 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.728 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "port": { 2021-03-10T13:43:25.728 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "port", 2021-03-10T13:43:25.728 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.728 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.729 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.729 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8086", 2021-03-10T13:43:25.729 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.729 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.729 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.729 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.730 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.730 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.730 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.730 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.731 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2021-03-10T13:43:25.731 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2021-03-10T13:43:25.731 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.731 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.731 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.732 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "false", 2021-03-10T13:43:25.732 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.732 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.732 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.732 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.732 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.733 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.733 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.733 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.733 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "threads": { 2021-03-10T13:43:25.733 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "threads", 2021-03-10T13:43:25.734 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.734 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.734 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.734 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2021-03-10T13:43:25.734 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.735 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.735 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.735 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.735 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.735 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.736 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.736 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.736 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2021-03-10T13:43:25.736 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2021-03-10T13:43:25.736 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.736 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.737 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.737 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:43:25.737 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.737 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.737 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.738 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.738 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.738 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.738 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.738 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.739 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "verify_ssl": { 2021-03-10T13:43:25.739 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "verify_ssl", 2021-03-10T13:43:25.739 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.739 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.739 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.739 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "true", 2021-03-10T13:43:25.740 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.740 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.740 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.740 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.740 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.741 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.741 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.741 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:25.741 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:25.741 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.742 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:25.742 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "insights", 2021-03-10T13:43:25.742 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:25.742 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:25.742 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:25.743 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:25.743 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:25.743 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.743 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.743 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.744 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.744 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.744 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.744 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.744 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:25.744 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:25.745 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:25.745 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:25.745 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:25.745 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:25.745 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.746 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.746 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.746 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.746 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.746 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.746 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:25.747 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:25.747 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.747 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.747 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.747 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.748 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.748 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.748 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.748 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.748 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.749 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.749 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.749 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.749 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:25.749 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:25.750 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.750 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.750 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.750 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:25.750 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.750 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.751 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.751 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:25.751 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:25.751 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:25.751 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:25.752 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:25.752 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:25.752 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.752 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.752 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.753 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.753 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.753 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.753 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:25.753 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:25.753 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.754 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.754 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.754 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.754 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.754 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.755 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.755 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.755 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.755 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.755 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.756 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:25.756 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:25.756 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.756 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:25.756 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "iostat", 2021-03-10T13:43:25.756 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:25.757 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:25.757 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:25.757 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:25.757 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:25.757 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.758 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.758 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.758 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.758 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.758 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.759 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.759 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:25.759 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:25.759 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:25.759 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:25.760 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:25.760 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:25.760 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.760 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.760 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.761 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.761 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.761 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.761 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:25.761 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:25.761 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.762 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.762 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.762 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.762 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.762 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.763 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.763 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.763 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.763 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.763 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.763 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.764 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:25.764 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:25.764 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.764 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.764 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.765 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:25.765 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.765 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.765 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.765 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:25.765 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:25.766 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:25.766 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:25.766 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:25.766 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:25.766 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.767 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.767 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.767 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.767 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.767 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.768 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:25.768 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:25.768 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.768 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.768 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.768 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.769 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.769 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.769 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.769 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.769 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.770 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.770 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.770 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:25.770 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:25.770 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.770 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:25.771 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "k8sevents", 2021-03-10T13:43:25.771 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:25.771 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:25.771 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:25.771 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ceph_event_retention_days": { 2021-03-10T13:43:25.772 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ceph_event_retention_days", 2021-03-10T13:43:25.772 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:25.772 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.772 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.772 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2021-03-10T13:43:25.773 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.773 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.773 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.773 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Days to hold ceph event information within local cache", 2021-03-10T13:43:25.773 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.774 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.774 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.774 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.774 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "config_check_secs": { 2021-03-10T13:43:25.774 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "config_check_secs", 2021-03-10T13:43:25.774 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:25.775 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.775 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.775 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2021-03-10T13:43:25.775 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "10", 2021-03-10T13:43:25.775 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.776 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.776 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "interval (secs) to check for cluster configuration changes", 2021-03-10T13:43:25.776 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.776 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.776 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.777 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.777 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:25.777 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:25.777 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.777 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.777 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.778 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.778 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.778 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.778 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.778 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:25.779 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:25.779 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:25.779 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:25.779 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:25.779 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:25.780 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.780 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.780 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.780 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.780 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.780 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.781 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:25.781 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:25.781 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.781 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.781 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.782 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.782 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.782 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.782 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.782 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.782 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.783 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.783 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.783 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.783 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:25.783 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:25.784 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.784 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.784 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.784 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:25.784 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.784 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.785 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.785 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:25.785 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:25.785 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:25.785 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:25.786 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:25.786 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:25.786 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.786 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.786 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.786 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.787 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.787 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.787 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:25.787 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:25.787 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.788 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.788 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.788 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.788 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.788 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.789 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.789 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.789 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.789 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.789 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.789 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:25.790 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:25.790 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.790 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:25.790 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "localpool", 2021-03-10T13:43:25.790 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:25.791 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:25.791 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:25.791 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "failure_domain": { 2021-03-10T13:43:25.791 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "failure_domain", 2021-03-10T13:43:25.791 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.791 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.792 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.792 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "host", 2021-03-10T13:43:25.792 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.792 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.792 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.793 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "failure domain for any created local pool", 2021-03-10T13:43:25.793 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.793 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.793 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.793 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.793 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:25.794 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:25.794 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.794 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.794 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.794 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.795 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.795 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.795 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.795 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:25.795 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:25.796 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:25.796 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:25.796 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:25.796 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:25.796 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.796 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.797 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.797 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.797 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.797 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.798 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:25.798 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:25.798 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.798 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.798 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.799 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.799 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.799 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.799 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.799 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.800 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.800 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.800 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.800 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.800 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:25.801 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:25.801 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.801 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.801 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.801 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:25.801 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.802 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.802 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.802 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:25.802 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:25.802 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:25.803 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:25.803 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:25.803 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:25.803 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.803 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.804 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.804 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.804 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.804 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.804 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:25.805 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:25.805 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.805 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.805 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.805 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.806 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.806 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.806 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.806 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.806 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.807 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.807 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.807 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.807 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_size": { 2021-03-10T13:43:25.807 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_size", 2021-03-10T13:43:25.807 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:25.808 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.808 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.808 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.808 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.808 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.809 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.809 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default min_size for any created local pool", 2021-03-10T13:43:25.809 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.809 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.809 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.810 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.810 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_rep": { 2021-03-10T13:43:25.810 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "num_rep", 2021-03-10T13:43:25.810 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:25.810 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.811 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.811 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "3", 2021-03-10T13:43:25.811 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.811 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.811 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.812 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default replica count for any created local pool", 2021-03-10T13:43:25.812 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.812 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.812 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.812 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.812 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_num": { 2021-03-10T13:43:25.813 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_num", 2021-03-10T13:43:25.813 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:25.813 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.813 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.813 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "128", 2021-03-10T13:43:25.814 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.814 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.814 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.814 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default pg_num for any created local pool", 2021-03-10T13:43:25.814 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.815 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.815 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.815 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.815 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "prefix": { 2021-03-10T13:43:25.815 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prefix", 2021-03-10T13:43:25.816 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.816 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.816 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.816 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.816 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.817 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.817 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.817 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name prefix for any created local pool", 2021-03-10T13:43:25.817 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.817 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.818 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.818 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.818 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "subtree": { 2021-03-10T13:43:25.818 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "subtree", 2021-03-10T13:43:25.818 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.819 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.819 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.819 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "rack", 2021-03-10T13:43:25.819 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.819 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.820 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.820 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "CRUSH level for which to create a local pool", 2021-03-10T13:43:25.820 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.820 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.820 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.821 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:25.821 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:25.821 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.821 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:25.821 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2021-03-10T13:43:25.822 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:25.822 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:25.822 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:25.822 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:25.822 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:25.823 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.823 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.823 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.823 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.823 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.824 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.824 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.824 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:25.824 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:25.824 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:25.825 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:25.825 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:25.825 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:25.825 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.825 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.826 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.826 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.826 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.826 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.827 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:25.827 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:25.827 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.827 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.827 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.828 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.828 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.828 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.828 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.828 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.829 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.829 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.829 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.829 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.829 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:25.830 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:25.830 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.830 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.830 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.831 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:25.831 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.831 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.831 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.831 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:25.832 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:25.832 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:25.832 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:25.832 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:25.832 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:25.833 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.833 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.833 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.833 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.833 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.834 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.834 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:25.834 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:25.834 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.834 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.835 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.835 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.835 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.835 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.835 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.836 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.836 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.836 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.836 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.836 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.837 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator": { 2021-03-10T13:43:25.837 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2021-03-10T13:43:25.837 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.837 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.837 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.837 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:43:25.838 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.838 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.838 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.838 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2021-03-10T13:43:25.839 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rook", 2021-03-10T13:43:25.839 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "test_orchestrator" 2021-03-10T13:43:25.839 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.839 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Orchestrator backend", 2021-03-10T13:43:25.839 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.840 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.840 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.840 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:25.840 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:25.840 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.840 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:25.841 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "osd_support", 2021-03-10T13:43:25.841 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:25.841 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:25.841 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:25.842 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:25.842 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:25.842 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.842 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.842 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.843 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.843 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.843 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.843 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.843 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:25.844 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:25.844 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:25.844 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:25.844 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:25.844 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:25.845 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.845 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.845 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.845 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.845 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.845 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.846 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:25.846 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:25.846 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.846 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.846 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.847 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.847 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.847 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.847 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.847 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.848 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.848 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.848 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.848 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.848 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:25.849 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:25.849 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.849 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.849 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.849 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:25.850 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.850 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.850 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.850 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:25.850 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:25.851 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:25.851 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:25.851 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:25.851 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:25.851 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.852 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.852 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.852 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.852 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.852 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.853 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:25.853 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:25.853 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.853 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.853 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.853 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.854 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.854 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.854 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.854 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.854 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.855 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.855 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.855 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:25.855 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:25.855 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.856 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:25.856 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_autoscaler", 2021-03-10T13:43:25.856 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:25.856 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:25.856 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:25.857 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:25.857 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:25.857 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.857 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.857 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.858 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.858 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.858 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.858 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.858 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:25.859 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:25.859 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:25.859 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:25.859 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:25.859 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:25.860 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.860 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.860 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.860 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.860 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.861 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.861 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:25.861 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:25.861 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.861 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.861 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.862 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.862 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.862 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.862 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.862 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.863 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.863 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.863 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.863 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.863 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:25.864 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:25.864 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.864 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.864 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.864 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:25.865 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.865 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.865 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.865 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:25.865 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:25.866 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:25.866 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:25.866 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:25.866 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:25.866 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.867 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.867 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.867 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.867 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.867 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.868 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:25.868 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:25.868 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.868 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.868 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.869 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.869 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.869 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.869 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.869 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.870 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.870 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.870 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.870 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.870 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2021-03-10T13:43:25.871 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2021-03-10T13:43:25.871 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.871 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.871 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.871 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2021-03-10T13:43:25.872 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.872 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.872 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.872 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.872 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.873 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.873 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.873 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:25.873 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:25.873 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.874 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:25.874 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "progress", 2021-03-10T13:43:25.874 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:25.874 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:25.875 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:25.875 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:25.875 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:25.875 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.875 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.876 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.876 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.876 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.876 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.876 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.877 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:25.877 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:25.877 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:25.877 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:25.877 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:25.878 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:25.878 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.878 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.878 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.878 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.879 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.879 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.879 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:25.879 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:25.879 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.880 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.880 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.880 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.880 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.880 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.880 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.881 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.881 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.881 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.881 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.881 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.882 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:25.882 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:25.882 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.882 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.882 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.883 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:25.883 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.883 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.883 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.883 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:25.884 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:25.884 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:25.884 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:25.884 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:25.884 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:25.884 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.885 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.885 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.885 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.885 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.885 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.886 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:25.886 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:25.886 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.886 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.886 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.887 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.887 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.887 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.887 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.887 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.888 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.888 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.888 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.888 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.888 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max_completed_events": { 2021-03-10T13:43:25.889 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "max_completed_events", 2021-03-10T13:43:25.889 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:25.889 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.889 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.889 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "50", 2021-03-10T13:43:25.889 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.890 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.890 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.890 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "number of past completed events to remember", 2021-03-10T13:43:25.890 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.890 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.891 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.891 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.891 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "persist_interval": { 2021-03-10T13:43:25.891 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "persist_interval", 2021-03-10T13:43:25.891 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:43:25.892 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.892 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.892 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2021-03-10T13:43:25.892 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.892 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.893 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.893 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to persist completed events", 2021-03-10T13:43:25.893 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.893 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.893 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.894 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:25.894 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:25.894 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.894 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:25.894 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prometheus", 2021-03-10T13:43:25.895 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:25.895 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:25.895 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:25.895 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:25.895 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:25.895 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.896 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.896 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.896 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.896 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.896 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.897 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.897 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:25.897 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:25.897 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:25.897 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:25.898 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:25.898 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:25.898 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.898 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.898 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.899 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.899 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.899 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.899 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:25.899 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:25.899 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.900 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.900 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.900 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.900 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.900 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.901 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.901 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.901 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.901 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.901 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.902 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.902 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:25.902 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:25.902 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.902 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.903 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.903 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:25.903 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.903 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.903 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.904 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:25.904 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:25.904 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:25.904 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:25.904 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:25.905 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:25.905 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.905 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.905 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.905 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.905 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.906 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.906 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:25.906 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:25.906 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.906 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.907 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.907 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.907 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.907 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.907 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.908 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.908 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.908 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.908 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.908 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.909 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools": { 2021-03-10T13:43:25.909 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools", 2021-03-10T13:43:25.909 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.909 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.909 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.910 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.910 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.910 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.910 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.910 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.911 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.911 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.911 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.911 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.911 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools_refresh_interval": { 2021-03-10T13:43:25.911 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools_refresh_interval", 2021-03-10T13:43:25.912 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.912 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.912 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.912 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.912 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.913 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.913 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.913 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.913 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.913 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.914 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.914 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.914 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_interval": { 2021-03-10T13:43:25.914 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_interval", 2021-03-10T13:43:25.915 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.915 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.915 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.915 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.915 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.916 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.916 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.916 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.916 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.916 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.917 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.917 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.917 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2021-03-10T13:43:25.917 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2021-03-10T13:43:25.917 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.918 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.918 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.918 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.918 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.918 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.919 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.919 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.919 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.919 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.919 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.919 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.920 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2021-03-10T13:43:25.920 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2021-03-10T13:43:25.920 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.920 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.920 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.921 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.921 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.921 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.921 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.921 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.922 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.922 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.922 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.922 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:25.922 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:25.923 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.923 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:25.923 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_support", 2021-03-10T13:43:25.923 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:25.923 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:25.923 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:25.924 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:25.924 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:25.924 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.924 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.924 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.925 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.925 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.925 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.925 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.925 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:25.926 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:25.926 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:25.926 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:25.926 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:25.926 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:25.927 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.927 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.927 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.927 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.927 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.928 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.928 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:25.928 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:25.928 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.928 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.928 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.929 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.929 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.929 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.929 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.929 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.930 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.930 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.930 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.930 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.930 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:25.931 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:25.931 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.931 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.931 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.931 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:25.932 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.932 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.932 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.932 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:25.932 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:25.933 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:25.933 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:25.933 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:25.933 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:25.933 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.934 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.934 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.934 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.934 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.934 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.935 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:25.935 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:25.935 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.935 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.935 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.935 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.936 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.936 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.936 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.936 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.936 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.937 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.937 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.937 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.937 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mirror_snapshot_schedule": { 2021-03-10T13:43:25.937 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mirror_snapshot_schedule", 2021-03-10T13:43:25.938 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.938 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.938 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.938 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.938 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.939 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.939 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.939 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.939 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.939 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.940 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.940 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.940 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "trash_purge_schedule": { 2021-03-10T13:43:25.940 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "trash_purge_schedule", 2021-03-10T13:43:25.940 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.941 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.941 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.941 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.941 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.941 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.941 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.942 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.942 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.942 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.942 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.942 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:25.943 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:25.943 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.943 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:25.943 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "restful", 2021-03-10T13:43:25.943 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:25.944 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:25.944 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:25.944 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2021-03-10T13:43:25.944 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2021-03-10T13:43:25.944 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.945 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.945 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.945 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.945 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.945 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.946 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.946 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.946 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.946 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.946 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.946 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.947 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:25.947 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:25.947 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.947 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.947 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.948 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.948 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.948 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.948 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.948 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:25.949 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:25.949 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:25.949 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:25.949 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:25.949 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:25.950 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.950 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.950 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.950 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.950 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.951 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.951 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:25.951 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:25.951 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.951 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.951 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.952 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.952 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.952 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.952 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.952 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.953 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.953 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.953 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.953 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.953 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:25.954 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:25.954 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.954 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.954 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.954 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:25.955 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.955 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.955 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.955 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:25.955 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:25.955 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:25.956 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:25.956 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:25.956 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:25.956 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.956 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.957 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.957 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.957 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.957 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.957 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:25.957 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:25.958 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.958 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.958 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.958 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.958 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.959 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.959 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.959 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.959 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.959 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.960 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.960 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.960 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2021-03-10T13:43:25.960 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2021-03-10T13:43:25.960 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.961 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.961 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.961 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.961 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.961 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.962 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.962 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.962 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.962 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.962 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.963 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.963 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2021-03-10T13:43:25.963 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2021-03-10T13:43:25.963 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.963 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.964 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.964 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.964 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.964 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.964 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.965 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.965 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.965 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.965 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.965 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:25.966 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:25.966 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.966 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:25.966 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rook", 2021-03-10T13:43:25.966 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:25.966 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:25.967 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:25.967 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:25.967 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:25.967 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.967 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.968 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.968 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.968 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.968 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.968 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.969 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:25.969 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:25.969 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:25.969 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:25.969 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:25.969 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:25.970 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.970 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.970 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.970 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.970 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.971 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.971 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:25.971 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:25.971 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.971 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.972 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.972 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.972 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.972 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.972 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.972 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.973 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.973 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.973 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.973 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.974 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:25.974 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:25.974 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.974 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.974 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.975 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:25.975 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.975 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.975 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.975 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:25.976 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:25.976 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:25.976 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:25.976 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:25.976 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:25.976 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.977 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.977 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.977 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.977 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.977 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.978 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:25.978 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:25.978 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.978 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.978 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.979 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.979 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.979 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.979 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.979 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.980 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.980 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.980 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.980 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:25.980 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:25.981 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.981 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:25.981 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "selftest", 2021-03-10T13:43:25.981 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:25.981 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:25.981 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:25.982 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:25.982 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:25.982 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.982 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.982 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.983 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.983 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.983 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.983 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.983 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:25.984 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:25.984 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:25.984 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:25.984 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:25.984 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:25.984 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.985 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.985 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.985 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.985 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.985 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.986 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:25.986 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:25.986 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.986 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.986 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.987 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.987 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.987 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.987 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.987 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.987 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.988 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.988 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.988 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.988 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:25.988 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:25.989 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.989 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.989 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.989 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:25.989 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.989 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.990 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:25.990 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:25.990 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:25.990 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:25.990 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:25.991 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:25.991 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:25.991 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:25.991 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.991 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.992 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.992 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.992 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.992 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:25.992 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:25.993 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:25.993 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.993 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:25.993 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:25.993 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.993 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.994 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.994 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.994 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.995 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.995 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.995 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.995 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption1": { 2021-03-10T13:43:25.995 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption1", 2021-03-10T13:43:25.995 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.996 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.996 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.996 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:25.996 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.996 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.997 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:25.997 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:25.997 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:25.997 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:25.997 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:25.998 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:25.998 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption2": { 2021-03-10T13:43:25.998 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption2", 2021-03-10T13:43:25.998 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:25.998 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:25.999 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:25.999 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "xyz", 2021-03-10T13:43:25.999 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:25.999 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:25.999 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:26.000 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.000 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.000 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.000 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.000 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.001 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption1": { 2021-03-10T13:43:26.001 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption1", 2021-03-10T13:43:26.001 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:26.001 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.001 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:26.001 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:26.002 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.002 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.002 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:26.002 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.002 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.003 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.003 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.003 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.003 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption2": { 2021-03-10T13:43:26.003 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption2", 2021-03-10T13:43:26.004 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:26.004 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.004 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:26.004 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:26.004 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.005 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.005 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:26.005 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.005 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.005 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.005 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.006 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.006 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption3": { 2021-03-10T13:43:26.006 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption3", 2021-03-10T13:43:26.006 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2021-03-10T13:43:26.006 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.007 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:26.007 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:26.007 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.007 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.007 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:26.008 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.008 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.008 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.008 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.008 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.009 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption4": { 2021-03-10T13:43:26.009 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption4", 2021-03-10T13:43:26.009 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:26.009 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.009 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:26.010 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:26.010 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.010 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.010 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:26.010 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.011 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.011 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.011 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.011 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.011 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption5": { 2021-03-10T13:43:26.011 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption5", 2021-03-10T13:43:26.012 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:26.012 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.012 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:26.012 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:26.012 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.013 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.013 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:26.013 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.013 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.013 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.014 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.014 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.014 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption6": { 2021-03-10T13:43:26.014 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption6", 2021-03-10T13:43:26.014 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:26.015 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.015 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:26.015 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:26.015 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.015 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.015 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:26.016 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.016 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.016 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.016 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.016 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.017 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testkey": { 2021-03-10T13:43:26.017 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testkey", 2021-03-10T13:43:26.017 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:26.017 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.017 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:26.018 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:26.018 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.018 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.018 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:26.018 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.018 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.019 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.019 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.019 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.019 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testlkey": { 2021-03-10T13:43:26.019 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testlkey", 2021-03-10T13:43:26.020 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:26.020 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.020 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:26.020 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:26.020 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.020 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.021 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:26.021 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.021 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.021 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.021 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.022 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.022 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testnewline": { 2021-03-10T13:43:26.022 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testnewline", 2021-03-10T13:43:26.022 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:26.022 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.023 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:26.023 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:26.023 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.023 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.023 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:26.023 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.024 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.024 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.024 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.024 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:26.024 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:26.025 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.025 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:26.025 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "status", 2021-03-10T13:43:26.025 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:26.025 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:26.025 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:26.026 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:26.026 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:26.026 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:26.026 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.026 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:26.027 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:26.027 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.027 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.027 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:26.027 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:26.028 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:26.028 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:26.028 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:26.028 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:26.028 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:26.029 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:26.029 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.029 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.029 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.029 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.029 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.030 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:26.030 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:26.030 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:26.030 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.030 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:26.031 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:26.031 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.031 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.031 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:26.031 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.032 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.032 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.032 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.032 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.032 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:26.033 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:26.033 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:26.033 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.033 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:26.034 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:26.034 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.034 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.034 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:26.034 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:26.034 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:26.035 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:26.035 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:26.035 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:26.035 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:26.035 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:26.036 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.036 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.036 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.036 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.036 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.037 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:26.037 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:26.037 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:26.037 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.037 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:26.037 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:26.038 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.038 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.038 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:26.038 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.038 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.039 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.039 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.039 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:26.039 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:26.039 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.040 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:26.040 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telegraf", 2021-03-10T13:43:26.040 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:26.040 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:26.040 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:26.041 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "address": { 2021-03-10T13:43:26.041 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "address", 2021-03-10T13:43:26.041 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:26.041 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.041 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:26.042 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "unixgram:///tmp/telegraf.sock", 2021-03-10T13:43:26.042 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.042 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.042 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:26.042 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.043 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.043 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.043 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.043 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.043 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T13:43:26.044 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T13:43:26.044 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:43:26.044 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.044 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:26.044 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15", 2021-03-10T13:43:26.045 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.045 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.045 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:26.045 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.045 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.046 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.046 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.046 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.046 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:26.046 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:26.047 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:26.047 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.047 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:26.047 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:26.047 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.048 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.048 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:26.048 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:26.048 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:26.048 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:26.049 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:26.049 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:26.049 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:26.049 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:26.049 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.050 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.050 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.050 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.050 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.050 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:26.051 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:26.051 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:26.051 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.051 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:26.051 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:26.051 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.052 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.052 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:26.052 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.052 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.052 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.053 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.053 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.053 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:26.053 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:26.053 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:26.053 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.054 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:26.054 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:26.054 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.054 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.054 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:26.055 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:26.055 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:26.055 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:26.055 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:26.055 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:26.056 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:26.056 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:26.056 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.056 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.056 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.057 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.057 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.057 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:26.057 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:26.057 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:26.058 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.058 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:26.058 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:26.058 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.058 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.059 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:26.059 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.059 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.059 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.060 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.060 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:26.060 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:26.060 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.060 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:26.060 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telemetry", 2021-03-10T13:43:26.061 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:26.061 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:26.061 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:26.061 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_basic": { 2021-03-10T13:43:26.061 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_basic", 2021-03-10T13:43:26.062 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:26.062 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.062 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:26.062 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:26.062 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.063 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.063 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:26.063 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Share basic cluster information (size, version)", 2021-03-10T13:43:26.063 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.063 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.064 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.064 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.064 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_crash": { 2021-03-10T13:43:26.064 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_crash", 2021-03-10T13:43:26.064 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:26.065 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.065 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:26.065 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:26.065 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.065 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.066 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:26.066 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.066 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.066 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.066 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.067 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.067 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_device": { 2021-03-10T13:43:26.067 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_device", 2021-03-10T13:43:26.067 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:26.067 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.067 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:26.068 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T13:43:26.068 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.068 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.068 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:26.068 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.069 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.069 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.069 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.069 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.069 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_ident": { 2021-03-10T13:43:26.070 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_ident", 2021-03-10T13:43:26.070 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:26.070 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.070 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:26.070 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:26.071 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.071 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.071 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:26.071 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.071 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.071 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.072 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.072 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.072 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "contact": { 2021-03-10T13:43:26.072 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "contact", 2021-03-10T13:43:26.072 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:26.073 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.073 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:26.073 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:43:26.073 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.073 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.074 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:26.074 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.074 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.074 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.074 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.075 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.075 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "description": { 2021-03-10T13:43:26.075 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "description", 2021-03-10T13:43:26.075 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:26.075 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.076 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:26.076 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:43:26.076 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.076 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.076 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:26.077 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.077 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.077 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.077 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.077 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.077 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_url": { 2021-03-10T13:43:26.078 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_url", 2021-03-10T13:43:26.078 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:26.078 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.078 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:26.078 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/device", 2021-03-10T13:43:26.079 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.079 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.079 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:26.079 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.079 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.080 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.080 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.080 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.080 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enabled": { 2021-03-10T13:43:26.080 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enabled", 2021-03-10T13:43:26.081 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:26.081 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.081 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:26.081 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:26.081 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.082 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.082 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:26.082 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.082 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.082 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.083 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.083 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.083 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T13:43:26.083 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T13:43:26.083 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:26.084 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.084 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:26.084 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "24", 2021-03-10T13:43:26.084 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "8", 2021-03-10T13:43:26.084 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.085 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:26.085 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.085 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.085 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.085 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.085 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.086 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_opt_revision": { 2021-03-10T13:43:26.086 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "last_opt_revision", 2021-03-10T13:43:26.086 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:26.086 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.086 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:26.087 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1", 2021-03-10T13:43:26.087 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.087 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.087 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:26.087 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.088 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.088 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.088 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.088 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.088 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "leaderboard": { 2021-03-10T13:43:26.089 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "leaderboard", 2021-03-10T13:43:26.089 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:26.089 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.089 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:26.089 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:26.090 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.090 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.090 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:26.090 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.090 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.090 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.091 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.091 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.091 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:26.091 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:26.091 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:26.092 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.092 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:26.092 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:26.092 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.092 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.093 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:26.093 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:26.093 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:26.093 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:26.093 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:26.093 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:26.094 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:26.094 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:26.094 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.094 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.094 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.095 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.095 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.095 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:26.095 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:26.095 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:26.095 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.096 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:26.096 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:26.096 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.096 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.096 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:26.097 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.097 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.097 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.097 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.097 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.097 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:26.098 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:26.098 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:26.098 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.098 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:26.098 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:26.099 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.099 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.099 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:26.099 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:26.099 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:26.099 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:26.100 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:26.100 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:26.100 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:26.100 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:26.100 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.101 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.101 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.101 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.101 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.101 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:26.101 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:26.102 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:26.102 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.102 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:26.102 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:26.102 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.103 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.103 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:26.103 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.103 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.103 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.104 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.104 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.104 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "organization": { 2021-03-10T13:43:26.104 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "organization", 2021-03-10T13:43:26.104 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:26.105 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.105 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:26.105 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:43:26.105 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.105 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.105 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:26.106 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.106 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.106 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.106 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.106 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.107 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "proxy": { 2021-03-10T13:43:26.107 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "proxy", 2021-03-10T13:43:26.107 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:26.107 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.107 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:26.107 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:43:26.108 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.108 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.108 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:26.108 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.108 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.109 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.109 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.109 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.109 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url": { 2021-03-10T13:43:26.109 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url", 2021-03-10T13:43:26.110 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:26.110 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.110 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:26.110 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/report", 2021-03-10T13:43:26.110 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.111 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.111 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:26.111 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.111 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.111 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.112 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.112 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:26.112 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:26.112 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.112 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:26.112 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "test_orchestrator", 2021-03-10T13:43:26.113 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:26.113 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:26.113 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:26.113 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:26.113 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:26.114 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:26.114 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.114 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:26.114 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:26.114 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.115 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.115 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:26.115 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:26.115 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:26.115 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:26.115 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:26.116 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:26.116 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:26.116 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:26.116 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.116 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.117 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.117 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.117 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.117 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:26.117 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:26.117 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:26.118 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.118 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:26.118 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:26.118 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.118 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.119 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:26.119 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.119 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.119 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.119 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.120 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.120 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:26.120 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:26.120 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:26.120 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.120 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:26.121 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:26.121 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.121 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.121 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:26.121 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:26.122 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:26.122 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:26.122 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:26.122 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:26.122 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:26.122 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:26.123 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.123 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.123 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.123 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.123 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.124 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:26.124 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:26.124 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:26.124 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.124 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:26.125 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:26.125 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.125 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.125 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:26.125 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.125 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.126 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.126 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.126 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:26.126 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:26.126 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.127 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:26.127 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "volumes", 2021-03-10T13:43:26.127 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:26.127 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:26.127 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:26.128 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:26.128 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:26.128 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:26.128 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.128 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:26.129 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:26.129 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.129 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.129 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:26.129 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:26.130 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:26.130 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:26.130 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:26.130 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:26.130 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:26.131 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:26.131 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.131 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.131 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.131 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.132 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.132 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:26.132 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:26.132 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:26.132 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.133 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:26.133 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:26.133 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.133 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.133 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:26.134 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.134 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.134 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.134 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.134 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.135 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:26.135 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:26.135 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:26.135 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.135 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:26.135 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:26.136 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.136 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.136 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:26.136 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:26.136 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:26.137 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:26.137 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:26.137 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:26.137 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:26.137 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:26.138 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.138 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.138 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.138 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.138 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.138 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:26.139 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:26.139 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:26.139 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.139 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:26.139 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:26.140 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.140 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.140 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:26.140 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.140 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.141 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.141 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.141 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:26.141 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:26.141 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.141 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:26.142 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix", 2021-03-10T13:43:26.142 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T13:43:26.142 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T13:43:26.142 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T13:43:26.142 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "discovery_interval": { 2021-03-10T13:43:26.143 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "discovery_interval", 2021-03-10T13:43:26.143 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:26.143 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.143 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:26.143 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "100", 2021-03-10T13:43:26.143 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.144 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.144 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:26.144 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.144 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.144 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.145 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.145 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.145 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "identifier": { 2021-03-10T13:43:26.145 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "identifier", 2021-03-10T13:43:26.145 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:26.146 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.146 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:26.146 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:26.146 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.146 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.147 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:26.147 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.147 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.147 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.147 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.148 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.148 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T13:43:26.148 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T13:43:26.148 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T13:43:26.148 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.148 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:26.149 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2021-03-10T13:43:26.149 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.149 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.149 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:26.149 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.150 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.150 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.150 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.150 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.150 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T13:43:26.151 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T13:43:26.151 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:26.151 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.151 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:26.151 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T13:43:26.151 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.152 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.152 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:26.152 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:26.152 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:26.152 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:26.153 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:26.153 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:26.153 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:26.153 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:26.153 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.153 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.154 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.154 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.154 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.154 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T13:43:26.154 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T13:43:26.155 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:26.155 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.155 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:26.155 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:26.155 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.156 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.156 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:26.156 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.156 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.156 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.156 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.157 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.157 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T13:43:26.157 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T13:43:26.157 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:26.157 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.158 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:26.158 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T13:43:26.158 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.158 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.158 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T13:43:26.158 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T13:43:26.159 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T13:43:26.159 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T13:43:26.159 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T13:43:26.159 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T13:43:26.159 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T13:43:26.160 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:26.160 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.160 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.160 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.160 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.160 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.161 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T13:43:26.161 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T13:43:26.161 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T13:43:26.161 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.161 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T13:43:26.162 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T13:43:26.162 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.162 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.162 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:26.162 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.163 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.163 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.163 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.163 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.163 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_host": { 2021-03-10T13:43:26.164 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_host", 2021-03-10T13:43:26.164 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:26.164 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.164 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:26.164 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T13:43:26.164 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.165 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.165 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:26.165 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.165 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.165 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.165 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.166 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.166 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_port": { 2021-03-10T13:43:26.166 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_port", 2021-03-10T13:43:26.166 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T13:43:26.166 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.167 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:26.167 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10051", 2021-03-10T13:43:26.167 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.167 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.167 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:26.168 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.168 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.168 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.168 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.168 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.168 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_sender": { 2021-03-10T13:43:26.169 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_sender", 2021-03-10T13:43:26.169 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T13:43:26.169 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T13:43:26.169 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T13:43:26.169 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "/usr/bin/zabbix_sender", 2021-03-10T13:43:26.170 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T13:43:26.170 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T13:43:26.170 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T13:43:26.170 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T13:43:26.170 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T13:43:26.170 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T13:43:26.171 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T13:43:26.171 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:26.171 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:26.171 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:26.171 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:26.172 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {}, 2021-03-10T13:43:26.172 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "always_on_modules": { 2021-03-10T13:43:26.172 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nautilus": [ 2021-03-10T13:43:26.172 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2021-03-10T13:43:26.172 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2021-03-10T13:43:26.172 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2021-03-10T13:43:26.173 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator_cli", 2021-03-10T13:43:26.173 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2021-03-10T13:43:26.173 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2021-03-10T13:43:26.173 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2021-03-10T13:43:26.173 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2021-03-10T13:43:26.174 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:26.174 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "octopus": [ 2021-03-10T13:43:26.174 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2021-03-10T13:43:26.174 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2021-03-10T13:43:26.174 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2021-03-10T13:43:26.175 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator", 2021-03-10T13:43:26.175 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_support", 2021-03-10T13:43:26.175 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_autoscaler", 2021-03-10T13:43:26.175 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2021-03-10T13:43:26.175 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2021-03-10T13:43:26.176 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2021-03-10T13:43:26.176 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "telemetry", 2021-03-10T13:43:26.176 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2021-03-10T13:43:26.176 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T13:43:26.176 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_failure_osd_epoch": 4, 2021-03-10T13:43:26.177 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_clients": [ 2021-03-10T13:43:26.177 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:26.177 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2021-03-10T13:43:26.177 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:26.177 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2021-03-10T13:43:26.178 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.113:0", 2021-03-10T13:43:26.178 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 2867408781 2021-03-10T13:43:26.178 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:26.178 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T13:43:26.178 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.179 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:26.179 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2021-03-10T13:43:26.179 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:26.179 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2021-03-10T13:43:26.179 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.113:0", 2021-03-10T13:43:26.180 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 4101755549 2021-03-10T13:43:26.180 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:26.180 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T13:43:26.180 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T13:43:26.180 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:26.180 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2021-03-10T13:43:26.181 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:26.181 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2021-03-10T13:43:26.181 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.113:0", 2021-03-10T13:43:26.181 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 1865931294 2021-03-10T13:43:26.181 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:26.182 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T13:43:26.182 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:26.182 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T13:43:26.182 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:26.182 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:26.183 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:25 gibba013 bash[9767]: audit 2021-03-10T13:43:24.935688+0000 mon.a (mon.0) 70 : audit [DBG] from='client.? 172.21.2.113:0/2766279556' entity='client.admin' cmd=[{"prefix": "mgr dump"}]: dispatch 2021-03-10T13:43:26.184 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:Waiting for the mgr to restart... 2021-03-10T13:43:26.184 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:Waiting for Mgr epoch 9... 2021-03-10T13:43:26.184 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba013', '-v', '/var/log/ceph/7672acc8-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp53lxa2bo:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmp7c38gcj7:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'tell', 'mgr', 'mgr_status'] 2021-03-10T13:43:26.184 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba013 -v /var/log/ceph/7672acc8-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp53lxa2bo:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp7c38gcj7:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 tell mgr mgr_status 2021-03-10T13:43:26.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:26 gibba013 bash[9767]: cluster 2021-03-10T13:43:25.864370+0000 mon.a (mon.0) 71 : cluster [INF] Active manager daemon y restarted 2021-03-10T13:43:26.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:26 gibba013 bash[9767]: cluster 2021-03-10T13:43:25.864950+0000 mon.a (mon.0) 72 : cluster [INF] Activating manager daemon y 2021-03-10T13:43:26.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:26 gibba013 bash[9767]: cluster 2021-03-10T13:43:25.866627+0000 mon.a (mon.0) 73 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2021-03-10T13:43:26.631 INFO:journalctl@ceph.mgr.y.gibba013.stdout:Mar 10 13:43:26 gibba013 bash[10020]: Warning: Permanently added 'gibba013,172.21.2.113' (ECDSA) to the list of known hosts. 2021-03-10T13:43:27.381 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T13:43:27.381 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap_epoch": 11, 2021-03-10T13:43:27.381 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "initialized": true 2021-03-10T13:43:27.382 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T13:43:27.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:27 gibba013 bash[9767]: cluster 2021-03-10T13:43:26.364770+0000 mon.a (mon.0) 74 : cluster [DBG] mgrmap e10: y(active, starting, since 0.499887s) 2021-03-10T13:43:27.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:27 gibba013 bash[9767]: audit 2021-03-10T13:43:26.369763+0000 mon.a (mon.0) 75 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T13:43:27.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:27 gibba013 bash[9767]: audit 2021-03-10T13:43:26.372032+0000 mon.a (mon.0) 76 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T13:43:27.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:27 gibba013 bash[9767]: audit 2021-03-10T13:43:26.372469+0000 mon.a (mon.0) 77 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T13:43:27.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:27 gibba013 bash[9767]: audit 2021-03-10T13:43:26.372837+0000 mon.a (mon.0) 78 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T13:43:27.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:27 gibba013 bash[9767]: audit 2021-03-10T13:43:26.374212+0000 mon.a (mon.0) 79 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T13:43:27.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:27 gibba013 bash[9767]: audit 2021-03-10T13:43:26.376433+0000 mon.a (mon.0) 80 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba013"}]: dispatch 2021-03-10T13:43:27.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:27 gibba013 bash[9767]: audit 2021-03-10T13:43:26.377623+0000 mon.a (mon.0) 81 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2021-03-10T13:43:27.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:27 gibba013 bash[9767]: audit 2021-03-10T13:43:26.378848+0000 mon.a (mon.0) 82 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2021-03-10T13:43:27.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:27 gibba013 bash[9767]: audit 2021-03-10T13:43:26.380047+0000 mon.a (mon.0) 83 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2021-03-10T13:43:27.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:27 gibba013 bash[9767]: audit 2021-03-10T13:43:26.381181+0000 mon.a (mon.0) 84 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-03-10T13:43:27.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:27 gibba013 bash[9767]: audit 2021-03-10T13:43:26.382356+0000 mon.a (mon.0) 85 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-03-10T13:43:27.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:27 gibba013 bash[9767]: cluster 2021-03-10T13:43:26.388101+0000 mon.a (mon.0) 86 : cluster [INF] Manager daemon y is now available 2021-03-10T13:43:27.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:27 gibba013 bash[9767]: audit 2021-03-10T13:43:26.444619+0000 mon.a (mon.0) 87 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-03-10T13:43:27.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:27 gibba013 bash[9767]: audit 2021-03-10T13:43:26.603952+0000 mon.a (mon.0) 88 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-03-10T13:43:27.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:27 gibba013 bash[9767]: audit 2021-03-10T13:43:26.604201+0000 mon.a (mon.0) 89 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:43:27.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:27 gibba013 bash[9767]: audit 2021-03-10T13:43:26.944717+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.944202\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.944275\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T13:43:26.944340\", \"networks\": {}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:43:27.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:27 gibba013 bash[9767]: audit 2021-03-10T13:43:26.946486+0000 mon.a (mon.0) 91 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.944202\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.944275\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T13:43:26.944340\", \"networks\": {}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:43:27.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:27 gibba013 bash[9767]: audit 2021-03-10T13:43:26.947035+0000 mon.a (mon.0) 92 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:43:28.100 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:Generating a dashboard self-signed certificate... 2021-03-10T13:43:28.101 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba013', '-v', '/var/log/ceph/7672acc8-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp53lxa2bo:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmp7c38gcj7:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'dashboard', 'create-self-signed-cert'] 2021-03-10T13:43:28.101 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba013 -v /var/log/ceph/7672acc8-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp53lxa2bo:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp7c38gcj7:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 dashboard create-self-signed-cert 2021-03-10T13:43:28.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:28 gibba013 bash[9767]: cluster 2021-03-10T13:43:27.371109+0000 mon.a (mon.0) 93 : cluster [DBG] mgrmap e11: y(active, since 1.50625s) 2021-03-10T13:43:29.437 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:29 gibba013 bash[9767]: cluster 2021-03-10T13:43:28.373987+0000 mon.a (mon.0) 94 : cluster [DBG] mgrmap e12: y(active, since 2s) 2021-03-10T13:43:29.900 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout Self-signed certificate created 2021-03-10T13:43:30.481 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:Creating initial admin user... 2021-03-10T13:43:30.481 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba013', '-v', '/var/log/ceph/7672acc8-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp53lxa2bo:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmp7c38gcj7:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'dashboard', 'ac-user-create', 'admin', 'rrqhmugwyb', 'administrator', '--force-password', '--pwd-update-required'] 2021-03-10T13:43:30.482 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba013 -v /var/log/ceph/7672acc8-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp53lxa2bo:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp7c38gcj7:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 dashboard ac-user-create admin rrqhmugwyb administrator --force-password --pwd-update-required 2021-03-10T13:43:30.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:30 gibba013 bash[9767]: audit 2021-03-10T13:43:29.735639+0000 mgr.y (mgr.14140) 1 : audit [DBG] from='client.14153 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:43:30.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:30 gibba013 bash[9767]: audit 2021-03-10T13:43:29.894312+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/dashboard/crt","val":"-----BEGIN CERTIFICATE-----\nMIIC0DCCAbgCEQCq00P9tkNLx5o3l9cOk00zMA0GCSqGSIb3DQEBDQUAMCYxCzAJ\nBgNVBAoMAklUMRcwFQYDVQQDDA5jZXBoLWRhc2hib2FyZDAeFw0yMTAzMTAxMzQz\nMjlaFw0zMTAzMDgxMzQzMjlaMCYxCzAJBgNVBAoMAklUMRcwFQYDVQQDDA5jZXBo\nLWRhc2hib2FyZDCCASIwDQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEBALt59YoN\nIHHFNJPO3tp0x96unOwgUaf08gcDc8oDDZJ+LLw/23skfBX86mJmeLKuuVKvGpj4\nryVTSZTUUQjHMH6einxXZ6zEr29j730dAzvx4CL0/uH07qmCnwdxG5Hw1aWJvw/G\nSJlL29/oSkygF1AF/xc4w/orVzai7AzgyfVe6sma1QIA15zI567F3UVJa1FaolKj\nmK8y6ne8VhUU1h7+34zJ++UsgAxT4Sdf73V5YJ/jWq86VF2U49UsL70q7BiT2mia\nD5FJespuN2ZMHuGyNte9DG0gxTqt67Rv33N7uc9fWN7Y1JtPObfbR/s5OyGUy5ub\nawH5epUYcmL5fuECAwEAATANBgkqhkiG9w0BAQ0FAAOCAQEALUa6P8j0Vbn3bI05\nKJ4v8thFfSZwJV5wR3biajV1b2la/OVgzroeYo0CGGXa2buA+sbCRFuNDj3Zw99I\nfpAl7/I1jq2dKgfh76CLtPOom55vtwFpvV2/oT8iM9s6RzZXc1Gy0e9Eha+CKnlA\nAyKp5psKtgH5IGhz/NjNxHVLBZtXE4qc1wuV0RyQDfMak5RQOldAmjwNfPIzZXXw\nl6kJhy+Kgh9zK6p83Sc1YOz4F8chHFjJSEwt0d1v920vV4Lo4648HP4a6KW3e4aZ\n5Asi4MN2C3FPEo4t9jc9mpR7Tg2emz/UnCJA7NmWOSKeA5ZD/TBTLHBDGWepgIlO\nIs8s2A==\n-----END CERTIFICATE-----\n"}]: dispatch 2021-03-10T13:43:30.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:30 gibba013 bash[9767]: audit 2021-03-10T13:43:29.896076+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/dashboard/crt","val":"-----BEGIN CERTIFICATE-----\nMIIC0DCCAbgCEQCq00P9tkNLx5o3l9cOk00zMA0GCSqGSIb3DQEBDQUAMCYxCzAJ\nBgNVBAoMAklUMRcwFQYDVQQDDA5jZXBoLWRhc2hib2FyZDAeFw0yMTAzMTAxMzQz\nMjlaFw0zMTAzMDgxMzQzMjlaMCYxCzAJBgNVBAoMAklUMRcwFQYDVQQDDA5jZXBo\nLWRhc2hib2FyZDCCASIwDQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEBALt59YoN\nIHHFNJPO3tp0x96unOwgUaf08gcDc8oDDZJ+LLw/23skfBX86mJmeLKuuVKvGpj4\nryVTSZTUUQjHMH6einxXZ6zEr29j730dAzvx4CL0/uH07qmCnwdxG5Hw1aWJvw/G\nSJlL29/oSkygF1AF/xc4w/orVzai7AzgyfVe6sma1QIA15zI567F3UVJa1FaolKj\nmK8y6ne8VhUU1h7+34zJ++UsgAxT4Sdf73V5YJ/jWq86VF2U49UsL70q7BiT2mia\nD5FJespuN2ZMHuGyNte9DG0gxTqt67Rv33N7uc9fWN7Y1JtPObfbR/s5OyGUy5ub\nawH5epUYcmL5fuECAwEAATANBgkqhkiG9w0BAQ0FAAOCAQEALUa6P8j0Vbn3bI05\nKJ4v8thFfSZwJV5wR3biajV1b2la/OVgzroeYo0CGGXa2buA+sbCRFuNDj3Zw99I\nfpAl7/I1jq2dKgfh76CLtPOom55vtwFpvV2/oT8iM9s6RzZXc1Gy0e9Eha+CKnlA\nAyKp5psKtgH5IGhz/NjNxHVLBZtXE4qc1wuV0RyQDfMak5RQOldAmjwNfPIzZXXw\nl6kJhy+Kgh9zK6p83Sc1YOz4F8chHFjJSEwt0d1v920vV4Lo4648HP4a6KW3e4aZ\n5Asi4MN2C3FPEo4t9jc9mpR7Tg2emz/UnCJA7NmWOSKeA5ZD/TBTLHBDGWepgIlO\nIs8s2A==\n-----END CERTIFICATE-----\n"}]': finished 2021-03-10T13:43:30.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:30 gibba013 bash[9767]: audit 2021-03-10T13:43:29.896626+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/dashboard/key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvgIBADANBgkqhkiG9w0BAQEFAASCBKgwggSkAgEAAoIBAQC7efWKDSBxxTST\nzt7adMferpzsIFGn9PIHA3PKAw2Sfiy8P9t7JHwV/OpiZniyrrlSrxqY+K8lU0mU\n1FEIxzB+nop8V2esxK9vY+99HQM78eAi9P7h9O6pgp8HcRuR8NWlib8PxkiZS9vf\n6EpMoBdQBf8XOMP6K1c2ouwM4Mn1XurJmtUCANecyOeuxd1FSWtRWqJSo5ivMup3\nvFYVFNYe/t+MyfvlLIAMU+EnX+91eWCf41qvOlRdlOPVLC+9KuwYk9pomg+RSXrK\nbjdmTB7hsjbXvQxtIMU6reu0b99ze7nPX1je2NSbTzm320f7OTshlMubm2sB+XqV\nGHJi+X7hAgMBAAECggEATrFZrJHn/XluoWBjUMVWJBWdTsweGmcJtIHxd2kiqEwI\nERio0x60azJXW+hxX2dR6PARNQal1gAI0czxGsMpiuyXaqvxm6aPkS0cmKK1+dKE\nZ4f4+PWrvEFU6XXDwdWaiDqylTeAv8AE0g6aKWHFh1SNB71PHdJVcFygwqMUgsaV\nfZ1J0JiZZjQ9oxqMsoUOm5TDrKhd1+zknW027VDUCf8meuJxOET5VRtt83V3KIWl\ncCu8bg7MmvpGhoNkuHiTKp96/kO5p6kQEsyikkaqy6Y7wv8pup7ptrTBbJ8hF7TS\nBVlR7mJnj1wlJzEnEeAyqJuL1otnhEsNBiExUWqvpQKBgQDopH3ySXBI/YS0E+W2\n/Xowwa+LusJvuws1suJigNoaq4WGFjDqvIVaYIM6YZw3fBmQKVU+MNTpipOKSGk+\nfwhl0ywCRmKyzNy3+LlhRzPCz29cWzjP9pA2ma0Jx27zav+baUW5gvhhs1dj98XD\nraxvBL9wMnoY92dOa90nTro7ywKBgQDOTJTyvz4Yprbv8mNNLdtyR6U2uR7O0Apx\nYYLMDSLGcXGL65qCLJGnZYwcpNhc7uXBr9Kp0TfD1E8pirvIqQo60z4LiulxkA2U\nzVNx+HtuX5W17htZrUTZbziWWQ9saVyQggsABgZ+E1io2tYJr6uh8H9ddQfD9/2n\nhTOEwJXygwKBgQCPFqVUgXDro+qcK+TNUUh3dpm3Uq5GtH+njpgJSAFeCAM/PqTl\nrABFXzk3jlPcGJtMfO+uKbC61/35PqJkyxNqNaFK4OnR2YkkKnoy5+1hM97lqkHe\nP2PiAVFZw21tkHEYsH4vJOwKg5kLppjfyxFU01G/+3v3oSvMIzHJ/HU1UwKBgQCr\n4krH5meKin0pdr8d8vNASElzStJMZjINPb2I3fj3dlWwyuC1TQUegBE5XG+ZHsL3\nmdLgAp1/4EkEx76l9ZG8aXzsiRTvtaJbNKgt8WaGE8XdC0JmeWM/9tcjDZk4LqEd\nFfysTFjkeqIILizfbSqHhqXX7EZIFTuWc/j0xrEomQKBgHb6XamDJeS3ewHA7xE+\nZUcCapxPeZgmavvLwsWZziaJdFRkbKxT5PVZzdP8YROLdd0H27zf/pmi3VjwcT9N\nwJJtXDEik0caIBqnHJNVg8BDIOjnkwaX8S9ypmbdlPvvKtlisz+nFN/kLoybc4Xt\n7KRKs4CDDYgE0bjP5CTDYl22\n-----END PRIVATE KEY-----\n"}]: dispatch 2021-03-10T13:43:30.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:30 gibba013 bash[9767]: audit 2021-03-10T13:43:29.898119+0000 mon.a (mon.0) 98 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/dashboard/key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvgIBADANBgkqhkiG9w0BAQEFAASCBKgwggSkAgEAAoIBAQC7efWKDSBxxTST\nzt7adMferpzsIFGn9PIHA3PKAw2Sfiy8P9t7JHwV/OpiZniyrrlSrxqY+K8lU0mU\n1FEIxzB+nop8V2esxK9vY+99HQM78eAi9P7h9O6pgp8HcRuR8NWlib8PxkiZS9vf\n6EpMoBdQBf8XOMP6K1c2ouwM4Mn1XurJmtUCANecyOeuxd1FSWtRWqJSo5ivMup3\nvFYVFNYe/t+MyfvlLIAMU+EnX+91eWCf41qvOlRdlOPVLC+9KuwYk9pomg+RSXrK\nbjdmTB7hsjbXvQxtIMU6reu0b99ze7nPX1je2NSbTzm320f7OTshlMubm2sB+XqV\nGHJi+X7hAgMBAAECggEATrFZrJHn/XluoWBjUMVWJBWdTsweGmcJtIHxd2kiqEwI\nERio0x60azJXW+hxX2dR6PARNQal1gAI0czxGsMpiuyXaqvxm6aPkS0cmKK1+dKE\nZ4f4+PWrvEFU6XXDwdWaiDqylTeAv8AE0g6aKWHFh1SNB71PHdJVcFygwqMUgsaV\nfZ1J0JiZZjQ9oxqMsoUOm5TDrKhd1+zknW027VDUCf8meuJxOET5VRtt83V3KIWl\ncCu8bg7MmvpGhoNkuHiTKp96/kO5p6kQEsyikkaqy6Y7wv8pup7ptrTBbJ8hF7TS\nBVlR7mJnj1wlJzEnEeAyqJuL1otnhEsNBiExUWqvpQKBgQDopH3ySXBI/YS0E+W2\n/Xowwa+LusJvuws1suJigNoaq4WGFjDqvIVaYIM6YZw3fBmQKVU+MNTpipOKSGk+\nfwhl0ywCRmKyzNy3+LlhRzPCz29cWzjP9pA2ma0Jx27zav+baUW5gvhhs1dj98XD\nraxvBL9wMnoY92dOa90nTro7ywKBgQDOTJTyvz4Yprbv8mNNLdtyR6U2uR7O0Apx\nYYLMDSLGcXGL65qCLJGnZYwcpNhc7uXBr9Kp0TfD1E8pirvIqQo60z4LiulxkA2U\nzVNx+HtuX5W17htZrUTZbziWWQ9saVyQggsABgZ+E1io2tYJr6uh8H9ddQfD9/2n\nhTOEwJXygwKBgQCPFqVUgXDro+qcK+TNUUh3dpm3Uq5GtH+njpgJSAFeCAM/PqTl\nrABFXzk3jlPcGJtMfO+uKbC61/35PqJkyxNqNaFK4OnR2YkkKnoy5+1hM97lqkHe\nP2PiAVFZw21tkHEYsH4vJOwKg5kLppjfyxFU01G/+3v3oSvMIzHJ/HU1UwKBgQCr\n4krH5meKin0pdr8d8vNASElzStJMZjINPb2I3fj3dlWwyuC1TQUegBE5XG+ZHsL3\nmdLgAp1/4EkEx76l9ZG8aXzsiRTvtaJbNKgt8WaGE8XdC0JmeWM/9tcjDZk4LqEd\nFfysTFjkeqIILizfbSqHhqXX7EZIFTuWc/j0xrEomQKBgHb6XamDJeS3ewHA7xE+\nZUcCapxPeZgmavvLwsWZziaJdFRkbKxT5PVZzdP8YROLdd0H27zf/pmi3VjwcT9N\nwJJtXDEik0caIBqnHJNVg8BDIOjnkwaX8S9ypmbdlPvvKtlisz+nFN/kLoybc4Xt\n7KRKs4CDDYgE0bjP5CTDYl22\n-----END PRIVATE KEY-----\n"}]': finished 2021-03-10T13:43:31.746 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout {"username": "admin", "password": "$2b$12$eM1X5uizYPyezRSMDti1OOHeBhPd0c/q/aiZkRMjWXs57fefycgYW", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1615383811, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2021-03-10T13:43:32.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:31 gibba013 bash[9767]: audit 2021-03-10T13:43:31.742312+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/dashboard/accessdb_v2","val":"{\"users\": {\"admin\": {\"username\": \"admin\", \"password\": \"$2b$12$eM1X5uizYPyezRSMDti1OOHeBhPd0c/q/aiZkRMjWXs57fefycgYW\", \"roles\": [\"administrator\"], \"name\": null, \"email\": null, \"lastUpdate\": 1615383811, \"enabled\": true, \"pwdExpirationDate\": null, \"pwdUpdateRequired\": true}}, \"roles\": {}, \"version\": 2}"}]: dispatch 2021-03-10T13:43:32.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:31 gibba013 bash[9767]: audit 2021-03-10T13:43:31.743994+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/dashboard/accessdb_v2","val":"{\"users\": {\"admin\": {\"username\": \"admin\", \"password\": \"$2b$12$eM1X5uizYPyezRSMDti1OOHeBhPd0c/q/aiZkRMjWXs57fefycgYW\", \"roles\": [\"administrator\"], \"name\": null, \"email\": null, \"lastUpdate\": 1615383811, \"enabled\": true, \"pwdExpirationDate\": null, \"pwdUpdateRequired\": true}}, \"roles\": {}, \"version\": 2}"}]': finished 2021-03-10T13:43:32.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:31 gibba013 bash[9767]: audit 2021-03-10T13:43:31.785955+0000 mon.a (mon.0) 101 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:43:32.288 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:Fetching dashboard port number... 2021-03-10T13:43:32.289 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba013', '-v', '/var/log/ceph/7672acc8-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmp53lxa2bo:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmp7c38gcj7:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'config', 'get', 'mgr', 'mgr/dashboard/ssl_server_port'] 2021-03-10T13:43:32.289 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba013 -v /var/log/ceph/7672acc8-81a6-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmp53lxa2bo:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp7c38gcj7:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 config get mgr mgr/dashboard/ssl_server_port 2021-03-10T13:43:33.068 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:32 gibba013 bash[9767]: audit 2021-03-10T13:43:31.575035+0000 mgr.y (mgr.14140) 2 : audit [DBG] from='client.14155 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "password": "rrqhmugwyb", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:43:33.068 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:32 gibba013 bash[9767]: audit 2021-03-10T13:43:31.885605+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.944202\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.944275\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T13:43:26.944340\", \"last_device_update\": \"2021-03-10T13:43:31.885152\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:43:33.068 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:32 gibba013 bash[9767]: audit 2021-03-10T13:43:31.887282+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.944202\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.944275\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T13:43:26.944340\", \"last_device_update\": \"2021-03-10T13:43:31.885152\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:43:33.292 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 8443 2021-03-10T13:43:33.797 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:Ceph Dashboard is now available at: 2021-03-10T13:43:33.797 INFO:teuthology.orchestra.run.gibba013.stderr: 2021-03-10T13:43:33.798 INFO:teuthology.orchestra.run.gibba013.stderr: URL: https://gibba013:8443/ 2021-03-10T13:43:33.798 INFO:teuthology.orchestra.run.gibba013.stderr: User: admin 2021-03-10T13:43:33.798 INFO:teuthology.orchestra.run.gibba013.stderr: Password: rrqhmugwyb 2021-03-10T13:43:33.798 INFO:teuthology.orchestra.run.gibba013.stderr: 2021-03-10T13:43:33.798 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:You can access the Ceph CLI with: 2021-03-10T13:43:33.799 INFO:teuthology.orchestra.run.gibba013.stderr: 2021-03-10T13:43:33.799 INFO:teuthology.orchestra.run.gibba013.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2021-03-10T13:43:33.799 INFO:teuthology.orchestra.run.gibba013.stderr: 2021-03-10T13:43:33.799 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:Please consider enabling telemetry to help improve Ceph: 2021-03-10T13:43:33.799 INFO:teuthology.orchestra.run.gibba013.stderr: 2021-03-10T13:43:33.800 INFO:teuthology.orchestra.run.gibba013.stderr: ceph telemetry on 2021-03-10T13:43:33.800 INFO:teuthology.orchestra.run.gibba013.stderr: 2021-03-10T13:43:33.800 INFO:teuthology.orchestra.run.gibba013.stderr:For more information see: 2021-03-10T13:43:33.800 INFO:teuthology.orchestra.run.gibba013.stderr: 2021-03-10T13:43:33.800 INFO:teuthology.orchestra.run.gibba013.stderr: https://docs.ceph.com/docs/master/mgr/telemetry/ 2021-03-10T13:43:33.801 INFO:teuthology.orchestra.run.gibba013.stderr: 2021-03-10T13:43:33.801 INFO:teuthology.orchestra.run.gibba013.stderr:INFO:cephadm:Bootstrap complete. 2021-03-10T13:43:33.801 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Releasing lock 140567652278624 on /run/cephadm/7672acc8-81a6-11eb-9080-001a4aab830c.lock 2021-03-10T13:43:33.801 INFO:teuthology.orchestra.run.gibba013.stderr:DEBUG:cephadm:Lock 140567652278624 released on /run/cephadm/7672acc8-81a6-11eb-9080-001a4aab830c.lock 2021-03-10T13:43:33.807 INFO:tasks.cephadm:Fetching config... 2021-03-10T13:43:33.807 DEBUG:teuthology.orchestra.run.gibba013:> set -ex 2021-03-10T13:43:33.808 DEBUG:teuthology.orchestra.run.gibba013:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2021-03-10T13:43:33.816 INFO:tasks.cephadm:Fetching client.admin keyring... 2021-03-10T13:43:33.816 DEBUG:teuthology.orchestra.run.gibba013:> set -ex 2021-03-10T13:43:33.816 DEBUG:teuthology.orchestra.run.gibba013:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2021-03-10T13:43:33.820 INFO:tasks.cephadm:Fetching mon keyring... 2021-03-10T13:43:33.821 DEBUG:teuthology.orchestra.run.gibba013:> set -ex 2021-03-10T13:43:33.821 DEBUG:teuthology.orchestra.run.gibba013:> sudo dd if=/var/lib/ceph/7672acc8-81a6-11eb-9080-001a4aab830c/mon.a/keyring of=/dev/stdout 2021-03-10T13:43:33.871 INFO:tasks.cephadm:Fetching pub ssh key... 2021-03-10T13:43:33.872 DEBUG:teuthology.orchestra.run.gibba013:> set -ex 2021-03-10T13:43:33.872 DEBUG:teuthology.orchestra.run.gibba013:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2021-03-10T13:43:33.879 INFO:tasks.cephadm:Installing pub ssh key for root users... 2021-03-10T13:43:33.879 DEBUG:teuthology.orchestra.run.gibba013:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDR496aVy5hajzV6LkKO7p2hfSwBdMxLq/vKCMcdFTqjToJTn2tqA9KhdBdK0yXTEt6soSd7GZSDkrJQUsbOE5pijoHU1RfjS1qpOg56MJHF/AAlCrVsnHYE3k89r45zrTiuXdCiMxQUiKr5IeHTIYqtR1L/aFjqleJKnnwZYj7CMHktEL0W/B1urYJ57pgJnLOkxqN4G9z2QLjXlyvRN8b+ooTlFv1JI1IghUTn6mvXCQBue3QMS/mKQW3fajVwAVVQvExR5E4E/UmduHJ/hg0SLBG0Hw/mqidRxGQ9cM+fzXLsDFPC5tDEz8SK0fxaLK4vjmOw85S/6+XxXBdquGdFmNdEvTsI6DM0yJ/zfbBCcYFRt6ac1O7bAJKWOTYmclkgYGGNope02XpNf8ZcPOrnTmn5STHue1jIeUJi45aEoVSCl5OILHXY1sjZyFQBhyISQLmCHqZ93Bu0jVSAN/ZmhyX3l68ypcmbg1NSiGEKHg4YLHa/aFTiaEyLZe4Kpk= ceph-7672acc8-81a6-11eb-9080-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2021-03-10T13:43:33.939 INFO:teuthology.orchestra.run.gibba013.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDR496aVy5hajzV6LkKO7p2hfSwBdMxLq/vKCMcdFTqjToJTn2tqA9KhdBdK0yXTEt6soSd7GZSDkrJQUsbOE5pijoHU1RfjS1qpOg56MJHF/AAlCrVsnHYE3k89r45zrTiuXdCiMxQUiKr5IeHTIYqtR1L/aFjqleJKnnwZYj7CMHktEL0W/B1urYJ57pgJnLOkxqN4G9z2QLjXlyvRN8b+ooTlFv1JI1IghUTn6mvXCQBue3QMS/mKQW3fajVwAVVQvExR5E4E/UmduHJ/hg0SLBG0Hw/mqidRxGQ9cM+fzXLsDFPC5tDEz8SK0fxaLK4vjmOw85S/6+XxXBdquGdFmNdEvTsI6DM0yJ/zfbBCcYFRt6ac1O7bAJKWOTYmclkgYGGNope02XpNf8ZcPOrnTmn5STHue1jIeUJi45aEoVSCl5OILHXY1sjZyFQBhyISQLmCHqZ93Bu0jVSAN/ZmhyX3l68ypcmbg1NSiGEKHg4YLHa/aFTiaEyLZe4Kpk= ceph-7672acc8-81a6-11eb-9080-001a4aab830c 2021-03-10T13:43:33.942 DEBUG:teuthology.orchestra.run.gibba020:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDR496aVy5hajzV6LkKO7p2hfSwBdMxLq/vKCMcdFTqjToJTn2tqA9KhdBdK0yXTEt6soSd7GZSDkrJQUsbOE5pijoHU1RfjS1qpOg56MJHF/AAlCrVsnHYE3k89r45zrTiuXdCiMxQUiKr5IeHTIYqtR1L/aFjqleJKnnwZYj7CMHktEL0W/B1urYJ57pgJnLOkxqN4G9z2QLjXlyvRN8b+ooTlFv1JI1IghUTn6mvXCQBue3QMS/mKQW3fajVwAVVQvExR5E4E/UmduHJ/hg0SLBG0Hw/mqidRxGQ9cM+fzXLsDFPC5tDEz8SK0fxaLK4vjmOw85S/6+XxXBdquGdFmNdEvTsI6DM0yJ/zfbBCcYFRt6ac1O7bAJKWOTYmclkgYGGNope02XpNf8ZcPOrnTmn5STHue1jIeUJi45aEoVSCl5OILHXY1sjZyFQBhyISQLmCHqZ93Bu0jVSAN/ZmhyX3l68ypcmbg1NSiGEKHg4YLHa/aFTiaEyLZe4Kpk= ceph-7672acc8-81a6-11eb-9080-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2021-03-10T13:43:33.959 INFO:teuthology.orchestra.run.gibba020.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDR496aVy5hajzV6LkKO7p2hfSwBdMxLq/vKCMcdFTqjToJTn2tqA9KhdBdK0yXTEt6soSd7GZSDkrJQUsbOE5pijoHU1RfjS1qpOg56MJHF/AAlCrVsnHYE3k89r45zrTiuXdCiMxQUiKr5IeHTIYqtR1L/aFjqleJKnnwZYj7CMHktEL0W/B1urYJ57pgJnLOkxqN4G9z2QLjXlyvRN8b+ooTlFv1JI1IghUTn6mvXCQBue3QMS/mKQW3fajVwAVVQvExR5E4E/UmduHJ/hg0SLBG0Hw/mqidRxGQ9cM+fzXLsDFPC5tDEz8SK0fxaLK4vjmOw85S/6+XxXBdquGdFmNdEvTsI6DM0yJ/zfbBCcYFRt6ac1O7bAJKWOTYmclkgYGGNope02XpNf8ZcPOrnTmn5STHue1jIeUJi45aEoVSCl5OILHXY1sjZyFQBhyISQLmCHqZ93Bu0jVSAN/ZmhyX3l68ypcmbg1NSiGEKHg4YLHa/aFTiaEyLZe4Kpk= ceph-7672acc8-81a6-11eb-9080-001a4aab830c 2021-03-10T13:43:33.962 INFO:tasks.cephadm:Writing (initial) conf and keyring to gibba020 2021-03-10T13:43:33.963 DEBUG:teuthology.orchestra.run.gibba020:> set -ex 2021-03-10T13:43:33.963 DEBUG:teuthology.orchestra.run.gibba020:> dd of=/etc/ceph/ceph.conf 2021-03-10T13:43:33.967 DEBUG:teuthology.orchestra.run.gibba020:> set -ex 2021-03-10T13:43:33.967 DEBUG:teuthology.orchestra.run.gibba020:> dd of=/etc/ceph/ceph.client.admin.keyring 2021-03-10T13:43:33.971 INFO:tasks.cephadm:Adding host gibba020 to orchestrator... 2021-03-10T13:43:33.971 DEBUG:teuthology.orchestra.run.gibba020:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph orch host add gibba020 2021-03-10T13:43:34.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:33 gibba013 bash[9767]: cluster 2021-03-10T13:43:32.801259+0000 mon.a (mon.0) 104 : cluster [DBG] mgrmap e13: y(active, since 6s) 2021-03-10T13:43:34.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:33 gibba013 bash[9767]: audit 2021-03-10T13:43:33.289976+0000 mon.a (mon.0) 105 : audit [DBG] from='client.? 172.21.2.113:0/62174868' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2021-03-10T13:43:47.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:47 gibba013 bash[9767]: cluster 2021-03-10T13:43:46.374764+0000 mgr.y (mgr.14140) 3 : cluster [DBG] pgmap v3: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:43:49.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:49 gibba013 bash[9767]: cluster 2021-03-10T13:43:48.375566+0000 mgr.y (mgr.14140) 4 : cluster [DBG] pgmap v4: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:43:51.366 INFO:journalctl@ceph.mgr.y.gibba013.stdout:Mar 10 13:43:51 gibba013 bash[10020]: Warning: Permanently added 'gibba020,172.21.2.120' (ECDSA) to the list of known hosts. 2021-03-10T13:43:51.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:51 gibba013 bash[9767]: cluster 2021-03-10T13:43:50.376425+0000 mgr.y (mgr.14140) 5 : cluster [DBG] pgmap v5: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:43:51.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:51 gibba013 bash[9767]: audit 2021-03-10T13:43:51.048143+0000 mgr.y (mgr.14140) 6 : audit [DBG] from='client.14159 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "gibba020", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:43:52.056 INFO:teuthology.orchestra.run.gibba020.stdout:Added host 'gibba020' 2021-03-10T13:43:52.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:52 gibba013 bash[9767]: audit 2021-03-10T13:43:51.382278+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"gibba013\": {\"hostname\": \"gibba013\", \"addr\": \"gibba013\", \"labels\": [], \"status\": \"\"}, \"gibba020\": {\"hostname\": \"gibba020\", \"addr\": \"gibba020\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2021-03-10T13:43:52.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:52 gibba013 bash[9767]: audit 2021-03-10T13:43:51.387996+0000 mon.a (mon.0) 107 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"gibba013\": {\"hostname\": \"gibba013\", \"addr\": \"gibba013\", \"labels\": [], \"status\": \"\"}, \"gibba020\": {\"hostname\": \"gibba020\", \"addr\": \"gibba020\", \"labels\": [], \"status\": \"\"}}"}]': finished 2021-03-10T13:43:52.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:52 gibba013 bash[9767]: cephadm 2021-03-10T13:43:51.389105+0000 mgr.y (mgr.14140) 7 : cephadm [INF] Added host gibba020 2021-03-10T13:43:52.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:52 gibba013 bash[9767]: audit 2021-03-10T13:43:51.520085+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:43:52.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:52 gibba013 bash[9767]: audit 2021-03-10T13:43:51.525843+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:43:52.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:52 gibba013 bash[9767]: audit 2021-03-10T13:43:51.527792+0000 mon.a (mon.0) 110 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:43:52.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:52 gibba013 bash[9767]: audit 2021-03-10T13:43:51.658527+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T13:43:51.657537\", \"networks\": {}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:43:52.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:52 gibba013 bash[9767]: audit 2021-03-10T13:43:51.664377+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T13:43:51.657537\", \"networks\": {}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:43:52.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:52 gibba013 bash[9767]: audit 2021-03-10T13:43:51.666192+0000 mon.a (mon.0) 113 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:43:52.838 DEBUG:teuthology.orchestra.run.gibba020:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph orch host ls --format=json 2021-03-10T13:43:53.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:53 gibba013 bash[9767]: cluster 2021-03-10T13:43:52.377058+0000 mgr.y (mgr.14140) 8 : cluster [DBG] pgmap v6: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:43:55.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:55 gibba013 bash[9767]: cluster 2021-03-10T13:43:54.377941+0000 mgr.y (mgr.14140) 9 : cluster [DBG] pgmap v7: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:43:56.764 INFO:teuthology.orchestra.run.gibba020.stdout: 2021-03-10T13:43:56.764 INFO:teuthology.orchestra.run.gibba020.stdout:[{"addr": "gibba013", "hostname": "gibba013", "labels": [], "status": ""}, {"addr": "gibba020", "hostname": "gibba020", "labels": [], "status": ""}] 2021-03-10T13:43:57.308 INFO:tasks.cephadm:Setting crush tunables to default 2021-03-10T13:43:57.308 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph osd crush tunables default 2021-03-10T13:43:57.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:57 gibba013 bash[9767]: cluster 2021-03-10T13:43:56.378548+0000 mgr.y (mgr.14140) 10 : cluster [DBG] pgmap v8: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:43:57.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:57 gibba013 bash[9767]: audit 2021-03-10T13:43:56.759515+0000 mgr.y (mgr.14140) 11 : audit [DBG] from='client.14161 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-03-10T13:43:58.442 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:58 gibba013 bash[9767]: audit 2021-03-10T13:43:57.737540+0000 mon.a (mon.0) 114 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:43:58.442 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:58 gibba013 bash[9767]: audit 2021-03-10T13:43:57.844299+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T13:43:51.657537\", \"last_device_update\": \"2021-03-10T13:43:57.842752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:43:58.443 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:58 gibba013 bash[9767]: audit 2021-03-10T13:43:57.850133+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T13:43:51.657537\", \"last_device_update\": \"2021-03-10T13:43:57.842752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:43:59.855 INFO:teuthology.orchestra.run.gibba013.stderr:adjusted tunables profile to default 2021-03-10T13:44:00.109 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:59 gibba013 bash[9767]: cluster 2021-03-10T13:43:58.379143+0000 mgr.y (mgr.14140) 12 : cluster [DBG] pgmap v9: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:00.109 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:43:59 gibba013 bash[9767]: audit 2021-03-10T13:43:59.754594+0000 mon.a (mon.0) 117 : audit [INF] from='client.? 172.21.2.113:0/2176400462' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2021-03-10T13:44:00.424 INFO:tasks.cephadm:Adding mon.c on gibba013 2021-03-10T13:44:00.424 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph orch daemon add mon 'gibba013:[v2:172.21.2.113:3301,v1:172.21.2.113:6790]=c' 2021-03-10T13:44:01.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:00 gibba013 bash[9767]: audit 2021-03-10T13:43:59.850697+0000 mon.a (mon.0) 118 : audit [INF] from='client.? 172.21.2.113:0/2176400462' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2021-03-10T13:44:01.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:00 gibba013 bash[9767]: cluster 2021-03-10T13:43:59.850737+0000 mon.a (mon.0) 119 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-03-10T13:44:02.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:01 gibba013 bash[9767]: cluster 2021-03-10T13:44:00.379729+0000 mgr.y (mgr.14140) 13 : cluster [DBG] pgmap v11: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:03.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:02 gibba013 bash[9767]: audit 2021-03-10T13:44:02.783701+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:44:03.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:02 gibba013 bash[9767]: audit 2021-03-10T13:44:02.784848+0000 mon.a (mon.0) 121 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:44:03.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:02 gibba013 bash[9767]: audit 2021-03-10T13:44:02.785843+0000 mon.a (mon.0) 122 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2021-03-10T13:44:04.082 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:03 gibba013 bash[9767]: cluster 2021-03-10T13:44:02.380293+0000 mgr.y (mgr.14140) 14 : cluster [DBG] pgmap v12: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:04.082 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:03 gibba013 bash[9767]: audit 2021-03-10T13:44:02.782278+0000 mgr.y (mgr.14140) 15 : audit [DBG] from='client.14165 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "gibba013:[v2:172.21.2.113:3301,v1:172.21.2.113:6790]=c", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:44:04.082 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:03 gibba013 bash[9767]: cephadm 2021-03-10T13:44:02.785643+0000 mgr.y (mgr.14140) 16 : cephadm [INF] Deploying daemon mon.c on gibba013 2021-03-10T13:44:05.790 INFO:teuthology.orchestra.run.gibba013.stdout:Deployed mon.c on host 'gibba013' 2021-03-10T13:44:06.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:05 gibba013 bash[9767]: cluster 2021-03-10T13:44:04.380809+0000 mgr.y (mgr.14140) 17 : cluster [DBG] pgmap v13: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:06.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:05 gibba013 bash[9767]: audit 2021-03-10T13:44:05.660676+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.944202\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.944275\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}}, \"last_device_update\": \"2021-03-10T13:43:31.885152\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:44:06.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:05 gibba013 bash[9767]: audit 2021-03-10T13:44:05.661198+0000 mon.a (mon.0) 124 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:06.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:05 gibba013 bash[9767]: audit 2021-03-10T13:44:05.662410+0000 mon.a (mon.0) 125 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.944202\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:43:26.944275\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}}, \"last_device_update\": \"2021-03-10T13:43:31.885152\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:44:06.650 DEBUG:teuthology.orchestra.run.gibba013:mon.c> sudo journalctl -f -n 0 -u ceph-7672acc8-81a6-11eb-9080-001a4aab830c@mon.c.service 2021-03-10T13:44:06.652 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2021-03-10T13:44:06.656 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph mon dump -f json 2021-03-10T13:44:06.861 INFO:journalctl@ceph.mon.c.gibba013.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:44:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:06 gibba013 bash[9767]: audit 2021-03-10T13:44:06.187885+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:06.186019\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:06.186223\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:06.186341\", \"created\": \"2021-03-10T13:44:05.649466\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}}, \"last_daemon_update\": \"2021-03-10T13:44:06.186539\", \"last_device_update\": \"2021-03-10T13:43:31.885152\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:44:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:06 gibba013 bash[9767]: audit 2021-03-10T13:44:06.192291+0000 mon.a (mon.0) 127 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:06.186019\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:06.186223\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:06.186341\", \"created\": \"2021-03-10T13:44:05.649466\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}}, \"last_daemon_update\": \"2021-03-10T13:44:06.186539\", \"last_device_update\": \"2021-03-10T13:43:31.885152\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:44:07.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.237+0000 7f29688a46c0 0 set uid:gid to 167:167 (ceph:ceph) 2021-03-10T13:44:07.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.237+0000 7f29688a46c0 0 ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc), process ceph-mon, pid 1 2021-03-10T13:44:07.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.237+0000 7f29688a46c0 0 pidfile_write: ignore empty --pid-file 2021-03-10T13:44:07.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 0 load: jerasure load: lrc load: isa 2021-03-10T13:44:07.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 0 set rocksdb option compression = kNoCompression 2021-03-10T13:44:07.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2021-03-10T13:44:07.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 0 set rocksdb option write_buffer_size = 33554432 2021-03-10T13:44:07.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 0 set rocksdb option compression = kNoCompression 2021-03-10T13:44:07.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2021-03-10T13:44:07.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 0 set rocksdb option write_buffer_size = 33554432 2021-03-10T13:44:07.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 1 rocksdb: do_open column families: [default] 2021-03-10T13:44:07.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: RocksDB version: 6.1.2 2021-03-10T13:44:07.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-03-10T13:44:07.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Compile date Mar 23 2020 2021-03-10T13:44:07.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: DB SUMMARY 2021-03-10T13:44:07.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: CURRENT file: CURRENT 2021-03-10T13:44:07.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: IDENTITY file: IDENTITY 2021-03-10T13:44:07.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2021-03-10T13:44:07.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2021-03-10T13:44:07.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000003.log size: 489 ; 2021-03-10T13:44:07.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.error_if_exists: 0 2021-03-10T13:44:07.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.create_if_missing: 0 2021-03-10T13:44:07.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.paranoid_checks: 1 2021-03-10T13:44:07.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.env: 0x5637b4fd31a0 2021-03-10T13:44:07.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.info_log: 0x5637b63a29a0 2021-03-10T13:44:07.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.max_file_opening_threads: 16 2021-03-10T13:44:07.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.statistics: (nil) 2021-03-10T13:44:07.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.use_fsync: 0 2021-03-10T13:44:07.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.max_log_file_size: 0 2021-03-10T13:44:07.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-03-10T13:44:07.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.log_file_time_to_roll: 0 2021-03-10T13:44:07.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.keep_log_file_num: 1000 2021-03-10T13:44:07.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.recycle_log_file_num: 0 2021-03-10T13:44:07.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.allow_fallocate: 1 2021-03-10T13:44:07.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.allow_mmap_reads: 0 2021-03-10T13:44:07.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.allow_mmap_writes: 0 2021-03-10T13:44:07.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.use_direct_reads: 0 2021-03-10T13:44:07.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-03-10T13:44:07.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.create_missing_column_families: 0 2021-03-10T13:44:07.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.db_log_dir: 2021-03-10T13:44:07.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-c/store.db 2021-03-10T13:44:07.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.table_cache_numshardbits: 6 2021-03-10T13:44:07.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.max_subcompactions: 1 2021-03-10T13:44:07.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.max_background_flushes: -1 2021-03-10T13:44:07.644 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-03-10T13:44:07.644 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-03-10T13:44:07.644 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-03-10T13:44:07.644 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-03-10T13:44:07.645 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.advise_random_on_open: 1 2021-03-10T13:44:07.645 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.db_write_buffer_size: 0 2021-03-10T13:44:07.645 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.write_buffer_manager: 0x5637b6f3cb10 2021-03-10T13:44:07.645 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-03-10T13:44:07.645 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-03-10T13:44:07.646 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-03-10T13:44:07.646 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.use_adaptive_mutex: 0 2021-03-10T13:44:07.646 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.rate_limiter: (nil) 2021-03-10T13:44:07.646 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-03-10T13:44:07.646 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.wal_recovery_mode: 2 2021-03-10T13:44:07.647 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.enable_thread_tracking: 0 2021-03-10T13:44:07.647 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.enable_pipelined_write: 0 2021-03-10T13:44:07.647 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-03-10T13:44:07.647 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-03-10T13:44:07.647 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-03-10T13:44:07.648 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-03-10T13:44:07.648 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.row_cache: None 2021-03-10T13:44:07.648 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.wal_filter: None 2021-03-10T13:44:07.648 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-03-10T13:44:07.649 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.allow_ingest_behind: 0 2021-03-10T13:44:07.649 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.preserve_deletes: 0 2021-03-10T13:44:07.649 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.two_write_queues: 0 2021-03-10T13:44:07.649 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.manual_wal_flush: 0 2021-03-10T13:44:07.649 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.atomic_flush: 0 2021-03-10T13:44:07.650 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-03-10T13:44:07.650 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.max_background_jobs: 2 2021-03-10T13:44:07.650 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.max_background_compactions: -1 2021-03-10T13:44:07.650 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-03-10T13:44:07.650 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-03-10T13:44:07.651 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.delayed_write_rate : 16777216 2021-03-10T13:44:07.651 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.max_total_wal_size: 0 2021-03-10T13:44:07.651 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-03-10T13:44:07.651 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.stats_dump_period_sec: 600 2021-03-10T13:44:07.651 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.stats_persist_period_sec: 600 2021-03-10T13:44:07.652 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-03-10T13:44:07.652 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.max_open_files: -1 2021-03-10T13:44:07.652 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.bytes_per_sync: 0 2021-03-10T13:44:07.652 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-03-10T13:44:07.653 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.compaction_readahead_size: 0 2021-03-10T13:44:07.653 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Compression algorithms supported: 2021-03-10T13:44:07.653 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-03-10T13:44:07.653 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: kZSTD supported: 0 2021-03-10T13:44:07.653 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: kXpressCompression supported: 0 2021-03-10T13:44:07.654 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: kLZ4HCCompression supported: 1 2021-03-10T13:44:07.654 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: kLZ4Compression supported: 1 2021-03-10T13:44:07.654 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: kBZip2Compression supported: 0 2021-03-10T13:44:07.654 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: kZlibCompression supported: 1 2021-03-10T13:44:07.655 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: kSnappyCompression supported: 1 2021-03-10T13:44:07.655 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-03-10T13:44:07.655 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000001 2021-03-10T13:44:07.655 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]: 2021-03-10T13:44:07.655 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-03-10T13:44:07.656 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.merge_operator: 2021-03-10T13:44:07.656 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.compaction_filter: None 2021-03-10T13:44:07.656 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.compaction_filter_factory: None 2021-03-10T13:44:07.656 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-03-10T13:44:07.656 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.table_factory: BlockBasedTable 2021-03-10T13:44:07.657 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5637b62c2138) 2021-03-10T13:44:07.657 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: cache_index_and_filter_blocks: 1 2021-03-10T13:44:07.657 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: cache_index_and_filter_blocks_with_high_priority: 1 2021-03-10T13:44:07.657 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-03-10T13:44:07.658 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: pin_top_level_index_and_filter: 1 2021-03-10T13:44:07.658 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: index_type: 0 2021-03-10T13:44:07.658 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: data_block_index_type: 0 2021-03-10T13:44:07.658 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: data_block_hash_table_util_ratio: 0.750000 2021-03-10T13:44:07.658 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: hash_index_allow_collision: 1 2021-03-10T13:44:07.659 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: checksum: 1 2021-03-10T13:44:07.659 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: no_block_cache: 0 2021-03-10T13:44:07.659 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: block_cache: 0x5637b62f8610 2021-03-10T13:44:07.659 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: block_cache_name: BinnedLRUCache 2021-03-10T13:44:07.659 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: block_cache_options: 2021-03-10T13:44:07.660 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: capacity : 536870912 2021-03-10T13:44:07.660 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: num_shard_bits : 4 2021-03-10T13:44:07.660 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: strict_capacity_limit : 0 2021-03-10T13:44:07.660 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: high_pri_pool_ratio: 0.000 2021-03-10T13:44:07.660 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: block_cache_compressed: (nil) 2021-03-10T13:44:07.661 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: persistent_cache: (nil) 2021-03-10T13:44:07.661 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: block_size: 4096 2021-03-10T13:44:07.661 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: block_size_deviation: 10 2021-03-10T13:44:07.661 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: block_restart_interval: 16 2021-03-10T13:44:07.661 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: index_block_restart_interval: 1 2021-03-10T13:44:07.662 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: metadata_block_size: 4096 2021-03-10T13:44:07.662 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: partition_filters: 0 2021-03-10T13:44:07.662 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: use_delta_encoding: 1 2021-03-10T13:44:07.662 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: filter_policy: rocksdb.BuiltinBloomFilter 2021-03-10T13:44:07.663 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: whole_key_filtering: 1 2021-03-10T13:44:07.663 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: verify_compression: 0 2021-03-10T13:44:07.663 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: read_amp_bytes_per_bit: 0 2021-03-10T13:44:07.663 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: format_version: 2 2021-03-10T13:44:07.663 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: enable_index_compression: 1 2021-03-10T13:44:07.664 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: block_align: 0 2021-03-10T13:44:07.664 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.write_buffer_size: 33554432 2021-03-10T13:44:07.664 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.max_write_buffer_number: 2 2021-03-10T13:44:07.664 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.compression: NoCompression 2021-03-10T13:44:07.664 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.bottommost_compression: Disabled 2021-03-10T13:44:07.665 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.prefix_extractor: nullptr 2021-03-10T13:44:07.665 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-03-10T13:44:07.665 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.num_levels: 7 2021-03-10T13:44:07.665 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-03-10T13:44:07.666 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-03-10T13:44:07.666 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-03-10T13:44:07.666 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-03-10T13:44:07.666 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-03-10T13:44:07.666 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-03-10T13:44:07.667 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-03-10T13:44:07.667 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-03-10T13:44:07.667 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.compression_opts.window_bits: -14 2021-03-10T13:44:07.667 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.compression_opts.level: 32767 2021-03-10T13:44:07.667 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.compression_opts.strategy: 0 2021-03-10T13:44:07.668 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-03-10T13:44:07.668 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-03-10T13:44:07.668 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.compression_opts.enabled: false 2021-03-10T13:44:07.668 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-03-10T13:44:07.668 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-03-10T13:44:07.669 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-03-10T13:44:07.669 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.target_file_size_base: 67108864 2021-03-10T13:44:07.669 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.target_file_size_multiplier: 1 2021-03-10T13:44:07.669 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-03-10T13:44:07.670 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-03-10T13:44:07.670 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-03-10T13:44:07.670 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-03-10T13:44:07.670 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-03-10T13:44:07.670 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-03-10T13:44:07.671 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-03-10T13:44:07.671 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-03-10T13:44:07.671 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-03-10T13:44:07.671 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-03-10T13:44:07.672 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-03-10T13:44:07.672 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-03-10T13:44:07.672 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.arena_block_size: 4194304 2021-03-10T13:44:07.672 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-03-10T13:44:07.672 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-03-10T13:44:07.673 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-03-10T13:44:07.673 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.disable_auto_compactions: 0 2021-03-10T13:44:07.673 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-03-10T13:44:07.673 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-03-10T13:44:07.673 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-03-10T13:44:07.674 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-03-10T13:44:07.674 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-03-10T13:44:07.674 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-03-10T13:44:07.674 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-03-10T13:44:07.675 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-03-10T13:44:07.675 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-03-10T13:44:07.675 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-03-10T13:44:07.675 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.table_properties_collectors: 2021-03-10T13:44:07.676 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.inplace_update_support: 0 2021-03-10T13:44:07.676 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-03-10T13:44:07.676 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-03-10T13:44:07.676 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-03-10T13:44:07.676 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.memtable_huge_page_size: 0 2021-03-10T13:44:07.677 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.bloom_locality: 0 2021-03-10T13:44:07.677 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.max_successive_merges: 0 2021-03-10T13:44:07.677 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-03-10T13:44:07.677 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.paranoid_file_checks: 0 2021-03-10T13:44:07.677 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.force_consistency_checks: 0 2021-03-10T13:44:07.678 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.report_bg_io_stats: 0 2021-03-10T13:44:07.678 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: Options.ttl: 0 2021-03-10T13:44:07.678 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-03-10T13:44:07.678 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 0 2021-03-10T13:44:07.678 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615383847244674, "job": 1, "event": "recovery_started", "log_files": [3]} 2021-03-10T13:44:07.679 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #3 mode 2 2021-03-10T13:44:07.679 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615383847245138, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1403, "table_properties": {"data_size": 501, "index_size": 28, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 379, "raw_average_value_size": 75, "num_data_blocks": 1, "num_entries": 5, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}} 2021-03-10T13:44:07.679 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: [db/version_set.cc:3036] Creating manifest 5 2021-03-10T13:44:07.679 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.241+0000 7f29688a46c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615383847245678, "job": 1, "event": "recovery_finished"} 2021-03-10T13:44:07.680 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.245+0000 7f29688a46c0 4 rocksdb: DB pointer 0x5637b6393200 2021-03-10T13:44:07.680 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.245+0000 7f29688a46c0 0 mon.c does not exist in monmap, will attempt to join an existing cluster 2021-03-10T13:44:07.680 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.245+0000 7f294f9f1700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS ------- 2021-03-10T13:44:07.680 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.245+0000 7f294f9f1700 4 rocksdb: [db/db_impl.cc:778] 2021-03-10T13:44:07.680 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: ** DB Stats ** 2021-03-10T13:44:07.681 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:44:07.681 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-03-10T13:44:07.681 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-03-10T13:44:07.681 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T13:44:07.681 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-03-10T13:44:07.682 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-03-10T13:44:07.682 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T13:44:07.682 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: ** Compaction Stats [default] ** 2021-03-10T13:44:07.682 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:44:07.682 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:44:07.683 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: L0 1/0 1.37 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.2 0.00 0.00 1 0.000 0 0 2021-03-10T13:44:07.683 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: Sum 1/0 1.37 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.2 0.00 0.00 1 0.000 0 0 2021-03-10T13:44:07.683 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.2 0.00 0.00 1 0.000 0 0 2021-03-10T13:44:07.683 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: ** Compaction Stats [default] ** 2021-03-10T13:44:07.683 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:44:07.684 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:44:07.684 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.2 0.00 0.00 1 0.000 0 0 2021-03-10T13:44:07.684 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:44:07.684 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: Flush(GB): cumulative 0.000, interval 0.000 2021-03-10T13:44:07.685 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T13:44:07.685 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T13:44:07.685 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T13:44:07.685 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T13:44:07.685 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: Cumulative compaction: 0.00 GB write, 0.46 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:44:07.686 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: Interval compaction: 0.00 GB write, 0.46 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:44:07.686 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T13:44:07.686 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T13:44:07.686 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: ** Compaction Stats [default] ** 2021-03-10T13:44:07.687 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:44:07.687 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:44:07.687 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: L0 1/0 1.37 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.2 0.00 0.00 1 0.000 0 0 2021-03-10T13:44:07.687 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: Sum 1/0 1.37 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.2 0.00 0.00 1 0.000 0 0 2021-03-10T13:44:07.687 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:44:07.688 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: ** Compaction Stats [default] ** 2021-03-10T13:44:07.688 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:44:07.688 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:44:07.688 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.2 0.00 0.00 1 0.000 0 0 2021-03-10T13:44:07.688 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:44:07.689 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: Flush(GB): cumulative 0.000, interval 0.000 2021-03-10T13:44:07.689 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T13:44:07.689 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T13:44:07.689 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T13:44:07.689 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T13:44:07.690 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: Cumulative compaction: 0.00 GB write, 0.46 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:44:07.690 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:44:07.690 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T13:44:07.690 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T13:44:07.691 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.245+0000 7f29688a46c0 0 using public_addrv [v2:172.21.2.113:3301/0,v1:172.21.2.113:6790/0] 2021-03-10T13:44:07.691 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.245+0000 7f29688a46c0 0 starting mon.c rank -1 at public addrs [v2:172.21.2.113:3301/0,v1:172.21.2.113:6790/0] at bind addrs [v2:172.21.2.113:3301/0,v1:172.21.2.113:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid 7672acc8-81a6-11eb-9080-001a4aab830c 2021-03-10T13:44:07.691 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.245+0000 7f29688a46c0 1 mon.c@-1(???) e0 preinit fsid 7672acc8-81a6-11eb-9080-001a4aab830c 2021-03-10T13:44:07.691 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.257+0000 7f29521f6700 0 mon.c@-1(synchronizing).mds e1 new map 2021-03-10T13:44:07.691 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.257+0000 7f29521f6700 0 mon.c@-1(synchronizing).mds e1 print_map 2021-03-10T13:44:07.692 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: e1 2021-03-10T13:44:07.692 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: enable_multiple, ever_enabled_multiple: 0,0 2021-03-10T13:44:07.692 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-03-10T13:44:07.692 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: legacy client fscid: -1 2021-03-10T13:44:07.692 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: 2021-03-10T13:44:07.693 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: No filesystems configured 2021-03-10T13:44:07.693 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.257+0000 7f29521f6700 1 mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2021-03-10T13:44:07.693 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.257+0000 7f29521f6700 1 mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2021-03-10T13:44:07.693 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.257+0000 7f29521f6700 1 mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2021-03-10T13:44:07.693 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.257+0000 7f29521f6700 1 mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2021-03-10T13:44:07.694 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.257+0000 7f29521f6700 1 mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2021-03-10T13:44:07.694 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.257+0000 7f29521f6700 1 mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2021-03-10T13:44:07.694 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.257+0000 7f29521f6700 1 mon.c@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2021-03-10T13:44:07.694 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.257+0000 7f29521f6700 1 mon.c@-1(synchronizing).osd e6 e6: 0 total, 0 up, 0 in 2021-03-10T13:44:07.695 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.257+0000 7f29521f6700 0 mon.c@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T13:44:07.695 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.257+0000 7f29521f6700 0 mon.c@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T13:44:07.695 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.257+0000 7f29521f6700 0 mon.c@-1(synchronizing).osd e6 crush map has features 3314933000852226048, adjusting msgr requires 2021-03-10T13:44:07.695 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.257+0000 7f29521f6700 0 mon.c@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T13:44:07.695 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: audit 2021-03-10T13:44:06.187885+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:06.186019\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:06.186223\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:06.186341\", \"created\": \"2021-03-10T13:44:05.649466\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}}, \"last_daemon_update\": \"2021-03-10T13:44:06.186539\", \"last_device_update\": \"2021-03-10T13:43:31.885152\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:44:07.696 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: audit 2021-03-10T13:44:06.192291+0000 mon.a (mon.0) 127 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:06.186019\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:06.186223\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:06.186341\", \"created\": \"2021-03-10T13:44:05.649466\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}}, \"last_daemon_update\": \"2021-03-10T13:44:06.186539\", \"last_device_update\": \"2021-03-10T13:43:31.885152\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:44:07.696 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:07 gibba013 bash[13024]: debug 2021-03-10T13:44:07.257+0000 7f29521f6700 1 mon.c@-1(synchronizing).paxosservice(auth 1..4) refresh upgraded, format 0 -> 3 2021-03-10T13:44:12.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:12 gibba013 bash[9767]: cluster 2021-03-10T13:44:07.264010+0000 mon.a (mon.0) 128 : cluster [INF] mon.a calling monitor election 2021-03-10T13:44:12.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:12 gibba013 bash[9767]: cluster 2021-03-10T13:44:08.382292+0000 mgr.y (mgr.14140) 19 : cluster [DBG] pgmap v15: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:12.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:12 gibba013 bash[9767]: cluster 2021-03-10T13:44:09.263107+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2021-03-10T13:44:12.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:12 gibba013 bash[9767]: cluster 2021-03-10T13:44:10.383201+0000 mgr.y (mgr.14140) 20 : cluster [DBG] pgmap v16: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:12.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:12 gibba013 bash[9767]: cluster 2021-03-10T13:44:12.270021+0000 mon.a (mon.0) 129 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-03-10T13:44:12.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:12 gibba013 bash[9767]: cluster 2021-03-10T13:44:12.278856+0000 mon.a (mon.0) 130 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.2.113:3300/0,v1:172.21.2.113:6789/0],c=[v2:172.21.2.113:3301/0,v1:172.21.2.113:6790/0]} 2021-03-10T13:44:12.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:12 gibba013 bash[9767]: cluster 2021-03-10T13:44:12.278984+0000 mon.a (mon.0) 131 : cluster [DBG] fsmap 2021-03-10T13:44:12.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:12 gibba013 bash[9767]: cluster 2021-03-10T13:44:12.279052+0000 mon.a (mon.0) 132 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-03-10T13:44:12.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:12 gibba013 bash[9767]: cluster 2021-03-10T13:44:12.279467+0000 mon.a (mon.0) 133 : cluster [DBG] mgrmap e13: y(active, since 46s) 2021-03-10T13:44:12.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:12 gibba013 bash[9767]: cluster 2021-03-10T13:44:12.281896+0000 mon.a (mon.0) 134 : cluster [INF] overall HEALTH_OK 2021-03-10T13:44:12.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:12 gibba013 bash[13024]: cluster 2021-03-10T13:44:07.264010+0000 mon.a (mon.0) 128 : cluster [INF] mon.a calling monitor election 2021-03-10T13:44:12.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:12 gibba013 bash[13024]: cluster 2021-03-10T13:44:08.382292+0000 mgr.y (mgr.14140) 19 : cluster [DBG] pgmap v15: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:12.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:12 gibba013 bash[13024]: cluster 2021-03-10T13:44:09.263107+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2021-03-10T13:44:12.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:12 gibba013 bash[13024]: cluster 2021-03-10T13:44:10.383201+0000 mgr.y (mgr.14140) 20 : cluster [DBG] pgmap v16: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:12.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:12 gibba013 bash[13024]: cluster 2021-03-10T13:44:12.270021+0000 mon.a (mon.0) 129 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-03-10T13:44:12.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:12 gibba013 bash[13024]: cluster 2021-03-10T13:44:12.278856+0000 mon.a (mon.0) 130 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.2.113:3300/0,v1:172.21.2.113:6789/0],c=[v2:172.21.2.113:3301/0,v1:172.21.2.113:6790/0]} 2021-03-10T13:44:12.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:12 gibba013 bash[13024]: cluster 2021-03-10T13:44:12.278984+0000 mon.a (mon.0) 131 : cluster [DBG] fsmap 2021-03-10T13:44:12.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:12 gibba013 bash[13024]: cluster 2021-03-10T13:44:12.279052+0000 mon.a (mon.0) 132 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-03-10T13:44:12.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:12 gibba013 bash[13024]: cluster 2021-03-10T13:44:12.279467+0000 mon.a (mon.0) 133 : cluster [DBG] mgrmap e13: y(active, since 46s) 2021-03-10T13:44:12.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:12 gibba013 bash[13024]: cluster 2021-03-10T13:44:12.281896+0000 mon.a (mon.0) 134 : cluster [INF] overall HEALTH_OK 2021-03-10T13:44:13.452 INFO:teuthology.orchestra.run.gibba013.stdout: 2021-03-10T13:44:13.452 INFO:teuthology.orchestra.run.gibba013.stdout:{"epoch":2,"fsid":"7672acc8-81a6-11eb-9080-001a4aab830c","modified":"2021-03-10T13:44:07.262426Z","created":"2021-03-10T13:42:52.040457Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:3300","nonce":0},{"type":"v1","addr":"172.21.2.113:6789","nonce":0}]},"addr":"172.21.2.113:6789/0","public_addr":"172.21.2.113:6789/0","priority":0,"weight":0},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:3301","nonce":0},{"type":"v1","addr":"172.21.2.113:6790","nonce":0}]},"addr":"172.21.2.113:6790/0","public_addr":"172.21.2.113:6790/0","priority":0,"weight":0}],"quorum":[0,1]} 2021-03-10T13:44:13.453 INFO:teuthology.orchestra.run.gibba013.stderr:dumped monmap epoch 2 2021-03-10T13:44:13.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:13 gibba013 bash[9767]: cluster 2021-03-10T13:44:12.383913+0000 mgr.y (mgr.14140) 21 : cluster [DBG] pgmap v17: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:13.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:13 gibba013 bash[13024]: cluster 2021-03-10T13:44:12.383913+0000 mgr.y (mgr.14140) 21 : cluster [DBG] pgmap v17: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:14.048 INFO:tasks.cephadm:Adding mon.b on gibba020 2021-03-10T13:44:14.049 DEBUG:teuthology.orchestra.run.gibba020:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph orch daemon add mon gibba020:172.21.2.120=b 2021-03-10T13:44:14.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:14 gibba013 bash[9767]: audit 2021-03-10T13:44:13.449378+0000 mon.a (mon.0) 135 : audit [DBG] from='client.? 172.21.2.113:0/3349185544' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-03-10T13:44:14.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:14 gibba013 bash[13024]: audit 2021-03-10T13:44:13.449378+0000 mon.a (mon.0) 135 : audit [DBG] from='client.? 172.21.2.113:0/3349185544' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-03-10T13:44:15.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:15 gibba013 bash[9767]: cluster 2021-03-10T13:44:14.384472+0000 mgr.y (mgr.14140) 22 : cluster [DBG] pgmap v18: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:15.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:15 gibba013 bash[13024]: cluster 2021-03-10T13:44:14.384472+0000 mgr.y (mgr.14140) 22 : cluster [DBG] pgmap v18: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:17.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:17 gibba013 bash[9767]: cluster 2021-03-10T13:44:16.385138+0000 mgr.y (mgr.14140) 23 : cluster [DBG] pgmap v19: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:17.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:17 gibba013 bash[9767]: audit 2021-03-10T13:44:16.811085+0000 mgr.y (mgr.14140) 24 : audit [DBG] from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "gibba020:172.21.2.120=b", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:44:17.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:17 gibba013 bash[9767]: audit 2021-03-10T13:44:16.814557+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:44:17.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:17 gibba013 bash[9767]: audit 2021-03-10T13:44:16.817468+0000 mon.a (mon.0) 137 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:44:17.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:17 gibba013 bash[9767]: cephadm 2021-03-10T13:44:16.819779+0000 mgr.y (mgr.14140) 25 : cephadm [INF] Deploying daemon mon.b on gibba020 2021-03-10T13:44:17.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:17 gibba013 bash[9767]: audit 2021-03-10T13:44:16.820715+0000 mon.a (mon.0) 138 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2021-03-10T13:44:17.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:17 gibba013 bash[13024]: cluster 2021-03-10T13:44:16.385138+0000 mgr.y (mgr.14140) 23 : cluster [DBG] pgmap v19: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:17.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:17 gibba013 bash[13024]: audit 2021-03-10T13:44:16.811085+0000 mgr.y (mgr.14140) 24 : audit [DBG] from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "gibba020:172.21.2.120=b", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:44:17.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:17 gibba013 bash[13024]: audit 2021-03-10T13:44:16.814557+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:44:17.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:17 gibba013 bash[13024]: audit 2021-03-10T13:44:16.817468+0000 mon.a (mon.0) 137 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:44:17.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:17 gibba013 bash[13024]: cephadm 2021-03-10T13:44:16.819779+0000 mgr.y (mgr.14140) 25 : cephadm [INF] Deploying daemon mon.b on gibba020 2021-03-10T13:44:17.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:17 gibba013 bash[13024]: audit 2021-03-10T13:44:16.820715+0000 mon.a (mon.0) 138 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2021-03-10T13:44:19.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:19 gibba013 bash[9767]: cluster 2021-03-10T13:44:18.386061+0000 mgr.y (mgr.14140) 26 : cluster [DBG] pgmap v20: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:19.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:19 gibba013 bash[13024]: cluster 2021-03-10T13:44:18.386061+0000 mgr.y (mgr.14140) 26 : cluster [DBG] pgmap v20: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:20.826 INFO:teuthology.orchestra.run.gibba020.stdout:Deployed mon.b on host 'gibba020' 2021-03-10T13:44:21.707 DEBUG:teuthology.orchestra.run.gibba020:mon.b> sudo journalctl -f -n 0 -u ceph-7672acc8-81a6-11eb-9080-001a4aab830c@mon.b.service 2021-03-10T13:44:21.710 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2021-03-10T13:44:21.710 DEBUG:teuthology.orchestra.run.gibba020:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph mon dump -f json 2021-03-10T13:44:21.761 INFO:journalctl@ceph.mon.b.gibba020.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:44:21.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:21 gibba013 bash[9767]: cluster 2021-03-10T13:44:20.386605+0000 mgr.y (mgr.14140) 27 : cluster [DBG] pgmap v21: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:21.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:21 gibba013 bash[9767]: audit 2021-03-10T13:44:20.538225+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}}, \"last_device_update\": \"2021-03-10T13:43:57.842752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:44:21.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:21 gibba013 bash[9767]: audit 2021-03-10T13:44:20.539554+0000 mon.a (mon.0) 140 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:21.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:21 gibba013 bash[13024]: cluster 2021-03-10T13:44:20.386605+0000 mgr.y (mgr.14140) 27 : cluster [DBG] pgmap v21: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:21.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:21 gibba013 bash[13024]: audit 2021-03-10T13:44:20.538225+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}}, \"last_device_update\": \"2021-03-10T13:43:57.842752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:44:21.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:21 gibba013 bash[13024]: audit 2021-03-10T13:44:20.539554+0000 mon.a (mon.0) 140 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:21.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:21 gibba013 bash[9767]: audit 2021-03-10T13:44:20.545667+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}}, \"last_device_update\": \"2021-03-10T13:43:57.842752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:44:21.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:21 gibba013 bash[13024]: audit 2021-03-10T13:44:20.545667+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}}, \"last_device_update\": \"2021-03-10T13:43:57.842752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:44:21.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:21 gibba013 bash[13024]: audit 2021-03-10T13:44:20.695000+0000 mon.a (mon.0) 142 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:20.693310\", \"created\": \"2021-03-10T13:44:20.530781\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}}, \"last_daemon_update\": \"2021-03-10T13:44:20.693599\", \"last_device_update\": \"2021-03-10T13:43:57.842752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:44:21.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:21 gibba013 bash[13024]: audit 2021-03-10T13:44:20.702403+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:20.693310\", \"created\": \"2021-03-10T13:44:20.530781\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}}, \"last_daemon_update\": \"2021-03-10T13:44:20.693599\", \"last_device_update\": \"2021-03-10T13:43:57.842752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:44:21.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:21 gibba013 bash[9767]: audit 2021-03-10T13:44:20.695000+0000 mon.a (mon.0) 142 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:20.693310\", \"created\": \"2021-03-10T13:44:20.530781\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}}, \"last_daemon_update\": \"2021-03-10T13:44:20.693599\", \"last_device_update\": \"2021-03-10T13:43:57.842752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:44:21.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:21 gibba013 bash[9767]: audit 2021-03-10T13:44:20.702403+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:20.693310\", \"created\": \"2021-03-10T13:44:20.530781\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}}, \"last_daemon_update\": \"2021-03-10T13:44:20.693599\", \"last_device_update\": \"2021-03-10T13:43:57.842752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:44:21.958 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.854+0000 7fb91ae3c6c0 0 set uid:gid to 167:167 (ceph:ceph) 2021-03-10T13:44:21.959 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.854+0000 7fb91ae3c6c0 0 ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc), process ceph-mon, pid 1 2021-03-10T13:44:21.959 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.854+0000 7fb91ae3c6c0 0 pidfile_write: ignore empty --pid-file 2021-03-10T13:44:21.959 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 0 load: jerasure load: lrc load: isa 2021-03-10T13:44:21.959 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 0 set rocksdb option compression = kNoCompression 2021-03-10T13:44:21.959 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2021-03-10T13:44:21.960 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 0 set rocksdb option write_buffer_size = 33554432 2021-03-10T13:44:21.960 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 0 set rocksdb option compression = kNoCompression 2021-03-10T13:44:21.960 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2021-03-10T13:44:21.960 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 0 set rocksdb option write_buffer_size = 33554432 2021-03-10T13:44:21.961 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 1 rocksdb: do_open column families: [default] 2021-03-10T13:44:21.961 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: RocksDB version: 6.1.2 2021-03-10T13:44:21.961 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-03-10T13:44:21.961 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Compile date Mar 23 2020 2021-03-10T13:44:21.961 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: DB SUMMARY 2021-03-10T13:44:21.962 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: CURRENT file: CURRENT 2021-03-10T13:44:21.962 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: IDENTITY file: IDENTITY 2021-03-10T13:44:21.962 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2021-03-10T13:44:21.962 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2021-03-10T13:44:21.962 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000003.log size: 610 ; 2021-03-10T13:44:21.963 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.error_if_exists: 0 2021-03-10T13:44:21.963 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.create_if_missing: 0 2021-03-10T13:44:21.963 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.paranoid_checks: 1 2021-03-10T13:44:21.963 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.env: 0x56477f0ae1a0 2021-03-10T13:44:21.964 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.info_log: 0x5647809849a0 2021-03-10T13:44:21.964 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.max_file_opening_threads: 16 2021-03-10T13:44:21.964 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.statistics: (nil) 2021-03-10T13:44:21.964 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.use_fsync: 0 2021-03-10T13:44:21.965 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.max_log_file_size: 0 2021-03-10T13:44:21.965 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-03-10T13:44:21.966 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.log_file_time_to_roll: 0 2021-03-10T13:44:21.966 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.keep_log_file_num: 1000 2021-03-10T13:44:21.966 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.recycle_log_file_num: 0 2021-03-10T13:44:21.966 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.allow_fallocate: 1 2021-03-10T13:44:21.966 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.allow_mmap_reads: 0 2021-03-10T13:44:21.967 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.allow_mmap_writes: 0 2021-03-10T13:44:21.967 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.use_direct_reads: 0 2021-03-10T13:44:21.967 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-03-10T13:44:21.967 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.create_missing_column_families: 0 2021-03-10T13:44:21.968 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.db_log_dir: 2021-03-10T13:44:21.968 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-b/store.db 2021-03-10T13:44:21.968 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.table_cache_numshardbits: 6 2021-03-10T13:44:21.968 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.max_subcompactions: 1 2021-03-10T13:44:21.968 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.max_background_flushes: -1 2021-03-10T13:44:21.969 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-03-10T13:44:21.969 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-03-10T13:44:21.969 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-03-10T13:44:21.969 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-03-10T13:44:21.969 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.advise_random_on_open: 1 2021-03-10T13:44:21.970 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.db_write_buffer_size: 0 2021-03-10T13:44:21.970 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.write_buffer_manager: 0x56478151ea80 2021-03-10T13:44:21.970 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-03-10T13:44:21.970 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-03-10T13:44:21.970 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-03-10T13:44:21.971 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.use_adaptive_mutex: 0 2021-03-10T13:44:21.971 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.rate_limiter: (nil) 2021-03-10T13:44:21.971 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-03-10T13:44:21.971 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.wal_recovery_mode: 2 2021-03-10T13:44:21.972 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.enable_thread_tracking: 0 2021-03-10T13:44:21.972 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.enable_pipelined_write: 0 2021-03-10T13:44:21.972 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-03-10T13:44:21.972 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-03-10T13:44:21.972 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-03-10T13:44:21.973 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-03-10T13:44:21.973 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.row_cache: None 2021-03-10T13:44:21.973 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.wal_filter: None 2021-03-10T13:44:21.973 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-03-10T13:44:21.973 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.allow_ingest_behind: 0 2021-03-10T13:44:21.974 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.preserve_deletes: 0 2021-03-10T13:44:21.974 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.two_write_queues: 0 2021-03-10T13:44:21.974 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.manual_wal_flush: 0 2021-03-10T13:44:21.974 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.atomic_flush: 0 2021-03-10T13:44:21.974 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-03-10T13:44:21.975 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.max_background_jobs: 2 2021-03-10T13:44:21.975 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.max_background_compactions: -1 2021-03-10T13:44:21.975 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-03-10T13:44:21.975 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-03-10T13:44:21.975 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.delayed_write_rate : 16777216 2021-03-10T13:44:21.976 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.max_total_wal_size: 0 2021-03-10T13:44:21.976 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-03-10T13:44:21.976 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.stats_dump_period_sec: 600 2021-03-10T13:44:21.976 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.stats_persist_period_sec: 600 2021-03-10T13:44:21.976 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-03-10T13:44:21.977 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.max_open_files: -1 2021-03-10T13:44:21.977 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.bytes_per_sync: 0 2021-03-10T13:44:21.977 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-03-10T13:44:21.977 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.compaction_readahead_size: 0 2021-03-10T13:44:21.978 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Compression algorithms supported: 2021-03-10T13:44:21.978 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-03-10T13:44:21.978 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: kZSTD supported: 0 2021-03-10T13:44:21.978 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: kXpressCompression supported: 0 2021-03-10T13:44:21.978 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: kLZ4HCCompression supported: 1 2021-03-10T13:44:21.979 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: kLZ4Compression supported: 1 2021-03-10T13:44:21.979 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: kBZip2Compression supported: 0 2021-03-10T13:44:21.979 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: kZlibCompression supported: 1 2021-03-10T13:44:21.979 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: kSnappyCompression supported: 1 2021-03-10T13:44:21.979 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-03-10T13:44:21.980 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000001 2021-03-10T13:44:21.980 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]: 2021-03-10T13:44:21.980 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-03-10T13:44:21.980 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.merge_operator: 2021-03-10T13:44:21.981 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.compaction_filter: None 2021-03-10T13:44:21.981 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.compaction_filter_factory: None 2021-03-10T13:44:21.981 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-03-10T13:44:21.981 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.table_factory: BlockBasedTable 2021-03-10T13:44:21.981 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5647808a4138) 2021-03-10T13:44:21.982 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: cache_index_and_filter_blocks: 1 2021-03-10T13:44:21.982 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: cache_index_and_filter_blocks_with_high_priority: 1 2021-03-10T13:44:21.982 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-03-10T13:44:21.982 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: pin_top_level_index_and_filter: 1 2021-03-10T13:44:21.982 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: index_type: 0 2021-03-10T13:44:21.983 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: data_block_index_type: 0 2021-03-10T13:44:21.983 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: data_block_hash_table_util_ratio: 0.750000 2021-03-10T13:44:21.983 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: hash_index_allow_collision: 1 2021-03-10T13:44:21.983 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: checksum: 1 2021-03-10T13:44:21.983 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: no_block_cache: 0 2021-03-10T13:44:21.984 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: block_cache: 0x5647808da610 2021-03-10T13:44:21.984 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: block_cache_name: BinnedLRUCache 2021-03-10T13:44:21.984 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: block_cache_options: 2021-03-10T13:44:21.984 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: capacity : 536870912 2021-03-10T13:44:21.984 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: num_shard_bits : 4 2021-03-10T13:44:21.985 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: strict_capacity_limit : 0 2021-03-10T13:44:21.985 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: high_pri_pool_ratio: 0.000 2021-03-10T13:44:21.985 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: block_cache_compressed: (nil) 2021-03-10T13:44:21.985 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: persistent_cache: (nil) 2021-03-10T13:44:21.985 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: block_size: 4096 2021-03-10T13:44:21.986 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: block_size_deviation: 10 2021-03-10T13:44:21.986 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: block_restart_interval: 16 2021-03-10T13:44:21.986 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: index_block_restart_interval: 1 2021-03-10T13:44:21.986 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: metadata_block_size: 4096 2021-03-10T13:44:21.986 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: partition_filters: 0 2021-03-10T13:44:21.987 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: use_delta_encoding: 1 2021-03-10T13:44:21.987 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: filter_policy: rocksdb.BuiltinBloomFilter 2021-03-10T13:44:21.987 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: whole_key_filtering: 1 2021-03-10T13:44:21.987 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: verify_compression: 0 2021-03-10T13:44:21.987 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: read_amp_bytes_per_bit: 0 2021-03-10T13:44:21.988 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: format_version: 2 2021-03-10T13:44:21.988 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: enable_index_compression: 1 2021-03-10T13:44:21.988 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: block_align: 0 2021-03-10T13:44:21.988 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.write_buffer_size: 33554432 2021-03-10T13:44:21.988 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.max_write_buffer_number: 2 2021-03-10T13:44:21.989 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.compression: NoCompression 2021-03-10T13:44:21.989 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.bottommost_compression: Disabled 2021-03-10T13:44:21.989 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.prefix_extractor: nullptr 2021-03-10T13:44:21.989 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-03-10T13:44:21.989 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.num_levels: 7 2021-03-10T13:44:21.990 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-03-10T13:44:21.990 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-03-10T13:44:21.990 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-03-10T13:44:21.990 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-03-10T13:44:21.990 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-03-10T13:44:21.991 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-03-10T13:44:21.991 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-03-10T13:44:21.991 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-03-10T13:44:21.991 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.compression_opts.window_bits: -14 2021-03-10T13:44:21.991 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.compression_opts.level: 32767 2021-03-10T13:44:21.991 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.compression_opts.strategy: 0 2021-03-10T13:44:21.992 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-03-10T13:44:21.992 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-03-10T13:44:21.992 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.compression_opts.enabled: false 2021-03-10T13:44:21.993 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-03-10T13:44:21.993 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-03-10T13:44:21.993 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-03-10T13:44:21.993 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.target_file_size_base: 67108864 2021-03-10T13:44:21.994 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.target_file_size_multiplier: 1 2021-03-10T13:44:21.994 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-03-10T13:44:21.994 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-03-10T13:44:21.994 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-03-10T13:44:21.995 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-03-10T13:44:21.995 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-03-10T13:44:21.995 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-03-10T13:44:21.995 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-03-10T13:44:21.996 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-03-10T13:44:21.996 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-03-10T13:44:21.996 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-03-10T13:44:21.996 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-03-10T13:44:21.996 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-03-10T13:44:21.997 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.arena_block_size: 4194304 2021-03-10T13:44:21.997 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-03-10T13:44:21.997 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-03-10T13:44:21.997 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-03-10T13:44:21.998 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.disable_auto_compactions: 0 2021-03-10T13:44:21.998 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-03-10T13:44:21.998 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-03-10T13:44:22.000 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-03-10T13:44:22.000 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-03-10T13:44:22.000 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-03-10T13:44:22.000 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-03-10T13:44:22.001 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-03-10T13:44:22.001 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-03-10T13:44:22.001 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-03-10T13:44:22.001 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-03-10T13:44:22.002 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.table_properties_collectors: 2021-03-10T13:44:22.002 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.inplace_update_support: 0 2021-03-10T13:44:22.002 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-03-10T13:44:22.002 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-03-10T13:44:22.002 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-03-10T13:44:22.003 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.memtable_huge_page_size: 0 2021-03-10T13:44:22.003 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.bloom_locality: 0 2021-03-10T13:44:22.003 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.max_successive_merges: 0 2021-03-10T13:44:22.003 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-03-10T13:44:22.004 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.paranoid_file_checks: 0 2021-03-10T13:44:22.004 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.force_consistency_checks: 0 2021-03-10T13:44:22.004 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.report_bg_io_stats: 0 2021-03-10T13:44:22.004 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: Options.ttl: 0 2021-03-10T13:44:22.004 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-03-10T13:44:22.005 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 0 2021-03-10T13:44:22.005 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615383861861727, "job": 1, "event": "recovery_started", "log_files": [3]} 2021-03-10T13:44:22.005 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #3 mode 2 2021-03-10T13:44:22.005 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615383861862245, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1524, "table_properties": {"data_size": 622, "index_size": 28, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 500, "raw_average_value_size": 100, "num_data_blocks": 1, "num_entries": 5, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}} 2021-03-10T13:44:22.006 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: [db/version_set.cc:3036] Creating manifest 5 2021-03-10T13:44:22.006 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615383861862747, "job": 1, "event": "recovery_finished"} 2021-03-10T13:44:22.006 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 4 rocksdb: DB pointer 0x564780975200 2021-03-10T13:44:22.006 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb901f89700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS ------- 2021-03-10T13:44:22.007 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb901f89700 4 rocksdb: [db/db_impl.cc:778] 2021-03-10T13:44:22.007 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: ** DB Stats ** 2021-03-10T13:44:22.007 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:44:22.007 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-03-10T13:44:22.007 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-03-10T13:44:22.008 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T13:44:22.008 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-03-10T13:44:22.008 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-03-10T13:44:22.008 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T13:44:22.008 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: ** Compaction Stats [default] ** 2021-03-10T13:44:22.009 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:44:22.009 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:44:22.009 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: L0 1/0 1.49 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.0 0.00 0.00 1 0.000 0 0 2021-03-10T13:44:22.009 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: Sum 1/0 1.49 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.0 0.00 0.00 1 0.000 0 0 2021-03-10T13:44:22.010 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.0 0.00 0.00 1 0.000 0 0 2021-03-10T13:44:22.010 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: ** Compaction Stats [default] ** 2021-03-10T13:44:22.010 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:44:22.010 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:44:22.010 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.0 0.00 0.00 1 0.000 0 0 2021-03-10T13:44:22.011 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:44:22.011 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: Flush(GB): cumulative 0.000, interval 0.000 2021-03-10T13:44:22.011 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T13:44:22.011 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T13:44:22.011 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T13:44:22.012 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T13:44:22.012 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: Cumulative compaction: 0.00 GB write, 0.58 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:44:22.012 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: Interval compaction: 0.00 GB write, 0.58 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:44:22.012 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T13:44:22.012 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T13:44:22.013 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: ** Compaction Stats [default] ** 2021-03-10T13:44:22.013 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:44:22.013 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:44:22.013 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: L0 1/0 1.49 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.0 0.00 0.00 1 0.000 0 0 2021-03-10T13:44:22.014 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: Sum 1/0 1.49 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.0 0.00 0.00 1 0.000 0 0 2021-03-10T13:44:22.014 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:44:22.014 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: ** Compaction Stats [default] ** 2021-03-10T13:44:22.014 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:44:22.015 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:44:22.015 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.0 0.00 0.00 1 0.000 0 0 2021-03-10T13:44:22.015 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:44:22.015 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: Flush(GB): cumulative 0.000, interval 0.000 2021-03-10T13:44:22.015 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T13:44:22.016 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T13:44:22.016 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T13:44:22.016 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T13:44:22.016 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: Cumulative compaction: 0.00 GB write, 0.57 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:44:22.016 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:44:22.017 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T13:44:22.017 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T13:44:22.017 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.858+0000 7fb91ae3c6c0 0 mon.b does not exist in monmap, will attempt to join an existing cluster 2021-03-10T13:44:22.017 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.862+0000 7fb91ae3c6c0 0 using public_addr v2:172.21.2.120:0/0 -> [v2:172.21.2.120:3300/0,v1:172.21.2.120:6789/0] 2021-03-10T13:44:22.018 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.862+0000 7fb91ae3c6c0 0 starting mon.b rank -1 at public addrs [v2:172.21.2.120:3300/0,v1:172.21.2.120:6789/0] at bind addrs [v2:172.21.2.120:3300/0,v1:172.21.2.120:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 7672acc8-81a6-11eb-9080-001a4aab830c 2021-03-10T13:44:22.018 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.862+0000 7fb91ae3c6c0 1 mon.b@-1(???) e0 preinit fsid 7672acc8-81a6-11eb-9080-001a4aab830c 2021-03-10T13:44:22.018 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.890+0000 7fb90478e700 0 mon.b@-1(synchronizing).mds e1 new map 2021-03-10T13:44:22.018 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.890+0000 7fb90478e700 0 mon.b@-1(synchronizing).mds e1 print_map 2021-03-10T13:44:22.018 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: e1 2021-03-10T13:44:22.019 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: enable_multiple, ever_enabled_multiple: 0,0 2021-03-10T13:44:22.019 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-03-10T13:44:22.019 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: legacy client fscid: -1 2021-03-10T13:44:22.019 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: 2021-03-10T13:44:22.019 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: No filesystems configured 2021-03-10T13:44:22.020 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.890+0000 7fb90478e700 1 mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2021-03-10T13:44:22.020 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.890+0000 7fb90478e700 1 mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2021-03-10T13:44:22.020 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.890+0000 7fb90478e700 1 mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2021-03-10T13:44:22.020 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.890+0000 7fb90478e700 1 mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2021-03-10T13:44:22.020 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.890+0000 7fb90478e700 1 mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2021-03-10T13:44:22.021 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.890+0000 7fb90478e700 1 mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2021-03-10T13:44:22.021 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.890+0000 7fb90478e700 1 mon.b@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2021-03-10T13:44:22.021 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.890+0000 7fb90478e700 1 mon.b@-1(synchronizing).osd e6 e6: 0 total, 0 up, 0 in 2021-03-10T13:44:22.021 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.890+0000 7fb90478e700 0 mon.b@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T13:44:22.021 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.890+0000 7fb90478e700 0 mon.b@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T13:44:22.022 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.890+0000 7fb90478e700 0 mon.b@-1(synchronizing).osd e6 crush map has features 3314933000852226048, adjusting msgr requires 2021-03-10T13:44:22.022 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.890+0000 7fb90478e700 0 mon.b@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T13:44:22.022 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: cluster 2021-03-10T13:44:20.386605+0000 mgr.y (mgr.14140) 27 : cluster [DBG] pgmap v21: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:22.022 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: audit 2021-03-10T13:44:20.538225+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}}, \"last_device_update\": \"2021-03-10T13:43:57.842752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:44:22.023 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: audit 2021-03-10T13:44:20.539554+0000 mon.a (mon.0) 140 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:22.023 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: audit 2021-03-10T13:44:20.545667+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}}, \"last_device_update\": \"2021-03-10T13:43:57.842752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:44:22.023 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: audit 2021-03-10T13:44:20.695000+0000 mon.a (mon.0) 142 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:20.693310\", \"created\": \"2021-03-10T13:44:20.530781\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}}, \"last_daemon_update\": \"2021-03-10T13:44:20.693599\", \"last_device_update\": \"2021-03-10T13:43:57.842752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:44:22.023 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: audit 2021-03-10T13:44:20.702403+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:20.693310\", \"created\": \"2021-03-10T13:44:20.530781\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}}, \"last_daemon_update\": \"2021-03-10T13:44:20.693599\", \"last_device_update\": \"2021-03-10T13:43:57.842752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:44:22.024 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.894+0000 7fb90478e700 1 mon.b@-1(synchronizing).paxosservice(auth 1..5) refresh upgraded, format 0 -> 3 2021-03-10T13:44:22.024 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.894+0000 7fb90478e700 10 mon.b@-1(synchronizing) e2 handle_conf_change mon_allow_pool_delete 2021-03-10T13:44:22.024 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.894+0000 7fb90478e700 20 expand_channel_meta expand map: {default=false} 2021-03-10T13:44:22.024 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.894+0000 7fb90478e700 20 expand_channel_meta from 'false' to 'false' 2021-03-10T13:44:22.024 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.894+0000 7fb90478e700 20 expand_channel_meta expanded map: {default=false} 2021-03-10T13:44:22.025 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.894+0000 7fb90478e700 20 expand_channel_meta expand map: {default=info} 2021-03-10T13:44:22.025 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.894+0000 7fb90478e700 20 expand_channel_meta from 'info' to 'info' 2021-03-10T13:44:22.025 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.894+0000 7fb90478e700 20 expand_channel_meta expanded map: {default=info} 2021-03-10T13:44:22.025 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.894+0000 7fb90478e700 20 expand_channel_meta expand map: {default=daemon} 2021-03-10T13:44:22.025 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.894+0000 7fb90478e700 20 expand_channel_meta from 'daemon' to 'daemon' 2021-03-10T13:44:22.026 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.894+0000 7fb90478e700 20 expand_channel_meta expanded map: {default=daemon} 2021-03-10T13:44:22.026 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.894+0000 7fb90478e700 20 expand_channel_meta expand map: {default=debug} 2021-03-10T13:44:22.026 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.894+0000 7fb90478e700 20 expand_channel_meta from 'debug' to 'debug' 2021-03-10T13:44:22.026 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:21 gibba020 bash[9782]: debug 2021-03-10T13:44:21.894+0000 7fb90478e700 20 expand_channel_meta expanded map: {default=debug} 2021-03-10T13:44:27.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:26 gibba013 bash[9767]: cluster 2021-03-10T13:44:21.904012+0000 mon.a (mon.0) 144 : cluster [INF] mon.a calling monitor election 2021-03-10T13:44:27.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:26 gibba013 bash[9767]: cluster 2021-03-10T13:44:21.904862+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2021-03-10T13:44:27.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:26 gibba013 bash[9767]: cluster 2021-03-10T13:44:22.387461+0000 mgr.y (mgr.14140) 28 : cluster [DBG] pgmap v22: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:27.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:26 gibba013 bash[9767]: cluster 2021-03-10T13:44:23.904151+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2021-03-10T13:44:27.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:26 gibba013 bash[9767]: cluster 2021-03-10T13:44:24.388154+0000 mgr.y (mgr.14140) 29 : cluster [DBG] pgmap v23: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:27.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:26 gibba013 bash[9767]: cluster 2021-03-10T13:44:26.908342+0000 mon.a (mon.0) 145 : cluster [INF] mon.a calling monitor election 2021-03-10T13:44:27.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:26 gibba013 bash[9767]: cluster 2021-03-10T13:44:26.933459+0000 mon.a (mon.0) 146 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T13:44:27.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:26 gibba013 bash[9767]: cluster 2021-03-10T13:44:26.942978+0000 mon.a (mon.0) 147 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.113:3300/0,v1:172.21.2.113:6789/0],b=[v2:172.21.2.120:3300/0,v1:172.21.2.120:6789/0],c=[v2:172.21.2.113:3301/0,v1:172.21.2.113:6790/0]} 2021-03-10T13:44:27.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:26 gibba013 bash[9767]: cluster 2021-03-10T13:44:26.943120+0000 mon.a (mon.0) 148 : cluster [DBG] fsmap 2021-03-10T13:44:27.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:26 gibba013 bash[9767]: cluster 2021-03-10T13:44:26.943195+0000 mon.a (mon.0) 149 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-03-10T13:44:27.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:26 gibba013 bash[9767]: cluster 2021-03-10T13:44:26.943621+0000 mon.a (mon.0) 150 : cluster [DBG] mgrmap e13: y(active, since 61s) 2021-03-10T13:44:27.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:26 gibba013 bash[9767]: cluster 2021-03-10T13:44:26.947076+0000 mon.a (mon.0) 151 : cluster [INF] overall HEALTH_OK 2021-03-10T13:44:27.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:26 gibba013 bash[13024]: cluster 2021-03-10T13:44:21.904012+0000 mon.a (mon.0) 144 : cluster [INF] mon.a calling monitor election 2021-03-10T13:44:27.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:26 gibba013 bash[13024]: cluster 2021-03-10T13:44:21.904862+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2021-03-10T13:44:27.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:26 gibba013 bash[13024]: cluster 2021-03-10T13:44:22.387461+0000 mgr.y (mgr.14140) 28 : cluster [DBG] pgmap v22: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:27.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:26 gibba013 bash[13024]: cluster 2021-03-10T13:44:23.904151+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2021-03-10T13:44:27.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:26 gibba013 bash[13024]: cluster 2021-03-10T13:44:24.388154+0000 mgr.y (mgr.14140) 29 : cluster [DBG] pgmap v23: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:27.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:26 gibba013 bash[13024]: cluster 2021-03-10T13:44:26.908342+0000 mon.a (mon.0) 145 : cluster [INF] mon.a calling monitor election 2021-03-10T13:44:27.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:26 gibba013 bash[13024]: cluster 2021-03-10T13:44:26.933459+0000 mon.a (mon.0) 146 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T13:44:27.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:26 gibba013 bash[13024]: cluster 2021-03-10T13:44:26.942978+0000 mon.a (mon.0) 147 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.113:3300/0,v1:172.21.2.113:6789/0],b=[v2:172.21.2.120:3300/0,v1:172.21.2.120:6789/0],c=[v2:172.21.2.113:3301/0,v1:172.21.2.113:6790/0]} 2021-03-10T13:44:27.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:26 gibba013 bash[13024]: cluster 2021-03-10T13:44:26.943120+0000 mon.a (mon.0) 148 : cluster [DBG] fsmap 2021-03-10T13:44:27.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:26 gibba013 bash[13024]: cluster 2021-03-10T13:44:26.943195+0000 mon.a (mon.0) 149 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-03-10T13:44:27.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:26 gibba013 bash[13024]: cluster 2021-03-10T13:44:26.943621+0000 mon.a (mon.0) 150 : cluster [DBG] mgrmap e13: y(active, since 61s) 2021-03-10T13:44:27.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:26 gibba013 bash[13024]: cluster 2021-03-10T13:44:26.947076+0000 mon.a (mon.0) 151 : cluster [INF] overall HEALTH_OK 2021-03-10T13:44:27.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:27 gibba020 bash[9782]: cluster 2021-03-10T13:44:21.904012+0000 mon.a (mon.0) 144 : cluster [INF] mon.a calling monitor election 2021-03-10T13:44:27.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:27 gibba020 bash[9782]: cluster 2021-03-10T13:44:21.904862+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2021-03-10T13:44:27.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:27 gibba020 bash[9782]: cluster 2021-03-10T13:44:22.387461+0000 mgr.y (mgr.14140) 28 : cluster [DBG] pgmap v22: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:27.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:27 gibba020 bash[9782]: cluster 2021-03-10T13:44:23.904151+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2021-03-10T13:44:27.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:27 gibba020 bash[9782]: cluster 2021-03-10T13:44:24.388154+0000 mgr.y (mgr.14140) 29 : cluster [DBG] pgmap v23: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:27.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:27 gibba020 bash[9782]: cluster 2021-03-10T13:44:26.908342+0000 mon.a (mon.0) 145 : cluster [INF] mon.a calling monitor election 2021-03-10T13:44:27.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:27 gibba020 bash[9782]: cluster 2021-03-10T13:44:26.933459+0000 mon.a (mon.0) 146 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T13:44:27.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:27 gibba020 bash[9782]: cluster 2021-03-10T13:44:26.942978+0000 mon.a (mon.0) 147 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.113:3300/0,v1:172.21.2.113:6789/0],b=[v2:172.21.2.120:3300/0,v1:172.21.2.120:6789/0],c=[v2:172.21.2.113:3301/0,v1:172.21.2.113:6790/0]} 2021-03-10T13:44:27.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:27 gibba020 bash[9782]: cluster 2021-03-10T13:44:26.943120+0000 mon.a (mon.0) 148 : cluster [DBG] fsmap 2021-03-10T13:44:27.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:27 gibba020 bash[9782]: cluster 2021-03-10T13:44:26.943195+0000 mon.a (mon.0) 149 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-03-10T13:44:27.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:27 gibba020 bash[9782]: cluster 2021-03-10T13:44:26.943621+0000 mon.a (mon.0) 150 : cluster [DBG] mgrmap e13: y(active, since 61s) 2021-03-10T13:44:27.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:27 gibba020 bash[9782]: cluster 2021-03-10T13:44:26.947076+0000 mon.a (mon.0) 151 : cluster [INF] overall HEALTH_OK 2021-03-10T13:44:28.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:28 gibba013 bash[9767]: cluster 2021-03-10T13:44:26.389118+0000 mgr.y (mgr.14140) 30 : cluster [DBG] pgmap v24: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:28.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:28 gibba013 bash[9767]: cluster 2021-03-10T13:44:26.995515+0000 mon.a (mon.0) 152 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-03-10T13:44:28.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:28 gibba013 bash[13024]: cluster 2021-03-10T13:44:26.389118+0000 mgr.y (mgr.14140) 30 : cluster [DBG] pgmap v24: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:28.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:28 gibba013 bash[13024]: cluster 2021-03-10T13:44:26.995515+0000 mon.a (mon.0) 152 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-03-10T13:44:28.444 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:28 gibba020 bash[9782]: cluster 2021-03-10T13:44:26.389118+0000 mgr.y (mgr.14140) 30 : cluster [DBG] pgmap v24: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:28.444 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:28 gibba020 bash[9782]: cluster 2021-03-10T13:44:26.995515+0000 mon.a (mon.0) 152 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-03-10T13:44:28.525 INFO:teuthology.orchestra.run.gibba020.stdout: 2021-03-10T13:44:28.525 INFO:teuthology.orchestra.run.gibba020.stdout:{"epoch":3,"fsid":"7672acc8-81a6-11eb-9080-001a4aab830c","modified":"2021-03-10T13:44:21.895399Z","created":"2021-03-10T13:42:52.040457Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:3300","nonce":0},{"type":"v1","addr":"172.21.2.113:6789","nonce":0}]},"addr":"172.21.2.113:6789/0","public_addr":"172.21.2.113:6789/0","priority":0,"weight":0},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:3301","nonce":0},{"type":"v1","addr":"172.21.2.113:6790","nonce":0}]},"addr":"172.21.2.113:6790/0","public_addr":"172.21.2.113:6790/0","priority":0,"weight":0},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:3300","nonce":0},{"type":"v1","addr":"172.21.2.120:6789","nonce":0}]},"addr":"172.21.2.120:6789/0","public_addr":"172.21.2.120:6789/0","priority":0,"weight":0}],"quorum":[0,1,2]} 2021-03-10T13:44:28.527 INFO:teuthology.orchestra.run.gibba020.stderr:dumped monmap epoch 3 2021-03-10T13:44:29.203 INFO:tasks.cephadm:Generating final ceph.conf file... 2021-03-10T13:44:29.204 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph config generate-minimal-conf 2021-03-10T13:44:29.303 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:29 gibba013 bash[9767]: audit 2021-03-10T13:44:28.522072+0000 mon.a (mon.0) 153 : audit [DBG] from='client.? 172.21.2.120:0/4026203079' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-03-10T13:44:29.303 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:29 gibba013 bash[13024]: audit 2021-03-10T13:44:28.522072+0000 mon.a (mon.0) 153 : audit [DBG] from='client.? 172.21.2.120:0/4026203079' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-03-10T13:44:29.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:29 gibba020 bash[9782]: audit 2021-03-10T13:44:28.522072+0000 mon.a (mon.0) 153 : audit [DBG] from='client.? 172.21.2.120:0/4026203079' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-03-10T13:44:30.328 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:30 gibba013 bash[9767]: cluster 2021-03-10T13:44:28.389729+0000 mgr.y (mgr.14140) 31 : cluster [DBG] pgmap v25: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:30.328 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:30 gibba013 bash[13024]: cluster 2021-03-10T13:44:28.389729+0000 mgr.y (mgr.14140) 31 : cluster [DBG] pgmap v25: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:30.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:30 gibba020 bash[9782]: cluster 2021-03-10T13:44:28.389729+0000 mgr.y (mgr.14140) 31 : cluster [DBG] pgmap v25: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:31.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:31 gibba020 bash[9782]: cluster 2021-03-10T13:44:30.390456+0000 mgr.y (mgr.14140) 32 : cluster [DBG] pgmap v26: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:31.706 INFO:teuthology.orchestra.run.gibba013.stdout:# minimal ceph.conf for 7672acc8-81a6-11eb-9080-001a4aab830c 2021-03-10T13:44:31.706 INFO:teuthology.orchestra.run.gibba013.stdout:[global] 2021-03-10T13:44:31.706 INFO:teuthology.orchestra.run.gibba013.stdout: fsid = 7672acc8-81a6-11eb-9080-001a4aab830c 2021-03-10T13:44:31.706 INFO:teuthology.orchestra.run.gibba013.stdout: mon_host = [v2:172.21.2.113:3300/0,v1:172.21.2.113:6789/0] [v2:172.21.2.120:3300/0,v1:172.21.2.120:6789/0] [v2:172.21.2.113:3301/0,v1:172.21.2.113:6790/0] 2021-03-10T13:44:31.786 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:31 gibba013 bash[9767]: cluster 2021-03-10T13:44:30.390456+0000 mgr.y (mgr.14140) 32 : cluster [DBG] pgmap v26: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:31.786 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:31 gibba013 bash[13024]: cluster 2021-03-10T13:44:30.390456+0000 mgr.y (mgr.14140) 32 : cluster [DBG] pgmap v26: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:32.254 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2021-03-10T13:44:32.255 DEBUG:teuthology.orchestra.run.gibba013:> set -ex 2021-03-10T13:44:32.255 DEBUG:teuthology.orchestra.run.gibba013:> sudo dd of=/etc/ceph/ceph.conf 2021-03-10T13:44:32.261 DEBUG:teuthology.orchestra.run.gibba013:> set -ex 2021-03-10T13:44:32.262 DEBUG:teuthology.orchestra.run.gibba013:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2021-03-10T13:44:32.270 DEBUG:teuthology.orchestra.run.gibba020:> set -ex 2021-03-10T13:44:32.270 DEBUG:teuthology.orchestra.run.gibba020:> sudo dd of=/etc/ceph/ceph.conf 2021-03-10T13:44:32.283 DEBUG:teuthology.orchestra.run.gibba020:> set -ex 2021-03-10T13:44:32.284 DEBUG:teuthology.orchestra.run.gibba020:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2021-03-10T13:44:32.291 INFO:tasks.cephadm:Adding mgr.y on gibba013 2021-03-10T13:44:32.292 INFO:tasks.cephadm:Adding mgr.x on gibba020 2021-03-10T13:44:32.293 DEBUG:teuthology.orchestra.run.gibba020:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph orch apply mgr '3;gibba013=y;gibba020=x' 2021-03-10T13:44:32.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:32 gibba013 bash[9767]: audit 2021-03-10T13:44:31.703732+0000 mon.a (mon.0) 154 : audit [DBG] from='client.? 172.21.2.113:0/3612871899' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:44:32.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:32 gibba013 bash[13024]: audit 2021-03-10T13:44:31.703732+0000 mon.a (mon.0) 154 : audit [DBG] from='client.? 172.21.2.113:0/3612871899' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:44:32.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:32 gibba020 bash[9782]: audit 2021-03-10T13:44:31.703732+0000 mon.a (mon.0) 154 : audit [DBG] from='client.? 172.21.2.113:0/3612871899' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:44:33.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:33 gibba020 bash[9782]: cluster 2021-03-10T13:44:32.391176+0000 mgr.y (mgr.14140) 33 : cluster [DBG] pgmap v27: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:33.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:33 gibba013 bash[9767]: cluster 2021-03-10T13:44:32.391176+0000 mgr.y (mgr.14140) 33 : cluster [DBG] pgmap v27: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:33.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:33 gibba013 bash[13024]: cluster 2021-03-10T13:44:32.391176+0000 mgr.y (mgr.14140) 33 : cluster [DBG] pgmap v27: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:34.956 INFO:teuthology.orchestra.run.gibba020.stdout:Scheduled mgr update... 2021-03-10T13:44:35.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:35 gibba020 bash[9782]: cluster 2021-03-10T13:44:34.392190+0000 mgr.y (mgr.14140) 34 : cluster [DBG] pgmap v28: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:35.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:35 gibba020 bash[9782]: audit 2021-03-10T13:44:34.940430+0000 mgr.y (mgr.14140) 35 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;gibba013=y;gibba020=x", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:44:35.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:35 gibba020 bash[9782]: cephadm 2021-03-10T13:44:34.941933+0000 mgr.y (mgr.14140) 36 : cephadm [INF] Saving service mgr spec with placement count:3 gibba013=y,gibba020=x 2021-03-10T13:44:35.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:35 gibba020 bash[9782]: audit 2021-03-10T13:44:34.942984+0000 mon.a (mon.0) 155 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:44:34.941970\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [{\"hostname\": \"gibba013\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"gibba020\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T13:44:35.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:35 gibba020 bash[9782]: audit 2021-03-10T13:44:34.950781+0000 mon.a (mon.0) 156 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:44:34.941970\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [{\"hostname\": \"gibba013\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"gibba020\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]': finished 2021-03-10T13:44:35.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:35 gibba020 bash[9782]: audit 2021-03-10T13:44:34.955633+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:44:35.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:35 gibba020 bash[9782]: audit 2021-03-10T13:44:34.963914+0000 mon.a (mon.0) 158 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-03-10T13:44:35.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:35 gibba020 bash[9782]: audit 2021-03-10T13:44:34.966543+0000 mon.a (mon.0) 159 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:44:35.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:35 gibba020 bash[9782]: cephadm 2021-03-10T13:44:34.968876+0000 mgr.y (mgr.14140) 37 : cephadm [INF] Deploying daemon mgr.x on gibba020 2021-03-10T13:44:35.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:35 gibba020 bash[9782]: audit 2021-03-10T13:44:34.970084+0000 mon.a (mon.0) 160 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-03-10T13:44:35.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:35 gibba013 bash[9767]: cluster 2021-03-10T13:44:34.392190+0000 mgr.y (mgr.14140) 34 : cluster [DBG] pgmap v28: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:35.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:35 gibba013 bash[9767]: audit 2021-03-10T13:44:34.940430+0000 mgr.y (mgr.14140) 35 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;gibba013=y;gibba020=x", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:44:35.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:35 gibba013 bash[9767]: cephadm 2021-03-10T13:44:34.941933+0000 mgr.y (mgr.14140) 36 : cephadm [INF] Saving service mgr spec with placement count:3 gibba013=y,gibba020=x 2021-03-10T13:44:35.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:35 gibba013 bash[9767]: audit 2021-03-10T13:44:34.942984+0000 mon.a (mon.0) 155 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:44:34.941970\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [{\"hostname\": \"gibba013\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"gibba020\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T13:44:35.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:35 gibba013 bash[9767]: audit 2021-03-10T13:44:34.950781+0000 mon.a (mon.0) 156 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:44:34.941970\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [{\"hostname\": \"gibba013\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"gibba020\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]': finished 2021-03-10T13:44:35.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:35 gibba013 bash[9767]: audit 2021-03-10T13:44:34.955633+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:44:35.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:35 gibba013 bash[9767]: audit 2021-03-10T13:44:34.963914+0000 mon.a (mon.0) 158 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-03-10T13:44:35.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:35 gibba013 bash[9767]: audit 2021-03-10T13:44:34.966543+0000 mon.a (mon.0) 159 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:44:35.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:35 gibba013 bash[9767]: cephadm 2021-03-10T13:44:34.968876+0000 mgr.y (mgr.14140) 37 : cephadm [INF] Deploying daemon mgr.x on gibba020 2021-03-10T13:44:35.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:35 gibba013 bash[9767]: audit 2021-03-10T13:44:34.970084+0000 mon.a (mon.0) 160 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-03-10T13:44:35.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:35 gibba013 bash[13024]: cluster 2021-03-10T13:44:34.392190+0000 mgr.y (mgr.14140) 34 : cluster [DBG] pgmap v28: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:35.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:35 gibba013 bash[13024]: audit 2021-03-10T13:44:34.940430+0000 mgr.y (mgr.14140) 35 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;gibba013=y;gibba020=x", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:44:35.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:35 gibba013 bash[13024]: cephadm 2021-03-10T13:44:34.941933+0000 mgr.y (mgr.14140) 36 : cephadm [INF] Saving service mgr spec with placement count:3 gibba013=y,gibba020=x 2021-03-10T13:44:35.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:35 gibba013 bash[13024]: audit 2021-03-10T13:44:34.942984+0000 mon.a (mon.0) 155 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:44:34.941970\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [{\"hostname\": \"gibba013\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"gibba020\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T13:44:35.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:35 gibba013 bash[13024]: audit 2021-03-10T13:44:34.950781+0000 mon.a (mon.0) 156 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:44:34.941970\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [{\"hostname\": \"gibba013\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"gibba020\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]': finished 2021-03-10T13:44:35.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:35 gibba013 bash[13024]: audit 2021-03-10T13:44:34.955633+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:44:35.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:35 gibba013 bash[13024]: audit 2021-03-10T13:44:34.963914+0000 mon.a (mon.0) 158 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-03-10T13:44:35.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:35 gibba013 bash[13024]: audit 2021-03-10T13:44:34.966543+0000 mon.a (mon.0) 159 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:44:35.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:35 gibba013 bash[13024]: cephadm 2021-03-10T13:44:34.968876+0000 mgr.y (mgr.14140) 37 : cephadm [INF] Deploying daemon mgr.x on gibba020 2021-03-10T13:44:35.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:35 gibba013 bash[13024]: audit 2021-03-10T13:44:34.970084+0000 mon.a (mon.0) 160 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-03-10T13:44:35.987 DEBUG:teuthology.orchestra.run.gibba020:mgr.x> sudo journalctl -f -n 0 -u ceph-7672acc8-81a6-11eb-9080-001a4aab830c@mgr.x.service 2021-03-10T13:44:35.988 INFO:tasks.cephadm:Deploying OSDs... 2021-03-10T13:44:35.989 DEBUG:teuthology.orchestra.run.gibba013:> set -ex 2021-03-10T13:44:35.989 DEBUG:teuthology.orchestra.run.gibba013:> dd if=/scratch_devs of=/dev/stdout 2021-03-10T13:44:35.998 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-03-10T13:44:35.999 DEBUG:teuthology.orchestra.run.gibba013:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-03-10T13:44:36.030 INFO:journalctl@ceph.mgr.x.gibba020.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:44:36.043 INFO:teuthology.orchestra.run.gibba013.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-03-10T13:44:36.043 INFO:teuthology.orchestra.run.gibba013.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-10T13:44:36.044 INFO:teuthology.orchestra.run.gibba013.stdout:Device: 6h/6d Inode: 344 Links: 1 2021-03-10T13:44:36.044 INFO:teuthology.orchestra.run.gibba013.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-10T13:44:36.044 INFO:teuthology.orchestra.run.gibba013.stdout:Access: 2021-03-10 13:41:54.903295662 +0000 2021-03-10T13:44:36.044 INFO:teuthology.orchestra.run.gibba013.stdout:Modify: 2021-03-10 13:41:54.747295663 +0000 2021-03-10T13:44:36.044 INFO:teuthology.orchestra.run.gibba013.stdout:Change: 2021-03-10 13:41:54.747295663 +0000 2021-03-10T13:44:36.045 INFO:teuthology.orchestra.run.gibba013.stdout: Birth: - 2021-03-10T13:44:36.047 INFO:teuthology.orchestra.run.gibba013.stderr:1+0 records in 2021-03-10T13:44:36.047 INFO:teuthology.orchestra.run.gibba013.stderr:1+0 records out 2021-03-10T13:44:36.047 INFO:teuthology.orchestra.run.gibba013.stderr:512 bytes copied, 0.000216737 s, 2.4 MB/s 2021-03-10T13:44:36.049 DEBUG:teuthology.orchestra.run.gibba013:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-03-10T13:44:36.054 INFO:teuthology.orchestra.run.gibba013.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-03-10T13:44:36.054 INFO:teuthology.orchestra.run.gibba013.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-10T13:44:36.055 INFO:teuthology.orchestra.run.gibba013.stdout:Device: 6h/6d Inode: 351 Links: 1 2021-03-10T13:44:36.055 INFO:teuthology.orchestra.run.gibba013.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-10T13:44:36.055 INFO:teuthology.orchestra.run.gibba013.stdout:Access: 2021-03-10 13:41:55.247295659 +0000 2021-03-10T13:44:36.055 INFO:teuthology.orchestra.run.gibba013.stdout:Modify: 2021-03-10 13:41:55.127295660 +0000 2021-03-10T13:44:36.055 INFO:teuthology.orchestra.run.gibba013.stdout:Change: 2021-03-10 13:41:55.127295660 +0000 2021-03-10T13:44:36.056 INFO:teuthology.orchestra.run.gibba013.stdout: Birth: - 2021-03-10T13:44:36.059 INFO:teuthology.orchestra.run.gibba013.stderr:1+0 records in 2021-03-10T13:44:36.060 INFO:teuthology.orchestra.run.gibba013.stderr:1+0 records out 2021-03-10T13:44:36.060 INFO:teuthology.orchestra.run.gibba013.stderr:512 bytes copied, 0.000226623 s, 2.3 MB/s 2021-03-10T13:44:36.063 DEBUG:teuthology.orchestra.run.gibba013:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-03-10T13:44:36.069 INFO:teuthology.orchestra.run.gibba013.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-03-10T13:44:36.069 INFO:teuthology.orchestra.run.gibba013.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-10T13:44:36.069 INFO:teuthology.orchestra.run.gibba013.stdout:Device: 6h/6d Inode: 356 Links: 1 2021-03-10T13:44:36.070 INFO:teuthology.orchestra.run.gibba013.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-10T13:44:36.070 INFO:teuthology.orchestra.run.gibba013.stdout:Access: 2021-03-10 13:41:55.595295656 +0000 2021-03-10T13:44:36.070 INFO:teuthology.orchestra.run.gibba013.stdout:Modify: 2021-03-10 13:41:55.443295657 +0000 2021-03-10T13:44:36.070 INFO:teuthology.orchestra.run.gibba013.stdout:Change: 2021-03-10 13:41:55.443295657 +0000 2021-03-10T13:44:36.070 INFO:teuthology.orchestra.run.gibba013.stdout: Birth: - 2021-03-10T13:44:36.075 INFO:teuthology.orchestra.run.gibba013.stderr:1+0 records in 2021-03-10T13:44:36.076 INFO:teuthology.orchestra.run.gibba013.stderr:1+0 records out 2021-03-10T13:44:36.076 INFO:teuthology.orchestra.run.gibba013.stderr:512 bytes copied, 0.000181934 s, 2.8 MB/s 2021-03-10T13:44:36.077 DEBUG:teuthology.orchestra.run.gibba013:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-03-10T13:44:36.080 INFO:teuthology.orchestra.run.gibba013.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-03-10T13:44:36.080 INFO:teuthology.orchestra.run.gibba013.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-10T13:44:36.081 INFO:teuthology.orchestra.run.gibba013.stdout:Device: 6h/6d Inode: 360 Links: 1 2021-03-10T13:44:36.081 INFO:teuthology.orchestra.run.gibba013.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-10T13:44:36.081 INFO:teuthology.orchestra.run.gibba013.stdout:Access: 2021-03-10 13:41:55.951295652 +0000 2021-03-10T13:44:36.081 INFO:teuthology.orchestra.run.gibba013.stdout:Modify: 2021-03-10 13:41:55.787295654 +0000 2021-03-10T13:44:36.082 INFO:teuthology.orchestra.run.gibba013.stdout:Change: 2021-03-10 13:41:55.787295654 +0000 2021-03-10T13:44:36.082 INFO:teuthology.orchestra.run.gibba013.stdout: Birth: - 2021-03-10T13:44:36.083 INFO:teuthology.orchestra.run.gibba013.stderr:1+0 records in 2021-03-10T13:44:36.083 INFO:teuthology.orchestra.run.gibba013.stderr:1+0 records out 2021-03-10T13:44:36.083 INFO:teuthology.orchestra.run.gibba013.stderr:512 bytes copied, 0.00015501 s, 3.3 MB/s 2021-03-10T13:44:36.084 DEBUG:teuthology.orchestra.run.gibba020:> set -ex 2021-03-10T13:44:36.085 DEBUG:teuthology.orchestra.run.gibba020:> dd if=/scratch_devs of=/dev/stdout 2021-03-10T13:44:36.093 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-03-10T13:44:36.094 DEBUG:teuthology.orchestra.run.gibba020:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-03-10T13:44:36.103 INFO:teuthology.orchestra.run.gibba020.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-03-10T13:44:36.103 INFO:teuthology.orchestra.run.gibba020.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-10T13:44:36.104 INFO:teuthology.orchestra.run.gibba020.stdout:Device: 6h/6d Inode: 349 Links: 1 2021-03-10T13:44:36.104 INFO:teuthology.orchestra.run.gibba020.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-10T13:44:36.104 INFO:teuthology.orchestra.run.gibba020.stdout:Access: 2021-03-10 13:41:54.999785802 +0000 2021-03-10T13:44:36.104 INFO:teuthology.orchestra.run.gibba020.stdout:Modify: 2021-03-10 13:41:54.883785799 +0000 2021-03-10T13:44:36.105 INFO:teuthology.orchestra.run.gibba020.stdout:Change: 2021-03-10 13:41:54.883785799 +0000 2021-03-10T13:44:36.105 INFO:teuthology.orchestra.run.gibba020.stdout: Birth: - 2021-03-10T13:44:36.111 INFO:teuthology.orchestra.run.gibba020.stderr:1+0 records in 2021-03-10T13:44:36.111 INFO:teuthology.orchestra.run.gibba020.stderr:1+0 records out 2021-03-10T13:44:36.111 INFO:teuthology.orchestra.run.gibba020.stderr:512 bytes copied, 0.000259248 s, 2.0 MB/s 2021-03-10T13:44:36.112 DEBUG:teuthology.orchestra.run.gibba020:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-03-10T13:44:36.157 INFO:teuthology.orchestra.run.gibba020.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-03-10T13:44:36.157 INFO:teuthology.orchestra.run.gibba020.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-10T13:44:36.157 INFO:teuthology.orchestra.run.gibba020.stdout:Device: 6h/6d Inode: 354 Links: 1 2021-03-10T13:44:36.157 INFO:teuthology.orchestra.run.gibba020.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-10T13:44:36.158 INFO:teuthology.orchestra.run.gibba020.stdout:Access: 2021-03-10 13:41:55.435785810 +0000 2021-03-10T13:44:36.158 INFO:teuthology.orchestra.run.gibba020.stdout:Modify: 2021-03-10 13:41:55.271785807 +0000 2021-03-10T13:44:36.158 INFO:teuthology.orchestra.run.gibba020.stdout:Change: 2021-03-10 13:41:55.271785807 +0000 2021-03-10T13:44:36.158 INFO:teuthology.orchestra.run.gibba020.stdout: Birth: - 2021-03-10T13:44:36.162 INFO:teuthology.orchestra.run.gibba020.stderr:1+0 records in 2021-03-10T13:44:36.162 INFO:teuthology.orchestra.run.gibba020.stderr:1+0 records out 2021-03-10T13:44:36.163 INFO:teuthology.orchestra.run.gibba020.stderr:512 bytes copied, 0.000315267 s, 1.6 MB/s 2021-03-10T13:44:36.165 DEBUG:teuthology.orchestra.run.gibba020:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-03-10T13:44:36.172 INFO:teuthology.orchestra.run.gibba020.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-03-10T13:44:36.172 INFO:teuthology.orchestra.run.gibba020.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-10T13:44:36.172 INFO:teuthology.orchestra.run.gibba020.stdout:Device: 6h/6d Inode: 363 Links: 1 2021-03-10T13:44:36.173 INFO:teuthology.orchestra.run.gibba020.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-10T13:44:36.173 INFO:teuthology.orchestra.run.gibba020.stdout:Access: 2021-03-10 13:41:55.755785816 +0000 2021-03-10T13:44:36.173 INFO:teuthology.orchestra.run.gibba020.stdout:Modify: 2021-03-10 13:41:55.663785814 +0000 2021-03-10T13:44:36.173 INFO:teuthology.orchestra.run.gibba020.stdout:Change: 2021-03-10 13:41:55.663785814 +0000 2021-03-10T13:44:36.173 INFO:teuthology.orchestra.run.gibba020.stdout: Birth: - 2021-03-10T13:44:36.182 INFO:teuthology.orchestra.run.gibba020.stderr:1+0 records in 2021-03-10T13:44:36.183 INFO:teuthology.orchestra.run.gibba020.stderr:1+0 records out 2021-03-10T13:44:36.183 INFO:teuthology.orchestra.run.gibba020.stderr:512 bytes copied, 0.000439008 s, 1.2 MB/s 2021-03-10T13:44:36.188 DEBUG:teuthology.orchestra.run.gibba020:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-03-10T13:44:36.197 INFO:teuthology.orchestra.run.gibba020.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-03-10T13:44:36.198 INFO:teuthology.orchestra.run.gibba020.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-10T13:44:36.198 INFO:teuthology.orchestra.run.gibba020.stdout:Device: 6h/6d Inode: 369 Links: 1 2021-03-10T13:44:36.198 INFO:teuthology.orchestra.run.gibba020.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-10T13:44:36.198 INFO:teuthology.orchestra.run.gibba020.stdout:Access: 2021-03-10 13:41:56.135785823 +0000 2021-03-10T13:44:36.199 INFO:teuthology.orchestra.run.gibba020.stdout:Modify: 2021-03-10 13:41:56.087785822 +0000 2021-03-10T13:44:36.199 INFO:teuthology.orchestra.run.gibba020.stdout:Change: 2021-03-10 13:41:56.087785822 +0000 2021-03-10T13:44:36.199 INFO:teuthology.orchestra.run.gibba020.stdout: Birth: - 2021-03-10T13:44:36.211 INFO:teuthology.orchestra.run.gibba020.stderr:1+0 records in 2021-03-10T13:44:36.211 INFO:teuthology.orchestra.run.gibba020.stderr:1+0 records out 2021-03-10T13:44:36.211 INFO:teuthology.orchestra.run.gibba020.stderr:512 bytes copied, 0.000411212 s, 1.2 MB/s 2021-03-10T13:44:36.217 INFO:tasks.cephadm:Deploying osd.0 on gibba013 with /dev/vg_nvme/lv_4... 2021-03-10T13:44:36.217 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2021-03-10T13:44:37.258 INFO:journalctl@ceph.mgr.x.gibba020.stdout:Mar 10 13:44:37 gibba020 docker[10377]: Error: No such container: ceph-7672acc8-81a6-11eb-9080-001a4aab830c-mgr.x 2021-03-10T13:44:37.259 INFO:journalctl@ceph.mgr.x.gibba020.stdout:Mar 10 13:44:37 gibba020 systemd[1]: Started Ceph mgr.x for 7672acc8-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:44:37.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:37 gibba020 bash[9782]: cluster 2021-03-10T13:44:36.392813+0000 mgr.y (mgr.14140) 38 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:37.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:37 gibba020 bash[9782]: audit 2021-03-10T13:44:37.242439+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:20.693310\", \"created\": \"2021-03-10T13:44:20.530781\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}}, \"last_device_update\": \"2021-03-10T13:43:57.842752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:44:37.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:37 gibba020 bash[9782]: audit 2021-03-10T13:44:37.246350+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:20.693310\", \"created\": \"2021-03-10T13:44:20.530781\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}}, \"last_device_update\": \"2021-03-10T13:43:57.842752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:44:37.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:37 gibba020 bash[9782]: audit 2021-03-10T13:44:37.247078+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.gibba020.yqfnwy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:44:37.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:37 gibba020 bash[9782]: audit 2021-03-10T13:44:37.250559+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.gibba020.yqfnwy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-03-10T13:44:37.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:37 gibba020 bash[9782]: audit 2021-03-10T13:44:37.251437+0000 mon.a (mon.0) 165 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:44:37.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:37 gibba020 bash[9782]: audit 2021-03-10T13:44:37.252549+0000 mon.a (mon.0) 166 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.gibba020.yqfnwy", "key": "container_image"}]: dispatch 2021-03-10T13:44:37.770 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:37 gibba013 bash[9767]: cluster 2021-03-10T13:44:36.392813+0000 mgr.y (mgr.14140) 38 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:37.770 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:37 gibba013 bash[9767]: audit 2021-03-10T13:44:37.242439+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:20.693310\", \"created\": \"2021-03-10T13:44:20.530781\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}}, \"last_device_update\": \"2021-03-10T13:43:57.842752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:44:37.770 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:37 gibba013 bash[13024]: cluster 2021-03-10T13:44:36.392813+0000 mgr.y (mgr.14140) 38 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:37.771 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:37 gibba013 bash[13024]: audit 2021-03-10T13:44:37.242439+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:20.693310\", \"created\": \"2021-03-10T13:44:20.530781\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}}, \"last_device_update\": \"2021-03-10T13:43:57.842752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:44:37.771 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:37 gibba013 bash[9767]: audit 2021-03-10T13:44:37.246350+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:20.693310\", \"created\": \"2021-03-10T13:44:20.530781\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}}, \"last_device_update\": \"2021-03-10T13:43:57.842752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:44:37.772 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:37 gibba013 bash[9767]: audit 2021-03-10T13:44:37.247078+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.gibba020.yqfnwy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:44:37.772 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:37 gibba013 bash[9767]: audit 2021-03-10T13:44:37.250559+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.gibba020.yqfnwy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-03-10T13:44:37.772 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:37 gibba013 bash[9767]: audit 2021-03-10T13:44:37.251437+0000 mon.a (mon.0) 165 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:44:37.772 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:37 gibba013 bash[9767]: audit 2021-03-10T13:44:37.252549+0000 mon.a (mon.0) 166 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.gibba020.yqfnwy", "key": "container_image"}]: dispatch 2021-03-10T13:44:37.773 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:37 gibba013 bash[13024]: audit 2021-03-10T13:44:37.246350+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:20.693310\", \"created\": \"2021-03-10T13:44:20.530781\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}}, \"last_device_update\": \"2021-03-10T13:43:57.842752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:44:37.773 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:37 gibba013 bash[13024]: audit 2021-03-10T13:44:37.247078+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.gibba020.yqfnwy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:44:37.773 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:37 gibba013 bash[13024]: audit 2021-03-10T13:44:37.250559+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.gibba020.yqfnwy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-03-10T13:44:37.773 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:37 gibba013 bash[13024]: audit 2021-03-10T13:44:37.251437+0000 mon.a (mon.0) 165 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:44:37.774 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:37 gibba013 bash[13024]: audit 2021-03-10T13:44:37.252549+0000 mon.a (mon.0) 166 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.gibba020.yqfnwy", "key": "container_image"}]: dispatch 2021-03-10T13:44:38.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:38 gibba020 bash[9782]: cephadm 2021-03-10T13:44:37.252186+0000 mgr.y (mgr.14140) 39 : cephadm [INF] Deploying daemon mgr.gibba020.yqfnwy on gibba020 2021-03-10T13:44:38.695 INFO:journalctl@ceph.mgr.x.gibba020.stdout:Mar 10 13:44:38 gibba020 bash[10394]: debug 2021-03-10T13:44:38.618+0000 7faba0655040 1 -- 172.21.2.120:0/2510768418 >> [v2:172.21.2.120:3300/0,v1:172.21.2.120:6789/0] conn(0x55e1729fc800 msgr2=0x55e1729a5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-10T13:44:38.695 INFO:journalctl@ceph.mgr.x.gibba020.stdout:Mar 10 13:44:38 gibba020 bash[10394]: debug 2021-03-10T13:44:38.618+0000 7faba0655040 1 --2- 172.21.2.120:0/2510768418 >> [v2:172.21.2.120:3300/0,v1:172.21.2.120:6789/0] conn(0x55e1729fc800 0x55e1729a5a80 secure :-1 s=READY pgs=7 cs=0 l=1 rx=0x55e1729ef140 tx=0x55e1729f17c0).stop 2021-03-10T13:44:38.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:38 gibba013 bash[9767]: cephadm 2021-03-10T13:44:37.252186+0000 mgr.y (mgr.14140) 39 : cephadm [INF] Deploying daemon mgr.gibba020.yqfnwy on gibba020 2021-03-10T13:44:38.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:38 gibba013 bash[13024]: cephadm 2021-03-10T13:44:37.252186+0000 mgr.y (mgr.14140) 39 : cephadm [INF] Deploying daemon mgr.gibba020.yqfnwy on gibba020 2021-03-10T13:44:38.960 INFO:teuthology.orchestra.run.gibba013.stderr:--> Zapping: /dev/vg_nvme/lv_4 2021-03-10T13:44:38.960 INFO:teuthology.orchestra.run.gibba013.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2021-03-10T13:44:38.960 INFO:teuthology.orchestra.run.gibba013.stderr: stderr: 10+0 records in 2021-03-10T13:44:38.960 INFO:teuthology.orchestra.run.gibba013.stderr:10+0 records out 2021-03-10T13:44:38.960 INFO:teuthology.orchestra.run.gibba013.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00900234 s, 1.2 GB/s 2021-03-10T13:44:38.961 INFO:teuthology.orchestra.run.gibba013.stderr:--> Zapping successful for: 2021-03-10T13:44:39.527 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:39 gibba020 bash[9782]: cluster 2021-03-10T13:44:38.393282+0000 mgr.y (mgr.14140) 40 : cluster [DBG] pgmap v30: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:39.591 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:39 gibba013 bash[9767]: cluster 2021-03-10T13:44:38.393282+0000 mgr.y (mgr.14140) 40 : cluster [DBG] pgmap v30: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:39.592 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:39 gibba013 bash[13024]: cluster 2021-03-10T13:44:38.393282+0000 mgr.y (mgr.14140) 40 : cluster [DBG] pgmap v30: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:39.593 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph orch daemon add osd gibba013:vg_nvme/lv_4 2021-03-10T13:44:40.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:40 gibba020 bash[9782]: audit 2021-03-10T13:44:39.561072+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:20.693310\", \"created\": \"2021-03-10T13:44:20.530781\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}}, \"last_device_update\": \"2021-03-10T13:43:57.842752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:44:40.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:40 gibba020 bash[9782]: audit 2021-03-10T13:44:39.569088+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:20.693310\", \"created\": \"2021-03-10T13:44:20.530781\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}}, \"last_device_update\": \"2021-03-10T13:43:57.842752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:44:40.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:40 gibba020 bash[9782]: audit 2021-03-10T13:44:39.571137+0000 mon.a (mon.0) 169 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:40.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:40 gibba020 bash[9782]: audit 2021-03-10T13:44:39.990705+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:39.988186\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:39.988455\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:39.988618\", \"created\": \"2021-03-10T13:44:39.550781\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}}, \"last_daemon_update\": \"2021-03-10T13:44:39.988879\", \"last_device_update\": \"2021-03-10T13:43:57.842752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:44:40.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:40 gibba020 bash[9782]: audit 2021-03-10T13:44:39.998433+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:39.988186\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:39.988455\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:39.988618\", \"created\": \"2021-03-10T13:44:39.550781\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}}, \"last_daemon_update\": \"2021-03-10T13:44:39.988879\", \"last_device_update\": \"2021-03-10T13:43:57.842752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:44:40.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:40 gibba020 bash[9782]: cephadm 2021-03-10T13:44:40.000595+0000 mgr.y (mgr.14140) 41 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2021-03-10T13:44:40.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:40 gibba020 bash[9782]: audit 2021-03-10T13:44:40.000781+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2021-03-10T13:44:40.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:40 gibba020 bash[9782]: audit 2021-03-10T13:44:40.001663+0000 mon.a (mon.0) 173 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:44:40.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:40 gibba020 bash[9782]: cephadm 2021-03-10T13:44:40.002424+0000 mgr.y (mgr.14140) 42 : cephadm [INF] Reconfiguring daemon mgr.y on gibba013 2021-03-10T13:44:40.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:40 gibba020 bash[9782]: audit 2021-03-10T13:44:40.002630+0000 mon.a (mon.0) 174 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2021-03-10T13:44:40.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:40 gibba013 bash[9767]: audit 2021-03-10T13:44:39.561072+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:20.693310\", \"created\": \"2021-03-10T13:44:20.530781\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}}, \"last_device_update\": \"2021-03-10T13:43:57.842752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:44:40.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:40 gibba013 bash[13024]: audit 2021-03-10T13:44:39.561072+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:20.693310\", \"created\": \"2021-03-10T13:44:20.530781\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}}, \"last_device_update\": \"2021-03-10T13:43:57.842752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:44:40.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:40 gibba013 bash[13024]: audit 2021-03-10T13:44:39.569088+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:20.693310\", \"created\": \"2021-03-10T13:44:20.530781\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}}, \"last_device_update\": \"2021-03-10T13:43:57.842752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:44:40.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:40 gibba013 bash[13024]: audit 2021-03-10T13:44:39.571137+0000 mon.a (mon.0) 169 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:40.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:40 gibba013 bash[9767]: audit 2021-03-10T13:44:39.569088+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:20.693310\", \"created\": \"2021-03-10T13:44:20.530781\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}}, \"last_device_update\": \"2021-03-10T13:43:57.842752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:44:40.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:40 gibba013 bash[9767]: audit 2021-03-10T13:44:39.571137+0000 mon.a (mon.0) 169 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:40.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:40 gibba013 bash[13024]: audit 2021-03-10T13:44:39.990705+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:39.988186\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:39.988455\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:39.988618\", \"created\": \"2021-03-10T13:44:39.550781\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}}, \"last_daemon_update\": \"2021-03-10T13:44:39.988879\", \"last_device_update\": \"2021-03-10T13:43:57.842752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:44:40.889 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:40 gibba013 bash[9767]: audit 2021-03-10T13:44:39.990705+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:39.988186\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:39.988455\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:39.988618\", \"created\": \"2021-03-10T13:44:39.550781\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}}, \"last_daemon_update\": \"2021-03-10T13:44:39.988879\", \"last_device_update\": \"2021-03-10T13:43:57.842752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:44:40.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:40 gibba013 bash[13024]: audit 2021-03-10T13:44:39.998433+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:39.988186\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:39.988455\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:39.988618\", \"created\": \"2021-03-10T13:44:39.550781\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}}, \"last_daemon_update\": \"2021-03-10T13:44:39.988879\", \"last_device_update\": \"2021-03-10T13:43:57.842752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:44:40.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:40 gibba013 bash[13024]: cephadm 2021-03-10T13:44:40.000595+0000 mgr.y (mgr.14140) 41 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2021-03-10T13:44:40.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:40 gibba013 bash[13024]: audit 2021-03-10T13:44:40.000781+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2021-03-10T13:44:40.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:40 gibba013 bash[13024]: audit 2021-03-10T13:44:40.001663+0000 mon.a (mon.0) 173 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:44:40.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:40 gibba013 bash[13024]: cephadm 2021-03-10T13:44:40.002424+0000 mgr.y (mgr.14140) 42 : cephadm [INF] Reconfiguring daemon mgr.y on gibba013 2021-03-10T13:44:40.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:40 gibba013 bash[13024]: audit 2021-03-10T13:44:40.002630+0000 mon.a (mon.0) 174 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2021-03-10T13:44:40.891 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:40 gibba013 bash[9767]: audit 2021-03-10T13:44:39.998433+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:39.988186\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:39.988455\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:39.988618\", \"created\": \"2021-03-10T13:44:39.550781\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}}, \"last_daemon_update\": \"2021-03-10T13:44:39.988879\", \"last_device_update\": \"2021-03-10T13:43:57.842752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:44:40.892 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:40 gibba013 bash[9767]: cephadm 2021-03-10T13:44:40.000595+0000 mgr.y (mgr.14140) 41 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2021-03-10T13:44:40.892 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:40 gibba013 bash[9767]: audit 2021-03-10T13:44:40.000781+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2021-03-10T13:44:40.892 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:40 gibba013 bash[9767]: audit 2021-03-10T13:44:40.001663+0000 mon.a (mon.0) 173 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:44:40.892 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:40 gibba013 bash[9767]: cephadm 2021-03-10T13:44:40.002424+0000 mgr.y (mgr.14140) 42 : cephadm [INF] Reconfiguring daemon mgr.y on gibba013 2021-03-10T13:44:40.892 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:40 gibba013 bash[9767]: audit 2021-03-10T13:44:40.002630+0000 mon.a (mon.0) 174 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2021-03-10T13:44:41.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:41 gibba013 bash[9767]: cluster 2021-03-10T13:44:40.393950+0000 mgr.y (mgr.14140) 43 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:41.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:41 gibba013 bash[13024]: cluster 2021-03-10T13:44:40.393950+0000 mgr.y (mgr.14140) 43 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:41.944 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:41 gibba020 bash[9782]: cluster 2021-03-10T13:44:40.393950+0000 mgr.y (mgr.14140) 43 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:42.778 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:42 gibba013 bash[9767]: cluster 2021-03-10T13:44:41.458109+0000 mon.a (mon.0) 175 : cluster [DBG] Standby manager daemon x started 2021-03-10T13:44:42.778 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:42 gibba013 bash[9767]: audit 2021-03-10T13:44:41.462144+0000 mon.b (mon.2) 2 : audit [DBG] from='mgr.? 172.21.2.120:0/1898269558' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:44:42.778 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:42 gibba013 bash[9767]: audit 2021-03-10T13:44:41.463065+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.2.120:0/1898269558' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:44:42.779 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:42 gibba013 bash[13024]: cluster 2021-03-10T13:44:41.458109+0000 mon.a (mon.0) 175 : cluster [DBG] Standby manager daemon x started 2021-03-10T13:44:42.779 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:42 gibba013 bash[13024]: audit 2021-03-10T13:44:41.462144+0000 mon.b (mon.2) 2 : audit [DBG] from='mgr.? 172.21.2.120:0/1898269558' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:44:42.779 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:42 gibba013 bash[13024]: audit 2021-03-10T13:44:41.463065+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.2.120:0/1898269558' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:44:42.944 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:42 gibba020 bash[9782]: cluster 2021-03-10T13:44:41.458109+0000 mon.a (mon.0) 175 : cluster [DBG] Standby manager daemon x started 2021-03-10T13:44:42.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:42 gibba020 bash[9782]: audit 2021-03-10T13:44:41.462144+0000 mon.b (mon.2) 2 : audit [DBG] from='mgr.? 172.21.2.120:0/1898269558' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:44:42.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:42 gibba020 bash[9782]: audit 2021-03-10T13:44:41.463065+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.2.120:0/1898269558' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:44:43.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:43 gibba013 bash[9767]: cluster 2021-03-10T13:44:42.394584+0000 mgr.y (mgr.14140) 44 : cluster [DBG] pgmap v32: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:43.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:43 gibba013 bash[9767]: cluster 2021-03-10T13:44:42.457608+0000 mon.a (mon.0) 176 : cluster [DBG] mgrmap e14: y(active, since 76s), standbys: x 2021-03-10T13:44:43.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:43 gibba013 bash[9767]: audit 2021-03-10T13:44:42.457683+0000 mon.a (mon.0) 177 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T13:44:43.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:43 gibba013 bash[9767]: audit 2021-03-10T13:44:42.498888+0000 mon.a (mon.0) 178 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:06.186019\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:06.186341\", \"created\": \"2021-03-10T13:44:05.649466\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}}, \"last_device_update\": \"2021-03-10T13:43:31.885152\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:44:43.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:43 gibba013 bash[13024]: cluster 2021-03-10T13:44:42.394584+0000 mgr.y (mgr.14140) 44 : cluster [DBG] pgmap v32: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:43.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:43 gibba013 bash[13024]: cluster 2021-03-10T13:44:42.457608+0000 mon.a (mon.0) 176 : cluster [DBG] mgrmap e14: y(active, since 76s), standbys: x 2021-03-10T13:44:43.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:43 gibba013 bash[13024]: audit 2021-03-10T13:44:42.457683+0000 mon.a (mon.0) 177 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T13:44:43.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:43 gibba013 bash[13024]: audit 2021-03-10T13:44:42.498888+0000 mon.a (mon.0) 178 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:06.186019\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:06.186341\", \"created\": \"2021-03-10T13:44:05.649466\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}}, \"last_device_update\": \"2021-03-10T13:43:31.885152\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:44:43.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:43 gibba013 bash[9767]: audit 2021-03-10T13:44:42.502185+0000 mon.a (mon.0) 179 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:06.186019\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:06.186341\", \"created\": \"2021-03-10T13:44:05.649466\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}}, \"last_device_update\": \"2021-03-10T13:43:31.885152\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:44:43.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:43 gibba013 bash[9767]: audit 2021-03-10T13:44:42.502933+0000 mon.a (mon.0) 180 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:43.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:43 gibba013 bash[13024]: audit 2021-03-10T13:44:42.502185+0000 mon.a (mon.0) 179 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:06.186019\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:06.186341\", \"created\": \"2021-03-10T13:44:05.649466\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}}, \"last_device_update\": \"2021-03-10T13:43:31.885152\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:44:43.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:43 gibba013 bash[13024]: audit 2021-03-10T13:44:42.502933+0000 mon.a (mon.0) 180 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:43.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:43 gibba013 bash[9767]: audit 2021-03-10T13:44:42.901366+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:42.900628\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:42.900709\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:42.900756\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}}, \"last_daemon_update\": \"2021-03-10T13:44:42.900847\", \"last_device_update\": \"2021-03-10T13:43:31.885152\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:44:43.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:43 gibba013 bash[9767]: audit 2021-03-10T13:44:42.903977+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:42.900628\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:42.900709\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:42.900756\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}}, \"last_daemon_update\": \"2021-03-10T13:44:42.900847\", \"last_device_update\": \"2021-03-10T13:43:31.885152\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:44:43.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:43 gibba013 bash[9767]: audit 2021-03-10T13:44:42.904540+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:43.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:43 gibba013 bash[9767]: audit 2021-03-10T13:44:43.002927+0000 mgr.y (mgr.14140) 45 : audit [DBG] from='client.14199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba013:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:44:43.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:43 gibba013 bash[9767]: cephadm 2021-03-10T13:44:43.003443+0000 mgr.y (mgr.14140) 46 : cephadm [INF] Applying osd on host gibba013... 2021-03-10T13:44:43.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:43 gibba013 bash[13024]: audit 2021-03-10T13:44:42.901366+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:42.900628\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:42.900709\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:42.900756\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}}, \"last_daemon_update\": \"2021-03-10T13:44:42.900847\", \"last_device_update\": \"2021-03-10T13:43:31.885152\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:44:43.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:43 gibba013 bash[13024]: audit 2021-03-10T13:44:42.903977+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:42.900628\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:42.900709\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:42.900756\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}}, \"last_daemon_update\": \"2021-03-10T13:44:42.900847\", \"last_device_update\": \"2021-03-10T13:43:31.885152\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:44:43.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:43 gibba013 bash[13024]: audit 2021-03-10T13:44:42.904540+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:43.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:43 gibba013 bash[13024]: audit 2021-03-10T13:44:43.002927+0000 mgr.y (mgr.14140) 45 : audit [DBG] from='client.14199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba013:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:44:43.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:43 gibba013 bash[13024]: cephadm 2021-03-10T13:44:43.003443+0000 mgr.y (mgr.14140) 46 : cephadm [INF] Applying osd on host gibba013... 2021-03-10T13:44:43.890 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:43 gibba013 bash[9767]: audit 2021-03-10T13:44:43.003658+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:44:43.891 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:43 gibba013 bash[9767]: audit 2021-03-10T13:44:43.004535+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:44:43.891 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:43 gibba013 bash[9767]: audit 2021-03-10T13:44:43.005428+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:44:43.891 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:43 gibba013 bash[9767]: cluster 2021-03-10T13:44:43.215455+0000 mon.a (mon.0) 187 : cluster [DBG] Standby manager daemon gibba020.yqfnwy started 2021-03-10T13:44:43.891 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:43 gibba013 bash[9767]: audit 2021-03-10T13:44:43.219390+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.2.120:0/360853881' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:44:43.892 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:43 gibba013 bash[9767]: audit 2021-03-10T13:44:43.220210+0000 mon.b (mon.2) 5 : audit [DBG] from='mgr.? 172.21.2.120:0/360853881' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:44:43.892 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:43 gibba013 bash[9767]: audit 2021-03-10T13:44:43.237468+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:43.234860\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:43.235126\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:43.235291\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}}, \"last_daemon_update\": \"2021-03-10T13:44:43.235613\", \"last_device_update\": \"2021-03-10T13:43:57.842752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:44:43.892 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:43 gibba013 bash[9767]: audit 2021-03-10T13:44:43.246000+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:43.234860\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:43.235126\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:43.235291\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}}, \"last_daemon_update\": \"2021-03-10T13:44:43.235613\", \"last_device_update\": \"2021-03-10T13:43:57.842752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:44:43.893 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:43 gibba013 bash[13024]: audit 2021-03-10T13:44:43.003658+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:44:43.893 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:43 gibba013 bash[13024]: audit 2021-03-10T13:44:43.004535+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:44:43.893 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:43 gibba013 bash[13024]: audit 2021-03-10T13:44:43.005428+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:44:43.893 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:43 gibba013 bash[13024]: cluster 2021-03-10T13:44:43.215455+0000 mon.a (mon.0) 187 : cluster [DBG] Standby manager daemon gibba020.yqfnwy started 2021-03-10T13:44:43.894 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:43 gibba013 bash[13024]: audit 2021-03-10T13:44:43.219390+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.2.120:0/360853881' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:44:43.894 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:43 gibba013 bash[13024]: audit 2021-03-10T13:44:43.220210+0000 mon.b (mon.2) 5 : audit [DBG] from='mgr.? 172.21.2.120:0/360853881' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:44:43.894 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:43 gibba013 bash[13024]: audit 2021-03-10T13:44:43.237468+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:43.234860\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:43.235126\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:43.235291\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}}, \"last_daemon_update\": \"2021-03-10T13:44:43.235613\", \"last_device_update\": \"2021-03-10T13:43:57.842752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:44:43.894 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:43 gibba013 bash[13024]: audit 2021-03-10T13:44:43.246000+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:43.234860\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:43.235126\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:43.235291\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}}, \"last_daemon_update\": \"2021-03-10T13:44:43.235613\", \"last_device_update\": \"2021-03-10T13:43:57.842752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:44:43.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:43 gibba020 bash[9782]: cluster 2021-03-10T13:44:42.394584+0000 mgr.y (mgr.14140) 44 : cluster [DBG] pgmap v32: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:43.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:43 gibba020 bash[9782]: cluster 2021-03-10T13:44:42.457608+0000 mon.a (mon.0) 176 : cluster [DBG] mgrmap e14: y(active, since 76s), standbys: x 2021-03-10T13:44:43.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:43 gibba020 bash[9782]: audit 2021-03-10T13:44:42.457683+0000 mon.a (mon.0) 177 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T13:44:43.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:43 gibba020 bash[9782]: audit 2021-03-10T13:44:42.498888+0000 mon.a (mon.0) 178 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:06.186019\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:06.186341\", \"created\": \"2021-03-10T13:44:05.649466\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}}, \"last_device_update\": \"2021-03-10T13:43:31.885152\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:44:43.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:43 gibba020 bash[9782]: audit 2021-03-10T13:44:42.502185+0000 mon.a (mon.0) 179 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:06.186019\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:06.186341\", \"created\": \"2021-03-10T13:44:05.649466\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}}, \"last_device_update\": \"2021-03-10T13:43:31.885152\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:44:43.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:43 gibba020 bash[9782]: audit 2021-03-10T13:44:42.502933+0000 mon.a (mon.0) 180 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:43.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:43 gibba020 bash[9782]: audit 2021-03-10T13:44:42.901366+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:42.900628\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:42.900709\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:42.900756\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}}, \"last_daemon_update\": \"2021-03-10T13:44:42.900847\", \"last_device_update\": \"2021-03-10T13:43:31.885152\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:44:43.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:43 gibba020 bash[9782]: audit 2021-03-10T13:44:42.903977+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:42.900628\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:42.900709\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:42.900756\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}}, \"last_daemon_update\": \"2021-03-10T13:44:42.900847\", \"last_device_update\": \"2021-03-10T13:43:31.885152\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:44:43.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:43 gibba020 bash[9782]: audit 2021-03-10T13:44:42.904540+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:43.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:43 gibba020 bash[9782]: audit 2021-03-10T13:44:43.002927+0000 mgr.y (mgr.14140) 45 : audit [DBG] from='client.14199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba013:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:44:43.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:43 gibba020 bash[9782]: cephadm 2021-03-10T13:44:43.003443+0000 mgr.y (mgr.14140) 46 : cephadm [INF] Applying osd on host gibba013... 2021-03-10T13:44:43.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:43 gibba020 bash[9782]: audit 2021-03-10T13:44:43.003658+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:44:43.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:43 gibba020 bash[9782]: audit 2021-03-10T13:44:43.004535+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:44:43.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:43 gibba020 bash[9782]: audit 2021-03-10T13:44:43.005428+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:44:43.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:43 gibba020 bash[9782]: cluster 2021-03-10T13:44:43.215455+0000 mon.a (mon.0) 187 : cluster [DBG] Standby manager daemon gibba020.yqfnwy started 2021-03-10T13:44:43.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:43 gibba020 bash[9782]: audit 2021-03-10T13:44:43.219390+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.2.120:0/360853881' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:44:43.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:43 gibba020 bash[9782]: audit 2021-03-10T13:44:43.220210+0000 mon.b (mon.2) 5 : audit [DBG] from='mgr.? 172.21.2.120:0/360853881' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:44:43.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:43 gibba020 bash[9782]: audit 2021-03-10T13:44:43.237468+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:43.234860\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:43.235126\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:43.235291\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}}, \"last_daemon_update\": \"2021-03-10T13:44:43.235613\", \"last_device_update\": \"2021-03-10T13:43:57.842752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:44:43.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:43 gibba020 bash[9782]: audit 2021-03-10T13:44:43.246000+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:43.234860\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:43.235126\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:43.235291\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}}, \"last_daemon_update\": \"2021-03-10T13:44:43.235613\", \"last_device_update\": \"2021-03-10T13:43:57.842752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:44:45.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:44 gibba020 bash[9782]: cluster 2021-03-10T13:44:43.921524+0000 mon.a (mon.0) 190 : cluster [DBG] mgrmap e15: y(active, since 78s), standbys: x, gibba020.yqfnwy 2021-03-10T13:44:45.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:44 gibba020 bash[9782]: audit 2021-03-10T13:44:43.921859+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "gibba020.yqfnwy", "id": "gibba020.yqfnwy"}]: dispatch 2021-03-10T13:44:45.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:44 gibba020 bash[9782]: cluster 2021-03-10T13:44:44.248839+0000 mgr.gibba020.yqfnwy (mgr.34115) 1 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba020.yqfnwy: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:44:45.275 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:44 gibba013 bash[9767]: cluster 2021-03-10T13:44:43.921524+0000 mon.a (mon.0) 190 : cluster [DBG] mgrmap e15: y(active, since 78s), standbys: x, gibba020.yqfnwy 2021-03-10T13:44:45.276 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:44 gibba013 bash[9767]: audit 2021-03-10T13:44:43.921859+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "gibba020.yqfnwy", "id": "gibba020.yqfnwy"}]: dispatch 2021-03-10T13:44:45.276 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:44 gibba013 bash[9767]: cluster 2021-03-10T13:44:44.248839+0000 mgr.gibba020.yqfnwy (mgr.34115) 1 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba020.yqfnwy: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:44:45.276 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:44 gibba013 bash[13024]: cluster 2021-03-10T13:44:43.921524+0000 mon.a (mon.0) 190 : cluster [DBG] mgrmap e15: y(active, since 78s), standbys: x, gibba020.yqfnwy 2021-03-10T13:44:45.276 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:44 gibba013 bash[13024]: audit 2021-03-10T13:44:43.921859+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "gibba020.yqfnwy", "id": "gibba020.yqfnwy"}]: dispatch 2021-03-10T13:44:45.277 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:44 gibba013 bash[13024]: cluster 2021-03-10T13:44:44.248839+0000 mgr.gibba020.yqfnwy (mgr.34115) 1 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba020.yqfnwy: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:44:46.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:45 gibba020 bash[9782]: cluster 2021-03-10T13:44:44.395035+0000 mgr.y (mgr.14140) 47 : cluster [DBG] pgmap v33: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:46.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:45 gibba020 bash[9782]: audit 2021-03-10T13:44:45.901554+0000 mon.a (mon.0) 192 : audit [INF] from='client.? 172.21.2.113:0/1066091452' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "471db9b4-2fe7-4656-b7f0-2c7e12b9ab63"}]: dispatch 2021-03-10T13:44:46.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:45 gibba020 bash[9782]: audit 2021-03-10T13:44:45.905619+0000 mon.a (mon.0) 193 : audit [INF] from='client.? 172.21.2.113:0/1066091452' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "471db9b4-2fe7-4656-b7f0-2c7e12b9ab63"}]': finished 2021-03-10T13:44:46.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:45 gibba020 bash[9782]: cluster 2021-03-10T13:44:45.905677+0000 mon.a (mon.0) 194 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2021-03-10T13:44:46.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:45 gibba020 bash[9782]: audit 2021-03-10T13:44:45.905820+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:44:46.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:45 gibba013 bash[9767]: cluster 2021-03-10T13:44:44.395035+0000 mgr.y (mgr.14140) 47 : cluster [DBG] pgmap v33: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:46.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:45 gibba013 bash[9767]: audit 2021-03-10T13:44:45.901554+0000 mon.a (mon.0) 192 : audit [INF] from='client.? 172.21.2.113:0/1066091452' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "471db9b4-2fe7-4656-b7f0-2c7e12b9ab63"}]: dispatch 2021-03-10T13:44:46.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:45 gibba013 bash[9767]: audit 2021-03-10T13:44:45.905619+0000 mon.a (mon.0) 193 : audit [INF] from='client.? 172.21.2.113:0/1066091452' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "471db9b4-2fe7-4656-b7f0-2c7e12b9ab63"}]': finished 2021-03-10T13:44:46.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:45 gibba013 bash[9767]: cluster 2021-03-10T13:44:45.905677+0000 mon.a (mon.0) 194 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2021-03-10T13:44:46.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:45 gibba013 bash[9767]: audit 2021-03-10T13:44:45.905820+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:44:46.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:45 gibba013 bash[13024]: cluster 2021-03-10T13:44:44.395035+0000 mgr.y (mgr.14140) 47 : cluster [DBG] pgmap v33: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:46.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:45 gibba013 bash[13024]: audit 2021-03-10T13:44:45.901554+0000 mon.a (mon.0) 192 : audit [INF] from='client.? 172.21.2.113:0/1066091452' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "471db9b4-2fe7-4656-b7f0-2c7e12b9ab63"}]: dispatch 2021-03-10T13:44:46.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:45 gibba013 bash[13024]: audit 2021-03-10T13:44:45.905619+0000 mon.a (mon.0) 193 : audit [INF] from='client.? 172.21.2.113:0/1066091452' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "471db9b4-2fe7-4656-b7f0-2c7e12b9ab63"}]': finished 2021-03-10T13:44:46.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:45 gibba013 bash[13024]: cluster 2021-03-10T13:44:45.905677+0000 mon.a (mon.0) 194 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2021-03-10T13:44:46.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:45 gibba013 bash[13024]: audit 2021-03-10T13:44:45.905820+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:44:48.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:47 gibba020 bash[9782]: cluster 2021-03-10T13:44:46.395569+0000 mgr.y (mgr.14140) 48 : cluster [DBG] pgmap v35: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:48.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:47 gibba020 bash[9782]: audit 2021-03-10T13:44:47.898855+0000 mon.a (mon.0) 196 : audit [DBG] from='client.? 172.21.2.113:0/1394954577' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:44:48.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:47 gibba013 bash[9767]: cluster 2021-03-10T13:44:46.395569+0000 mgr.y (mgr.14140) 48 : cluster [DBG] pgmap v35: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:48.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:47 gibba013 bash[9767]: audit 2021-03-10T13:44:47.898855+0000 mon.a (mon.0) 196 : audit [DBG] from='client.? 172.21.2.113:0/1394954577' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:44:48.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:47 gibba013 bash[13024]: cluster 2021-03-10T13:44:46.395569+0000 mgr.y (mgr.14140) 48 : cluster [DBG] pgmap v35: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:48.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:47 gibba013 bash[13024]: audit 2021-03-10T13:44:47.898855+0000 mon.a (mon.0) 196 : audit [DBG] from='client.? 172.21.2.113:0/1394954577' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:44:50.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:49 gibba013 bash[9767]: cluster 2021-03-10T13:44:48.396277+0000 mgr.y (mgr.14140) 49 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:50.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:49 gibba013 bash[13024]: cluster 2021-03-10T13:44:48.396277+0000 mgr.y (mgr.14140) 49 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:50.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:49 gibba020 bash[9782]: cluster 2021-03-10T13:44:48.396277+0000 mgr.y (mgr.14140) 49 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:51.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:51 gibba013 bash[9767]: cluster 2021-03-10T13:44:50.396706+0000 mgr.y (mgr.14140) 50 : cluster [DBG] pgmap v37: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:51.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:51 gibba013 bash[9767]: audit 2021-03-10T13:44:50.524754+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:44:51.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:51 gibba013 bash[13024]: cluster 2021-03-10T13:44:50.396706+0000 mgr.y (mgr.14140) 50 : cluster [DBG] pgmap v37: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:51.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:51 gibba013 bash[13024]: audit 2021-03-10T13:44:50.524754+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:44:51.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:51 gibba020 bash[9782]: cluster 2021-03-10T13:44:50.396706+0000 mgr.y (mgr.14140) 50 : cluster [DBG] pgmap v37: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:51.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:51 gibba020 bash[9782]: audit 2021-03-10T13:44:50.524754+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:44:53.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:53 gibba013 bash[9767]: cluster 2021-03-10T13:44:52.397155+0000 mgr.y (mgr.14140) 51 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:53.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:53 gibba013 bash[13024]: cluster 2021-03-10T13:44:52.397155+0000 mgr.y (mgr.14140) 51 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:53.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:53 gibba020 bash[9782]: cluster 2021-03-10T13:44:52.397155+0000 mgr.y (mgr.14140) 51 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:54.711 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:54 gibba013 bash[9767]: audit 2021-03-10T13:44:53.534611+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-03-10T13:44:54.712 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:54 gibba013 bash[9767]: audit 2021-03-10T13:44:53.536749+0000 mon.a (mon.0) 199 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:44:54.712 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:54 gibba013 bash[9767]: cephadm 2021-03-10T13:44:53.538641+0000 mgr.y (mgr.14140) 52 : cephadm [INF] Deploying daemon osd.0 on gibba013 2021-03-10T13:44:54.712 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:54 gibba013 bash[9767]: audit 2021-03-10T13:44:53.539354+0000 mon.a (mon.0) 200 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2021-03-10T13:44:54.713 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:54 gibba013 bash[13024]: audit 2021-03-10T13:44:53.534611+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-03-10T13:44:54.713 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:54 gibba013 bash[13024]: audit 2021-03-10T13:44:53.536749+0000 mon.a (mon.0) 199 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:44:54.713 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:54 gibba013 bash[13024]: cephadm 2021-03-10T13:44:53.538641+0000 mgr.y (mgr.14140) 52 : cephadm [INF] Deploying daemon osd.0 on gibba013 2021-03-10T13:44:54.713 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:54 gibba013 bash[13024]: audit 2021-03-10T13:44:53.539354+0000 mon.a (mon.0) 200 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2021-03-10T13:44:54.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:54 gibba020 bash[9782]: audit 2021-03-10T13:44:53.534611+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-03-10T13:44:54.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:54 gibba020 bash[9782]: audit 2021-03-10T13:44:53.536749+0000 mon.a (mon.0) 199 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:44:54.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:54 gibba020 bash[9782]: cephadm 2021-03-10T13:44:53.538641+0000 mgr.y (mgr.14140) 52 : cephadm [INF] Deploying daemon osd.0 on gibba013 2021-03-10T13:44:54.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:54 gibba020 bash[9782]: audit 2021-03-10T13:44:53.539354+0000 mon.a (mon.0) 200 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2021-03-10T13:44:55.308 INFO:teuthology.orchestra.run.gibba013.stdout:Created osd(s) 0 on host 'gibba013' 2021-03-10T13:44:55.584 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:55 gibba013 bash[9767]: cluster 2021-03-10T13:44:54.397772+0000 mgr.y (mgr.14140) 53 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:55.585 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:55 gibba013 bash[13024]: cluster 2021-03-10T13:44:54.397772+0000 mgr.y (mgr.14140) 53 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:55.585 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:55 gibba013 bash[9767]: audit 2021-03-10T13:44:55.300594+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:42.900628\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:42.900709\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:42.900756\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}}, \"last_device_update\": \"2021-03-10T13:43:31.885152\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:44:55.586 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:55 gibba013 bash[9767]: audit 2021-03-10T13:44:55.301193+0000 mon.a (mon.0) 202 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:55.586 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:55 gibba013 bash[9767]: audit 2021-03-10T13:44:55.304698+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:42.900628\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:42.900709\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:42.900756\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}}, \"last_device_update\": \"2021-03-10T13:43:31.885152\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:44:55.586 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:55 gibba013 bash[13024]: audit 2021-03-10T13:44:55.300594+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:42.900628\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:42.900709\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:42.900756\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}}, \"last_device_update\": \"2021-03-10T13:43:31.885152\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:44:55.587 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:55 gibba013 bash[13024]: audit 2021-03-10T13:44:55.301193+0000 mon.a (mon.0) 202 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:55.587 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:55 gibba013 bash[13024]: audit 2021-03-10T13:44:55.304698+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:42.900628\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:42.900709\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:42.900756\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}}, \"last_device_update\": \"2021-03-10T13:43:31.885152\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:44:55.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:55 gibba020 bash[9782]: cluster 2021-03-10T13:44:54.397772+0000 mgr.y (mgr.14140) 53 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:55.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:55 gibba020 bash[9782]: audit 2021-03-10T13:44:55.300594+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:42.900628\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:42.900709\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:42.900756\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}}, \"last_device_update\": \"2021-03-10T13:43:31.885152\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:44:55.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:55 gibba020 bash[9782]: audit 2021-03-10T13:44:55.301193+0000 mon.a (mon.0) 202 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:44:55.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:55 gibba020 bash[9782]: audit 2021-03-10T13:44:55.304698+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:42.900628\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:42.900709\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:42.900756\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}}, \"last_device_update\": \"2021-03-10T13:43:31.885152\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:44:56.395 DEBUG:teuthology.orchestra.run.gibba013:osd.0> sudo journalctl -f -n 0 -u ceph-7672acc8-81a6-11eb-9080-001a4aab830c@osd.0.service 2021-03-10T13:44:56.398 INFO:tasks.cephadm:Deploying osd.1 on gibba013 with /dev/vg_nvme/lv_3... 2021-03-10T13:44:56.398 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2021-03-10T13:44:56.467 INFO:journalctl@ceph.osd.0.gibba013.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:44:56.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:56 gibba013 bash[9767]: audit 2021-03-10T13:44:55.724798+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724053\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724119\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724152\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724183\", \"created\": \"2021-03-10T13:44:55.289466\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}}, \"last_daemon_update\": \"2021-03-10T13:44:55.724239\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:44:56.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:56 gibba013 bash[13024]: audit 2021-03-10T13:44:55.724798+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724053\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724119\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724152\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724183\", \"created\": \"2021-03-10T13:44:55.289466\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}}, \"last_daemon_update\": \"2021-03-10T13:44:55.724239\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:44:56.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:56 gibba013 bash[9767]: audit 2021-03-10T13:44:55.728695+0000 mon.a (mon.0) 205 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724053\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724119\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724152\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724183\", \"created\": \"2021-03-10T13:44:55.289466\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}}, \"last_daemon_update\": \"2021-03-10T13:44:55.724239\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:44:56.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:56 gibba013 bash[9767]: audit 2021-03-10T13:44:55.729140+0000 mon.a (mon.0) 206 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:44:56.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:56 gibba013 bash[13024]: audit 2021-03-10T13:44:55.728695+0000 mon.a (mon.0) 205 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724053\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724119\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724152\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724183\", \"created\": \"2021-03-10T13:44:55.289466\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}}, \"last_daemon_update\": \"2021-03-10T13:44:55.724239\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:44:56.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:56 gibba013 bash[13024]: audit 2021-03-10T13:44:55.729140+0000 mon.a (mon.0) 206 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:44:56.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:56 gibba020 bash[9782]: audit 2021-03-10T13:44:55.724798+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724053\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724119\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724152\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724183\", \"created\": \"2021-03-10T13:44:55.289466\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}}, \"last_daemon_update\": \"2021-03-10T13:44:55.724239\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:44:56.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:56 gibba020 bash[9782]: audit 2021-03-10T13:44:55.728695+0000 mon.a (mon.0) 205 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724053\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724119\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724152\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724183\", \"created\": \"2021-03-10T13:44:55.289466\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}}, \"last_daemon_update\": \"2021-03-10T13:44:55.724239\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:44:56.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:56 gibba020 bash[9782]: audit 2021-03-10T13:44:55.729140+0000 mon.a (mon.0) 206 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:44:57.577 INFO:journalctl@ceph.osd.0.gibba013.stdout:Mar 10 13:44:57 gibba013 bash[14618]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-03-10T13:44:57.578 INFO:journalctl@ceph.osd.0.gibba013.stdout:Mar 10 13:44:57 gibba013 bash[14618]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2021-03-10T13:44:57.578 INFO:journalctl@ceph.osd.0.gibba013.stdout:Mar 10 13:44:57 gibba013 bash[14618]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2021-03-10T13:44:57.578 INFO:journalctl@ceph.osd.0.gibba013.stdout:Mar 10 13:44:57 gibba013 bash[14618]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2021-03-10T13:44:57.579 INFO:journalctl@ceph.osd.0.gibba013.stdout:Mar 10 13:44:57 gibba013 bash[14618]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2021-03-10T13:44:57.579 INFO:journalctl@ceph.osd.0.gibba013.stdout:Mar 10 13:44:57 gibba013 bash[14618]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-03-10T13:44:57.579 INFO:journalctl@ceph.osd.0.gibba013.stdout:Mar 10 13:44:57 gibba013 bash[14618]: --> ceph-volume lvm activate successful for osd ID: 0 2021-03-10T13:44:57.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:57 gibba013 bash[9767]: cluster 2021-03-10T13:44:56.398105+0000 mgr.y (mgr.14140) 54 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:57.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:57 gibba013 bash[13024]: cluster 2021-03-10T13:44:56.398105+0000 mgr.y (mgr.14140) 54 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:44:58.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:57 gibba020 bash[9782]: cluster 2021-03-10T13:44:56.398105+0000 mgr.y (mgr.14140) 54 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:45:00.036 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:44:59 gibba013 bash[13024]: cluster 2021-03-10T13:44:58.398884+0000 mgr.y (mgr.14140) 55 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:45:00.037 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:44:59 gibba013 bash[9767]: cluster 2021-03-10T13:44:58.398884+0000 mgr.y (mgr.14140) 55 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:45:00.194 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:44:59 gibba020 bash[9782]: cluster 2021-03-10T13:44:58.398884+0000 mgr.y (mgr.14140) 55 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:45:01.205 INFO:journalctl@ceph.osd.0.gibba013.stdout:Mar 10 13:45:00 gibba013 bash[14934]: debug 2021-03-10T13:45:00.909+0000 7f195f4a3ec0 -1 Falling back to public interface 2021-03-10T13:45:01.624 INFO:teuthology.orchestra.run.gibba013.stderr:--> Zapping: /dev/vg_nvme/lv_3 2021-03-10T13:45:01.624 INFO:teuthology.orchestra.run.gibba013.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2021-03-10T13:45:01.625 INFO:teuthology.orchestra.run.gibba013.stderr: stderr: 10+0 records in 2021-03-10T13:45:01.625 INFO:teuthology.orchestra.run.gibba013.stderr:10+0 records out 2021-03-10T13:45:01.625 INFO:teuthology.orchestra.run.gibba013.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00801659 s, 1.3 GB/s 2021-03-10T13:45:01.625 INFO:teuthology.orchestra.run.gibba013.stderr:--> Zapping successful for: 2021-03-10T13:45:01.689 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:01 gibba013 bash[9767]: cluster 2021-03-10T13:45:00.399324+0000 mgr.y (mgr.14140) 56 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:45:01.690 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:01 gibba013 bash[13024]: cluster 2021-03-10T13:45:00.399324+0000 mgr.y (mgr.14140) 56 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:45:01.690 INFO:journalctl@ceph.osd.0.gibba013.stdout:Mar 10 13:45:01 gibba013 bash[14934]: debug 2021-03-10T13:45:01.529+0000 7f195f4a3ec0 -1 osd.0 0 log_to_monitors {default=true} 2021-03-10T13:45:01.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:01 gibba020 bash[9782]: cluster 2021-03-10T13:45:00.399324+0000 mgr.y (mgr.14140) 56 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:45:02.414 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph orch daemon add osd gibba013:vg_nvme/lv_3 2021-03-10T13:45:02.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:02 gibba013 bash[9767]: audit 2021-03-10T13:45:01.536282+0000 mon.c (mon.1) 3 : audit [INF] from='osd.0 [v2:172.21.2.113:6802/1746855808,v1:172.21.2.113:6803/1746855808]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T13:45:02.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:02 gibba013 bash[9767]: audit 2021-03-10T13:45:01.536592+0000 mon.a (mon.0) 207 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T13:45:02.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:02 gibba013 bash[13024]: audit 2021-03-10T13:45:01.536282+0000 mon.c (mon.1) 3 : audit [INF] from='osd.0 [v2:172.21.2.113:6802/1746855808,v1:172.21.2.113:6803/1746855808]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T13:45:02.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:02 gibba013 bash[13024]: audit 2021-03-10T13:45:01.536592+0000 mon.a (mon.0) 207 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T13:45:02.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:02 gibba020 bash[9782]: audit 2021-03-10T13:45:01.536282+0000 mon.c (mon.1) 3 : audit [INF] from='osd.0 [v2:172.21.2.113:6802/1746855808,v1:172.21.2.113:6803/1746855808]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T13:45:02.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:02 gibba020 bash[9782]: audit 2021-03-10T13:45:01.536592+0000 mon.a (mon.0) 207 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T13:45:03.653 INFO:journalctl@ceph.osd.0.gibba013.stdout:Mar 10 13:45:03 gibba013 bash[14934]: debug 2021-03-10T13:45:03.413+0000 7f1948258700 -1 osd.0 0 waiting for initial osdmap 2021-03-10T13:45:03.654 INFO:journalctl@ceph.osd.0.gibba013.stdout:Mar 10 13:45:03 gibba013 bash[14934]: debug 2021-03-10T13:45:03.417+0000 7f1953474700 -1 osd.0 9 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:45:03.654 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:03 gibba013 bash[9767]: cluster 2021-03-10T13:45:02.399831+0000 mgr.y (mgr.14140) 57 : cluster [DBG] pgmap v43: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:45:03.654 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:03 gibba013 bash[9767]: audit 2021-03-10T13:45:02.409914+0000 mon.a (mon.0) 208 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-03-10T13:45:03.655 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:03 gibba013 bash[9767]: cluster 2021-03-10T13:45:02.409946+0000 mon.a (mon.0) 209 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2021-03-10T13:45:03.655 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:03 gibba013 bash[9767]: audit 2021-03-10T13:45:02.410117+0000 mon.a (mon.0) 210 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:45:03.655 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:03 gibba013 bash[9767]: audit 2021-03-10T13:45:02.410360+0000 mon.c (mon.1) 4 : audit [INF] from='osd.0 [v2:172.21.2.113:6802/1746855808,v1:172.21.2.113:6803/1746855808]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:45:03.655 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:03 gibba013 bash[9767]: audit 2021-03-10T13:45:02.410534+0000 mon.a (mon.0) 211 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:45:03.656 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:03 gibba013 bash[9767]: audit 2021-03-10T13:45:03.079738+0000 mon.a (mon.0) 212 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:45:03.656 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:03 gibba013 bash[13024]: cluster 2021-03-10T13:45:02.399831+0000 mgr.y (mgr.14140) 57 : cluster [DBG] pgmap v43: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:45:03.656 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:03 gibba013 bash[13024]: audit 2021-03-10T13:45:02.409914+0000 mon.a (mon.0) 208 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-03-10T13:45:03.657 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:03 gibba013 bash[13024]: cluster 2021-03-10T13:45:02.409946+0000 mon.a (mon.0) 209 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2021-03-10T13:45:03.657 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:03 gibba013 bash[13024]: audit 2021-03-10T13:45:02.410117+0000 mon.a (mon.0) 210 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:45:03.657 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:03 gibba013 bash[13024]: audit 2021-03-10T13:45:02.410360+0000 mon.c (mon.1) 4 : audit [INF] from='osd.0 [v2:172.21.2.113:6802/1746855808,v1:172.21.2.113:6803/1746855808]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:45:03.657 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:03 gibba013 bash[13024]: audit 2021-03-10T13:45:02.410534+0000 mon.a (mon.0) 211 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:45:03.657 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:03 gibba013 bash[13024]: audit 2021-03-10T13:45:03.079738+0000 mon.a (mon.0) 212 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:45:03.658 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:03 gibba013 bash[9767]: audit 2021-03-10T13:45:03.181167+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724053\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724119\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724152\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724183\", \"created\": \"2021-03-10T13:44:55.289466\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}}, \"last_daemon_update\": \"2021-03-10T13:44:55.724239\", \"last_device_update\": \"2021-03-10T13:45:03.180657\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:45:03.658 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:03 gibba013 bash[9767]: audit 2021-03-10T13:45:03.188237+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724053\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724119\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724152\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724183\", \"created\": \"2021-03-10T13:44:55.289466\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}}, \"last_daemon_update\": \"2021-03-10T13:44:55.724239\", \"last_device_update\": \"2021-03-10T13:45:03.180657\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:45:03.659 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:03 gibba013 bash[13024]: audit 2021-03-10T13:45:03.181167+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724053\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724119\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724152\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724183\", \"created\": \"2021-03-10T13:44:55.289466\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}}, \"last_daemon_update\": \"2021-03-10T13:44:55.724239\", \"last_device_update\": \"2021-03-10T13:45:03.180657\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:45:03.659 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:03 gibba013 bash[13024]: audit 2021-03-10T13:45:03.188237+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724053\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724119\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724152\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724183\", \"created\": \"2021-03-10T13:44:55.289466\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}}, \"last_daemon_update\": \"2021-03-10T13:44:55.724239\", \"last_device_update\": \"2021-03-10T13:45:03.180657\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:45:03.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:03 gibba020 bash[9782]: cluster 2021-03-10T13:45:02.399831+0000 mgr.y (mgr.14140) 57 : cluster [DBG] pgmap v43: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:45:03.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:03 gibba020 bash[9782]: audit 2021-03-10T13:45:02.409914+0000 mon.a (mon.0) 208 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-03-10T13:45:03.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:03 gibba020 bash[9782]: cluster 2021-03-10T13:45:02.409946+0000 mon.a (mon.0) 209 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2021-03-10T13:45:03.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:03 gibba020 bash[9782]: audit 2021-03-10T13:45:02.410117+0000 mon.a (mon.0) 210 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:45:03.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:03 gibba020 bash[9782]: audit 2021-03-10T13:45:02.410360+0000 mon.c (mon.1) 4 : audit [INF] from='osd.0 [v2:172.21.2.113:6802/1746855808,v1:172.21.2.113:6803/1746855808]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:45:03.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:03 gibba020 bash[9782]: audit 2021-03-10T13:45:02.410534+0000 mon.a (mon.0) 211 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:45:03.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:03 gibba020 bash[9782]: audit 2021-03-10T13:45:03.079738+0000 mon.a (mon.0) 212 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:45:03.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:03 gibba020 bash[9782]: audit 2021-03-10T13:45:03.181167+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724053\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724119\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724152\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724183\", \"created\": \"2021-03-10T13:44:55.289466\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}}, \"last_daemon_update\": \"2021-03-10T13:44:55.724239\", \"last_device_update\": \"2021-03-10T13:45:03.180657\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:45:03.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:03 gibba020 bash[9782]: audit 2021-03-10T13:45:03.188237+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724053\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724119\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724152\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724183\", \"created\": \"2021-03-10T13:44:55.289466\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}}, \"last_daemon_update\": \"2021-03-10T13:44:55.724239\", \"last_device_update\": \"2021-03-10T13:45:03.180657\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:45:04.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:04 gibba020 bash[9782]: cluster 2021-03-10T13:45:02.570909+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:45:04.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:04 gibba020 bash[9782]: cluster 2021-03-10T13:45:02.571007+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:45:04.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:04 gibba020 bash[9782]: audit 2021-03-10T13:45:03.412670+0000 mon.a (mon.0) 215 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]': finished 2021-03-10T13:45:04.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:04 gibba020 bash[9782]: cluster 2021-03-10T13:45:03.412707+0000 mon.a (mon.0) 216 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2021-03-10T13:45:04.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:04 gibba020 bash[9782]: audit 2021-03-10T13:45:03.413232+0000 mon.a (mon.0) 217 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:45:04.784 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:04 gibba013 bash[9767]: cluster 2021-03-10T13:45:02.570909+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:45:04.785 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:04 gibba013 bash[9767]: cluster 2021-03-10T13:45:02.571007+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:45:04.785 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:04 gibba013 bash[9767]: audit 2021-03-10T13:45:03.412670+0000 mon.a (mon.0) 215 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]': finished 2021-03-10T13:45:04.785 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:04 gibba013 bash[9767]: cluster 2021-03-10T13:45:03.412707+0000 mon.a (mon.0) 216 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2021-03-10T13:45:04.786 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:04 gibba013 bash[9767]: audit 2021-03-10T13:45:03.413232+0000 mon.a (mon.0) 217 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:45:04.786 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:04 gibba013 bash[13024]: cluster 2021-03-10T13:45:02.570909+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:45:04.786 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:04 gibba013 bash[13024]: cluster 2021-03-10T13:45:02.571007+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:45:04.787 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:04 gibba013 bash[13024]: audit 2021-03-10T13:45:03.412670+0000 mon.a (mon.0) 215 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]': finished 2021-03-10T13:45:04.787 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:04 gibba013 bash[13024]: cluster 2021-03-10T13:45:03.412707+0000 mon.a (mon.0) 216 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2021-03-10T13:45:04.787 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:04 gibba013 bash[13024]: audit 2021-03-10T13:45:03.413232+0000 mon.a (mon.0) 217 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:45:05.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:05 gibba013 bash[9767]: cluster 2021-03-10T13:45:04.400635+0000 mgr.y (mgr.14140) 58 : cluster [DBG] pgmap v46: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:45:05.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:05 gibba013 bash[9767]: cluster 2021-03-10T13:45:04.425503+0000 mon.a (mon.0) 218 : cluster [INF] osd.0 [v2:172.21.2.113:6802/1746855808,v1:172.21.2.113:6803/1746855808] boot 2021-03-10T13:45:05.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:05 gibba013 bash[9767]: cluster 2021-03-10T13:45:04.425523+0000 mon.a (mon.0) 219 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2021-03-10T13:45:05.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:05 gibba013 bash[9767]: audit 2021-03-10T13:45:04.426098+0000 mon.a (mon.0) 220 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:45:05.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:05 gibba013 bash[9767]: audit 2021-03-10T13:45:05.069411+0000 mgr.y (mgr.14140) 59 : audit [DBG] from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba013:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:45:05.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:05 gibba013 bash[9767]: cephadm 2021-03-10T13:45:05.069873+0000 mgr.y (mgr.14140) 60 : cephadm [INF] Applying osd on host gibba013... 2021-03-10T13:45:05.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:05 gibba013 bash[9767]: audit 2021-03-10T13:45:05.070144+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:45:05.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:05 gibba013 bash[9767]: audit 2021-03-10T13:45:05.071184+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:45:05.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:05 gibba013 bash[9767]: audit 2021-03-10T13:45:05.072281+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:45:05.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:05 gibba013 bash[9767]: cluster 2021-03-10T13:45:05.423107+0000 mon.a (mon.0) 224 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2021-03-10T13:45:05.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:05 gibba013 bash[13024]: cluster 2021-03-10T13:45:04.400635+0000 mgr.y (mgr.14140) 58 : cluster [DBG] pgmap v46: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:45:05.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:05 gibba013 bash[13024]: cluster 2021-03-10T13:45:04.425503+0000 mon.a (mon.0) 218 : cluster [INF] osd.0 [v2:172.21.2.113:6802/1746855808,v1:172.21.2.113:6803/1746855808] boot 2021-03-10T13:45:05.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:05 gibba013 bash[13024]: cluster 2021-03-10T13:45:04.425523+0000 mon.a (mon.0) 219 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2021-03-10T13:45:05.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:05 gibba013 bash[13024]: audit 2021-03-10T13:45:04.426098+0000 mon.a (mon.0) 220 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:45:05.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:05 gibba013 bash[13024]: audit 2021-03-10T13:45:05.069411+0000 mgr.y (mgr.14140) 59 : audit [DBG] from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba013:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:45:05.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:05 gibba013 bash[13024]: cephadm 2021-03-10T13:45:05.069873+0000 mgr.y (mgr.14140) 60 : cephadm [INF] Applying osd on host gibba013... 2021-03-10T13:45:05.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:05 gibba013 bash[13024]: audit 2021-03-10T13:45:05.070144+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:45:05.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:05 gibba013 bash[13024]: audit 2021-03-10T13:45:05.071184+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:45:05.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:05 gibba013 bash[13024]: audit 2021-03-10T13:45:05.072281+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:45:05.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:05 gibba013 bash[13024]: cluster 2021-03-10T13:45:05.423107+0000 mon.a (mon.0) 224 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2021-03-10T13:45:05.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:05 gibba020 bash[9782]: cluster 2021-03-10T13:45:04.400635+0000 mgr.y (mgr.14140) 58 : cluster [DBG] pgmap v46: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T13:45:05.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:05 gibba020 bash[9782]: cluster 2021-03-10T13:45:04.425503+0000 mon.a (mon.0) 218 : cluster [INF] osd.0 [v2:172.21.2.113:6802/1746855808,v1:172.21.2.113:6803/1746855808] boot 2021-03-10T13:45:05.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:05 gibba020 bash[9782]: cluster 2021-03-10T13:45:04.425523+0000 mon.a (mon.0) 219 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2021-03-10T13:45:05.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:05 gibba020 bash[9782]: audit 2021-03-10T13:45:04.426098+0000 mon.a (mon.0) 220 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:45:05.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:05 gibba020 bash[9782]: audit 2021-03-10T13:45:05.069411+0000 mgr.y (mgr.14140) 59 : audit [DBG] from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba013:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:45:05.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:05 gibba020 bash[9782]: cephadm 2021-03-10T13:45:05.069873+0000 mgr.y (mgr.14140) 60 : cephadm [INF] Applying osd on host gibba013... 2021-03-10T13:45:05.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:05 gibba020 bash[9782]: audit 2021-03-10T13:45:05.070144+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:45:05.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:05 gibba020 bash[9782]: audit 2021-03-10T13:45:05.071184+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:45:05.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:05 gibba020 bash[9782]: audit 2021-03-10T13:45:05.072281+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:45:05.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:05 gibba020 bash[9782]: cluster 2021-03-10T13:45:05.423107+0000 mon.a (mon.0) 224 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2021-03-10T13:45:07.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:07 gibba013 bash[9767]: cluster 2021-03-10T13:45:06.401455+0000 mgr.y (mgr.14140) 61 : cluster [DBG] pgmap v49: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:45:07.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:07 gibba013 bash[9767]: cluster 2021-03-10T13:45:06.431914+0000 mon.a (mon.0) 225 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2021-03-10T13:45:07.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:07 gibba013 bash[9767]: cluster 2021-03-10T13:45:06.432280+0000 mon.a (mon.0) 226 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T13:45:07.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:07 gibba013 bash[13024]: cluster 2021-03-10T13:45:06.401455+0000 mgr.y (mgr.14140) 61 : cluster [DBG] pgmap v49: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:45:07.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:07 gibba013 bash[13024]: cluster 2021-03-10T13:45:06.431914+0000 mon.a (mon.0) 225 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2021-03-10T13:45:07.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:07 gibba013 bash[13024]: cluster 2021-03-10T13:45:06.432280+0000 mon.a (mon.0) 226 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T13:45:07.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:07 gibba020 bash[9782]: cluster 2021-03-10T13:45:06.401455+0000 mgr.y (mgr.14140) 61 : cluster [DBG] pgmap v49: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:45:07.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:07 gibba020 bash[9782]: cluster 2021-03-10T13:45:06.431914+0000 mon.a (mon.0) 225 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2021-03-10T13:45:07.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:07 gibba020 bash[9782]: cluster 2021-03-10T13:45:06.432280+0000 mon.a (mon.0) 226 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T13:45:08.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:08 gibba020 bash[9782]: audit 2021-03-10T13:45:07.953817+0000 mon.c (mon.1) 5 : audit [INF] from='client.? 172.21.2.113:0/3424950480' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc"}]: dispatch 2021-03-10T13:45:08.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:08 gibba020 bash[9782]: audit 2021-03-10T13:45:07.954154+0000 mon.a (mon.0) 227 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc"}]: dispatch 2021-03-10T13:45:08.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:08 gibba020 bash[9782]: audit 2021-03-10T13:45:07.958968+0000 mon.a (mon.0) 228 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc"}]': finished 2021-03-10T13:45:08.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:08 gibba020 bash[9782]: cluster 2021-03-10T13:45:07.958992+0000 mon.a (mon.0) 229 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2021-03-10T13:45:08.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:08 gibba020 bash[9782]: audit 2021-03-10T13:45:07.959169+0000 mon.a (mon.0) 230 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:45:08.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:08 gibba013 bash[9767]: audit 2021-03-10T13:45:07.953817+0000 mon.c (mon.1) 5 : audit [INF] from='client.? 172.21.2.113:0/3424950480' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc"}]: dispatch 2021-03-10T13:45:08.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:08 gibba013 bash[9767]: audit 2021-03-10T13:45:07.954154+0000 mon.a (mon.0) 227 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc"}]: dispatch 2021-03-10T13:45:08.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:08 gibba013 bash[9767]: audit 2021-03-10T13:45:07.958968+0000 mon.a (mon.0) 228 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc"}]': finished 2021-03-10T13:45:08.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:08 gibba013 bash[9767]: cluster 2021-03-10T13:45:07.958992+0000 mon.a (mon.0) 229 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2021-03-10T13:45:08.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:08 gibba013 bash[9767]: audit 2021-03-10T13:45:07.959169+0000 mon.a (mon.0) 230 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:45:08.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:08 gibba013 bash[13024]: audit 2021-03-10T13:45:07.953817+0000 mon.c (mon.1) 5 : audit [INF] from='client.? 172.21.2.113:0/3424950480' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc"}]: dispatch 2021-03-10T13:45:08.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:08 gibba013 bash[13024]: audit 2021-03-10T13:45:07.954154+0000 mon.a (mon.0) 227 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc"}]: dispatch 2021-03-10T13:45:08.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:08 gibba013 bash[13024]: audit 2021-03-10T13:45:07.958968+0000 mon.a (mon.0) 228 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc"}]': finished 2021-03-10T13:45:08.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:08 gibba013 bash[13024]: cluster 2021-03-10T13:45:07.958992+0000 mon.a (mon.0) 229 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2021-03-10T13:45:08.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:08 gibba013 bash[13024]: audit 2021-03-10T13:45:07.959169+0000 mon.a (mon.0) 230 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:45:10.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:09 gibba013 bash[9767]: cluster 2021-03-10T13:45:08.401938+0000 mgr.y (mgr.14140) 62 : cluster [DBG] pgmap v52: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:45:10.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:09 gibba013 bash[9767]: audit 2021-03-10T13:45:09.928898+0000 mon.a (mon.0) 231 : audit [DBG] from='client.? 172.21.2.113:0/2909533616' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:45:10.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:09 gibba013 bash[13024]: cluster 2021-03-10T13:45:08.401938+0000 mgr.y (mgr.14140) 62 : cluster [DBG] pgmap v52: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:45:10.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:09 gibba013 bash[13024]: audit 2021-03-10T13:45:09.928898+0000 mon.a (mon.0) 231 : audit [DBG] from='client.? 172.21.2.113:0/2909533616' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:45:10.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:09 gibba020 bash[9782]: cluster 2021-03-10T13:45:08.401938+0000 mgr.y (mgr.14140) 62 : cluster [DBG] pgmap v52: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:45:10.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:09 gibba020 bash[9782]: audit 2021-03-10T13:45:09.928898+0000 mon.a (mon.0) 231 : audit [DBG] from='client.? 172.21.2.113:0/2909533616' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:45:11.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:11 gibba020 bash[9782]: cluster 2021-03-10T13:45:10.402635+0000 mgr.y (mgr.14140) 63 : cluster [DBG] pgmap v53: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:45:11.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:11 gibba013 bash[9767]: cluster 2021-03-10T13:45:10.402635+0000 mgr.y (mgr.14140) 63 : cluster [DBG] pgmap v53: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:45:11.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:11 gibba013 bash[13024]: cluster 2021-03-10T13:45:10.402635+0000 mgr.y (mgr.14140) 63 : cluster [DBG] pgmap v53: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:45:12.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:12 gibba013 bash[9767]: cluster 2021-03-10T13:45:12.455237+0000 mon.a (mon.0) 232 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-03-10T13:45:12.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:12 gibba013 bash[13024]: cluster 2021-03-10T13:45:12.455237+0000 mon.a (mon.0) 232 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-03-10T13:45:12.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:12 gibba020 bash[9782]: cluster 2021-03-10T13:45:12.455237+0000 mon.a (mon.0) 232 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-03-10T13:45:13.670 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:13 gibba013 bash[9767]: cluster 2021-03-10T13:45:12.403448+0000 mgr.y (mgr.14140) 64 : cluster [DBG] pgmap v54: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:45:13.671 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:13 gibba013 bash[9767]: audit 2021-03-10T13:45:12.554376+0000 mon.a (mon.0) 233 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:45:13.671 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:13 gibba013 bash[13024]: cluster 2021-03-10T13:45:12.403448+0000 mgr.y (mgr.14140) 64 : cluster [DBG] pgmap v54: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:45:13.671 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:13 gibba013 bash[13024]: audit 2021-03-10T13:45:12.554376+0000 mon.a (mon.0) 233 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:45:13.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:13 gibba020 bash[9782]: cluster 2021-03-10T13:45:12.403448+0000 mgr.y (mgr.14140) 64 : cluster [DBG] pgmap v54: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:45:13.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:13 gibba020 bash[9782]: audit 2021-03-10T13:45:12.554376+0000 mon.a (mon.0) 233 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:45:15.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:15 gibba013 bash[9767]: cluster 2021-03-10T13:45:14.404146+0000 mgr.y (mgr.14140) 65 : cluster [DBG] pgmap v55: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:45:15.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:15 gibba013 bash[13024]: cluster 2021-03-10T13:45:14.404146+0000 mgr.y (mgr.14140) 65 : cluster [DBG] pgmap v55: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:45:15.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:15 gibba020 bash[9782]: cluster 2021-03-10T13:45:14.404146+0000 mgr.y (mgr.14140) 65 : cluster [DBG] pgmap v55: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:45:16.803 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:16 gibba013 bash[9767]: audit 2021-03-10T13:45:15.698905+0000 mon.a (mon.0) 234 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-03-10T13:45:16.804 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:16 gibba013 bash[9767]: audit 2021-03-10T13:45:15.699884+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:45:16.804 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:16 gibba013 bash[9767]: cephadm 2021-03-10T13:45:15.700549+0000 mgr.y (mgr.14140) 66 : cephadm [INF] Deploying daemon osd.1 on gibba013 2021-03-10T13:45:16.804 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:16 gibba013 bash[9767]: audit 2021-03-10T13:45:15.700765+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2021-03-10T13:45:16.805 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:16 gibba013 bash[13024]: audit 2021-03-10T13:45:15.698905+0000 mon.a (mon.0) 234 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-03-10T13:45:16.805 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:16 gibba013 bash[13024]: audit 2021-03-10T13:45:15.699884+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:45:16.805 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:16 gibba013 bash[13024]: cephadm 2021-03-10T13:45:15.700549+0000 mgr.y (mgr.14140) 66 : cephadm [INF] Deploying daemon osd.1 on gibba013 2021-03-10T13:45:16.805 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:16 gibba013 bash[13024]: audit 2021-03-10T13:45:15.700765+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2021-03-10T13:45:16.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:16 gibba020 bash[9782]: audit 2021-03-10T13:45:15.698905+0000 mon.a (mon.0) 234 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-03-10T13:45:16.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:16 gibba020 bash[9782]: audit 2021-03-10T13:45:15.699884+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:45:16.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:16 gibba020 bash[9782]: cephadm 2021-03-10T13:45:15.700549+0000 mgr.y (mgr.14140) 66 : cephadm [INF] Deploying daemon osd.1 on gibba013 2021-03-10T13:45:16.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:16 gibba020 bash[9782]: audit 2021-03-10T13:45:15.700765+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2021-03-10T13:45:17.402 INFO:teuthology.orchestra.run.gibba013.stdout:Created osd(s) 1 on host 'gibba013' 2021-03-10T13:45:17.776 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:17 gibba013 bash[9767]: cluster 2021-03-10T13:45:16.404968+0000 mgr.y (mgr.14140) 67 : cluster [DBG] pgmap v56: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:45:17.776 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:17 gibba013 bash[9767]: audit 2021-03-10T13:45:17.395684+0000 mon.a (mon.0) 237 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724053\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724119\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724152\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724183\", \"created\": \"2021-03-10T13:44:55.289466\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}}, \"last_device_update\": \"2021-03-10T13:45:03.180657\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:45:17.777 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:17 gibba013 bash[9767]: audit 2021-03-10T13:45:17.396159+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:45:17.777 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:17 gibba013 bash[9767]: audit 2021-03-10T13:45:17.399277+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724053\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724119\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724152\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724183\", \"created\": \"2021-03-10T13:44:55.289466\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}}, \"last_device_update\": \"2021-03-10T13:45:03.180657\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:45:17.778 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:17 gibba013 bash[13024]: cluster 2021-03-10T13:45:16.404968+0000 mgr.y (mgr.14140) 67 : cluster [DBG] pgmap v56: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:45:17.778 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:17 gibba013 bash[13024]: audit 2021-03-10T13:45:17.395684+0000 mon.a (mon.0) 237 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724053\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724119\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724152\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724183\", \"created\": \"2021-03-10T13:44:55.289466\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}}, \"last_device_update\": \"2021-03-10T13:45:03.180657\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:45:17.778 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:17 gibba013 bash[13024]: audit 2021-03-10T13:45:17.396159+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:45:17.778 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:17 gibba013 bash[13024]: audit 2021-03-10T13:45:17.399277+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724053\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724119\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724152\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724183\", \"created\": \"2021-03-10T13:44:55.289466\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}}, \"last_device_update\": \"2021-03-10T13:45:03.180657\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:45:17.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:17 gibba020 bash[9782]: cluster 2021-03-10T13:45:16.404968+0000 mgr.y (mgr.14140) 67 : cluster [DBG] pgmap v56: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:45:17.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:17 gibba020 bash[9782]: audit 2021-03-10T13:45:17.395684+0000 mon.a (mon.0) 237 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724053\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724119\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724152\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724183\", \"created\": \"2021-03-10T13:44:55.289466\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}}, \"last_device_update\": \"2021-03-10T13:45:03.180657\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:45:17.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:17 gibba020 bash[9782]: audit 2021-03-10T13:45:17.396159+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:45:17.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:17 gibba020 bash[9782]: audit 2021-03-10T13:45:17.399277+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724053\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724119\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724152\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:55.724183\", \"created\": \"2021-03-10T13:44:55.289466\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}}, \"last_device_update\": \"2021-03-10T13:45:03.180657\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:45:18.544 DEBUG:teuthology.orchestra.run.gibba013:osd.1> sudo journalctl -f -n 0 -u ceph-7672acc8-81a6-11eb-9080-001a4aab830c@osd.1.service 2021-03-10T13:45:18.546 INFO:tasks.cephadm:Deploying osd.2 on gibba013 with /dev/vg_nvme/lv_2... 2021-03-10T13:45:18.547 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2021-03-10T13:45:18.619 INFO:journalctl@ceph.osd.1.gibba013.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:45:18.913 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:18 gibba013 bash[9767]: audit 2021-03-10T13:45:17.867655+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.866928\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.866987\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867016\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867042\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867069\", \"created\": \"2021-03-10T13:45:17.385465\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}}, \"last_daemon_update\": \"2021-03-10T13:45:17.867117\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:45:18.913 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:18 gibba013 bash[9767]: audit 2021-03-10T13:45:17.876266+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.866928\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.866987\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867016\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867042\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867069\", \"created\": \"2021-03-10T13:45:17.385465\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}}, \"last_daemon_update\": \"2021-03-10T13:45:17.867117\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:45:18.913 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:18 gibba013 bash[9767]: audit 2021-03-10T13:45:17.876925+0000 mon.a (mon.0) 242 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:45:18.914 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:18 gibba013 bash[13024]: audit 2021-03-10T13:45:17.867655+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.866928\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.866987\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867016\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867042\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867069\", \"created\": \"2021-03-10T13:45:17.385465\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}}, \"last_daemon_update\": \"2021-03-10T13:45:17.867117\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:45:18.914 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:18 gibba013 bash[13024]: audit 2021-03-10T13:45:17.876266+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.866928\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.866987\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867016\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867042\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867069\", \"created\": \"2021-03-10T13:45:17.385465\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}}, \"last_daemon_update\": \"2021-03-10T13:45:17.867117\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:45:18.914 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:18 gibba013 bash[13024]: audit 2021-03-10T13:45:17.876925+0000 mon.a (mon.0) 242 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:45:18.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:18 gibba020 bash[9782]: audit 2021-03-10T13:45:17.867655+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.866928\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.866987\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867016\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867042\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867069\", \"created\": \"2021-03-10T13:45:17.385465\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}}, \"last_daemon_update\": \"2021-03-10T13:45:17.867117\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:45:18.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:18 gibba020 bash[9782]: audit 2021-03-10T13:45:17.876266+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.866928\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.866987\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867016\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867042\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867069\", \"created\": \"2021-03-10T13:45:17.385465\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}}, \"last_daemon_update\": \"2021-03-10T13:45:17.867117\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:45:18.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:18 gibba020 bash[9782]: audit 2021-03-10T13:45:17.876925+0000 mon.a (mon.0) 242 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:45:19.763 INFO:journalctl@ceph.osd.1.gibba013.stdout:Mar 10 13:45:19 gibba013 bash[16069]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-03-10T13:45:19.763 INFO:journalctl@ceph.osd.1.gibba013.stdout:Mar 10 13:45:19 gibba013 bash[16069]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2021-03-10T13:45:19.764 INFO:journalctl@ceph.osd.1.gibba013.stdout:Mar 10 13:45:19 gibba013 bash[16069]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2021-03-10T13:45:19.764 INFO:journalctl@ceph.osd.1.gibba013.stdout:Mar 10 13:45:19 gibba013 bash[16069]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2021-03-10T13:45:19.764 INFO:journalctl@ceph.osd.1.gibba013.stdout:Mar 10 13:45:19 gibba013 bash[16069]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2021-03-10T13:45:19.764 INFO:journalctl@ceph.osd.1.gibba013.stdout:Mar 10 13:45:19 gibba013 bash[16069]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-03-10T13:45:19.764 INFO:journalctl@ceph.osd.1.gibba013.stdout:Mar 10 13:45:19 gibba013 bash[16069]: --> ceph-volume lvm activate successful for osd ID: 1 2021-03-10T13:45:20.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:19 gibba013 bash[9767]: cluster 2021-03-10T13:45:18.405790+0000 mgr.y (mgr.14140) 68 : cluster [DBG] pgmap v57: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:45:20.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:19 gibba013 bash[13024]: cluster 2021-03-10T13:45:18.405790+0000 mgr.y (mgr.14140) 68 : cluster [DBG] pgmap v57: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:45:20.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:19 gibba020 bash[9782]: cluster 2021-03-10T13:45:18.405790+0000 mgr.y (mgr.14140) 68 : cluster [DBG] pgmap v57: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:45:21.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:21 gibba013 bash[9767]: cluster 2021-03-10T13:45:20.406688+0000 mgr.y (mgr.14140) 69 : cluster [DBG] pgmap v58: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:45:21.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:21 gibba013 bash[13024]: cluster 2021-03-10T13:45:20.406688+0000 mgr.y (mgr.14140) 69 : cluster [DBG] pgmap v58: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:45:21.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:21 gibba020 bash[9782]: cluster 2021-03-10T13:45:20.406688+0000 mgr.y (mgr.14140) 69 : cluster [DBG] pgmap v58: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:45:23.381 INFO:journalctl@ceph.osd.1.gibba013.stdout:Mar 10 13:45:23 gibba013 bash[16389]: debug 2021-03-10T13:45:23.165+0000 7f9436699ec0 -1 Falling back to public interface 2021-03-10T13:45:23.514 INFO:teuthology.orchestra.run.gibba013.stderr:--> Zapping: /dev/vg_nvme/lv_2 2021-03-10T13:45:23.514 INFO:teuthology.orchestra.run.gibba013.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2021-03-10T13:45:23.515 INFO:teuthology.orchestra.run.gibba013.stderr: stderr: 10+0 records in 2021-03-10T13:45:23.515 INFO:teuthology.orchestra.run.gibba013.stderr:10+0 records out 2021-03-10T13:45:23.515 INFO:teuthology.orchestra.run.gibba013.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0074598 s, 1.4 GB/s 2021-03-10T13:45:23.515 INFO:teuthology.orchestra.run.gibba013.stderr:--> Zapping successful for: 2021-03-10T13:45:23.835 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:23 gibba013 bash[9767]: cluster 2021-03-10T13:45:22.407419+0000 mgr.y (mgr.14140) 70 : cluster [DBG] pgmap v59: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:45:23.836 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:23 gibba013 bash[13024]: cluster 2021-03-10T13:45:22.407419+0000 mgr.y (mgr.14140) 70 : cluster [DBG] pgmap v59: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:45:23.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:23 gibba020 bash[9782]: cluster 2021-03-10T13:45:22.407419+0000 mgr.y (mgr.14140) 70 : cluster [DBG] pgmap v59: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:45:24.085 INFO:journalctl@ceph.osd.1.gibba013.stdout:Mar 10 13:45:23 gibba013 bash[16389]: debug 2021-03-10T13:45:23.829+0000 7f9436699ec0 -1 osd.1 0 log_to_monitors {default=true} 2021-03-10T13:45:24.086 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph orch daemon add osd gibba013:vg_nvme/lv_2 2021-03-10T13:45:24.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:24 gibba013 bash[9767]: audit 2021-03-10T13:45:23.840188+0000 mon.c (mon.1) 6 : audit [INF] from='osd.1 [v2:172.21.2.113:6810/1501662462,v1:172.21.2.113:6811/1501662462]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T13:45:24.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:24 gibba013 bash[9767]: audit 2021-03-10T13:45:23.840875+0000 mon.a (mon.0) 243 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T13:45:24.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:24 gibba013 bash[13024]: audit 2021-03-10T13:45:23.840188+0000 mon.c (mon.1) 6 : audit [INF] from='osd.1 [v2:172.21.2.113:6810/1501662462,v1:172.21.2.113:6811/1501662462]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T13:45:24.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:24 gibba013 bash[13024]: audit 2021-03-10T13:45:23.840875+0000 mon.a (mon.0) 243 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T13:45:24.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:24 gibba020 bash[9782]: audit 2021-03-10T13:45:23.840188+0000 mon.c (mon.1) 6 : audit [INF] from='osd.1 [v2:172.21.2.113:6810/1501662462,v1:172.21.2.113:6811/1501662462]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T13:45:24.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:24 gibba020 bash[9782]: audit 2021-03-10T13:45:23.840875+0000 mon.a (mon.0) 243 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T13:45:25.522 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:25 gibba013 bash[9767]: cluster 2021-03-10T13:45:24.408220+0000 mgr.y (mgr.14140) 71 : cluster [DBG] pgmap v60: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:45:25.523 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:25 gibba013 bash[9767]: audit 2021-03-10T13:45:24.481446+0000 mon.a (mon.0) 244 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-03-10T13:45:25.882 INFO:journalctl@ceph.osd.1.gibba013.stdout:Mar 10 13:45:25 gibba013 bash[16389]: debug 2021-03-10T13:45:25.497+0000 7f941b446700 -1 osd.1 0 waiting for initial osdmap 2021-03-10T13:45:25.882 INFO:journalctl@ceph.osd.1.gibba013.stdout:Mar 10 13:45:25 gibba013 bash[16389]: debug 2021-03-10T13:45:25.509+0000 7f9426662700 -1 osd.1 15 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:45:25.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:25 gibba013 bash[9767]: cluster 2021-03-10T13:45:24.481472+0000 mon.a (mon.0) 245 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2021-03-10T13:45:25.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:25 gibba013 bash[9767]: audit 2021-03-10T13:45:24.481598+0000 mon.a (mon.0) 246 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:45:25.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:25 gibba013 bash[9767]: audit 2021-03-10T13:45:24.482008+0000 mon.c (mon.1) 7 : audit [INF] from='osd.1 [v2:172.21.2.113:6810/1501662462,v1:172.21.2.113:6811/1501662462]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:45:25.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:25 gibba013 bash[9767]: audit 2021-03-10T13:45:24.482235+0000 mon.a (mon.0) 247 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:45:25.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:25 gibba013 bash[9767]: cluster 2021-03-10T13:45:24.822489+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:45:25.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:25 gibba013 bash[9767]: cluster 2021-03-10T13:45:24.822590+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:45:25.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:25 gibba013 bash[9767]: audit 2021-03-10T13:45:25.020544+0000 mon.a (mon.0) 248 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:45:25.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:25 gibba013 bash[13024]: cluster 2021-03-10T13:45:24.408220+0000 mgr.y (mgr.14140) 71 : cluster [DBG] pgmap v60: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:45:25.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:25 gibba013 bash[13024]: audit 2021-03-10T13:45:24.481446+0000 mon.a (mon.0) 244 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-03-10T13:45:25.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:25 gibba013 bash[13024]: cluster 2021-03-10T13:45:24.481472+0000 mon.a (mon.0) 245 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2021-03-10T13:45:25.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:25 gibba013 bash[13024]: audit 2021-03-10T13:45:24.481598+0000 mon.a (mon.0) 246 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:45:25.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:25 gibba013 bash[13024]: audit 2021-03-10T13:45:24.482008+0000 mon.c (mon.1) 7 : audit [INF] from='osd.1 [v2:172.21.2.113:6810/1501662462,v1:172.21.2.113:6811/1501662462]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:45:25.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:25 gibba013 bash[13024]: audit 2021-03-10T13:45:24.482235+0000 mon.a (mon.0) 247 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:45:25.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:25 gibba013 bash[13024]: cluster 2021-03-10T13:45:24.822489+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:45:25.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:25 gibba013 bash[13024]: cluster 2021-03-10T13:45:24.822590+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:45:25.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:25 gibba013 bash[13024]: audit 2021-03-10T13:45:25.020544+0000 mon.a (mon.0) 248 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:45:25.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:25 gibba013 bash[9767]: audit 2021-03-10T13:45:25.118091+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.866928\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.866987\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867016\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867042\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867069\", \"created\": \"2021-03-10T13:45:17.385465\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}}, \"last_daemon_update\": \"2021-03-10T13:45:17.867117\", \"last_device_update\": \"2021-03-10T13:45:25.117481\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:45:25.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:25 gibba013 bash[9767]: audit 2021-03-10T13:45:25.122292+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.866928\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.866987\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867016\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867042\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867069\", \"created\": \"2021-03-10T13:45:17.385465\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}}, \"last_daemon_update\": \"2021-03-10T13:45:17.867117\", \"last_device_update\": \"2021-03-10T13:45:25.117481\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:45:25.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:25 gibba013 bash[13024]: audit 2021-03-10T13:45:25.118091+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.866928\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.866987\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867016\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867042\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867069\", \"created\": \"2021-03-10T13:45:17.385465\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}}, \"last_daemon_update\": \"2021-03-10T13:45:17.867117\", \"last_device_update\": \"2021-03-10T13:45:25.117481\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:45:25.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:25 gibba013 bash[13024]: audit 2021-03-10T13:45:25.122292+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.866928\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.866987\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867016\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867042\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867069\", \"created\": \"2021-03-10T13:45:17.385465\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}}, \"last_daemon_update\": \"2021-03-10T13:45:17.867117\", \"last_device_update\": \"2021-03-10T13:45:25.117481\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:45:25.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:25 gibba020 bash[9782]: cluster 2021-03-10T13:45:24.408220+0000 mgr.y (mgr.14140) 71 : cluster [DBG] pgmap v60: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:45:25.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:25 gibba020 bash[9782]: audit 2021-03-10T13:45:24.481446+0000 mon.a (mon.0) 244 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-03-10T13:45:25.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:25 gibba020 bash[9782]: cluster 2021-03-10T13:45:24.481472+0000 mon.a (mon.0) 245 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2021-03-10T13:45:25.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:25 gibba020 bash[9782]: audit 2021-03-10T13:45:24.481598+0000 mon.a (mon.0) 246 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:45:25.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:25 gibba020 bash[9782]: audit 2021-03-10T13:45:24.482008+0000 mon.c (mon.1) 7 : audit [INF] from='osd.1 [v2:172.21.2.113:6810/1501662462,v1:172.21.2.113:6811/1501662462]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:45:25.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:25 gibba020 bash[9782]: audit 2021-03-10T13:45:24.482235+0000 mon.a (mon.0) 247 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:45:25.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:25 gibba020 bash[9782]: cluster 2021-03-10T13:45:24.822489+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:45:25.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:25 gibba020 bash[9782]: cluster 2021-03-10T13:45:24.822590+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:45:25.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:25 gibba020 bash[9782]: audit 2021-03-10T13:45:25.020544+0000 mon.a (mon.0) 248 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:45:25.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:25 gibba020 bash[9782]: audit 2021-03-10T13:45:25.118091+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.866928\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.866987\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867016\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867042\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867069\", \"created\": \"2021-03-10T13:45:17.385465\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}}, \"last_daemon_update\": \"2021-03-10T13:45:17.867117\", \"last_device_update\": \"2021-03-10T13:45:25.117481\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:45:25.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:25 gibba020 bash[9782]: audit 2021-03-10T13:45:25.122292+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.866928\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.866987\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867016\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867042\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867069\", \"created\": \"2021-03-10T13:45:17.385465\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}}, \"last_daemon_update\": \"2021-03-10T13:45:17.867117\", \"last_device_update\": \"2021-03-10T13:45:25.117481\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:45:26.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:26 gibba013 bash[9767]: audit 2021-03-10T13:45:25.487044+0000 mon.a (mon.0) 251 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]': finished 2021-03-10T13:45:26.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:26 gibba013 bash[9767]: cluster 2021-03-10T13:45:25.487206+0000 mon.a (mon.0) 252 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2021-03-10T13:45:26.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:26 gibba013 bash[9767]: audit 2021-03-10T13:45:25.488558+0000 mon.a (mon.0) 253 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:45:26.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:26 gibba013 bash[13024]: audit 2021-03-10T13:45:25.487044+0000 mon.a (mon.0) 251 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]': finished 2021-03-10T13:45:26.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:26 gibba013 bash[13024]: cluster 2021-03-10T13:45:25.487206+0000 mon.a (mon.0) 252 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2021-03-10T13:45:26.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:26 gibba013 bash[13024]: audit 2021-03-10T13:45:25.488558+0000 mon.a (mon.0) 253 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:45:26.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:26 gibba020 bash[9782]: audit 2021-03-10T13:45:25.487044+0000 mon.a (mon.0) 251 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]': finished 2021-03-10T13:45:26.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:26 gibba020 bash[9782]: cluster 2021-03-10T13:45:25.487206+0000 mon.a (mon.0) 252 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2021-03-10T13:45:26.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:26 gibba020 bash[9782]: audit 2021-03-10T13:45:25.488558+0000 mon.a (mon.0) 253 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:45:27.860 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:27 gibba013 bash[9767]: cluster 2021-03-10T13:45:26.408713+0000 mgr.y (mgr.14140) 72 : cluster [DBG] pgmap v63: 1 pgs: 1 undersized+peered; 0 B data, 128 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:45:27.860 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:27 gibba013 bash[9767]: cluster 2021-03-10T13:45:26.504976+0000 mon.a (mon.0) 254 : cluster [INF] osd.1 [v2:172.21.2.113:6810/1501662462,v1:172.21.2.113:6811/1501662462] boot 2021-03-10T13:45:27.860 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:27 gibba013 bash[9767]: cluster 2021-03-10T13:45:26.505009+0000 mon.a (mon.0) 255 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2021-03-10T13:45:27.861 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:27 gibba013 bash[9767]: audit 2021-03-10T13:45:26.505177+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:45:27.861 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:27 gibba013 bash[9767]: audit 2021-03-10T13:45:26.957747+0000 mgr.y (mgr.14140) 73 : audit [DBG] from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba013:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:45:27.861 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:27 gibba013 bash[9767]: cephadm 2021-03-10T13:45:26.958198+0000 mgr.y (mgr.14140) 74 : cephadm [INF] Applying osd on host gibba013... 2021-03-10T13:45:27.861 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:27 gibba013 bash[9767]: audit 2021-03-10T13:45:26.958445+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:45:27.861 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:27 gibba013 bash[9767]: audit 2021-03-10T13:45:26.959283+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:45:27.862 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:27 gibba013 bash[9767]: audit 2021-03-10T13:45:26.960262+0000 mon.a (mon.0) 259 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:45:27.862 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:27 gibba013 bash[13024]: cluster 2021-03-10T13:45:26.408713+0000 mgr.y (mgr.14140) 72 : cluster [DBG] pgmap v63: 1 pgs: 1 undersized+peered; 0 B data, 128 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:45:27.862 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:27 gibba013 bash[13024]: cluster 2021-03-10T13:45:26.504976+0000 mon.a (mon.0) 254 : cluster [INF] osd.1 [v2:172.21.2.113:6810/1501662462,v1:172.21.2.113:6811/1501662462] boot 2021-03-10T13:45:27.862 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:27 gibba013 bash[13024]: cluster 2021-03-10T13:45:26.505009+0000 mon.a (mon.0) 255 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2021-03-10T13:45:27.863 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:27 gibba013 bash[13024]: audit 2021-03-10T13:45:26.505177+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:45:27.863 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:27 gibba013 bash[13024]: audit 2021-03-10T13:45:26.957747+0000 mgr.y (mgr.14140) 73 : audit [DBG] from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba013:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:45:27.863 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:27 gibba013 bash[13024]: cephadm 2021-03-10T13:45:26.958198+0000 mgr.y (mgr.14140) 74 : cephadm [INF] Applying osd on host gibba013... 2021-03-10T13:45:27.863 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:27 gibba013 bash[13024]: audit 2021-03-10T13:45:26.958445+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:45:27.863 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:27 gibba013 bash[13024]: audit 2021-03-10T13:45:26.959283+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:45:27.864 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:27 gibba013 bash[13024]: audit 2021-03-10T13:45:26.960262+0000 mon.a (mon.0) 259 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:45:27.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:27 gibba020 bash[9782]: cluster 2021-03-10T13:45:26.408713+0000 mgr.y (mgr.14140) 72 : cluster [DBG] pgmap v63: 1 pgs: 1 undersized+peered; 0 B data, 128 KiB used, 83 GiB / 84 GiB avail 2021-03-10T13:45:27.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:27 gibba020 bash[9782]: cluster 2021-03-10T13:45:26.504976+0000 mon.a (mon.0) 254 : cluster [INF] osd.1 [v2:172.21.2.113:6810/1501662462,v1:172.21.2.113:6811/1501662462] boot 2021-03-10T13:45:27.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:27 gibba020 bash[9782]: cluster 2021-03-10T13:45:26.505009+0000 mon.a (mon.0) 255 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2021-03-10T13:45:27.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:27 gibba020 bash[9782]: audit 2021-03-10T13:45:26.505177+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:45:27.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:27 gibba020 bash[9782]: audit 2021-03-10T13:45:26.957747+0000 mgr.y (mgr.14140) 73 : audit [DBG] from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba013:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:45:27.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:27 gibba020 bash[9782]: cephadm 2021-03-10T13:45:26.958198+0000 mgr.y (mgr.14140) 74 : cephadm [INF] Applying osd on host gibba013... 2021-03-10T13:45:27.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:27 gibba020 bash[9782]: audit 2021-03-10T13:45:26.958445+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:45:27.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:27 gibba020 bash[9782]: audit 2021-03-10T13:45:26.959283+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:45:27.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:27 gibba020 bash[9782]: audit 2021-03-10T13:45:26.960262+0000 mon.a (mon.0) 259 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:45:28.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:28 gibba013 bash[9767]: cluster 2021-03-10T13:45:27.519361+0000 mon.a (mon.0) 260 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2021-03-10T13:45:28.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:28 gibba013 bash[9767]: audit 2021-03-10T13:45:27.560313+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20210310-134326"}]: dispatch 2021-03-10T13:45:28.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:28 gibba013 bash[9767]: audit 2021-03-10T13:45:27.568888+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20210310-134326"}]': finished 2021-03-10T13:45:28.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:28 gibba013 bash[13024]: cluster 2021-03-10T13:45:27.519361+0000 mon.a (mon.0) 260 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2021-03-10T13:45:28.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:28 gibba013 bash[13024]: audit 2021-03-10T13:45:27.560313+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20210310-134326"}]: dispatch 2021-03-10T13:45:28.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:28 gibba013 bash[13024]: audit 2021-03-10T13:45:27.568888+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20210310-134326"}]': finished 2021-03-10T13:45:28.944 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:28 gibba020 bash[9782]: cluster 2021-03-10T13:45:27.519361+0000 mon.a (mon.0) 260 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2021-03-10T13:45:28.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:28 gibba020 bash[9782]: audit 2021-03-10T13:45:27.560313+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20210310-134326"}]: dispatch 2021-03-10T13:45:28.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:28 gibba020 bash[9782]: audit 2021-03-10T13:45:27.568888+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20210310-134326"}]': finished 2021-03-10T13:45:29.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:29 gibba013 bash[9767]: cluster 2021-03-10T13:45:28.409388+0000 mgr.y (mgr.14140) 75 : cluster [DBG] pgmap v66: 1 pgs: 1 undersized+peered; 0 B data, 272 KiB used, 166 GiB / 168 GiB avail 2021-03-10T13:45:29.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:29 gibba013 bash[13024]: cluster 2021-03-10T13:45:28.409388+0000 mgr.y (mgr.14140) 75 : cluster [DBG] pgmap v66: 1 pgs: 1 undersized+peered; 0 B data, 272 KiB used, 166 GiB / 168 GiB avail 2021-03-10T13:45:29.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:29 gibba020 bash[9782]: cluster 2021-03-10T13:45:28.409388+0000 mgr.y (mgr.14140) 75 : cluster [DBG] pgmap v66: 1 pgs: 1 undersized+peered; 0 B data, 272 KiB used, 166 GiB / 168 GiB avail 2021-03-10T13:45:30.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:30 gibba013 bash[9767]: audit 2021-03-10T13:45:29.934721+0000 mon.c (mon.1) 8 : audit [INF] from='client.? 172.21.2.113:0/30872310' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "13edbbb8-76dd-40bc-bb99-7e4b3612e855"}]: dispatch 2021-03-10T13:45:30.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:30 gibba013 bash[9767]: audit 2021-03-10T13:45:29.935050+0000 mon.a (mon.0) 263 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "13edbbb8-76dd-40bc-bb99-7e4b3612e855"}]: dispatch 2021-03-10T13:45:30.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:30 gibba013 bash[9767]: audit 2021-03-10T13:45:29.939896+0000 mon.a (mon.0) 264 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "13edbbb8-76dd-40bc-bb99-7e4b3612e855"}]': finished 2021-03-10T13:45:30.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:30 gibba013 bash[9767]: cluster 2021-03-10T13:45:29.939917+0000 mon.a (mon.0) 265 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2021-03-10T13:45:30.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:30 gibba013 bash[9767]: audit 2021-03-10T13:45:29.940010+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:45:30.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:30 gibba013 bash[13024]: audit 2021-03-10T13:45:29.934721+0000 mon.c (mon.1) 8 : audit [INF] from='client.? 172.21.2.113:0/30872310' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "13edbbb8-76dd-40bc-bb99-7e4b3612e855"}]: dispatch 2021-03-10T13:45:30.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:30 gibba013 bash[13024]: audit 2021-03-10T13:45:29.935050+0000 mon.a (mon.0) 263 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "13edbbb8-76dd-40bc-bb99-7e4b3612e855"}]: dispatch 2021-03-10T13:45:30.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:30 gibba013 bash[13024]: audit 2021-03-10T13:45:29.939896+0000 mon.a (mon.0) 264 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "13edbbb8-76dd-40bc-bb99-7e4b3612e855"}]': finished 2021-03-10T13:45:30.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:30 gibba013 bash[13024]: cluster 2021-03-10T13:45:29.939917+0000 mon.a (mon.0) 265 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2021-03-10T13:45:30.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:30 gibba013 bash[13024]: audit 2021-03-10T13:45:29.940010+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:45:30.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:30 gibba020 bash[9782]: audit 2021-03-10T13:45:29.934721+0000 mon.c (mon.1) 8 : audit [INF] from='client.? 172.21.2.113:0/30872310' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "13edbbb8-76dd-40bc-bb99-7e4b3612e855"}]: dispatch 2021-03-10T13:45:30.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:30 gibba020 bash[9782]: audit 2021-03-10T13:45:29.935050+0000 mon.a (mon.0) 263 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "13edbbb8-76dd-40bc-bb99-7e4b3612e855"}]: dispatch 2021-03-10T13:45:30.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:30 gibba020 bash[9782]: audit 2021-03-10T13:45:29.939896+0000 mon.a (mon.0) 264 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "13edbbb8-76dd-40bc-bb99-7e4b3612e855"}]': finished 2021-03-10T13:45:30.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:30 gibba020 bash[9782]: cluster 2021-03-10T13:45:29.939917+0000 mon.a (mon.0) 265 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2021-03-10T13:45:30.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:30 gibba020 bash[9782]: audit 2021-03-10T13:45:29.940010+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:45:31.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:31 gibba013 bash[9767]: cluster 2021-03-10T13:45:30.409868+0000 mgr.y (mgr.14140) 76 : cluster [DBG] pgmap v68: 1 pgs: 1 undersized+peered; 0 B data, 272 KiB used, 166 GiB / 168 GiB avail 2021-03-10T13:45:31.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:31 gibba013 bash[13024]: cluster 2021-03-10T13:45:30.409868+0000 mgr.y (mgr.14140) 76 : cluster [DBG] pgmap v68: 1 pgs: 1 undersized+peered; 0 B data, 272 KiB used, 166 GiB / 168 GiB avail 2021-03-10T13:45:31.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:31 gibba020 bash[9782]: cluster 2021-03-10T13:45:30.409868+0000 mgr.y (mgr.14140) 76 : cluster [DBG] pgmap v68: 1 pgs: 1 undersized+peered; 0 B data, 272 KiB used, 166 GiB / 168 GiB avail 2021-03-10T13:45:32.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:32 gibba013 bash[9767]: audit 2021-03-10T13:45:31.976786+0000 mon.a (mon.0) 267 : audit [DBG] from='client.? 172.21.2.113:0/2750347011' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:45:32.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:32 gibba013 bash[13024]: audit 2021-03-10T13:45:31.976786+0000 mon.a (mon.0) 267 : audit [DBG] from='client.? 172.21.2.113:0/2750347011' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:45:32.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:32 gibba020 bash[9782]: audit 2021-03-10T13:45:31.976786+0000 mon.a (mon.0) 267 : audit [DBG] from='client.? 172.21.2.113:0/2750347011' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:45:33.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:33 gibba013 bash[9767]: cluster 2021-03-10T13:45:32.410530+0000 mgr.y (mgr.14140) 77 : cluster [DBG] pgmap v69: 1 pgs: 1 undersized+peered; 0 B data, 296 KiB used, 166 GiB / 168 GiB avail 2021-03-10T13:45:33.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:33 gibba013 bash[13024]: cluster 2021-03-10T13:45:32.410530+0000 mgr.y (mgr.14140) 77 : cluster [DBG] pgmap v69: 1 pgs: 1 undersized+peered; 0 B data, 296 KiB used, 166 GiB / 168 GiB avail 2021-03-10T13:45:33.944 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:33 gibba020 bash[9782]: cluster 2021-03-10T13:45:32.410530+0000 mgr.y (mgr.14140) 77 : cluster [DBG] pgmap v69: 1 pgs: 1 undersized+peered; 0 B data, 296 KiB used, 166 GiB / 168 GiB avail 2021-03-10T13:45:34.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:34 gibba020 bash[9782]: cluster 2021-03-10T13:45:34.601032+0000 mon.a (mon.0) 268 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2021-03-10T13:45:34.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:34 gibba020 bash[9782]: cluster 2021-03-10T13:45:34.601127+0000 mon.a (mon.0) 269 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2021-03-10T13:45:34.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:34 gibba020 bash[9782]: audit 2021-03-10T13:45:34.621707+0000 mon.a (mon.0) 270 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:45:35.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:34 gibba013 bash[9767]: cluster 2021-03-10T13:45:34.601032+0000 mon.a (mon.0) 268 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2021-03-10T13:45:35.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:34 gibba013 bash[9767]: cluster 2021-03-10T13:45:34.601127+0000 mon.a (mon.0) 269 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2021-03-10T13:45:35.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:34 gibba013 bash[9767]: audit 2021-03-10T13:45:34.621707+0000 mon.a (mon.0) 270 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:45:35.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:34 gibba013 bash[13024]: cluster 2021-03-10T13:45:34.601032+0000 mon.a (mon.0) 268 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2021-03-10T13:45:35.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:34 gibba013 bash[13024]: cluster 2021-03-10T13:45:34.601127+0000 mon.a (mon.0) 269 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2021-03-10T13:45:35.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:34 gibba013 bash[13024]: audit 2021-03-10T13:45:34.621707+0000 mon.a (mon.0) 270 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:45:35.770 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:35 gibba013 bash[9767]: cluster 2021-03-10T13:45:34.411310+0000 mgr.y (mgr.14140) 78 : cluster [DBG] pgmap v70: 1 pgs: 1 active+undersized+degraded; 0 B data, 312 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:45:35.771 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:35 gibba013 bash[13024]: cluster 2021-03-10T13:45:34.411310+0000 mgr.y (mgr.14140) 78 : cluster [DBG] pgmap v70: 1 pgs: 1 active+undersized+degraded; 0 B data, 312 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:45:35.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:35 gibba020 bash[9782]: cluster 2021-03-10T13:45:34.411310+0000 mgr.y (mgr.14140) 78 : cluster [DBG] pgmap v70: 1 pgs: 1 active+undersized+degraded; 0 B data, 312 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:45:37.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:37 gibba013 bash[9767]: cluster 2021-03-10T13:45:36.411675+0000 mgr.y (mgr.14140) 79 : cluster [DBG] pgmap v71: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:45:37.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:37 gibba013 bash[13024]: cluster 2021-03-10T13:45:36.411675+0000 mgr.y (mgr.14140) 79 : cluster [DBG] pgmap v71: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:45:37.944 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:37 gibba020 bash[9782]: cluster 2021-03-10T13:45:36.411675+0000 mgr.y (mgr.14140) 79 : cluster [DBG] pgmap v71: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:45:38.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:38 gibba020 bash[9782]: audit 2021-03-10T13:45:38.019121+0000 mon.a (mon.0) 271 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2021-03-10T13:45:38.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:38 gibba020 bash[9782]: audit 2021-03-10T13:45:38.019989+0000 mon.a (mon.0) 272 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:45:38.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:38 gibba020 bash[9782]: cephadm 2021-03-10T13:45:38.020715+0000 mgr.y (mgr.14140) 80 : cephadm [INF] Deploying daemon osd.2 on gibba013 2021-03-10T13:45:38.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:38 gibba020 bash[9782]: audit 2021-03-10T13:45:38.020947+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2021-03-10T13:45:38.982 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:38 gibba013 bash[9767]: audit 2021-03-10T13:45:38.019121+0000 mon.a (mon.0) 271 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2021-03-10T13:45:38.982 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:38 gibba013 bash[9767]: audit 2021-03-10T13:45:38.019989+0000 mon.a (mon.0) 272 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:45:38.982 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:38 gibba013 bash[9767]: cephadm 2021-03-10T13:45:38.020715+0000 mgr.y (mgr.14140) 80 : cephadm [INF] Deploying daemon osd.2 on gibba013 2021-03-10T13:45:38.982 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:38 gibba013 bash[9767]: audit 2021-03-10T13:45:38.020947+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2021-03-10T13:45:38.983 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:38 gibba013 bash[13024]: audit 2021-03-10T13:45:38.019121+0000 mon.a (mon.0) 271 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2021-03-10T13:45:38.983 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:38 gibba013 bash[13024]: audit 2021-03-10T13:45:38.019989+0000 mon.a (mon.0) 272 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:45:38.983 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:38 gibba013 bash[13024]: cephadm 2021-03-10T13:45:38.020715+0000 mgr.y (mgr.14140) 80 : cephadm [INF] Deploying daemon osd.2 on gibba013 2021-03-10T13:45:38.983 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:38 gibba013 bash[13024]: audit 2021-03-10T13:45:38.020947+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2021-03-10T13:45:39.789 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:39 gibba013 bash[9767]: cluster 2021-03-10T13:45:38.412350+0000 mgr.y (mgr.14140) 81 : cluster [DBG] pgmap v72: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:45:39.789 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:39 gibba013 bash[13024]: cluster 2021-03-10T13:45:38.412350+0000 mgr.y (mgr.14140) 81 : cluster [DBG] pgmap v72: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:45:39.804 INFO:teuthology.orchestra.run.gibba013.stdout:Created osd(s) 2 on host 'gibba013' 2021-03-10T13:45:39.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:39 gibba020 bash[9782]: cluster 2021-03-10T13:45:38.412350+0000 mgr.y (mgr.14140) 81 : cluster [DBG] pgmap v72: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:45:41.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:40 gibba013 bash[9767]: audit 2021-03-10T13:45:39.797444+0000 mon.a (mon.0) 274 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.866928\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.866987\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867016\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867042\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867069\", \"created\": \"2021-03-10T13:45:17.385465\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}}, \"last_device_update\": \"2021-03-10T13:45:25.117481\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:45:41.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:40 gibba013 bash[9767]: audit 2021-03-10T13:45:39.797966+0000 mon.a (mon.0) 275 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:45:41.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:40 gibba013 bash[13024]: audit 2021-03-10T13:45:39.797444+0000 mon.a (mon.0) 274 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.866928\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.866987\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867016\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867042\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867069\", \"created\": \"2021-03-10T13:45:17.385465\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}}, \"last_device_update\": \"2021-03-10T13:45:25.117481\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:45:41.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:40 gibba013 bash[13024]: audit 2021-03-10T13:45:39.797966+0000 mon.a (mon.0) 275 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:45:41.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:40 gibba013 bash[9767]: audit 2021-03-10T13:45:39.800992+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.866928\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.866987\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867016\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867042\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867069\", \"created\": \"2021-03-10T13:45:17.385465\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}}, \"last_device_update\": \"2021-03-10T13:45:25.117481\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:45:41.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:40 gibba013 bash[13024]: audit 2021-03-10T13:45:39.800992+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.866928\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.866987\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867016\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867042\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867069\", \"created\": \"2021-03-10T13:45:17.385465\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}}, \"last_device_update\": \"2021-03-10T13:45:25.117481\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:45:41.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:40 gibba013 bash[9767]: audit 2021-03-10T13:45:40.300170+0000 mon.a (mon.0) 277 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299380\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299439\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299468\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299495\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299521\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299547\", \"created\": \"2021-03-10T13:45:39.785465\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}}, \"last_daemon_update\": \"2021-03-10T13:45:40.299595\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:45:41.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:40 gibba013 bash[13024]: audit 2021-03-10T13:45:40.300170+0000 mon.a (mon.0) 277 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299380\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299439\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299468\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299495\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299521\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299547\", \"created\": \"2021-03-10T13:45:39.785465\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}}, \"last_daemon_update\": \"2021-03-10T13:45:40.299595\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:45:41.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:40 gibba013 bash[9767]: audit 2021-03-10T13:45:40.304172+0000 mon.a (mon.0) 278 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299380\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299439\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299468\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299495\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299521\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299547\", \"created\": \"2021-03-10T13:45:39.785465\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}}, \"last_daemon_update\": \"2021-03-10T13:45:40.299595\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:45:41.138 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:40 gibba013 bash[9767]: audit 2021-03-10T13:45:40.304682+0000 mon.a (mon.0) 279 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:45:41.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:40 gibba013 bash[13024]: audit 2021-03-10T13:45:40.304172+0000 mon.a (mon.0) 278 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299380\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299439\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299468\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299495\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299521\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299547\", \"created\": \"2021-03-10T13:45:39.785465\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}}, \"last_daemon_update\": \"2021-03-10T13:45:40.299595\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:45:41.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:40 gibba013 bash[13024]: audit 2021-03-10T13:45:40.304682+0000 mon.a (mon.0) 279 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:45:41.176 DEBUG:teuthology.orchestra.run.gibba013:osd.2> sudo journalctl -f -n 0 -u ceph-7672acc8-81a6-11eb-9080-001a4aab830c@osd.2.service 2021-03-10T13:45:41.178 INFO:tasks.cephadm:Deploying osd.3 on gibba013 with /dev/vg_nvme/lv_1... 2021-03-10T13:45:41.179 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2021-03-10T13:45:41.187 INFO:journalctl@ceph.osd.2.gibba013.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:45:41.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:40 gibba020 bash[9782]: audit 2021-03-10T13:45:39.797444+0000 mon.a (mon.0) 274 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.866928\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.866987\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867016\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867042\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867069\", \"created\": \"2021-03-10T13:45:17.385465\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}}, \"last_device_update\": \"2021-03-10T13:45:25.117481\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:45:41.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:40 gibba020 bash[9782]: audit 2021-03-10T13:45:39.797966+0000 mon.a (mon.0) 275 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:45:41.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:40 gibba020 bash[9782]: audit 2021-03-10T13:45:39.800992+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.866928\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.866987\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867016\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867042\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:17.867069\", \"created\": \"2021-03-10T13:45:17.385465\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}}, \"last_device_update\": \"2021-03-10T13:45:25.117481\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:45:41.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:40 gibba020 bash[9782]: audit 2021-03-10T13:45:40.300170+0000 mon.a (mon.0) 277 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299380\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299439\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299468\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299495\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299521\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299547\", \"created\": \"2021-03-10T13:45:39.785465\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}}, \"last_daemon_update\": \"2021-03-10T13:45:40.299595\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:45:41.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:40 gibba020 bash[9782]: audit 2021-03-10T13:45:40.304172+0000 mon.a (mon.0) 278 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299380\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299439\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299468\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299495\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299521\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299547\", \"created\": \"2021-03-10T13:45:39.785465\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}}, \"last_daemon_update\": \"2021-03-10T13:45:40.299595\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:45:41.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:40 gibba020 bash[9782]: audit 2021-03-10T13:45:40.304682+0000 mon.a (mon.0) 279 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:45:42.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:41 gibba013 bash[9767]: cluster 2021-03-10T13:45:40.412646+0000 mgr.y (mgr.14140) 82 : cluster [DBG] pgmap v73: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:45:42.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:41 gibba013 bash[13024]: cluster 2021-03-10T13:45:40.412646+0000 mgr.y (mgr.14140) 82 : cluster [DBG] pgmap v73: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:45:42.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:41 gibba020 bash[9782]: cluster 2021-03-10T13:45:40.412646+0000 mgr.y (mgr.14140) 82 : cluster [DBG] pgmap v73: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:45:42.679 INFO:journalctl@ceph.osd.2.gibba013.stdout:Mar 10 13:45:42 gibba013 bash[17513]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-03-10T13:45:42.679 INFO:journalctl@ceph.osd.2.gibba013.stdout:Mar 10 13:45:42 gibba013 bash[17513]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2021-03-10T13:45:42.679 INFO:journalctl@ceph.osd.2.gibba013.stdout:Mar 10 13:45:42 gibba013 bash[17513]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2021-03-10T13:45:42.679 INFO:journalctl@ceph.osd.2.gibba013.stdout:Mar 10 13:45:42 gibba013 bash[17513]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2021-03-10T13:45:42.680 INFO:journalctl@ceph.osd.2.gibba013.stdout:Mar 10 13:45:42 gibba013 bash[17513]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2021-03-10T13:45:42.680 INFO:journalctl@ceph.osd.2.gibba013.stdout:Mar 10 13:45:42 gibba013 bash[17513]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-03-10T13:45:42.680 INFO:journalctl@ceph.osd.2.gibba013.stdout:Mar 10 13:45:42 gibba013 bash[17513]: --> ceph-volume lvm activate successful for osd ID: 2 2021-03-10T13:45:43.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:43 gibba013 bash[9767]: cluster 2021-03-10T13:45:42.413048+0000 mgr.y (mgr.14140) 83 : cluster [DBG] pgmap v74: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:45:43.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:43 gibba013 bash[13024]: cluster 2021-03-10T13:45:42.413048+0000 mgr.y (mgr.14140) 83 : cluster [DBG] pgmap v74: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:45:44.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:43 gibba020 bash[9782]: cluster 2021-03-10T13:45:42.413048+0000 mgr.y (mgr.14140) 83 : cluster [DBG] pgmap v74: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:45:45.859 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:45 gibba013 bash[9767]: cluster 2021-03-10T13:45:44.413729+0000 mgr.y (mgr.14140) 84 : cluster [DBG] pgmap v75: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:45:45.859 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:45 gibba013 bash[13024]: cluster 2021-03-10T13:45:44.413729+0000 mgr.y (mgr.14140) 84 : cluster [DBG] pgmap v75: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:45:46.194 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:45 gibba020 bash[9782]: cluster 2021-03-10T13:45:44.413729+0000 mgr.y (mgr.14140) 84 : cluster [DBG] pgmap v75: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:45:46.475 INFO:teuthology.orchestra.run.gibba013.stderr:--> Zapping: /dev/vg_nvme/lv_1 2021-03-10T13:45:46.476 INFO:teuthology.orchestra.run.gibba013.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2021-03-10T13:45:46.476 INFO:teuthology.orchestra.run.gibba013.stderr: stderr: 10+0 records in 2021-03-10T13:45:46.476 INFO:teuthology.orchestra.run.gibba013.stderr:10+0 records out 2021-03-10T13:45:46.476 INFO:teuthology.orchestra.run.gibba013.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00758956 s, 1.4 GB/s 2021-03-10T13:45:46.477 INFO:teuthology.orchestra.run.gibba013.stderr:--> Zapping successful for: 2021-03-10T13:45:46.551 INFO:journalctl@ceph.osd.2.gibba013.stdout:Mar 10 13:45:46 gibba013 bash[17903]: debug 2021-03-10T13:45:46.154+0000 7fb1dd52fec0 -1 Falling back to public interface 2021-03-10T13:45:47.130 INFO:journalctl@ceph.osd.2.gibba013.stdout:Mar 10 13:45:46 gibba013 bash[17903]: debug 2021-03-10T13:45:46.794+0000 7fb1dd52fec0 -1 osd.2 0 log_to_monitors {default=true} 2021-03-10T13:45:47.162 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph orch daemon add osd gibba013:vg_nvme/lv_1 2021-03-10T13:45:48.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:47 gibba013 bash[9767]: cluster 2021-03-10T13:45:46.414430+0000 mgr.y (mgr.14140) 85 : cluster [DBG] pgmap v76: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:45:48.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:47 gibba013 bash[9767]: audit 2021-03-10T13:45:46.803769+0000 mon.c (mon.1) 9 : audit [INF] from='osd.2 [v2:172.21.2.113:6818/3189642125,v1:172.21.2.113:6819/3189642125]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T13:45:48.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:47 gibba013 bash[9767]: audit 2021-03-10T13:45:46.803941+0000 mon.a (mon.0) 280 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T13:45:48.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:47 gibba013 bash[13024]: cluster 2021-03-10T13:45:46.414430+0000 mgr.y (mgr.14140) 85 : cluster [DBG] pgmap v76: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:45:48.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:47 gibba013 bash[13024]: audit 2021-03-10T13:45:46.803769+0000 mon.c (mon.1) 9 : audit [INF] from='osd.2 [v2:172.21.2.113:6818/3189642125,v1:172.21.2.113:6819/3189642125]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T13:45:48.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:47 gibba013 bash[13024]: audit 2021-03-10T13:45:46.803941+0000 mon.a (mon.0) 280 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T13:45:48.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:47 gibba020 bash[9782]: cluster 2021-03-10T13:45:46.414430+0000 mgr.y (mgr.14140) 85 : cluster [DBG] pgmap v76: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:45:48.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:47 gibba020 bash[9782]: audit 2021-03-10T13:45:46.803769+0000 mon.c (mon.1) 9 : audit [INF] from='osd.2 [v2:172.21.2.113:6818/3189642125,v1:172.21.2.113:6819/3189642125]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T13:45:48.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:47 gibba020 bash[9782]: audit 2021-03-10T13:45:46.803941+0000 mon.a (mon.0) 280 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T13:45:48.878 INFO:journalctl@ceph.osd.2.gibba013.stdout:Mar 10 13:45:48 gibba013 bash[17903]: debug 2021-03-10T13:45:48.734+0000 7fb1c62e4700 -1 osd.2 0 waiting for initial osdmap 2021-03-10T13:45:48.879 INFO:journalctl@ceph.osd.2.gibba013.stdout:Mar 10 13:45:48 gibba013 bash[17903]: debug 2021-03-10T13:45:48.738+0000 7fb1d1500700 -1 osd.2 20 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:45:48.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:48 gibba013 bash[9767]: audit 2021-03-10T13:45:47.734963+0000 mon.a (mon.0) 281 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-03-10T13:45:48.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:48 gibba013 bash[9767]: cluster 2021-03-10T13:45:47.734985+0000 mon.a (mon.0) 282 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2021-03-10T13:45:48.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:48 gibba013 bash[9767]: audit 2021-03-10T13:45:47.735081+0000 mon.a (mon.0) 283 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:45:48.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:48 gibba013 bash[9767]: audit 2021-03-10T13:45:47.735715+0000 mon.c (mon.1) 10 : audit [INF] from='osd.2 [v2:172.21.2.113:6818/3189642125,v1:172.21.2.113:6819/3189642125]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:45:48.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:48 gibba013 bash[9767]: audit 2021-03-10T13:45:47.735936+0000 mon.a (mon.0) 284 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:45:48.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:48 gibba013 bash[9767]: audit 2021-03-10T13:45:48.344276+0000 mon.a (mon.0) 285 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:45:48.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:48 gibba013 bash[13024]: audit 2021-03-10T13:45:47.734963+0000 mon.a (mon.0) 281 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-03-10T13:45:48.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:48 gibba013 bash[13024]: cluster 2021-03-10T13:45:47.734985+0000 mon.a (mon.0) 282 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2021-03-10T13:45:48.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:48 gibba013 bash[13024]: audit 2021-03-10T13:45:47.735081+0000 mon.a (mon.0) 283 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:45:48.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:48 gibba013 bash[13024]: audit 2021-03-10T13:45:47.735715+0000 mon.c (mon.1) 10 : audit [INF] from='osd.2 [v2:172.21.2.113:6818/3189642125,v1:172.21.2.113:6819/3189642125]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:45:48.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:48 gibba013 bash[13024]: audit 2021-03-10T13:45:47.735936+0000 mon.a (mon.0) 284 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:45:48.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:48 gibba013 bash[13024]: audit 2021-03-10T13:45:48.344276+0000 mon.a (mon.0) 285 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:45:48.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:48 gibba013 bash[9767]: audit 2021-03-10T13:45:48.440911+0000 mon.a (mon.0) 286 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299380\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299439\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299468\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299495\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299521\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299547\", \"created\": \"2021-03-10T13:45:39.785465\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}}, \"last_daemon_update\": \"2021-03-10T13:45:40.299595\", \"last_device_update\": \"2021-03-10T13:45:48.440335\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:45:48.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:48 gibba013 bash[9767]: audit 2021-03-10T13:45:48.444822+0000 mon.a (mon.0) 287 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299380\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299439\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299468\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299495\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299521\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299547\", \"created\": \"2021-03-10T13:45:39.785465\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}}, \"last_daemon_update\": \"2021-03-10T13:45:40.299595\", \"last_device_update\": \"2021-03-10T13:45:48.440335\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:45:48.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:48 gibba013 bash[13024]: audit 2021-03-10T13:45:48.440911+0000 mon.a (mon.0) 286 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299380\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299439\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299468\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299495\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299521\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299547\", \"created\": \"2021-03-10T13:45:39.785465\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}}, \"last_daemon_update\": \"2021-03-10T13:45:40.299595\", \"last_device_update\": \"2021-03-10T13:45:48.440335\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:45:48.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:48 gibba013 bash[13024]: audit 2021-03-10T13:45:48.444822+0000 mon.a (mon.0) 287 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299380\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299439\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299468\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299495\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299521\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299547\", \"created\": \"2021-03-10T13:45:39.785465\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}}, \"last_daemon_update\": \"2021-03-10T13:45:40.299595\", \"last_device_update\": \"2021-03-10T13:45:48.440335\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:45:49.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:48 gibba020 bash[9782]: audit 2021-03-10T13:45:47.734963+0000 mon.a (mon.0) 281 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-03-10T13:45:49.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:48 gibba020 bash[9782]: cluster 2021-03-10T13:45:47.734985+0000 mon.a (mon.0) 282 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2021-03-10T13:45:49.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:48 gibba020 bash[9782]: audit 2021-03-10T13:45:47.735081+0000 mon.a (mon.0) 283 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:45:49.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:48 gibba020 bash[9782]: audit 2021-03-10T13:45:47.735715+0000 mon.c (mon.1) 10 : audit [INF] from='osd.2 [v2:172.21.2.113:6818/3189642125,v1:172.21.2.113:6819/3189642125]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:45:49.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:48 gibba020 bash[9782]: audit 2021-03-10T13:45:47.735936+0000 mon.a (mon.0) 284 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:45:49.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:48 gibba020 bash[9782]: audit 2021-03-10T13:45:48.344276+0000 mon.a (mon.0) 285 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:45:49.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:48 gibba020 bash[9782]: audit 2021-03-10T13:45:48.440911+0000 mon.a (mon.0) 286 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299380\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299439\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299468\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299495\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299521\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299547\", \"created\": \"2021-03-10T13:45:39.785465\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}}, \"last_daemon_update\": \"2021-03-10T13:45:40.299595\", \"last_device_update\": \"2021-03-10T13:45:48.440335\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:45:49.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:48 gibba020 bash[9782]: audit 2021-03-10T13:45:48.444822+0000 mon.a (mon.0) 287 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299380\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299439\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299468\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299495\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299521\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299547\", \"created\": \"2021-03-10T13:45:39.785465\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}}, \"last_daemon_update\": \"2021-03-10T13:45:40.299595\", \"last_device_update\": \"2021-03-10T13:45:48.440335\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:45:50.104 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:49 gibba013 bash[9767]: cluster 2021-03-10T13:45:47.841170+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:45:50.104 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:49 gibba013 bash[9767]: cluster 2021-03-10T13:45:47.841270+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:45:50.104 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:49 gibba013 bash[9767]: cluster 2021-03-10T13:45:48.414700+0000 mgr.y (mgr.14140) 86 : cluster [DBG] pgmap v78: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:45:50.105 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:49 gibba013 bash[9767]: audit 2021-03-10T13:45:48.738851+0000 mon.a (mon.0) 288 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]': finished 2021-03-10T13:45:50.105 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:49 gibba013 bash[9767]: cluster 2021-03-10T13:45:48.738889+0000 mon.a (mon.0) 289 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2021-03-10T13:45:50.105 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:49 gibba013 bash[9767]: audit 2021-03-10T13:45:48.739635+0000 mon.a (mon.0) 290 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:45:50.105 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:49 gibba013 bash[13024]: cluster 2021-03-10T13:45:47.841170+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:45:50.106 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:49 gibba013 bash[13024]: cluster 2021-03-10T13:45:47.841270+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:45:50.106 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:49 gibba013 bash[13024]: cluster 2021-03-10T13:45:48.414700+0000 mgr.y (mgr.14140) 86 : cluster [DBG] pgmap v78: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:45:50.106 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:49 gibba013 bash[13024]: audit 2021-03-10T13:45:48.738851+0000 mon.a (mon.0) 288 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]': finished 2021-03-10T13:45:50.106 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:49 gibba013 bash[13024]: cluster 2021-03-10T13:45:48.738889+0000 mon.a (mon.0) 289 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2021-03-10T13:45:50.106 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:49 gibba013 bash[13024]: audit 2021-03-10T13:45:48.739635+0000 mon.a (mon.0) 290 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:45:50.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:49 gibba020 bash[9782]: cluster 2021-03-10T13:45:47.841170+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:45:50.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:49 gibba020 bash[9782]: cluster 2021-03-10T13:45:47.841270+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:45:50.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:49 gibba020 bash[9782]: cluster 2021-03-10T13:45:48.414700+0000 mgr.y (mgr.14140) 86 : cluster [DBG] pgmap v78: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:45:50.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:49 gibba020 bash[9782]: audit 2021-03-10T13:45:48.738851+0000 mon.a (mon.0) 288 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]': finished 2021-03-10T13:45:50.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:49 gibba020 bash[9782]: cluster 2021-03-10T13:45:48.738889+0000 mon.a (mon.0) 289 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2021-03-10T13:45:50.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:49 gibba020 bash[9782]: audit 2021-03-10T13:45:48.739635+0000 mon.a (mon.0) 290 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:45:51.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:50 gibba013 bash[9767]: cluster 2021-03-10T13:45:49.757067+0000 mon.a (mon.0) 291 : cluster [INF] osd.2 [v2:172.21.2.113:6818/3189642125,v1:172.21.2.113:6819/3189642125] boot 2021-03-10T13:45:51.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:50 gibba013 bash[9767]: cluster 2021-03-10T13:45:49.757175+0000 mon.a (mon.0) 292 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2021-03-10T13:45:51.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:50 gibba013 bash[9767]: audit 2021-03-10T13:45:49.758548+0000 mon.a (mon.0) 293 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:45:51.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:50 gibba013 bash[9767]: audit 2021-03-10T13:45:50.370877+0000 mon.a (mon.0) 294 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:45:51.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:50 gibba013 bash[9767]: audit 2021-03-10T13:45:50.371868+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:45:51.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:50 gibba013 bash[9767]: audit 2021-03-10T13:45:50.373022+0000 mon.a (mon.0) 296 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:45:51.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:50 gibba013 bash[13024]: cluster 2021-03-10T13:45:49.757067+0000 mon.a (mon.0) 291 : cluster [INF] osd.2 [v2:172.21.2.113:6818/3189642125,v1:172.21.2.113:6819/3189642125] boot 2021-03-10T13:45:51.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:50 gibba013 bash[13024]: cluster 2021-03-10T13:45:49.757175+0000 mon.a (mon.0) 292 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2021-03-10T13:45:51.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:50 gibba013 bash[13024]: audit 2021-03-10T13:45:49.758548+0000 mon.a (mon.0) 293 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:45:51.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:50 gibba013 bash[13024]: audit 2021-03-10T13:45:50.370877+0000 mon.a (mon.0) 294 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:45:51.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:50 gibba013 bash[13024]: audit 2021-03-10T13:45:50.371868+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:45:51.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:50 gibba013 bash[13024]: audit 2021-03-10T13:45:50.373022+0000 mon.a (mon.0) 296 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:45:51.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:50 gibba020 bash[9782]: cluster 2021-03-10T13:45:49.757067+0000 mon.a (mon.0) 291 : cluster [INF] osd.2 [v2:172.21.2.113:6818/3189642125,v1:172.21.2.113:6819/3189642125] boot 2021-03-10T13:45:51.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:50 gibba020 bash[9782]: cluster 2021-03-10T13:45:49.757175+0000 mon.a (mon.0) 292 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2021-03-10T13:45:51.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:50 gibba020 bash[9782]: audit 2021-03-10T13:45:49.758548+0000 mon.a (mon.0) 293 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:45:51.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:50 gibba020 bash[9782]: audit 2021-03-10T13:45:50.370877+0000 mon.a (mon.0) 294 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:45:51.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:50 gibba020 bash[9782]: audit 2021-03-10T13:45:50.371868+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:45:51.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:50 gibba020 bash[9782]: audit 2021-03-10T13:45:50.373022+0000 mon.a (mon.0) 296 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:45:52.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:51 gibba013 bash[9767]: audit 2021-03-10T13:45:50.370175+0000 mgr.y (mgr.14140) 87 : audit [DBG] from='client.24196 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba013:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:45:52.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:51 gibba013 bash[9767]: cephadm 2021-03-10T13:45:50.370619+0000 mgr.y (mgr.14140) 88 : cephadm [INF] Applying osd on host gibba013... 2021-03-10T13:45:52.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:51 gibba013 bash[9767]: cluster 2021-03-10T13:45:50.414921+0000 mgr.y (mgr.14140) 89 : cluster [DBG] pgmap v81: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:45:52.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:51 gibba013 bash[9767]: cluster 2021-03-10T13:45:50.773023+0000 mon.a (mon.0) 297 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2021-03-10T13:45:52.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:51 gibba013 bash[9767]: cluster 2021-03-10T13:45:51.776585+0000 mon.a (mon.0) 298 : cluster [DBG] osdmap e23: 3 total, 3 up, 3 in 2021-03-10T13:45:52.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:51 gibba013 bash[13024]: audit 2021-03-10T13:45:50.370175+0000 mgr.y (mgr.14140) 87 : audit [DBG] from='client.24196 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba013:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:45:52.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:51 gibba013 bash[13024]: cephadm 2021-03-10T13:45:50.370619+0000 mgr.y (mgr.14140) 88 : cephadm [INF] Applying osd on host gibba013... 2021-03-10T13:45:52.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:51 gibba013 bash[13024]: cluster 2021-03-10T13:45:50.414921+0000 mgr.y (mgr.14140) 89 : cluster [DBG] pgmap v81: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:45:52.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:51 gibba013 bash[13024]: cluster 2021-03-10T13:45:50.773023+0000 mon.a (mon.0) 297 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2021-03-10T13:45:52.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:51 gibba013 bash[13024]: cluster 2021-03-10T13:45:51.776585+0000 mon.a (mon.0) 298 : cluster [DBG] osdmap e23: 3 total, 3 up, 3 in 2021-03-10T13:45:52.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:51 gibba020 bash[9782]: audit 2021-03-10T13:45:50.370175+0000 mgr.y (mgr.14140) 87 : audit [DBG] from='client.24196 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba013:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:45:52.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:51 gibba020 bash[9782]: cephadm 2021-03-10T13:45:50.370619+0000 mgr.y (mgr.14140) 88 : cephadm [INF] Applying osd on host gibba013... 2021-03-10T13:45:52.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:51 gibba020 bash[9782]: cluster 2021-03-10T13:45:50.414921+0000 mgr.y (mgr.14140) 89 : cluster [DBG] pgmap v81: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:45:52.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:51 gibba020 bash[9782]: cluster 2021-03-10T13:45:50.773023+0000 mon.a (mon.0) 297 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2021-03-10T13:45:52.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:51 gibba020 bash[9782]: cluster 2021-03-10T13:45:51.776585+0000 mon.a (mon.0) 298 : cluster [DBG] osdmap e23: 3 total, 3 up, 3 in 2021-03-10T13:45:54.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:53 gibba013 bash[9767]: cluster 2021-03-10T13:45:52.415642+0000 mgr.y (mgr.14140) 90 : cluster [DBG] pgmap v84: 1 pgs: 1 active+undersized+degraded; 0 B data, 520 KiB used, 249 GiB / 252 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:45:54.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:53 gibba013 bash[9767]: audit 2021-03-10T13:45:53.545705+0000 mon.a (mon.0) 299 : audit [INF] from='client.? 172.21.2.113:0/4006299866' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6d982c1b-253a-4416-814a-f14b580f5c6b"}]: dispatch 2021-03-10T13:45:54.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:53 gibba013 bash[9767]: audit 2021-03-10T13:45:53.550680+0000 mon.a (mon.0) 300 : audit [INF] from='client.? 172.21.2.113:0/4006299866' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6d982c1b-253a-4416-814a-f14b580f5c6b"}]': finished 2021-03-10T13:45:54.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:53 gibba013 bash[9767]: cluster 2021-03-10T13:45:53.550701+0000 mon.a (mon.0) 301 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2021-03-10T13:45:54.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:53 gibba013 bash[9767]: audit 2021-03-10T13:45:53.550877+0000 mon.a (mon.0) 302 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:45:54.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:53 gibba013 bash[13024]: cluster 2021-03-10T13:45:52.415642+0000 mgr.y (mgr.14140) 90 : cluster [DBG] pgmap v84: 1 pgs: 1 active+undersized+degraded; 0 B data, 520 KiB used, 249 GiB / 252 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:45:54.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:53 gibba013 bash[13024]: audit 2021-03-10T13:45:53.545705+0000 mon.a (mon.0) 299 : audit [INF] from='client.? 172.21.2.113:0/4006299866' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6d982c1b-253a-4416-814a-f14b580f5c6b"}]: dispatch 2021-03-10T13:45:54.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:53 gibba013 bash[13024]: audit 2021-03-10T13:45:53.550680+0000 mon.a (mon.0) 300 : audit [INF] from='client.? 172.21.2.113:0/4006299866' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6d982c1b-253a-4416-814a-f14b580f5c6b"}]': finished 2021-03-10T13:45:54.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:53 gibba013 bash[13024]: cluster 2021-03-10T13:45:53.550701+0000 mon.a (mon.0) 301 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2021-03-10T13:45:54.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:53 gibba013 bash[13024]: audit 2021-03-10T13:45:53.550877+0000 mon.a (mon.0) 302 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:45:54.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:53 gibba020 bash[9782]: cluster 2021-03-10T13:45:52.415642+0000 mgr.y (mgr.14140) 90 : cluster [DBG] pgmap v84: 1 pgs: 1 active+undersized+degraded; 0 B data, 520 KiB used, 249 GiB / 252 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T13:45:54.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:53 gibba020 bash[9782]: audit 2021-03-10T13:45:53.545705+0000 mon.a (mon.0) 299 : audit [INF] from='client.? 172.21.2.113:0/4006299866' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6d982c1b-253a-4416-814a-f14b580f5c6b"}]: dispatch 2021-03-10T13:45:54.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:53 gibba020 bash[9782]: audit 2021-03-10T13:45:53.550680+0000 mon.a (mon.0) 300 : audit [INF] from='client.? 172.21.2.113:0/4006299866' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6d982c1b-253a-4416-814a-f14b580f5c6b"}]': finished 2021-03-10T13:45:54.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:53 gibba020 bash[9782]: cluster 2021-03-10T13:45:53.550701+0000 mon.a (mon.0) 301 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2021-03-10T13:45:54.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:53 gibba020 bash[9782]: audit 2021-03-10T13:45:53.550877+0000 mon.a (mon.0) 302 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:45:55.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:54 gibba013 bash[9767]: cluster 2021-03-10T13:45:54.787500+0000 mon.a (mon.0) 303 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2021-03-10T13:45:55.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:54 gibba013 bash[9767]: cluster 2021-03-10T13:45:54.787617+0000 mon.a (mon.0) 304 : cluster [INF] Cluster is now healthy 2021-03-10T13:45:55.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:54 gibba013 bash[13024]: cluster 2021-03-10T13:45:54.787500+0000 mon.a (mon.0) 303 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2021-03-10T13:45:55.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:54 gibba013 bash[13024]: cluster 2021-03-10T13:45:54.787617+0000 mon.a (mon.0) 304 : cluster [INF] Cluster is now healthy 2021-03-10T13:45:55.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:54 gibba020 bash[9782]: cluster 2021-03-10T13:45:54.787500+0000 mon.a (mon.0) 303 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2021-03-10T13:45:55.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:54 gibba020 bash[9782]: cluster 2021-03-10T13:45:54.787617+0000 mon.a (mon.0) 304 : cluster [INF] Cluster is now healthy 2021-03-10T13:45:56.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:55 gibba013 bash[9767]: cluster 2021-03-10T13:45:54.416278+0000 mgr.y (mgr.14140) 91 : cluster [DBG] pgmap v86: 1 pgs: 1 active+clean; 0 B data, 560 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:45:56.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:55 gibba013 bash[9767]: audit 2021-03-10T13:45:55.661413+0000 mon.c (mon.1) 11 : audit [DBG] from='client.? 172.21.2.113:0/3836210552' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:45:56.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:55 gibba013 bash[13024]: cluster 2021-03-10T13:45:54.416278+0000 mgr.y (mgr.14140) 91 : cluster [DBG] pgmap v86: 1 pgs: 1 active+clean; 0 B data, 560 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:45:56.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:55 gibba013 bash[13024]: audit 2021-03-10T13:45:55.661413+0000 mon.c (mon.1) 11 : audit [DBG] from='client.? 172.21.2.113:0/3836210552' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:45:56.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:55 gibba020 bash[9782]: cluster 2021-03-10T13:45:54.416278+0000 mgr.y (mgr.14140) 91 : cluster [DBG] pgmap v86: 1 pgs: 1 active+clean; 0 B data, 560 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:45:56.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:55 gibba020 bash[9782]: audit 2021-03-10T13:45:55.661413+0000 mon.c (mon.1) 11 : audit [DBG] from='client.? 172.21.2.113:0/3836210552' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:45:58.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:57 gibba013 bash[9767]: cluster 2021-03-10T13:45:56.416975+0000 mgr.y (mgr.14140) 92 : cluster [DBG] pgmap v87: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:45:58.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:57 gibba013 bash[13024]: cluster 2021-03-10T13:45:56.416975+0000 mgr.y (mgr.14140) 92 : cluster [DBG] pgmap v87: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:45:58.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:57 gibba020 bash[9782]: cluster 2021-03-10T13:45:56.416975+0000 mgr.y (mgr.14140) 92 : cluster [DBG] pgmap v87: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:45:59.126 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:58 gibba013 bash[9767]: audit 2021-03-10T13:45:58.277910+0000 mon.a (mon.0) 305 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:45:59.126 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:58 gibba013 bash[13024]: audit 2021-03-10T13:45:58.277910+0000 mon.a (mon.0) 305 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:45:59.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:58 gibba020 bash[9782]: audit 2021-03-10T13:45:58.277910+0000 mon.a (mon.0) 305 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:46:00.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:45:59 gibba013 bash[9767]: cluster 2021-03-10T13:45:58.417461+0000 mgr.y (mgr.14140) 93 : cluster [DBG] pgmap v88: 1 pgs: 1 active+clean; 0 B data, 608 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:46:00.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:45:59 gibba013 bash[13024]: cluster 2021-03-10T13:45:58.417461+0000 mgr.y (mgr.14140) 93 : cluster [DBG] pgmap v88: 1 pgs: 1 active+clean; 0 B data, 608 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:46:00.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:45:59 gibba020 bash[9782]: cluster 2021-03-10T13:45:58.417461+0000 mgr.y (mgr.14140) 93 : cluster [DBG] pgmap v88: 1 pgs: 1 active+clean; 0 B data, 608 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:46:01.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:01 gibba013 bash[9767]: cluster 2021-03-10T13:46:00.417692+0000 mgr.y (mgr.14140) 94 : cluster [DBG] pgmap v89: 1 pgs: 1 active+clean; 0 B data, 608 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:46:01.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:01 gibba013 bash[13024]: cluster 2021-03-10T13:46:00.417692+0000 mgr.y (mgr.14140) 94 : cluster [DBG] pgmap v89: 1 pgs: 1 active+clean; 0 B data, 608 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:46:01.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:01 gibba020 bash[9782]: cluster 2021-03-10T13:46:00.417692+0000 mgr.y (mgr.14140) 94 : cluster [DBG] pgmap v89: 1 pgs: 1 active+clean; 0 B data, 608 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:46:02.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:02 gibba020 bash[9782]: audit 2021-03-10T13:46:01.906852+0000 mon.a (mon.0) 306 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2021-03-10T13:46:02.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:02 gibba020 bash[9782]: audit 2021-03-10T13:46:01.907779+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:46:02.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:02 gibba020 bash[9782]: cephadm 2021-03-10T13:46:01.908544+0000 mgr.y (mgr.14140) 95 : cephadm [INF] Deploying daemon osd.3 on gibba013 2021-03-10T13:46:02.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:02 gibba020 bash[9782]: audit 2021-03-10T13:46:01.908783+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2021-03-10T13:46:02.784 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:02 gibba013 bash[9767]: audit 2021-03-10T13:46:01.906852+0000 mon.a (mon.0) 306 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2021-03-10T13:46:02.785 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:02 gibba013 bash[9767]: audit 2021-03-10T13:46:01.907779+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:46:02.785 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:02 gibba013 bash[9767]: cephadm 2021-03-10T13:46:01.908544+0000 mgr.y (mgr.14140) 95 : cephadm [INF] Deploying daemon osd.3 on gibba013 2021-03-10T13:46:02.785 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:02 gibba013 bash[9767]: audit 2021-03-10T13:46:01.908783+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2021-03-10T13:46:02.786 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:02 gibba013 bash[13024]: audit 2021-03-10T13:46:01.906852+0000 mon.a (mon.0) 306 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2021-03-10T13:46:02.786 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:02 gibba013 bash[13024]: audit 2021-03-10T13:46:01.907779+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:46:02.786 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:02 gibba013 bash[13024]: cephadm 2021-03-10T13:46:01.908544+0000 mgr.y (mgr.14140) 95 : cephadm [INF] Deploying daemon osd.3 on gibba013 2021-03-10T13:46:02.786 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:02 gibba013 bash[13024]: audit 2021-03-10T13:46:01.908783+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2021-03-10T13:46:03.740 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:03 gibba013 bash[9767]: cluster 2021-03-10T13:46:02.418242+0000 mgr.y (mgr.14140) 96 : cluster [DBG] pgmap v90: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:46:03.740 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:03 gibba013 bash[13024]: cluster 2021-03-10T13:46:02.418242+0000 mgr.y (mgr.14140) 96 : cluster [DBG] pgmap v90: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:46:03.756 INFO:teuthology.orchestra.run.gibba013.stdout:Created osd(s) 3 on host 'gibba013' 2021-03-10T13:46:03.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:03 gibba020 bash[9782]: cluster 2021-03-10T13:46:02.418242+0000 mgr.y (mgr.14140) 96 : cluster [DBG] pgmap v90: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:46:04.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:04 gibba013 bash[13024]: audit 2021-03-10T13:46:03.749989+0000 mon.a (mon.0) 309 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299380\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299439\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299468\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299495\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299521\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299547\", \"created\": \"2021-03-10T13:45:39.785465\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}}, \"last_device_update\": \"2021-03-10T13:45:48.440335\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:46:04.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:04 gibba013 bash[13024]: audit 2021-03-10T13:46:03.750672+0000 mon.a (mon.0) 310 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:46:04.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:04 gibba013 bash[9767]: audit 2021-03-10T13:46:03.749989+0000 mon.a (mon.0) 309 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299380\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299439\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299468\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299495\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299521\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299547\", \"created\": \"2021-03-10T13:45:39.785465\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}}, \"last_device_update\": \"2021-03-10T13:45:48.440335\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:46:04.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:04 gibba013 bash[9767]: audit 2021-03-10T13:46:03.750672+0000 mon.a (mon.0) 310 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:46:04.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:04 gibba013 bash[13024]: audit 2021-03-10T13:46:03.753958+0000 mon.a (mon.0) 311 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299380\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299439\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299468\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299495\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299521\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299547\", \"created\": \"2021-03-10T13:45:39.785465\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}}, \"last_device_update\": \"2021-03-10T13:45:48.440335\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:46:04.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:04 gibba013 bash[9767]: audit 2021-03-10T13:46:03.753958+0000 mon.a (mon.0) 311 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299380\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299439\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299468\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299495\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299521\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299547\", \"created\": \"2021-03-10T13:45:39.785465\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}}, \"last_device_update\": \"2021-03-10T13:45:48.440335\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:46:04.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:04 gibba013 bash[13024]: audit 2021-03-10T13:46:04.407319+0000 mon.a (mon.0) 312 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406440\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406500\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406529\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406556\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406581\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406607\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406633\", \"created\": \"2021-03-10T13:46:03.738924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}}, \"last_daemon_update\": \"2021-03-10T13:46:04.406686\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:46:04.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:04 gibba013 bash[13024]: audit 2021-03-10T13:46:04.415844+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406440\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406500\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406529\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406556\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406581\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406607\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406633\", \"created\": \"2021-03-10T13:46:03.738924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}}, \"last_daemon_update\": \"2021-03-10T13:46:04.406686\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:46:04.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:04 gibba013 bash[13024]: audit 2021-03-10T13:46:04.417725+0000 mon.a (mon.0) 314 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:46:04.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:04 gibba013 bash[9767]: audit 2021-03-10T13:46:04.407319+0000 mon.a (mon.0) 312 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406440\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406500\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406529\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406556\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406581\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406607\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406633\", \"created\": \"2021-03-10T13:46:03.738924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}}, \"last_daemon_update\": \"2021-03-10T13:46:04.406686\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:46:04.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:04 gibba013 bash[9767]: audit 2021-03-10T13:46:04.415844+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406440\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406500\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406529\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406556\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406581\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406607\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406633\", \"created\": \"2021-03-10T13:46:03.738924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}}, \"last_daemon_update\": \"2021-03-10T13:46:04.406686\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:46:04.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:04 gibba013 bash[9767]: audit 2021-03-10T13:46:04.417725+0000 mon.a (mon.0) 314 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:46:04.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:04 gibba020 bash[9782]: audit 2021-03-10T13:46:03.749989+0000 mon.a (mon.0) 309 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299380\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299439\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299468\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299495\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299521\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299547\", \"created\": \"2021-03-10T13:45:39.785465\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}}, \"last_device_update\": \"2021-03-10T13:45:48.440335\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:46:04.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:04 gibba020 bash[9782]: audit 2021-03-10T13:46:03.750672+0000 mon.a (mon.0) 310 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:46:04.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:04 gibba020 bash[9782]: audit 2021-03-10T13:46:03.753958+0000 mon.a (mon.0) 311 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299380\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299439\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299468\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299495\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299521\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:45:40.299547\", \"created\": \"2021-03-10T13:45:39.785465\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}}, \"last_device_update\": \"2021-03-10T13:45:48.440335\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:46:04.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:04 gibba020 bash[9782]: audit 2021-03-10T13:46:04.407319+0000 mon.a (mon.0) 312 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406440\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406500\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406529\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406556\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406581\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406607\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406633\", \"created\": \"2021-03-10T13:46:03.738924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}}, \"last_daemon_update\": \"2021-03-10T13:46:04.406686\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:46:04.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:04 gibba020 bash[9782]: audit 2021-03-10T13:46:04.415844+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406440\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406500\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406529\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406556\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406581\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406607\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406633\", \"created\": \"2021-03-10T13:46:03.738924\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}}, \"last_daemon_update\": \"2021-03-10T13:46:04.406686\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:46:04.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:04 gibba020 bash[9782]: audit 2021-03-10T13:46:04.417725+0000 mon.a (mon.0) 314 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:46:05.174 DEBUG:teuthology.orchestra.run.gibba013:osd.3> sudo journalctl -f -n 0 -u ceph-7672acc8-81a6-11eb-9080-001a4aab830c@osd.3.service 2021-03-10T13:46:05.177 INFO:tasks.cephadm:Deploying osd.4 on gibba020 with /dev/vg_nvme/lv_4... 2021-03-10T13:46:05.177 DEBUG:teuthology.orchestra.run.gibba020:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2021-03-10T13:46:05.204 INFO:journalctl@ceph.osd.3.gibba013.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:46:05.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:05 gibba020 bash[9782]: cluster 2021-03-10T13:46:04.418882+0000 mgr.y (mgr.14140) 97 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail 2021-03-10T13:46:05.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:05 gibba013 bash[9767]: cluster 2021-03-10T13:46:04.418882+0000 mgr.y (mgr.14140) 97 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail 2021-03-10T13:46:05.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:05 gibba013 bash[13024]: cluster 2021-03-10T13:46:04.418882+0000 mgr.y (mgr.14140) 97 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail 2021-03-10T13:46:06.196 INFO:journalctl@ceph.osd.3.gibba013.stdout:Mar 10 13:46:05 gibba013 bash[18982]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-03-10T13:46:06.196 INFO:journalctl@ceph.osd.3.gibba013.stdout:Mar 10 13:46:05 gibba013 bash[18982]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2021-03-10T13:46:06.196 INFO:journalctl@ceph.osd.3.gibba013.stdout:Mar 10 13:46:05 gibba013 bash[18982]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3/block 2021-03-10T13:46:06.196 INFO:journalctl@ceph.osd.3.gibba013.stdout:Mar 10 13:46:05 gibba013 bash[18982]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2021-03-10T13:46:06.197 INFO:journalctl@ceph.osd.3.gibba013.stdout:Mar 10 13:46:05 gibba013 bash[18982]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2021-03-10T13:46:06.197 INFO:journalctl@ceph.osd.3.gibba013.stdout:Mar 10 13:46:05 gibba013 bash[18982]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-03-10T13:46:06.197 INFO:journalctl@ceph.osd.3.gibba013.stdout:Mar 10 13:46:05 gibba013 bash[18982]: --> ceph-volume lvm activate successful for osd ID: 3 2021-03-10T13:46:07.767 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:07 gibba020 bash[9782]: cluster 2021-03-10T13:46:06.419632+0000 mgr.y (mgr.14140) 98 : cluster [DBG] pgmap v92: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail 2021-03-10T13:46:07.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:07 gibba013 bash[9767]: cluster 2021-03-10T13:46:06.419632+0000 mgr.y (mgr.14140) 98 : cluster [DBG] pgmap v92: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail 2021-03-10T13:46:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:07 gibba013 bash[13024]: cluster 2021-03-10T13:46:06.419632+0000 mgr.y (mgr.14140) 98 : cluster [DBG] pgmap v92: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail 2021-03-10T13:46:08.175 INFO:teuthology.orchestra.run.gibba020.stderr:--> Zapping: /dev/vg_nvme/lv_4 2021-03-10T13:46:08.175 INFO:teuthology.orchestra.run.gibba020.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2021-03-10T13:46:08.175 INFO:teuthology.orchestra.run.gibba020.stderr: stderr: 10+0 records in 2021-03-10T13:46:08.176 INFO:teuthology.orchestra.run.gibba020.stderr:10+0 records out 2021-03-10T13:46:08.176 INFO:teuthology.orchestra.run.gibba020.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0160397 s, 654 MB/s 2021-03-10T13:46:08.176 INFO:teuthology.orchestra.run.gibba020.stderr:--> Zapping successful for: 2021-03-10T13:46:08.868 DEBUG:teuthology.orchestra.run.gibba020:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph orch daemon add osd gibba020:vg_nvme/lv_4 2021-03-10T13:46:09.380 INFO:journalctl@ceph.osd.3.gibba013.stdout:Mar 10 13:46:08 gibba013 bash[19325]: debug 2021-03-10T13:46:08.930+0000 7f244e2a7ec0 -1 Falling back to public interface 2021-03-10T13:46:09.771 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:09 gibba020 bash[9782]: cluster 2021-03-10T13:46:08.420466+0000 mgr.y (mgr.14140) 99 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail 2021-03-10T13:46:09.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:09 gibba013 bash[9767]: cluster 2021-03-10T13:46:08.420466+0000 mgr.y (mgr.14140) 99 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail 2021-03-10T13:46:09.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:09 gibba013 bash[13024]: cluster 2021-03-10T13:46:08.420466+0000 mgr.y (mgr.14140) 99 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail 2021-03-10T13:46:09.881 INFO:journalctl@ceph.osd.3.gibba013.stdout:Mar 10 13:46:09 gibba013 bash[19325]: debug 2021-03-10T13:46:09.594+0000 7f244e2a7ec0 -1 osd.3 0 log_to_monitors {default=true} 2021-03-10T13:46:10.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:10 gibba013 bash[9767]: audit 2021-03-10T13:46:09.603088+0000 mon.a (mon.0) 315 : audit [INF] from='osd.3 [v2:172.21.2.113:6826/144091957,v1:172.21.2.113:6827/144091957]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T13:46:10.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:10 gibba013 bash[9767]: audit 2021-03-10T13:46:10.361375+0000 mon.a (mon.0) 316 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:46:10.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:10 gibba013 bash[13024]: audit 2021-03-10T13:46:09.603088+0000 mon.a (mon.0) 315 : audit [INF] from='osd.3 [v2:172.21.2.113:6826/144091957,v1:172.21.2.113:6827/144091957]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T13:46:10.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:10 gibba013 bash[13024]: audit 2021-03-10T13:46:10.361375+0000 mon.a (mon.0) 316 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:46:10.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:10 gibba013 bash[13024]: audit 2021-03-10T13:46:10.458146+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406440\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406500\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406529\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406556\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406581\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406607\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406633\", \"created\": \"2021-03-10T13:46:03.738924\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}}, \"last_daemon_update\": \"2021-03-10T13:46:04.406686\", \"last_device_update\": \"2021-03-10T13:46:10.457486\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:46:10.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:10 gibba013 bash[13024]: audit 2021-03-10T13:46:10.460961+0000 mon.a (mon.0) 318 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406440\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406500\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406529\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406556\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406581\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406607\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406633\", \"created\": \"2021-03-10T13:46:03.738924\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}}, \"last_daemon_update\": \"2021-03-10T13:46:04.406686\", \"last_device_update\": \"2021-03-10T13:46:10.457486\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:46:10.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:10 gibba013 bash[9767]: audit 2021-03-10T13:46:10.458146+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406440\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406500\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406529\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406556\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406581\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406607\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406633\", \"created\": \"2021-03-10T13:46:03.738924\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}}, \"last_daemon_update\": \"2021-03-10T13:46:04.406686\", \"last_device_update\": \"2021-03-10T13:46:10.457486\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:46:10.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:10 gibba013 bash[9767]: audit 2021-03-10T13:46:10.460961+0000 mon.a (mon.0) 318 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406440\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406500\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406529\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406556\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406581\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406607\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406633\", \"created\": \"2021-03-10T13:46:03.738924\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}}, \"last_daemon_update\": \"2021-03-10T13:46:04.406686\", \"last_device_update\": \"2021-03-10T13:46:10.457486\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:46:10.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:10 gibba020 bash[9782]: audit 2021-03-10T13:46:09.603088+0000 mon.a (mon.0) 315 : audit [INF] from='osd.3 [v2:172.21.2.113:6826/144091957,v1:172.21.2.113:6827/144091957]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T13:46:10.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:10 gibba020 bash[9782]: audit 2021-03-10T13:46:10.361375+0000 mon.a (mon.0) 316 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:46:10.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:10 gibba020 bash[9782]: audit 2021-03-10T13:46:10.458146+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406440\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406500\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406529\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406556\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406581\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406607\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406633\", \"created\": \"2021-03-10T13:46:03.738924\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}}, \"last_daemon_update\": \"2021-03-10T13:46:04.406686\", \"last_device_update\": \"2021-03-10T13:46:10.457486\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:46:10.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:10 gibba020 bash[9782]: audit 2021-03-10T13:46:10.460961+0000 mon.a (mon.0) 318 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406440\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406500\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406529\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406556\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406581\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406607\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406633\", \"created\": \"2021-03-10T13:46:03.738924\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}}, \"last_daemon_update\": \"2021-03-10T13:46:04.406686\", \"last_device_update\": \"2021-03-10T13:46:10.457486\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:46:11.881 INFO:journalctl@ceph.osd.3.gibba013.stdout:Mar 10 13:46:11 gibba013 bash[19325]: debug 2021-03-10T13:46:11.530+0000 7f2433054700 -1 osd.3 0 waiting for initial osdmap 2021-03-10T13:46:11.881 INFO:journalctl@ceph.osd.3.gibba013.stdout:Mar 10 13:46:11 gibba013 bash[19325]: debug 2021-03-10T13:46:11.538+0000 7f243e270700 -1 osd.3 26 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:46:11.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:11 gibba013 bash[9767]: cluster 2021-03-10T13:46:10.420833+0000 mgr.y (mgr.14140) 100 : cluster [DBG] pgmap v94: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail 2021-03-10T13:46:11.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:11 gibba013 bash[9767]: audit 2021-03-10T13:46:10.525385+0000 mon.a (mon.0) 319 : audit [INF] from='osd.3 [v2:172.21.2.113:6826/144091957,v1:172.21.2.113:6827/144091957]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-03-10T13:46:11.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:11 gibba013 bash[9767]: cluster 2021-03-10T13:46:10.525409+0000 mon.a (mon.0) 320 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2021-03-10T13:46:11.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:11 gibba013 bash[9767]: audit 2021-03-10T13:46:10.525499+0000 mon.a (mon.0) 321 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:46:11.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:11 gibba013 bash[9767]: audit 2021-03-10T13:46:10.525735+0000 mon.a (mon.0) 322 : audit [INF] from='osd.3 [v2:172.21.2.113:6826/144091957,v1:172.21.2.113:6827/144091957]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:46:11.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:11 gibba013 bash[13024]: cluster 2021-03-10T13:46:10.420833+0000 mgr.y (mgr.14140) 100 : cluster [DBG] pgmap v94: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail 2021-03-10T13:46:11.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:11 gibba013 bash[13024]: audit 2021-03-10T13:46:10.525385+0000 mon.a (mon.0) 319 : audit [INF] from='osd.3 [v2:172.21.2.113:6826/144091957,v1:172.21.2.113:6827/144091957]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-03-10T13:46:11.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:11 gibba013 bash[13024]: cluster 2021-03-10T13:46:10.525409+0000 mon.a (mon.0) 320 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2021-03-10T13:46:11.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:11 gibba013 bash[13024]: audit 2021-03-10T13:46:10.525499+0000 mon.a (mon.0) 321 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:46:11.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:11 gibba013 bash[13024]: audit 2021-03-10T13:46:10.525735+0000 mon.a (mon.0) 322 : audit [INF] from='osd.3 [v2:172.21.2.113:6826/144091957,v1:172.21.2.113:6827/144091957]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:46:11.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:11 gibba020 bash[9782]: cluster 2021-03-10T13:46:10.420833+0000 mgr.y (mgr.14140) 100 : cluster [DBG] pgmap v94: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail 2021-03-10T13:46:11.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:11 gibba020 bash[9782]: audit 2021-03-10T13:46:10.525385+0000 mon.a (mon.0) 319 : audit [INF] from='osd.3 [v2:172.21.2.113:6826/144091957,v1:172.21.2.113:6827/144091957]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-03-10T13:46:11.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:11 gibba020 bash[9782]: cluster 2021-03-10T13:46:10.525409+0000 mon.a (mon.0) 320 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2021-03-10T13:46:11.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:11 gibba020 bash[9782]: audit 2021-03-10T13:46:10.525499+0000 mon.a (mon.0) 321 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:46:11.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:11 gibba020 bash[9782]: audit 2021-03-10T13:46:10.525735+0000 mon.a (mon.0) 322 : audit [INF] from='osd.3 [v2:172.21.2.113:6826/144091957,v1:172.21.2.113:6827/144091957]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:46:12.781 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:12 gibba020 bash[9782]: cluster 2021-03-10T13:46:10.640746+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:46:12.781 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:12 gibba020 bash[9782]: cluster 2021-03-10T13:46:10.640896+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:46:12.781 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:12 gibba020 bash[9782]: audit 2021-03-10T13:46:11.534155+0000 mon.a (mon.0) 323 : audit [INF] from='osd.3 [v2:172.21.2.113:6826/144091957,v1:172.21.2.113:6827/144091957]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]': finished 2021-03-10T13:46:12.781 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:12 gibba020 bash[9782]: cluster 2021-03-10T13:46:11.534217+0000 mon.a (mon.0) 324 : cluster [DBG] osdmap e26: 4 total, 3 up, 3 in 2021-03-10T13:46:12.782 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:12 gibba020 bash[9782]: audit 2021-03-10T13:46:11.535074+0000 mon.a (mon.0) 325 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:46:12.782 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:12 gibba020 bash[9782]: audit 2021-03-10T13:46:11.582503+0000 mgr.y (mgr.14140) 101 : audit [DBG] from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba020:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:46:12.782 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:12 gibba020 bash[9782]: cephadm 2021-03-10T13:46:11.584914+0000 mgr.y (mgr.14140) 102 : cephadm [INF] Applying osd on host gibba020... 2021-03-10T13:46:12.782 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:12 gibba020 bash[9782]: audit 2021-03-10T13:46:11.585716+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:46:12.783 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:12 gibba020 bash[9782]: audit 2021-03-10T13:46:11.588542+0000 mon.a (mon.0) 327 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:46:12.783 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:12 gibba020 bash[9782]: audit 2021-03-10T13:46:11.592513+0000 mon.a (mon.0) 328 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:46:12.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:12 gibba013 bash[9767]: cluster 2021-03-10T13:46:10.640746+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:46:12.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:12 gibba013 bash[9767]: cluster 2021-03-10T13:46:10.640896+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:46:12.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:12 gibba013 bash[9767]: audit 2021-03-10T13:46:11.534155+0000 mon.a (mon.0) 323 : audit [INF] from='osd.3 [v2:172.21.2.113:6826/144091957,v1:172.21.2.113:6827/144091957]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]': finished 2021-03-10T13:46:12.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:12 gibba013 bash[9767]: cluster 2021-03-10T13:46:11.534217+0000 mon.a (mon.0) 324 : cluster [DBG] osdmap e26: 4 total, 3 up, 3 in 2021-03-10T13:46:12.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:12 gibba013 bash[9767]: audit 2021-03-10T13:46:11.535074+0000 mon.a (mon.0) 325 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:46:12.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:12 gibba013 bash[9767]: audit 2021-03-10T13:46:11.582503+0000 mgr.y (mgr.14140) 101 : audit [DBG] from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba020:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:46:12.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:12 gibba013 bash[9767]: cephadm 2021-03-10T13:46:11.584914+0000 mgr.y (mgr.14140) 102 : cephadm [INF] Applying osd on host gibba020... 2021-03-10T13:46:12.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:12 gibba013 bash[9767]: audit 2021-03-10T13:46:11.585716+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:46:12.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:12 gibba013 bash[9767]: audit 2021-03-10T13:46:11.588542+0000 mon.a (mon.0) 327 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:46:12.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:12 gibba013 bash[9767]: audit 2021-03-10T13:46:11.592513+0000 mon.a (mon.0) 328 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:46:12.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:12 gibba013 bash[13024]: cluster 2021-03-10T13:46:10.640746+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:46:12.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:12 gibba013 bash[13024]: cluster 2021-03-10T13:46:10.640896+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:46:12.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:12 gibba013 bash[13024]: audit 2021-03-10T13:46:11.534155+0000 mon.a (mon.0) 323 : audit [INF] from='osd.3 [v2:172.21.2.113:6826/144091957,v1:172.21.2.113:6827/144091957]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]': finished 2021-03-10T13:46:12.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:12 gibba013 bash[13024]: cluster 2021-03-10T13:46:11.534217+0000 mon.a (mon.0) 324 : cluster [DBG] osdmap e26: 4 total, 3 up, 3 in 2021-03-10T13:46:12.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:12 gibba013 bash[13024]: audit 2021-03-10T13:46:11.535074+0000 mon.a (mon.0) 325 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:46:12.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:12 gibba013 bash[13024]: audit 2021-03-10T13:46:11.582503+0000 mgr.y (mgr.14140) 101 : audit [DBG] from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba020:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:46:12.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:12 gibba013 bash[13024]: cephadm 2021-03-10T13:46:11.584914+0000 mgr.y (mgr.14140) 102 : cephadm [INF] Applying osd on host gibba020... 2021-03-10T13:46:12.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:12 gibba013 bash[13024]: audit 2021-03-10T13:46:11.585716+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:46:12.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:12 gibba013 bash[13024]: audit 2021-03-10T13:46:11.588542+0000 mon.a (mon.0) 327 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:46:12.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:12 gibba013 bash[13024]: audit 2021-03-10T13:46:11.592513+0000 mon.a (mon.0) 328 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:46:13.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:13 gibba013 bash[9767]: cluster 2021-03-10T13:46:12.421747+0000 mgr.y (mgr.14140) 103 : cluster [DBG] pgmap v97: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail 2021-03-10T13:46:13.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:13 gibba013 bash[9767]: cluster 2021-03-10T13:46:12.549953+0000 mon.a (mon.0) 329 : cluster [INF] osd.3 [v2:172.21.2.113:6826/144091957,v1:172.21.2.113:6827/144091957] boot 2021-03-10T13:46:13.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:13 gibba013 bash[9767]: cluster 2021-03-10T13:46:12.549983+0000 mon.a (mon.0) 330 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2021-03-10T13:46:13.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:13 gibba013 bash[9767]: audit 2021-03-10T13:46:12.550171+0000 mon.a (mon.0) 331 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:46:13.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:13 gibba013 bash[13024]: cluster 2021-03-10T13:46:12.421747+0000 mgr.y (mgr.14140) 103 : cluster [DBG] pgmap v97: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail 2021-03-10T13:46:13.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:13 gibba013 bash[13024]: cluster 2021-03-10T13:46:12.549953+0000 mon.a (mon.0) 329 : cluster [INF] osd.3 [v2:172.21.2.113:6826/144091957,v1:172.21.2.113:6827/144091957] boot 2021-03-10T13:46:13.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:13 gibba013 bash[13024]: cluster 2021-03-10T13:46:12.549983+0000 mon.a (mon.0) 330 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2021-03-10T13:46:13.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:13 gibba013 bash[13024]: audit 2021-03-10T13:46:12.550171+0000 mon.a (mon.0) 331 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:46:13.924 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:13 gibba020 bash[9782]: cluster 2021-03-10T13:46:12.421747+0000 mgr.y (mgr.14140) 103 : cluster [DBG] pgmap v97: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail 2021-03-10T13:46:13.924 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:13 gibba020 bash[9782]: cluster 2021-03-10T13:46:12.549953+0000 mon.a (mon.0) 329 : cluster [INF] osd.3 [v2:172.21.2.113:6826/144091957,v1:172.21.2.113:6827/144091957] boot 2021-03-10T13:46:13.924 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:13 gibba020 bash[9782]: cluster 2021-03-10T13:46:12.549983+0000 mon.a (mon.0) 330 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2021-03-10T13:46:13.924 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:13 gibba020 bash[9782]: audit 2021-03-10T13:46:12.550171+0000 mon.a (mon.0) 331 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:46:14.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:14 gibba013 bash[9767]: cluster 2021-03-10T13:46:13.565226+0000 mon.a (mon.0) 332 : cluster [DBG] osdmap e28: 4 total, 4 up, 4 in 2021-03-10T13:46:14.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:14 gibba013 bash[9767]: audit 2021-03-10T13:46:14.504626+0000 mon.a (mon.0) 333 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e1ee562f-9cbb-49d7-864e-764dd41860fe"}]: dispatch 2021-03-10T13:46:14.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:14 gibba013 bash[9767]: audit 2021-03-10T13:46:14.506504+0000 mon.b (mon.2) 6 : audit [INF] from='client.? 172.21.2.120:0/3037079084' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e1ee562f-9cbb-49d7-864e-764dd41860fe"}]: dispatch 2021-03-10T13:46:14.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:14 gibba013 bash[9767]: audit 2021-03-10T13:46:14.515614+0000 mon.a (mon.0) 334 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e1ee562f-9cbb-49d7-864e-764dd41860fe"}]': finished 2021-03-10T13:46:14.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:14 gibba013 bash[9767]: cluster 2021-03-10T13:46:14.515657+0000 mon.a (mon.0) 335 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2021-03-10T13:46:14.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:14 gibba013 bash[9767]: audit 2021-03-10T13:46:14.515775+0000 mon.a (mon.0) 336 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:46:14.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:14 gibba013 bash[13024]: cluster 2021-03-10T13:46:13.565226+0000 mon.a (mon.0) 332 : cluster [DBG] osdmap e28: 4 total, 4 up, 4 in 2021-03-10T13:46:14.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:14 gibba013 bash[13024]: audit 2021-03-10T13:46:14.504626+0000 mon.a (mon.0) 333 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e1ee562f-9cbb-49d7-864e-764dd41860fe"}]: dispatch 2021-03-10T13:46:14.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:14 gibba013 bash[13024]: audit 2021-03-10T13:46:14.506504+0000 mon.b (mon.2) 6 : audit [INF] from='client.? 172.21.2.120:0/3037079084' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e1ee562f-9cbb-49d7-864e-764dd41860fe"}]: dispatch 2021-03-10T13:46:14.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:14 gibba013 bash[13024]: audit 2021-03-10T13:46:14.515614+0000 mon.a (mon.0) 334 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e1ee562f-9cbb-49d7-864e-764dd41860fe"}]': finished 2021-03-10T13:46:14.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:14 gibba013 bash[13024]: cluster 2021-03-10T13:46:14.515657+0000 mon.a (mon.0) 335 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2021-03-10T13:46:14.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:14 gibba013 bash[13024]: audit 2021-03-10T13:46:14.515775+0000 mon.a (mon.0) 336 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:46:14.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:14 gibba020 bash[9782]: cluster 2021-03-10T13:46:13.565226+0000 mon.a (mon.0) 332 : cluster [DBG] osdmap e28: 4 total, 4 up, 4 in 2021-03-10T13:46:14.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:14 gibba020 bash[9782]: audit 2021-03-10T13:46:14.504626+0000 mon.a (mon.0) 333 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e1ee562f-9cbb-49d7-864e-764dd41860fe"}]: dispatch 2021-03-10T13:46:14.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:14 gibba020 bash[9782]: audit 2021-03-10T13:46:14.506504+0000 mon.b (mon.2) 6 : audit [INF] from='client.? 172.21.2.120:0/3037079084' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e1ee562f-9cbb-49d7-864e-764dd41860fe"}]: dispatch 2021-03-10T13:46:14.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:14 gibba020 bash[9782]: audit 2021-03-10T13:46:14.515614+0000 mon.a (mon.0) 334 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e1ee562f-9cbb-49d7-864e-764dd41860fe"}]': finished 2021-03-10T13:46:14.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:14 gibba020 bash[9782]: cluster 2021-03-10T13:46:14.515657+0000 mon.a (mon.0) 335 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2021-03-10T13:46:14.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:14 gibba020 bash[9782]: audit 2021-03-10T13:46:14.515775+0000 mon.a (mon.0) 336 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:46:15.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:15 gibba013 bash[9767]: cluster 2021-03-10T13:46:14.422719+0000 mgr.y (mgr.14140) 104 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 864 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:46:15.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:15 gibba013 bash[13024]: cluster 2021-03-10T13:46:14.422719+0000 mgr.y (mgr.14140) 104 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 864 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:46:15.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:15 gibba020 bash[9782]: cluster 2021-03-10T13:46:14.422719+0000 mgr.y (mgr.14140) 104 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 864 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:46:17.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:17 gibba013 bash[9767]: cluster 2021-03-10T13:46:16.423683+0000 mgr.y (mgr.14140) 105 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 944 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:46:17.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:17 gibba013 bash[9767]: audit 2021-03-10T13:46:16.602920+0000 mon.b (mon.2) 7 : audit [DBG] from='client.? 172.21.2.120:0/1874097016' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:46:17.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:17 gibba013 bash[13024]: cluster 2021-03-10T13:46:16.423683+0000 mgr.y (mgr.14140) 105 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 944 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:46:17.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:17 gibba013 bash[13024]: audit 2021-03-10T13:46:16.602920+0000 mon.b (mon.2) 7 : audit [DBG] from='client.? 172.21.2.120:0/1874097016' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:46:17.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:17 gibba020 bash[9782]: cluster 2021-03-10T13:46:16.423683+0000 mgr.y (mgr.14140) 105 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 944 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:46:17.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:17 gibba020 bash[9782]: audit 2021-03-10T13:46:16.602920+0000 mon.b (mon.2) 7 : audit [DBG] from='client.? 172.21.2.120:0/1874097016' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:46:19.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:19 gibba013 bash[9767]: cluster 2021-03-10T13:46:18.424584+0000 mgr.y (mgr.14140) 106 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 976 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:46:19.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:19 gibba013 bash[9767]: audit 2021-03-10T13:46:19.131128+0000 mon.a (mon.0) 337 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:46:19.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:19 gibba013 bash[13024]: cluster 2021-03-10T13:46:18.424584+0000 mgr.y (mgr.14140) 106 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 976 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:46:19.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:19 gibba013 bash[13024]: audit 2021-03-10T13:46:19.131128+0000 mon.a (mon.0) 337 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:46:19.896 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:19 gibba020 bash[9782]: cluster 2021-03-10T13:46:18.424584+0000 mgr.y (mgr.14140) 106 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 976 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:46:19.896 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:19 gibba020 bash[9782]: audit 2021-03-10T13:46:19.131128+0000 mon.a (mon.0) 337 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:46:21.641 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:21 gibba020 bash[9782]: cluster 2021-03-10T13:46:20.425040+0000 mgr.y (mgr.14140) 107 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:46:21.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:21 gibba013 bash[9767]: cluster 2021-03-10T13:46:20.425040+0000 mgr.y (mgr.14140) 107 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:46:21.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:21 gibba013 bash[13024]: cluster 2021-03-10T13:46:20.425040+0000 mgr.y (mgr.14140) 107 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:46:22.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:22 gibba020 bash[9782]: audit 2021-03-10T13:46:22.156960+0000 mon.a (mon.0) 338 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2021-03-10T13:46:22.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:22 gibba020 bash[9782]: audit 2021-03-10T13:46:22.159873+0000 mon.a (mon.0) 339 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:46:22.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:22 gibba020 bash[9782]: audit 2021-03-10T13:46:22.163293+0000 mon.a (mon.0) 340 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2021-03-10T13:46:22.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:22 gibba013 bash[9767]: audit 2021-03-10T13:46:22.156960+0000 mon.a (mon.0) 338 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2021-03-10T13:46:22.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:22 gibba013 bash[9767]: audit 2021-03-10T13:46:22.159873+0000 mon.a (mon.0) 339 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:46:22.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:22 gibba013 bash[9767]: audit 2021-03-10T13:46:22.163293+0000 mon.a (mon.0) 340 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2021-03-10T13:46:22.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:22 gibba013 bash[13024]: audit 2021-03-10T13:46:22.156960+0000 mon.a (mon.0) 338 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2021-03-10T13:46:22.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:22 gibba013 bash[13024]: audit 2021-03-10T13:46:22.159873+0000 mon.a (mon.0) 339 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:46:22.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:22 gibba013 bash[13024]: audit 2021-03-10T13:46:22.163293+0000 mon.a (mon.0) 340 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2021-03-10T13:46:23.778 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:23 gibba020 bash[9782]: cephadm 2021-03-10T13:46:22.162350+0000 mgr.y (mgr.14140) 108 : cephadm [INF] Deploying daemon osd.4 on gibba020 2021-03-10T13:46:23.779 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:23 gibba020 bash[9782]: cluster 2021-03-10T13:46:22.425576+0000 mgr.y (mgr.14140) 109 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:46:23.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:23 gibba013 bash[9767]: cephadm 2021-03-10T13:46:22.162350+0000 mgr.y (mgr.14140) 108 : cephadm [INF] Deploying daemon osd.4 on gibba020 2021-03-10T13:46:23.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:23 gibba013 bash[9767]: cluster 2021-03-10T13:46:22.425576+0000 mgr.y (mgr.14140) 109 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:46:23.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:23 gibba013 bash[13024]: cephadm 2021-03-10T13:46:22.162350+0000 mgr.y (mgr.14140) 108 : cephadm [INF] Deploying daemon osd.4 on gibba020 2021-03-10T13:46:23.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:23 gibba013 bash[13024]: cluster 2021-03-10T13:46:22.425576+0000 mgr.y (mgr.14140) 109 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:46:23.890 INFO:teuthology.orchestra.run.gibba020.stdout:Created osd(s) 4 on host 'gibba020' 2021-03-10T13:46:24.619 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:24 gibba020 bash[9782]: audit 2021-03-10T13:46:23.878461+0000 mon.a (mon.0) 341 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:43.234860\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:43.235126\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:43.235291\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}}, \"last_device_update\": \"2021-03-10T13:43:57.842752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:46:24.619 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:24 gibba020 bash[9782]: audit 2021-03-10T13:46:23.880233+0000 mon.a (mon.0) 342 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:46:24.620 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:24 gibba020 bash[9782]: audit 2021-03-10T13:46:23.887232+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:43.234860\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:43.235126\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:43.235291\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}}, \"last_device_update\": \"2021-03-10T13:43:57.842752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:46:24.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:24 gibba013 bash[9767]: audit 2021-03-10T13:46:23.878461+0000 mon.a (mon.0) 341 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:43.234860\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:43.235126\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:43.235291\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}}, \"last_device_update\": \"2021-03-10T13:43:57.842752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:46:24.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:24 gibba013 bash[9767]: audit 2021-03-10T13:46:23.880233+0000 mon.a (mon.0) 342 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:46:24.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:24 gibba013 bash[9767]: audit 2021-03-10T13:46:23.887232+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:43.234860\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:43.235126\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:43.235291\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}}, \"last_device_update\": \"2021-03-10T13:43:57.842752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:46:24.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:24 gibba013 bash[13024]: audit 2021-03-10T13:46:23.878461+0000 mon.a (mon.0) 341 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:43.234860\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:43.235126\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:43.235291\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}}, \"last_device_update\": \"2021-03-10T13:43:57.842752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:46:24.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:24 gibba013 bash[13024]: audit 2021-03-10T13:46:23.880233+0000 mon.a (mon.0) 342 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:46:24.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:24 gibba013 bash[13024]: audit 2021-03-10T13:46:23.887232+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:43.234860\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:43.235126\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:44:43.235291\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}}, \"last_device_update\": \"2021-03-10T13:43:57.842752\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:46:25.131 DEBUG:teuthology.orchestra.run.gibba020:osd.4> sudo journalctl -f -n 0 -u ceph-7672acc8-81a6-11eb-9080-001a4aab830c@osd.4.service 2021-03-10T13:46:25.134 INFO:tasks.cephadm:Deploying osd.5 on gibba020 with /dev/vg_nvme/lv_3... 2021-03-10T13:46:25.135 DEBUG:teuthology.orchestra.run.gibba020:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2021-03-10T13:46:25.222 INFO:journalctl@ceph.osd.4.gibba020.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:46:25.823 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:25 gibba020 bash[9782]: cluster 2021-03-10T13:46:24.426460+0000 mgr.y (mgr.14140) 110 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:46:25.824 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:25 gibba020 bash[9782]: audit 2021-03-10T13:46:24.491395+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488332\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488622\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488815\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488976\", \"created\": \"2021-03-10T13:46:23.866010\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}}, \"last_daemon_update\": \"2021-03-10T13:46:24.489275\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:46:25.824 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:25 gibba020 bash[9782]: audit 2021-03-10T13:46:24.500822+0000 mon.a (mon.0) 345 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488332\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488622\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488815\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488976\", \"created\": \"2021-03-10T13:46:23.866010\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}}, \"last_daemon_update\": \"2021-03-10T13:46:24.489275\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:46:25.824 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:25 gibba020 bash[9782]: audit 2021-03-10T13:46:24.501430+0000 mon.a (mon.0) 346 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:46:25.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:25 gibba013 bash[9767]: cluster 2021-03-10T13:46:24.426460+0000 mgr.y (mgr.14140) 110 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:46:25.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:25 gibba013 bash[13024]: cluster 2021-03-10T13:46:24.426460+0000 mgr.y (mgr.14140) 110 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:46:25.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:25 gibba013 bash[9767]: audit 2021-03-10T13:46:24.491395+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488332\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488622\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488815\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488976\", \"created\": \"2021-03-10T13:46:23.866010\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}}, \"last_daemon_update\": \"2021-03-10T13:46:24.489275\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:46:25.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:25 gibba013 bash[13024]: audit 2021-03-10T13:46:24.491395+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488332\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488622\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488815\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488976\", \"created\": \"2021-03-10T13:46:23.866010\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}}, \"last_daemon_update\": \"2021-03-10T13:46:24.489275\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:46:25.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:25 gibba013 bash[9767]: audit 2021-03-10T13:46:24.500822+0000 mon.a (mon.0) 345 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488332\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488622\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488815\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488976\", \"created\": \"2021-03-10T13:46:23.866010\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}}, \"last_daemon_update\": \"2021-03-10T13:46:24.489275\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:46:25.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:25 gibba013 bash[9767]: audit 2021-03-10T13:46:24.501430+0000 mon.a (mon.0) 346 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:46:25.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:25 gibba013 bash[13024]: audit 2021-03-10T13:46:24.500822+0000 mon.a (mon.0) 345 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488332\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488622\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488815\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488976\", \"created\": \"2021-03-10T13:46:23.866010\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}}, \"last_daemon_update\": \"2021-03-10T13:46:24.489275\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:46:25.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:25 gibba013 bash[13024]: audit 2021-03-10T13:46:24.501430+0000 mon.a (mon.0) 346 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:46:26.355 INFO:journalctl@ceph.osd.4.gibba020.stdout:Mar 10 13:46:26 gibba020 bash[11875]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-03-10T13:46:26.355 INFO:journalctl@ceph.osd.4.gibba020.stdout:Mar 10 13:46:26 gibba020 bash[11875]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2021-03-10T13:46:26.356 INFO:journalctl@ceph.osd.4.gibba020.stdout:Mar 10 13:46:26 gibba020 bash[11875]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4/block 2021-03-10T13:46:26.356 INFO:journalctl@ceph.osd.4.gibba020.stdout:Mar 10 13:46:26 gibba020 bash[11875]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2021-03-10T13:46:26.356 INFO:journalctl@ceph.osd.4.gibba020.stdout:Mar 10 13:46:26 gibba020 bash[11875]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2021-03-10T13:46:26.356 INFO:journalctl@ceph.osd.4.gibba020.stdout:Mar 10 13:46:26 gibba020 bash[11875]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-03-10T13:46:26.357 INFO:journalctl@ceph.osd.4.gibba020.stdout:Mar 10 13:46:26 gibba020 bash[11875]: --> ceph-volume lvm activate successful for osd ID: 4 2021-03-10T13:46:27.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:27 gibba020 bash[9782]: cluster 2021-03-10T13:46:26.427223+0000 mgr.y (mgr.14140) 111 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:46:27.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:27 gibba013 bash[9767]: cluster 2021-03-10T13:46:26.427223+0000 mgr.y (mgr.14140) 111 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:46:27.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:27 gibba013 bash[13024]: cluster 2021-03-10T13:46:26.427223+0000 mgr.y (mgr.14140) 111 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:46:29.445 INFO:journalctl@ceph.osd.4.gibba020.stdout:Mar 10 13:46:29 gibba020 bash[12207]: debug 2021-03-10T13:46:29.226+0000 7f593dda0ec0 1 -- 172.21.2.120:0/3861663507 >> [v2:172.21.2.120:3300/0,v1:172.21.2.120:6789/0] conn(0x55ff91e1ec00 msgr2=0x55ff91e1b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-10T13:46:29.445 INFO:journalctl@ceph.osd.4.gibba020.stdout:Mar 10 13:46:29 gibba020 bash[12207]: debug 2021-03-10T13:46:29.226+0000 7f593dda0ec0 1 --2- 172.21.2.120:0/3861663507 >> [v2:172.21.2.120:3300/0,v1:172.21.2.120:6789/0] conn(0x55ff91e1ec00 0x55ff91e1b680 secure :-1 s=READY pgs=17 cs=0 l=1 rx=0x55ff91db5d10 tx=0x55ff92a94aa0).stop 2021-03-10T13:46:29.794 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:29 gibba020 bash[9782]: cluster 2021-03-10T13:46:28.428188+0000 mgr.y (mgr.14140) 112 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:46:29.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:29 gibba013 bash[9767]: cluster 2021-03-10T13:46:28.428188+0000 mgr.y (mgr.14140) 112 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:46:29.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:29 gibba013 bash[13024]: cluster 2021-03-10T13:46:28.428188+0000 mgr.y (mgr.14140) 112 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:46:30.063 INFO:journalctl@ceph.osd.4.gibba020.stdout:Mar 10 13:46:29 gibba020 bash[12207]: debug 2021-03-10T13:46:29.790+0000 7f593dda0ec0 -1 Falling back to public interface 2021-03-10T13:46:30.524 INFO:teuthology.orchestra.run.gibba020.stderr:--> Zapping: /dev/vg_nvme/lv_3 2021-03-10T13:46:30.525 INFO:teuthology.orchestra.run.gibba020.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2021-03-10T13:46:30.525 INFO:teuthology.orchestra.run.gibba020.stderr: stderr: 10+0 records in 2021-03-10T13:46:30.525 INFO:teuthology.orchestra.run.gibba020.stderr:10+0 records out 2021-03-10T13:46:30.525 INFO:teuthology.orchestra.run.gibba020.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00778507 s, 1.3 GB/s 2021-03-10T13:46:30.525 INFO:teuthology.orchestra.run.gibba020.stderr:--> Zapping successful for: 2021-03-10T13:46:30.945 INFO:journalctl@ceph.osd.4.gibba020.stdout:Mar 10 13:46:30 gibba020 bash[12207]: debug 2021-03-10T13:46:30.466+0000 7f593dda0ec0 -1 osd.4 0 log_to_monitors {default=true} 2021-03-10T13:46:31.209 DEBUG:teuthology.orchestra.run.gibba020:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph orch daemon add osd gibba020:vg_nvme/lv_3 2021-03-10T13:46:31.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:31 gibba020 bash[9782]: cluster 2021-03-10T13:46:30.428723+0000 mgr.y (mgr.14140) 113 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:46:31.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:31 gibba020 bash[9782]: audit 2021-03-10T13:46:30.468423+0000 mon.a (mon.0) 347 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T13:46:31.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:31 gibba020 bash[9782]: audit 2021-03-10T13:46:30.471264+0000 mon.b (mon.2) 8 : audit [INF] from='osd.4 [v2:172.21.2.120:6800/319375890,v1:172.21.2.120:6801/319375890]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T13:46:31.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:31 gibba013 bash[9767]: cluster 2021-03-10T13:46:30.428723+0000 mgr.y (mgr.14140) 113 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:46:31.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:31 gibba013 bash[9767]: audit 2021-03-10T13:46:30.468423+0000 mon.a (mon.0) 347 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T13:46:31.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:31 gibba013 bash[9767]: audit 2021-03-10T13:46:30.471264+0000 mon.b (mon.2) 8 : audit [INF] from='osd.4 [v2:172.21.2.120:6800/319375890,v1:172.21.2.120:6801/319375890]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T13:46:31.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:31 gibba013 bash[13024]: cluster 2021-03-10T13:46:30.428723+0000 mgr.y (mgr.14140) 113 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:46:31.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:31 gibba013 bash[13024]: audit 2021-03-10T13:46:30.468423+0000 mon.a (mon.0) 347 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T13:46:31.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:31 gibba013 bash[13024]: audit 2021-03-10T13:46:30.471264+0000 mon.b (mon.2) 8 : audit [INF] from='osd.4 [v2:172.21.2.120:6800/319375890,v1:172.21.2.120:6801/319375890]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T13:46:32.695 INFO:journalctl@ceph.osd.4.gibba020.stdout:Mar 10 13:46:32 gibba020 bash[12207]: debug 2021-03-10T13:46:32.450+0000 7f5926b55700 -1 osd.4 0 waiting for initial osdmap 2021-03-10T13:46:32.696 INFO:journalctl@ceph.osd.4.gibba020.stdout:Mar 10 13:46:32 gibba020 bash[12207]: debug 2021-03-10T13:46:32.466+0000 7f5931d71700 -1 osd.4 31 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:46:32.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:32 gibba020 bash[9782]: audit 2021-03-10T13:46:31.430529+0000 mon.a (mon.0) 348 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-03-10T13:46:32.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:32 gibba020 bash[9782]: cluster 2021-03-10T13:46:31.430552+0000 mon.a (mon.0) 349 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2021-03-10T13:46:32.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:32 gibba020 bash[9782]: audit 2021-03-10T13:46:31.430626+0000 mon.a (mon.0) 350 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:46:32.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:32 gibba020 bash[9782]: audit 2021-03-10T13:46:31.437546+0000 mon.a (mon.0) 351 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:46:32.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:32 gibba020 bash[9782]: audit 2021-03-10T13:46:31.440526+0000 mon.b (mon.2) 9 : audit [INF] from='osd.4 [v2:172.21.2.120:6800/319375890,v1:172.21.2.120:6801/319375890]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:46:32.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:32 gibba020 bash[9782]: audit 2021-03-10T13:46:31.854091+0000 mon.a (mon.0) 352 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:46:32.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:32 gibba020 bash[9782]: audit 2021-03-10T13:46:31.968452+0000 mon.a (mon.0) 353 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488332\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488622\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488815\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488976\", \"created\": \"2021-03-10T13:46:23.866010\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}}, \"last_daemon_update\": \"2021-03-10T13:46:24.489275\", \"last_device_update\": \"2021-03-10T13:46:31.966426\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:46:32.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:32 gibba020 bash[9782]: audit 2021-03-10T13:46:31.977176+0000 mon.a (mon.0) 354 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488332\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488622\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488815\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488976\", \"created\": \"2021-03-10T13:46:23.866010\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}}, \"last_daemon_update\": \"2021-03-10T13:46:24.489275\", \"last_device_update\": \"2021-03-10T13:46:31.966426\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:46:32.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:32 gibba013 bash[9767]: audit 2021-03-10T13:46:31.430529+0000 mon.a (mon.0) 348 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-03-10T13:46:32.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:32 gibba013 bash[9767]: cluster 2021-03-10T13:46:31.430552+0000 mon.a (mon.0) 349 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2021-03-10T13:46:32.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:32 gibba013 bash[9767]: audit 2021-03-10T13:46:31.430626+0000 mon.a (mon.0) 350 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:46:32.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:32 gibba013 bash[9767]: audit 2021-03-10T13:46:31.437546+0000 mon.a (mon.0) 351 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:46:32.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:32 gibba013 bash[9767]: audit 2021-03-10T13:46:31.440526+0000 mon.b (mon.2) 9 : audit [INF] from='osd.4 [v2:172.21.2.120:6800/319375890,v1:172.21.2.120:6801/319375890]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:46:32.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:32 gibba013 bash[9767]: audit 2021-03-10T13:46:31.854091+0000 mon.a (mon.0) 352 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:46:32.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:32 gibba013 bash[13024]: audit 2021-03-10T13:46:31.430529+0000 mon.a (mon.0) 348 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-03-10T13:46:32.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:32 gibba013 bash[13024]: cluster 2021-03-10T13:46:31.430552+0000 mon.a (mon.0) 349 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2021-03-10T13:46:32.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:32 gibba013 bash[13024]: audit 2021-03-10T13:46:31.430626+0000 mon.a (mon.0) 350 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:46:32.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:32 gibba013 bash[13024]: audit 2021-03-10T13:46:31.437546+0000 mon.a (mon.0) 351 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:46:32.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:32 gibba013 bash[13024]: audit 2021-03-10T13:46:31.440526+0000 mon.b (mon.2) 9 : audit [INF] from='osd.4 [v2:172.21.2.120:6800/319375890,v1:172.21.2.120:6801/319375890]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:46:32.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:32 gibba013 bash[13024]: audit 2021-03-10T13:46:31.854091+0000 mon.a (mon.0) 352 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:46:32.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:32 gibba013 bash[9767]: audit 2021-03-10T13:46:31.968452+0000 mon.a (mon.0) 353 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488332\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488622\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488815\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488976\", \"created\": \"2021-03-10T13:46:23.866010\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}}, \"last_daemon_update\": \"2021-03-10T13:46:24.489275\", \"last_device_update\": \"2021-03-10T13:46:31.966426\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:46:32.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:32 gibba013 bash[9767]: audit 2021-03-10T13:46:31.977176+0000 mon.a (mon.0) 354 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488332\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488622\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488815\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488976\", \"created\": \"2021-03-10T13:46:23.866010\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}}, \"last_daemon_update\": \"2021-03-10T13:46:24.489275\", \"last_device_update\": \"2021-03-10T13:46:31.966426\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:46:32.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:32 gibba013 bash[13024]: audit 2021-03-10T13:46:31.968452+0000 mon.a (mon.0) 353 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488332\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488622\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488815\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488976\", \"created\": \"2021-03-10T13:46:23.866010\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}}, \"last_daemon_update\": \"2021-03-10T13:46:24.489275\", \"last_device_update\": \"2021-03-10T13:46:31.966426\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:46:32.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:32 gibba013 bash[13024]: audit 2021-03-10T13:46:31.977176+0000 mon.a (mon.0) 354 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488332\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488622\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488815\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488976\", \"created\": \"2021-03-10T13:46:23.866010\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}}, \"last_daemon_update\": \"2021-03-10T13:46:24.489275\", \"last_device_update\": \"2021-03-10T13:46:31.966426\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:46:33.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:33 gibba013 bash[9767]: cluster 2021-03-10T13:46:31.489165+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:46:33.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:33 gibba013 bash[9767]: cluster 2021-03-10T13:46:31.489216+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:46:33.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:33 gibba013 bash[9767]: cluster 2021-03-10T13:46:32.429409+0000 mgr.y (mgr.14140) 114 : cluster [DBG] pgmap v111: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:46:33.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:33 gibba013 bash[9767]: audit 2021-03-10T13:46:32.439653+0000 mon.a (mon.0) 355 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]': finished 2021-03-10T13:46:33.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:33 gibba013 bash[9767]: cluster 2021-03-10T13:46:32.439729+0000 mon.a (mon.0) 356 : cluster [DBG] osdmap e31: 5 total, 4 up, 4 in 2021-03-10T13:46:33.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:33 gibba013 bash[9767]: audit 2021-03-10T13:46:32.440405+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:46:33.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:33 gibba013 bash[13024]: cluster 2021-03-10T13:46:31.489165+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:46:33.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:33 gibba013 bash[13024]: cluster 2021-03-10T13:46:31.489216+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:46:33.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:33 gibba013 bash[13024]: cluster 2021-03-10T13:46:32.429409+0000 mgr.y (mgr.14140) 114 : cluster [DBG] pgmap v111: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:46:33.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:33 gibba013 bash[13024]: audit 2021-03-10T13:46:32.439653+0000 mon.a (mon.0) 355 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]': finished 2021-03-10T13:46:33.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:33 gibba013 bash[13024]: cluster 2021-03-10T13:46:32.439729+0000 mon.a (mon.0) 356 : cluster [DBG] osdmap e31: 5 total, 4 up, 4 in 2021-03-10T13:46:33.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:33 gibba013 bash[13024]: audit 2021-03-10T13:46:32.440405+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:46:33.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:33 gibba020 bash[9782]: cluster 2021-03-10T13:46:31.489165+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:46:33.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:33 gibba020 bash[9782]: cluster 2021-03-10T13:46:31.489216+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:46:33.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:33 gibba020 bash[9782]: cluster 2021-03-10T13:46:32.429409+0000 mgr.y (mgr.14140) 114 : cluster [DBG] pgmap v111: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:46:33.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:33 gibba020 bash[9782]: audit 2021-03-10T13:46:32.439653+0000 mon.a (mon.0) 355 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]': finished 2021-03-10T13:46:33.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:33 gibba020 bash[9782]: cluster 2021-03-10T13:46:32.439729+0000 mon.a (mon.0) 356 : cluster [DBG] osdmap e31: 5 total, 4 up, 4 in 2021-03-10T13:46:33.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:33 gibba020 bash[9782]: audit 2021-03-10T13:46:32.440405+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:46:34.813 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:34 gibba020 bash[9782]: cluster 2021-03-10T13:46:33.454694+0000 mon.a (mon.0) 358 : cluster [INF] osd.4 [v2:172.21.2.120:6800/319375890,v1:172.21.2.120:6801/319375890] boot 2021-03-10T13:46:34.814 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:34 gibba020 bash[9782]: cluster 2021-03-10T13:46:33.454761+0000 mon.a (mon.0) 359 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2021-03-10T13:46:34.814 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:34 gibba020 bash[9782]: audit 2021-03-10T13:46:33.455407+0000 mon.a (mon.0) 360 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:46:34.814 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:34 gibba020 bash[9782]: audit 2021-03-10T13:46:33.887542+0000 mgr.y (mgr.14140) 115 : audit [DBG] from='client.34157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba020:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:46:34.815 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:34 gibba020 bash[9782]: cephadm 2021-03-10T13:46:33.889499+0000 mgr.y (mgr.14140) 116 : cephadm [INF] Applying osd on host gibba020... 2021-03-10T13:46:34.815 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:34 gibba020 bash[9782]: audit 2021-03-10T13:46:33.890297+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:46:34.815 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:34 gibba020 bash[9782]: audit 2021-03-10T13:46:33.893160+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:46:34.815 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:34 gibba020 bash[9782]: audit 2021-03-10T13:46:33.897232+0000 mon.a (mon.0) 363 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:46:34.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:34 gibba013 bash[9767]: cluster 2021-03-10T13:46:33.454694+0000 mon.a (mon.0) 358 : cluster [INF] osd.4 [v2:172.21.2.120:6800/319375890,v1:172.21.2.120:6801/319375890] boot 2021-03-10T13:46:34.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:34 gibba013 bash[9767]: cluster 2021-03-10T13:46:33.454761+0000 mon.a (mon.0) 359 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2021-03-10T13:46:34.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:34 gibba013 bash[9767]: audit 2021-03-10T13:46:33.455407+0000 mon.a (mon.0) 360 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:46:34.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:34 gibba013 bash[9767]: audit 2021-03-10T13:46:33.887542+0000 mgr.y (mgr.14140) 115 : audit [DBG] from='client.34157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba020:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:46:34.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:34 gibba013 bash[9767]: cephadm 2021-03-10T13:46:33.889499+0000 mgr.y (mgr.14140) 116 : cephadm [INF] Applying osd on host gibba020... 2021-03-10T13:46:34.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:34 gibba013 bash[9767]: audit 2021-03-10T13:46:33.890297+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:46:34.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:34 gibba013 bash[9767]: audit 2021-03-10T13:46:33.893160+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:46:34.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:34 gibba013 bash[9767]: audit 2021-03-10T13:46:33.897232+0000 mon.a (mon.0) 363 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:46:34.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:34 gibba013 bash[13024]: cluster 2021-03-10T13:46:33.454694+0000 mon.a (mon.0) 358 : cluster [INF] osd.4 [v2:172.21.2.120:6800/319375890,v1:172.21.2.120:6801/319375890] boot 2021-03-10T13:46:34.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:34 gibba013 bash[13024]: cluster 2021-03-10T13:46:33.454761+0000 mon.a (mon.0) 359 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2021-03-10T13:46:34.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:34 gibba013 bash[13024]: audit 2021-03-10T13:46:33.455407+0000 mon.a (mon.0) 360 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:46:34.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:34 gibba013 bash[13024]: audit 2021-03-10T13:46:33.887542+0000 mgr.y (mgr.14140) 115 : audit [DBG] from='client.34157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba020:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:46:34.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:34 gibba013 bash[13024]: cephadm 2021-03-10T13:46:33.889499+0000 mgr.y (mgr.14140) 116 : cephadm [INF] Applying osd on host gibba020... 2021-03-10T13:46:34.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:34 gibba013 bash[13024]: audit 2021-03-10T13:46:33.890297+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:46:34.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:34 gibba013 bash[13024]: audit 2021-03-10T13:46:33.893160+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:46:34.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:34 gibba013 bash[13024]: audit 2021-03-10T13:46:33.897232+0000 mon.a (mon.0) 363 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:46:35.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:35 gibba013 bash[9767]: cluster 2021-03-10T13:46:34.430320+0000 mgr.y (mgr.14140) 117 : cluster [DBG] pgmap v114: 1 pgs: 1 peering; 0 B data, 1016 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:46:35.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:35 gibba013 bash[9767]: cluster 2021-03-10T13:46:34.467075+0000 mon.a (mon.0) 364 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2021-03-10T13:46:35.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:35 gibba013 bash[13024]: cluster 2021-03-10T13:46:34.430320+0000 mgr.y (mgr.14140) 117 : cluster [DBG] pgmap v114: 1 pgs: 1 peering; 0 B data, 1016 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:46:35.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:35 gibba013 bash[13024]: cluster 2021-03-10T13:46:34.467075+0000 mon.a (mon.0) 364 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2021-03-10T13:46:35.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:35 gibba020 bash[9782]: cluster 2021-03-10T13:46:34.430320+0000 mgr.y (mgr.14140) 117 : cluster [DBG] pgmap v114: 1 pgs: 1 peering; 0 B data, 1016 KiB used, 332 GiB / 336 GiB avail 2021-03-10T13:46:35.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:35 gibba020 bash[9782]: cluster 2021-03-10T13:46:34.467075+0000 mon.a (mon.0) 364 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2021-03-10T13:46:37.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:37 gibba013 bash[9767]: cluster 2021-03-10T13:46:36.431247+0000 mgr.y (mgr.14140) 118 : cluster [DBG] pgmap v116: 1 pgs: 1 peering; 0 B data, 1.3 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:46:37.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:37 gibba013 bash[9767]: audit 2021-03-10T13:46:36.966316+0000 mon.a (mon.0) 365 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "81a906b6-e201-49ad-ae65-0e049d746e98"}]: dispatch 2021-03-10T13:46:37.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:37 gibba013 bash[9767]: audit 2021-03-10T13:46:36.968521+0000 mon.b (mon.2) 10 : audit [INF] from='client.? 172.21.2.120:0/2457357025' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "81a906b6-e201-49ad-ae65-0e049d746e98"}]: dispatch 2021-03-10T13:46:37.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:37 gibba013 bash[9767]: audit 2021-03-10T13:46:36.977604+0000 mon.a (mon.0) 366 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "81a906b6-e201-49ad-ae65-0e049d746e98"}]': finished 2021-03-10T13:46:37.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:37 gibba013 bash[9767]: cluster 2021-03-10T13:46:36.977694+0000 mon.a (mon.0) 367 : cluster [DBG] osdmap e34: 6 total, 5 up, 5 in 2021-03-10T13:46:37.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:37 gibba013 bash[9767]: audit 2021-03-10T13:46:36.977842+0000 mon.a (mon.0) 368 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:46:37.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:37 gibba013 bash[13024]: cluster 2021-03-10T13:46:36.431247+0000 mgr.y (mgr.14140) 118 : cluster [DBG] pgmap v116: 1 pgs: 1 peering; 0 B data, 1.3 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:46:37.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:37 gibba013 bash[13024]: audit 2021-03-10T13:46:36.966316+0000 mon.a (mon.0) 365 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "81a906b6-e201-49ad-ae65-0e049d746e98"}]: dispatch 2021-03-10T13:46:37.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:37 gibba013 bash[13024]: audit 2021-03-10T13:46:36.968521+0000 mon.b (mon.2) 10 : audit [INF] from='client.? 172.21.2.120:0/2457357025' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "81a906b6-e201-49ad-ae65-0e049d746e98"}]: dispatch 2021-03-10T13:46:37.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:37 gibba013 bash[13024]: audit 2021-03-10T13:46:36.977604+0000 mon.a (mon.0) 366 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "81a906b6-e201-49ad-ae65-0e049d746e98"}]': finished 2021-03-10T13:46:37.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:37 gibba013 bash[13024]: cluster 2021-03-10T13:46:36.977694+0000 mon.a (mon.0) 367 : cluster [DBG] osdmap e34: 6 total, 5 up, 5 in 2021-03-10T13:46:37.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:37 gibba013 bash[13024]: audit 2021-03-10T13:46:36.977842+0000 mon.a (mon.0) 368 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:46:37.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:37 gibba020 bash[9782]: cluster 2021-03-10T13:46:36.431247+0000 mgr.y (mgr.14140) 118 : cluster [DBG] pgmap v116: 1 pgs: 1 peering; 0 B data, 1.3 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:46:37.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:37 gibba020 bash[9782]: audit 2021-03-10T13:46:36.966316+0000 mon.a (mon.0) 365 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "81a906b6-e201-49ad-ae65-0e049d746e98"}]: dispatch 2021-03-10T13:46:37.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:37 gibba020 bash[9782]: audit 2021-03-10T13:46:36.968521+0000 mon.b (mon.2) 10 : audit [INF] from='client.? 172.21.2.120:0/2457357025' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "81a906b6-e201-49ad-ae65-0e049d746e98"}]: dispatch 2021-03-10T13:46:37.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:37 gibba020 bash[9782]: audit 2021-03-10T13:46:36.977604+0000 mon.a (mon.0) 366 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "81a906b6-e201-49ad-ae65-0e049d746e98"}]': finished 2021-03-10T13:46:37.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:37 gibba020 bash[9782]: cluster 2021-03-10T13:46:36.977694+0000 mon.a (mon.0) 367 : cluster [DBG] osdmap e34: 6 total, 5 up, 5 in 2021-03-10T13:46:37.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:37 gibba020 bash[9782]: audit 2021-03-10T13:46:36.977842+0000 mon.a (mon.0) 368 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:46:39.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:39 gibba013 bash[9767]: cluster 2021-03-10T13:46:38.432221+0000 mgr.y (mgr.14140) 119 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:46:40.182 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:39 gibba013 bash[9767]: audit 2021-03-10T13:46:39.068835+0000 mon.b (mon.2) 11 : audit [DBG] from='client.? 172.21.2.120:0/3458049418' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:46:40.183 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:39 gibba013 bash[13024]: cluster 2021-03-10T13:46:38.432221+0000 mgr.y (mgr.14140) 119 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:46:40.183 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:39 gibba013 bash[13024]: audit 2021-03-10T13:46:39.068835+0000 mon.b (mon.2) 11 : audit [DBG] from='client.? 172.21.2.120:0/3458049418' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:46:40.184 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:39 gibba020 bash[9782]: cluster 2021-03-10T13:46:38.432221+0000 mgr.y (mgr.14140) 119 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:46:40.184 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:39 gibba020 bash[9782]: audit 2021-03-10T13:46:39.068835+0000 mon.b (mon.2) 11 : audit [DBG] from='client.? 172.21.2.120:0/3458049418' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:46:41.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:41 gibba020 bash[9782]: cluster 2021-03-10T13:46:40.432550+0000 mgr.y (mgr.14140) 120 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:46:41.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:41 gibba013 bash[9767]: cluster 2021-03-10T13:46:40.432550+0000 mgr.y (mgr.14140) 120 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:46:41.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:41 gibba013 bash[13024]: cluster 2021-03-10T13:46:40.432550+0000 mgr.y (mgr.14140) 120 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:46:42.693 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:42 gibba020 bash[9782]: audit 2021-03-10T13:46:41.663422+0000 mon.a (mon.0) 369 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:46:42.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:42 gibba013 bash[9767]: audit 2021-03-10T13:46:41.663422+0000 mon.a (mon.0) 369 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:46:42.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:42 gibba013 bash[13024]: audit 2021-03-10T13:46:41.663422+0000 mon.a (mon.0) 369 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:46:43.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:43 gibba020 bash[9782]: cluster 2021-03-10T13:46:42.433399+0000 mgr.y (mgr.14140) 121 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:46:43.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:43 gibba013 bash[9767]: cluster 2021-03-10T13:46:42.433399+0000 mgr.y (mgr.14140) 121 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:46:43.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:43 gibba013 bash[13024]: cluster 2021-03-10T13:46:42.433399+0000 mgr.y (mgr.14140) 121 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:46:45.850 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:45 gibba020 bash[9782]: cluster 2021-03-10T13:46:44.434520+0000 mgr.y (mgr.14140) 122 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:46:45.850 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:45 gibba020 bash[9782]: audit 2021-03-10T13:46:44.951394+0000 mon.a (mon.0) 370 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2021-03-10T13:46:45.851 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:45 gibba020 bash[9782]: audit 2021-03-10T13:46:44.954151+0000 mon.a (mon.0) 371 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:46:45.851 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:45 gibba020 bash[9782]: cephadm 2021-03-10T13:46:44.956524+0000 mgr.y (mgr.14140) 123 : cephadm [INF] Deploying daemon osd.5 on gibba020 2021-03-10T13:46:45.851 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:45 gibba020 bash[9782]: audit 2021-03-10T13:46:44.957452+0000 mon.a (mon.0) 372 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2021-03-10T13:46:45.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:45 gibba013 bash[9767]: cluster 2021-03-10T13:46:44.434520+0000 mgr.y (mgr.14140) 122 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:46:45.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:45 gibba013 bash[9767]: audit 2021-03-10T13:46:44.951394+0000 mon.a (mon.0) 370 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2021-03-10T13:46:45.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:45 gibba013 bash[9767]: audit 2021-03-10T13:46:44.954151+0000 mon.a (mon.0) 371 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:46:45.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:45 gibba013 bash[9767]: cephadm 2021-03-10T13:46:44.956524+0000 mgr.y (mgr.14140) 123 : cephadm [INF] Deploying daemon osd.5 on gibba020 2021-03-10T13:46:45.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:45 gibba013 bash[9767]: audit 2021-03-10T13:46:44.957452+0000 mon.a (mon.0) 372 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2021-03-10T13:46:45.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:45 gibba013 bash[13024]: cluster 2021-03-10T13:46:44.434520+0000 mgr.y (mgr.14140) 122 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:46:45.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:45 gibba013 bash[13024]: audit 2021-03-10T13:46:44.951394+0000 mon.a (mon.0) 370 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2021-03-10T13:46:45.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:45 gibba013 bash[13024]: audit 2021-03-10T13:46:44.954151+0000 mon.a (mon.0) 371 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:46:45.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:45 gibba013 bash[13024]: cephadm 2021-03-10T13:46:44.956524+0000 mgr.y (mgr.14140) 123 : cephadm [INF] Deploying daemon osd.5 on gibba020 2021-03-10T13:46:45.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:45 gibba013 bash[13024]: audit 2021-03-10T13:46:44.957452+0000 mon.a (mon.0) 372 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2021-03-10T13:46:46.769 INFO:teuthology.orchestra.run.gibba020.stdout:Created osd(s) 5 on host 'gibba020' 2021-03-10T13:46:47.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:47 gibba020 bash[9782]: cluster 2021-03-10T13:46:46.435325+0000 mgr.y (mgr.14140) 124 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:46:47.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:47 gibba020 bash[9782]: audit 2021-03-10T13:46:46.756903+0000 mon.a (mon.0) 373 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488332\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488622\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488815\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488976\", \"created\": \"2021-03-10T13:46:23.866010\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}}, \"last_device_update\": \"2021-03-10T13:46:31.966426\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:46:47.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:47 gibba020 bash[9782]: audit 2021-03-10T13:46:46.758448+0000 mon.a (mon.0) 374 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:46:47.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:47 gibba020 bash[9782]: audit 2021-03-10T13:46:46.766135+0000 mon.a (mon.0) 375 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488332\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488622\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488815\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488976\", \"created\": \"2021-03-10T13:46:23.866010\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}}, \"last_device_update\": \"2021-03-10T13:46:31.966426\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:46:47.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:47 gibba020 bash[9782]: audit 2021-03-10T13:46:47.268008+0000 mon.a (mon.0) 376 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.264788\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265050\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265213\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265364\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265511\", \"created\": \"2021-03-10T13:46:46.746011\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}}, \"last_daemon_update\": \"2021-03-10T13:46:47.265772\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:46:47.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:47 gibba020 bash[9782]: audit 2021-03-10T13:46:47.276669+0000 mon.a (mon.0) 377 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.264788\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265050\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265213\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265364\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265511\", \"created\": \"2021-03-10T13:46:46.746011\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}}, \"last_daemon_update\": \"2021-03-10T13:46:47.265772\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:46:47.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:47 gibba020 bash[9782]: audit 2021-03-10T13:46:47.277425+0000 mon.a (mon.0) 378 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:46:47.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:47 gibba013 bash[9767]: cluster 2021-03-10T13:46:46.435325+0000 mgr.y (mgr.14140) 124 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:46:47.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:47 gibba013 bash[13024]: cluster 2021-03-10T13:46:46.435325+0000 mgr.y (mgr.14140) 124 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:46:47.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:47 gibba013 bash[9767]: audit 2021-03-10T13:46:46.756903+0000 mon.a (mon.0) 373 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488332\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488622\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488815\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488976\", \"created\": \"2021-03-10T13:46:23.866010\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}}, \"last_device_update\": \"2021-03-10T13:46:31.966426\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:46:47.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:47 gibba013 bash[9767]: audit 2021-03-10T13:46:46.758448+0000 mon.a (mon.0) 374 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:46:47.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:47 gibba013 bash[13024]: audit 2021-03-10T13:46:46.756903+0000 mon.a (mon.0) 373 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488332\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488622\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488815\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488976\", \"created\": \"2021-03-10T13:46:23.866010\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}}, \"last_device_update\": \"2021-03-10T13:46:31.966426\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:46:47.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:47 gibba013 bash[13024]: audit 2021-03-10T13:46:46.758448+0000 mon.a (mon.0) 374 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:46:47.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:47 gibba013 bash[9767]: audit 2021-03-10T13:46:46.766135+0000 mon.a (mon.0) 375 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488332\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488622\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488815\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488976\", \"created\": \"2021-03-10T13:46:23.866010\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}}, \"last_device_update\": \"2021-03-10T13:46:31.966426\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:46:47.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:47 gibba013 bash[13024]: audit 2021-03-10T13:46:46.766135+0000 mon.a (mon.0) 375 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488332\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488622\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488815\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:24.488976\", \"created\": \"2021-03-10T13:46:23.866010\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}}, \"last_device_update\": \"2021-03-10T13:46:31.966426\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:46:47.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:47 gibba013 bash[9767]: audit 2021-03-10T13:46:47.268008+0000 mon.a (mon.0) 376 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.264788\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265050\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265213\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265364\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265511\", \"created\": \"2021-03-10T13:46:46.746011\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}}, \"last_daemon_update\": \"2021-03-10T13:46:47.265772\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:46:47.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:47 gibba013 bash[13024]: audit 2021-03-10T13:46:47.268008+0000 mon.a (mon.0) 376 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.264788\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265050\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265213\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265364\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265511\", \"created\": \"2021-03-10T13:46:46.746011\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}}, \"last_daemon_update\": \"2021-03-10T13:46:47.265772\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:46:47.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:47 gibba013 bash[9767]: audit 2021-03-10T13:46:47.276669+0000 mon.a (mon.0) 377 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.264788\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265050\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265213\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265364\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265511\", \"created\": \"2021-03-10T13:46:46.746011\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}}, \"last_daemon_update\": \"2021-03-10T13:46:47.265772\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:46:47.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:47 gibba013 bash[9767]: audit 2021-03-10T13:46:47.277425+0000 mon.a (mon.0) 378 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:46:47.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:47 gibba013 bash[13024]: audit 2021-03-10T13:46:47.276669+0000 mon.a (mon.0) 377 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.264788\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265050\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265213\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265364\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265511\", \"created\": \"2021-03-10T13:46:46.746011\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}}, \"last_daemon_update\": \"2021-03-10T13:46:47.265772\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:46:47.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:47 gibba013 bash[13024]: audit 2021-03-10T13:46:47.277425+0000 mon.a (mon.0) 378 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:46:47.962 DEBUG:teuthology.orchestra.run.gibba020:osd.5> sudo journalctl -f -n 0 -u ceph-7672acc8-81a6-11eb-9080-001a4aab830c@osd.5.service 2021-03-10T13:46:47.964 INFO:tasks.cephadm:Deploying osd.6 on gibba020 with /dev/vg_nvme/lv_2... 2021-03-10T13:46:47.965 DEBUG:teuthology.orchestra.run.gibba020:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2021-03-10T13:46:48.011 INFO:journalctl@ceph.osd.5.gibba020.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:46:49.446 INFO:journalctl@ceph.osd.5.gibba020.stdout:Mar 10 13:46:49 gibba020 bash[13357]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-03-10T13:46:49.446 INFO:journalctl@ceph.osd.5.gibba020.stdout:Mar 10 13:46:49 gibba020 bash[13357]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2021-03-10T13:46:49.447 INFO:journalctl@ceph.osd.5.gibba020.stdout:Mar 10 13:46:49 gibba020 bash[13357]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5/block 2021-03-10T13:46:49.447 INFO:journalctl@ceph.osd.5.gibba020.stdout:Mar 10 13:46:49 gibba020 bash[13357]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2021-03-10T13:46:49.447 INFO:journalctl@ceph.osd.5.gibba020.stdout:Mar 10 13:46:49 gibba020 bash[13357]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2021-03-10T13:46:49.448 INFO:journalctl@ceph.osd.5.gibba020.stdout:Mar 10 13:46:49 gibba020 bash[13357]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-03-10T13:46:49.448 INFO:journalctl@ceph.osd.5.gibba020.stdout:Mar 10 13:46:49 gibba020 bash[13357]: --> ceph-volume lvm activate successful for osd ID: 5 2021-03-10T13:46:49.871 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:49 gibba020 bash[9782]: cluster 2021-03-10T13:46:48.436169+0000 mgr.y (mgr.14140) 125 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:46:49.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:49 gibba013 bash[9767]: cluster 2021-03-10T13:46:48.436169+0000 mgr.y (mgr.14140) 125 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:46:49.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:49 gibba013 bash[13024]: cluster 2021-03-10T13:46:48.436169+0000 mgr.y (mgr.14140) 125 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T13:46:51.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:51 gibba020 bash[9782]: cluster 2021-03-10T13:46:50.436790+0000 mgr.y (mgr.14140) 126 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:46:51.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:51 gibba013 bash[9767]: cluster 2021-03-10T13:46:50.436790+0000 mgr.y (mgr.14140) 126 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:46:51.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:51 gibba013 bash[13024]: cluster 2021-03-10T13:46:50.436790+0000 mgr.y (mgr.14140) 126 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:46:52.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:52 gibba013 bash[9767]: audit 2021-03-10T13:46:51.459517+0000 mon.a (mon.0) 379 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"4df2e810-953e-45e5-852d-84682d065dae\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383993.454606, \"finished_at\": 1615384006.7700126}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T13:46:52.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:52 gibba013 bash[9767]: audit 2021-03-10T13:46:51.468448+0000 mon.a (mon.0) 380 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"4df2e810-953e-45e5-852d-84682d065dae\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383993.454606, \"finished_at\": 1615384006.7700126}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T13:46:52.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:52 gibba013 bash[13024]: audit 2021-03-10T13:46:51.459517+0000 mon.a (mon.0) 379 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"4df2e810-953e-45e5-852d-84682d065dae\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383993.454606, \"finished_at\": 1615384006.7700126}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T13:46:52.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:52 gibba013 bash[13024]: audit 2021-03-10T13:46:51.468448+0000 mon.a (mon.0) 380 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"4df2e810-953e-45e5-852d-84682d065dae\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383993.454606, \"finished_at\": 1615384006.7700126}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T13:46:52.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:52 gibba020 bash[9782]: audit 2021-03-10T13:46:51.459517+0000 mon.a (mon.0) 379 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"4df2e810-953e-45e5-852d-84682d065dae\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383993.454606, \"finished_at\": 1615384006.7700126}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T13:46:52.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:52 gibba020 bash[9782]: audit 2021-03-10T13:46:51.468448+0000 mon.a (mon.0) 380 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"4df2e810-953e-45e5-852d-84682d065dae\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383993.454606, \"finished_at\": 1615384006.7700126}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T13:46:52.945 INFO:journalctl@ceph.osd.5.gibba020.stdout:Mar 10 13:46:52 gibba020 bash[13673]: debug 2021-03-10T13:46:52.674+0000 7f94641a3ec0 -1 Falling back to public interface 2021-03-10T13:46:52.984 INFO:teuthology.orchestra.run.gibba020.stderr:--> Zapping: /dev/vg_nvme/lv_2 2021-03-10T13:46:52.984 INFO:teuthology.orchestra.run.gibba020.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2021-03-10T13:46:52.984 INFO:teuthology.orchestra.run.gibba020.stderr: stderr: 10+0 records in 2021-03-10T13:46:52.984 INFO:teuthology.orchestra.run.gibba020.stderr:10+0 records out 2021-03-10T13:46:52.985 INFO:teuthology.orchestra.run.gibba020.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00875566 s, 1.2 GB/s 2021-03-10T13:46:52.985 INFO:teuthology.orchestra.run.gibba020.stderr:--> Zapping successful for: 2021-03-10T13:46:53.445 INFO:journalctl@ceph.osd.5.gibba020.stdout:Mar 10 13:46:53 gibba020 bash[13673]: debug 2021-03-10T13:46:53.338+0000 7f94641a3ec0 -1 osd.5 0 log_to_monitors {default=true} 2021-03-10T13:46:53.624 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:53 gibba020 bash[9782]: cluster 2021-03-10T13:46:52.437587+0000 mgr.y (mgr.14140) 127 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:46:53.624 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:53 gibba020 bash[9782]: audit 2021-03-10T13:46:53.348425+0000 mon.a (mon.0) 381 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T13:46:53.625 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:53 gibba020 bash[9782]: audit 2021-03-10T13:46:53.350512+0000 mon.b (mon.2) 12 : audit [INF] from='osd.5 [v2:172.21.2.120:6808/3595534437,v1:172.21.2.120:6809/3595534437]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T13:46:53.646 DEBUG:teuthology.orchestra.run.gibba020:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph orch daemon add osd gibba020:vg_nvme/lv_2 2021-03-10T13:46:53.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:53 gibba013 bash[9767]: cluster 2021-03-10T13:46:52.437587+0000 mgr.y (mgr.14140) 127 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:46:53.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:53 gibba013 bash[9767]: audit 2021-03-10T13:46:53.348425+0000 mon.a (mon.0) 381 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T13:46:53.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:53 gibba013 bash[9767]: audit 2021-03-10T13:46:53.350512+0000 mon.b (mon.2) 12 : audit [INF] from='osd.5 [v2:172.21.2.120:6808/3595534437,v1:172.21.2.120:6809/3595534437]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T13:46:53.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:53 gibba013 bash[13024]: cluster 2021-03-10T13:46:52.437587+0000 mgr.y (mgr.14140) 127 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:46:53.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:53 gibba013 bash[13024]: audit 2021-03-10T13:46:53.348425+0000 mon.a (mon.0) 381 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T13:46:53.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:53 gibba013 bash[13024]: audit 2021-03-10T13:46:53.350512+0000 mon.b (mon.2) 12 : audit [INF] from='osd.5 [v2:172.21.2.120:6808/3595534437,v1:172.21.2.120:6809/3595534437]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T13:46:54.861 INFO:journalctl@ceph.osd.5.gibba020.stdout:Mar 10 13:46:54 gibba020 bash[13673]: debug 2021-03-10T13:46:54.486+0000 7f944cf58700 -1 osd.5 0 waiting for initial osdmap 2021-03-10T13:46:54.862 INFO:journalctl@ceph.osd.5.gibba020.stdout:Mar 10 13:46:54 gibba020 bash[13673]: debug 2021-03-10T13:46:54.490+0000 7f9458174700 -1 osd.5 36 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:46:54.862 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:54 gibba020 bash[9782]: audit 2021-03-10T13:46:53.476782+0000 mon.a (mon.0) 382 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-03-10T13:46:54.862 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:54 gibba020 bash[9782]: cluster 2021-03-10T13:46:53.476900+0000 mon.a (mon.0) 383 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2021-03-10T13:46:54.863 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:54 gibba020 bash[9782]: audit 2021-03-10T13:46:53.477633+0000 mon.a (mon.0) 384 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:46:54.863 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:54 gibba020 bash[9782]: audit 2021-03-10T13:46:53.483264+0000 mon.b (mon.2) 13 : audit [INF] from='osd.5 [v2:172.21.2.120:6808/3595534437,v1:172.21.2.120:6809/3595534437]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:46:54.863 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:54 gibba020 bash[9782]: audit 2021-03-10T13:46:53.487690+0000 mon.a (mon.0) 385 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:46:54.863 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:54 gibba020 bash[9782]: audit 2021-03-10T13:46:54.458235+0000 mon.a (mon.0) 386 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:46:54.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:54 gibba013 bash[9767]: audit 2021-03-10T13:46:53.476782+0000 mon.a (mon.0) 382 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-03-10T13:46:54.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:54 gibba013 bash[9767]: cluster 2021-03-10T13:46:53.476900+0000 mon.a (mon.0) 383 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2021-03-10T13:46:54.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:54 gibba013 bash[9767]: audit 2021-03-10T13:46:53.477633+0000 mon.a (mon.0) 384 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:46:54.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:54 gibba013 bash[9767]: audit 2021-03-10T13:46:53.483264+0000 mon.b (mon.2) 13 : audit [INF] from='osd.5 [v2:172.21.2.120:6808/3595534437,v1:172.21.2.120:6809/3595534437]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:46:54.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:54 gibba013 bash[9767]: audit 2021-03-10T13:46:53.487690+0000 mon.a (mon.0) 385 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:46:54.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:54 gibba013 bash[9767]: audit 2021-03-10T13:46:54.458235+0000 mon.a (mon.0) 386 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:46:54.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:54 gibba013 bash[13024]: audit 2021-03-10T13:46:53.476782+0000 mon.a (mon.0) 382 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-03-10T13:46:54.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:54 gibba013 bash[13024]: cluster 2021-03-10T13:46:53.476900+0000 mon.a (mon.0) 383 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2021-03-10T13:46:54.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:54 gibba013 bash[13024]: audit 2021-03-10T13:46:53.477633+0000 mon.a (mon.0) 384 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:46:54.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:54 gibba013 bash[13024]: audit 2021-03-10T13:46:53.483264+0000 mon.b (mon.2) 13 : audit [INF] from='osd.5 [v2:172.21.2.120:6808/3595534437,v1:172.21.2.120:6809/3595534437]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:46:54.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:54 gibba013 bash[13024]: audit 2021-03-10T13:46:53.487690+0000 mon.a (mon.0) 385 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:46:54.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:54 gibba013 bash[13024]: audit 2021-03-10T13:46:54.458235+0000 mon.a (mon.0) 386 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:46:55.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:55 gibba020 bash[9782]: cluster 2021-03-10T13:46:54.345880+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:46:55.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:55 gibba020 bash[9782]: cluster 2021-03-10T13:46:54.345977+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:46:55.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:55 gibba020 bash[9782]: cluster 2021-03-10T13:46:54.438497+0000 mgr.y (mgr.14140) 128 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:46:55.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:55 gibba020 bash[9782]: audit 2021-03-10T13:46:54.484054+0000 mon.a (mon.0) 387 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]': finished 2021-03-10T13:46:55.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:55 gibba020 bash[9782]: cluster 2021-03-10T13:46:54.484092+0000 mon.a (mon.0) 388 : cluster [DBG] osdmap e36: 6 total, 5 up, 5 in 2021-03-10T13:46:55.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:55 gibba020 bash[9782]: audit 2021-03-10T13:46:54.484498+0000 mon.a (mon.0) 389 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:46:55.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:55 gibba020 bash[9782]: audit 2021-03-10T13:46:54.572224+0000 mon.a (mon.0) 390 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.264788\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265050\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265213\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265364\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265511\", \"created\": \"2021-03-10T13:46:46.746011\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}}, \"last_daemon_update\": \"2021-03-10T13:46:47.265772\", \"last_device_update\": \"2021-03-10T13:46:54.569893\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:46:55.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:55 gibba020 bash[9782]: audit 2021-03-10T13:46:54.580713+0000 mon.a (mon.0) 391 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.264788\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265050\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265213\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265364\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265511\", \"created\": \"2021-03-10T13:46:46.746011\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}}, \"last_daemon_update\": \"2021-03-10T13:46:47.265772\", \"last_device_update\": \"2021-03-10T13:46:54.569893\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:46:55.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:55 gibba013 bash[9767]: cluster 2021-03-10T13:46:54.345880+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:46:55.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:55 gibba013 bash[9767]: cluster 2021-03-10T13:46:54.345977+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:46:55.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:55 gibba013 bash[9767]: cluster 2021-03-10T13:46:54.438497+0000 mgr.y (mgr.14140) 128 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:46:55.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:55 gibba013 bash[9767]: audit 2021-03-10T13:46:54.484054+0000 mon.a (mon.0) 387 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]': finished 2021-03-10T13:46:55.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:55 gibba013 bash[9767]: cluster 2021-03-10T13:46:54.484092+0000 mon.a (mon.0) 388 : cluster [DBG] osdmap e36: 6 total, 5 up, 5 in 2021-03-10T13:46:55.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:55 gibba013 bash[9767]: audit 2021-03-10T13:46:54.484498+0000 mon.a (mon.0) 389 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:46:55.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:55 gibba013 bash[13024]: cluster 2021-03-10T13:46:54.345880+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:46:55.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:55 gibba013 bash[13024]: cluster 2021-03-10T13:46:54.345977+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:46:55.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:55 gibba013 bash[13024]: cluster 2021-03-10T13:46:54.438497+0000 mgr.y (mgr.14140) 128 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:46:55.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:55 gibba013 bash[13024]: audit 2021-03-10T13:46:54.484054+0000 mon.a (mon.0) 387 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]': finished 2021-03-10T13:46:55.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:55 gibba013 bash[13024]: cluster 2021-03-10T13:46:54.484092+0000 mon.a (mon.0) 388 : cluster [DBG] osdmap e36: 6 total, 5 up, 5 in 2021-03-10T13:46:55.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:55 gibba013 bash[13024]: audit 2021-03-10T13:46:54.484498+0000 mon.a (mon.0) 389 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:46:55.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:55 gibba013 bash[9767]: audit 2021-03-10T13:46:54.572224+0000 mon.a (mon.0) 390 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.264788\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265050\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265213\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265364\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265511\", \"created\": \"2021-03-10T13:46:46.746011\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}}, \"last_daemon_update\": \"2021-03-10T13:46:47.265772\", \"last_device_update\": \"2021-03-10T13:46:54.569893\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:46:55.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:55 gibba013 bash[9767]: audit 2021-03-10T13:46:54.580713+0000 mon.a (mon.0) 391 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.264788\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265050\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265213\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265364\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265511\", \"created\": \"2021-03-10T13:46:46.746011\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}}, \"last_daemon_update\": \"2021-03-10T13:46:47.265772\", \"last_device_update\": \"2021-03-10T13:46:54.569893\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:46:55.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:55 gibba013 bash[13024]: audit 2021-03-10T13:46:54.572224+0000 mon.a (mon.0) 390 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.264788\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265050\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265213\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265364\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265511\", \"created\": \"2021-03-10T13:46:46.746011\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}}, \"last_daemon_update\": \"2021-03-10T13:46:47.265772\", \"last_device_update\": \"2021-03-10T13:46:54.569893\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:46:55.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:55 gibba013 bash[13024]: audit 2021-03-10T13:46:54.580713+0000 mon.a (mon.0) 391 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.264788\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265050\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265213\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265364\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265511\", \"created\": \"2021-03-10T13:46:46.746011\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}}, \"last_daemon_update\": \"2021-03-10T13:46:47.265772\", \"last_device_update\": \"2021-03-10T13:46:54.569893\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:46:56.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:56 gibba013 bash[9767]: cluster 2021-03-10T13:46:55.500628+0000 mon.a (mon.0) 392 : cluster [INF] osd.5 [v2:172.21.2.120:6808/3595534437,v1:172.21.2.120:6809/3595534437] boot 2021-03-10T13:46:56.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:56 gibba013 bash[9767]: cluster 2021-03-10T13:46:55.500745+0000 mon.a (mon.0) 393 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2021-03-10T13:46:56.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:56 gibba013 bash[9767]: audit 2021-03-10T13:46:55.500955+0000 mon.a (mon.0) 394 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:46:56.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:56 gibba013 bash[9767]: audit 2021-03-10T13:46:56.415063+0000 mon.a (mon.0) 395 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:46:56.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:56 gibba013 bash[9767]: audit 2021-03-10T13:46:56.418057+0000 mon.a (mon.0) 396 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:46:56.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:56 gibba013 bash[9767]: audit 2021-03-10T13:46:56.422168+0000 mon.a (mon.0) 397 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:46:56.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:56 gibba013 bash[13024]: cluster 2021-03-10T13:46:55.500628+0000 mon.a (mon.0) 392 : cluster [INF] osd.5 [v2:172.21.2.120:6808/3595534437,v1:172.21.2.120:6809/3595534437] boot 2021-03-10T13:46:56.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:56 gibba013 bash[13024]: cluster 2021-03-10T13:46:55.500745+0000 mon.a (mon.0) 393 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2021-03-10T13:46:56.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:56 gibba013 bash[13024]: audit 2021-03-10T13:46:55.500955+0000 mon.a (mon.0) 394 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:46:56.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:56 gibba013 bash[13024]: audit 2021-03-10T13:46:56.415063+0000 mon.a (mon.0) 395 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:46:56.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:56 gibba013 bash[13024]: audit 2021-03-10T13:46:56.418057+0000 mon.a (mon.0) 396 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:46:56.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:56 gibba013 bash[13024]: audit 2021-03-10T13:46:56.422168+0000 mon.a (mon.0) 397 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:46:56.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:56 gibba020 bash[9782]: cluster 2021-03-10T13:46:55.500628+0000 mon.a (mon.0) 392 : cluster [INF] osd.5 [v2:172.21.2.120:6808/3595534437,v1:172.21.2.120:6809/3595534437] boot 2021-03-10T13:46:56.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:56 gibba020 bash[9782]: cluster 2021-03-10T13:46:55.500745+0000 mon.a (mon.0) 393 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2021-03-10T13:46:56.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:56 gibba020 bash[9782]: audit 2021-03-10T13:46:55.500955+0000 mon.a (mon.0) 394 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:46:56.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:56 gibba020 bash[9782]: audit 2021-03-10T13:46:56.415063+0000 mon.a (mon.0) 395 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:46:56.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:56 gibba020 bash[9782]: audit 2021-03-10T13:46:56.418057+0000 mon.a (mon.0) 396 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:46:56.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:56 gibba020 bash[9782]: audit 2021-03-10T13:46:56.422168+0000 mon.a (mon.0) 397 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:46:57.580 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:57 gibba020 bash[9782]: audit 2021-03-10T13:46:56.412289+0000 mgr.y (mgr.14140) 129 : audit [DBG] from='client.34184 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba020:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:46:57.580 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:57 gibba020 bash[9782]: cephadm 2021-03-10T13:46:56.414291+0000 mgr.y (mgr.14140) 130 : cephadm [INF] Applying osd on host gibba020... 2021-03-10T13:46:57.581 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:57 gibba020 bash[9782]: cluster 2021-03-10T13:46:56.438825+0000 mgr.y (mgr.14140) 131 : cluster [DBG] pgmap v130: 1 pgs: 1 peering; 0 B data, 1.5 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:46:57.581 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:57 gibba020 bash[9782]: cluster 2021-03-10T13:46:56.497646+0000 mon.a (mon.0) 398 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2021-03-10T13:46:57.581 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:57 gibba020 bash[9782]: cluster 2021-03-10T13:46:56.508188+0000 mon.a (mon.0) 399 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2021-03-10T13:46:57.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:57 gibba013 bash[9767]: audit 2021-03-10T13:46:56.412289+0000 mgr.y (mgr.14140) 129 : audit [DBG] from='client.34184 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba020:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:46:57.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:57 gibba013 bash[9767]: cephadm 2021-03-10T13:46:56.414291+0000 mgr.y (mgr.14140) 130 : cephadm [INF] Applying osd on host gibba020... 2021-03-10T13:46:57.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:57 gibba013 bash[9767]: cluster 2021-03-10T13:46:56.438825+0000 mgr.y (mgr.14140) 131 : cluster [DBG] pgmap v130: 1 pgs: 1 peering; 0 B data, 1.5 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:46:57.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:57 gibba013 bash[9767]: cluster 2021-03-10T13:46:56.497646+0000 mon.a (mon.0) 398 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2021-03-10T13:46:57.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:57 gibba013 bash[9767]: cluster 2021-03-10T13:46:56.508188+0000 mon.a (mon.0) 399 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2021-03-10T13:46:57.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:57 gibba013 bash[13024]: audit 2021-03-10T13:46:56.412289+0000 mgr.y (mgr.14140) 129 : audit [DBG] from='client.34184 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba020:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:46:57.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:57 gibba013 bash[13024]: cephadm 2021-03-10T13:46:56.414291+0000 mgr.y (mgr.14140) 130 : cephadm [INF] Applying osd on host gibba020... 2021-03-10T13:46:57.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:57 gibba013 bash[13024]: cluster 2021-03-10T13:46:56.438825+0000 mgr.y (mgr.14140) 131 : cluster [DBG] pgmap v130: 1 pgs: 1 peering; 0 B data, 1.5 MiB used, 415 GiB / 420 GiB avail 2021-03-10T13:46:57.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:57 gibba013 bash[13024]: cluster 2021-03-10T13:46:56.497646+0000 mon.a (mon.0) 398 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2021-03-10T13:46:57.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:57 gibba013 bash[13024]: cluster 2021-03-10T13:46:56.508188+0000 mon.a (mon.0) 399 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2021-03-10T13:46:59.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:59 gibba013 bash[9767]: cluster 2021-03-10T13:46:58.439894+0000 mgr.y (mgr.14140) 132 : cluster [DBG] pgmap v132: 1 pgs: 1 peering; 0 B data, 1.9 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:47:00.180 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:59 gibba013 bash[9767]: audit 2021-03-10T13:46:59.410999+0000 mon.a (mon.0) 400 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7"}]: dispatch 2021-03-10T13:47:00.181 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:59 gibba013 bash[9767]: audit 2021-03-10T13:46:59.413140+0000 mon.b (mon.2) 14 : audit [INF] from='client.? 172.21.2.120:0/254602959' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7"}]: dispatch 2021-03-10T13:47:00.181 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:59 gibba013 bash[9767]: audit 2021-03-10T13:46:59.422480+0000 mon.a (mon.0) 401 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7"}]': finished 2021-03-10T13:47:00.181 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:59 gibba013 bash[9767]: cluster 2021-03-10T13:46:59.422517+0000 mon.a (mon.0) 402 : cluster [DBG] osdmap e39: 7 total, 6 up, 6 in 2021-03-10T13:47:00.181 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:46:59 gibba013 bash[9767]: audit 2021-03-10T13:46:59.422670+0000 mon.a (mon.0) 403 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:47:00.182 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:59 gibba013 bash[13024]: cluster 2021-03-10T13:46:58.439894+0000 mgr.y (mgr.14140) 132 : cluster [DBG] pgmap v132: 1 pgs: 1 peering; 0 B data, 1.9 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:47:00.182 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:59 gibba013 bash[13024]: audit 2021-03-10T13:46:59.410999+0000 mon.a (mon.0) 400 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7"}]: dispatch 2021-03-10T13:47:00.182 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:59 gibba013 bash[13024]: audit 2021-03-10T13:46:59.413140+0000 mon.b (mon.2) 14 : audit [INF] from='client.? 172.21.2.120:0/254602959' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7"}]: dispatch 2021-03-10T13:47:00.183 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:59 gibba013 bash[13024]: audit 2021-03-10T13:46:59.422480+0000 mon.a (mon.0) 401 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7"}]': finished 2021-03-10T13:47:00.183 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:59 gibba013 bash[13024]: cluster 2021-03-10T13:46:59.422517+0000 mon.a (mon.0) 402 : cluster [DBG] osdmap e39: 7 total, 6 up, 6 in 2021-03-10T13:47:00.183 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:46:59 gibba013 bash[13024]: audit 2021-03-10T13:46:59.422670+0000 mon.a (mon.0) 403 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:47:00.184 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:59 gibba020 bash[9782]: cluster 2021-03-10T13:46:58.439894+0000 mgr.y (mgr.14140) 132 : cluster [DBG] pgmap v132: 1 pgs: 1 peering; 0 B data, 1.9 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:47:00.184 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:59 gibba020 bash[9782]: audit 2021-03-10T13:46:59.410999+0000 mon.a (mon.0) 400 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7"}]: dispatch 2021-03-10T13:47:00.184 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:59 gibba020 bash[9782]: audit 2021-03-10T13:46:59.413140+0000 mon.b (mon.2) 14 : audit [INF] from='client.? 172.21.2.120:0/254602959' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7"}]: dispatch 2021-03-10T13:47:00.184 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:59 gibba020 bash[9782]: audit 2021-03-10T13:46:59.422480+0000 mon.a (mon.0) 401 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7"}]': finished 2021-03-10T13:47:00.185 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:59 gibba020 bash[9782]: cluster 2021-03-10T13:46:59.422517+0000 mon.a (mon.0) 402 : cluster [DBG] osdmap e39: 7 total, 6 up, 6 in 2021-03-10T13:47:00.185 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:46:59 gibba020 bash[9782]: audit 2021-03-10T13:46:59.422670+0000 mon.a (mon.0) 403 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:47:01.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:01 gibba013 bash[9767]: cluster 2021-03-10T13:47:00.440922+0000 mgr.y (mgr.14140) 133 : cluster [DBG] pgmap v134: 1 pgs: 1 peering; 0 B data, 2.0 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:47:01.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:01 gibba013 bash[9767]: audit 2021-03-10T13:47:01.427394+0000 mon.b (mon.2) 15 : audit [DBG] from='client.? 172.21.2.120:0/1606481075' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:47:01.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:01 gibba013 bash[13024]: cluster 2021-03-10T13:47:00.440922+0000 mgr.y (mgr.14140) 133 : cluster [DBG] pgmap v134: 1 pgs: 1 peering; 0 B data, 2.0 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:47:01.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:01 gibba013 bash[13024]: audit 2021-03-10T13:47:01.427394+0000 mon.b (mon.2) 15 : audit [DBG] from='client.? 172.21.2.120:0/1606481075' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:47:01.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:01 gibba020 bash[9782]: cluster 2021-03-10T13:47:00.440922+0000 mgr.y (mgr.14140) 133 : cluster [DBG] pgmap v134: 1 pgs: 1 peering; 0 B data, 2.0 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:47:01.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:01 gibba020 bash[9782]: audit 2021-03-10T13:47:01.427394+0000 mon.b (mon.2) 15 : audit [DBG] from='client.? 172.21.2.120:0/1606481075' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:47:02.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:02 gibba013 bash[9767]: cluster 2021-03-10T13:47:02.526416+0000 mon.a (mon.0) 404 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T13:47:02.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:02 gibba013 bash[9767]: cluster 2021-03-10T13:47:02.526507+0000 mon.a (mon.0) 405 : cluster [INF] Cluster is now healthy 2021-03-10T13:47:02.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:02 gibba013 bash[13024]: cluster 2021-03-10T13:47:02.526416+0000 mon.a (mon.0) 404 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T13:47:02.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:02 gibba013 bash[13024]: cluster 2021-03-10T13:47:02.526507+0000 mon.a (mon.0) 405 : cluster [INF] Cluster is now healthy 2021-03-10T13:47:02.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:02 gibba020 bash[9782]: cluster 2021-03-10T13:47:02.526416+0000 mon.a (mon.0) 404 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T13:47:02.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:02 gibba020 bash[9782]: cluster 2021-03-10T13:47:02.526507+0000 mon.a (mon.0) 405 : cluster [INF] Cluster is now healthy 2021-03-10T13:47:03.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:03 gibba013 bash[9767]: cluster 2021-03-10T13:47:02.441966+0000 mgr.y (mgr.14140) 134 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:47:03.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:03 gibba013 bash[13024]: cluster 2021-03-10T13:47:02.441966+0000 mgr.y (mgr.14140) 134 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:47:03.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:03 gibba020 bash[9782]: cluster 2021-03-10T13:47:02.441966+0000 mgr.y (mgr.14140) 134 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:47:04.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:04 gibba013 bash[9767]: audit 2021-03-10T13:47:04.090913+0000 mon.a (mon.0) 406 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:47:04.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:04 gibba013 bash[13024]: audit 2021-03-10T13:47:04.090913+0000 mon.a (mon.0) 406 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:47:04.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:04 gibba020 bash[9782]: audit 2021-03-10T13:47:04.090913+0000 mon.a (mon.0) 406 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:47:05.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:05 gibba013 bash[9767]: cluster 2021-03-10T13:47:04.442886+0000 mgr.y (mgr.14140) 135 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:47:05.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:05 gibba013 bash[13024]: cluster 2021-03-10T13:47:04.442886+0000 mgr.y (mgr.14140) 135 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:47:05.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:05 gibba020 bash[9782]: cluster 2021-03-10T13:47:04.442886+0000 mgr.y (mgr.14140) 135 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:47:07.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:07 gibba013 bash[9767]: cluster 2021-03-10T13:47:06.443945+0000 mgr.y (mgr.14140) 136 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:47:07.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:07 gibba013 bash[9767]: audit 2021-03-10T13:47:07.538905+0000 mon.a (mon.0) 407 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-03-10T13:47:07.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:07 gibba013 bash[9767]: audit 2021-03-10T13:47:07.541818+0000 mon.a (mon.0) 408 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:47:07.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:07 gibba013 bash[9767]: audit 2021-03-10T13:47:07.545321+0000 mon.a (mon.0) 409 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2021-03-10T13:47:07.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:07 gibba013 bash[13024]: cluster 2021-03-10T13:47:06.443945+0000 mgr.y (mgr.14140) 136 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:47:07.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:07 gibba013 bash[13024]: audit 2021-03-10T13:47:07.538905+0000 mon.a (mon.0) 407 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-03-10T13:47:07.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:07 gibba013 bash[13024]: audit 2021-03-10T13:47:07.541818+0000 mon.a (mon.0) 408 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:47:07.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:07 gibba013 bash[13024]: audit 2021-03-10T13:47:07.545321+0000 mon.a (mon.0) 409 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2021-03-10T13:47:07.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:07 gibba020 bash[9782]: cluster 2021-03-10T13:47:06.443945+0000 mgr.y (mgr.14140) 136 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:47:07.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:07 gibba020 bash[9782]: audit 2021-03-10T13:47:07.538905+0000 mon.a (mon.0) 407 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-03-10T13:47:07.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:07 gibba020 bash[9782]: audit 2021-03-10T13:47:07.541818+0000 mon.a (mon.0) 408 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:47:07.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:07 gibba020 bash[9782]: audit 2021-03-10T13:47:07.545321+0000 mon.a (mon.0) 409 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2021-03-10T13:47:08.664 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:08 gibba020 bash[9782]: cephadm 2021-03-10T13:47:07.544288+0000 mgr.y (mgr.14140) 137 : cephadm [INF] Deploying daemon osd.6 on gibba020 2021-03-10T13:47:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:08 gibba013 bash[9767]: cephadm 2021-03-10T13:47:07.544288+0000 mgr.y (mgr.14140) 137 : cephadm [INF] Deploying daemon osd.6 on gibba020 2021-03-10T13:47:08.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:08 gibba013 bash[13024]: cephadm 2021-03-10T13:47:07.544288+0000 mgr.y (mgr.14140) 137 : cephadm [INF] Deploying daemon osd.6 on gibba020 2021-03-10T13:47:09.399 INFO:teuthology.orchestra.run.gibba020.stdout:Created osd(s) 6 on host 'gibba020' 2021-03-10T13:47:09.672 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:09 gibba020 bash[9782]: cluster 2021-03-10T13:47:08.444916+0000 mgr.y (mgr.14140) 138 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:47:09.673 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:09 gibba020 bash[9782]: audit 2021-03-10T13:47:09.388023+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.264788\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265050\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265213\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265364\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265511\", \"created\": \"2021-03-10T13:46:46.746011\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}}, \"last_device_update\": \"2021-03-10T13:46:54.569893\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:47:09.673 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:09 gibba020 bash[9782]: audit 2021-03-10T13:47:09.389492+0000 mon.a (mon.0) 411 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:47:09.673 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:09 gibba020 bash[9782]: audit 2021-03-10T13:47:09.396575+0000 mon.a (mon.0) 412 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.264788\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265050\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265213\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265364\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265511\", \"created\": \"2021-03-10T13:46:46.746011\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}}, \"last_device_update\": \"2021-03-10T13:46:54.569893\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:47:10.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:09 gibba013 bash[9767]: cluster 2021-03-10T13:47:08.444916+0000 mgr.y (mgr.14140) 138 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:47:10.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:09 gibba013 bash[13024]: cluster 2021-03-10T13:47:08.444916+0000 mgr.y (mgr.14140) 138 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:47:10.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:09 gibba013 bash[9767]: audit 2021-03-10T13:47:09.388023+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.264788\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265050\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265213\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265364\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265511\", \"created\": \"2021-03-10T13:46:46.746011\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}}, \"last_device_update\": \"2021-03-10T13:46:54.569893\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:47:10.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:09 gibba013 bash[9767]: audit 2021-03-10T13:47:09.389492+0000 mon.a (mon.0) 411 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:47:10.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:09 gibba013 bash[9767]: audit 2021-03-10T13:47:09.396575+0000 mon.a (mon.0) 412 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.264788\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265050\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265213\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265364\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265511\", \"created\": \"2021-03-10T13:46:46.746011\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}}, \"last_device_update\": \"2021-03-10T13:46:54.569893\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:47:10.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:09 gibba013 bash[13024]: audit 2021-03-10T13:47:09.388023+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.264788\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265050\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265213\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265364\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265511\", \"created\": \"2021-03-10T13:46:46.746011\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}}, \"last_device_update\": \"2021-03-10T13:46:54.569893\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:47:10.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:09 gibba013 bash[13024]: audit 2021-03-10T13:47:09.389492+0000 mon.a (mon.0) 411 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:47:10.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:09 gibba013 bash[13024]: audit 2021-03-10T13:47:09.396575+0000 mon.a (mon.0) 412 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.264788\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265050\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265213\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265364\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:47.265511\", \"created\": \"2021-03-10T13:46:46.746011\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}}, \"last_device_update\": \"2021-03-10T13:46:54.569893\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:47:10.725 DEBUG:teuthology.orchestra.run.gibba020:osd.6> sudo journalctl -f -n 0 -u ceph-7672acc8-81a6-11eb-9080-001a4aab830c@osd.6.service 2021-03-10T13:47:10.728 INFO:tasks.cephadm:Deploying osd.7 on gibba020 with /dev/vg_nvme/lv_1... 2021-03-10T13:47:10.728 DEBUG:teuthology.orchestra.run.gibba020:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2021-03-10T13:47:10.810 INFO:journalctl@ceph.osd.6.gibba020.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:47:10.902 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:10 gibba020 bash[9782]: audit 2021-03-10T13:47:09.976588+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973062\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973326\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973492\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973650\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973800\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973950\", \"created\": \"2021-03-10T13:47:09.378011\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}}, \"last_daemon_update\": \"2021-03-10T13:47:09.974248\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:47:10.903 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:10 gibba020 bash[9782]: audit 2021-03-10T13:47:09.985343+0000 mon.a (mon.0) 414 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973062\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973326\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973492\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973650\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973800\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973950\", \"created\": \"2021-03-10T13:47:09.378011\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}}, \"last_daemon_update\": \"2021-03-10T13:47:09.974248\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:47:10.903 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:10 gibba020 bash[9782]: audit 2021-03-10T13:47:09.986056+0000 mon.a (mon.0) 415 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:47:11.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:10 gibba013 bash[9767]: audit 2021-03-10T13:47:09.976588+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973062\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973326\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973492\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973650\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973800\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973950\", \"created\": \"2021-03-10T13:47:09.378011\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}}, \"last_daemon_update\": \"2021-03-10T13:47:09.974248\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:47:11.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:10 gibba013 bash[9767]: audit 2021-03-10T13:47:09.985343+0000 mon.a (mon.0) 414 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973062\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973326\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973492\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973650\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973800\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973950\", \"created\": \"2021-03-10T13:47:09.378011\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}}, \"last_daemon_update\": \"2021-03-10T13:47:09.974248\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:47:11.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:10 gibba013 bash[9767]: audit 2021-03-10T13:47:09.986056+0000 mon.a (mon.0) 415 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:47:11.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:10 gibba013 bash[13024]: audit 2021-03-10T13:47:09.976588+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973062\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973326\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973492\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973650\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973800\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973950\", \"created\": \"2021-03-10T13:47:09.378011\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}}, \"last_daemon_update\": \"2021-03-10T13:47:09.974248\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:47:11.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:10 gibba013 bash[13024]: audit 2021-03-10T13:47:09.985343+0000 mon.a (mon.0) 414 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973062\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973326\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973492\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973650\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973800\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973950\", \"created\": \"2021-03-10T13:47:09.378011\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}}, \"last_daemon_update\": \"2021-03-10T13:47:09.974248\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:47:11.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:10 gibba013 bash[13024]: audit 2021-03-10T13:47:09.986056+0000 mon.a (mon.0) 415 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:47:11.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:11 gibba020 bash[9782]: cluster 2021-03-10T13:47:10.445371+0000 mgr.y (mgr.14140) 139 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:47:11.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:11 gibba020 bash[9782]: audit 2021-03-10T13:47:11.470522+0000 mon.a (mon.0) 416 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"4df2e810-953e-45e5-852d-84682d065dae\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383993.454606, \"finished_at\": 1615384006.7700126}, {\"id\": \"c79d246c-7a77-4683-bf60-27d80d5cf59c\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615384015.5000648, \"finished_at\": 1615384029.3994632}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T13:47:11.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:11 gibba020 bash[9782]: audit 2021-03-10T13:47:11.473988+0000 mon.a (mon.0) 417 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"4df2e810-953e-45e5-852d-84682d065dae\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383993.454606, \"finished_at\": 1615384006.7700126}, {\"id\": \"c79d246c-7a77-4683-bf60-27d80d5cf59c\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615384015.5000648, \"finished_at\": 1615384029.3994632}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T13:47:11.946 INFO:journalctl@ceph.osd.6.gibba020.stdout:Mar 10 13:47:11 gibba020 bash[14805]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-03-10T13:47:11.947 INFO:journalctl@ceph.osd.6.gibba020.stdout:Mar 10 13:47:11 gibba020 bash[14805]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-6 --no-mon-config 2021-03-10T13:47:11.947 INFO:journalctl@ceph.osd.6.gibba020.stdout:Mar 10 13:47:11 gibba020 bash[14805]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6/block 2021-03-10T13:47:11.947 INFO:journalctl@ceph.osd.6.gibba020.stdout:Mar 10 13:47:11 gibba020 bash[14805]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-6/block 2021-03-10T13:47:11.947 INFO:journalctl@ceph.osd.6.gibba020.stdout:Mar 10 13:47:11 gibba020 bash[14805]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2021-03-10T13:47:11.947 INFO:journalctl@ceph.osd.6.gibba020.stdout:Mar 10 13:47:11 gibba020 bash[14805]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-03-10T13:47:11.948 INFO:journalctl@ceph.osd.6.gibba020.stdout:Mar 10 13:47:11 gibba020 bash[14805]: --> ceph-volume lvm activate successful for osd ID: 6 2021-03-10T13:47:12.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:11 gibba013 bash[9767]: cluster 2021-03-10T13:47:10.445371+0000 mgr.y (mgr.14140) 139 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:47:12.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:11 gibba013 bash[9767]: audit 2021-03-10T13:47:11.470522+0000 mon.a (mon.0) 416 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"4df2e810-953e-45e5-852d-84682d065dae\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383993.454606, \"finished_at\": 1615384006.7700126}, {\"id\": \"c79d246c-7a77-4683-bf60-27d80d5cf59c\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615384015.5000648, \"finished_at\": 1615384029.3994632}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T13:47:12.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:11 gibba013 bash[9767]: audit 2021-03-10T13:47:11.473988+0000 mon.a (mon.0) 417 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"4df2e810-953e-45e5-852d-84682d065dae\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383993.454606, \"finished_at\": 1615384006.7700126}, {\"id\": \"c79d246c-7a77-4683-bf60-27d80d5cf59c\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615384015.5000648, \"finished_at\": 1615384029.3994632}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T13:47:12.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:11 gibba013 bash[13024]: cluster 2021-03-10T13:47:10.445371+0000 mgr.y (mgr.14140) 139 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:47:12.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:11 gibba013 bash[13024]: audit 2021-03-10T13:47:11.470522+0000 mon.a (mon.0) 416 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"4df2e810-953e-45e5-852d-84682d065dae\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383993.454606, \"finished_at\": 1615384006.7700126}, {\"id\": \"c79d246c-7a77-4683-bf60-27d80d5cf59c\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615384015.5000648, \"finished_at\": 1615384029.3994632}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T13:47:12.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:11 gibba013 bash[13024]: audit 2021-03-10T13:47:11.473988+0000 mon.a (mon.0) 417 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"4df2e810-953e-45e5-852d-84682d065dae\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383993.454606, \"finished_at\": 1615384006.7700126}, {\"id\": \"c79d246c-7a77-4683-bf60-27d80d5cf59c\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615384015.5000648, \"finished_at\": 1615384029.3994632}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T13:47:13.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:13 gibba020 bash[9782]: cluster 2021-03-10T13:47:12.446228+0000 mgr.y (mgr.14140) 140 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:47:14.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:13 gibba013 bash[9767]: cluster 2021-03-10T13:47:12.446228+0000 mgr.y (mgr.14140) 140 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:47:14.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:13 gibba013 bash[13024]: cluster 2021-03-10T13:47:12.446228+0000 mgr.y (mgr.14140) 140 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:47:15.195 INFO:journalctl@ceph.osd.6.gibba020.stdout:Mar 10 13:47:14 gibba020 bash[15161]: debug 2021-03-10T13:47:14.986+0000 7f6c4e1deec0 1 -- 172.21.2.120:0/2796702514 >> [v2:172.21.2.120:3300/0,v1:172.21.2.120:6789/0] conn(0x560620ec8c00 msgr2=0x560620ec5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-10T13:47:15.195 INFO:journalctl@ceph.osd.6.gibba020.stdout:Mar 10 13:47:14 gibba020 bash[15161]: debug 2021-03-10T13:47:14.986+0000 7f6c4e1deec0 1 --2- 172.21.2.120:0/2796702514 >> [v2:172.21.2.120:3300/0,v1:172.21.2.120:6789/0] conn(0x560620ec8c00 0x560620ec5680 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x560620e5fe90 tx=0x560621b34aa0).stop 2021-03-10T13:47:15.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:15 gibba020 bash[9782]: cluster 2021-03-10T13:47:14.447137+0000 mgr.y (mgr.14140) 141 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:47:15.945 INFO:journalctl@ceph.osd.6.gibba020.stdout:Mar 10 13:47:15 gibba020 bash[15161]: debug 2021-03-10T13:47:15.574+0000 7f6c4e1deec0 -1 Falling back to public interface 2021-03-10T13:47:16.000 INFO:teuthology.orchestra.run.gibba020.stderr:--> Zapping: /dev/vg_nvme/lv_1 2021-03-10T13:47:16.000 INFO:teuthology.orchestra.run.gibba020.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2021-03-10T13:47:16.000 INFO:teuthology.orchestra.run.gibba020.stderr: stderr: 10+0 records in 2021-03-10T13:47:16.000 INFO:teuthology.orchestra.run.gibba020.stderr:10+0 records out 2021-03-10T13:47:16.001 INFO:teuthology.orchestra.run.gibba020.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00894574 s, 1.2 GB/s 2021-03-10T13:47:16.001 INFO:teuthology.orchestra.run.gibba020.stderr:--> Zapping successful for: 2021-03-10T13:47:16.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:15 gibba013 bash[9767]: cluster 2021-03-10T13:47:14.447137+0000 mgr.y (mgr.14140) 141 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:47:16.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:15 gibba013 bash[13024]: cluster 2021-03-10T13:47:14.447137+0000 mgr.y (mgr.14140) 141 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:47:16.445 INFO:journalctl@ceph.osd.6.gibba020.stdout:Mar 10 13:47:16 gibba020 bash[15161]: debug 2021-03-10T13:47:16.250+0000 7f6c4e1deec0 -1 osd.6 0 log_to_monitors {default=true} 2021-03-10T13:47:16.850 DEBUG:teuthology.orchestra.run.gibba020:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph orch daemon add osd gibba020:vg_nvme/lv_1 2021-03-10T13:47:16.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:16 gibba020 bash[9782]: audit 2021-03-10T13:47:16.256215+0000 mon.a (mon.0) 418 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T13:47:17.327 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:16 gibba020 bash[9782]: audit 2021-03-10T13:47:16.258892+0000 mon.b (mon.2) 16 : audit [INF] from='osd.6 [v2:172.21.2.120:6816/1328382283,v1:172.21.2.120:6817/1328382283]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T13:47:17.328 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:16 gibba013 bash[9767]: audit 2021-03-10T13:47:16.256215+0000 mon.a (mon.0) 418 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T13:47:17.329 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:16 gibba013 bash[9767]: audit 2021-03-10T13:47:16.258892+0000 mon.b (mon.2) 16 : audit [INF] from='osd.6 [v2:172.21.2.120:6816/1328382283,v1:172.21.2.120:6817/1328382283]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T13:47:17.329 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:16 gibba013 bash[13024]: audit 2021-03-10T13:47:16.256215+0000 mon.a (mon.0) 418 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T13:47:17.329 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:16 gibba013 bash[13024]: audit 2021-03-10T13:47:16.258892+0000 mon.b (mon.2) 16 : audit [INF] from='osd.6 [v2:172.21.2.120:6816/1328382283,v1:172.21.2.120:6817/1328382283]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T13:47:17.945 INFO:journalctl@ceph.osd.6.gibba020.stdout:Mar 10 13:47:17 gibba020 bash[15161]: debug 2021-03-10T13:47:17.682+0000 7f6c36f93700 -1 osd.6 0 waiting for initial osdmap 2021-03-10T13:47:17.945 INFO:journalctl@ceph.osd.6.gibba020.stdout:Mar 10 13:47:17 gibba020 bash[15161]: debug 2021-03-10T13:47:17.690+0000 7f6c421af700 -1 osd.6 41 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:47:17.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:17 gibba020 bash[9782]: cluster 2021-03-10T13:47:16.448070+0000 mgr.y (mgr.14140) 142 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:47:17.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:17 gibba020 bash[9782]: audit 2021-03-10T13:47:16.673515+0000 mon.a (mon.0) 419 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-03-10T13:47:17.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:17 gibba020 bash[9782]: cluster 2021-03-10T13:47:16.673532+0000 mon.a (mon.0) 420 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2021-03-10T13:47:17.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:17 gibba020 bash[9782]: audit 2021-03-10T13:47:16.673612+0000 mon.a (mon.0) 421 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:47:17.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:17 gibba020 bash[9782]: audit 2021-03-10T13:47:16.676373+0000 mon.a (mon.0) 422 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:47:17.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:17 gibba020 bash[9782]: audit 2021-03-10T13:47:16.679758+0000 mon.b (mon.2) 17 : audit [INF] from='osd.6 [v2:172.21.2.120:6816/1328382283,v1:172.21.2.120:6817/1328382283]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:47:17.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:17 gibba020 bash[9782]: cluster 2021-03-10T13:47:17.218199+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:47:17.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:17 gibba020 bash[9782]: cluster 2021-03-10T13:47:17.218305+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:47:17.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:17 gibba020 bash[9782]: audit 2021-03-10T13:47:17.585036+0000 mon.a (mon.0) 423 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:47:18.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:17 gibba013 bash[9767]: cluster 2021-03-10T13:47:16.448070+0000 mgr.y (mgr.14140) 142 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:47:18.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:17 gibba013 bash[9767]: audit 2021-03-10T13:47:16.673515+0000 mon.a (mon.0) 419 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-03-10T13:47:18.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:17 gibba013 bash[9767]: cluster 2021-03-10T13:47:16.673532+0000 mon.a (mon.0) 420 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2021-03-10T13:47:18.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:17 gibba013 bash[9767]: audit 2021-03-10T13:47:16.673612+0000 mon.a (mon.0) 421 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:47:18.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:17 gibba013 bash[9767]: audit 2021-03-10T13:47:16.676373+0000 mon.a (mon.0) 422 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:47:18.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:17 gibba013 bash[9767]: audit 2021-03-10T13:47:16.679758+0000 mon.b (mon.2) 17 : audit [INF] from='osd.6 [v2:172.21.2.120:6816/1328382283,v1:172.21.2.120:6817/1328382283]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:47:18.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:17 gibba013 bash[9767]: cluster 2021-03-10T13:47:17.218199+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:47:18.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:17 gibba013 bash[9767]: cluster 2021-03-10T13:47:17.218305+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:47:18.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:17 gibba013 bash[9767]: audit 2021-03-10T13:47:17.585036+0000 mon.a (mon.0) 423 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:47:18.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:17 gibba013 bash[13024]: cluster 2021-03-10T13:47:16.448070+0000 mgr.y (mgr.14140) 142 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:47:18.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:17 gibba013 bash[13024]: audit 2021-03-10T13:47:16.673515+0000 mon.a (mon.0) 419 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-03-10T13:47:18.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:17 gibba013 bash[13024]: cluster 2021-03-10T13:47:16.673532+0000 mon.a (mon.0) 420 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2021-03-10T13:47:18.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:17 gibba013 bash[13024]: audit 2021-03-10T13:47:16.673612+0000 mon.a (mon.0) 421 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:47:18.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:17 gibba013 bash[13024]: audit 2021-03-10T13:47:16.676373+0000 mon.a (mon.0) 422 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:47:18.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:17 gibba013 bash[13024]: audit 2021-03-10T13:47:16.679758+0000 mon.b (mon.2) 17 : audit [INF] from='osd.6 [v2:172.21.2.120:6816/1328382283,v1:172.21.2.120:6817/1328382283]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:47:18.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:17 gibba013 bash[13024]: cluster 2021-03-10T13:47:17.218199+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:47:18.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:17 gibba013 bash[13024]: cluster 2021-03-10T13:47:17.218305+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:47:18.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:17 gibba013 bash[13024]: audit 2021-03-10T13:47:17.585036+0000 mon.a (mon.0) 423 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:47:18.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:18 gibba020 bash[9782]: audit 2021-03-10T13:47:17.677380+0000 mon.a (mon.0) 424 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]': finished 2021-03-10T13:47:18.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:18 gibba020 bash[9782]: cluster 2021-03-10T13:47:17.677429+0000 mon.a (mon.0) 425 : cluster [DBG] osdmap e41: 7 total, 6 up, 6 in 2021-03-10T13:47:18.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:18 gibba020 bash[9782]: audit 2021-03-10T13:47:17.678109+0000 mon.a (mon.0) 426 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:47:18.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:18 gibba020 bash[9782]: audit 2021-03-10T13:47:17.701476+0000 mon.a (mon.0) 427 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973062\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973326\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973492\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973650\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973800\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973950\", \"created\": \"2021-03-10T13:47:09.378011\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}}, \"last_daemon_update\": \"2021-03-10T13:47:09.974248\", \"last_device_update\": \"2021-03-10T13:47:17.699008\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:47:18.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:18 gibba020 bash[9782]: audit 2021-03-10T13:47:17.710344+0000 mon.a (mon.0) 428 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973062\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973326\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973492\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973650\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973800\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973950\", \"created\": \"2021-03-10T13:47:09.378011\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}}, \"last_daemon_update\": \"2021-03-10T13:47:09.974248\", \"last_device_update\": \"2021-03-10T13:47:17.699008\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:47:19.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:18 gibba013 bash[9767]: audit 2021-03-10T13:47:17.677380+0000 mon.a (mon.0) 424 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]': finished 2021-03-10T13:47:19.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:18 gibba013 bash[9767]: cluster 2021-03-10T13:47:17.677429+0000 mon.a (mon.0) 425 : cluster [DBG] osdmap e41: 7 total, 6 up, 6 in 2021-03-10T13:47:19.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:18 gibba013 bash[9767]: audit 2021-03-10T13:47:17.678109+0000 mon.a (mon.0) 426 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:47:19.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:18 gibba013 bash[13024]: audit 2021-03-10T13:47:17.677380+0000 mon.a (mon.0) 424 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]': finished 2021-03-10T13:47:19.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:18 gibba013 bash[13024]: cluster 2021-03-10T13:47:17.677429+0000 mon.a (mon.0) 425 : cluster [DBG] osdmap e41: 7 total, 6 up, 6 in 2021-03-10T13:47:19.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:18 gibba013 bash[13024]: audit 2021-03-10T13:47:17.678109+0000 mon.a (mon.0) 426 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:47:19.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:18 gibba013 bash[9767]: audit 2021-03-10T13:47:17.701476+0000 mon.a (mon.0) 427 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973062\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973326\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973492\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973650\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973800\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973950\", \"created\": \"2021-03-10T13:47:09.378011\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}}, \"last_daemon_update\": \"2021-03-10T13:47:09.974248\", \"last_device_update\": \"2021-03-10T13:47:17.699008\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:47:19.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:18 gibba013 bash[9767]: audit 2021-03-10T13:47:17.710344+0000 mon.a (mon.0) 428 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973062\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973326\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973492\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973650\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973800\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973950\", \"created\": \"2021-03-10T13:47:09.378011\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}}, \"last_daemon_update\": \"2021-03-10T13:47:09.974248\", \"last_device_update\": \"2021-03-10T13:47:17.699008\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:47:19.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:18 gibba013 bash[13024]: audit 2021-03-10T13:47:17.701476+0000 mon.a (mon.0) 427 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973062\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973326\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973492\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973650\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973800\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973950\", \"created\": \"2021-03-10T13:47:09.378011\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}}, \"last_daemon_update\": \"2021-03-10T13:47:09.974248\", \"last_device_update\": \"2021-03-10T13:47:17.699008\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:47:19.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:18 gibba013 bash[13024]: audit 2021-03-10T13:47:17.710344+0000 mon.a (mon.0) 428 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973062\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973326\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973492\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973650\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973800\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973950\", \"created\": \"2021-03-10T13:47:09.378011\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}}, \"last_daemon_update\": \"2021-03-10T13:47:09.974248\", \"last_device_update\": \"2021-03-10T13:47:17.699008\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:47:19.945 INFO:journalctl@ceph.osd.5.gibba020.stdout:Mar 10 13:47:19 gibba020 bash[13673]: debug 2021-03-10T13:47:19.710+0000 7f9442148700 -1 osd.5 43 build_incremental_map_msg missing incremental map 43 2021-03-10T13:47:19.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:19 gibba020 bash[9782]: cluster 2021-03-10T13:47:18.449217+0000 mgr.y (mgr.14140) 143 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:47:19.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:19 gibba020 bash[9782]: cluster 2021-03-10T13:47:18.685297+0000 mon.a (mon.0) 429 : cluster [INF] osd.6 [v2:172.21.2.120:6816/1328382283,v1:172.21.2.120:6817/1328382283] boot 2021-03-10T13:47:19.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:19 gibba020 bash[9782]: cluster 2021-03-10T13:47:18.685340+0000 mon.a (mon.0) 430 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2021-03-10T13:47:19.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:19 gibba020 bash[9782]: audit 2021-03-10T13:47:18.686201+0000 mon.a (mon.0) 431 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:47:20.131 INFO:journalctl@ceph.osd.1.gibba013.stdout:Mar 10 13:47:19 gibba013 bash[16389]: debug 2021-03-10T13:47:19.706+0000 7f940c62e700 -1 osd.1 43 build_incremental_map_msg missing incremental map 43 2021-03-10T13:47:20.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:19 gibba013 bash[9767]: cluster 2021-03-10T13:47:18.449217+0000 mgr.y (mgr.14140) 143 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:47:20.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:19 gibba013 bash[9767]: cluster 2021-03-10T13:47:18.685297+0000 mon.a (mon.0) 429 : cluster [INF] osd.6 [v2:172.21.2.120:6816/1328382283,v1:172.21.2.120:6817/1328382283] boot 2021-03-10T13:47:20.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:19 gibba013 bash[9767]: cluster 2021-03-10T13:47:18.685340+0000 mon.a (mon.0) 430 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2021-03-10T13:47:20.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:19 gibba013 bash[9767]: audit 2021-03-10T13:47:18.686201+0000 mon.a (mon.0) 431 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:47:20.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:19 gibba013 bash[13024]: cluster 2021-03-10T13:47:18.449217+0000 mgr.y (mgr.14140) 143 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T13:47:20.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:19 gibba013 bash[13024]: cluster 2021-03-10T13:47:18.685297+0000 mon.a (mon.0) 429 : cluster [INF] osd.6 [v2:172.21.2.120:6816/1328382283,v1:172.21.2.120:6817/1328382283] boot 2021-03-10T13:47:20.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:19 gibba013 bash[13024]: cluster 2021-03-10T13:47:18.685340+0000 mon.a (mon.0) 430 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2021-03-10T13:47:20.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:19 gibba013 bash[13024]: audit 2021-03-10T13:47:18.686201+0000 mon.a (mon.0) 431 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:47:20.801 INFO:journalctl@ceph.osd.5.gibba020.stdout:Mar 10 13:47:20 gibba020 bash[13673]: debug 2021-03-10T13:47:20.550+0000 7f945e9f1700 -1 osd.5 43 build_incremental_map_msg missing incremental map 43 2021-03-10T13:47:20.801 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:20 gibba020 bash[9782]: cluster 2021-03-10T13:47:19.709395+0000 mon.a (mon.0) 432 : cluster [DBG] osdmap e43: 7 total, 7 up, 7 in 2021-03-10T13:47:20.802 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:20 gibba020 bash[9782]: audit 2021-03-10T13:47:19.831997+0000 mgr.y (mgr.14140) 144 : audit [DBG] from='client.34211 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba020:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:47:20.802 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:20 gibba020 bash[9782]: cephadm 2021-03-10T13:47:19.833938+0000 mgr.y (mgr.14140) 145 : cephadm [INF] Applying osd on host gibba020... 2021-03-10T13:47:20.802 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:20 gibba020 bash[9782]: audit 2021-03-10T13:47:19.834792+0000 mon.a (mon.0) 433 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:47:20.802 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:20 gibba020 bash[9782]: audit 2021-03-10T13:47:19.837555+0000 mon.a (mon.0) 434 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:47:20.802 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:20 gibba020 bash[9782]: audit 2021-03-10T13:47:19.841828+0000 mon.a (mon.0) 435 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:47:21.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:20 gibba013 bash[9767]: cluster 2021-03-10T13:47:19.709395+0000 mon.a (mon.0) 432 : cluster [DBG] osdmap e43: 7 total, 7 up, 7 in 2021-03-10T13:47:21.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:20 gibba013 bash[9767]: audit 2021-03-10T13:47:19.831997+0000 mgr.y (mgr.14140) 144 : audit [DBG] from='client.34211 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba020:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:47:21.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:20 gibba013 bash[9767]: cephadm 2021-03-10T13:47:19.833938+0000 mgr.y (mgr.14140) 145 : cephadm [INF] Applying osd on host gibba020... 2021-03-10T13:47:21.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:20 gibba013 bash[9767]: audit 2021-03-10T13:47:19.834792+0000 mon.a (mon.0) 433 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:47:21.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:20 gibba013 bash[9767]: audit 2021-03-10T13:47:19.837555+0000 mon.a (mon.0) 434 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:47:21.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:20 gibba013 bash[9767]: audit 2021-03-10T13:47:19.841828+0000 mon.a (mon.0) 435 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:47:21.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:20 gibba013 bash[13024]: cluster 2021-03-10T13:47:19.709395+0000 mon.a (mon.0) 432 : cluster [DBG] osdmap e43: 7 total, 7 up, 7 in 2021-03-10T13:47:21.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:20 gibba013 bash[13024]: audit 2021-03-10T13:47:19.831997+0000 mgr.y (mgr.14140) 144 : audit [DBG] from='client.34211 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba020:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:47:21.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:20 gibba013 bash[13024]: cephadm 2021-03-10T13:47:19.833938+0000 mgr.y (mgr.14140) 145 : cephadm [INF] Applying osd on host gibba020... 2021-03-10T13:47:21.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:20 gibba013 bash[13024]: audit 2021-03-10T13:47:19.834792+0000 mon.a (mon.0) 433 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T13:47:21.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:20 gibba013 bash[13024]: audit 2021-03-10T13:47:19.837555+0000 mon.a (mon.0) 434 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:47:21.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:20 gibba013 bash[13024]: audit 2021-03-10T13:47:19.841828+0000 mon.a (mon.0) 435 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:47:22.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:21 gibba013 bash[9767]: cluster 2021-03-10T13:47:20.449780+0000 mgr.y (mgr.14140) 146 : cluster [DBG] pgmap v148: 1 pgs: 1 peering; 0 B data, 2.5 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:47:22.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:21 gibba013 bash[9767]: cluster 2021-03-10T13:47:21.440370+0000 mon.a (mon.0) 436 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T13:47:22.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:21 gibba013 bash[13024]: cluster 2021-03-10T13:47:20.449780+0000 mgr.y (mgr.14140) 146 : cluster [DBG] pgmap v148: 1 pgs: 1 peering; 0 B data, 2.5 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:47:22.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:21 gibba013 bash[13024]: cluster 2021-03-10T13:47:21.440370+0000 mon.a (mon.0) 436 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T13:47:22.164 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:21 gibba020 bash[9782]: cluster 2021-03-10T13:47:20.449780+0000 mgr.y (mgr.14140) 146 : cluster [DBG] pgmap v148: 1 pgs: 1 peering; 0 B data, 2.5 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:47:22.164 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:21 gibba020 bash[9782]: cluster 2021-03-10T13:47:21.440370+0000 mon.a (mon.0) 436 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T13:47:24.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:23 gibba013 bash[9767]: cluster 2021-03-10T13:47:22.450649+0000 mgr.y (mgr.14140) 147 : cluster [DBG] pgmap v149: 1 pgs: 1 peering; 0 B data, 2.6 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:47:24.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:23 gibba013 bash[9767]: audit 2021-03-10T13:47:22.767756+0000 mon.a (mon.0) 437 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b05701f-f937-4752-bbf7-a7196766d792"}]: dispatch 2021-03-10T13:47:24.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:23 gibba013 bash[9767]: audit 2021-03-10T13:47:22.770623+0000 mon.b (mon.2) 18 : audit [INF] from='client.? 172.21.2.120:0/2244157144' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b05701f-f937-4752-bbf7-a7196766d792"}]: dispatch 2021-03-10T13:47:24.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:23 gibba013 bash[9767]: audit 2021-03-10T13:47:22.772599+0000 mon.a (mon.0) 438 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6b05701f-f937-4752-bbf7-a7196766d792"}]': finished 2021-03-10T13:47:24.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:23 gibba013 bash[9767]: cluster 2021-03-10T13:47:22.772656+0000 mon.a (mon.0) 439 : cluster [DBG] osdmap e44: 8 total, 7 up, 7 in 2021-03-10T13:47:24.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:23 gibba013 bash[9767]: audit 2021-03-10T13:47:22.772762+0000 mon.a (mon.0) 440 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:47:24.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:23 gibba013 bash[13024]: cluster 2021-03-10T13:47:22.450649+0000 mgr.y (mgr.14140) 147 : cluster [DBG] pgmap v149: 1 pgs: 1 peering; 0 B data, 2.6 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:47:24.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:23 gibba013 bash[13024]: audit 2021-03-10T13:47:22.767756+0000 mon.a (mon.0) 437 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b05701f-f937-4752-bbf7-a7196766d792"}]: dispatch 2021-03-10T13:47:24.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:23 gibba013 bash[13024]: audit 2021-03-10T13:47:22.770623+0000 mon.b (mon.2) 18 : audit [INF] from='client.? 172.21.2.120:0/2244157144' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b05701f-f937-4752-bbf7-a7196766d792"}]: dispatch 2021-03-10T13:47:24.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:23 gibba013 bash[13024]: audit 2021-03-10T13:47:22.772599+0000 mon.a (mon.0) 438 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6b05701f-f937-4752-bbf7-a7196766d792"}]': finished 2021-03-10T13:47:24.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:23 gibba013 bash[13024]: cluster 2021-03-10T13:47:22.772656+0000 mon.a (mon.0) 439 : cluster [DBG] osdmap e44: 8 total, 7 up, 7 in 2021-03-10T13:47:24.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:23 gibba013 bash[13024]: audit 2021-03-10T13:47:22.772762+0000 mon.a (mon.0) 440 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:47:24.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:23 gibba020 bash[9782]: cluster 2021-03-10T13:47:22.450649+0000 mgr.y (mgr.14140) 147 : cluster [DBG] pgmap v149: 1 pgs: 1 peering; 0 B data, 2.6 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:47:24.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:23 gibba020 bash[9782]: audit 2021-03-10T13:47:22.767756+0000 mon.a (mon.0) 437 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b05701f-f937-4752-bbf7-a7196766d792"}]: dispatch 2021-03-10T13:47:24.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:23 gibba020 bash[9782]: audit 2021-03-10T13:47:22.770623+0000 mon.b (mon.2) 18 : audit [INF] from='client.? 172.21.2.120:0/2244157144' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6b05701f-f937-4752-bbf7-a7196766d792"}]: dispatch 2021-03-10T13:47:24.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:23 gibba020 bash[9782]: audit 2021-03-10T13:47:22.772599+0000 mon.a (mon.0) 438 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6b05701f-f937-4752-bbf7-a7196766d792"}]': finished 2021-03-10T13:47:24.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:23 gibba020 bash[9782]: cluster 2021-03-10T13:47:22.772656+0000 mon.a (mon.0) 439 : cluster [DBG] osdmap e44: 8 total, 7 up, 7 in 2021-03-10T13:47:24.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:23 gibba020 bash[9782]: audit 2021-03-10T13:47:22.772762+0000 mon.a (mon.0) 440 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:47:26.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:25 gibba013 bash[9767]: cluster 2021-03-10T13:47:24.451530+0000 mgr.y (mgr.14140) 148 : cluster [DBG] pgmap v151: 1 pgs: 1 peering; 0 B data, 2.7 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:47:26.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:25 gibba013 bash[9767]: audit 2021-03-10T13:47:24.806911+0000 mon.b (mon.2) 19 : audit [DBG] from='client.? 172.21.2.120:0/3531347651' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:47:26.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:25 gibba013 bash[13024]: cluster 2021-03-10T13:47:24.451530+0000 mgr.y (mgr.14140) 148 : cluster [DBG] pgmap v151: 1 pgs: 1 peering; 0 B data, 2.7 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:47:26.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:25 gibba013 bash[13024]: audit 2021-03-10T13:47:24.806911+0000 mon.b (mon.2) 19 : audit [DBG] from='client.? 172.21.2.120:0/3531347651' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:47:26.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:25 gibba020 bash[9782]: cluster 2021-03-10T13:47:24.451530+0000 mgr.y (mgr.14140) 148 : cluster [DBG] pgmap v151: 1 pgs: 1 peering; 0 B data, 2.7 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:47:26.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:25 gibba020 bash[9782]: audit 2021-03-10T13:47:24.806911+0000 mon.b (mon.2) 19 : audit [DBG] from='client.? 172.21.2.120:0/3531347651' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T13:47:27.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:26 gibba013 bash[9767]: cluster 2021-03-10T13:47:26.736936+0000 mon.a (mon.0) 441 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T13:47:27.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:26 gibba013 bash[9767]: cluster 2021-03-10T13:47:26.737038+0000 mon.a (mon.0) 442 : cluster [INF] Cluster is now healthy 2021-03-10T13:47:27.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:26 gibba013 bash[13024]: cluster 2021-03-10T13:47:26.736936+0000 mon.a (mon.0) 441 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T13:47:27.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:26 gibba013 bash[13024]: cluster 2021-03-10T13:47:26.737038+0000 mon.a (mon.0) 442 : cluster [INF] Cluster is now healthy 2021-03-10T13:47:27.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:26 gibba020 bash[9782]: cluster 2021-03-10T13:47:26.736936+0000 mon.a (mon.0) 441 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T13:47:27.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:26 gibba020 bash[9782]: cluster 2021-03-10T13:47:26.737038+0000 mon.a (mon.0) 442 : cluster [INF] Cluster is now healthy 2021-03-10T13:47:27.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:27 gibba020 bash[9782]: cluster 2021-03-10T13:47:26.452229+0000 mgr.y (mgr.14140) 149 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:47:27.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:27 gibba020 bash[9782]: audit 2021-03-10T13:47:27.480711+0000 mon.a (mon.0) 443 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:47:28.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:27 gibba013 bash[9767]: cluster 2021-03-10T13:47:26.452229+0000 mgr.y (mgr.14140) 149 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:47:28.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:27 gibba013 bash[9767]: audit 2021-03-10T13:47:27.480711+0000 mon.a (mon.0) 443 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:47:28.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:27 gibba013 bash[13024]: cluster 2021-03-10T13:47:26.452229+0000 mgr.y (mgr.14140) 149 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:47:28.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:27 gibba013 bash[13024]: audit 2021-03-10T13:47:27.480711+0000 mon.a (mon.0) 443 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:47:30.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:29 gibba013 bash[9767]: cluster 2021-03-10T13:47:28.453144+0000 mgr.y (mgr.14140) 150 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:47:30.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:29 gibba013 bash[13024]: cluster 2021-03-10T13:47:28.453144+0000 mgr.y (mgr.14140) 150 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:47:30.194 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:29 gibba020 bash[9782]: cluster 2021-03-10T13:47:28.453144+0000 mgr.y (mgr.14140) 150 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:47:31.857 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:31 gibba020 bash[9782]: cluster 2021-03-10T13:47:30.453768+0000 mgr.y (mgr.14140) 151 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:47:31.858 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:31 gibba020 bash[9782]: audit 2021-03-10T13:47:30.998066+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2021-03-10T13:47:31.858 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:31 gibba020 bash[9782]: audit 2021-03-10T13:47:31.001022+0000 mon.a (mon.0) 445 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:47:31.858 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:31 gibba020 bash[9782]: cephadm 2021-03-10T13:47:31.003439+0000 mgr.y (mgr.14140) 152 : cephadm [INF] Deploying daemon osd.7 on gibba020 2021-03-10T13:47:31.859 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:31 gibba020 bash[9782]: audit 2021-03-10T13:47:31.004361+0000 mon.a (mon.0) 446 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2021-03-10T13:47:32.297 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:31 gibba013 bash[9767]: cluster 2021-03-10T13:47:30.453768+0000 mgr.y (mgr.14140) 151 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:47:32.297 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:31 gibba013 bash[9767]: audit 2021-03-10T13:47:30.998066+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2021-03-10T13:47:32.297 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:31 gibba013 bash[9767]: audit 2021-03-10T13:47:31.001022+0000 mon.a (mon.0) 445 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:47:32.298 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:31 gibba013 bash[9767]: cephadm 2021-03-10T13:47:31.003439+0000 mgr.y (mgr.14140) 152 : cephadm [INF] Deploying daemon osd.7 on gibba020 2021-03-10T13:47:32.298 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:31 gibba013 bash[9767]: audit 2021-03-10T13:47:31.004361+0000 mon.a (mon.0) 446 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2021-03-10T13:47:32.298 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:31 gibba013 bash[13024]: cluster 2021-03-10T13:47:30.453768+0000 mgr.y (mgr.14140) 151 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:47:32.299 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:31 gibba013 bash[13024]: audit 2021-03-10T13:47:30.998066+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2021-03-10T13:47:32.299 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:31 gibba013 bash[13024]: audit 2021-03-10T13:47:31.001022+0000 mon.a (mon.0) 445 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:47:32.299 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:31 gibba013 bash[13024]: cephadm 2021-03-10T13:47:31.003439+0000 mgr.y (mgr.14140) 152 : cephadm [INF] Deploying daemon osd.7 on gibba020 2021-03-10T13:47:32.300 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:31 gibba013 bash[13024]: audit 2021-03-10T13:47:31.004361+0000 mon.a (mon.0) 446 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2021-03-10T13:47:32.893 INFO:teuthology.orchestra.run.gibba020.stdout:Created osd(s) 7 on host 'gibba020' 2021-03-10T13:47:33.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:33 gibba020 bash[9782]: cluster 2021-03-10T13:47:32.454617+0000 mgr.y (mgr.14140) 153 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:47:33.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:33 gibba020 bash[9782]: audit 2021-03-10T13:47:32.881153+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973062\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973326\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973492\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973650\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973800\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973950\", \"created\": \"2021-03-10T13:47:09.378011\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}}, \"last_device_update\": \"2021-03-10T13:47:17.699008\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:47:33.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:33 gibba020 bash[9782]: audit 2021-03-10T13:47:32.882739+0000 mon.a (mon.0) 448 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:47:33.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:33 gibba020 bash[9782]: audit 2021-03-10T13:47:32.889941+0000 mon.a (mon.0) 449 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973062\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973326\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973492\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973650\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973800\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973950\", \"created\": \"2021-03-10T13:47:09.378011\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}}, \"last_device_update\": \"2021-03-10T13:47:17.699008\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:47:33.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:33 gibba020 bash[9782]: audit 2021-03-10T13:47:33.356648+0000 mon.a (mon.0) 450 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.352683\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.352951\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353121\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353278\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353431\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353582\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353731\", \"created\": \"2021-03-10T13:47:32.870012\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}}, \"last_daemon_update\": \"2021-03-10T13:47:33.354024\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:47:33.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:33 gibba020 bash[9782]: audit 2021-03-10T13:47:33.365512+0000 mon.a (mon.0) 451 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.352683\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.352951\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353121\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353278\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353431\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353582\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353731\", \"created\": \"2021-03-10T13:47:32.870012\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}}, \"last_daemon_update\": \"2021-03-10T13:47:33.354024\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:47:33.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:33 gibba020 bash[9782]: audit 2021-03-10T13:47:33.366129+0000 mon.a (mon.0) 452 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:47:33.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:33 gibba013 bash[9767]: cluster 2021-03-10T13:47:32.454617+0000 mgr.y (mgr.14140) 153 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:47:33.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:33 gibba013 bash[13024]: cluster 2021-03-10T13:47:32.454617+0000 mgr.y (mgr.14140) 153 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:47:33.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:33 gibba013 bash[9767]: audit 2021-03-10T13:47:32.881153+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973062\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973326\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973492\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973650\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973800\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973950\", \"created\": \"2021-03-10T13:47:09.378011\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}}, \"last_device_update\": \"2021-03-10T13:47:17.699008\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:47:33.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:33 gibba013 bash[9767]: audit 2021-03-10T13:47:32.882739+0000 mon.a (mon.0) 448 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:47:33.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:33 gibba013 bash[13024]: audit 2021-03-10T13:47:32.881153+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973062\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973326\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973492\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973650\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973800\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973950\", \"created\": \"2021-03-10T13:47:09.378011\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}}, \"last_device_update\": \"2021-03-10T13:47:17.699008\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:47:33.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:33 gibba013 bash[13024]: audit 2021-03-10T13:47:32.882739+0000 mon.a (mon.0) 448 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:47:33.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:33 gibba013 bash[9767]: audit 2021-03-10T13:47:32.889941+0000 mon.a (mon.0) 449 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973062\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973326\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973492\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973650\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973800\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973950\", \"created\": \"2021-03-10T13:47:09.378011\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}}, \"last_device_update\": \"2021-03-10T13:47:17.699008\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:47:33.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:33 gibba013 bash[9767]: audit 2021-03-10T13:47:33.356648+0000 mon.a (mon.0) 450 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.352683\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.352951\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353121\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353278\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353431\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353582\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353731\", \"created\": \"2021-03-10T13:47:32.870012\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}}, \"last_daemon_update\": \"2021-03-10T13:47:33.354024\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:47:33.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:33 gibba013 bash[9767]: audit 2021-03-10T13:47:33.365512+0000 mon.a (mon.0) 451 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.352683\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.352951\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353121\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353278\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353431\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353582\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353731\", \"created\": \"2021-03-10T13:47:32.870012\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}}, \"last_daemon_update\": \"2021-03-10T13:47:33.354024\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:47:33.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:33 gibba013 bash[9767]: audit 2021-03-10T13:47:33.366129+0000 mon.a (mon.0) 452 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:47:33.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:33 gibba013 bash[13024]: audit 2021-03-10T13:47:32.889941+0000 mon.a (mon.0) 449 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973062\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973326\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973492\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973650\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973800\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:09.973950\", \"created\": \"2021-03-10T13:47:09.378011\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}}, \"last_device_update\": \"2021-03-10T13:47:17.699008\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:47:33.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:33 gibba013 bash[13024]: audit 2021-03-10T13:47:33.356648+0000 mon.a (mon.0) 450 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.352683\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.352951\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353121\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353278\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353431\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353582\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353731\", \"created\": \"2021-03-10T13:47:32.870012\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}}, \"last_daemon_update\": \"2021-03-10T13:47:33.354024\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:47:33.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:33 gibba013 bash[13024]: audit 2021-03-10T13:47:33.365512+0000 mon.a (mon.0) 451 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.352683\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.352951\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353121\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353278\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353431\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353582\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353731\", \"created\": \"2021-03-10T13:47:32.870012\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}}, \"last_daemon_update\": \"2021-03-10T13:47:33.354024\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:47:33.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:33 gibba013 bash[13024]: audit 2021-03-10T13:47:33.366129+0000 mon.a (mon.0) 452 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T13:47:34.393 DEBUG:teuthology.orchestra.run.gibba020:osd.7> sudo journalctl -f -n 0 -u ceph-7672acc8-81a6-11eb-9080-001a4aab830c@osd.7.service 2021-03-10T13:47:34.395 INFO:tasks.cephadm:Adding prometheus.a on gibba020 2021-03-10T13:47:34.396 DEBUG:teuthology.orchestra.run.gibba020:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph orch apply prometheus '1;gibba020=a' 2021-03-10T13:47:34.436 INFO:journalctl@ceph.osd.7.gibba020.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:47:35.689 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:35 gibba020 bash[9782]: cluster 2021-03-10T13:47:34.455281+0000 mgr.y (mgr.14140) 154 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:47:35.690 INFO:journalctl@ceph.osd.7.gibba020.stdout:Mar 10 13:47:35 gibba020 bash[16261]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-03-10T13:47:35.690 INFO:journalctl@ceph.osd.7.gibba020.stdout:Mar 10 13:47:35 gibba020 bash[16261]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-7 --no-mon-config 2021-03-10T13:47:35.690 INFO:journalctl@ceph.osd.7.gibba020.stdout:Mar 10 13:47:35 gibba020 bash[16261]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7/block 2021-03-10T13:47:35.690 INFO:journalctl@ceph.osd.7.gibba020.stdout:Mar 10 13:47:35 gibba020 bash[16261]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-7/block 2021-03-10T13:47:35.691 INFO:journalctl@ceph.osd.7.gibba020.stdout:Mar 10 13:47:35 gibba020 bash[16261]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2021-03-10T13:47:35.691 INFO:journalctl@ceph.osd.7.gibba020.stdout:Mar 10 13:47:35 gibba020 bash[16261]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-03-10T13:47:35.691 INFO:journalctl@ceph.osd.7.gibba020.stdout:Mar 10 13:47:35 gibba020 bash[16261]: --> ceph-volume lvm activate successful for osd ID: 7 2021-03-10T13:47:35.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:35 gibba013 bash[9767]: cluster 2021-03-10T13:47:34.455281+0000 mgr.y (mgr.14140) 154 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:47:35.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:35 gibba013 bash[13024]: cluster 2021-03-10T13:47:34.455281+0000 mgr.y (mgr.14140) 154 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:47:37.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:37 gibba020 bash[9782]: cluster 2021-03-10T13:47:36.456259+0000 mgr.y (mgr.14140) 155 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:47:37.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:37 gibba020 bash[9782]: audit 2021-03-10T13:47:36.481660+0000 mon.a (mon.0) 453 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"4df2e810-953e-45e5-852d-84682d065dae\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383993.454606, \"finished_at\": 1615384006.7700126}, {\"id\": \"c79d246c-7a77-4683-bf60-27d80d5cf59c\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615384015.5000648, \"finished_at\": 1615384029.3994632}, {\"id\": \"b50cbdf8-4b22-4996-904b-b94155273994\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615384038.6853857, \"finished_at\": 1615384052.8935423}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T13:47:37.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:37 gibba020 bash[9782]: audit 2021-03-10T13:47:36.484362+0000 mon.a (mon.0) 454 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"4df2e810-953e-45e5-852d-84682d065dae\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383993.454606, \"finished_at\": 1615384006.7700126}, {\"id\": \"c79d246c-7a77-4683-bf60-27d80d5cf59c\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615384015.5000648, \"finished_at\": 1615384029.3994632}, {\"id\": \"b50cbdf8-4b22-4996-904b-b94155273994\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615384038.6853857, \"finished_at\": 1615384052.8935423}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T13:47:37.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:37 gibba013 bash[9767]: cluster 2021-03-10T13:47:36.456259+0000 mgr.y (mgr.14140) 155 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:47:37.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:37 gibba013 bash[9767]: audit 2021-03-10T13:47:36.481660+0000 mon.a (mon.0) 453 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"4df2e810-953e-45e5-852d-84682d065dae\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383993.454606, \"finished_at\": 1615384006.7700126}, {\"id\": \"c79d246c-7a77-4683-bf60-27d80d5cf59c\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615384015.5000648, \"finished_at\": 1615384029.3994632}, {\"id\": \"b50cbdf8-4b22-4996-904b-b94155273994\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615384038.6853857, \"finished_at\": 1615384052.8935423}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T13:47:37.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:37 gibba013 bash[9767]: audit 2021-03-10T13:47:36.484362+0000 mon.a (mon.0) 454 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"4df2e810-953e-45e5-852d-84682d065dae\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383993.454606, \"finished_at\": 1615384006.7700126}, {\"id\": \"c79d246c-7a77-4683-bf60-27d80d5cf59c\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615384015.5000648, \"finished_at\": 1615384029.3994632}, {\"id\": \"b50cbdf8-4b22-4996-904b-b94155273994\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615384038.6853857, \"finished_at\": 1615384052.8935423}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T13:47:37.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:37 gibba013 bash[13024]: cluster 2021-03-10T13:47:36.456259+0000 mgr.y (mgr.14140) 155 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:47:37.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:37 gibba013 bash[13024]: audit 2021-03-10T13:47:36.481660+0000 mon.a (mon.0) 453 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"4df2e810-953e-45e5-852d-84682d065dae\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383993.454606, \"finished_at\": 1615384006.7700126}, {\"id\": \"c79d246c-7a77-4683-bf60-27d80d5cf59c\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615384015.5000648, \"finished_at\": 1615384029.3994632}, {\"id\": \"b50cbdf8-4b22-4996-904b-b94155273994\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615384038.6853857, \"finished_at\": 1615384052.8935423}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T13:47:37.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:37 gibba013 bash[13024]: audit 2021-03-10T13:47:36.484362+0000 mon.a (mon.0) 454 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"4df2e810-953e-45e5-852d-84682d065dae\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383993.454606, \"finished_at\": 1615384006.7700126}, {\"id\": \"c79d246c-7a77-4683-bf60-27d80d5cf59c\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615384015.5000648, \"finished_at\": 1615384029.3994632}, {\"id\": \"b50cbdf8-4b22-4996-904b-b94155273994\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615384038.6853857, \"finished_at\": 1615384052.8935423}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T13:47:39.832 INFO:teuthology.orchestra.run.gibba020.stdout:Scheduled prometheus update... 2021-03-10T13:47:39.879 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:39 gibba020 bash[9782]: cluster 2021-03-10T13:47:38.457292+0000 mgr.y (mgr.14140) 156 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:47:39.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:39 gibba013 bash[9767]: cluster 2021-03-10T13:47:38.457292+0000 mgr.y (mgr.14140) 156 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:47:39.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:39 gibba013 bash[13024]: cluster 2021-03-10T13:47:38.457292+0000 mgr.y (mgr.14140) 156 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:47:40.194 INFO:journalctl@ceph.osd.7.gibba020.stdout:Mar 10 13:47:39 gibba020 bash[16618]: debug 2021-03-10T13:47:39.878+0000 7f291cda3ec0 -1 Falling back to public interface 2021-03-10T13:47:40.640 DEBUG:teuthology.orchestra.run.gibba020:prometheus.a> sudo journalctl -f -n 0 -u ceph-7672acc8-81a6-11eb-9080-001a4aab830c@prometheus.a.service 2021-03-10T13:47:40.645 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:40 gibba020 bash[9782]: audit 2021-03-10T13:47:39.818505+0000 mgr.y (mgr.14140) 157 : audit [DBG] from='client.34235 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;gibba020=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:47:40.646 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:40 gibba020 bash[9782]: cephadm 2021-03-10T13:47:39.819856+0000 mgr.y (mgr.14140) 158 : cephadm [INF] Saving service prometheus spec with placement count:1 gibba020=a 2021-03-10T13:47:40.646 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:40 gibba020 bash[9782]: audit 2021-03-10T13:47:39.820822+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2021-03-10T13:47:39.819895\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba020\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]: dispatch 2021-03-10T13:47:40.646 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:40 gibba020 bash[9782]: audit 2021-03-10T13:47:39.829075+0000 mon.a (mon.0) 456 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2021-03-10T13:47:39.819895\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba020\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]': finished 2021-03-10T13:47:40.647 INFO:journalctl@ceph.osd.7.gibba020.stdout:Mar 10 13:47:40 gibba020 bash[16618]: debug 2021-03-10T13:47:40.502+0000 7f291cda3ec0 -1 osd.7 0 log_to_monitors {default=true} 2021-03-10T13:47:40.648 INFO:tasks.cephadm:Adding node-exporter.a on gibba013 2021-03-10T13:47:40.648 INFO:tasks.cephadm:Adding node-exporter.b on gibba020 2021-03-10T13:47:40.649 DEBUG:teuthology.orchestra.run.gibba020:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph orch apply node-exporter '2;gibba013=a;gibba020=b' 2021-03-10T13:47:40.803 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:47:40.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:40 gibba013 bash[9767]: audit 2021-03-10T13:47:39.818505+0000 mgr.y (mgr.14140) 157 : audit [DBG] from='client.34235 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;gibba020=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:47:40.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:40 gibba013 bash[9767]: cephadm 2021-03-10T13:47:39.819856+0000 mgr.y (mgr.14140) 158 : cephadm [INF] Saving service prometheus spec with placement count:1 gibba020=a 2021-03-10T13:47:40.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:40 gibba013 bash[9767]: audit 2021-03-10T13:47:39.820822+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2021-03-10T13:47:39.819895\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba020\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]: dispatch 2021-03-10T13:47:40.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:40 gibba013 bash[9767]: audit 2021-03-10T13:47:39.829075+0000 mon.a (mon.0) 456 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2021-03-10T13:47:39.819895\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba020\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]': finished 2021-03-10T13:47:40.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:40 gibba013 bash[13024]: audit 2021-03-10T13:47:39.818505+0000 mgr.y (mgr.14140) 157 : audit [DBG] from='client.34235 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;gibba020=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:47:40.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:40 gibba013 bash[13024]: cephadm 2021-03-10T13:47:39.819856+0000 mgr.y (mgr.14140) 158 : cephadm [INF] Saving service prometheus spec with placement count:1 gibba020=a 2021-03-10T13:47:40.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:40 gibba013 bash[13024]: audit 2021-03-10T13:47:39.820822+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2021-03-10T13:47:39.819895\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba020\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]: dispatch 2021-03-10T13:47:40.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:40 gibba013 bash[13024]: audit 2021-03-10T13:47:39.829075+0000 mon.a (mon.0) 456 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2021-03-10T13:47:39.819895\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba020\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]': finished 2021-03-10T13:47:41.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:41 gibba013 bash[9767]: cluster 2021-03-10T13:47:40.457909+0000 mgr.y (mgr.14140) 159 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:47:41.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:41 gibba013 bash[9767]: audit 2021-03-10T13:47:40.505855+0000 mon.a (mon.0) 457 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T13:47:41.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:41 gibba013 bash[9767]: audit 2021-03-10T13:47:40.509288+0000 mon.b (mon.2) 20 : audit [INF] from='osd.7 [v2:172.21.2.120:6824/1421523901,v1:172.21.2.120:6825/1421523901]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T13:47:41.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:41 gibba013 bash[9767]: audit 2021-03-10T13:47:41.377395+0000 mon.a (mon.0) 458 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:47:41.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:41 gibba013 bash[9767]: audit 2021-03-10T13:47:41.486647+0000 mon.a (mon.0) 459 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.352683\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.352951\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353121\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353278\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353431\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353582\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353731\", \"created\": \"2021-03-10T13:47:32.870012\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}}, \"last_daemon_update\": \"2021-03-10T13:47:33.354024\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:47:41.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:41 gibba013 bash[13024]: cluster 2021-03-10T13:47:40.457909+0000 mgr.y (mgr.14140) 159 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:47:41.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:41 gibba013 bash[13024]: audit 2021-03-10T13:47:40.505855+0000 mon.a (mon.0) 457 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T13:47:41.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:41 gibba013 bash[13024]: audit 2021-03-10T13:47:40.509288+0000 mon.b (mon.2) 20 : audit [INF] from='osd.7 [v2:172.21.2.120:6824/1421523901,v1:172.21.2.120:6825/1421523901]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T13:47:41.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:41 gibba013 bash[13024]: audit 2021-03-10T13:47:41.377395+0000 mon.a (mon.0) 458 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:47:41.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:41 gibba013 bash[13024]: audit 2021-03-10T13:47:41.486647+0000 mon.a (mon.0) 459 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.352683\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.352951\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353121\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353278\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353431\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353582\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353731\", \"created\": \"2021-03-10T13:47:32.870012\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}}, \"last_daemon_update\": \"2021-03-10T13:47:33.354024\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:47:41.907 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:41 gibba020 bash[9782]: cluster 2021-03-10T13:47:40.457909+0000 mgr.y (mgr.14140) 159 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:47:41.907 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:41 gibba020 bash[9782]: audit 2021-03-10T13:47:40.505855+0000 mon.a (mon.0) 457 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T13:47:41.907 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:41 gibba020 bash[9782]: audit 2021-03-10T13:47:40.509288+0000 mon.b (mon.2) 20 : audit [INF] from='osd.7 [v2:172.21.2.120:6824/1421523901,v1:172.21.2.120:6825/1421523901]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T13:47:41.908 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:41 gibba020 bash[9782]: audit 2021-03-10T13:47:41.377395+0000 mon.a (mon.0) 458 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:47:41.908 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:41 gibba020 bash[9782]: audit 2021-03-10T13:47:41.486647+0000 mon.a (mon.0) 459 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.352683\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.352951\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353121\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353278\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353431\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353582\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353731\", \"created\": \"2021-03-10T13:47:32.870012\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}}, \"last_daemon_update\": \"2021-03-10T13:47:33.354024\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:47:42.539 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:42 gibba020 bash[9782]: cluster 2021-03-10T13:47:41.487690+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:47:42.539 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:42 gibba020 bash[9782]: cluster 2021-03-10T13:47:41.487718+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:47:42.539 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:42 gibba020 bash[9782]: audit 2021-03-10T13:47:41.495505+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.352683\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.352951\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353121\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353278\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353431\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353582\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353731\", \"created\": \"2021-03-10T13:47:32.870012\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}}, \"last_daemon_update\": \"2021-03-10T13:47:33.354024\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:47:42.540 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:42 gibba020 bash[9782]: cephadm 2021-03-10T13:47:41.500055+0000 mgr.y (mgr.14140) 160 : cephadm [INF] Deploying daemon prometheus.a on gibba020 2021-03-10T13:47:42.540 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:42 gibba020 bash[9782]: audit 2021-03-10T13:47:41.503517+0000 mon.a (mon.0) 461 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-03-10T13:47:42.540 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:42 gibba020 bash[9782]: cluster 2021-03-10T13:47:41.503540+0000 mon.a (mon.0) 462 : cluster [DBG] osdmap e45: 8 total, 7 up, 7 in 2021-03-10T13:47:42.540 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:42 gibba020 bash[9782]: audit 2021-03-10T13:47:41.503621+0000 mon.a (mon.0) 463 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:47:42.541 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:42 gibba020 bash[9782]: audit 2021-03-10T13:47:41.504404+0000 mon.a (mon.0) 464 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:47:42.541 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:42 gibba020 bash[9782]: audit 2021-03-10T13:47:41.508164+0000 mon.b (mon.2) 21 : audit [INF] from='osd.7 [v2:172.21.2.120:6824/1421523901,v1:172.21.2.120:6825/1421523901]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:47:42.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:42 gibba013 bash[9767]: cluster 2021-03-10T13:47:41.487690+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:47:42.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:42 gibba013 bash[9767]: cluster 2021-03-10T13:47:41.487718+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:47:42.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:42 gibba013 bash[13024]: cluster 2021-03-10T13:47:41.487690+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T13:47:42.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:42 gibba013 bash[13024]: cluster 2021-03-10T13:47:41.487718+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T13:47:42.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:42 gibba013 bash[9767]: audit 2021-03-10T13:47:41.495505+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.352683\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.352951\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353121\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353278\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353431\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353582\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353731\", \"created\": \"2021-03-10T13:47:32.870012\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}}, \"last_daemon_update\": \"2021-03-10T13:47:33.354024\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:47:42.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:42 gibba013 bash[9767]: cephadm 2021-03-10T13:47:41.500055+0000 mgr.y (mgr.14140) 160 : cephadm [INF] Deploying daemon prometheus.a on gibba020 2021-03-10T13:47:42.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:42 gibba013 bash[9767]: audit 2021-03-10T13:47:41.503517+0000 mon.a (mon.0) 461 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-03-10T13:47:42.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:42 gibba013 bash[9767]: cluster 2021-03-10T13:47:41.503540+0000 mon.a (mon.0) 462 : cluster [DBG] osdmap e45: 8 total, 7 up, 7 in 2021-03-10T13:47:42.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:42 gibba013 bash[9767]: audit 2021-03-10T13:47:41.503621+0000 mon.a (mon.0) 463 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:47:42.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:42 gibba013 bash[9767]: audit 2021-03-10T13:47:41.504404+0000 mon.a (mon.0) 464 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:47:42.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:42 gibba013 bash[9767]: audit 2021-03-10T13:47:41.508164+0000 mon.b (mon.2) 21 : audit [INF] from='osd.7 [v2:172.21.2.120:6824/1421523901,v1:172.21.2.120:6825/1421523901]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:47:42.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:42 gibba013 bash[13024]: audit 2021-03-10T13:47:41.495505+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.352683\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.352951\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353121\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353278\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353431\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353582\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353731\", \"created\": \"2021-03-10T13:47:32.870012\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}}, \"last_daemon_update\": \"2021-03-10T13:47:33.354024\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:47:42.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:42 gibba013 bash[13024]: cephadm 2021-03-10T13:47:41.500055+0000 mgr.y (mgr.14140) 160 : cephadm [INF] Deploying daemon prometheus.a on gibba020 2021-03-10T13:47:42.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:42 gibba013 bash[13024]: audit 2021-03-10T13:47:41.503517+0000 mon.a (mon.0) 461 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-03-10T13:47:42.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:42 gibba013 bash[13024]: cluster 2021-03-10T13:47:41.503540+0000 mon.a (mon.0) 462 : cluster [DBG] osdmap e45: 8 total, 7 up, 7 in 2021-03-10T13:47:42.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:42 gibba013 bash[13024]: audit 2021-03-10T13:47:41.503621+0000 mon.a (mon.0) 463 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:47:42.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:42 gibba013 bash[13024]: audit 2021-03-10T13:47:41.504404+0000 mon.a (mon.0) 464 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:47:42.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:42 gibba013 bash[13024]: audit 2021-03-10T13:47:41.508164+0000 mon.b (mon.2) 21 : audit [INF] from='osd.7 [v2:172.21.2.120:6824/1421523901,v1:172.21.2.120:6825/1421523901]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:47:42.945 INFO:journalctl@ceph.osd.7.gibba020.stdout:Mar 10 13:47:42 gibba020 bash[16618]: debug 2021-03-10T13:47:42.518+0000 7f2901b50700 -1 osd.7 0 waiting for initial osdmap 2021-03-10T13:47:42.945 INFO:journalctl@ceph.osd.7.gibba020.stdout:Mar 10 13:47:42 gibba020 bash[16618]: debug 2021-03-10T13:47:42.522+0000 7f290cd6c700 -1 osd.7 46 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:47:43.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:43 gibba013 bash[9767]: cluster 2021-03-10T13:47:42.458740+0000 mgr.y (mgr.14140) 161 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:47:43.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:43 gibba013 bash[9767]: audit 2021-03-10T13:47:42.516032+0000 mon.a (mon.0) 465 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]': finished 2021-03-10T13:47:43.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:43 gibba013 bash[9767]: cluster 2021-03-10T13:47:42.516061+0000 mon.a (mon.0) 466 : cluster [DBG] osdmap e46: 8 total, 7 up, 7 in 2021-03-10T13:47:43.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:43 gibba013 bash[9767]: audit 2021-03-10T13:47:42.516178+0000 mon.a (mon.0) 467 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:47:43.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:43 gibba013 bash[13024]: cluster 2021-03-10T13:47:42.458740+0000 mgr.y (mgr.14140) 161 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:47:43.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:43 gibba013 bash[13024]: audit 2021-03-10T13:47:42.516032+0000 mon.a (mon.0) 465 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]': finished 2021-03-10T13:47:43.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:43 gibba013 bash[13024]: cluster 2021-03-10T13:47:42.516061+0000 mon.a (mon.0) 466 : cluster [DBG] osdmap e46: 8 total, 7 up, 7 in 2021-03-10T13:47:43.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:43 gibba013 bash[13024]: audit 2021-03-10T13:47:42.516178+0000 mon.a (mon.0) 467 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:47:44.058 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:43 gibba020 bash[9782]: cluster 2021-03-10T13:47:42.458740+0000 mgr.y (mgr.14140) 161 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:47:44.058 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:43 gibba020 bash[9782]: audit 2021-03-10T13:47:42.516032+0000 mon.a (mon.0) 465 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]': finished 2021-03-10T13:47:44.058 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:43 gibba020 bash[9782]: cluster 2021-03-10T13:47:42.516061+0000 mon.a (mon.0) 466 : cluster [DBG] osdmap e46: 8 total, 7 up, 7 in 2021-03-10T13:47:44.059 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:43 gibba020 bash[9782]: audit 2021-03-10T13:47:42.516178+0000 mon.a (mon.0) 467 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:47:44.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:44 gibba013 bash[9767]: cluster 2021-03-10T13:47:43.525917+0000 mon.a (mon.0) 468 : cluster [INF] osd.7 [v2:172.21.2.120:6824/1421523901,v1:172.21.2.120:6825/1421523901] boot 2021-03-10T13:47:44.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:44 gibba013 bash[9767]: cluster 2021-03-10T13:47:43.525955+0000 mon.a (mon.0) 469 : cluster [DBG] osdmap e47: 8 total, 8 up, 8 in 2021-03-10T13:47:44.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:44 gibba013 bash[9767]: audit 2021-03-10T13:47:43.526714+0000 mon.a (mon.0) 470 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:47:44.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:44 gibba013 bash[13024]: cluster 2021-03-10T13:47:43.525917+0000 mon.a (mon.0) 468 : cluster [INF] osd.7 [v2:172.21.2.120:6824/1421523901,v1:172.21.2.120:6825/1421523901] boot 2021-03-10T13:47:44.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:44 gibba013 bash[13024]: cluster 2021-03-10T13:47:43.525955+0000 mon.a (mon.0) 469 : cluster [DBG] osdmap e47: 8 total, 8 up, 8 in 2021-03-10T13:47:44.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:44 gibba013 bash[13024]: audit 2021-03-10T13:47:43.526714+0000 mon.a (mon.0) 470 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:47:44.945 INFO:journalctl@ceph.osd.6.gibba020.stdout:Mar 10 13:47:44 gibba020 bash[15161]: debug 2021-03-10T13:47:44.546+0000 7f6c2c183700 -1 osd.6 48 build_incremental_map_msg missing incremental map 48 2021-03-10T13:47:44.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:44 gibba020 bash[9782]: cluster 2021-03-10T13:47:43.525917+0000 mon.a (mon.0) 468 : cluster [INF] osd.7 [v2:172.21.2.120:6824/1421523901,v1:172.21.2.120:6825/1421523901] boot 2021-03-10T13:47:44.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:44 gibba020 bash[9782]: cluster 2021-03-10T13:47:43.525955+0000 mon.a (mon.0) 469 : cluster [DBG] osdmap e47: 8 total, 8 up, 8 in 2021-03-10T13:47:44.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:44 gibba020 bash[9782]: audit 2021-03-10T13:47:43.526714+0000 mon.a (mon.0) 470 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:47:45.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:45 gibba013 bash[9767]: cluster 2021-03-10T13:47:44.459717+0000 mgr.y (mgr.14140) 162 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:47:45.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:45 gibba013 bash[9767]: cluster 2021-03-10T13:47:44.544470+0000 mon.a (mon.0) 471 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2021-03-10T13:47:45.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:45 gibba013 bash[13024]: cluster 2021-03-10T13:47:44.459717+0000 mgr.y (mgr.14140) 162 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:47:45.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:45 gibba013 bash[13024]: cluster 2021-03-10T13:47:44.544470+0000 mon.a (mon.0) 471 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2021-03-10T13:47:45.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:45 gibba020 bash[9782]: cluster 2021-03-10T13:47:44.459717+0000 mgr.y (mgr.14140) 162 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T13:47:45.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:45 gibba020 bash[9782]: cluster 2021-03-10T13:47:44.544470+0000 mon.a (mon.0) 471 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2021-03-10T13:47:45.967 INFO:teuthology.orchestra.run.gibba020.stdout:Scheduled node-exporter update... 2021-03-10T13:47:46.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:46 gibba013 bash[9767]: audit 2021-03-10T13:47:45.953942+0000 mgr.y (mgr.14140) 163 : audit [DBG] from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;gibba013=a;gibba020=b", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:47:46.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:46 gibba013 bash[9767]: cephadm 2021-03-10T13:47:45.955341+0000 mgr.y (mgr.14140) 164 : cephadm [INF] Saving service node-exporter spec with placement count:2 gibba013=a,gibba020=b 2021-03-10T13:47:46.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:46 gibba013 bash[9767]: audit 2021-03-10T13:47:45.956357+0000 mon.a (mon.0) 472 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2021-03-10T13:47:45.955375\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"gibba013\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"gibba020\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]: dispatch 2021-03-10T13:47:46.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:46 gibba013 bash[9767]: audit 2021-03-10T13:47:45.964579+0000 mon.a (mon.0) 473 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2021-03-10T13:47:45.955375\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"gibba013\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"gibba020\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]': finished 2021-03-10T13:47:46.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:46 gibba013 bash[13024]: audit 2021-03-10T13:47:45.953942+0000 mgr.y (mgr.14140) 163 : audit [DBG] from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;gibba013=a;gibba020=b", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:47:46.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:46 gibba013 bash[13024]: cephadm 2021-03-10T13:47:45.955341+0000 mgr.y (mgr.14140) 164 : cephadm [INF] Saving service node-exporter spec with placement count:2 gibba013=a,gibba020=b 2021-03-10T13:47:46.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:46 gibba013 bash[13024]: audit 2021-03-10T13:47:45.956357+0000 mon.a (mon.0) 472 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2021-03-10T13:47:45.955375\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"gibba013\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"gibba020\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]: dispatch 2021-03-10T13:47:46.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:46 gibba013 bash[13024]: audit 2021-03-10T13:47:45.964579+0000 mon.a (mon.0) 473 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2021-03-10T13:47:45.955375\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"gibba013\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"gibba020\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]': finished 2021-03-10T13:47:46.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:46 gibba020 bash[9782]: audit 2021-03-10T13:47:45.953942+0000 mgr.y (mgr.14140) 163 : audit [DBG] from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;gibba013=a;gibba020=b", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:47:46.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:46 gibba020 bash[9782]: cephadm 2021-03-10T13:47:45.955341+0000 mgr.y (mgr.14140) 164 : cephadm [INF] Saving service node-exporter spec with placement count:2 gibba013=a,gibba020=b 2021-03-10T13:47:46.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:46 gibba020 bash[9782]: audit 2021-03-10T13:47:45.956357+0000 mon.a (mon.0) 472 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2021-03-10T13:47:45.955375\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"gibba013\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"gibba020\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]: dispatch 2021-03-10T13:47:46.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:46 gibba020 bash[9782]: audit 2021-03-10T13:47:45.964579+0000 mon.a (mon.0) 473 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2021-03-10T13:47:45.955375\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"gibba013\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"gibba020\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]': finished 2021-03-10T13:47:47.488 DEBUG:teuthology.orchestra.run.gibba013:node-exporter.a> sudo journalctl -f -n 0 -u ceph-7672acc8-81a6-11eb-9080-001a4aab830c@node-exporter.a.service 2021-03-10T13:47:47.525 DEBUG:teuthology.orchestra.run.gibba020:node-exporter.b> sudo journalctl -f -n 0 -u ceph-7672acc8-81a6-11eb-9080-001a4aab830c@node-exporter.b.service 2021-03-10T13:47:47.529 INFO:tasks.cephadm:Adding alertmanager.a on gibba013 2021-03-10T13:47:47.529 DEBUG:teuthology.orchestra.run.gibba020:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph orch apply alertmanager '1;gibba013=a' 2021-03-10T13:47:47.553 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:47:47.572 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:47:47.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:47 gibba013 bash[9767]: cluster 2021-03-10T13:47:46.460650+0000 mgr.y (mgr.14140) 165 : cluster [DBG] pgmap v166: 1 pgs: 1 peering; 0 B data, 3.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:47.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:47 gibba013 bash[9767]: cluster 2021-03-10T13:47:46.959770+0000 mon.a (mon.0) 474 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T13:47:47.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:47 gibba013 bash[13024]: cluster 2021-03-10T13:47:46.460650+0000 mgr.y (mgr.14140) 165 : cluster [DBG] pgmap v166: 1 pgs: 1 peering; 0 B data, 3.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:47.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:47 gibba013 bash[13024]: cluster 2021-03-10T13:47:46.959770+0000 mon.a (mon.0) 474 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T13:47:47.965 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:47 gibba020 bash[9782]: cluster 2021-03-10T13:47:46.460650+0000 mgr.y (mgr.14140) 165 : cluster [DBG] pgmap v166: 1 pgs: 1 peering; 0 B data, 3.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:47.965 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:47 gibba020 bash[9782]: cluster 2021-03-10T13:47:46.959770+0000 mon.a (mon.0) 474 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T13:47:49.856 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:49 gibba020 bash[9782]: cluster 2021-03-10T13:47:48.461603+0000 mgr.y (mgr.14140) 166 : cluster [DBG] pgmap v167: 1 pgs: 1 peering; 0 B data, 3.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:49.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:49 gibba013 bash[9767]: cluster 2021-03-10T13:47:48.461603+0000 mgr.y (mgr.14140) 166 : cluster [DBG] pgmap v167: 1 pgs: 1 peering; 0 B data, 3.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:49.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:49 gibba013 bash[13024]: cluster 2021-03-10T13:47:48.461603+0000 mgr.y (mgr.14140) 166 : cluster [DBG] pgmap v167: 1 pgs: 1 peering; 0 B data, 3.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:51.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:51 gibba013 bash[9767]: cluster 2021-03-10T13:47:50.462006+0000 mgr.y (mgr.14140) 167 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:51.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:51 gibba013 bash[13024]: cluster 2021-03-10T13:47:50.462006+0000 mgr.y (mgr.14140) 167 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:51.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:51 gibba020 bash[9782]: cluster 2021-03-10T13:47:50.462006+0000 mgr.y (mgr.14140) 167 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:52.270 INFO:teuthology.orchestra.run.gibba020.stdout:Scheduled alertmanager update... 2021-03-10T13:47:52.626 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:52 gibba020 bash[9782]: cluster 2021-03-10T13:47:51.454294+0000 mon.a (mon.0) 475 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T13:47:52.626 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:52 gibba020 bash[9782]: cluster 2021-03-10T13:47:51.454390+0000 mon.a (mon.0) 476 : cluster [INF] Cluster is now healthy 2021-03-10T13:47:52.626 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:52 gibba020 bash[9782]: audit 2021-03-10T13:47:51.486426+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"4df2e810-953e-45e5-852d-84682d065dae\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383993.454606, \"finished_at\": 1615384006.7700126}, {\"id\": \"c79d246c-7a77-4683-bf60-27d80d5cf59c\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615384015.5000648, \"finished_at\": 1615384029.3994632}, {\"id\": \"b50cbdf8-4b22-4996-904b-b94155273994\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615384038.6853857, \"finished_at\": 1615384052.8935423}, {\"id\": \"034faffd-906c-4cc0-ab1b-a410be1f6bd7\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1615384063.5258696, \"finished_at\": 1615384071.4648335}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T13:47:52.626 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:52 gibba020 bash[9782]: audit 2021-03-10T13:47:51.490335+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"4df2e810-953e-45e5-852d-84682d065dae\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383993.454606, \"finished_at\": 1615384006.7700126}, {\"id\": \"c79d246c-7a77-4683-bf60-27d80d5cf59c\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615384015.5000648, \"finished_at\": 1615384029.3994632}, {\"id\": \"b50cbdf8-4b22-4996-904b-b94155273994\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615384038.6853857, \"finished_at\": 1615384052.8935423}, {\"id\": \"034faffd-906c-4cc0-ab1b-a410be1f6bd7\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1615384063.5258696, \"finished_at\": 1615384071.4648335}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T13:47:52.627 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:52 gibba020 bash[9782]: audit 2021-03-10T13:47:52.258328+0000 mon.a (mon.0) 479 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2021-03-10T13:47:52.257342\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba013\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]: dispatch 2021-03-10T13:47:52.627 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:52 gibba020 bash[9782]: audit 2021-03-10T13:47:52.266831+0000 mon.a (mon.0) 480 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2021-03-10T13:47:52.257342\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba013\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]': finished 2021-03-10T13:47:52.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:52 gibba013 bash[9767]: cluster 2021-03-10T13:47:51.454294+0000 mon.a (mon.0) 475 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T13:47:52.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:52 gibba013 bash[9767]: cluster 2021-03-10T13:47:51.454390+0000 mon.a (mon.0) 476 : cluster [INF] Cluster is now healthy 2021-03-10T13:47:52.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:52 gibba013 bash[9767]: audit 2021-03-10T13:47:51.486426+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"4df2e810-953e-45e5-852d-84682d065dae\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383993.454606, \"finished_at\": 1615384006.7700126}, {\"id\": \"c79d246c-7a77-4683-bf60-27d80d5cf59c\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615384015.5000648, \"finished_at\": 1615384029.3994632}, {\"id\": \"b50cbdf8-4b22-4996-904b-b94155273994\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615384038.6853857, \"finished_at\": 1615384052.8935423}, {\"id\": \"034faffd-906c-4cc0-ab1b-a410be1f6bd7\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1615384063.5258696, \"finished_at\": 1615384071.4648335}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T13:47:52.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:52 gibba013 bash[9767]: audit 2021-03-10T13:47:51.490335+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"4df2e810-953e-45e5-852d-84682d065dae\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383993.454606, \"finished_at\": 1615384006.7700126}, {\"id\": \"c79d246c-7a77-4683-bf60-27d80d5cf59c\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615384015.5000648, \"finished_at\": 1615384029.3994632}, {\"id\": \"b50cbdf8-4b22-4996-904b-b94155273994\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615384038.6853857, \"finished_at\": 1615384052.8935423}, {\"id\": \"034faffd-906c-4cc0-ab1b-a410be1f6bd7\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1615384063.5258696, \"finished_at\": 1615384071.4648335}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T13:47:52.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:52 gibba013 bash[9767]: audit 2021-03-10T13:47:52.258328+0000 mon.a (mon.0) 479 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2021-03-10T13:47:52.257342\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba013\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]: dispatch 2021-03-10T13:47:52.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:52 gibba013 bash[9767]: audit 2021-03-10T13:47:52.266831+0000 mon.a (mon.0) 480 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2021-03-10T13:47:52.257342\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba013\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]': finished 2021-03-10T13:47:52.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:52 gibba013 bash[13024]: cluster 2021-03-10T13:47:51.454294+0000 mon.a (mon.0) 475 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T13:47:52.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:52 gibba013 bash[13024]: cluster 2021-03-10T13:47:51.454390+0000 mon.a (mon.0) 476 : cluster [INF] Cluster is now healthy 2021-03-10T13:47:52.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:52 gibba013 bash[13024]: audit 2021-03-10T13:47:51.486426+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"4df2e810-953e-45e5-852d-84682d065dae\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383993.454606, \"finished_at\": 1615384006.7700126}, {\"id\": \"c79d246c-7a77-4683-bf60-27d80d5cf59c\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615384015.5000648, \"finished_at\": 1615384029.3994632}, {\"id\": \"b50cbdf8-4b22-4996-904b-b94155273994\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615384038.6853857, \"finished_at\": 1615384052.8935423}, {\"id\": \"034faffd-906c-4cc0-ab1b-a410be1f6bd7\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1615384063.5258696, \"finished_at\": 1615384071.4648335}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T13:47:52.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:52 gibba013 bash[13024]: audit 2021-03-10T13:47:51.490335+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"4df2e810-953e-45e5-852d-84682d065dae\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615383993.454606, \"finished_at\": 1615384006.7700126}, {\"id\": \"c79d246c-7a77-4683-bf60-27d80d5cf59c\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615384015.5000648, \"finished_at\": 1615384029.3994632}, {\"id\": \"b50cbdf8-4b22-4996-904b-b94155273994\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615384038.6853857, \"finished_at\": 1615384052.8935423}, {\"id\": \"034faffd-906c-4cc0-ab1b-a410be1f6bd7\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1615384063.5258696, \"finished_at\": 1615384071.4648335}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T13:47:52.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:52 gibba013 bash[13024]: audit 2021-03-10T13:47:52.258328+0000 mon.a (mon.0) 479 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2021-03-10T13:47:52.257342\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba013\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]: dispatch 2021-03-10T13:47:52.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:52 gibba013 bash[13024]: audit 2021-03-10T13:47:52.266831+0000 mon.a (mon.0) 480 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2021-03-10T13:47:52.257342\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba013\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]': finished 2021-03-10T13:47:53.295 DEBUG:teuthology.orchestra.run.gibba013:alertmanager.a> sudo journalctl -f -n 0 -u ceph-7672acc8-81a6-11eb-9080-001a4aab830c@alertmanager.a.service 2021-03-10T13:47:53.302 INFO:tasks.cephadm:Adding grafana.a on gibba020 2021-03-10T13:47:53.302 DEBUG:teuthology.orchestra.run.gibba020:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph orch apply grafana '1;gibba020=a' 2021-03-10T13:47:53.319 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:47:53.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:53 gibba013 bash[9767]: audit 2021-03-10T13:47:52.256014+0000 mgr.y (mgr.14140) 168 : audit [DBG] from='client.34250 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;gibba013=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:47:53.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:53 gibba013 bash[9767]: cephadm 2021-03-10T13:47:52.257308+0000 mgr.y (mgr.14140) 169 : cephadm [INF] Saving service alertmanager spec with placement count:1 gibba013=a 2021-03-10T13:47:53.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:53 gibba013 bash[9767]: cluster 2021-03-10T13:47:52.462608+0000 mgr.y (mgr.14140) 170 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:53.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:53 gibba013 bash[13024]: audit 2021-03-10T13:47:52.256014+0000 mgr.y (mgr.14140) 168 : audit [DBG] from='client.34250 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;gibba013=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:47:53.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:53 gibba013 bash[13024]: cephadm 2021-03-10T13:47:52.257308+0000 mgr.y (mgr.14140) 169 : cephadm [INF] Saving service alertmanager spec with placement count:1 gibba013=a 2021-03-10T13:47:53.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:53 gibba013 bash[13024]: cluster 2021-03-10T13:47:52.462608+0000 mgr.y (mgr.14140) 170 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:53.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:53 gibba020 bash[9782]: audit 2021-03-10T13:47:52.256014+0000 mgr.y (mgr.14140) 168 : audit [DBG] from='client.34250 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;gibba013=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:47:53.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:53 gibba020 bash[9782]: cephadm 2021-03-10T13:47:52.257308+0000 mgr.y (mgr.14140) 169 : cephadm [INF] Saving service alertmanager spec with placement count:1 gibba013=a 2021-03-10T13:47:53.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:53 gibba020 bash[9782]: cluster 2021-03-10T13:47:52.462608+0000 mgr.y (mgr.14140) 170 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:55.445 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:47:55 gibba020 docker[17818]: Error: No such container: ceph-7672acc8-81a6-11eb-9080-001a4aab830c-prometheus.a 2021-03-10T13:47:55.445 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:47:55 gibba020 systemd[1]: Started Ceph prometheus.a for 7672acc8-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:47:55.576 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:55 gibba020 bash[9782]: cluster 2021-03-10T13:47:54.463438+0000 mgr.y (mgr.14140) 171 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:55.577 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:55 gibba020 bash[9782]: audit 2021-03-10T13:47:55.239312+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.352683\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.352951\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353121\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353278\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353431\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353582\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353731\", \"created\": \"2021-03-10T13:47:32.870012\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:47:41.497315\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:47:55.577 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:55 gibba020 bash[9782]: audit 2021-03-10T13:47:55.248199+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.352683\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.352951\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353121\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353278\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353431\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353582\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353731\", \"created\": \"2021-03-10T13:47:32.870012\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:47:41.497315\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:47:55.578 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:55 gibba020 bash[9782]: audit 2021-03-10T13:47:55.249001+0000 mon.a (mon.0) 483 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:47:55.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:55 gibba013 bash[9767]: cluster 2021-03-10T13:47:54.463438+0000 mgr.y (mgr.14140) 171 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:55.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:55 gibba013 bash[13024]: cluster 2021-03-10T13:47:54.463438+0000 mgr.y (mgr.14140) 171 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:55.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:55 gibba013 bash[9767]: audit 2021-03-10T13:47:55.239312+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.352683\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.352951\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353121\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353278\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353431\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353582\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353731\", \"created\": \"2021-03-10T13:47:32.870012\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:47:41.497315\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:47:55.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:55 gibba013 bash[9767]: audit 2021-03-10T13:47:55.248199+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.352683\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.352951\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353121\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353278\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353431\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353582\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353731\", \"created\": \"2021-03-10T13:47:32.870012\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:47:41.497315\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:47:55.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:55 gibba013 bash[9767]: audit 2021-03-10T13:47:55.249001+0000 mon.a (mon.0) 483 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:47:55.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:55 gibba013 bash[13024]: audit 2021-03-10T13:47:55.239312+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.352683\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.352951\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353121\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353278\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353431\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353582\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353731\", \"created\": \"2021-03-10T13:47:32.870012\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:47:41.497315\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:47:55.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:55 gibba013 bash[13024]: audit 2021-03-10T13:47:55.248199+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.352683\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.352951\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353121\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353278\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353431\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353582\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:33.353731\", \"created\": \"2021-03-10T13:47:32.870012\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:47:41.497315\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:47:55.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:55 gibba013 bash[13024]: audit 2021-03-10T13:47:55.249001+0000 mon.a (mon.0) 483 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:47:56.445 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:56 gibba020 systemd[1]: Started Ceph node-exporter.b for 7672acc8-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:47:56.445 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:56 gibba020 bash[18137]: Unable to find image 'prom/node-exporter:latest' locally 2021-03-10T13:47:56.665 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:56 gibba020 bash[9782]: audit 2021-03-10T13:47:55.922070+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.917690\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.917957\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918163\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918319\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918469\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918615\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918761\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918907\", \"created\": \"2021-03-10T13:47:55.226012\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:47:41.497315\"}}, \"last_daemon_update\": \"2021-03-10T13:47:55.919192\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:47:56.666 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:56 gibba020 bash[9782]: audit 2021-03-10T13:47:55.930612+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.917690\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.917957\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918163\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918319\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918469\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918615\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918761\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918907\", \"created\": \"2021-03-10T13:47:55.226012\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:47:41.497315\"}}, \"last_daemon_update\": \"2021-03-10T13:47:55.919192\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:47:56.666 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:56 gibba020 bash[9782]: audit 2021-03-10T13:47:55.932038+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2021-03-10T13:47:56.666 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:56 gibba020 bash[9782]: audit 2021-03-10T13:47:55.932991+0000 mon.a (mon.0) 487 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:47:56.667 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:56 gibba020 bash[9782]: cephadm 2021-03-10T13:47:55.933840+0000 mgr.y (mgr.14140) 172 : cephadm [INF] Deploying daemon node-exporter.b on gibba020 2021-03-10T13:47:56.667 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:56 gibba020 bash[9782]: audit 2021-03-10T13:47:56.335306+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.917690\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.917957\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918163\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918319\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918469\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918615\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918761\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918907\", \"created\": \"2021-03-10T13:47:55.226012\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:47:41.497315\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:47:56.668 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:56 gibba020 bash[9782]: audit 2021-03-10T13:47:56.344090+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.917690\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.917957\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918163\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918319\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918469\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918615\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918761\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918907\", \"created\": \"2021-03-10T13:47:55.226012\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:47:41.497315\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:47:56.668 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:56 gibba020 bash[9782]: audit 2021-03-10T13:47:56.344966+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2021-03-10T13:47:56.668 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:56 gibba020 bash[9782]: audit 2021-03-10T13:47:56.346050+0000 mon.a (mon.0) 491 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:47:56.705 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:56 gibba013 bash[13024]: audit 2021-03-10T13:47:55.922070+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.917690\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.917957\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918163\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918319\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918469\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918615\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918761\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918907\", \"created\": \"2021-03-10T13:47:55.226012\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:47:41.497315\"}}, \"last_daemon_update\": \"2021-03-10T13:47:55.919192\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:47:56.706 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:56 gibba013 bash[9767]: audit 2021-03-10T13:47:55.922070+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.917690\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.917957\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918163\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918319\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918469\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918615\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918761\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918907\", \"created\": \"2021-03-10T13:47:55.226012\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:47:41.497315\"}}, \"last_daemon_update\": \"2021-03-10T13:47:55.919192\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:47:56.706 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:56 gibba013 bash[13024]: audit 2021-03-10T13:47:55.930612+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.917690\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.917957\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918163\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918319\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918469\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918615\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918761\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918907\", \"created\": \"2021-03-10T13:47:55.226012\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:47:41.497315\"}}, \"last_daemon_update\": \"2021-03-10T13:47:55.919192\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:47:56.707 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:56 gibba013 bash[13024]: audit 2021-03-10T13:47:55.932038+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2021-03-10T13:47:56.707 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:56 gibba013 bash[13024]: audit 2021-03-10T13:47:55.932991+0000 mon.a (mon.0) 487 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:47:56.707 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:56 gibba013 bash[13024]: cephadm 2021-03-10T13:47:55.933840+0000 mgr.y (mgr.14140) 172 : cephadm [INF] Deploying daemon node-exporter.b on gibba020 2021-03-10T13:47:56.708 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:56 gibba013 bash[13024]: audit 2021-03-10T13:47:56.335306+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.917690\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.917957\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918163\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918319\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918469\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918615\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918761\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918907\", \"created\": \"2021-03-10T13:47:55.226012\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:47:41.497315\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:47:56.708 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:56 gibba013 bash[13024]: audit 2021-03-10T13:47:56.344090+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.917690\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.917957\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918163\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918319\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918469\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918615\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918761\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918907\", \"created\": \"2021-03-10T13:47:55.226012\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:47:41.497315\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:47:56.708 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:56 gibba013 bash[13024]: audit 2021-03-10T13:47:56.344966+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2021-03-10T13:47:56.709 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:56 gibba013 bash[13024]: audit 2021-03-10T13:47:56.346050+0000 mon.a (mon.0) 491 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:47:56.709 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:56 gibba013 bash[9767]: audit 2021-03-10T13:47:55.930612+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.917690\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.917957\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918163\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918319\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918469\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918615\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918761\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918907\", \"created\": \"2021-03-10T13:47:55.226012\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:47:41.497315\"}}, \"last_daemon_update\": \"2021-03-10T13:47:55.919192\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:47:56.709 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:56 gibba013 bash[9767]: audit 2021-03-10T13:47:55.932038+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2021-03-10T13:47:56.710 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:56 gibba013 bash[9767]: audit 2021-03-10T13:47:55.932991+0000 mon.a (mon.0) 487 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:47:56.710 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:56 gibba013 bash[9767]: cephadm 2021-03-10T13:47:55.933840+0000 mgr.y (mgr.14140) 172 : cephadm [INF] Deploying daemon node-exporter.b on gibba020 2021-03-10T13:47:56.711 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:56 gibba013 bash[9767]: audit 2021-03-10T13:47:56.335306+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.917690\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.917957\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918163\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918319\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918469\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918615\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918761\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918907\", \"created\": \"2021-03-10T13:47:55.226012\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:47:41.497315\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:47:56.711 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:56 gibba013 bash[9767]: audit 2021-03-10T13:47:56.344090+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.917690\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.917957\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918163\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918319\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918469\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918615\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918761\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:47:55.918907\", \"created\": \"2021-03-10T13:47:55.226012\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:47:41.497315\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:47:56.712 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:56 gibba013 bash[9767]: audit 2021-03-10T13:47:56.344966+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2021-03-10T13:47:56.712 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:56 gibba013 bash[9767]: audit 2021-03-10T13:47:56.346050+0000 mon.a (mon.0) 491 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:47:56.945 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:56 gibba020 bash[18137]: latest: Pulling from prom/node-exporter 2021-03-10T13:47:56.946 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:56 gibba020 bash[18137]: dc6dd4561653: Pulling fs layer 2021-03-10T13:47:56.946 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:56 gibba020 bash[18137]: 613f88646930: Pulling fs layer 2021-03-10T13:47:56.946 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:56 gibba020 bash[18137]: edad907fb257: Pulling fs layer 2021-03-10T13:47:56.947 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:56 gibba020 bash[18137]: 613f88646930: Download complete 2021-03-10T13:47:56.947 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:56 gibba020 bash[18137]: dc6dd4561653: Verifying Checksum 2021-03-10T13:47:56.948 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:56 gibba020 bash[18137]: dc6dd4561653: Download complete 2021-03-10T13:47:56.948 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:56 gibba020 bash[18137]: edad907fb257: Verifying Checksum 2021-03-10T13:47:56.948 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:56 gibba020 bash[18137]: edad907fb257: Download complete 2021-03-10T13:47:57.030 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:47:56 gibba013 systemd[1]: Started Ceph node-exporter.a for 7672acc8-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:47:57.030 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:47:56 gibba013 bash[19708]: Unable to find image 'prom/node-exporter:latest' locally 2021-03-10T13:47:57.030 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:47:57 gibba013 bash[19708]: latest: Pulling from prom/node-exporter 2021-03-10T13:47:57.381 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:47:57 gibba013 bash[19708]: dc6dd4561653: Pulling fs layer 2021-03-10T13:47:57.382 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:47:57 gibba013 bash[19708]: 613f88646930: Pulling fs layer 2021-03-10T13:47:57.382 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:47:57 gibba013 bash[19708]: edad907fb257: Pulling fs layer 2021-03-10T13:47:57.382 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:47:57 gibba013 bash[19708]: 613f88646930: Verifying Checksum 2021-03-10T13:47:57.382 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:47:57 gibba013 bash[19708]: 613f88646930: Download complete 2021-03-10T13:47:57.383 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:47:57 gibba013 bash[19708]: dc6dd4561653: Verifying Checksum 2021-03-10T13:47:57.383 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:47:57 gibba013 bash[19708]: dc6dd4561653: Download complete 2021-03-10T13:47:57.383 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:47:57 gibba013 bash[19708]: edad907fb257: Verifying Checksum 2021-03-10T13:47:57.383 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:47:57 gibba013 bash[19708]: edad907fb257: Download complete 2021-03-10T13:47:57.695 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:57 gibba020 bash[18137]: dc6dd4561653: Pull complete 2021-03-10T13:47:57.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:57 gibba020 bash[9782]: cephadm 2021-03-10T13:47:56.346694+0000 mgr.y (mgr.14140) 173 : cephadm [INF] Deploying daemon node-exporter.a on gibba013 2021-03-10T13:47:57.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:57 gibba020 bash[9782]: cluster 2021-03-10T13:47:56.463819+0000 mgr.y (mgr.14140) 174 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:57.696 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:47:57 gibba020 bash[17837]: level=info ts=2021-03-10T13:47:57.529Z caller=main.go:366 msg="No time or size retention was set so using the default time retention" duration=15d 2021-03-10T13:47:57.696 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:47:57 gibba020 bash[17837]: level=info ts=2021-03-10T13:47:57.529Z caller=main.go:404 msg="Starting Prometheus" version="(version=2.25.0, branch=HEAD, revision=a6be548dbc17780d562a39c0e4bd0bd4c00ad6e2)" 2021-03-10T13:47:57.697 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:47:57 gibba020 bash[17837]: level=info ts=2021-03-10T13:47:57.529Z caller=main.go:409 build_context="(go=go1.15.8, user=root@615f028225c9, date=20210217-14:17:24)" 2021-03-10T13:47:57.697 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:47:57 gibba020 bash[17837]: level=info ts=2021-03-10T13:47:57.529Z caller=main.go:410 host_details="(Linux 5.4.0-66-generic #74-Ubuntu SMP Wed Jan 27 22:54:38 UTC 2021 x86_64 gibba020 (none))" 2021-03-10T13:47:57.697 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:47:57 gibba020 bash[17837]: level=info ts=2021-03-10T13:47:57.529Z caller=main.go:411 fd_limits="(soft=1048576, hard=1048576)" 2021-03-10T13:47:57.697 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:47:57 gibba020 bash[17837]: level=info ts=2021-03-10T13:47:57.529Z caller=main.go:412 vm_limits="(soft=unlimited, hard=unlimited)" 2021-03-10T13:47:57.698 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:47:57 gibba020 bash[17837]: level=info ts=2021-03-10T13:47:57.530Z caller=web.go:532 component=web msg="Start listening for connections" address=:9095 2021-03-10T13:47:57.698 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:47:57 gibba020 bash[17837]: level=info ts=2021-03-10T13:47:57.530Z caller=main.go:779 msg="Starting TSDB ..." 2021-03-10T13:47:57.698 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:47:57 gibba020 bash[17837]: level=info ts=2021-03-10T13:47:57.531Z caller=tls_config.go:191 component=web msg="TLS is disabled." http2=false 2021-03-10T13:47:57.698 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:47:57 gibba020 bash[17837]: level=info ts=2021-03-10T13:47:57.532Z caller=head.go:668 component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2021-03-10T13:47:57.698 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:47:57 gibba020 bash[17837]: level=info ts=2021-03-10T13:47:57.532Z caller=head.go:682 component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.877µs 2021-03-10T13:47:57.699 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:47:57 gibba020 bash[17837]: level=info ts=2021-03-10T13:47:57.532Z caller=head.go:688 component=tsdb msg="Replaying WAL, this may take a while" 2021-03-10T13:47:57.699 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:47:57 gibba020 bash[17837]: level=info ts=2021-03-10T13:47:57.532Z caller=head.go:740 component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 2021-03-10T13:47:57.699 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:47:57 gibba020 bash[17837]: level=info ts=2021-03-10T13:47:57.533Z caller=head.go:745 component=tsdb msg="WAL replay completed" checkpoint_replay_duration=14.894µs wal_replay_duration=158.063µs total_replay_duration=183.985µs 2021-03-10T13:47:57.699 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:47:57 gibba020 bash[17837]: level=info ts=2021-03-10T13:47:57.533Z caller=main.go:799 fs_type=XFS_SUPER_MAGIC 2021-03-10T13:47:57.699 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:47:57 gibba020 bash[17837]: level=info ts=2021-03-10T13:47:57.533Z caller=main.go:802 msg="TSDB started" 2021-03-10T13:47:57.700 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:47:57 gibba020 bash[17837]: level=info ts=2021-03-10T13:47:57.533Z caller=main.go:928 msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2021-03-10T13:47:57.700 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:47:57 gibba020 bash[17837]: level=info ts=2021-03-10T13:47:57.534Z caller=main.go:959 msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=393.668µs remote_storage=1.099µs web_handler=170ns query_engine=587ns scrape=226.219µs scrape_sd=14.169µs notify=481ns notify_sd=993ns rules=17.419µs 2021-03-10T13:47:57.700 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:47:57 gibba020 bash[17837]: level=info ts=2021-03-10T13:47:57.534Z caller=main.go:751 msg="Server is ready to receive web requests." 2021-03-10T13:47:57.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:57 gibba020 bash[9782]: audit 2021-03-10T13:47:56.732365+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406440\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406500\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406529\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406556\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406581\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406607\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406633\", \"created\": \"2021-03-10T13:46:03.738924\"}, \"node-exporter.a\": {\"hostname\": \"gibba013\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:47:57.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:57 gibba020 bash[9782]: audit 2021-03-10T13:47:56.735681+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406440\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406500\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406529\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406556\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406581\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406607\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406633\", \"created\": \"2021-03-10T13:46:03.738924\"}, \"node-exporter.a\": {\"hostname\": \"gibba013\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:47:57.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:57 gibba020 bash[9782]: cephadm 2021-03-10T13:47:56.738029+0000 mgr.y (mgr.14140) 175 : cephadm [INF] Deploying daemon alertmanager.a on gibba013 2021-03-10T13:47:57.881 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:47:57 gibba013 bash[19708]: dc6dd4561653: Pull complete 2021-03-10T13:47:57.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:57 gibba013 bash[9767]: cephadm 2021-03-10T13:47:56.346694+0000 mgr.y (mgr.14140) 173 : cephadm [INF] Deploying daemon node-exporter.a on gibba013 2021-03-10T13:47:57.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:57 gibba013 bash[9767]: cluster 2021-03-10T13:47:56.463819+0000 mgr.y (mgr.14140) 174 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:57.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:57 gibba013 bash[13024]: cephadm 2021-03-10T13:47:56.346694+0000 mgr.y (mgr.14140) 173 : cephadm [INF] Deploying daemon node-exporter.a on gibba013 2021-03-10T13:47:57.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:57 gibba013 bash[13024]: cluster 2021-03-10T13:47:56.463819+0000 mgr.y (mgr.14140) 174 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:57.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:57 gibba013 bash[9767]: audit 2021-03-10T13:47:56.732365+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406440\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406500\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406529\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406556\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406581\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406607\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406633\", \"created\": \"2021-03-10T13:46:03.738924\"}, \"node-exporter.a\": {\"hostname\": \"gibba013\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:47:57.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:57 gibba013 bash[13024]: audit 2021-03-10T13:47:56.732365+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406440\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406500\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406529\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406556\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406581\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406607\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406633\", \"created\": \"2021-03-10T13:46:03.738924\"}, \"node-exporter.a\": {\"hostname\": \"gibba013\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:47:57.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:57 gibba013 bash[13024]: audit 2021-03-10T13:47:56.735681+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406440\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406500\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406529\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406556\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406581\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406607\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406633\", \"created\": \"2021-03-10T13:46:03.738924\"}, \"node-exporter.a\": {\"hostname\": \"gibba013\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:47:57.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:57 gibba013 bash[13024]: cephadm 2021-03-10T13:47:56.738029+0000 mgr.y (mgr.14140) 175 : cephadm [INF] Deploying daemon alertmanager.a on gibba013 2021-03-10T13:47:57.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:57 gibba013 bash[9767]: audit 2021-03-10T13:47:56.735681+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406440\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406500\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406529\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406556\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406581\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406607\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406633\", \"created\": \"2021-03-10T13:46:03.738924\"}, \"node-exporter.a\": {\"hostname\": \"gibba013\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:47:57.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:57 gibba013 bash[9767]: cephadm 2021-03-10T13:47:56.738029+0000 mgr.y (mgr.14140) 175 : cephadm [INF] Deploying daemon alertmanager.a on gibba013 2021-03-10T13:47:58.060 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:57 gibba020 bash[18137]: 613f88646930: Pull complete 2021-03-10T13:47:58.334 INFO:teuthology.orchestra.run.gibba020.stdout:Scheduled grafana update... 2021-03-10T13:47:58.359 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:47:57 gibba013 bash[19708]: 613f88646930: Pull complete 2021-03-10T13:47:58.385 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:58 gibba020 bash[18137]: edad907fb257: Pull complete 2021-03-10T13:47:58.385 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:58 gibba020 bash[18137]: Digest: sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810 2021-03-10T13:47:58.385 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:58 gibba020 bash[18137]: Status: Downloaded newer image for prom/node-exporter:latest 2021-03-10T13:47:58.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:58 gibba013 bash[9767]: audit 2021-03-10T13:47:58.320308+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2021-03-10T13:47:58.319371\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba020\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]: dispatch 2021-03-10T13:47:58.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:58 gibba013 bash[9767]: audit 2021-03-10T13:47:58.328995+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2021-03-10T13:47:58.319371\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba020\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]': finished 2021-03-10T13:47:58.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:58 gibba013 bash[13024]: audit 2021-03-10T13:47:58.320308+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2021-03-10T13:47:58.319371\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba020\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]: dispatch 2021-03-10T13:47:58.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:58 gibba013 bash[13024]: audit 2021-03-10T13:47:58.328995+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2021-03-10T13:47:58.319371\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba020\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]': finished 2021-03-10T13:47:58.632 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:47:58 gibba013 bash[19708]: edad907fb257: Pull complete 2021-03-10T13:47:58.633 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:47:58 gibba013 bash[19708]: Digest: sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810 2021-03-10T13:47:58.633 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:47:58 gibba013 bash[19708]: Status: Downloaded newer image for prom/node-exporter:latest 2021-03-10T13:47:58.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:58 gibba020 bash[9782]: audit 2021-03-10T13:47:58.320308+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2021-03-10T13:47:58.319371\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba020\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]: dispatch 2021-03-10T13:47:58.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:58 gibba020 bash[9782]: audit 2021-03-10T13:47:58.328995+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2021-03-10T13:47:58.319371\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba020\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]': finished 2021-03-10T13:47:59.531 DEBUG:teuthology.orchestra.run.gibba020:grafana.a> sudo journalctl -f -n 0 -u ceph-7672acc8-81a6-11eb-9080-001a4aab830c@grafana.a.service 2021-03-10T13:47:59.534 INFO:tasks.cephadm:Setting up client nodes... 2021-03-10T13:47:59.534 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2021-03-10T13:47:59.547 INFO:journalctl@ceph.grafana.a.gibba020.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T13:47:59.759 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[9782]: audit 2021-03-10T13:47:58.318036+0000 mgr.y (mgr.14140) 176 : audit [DBG] from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;gibba020=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:47:59.759 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[9782]: cephadm 2021-03-10T13:47:58.319337+0000 mgr.y (mgr.14140) 177 : cephadm [INF] Saving service grafana spec with placement count:1 gibba020=a 2021-03-10T13:47:59.759 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[9782]: cluster 2021-03-10T13:47:58.464494+0000 mgr.y (mgr.14140) 178 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:59.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:59 gibba013 bash[9767]: audit 2021-03-10T13:47:58.318036+0000 mgr.y (mgr.14140) 176 : audit [DBG] from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;gibba020=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:47:59.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:59 gibba013 bash[9767]: cephadm 2021-03-10T13:47:58.319337+0000 mgr.y (mgr.14140) 177 : cephadm [INF] Saving service grafana spec with placement count:1 gibba020=a 2021-03-10T13:47:59.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:47:59 gibba013 bash[9767]: cluster 2021-03-10T13:47:58.464494+0000 mgr.y (mgr.14140) 178 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:47:59.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:59 gibba013 bash[13024]: audit 2021-03-10T13:47:58.318036+0000 mgr.y (mgr.14140) 176 : audit [DBG] from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;gibba020=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:47:59.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:59 gibba013 bash[13024]: cephadm 2021-03-10T13:47:58.319337+0000 mgr.y (mgr.14140) 177 : cephadm [INF] Saving service grafana spec with placement count:1 gibba020=a 2021-03-10T13:47:59.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:47:59 gibba013 bash[13024]: cluster 2021-03-10T13:47:58.464494+0000 mgr.y (mgr.14140) 178 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:00.195 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.870Z caller=node_exporter.go:178 msg="Starting node_exporter" version="(version=1.1.2, branch=HEAD, revision=b597c1244d7bef49e6f3359c87a56dd7707f6719)" 2021-03-10T13:48:00.196 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.870Z caller=node_exporter.go:179 msg="Build context" build_context="(go=go1.15.8, user=root@f07de8ca602a, date=20210305-09:29:10)" 2021-03-10T13:48:00.196 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.871Z caller=filesystem_common.go:74 collector=filesystem msg="Parsed flag --collector.filesystem.ignored-mount-points" flag=^/(dev|proc|sys|var/lib/docker/.+)($|/) 2021-03-10T13:48:00.196 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.871Z caller=filesystem_common.go:76 collector=filesystem msg="Parsed flag --collector.filesystem.ignored-fs-types" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2021-03-10T13:48:00.196 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.871Z caller=node_exporter.go:106 msg="Enabled collectors" 2021-03-10T13:48:00.197 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.871Z caller=node_exporter.go:113 collector=arp 2021-03-10T13:48:00.197 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.871Z caller=node_exporter.go:113 collector=bcache 2021-03-10T13:48:00.197 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.871Z caller=node_exporter.go:113 collector=bonding 2021-03-10T13:48:00.197 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.871Z caller=node_exporter.go:113 collector=btrfs 2021-03-10T13:48:00.198 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.871Z caller=node_exporter.go:113 collector=conntrack 2021-03-10T13:48:00.198 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.871Z caller=node_exporter.go:113 collector=cpu 2021-03-10T13:48:00.198 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.871Z caller=node_exporter.go:113 collector=cpufreq 2021-03-10T13:48:00.198 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.871Z caller=node_exporter.go:113 collector=diskstats 2021-03-10T13:48:00.199 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.871Z caller=node_exporter.go:113 collector=edac 2021-03-10T13:48:00.199 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.871Z caller=node_exporter.go:113 collector=entropy 2021-03-10T13:48:00.199 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.871Z caller=node_exporter.go:113 collector=fibrechannel 2021-03-10T13:48:00.199 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.871Z caller=node_exporter.go:113 collector=filefd 2021-03-10T13:48:00.199 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.871Z caller=node_exporter.go:113 collector=filesystem 2021-03-10T13:48:00.200 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.871Z caller=node_exporter.go:113 collector=hwmon 2021-03-10T13:48:00.200 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.871Z caller=node_exporter.go:113 collector=infiniband 2021-03-10T13:48:00.200 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.871Z caller=node_exporter.go:113 collector=ipvs 2021-03-10T13:48:00.200 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.871Z caller=node_exporter.go:113 collector=loadavg 2021-03-10T13:48:00.200 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.871Z caller=node_exporter.go:113 collector=mdadm 2021-03-10T13:48:00.200 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.871Z caller=node_exporter.go:113 collector=meminfo 2021-03-10T13:48:00.201 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.871Z caller=node_exporter.go:113 collector=netclass 2021-03-10T13:48:00.201 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.871Z caller=node_exporter.go:113 collector=netdev 2021-03-10T13:48:00.201 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.871Z caller=node_exporter.go:113 collector=netstat 2021-03-10T13:48:00.201 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.871Z caller=node_exporter.go:113 collector=nfs 2021-03-10T13:48:00.201 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.871Z caller=node_exporter.go:113 collector=nfsd 2021-03-10T13:48:00.202 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.871Z caller=node_exporter.go:113 collector=powersupplyclass 2021-03-10T13:48:00.202 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.871Z caller=node_exporter.go:113 collector=pressure 2021-03-10T13:48:00.202 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.871Z caller=node_exporter.go:113 collector=rapl 2021-03-10T13:48:00.202 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.871Z caller=node_exporter.go:113 collector=schedstat 2021-03-10T13:48:00.203 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.871Z caller=node_exporter.go:113 collector=sockstat 2021-03-10T13:48:00.203 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.871Z caller=node_exporter.go:113 collector=softnet 2021-03-10T13:48:00.203 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.871Z caller=node_exporter.go:113 collector=stat 2021-03-10T13:48:00.203 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.871Z caller=node_exporter.go:113 collector=textfile 2021-03-10T13:48:00.203 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.871Z caller=node_exporter.go:113 collector=thermal_zone 2021-03-10T13:48:00.204 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.872Z caller=node_exporter.go:113 collector=time 2021-03-10T13:48:00.204 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.872Z caller=node_exporter.go:113 collector=udp_queues 2021-03-10T13:48:00.204 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.872Z caller=node_exporter.go:113 collector=uname 2021-03-10T13:48:00.204 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.872Z caller=node_exporter.go:113 collector=vmstat 2021-03-10T13:48:00.204 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.872Z caller=node_exporter.go:113 collector=xfs 2021-03-10T13:48:00.205 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.872Z caller=node_exporter.go:113 collector=zfs 2021-03-10T13:48:00.205 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.872Z caller=node_exporter.go:195 msg="Listening on" address=:9100 2021-03-10T13:48:00.205 INFO:journalctl@ceph.node-exporter.b.gibba020.stdout:Mar 10 13:47:59 gibba020 bash[18137]: level=info ts=2021-03-10T13:47:59.872Z caller=tls_config.go:191 msg="TLS is disabled." http2=false 2021-03-10T13:48:01.618 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[9767]: cluster 2021-03-10T13:48:00.465258+0000 mgr.y (mgr.14140) 179 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:01.619 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[13024]: cluster 2021-03-10T13:48:00.465258+0000 mgr.y (mgr.14140) 179 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:01.882 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.780Z caller=node_exporter.go:178 msg="Starting node_exporter" version="(version=1.1.2, branch=HEAD, revision=b597c1244d7bef49e6f3359c87a56dd7707f6719)" 2021-03-10T13:48:01.882 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.780Z caller=node_exporter.go:179 msg="Build context" build_context="(go=go1.15.8, user=root@f07de8ca602a, date=20210305-09:29:10)" 2021-03-10T13:48:01.882 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.781Z caller=filesystem_common.go:74 collector=filesystem msg="Parsed flag --collector.filesystem.ignored-mount-points" flag=^/(dev|proc|sys|var/lib/docker/.+)($|/) 2021-03-10T13:48:01.882 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.781Z caller=filesystem_common.go:76 collector=filesystem msg="Parsed flag --collector.filesystem.ignored-fs-types" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2021-03-10T13:48:01.883 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.781Z caller=node_exporter.go:106 msg="Enabled collectors" 2021-03-10T13:48:01.883 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.781Z caller=node_exporter.go:113 collector=arp 2021-03-10T13:48:01.883 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.781Z caller=node_exporter.go:113 collector=bcache 2021-03-10T13:48:01.883 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.781Z caller=node_exporter.go:113 collector=bonding 2021-03-10T13:48:01.884 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.781Z caller=node_exporter.go:113 collector=btrfs 2021-03-10T13:48:01.884 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.781Z caller=node_exporter.go:113 collector=conntrack 2021-03-10T13:48:01.884 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.781Z caller=node_exporter.go:113 collector=cpu 2021-03-10T13:48:01.884 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.781Z caller=node_exporter.go:113 collector=cpufreq 2021-03-10T13:48:01.884 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.781Z caller=node_exporter.go:113 collector=diskstats 2021-03-10T13:48:01.885 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.781Z caller=node_exporter.go:113 collector=edac 2021-03-10T13:48:01.885 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.781Z caller=node_exporter.go:113 collector=entropy 2021-03-10T13:48:01.885 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.781Z caller=node_exporter.go:113 collector=fibrechannel 2021-03-10T13:48:01.885 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.781Z caller=node_exporter.go:113 collector=filefd 2021-03-10T13:48:01.885 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.781Z caller=node_exporter.go:113 collector=filesystem 2021-03-10T13:48:01.886 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.781Z caller=node_exporter.go:113 collector=hwmon 2021-03-10T13:48:01.886 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.781Z caller=node_exporter.go:113 collector=infiniband 2021-03-10T13:48:01.886 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.781Z caller=node_exporter.go:113 collector=ipvs 2021-03-10T13:48:01.886 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.781Z caller=node_exporter.go:113 collector=loadavg 2021-03-10T13:48:01.886 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.781Z caller=node_exporter.go:113 collector=mdadm 2021-03-10T13:48:01.887 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.781Z caller=node_exporter.go:113 collector=meminfo 2021-03-10T13:48:01.887 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.781Z caller=node_exporter.go:113 collector=netclass 2021-03-10T13:48:01.887 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.781Z caller=node_exporter.go:113 collector=netdev 2021-03-10T13:48:01.887 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.781Z caller=node_exporter.go:113 collector=netstat 2021-03-10T13:48:01.887 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.781Z caller=node_exporter.go:113 collector=nfs 2021-03-10T13:48:01.888 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.781Z caller=node_exporter.go:113 collector=nfsd 2021-03-10T13:48:01.888 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.781Z caller=node_exporter.go:113 collector=powersupplyclass 2021-03-10T13:48:01.888 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.781Z caller=node_exporter.go:113 collector=pressure 2021-03-10T13:48:01.888 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.781Z caller=node_exporter.go:113 collector=rapl 2021-03-10T13:48:01.888 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.781Z caller=node_exporter.go:113 collector=schedstat 2021-03-10T13:48:01.889 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.781Z caller=node_exporter.go:113 collector=sockstat 2021-03-10T13:48:01.889 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.781Z caller=node_exporter.go:113 collector=softnet 2021-03-10T13:48:01.889 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.781Z caller=node_exporter.go:113 collector=stat 2021-03-10T13:48:01.889 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.781Z caller=node_exporter.go:113 collector=textfile 2021-03-10T13:48:01.890 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.781Z caller=node_exporter.go:113 collector=thermal_zone 2021-03-10T13:48:01.890 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.781Z caller=node_exporter.go:113 collector=time 2021-03-10T13:48:01.890 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.781Z caller=node_exporter.go:113 collector=udp_queues 2021-03-10T13:48:01.890 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.781Z caller=node_exporter.go:113 collector=uname 2021-03-10T13:48:01.890 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.781Z caller=node_exporter.go:113 collector=vmstat 2021-03-10T13:48:01.891 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.781Z caller=node_exporter.go:113 collector=xfs 2021-03-10T13:48:01.891 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.781Z caller=node_exporter.go:113 collector=zfs 2021-03-10T13:48:01.891 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.781Z caller=node_exporter.go:195 msg="Listening on" address=:9100 2021-03-10T13:48:01.891 INFO:journalctl@ceph.node-exporter.a.gibba013.stdout:Mar 10 13:48:01 gibba013 bash[19708]: level=info ts=2021-03-10T13:48:01.781Z caller=tls_config.go:191 msg="TLS is disabled." http2=false 2021-03-10T13:48:01.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:01 gibba020 bash[9782]: cluster 2021-03-10T13:48:00.465258+0000 mgr.y (mgr.14140) 179 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:03.764 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:03 gibba013 bash[9767]: cluster 2021-03-10T13:48:02.466093+0000 mgr.y (mgr.14140) 180 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:03.764 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:03 gibba013 bash[13024]: cluster 2021-03-10T13:48:02.466093+0000 mgr.y (mgr.14140) 180 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:03.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:03 gibba020 bash[9782]: cluster 2021-03-10T13:48:02.466093+0000 mgr.y (mgr.14140) 180 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:04.792 INFO:teuthology.orchestra.run.gibba013.stdout:[client.0] 2021-03-10T13:48:04.792 INFO:teuthology.orchestra.run.gibba013.stdout: key = AQAUzkhgUq/SLhAA15dZt2tbN+pAuHqEIdEbGg== 2021-03-10T13:48:05.691 DEBUG:teuthology.orchestra.run.gibba013:> set -ex 2021-03-10T13:48:05.692 DEBUG:teuthology.orchestra.run.gibba013:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2021-03-10T13:48:05.692 DEBUG:teuthology.orchestra.run.gibba013:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2021-03-10T13:48:05.701 DEBUG:teuthology.orchestra.run.gibba020:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2021-03-10T13:48:05.748 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:05 gibba013 bash[9767]: cluster 2021-03-10T13:48:04.466938+0000 mgr.y (mgr.14140) 181 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:05.748 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:05 gibba013 bash[9767]: audit 2021-03-10T13:48:04.785466+0000 mon.a (mon.0) 496 : audit [INF] from='client.? 172.21.2.113:0/597247169' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T13:48:05.748 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:05 gibba013 bash[9767]: audit 2021-03-10T13:48:04.789526+0000 mon.a (mon.0) 497 : audit [INF] from='client.? 172.21.2.113:0/597247169' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-03-10T13:48:05.749 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:05 gibba013 bash[13024]: cluster 2021-03-10T13:48:04.466938+0000 mgr.y (mgr.14140) 181 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:05.749 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:05 gibba013 bash[13024]: audit 2021-03-10T13:48:04.785466+0000 mon.a (mon.0) 496 : audit [INF] from='client.? 172.21.2.113:0/597247169' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T13:48:05.749 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:05 gibba013 bash[13024]: audit 2021-03-10T13:48:04.789526+0000 mon.a (mon.0) 497 : audit [INF] from='client.? 172.21.2.113:0/597247169' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-03-10T13:48:05.789 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:05 gibba020 bash[9782]: cluster 2021-03-10T13:48:04.466938+0000 mgr.y (mgr.14140) 181 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:05.789 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:05 gibba020 bash[9782]: audit 2021-03-10T13:48:04.785466+0000 mon.a (mon.0) 496 : audit [INF] from='client.? 172.21.2.113:0/597247169' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T13:48:05.789 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:05 gibba020 bash[9782]: audit 2021-03-10T13:48:04.789526+0000 mon.a (mon.0) 497 : audit [INF] from='client.? 172.21.2.113:0/597247169' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-03-10T13:48:07.132 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:48:06 gibba013 docker[20315]: Error: No such container: ceph-7672acc8-81a6-11eb-9080-001a4aab830c-alertmanager.a 2021-03-10T13:48:07.132 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:48:06 gibba013 systemd[1]: Started Ceph alertmanager.a for 7672acc8-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:48:07.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:07 gibba020 bash[9782]: cluster 2021-03-10T13:48:06.467300+0000 mgr.y (mgr.14140) 182 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:07.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:07 gibba020 bash[9782]: audit 2021-03-10T13:48:06.719999+0000 mon.a (mon.0) 498 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406440\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406500\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406529\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406556\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406581\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406607\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406633\", \"created\": \"2021-03-10T13:46:03.738924\"}, \"node-exporter.a\": {\"hostname\": \"gibba013\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"gibba013\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.736195\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:48:07.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:07 gibba020 bash[9782]: audit 2021-03-10T13:48:06.723565+0000 mon.a (mon.0) 499 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406440\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406500\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406529\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406556\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406581\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406607\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406633\", \"created\": \"2021-03-10T13:46:03.738924\"}, \"node-exporter.a\": {\"hostname\": \"gibba013\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"gibba013\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.736195\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:48:07.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:07 gibba020 bash[9782]: audit 2021-03-10T13:48:06.724245+0000 mon.a (mon.0) 500 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:48:07.881 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:48:07 gibba013 bash[20331]: level=info ts=2021-03-10T13:48:07.698Z caller=main.go:216 msg="Starting Alertmanager" version="(version=0.21.0, branch=HEAD, revision=4c6c03ebfe21009c546e4d1e9b92c371d67c021d)" 2021-03-10T13:48:07.881 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:48:07 gibba013 bash[20331]: level=info ts=2021-03-10T13:48:07.698Z caller=main.go:217 build_context="(go=go1.14.4, user=root@dee35927357f, date=20200617-08:54:02)" 2021-03-10T13:48:07.882 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:48:07 gibba013 bash[20331]: level=info ts=2021-03-10T13:48:07.699Z caller=cluster.go:161 component=cluster msg="setting advertise address explicitly" addr=172.21.2.113 port=9094 2021-03-10T13:48:07.882 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:48:07 gibba013 bash[20331]: level=info ts=2021-03-10T13:48:07.700Z caller=cluster.go:623 component=cluster msg="Waiting for gossip to settle..." interval=2s 2021-03-10T13:48:07.882 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:48:07 gibba013 bash[20331]: level=info ts=2021-03-10T13:48:07.714Z caller=coordinator.go:119 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2021-03-10T13:48:07.882 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:48:07 gibba013 bash[20331]: level=info ts=2021-03-10T13:48:07.714Z caller=coordinator.go:131 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2021-03-10T13:48:07.882 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:48:07 gibba013 bash[20331]: level=info ts=2021-03-10T13:48:07.716Z caller=main.go:485 msg=Listening address=:9093 2021-03-10T13:48:07.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:07 gibba013 bash[9767]: cluster 2021-03-10T13:48:06.467300+0000 mgr.y (mgr.14140) 182 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:07.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:07 gibba013 bash[13024]: cluster 2021-03-10T13:48:06.467300+0000 mgr.y (mgr.14140) 182 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:07.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:07 gibba013 bash[9767]: audit 2021-03-10T13:48:06.719999+0000 mon.a (mon.0) 498 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406440\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406500\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406529\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406556\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406581\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406607\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406633\", \"created\": \"2021-03-10T13:46:03.738924\"}, \"node-exporter.a\": {\"hostname\": \"gibba013\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"gibba013\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.736195\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:48:07.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:07 gibba013 bash[9767]: audit 2021-03-10T13:48:06.723565+0000 mon.a (mon.0) 499 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406440\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406500\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406529\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406556\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406581\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406607\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406633\", \"created\": \"2021-03-10T13:46:03.738924\"}, \"node-exporter.a\": {\"hostname\": \"gibba013\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"gibba013\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.736195\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:48:07.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:07 gibba013 bash[9767]: audit 2021-03-10T13:48:06.724245+0000 mon.a (mon.0) 500 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:48:07.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:07 gibba013 bash[13024]: audit 2021-03-10T13:48:06.719999+0000 mon.a (mon.0) 498 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406440\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406500\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406529\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406556\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406581\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406607\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406633\", \"created\": \"2021-03-10T13:46:03.738924\"}, \"node-exporter.a\": {\"hostname\": \"gibba013\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"gibba013\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.736195\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:48:07.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:07 gibba013 bash[13024]: audit 2021-03-10T13:48:06.723565+0000 mon.a (mon.0) 499 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406440\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406500\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406529\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406556\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406581\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406607\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:46:04.406633\", \"created\": \"2021-03-10T13:46:03.738924\"}, \"node-exporter.a\": {\"hostname\": \"gibba013\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"gibba013\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.736195\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:48:07.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:07 gibba013 bash[13024]: audit 2021-03-10T13:48:06.724245+0000 mon.a (mon.0) 500 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:48:08.567 INFO:teuthology.orchestra.run.gibba020.stdout:[client.1] 2021-03-10T13:48:08.567 INFO:teuthology.orchestra.run.gibba020.stdout: key = AQAYzkhg9ypsIRAA2HREuYC907qaTegZnY6k/w== 2021-03-10T13:48:08.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:08 gibba013 bash[9767]: audit 2021-03-10T13:48:07.854815+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.853821\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.853880\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.853910\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.853937\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.853963\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.853995\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.854022\", \"created\": \"2021-03-10T13:46:03.738924\", \"started\": \"2021-03-10T13:46:06.962147\"}, \"node-exporter.a\": {\"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.854049\", \"created\": \"2021-03-10T13:47:56.718923\", \"started\": \"2021-03-10T13:47:58.556074\"}, \"alertmanager.a\": {\"hostname\": \"gibba013\", \"container_id\": \"2e79d86dc29d\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.854075\", \"created\": \"2021-03-10T13:48:06.706923\", \"started\": \"2021-03-10T13:48:06.734042\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.736195\"}}, \"last_daemon_update\": \"2021-03-10T13:48:07.854138\", \"last_device_update\": \"2021-03-10T13:46:10.457486\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:48:08.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:08 gibba013 bash[9767]: audit 2021-03-10T13:48:07.858587+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.853821\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.853880\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.853910\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.853937\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.853963\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.853995\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.854022\", \"created\": \"2021-03-10T13:46:03.738924\", \"started\": \"2021-03-10T13:46:06.962147\"}, \"node-exporter.a\": {\"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.854049\", \"created\": \"2021-03-10T13:47:56.718923\", \"started\": \"2021-03-10T13:47:58.556074\"}, \"alertmanager.a\": {\"hostname\": \"gibba013\", \"container_id\": \"2e79d86dc29d\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.854075\", \"created\": \"2021-03-10T13:48:06.706923\", \"started\": \"2021-03-10T13:48:06.734042\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.736195\"}}, \"last_daemon_update\": \"2021-03-10T13:48:07.854138\", \"last_device_update\": \"2021-03-10T13:46:10.457486\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:48:08.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:08 gibba013 bash[9767]: audit 2021-03-10T13:48:07.859142+0000 mon.a (mon.0) 503 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:48:08.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:08 gibba013 bash[13024]: audit 2021-03-10T13:48:07.854815+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.853821\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.853880\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.853910\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.853937\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.853963\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.853995\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.854022\", \"created\": \"2021-03-10T13:46:03.738924\", \"started\": \"2021-03-10T13:46:06.962147\"}, \"node-exporter.a\": {\"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.854049\", \"created\": \"2021-03-10T13:47:56.718923\", \"started\": \"2021-03-10T13:47:58.556074\"}, \"alertmanager.a\": {\"hostname\": \"gibba013\", \"container_id\": \"2e79d86dc29d\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.854075\", \"created\": \"2021-03-10T13:48:06.706923\", \"started\": \"2021-03-10T13:48:06.734042\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.736195\"}}, \"last_daemon_update\": \"2021-03-10T13:48:07.854138\", \"last_device_update\": \"2021-03-10T13:46:10.457486\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:48:08.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:08 gibba013 bash[13024]: audit 2021-03-10T13:48:07.858587+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.853821\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.853880\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.853910\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.853937\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.853963\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.853995\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.854022\", \"created\": \"2021-03-10T13:46:03.738924\", \"started\": \"2021-03-10T13:46:06.962147\"}, \"node-exporter.a\": {\"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.854049\", \"created\": \"2021-03-10T13:47:56.718923\", \"started\": \"2021-03-10T13:47:58.556074\"}, \"alertmanager.a\": {\"hostname\": \"gibba013\", \"container_id\": \"2e79d86dc29d\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.854075\", \"created\": \"2021-03-10T13:48:06.706923\", \"started\": \"2021-03-10T13:48:06.734042\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.736195\"}}, \"last_daemon_update\": \"2021-03-10T13:48:07.854138\", \"last_device_update\": \"2021-03-10T13:46:10.457486\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:48:08.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:08 gibba013 bash[13024]: audit 2021-03-10T13:48:07.859142+0000 mon.a (mon.0) 503 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:48:08.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:08 gibba020 bash[9782]: audit 2021-03-10T13:48:07.854815+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.853821\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.853880\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.853910\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.853937\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.853963\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.853995\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.854022\", \"created\": \"2021-03-10T13:46:03.738924\", \"started\": \"2021-03-10T13:46:06.962147\"}, \"node-exporter.a\": {\"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.854049\", \"created\": \"2021-03-10T13:47:56.718923\", \"started\": \"2021-03-10T13:47:58.556074\"}, \"alertmanager.a\": {\"hostname\": \"gibba013\", \"container_id\": \"2e79d86dc29d\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.854075\", \"created\": \"2021-03-10T13:48:06.706923\", \"started\": \"2021-03-10T13:48:06.734042\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.736195\"}}, \"last_daemon_update\": \"2021-03-10T13:48:07.854138\", \"last_device_update\": \"2021-03-10T13:46:10.457486\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:48:08.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:08 gibba020 bash[9782]: audit 2021-03-10T13:48:07.858587+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.853821\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.853880\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.853910\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.853937\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.853963\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.853995\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.854022\", \"created\": \"2021-03-10T13:46:03.738924\", \"started\": \"2021-03-10T13:46:06.962147\"}, \"node-exporter.a\": {\"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.854049\", \"created\": \"2021-03-10T13:47:56.718923\", \"started\": \"2021-03-10T13:47:58.556074\"}, \"alertmanager.a\": {\"hostname\": \"gibba013\", \"container_id\": \"2e79d86dc29d\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:07.854075\", \"created\": \"2021-03-10T13:48:06.706923\", \"started\": \"2021-03-10T13:48:06.734042\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.736195\"}}, \"last_daemon_update\": \"2021-03-10T13:48:07.854138\", \"last_device_update\": \"2021-03-10T13:46:10.457486\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:48:08.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:08 gibba020 bash[9782]: audit 2021-03-10T13:48:07.859142+0000 mon.a (mon.0) 503 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:48:09.175 DEBUG:teuthology.orchestra.run.gibba020:> set -ex 2021-03-10T13:48:09.176 DEBUG:teuthology.orchestra.run.gibba020:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2021-03-10T13:48:09.176 DEBUG:teuthology.orchestra.run.gibba020:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2021-03-10T13:48:09.185 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph osd dump --format=json 2021-03-10T13:48:09.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:09 gibba013 bash[9767]: cluster 2021-03-10T13:48:08.468260+0000 mgr.y (mgr.14140) 183 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:09.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:09 gibba013 bash[13024]: cluster 2021-03-10T13:48:08.468260+0000 mgr.y (mgr.14140) 183 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:09.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:09 gibba013 bash[9767]: audit 2021-03-10T13:48:08.555718+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554222\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554310\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554358\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554404\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554447\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554489\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554531\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"157beacd603d\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554574\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:47:55.252546\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554616\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:47:41.497315\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}}, \"last_daemon_update\": \"2021-03-10T13:48:08.554714\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:48:09.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:09 gibba013 bash[13024]: audit 2021-03-10T13:48:08.555718+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554222\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554310\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554358\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554404\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554447\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554489\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554531\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"157beacd603d\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554574\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:47:55.252546\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554616\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:47:41.497315\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}}, \"last_daemon_update\": \"2021-03-10T13:48:08.554714\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:48:09.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:09 gibba013 bash[9767]: audit 2021-03-10T13:48:08.559463+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554222\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554310\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554358\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554404\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554447\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554489\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554531\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"157beacd603d\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554574\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:47:55.252546\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554616\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:47:41.497315\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}}, \"last_daemon_update\": \"2021-03-10T13:48:08.554714\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:48:09.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:09 gibba013 bash[9767]: audit 2021-03-10T13:48:08.560584+0000 mon.a (mon.0) 506 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T13:48:09.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:09 gibba013 bash[9767]: audit 2021-03-10T13:48:08.564551+0000 mon.a (mon.0) 507 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-03-10T13:48:09.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:09 gibba013 bash[9767]: audit 2021-03-10T13:48:08.564559+0000 mon.b (mon.2) 22 : audit [INF] from='client.? 172.21.2.120:0/716506105' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T13:48:09.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:09 gibba013 bash[9767]: audit 2021-03-10T13:48:08.635953+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxjCCAa4CEQCMJ73Rj4JHTrxNlUBM+iJyMA0GCSqGSIb3DQEBDQUAMCExDTAL\nBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0wHhcNMjEwMzEwMTM0ODA4WhcN\nMzEwMzA4MTM0ODA4WjAhMQ0wCwYDVQQKDARDZXBoMRAwDgYDVQQDDAdjZXBoYWRt\nMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAlF+klNThGk9yGiH7lxuJ\n79lvKSwrlAfb2r0BpnqWbKvbFWggNR3PqmHyWKvFxJBfTt+vIKe4v56IqqoJvHcw\nmokm/SJjtcCrrakh7iqVYSTHCx7imvQqSusHph5wK+wVZKot78AprZHTQuB6i9yv\n1QZEpjAQKOb0kYUPYhWplsLzUsRHWGmFARDQ5nydoV1nLJ/dctDev+3aBaCaK4TP\nkNsFsj9AfXClFghJNzzgZI8lg2r7giCJ1smB3BKZO62krJXN1yDkXCk5aeKwiAH7\nIwYarR5NHKIbsvaY1yDuKEPsEzwHBGel6GfwAEPFhKAiS/Z0+KKonfVQT5zKnl1G\n3wIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQBcixco7AcmV/Fr0SwWnrx0Ns3BCK2w\n1Uq8GTr/NT9ZTPPyUt8UcZ/PxnXSFr8UhCuBOvaMn5PUrONBbhZdIsJf08bkGuS3\nim9gJBAVdERdGcTevhTg8vKX9PHgdJCPvZ1mQb/BWjmKve/yN4a4ZxC3o+Tp9KIg\neGFdqjLRTdZGQGz6QL/xPwA6zMgxEkRDCwsbWRrepBnd4XMkVtcY3iWNkmil7unK\nWkIcQCAGqoANvUPdsU+W7xMqgC7WwTVi7hiKHadeXAWnrLM6caI36dFF0NF6ZSJa\nDNVSaO7AZbR2+4lVl6pCa98ydZ12PEeVtuvj33hTMwBKK7LTAXuZATeV\n-----END CERTIFICATE-----\n"}]: dispatch 2021-03-10T13:48:09.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:09 gibba013 bash[13024]: audit 2021-03-10T13:48:08.559463+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554222\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554310\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554358\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554404\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554447\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554489\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554531\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"157beacd603d\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554574\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:47:55.252546\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554616\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:47:41.497315\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}}, \"last_daemon_update\": \"2021-03-10T13:48:08.554714\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:48:09.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:09 gibba013 bash[13024]: audit 2021-03-10T13:48:08.560584+0000 mon.a (mon.0) 506 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T13:48:09.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:09 gibba013 bash[13024]: audit 2021-03-10T13:48:08.564551+0000 mon.a (mon.0) 507 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-03-10T13:48:09.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:09 gibba013 bash[13024]: audit 2021-03-10T13:48:08.564559+0000 mon.b (mon.2) 22 : audit [INF] from='client.? 172.21.2.120:0/716506105' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T13:48:09.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:09 gibba013 bash[13024]: audit 2021-03-10T13:48:08.635953+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxjCCAa4CEQCMJ73Rj4JHTrxNlUBM+iJyMA0GCSqGSIb3DQEBDQUAMCExDTAL\nBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0wHhcNMjEwMzEwMTM0ODA4WhcN\nMzEwMzA4MTM0ODA4WjAhMQ0wCwYDVQQKDARDZXBoMRAwDgYDVQQDDAdjZXBoYWRt\nMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAlF+klNThGk9yGiH7lxuJ\n79lvKSwrlAfb2r0BpnqWbKvbFWggNR3PqmHyWKvFxJBfTt+vIKe4v56IqqoJvHcw\nmokm/SJjtcCrrakh7iqVYSTHCx7imvQqSusHph5wK+wVZKot78AprZHTQuB6i9yv\n1QZEpjAQKOb0kYUPYhWplsLzUsRHWGmFARDQ5nydoV1nLJ/dctDev+3aBaCaK4TP\nkNsFsj9AfXClFghJNzzgZI8lg2r7giCJ1smB3BKZO62krJXN1yDkXCk5aeKwiAH7\nIwYarR5NHKIbsvaY1yDuKEPsEzwHBGel6GfwAEPFhKAiS/Z0+KKonfVQT5zKnl1G\n3wIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQBcixco7AcmV/Fr0SwWnrx0Ns3BCK2w\n1Uq8GTr/NT9ZTPPyUt8UcZ/PxnXSFr8UhCuBOvaMn5PUrONBbhZdIsJf08bkGuS3\nim9gJBAVdERdGcTevhTg8vKX9PHgdJCPvZ1mQb/BWjmKve/yN4a4ZxC3o+Tp9KIg\neGFdqjLRTdZGQGz6QL/xPwA6zMgxEkRDCwsbWRrepBnd4XMkVtcY3iWNkmil7unK\nWkIcQCAGqoANvUPdsU+W7xMqgC7WwTVi7hiKHadeXAWnrLM6caI36dFF0NF6ZSJa\nDNVSaO7AZbR2+4lVl6pCa98ydZ12PEeVtuvj33hTMwBKK7LTAXuZATeV\n-----END CERTIFICATE-----\n"}]: dispatch 2021-03-10T13:48:09.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:09 gibba013 bash[9767]: audit 2021-03-10T13:48:08.638931+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxjCCAa4CEQCMJ73Rj4JHTrxNlUBM+iJyMA0GCSqGSIb3DQEBDQUAMCExDTAL\nBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0wHhcNMjEwMzEwMTM0ODA4WhcN\nMzEwMzA4MTM0ODA4WjAhMQ0wCwYDVQQKDARDZXBoMRAwDgYDVQQDDAdjZXBoYWRt\nMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAlF+klNThGk9yGiH7lxuJ\n79lvKSwrlAfb2r0BpnqWbKvbFWggNR3PqmHyWKvFxJBfTt+vIKe4v56IqqoJvHcw\nmokm/SJjtcCrrakh7iqVYSTHCx7imvQqSusHph5wK+wVZKot78AprZHTQuB6i9yv\n1QZEpjAQKOb0kYUPYhWplsLzUsRHWGmFARDQ5nydoV1nLJ/dctDev+3aBaCaK4TP\nkNsFsj9AfXClFghJNzzgZI8lg2r7giCJ1smB3BKZO62krJXN1yDkXCk5aeKwiAH7\nIwYarR5NHKIbsvaY1yDuKEPsEzwHBGel6GfwAEPFhKAiS/Z0+KKonfVQT5zKnl1G\n3wIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQBcixco7AcmV/Fr0SwWnrx0Ns3BCK2w\n1Uq8GTr/NT9ZTPPyUt8UcZ/PxnXSFr8UhCuBOvaMn5PUrONBbhZdIsJf08bkGuS3\nim9gJBAVdERdGcTevhTg8vKX9PHgdJCPvZ1mQb/BWjmKve/yN4a4ZxC3o+Tp9KIg\neGFdqjLRTdZGQGz6QL/xPwA6zMgxEkRDCwsbWRrepBnd4XMkVtcY3iWNkmil7unK\nWkIcQCAGqoANvUPdsU+W7xMqgC7WwTVi7hiKHadeXAWnrLM6caI36dFF0NF6ZSJa\nDNVSaO7AZbR2+4lVl6pCa98ydZ12PEeVtuvj33hTMwBKK7LTAXuZATeV\n-----END CERTIFICATE-----\n"}]': finished 2021-03-10T13:48:09.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:09 gibba013 bash[9767]: audit 2021-03-10T13:48:08.639388+0000 mon.a (mon.0) 510 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvwIBADANBgkqhkiG9w0BAQEFAASCBKkwggSlAgEAAoIBAQCUX6SU1OEaT3Ia\nIfuXG4nv2W8pLCuUB9vavQGmepZsq9sVaCA1Hc+qYfJYq8XEkF9O368gp7i/noiq\nqgm8dzCaiSb9ImO1wKutqSHuKpVhJMcLHuKa9CpK6wemHnAr7BVkqi3vwCmtkdNC\n4HqL3K/VBkSmMBAo5vSRhQ9iFamWwvNSxEdYaYUBENDmfJ2hXWcsn91y0N6/7doF\noJorhM+Q2wWyP0B9cKUWCEk3POBkjyWDavuCIInWyYHcEpk7raSslc3XIORcKTlp\n4rCIAfsjBhqtHk0cohuy9pjXIO4oQ+wTPAcEZ6XoZ/AAQ8WEoCJL9nT4oqid9VBP\nnMqeXUbfAgMBAAECggEAfgohTSzpa+hBDWIAzwRd0JnsjBUxj7Z9VPtqA3nvfrEe\nkri5Y2XHmv1JWXnRroDV9bKemibgEiciAZggXTEC4MPRkwc7nJHnRMaAREl4S+Vq\nEFBUPz1bD/lHrh39O9J4+eJ200tyHDfcNttqPpVh6JxChMofcB+BcnyN7MxqG96E\noivTvpXAL3sPRXgBaBIBHTV3pipQjnDg73qXIWbNYmeTliH4PxYy3Nsj+yq4OY5e\nl8a6RdPOcxekyjhwCxKdeZQMVAFjVPPRmcDYuzdbxvmSNCeodInhJQVywrgR2+HR\nuiUMrMmG8dPtTFkpY/1qAX1GzpaxFHVhsljDo/JQwQKBgQDEwo9BHGB009dncPa8\nUZc2HwYtN9YoBEMsQ/I93yVRigdreHrUFqoccNVHnTPj7rXoQiD8drHhXNwGxdqo\n+X49rePd0hknoYijcWASrInor2Xpetg8ineHYc7rnwqcbiWsmRShlB9OaX690i6P\nwu5hNH7iQQoHNTikW9UwymiANQKBgQDBC6lte/bSkkNQOIibhsqslk6VgaNQY3H0\nyli6H5N6Tj5w2daahwILxst77QhFiUdOEz6CY8Q0ay9Uc7TuEmxt5D0AbSXLj8+u\nAPW/iRDjtAPXquOs5V4Xd6P7BclXCv7hNf5Pir2Z6t4ETjRz1Eb4m663HlEU3mN4\n0dnR1S31QwKBgQCo0iKmBBoCw2yzlWoupHbweegLzjfSt+2GwnnLenYDo0HAhWwm\nI5grtOhafNhz/nJX6L1ywMjZC5rBuOtnRkJ524SC4+yvY1rgmbuL6jydyDjR/pQg\nRdJO963Z3uj01VE/6UyZYoUF+2BCsF9A/EkaYDdqG9Hl41VJOH4QUesd7QKBgQCp\nH9ZnnNs4z/s5JM5Js2WMnoJqaRDzNKx5kWz6Yv+Jf1Mk+zQQXYdlWdybzaYZhZN6\ny1FQWqdiZSUqD9TLXkiwXe0zmmwqUuvXve+Oxj6NvwA+yfB9YNV2KdL38LHcGD4E\ngJE0jpBdcG7hxsIdWDR1Sa9frqfKaKstBmyWcPW6kQKBgQCFXO/YyLVEsySEPFFI\nUNRQf1O7N1VAT+Wy9aAc/hBT9cx5/BWfru+zBuirVAS7UgIu3lNy0jc/5Bz/xwfp\nDv0QSv+Mo1AV1M74F51SRH9GYEAltH5RzNED0nK1gYbfVkPIUy3cmiaiMzcHxMMP\nr9c9Yx6hgrm/ypPFoSN+0ZBUdA==\n-----END PRIVATE KEY-----\n"}]: dispatch 2021-03-10T13:48:09.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:09 gibba013 bash[9767]: audit 2021-03-10T13:48:08.642123+0000 mon.a (mon.0) 511 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvwIBADANBgkqhkiG9w0BAQEFAASCBKkwggSlAgEAAoIBAQCUX6SU1OEaT3Ia\nIfuXG4nv2W8pLCuUB9vavQGmepZsq9sVaCA1Hc+qYfJYq8XEkF9O368gp7i/noiq\nqgm8dzCaiSb9ImO1wKutqSHuKpVhJMcLHuKa9CpK6wemHnAr7BVkqi3vwCmtkdNC\n4HqL3K/VBkSmMBAo5vSRhQ9iFamWwvNSxEdYaYUBENDmfJ2hXWcsn91y0N6/7doF\noJorhM+Q2wWyP0B9cKUWCEk3POBkjyWDavuCIInWyYHcEpk7raSslc3XIORcKTlp\n4rCIAfsjBhqtHk0cohuy9pjXIO4oQ+wTPAcEZ6XoZ/AAQ8WEoCJL9nT4oqid9VBP\nnMqeXUbfAgMBAAECggEAfgohTSzpa+hBDWIAzwRd0JnsjBUxj7Z9VPtqA3nvfrEe\nkri5Y2XHmv1JWXnRroDV9bKemibgEiciAZggXTEC4MPRkwc7nJHnRMaAREl4S+Vq\nEFBUPz1bD/lHrh39O9J4+eJ200tyHDfcNttqPpVh6JxChMofcB+BcnyN7MxqG96E\noivTvpXAL3sPRXgBaBIBHTV3pipQjnDg73qXIWbNYmeTliH4PxYy3Nsj+yq4OY5e\nl8a6RdPOcxekyjhwCxKdeZQMVAFjVPPRmcDYuzdbxvmSNCeodInhJQVywrgR2+HR\nuiUMrMmG8dPtTFkpY/1qAX1GzpaxFHVhsljDo/JQwQKBgQDEwo9BHGB009dncPa8\nUZc2HwYtN9YoBEMsQ/I93yVRigdreHrUFqoccNVHnTPj7rXoQiD8drHhXNwGxdqo\n+X49rePd0hknoYijcWASrInor2Xpetg8ineHYc7rnwqcbiWsmRShlB9OaX690i6P\nwu5hNH7iQQoHNTikW9UwymiANQKBgQDBC6lte/bSkkNQOIibhsqslk6VgaNQY3H0\nyli6H5N6Tj5w2daahwILxst77QhFiUdOEz6CY8Q0ay9Uc7TuEmxt5D0AbSXLj8+u\nAPW/iRDjtAPXquOs5V4Xd6P7BclXCv7hNf5Pir2Z6t4ETjRz1Eb4m663HlEU3mN4\n0dnR1S31QwKBgQCo0iKmBBoCw2yzlWoupHbweegLzjfSt+2GwnnLenYDo0HAhWwm\nI5grtOhafNhz/nJX6L1ywMjZC5rBuOtnRkJ524SC4+yvY1rgmbuL6jydyDjR/pQg\nRdJO963Z3uj01VE/6UyZYoUF+2BCsF9A/EkaYDdqG9Hl41VJOH4QUesd7QKBgQCp\nH9ZnnNs4z/s5JM5Js2WMnoJqaRDzNKx5kWz6Yv+Jf1Mk+zQQXYdlWdybzaYZhZN6\ny1FQWqdiZSUqD9TLXkiwXe0zmmwqUuvXve+Oxj6NvwA+yfB9YNV2KdL38LHcGD4E\ngJE0jpBdcG7hxsIdWDR1Sa9frqfKaKstBmyWcPW6kQKBgQCFXO/YyLVEsySEPFFI\nUNRQf1O7N1VAT+Wy9aAc/hBT9cx5/BWfru+zBuirVAS7UgIu3lNy0jc/5Bz/xwfp\nDv0QSv+Mo1AV1M74F51SRH9GYEAltH5RzNED0nK1gYbfVkPIUy3cmiaiMzcHxMMP\nr9c9Yx6hgrm/ypPFoSN+0ZBUdA==\n-----END PRIVATE KEY-----\n"}]': finished 2021-03-10T13:48:09.639 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:09 gibba013 bash[9767]: cephadm 2021-03-10T13:48:08.642675+0000 mgr.y (mgr.14140) 184 : cephadm [INF] Deploying daemon grafana.a on gibba020 2021-03-10T13:48:09.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:09 gibba013 bash[13024]: audit 2021-03-10T13:48:08.638931+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxjCCAa4CEQCMJ73Rj4JHTrxNlUBM+iJyMA0GCSqGSIb3DQEBDQUAMCExDTAL\nBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0wHhcNMjEwMzEwMTM0ODA4WhcN\nMzEwMzA4MTM0ODA4WjAhMQ0wCwYDVQQKDARDZXBoMRAwDgYDVQQDDAdjZXBoYWRt\nMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAlF+klNThGk9yGiH7lxuJ\n79lvKSwrlAfb2r0BpnqWbKvbFWggNR3PqmHyWKvFxJBfTt+vIKe4v56IqqoJvHcw\nmokm/SJjtcCrrakh7iqVYSTHCx7imvQqSusHph5wK+wVZKot78AprZHTQuB6i9yv\n1QZEpjAQKOb0kYUPYhWplsLzUsRHWGmFARDQ5nydoV1nLJ/dctDev+3aBaCaK4TP\nkNsFsj9AfXClFghJNzzgZI8lg2r7giCJ1smB3BKZO62krJXN1yDkXCk5aeKwiAH7\nIwYarR5NHKIbsvaY1yDuKEPsEzwHBGel6GfwAEPFhKAiS/Z0+KKonfVQT5zKnl1G\n3wIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQBcixco7AcmV/Fr0SwWnrx0Ns3BCK2w\n1Uq8GTr/NT9ZTPPyUt8UcZ/PxnXSFr8UhCuBOvaMn5PUrONBbhZdIsJf08bkGuS3\nim9gJBAVdERdGcTevhTg8vKX9PHgdJCPvZ1mQb/BWjmKve/yN4a4ZxC3o+Tp9KIg\neGFdqjLRTdZGQGz6QL/xPwA6zMgxEkRDCwsbWRrepBnd4XMkVtcY3iWNkmil7unK\nWkIcQCAGqoANvUPdsU+W7xMqgC7WwTVi7hiKHadeXAWnrLM6caI36dFF0NF6ZSJa\nDNVSaO7AZbR2+4lVl6pCa98ydZ12PEeVtuvj33hTMwBKK7LTAXuZATeV\n-----END CERTIFICATE-----\n"}]': finished 2021-03-10T13:48:09.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:09 gibba013 bash[13024]: audit 2021-03-10T13:48:08.639388+0000 mon.a (mon.0) 510 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvwIBADANBgkqhkiG9w0BAQEFAASCBKkwggSlAgEAAoIBAQCUX6SU1OEaT3Ia\nIfuXG4nv2W8pLCuUB9vavQGmepZsq9sVaCA1Hc+qYfJYq8XEkF9O368gp7i/noiq\nqgm8dzCaiSb9ImO1wKutqSHuKpVhJMcLHuKa9CpK6wemHnAr7BVkqi3vwCmtkdNC\n4HqL3K/VBkSmMBAo5vSRhQ9iFamWwvNSxEdYaYUBENDmfJ2hXWcsn91y0N6/7doF\noJorhM+Q2wWyP0B9cKUWCEk3POBkjyWDavuCIInWyYHcEpk7raSslc3XIORcKTlp\n4rCIAfsjBhqtHk0cohuy9pjXIO4oQ+wTPAcEZ6XoZ/AAQ8WEoCJL9nT4oqid9VBP\nnMqeXUbfAgMBAAECggEAfgohTSzpa+hBDWIAzwRd0JnsjBUxj7Z9VPtqA3nvfrEe\nkri5Y2XHmv1JWXnRroDV9bKemibgEiciAZggXTEC4MPRkwc7nJHnRMaAREl4S+Vq\nEFBUPz1bD/lHrh39O9J4+eJ200tyHDfcNttqPpVh6JxChMofcB+BcnyN7MxqG96E\noivTvpXAL3sPRXgBaBIBHTV3pipQjnDg73qXIWbNYmeTliH4PxYy3Nsj+yq4OY5e\nl8a6RdPOcxekyjhwCxKdeZQMVAFjVPPRmcDYuzdbxvmSNCeodInhJQVywrgR2+HR\nuiUMrMmG8dPtTFkpY/1qAX1GzpaxFHVhsljDo/JQwQKBgQDEwo9BHGB009dncPa8\nUZc2HwYtN9YoBEMsQ/I93yVRigdreHrUFqoccNVHnTPj7rXoQiD8drHhXNwGxdqo\n+X49rePd0hknoYijcWASrInor2Xpetg8ineHYc7rnwqcbiWsmRShlB9OaX690i6P\nwu5hNH7iQQoHNTikW9UwymiANQKBgQDBC6lte/bSkkNQOIibhsqslk6VgaNQY3H0\nyli6H5N6Tj5w2daahwILxst77QhFiUdOEz6CY8Q0ay9Uc7TuEmxt5D0AbSXLj8+u\nAPW/iRDjtAPXquOs5V4Xd6P7BclXCv7hNf5Pir2Z6t4ETjRz1Eb4m663HlEU3mN4\n0dnR1S31QwKBgQCo0iKmBBoCw2yzlWoupHbweegLzjfSt+2GwnnLenYDo0HAhWwm\nI5grtOhafNhz/nJX6L1ywMjZC5rBuOtnRkJ524SC4+yvY1rgmbuL6jydyDjR/pQg\nRdJO963Z3uj01VE/6UyZYoUF+2BCsF9A/EkaYDdqG9Hl41VJOH4QUesd7QKBgQCp\nH9ZnnNs4z/s5JM5Js2WMnoJqaRDzNKx5kWz6Yv+Jf1Mk+zQQXYdlWdybzaYZhZN6\ny1FQWqdiZSUqD9TLXkiwXe0zmmwqUuvXve+Oxj6NvwA+yfB9YNV2KdL38LHcGD4E\ngJE0jpBdcG7hxsIdWDR1Sa9frqfKaKstBmyWcPW6kQKBgQCFXO/YyLVEsySEPFFI\nUNRQf1O7N1VAT+Wy9aAc/hBT9cx5/BWfru+zBuirVAS7UgIu3lNy0jc/5Bz/xwfp\nDv0QSv+Mo1AV1M74F51SRH9GYEAltH5RzNED0nK1gYbfVkPIUy3cmiaiMzcHxMMP\nr9c9Yx6hgrm/ypPFoSN+0ZBUdA==\n-----END PRIVATE KEY-----\n"}]: dispatch 2021-03-10T13:48:09.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:09 gibba013 bash[13024]: audit 2021-03-10T13:48:08.642123+0000 mon.a (mon.0) 511 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvwIBADANBgkqhkiG9w0BAQEFAASCBKkwggSlAgEAAoIBAQCUX6SU1OEaT3Ia\nIfuXG4nv2W8pLCuUB9vavQGmepZsq9sVaCA1Hc+qYfJYq8XEkF9O368gp7i/noiq\nqgm8dzCaiSb9ImO1wKutqSHuKpVhJMcLHuKa9CpK6wemHnAr7BVkqi3vwCmtkdNC\n4HqL3K/VBkSmMBAo5vSRhQ9iFamWwvNSxEdYaYUBENDmfJ2hXWcsn91y0N6/7doF\noJorhM+Q2wWyP0B9cKUWCEk3POBkjyWDavuCIInWyYHcEpk7raSslc3XIORcKTlp\n4rCIAfsjBhqtHk0cohuy9pjXIO4oQ+wTPAcEZ6XoZ/AAQ8WEoCJL9nT4oqid9VBP\nnMqeXUbfAgMBAAECggEAfgohTSzpa+hBDWIAzwRd0JnsjBUxj7Z9VPtqA3nvfrEe\nkri5Y2XHmv1JWXnRroDV9bKemibgEiciAZggXTEC4MPRkwc7nJHnRMaAREl4S+Vq\nEFBUPz1bD/lHrh39O9J4+eJ200tyHDfcNttqPpVh6JxChMofcB+BcnyN7MxqG96E\noivTvpXAL3sPRXgBaBIBHTV3pipQjnDg73qXIWbNYmeTliH4PxYy3Nsj+yq4OY5e\nl8a6RdPOcxekyjhwCxKdeZQMVAFjVPPRmcDYuzdbxvmSNCeodInhJQVywrgR2+HR\nuiUMrMmG8dPtTFkpY/1qAX1GzpaxFHVhsljDo/JQwQKBgQDEwo9BHGB009dncPa8\nUZc2HwYtN9YoBEMsQ/I93yVRigdreHrUFqoccNVHnTPj7rXoQiD8drHhXNwGxdqo\n+X49rePd0hknoYijcWASrInor2Xpetg8ineHYc7rnwqcbiWsmRShlB9OaX690i6P\nwu5hNH7iQQoHNTikW9UwymiANQKBgQDBC6lte/bSkkNQOIibhsqslk6VgaNQY3H0\nyli6H5N6Tj5w2daahwILxst77QhFiUdOEz6CY8Q0ay9Uc7TuEmxt5D0AbSXLj8+u\nAPW/iRDjtAPXquOs5V4Xd6P7BclXCv7hNf5Pir2Z6t4ETjRz1Eb4m663HlEU3mN4\n0dnR1S31QwKBgQCo0iKmBBoCw2yzlWoupHbweegLzjfSt+2GwnnLenYDo0HAhWwm\nI5grtOhafNhz/nJX6L1ywMjZC5rBuOtnRkJ524SC4+yvY1rgmbuL6jydyDjR/pQg\nRdJO963Z3uj01VE/6UyZYoUF+2BCsF9A/EkaYDdqG9Hl41VJOH4QUesd7QKBgQCp\nH9ZnnNs4z/s5JM5Js2WMnoJqaRDzNKx5kWz6Yv+Jf1Mk+zQQXYdlWdybzaYZhZN6\ny1FQWqdiZSUqD9TLXkiwXe0zmmwqUuvXve+Oxj6NvwA+yfB9YNV2KdL38LHcGD4E\ngJE0jpBdcG7hxsIdWDR1Sa9frqfKaKstBmyWcPW6kQKBgQCFXO/YyLVEsySEPFFI\nUNRQf1O7N1VAT+Wy9aAc/hBT9cx5/BWfru+zBuirVAS7UgIu3lNy0jc/5Bz/xwfp\nDv0QSv+Mo1AV1M74F51SRH9GYEAltH5RzNED0nK1gYbfVkPIUy3cmiaiMzcHxMMP\nr9c9Yx6hgrm/ypPFoSN+0ZBUdA==\n-----END PRIVATE KEY-----\n"}]': finished 2021-03-10T13:48:09.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:09 gibba013 bash[13024]: cephadm 2021-03-10T13:48:08.642675+0000 mgr.y (mgr.14140) 184 : cephadm [INF] Deploying daemon grafana.a on gibba020 2021-03-10T13:48:09.881 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:48:09 gibba013 bash[20331]: level=info ts=2021-03-10T13:48:09.700Z caller=cluster.go:648 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000082277s 2021-03-10T13:48:09.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:09 gibba020 bash[9782]: cluster 2021-03-10T13:48:08.468260+0000 mgr.y (mgr.14140) 183 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:09.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:09 gibba020 bash[9782]: audit 2021-03-10T13:48:08.555718+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554222\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554310\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554358\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554404\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554447\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554489\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554531\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"157beacd603d\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554574\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:47:55.252546\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554616\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:47:41.497315\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}}, \"last_daemon_update\": \"2021-03-10T13:48:08.554714\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:48:09.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:09 gibba020 bash[9782]: audit 2021-03-10T13:48:08.559463+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554222\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554310\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554358\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554404\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554447\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554489\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554531\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"157beacd603d\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554574\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:47:55.252546\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554616\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:47:41.497315\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}}, \"last_daemon_update\": \"2021-03-10T13:48:08.554714\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:48:09.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:09 gibba020 bash[9782]: audit 2021-03-10T13:48:08.560584+0000 mon.a (mon.0) 506 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T13:48:09.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:09 gibba020 bash[9782]: audit 2021-03-10T13:48:08.564551+0000 mon.a (mon.0) 507 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-03-10T13:48:09.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:09 gibba020 bash[9782]: audit 2021-03-10T13:48:08.564559+0000 mon.b (mon.2) 22 : audit [INF] from='client.? 172.21.2.120:0/716506105' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T13:48:09.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:09 gibba020 bash[9782]: audit 2021-03-10T13:48:08.635953+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxjCCAa4CEQCMJ73Rj4JHTrxNlUBM+iJyMA0GCSqGSIb3DQEBDQUAMCExDTAL\nBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0wHhcNMjEwMzEwMTM0ODA4WhcN\nMzEwMzA4MTM0ODA4WjAhMQ0wCwYDVQQKDARDZXBoMRAwDgYDVQQDDAdjZXBoYWRt\nMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAlF+klNThGk9yGiH7lxuJ\n79lvKSwrlAfb2r0BpnqWbKvbFWggNR3PqmHyWKvFxJBfTt+vIKe4v56IqqoJvHcw\nmokm/SJjtcCrrakh7iqVYSTHCx7imvQqSusHph5wK+wVZKot78AprZHTQuB6i9yv\n1QZEpjAQKOb0kYUPYhWplsLzUsRHWGmFARDQ5nydoV1nLJ/dctDev+3aBaCaK4TP\nkNsFsj9AfXClFghJNzzgZI8lg2r7giCJ1smB3BKZO62krJXN1yDkXCk5aeKwiAH7\nIwYarR5NHKIbsvaY1yDuKEPsEzwHBGel6GfwAEPFhKAiS/Z0+KKonfVQT5zKnl1G\n3wIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQBcixco7AcmV/Fr0SwWnrx0Ns3BCK2w\n1Uq8GTr/NT9ZTPPyUt8UcZ/PxnXSFr8UhCuBOvaMn5PUrONBbhZdIsJf08bkGuS3\nim9gJBAVdERdGcTevhTg8vKX9PHgdJCPvZ1mQb/BWjmKve/yN4a4ZxC3o+Tp9KIg\neGFdqjLRTdZGQGz6QL/xPwA6zMgxEkRDCwsbWRrepBnd4XMkVtcY3iWNkmil7unK\nWkIcQCAGqoANvUPdsU+W7xMqgC7WwTVi7hiKHadeXAWnrLM6caI36dFF0NF6ZSJa\nDNVSaO7AZbR2+4lVl6pCa98ydZ12PEeVtuvj33hTMwBKK7LTAXuZATeV\n-----END CERTIFICATE-----\n"}]: dispatch 2021-03-10T13:48:09.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:09 gibba020 bash[9782]: audit 2021-03-10T13:48:08.638931+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxjCCAa4CEQCMJ73Rj4JHTrxNlUBM+iJyMA0GCSqGSIb3DQEBDQUAMCExDTAL\nBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0wHhcNMjEwMzEwMTM0ODA4WhcN\nMzEwMzA4MTM0ODA4WjAhMQ0wCwYDVQQKDARDZXBoMRAwDgYDVQQDDAdjZXBoYWRt\nMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAlF+klNThGk9yGiH7lxuJ\n79lvKSwrlAfb2r0BpnqWbKvbFWggNR3PqmHyWKvFxJBfTt+vIKe4v56IqqoJvHcw\nmokm/SJjtcCrrakh7iqVYSTHCx7imvQqSusHph5wK+wVZKot78AprZHTQuB6i9yv\n1QZEpjAQKOb0kYUPYhWplsLzUsRHWGmFARDQ5nydoV1nLJ/dctDev+3aBaCaK4TP\nkNsFsj9AfXClFghJNzzgZI8lg2r7giCJ1smB3BKZO62krJXN1yDkXCk5aeKwiAH7\nIwYarR5NHKIbsvaY1yDuKEPsEzwHBGel6GfwAEPFhKAiS/Z0+KKonfVQT5zKnl1G\n3wIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQBcixco7AcmV/Fr0SwWnrx0Ns3BCK2w\n1Uq8GTr/NT9ZTPPyUt8UcZ/PxnXSFr8UhCuBOvaMn5PUrONBbhZdIsJf08bkGuS3\nim9gJBAVdERdGcTevhTg8vKX9PHgdJCPvZ1mQb/BWjmKve/yN4a4ZxC3o+Tp9KIg\neGFdqjLRTdZGQGz6QL/xPwA6zMgxEkRDCwsbWRrepBnd4XMkVtcY3iWNkmil7unK\nWkIcQCAGqoANvUPdsU+W7xMqgC7WwTVi7hiKHadeXAWnrLM6caI36dFF0NF6ZSJa\nDNVSaO7AZbR2+4lVl6pCa98ydZ12PEeVtuvj33hTMwBKK7LTAXuZATeV\n-----END CERTIFICATE-----\n"}]': finished 2021-03-10T13:48:09.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:09 gibba020 bash[9782]: audit 2021-03-10T13:48:08.639388+0000 mon.a (mon.0) 510 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvwIBADANBgkqhkiG9w0BAQEFAASCBKkwggSlAgEAAoIBAQCUX6SU1OEaT3Ia\nIfuXG4nv2W8pLCuUB9vavQGmepZsq9sVaCA1Hc+qYfJYq8XEkF9O368gp7i/noiq\nqgm8dzCaiSb9ImO1wKutqSHuKpVhJMcLHuKa9CpK6wemHnAr7BVkqi3vwCmtkdNC\n4HqL3K/VBkSmMBAo5vSRhQ9iFamWwvNSxEdYaYUBENDmfJ2hXWcsn91y0N6/7doF\noJorhM+Q2wWyP0B9cKUWCEk3POBkjyWDavuCIInWyYHcEpk7raSslc3XIORcKTlp\n4rCIAfsjBhqtHk0cohuy9pjXIO4oQ+wTPAcEZ6XoZ/AAQ8WEoCJL9nT4oqid9VBP\nnMqeXUbfAgMBAAECggEAfgohTSzpa+hBDWIAzwRd0JnsjBUxj7Z9VPtqA3nvfrEe\nkri5Y2XHmv1JWXnRroDV9bKemibgEiciAZggXTEC4MPRkwc7nJHnRMaAREl4S+Vq\nEFBUPz1bD/lHrh39O9J4+eJ200tyHDfcNttqPpVh6JxChMofcB+BcnyN7MxqG96E\noivTvpXAL3sPRXgBaBIBHTV3pipQjnDg73qXIWbNYmeTliH4PxYy3Nsj+yq4OY5e\nl8a6RdPOcxekyjhwCxKdeZQMVAFjVPPRmcDYuzdbxvmSNCeodInhJQVywrgR2+HR\nuiUMrMmG8dPtTFkpY/1qAX1GzpaxFHVhsljDo/JQwQKBgQDEwo9BHGB009dncPa8\nUZc2HwYtN9YoBEMsQ/I93yVRigdreHrUFqoccNVHnTPj7rXoQiD8drHhXNwGxdqo\n+X49rePd0hknoYijcWASrInor2Xpetg8ineHYc7rnwqcbiWsmRShlB9OaX690i6P\nwu5hNH7iQQoHNTikW9UwymiANQKBgQDBC6lte/bSkkNQOIibhsqslk6VgaNQY3H0\nyli6H5N6Tj5w2daahwILxst77QhFiUdOEz6CY8Q0ay9Uc7TuEmxt5D0AbSXLj8+u\nAPW/iRDjtAPXquOs5V4Xd6P7BclXCv7hNf5Pir2Z6t4ETjRz1Eb4m663HlEU3mN4\n0dnR1S31QwKBgQCo0iKmBBoCw2yzlWoupHbweegLzjfSt+2GwnnLenYDo0HAhWwm\nI5grtOhafNhz/nJX6L1ywMjZC5rBuOtnRkJ524SC4+yvY1rgmbuL6jydyDjR/pQg\nRdJO963Z3uj01VE/6UyZYoUF+2BCsF9A/EkaYDdqG9Hl41VJOH4QUesd7QKBgQCp\nH9ZnnNs4z/s5JM5Js2WMnoJqaRDzNKx5kWz6Yv+Jf1Mk+zQQXYdlWdybzaYZhZN6\ny1FQWqdiZSUqD9TLXkiwXe0zmmwqUuvXve+Oxj6NvwA+yfB9YNV2KdL38LHcGD4E\ngJE0jpBdcG7hxsIdWDR1Sa9frqfKaKstBmyWcPW6kQKBgQCFXO/YyLVEsySEPFFI\nUNRQf1O7N1VAT+Wy9aAc/hBT9cx5/BWfru+zBuirVAS7UgIu3lNy0jc/5Bz/xwfp\nDv0QSv+Mo1AV1M74F51SRH9GYEAltH5RzNED0nK1gYbfVkPIUy3cmiaiMzcHxMMP\nr9c9Yx6hgrm/ypPFoSN+0ZBUdA==\n-----END PRIVATE KEY-----\n"}]: dispatch 2021-03-10T13:48:09.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:09 gibba020 bash[9782]: audit 2021-03-10T13:48:08.642123+0000 mon.a (mon.0) 511 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvwIBADANBgkqhkiG9w0BAQEFAASCBKkwggSlAgEAAoIBAQCUX6SU1OEaT3Ia\nIfuXG4nv2W8pLCuUB9vavQGmepZsq9sVaCA1Hc+qYfJYq8XEkF9O368gp7i/noiq\nqgm8dzCaiSb9ImO1wKutqSHuKpVhJMcLHuKa9CpK6wemHnAr7BVkqi3vwCmtkdNC\n4HqL3K/VBkSmMBAo5vSRhQ9iFamWwvNSxEdYaYUBENDmfJ2hXWcsn91y0N6/7doF\noJorhM+Q2wWyP0B9cKUWCEk3POBkjyWDavuCIInWyYHcEpk7raSslc3XIORcKTlp\n4rCIAfsjBhqtHk0cohuy9pjXIO4oQ+wTPAcEZ6XoZ/AAQ8WEoCJL9nT4oqid9VBP\nnMqeXUbfAgMBAAECggEAfgohTSzpa+hBDWIAzwRd0JnsjBUxj7Z9VPtqA3nvfrEe\nkri5Y2XHmv1JWXnRroDV9bKemibgEiciAZggXTEC4MPRkwc7nJHnRMaAREl4S+Vq\nEFBUPz1bD/lHrh39O9J4+eJ200tyHDfcNttqPpVh6JxChMofcB+BcnyN7MxqG96E\noivTvpXAL3sPRXgBaBIBHTV3pipQjnDg73qXIWbNYmeTliH4PxYy3Nsj+yq4OY5e\nl8a6RdPOcxekyjhwCxKdeZQMVAFjVPPRmcDYuzdbxvmSNCeodInhJQVywrgR2+HR\nuiUMrMmG8dPtTFkpY/1qAX1GzpaxFHVhsljDo/JQwQKBgQDEwo9BHGB009dncPa8\nUZc2HwYtN9YoBEMsQ/I93yVRigdreHrUFqoccNVHnTPj7rXoQiD8drHhXNwGxdqo\n+X49rePd0hknoYijcWASrInor2Xpetg8ineHYc7rnwqcbiWsmRShlB9OaX690i6P\nwu5hNH7iQQoHNTikW9UwymiANQKBgQDBC6lte/bSkkNQOIibhsqslk6VgaNQY3H0\nyli6H5N6Tj5w2daahwILxst77QhFiUdOEz6CY8Q0ay9Uc7TuEmxt5D0AbSXLj8+u\nAPW/iRDjtAPXquOs5V4Xd6P7BclXCv7hNf5Pir2Z6t4ETjRz1Eb4m663HlEU3mN4\n0dnR1S31QwKBgQCo0iKmBBoCw2yzlWoupHbweegLzjfSt+2GwnnLenYDo0HAhWwm\nI5grtOhafNhz/nJX6L1ywMjZC5rBuOtnRkJ524SC4+yvY1rgmbuL6jydyDjR/pQg\nRdJO963Z3uj01VE/6UyZYoUF+2BCsF9A/EkaYDdqG9Hl41VJOH4QUesd7QKBgQCp\nH9ZnnNs4z/s5JM5Js2WMnoJqaRDzNKx5kWz6Yv+Jf1Mk+zQQXYdlWdybzaYZhZN6\ny1FQWqdiZSUqD9TLXkiwXe0zmmwqUuvXve+Oxj6NvwA+yfB9YNV2KdL38LHcGD4E\ngJE0jpBdcG7hxsIdWDR1Sa9frqfKaKstBmyWcPW6kQKBgQCFXO/YyLVEsySEPFFI\nUNRQf1O7N1VAT+Wy9aAc/hBT9cx5/BWfru+zBuirVAS7UgIu3lNy0jc/5Bz/xwfp\nDv0QSv+Mo1AV1M74F51SRH9GYEAltH5RzNED0nK1gYbfVkPIUy3cmiaiMzcHxMMP\nr9c9Yx6hgrm/ypPFoSN+0ZBUdA==\n-----END PRIVATE KEY-----\n"}]': finished 2021-03-10T13:48:09.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:09 gibba020 bash[9782]: cephadm 2021-03-10T13:48:08.642675+0000 mgr.y (mgr.14140) 184 : cephadm [INF] Deploying daemon grafana.a on gibba020 2021-03-10T13:48:11.844 INFO:teuthology.orchestra.run.gibba013.stdout: 2021-03-10T13:48:11.845 INFO:teuthology.orchestra.run.gibba013.stdout:{"epoch":48,"fsid":"7672acc8-81a6-11eb-9080-001a4aab830c","created":"2021-03-10T13:42:55.242911+0000","modified":"2021-03-10T13:47:44.530544+0000","last_up_change":"2021-03-10T13:47:43.514810+0000","last_in_change":"2021-03-10T13:47:43.514810+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-10T13:43:05.278362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6802","nonce":1746855808},{"type":"v1","addr":"172.21.2.113:6803","nonce":1746855808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6804","nonce":1746855808},{"type":"v1","addr":"172.21.2.113:6805","nonce":1746855808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6808","nonce":1746855808},{"type":"v1","addr":"172.21.2.113:6809","nonce":1746855808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6806","nonce":1746855808},{"type":"v1","addr":"172.21.2.113:6807","nonce":1746855808}]},"public_addr":"172.21.2.113:6803/1746855808","cluster_addr":"172.21.2.113:6805/1746855808","heartbeat_back_addr":"172.21.2.113:6809/1746855808","heartbeat_front_addr":"172.21.2.113:6807/1746855808","state":["exists","up"]},{"osd":1,"uuid":"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6810","nonce":1501662462},{"type":"v1","addr":"172.21.2.113:6811","nonce":1501662462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6812","nonce":1501662462},{"type":"v1","addr":"172.21.2.113:6813","nonce":1501662462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6816","nonce":1501662462},{"type":"v1","addr":"172.21.2.113:6817","nonce":1501662462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6814","nonce":1501662462},{"type":"v1","addr":"172.21.2.113:6815","nonce":1501662462}]},"public_addr":"172.21.2.113:6811/1501662462","cluster_addr":"172.21.2.113:6813/1501662462","heartbeat_back_addr":"172.21.2.113:6817/1501662462","heartbeat_front_addr":"172.21.2.113:6815/1501662462","state":["exists","up"]},{"osd":2,"uuid":"13edbbb8-76dd-40bc-bb99-7e4b3612e855","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6818","nonce":3189642125},{"type":"v1","addr":"172.21.2.113:6819","nonce":3189642125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6820","nonce":3189642125},{"type":"v1","addr":"172.21.2.113:6821","nonce":3189642125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6824","nonce":3189642125},{"type":"v1","addr":"172.21.2.113:6825","nonce":3189642125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6822","nonce":3189642125},{"type":"v1","addr":"172.21.2.113:6823","nonce":3189642125}]},"public_addr":"172.21.2.113:6819/3189642125","cluster_addr":"172.21.2.113:6821/3189642125","heartbeat_back_addr":"172.21.2.113:6825/3189642125","heartbeat_front_addr":"172.21.2.113:6823/3189642125","state":["exists","up"]},{"osd":3,"uuid":"6d982c1b-253a-4416-814a-f14b580f5c6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6826","nonce":144091957},{"type":"v1","addr":"172.21.2.113:6827","nonce":144091957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6828","nonce":144091957},{"type":"v1","addr":"172.21.2.113:6829","nonce":144091957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6832","nonce":144091957},{"type":"v1","addr":"172.21.2.113:6833","nonce":144091957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6830","nonce":144091957},{"type":"v1","addr":"172.21.2.113:6831","nonce":144091957}]},"public_addr":"172.21.2.113:6827/144091957","cluster_addr":"172.21.2.113:6829/144091957","heartbeat_back_addr":"172.21.2.113:6833/144091957","heartbeat_front_addr":"172.21.2.113:6831/144091957","state":["exists","up"]},{"osd":4,"uuid":"e1ee562f-9cbb-49d7-864e-764dd41860fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6800","nonce":319375890},{"type":"v1","addr":"172.21.2.120:6801","nonce":319375890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6802","nonce":319375890},{"type":"v1","addr":"172.21.2.120:6803","nonce":319375890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6806","nonce":319375890},{"type":"v1","addr":"172.21.2.120:6807","nonce":319375890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6804","nonce":319375890},{"type":"v1","addr":"172.21.2.120:6805","nonce":319375890}]},"public_addr":"172.21.2.120:6801/319375890","cluster_addr":"172.21.2.120:6803/319375890","heartbeat_back_addr":"172.21.2.120:6807/319375890","heartbeat_front_addr":"172.21.2.120:6805/319375890","state":["exists","up"]},{"osd":5,"uuid":"81a906b6-e201-49ad-ae65-0e049d746e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6808","nonce":3595534437},{"type":"v1","addr":"172.21.2.120:6809","nonce":3595534437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6810","nonce":3595534437},{"type":"v1","addr":"172.21.2.120:6811","nonce":3595534437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6814","nonce":3595534437},{"type":"v1","addr":"172.21.2.120:6815","nonce":3595534437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6812","nonce":3595534437},{"type":"v1","addr":"172.21.2.120:6813","nonce":3595534437}]},"public_addr":"172.21.2.120:6809/3595534437","cluster_addr":"172.21.2.120:6811/3595534437","heartbeat_back_addr":"172.21.2.120:6815/3595534437","heartbeat_front_addr":"172.21.2.120:6813/3595534437","state":["exists","up"]},{"osd":6,"uuid":"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6816","nonce":1328382283},{"type":"v1","addr":"172.21.2.120:6817","nonce":1328382283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6818","nonce":1328382283},{"type":"v1","addr":"172.21.2.120:6819","nonce":1328382283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6822","nonce":1328382283},{"type":"v1","addr":"172.21.2.120:6823","nonce":1328382283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6820","nonce":1328382283},{"type":"v1","addr":"172.21.2.120:6821","nonce":1328382283}]},"public_addr":"172.21.2.120:6817/1328382283","cluster_addr":"172.21.2.120:6819/1328382283","heartbeat_back_addr":"172.21.2.120:6823/1328382283","heartbeat_front_addr":"172.21.2.120:6821/1328382283","state":["exists","up"]},{"osd":7,"uuid":"6b05701f-f937-4752-bbf7-a7196766d792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6824","nonce":1421523901},{"type":"v1","addr":"172.21.2.120:6825","nonce":1421523901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6826","nonce":1421523901},{"type":"v1","addr":"172.21.2.120:6827","nonce":1421523901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6830","nonce":1421523901},{"type":"v1","addr":"172.21.2.120:6831","nonce":1421523901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6828","nonce":1421523901},{"type":"v1","addr":"172.21.2.120:6829","nonce":1421523901}]},"public_addr":"172.21.2.120:6825/1421523901","cluster_addr":"172.21.2.120:6827/1421523901","heartbeat_back_addr":"172.21.2.120:6831/1421523901","heartbeat_front_addr":"172.21.2.120:6829/1421523901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:45:02.571014+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:45:24.822597+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:45:47.841278+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:46:10.640903+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:46:31.489218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:46:54.345984+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:47:17.218312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:47:41.487719+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.2.113:0/2867408781":"2021-03-11T13:43:25.864383+0000","172.21.2.113:0/4101755549":"2021-03-11T13:43:25.864383+0000","172.21.2.113:6801/2579871074":"2021-03-11T13:43:25.864383+0000","172.21.2.113:6800/2579871074":"2021-03-11T13:43:25.864383+0000","172.21.2.113:0/2306552835":"2021-03-11T13:43:12.108225+0000","172.21.2.113:6800/2562375199":"2021-03-11T13:43:12.108225+0000","172.21.2.113:0/1865931294":"2021-03-11T13:43:25.864383+0000","172.21.2.113:6801/2562375199":"2021-03-11T13:43:12.108225+0000","172.21.2.113:0/1874002260":"2021-03-11T13:43:12.108225+0000","172.21.2.113:0/2911839215":"2021-03-11T13:43:12.108225+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-03-10T13:48:11.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:11 gibba013 bash[9767]: cluster 2021-03-10T13:48:10.468671+0000 mgr.y (mgr.14140) 185 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:11.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:11 gibba013 bash[13024]: cluster 2021-03-10T13:48:10.468671+0000 mgr.y (mgr.14140) 185 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:11.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:11 gibba020 bash[9782]: cluster 2021-03-10T13:48:10.468671+0000 mgr.y (mgr.14140) 185 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:12.381 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-03-10T13:43:05.278362+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}] 2021-03-10T13:48:12.382 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph osd pool get device_health_metrics pg_num 2021-03-10T13:48:12.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:12 gibba013 bash[9767]: audit 2021-03-10T13:48:11.841569+0000 mon.a (mon.0) 512 : audit [DBG] from='client.? 172.21.2.113:0/1871935757' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T13:48:12.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:12 gibba013 bash[13024]: audit 2021-03-10T13:48:11.841569+0000 mon.a (mon.0) 512 : audit [DBG] from='client.? 172.21.2.113:0/1871935757' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T13:48:12.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:12 gibba020 bash[9782]: audit 2021-03-10T13:48:11.841569+0000 mon.a (mon.0) 512 : audit [DBG] from='client.? 172.21.2.113:0/1871935757' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T13:48:13.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:13 gibba013 bash[9767]: cluster 2021-03-10T13:48:12.468905+0000 mgr.y (mgr.14140) 186 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:13.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:13 gibba013 bash[13024]: cluster 2021-03-10T13:48:12.468905+0000 mgr.y (mgr.14140) 186 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:13.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:13 gibba020 bash[9782]: cluster 2021-03-10T13:48:12.468905+0000 mgr.y (mgr.14140) 186 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:15.157 INFO:teuthology.orchestra.run.gibba013.stdout:pg_num: 1 2021-03-10T13:48:15.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:15 gibba013 bash[9767]: cluster 2021-03-10T13:48:14.469653+0000 mgr.y (mgr.14140) 187 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:15.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:15 gibba013 bash[9767]: audit 2021-03-10T13:48:15.154446+0000 mon.a (mon.0) 513 : audit [DBG] from='client.? 172.21.2.113:0/2831679393' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2021-03-10T13:48:15.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:15 gibba013 bash[13024]: cluster 2021-03-10T13:48:14.469653+0000 mgr.y (mgr.14140) 187 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:15.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:15 gibba013 bash[13024]: audit 2021-03-10T13:48:15.154446+0000 mon.a (mon.0) 513 : audit [DBG] from='client.? 172.21.2.113:0/2831679393' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2021-03-10T13:48:15.681 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2021-03-10T13:48:15.682 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2021-03-10T13:48:15.683 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph mgr dump --format=json 2021-03-10T13:48:15.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:15 gibba020 bash[9782]: cluster 2021-03-10T13:48:14.469653+0000 mgr.y (mgr.14140) 187 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:15.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:15 gibba020 bash[9782]: audit 2021-03-10T13:48:15.154446+0000 mon.a (mon.0) 513 : audit [DBG] from='client.? 172.21.2.113:0/2831679393' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2021-03-10T13:48:17.703 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:17 gibba013 bash[9767]: cluster 2021-03-10T13:48:16.470105+0000 mgr.y (mgr.14140) 188 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:17.704 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:17 gibba013 bash[13024]: cluster 2021-03-10T13:48:16.470105+0000 mgr.y (mgr.14140) 188 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:17.764 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:17 gibba020 bash[9782]: cluster 2021-03-10T13:48:16.470105+0000 mgr.y (mgr.14140) 188 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:18.132 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:48:17 gibba013 bash[20331]: level=info ts=2021-03-10T13:48:17.701Z caller=cluster.go:640 component=cluster msg="gossip settled; proceeding" elapsed=10.000961332s 2021-03-10T13:48:18.421 INFO:teuthology.orchestra.run.gibba013.stdout: 2021-03-10T13:48:18.762 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:18 gibba020 bash[9782]: audit 2021-03-10T13:48:18.413767+0000 mon.c (mon.1) 12 : audit [DBG] from='client.? 172.21.2.113:0/3197095695' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-03-10T13:48:18.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:18 gibba013 bash[9767]: audit 2021-03-10T13:48:18.413767+0000 mon.c (mon.1) 12 : audit [DBG] from='client.? 172.21.2.113:0/3197095695' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-03-10T13:48:18.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:18 gibba013 bash[13024]: audit 2021-03-10T13:48:18.413767+0000 mon.c (mon.1) 12 : audit [DBG] from='client.? 172.21.2.113:0/3197095695' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-03-10T13:48:19.032 INFO:teuthology.orchestra.run.gibba013.stdout:{"epoch":15,"active_gid":14140,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6800","nonce":3319171079},{"type":"v1","addr":"172.21.2.113:6801","nonce":3319171079}]},"active_addr":"172.21.2.113:6801/3319171079","active_change":"2021-03-10T13:43:25.864851+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[{"gid":34109,"name":"x","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":34115,"name":"gibba020.yqfnwy","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://gibba013:8443/"},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","osd_support","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":5,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.2.113:0","nonce":4168289805}]},{"addrvec":[{"type":"v2","addr":"172.21.2.113:0","nonce":2799569892}]},{"addrvec":[{"type":"v2","addr":"172.21.2.113:0","nonce":2336946415}]}]}} 2021-03-10T13:48:19.037 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2021-03-10T13:48:19.037 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2021-03-10T13:48:19.037 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph osd dump --format=json 2021-03-10T13:48:19.195 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:18 gibba020 docker[19066]: Error: No such container: ceph-7672acc8-81a6-11eb-9080-001a4aab830c-grafana.a 2021-03-10T13:48:19.195 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:18 gibba020 systemd[1]: Started Ceph grafana.a for 7672acc8-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:48:19.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:19 gibba013 bash[9767]: cluster 2021-03-10T13:48:18.470338+0000 mgr.y (mgr.14140) 189 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:19.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:19 gibba013 bash[13024]: cluster 2021-03-10T13:48:18.470338+0000 mgr.y (mgr.14140) 189 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:19.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:19 gibba013 bash[9767]: audit 2021-03-10T13:48:18.794511+0000 mon.a (mon.0) 514 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554222\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554310\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554358\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554404\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554447\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554489\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554531\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"157beacd603d\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554574\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:47:55.252546\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554616\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:47:41.497315\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:48:19.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:19 gibba013 bash[9767]: audit 2021-03-10T13:48:18.803418+0000 mon.a (mon.0) 515 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554222\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554310\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554358\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554404\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554447\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554489\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554531\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"157beacd603d\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554574\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:47:55.252546\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554616\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:47:41.497315\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:48:19.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:19 gibba013 bash[9767]: audit 2021-03-10T13:48:18.804267+0000 mon.a (mon.0) 516 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:48:19.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:19 gibba013 bash[13024]: audit 2021-03-10T13:48:18.794511+0000 mon.a (mon.0) 514 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554222\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554310\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554358\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554404\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554447\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554489\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554531\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"157beacd603d\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554574\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:47:55.252546\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554616\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:47:41.497315\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:48:19.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:19 gibba013 bash[13024]: audit 2021-03-10T13:48:18.803418+0000 mon.a (mon.0) 515 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554222\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554310\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554358\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554404\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554447\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554489\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554531\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"157beacd603d\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554574\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:47:55.252546\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554616\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:47:41.497315\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:48:19.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:19 gibba013 bash[13024]: audit 2021-03-10T13:48:18.804267+0000 mon.a (mon.0) 516 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:48:19.810 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:19 gibba020 bash[9782]: cluster 2021-03-10T13:48:18.470338+0000 mgr.y (mgr.14140) 189 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:19.811 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:19 gibba020 bash[19086]: t=2021-03-10T13:48:19+0000 lvl=info msg="Starting Grafana" logger=server version=6.6.2 commit=3fa63cfc34 branch=HEAD compiled=2020-02-20T12:03:49+0000 2021-03-10T13:48:19.811 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:19 gibba020 bash[19086]: t=2021-03-10T13:48:19+0000 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini 2021-03-10T13:48:19.811 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:19 gibba020 bash[19086]: t=2021-03-10T13:48:19+0000 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini 2021-03-10T13:48:19.812 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:19 gibba020 bash[19086]: t=2021-03-10T13:48:19+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_DATA=/var/lib/grafana" 2021-03-10T13:48:19.812 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:19 gibba020 bash[19086]: t=2021-03-10T13:48:19+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_LOGS=/var/log/grafana" 2021-03-10T13:48:19.812 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:19 gibba020 bash[19086]: t=2021-03-10T13:48:19+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2021-03-10T13:48:19.812 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:19 gibba020 bash[19086]: t=2021-03-10T13:48:19+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2021-03-10T13:48:19.812 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:19 gibba020 bash[19086]: t=2021-03-10T13:48:19+0000 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana 2021-03-10T13:48:19.813 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:19 gibba020 bash[19086]: t=2021-03-10T13:48:19+0000 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana 2021-03-10T13:48:19.813 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:19 gibba020 bash[19086]: t=2021-03-10T13:48:19+0000 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana 2021-03-10T13:48:19.813 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:19 gibba020 bash[19086]: t=2021-03-10T13:48:19+0000 lvl=info msg="Path Plugins" logger=settings path=/var/lib/grafana/plugins 2021-03-10T13:48:19.813 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:19 gibba020 bash[19086]: t=2021-03-10T13:48:19+0000 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning 2021-03-10T13:48:19.813 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:19 gibba020 bash[19086]: t=2021-03-10T13:48:19+0000 lvl=info msg="App mode production" logger=settings 2021-03-10T13:48:19.814 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:19 gibba020 bash[19086]: t=2021-03-10T13:48:19+0000 lvl=info msg="Initializing SqlStore" logger=server 2021-03-10T13:48:19.814 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:19 gibba020 bash[19086]: t=2021-03-10T13:48:19+0000 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3 2021-03-10T13:48:19.814 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:19 gibba020 bash[19086]: t=2021-03-10T13:48:19+0000 lvl=info msg="Starting DB migration" logger=migrator 2021-03-10T13:48:19.814 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:19 gibba020 bash[19086]: t=2021-03-10T13:48:19+0000 lvl=info msg="Executing migration" logger=migrator id="create migration_log table" 2021-03-10T13:48:19.814 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:19 gibba020 bash[19086]: t=2021-03-10T13:48:19+0000 lvl=info msg="Executing migration" logger=migrator id="create user table" 2021-03-10T13:48:19.815 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:19 gibba020 bash[9782]: audit 2021-03-10T13:48:18.794511+0000 mon.a (mon.0) 514 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554222\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554310\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554358\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554404\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554447\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554489\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554531\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"157beacd603d\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554574\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:47:55.252546\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554616\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:47:41.497315\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:48:19.815 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:19 gibba020 bash[9782]: audit 2021-03-10T13:48:18.803418+0000 mon.a (mon.0) 515 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554222\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554310\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554358\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554404\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554447\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554489\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554531\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"157beacd603d\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554574\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:47:55.252546\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:08.554616\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:47:41.497315\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:48:19.815 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:19 gibba020 bash[9782]: audit 2021-03-10T13:48:18.804267+0000 mon.a (mon.0) 516 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:48:20.068 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:19 gibba020 bash[19086]: t=2021-03-10T13:48:19+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.login" 2021-03-10T13:48:20.069 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:19 gibba020 bash[19086]: t=2021-03-10T13:48:19+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.email" 2021-03-10T13:48:20.069 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:19 gibba020 bash[19086]: t=2021-03-10T13:48:19+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_login - v1" 2021-03-10T13:48:20.328 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:20 gibba020 bash[19086]: t=2021-03-10T13:48:20+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_email - v1" 2021-03-10T13:48:20.329 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:20 gibba020 bash[19086]: t=2021-03-10T13:48:20+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table user to user_v1 - v1" 2021-03-10T13:48:20.329 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:20 gibba020 bash[19086]: t=2021-03-10T13:48:20+0000 lvl=info msg="Executing migration" logger=migrator id="create user table v2" 2021-03-10T13:48:20.329 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:20 gibba020 bash[19086]: t=2021-03-10T13:48:20+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_login - v2" 2021-03-10T13:48:20.606 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:20 gibba020 bash[19086]: t=2021-03-10T13:48:20+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_email - v2" 2021-03-10T13:48:20.607 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:20 gibba020 bash[19086]: t=2021-03-10T13:48:20+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2021-03-10T13:48:20.607 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:20 gibba020 bash[19086]: t=2021-03-10T13:48:20+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table user_v1" 2021-03-10T13:48:20.607 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:20 gibba020 bash[19086]: t=2021-03-10T13:48:20+0000 lvl=info msg="Executing migration" logger=migrator id="Add column help_flags1 to user table" 2021-03-10T13:48:20.608 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:20 gibba020 bash[9782]: audit 2021-03-10T13:48:19.903037+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902084\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902154\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902182\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902208\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902233\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902258\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902283\", \"created\": \"2021-03-10T13:46:03.738924\", \"started\": \"2021-03-10T13:46:06.962147\"}, \"node-exporter.a\": {\"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902308\", \"created\": \"2021-03-10T13:47:56.718923\", \"started\": \"2021-03-10T13:47:58.556074\"}, \"alertmanager.a\": {\"hostname\": \"gibba013\", \"container_id\": \"2e79d86dc29d\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902333\", \"created\": \"2021-03-10T13:48:06.706923\", \"started\": \"2021-03-10T13:48:06.734042\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.736195\"}}, \"last_daemon_update\": \"2021-03-10T13:48:19.902396\", \"last_device_update\": \"2021-03-10T13:46:10.457486\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:48:20.608 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:20 gibba020 bash[9782]: audit 2021-03-10T13:48:19.906368+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902084\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902154\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902182\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902208\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902233\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902258\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902283\", \"created\": \"2021-03-10T13:46:03.738924\", \"started\": \"2021-03-10T13:46:06.962147\"}, \"node-exporter.a\": {\"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902308\", \"created\": \"2021-03-10T13:47:56.718923\", \"started\": \"2021-03-10T13:47:58.556074\"}, \"alertmanager.a\": {\"hostname\": \"gibba013\", \"container_id\": \"2e79d86dc29d\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902333\", \"created\": \"2021-03-10T13:48:06.706923\", \"started\": \"2021-03-10T13:48:06.734042\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.736195\"}}, \"last_daemon_update\": \"2021-03-10T13:48:19.902396\", \"last_device_update\": \"2021-03-10T13:46:10.457486\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:48:20.608 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:20 gibba020 bash[9782]: audit 2021-03-10T13:48:19.906864+0000 mon.a (mon.0) 519 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:48:20.803 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:20 gibba020 bash[19086]: t=2021-03-10T13:48:20+0000 lvl=info msg="Executing migration" logger=migrator id="Update user table charset" 2021-03-10T13:48:20.803 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:20 gibba020 bash[19086]: t=2021-03-10T13:48:20+0000 lvl=info msg="Executing migration" logger=migrator id="Add last_seen_at column to user" 2021-03-10T13:48:20.803 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:20 gibba020 bash[19086]: t=2021-03-10T13:48:20+0000 lvl=info msg="Executing migration" logger=migrator id="Add missing user data" 2021-03-10T13:48:20.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:20 gibba013 bash[9767]: audit 2021-03-10T13:48:19.903037+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902084\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902154\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902182\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902208\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902233\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902258\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902283\", \"created\": \"2021-03-10T13:46:03.738924\", \"started\": \"2021-03-10T13:46:06.962147\"}, \"node-exporter.a\": {\"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902308\", \"created\": \"2021-03-10T13:47:56.718923\", \"started\": \"2021-03-10T13:47:58.556074\"}, \"alertmanager.a\": {\"hostname\": \"gibba013\", \"container_id\": \"2e79d86dc29d\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902333\", \"created\": \"2021-03-10T13:48:06.706923\", \"started\": \"2021-03-10T13:48:06.734042\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.736195\"}}, \"last_daemon_update\": \"2021-03-10T13:48:19.902396\", \"last_device_update\": \"2021-03-10T13:46:10.457486\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:48:20.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:20 gibba013 bash[9767]: audit 2021-03-10T13:48:19.906368+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902084\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902154\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902182\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902208\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902233\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902258\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902283\", \"created\": \"2021-03-10T13:46:03.738924\", \"started\": \"2021-03-10T13:46:06.962147\"}, \"node-exporter.a\": {\"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902308\", \"created\": \"2021-03-10T13:47:56.718923\", \"started\": \"2021-03-10T13:47:58.556074\"}, \"alertmanager.a\": {\"hostname\": \"gibba013\", \"container_id\": \"2e79d86dc29d\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902333\", \"created\": \"2021-03-10T13:48:06.706923\", \"started\": \"2021-03-10T13:48:06.734042\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.736195\"}}, \"last_daemon_update\": \"2021-03-10T13:48:19.902396\", \"last_device_update\": \"2021-03-10T13:46:10.457486\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:48:20.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:20 gibba013 bash[9767]: audit 2021-03-10T13:48:19.906864+0000 mon.a (mon.0) 519 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:48:20.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:20 gibba013 bash[13024]: audit 2021-03-10T13:48:19.903037+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902084\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902154\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902182\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902208\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902233\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902258\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902283\", \"created\": \"2021-03-10T13:46:03.738924\", \"started\": \"2021-03-10T13:46:06.962147\"}, \"node-exporter.a\": {\"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902308\", \"created\": \"2021-03-10T13:47:56.718923\", \"started\": \"2021-03-10T13:47:58.556074\"}, \"alertmanager.a\": {\"hostname\": \"gibba013\", \"container_id\": \"2e79d86dc29d\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902333\", \"created\": \"2021-03-10T13:48:06.706923\", \"started\": \"2021-03-10T13:48:06.734042\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.736195\"}}, \"last_daemon_update\": \"2021-03-10T13:48:19.902396\", \"last_device_update\": \"2021-03-10T13:46:10.457486\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:48:20.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:20 gibba013 bash[13024]: audit 2021-03-10T13:48:19.906368+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902084\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902154\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902182\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902208\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902233\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902258\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902283\", \"created\": \"2021-03-10T13:46:03.738924\", \"started\": \"2021-03-10T13:46:06.962147\"}, \"node-exporter.a\": {\"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902308\", \"created\": \"2021-03-10T13:47:56.718923\", \"started\": \"2021-03-10T13:47:58.556074\"}, \"alertmanager.a\": {\"hostname\": \"gibba013\", \"container_id\": \"2e79d86dc29d\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902333\", \"created\": \"2021-03-10T13:48:06.706923\", \"started\": \"2021-03-10T13:48:06.734042\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.736195\"}}, \"last_daemon_update\": \"2021-03-10T13:48:19.902396\", \"last_device_update\": \"2021-03-10T13:46:10.457486\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:48:20.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:20 gibba013 bash[13024]: audit 2021-03-10T13:48:19.906864+0000 mon.a (mon.0) 519 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:48:21.122 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:20 gibba020 bash[19086]: t=2021-03-10T13:48:20+0000 lvl=info msg="Executing migration" logger=migrator id="Add is_disabled column to user" 2021-03-10T13:48:21.123 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:20 gibba020 bash[19086]: t=2021-03-10T13:48:20+0000 lvl=info msg="Executing migration" logger=migrator id="create temp user table v1-7" 2021-03-10T13:48:21.123 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:20 gibba020 bash[19086]: t=2021-03-10T13:48:20+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_email - v1-7" 2021-03-10T13:48:21.123 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:20 gibba020 bash[19086]: t=2021-03-10T13:48:20+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_org_id - v1-7" 2021-03-10T13:48:21.124 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:21 gibba020 bash[19086]: t=2021-03-10T13:48:21+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_code - v1-7" 2021-03-10T13:48:21.124 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:21 gibba020 bash[19086]: t=2021-03-10T13:48:21+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_status - v1-7" 2021-03-10T13:48:21.124 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:21 gibba020 bash[19086]: t=2021-03-10T13:48:21+0000 lvl=info msg="Executing migration" logger=migrator id="Update temp_user table charset" 2021-03-10T13:48:21.383 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:21 gibba020 bash[19086]: t=2021-03-10T13:48:21+0000 lvl=info msg="Executing migration" logger=migrator id="create star table" 2021-03-10T13:48:22.099 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:21 gibba020 bash[19086]: t=2021-03-10T13:48:21+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index star.user_id_dashboard_id" 2021-03-10T13:48:22.099 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:21 gibba020 bash[19086]: t=2021-03-10T13:48:21+0000 lvl=info msg="Executing migration" logger=migrator id="create org table v1" 2021-03-10T13:48:22.100 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:21 gibba013 bash[9767]: cluster 2021-03-10T13:48:20.471027+0000 mgr.y (mgr.14140) 190 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:22.101 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:21 gibba020 bash[19086]: t=2021-03-10T13:48:21+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_name - v1" 2021-03-10T13:48:22.101 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:21 gibba020 bash[19086]: t=2021-03-10T13:48:21+0000 lvl=info msg="Executing migration" logger=migrator id="create org_user table v1" 2021-03-10T13:48:22.101 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:21 gibba020 bash[19086]: t=2021-03-10T13:48:21+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_org_id - v1" 2021-03-10T13:48:22.102 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:21 gibba020 bash[19086]: t=2021-03-10T13:48:21+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_user_org_id_user_id - v1" 2021-03-10T13:48:22.102 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:21 gibba020 bash[19086]: t=2021-03-10T13:48:21+0000 lvl=info msg="Executing migration" logger=migrator id="Update org table charset" 2021-03-10T13:48:22.102 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:21 gibba013 bash[13024]: cluster 2021-03-10T13:48:20.471027+0000 mgr.y (mgr.14140) 190 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:22.103 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:21 gibba020 bash[9782]: cluster 2021-03-10T13:48:20.471027+0000 mgr.y (mgr.14140) 190 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:22.103 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:21 gibba020 bash[9782]: audit 2021-03-10T13:48:20.857404+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.852473\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.852739\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.852905\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853061\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853212\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853362\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853512\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"157beacd603d\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853661\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:47:55.252546\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853808\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853955\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:47:41.497315\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}}, \"last_daemon_update\": \"2021-03-10T13:48:20.854331\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:48:22.104 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:21 gibba020 bash[9782]: audit 2021-03-10T13:48:20.866588+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.852473\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.852739\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.852905\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853061\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853212\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853362\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853512\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"157beacd603d\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853661\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:47:55.252546\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853808\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853955\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:47:41.497315\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}}, \"last_daemon_update\": \"2021-03-10T13:48:20.854331\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:48:22.104 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:21 gibba020 bash[9782]: cephadm 2021-03-10T13:48:20.868182+0000 mgr.y (mgr.14140) 191 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-03-10T13:48:22.104 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:21 gibba020 bash[9782]: cephadm 2021-03-10T13:48:20.870178+0000 mgr.y (mgr.14140) 192 : cephadm [INF] Reconfiguring daemon alertmanager.a on gibba013 2021-03-10T13:48:22.105 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:21 gibba020 bash[19086]: t=2021-03-10T13:48:21+0000 lvl=info msg="Executing migration" logger=migrator id="Update org_user table charset" 2021-03-10T13:48:22.105 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:21 gibba020 bash[19086]: t=2021-03-10T13:48:21+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate all Read Only Viewers to Viewers" 2021-03-10T13:48:22.105 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:21 gibba020 bash[19086]: t=2021-03-10T13:48:21+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard table" 2021-03-10T13:48:22.105 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:21 gibba013 bash[9767]: audit 2021-03-10T13:48:20.857404+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.852473\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.852739\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.852905\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853061\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853212\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853362\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853512\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"157beacd603d\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853661\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:47:55.252546\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853808\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853955\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:47:41.497315\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}}, \"last_daemon_update\": \"2021-03-10T13:48:20.854331\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:48:22.106 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:21 gibba013 bash[9767]: audit 2021-03-10T13:48:20.866588+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.852473\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.852739\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.852905\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853061\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853212\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853362\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853512\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"157beacd603d\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853661\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:47:55.252546\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853808\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853955\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:47:41.497315\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}}, \"last_daemon_update\": \"2021-03-10T13:48:20.854331\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:48:22.106 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:21 gibba013 bash[9767]: cephadm 2021-03-10T13:48:20.868182+0000 mgr.y (mgr.14140) 191 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-03-10T13:48:22.106 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:21 gibba013 bash[9767]: cephadm 2021-03-10T13:48:20.870178+0000 mgr.y (mgr.14140) 192 : cephadm [INF] Reconfiguring daemon alertmanager.a on gibba013 2021-03-10T13:48:22.107 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:21 gibba013 bash[13024]: audit 2021-03-10T13:48:20.857404+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.852473\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.852739\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.852905\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853061\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853212\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853362\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853512\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"157beacd603d\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853661\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:47:55.252546\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853808\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853955\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:47:41.497315\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}}, \"last_daemon_update\": \"2021-03-10T13:48:20.854331\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:48:22.107 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:21 gibba013 bash[13024]: audit 2021-03-10T13:48:20.866588+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.852473\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.852739\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.852905\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853061\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853212\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853362\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853512\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"157beacd603d\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853661\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:47:55.252546\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853808\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853955\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:47:41.497315\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}}, \"last_daemon_update\": \"2021-03-10T13:48:20.854331\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:48:22.107 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:21 gibba013 bash[13024]: cephadm 2021-03-10T13:48:20.868182+0000 mgr.y (mgr.14140) 191 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-03-10T13:48:22.108 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:21 gibba013 bash[13024]: cephadm 2021-03-10T13:48:20.870178+0000 mgr.y (mgr.14140) 192 : cephadm [INF] Reconfiguring daemon alertmanager.a on gibba013 2021-03-10T13:48:22.178 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:21 gibba020 bash[19086]: t=2021-03-10T13:48:21+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard.account_id" 2021-03-10T13:48:22.179 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:21 gibba020 bash[19086]: t=2021-03-10T13:48:21+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_account_id_slug" 2021-03-10T13:48:22.179 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:22 gibba020 bash[19086]: t=2021-03-10T13:48:22+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_tag table" 2021-03-10T13:48:22.179 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:22 gibba020 bash[19086]: t=2021-03-10T13:48:22+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_tag.dasboard_id_term" 2021-03-10T13:48:22.445 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:22 gibba020 bash[19086]: t=2021-03-10T13:48:22+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2021-03-10T13:48:22.445 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:22 gibba020 bash[19086]: t=2021-03-10T13:48:22+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard to dashboard_v1 - v1" 2021-03-10T13:48:22.445 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:22 gibba020 bash[19086]: t=2021-03-10T13:48:22+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard v2" 2021-03-10T13:48:22.446 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:22 gibba020 bash[19086]: t=2021-03-10T13:48:22+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_org_id - v2" 2021-03-10T13:48:22.740 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:22 gibba020 bash[19086]: t=2021-03-10T13:48:22+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_org_id_slug - v2" 2021-03-10T13:48:22.741 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:22 gibba020 bash[19086]: t=2021-03-10T13:48:22+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard v1 to v2" 2021-03-10T13:48:22.741 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:22 gibba020 bash[19086]: t=2021-03-10T13:48:22+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_v1" 2021-03-10T13:48:22.741 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:22 gibba020 bash[19086]: t=2021-03-10T13:48:22+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard.data to mediumtext v1" 2021-03-10T13:48:22.742 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:22 gibba020 bash[19086]: t=2021-03-10T13:48:22+0000 lvl=info msg="Executing migration" logger=migrator id="Add column updated_by in dashboard - v2" 2021-03-10T13:48:22.809 INFO:teuthology.orchestra.run.gibba013.stdout: 2021-03-10T13:48:22.809 INFO:teuthology.orchestra.run.gibba013.stdout:{"epoch":48,"fsid":"7672acc8-81a6-11eb-9080-001a4aab830c","created":"2021-03-10T13:42:55.242911+0000","modified":"2021-03-10T13:47:44.530544+0000","last_up_change":"2021-03-10T13:47:43.514810+0000","last_in_change":"2021-03-10T13:47:43.514810+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-10T13:43:05.278362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6802","nonce":1746855808},{"type":"v1","addr":"172.21.2.113:6803","nonce":1746855808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6804","nonce":1746855808},{"type":"v1","addr":"172.21.2.113:6805","nonce":1746855808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6808","nonce":1746855808},{"type":"v1","addr":"172.21.2.113:6809","nonce":1746855808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6806","nonce":1746855808},{"type":"v1","addr":"172.21.2.113:6807","nonce":1746855808}]},"public_addr":"172.21.2.113:6803/1746855808","cluster_addr":"172.21.2.113:6805/1746855808","heartbeat_back_addr":"172.21.2.113:6809/1746855808","heartbeat_front_addr":"172.21.2.113:6807/1746855808","state":["exists","up"]},{"osd":1,"uuid":"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6810","nonce":1501662462},{"type":"v1","addr":"172.21.2.113:6811","nonce":1501662462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6812","nonce":1501662462},{"type":"v1","addr":"172.21.2.113:6813","nonce":1501662462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6816","nonce":1501662462},{"type":"v1","addr":"172.21.2.113:6817","nonce":1501662462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6814","nonce":1501662462},{"type":"v1","addr":"172.21.2.113:6815","nonce":1501662462}]},"public_addr":"172.21.2.113:6811/1501662462","cluster_addr":"172.21.2.113:6813/1501662462","heartbeat_back_addr":"172.21.2.113:6817/1501662462","heartbeat_front_addr":"172.21.2.113:6815/1501662462","state":["exists","up"]},{"osd":2,"uuid":"13edbbb8-76dd-40bc-bb99-7e4b3612e855","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6818","nonce":3189642125},{"type":"v1","addr":"172.21.2.113:6819","nonce":3189642125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6820","nonce":3189642125},{"type":"v1","addr":"172.21.2.113:6821","nonce":3189642125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6824","nonce":3189642125},{"type":"v1","addr":"172.21.2.113:6825","nonce":3189642125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6822","nonce":3189642125},{"type":"v1","addr":"172.21.2.113:6823","nonce":3189642125}]},"public_addr":"172.21.2.113:6819/3189642125","cluster_addr":"172.21.2.113:6821/3189642125","heartbeat_back_addr":"172.21.2.113:6825/3189642125","heartbeat_front_addr":"172.21.2.113:6823/3189642125","state":["exists","up"]},{"osd":3,"uuid":"6d982c1b-253a-4416-814a-f14b580f5c6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6826","nonce":144091957},{"type":"v1","addr":"172.21.2.113:6827","nonce":144091957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6828","nonce":144091957},{"type":"v1","addr":"172.21.2.113:6829","nonce":144091957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6832","nonce":144091957},{"type":"v1","addr":"172.21.2.113:6833","nonce":144091957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6830","nonce":144091957},{"type":"v1","addr":"172.21.2.113:6831","nonce":144091957}]},"public_addr":"172.21.2.113:6827/144091957","cluster_addr":"172.21.2.113:6829/144091957","heartbeat_back_addr":"172.21.2.113:6833/144091957","heartbeat_front_addr":"172.21.2.113:6831/144091957","state":["exists","up"]},{"osd":4,"uuid":"e1ee562f-9cbb-49d7-864e-764dd41860fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6800","nonce":319375890},{"type":"v1","addr":"172.21.2.120:6801","nonce":319375890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6802","nonce":319375890},{"type":"v1","addr":"172.21.2.120:6803","nonce":319375890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6806","nonce":319375890},{"type":"v1","addr":"172.21.2.120:6807","nonce":319375890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6804","nonce":319375890},{"type":"v1","addr":"172.21.2.120:6805","nonce":319375890}]},"public_addr":"172.21.2.120:6801/319375890","cluster_addr":"172.21.2.120:6803/319375890","heartbeat_back_addr":"172.21.2.120:6807/319375890","heartbeat_front_addr":"172.21.2.120:6805/319375890","state":["exists","up"]},{"osd":5,"uuid":"81a906b6-e201-49ad-ae65-0e049d746e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6808","nonce":3595534437},{"type":"v1","addr":"172.21.2.120:6809","nonce":3595534437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6810","nonce":3595534437},{"type":"v1","addr":"172.21.2.120:6811","nonce":3595534437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6814","nonce":3595534437},{"type":"v1","addr":"172.21.2.120:6815","nonce":3595534437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6812","nonce":3595534437},{"type":"v1","addr":"172.21.2.120:6813","nonce":3595534437}]},"public_addr":"172.21.2.120:6809/3595534437","cluster_addr":"172.21.2.120:6811/3595534437","heartbeat_back_addr":"172.21.2.120:6815/3595534437","heartbeat_front_addr":"172.21.2.120:6813/3595534437","state":["exists","up"]},{"osd":6,"uuid":"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6816","nonce":1328382283},{"type":"v1","addr":"172.21.2.120:6817","nonce":1328382283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6818","nonce":1328382283},{"type":"v1","addr":"172.21.2.120:6819","nonce":1328382283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6822","nonce":1328382283},{"type":"v1","addr":"172.21.2.120:6823","nonce":1328382283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6820","nonce":1328382283},{"type":"v1","addr":"172.21.2.120:6821","nonce":1328382283}]},"public_addr":"172.21.2.120:6817/1328382283","cluster_addr":"172.21.2.120:6819/1328382283","heartbeat_back_addr":"172.21.2.120:6823/1328382283","heartbeat_front_addr":"172.21.2.120:6821/1328382283","state":["exists","up"]},{"osd":7,"uuid":"6b05701f-f937-4752-bbf7-a7196766d792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6824","nonce":1421523901},{"type":"v1","addr":"172.21.2.120:6825","nonce":1421523901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6826","nonce":1421523901},{"type":"v1","addr":"172.21.2.120:6827","nonce":1421523901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6830","nonce":1421523901},{"type":"v1","addr":"172.21.2.120:6831","nonce":1421523901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6828","nonce":1421523901},{"type":"v1","addr":"172.21.2.120:6829","nonce":1421523901}]},"public_addr":"172.21.2.120:6825/1421523901","cluster_addr":"172.21.2.120:6827/1421523901","heartbeat_back_addr":"172.21.2.120:6831/1421523901","heartbeat_front_addr":"172.21.2.120:6829/1421523901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:45:02.571014+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:45:24.822597+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:45:47.841278+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:46:10.640903+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:46:31.489218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:46:54.345984+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:47:17.218312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:47:41.487719+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.2.113:0/2867408781":"2021-03-11T13:43:25.864383+0000","172.21.2.113:0/4101755549":"2021-03-11T13:43:25.864383+0000","172.21.2.113:6801/2579871074":"2021-03-11T13:43:25.864383+0000","172.21.2.113:6800/2579871074":"2021-03-11T13:43:25.864383+0000","172.21.2.113:0/2306552835":"2021-03-11T13:43:12.108225+0000","172.21.2.113:6800/2562375199":"2021-03-11T13:43:12.108225+0000","172.21.2.113:0/1865931294":"2021-03-11T13:43:25.864383+0000","172.21.2.113:6801/2562375199":"2021-03-11T13:43:12.108225+0000","172.21.2.113:0/1874002260":"2021-03-11T13:43:12.108225+0000","172.21.2.113:0/2911839215":"2021-03-11T13:43:12.108225+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-03-10T13:48:23.025 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:22 gibba020 bash[19086]: t=2021-03-10T13:48:22+0000 lvl=info msg="Executing migration" logger=migrator id="Add column created_by in dashboard - v2" 2021-03-10T13:48:23.026 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:22 gibba020 bash[19086]: t=2021-03-10T13:48:22+0000 lvl=info msg="Executing migration" logger=migrator id="Add column gnetId in dashboard" 2021-03-10T13:48:23.026 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:22 gibba020 bash[19086]: t=2021-03-10T13:48:22+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for gnetId in dashboard" 2021-03-10T13:48:23.026 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:22 gibba020 bash[19086]: t=2021-03-10T13:48:22+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_id in dashboard" 2021-03-10T13:48:23.026 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:22 gibba020 bash[19086]: t=2021-03-10T13:48:22+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for plugin_id in dashboard" 2021-03-10T13:48:23.027 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:23 gibba020 bash[19086]: t=2021-03-10T13:48:23+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_id in dashboard_tag" 2021-03-10T13:48:23.293 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:23 gibba020 bash[19086]: t=2021-03-10T13:48:23+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard table charset" 2021-03-10T13:48:23.294 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:23 gibba020 bash[19086]: t=2021-03-10T13:48:23+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_tag table charset" 2021-03-10T13:48:23.294 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:23 gibba020 bash[19086]: t=2021-03-10T13:48:23+0000 lvl=info msg="Executing migration" logger=migrator id="Add column folder_id in dashboard" 2021-03-10T13:48:23.544 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:23 gibba020 bash[9782]: cluster 2021-03-10T13:48:22.471853+0000 mgr.y (mgr.14140) 193 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:23.544 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:23 gibba020 bash[9782]: audit 2021-03-10T13:48:22.806108+0000 mon.c (mon.1) 13 : audit [DBG] from='client.? 172.21.2.113:0/2725374461' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T13:48:23.545 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:23 gibba020 bash[19086]: t=2021-03-10T13:48:23+0000 lvl=info msg="Executing migration" logger=migrator id="Add column isFolder in dashboard" 2021-03-10T13:48:23.545 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:23 gibba020 bash[19086]: t=2021-03-10T13:48:23+0000 lvl=info msg="Executing migration" logger=migrator id="Add column has_acl in dashboard" 2021-03-10T13:48:23.545 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:23 gibba020 bash[19086]: t=2021-03-10T13:48:23+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in dashboard" 2021-03-10T13:48:23.545 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:23 gibba020 bash[19086]: t=2021-03-10T13:48:23+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in dashboard" 2021-03-10T13:48:23.546 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:23 gibba020 bash[19086]: t=2021-03-10T13:48:23+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index dashboard_org_id_uid" 2021-03-10T13:48:23.754 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2021-03-10T13:48:23.754 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph osd dump --format=json 2021-03-10T13:48:23.837 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:23 gibba020 bash[19086]: t=2021-03-10T13:48:23+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_slug" 2021-03-10T13:48:23.838 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:23 gibba020 bash[19086]: t=2021-03-10T13:48:23+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard title length" 2021-03-10T13:48:23.838 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:23 gibba020 bash[19086]: t=2021-03-10T13:48:23+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index for dashboard_org_id_title_folder_id" 2021-03-10T13:48:23.843 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:23 gibba013 bash[9767]: cluster 2021-03-10T13:48:22.471853+0000 mgr.y (mgr.14140) 193 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:23.843 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:23 gibba013 bash[9767]: audit 2021-03-10T13:48:22.806108+0000 mon.c (mon.1) 13 : audit [DBG] from='client.? 172.21.2.113:0/2725374461' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T13:48:23.843 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:23 gibba013 bash[13024]: cluster 2021-03-10T13:48:22.471853+0000 mgr.y (mgr.14140) 193 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:23.844 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:23 gibba013 bash[13024]: audit 2021-03-10T13:48:22.806108+0000 mon.c (mon.1) 13 : audit [DBG] from='client.? 172.21.2.113:0/2725374461' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T13:48:24.106 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:23 gibba020 bash[19086]: t=2021-03-10T13:48:23+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning" 2021-03-10T13:48:24.107 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:23 gibba020 bash[19086]: t=2021-03-10T13:48:23+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2021-03-10T13:48:24.107 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:23 gibba020 bash[19086]: t=2021-03-10T13:48:23+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning v2" 2021-03-10T13:48:24.107 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:24 gibba020 bash[19086]: t=2021-03-10T13:48:24+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2021-03-10T13:48:24.107 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:24 gibba020 bash[19086]: t=2021-03-10T13:48:24+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2021-03-10T13:48:24.366 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:24 gibba020 bash[19086]: t=2021-03-10T13:48:24+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard_provisioning v1 to v2" 2021-03-10T13:48:24.366 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:24 gibba020 bash[19086]: t=2021-03-10T13:48:24+0000 lvl=info msg="Executing migration" logger=migrator id="drop dashboard_provisioning_tmp_qwerty" 2021-03-10T13:48:24.366 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:24 gibba020 bash[19086]: t=2021-03-10T13:48:24+0000 lvl=info msg="Executing migration" logger=migrator id="Add check_sum column" 2021-03-10T13:48:24.367 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:24 gibba020 bash[19086]: t=2021-03-10T13:48:24+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table" 2021-03-10T13:48:24.668 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:24 gibba020 bash[19086]: t=2021-03-10T13:48:24+0000 lvl=info msg="Executing migration" logger=migrator id="add index data_source.account_id" 2021-03-10T13:48:24.668 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:24 gibba020 bash[19086]: t=2021-03-10T13:48:24+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index data_source.account_id_name" 2021-03-10T13:48:24.668 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:24 gibba020 bash[19086]: t=2021-03-10T13:48:24+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_data_source_account_id - v1" 2021-03-10T13:48:24.668 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:24 gibba020 bash[19086]: t=2021-03-10T13:48:24+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_data_source_account_id_name - v1" 2021-03-10T13:48:24.945 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:24 gibba020 bash[19086]: t=2021-03-10T13:48:24+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table data_source to data_source_v1 - v1" 2021-03-10T13:48:24.946 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:24 gibba020 bash[19086]: t=2021-03-10T13:48:24+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table v2" 2021-03-10T13:48:24.946 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:24 gibba020 bash[19086]: t=2021-03-10T13:48:24+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_data_source_org_id - v2" 2021-03-10T13:48:24.947 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:24 gibba020 bash[19086]: t=2021-03-10T13:48:24+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_data_source_org_id_name - v2" 2021-03-10T13:48:25.246 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:24 gibba020 bash[19086]: t=2021-03-10T13:48:24+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2021-03-10T13:48:25.246 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:25 gibba020 bash[19086]: t=2021-03-10T13:48:25+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table data_source_v1 #2" 2021-03-10T13:48:25.246 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:25 gibba020 bash[19086]: t=2021-03-10T13:48:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add column with_credentials" 2021-03-10T13:48:25.247 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:25 gibba020 bash[19086]: t=2021-03-10T13:48:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add secure json data column" 2021-03-10T13:48:25.247 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:25 gibba020 bash[19086]: t=2021-03-10T13:48:25+0000 lvl=info msg="Executing migration" logger=migrator id="Update data_source table charset" 2021-03-10T13:48:25.496 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:25 gibba020 bash[19086]: t=2021-03-10T13:48:25+0000 lvl=info msg="Executing migration" logger=migrator id="Update initial version to 1" 2021-03-10T13:48:25.496 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:25 gibba020 bash[19086]: t=2021-03-10T13:48:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add read_only data column" 2021-03-10T13:48:25.496 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:25 gibba020 bash[19086]: t=2021-03-10T13:48:25+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate logging ds to loki ds" 2021-03-10T13:48:25.497 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:25 gibba020 bash[19086]: t=2021-03-10T13:48:25+0000 lvl=info msg="Executing migration" logger=migrator id="Update json_data with nulls" 2021-03-10T13:48:25.767 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:25 gibba020 bash[9782]: cluster 2021-03-10T13:48:24.472515+0000 mgr.y (mgr.14140) 194 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:25.767 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:25 gibba020 bash[19086]: t=2021-03-10T13:48:25+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table" 2021-03-10T13:48:25.767 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:25 gibba020 bash[19086]: t=2021-03-10T13:48:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id" 2021-03-10T13:48:25.768 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:25 gibba020 bash[19086]: t=2021-03-10T13:48:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.key" 2021-03-10T13:48:25.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:25 gibba013 bash[9767]: cluster 2021-03-10T13:48:24.472515+0000 mgr.y (mgr.14140) 194 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:25.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:25 gibba013 bash[13024]: cluster 2021-03-10T13:48:24.472515+0000 mgr.y (mgr.14140) 194 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:26.060 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:25 gibba020 bash[19086]: t=2021-03-10T13:48:25+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id_name" 2021-03-10T13:48:26.060 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:25 gibba020 bash[19086]: t=2021-03-10T13:48:25+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_api_key_account_id - v1" 2021-03-10T13:48:26.060 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:25 gibba020 bash[19086]: t=2021-03-10T13:48:25+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_key - v1" 2021-03-10T13:48:26.060 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:25 gibba020 bash[19086]: t=2021-03-10T13:48:25+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_account_id_name - v1" 2021-03-10T13:48:26.061 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:26 gibba020 bash[19086]: t=2021-03-10T13:48:26+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table api_key to api_key_v1 - v1" 2021-03-10T13:48:26.061 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:26 gibba020 bash[19086]: t=2021-03-10T13:48:26+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table v2" 2021-03-10T13:48:26.345 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:26 gibba020 bash[19086]: t=2021-03-10T13:48:26+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_api_key_org_id - v2" 2021-03-10T13:48:26.345 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:26 gibba020 bash[19086]: t=2021-03-10T13:48:26+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_key - v2" 2021-03-10T13:48:26.345 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:26 gibba020 bash[19086]: t=2021-03-10T13:48:26+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_org_id_name - v2" 2021-03-10T13:48:26.630 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:26 gibba020 bash[19086]: t=2021-03-10T13:48:26+0000 lvl=info msg="Executing migration" logger=migrator id="copy api_key v1 to v2" 2021-03-10T13:48:26.630 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:26 gibba020 bash[19086]: t=2021-03-10T13:48:26+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table api_key_v1" 2021-03-10T13:48:26.630 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:26 gibba020 bash[19086]: t=2021-03-10T13:48:26+0000 lvl=info msg="Executing migration" logger=migrator id="Update api_key table charset" 2021-03-10T13:48:26.631 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:26 gibba020 bash[19086]: t=2021-03-10T13:48:26+0000 lvl=info msg="Executing migration" logger=migrator id="Add expires to api_key table" 2021-03-10T13:48:26.631 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:26 gibba020 bash[19086]: t=2021-03-10T13:48:26+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v4" 2021-03-10T13:48:26.631 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:26 gibba020 bash[19086]: t=2021-03-10T13:48:26+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_snapshot_v4 #1" 2021-03-10T13:48:26.631 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:48:26 gibba013 systemd[1]: Stopping Ceph alertmanager.a for 7672acc8-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:48:26.917 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:26 gibba020 bash[19086]: t=2021-03-10T13:48:26+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v5 #2" 2021-03-10T13:48:26.917 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:26 gibba020 bash[19086]: t=2021-03-10T13:48:26+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_key - v5" 2021-03-10T13:48:26.918 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:26 gibba020 bash[19086]: t=2021-03-10T13:48:26+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_delete_key - v5" 2021-03-10T13:48:26.918 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:26 gibba020 bash[19086]: t=2021-03-10T13:48:26+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_snapshot_user_id - v5" 2021-03-10T13:48:27.103 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:48:26 gibba013 bash[20331]: level=info ts=2021-03-10T13:48:26.687Z caller=main.go:524 msg="Received SIGTERM, exiting gracefully..." 2021-03-10T13:48:27.195 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:26 gibba020 bash[19086]: t=2021-03-10T13:48:26+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_snapshot to mediumtext v2" 2021-03-10T13:48:27.195 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:27 gibba020 bash[19086]: t=2021-03-10T13:48:27+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_snapshot table charset" 2021-03-10T13:48:27.195 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:27 gibba020 bash[19086]: t=2021-03-10T13:48:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external_delete_url to dashboard_snapshots table" 2021-03-10T13:48:27.196 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:27 gibba020 bash[19086]: t=2021-03-10T13:48:27+0000 lvl=info msg="Executing migration" logger=migrator id="create quota table v1" 2021-03-10T13:48:27.497 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:27 gibba020 bash[19086]: t=2021-03-10T13:48:27+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_quota_org_id_user_id_target - v1" 2021-03-10T13:48:27.498 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:27 gibba020 bash[19086]: t=2021-03-10T13:48:27+0000 lvl=info msg="Executing migration" logger=migrator id="Update quota table charset" 2021-03-10T13:48:27.498 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:27 gibba020 bash[19086]: t=2021-03-10T13:48:27+0000 lvl=info msg="Executing migration" logger=migrator id="create plugin_setting table" 2021-03-10T13:48:27.498 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:27 gibba020 bash[19086]: t=2021-03-10T13:48:27+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2021-03-10T13:48:27.498 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:27 gibba020 bash[19086]: t=2021-03-10T13:48:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_version to plugin_settings" 2021-03-10T13:48:27.499 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:27 gibba020 bash[19086]: t=2021-03-10T13:48:27+0000 lvl=info msg="Executing migration" logger=migrator id="Update plugin_setting table charset" 2021-03-10T13:48:27.773 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:27 gibba020 bash[9782]: cluster 2021-03-10T13:48:26.472779+0000 mgr.y (mgr.14140) 195 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:27.773 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:27 gibba020 bash[19086]: t=2021-03-10T13:48:27+0000 lvl=info msg="Executing migration" logger=migrator id="create session table" 2021-03-10T13:48:27.773 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:27 gibba020 bash[19086]: t=2021-03-10T13:48:27+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist table" 2021-03-10T13:48:27.774 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:27 gibba020 bash[19086]: t=2021-03-10T13:48:27+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist_item table" 2021-03-10T13:48:27.841 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:27 gibba013 bash[9767]: cluster 2021-03-10T13:48:26.472779+0000 mgr.y (mgr.14140) 195 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:27.842 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:27 gibba013 bash[13024]: cluster 2021-03-10T13:48:26.472779+0000 mgr.y (mgr.14140) 195 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:27.842 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:48:27 gibba013 docker[21787]: ceph-7672acc8-81a6-11eb-9080-001a4aab830c-alertmanager.a 2021-03-10T13:48:27.842 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:48:27 gibba013 systemd[1]: ceph-7672acc8-81a6-11eb-9080-001a4aab830c@alertmanager.a.service: Succeeded. 2021-03-10T13:48:27.843 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:48:27 gibba013 systemd[1]: Stopped Ceph alertmanager.a for 7672acc8-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:48:27.843 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:48:27 gibba013 systemd[1]: Starting Ceph alertmanager.a for 7672acc8-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:48:27.843 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:48:27 gibba013 docker[21821]: Error: No such container: ceph-7672acc8-81a6-11eb-9080-001a4aab830c-alertmanager.a 2021-03-10T13:48:27.843 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:48:27 gibba013 systemd[1]: Started Ceph alertmanager.a for 7672acc8-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:48:28.118 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:27 gibba020 bash[19086]: t=2021-03-10T13:48:27+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist table v2" 2021-03-10T13:48:28.118 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:27 gibba020 bash[19086]: t=2021-03-10T13:48:27+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist item table v2" 2021-03-10T13:48:28.118 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:27 gibba020 bash[19086]: t=2021-03-10T13:48:27+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist table charset" 2021-03-10T13:48:28.169 INFO:teuthology.orchestra.run.gibba013.stdout: 2021-03-10T13:48:28.169 INFO:teuthology.orchestra.run.gibba013.stdout:{"epoch":48,"fsid":"7672acc8-81a6-11eb-9080-001a4aab830c","created":"2021-03-10T13:42:55.242911+0000","modified":"2021-03-10T13:47:44.530544+0000","last_up_change":"2021-03-10T13:47:43.514810+0000","last_in_change":"2021-03-10T13:47:43.514810+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-10T13:43:05.278362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6802","nonce":1746855808},{"type":"v1","addr":"172.21.2.113:6803","nonce":1746855808}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6804","nonce":1746855808},{"type":"v1","addr":"172.21.2.113:6805","nonce":1746855808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6808","nonce":1746855808},{"type":"v1","addr":"172.21.2.113:6809","nonce":1746855808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6806","nonce":1746855808},{"type":"v1","addr":"172.21.2.113:6807","nonce":1746855808}]},"public_addr":"172.21.2.113:6803/1746855808","cluster_addr":"172.21.2.113:6805/1746855808","heartbeat_back_addr":"172.21.2.113:6809/1746855808","heartbeat_front_addr":"172.21.2.113:6807/1746855808","state":["exists","up"]},{"osd":1,"uuid":"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6810","nonce":1501662462},{"type":"v1","addr":"172.21.2.113:6811","nonce":1501662462}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6812","nonce":1501662462},{"type":"v1","addr":"172.21.2.113:6813","nonce":1501662462}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6816","nonce":1501662462},{"type":"v1","addr":"172.21.2.113:6817","nonce":1501662462}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6814","nonce":1501662462},{"type":"v1","addr":"172.21.2.113:6815","nonce":1501662462}]},"public_addr":"172.21.2.113:6811/1501662462","cluster_addr":"172.21.2.113:6813/1501662462","heartbeat_back_addr":"172.21.2.113:6817/1501662462","heartbeat_front_addr":"172.21.2.113:6815/1501662462","state":["exists","up"]},{"osd":2,"uuid":"13edbbb8-76dd-40bc-bb99-7e4b3612e855","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6818","nonce":3189642125},{"type":"v1","addr":"172.21.2.113:6819","nonce":3189642125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6820","nonce":3189642125},{"type":"v1","addr":"172.21.2.113:6821","nonce":3189642125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6824","nonce":3189642125},{"type":"v1","addr":"172.21.2.113:6825","nonce":3189642125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6822","nonce":3189642125},{"type":"v1","addr":"172.21.2.113:6823","nonce":3189642125}]},"public_addr":"172.21.2.113:6819/3189642125","cluster_addr":"172.21.2.113:6821/3189642125","heartbeat_back_addr":"172.21.2.113:6825/3189642125","heartbeat_front_addr":"172.21.2.113:6823/3189642125","state":["exists","up"]},{"osd":3,"uuid":"6d982c1b-253a-4416-814a-f14b580f5c6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6826","nonce":144091957},{"type":"v1","addr":"172.21.2.113:6827","nonce":144091957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6828","nonce":144091957},{"type":"v1","addr":"172.21.2.113:6829","nonce":144091957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6832","nonce":144091957},{"type":"v1","addr":"172.21.2.113:6833","nonce":144091957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.113:6830","nonce":144091957},{"type":"v1","addr":"172.21.2.113:6831","nonce":144091957}]},"public_addr":"172.21.2.113:6827/144091957","cluster_addr":"172.21.2.113:6829/144091957","heartbeat_back_addr":"172.21.2.113:6833/144091957","heartbeat_front_addr":"172.21.2.113:6831/144091957","state":["exists","up"]},{"osd":4,"uuid":"e1ee562f-9cbb-49d7-864e-764dd41860fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6800","nonce":319375890},{"type":"v1","addr":"172.21.2.120:6801","nonce":319375890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6802","nonce":319375890},{"type":"v1","addr":"172.21.2.120:6803","nonce":319375890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6806","nonce":319375890},{"type":"v1","addr":"172.21.2.120:6807","nonce":319375890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6804","nonce":319375890},{"type":"v1","addr":"172.21.2.120:6805","nonce":319375890}]},"public_addr":"172.21.2.120:6801/319375890","cluster_addr":"172.21.2.120:6803/319375890","heartbeat_back_addr":"172.21.2.120:6807/319375890","heartbeat_front_addr":"172.21.2.120:6805/319375890","state":["exists","up"]},{"osd":5,"uuid":"81a906b6-e201-49ad-ae65-0e049d746e98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6808","nonce":3595534437},{"type":"v1","addr":"172.21.2.120:6809","nonce":3595534437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6810","nonce":3595534437},{"type":"v1","addr":"172.21.2.120:6811","nonce":3595534437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6814","nonce":3595534437},{"type":"v1","addr":"172.21.2.120:6815","nonce":3595534437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6812","nonce":3595534437},{"type":"v1","addr":"172.21.2.120:6813","nonce":3595534437}]},"public_addr":"172.21.2.120:6809/3595534437","cluster_addr":"172.21.2.120:6811/3595534437","heartbeat_back_addr":"172.21.2.120:6815/3595534437","heartbeat_front_addr":"172.21.2.120:6813/3595534437","state":["exists","up"]},{"osd":6,"uuid":"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6816","nonce":1328382283},{"type":"v1","addr":"172.21.2.120:6817","nonce":1328382283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6818","nonce":1328382283},{"type":"v1","addr":"172.21.2.120:6819","nonce":1328382283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6822","nonce":1328382283},{"type":"v1","addr":"172.21.2.120:6823","nonce":1328382283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6820","nonce":1328382283},{"type":"v1","addr":"172.21.2.120:6821","nonce":1328382283}]},"public_addr":"172.21.2.120:6817/1328382283","cluster_addr":"172.21.2.120:6819/1328382283","heartbeat_back_addr":"172.21.2.120:6823/1328382283","heartbeat_front_addr":"172.21.2.120:6821/1328382283","state":["exists","up"]},{"osd":7,"uuid":"6b05701f-f937-4752-bbf7-a7196766d792","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6824","nonce":1421523901},{"type":"v1","addr":"172.21.2.120:6825","nonce":1421523901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6826","nonce":1421523901},{"type":"v1","addr":"172.21.2.120:6827","nonce":1421523901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6830","nonce":1421523901},{"type":"v1","addr":"172.21.2.120:6831","nonce":1421523901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.120:6828","nonce":1421523901},{"type":"v1","addr":"172.21.2.120:6829","nonce":1421523901}]},"public_addr":"172.21.2.120:6825/1421523901","cluster_addr":"172.21.2.120:6827/1421523901","heartbeat_back_addr":"172.21.2.120:6831/1421523901","heartbeat_front_addr":"172.21.2.120:6829/1421523901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:45:02.571014+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:45:24.822597+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:45:47.841278+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:46:10.640903+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:46:31.489218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:46:54.345984+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:47:17.218312+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T13:47:41.487719+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.2.113:0/2867408781":"2021-03-11T13:43:25.864383+0000","172.21.2.113:0/4101755549":"2021-03-11T13:43:25.864383+0000","172.21.2.113:6801/2579871074":"2021-03-11T13:43:25.864383+0000","172.21.2.113:6800/2579871074":"2021-03-11T13:43:25.864383+0000","172.21.2.113:0/2306552835":"2021-03-11T13:43:12.108225+0000","172.21.2.113:6800/2562375199":"2021-03-11T13:43:12.108225+0000","172.21.2.113:0/1865931294":"2021-03-11T13:43:25.864383+0000","172.21.2.113:6801/2562375199":"2021-03-11T13:43:12.108225+0000","172.21.2.113:0/1874002260":"2021-03-11T13:43:12.108225+0000","172.21.2.113:0/2911839215":"2021-03-11T13:43:12.108225+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-03-10T13:48:28.445 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:28 gibba020 bash[19086]: t=2021-03-10T13:48:28+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist_item table charset" 2021-03-10T13:48:28.783 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:28 gibba020 bash[19086]: t=2021-03-10T13:48:28+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v2" 2021-03-10T13:48:28.784 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:28 gibba020 bash[19086]: t=2021-03-10T13:48:28+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v3" 2021-03-10T13:48:28.785 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:28 gibba020 bash[9782]: audit 2021-03-10T13:48:27.699816+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902084\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902154\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902182\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902208\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902233\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902258\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902283\", \"created\": \"2021-03-10T13:46:03.738924\", \"started\": \"2021-03-10T13:46:06.962147\"}, \"node-exporter.a\": {\"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902308\", \"created\": \"2021-03-10T13:47:56.718923\", \"started\": \"2021-03-10T13:47:58.556074\"}, \"alertmanager.a\": {\"hostname\": \"gibba013\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:48:20.868189\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:48:28.785 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:28 gibba020 bash[9782]: audit 2021-03-10T13:48:27.703724+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902084\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902154\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902182\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902208\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902233\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902258\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902283\", \"created\": \"2021-03-10T13:46:03.738924\", \"started\": \"2021-03-10T13:46:06.962147\"}, \"node-exporter.a\": {\"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902308\", \"created\": \"2021-03-10T13:47:56.718923\", \"started\": \"2021-03-10T13:47:58.556074\"}, \"alertmanager.a\": {\"hostname\": \"gibba013\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:48:20.868189\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:48:28.785 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:28 gibba020 bash[9782]: cephadm 2021-03-10T13:48:27.704316+0000 mgr.y (mgr.14140) 196 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2021-03-10T13:48:28.785 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:28 gibba020 bash[9782]: cephadm 2021-03-10T13:48:27.706636+0000 mgr.y (mgr.14140) 197 : cephadm [INF] Reconfiguring daemon prometheus.a on gibba020 2021-03-10T13:48:28.786 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:28 gibba020 bash[9782]: audit 2021-03-10T13:48:28.166278+0000 mon.a (mon.0) 524 : audit [DBG] from='client.? 172.21.2.113:0/2920568886' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T13:48:28.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:28 gibba013 bash[9767]: audit 2021-03-10T13:48:27.699816+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902084\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902154\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902182\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902208\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902233\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902258\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902283\", \"created\": \"2021-03-10T13:46:03.738924\", \"started\": \"2021-03-10T13:46:06.962147\"}, \"node-exporter.a\": {\"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902308\", \"created\": \"2021-03-10T13:47:56.718923\", \"started\": \"2021-03-10T13:47:58.556074\"}, \"alertmanager.a\": {\"hostname\": \"gibba013\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:48:20.868189\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:48:28.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:28 gibba013 bash[9767]: audit 2021-03-10T13:48:27.703724+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902084\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902154\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902182\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902208\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902233\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902258\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902283\", \"created\": \"2021-03-10T13:46:03.738924\", \"started\": \"2021-03-10T13:46:06.962147\"}, \"node-exporter.a\": {\"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902308\", \"created\": \"2021-03-10T13:47:56.718923\", \"started\": \"2021-03-10T13:47:58.556074\"}, \"alertmanager.a\": {\"hostname\": \"gibba013\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:48:20.868189\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:48:28.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:28 gibba013 bash[9767]: cephadm 2021-03-10T13:48:27.704316+0000 mgr.y (mgr.14140) 196 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2021-03-10T13:48:28.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:28 gibba013 bash[9767]: cephadm 2021-03-10T13:48:27.706636+0000 mgr.y (mgr.14140) 197 : cephadm [INF] Reconfiguring daemon prometheus.a on gibba020 2021-03-10T13:48:28.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:28 gibba013 bash[9767]: audit 2021-03-10T13:48:28.166278+0000 mon.a (mon.0) 524 : audit [DBG] from='client.? 172.21.2.113:0/2920568886' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T13:48:28.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:28 gibba013 bash[13024]: audit 2021-03-10T13:48:27.699816+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902084\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902154\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902182\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902208\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902233\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902258\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902283\", \"created\": \"2021-03-10T13:46:03.738924\", \"started\": \"2021-03-10T13:46:06.962147\"}, \"node-exporter.a\": {\"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902308\", \"created\": \"2021-03-10T13:47:56.718923\", \"started\": \"2021-03-10T13:47:58.556074\"}, \"alertmanager.a\": {\"hostname\": \"gibba013\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:48:20.868189\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:48:28.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:28 gibba013 bash[13024]: audit 2021-03-10T13:48:27.703724+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902084\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902154\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902182\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902208\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902233\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902258\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902283\", \"created\": \"2021-03-10T13:46:03.738924\", \"started\": \"2021-03-10T13:46:06.962147\"}, \"node-exporter.a\": {\"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:19.902308\", \"created\": \"2021-03-10T13:47:56.718923\", \"started\": \"2021-03-10T13:47:58.556074\"}, \"alertmanager.a\": {\"hostname\": \"gibba013\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:48:20.868189\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:48:28.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:28 gibba013 bash[13024]: cephadm 2021-03-10T13:48:27.704316+0000 mgr.y (mgr.14140) 196 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2021-03-10T13:48:28.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:28 gibba013 bash[13024]: cephadm 2021-03-10T13:48:27.706636+0000 mgr.y (mgr.14140) 197 : cephadm [INF] Reconfiguring daemon prometheus.a on gibba020 2021-03-10T13:48:28.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:28 gibba013 bash[13024]: audit 2021-03-10T13:48:28.166278+0000 mon.a (mon.0) 524 : audit [DBG] from='client.? 172.21.2.113:0/2920568886' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T13:48:29.261 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph tell osd.0 flush_pg_stats 2021-03-10T13:48:29.445 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:28 gibba020 bash[19086]: t=2021-03-10T13:48:28+0000 lvl=info msg="Executing migration" logger=migrator id="create preferences table v3" 2021-03-10T13:48:29.445 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:29 gibba020 bash[19086]: t=2021-03-10T13:48:29+0000 lvl=info msg="Executing migration" logger=migrator id="Update preferences table charset" 2021-03-10T13:48:29.445 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:29 gibba020 bash[19086]: t=2021-03-10T13:48:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add column team_id in preferences" 2021-03-10T13:48:29.446 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:29 gibba020 bash[19086]: t=2021-03-10T13:48:29+0000 lvl=info msg="Executing migration" logger=migrator id="Update team_id column values in preferences" 2021-03-10T13:48:29.632 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:48:29 gibba013 bash[21839]: level=info ts=2021-03-10T13:48:29.370Z caller=main.go:216 msg="Starting Alertmanager" version="(version=0.21.0, branch=HEAD, revision=4c6c03ebfe21009c546e4d1e9b92c371d67c021d)" 2021-03-10T13:48:29.632 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:48:29 gibba013 bash[21839]: level=info ts=2021-03-10T13:48:29.370Z caller=main.go:217 build_context="(go=go1.14.4, user=root@dee35927357f, date=20200617-08:54:02)" 2021-03-10T13:48:29.632 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:48:29 gibba013 bash[21839]: level=info ts=2021-03-10T13:48:29.371Z caller=cluster.go:161 component=cluster msg="setting advertise address explicitly" addr=172.21.2.113 port=9094 2021-03-10T13:48:29.633 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:48:29 gibba013 bash[21839]: level=info ts=2021-03-10T13:48:29.372Z caller=cluster.go:623 component=cluster msg="Waiting for gossip to settle..." interval=2s 2021-03-10T13:48:29.633 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:48:29 gibba013 bash[21839]: level=info ts=2021-03-10T13:48:29.386Z caller=coordinator.go:119 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2021-03-10T13:48:29.633 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:48:29 gibba013 bash[21839]: level=info ts=2021-03-10T13:48:29.386Z caller=coordinator.go:131 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2021-03-10T13:48:29.633 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:48:29 gibba013 bash[21839]: level=info ts=2021-03-10T13:48:29.387Z caller=main.go:485 msg=Listening address=:9093 2021-03-10T13:48:29.793 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:29 gibba020 bash[9782]: cluster 2021-03-10T13:48:28.473687+0000 mgr.y (mgr.14140) 198 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:29.793 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:29 gibba020 bash[19086]: t=2021-03-10T13:48:29+0000 lvl=info msg="Executing migration" logger=migrator id="create alert table v1" 2021-03-10T13:48:29.793 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:29 gibba020 bash[19086]: t=2021-03-10T13:48:29+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert org_id & id " 2021-03-10T13:48:29.794 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:29 gibba020 bash[19086]: t=2021-03-10T13:48:29+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert state" 2021-03-10T13:48:30.071 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:29 gibba020 bash[19086]: t=2021-03-10T13:48:29+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert dashboard_id" 2021-03-10T13:48:30.072 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:29 gibba020 bash[19086]: t=2021-03-10T13:48:29+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v1" 2021-03-10T13:48:30.072 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:29 gibba020 bash[19086]: t=2021-03-10T13:48:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_rule_tag.alert_id_tag_id" 2021-03-10T13:48:30.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:29 gibba013 bash[9767]: cluster 2021-03-10T13:48:28.473687+0000 mgr.y (mgr.14140) 198 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:30.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:29 gibba013 bash[13024]: cluster 2021-03-10T13:48:28.473687+0000 mgr.y (mgr.14140) 198 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:30.368 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:30 gibba020 bash[19086]: t=2021-03-10T13:48:30+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification table v1" 2021-03-10T13:48:30.648 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:30 gibba020 bash[19086]: t=2021-03-10T13:48:30+0000 lvl=info msg="Executing migration" logger=migrator id="Add column is_default" 2021-03-10T13:48:30.908 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:30 gibba020 bash[19086]: t=2021-03-10T13:48:30+0000 lvl=info msg="Executing migration" logger=migrator id="Add column frequency" 2021-03-10T13:48:30.909 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:30 gibba020 bash[19086]: t=2021-03-10T13:48:30+0000 lvl=info msg="Executing migration" logger=migrator id="Add column send_reminder" 2021-03-10T13:48:30.909 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:30 gibba020 bash[19086]: t=2021-03-10T13:48:30+0000 lvl=info msg="Executing migration" logger=migrator id="Add column disable_resolve_message" 2021-03-10T13:48:31.632 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:48:31 gibba013 bash[21839]: level=info ts=2021-03-10T13:48:31.372Z caller=cluster.go:648 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000114721s 2021-03-10T13:48:31.695 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:30 gibba020 bash[19086]: t=2021-03-10T13:48:30+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification org_id & name" 2021-03-10T13:48:31.695 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:31 gibba020 bash[19086]: t=2021-03-10T13:48:31+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert table charset" 2021-03-10T13:48:31.695 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:31 gibba020 bash[19086]: t=2021-03-10T13:48:31+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert_notification table charset" 2021-03-10T13:48:31.695 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:31 gibba020 bash[19086]: t=2021-03-10T13:48:31+0000 lvl=info msg="Executing migration" logger=migrator id="create notification_journal table v1" 2021-03-10T13:48:31.905 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:31 gibba020 bash[9782]: cluster 2021-03-10T13:48:30.474560+0000 mgr.y (mgr.14140) 199 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:32.063 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:31 gibba013 bash[9767]: cluster 2021-03-10T13:48:30.474560+0000 mgr.y (mgr.14140) 199 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:32.064 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:31 gibba013 bash[13024]: cluster 2021-03-10T13:48:30.474560+0000 mgr.y (mgr.14140) 199 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:32.064 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:31 gibba020 bash[19086]: t=2021-03-10T13:48:31+0000 lvl=info msg="Executing migration" logger=migrator id="add index notification_journal org_id & alert_id & notifier_id" 2021-03-10T13:48:32.416 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:32 gibba020 bash[19086]: t=2021-03-10T13:48:32+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_notification_journal" 2021-03-10T13:48:32.416 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:32 gibba020 bash[19086]: t=2021-03-10T13:48:32+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification_state table v1" 2021-03-10T13:48:32.417 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:32 gibba020 bash[19086]: t=2021-03-10T13:48:32+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification_state org_id & alert_id & notifier_id" 2021-03-10T13:48:32.632 INFO:teuthology.orchestra.run.gibba013.stdout:42949673004 2021-03-10T13:48:32.632 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph tell osd.1 flush_pg_stats 2021-03-10T13:48:32.685 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:32 gibba020 bash[19086]: t=2021-03-10T13:48:32+0000 lvl=info msg="Executing migration" logger=migrator id="Add for to alert table" 2021-03-10T13:48:32.685 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:32 gibba020 bash[19086]: t=2021-03-10T13:48:32+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in alert_notification" 2021-03-10T13:48:32.685 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:32 gibba020 bash[19086]: t=2021-03-10T13:48:32+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in alert_notification" 2021-03-10T13:48:32.686 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:32 gibba020 bash[19086]: t=2021-03-10T13:48:32+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_notification_org_id_uid" 2021-03-10T13:48:32.945 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:32 gibba020 bash[19086]: t=2021-03-10T13:48:32+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_name" 2021-03-10T13:48:32.945 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:32 gibba020 bash[19086]: t=2021-03-10T13:48:32+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old annotation table v4" 2021-03-10T13:48:33.195 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:33 gibba020 bash[19086]: t=2021-03-10T13:48:33+0000 lvl=info msg="Executing migration" logger=migrator id="create annotation table v5" 2021-03-10T13:48:33.437 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:33 gibba020 bash[19086]: t=2021-03-10T13:48:33+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 0 v3" 2021-03-10T13:48:33.695 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:48:33 gibba020 systemd[1]: Stopping Ceph prometheus.a for 7672acc8-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:48:33.695 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:33 gibba020 bash[19086]: t=2021-03-10T13:48:33+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 1 v3" 2021-03-10T13:48:33.695 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:33 gibba020 bash[19086]: t=2021-03-10T13:48:33+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 2 v3" 2021-03-10T13:48:33.695 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:33 gibba020 bash[19086]: t=2021-03-10T13:48:33+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 3 v3" 2021-03-10T13:48:33.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:33 gibba013 bash[9767]: cluster 2021-03-10T13:48:32.475442+0000 mgr.y (mgr.14140) 200 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:33.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:33 gibba013 bash[13024]: cluster 2021-03-10T13:48:32.475442+0000 mgr.y (mgr.14140) 200 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:34.047 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:33 gibba020 bash[9782]: cluster 2021-03-10T13:48:32.475442+0000 mgr.y (mgr.14140) 200 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:34.047 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:33 gibba020 bash[19086]: t=2021-03-10T13:48:33+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 4 v3" 2021-03-10T13:48:34.048 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:33 gibba020 bash[19086]: t=2021-03-10T13:48:33+0000 lvl=info msg="Executing migration" logger=migrator id="Update annotation table charset" 2021-03-10T13:48:34.048 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:33 gibba020 bash[19086]: t=2021-03-10T13:48:33+0000 lvl=info msg="Executing migration" logger=migrator id="Add column region_id to annotation table" 2021-03-10T13:48:34.048 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:48:33 gibba020 bash[17837]: level=warn ts=2021-03-10T13:48:33.721Z caller=main.go:629 msg="Received SIGTERM, exiting gracefully..." 2021-03-10T13:48:34.048 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:48:33 gibba020 bash[17837]: level=info ts=2021-03-10T13:48:33.721Z caller=main.go:652 msg="Stopping scrape discovery manager..." 2021-03-10T13:48:34.049 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:48:33 gibba020 bash[17837]: level=info ts=2021-03-10T13:48:33.721Z caller=main.go:666 msg="Stopping notify discovery manager..." 2021-03-10T13:48:34.049 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:48:33 gibba020 bash[17837]: level=info ts=2021-03-10T13:48:33.721Z caller=main.go:688 msg="Stopping scrape manager..." 2021-03-10T13:48:34.049 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:48:33 gibba020 bash[17837]: level=info ts=2021-03-10T13:48:33.721Z caller=main.go:648 msg="Scrape discovery manager stopped" 2021-03-10T13:48:34.049 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:48:33 gibba020 bash[17837]: level=info ts=2021-03-10T13:48:33.721Z caller=manager.go:924 component="rule manager" msg="Stopping rule manager..." 2021-03-10T13:48:34.049 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:48:33 gibba020 bash[17837]: level=info ts=2021-03-10T13:48:33.721Z caller=manager.go:934 component="rule manager" msg="Rule manager stopped" 2021-03-10T13:48:34.050 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:48:33 gibba020 bash[17837]: level=info ts=2021-03-10T13:48:33.721Z caller=main.go:682 msg="Scrape manager stopped" 2021-03-10T13:48:34.050 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:48:33 gibba020 bash[17837]: level=info ts=2021-03-10T13:48:33.721Z caller=main.go:662 msg="Notify discovery manager stopped" 2021-03-10T13:48:34.050 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:48:33 gibba020 bash[17837]: level=info ts=2021-03-10T13:48:33.722Z caller=notifier.go:601 component=notifier msg="Stopping notification manager..." 2021-03-10T13:48:34.050 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:48:33 gibba020 bash[17837]: level=info ts=2021-03-10T13:48:33.722Z caller=main.go:856 msg="Notifier manager stopped" 2021-03-10T13:48:34.051 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:48:33 gibba020 bash[17837]: level=info ts=2021-03-10T13:48:33.722Z caller=main.go:868 msg="See you next time!" 2021-03-10T13:48:34.779 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:34 gibba020 bash[19086]: t=2021-03-10T13:48:34+0000 lvl=info msg="Executing migration" logger=migrator id="Drop category_id index" 2021-03-10T13:48:34.779 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:34 gibba020 bash[19086]: t=2021-03-10T13:48:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add column tags to annotation table" 2021-03-10T13:48:34.779 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:34 gibba020 bash[19086]: t=2021-03-10T13:48:34+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v2" 2021-03-10T13:48:34.780 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:34 gibba020 bash[19086]: t=2021-03-10T13:48:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index annotation_tag.annotation_id_tag_id" 2021-03-10T13:48:35.117 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:34 gibba020 bash[19086]: t=2021-03-10T13:48:34+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert annotations and set TEXT to empty" 2021-03-10T13:48:35.117 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:48:34 gibba020 docker[19660]: ceph-7672acc8-81a6-11eb-9080-001a4aab830c-prometheus.a 2021-03-10T13:48:35.117 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:48:34 gibba020 systemd[1]: ceph-7672acc8-81a6-11eb-9080-001a4aab830c@prometheus.a.service: Succeeded. 2021-03-10T13:48:35.118 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:48:34 gibba020 systemd[1]: Stopped Ceph prometheus.a for 7672acc8-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:48:35.118 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:48:34 gibba020 systemd[1]: Starting Ceph prometheus.a for 7672acc8-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:48:35.118 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:48:34 gibba020 docker[19694]: Error: No such container: ceph-7672acc8-81a6-11eb-9080-001a4aab830c-prometheus.a 2021-03-10T13:48:35.118 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:48:34 gibba020 systemd[1]: Started Ceph prometheus.a for 7672acc8-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:48:35.445 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:35 gibba020 bash[19086]: t=2021-03-10T13:48:35+0000 lvl=info msg="Executing migration" logger=migrator id="Add created time to annotation table" 2021-03-10T13:48:35.745 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:35 gibba020 bash[19086]: t=2021-03-10T13:48:35+0000 lvl=info msg="Executing migration" logger=migrator id="Add updated time to annotation table" 2021-03-10T13:48:35.746 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:35 gibba020 bash[19086]: t=2021-03-10T13:48:35+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for created in annotation table" 2021-03-10T13:48:35.865 INFO:teuthology.orchestra.run.gibba013.stdout:68719476777 2021-03-10T13:48:35.866 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph tell osd.2 flush_pg_stats 2021-03-10T13:48:36.093 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:35 gibba020 bash[19086]: t=2021-03-10T13:48:35+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for updated in annotation table" 2021-03-10T13:48:36.094 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:35 gibba020 bash[19086]: t=2021-03-10T13:48:35+0000 lvl=info msg="Executing migration" logger=migrator id="Convert existing annotations from seconds to milliseconds" 2021-03-10T13:48:36.095 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:35 gibba020 bash[9782]: cluster 2021-03-10T13:48:34.476269+0000 mgr.y (mgr.14140) 201 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:36.095 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:35 gibba020 bash[9782]: audit 2021-03-10T13:48:34.820271+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.852473\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.852739\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.852905\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853061\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853212\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853362\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853512\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853808\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853955\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:48:36.095 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:35 gibba020 bash[9782]: audit 2021-03-10T13:48:34.829333+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.852473\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.852739\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.852905\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853061\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853212\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853362\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853512\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853808\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853955\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:48:36.096 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:35 gibba020 bash[9782]: cephadm 2021-03-10T13:48:34.829963+0000 mgr.y (mgr.14140) 202 : cephadm [INF] Setting dashboard grafana config to https://gibba020:3000 2021-03-10T13:48:36.096 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:35 gibba020 bash[9782]: audit 2021-03-10T13:48:34.830214+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config set","value":"https://gibba020:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2021-03-10T13:48:36.096 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:35 gibba020 bash[9782]: audit 2021-03-10T13:48:34.833780+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config set","value":"https://gibba020:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]': finished 2021-03-10T13:48:36.097 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:35 gibba020 bash[9782]: audit 2021-03-10T13:48:34.835849+0000 mon.a (mon.0) 529 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:48:36.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:35 gibba013 bash[9767]: cluster 2021-03-10T13:48:34.476269+0000 mgr.y (mgr.14140) 201 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:36.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:35 gibba013 bash[13024]: cluster 2021-03-10T13:48:34.476269+0000 mgr.y (mgr.14140) 201 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:36.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:35 gibba013 bash[9767]: audit 2021-03-10T13:48:34.820271+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.852473\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.852739\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.852905\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853061\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853212\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853362\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853512\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853808\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853955\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:48:36.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:35 gibba013 bash[13024]: audit 2021-03-10T13:48:34.820271+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.852473\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.852739\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.852905\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853061\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853212\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853362\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853512\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853808\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853955\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:48:36.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:35 gibba013 bash[9767]: audit 2021-03-10T13:48:34.829333+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.852473\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.852739\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.852905\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853061\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853212\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853362\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853512\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853808\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853955\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:48:36.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:35 gibba013 bash[9767]: cephadm 2021-03-10T13:48:34.829963+0000 mgr.y (mgr.14140) 202 : cephadm [INF] Setting dashboard grafana config to https://gibba020:3000 2021-03-10T13:48:36.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:35 gibba013 bash[9767]: audit 2021-03-10T13:48:34.830214+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config set","value":"https://gibba020:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2021-03-10T13:48:36.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:35 gibba013 bash[9767]: audit 2021-03-10T13:48:34.833780+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config set","value":"https://gibba020:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]': finished 2021-03-10T13:48:36.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:35 gibba013 bash[9767]: audit 2021-03-10T13:48:34.835849+0000 mon.a (mon.0) 529 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:48:36.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:35 gibba013 bash[13024]: audit 2021-03-10T13:48:34.829333+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.852473\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.852739\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.852905\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853061\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853212\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853362\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853512\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853808\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:20.853955\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:48:36.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:35 gibba013 bash[13024]: cephadm 2021-03-10T13:48:34.829963+0000 mgr.y (mgr.14140) 202 : cephadm [INF] Setting dashboard grafana config to https://gibba020:3000 2021-03-10T13:48:36.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:35 gibba013 bash[13024]: audit 2021-03-10T13:48:34.830214+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config set","value":"https://gibba020:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2021-03-10T13:48:36.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:35 gibba013 bash[13024]: audit 2021-03-10T13:48:34.833780+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config set","value":"https://gibba020:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]': finished 2021-03-10T13:48:36.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:35 gibba013 bash[13024]: audit 2021-03-10T13:48:34.835849+0000 mon.a (mon.0) 529 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:48:36.356 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:36 gibba020 bash[19086]: t=2021-03-10T13:48:36+0000 lvl=info msg="Executing migration" logger=migrator id="Add epoch_end column" 2021-03-10T13:48:36.356 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:36 gibba020 bash[19086]: t=2021-03-10T13:48:36+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for epoch_end" 2021-03-10T13:48:36.639 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:36 gibba020 bash[19086]: t=2021-03-10T13:48:36+0000 lvl=info msg="Executing migration" logger=migrator id="Make epoch_end the same as epoch" 2021-03-10T13:48:36.639 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:36 gibba020 bash[19086]: t=2021-03-10T13:48:36+0000 lvl=info msg="Executing migration" logger=migrator id="Move region to single row" 2021-03-10T13:48:36.639 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:36 gibba020 bash[19086]: t=2021-03-10T13:48:36+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch from annotation table" 2021-03-10T13:48:36.639 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:36 gibba020 bash[19086]: t=2021-03-10T13:48:36+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2021-03-10T13:48:36.640 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:48:36 gibba020 bash[19712]: level=info ts=2021-03-10T13:48:36.475Z caller=main.go:366 msg="No time or size retention was set so using the default time retention" duration=15d 2021-03-10T13:48:36.640 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:48:36 gibba020 bash[19712]: level=info ts=2021-03-10T13:48:36.475Z caller=main.go:404 msg="Starting Prometheus" version="(version=2.25.0, branch=HEAD, revision=a6be548dbc17780d562a39c0e4bd0bd4c00ad6e2)" 2021-03-10T13:48:36.640 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:48:36 gibba020 bash[19712]: level=info ts=2021-03-10T13:48:36.475Z caller=main.go:409 build_context="(go=go1.15.8, user=root@615f028225c9, date=20210217-14:17:24)" 2021-03-10T13:48:36.640 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:48:36 gibba020 bash[19712]: level=info ts=2021-03-10T13:48:36.475Z caller=main.go:410 host_details="(Linux 5.4.0-66-generic #74-Ubuntu SMP Wed Jan 27 22:54:38 UTC 2021 x86_64 gibba020 (none))" 2021-03-10T13:48:36.641 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:48:36 gibba020 bash[19712]: level=info ts=2021-03-10T13:48:36.475Z caller=main.go:411 fd_limits="(soft=1048576, hard=1048576)" 2021-03-10T13:48:36.641 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:48:36 gibba020 bash[19712]: level=info ts=2021-03-10T13:48:36.475Z caller=main.go:412 vm_limits="(soft=unlimited, hard=unlimited)" 2021-03-10T13:48:36.641 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:48:36 gibba020 bash[19712]: level=info ts=2021-03-10T13:48:36.476Z caller=web.go:532 component=web msg="Start listening for connections" address=:9095 2021-03-10T13:48:36.641 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:48:36 gibba020 bash[19712]: level=info ts=2021-03-10T13:48:36.477Z caller=main.go:779 msg="Starting TSDB ..." 2021-03-10T13:48:36.641 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:48:36 gibba020 bash[19712]: level=info ts=2021-03-10T13:48:36.478Z caller=tls_config.go:191 component=web msg="TLS is disabled." http2=false 2021-03-10T13:48:36.641 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:48:36 gibba020 bash[19712]: level=info ts=2021-03-10T13:48:36.479Z caller=head.go:668 component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2021-03-10T13:48:36.642 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:48:36 gibba020 bash[19712]: level=info ts=2021-03-10T13:48:36.479Z caller=head.go:682 component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.304µs 2021-03-10T13:48:36.642 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:48:36 gibba020 bash[19712]: level=info ts=2021-03-10T13:48:36.479Z caller=head.go:688 component=tsdb msg="Replaying WAL, this may take a while" 2021-03-10T13:48:36.642 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:48:36 gibba020 bash[19712]: level=info ts=2021-03-10T13:48:36.479Z caller=head.go:740 component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2021-03-10T13:48:36.642 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:48:36 gibba020 bash[19712]: level=info ts=2021-03-10T13:48:36.480Z caller=head.go:740 component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2021-03-10T13:48:36.642 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:48:36 gibba020 bash[19712]: level=info ts=2021-03-10T13:48:36.480Z caller=head.go:745 component=tsdb msg="WAL replay completed" checkpoint_replay_duration=15.398µs wal_replay_duration=317.598µs total_replay_duration=345.74µs 2021-03-10T13:48:36.643 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:48:36 gibba020 bash[19712]: level=info ts=2021-03-10T13:48:36.480Z caller=main.go:799 fs_type=XFS_SUPER_MAGIC 2021-03-10T13:48:36.643 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:48:36 gibba020 bash[19712]: level=info ts=2021-03-10T13:48:36.480Z caller=main.go:802 msg="TSDB started" 2021-03-10T13:48:36.643 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:48:36 gibba020 bash[19712]: level=info ts=2021-03-10T13:48:36.480Z caller=main.go:928 msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2021-03-10T13:48:36.643 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:48:36 gibba020 bash[19712]: level=info ts=2021-03-10T13:48:36.481Z caller=main.go:959 msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=407.438µs remote_storage=739ns web_handler=164ns query_engine=418ns scrape=188.301µs scrape_sd=18.66µs notify=10.834µs notify_sd=5.568µs rules=19.452µs 2021-03-10T13:48:36.644 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 13:48:36 gibba020 bash[19712]: level=info ts=2021-03-10T13:48:36.481Z caller=main.go:751 msg="Server is ready to receive web requests." 2021-03-10T13:48:36.942 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:36 gibba020 bash[19086]: t=2021-03-10T13:48:36+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2021-03-10T13:48:36.943 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:36 gibba020 bash[19086]: t=2021-03-10T13:48:36+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_epoch_end_epoch on annotation table" 2021-03-10T13:48:36.943 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:36 gibba020 bash[19086]: t=2021-03-10T13:48:36+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch_epoch_end from annotation table" 2021-03-10T13:48:36.943 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:36 gibba020 bash[19086]: t=2021-03-10T13:48:36+0000 lvl=info msg="Executing migration" logger=migrator id="create test_data table" 2021-03-10T13:48:36.943 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:36 gibba020 bash[19086]: t=2021-03-10T13:48:36+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_version table v1" 2021-03-10T13:48:36.944 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:36 gibba020 bash[9782]: audit 2021-03-10T13:48:35.765919+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765001\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765063\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765092\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765118\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765145\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765170\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765196\", \"created\": \"2021-03-10T13:46:03.738924\", \"started\": \"2021-03-10T13:46:06.962147\"}, \"node-exporter.a\": {\"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765221\", \"created\": \"2021-03-10T13:47:56.718923\", \"started\": \"2021-03-10T13:47:58.556074\"}, \"alertmanager.a\": {\"hostname\": \"gibba013\", \"container_id\": \"a890668984ec\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765247\", \"created\": \"2021-03-10T13:48:06.706923\", \"started\": \"2021-03-10T13:48:27.713709\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:48:20.868189\"}}, \"last_daemon_update\": \"2021-03-10T13:48:35.765307\", \"last_device_update\": \"2021-03-10T13:46:10.457486\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:48:36.944 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:36 gibba020 bash[9782]: audit 2021-03-10T13:48:35.768914+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765001\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765063\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765092\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765118\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765145\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765170\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765196\", \"created\": \"2021-03-10T13:46:03.738924\", \"started\": \"2021-03-10T13:46:06.962147\"}, \"node-exporter.a\": {\"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765221\", \"created\": \"2021-03-10T13:47:56.718923\", \"started\": \"2021-03-10T13:47:58.556074\"}, \"alertmanager.a\": {\"hostname\": \"gibba013\", \"container_id\": \"a890668984ec\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765247\", \"created\": \"2021-03-10T13:48:06.706923\", \"started\": \"2021-03-10T13:48:27.713709\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:48:20.868189\"}}, \"last_daemon_update\": \"2021-03-10T13:48:35.765307\", \"last_device_update\": \"2021-03-10T13:46:10.457486\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:48:36.944 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:36 gibba020 bash[9782]: audit 2021-03-10T13:48:35.769431+0000 mon.a (mon.0) 532 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:48:37.005 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:36 gibba013 bash[9767]: audit 2021-03-10T13:48:35.765919+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765001\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765063\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765092\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765118\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765145\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765170\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765196\", \"created\": \"2021-03-10T13:46:03.738924\", \"started\": \"2021-03-10T13:46:06.962147\"}, \"node-exporter.a\": {\"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765221\", \"created\": \"2021-03-10T13:47:56.718923\", \"started\": \"2021-03-10T13:47:58.556074\"}, \"alertmanager.a\": {\"hostname\": \"gibba013\", \"container_id\": \"a890668984ec\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765247\", \"created\": \"2021-03-10T13:48:06.706923\", \"started\": \"2021-03-10T13:48:27.713709\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:48:20.868189\"}}, \"last_daemon_update\": \"2021-03-10T13:48:35.765307\", \"last_device_update\": \"2021-03-10T13:46:10.457486\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:48:37.005 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:36 gibba013 bash[13024]: audit 2021-03-10T13:48:35.765919+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765001\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765063\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765092\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765118\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765145\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765170\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765196\", \"created\": \"2021-03-10T13:46:03.738924\", \"started\": \"2021-03-10T13:46:06.962147\"}, \"node-exporter.a\": {\"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765221\", \"created\": \"2021-03-10T13:47:56.718923\", \"started\": \"2021-03-10T13:47:58.556074\"}, \"alertmanager.a\": {\"hostname\": \"gibba013\", \"container_id\": \"a890668984ec\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765247\", \"created\": \"2021-03-10T13:48:06.706923\", \"started\": \"2021-03-10T13:48:27.713709\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:48:20.868189\"}}, \"last_daemon_update\": \"2021-03-10T13:48:35.765307\", \"last_device_update\": \"2021-03-10T13:46:10.457486\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]: dispatch 2021-03-10T13:48:37.006 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:36 gibba013 bash[9767]: audit 2021-03-10T13:48:35.768914+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765001\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765063\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765092\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765118\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765145\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765170\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765196\", \"created\": \"2021-03-10T13:46:03.738924\", \"started\": \"2021-03-10T13:46:06.962147\"}, \"node-exporter.a\": {\"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765221\", \"created\": \"2021-03-10T13:47:56.718923\", \"started\": \"2021-03-10T13:47:58.556074\"}, \"alertmanager.a\": {\"hostname\": \"gibba013\", \"container_id\": \"a890668984ec\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765247\", \"created\": \"2021-03-10T13:48:06.706923\", \"started\": \"2021-03-10T13:48:27.713709\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:48:20.868189\"}}, \"last_daemon_update\": \"2021-03-10T13:48:35.765307\", \"last_device_update\": \"2021-03-10T13:46:10.457486\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:48:37.006 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:36 gibba013 bash[9767]: audit 2021-03-10T13:48:35.769431+0000 mon.a (mon.0) 532 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:48:37.007 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:36 gibba013 bash[13024]: audit 2021-03-10T13:48:35.768914+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765001\", \"created\": \"2021-03-10T13:42:54.241467\", \"started\": \"2021-03-10T13:42:59.367378\"}, \"mgr.y\": {\"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765063\", \"created\": \"2021-03-10T13:43:01.281467\", \"started\": \"2021-03-10T13:43:01.306356\"}, \"mon.c\": {\"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765092\", \"created\": \"2021-03-10T13:44:05.649466\", \"started\": \"2021-03-10T13:44:05.674115\"}, \"osd.0\": {\"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765118\", \"created\": \"2021-03-10T13:44:55.289466\", \"started\": \"2021-03-10T13:44:58.251046\"}, \"osd.1\": {\"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765145\", \"created\": \"2021-03-10T13:45:17.385465\", \"started\": \"2021-03-10T13:45:20.657219\"}, \"osd.2\": {\"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765170\", \"created\": \"2021-03-10T13:45:39.785465\", \"started\": \"2021-03-10T13:45:43.590638\"}, \"osd.3\": {\"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765196\", \"created\": \"2021-03-10T13:46:03.738924\", \"started\": \"2021-03-10T13:46:06.962147\"}, \"node-exporter.a\": {\"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765221\", \"created\": \"2021-03-10T13:47:56.718923\", \"started\": \"2021-03-10T13:47:58.556074\"}, \"alertmanager.a\": {\"hostname\": \"gibba013\", \"container_id\": \"a890668984ec\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:35.765247\", \"created\": \"2021-03-10T13:48:06.706923\", \"started\": \"2021-03-10T13:48:27.713709\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:48:20.868189\"}}, \"last_daemon_update\": \"2021-03-10T13:48:35.765307\", \"last_device_update\": \"2021-03-10T13:46:10.457486\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394\"}"}]': finished 2021-03-10T13:48:37.007 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:36 gibba013 bash[13024]: audit 2021-03-10T13:48:35.769431+0000 mon.a (mon.0) 532 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:48:37.195 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:36 gibba020 bash[19086]: t=2021-03-10T13:48:36+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_version.dashboard_id" 2021-03-10T13:48:37.195 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:37 gibba020 bash[19086]: t=2021-03-10T13:48:37+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2021-03-10T13:48:37.196 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:37 gibba020 bash[19086]: t=2021-03-10T13:48:37+0000 lvl=info msg="Executing migration" logger=migrator id="Set dashboard version to 1 where 0" 2021-03-10T13:48:37.196 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:37 gibba020 bash[19086]: t=2021-03-10T13:48:37+0000 lvl=info msg="Executing migration" logger=migrator id="save existing dashboard data in dashboard_version table v1" 2021-03-10T13:48:37.471 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:37 gibba020 bash[19086]: t=2021-03-10T13:48:37+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_version.data to mediumtext v1" 2021-03-10T13:48:37.471 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:37 gibba020 bash[19086]: t=2021-03-10T13:48:37+0000 lvl=info msg="Executing migration" logger=migrator id="create team table" 2021-03-10T13:48:37.471 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:37 gibba020 bash[19086]: t=2021-03-10T13:48:37+0000 lvl=info msg="Executing migration" logger=migrator id="add index team.org_id" 2021-03-10T13:48:37.756 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:37 gibba020 bash[19086]: t=2021-03-10T13:48:37+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_org_id_name" 2021-03-10T13:48:37.756 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:37 gibba020 bash[19086]: t=2021-03-10T13:48:37+0000 lvl=info msg="Executing migration" logger=migrator id="create team member table" 2021-03-10T13:48:37.756 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:37 gibba020 bash[19086]: t=2021-03-10T13:48:37+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.org_id" 2021-03-10T13:48:37.756 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:37 gibba020 bash[19086]: t=2021-03-10T13:48:37+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_member_org_id_team_id_user_id" 2021-03-10T13:48:37.757 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:37 gibba020 bash[19086]: t=2021-03-10T13:48:37+0000 lvl=info msg="Executing migration" logger=migrator id="Add column email to team table" 2021-03-10T13:48:37.890 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:37 gibba013 bash[9767]: cluster 2021-03-10T13:48:36.477083+0000 mgr.y (mgr.14140) 203 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:37.890 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:37 gibba013 bash[9767]: audit 2021-03-10T13:48:36.988397+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987404\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987464\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987492\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987518\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987545\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987570\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987596\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987622\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:48:34.834688\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987647\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987672\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}}, \"last_daemon_update\": \"2021-03-10T13:48:36.987733\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:48:37.891 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:37 gibba013 bash[9767]: audit 2021-03-10T13:48:36.991419+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987404\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987464\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987492\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987518\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987545\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987570\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987596\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987622\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:48:34.834688\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987647\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987672\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}}, \"last_daemon_update\": \"2021-03-10T13:48:36.987733\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:48:38.024 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:37 gibba020 bash[19086]: t=2021-03-10T13:48:37+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external to team_member table" 2021-03-10T13:48:38.024 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:37 gibba020 bash[19086]: t=2021-03-10T13:48:37+0000 lvl=info msg="Executing migration" logger=migrator id="Add column permission to team_member table" 2021-03-10T13:48:38.024 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:37 gibba020 bash[19086]: t=2021-03-10T13:48:37+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard acl table" 2021-03-10T13:48:38.025 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:37 gibba020 bash[9782]: cluster 2021-03-10T13:48:36.477083+0000 mgr.y (mgr.14140) 203 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:38.025 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:37 gibba020 bash[9782]: audit 2021-03-10T13:48:36.988397+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987404\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987464\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987492\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987518\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987545\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987570\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987596\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987622\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:48:34.834688\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987647\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987672\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}}, \"last_daemon_update\": \"2021-03-10T13:48:36.987733\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:48:38.026 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:37 gibba020 bash[9782]: audit 2021-03-10T13:48:36.991419+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987404\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987464\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987492\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987518\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987545\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987570\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987596\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987622\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:48:34.834688\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987647\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987672\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}}, \"last_daemon_update\": \"2021-03-10T13:48:36.987733\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:48:38.326 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:38 gibba020 bash[19086]: t=2021-03-10T13:48:38+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_dashboard_id" 2021-03-10T13:48:38.327 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:38 gibba020 bash[19086]: t=2021-03-10T13:48:38+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_user_id" 2021-03-10T13:48:38.327 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:38 gibba020 bash[19086]: t=2021-03-10T13:48:38+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_team_id" 2021-03-10T13:48:38.327 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:38 gibba020 bash[19086]: t=2021-03-10T13:48:38+0000 lvl=info msg="Executing migration" logger=migrator id="save default acl rules in dashboard_acl table" 2021-03-10T13:48:38.327 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:38 gibba020 bash[19086]: t=2021-03-10T13:48:38+0000 lvl=info msg="Executing migration" logger=migrator id="create tag table" 2021-03-10T13:48:38.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:37 gibba013 bash[13024]: cluster 2021-03-10T13:48:36.477083+0000 mgr.y (mgr.14140) 203 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:38.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:37 gibba013 bash[13024]: audit 2021-03-10T13:48:36.988397+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987404\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987464\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987492\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987518\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987545\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987570\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987596\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987622\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:48:34.834688\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987647\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987672\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}}, \"last_daemon_update\": \"2021-03-10T13:48:36.987733\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:48:38.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:37 gibba013 bash[13024]: audit 2021-03-10T13:48:36.991419+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987404\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987464\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987492\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987518\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987545\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987570\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987596\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987622\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:48:34.834688\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987647\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987672\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}}, \"last_daemon_update\": \"2021-03-10T13:48:36.987733\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:48:38.628 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:38 gibba020 bash[19086]: t=2021-03-10T13:48:38+0000 lvl=info msg="Executing migration" logger=migrator id="add index tag.key_value" 2021-03-10T13:48:38.629 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:38 gibba020 bash[19086]: t=2021-03-10T13:48:38+0000 lvl=info msg="Executing migration" logger=migrator id="create login attempt table" 2021-03-10T13:48:38.629 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:38 gibba020 bash[19086]: t=2021-03-10T13:48:38+0000 lvl=info msg="Executing migration" logger=migrator id="add index login_attempt.username" 2021-03-10T13:48:38.630 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:38 gibba020 bash[19086]: t=2021-03-10T13:48:38+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_login_attempt_username - v1" 2021-03-10T13:48:38.630 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:38 gibba020 bash[19086]: t=2021-03-10T13:48:38+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2021-03-10T13:48:38.913 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:38 gibba020 bash[19086]: t=2021-03-10T13:48:38+0000 lvl=info msg="Executing migration" logger=migrator id="create login_attempt v2" 2021-03-10T13:48:38.913 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:38 gibba020 bash[19086]: t=2021-03-10T13:48:38+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_login_attempt_username - v2" 2021-03-10T13:48:38.914 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:38 gibba020 bash[19086]: t=2021-03-10T13:48:38+0000 lvl=info msg="Executing migration" logger=migrator id="copy login_attempt v1 to v2" 2021-03-10T13:48:39.181 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:38 gibba020 bash[19086]: t=2021-03-10T13:48:38+0000 lvl=info msg="Executing migration" logger=migrator id="drop login_attempt_tmp_qwerty" 2021-03-10T13:48:39.181 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:38 gibba020 bash[19086]: t=2021-03-10T13:48:38+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth table" 2021-03-10T13:48:39.182 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:39 gibba020 bash[19086]: t=2021-03-10T13:48:39+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_user_auth_auth_module_auth_id - v1" 2021-03-10T13:48:39.182 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:39 gibba020 bash[19086]: t=2021-03-10T13:48:39+0000 lvl=info msg="Executing migration" logger=migrator id="alter user_auth.auth_id to length 190" 2021-03-10T13:48:39.182 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:39 gibba020 bash[19086]: t=2021-03-10T13:48:39+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth access token to user_auth" 2021-03-10T13:48:39.212 INFO:teuthology.orchestra.run.gibba013.stdout:90194313252 2021-03-10T13:48:39.213 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph tell osd.3 flush_pg_stats 2021-03-10T13:48:39.445 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:39 gibba020 bash[19086]: t=2021-03-10T13:48:39+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth refresh token to user_auth" 2021-03-10T13:48:39.445 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:39 gibba020 bash[19086]: t=2021-03-10T13:48:39+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth token type to user_auth" 2021-03-10T13:48:39.445 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:39 gibba020 bash[19086]: t=2021-03-10T13:48:39+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth expiry to user_auth" 2021-03-10T13:48:39.445 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:39 gibba020 bash[19086]: t=2021-03-10T13:48:39+0000 lvl=info msg="Executing migration" logger=migrator id="Add index to user_id column in user_auth" 2021-03-10T13:48:39.634 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:48:39 gibba013 bash[21839]: level=info ts=2021-03-10T13:48:39.373Z caller=cluster.go:640 component=cluster msg="gossip settled; proceeding" elapsed=10.000950042s 2021-03-10T13:48:39.769 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:39 gibba020 bash[19086]: t=2021-03-10T13:48:39+0000 lvl=info msg="Executing migration" logger=migrator id="create server_lock table" 2021-03-10T13:48:39.769 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:39 gibba020 bash[19086]: t=2021-03-10T13:48:39+0000 lvl=info msg="Executing migration" logger=migrator id="add index server_lock.operation_uid" 2021-03-10T13:48:39.769 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:39 gibba020 bash[19086]: t=2021-03-10T13:48:39+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth token table" 2021-03-10T13:48:39.769 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:39 gibba020 bash[19086]: t=2021-03-10T13:48:39+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.auth_token" 2021-03-10T13:48:39.770 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:39 gibba020 bash[19086]: t=2021-03-10T13:48:39+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.prev_auth_token" 2021-03-10T13:48:39.770 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:39 gibba020 bash[19086]: t=2021-03-10T13:48:39+0000 lvl=info msg="Executing migration" logger=migrator id="create cache_data table" 2021-03-10T13:48:40.036 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:39 gibba020 bash[9782]: cluster 2021-03-10T13:48:38.477441+0000 mgr.y (mgr.14140) 204 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:40.037 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:39 gibba020 bash[19086]: t=2021-03-10T13:48:39+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index cache_data.cache_key" 2021-03-10T13:48:40.037 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:39 gibba020 bash[19086]: t=2021-03-10T13:48:39+0000 lvl=info msg="Created default admin" logger=sqlstore user=admin 2021-03-10T13:48:40.037 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:39 gibba020 bash[19086]: t=2021-03-10T13:48:39+0000 lvl=info msg="Initializing HTTPServer" logger=server 2021-03-10T13:48:40.037 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:39 gibba020 bash[19086]: t=2021-03-10T13:48:39+0000 lvl=info msg="Initializing BackendPluginManager" logger=server 2021-03-10T13:48:40.038 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:39 gibba020 bash[19086]: t=2021-03-10T13:48:39+0000 lvl=info msg="Initializing PluginManager" logger=server 2021-03-10T13:48:40.038 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:39 gibba020 bash[19086]: t=2021-03-10T13:48:39+0000 lvl=info msg="Starting plugin search" logger=plugins 2021-03-10T13:48:40.038 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:39 gibba020 bash[19086]: t=2021-03-10T13:48:39+0000 lvl=info msg="Registering plugin" logger=plugins name="Pie Chart" 2021-03-10T13:48:40.038 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:39 gibba020 bash[19086]: t=2021-03-10T13:48:39+0000 lvl=info msg="Registering plugin" logger=plugins name="Status Panel" 2021-03-10T13:48:40.039 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:39 gibba020 bash[19086]: t=2021-03-10T13:48:39+0000 lvl=info msg="Initializing HooksService" logger=server 2021-03-10T13:48:40.039 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:39 gibba020 bash[19086]: t=2021-03-10T13:48:39+0000 lvl=info msg="Initializing OSSLicensingService" logger=server 2021-03-10T13:48:40.039 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:39 gibba020 bash[19086]: t=2021-03-10T13:48:39+0000 lvl=info msg="Initializing InternalMetricsService" logger=server 2021-03-10T13:48:40.039 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:39 gibba020 bash[19086]: t=2021-03-10T13:48:39+0000 lvl=info msg="Initializing RemoteCache" logger=server 2021-03-10T13:48:40.040 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:39 gibba020 bash[19086]: t=2021-03-10T13:48:39+0000 lvl=info msg="Initializing QuotaService" logger=server 2021-03-10T13:48:40.040 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:39 gibba020 bash[19086]: t=2021-03-10T13:48:39+0000 lvl=info msg="Initializing ServerLockService" logger=server 2021-03-10T13:48:40.040 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:39 gibba020 bash[19086]: t=2021-03-10T13:48:39+0000 lvl=info msg="Initializing UserAuthTokenService" logger=server 2021-03-10T13:48:40.040 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:39 gibba020 bash[19086]: t=2021-03-10T13:48:39+0000 lvl=info msg="Initializing RenderingService" logger=server 2021-03-10T13:48:40.040 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:39 gibba020 bash[19086]: t=2021-03-10T13:48:39+0000 lvl=info msg="Initializing AlertEngine" logger=server 2021-03-10T13:48:40.041 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:39 gibba020 bash[19086]: t=2021-03-10T13:48:39+0000 lvl=info msg="Initializing DatasourceCacheService" logger=server 2021-03-10T13:48:40.041 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:39 gibba020 bash[19086]: t=2021-03-10T13:48:39+0000 lvl=info msg="Initializing LoginService" logger=server 2021-03-10T13:48:40.041 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:39 gibba020 bash[19086]: t=2021-03-10T13:48:39+0000 lvl=info msg="Initializing SearchService" logger=server 2021-03-10T13:48:40.041 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:39 gibba020 bash[19086]: t=2021-03-10T13:48:39+0000 lvl=info msg="Initializing TracingService" logger=server 2021-03-10T13:48:40.041 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:39 gibba020 bash[19086]: t=2021-03-10T13:48:39+0000 lvl=info msg="Initializing UsageStatsService" logger=server 2021-03-10T13:48:40.042 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:39 gibba020 bash[19086]: t=2021-03-10T13:48:39+0000 lvl=info msg="Initializing CleanUpService" logger=server 2021-03-10T13:48:40.042 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:39 gibba020 bash[19086]: t=2021-03-10T13:48:39+0000 lvl=info msg="Initializing NotificationService" logger=server 2021-03-10T13:48:40.042 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:39 gibba020 bash[19086]: t=2021-03-10T13:48:39+0000 lvl=info msg="Initializing provisioningServiceImpl" logger=server 2021-03-10T13:48:40.042 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:39 gibba020 bash[19086]: t=2021-03-10T13:48:39+0000 lvl=warn msg="[Deprecated] the datasource provisioning config is outdated. please upgrade" logger=provisioning.datasources filename=/etc/grafana/provisioning/datasources/ceph-dashboard.yml 2021-03-10T13:48:40.043 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:39 gibba020 bash[19086]: t=2021-03-10T13:48:39+0000 lvl=info msg="inserting datasource from configuration " logger=provisioning.datasources name="Dashboard 1" 2021-03-10T13:48:40.119 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:39 gibba013 bash[9767]: cluster 2021-03-10T13:48:38.477441+0000 mgr.y (mgr.14140) 204 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:40.120 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:39 gibba013 bash[13024]: cluster 2021-03-10T13:48:38.477441+0000 mgr.y (mgr.14140) 204 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:40.445 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:40 gibba020 bash[19086]: t=2021-03-10T13:48:40+0000 lvl=info msg="Backend rendering via phantomJS" logger=rendering renderer=phantomJS 2021-03-10T13:48:40.445 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:40 gibba020 bash[19086]: t=2021-03-10T13:48:40+0000 lvl=warn msg="phantomJS is deprecated and will be removed in a future release. You should consider migrating from phantomJS to grafana-image-renderer plugin." logger=rendering renderer=phantomJS 2021-03-10T13:48:40.446 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:40 gibba020 bash[19086]: t=2021-03-10T13:48:40+0000 lvl=info msg="Initializing Stream Manager" 2021-03-10T13:48:40.446 INFO:journalctl@ceph.grafana.a.gibba020.stdout:Mar 10 13:48:40 gibba020 bash[19086]: t=2021-03-10T13:48:40+0000 lvl=info msg="HTTP Server Listen" logger=http.server address=127.0.0.1:3000 protocol=https subUrl= socket= 2021-03-10T13:48:41.791 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:41 gibba013 bash[9767]: cluster 2021-03-10T13:48:40.478109+0000 mgr.y (mgr.14140) 205 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:41.791 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:41 gibba013 bash[13024]: cluster 2021-03-10T13:48:40.478109+0000 mgr.y (mgr.14140) 205 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:41.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:41 gibba020 bash[9782]: cluster 2021-03-10T13:48:40.478109+0000 mgr.y (mgr.14140) 205 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:42.549 INFO:teuthology.orchestra.run.gibba013.stdout:115964117025 2021-03-10T13:48:42.550 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph tell osd.4 flush_pg_stats 2021-03-10T13:48:43.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:43 gibba013 bash[9767]: cluster 2021-03-10T13:48:42.478824+0000 mgr.y (mgr.14140) 206 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:43.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:43 gibba013 bash[13024]: cluster 2021-03-10T13:48:42.478824+0000 mgr.y (mgr.14140) 206 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:43.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:43 gibba020 bash[9782]: cluster 2021-03-10T13:48:42.478824+0000 mgr.y (mgr.14140) 206 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:45.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:45 gibba013 bash[9767]: cluster 2021-03-10T13:48:44.479746+0000 mgr.y (mgr.14140) 207 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:45.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:45 gibba013 bash[13024]: cluster 2021-03-10T13:48:44.479746+0000 mgr.y (mgr.14140) 207 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:45.762 INFO:teuthology.orchestra.run.gibba013.stdout:137438953500 2021-03-10T13:48:45.763 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph tell osd.5 flush_pg_stats 2021-03-10T13:48:45.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:45 gibba020 bash[9782]: cluster 2021-03-10T13:48:44.479746+0000 mgr.y (mgr.14140) 207 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:47.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:47 gibba013 bash[9767]: cluster 2021-03-10T13:48:46.480524+0000 mgr.y (mgr.14140) 208 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:47.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:47 gibba013 bash[13024]: cluster 2021-03-10T13:48:46.480524+0000 mgr.y (mgr.14140) 208 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:47.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:47 gibba020 bash[9782]: cluster 2021-03-10T13:48:46.480524+0000 mgr.y (mgr.14140) 208 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:49.025 INFO:teuthology.orchestra.run.gibba013.stdout:158913789978 2021-03-10T13:48:49.026 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph tell osd.6 flush_pg_stats 2021-03-10T13:48:49.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:49 gibba013 bash[9767]: cluster 2021-03-10T13:48:48.481068+0000 mgr.y (mgr.14140) 209 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:49.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:49 gibba013 bash[13024]: cluster 2021-03-10T13:48:48.481068+0000 mgr.y (mgr.14140) 209 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:49.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:49 gibba020 bash[9782]: cluster 2021-03-10T13:48:48.481068+0000 mgr.y (mgr.14140) 209 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:51.813 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:51 gibba013 bash[9767]: cluster 2021-03-10T13:48:50.481682+0000 mgr.y (mgr.14140) 210 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:51.814 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:51 gibba013 bash[13024]: cluster 2021-03-10T13:48:50.481682+0000 mgr.y (mgr.14140) 210 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:51.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:51 gibba020 bash[9782]: cluster 2021-03-10T13:48:50.481682+0000 mgr.y (mgr.14140) 210 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:52.213 INFO:teuthology.orchestra.run.gibba013.stdout:180388626453 2021-03-10T13:48:52.214 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph tell osd.7 flush_pg_stats 2021-03-10T13:48:53.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:53 gibba013 bash[9767]: cluster 2021-03-10T13:48:52.482659+0000 mgr.y (mgr.14140) 211 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:53.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:53 gibba013 bash[13024]: cluster 2021-03-10T13:48:52.482659+0000 mgr.y (mgr.14140) 211 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:53.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:53 gibba020 bash[9782]: cluster 2021-03-10T13:48:52.482659+0000 mgr.y (mgr.14140) 211 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:55.504 INFO:teuthology.orchestra.run.gibba013.stdout:201863462930 2021-03-10T13:48:55.504 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph osd last-stat-seq osd.0 2021-03-10T13:48:55.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:55 gibba013 bash[9767]: cluster 2021-03-10T13:48:54.483522+0000 mgr.y (mgr.14140) 212 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:55.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:55 gibba013 bash[13024]: cluster 2021-03-10T13:48:54.483522+0000 mgr.y (mgr.14140) 212 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:55.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:55 gibba020 bash[9782]: cluster 2021-03-10T13:48:54.483522+0000 mgr.y (mgr.14140) 212 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:57.845 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:57 gibba013 bash[9767]: cluster 2021-03-10T13:48:56.484197+0000 mgr.y (mgr.14140) 213 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:57.845 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:57 gibba013 bash[13024]: cluster 2021-03-10T13:48:56.484197+0000 mgr.y (mgr.14140) 213 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:57.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:57 gibba020 bash[9782]: cluster 2021-03-10T13:48:56.484197+0000 mgr.y (mgr.14140) 213 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:58.125 INFO:teuthology.orchestra.run.gibba013.stdout:42949673009 2021-03-10T13:48:58.817 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:58 gibba013 bash[9767]: audit 2021-03-10T13:48:58.122670+0000 mon.c (mon.1) 14 : audit [DBG] from='client.? 172.21.2.113:0/2722033579' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-03-10T13:48:58.817 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:58 gibba013 bash[13024]: audit 2021-03-10T13:48:58.122670+0000 mon.c (mon.1) 14 : audit [DBG] from='client.? 172.21.2.113:0/2722033579' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-03-10T13:48:58.819 INFO:tasks.cephadm.ceph_manager.ceph:need seq 42949673004 got 42949673009 for osd.0 2021-03-10T13:48:58.819 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph osd last-stat-seq osd.1 2021-03-10T13:48:58.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:58 gibba020 bash[9782]: audit 2021-03-10T13:48:58.122670+0000 mon.c (mon.1) 14 : audit [DBG] from='client.? 172.21.2.113:0/2722033579' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-03-10T13:48:59.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:48:59 gibba013 bash[9767]: cluster 2021-03-10T13:48:58.485060+0000 mgr.y (mgr.14140) 214 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:59.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:48:59 gibba013 bash[13024]: cluster 2021-03-10T13:48:58.485060+0000 mgr.y (mgr.14140) 214 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:48:59.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:48:59 gibba020 bash[9782]: cluster 2021-03-10T13:48:58.485060+0000 mgr.y (mgr.14140) 214 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:01.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:01 gibba013 bash[9767]: cluster 2021-03-10T13:49:00.485891+0000 mgr.y (mgr.14140) 215 : cluster [DBG] pgmap v203: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:01.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:01 gibba013 bash[13024]: cluster 2021-03-10T13:49:00.485891+0000 mgr.y (mgr.14140) 215 : cluster [DBG] pgmap v203: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:01.691 INFO:teuthology.orchestra.run.gibba013.stdout:68719476782 2021-03-10T13:49:01.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:01 gibba020 bash[9782]: cluster 2021-03-10T13:49:00.485891+0000 mgr.y (mgr.14140) 215 : cluster [DBG] pgmap v203: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:02.328 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476777 got 68719476782 for osd.1 2021-03-10T13:49:02.329 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph osd last-stat-seq osd.2 2021-03-10T13:49:02.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:02 gibba013 bash[9767]: audit 2021-03-10T13:49:01.688554+0000 mon.c (mon.1) 15 : audit [DBG] from='client.? 172.21.2.113:0/1488886620' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-03-10T13:49:02.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:02 gibba013 bash[13024]: audit 2021-03-10T13:49:01.688554+0000 mon.c (mon.1) 15 : audit [DBG] from='client.? 172.21.2.113:0/1488886620' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-03-10T13:49:02.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:02 gibba020 bash[9782]: audit 2021-03-10T13:49:01.688554+0000 mon.c (mon.1) 15 : audit [DBG] from='client.? 172.21.2.113:0/1488886620' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-03-10T13:49:03.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:03 gibba013 bash[9767]: cluster 2021-03-10T13:49:02.486674+0000 mgr.y (mgr.14140) 216 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:03.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:03 gibba013 bash[13024]: cluster 2021-03-10T13:49:02.486674+0000 mgr.y (mgr.14140) 216 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:03.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:03 gibba020 bash[9782]: cluster 2021-03-10T13:49:02.486674+0000 mgr.y (mgr.14140) 216 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:05.190 INFO:teuthology.orchestra.run.gibba013.stdout:90194313257 2021-03-10T13:49:05.777 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:05 gibba013 bash[9767]: cluster 2021-03-10T13:49:04.487641+0000 mgr.y (mgr.14140) 217 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:05.778 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:05 gibba013 bash[9767]: audit 2021-03-10T13:49:05.187582+0000 mon.a (mon.0) 535 : audit [DBG] from='client.? 172.21.2.113:0/3855596295' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-03-10T13:49:05.778 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:05 gibba013 bash[13024]: cluster 2021-03-10T13:49:04.487641+0000 mgr.y (mgr.14140) 217 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:05.778 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:05 gibba013 bash[13024]: audit 2021-03-10T13:49:05.187582+0000 mon.a (mon.0) 535 : audit [DBG] from='client.? 172.21.2.113:0/3855596295' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-03-10T13:49:05.779 INFO:tasks.cephadm.ceph_manager.ceph:need seq 90194313252 got 90194313257 for osd.2 2021-03-10T13:49:05.780 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph osd last-stat-seq osd.3 2021-03-10T13:49:05.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:05 gibba020 bash[9782]: cluster 2021-03-10T13:49:04.487641+0000 mgr.y (mgr.14140) 217 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:05.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:05 gibba020 bash[9782]: audit 2021-03-10T13:49:05.187582+0000 mon.a (mon.0) 535 : audit [DBG] from='client.? 172.21.2.113:0/3855596295' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-03-10T13:49:07.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:07 gibba013 bash[9767]: cluster 2021-03-10T13:49:06.488507+0000 mgr.y (mgr.14140) 218 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:07.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:07 gibba013 bash[13024]: cluster 2021-03-10T13:49:06.488507+0000 mgr.y (mgr.14140) 218 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:07.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:07 gibba020 bash[9782]: cluster 2021-03-10T13:49:06.488507+0000 mgr.y (mgr.14140) 218 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:08.658 INFO:teuthology.orchestra.run.gibba013.stdout:115964117030 2021-03-10T13:49:09.316 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117025 got 115964117030 for osd.3 2021-03-10T13:49:09.316 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph osd last-stat-seq osd.4 2021-03-10T13:49:09.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:09 gibba020 bash[9782]: cluster 2021-03-10T13:49:08.488907+0000 mgr.y (mgr.14140) 219 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:09.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:09 gibba020 bash[9782]: audit 2021-03-10T13:49:08.655638+0000 mon.c (mon.1) 16 : audit [DBG] from='client.? 172.21.2.113:0/2763037976' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-03-10T13:49:10.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:09 gibba013 bash[9767]: cluster 2021-03-10T13:49:08.488907+0000 mgr.y (mgr.14140) 219 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:10.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:09 gibba013 bash[9767]: audit 2021-03-10T13:49:08.655638+0000 mon.c (mon.1) 16 : audit [DBG] from='client.? 172.21.2.113:0/2763037976' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-03-10T13:49:10.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:09 gibba013 bash[13024]: cluster 2021-03-10T13:49:08.488907+0000 mgr.y (mgr.14140) 219 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:10.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:09 gibba013 bash[13024]: audit 2021-03-10T13:49:08.655638+0000 mon.c (mon.1) 16 : audit [DBG] from='client.? 172.21.2.113:0/2763037976' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-03-10T13:49:11.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:11 gibba020 bash[9782]: cluster 2021-03-10T13:49:10.489161+0000 mgr.y (mgr.14140) 220 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:12.079 INFO:teuthology.orchestra.run.gibba013.stdout:137438953505 2021-03-10T13:49:12.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:11 gibba013 bash[9767]: cluster 2021-03-10T13:49:10.489161+0000 mgr.y (mgr.14140) 220 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:12.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:11 gibba013 bash[13024]: cluster 2021-03-10T13:49:10.489161+0000 mgr.y (mgr.14140) 220 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:12.780 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953500 got 137438953505 for osd.4 2021-03-10T13:49:12.781 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph osd last-stat-seq osd.5 2021-03-10T13:49:12.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:12 gibba020 bash[9782]: audit 2021-03-10T13:49:12.076349+0000 mon.a (mon.0) 536 : audit [DBG] from='client.? 172.21.2.113:0/765595826' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-03-10T13:49:13.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:12 gibba013 bash[9767]: audit 2021-03-10T13:49:12.076349+0000 mon.a (mon.0) 536 : audit [DBG] from='client.? 172.21.2.113:0/765595826' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-03-10T13:49:13.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:12 gibba013 bash[13024]: audit 2021-03-10T13:49:12.076349+0000 mon.a (mon.0) 536 : audit [DBG] from='client.? 172.21.2.113:0/765595826' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-03-10T13:49:13.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:13 gibba020 bash[9782]: cluster 2021-03-10T13:49:12.489901+0000 mgr.y (mgr.14140) 221 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:13.947 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:13 gibba013 bash[9767]: cluster 2021-03-10T13:49:12.489901+0000 mgr.y (mgr.14140) 221 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:13.947 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:13 gibba013 bash[13024]: cluster 2021-03-10T13:49:12.489901+0000 mgr.y (mgr.14140) 221 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:15.424 INFO:teuthology.orchestra.run.gibba013.stdout:158913789983 2021-03-10T13:49:15.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:15 gibba013 bash[9767]: cluster 2021-03-10T13:49:14.490568+0000 mgr.y (mgr.14140) 222 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:15.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:15 gibba013 bash[9767]: audit 2021-03-10T13:49:15.421622+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.2.113:0/618654710' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-03-10T13:49:15.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:15 gibba013 bash[13024]: cluster 2021-03-10T13:49:14.490568+0000 mgr.y (mgr.14140) 222 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:15.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:15 gibba013 bash[13024]: audit 2021-03-10T13:49:15.421622+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.2.113:0/618654710' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-03-10T13:49:16.066 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913789978 got 158913789983 for osd.5 2021-03-10T13:49:16.067 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph osd last-stat-seq osd.6 2021-03-10T13:49:16.194 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:15 gibba020 bash[9782]: cluster 2021-03-10T13:49:14.490568+0000 mgr.y (mgr.14140) 222 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:16.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:15 gibba020 bash[9782]: audit 2021-03-10T13:49:15.421622+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.2.113:0/618654710' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-03-10T13:49:18.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:17 gibba013 bash[9767]: cluster 2021-03-10T13:49:16.491198+0000 mgr.y (mgr.14140) 223 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:18.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:17 gibba013 bash[13024]: cluster 2021-03-10T13:49:16.491198+0000 mgr.y (mgr.14140) 223 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:18.194 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:17 gibba020 bash[9782]: cluster 2021-03-10T13:49:16.491198+0000 mgr.y (mgr.14140) 223 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:18.905 INFO:teuthology.orchestra.run.gibba013.stdout:180388626458 2021-03-10T13:49:19.496 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626453 got 180388626458 for osd.6 2021-03-10T13:49:19.496 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph osd last-stat-seq osd.7 2021-03-10T13:49:19.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:19 gibba013 bash[9767]: cluster 2021-03-10T13:49:18.491987+0000 mgr.y (mgr.14140) 224 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:19.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:19 gibba013 bash[9767]: audit 2021-03-10T13:49:18.902389+0000 mon.a (mon.0) 537 : audit [DBG] from='client.? 172.21.2.113:0/3871004303' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-03-10T13:49:19.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:19 gibba013 bash[13024]: cluster 2021-03-10T13:49:18.491987+0000 mgr.y (mgr.14140) 224 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:19.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:19 gibba013 bash[13024]: audit 2021-03-10T13:49:18.902389+0000 mon.a (mon.0) 537 : audit [DBG] from='client.? 172.21.2.113:0/3871004303' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-03-10T13:49:20.194 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:19 gibba020 bash[9782]: cluster 2021-03-10T13:49:18.491987+0000 mgr.y (mgr.14140) 224 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:20.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:19 gibba020 bash[9782]: audit 2021-03-10T13:49:18.902389+0000 mon.a (mon.0) 537 : audit [DBG] from='client.? 172.21.2.113:0/3871004303' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-03-10T13:49:22.048 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:21 gibba013 bash[9767]: cluster 2021-03-10T13:49:20.492423+0000 mgr.y (mgr.14140) 225 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:22.048 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:21 gibba013 bash[13024]: cluster 2021-03-10T13:49:20.492423+0000 mgr.y (mgr.14140) 225 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:22.194 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:21 gibba020 bash[9782]: cluster 2021-03-10T13:49:20.492423+0000 mgr.y (mgr.14140) 225 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:22.283 INFO:teuthology.orchestra.run.gibba013.stdout:201863462935 2021-03-10T13:49:22.919 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462930 got 201863462935 for osd.7 2021-03-10T13:49:22.919 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2021-03-10T13:49:22.920 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph pg dump --format=json 2021-03-10T13:49:23.003 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:22 gibba013 bash[9767]: audit 2021-03-10T13:49:22.280336+0000 mon.a (mon.0) 538 : audit [DBG] from='client.? 172.21.2.113:0/3570566860' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-03-10T13:49:23.004 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:22 gibba013 bash[13024]: audit 2021-03-10T13:49:22.280336+0000 mon.a (mon.0) 538 : audit [DBG] from='client.? 172.21.2.113:0/3570566860' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-03-10T13:49:23.194 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:22 gibba020 bash[9782]: audit 2021-03-10T13:49:22.280336+0000 mon.a (mon.0) 538 : audit [DBG] from='client.? 172.21.2.113:0/3570566860' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-03-10T13:49:24.008 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:23 gibba013 bash[13024]: cluster 2021-03-10T13:49:22.493024+0000 mgr.y (mgr.14140) 226 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:24.009 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:23 gibba013 bash[9767]: cluster 2021-03-10T13:49:22.493024+0000 mgr.y (mgr.14140) 226 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:24.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:23 gibba020 bash[9782]: cluster 2021-03-10T13:49:22.493024+0000 mgr.y (mgr.14140) 226 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:25.601 INFO:teuthology.orchestra.run.gibba013.stdout: 2021-03-10T13:49:25.602 INFO:teuthology.orchestra.run.gibba013.stderr:dumped all 2021-03-10T13:49:26.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:25 gibba013 bash[9767]: cluster 2021-03-10T13:49:24.493960+0000 mgr.y (mgr.14140) 227 : cluster [DBG] pgmap v215: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:26.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:25 gibba013 bash[13024]: cluster 2021-03-10T13:49:24.493960+0000 mgr.y (mgr.14140) 227 : cluster [DBG] pgmap v215: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:26.194 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:25 gibba020 bash[9782]: cluster 2021-03-10T13:49:24.493960+0000 mgr.y (mgr.14140) 227 : cluster [DBG] pgmap v215: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:26.221 INFO:teuthology.orchestra.run.gibba013.stdout:{"pg_ready":true,"pg_map":{"version":215,"stamp":"2021-03-10T13:49:24.493609+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":704643072,"kb_used":8392272,"kb_used_data":3600,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":696250800,"statfs":{"total":721554505728,"available":712960819200,"internally_reserved":8589934592,"allocated":3686400,"data_stored":1467496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004056"},"pg_stats":[{"pgid":"1.0","version":"17'1","reported_seq":"14","reported_epoch":"48","state":"active+clean","last_fresh":"2021-03-10T13:47:44.552136+0000","last_change":"2021-03-10T13:47:44.552136+0000","last_active":"2021-03-10T13:47:44.552136+0000","last_peered":"2021-03-10T13:47:44.552136+0000","last_clean":"2021-03-10T13:47:44.552136+0000","last_became_active":"2021-03-10T13:47:44.550419+0000","last_became_peered":"2021-03-10T13:47:44.550419+0000","last_unstale":"2021-03-10T13:47:44.552136+0000","last_undegraded":"2021-03-10T13:47:44.552136+0000","last_fullsized":"2021-03-10T13:47:44.552136+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":2,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-10T13:43:05.278380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-10T13:43:05.278380+0000","last_clean_scrub_stamp":"2021-03-10T13:43:05.278380+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":47,"seq":201863462935,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":1049036,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031348,"statfs":{"total":90194313216,"available":89120100352,"internally_reserved":1073741824,"allocated":462848,"data_stored":183584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 13:48:46 2021","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.641,"5min":2.641,"15min":2.641},"last":2.2269999999999999},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.2650000000000001,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":1.242}]},{"osd":1,"last update":"Wed Mar 10 13:48:46 2021","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.2799999999999998,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.5910000000000002,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":2.327}]},{"osd":2,"last update":"Wed Mar 10 13:48:46 2021","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":2.5630000000000002,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":1.135},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":2.2410000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":2.4700000000000002}]},{"osd":3,"last update":"Wed Mar 10 13:48:46 2021","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":2.302,"5min":2.302,"15min":2.302},"last":1.6699999999999999},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":2.363,"5min":2.363,"15min":2.363},"last":1.8149999999999999}]},{"osd":4,"last update":"Wed Mar 10 13:48:46 2021","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":2.5249999999999999,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":1.909},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":2.3730000000000002,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":0.95899999999999996}]},{"osd":5,"last update":"Wed Mar 10 13:48:46 2021","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":2.4700000000000002,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":1.5129999999999999}]},{"osd":6,"last update":"Wed Mar 10 13:48:46 2021","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":2.2290000000000001,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":2.593},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":2.484,"5min":2.484,"15min":2.484},"last":2.056}]}]},{"osd":6,"up_from":42,"seq":180388626459,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":1049032,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031352,"statfs":{"total":90194313216,"available":89120104448,"internally_reserved":1073741824,"allocated":458752,"data_stored":183290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 13:48:20 2021","interfaces":[{"interface":"back","average":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":2.6160000000000001,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":1.9870000000000001},{"interface":"front","average":{"1min":1.446,"5min":1.446,"15min":1.446},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.4940000000000002,"5min":2.4940000000000002,"15min":2.4940000000000002},"last":2.258}]},{"osd":1,"last update":"Wed Mar 10 13:48:20 2021","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":2.4769999999999999,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":2.121},{"interface":"front","average":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":2.556,"5min":2.556,"15min":2.556},"last":2.4060000000000001}]},{"osd":2,"last update":"Wed Mar 10 13:48:20 2021","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.5,"15min":1.5},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":2.5329999999999999,"5min":2.5329999999999999,"15min":2.5329999999999999},"last":2.8199999999999998},{"interface":"front","average":{"1min":1.468,"5min":1.468,"15min":1.468},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.4500000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":2.6970000000000001}]},{"osd":3,"last update":"Wed Mar 10 13:48:20 2021","interfaces":[{"interface":"back","average":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":2.5529999999999999},{"interface":"front","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.548,"5min":2.548,"15min":2.548},"last":1.5640000000000001}]},{"osd":4,"last update":"Wed Mar 10 13:48:20 2021","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":2.145,"5min":2.145,"15min":2.145},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":1.8140000000000001,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":1.6930000000000001}]},{"osd":5,"last update":"Wed Mar 10 13:48:20 2021","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.208,"15min":1.208},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":2.339,"5min":2.339,"15min":2.339},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.2350000000000001}]},{"osd":7,"last update":"Wed Mar 10 13:48:44 2021","interfaces":[{"interface":"back","average":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":2.3820000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.597,"5min":1.597,"15min":1.597},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":2.8250000000000002,"5min":2.8250000000000002,"15min":2.8250000000000002},"last":1.839}]}]},{"osd":1,"up_from":16,"seq":68719476787,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049032,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031352,"statfs":{"total":90194313216,"available":89120104448,"internally_reserved":1073741824,"allocated":458752,"data_stored":183290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 13:48:29 2021","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.73599999999999999,"15min":0.72799999999999998},"min":{"1min":0.17599999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":1.135,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.85699999999999998,"15min":0.82799999999999996},"min":{"1min":0.14199999999999999,"5min":0.14199999999999999,"15min":0.14199999999999999},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":1.365}]},{"osd":2,"last update":"Wed Mar 10 13:48:56 2021","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.86099999999999999,"15min":0.875},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.202,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.83399999999999996,"5min":1.0720000000000001,"15min":1.099},"min":{"1min":0.16300000000000001,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":1.3169999999999999,"5min":1.976,"15min":1.976},"last":0.91300000000000003}]},{"osd":3,"last update":"Wed Mar 10 13:49:21 2021","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":1.0289999999999999,"15min":1.0680000000000001},"min":{"1min":0.219,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.365,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.165,"5min":1.236,"15min":1.258},"min":{"1min":0.28799999999999998,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.9550000000000001,"5min":2.0329999999999999,"15min":2.0329999999999999},"last":1.179}]},{"osd":4,"last update":"Wed Mar 10 13:48:38 2021","interfaces":[{"interface":"back","average":{"1min":1.498,"5min":1.6060000000000001,"15min":1.6240000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":2.3340000000000001,"5min":2.3340000000000001,"15min":2.3340000000000001},"last":2.2130000000000001},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.4379999999999999,"15min":1.4590000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":1.4950000000000001}]},{"osd":5,"last update":"Wed Mar 10 13:48:56 2021","interfaces":[{"interface":"back","average":{"1min":1.579,"5min":1.627,"15min":1.635},"min":{"1min":0.622,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.5070000000000001,"5min":2.5070000000000001,"15min":2.5070000000000001},"last":1.927},{"interface":"front","average":{"1min":1.268,"5min":1.272,"15min":1.2729999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.9410000000000001,"5min":2.028,"15min":2.028},"last":1.746}]},{"osd":6,"last update":"Wed Mar 10 13:48:23 2021","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":1.669},{"interface":"front","average":{"1min":1.556,"5min":1.556,"15min":1.556},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":2.3679999999999999,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":2.1000000000000001}]},{"osd":7,"last update":"Wed Mar 10 13:48:44 2021","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.5649999999999999},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":2.3769999999999998,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":1.8029999999999999}]}]},{"osd":0,"up_from":10,"seq":42949673014,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":1049036,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031348,"statfs":{"total":90194313216,"available":89120100352,"internally_reserved":1073741824,"allocated":462848,"data_stored":183584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Mar 10 13:48:33 2021","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.748,"15min":0.71599999999999997},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.006,"5min":0.94099999999999995,"15min":0.88300000000000001},"min":{"1min":0.313,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.83799999999999997}]},{"osd":2,"last update":"Wed Mar 10 13:48:56 2021","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.024,"15min":0.96899999999999997},"min":{"1min":0.36399999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":2.198,"5min":2.198,"15min":2.198},"last":1.5409999999999999},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.92400000000000004,"15min":0.89000000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.361,"5min":1.873,"15min":1.873},"last":0.92200000000000004}]},{"osd":3,"last update":"Wed Mar 10 13:48:23 2021","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.95099999999999996,"15min":0.96299999999999997},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.387,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.3200000000000001,"15min":1.335},"min":{"1min":0.38100000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.9970000000000001,"5min":2.1890000000000001,"15min":2.1890000000000001},"last":1.1459999999999999}]},{"osd":4,"last update":"Wed Mar 10 13:48:38 2021","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.282,"15min":1.2729999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":1.6870000000000001},{"interface":"front","average":{"1min":1.5509999999999999,"5min":1.5429999999999999,"15min":1.5409999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":2.4580000000000002,"5min":2.4580000000000002,"15min":2.4580000000000002},"last":2.2679999999999998}]},{"osd":5,"last update":"Wed Mar 10 13:48:56 2021","interfaces":[{"interface":"back","average":{"1min":1.617,"5min":1.591,"15min":1.587},"min":{"1min":0.496,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":2.3029999999999999,"5min":2.3620000000000001,"15min":2.3620000000000001},"last":1.8540000000000001},{"interface":"front","average":{"1min":1.6679999999999999,"5min":1.466,"15min":1.4319999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":2.7519999999999998,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":1.978}]},{"osd":6,"last update":"Wed Mar 10 13:48:23 2021","interfaces":[{"interface":"back","average":{"1min":1.575,"5min":1.575,"15min":1.575},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":2.524,"5min":2.524,"15min":2.524},"last":2.4249999999999998},{"interface":"front","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":2.1110000000000002,"5min":2.1110000000000002,"15min":2.1110000000000002},"last":2.198}]},{"osd":7,"last update":"Wed Mar 10 13:48:46 2021","interfaces":[{"interface":"back","average":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":2.6739999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":2.1160000000000001},{"interface":"front","average":{"1min":1.569,"5min":1.569,"15min":1.569},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":2.3730000000000002,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":2.3610000000000002}]}]},{"osd":2,"up_from":21,"seq":90194313261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049036,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031348,"statfs":{"total":90194313216,"available":89120100352,"internally_reserved":1073741824,"allocated":462848,"data_stored":183584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 13:48:55 2021","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.73999999999999999,"15min":0.68400000000000005},"min":{"1min":0.214,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":2.484,"5min":2.484,"15min":2.484},"last":1.0580000000000001},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.93300000000000005,"15min":0.83999999999999997},"min":{"1min":0.26500000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":2.714,"5min":2.714,"15min":2.714},"last":0.99099999999999999}]},{"osd":1,"last update":"Wed Mar 10 13:48:55 2021","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97099999999999997,"15min":0.90600000000000003},"min":{"1min":0.23799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":2.2759999999999998,"5min":2.2759999999999998,"15min":2.2759999999999998},"last":1.4370000000000001},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.95599999999999996,"15min":0.88500000000000001},"min":{"1min":0.27800000000000002,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":2.3940000000000001,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":0.79200000000000004}]},{"osd":3,"last update":"Wed Mar 10 13:49:20 2021","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.98999999999999999,"15min":1.028},"min":{"1min":0.26400000000000001,"5min":0.254,"15min":0.254},"max":{"1min":1.0409999999999999,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.246,"5min":1.3180000000000001,"15min":1.3120000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":2.0979999999999999,"5min":2.5569999999999999,"15min":2.5569999999999999},"last":1.851}]},{"osd":4,"last update":"Wed Mar 10 13:48:37 2021","interfaces":[{"interface":"back","average":{"1min":1.621,"5min":1.4019999999999999,"15min":1.3660000000000001},"min":{"1min":0.69499999999999995,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":2.984,"5min":2.984,"15min":2.984},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.5680000000000001,"5min":1.4610000000000001,"15min":1.4430000000000001},"min":{"1min":0.65000000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":2.8639999999999999,"5min":2.8639999999999999,"15min":2.8639999999999999},"last":2.1240000000000001}]},{"osd":5,"last update":"Wed Mar 10 13:48:57 2021","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.4339999999999999,"15min":1.4299999999999999},"min":{"1min":0.59799999999999998,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":2.5030000000000001,"5min":2.5030000000000001,"15min":2.5030000000000001},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2270000000000001,"15min":1.216},"min":{"1min":0.55100000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":2.6779999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":1.734}]},{"osd":6,"last update":"Wed Mar 10 13:49:20 2021","interfaces":[{"interface":"back","average":{"1min":1.516,"5min":1.3480000000000001,"15min":1.3200000000000001},"min":{"1min":0.65400000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":2.4199999999999999,"5min":2.4199999999999999,"15min":2.4199999999999999},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.6859999999999999,"5min":1.6419999999999999,"15min":1.6339999999999999},"min":{"1min":0.72099999999999997,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":2.452,"5min":2.452,"15min":2.452},"last":2.0289999999999999}]},{"osd":7,"last update":"Wed Mar 10 13:48:46 2021","interfaces":[{"interface":"back","average":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.6259999999999999,"5min":2.6259999999999999,"15min":2.6259999999999999},"last":1.655},{"interface":"front","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.3860000000000001,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":1.5669999999999999}]}]},{"osd":3,"up_from":27,"seq":115964117034,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049036,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031348,"statfs":{"total":90194313216,"available":89120100352,"internally_reserved":1073741824,"allocated":462848,"data_stored":183584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 13:49:14 2021","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.83299999999999996,"15min":0.82999999999999996},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":1.226,"5min":1.5,"15min":1.5},"last":1.258},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.98199999999999998,"15min":1.0009999999999999},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.423,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.68799999999999994}]},{"osd":1,"last update":"Wed Mar 10 13:49:14 2021","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.92800000000000005,"15min":0.93200000000000005},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":1.2869999999999999,"5min":1.403,"15min":1.403},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.97799999999999998,"5min":1.1539999999999999,"15min":1.1859999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.7509999999999999,"5min":2.222,"15min":2.222},"last":0.81799999999999995}]},{"osd":2,"last update":"Wed Mar 10 13:49:14 2021","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.2490000000000001,"15min":1.2410000000000001},"min":{"1min":0.29099999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.738,"5min":2.141,"15min":2.141},"last":1.667},{"interface":"front","average":{"1min":1.042,"5min":1.077,"15min":1.077},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":1.1120000000000001}]},{"osd":4,"last update":"Wed Mar 10 13:48:37 2021","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.3009999999999999,"15min":1.3129999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":2.0609999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.5760000000000001,"5min":1.635,"15min":1.645},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.2639999999999998,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":2.3300000000000001}]},{"osd":5,"last update":"Wed Mar 10 13:48:59 2021","interfaces":[{"interface":"back","average":{"1min":1.7330000000000001,"5min":1.673,"15min":1.663},"min":{"1min":0.77500000000000002,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.4740000000000002,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":2.117},{"interface":"front","average":{"1min":1.819,"5min":1.6910000000000001,"15min":1.6699999999999999},"min":{"1min":0.70499999999999996,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.8500000000000001,"5min":2.8500000000000001,"15min":2.8500000000000001},"last":2.181}]},{"osd":6,"last update":"Wed Mar 10 13:49:19 2021","interfaces":[{"interface":"back","average":{"1min":1.774,"5min":1.7130000000000001,"15min":1.7030000000000001},"min":{"1min":0.77600000000000002,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":2.399,"5min":2.415,"15min":2.415},"last":1.9550000000000001},{"interface":"front","average":{"1min":1.552,"5min":1.4359999999999999,"15min":1.417},"min":{"1min":0.84699999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":2.0870000000000002,"5min":2.097,"15min":2.097},"last":1.5529999999999999}]},{"osd":7,"last update":"Wed Mar 10 13:48:44 2021","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.806},{"interface":"front","average":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":2.573,"5min":2.573,"15min":2.573},"last":2.2549999999999999}]}]},{"osd":4,"up_from":32,"seq":137438953508,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049032,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031352,"statfs":{"total":90194313216,"available":89120104448,"internally_reserved":1073741824,"allocated":458752,"data_stored":183290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 13:48:37 2021","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.369,"15min":1.379},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":2.3490000000000002,"5min":2.3519999999999999,"15min":2.3519999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":1.663,"5min":1.4630000000000001,"15min":1.4299999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":2.5899999999999999,"5min":2.5899999999999999,"15min":2.5899999999999999},"last":0.88500000000000001}]},{"osd":1,"last update":"Wed Mar 10 13:48:37 2021","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.3520000000000001,"15min":1.3400000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":2.4609999999999999,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.4039999999999999,"15min":1.4119999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.3780000000000001,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":0.67000000000000004}]},{"osd":2,"last update":"Wed Mar 10 13:48:37 2021","interfaces":[{"interface":"back","average":{"1min":1.504,"5min":1.492,"15min":1.49},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":2.7040000000000002,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.355,"5min":1.379,"15min":1.383},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":2.403,"5min":2.403,"15min":2.403},"last":0.73099999999999998}]},{"osd":3,"last update":"Wed Mar 10 13:48:37 2021","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":2.403,"5min":2.403,"15min":2.403},"last":0.78400000000000003},{"interface":"front","average":{"1min":1.496,"5min":1.4039999999999999,"15min":1.389},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":2.3330000000000002,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":0.91000000000000003}]},{"osd":5,"last update":"Wed Mar 10 13:48:57 2021","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":0.94599999999999995,"15min":0.91400000000000003},"min":{"1min":0.28599999999999998,"5min":0.253,"15min":0.253},"max":{"1min":2.5009999999999999,"5min":2.5009999999999999,"15min":2.5009999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":1.258,"5min":1.0429999999999999,"15min":1.0069999999999999},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":2.4239999999999999,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":0.39700000000000002}]},{"osd":6,"last update":"Wed Mar 10 13:49:22 2021","interfaces":[{"interface":"back","average":{"1min":1.3839999999999999,"5min":1.1759999999999999,"15min":1.141},"min":{"1min":0.32100000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":2.6400000000000001,"5min":2.6400000000000001,"15min":2.6400000000000001},"last":0.29499999999999998},{"interface":"front","average":{"1min":1.381,"5min":1.206,"15min":1.177},"min":{"1min":0.31900000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":2.0840000000000001,"5min":2.7429999999999999,"15min":2.7429999999999999},"last":0.51200000000000001}]},{"osd":7,"last update":"Wed Mar 10 13:48:46 2021","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":2.7930000000000001,"5min":2.7930000000000001,"15min":2.7930000000000001},"last":0.33000000000000002},{"interface":"front","average":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":2.8860000000000001,"5min":2.8860000000000001,"15min":2.8860000000000001},"last":0.46100000000000002}]}]},{"osd":5,"up_from":37,"seq":158913789985,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049032,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031352,"statfs":{"total":90194313216,"available":89120104448,"internally_reserved":1073741824,"allocated":458752,"data_stored":183290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 13:49:01 2021","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.472,"15min":1.464},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":2.5870000000000002,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":2.3010000000000002},{"interface":"front","average":{"1min":1.595,"5min":1.5009999999999999,"15min":1.4850000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":2.7029999999999998,"5min":2.7029999999999998,"15min":2.7029999999999998},"last":1.8919999999999999}]},{"osd":1,"last update":"Wed Mar 10 13:49:01 2021","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.403,"15min":1.413},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.2959999999999998,"5min":2.5339999999999998,"15min":2.5339999999999998},"last":2.1549999999999998},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.228,"15min":1.2290000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.226,"5min":2.226,"15min":2.226},"last":1.7390000000000001}]},{"osd":2,"last update":"Wed Mar 10 13:49:01 2021","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.377,"15min":1.383},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.1509999999999998,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":2.02},{"interface":"front","average":{"1min":1.5649999999999999,"5min":1.5229999999999999,"15min":1.516},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.5489999999999999,"5min":2.5539999999999998,"15min":2.5539999999999998},"last":2.5720000000000001}]},{"osd":3,"last update":"Wed Mar 10 13:49:01 2021","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.452,"15min":1.462},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":2.4079999999999999,"5min":2.6379999999999999,"15min":2.6379999999999999},"last":1.673},{"interface":"front","average":{"1min":1.6279999999999999,"5min":1.5009999999999999,"15min":1.48},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2.7170000000000001,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":2.4900000000000002}]},{"osd":4,"last update":"Wed Mar 10 13:49:01 2021","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":0.872,"15min":0.83199999999999996},"min":{"1min":0.32700000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.042,"15min":0.99399999999999999},"min":{"1min":0.33500000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":2.581,"5min":2.581,"15min":2.581},"last":1.1519999999999999}]},{"osd":6,"last update":"Wed Mar 10 13:48:24 2021","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":2.4809999999999999,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":1.506},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":2.758,"5min":2.758,"15min":2.758},"last":2.391}]},{"osd":7,"last update":"Wed Mar 10 13:48:45 2021","interfaces":[{"interface":"back","average":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":2.9329999999999998,"5min":2.9329999999999998,"15min":2.9329999999999998},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":2.2200000000000002,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":1.5960000000000001}]}]}]}} 2021-03-10T13:49:26.223 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph pg dump --format=json 2021-03-10T13:49:27.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:26 gibba013 bash[9767]: audit 2021-03-10T13:49:25.595749+0000 mgr.y (mgr.14140) 228 : audit [DBG] from='client.24364 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-03-10T13:49:27.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:26 gibba013 bash[13024]: audit 2021-03-10T13:49:25.595749+0000 mgr.y (mgr.14140) 228 : audit [DBG] from='client.24364 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-03-10T13:49:27.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:26 gibba020 bash[9782]: audit 2021-03-10T13:49:25.595749+0000 mgr.y (mgr.14140) 228 : audit [DBG] from='client.24364 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-03-10T13:49:28.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:27 gibba013 bash[9767]: cluster 2021-03-10T13:49:26.494391+0000 mgr.y (mgr.14140) 229 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:28.297 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:27 gibba013 bash[13024]: cluster 2021-03-10T13:49:26.494391+0000 mgr.y (mgr.14140) 229 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:28.298 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:27 gibba020 bash[9782]: cluster 2021-03-10T13:49:26.494391+0000 mgr.y (mgr.14140) 229 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:28.952 INFO:teuthology.orchestra.run.gibba013.stdout: 2021-03-10T13:49:28.953 INFO:teuthology.orchestra.run.gibba013.stderr:dumped all 2021-03-10T13:49:29.544 INFO:teuthology.orchestra.run.gibba013.stdout:{"pg_ready":true,"pg_map":{"version":217,"stamp":"2021-03-10T13:49:28.494608+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":704643072,"kb_used":8392272,"kb_used_data":3600,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":696250800,"statfs":{"total":721554505728,"available":712960819200,"internally_reserved":8589934592,"allocated":3686400,"data_stored":1467496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003745"},"pg_stats":[{"pgid":"1.0","version":"17'1","reported_seq":"14","reported_epoch":"48","state":"active+clean","last_fresh":"2021-03-10T13:47:44.552136+0000","last_change":"2021-03-10T13:47:44.552136+0000","last_active":"2021-03-10T13:47:44.552136+0000","last_peered":"2021-03-10T13:47:44.552136+0000","last_clean":"2021-03-10T13:47:44.552136+0000","last_became_active":"2021-03-10T13:47:44.550419+0000","last_became_peered":"2021-03-10T13:47:44.550419+0000","last_unstale":"2021-03-10T13:47:44.552136+0000","last_undegraded":"2021-03-10T13:47:44.552136+0000","last_fullsized":"2021-03-10T13:47:44.552136+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":2,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-10T13:43:05.278380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-10T13:43:05.278380+0000","last_clean_scrub_stamp":"2021-03-10T13:43:05.278380+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":47,"seq":201863462936,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":1049036,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031348,"statfs":{"total":90194313216,"available":89120100352,"internally_reserved":1073741824,"allocated":462848,"data_stored":183584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 13:48:46 2021","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.641,"5min":2.641,"15min":2.641},"last":1.9530000000000001},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.2650000000000001,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":2.0379999999999998}]},{"osd":1,"last update":"Wed Mar 10 13:48:46 2021","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.2799999999999998,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":1.6100000000000001},{"interface":"front","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.5910000000000002,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":1.8069999999999999}]},{"osd":2,"last update":"Wed Mar 10 13:48:46 2021","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":2.5630000000000002,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":2.165},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":2.2410000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":1.262}]},{"osd":3,"last update":"Wed Mar 10 13:48:46 2021","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":2.302,"5min":2.302,"15min":2.302},"last":1.72},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":2.363,"5min":2.363,"15min":2.363},"last":2.2770000000000001}]},{"osd":4,"last update":"Wed Mar 10 13:48:46 2021","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":2.5249999999999999,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":2.3730000000000002,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":1.3720000000000001}]},{"osd":5,"last update":"Wed Mar 10 13:48:46 2021","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":2.4700000000000002,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":0.80900000000000005}]},{"osd":6,"last update":"Wed Mar 10 13:48:46 2021","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":2.2290000000000001,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":1.4850000000000001},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":2.484,"5min":2.484,"15min":2.484},"last":1.014}]}]},{"osd":6,"up_from":42,"seq":180388626460,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":1049032,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031352,"statfs":{"total":90194313216,"available":89120104448,"internally_reserved":1073741824,"allocated":458752,"data_stored":183290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 13:49:22 2021","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.4570000000000001,"15min":1.4650000000000001},"min":{"1min":0.63800000000000001,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":2.4900000000000002,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.341,"5min":1.425,"15min":1.4390000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.5289999999999999,"5min":2.5289999999999999,"15min":2.5289999999999999},"last":0.87}]},{"osd":1,"last update":"Wed Mar 10 13:49:22 2021","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.3320000000000001,"15min":1.3560000000000001},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":2.294,"5min":2.4769999999999999,"15min":2.4769999999999999},"last":0.755},{"interface":"front","average":{"1min":1.488,"5min":1.544,"15min":1.554},"min":{"1min":0.68200000000000005,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":2.7759999999999998,"5min":2.7759999999999998,"15min":2.7759999999999998},"last":0.68200000000000005}]},{"osd":2,"last update":"Wed Mar 10 13:49:22 2021","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":1.492,"15min":1.4970000000000001},"min":{"1min":0.79100000000000004,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.5549999999999999,"5min":1.4850000000000001,"15min":1.4730000000000001},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":2.6970000000000001,"5min":2.6970000000000001,"15min":2.6970000000000001},"last":1.226}]},{"osd":3,"last update":"Wed Mar 10 13:49:22 2021","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.417,"15min":1.421},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":2.5529999999999999,"5min":2.5529999999999999,"15min":2.5529999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":1.768,"5min":1.5249999999999999,"15min":1.4850000000000001},"min":{"1min":0.67300000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.6819999999999999,"5min":2.6819999999999999,"15min":2.6819999999999999},"last":1.5149999999999999}]},{"osd":4,"last update":"Wed Mar 10 13:49:22 2021","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.093,"15min":1.069},"min":{"1min":0.35899999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":2.4780000000000002,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":1.657},{"interface":"front","average":{"1min":1.397,"5min":1.085,"15min":1.0329999999999999},"min":{"1min":0.316,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":2.3879999999999999,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":0.98299999999999998}]},{"osd":5,"last update":"Wed Mar 10 13:49:22 2021","interfaces":[{"interface":"back","average":{"1min":1.546,"5min":1.2749999999999999,"15min":1.23},"min":{"1min":0.40400000000000003,"5min":0.223,"15min":0.223},"max":{"1min":2.2200000000000002,"5min":2.339,"15min":2.339},"last":1.9359999999999999},{"interface":"front","average":{"1min":1.5620000000000001,"5min":1.2090000000000001,"15min":1.1499999999999999},"min":{"1min":0.29199999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":2.6299999999999999,"5min":2.6299999999999999,"15min":2.6299999999999999},"last":1.395}]},{"osd":7,"last update":"Wed Mar 10 13:48:44 2021","interfaces":[{"interface":"back","average":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":2.3820000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":1.8069999999999999},{"interface":"front","average":{"1min":1.597,"5min":1.597,"15min":1.597},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":2.8250000000000002,"5min":2.8250000000000002,"15min":2.8250000000000002},"last":2.113}]}]},{"osd":1,"up_from":16,"seq":68719476788,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049032,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031352,"statfs":{"total":90194313216,"available":89120104448,"internally_reserved":1073741824,"allocated":458752,"data_stored":183290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 13:48:29 2021","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.73599999999999999,"15min":0.72799999999999998},"min":{"1min":0.17599999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":1.135,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.85699999999999998,"15min":0.82799999999999996},"min":{"1min":0.14199999999999999,"5min":0.14199999999999999,"15min":0.14199999999999999},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":0.86299999999999999}]},{"osd":2,"last update":"Wed Mar 10 13:48:56 2021","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.86099999999999999,"15min":0.875},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.202,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.83399999999999996,"5min":1.0720000000000001,"15min":1.099},"min":{"1min":0.16300000000000001,"5min":0.16300000000000001,"15min":0.16300000000000001},"max":{"1min":1.3169999999999999,"5min":1.976,"15min":1.976},"last":1.3200000000000001}]},{"osd":3,"last update":"Wed Mar 10 13:49:21 2021","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":1.0289999999999999,"15min":1.0680000000000001},"min":{"1min":0.219,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.365,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":1.448},{"interface":"front","average":{"1min":1.165,"5min":1.236,"15min":1.258},"min":{"1min":0.28799999999999998,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":1.9550000000000001,"5min":2.0329999999999999,"15min":2.0329999999999999},"last":1.1499999999999999}]},{"osd":4,"last update":"Wed Mar 10 13:48:38 2021","interfaces":[{"interface":"back","average":{"1min":1.498,"5min":1.6060000000000001,"15min":1.6240000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":2.3340000000000001,"5min":2.3340000000000001,"15min":2.3340000000000001},"last":2.2389999999999999},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.4379999999999999,"15min":1.4590000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":1.8160000000000001}]},{"osd":5,"last update":"Wed Mar 10 13:48:56 2021","interfaces":[{"interface":"back","average":{"1min":1.579,"5min":1.627,"15min":1.635},"min":{"1min":0.622,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.5070000000000001,"5min":2.5070000000000001,"15min":2.5070000000000001},"last":1.9410000000000001},{"interface":"front","average":{"1min":1.268,"5min":1.272,"15min":1.2729999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.9410000000000001,"5min":2.028,"15min":2.028},"last":1.2529999999999999}]},{"osd":6,"last update":"Wed Mar 10 13:48:23 2021","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":2.3650000000000002},{"interface":"front","average":{"1min":1.556,"5min":1.556,"15min":1.556},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":2.3679999999999999,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":1.6970000000000001}]},{"osd":7,"last update":"Wed Mar 10 13:48:44 2021","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.5920000000000001},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":2.3769999999999998,"5min":2.3769999999999998,"15min":2.3769999999999998},"last":2.105}]}]},{"osd":0,"up_from":10,"seq":42949673015,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":1049036,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031348,"statfs":{"total":90194313216,"available":89120100352,"internally_reserved":1073741824,"allocated":462848,"data_stored":183584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Mar 10 13:48:33 2021","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.748,"15min":0.71599999999999997},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.006,"5min":0.94099999999999995,"15min":0.88300000000000001},"min":{"1min":0.313,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.91100000000000003}]},{"osd":2,"last update":"Wed Mar 10 13:48:56 2021","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.024,"15min":0.96899999999999997},"min":{"1min":0.36399999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":2.198,"5min":2.198,"15min":2.198},"last":1.266},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.92400000000000004,"15min":0.89000000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.361,"5min":1.873,"15min":1.873},"last":0.79600000000000004}]},{"osd":3,"last update":"Wed Mar 10 13:49:24 2021","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":0.97599999999999998,"15min":0.97199999999999998},"min":{"1min":0.26000000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.49,"5min":1.49,"15min":1.49},"last":1.429},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3180000000000001,"15min":1.3340000000000001},"min":{"1min":0.36199999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.879,"5min":2.1890000000000001,"15min":2.1890000000000001},"last":1.004}]},{"osd":4,"last update":"Wed Mar 10 13:48:38 2021","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.282,"15min":1.2729999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":1.841},{"interface":"front","average":{"1min":1.5509999999999999,"5min":1.5429999999999999,"15min":1.5409999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":2.4580000000000002,"5min":2.4580000000000002,"15min":2.4580000000000002},"last":2.1619999999999999}]},{"osd":5,"last update":"Wed Mar 10 13:48:56 2021","interfaces":[{"interface":"back","average":{"1min":1.617,"5min":1.591,"15min":1.587},"min":{"1min":0.496,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":2.3029999999999999,"5min":2.3620000000000001,"15min":2.3620000000000001},"last":1.6679999999999999},{"interface":"front","average":{"1min":1.6679999999999999,"5min":1.466,"15min":1.4319999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":2.7519999999999998,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":1.5489999999999999}]},{"osd":6,"last update":"Wed Mar 10 13:49:24 2021","interfaces":[{"interface":"back","average":{"1min":1.9259999999999999,"5min":1.645,"15min":1.5980000000000001},"min":{"1min":1.03,"5min":0.436,"15min":0.436},"max":{"1min":2.4249999999999998,"5min":2.524,"15min":2.524},"last":2.3839999999999999},{"interface":"front","average":{"1min":1.746,"5min":1.4490000000000001,"15min":1.399},"min":{"1min":1.0129999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":2.3239999999999998,"5min":2.3239999999999998,"15min":2.3239999999999998},"last":2.0750000000000002}]},{"osd":7,"last update":"Wed Mar 10 13:48:46 2021","interfaces":[{"interface":"back","average":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":2.6739999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":1.9630000000000001},{"interface":"front","average":{"1min":1.569,"5min":1.569,"15min":1.569},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":2.3730000000000002,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":2.242}]}]},{"osd":2,"up_from":21,"seq":90194313262,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049036,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031348,"statfs":{"total":90194313216,"available":89120100352,"internally_reserved":1073741824,"allocated":462848,"data_stored":183584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 13:48:55 2021","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.73999999999999999,"15min":0.68400000000000005},"min":{"1min":0.214,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":2.484,"5min":2.484,"15min":2.484},"last":1.028},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.93300000000000005,"15min":0.83999999999999997},"min":{"1min":0.26500000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":2.714,"5min":2.714,"15min":2.714},"last":1.3959999999999999}]},{"osd":1,"last update":"Wed Mar 10 13:48:55 2021","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97099999999999997,"15min":0.90600000000000003},"min":{"1min":0.23799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":2.2759999999999998,"5min":2.2759999999999998,"15min":2.2759999999999998},"last":1.7370000000000001},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.95599999999999996,"15min":0.88500000000000001},"min":{"1min":0.27800000000000002,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":2.3940000000000001,"5min":2.3940000000000001,"15min":2.3940000000000001},"last":0.85499999999999998}]},{"osd":3,"last update":"Wed Mar 10 13:49:20 2021","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.98999999999999999,"15min":1.028},"min":{"1min":0.26400000000000001,"5min":0.254,"15min":0.254},"max":{"1min":1.0409999999999999,"5min":2.1360000000000001,"15min":2.1360000000000001},"last":1.147},{"interface":"front","average":{"1min":1.246,"5min":1.3180000000000001,"15min":1.3120000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":2.0979999999999999,"5min":2.5569999999999999,"15min":2.5569999999999999},"last":1.464}]},{"osd":4,"last update":"Wed Mar 10 13:48:37 2021","interfaces":[{"interface":"back","average":{"1min":1.621,"5min":1.4019999999999999,"15min":1.3660000000000001},"min":{"1min":0.69499999999999995,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":2.984,"5min":2.984,"15min":2.984},"last":1.8180000000000001},{"interface":"front","average":{"1min":1.5680000000000001,"5min":1.4610000000000001,"15min":1.4430000000000001},"min":{"1min":0.65000000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":2.8639999999999999,"5min":2.8639999999999999,"15min":2.8639999999999999},"last":2.0230000000000001}]},{"osd":5,"last update":"Wed Mar 10 13:48:57 2021","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.4339999999999999,"15min":1.4299999999999999},"min":{"1min":0.59799999999999998,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":2.5030000000000001,"5min":2.5030000000000001,"15min":2.5030000000000001},"last":1.6910000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2270000000000001,"15min":1.216},"min":{"1min":0.55100000000000005,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":2.6779999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":2.093}]},{"osd":6,"last update":"Wed Mar 10 13:49:20 2021","interfaces":[{"interface":"back","average":{"1min":1.516,"5min":1.3480000000000001,"15min":1.3200000000000001},"min":{"1min":0.65400000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":2.4199999999999999,"5min":2.4199999999999999,"15min":2.4199999999999999},"last":1.9470000000000001},{"interface":"front","average":{"1min":1.6859999999999999,"5min":1.6419999999999999,"15min":1.6339999999999999},"min":{"1min":0.72099999999999997,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":2.452,"5min":2.452,"15min":2.452},"last":1.859}]},{"osd":7,"last update":"Wed Mar 10 13:48:46 2021","interfaces":[{"interface":"back","average":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.6259999999999999,"5min":2.6259999999999999,"15min":2.6259999999999999},"last":1.8939999999999999},{"interface":"front","average":{"1min":1.448,"5min":1.448,"15min":1.448},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.3860000000000001,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":1.601}]}]},{"osd":3,"up_from":27,"seq":115964117034,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049036,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031348,"statfs":{"total":90194313216,"available":89120100352,"internally_reserved":1073741824,"allocated":462848,"data_stored":183584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 13:49:14 2021","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.83299999999999996,"15min":0.82999999999999996},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":1.226,"5min":1.5,"15min":1.5},"last":1.258},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.98199999999999998,"15min":1.0009999999999999},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1.423,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.68799999999999994}]},{"osd":1,"last update":"Wed Mar 10 13:49:14 2021","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.92800000000000005,"15min":0.93200000000000005},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":1.2869999999999999,"5min":1.403,"15min":1.403},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.97799999999999998,"5min":1.1539999999999999,"15min":1.1859999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.7509999999999999,"5min":2.222,"15min":2.222},"last":0.81799999999999995}]},{"osd":2,"last update":"Wed Mar 10 13:49:14 2021","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.2490000000000001,"15min":1.2410000000000001},"min":{"1min":0.29099999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.738,"5min":2.141,"15min":2.141},"last":1.667},{"interface":"front","average":{"1min":1.042,"5min":1.077,"15min":1.077},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":1.1120000000000001}]},{"osd":4,"last update":"Wed Mar 10 13:48:37 2021","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.3009999999999999,"15min":1.3129999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":2.0609999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.5760000000000001,"5min":1.635,"15min":1.645},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.2639999999999998,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":2.3300000000000001}]},{"osd":5,"last update":"Wed Mar 10 13:48:59 2021","interfaces":[{"interface":"back","average":{"1min":1.7330000000000001,"5min":1.673,"15min":1.663},"min":{"1min":0.77500000000000002,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.4740000000000002,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":2.117},{"interface":"front","average":{"1min":1.819,"5min":1.6910000000000001,"15min":1.6699999999999999},"min":{"1min":0.70499999999999996,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":2.8500000000000001,"5min":2.8500000000000001,"15min":2.8500000000000001},"last":2.181}]},{"osd":6,"last update":"Wed Mar 10 13:49:19 2021","interfaces":[{"interface":"back","average":{"1min":1.774,"5min":1.7130000000000001,"15min":1.7030000000000001},"min":{"1min":0.77600000000000002,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":2.399,"5min":2.415,"15min":2.415},"last":1.9550000000000001},{"interface":"front","average":{"1min":1.552,"5min":1.4359999999999999,"15min":1.417},"min":{"1min":0.84699999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":2.0870000000000002,"5min":2.097,"15min":2.097},"last":1.5529999999999999}]},{"osd":7,"last update":"Wed Mar 10 13:48:44 2021","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.806},{"interface":"front","average":{"1min":1.8069999999999999,"5min":1.8069999999999999,"15min":1.8069999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":2.573,"5min":2.573,"15min":2.573},"last":2.2549999999999999}]}]},{"osd":4,"up_from":32,"seq":137438953508,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049032,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031352,"statfs":{"total":90194313216,"available":89120104448,"internally_reserved":1073741824,"allocated":458752,"data_stored":183290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 13:48:37 2021","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.369,"15min":1.379},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":2.3490000000000002,"5min":2.3519999999999999,"15min":2.3519999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":1.663,"5min":1.4630000000000001,"15min":1.4299999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":2.5899999999999999,"5min":2.5899999999999999,"15min":2.5899999999999999},"last":0.88500000000000001}]},{"osd":1,"last update":"Wed Mar 10 13:48:37 2021","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.3520000000000001,"15min":1.3400000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":2.4609999999999999,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.4039999999999999,"15min":1.4119999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.3780000000000001,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":0.67000000000000004}]},{"osd":2,"last update":"Wed Mar 10 13:48:37 2021","interfaces":[{"interface":"back","average":{"1min":1.504,"5min":1.492,"15min":1.49},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":2.7040000000000002,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.355,"5min":1.379,"15min":1.383},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":2.403,"5min":2.403,"15min":2.403},"last":0.73099999999999998}]},{"osd":3,"last update":"Wed Mar 10 13:48:37 2021","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":2.403,"5min":2.403,"15min":2.403},"last":0.78400000000000003},{"interface":"front","average":{"1min":1.496,"5min":1.4039999999999999,"15min":1.389},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":2.3330000000000002,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":0.91000000000000003}]},{"osd":5,"last update":"Wed Mar 10 13:48:57 2021","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":0.94599999999999995,"15min":0.91400000000000003},"min":{"1min":0.28599999999999998,"5min":0.253,"15min":0.253},"max":{"1min":2.5009999999999999,"5min":2.5009999999999999,"15min":2.5009999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":1.258,"5min":1.0429999999999999,"15min":1.0069999999999999},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":2.4239999999999999,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":0.39700000000000002}]},{"osd":6,"last update":"Wed Mar 10 13:49:22 2021","interfaces":[{"interface":"back","average":{"1min":1.3839999999999999,"5min":1.1759999999999999,"15min":1.141},"min":{"1min":0.32100000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":2.6400000000000001,"5min":2.6400000000000001,"15min":2.6400000000000001},"last":0.29499999999999998},{"interface":"front","average":{"1min":1.381,"5min":1.206,"15min":1.177},"min":{"1min":0.31900000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":2.0840000000000001,"5min":2.7429999999999999,"15min":2.7429999999999999},"last":0.51200000000000001}]},{"osd":7,"last update":"Wed Mar 10 13:48:46 2021","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":2.7930000000000001,"5min":2.7930000000000001,"15min":2.7930000000000001},"last":0.33000000000000002},{"interface":"front","average":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":2.8860000000000001,"5min":2.8860000000000001,"15min":2.8860000000000001},"last":0.46100000000000002}]}]},{"osd":5,"up_from":37,"seq":158913789986,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049032,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031352,"statfs":{"total":90194313216,"available":89120104448,"internally_reserved":1073741824,"allocated":458752,"data_stored":183290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 13:49:01 2021","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.472,"15min":1.464},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":2.5870000000000002,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":0.748},{"interface":"front","average":{"1min":1.595,"5min":1.5009999999999999,"15min":1.4850000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":2.7029999999999998,"5min":2.7029999999999998,"15min":2.7029999999999998},"last":1.044}]},{"osd":1,"last update":"Wed Mar 10 13:49:01 2021","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.403,"15min":1.413},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.2959999999999998,"5min":2.5339999999999998,"15min":2.5339999999999998},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.228,"15min":1.2290000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":2.226,"5min":2.226,"15min":2.226},"last":0.88800000000000001}]},{"osd":2,"last update":"Wed Mar 10 13:49:01 2021","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.377,"15min":1.383},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.1509999999999998,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.5649999999999999,"5min":1.5229999999999999,"15min":1.516},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.5489999999999999,"5min":2.5539999999999998,"15min":2.5539999999999998},"last":1.6850000000000001}]},{"osd":3,"last update":"Wed Mar 10 13:49:01 2021","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.452,"15min":1.462},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":2.4079999999999999,"5min":2.6379999999999999,"15min":2.6379999999999999},"last":1.468},{"interface":"front","average":{"1min":1.6279999999999999,"5min":1.5009999999999999,"15min":1.48},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2.7170000000000001,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":1.9219999999999999}]},{"osd":4,"last update":"Wed Mar 10 13:49:01 2021","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":0.872,"15min":0.83199999999999996},"min":{"1min":0.32700000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":1.214},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.042,"15min":0.99399999999999999},"min":{"1min":0.33500000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":2.581,"5min":2.581,"15min":2.581},"last":1.6140000000000001}]},{"osd":6,"last update":"Wed Mar 10 13:49:26 2021","interfaces":[{"interface":"back","average":{"1min":1.6559999999999999,"5min":1.337,"15min":1.284},"min":{"1min":0.42599999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":2.331,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":1.833},{"interface":"front","average":{"1min":1.8,"5min":1.216,"15min":1.119},"min":{"1min":0.41399999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":2.8450000000000002,"5min":2.8450000000000002,"15min":2.8450000000000002},"last":2.028}]},{"osd":7,"last update":"Wed Mar 10 13:48:45 2021","interfaces":[{"interface":"back","average":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":2.9329999999999998,"5min":2.9329999999999998,"15min":2.9329999999999998},"last":2.1560000000000001},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":2.2200000000000002,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":1.54}]}]}]}} 2021-03-10T13:49:29.546 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2021-03-10T13:49:29.546 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2021-03-10T13:49:29.546 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2021-03-10T13:49:29.547 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -- ceph health --format=json 2021-03-10T13:49:29.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:29 gibba013 bash[9767]: cluster 2021-03-10T13:49:28.494936+0000 mgr.y (mgr.14140) 230 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:29.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:29 gibba013 bash[9767]: audit 2021-03-10T13:49:28.947570+0000 mgr.y (mgr.14140) 231 : audit [DBG] from='client.14454 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-03-10T13:49:29.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:29 gibba013 bash[13024]: cluster 2021-03-10T13:49:28.494936+0000 mgr.y (mgr.14140) 230 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:29.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:29 gibba013 bash[13024]: audit 2021-03-10T13:49:28.947570+0000 mgr.y (mgr.14140) 231 : audit [DBG] from='client.14454 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-03-10T13:49:30.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:29 gibba020 bash[9782]: cluster 2021-03-10T13:49:28.494936+0000 mgr.y (mgr.14140) 230 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:30.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:29 gibba020 bash[9782]: audit 2021-03-10T13:49:28.947570+0000 mgr.y (mgr.14140) 231 : audit [DBG] from='client.14454 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-03-10T13:49:32.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:31 gibba013 bash[13024]: cluster 2021-03-10T13:49:30.495644+0000 mgr.y (mgr.14140) 232 : cluster [DBG] pgmap v218: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:32.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:31 gibba013 bash[9767]: cluster 2021-03-10T13:49:30.495644+0000 mgr.y (mgr.14140) 232 : cluster [DBG] pgmap v218: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:32.194 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:31 gibba020 bash[9782]: cluster 2021-03-10T13:49:30.495644+0000 mgr.y (mgr.14140) 232 : cluster [DBG] pgmap v218: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:32.321 INFO:teuthology.orchestra.run.gibba013.stdout: 2021-03-10T13:49:32.976 INFO:teuthology.orchestra.run.gibba013.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2021-03-10T13:49:32.976 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2021-03-10T13:49:32.977 INFO:tasks.cephadm:Setup complete, yielding 2021-03-10T13:49:32.977 INFO:teuthology.run_tasks:Running task cephadm.shell... 2021-03-10T13:49:32.987 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@gibba013.front.sepia.ceph.com 2021-03-10T13:49:32.987 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -e sha1=b26fc080937a021ce826cdc94d1adb52c064381a -- bash -c 'radosgw-admin realm create --rgw-realm=r --default' 2021-03-10T13:49:33.073 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:32 gibba013 bash[9767]: audit 2021-03-10T13:49:32.318540+0000 mon.a (mon.0) 539 : audit [DBG] from='client.? 172.21.2.113:0/2179495602' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-03-10T13:49:33.073 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:32 gibba013 bash[13024]: audit 2021-03-10T13:49:32.318540+0000 mon.a (mon.0) 539 : audit [DBG] from='client.? 172.21.2.113:0/2179495602' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-03-10T13:49:33.194 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:32 gibba020 bash[9782]: audit 2021-03-10T13:49:32.318540+0000 mon.a (mon.0) 539 : audit [DBG] from='client.? 172.21.2.113:0/2179495602' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-03-10T13:49:34.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:33 gibba013 bash[9767]: cluster 2021-03-10T13:49:32.496462+0000 mgr.y (mgr.14140) 233 : cluster [DBG] pgmap v219: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:34.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:33 gibba013 bash[13024]: cluster 2021-03-10T13:49:32.496462+0000 mgr.y (mgr.14140) 233 : cluster [DBG] pgmap v219: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:34.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:33 gibba020 bash[9782]: cluster 2021-03-10T13:49:32.496462+0000 mgr.y (mgr.14140) 233 : cluster [DBG] pgmap v219: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:36.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:35 gibba013 bash[9767]: cluster 2021-03-10T13:49:34.497305+0000 mgr.y (mgr.14140) 234 : cluster [DBG] pgmap v220: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:36.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:35 gibba013 bash[13024]: cluster 2021-03-10T13:49:34.497305+0000 mgr.y (mgr.14140) 234 : cluster [DBG] pgmap v220: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:36.194 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:35 gibba020 bash[9782]: cluster 2021-03-10T13:49:34.497305+0000 mgr.y (mgr.14140) 234 : cluster [DBG] pgmap v220: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:36.878 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T13:49:36.879 INFO:teuthology.orchestra.run.gibba013.stdout: "id": "6c0bc3a3-3ea2-4e06-a7ad-fbe7c3b573ef", 2021-03-10T13:49:36.879 INFO:teuthology.orchestra.run.gibba013.stdout: "name": "r", 2021-03-10T13:49:36.879 INFO:teuthology.orchestra.run.gibba013.stdout: "current_period": "fc77a873-bddf-46b1-9ab7-7d9f53d74f95", 2021-03-10T13:49:36.879 INFO:teuthology.orchestra.run.gibba013.stdout: "epoch": 1 2021-03-10T13:49:36.880 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T13:49:37.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:36 gibba013 bash[9767]: cluster 2021-03-10T13:49:35.850831+0000 mon.a (mon.0) 540 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2021-03-10T13:49:37.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:36 gibba013 bash[9767]: audit 2021-03-10T13:49:35.852384+0000 mon.c (mon.1) 18 : audit [INF] from='client.? 172.21.2.113:0/482333474' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-03-10T13:49:37.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:36 gibba013 bash[9767]: audit 2021-03-10T13:49:35.856121+0000 mon.a (mon.0) 541 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-03-10T13:49:37.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:36 gibba013 bash[9767]: audit 2021-03-10T13:49:36.856562+0000 mon.a (mon.0) 542 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-03-10T13:49:37.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:36 gibba013 bash[9767]: cluster 2021-03-10T13:49:36.856602+0000 mon.a (mon.0) 543 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2021-03-10T13:49:37.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:36 gibba013 bash[13024]: cluster 2021-03-10T13:49:35.850831+0000 mon.a (mon.0) 540 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2021-03-10T13:49:37.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:36 gibba013 bash[13024]: audit 2021-03-10T13:49:35.852384+0000 mon.c (mon.1) 18 : audit [INF] from='client.? 172.21.2.113:0/482333474' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-03-10T13:49:37.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:36 gibba013 bash[13024]: audit 2021-03-10T13:49:35.856121+0000 mon.a (mon.0) 541 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-03-10T13:49:37.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:36 gibba013 bash[13024]: audit 2021-03-10T13:49:36.856562+0000 mon.a (mon.0) 542 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-03-10T13:49:37.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:36 gibba013 bash[13024]: cluster 2021-03-10T13:49:36.856602+0000 mon.a (mon.0) 543 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2021-03-10T13:49:37.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:36 gibba020 bash[9782]: cluster 2021-03-10T13:49:35.850831+0000 mon.a (mon.0) 540 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2021-03-10T13:49:37.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:36 gibba020 bash[9782]: audit 2021-03-10T13:49:35.852384+0000 mon.c (mon.1) 18 : audit [INF] from='client.? 172.21.2.113:0/482333474' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-03-10T13:49:37.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:36 gibba020 bash[9782]: audit 2021-03-10T13:49:35.856121+0000 mon.a (mon.0) 541 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-03-10T13:49:37.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:36 gibba020 bash[9782]: audit 2021-03-10T13:49:36.856562+0000 mon.a (mon.0) 542 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-03-10T13:49:37.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:36 gibba020 bash[9782]: cluster 2021-03-10T13:49:36.856602+0000 mon.a (mon.0) 543 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2021-03-10T13:49:37.487 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -e sha1=b26fc080937a021ce826cdc94d1adb52c064381a -- bash -c 'radosgw-admin zonegroup create --rgw-zonegroup=default --master --default' 2021-03-10T13:49:38.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:37 gibba013 bash[9767]: cluster 2021-03-10T13:49:36.497916+0000 mgr.y (mgr.14140) 235 : cluster [DBG] pgmap v222: 33 pgs: 32 unknown, 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:38.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:37 gibba013 bash[13024]: cluster 2021-03-10T13:49:36.497916+0000 mgr.y (mgr.14140) 235 : cluster [DBG] pgmap v222: 33 pgs: 32 unknown, 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:38.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:37 gibba020 bash[9782]: cluster 2021-03-10T13:49:36.497916+0000 mgr.y (mgr.14140) 235 : cluster [DBG] pgmap v222: 33 pgs: 32 unknown, 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:49:39.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:38 gibba013 bash[9767]: cluster 2021-03-10T13:49:37.863296+0000 mon.a (mon.0) 544 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2021-03-10T13:49:39.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:38 gibba013 bash[13024]: cluster 2021-03-10T13:49:37.863296+0000 mon.a (mon.0) 544 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2021-03-10T13:49:39.194 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:38 gibba020 bash[9782]: cluster 2021-03-10T13:49:37.863296+0000 mon.a (mon.0) 544 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2021-03-10T13:49:40.076 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T13:49:40.076 INFO:teuthology.orchestra.run.gibba013.stdout: "id": "92102a18-2282-4be8-a4fa-4544ce19972c", 2021-03-10T13:49:40.076 INFO:teuthology.orchestra.run.gibba013.stdout: "name": "default", 2021-03-10T13:49:40.076 INFO:teuthology.orchestra.run.gibba013.stdout: "api_name": "default", 2021-03-10T13:49:40.077 INFO:teuthology.orchestra.run.gibba013.stdout: "is_master": "true", 2021-03-10T13:49:40.077 INFO:teuthology.orchestra.run.gibba013.stdout: "endpoints": [], 2021-03-10T13:49:40.077 INFO:teuthology.orchestra.run.gibba013.stdout: "hostnames": [], 2021-03-10T13:49:40.077 INFO:teuthology.orchestra.run.gibba013.stdout: "hostnames_s3website": [], 2021-03-10T13:49:40.077 INFO:teuthology.orchestra.run.gibba013.stdout: "master_zone": "", 2021-03-10T13:49:40.078 INFO:teuthology.orchestra.run.gibba013.stdout: "zones": [], 2021-03-10T13:49:40.078 INFO:teuthology.orchestra.run.gibba013.stdout: "placement_targets": [], 2021-03-10T13:49:40.078 INFO:teuthology.orchestra.run.gibba013.stdout: "default_placement": "", 2021-03-10T13:49:40.078 INFO:teuthology.orchestra.run.gibba013.stdout: "realm_id": "6c0bc3a3-3ea2-4e06-a7ad-fbe7c3b573ef", 2021-03-10T13:49:40.078 INFO:teuthology.orchestra.run.gibba013.stdout: "sync_policy": { 2021-03-10T13:49:40.079 INFO:teuthology.orchestra.run.gibba013.stdout: "groups": [] 2021-03-10T13:49:40.079 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T13:49:40.079 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T13:49:40.167 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:39 gibba013 bash[9767]: cluster 2021-03-10T13:49:38.498732+0000 mgr.y (mgr.14140) 236 : cluster [DBG] pgmap v225: 33 pgs: 5 creating+peering, 7 active+clean, 21 unknown; 369 B data, 3.6 MiB used, 664 GiB / 672 GiB avail; 682 B/s wr, 0 op/s 2021-03-10T13:49:40.167 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:39 gibba013 bash[13024]: cluster 2021-03-10T13:49:38.498732+0000 mgr.y (mgr.14140) 236 : cluster [DBG] pgmap v225: 33 pgs: 5 creating+peering, 7 active+clean, 21 unknown; 369 B data, 3.6 MiB used, 664 GiB / 672 GiB avail; 682 B/s wr, 0 op/s 2021-03-10T13:49:40.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:39 gibba020 bash[9782]: cluster 2021-03-10T13:49:38.498732+0000 mgr.y (mgr.14140) 236 : cluster [DBG] pgmap v225: 33 pgs: 5 creating+peering, 7 active+clean, 21 unknown; 369 B data, 3.6 MiB used, 664 GiB / 672 GiB avail; 682 B/s wr, 0 op/s 2021-03-10T13:49:40.711 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -e sha1=b26fc080937a021ce826cdc94d1adb52c064381a -- bash -c 'radosgw-admin zone create --rgw-zonegroup=default --rgw-zone=z --master --default' 2021-03-10T13:49:41.938 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:41 gibba013 bash[9767]: cluster 2021-03-10T13:49:40.499899+0000 mgr.y (mgr.14140) 237 : cluster [DBG] pgmap v226: 33 pgs: 5 creating+peering, 24 active+clean, 4 unknown; 470 B data, 3.8 MiB used, 664 GiB / 672 GiB avail; 170 B/s rd, 1023 B/s wr, 1 op/s 2021-03-10T13:49:41.939 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:41 gibba013 bash[13024]: cluster 2021-03-10T13:49:40.499899+0000 mgr.y (mgr.14140) 237 : cluster [DBG] pgmap v226: 33 pgs: 5 creating+peering, 24 active+clean, 4 unknown; 470 B data, 3.8 MiB used, 664 GiB / 672 GiB avail; 170 B/s rd, 1023 B/s wr, 1 op/s 2021-03-10T13:49:42.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:41 gibba020 bash[9782]: cluster 2021-03-10T13:49:40.499899+0000 mgr.y (mgr.14140) 237 : cluster [DBG] pgmap v226: 33 pgs: 5 creating+peering, 24 active+clean, 4 unknown; 470 B data, 3.8 MiB used, 664 GiB / 672 GiB avail; 170 B/s rd, 1023 B/s wr, 1 op/s 2021-03-10T13:49:43.506 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T13:49:43.507 INFO:teuthology.orchestra.run.gibba013.stdout: "id": "26eb8495-334e-4a0c-ae6b-a2287a535a70", 2021-03-10T13:49:43.507 INFO:teuthology.orchestra.run.gibba013.stdout: "name": "z", 2021-03-10T13:49:43.507 INFO:teuthology.orchestra.run.gibba013.stdout: "domain_root": "z.rgw.meta:root", 2021-03-10T13:49:43.507 INFO:teuthology.orchestra.run.gibba013.stdout: "control_pool": "z.rgw.control", 2021-03-10T13:49:43.507 INFO:teuthology.orchestra.run.gibba013.stdout: "gc_pool": "z.rgw.log:gc", 2021-03-10T13:49:43.508 INFO:teuthology.orchestra.run.gibba013.stdout: "lc_pool": "z.rgw.log:lc", 2021-03-10T13:49:43.508 INFO:teuthology.orchestra.run.gibba013.stdout: "log_pool": "z.rgw.log", 2021-03-10T13:49:43.508 INFO:teuthology.orchestra.run.gibba013.stdout: "intent_log_pool": "z.rgw.log:intent", 2021-03-10T13:49:43.508 INFO:teuthology.orchestra.run.gibba013.stdout: "usage_log_pool": "z.rgw.log:usage", 2021-03-10T13:49:43.508 INFO:teuthology.orchestra.run.gibba013.stdout: "roles_pool": "z.rgw.meta:roles", 2021-03-10T13:49:43.508 INFO:teuthology.orchestra.run.gibba013.stdout: "reshard_pool": "z.rgw.log:reshard", 2021-03-10T13:49:43.509 INFO:teuthology.orchestra.run.gibba013.stdout: "user_keys_pool": "z.rgw.meta:users.keys", 2021-03-10T13:49:43.509 INFO:teuthology.orchestra.run.gibba013.stdout: "user_email_pool": "z.rgw.meta:users.email", 2021-03-10T13:49:43.509 INFO:teuthology.orchestra.run.gibba013.stdout: "user_swift_pool": "z.rgw.meta:users.swift", 2021-03-10T13:49:43.509 INFO:teuthology.orchestra.run.gibba013.stdout: "user_uid_pool": "z.rgw.meta:users.uid", 2021-03-10T13:49:43.509 INFO:teuthology.orchestra.run.gibba013.stdout: "otp_pool": "z.rgw.otp", 2021-03-10T13:49:43.510 INFO:teuthology.orchestra.run.gibba013.stdout: "system_key": { 2021-03-10T13:49:43.510 INFO:teuthology.orchestra.run.gibba013.stdout: "access_key": "", 2021-03-10T13:49:43.510 INFO:teuthology.orchestra.run.gibba013.stdout: "secret_key": "" 2021-03-10T13:49:43.510 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:49:43.511 INFO:teuthology.orchestra.run.gibba013.stdout: "placement_pools": [ 2021-03-10T13:49:43.511 INFO:teuthology.orchestra.run.gibba013.stdout: { 2021-03-10T13:49:43.511 INFO:teuthology.orchestra.run.gibba013.stdout: "key": "default-placement", 2021-03-10T13:49:43.511 INFO:teuthology.orchestra.run.gibba013.stdout: "val": { 2021-03-10T13:49:43.511 INFO:teuthology.orchestra.run.gibba013.stdout: "index_pool": "z.rgw.buckets.index", 2021-03-10T13:49:43.512 INFO:teuthology.orchestra.run.gibba013.stdout: "storage_classes": { 2021-03-10T13:49:43.512 INFO:teuthology.orchestra.run.gibba013.stdout: "STANDARD": { 2021-03-10T13:49:43.512 INFO:teuthology.orchestra.run.gibba013.stdout: "data_pool": "z.rgw.buckets.data" 2021-03-10T13:49:43.512 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T13:49:43.512 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:49:43.513 INFO:teuthology.orchestra.run.gibba013.stdout: "data_extra_pool": "z.rgw.buckets.non-ec", 2021-03-10T13:49:43.513 INFO:teuthology.orchestra.run.gibba013.stdout: "index_type": 0 2021-03-10T13:49:43.513 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T13:49:43.513 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T13:49:43.513 INFO:teuthology.orchestra.run.gibba013.stdout: ], 2021-03-10T13:49:43.514 INFO:teuthology.orchestra.run.gibba013.stdout: "realm_id": "6c0bc3a3-3ea2-4e06-a7ad-fbe7c3b573ef" 2021-03-10T13:49:43.514 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T13:49:44.126 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:43 gibba013 bash[9767]: cluster 2021-03-10T13:49:42.500703+0000 mgr.y (mgr.14140) 238 : cluster [DBG] pgmap v227: 33 pgs: 33 active+clean; 516 B data, 3.9 MiB used, 664 GiB / 672 GiB avail; 307 B/s rd, 1.2 KiB/s wr, 1 op/s 2021-03-10T13:49:44.127 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:43 gibba013 bash[13024]: cluster 2021-03-10T13:49:42.500703+0000 mgr.y (mgr.14140) 238 : cluster [DBG] pgmap v227: 33 pgs: 33 active+clean; 516 B data, 3.9 MiB used, 664 GiB / 672 GiB avail; 307 B/s rd, 1.2 KiB/s wr, 1 op/s 2021-03-10T13:49:44.128 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -e sha1=b26fc080937a021ce826cdc94d1adb52c064381a -- bash -c 'radosgw-admin period update --rgw-realm=r --commit' 2021-03-10T13:49:44.194 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:43 gibba020 bash[9782]: cluster 2021-03-10T13:49:42.500703+0000 mgr.y (mgr.14140) 238 : cluster [DBG] pgmap v227: 33 pgs: 33 active+clean; 516 B data, 3.9 MiB used, 664 GiB / 672 GiB avail; 307 B/s rd, 1.2 KiB/s wr, 1 op/s 2021-03-10T13:49:46.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:45 gibba013 bash[9767]: cluster 2021-03-10T13:49:44.501642+0000 mgr.y (mgr.14140) 239 : cluster [DBG] pgmap v228: 33 pgs: 33 active+clean; 1.3 KiB data, 3.9 MiB used, 664 GiB / 672 GiB avail; 511 B/s rd, 1.2 KiB/s wr, 2 op/s 2021-03-10T13:49:46.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:45 gibba013 bash[13024]: cluster 2021-03-10T13:49:44.501642+0000 mgr.y (mgr.14140) 239 : cluster [DBG] pgmap v228: 33 pgs: 33 active+clean; 1.3 KiB data, 3.9 MiB used, 664 GiB / 672 GiB avail; 511 B/s rd, 1.2 KiB/s wr, 2 op/s 2021-03-10T13:49:46.194 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:45 gibba020 bash[9782]: cluster 2021-03-10T13:49:44.501642+0000 mgr.y (mgr.14140) 239 : cluster [DBG] pgmap v228: 33 pgs: 33 active+clean; 1.3 KiB data, 3.9 MiB used, 664 GiB / 672 GiB avail; 511 B/s rd, 1.2 KiB/s wr, 2 op/s 2021-03-10T13:49:48.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:47 gibba013 bash[9767]: cluster 2021-03-10T13:49:46.502547+0000 mgr.y (mgr.14140) 240 : cluster [DBG] pgmap v229: 33 pgs: 33 active+clean; 1.7 KiB data, 4.0 MiB used, 664 GiB / 672 GiB avail; 530 B/s rd, 1.6 KiB/s wr, 2 op/s 2021-03-10T13:49:48.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:47 gibba013 bash[9767]: cluster 2021-03-10T13:49:46.936856+0000 mon.a (mon.0) 545 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2021-03-10T13:49:48.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:47 gibba013 bash[9767]: audit 2021-03-10T13:49:46.937562+0000 mon.a (mon.0) 546 : audit [INF] from='client.? 172.21.2.113:0/3991841966' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2021-03-10T13:49:48.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:47 gibba013 bash[13024]: cluster 2021-03-10T13:49:46.502547+0000 mgr.y (mgr.14140) 240 : cluster [DBG] pgmap v229: 33 pgs: 33 active+clean; 1.7 KiB data, 4.0 MiB used, 664 GiB / 672 GiB avail; 530 B/s rd, 1.6 KiB/s wr, 2 op/s 2021-03-10T13:49:48.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:47 gibba013 bash[13024]: cluster 2021-03-10T13:49:46.936856+0000 mon.a (mon.0) 545 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2021-03-10T13:49:48.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:47 gibba013 bash[13024]: audit 2021-03-10T13:49:46.937562+0000 mon.a (mon.0) 546 : audit [INF] from='client.? 172.21.2.113:0/3991841966' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2021-03-10T13:49:48.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:47 gibba020 bash[9782]: cluster 2021-03-10T13:49:46.502547+0000 mgr.y (mgr.14140) 240 : cluster [DBG] pgmap v229: 33 pgs: 33 active+clean; 1.7 KiB data, 4.0 MiB used, 664 GiB / 672 GiB avail; 530 B/s rd, 1.6 KiB/s wr, 2 op/s 2021-03-10T13:49:48.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:47 gibba020 bash[9782]: cluster 2021-03-10T13:49:46.936856+0000 mon.a (mon.0) 545 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2021-03-10T13:49:48.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:47 gibba020 bash[9782]: audit 2021-03-10T13:49:46.937562+0000 mon.a (mon.0) 546 : audit [INF] from='client.? 172.21.2.113:0/3991841966' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2021-03-10T13:49:49.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:48 gibba013 bash[9767]: audit 2021-03-10T13:49:47.940893+0000 mon.a (mon.0) 547 : audit [INF] from='client.? 172.21.2.113:0/3991841966' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2021-03-10T13:49:49.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:48 gibba013 bash[9767]: cluster 2021-03-10T13:49:47.940994+0000 mon.a (mon.0) 548 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2021-03-10T13:49:49.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:48 gibba013 bash[13024]: audit 2021-03-10T13:49:47.940893+0000 mon.a (mon.0) 547 : audit [INF] from='client.? 172.21.2.113:0/3991841966' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2021-03-10T13:49:49.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:48 gibba013 bash[13024]: cluster 2021-03-10T13:49:47.940994+0000 mon.a (mon.0) 548 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2021-03-10T13:49:49.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:48 gibba020 bash[9782]: audit 2021-03-10T13:49:47.940893+0000 mon.a (mon.0) 547 : audit [INF] from='client.? 172.21.2.113:0/3991841966' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2021-03-10T13:49:49.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:48 gibba020 bash[9782]: cluster 2021-03-10T13:49:47.940994+0000 mon.a (mon.0) 548 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2021-03-10T13:49:50.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:49 gibba013 bash[9767]: cluster 2021-03-10T13:49:48.503279+0000 mgr.y (mgr.14140) 241 : cluster [DBG] pgmap v232: 65 pgs: 3 creating+peering, 29 unknown, 33 active+clean; 1.8 KiB data, 4.0 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-03-10T13:49:50.772 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:49 gibba013 bash[9767]: cluster 2021-03-10T13:49:48.946858+0000 mon.a (mon.0) 549 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2021-03-10T13:49:50.773 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:49 gibba013 bash[9767]: audit 2021-03-10T13:49:48.948732+0000 mon.a (mon.0) 550 : audit [INF] from='client.? 172.21.2.113:0/3991841966' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2021-03-10T13:49:50.773 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:49 gibba013 bash[13024]: cluster 2021-03-10T13:49:48.503279+0000 mgr.y (mgr.14140) 241 : cluster [DBG] pgmap v232: 65 pgs: 3 creating+peering, 29 unknown, 33 active+clean; 1.8 KiB data, 4.0 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-03-10T13:49:50.773 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:49 gibba013 bash[13024]: cluster 2021-03-10T13:49:48.946858+0000 mon.a (mon.0) 549 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2021-03-10T13:49:50.774 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:49 gibba013 bash[13024]: audit 2021-03-10T13:49:48.948732+0000 mon.a (mon.0) 550 : audit [INF] from='client.? 172.21.2.113:0/3991841966' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2021-03-10T13:49:50.774 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:49 gibba020 bash[9782]: cluster 2021-03-10T13:49:48.503279+0000 mgr.y (mgr.14140) 241 : cluster [DBG] pgmap v232: 65 pgs: 3 creating+peering, 29 unknown, 33 active+clean; 1.8 KiB data, 4.0 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-03-10T13:49:50.774 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:49 gibba020 bash[9782]: cluster 2021-03-10T13:49:48.946858+0000 mon.a (mon.0) 549 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2021-03-10T13:49:50.775 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:49 gibba020 bash[9782]: audit 2021-03-10T13:49:48.948732+0000 mon.a (mon.0) 550 : audit [INF] from='client.? 172.21.2.113:0/3991841966' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2021-03-10T13:49:51.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:50 gibba013 bash[9767]: audit 2021-03-10T13:49:49.951638+0000 mon.a (mon.0) 551 : audit [INF] from='client.? 172.21.2.113:0/3991841966' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2021-03-10T13:49:51.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:50 gibba013 bash[9767]: cluster 2021-03-10T13:49:49.951689+0000 mon.a (mon.0) 552 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2021-03-10T13:49:51.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:50 gibba013 bash[9767]: cluster 2021-03-10T13:49:50.957357+0000 mon.a (mon.0) 553 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2021-03-10T13:49:51.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:50 gibba013 bash[13024]: audit 2021-03-10T13:49:49.951638+0000 mon.a (mon.0) 551 : audit [INF] from='client.? 172.21.2.113:0/3991841966' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2021-03-10T13:49:51.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:50 gibba013 bash[13024]: cluster 2021-03-10T13:49:49.951689+0000 mon.a (mon.0) 552 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2021-03-10T13:49:51.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:50 gibba013 bash[13024]: cluster 2021-03-10T13:49:50.957357+0000 mon.a (mon.0) 553 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2021-03-10T13:49:51.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:50 gibba020 bash[9782]: audit 2021-03-10T13:49:49.951638+0000 mon.a (mon.0) 551 : audit [INF] from='client.? 172.21.2.113:0/3991841966' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2021-03-10T13:49:51.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:50 gibba020 bash[9782]: cluster 2021-03-10T13:49:49.951689+0000 mon.a (mon.0) 552 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2021-03-10T13:49:51.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:50 gibba020 bash[9782]: cluster 2021-03-10T13:49:50.957357+0000 mon.a (mon.0) 553 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2021-03-10T13:49:52.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:51 gibba013 bash[9767]: cluster 2021-03-10T13:49:50.504445+0000 mgr.y (mgr.14140) 242 : cluster [DBG] pgmap v235: 97 pgs: 15 creating+peering, 20 unknown, 62 active+clean; 1.8 KiB data, 4.2 MiB used, 664 GiB / 672 GiB avail; 4.0 KiB/s rd, 255 B/s wr, 4 op/s 2021-03-10T13:49:52.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:51 gibba013 bash[9767]: audit 2021-03-10T13:49:50.959163+0000 mon.a (mon.0) 554 : audit [INF] from='client.? 172.21.2.113:0/2971216336' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2021-03-10T13:49:52.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:51 gibba013 bash[13024]: cluster 2021-03-10T13:49:50.504445+0000 mgr.y (mgr.14140) 242 : cluster [DBG] pgmap v235: 97 pgs: 15 creating+peering, 20 unknown, 62 active+clean; 1.8 KiB data, 4.2 MiB used, 664 GiB / 672 GiB avail; 4.0 KiB/s rd, 255 B/s wr, 4 op/s 2021-03-10T13:49:52.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:51 gibba013 bash[13024]: audit 2021-03-10T13:49:50.959163+0000 mon.a (mon.0) 554 : audit [INF] from='client.? 172.21.2.113:0/2971216336' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2021-03-10T13:49:52.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:51 gibba020 bash[9782]: cluster 2021-03-10T13:49:50.504445+0000 mgr.y (mgr.14140) 242 : cluster [DBG] pgmap v235: 97 pgs: 15 creating+peering, 20 unknown, 62 active+clean; 1.8 KiB data, 4.2 MiB used, 664 GiB / 672 GiB avail; 4.0 KiB/s rd, 255 B/s wr, 4 op/s 2021-03-10T13:49:52.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:51 gibba020 bash[9782]: audit 2021-03-10T13:49:50.959163+0000 mon.a (mon.0) 554 : audit [INF] from='client.? 172.21.2.113:0/2971216336' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2021-03-10T13:49:53.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:52 gibba013 bash[9767]: audit 2021-03-10T13:49:51.962157+0000 mon.a (mon.0) 555 : audit [INF] from='client.? 172.21.2.113:0/2971216336' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2021-03-10T13:49:53.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:52 gibba013 bash[9767]: cluster 2021-03-10T13:49:51.962225+0000 mon.a (mon.0) 556 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2021-03-10T13:49:53.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:52 gibba013 bash[9767]: audit 2021-03-10T13:49:51.963841+0000 mon.a (mon.0) 557 : audit [INF] from='client.? 172.21.2.113:0/2971216336' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-03-10T13:49:53.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:52 gibba013 bash[9767]: audit 2021-03-10T13:49:52.965836+0000 mon.a (mon.0) 558 : audit [INF] from='client.? 172.21.2.113:0/2971216336' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-03-10T13:49:53.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:52 gibba013 bash[13024]: audit 2021-03-10T13:49:51.962157+0000 mon.a (mon.0) 555 : audit [INF] from='client.? 172.21.2.113:0/2971216336' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2021-03-10T13:49:53.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:52 gibba013 bash[13024]: cluster 2021-03-10T13:49:51.962225+0000 mon.a (mon.0) 556 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2021-03-10T13:49:53.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:52 gibba013 bash[13024]: audit 2021-03-10T13:49:51.963841+0000 mon.a (mon.0) 557 : audit [INF] from='client.? 172.21.2.113:0/2971216336' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-03-10T13:49:53.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:52 gibba013 bash[13024]: audit 2021-03-10T13:49:52.965836+0000 mon.a (mon.0) 558 : audit [INF] from='client.? 172.21.2.113:0/2971216336' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-03-10T13:49:53.444 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:52 gibba020 bash[9782]: audit 2021-03-10T13:49:51.962157+0000 mon.a (mon.0) 555 : audit [INF] from='client.? 172.21.2.113:0/2971216336' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2021-03-10T13:49:53.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:52 gibba020 bash[9782]: cluster 2021-03-10T13:49:51.962225+0000 mon.a (mon.0) 556 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2021-03-10T13:49:53.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:52 gibba020 bash[9782]: audit 2021-03-10T13:49:51.963841+0000 mon.a (mon.0) 557 : audit [INF] from='client.? 172.21.2.113:0/2971216336' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-03-10T13:49:53.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:52 gibba020 bash[9782]: audit 2021-03-10T13:49:52.965836+0000 mon.a (mon.0) 558 : audit [INF] from='client.? 172.21.2.113:0/2971216336' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-03-10T13:49:54.187 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T13:49:54.188 INFO:teuthology.orchestra.run.gibba013.stdout: "id": "204b48f9-65cf-49bb-8f27-c478df970397", 2021-03-10T13:49:54.188 INFO:teuthology.orchestra.run.gibba013.stdout: "epoch": 1, 2021-03-10T13:49:54.188 INFO:teuthology.orchestra.run.gibba013.stdout: "predecessor_uuid": "fc77a873-bddf-46b1-9ab7-7d9f53d74f95", 2021-03-10T13:49:54.188 INFO:teuthology.orchestra.run.gibba013.stdout: "sync_status": [], 2021-03-10T13:49:54.188 INFO:teuthology.orchestra.run.gibba013.stdout: "period_map": { 2021-03-10T13:49:54.189 INFO:teuthology.orchestra.run.gibba013.stdout: "id": "204b48f9-65cf-49bb-8f27-c478df970397", 2021-03-10T13:49:54.189 INFO:teuthology.orchestra.run.gibba013.stdout: "zonegroups": [ 2021-03-10T13:49:54.189 INFO:teuthology.orchestra.run.gibba013.stdout: { 2021-03-10T13:49:54.189 INFO:teuthology.orchestra.run.gibba013.stdout: "id": "92102a18-2282-4be8-a4fa-4544ce19972c", 2021-03-10T13:49:54.189 INFO:teuthology.orchestra.run.gibba013.stdout: "name": "default", 2021-03-10T13:49:54.190 INFO:teuthology.orchestra.run.gibba013.stdout: "api_name": "default", 2021-03-10T13:49:54.190 INFO:teuthology.orchestra.run.gibba013.stdout: "is_master": "true", 2021-03-10T13:49:54.190 INFO:teuthology.orchestra.run.gibba013.stdout: "endpoints": [], 2021-03-10T13:49:54.190 INFO:teuthology.orchestra.run.gibba013.stdout: "hostnames": [], 2021-03-10T13:49:54.190 INFO:teuthology.orchestra.run.gibba013.stdout: "hostnames_s3website": [], 2021-03-10T13:49:54.191 INFO:teuthology.orchestra.run.gibba013.stdout: "master_zone": "26eb8495-334e-4a0c-ae6b-a2287a535a70", 2021-03-10T13:49:54.191 INFO:teuthology.orchestra.run.gibba013.stdout: "zones": [ 2021-03-10T13:49:54.191 INFO:teuthology.orchestra.run.gibba013.stdout: { 2021-03-10T13:49:54.191 INFO:teuthology.orchestra.run.gibba013.stdout: "id": "26eb8495-334e-4a0c-ae6b-a2287a535a70", 2021-03-10T13:49:54.191 INFO:teuthology.orchestra.run.gibba013.stdout: "name": "z", 2021-03-10T13:49:54.192 INFO:teuthology.orchestra.run.gibba013.stdout: "endpoints": [], 2021-03-10T13:49:54.192 INFO:teuthology.orchestra.run.gibba013.stdout: "log_meta": "false", 2021-03-10T13:49:54.192 INFO:teuthology.orchestra.run.gibba013.stdout: "log_data": "false", 2021-03-10T13:49:54.192 INFO:teuthology.orchestra.run.gibba013.stdout: "bucket_index_max_shards": 11, 2021-03-10T13:49:54.192 INFO:teuthology.orchestra.run.gibba013.stdout: "read_only": "false", 2021-03-10T13:49:54.193 INFO:teuthology.orchestra.run.gibba013.stdout: "tier_type": "", 2021-03-10T13:49:54.193 INFO:teuthology.orchestra.run.gibba013.stdout: "sync_from_all": "true", 2021-03-10T13:49:54.193 INFO:teuthology.orchestra.run.gibba013.stdout: "sync_from": [], 2021-03-10T13:49:54.193 INFO:teuthology.orchestra.run.gibba013.stdout: "redirect_zone": "" 2021-03-10T13:49:54.193 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T13:49:54.193 INFO:teuthology.orchestra.run.gibba013.stdout: ], 2021-03-10T13:49:54.194 INFO:teuthology.orchestra.run.gibba013.stdout: "placement_targets": [ 2021-03-10T13:49:54.194 INFO:teuthology.orchestra.run.gibba013.stdout: { 2021-03-10T13:49:54.194 INFO:teuthology.orchestra.run.gibba013.stdout: "name": "default-placement", 2021-03-10T13:49:54.194 INFO:teuthology.orchestra.run.gibba013.stdout: "tags": [], 2021-03-10T13:49:54.195 INFO:teuthology.orchestra.run.gibba013.stdout: "storage_classes": [ 2021-03-10T13:49:54.195 INFO:teuthology.orchestra.run.gibba013.stdout: "STANDARD" 2021-03-10T13:49:54.195 INFO:teuthology.orchestra.run.gibba013.stdout: ] 2021-03-10T13:49:54.195 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T13:49:54.195 INFO:teuthology.orchestra.run.gibba013.stdout: ], 2021-03-10T13:49:54.196 INFO:teuthology.orchestra.run.gibba013.stdout: "default_placement": "default-placement", 2021-03-10T13:49:54.196 INFO:teuthology.orchestra.run.gibba013.stdout: "realm_id": "6c0bc3a3-3ea2-4e06-a7ad-fbe7c3b573ef", 2021-03-10T13:49:54.196 INFO:teuthology.orchestra.run.gibba013.stdout: "sync_policy": { 2021-03-10T13:49:54.196 INFO:teuthology.orchestra.run.gibba013.stdout: "groups": [] 2021-03-10T13:49:54.196 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T13:49:54.196 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T13:49:54.197 INFO:teuthology.orchestra.run.gibba013.stdout: ], 2021-03-10T13:49:54.197 INFO:teuthology.orchestra.run.gibba013.stdout: "short_zone_ids": [ 2021-03-10T13:49:54.197 INFO:teuthology.orchestra.run.gibba013.stdout: { 2021-03-10T13:49:54.197 INFO:teuthology.orchestra.run.gibba013.stdout: "key": "26eb8495-334e-4a0c-ae6b-a2287a535a70", 2021-03-10T13:49:54.198 INFO:teuthology.orchestra.run.gibba013.stdout: "val": 3005109250 2021-03-10T13:49:54.198 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T13:49:54.198 INFO:teuthology.orchestra.run.gibba013.stdout: ] 2021-03-10T13:49:54.198 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:49:54.198 INFO:teuthology.orchestra.run.gibba013.stdout: "master_zonegroup": "92102a18-2282-4be8-a4fa-4544ce19972c", 2021-03-10T13:49:54.199 INFO:teuthology.orchestra.run.gibba013.stdout: "master_zone": "26eb8495-334e-4a0c-ae6b-a2287a535a70", 2021-03-10T13:49:54.199 INFO:teuthology.orchestra.run.gibba013.stdout: "period_config": { 2021-03-10T13:49:54.199 INFO:teuthology.orchestra.run.gibba013.stdout: "bucket_quota": { 2021-03-10T13:49:54.199 INFO:teuthology.orchestra.run.gibba013.stdout: "enabled": false, 2021-03-10T13:49:54.199 INFO:teuthology.orchestra.run.gibba013.stdout: "check_on_raw": false, 2021-03-10T13:49:54.200 INFO:teuthology.orchestra.run.gibba013.stdout: "max_size": -1, 2021-03-10T13:49:54.200 INFO:teuthology.orchestra.run.gibba013.stdout: "max_size_kb": 0, 2021-03-10T13:49:54.200 INFO:teuthology.orchestra.run.gibba013.stdout: "max_objects": -1 2021-03-10T13:49:54.200 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:49:54.200 INFO:teuthology.orchestra.run.gibba013.stdout: "user_quota": { 2021-03-10T13:49:54.201 INFO:teuthology.orchestra.run.gibba013.stdout: "enabled": false, 2021-03-10T13:49:54.201 INFO:teuthology.orchestra.run.gibba013.stdout: "check_on_raw": false, 2021-03-10T13:49:54.201 INFO:teuthology.orchestra.run.gibba013.stdout: "max_size": -1, 2021-03-10T13:49:54.201 INFO:teuthology.orchestra.run.gibba013.stdout: "max_size_kb": 0, 2021-03-10T13:49:54.201 INFO:teuthology.orchestra.run.gibba013.stdout: "max_objects": -1 2021-03-10T13:49:54.202 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T13:49:54.202 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:49:54.202 INFO:teuthology.orchestra.run.gibba013.stdout: "realm_id": "6c0bc3a3-3ea2-4e06-a7ad-fbe7c3b573ef", 2021-03-10T13:49:54.202 INFO:teuthology.orchestra.run.gibba013.stdout: "realm_name": "r", 2021-03-10T13:49:54.202 INFO:teuthology.orchestra.run.gibba013.stdout: "realm_epoch": 2 2021-03-10T13:49:54.203 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T13:49:54.285 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:53 gibba013 bash[9767]: cluster 2021-03-10T13:49:52.505500+0000 mgr.y (mgr.14140) 243 : cluster [DBG] pgmap v238: 129 pgs: 20 creating+peering, 39 unknown, 70 active+clean; 1.8 KiB data, 4.3 MiB used, 664 GiB / 672 GiB avail; 2.7 KiB/s rd, 2 op/s 2021-03-10T13:49:54.285 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:53 gibba013 bash[9767]: cluster 2021-03-10T13:49:52.965866+0000 mon.a (mon.0) 559 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2021-03-10T13:49:54.285 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:53 gibba013 bash[9767]: audit 2021-03-10T13:49:52.966773+0000 mon.a (mon.0) 560 : audit [INF] from='client.? 172.21.2.113:0/2971216336' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-03-10T13:49:54.285 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:53 gibba013 bash[9767]: audit 2021-03-10T13:49:53.970148+0000 mon.a (mon.0) 561 : audit [INF] from='client.? 172.21.2.113:0/2971216336' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-03-10T13:49:54.285 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:53 gibba013 bash[9767]: cluster 2021-03-10T13:49:53.970182+0000 mon.a (mon.0) 562 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2021-03-10T13:49:54.286 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:53 gibba013 bash[13024]: cluster 2021-03-10T13:49:52.505500+0000 mgr.y (mgr.14140) 243 : cluster [DBG] pgmap v238: 129 pgs: 20 creating+peering, 39 unknown, 70 active+clean; 1.8 KiB data, 4.3 MiB used, 664 GiB / 672 GiB avail; 2.7 KiB/s rd, 2 op/s 2021-03-10T13:49:54.286 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:53 gibba013 bash[13024]: cluster 2021-03-10T13:49:52.965866+0000 mon.a (mon.0) 559 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2021-03-10T13:49:54.286 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:53 gibba013 bash[13024]: audit 2021-03-10T13:49:52.966773+0000 mon.a (mon.0) 560 : audit [INF] from='client.? 172.21.2.113:0/2971216336' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-03-10T13:49:54.287 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:53 gibba013 bash[13024]: audit 2021-03-10T13:49:53.970148+0000 mon.a (mon.0) 561 : audit [INF] from='client.? 172.21.2.113:0/2971216336' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-03-10T13:49:54.287 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:53 gibba013 bash[13024]: cluster 2021-03-10T13:49:53.970182+0000 mon.a (mon.0) 562 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2021-03-10T13:49:54.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:53 gibba020 bash[9782]: cluster 2021-03-10T13:49:52.505500+0000 mgr.y (mgr.14140) 243 : cluster [DBG] pgmap v238: 129 pgs: 20 creating+peering, 39 unknown, 70 active+clean; 1.8 KiB data, 4.3 MiB used, 664 GiB / 672 GiB avail; 2.7 KiB/s rd, 2 op/s 2021-03-10T13:49:54.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:53 gibba020 bash[9782]: cluster 2021-03-10T13:49:52.965866+0000 mon.a (mon.0) 559 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2021-03-10T13:49:54.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:53 gibba020 bash[9782]: audit 2021-03-10T13:49:52.966773+0000 mon.a (mon.0) 560 : audit [INF] from='client.? 172.21.2.113:0/2971216336' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-03-10T13:49:54.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:53 gibba020 bash[9782]: audit 2021-03-10T13:49:53.970148+0000 mon.a (mon.0) 561 : audit [INF] from='client.? 172.21.2.113:0/2971216336' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-03-10T13:49:54.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:53 gibba020 bash[9782]: cluster 2021-03-10T13:49:53.970182+0000 mon.a (mon.0) 562 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2021-03-10T13:49:54.986 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -e sha1=b26fc080937a021ce826cdc94d1adb52c064381a -- bash -c 'ceph orch apply rgw r z --placement=1' 2021-03-10T13:49:56.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:55 gibba013 bash[9767]: cluster 2021-03-10T13:49:54.506577+0000 mgr.y (mgr.14140) 244 : cluster [DBG] pgmap v241: 129 pgs: 8 creating+peering, 15 unknown, 106 active+clean; 2.4 KiB data, 4.5 MiB used, 664 GiB / 672 GiB avail; 511 B/s rd, 1.7 KiB/s wr, 6 op/s 2021-03-10T13:49:56.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:55 gibba013 bash[13024]: cluster 2021-03-10T13:49:54.506577+0000 mgr.y (mgr.14140) 244 : cluster [DBG] pgmap v241: 129 pgs: 8 creating+peering, 15 unknown, 106 active+clean; 2.4 KiB data, 4.5 MiB used, 664 GiB / 672 GiB avail; 511 B/s rd, 1.7 KiB/s wr, 6 op/s 2021-03-10T13:49:56.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:55 gibba020 bash[9782]: cluster 2021-03-10T13:49:54.506577+0000 mgr.y (mgr.14140) 244 : cluster [DBG] pgmap v241: 129 pgs: 8 creating+peering, 15 unknown, 106 active+clean; 2.4 KiB data, 4.5 MiB used, 664 GiB / 672 GiB avail; 511 B/s rd, 1.7 KiB/s wr, 6 op/s 2021-03-10T13:49:57.764 INFO:teuthology.orchestra.run.gibba013.stdout:Scheduled rgw update... 2021-03-10T13:49:58.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:57 gibba013 bash[9767]: cluster 2021-03-10T13:49:56.507321+0000 mgr.y (mgr.14140) 245 : cluster [DBG] pgmap v242: 129 pgs: 5 creating+peering, 124 active+clean; 3.5 KiB data, 5.0 MiB used, 664 GiB / 672 GiB avail; 552 B/s rd, 3.6 KiB/s wr, 13 op/s 2021-03-10T13:49:58.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:57 gibba013 bash[9767]: audit 2021-03-10T13:49:57.756931+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2021-03-10T13:49:57.756649\", \"spec\": {\"placement\": {\"count\": 1}, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]: dispatch 2021-03-10T13:49:58.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:57 gibba013 bash[9767]: audit 2021-03-10T13:49:57.760754+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2021-03-10T13:49:57.756649\", \"spec\": {\"placement\": {\"count\": 1}, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]': finished 2021-03-10T13:49:58.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:57 gibba013 bash[9767]: audit 2021-03-10T13:49:57.763140+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]: dispatch 2021-03-10T13:49:58.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:57 gibba013 bash[9767]: audit 2021-03-10T13:49:57.768808+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]': finished 2021-03-10T13:49:58.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:57 gibba013 bash[9767]: audit 2021-03-10T13:49:57.769794+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]: dispatch 2021-03-10T13:49:58.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:57 gibba013 bash[9767]: audit 2021-03-10T13:49:57.772906+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]': finished 2021-03-10T13:49:58.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:57 gibba013 bash[9767]: audit 2021-03-10T13:49:57.773729+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=80"}]: dispatch 2021-03-10T13:49:58.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:57 gibba013 bash[9767]: audit 2021-03-10T13:49:57.776799+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=80"}]': finished 2021-03-10T13:49:58.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:57 gibba013 bash[9767]: audit 2021-03-10T13:49:57.777700+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba020.txcybs", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2021-03-10T13:49:58.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:57 gibba013 bash[9767]: audit 2021-03-10T13:49:57.780412+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba020.txcybs", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2021-03-10T13:49:58.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:57 gibba013 bash[9767]: audit 2021-03-10T13:49:57.781250+0000 mon.a (mon.0) 573 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:49:58.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:57 gibba013 bash[9767]: audit 2021-03-10T13:49:57.782079+0000 mon.a (mon.0) 574 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.gibba020.txcybs", "key": "container_image"}]: dispatch 2021-03-10T13:49:58.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:57 gibba013 bash[13024]: cluster 2021-03-10T13:49:56.507321+0000 mgr.y (mgr.14140) 245 : cluster [DBG] pgmap v242: 129 pgs: 5 creating+peering, 124 active+clean; 3.5 KiB data, 5.0 MiB used, 664 GiB / 672 GiB avail; 552 B/s rd, 3.6 KiB/s wr, 13 op/s 2021-03-10T13:49:58.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:57 gibba013 bash[13024]: audit 2021-03-10T13:49:57.756931+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2021-03-10T13:49:57.756649\", \"spec\": {\"placement\": {\"count\": 1}, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]: dispatch 2021-03-10T13:49:58.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:57 gibba013 bash[13024]: audit 2021-03-10T13:49:57.760754+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2021-03-10T13:49:57.756649\", \"spec\": {\"placement\": {\"count\": 1}, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]': finished 2021-03-10T13:49:58.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:57 gibba013 bash[13024]: audit 2021-03-10T13:49:57.763140+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]: dispatch 2021-03-10T13:49:58.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:57 gibba013 bash[13024]: audit 2021-03-10T13:49:57.768808+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]': finished 2021-03-10T13:49:58.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:57 gibba013 bash[13024]: audit 2021-03-10T13:49:57.769794+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]: dispatch 2021-03-10T13:49:58.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:57 gibba013 bash[13024]: audit 2021-03-10T13:49:57.772906+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]': finished 2021-03-10T13:49:58.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:57 gibba013 bash[13024]: audit 2021-03-10T13:49:57.773729+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=80"}]: dispatch 2021-03-10T13:49:58.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:57 gibba013 bash[13024]: audit 2021-03-10T13:49:57.776799+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=80"}]': finished 2021-03-10T13:49:58.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:57 gibba013 bash[13024]: audit 2021-03-10T13:49:57.777700+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba020.txcybs", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2021-03-10T13:49:58.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:57 gibba013 bash[13024]: audit 2021-03-10T13:49:57.780412+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba020.txcybs", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2021-03-10T13:49:58.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:57 gibba013 bash[13024]: audit 2021-03-10T13:49:57.781250+0000 mon.a (mon.0) 573 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:49:58.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:57 gibba013 bash[13024]: audit 2021-03-10T13:49:57.782079+0000 mon.a (mon.0) 574 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.gibba020.txcybs", "key": "container_image"}]: dispatch 2021-03-10T13:49:58.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:58 gibba020 bash[9782]: cluster 2021-03-10T13:49:56.507321+0000 mgr.y (mgr.14140) 245 : cluster [DBG] pgmap v242: 129 pgs: 5 creating+peering, 124 active+clean; 3.5 KiB data, 5.0 MiB used, 664 GiB / 672 GiB avail; 552 B/s rd, 3.6 KiB/s wr, 13 op/s 2021-03-10T13:49:58.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:58 gibba020 bash[9782]: audit 2021-03-10T13:49:57.756931+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2021-03-10T13:49:57.756649\", \"spec\": {\"placement\": {\"count\": 1}, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]: dispatch 2021-03-10T13:49:58.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:58 gibba020 bash[9782]: audit 2021-03-10T13:49:57.760754+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2021-03-10T13:49:57.756649\", \"spec\": {\"placement\": {\"count\": 1}, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]': finished 2021-03-10T13:49:58.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:58 gibba020 bash[9782]: audit 2021-03-10T13:49:57.763140+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]: dispatch 2021-03-10T13:49:58.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:58 gibba020 bash[9782]: audit 2021-03-10T13:49:57.768808+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]': finished 2021-03-10T13:49:58.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:58 gibba020 bash[9782]: audit 2021-03-10T13:49:57.769794+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]: dispatch 2021-03-10T13:49:58.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:58 gibba020 bash[9782]: audit 2021-03-10T13:49:57.772906+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]': finished 2021-03-10T13:49:58.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:58 gibba020 bash[9782]: audit 2021-03-10T13:49:57.773729+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=80"}]: dispatch 2021-03-10T13:49:58.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:58 gibba020 bash[9782]: audit 2021-03-10T13:49:57.776799+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=80"}]': finished 2021-03-10T13:49:58.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:58 gibba020 bash[9782]: audit 2021-03-10T13:49:57.777700+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba020.txcybs", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2021-03-10T13:49:58.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:58 gibba020 bash[9782]: audit 2021-03-10T13:49:57.780412+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba020.txcybs", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2021-03-10T13:49:58.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:58 gibba020 bash[9782]: audit 2021-03-10T13:49:57.781250+0000 mon.a (mon.0) 573 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:49:58.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:58 gibba020 bash[9782]: audit 2021-03-10T13:49:57.782079+0000 mon.a (mon.0) 574 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.gibba020.txcybs", "key": "container_image"}]: dispatch 2021-03-10T13:49:58.398 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -e sha1=b26fc080937a021ce826cdc94d1adb52c064381a -- bash -c 'sleep 120' 2021-03-10T13:49:59.258 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:59 gibba020 bash[9782]: audit 2021-03-10T13:49:57.756292+0000 mgr.y (mgr.14140) 246 : audit [DBG] from='client.24442 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "r", "zone_name": "z", "placement": "1", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:49:59.258 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:59 gibba020 bash[9782]: cephadm 2021-03-10T13:49:57.756640+0000 mgr.y (mgr.14140) 247 : cephadm [INF] Saving service rgw.r.z spec with placement count:1 2021-03-10T13:49:59.258 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:49:59 gibba020 bash[9782]: cephadm 2021-03-10T13:49:57.781864+0000 mgr.y (mgr.14140) 248 : cephadm [INF] Deploying daemon rgw.r.z.gibba020.txcybs on gibba020 2021-03-10T13:49:59.286 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:59 gibba013 bash[9767]: audit 2021-03-10T13:49:57.756292+0000 mgr.y (mgr.14140) 246 : audit [DBG] from='client.24442 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "r", "zone_name": "z", "placement": "1", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:49:59.286 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:59 gibba013 bash[9767]: cephadm 2021-03-10T13:49:57.756640+0000 mgr.y (mgr.14140) 247 : cephadm [INF] Saving service rgw.r.z spec with placement count:1 2021-03-10T13:49:59.287 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:49:59 gibba013 bash[9767]: cephadm 2021-03-10T13:49:57.781864+0000 mgr.y (mgr.14140) 248 : cephadm [INF] Deploying daemon rgw.r.z.gibba020.txcybs on gibba020 2021-03-10T13:49:59.287 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:59 gibba013 bash[13024]: audit 2021-03-10T13:49:57.756292+0000 mgr.y (mgr.14140) 246 : audit [DBG] from='client.24442 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "r", "zone_name": "z", "placement": "1", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:49:59.287 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:59 gibba013 bash[13024]: cephadm 2021-03-10T13:49:57.756640+0000 mgr.y (mgr.14140) 247 : cephadm [INF] Saving service rgw.r.z spec with placement count:1 2021-03-10T13:49:59.287 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:49:59 gibba013 bash[13024]: cephadm 2021-03-10T13:49:57.781864+0000 mgr.y (mgr.14140) 248 : cephadm [INF] Deploying daemon rgw.r.z.gibba020.txcybs on gibba020 2021-03-10T13:50:00.028 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:50:00 gibba020 bash[9782]: cluster 2021-03-10T13:49:58.507715+0000 mgr.y (mgr.14140) 249 : cluster [DBG] pgmap v243: 129 pgs: 129 active+clean; 5.4 KiB data, 5.1 MiB used, 664 GiB / 672 GiB avail; 1.1 KiB/s rd, 4.9 KiB/s wr, 18 op/s 2021-03-10T13:50:00.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:50:00 gibba013 bash[9767]: cluster 2021-03-10T13:49:58.507715+0000 mgr.y (mgr.14140) 249 : cluster [DBG] pgmap v243: 129 pgs: 129 active+clean; 5.4 KiB data, 5.1 MiB used, 664 GiB / 672 GiB avail; 1.1 KiB/s rd, 4.9 KiB/s wr, 18 op/s 2021-03-10T13:50:00.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:50:00 gibba013 bash[13024]: cluster 2021-03-10T13:49:58.507715+0000 mgr.y (mgr.14140) 249 : cluster [DBG] pgmap v243: 129 pgs: 129 active+clean; 5.4 KiB data, 5.1 MiB used, 664 GiB / 672 GiB avail; 1.1 KiB/s rd, 4.9 KiB/s wr, 18 op/s 2021-03-10T13:50:01.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:50:01 gibba013 bash[13024]: audit 2021-03-10T13:50:00.054755+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987404\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987464\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987492\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987518\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987545\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987570\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987596\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987622\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:48:34.834688\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987647\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987672\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}, \"rgw.r.z.gibba020.txcybs\": {\"hostname\": \"gibba020\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:50:01.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:50:01 gibba013 bash[13024]: audit 2021-03-10T13:50:00.057491+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987404\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987464\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987492\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987518\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987545\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987570\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987596\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987622\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:48:34.834688\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987647\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987672\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}, \"rgw.r.z.gibba020.txcybs\": {\"hostname\": \"gibba020\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:50:01.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:50:01 gibba013 bash[13024]: audit 2021-03-10T13:50:00.057989+0000 mon.a (mon.0) 577 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:50:01.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:50:01 gibba013 bash[9767]: audit 2021-03-10T13:50:00.054755+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987404\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987464\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987492\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987518\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987545\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987570\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987596\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987622\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:48:34.834688\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987647\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987672\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}, \"rgw.r.z.gibba020.txcybs\": {\"hostname\": \"gibba020\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:50:01.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:50:01 gibba013 bash[9767]: audit 2021-03-10T13:50:00.057491+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987404\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987464\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987492\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987518\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987545\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987570\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987596\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987622\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:48:34.834688\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987647\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987672\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}, \"rgw.r.z.gibba020.txcybs\": {\"hostname\": \"gibba020\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:50:01.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:50:01 gibba013 bash[9767]: audit 2021-03-10T13:50:00.057989+0000 mon.a (mon.0) 577 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:50:01.402 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:50:01 gibba020 bash[9782]: audit 2021-03-10T13:50:00.054755+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987404\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987464\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987492\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987518\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987545\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987570\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987596\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987622\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:48:34.834688\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987647\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987672\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}, \"rgw.r.z.gibba020.txcybs\": {\"hostname\": \"gibba020\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:50:01.402 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:50:01 gibba020 bash[9782]: audit 2021-03-10T13:50:00.057491+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987404\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987464\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987492\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987518\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987545\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987570\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987596\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987622\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:48:34.834688\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987647\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:48:36.987672\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}, \"rgw.r.z.gibba020.txcybs\": {\"hostname\": \"gibba020\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:50:01.403 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:50:01 gibba020 bash[9782]: audit 2021-03-10T13:50:00.057989+0000 mon.a (mon.0) 577 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:50:02.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:50:02 gibba013 bash[9767]: cluster 2021-03-10T13:50:00.509479+0000 mgr.y (mgr.14140) 250 : cluster [DBG] pgmap v244: 129 pgs: 129 active+clean; 6.9 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 895 B/s rd, 4.9 KiB/s wr, 18 op/s 2021-03-10T13:50:02.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:50:02 gibba013 bash[13024]: cluster 2021-03-10T13:50:00.509479+0000 mgr.y (mgr.14140) 250 : cluster [DBG] pgmap v244: 129 pgs: 129 active+clean; 6.9 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 895 B/s rd, 4.9 KiB/s wr, 18 op/s 2021-03-10T13:50:02.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:50:02 gibba013 bash[9767]: audit 2021-03-10T13:50:01.180726+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175119\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175388\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175555\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175709\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175858\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176003\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176147\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176294\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:48:34.834688\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176440\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176586\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}, \"rgw.r.z.gibba020.txcybs\": {\"hostname\": \"gibba020\", \"container_id\": \"809accf5e776\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176734\", \"created\": \"2021-03-10T13:50:00.050014\", \"started\": \"2021-03-10T13:50:00.073039\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038\"}}, \"last_daemon_update\": \"2021-03-10T13:50:01.177071\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:50:02.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:50:02 gibba013 bash[9767]: audit 2021-03-10T13:50:01.190318+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175119\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175388\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175555\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175709\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175858\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176003\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176147\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176294\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:48:34.834688\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176440\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176586\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}, \"rgw.r.z.gibba020.txcybs\": {\"hostname\": \"gibba020\", \"container_id\": \"809accf5e776\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176734\", \"created\": \"2021-03-10T13:50:00.050014\", \"started\": \"2021-03-10T13:50:00.073039\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038\"}}, \"last_daemon_update\": \"2021-03-10T13:50:01.177071\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:50:02.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:50:02 gibba013 bash[13024]: audit 2021-03-10T13:50:01.180726+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175119\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175388\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175555\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175709\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175858\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176003\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176147\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176294\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:48:34.834688\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176440\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176586\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}, \"rgw.r.z.gibba020.txcybs\": {\"hostname\": \"gibba020\", \"container_id\": \"809accf5e776\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176734\", \"created\": \"2021-03-10T13:50:00.050014\", \"started\": \"2021-03-10T13:50:00.073039\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038\"}}, \"last_daemon_update\": \"2021-03-10T13:50:01.177071\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:50:02.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:50:02 gibba013 bash[13024]: audit 2021-03-10T13:50:01.190318+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175119\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175388\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175555\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175709\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175858\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176003\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176147\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176294\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:48:34.834688\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176440\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176586\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}, \"rgw.r.z.gibba020.txcybs\": {\"hostname\": \"gibba020\", \"container_id\": \"809accf5e776\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176734\", \"created\": \"2021-03-10T13:50:00.050014\", \"started\": \"2021-03-10T13:50:00.073039\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038\"}}, \"last_daemon_update\": \"2021-03-10T13:50:01.177071\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:50:02.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:50:02 gibba020 bash[9782]: cluster 2021-03-10T13:50:00.509479+0000 mgr.y (mgr.14140) 250 : cluster [DBG] pgmap v244: 129 pgs: 129 active+clean; 6.9 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 895 B/s rd, 4.9 KiB/s wr, 18 op/s 2021-03-10T13:50:02.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:50:02 gibba020 bash[9782]: audit 2021-03-10T13:50:01.180726+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175119\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175388\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175555\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175709\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175858\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176003\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176147\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176294\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:48:34.834688\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176440\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176586\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}, \"rgw.r.z.gibba020.txcybs\": {\"hostname\": \"gibba020\", \"container_id\": \"809accf5e776\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176734\", \"created\": \"2021-03-10T13:50:00.050014\", \"started\": \"2021-03-10T13:50:00.073039\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038\"}}, \"last_daemon_update\": \"2021-03-10T13:50:01.177071\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:50:02.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:50:02 gibba020 bash[9782]: audit 2021-03-10T13:50:01.190318+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175119\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"d4ef307f84c5\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175388\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:44:37.258971\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175555\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175709\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175858\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176003\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176147\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176294\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:48:34.834688\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176440\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176586\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}, \"rgw.r.z.gibba020.txcybs\": {\"hostname\": \"gibba020\", \"container_id\": \"809accf5e776\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176734\", \"created\": \"2021-03-10T13:50:00.050014\", \"started\": \"2021-03-10T13:50:00.073039\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:34.965801\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038\"}}, \"last_daemon_update\": \"2021-03-10T13:50:01.177071\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:50:04.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:50:04 gibba013 bash[9767]: cluster 2021-03-10T13:50:02.510727+0000 mgr.y (mgr.14140) 251 : cluster [DBG] pgmap v245: 129 pgs: 129 active+clean; 6.9 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.3 KiB/s rd, 4.1 KiB/s wr, 16 op/s 2021-03-10T13:50:04.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:50:04 gibba013 bash[13024]: cluster 2021-03-10T13:50:02.510727+0000 mgr.y (mgr.14140) 251 : cluster [DBG] pgmap v245: 129 pgs: 129 active+clean; 6.9 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.3 KiB/s rd, 4.1 KiB/s wr, 16 op/s 2021-03-10T13:50:04.444 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:50:04 gibba020 bash[9782]: cluster 2021-03-10T13:50:02.510727+0000 mgr.y (mgr.14140) 251 : cluster [DBG] pgmap v245: 129 pgs: 129 active+clean; 6.9 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.3 KiB/s rd, 4.1 KiB/s wr, 16 op/s 2021-03-10T13:50:06.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:50:06 gibba013 bash[9767]: cluster 2021-03-10T13:50:04.512290+0000 mgr.y (mgr.14140) 252 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.2 KiB/s rd, 3.8 KiB/s wr, 16 op/s 2021-03-10T13:50:06.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:50:06 gibba013 bash[13024]: cluster 2021-03-10T13:50:04.512290+0000 mgr.y (mgr.14140) 252 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.2 KiB/s rd, 3.8 KiB/s wr, 16 op/s 2021-03-10T13:50:06.444 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:50:06 gibba020 bash[9782]: cluster 2021-03-10T13:50:04.512290+0000 mgr.y (mgr.14140) 252 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.2 KiB/s rd, 3.8 KiB/s wr, 16 op/s 2021-03-10T13:50:08.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:50:08 gibba013 bash[9767]: cluster 2021-03-10T13:50:06.513052+0000 mgr.y (mgr.14140) 253 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 2.7 KiB/s wr, 14 op/s 2021-03-10T13:50:08.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:50:08 gibba013 bash[13024]: cluster 2021-03-10T13:50:06.513052+0000 mgr.y (mgr.14140) 253 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 2.7 KiB/s wr, 14 op/s 2021-03-10T13:50:08.444 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:50:08 gibba020 bash[9782]: cluster 2021-03-10T13:50:06.513052+0000 mgr.y (mgr.14140) 253 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 2.7 KiB/s wr, 14 op/s 2021-03-10T13:50:10.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:50:10 gibba013 bash[9767]: cluster 2021-03-10T13:50:08.514103+0000 mgr.y (mgr.14140) 254 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.1 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2021-03-10T13:50:10.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:50:10 gibba013 bash[13024]: cluster 2021-03-10T13:50:08.514103+0000 mgr.y (mgr.14140) 254 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.1 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2021-03-10T13:50:10.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:50:10 gibba020 bash[9782]: cluster 2021-03-10T13:50:08.514103+0000 mgr.y (mgr.14140) 254 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.1 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2021-03-10T13:50:12.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:50:12 gibba013 bash[9767]: cluster 2021-03-10T13:50:10.515812+0000 mgr.y (mgr.14140) 255 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2021-03-10T13:50:12.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:50:12 gibba013 bash[13024]: cluster 2021-03-10T13:50:10.515812+0000 mgr.y (mgr.14140) 255 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2021-03-10T13:50:12.444 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:50:12 gibba020 bash[9782]: cluster 2021-03-10T13:50:10.515812+0000 mgr.y (mgr.14140) 255 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2021-03-10T13:50:14.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:50:14 gibba013 bash[9767]: cluster 2021-03-10T13:50:12.516898+0000 mgr.y (mgr.14140) 256 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.7 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T13:50:14.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:50:14 gibba013 bash[13024]: cluster 2021-03-10T13:50:12.516898+0000 mgr.y (mgr.14140) 256 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.7 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T13:50:14.444 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:50:14 gibba020 bash[9782]: cluster 2021-03-10T13:50:12.516898+0000 mgr.y (mgr.14140) 256 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.7 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T13:50:16.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:50:16 gibba020 bash[9782]: cluster 2021-03-10T13:50:14.518509+0000 mgr.y (mgr.14140) 257 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.6 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T13:50:16.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:50:16 gibba013 bash[9767]: cluster 2021-03-10T13:50:14.518509+0000 mgr.y (mgr.14140) 257 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.6 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T13:50:16.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:50:16 gibba013 bash[13024]: cluster 2021-03-10T13:50:14.518509+0000 mgr.y (mgr.14140) 257 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.6 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T13:50:18.444 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:50:18 gibba020 bash[9782]: cluster 2021-03-10T13:50:16.519423+0000 mgr.y (mgr.14140) 258 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.4 KiB/s rd, 0 B/s wr, 3 op/s 2021-03-10T13:50:18.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:50:18 gibba013 bash[9767]: cluster 2021-03-10T13:50:16.519423+0000 mgr.y (mgr.14140) 258 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.4 KiB/s rd, 0 B/s wr, 3 op/s 2021-03-10T13:50:18.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:50:18 gibba013 bash[13024]: cluster 2021-03-10T13:50:16.519423+0000 mgr.y (mgr.14140) 258 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.4 KiB/s rd, 0 B/s wr, 3 op/s 2021-03-10T13:50:20.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:50:20 gibba020 bash[9782]: cluster 2021-03-10T13:50:18.520648+0000 mgr.y (mgr.14140) 259 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:50:20.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:50:20 gibba013 bash[9767]: cluster 2021-03-10T13:50:18.520648+0000 mgr.y (mgr.14140) 259 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:50:20.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:50:20 gibba013 bash[13024]: cluster 2021-03-10T13:50:18.520648+0000 mgr.y (mgr.14140) 259 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:50:22.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:50:22 gibba020 bash[9782]: cluster 2021-03-10T13:50:20.522372+0000 mgr.y (mgr.14140) 260 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:50:22.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:50:22 gibba013 bash[9767]: cluster 2021-03-10T13:50:20.522372+0000 mgr.y (mgr.14140) 260 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:50:22.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:50:22 gibba013 bash[13024]: cluster 2021-03-10T13:50:20.522372+0000 mgr.y (mgr.14140) 260 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:50:24.444 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:50:24 gibba020 bash[9782]: cluster 2021-03-10T13:50:22.523414+0000 mgr.y (mgr.14140) 261 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:50:24.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:50:24 gibba013 bash[9767]: cluster 2021-03-10T13:50:22.523414+0000 mgr.y (mgr.14140) 261 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:50:24.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:50:24 gibba013 bash[13024]: cluster 2021-03-10T13:50:22.523414+0000 mgr.y (mgr.14140) 261 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:50:26.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:50:26 gibba013 bash[9767]: cluster 2021-03-10T13:50:24.524869+0000 mgr.y (mgr.14140) 262 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.7 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T13:50:26.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:50:26 gibba013 bash[13024]: cluster 2021-03-10T13:50:24.524869+0000 mgr.y (mgr.14140) 262 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.7 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T13:50:26.694 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:50:26 gibba020 bash[9782]: cluster 2021-03-10T13:50:24.524869+0000 mgr.y (mgr.14140) 262 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.7 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T13:50:27.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:50:27 gibba013 bash[9767]: cluster 2021-03-10T13:50:26.526613+0000 mgr.y (mgr.14140) 263 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.0 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T13:50:27.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:50:27 gibba013 bash[13024]: cluster 2021-03-10T13:50:26.526613+0000 mgr.y (mgr.14140) 263 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.0 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T13:50:27.694 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:50:27 gibba020 bash[9782]: cluster 2021-03-10T13:50:26.526613+0000 mgr.y (mgr.14140) 263 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.0 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T13:50:29.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:50:29 gibba013 bash[9767]: cluster 2021-03-10T13:50:28.527859+0000 mgr.y (mgr.14140) 264 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.2 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T13:50:29.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:50:29 gibba013 bash[13024]: cluster 2021-03-10T13:50:28.527859+0000 mgr.y (mgr.14140) 264 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.2 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T13:50:29.944 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:50:29 gibba020 bash[9782]: cluster 2021-03-10T13:50:28.527859+0000 mgr.y (mgr.14140) 264 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.2 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T13:50:31.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:50:31 gibba013 bash[9767]: cluster 2021-03-10T13:50:30.529653+0000 mgr.y (mgr.14140) 265 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:50:31.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:50:31 gibba013 bash[13024]: cluster 2021-03-10T13:50:30.529653+0000 mgr.y (mgr.14140) 265 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:50:31.944 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:50:31 gibba020 bash[9782]: cluster 2021-03-10T13:50:30.529653+0000 mgr.y (mgr.14140) 265 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:50:33.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:50:33 gibba013 bash[9767]: cluster 2021-03-10T13:50:32.530857+0000 mgr.y (mgr.14140) 266 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:50:33.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:50:33 gibba013 bash[13024]: cluster 2021-03-10T13:50:32.530857+0000 mgr.y (mgr.14140) 266 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:50:33.944 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:50:33 gibba020 bash[9782]: cluster 2021-03-10T13:50:32.530857+0000 mgr.y (mgr.14140) 266 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:50:35.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:50:35 gibba013 bash[9767]: cluster 2021-03-10T13:50:34.532439+0000 mgr.y (mgr.14140) 267 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:50:35.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:50:35 gibba013 bash[13024]: cluster 2021-03-10T13:50:34.532439+0000 mgr.y (mgr.14140) 267 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:50:35.944 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:50:35 gibba020 bash[9782]: cluster 2021-03-10T13:50:34.532439+0000 mgr.y (mgr.14140) 267 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:50:37.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:50:37 gibba013 bash[9767]: cluster 2021-03-10T13:50:36.533256+0000 mgr.y (mgr.14140) 268 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 596 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:50:37.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:50:37 gibba013 bash[13024]: cluster 2021-03-10T13:50:36.533256+0000 mgr.y (mgr.14140) 268 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 596 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:50:37.944 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:50:37 gibba020 bash[9782]: cluster 2021-03-10T13:50:36.533256+0000 mgr.y (mgr.14140) 268 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 596 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:50:39.944 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:50:39 gibba020 bash[9782]: cluster 2021-03-10T13:50:38.534331+0000 mgr.y (mgr.14140) 269 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 1 op/s 2021-03-10T13:50:40.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:50:39 gibba013 bash[9767]: cluster 2021-03-10T13:50:38.534331+0000 mgr.y (mgr.14140) 269 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 1 op/s 2021-03-10T13:50:40.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:50:39 gibba013 bash[13024]: cluster 2021-03-10T13:50:38.534331+0000 mgr.y (mgr.14140) 269 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 1 op/s 2021-03-10T13:50:41.944 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:50:41 gibba020 bash[9782]: cluster 2021-03-10T13:50:40.536123+0000 mgr.y (mgr.14140) 270 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:50:42.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:50:41 gibba013 bash[9767]: cluster 2021-03-10T13:50:40.536123+0000 mgr.y (mgr.14140) 270 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:50:42.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:50:41 gibba013 bash[13024]: cluster 2021-03-10T13:50:40.536123+0000 mgr.y (mgr.14140) 270 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:50:43.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:50:43 gibba020 bash[9782]: cluster 2021-03-10T13:50:42.537360+0000 mgr.y (mgr.14140) 271 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:50:44.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:50:43 gibba013 bash[9767]: cluster 2021-03-10T13:50:42.537360+0000 mgr.y (mgr.14140) 271 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:50:44.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:50:43 gibba013 bash[13024]: cluster 2021-03-10T13:50:42.537360+0000 mgr.y (mgr.14140) 271 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:50:45.944 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:50:45 gibba020 bash[9782]: cluster 2021-03-10T13:50:44.538994+0000 mgr.y (mgr.14140) 272 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:50:46.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:50:45 gibba013 bash[9767]: cluster 2021-03-10T13:50:44.538994+0000 mgr.y (mgr.14140) 272 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:50:46.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:50:45 gibba013 bash[13024]: cluster 2021-03-10T13:50:44.538994+0000 mgr.y (mgr.14140) 272 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:50:47.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:50:47 gibba020 bash[9782]: cluster 2021-03-10T13:50:46.539951+0000 mgr.y (mgr.14140) 273 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:50:48.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:50:47 gibba013 bash[9767]: cluster 2021-03-10T13:50:46.539951+0000 mgr.y (mgr.14140) 273 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:50:48.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:50:47 gibba013 bash[13024]: cluster 2021-03-10T13:50:46.539951+0000 mgr.y (mgr.14140) 273 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:50:49.944 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:50:49 gibba020 bash[9782]: cluster 2021-03-10T13:50:48.541153+0000 mgr.y (mgr.14140) 274 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.4 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:50:50.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:50:49 gibba013 bash[9767]: cluster 2021-03-10T13:50:48.541153+0000 mgr.y (mgr.14140) 274 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.4 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:50:50.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:50:49 gibba013 bash[13024]: cluster 2021-03-10T13:50:48.541153+0000 mgr.y (mgr.14140) 274 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.4 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:50:51.944 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:50:51 gibba020 bash[9782]: cluster 2021-03-10T13:50:50.542960+0000 mgr.y (mgr.14140) 275 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2021-03-10T13:50:52.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:50:51 gibba013 bash[9767]: cluster 2021-03-10T13:50:50.542960+0000 mgr.y (mgr.14140) 275 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2021-03-10T13:50:52.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:50:51 gibba013 bash[13024]: cluster 2021-03-10T13:50:50.542960+0000 mgr.y (mgr.14140) 275 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2021-03-10T13:50:54.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:50:53 gibba013 bash[9767]: cluster 2021-03-10T13:50:52.544198+0000 mgr.y (mgr.14140) 276 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:50:54.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:50:53 gibba013 bash[13024]: cluster 2021-03-10T13:50:52.544198+0000 mgr.y (mgr.14140) 276 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:50:54.194 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:50:53 gibba020 bash[9782]: cluster 2021-03-10T13:50:52.544198+0000 mgr.y (mgr.14140) 276 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:50:56.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:50:55 gibba013 bash[9767]: cluster 2021-03-10T13:50:54.545681+0000 mgr.y (mgr.14140) 277 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:50:56.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:50:55 gibba013 bash[13024]: cluster 2021-03-10T13:50:54.545681+0000 mgr.y (mgr.14140) 277 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:50:56.194 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:50:55 gibba020 bash[9782]: cluster 2021-03-10T13:50:54.545681+0000 mgr.y (mgr.14140) 277 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:50:58.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:50:57 gibba013 bash[9767]: cluster 2021-03-10T13:50:56.546610+0000 mgr.y (mgr.14140) 278 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:50:58.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:50:57 gibba013 bash[13024]: cluster 2021-03-10T13:50:56.546610+0000 mgr.y (mgr.14140) 278 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:50:58.194 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:50:57 gibba020 bash[9782]: cluster 2021-03-10T13:50:56.546610+0000 mgr.y (mgr.14140) 278 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:51:00.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:50:59 gibba013 bash[9767]: cluster 2021-03-10T13:50:58.547624+0000 mgr.y (mgr.14140) 279 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:51:00.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:50:59 gibba013 bash[13024]: cluster 2021-03-10T13:50:58.547624+0000 mgr.y (mgr.14140) 279 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:51:00.194 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:50:59 gibba020 bash[9782]: cluster 2021-03-10T13:50:58.547624+0000 mgr.y (mgr.14140) 279 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:51:02.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:51:01 gibba013 bash[9767]: cluster 2021-03-10T13:51:00.549153+0000 mgr.y (mgr.14140) 280 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.8 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:51:02.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:51:01 gibba013 bash[13024]: cluster 2021-03-10T13:51:00.549153+0000 mgr.y (mgr.14140) 280 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.8 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:51:02.194 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:51:01 gibba020 bash[9782]: cluster 2021-03-10T13:51:00.549153+0000 mgr.y (mgr.14140) 280 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.8 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:51:04.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:51:03 gibba013 bash[9767]: cluster 2021-03-10T13:51:02.550558+0000 mgr.y (mgr.14140) 281 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:51:04.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:51:03 gibba013 bash[13024]: cluster 2021-03-10T13:51:02.550558+0000 mgr.y (mgr.14140) 281 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:51:04.194 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:51:03 gibba020 bash[9782]: cluster 2021-03-10T13:51:02.550558+0000 mgr.y (mgr.14140) 281 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:51:06.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:51:05 gibba013 bash[9767]: cluster 2021-03-10T13:51:04.551832+0000 mgr.y (mgr.14140) 282 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:51:06.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:51:05 gibba013 bash[13024]: cluster 2021-03-10T13:51:04.551832+0000 mgr.y (mgr.14140) 282 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:51:06.194 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:51:05 gibba020 bash[9782]: cluster 2021-03-10T13:51:04.551832+0000 mgr.y (mgr.14140) 282 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:51:08.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:51:07 gibba013 bash[9767]: cluster 2021-03-10T13:51:06.552877+0000 mgr.y (mgr.14140) 283 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:51:08.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:51:07 gibba013 bash[13024]: cluster 2021-03-10T13:51:06.552877+0000 mgr.y (mgr.14140) 283 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:51:08.194 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:51:07 gibba020 bash[9782]: cluster 2021-03-10T13:51:06.552877+0000 mgr.y (mgr.14140) 283 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:51:10.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:51:09 gibba013 bash[9767]: cluster 2021-03-10T13:51:08.554082+0000 mgr.y (mgr.14140) 284 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:51:10.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:51:09 gibba013 bash[13024]: cluster 2021-03-10T13:51:08.554082+0000 mgr.y (mgr.14140) 284 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:51:10.194 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:51:09 gibba020 bash[9782]: cluster 2021-03-10T13:51:08.554082+0000 mgr.y (mgr.14140) 284 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:51:12.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:51:11 gibba013 bash[9767]: cluster 2021-03-10T13:51:10.555754+0000 mgr.y (mgr.14140) 285 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.1 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T13:51:12.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:51:11 gibba013 bash[13024]: cluster 2021-03-10T13:51:10.555754+0000 mgr.y (mgr.14140) 285 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.1 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T13:51:12.194 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:51:11 gibba020 bash[9782]: cluster 2021-03-10T13:51:10.555754+0000 mgr.y (mgr.14140) 285 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.1 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T13:51:14.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:51:13 gibba013 bash[9767]: cluster 2021-03-10T13:51:12.557347+0000 mgr.y (mgr.14140) 286 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.2 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T13:51:14.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:51:13 gibba013 bash[13024]: cluster 2021-03-10T13:51:12.557347+0000 mgr.y (mgr.14140) 286 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.2 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T13:51:14.194 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:51:13 gibba020 bash[9782]: cluster 2021-03-10T13:51:12.557347+0000 mgr.y (mgr.14140) 286 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.2 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T13:51:16.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:51:15 gibba013 bash[9767]: cluster 2021-03-10T13:51:14.558920+0000 mgr.y (mgr.14140) 287 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:51:16.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:51:15 gibba013 bash[13024]: cluster 2021-03-10T13:51:14.558920+0000 mgr.y (mgr.14140) 287 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:51:16.194 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:51:15 gibba020 bash[9782]: cluster 2021-03-10T13:51:14.558920+0000 mgr.y (mgr.14140) 287 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:51:18.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:51:17 gibba013 bash[9767]: cluster 2021-03-10T13:51:16.559869+0000 mgr.y (mgr.14140) 288 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:51:18.212 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:51:17 gibba013 bash[13024]: cluster 2021-03-10T13:51:16.559869+0000 mgr.y (mgr.14140) 288 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:51:18.213 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:51:17 gibba020 bash[9782]: cluster 2021-03-10T13:51:16.559869+0000 mgr.y (mgr.14140) 288 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:51:19.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:51:19 gibba020 bash[9782]: cluster 2021-03-10T13:51:18.561055+0000 mgr.y (mgr.14140) 289 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:51:20.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:51:19 gibba013 bash[9767]: cluster 2021-03-10T13:51:18.561055+0000 mgr.y (mgr.14140) 289 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:51:20.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:51:19 gibba013 bash[13024]: cluster 2021-03-10T13:51:18.561055+0000 mgr.y (mgr.14140) 289 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:51:22.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:51:21 gibba013 bash[9767]: cluster 2021-03-10T13:51:20.562769+0000 mgr.y (mgr.14140) 290 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:51:22.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:51:21 gibba013 bash[13024]: cluster 2021-03-10T13:51:20.562769+0000 mgr.y (mgr.14140) 290 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:51:22.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:51:21 gibba020 bash[9782]: cluster 2021-03-10T13:51:20.562769+0000 mgr.y (mgr.14140) 290 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:51:24.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:51:23 gibba013 bash[9767]: cluster 2021-03-10T13:51:22.564300+0000 mgr.y (mgr.14140) 291 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.5 KiB/s rd, 85 B/s wr, 1 op/s 2021-03-10T13:51:24.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:51:23 gibba013 bash[13024]: cluster 2021-03-10T13:51:22.564300+0000 mgr.y (mgr.14140) 291 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.5 KiB/s rd, 85 B/s wr, 1 op/s 2021-03-10T13:51:24.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:51:23 gibba020 bash[9782]: cluster 2021-03-10T13:51:22.564300+0000 mgr.y (mgr.14140) 291 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.5 KiB/s rd, 85 B/s wr, 1 op/s 2021-03-10T13:51:26.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:51:25 gibba013 bash[9767]: cluster 2021-03-10T13:51:24.565871+0000 mgr.y (mgr.14140) 292 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:51:26.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:51:25 gibba013 bash[13024]: cluster 2021-03-10T13:51:24.565871+0000 mgr.y (mgr.14140) 292 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:51:26.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:51:25 gibba020 bash[9782]: cluster 2021-03-10T13:51:24.565871+0000 mgr.y (mgr.14140) 292 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:51:28.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:51:27 gibba013 bash[9767]: cluster 2021-03-10T13:51:26.566909+0000 mgr.y (mgr.14140) 293 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:51:28.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:51:27 gibba013 bash[13024]: cluster 2021-03-10T13:51:26.566909+0000 mgr.y (mgr.14140) 293 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:51:28.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:51:27 gibba020 bash[9782]: cluster 2021-03-10T13:51:26.566909+0000 mgr.y (mgr.14140) 293 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:51:30.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:51:29 gibba013 bash[9767]: cluster 2021-03-10T13:51:28.568051+0000 mgr.y (mgr.14140) 294 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:51:30.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:51:29 gibba013 bash[13024]: cluster 2021-03-10T13:51:28.568051+0000 mgr.y (mgr.14140) 294 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:51:30.175 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:51:29 gibba020 bash[9782]: cluster 2021-03-10T13:51:28.568051+0000 mgr.y (mgr.14140) 294 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:51:32.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:51:31 gibba020 bash[9782]: cluster 2021-03-10T13:51:30.569787+0000 mgr.y (mgr.14140) 295 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.3 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:51:32.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:51:31 gibba013 bash[9767]: cluster 2021-03-10T13:51:30.569787+0000 mgr.y (mgr.14140) 295 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.3 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:51:32.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:51:31 gibba013 bash[13024]: cluster 2021-03-10T13:51:30.569787+0000 mgr.y (mgr.14140) 295 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.3 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:51:34.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:51:33 gibba020 bash[9782]: cluster 2021-03-10T13:51:32.571338+0000 mgr.y (mgr.14140) 296 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.0 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:51:34.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:51:33 gibba013 bash[9767]: cluster 2021-03-10T13:51:32.571338+0000 mgr.y (mgr.14140) 296 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.0 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:51:34.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:51:33 gibba013 bash[13024]: cluster 2021-03-10T13:51:32.571338+0000 mgr.y (mgr.14140) 296 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.0 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T13:51:36.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:51:35 gibba020 bash[9782]: cluster 2021-03-10T13:51:34.572651+0000 mgr.y (mgr.14140) 297 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:51:36.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:51:35 gibba013 bash[9767]: cluster 2021-03-10T13:51:34.572651+0000 mgr.y (mgr.14140) 297 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:51:36.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:51:35 gibba013 bash[13024]: cluster 2021-03-10T13:51:34.572651+0000 mgr.y (mgr.14140) 297 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:51:38.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:51:37 gibba020 bash[9782]: cluster 2021-03-10T13:51:36.573528+0000 mgr.y (mgr.14140) 298 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:51:38.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:51:37 gibba013 bash[9767]: cluster 2021-03-10T13:51:36.573528+0000 mgr.y (mgr.14140) 298 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:51:38.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:51:37 gibba013 bash[13024]: cluster 2021-03-10T13:51:36.573528+0000 mgr.y (mgr.14140) 298 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:51:40.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:51:39 gibba020 bash[9782]: cluster 2021-03-10T13:51:38.574706+0000 mgr.y (mgr.14140) 299 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:51:40.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:51:39 gibba013 bash[9767]: cluster 2021-03-10T13:51:38.574706+0000 mgr.y (mgr.14140) 299 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:51:40.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:51:39 gibba013 bash[13024]: cluster 2021-03-10T13:51:38.574706+0000 mgr.y (mgr.14140) 299 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:51:42.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:51:41 gibba020 bash[9782]: cluster 2021-03-10T13:51:40.576266+0000 mgr.y (mgr.14140) 300 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:51:42.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:51:41 gibba013 bash[9767]: cluster 2021-03-10T13:51:40.576266+0000 mgr.y (mgr.14140) 300 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:51:42.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:51:41 gibba013 bash[13024]: cluster 2021-03-10T13:51:40.576266+0000 mgr.y (mgr.14140) 300 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T13:51:44.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:51:43 gibba013 bash[9767]: cluster 2021-03-10T13:51:42.577744+0000 mgr.y (mgr.14140) 301 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:51:44.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:51:43 gibba013 bash[13024]: cluster 2021-03-10T13:51:42.577744+0000 mgr.y (mgr.14140) 301 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:51:44.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:51:43 gibba020 bash[9782]: cluster 2021-03-10T13:51:42.577744+0000 mgr.y (mgr.14140) 301 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:51:46.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:51:45 gibba013 bash[9767]: cluster 2021-03-10T13:51:44.579222+0000 mgr.y (mgr.14140) 302 : cluster [DBG] pgmap v296: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:51:46.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:51:45 gibba013 bash[13024]: cluster 2021-03-10T13:51:44.579222+0000 mgr.y (mgr.14140) 302 : cluster [DBG] pgmap v296: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:51:46.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:51:45 gibba020 bash[9782]: cluster 2021-03-10T13:51:44.579222+0000 mgr.y (mgr.14140) 302 : cluster [DBG] pgmap v296: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T13:51:48.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:51:47 gibba013 bash[9767]: cluster 2021-03-10T13:51:46.580377+0000 mgr.y (mgr.14140) 303 : cluster [DBG] pgmap v297: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:48.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:51:47 gibba013 bash[13024]: cluster 2021-03-10T13:51:46.580377+0000 mgr.y (mgr.14140) 303 : cluster [DBG] pgmap v297: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:48.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:51:47 gibba020 bash[9782]: cluster 2021-03-10T13:51:46.580377+0000 mgr.y (mgr.14140) 303 : cluster [DBG] pgmap v297: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:50.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:51:49 gibba013 bash[9767]: cluster 2021-03-10T13:51:48.581310+0000 mgr.y (mgr.14140) 304 : cluster [DBG] pgmap v298: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:50.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:51:49 gibba013 bash[13024]: cluster 2021-03-10T13:51:48.581310+0000 mgr.y (mgr.14140) 304 : cluster [DBG] pgmap v298: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:50.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:51:49 gibba020 bash[9782]: cluster 2021-03-10T13:51:48.581310+0000 mgr.y (mgr.14140) 304 : cluster [DBG] pgmap v298: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:52.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:51:51 gibba013 bash[9767]: cluster 2021-03-10T13:51:50.582865+0000 mgr.y (mgr.14140) 305 : cluster [DBG] pgmap v299: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:52.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:51:51 gibba013 bash[13024]: cluster 2021-03-10T13:51:50.582865+0000 mgr.y (mgr.14140) 305 : cluster [DBG] pgmap v299: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:52.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:51:51 gibba020 bash[9782]: cluster 2021-03-10T13:51:50.582865+0000 mgr.y (mgr.14140) 305 : cluster [DBG] pgmap v299: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:54.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:51:54 gibba013 bash[9767]: cluster 2021-03-10T13:51:52.584193+0000 mgr.y (mgr.14140) 306 : cluster [DBG] pgmap v300: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:54.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:51:54 gibba013 bash[13024]: cluster 2021-03-10T13:51:52.584193+0000 mgr.y (mgr.14140) 306 : cluster [DBG] pgmap v300: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:54.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:51:54 gibba020 bash[9782]: cluster 2021-03-10T13:51:52.584193+0000 mgr.y (mgr.14140) 306 : cluster [DBG] pgmap v300: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:56.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:51:56 gibba013 bash[9767]: cluster 2021-03-10T13:51:54.585686+0000 mgr.y (mgr.14140) 307 : cluster [DBG] pgmap v301: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:56.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:51:56 gibba013 bash[13024]: cluster 2021-03-10T13:51:54.585686+0000 mgr.y (mgr.14140) 307 : cluster [DBG] pgmap v301: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:56.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:51:56 gibba020 bash[9782]: cluster 2021-03-10T13:51:54.585686+0000 mgr.y (mgr.14140) 307 : cluster [DBG] pgmap v301: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:58.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:51:58 gibba013 bash[9767]: cluster 2021-03-10T13:51:56.586894+0000 mgr.y (mgr.14140) 308 : cluster [DBG] pgmap v302: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:58.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:51:58 gibba013 bash[13024]: cluster 2021-03-10T13:51:56.586894+0000 mgr.y (mgr.14140) 308 : cluster [DBG] pgmap v302: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:51:58.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:51:58 gibba020 bash[9782]: cluster 2021-03-10T13:51:56.586894+0000 mgr.y (mgr.14140) 308 : cluster [DBG] pgmap v302: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:00.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:00 gibba013 bash[9767]: cluster 2021-03-10T13:51:58.587799+0000 mgr.y (mgr.14140) 309 : cluster [DBG] pgmap v303: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:00.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:00 gibba013 bash[13024]: cluster 2021-03-10T13:51:58.587799+0000 mgr.y (mgr.14140) 309 : cluster [DBG] pgmap v303: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:00.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:00 gibba020 bash[9782]: cluster 2021-03-10T13:51:58.587799+0000 mgr.y (mgr.14140) 309 : cluster [DBG] pgmap v303: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:01.711 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -e sha1=b26fc080937a021ce826cdc94d1adb52c064381a -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2021-03-10T13:52:02.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:02 gibba013 bash[9767]: cluster 2021-03-10T13:52:00.589524+0000 mgr.y (mgr.14140) 310 : cluster [DBG] pgmap v304: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:02.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:02 gibba013 bash[13024]: cluster 2021-03-10T13:52:00.589524+0000 mgr.y (mgr.14140) 310 : cluster [DBG] pgmap v304: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:02.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:02 gibba020 bash[9782]: cluster 2021-03-10T13:52:00.589524+0000 mgr.y (mgr.14140) 310 : cluster [DBG] pgmap v304: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:04.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:04 gibba013 bash[9767]: cluster 2021-03-10T13:52:02.590895+0000 mgr.y (mgr.14140) 311 : cluster [DBG] pgmap v305: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:04.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:04 gibba013 bash[13024]: cluster 2021-03-10T13:52:02.590895+0000 mgr.y (mgr.14140) 311 : cluster [DBG] pgmap v305: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:04.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:04 gibba020 bash[9782]: cluster 2021-03-10T13:52:02.590895+0000 mgr.y (mgr.14140) 311 : cluster [DBG] pgmap v305: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:04.718 INFO:teuthology.orchestra.run.gibba013.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T13:52:05.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:05 gibba013 bash[9767]: audit 2021-03-10T13:52:04.712352+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"ecb495d6-04bf-47bb-ad7b-145e7a1a6bcc\"}"}]: dispatch 2021-03-10T13:52:05.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:05 gibba013 bash[9767]: audit 2021-03-10T13:52:04.716044+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"ecb495d6-04bf-47bb-ad7b-145e7a1a6bcc\"}"}]': finished 2021-03-10T13:52:05.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:05 gibba013 bash[13024]: audit 2021-03-10T13:52:04.712352+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"ecb495d6-04bf-47bb-ad7b-145e7a1a6bcc\"}"}]: dispatch 2021-03-10T13:52:05.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:05 gibba013 bash[13024]: audit 2021-03-10T13:52:04.716044+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"ecb495d6-04bf-47bb-ad7b-145e7a1a6bcc\"}"}]': finished 2021-03-10T13:52:05.397 INFO:teuthology.run_tasks:Running task cephadm.shell... 2021-03-10T13:52:05.407 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@gibba013.front.sepia.ceph.com 2021-03-10T13:52:05.407 DEBUG:teuthology.orchestra.run.gibba013:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7672acc8-81a6-11eb-9080-001a4aab830c -e sha1=b26fc080937a021ce826cdc94d1adb52c064381a -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true ; do ceph orch ps ; ceph versions ; sleep 30 ; done' 2021-03-10T13:52:05.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:05 gibba020 bash[9782]: audit 2021-03-10T13:52:04.712352+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"ecb495d6-04bf-47bb-ad7b-145e7a1a6bcc\"}"}]: dispatch 2021-03-10T13:52:05.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:05 gibba020 bash[9782]: audit 2021-03-10T13:52:04.716044+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"ecb495d6-04bf-47bb-ad7b-145e7a1a6bcc\"}"}]': finished 2021-03-10T13:52:06.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:06 gibba013 bash[9767]: cluster 2021-03-10T13:52:04.591343+0000 mgr.y (mgr.14140) 312 : cluster [DBG] pgmap v306: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:06.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:06 gibba013 bash[9767]: audit 2021-03-10T13:52:04.711735+0000 mgr.y (mgr.14140) 313 : audit [DBG] from='client.24478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:52:06.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:06 gibba013 bash[9767]: cephadm 2021-03-10T13:52:04.717827+0000 mgr.y (mgr.14140) 314 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T13:52:06.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:06 gibba013 bash[13024]: cluster 2021-03-10T13:52:04.591343+0000 mgr.y (mgr.14140) 312 : cluster [DBG] pgmap v306: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:06.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:06 gibba013 bash[13024]: audit 2021-03-10T13:52:04.711735+0000 mgr.y (mgr.14140) 313 : audit [DBG] from='client.24478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:52:06.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:06 gibba013 bash[13024]: cephadm 2021-03-10T13:52:04.717827+0000 mgr.y (mgr.14140) 314 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T13:52:06.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:06 gibba020 bash[9782]: cluster 2021-03-10T13:52:04.591343+0000 mgr.y (mgr.14140) 312 : cluster [DBG] pgmap v306: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:06.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:06 gibba020 bash[9782]: audit 2021-03-10T13:52:04.711735+0000 mgr.y (mgr.14140) 313 : audit [DBG] from='client.24478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:52:06.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:06 gibba020 bash[9782]: cephadm 2021-03-10T13:52:04.717827+0000 mgr.y (mgr.14140) 314 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T13:52:08.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:08 gibba013 bash[9767]: cluster 2021-03-10T13:52:06.591687+0000 mgr.y (mgr.14140) 315 : cluster [DBG] pgmap v307: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:08.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:08 gibba013 bash[13024]: cluster 2021-03-10T13:52:06.591687+0000 mgr.y (mgr.14140) 315 : cluster [DBG] pgmap v307: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:08.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:08 gibba020 bash[9782]: cluster 2021-03-10T13:52:06.591687+0000 mgr.y (mgr.14140) 315 : cluster [DBG] pgmap v307: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:10.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:10 gibba013 bash[9767]: cluster 2021-03-10T13:52:08.591978+0000 mgr.y (mgr.14140) 316 : cluster [DBG] pgmap v308: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:10.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:10 gibba013 bash[13024]: cluster 2021-03-10T13:52:08.591978+0000 mgr.y (mgr.14140) 316 : cluster [DBG] pgmap v308: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:10.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:10 gibba020 bash[9782]: cluster 2021-03-10T13:52:08.591978+0000 mgr.y (mgr.14140) 316 : cluster [DBG] pgmap v308: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:12.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:12 gibba013 bash[9767]: cluster 2021-03-10T13:52:10.592348+0000 mgr.y (mgr.14140) 317 : cluster [DBG] pgmap v309: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:12.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:12 gibba013 bash[13024]: cluster 2021-03-10T13:52:10.592348+0000 mgr.y (mgr.14140) 317 : cluster [DBG] pgmap v309: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:12.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:12 gibba020 bash[9782]: cluster 2021-03-10T13:52:10.592348+0000 mgr.y (mgr.14140) 317 : cluster [DBG] pgmap v309: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:14.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:14 gibba013 bash[9767]: cluster 2021-03-10T13:52:12.592766+0000 mgr.y (mgr.14140) 318 : cluster [DBG] pgmap v310: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:14.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:14 gibba013 bash[13024]: cluster 2021-03-10T13:52:12.592766+0000 mgr.y (mgr.14140) 318 : cluster [DBG] pgmap v310: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:14.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:14 gibba020 bash[9782]: cluster 2021-03-10T13:52:12.592766+0000 mgr.y (mgr.14140) 318 : cluster [DBG] pgmap v310: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:16.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:16 gibba013 bash[9767]: cluster 2021-03-10T13:52:14.594174+0000 mgr.y (mgr.14140) 319 : cluster [DBG] pgmap v311: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:16.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:16 gibba013 bash[13024]: cluster 2021-03-10T13:52:14.594174+0000 mgr.y (mgr.14140) 319 : cluster [DBG] pgmap v311: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:16.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:16 gibba020 bash[9782]: cluster 2021-03-10T13:52:14.594174+0000 mgr.y (mgr.14140) 319 : cluster [DBG] pgmap v311: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:18.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:18 gibba013 bash[9767]: cluster 2021-03-10T13:52:16.595136+0000 mgr.y (mgr.14140) 320 : cluster [DBG] pgmap v312: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:18.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:18 gibba013 bash[13024]: cluster 2021-03-10T13:52:16.595136+0000 mgr.y (mgr.14140) 320 : cluster [DBG] pgmap v312: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:18.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:18 gibba020 bash[9782]: cluster 2021-03-10T13:52:16.595136+0000 mgr.y (mgr.14140) 320 : cluster [DBG] pgmap v312: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:19.615 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T13:52:19.807 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:52:19.808 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3m) 3m ago 4m 0.21.0 prom/alertmanager c876f5897d7b a890668984ec 2021-03-10T13:52:19.808 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (4m) 2m ago 4m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T13:52:19.808 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a099a9208e7e 2021-03-10T13:52:19.808 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d4ef307f84c5 2021-03-10T13:52:19.809 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (9m) 3m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 aff9dae2208b 2021-03-10T13:52:19.809 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (9m) 3m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 02bb13cc8f40 2021-03-10T13:52:19.809 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a58fc42cd46b 2021-03-10T13:52:19.809 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (8m) 3m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 c561d31798a4 2021-03-10T13:52:19.810 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (4m) 3m ago 4m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T13:52:19.810 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (4m) 2m ago 4m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T13:52:19.810 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (7m) 3m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 bf4441d660ac 2021-03-10T13:52:19.810 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (6m) 3m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 385800e8f97f 2021-03-10T13:52:19.810 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (6m) 3m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d0a99b0fd1fc 2021-03-10T13:52:19.811 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (6m) 3m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d0b507f36a88 2021-03-10T13:52:19.811 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (5m) 2m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5bcc0da1a794 2021-03-10T13:52:19.811 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (5m) 2m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 8e0d292ca03b 2021-03-10T13:52:19.811 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (5m) 2m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b54758e37be1 2021-03-10T13:52:19.811 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (4m) 2m ago 4m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 75c9ee8106fc 2021-03-10T13:52:19.812 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3m) 2m ago 4m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T13:52:19.812 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 running (2m) 2m ago 2m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 809accf5e776 2021-03-10T13:52:20.023 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T13:52:20.023 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T13:52:20.024 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2021-03-10T13:52:20.024 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:52:20.024 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T13:52:20.024 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2021-03-10T13:52:20.024 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:52:20.025 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T13:52:20.025 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2021-03-10T13:52:20.025 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:52:20.025 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T13:52:20.026 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T13:52:20.026 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 14 2021-03-10T13:52:20.026 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T13:52:20.026 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T13:52:20.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:20 gibba013 bash[9767]: cluster 2021-03-10T13:52:18.596214+0000 mgr.y (mgr.14140) 321 : cluster [DBG] pgmap v313: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:20.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:20 gibba013 bash[9767]: audit 2021-03-10T13:52:19.644754+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"ecb495d6-04bf-47bb-ad7b-145e7a1a6bcc\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_version\": \"ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)\"}"}]: dispatch 2021-03-10T13:52:20.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:20 gibba013 bash[9767]: audit 2021-03-10T13:52:19.648080+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"ecb495d6-04bf-47bb-ad7b-145e7a1a6bcc\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_version\": \"ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)\"}"}]': finished 2021-03-10T13:52:20.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:20 gibba013 bash[9767]: audit 2021-03-10T13:52:19.648830+0000 mon.a (mon.0) 584 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:52:20.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:20 gibba013 bash[9767]: audit 2021-03-10T13:52:20.022144+0000 mon.a (mon.0) 585 : audit [DBG] from='client.? 172.21.2.113:0/3092651585' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:52:20.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:20 gibba013 bash[13024]: cluster 2021-03-10T13:52:18.596214+0000 mgr.y (mgr.14140) 321 : cluster [DBG] pgmap v313: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:20.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:20 gibba013 bash[13024]: audit 2021-03-10T13:52:19.644754+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"ecb495d6-04bf-47bb-ad7b-145e7a1a6bcc\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_version\": \"ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)\"}"}]: dispatch 2021-03-10T13:52:20.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:20 gibba013 bash[13024]: audit 2021-03-10T13:52:19.648080+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"ecb495d6-04bf-47bb-ad7b-145e7a1a6bcc\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_version\": \"ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)\"}"}]': finished 2021-03-10T13:52:20.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:20 gibba013 bash[13024]: audit 2021-03-10T13:52:19.648830+0000 mon.a (mon.0) 584 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:52:20.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:20 gibba013 bash[13024]: audit 2021-03-10T13:52:20.022144+0000 mon.a (mon.0) 585 : audit [DBG] from='client.? 172.21.2.113:0/3092651585' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:52:20.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:20 gibba020 bash[9782]: cluster 2021-03-10T13:52:18.596214+0000 mgr.y (mgr.14140) 321 : cluster [DBG] pgmap v313: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:20.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:20 gibba020 bash[9782]: audit 2021-03-10T13:52:19.644754+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"ecb495d6-04bf-47bb-ad7b-145e7a1a6bcc\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_version\": \"ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)\"}"}]: dispatch 2021-03-10T13:52:20.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:20 gibba020 bash[9782]: audit 2021-03-10T13:52:19.648080+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"ecb495d6-04bf-47bb-ad7b-145e7a1a6bcc\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_version\": \"ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)\"}"}]': finished 2021-03-10T13:52:20.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:20 gibba020 bash[9782]: audit 2021-03-10T13:52:19.648830+0000 mon.a (mon.0) 584 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:52:20.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:20 gibba020 bash[9782]: audit 2021-03-10T13:52:20.022144+0000 mon.a (mon.0) 585 : audit [DBG] from='client.? 172.21.2.113:0/3092651585' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:52:21.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:21 gibba013 bash[9767]: audit 2021-03-10T13:52:19.606415+0000 mgr.y (mgr.14140) 322 : audit [DBG] from='client.24484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:52:21.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:21 gibba013 bash[9767]: cephadm 2021-03-10T13:52:19.648531+0000 mgr.y (mgr.14140) 323 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T13:52:21.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:21 gibba013 bash[9767]: cephadm 2021-03-10T13:52:19.649799+0000 mgr.y (mgr.14140) 324 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T13:52:21.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:21 gibba013 bash[9767]: cephadm 2021-03-10T13:52:19.649968+0000 mgr.y (mgr.14140) 325 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T13:52:21.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:21 gibba013 bash[9767]: cephadm 2021-03-10T13:52:19.791261+0000 mgr.y (mgr.14140) 326 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a on gibba020 2021-03-10T13:52:21.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:21 gibba013 bash[9767]: audit 2021-03-10T13:52:19.803418+0000 mgr.y (mgr.14140) 327 : audit [DBG] from='client.24490 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:52:21.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:21 gibba013 bash[13024]: audit 2021-03-10T13:52:19.606415+0000 mgr.y (mgr.14140) 322 : audit [DBG] from='client.24484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:52:21.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:21 gibba013 bash[13024]: cephadm 2021-03-10T13:52:19.648531+0000 mgr.y (mgr.14140) 323 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T13:52:21.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:21 gibba013 bash[13024]: cephadm 2021-03-10T13:52:19.649799+0000 mgr.y (mgr.14140) 324 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T13:52:21.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:21 gibba013 bash[13024]: cephadm 2021-03-10T13:52:19.649968+0000 mgr.y (mgr.14140) 325 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T13:52:21.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:21 gibba013 bash[13024]: cephadm 2021-03-10T13:52:19.791261+0000 mgr.y (mgr.14140) 326 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a on gibba020 2021-03-10T13:52:21.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:21 gibba013 bash[13024]: audit 2021-03-10T13:52:19.803418+0000 mgr.y (mgr.14140) 327 : audit [DBG] from='client.24490 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:52:21.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:21 gibba020 bash[9782]: audit 2021-03-10T13:52:19.606415+0000 mgr.y (mgr.14140) 322 : audit [DBG] from='client.24484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:52:21.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:21 gibba020 bash[9782]: cephadm 2021-03-10T13:52:19.648531+0000 mgr.y (mgr.14140) 323 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T13:52:21.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:21 gibba020 bash[9782]: cephadm 2021-03-10T13:52:19.649799+0000 mgr.y (mgr.14140) 324 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T13:52:21.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:21 gibba020 bash[9782]: cephadm 2021-03-10T13:52:19.649968+0000 mgr.y (mgr.14140) 325 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T13:52:21.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:21 gibba020 bash[9782]: cephadm 2021-03-10T13:52:19.791261+0000 mgr.y (mgr.14140) 326 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a on gibba020 2021-03-10T13:52:21.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:21 gibba020 bash[9782]: audit 2021-03-10T13:52:19.803418+0000 mgr.y (mgr.14140) 327 : audit [DBG] from='client.24490 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:52:22.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:22 gibba013 bash[9767]: cluster 2021-03-10T13:52:20.597560+0000 mgr.y (mgr.14140) 328 : cluster [DBG] pgmap v314: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:22.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:22 gibba013 bash[13024]: cluster 2021-03-10T13:52:20.597560+0000 mgr.y (mgr.14140) 328 : cluster [DBG] pgmap v314: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:22.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:22 gibba020 bash[9782]: cluster 2021-03-10T13:52:20.597560+0000 mgr.y (mgr.14140) 328 : cluster [DBG] pgmap v314: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:24.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:24 gibba020 bash[9782]: cluster 2021-03-10T13:52:22.599083+0000 mgr.y (mgr.14140) 329 : cluster [DBG] pgmap v315: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:24.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:24 gibba013 bash[9767]: cluster 2021-03-10T13:52:22.599083+0000 mgr.y (mgr.14140) 329 : cluster [DBG] pgmap v315: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:24.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:24 gibba013 bash[13024]: cluster 2021-03-10T13:52:22.599083+0000 mgr.y (mgr.14140) 329 : cluster [DBG] pgmap v315: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:26.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:26 gibba020 bash[9782]: cluster 2021-03-10T13:52:24.600578+0000 mgr.y (mgr.14140) 330 : cluster [DBG] pgmap v316: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:26.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:26 gibba013 bash[13024]: cluster 2021-03-10T13:52:24.600578+0000 mgr.y (mgr.14140) 330 : cluster [DBG] pgmap v316: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:26.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:26 gibba013 bash[9767]: cluster 2021-03-10T13:52:24.600578+0000 mgr.y (mgr.14140) 330 : cluster [DBG] pgmap v316: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:28.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:28 gibba020 bash[9782]: cluster 2021-03-10T13:52:26.602022+0000 mgr.y (mgr.14140) 331 : cluster [DBG] pgmap v317: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:28.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:28 gibba013 bash[9767]: cluster 2021-03-10T13:52:26.602022+0000 mgr.y (mgr.14140) 331 : cluster [DBG] pgmap v317: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:28.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:28 gibba013 bash[13024]: cluster 2021-03-10T13:52:26.602022+0000 mgr.y (mgr.14140) 331 : cluster [DBG] pgmap v317: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:30.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:30 gibba020 bash[9782]: cluster 2021-03-10T13:52:28.603343+0000 mgr.y (mgr.14140) 332 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:30.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:30 gibba013 bash[9767]: cluster 2021-03-10T13:52:28.603343+0000 mgr.y (mgr.14140) 332 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:30.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:30 gibba013 bash[13024]: cluster 2021-03-10T13:52:28.603343+0000 mgr.y (mgr.14140) 332 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:32.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:32 gibba020 bash[9782]: cluster 2021-03-10T13:52:30.604838+0000 mgr.y (mgr.14140) 333 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:32.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:32 gibba013 bash[9767]: cluster 2021-03-10T13:52:30.604838+0000 mgr.y (mgr.14140) 333 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:32.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:32 gibba013 bash[13024]: cluster 2021-03-10T13:52:30.604838+0000 mgr.y (mgr.14140) 333 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:34.435 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:34 gibba020 bash[9782]: cluster 2021-03-10T13:52:32.606223+0000 mgr.y (mgr.14140) 334 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:34.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:34 gibba013 bash[9767]: cluster 2021-03-10T13:52:32.606223+0000 mgr.y (mgr.14140) 334 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:34.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:34 gibba013 bash[13024]: cluster 2021-03-10T13:52:32.606223+0000 mgr.y (mgr.14140) 334 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:35.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:35 gibba020 bash[9782]: audit 2021-03-10T13:52:34.927226+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.x"}]: dispatch 2021-03-10T13:52:35.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:35 gibba020 bash[9782]: audit 2021-03-10T13:52:34.936133+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.x"}]': finished 2021-03-10T13:52:35.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:35 gibba020 bash[9782]: audit 2021-03-10T13:52:34.937261+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.x"}]: dispatch 2021-03-10T13:52:35.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:35 gibba020 bash[9782]: audit 2021-03-10T13:52:34.938117+0000 mon.a (mon.0) 589 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:52:35.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:35 gibba020 bash[9782]: audit 2021-03-10T13:52:34.938962+0000 mon.a (mon.0) 590 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-03-10T13:52:35.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:35 gibba013 bash[13024]: audit 2021-03-10T13:52:34.927226+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.x"}]: dispatch 2021-03-10T13:52:35.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:35 gibba013 bash[13024]: audit 2021-03-10T13:52:34.936133+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.x"}]': finished 2021-03-10T13:52:35.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:35 gibba013 bash[13024]: audit 2021-03-10T13:52:34.937261+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.x"}]: dispatch 2021-03-10T13:52:35.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:35 gibba013 bash[13024]: audit 2021-03-10T13:52:34.938117+0000 mon.a (mon.0) 589 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:52:35.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:35 gibba013 bash[13024]: audit 2021-03-10T13:52:34.938962+0000 mon.a (mon.0) 590 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-03-10T13:52:35.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:35 gibba013 bash[9767]: audit 2021-03-10T13:52:34.927226+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.x"}]: dispatch 2021-03-10T13:52:35.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:35 gibba013 bash[9767]: audit 2021-03-10T13:52:34.936133+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.x"}]': finished 2021-03-10T13:52:35.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:35 gibba013 bash[9767]: audit 2021-03-10T13:52:34.937261+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.x"}]: dispatch 2021-03-10T13:52:35.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:35 gibba013 bash[9767]: audit 2021-03-10T13:52:34.938117+0000 mon.a (mon.0) 589 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:52:35.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:35 gibba013 bash[9767]: audit 2021-03-10T13:52:34.938962+0000 mon.a (mon.0) 590 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-03-10T13:52:36.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:36 gibba020 bash[9782]: cluster 2021-03-10T13:52:34.607627+0000 mgr.y (mgr.14140) 335 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:36.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:36 gibba020 bash[9782]: cephadm 2021-03-10T13:52:34.926151+0000 mgr.y (mgr.14140) 336 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.x 2021-03-10T13:52:36.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:36 gibba020 bash[9782]: cephadm 2021-03-10T13:52:34.926371+0000 mgr.y (mgr.14140) 337 : cephadm [INF] Upgrade: Redeploying mgr.x 2021-03-10T13:52:36.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:36 gibba020 bash[9782]: cephadm 2021-03-10T13:52:34.938732+0000 mgr.y (mgr.14140) 338 : cephadm [INF] Deploying daemon mgr.x on gibba020 2021-03-10T13:52:36.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:36 gibba013 bash[13024]: cluster 2021-03-10T13:52:34.607627+0000 mgr.y (mgr.14140) 335 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:36.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:36 gibba013 bash[13024]: cephadm 2021-03-10T13:52:34.926151+0000 mgr.y (mgr.14140) 336 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.x 2021-03-10T13:52:36.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:36 gibba013 bash[13024]: cephadm 2021-03-10T13:52:34.926371+0000 mgr.y (mgr.14140) 337 : cephadm [INF] Upgrade: Redeploying mgr.x 2021-03-10T13:52:36.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:36 gibba013 bash[13024]: cephadm 2021-03-10T13:52:34.938732+0000 mgr.y (mgr.14140) 338 : cephadm [INF] Deploying daemon mgr.x on gibba020 2021-03-10T13:52:36.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:36 gibba013 bash[9767]: cluster 2021-03-10T13:52:34.607627+0000 mgr.y (mgr.14140) 335 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:36.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:36 gibba013 bash[9767]: cephadm 2021-03-10T13:52:34.926151+0000 mgr.y (mgr.14140) 336 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.x 2021-03-10T13:52:36.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:36 gibba013 bash[9767]: cephadm 2021-03-10T13:52:34.926371+0000 mgr.y (mgr.14140) 337 : cephadm [INF] Upgrade: Redeploying mgr.x 2021-03-10T13:52:36.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:36 gibba013 bash[9767]: cephadm 2021-03-10T13:52:34.938732+0000 mgr.y (mgr.14140) 338 : cephadm [INF] Deploying daemon mgr.x on gibba020 2021-03-10T13:52:36.948 INFO:journalctl@ceph.mgr.x.gibba020.stdout:Mar 10 13:52:36 gibba020 systemd[1]: Stopping Ceph mgr.x for 7672acc8-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:52:38.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:38 gibba013 bash[9767]: cluster 2021-03-10T13:52:36.608645+0000 mgr.y (mgr.14140) 339 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:38.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:38 gibba013 bash[13024]: cluster 2021-03-10T13:52:36.608645+0000 mgr.y (mgr.14140) 339 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:38.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:38 gibba020 bash[9782]: cluster 2021-03-10T13:52:36.608645+0000 mgr.y (mgr.14140) 339 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:40.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:40 gibba013 bash[9767]: cluster 2021-03-10T13:52:38.609923+0000 mgr.y (mgr.14140) 340 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:40.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:40 gibba013 bash[13024]: cluster 2021-03-10T13:52:38.609923+0000 mgr.y (mgr.14140) 340 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:40.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:40 gibba020 bash[9782]: cluster 2021-03-10T13:52:38.609923+0000 mgr.y (mgr.14140) 340 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:42.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:42 gibba013 bash[9767]: cluster 2021-03-10T13:52:40.611361+0000 mgr.y (mgr.14140) 341 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:42.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:42 gibba013 bash[13024]: cluster 2021-03-10T13:52:40.611361+0000 mgr.y (mgr.14140) 341 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:42.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:42 gibba020 bash[9782]: cluster 2021-03-10T13:52:40.611361+0000 mgr.y (mgr.14140) 341 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:44.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:44 gibba013 bash[9767]: cluster 2021-03-10T13:52:42.612808+0000 mgr.y (mgr.14140) 342 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:44.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:44 gibba013 bash[13024]: cluster 2021-03-10T13:52:42.612808+0000 mgr.y (mgr.14140) 342 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:44.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:44 gibba020 bash[9782]: cluster 2021-03-10T13:52:42.612808+0000 mgr.y (mgr.14140) 342 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:46.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:46 gibba013 bash[9767]: cluster 2021-03-10T13:52:44.614431+0000 mgr.y (mgr.14140) 343 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:46.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:46 gibba013 bash[13024]: cluster 2021-03-10T13:52:44.614431+0000 mgr.y (mgr.14140) 343 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:46.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:46 gibba020 bash[9782]: cluster 2021-03-10T13:52:44.614431+0000 mgr.y (mgr.14140) 343 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:47.948 INFO:journalctl@ceph.mgr.x.gibba020.stdout:Mar 10 13:52:47 gibba020 docker[21977]: ceph-7672acc8-81a6-11eb-9080-001a4aab830c-mgr.x 2021-03-10T13:52:47.949 INFO:journalctl@ceph.mgr.x.gibba020.stdout:Mar 10 13:52:47 gibba020 systemd[1]: ceph-7672acc8-81a6-11eb-9080-001a4aab830c@mgr.x.service: Main process exited, code=exited, status=137/n/a 2021-03-10T13:52:47.949 INFO:journalctl@ceph.mgr.x.gibba020.stdout:Mar 10 13:52:47 gibba020 systemd[1]: ceph-7672acc8-81a6-11eb-9080-001a4aab830c@mgr.x.service: Failed with result 'exit-code'. 2021-03-10T13:52:47.949 INFO:journalctl@ceph.mgr.x.gibba020.stdout:Mar 10 13:52:47 gibba020 systemd[1]: Stopped Ceph mgr.x for 7672acc8-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:52:47.949 INFO:journalctl@ceph.mgr.x.gibba020.stdout:Mar 10 13:52:47 gibba020 systemd[1]: Starting Ceph mgr.x for 7672acc8-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:52:47.950 INFO:journalctl@ceph.mgr.x.gibba020.stdout:Mar 10 13:52:47 gibba020 docker[22054]: Error: No such container: ceph-7672acc8-81a6-11eb-9080-001a4aab830c-mgr.x 2021-03-10T13:52:47.950 INFO:journalctl@ceph.mgr.x.gibba020.stdout:Mar 10 13:52:47 gibba020 systemd[1]: Started Ceph mgr.x for 7672acc8-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:52:48.432 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:48 gibba020 bash[9782]: cluster 2021-03-10T13:52:46.614980+0000 mgr.y (mgr.14140) 344 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:48.433 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:48 gibba020 bash[9782]: audit 2021-03-10T13:52:47.784747+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175119\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175555\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175709\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175858\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176003\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176147\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176294\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:48:34.834688\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176440\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176586\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}, \"rgw.r.z.gibba020.txcybs\": {\"hostname\": \"gibba020\", \"container_id\": \"809accf5e776\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176734\", \"created\": \"2021-03-10T13:50:00.050014\", \"started\": \"2021-03-10T13:50:00.073039\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:52:48.433 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:48 gibba020 bash[9782]: audit 2021-03-10T13:52:47.793823+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175119\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175555\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175709\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175858\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176003\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176147\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176294\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:48:34.834688\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176440\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176586\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}, \"rgw.r.z.gibba020.txcybs\": {\"hostname\": \"gibba020\", \"container_id\": \"809accf5e776\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176734\", \"created\": \"2021-03-10T13:50:00.050014\", \"started\": \"2021-03-10T13:50:00.073039\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:52:48.433 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:48 gibba020 bash[9782]: audit 2021-03-10T13:52:47.794832+0000 mon.a (mon.0) 593 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:52:48.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:48 gibba013 bash[9767]: cluster 2021-03-10T13:52:46.614980+0000 mgr.y (mgr.14140) 344 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:48.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:48 gibba013 bash[13024]: cluster 2021-03-10T13:52:46.614980+0000 mgr.y (mgr.14140) 344 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:48.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:48 gibba013 bash[9767]: audit 2021-03-10T13:52:47.784747+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175119\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175555\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175709\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175858\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176003\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176147\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176294\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:48:34.834688\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176440\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176586\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}, \"rgw.r.z.gibba020.txcybs\": {\"hostname\": \"gibba020\", \"container_id\": \"809accf5e776\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176734\", \"created\": \"2021-03-10T13:50:00.050014\", \"started\": \"2021-03-10T13:50:00.073039\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:52:48.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:48 gibba013 bash[9767]: audit 2021-03-10T13:52:47.793823+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175119\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175555\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175709\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175858\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176003\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176147\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176294\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:48:34.834688\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176440\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176586\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}, \"rgw.r.z.gibba020.txcybs\": {\"hostname\": \"gibba020\", \"container_id\": \"809accf5e776\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176734\", \"created\": \"2021-03-10T13:50:00.050014\", \"started\": \"2021-03-10T13:50:00.073039\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:52:48.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:48 gibba013 bash[9767]: audit 2021-03-10T13:52:47.794832+0000 mon.a (mon.0) 593 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:52:48.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:48 gibba013 bash[13024]: audit 2021-03-10T13:52:47.784747+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175119\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175555\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175709\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175858\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176003\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176147\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176294\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:48:34.834688\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176440\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176586\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}, \"rgw.r.z.gibba020.txcybs\": {\"hostname\": \"gibba020\", \"container_id\": \"809accf5e776\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176734\", \"created\": \"2021-03-10T13:50:00.050014\", \"started\": \"2021-03-10T13:50:00.073039\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:52:48.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:48 gibba013 bash[13024]: audit 2021-03-10T13:52:47.793823+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175119\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175555\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175709\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.175858\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176003\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176147\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176294\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:48:34.834688\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176440\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176586\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}, \"rgw.r.z.gibba020.txcybs\": {\"hostname\": \"gibba020\", \"container_id\": \"809accf5e776\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:50:01.176734\", \"created\": \"2021-03-10T13:50:00.050014\", \"started\": \"2021-03-10T13:50:00.073039\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:52:48.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:48 gibba013 bash[13024]: audit 2021-03-10T13:52:47.794832+0000 mon.a (mon.0) 593 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:52:49.198 INFO:journalctl@ceph.mgr.x.gibba020.stdout:Mar 10 13:52:48 gibba020 bash[22074]: debug 2021-03-10T13:52:48.837+0000 7f8389147700 1 -- 172.21.2.120:0/184475475 <== mon.2 v2:172.21.2.120:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5620911464e0 con 0x562091234c00 2021-03-10T13:52:49.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:49 gibba013 bash[9767]: audit 2021-03-10T13:52:48.822534+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.817407\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.817673\", \"created\": \"2021-03-10T13:44:37.234781\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.817775\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.817932\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818125\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818271\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818420\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818569\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:48:34.834688\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818715\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818862\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}, \"rgw.r.z.gibba020.txcybs\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T13:52:48.819008\", \"created\": \"2021-03-10T13:50:00.050014\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038\"}}, \"last_daemon_update\": \"2021-03-10T13:52:48.819293\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:52:49.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:49 gibba013 bash[13024]: audit 2021-03-10T13:52:48.822534+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.817407\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.817673\", \"created\": \"2021-03-10T13:44:37.234781\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.817775\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.817932\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818125\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818271\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818420\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818569\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:48:34.834688\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818715\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818862\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}, \"rgw.r.z.gibba020.txcybs\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T13:52:48.819008\", \"created\": \"2021-03-10T13:50:00.050014\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038\"}}, \"last_daemon_update\": \"2021-03-10T13:52:48.819293\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:52:49.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:49 gibba013 bash[13024]: audit 2021-03-10T13:52:48.831597+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.817407\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.817673\", \"created\": \"2021-03-10T13:44:37.234781\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.817775\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.817932\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818125\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818271\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818420\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818569\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:48:34.834688\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818715\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818862\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}, \"rgw.r.z.gibba020.txcybs\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T13:52:48.819008\", \"created\": \"2021-03-10T13:50:00.050014\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038\"}}, \"last_daemon_update\": \"2021-03-10T13:52:48.819293\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:52:49.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:49 gibba013 bash[13024]: audit 2021-03-10T13:52:48.833461+0000 mon.a (mon.0) 596 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:52:49.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:49 gibba013 bash[9767]: audit 2021-03-10T13:52:48.831597+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.817407\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.817673\", \"created\": \"2021-03-10T13:44:37.234781\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.817775\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.817932\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818125\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818271\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818420\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818569\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:48:34.834688\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818715\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818862\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}, \"rgw.r.z.gibba020.txcybs\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T13:52:48.819008\", \"created\": \"2021-03-10T13:50:00.050014\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038\"}}, \"last_daemon_update\": \"2021-03-10T13:52:48.819293\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:52:49.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:49 gibba013 bash[9767]: audit 2021-03-10T13:52:48.833461+0000 mon.a (mon.0) 596 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:52:49.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:49 gibba020 bash[9782]: audit 2021-03-10T13:52:48.822534+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.817407\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.817673\", \"created\": \"2021-03-10T13:44:37.234781\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.817775\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.817932\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818125\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818271\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818420\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818569\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:48:34.834688\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818715\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818862\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}, \"rgw.r.z.gibba020.txcybs\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T13:52:48.819008\", \"created\": \"2021-03-10T13:50:00.050014\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038\"}}, \"last_daemon_update\": \"2021-03-10T13:52:48.819293\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:52:49.814 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:49 gibba020 bash[9782]: audit 2021-03-10T13:52:48.831597+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.817407\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.817673\", \"created\": \"2021-03-10T13:44:37.234781\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"a099a9208e7e\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.817775\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:44:39.575400\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.817932\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818125\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818271\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818420\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818569\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:48:34.834688\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818715\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818862\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}, \"rgw.r.z.gibba020.txcybs\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T13:52:48.819008\", \"created\": \"2021-03-10T13:50:00.050014\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:37.251226\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038\"}}, \"last_daemon_update\": \"2021-03-10T13:52:48.819293\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:52:49.814 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:49 gibba020 bash[9782]: audit 2021-03-10T13:52:48.833461+0000 mon.a (mon.0) 596 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:52:50.229 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T13:52:50.418 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:52:50.419 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (4m) 4m ago 4m 0.21.0 prom/alertmanager c876f5897d7b a890668984ec 2021-03-10T13:52:50.419 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (4m) 1s ago 4m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T13:52:50.419 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (8m) 1s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a099a9208e7e 2021-03-10T13:52:50.419 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running 1s ago 8m quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T13:52:50.420 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (9m) 4m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 aff9dae2208b 2021-03-10T13:52:50.420 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (9m) 4m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 02bb13cc8f40 2021-03-10T13:52:50.420 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (8m) 1s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a58fc42cd46b 2021-03-10T13:52:50.420 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (8m) 4m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 c561d31798a4 2021-03-10T13:52:50.421 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (4m) 4m ago 4m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T13:52:50.421 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (4m) 1s ago 4m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T13:52:50.421 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (7m) 4m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 bf4441d660ac 2021-03-10T13:52:50.421 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (7m) 4m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 385800e8f97f 2021-03-10T13:52:50.421 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (7m) 4m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d0a99b0fd1fc 2021-03-10T13:52:50.422 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (6m) 4m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d0b507f36a88 2021-03-10T13:52:50.422 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (6m) 1s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5bcc0da1a794 2021-03-10T13:52:50.422 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (6m) 1s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 8e0d292ca03b 2021-03-10T13:52:50.422 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (5m) 1s ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b54758e37be1 2021-03-10T13:52:50.423 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (5m) 1s ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 75c9ee8106fc 2021-03-10T13:52:50.423 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (4m) 1s ago 4m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T13:52:50.423 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 1s ago 2m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:52:50.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:50 gibba013 bash[9767]: cluster 2021-03-10T13:52:48.616358+0000 mgr.y (mgr.14140) 345 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:50.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:50 gibba013 bash[9767]: cephadm 2021-03-10T13:52:48.833199+0000 mgr.y (mgr.14140) 346 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T13:52:50.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:50 gibba013 bash[9767]: cephadm 2021-03-10T13:52:48.834310+0000 mgr.y (mgr.14140) 347 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T13:52:50.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:50 gibba013 bash[9767]: cephadm 2021-03-10T13:52:48.834377+0000 mgr.y (mgr.14140) 348 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T13:52:50.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:50 gibba013 bash[9767]: audit 2021-03-10T13:52:50.221374+0000 mgr.y (mgr.14140) 349 : audit [DBG] from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:52:50.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:50 gibba013 bash[13024]: cluster 2021-03-10T13:52:48.616358+0000 mgr.y (mgr.14140) 345 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:50.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:50 gibba013 bash[13024]: cephadm 2021-03-10T13:52:48.833199+0000 mgr.y (mgr.14140) 346 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T13:52:50.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:50 gibba013 bash[13024]: cephadm 2021-03-10T13:52:48.834310+0000 mgr.y (mgr.14140) 347 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T13:52:50.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:50 gibba013 bash[13024]: cephadm 2021-03-10T13:52:48.834377+0000 mgr.y (mgr.14140) 348 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T13:52:50.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:50 gibba013 bash[13024]: audit 2021-03-10T13:52:50.221374+0000 mgr.y (mgr.14140) 349 : audit [DBG] from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:52:50.633 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T13:52:50.634 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T13:52:50.634 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2021-03-10T13:52:50.634 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:52:50.634 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T13:52:50.635 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2021-03-10T13:52:50.635 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:52:50.635 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T13:52:50.635 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2021-03-10T13:52:50.635 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:52:50.636 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T13:52:50.636 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T13:52:50.636 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 14 2021-03-10T13:52:50.636 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T13:52:50.636 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T13:52:50.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:50 gibba020 bash[9782]: cluster 2021-03-10T13:52:48.616358+0000 mgr.y (mgr.14140) 345 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:50.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:50 gibba020 bash[9782]: cephadm 2021-03-10T13:52:48.833199+0000 mgr.y (mgr.14140) 346 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T13:52:50.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:50 gibba020 bash[9782]: cephadm 2021-03-10T13:52:48.834310+0000 mgr.y (mgr.14140) 347 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T13:52:50.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:50 gibba020 bash[9782]: cephadm 2021-03-10T13:52:48.834377+0000 mgr.y (mgr.14140) 348 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T13:52:50.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:50 gibba020 bash[9782]: audit 2021-03-10T13:52:50.221374+0000 mgr.y (mgr.14140) 349 : audit [DBG] from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:52:51.612 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:51 gibba020 bash[9782]: audit 2021-03-10T13:52:50.415613+0000 mgr.y (mgr.14140) 350 : audit [DBG] from='client.24508 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:52:51.613 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:51 gibba020 bash[9782]: cluster 2021-03-10T13:52:50.616837+0000 mgr.y (mgr.14140) 351 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:51.613 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:51 gibba020 bash[9782]: audit 2021-03-10T13:52:50.634040+0000 mon.a (mon.0) 597 : audit [DBG] from='client.? 172.21.2.113:0/2890289297' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:52:51.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:51 gibba013 bash[9767]: audit 2021-03-10T13:52:50.415613+0000 mgr.y (mgr.14140) 350 : audit [DBG] from='client.24508 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:52:51.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:51 gibba013 bash[9767]: cluster 2021-03-10T13:52:50.616837+0000 mgr.y (mgr.14140) 351 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:51.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:51 gibba013 bash[9767]: audit 2021-03-10T13:52:50.634040+0000 mon.a (mon.0) 597 : audit [DBG] from='client.? 172.21.2.113:0/2890289297' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:52:51.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:51 gibba013 bash[13024]: audit 2021-03-10T13:52:50.415613+0000 mgr.y (mgr.14140) 350 : audit [DBG] from='client.24508 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:52:51.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:51 gibba013 bash[13024]: cluster 2021-03-10T13:52:50.616837+0000 mgr.y (mgr.14140) 351 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:51.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:51 gibba013 bash[13024]: audit 2021-03-10T13:52:50.634040+0000 mon.a (mon.0) 597 : audit [DBG] from='client.? 172.21.2.113:0/2890289297' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:52:52.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:52 gibba020 bash[9782]: audit 2021-03-10T13:52:52.328535+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.gibba020.yqfnwy"}]: dispatch 2021-03-10T13:52:52.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:52 gibba020 bash[9782]: audit 2021-03-10T13:52:52.338049+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.gibba020.yqfnwy"}]': finished 2021-03-10T13:52:52.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:52 gibba020 bash[9782]: audit 2021-03-10T13:52:52.338988+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.gibba020.yqfnwy"}]: dispatch 2021-03-10T13:52:52.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:52 gibba020 bash[9782]: audit 2021-03-10T13:52:52.339790+0000 mon.a (mon.0) 601 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:52:52.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:52 gibba020 bash[9782]: audit 2021-03-10T13:52:52.340569+0000 mon.a (mon.0) 602 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.gibba020.yqfnwy", "key": "container_image"}]: dispatch 2021-03-10T13:52:52.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:52 gibba013 bash[9767]: audit 2021-03-10T13:52:52.328535+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.gibba020.yqfnwy"}]: dispatch 2021-03-10T13:52:52.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:52 gibba013 bash[9767]: audit 2021-03-10T13:52:52.338049+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.gibba020.yqfnwy"}]': finished 2021-03-10T13:52:52.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:52 gibba013 bash[9767]: audit 2021-03-10T13:52:52.338988+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.gibba020.yqfnwy"}]: dispatch 2021-03-10T13:52:52.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:52 gibba013 bash[9767]: audit 2021-03-10T13:52:52.339790+0000 mon.a (mon.0) 601 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:52:52.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:52 gibba013 bash[9767]: audit 2021-03-10T13:52:52.340569+0000 mon.a (mon.0) 602 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.gibba020.yqfnwy", "key": "container_image"}]: dispatch 2021-03-10T13:52:52.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:52 gibba013 bash[13024]: audit 2021-03-10T13:52:52.328535+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.gibba020.yqfnwy"}]: dispatch 2021-03-10T13:52:52.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:52 gibba013 bash[13024]: audit 2021-03-10T13:52:52.338049+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.gibba020.yqfnwy"}]': finished 2021-03-10T13:52:52.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:52 gibba013 bash[13024]: audit 2021-03-10T13:52:52.338988+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.gibba020.yqfnwy"}]: dispatch 2021-03-10T13:52:52.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:52 gibba013 bash[13024]: audit 2021-03-10T13:52:52.339790+0000 mon.a (mon.0) 601 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:52:52.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:52 gibba013 bash[13024]: audit 2021-03-10T13:52:52.340569+0000 mon.a (mon.0) 602 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.gibba020.yqfnwy", "key": "container_image"}]: dispatch 2021-03-10T13:52:53.593 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:53 gibba020 bash[9782]: cephadm 2021-03-10T13:52:52.327451+0000 mgr.y (mgr.14140) 352 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.gibba020.yqfnwy 2021-03-10T13:52:53.594 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:53 gibba020 bash[9782]: cephadm 2021-03-10T13:52:52.327675+0000 mgr.y (mgr.14140) 353 : cephadm [INF] Upgrade: Redeploying mgr.gibba020.yqfnwy 2021-03-10T13:52:53.594 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:53 gibba020 bash[9782]: cephadm 2021-03-10T13:52:52.340335+0000 mgr.y (mgr.14140) 354 : cephadm [INF] Deploying daemon mgr.gibba020.yqfnwy on gibba020 2021-03-10T13:52:53.594 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:53 gibba020 bash[9782]: cluster 2021-03-10T13:52:52.618331+0000 mgr.y (mgr.14140) 355 : cluster [DBG] pgmap v330: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:53.595 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:53 gibba020 bash[9782]: audit 2021-03-10T13:52:52.630951+0000 mon.b (mon.2) 23 : audit [DBG] from='mgr.? 172.21.2.120:0/2032443355' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:52:53.595 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:53 gibba020 bash[9782]: audit 2021-03-10T13:52:52.632021+0000 mon.b (mon.2) 24 : audit [DBG] from='mgr.? 172.21.2.120:0/2032443355' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:52:53.595 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:53 gibba020 bash[9782]: cluster 2021-03-10T13:52:52.633952+0000 mon.a (mon.0) 603 : cluster [DBG] Standby manager daemon x restarted 2021-03-10T13:52:53.595 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:53 gibba020 bash[9782]: cluster 2021-03-10T13:52:52.634359+0000 mon.a (mon.0) 604 : cluster [DBG] Standby manager daemon x started 2021-03-10T13:52:53.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:53 gibba013 bash[9767]: cephadm 2021-03-10T13:52:52.327451+0000 mgr.y (mgr.14140) 352 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.gibba020.yqfnwy 2021-03-10T13:52:53.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:53 gibba013 bash[9767]: cephadm 2021-03-10T13:52:52.327675+0000 mgr.y (mgr.14140) 353 : cephadm [INF] Upgrade: Redeploying mgr.gibba020.yqfnwy 2021-03-10T13:52:53.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:53 gibba013 bash[9767]: cephadm 2021-03-10T13:52:52.340335+0000 mgr.y (mgr.14140) 354 : cephadm [INF] Deploying daemon mgr.gibba020.yqfnwy on gibba020 2021-03-10T13:52:53.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:53 gibba013 bash[9767]: cluster 2021-03-10T13:52:52.618331+0000 mgr.y (mgr.14140) 355 : cluster [DBG] pgmap v330: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:53.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:53 gibba013 bash[9767]: audit 2021-03-10T13:52:52.630951+0000 mon.b (mon.2) 23 : audit [DBG] from='mgr.? 172.21.2.120:0/2032443355' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:52:53.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:53 gibba013 bash[9767]: audit 2021-03-10T13:52:52.632021+0000 mon.b (mon.2) 24 : audit [DBG] from='mgr.? 172.21.2.120:0/2032443355' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:52:53.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:53 gibba013 bash[9767]: cluster 2021-03-10T13:52:52.633952+0000 mon.a (mon.0) 603 : cluster [DBG] Standby manager daemon x restarted 2021-03-10T13:52:53.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:53 gibba013 bash[9767]: cluster 2021-03-10T13:52:52.634359+0000 mon.a (mon.0) 604 : cluster [DBG] Standby manager daemon x started 2021-03-10T13:52:53.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:53 gibba013 bash[13024]: cephadm 2021-03-10T13:52:52.327451+0000 mgr.y (mgr.14140) 352 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.gibba020.yqfnwy 2021-03-10T13:52:53.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:53 gibba013 bash[13024]: cephadm 2021-03-10T13:52:52.327675+0000 mgr.y (mgr.14140) 353 : cephadm [INF] Upgrade: Redeploying mgr.gibba020.yqfnwy 2021-03-10T13:52:53.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:53 gibba013 bash[13024]: cephadm 2021-03-10T13:52:52.340335+0000 mgr.y (mgr.14140) 354 : cephadm [INF] Deploying daemon mgr.gibba020.yqfnwy on gibba020 2021-03-10T13:52:53.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:53 gibba013 bash[13024]: cluster 2021-03-10T13:52:52.618331+0000 mgr.y (mgr.14140) 355 : cluster [DBG] pgmap v330: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:53.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:53 gibba013 bash[13024]: audit 2021-03-10T13:52:52.630951+0000 mon.b (mon.2) 23 : audit [DBG] from='mgr.? 172.21.2.120:0/2032443355' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:52:53.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:53 gibba013 bash[13024]: audit 2021-03-10T13:52:52.632021+0000 mon.b (mon.2) 24 : audit [DBG] from='mgr.? 172.21.2.120:0/2032443355' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:52:53.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:53 gibba013 bash[13024]: cluster 2021-03-10T13:52:52.633952+0000 mon.a (mon.0) 603 : cluster [DBG] Standby manager daemon x restarted 2021-03-10T13:52:53.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:53 gibba013 bash[13024]: cluster 2021-03-10T13:52:52.634359+0000 mon.a (mon.0) 604 : cluster [DBG] Standby manager daemon x started 2021-03-10T13:52:54.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:54 gibba020 bash[9782]: cluster 2021-03-10T13:52:53.398260+0000 mon.a (mon.0) 605 : cluster [DBG] mgrmap e16: y(active, since 9m), standbys: gibba020.yqfnwy, x 2021-03-10T13:52:54.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:54 gibba013 bash[9767]: cluster 2021-03-10T13:52:53.398260+0000 mon.a (mon.0) 605 : cluster [DBG] mgrmap e16: y(active, since 9m), standbys: gibba020.yqfnwy, x 2021-03-10T13:52:54.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:54 gibba013 bash[13024]: cluster 2021-03-10T13:52:53.398260+0000 mon.a (mon.0) 605 : cluster [DBG] mgrmap e16: y(active, since 9m), standbys: gibba020.yqfnwy, x 2021-03-10T13:52:55.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:55 gibba020 bash[9782]: cluster 2021-03-10T13:52:54.619859+0000 mgr.y (mgr.14140) 356 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:55.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:55 gibba013 bash[9767]: cluster 2021-03-10T13:52:54.619859+0000 mgr.y (mgr.14140) 356 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:55.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:55 gibba013 bash[13024]: cluster 2021-03-10T13:52:54.619859+0000 mgr.y (mgr.14140) 356 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:57.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:57 gibba020 bash[9782]: cluster 2021-03-10T13:52:56.620354+0000 mgr.y (mgr.14140) 357 : cluster [DBG] pgmap v332: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:58.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:57 gibba013 bash[9767]: cluster 2021-03-10T13:52:56.620354+0000 mgr.y (mgr.14140) 357 : cluster [DBG] pgmap v332: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:58.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:57 gibba013 bash[13024]: cluster 2021-03-10T13:52:56.620354+0000 mgr.y (mgr.14140) 357 : cluster [DBG] pgmap v332: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:52:59.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:52:59 gibba020 bash[9782]: cluster 2021-03-10T13:52:58.621722+0000 mgr.y (mgr.14140) 358 : cluster [DBG] pgmap v333: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:00.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:52:59 gibba013 bash[9767]: cluster 2021-03-10T13:52:58.621722+0000 mgr.y (mgr.14140) 358 : cluster [DBG] pgmap v333: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:00.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:52:59 gibba013 bash[13024]: cluster 2021-03-10T13:52:58.621722+0000 mgr.y (mgr.14140) 358 : cluster [DBG] pgmap v333: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:01.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:01 gibba020 bash[9782]: cluster 2021-03-10T13:53:00.623133+0000 mgr.y (mgr.14140) 359 : cluster [DBG] pgmap v334: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:02.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:01 gibba013 bash[9767]: cluster 2021-03-10T13:53:00.623133+0000 mgr.y (mgr.14140) 359 : cluster [DBG] pgmap v334: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:02.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:01 gibba013 bash[13024]: cluster 2021-03-10T13:53:00.623133+0000 mgr.y (mgr.14140) 359 : cluster [DBG] pgmap v334: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:03.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:03 gibba020 bash[9782]: cluster 2021-03-10T13:53:02.624568+0000 mgr.y (mgr.14140) 360 : cluster [DBG] pgmap v335: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:04.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:03 gibba013 bash[9767]: cluster 2021-03-10T13:53:02.624568+0000 mgr.y (mgr.14140) 360 : cluster [DBG] pgmap v335: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:04.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:03 gibba013 bash[13024]: cluster 2021-03-10T13:53:02.624568+0000 mgr.y (mgr.14140) 360 : cluster [DBG] pgmap v335: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:05.685 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:05 gibba013 bash[9767]: cluster 2021-03-10T13:53:04.625829+0000 mgr.y (mgr.14140) 361 : cluster [DBG] pgmap v336: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:05.685 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:05 gibba013 bash[9767]: audit 2021-03-10T13:53:05.127320+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.817407\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.817673\", \"created\": \"2021-03-10T13:44:37.234781\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.817932\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818125\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818271\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818420\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818569\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:48:34.834688\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818715\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818862\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}, \"rgw.r.z.gibba020.txcybs\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T13:52:48.819008\", \"created\": \"2021-03-10T13:50:00.050014\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:52.338810\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:53:05.686 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:05 gibba013 bash[9767]: audit 2021-03-10T13:53:05.136176+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.817407\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.817673\", \"created\": \"2021-03-10T13:44:37.234781\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.817932\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818125\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818271\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818420\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818569\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:48:34.834688\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818715\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818862\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}, \"rgw.r.z.gibba020.txcybs\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T13:52:48.819008\", \"created\": \"2021-03-10T13:50:00.050014\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:52.338810\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:53:05.686 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:05 gibba013 bash[9767]: audit 2021-03-10T13:53:05.137015+0000 mon.a (mon.0) 608 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:53:05.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:05 gibba020 bash[9782]: cluster 2021-03-10T13:53:04.625829+0000 mgr.y (mgr.14140) 361 : cluster [DBG] pgmap v336: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:05.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:05 gibba020 bash[9782]: audit 2021-03-10T13:53:05.127320+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.817407\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.817673\", \"created\": \"2021-03-10T13:44:37.234781\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.817932\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818125\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818271\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818420\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818569\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:48:34.834688\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818715\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818862\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}, \"rgw.r.z.gibba020.txcybs\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T13:52:48.819008\", \"created\": \"2021-03-10T13:50:00.050014\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:52.338810\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:53:05.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:05 gibba020 bash[9782]: audit 2021-03-10T13:53:05.136176+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.817407\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.817673\", \"created\": \"2021-03-10T13:44:37.234781\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.817932\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818125\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818271\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818420\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818569\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:48:34.834688\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818715\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818862\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}, \"rgw.r.z.gibba020.txcybs\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T13:52:48.819008\", \"created\": \"2021-03-10T13:50:00.050014\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:52.338810\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:53:05.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:05 gibba020 bash[9782]: audit 2021-03-10T13:53:05.137015+0000 mon.a (mon.0) 608 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:53:06.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:05 gibba013 bash[13024]: cluster 2021-03-10T13:53:04.625829+0000 mgr.y (mgr.14140) 361 : cluster [DBG] pgmap v336: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:06.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:05 gibba013 bash[13024]: audit 2021-03-10T13:53:05.127320+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.817407\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.817673\", \"created\": \"2021-03-10T13:44:37.234781\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.817932\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818125\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818271\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818420\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818569\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:48:34.834688\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818715\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818862\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}, \"rgw.r.z.gibba020.txcybs\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T13:52:48.819008\", \"created\": \"2021-03-10T13:50:00.050014\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:52.338810\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:53:06.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:05 gibba013 bash[13024]: audit 2021-03-10T13:53:05.136176+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.817407\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.817673\", \"created\": \"2021-03-10T13:44:37.234781\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.817932\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818125\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818271\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818420\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818569\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:48:34.834688\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818715\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:52:48.818862\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}, \"rgw.r.z.gibba020.txcybs\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T13:52:48.819008\", \"created\": \"2021-03-10T13:50:00.050014\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:52.338810\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:53:06.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:05 gibba013 bash[13024]: audit 2021-03-10T13:53:05.137015+0000 mon.a (mon.0) 608 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T13:53:07.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:07 gibba020 bash[9782]: cluster 2021-03-10T13:53:06.626245+0000 mgr.y (mgr.14140) 362 : cluster [DBG] pgmap v337: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:07.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:07 gibba020 bash[9782]: audit 2021-03-10T13:53:06.819134+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.814230\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"7268fb51c46b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.814532\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:52:47.791424\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"24f623ad250b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.814726\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:53:05.133311\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.814884\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.815034\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.815183\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.815329\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.815478\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:48:34.834688\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.815624\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.815770\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}, \"rgw.r.z.gibba020.txcybs\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T13:53:06.815915\", \"created\": \"2021-03-10T13:50:00.050014\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:52.338810\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038\"}}, \"last_daemon_update\": \"2021-03-10T13:53:06.816205\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:53:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:07 gibba020 bash[9782]: audit 2021-03-10T13:53:06.822212+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.814230\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"7268fb51c46b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.814532\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:52:47.791424\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"24f623ad250b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.814726\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:53:05.133311\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.814884\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.815034\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.815183\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.815329\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.815478\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:48:34.834688\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.815624\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.815770\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}, \"rgw.r.z.gibba020.txcybs\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T13:53:06.815915\", \"created\": \"2021-03-10T13:50:00.050014\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:52.338810\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038\"}}, \"last_daemon_update\": \"2021-03-10T13:53:06.816205\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:53:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:07 gibba020 bash[9782]: cephadm 2021-03-10T13:53:06.823811+0000 mgr.y (mgr.14140) 363 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T13:53:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:07 gibba020 bash[9782]: audit 2021-03-10T13:53:06.824027+0000 mon.a (mon.0) 611 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:53:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:07 gibba020 bash[9782]: cephadm 2021-03-10T13:53:06.824828+0000 mgr.y (mgr.14140) 364 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T13:53:07.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:07 gibba020 bash[9782]: cephadm 2021-03-10T13:53:06.824910+0000 mgr.y (mgr.14140) 365 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T13:53:07.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:07 gibba020 bash[9782]: cephadm 2021-03-10T13:53:06.826533+0000 mgr.y (mgr.14140) 366 : cephadm [INF] Upgrade: there are 2 other already-upgraded standby mgrs, failing over 2021-03-10T13:53:07.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:07 gibba020 bash[9782]: audit 2021-03-10T13:53:06.826881+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2021-03-10T13:53:07.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:07 gibba020 bash[9782]: cluster 2021-03-10T13:53:06.830058+0000 mon.a (mon.0) 613 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2021-03-10T13:53:07.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:07 gibba020 bash[9782]: cluster 2021-03-10T13:53:07.490232+0000 mon.a (mon.0) 614 : cluster [DBG] Standby manager daemon y started 2021-03-10T13:53:08.128 INFO:journalctl@ceph.mgr.y.gibba013.stdout:Mar 10 13:53:07 gibba013 bash[10020]: debug 2021-03-10T13:53:07.828+0000 7f1b9c786700 -1 mgr handle_mgr_map I was active but no longer am 2021-03-10T13:53:08.128 INFO:journalctl@ceph.mgr.y.gibba013.stdout:Mar 10 13:53:07 gibba013 bash[10020]: ignoring --setuser ceph since I am not root 2021-03-10T13:53:08.128 INFO:journalctl@ceph.mgr.y.gibba013.stdout:Mar 10 13:53:07 gibba013 bash[10020]: ignoring --setgroup ceph since I am not root 2021-03-10T13:53:08.129 INFO:journalctl@ceph.mgr.y.gibba013.stdout:Mar 10 13:53:07 gibba013 bash[10020]: debug 2021-03-10T13:53:07.856+0000 7f34974a6040 -1 asok(0x556ba3dae000) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/ceph-mgr.y.asok': (13) Permission denied 2021-03-10T13:53:08.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:07 gibba013 bash[13024]: cluster 2021-03-10T13:53:06.626245+0000 mgr.y (mgr.14140) 362 : cluster [DBG] pgmap v337: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:08.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:07 gibba013 bash[9767]: cluster 2021-03-10T13:53:06.626245+0000 mgr.y (mgr.14140) 362 : cluster [DBG] pgmap v337: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:08.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:07 gibba013 bash[13024]: audit 2021-03-10T13:53:06.819134+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.814230\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"7268fb51c46b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.814532\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:52:47.791424\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"24f623ad250b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.814726\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:53:05.133311\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.814884\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.815034\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.815183\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.815329\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.815478\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:48:34.834688\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.815624\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.815770\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}, \"rgw.r.z.gibba020.txcybs\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T13:53:06.815915\", \"created\": \"2021-03-10T13:50:00.050014\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:52.338810\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038\"}}, \"last_daemon_update\": \"2021-03-10T13:53:06.816205\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:53:08.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:07 gibba013 bash[13024]: audit 2021-03-10T13:53:06.822212+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.814230\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"7268fb51c46b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.814532\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:52:47.791424\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"24f623ad250b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.814726\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:53:05.133311\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.814884\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.815034\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.815183\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.815329\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.815478\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:48:34.834688\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.815624\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.815770\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}, \"rgw.r.z.gibba020.txcybs\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T13:53:06.815915\", \"created\": \"2021-03-10T13:50:00.050014\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:52.338810\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038\"}}, \"last_daemon_update\": \"2021-03-10T13:53:06.816205\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:53:08.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:07 gibba013 bash[13024]: cephadm 2021-03-10T13:53:06.823811+0000 mgr.y (mgr.14140) 363 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T13:53:08.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:07 gibba013 bash[13024]: audit 2021-03-10T13:53:06.824027+0000 mon.a (mon.0) 611 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:53:08.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:07 gibba013 bash[13024]: cephadm 2021-03-10T13:53:06.824828+0000 mgr.y (mgr.14140) 364 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T13:53:08.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:07 gibba013 bash[13024]: cephadm 2021-03-10T13:53:06.824910+0000 mgr.y (mgr.14140) 365 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T13:53:08.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:07 gibba013 bash[13024]: cephadm 2021-03-10T13:53:06.826533+0000 mgr.y (mgr.14140) 366 : cephadm [INF] Upgrade: there are 2 other already-upgraded standby mgrs, failing over 2021-03-10T13:53:08.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:07 gibba013 bash[13024]: audit 2021-03-10T13:53:06.826881+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2021-03-10T13:53:08.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:07 gibba013 bash[13024]: cluster 2021-03-10T13:53:06.830058+0000 mon.a (mon.0) 613 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2021-03-10T13:53:08.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:07 gibba013 bash[13024]: cluster 2021-03-10T13:53:07.490232+0000 mon.a (mon.0) 614 : cluster [DBG] Standby manager daemon y started 2021-03-10T13:53:08.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:07 gibba013 bash[9767]: audit 2021-03-10T13:53:06.819134+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.814230\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"7268fb51c46b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.814532\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:52:47.791424\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"24f623ad250b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.814726\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:53:05.133311\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.814884\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.815034\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.815183\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.815329\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.815478\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:48:34.834688\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.815624\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.815770\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}, \"rgw.r.z.gibba020.txcybs\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T13:53:06.815915\", \"created\": \"2021-03-10T13:50:00.050014\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:52.338810\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038\"}}, \"last_daemon_update\": \"2021-03-10T13:53:06.816205\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]: dispatch 2021-03-10T13:53:08.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:07 gibba013 bash[9767]: audit 2021-03-10T13:53:06.822212+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.814230\", \"created\": \"2021-03-10T13:44:20.530781\", \"started\": \"2021-03-10T13:44:20.552250\"}, \"mgr.x\": {\"hostname\": \"gibba020\", \"container_id\": \"7268fb51c46b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.814532\", \"created\": \"2021-03-10T13:44:37.234781\", \"started\": \"2021-03-10T13:52:47.791424\"}, \"mgr.gibba020.yqfnwy\": {\"hostname\": \"gibba020\", \"container_id\": \"24f623ad250b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"gibba020.yqfnwy\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.814726\", \"created\": \"2021-03-10T13:44:39.550781\", \"started\": \"2021-03-10T13:53:05.133311\"}, \"osd.4\": {\"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.814884\", \"created\": \"2021-03-10T13:46:23.866010\", \"started\": \"2021-03-10T13:46:27.049069\"}, \"osd.5\": {\"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.815034\", \"created\": \"2021-03-10T13:46:46.746011\", \"started\": \"2021-03-10T13:46:49.913581\"}, \"osd.6\": {\"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.815183\", \"created\": \"2021-03-10T13:47:09.378011\", \"started\": \"2021-03-10T13:47:12.839725\"}, \"osd.7\": {\"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.815329\", \"created\": \"2021-03-10T13:47:32.870012\", \"started\": \"2021-03-10T13:47:36.592939\"}, \"prometheus.a\": {\"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.815478\", \"created\": \"2021-03-10T13:47:55.226012\", \"started\": \"2021-03-10T13:48:34.834688\"}, \"node-exporter.b\": {\"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.815624\", \"created\": \"2021-03-10T13:47:56.326012\", \"started\": \"2021-03-10T13:47:58.273150\"}, \"grafana.a\": {\"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T13:53:06.815770\", \"created\": \"2021-03-10T13:48:18.782012\", \"started\": \"2021-03-10T13:48:18.806617\"}, \"rgw.r.z.gibba020.txcybs\": {\"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T13:53:06.815915\", \"created\": \"2021-03-10T13:50:00.050014\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:52.338810\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038\"}}, \"last_daemon_update\": \"2021-03-10T13:53:06.816205\", \"last_device_update\": \"2021-03-10T13:47:41.483965\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080\"}"}]': finished 2021-03-10T13:53:08.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:07 gibba013 bash[9767]: cephadm 2021-03-10T13:53:06.823811+0000 mgr.y (mgr.14140) 363 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T13:53:08.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:07 gibba013 bash[9767]: audit 2021-03-10T13:53:06.824027+0000 mon.a (mon.0) 611 : audit [DBG] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:53:08.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:07 gibba013 bash[9767]: cephadm 2021-03-10T13:53:06.824828+0000 mgr.y (mgr.14140) 364 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T13:53:08.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:07 gibba013 bash[9767]: cephadm 2021-03-10T13:53:06.824910+0000 mgr.y (mgr.14140) 365 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T13:53:08.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:07 gibba013 bash[9767]: cephadm 2021-03-10T13:53:06.826533+0000 mgr.y (mgr.14140) 366 : cephadm [INF] Upgrade: there are 2 other already-upgraded standby mgrs, failing over 2021-03-10T13:53:08.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:07 gibba013 bash[9767]: audit 2021-03-10T13:53:06.826881+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2021-03-10T13:53:08.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:07 gibba013 bash[9767]: cluster 2021-03-10T13:53:06.830058+0000 mon.a (mon.0) 613 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2021-03-10T13:53:08.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:07 gibba013 bash[9767]: cluster 2021-03-10T13:53:07.490232+0000 mon.a (mon.0) 614 : cluster [DBG] Standby manager daemon y started 2021-03-10T13:53:09.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:08 gibba013 bash[9767]: audit 2021-03-10T13:53:07.834693+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2021-03-10T13:53:09.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:08 gibba013 bash[9767]: cluster 2021-03-10T13:53:07.834720+0000 mon.a (mon.0) 616 : cluster [DBG] mgrmap e17: gibba020.yqfnwy(active, starting, since 1.00741s), standbys: y, x 2021-03-10T13:53:09.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:08 gibba013 bash[13024]: audit 2021-03-10T13:53:07.834693+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2021-03-10T13:53:09.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:08 gibba013 bash[13024]: cluster 2021-03-10T13:53:07.834720+0000 mon.a (mon.0) 616 : cluster [DBG] mgrmap e17: gibba020.yqfnwy(active, starting, since 1.00741s), standbys: y, x 2021-03-10T13:53:09.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:08 gibba020 bash[9782]: audit 2021-03-10T13:53:07.834693+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.14140 172.21.2.113:0/1290032621' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2021-03-10T13:53:09.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:08 gibba020 bash[9782]: cluster 2021-03-10T13:53:07.834720+0000 mon.a (mon.0) 616 : cluster [DBG] mgrmap e17: gibba020.yqfnwy(active, starting, since 1.00741s), standbys: y, x 2021-03-10T13:53:10.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:10 gibba013 bash[9767]: audit 2021-03-10T13:53:10.062151+0000 mon.b (mon.2) 25 : audit [DBG] from='mgr.? 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:53:10.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:10 gibba013 bash[9767]: cluster 2021-03-10T13:53:10.064619+0000 mon.a (mon.0) 617 : cluster [INF] Active manager daemon gibba020.yqfnwy restarted 2021-03-10T13:53:10.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:10 gibba013 bash[9767]: cluster 2021-03-10T13:53:10.065226+0000 mon.a (mon.0) 618 : cluster [INF] Activating manager daemon gibba020.yqfnwy 2021-03-10T13:53:10.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:10 gibba013 bash[9767]: audit 2021-03-10T13:53:10.065307+0000 mon.b (mon.2) 26 : audit [DBG] from='mgr.? 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:53:10.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:10 gibba013 bash[9767]: cluster 2021-03-10T13:53:10.068664+0000 mon.a (mon.0) 619 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2021-03-10T13:53:10.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:10 gibba013 bash[13024]: audit 2021-03-10T13:53:10.062151+0000 mon.b (mon.2) 25 : audit [DBG] from='mgr.? 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:53:10.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:10 gibba013 bash[13024]: cluster 2021-03-10T13:53:10.064619+0000 mon.a (mon.0) 617 : cluster [INF] Active manager daemon gibba020.yqfnwy restarted 2021-03-10T13:53:10.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:10 gibba013 bash[13024]: cluster 2021-03-10T13:53:10.065226+0000 mon.a (mon.0) 618 : cluster [INF] Activating manager daemon gibba020.yqfnwy 2021-03-10T13:53:10.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:10 gibba013 bash[13024]: audit 2021-03-10T13:53:10.065307+0000 mon.b (mon.2) 26 : audit [DBG] from='mgr.? 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:53:10.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:10 gibba013 bash[13024]: cluster 2021-03-10T13:53:10.068664+0000 mon.a (mon.0) 619 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2021-03-10T13:53:10.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:10 gibba020 bash[9782]: audit 2021-03-10T13:53:10.062151+0000 mon.b (mon.2) 25 : audit [DBG] from='mgr.? 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:53:10.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:10 gibba020 bash[9782]: cluster 2021-03-10T13:53:10.064619+0000 mon.a (mon.0) 617 : cluster [INF] Active manager daemon gibba020.yqfnwy restarted 2021-03-10T13:53:10.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:10 gibba020 bash[9782]: cluster 2021-03-10T13:53:10.065226+0000 mon.a (mon.0) 618 : cluster [INF] Activating manager daemon gibba020.yqfnwy 2021-03-10T13:53:10.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:10 gibba020 bash[9782]: audit 2021-03-10T13:53:10.065307+0000 mon.b (mon.2) 26 : audit [DBG] from='mgr.? 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:53:10.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:10 gibba020 bash[9782]: cluster 2021-03-10T13:53:10.068664+0000 mon.a (mon.0) 619 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2021-03-10T13:53:11.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: cluster 2021-03-10T13:53:10.120941+0000 mon.a (mon.0) 620 : cluster [DBG] mgrmap e18: gibba020.yqfnwy(active, starting, since 0.0558209s), standbys: y, x 2021-03-10T13:53:11.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: audit 2021-03-10T13:53:10.123109+0000 mon.b (mon.2) 27 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mgr metadata", "who": "gibba020.yqfnwy", "id": "gibba020.yqfnwy"}]: dispatch 2021-03-10T13:53:11.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: audit 2021-03-10T13:53:10.123260+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T13:53:11.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: audit 2021-03-10T13:53:10.123383+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T13:53:11.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: audit 2021-03-10T13:53:10.123563+0000 mon.b (mon.2) 30 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:53:11.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: audit 2021-03-10T13:53:10.123813+0000 mon.b (mon.2) 31 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:53:11.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: audit 2021-03-10T13:53:10.124083+0000 mon.b (mon.2) 32 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:53:11.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: audit 2021-03-10T13:53:10.124369+0000 mon.b (mon.2) 33 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:53:11.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: audit 2021-03-10T13:53:10.124551+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:53:11.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: audit 2021-03-10T13:53:10.124737+0000 mon.b (mon.2) 35 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:53:11.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: audit 2021-03-10T13:53:10.125105+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:53:11.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: audit 2021-03-10T13:53:10.125272+0000 mon.b (mon.2) 37 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:53:11.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: audit 2021-03-10T13:53:10.125777+0000 mon.b (mon.2) 38 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T13:53:11.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: audit 2021-03-10T13:53:10.125908+0000 mon.b (mon.2) 39 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T13:53:11.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: audit 2021-03-10T13:53:10.126250+0000 mon.b (mon.2) 40 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T13:53:11.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: audit 2021-03-10T13:53:10.127010+0000 mon.b (mon.2) 41 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T13:53:11.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: audit 2021-03-10T13:53:10.127674+0000 mon.b (mon.2) 42 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2021-03-10T13:53:11.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: cluster 2021-03-10T13:53:10.120941+0000 mon.a (mon.0) 620 : cluster [DBG] mgrmap e18: gibba020.yqfnwy(active, starting, since 0.0558209s), standbys: y, x 2021-03-10T13:53:11.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: audit 2021-03-10T13:53:10.123109+0000 mon.b (mon.2) 27 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mgr metadata", "who": "gibba020.yqfnwy", "id": "gibba020.yqfnwy"}]: dispatch 2021-03-10T13:53:11.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: audit 2021-03-10T13:53:10.123260+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T13:53:11.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: audit 2021-03-10T13:53:10.123383+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T13:53:11.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: audit 2021-03-10T13:53:10.123563+0000 mon.b (mon.2) 30 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:53:11.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: audit 2021-03-10T13:53:10.123813+0000 mon.b (mon.2) 31 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:53:11.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: audit 2021-03-10T13:53:10.124083+0000 mon.b (mon.2) 32 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:53:11.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: audit 2021-03-10T13:53:10.124369+0000 mon.b (mon.2) 33 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:53:11.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: audit 2021-03-10T13:53:10.124551+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:53:11.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: audit 2021-03-10T13:53:10.124737+0000 mon.b (mon.2) 35 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:53:11.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: audit 2021-03-10T13:53:10.125105+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:53:11.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: audit 2021-03-10T13:53:10.125272+0000 mon.b (mon.2) 37 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:53:11.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: audit 2021-03-10T13:53:10.125777+0000 mon.b (mon.2) 38 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T13:53:11.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: audit 2021-03-10T13:53:10.125908+0000 mon.b (mon.2) 39 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T13:53:11.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: audit 2021-03-10T13:53:10.126250+0000 mon.b (mon.2) 40 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T13:53:11.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: audit 2021-03-10T13:53:10.127010+0000 mon.b (mon.2) 41 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T13:53:11.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: audit 2021-03-10T13:53:10.127674+0000 mon.b (mon.2) 42 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2021-03-10T13:53:11.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: audit 2021-03-10T13:53:10.127915+0000 mon.b (mon.2) 43 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2021-03-10T13:53:11.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: audit 2021-03-10T13:53:10.128349+0000 mon.b (mon.2) 44 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba013"}]: dispatch 2021-03-10T13:53:11.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: audit 2021-03-10T13:53:10.128721+0000 mon.b (mon.2) 45 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba020"}]: dispatch 2021-03-10T13:53:11.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: audit 2021-03-10T13:53:10.129190+0000 mon.b (mon.2) 46 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2021-03-10T13:53:11.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: audit 2021-03-10T13:53:10.129550+0000 mon.b (mon.2) 47 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2021-03-10T13:53:11.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: audit 2021-03-10T13:53:10.129906+0000 mon.b (mon.2) 48 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2021-03-10T13:53:11.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: audit 2021-03-10T13:53:10.130173+0000 mon.b (mon.2) 49 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2021-03-10T13:53:11.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: audit 2021-03-10T13:53:10.130502+0000 mon.b (mon.2) 50 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2021-03-10T13:53:11.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: audit 2021-03-10T13:53:10.130664+0000 mon.b (mon.2) 51 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2021-03-10T13:53:11.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: audit 2021-03-10T13:53:10.130841+0000 mon.b (mon.2) 52 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2021-03-10T13:53:11.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: audit 2021-03-10T13:53:10.131001+0000 mon.b (mon.2) 53 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2021-03-10T13:53:11.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: audit 2021-03-10T13:53:10.131258+0000 mon.b (mon.2) 54 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2021-03-10T13:53:11.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: audit 2021-03-10T13:53:10.131504+0000 mon.b (mon.2) 55 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2021-03-10T13:53:11.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: audit 2021-03-10T13:53:10.131676+0000 mon.b (mon.2) 56 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2021-03-10T13:53:11.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: audit 2021-03-10T13:53:10.131815+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:53:11.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: audit 2021-03-10T13:53:10.131960+0000 mon.b (mon.2) 58 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:53:11.390 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: audit 2021-03-10T13:53:10.127915+0000 mon.b (mon.2) 43 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2021-03-10T13:53:11.390 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: audit 2021-03-10T13:53:10.128349+0000 mon.b (mon.2) 44 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba013"}]: dispatch 2021-03-10T13:53:11.390 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: audit 2021-03-10T13:53:10.128721+0000 mon.b (mon.2) 45 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba020"}]: dispatch 2021-03-10T13:53:11.390 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: audit 2021-03-10T13:53:10.129190+0000 mon.b (mon.2) 46 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2021-03-10T13:53:11.391 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: audit 2021-03-10T13:53:10.129550+0000 mon.b (mon.2) 47 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2021-03-10T13:53:11.391 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: audit 2021-03-10T13:53:10.129906+0000 mon.b (mon.2) 48 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2021-03-10T13:53:11.391 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: audit 2021-03-10T13:53:10.130173+0000 mon.b (mon.2) 49 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2021-03-10T13:53:11.391 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: audit 2021-03-10T13:53:10.130502+0000 mon.b (mon.2) 50 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2021-03-10T13:53:11.391 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: audit 2021-03-10T13:53:10.130664+0000 mon.b (mon.2) 51 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2021-03-10T13:53:11.392 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: audit 2021-03-10T13:53:10.130841+0000 mon.b (mon.2) 52 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2021-03-10T13:53:11.392 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: audit 2021-03-10T13:53:10.131001+0000 mon.b (mon.2) 53 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2021-03-10T13:53:11.392 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: audit 2021-03-10T13:53:10.131258+0000 mon.b (mon.2) 54 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2021-03-10T13:53:11.392 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: audit 2021-03-10T13:53:10.131504+0000 mon.b (mon.2) 55 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2021-03-10T13:53:11.393 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: audit 2021-03-10T13:53:10.131676+0000 mon.b (mon.2) 56 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2021-03-10T13:53:11.393 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: audit 2021-03-10T13:53:10.131815+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:53:11.393 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: audit 2021-03-10T13:53:10.131960+0000 mon.b (mon.2) 58 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:53:11.393 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: audit 2021-03-10T13:53:10.132254+0000 mon.b (mon.2) 59 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2021-03-10T13:53:11.394 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: audit 2021-03-10T13:53:10.132462+0000 mon.b (mon.2) 60 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2021-03-10T13:53:11.394 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: audit 2021-03-10T13:53:10.132605+0000 mon.b (mon.2) 61 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-03-10T13:53:11.394 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: audit 2021-03-10T13:53:10.132775+0000 mon.b (mon.2) 62 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-03-10T13:53:11.394 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: cluster 2021-03-10T13:53:10.615549+0000 mon.a (mon.0) 621 : cluster [DBG] Standby manager daemon y restarted 2021-03-10T13:53:11.395 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: cluster 2021-03-10T13:53:10.615640+0000 mon.a (mon.0) 622 : cluster [DBG] Standby manager daemon y started 2021-03-10T13:53:11.395 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: audit 2021-03-10T13:53:10.616274+0000 mon.c (mon.1) 19 : audit [DBG] from='mgr.? 172.21.2.113:0/2385446846' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:53:11.395 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: audit 2021-03-10T13:53:10.617183+0000 mon.c (mon.1) 20 : audit [DBG] from='mgr.? 172.21.2.113:0/2385446846' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:53:11.395 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: cluster 2021-03-10T13:53:11.105146+0000 mon.a (mon.0) 623 : cluster [INF] Manager daemon gibba020.yqfnwy is now available 2021-03-10T13:53:11.395 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: audit 2021-03-10T13:53:11.108904+0000 mon.b (mon.2) 63 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:53:11.396 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: audit 2021-03-10T13:53:11.113043+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:53:11.396 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[13024]: audit 2021-03-10T13:53:11.122287+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T13:53:11.396 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: audit 2021-03-10T13:53:10.132254+0000 mon.b (mon.2) 59 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2021-03-10T13:53:11.396 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: audit 2021-03-10T13:53:10.132462+0000 mon.b (mon.2) 60 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2021-03-10T13:53:11.397 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: audit 2021-03-10T13:53:10.132605+0000 mon.b (mon.2) 61 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-03-10T13:53:11.397 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: audit 2021-03-10T13:53:10.132775+0000 mon.b (mon.2) 62 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-03-10T13:53:11.397 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: cluster 2021-03-10T13:53:10.615549+0000 mon.a (mon.0) 621 : cluster [DBG] Standby manager daemon y restarted 2021-03-10T13:53:11.397 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: cluster 2021-03-10T13:53:10.615640+0000 mon.a (mon.0) 622 : cluster [DBG] Standby manager daemon y started 2021-03-10T13:53:11.397 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: audit 2021-03-10T13:53:10.616274+0000 mon.c (mon.1) 19 : audit [DBG] from='mgr.? 172.21.2.113:0/2385446846' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:53:11.398 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: audit 2021-03-10T13:53:10.617183+0000 mon.c (mon.1) 20 : audit [DBG] from='mgr.? 172.21.2.113:0/2385446846' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:53:11.398 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: cluster 2021-03-10T13:53:11.105146+0000 mon.a (mon.0) 623 : cluster [INF] Manager daemon gibba020.yqfnwy is now available 2021-03-10T13:53:11.398 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: audit 2021-03-10T13:53:11.108904+0000 mon.b (mon.2) 63 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:53:11.398 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: audit 2021-03-10T13:53:11.113043+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:53:11.399 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:11 gibba013 bash[9767]: audit 2021-03-10T13:53:11.122287+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T13:53:11.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: cluster 2021-03-10T13:53:10.120941+0000 mon.a (mon.0) 620 : cluster [DBG] mgrmap e18: gibba020.yqfnwy(active, starting, since 0.0558209s), standbys: y, x 2021-03-10T13:53:11.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: audit 2021-03-10T13:53:10.123109+0000 mon.b (mon.2) 27 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mgr metadata", "who": "gibba020.yqfnwy", "id": "gibba020.yqfnwy"}]: dispatch 2021-03-10T13:53:11.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: audit 2021-03-10T13:53:10.123260+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T13:53:11.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: audit 2021-03-10T13:53:10.123383+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T13:53:11.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: audit 2021-03-10T13:53:10.123563+0000 mon.b (mon.2) 30 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:53:11.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: audit 2021-03-10T13:53:10.123813+0000 mon.b (mon.2) 31 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:53:11.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: audit 2021-03-10T13:53:10.124083+0000 mon.b (mon.2) 32 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:53:11.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: audit 2021-03-10T13:53:10.124369+0000 mon.b (mon.2) 33 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:53:11.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: audit 2021-03-10T13:53:10.124551+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:53:11.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: audit 2021-03-10T13:53:10.124737+0000 mon.b (mon.2) 35 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:53:11.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: audit 2021-03-10T13:53:10.125105+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:53:11.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: audit 2021-03-10T13:53:10.125272+0000 mon.b (mon.2) 37 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:53:11.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: audit 2021-03-10T13:53:10.125777+0000 mon.b (mon.2) 38 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T13:53:11.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: audit 2021-03-10T13:53:10.125908+0000 mon.b (mon.2) 39 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T13:53:11.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: audit 2021-03-10T13:53:10.126250+0000 mon.b (mon.2) 40 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T13:53:11.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: audit 2021-03-10T13:53:10.127010+0000 mon.b (mon.2) 41 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T13:53:11.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: audit 2021-03-10T13:53:10.127674+0000 mon.b (mon.2) 42 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2021-03-10T13:53:11.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: audit 2021-03-10T13:53:10.127915+0000 mon.b (mon.2) 43 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2021-03-10T13:53:11.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: audit 2021-03-10T13:53:10.128349+0000 mon.b (mon.2) 44 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba013"}]: dispatch 2021-03-10T13:53:11.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: audit 2021-03-10T13:53:10.128721+0000 mon.b (mon.2) 45 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba020"}]: dispatch 2021-03-10T13:53:11.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: audit 2021-03-10T13:53:10.129190+0000 mon.b (mon.2) 46 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2021-03-10T13:53:11.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: audit 2021-03-10T13:53:10.129550+0000 mon.b (mon.2) 47 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2021-03-10T13:53:11.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: audit 2021-03-10T13:53:10.129906+0000 mon.b (mon.2) 48 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2021-03-10T13:53:11.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: audit 2021-03-10T13:53:10.130173+0000 mon.b (mon.2) 49 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2021-03-10T13:53:11.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: audit 2021-03-10T13:53:10.130502+0000 mon.b (mon.2) 50 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2021-03-10T13:53:11.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: audit 2021-03-10T13:53:10.130664+0000 mon.b (mon.2) 51 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2021-03-10T13:53:11.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: audit 2021-03-10T13:53:10.130841+0000 mon.b (mon.2) 52 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2021-03-10T13:53:11.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: audit 2021-03-10T13:53:10.131001+0000 mon.b (mon.2) 53 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2021-03-10T13:53:11.456 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: audit 2021-03-10T13:53:10.131258+0000 mon.b (mon.2) 54 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2021-03-10T13:53:11.456 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: audit 2021-03-10T13:53:10.131504+0000 mon.b (mon.2) 55 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2021-03-10T13:53:11.456 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: audit 2021-03-10T13:53:10.131676+0000 mon.b (mon.2) 56 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2021-03-10T13:53:11.456 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: audit 2021-03-10T13:53:10.131815+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:53:11.456 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: audit 2021-03-10T13:53:10.131960+0000 mon.b (mon.2) 58 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:53:11.457 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: audit 2021-03-10T13:53:10.132254+0000 mon.b (mon.2) 59 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2021-03-10T13:53:11.457 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: audit 2021-03-10T13:53:10.132462+0000 mon.b (mon.2) 60 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2021-03-10T13:53:11.457 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: audit 2021-03-10T13:53:10.132605+0000 mon.b (mon.2) 61 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-03-10T13:53:11.457 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: audit 2021-03-10T13:53:10.132775+0000 mon.b (mon.2) 62 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-03-10T13:53:11.457 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: cluster 2021-03-10T13:53:10.615549+0000 mon.a (mon.0) 621 : cluster [DBG] Standby manager daemon y restarted 2021-03-10T13:53:11.458 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: cluster 2021-03-10T13:53:10.615640+0000 mon.a (mon.0) 622 : cluster [DBG] Standby manager daemon y started 2021-03-10T13:53:11.458 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: audit 2021-03-10T13:53:10.616274+0000 mon.c (mon.1) 19 : audit [DBG] from='mgr.? 172.21.2.113:0/2385446846' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:53:11.458 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: audit 2021-03-10T13:53:10.617183+0000 mon.c (mon.1) 20 : audit [DBG] from='mgr.? 172.21.2.113:0/2385446846' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:53:11.458 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: cluster 2021-03-10T13:53:11.105146+0000 mon.a (mon.0) 623 : cluster [INF] Manager daemon gibba020.yqfnwy is now available 2021-03-10T13:53:11.459 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: audit 2021-03-10T13:53:11.108904+0000 mon.b (mon.2) 63 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:53:11.459 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: audit 2021-03-10T13:53:11.113043+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:53:11.459 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:11 gibba020 bash[9782]: audit 2021-03-10T13:53:11.122287+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T13:53:12.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:12 gibba013 bash[9767]: cephadm 2021-03-10T13:53:11.121193+0000 mgr.gibba020.yqfnwy (mgr.34391) 2 : cephadm [INF] Migrating to explicit placement 2021-03-10T13:53:12.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:12 gibba013 bash[9767]: audit 2021-03-10T13:53:11.121772+0000 mon.b (mon.2) 64 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:53:11.121203Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba013=y\", \"gibba020=x\", \"gibba020=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T13:53:12.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:12 gibba013 bash[9767]: audit 2021-03-10T13:53:11.124994+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:53:11.121203Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba013=y\", \"gibba020=x\", \"gibba020=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T13:53:12.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:12 gibba013 bash[9767]: audit 2021-03-10T13:53:11.132814+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:53:11.121203Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba013=y\", \"gibba020=x\", \"gibba020=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]': finished 2021-03-10T13:53:12.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:12 gibba013 bash[9767]: cluster 2021-03-10T13:53:11.133175+0000 mon.a (mon.0) 628 : cluster [DBG] mgrmap e19: gibba020.yqfnwy(active, since 1.06806s), standbys: y, x 2021-03-10T13:53:12.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:12 gibba013 bash[9767]: audit 2021-03-10T13:53:11.134539+0000 mon.b (mon.2) 65 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:53:12.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:12 gibba013 bash[9767]: cluster 2021-03-10T13:53:11.135145+0000 mgr.gibba020.yqfnwy (mgr.34391) 3 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:12.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:12 gibba013 bash[9767]: audit 2021-03-10T13:53:11.137837+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:53:12.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:12 gibba013 bash[9767]: audit 2021-03-10T13:53:11.140860+0000 mon.b (mon.2) 66 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:53:12.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:12 gibba013 bash[9767]: audit 2021-03-10T13:53:11.141578+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T13:53:12.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:12 gibba013 bash[9767]: audit 2021-03-10T13:53:11.144206+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:53:12.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:12 gibba013 bash[9767]: audit 2021-03-10T13:53:11.147655+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T13:53:12.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:12 gibba013 bash[9767]: audit 2021-03-10T13:53:11.224957+0000 mon.b (mon.2) 67 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:53:12.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:12 gibba013 bash[9767]: audit 2021-03-10T13:53:11.246879+0000 mon.b (mon.2) 68 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:53:12.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:12 gibba013 bash[13024]: cephadm 2021-03-10T13:53:11.121193+0000 mgr.gibba020.yqfnwy (mgr.34391) 2 : cephadm [INF] Migrating to explicit placement 2021-03-10T13:53:12.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:12 gibba013 bash[13024]: audit 2021-03-10T13:53:11.121772+0000 mon.b (mon.2) 64 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:53:11.121203Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba013=y\", \"gibba020=x\", \"gibba020=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T13:53:12.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:12 gibba013 bash[13024]: audit 2021-03-10T13:53:11.124994+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:53:11.121203Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba013=y\", \"gibba020=x\", \"gibba020=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T13:53:12.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:12 gibba013 bash[13024]: audit 2021-03-10T13:53:11.132814+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:53:11.121203Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba013=y\", \"gibba020=x\", \"gibba020=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]': finished 2021-03-10T13:53:12.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:12 gibba013 bash[13024]: cluster 2021-03-10T13:53:11.133175+0000 mon.a (mon.0) 628 : cluster [DBG] mgrmap e19: gibba020.yqfnwy(active, since 1.06806s), standbys: y, x 2021-03-10T13:53:12.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:12 gibba013 bash[13024]: audit 2021-03-10T13:53:11.134539+0000 mon.b (mon.2) 65 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:53:12.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:12 gibba013 bash[13024]: cluster 2021-03-10T13:53:11.135145+0000 mgr.gibba020.yqfnwy (mgr.34391) 3 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:12.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:12 gibba013 bash[13024]: audit 2021-03-10T13:53:11.137837+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:53:12.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:12 gibba013 bash[13024]: audit 2021-03-10T13:53:11.140860+0000 mon.b (mon.2) 66 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:53:12.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:12 gibba013 bash[13024]: audit 2021-03-10T13:53:11.141578+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T13:53:12.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:12 gibba013 bash[13024]: audit 2021-03-10T13:53:11.144206+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:53:12.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:12 gibba013 bash[13024]: audit 2021-03-10T13:53:11.147655+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T13:53:12.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:12 gibba013 bash[13024]: audit 2021-03-10T13:53:11.224957+0000 mon.b (mon.2) 67 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:53:12.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:12 gibba013 bash[13024]: audit 2021-03-10T13:53:11.246879+0000 mon.b (mon.2) 68 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:53:12.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:12 gibba013 bash[9767]: audit 2021-03-10T13:53:11.250918+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:53:12.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:12 gibba013 bash[9767]: audit 2021-03-10T13:53:11.263965+0000 mon.b (mon.2) 69 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T13:53:12.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:12 gibba013 bash[9767]: audit 2021-03-10T13:53:11.267386+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T13:53:12.387 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:12 gibba013 bash[9767]: debug 2021-03-10T13:53:12.132+0000 7f78c10ae700 -1 log_channel(cluster) log [ERR] : Health check failed: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) (MGR_MODULE_ERROR) 2021-03-10T13:53:12.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:12 gibba013 bash[13024]: audit 2021-03-10T13:53:11.250918+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:53:12.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:12 gibba013 bash[13024]: audit 2021-03-10T13:53:11.263965+0000 mon.b (mon.2) 69 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T13:53:12.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:12 gibba013 bash[13024]: audit 2021-03-10T13:53:11.267386+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T13:53:12.388 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:12 gibba020 bash[9782]: cephadm 2021-03-10T13:53:11.121193+0000 mgr.gibba020.yqfnwy (mgr.34391) 2 : cephadm [INF] Migrating to explicit placement 2021-03-10T13:53:12.389 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:12 gibba020 bash[9782]: audit 2021-03-10T13:53:11.121772+0000 mon.b (mon.2) 64 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:53:11.121203Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba013=y\", \"gibba020=x\", \"gibba020=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T13:53:12.389 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:12 gibba020 bash[9782]: audit 2021-03-10T13:53:11.124994+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:53:11.121203Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba013=y\", \"gibba020=x\", \"gibba020=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T13:53:12.389 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:12 gibba020 bash[9782]: audit 2021-03-10T13:53:11.132814+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T13:53:11.121203Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba013=y\", \"gibba020=x\", \"gibba020=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]': finished 2021-03-10T13:53:12.389 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:12 gibba020 bash[9782]: cluster 2021-03-10T13:53:11.133175+0000 mon.a (mon.0) 628 : cluster [DBG] mgrmap e19: gibba020.yqfnwy(active, since 1.06806s), standbys: y, x 2021-03-10T13:53:12.389 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:12 gibba020 bash[9782]: audit 2021-03-10T13:53:11.134539+0000 mon.b (mon.2) 65 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:53:12.390 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:12 gibba020 bash[9782]: cluster 2021-03-10T13:53:11.135145+0000 mgr.gibba020.yqfnwy (mgr.34391) 3 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:12.390 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:12 gibba020 bash[9782]: audit 2021-03-10T13:53:11.137837+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:53:12.390 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:12 gibba020 bash[9782]: audit 2021-03-10T13:53:11.140860+0000 mon.b (mon.2) 66 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:53:12.390 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:12 gibba020 bash[9782]: audit 2021-03-10T13:53:11.141578+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T13:53:12.391 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:12 gibba020 bash[9782]: audit 2021-03-10T13:53:11.144206+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T13:53:12.391 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:12 gibba020 bash[9782]: audit 2021-03-10T13:53:11.147655+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T13:53:12.391 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:12 gibba020 bash[9782]: audit 2021-03-10T13:53:11.224957+0000 mon.b (mon.2) 67 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:53:12.391 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:12 gibba020 bash[9782]: audit 2021-03-10T13:53:11.246879+0000 mon.b (mon.2) 68 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:53:12.391 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:12 gibba020 bash[9782]: audit 2021-03-10T13:53:11.250918+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:53:12.391 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:12 gibba020 bash[9782]: audit 2021-03-10T13:53:11.263965+0000 mon.b (mon.2) 69 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T13:53:12.392 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:12 gibba020 bash[9782]: audit 2021-03-10T13:53:11.267386+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T13:53:13.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:13 gibba013 bash[13024]: cluster 2021-03-10T13:53:12.126445+0000 mgr.gibba020.yqfnwy (mgr.34391) 4 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:13.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:13 gibba013 bash[13024]: cluster 2021-03-10T13:53:12.137136+0000 mon.a (mon.0) 635 : cluster [ERR] Health check failed: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) (MGR_MODULE_ERROR) 2021-03-10T13:53:13.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:13 gibba013 bash[13024]: cluster 2021-03-10T13:53:12.149473+0000 mon.a (mon.0) 636 : cluster [DBG] mgrmap e20: gibba020.yqfnwy(active, since 2s), standbys: y, x 2021-03-10T13:53:13.387 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:13 gibba013 bash[9767]: cluster 2021-03-10T13:53:12.126445+0000 mgr.gibba020.yqfnwy (mgr.34391) 4 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:13.387 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:13 gibba013 bash[9767]: cluster 2021-03-10T13:53:12.137136+0000 mon.a (mon.0) 635 : cluster [ERR] Health check failed: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) (MGR_MODULE_ERROR) 2021-03-10T13:53:13.387 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:13 gibba013 bash[9767]: cluster 2021-03-10T13:53:12.149473+0000 mon.a (mon.0) 636 : cluster [DBG] mgrmap e20: gibba020.yqfnwy(active, since 2s), standbys: y, x 2021-03-10T13:53:13.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:13 gibba020 bash[9782]: cluster 2021-03-10T13:53:12.126445+0000 mgr.gibba020.yqfnwy (mgr.34391) 4 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:13.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:13 gibba020 bash[9782]: cluster 2021-03-10T13:53:12.137136+0000 mon.a (mon.0) 635 : cluster [ERR] Health check failed: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) (MGR_MODULE_ERROR) 2021-03-10T13:53:13.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:13 gibba020 bash[9782]: cluster 2021-03-10T13:53:12.149473+0000 mon.a (mon.0) 636 : cluster [DBG] mgrmap e20: gibba020.yqfnwy(active, since 2s), standbys: y, x 2021-03-10T13:53:14.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:14 gibba020 bash[9782]: cluster 2021-03-10T13:53:12.386482+0000 mgr.gibba020.yqfnwy (mgr.34391) 5 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba020.yqfnwy: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:53:14.506 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:14 gibba013 bash[9767]: cluster 2021-03-10T13:53:12.386482+0000 mgr.gibba020.yqfnwy (mgr.34391) 5 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba020.yqfnwy: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:53:14.506 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:14 gibba013 bash[13024]: cluster 2021-03-10T13:53:12.386482+0000 mgr.gibba020.yqfnwy (mgr.34391) 5 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba020.yqfnwy: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:53:15.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:15 gibba020 bash[9782]: cluster 2021-03-10T13:53:14.127575+0000 mgr.gibba020.yqfnwy (mgr.34391) 6 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:15.463 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:15 gibba013 bash[9767]: cluster 2021-03-10T13:53:14.127575+0000 mgr.gibba020.yqfnwy (mgr.34391) 6 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:15.464 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:15 gibba013 bash[13024]: cluster 2021-03-10T13:53:14.127575+0000 mgr.gibba020.yqfnwy (mgr.34391) 6 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:16.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:16 gibba020 bash[9782]: cluster 2021-03-10T13:53:16.128729+0000 mgr.gibba020.yqfnwy (mgr.34391) 7 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:16.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:16 gibba020 bash[9782]: audit 2021-03-10T13:53:16.217280+0000 mon.b (mon.2) 70 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config set", "name": "container_image", "value": "ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60", "who": "global"}]: dispatch 2021-03-10T13:53:16.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:16 gibba020 bash[9782]: audit 2021-03-10T13:53:16.221437+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config set", "name": "container_image", "value": "ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60", "who": "global"}]: dispatch 2021-03-10T13:53:16.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:16 gibba020 bash[9782]: audit 2021-03-10T13:53:16.226102+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config set", "name": "container_image", "value": "ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60", "who": "global"}]': finished 2021-03-10T13:53:16.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:16 gibba020 bash[9782]: audit 2021-03-10T13:53:16.229027+0000 mon.b (mon.2) 71 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.gibba020.yqfnwy"}]: dispatch 2021-03-10T13:53:16.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:16 gibba020 bash[9782]: audit 2021-03-10T13:53:16.232541+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.gibba020.yqfnwy"}]: dispatch 2021-03-10T13:53:16.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:16 gibba020 bash[9782]: audit 2021-03-10T13:53:16.234318+0000 mon.b (mon.2) 72 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.x"}]: dispatch 2021-03-10T13:53:16.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:16 gibba020 bash[9782]: audit 2021-03-10T13:53:16.235665+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.gibba020.yqfnwy"}]': finished 2021-03-10T13:53:16.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:16 gibba020 bash[9782]: audit 2021-03-10T13:53:16.237816+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.x"}]: dispatch 2021-03-10T13:53:16.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:16 gibba020 bash[9782]: audit 2021-03-10T13:53:16.239514+0000 mon.b (mon.2) 73 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:53:16.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:16 gibba020 bash[9782]: audit 2021-03-10T13:53:16.241012+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.x"}]': finished 2021-03-10T13:53:16.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:16 gibba020 bash[9782]: audit 2021-03-10T13:53:16.413561+0000 mon.b (mon.2) 74 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:53:17.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:16 gibba013 bash[9767]: cluster 2021-03-10T13:53:16.128729+0000 mgr.gibba020.yqfnwy (mgr.34391) 7 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:17.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:16 gibba013 bash[9767]: audit 2021-03-10T13:53:16.217280+0000 mon.b (mon.2) 70 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config set", "name": "container_image", "value": "ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60", "who": "global"}]: dispatch 2021-03-10T13:53:17.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:16 gibba013 bash[9767]: audit 2021-03-10T13:53:16.221437+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config set", "name": "container_image", "value": "ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60", "who": "global"}]: dispatch 2021-03-10T13:53:17.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:16 gibba013 bash[9767]: audit 2021-03-10T13:53:16.226102+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config set", "name": "container_image", "value": "ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60", "who": "global"}]': finished 2021-03-10T13:53:17.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:16 gibba013 bash[9767]: audit 2021-03-10T13:53:16.229027+0000 mon.b (mon.2) 71 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.gibba020.yqfnwy"}]: dispatch 2021-03-10T13:53:17.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:16 gibba013 bash[9767]: audit 2021-03-10T13:53:16.232541+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.gibba020.yqfnwy"}]: dispatch 2021-03-10T13:53:17.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:16 gibba013 bash[9767]: audit 2021-03-10T13:53:16.234318+0000 mon.b (mon.2) 72 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.x"}]: dispatch 2021-03-10T13:53:17.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:16 gibba013 bash[9767]: audit 2021-03-10T13:53:16.235665+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.gibba020.yqfnwy"}]': finished 2021-03-10T13:53:17.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:16 gibba013 bash[9767]: audit 2021-03-10T13:53:16.237816+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.x"}]: dispatch 2021-03-10T13:53:17.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:16 gibba013 bash[9767]: audit 2021-03-10T13:53:16.239514+0000 mon.b (mon.2) 73 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:53:17.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:16 gibba013 bash[9767]: audit 2021-03-10T13:53:16.241012+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.x"}]': finished 2021-03-10T13:53:17.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:16 gibba013 bash[9767]: audit 2021-03-10T13:53:16.413561+0000 mon.b (mon.2) 74 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:53:17.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:16 gibba013 bash[13024]: cluster 2021-03-10T13:53:16.128729+0000 mgr.gibba020.yqfnwy (mgr.34391) 7 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:17.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:16 gibba013 bash[13024]: audit 2021-03-10T13:53:16.217280+0000 mon.b (mon.2) 70 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config set", "name": "container_image", "value": "ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60", "who": "global"}]: dispatch 2021-03-10T13:53:17.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:16 gibba013 bash[13024]: audit 2021-03-10T13:53:16.221437+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config set", "name": "container_image", "value": "ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60", "who": "global"}]: dispatch 2021-03-10T13:53:17.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:16 gibba013 bash[13024]: audit 2021-03-10T13:53:16.226102+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config set", "name": "container_image", "value": "ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60", "who": "global"}]': finished 2021-03-10T13:53:17.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:16 gibba013 bash[13024]: audit 2021-03-10T13:53:16.229027+0000 mon.b (mon.2) 71 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.gibba020.yqfnwy"}]: dispatch 2021-03-10T13:53:17.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:16 gibba013 bash[13024]: audit 2021-03-10T13:53:16.232541+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.gibba020.yqfnwy"}]: dispatch 2021-03-10T13:53:17.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:16 gibba013 bash[13024]: audit 2021-03-10T13:53:16.234318+0000 mon.b (mon.2) 72 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.x"}]: dispatch 2021-03-10T13:53:17.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:16 gibba013 bash[13024]: audit 2021-03-10T13:53:16.235665+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.gibba020.yqfnwy"}]': finished 2021-03-10T13:53:17.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:16 gibba013 bash[13024]: audit 2021-03-10T13:53:16.237816+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.x"}]: dispatch 2021-03-10T13:53:17.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:16 gibba013 bash[13024]: audit 2021-03-10T13:53:16.239514+0000 mon.b (mon.2) 73 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:53:17.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:16 gibba013 bash[13024]: audit 2021-03-10T13:53:16.241012+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.x"}]': finished 2021-03-10T13:53:17.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:16 gibba013 bash[13024]: audit 2021-03-10T13:53:16.413561+0000 mon.b (mon.2) 74 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:53:19.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:19 gibba020 bash[9782]: cluster 2021-03-10T13:53:18.131028+0000 mgr.gibba020.yqfnwy (mgr.34391) 8 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:19.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:19 gibba013 bash[9767]: cluster 2021-03-10T13:53:18.131028+0000 mgr.gibba020.yqfnwy (mgr.34391) 8 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:19.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:19 gibba013 bash[13024]: cluster 2021-03-10T13:53:18.131028+0000 mgr.gibba020.yqfnwy (mgr.34391) 8 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:20.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:20 gibba020 bash[9782]: audit 2021-03-10T13:53:19.720107+0000 mon.b (mon.2) 75 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307442483, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718425Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:43:01.306356Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a890668984ec\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12740198, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719109Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:48:27.713709Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:48:20.868189Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:19.719207Z\", \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:53:20.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:20 gibba020 bash[9782]: audit 2021-03-10T13:53:19.723823+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307442483, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718425Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:43:01.306356Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a890668984ec\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12740198, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719109Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:48:27.713709Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:48:20.868189Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:19.719207Z\", \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:53:20.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:20 gibba020 bash[9782]: audit 2021-03-10T13:53:19.726885+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307442483, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718425Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:43:01.306356Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a890668984ec\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12740198, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719109Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:48:27.713709Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:48:20.868189Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:19.719207Z\", \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T13:53:20.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:20 gibba013 bash[9767]: audit 2021-03-10T13:53:19.720107+0000 mon.b (mon.2) 75 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307442483, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718425Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:43:01.306356Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a890668984ec\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12740198, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719109Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:48:27.713709Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:48:20.868189Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:19.719207Z\", \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:53:20.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:20 gibba013 bash[13024]: audit 2021-03-10T13:53:19.720107+0000 mon.b (mon.2) 75 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307442483, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718425Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:43:01.306356Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a890668984ec\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12740198, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719109Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:48:27.713709Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:48:20.868189Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:19.719207Z\", \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:53:20.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:20 gibba013 bash[9767]: audit 2021-03-10T13:53:19.723823+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307442483, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718425Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:43:01.306356Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a890668984ec\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12740198, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719109Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:48:27.713709Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:48:20.868189Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:19.719207Z\", \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:53:20.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:20 gibba013 bash[9767]: audit 2021-03-10T13:53:19.726885+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307442483, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718425Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:43:01.306356Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a890668984ec\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12740198, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719109Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:48:27.713709Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:48:20.868189Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:19.719207Z\", \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T13:53:20.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:20 gibba013 bash[13024]: audit 2021-03-10T13:53:19.723823+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307442483, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718425Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:43:01.306356Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a890668984ec\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12740198, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719109Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:48:27.713709Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:48:20.868189Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:19.719207Z\", \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:53:20.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:20 gibba013 bash[13024]: audit 2021-03-10T13:53:19.726885+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307442483, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718425Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:43:01.306356Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a890668984ec\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12740198, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719109Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:48:27.713709Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:48:20.868189Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:19.719207Z\", \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T13:53:20.878 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T13:53:21.109 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:53:21.109 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (4m) 1s ago 5m 0.21.0 prom/alertmanager c876f5897d7b a890668984ec 2021-03-10T13:53:21.109 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (5m) 0s ago 5m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T13:53:21.110 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (15s) 0s ago 8m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T13:53:21.110 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (33s) 0s ago 8m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T13:53:21.110 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (10m) 1s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 aff9dae2208b 2021-03-10T13:53:21.110 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (10m) 1s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 02bb13cc8f40 2021-03-10T13:53:21.111 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (9m) 0s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a58fc42cd46b 2021-03-10T13:53:21.111 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (9m) 1s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 c561d31798a4 2021-03-10T13:53:21.111 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (5m) 1s ago 5m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T13:53:21.111 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (5m) 0s ago 5m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T13:53:21.111 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (8m) 1s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 bf4441d660ac 2021-03-10T13:53:21.112 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (8m) 1s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 385800e8f97f 2021-03-10T13:53:21.112 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (7m) 1s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d0a99b0fd1fc 2021-03-10T13:53:21.112 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (7m) 1s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d0b507f36a88 2021-03-10T13:53:21.112 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (6m) 0s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5bcc0da1a794 2021-03-10T13:53:21.112 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (6m) 0s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 8e0d292ca03b 2021-03-10T13:53:21.112 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (6m) 0s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b54758e37be1 2021-03-10T13:53:21.113 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (5m) 0s ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 75c9ee8106fc 2021-03-10T13:53:21.113 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (4m) 0s ago 5m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T13:53:21.113 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 0s ago 3m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:53:21.359 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T13:53:21.359 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T13:53:21.359 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2021-03-10T13:53:21.360 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:53:21.360 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T13:53:21.360 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 1, 2021-03-10T13:53:21.360 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 2 2021-03-10T13:53:21.360 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:53:21.360 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T13:53:21.361 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2021-03-10T13:53:21.361 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:53:21.361 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T13:53:21.361 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T13:53:21.361 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 12, 2021-03-10T13:53:21.362 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 2 2021-03-10T13:53:21.362 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T13:53:21.362 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T13:53:21.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:21 gibba013 bash[9767]: cephadm 2021-03-10T13:53:19.724371+0000 mgr.gibba020.yqfnwy (mgr.34391) 9 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T13:53:21.642 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:21 gibba013 bash[9767]: cluster 2021-03-10T13:53:20.131441+0000 mgr.gibba020.yqfnwy (mgr.34391) 10 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:21.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:21 gibba013 bash[13024]: cephadm 2021-03-10T13:53:19.724371+0000 mgr.gibba020.yqfnwy (mgr.34391) 9 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T13:53:21.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:21 gibba013 bash[13024]: cluster 2021-03-10T13:53:20.131441+0000 mgr.gibba020.yqfnwy (mgr.34391) 10 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:21.643 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:21 gibba013 bash[9767]: audit 2021-03-10T13:53:20.478248+0000 mon.b (mon.2) 76 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101607014, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475677Z\", \"created\": \"2021-03-10T13:44:20.530781Z\", \"started\": \"2021-03-10T13:44:20.552250Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba020\", \"container_id\": \"7268fb51c46b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371720192, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475817Z\", \"created\": \"2021-03-10T13:44:37.234781Z\", \"started\": \"2021-03-10T13:52:47.791424Z\"}, \"mgr.gibba020.yqfnwy\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba020.yqfnwy\", \"hostname\": \"gibba020\", \"container_id\": \"24f623ad250b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 401394892, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475899Z\", \"created\": \"2021-03-10T13:44:39.550781Z\", \"started\": \"2021-03-10T13:53:05.133311Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48276439, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475985Z\", \"created\": \"2021-03-10T13:46:23.866010Z\", \"started\": \"2021-03-10T13:46:27.049069Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47185920, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476192Z\", \"created\": \"2021-03-10T13:46:46.746011Z\", \"started\": \"2021-03-10T13:46:49.913581Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46231715, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476360Z\", \"created\": \"2021-03-10T13:47:09.378011Z\", \"started\": \"2021-03-10T13:47:12.839725Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476523Z\", \"created\": \"2021-03-10T13:47:32.870012Z\", \"started\": \"2021-03-10T13:47:36.592939Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 31362908, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476685Z\", \"created\": \"2021-03-10T13:47:55.226012Z\", \"started\": \"2021-03-10T13:48:34.834688Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 26235371, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476768Z\", \"created\": \"2021-03-10T13:47:56.326012Z\", \"started\": \"2021-03-10T13:47:58.273150Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31771852, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476844Z\", \"created\": \"2021-03-10T13:48:18.782012Z\", \"started\": \"2021-03-10T13:48:18.806617Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476919Z\", \"created\": \"2021-03-10T13:50:00.050014Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086Z\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:52.338810Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:20.477018Z\", \"last_device_update\": \"2021-03-10T13:47:41.483965Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:53:21.644 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:21 gibba013 bash[13024]: audit 2021-03-10T13:53:20.478248+0000 mon.b (mon.2) 76 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101607014, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475677Z\", \"created\": \"2021-03-10T13:44:20.530781Z\", \"started\": \"2021-03-10T13:44:20.552250Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba020\", \"container_id\": \"7268fb51c46b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371720192, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475817Z\", \"created\": \"2021-03-10T13:44:37.234781Z\", \"started\": \"2021-03-10T13:52:47.791424Z\"}, \"mgr.gibba020.yqfnwy\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba020.yqfnwy\", \"hostname\": \"gibba020\", \"container_id\": \"24f623ad250b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 401394892, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475899Z\", \"created\": \"2021-03-10T13:44:39.550781Z\", \"started\": \"2021-03-10T13:53:05.133311Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48276439, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475985Z\", \"created\": \"2021-03-10T13:46:23.866010Z\", \"started\": \"2021-03-10T13:46:27.049069Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47185920, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476192Z\", \"created\": \"2021-03-10T13:46:46.746011Z\", \"started\": \"2021-03-10T13:46:49.913581Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46231715, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476360Z\", \"created\": \"2021-03-10T13:47:09.378011Z\", \"started\": \"2021-03-10T13:47:12.839725Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476523Z\", \"created\": \"2021-03-10T13:47:32.870012Z\", \"started\": \"2021-03-10T13:47:36.592939Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 31362908, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476685Z\", \"created\": \"2021-03-10T13:47:55.226012Z\", \"started\": \"2021-03-10T13:48:34.834688Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 26235371, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476768Z\", \"created\": \"2021-03-10T13:47:56.326012Z\", \"started\": \"2021-03-10T13:47:58.273150Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31771852, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476844Z\", \"created\": \"2021-03-10T13:48:18.782012Z\", \"started\": \"2021-03-10T13:48:18.806617Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476919Z\", \"created\": \"2021-03-10T13:50:00.050014Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086Z\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:52.338810Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:20.477018Z\", \"last_device_update\": \"2021-03-10T13:47:41.483965Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:53:21.644 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:21 gibba013 bash[9767]: audit 2021-03-10T13:53:20.483220+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101607014, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475677Z\", \"created\": \"2021-03-10T13:44:20.530781Z\", \"started\": \"2021-03-10T13:44:20.552250Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba020\", \"container_id\": \"7268fb51c46b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371720192, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475817Z\", \"created\": \"2021-03-10T13:44:37.234781Z\", \"started\": \"2021-03-10T13:52:47.791424Z\"}, \"mgr.gibba020.yqfnwy\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba020.yqfnwy\", \"hostname\": \"gibba020\", \"container_id\": \"24f623ad250b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 401394892, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475899Z\", \"created\": \"2021-03-10T13:44:39.550781Z\", \"started\": \"2021-03-10T13:53:05.133311Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48276439, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475985Z\", \"created\": \"2021-03-10T13:46:23.866010Z\", \"started\": \"2021-03-10T13:46:27.049069Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47185920, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476192Z\", \"created\": \"2021-03-10T13:46:46.746011Z\", \"started\": \"2021-03-10T13:46:49.913581Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46231715, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476360Z\", \"created\": \"2021-03-10T13:47:09.378011Z\", \"started\": \"2021-03-10T13:47:12.839725Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476523Z\", \"created\": \"2021-03-10T13:47:32.870012Z\", \"started\": \"2021-03-10T13:47:36.592939Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 31362908, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476685Z\", \"created\": \"2021-03-10T13:47:55.226012Z\", \"started\": \"2021-03-10T13:48:34.834688Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 26235371, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476768Z\", \"created\": \"2021-03-10T13:47:56.326012Z\", \"started\": \"2021-03-10T13:47:58.273150Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31771852, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476844Z\", \"created\": \"2021-03-10T13:48:18.782012Z\", \"started\": \"2021-03-10T13:48:18.806617Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476919Z\", \"created\": \"2021-03-10T13:50:00.050014Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086Z\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:52.338810Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:20.477018Z\", \"last_device_update\": \"2021-03-10T13:47:41.483965Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:53:21.645 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:21 gibba013 bash[13024]: audit 2021-03-10T13:53:20.483220+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101607014, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475677Z\", \"created\": \"2021-03-10T13:44:20.530781Z\", \"started\": \"2021-03-10T13:44:20.552250Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba020\", \"container_id\": \"7268fb51c46b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371720192, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475817Z\", \"created\": \"2021-03-10T13:44:37.234781Z\", \"started\": \"2021-03-10T13:52:47.791424Z\"}, \"mgr.gibba020.yqfnwy\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba020.yqfnwy\", \"hostname\": \"gibba020\", \"container_id\": \"24f623ad250b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 401394892, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475899Z\", \"created\": \"2021-03-10T13:44:39.550781Z\", \"started\": \"2021-03-10T13:53:05.133311Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48276439, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475985Z\", \"created\": \"2021-03-10T13:46:23.866010Z\", \"started\": \"2021-03-10T13:46:27.049069Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47185920, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476192Z\", \"created\": \"2021-03-10T13:46:46.746011Z\", \"started\": \"2021-03-10T13:46:49.913581Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46231715, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476360Z\", \"created\": \"2021-03-10T13:47:09.378011Z\", \"started\": \"2021-03-10T13:47:12.839725Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476523Z\", \"created\": \"2021-03-10T13:47:32.870012Z\", \"started\": \"2021-03-10T13:47:36.592939Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 31362908, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476685Z\", \"created\": \"2021-03-10T13:47:55.226012Z\", \"started\": \"2021-03-10T13:48:34.834688Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 26235371, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476768Z\", \"created\": \"2021-03-10T13:47:56.326012Z\", \"started\": \"2021-03-10T13:47:58.273150Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31771852, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476844Z\", \"created\": \"2021-03-10T13:48:18.782012Z\", \"started\": \"2021-03-10T13:48:18.806617Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476919Z\", \"created\": \"2021-03-10T13:50:00.050014Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086Z\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:52.338810Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:20.477018Z\", \"last_device_update\": \"2021-03-10T13:47:41.483965Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:53:21.646 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:21 gibba013 bash[9767]: audit 2021-03-10T13:53:20.492495+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101607014, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475677Z\", \"created\": \"2021-03-10T13:44:20.530781Z\", \"started\": \"2021-03-10T13:44:20.552250Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba020\", \"container_id\": \"7268fb51c46b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371720192, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475817Z\", \"created\": \"2021-03-10T13:44:37.234781Z\", \"started\": \"2021-03-10T13:52:47.791424Z\"}, \"mgr.gibba020.yqfnwy\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba020.yqfnwy\", \"hostname\": \"gibba020\", \"container_id\": \"24f623ad250b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 401394892, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475899Z\", \"created\": \"2021-03-10T13:44:39.550781Z\", \"started\": \"2021-03-10T13:53:05.133311Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48276439, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475985Z\", \"created\": \"2021-03-10T13:46:23.866010Z\", \"started\": \"2021-03-10T13:46:27.049069Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47185920, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476192Z\", \"created\": \"2021-03-10T13:46:46.746011Z\", \"started\": \"2021-03-10T13:46:49.913581Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46231715, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476360Z\", \"created\": \"2021-03-10T13:47:09.378011Z\", \"started\": \"2021-03-10T13:47:12.839725Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476523Z\", \"created\": \"2021-03-10T13:47:32.870012Z\", \"started\": \"2021-03-10T13:47:36.592939Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 31362908, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476685Z\", \"created\": \"2021-03-10T13:47:55.226012Z\", \"started\": \"2021-03-10T13:48:34.834688Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 26235371, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476768Z\", \"created\": \"2021-03-10T13:47:56.326012Z\", \"started\": \"2021-03-10T13:47:58.273150Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31771852, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476844Z\", \"created\": \"2021-03-10T13:48:18.782012Z\", \"started\": \"2021-03-10T13:48:18.806617Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476919Z\", \"created\": \"2021-03-10T13:50:00.050014Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086Z\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:52.338810Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:20.477018Z\", \"last_device_update\": \"2021-03-10T13:47:41.483965Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T13:53:21.646 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:21 gibba013 bash[9767]: audit 2021-03-10T13:53:20.730206+0000 mon.b (mon.2) 77 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:53:21.646 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:21 gibba013 bash[9767]: audit 2021-03-10T13:53:20.734080+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:53:21.646 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:21 gibba013 bash[9767]: audit 2021-03-10T13:53:20.736372+0000 mon.b (mon.2) 78 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:53:21.647 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:21 gibba013 bash[9767]: audit 2021-03-10T13:53:20.736592+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2021-03-10T13:53:21.647 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:21 gibba013 bash[9767]: audit 2021-03-10T13:53:20.737297+0000 mon.b (mon.2) 79 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:53:21.647 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:21 gibba013 bash[9767]: audit 2021-03-10T13:53:20.738053+0000 mon.b (mon.2) 80 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:53:21.647 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:21 gibba013 bash[9767]: audit 2021-03-10T13:53:20.738829+0000 mon.b (mon.2) 81 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T13:53:21.648 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:21 gibba013 bash[13024]: audit 2021-03-10T13:53:20.492495+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101607014, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475677Z\", \"created\": \"2021-03-10T13:44:20.530781Z\", \"started\": \"2021-03-10T13:44:20.552250Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba020\", \"container_id\": \"7268fb51c46b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371720192, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475817Z\", \"created\": \"2021-03-10T13:44:37.234781Z\", \"started\": \"2021-03-10T13:52:47.791424Z\"}, \"mgr.gibba020.yqfnwy\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba020.yqfnwy\", \"hostname\": \"gibba020\", \"container_id\": \"24f623ad250b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 401394892, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475899Z\", \"created\": \"2021-03-10T13:44:39.550781Z\", \"started\": \"2021-03-10T13:53:05.133311Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48276439, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475985Z\", \"created\": \"2021-03-10T13:46:23.866010Z\", \"started\": \"2021-03-10T13:46:27.049069Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47185920, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476192Z\", \"created\": \"2021-03-10T13:46:46.746011Z\", \"started\": \"2021-03-10T13:46:49.913581Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46231715, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476360Z\", \"created\": \"2021-03-10T13:47:09.378011Z\", \"started\": \"2021-03-10T13:47:12.839725Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476523Z\", \"created\": \"2021-03-10T13:47:32.870012Z\", \"started\": \"2021-03-10T13:47:36.592939Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 31362908, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476685Z\", \"created\": \"2021-03-10T13:47:55.226012Z\", \"started\": \"2021-03-10T13:48:34.834688Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 26235371, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476768Z\", \"created\": \"2021-03-10T13:47:56.326012Z\", \"started\": \"2021-03-10T13:47:58.273150Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31771852, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476844Z\", \"created\": \"2021-03-10T13:48:18.782012Z\", \"started\": \"2021-03-10T13:48:18.806617Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476919Z\", \"created\": \"2021-03-10T13:50:00.050014Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086Z\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:52.338810Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:20.477018Z\", \"last_device_update\": \"2021-03-10T13:47:41.483965Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T13:53:21.648 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:21 gibba013 bash[13024]: audit 2021-03-10T13:53:20.730206+0000 mon.b (mon.2) 77 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:53:21.648 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:21 gibba013 bash[13024]: audit 2021-03-10T13:53:20.734080+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:53:21.649 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:21 gibba013 bash[13024]: audit 2021-03-10T13:53:20.736372+0000 mon.b (mon.2) 78 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:53:21.649 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:21 gibba013 bash[13024]: audit 2021-03-10T13:53:20.736592+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2021-03-10T13:53:21.649 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:21 gibba013 bash[13024]: audit 2021-03-10T13:53:20.737297+0000 mon.b (mon.2) 79 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:53:21.649 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:21 gibba013 bash[13024]: audit 2021-03-10T13:53:20.738053+0000 mon.b (mon.2) 80 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:53:21.649 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:21 gibba013 bash[13024]: audit 2021-03-10T13:53:20.738829+0000 mon.b (mon.2) 81 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T13:53:21.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:21 gibba020 bash[9782]: cephadm 2021-03-10T13:53:19.724371+0000 mgr.gibba020.yqfnwy (mgr.34391) 9 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T13:53:21.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:21 gibba020 bash[9782]: cluster 2021-03-10T13:53:20.131441+0000 mgr.gibba020.yqfnwy (mgr.34391) 10 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:21.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:21 gibba020 bash[9782]: audit 2021-03-10T13:53:20.478248+0000 mon.b (mon.2) 76 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101607014, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475677Z\", \"created\": \"2021-03-10T13:44:20.530781Z\", \"started\": \"2021-03-10T13:44:20.552250Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba020\", \"container_id\": \"7268fb51c46b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371720192, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475817Z\", \"created\": \"2021-03-10T13:44:37.234781Z\", \"started\": \"2021-03-10T13:52:47.791424Z\"}, \"mgr.gibba020.yqfnwy\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba020.yqfnwy\", \"hostname\": \"gibba020\", \"container_id\": \"24f623ad250b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 401394892, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475899Z\", \"created\": \"2021-03-10T13:44:39.550781Z\", \"started\": \"2021-03-10T13:53:05.133311Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48276439, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475985Z\", \"created\": \"2021-03-10T13:46:23.866010Z\", \"started\": \"2021-03-10T13:46:27.049069Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47185920, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476192Z\", \"created\": \"2021-03-10T13:46:46.746011Z\", \"started\": \"2021-03-10T13:46:49.913581Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46231715, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476360Z\", \"created\": \"2021-03-10T13:47:09.378011Z\", \"started\": \"2021-03-10T13:47:12.839725Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476523Z\", \"created\": \"2021-03-10T13:47:32.870012Z\", \"started\": \"2021-03-10T13:47:36.592939Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 31362908, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476685Z\", \"created\": \"2021-03-10T13:47:55.226012Z\", \"started\": \"2021-03-10T13:48:34.834688Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 26235371, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476768Z\", \"created\": \"2021-03-10T13:47:56.326012Z\", \"started\": \"2021-03-10T13:47:58.273150Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31771852, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476844Z\", \"created\": \"2021-03-10T13:48:18.782012Z\", \"started\": \"2021-03-10T13:48:18.806617Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476919Z\", \"created\": \"2021-03-10T13:50:00.050014Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086Z\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:52.338810Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:20.477018Z\", \"last_device_update\": \"2021-03-10T13:47:41.483965Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:53:21.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:21 gibba020 bash[9782]: audit 2021-03-10T13:53:20.483220+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101607014, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475677Z\", \"created\": \"2021-03-10T13:44:20.530781Z\", \"started\": \"2021-03-10T13:44:20.552250Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba020\", \"container_id\": \"7268fb51c46b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371720192, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475817Z\", \"created\": \"2021-03-10T13:44:37.234781Z\", \"started\": \"2021-03-10T13:52:47.791424Z\"}, \"mgr.gibba020.yqfnwy\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba020.yqfnwy\", \"hostname\": \"gibba020\", \"container_id\": \"24f623ad250b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 401394892, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475899Z\", \"created\": \"2021-03-10T13:44:39.550781Z\", \"started\": \"2021-03-10T13:53:05.133311Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48276439, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475985Z\", \"created\": \"2021-03-10T13:46:23.866010Z\", \"started\": \"2021-03-10T13:46:27.049069Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47185920, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476192Z\", \"created\": \"2021-03-10T13:46:46.746011Z\", \"started\": \"2021-03-10T13:46:49.913581Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46231715, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476360Z\", \"created\": \"2021-03-10T13:47:09.378011Z\", \"started\": \"2021-03-10T13:47:12.839725Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476523Z\", \"created\": \"2021-03-10T13:47:32.870012Z\", \"started\": \"2021-03-10T13:47:36.592939Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 31362908, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476685Z\", \"created\": \"2021-03-10T13:47:55.226012Z\", \"started\": \"2021-03-10T13:48:34.834688Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 26235371, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476768Z\", \"created\": \"2021-03-10T13:47:56.326012Z\", \"started\": \"2021-03-10T13:47:58.273150Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31771852, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476844Z\", \"created\": \"2021-03-10T13:48:18.782012Z\", \"started\": \"2021-03-10T13:48:18.806617Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476919Z\", \"created\": \"2021-03-10T13:50:00.050014Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086Z\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:52.338810Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:20.477018Z\", \"last_device_update\": \"2021-03-10T13:47:41.483965Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:53:21.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:21 gibba020 bash[9782]: audit 2021-03-10T13:53:20.492495+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101607014, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475677Z\", \"created\": \"2021-03-10T13:44:20.530781Z\", \"started\": \"2021-03-10T13:44:20.552250Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba020\", \"container_id\": \"7268fb51c46b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371720192, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475817Z\", \"created\": \"2021-03-10T13:44:37.234781Z\", \"started\": \"2021-03-10T13:52:47.791424Z\"}, \"mgr.gibba020.yqfnwy\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba020.yqfnwy\", \"hostname\": \"gibba020\", \"container_id\": \"24f623ad250b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 401394892, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475899Z\", \"created\": \"2021-03-10T13:44:39.550781Z\", \"started\": \"2021-03-10T13:53:05.133311Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48276439, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475985Z\", \"created\": \"2021-03-10T13:46:23.866010Z\", \"started\": \"2021-03-10T13:46:27.049069Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47185920, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476192Z\", \"created\": \"2021-03-10T13:46:46.746011Z\", \"started\": \"2021-03-10T13:46:49.913581Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46231715, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476360Z\", \"created\": \"2021-03-10T13:47:09.378011Z\", \"started\": \"2021-03-10T13:47:12.839725Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476523Z\", \"created\": \"2021-03-10T13:47:32.870012Z\", \"started\": \"2021-03-10T13:47:36.592939Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 31362908, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476685Z\", \"created\": \"2021-03-10T13:47:55.226012Z\", \"started\": \"2021-03-10T13:48:34.834688Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 26235371, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476768Z\", \"created\": \"2021-03-10T13:47:56.326012Z\", \"started\": \"2021-03-10T13:47:58.273150Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31771852, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476844Z\", \"created\": \"2021-03-10T13:48:18.782012Z\", \"started\": \"2021-03-10T13:48:18.806617Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476919Z\", \"created\": \"2021-03-10T13:50:00.050014Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:16.816746Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086Z\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:52.338810Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:20.477018Z\", \"last_device_update\": \"2021-03-10T13:47:41.483965Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T13:53:21.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:21 gibba020 bash[9782]: audit 2021-03-10T13:53:20.730206+0000 mon.b (mon.2) 77 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:53:21.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:21 gibba020 bash[9782]: audit 2021-03-10T13:53:20.734080+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:53:21.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:21 gibba020 bash[9782]: audit 2021-03-10T13:53:20.736372+0000 mon.b (mon.2) 78 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:53:21.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:21 gibba020 bash[9782]: audit 2021-03-10T13:53:20.736592+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2021-03-10T13:53:21.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:21 gibba020 bash[9782]: audit 2021-03-10T13:53:20.737297+0000 mon.b (mon.2) 79 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:53:21.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:21 gibba020 bash[9782]: audit 2021-03-10T13:53:20.738053+0000 mon.b (mon.2) 80 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:53:21.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:21 gibba020 bash[9782]: audit 2021-03-10T13:53:20.738829+0000 mon.b (mon.2) 81 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T13:53:22.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:22 gibba013 bash[9767]: cephadm 2021-03-10T13:53:20.490590+0000 mgr.gibba020.yqfnwy (mgr.34391) 11 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T13:53:22.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:22 gibba013 bash[9767]: cluster 2021-03-10T13:53:20.729966+0000 mgr.gibba020.yqfnwy (mgr.34391) 12 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:22.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:22 gibba013 bash[9767]: cephadm 2021-03-10T13:53:20.736155+0000 mgr.gibba020.yqfnwy (mgr.34391) 13 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2021-03-10T13:53:22.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:22 gibba013 bash[9767]: cephadm 2021-03-10T13:53:20.738602+0000 mgr.gibba020.yqfnwy (mgr.34391) 14 : cephadm [INF] Reconfiguring daemon mon.a on gibba013 2021-03-10T13:53:22.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:22 gibba013 bash[9767]: audit 2021-03-10T13:53:20.867393+0000 mgr.gibba020.yqfnwy (mgr.34391) 15 : audit [DBG] from='client.14610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:53:22.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:22 gibba013 bash[9767]: audit 2021-03-10T13:53:21.094941+0000 mgr.gibba020.yqfnwy (mgr.34391) 16 : audit [DBG] from='client.24532 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:53:22.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:22 gibba013 bash[9767]: audit 2021-03-10T13:53:21.359680+0000 mon.a (mon.0) 649 : audit [DBG] from='client.? 172.21.2.113:0/1527774863' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:22.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:22 gibba013 bash[9767]: cluster 2021-03-10T13:53:21.727154+0000 mon.a (mon.0) 650 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2021-03-10T13:53:22.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:22 gibba013 bash[13024]: cephadm 2021-03-10T13:53:20.490590+0000 mgr.gibba020.yqfnwy (mgr.34391) 11 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T13:53:22.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:22 gibba013 bash[13024]: cluster 2021-03-10T13:53:20.729966+0000 mgr.gibba020.yqfnwy (mgr.34391) 12 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:22.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:22 gibba013 bash[13024]: cephadm 2021-03-10T13:53:20.736155+0000 mgr.gibba020.yqfnwy (mgr.34391) 13 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2021-03-10T13:53:22.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:22 gibba013 bash[13024]: cephadm 2021-03-10T13:53:20.738602+0000 mgr.gibba020.yqfnwy (mgr.34391) 14 : cephadm [INF] Reconfiguring daemon mon.a on gibba013 2021-03-10T13:53:22.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:22 gibba013 bash[13024]: audit 2021-03-10T13:53:20.867393+0000 mgr.gibba020.yqfnwy (mgr.34391) 15 : audit [DBG] from='client.14610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:53:22.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:22 gibba013 bash[13024]: audit 2021-03-10T13:53:21.094941+0000 mgr.gibba020.yqfnwy (mgr.34391) 16 : audit [DBG] from='client.24532 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:53:22.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:22 gibba013 bash[13024]: audit 2021-03-10T13:53:21.359680+0000 mon.a (mon.0) 649 : audit [DBG] from='client.? 172.21.2.113:0/1527774863' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:22.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:22 gibba013 bash[13024]: cluster 2021-03-10T13:53:21.727154+0000 mon.a (mon.0) 650 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2021-03-10T13:53:22.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:22 gibba020 bash[9782]: cephadm 2021-03-10T13:53:20.490590+0000 mgr.gibba020.yqfnwy (mgr.34391) 11 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T13:53:22.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:22 gibba020 bash[9782]: cluster 2021-03-10T13:53:20.729966+0000 mgr.gibba020.yqfnwy (mgr.34391) 12 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:22.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:22 gibba020 bash[9782]: cephadm 2021-03-10T13:53:20.736155+0000 mgr.gibba020.yqfnwy (mgr.34391) 13 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2021-03-10T13:53:22.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:22 gibba020 bash[9782]: cephadm 2021-03-10T13:53:20.738602+0000 mgr.gibba020.yqfnwy (mgr.34391) 14 : cephadm [INF] Reconfiguring daemon mon.a on gibba013 2021-03-10T13:53:22.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:22 gibba020 bash[9782]: audit 2021-03-10T13:53:20.867393+0000 mgr.gibba020.yqfnwy (mgr.34391) 15 : audit [DBG] from='client.14610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:53:22.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:22 gibba020 bash[9782]: audit 2021-03-10T13:53:21.094941+0000 mgr.gibba020.yqfnwy (mgr.34391) 16 : audit [DBG] from='client.24532 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:53:22.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:22 gibba020 bash[9782]: audit 2021-03-10T13:53:21.359680+0000 mon.a (mon.0) 649 : audit [DBG] from='client.? 172.21.2.113:0/1527774863' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:22.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:22 gibba020 bash[9782]: cluster 2021-03-10T13:53:21.727154+0000 mon.a (mon.0) 650 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2021-03-10T13:53:23.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:23 gibba013 bash[9767]: audit 2021-03-10T13:53:22.736703+0000 mon.b (mon.2) 82 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307442483, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718425Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:43:01.306356Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a890668984ec\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12740198, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719109Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:48:27.713709Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:48:20.868189Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:19.719207Z\", \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:53:23.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:23 gibba013 bash[13024]: audit 2021-03-10T13:53:22.736703+0000 mon.b (mon.2) 82 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307442483, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718425Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:43:01.306356Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a890668984ec\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12740198, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719109Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:48:27.713709Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:48:20.868189Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:19.719207Z\", \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:53:23.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:23 gibba013 bash[9767]: audit 2021-03-10T13:53:22.741310+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307442483, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718425Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:43:01.306356Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a890668984ec\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12740198, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719109Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:48:27.713709Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:48:20.868189Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:19.719207Z\", \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:53:23.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:23 gibba013 bash[9767]: audit 2021-03-10T13:53:22.745120+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307442483, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718425Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:43:01.306356Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a890668984ec\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12740198, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719109Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:48:27.713709Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:48:20.868189Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:19.719207Z\", \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T13:53:23.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:23 gibba013 bash[9767]: audit 2021-03-10T13:53:22.748324+0000 mon.b (mon.2) 83 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:53:23.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:23 gibba013 bash[9767]: audit 2021-03-10T13:53:22.749329+0000 mon.b (mon.2) 84 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:53:23.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:23 gibba013 bash[9767]: audit 2021-03-10T13:53:22.749988+0000 mon.b (mon.2) 85 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:53:23.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:23 gibba013 bash[9767]: audit 2021-03-10T13:53:22.750722+0000 mon.b (mon.2) 86 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T13:53:23.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:23 gibba013 bash[13024]: audit 2021-03-10T13:53:22.741310+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307442483, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718425Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:43:01.306356Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a890668984ec\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12740198, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719109Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:48:27.713709Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:48:20.868189Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:19.719207Z\", \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:53:23.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:23 gibba013 bash[13024]: audit 2021-03-10T13:53:22.745120+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307442483, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718425Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:43:01.306356Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a890668984ec\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12740198, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719109Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:48:27.713709Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:48:20.868189Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:19.719207Z\", \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T13:53:23.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:23 gibba013 bash[13024]: audit 2021-03-10T13:53:22.748324+0000 mon.b (mon.2) 83 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:53:23.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:23 gibba013 bash[13024]: audit 2021-03-10T13:53:22.749329+0000 mon.b (mon.2) 84 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:53:23.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:23 gibba013 bash[13024]: audit 2021-03-10T13:53:22.749988+0000 mon.b (mon.2) 85 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:53:23.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:23 gibba013 bash[13024]: audit 2021-03-10T13:53:22.750722+0000 mon.b (mon.2) 86 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T13:53:23.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:23 gibba020 bash[9782]: audit 2021-03-10T13:53:22.736703+0000 mon.b (mon.2) 82 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307442483, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718425Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:43:01.306356Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a890668984ec\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12740198, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719109Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:48:27.713709Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:48:20.868189Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:19.719207Z\", \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:53:23.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:23 gibba020 bash[9782]: audit 2021-03-10T13:53:22.741310+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307442483, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718425Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:43:01.306356Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a890668984ec\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12740198, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719109Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:48:27.713709Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:48:20.868189Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:19.719207Z\", \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:53:23.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:23 gibba020 bash[9782]: audit 2021-03-10T13:53:22.745120+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307442483, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718425Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:43:01.306356Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a890668984ec\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12740198, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719109Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:48:27.713709Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:02.784637Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:48:20.868189Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:19.719207Z\", \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T13:53:23.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:23 gibba020 bash[9782]: audit 2021-03-10T13:53:22.748324+0000 mon.b (mon.2) 83 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:53:23.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:23 gibba020 bash[9782]: audit 2021-03-10T13:53:22.749329+0000 mon.b (mon.2) 84 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:53:23.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:23 gibba020 bash[9782]: audit 2021-03-10T13:53:22.749988+0000 mon.b (mon.2) 85 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:53:23.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:23 gibba020 bash[9782]: audit 2021-03-10T13:53:22.750722+0000 mon.b (mon.2) 86 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T13:53:24.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:24 gibba013 bash[13024]: cluster 2021-03-10T13:53:22.732093+0000 mgr.gibba020.yqfnwy (mgr.34391) 17 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:24.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:24 gibba013 bash[13024]: cephadm 2021-03-10T13:53:22.748064+0000 mgr.gibba020.yqfnwy (mgr.34391) 18 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-03-10T13:53:24.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:24 gibba013 bash[13024]: cephadm 2021-03-10T13:53:22.750514+0000 mgr.gibba020.yqfnwy (mgr.34391) 19 : cephadm [INF] Reconfiguring daemon mon.c on gibba013 2021-03-10T13:53:24.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:24 gibba013 bash[9767]: cluster 2021-03-10T13:53:22.732093+0000 mgr.gibba020.yqfnwy (mgr.34391) 17 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:24.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:24 gibba013 bash[9767]: cephadm 2021-03-10T13:53:22.748064+0000 mgr.gibba020.yqfnwy (mgr.34391) 18 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-03-10T13:53:24.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:24 gibba013 bash[9767]: cephadm 2021-03-10T13:53:22.750514+0000 mgr.gibba020.yqfnwy (mgr.34391) 19 : cephadm [INF] Reconfiguring daemon mon.c on gibba013 2021-03-10T13:53:24.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:24 gibba020 bash[9782]: cluster 2021-03-10T13:53:22.732093+0000 mgr.gibba020.yqfnwy (mgr.34391) 17 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:24.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:24 gibba020 bash[9782]: cephadm 2021-03-10T13:53:22.748064+0000 mgr.gibba020.yqfnwy (mgr.34391) 18 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-03-10T13:53:24.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:24 gibba020 bash[9782]: cephadm 2021-03-10T13:53:22.750514+0000 mgr.gibba020.yqfnwy (mgr.34391) 19 : cephadm [INF] Reconfiguring daemon mon.c on gibba013 2021-03-10T13:53:25.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:25 gibba013 bash[13024]: audit 2021-03-10T13:53:24.636577+0000 mon.b (mon.2) 87 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307442483, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718425Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:43:01.306356Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a890668984ec\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12740198, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719109Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:48:27.713709Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:48:20.868189Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:19.719207Z\", \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\"}"}]: dispatch 2021-03-10T13:53:25.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:25 gibba013 bash[9767]: audit 2021-03-10T13:53:24.636577+0000 mon.b (mon.2) 87 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307442483, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718425Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:43:01.306356Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a890668984ec\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12740198, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719109Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:48:27.713709Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:48:20.868189Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:19.719207Z\", \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\"}"}]: dispatch 2021-03-10T13:53:25.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:25 gibba013 bash[13024]: audit 2021-03-10T13:53:24.641092+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307442483, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718425Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:43:01.306356Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a890668984ec\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12740198, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719109Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:48:27.713709Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:48:20.868189Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:19.719207Z\", \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\"}"}]: dispatch 2021-03-10T13:53:25.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:25 gibba013 bash[13024]: audit 2021-03-10T13:53:24.645273+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307442483, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718425Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:43:01.306356Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a890668984ec\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12740198, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719109Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:48:27.713709Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:48:20.868189Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:19.719207Z\", \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\"}"}]': finished 2021-03-10T13:53:25.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:25 gibba013 bash[9767]: audit 2021-03-10T13:53:24.641092+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307442483, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718425Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:43:01.306356Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a890668984ec\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12740198, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719109Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:48:27.713709Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:48:20.868189Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:19.719207Z\", \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\"}"}]: dispatch 2021-03-10T13:53:25.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:25 gibba013 bash[9767]: audit 2021-03-10T13:53:24.645273+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307442483, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718425Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:43:01.306356Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a890668984ec\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12740198, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719109Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:48:27.713709Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:48:20.868189Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:19.719207Z\", \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\"}"}]': finished 2021-03-10T13:53:25.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:25 gibba020 bash[9782]: audit 2021-03-10T13:53:24.636577+0000 mon.b (mon.2) 87 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307442483, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718425Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:43:01.306356Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a890668984ec\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12740198, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719109Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:48:27.713709Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:48:20.868189Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:19.719207Z\", \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\"}"}]: dispatch 2021-03-10T13:53:25.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:25 gibba020 bash[9782]: audit 2021-03-10T13:53:24.641092+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307442483, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718425Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:43:01.306356Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a890668984ec\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12740198, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719109Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:48:27.713709Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:48:20.868189Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:19.719207Z\", \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\"}"}]: dispatch 2021-03-10T13:53:25.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:25 gibba020 bash[9782]: audit 2021-03-10T13:53:24.645273+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307442483, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718425Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:43:01.306356Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a890668984ec\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12740198, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719109Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:48:27.713709Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T13:48:20.868189Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:19.719207Z\", \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\"}"}]': finished 2021-03-10T13:53:26.582 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:26 gibba013 bash[9767]: cephadm 2021-03-10T13:53:24.648956+0000 mgr.gibba020.yqfnwy (mgr.34391) 20 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-03-10T13:53:26.582 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:26 gibba013 bash[9767]: cephadm 2021-03-10T13:53:24.655654+0000 mgr.gibba020.yqfnwy (mgr.34391) 21 : cephadm [INF] Reconfiguring daemon alertmanager.a on gibba013 2021-03-10T13:53:26.582 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:26 gibba013 bash[9767]: cluster 2021-03-10T13:53:24.733042+0000 mgr.gibba020.yqfnwy (mgr.34391) 22 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:26.583 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:26 gibba013 bash[13024]: cephadm 2021-03-10T13:53:24.648956+0000 mgr.gibba020.yqfnwy (mgr.34391) 20 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-03-10T13:53:26.583 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:26 gibba013 bash[13024]: cephadm 2021-03-10T13:53:24.655654+0000 mgr.gibba020.yqfnwy (mgr.34391) 21 : cephadm [INF] Reconfiguring daemon alertmanager.a on gibba013 2021-03-10T13:53:26.583 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:26 gibba013 bash[13024]: cluster 2021-03-10T13:53:24.733042+0000 mgr.gibba020.yqfnwy (mgr.34391) 22 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:26.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:26 gibba020 bash[9782]: cephadm 2021-03-10T13:53:24.648956+0000 mgr.gibba020.yqfnwy (mgr.34391) 20 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-03-10T13:53:26.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:26 gibba020 bash[9782]: cephadm 2021-03-10T13:53:24.655654+0000 mgr.gibba020.yqfnwy (mgr.34391) 21 : cephadm [INF] Reconfiguring daemon alertmanager.a on gibba013 2021-03-10T13:53:26.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:26 gibba020 bash[9782]: cluster 2021-03-10T13:53:24.733042+0000 mgr.gibba020.yqfnwy (mgr.34391) 22 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:28.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:28 gibba013 bash[9767]: cluster 2021-03-10T13:53:26.734305+0000 mgr.gibba020.yqfnwy (mgr.34391) 23 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:28.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:28 gibba013 bash[13024]: cluster 2021-03-10T13:53:26.734305+0000 mgr.gibba020.yqfnwy (mgr.34391) 23 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:28.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:28 gibba020 bash[9782]: cluster 2021-03-10T13:53:26.734305+0000 mgr.gibba020.yqfnwy (mgr.34391) 23 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:30.541 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:30 gibba013 bash[9767]: cluster 2021-03-10T13:53:28.735268+0000 mgr.gibba020.yqfnwy (mgr.34391) 24 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:30.542 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:30 gibba013 bash[13024]: cluster 2021-03-10T13:53:28.735268+0000 mgr.gibba020.yqfnwy (mgr.34391) 24 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:30.542 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:53:30 gibba013 systemd[1]: Stopping Ceph alertmanager.a for 7672acc8-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:53:30.543 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:53:30 gibba013 bash[21839]: level=info ts=2021-03-10T13:53:30.346Z caller=main.go:524 msg="Received SIGTERM, exiting gracefully..." 2021-03-10T13:53:30.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:30 gibba020 bash[9782]: cluster 2021-03-10T13:53:28.735268+0000 mgr.gibba020.yqfnwy (mgr.34391) 24 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:31.378 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:53:31 gibba013 docker[27944]: ceph-7672acc8-81a6-11eb-9080-001a4aab830c-alertmanager.a 2021-03-10T13:53:31.378 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:53:31 gibba013 systemd[1]: ceph-7672acc8-81a6-11eb-9080-001a4aab830c@alertmanager.a.service: Succeeded. 2021-03-10T13:53:31.379 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:53:31 gibba013 systemd[1]: Stopped Ceph alertmanager.a for 7672acc8-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:53:31.379 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:53:31 gibba013 systemd[1]: Starting Ceph alertmanager.a for 7672acc8-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:53:31.379 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:53:31 gibba013 docker[27977]: Error: No such container: ceph-7672acc8-81a6-11eb-9080-001a4aab830c-alertmanager.a 2021-03-10T13:53:31.379 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:53:31 gibba013 systemd[1]: Started Ceph alertmanager.a for 7672acc8-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:53:31.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:31 gibba020 bash[9782]: cluster 2021-03-10T13:53:30.736244+0000 mgr.gibba020.yqfnwy (mgr.34391) 25 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:31.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:31 gibba020 bash[9782]: audit 2021-03-10T13:53:31.053986+0000 mon.b (mon.2) 88 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307442483, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718425Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:43:01.306356Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\"}"}]: dispatch 2021-03-10T13:53:31.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:31 gibba020 bash[9782]: audit 2021-03-10T13:53:31.058314+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307442483, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718425Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:43:01.306356Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\"}"}]: dispatch 2021-03-10T13:53:31.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:31 gibba020 bash[9782]: audit 2021-03-10T13:53:31.061840+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307442483, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718425Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:43:01.306356Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\"}"}]': finished 2021-03-10T13:53:31.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:31 gibba020 bash[9782]: cephadm 2021-03-10T13:53:31.064389+0000 mgr.gibba020.yqfnwy (mgr.34391) 26 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-03-10T13:53:31.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:31 gibba020 bash[9782]: audit 2021-03-10T13:53:31.064674+0000 mon.b (mon.2) 89 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:53:31.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:31 gibba020 bash[9782]: audit 2021-03-10T13:53:31.065710+0000 mon.b (mon.2) 90 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:53:31.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:31 gibba020 bash[9782]: audit 2021-03-10T13:53:31.066554+0000 mon.b (mon.2) 91 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:53:31.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:31 gibba020 bash[9782]: cephadm 2021-03-10T13:53:31.067351+0000 mgr.gibba020.yqfnwy (mgr.34391) 27 : cephadm [INF] Reconfiguring daemon mon.b on gibba020 2021-03-10T13:53:31.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:31 gibba020 bash[9782]: audit 2021-03-10T13:53:31.067650+0000 mon.b (mon.2) 92 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T13:53:31.998 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:31 gibba013 bash[9767]: cluster 2021-03-10T13:53:30.736244+0000 mgr.gibba020.yqfnwy (mgr.34391) 25 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:31.998 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:31 gibba013 bash[13024]: cluster 2021-03-10T13:53:30.736244+0000 mgr.gibba020.yqfnwy (mgr.34391) 25 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:31.999 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:31 gibba013 bash[9767]: audit 2021-03-10T13:53:31.053986+0000 mon.b (mon.2) 88 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307442483, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718425Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:43:01.306356Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\"}"}]: dispatch 2021-03-10T13:53:32.000 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:31 gibba013 bash[13024]: audit 2021-03-10T13:53:31.053986+0000 mon.b (mon.2) 88 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307442483, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718425Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:43:01.306356Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\"}"}]: dispatch 2021-03-10T13:53:32.001 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:31 gibba013 bash[9767]: audit 2021-03-10T13:53:31.058314+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307442483, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718425Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:43:01.306356Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\"}"}]: dispatch 2021-03-10T13:53:32.002 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:31 gibba013 bash[13024]: audit 2021-03-10T13:53:31.058314+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307442483, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718425Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:43:01.306356Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\"}"}]: dispatch 2021-03-10T13:53:32.002 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:31 gibba013 bash[9767]: audit 2021-03-10T13:53:31.061840+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307442483, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718425Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:43:01.306356Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\"}"}]': finished 2021-03-10T13:53:32.003 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:31 gibba013 bash[9767]: cephadm 2021-03-10T13:53:31.064389+0000 mgr.gibba020.yqfnwy (mgr.34391) 26 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-03-10T13:53:32.003 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:31 gibba013 bash[9767]: audit 2021-03-10T13:53:31.064674+0000 mon.b (mon.2) 89 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:53:32.003 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:31 gibba013 bash[9767]: audit 2021-03-10T13:53:31.065710+0000 mon.b (mon.2) 90 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:53:32.003 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:31 gibba013 bash[9767]: audit 2021-03-10T13:53:31.066554+0000 mon.b (mon.2) 91 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:53:32.003 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:31 gibba013 bash[9767]: cephadm 2021-03-10T13:53:31.067351+0000 mgr.gibba020.yqfnwy (mgr.34391) 27 : cephadm [INF] Reconfiguring daemon mon.b on gibba020 2021-03-10T13:53:32.004 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:31 gibba013 bash[9767]: audit 2021-03-10T13:53:31.067650+0000 mon.b (mon.2) 92 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T13:53:32.004 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:31 gibba013 bash[13024]: audit 2021-03-10T13:53:31.061840+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"aff9dae2208b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 307442483, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718425Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:43:01.306356Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:40.000603Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\"}"}]': finished 2021-03-10T13:53:32.004 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:31 gibba013 bash[13024]: cephadm 2021-03-10T13:53:31.064389+0000 mgr.gibba020.yqfnwy (mgr.34391) 26 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-03-10T13:53:32.004 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:31 gibba013 bash[13024]: audit 2021-03-10T13:53:31.064674+0000 mon.b (mon.2) 89 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:53:32.005 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:31 gibba013 bash[13024]: audit 2021-03-10T13:53:31.065710+0000 mon.b (mon.2) 90 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:53:32.005 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:31 gibba013 bash[13024]: audit 2021-03-10T13:53:31.066554+0000 mon.b (mon.2) 91 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:53:32.005 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:31 gibba013 bash[13024]: cephadm 2021-03-10T13:53:31.067351+0000 mgr.gibba020.yqfnwy (mgr.34391) 27 : cephadm [INF] Reconfiguring daemon mon.b on gibba020 2021-03-10T13:53:32.005 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:31 gibba013 bash[13024]: audit 2021-03-10T13:53:31.067650+0000 mon.b (mon.2) 92 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T13:53:32.378 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:53:32 gibba013 bash[27996]: level=info ts=2021-03-10T13:53:32.057Z caller=main.go:216 msg="Starting Alertmanager" version="(version=0.21.0, branch=HEAD, revision=4c6c03ebfe21009c546e4d1e9b92c371d67c021d)" 2021-03-10T13:53:32.379 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:53:32 gibba013 bash[27996]: level=info ts=2021-03-10T13:53:32.057Z caller=main.go:217 build_context="(go=go1.14.4, user=root@dee35927357f, date=20200617-08:54:02)" 2021-03-10T13:53:32.379 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:53:32 gibba013 bash[27996]: level=info ts=2021-03-10T13:53:32.058Z caller=cluster.go:161 component=cluster msg="setting advertise address explicitly" addr=172.21.2.113 port=9094 2021-03-10T13:53:32.379 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:53:32 gibba013 bash[27996]: level=info ts=2021-03-10T13:53:32.058Z caller=cluster.go:623 component=cluster msg="Waiting for gossip to settle..." interval=2s 2021-03-10T13:53:32.379 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:53:32 gibba013 bash[27996]: level=info ts=2021-03-10T13:53:32.072Z caller=coordinator.go:119 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2021-03-10T13:53:32.380 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:53:32 gibba013 bash[27996]: level=info ts=2021-03-10T13:53:32.072Z caller=coordinator.go:131 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2021-03-10T13:53:32.380 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:53:32 gibba013 bash[27996]: level=info ts=2021-03-10T13:53:32.074Z caller=main.go:485 msg=Listening address=:9093 2021-03-10T13:53:34.061 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:33 gibba013 bash[9767]: cluster 2021-03-10T13:53:32.738094+0000 mgr.gibba020.yqfnwy (mgr.34391) 28 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:34.061 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:33 gibba013 bash[13024]: cluster 2021-03-10T13:53:32.738094+0000 mgr.gibba020.yqfnwy (mgr.34391) 28 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:34.062 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:33 gibba013 bash[9767]: audit 2021-03-10T13:53:33.217424+0000 mon.b (mon.2) 93 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101607014, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475677Z\", \"created\": \"2021-03-10T13:44:20.530781Z\", \"started\": \"2021-03-10T13:44:20.552250Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba020\", \"container_id\": \"7268fb51c46b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371720192, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475817Z\", \"created\": \"2021-03-10T13:44:37.234781Z\", \"started\": \"2021-03-10T13:52:47.791424Z\"}, \"mgr.gibba020.yqfnwy\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba020.yqfnwy\", \"hostname\": \"gibba020\", \"container_id\": \"24f623ad250b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 401394892, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475899Z\", \"created\": \"2021-03-10T13:44:39.550781Z\", \"started\": \"2021-03-10T13:53:05.133311Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48276439, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475985Z\", \"created\": \"2021-03-10T13:46:23.866010Z\", \"started\": \"2021-03-10T13:46:27.049069Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47185920, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476192Z\", \"created\": \"2021-03-10T13:46:46.746011Z\", \"started\": \"2021-03-10T13:46:49.913581Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46231715, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476360Z\", \"created\": \"2021-03-10T13:47:09.378011Z\", \"started\": \"2021-03-10T13:47:12.839725Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476523Z\", \"created\": \"2021-03-10T13:47:32.870012Z\", \"started\": \"2021-03-10T13:47:36.592939Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 31362908, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476685Z\", \"created\": \"2021-03-10T13:47:55.226012Z\", \"started\": \"2021-03-10T13:48:34.834688Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 26235371, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476768Z\", \"created\": \"2021-03-10T13:47:56.326012Z\", \"started\": \"2021-03-10T13:47:58.273150Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31771852, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476844Z\", \"created\": \"2021-03-10T13:48:18.782012Z\", \"started\": \"2021-03-10T13:48:18.806617Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476919Z\", \"created\": \"2021-03-10T13:50:00.050014Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:31.067278Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086Z\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:52.338810Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:20.477018Z\", \"last_device_update\": \"2021-03-10T13:47:41.483965Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:53:34.063 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:33 gibba013 bash[13024]: audit 2021-03-10T13:53:33.217424+0000 mon.b (mon.2) 93 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101607014, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475677Z\", \"created\": \"2021-03-10T13:44:20.530781Z\", \"started\": \"2021-03-10T13:44:20.552250Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba020\", \"container_id\": \"7268fb51c46b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371720192, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475817Z\", \"created\": \"2021-03-10T13:44:37.234781Z\", \"started\": \"2021-03-10T13:52:47.791424Z\"}, \"mgr.gibba020.yqfnwy\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba020.yqfnwy\", \"hostname\": \"gibba020\", \"container_id\": \"24f623ad250b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 401394892, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475899Z\", \"created\": \"2021-03-10T13:44:39.550781Z\", \"started\": \"2021-03-10T13:53:05.133311Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48276439, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475985Z\", \"created\": \"2021-03-10T13:46:23.866010Z\", \"started\": \"2021-03-10T13:46:27.049069Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47185920, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476192Z\", \"created\": \"2021-03-10T13:46:46.746011Z\", \"started\": \"2021-03-10T13:46:49.913581Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46231715, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476360Z\", \"created\": \"2021-03-10T13:47:09.378011Z\", \"started\": \"2021-03-10T13:47:12.839725Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476523Z\", \"created\": \"2021-03-10T13:47:32.870012Z\", \"started\": \"2021-03-10T13:47:36.592939Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 31362908, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476685Z\", \"created\": \"2021-03-10T13:47:55.226012Z\", \"started\": \"2021-03-10T13:48:34.834688Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 26235371, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476768Z\", \"created\": \"2021-03-10T13:47:56.326012Z\", \"started\": \"2021-03-10T13:47:58.273150Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31771852, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476844Z\", \"created\": \"2021-03-10T13:48:18.782012Z\", \"started\": \"2021-03-10T13:48:18.806617Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476919Z\", \"created\": \"2021-03-10T13:50:00.050014Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:31.067278Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086Z\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:52.338810Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:20.477018Z\", \"last_device_update\": \"2021-03-10T13:47:41.483965Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:53:34.064 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:33 gibba013 bash[9767]: audit 2021-03-10T13:53:33.222296+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101607014, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475677Z\", \"created\": \"2021-03-10T13:44:20.530781Z\", \"started\": \"2021-03-10T13:44:20.552250Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba020\", \"container_id\": \"7268fb51c46b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371720192, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475817Z\", \"created\": \"2021-03-10T13:44:37.234781Z\", \"started\": \"2021-03-10T13:52:47.791424Z\"}, \"mgr.gibba020.yqfnwy\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba020.yqfnwy\", \"hostname\": \"gibba020\", \"container_id\": \"24f623ad250b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 401394892, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475899Z\", \"created\": \"2021-03-10T13:44:39.550781Z\", \"started\": \"2021-03-10T13:53:05.133311Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48276439, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475985Z\", \"created\": \"2021-03-10T13:46:23.866010Z\", \"started\": \"2021-03-10T13:46:27.049069Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47185920, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476192Z\", \"created\": \"2021-03-10T13:46:46.746011Z\", \"started\": \"2021-03-10T13:46:49.913581Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46231715, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476360Z\", \"created\": \"2021-03-10T13:47:09.378011Z\", \"started\": \"2021-03-10T13:47:12.839725Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476523Z\", \"created\": \"2021-03-10T13:47:32.870012Z\", \"started\": \"2021-03-10T13:47:36.592939Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 31362908, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476685Z\", \"created\": \"2021-03-10T13:47:55.226012Z\", \"started\": \"2021-03-10T13:48:34.834688Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 26235371, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476768Z\", \"created\": \"2021-03-10T13:47:56.326012Z\", \"started\": \"2021-03-10T13:47:58.273150Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31771852, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476844Z\", \"created\": \"2021-03-10T13:48:18.782012Z\", \"started\": \"2021-03-10T13:48:18.806617Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476919Z\", \"created\": \"2021-03-10T13:50:00.050014Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:31.067278Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086Z\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:52.338810Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:20.477018Z\", \"last_device_update\": \"2021-03-10T13:47:41.483965Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:53:34.064 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:33 gibba013 bash[13024]: audit 2021-03-10T13:53:33.222296+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101607014, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475677Z\", \"created\": \"2021-03-10T13:44:20.530781Z\", \"started\": \"2021-03-10T13:44:20.552250Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba020\", \"container_id\": \"7268fb51c46b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371720192, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475817Z\", \"created\": \"2021-03-10T13:44:37.234781Z\", \"started\": \"2021-03-10T13:52:47.791424Z\"}, \"mgr.gibba020.yqfnwy\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba020.yqfnwy\", \"hostname\": \"gibba020\", \"container_id\": \"24f623ad250b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 401394892, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475899Z\", \"created\": \"2021-03-10T13:44:39.550781Z\", \"started\": \"2021-03-10T13:53:05.133311Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48276439, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475985Z\", \"created\": \"2021-03-10T13:46:23.866010Z\", \"started\": \"2021-03-10T13:46:27.049069Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47185920, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476192Z\", \"created\": \"2021-03-10T13:46:46.746011Z\", \"started\": \"2021-03-10T13:46:49.913581Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46231715, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476360Z\", \"created\": \"2021-03-10T13:47:09.378011Z\", \"started\": \"2021-03-10T13:47:12.839725Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476523Z\", \"created\": \"2021-03-10T13:47:32.870012Z\", \"started\": \"2021-03-10T13:47:36.592939Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 31362908, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476685Z\", \"created\": \"2021-03-10T13:47:55.226012Z\", \"started\": \"2021-03-10T13:48:34.834688Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 26235371, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476768Z\", \"created\": \"2021-03-10T13:47:56.326012Z\", \"started\": \"2021-03-10T13:47:58.273150Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31771852, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476844Z\", \"created\": \"2021-03-10T13:48:18.782012Z\", \"started\": \"2021-03-10T13:48:18.806617Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476919Z\", \"created\": \"2021-03-10T13:50:00.050014Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:31.067278Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086Z\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:52.338810Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:20.477018Z\", \"last_device_update\": \"2021-03-10T13:47:41.483965Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:53:34.065 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:33 gibba013 bash[9767]: audit 2021-03-10T13:53:33.231112+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101607014, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475677Z\", \"created\": \"2021-03-10T13:44:20.530781Z\", \"started\": \"2021-03-10T13:44:20.552250Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba020\", \"container_id\": \"7268fb51c46b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371720192, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475817Z\", \"created\": \"2021-03-10T13:44:37.234781Z\", \"started\": \"2021-03-10T13:52:47.791424Z\"}, \"mgr.gibba020.yqfnwy\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba020.yqfnwy\", \"hostname\": \"gibba020\", \"container_id\": \"24f623ad250b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 401394892, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475899Z\", \"created\": \"2021-03-10T13:44:39.550781Z\", \"started\": \"2021-03-10T13:53:05.133311Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48276439, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475985Z\", \"created\": \"2021-03-10T13:46:23.866010Z\", \"started\": \"2021-03-10T13:46:27.049069Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47185920, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476192Z\", \"created\": \"2021-03-10T13:46:46.746011Z\", \"started\": \"2021-03-10T13:46:49.913581Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46231715, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476360Z\", \"created\": \"2021-03-10T13:47:09.378011Z\", \"started\": \"2021-03-10T13:47:12.839725Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476523Z\", \"created\": \"2021-03-10T13:47:32.870012Z\", \"started\": \"2021-03-10T13:47:36.592939Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 31362908, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476685Z\", \"created\": \"2021-03-10T13:47:55.226012Z\", \"started\": \"2021-03-10T13:48:34.834688Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 26235371, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476768Z\", \"created\": \"2021-03-10T13:47:56.326012Z\", \"started\": \"2021-03-10T13:47:58.273150Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31771852, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476844Z\", \"created\": \"2021-03-10T13:48:18.782012Z\", \"started\": \"2021-03-10T13:48:18.806617Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476919Z\", \"created\": \"2021-03-10T13:50:00.050014Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:31.067278Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086Z\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:52.338810Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:20.477018Z\", \"last_device_update\": \"2021-03-10T13:47:41.483965Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T13:53:34.065 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:33 gibba013 bash[9767]: audit 2021-03-10T13:53:33.233293+0000 mon.b (mon.2) 94 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-03-10T13:53:34.065 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:33 gibba013 bash[9767]: audit 2021-03-10T13:53:33.233666+0000 mgr.gibba020.yqfnwy (mgr.34391) 29 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-03-10T13:53:34.066 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:33 gibba013 bash[9767]: cephadm 2021-03-10T13:53:33.234773+0000 mgr.gibba020.yqfnwy (mgr.34391) 30 : cephadm [WRN] Failed to get Dashboard config for AlertManager: dashboard get-alertmanager-api-host failed: Module 'dashboard' has experienced an error and cannot handle commands: Timeout('Port 8443 not free on ::.',) retval: -5 2021-03-10T13:53:34.066 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:33 gibba013 bash[9767]: cephadm 2021-03-10T13:53:33.234868+0000 mgr.gibba020.yqfnwy (mgr.34391) 31 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T13:53:34.067 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:33 gibba013 bash[13024]: audit 2021-03-10T13:53:33.231112+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101607014, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475677Z\", \"created\": \"2021-03-10T13:44:20.530781Z\", \"started\": \"2021-03-10T13:44:20.552250Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba020\", \"container_id\": \"7268fb51c46b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371720192, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475817Z\", \"created\": \"2021-03-10T13:44:37.234781Z\", \"started\": \"2021-03-10T13:52:47.791424Z\"}, \"mgr.gibba020.yqfnwy\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba020.yqfnwy\", \"hostname\": \"gibba020\", \"container_id\": \"24f623ad250b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 401394892, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475899Z\", \"created\": \"2021-03-10T13:44:39.550781Z\", \"started\": \"2021-03-10T13:53:05.133311Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48276439, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475985Z\", \"created\": \"2021-03-10T13:46:23.866010Z\", \"started\": \"2021-03-10T13:46:27.049069Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47185920, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476192Z\", \"created\": \"2021-03-10T13:46:46.746011Z\", \"started\": \"2021-03-10T13:46:49.913581Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46231715, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476360Z\", \"created\": \"2021-03-10T13:47:09.378011Z\", \"started\": \"2021-03-10T13:47:12.839725Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476523Z\", \"created\": \"2021-03-10T13:47:32.870012Z\", \"started\": \"2021-03-10T13:47:36.592939Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 31362908, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476685Z\", \"created\": \"2021-03-10T13:47:55.226012Z\", \"started\": \"2021-03-10T13:48:34.834688Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 26235371, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476768Z\", \"created\": \"2021-03-10T13:47:56.326012Z\", \"started\": \"2021-03-10T13:47:58.273150Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31771852, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476844Z\", \"created\": \"2021-03-10T13:48:18.782012Z\", \"started\": \"2021-03-10T13:48:18.806617Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476919Z\", \"created\": \"2021-03-10T13:50:00.050014Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:31.067278Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086Z\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:52.338810Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:20.477018Z\", \"last_device_update\": \"2021-03-10T13:47:41.483965Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T13:53:34.067 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:33 gibba013 bash[13024]: audit 2021-03-10T13:53:33.233293+0000 mon.b (mon.2) 94 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-03-10T13:53:34.068 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:33 gibba013 bash[13024]: audit 2021-03-10T13:53:33.233666+0000 mgr.gibba020.yqfnwy (mgr.34391) 29 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-03-10T13:53:34.068 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:33 gibba013 bash[13024]: cephadm 2021-03-10T13:53:33.234773+0000 mgr.gibba020.yqfnwy (mgr.34391) 30 : cephadm [WRN] Failed to get Dashboard config for AlertManager: dashboard get-alertmanager-api-host failed: Module 'dashboard' has experienced an error and cannot handle commands: Timeout('Port 8443 not free on ::.',) retval: -5 2021-03-10T13:53:34.068 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:33 gibba013 bash[13024]: cephadm 2021-03-10T13:53:33.234868+0000 mgr.gibba020.yqfnwy (mgr.34391) 31 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T13:53:34.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:33 gibba020 bash[9782]: cluster 2021-03-10T13:53:32.738094+0000 mgr.gibba020.yqfnwy (mgr.34391) 28 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:34.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:33 gibba020 bash[9782]: audit 2021-03-10T13:53:33.217424+0000 mon.b (mon.2) 93 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101607014, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475677Z\", \"created\": \"2021-03-10T13:44:20.530781Z\", \"started\": \"2021-03-10T13:44:20.552250Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba020\", \"container_id\": \"7268fb51c46b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371720192, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475817Z\", \"created\": \"2021-03-10T13:44:37.234781Z\", \"started\": \"2021-03-10T13:52:47.791424Z\"}, \"mgr.gibba020.yqfnwy\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba020.yqfnwy\", \"hostname\": \"gibba020\", \"container_id\": \"24f623ad250b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 401394892, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475899Z\", \"created\": \"2021-03-10T13:44:39.550781Z\", \"started\": \"2021-03-10T13:53:05.133311Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48276439, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475985Z\", \"created\": \"2021-03-10T13:46:23.866010Z\", \"started\": \"2021-03-10T13:46:27.049069Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47185920, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476192Z\", \"created\": \"2021-03-10T13:46:46.746011Z\", \"started\": \"2021-03-10T13:46:49.913581Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46231715, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476360Z\", \"created\": \"2021-03-10T13:47:09.378011Z\", \"started\": \"2021-03-10T13:47:12.839725Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476523Z\", \"created\": \"2021-03-10T13:47:32.870012Z\", \"started\": \"2021-03-10T13:47:36.592939Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 31362908, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476685Z\", \"created\": \"2021-03-10T13:47:55.226012Z\", \"started\": \"2021-03-10T13:48:34.834688Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 26235371, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476768Z\", \"created\": \"2021-03-10T13:47:56.326012Z\", \"started\": \"2021-03-10T13:47:58.273150Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31771852, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476844Z\", \"created\": \"2021-03-10T13:48:18.782012Z\", \"started\": \"2021-03-10T13:48:18.806617Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476919Z\", \"created\": \"2021-03-10T13:50:00.050014Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:31.067278Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086Z\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:52.338810Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:20.477018Z\", \"last_device_update\": \"2021-03-10T13:47:41.483965Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:53:34.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:33 gibba020 bash[9782]: audit 2021-03-10T13:53:33.222296+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101607014, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475677Z\", \"created\": \"2021-03-10T13:44:20.530781Z\", \"started\": \"2021-03-10T13:44:20.552250Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba020\", \"container_id\": \"7268fb51c46b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371720192, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475817Z\", \"created\": \"2021-03-10T13:44:37.234781Z\", \"started\": \"2021-03-10T13:52:47.791424Z\"}, \"mgr.gibba020.yqfnwy\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba020.yqfnwy\", \"hostname\": \"gibba020\", \"container_id\": \"24f623ad250b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 401394892, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475899Z\", \"created\": \"2021-03-10T13:44:39.550781Z\", \"started\": \"2021-03-10T13:53:05.133311Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48276439, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475985Z\", \"created\": \"2021-03-10T13:46:23.866010Z\", \"started\": \"2021-03-10T13:46:27.049069Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47185920, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476192Z\", \"created\": \"2021-03-10T13:46:46.746011Z\", \"started\": \"2021-03-10T13:46:49.913581Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46231715, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476360Z\", \"created\": \"2021-03-10T13:47:09.378011Z\", \"started\": \"2021-03-10T13:47:12.839725Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476523Z\", \"created\": \"2021-03-10T13:47:32.870012Z\", \"started\": \"2021-03-10T13:47:36.592939Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 31362908, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476685Z\", \"created\": \"2021-03-10T13:47:55.226012Z\", \"started\": \"2021-03-10T13:48:34.834688Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 26235371, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476768Z\", \"created\": \"2021-03-10T13:47:56.326012Z\", \"started\": \"2021-03-10T13:47:58.273150Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31771852, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476844Z\", \"created\": \"2021-03-10T13:48:18.782012Z\", \"started\": \"2021-03-10T13:48:18.806617Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476919Z\", \"created\": \"2021-03-10T13:50:00.050014Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:31.067278Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086Z\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:52.338810Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:20.477018Z\", \"last_device_update\": \"2021-03-10T13:47:41.483965Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:53:34.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:33 gibba020 bash[9782]: audit 2021-03-10T13:53:33.231112+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101607014, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475677Z\", \"created\": \"2021-03-10T13:44:20.530781Z\", \"started\": \"2021-03-10T13:44:20.552250Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba020\", \"container_id\": \"7268fb51c46b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371720192, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475817Z\", \"created\": \"2021-03-10T13:44:37.234781Z\", \"started\": \"2021-03-10T13:52:47.791424Z\"}, \"mgr.gibba020.yqfnwy\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba020.yqfnwy\", \"hostname\": \"gibba020\", \"container_id\": \"24f623ad250b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 401394892, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475899Z\", \"created\": \"2021-03-10T13:44:39.550781Z\", \"started\": \"2021-03-10T13:53:05.133311Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48276439, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475985Z\", \"created\": \"2021-03-10T13:46:23.866010Z\", \"started\": \"2021-03-10T13:46:27.049069Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47185920, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476192Z\", \"created\": \"2021-03-10T13:46:46.746011Z\", \"started\": \"2021-03-10T13:46:49.913581Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46231715, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476360Z\", \"created\": \"2021-03-10T13:47:09.378011Z\", \"started\": \"2021-03-10T13:47:12.839725Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476523Z\", \"created\": \"2021-03-10T13:47:32.870012Z\", \"started\": \"2021-03-10T13:47:36.592939Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 31362908, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476685Z\", \"created\": \"2021-03-10T13:47:55.226012Z\", \"started\": \"2021-03-10T13:48:34.834688Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 26235371, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476768Z\", \"created\": \"2021-03-10T13:47:56.326012Z\", \"started\": \"2021-03-10T13:47:58.273150Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31771852, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476844Z\", \"created\": \"2021-03-10T13:48:18.782012Z\", \"started\": \"2021-03-10T13:48:18.806617Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476919Z\", \"created\": \"2021-03-10T13:50:00.050014Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:31.067278Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086Z\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:52.338810Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:20.477018Z\", \"last_device_update\": \"2021-03-10T13:47:41.483965Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:43:51.519080Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T13:53:34.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:33 gibba020 bash[9782]: audit 2021-03-10T13:53:33.233293+0000 mon.b (mon.2) 94 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-03-10T13:53:34.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:33 gibba020 bash[9782]: audit 2021-03-10T13:53:33.233666+0000 mgr.gibba020.yqfnwy (mgr.34391) 29 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-03-10T13:53:34.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:33 gibba020 bash[9782]: cephadm 2021-03-10T13:53:33.234773+0000 mgr.gibba020.yqfnwy (mgr.34391) 30 : cephadm [WRN] Failed to get Dashboard config for AlertManager: dashboard get-alertmanager-api-host failed: Module 'dashboard' has experienced an error and cannot handle commands: Timeout('Port 8443 not free on ::.',) retval: -5 2021-03-10T13:53:34.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:33 gibba020 bash[9782]: cephadm 2021-03-10T13:53:33.234868+0000 mgr.gibba020.yqfnwy (mgr.34391) 31 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T13:53:34.378 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:53:34 gibba013 bash[27996]: level=info ts=2021-03-10T13:53:34.059Z caller=cluster.go:648 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000138937s 2021-03-10T13:53:35.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:35 gibba013 bash[9767]: cluster 2021-03-10T13:53:34.739262+0000 mgr.gibba020.yqfnwy (mgr.34391) 32 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:35.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:35 gibba013 bash[9767]: audit 2021-03-10T13:53:35.421246+0000 mon.b (mon.2) 95 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"ecb495d6-04bf-47bb-ad7b-145e7a1a6bcc\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]: dispatch 2021-03-10T13:53:35.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:35 gibba013 bash[9767]: audit 2021-03-10T13:53:35.425339+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"ecb495d6-04bf-47bb-ad7b-145e7a1a6bcc\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]: dispatch 2021-03-10T13:53:35.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:35 gibba013 bash[9767]: audit 2021-03-10T13:53:35.429698+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"ecb495d6-04bf-47bb-ad7b-145e7a1a6bcc\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]': finished 2021-03-10T13:53:35.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:35 gibba013 bash[9767]: audit 2021-03-10T13:53:35.432704+0000 mon.b (mon.2) 96 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:53:35.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:35 gibba013 bash[13024]: cluster 2021-03-10T13:53:34.739262+0000 mgr.gibba020.yqfnwy (mgr.34391) 32 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:35.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:35 gibba013 bash[13024]: audit 2021-03-10T13:53:35.421246+0000 mon.b (mon.2) 95 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"ecb495d6-04bf-47bb-ad7b-145e7a1a6bcc\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]: dispatch 2021-03-10T13:53:35.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:35 gibba013 bash[13024]: audit 2021-03-10T13:53:35.425339+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"ecb495d6-04bf-47bb-ad7b-145e7a1a6bcc\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]: dispatch 2021-03-10T13:53:35.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:35 gibba013 bash[13024]: audit 2021-03-10T13:53:35.429698+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"ecb495d6-04bf-47bb-ad7b-145e7a1a6bcc\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]': finished 2021-03-10T13:53:35.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:35 gibba013 bash[13024]: audit 2021-03-10T13:53:35.432704+0000 mon.b (mon.2) 96 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:53:36.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:35 gibba020 bash[9782]: cluster 2021-03-10T13:53:34.739262+0000 mgr.gibba020.yqfnwy (mgr.34391) 32 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:36.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:35 gibba020 bash[9782]: audit 2021-03-10T13:53:35.421246+0000 mon.b (mon.2) 95 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"ecb495d6-04bf-47bb-ad7b-145e7a1a6bcc\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]: dispatch 2021-03-10T13:53:36.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:35 gibba020 bash[9782]: audit 2021-03-10T13:53:35.425339+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"ecb495d6-04bf-47bb-ad7b-145e7a1a6bcc\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]: dispatch 2021-03-10T13:53:36.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:35 gibba020 bash[9782]: audit 2021-03-10T13:53:35.429698+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"ecb495d6-04bf-47bb-ad7b-145e7a1a6bcc\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]': finished 2021-03-10T13:53:36.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:35 gibba020 bash[9782]: audit 2021-03-10T13:53:35.432704+0000 mon.b (mon.2) 96 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:53:37.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:36 gibba013 bash[9767]: cephadm 2021-03-10T13:53:35.432048+0000 mgr.gibba020.yqfnwy (mgr.34391) 33 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:53:37.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:36 gibba013 bash[9767]: cephadm 2021-03-10T13:53:35.433678+0000 mgr.gibba020.yqfnwy (mgr.34391) 34 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:53:37.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:36 gibba013 bash[9767]: cephadm 2021-03-10T13:53:35.433865+0000 mgr.gibba020.yqfnwy (mgr.34391) 35 : cephadm [INF] Upgrade: It is presumed safe to stop ['mgr.y'] 2021-03-10T13:53:37.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:36 gibba013 bash[13024]: cephadm 2021-03-10T13:53:35.432048+0000 mgr.gibba020.yqfnwy (mgr.34391) 33 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:53:37.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:36 gibba013 bash[13024]: cephadm 2021-03-10T13:53:35.433678+0000 mgr.gibba020.yqfnwy (mgr.34391) 34 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:53:37.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:36 gibba013 bash[13024]: cephadm 2021-03-10T13:53:35.433865+0000 mgr.gibba020.yqfnwy (mgr.34391) 35 : cephadm [INF] Upgrade: It is presumed safe to stop ['mgr.y'] 2021-03-10T13:53:37.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:36 gibba020 bash[9782]: cephadm 2021-03-10T13:53:35.432048+0000 mgr.gibba020.yqfnwy (mgr.34391) 33 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:53:37.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:36 gibba020 bash[9782]: cephadm 2021-03-10T13:53:35.433678+0000 mgr.gibba020.yqfnwy (mgr.34391) 34 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:53:37.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:36 gibba020 bash[9782]: cephadm 2021-03-10T13:53:35.433865+0000 mgr.gibba020.yqfnwy (mgr.34391) 35 : cephadm [INF] Upgrade: It is presumed safe to stop ['mgr.y'] 2021-03-10T13:53:38.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:37 gibba013 bash[9767]: cluster 2021-03-10T13:53:36.745114+0000 mgr.gibba020.yqfnwy (mgr.34391) 36 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:38.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:37 gibba013 bash[9767]: cephadm 2021-03-10T13:53:37.202335+0000 mgr.gibba020.yqfnwy (mgr.34391) 37 : cephadm [INF] Upgrade: Updating mgr.y 2021-03-10T13:53:38.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:37 gibba013 bash[9767]: audit 2021-03-10T13:53:37.203380+0000 mon.b (mon.2) 97 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.y"}]: dispatch 2021-03-10T13:53:38.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:37 gibba013 bash[9767]: audit 2021-03-10T13:53:37.207459+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.y"}]: dispatch 2021-03-10T13:53:38.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:37 gibba013 bash[9767]: audit 2021-03-10T13:53:37.212015+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.y"}]': finished 2021-03-10T13:53:38.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:37 gibba013 bash[9767]: audit 2021-03-10T13:53:37.215076+0000 mon.b (mon.2) 98 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:53:38.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:37 gibba013 bash[9767]: audit 2021-03-10T13:53:37.216210+0000 mon.b (mon.2) 99 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T13:53:38.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:37 gibba013 bash[9767]: audit 2021-03-10T13:53:37.217318+0000 mon.b (mon.2) 100 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:53:38.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:37 gibba013 bash[9767]: cephadm 2021-03-10T13:53:37.217885+0000 mgr.gibba020.yqfnwy (mgr.34391) 38 : cephadm [INF] Deploying daemon mgr.y on gibba013 2021-03-10T13:53:38.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:37 gibba013 bash[9767]: audit 2021-03-10T13:53:37.218144+0000 mon.b (mon.2) 101 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2021-03-10T13:53:38.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:37 gibba013 bash[9767]: audit 2021-03-10T13:53:37.218407+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:53:38.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:37 gibba013 bash[13024]: cluster 2021-03-10T13:53:36.745114+0000 mgr.gibba020.yqfnwy (mgr.34391) 36 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:38.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:37 gibba013 bash[13024]: cephadm 2021-03-10T13:53:37.202335+0000 mgr.gibba020.yqfnwy (mgr.34391) 37 : cephadm [INF] Upgrade: Updating mgr.y 2021-03-10T13:53:38.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:37 gibba013 bash[13024]: audit 2021-03-10T13:53:37.203380+0000 mon.b (mon.2) 97 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.y"}]: dispatch 2021-03-10T13:53:38.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:37 gibba013 bash[13024]: audit 2021-03-10T13:53:37.207459+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.y"}]: dispatch 2021-03-10T13:53:38.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:37 gibba013 bash[13024]: audit 2021-03-10T13:53:37.212015+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.y"}]': finished 2021-03-10T13:53:38.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:37 gibba013 bash[13024]: audit 2021-03-10T13:53:37.215076+0000 mon.b (mon.2) 98 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:53:38.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:37 gibba013 bash[13024]: audit 2021-03-10T13:53:37.216210+0000 mon.b (mon.2) 99 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T13:53:38.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:37 gibba013 bash[13024]: audit 2021-03-10T13:53:37.217318+0000 mon.b (mon.2) 100 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:53:38.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:37 gibba013 bash[13024]: cephadm 2021-03-10T13:53:37.217885+0000 mgr.gibba020.yqfnwy (mgr.34391) 38 : cephadm [INF] Deploying daemon mgr.y on gibba013 2021-03-10T13:53:38.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:37 gibba013 bash[13024]: audit 2021-03-10T13:53:37.218144+0000 mon.b (mon.2) 101 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2021-03-10T13:53:38.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:37 gibba013 bash[13024]: audit 2021-03-10T13:53:37.218407+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:53:38.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:37 gibba020 bash[9782]: cluster 2021-03-10T13:53:36.745114+0000 mgr.gibba020.yqfnwy (mgr.34391) 36 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:38.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:37 gibba020 bash[9782]: cephadm 2021-03-10T13:53:37.202335+0000 mgr.gibba020.yqfnwy (mgr.34391) 37 : cephadm [INF] Upgrade: Updating mgr.y 2021-03-10T13:53:38.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:37 gibba020 bash[9782]: audit 2021-03-10T13:53:37.203380+0000 mon.b (mon.2) 97 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.y"}]: dispatch 2021-03-10T13:53:38.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:37 gibba020 bash[9782]: audit 2021-03-10T13:53:37.207459+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.y"}]: dispatch 2021-03-10T13:53:38.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:37 gibba020 bash[9782]: audit 2021-03-10T13:53:37.212015+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr.y"}]': finished 2021-03-10T13:53:38.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:37 gibba020 bash[9782]: audit 2021-03-10T13:53:37.215076+0000 mon.b (mon.2) 98 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:53:38.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:37 gibba020 bash[9782]: audit 2021-03-10T13:53:37.216210+0000 mon.b (mon.2) 99 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T13:53:38.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:37 gibba020 bash[9782]: audit 2021-03-10T13:53:37.217318+0000 mon.b (mon.2) 100 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:53:38.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:37 gibba020 bash[9782]: cephadm 2021-03-10T13:53:37.217885+0000 mgr.gibba020.yqfnwy (mgr.34391) 38 : cephadm [INF] Deploying daemon mgr.y on gibba013 2021-03-10T13:53:38.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:37 gibba020 bash[9782]: audit 2021-03-10T13:53:37.218144+0000 mon.b (mon.2) 101 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2021-03-10T13:53:38.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:37 gibba020 bash[9782]: audit 2021-03-10T13:53:37.218407+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:53:39.378 INFO:journalctl@ceph.mgr.y.gibba013.stdout:Mar 10 13:53:39 gibba013 systemd[1]: Stopping Ceph mgr.y for 7672acc8-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:53:40.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:39 gibba013 bash[9767]: cluster 2021-03-10T13:53:38.746128+0000 mgr.gibba020.yqfnwy (mgr.34391) 39 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:40.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:39 gibba013 bash[13024]: cluster 2021-03-10T13:53:38.746128+0000 mgr.gibba020.yqfnwy (mgr.34391) 39 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:40.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:39 gibba020 bash[9782]: cluster 2021-03-10T13:53:38.746128+0000 mgr.gibba020.yqfnwy (mgr.34391) 39 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:41.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:41 gibba020 bash[9782]: cluster 2021-03-10T13:53:40.747152+0000 mgr.gibba020.yqfnwy (mgr.34391) 40 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:42.059 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:41 gibba013 bash[9767]: cluster 2021-03-10T13:53:40.747152+0000 mgr.gibba020.yqfnwy (mgr.34391) 40 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:42.060 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:41 gibba013 bash[13024]: cluster 2021-03-10T13:53:40.747152+0000 mgr.gibba020.yqfnwy (mgr.34391) 40 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:42.378 INFO:journalctl@ceph.alertmanager.a.gibba013.stdout:Mar 10 13:53:42 gibba013 bash[27996]: level=info ts=2021-03-10T13:53:42.060Z caller=cluster.go:640 component=cluster msg="gossip settled; proceeding" elapsed=10.001049564s 2021-03-10T13:53:44.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:43 gibba013 bash[9767]: cluster 2021-03-10T13:53:42.749253+0000 mgr.gibba020.yqfnwy (mgr.34391) 41 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:44.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:43 gibba013 bash[13024]: cluster 2021-03-10T13:53:42.749253+0000 mgr.gibba020.yqfnwy (mgr.34391) 41 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:44.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:43 gibba020 bash[9782]: cluster 2021-03-10T13:53:42.749253+0000 mgr.gibba020.yqfnwy (mgr.34391) 41 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:46.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:45 gibba013 bash[9767]: cluster 2021-03-10T13:53:44.750392+0000 mgr.gibba020.yqfnwy (mgr.34391) 42 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:46.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:45 gibba013 bash[13024]: cluster 2021-03-10T13:53:44.750392+0000 mgr.gibba020.yqfnwy (mgr.34391) 42 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:46.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:45 gibba020 bash[9782]: cluster 2021-03-10T13:53:44.750392+0000 mgr.gibba020.yqfnwy (mgr.34391) 42 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:48.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:47 gibba013 bash[9767]: cluster 2021-03-10T13:53:46.751329+0000 mgr.gibba020.yqfnwy (mgr.34391) 43 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:48.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:47 gibba013 bash[13024]: cluster 2021-03-10T13:53:46.751329+0000 mgr.gibba020.yqfnwy (mgr.34391) 43 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:48.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:47 gibba020 bash[9782]: cluster 2021-03-10T13:53:46.751329+0000 mgr.gibba020.yqfnwy (mgr.34391) 43 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:50.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:49 gibba013 bash[9767]: cluster 2021-03-10T13:53:48.752144+0000 mgr.gibba020.yqfnwy (mgr.34391) 44 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:50.133 INFO:journalctl@ceph.mgr.y.gibba013.stdout:Mar 10 13:53:49 gibba013 docker[28342]: ceph-7672acc8-81a6-11eb-9080-001a4aab830c-mgr.y 2021-03-10T13:53:50.133 INFO:journalctl@ceph.mgr.y.gibba013.stdout:Mar 10 13:53:49 gibba013 systemd[1]: ceph-7672acc8-81a6-11eb-9080-001a4aab830c@mgr.y.service: Main process exited, code=exited, status=137/n/a 2021-03-10T13:53:50.133 INFO:journalctl@ceph.mgr.y.gibba013.stdout:Mar 10 13:53:49 gibba013 systemd[1]: ceph-7672acc8-81a6-11eb-9080-001a4aab830c@mgr.y.service: Failed with result 'exit-code'. 2021-03-10T13:53:50.133 INFO:journalctl@ceph.mgr.y.gibba013.stdout:Mar 10 13:53:49 gibba013 systemd[1]: Stopped Ceph mgr.y for 7672acc8-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:53:50.134 INFO:journalctl@ceph.mgr.y.gibba013.stdout:Mar 10 13:53:50 gibba013 systemd[1]: Started Ceph mgr.y for 7672acc8-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:53:50.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:49 gibba013 bash[13024]: cluster 2021-03-10T13:53:48.752144+0000 mgr.gibba020.yqfnwy (mgr.34391) 44 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:50.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:49 gibba020 bash[9782]: cluster 2021-03-10T13:53:48.752144+0000 mgr.gibba020.yqfnwy (mgr.34391) 44 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:51.128 INFO:journalctl@ceph.mgr.y.gibba013.stdout:Mar 10 13:53:51 gibba013 bash[28437]: debug 2021-03-10T13:53:51.108+0000 7fb36d23c700 1 -- 172.21.2.113:0/2870476588 <== mon.0 v2:172.21.2.113:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5601f99004e0 con 0x5601f99f0c00 2021-03-10T13:53:51.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:50 gibba013 bash[9767]: audit 2021-03-10T13:53:50.071921+0000 mon.b (mon.2) 102 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:37.217814Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\"}"}]: dispatch 2021-03-10T13:53:51.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:50 gibba013 bash[13024]: audit 2021-03-10T13:53:50.071921+0000 mon.b (mon.2) 102 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:37.217814Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\"}"}]: dispatch 2021-03-10T13:53:51.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:50 gibba013 bash[13024]: audit 2021-03-10T13:53:50.075469+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:37.217814Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\"}"}]: dispatch 2021-03-10T13:53:51.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:50 gibba013 bash[9767]: audit 2021-03-10T13:53:50.075469+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:37.217814Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\"}"}]: dispatch 2021-03-10T13:53:51.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:50 gibba013 bash[13024]: audit 2021-03-10T13:53:50.078730+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:37.217814Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\"}"}]': finished 2021-03-10T13:53:51.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:50 gibba013 bash[13024]: audit 2021-03-10T13:53:50.080063+0000 mon.b (mon.2) 103 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:53:51.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:50 gibba013 bash[9767]: audit 2021-03-10T13:53:50.078730+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:37.217814Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\"}"}]': finished 2021-03-10T13:53:51.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:50 gibba013 bash[9767]: audit 2021-03-10T13:53:50.080063+0000 mon.b (mon.2) 103 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:53:51.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:50 gibba013 bash[13024]: audit 2021-03-10T13:53:50.276153+0000 mon.b (mon.2) 104 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:37.217814Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:53:50.272497Z\"}"}]: dispatch 2021-03-10T13:53:51.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:50 gibba013 bash[9767]: audit 2021-03-10T13:53:50.276153+0000 mon.b (mon.2) 104 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:37.217814Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:53:50.272497Z\"}"}]: dispatch 2021-03-10T13:53:51.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:50 gibba013 bash[13024]: audit 2021-03-10T13:53:50.280108+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:37.217814Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:53:50.272497Z\"}"}]: dispatch 2021-03-10T13:53:51.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:50 gibba013 bash[13024]: audit 2021-03-10T13:53:50.283855+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:37.217814Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:53:50.272497Z\"}"}]': finished 2021-03-10T13:53:51.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:50 gibba013 bash[13024]: audit 2021-03-10T13:53:50.289218+0000 mon.b (mon.2) 105 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:53:51.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:50 gibba013 bash[9767]: audit 2021-03-10T13:53:50.280108+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:37.217814Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:53:50.272497Z\"}"}]: dispatch 2021-03-10T13:53:51.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:50 gibba013 bash[9767]: audit 2021-03-10T13:53:50.283855+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:37.217814Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:53:50.272497Z\"}"}]': finished 2021-03-10T13:53:51.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:50 gibba013 bash[9767]: audit 2021-03-10T13:53:50.289218+0000 mon.b (mon.2) 105 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:53:51.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:50 gibba020 bash[9782]: audit 2021-03-10T13:53:50.071921+0000 mon.b (mon.2) 102 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:37.217814Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\"}"}]: dispatch 2021-03-10T13:53:51.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:50 gibba020 bash[9782]: audit 2021-03-10T13:53:50.075469+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:37.217814Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\"}"}]: dispatch 2021-03-10T13:53:51.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:50 gibba020 bash[9782]: audit 2021-03-10T13:53:50.078730+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:37.217814Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:43:20.026394Z\"}"}]': finished 2021-03-10T13:53:51.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:50 gibba020 bash[9782]: audit 2021-03-10T13:53:50.080063+0000 mon.b (mon.2) 103 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:53:51.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:50 gibba020 bash[9782]: audit 2021-03-10T13:53:50.276153+0000 mon.b (mon.2) 104 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:37.217814Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:53:50.272497Z\"}"}]: dispatch 2021-03-10T13:53:51.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:50 gibba020 bash[9782]: audit 2021-03-10T13:53:50.280108+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:37.217814Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:53:50.272497Z\"}"}]: dispatch 2021-03-10T13:53:51.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:50 gibba020 bash[9782]: audit 2021-03-10T13:53:50.283855+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96930365, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718282Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94025809, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718484Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48842670, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718538Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49387929, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718703Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45780828, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718822Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.718939Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25249710, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:19.719050Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:37.217814Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:53:50.272497Z\"}"}]': finished 2021-03-10T13:53:51.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:50 gibba020 bash[9782]: audit 2021-03-10T13:53:50.289218+0000 mon.b (mon.2) 105 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:53:51.598 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T13:53:51.858 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:53:51.858 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 starting - - 2021-03-10T13:53:51.858 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (5m) 31s ago 5m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T13:53:51.858 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (46s) 31s ago 9m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T13:53:51.859 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (64s) 31s ago 9m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T13:53:51.859 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 starting - - 2021-03-10T13:53:51.859 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (10m) 32s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 02bb13cc8f40 2021-03-10T13:53:51.859 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (9m) 31s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a58fc42cd46b 2021-03-10T13:53:51.860 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (9m) 32s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 c561d31798a4 2021-03-10T13:53:51.860 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (5m) 32s ago 5m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T13:53:51.860 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (5m) 31s ago 5m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T13:53:51.860 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (8m) 32s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 bf4441d660ac 2021-03-10T13:53:51.860 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (8m) 32s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 385800e8f97f 2021-03-10T13:53:51.861 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (8m) 32s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d0a99b0fd1fc 2021-03-10T13:53:51.861 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (7m) 32s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d0b507f36a88 2021-03-10T13:53:51.861 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (7m) 31s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5bcc0da1a794 2021-03-10T13:53:51.861 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (7m) 31s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 8e0d292ca03b 2021-03-10T13:53:51.861 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (6m) 31s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b54758e37be1 2021-03-10T13:53:51.862 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (6m) 31s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 75c9ee8106fc 2021-03-10T13:53:51.862 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (5m) 31s ago 5m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T13:53:51.862 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 31s ago 3m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:53:52.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:51 gibba013 bash[13024]: cluster 2021-03-10T13:53:50.753538+0000 mgr.gibba020.yqfnwy (mgr.34391) 45 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:52.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:51 gibba013 bash[9767]: cluster 2021-03-10T13:53:50.753538+0000 mgr.gibba020.yqfnwy (mgr.34391) 45 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:52.152 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T13:53:52.153 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T13:53:52.153 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2021-03-10T13:53:52.153 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:53:52.153 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T13:53:52.154 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 1, 2021-03-10T13:53:52.154 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 2 2021-03-10T13:53:52.154 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:53:52.154 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T13:53:52.155 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2021-03-10T13:53:52.155 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:53:52.155 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T13:53:52.155 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T13:53:52.155 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 12, 2021-03-10T13:53:52.156 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 2 2021-03-10T13:53:52.156 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T13:53:52.156 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T13:53:52.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:51 gibba020 bash[9782]: cluster 2021-03-10T13:53:50.753538+0000 mgr.gibba020.yqfnwy (mgr.34391) 45 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:53.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:52 gibba013 bash[9767]: audit 2021-03-10T13:53:51.587188+0000 mgr.gibba020.yqfnwy (mgr.34391) 46 : audit [DBG] from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:53:53.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:52 gibba013 bash[9767]: audit 2021-03-10T13:53:51.821672+0000 mgr.gibba020.yqfnwy (mgr.34391) 47 : audit [DBG] from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:53:53.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:52 gibba013 bash[9767]: audit 2021-03-10T13:53:52.153732+0000 mon.a (mon.0) 668 : audit [DBG] from='client.? 172.21.2.113:0/855498429' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:53.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:52 gibba013 bash[13024]: audit 2021-03-10T13:53:51.587188+0000 mgr.gibba020.yqfnwy (mgr.34391) 46 : audit [DBG] from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:53:53.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:52 gibba013 bash[13024]: audit 2021-03-10T13:53:51.821672+0000 mgr.gibba020.yqfnwy (mgr.34391) 47 : audit [DBG] from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:53:53.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:52 gibba013 bash[13024]: audit 2021-03-10T13:53:52.153732+0000 mon.a (mon.0) 668 : audit [DBG] from='client.? 172.21.2.113:0/855498429' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:53.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:52 gibba020 bash[9782]: audit 2021-03-10T13:53:51.587188+0000 mgr.gibba020.yqfnwy (mgr.34391) 46 : audit [DBG] from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:53:53.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:52 gibba020 bash[9782]: audit 2021-03-10T13:53:51.821672+0000 mgr.gibba020.yqfnwy (mgr.34391) 47 : audit [DBG] from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:53:53.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:52 gibba020 bash[9782]: audit 2021-03-10T13:53:52.153732+0000 mon.a (mon.0) 668 : audit [DBG] from='client.? 172.21.2.113:0/855498429' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:54.169 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:53 gibba013 bash[9767]: cluster 2021-03-10T13:53:52.755658+0000 mgr.gibba020.yqfnwy (mgr.34391) 48 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:54.170 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:53 gibba013 bash[13024]: cluster 2021-03-10T13:53:52.755658+0000 mgr.gibba020.yqfnwy (mgr.34391) 48 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:54.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:53 gibba020 bash[9782]: cluster 2021-03-10T13:53:52.755658+0000 mgr.gibba020.yqfnwy (mgr.34391) 48 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:55.196 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[9767]: audit 2021-03-10T13:53:53.933387+0000 mon.b (mon.2) 106 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 102928220, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.930815Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"7609af74159c\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 157496115, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.930974Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:53:50.102625Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94162124, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931067Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49146757, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931152Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49408901, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931387Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45927628, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931570Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48087695, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931746Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25417482, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931921Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a7c14b180bbc\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12383682, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.932030Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:53:31.062073Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:37.217814Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:53.932172Z\", \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:53:50.272497Z\"}"}]: dispatch 2021-03-10T13:53:55.197 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[13024]: audit 2021-03-10T13:53:53.933387+0000 mon.b (mon.2) 106 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 102928220, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.930815Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"7609af74159c\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 157496115, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.930974Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:53:50.102625Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94162124, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931067Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49146757, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931152Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49408901, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931387Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45927628, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931570Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48087695, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931746Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25417482, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931921Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a7c14b180bbc\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12383682, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.932030Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:53:31.062073Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:37.217814Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:53.932172Z\", \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:53:50.272497Z\"}"}]: dispatch 2021-03-10T13:53:55.198 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[9767]: audit 2021-03-10T13:53:53.936929+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 102928220, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.930815Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"7609af74159c\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 157496115, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.930974Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:53:50.102625Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94162124, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931067Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49146757, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931152Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49408901, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931387Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45927628, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931570Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48087695, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931746Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25417482, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931921Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a7c14b180bbc\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12383682, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.932030Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:53:31.062073Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:37.217814Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:53.932172Z\", \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:53:50.272497Z\"}"}]: dispatch 2021-03-10T13:53:55.198 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[9767]: audit 2021-03-10T13:53:53.940158+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 102928220, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.930815Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"7609af74159c\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 157496115, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.930974Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:53:50.102625Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94162124, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931067Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49146757, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931152Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49408901, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931387Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45927628, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931570Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48087695, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931746Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25417482, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931921Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a7c14b180bbc\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12383682, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.932030Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:53:31.062073Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:37.217814Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:53.932172Z\", \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:53:50.272497Z\"}"}]': finished 2021-03-10T13:53:55.198 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[9767]: audit 2021-03-10T13:53:53.940219+0000 mon.b (mon.2) 107 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:53:55.198 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[9767]: audit 2021-03-10T13:53:53.943472+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:53:55.199 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[9767]: audit 2021-03-10T13:53:53.946002+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2021-03-10T13:53:55.199 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[9767]: cephadm 2021-03-10T13:53:53.951738+0000 mgr.gibba020.yqfnwy (mgr.34391) 49 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:53:55.199 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[9767]: audit 2021-03-10T13:53:53.952361+0000 mon.b (mon.2) 108 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:53:55.199 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[9767]: cephadm 2021-03-10T13:53:53.953411+0000 mgr.gibba020.yqfnwy (mgr.34391) 50 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:53:55.200 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[9767]: audit 2021-03-10T13:53:53.953610+0000 mon.b (mon.2) 109 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:55.200 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[13024]: audit 2021-03-10T13:53:53.936929+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 102928220, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.930815Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"7609af74159c\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 157496115, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.930974Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:53:50.102625Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94162124, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931067Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49146757, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931152Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49408901, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931387Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45927628, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931570Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48087695, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931746Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25417482, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931921Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a7c14b180bbc\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12383682, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.932030Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:53:31.062073Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:37.217814Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:53.932172Z\", \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:53:50.272497Z\"}"}]: dispatch 2021-03-10T13:53:55.201 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[13024]: audit 2021-03-10T13:53:53.940158+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 102928220, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.930815Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"7609af74159c\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 157496115, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.930974Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:53:50.102625Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94162124, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931067Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49146757, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931152Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49408901, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931387Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45927628, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931570Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48087695, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931746Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25417482, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931921Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a7c14b180bbc\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12383682, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.932030Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:53:31.062073Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:37.217814Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:53.932172Z\", \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:53:50.272497Z\"}"}]': finished 2021-03-10T13:53:55.201 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[13024]: audit 2021-03-10T13:53:53.940219+0000 mon.b (mon.2) 107 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:53:55.201 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[13024]: audit 2021-03-10T13:53:53.943472+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:53:55.201 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[13024]: audit 2021-03-10T13:53:53.946002+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2021-03-10T13:53:55.202 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[13024]: cephadm 2021-03-10T13:53:53.951738+0000 mgr.gibba020.yqfnwy (mgr.34391) 49 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:53:55.202 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[13024]: audit 2021-03-10T13:53:53.952361+0000 mon.b (mon.2) 108 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:53:55.202 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[13024]: cephadm 2021-03-10T13:53:53.953411+0000 mgr.gibba020.yqfnwy (mgr.34391) 50 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:53:55.202 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[13024]: audit 2021-03-10T13:53:53.953610+0000 mon.b (mon.2) 109 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:55.203 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[9767]: cephadm 2021-03-10T13:53:53.954301+0000 mgr.gibba020.yqfnwy (mgr.34391) 51 : cephadm [WRN] Upgrade: 1 mgr daemon(s) are 15.2.0 != target 17.0.0-1749-gb26fc080 2021-03-10T13:53:55.203 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[9767]: cephadm 2021-03-10T13:53:53.954343+0000 mgr.gibba020.yqfnwy (mgr.34391) 52 : cephadm [INF] Upgrade: Setting container_image for all mgr 2021-03-10T13:53:55.203 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[9767]: audit 2021-03-10T13:53:53.954490+0000 mon.b (mon.2) 110 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr"}]: dispatch 2021-03-10T13:53:55.203 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[9767]: audit 2021-03-10T13:53:53.957708+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr"}]: dispatch 2021-03-10T13:53:55.204 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[9767]: audit 2021-03-10T13:53:53.958832+0000 mon.b (mon.2) 111 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba020.yqfnwy"}]: dispatch 2021-03-10T13:53:55.204 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[9767]: audit 2021-03-10T13:53:53.960536+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr"}]': finished 2021-03-10T13:53:55.204 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[9767]: audit 2021-03-10T13:53:53.962036+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba020.yqfnwy"}]: dispatch 2021-03-10T13:53:55.204 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[9767]: audit 2021-03-10T13:53:53.963396+0000 mon.b (mon.2) 112 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2021-03-10T13:53:55.205 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[9767]: audit 2021-03-10T13:53:53.964988+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba020.yqfnwy"}]': finished 2021-03-10T13:53:55.205 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[9767]: audit 2021-03-10T13:53:53.966657+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2021-03-10T13:53:55.205 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[9767]: audit 2021-03-10T13:53:53.967760+0000 mon.b (mon.2) 113 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2021-03-10T13:53:55.205 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[9767]: audit 2021-03-10T13:53:53.969571+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2021-03-10T13:53:55.205 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[9767]: audit 2021-03-10T13:53:53.970986+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2021-03-10T13:53:55.206 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[9767]: cephadm 2021-03-10T13:53:53.972047+0000 mgr.gibba020.yqfnwy (mgr.34391) 53 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:53:55.206 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[9767]: cephadm 2021-03-10T13:53:53.972095+0000 mgr.gibba020.yqfnwy (mgr.34391) 54 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:53:55.206 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[9767]: audit 2021-03-10T13:53:53.972344+0000 mon.b (mon.2) 114 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2021-03-10T13:53:55.206 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[9767]: cephadm 2021-03-10T13:53:53.972870+0000 mgr.gibba020.yqfnwy (mgr.34391) 55 : cephadm [INF] It is presumed safe to stop mon.a 2021-03-10T13:53:55.207 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[9767]: cephadm 2021-03-10T13:53:53.972922+0000 mgr.gibba020.yqfnwy (mgr.34391) 56 : cephadm [INF] Upgrade: It is presumed safe to stop mon.a 2021-03-10T13:53:55.207 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[9767]: audit 2021-03-10T13:53:53.973655+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2021-03-10T13:53:55.207 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[13024]: cephadm 2021-03-10T13:53:53.954301+0000 mgr.gibba020.yqfnwy (mgr.34391) 51 : cephadm [WRN] Upgrade: 1 mgr daemon(s) are 15.2.0 != target 17.0.0-1749-gb26fc080 2021-03-10T13:53:55.208 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[13024]: cephadm 2021-03-10T13:53:53.954343+0000 mgr.gibba020.yqfnwy (mgr.34391) 52 : cephadm [INF] Upgrade: Setting container_image for all mgr 2021-03-10T13:53:55.208 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[13024]: audit 2021-03-10T13:53:53.954490+0000 mon.b (mon.2) 110 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr"}]: dispatch 2021-03-10T13:53:55.208 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[13024]: audit 2021-03-10T13:53:53.957708+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr"}]: dispatch 2021-03-10T13:53:55.208 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[13024]: audit 2021-03-10T13:53:53.958832+0000 mon.b (mon.2) 111 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba020.yqfnwy"}]: dispatch 2021-03-10T13:53:55.208 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[13024]: audit 2021-03-10T13:53:53.960536+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr"}]': finished 2021-03-10T13:53:55.209 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[13024]: audit 2021-03-10T13:53:53.962036+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba020.yqfnwy"}]: dispatch 2021-03-10T13:53:55.209 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[13024]: audit 2021-03-10T13:53:53.963396+0000 mon.b (mon.2) 112 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2021-03-10T13:53:55.209 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[13024]: audit 2021-03-10T13:53:53.964988+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba020.yqfnwy"}]': finished 2021-03-10T13:53:55.209 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[13024]: audit 2021-03-10T13:53:53.966657+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2021-03-10T13:53:55.210 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[13024]: audit 2021-03-10T13:53:53.967760+0000 mon.b (mon.2) 113 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2021-03-10T13:53:55.210 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[13024]: audit 2021-03-10T13:53:53.969571+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2021-03-10T13:53:55.210 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[13024]: audit 2021-03-10T13:53:53.970986+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2021-03-10T13:53:55.210 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[13024]: cephadm 2021-03-10T13:53:53.972047+0000 mgr.gibba020.yqfnwy (mgr.34391) 53 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:53:55.210 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[13024]: cephadm 2021-03-10T13:53:53.972095+0000 mgr.gibba020.yqfnwy (mgr.34391) 54 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:53:55.211 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[13024]: audit 2021-03-10T13:53:53.972344+0000 mon.b (mon.2) 114 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2021-03-10T13:53:55.211 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[13024]: cephadm 2021-03-10T13:53:53.972870+0000 mgr.gibba020.yqfnwy (mgr.34391) 55 : cephadm [INF] It is presumed safe to stop mon.a 2021-03-10T13:53:55.211 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[13024]: cephadm 2021-03-10T13:53:53.972922+0000 mgr.gibba020.yqfnwy (mgr.34391) 56 : cephadm [INF] Upgrade: It is presumed safe to stop mon.a 2021-03-10T13:53:55.211 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:54 gibba013 bash[13024]: audit 2021-03-10T13:53:53.973655+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2021-03-10T13:53:55.213 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:54 gibba020 bash[9782]: audit 2021-03-10T13:53:53.933387+0000 mon.b (mon.2) 106 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 102928220, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.930815Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"7609af74159c\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 157496115, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.930974Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:53:50.102625Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94162124, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931067Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49146757, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931152Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49408901, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931387Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45927628, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931570Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48087695, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931746Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25417482, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931921Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a7c14b180bbc\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12383682, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.932030Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:53:31.062073Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:37.217814Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:53.932172Z\", \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:53:50.272497Z\"}"}]: dispatch 2021-03-10T13:53:55.213 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:54 gibba020 bash[9782]: audit 2021-03-10T13:53:53.936929+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 102928220, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.930815Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"7609af74159c\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 157496115, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.930974Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:53:50.102625Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94162124, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931067Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49146757, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931152Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49408901, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931387Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45927628, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931570Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48087695, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931746Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25417482, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931921Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a7c14b180bbc\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12383682, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.932030Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:53:31.062073Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:37.217814Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:53.932172Z\", \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:53:50.272497Z\"}"}]: dispatch 2021-03-10T13:53:55.213 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:54 gibba020 bash[9782]: audit 2021-03-10T13:53:53.940158+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"02bb13cc8f40\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 102928220, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.930815Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:42:59.367378Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"7609af74159c\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 157496115, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.930974Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:53:50.102625Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94162124, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931067Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49146757, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931152Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49408901, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931387Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45927628, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931570Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48087695, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931746Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25417482, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931921Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a7c14b180bbc\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12383682, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.932030Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:53:31.062073Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:37.217814Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:20.738549Z\"}}, \"last_daemon_update\": \"2021-03-10T13:53:53.932172Z\", \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:53:50.272497Z\"}"}]': finished 2021-03-10T13:53:55.214 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:54 gibba020 bash[9782]: audit 2021-03-10T13:53:53.940219+0000 mon.b (mon.2) 107 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:53:55.214 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:54 gibba020 bash[9782]: audit 2021-03-10T13:53:53.943472+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:53:55.214 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:54 gibba020 bash[9782]: audit 2021-03-10T13:53:53.946002+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2021-03-10T13:53:55.214 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:54 gibba020 bash[9782]: cephadm 2021-03-10T13:53:53.951738+0000 mgr.gibba020.yqfnwy (mgr.34391) 49 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:53:55.215 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:54 gibba020 bash[9782]: audit 2021-03-10T13:53:53.952361+0000 mon.b (mon.2) 108 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:53:55.215 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:54 gibba020 bash[9782]: cephadm 2021-03-10T13:53:53.953411+0000 mgr.gibba020.yqfnwy (mgr.34391) 50 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:53:55.215 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:54 gibba020 bash[9782]: audit 2021-03-10T13:53:53.953610+0000 mon.b (mon.2) 109 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:53:55.215 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:54 gibba020 bash[9782]: cephadm 2021-03-10T13:53:53.954301+0000 mgr.gibba020.yqfnwy (mgr.34391) 51 : cephadm [WRN] Upgrade: 1 mgr daemon(s) are 15.2.0 != target 17.0.0-1749-gb26fc080 2021-03-10T13:53:55.216 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:54 gibba020 bash[9782]: cephadm 2021-03-10T13:53:53.954343+0000 mgr.gibba020.yqfnwy (mgr.34391) 52 : cephadm [INF] Upgrade: Setting container_image for all mgr 2021-03-10T13:53:55.216 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:54 gibba020 bash[9782]: audit 2021-03-10T13:53:53.954490+0000 mon.b (mon.2) 110 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr"}]: dispatch 2021-03-10T13:53:55.216 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:54 gibba020 bash[9782]: audit 2021-03-10T13:53:53.957708+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr"}]: dispatch 2021-03-10T13:53:55.216 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:54 gibba020 bash[9782]: audit 2021-03-10T13:53:53.958832+0000 mon.b (mon.2) 111 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba020.yqfnwy"}]: dispatch 2021-03-10T13:53:55.216 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:54 gibba020 bash[9782]: audit 2021-03-10T13:53:53.960536+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mgr"}]': finished 2021-03-10T13:53:55.217 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:54 gibba020 bash[9782]: audit 2021-03-10T13:53:53.962036+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba020.yqfnwy"}]: dispatch 2021-03-10T13:53:55.217 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:54 gibba020 bash[9782]: audit 2021-03-10T13:53:53.963396+0000 mon.b (mon.2) 112 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2021-03-10T13:53:55.217 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:54 gibba020 bash[9782]: audit 2021-03-10T13:53:53.964988+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba020.yqfnwy"}]': finished 2021-03-10T13:53:55.218 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:54 gibba020 bash[9782]: audit 2021-03-10T13:53:53.966657+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2021-03-10T13:53:55.218 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:54 gibba020 bash[9782]: audit 2021-03-10T13:53:53.967760+0000 mon.b (mon.2) 113 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2021-03-10T13:53:55.218 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:54 gibba020 bash[9782]: audit 2021-03-10T13:53:53.969571+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2021-03-10T13:53:55.218 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:54 gibba020 bash[9782]: audit 2021-03-10T13:53:53.970986+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2021-03-10T13:53:55.218 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:54 gibba020 bash[9782]: cephadm 2021-03-10T13:53:53.972047+0000 mgr.gibba020.yqfnwy (mgr.34391) 53 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:53:55.219 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:54 gibba020 bash[9782]: cephadm 2021-03-10T13:53:53.972095+0000 mgr.gibba020.yqfnwy (mgr.34391) 54 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:53:55.219 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:54 gibba020 bash[9782]: audit 2021-03-10T13:53:53.972344+0000 mon.b (mon.2) 114 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2021-03-10T13:53:55.219 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:54 gibba020 bash[9782]: cephadm 2021-03-10T13:53:53.972870+0000 mgr.gibba020.yqfnwy (mgr.34391) 55 : cephadm [INF] It is presumed safe to stop mon.a 2021-03-10T13:53:55.219 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:54 gibba020 bash[9782]: cephadm 2021-03-10T13:53:53.972922+0000 mgr.gibba020.yqfnwy (mgr.34391) 56 : cephadm [INF] Upgrade: It is presumed safe to stop mon.a 2021-03-10T13:53:55.219 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:54 gibba020 bash[9782]: audit 2021-03-10T13:53:53.973655+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2021-03-10T13:53:56.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:55 gibba013 bash[9767]: cluster 2021-03-10T13:53:54.756819+0000 mgr.gibba020.yqfnwy (mgr.34391) 57 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:56.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:55 gibba013 bash[9767]: cluster 2021-03-10T13:53:55.055546+0000 mon.a (mon.0) 681 : cluster [DBG] Standby manager daemon y restarted 2021-03-10T13:53:56.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:55 gibba013 bash[9767]: cluster 2021-03-10T13:53:55.055710+0000 mon.a (mon.0) 682 : cluster [DBG] Standby manager daemon y started 2021-03-10T13:53:56.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:55 gibba013 bash[9767]: audit 2021-03-10T13:53:55.056547+0000 mon.c (mon.1) 21 : audit [DBG] from='mgr.? 172.21.2.113:0/1803461916' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:53:56.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:55 gibba013 bash[9767]: audit 2021-03-10T13:53:55.057679+0000 mon.c (mon.1) 22 : audit [DBG] from='mgr.? 172.21.2.113:0/1803461916' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:53:56.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:55 gibba013 bash[9767]: audit 2021-03-10T13:53:55.824113+0000 mon.b (mon.2) 115 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.a"}]: dispatch 2021-03-10T13:53:56.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:55 gibba013 bash[9767]: audit 2021-03-10T13:53:55.828007+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.a"}]: dispatch 2021-03-10T13:53:56.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:55 gibba013 bash[9767]: audit 2021-03-10T13:53:55.832647+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.a"}]': finished 2021-03-10T13:53:56.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:55 gibba013 bash[9767]: audit 2021-03-10T13:53:55.836005+0000 mon.b (mon.2) 116 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:53:56.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:55 gibba013 bash[9767]: audit 2021-03-10T13:53:55.836815+0000 mon.b (mon.2) 117 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:53:56.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:55 gibba013 bash[9767]: audit 2021-03-10T13:53:55.837580+0000 mon.b (mon.2) 118 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:53:56.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:55 gibba013 bash[9767]: audit 2021-03-10T13:53:55.838494+0000 mon.b (mon.2) 119 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T13:53:56.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:55 gibba013 bash[13024]: cluster 2021-03-10T13:53:54.756819+0000 mgr.gibba020.yqfnwy (mgr.34391) 57 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:56.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:55 gibba013 bash[13024]: cluster 2021-03-10T13:53:55.055546+0000 mon.a (mon.0) 681 : cluster [DBG] Standby manager daemon y restarted 2021-03-10T13:53:56.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:55 gibba013 bash[13024]: cluster 2021-03-10T13:53:55.055710+0000 mon.a (mon.0) 682 : cluster [DBG] Standby manager daemon y started 2021-03-10T13:53:56.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:55 gibba013 bash[13024]: audit 2021-03-10T13:53:55.056547+0000 mon.c (mon.1) 21 : audit [DBG] from='mgr.? 172.21.2.113:0/1803461916' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:53:56.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:55 gibba013 bash[13024]: audit 2021-03-10T13:53:55.057679+0000 mon.c (mon.1) 22 : audit [DBG] from='mgr.? 172.21.2.113:0/1803461916' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:53:56.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:55 gibba013 bash[13024]: audit 2021-03-10T13:53:55.824113+0000 mon.b (mon.2) 115 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.a"}]: dispatch 2021-03-10T13:53:56.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:55 gibba013 bash[13024]: audit 2021-03-10T13:53:55.828007+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.a"}]: dispatch 2021-03-10T13:53:56.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:55 gibba013 bash[13024]: audit 2021-03-10T13:53:55.832647+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.a"}]': finished 2021-03-10T13:53:56.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:55 gibba013 bash[13024]: audit 2021-03-10T13:53:55.836005+0000 mon.b (mon.2) 116 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:53:56.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:55 gibba013 bash[13024]: audit 2021-03-10T13:53:55.836815+0000 mon.b (mon.2) 117 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:53:56.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:55 gibba013 bash[13024]: audit 2021-03-10T13:53:55.837580+0000 mon.b (mon.2) 118 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:53:56.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:55 gibba013 bash[13024]: audit 2021-03-10T13:53:55.838494+0000 mon.b (mon.2) 119 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T13:53:56.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:55 gibba020 bash[9782]: cluster 2021-03-10T13:53:54.756819+0000 mgr.gibba020.yqfnwy (mgr.34391) 57 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:53:56.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:55 gibba020 bash[9782]: cluster 2021-03-10T13:53:55.055546+0000 mon.a (mon.0) 681 : cluster [DBG] Standby manager daemon y restarted 2021-03-10T13:53:56.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:55 gibba020 bash[9782]: cluster 2021-03-10T13:53:55.055710+0000 mon.a (mon.0) 682 : cluster [DBG] Standby manager daemon y started 2021-03-10T13:53:56.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:55 gibba020 bash[9782]: audit 2021-03-10T13:53:55.056547+0000 mon.c (mon.1) 21 : audit [DBG] from='mgr.? 172.21.2.113:0/1803461916' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:53:56.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:55 gibba020 bash[9782]: audit 2021-03-10T13:53:55.057679+0000 mon.c (mon.1) 22 : audit [DBG] from='mgr.? 172.21.2.113:0/1803461916' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:53:56.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:55 gibba020 bash[9782]: audit 2021-03-10T13:53:55.824113+0000 mon.b (mon.2) 115 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.a"}]: dispatch 2021-03-10T13:53:56.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:55 gibba020 bash[9782]: audit 2021-03-10T13:53:55.828007+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.a"}]: dispatch 2021-03-10T13:53:56.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:55 gibba020 bash[9782]: audit 2021-03-10T13:53:55.832647+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.34391 ' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.a"}]': finished 2021-03-10T13:53:56.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:55 gibba020 bash[9782]: audit 2021-03-10T13:53:55.836005+0000 mon.b (mon.2) 116 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:53:56.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:55 gibba020 bash[9782]: audit 2021-03-10T13:53:55.836815+0000 mon.b (mon.2) 117 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:53:56.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:55 gibba020 bash[9782]: audit 2021-03-10T13:53:55.837580+0000 mon.b (mon.2) 118 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:53:56.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:55 gibba020 bash[9782]: audit 2021-03-10T13:53:55.838494+0000 mon.b (mon.2) 119 : audit [DBG] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T13:53:57.075 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:56 gibba013 bash[9767]: cephadm 2021-03-10T13:53:55.823046+0000 mgr.gibba020.yqfnwy (mgr.34391) 58 : cephadm [INF] Upgrade: Updating mon.a 2021-03-10T13:53:57.075 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:56 gibba013 bash[9767]: cephadm 2021-03-10T13:53:55.838203+0000 mgr.gibba020.yqfnwy (mgr.34391) 59 : cephadm [INF] Deploying daemon mon.a on gibba013 2021-03-10T13:53:57.076 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:56 gibba013 bash[9767]: cluster 2021-03-10T13:53:55.994090+0000 mon.a (mon.0) 685 : cluster [DBG] mgrmap e21: gibba020.yqfnwy(active, since 45s), standbys: y, x 2021-03-10T13:53:57.076 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:56 gibba013 bash[13024]: cephadm 2021-03-10T13:53:55.823046+0000 mgr.gibba020.yqfnwy (mgr.34391) 58 : cephadm [INF] Upgrade: Updating mon.a 2021-03-10T13:53:57.076 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:56 gibba013 bash[13024]: cephadm 2021-03-10T13:53:55.838203+0000 mgr.gibba020.yqfnwy (mgr.34391) 59 : cephadm [INF] Deploying daemon mon.a on gibba013 2021-03-10T13:53:57.077 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:53:57 gibba013 bash[13024]: cluster 2021-03-10T13:53:55.994090+0000 mon.a (mon.0) 685 : cluster [DBG] mgrmap e21: gibba020.yqfnwy(active, since 45s), standbys: y, x 2021-03-10T13:53:57.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:56 gibba020 bash[9782]: cephadm 2021-03-10T13:53:55.823046+0000 mgr.gibba020.yqfnwy (mgr.34391) 58 : cephadm [INF] Upgrade: Updating mon.a 2021-03-10T13:53:57.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:56 gibba020 bash[9782]: cephadm 2021-03-10T13:53:55.838203+0000 mgr.gibba020.yqfnwy (mgr.34391) 59 : cephadm [INF] Deploying daemon mon.a on gibba013 2021-03-10T13:53:57.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:53:56 gibba020 bash[9782]: cluster 2021-03-10T13:53:55.994090+0000 mon.a (mon.0) 685 : cluster [DBG] mgrmap e21: gibba020.yqfnwy(active, since 45s), standbys: y, x 2021-03-10T13:53:57.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:57 gibba013 systemd[1]: Stopping Ceph mon.a for 7672acc8-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:53:57.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:57 gibba013 bash[9767]: debug 2021-03-10T13:53:57.776+0000 7f78c50b6700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T13:53:57.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:57 gibba013 bash[9767]: debug 2021-03-10T13:53:57.776+0000 7f78c50b6700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2021-03-10T13:53:58.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:58 gibba013 docker[29321]: ceph-7672acc8-81a6-11eb-9080-001a4aab830c-mon.a 2021-03-10T13:53:58.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:58 gibba013 systemd[1]: ceph-7672acc8-81a6-11eb-9080-001a4aab830c@mon.a.service: Succeeded. 2021-03-10T13:53:58.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:58 gibba013 systemd[1]: Stopped Ceph mon.a for 7672acc8-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:53:58.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:58 gibba013 systemd[1]: Started Ceph mon.a for 7672acc8-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:53:59.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.652+0000 7fd72cc65700 0 set uid:gid to 167:167 (ceph:ceph) 2021-03-10T13:53:59.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.652+0000 7fd72cc65700 0 ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev), process ceph-mon, pid 6 2021-03-10T13:53:59.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.652+0000 7fd72cc65700 0 pidfile_write: ignore empty --pid-file 2021-03-10T13:53:59.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 0 load: jerasure load: lrc load: isa 2021-03-10T13:53:59.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: RocksDB version: 6.8.1 2021-03-10T13:53:59.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-03-10T13:53:59.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Compile date Mar 9 2021 2021-03-10T13:53:59.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: DB SUMMARY 2021-03-10T13:53:59.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: CURRENT file: CURRENT 2021-03-10T13:53:59.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: IDENTITY file: IDENTITY 2021-03-10T13:53:59.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: MANIFEST file: MANIFEST-000008 size: 889 Bytes 2021-03-10T13:53:59.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 2, files: 000026.sst 000027.sst 2021-03-10T13:53:59.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000024.log size: 10224193 ; 2021-03-10T13:53:59.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.error_if_exists: 0 2021-03-10T13:53:59.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.create_if_missing: 0 2021-03-10T13:53:59.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.paranoid_checks: 1 2021-03-10T13:53:59.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.env: 0x55e662c921c0 2021-03-10T13:53:59.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.fs: Posix File System 2021-03-10T13:53:59.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.info_log: 0x55e663f311e0 2021-03-10T13:53:59.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.max_file_opening_threads: 16 2021-03-10T13:53:59.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.statistics: (nil) 2021-03-10T13:53:59.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.use_fsync: 0 2021-03-10T13:53:59.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.max_log_file_size: 0 2021-03-10T13:53:59.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-03-10T13:53:59.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-03-10T13:53:59.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.keep_log_file_num: 1000 2021-03-10T13:53:59.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.recycle_log_file_num: 0 2021-03-10T13:53:59.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.allow_fallocate: 1 2021-03-10T13:53:59.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.allow_mmap_reads: 0 2021-03-10T13:53:59.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.allow_mmap_writes: 0 2021-03-10T13:53:59.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.use_direct_reads: 0 2021-03-10T13:53:59.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-03-10T13:53:59.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.create_missing_column_families: 0 2021-03-10T13:53:59.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.db_log_dir: 2021-03-10T13:53:59.889 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2021-03-10T13:53:59.889 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-03-10T13:53:59.889 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.max_subcompactions: 1 2021-03-10T13:53:59.889 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.max_background_flushes: -1 2021-03-10T13:53:59.889 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-03-10T13:53:59.890 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-03-10T13:53:59.890 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-03-10T13:53:59.890 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-03-10T13:53:59.890 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-03-10T13:53:59.891 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.advise_random_on_open: 1 2021-03-10T13:53:59.891 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.db_write_buffer_size: 0 2021-03-10T13:53:59.891 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.write_buffer_manager: 0x55e663f85c50 2021-03-10T13:53:59.891 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-03-10T13:53:59.891 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-03-10T13:53:59.892 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-03-10T13:53:59.892 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-03-10T13:53:59.892 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.rate_limiter: (nil) 2021-03-10T13:53:59.892 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-03-10T13:53:59.892 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.wal_recovery_mode: 2 2021-03-10T13:53:59.893 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.enable_thread_tracking: 0 2021-03-10T13:53:59.893 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.enable_pipelined_write: 0 2021-03-10T13:53:59.893 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.unordered_write: 0 2021-03-10T13:53:59.893 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-03-10T13:53:59.893 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-03-10T13:53:59.894 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-03-10T13:53:59.894 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-03-10T13:53:59.894 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.row_cache: None 2021-03-10T13:53:59.894 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.wal_filter: None 2021-03-10T13:53:59.895 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-03-10T13:53:59.895 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.allow_ingest_behind: 0 2021-03-10T13:53:59.895 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.preserve_deletes: 0 2021-03-10T13:53:59.895 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.two_write_queues: 0 2021-03-10T13:53:59.895 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.manual_wal_flush: 0 2021-03-10T13:53:59.896 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.atomic_flush: 0 2021-03-10T13:53:59.896 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-03-10T13:53:59.896 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-03-10T13:53:59.896 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-03-10T13:53:59.897 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.log_readahead_size: 0 2021-03-10T13:53:59.897 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2021-03-10T13:53:59.897 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.max_background_jobs: 2 2021-03-10T13:53:59.897 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.max_background_compactions: -1 2021-03-10T13:53:59.897 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-03-10T13:53:59.898 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-03-10T13:53:59.898 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-03-10T13:53:59.898 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.max_total_wal_size: 0 2021-03-10T13:53:59.898 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-03-10T13:53:59.898 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-03-10T13:53:59.899 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-03-10T13:53:59.899 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-03-10T13:53:59.899 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.max_open_files: -1 2021-03-10T13:53:59.899 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.bytes_per_sync: 0 2021-03-10T13:53:59.900 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-03-10T13:53:59.900 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-03-10T13:53:59.900 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.compaction_readahead_size: 0 2021-03-10T13:53:59.900 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Compression algorithms supported: 2021-03-10T13:53:59.900 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-03-10T13:53:59.901 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: kZSTD supported: 0 2021-03-10T13:53:59.901 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: kXpressCompression supported: 0 2021-03-10T13:53:59.901 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: kLZ4HCCompression supported: 1 2021-03-10T13:53:59.901 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: kLZ4Compression supported: 1 2021-03-10T13:53:59.901 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: kBZip2Compression supported: 0 2021-03-10T13:53:59.902 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: kZlibCompression supported: 1 2021-03-10T13:53:59.902 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: kSnappyCompression supported: 1 2021-03-10T13:53:59.902 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-03-10T13:53:59.902 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000008 2021-03-10T13:53:59.902 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2021-03-10T13:53:59.903 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-03-10T13:53:59.903 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.merge_operator: 2021-03-10T13:53:59.903 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.compaction_filter: None 2021-03-10T13:53:59.903 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.compaction_filter_factory: None 2021-03-10T13:53:59.904 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-03-10T13:53:59.904 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-03-10T13:53:59.904 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e663ed4230) 2021-03-10T13:53:59.904 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: cache_index_and_filter_blocks: 1 2021-03-10T13:53:59.904 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: cache_index_and_filter_blocks_with_high_priority: 0 2021-03-10T13:53:59.905 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-03-10T13:53:59.905 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: pin_top_level_index_and_filter: 1 2021-03-10T13:53:59.905 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: index_type: 0 2021-03-10T13:53:59.905 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: data_block_index_type: 0 2021-03-10T13:53:59.905 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: index_shortening: 1 2021-03-10T13:53:59.906 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: data_block_hash_table_util_ratio: 0.750000 2021-03-10T13:53:59.906 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: hash_index_allow_collision: 1 2021-03-10T13:53:59.906 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: checksum: 1 2021-03-10T13:53:59.906 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: no_block_cache: 0 2021-03-10T13:53:59.907 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: block_cache: 0x55e663f0c510 2021-03-10T13:53:59.907 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: block_cache_name: BinnedLRUCache 2021-03-10T13:53:59.907 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: block_cache_options: 2021-03-10T13:53:59.907 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: capacity : 536870912 2021-03-10T13:53:59.907 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: num_shard_bits : 4 2021-03-10T13:53:59.908 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: strict_capacity_limit : 0 2021-03-10T13:53:59.908 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: high_pri_pool_ratio: 0.000 2021-03-10T13:53:59.908 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: block_cache_compressed: (nil) 2021-03-10T13:53:59.908 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: persistent_cache: (nil) 2021-03-10T13:53:59.908 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: block_size: 4096 2021-03-10T13:53:59.909 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: block_size_deviation: 10 2021-03-10T13:53:59.909 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: block_restart_interval: 16 2021-03-10T13:53:59.909 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: index_block_restart_interval: 1 2021-03-10T13:53:59.909 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: metadata_block_size: 4096 2021-03-10T13:53:59.909 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: partition_filters: 0 2021-03-10T13:53:59.910 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: use_delta_encoding: 1 2021-03-10T13:53:59.910 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: filter_policy: rocksdb.BuiltinBloomFilter 2021-03-10T13:53:59.910 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: whole_key_filtering: 1 2021-03-10T13:53:59.910 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: verify_compression: 0 2021-03-10T13:53:59.911 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: read_amp_bytes_per_bit: 0 2021-03-10T13:53:59.911 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: format_version: 2 2021-03-10T13:53:59.911 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: enable_index_compression: 1 2021-03-10T13:53:59.911 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: block_align: 0 2021-03-10T13:53:59.912 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.write_buffer_size: 33554432 2021-03-10T13:53:59.912 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.max_write_buffer_number: 2 2021-03-10T13:53:59.912 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.compression: NoCompression 2021-03-10T13:53:59.912 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.bottommost_compression: Disabled 2021-03-10T13:53:59.912 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.prefix_extractor: nullptr 2021-03-10T13:53:59.913 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-03-10T13:53:59.913 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.num_levels: 7 2021-03-10T13:53:59.913 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-03-10T13:53:59.913 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-03-10T13:53:59.914 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-03-10T13:53:59.914 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-03-10T13:53:59.914 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-03-10T13:53:59.914 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-03-10T13:53:59.914 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-03-10T13:53:59.915 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-03-10T13:53:59.915 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-03-10T13:53:59.915 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-03-10T13:53:59.915 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.compression_opts.level: 32767 2021-03-10T13:53:59.915 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.compression_opts.strategy: 0 2021-03-10T13:53:59.916 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-03-10T13:53:59.916 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-03-10T13:53:59.916 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.compression_opts.enabled: false 2021-03-10T13:53:59.916 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-03-10T13:53:59.917 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-03-10T13:53:59.917 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-03-10T13:53:59.917 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.target_file_size_base: 67108864 2021-03-10T13:53:59.917 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-03-10T13:53:59.917 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-03-10T13:53:59.918 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-03-10T13:53:59.918 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-03-10T13:53:59.918 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-03-10T13:53:59.918 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-03-10T13:53:59.919 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-03-10T13:53:59.919 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-03-10T13:53:59.919 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-03-10T13:53:59.919 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-03-10T13:53:59.919 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-03-10T13:53:59.920 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-03-10T13:53:59.920 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-03-10T13:53:59.920 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.arena_block_size: 4194304 2021-03-10T13:53:59.920 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-03-10T13:53:59.920 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-03-10T13:53:59.921 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-03-10T13:53:59.921 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.disable_auto_compactions: 0 2021-03-10T13:53:59.921 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-03-10T13:53:59.921 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-03-10T13:53:59.922 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-03-10T13:53:59.922 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-03-10T13:53:59.922 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-03-10T13:53:59.922 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-03-10T13:53:59.923 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-03-10T13:53:59.923 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-03-10T13:53:59.923 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-03-10T13:53:59.923 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-03-10T13:53:59.923 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.table_properties_collectors: 2021-03-10T13:53:59.924 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.inplace_update_support: 0 2021-03-10T13:53:59.924 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-03-10T13:53:59.924 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-03-10T13:53:59.924 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-03-10T13:53:59.924 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-03-10T13:53:59.925 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.bloom_locality: 0 2021-03-10T13:53:59.925 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.max_successive_merges: 0 2021-03-10T13:53:59.925 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-03-10T13:53:59.925 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.paranoid_file_checks: 0 2021-03-10T13:53:59.926 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.force_consistency_checks: 0 2021-03-10T13:53:59.926 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.report_bg_io_stats: 0 2021-03-10T13:53:59.926 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.ttl: 2592000 2021-03-10T13:53:59.926 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-03-10T13:53:59.926 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000008 succeeded,manifest_file_number is 8, next_file_number is 29, last_sequence is 8752, log_number is 24,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-03-10T13:53:59.927 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 24 2021-03-10T13:53:59.927 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615384439660668, "job": 1, "event": "recovery_started", "log_files": [24]} 2021-03-10T13:53:59.927 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.656+0000 7fd72cc65700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #24 mode 2 2021-03-10T13:53:59.927 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.664+0000 7fd72cc65700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-03-10T13:53:59.928 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.672+0000 7fd72cc65700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615384439676154, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 29, "file_size": 10169251, "table_properties": {"data_size": 10164546, "index_size": 3434, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 453, "raw_key_size": 3983, "raw_average_key_size": 23, "raw_value_size": 10159288, "raw_average_value_size": 58724, "num_data_blocks": 106, "num_entries": 173, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1615384439, "oldest_key_time": 3, "file_creation_time": 0}} 2021-03-10T13:53:59.928 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.672+0000 7fd72cc65700 4 rocksdb: [version_set.cc:3826] Creating manifest 30 2021-03-10T13:53:59.928 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.672+0000 7fd72cc65700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615384439676969, "job": 1, "event": "recovery_finished"} 2021-03-10T13:53:59.928 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.676+0000 7fd72cc65700 4 rocksdb: DB pointer 0x55e663fd1800 2021-03-10T13:53:59.928 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.676+0000 7fd713a78700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2021-03-10T13:53:59.929 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.676+0000 7fd713a78700 4 rocksdb: [db_impl/db_impl.cc:851] 2021-03-10T13:53:59.929 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: ** DB Stats ** 2021-03-10T13:53:59.929 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:53:59.929 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-03-10T13:53:59.929 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-03-10T13:53:59.930 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T13:53:59.930 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-03-10T13:53:59.930 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-03-10T13:53:59.930 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T13:53:59.931 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: ** Compaction Stats [default] ** 2021-03-10T13:53:59.931 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:53:59.931 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:53:59.931 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: L0 1/0 9.70 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1057.1 0.01 0.00 1 0.009 0 0 2021-03-10T13:53:59.931 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: L6 2/0 66.64 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:53:59.932 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: Sum 3/0 76.34 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1057.1 0.01 0.00 1 0.009 0 0 2021-03-10T13:53:59.932 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1057.1 0.01 0.00 1 0.009 0 0 2021-03-10T13:53:59.932 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: ** Compaction Stats [default] ** 2021-03-10T13:53:59.932 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:53:59.933 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:53:59.933 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1057.1 0.01 0.00 1 0.009 0 0 2021-03-10T13:53:59.933 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:53:59.933 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: Flush(GB): cumulative 0.009, interval 0.009 2021-03-10T13:53:59.933 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T13:53:59.934 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T13:53:59.934 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T13:53:59.934 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T13:53:59.934 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: Cumulative compaction: 0.01 GB write, 531.78 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:53:59.935 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: Interval compaction: 0.01 GB write, 531.78 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:53:59.935 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T13:53:59.935 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T13:53:59.935 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: ** Compaction Stats [default] ** 2021-03-10T13:53:59.935 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:53:59.936 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:53:59.936 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: L0 1/0 9.70 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1057.1 0.01 0.00 1 0.009 0 0 2021-03-10T13:53:59.936 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: L6 2/0 66.64 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:53:59.936 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: Sum 3/0 76.34 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1057.1 0.01 0.00 1 0.009 0 0 2021-03-10T13:53:59.936 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:53:59.937 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: ** Compaction Stats [default] ** 2021-03-10T13:53:59.937 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:53:59.937 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:53:59.937 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1057.1 0.01 0.00 1 0.009 0 0 2021-03-10T13:53:59.938 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:53:59.938 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: Flush(GB): cumulative 0.009, interval 0.000 2021-03-10T13:53:59.938 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T13:53:59.938 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T13:53:59.938 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T13:53:59.939 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T13:53:59.939 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: Cumulative compaction: 0.01 GB write, 530.91 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:53:59.939 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:53:59.939 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T13:53:59.939 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T13:53:59.940 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.676+0000 7fd72cc65700 0 starting mon.a rank 0 at public addrs [v2:172.21.2.113:3300/0,v1:172.21.2.113:6789/0] at bind addrs [v2:172.21.2.113:3300/0,v1:172.21.2.113:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 7672acc8-81a6-11eb-9080-001a4aab830c 2021-03-10T13:53:59.940 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.676+0000 7fd72cc65700 1 mon.a@-1(???) e3 preinit fsid 7672acc8-81a6-11eb-9080-001a4aab830c 2021-03-10T13:53:59.940 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.676+0000 7fd72cc65700 0 mon.a@-1(???).mds e1 new map 2021-03-10T13:53:59.940 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.676+0000 7fd72cc65700 0 mon.a@-1(???).mds e1 print_map 2021-03-10T13:53:59.941 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: e1 2021-03-10T13:53:59.941 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: enable_multiple, ever_enabled_multiple: 0,0 2021-03-10T13:53:59.941 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-03-10T13:53:59.941 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: legacy client fscid: -1 2021-03-10T13:53:59.941 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: 2021-03-10T13:53:59.942 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: No filesystems configured 2021-03-10T13:53:59.942 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.676+0000 7fd72cc65700 0 mon.a@-1(???).osd e61 crush map has features 3314933000852226048, adjusting msgr requires 2021-03-10T13:53:59.942 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.676+0000 7fd72cc65700 0 mon.a@-1(???).osd e61 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T13:53:59.942 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.676+0000 7fd72cc65700 0 mon.a@-1(???).osd e61 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T13:53:59.942 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.676+0000 7fd72cc65700 0 mon.a@-1(???).osd e61 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T13:53:59.943 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: cephadm 2021-03-10T13:53:55.823046+0000 mgr.gibba020.yqfnwy (mgr.34391) 58 : cephadm [INF] Upgrade: Updating mon.a 2021-03-10T13:53:59.943 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: cephadm 2021-03-10T13:53:55.838203+0000 mgr.gibba020.yqfnwy (mgr.34391) 59 : cephadm [INF] Deploying daemon mon.a on gibba013 2021-03-10T13:53:59.943 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: cluster 2021-03-10T13:53:55.994090+0000 mon.a (mon.0) 685 : cluster [DBG] mgrmap e21: gibba020.yqfnwy(active, since 45s), standbys: y, x 2021-03-10T13:53:59.943 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.676+0000 7fd72cc65700 1 mon.a@-1(???).paxosservice(auth 1..19) refresh upgraded, format 0 -> 3 2021-03-10T13:53:59.943 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.676+0000 7fd72cc65700 20 expand_channel_meta expand map: {default=false} 2021-03-10T13:53:59.944 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.676+0000 7fd72cc65700 20 expand_channel_meta from 'false' to 'false' 2021-03-10T13:53:59.944 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.676+0000 7fd72cc65700 20 expand_channel_meta expanded map: {default=false} 2021-03-10T13:53:59.944 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.676+0000 7fd72cc65700 20 expand_channel_meta expand map: {default=info} 2021-03-10T13:53:59.944 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.676+0000 7fd72cc65700 20 expand_channel_meta from 'info' to 'info' 2021-03-10T13:53:59.945 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.676+0000 7fd72cc65700 20 expand_channel_meta expanded map: {default=info} 2021-03-10T13:53:59.945 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.676+0000 7fd72cc65700 20 expand_channel_meta expand map: {default=daemon} 2021-03-10T13:53:59.945 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.676+0000 7fd72cc65700 20 expand_channel_meta from 'daemon' to 'daemon' 2021-03-10T13:53:59.945 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.676+0000 7fd72cc65700 20 expand_channel_meta expanded map: {default=daemon} 2021-03-10T13:53:59.945 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.676+0000 7fd72cc65700 20 expand_channel_meta expand map: {default=debug} 2021-03-10T13:53:59.946 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.676+0000 7fd72cc65700 20 expand_channel_meta from 'debug' to 'debug' 2021-03-10T13:53:59.946 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:53:59 gibba013 bash[29418]: debug 2021-03-10T13:53:59.676+0000 7fd72cc65700 20 expand_channel_meta expanded map: {default=debug} 2021-03-10T13:54:01.378 INFO:journalctl@ceph.mgr.y.gibba013.stdout:Mar 10 13:54:01 gibba013 bash[28437]: ignoring --setuser ceph since I am not root 2021-03-10T13:54:01.378 INFO:journalctl@ceph.mgr.y.gibba013.stdout:Mar 10 13:54:01 gibba013 bash[28437]: ignoring --setgroup ceph since I am not root 2021-03-10T13:54:01.379 INFO:journalctl@ceph.mgr.y.gibba013.stdout:Mar 10 13:54:01 gibba013 bash[28437]: debug 2021-03-10T13:54:01.148+0000 7f1600e7b700 1 -- 172.21.2.113:0/3782750312 <== mon.0 v2:172.21.2.113:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a362b1e4e0 con 0x55a362c0f000 2021-03-10T13:54:01.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:01 gibba013 bash[29418]: debug 2021-03-10T13:54:01.124+0000 7fd714a7a700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:01.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:01 gibba013 bash[29418]: debug 2021-03-10T13:54:01.124+0000 7fd714a7a700 -1 log_channel(cluster) log [ERR] : [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:54:01.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:01 gibba013 bash[29418]: debug 2021-03-10T13:54:01.124+0000 7fd714a7a700 -1 log_channel(cluster) log [ERR] : daemon rgw.r.z.gibba020.txcybs on gibba020 is in error state 2021-03-10T13:54:01.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:01 gibba013 bash[29418]: debug 2021-03-10T13:54:01.124+0000 7fd714a7a700 -1 log_channel(cluster) log [ERR] : [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:01.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:01 gibba013 bash[29418]: debug 2021-03-10T13:54:01.124+0000 7fd714a7a700 -1 log_channel(cluster) log [ERR] : Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:01.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:01 gibba013 bash[13024]: audit 2021-03-10T13:53:58.702455+0000 mon.b (mon.2) 120 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"7609af74159c\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 157496115, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.930974Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:53:50.102625Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94162124, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931067Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49146757, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931152Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49408901, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931387Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45927628, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931570Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48087695, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931746Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25417482, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931921Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a7c14b180bbc\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12383682, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T13:53:53.932030Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:53:31.062073Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:37.217814Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:55.838140Z\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:53:50.272497Z\"}"}]: dispatch 2021-03-10T13:54:01.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:01 gibba013 bash[13024]: cluster 2021-03-10T13:53:58.758868+0000 mgr.gibba020.yqfnwy (mgr.34391) 61 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:01.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:01 gibba013 bash[13024]: cluster 2021-03-10T13:53:59.886586+0000 mon.a (mon.0) 1 : cluster [INF] mon.a calling monitor election 2021-03-10T13:54:01.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:01 gibba013 bash[13024]: cluster 2021-03-10T13:54:01.096049+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T13:54:01.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:01 gibba013 bash[13024]: cluster 2021-03-10T13:54:01.107083+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.113:3300/0,v1:172.21.2.113:6789/0],b=[v2:172.21.2.120:3300/0,v1:172.21.2.120:6789/0],c=[v2:172.21.2.113:3301/0,v1:172.21.2.113:6790/0]} 2021-03-10T13:54:01.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:01 gibba013 bash[13024]: cluster 2021-03-10T13:54:01.107104+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2021-03-10T13:54:01.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:01 gibba013 bash[13024]: cluster 2021-03-10T13:54:01.107143+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2021-03-10T13:54:01.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:01 gibba013 bash[13024]: cluster 2021-03-10T13:54:01.108121+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e21: gibba020.yqfnwy(active, since 51s), standbys: y, x 2021-03-10T13:54:01.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:01 gibba013 bash[13024]: cluster 2021-03-10T13:54:01.125750+0000 mon.a (mon.0) 7 : cluster [DBG] mgrmap e22: gibba020.yqfnwy(active, since 51s), standbys: y, x 2021-03-10T13:54:01.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:01 gibba013 bash[13024]: cluster 2021-03-10T13:54:01.126382+0000 mon.a (mon.0) 8 : cluster [ERR] Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:01.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:01 gibba013 bash[13024]: cluster 2021-03-10T13:54:01.126412+0000 mon.a (mon.0) 9 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:54:01.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:01 gibba013 bash[13024]: cluster 2021-03-10T13:54:01.126418+0000 mon.a (mon.0) 10 : cluster [ERR] daemon rgw.r.z.gibba020.txcybs on gibba020 is in error state 2021-03-10T13:54:01.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:01 gibba013 bash[13024]: cluster 2021-03-10T13:54:01.126423+0000 mon.a (mon.0) 11 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:01.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:01 gibba013 bash[13024]: cluster 2021-03-10T13:54:01.126429+0000 mon.a (mon.0) 12 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:01.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:01 gibba013 bash[13024]: audit 2021-03-10T13:54:01.129629+0000 mon.a (mon.0) 13 : audit [INF] from='mgr.34391 ' entity='' 2021-03-10T13:54:01.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:01 gibba013 bash[29418]: audit 2021-03-10T13:53:58.702455+0000 mon.b (mon.2) 120 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"7609af74159c\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 157496115, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.930974Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:53:50.102625Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94162124, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931067Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49146757, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931152Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49408901, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931387Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45927628, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931570Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48087695, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931746Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25417482, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931921Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a7c14b180bbc\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12383682, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T13:53:53.932030Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:53:31.062073Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:37.217814Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:55.838140Z\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:53:50.272497Z\"}"}]: dispatch 2021-03-10T13:54:01.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:01 gibba013 bash[29418]: cluster 2021-03-10T13:53:58.758868+0000 mgr.gibba020.yqfnwy (mgr.34391) 61 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:01.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:01 gibba013 bash[29418]: cluster 2021-03-10T13:53:59.886586+0000 mon.a (mon.0) 1 : cluster [INF] mon.a calling monitor election 2021-03-10T13:54:01.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:01 gibba013 bash[29418]: cluster 2021-03-10T13:54:01.096049+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T13:54:01.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:01 gibba013 bash[29418]: cluster 2021-03-10T13:54:01.107083+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.113:3300/0,v1:172.21.2.113:6789/0],b=[v2:172.21.2.120:3300/0,v1:172.21.2.120:6789/0],c=[v2:172.21.2.113:3301/0,v1:172.21.2.113:6790/0]} 2021-03-10T13:54:01.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:01 gibba013 bash[29418]: cluster 2021-03-10T13:54:01.107104+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2021-03-10T13:54:01.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:01 gibba013 bash[29418]: cluster 2021-03-10T13:54:01.107143+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2021-03-10T13:54:01.387 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:01 gibba013 bash[29418]: cluster 2021-03-10T13:54:01.108121+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e21: gibba020.yqfnwy(active, since 51s), standbys: y, x 2021-03-10T13:54:01.387 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:01 gibba013 bash[29418]: cluster 2021-03-10T13:54:01.125750+0000 mon.a (mon.0) 7 : cluster [DBG] mgrmap e22: gibba020.yqfnwy(active, since 51s), standbys: y, x 2021-03-10T13:54:01.387 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:01 gibba013 bash[29418]: cluster 2021-03-10T13:54:01.126382+0000 mon.a (mon.0) 8 : cluster [ERR] Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:01.387 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:01 gibba013 bash[29418]: cluster 2021-03-10T13:54:01.126412+0000 mon.a (mon.0) 9 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:54:01.388 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:01 gibba013 bash[29418]: cluster 2021-03-10T13:54:01.126418+0000 mon.a (mon.0) 10 : cluster [ERR] daemon rgw.r.z.gibba020.txcybs on gibba020 is in error state 2021-03-10T13:54:01.388 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:01 gibba013 bash[29418]: cluster 2021-03-10T13:54:01.126423+0000 mon.a (mon.0) 11 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:01.388 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:01 gibba013 bash[29418]: cluster 2021-03-10T13:54:01.126429+0000 mon.a (mon.0) 12 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:01.388 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:01 gibba013 bash[29418]: audit 2021-03-10T13:54:01.129629+0000 mon.a (mon.0) 13 : audit [INF] from='mgr.34391 ' entity='' 2021-03-10T13:54:01.448 INFO:journalctl@ceph.mgr.x.gibba020.stdout:Mar 10 13:54:01 gibba020 bash[22074]: ignoring --setuser ceph since I am not root 2021-03-10T13:54:01.449 INFO:journalctl@ceph.mgr.x.gibba020.stdout:Mar 10 13:54:01 gibba020 bash[22074]: ignoring --setgroup ceph since I am not root 2021-03-10T13:54:01.449 INFO:journalctl@ceph.mgr.x.gibba020.stdout:Mar 10 13:54:01 gibba020 bash[22074]: debug 2021-03-10T13:54:01.140+0000 7fc5db62a700 1 -- 172.21.2.120:0/621865594 <== mon.2 v2:172.21.2.120:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c0fe49a4e0 con 0x55c0fe58ac00 2021-03-10T13:54:01.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:01 gibba020 bash[9782]: audit 2021-03-10T13:53:58.702455+0000 mon.b (mon.2) 120 : audit [INF] from='mgr.34391 172.21.2.120:0/1114672609' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"7609af74159c\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 157496115, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.930974Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:53:50.102625Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94162124, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931067Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49146757, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931152Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49408901, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931387Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45927628, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931570Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48087695, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931746Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25417482, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:53.931921Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a7c14b180bbc\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12383682, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T13:53:53.932030Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:53:31.062073Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:37.217814Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:55.838140Z\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:53:50.272497Z\"}"}]: dispatch 2021-03-10T13:54:01.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:01 gibba020 bash[9782]: cluster 2021-03-10T13:53:58.758868+0000 mgr.gibba020.yqfnwy (mgr.34391) 61 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:01.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:01 gibba020 bash[9782]: cluster 2021-03-10T13:53:59.886586+0000 mon.a (mon.0) 1 : cluster [INF] mon.a calling monitor election 2021-03-10T13:54:01.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:01 gibba020 bash[9782]: cluster 2021-03-10T13:54:01.096049+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T13:54:01.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:01 gibba020 bash[9782]: cluster 2021-03-10T13:54:01.107083+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.113:3300/0,v1:172.21.2.113:6789/0],b=[v2:172.21.2.120:3300/0,v1:172.21.2.120:6789/0],c=[v2:172.21.2.113:3301/0,v1:172.21.2.113:6790/0]} 2021-03-10T13:54:01.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:01 gibba020 bash[9782]: cluster 2021-03-10T13:54:01.107104+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2021-03-10T13:54:01.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:01 gibba020 bash[9782]: cluster 2021-03-10T13:54:01.107143+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2021-03-10T13:54:01.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:01 gibba020 bash[9782]: cluster 2021-03-10T13:54:01.108121+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e21: gibba020.yqfnwy(active, since 51s), standbys: y, x 2021-03-10T13:54:01.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:01 gibba020 bash[9782]: cluster 2021-03-10T13:54:01.125750+0000 mon.a (mon.0) 7 : cluster [DBG] mgrmap e22: gibba020.yqfnwy(active, since 51s), standbys: y, x 2021-03-10T13:54:01.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:01 gibba020 bash[9782]: cluster 2021-03-10T13:54:01.126382+0000 mon.a (mon.0) 8 : cluster [ERR] Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:01.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:01 gibba020 bash[9782]: cluster 2021-03-10T13:54:01.126412+0000 mon.a (mon.0) 9 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:54:01.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:01 gibba020 bash[9782]: cluster 2021-03-10T13:54:01.126418+0000 mon.a (mon.0) 10 : cluster [ERR] daemon rgw.r.z.gibba020.txcybs on gibba020 is in error state 2021-03-10T13:54:01.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:01 gibba020 bash[9782]: cluster 2021-03-10T13:54:01.126423+0000 mon.a (mon.0) 11 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:01.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:01 gibba020 bash[9782]: cluster 2021-03-10T13:54:01.126429+0000 mon.a (mon.0) 12 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:01.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:01 gibba020 bash[9782]: audit 2021-03-10T13:54:01.129629+0000 mon.a (mon.0) 13 : audit [INF] from='mgr.34391 ' entity='' 2021-03-10T13:54:05.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:05 gibba020 bash[9782]: cluster 2021-03-10T13:54:04.951165+0000 mon.a (mon.0) 14 : cluster [DBG] Standby manager daemon y restarted 2021-03-10T13:54:05.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:05 gibba020 bash[9782]: cluster 2021-03-10T13:54:04.951240+0000 mon.a (mon.0) 15 : cluster [DBG] Standby manager daemon y started 2021-03-10T13:54:05.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:05 gibba020 bash[9782]: audit 2021-03-10T13:54:04.952645+0000 mon.a (mon.0) 16 : audit [DBG] from='mgr.? 172.21.2.113:0/212025921' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:54:05.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:05 gibba020 bash[9782]: audit 2021-03-10T13:54:04.953558+0000 mon.a (mon.0) 17 : audit [DBG] from='mgr.? 172.21.2.113:0/212025921' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:54:05.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:05 gibba020 bash[9782]: cluster 2021-03-10T13:54:04.988985+0000 mon.a (mon.0) 18 : cluster [INF] Active manager daemon gibba020.yqfnwy restarted 2021-03-10T13:54:05.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:05 gibba020 bash[9782]: cluster 2021-03-10T13:54:04.990198+0000 mon.a (mon.0) 19 : cluster [INF] Activating manager daemon gibba020.yqfnwy 2021-03-10T13:54:05.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:05 gibba020 bash[9782]: cluster 2021-03-10T13:54:04.998009+0000 mon.a (mon.0) 20 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-03-10T13:54:05.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:05 gibba020 bash[9782]: audit 2021-03-10T13:54:05.007159+0000 mon.b (mon.2) 121 : audit [DBG] from='mgr.? 172.21.2.120:0/2538961093' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:54:05.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:05 gibba020 bash[9782]: audit 2021-03-10T13:54:05.008100+0000 mon.b (mon.2) 122 : audit [DBG] from='mgr.? 172.21.2.120:0/2538961093' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:54:05.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:05 gibba020 bash[9782]: cluster 2021-03-10T13:54:05.009535+0000 mon.a (mon.0) 21 : cluster [DBG] Standby manager daemon x restarted 2021-03-10T13:54:05.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:05 gibba020 bash[9782]: cluster 2021-03-10T13:54:05.009582+0000 mon.a (mon.0) 22 : cluster [DBG] Standby manager daemon x started 2021-03-10T13:54:06.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:05 gibba013 bash[29418]: cluster 2021-03-10T13:54:04.951165+0000 mon.a (mon.0) 14 : cluster [DBG] Standby manager daemon y restarted 2021-03-10T13:54:06.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:05 gibba013 bash[29418]: cluster 2021-03-10T13:54:04.951240+0000 mon.a (mon.0) 15 : cluster [DBG] Standby manager daemon y started 2021-03-10T13:54:06.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:05 gibba013 bash[29418]: audit 2021-03-10T13:54:04.952645+0000 mon.a (mon.0) 16 : audit [DBG] from='mgr.? 172.21.2.113:0/212025921' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:54:06.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:05 gibba013 bash[29418]: audit 2021-03-10T13:54:04.953558+0000 mon.a (mon.0) 17 : audit [DBG] from='mgr.? 172.21.2.113:0/212025921' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:54:06.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:05 gibba013 bash[29418]: cluster 2021-03-10T13:54:04.988985+0000 mon.a (mon.0) 18 : cluster [INF] Active manager daemon gibba020.yqfnwy restarted 2021-03-10T13:54:06.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:05 gibba013 bash[29418]: cluster 2021-03-10T13:54:04.990198+0000 mon.a (mon.0) 19 : cluster [INF] Activating manager daemon gibba020.yqfnwy 2021-03-10T13:54:06.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:05 gibba013 bash[29418]: cluster 2021-03-10T13:54:04.998009+0000 mon.a (mon.0) 20 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-03-10T13:54:06.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:05 gibba013 bash[29418]: audit 2021-03-10T13:54:05.007159+0000 mon.b (mon.2) 121 : audit [DBG] from='mgr.? 172.21.2.120:0/2538961093' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:54:06.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:05 gibba013 bash[29418]: audit 2021-03-10T13:54:05.008100+0000 mon.b (mon.2) 122 : audit [DBG] from='mgr.? 172.21.2.120:0/2538961093' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:54:06.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:05 gibba013 bash[29418]: cluster 2021-03-10T13:54:05.009535+0000 mon.a (mon.0) 21 : cluster [DBG] Standby manager daemon x restarted 2021-03-10T13:54:06.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:05 gibba013 bash[29418]: cluster 2021-03-10T13:54:05.009582+0000 mon.a (mon.0) 22 : cluster [DBG] Standby manager daemon x started 2021-03-10T13:54:06.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:05 gibba013 bash[13024]: cluster 2021-03-10T13:54:04.951165+0000 mon.a (mon.0) 14 : cluster [DBG] Standby manager daemon y restarted 2021-03-10T13:54:06.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:05 gibba013 bash[13024]: cluster 2021-03-10T13:54:04.951240+0000 mon.a (mon.0) 15 : cluster [DBG] Standby manager daemon y started 2021-03-10T13:54:06.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:05 gibba013 bash[13024]: audit 2021-03-10T13:54:04.952645+0000 mon.a (mon.0) 16 : audit [DBG] from='mgr.? 172.21.2.113:0/212025921' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:54:06.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:05 gibba013 bash[13024]: audit 2021-03-10T13:54:04.953558+0000 mon.a (mon.0) 17 : audit [DBG] from='mgr.? 172.21.2.113:0/212025921' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:54:06.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:05 gibba013 bash[13024]: cluster 2021-03-10T13:54:04.988985+0000 mon.a (mon.0) 18 : cluster [INF] Active manager daemon gibba020.yqfnwy restarted 2021-03-10T13:54:06.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:05 gibba013 bash[13024]: cluster 2021-03-10T13:54:04.990198+0000 mon.a (mon.0) 19 : cluster [INF] Activating manager daemon gibba020.yqfnwy 2021-03-10T13:54:06.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:05 gibba013 bash[13024]: cluster 2021-03-10T13:54:04.998009+0000 mon.a (mon.0) 20 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-03-10T13:54:06.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:05 gibba013 bash[13024]: audit 2021-03-10T13:54:05.007159+0000 mon.b (mon.2) 121 : audit [DBG] from='mgr.? 172.21.2.120:0/2538961093' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:54:06.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:05 gibba013 bash[13024]: audit 2021-03-10T13:54:05.008100+0000 mon.b (mon.2) 122 : audit [DBG] from='mgr.? 172.21.2.120:0/2538961093' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:54:06.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:05 gibba013 bash[13024]: cluster 2021-03-10T13:54:05.009535+0000 mon.a (mon.0) 21 : cluster [DBG] Standby manager daemon x restarted 2021-03-10T13:54:06.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:05 gibba013 bash[13024]: cluster 2021-03-10T13:54:05.009582+0000 mon.a (mon.0) 22 : cluster [DBG] Standby manager daemon x started 2021-03-10T13:54:07.000 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:05.716214+0000 mon.b (mon.2) 123 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mgr metadata", "who": "gibba020.yqfnwy", "id": "gibba020.yqfnwy"}]: dispatch 2021-03-10T13:54:07.000 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:05.716342+0000 mon.b (mon.2) 124 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T13:54:07.000 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:05.716468+0000 mon.b (mon.2) 125 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T13:54:07.001 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: cluster 2021-03-10T13:54:05.716511+0000 mon.a (mon.0) 23 : cluster [DBG] mgrmap e23: gibba020.yqfnwy(active, starting, since 0.726463s), standbys: x, y 2021-03-10T13:54:07.001 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:05.716574+0000 mon.b (mon.2) 126 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:54:07.001 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:05.716694+0000 mon.b (mon.2) 127 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:54:07.001 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:05.716797+0000 mon.b (mon.2) 128 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:54:07.002 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:05.716916+0000 mon.b (mon.2) 129 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:54:07.002 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:05.717026+0000 mon.b (mon.2) 130 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:54:07.002 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:05.717138+0000 mon.b (mon.2) 131 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:54:07.003 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:05.717246+0000 mon.b (mon.2) 132 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:54:07.003 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:05.717365+0000 mon.b (mon.2) 133 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:54:07.003 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:05.717689+0000 mon.b (mon.2) 134 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T13:54:07.003 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:05.717809+0000 mon.b (mon.2) 135 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T13:54:07.003 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:05.718106+0000 mon.b (mon.2) 136 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T13:54:07.004 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:05.718688+0000 mon.b (mon.2) 137 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T13:54:07.004 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:05.719229+0000 mon.b (mon.2) 138 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2021-03-10T13:54:07.005 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:05.719677+0000 mon.b (mon.2) 139 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2021-03-10T13:54:07.005 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:05.720033+0000 mon.b (mon.2) 140 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba013"}]: dispatch 2021-03-10T13:54:07.005 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:05.720421+0000 mon.b (mon.2) 141 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba020"}]: dispatch 2021-03-10T13:54:07.005 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:05.720839+0000 mon.b (mon.2) 142 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2021-03-10T13:54:07.006 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:05.721232+0000 mon.b (mon.2) 143 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2021-03-10T13:54:07.006 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:05.721626+0000 mon.b (mon.2) 144 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2021-03-10T13:54:07.006 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:05.722000+0000 mon.b (mon.2) 145 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2021-03-10T13:54:07.006 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:05.722265+0000 mon.b (mon.2) 146 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2021-03-10T13:54:07.007 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:05.722510+0000 mon.b (mon.2) 147 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2021-03-10T13:54:07.007 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:05.722788+0000 mon.b (mon.2) 148 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2021-03-10T13:54:07.007 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:05.722972+0000 mon.b (mon.2) 149 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2021-03-10T13:54:07.007 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:05.723246+0000 mon.b (mon.2) 150 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2021-03-10T13:54:07.007 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:05.723544+0000 mon.b (mon.2) 151 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2021-03-10T13:54:07.008 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:05.723795+0000 mon.b (mon.2) 152 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2021-03-10T13:54:07.008 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:05.723990+0000 mon.b (mon.2) 153 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2021-03-10T13:54:07.008 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:05.724311+0000 mon.b (mon.2) 154 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:54:07.008 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:05.724607+0000 mon.b (mon.2) 155 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:54:07.009 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:05.725045+0000 mon.b (mon.2) 156 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2021-03-10T13:54:07.009 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:05.725309+0000 mon.b (mon.2) 157 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2021-03-10T13:54:07.009 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:05.725658+0000 mon.b (mon.2) 158 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-03-10T13:54:07.009 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:05.725903+0000 mon.b (mon.2) 159 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-03-10T13:54:07.009 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: cluster 2021-03-10T13:54:05.732504+0000 mon.a (mon.0) 24 : cluster [INF] Manager daemon gibba020.yqfnwy is now available 2021-03-10T13:54:07.010 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:05.813950+0000 mon.b (mon.2) 160 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:54:07.010 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:05.827758+0000 mon.b (mon.2) 161 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:54:07.010 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:05.831781+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.34427 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:54:07.010 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:05.840586+0000 mon.b (mon.2) 162 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T13:54:07.011 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:05.844410+0000 mon.a (mon.0) 26 : audit [INF] from='mgr.34427 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T13:54:07.011 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:06.014406+0000 mon.b (mon.2) 163 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:54:07.011 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:06.164240+0000 mon.b (mon.2) 164 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101607014, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475677Z\", \"created\": \"2021-03-10T13:44:20.530781Z\", \"started\": \"2021-03-10T13:44:20.552250Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba020\", \"container_id\": \"7268fb51c46b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371720192, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475817Z\", \"created\": \"2021-03-10T13:44:37.234781Z\", \"started\": \"2021-03-10T13:52:47.791424Z\"}, \"mgr.gibba020.yqfnwy\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba020.yqfnwy\", \"hostname\": \"gibba020\", \"container_id\": \"24f623ad250b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 401394892, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475899Z\", \"created\": \"2021-03-10T13:44:39.550781Z\", \"started\": \"2021-03-10T13:53:05.133311Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48276439, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475985Z\", \"created\": \"2021-03-10T13:46:23.866010Z\", \"started\": \"2021-03-10T13:46:27.049069Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47185920, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476192Z\", \"created\": \"2021-03-10T13:46:46.746011Z\", \"started\": \"2021-03-10T13:46:49.913581Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46231715, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476360Z\", \"created\": \"2021-03-10T13:47:09.378011Z\", \"started\": \"2021-03-10T13:47:12.839725Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476523Z\", \"created\": \"2021-03-10T13:47:32.870012Z\", \"started\": \"2021-03-10T13:47:36.592939Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 31362908, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476685Z\", \"created\": \"2021-03-10T13:47:55.226012Z\", \"started\": \"2021-03-10T13:48:34.834688Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 26235371, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476768Z\", \"created\": \"2021-03-10T13:47:56.326012Z\", \"started\": \"2021-03-10T13:47:58.273150Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31771852, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476844Z\", \"created\": \"2021-03-10T13:48:18.782012Z\", \"started\": \"2021-03-10T13:48:18.806617Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476919Z\", \"created\": \"2021-03-10T13:50:00.050014Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:31.067278Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086Z\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:52.338810Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038Z\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:54:06.163232Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:54:07.012 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:06.169663+0000 mon.b (mon.2) 165 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:54:07.012 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:06 gibba020 bash[9782]: audit 2021-03-10T13:54:06.171470+0000 mon.a (mon.0) 27 : audit [INF] from='mgr.34427 ' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:07.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:05.716214+0000 mon.b (mon.2) 123 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mgr metadata", "who": "gibba020.yqfnwy", "id": "gibba020.yqfnwy"}]: dispatch 2021-03-10T13:54:07.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:05.716342+0000 mon.b (mon.2) 124 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T13:54:07.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:05.716468+0000 mon.b (mon.2) 125 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T13:54:07.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: cluster 2021-03-10T13:54:05.716511+0000 mon.a (mon.0) 23 : cluster [DBG] mgrmap e23: gibba020.yqfnwy(active, starting, since 0.726463s), standbys: x, y 2021-03-10T13:54:07.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:05.716574+0000 mon.b (mon.2) 126 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:54:07.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:05.716694+0000 mon.b (mon.2) 127 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:54:07.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:05.716797+0000 mon.b (mon.2) 128 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:54:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:05.716916+0000 mon.b (mon.2) 129 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:54:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:05.717026+0000 mon.b (mon.2) 130 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:54:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:05.717138+0000 mon.b (mon.2) 131 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:54:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:05.717246+0000 mon.b (mon.2) 132 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:54:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:05.717365+0000 mon.b (mon.2) 133 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:54:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:05.717689+0000 mon.b (mon.2) 134 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T13:54:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:05.717809+0000 mon.b (mon.2) 135 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T13:54:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:05.718106+0000 mon.b (mon.2) 136 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T13:54:07.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:05.718688+0000 mon.b (mon.2) 137 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T13:54:07.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:05.719229+0000 mon.b (mon.2) 138 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2021-03-10T13:54:07.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:05.716214+0000 mon.b (mon.2) 123 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mgr metadata", "who": "gibba020.yqfnwy", "id": "gibba020.yqfnwy"}]: dispatch 2021-03-10T13:54:07.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:05.716342+0000 mon.b (mon.2) 124 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T13:54:07.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:05.716468+0000 mon.b (mon.2) 125 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T13:54:07.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: cluster 2021-03-10T13:54:05.716511+0000 mon.a (mon.0) 23 : cluster [DBG] mgrmap e23: gibba020.yqfnwy(active, starting, since 0.726463s), standbys: x, y 2021-03-10T13:54:07.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:05.716574+0000 mon.b (mon.2) 126 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:54:07.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:05.716694+0000 mon.b (mon.2) 127 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:54:07.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:05.716797+0000 mon.b (mon.2) 128 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:54:07.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:05.716916+0000 mon.b (mon.2) 129 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:54:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:05.717026+0000 mon.b (mon.2) 130 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:54:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:05.717138+0000 mon.b (mon.2) 131 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:54:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:05.717246+0000 mon.b (mon.2) 132 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:54:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:05.717365+0000 mon.b (mon.2) 133 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:54:07.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:05.717689+0000 mon.b (mon.2) 134 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T13:54:07.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:05.717809+0000 mon.b (mon.2) 135 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T13:54:07.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:05.718106+0000 mon.b (mon.2) 136 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T13:54:07.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:05.718688+0000 mon.b (mon.2) 137 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T13:54:07.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:05.719229+0000 mon.b (mon.2) 138 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2021-03-10T13:54:07.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:05.719677+0000 mon.b (mon.2) 139 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2021-03-10T13:54:07.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:05.720033+0000 mon.b (mon.2) 140 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba013"}]: dispatch 2021-03-10T13:54:07.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:05.720421+0000 mon.b (mon.2) 141 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba020"}]: dispatch 2021-03-10T13:54:07.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:05.720839+0000 mon.b (mon.2) 142 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2021-03-10T13:54:07.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:05.721232+0000 mon.b (mon.2) 143 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2021-03-10T13:54:07.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:05.721626+0000 mon.b (mon.2) 144 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2021-03-10T13:54:07.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:05.722000+0000 mon.b (mon.2) 145 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2021-03-10T13:54:07.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:05.722265+0000 mon.b (mon.2) 146 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2021-03-10T13:54:07.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:05.722510+0000 mon.b (mon.2) 147 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2021-03-10T13:54:07.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:05.722788+0000 mon.b (mon.2) 148 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2021-03-10T13:54:07.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:05.722972+0000 mon.b (mon.2) 149 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2021-03-10T13:54:07.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:05.723246+0000 mon.b (mon.2) 150 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2021-03-10T13:54:07.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:05.723544+0000 mon.b (mon.2) 151 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2021-03-10T13:54:07.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:05.723795+0000 mon.b (mon.2) 152 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2021-03-10T13:54:07.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:05.723990+0000 mon.b (mon.2) 153 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2021-03-10T13:54:07.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:05.724311+0000 mon.b (mon.2) 154 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:54:07.142 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:05.719677+0000 mon.b (mon.2) 139 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2021-03-10T13:54:07.142 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:05.720033+0000 mon.b (mon.2) 140 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba013"}]: dispatch 2021-03-10T13:54:07.142 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:05.720421+0000 mon.b (mon.2) 141 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba020"}]: dispatch 2021-03-10T13:54:07.142 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:05.720839+0000 mon.b (mon.2) 142 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2021-03-10T13:54:07.143 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:05.721232+0000 mon.b (mon.2) 143 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2021-03-10T13:54:07.143 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:05.721626+0000 mon.b (mon.2) 144 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2021-03-10T13:54:07.143 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:05.722000+0000 mon.b (mon.2) 145 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2021-03-10T13:54:07.143 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:05.722265+0000 mon.b (mon.2) 146 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2021-03-10T13:54:07.144 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:05.722510+0000 mon.b (mon.2) 147 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2021-03-10T13:54:07.144 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:05.722788+0000 mon.b (mon.2) 148 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2021-03-10T13:54:07.144 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:05.722972+0000 mon.b (mon.2) 149 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2021-03-10T13:54:07.144 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:05.723246+0000 mon.b (mon.2) 150 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2021-03-10T13:54:07.145 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:05.723544+0000 mon.b (mon.2) 151 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2021-03-10T13:54:07.145 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:05.723795+0000 mon.b (mon.2) 152 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2021-03-10T13:54:07.145 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:05.723990+0000 mon.b (mon.2) 153 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2021-03-10T13:54:07.145 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:05.724311+0000 mon.b (mon.2) 154 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T13:54:07.146 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:05.724607+0000 mon.b (mon.2) 155 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:54:07.146 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:05.725045+0000 mon.b (mon.2) 156 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2021-03-10T13:54:07.146 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:05.725309+0000 mon.b (mon.2) 157 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2021-03-10T13:54:07.146 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:05.725658+0000 mon.b (mon.2) 158 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-03-10T13:54:07.147 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:05.725903+0000 mon.b (mon.2) 159 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-03-10T13:54:07.147 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: cluster 2021-03-10T13:54:05.732504+0000 mon.a (mon.0) 24 : cluster [INF] Manager daemon gibba020.yqfnwy is now available 2021-03-10T13:54:07.147 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:05.813950+0000 mon.b (mon.2) 160 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:54:07.147 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:05.827758+0000 mon.b (mon.2) 161 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:54:07.148 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:05.831781+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.34427 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:54:07.148 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:05.840586+0000 mon.b (mon.2) 162 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T13:54:07.148 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:05.844410+0000 mon.a (mon.0) 26 : audit [INF] from='mgr.34427 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T13:54:07.148 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:06.014406+0000 mon.b (mon.2) 163 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:54:07.149 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:05.724607+0000 mon.b (mon.2) 155 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T13:54:07.149 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:05.725045+0000 mon.b (mon.2) 156 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2021-03-10T13:54:07.149 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:05.725309+0000 mon.b (mon.2) 157 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2021-03-10T13:54:07.150 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:05.725658+0000 mon.b (mon.2) 158 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-03-10T13:54:07.150 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:05.725903+0000 mon.b (mon.2) 159 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-03-10T13:54:07.150 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: cluster 2021-03-10T13:54:05.732504+0000 mon.a (mon.0) 24 : cluster [INF] Manager daemon gibba020.yqfnwy is now available 2021-03-10T13:54:07.150 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:05.813950+0000 mon.b (mon.2) 160 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:54:07.151 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:05.827758+0000 mon.b (mon.2) 161 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:54:07.151 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:05.831781+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.34427 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:54:07.151 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:05.840586+0000 mon.b (mon.2) 162 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T13:54:07.151 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:05.844410+0000 mon.a (mon.0) 26 : audit [INF] from='mgr.34427 ' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T13:54:07.152 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:06.014406+0000 mon.b (mon.2) 163 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:54:07.152 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:06.164240+0000 mon.b (mon.2) 164 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101607014, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475677Z\", \"created\": \"2021-03-10T13:44:20.530781Z\", \"started\": \"2021-03-10T13:44:20.552250Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba020\", \"container_id\": \"7268fb51c46b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371720192, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475817Z\", \"created\": \"2021-03-10T13:44:37.234781Z\", \"started\": \"2021-03-10T13:52:47.791424Z\"}, \"mgr.gibba020.yqfnwy\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba020.yqfnwy\", \"hostname\": \"gibba020\", \"container_id\": \"24f623ad250b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 401394892, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475899Z\", \"created\": \"2021-03-10T13:44:39.550781Z\", \"started\": \"2021-03-10T13:53:05.133311Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48276439, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475985Z\", \"created\": \"2021-03-10T13:46:23.866010Z\", \"started\": \"2021-03-10T13:46:27.049069Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47185920, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476192Z\", \"created\": \"2021-03-10T13:46:46.746011Z\", \"started\": \"2021-03-10T13:46:49.913581Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46231715, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476360Z\", \"created\": \"2021-03-10T13:47:09.378011Z\", \"started\": \"2021-03-10T13:47:12.839725Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476523Z\", \"created\": \"2021-03-10T13:47:32.870012Z\", \"started\": \"2021-03-10T13:47:36.592939Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 31362908, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476685Z\", \"created\": \"2021-03-10T13:47:55.226012Z\", \"started\": \"2021-03-10T13:48:34.834688Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 26235371, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476768Z\", \"created\": \"2021-03-10T13:47:56.326012Z\", \"started\": \"2021-03-10T13:47:58.273150Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31771852, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476844Z\", \"created\": \"2021-03-10T13:48:18.782012Z\", \"started\": \"2021-03-10T13:48:18.806617Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476919Z\", \"created\": \"2021-03-10T13:50:00.050014Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:31.067278Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086Z\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:52.338810Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038Z\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:54:06.163232Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:54:07.152 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:06.169663+0000 mon.b (mon.2) 165 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:54:07.153 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[29418]: audit 2021-03-10T13:54:06.171470+0000 mon.a (mon.0) 27 : audit [INF] from='mgr.34427 ' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:07.153 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:06.164240+0000 mon.b (mon.2) 164 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101607014, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475677Z\", \"created\": \"2021-03-10T13:44:20.530781Z\", \"started\": \"2021-03-10T13:44:20.552250Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba020\", \"container_id\": \"7268fb51c46b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371720192, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475817Z\", \"created\": \"2021-03-10T13:44:37.234781Z\", \"started\": \"2021-03-10T13:52:47.791424Z\"}, \"mgr.gibba020.yqfnwy\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba020.yqfnwy\", \"hostname\": \"gibba020\", \"container_id\": \"24f623ad250b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 401394892, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475899Z\", \"created\": \"2021-03-10T13:44:39.550781Z\", \"started\": \"2021-03-10T13:53:05.133311Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48276439, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.475985Z\", \"created\": \"2021-03-10T13:46:23.866010Z\", \"started\": \"2021-03-10T13:46:27.049069Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47185920, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476192Z\", \"created\": \"2021-03-10T13:46:46.746011Z\", \"started\": \"2021-03-10T13:46:49.913581Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46231715, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476360Z\", \"created\": \"2021-03-10T13:47:09.378011Z\", \"started\": \"2021-03-10T13:47:12.839725Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47972352, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476523Z\", \"created\": \"2021-03-10T13:47:32.870012Z\", \"started\": \"2021-03-10T13:47:36.592939Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 31362908, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476685Z\", \"created\": \"2021-03-10T13:47:55.226012Z\", \"started\": \"2021-03-10T13:48:34.834688Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 26235371, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476768Z\", \"created\": \"2021-03-10T13:47:56.326012Z\", \"started\": \"2021-03-10T13:47:58.273150Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31771852, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476844Z\", \"created\": \"2021-03-10T13:48:18.782012Z\", \"started\": \"2021-03-10T13:48:18.806617Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:53:20.476919Z\", \"created\": \"2021-03-10T13:50:00.050014Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:31.067278Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086Z\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:52.338810Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038Z\"}}, \"last_device_update\": \"2021-03-10T13:47:41.483965Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:54:06.163232Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:54:07.153 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:06.169663+0000 mon.b (mon.2) 165 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:54:07.154 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:06 gibba013 bash[13024]: audit 2021-03-10T13:54:06.171470+0000 mon.a (mon.0) 27 : audit [INF] from='mgr.34427 ' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:08.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:07 gibba013 bash[29418]: cluster 2021-03-10T13:54:06.723280+0000 mon.a (mon.0) 28 : cluster [DBG] mgrmap e24: gibba020.yqfnwy(active, since 1.73326s), standbys: x, y 2021-03-10T13:54:08.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:07 gibba013 bash[29418]: cluster 2021-03-10T13:54:06.726111+0000 mgr.gibba020.yqfnwy (mgr.34427) 1 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:08.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:07 gibba013 bash[29418]: cluster 2021-03-10T13:54:06.996529+0000 mgr.gibba020.yqfnwy (mgr.34427) 2 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba020.yqfnwy: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:08.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:07 gibba013 bash[13024]: cluster 2021-03-10T13:54:06.723280+0000 mon.a (mon.0) 28 : cluster [DBG] mgrmap e24: gibba020.yqfnwy(active, since 1.73326s), standbys: x, y 2021-03-10T13:54:08.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:07 gibba013 bash[13024]: cluster 2021-03-10T13:54:06.726111+0000 mgr.gibba020.yqfnwy (mgr.34427) 1 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:08.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:07 gibba013 bash[13024]: cluster 2021-03-10T13:54:06.996529+0000 mgr.gibba020.yqfnwy (mgr.34427) 2 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba020.yqfnwy: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:08.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:07 gibba020 bash[9782]: cluster 2021-03-10T13:54:06.723280+0000 mon.a (mon.0) 28 : cluster [DBG] mgrmap e24: gibba020.yqfnwy(active, since 1.73326s), standbys: x, y 2021-03-10T13:54:08.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:07 gibba020 bash[9782]: cluster 2021-03-10T13:54:06.726111+0000 mgr.gibba020.yqfnwy (mgr.34427) 1 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:08.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:07 gibba020 bash[9782]: cluster 2021-03-10T13:54:06.996529+0000 mgr.gibba020.yqfnwy (mgr.34427) 2 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba020.yqfnwy: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:09.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:08 gibba013 bash[29418]: cluster 2021-03-10T13:54:07.718677+0000 mgr.gibba020.yqfnwy (mgr.34427) 3 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:09.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:08 gibba013 bash[29418]: cluster 2021-03-10T13:54:07.729086+0000 mon.a (mon.0) 29 : cluster [INF] Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2021-03-10T13:54:09.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:08 gibba013 bash[29418]: cluster 2021-03-10T13:54:07.743039+0000 mon.a (mon.0) 30 : cluster [DBG] mgrmap e25: gibba020.yqfnwy(active, since 2s), standbys: x, y 2021-03-10T13:54:09.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:08 gibba013 bash[13024]: cluster 2021-03-10T13:54:07.718677+0000 mgr.gibba020.yqfnwy (mgr.34427) 3 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:09.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:08 gibba013 bash[13024]: cluster 2021-03-10T13:54:07.729086+0000 mon.a (mon.0) 29 : cluster [INF] Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2021-03-10T13:54:09.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:08 gibba013 bash[13024]: cluster 2021-03-10T13:54:07.743039+0000 mon.a (mon.0) 30 : cluster [DBG] mgrmap e25: gibba020.yqfnwy(active, since 2s), standbys: x, y 2021-03-10T13:54:09.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:08 gibba020 bash[9782]: cluster 2021-03-10T13:54:07.718677+0000 mgr.gibba020.yqfnwy (mgr.34427) 3 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:09.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:08 gibba020 bash[9782]: cluster 2021-03-10T13:54:07.729086+0000 mon.a (mon.0) 29 : cluster [INF] Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2021-03-10T13:54:09.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:08 gibba020 bash[9782]: cluster 2021-03-10T13:54:07.743039+0000 mon.a (mon.0) 30 : cluster [DBG] mgrmap e25: gibba020.yqfnwy(active, since 2s), standbys: x, y 2021-03-10T13:54:10.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:10 gibba013 bash[13024]: audit 2021-03-10T13:54:09.753541+0000 mon.b (mon.2) 166 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"656fb288b68f\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 38346424, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.745998Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:53:58.730066Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"7609af74159c\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373502771, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.746547Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:53:50.102625Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96290734, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.746878Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49996103, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.747176Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50153390, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.747915Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46504345, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.748670Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49115299, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.749319Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25648168, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.749952Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a7c14b180bbc\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12813598, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.750276Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:53:31.062073Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:37.217814Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:55.838140Z\"}}, \"last_daemon_update\": \"2021-03-10T13:54:09.750776Z\", \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:53:50.272497Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:54:10.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:10 gibba013 bash[13024]: audit 2021-03-10T13:54:09.761245+0000 mon.a (mon.0) 31 : audit [INF] from='mgr.34427 ' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:10.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:10 gibba013 bash[13024]: cephadm 2021-03-10T13:54:09.761486+0000 mgr.gibba020.yqfnwy (mgr.34427) 5 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T13:54:10.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:10 gibba013 bash[29418]: audit 2021-03-10T13:54:09.753541+0000 mon.b (mon.2) 166 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"656fb288b68f\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 38346424, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.745998Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:53:58.730066Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"7609af74159c\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373502771, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.746547Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:53:50.102625Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96290734, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.746878Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49996103, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.747176Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50153390, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.747915Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46504345, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.748670Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49115299, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.749319Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25648168, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.749952Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a7c14b180bbc\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12813598, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.750276Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:53:31.062073Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:37.217814Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:55.838140Z\"}}, \"last_daemon_update\": \"2021-03-10T13:54:09.750776Z\", \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:53:50.272497Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:54:10.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:10 gibba013 bash[29418]: audit 2021-03-10T13:54:09.761245+0000 mon.a (mon.0) 31 : audit [INF] from='mgr.34427 ' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:10.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:10 gibba013 bash[29418]: cephadm 2021-03-10T13:54:09.761486+0000 mgr.gibba020.yqfnwy (mgr.34427) 5 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T13:54:10.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:10 gibba013 bash[13024]: audit 2021-03-10T13:54:10.159533+0000 mon.b (mon.2) 167 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 104511569, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:10.157627Z\", \"created\": \"2021-03-10T13:44:20.530781Z\", \"started\": \"2021-03-10T13:44:20.552250Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba020\", \"container_id\": \"7268fb51c46b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 375914496, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:10.157737Z\", \"created\": \"2021-03-10T13:44:37.234781Z\", \"started\": \"2021-03-10T13:52:47.791424Z\"}, \"mgr.gibba020.yqfnwy\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba020.yqfnwy\", \"hostname\": \"gibba020\", \"container_id\": \"24f623ad250b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403177472, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:10.157798Z\", \"created\": \"2021-03-10T13:44:39.550781Z\", \"started\": \"2021-03-10T13:53:05.133311Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49366958, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:10.157854Z\", \"created\": \"2021-03-10T13:46:23.866010Z\", \"started\": \"2021-03-10T13:46:27.049069Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47877980, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:10.158010Z\", \"created\": \"2021-03-10T13:46:46.746011Z\", \"started\": \"2021-03-10T13:46:49.913581Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46577745, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:10.158136Z\", \"created\": \"2021-03-10T13:47:09.378011Z\", \"started\": \"2021-03-10T13:47:12.839725Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49041899, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:10.158255Z\", \"created\": \"2021-03-10T13:47:32.870012Z\", \"started\": \"2021-03-10T13:47:36.592939Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 31908167, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:10.158374Z\", \"created\": \"2021-03-10T13:47:55.226012Z\", \"started\": \"2021-03-10T13:48:34.834688Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 26424115, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:10.158434Z\", \"created\": \"2021-03-10T13:47:56.326012Z\", \"started\": \"2021-03-10T13:47:58.273150Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 32170311, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:10.158489Z\", \"created\": \"2021-03-10T13:48:18.782012Z\", \"started\": \"2021-03-10T13:48:18.806617Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:10.158543Z\", \"created\": \"2021-03-10T13:50:00.050014Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:31.067278Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086Z\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:52.338810Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038Z\"}}, \"last_daemon_update\": \"2021-03-10T13:54:10.158615Z\", \"last_device_update\": \"2021-03-10T13:47:41.483965Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:54:06.163232Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:54:10.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:10 gibba013 bash[13024]: audit 2021-03-10T13:54:10.175695+0000 mon.a (mon.0) 32 : audit [INF] from='mgr.34427 ' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:10.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:10 gibba013 bash[13024]: audit 2021-03-10T13:54:10.373705+0000 mon.b (mon.2) 168 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:54:10.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:10 gibba013 bash[13024]: audit 2021-03-10T13:54:10.387116+0000 mon.a (mon.0) 33 : audit [INF] from='mgr.34427 ' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:10.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:10 gibba013 bash[13024]: audit 2021-03-10T13:54:10.388921+0000 mon.b (mon.2) 169 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:54:10.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:10 gibba013 bash[13024]: audit 2021-03-10T13:54:10.390339+0000 mon.b (mon.2) 170 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:10.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:10 gibba013 bash[13024]: audit 2021-03-10T13:54:10.391527+0000 mon.b (mon.2) 171 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2021-03-10T13:54:10.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:10 gibba013 bash[29418]: audit 2021-03-10T13:54:10.159533+0000 mon.b (mon.2) 167 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 104511569, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:10.157627Z\", \"created\": \"2021-03-10T13:44:20.530781Z\", \"started\": \"2021-03-10T13:44:20.552250Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba020\", \"container_id\": \"7268fb51c46b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 375914496, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:10.157737Z\", \"created\": \"2021-03-10T13:44:37.234781Z\", \"started\": \"2021-03-10T13:52:47.791424Z\"}, \"mgr.gibba020.yqfnwy\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba020.yqfnwy\", \"hostname\": \"gibba020\", \"container_id\": \"24f623ad250b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403177472, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:10.157798Z\", \"created\": \"2021-03-10T13:44:39.550781Z\", \"started\": \"2021-03-10T13:53:05.133311Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49366958, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:10.157854Z\", \"created\": \"2021-03-10T13:46:23.866010Z\", \"started\": \"2021-03-10T13:46:27.049069Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47877980, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:10.158010Z\", \"created\": \"2021-03-10T13:46:46.746011Z\", \"started\": \"2021-03-10T13:46:49.913581Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46577745, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:10.158136Z\", \"created\": \"2021-03-10T13:47:09.378011Z\", \"started\": \"2021-03-10T13:47:12.839725Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49041899, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:10.158255Z\", \"created\": \"2021-03-10T13:47:32.870012Z\", \"started\": \"2021-03-10T13:47:36.592939Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 31908167, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:10.158374Z\", \"created\": \"2021-03-10T13:47:55.226012Z\", \"started\": \"2021-03-10T13:48:34.834688Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 26424115, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:10.158434Z\", \"created\": \"2021-03-10T13:47:56.326012Z\", \"started\": \"2021-03-10T13:47:58.273150Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 32170311, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:10.158489Z\", \"created\": \"2021-03-10T13:48:18.782012Z\", \"started\": \"2021-03-10T13:48:18.806617Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:10.158543Z\", \"created\": \"2021-03-10T13:50:00.050014Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:31.067278Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086Z\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:52.338810Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038Z\"}}, \"last_daemon_update\": \"2021-03-10T13:54:10.158615Z\", \"last_device_update\": \"2021-03-10T13:47:41.483965Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:54:06.163232Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:54:10.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:10 gibba013 bash[29418]: audit 2021-03-10T13:54:10.175695+0000 mon.a (mon.0) 32 : audit [INF] from='mgr.34427 ' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:10.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:10 gibba013 bash[29418]: audit 2021-03-10T13:54:10.373705+0000 mon.b (mon.2) 168 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:54:10.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:10 gibba013 bash[29418]: audit 2021-03-10T13:54:10.387116+0000 mon.a (mon.0) 33 : audit [INF] from='mgr.34427 ' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:10.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:10 gibba013 bash[29418]: audit 2021-03-10T13:54:10.388921+0000 mon.b (mon.2) 169 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:54:10.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:10 gibba013 bash[29418]: audit 2021-03-10T13:54:10.390339+0000 mon.b (mon.2) 170 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:10.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:10 gibba013 bash[29418]: audit 2021-03-10T13:54:10.391527+0000 mon.b (mon.2) 171 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2021-03-10T13:54:11.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:10 gibba020 bash[9782]: audit 2021-03-10T13:54:09.753541+0000 mon.b (mon.2) 166 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"656fb288b68f\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 38346424, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.745998Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:53:58.730066Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"7609af74159c\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373502771, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.746547Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:53:50.102625Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"c561d31798a4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 96290734, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.746878Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:44:05.674115Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49996103, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.747176Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50153390, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.747915Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46504345, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.748670Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49115299, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.749319Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25648168, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.749952Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a7c14b180bbc\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12813598, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.750276Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:53:31.062073Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:22.750465Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:37.217814Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:55.838140Z\"}}, \"last_daemon_update\": \"2021-03-10T13:54:09.750776Z\", \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:53:50.272497Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:54:11.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:10 gibba020 bash[9782]: audit 2021-03-10T13:54:09.761245+0000 mon.a (mon.0) 31 : audit [INF] from='mgr.34427 ' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:11.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:10 gibba020 bash[9782]: cephadm 2021-03-10T13:54:09.761486+0000 mgr.gibba020.yqfnwy (mgr.34427) 5 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T13:54:11.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:10 gibba020 bash[9782]: audit 2021-03-10T13:54:10.159533+0000 mon.b (mon.2) 167 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba020","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"a58fc42cd46b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 104511569, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:10.157627Z\", \"created\": \"2021-03-10T13:44:20.530781Z\", \"started\": \"2021-03-10T13:44:20.552250Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba020\", \"container_id\": \"7268fb51c46b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 375914496, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:10.157737Z\", \"created\": \"2021-03-10T13:44:37.234781Z\", \"started\": \"2021-03-10T13:52:47.791424Z\"}, \"mgr.gibba020.yqfnwy\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba020.yqfnwy\", \"hostname\": \"gibba020\", \"container_id\": \"24f623ad250b\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403177472, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:10.157798Z\", \"created\": \"2021-03-10T13:44:39.550781Z\", \"started\": \"2021-03-10T13:53:05.133311Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba020\", \"container_id\": \"5bcc0da1a794\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49366958, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:10.157854Z\", \"created\": \"2021-03-10T13:46:23.866010Z\", \"started\": \"2021-03-10T13:46:27.049069Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba020\", \"container_id\": \"8e0d292ca03b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47877980, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:10.158010Z\", \"created\": \"2021-03-10T13:46:46.746011Z\", \"started\": \"2021-03-10T13:46:49.913581Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba020\", \"container_id\": \"b54758e37be1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46577745, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:10.158136Z\", \"created\": \"2021-03-10T13:47:09.378011Z\", \"started\": \"2021-03-10T13:47:12.839725Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba020\", \"container_id\": \"75c9ee8106fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49041899, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:10.158255Z\", \"created\": \"2021-03-10T13:47:32.870012Z\", \"started\": \"2021-03-10T13:47:36.592939Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"f231d37f1a20\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 31908167, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:10.158374Z\", \"created\": \"2021-03-10T13:47:55.226012Z\", \"started\": \"2021-03-10T13:48:34.834688Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba020\", \"container_id\": \"486e0c838f13\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 26424115, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:10.158434Z\", \"created\": \"2021-03-10T13:47:56.326012Z\", \"started\": \"2021-03-10T13:47:58.273150Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba020\", \"container_id\": \"8add9188497a\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 32170311, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:10.158489Z\", \"created\": \"2021-03-10T13:48:18.782012Z\", \"started\": \"2021-03-10T13:48:18.806617Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba020.txcybs\", \"hostname\": \"gibba020\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:10.158543Z\", \"created\": \"2021-03-10T13:50:00.050014Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6b05701f-f937-4752-bbf7-a7196766d792\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"CGECkI-9eR3-rWbc-Cfnb-gxjb-fjHf-c1jI7r\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"eb7b7486-28ef-4b88-ac83-c9ddd0cfd9d7\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soEiST-demz-gvFP-HUnh-dk2o-tzBP-eXoAvK\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"81a906b6-e201-49ad-ae65-0e049d746e98\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"wWEhbz-eWJT-nBJJ-XgDb-pYw5-pqtr-mLTVf6\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"e1ee562f-9cbb-49d7-864e-764dd41860fe\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"m4cRSq-RdAt-H5vb-jiCz-LlE0-QEMB-VQrFsK\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM920000CH375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38OF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:31.067278Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:34.937086Z\"}, \"mgr.gibba020.yqfnwy\": {\"deps\": [], \"last_config\": \"2021-03-10T13:52:52.338810Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:22.156123Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:44.950592Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:07.538113Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:30.997179Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T13:48:27.704324Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:55.931794Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T13:48:08.561458Z\"}, \"rgw.r.z.gibba020.txcybs\": {\"deps\": [], \"last_config\": \"2021-03-10T13:49:57.781038Z\"}}, \"last_daemon_update\": \"2021-03-10T13:54:10.158615Z\", \"last_device_update\": \"2021-03-10T13:47:41.483965Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.120\"], \"172.21.15.254\": [\"172.21.2.120\"]}, \"last_host_check\": \"2021-03-10T13:54:06.163232Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:54:11.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:10 gibba020 bash[9782]: audit 2021-03-10T13:54:10.175695+0000 mon.a (mon.0) 32 : audit [INF] from='mgr.34427 ' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:11.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:10 gibba020 bash[9782]: audit 2021-03-10T13:54:10.373705+0000 mon.b (mon.2) 168 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:54:11.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:10 gibba020 bash[9782]: audit 2021-03-10T13:54:10.387116+0000 mon.a (mon.0) 33 : audit [INF] from='mgr.34427 ' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:11.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:10 gibba020 bash[9782]: audit 2021-03-10T13:54:10.388921+0000 mon.b (mon.2) 169 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:54:11.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:10 gibba020 bash[9782]: audit 2021-03-10T13:54:10.390339+0000 mon.b (mon.2) 170 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:11.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:10 gibba020 bash[9782]: audit 2021-03-10T13:54:10.391527+0000 mon.b (mon.2) 171 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2021-03-10T13:54:11.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:11 gibba013 bash[29418]: cephadm 2021-03-10T13:54:10.174881+0000 mgr.gibba020.yqfnwy (mgr.34427) 6 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T13:54:11.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:11 gibba013 bash[29418]: cluster 2021-03-10T13:54:10.373393+0000 mgr.gibba020.yqfnwy (mgr.34427) 7 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:11.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:11 gibba013 bash[29418]: cephadm 2021-03-10T13:54:10.388267+0000 mgr.gibba020.yqfnwy (mgr.34427) 8 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:54:11.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:11 gibba013 bash[29418]: cephadm 2021-03-10T13:54:10.390040+0000 mgr.gibba020.yqfnwy (mgr.34427) 9 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:54:11.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:11 gibba013 bash[29418]: cephadm 2021-03-10T13:54:10.391236+0000 mgr.gibba020.yqfnwy (mgr.34427) 10 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:54:11.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:11 gibba013 bash[29418]: cephadm 2021-03-10T13:54:10.391275+0000 mgr.gibba020.yqfnwy (mgr.34427) 11 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:54:11.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:11 gibba013 bash[29418]: cephadm 2021-03-10T13:54:10.392235+0000 mgr.gibba020.yqfnwy (mgr.34427) 12 : cephadm [INF] It is presumed safe to stop mon.c 2021-03-10T13:54:11.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:11 gibba013 bash[29418]: cephadm 2021-03-10T13:54:10.392273+0000 mgr.gibba020.yqfnwy (mgr.34427) 13 : cephadm [INF] Upgrade: It is presumed safe to stop mon.c 2021-03-10T13:54:11.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:11 gibba013 bash[29418]: cluster 2021-03-10T13:54:10.686876+0000 mon.a (mon.0) 34 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2021-03-10T13:54:11.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:11 gibba013 bash[13024]: cephadm 2021-03-10T13:54:10.174881+0000 mgr.gibba020.yqfnwy (mgr.34427) 6 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T13:54:11.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:11 gibba013 bash[13024]: cluster 2021-03-10T13:54:10.373393+0000 mgr.gibba020.yqfnwy (mgr.34427) 7 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:11.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:11 gibba013 bash[13024]: cephadm 2021-03-10T13:54:10.388267+0000 mgr.gibba020.yqfnwy (mgr.34427) 8 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:54:11.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:11 gibba013 bash[13024]: cephadm 2021-03-10T13:54:10.390040+0000 mgr.gibba020.yqfnwy (mgr.34427) 9 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:54:11.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:11 gibba013 bash[13024]: cephadm 2021-03-10T13:54:10.391236+0000 mgr.gibba020.yqfnwy (mgr.34427) 10 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:54:11.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:11 gibba013 bash[13024]: cephadm 2021-03-10T13:54:10.391275+0000 mgr.gibba020.yqfnwy (mgr.34427) 11 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:54:11.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:11 gibba013 bash[13024]: cephadm 2021-03-10T13:54:10.392235+0000 mgr.gibba020.yqfnwy (mgr.34427) 12 : cephadm [INF] It is presumed safe to stop mon.c 2021-03-10T13:54:11.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:11 gibba013 bash[13024]: cephadm 2021-03-10T13:54:10.392273+0000 mgr.gibba020.yqfnwy (mgr.34427) 13 : cephadm [INF] Upgrade: It is presumed safe to stop mon.c 2021-03-10T13:54:11.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:11 gibba013 bash[13024]: cluster 2021-03-10T13:54:10.686876+0000 mon.a (mon.0) 34 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2021-03-10T13:54:12.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:11 gibba020 bash[9782]: cephadm 2021-03-10T13:54:10.174881+0000 mgr.gibba020.yqfnwy (mgr.34427) 6 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T13:54:12.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:11 gibba020 bash[9782]: cluster 2021-03-10T13:54:10.373393+0000 mgr.gibba020.yqfnwy (mgr.34427) 7 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:12.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:11 gibba020 bash[9782]: cephadm 2021-03-10T13:54:10.388267+0000 mgr.gibba020.yqfnwy (mgr.34427) 8 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:54:12.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:11 gibba020 bash[9782]: cephadm 2021-03-10T13:54:10.390040+0000 mgr.gibba020.yqfnwy (mgr.34427) 9 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:54:12.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:11 gibba020 bash[9782]: cephadm 2021-03-10T13:54:10.391236+0000 mgr.gibba020.yqfnwy (mgr.34427) 10 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:54:12.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:11 gibba020 bash[9782]: cephadm 2021-03-10T13:54:10.391275+0000 mgr.gibba020.yqfnwy (mgr.34427) 11 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:54:12.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:11 gibba020 bash[9782]: cephadm 2021-03-10T13:54:10.392235+0000 mgr.gibba020.yqfnwy (mgr.34427) 12 : cephadm [INF] It is presumed safe to stop mon.c 2021-03-10T13:54:12.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:11 gibba020 bash[9782]: cephadm 2021-03-10T13:54:10.392273+0000 mgr.gibba020.yqfnwy (mgr.34427) 13 : cephadm [INF] Upgrade: It is presumed safe to stop mon.c 2021-03-10T13:54:12.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:11 gibba020 bash[9782]: cluster 2021-03-10T13:54:10.686876+0000 mon.a (mon.0) 34 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2021-03-10T13:54:13.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:12 gibba013 bash[29418]: audit 2021-03-10T13:54:12.479612+0000 mon.b (mon.2) 172 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.c"}]: dispatch 2021-03-10T13:54:13.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:12 gibba013 bash[29418]: audit 2021-03-10T13:54:12.487896+0000 mon.a (mon.0) 35 : audit [INF] from='mgr.34427 ' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:13.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:12 gibba013 bash[29418]: audit 2021-03-10T13:54:12.492177+0000 mon.b (mon.2) 173 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:54:13.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:12 gibba013 bash[29418]: audit 2021-03-10T13:54:12.493151+0000 mon.b (mon.2) 174 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:54:13.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:12 gibba013 bash[29418]: audit 2021-03-10T13:54:12.494043+0000 mon.b (mon.2) 175 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:54:13.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:12 gibba013 bash[29418]: audit 2021-03-10T13:54:12.495107+0000 mon.b (mon.2) 176 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T13:54:13.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:12 gibba013 bash[13024]: audit 2021-03-10T13:54:12.479612+0000 mon.b (mon.2) 172 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.c"}]: dispatch 2021-03-10T13:54:13.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:12 gibba013 bash[13024]: audit 2021-03-10T13:54:12.487896+0000 mon.a (mon.0) 35 : audit [INF] from='mgr.34427 ' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:13.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:12 gibba013 bash[13024]: audit 2021-03-10T13:54:12.492177+0000 mon.b (mon.2) 173 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:54:13.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:12 gibba013 bash[13024]: audit 2021-03-10T13:54:12.493151+0000 mon.b (mon.2) 174 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:54:13.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:12 gibba013 bash[13024]: audit 2021-03-10T13:54:12.494043+0000 mon.b (mon.2) 175 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:54:13.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:12 gibba013 bash[13024]: audit 2021-03-10T13:54:12.495107+0000 mon.b (mon.2) 176 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T13:54:13.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:12 gibba020 bash[9782]: audit 2021-03-10T13:54:12.479612+0000 mon.b (mon.2) 172 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.c"}]: dispatch 2021-03-10T13:54:13.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:12 gibba020 bash[9782]: audit 2021-03-10T13:54:12.487896+0000 mon.a (mon.0) 35 : audit [INF] from='mgr.34427 ' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:13.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:12 gibba020 bash[9782]: audit 2021-03-10T13:54:12.492177+0000 mon.b (mon.2) 173 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:54:13.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:12 gibba020 bash[9782]: audit 2021-03-10T13:54:12.493151+0000 mon.b (mon.2) 174 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:54:13.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:12 gibba020 bash[9782]: audit 2021-03-10T13:54:12.494043+0000 mon.b (mon.2) 175 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:54:13.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:12 gibba020 bash[9782]: audit 2021-03-10T13:54:12.495107+0000 mon.b (mon.2) 176 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T13:54:13.773 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:13 gibba013 bash[29418]: cluster 2021-03-10T13:54:12.375477+0000 mgr.gibba020.yqfnwy (mgr.34427) 14 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:13.774 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:13 gibba013 bash[29418]: cephadm 2021-03-10T13:54:12.478495+0000 mgr.gibba020.yqfnwy (mgr.34427) 15 : cephadm [INF] Upgrade: Updating mon.c 2021-03-10T13:54:13.774 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:13 gibba013 bash[29418]: cephadm 2021-03-10T13:54:12.494809+0000 mgr.gibba020.yqfnwy (mgr.34427) 16 : cephadm [INF] Deploying daemon mon.c on gibba013 2021-03-10T13:54:13.774 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:13 gibba013 bash[13024]: cluster 2021-03-10T13:54:12.375477+0000 mgr.gibba020.yqfnwy (mgr.34427) 14 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:13.775 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:13 gibba013 bash[13024]: cephadm 2021-03-10T13:54:12.478495+0000 mgr.gibba020.yqfnwy (mgr.34427) 15 : cephadm [INF] Upgrade: Updating mon.c 2021-03-10T13:54:13.775 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:13 gibba013 bash[13024]: cephadm 2021-03-10T13:54:12.494809+0000 mgr.gibba020.yqfnwy (mgr.34427) 16 : cephadm [INF] Deploying daemon mon.c on gibba013 2021-03-10T13:54:14.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:13 gibba020 bash[9782]: cluster 2021-03-10T13:54:12.375477+0000 mgr.gibba020.yqfnwy (mgr.34427) 14 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:14.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:13 gibba020 bash[9782]: cephadm 2021-03-10T13:54:12.478495+0000 mgr.gibba020.yqfnwy (mgr.34427) 15 : cephadm [INF] Upgrade: Updating mon.c 2021-03-10T13:54:14.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:13 gibba020 bash[9782]: cephadm 2021-03-10T13:54:12.494809+0000 mgr.gibba020.yqfnwy (mgr.34427) 16 : cephadm [INF] Deploying daemon mon.c on gibba013 2021-03-10T13:54:14.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:14 gibba013 systemd[1]: Stopping Ceph mon.c for 7672acc8-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:54:14.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:14 gibba013 bash[13024]: debug 2021-03-10T13:54:14.496+0000 7f2958a03700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T13:54:14.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:14 gibba013 bash[13024]: debug 2021-03-10T13:54:14.496+0000 7f2958a03700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2021-03-10T13:54:15.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:15 gibba013 docker[30294]: ceph-7672acc8-81a6-11eb-9080-001a4aab830c-mon.c 2021-03-10T13:54:15.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:15 gibba013 systemd[1]: ceph-7672acc8-81a6-11eb-9080-001a4aab830c@mon.c.service: Succeeded. 2021-03-10T13:54:15.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:15 gibba013 systemd[1]: Stopped Ceph mon.c for 7672acc8-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:54:15.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:15 gibba013 systemd[1]: Started Ceph mon.c for 7672acc8-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:54:16.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.404+0000 7f3454cc0700 0 set uid:gid to 167:167 (ceph:ceph) 2021-03-10T13:54:16.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.404+0000 7f3454cc0700 0 ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev), process ceph-mon, pid 6 2021-03-10T13:54:16.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.404+0000 7f3454cc0700 0 pidfile_write: ignore empty --pid-file 2021-03-10T13:54:16.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 0 load: jerasure load: lrc load: isa 2021-03-10T13:54:16.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: RocksDB version: 6.8.1 2021-03-10T13:54:16.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-03-10T13:54:16.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Compile date Mar 9 2021 2021-03-10T13:54:16.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: DB SUMMARY 2021-03-10T13:54:16.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: CURRENT file: CURRENT 2021-03-10T13:54:16.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: IDENTITY file: IDENTITY 2021-03-10T13:54:16.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 765 Bytes 2021-03-10T13:54:16.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 2, files: 000022.sst 000023.sst 2021-03-10T13:54:16.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000020.log size: 19521623 ; 2021-03-10T13:54:16.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.error_if_exists: 0 2021-03-10T13:54:16.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.create_if_missing: 0 2021-03-10T13:54:16.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.paranoid_checks: 1 2021-03-10T13:54:16.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.env: 0x55832e5d01c0 2021-03-10T13:54:16.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.fs: Posix File System 2021-03-10T13:54:16.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.info_log: 0x55832f1851e0 2021-03-10T13:54:16.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.max_file_opening_threads: 16 2021-03-10T13:54:16.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.statistics: (nil) 2021-03-10T13:54:16.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.use_fsync: 0 2021-03-10T13:54:16.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.max_log_file_size: 0 2021-03-10T13:54:16.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-03-10T13:54:16.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-03-10T13:54:16.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.keep_log_file_num: 1000 2021-03-10T13:54:16.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.recycle_log_file_num: 0 2021-03-10T13:54:16.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.allow_fallocate: 1 2021-03-10T13:54:16.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.allow_mmap_reads: 0 2021-03-10T13:54:16.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.allow_mmap_writes: 0 2021-03-10T13:54:16.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.use_direct_reads: 0 2021-03-10T13:54:16.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-03-10T13:54:16.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.create_missing_column_families: 0 2021-03-10T13:54:16.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.db_log_dir: 2021-03-10T13:54:16.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-c/store.db 2021-03-10T13:54:16.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-03-10T13:54:16.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.max_subcompactions: 1 2021-03-10T13:54:16.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.max_background_flushes: -1 2021-03-10T13:54:16.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-03-10T13:54:16.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-03-10T13:54:16.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-03-10T13:54:16.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-03-10T13:54:16.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-03-10T13:54:16.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.advise_random_on_open: 1 2021-03-10T13:54:16.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.db_write_buffer_size: 0 2021-03-10T13:54:16.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.write_buffer_manager: 0x55832f1d9c50 2021-03-10T13:54:16.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-03-10T13:54:16.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-03-10T13:54:16.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-03-10T13:54:16.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-03-10T13:54:16.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.rate_limiter: (nil) 2021-03-10T13:54:16.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-03-10T13:54:16.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.wal_recovery_mode: 2 2021-03-10T13:54:16.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.enable_thread_tracking: 0 2021-03-10T13:54:16.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.enable_pipelined_write: 0 2021-03-10T13:54:16.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.unordered_write: 0 2021-03-10T13:54:16.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-03-10T13:54:16.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-03-10T13:54:16.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-03-10T13:54:16.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-03-10T13:54:16.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.row_cache: None 2021-03-10T13:54:16.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.wal_filter: None 2021-03-10T13:54:16.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-03-10T13:54:16.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.allow_ingest_behind: 0 2021-03-10T13:54:16.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.preserve_deletes: 0 2021-03-10T13:54:16.644 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.two_write_queues: 0 2021-03-10T13:54:16.644 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.manual_wal_flush: 0 2021-03-10T13:54:16.644 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.atomic_flush: 0 2021-03-10T13:54:16.644 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-03-10T13:54:16.644 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-03-10T13:54:16.645 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-03-10T13:54:16.645 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.log_readahead_size: 0 2021-03-10T13:54:16.645 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2021-03-10T13:54:16.645 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.max_background_jobs: 2 2021-03-10T13:54:16.646 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.max_background_compactions: -1 2021-03-10T13:54:16.646 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-03-10T13:54:16.646 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-03-10T13:54:16.646 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-03-10T13:54:16.647 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.max_total_wal_size: 0 2021-03-10T13:54:16.647 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-03-10T13:54:16.647 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-03-10T13:54:16.647 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-03-10T13:54:16.648 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-03-10T13:54:16.648 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.max_open_files: -1 2021-03-10T13:54:16.648 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.bytes_per_sync: 0 2021-03-10T13:54:16.648 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-03-10T13:54:16.648 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-03-10T13:54:16.649 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.compaction_readahead_size: 0 2021-03-10T13:54:16.649 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Compression algorithms supported: 2021-03-10T13:54:16.649 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-03-10T13:54:16.649 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: kZSTD supported: 0 2021-03-10T13:54:16.649 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: kXpressCompression supported: 0 2021-03-10T13:54:16.650 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: kLZ4HCCompression supported: 1 2021-03-10T13:54:16.650 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: kLZ4Compression supported: 1 2021-03-10T13:54:16.650 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: kBZip2Compression supported: 0 2021-03-10T13:54:16.650 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: kZlibCompression supported: 1 2021-03-10T13:54:16.651 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: kSnappyCompression supported: 1 2021-03-10T13:54:16.651 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-03-10T13:54:16.651 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2021-03-10T13:54:16.651 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2021-03-10T13:54:16.651 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-03-10T13:54:16.652 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.merge_operator: 2021-03-10T13:54:16.652 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.compaction_filter: None 2021-03-10T13:54:16.652 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.compaction_filter_factory: None 2021-03-10T13:54:16.652 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-03-10T13:54:16.652 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-03-10T13:54:16.653 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55832f128230) 2021-03-10T13:54:16.653 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: cache_index_and_filter_blocks: 1 2021-03-10T13:54:16.653 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: cache_index_and_filter_blocks_with_high_priority: 0 2021-03-10T13:54:16.653 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-03-10T13:54:16.653 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: pin_top_level_index_and_filter: 1 2021-03-10T13:54:16.654 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: index_type: 0 2021-03-10T13:54:16.654 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: data_block_index_type: 0 2021-03-10T13:54:16.654 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: index_shortening: 1 2021-03-10T13:54:16.654 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: data_block_hash_table_util_ratio: 0.750000 2021-03-10T13:54:16.655 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: hash_index_allow_collision: 1 2021-03-10T13:54:16.655 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: checksum: 1 2021-03-10T13:54:16.655 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: no_block_cache: 0 2021-03-10T13:54:16.655 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: block_cache: 0x55832f160510 2021-03-10T13:54:16.655 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: block_cache_name: BinnedLRUCache 2021-03-10T13:54:16.656 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: block_cache_options: 2021-03-10T13:54:16.656 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: capacity : 536870912 2021-03-10T13:54:16.656 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: num_shard_bits : 4 2021-03-10T13:54:16.656 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: strict_capacity_limit : 0 2021-03-10T13:54:16.657 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: high_pri_pool_ratio: 0.000 2021-03-10T13:54:16.657 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: block_cache_compressed: (nil) 2021-03-10T13:54:16.657 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: persistent_cache: (nil) 2021-03-10T13:54:16.657 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: block_size: 4096 2021-03-10T13:54:16.658 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: block_size_deviation: 10 2021-03-10T13:54:16.658 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: block_restart_interval: 16 2021-03-10T13:54:16.658 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: index_block_restart_interval: 1 2021-03-10T13:54:16.658 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: metadata_block_size: 4096 2021-03-10T13:54:16.658 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: partition_filters: 0 2021-03-10T13:54:16.659 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: use_delta_encoding: 1 2021-03-10T13:54:16.659 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: filter_policy: rocksdb.BuiltinBloomFilter 2021-03-10T13:54:16.659 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: whole_key_filtering: 1 2021-03-10T13:54:16.659 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: verify_compression: 0 2021-03-10T13:54:16.660 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: read_amp_bytes_per_bit: 0 2021-03-10T13:54:16.660 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: format_version: 2 2021-03-10T13:54:16.660 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: enable_index_compression: 1 2021-03-10T13:54:16.660 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: block_align: 0 2021-03-10T13:54:16.660 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.write_buffer_size: 33554432 2021-03-10T13:54:16.661 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.max_write_buffer_number: 2 2021-03-10T13:54:16.661 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.compression: NoCompression 2021-03-10T13:54:16.661 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.bottommost_compression: Disabled 2021-03-10T13:54:16.661 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.prefix_extractor: nullptr 2021-03-10T13:54:16.662 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-03-10T13:54:16.662 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.num_levels: 7 2021-03-10T13:54:16.662 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-03-10T13:54:16.662 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-03-10T13:54:16.662 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-03-10T13:54:16.663 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-03-10T13:54:16.663 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-03-10T13:54:16.663 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-03-10T13:54:16.663 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-03-10T13:54:16.664 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-03-10T13:54:16.664 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-03-10T13:54:16.664 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-03-10T13:54:16.664 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.compression_opts.level: 32767 2021-03-10T13:54:16.664 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.compression_opts.strategy: 0 2021-03-10T13:54:16.665 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-03-10T13:54:16.665 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-03-10T13:54:16.665 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.compression_opts.enabled: false 2021-03-10T13:54:16.665 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-03-10T13:54:16.666 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-03-10T13:54:16.666 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-03-10T13:54:16.666 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.target_file_size_base: 67108864 2021-03-10T13:54:16.666 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-03-10T13:54:16.666 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-03-10T13:54:16.667 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-03-10T13:54:16.667 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-03-10T13:54:16.667 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-03-10T13:54:16.667 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-03-10T13:54:16.668 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-03-10T13:54:16.668 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-03-10T13:54:16.668 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-03-10T13:54:16.668 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-03-10T13:54:16.668 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-03-10T13:54:16.669 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-03-10T13:54:16.669 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-03-10T13:54:16.669 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.arena_block_size: 4194304 2021-03-10T13:54:16.669 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-03-10T13:54:16.669 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-03-10T13:54:16.670 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-03-10T13:54:16.670 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.disable_auto_compactions: 0 2021-03-10T13:54:16.670 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-03-10T13:54:16.670 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-03-10T13:54:16.671 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-03-10T13:54:16.671 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-03-10T13:54:16.671 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-03-10T13:54:16.671 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-03-10T13:54:16.671 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-03-10T13:54:16.672 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-03-10T13:54:16.672 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-03-10T13:54:16.672 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-03-10T13:54:16.672 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.table_properties_collectors: 2021-03-10T13:54:16.672 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.inplace_update_support: 0 2021-03-10T13:54:16.673 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-03-10T13:54:16.673 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-03-10T13:54:16.673 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-03-10T13:54:16.673 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-03-10T13:54:16.674 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.bloom_locality: 0 2021-03-10T13:54:16.674 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.max_successive_merges: 0 2021-03-10T13:54:16.674 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-03-10T13:54:16.674 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.paranoid_file_checks: 0 2021-03-10T13:54:16.674 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.force_consistency_checks: 0 2021-03-10T13:54:16.675 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.report_bg_io_stats: 0 2021-03-10T13:54:16.675 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.ttl: 2592000 2021-03-10T13:54:16.675 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-03-10T13:54:16.676 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 25, last_sequence is 9279, log_number is 20,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-03-10T13:54:16.676 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 20 2021-03-10T13:54:16.676 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615384456412170, "job": 1, "event": "recovery_started", "log_files": [20]} 2021-03-10T13:54:16.677 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.408+0000 7f3454cc0700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #20 mode 2 2021-03-10T13:54:16.677 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.416+0000 7f3454cc0700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-03-10T13:54:16.677 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.428+0000 7f3454cc0700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615384456431421, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 25, "file_size": 12916605, "table_properties": {"data_size": 12910125, "index_size": 4952, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 709, "raw_key_size": 5648, "raw_average_key_size": 22, "raw_value_size": 12902493, "raw_average_value_size": 50598, "num_data_blocks": 155, "num_entries": 255, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1615384456, "oldest_key_time": 3, "file_creation_time": 0}} 2021-03-10T13:54:16.677 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.428+0000 7f3454cc0700 4 rocksdb: [version_set.cc:3826] Creating manifest 26 2021-03-10T13:54:16.678 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.428+0000 7f3454cc0700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615384456432239, "job": 1, "event": "recovery_finished"} 2021-03-10T13:54:16.678 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.428+0000 7f3454cc0700 4 rocksdb: DB pointer 0x55832f225800 2021-03-10T13:54:16.678 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.432+0000 7f343bad3700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2021-03-10T13:54:16.678 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.432+0000 7f343bad3700 4 rocksdb: [db_impl/db_impl.cc:851] 2021-03-10T13:54:16.678 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: ** DB Stats ** 2021-03-10T13:54:16.679 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:54:16.679 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-03-10T13:54:16.679 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-03-10T13:54:16.679 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T13:54:16.680 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-03-10T13:54:16.680 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-03-10T13:54:16.680 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T13:54:16.680 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: ** Compaction Stats [default] ** 2021-03-10T13:54:16.680 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:54:16.681 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:54:16.681 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: L0 1/0 12.32 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1208.3 0.01 0.00 1 0.010 0 0 2021-03-10T13:54:16.681 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: L6 2/0 66.64 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:54:16.681 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: Sum 3/0 78.96 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1208.3 0.01 0.00 1 0.010 0 0 2021-03-10T13:54:16.682 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1208.3 0.01 0.00 1 0.010 0 0 2021-03-10T13:54:16.682 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: ** Compaction Stats [default] ** 2021-03-10T13:54:16.682 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:54:16.682 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:54:16.682 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1208.3 0.01 0.00 1 0.010 0 0 2021-03-10T13:54:16.683 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:54:16.683 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: Flush(GB): cumulative 0.012, interval 0.012 2021-03-10T13:54:16.683 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T13:54:16.683 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T13:54:16.684 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T13:54:16.684 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T13:54:16.684 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: Cumulative compaction: 0.01 GB write, 551.37 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:54:16.684 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: Interval compaction: 0.01 GB write, 551.37 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:54:16.684 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T13:54:16.685 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T13:54:16.685 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: ** Compaction Stats [default] ** 2021-03-10T13:54:16.685 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:54:16.685 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:54:16.685 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: L0 1/0 12.32 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1208.3 0.01 0.00 1 0.010 0 0 2021-03-10T13:54:16.686 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: L6 2/0 66.64 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:54:16.686 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: Sum 3/0 78.96 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1208.3 0.01 0.00 1 0.010 0 0 2021-03-10T13:54:16.686 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:54:16.686 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: ** Compaction Stats [default] ** 2021-03-10T13:54:16.687 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:54:16.687 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:54:16.687 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1208.3 0.01 0.00 1 0.010 0 0 2021-03-10T13:54:16.687 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:54:16.687 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: Flush(GB): cumulative 0.012, interval 0.000 2021-03-10T13:54:16.688 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T13:54:16.688 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T13:54:16.688 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T13:54:16.688 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T13:54:16.689 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: Cumulative compaction: 0.01 GB write, 550.51 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:54:16.689 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:54:16.689 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T13:54:16.689 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T13:54:16.690 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.432+0000 7f3454cc0700 0 starting mon.c rank 1 at public addrs [v2:172.21.2.113:3301/0,v1:172.21.2.113:6790/0] at bind addrs [v2:172.21.2.113:3301/0,v1:172.21.2.113:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid 7672acc8-81a6-11eb-9080-001a4aab830c 2021-03-10T13:54:16.690 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.432+0000 7f3454cc0700 1 mon.c@-1(???) e3 preinit fsid 7672acc8-81a6-11eb-9080-001a4aab830c 2021-03-10T13:54:16.690 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.432+0000 7f3454cc0700 0 mon.c@-1(???).mds e1 new map 2021-03-10T13:54:16.690 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.432+0000 7f3454cc0700 0 mon.c@-1(???).mds e1 print_map 2021-03-10T13:54:16.690 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: e1 2021-03-10T13:54:16.691 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: enable_multiple, ever_enabled_multiple: 0,0 2021-03-10T13:54:16.691 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-03-10T13:54:16.691 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: legacy client fscid: -1 2021-03-10T13:54:16.691 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: 2021-03-10T13:54:16.691 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: No filesystems configured 2021-03-10T13:54:16.692 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.432+0000 7f3454cc0700 0 mon.c@-1(???).osd e62 crush map has features 3314933000852226048, adjusting msgr requires 2021-03-10T13:54:16.692 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.432+0000 7f3454cc0700 0 mon.c@-1(???).osd e62 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T13:54:16.692 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.432+0000 7f3454cc0700 0 mon.c@-1(???).osd e62 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T13:54:16.692 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.432+0000 7f3454cc0700 0 mon.c@-1(???).osd e62 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T13:54:16.693 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: cluster 2021-03-10T13:54:12.375477+0000 mgr.gibba020.yqfnwy (mgr.34427) 14 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:16.693 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: cephadm 2021-03-10T13:54:12.478495+0000 mgr.gibba020.yqfnwy (mgr.34427) 15 : cephadm [INF] Upgrade: Updating mon.c 2021-03-10T13:54:16.693 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: cephadm 2021-03-10T13:54:12.494809+0000 mgr.gibba020.yqfnwy (mgr.34427) 16 : cephadm [INF] Deploying daemon mon.c on gibba013 2021-03-10T13:54:16.693 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:16 gibba013 bash[30381]: debug 2021-03-10T13:54:16.432+0000 7f3454cc0700 1 mon.c@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2021-03-10T13:54:18.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:17 gibba013 bash[29418]: debug 2021-03-10T13:54:17.712+0000 7fd714a7a700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:18.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:17 gibba013 bash[29418]: debug 2021-03-10T13:54:17.712+0000 7fd714a7a700 -1 log_channel(cluster) log [ERR] : [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:54:18.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:17 gibba013 bash[29418]: debug 2021-03-10T13:54:17.712+0000 7fd714a7a700 -1 log_channel(cluster) log [ERR] : daemon rgw.r.z.gibba020.txcybs on gibba020 is in error state 2021-03-10T13:54:18.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:17 gibba013 bash[29418]: debug 2021-03-10T13:54:17.712+0000 7fd714a7a700 -1 log_channel(cluster) log [ERR] : [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:18.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:17 gibba013 bash[29418]: debug 2021-03-10T13:54:17.712+0000 7fd714a7a700 -1 log_channel(cluster) log [ERR] : Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:18.747 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:18 gibba020 bash[9782]: cluster 2021-03-10T13:54:14.376650+0000 mgr.gibba020.yqfnwy (mgr.34427) 17 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:19.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:18 gibba013 bash[29418]: cluster 2021-03-10T13:54:14.376650+0000 mgr.gibba020.yqfnwy (mgr.34427) 17 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:19.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:18 gibba013 bash[30381]: cluster 2021-03-10T13:54:14.376650+0000 mgr.gibba020.yqfnwy (mgr.34427) 17 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:19.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:18 gibba013 bash[30381]: audit 2021-03-10T13:54:15.481608+0000 mon.b (mon.2) 177 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"656fb288b68f\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 38346424, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.745998Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:53:58.730066Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"7609af74159c\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373502771, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.746547Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:53:50.102625Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49996103, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.747176Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50153390, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.747915Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46504345, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.748670Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49115299, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.749319Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25648168, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.749952Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a7c14b180bbc\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12813598, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T13:54:09.750276Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:53:31.062073Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:54:12.494744Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:37.217814Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:55.838140Z\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:53:50.272497Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:54:19.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:18 gibba013 bash[30381]: cluster 2021-03-10T13:54:16.377668+0000 mgr.gibba020.yqfnwy (mgr.34427) 18 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:19.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:18 gibba013 bash[30381]: cluster 2021-03-10T13:54:16.643710+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2021-03-10T13:54:19.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:18 gibba013 bash[30381]: cluster 2021-03-10T13:54:17.692241+0000 mon.a (mon.0) 36 : cluster [INF] mon.a calling monitor election 2021-03-10T13:54:19.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:18 gibba013 bash[30381]: cluster 2021-03-10T13:54:17.698500+0000 mon.a (mon.0) 37 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T13:54:19.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:18 gibba013 bash[30381]: cluster 2021-03-10T13:54:17.711031+0000 mon.a (mon.0) 38 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.113:3300/0,v1:172.21.2.113:6789/0],b=[v2:172.21.2.120:3300/0,v1:172.21.2.120:6789/0],c=[v2:172.21.2.113:3301/0,v1:172.21.2.113:6790/0]} 2021-03-10T13:54:19.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:18 gibba013 bash[30381]: cluster 2021-03-10T13:54:17.711159+0000 mon.a (mon.0) 39 : cluster [DBG] fsmap 2021-03-10T13:54:19.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:18 gibba013 bash[30381]: cluster 2021-03-10T13:54:17.711242+0000 mon.a (mon.0) 40 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-03-10T13:54:19.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:18 gibba013 bash[30381]: cluster 2021-03-10T13:54:17.711736+0000 mon.a (mon.0) 41 : cluster [DBG] mgrmap e25: gibba020.yqfnwy(active, since 12s), standbys: x, y 2021-03-10T13:54:19.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:18 gibba013 bash[30381]: cluster 2021-03-10T13:54:17.715661+0000 mon.a (mon.0) 42 : cluster [ERR] Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:19.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:18 gibba013 bash[30381]: cluster 2021-03-10T13:54:17.715671+0000 mon.a (mon.0) 43 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:54:19.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:18 gibba013 bash[30381]: cluster 2021-03-10T13:54:17.715678+0000 mon.a (mon.0) 44 : cluster [ERR] daemon rgw.r.z.gibba020.txcybs on gibba020 is in error state 2021-03-10T13:54:19.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:18 gibba013 bash[30381]: cluster 2021-03-10T13:54:17.715683+0000 mon.a (mon.0) 45 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:19.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:18 gibba013 bash[29418]: audit 2021-03-10T13:54:15.481608+0000 mon.b (mon.2) 177 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"656fb288b68f\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 38346424, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.745998Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:53:58.730066Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"7609af74159c\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373502771, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.746547Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:53:50.102625Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49996103, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.747176Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50153390, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.747915Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46504345, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.748670Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49115299, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.749319Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25648168, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.749952Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a7c14b180bbc\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12813598, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T13:54:09.750276Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:53:31.062073Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:54:12.494744Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:37.217814Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:55.838140Z\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:53:50.272497Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:54:19.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:18 gibba013 bash[29418]: cluster 2021-03-10T13:54:16.377668+0000 mgr.gibba020.yqfnwy (mgr.34427) 18 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:19.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:18 gibba013 bash[29418]: cluster 2021-03-10T13:54:16.643710+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2021-03-10T13:54:19.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:18 gibba013 bash[29418]: cluster 2021-03-10T13:54:17.692241+0000 mon.a (mon.0) 36 : cluster [INF] mon.a calling monitor election 2021-03-10T13:54:19.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:18 gibba013 bash[29418]: cluster 2021-03-10T13:54:17.698500+0000 mon.a (mon.0) 37 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T13:54:19.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:18 gibba013 bash[29418]: cluster 2021-03-10T13:54:17.711031+0000 mon.a (mon.0) 38 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.113:3300/0,v1:172.21.2.113:6789/0],b=[v2:172.21.2.120:3300/0,v1:172.21.2.120:6789/0],c=[v2:172.21.2.113:3301/0,v1:172.21.2.113:6790/0]} 2021-03-10T13:54:19.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:18 gibba013 bash[29418]: cluster 2021-03-10T13:54:17.711159+0000 mon.a (mon.0) 39 : cluster [DBG] fsmap 2021-03-10T13:54:19.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:18 gibba013 bash[29418]: cluster 2021-03-10T13:54:17.711242+0000 mon.a (mon.0) 40 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-03-10T13:54:19.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:18 gibba013 bash[29418]: cluster 2021-03-10T13:54:17.711736+0000 mon.a (mon.0) 41 : cluster [DBG] mgrmap e25: gibba020.yqfnwy(active, since 12s), standbys: x, y 2021-03-10T13:54:19.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:18 gibba013 bash[29418]: cluster 2021-03-10T13:54:17.715661+0000 mon.a (mon.0) 42 : cluster [ERR] Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:19.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:18 gibba013 bash[29418]: cluster 2021-03-10T13:54:17.715671+0000 mon.a (mon.0) 43 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:54:19.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:18 gibba013 bash[29418]: cluster 2021-03-10T13:54:17.715678+0000 mon.a (mon.0) 44 : cluster [ERR] daemon rgw.r.z.gibba020.txcybs on gibba020 is in error state 2021-03-10T13:54:19.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:18 gibba013 bash[29418]: cluster 2021-03-10T13:54:17.715683+0000 mon.a (mon.0) 45 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:19.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:18 gibba013 bash[30381]: cluster 2021-03-10T13:54:17.715689+0000 mon.a (mon.0) 46 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:19.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:18 gibba013 bash[30381]: audit 2021-03-10T13:54:17.716162+0000 mon.b (mon.2) 178 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:54:19.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:18 gibba013 bash[30381]: audit 2021-03-10T13:54:17.717522+0000 mon.b (mon.2) 179 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:54:19.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:18 gibba013 bash[30381]: audit 2021-03-10T13:54:17.717913+0000 mon.a (mon.0) 47 : audit [INF] from='mgr.34427 ' entity='' 2021-03-10T13:54:19.138 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:18 gibba013 bash[29418]: cluster 2021-03-10T13:54:17.715689+0000 mon.a (mon.0) 46 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:19.138 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:18 gibba013 bash[29418]: audit 2021-03-10T13:54:17.716162+0000 mon.b (mon.2) 178 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:54:19.139 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:18 gibba013 bash[29418]: audit 2021-03-10T13:54:17.717522+0000 mon.b (mon.2) 179 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:54:19.139 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:18 gibba013 bash[29418]: audit 2021-03-10T13:54:17.717913+0000 mon.a (mon.0) 47 : audit [INF] from='mgr.34427 ' entity='' 2021-03-10T13:54:19.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:18 gibba020 bash[9782]: audit 2021-03-10T13:54:15.481608+0000 mon.b (mon.2) 177 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"656fb288b68f\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 38346424, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.745998Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:53:58.730066Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"7609af74159c\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373502771, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.746547Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:53:50.102625Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49996103, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.747176Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50153390, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.747915Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46504345, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.748670Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49115299, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.749319Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25648168, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:09.749952Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a7c14b180bbc\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12813598, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T13:54:09.750276Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:53:31.062073Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:54:12.494744Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:37.217814Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:55.838140Z\"}}, \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:53:50.272497Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:54:19.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:18 gibba020 bash[9782]: cluster 2021-03-10T13:54:16.377668+0000 mgr.gibba020.yqfnwy (mgr.34427) 18 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:19.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:18 gibba020 bash[9782]: cluster 2021-03-10T13:54:16.643710+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2021-03-10T13:54:19.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:18 gibba020 bash[9782]: cluster 2021-03-10T13:54:17.692241+0000 mon.a (mon.0) 36 : cluster [INF] mon.a calling monitor election 2021-03-10T13:54:19.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:18 gibba020 bash[9782]: cluster 2021-03-10T13:54:17.698500+0000 mon.a (mon.0) 37 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T13:54:19.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:18 gibba020 bash[9782]: cluster 2021-03-10T13:54:17.711031+0000 mon.a (mon.0) 38 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.113:3300/0,v1:172.21.2.113:6789/0],b=[v2:172.21.2.120:3300/0,v1:172.21.2.120:6789/0],c=[v2:172.21.2.113:3301/0,v1:172.21.2.113:6790/0]} 2021-03-10T13:54:19.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:18 gibba020 bash[9782]: cluster 2021-03-10T13:54:17.711159+0000 mon.a (mon.0) 39 : cluster [DBG] fsmap 2021-03-10T13:54:19.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:18 gibba020 bash[9782]: cluster 2021-03-10T13:54:17.711242+0000 mon.a (mon.0) 40 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-03-10T13:54:19.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:18 gibba020 bash[9782]: cluster 2021-03-10T13:54:17.711736+0000 mon.a (mon.0) 41 : cluster [DBG] mgrmap e25: gibba020.yqfnwy(active, since 12s), standbys: x, y 2021-03-10T13:54:19.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:18 gibba020 bash[9782]: cluster 2021-03-10T13:54:17.715661+0000 mon.a (mon.0) 42 : cluster [ERR] Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:19.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:18 gibba020 bash[9782]: cluster 2021-03-10T13:54:17.715671+0000 mon.a (mon.0) 43 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:54:19.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:18 gibba020 bash[9782]: cluster 2021-03-10T13:54:17.715678+0000 mon.a (mon.0) 44 : cluster [ERR] daemon rgw.r.z.gibba020.txcybs on gibba020 is in error state 2021-03-10T13:54:19.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:18 gibba020 bash[9782]: cluster 2021-03-10T13:54:17.715683+0000 mon.a (mon.0) 45 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:19.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:18 gibba020 bash[9782]: cluster 2021-03-10T13:54:17.715689+0000 mon.a (mon.0) 46 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:19.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:18 gibba020 bash[9782]: audit 2021-03-10T13:54:17.716162+0000 mon.b (mon.2) 178 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:54:19.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:18 gibba020 bash[9782]: audit 2021-03-10T13:54:17.717522+0000 mon.b (mon.2) 179 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:54:19.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:18 gibba020 bash[9782]: audit 2021-03-10T13:54:17.717913+0000 mon.a (mon.0) 47 : audit [INF] from='mgr.34427 ' entity='' 2021-03-10T13:54:20.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:19 gibba013 bash[29418]: cluster 2021-03-10T13:54:18.379750+0000 mgr.gibba020.yqfnwy (mgr.34427) 19 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:20.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:19 gibba013 bash[30381]: cluster 2021-03-10T13:54:18.379750+0000 mgr.gibba020.yqfnwy (mgr.34427) 19 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:20.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:19 gibba020 bash[9782]: cluster 2021-03-10T13:54:18.379750+0000 mgr.gibba020.yqfnwy (mgr.34427) 19 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:21.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:21 gibba020 bash[9782]: cluster 2021-03-10T13:54:20.380939+0000 mgr.gibba020.yqfnwy (mgr.34427) 20 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:21.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:21 gibba020 bash[9782]: audit 2021-03-10T13:54:21.402671+0000 mon.b (mon.2) 180 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"656fb288b68f\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 43169873, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:21.396768Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:53:58.730066Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"7609af74159c\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373502771, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:21.397257Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:53:50.102625Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"693539cc5eb6\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 38126223, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:21.397578Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:54:15.509111Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49671045, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:21.397877Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50111447, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:21.398578Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46525317, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:21.399232Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49010442, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:21.399868Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25805455, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:21.400521Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a7c14b180bbc\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13128171, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:21.400845Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:53:31.062073Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:54:12.494744Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:37.217814Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:55.838140Z\"}}, \"last_daemon_update\": \"2021-03-10T13:54:21.401324Z\", \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:53:50.272497Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:54:21.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:21 gibba020 bash[9782]: audit 2021-03-10T13:54:21.408938+0000 mon.b (mon.2) 181 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:54:21.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:21 gibba020 bash[9782]: audit 2021-03-10T13:54:21.409901+0000 mon.a (mon.0) 48 : audit [INF] from='mgr.34427 ' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:21.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:21 gibba020 bash[9782]: audit 2021-03-10T13:54:21.414898+0000 mon.a (mon.0) 49 : audit [INF] from='mgr.34427 ' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:21.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:21 gibba020 bash[9782]: audit 2021-03-10T13:54:21.417217+0000 mon.b (mon.2) 182 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:54:21.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:21 gibba020 bash[9782]: audit 2021-03-10T13:54:21.418426+0000 mon.b (mon.2) 183 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:21.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:21 gibba020 bash[9782]: audit 2021-03-10T13:54:21.419428+0000 mon.b (mon.2) 184 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2021-03-10T13:54:22.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:21 gibba013 bash[29418]: cluster 2021-03-10T13:54:20.380939+0000 mgr.gibba020.yqfnwy (mgr.34427) 20 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:22.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:21 gibba013 bash[30381]: cluster 2021-03-10T13:54:20.380939+0000 mgr.gibba020.yqfnwy (mgr.34427) 20 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:22.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:21 gibba013 bash[29418]: audit 2021-03-10T13:54:21.402671+0000 mon.b (mon.2) 180 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"656fb288b68f\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 43169873, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:21.396768Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:53:58.730066Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"7609af74159c\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373502771, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:21.397257Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:53:50.102625Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"693539cc5eb6\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 38126223, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:21.397578Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:54:15.509111Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49671045, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:21.397877Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50111447, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:21.398578Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46525317, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:21.399232Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49010442, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:21.399868Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25805455, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:21.400521Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a7c14b180bbc\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13128171, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:21.400845Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:53:31.062073Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:54:12.494744Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:37.217814Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:55.838140Z\"}}, \"last_daemon_update\": \"2021-03-10T13:54:21.401324Z\", \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:53:50.272497Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:54:22.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:21 gibba013 bash[29418]: audit 2021-03-10T13:54:21.408938+0000 mon.b (mon.2) 181 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:54:22.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:21 gibba013 bash[29418]: audit 2021-03-10T13:54:21.409901+0000 mon.a (mon.0) 48 : audit [INF] from='mgr.34427 ' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:22.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:21 gibba013 bash[29418]: audit 2021-03-10T13:54:21.414898+0000 mon.a (mon.0) 49 : audit [INF] from='mgr.34427 ' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:22.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:21 gibba013 bash[29418]: audit 2021-03-10T13:54:21.417217+0000 mon.b (mon.2) 182 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:54:22.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:21 gibba013 bash[29418]: audit 2021-03-10T13:54:21.418426+0000 mon.b (mon.2) 183 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:22.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:21 gibba013 bash[29418]: audit 2021-03-10T13:54:21.419428+0000 mon.b (mon.2) 184 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2021-03-10T13:54:22.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:21 gibba013 bash[30381]: audit 2021-03-10T13:54:21.402671+0000 mon.b (mon.2) 180 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba013","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"656fb288b68f\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 43169873, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:21.396768Z\", \"created\": \"2021-03-10T13:42:54.241467Z\", \"started\": \"2021-03-10T13:53:58.730066Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba013\", \"container_id\": \"7609af74159c\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373502771, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:21.397257Z\", \"created\": \"2021-03-10T13:43:01.281467Z\", \"started\": \"2021-03-10T13:53:50.102625Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba013\", \"container_id\": \"693539cc5eb6\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 38126223, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:21.397578Z\", \"created\": \"2021-03-10T13:44:05.649466Z\", \"started\": \"2021-03-10T13:54:15.509111Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba013\", \"container_id\": \"bf4441d660ac\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49671045, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:21.397877Z\", \"created\": \"2021-03-10T13:44:55.289466Z\", \"started\": \"2021-03-10T13:44:58.251046Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba013\", \"container_id\": \"385800e8f97f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50111447, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:21.398578Z\", \"created\": \"2021-03-10T13:45:17.385465Z\", \"started\": \"2021-03-10T13:45:20.657219Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba013\", \"container_id\": \"d0a99b0fd1fc\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46525317, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:21.399232Z\", \"created\": \"2021-03-10T13:45:39.785465Z\", \"started\": \"2021-03-10T13:45:43.590638Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba013\", \"container_id\": \"d0b507f36a88\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49010442, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:21.399868Z\", \"created\": \"2021-03-10T13:46:03.738924Z\", \"started\": \"2021-03-10T13:46:06.962147Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"f7b56637bd4e\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 25805455, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:21.400521Z\", \"created\": \"2021-03-10T13:47:56.718923Z\", \"started\": \"2021-03-10T13:47:58.556074Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba013\", \"container_id\": \"a7c14b180bbc\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13128171, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T13:54:21.400845Z\", \"created\": \"2021-03-10T13:48:06.706923Z\", \"started\": \"2021-03-10T13:53:31.062073Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6d982c1b-253a-4416-814a-f14b580f5c6b\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"2TdoDr-egWb-eNwy-oPsk-df68-eFa9-0TWOQl\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"13edbbb8-76dd-40bc-bb99-7e4b3612e855\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"TwdiAX-Gobn-zEIo-6ASN-BwKN-q3pH-bcBE3V\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"9b308e58-9ae5-4dfd-91fd-a7ad24aaaacc\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"QS4z19-oQFr-026f-mDf8-eizt-aZ9v-U6JvTf\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"471db9b4-2fe7-4656-b7f0-2c7e12b9ab63\", \"cluster_fsid\": \"7672acc8-81a6-11eb-9080-001a4aab830c\", \"block_uuid\": \"soMmDS-9bT8-zysc-ZPGL-2osz-1P2B-ZsNqQ4\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM9200001J375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2L3F6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T13:54:12.494744Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:37.217814Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T13:44:53.533935Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:15.698634Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T13:45:38.018846Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T13:46:01.906585Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:47:56.344716Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba020.yqfnwy\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T13:53:24.655586Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T13:53:55.838140Z\"}}, \"last_daemon_update\": \"2021-03-10T13:54:21.401324Z\", \"last_device_update\": \"2021-03-10T13:46:10.457486Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.113\"], \"172.21.15.254\": [\"172.21.2.113\"]}, \"last_host_check\": \"2021-03-10T13:53:50.272497Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T13:54:22.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:21 gibba013 bash[30381]: audit 2021-03-10T13:54:21.408938+0000 mon.b (mon.2) 181 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T13:54:22.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:21 gibba013 bash[30381]: audit 2021-03-10T13:54:21.409901+0000 mon.a (mon.0) 48 : audit [INF] from='mgr.34427 ' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:22.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:21 gibba013 bash[30381]: audit 2021-03-10T13:54:21.414898+0000 mon.a (mon.0) 49 : audit [INF] from='mgr.34427 ' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:22.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:21 gibba013 bash[30381]: audit 2021-03-10T13:54:21.417217+0000 mon.b (mon.2) 182 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:54:22.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:21 gibba013 bash[30381]: audit 2021-03-10T13:54:21.418426+0000 mon.b (mon.2) 183 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:22.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:21 gibba013 bash[30381]: audit 2021-03-10T13:54:21.419428+0000 mon.b (mon.2) 184 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2021-03-10T13:54:22.400 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T13:54:22.629 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:54:22.630 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (51s) 1s ago 6m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T13:54:22.630 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (6m) 12s ago 6m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T13:54:22.630 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (77s) 12s ago 9m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T13:54:22.630 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (94s) 12s ago 9m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T13:54:22.631 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (32s) 1s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T13:54:22.631 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (23s) 1s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T13:54:22.631 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (10m) 12s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a58fc42cd46b 2021-03-10T13:54:22.631 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (7s) 1s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T13:54:22.631 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (6m) 1s ago 6m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T13:54:22.632 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (6m) 12s ago 6m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T13:54:22.632 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (9m) 1s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 bf4441d660ac 2021-03-10T13:54:22.632 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (9m) 1s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 385800e8f97f 2021-03-10T13:54:22.632 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (8m) 1s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d0a99b0fd1fc 2021-03-10T13:54:22.632 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (8m) 1s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d0b507f36a88 2021-03-10T13:54:22.633 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (7m) 12s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5bcc0da1a794 2021-03-10T13:54:22.633 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (7m) 12s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 8e0d292ca03b 2021-03-10T13:54:22.633 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (7m) 12s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b54758e37be1 2021-03-10T13:54:22.633 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (6m) 12s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 75c9ee8106fc 2021-03-10T13:54:22.633 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (5m) 12s ago 6m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T13:54:22.634 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 12s ago 4m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:54:22.883 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T13:54:22.883 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T13:54:22.883 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 1, 2021-03-10T13:54:22.884 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 2 2021-03-10T13:54:22.884 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:54:22.884 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T13:54:22.884 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:54:22.884 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:54:22.885 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T13:54:22.885 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2021-03-10T13:54:22.885 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:54:22.885 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T13:54:22.886 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T13:54:22.886 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 9, 2021-03-10T13:54:22.886 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 5 2021-03-10T13:54:22.886 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T13:54:22.886 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T13:54:22.920 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:22 gibba020 bash[9782]: cephadm 2021-03-10T13:54:21.416639+0000 mgr.gibba020.yqfnwy (mgr.34427) 21 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:54:22.920 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:22 gibba020 bash[9782]: cephadm 2021-03-10T13:54:21.418182+0000 mgr.gibba020.yqfnwy (mgr.34427) 22 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:54:22.920 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:22 gibba020 bash[9782]: cephadm 2021-03-10T13:54:21.419166+0000 mgr.gibba020.yqfnwy (mgr.34427) 23 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:54:22.920 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:22 gibba020 bash[9782]: cephadm 2021-03-10T13:54:21.419203+0000 mgr.gibba020.yqfnwy (mgr.34427) 24 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:54:22.921 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:22 gibba020 bash[9782]: cephadm 2021-03-10T13:54:21.420046+0000 mgr.gibba020.yqfnwy (mgr.34427) 25 : cephadm [INF] It is presumed safe to stop mon.b 2021-03-10T13:54:22.921 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:22 gibba020 bash[9782]: cephadm 2021-03-10T13:54:21.420102+0000 mgr.gibba020.yqfnwy (mgr.34427) 26 : cephadm [INF] Upgrade: It is presumed safe to stop mon.b 2021-03-10T13:54:23.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:22 gibba013 bash[29418]: cephadm 2021-03-10T13:54:21.416639+0000 mgr.gibba020.yqfnwy (mgr.34427) 21 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:54:23.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:22 gibba013 bash[29418]: cephadm 2021-03-10T13:54:21.418182+0000 mgr.gibba020.yqfnwy (mgr.34427) 22 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:54:23.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:22 gibba013 bash[29418]: cephadm 2021-03-10T13:54:21.419166+0000 mgr.gibba020.yqfnwy (mgr.34427) 23 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:54:23.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:22 gibba013 bash[29418]: cephadm 2021-03-10T13:54:21.419203+0000 mgr.gibba020.yqfnwy (mgr.34427) 24 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:54:23.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:22 gibba013 bash[29418]: cephadm 2021-03-10T13:54:21.420046+0000 mgr.gibba020.yqfnwy (mgr.34427) 25 : cephadm [INF] It is presumed safe to stop mon.b 2021-03-10T13:54:23.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:22 gibba013 bash[29418]: cephadm 2021-03-10T13:54:21.420102+0000 mgr.gibba020.yqfnwy (mgr.34427) 26 : cephadm [INF] Upgrade: It is presumed safe to stop mon.b 2021-03-10T13:54:23.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:22 gibba013 bash[30381]: cephadm 2021-03-10T13:54:21.416639+0000 mgr.gibba020.yqfnwy (mgr.34427) 21 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:54:23.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:22 gibba013 bash[30381]: cephadm 2021-03-10T13:54:21.418182+0000 mgr.gibba020.yqfnwy (mgr.34427) 22 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:54:23.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:22 gibba013 bash[30381]: cephadm 2021-03-10T13:54:21.419166+0000 mgr.gibba020.yqfnwy (mgr.34427) 23 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:54:23.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:22 gibba013 bash[30381]: cephadm 2021-03-10T13:54:21.419203+0000 mgr.gibba020.yqfnwy (mgr.34427) 24 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:54:23.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:22 gibba013 bash[30381]: cephadm 2021-03-10T13:54:21.420046+0000 mgr.gibba020.yqfnwy (mgr.34427) 25 : cephadm [INF] It is presumed safe to stop mon.b 2021-03-10T13:54:23.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:22 gibba013 bash[30381]: cephadm 2021-03-10T13:54:21.420102+0000 mgr.gibba020.yqfnwy (mgr.34427) 26 : cephadm [INF] Upgrade: It is presumed safe to stop mon.b 2021-03-10T13:54:23.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:23 gibba020 bash[9782]: cluster 2021-03-10T13:54:22.383060+0000 mgr.gibba020.yqfnwy (mgr.34427) 27 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:23.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:23 gibba020 bash[9782]: audit 2021-03-10T13:54:22.388024+0000 mgr.gibba020.yqfnwy (mgr.34427) 28 : audit [DBG] from='client.44118 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:54:23.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:23 gibba020 bash[9782]: audit 2021-03-10T13:54:22.615680+0000 mgr.gibba020.yqfnwy (mgr.34427) 29 : audit [DBG] from='client.54109 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:54:23.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:23 gibba020 bash[9782]: audit 2021-03-10T13:54:22.883568+0000 mon.c (mon.1) 2 : audit [DBG] from='client.? 172.21.2.113:0/1852078707' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:23.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:23 gibba020 bash[9782]: audit 2021-03-10T13:54:23.427286+0000 mon.b (mon.2) 185 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.b"}]: dispatch 2021-03-10T13:54:23.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:23 gibba020 bash[9782]: audit 2021-03-10T13:54:23.438542+0000 mon.b (mon.2) 186 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:54:23.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:23 gibba020 bash[9782]: audit 2021-03-10T13:54:23.439347+0000 mon.b (mon.2) 187 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:54:23.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:23 gibba020 bash[9782]: audit 2021-03-10T13:54:23.440194+0000 mon.b (mon.2) 188 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:54:23.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:23 gibba020 bash[9782]: audit 2021-03-10T13:54:23.440408+0000 mon.a (mon.0) 50 : audit [INF] from='mgr.34427 ' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:23.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:23 gibba020 bash[9782]: audit 2021-03-10T13:54:23.441191+0000 mon.b (mon.2) 189 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T13:54:24.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:23 gibba013 bash[29418]: cluster 2021-03-10T13:54:22.383060+0000 mgr.gibba020.yqfnwy (mgr.34427) 27 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:24.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:23 gibba013 bash[29418]: audit 2021-03-10T13:54:22.388024+0000 mgr.gibba020.yqfnwy (mgr.34427) 28 : audit [DBG] from='client.44118 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:54:24.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:23 gibba013 bash[29418]: audit 2021-03-10T13:54:22.615680+0000 mgr.gibba020.yqfnwy (mgr.34427) 29 : audit [DBG] from='client.54109 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:54:24.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:23 gibba013 bash[29418]: audit 2021-03-10T13:54:22.883568+0000 mon.c (mon.1) 2 : audit [DBG] from='client.? 172.21.2.113:0/1852078707' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:24.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:23 gibba013 bash[29418]: audit 2021-03-10T13:54:23.427286+0000 mon.b (mon.2) 185 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.b"}]: dispatch 2021-03-10T13:54:24.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:23 gibba013 bash[29418]: audit 2021-03-10T13:54:23.438542+0000 mon.b (mon.2) 186 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:54:24.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:23 gibba013 bash[29418]: audit 2021-03-10T13:54:23.439347+0000 mon.b (mon.2) 187 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:54:24.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:23 gibba013 bash[29418]: audit 2021-03-10T13:54:23.440194+0000 mon.b (mon.2) 188 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:54:24.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:23 gibba013 bash[29418]: audit 2021-03-10T13:54:23.440408+0000 mon.a (mon.0) 50 : audit [INF] from='mgr.34427 ' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:24.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:23 gibba013 bash[29418]: audit 2021-03-10T13:54:23.441191+0000 mon.b (mon.2) 189 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T13:54:24.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:23 gibba013 bash[30381]: cluster 2021-03-10T13:54:22.383060+0000 mgr.gibba020.yqfnwy (mgr.34427) 27 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:24.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:23 gibba013 bash[30381]: audit 2021-03-10T13:54:22.388024+0000 mgr.gibba020.yqfnwy (mgr.34427) 28 : audit [DBG] from='client.44118 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:54:24.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:23 gibba013 bash[30381]: audit 2021-03-10T13:54:22.615680+0000 mgr.gibba020.yqfnwy (mgr.34427) 29 : audit [DBG] from='client.54109 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:54:24.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:23 gibba013 bash[30381]: audit 2021-03-10T13:54:22.883568+0000 mon.c (mon.1) 2 : audit [DBG] from='client.? 172.21.2.113:0/1852078707' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:24.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:23 gibba013 bash[30381]: audit 2021-03-10T13:54:23.427286+0000 mon.b (mon.2) 185 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54", "who": "mon.b"}]: dispatch 2021-03-10T13:54:24.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:23 gibba013 bash[30381]: audit 2021-03-10T13:54:23.438542+0000 mon.b (mon.2) 186 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:54:24.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:23 gibba013 bash[30381]: audit 2021-03-10T13:54:23.439347+0000 mon.b (mon.2) 187 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:54:24.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:23 gibba013 bash[30381]: audit 2021-03-10T13:54:23.440194+0000 mon.b (mon.2) 188 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:54:24.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:23 gibba013 bash[30381]: audit 2021-03-10T13:54:23.440408+0000 mon.a (mon.0) 50 : audit [INF] from='mgr.34427 ' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:24.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:23 gibba013 bash[30381]: audit 2021-03-10T13:54:23.441191+0000 mon.b (mon.2) 189 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T13:54:24.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:24 gibba020 bash[9782]: cephadm 2021-03-10T13:54:23.426955+0000 mgr.gibba020.yqfnwy (mgr.34427) 30 : cephadm [INF] Upgrade: Updating mon.b 2021-03-10T13:54:24.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:24 gibba020 bash[9782]: cephadm 2021-03-10T13:54:23.440891+0000 mgr.gibba020.yqfnwy (mgr.34427) 31 : cephadm [INF] Deploying daemon mon.b on gibba020 2021-03-10T13:54:25.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:24 gibba013 bash[29418]: cephadm 2021-03-10T13:54:23.426955+0000 mgr.gibba020.yqfnwy (mgr.34427) 30 : cephadm [INF] Upgrade: Updating mon.b 2021-03-10T13:54:25.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:24 gibba013 bash[29418]: cephadm 2021-03-10T13:54:23.440891+0000 mgr.gibba020.yqfnwy (mgr.34427) 31 : cephadm [INF] Deploying daemon mon.b on gibba020 2021-03-10T13:54:25.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:24 gibba013 bash[30381]: cephadm 2021-03-10T13:54:23.426955+0000 mgr.gibba020.yqfnwy (mgr.34427) 30 : cephadm [INF] Upgrade: Updating mon.b 2021-03-10T13:54:25.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:24 gibba013 bash[30381]: cephadm 2021-03-10T13:54:23.440891+0000 mgr.gibba020.yqfnwy (mgr.34427) 31 : cephadm [INF] Deploying daemon mon.b on gibba020 2021-03-10T13:54:25.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:25 gibba020 systemd[1]: Stopping Ceph mon.b for 7672acc8-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:54:25.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:25 gibba020 bash[9782]: debug 2021-03-10T13:54:25.476+0000 7fb90af9b700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T13:54:25.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:25 gibba020 bash[9782]: debug 2021-03-10T13:54:25.476+0000 7fb90af9b700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2021-03-10T13:54:26.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:26 gibba020 docker[25359]: ceph-7672acc8-81a6-11eb-9080-001a4aab830c-mon.b 2021-03-10T13:54:26.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:26 gibba020 systemd[1]: ceph-7672acc8-81a6-11eb-9080-001a4aab830c@mon.b.service: Succeeded. 2021-03-10T13:54:26.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:26 gibba020 systemd[1]: Stopped Ceph mon.b for 7672acc8-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:54:26.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:26 gibba020 systemd[1]: Started Ceph mon.b for 7672acc8-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:54:27.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.548+0000 7f5084bab700 0 set uid:gid to 167:167 (ceph:ceph) 2021-03-10T13:54:27.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.548+0000 7f5084bab700 0 ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev), process ceph-mon, pid 6 2021-03-10T13:54:27.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.548+0000 7f5084bab700 0 pidfile_write: ignore empty --pid-file 2021-03-10T13:54:27.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 0 load: jerasure load: lrc load: isa 2021-03-10T13:54:27.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: RocksDB version: 6.8.1 2021-03-10T13:54:27.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-03-10T13:54:27.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Compile date Mar 9 2021 2021-03-10T13:54:27.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: DB SUMMARY 2021-03-10T13:54:27.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: CURRENT file: CURRENT 2021-03-10T13:54:27.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: IDENTITY file: IDENTITY 2021-03-10T13:54:27.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 765 Bytes 2021-03-10T13:54:27.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 2, files: 000022.sst 000023.sst 2021-03-10T13:54:27.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000020.log size: 21259808 ; 2021-03-10T13:54:27.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.error_if_exists: 0 2021-03-10T13:54:27.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.create_if_missing: 0 2021-03-10T13:54:27.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.paranoid_checks: 1 2021-03-10T13:54:27.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.env: 0x5653ec5331c0 2021-03-10T13:54:27.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.fs: Posix File System 2021-03-10T13:54:27.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.info_log: 0x5653edf7b1e0 2021-03-10T13:54:27.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.max_file_opening_threads: 16 2021-03-10T13:54:27.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.statistics: (nil) 2021-03-10T13:54:27.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.use_fsync: 0 2021-03-10T13:54:27.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.max_log_file_size: 0 2021-03-10T13:54:27.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-03-10T13:54:27.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-03-10T13:54:27.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.keep_log_file_num: 1000 2021-03-10T13:54:27.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.recycle_log_file_num: 0 2021-03-10T13:54:27.957 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.allow_fallocate: 1 2021-03-10T13:54:27.957 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.allow_mmap_reads: 0 2021-03-10T13:54:27.957 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.allow_mmap_writes: 0 2021-03-10T13:54:27.958 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.use_direct_reads: 0 2021-03-10T13:54:27.958 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-03-10T13:54:27.958 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.create_missing_column_families: 0 2021-03-10T13:54:27.958 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.db_log_dir: 2021-03-10T13:54:27.958 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-b/store.db 2021-03-10T13:54:27.959 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-03-10T13:54:27.959 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.max_subcompactions: 1 2021-03-10T13:54:27.959 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.max_background_flushes: -1 2021-03-10T13:54:27.959 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-03-10T13:54:27.959 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-03-10T13:54:27.960 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-03-10T13:54:27.960 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-03-10T13:54:27.960 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-03-10T13:54:27.960 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.advise_random_on_open: 1 2021-03-10T13:54:27.960 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.db_write_buffer_size: 0 2021-03-10T13:54:27.961 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.write_buffer_manager: 0x5653edfcfc50 2021-03-10T13:54:27.961 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-03-10T13:54:27.961 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-03-10T13:54:27.961 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-03-10T13:54:27.962 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-03-10T13:54:27.962 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.rate_limiter: (nil) 2021-03-10T13:54:27.962 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-03-10T13:54:27.962 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.wal_recovery_mode: 2 2021-03-10T13:54:27.962 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.enable_thread_tracking: 0 2021-03-10T13:54:27.963 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.enable_pipelined_write: 0 2021-03-10T13:54:27.963 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.unordered_write: 0 2021-03-10T13:54:27.963 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-03-10T13:54:27.963 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-03-10T13:54:27.964 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-03-10T13:54:27.964 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-03-10T13:54:27.964 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.row_cache: None 2021-03-10T13:54:27.964 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.wal_filter: None 2021-03-10T13:54:27.964 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-03-10T13:54:27.965 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.allow_ingest_behind: 0 2021-03-10T13:54:27.965 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.preserve_deletes: 0 2021-03-10T13:54:27.965 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.two_write_queues: 0 2021-03-10T13:54:27.965 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.manual_wal_flush: 0 2021-03-10T13:54:27.965 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.atomic_flush: 0 2021-03-10T13:54:27.966 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-03-10T13:54:27.966 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-03-10T13:54:27.966 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-03-10T13:54:27.966 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.log_readahead_size: 0 2021-03-10T13:54:27.966 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2021-03-10T13:54:27.967 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.max_background_jobs: 2 2021-03-10T13:54:27.967 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.max_background_compactions: -1 2021-03-10T13:54:27.967 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-03-10T13:54:27.967 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-03-10T13:54:27.968 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-03-10T13:54:27.968 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.max_total_wal_size: 0 2021-03-10T13:54:27.968 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-03-10T13:54:27.968 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-03-10T13:54:27.968 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-03-10T13:54:27.969 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-03-10T13:54:27.969 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.max_open_files: -1 2021-03-10T13:54:27.969 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.bytes_per_sync: 0 2021-03-10T13:54:27.969 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-03-10T13:54:27.969 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-03-10T13:54:27.970 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.compaction_readahead_size: 0 2021-03-10T13:54:27.970 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Compression algorithms supported: 2021-03-10T13:54:27.970 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-03-10T13:54:27.970 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: kZSTD supported: 0 2021-03-10T13:54:27.971 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: kXpressCompression supported: 0 2021-03-10T13:54:27.971 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: kLZ4HCCompression supported: 1 2021-03-10T13:54:27.971 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: kLZ4Compression supported: 1 2021-03-10T13:54:27.971 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: kBZip2Compression supported: 0 2021-03-10T13:54:27.971 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: kZlibCompression supported: 1 2021-03-10T13:54:27.972 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: kSnappyCompression supported: 1 2021-03-10T13:54:27.972 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-03-10T13:54:27.972 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2021-03-10T13:54:27.972 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2021-03-10T13:54:27.972 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-03-10T13:54:27.973 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.merge_operator: 2021-03-10T13:54:27.973 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.compaction_filter: None 2021-03-10T13:54:27.973 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.compaction_filter_factory: None 2021-03-10T13:54:27.973 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-03-10T13:54:27.973 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-03-10T13:54:27.974 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5653edf1e230) 2021-03-10T13:54:27.974 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: cache_index_and_filter_blocks: 1 2021-03-10T13:54:27.974 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: cache_index_and_filter_blocks_with_high_priority: 0 2021-03-10T13:54:27.974 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-03-10T13:54:27.975 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: pin_top_level_index_and_filter: 1 2021-03-10T13:54:27.975 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: index_type: 0 2021-03-10T13:54:27.975 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: data_block_index_type: 0 2021-03-10T13:54:27.975 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: index_shortening: 1 2021-03-10T13:54:27.975 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: data_block_hash_table_util_ratio: 0.750000 2021-03-10T13:54:27.976 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: hash_index_allow_collision: 1 2021-03-10T13:54:27.976 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: checksum: 1 2021-03-10T13:54:27.976 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: no_block_cache: 0 2021-03-10T13:54:27.976 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: block_cache: 0x5653edf56510 2021-03-10T13:54:27.976 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: block_cache_name: BinnedLRUCache 2021-03-10T13:54:27.977 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: block_cache_options: 2021-03-10T13:54:27.977 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: capacity : 536870912 2021-03-10T13:54:27.977 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: num_shard_bits : 4 2021-03-10T13:54:27.977 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: strict_capacity_limit : 0 2021-03-10T13:54:27.978 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: high_pri_pool_ratio: 0.000 2021-03-10T13:54:27.978 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: block_cache_compressed: (nil) 2021-03-10T13:54:27.978 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: persistent_cache: (nil) 2021-03-10T13:54:27.978 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: block_size: 4096 2021-03-10T13:54:27.978 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: block_size_deviation: 10 2021-03-10T13:54:27.979 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: block_restart_interval: 16 2021-03-10T13:54:27.979 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: index_block_restart_interval: 1 2021-03-10T13:54:27.979 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: metadata_block_size: 4096 2021-03-10T13:54:27.979 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: partition_filters: 0 2021-03-10T13:54:27.979 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: use_delta_encoding: 1 2021-03-10T13:54:27.980 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: filter_policy: rocksdb.BuiltinBloomFilter 2021-03-10T13:54:27.980 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: whole_key_filtering: 1 2021-03-10T13:54:27.980 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: verify_compression: 0 2021-03-10T13:54:27.980 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: read_amp_bytes_per_bit: 0 2021-03-10T13:54:27.980 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: format_version: 2 2021-03-10T13:54:27.981 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: enable_index_compression: 1 2021-03-10T13:54:27.981 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: block_align: 0 2021-03-10T13:54:27.981 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.write_buffer_size: 33554432 2021-03-10T13:54:27.981 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.max_write_buffer_number: 2 2021-03-10T13:54:27.982 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.compression: NoCompression 2021-03-10T13:54:27.982 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.bottommost_compression: Disabled 2021-03-10T13:54:27.982 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.prefix_extractor: nullptr 2021-03-10T13:54:27.982 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-03-10T13:54:27.982 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.num_levels: 7 2021-03-10T13:54:27.983 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-03-10T13:54:27.983 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-03-10T13:54:27.983 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-03-10T13:54:27.983 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-03-10T13:54:27.983 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-03-10T13:54:27.984 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-03-10T13:54:27.984 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-03-10T13:54:27.984 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-03-10T13:54:27.984 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-03-10T13:54:27.985 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-03-10T13:54:27.985 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.compression_opts.level: 32767 2021-03-10T13:54:27.985 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.compression_opts.strategy: 0 2021-03-10T13:54:27.985 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-03-10T13:54:27.985 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-03-10T13:54:27.986 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.compression_opts.enabled: false 2021-03-10T13:54:27.986 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-03-10T13:54:27.986 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-03-10T13:54:27.986 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-03-10T13:54:27.987 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.target_file_size_base: 67108864 2021-03-10T13:54:27.987 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-03-10T13:54:27.987 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-03-10T13:54:27.987 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-03-10T13:54:27.987 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-03-10T13:54:27.988 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-03-10T13:54:27.988 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-03-10T13:54:27.988 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-03-10T13:54:27.988 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-03-10T13:54:27.989 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-03-10T13:54:27.989 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-03-10T13:54:27.989 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-03-10T13:54:27.989 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-03-10T13:54:27.989 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-03-10T13:54:27.990 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.arena_block_size: 4194304 2021-03-10T13:54:27.990 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-03-10T13:54:27.990 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-03-10T13:54:27.990 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-03-10T13:54:27.990 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.disable_auto_compactions: 0 2021-03-10T13:54:27.991 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-03-10T13:54:27.991 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-03-10T13:54:27.991 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-03-10T13:54:27.991 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-03-10T13:54:27.991 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-03-10T13:54:27.992 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-03-10T13:54:27.992 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-03-10T13:54:27.992 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-03-10T13:54:27.992 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-03-10T13:54:27.992 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-03-10T13:54:27.993 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.table_properties_collectors: 2021-03-10T13:54:27.993 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.inplace_update_support: 0 2021-03-10T13:54:27.993 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-03-10T13:54:27.993 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-03-10T13:54:27.994 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-03-10T13:54:27.994 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-03-10T13:54:27.994 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.bloom_locality: 0 2021-03-10T13:54:27.994 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.max_successive_merges: 0 2021-03-10T13:54:27.994 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-03-10T13:54:27.995 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.paranoid_file_checks: 0 2021-03-10T13:54:27.995 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.force_consistency_checks: 0 2021-03-10T13:54:27.995 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.report_bg_io_stats: 0 2021-03-10T13:54:27.995 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.ttl: 2592000 2021-03-10T13:54:27.995 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-03-10T13:54:27.996 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 25, last_sequence is 9194, log_number is 20,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-03-10T13:54:27.996 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 20 2021-03-10T13:54:27.996 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615384467558220, "job": 1, "event": "recovery_started", "log_files": [20]} 2021-03-10T13:54:27.996 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.552+0000 7f5084bab700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #20 mode 2 2021-03-10T13:54:27.996 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.564+0000 7f5084bab700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-03-10T13:54:27.997 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.576+0000 7f5084bab700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615384467581602, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 25, "file_size": 14050736, "table_properties": {"data_size": 14043219, "index_size": 5861, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 837, "raw_key_size": 6552, "raw_average_key_size": 21, "raw_value_size": 14034294, "raw_average_value_size": 46780, "num_data_blocks": 184, "num_entries": 300, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1615384467, "oldest_key_time": 3, "file_creation_time": 0}} 2021-03-10T13:54:27.997 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.576+0000 7f5084bab700 4 rocksdb: [version_set.cc:3826] Creating manifest 26 2021-03-10T13:54:27.997 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.576+0000 7f5084bab700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615384467582455, "job": 1, "event": "recovery_finished"} 2021-03-10T13:54:27.997 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.580+0000 7f5084bab700 4 rocksdb: DB pointer 0x5653ee01b800 2021-03-10T13:54:27.997 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.580+0000 7f506b9be700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2021-03-10T13:54:27.998 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.580+0000 7f506b9be700 4 rocksdb: [db_impl/db_impl.cc:851] 2021-03-10T13:54:27.998 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: ** DB Stats ** 2021-03-10T13:54:27.998 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:54:27.998 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-03-10T13:54:27.999 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-03-10T13:54:27.999 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T13:54:27.999 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-03-10T13:54:27.999 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-03-10T13:54:27.999 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T13:54:28.000 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: ** Compaction Stats [default] ** 2021-03-10T13:54:28.000 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:54:28.000 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:54:28.000 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: L0 1/0 13.40 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1154.2 0.01 0.00 1 0.012 0 0 2021-03-10T13:54:28.000 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: L6 2/0 66.64 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:54:28.001 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: Sum 3/0 80.04 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1154.2 0.01 0.00 1 0.012 0 0 2021-03-10T13:54:28.001 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1154.2 0.01 0.00 1 0.012 0 0 2021-03-10T13:54:28.001 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: ** Compaction Stats [default] ** 2021-03-10T13:54:28.001 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:54:28.002 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:54:28.002 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1154.2 0.01 0.00 1 0.012 0 0 2021-03-10T13:54:28.002 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:54:28.002 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: Flush(GB): cumulative 0.013, interval 0.013 2021-03-10T13:54:28.002 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T13:54:28.003 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T13:54:28.003 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T13:54:28.003 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T13:54:28.003 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: Cumulative compaction: 0.01 GB write, 508.01 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:54:28.003 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: Interval compaction: 0.01 GB write, 508.01 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:54:28.004 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T13:54:28.004 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T13:54:28.004 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: ** Compaction Stats [default] ** 2021-03-10T13:54:28.004 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:54:28.005 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:54:28.005 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: L0 1/0 13.40 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1154.2 0.01 0.00 1 0.012 0 0 2021-03-10T13:54:28.005 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: L6 2/0 66.64 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:54:28.005 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: Sum 3/0 80.04 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1154.2 0.01 0.00 1 0.012 0 0 2021-03-10T13:54:28.005 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T13:54:28.006 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: ** Compaction Stats [default] ** 2021-03-10T13:54:28.006 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T13:54:28.006 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T13:54:28.006 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1154.2 0.01 0.00 1 0.012 0 0 2021-03-10T13:54:28.006 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T13:54:28.007 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: Flush(GB): cumulative 0.013, interval 0.000 2021-03-10T13:54:28.007 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T13:54:28.007 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T13:54:28.007 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T13:54:28.008 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T13:54:28.008 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: Cumulative compaction: 0.01 GB write, 507.43 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:54:28.008 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T13:54:28.008 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T13:54:28.008 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T13:54:28.009 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.580+0000 7f5084bab700 0 starting mon.b rank 2 at public addrs [v2:172.21.2.120:3300/0,v1:172.21.2.120:6789/0] at bind addrs [v2:172.21.2.120:3300/0,v1:172.21.2.120:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 7672acc8-81a6-11eb-9080-001a4aab830c 2021-03-10T13:54:28.009 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.580+0000 7f5084bab700 1 mon.b@-1(???) e3 preinit fsid 7672acc8-81a6-11eb-9080-001a4aab830c 2021-03-10T13:54:28.009 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.580+0000 7f5084bab700 0 mon.b@-1(???).mds e1 new map 2021-03-10T13:54:28.009 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.580+0000 7f5084bab700 0 mon.b@-1(???).mds e1 print_map 2021-03-10T13:54:28.009 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: e1 2021-03-10T13:54:28.010 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: enable_multiple, ever_enabled_multiple: 0,0 2021-03-10T13:54:28.010 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-03-10T13:54:28.010 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: legacy client fscid: -1 2021-03-10T13:54:28.010 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: 2021-03-10T13:54:28.011 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: No filesystems configured 2021-03-10T13:54:28.011 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.580+0000 7f5084bab700 0 mon.b@-1(???).osd e62 crush map has features 3314933000852226048, adjusting msgr requires 2021-03-10T13:54:28.011 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.580+0000 7f5084bab700 0 mon.b@-1(???).osd e62 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T13:54:28.011 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.580+0000 7f5084bab700 0 mon.b@-1(???).osd e62 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T13:54:28.011 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.580+0000 7f5084bab700 0 mon.b@-1(???).osd e62 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T13:54:28.011 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: cephadm 2021-03-10T13:54:23.426955+0000 mgr.gibba020.yqfnwy (mgr.34427) 30 : cephadm [INF] Upgrade: Updating mon.b 2021-03-10T13:54:28.012 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: cephadm 2021-03-10T13:54:23.440891+0000 mgr.gibba020.yqfnwy (mgr.34427) 31 : cephadm [INF] Deploying daemon mon.b on gibba020 2021-03-10T13:54:28.012 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.580+0000 7f5084bab700 1 mon.b@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2021-03-10T13:54:28.012 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.580+0000 7f5084bab700 20 expand_channel_meta expand map: {default=false} 2021-03-10T13:54:28.012 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.580+0000 7f5084bab700 20 expand_channel_meta from 'false' to 'false' 2021-03-10T13:54:28.012 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.580+0000 7f5084bab700 20 expand_channel_meta expanded map: {default=false} 2021-03-10T13:54:28.013 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.580+0000 7f5084bab700 20 expand_channel_meta expand map: {default=info} 2021-03-10T13:54:28.013 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.580+0000 7f5084bab700 20 expand_channel_meta from 'info' to 'info' 2021-03-10T13:54:28.013 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.580+0000 7f5084bab700 20 expand_channel_meta expanded map: {default=info} 2021-03-10T13:54:28.013 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.580+0000 7f5084bab700 20 expand_channel_meta expand map: {default=daemon} 2021-03-10T13:54:28.013 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.580+0000 7f5084bab700 20 expand_channel_meta from 'daemon' to 'daemon' 2021-03-10T13:54:28.014 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.580+0000 7f5084bab700 20 expand_channel_meta expanded map: {default=daemon} 2021-03-10T13:54:28.014 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.580+0000 7f5084bab700 20 expand_channel_meta expand map: {default=debug} 2021-03-10T13:54:28.014 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.580+0000 7f5084bab700 20 expand_channel_meta from 'debug' to 'debug' 2021-03-10T13:54:28.014 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:27 gibba020 bash[25448]: debug 2021-03-10T13:54:27.580+0000 7f5084bab700 20 expand_channel_meta expanded map: {default=debug} 2021-03-10T13:54:29.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:28 gibba013 bash[30381]: cluster 2021-03-10T13:54:24.384006+0000 mgr.gibba020.yqfnwy (mgr.34427) 32 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:29.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:28 gibba013 bash[29418]: cluster 2021-03-10T13:54:24.384006+0000 mgr.gibba020.yqfnwy (mgr.34427) 32 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:29.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:28 gibba013 bash[29418]: debug 2021-03-10T13:54:28.805+0000 7fd714a7a700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:29.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:28 gibba013 bash[29418]: debug 2021-03-10T13:54:28.805+0000 7fd714a7a700 -1 log_channel(cluster) log [ERR] : [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:54:29.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:28 gibba013 bash[29418]: debug 2021-03-10T13:54:28.805+0000 7fd714a7a700 -1 log_channel(cluster) log [ERR] : daemon rgw.r.z.gibba020.txcybs on gibba020 is in error state 2021-03-10T13:54:29.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:28 gibba013 bash[29418]: debug 2021-03-10T13:54:28.805+0000 7fd714a7a700 -1 log_channel(cluster) log [ERR] : [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:29.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:28 gibba013 bash[29418]: debug 2021-03-10T13:54:28.805+0000 7fd714a7a700 -1 log_channel(cluster) log [ERR] : Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:29.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:28 gibba020 bash[25448]: cluster 2021-03-10T13:54:24.384006+0000 mgr.gibba020.yqfnwy (mgr.34427) 32 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:34.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[29418]: debug 2021-03-10T13:54:33.813+0000 7fd71627d700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:34.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[29418]: debug 2021-03-10T13:54:33.813+0000 7fd71627d700 -1 log_channel(cluster) log [ERR] : [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:54:34.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[29418]: debug 2021-03-10T13:54:33.813+0000 7fd71627d700 -1 log_channel(cluster) log [ERR] : daemon rgw.r.z.gibba020.txcybs on gibba020 is in error state 2021-03-10T13:54:34.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[29418]: debug 2021-03-10T13:54:33.813+0000 7fd71627d700 -1 log_channel(cluster) log [ERR] : [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:34.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[29418]: debug 2021-03-10T13:54:33.813+0000 7fd71627d700 -1 log_channel(cluster) log [ERR] : Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:34.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[29418]: debug 2021-03-10T13:54:33.833+0000 7fd714a7a700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:34.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[29418]: debug 2021-03-10T13:54:33.833+0000 7fd714a7a700 -1 log_channel(cluster) log [ERR] : [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:54:34.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[29418]: debug 2021-03-10T13:54:33.833+0000 7fd714a7a700 -1 log_channel(cluster) log [ERR] : daemon rgw.r.z.gibba020.txcybs on gibba020 is in error state 2021-03-10T13:54:34.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[29418]: debug 2021-03-10T13:54:33.833+0000 7fd714a7a700 -1 log_channel(cluster) log [ERR] : [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:34.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[29418]: debug 2021-03-10T13:54:33.833+0000 7fd714a7a700 -1 log_channel(cluster) log [ERR] : Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:34.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[29418]: cluster 2021-03-10T13:54:28.387019+0000 mgr.gibba020.yqfnwy (mgr.34427) 34 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:34.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[29418]: cluster 2021-03-10T13:54:28.807156+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2021-03-10T13:54:34.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[29418]: cluster 2021-03-10T13:54:28.808571+0000 mon.a (mon.0) 57 : cluster [ERR] Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:34.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[29418]: cluster 2021-03-10T13:54:28.808579+0000 mon.a (mon.0) 58 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:54:34.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[29418]: cluster 2021-03-10T13:54:28.808589+0000 mon.a (mon.0) 59 : cluster [ERR] daemon rgw.r.z.gibba020.txcybs on gibba020 is in error state 2021-03-10T13:54:34.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[29418]: cluster 2021-03-10T13:54:28.808596+0000 mon.a (mon.0) 60 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:34.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[29418]: cluster 2021-03-10T13:54:28.808603+0000 mon.a (mon.0) 61 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:34.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[29418]: cluster 2021-03-10T13:54:28.809256+0000 mon.a (mon.0) 62 : cluster [INF] mon.a calling monitor election 2021-03-10T13:54:34.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[29418]: cluster 2021-03-10T13:54:28.809333+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2021-03-10T13:54:34.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[29418]: cluster 2021-03-10T13:54:30.388140+0000 mgr.gibba020.yqfnwy (mgr.34427) 35 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:34.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[29418]: cluster 2021-03-10T13:54:32.390329+0000 mgr.gibba020.yqfnwy (mgr.34427) 36 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:34.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[30381]: cluster 2021-03-10T13:54:28.387019+0000 mgr.gibba020.yqfnwy (mgr.34427) 34 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:34.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[30381]: cluster 2021-03-10T13:54:28.807156+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2021-03-10T13:54:34.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[30381]: cluster 2021-03-10T13:54:28.808571+0000 mon.a (mon.0) 57 : cluster [ERR] Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:34.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[30381]: cluster 2021-03-10T13:54:28.808579+0000 mon.a (mon.0) 58 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:54:34.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[30381]: cluster 2021-03-10T13:54:28.808589+0000 mon.a (mon.0) 59 : cluster [ERR] daemon rgw.r.z.gibba020.txcybs on gibba020 is in error state 2021-03-10T13:54:34.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[30381]: cluster 2021-03-10T13:54:28.808596+0000 mon.a (mon.0) 60 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:34.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[30381]: cluster 2021-03-10T13:54:28.808603+0000 mon.a (mon.0) 61 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:34.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[30381]: cluster 2021-03-10T13:54:28.809256+0000 mon.a (mon.0) 62 : cluster [INF] mon.a calling monitor election 2021-03-10T13:54:34.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[30381]: cluster 2021-03-10T13:54:28.809333+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2021-03-10T13:54:34.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[30381]: cluster 2021-03-10T13:54:30.388140+0000 mgr.gibba020.yqfnwy (mgr.34427) 35 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:34.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[30381]: cluster 2021-03-10T13:54:32.390329+0000 mgr.gibba020.yqfnwy (mgr.34427) 36 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:34.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[30381]: cluster 2021-03-10T13:54:33.810974+0000 mon.a (mon.0) 63 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-03-10T13:54:34.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[30381]: cluster 2021-03-10T13:54:33.814142+0000 mon.a (mon.0) 64 : cluster [ERR] Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:34.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[30381]: cluster 2021-03-10T13:54:33.814240+0000 mon.a (mon.0) 65 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:54:34.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[30381]: cluster 2021-03-10T13:54:33.814308+0000 mon.a (mon.0) 66 : cluster [ERR] daemon rgw.r.z.gibba020.txcybs on gibba020 is in error state 2021-03-10T13:54:34.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[30381]: cluster 2021-03-10T13:54:33.814361+0000 mon.a (mon.0) 67 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:34.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[30381]: cluster 2021-03-10T13:54:33.814443+0000 mon.a (mon.0) 68 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:34.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[30381]: cluster 2021-03-10T13:54:33.814657+0000 mon.a (mon.0) 69 : cluster [INF] mon.a calling monitor election 2021-03-10T13:54:34.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[30381]: cluster 2021-03-10T13:54:33.814871+0000 mon.c (mon.1) 4 : cluster [INF] mon.c calling monitor election 2021-03-10T13:54:34.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[30381]: cluster 2021-03-10T13:54:33.820267+0000 mon.a (mon.0) 70 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T13:54:34.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[30381]: cluster 2021-03-10T13:54:33.830156+0000 mon.a (mon.0) 71 : cluster [DBG] monmap e4: 3 mons at {a=[v2:172.21.2.113:3300/0,v1:172.21.2.113:6789/0],b=[v2:172.21.2.120:3300/0,v1:172.21.2.120:6789/0],c=[v2:172.21.2.113:3301/0,v1:172.21.2.113:6790/0]} 2021-03-10T13:54:34.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[30381]: cluster 2021-03-10T13:54:33.830225+0000 mon.a (mon.0) 72 : cluster [DBG] fsmap 2021-03-10T13:54:34.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[30381]: cluster 2021-03-10T13:54:33.830237+0000 mon.a (mon.0) 73 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-03-10T13:54:34.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[30381]: cluster 2021-03-10T13:54:33.830473+0000 mon.a (mon.0) 74 : cluster [DBG] mgrmap e25: gibba020.yqfnwy(active, since 28s), standbys: x, y 2021-03-10T13:54:34.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[30381]: cluster 2021-03-10T13:54:33.834521+0000 mon.a (mon.0) 75 : cluster [ERR] Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:34.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[30381]: cluster 2021-03-10T13:54:33.834530+0000 mon.a (mon.0) 76 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:54:34.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[30381]: cluster 2021-03-10T13:54:33.834534+0000 mon.a (mon.0) 77 : cluster [ERR] daemon rgw.r.z.gibba020.txcybs on gibba020 is in error state 2021-03-10T13:54:34.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[30381]: cluster 2021-03-10T13:54:33.834564+0000 mon.a (mon.0) 78 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:34.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[30381]: cluster 2021-03-10T13:54:33.834572+0000 mon.a (mon.0) 79 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:34.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[30381]: audit 2021-03-10T13:54:33.841267+0000 mon.a (mon.0) 80 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:34.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[30381]: audit 2021-03-10T13:54:33.841969+0000 mon.a (mon.0) 81 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:54:34.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[30381]: audit 2021-03-10T13:54:33.843642+0000 mon.a (mon.0) 82 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:54:34.142 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[29418]: cluster 2021-03-10T13:54:33.810974+0000 mon.a (mon.0) 63 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-03-10T13:54:34.142 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[29418]: cluster 2021-03-10T13:54:33.814142+0000 mon.a (mon.0) 64 : cluster [ERR] Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:34.142 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[29418]: cluster 2021-03-10T13:54:33.814240+0000 mon.a (mon.0) 65 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:54:34.143 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[29418]: cluster 2021-03-10T13:54:33.814308+0000 mon.a (mon.0) 66 : cluster [ERR] daemon rgw.r.z.gibba020.txcybs on gibba020 is in error state 2021-03-10T13:54:34.143 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[29418]: cluster 2021-03-10T13:54:33.814361+0000 mon.a (mon.0) 67 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:34.143 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[29418]: cluster 2021-03-10T13:54:33.814443+0000 mon.a (mon.0) 68 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:34.143 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[29418]: cluster 2021-03-10T13:54:33.814657+0000 mon.a (mon.0) 69 : cluster [INF] mon.a calling monitor election 2021-03-10T13:54:34.143 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[29418]: cluster 2021-03-10T13:54:33.814871+0000 mon.c (mon.1) 4 : cluster [INF] mon.c calling monitor election 2021-03-10T13:54:34.144 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[29418]: cluster 2021-03-10T13:54:33.820267+0000 mon.a (mon.0) 70 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T13:54:34.144 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[29418]: cluster 2021-03-10T13:54:33.830156+0000 mon.a (mon.0) 71 : cluster [DBG] monmap e4: 3 mons at {a=[v2:172.21.2.113:3300/0,v1:172.21.2.113:6789/0],b=[v2:172.21.2.120:3300/0,v1:172.21.2.120:6789/0],c=[v2:172.21.2.113:3301/0,v1:172.21.2.113:6790/0]} 2021-03-10T13:54:34.144 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[29418]: cluster 2021-03-10T13:54:33.830225+0000 mon.a (mon.0) 72 : cluster [DBG] fsmap 2021-03-10T13:54:34.144 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[29418]: cluster 2021-03-10T13:54:33.830237+0000 mon.a (mon.0) 73 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-03-10T13:54:34.145 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[29418]: cluster 2021-03-10T13:54:33.830473+0000 mon.a (mon.0) 74 : cluster [DBG] mgrmap e25: gibba020.yqfnwy(active, since 28s), standbys: x, y 2021-03-10T13:54:34.145 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[29418]: cluster 2021-03-10T13:54:33.834521+0000 mon.a (mon.0) 75 : cluster [ERR] Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:34.145 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[29418]: cluster 2021-03-10T13:54:33.834530+0000 mon.a (mon.0) 76 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:54:34.145 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[29418]: cluster 2021-03-10T13:54:33.834534+0000 mon.a (mon.0) 77 : cluster [ERR] daemon rgw.r.z.gibba020.txcybs on gibba020 is in error state 2021-03-10T13:54:34.145 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[29418]: cluster 2021-03-10T13:54:33.834564+0000 mon.a (mon.0) 78 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:34.146 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[29418]: cluster 2021-03-10T13:54:33.834572+0000 mon.a (mon.0) 79 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:34.146 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[29418]: audit 2021-03-10T13:54:33.841267+0000 mon.a (mon.0) 80 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:34.146 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[29418]: audit 2021-03-10T13:54:33.841969+0000 mon.a (mon.0) 81 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:54:34.146 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:33 gibba013 bash[29418]: audit 2021-03-10T13:54:33.843642+0000 mon.a (mon.0) 82 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:54:34.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:33 gibba020 bash[25448]: cluster 2021-03-10T13:54:28.387019+0000 mgr.gibba020.yqfnwy (mgr.34427) 34 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:34.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:33 gibba020 bash[25448]: cluster 2021-03-10T13:54:28.807156+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2021-03-10T13:54:34.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:33 gibba020 bash[25448]: cluster 2021-03-10T13:54:28.808571+0000 mon.a (mon.0) 57 : cluster [ERR] Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:34.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:33 gibba020 bash[25448]: cluster 2021-03-10T13:54:28.808579+0000 mon.a (mon.0) 58 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:54:34.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:33 gibba020 bash[25448]: cluster 2021-03-10T13:54:28.808589+0000 mon.a (mon.0) 59 : cluster [ERR] daemon rgw.r.z.gibba020.txcybs on gibba020 is in error state 2021-03-10T13:54:34.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:33 gibba020 bash[25448]: cluster 2021-03-10T13:54:28.808596+0000 mon.a (mon.0) 60 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:34.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:33 gibba020 bash[25448]: cluster 2021-03-10T13:54:28.808603+0000 mon.a (mon.0) 61 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:34.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:33 gibba020 bash[25448]: cluster 2021-03-10T13:54:28.809256+0000 mon.a (mon.0) 62 : cluster [INF] mon.a calling monitor election 2021-03-10T13:54:34.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:33 gibba020 bash[25448]: cluster 2021-03-10T13:54:28.809333+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2021-03-10T13:54:34.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:33 gibba020 bash[25448]: cluster 2021-03-10T13:54:30.388140+0000 mgr.gibba020.yqfnwy (mgr.34427) 35 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:34.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:33 gibba020 bash[25448]: cluster 2021-03-10T13:54:32.390329+0000 mgr.gibba020.yqfnwy (mgr.34427) 36 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:34.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:33 gibba020 bash[25448]: cluster 2021-03-10T13:54:33.810974+0000 mon.a (mon.0) 63 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-03-10T13:54:34.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:33 gibba020 bash[25448]: cluster 2021-03-10T13:54:33.814142+0000 mon.a (mon.0) 64 : cluster [ERR] Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:34.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:33 gibba020 bash[25448]: cluster 2021-03-10T13:54:33.814240+0000 mon.a (mon.0) 65 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:54:34.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:33 gibba020 bash[25448]: cluster 2021-03-10T13:54:33.814308+0000 mon.a (mon.0) 66 : cluster [ERR] daemon rgw.r.z.gibba020.txcybs on gibba020 is in error state 2021-03-10T13:54:34.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:33 gibba020 bash[25448]: cluster 2021-03-10T13:54:33.814361+0000 mon.a (mon.0) 67 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:34.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:33 gibba020 bash[25448]: cluster 2021-03-10T13:54:33.814443+0000 mon.a (mon.0) 68 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:34.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:33 gibba020 bash[25448]: cluster 2021-03-10T13:54:33.814657+0000 mon.a (mon.0) 69 : cluster [INF] mon.a calling monitor election 2021-03-10T13:54:34.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:33 gibba020 bash[25448]: cluster 2021-03-10T13:54:33.814871+0000 mon.c (mon.1) 4 : cluster [INF] mon.c calling monitor election 2021-03-10T13:54:34.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:33 gibba020 bash[25448]: cluster 2021-03-10T13:54:33.820267+0000 mon.a (mon.0) 70 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T13:54:34.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:33 gibba020 bash[25448]: cluster 2021-03-10T13:54:33.830156+0000 mon.a (mon.0) 71 : cluster [DBG] monmap e4: 3 mons at {a=[v2:172.21.2.113:3300/0,v1:172.21.2.113:6789/0],b=[v2:172.21.2.120:3300/0,v1:172.21.2.120:6789/0],c=[v2:172.21.2.113:3301/0,v1:172.21.2.113:6790/0]} 2021-03-10T13:54:34.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:33 gibba020 bash[25448]: cluster 2021-03-10T13:54:33.830225+0000 mon.a (mon.0) 72 : cluster [DBG] fsmap 2021-03-10T13:54:34.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:33 gibba020 bash[25448]: cluster 2021-03-10T13:54:33.830237+0000 mon.a (mon.0) 73 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-03-10T13:54:34.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:33 gibba020 bash[25448]: cluster 2021-03-10T13:54:33.830473+0000 mon.a (mon.0) 74 : cluster [DBG] mgrmap e25: gibba020.yqfnwy(active, since 28s), standbys: x, y 2021-03-10T13:54:34.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:33 gibba020 bash[25448]: cluster 2021-03-10T13:54:33.834521+0000 mon.a (mon.0) 75 : cluster [ERR] Health detail: HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:34.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:33 gibba020 bash[25448]: cluster 2021-03-10T13:54:33.834530+0000 mon.a (mon.0) 76 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2021-03-10T13:54:34.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:33 gibba020 bash[25448]: cluster 2021-03-10T13:54:33.834534+0000 mon.a (mon.0) 77 : cluster [ERR] daemon rgw.r.z.gibba020.txcybs on gibba020 is in error state 2021-03-10T13:54:34.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:33 gibba020 bash[25448]: cluster 2021-03-10T13:54:33.834564+0000 mon.a (mon.0) 78 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:34.206 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:33 gibba020 bash[25448]: cluster 2021-03-10T13:54:33.834572+0000 mon.a (mon.0) 79 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T13:54:34.206 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:33 gibba020 bash[25448]: audit 2021-03-10T13:54:33.841267+0000 mon.a (mon.0) 80 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:34.206 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:33 gibba020 bash[25448]: audit 2021-03-10T13:54:33.841969+0000 mon.a (mon.0) 81 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:54:34.206 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:33 gibba020 bash[25448]: audit 2021-03-10T13:54:33.843642+0000 mon.a (mon.0) 82 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:54:36.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:35 gibba020 bash[25448]: cluster 2021-03-10T13:54:34.391246+0000 mgr.gibba020.yqfnwy (mgr.34427) 37 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:36.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:35 gibba013 bash[29418]: cluster 2021-03-10T13:54:34.391246+0000 mgr.gibba020.yqfnwy (mgr.34427) 37 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:36.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:35 gibba013 bash[30381]: cluster 2021-03-10T13:54:34.391246+0000 mgr.gibba020.yqfnwy (mgr.34427) 37 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:38.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:37 gibba020 bash[25448]: cluster 2021-03-10T13:54:36.392169+0000 mgr.gibba020.yqfnwy (mgr.34427) 38 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:38.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:37 gibba020 bash[25448]: audit 2021-03-10T13:54:37.808222+0000 mon.a (mon.0) 83 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:38.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:37 gibba020 bash[25448]: audit 2021-03-10T13:54:37.812035+0000 mon.a (mon.0) 84 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:38.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:37 gibba020 bash[25448]: audit 2021-03-10T13:54:37.814453+0000 mon.a (mon.0) 85 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:54:38.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:37 gibba020 bash[25448]: audit 2021-03-10T13:54:37.815421+0000 mon.a (mon.0) 86 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:54:38.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:37 gibba020 bash[25448]: audit 2021-03-10T13:54:37.816289+0000 mon.a (mon.0) 87 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:54:38.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:37 gibba020 bash[25448]: audit 2021-03-10T13:54:37.817729+0000 mon.a (mon.0) 88 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T13:54:38.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:37 gibba013 bash[29418]: cluster 2021-03-10T13:54:36.392169+0000 mgr.gibba020.yqfnwy (mgr.34427) 38 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:38.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:37 gibba013 bash[29418]: audit 2021-03-10T13:54:37.808222+0000 mon.a (mon.0) 83 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:38.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:37 gibba013 bash[29418]: audit 2021-03-10T13:54:37.812035+0000 mon.a (mon.0) 84 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:38.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:37 gibba013 bash[29418]: audit 2021-03-10T13:54:37.814453+0000 mon.a (mon.0) 85 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:54:38.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:37 gibba013 bash[29418]: audit 2021-03-10T13:54:37.815421+0000 mon.a (mon.0) 86 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:54:38.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:37 gibba013 bash[29418]: audit 2021-03-10T13:54:37.816289+0000 mon.a (mon.0) 87 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:54:38.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:37 gibba013 bash[29418]: audit 2021-03-10T13:54:37.817729+0000 mon.a (mon.0) 88 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T13:54:38.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:37 gibba013 bash[30381]: cluster 2021-03-10T13:54:36.392169+0000 mgr.gibba020.yqfnwy (mgr.34427) 38 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:38.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:37 gibba013 bash[30381]: audit 2021-03-10T13:54:37.808222+0000 mon.a (mon.0) 83 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:38.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:37 gibba013 bash[30381]: audit 2021-03-10T13:54:37.812035+0000 mon.a (mon.0) 84 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:38.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:37 gibba013 bash[30381]: audit 2021-03-10T13:54:37.814453+0000 mon.a (mon.0) 85 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:54:38.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:37 gibba013 bash[30381]: audit 2021-03-10T13:54:37.815421+0000 mon.a (mon.0) 86 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:54:38.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:37 gibba013 bash[30381]: audit 2021-03-10T13:54:37.816289+0000 mon.a (mon.0) 87 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:54:38.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:37 gibba013 bash[30381]: audit 2021-03-10T13:54:37.817729+0000 mon.a (mon.0) 88 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T13:54:39.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:38 gibba020 bash[25448]: cephadm 2021-03-10T13:54:37.811595+0000 mgr.gibba020.yqfnwy (mgr.34427) 39 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2021-03-10T13:54:39.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:38 gibba020 bash[25448]: cephadm 2021-03-10T13:54:37.814624+0000 mgr.gibba020.yqfnwy (mgr.34427) 40 : cephadm [INF] Reconfiguring daemon mon.a on gibba013 2021-03-10T13:54:39.242 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:38 gibba013 bash[29418]: cephadm 2021-03-10T13:54:37.811595+0000 mgr.gibba020.yqfnwy (mgr.34427) 39 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2021-03-10T13:54:39.242 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:38 gibba013 bash[29418]: cephadm 2021-03-10T13:54:37.814624+0000 mgr.gibba020.yqfnwy (mgr.34427) 40 : cephadm [INF] Reconfiguring daemon mon.a on gibba013 2021-03-10T13:54:39.243 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:38 gibba013 bash[30381]: cephadm 2021-03-10T13:54:37.811595+0000 mgr.gibba020.yqfnwy (mgr.34427) 39 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2021-03-10T13:54:39.243 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:38 gibba013 bash[30381]: cephadm 2021-03-10T13:54:37.814624+0000 mgr.gibba020.yqfnwy (mgr.34427) 40 : cephadm [INF] Reconfiguring daemon mon.a on gibba013 2021-03-10T13:54:40.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:39 gibba013 bash[29418]: cluster 2021-03-10T13:54:38.394427+0000 mgr.gibba020.yqfnwy (mgr.34427) 41 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:40.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:39 gibba013 bash[29418]: audit 2021-03-10T13:54:39.695617+0000 mon.a (mon.0) 89 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:40.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:39 gibba013 bash[29418]: audit 2021-03-10T13:54:39.698532+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:54:40.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:39 gibba013 bash[29418]: audit 2021-03-10T13:54:39.701275+0000 mon.a (mon.0) 91 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T13:54:40.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:39 gibba013 bash[29418]: audit 2021-03-10T13:54:39.703095+0000 mon.a (mon.0) 92 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:54:40.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:39 gibba013 bash[29418]: audit 2021-03-10T13:54:39.704352+0000 mon.a (mon.0) 93 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2021-03-10T13:54:40.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:39 gibba013 bash[30381]: cluster 2021-03-10T13:54:38.394427+0000 mgr.gibba020.yqfnwy (mgr.34427) 41 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:40.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:39 gibba013 bash[30381]: audit 2021-03-10T13:54:39.695617+0000 mon.a (mon.0) 89 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:40.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:39 gibba013 bash[30381]: audit 2021-03-10T13:54:39.698532+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:54:40.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:39 gibba013 bash[30381]: audit 2021-03-10T13:54:39.701275+0000 mon.a (mon.0) 91 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T13:54:40.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:39 gibba013 bash[30381]: audit 2021-03-10T13:54:39.703095+0000 mon.a (mon.0) 92 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:54:40.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:39 gibba013 bash[30381]: audit 2021-03-10T13:54:39.704352+0000 mon.a (mon.0) 93 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2021-03-10T13:54:40.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:39 gibba020 bash[25448]: cluster 2021-03-10T13:54:38.394427+0000 mgr.gibba020.yqfnwy (mgr.34427) 41 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:40.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:39 gibba020 bash[25448]: audit 2021-03-10T13:54:39.695617+0000 mon.a (mon.0) 89 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:40.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:39 gibba020 bash[25448]: audit 2021-03-10T13:54:39.698532+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:54:40.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:39 gibba020 bash[25448]: audit 2021-03-10T13:54:39.701275+0000 mon.a (mon.0) 91 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T13:54:40.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:39 gibba020 bash[25448]: audit 2021-03-10T13:54:39.703095+0000 mon.a (mon.0) 92 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:54:40.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:39 gibba020 bash[25448]: audit 2021-03-10T13:54:39.704352+0000 mon.a (mon.0) 93 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2021-03-10T13:54:41.067 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:40 gibba013 bash[29418]: cephadm 2021-03-10T13:54:39.695297+0000 mgr.gibba020.yqfnwy (mgr.34427) 42 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2021-03-10T13:54:41.068 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:40 gibba013 bash[29418]: cephadm 2021-03-10T13:54:39.701347+0000 mgr.gibba020.yqfnwy (mgr.34427) 43 : cephadm [INF] Reconfiguring daemon mgr.y on gibba013 2021-03-10T13:54:41.068 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:40 gibba013 bash[30381]: cephadm 2021-03-10T13:54:39.695297+0000 mgr.gibba020.yqfnwy (mgr.34427) 42 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2021-03-10T13:54:41.068 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:40 gibba013 bash[30381]: cephadm 2021-03-10T13:54:39.701347+0000 mgr.gibba020.yqfnwy (mgr.34427) 43 : cephadm [INF] Reconfiguring daemon mgr.y on gibba013 2021-03-10T13:54:41.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:40 gibba020 bash[25448]: cephadm 2021-03-10T13:54:39.695297+0000 mgr.gibba020.yqfnwy (mgr.34427) 42 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2021-03-10T13:54:41.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:40 gibba020 bash[25448]: cephadm 2021-03-10T13:54:39.701347+0000 mgr.gibba020.yqfnwy (mgr.34427) 43 : cephadm [INF] Reconfiguring daemon mgr.y on gibba013 2021-03-10T13:54:42.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:41 gibba013 bash[29418]: cluster 2021-03-10T13:54:40.395636+0000 mgr.gibba020.yqfnwy (mgr.34427) 44 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:42.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:41 gibba013 bash[29418]: audit 2021-03-10T13:54:41.518779+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:42.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:41 gibba013 bash[29418]: audit 2021-03-10T13:54:41.521429+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:54:42.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:41 gibba013 bash[29418]: audit 2021-03-10T13:54:41.523850+0000 mon.a (mon.0) 96 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:54:42.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:41 gibba013 bash[29418]: audit 2021-03-10T13:54:41.525830+0000 mon.a (mon.0) 97 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:54:42.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:41 gibba013 bash[29418]: audit 2021-03-10T13:54:41.527559+0000 mon.a (mon.0) 98 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T13:54:42.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:41 gibba013 bash[30381]: cluster 2021-03-10T13:54:40.395636+0000 mgr.gibba020.yqfnwy (mgr.34427) 44 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:42.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:41 gibba013 bash[30381]: audit 2021-03-10T13:54:41.518779+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:42.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:41 gibba013 bash[30381]: audit 2021-03-10T13:54:41.521429+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:54:42.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:41 gibba013 bash[30381]: audit 2021-03-10T13:54:41.523850+0000 mon.a (mon.0) 96 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:54:42.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:41 gibba013 bash[30381]: audit 2021-03-10T13:54:41.525830+0000 mon.a (mon.0) 97 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:54:42.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:41 gibba013 bash[30381]: audit 2021-03-10T13:54:41.527559+0000 mon.a (mon.0) 98 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T13:54:42.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:41 gibba020 bash[25448]: cluster 2021-03-10T13:54:40.395636+0000 mgr.gibba020.yqfnwy (mgr.34427) 44 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:42.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:41 gibba020 bash[25448]: audit 2021-03-10T13:54:41.518779+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:42.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:41 gibba020 bash[25448]: audit 2021-03-10T13:54:41.521429+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:54:42.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:41 gibba020 bash[25448]: audit 2021-03-10T13:54:41.523850+0000 mon.a (mon.0) 96 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:54:42.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:41 gibba020 bash[25448]: audit 2021-03-10T13:54:41.525830+0000 mon.a (mon.0) 97 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:54:42.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:41 gibba020 bash[25448]: audit 2021-03-10T13:54:41.527559+0000 mon.a (mon.0) 98 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T13:54:43.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:42 gibba013 bash[29418]: cephadm 2021-03-10T13:54:41.518280+0000 mgr.gibba020.yqfnwy (mgr.34427) 45 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-03-10T13:54:43.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:42 gibba013 bash[29418]: cephadm 2021-03-10T13:54:41.524512+0000 mgr.gibba020.yqfnwy (mgr.34427) 46 : cephadm [INF] Reconfiguring daemon mon.c on gibba013 2021-03-10T13:54:43.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:42 gibba013 bash[30381]: cephadm 2021-03-10T13:54:41.518280+0000 mgr.gibba020.yqfnwy (mgr.34427) 45 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-03-10T13:54:43.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:42 gibba013 bash[30381]: cephadm 2021-03-10T13:54:41.524512+0000 mgr.gibba020.yqfnwy (mgr.34427) 46 : cephadm [INF] Reconfiguring daemon mon.c on gibba013 2021-03-10T13:54:43.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:42 gibba020 bash[25448]: cephadm 2021-03-10T13:54:41.518280+0000 mgr.gibba020.yqfnwy (mgr.34427) 45 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-03-10T13:54:43.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:42 gibba020 bash[25448]: cephadm 2021-03-10T13:54:41.524512+0000 mgr.gibba020.yqfnwy (mgr.34427) 46 : cephadm [INF] Reconfiguring daemon mon.c on gibba013 2021-03-10T13:54:44.289 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:43 gibba013 bash[29418]: cluster 2021-03-10T13:54:42.397721+0000 mgr.gibba020.yqfnwy (mgr.34427) 47 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:44.290 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:43 gibba013 bash[29418]: audit 2021-03-10T13:54:43.260353+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:44.290 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:43 gibba013 bash[29418]: audit 2021-03-10T13:54:43.265560+0000 mon.a (mon.0) 100 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2021-03-10T13:54:44.290 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:43 gibba013 bash[30381]: cluster 2021-03-10T13:54:42.397721+0000 mgr.gibba020.yqfnwy (mgr.34427) 47 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:44.291 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:43 gibba013 bash[30381]: audit 2021-03-10T13:54:43.260353+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:44.291 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:43 gibba013 bash[30381]: audit 2021-03-10T13:54:43.265560+0000 mon.a (mon.0) 100 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2021-03-10T13:54:44.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:43 gibba020 bash[25448]: cluster 2021-03-10T13:54:42.397721+0000 mgr.gibba020.yqfnwy (mgr.34427) 47 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:44.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:43 gibba020 bash[25448]: audit 2021-03-10T13:54:43.260353+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:44.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:43 gibba020 bash[25448]: audit 2021-03-10T13:54:43.265560+0000 mon.a (mon.0) 100 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2021-03-10T13:54:45.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:44 gibba013 bash[29418]: cephadm 2021-03-10T13:54:43.259858+0000 mgr.gibba020.yqfnwy (mgr.34427) 48 : cephadm [INF] Reconfiguring osd.0 (monmap changed)... 2021-03-10T13:54:45.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:44 gibba013 bash[29418]: cephadm 2021-03-10T13:54:43.262091+0000 mgr.gibba020.yqfnwy (mgr.34427) 49 : cephadm [INF] Reconfiguring daemon osd.0 on gibba013 2021-03-10T13:54:45.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:44 gibba013 bash[30381]: cephadm 2021-03-10T13:54:43.259858+0000 mgr.gibba020.yqfnwy (mgr.34427) 48 : cephadm [INF] Reconfiguring osd.0 (monmap changed)... 2021-03-10T13:54:45.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:44 gibba013 bash[30381]: cephadm 2021-03-10T13:54:43.262091+0000 mgr.gibba020.yqfnwy (mgr.34427) 49 : cephadm [INF] Reconfiguring daemon osd.0 on gibba013 2021-03-10T13:54:45.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:44 gibba020 bash[25448]: cephadm 2021-03-10T13:54:43.259858+0000 mgr.gibba020.yqfnwy (mgr.34427) 48 : cephadm [INF] Reconfiguring osd.0 (monmap changed)... 2021-03-10T13:54:45.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:44 gibba020 bash[25448]: cephadm 2021-03-10T13:54:43.262091+0000 mgr.gibba020.yqfnwy (mgr.34427) 49 : cephadm [INF] Reconfiguring daemon osd.0 on gibba013 2021-03-10T13:54:46.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:45 gibba013 bash[29418]: cluster 2021-03-10T13:54:44.398900+0000 mgr.gibba020.yqfnwy (mgr.34427) 50 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:46.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:45 gibba013 bash[29418]: cephadm 2021-03-10T13:54:44.990852+0000 mgr.gibba020.yqfnwy (mgr.34427) 51 : cephadm [INF] Reconfiguring osd.1 (monmap changed)... 2021-03-10T13:54:46.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:45 gibba013 bash[29418]: cephadm 2021-03-10T13:54:44.991386+0000 mgr.gibba020.yqfnwy (mgr.34427) 52 : cephadm [INF] Reconfiguring daemon osd.1 on gibba013 2021-03-10T13:54:46.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:45 gibba013 bash[29418]: audit 2021-03-10T13:54:44.992392+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:46.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:45 gibba013 bash[29418]: audit 2021-03-10T13:54:44.994186+0000 mon.a (mon.0) 102 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2021-03-10T13:54:46.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:45 gibba013 bash[30381]: cluster 2021-03-10T13:54:44.398900+0000 mgr.gibba020.yqfnwy (mgr.34427) 50 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:46.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:45 gibba013 bash[30381]: cephadm 2021-03-10T13:54:44.990852+0000 mgr.gibba020.yqfnwy (mgr.34427) 51 : cephadm [INF] Reconfiguring osd.1 (monmap changed)... 2021-03-10T13:54:46.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:45 gibba013 bash[30381]: cephadm 2021-03-10T13:54:44.991386+0000 mgr.gibba020.yqfnwy (mgr.34427) 52 : cephadm [INF] Reconfiguring daemon osd.1 on gibba013 2021-03-10T13:54:46.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:45 gibba013 bash[30381]: audit 2021-03-10T13:54:44.992392+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:46.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:45 gibba013 bash[30381]: audit 2021-03-10T13:54:44.994186+0000 mon.a (mon.0) 102 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2021-03-10T13:54:46.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:45 gibba020 bash[25448]: cluster 2021-03-10T13:54:44.398900+0000 mgr.gibba020.yqfnwy (mgr.34427) 50 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:46.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:45 gibba020 bash[25448]: cephadm 2021-03-10T13:54:44.990852+0000 mgr.gibba020.yqfnwy (mgr.34427) 51 : cephadm [INF] Reconfiguring osd.1 (monmap changed)... 2021-03-10T13:54:46.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:45 gibba020 bash[25448]: cephadm 2021-03-10T13:54:44.991386+0000 mgr.gibba020.yqfnwy (mgr.34427) 52 : cephadm [INF] Reconfiguring daemon osd.1 on gibba013 2021-03-10T13:54:46.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:45 gibba020 bash[25448]: audit 2021-03-10T13:54:44.992392+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:46.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:45 gibba020 bash[25448]: audit 2021-03-10T13:54:44.994186+0000 mon.a (mon.0) 102 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2021-03-10T13:54:47.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:47 gibba020 bash[25448]: cluster 2021-03-10T13:54:46.399825+0000 mgr.gibba020.yqfnwy (mgr.34427) 53 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:47.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:47 gibba020 bash[25448]: cephadm 2021-03-10T13:54:46.682961+0000 mgr.gibba020.yqfnwy (mgr.34427) 54 : cephadm [INF] Reconfiguring osd.2 (monmap changed)... 2021-03-10T13:54:47.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:47 gibba020 bash[25448]: cephadm 2021-03-10T13:54:46.683790+0000 mgr.gibba020.yqfnwy (mgr.34427) 55 : cephadm [INF] Reconfiguring daemon osd.2 on gibba013 2021-03-10T13:54:47.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:47 gibba020 bash[25448]: audit 2021-03-10T13:54:46.684207+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:47.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:47 gibba020 bash[25448]: audit 2021-03-10T13:54:46.686822+0000 mon.a (mon.0) 104 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2021-03-10T13:54:47.967 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:47 gibba013 bash[29418]: cluster 2021-03-10T13:54:46.399825+0000 mgr.gibba020.yqfnwy (mgr.34427) 53 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:47.968 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:47 gibba013 bash[29418]: cephadm 2021-03-10T13:54:46.682961+0000 mgr.gibba020.yqfnwy (mgr.34427) 54 : cephadm [INF] Reconfiguring osd.2 (monmap changed)... 2021-03-10T13:54:47.968 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:47 gibba013 bash[29418]: cephadm 2021-03-10T13:54:46.683790+0000 mgr.gibba020.yqfnwy (mgr.34427) 55 : cephadm [INF] Reconfiguring daemon osd.2 on gibba013 2021-03-10T13:54:47.968 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:47 gibba013 bash[29418]: audit 2021-03-10T13:54:46.684207+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:47.969 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:47 gibba013 bash[29418]: audit 2021-03-10T13:54:46.686822+0000 mon.a (mon.0) 104 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2021-03-10T13:54:47.969 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:47 gibba013 bash[30381]: cluster 2021-03-10T13:54:46.399825+0000 mgr.gibba020.yqfnwy (mgr.34427) 53 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:47.970 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:47 gibba013 bash[30381]: cephadm 2021-03-10T13:54:46.682961+0000 mgr.gibba020.yqfnwy (mgr.34427) 54 : cephadm [INF] Reconfiguring osd.2 (monmap changed)... 2021-03-10T13:54:47.970 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:47 gibba013 bash[30381]: cephadm 2021-03-10T13:54:46.683790+0000 mgr.gibba020.yqfnwy (mgr.34427) 55 : cephadm [INF] Reconfiguring daemon osd.2 on gibba013 2021-03-10T13:54:47.970 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:47 gibba013 bash[30381]: audit 2021-03-10T13:54:46.684207+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:47.970 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:47 gibba013 bash[30381]: audit 2021-03-10T13:54:46.686822+0000 mon.a (mon.0) 104 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2021-03-10T13:54:49.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:49 gibba013 bash[29418]: cluster 2021-03-10T13:54:48.401801+0000 mgr.gibba020.yqfnwy (mgr.34427) 56 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:49.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:49 gibba013 bash[29418]: cephadm 2021-03-10T13:54:48.430281+0000 mgr.gibba020.yqfnwy (mgr.34427) 57 : cephadm [INF] Reconfiguring osd.3 (monmap changed)... 2021-03-10T13:54:49.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:49 gibba013 bash[29418]: audit 2021-03-10T13:54:48.430573+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:49.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:49 gibba013 bash[29418]: cephadm 2021-03-10T13:54:48.432535+0000 mgr.gibba020.yqfnwy (mgr.34427) 58 : cephadm [INF] Reconfiguring daemon osd.3 on gibba013 2021-03-10T13:54:49.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:49 gibba013 bash[29418]: audit 2021-03-10T13:54:48.435827+0000 mon.a (mon.0) 106 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2021-03-10T13:54:49.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:49 gibba013 bash[30381]: cluster 2021-03-10T13:54:48.401801+0000 mgr.gibba020.yqfnwy (mgr.34427) 56 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:49.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:49 gibba013 bash[30381]: cephadm 2021-03-10T13:54:48.430281+0000 mgr.gibba020.yqfnwy (mgr.34427) 57 : cephadm [INF] Reconfiguring osd.3 (monmap changed)... 2021-03-10T13:54:49.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:49 gibba013 bash[30381]: audit 2021-03-10T13:54:48.430573+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:49.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:49 gibba013 bash[30381]: cephadm 2021-03-10T13:54:48.432535+0000 mgr.gibba020.yqfnwy (mgr.34427) 58 : cephadm [INF] Reconfiguring daemon osd.3 on gibba013 2021-03-10T13:54:49.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:49 gibba013 bash[30381]: audit 2021-03-10T13:54:48.435827+0000 mon.a (mon.0) 106 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2021-03-10T13:54:49.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:49 gibba020 bash[25448]: cluster 2021-03-10T13:54:48.401801+0000 mgr.gibba020.yqfnwy (mgr.34427) 56 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:49.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:49 gibba020 bash[25448]: cephadm 2021-03-10T13:54:48.430281+0000 mgr.gibba020.yqfnwy (mgr.34427) 57 : cephadm [INF] Reconfiguring osd.3 (monmap changed)... 2021-03-10T13:54:49.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:49 gibba020 bash[25448]: audit 2021-03-10T13:54:48.430573+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:49.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:49 gibba020 bash[25448]: cephadm 2021-03-10T13:54:48.432535+0000 mgr.gibba020.yqfnwy (mgr.34427) 58 : cephadm [INF] Reconfiguring daemon osd.3 on gibba013 2021-03-10T13:54:49.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:49 gibba020 bash[25448]: audit 2021-03-10T13:54:48.435827+0000 mon.a (mon.0) 106 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2021-03-10T13:54:51.362 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:51 gibba020 bash[25448]: cephadm 2021-03-10T13:54:50.156351+0000 mgr.gibba020.yqfnwy (mgr.34427) 59 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-03-10T13:54:51.362 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:51 gibba020 bash[25448]: audit 2021-03-10T13:54:50.157837+0000 mon.a (mon.0) 107 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:51.362 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:51 gibba020 bash[25448]: audit 2021-03-10T13:54:50.158807+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:54:51.363 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:51 gibba020 bash[25448]: audit 2021-03-10T13:54:50.160332+0000 mon.a (mon.0) 109 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:54:51.363 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:51 gibba020 bash[25448]: cephadm 2021-03-10T13:54:50.160850+0000 mgr.gibba020.yqfnwy (mgr.34427) 60 : cephadm [INF] Reconfiguring daemon mon.b on gibba020 2021-03-10T13:54:51.363 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:51 gibba020 bash[25448]: audit 2021-03-10T13:54:50.161543+0000 mon.a (mon.0) 110 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:54:51.363 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:51 gibba020 bash[25448]: audit 2021-03-10T13:54:50.163691+0000 mon.a (mon.0) 111 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T13:54:51.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:51 gibba013 bash[29418]: cephadm 2021-03-10T13:54:50.156351+0000 mgr.gibba020.yqfnwy (mgr.34427) 59 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-03-10T13:54:51.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:51 gibba013 bash[29418]: audit 2021-03-10T13:54:50.157837+0000 mon.a (mon.0) 107 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:51.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:51 gibba013 bash[29418]: audit 2021-03-10T13:54:50.158807+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:54:51.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:51 gibba013 bash[29418]: audit 2021-03-10T13:54:50.160332+0000 mon.a (mon.0) 109 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:54:51.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:51 gibba013 bash[29418]: cephadm 2021-03-10T13:54:50.160850+0000 mgr.gibba020.yqfnwy (mgr.34427) 60 : cephadm [INF] Reconfiguring daemon mon.b on gibba020 2021-03-10T13:54:51.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:51 gibba013 bash[29418]: audit 2021-03-10T13:54:50.161543+0000 mon.a (mon.0) 110 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:54:51.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:51 gibba013 bash[29418]: audit 2021-03-10T13:54:50.163691+0000 mon.a (mon.0) 111 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T13:54:51.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:51 gibba013 bash[30381]: cephadm 2021-03-10T13:54:50.156351+0000 mgr.gibba020.yqfnwy (mgr.34427) 59 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-03-10T13:54:51.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:51 gibba013 bash[30381]: audit 2021-03-10T13:54:50.157837+0000 mon.a (mon.0) 107 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:51.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:51 gibba013 bash[30381]: audit 2021-03-10T13:54:50.158807+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T13:54:51.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:51 gibba013 bash[30381]: audit 2021-03-10T13:54:50.160332+0000 mon.a (mon.0) 109 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T13:54:51.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:51 gibba013 bash[30381]: cephadm 2021-03-10T13:54:50.160850+0000 mgr.gibba020.yqfnwy (mgr.34427) 60 : cephadm [INF] Reconfiguring daemon mon.b on gibba020 2021-03-10T13:54:51.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:51 gibba013 bash[30381]: audit 2021-03-10T13:54:50.161543+0000 mon.a (mon.0) 110 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:54:51.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:51 gibba013 bash[30381]: audit 2021-03-10T13:54:50.163691+0000 mon.a (mon.0) 111 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T13:54:52.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:52 gibba020 bash[25448]: cluster 2021-03-10T13:54:50.402540+0000 mgr.gibba020.yqfnwy (mgr.34427) 61 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:52.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:52 gibba020 bash[25448]: audit 2021-03-10T13:54:51.878675+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:52.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:52 gibba020 bash[25448]: audit 2021-03-10T13:54:51.882487+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:54:52.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:52 gibba020 bash[25448]: audit 2021-03-10T13:54:51.885885+0000 mon.a (mon.0) 114 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T13:54:52.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:52 gibba020 bash[25448]: audit 2021-03-10T13:54:51.888943+0000 mon.a (mon.0) 115 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:54:52.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:52 gibba020 bash[25448]: audit 2021-03-10T13:54:51.893018+0000 mon.a (mon.0) 116 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2021-03-10T13:54:52.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:52 gibba013 bash[29418]: cluster 2021-03-10T13:54:50.402540+0000 mgr.gibba020.yqfnwy (mgr.34427) 61 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:52.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:52 gibba013 bash[29418]: audit 2021-03-10T13:54:51.878675+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:52.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:52 gibba013 bash[29418]: audit 2021-03-10T13:54:51.882487+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:54:52.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:52 gibba013 bash[29418]: audit 2021-03-10T13:54:51.885885+0000 mon.a (mon.0) 114 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T13:54:52.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:52 gibba013 bash[29418]: audit 2021-03-10T13:54:51.888943+0000 mon.a (mon.0) 115 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:54:52.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:52 gibba013 bash[29418]: audit 2021-03-10T13:54:51.893018+0000 mon.a (mon.0) 116 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2021-03-10T13:54:52.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:52 gibba013 bash[30381]: cluster 2021-03-10T13:54:50.402540+0000 mgr.gibba020.yqfnwy (mgr.34427) 61 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:52.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:52 gibba013 bash[30381]: audit 2021-03-10T13:54:51.878675+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:52.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:52 gibba013 bash[30381]: audit 2021-03-10T13:54:51.882487+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:54:52.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:52 gibba013 bash[30381]: audit 2021-03-10T13:54:51.885885+0000 mon.a (mon.0) 114 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T13:54:52.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:52 gibba013 bash[30381]: audit 2021-03-10T13:54:51.888943+0000 mon.a (mon.0) 115 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:54:52.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:52 gibba013 bash[30381]: audit 2021-03-10T13:54:51.893018+0000 mon.a (mon.0) 116 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2021-03-10T13:54:53.128 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T13:54:53.386 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:54:53.387 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (82s) 31s ago 6m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T13:54:53.387 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (6m) 15s ago 6m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T13:54:53.387 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (108s) 15s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T13:54:53.388 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2m) 15s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T13:54:53.388 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (63s) 31s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T13:54:53.388 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (54s) 31s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T13:54:53.388 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (26s) 15s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T13:54:53.388 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (37s) 31s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T13:54:53.389 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (6m) 31s ago 6m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T13:54:53.389 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (6m) 15s ago 6m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T13:54:53.389 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (9m) 31s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 bf4441d660ac 2021-03-10T13:54:53.389 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (9m) 31s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 385800e8f97f 2021-03-10T13:54:53.389 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (9m) 31s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d0a99b0fd1fc 2021-03-10T13:54:53.390 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (8m) 31s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d0b507f36a88 2021-03-10T13:54:53.390 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (8m) 15s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5bcc0da1a794 2021-03-10T13:54:53.390 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (8m) 15s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 8e0d292ca03b 2021-03-10T13:54:53.390 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (7m) 15s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b54758e37be1 2021-03-10T13:54:53.391 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (7m) 15s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 75c9ee8106fc 2021-03-10T13:54:53.391 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (6m) 15s ago 6m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T13:54:53.391 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 15s ago 4m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:54:53.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:53 gibba020 bash[25448]: cephadm 2021-03-10T13:54:51.879199+0000 mgr.gibba020.yqfnwy (mgr.34427) 62 : cephadm [INF] Reconfiguring mgr.x (monmap changed)... 2021-03-10T13:54:53.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:53 gibba020 bash[25448]: cephadm 2021-03-10T13:54:51.889290+0000 mgr.gibba020.yqfnwy (mgr.34427) 63 : cephadm [INF] Reconfiguring daemon mgr.x on gibba020 2021-03-10T13:54:53.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:53 gibba013 bash[29418]: cephadm 2021-03-10T13:54:51.879199+0000 mgr.gibba020.yqfnwy (mgr.34427) 62 : cephadm [INF] Reconfiguring mgr.x (monmap changed)... 2021-03-10T13:54:53.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:53 gibba013 bash[29418]: cephadm 2021-03-10T13:54:51.889290+0000 mgr.gibba020.yqfnwy (mgr.34427) 63 : cephadm [INF] Reconfiguring daemon mgr.x on gibba020 2021-03-10T13:54:53.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:53 gibba013 bash[30381]: cephadm 2021-03-10T13:54:51.879199+0000 mgr.gibba020.yqfnwy (mgr.34427) 62 : cephadm [INF] Reconfiguring mgr.x (monmap changed)... 2021-03-10T13:54:53.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:53 gibba013 bash[30381]: cephadm 2021-03-10T13:54:51.889290+0000 mgr.gibba020.yqfnwy (mgr.34427) 63 : cephadm [INF] Reconfiguring daemon mgr.x on gibba020 2021-03-10T13:54:53.648 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T13:54:53.649 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T13:54:53.649 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:54:53.649 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:54:53.649 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T13:54:53.650 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:54:53.650 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:54:53.650 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T13:54:53.650 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2021-03-10T13:54:53.650 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:54:53.651 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T13:54:53.651 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T13:54:53.651 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8, 2021-03-10T13:54:53.651 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 6 2021-03-10T13:54:53.651 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T13:54:53.652 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T13:54:54.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:54 gibba020 bash[25448]: cluster 2021-03-10T13:54:52.404540+0000 mgr.gibba020.yqfnwy (mgr.34427) 64 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:54.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:54 gibba020 bash[25448]: audit 2021-03-10T13:54:53.116790+0000 mgr.gibba020.yqfnwy (mgr.34427) 65 : audit [DBG] from='client.44136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:54:54.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:54 gibba020 bash[25448]: audit 2021-03-10T13:54:53.634376+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:54.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:54 gibba020 bash[25448]: audit 2021-03-10T13:54:53.635432+0000 mon.a (mon.0) 118 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.gibba020.yqfnwy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:54:54.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:54 gibba020 bash[25448]: audit 2021-03-10T13:54:53.636698+0000 mon.a (mon.0) 119 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T13:54:54.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:54 gibba020 bash[25448]: audit 2021-03-10T13:54:53.637771+0000 mon.a (mon.0) 120 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:54:54.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:54 gibba020 bash[25448]: audit 2021-03-10T13:54:53.638738+0000 mon.a (mon.0) 121 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mgr.gibba020.yqfnwy","key": "container_image"}]: dispatch 2021-03-10T13:54:54.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:54 gibba020 bash[25448]: audit 2021-03-10T13:54:53.649640+0000 mon.c (mon.1) 5 : audit [DBG] from='client.? 172.21.2.113:0/1561833647' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:54.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:54 gibba013 bash[29418]: cluster 2021-03-10T13:54:52.404540+0000 mgr.gibba020.yqfnwy (mgr.34427) 64 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:54.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:54 gibba013 bash[29418]: audit 2021-03-10T13:54:53.116790+0000 mgr.gibba020.yqfnwy (mgr.34427) 65 : audit [DBG] from='client.44136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:54:54.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:54 gibba013 bash[29418]: audit 2021-03-10T13:54:53.634376+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:54.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:54 gibba013 bash[29418]: audit 2021-03-10T13:54:53.635432+0000 mon.a (mon.0) 118 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.gibba020.yqfnwy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:54:54.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:54 gibba013 bash[29418]: audit 2021-03-10T13:54:53.636698+0000 mon.a (mon.0) 119 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T13:54:54.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:54 gibba013 bash[29418]: audit 2021-03-10T13:54:53.637771+0000 mon.a (mon.0) 120 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:54:54.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:54 gibba013 bash[29418]: audit 2021-03-10T13:54:53.638738+0000 mon.a (mon.0) 121 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mgr.gibba020.yqfnwy","key": "container_image"}]: dispatch 2021-03-10T13:54:54.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:54 gibba013 bash[29418]: audit 2021-03-10T13:54:53.649640+0000 mon.c (mon.1) 5 : audit [DBG] from='client.? 172.21.2.113:0/1561833647' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:54.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:54 gibba013 bash[30381]: cluster 2021-03-10T13:54:52.404540+0000 mgr.gibba020.yqfnwy (mgr.34427) 64 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:54.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:54 gibba013 bash[30381]: audit 2021-03-10T13:54:53.116790+0000 mgr.gibba020.yqfnwy (mgr.34427) 65 : audit [DBG] from='client.44136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:54:54.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:54 gibba013 bash[30381]: audit 2021-03-10T13:54:53.634376+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:54.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:54 gibba013 bash[30381]: audit 2021-03-10T13:54:53.635432+0000 mon.a (mon.0) 118 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.gibba020.yqfnwy", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T13:54:54.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:54 gibba013 bash[30381]: audit 2021-03-10T13:54:53.636698+0000 mon.a (mon.0) 119 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T13:54:54.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:54 gibba013 bash[30381]: audit 2021-03-10T13:54:53.637771+0000 mon.a (mon.0) 120 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:54:54.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:54 gibba013 bash[30381]: audit 2021-03-10T13:54:53.638738+0000 mon.a (mon.0) 121 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mgr.gibba020.yqfnwy","key": "container_image"}]: dispatch 2021-03-10T13:54:54.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:54 gibba013 bash[30381]: audit 2021-03-10T13:54:53.649640+0000 mon.c (mon.1) 5 : audit [DBG] from='client.? 172.21.2.113:0/1561833647' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:54:55.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:55 gibba020 bash[25448]: audit 2021-03-10T13:54:53.348212+0000 mgr.gibba020.yqfnwy (mgr.34427) 66 : audit [DBG] from='client.44142 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:54:55.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:55 gibba020 bash[25448]: cephadm 2021-03-10T13:54:53.632971+0000 mgr.gibba020.yqfnwy (mgr.34427) 67 : cephadm [INF] Reconfiguring mgr.gibba020.yqfnwy (monmap changed)... 2021-03-10T13:54:55.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:55 gibba020 bash[25448]: cephadm 2021-03-10T13:54:53.636256+0000 mgr.gibba020.yqfnwy (mgr.34427) 68 : cephadm [INF] Reconfiguring daemon mgr.gibba020.yqfnwy on gibba020 2021-03-10T13:54:55.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:55 gibba020 bash[25448]: cluster 2021-03-10T13:54:54.405793+0000 mgr.gibba020.yqfnwy (mgr.34427) 69 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:55.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:55 gibba013 bash[29418]: audit 2021-03-10T13:54:53.348212+0000 mgr.gibba020.yqfnwy (mgr.34427) 66 : audit [DBG] from='client.44142 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:54:55.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:55 gibba013 bash[29418]: cephadm 2021-03-10T13:54:53.632971+0000 mgr.gibba020.yqfnwy (mgr.34427) 67 : cephadm [INF] Reconfiguring mgr.gibba020.yqfnwy (monmap changed)... 2021-03-10T13:54:55.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:55 gibba013 bash[29418]: cephadm 2021-03-10T13:54:53.636256+0000 mgr.gibba020.yqfnwy (mgr.34427) 68 : cephadm [INF] Reconfiguring daemon mgr.gibba020.yqfnwy on gibba020 2021-03-10T13:54:55.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:55 gibba013 bash[29418]: cluster 2021-03-10T13:54:54.405793+0000 mgr.gibba020.yqfnwy (mgr.34427) 69 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:55.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:55 gibba013 bash[30381]: audit 2021-03-10T13:54:53.348212+0000 mgr.gibba020.yqfnwy (mgr.34427) 66 : audit [DBG] from='client.44142 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:54:55.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:55 gibba013 bash[30381]: cephadm 2021-03-10T13:54:53.632971+0000 mgr.gibba020.yqfnwy (mgr.34427) 67 : cephadm [INF] Reconfiguring mgr.gibba020.yqfnwy (monmap changed)... 2021-03-10T13:54:55.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:55 gibba013 bash[30381]: cephadm 2021-03-10T13:54:53.636256+0000 mgr.gibba020.yqfnwy (mgr.34427) 68 : cephadm [INF] Reconfiguring daemon mgr.gibba020.yqfnwy on gibba020 2021-03-10T13:54:55.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:55 gibba013 bash[30381]: cluster 2021-03-10T13:54:54.405793+0000 mgr.gibba020.yqfnwy (mgr.34427) 69 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:56.828 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:56 gibba020 bash[25448]: cephadm 2021-03-10T13:54:55.517253+0000 mgr.gibba020.yqfnwy (mgr.34427) 70 : cephadm [INF] Reconfiguring osd.4 (monmap changed)... 2021-03-10T13:54:56.829 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:56 gibba020 bash[25448]: cephadm 2021-03-10T13:54:55.517787+0000 mgr.gibba020.yqfnwy (mgr.34427) 71 : cephadm [INF] Reconfiguring daemon osd.4 on gibba020 2021-03-10T13:54:56.829 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:56 gibba020 bash[25448]: audit 2021-03-10T13:54:55.518550+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:56.829 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:56 gibba020 bash[25448]: audit 2021-03-10T13:54:55.520499+0000 mon.a (mon.0) 123 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2021-03-10T13:54:56.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:56 gibba013 bash[29418]: cephadm 2021-03-10T13:54:55.517253+0000 mgr.gibba020.yqfnwy (mgr.34427) 70 : cephadm [INF] Reconfiguring osd.4 (monmap changed)... 2021-03-10T13:54:56.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:56 gibba013 bash[29418]: cephadm 2021-03-10T13:54:55.517787+0000 mgr.gibba020.yqfnwy (mgr.34427) 71 : cephadm [INF] Reconfiguring daemon osd.4 on gibba020 2021-03-10T13:54:56.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:56 gibba013 bash[29418]: audit 2021-03-10T13:54:55.518550+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:56.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:56 gibba013 bash[29418]: audit 2021-03-10T13:54:55.520499+0000 mon.a (mon.0) 123 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2021-03-10T13:54:56.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:56 gibba013 bash[30381]: cephadm 2021-03-10T13:54:55.517253+0000 mgr.gibba020.yqfnwy (mgr.34427) 70 : cephadm [INF] Reconfiguring osd.4 (monmap changed)... 2021-03-10T13:54:56.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:56 gibba013 bash[30381]: cephadm 2021-03-10T13:54:55.517787+0000 mgr.gibba020.yqfnwy (mgr.34427) 71 : cephadm [INF] Reconfiguring daemon osd.4 on gibba020 2021-03-10T13:54:56.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:56 gibba013 bash[30381]: audit 2021-03-10T13:54:55.518550+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:56.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:56 gibba013 bash[30381]: audit 2021-03-10T13:54:55.520499+0000 mon.a (mon.0) 123 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2021-03-10T13:54:57.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:57 gibba020 bash[25448]: cluster 2021-03-10T13:54:56.406877+0000 mgr.gibba020.yqfnwy (mgr.34427) 72 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:57.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:57 gibba020 bash[25448]: audit 2021-03-10T13:54:57.265367+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:57.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:57 gibba020 bash[25448]: audit 2021-03-10T13:54:57.266939+0000 mon.a (mon.0) 125 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2021-03-10T13:54:57.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:57 gibba013 bash[29418]: cluster 2021-03-10T13:54:56.406877+0000 mgr.gibba020.yqfnwy (mgr.34427) 72 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:57.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:57 gibba013 bash[29418]: audit 2021-03-10T13:54:57.265367+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:57.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:57 gibba013 bash[29418]: audit 2021-03-10T13:54:57.266939+0000 mon.a (mon.0) 125 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2021-03-10T13:54:57.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:57 gibba013 bash[30381]: cluster 2021-03-10T13:54:56.406877+0000 mgr.gibba020.yqfnwy (mgr.34427) 72 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:54:57.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:57 gibba013 bash[30381]: audit 2021-03-10T13:54:57.265367+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:54:57.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:57 gibba013 bash[30381]: audit 2021-03-10T13:54:57.266939+0000 mon.a (mon.0) 125 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2021-03-10T13:54:58.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:58 gibba013 bash[29418]: cephadm 2021-03-10T13:54:57.263990+0000 mgr.gibba020.yqfnwy (mgr.34427) 73 : cephadm [INF] Reconfiguring osd.5 (monmap changed)... 2021-03-10T13:54:58.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:58 gibba013 bash[29418]: cephadm 2021-03-10T13:54:57.264449+0000 mgr.gibba020.yqfnwy (mgr.34427) 74 : cephadm [INF] Reconfiguring daemon osd.5 on gibba020 2021-03-10T13:54:58.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:58 gibba013 bash[30381]: cephadm 2021-03-10T13:54:57.263990+0000 mgr.gibba020.yqfnwy (mgr.34427) 73 : cephadm [INF] Reconfiguring osd.5 (monmap changed)... 2021-03-10T13:54:58.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:58 gibba013 bash[30381]: cephadm 2021-03-10T13:54:57.264449+0000 mgr.gibba020.yqfnwy (mgr.34427) 74 : cephadm [INF] Reconfiguring daemon osd.5 on gibba020 2021-03-10T13:54:58.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:58 gibba020 bash[25448]: cephadm 2021-03-10T13:54:57.263990+0000 mgr.gibba020.yqfnwy (mgr.34427) 73 : cephadm [INF] Reconfiguring osd.5 (monmap changed)... 2021-03-10T13:54:58.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:58 gibba020 bash[25448]: cephadm 2021-03-10T13:54:57.264449+0000 mgr.gibba020.yqfnwy (mgr.34427) 74 : cephadm [INF] Reconfiguring daemon osd.5 on gibba020 2021-03-10T13:55:00.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:59 gibba013 bash[29418]: cluster 2021-03-10T13:54:58.409048+0000 mgr.gibba020.yqfnwy (mgr.34427) 75 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:55:00.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:59 gibba013 bash[29418]: cephadm 2021-03-10T13:54:58.982783+0000 mgr.gibba020.yqfnwy (mgr.34427) 76 : cephadm [INF] Reconfiguring osd.6 (monmap changed)... 2021-03-10T13:55:00.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:59 gibba013 bash[29418]: cephadm 2021-03-10T13:54:58.983230+0000 mgr.gibba020.yqfnwy (mgr.34427) 77 : cephadm [INF] Reconfiguring daemon osd.6 on gibba020 2021-03-10T13:55:00.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:59 gibba013 bash[29418]: audit 2021-03-10T13:54:58.983776+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:00.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:54:59 gibba013 bash[29418]: audit 2021-03-10T13:54:58.985668+0000 mon.a (mon.0) 127 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2021-03-10T13:55:00.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:59 gibba013 bash[30381]: cluster 2021-03-10T13:54:58.409048+0000 mgr.gibba020.yqfnwy (mgr.34427) 75 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:55:00.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:59 gibba013 bash[30381]: cephadm 2021-03-10T13:54:58.982783+0000 mgr.gibba020.yqfnwy (mgr.34427) 76 : cephadm [INF] Reconfiguring osd.6 (monmap changed)... 2021-03-10T13:55:00.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:59 gibba013 bash[30381]: cephadm 2021-03-10T13:54:58.983230+0000 mgr.gibba020.yqfnwy (mgr.34427) 77 : cephadm [INF] Reconfiguring daemon osd.6 on gibba020 2021-03-10T13:55:00.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:59 gibba013 bash[30381]: audit 2021-03-10T13:54:58.983776+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:00.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:54:59 gibba013 bash[30381]: audit 2021-03-10T13:54:58.985668+0000 mon.a (mon.0) 127 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2021-03-10T13:55:00.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:59 gibba020 bash[25448]: cluster 2021-03-10T13:54:58.409048+0000 mgr.gibba020.yqfnwy (mgr.34427) 75 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:55:00.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:59 gibba020 bash[25448]: cephadm 2021-03-10T13:54:58.982783+0000 mgr.gibba020.yqfnwy (mgr.34427) 76 : cephadm [INF] Reconfiguring osd.6 (monmap changed)... 2021-03-10T13:55:00.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:59 gibba020 bash[25448]: cephadm 2021-03-10T13:54:58.983230+0000 mgr.gibba020.yqfnwy (mgr.34427) 77 : cephadm [INF] Reconfiguring daemon osd.6 on gibba020 2021-03-10T13:55:00.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:59 gibba020 bash[25448]: audit 2021-03-10T13:54:58.983776+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:00.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:54:59 gibba020 bash[25448]: audit 2021-03-10T13:54:58.985668+0000 mon.a (mon.0) 127 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2021-03-10T13:55:01.912 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:01 gibba020 bash[25448]: cluster 2021-03-10T13:55:00.409993+0000 mgr.gibba020.yqfnwy (mgr.34427) 78 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:55:01.913 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:01 gibba020 bash[25448]: cephadm 2021-03-10T13:55:00.713598+0000 mgr.gibba020.yqfnwy (mgr.34427) 79 : cephadm [INF] Reconfiguring osd.7 (monmap changed)... 2021-03-10T13:55:01.913 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:01 gibba020 bash[25448]: cephadm 2021-03-10T13:55:00.714069+0000 mgr.gibba020.yqfnwy (mgr.34427) 80 : cephadm [INF] Reconfiguring daemon osd.7 on gibba020 2021-03-10T13:55:01.913 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:01 gibba020 bash[25448]: audit 2021-03-10T13:55:00.714841+0000 mon.a (mon.0) 128 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:01.913 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:01 gibba020 bash[25448]: audit 2021-03-10T13:55:00.716668+0000 mon.a (mon.0) 129 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2021-03-10T13:55:02.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:01 gibba013 bash[29418]: cluster 2021-03-10T13:55:00.409993+0000 mgr.gibba020.yqfnwy (mgr.34427) 78 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:55:02.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:01 gibba013 bash[29418]: cephadm 2021-03-10T13:55:00.713598+0000 mgr.gibba020.yqfnwy (mgr.34427) 79 : cephadm [INF] Reconfiguring osd.7 (monmap changed)... 2021-03-10T13:55:02.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:01 gibba013 bash[29418]: cephadm 2021-03-10T13:55:00.714069+0000 mgr.gibba020.yqfnwy (mgr.34427) 80 : cephadm [INF] Reconfiguring daemon osd.7 on gibba020 2021-03-10T13:55:02.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:01 gibba013 bash[29418]: audit 2021-03-10T13:55:00.714841+0000 mon.a (mon.0) 128 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:02.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:01 gibba013 bash[29418]: audit 2021-03-10T13:55:00.716668+0000 mon.a (mon.0) 129 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2021-03-10T13:55:02.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:01 gibba013 bash[30381]: cluster 2021-03-10T13:55:00.409993+0000 mgr.gibba020.yqfnwy (mgr.34427) 78 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:55:02.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:01 gibba013 bash[30381]: cephadm 2021-03-10T13:55:00.713598+0000 mgr.gibba020.yqfnwy (mgr.34427) 79 : cephadm [INF] Reconfiguring osd.7 (monmap changed)... 2021-03-10T13:55:02.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:01 gibba013 bash[30381]: cephadm 2021-03-10T13:55:00.714069+0000 mgr.gibba020.yqfnwy (mgr.34427) 80 : cephadm [INF] Reconfiguring daemon osd.7 on gibba020 2021-03-10T13:55:02.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:01 gibba013 bash[30381]: audit 2021-03-10T13:55:00.714841+0000 mon.a (mon.0) 128 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:02.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:01 gibba013 bash[30381]: audit 2021-03-10T13:55:00.716668+0000 mon.a (mon.0) 129 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2021-03-10T13:55:03.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:03 gibba020 bash[25448]: cluster 2021-03-10T13:55:02.410649+0000 mgr.gibba020.yqfnwy (mgr.34427) 81 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:55:03.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:03 gibba020 bash[25448]: cephadm 2021-03-10T13:55:02.437999+0000 mgr.gibba020.yqfnwy (mgr.34427) 82 : cephadm [INF] Reconfiguring rgw.r.z.gibba020.txcybs (monmap changed)... 2021-03-10T13:55:03.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:03 gibba020 bash[25448]: audit 2021-03-10T13:55:02.438724+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:03.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:03 gibba020 bash[25448]: audit 2021-03-10T13:55:02.440497+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba020.txcybs", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-03-10T13:55:03.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:03 gibba020 bash[25448]: audit 2021-03-10T13:55:02.442494+0000 mon.a (mon.0) 132 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.gibba020.txcybs"}]: dispatch 2021-03-10T13:55:03.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:03 gibba020 bash[25448]: cephadm 2021-03-10T13:55:02.443240+0000 mgr.gibba020.yqfnwy (mgr.34427) 83 : cephadm [INF] Reconfiguring daemon rgw.r.z.gibba020.txcybs on gibba020 2021-03-10T13:55:03.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:03 gibba020 bash[25448]: audit 2021-03-10T13:55:02.444107+0000 mon.a (mon.0) 133 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:55:03.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:03 gibba020 bash[25448]: audit 2021-03-10T13:55:02.445864+0000 mon.a (mon.0) 134 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "client.rgw.r.z.gibba020.txcybs","key": "container_image"}]: dispatch 2021-03-10T13:55:03.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:03 gibba013 bash[29418]: cluster 2021-03-10T13:55:02.410649+0000 mgr.gibba020.yqfnwy (mgr.34427) 81 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:55:03.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:03 gibba013 bash[29418]: cephadm 2021-03-10T13:55:02.437999+0000 mgr.gibba020.yqfnwy (mgr.34427) 82 : cephadm [INF] Reconfiguring rgw.r.z.gibba020.txcybs (monmap changed)... 2021-03-10T13:55:03.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:03 gibba013 bash[29418]: audit 2021-03-10T13:55:02.438724+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:03.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:03 gibba013 bash[29418]: audit 2021-03-10T13:55:02.440497+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba020.txcybs", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-03-10T13:55:03.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:03 gibba013 bash[29418]: audit 2021-03-10T13:55:02.442494+0000 mon.a (mon.0) 132 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.gibba020.txcybs"}]: dispatch 2021-03-10T13:55:03.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:03 gibba013 bash[29418]: cephadm 2021-03-10T13:55:02.443240+0000 mgr.gibba020.yqfnwy (mgr.34427) 83 : cephadm [INF] Reconfiguring daemon rgw.r.z.gibba020.txcybs on gibba020 2021-03-10T13:55:03.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:03 gibba013 bash[29418]: audit 2021-03-10T13:55:02.444107+0000 mon.a (mon.0) 133 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:55:03.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:03 gibba013 bash[29418]: audit 2021-03-10T13:55:02.445864+0000 mon.a (mon.0) 134 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "client.rgw.r.z.gibba020.txcybs","key": "container_image"}]: dispatch 2021-03-10T13:55:03.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:03 gibba013 bash[30381]: cluster 2021-03-10T13:55:02.410649+0000 mgr.gibba020.yqfnwy (mgr.34427) 81 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:55:03.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:03 gibba013 bash[30381]: cephadm 2021-03-10T13:55:02.437999+0000 mgr.gibba020.yqfnwy (mgr.34427) 82 : cephadm [INF] Reconfiguring rgw.r.z.gibba020.txcybs (monmap changed)... 2021-03-10T13:55:03.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:03 gibba013 bash[30381]: audit 2021-03-10T13:55:02.438724+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:03.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:03 gibba013 bash[30381]: audit 2021-03-10T13:55:02.440497+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba020.txcybs", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-03-10T13:55:03.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:03 gibba013 bash[30381]: audit 2021-03-10T13:55:02.442494+0000 mon.a (mon.0) 132 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.gibba020.txcybs"}]: dispatch 2021-03-10T13:55:03.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:03 gibba013 bash[30381]: cephadm 2021-03-10T13:55:02.443240+0000 mgr.gibba020.yqfnwy (mgr.34427) 83 : cephadm [INF] Reconfiguring daemon rgw.r.z.gibba020.txcybs on gibba020 2021-03-10T13:55:03.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:03 gibba013 bash[30381]: audit 2021-03-10T13:55:02.444107+0000 mon.a (mon.0) 133 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T13:55:03.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:03 gibba013 bash[30381]: audit 2021-03-10T13:55:02.445864+0000 mon.a (mon.0) 134 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "client.rgw.r.z.gibba020.txcybs","key": "container_image"}]: dispatch 2021-03-10T13:55:05.480 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[29418]: cephadm 2021-03-10T13:55:04.225076+0000 mgr.gibba020.yqfnwy (mgr.34427) 84 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:55:05.481 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[29418]: audit 2021-03-10T13:55:04.226325+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:05.481 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[29418]: cephadm 2021-03-10T13:55:04.227353+0000 mgr.gibba020.yqfnwy (mgr.34427) 85 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:55:05.481 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[29418]: audit 2021-03-10T13:55:04.227789+0000 mon.a (mon.0) 136 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:55:05.481 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[29418]: cephadm 2021-03-10T13:55:04.228840+0000 mgr.gibba020.yqfnwy (mgr.34427) 86 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:55:05.482 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[29418]: cephadm 2021-03-10T13:55:04.228885+0000 mgr.gibba020.yqfnwy (mgr.34427) 87 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:55:05.482 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[29418]: audit 2021-03-10T13:55:04.229909+0000 mon.a (mon.0) 137 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:05.482 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[29418]: cephadm 2021-03-10T13:55:04.230725+0000 mgr.gibba020.yqfnwy (mgr.34427) 88 : cephadm [INF] Upgrade: Setting container_image for all mon 2021-03-10T13:55:05.482 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[29418]: audit 2021-03-10T13:55:04.231380+0000 mon.a (mon.0) 138 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:05.483 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[29418]: audit 2021-03-10T13:55:04.236986+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:05.483 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[29418]: audit 2021-03-10T13:55:04.238077+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2021-03-10T13:55:05.483 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[29418]: audit 2021-03-10T13:55:04.240881+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2021-03-10T13:55:05.483 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[29418]: audit 2021-03-10T13:55:04.241740+0000 mon.a (mon.0) 142 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2021-03-10T13:55:05.484 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[29418]: audit 2021-03-10T13:55:04.244689+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2021-03-10T13:55:05.484 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[29418]: audit 2021-03-10T13:55:04.245656+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2021-03-10T13:55:05.484 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[29418]: cephadm 2021-03-10T13:55:04.247306+0000 mgr.gibba020.yqfnwy (mgr.34427) 89 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:55:05.484 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[29418]: cephadm 2021-03-10T13:55:04.247372+0000 mgr.gibba020.yqfnwy (mgr.34427) 90 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:55:05.484 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[29418]: audit 2021-03-10T13:55:04.248602+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2021-03-10T13:55:05.485 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[30381]: cephadm 2021-03-10T13:55:04.225076+0000 mgr.gibba020.yqfnwy (mgr.34427) 84 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:55:05.485 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[30381]: audit 2021-03-10T13:55:04.226325+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:05.485 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[30381]: cephadm 2021-03-10T13:55:04.227353+0000 mgr.gibba020.yqfnwy (mgr.34427) 85 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:55:05.485 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[30381]: audit 2021-03-10T13:55:04.227789+0000 mon.a (mon.0) 136 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:55:05.486 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[30381]: cephadm 2021-03-10T13:55:04.228840+0000 mgr.gibba020.yqfnwy (mgr.34427) 86 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:55:05.486 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[30381]: cephadm 2021-03-10T13:55:04.228885+0000 mgr.gibba020.yqfnwy (mgr.34427) 87 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:55:05.486 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[30381]: audit 2021-03-10T13:55:04.229909+0000 mon.a (mon.0) 137 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:05.486 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[30381]: cephadm 2021-03-10T13:55:04.230725+0000 mgr.gibba020.yqfnwy (mgr.34427) 88 : cephadm [INF] Upgrade: Setting container_image for all mon 2021-03-10T13:55:05.486 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[30381]: audit 2021-03-10T13:55:04.231380+0000 mon.a (mon.0) 138 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:05.487 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[30381]: audit 2021-03-10T13:55:04.236986+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:05.487 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[30381]: audit 2021-03-10T13:55:04.238077+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2021-03-10T13:55:05.487 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[30381]: audit 2021-03-10T13:55:04.240881+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2021-03-10T13:55:05.487 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[30381]: audit 2021-03-10T13:55:04.241740+0000 mon.a (mon.0) 142 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2021-03-10T13:55:05.487 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[30381]: audit 2021-03-10T13:55:04.244689+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2021-03-10T13:55:05.488 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[30381]: audit 2021-03-10T13:55:04.245656+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2021-03-10T13:55:05.488 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[30381]: cephadm 2021-03-10T13:55:04.247306+0000 mgr.gibba020.yqfnwy (mgr.34427) 89 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:55:05.488 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[30381]: cephadm 2021-03-10T13:55:04.247372+0000 mgr.gibba020.yqfnwy (mgr.34427) 90 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:55:05.488 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[30381]: audit 2021-03-10T13:55:04.248602+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2021-03-10T13:55:05.489 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[29418]: cephadm 2021-03-10T13:55:04.248642+0000 mgr.gibba020.yqfnwy (mgr.34427) 91 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:55:05.489 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[29418]: audit 2021-03-10T13:55:04.249691+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:05.489 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[29418]: cephadm 2021-03-10T13:55:04.253114+0000 mgr.gibba020.yqfnwy (mgr.34427) 92 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:55:05.489 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[29418]: cephadm 2021-03-10T13:55:04.253189+0000 mgr.gibba020.yqfnwy (mgr.34427) 93 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:55:05.490 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[29418]: audit 2021-03-10T13:55:04.254050+0000 mgr.gibba020.yqfnwy (mgr.34427) 94 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2021-03-10T13:55:05.490 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[29418]: audit 2021-03-10T13:55:04.254281+0000 mon.a (mon.0) 147 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:05.490 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[29418]: cephadm 2021-03-10T13:55:04.255522+0000 mgr.gibba020.yqfnwy (mgr.34427) 95 : cephadm [INF] Upgrade: osd.0 is safe to restart 2021-03-10T13:55:05.490 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[29418]: audit 2021-03-10T13:55:04.255884+0000 mon.a (mon.0) 148 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2021-03-10T13:55:05.490 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[29418]: cluster 2021-03-10T13:55:04.411836+0000 mgr.gibba020.yqfnwy (mgr.34427) 96 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:55:05.491 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[30381]: cephadm 2021-03-10T13:55:04.248642+0000 mgr.gibba020.yqfnwy (mgr.34427) 91 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:55:05.491 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[30381]: audit 2021-03-10T13:55:04.249691+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:05.491 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[30381]: cephadm 2021-03-10T13:55:04.253114+0000 mgr.gibba020.yqfnwy (mgr.34427) 92 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:55:05.491 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[30381]: cephadm 2021-03-10T13:55:04.253189+0000 mgr.gibba020.yqfnwy (mgr.34427) 93 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:55:05.492 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[30381]: audit 2021-03-10T13:55:04.254050+0000 mgr.gibba020.yqfnwy (mgr.34427) 94 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2021-03-10T13:55:05.492 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[30381]: audit 2021-03-10T13:55:04.254281+0000 mon.a (mon.0) 147 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:05.492 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[30381]: cephadm 2021-03-10T13:55:04.255522+0000 mgr.gibba020.yqfnwy (mgr.34427) 95 : cephadm [INF] Upgrade: osd.0 is safe to restart 2021-03-10T13:55:05.492 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[30381]: audit 2021-03-10T13:55:04.255884+0000 mon.a (mon.0) 148 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2021-03-10T13:55:05.492 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:05 gibba013 bash[30381]: cluster 2021-03-10T13:55:04.411836+0000 mgr.gibba020.yqfnwy (mgr.34427) 96 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:55:05.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:05 gibba020 bash[25448]: cephadm 2021-03-10T13:55:04.225076+0000 mgr.gibba020.yqfnwy (mgr.34427) 84 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:55:05.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:05 gibba020 bash[25448]: audit 2021-03-10T13:55:04.226325+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:05.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:05 gibba020 bash[25448]: cephadm 2021-03-10T13:55:04.227353+0000 mgr.gibba020.yqfnwy (mgr.34427) 85 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:55:05.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:05 gibba020 bash[25448]: audit 2021-03-10T13:55:04.227789+0000 mon.a (mon.0) 136 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:55:05.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:05 gibba020 bash[25448]: cephadm 2021-03-10T13:55:04.228840+0000 mgr.gibba020.yqfnwy (mgr.34427) 86 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:55:05.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:05 gibba020 bash[25448]: cephadm 2021-03-10T13:55:04.228885+0000 mgr.gibba020.yqfnwy (mgr.34427) 87 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:55:05.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:05 gibba020 bash[25448]: audit 2021-03-10T13:55:04.229909+0000 mon.a (mon.0) 137 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:05.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:05 gibba020 bash[25448]: cephadm 2021-03-10T13:55:04.230725+0000 mgr.gibba020.yqfnwy (mgr.34427) 88 : cephadm [INF] Upgrade: Setting container_image for all mon 2021-03-10T13:55:05.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:05 gibba020 bash[25448]: audit 2021-03-10T13:55:04.231380+0000 mon.a (mon.0) 138 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:05.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:05 gibba020 bash[25448]: audit 2021-03-10T13:55:04.236986+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:05.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:05 gibba020 bash[25448]: audit 2021-03-10T13:55:04.238077+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2021-03-10T13:55:05.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:05 gibba020 bash[25448]: audit 2021-03-10T13:55:04.240881+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2021-03-10T13:55:05.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:05 gibba020 bash[25448]: audit 2021-03-10T13:55:04.241740+0000 mon.a (mon.0) 142 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2021-03-10T13:55:05.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:05 gibba020 bash[25448]: audit 2021-03-10T13:55:04.244689+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2021-03-10T13:55:05.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:05 gibba020 bash[25448]: audit 2021-03-10T13:55:04.245656+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2021-03-10T13:55:05.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:05 gibba020 bash[25448]: cephadm 2021-03-10T13:55:04.247306+0000 mgr.gibba020.yqfnwy (mgr.34427) 89 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:55:05.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:05 gibba020 bash[25448]: cephadm 2021-03-10T13:55:04.247372+0000 mgr.gibba020.yqfnwy (mgr.34427) 90 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:55:05.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:05 gibba020 bash[25448]: audit 2021-03-10T13:55:04.248602+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2021-03-10T13:55:05.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:05 gibba020 bash[25448]: cephadm 2021-03-10T13:55:04.248642+0000 mgr.gibba020.yqfnwy (mgr.34427) 91 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:55:05.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:05 gibba020 bash[25448]: audit 2021-03-10T13:55:04.249691+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:05.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:05 gibba020 bash[25448]: cephadm 2021-03-10T13:55:04.253114+0000 mgr.gibba020.yqfnwy (mgr.34427) 92 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:55:05.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:05 gibba020 bash[25448]: cephadm 2021-03-10T13:55:04.253189+0000 mgr.gibba020.yqfnwy (mgr.34427) 93 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:55:05.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:05 gibba020 bash[25448]: audit 2021-03-10T13:55:04.254050+0000 mgr.gibba020.yqfnwy (mgr.34427) 94 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2021-03-10T13:55:05.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:05 gibba020 bash[25448]: audit 2021-03-10T13:55:04.254281+0000 mon.a (mon.0) 147 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:05.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:05 gibba020 bash[25448]: cephadm 2021-03-10T13:55:04.255522+0000 mgr.gibba020.yqfnwy (mgr.34427) 95 : cephadm [INF] Upgrade: osd.0 is safe to restart 2021-03-10T13:55:05.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:05 gibba020 bash[25448]: audit 2021-03-10T13:55:04.255884+0000 mon.a (mon.0) 148 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2021-03-10T13:55:05.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:05 gibba020 bash[25448]: cluster 2021-03-10T13:55:04.411836+0000 mgr.gibba020.yqfnwy (mgr.34427) 96 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:55:06.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:06 gibba013 bash[29418]: audit 2021-03-10T13:55:05.737448+0000 mon.a (mon.0) 149 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T13:55:06.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:06 gibba013 bash[29418]: audit 2021-03-10T13:55:05.738302+0000 mon.a (mon.0) 150 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T13:55:06.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:06 gibba013 bash[29418]: audit 2021-03-10T13:55:05.738966+0000 mon.a (mon.0) 151 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T13:55:06.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:06 gibba013 bash[29418]: audit 2021-03-10T13:55:05.739620+0000 mon.a (mon.0) 152 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T13:55:06.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:06 gibba013 bash[29418]: audit 2021-03-10T13:55:05.842968+0000 mon.a (mon.0) 153 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:55:06.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:06 gibba013 bash[29418]: audit 2021-03-10T13:55:05.848448+0000 mon.a (mon.0) 154 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T13:55:06.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:06 gibba013 bash[29418]: cephadm 2021-03-10T13:55:06.053317+0000 mgr.gibba020.yqfnwy (mgr.34427) 97 : cephadm [INF] Upgrade: Updating osd.0 2021-03-10T13:55:06.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:06 gibba013 bash[29418]: audit 2021-03-10T13:55:06.061053+0000 mon.a (mon.0) 155 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:06.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:06 gibba013 bash[29418]: cephadm 2021-03-10T13:55:06.063361+0000 mgr.gibba020.yqfnwy (mgr.34427) 98 : cephadm [INF] Deploying daemon osd.0 on gibba013 2021-03-10T13:55:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:06 gibba013 bash[29418]: audit 2021-03-10T13:55:06.066359+0000 mon.a (mon.0) 156 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2021-03-10T13:55:06.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:06 gibba013 bash[30381]: audit 2021-03-10T13:55:05.737448+0000 mon.a (mon.0) 149 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T13:55:06.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:06 gibba013 bash[30381]: audit 2021-03-10T13:55:05.738302+0000 mon.a (mon.0) 150 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T13:55:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:06 gibba013 bash[30381]: audit 2021-03-10T13:55:05.738966+0000 mon.a (mon.0) 151 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T13:55:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:06 gibba013 bash[30381]: audit 2021-03-10T13:55:05.739620+0000 mon.a (mon.0) 152 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T13:55:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:06 gibba013 bash[30381]: audit 2021-03-10T13:55:05.842968+0000 mon.a (mon.0) 153 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:55:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:06 gibba013 bash[30381]: audit 2021-03-10T13:55:05.848448+0000 mon.a (mon.0) 154 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T13:55:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:06 gibba013 bash[30381]: cephadm 2021-03-10T13:55:06.053317+0000 mgr.gibba020.yqfnwy (mgr.34427) 97 : cephadm [INF] Upgrade: Updating osd.0 2021-03-10T13:55:06.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:06 gibba013 bash[30381]: audit 2021-03-10T13:55:06.061053+0000 mon.a (mon.0) 155 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:06.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:06 gibba013 bash[30381]: cephadm 2021-03-10T13:55:06.063361+0000 mgr.gibba020.yqfnwy (mgr.34427) 98 : cephadm [INF] Deploying daemon osd.0 on gibba013 2021-03-10T13:55:06.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:06 gibba013 bash[30381]: audit 2021-03-10T13:55:06.066359+0000 mon.a (mon.0) 156 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2021-03-10T13:55:06.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:06 gibba020 bash[25448]: audit 2021-03-10T13:55:05.737448+0000 mon.a (mon.0) 149 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T13:55:06.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:06 gibba020 bash[25448]: audit 2021-03-10T13:55:05.738302+0000 mon.a (mon.0) 150 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T13:55:06.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:06 gibba020 bash[25448]: audit 2021-03-10T13:55:05.738966+0000 mon.a (mon.0) 151 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T13:55:06.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:06 gibba020 bash[25448]: audit 2021-03-10T13:55:05.739620+0000 mon.a (mon.0) 152 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T13:55:06.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:06 gibba020 bash[25448]: audit 2021-03-10T13:55:05.842968+0000 mon.a (mon.0) 153 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:55:06.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:06 gibba020 bash[25448]: audit 2021-03-10T13:55:05.848448+0000 mon.a (mon.0) 154 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T13:55:06.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:06 gibba020 bash[25448]: cephadm 2021-03-10T13:55:06.053317+0000 mgr.gibba020.yqfnwy (mgr.34427) 97 : cephadm [INF] Upgrade: Updating osd.0 2021-03-10T13:55:06.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:06 gibba020 bash[25448]: audit 2021-03-10T13:55:06.061053+0000 mon.a (mon.0) 155 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:06.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:06 gibba020 bash[25448]: cephadm 2021-03-10T13:55:06.063361+0000 mgr.gibba020.yqfnwy (mgr.34427) 98 : cephadm [INF] Deploying daemon osd.0 on gibba013 2021-03-10T13:55:06.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:06 gibba020 bash[25448]: audit 2021-03-10T13:55:06.066359+0000 mon.a (mon.0) 156 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2021-03-10T13:55:07.317 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:07 gibba013 bash[30381]: cluster 2021-03-10T13:55:06.413302+0000 mgr.gibba020.yqfnwy (mgr.34427) 99 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:55:07.318 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:07 gibba013 bash[29418]: cluster 2021-03-10T13:55:06.413302+0000 mgr.gibba020.yqfnwy (mgr.34427) 99 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:55:07.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:07 gibba020 bash[25448]: cluster 2021-03-10T13:55:06.413302+0000 mgr.gibba020.yqfnwy (mgr.34427) 99 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:55:08.063 INFO:journalctl@ceph.osd.0.gibba013.stdout:Mar 10 13:55:07 gibba013 systemd[1]: Stopping Ceph osd.0 for 7672acc8-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:55:08.063 INFO:journalctl@ceph.osd.0.gibba013.stdout:Mar 10 13:55:07 gibba013 bash[14934]: debug 2021-03-10T13:55:07.945+0000 7f1956ceb700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T13:55:08.063 INFO:journalctl@ceph.osd.0.gibba013.stdout:Mar 10 13:55:07 gibba013 bash[14934]: debug 2021-03-10T13:55:07.945+0000 7f1956ceb700 -1 osd.0 62 *** Got signal Terminated *** 2021-03-10T13:55:08.064 INFO:journalctl@ceph.osd.0.gibba013.stdout:Mar 10 13:55:07 gibba013 bash[14934]: debug 2021-03-10T13:55:07.945+0000 7f1956ceb700 -1 osd.0 62 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-03-10T13:55:08.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[29418]: cluster 2021-03-10T13:55:08.045391+0000 mon.a (mon.0) 157 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T13:55:08.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[29418]: cluster 2021-03-10T13:55:08.045429+0000 mon.a (mon.0) 158 : cluster [INF] osd.0 failed (root=default,host=gibba013) (connection refused reported by osd.6) 2021-03-10T13:55:08.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[29418]: cluster 2021-03-10T13:55:08.045684+0000 mon.a (mon.0) 159 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T13:55:08.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[29418]: cluster 2021-03-10T13:55:08.045848+0000 mon.a (mon.0) 160 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T13:55:08.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[29418]: cluster 2021-03-10T13:55:08.045908+0000 mon.a (mon.0) 161 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T13:55:08.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[29418]: cluster 2021-03-10T13:55:08.045957+0000 mon.a (mon.0) 162 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T13:55:08.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[29418]: cluster 2021-03-10T13:55:08.046050+0000 mon.a (mon.0) 163 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T13:55:08.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[29418]: cluster 2021-03-10T13:55:08.245714+0000 mon.a (mon.0) 164 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T13:55:08.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[29418]: cluster 2021-03-10T13:55:08.246354+0000 mon.a (mon.0) 165 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T13:55:08.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[29418]: cluster 2021-03-10T13:55:08.246571+0000 mon.a (mon.0) 166 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T13:55:08.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[29418]: cluster 2021-03-10T13:55:08.247122+0000 mon.a (mon.0) 167 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T13:55:08.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[29418]: cluster 2021-03-10T13:55:08.247316+0000 mon.a (mon.0) 168 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T13:55:08.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[29418]: cluster 2021-03-10T13:55:08.247708+0000 mon.a (mon.0) 169 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T13:55:08.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[29418]: cluster 2021-03-10T13:55:08.247886+0000 mon.a (mon.0) 170 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T13:55:08.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[29418]: cluster 2021-03-10T13:55:08.248424+0000 mon.a (mon.0) 171 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T13:55:08.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[29418]: cluster 2021-03-10T13:55:08.248818+0000 mon.a (mon.0) 172 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T13:55:08.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[29418]: cluster 2021-03-10T13:55:08.249123+0000 mon.a (mon.0) 173 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T13:55:08.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[29418]: cluster 2021-03-10T13:55:08.249408+0000 mon.a (mon.0) 174 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T13:55:08.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[29418]: cluster 2021-03-10T13:55:08.249691+0000 mon.a (mon.0) 175 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T13:55:08.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[29418]: cluster 2021-03-10T13:55:08.250027+0000 mon.a (mon.0) 176 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T13:55:08.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[29418]: cluster 2021-03-10T13:55:08.250364+0000 mon.a (mon.0) 177 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T13:55:08.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[29418]: cluster 2021-03-10T13:55:08.250857+0000 mon.a (mon.0) 178 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T13:55:08.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[29418]: cluster 2021-03-10T13:55:08.251043+0000 mon.a (mon.0) 179 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T13:55:08.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[29418]: cluster 2021-03-10T13:55:08.251448+0000 mon.a (mon.0) 180 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T13:55:08.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[29418]: cluster 2021-03-10T13:55:08.251730+0000 mon.a (mon.0) 181 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T13:55:08.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[30381]: cluster 2021-03-10T13:55:08.045391+0000 mon.a (mon.0) 157 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T13:55:08.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[30381]: cluster 2021-03-10T13:55:08.045429+0000 mon.a (mon.0) 158 : cluster [INF] osd.0 failed (root=default,host=gibba013) (connection refused reported by osd.6) 2021-03-10T13:55:08.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[30381]: cluster 2021-03-10T13:55:08.045684+0000 mon.a (mon.0) 159 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T13:55:08.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[30381]: cluster 2021-03-10T13:55:08.045848+0000 mon.a (mon.0) 160 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T13:55:08.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[30381]: cluster 2021-03-10T13:55:08.045908+0000 mon.a (mon.0) 161 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T13:55:08.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[30381]: cluster 2021-03-10T13:55:08.045957+0000 mon.a (mon.0) 162 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T13:55:08.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[30381]: cluster 2021-03-10T13:55:08.046050+0000 mon.a (mon.0) 163 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T13:55:08.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[30381]: cluster 2021-03-10T13:55:08.245714+0000 mon.a (mon.0) 164 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T13:55:08.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[30381]: cluster 2021-03-10T13:55:08.246354+0000 mon.a (mon.0) 165 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T13:55:08.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[30381]: cluster 2021-03-10T13:55:08.246571+0000 mon.a (mon.0) 166 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T13:55:08.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[30381]: cluster 2021-03-10T13:55:08.247122+0000 mon.a (mon.0) 167 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T13:55:08.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[30381]: cluster 2021-03-10T13:55:08.247316+0000 mon.a (mon.0) 168 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T13:55:08.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[30381]: cluster 2021-03-10T13:55:08.247708+0000 mon.a (mon.0) 169 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T13:55:08.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[30381]: cluster 2021-03-10T13:55:08.247886+0000 mon.a (mon.0) 170 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T13:55:08.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[30381]: cluster 2021-03-10T13:55:08.248424+0000 mon.a (mon.0) 171 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T13:55:08.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[30381]: cluster 2021-03-10T13:55:08.248818+0000 mon.a (mon.0) 172 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T13:55:08.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[30381]: cluster 2021-03-10T13:55:08.249123+0000 mon.a (mon.0) 173 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T13:55:08.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[30381]: cluster 2021-03-10T13:55:08.249408+0000 mon.a (mon.0) 174 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T13:55:08.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[30381]: cluster 2021-03-10T13:55:08.249691+0000 mon.a (mon.0) 175 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T13:55:08.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[30381]: cluster 2021-03-10T13:55:08.250027+0000 mon.a (mon.0) 176 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T13:55:08.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[30381]: cluster 2021-03-10T13:55:08.250364+0000 mon.a (mon.0) 177 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T13:55:08.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[30381]: cluster 2021-03-10T13:55:08.250857+0000 mon.a (mon.0) 178 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T13:55:08.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[30381]: cluster 2021-03-10T13:55:08.251043+0000 mon.a (mon.0) 179 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T13:55:08.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[30381]: cluster 2021-03-10T13:55:08.251448+0000 mon.a (mon.0) 180 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T13:55:08.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:08 gibba013 bash[30381]: cluster 2021-03-10T13:55:08.251730+0000 mon.a (mon.0) 181 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T13:55:08.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:08 gibba020 bash[25448]: cluster 2021-03-10T13:55:08.045391+0000 mon.a (mon.0) 157 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T13:55:08.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:08 gibba020 bash[25448]: cluster 2021-03-10T13:55:08.045429+0000 mon.a (mon.0) 158 : cluster [INF] osd.0 failed (root=default,host=gibba013) (connection refused reported by osd.6) 2021-03-10T13:55:08.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:08 gibba020 bash[25448]: cluster 2021-03-10T13:55:08.045684+0000 mon.a (mon.0) 159 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T13:55:08.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:08 gibba020 bash[25448]: cluster 2021-03-10T13:55:08.045848+0000 mon.a (mon.0) 160 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T13:55:08.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:08 gibba020 bash[25448]: cluster 2021-03-10T13:55:08.045908+0000 mon.a (mon.0) 161 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T13:55:08.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:08 gibba020 bash[25448]: cluster 2021-03-10T13:55:08.045957+0000 mon.a (mon.0) 162 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T13:55:08.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:08 gibba020 bash[25448]: cluster 2021-03-10T13:55:08.046050+0000 mon.a (mon.0) 163 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T13:55:08.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:08 gibba020 bash[25448]: cluster 2021-03-10T13:55:08.245714+0000 mon.a (mon.0) 164 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T13:55:08.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:08 gibba020 bash[25448]: cluster 2021-03-10T13:55:08.246354+0000 mon.a (mon.0) 165 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T13:55:08.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:08 gibba020 bash[25448]: cluster 2021-03-10T13:55:08.246571+0000 mon.a (mon.0) 166 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T13:55:08.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:08 gibba020 bash[25448]: cluster 2021-03-10T13:55:08.247122+0000 mon.a (mon.0) 167 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T13:55:08.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:08 gibba020 bash[25448]: cluster 2021-03-10T13:55:08.247316+0000 mon.a (mon.0) 168 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T13:55:08.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:08 gibba020 bash[25448]: cluster 2021-03-10T13:55:08.247708+0000 mon.a (mon.0) 169 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T13:55:08.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:08 gibba020 bash[25448]: cluster 2021-03-10T13:55:08.247886+0000 mon.a (mon.0) 170 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T13:55:08.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:08 gibba020 bash[25448]: cluster 2021-03-10T13:55:08.248424+0000 mon.a (mon.0) 171 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T13:55:08.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:08 gibba020 bash[25448]: cluster 2021-03-10T13:55:08.248818+0000 mon.a (mon.0) 172 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T13:55:08.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:08 gibba020 bash[25448]: cluster 2021-03-10T13:55:08.249123+0000 mon.a (mon.0) 173 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T13:55:08.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:08 gibba020 bash[25448]: cluster 2021-03-10T13:55:08.249408+0000 mon.a (mon.0) 174 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T13:55:08.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:08 gibba020 bash[25448]: cluster 2021-03-10T13:55:08.249691+0000 mon.a (mon.0) 175 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T13:55:08.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:08 gibba020 bash[25448]: cluster 2021-03-10T13:55:08.250027+0000 mon.a (mon.0) 176 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T13:55:08.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:08 gibba020 bash[25448]: cluster 2021-03-10T13:55:08.250364+0000 mon.a (mon.0) 177 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T13:55:08.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:08 gibba020 bash[25448]: cluster 2021-03-10T13:55:08.250857+0000 mon.a (mon.0) 178 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T13:55:08.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:08 gibba020 bash[25448]: cluster 2021-03-10T13:55:08.251043+0000 mon.a (mon.0) 179 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T13:55:08.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:08 gibba020 bash[25448]: cluster 2021-03-10T13:55:08.251448+0000 mon.a (mon.0) 180 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T13:55:08.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:08 gibba020 bash[25448]: cluster 2021-03-10T13:55:08.251730+0000 mon.a (mon.0) 181 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T13:55:08.878 INFO:journalctl@ceph.osd.0.gibba013.stdout:Mar 10 13:55:08 gibba013 docker[31809]: ceph-7672acc8-81a6-11eb-9080-001a4aab830c-osd.0 2021-03-10T13:55:09.548 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:09 gibba013 bash[29418]: cluster 2021-03-10T13:55:08.272088+0000 mon.a (mon.0) 182 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:55:09.549 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:09 gibba013 bash[29418]: cluster 2021-03-10T13:55:08.294625+0000 mon.a (mon.0) 183 : cluster [DBG] osdmap e63: 8 total, 7 up, 8 in 2021-03-10T13:55:09.549 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:09 gibba013 bash[29418]: audit 2021-03-10T13:55:08.297538+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-03-10T13:55:09.549 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:09 gibba013 bash[29418]: audit 2021-03-10T13:55:08.304262+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2021-03-10T13:55:09.549 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:09 gibba013 bash[29418]: cluster 2021-03-10T13:55:08.414472+0000 mgr.gibba020.yqfnwy (mgr.34427) 100 : cluster [DBG] pgmap v36: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:55:09.550 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:09 gibba013 bash[30381]: cluster 2021-03-10T13:55:08.272088+0000 mon.a (mon.0) 182 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:55:09.550 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:09 gibba013 bash[30381]: cluster 2021-03-10T13:55:08.294625+0000 mon.a (mon.0) 183 : cluster [DBG] osdmap e63: 8 total, 7 up, 8 in 2021-03-10T13:55:09.550 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:09 gibba013 bash[30381]: audit 2021-03-10T13:55:08.297538+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-03-10T13:55:09.551 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:09 gibba013 bash[30381]: audit 2021-03-10T13:55:08.304262+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2021-03-10T13:55:09.551 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:09 gibba013 bash[30381]: cluster 2021-03-10T13:55:08.414472+0000 mgr.gibba020.yqfnwy (mgr.34427) 100 : cluster [DBG] pgmap v36: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:55:09.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:09 gibba020 bash[25448]: cluster 2021-03-10T13:55:08.272088+0000 mon.a (mon.0) 182 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:55:09.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:09 gibba020 bash[25448]: cluster 2021-03-10T13:55:08.294625+0000 mon.a (mon.0) 183 : cluster [DBG] osdmap e63: 8 total, 7 up, 8 in 2021-03-10T13:55:09.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:09 gibba020 bash[25448]: audit 2021-03-10T13:55:08.297538+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-03-10T13:55:09.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:09 gibba020 bash[25448]: audit 2021-03-10T13:55:08.304262+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2021-03-10T13:55:09.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:09 gibba020 bash[25448]: cluster 2021-03-10T13:55:08.414472+0000 mgr.gibba020.yqfnwy (mgr.34427) 100 : cluster [DBG] pgmap v36: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:55:10.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:10 gibba013 bash[29418]: audit 2021-03-10T13:55:09.292334+0000 mon.a (mon.0) 186 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2021-03-10T13:55:10.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:10 gibba013 bash[29418]: cluster 2021-03-10T13:55:09.292376+0000 mon.a (mon.0) 187 : cluster [DBG] osdmap e64: 8 total, 7 up, 8 in 2021-03-10T13:55:10.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:10 gibba013 bash[30381]: audit 2021-03-10T13:55:09.292334+0000 mon.a (mon.0) 186 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2021-03-10T13:55:10.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:10 gibba013 bash[30381]: cluster 2021-03-10T13:55:09.292376+0000 mon.a (mon.0) 187 : cluster [DBG] osdmap e64: 8 total, 7 up, 8 in 2021-03-10T13:55:10.629 INFO:journalctl@ceph.osd.0.gibba013.stdout:Mar 10 13:55:10 gibba013 systemd[1]: ceph-7672acc8-81a6-11eb-9080-001a4aab830c@osd.0.service: Succeeded. 2021-03-10T13:55:10.629 INFO:journalctl@ceph.osd.0.gibba013.stdout:Mar 10 13:55:10 gibba013 systemd[1]: Stopped Ceph osd.0 for 7672acc8-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:55:10.630 INFO:journalctl@ceph.osd.0.gibba013.stdout:Mar 10 13:55:10 gibba013 systemd[1]: Started Ceph osd.0 for 7672acc8-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:55:10.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:10 gibba020 bash[25448]: audit 2021-03-10T13:55:09.292334+0000 mon.a (mon.0) 186 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2021-03-10T13:55:10.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:10 gibba020 bash[25448]: cluster 2021-03-10T13:55:09.292376+0000 mon.a (mon.0) 187 : cluster [DBG] osdmap e64: 8 total, 7 up, 8 in 2021-03-10T13:55:11.616 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:11 gibba013 bash[29418]: cluster 2021-03-10T13:55:10.415715+0000 mgr.gibba020.yqfnwy (mgr.34427) 101 : cluster [DBG] pgmap v38: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:55:11.616 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:11 gibba013 bash[29418]: audit 2021-03-10T13:55:10.502993+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:11.617 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:11 gibba013 bash[29418]: audit 2021-03-10T13:55:10.504926+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:55:11.617 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:11 gibba013 bash[29418]: cephadm 2021-03-10T13:55:10.506496+0000 mgr.gibba020.yqfnwy (mgr.34427) 102 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T13:55:11.617 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:11 gibba013 bash[29418]: audit 2021-03-10T13:55:10.508585+0000 mon.a (mon.0) 190 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:55:11.617 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:11 gibba013 bash[30381]: cluster 2021-03-10T13:55:10.415715+0000 mgr.gibba020.yqfnwy (mgr.34427) 101 : cluster [DBG] pgmap v38: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:55:11.618 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:11 gibba013 bash[30381]: audit 2021-03-10T13:55:10.502993+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:11.618 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:11 gibba013 bash[30381]: audit 2021-03-10T13:55:10.504926+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:55:11.618 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:11 gibba013 bash[30381]: cephadm 2021-03-10T13:55:10.506496+0000 mgr.gibba020.yqfnwy (mgr.34427) 102 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T13:55:11.618 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:11 gibba013 bash[30381]: audit 2021-03-10T13:55:10.508585+0000 mon.a (mon.0) 190 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:55:11.878 INFO:journalctl@ceph.osd.0.gibba013.stdout:Mar 10 13:55:11 gibba013 bash[31999]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-03-10T13:55:11.878 INFO:journalctl@ceph.osd.0.gibba013.stdout:Mar 10 13:55:11 gibba013 bash[31999]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2021-03-10T13:55:11.879 INFO:journalctl@ceph.osd.0.gibba013.stdout:Mar 10 13:55:11 gibba013 bash[31999]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2021-03-10T13:55:11.879 INFO:journalctl@ceph.osd.0.gibba013.stdout:Mar 10 13:55:11 gibba013 bash[31999]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2021-03-10T13:55:11.879 INFO:journalctl@ceph.osd.0.gibba013.stdout:Mar 10 13:55:11 gibba013 bash[31999]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2021-03-10T13:55:11.879 INFO:journalctl@ceph.osd.0.gibba013.stdout:Mar 10 13:55:11 gibba013 bash[31999]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-03-10T13:55:11.879 INFO:journalctl@ceph.osd.0.gibba013.stdout:Mar 10 13:55:11 gibba013 bash[31999]: --> ceph-volume lvm activate successful for osd ID: 0 2021-03-10T13:55:11.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:11 gibba020 bash[25448]: cluster 2021-03-10T13:55:10.415715+0000 mgr.gibba020.yqfnwy (mgr.34427) 101 : cluster [DBG] pgmap v38: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T13:55:11.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:11 gibba020 bash[25448]: audit 2021-03-10T13:55:10.502993+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:11.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:11 gibba020 bash[25448]: audit 2021-03-10T13:55:10.504926+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:55:11.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:11 gibba020 bash[25448]: cephadm 2021-03-10T13:55:10.506496+0000 mgr.gibba020.yqfnwy (mgr.34427) 102 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T13:55:11.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:11 gibba020 bash[25448]: audit 2021-03-10T13:55:10.508585+0000 mon.a (mon.0) 190 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:55:12.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:12 gibba013 bash[29418]: cluster 2021-03-10T13:55:12.504084+0000 mon.a (mon.0) 191 : cluster [WRN] Health check failed: Degraded data redundancy: 26/192 objects degraded (13.542%), 18 pgs degraded (PG_DEGRADED) 2021-03-10T13:55:12.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:12 gibba013 bash[30381]: cluster 2021-03-10T13:55:12.504084+0000 mon.a (mon.0) 191 : cluster [WRN] Health check failed: Degraded data redundancy: 26/192 objects degraded (13.542%), 18 pgs degraded (PG_DEGRADED) 2021-03-10T13:55:12.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:12 gibba020 bash[25448]: cluster 2021-03-10T13:55:12.504084+0000 mon.a (mon.0) 191 : cluster [WRN] Health check failed: Degraded data redundancy: 26/192 objects degraded (13.542%), 18 pgs degraded (PG_DEGRADED) 2021-03-10T13:55:13.378 INFO:journalctl@ceph.osd.0.gibba013.stdout:Mar 10 13:55:13 gibba013 bash[32159]: debug 2021-03-10T13:55:13.113+0000 7f02647fa700 1 -- 172.21.2.113:0/814980867 <== mon.1 v2:172.21.2.113:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55962367e4e0 con 0x5596236fb400 2021-03-10T13:55:13.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:13 gibba013 bash[29418]: cluster 2021-03-10T13:55:12.418254+0000 mgr.gibba020.yqfnwy (mgr.34427) 103 : cluster [DBG] pgmap v39: 129 pgs: 18 active+undersized+degraded, 31 active+undersized, 80 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 26/192 objects degraded (13.542%) 2021-03-10T13:55:13.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:13 gibba013 bash[30381]: cluster 2021-03-10T13:55:12.418254+0000 mgr.gibba020.yqfnwy (mgr.34427) 103 : cluster [DBG] pgmap v39: 129 pgs: 18 active+undersized+degraded, 31 active+undersized, 80 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 26/192 objects degraded (13.542%) 2021-03-10T13:55:13.879 INFO:journalctl@ceph.osd.0.gibba013.stdout:Mar 10 13:55:13 gibba013 bash[32159]: debug 2021-03-10T13:55:13.665+0000 7f026c28f080 -1 Falling back to public interface 2021-03-10T13:55:13.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:13 gibba020 bash[25448]: cluster 2021-03-10T13:55:12.418254+0000 mgr.gibba020.yqfnwy (mgr.34427) 103 : cluster [DBG] pgmap v39: 129 pgs: 18 active+undersized+degraded, 31 active+undersized, 80 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 26/192 objects degraded (13.542%) 2021-03-10T13:55:15.986 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:15 gibba020 bash[25448]: cluster 2021-03-10T13:55:14.419715+0000 mgr.gibba020.yqfnwy (mgr.34427) 104 : cluster [DBG] pgmap v40: 129 pgs: 18 active+undersized+degraded, 31 active+undersized, 80 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 26/192 objects degraded (13.542%) 2021-03-10T13:55:16.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:15 gibba013 bash[29418]: cluster 2021-03-10T13:55:14.419715+0000 mgr.gibba020.yqfnwy (mgr.34427) 104 : cluster [DBG] pgmap v40: 129 pgs: 18 active+undersized+degraded, 31 active+undersized, 80 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 26/192 objects degraded (13.542%) 2021-03-10T13:55:16.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:15 gibba013 bash[30381]: cluster 2021-03-10T13:55:14.419715+0000 mgr.gibba020.yqfnwy (mgr.34427) 104 : cluster [DBG] pgmap v40: 129 pgs: 18 active+undersized+degraded, 31 active+undersized, 80 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 26/192 objects degraded (13.542%) 2021-03-10T13:55:17.095 INFO:journalctl@ceph.osd.0.gibba013.stdout:Mar 10 13:55:16 gibba013 bash[32159]: debug 2021-03-10T13:55:16.961+0000 7f026c28f080 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: store not yet converted to per-pg omap 2021-03-10T13:55:17.095 INFO:journalctl@ceph.osd.0.gibba013.stdout:Mar 10 13:55:16 gibba013 bash[32159]: debug 2021-03-10T13:55:16.965+0000 7f0255d51700 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2021-03-10T13:55:17.096 INFO:journalctl@ceph.osd.0.gibba013.stdout:Mar 10 13:55:16 gibba013 bash[32159]: debug 2021-03-10T13:55:16.965+0000 7f0255d51700 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #1:7baad65a:::INTEL_SSDPEL1K375GA_PHKM9200001J375A:head# has omap that is not per-pg or pgmeta 2021-03-10T13:55:17.096 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:16 gibba013 bash[29418]: cephadm 2021-03-10T13:55:15.760396+0000 mgr.gibba020.yqfnwy (mgr.34427) 105 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T13:55:17.096 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:16 gibba013 bash[29418]: audit 2021-03-10T13:55:15.761662+0000 mon.a (mon.0) 192 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:17.097 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:16 gibba013 bash[29418]: audit 2021-03-10T13:55:15.970471+0000 mon.a (mon.0) 193 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:17.097 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:16 gibba013 bash[29418]: cephadm 2021-03-10T13:55:15.976098+0000 mgr.gibba020.yqfnwy (mgr.34427) 106 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:55:17.097 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:16 gibba013 bash[29418]: cephadm 2021-03-10T13:55:15.978038+0000 mgr.gibba020.yqfnwy (mgr.34427) 107 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:55:17.097 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:16 gibba013 bash[29418]: audit 2021-03-10T13:55:15.978892+0000 mon.a (mon.0) 194 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:55:17.098 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:16 gibba013 bash[29418]: cephadm 2021-03-10T13:55:15.979483+0000 mgr.gibba020.yqfnwy (mgr.34427) 108 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:55:17.098 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:16 gibba013 bash[29418]: cephadm 2021-03-10T13:55:15.979522+0000 mgr.gibba020.yqfnwy (mgr.34427) 109 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:55:17.098 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:16 gibba013 bash[29418]: audit 2021-03-10T13:55:15.980530+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:17.098 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:16 gibba013 bash[29418]: cephadm 2021-03-10T13:55:15.981486+0000 mgr.gibba020.yqfnwy (mgr.34427) 110 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:55:17.098 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:16 gibba013 bash[29418]: cephadm 2021-03-10T13:55:15.981528+0000 mgr.gibba020.yqfnwy (mgr.34427) 111 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:55:17.099 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:16 gibba013 bash[29418]: audit 2021-03-10T13:55:15.981990+0000 mon.a (mon.0) 196 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:17.099 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:16 gibba013 bash[29418]: cephadm 2021-03-10T13:55:15.983003+0000 mgr.gibba020.yqfnwy (mgr.34427) 112 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:55:17.099 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:16 gibba013 bash[29418]: audit 2021-03-10T13:55:15.983943+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:17.099 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:16 gibba013 bash[29418]: cephadm 2021-03-10T13:55:15.984502+0000 mgr.gibba020.yqfnwy (mgr.34427) 113 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:55:17.100 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:16 gibba013 bash[29418]: cephadm 2021-03-10T13:55:15.984541+0000 mgr.gibba020.yqfnwy (mgr.34427) 114 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:55:17.100 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:16 gibba013 bash[29418]: audit 2021-03-10T13:55:15.985373+0000 mgr.gibba020.yqfnwy (mgr.34427) 115 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T13:55:17.100 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:16 gibba013 bash[29418]: cephadm 2021-03-10T13:55:15.986933+0000 mgr.gibba020.yqfnwy (mgr.34427) 116 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2021-03-10T13:55:17.100 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:16 gibba013 bash[29418]: audit 2021-03-10T13:55:15.987127+0000 mon.a (mon.0) 198 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T13:55:17.100 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:16 gibba013 bash[30381]: cephadm 2021-03-10T13:55:15.760396+0000 mgr.gibba020.yqfnwy (mgr.34427) 105 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T13:55:17.101 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:16 gibba013 bash[30381]: audit 2021-03-10T13:55:15.761662+0000 mon.a (mon.0) 192 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:17.101 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:16 gibba013 bash[30381]: audit 2021-03-10T13:55:15.970471+0000 mon.a (mon.0) 193 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:17.101 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:16 gibba013 bash[30381]: cephadm 2021-03-10T13:55:15.976098+0000 mgr.gibba020.yqfnwy (mgr.34427) 106 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:55:17.101 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:16 gibba013 bash[30381]: cephadm 2021-03-10T13:55:15.978038+0000 mgr.gibba020.yqfnwy (mgr.34427) 107 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:55:17.102 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:16 gibba013 bash[30381]: audit 2021-03-10T13:55:15.978892+0000 mon.a (mon.0) 194 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:55:17.102 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:16 gibba013 bash[30381]: cephadm 2021-03-10T13:55:15.979483+0000 mgr.gibba020.yqfnwy (mgr.34427) 108 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:55:17.102 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:16 gibba013 bash[30381]: cephadm 2021-03-10T13:55:15.979522+0000 mgr.gibba020.yqfnwy (mgr.34427) 109 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:55:17.102 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:16 gibba013 bash[30381]: audit 2021-03-10T13:55:15.980530+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:17.102 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:16 gibba013 bash[30381]: cephadm 2021-03-10T13:55:15.981486+0000 mgr.gibba020.yqfnwy (mgr.34427) 110 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:55:17.103 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:16 gibba013 bash[30381]: cephadm 2021-03-10T13:55:15.981528+0000 mgr.gibba020.yqfnwy (mgr.34427) 111 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:55:17.103 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:16 gibba013 bash[30381]: audit 2021-03-10T13:55:15.981990+0000 mon.a (mon.0) 196 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:17.103 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:16 gibba013 bash[30381]: cephadm 2021-03-10T13:55:15.983003+0000 mgr.gibba020.yqfnwy (mgr.34427) 112 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:55:17.103 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:16 gibba013 bash[30381]: audit 2021-03-10T13:55:15.983943+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:17.104 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:16 gibba013 bash[30381]: cephadm 2021-03-10T13:55:15.984502+0000 mgr.gibba020.yqfnwy (mgr.34427) 113 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:55:17.104 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:16 gibba013 bash[30381]: cephadm 2021-03-10T13:55:15.984541+0000 mgr.gibba020.yqfnwy (mgr.34427) 114 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:55:17.104 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:16 gibba013 bash[30381]: audit 2021-03-10T13:55:15.985373+0000 mgr.gibba020.yqfnwy (mgr.34427) 115 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T13:55:17.104 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:16 gibba013 bash[30381]: cephadm 2021-03-10T13:55:15.986933+0000 mgr.gibba020.yqfnwy (mgr.34427) 116 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2021-03-10T13:55:17.104 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:16 gibba013 bash[30381]: audit 2021-03-10T13:55:15.987127+0000 mon.a (mon.0) 198 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T13:55:17.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:16 gibba020 bash[25448]: cephadm 2021-03-10T13:55:15.760396+0000 mgr.gibba020.yqfnwy (mgr.34427) 105 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T13:55:17.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:16 gibba020 bash[25448]: audit 2021-03-10T13:55:15.761662+0000 mon.a (mon.0) 192 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:17.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:16 gibba020 bash[25448]: audit 2021-03-10T13:55:15.970471+0000 mon.a (mon.0) 193 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:17.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:16 gibba020 bash[25448]: cephadm 2021-03-10T13:55:15.976098+0000 mgr.gibba020.yqfnwy (mgr.34427) 106 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:55:17.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:16 gibba020 bash[25448]: cephadm 2021-03-10T13:55:15.978038+0000 mgr.gibba020.yqfnwy (mgr.34427) 107 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:55:17.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:16 gibba020 bash[25448]: audit 2021-03-10T13:55:15.978892+0000 mon.a (mon.0) 194 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:55:17.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:16 gibba020 bash[25448]: cephadm 2021-03-10T13:55:15.979483+0000 mgr.gibba020.yqfnwy (mgr.34427) 108 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:55:17.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:16 gibba020 bash[25448]: cephadm 2021-03-10T13:55:15.979522+0000 mgr.gibba020.yqfnwy (mgr.34427) 109 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:55:17.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:16 gibba020 bash[25448]: audit 2021-03-10T13:55:15.980530+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:17.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:16 gibba020 bash[25448]: cephadm 2021-03-10T13:55:15.981486+0000 mgr.gibba020.yqfnwy (mgr.34427) 110 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:55:17.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:16 gibba020 bash[25448]: cephadm 2021-03-10T13:55:15.981528+0000 mgr.gibba020.yqfnwy (mgr.34427) 111 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:55:17.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:16 gibba020 bash[25448]: audit 2021-03-10T13:55:15.981990+0000 mon.a (mon.0) 196 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:17.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:16 gibba020 bash[25448]: cephadm 2021-03-10T13:55:15.983003+0000 mgr.gibba020.yqfnwy (mgr.34427) 112 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:55:17.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:16 gibba020 bash[25448]: audit 2021-03-10T13:55:15.983943+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:17.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:16 gibba020 bash[25448]: cephadm 2021-03-10T13:55:15.984502+0000 mgr.gibba020.yqfnwy (mgr.34427) 113 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:55:17.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:16 gibba020 bash[25448]: cephadm 2021-03-10T13:55:15.984541+0000 mgr.gibba020.yqfnwy (mgr.34427) 114 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:55:17.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:16 gibba020 bash[25448]: audit 2021-03-10T13:55:15.985373+0000 mgr.gibba020.yqfnwy (mgr.34427) 115 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T13:55:17.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:16 gibba020 bash[25448]: cephadm 2021-03-10T13:55:15.986933+0000 mgr.gibba020.yqfnwy (mgr.34427) 116 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2021-03-10T13:55:17.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:16 gibba020 bash[25448]: audit 2021-03-10T13:55:15.987127+0000 mon.a (mon.0) 198 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T13:55:17.378 INFO:journalctl@ceph.osd.0.gibba013.stdout:Mar 10 13:55:17 gibba013 bash[32159]: debug 2021-03-10T13:55:17.093+0000 7f026c28f080 -1 osd.0 62 log_to_monitors {default=true} 2021-03-10T13:55:18.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:17 gibba013 bash[29418]: cluster 2021-03-10T13:55:16.421187+0000 mgr.gibba020.yqfnwy (mgr.34427) 117 : cluster [DBG] pgmap v41: 129 pgs: 18 active+undersized+degraded, 31 active+undersized, 80 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 26/192 objects degraded (13.542%) 2021-03-10T13:55:18.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:17 gibba013 bash[29418]: audit 2021-03-10T13:55:17.099010+0000 mon.c (mon.1) 6 : audit [INF] from='osd.0 [v2:172.21.2.113:6800/418598028,v1:172.21.2.113:6801/418598028]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T13:55:18.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:17 gibba013 bash[29418]: audit 2021-03-10T13:55:17.099258+0000 mon.a (mon.0) 199 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T13:55:18.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:17 gibba013 bash[30381]: cluster 2021-03-10T13:55:16.421187+0000 mgr.gibba020.yqfnwy (mgr.34427) 117 : cluster [DBG] pgmap v41: 129 pgs: 18 active+undersized+degraded, 31 active+undersized, 80 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 26/192 objects degraded (13.542%) 2021-03-10T13:55:18.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:17 gibba013 bash[30381]: audit 2021-03-10T13:55:17.099010+0000 mon.c (mon.1) 6 : audit [INF] from='osd.0 [v2:172.21.2.113:6800/418598028,v1:172.21.2.113:6801/418598028]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T13:55:18.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:17 gibba013 bash[30381]: audit 2021-03-10T13:55:17.099258+0000 mon.a (mon.0) 199 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T13:55:18.380 INFO:journalctl@ceph.osd.0.gibba013.stdout:Mar 10 13:55:17 gibba013 bash[32159]: debug 2021-03-10T13:55:17.989+0000 7f025bf6c700 -1 osd.0 62 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:55:18.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:17 gibba020 bash[25448]: cluster 2021-03-10T13:55:16.421187+0000 mgr.gibba020.yqfnwy (mgr.34427) 117 : cluster [DBG] pgmap v41: 129 pgs: 18 active+undersized+degraded, 31 active+undersized, 80 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 26/192 objects degraded (13.542%) 2021-03-10T13:55:18.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:17 gibba020 bash[25448]: audit 2021-03-10T13:55:17.099010+0000 mon.c (mon.1) 6 : audit [INF] from='osd.0 [v2:172.21.2.113:6800/418598028,v1:172.21.2.113:6801/418598028]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T13:55:18.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:17 gibba020 bash[25448]: audit 2021-03-10T13:55:17.099258+0000 mon.a (mon.0) 199 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T13:55:19.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:18 gibba013 bash[29418]: audit 2021-03-10T13:55:17.985841+0000 mon.a (mon.0) 200 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-03-10T13:55:19.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:18 gibba013 bash[29418]: cluster 2021-03-10T13:55:17.985890+0000 mon.a (mon.0) 201 : cluster [DBG] osdmap e65: 8 total, 7 up, 8 in 2021-03-10T13:55:19.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:18 gibba013 bash[29418]: audit 2021-03-10T13:55:17.986540+0000 mon.c (mon.1) 7 : audit [INF] from='osd.0 [v2:172.21.2.113:6800/418598028,v1:172.21.2.113:6801/418598028]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:55:19.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:18 gibba013 bash[29418]: audit 2021-03-10T13:55:17.986848+0000 mon.a (mon.0) 202 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:55:19.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:18 gibba013 bash[30381]: audit 2021-03-10T13:55:17.985841+0000 mon.a (mon.0) 200 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-03-10T13:55:19.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:18 gibba013 bash[30381]: cluster 2021-03-10T13:55:17.985890+0000 mon.a (mon.0) 201 : cluster [DBG] osdmap e65: 8 total, 7 up, 8 in 2021-03-10T13:55:19.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:18 gibba013 bash[30381]: audit 2021-03-10T13:55:17.986540+0000 mon.c (mon.1) 7 : audit [INF] from='osd.0 [v2:172.21.2.113:6800/418598028,v1:172.21.2.113:6801/418598028]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:55:19.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:18 gibba013 bash[30381]: audit 2021-03-10T13:55:17.986848+0000 mon.a (mon.0) 202 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:55:19.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:18 gibba020 bash[25448]: audit 2021-03-10T13:55:17.985841+0000 mon.a (mon.0) 200 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-03-10T13:55:19.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:18 gibba020 bash[25448]: cluster 2021-03-10T13:55:17.985890+0000 mon.a (mon.0) 201 : cluster [DBG] osdmap e65: 8 total, 7 up, 8 in 2021-03-10T13:55:19.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:18 gibba020 bash[25448]: audit 2021-03-10T13:55:17.986540+0000 mon.c (mon.1) 7 : audit [INF] from='osd.0 [v2:172.21.2.113:6800/418598028,v1:172.21.2.113:6801/418598028]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:55:19.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:18 gibba020 bash[25448]: audit 2021-03-10T13:55:17.986848+0000 mon.a (mon.0) 202 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:55:20.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:20 gibba013 bash[29418]: cluster 2021-03-10T13:55:18.422485+0000 mgr.gibba020.yqfnwy (mgr.34427) 118 : cluster [DBG] pgmap v43: 129 pgs: 18 active+undersized+degraded, 31 active+undersized, 80 active+clean; 7.0 KiB data, 10 MiB used, 665 GiB / 672 GiB avail; 26/192 objects degraded (13.542%) 2021-03-10T13:55:20.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:20 gibba013 bash[29418]: cluster 2021-03-10T13:55:18.985720+0000 mon.a (mon.0) 203 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:55:20.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:20 gibba013 bash[29418]: cluster 2021-03-10T13:55:18.996618+0000 mon.a (mon.0) 204 : cluster [INF] osd.0 [v2:172.21.2.113:6800/418598028,v1:172.21.2.113:6801/418598028] boot 2021-03-10T13:55:20.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:20 gibba013 bash[29418]: cluster 2021-03-10T13:55:18.996774+0000 mon.a (mon.0) 205 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2021-03-10T13:55:20.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:20 gibba013 bash[29418]: audit 2021-03-10T13:55:18.997643+0000 mon.a (mon.0) 206 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:55:20.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:20 gibba013 bash[30381]: cluster 2021-03-10T13:55:18.422485+0000 mgr.gibba020.yqfnwy (mgr.34427) 118 : cluster [DBG] pgmap v43: 129 pgs: 18 active+undersized+degraded, 31 active+undersized, 80 active+clean; 7.0 KiB data, 10 MiB used, 665 GiB / 672 GiB avail; 26/192 objects degraded (13.542%) 2021-03-10T13:55:20.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:20 gibba013 bash[30381]: cluster 2021-03-10T13:55:18.985720+0000 mon.a (mon.0) 203 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:55:20.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:20 gibba013 bash[30381]: cluster 2021-03-10T13:55:18.996618+0000 mon.a (mon.0) 204 : cluster [INF] osd.0 [v2:172.21.2.113:6800/418598028,v1:172.21.2.113:6801/418598028] boot 2021-03-10T13:55:20.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:20 gibba013 bash[30381]: cluster 2021-03-10T13:55:18.996774+0000 mon.a (mon.0) 205 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2021-03-10T13:55:20.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:20 gibba013 bash[30381]: audit 2021-03-10T13:55:18.997643+0000 mon.a (mon.0) 206 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:55:20.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:20 gibba020 bash[25448]: cluster 2021-03-10T13:55:18.422485+0000 mgr.gibba020.yqfnwy (mgr.34427) 118 : cluster [DBG] pgmap v43: 129 pgs: 18 active+undersized+degraded, 31 active+undersized, 80 active+clean; 7.0 KiB data, 10 MiB used, 665 GiB / 672 GiB avail; 26/192 objects degraded (13.542%) 2021-03-10T13:55:20.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:20 gibba020 bash[25448]: cluster 2021-03-10T13:55:18.985720+0000 mon.a (mon.0) 203 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:55:20.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:20 gibba020 bash[25448]: cluster 2021-03-10T13:55:18.996618+0000 mon.a (mon.0) 204 : cluster [INF] osd.0 [v2:172.21.2.113:6800/418598028,v1:172.21.2.113:6801/418598028] boot 2021-03-10T13:55:20.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:20 gibba020 bash[25448]: cluster 2021-03-10T13:55:18.996774+0000 mon.a (mon.0) 205 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2021-03-10T13:55:20.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:20 gibba020 bash[25448]: audit 2021-03-10T13:55:18.997643+0000 mon.a (mon.0) 206 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T13:55:21.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:21 gibba013 bash[29418]: cluster 2021-03-10T13:55:20.000351+0000 mon.a (mon.0) 207 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2021-03-10T13:55:21.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:21 gibba013 bash[30381]: cluster 2021-03-10T13:55:20.000351+0000 mon.a (mon.0) 207 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2021-03-10T13:55:21.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:21 gibba020 bash[25448]: cluster 2021-03-10T13:55:20.000351+0000 mon.a (mon.0) 207 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2021-03-10T13:55:22.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:22 gibba013 bash[29418]: cluster 2021-03-10T13:55:20.423878+0000 mgr.gibba020.yqfnwy (mgr.34427) 119 : cluster [DBG] pgmap v46: 129 pgs: 18 active+undersized+degraded, 31 active+undersized, 80 active+clean; 7.0 KiB data, 10 MiB used, 665 GiB / 672 GiB avail; 26/192 objects degraded (13.542%) 2021-03-10T13:55:22.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:22 gibba013 bash[30381]: cluster 2021-03-10T13:55:20.423878+0000 mgr.gibba020.yqfnwy (mgr.34427) 119 : cluster [DBG] pgmap v46: 129 pgs: 18 active+undersized+degraded, 31 active+undersized, 80 active+clean; 7.0 KiB data, 10 MiB used, 665 GiB / 672 GiB avail; 26/192 objects degraded (13.542%) 2021-03-10T13:55:22.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:22 gibba020 bash[25448]: cluster 2021-03-10T13:55:20.423878+0000 mgr.gibba020.yqfnwy (mgr.34427) 119 : cluster [DBG] pgmap v46: 129 pgs: 18 active+undersized+degraded, 31 active+undersized, 80 active+clean; 7.0 KiB data, 10 MiB used, 665 GiB / 672 GiB avail; 26/192 objects degraded (13.542%) 2021-03-10T13:55:23.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:23 gibba013 bash[29418]: cluster 2021-03-10T13:55:23.019895+0000 mon.a (mon.0) 208 : cluster [WRN] Health check update: Degraded data redundancy: 6/192 objects degraded (3.125%), 6 pgs degraded (PG_DEGRADED) 2021-03-10T13:55:23.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:23 gibba013 bash[30381]: cluster 2021-03-10T13:55:23.019895+0000 mon.a (mon.0) 208 : cluster [WRN] Health check update: Degraded data redundancy: 6/192 objects degraded (3.125%), 6 pgs degraded (PG_DEGRADED) 2021-03-10T13:55:23.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:23 gibba020 bash[25448]: cluster 2021-03-10T13:55:23.019895+0000 mon.a (mon.0) 208 : cluster [WRN] Health check update: Degraded data redundancy: 6/192 objects degraded (3.125%), 6 pgs degraded (PG_DEGRADED) 2021-03-10T13:55:23.892 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T13:55:24.120 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:55:24.120 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (113s) 8s ago 7m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T13:55:24.120 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (7m) 46s ago 7m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T13:55:24.121 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2m) 46s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T13:55:24.121 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2m) 46s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T13:55:24.121 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (94s) 8s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T13:55:24.121 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (85s) 8s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T13:55:24.122 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (57s) 46s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T13:55:24.122 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (68s) 8s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T13:55:24.122 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (7m) 8s ago 7m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T13:55:24.122 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (7m) 46s ago 7m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T13:55:24.122 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (11s) 8s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T13:55:24.123 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (10m) 8s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 385800e8f97f 2021-03-10T13:55:24.123 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (9m) 8s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d0a99b0fd1fc 2021-03-10T13:55:24.123 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (9m) 8s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d0b507f36a88 2021-03-10T13:55:24.123 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (8m) 46s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5bcc0da1a794 2021-03-10T13:55:24.123 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (8m) 46s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 8e0d292ca03b 2021-03-10T13:55:24.124 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (8m) 46s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b54758e37be1 2021-03-10T13:55:24.124 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (7m) 46s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 75c9ee8106fc 2021-03-10T13:55:24.124 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (6m) 46s ago 7m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T13:55:24.124 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 46s ago 5m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:55:24.370 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T13:55:24.370 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T13:55:24.370 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:55:24.370 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:55:24.371 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T13:55:24.371 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:55:24.371 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:55:24.371 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T13:55:24.371 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 7, 2021-03-10T13:55:24.372 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 1 2021-03-10T13:55:24.372 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:55:24.372 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T13:55:24.372 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T13:55:24.372 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 7, 2021-03-10T13:55:24.373 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 7 2021-03-10T13:55:24.373 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T13:55:24.373 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T13:55:24.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:24 gibba013 bash[29418]: cluster 2021-03-10T13:55:22.426042+0000 mgr.gibba020.yqfnwy (mgr.34427) 120 : cluster [DBG] pgmap v47: 129 pgs: 6 active+undersized+degraded, 10 active+undersized, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 6/192 objects degraded (3.125%) 2021-03-10T13:55:24.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:24 gibba013 bash[30381]: cluster 2021-03-10T13:55:22.426042+0000 mgr.gibba020.yqfnwy (mgr.34427) 120 : cluster [DBG] pgmap v47: 129 pgs: 6 active+undersized+degraded, 10 active+undersized, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 6/192 objects degraded (3.125%) 2021-03-10T13:55:24.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:24 gibba020 bash[25448]: cluster 2021-03-10T13:55:22.426042+0000 mgr.gibba020.yqfnwy (mgr.34427) 120 : cluster [DBG] pgmap v47: 129 pgs: 6 active+undersized+degraded, 10 active+undersized, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 6/192 objects degraded (3.125%) 2021-03-10T13:55:25.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:25 gibba013 bash[29418]: audit 2021-03-10T13:55:23.882122+0000 mgr.gibba020.yqfnwy (mgr.34427) 121 : audit [DBG] from='client.54145 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:55:25.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:25 gibba013 bash[29418]: audit 2021-03-10T13:55:24.108413+0000 mgr.gibba020.yqfnwy (mgr.34427) 122 : audit [DBG] from='client.44166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:55:25.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:25 gibba013 bash[29418]: audit 2021-03-10T13:55:24.370831+0000 mon.c (mon.1) 8 : audit [DBG] from='client.? 172.21.2.113:0/2141334500' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:25.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:25 gibba013 bash[30381]: audit 2021-03-10T13:55:23.882122+0000 mgr.gibba020.yqfnwy (mgr.34427) 121 : audit [DBG] from='client.54145 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:55:25.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:25 gibba013 bash[30381]: audit 2021-03-10T13:55:24.108413+0000 mgr.gibba020.yqfnwy (mgr.34427) 122 : audit [DBG] from='client.44166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:55:25.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:25 gibba013 bash[30381]: audit 2021-03-10T13:55:24.370831+0000 mon.c (mon.1) 8 : audit [DBG] from='client.? 172.21.2.113:0/2141334500' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:25.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:25 gibba020 bash[25448]: audit 2021-03-10T13:55:23.882122+0000 mgr.gibba020.yqfnwy (mgr.34427) 121 : audit [DBG] from='client.54145 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:55:25.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:25 gibba020 bash[25448]: audit 2021-03-10T13:55:24.108413+0000 mgr.gibba020.yqfnwy (mgr.34427) 122 : audit [DBG] from='client.44166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:55:25.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:25 gibba020 bash[25448]: audit 2021-03-10T13:55:24.370831+0000 mon.c (mon.1) 8 : audit [DBG] from='client.? 172.21.2.113:0/2141334500' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:26.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:26 gibba013 bash[29418]: cluster 2021-03-10T13:55:24.427397+0000 mgr.gibba020.yqfnwy (mgr.34427) 123 : cluster [DBG] pgmap v48: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:55:26.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:26 gibba013 bash[29418]: cluster 2021-03-10T13:55:25.076745+0000 mon.a (mon.0) 209 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/192 objects degraded (3.125%), 6 pgs degraded) 2021-03-10T13:55:26.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:26 gibba013 bash[29418]: audit 2021-03-10T13:55:25.851807+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:26.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:26 gibba013 bash[30381]: cluster 2021-03-10T13:55:24.427397+0000 mgr.gibba020.yqfnwy (mgr.34427) 123 : cluster [DBG] pgmap v48: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:55:26.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:26 gibba013 bash[30381]: cluster 2021-03-10T13:55:25.076745+0000 mon.a (mon.0) 209 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/192 objects degraded (3.125%), 6 pgs degraded) 2021-03-10T13:55:26.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:26 gibba013 bash[30381]: audit 2021-03-10T13:55:25.851807+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:26.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:26 gibba020 bash[25448]: cluster 2021-03-10T13:55:24.427397+0000 mgr.gibba020.yqfnwy (mgr.34427) 123 : cluster [DBG] pgmap v48: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:55:26.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:26 gibba020 bash[25448]: cluster 2021-03-10T13:55:25.076745+0000 mon.a (mon.0) 209 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/192 objects degraded (3.125%), 6 pgs degraded) 2021-03-10T13:55:26.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:26 gibba020 bash[25448]: audit 2021-03-10T13:55:25.851807+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:28.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:28 gibba013 bash[29418]: cluster 2021-03-10T13:55:26.428615+0000 mgr.gibba020.yqfnwy (mgr.34427) 124 : cluster [DBG] pgmap v49: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:55:28.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:28 gibba013 bash[30381]: cluster 2021-03-10T13:55:26.428615+0000 mgr.gibba020.yqfnwy (mgr.34427) 124 : cluster [DBG] pgmap v49: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:55:28.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:28 gibba020 bash[25448]: cluster 2021-03-10T13:55:26.428615+0000 mgr.gibba020.yqfnwy (mgr.34427) 124 : cluster [DBG] pgmap v49: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:55:30.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:30 gibba013 bash[29418]: cluster 2021-03-10T13:55:28.430700+0000 mgr.gibba020.yqfnwy (mgr.34427) 125 : cluster [DBG] pgmap v50: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:55:30.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:30 gibba013 bash[30381]: cluster 2021-03-10T13:55:28.430700+0000 mgr.gibba020.yqfnwy (mgr.34427) 125 : cluster [DBG] pgmap v50: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:55:30.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:30 gibba020 bash[25448]: cluster 2021-03-10T13:55:28.430700+0000 mgr.gibba020.yqfnwy (mgr.34427) 125 : cluster [DBG] pgmap v50: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:55:31.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:31 gibba013 bash[29418]: audit 2021-03-10T13:55:31.005397+0000 mon.a (mon.0) 211 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T13:55:31.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:31 gibba013 bash[30381]: audit 2021-03-10T13:55:31.005397+0000 mon.a (mon.0) 211 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T13:55:31.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:31 gibba020 bash[25448]: audit 2021-03-10T13:55:31.005397+0000 mon.a (mon.0) 211 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T13:55:32.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:32 gibba013 bash[29418]: cluster 2021-03-10T13:55:30.431858+0000 mgr.gibba020.yqfnwy (mgr.34427) 126 : cluster [DBG] pgmap v51: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:55:32.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:32 gibba013 bash[29418]: audit 2021-03-10T13:55:31.004472+0000 mgr.gibba020.yqfnwy (mgr.34427) 127 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T13:55:32.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:32 gibba013 bash[29418]: cephadm 2021-03-10T13:55:31.009114+0000 mgr.gibba020.yqfnwy (mgr.34427) 128 : cephadm [INF] Upgrade: osd.1 is safe to restart 2021-03-10T13:55:32.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:32 gibba013 bash[30381]: cluster 2021-03-10T13:55:30.431858+0000 mgr.gibba020.yqfnwy (mgr.34427) 126 : cluster [DBG] pgmap v51: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:55:32.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:32 gibba013 bash[30381]: audit 2021-03-10T13:55:31.004472+0000 mgr.gibba020.yqfnwy (mgr.34427) 127 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T13:55:32.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:32 gibba013 bash[30381]: cephadm 2021-03-10T13:55:31.009114+0000 mgr.gibba020.yqfnwy (mgr.34427) 128 : cephadm [INF] Upgrade: osd.1 is safe to restart 2021-03-10T13:55:32.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:32 gibba020 bash[25448]: cluster 2021-03-10T13:55:30.431858+0000 mgr.gibba020.yqfnwy (mgr.34427) 126 : cluster [DBG] pgmap v51: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:55:32.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:32 gibba020 bash[25448]: audit 2021-03-10T13:55:31.004472+0000 mgr.gibba020.yqfnwy (mgr.34427) 127 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T13:55:32.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:32 gibba020 bash[25448]: cephadm 2021-03-10T13:55:31.009114+0000 mgr.gibba020.yqfnwy (mgr.34427) 128 : cephadm [INF] Upgrade: osd.1 is safe to restart 2021-03-10T13:55:34.091 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:33 gibba013 bash[29418]: cluster 2021-03-10T13:55:32.433734+0000 mgr.gibba020.yqfnwy (mgr.34427) 129 : cluster [DBG] pgmap v52: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:55:34.091 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:33 gibba013 bash[29418]: cephadm 2021-03-10T13:55:32.880919+0000 mgr.gibba020.yqfnwy (mgr.34427) 130 : cephadm [INF] Upgrade: Updating osd.1 2021-03-10T13:55:34.091 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:33 gibba013 bash[29418]: audit 2021-03-10T13:55:32.888519+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:34.091 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:33 gibba013 bash[29418]: cephadm 2021-03-10T13:55:32.890897+0000 mgr.gibba020.yqfnwy (mgr.34427) 131 : cephadm [INF] Deploying daemon osd.1 on gibba013 2021-03-10T13:55:34.092 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:33 gibba013 bash[29418]: audit 2021-03-10T13:55:32.894037+0000 mon.a (mon.0) 213 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2021-03-10T13:55:34.092 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:33 gibba013 bash[30381]: cluster 2021-03-10T13:55:32.433734+0000 mgr.gibba020.yqfnwy (mgr.34427) 129 : cluster [DBG] pgmap v52: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:55:34.092 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:33 gibba013 bash[30381]: cephadm 2021-03-10T13:55:32.880919+0000 mgr.gibba020.yqfnwy (mgr.34427) 130 : cephadm [INF] Upgrade: Updating osd.1 2021-03-10T13:55:34.092 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:33 gibba013 bash[30381]: audit 2021-03-10T13:55:32.888519+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:34.093 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:33 gibba013 bash[30381]: cephadm 2021-03-10T13:55:32.890897+0000 mgr.gibba020.yqfnwy (mgr.34427) 131 : cephadm [INF] Deploying daemon osd.1 on gibba013 2021-03-10T13:55:34.093 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:33 gibba013 bash[30381]: audit 2021-03-10T13:55:32.894037+0000 mon.a (mon.0) 213 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2021-03-10T13:55:34.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:33 gibba020 bash[25448]: cluster 2021-03-10T13:55:32.433734+0000 mgr.gibba020.yqfnwy (mgr.34427) 129 : cluster [DBG] pgmap v52: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:55:34.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:33 gibba020 bash[25448]: cephadm 2021-03-10T13:55:32.880919+0000 mgr.gibba020.yqfnwy (mgr.34427) 130 : cephadm [INF] Upgrade: Updating osd.1 2021-03-10T13:55:34.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:33 gibba020 bash[25448]: audit 2021-03-10T13:55:32.888519+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:34.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:33 gibba020 bash[25448]: cephadm 2021-03-10T13:55:32.890897+0000 mgr.gibba020.yqfnwy (mgr.34427) 131 : cephadm [INF] Deploying daemon osd.1 on gibba013 2021-03-10T13:55:34.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:33 gibba020 bash[25448]: audit 2021-03-10T13:55:32.894037+0000 mon.a (mon.0) 213 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2021-03-10T13:55:34.877 INFO:journalctl@ceph.osd.1.gibba013.stdout:Mar 10 13:55:34 gibba013 systemd[1]: Stopping Ceph osd.1 for 7672acc8-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:55:35.085 INFO:journalctl@ceph.osd.1.gibba013.stdout:Mar 10 13:55:34 gibba013 bash[16389]: debug 2021-03-10T13:55:34.741+0000 7f942dee1700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T13:55:35.085 INFO:journalctl@ceph.osd.1.gibba013.stdout:Mar 10 13:55:34 gibba013 bash[16389]: debug 2021-03-10T13:55:34.741+0000 7f942dee1700 -1 osd.1 67 *** Got signal Terminated *** 2021-03-10T13:55:35.085 INFO:journalctl@ceph.osd.1.gibba013.stdout:Mar 10 13:55:34 gibba013 bash[16389]: debug 2021-03-10T13:55:34.741+0000 7f942dee1700 -1 osd.1 67 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-03-10T13:55:35.878 INFO:journalctl@ceph.osd.1.gibba013.stdout:Mar 10 13:55:35 gibba013 docker[33068]: ceph-7672acc8-81a6-11eb-9080-001a4aab830c-osd.1 2021-03-10T13:55:35.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[29418]: cluster 2021-03-10T13:55:34.434953+0000 mgr.gibba020.yqfnwy (mgr.34427) 132 : cluster [DBG] pgmap v53: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:55:35.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[29418]: cluster 2021-03-10T13:55:34.875665+0000 mon.a (mon.0) 214 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T13:55:35.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[29418]: cluster 2021-03-10T13:55:34.875703+0000 mon.a (mon.0) 215 : cluster [INF] osd.1 failed (root=default,host=gibba013) (connection refused reported by osd.4) 2021-03-10T13:55:35.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[29418]: cluster 2021-03-10T13:55:34.875923+0000 mon.a (mon.0) 216 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T13:55:35.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[29418]: cluster 2021-03-10T13:55:34.876061+0000 mon.a (mon.0) 217 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T13:55:35.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[29418]: cluster 2021-03-10T13:55:34.876191+0000 mon.a (mon.0) 218 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T13:55:35.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[29418]: cluster 2021-03-10T13:55:34.876327+0000 mon.a (mon.0) 219 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T13:55:35.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[29418]: cluster 2021-03-10T13:55:34.876452+0000 mon.a (mon.0) 220 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T13:55:35.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[29418]: cluster 2021-03-10T13:55:34.876654+0000 mon.a (mon.0) 221 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T13:55:35.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[29418]: cluster 2021-03-10T13:55:34.876774+0000 mon.a (mon.0) 222 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T13:55:35.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[29418]: cluster 2021-03-10T13:55:35.076100+0000 mon.a (mon.0) 223 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T13:55:35.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[29418]: cluster 2021-03-10T13:55:35.076435+0000 mon.a (mon.0) 224 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T13:55:35.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[29418]: cluster 2021-03-10T13:55:35.077232+0000 mon.a (mon.0) 225 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T13:55:35.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[29418]: cluster 2021-03-10T13:55:35.077537+0000 mon.a (mon.0) 226 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T13:55:35.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[29418]: cluster 2021-03-10T13:55:35.078313+0000 mon.a (mon.0) 227 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T13:55:35.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[29418]: cluster 2021-03-10T13:55:35.078625+0000 mon.a (mon.0) 228 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T13:55:35.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[29418]: cluster 2021-03-10T13:55:35.079533+0000 mon.a (mon.0) 229 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:55:35.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[29418]: cluster 2021-03-10T13:55:35.079880+0000 mon.a (mon.0) 230 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T13:55:35.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[29418]: cluster 2021-03-10T13:55:35.080664+0000 mon.a (mon.0) 231 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T13:55:35.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[29418]: cluster 2021-03-10T13:55:35.080976+0000 mon.a (mon.0) 232 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T13:55:35.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[29418]: cluster 2021-03-10T13:55:35.081470+0000 mon.a (mon.0) 233 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T13:55:35.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[29418]: cluster 2021-03-10T13:55:35.081551+0000 mon.a (mon.0) 234 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:55:35.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[29418]: cluster 2021-03-10T13:55:35.081706+0000 mon.a (mon.0) 235 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T13:55:35.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[29418]: cluster 2021-03-10T13:55:35.081786+0000 mon.a (mon.0) 236 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T13:55:35.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[29418]: cluster 2021-03-10T13:55:35.475780+0000 mon.a (mon.0) 237 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T13:55:35.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[30381]: cluster 2021-03-10T13:55:34.434953+0000 mgr.gibba020.yqfnwy (mgr.34427) 132 : cluster [DBG] pgmap v53: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:55:35.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[30381]: cluster 2021-03-10T13:55:34.875665+0000 mon.a (mon.0) 214 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T13:55:35.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[30381]: cluster 2021-03-10T13:55:34.875703+0000 mon.a (mon.0) 215 : cluster [INF] osd.1 failed (root=default,host=gibba013) (connection refused reported by osd.4) 2021-03-10T13:55:35.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[30381]: cluster 2021-03-10T13:55:34.875923+0000 mon.a (mon.0) 216 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T13:55:35.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[30381]: cluster 2021-03-10T13:55:34.876061+0000 mon.a (mon.0) 217 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T13:55:35.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[30381]: cluster 2021-03-10T13:55:34.876191+0000 mon.a (mon.0) 218 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T13:55:35.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[30381]: cluster 2021-03-10T13:55:34.876327+0000 mon.a (mon.0) 219 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T13:55:35.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[30381]: cluster 2021-03-10T13:55:34.876452+0000 mon.a (mon.0) 220 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T13:55:35.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[30381]: cluster 2021-03-10T13:55:34.876654+0000 mon.a (mon.0) 221 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T13:55:35.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[30381]: cluster 2021-03-10T13:55:34.876774+0000 mon.a (mon.0) 222 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T13:55:35.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[30381]: cluster 2021-03-10T13:55:35.076100+0000 mon.a (mon.0) 223 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T13:55:35.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[30381]: cluster 2021-03-10T13:55:35.076435+0000 mon.a (mon.0) 224 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T13:55:35.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[30381]: cluster 2021-03-10T13:55:35.077232+0000 mon.a (mon.0) 225 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T13:55:35.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[30381]: cluster 2021-03-10T13:55:35.077537+0000 mon.a (mon.0) 226 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T13:55:35.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[30381]: cluster 2021-03-10T13:55:35.078313+0000 mon.a (mon.0) 227 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T13:55:35.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[30381]: cluster 2021-03-10T13:55:35.078625+0000 mon.a (mon.0) 228 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T13:55:35.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[30381]: cluster 2021-03-10T13:55:35.079533+0000 mon.a (mon.0) 229 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:55:35.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[30381]: cluster 2021-03-10T13:55:35.079880+0000 mon.a (mon.0) 230 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T13:55:35.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[30381]: cluster 2021-03-10T13:55:35.080664+0000 mon.a (mon.0) 231 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T13:55:35.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[30381]: cluster 2021-03-10T13:55:35.080976+0000 mon.a (mon.0) 232 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T13:55:35.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[30381]: cluster 2021-03-10T13:55:35.081470+0000 mon.a (mon.0) 233 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T13:55:35.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[30381]: cluster 2021-03-10T13:55:35.081551+0000 mon.a (mon.0) 234 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:55:35.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[30381]: cluster 2021-03-10T13:55:35.081706+0000 mon.a (mon.0) 235 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T13:55:35.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[30381]: cluster 2021-03-10T13:55:35.081786+0000 mon.a (mon.0) 236 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T13:55:35.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[30381]: cluster 2021-03-10T13:55:35.475780+0000 mon.a (mon.0) 237 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T13:55:35.890 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[29418]: cluster 2021-03-10T13:55:35.476499+0000 mon.a (mon.0) 238 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:55:35.890 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[29418]: cluster 2021-03-10T13:55:35.477022+0000 mon.a (mon.0) 239 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T13:55:35.891 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[29418]: cluster 2021-03-10T13:55:35.477256+0000 mon.a (mon.0) 240 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T13:55:35.891 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[29418]: cluster 2021-03-10T13:55:35.477824+0000 mon.a (mon.0) 241 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:55:35.891 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[29418]: cluster 2021-03-10T13:55:35.478054+0000 mon.a (mon.0) 242 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T13:55:35.891 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[29418]: cluster 2021-03-10T13:55:35.483231+0000 mon.a (mon.0) 243 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T13:55:35.892 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[29418]: cluster 2021-03-10T13:55:35.483506+0000 mon.a (mon.0) 244 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T13:55:35.892 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[29418]: cluster 2021-03-10T13:55:35.483951+0000 mon.a (mon.0) 245 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T13:55:35.892 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[29418]: cluster 2021-03-10T13:55:35.484127+0000 mon.a (mon.0) 246 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T13:55:35.892 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[29418]: cluster 2021-03-10T13:55:35.484687+0000 mon.a (mon.0) 247 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T13:55:35.892 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[29418]: cluster 2021-03-10T13:55:35.484876+0000 mon.a (mon.0) 248 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T13:55:35.893 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[29418]: cluster 2021-03-10T13:55:35.485378+0000 mon.a (mon.0) 249 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T13:55:35.893 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[29418]: cluster 2021-03-10T13:55:35.485662+0000 mon.a (mon.0) 250 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T13:55:35.893 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[30381]: cluster 2021-03-10T13:55:35.476499+0000 mon.a (mon.0) 238 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:55:35.893 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[30381]: cluster 2021-03-10T13:55:35.477022+0000 mon.a (mon.0) 239 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T13:55:35.894 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[30381]: cluster 2021-03-10T13:55:35.477256+0000 mon.a (mon.0) 240 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T13:55:35.894 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[30381]: cluster 2021-03-10T13:55:35.477824+0000 mon.a (mon.0) 241 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:55:35.894 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[30381]: cluster 2021-03-10T13:55:35.478054+0000 mon.a (mon.0) 242 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T13:55:35.894 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[30381]: cluster 2021-03-10T13:55:35.483231+0000 mon.a (mon.0) 243 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T13:55:35.894 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[30381]: cluster 2021-03-10T13:55:35.483506+0000 mon.a (mon.0) 244 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T13:55:35.895 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[30381]: cluster 2021-03-10T13:55:35.483951+0000 mon.a (mon.0) 245 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T13:55:35.895 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[30381]: cluster 2021-03-10T13:55:35.484127+0000 mon.a (mon.0) 246 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T13:55:35.895 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[30381]: cluster 2021-03-10T13:55:35.484687+0000 mon.a (mon.0) 247 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T13:55:35.895 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[30381]: cluster 2021-03-10T13:55:35.484876+0000 mon.a (mon.0) 248 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T13:55:35.895 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[30381]: cluster 2021-03-10T13:55:35.485378+0000 mon.a (mon.0) 249 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T13:55:35.896 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:35 gibba013 bash[30381]: cluster 2021-03-10T13:55:35.485662+0000 mon.a (mon.0) 250 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T13:55:36.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:35 gibba020 bash[25448]: cluster 2021-03-10T13:55:34.434953+0000 mgr.gibba020.yqfnwy (mgr.34427) 132 : cluster [DBG] pgmap v53: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:55:36.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:35 gibba020 bash[25448]: cluster 2021-03-10T13:55:34.875665+0000 mon.a (mon.0) 214 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T13:55:36.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:35 gibba020 bash[25448]: cluster 2021-03-10T13:55:34.875703+0000 mon.a (mon.0) 215 : cluster [INF] osd.1 failed (root=default,host=gibba013) (connection refused reported by osd.4) 2021-03-10T13:55:36.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:35 gibba020 bash[25448]: cluster 2021-03-10T13:55:34.875923+0000 mon.a (mon.0) 216 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T13:55:36.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:35 gibba020 bash[25448]: cluster 2021-03-10T13:55:34.876061+0000 mon.a (mon.0) 217 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T13:55:36.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:35 gibba020 bash[25448]: cluster 2021-03-10T13:55:34.876191+0000 mon.a (mon.0) 218 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T13:55:36.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:35 gibba020 bash[25448]: cluster 2021-03-10T13:55:34.876327+0000 mon.a (mon.0) 219 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T13:55:36.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:35 gibba020 bash[25448]: cluster 2021-03-10T13:55:34.876452+0000 mon.a (mon.0) 220 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T13:55:36.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:35 gibba020 bash[25448]: cluster 2021-03-10T13:55:34.876654+0000 mon.a (mon.0) 221 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T13:55:36.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:35 gibba020 bash[25448]: cluster 2021-03-10T13:55:34.876774+0000 mon.a (mon.0) 222 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T13:55:36.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:35 gibba020 bash[25448]: cluster 2021-03-10T13:55:35.076100+0000 mon.a (mon.0) 223 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T13:55:36.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:35 gibba020 bash[25448]: cluster 2021-03-10T13:55:35.076435+0000 mon.a (mon.0) 224 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T13:55:36.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:35 gibba020 bash[25448]: cluster 2021-03-10T13:55:35.077232+0000 mon.a (mon.0) 225 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T13:55:36.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:35 gibba020 bash[25448]: cluster 2021-03-10T13:55:35.077537+0000 mon.a (mon.0) 226 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T13:55:36.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:35 gibba020 bash[25448]: cluster 2021-03-10T13:55:35.078313+0000 mon.a (mon.0) 227 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T13:55:36.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:35 gibba020 bash[25448]: cluster 2021-03-10T13:55:35.078625+0000 mon.a (mon.0) 228 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T13:55:36.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:35 gibba020 bash[25448]: cluster 2021-03-10T13:55:35.079533+0000 mon.a (mon.0) 229 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:55:36.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:35 gibba020 bash[25448]: cluster 2021-03-10T13:55:35.079880+0000 mon.a (mon.0) 230 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T13:55:36.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:35 gibba020 bash[25448]: cluster 2021-03-10T13:55:35.080664+0000 mon.a (mon.0) 231 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T13:55:36.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:35 gibba020 bash[25448]: cluster 2021-03-10T13:55:35.080976+0000 mon.a (mon.0) 232 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T13:55:36.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:35 gibba020 bash[25448]: cluster 2021-03-10T13:55:35.081470+0000 mon.a (mon.0) 233 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T13:55:36.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:35 gibba020 bash[25448]: cluster 2021-03-10T13:55:35.081551+0000 mon.a (mon.0) 234 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:55:36.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:35 gibba020 bash[25448]: cluster 2021-03-10T13:55:35.081706+0000 mon.a (mon.0) 235 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T13:55:36.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:35 gibba020 bash[25448]: cluster 2021-03-10T13:55:35.081786+0000 mon.a (mon.0) 236 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T13:55:36.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:35 gibba020 bash[25448]: cluster 2021-03-10T13:55:35.475780+0000 mon.a (mon.0) 237 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T13:55:36.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:35 gibba020 bash[25448]: cluster 2021-03-10T13:55:35.476499+0000 mon.a (mon.0) 238 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:55:36.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:35 gibba020 bash[25448]: cluster 2021-03-10T13:55:35.477022+0000 mon.a (mon.0) 239 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T13:55:36.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:35 gibba020 bash[25448]: cluster 2021-03-10T13:55:35.477256+0000 mon.a (mon.0) 240 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T13:55:36.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:35 gibba020 bash[25448]: cluster 2021-03-10T13:55:35.477824+0000 mon.a (mon.0) 241 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T13:55:36.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:35 gibba020 bash[25448]: cluster 2021-03-10T13:55:35.478054+0000 mon.a (mon.0) 242 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T13:55:36.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:35 gibba020 bash[25448]: cluster 2021-03-10T13:55:35.483231+0000 mon.a (mon.0) 243 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T13:55:36.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:35 gibba020 bash[25448]: cluster 2021-03-10T13:55:35.483506+0000 mon.a (mon.0) 244 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T13:55:36.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:35 gibba020 bash[25448]: cluster 2021-03-10T13:55:35.483951+0000 mon.a (mon.0) 245 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T13:55:36.206 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:35 gibba020 bash[25448]: cluster 2021-03-10T13:55:35.484127+0000 mon.a (mon.0) 246 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T13:55:36.206 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:35 gibba020 bash[25448]: cluster 2021-03-10T13:55:35.484687+0000 mon.a (mon.0) 247 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T13:55:36.206 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:35 gibba020 bash[25448]: cluster 2021-03-10T13:55:35.484876+0000 mon.a (mon.0) 248 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T13:55:36.206 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:35 gibba020 bash[25448]: cluster 2021-03-10T13:55:35.485378+0000 mon.a (mon.0) 249 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T13:55:36.206 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:35 gibba020 bash[25448]: cluster 2021-03-10T13:55:35.485662+0000 mon.a (mon.0) 250 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T13:55:37.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:36 gibba013 bash[29418]: cluster 2021-03-10T13:55:35.726088+0000 mon.a (mon.0) 251 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:55:37.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:36 gibba013 bash[29418]: cluster 2021-03-10T13:55:35.738678+0000 mon.a (mon.0) 252 : cluster [DBG] osdmap e68: 8 total, 7 up, 8 in 2021-03-10T13:55:37.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:36 gibba013 bash[30381]: cluster 2021-03-10T13:55:35.726088+0000 mon.a (mon.0) 251 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:55:37.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:36 gibba013 bash[30381]: cluster 2021-03-10T13:55:35.738678+0000 mon.a (mon.0) 252 : cluster [DBG] osdmap e68: 8 total, 7 up, 8 in 2021-03-10T13:55:37.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:36 gibba020 bash[25448]: cluster 2021-03-10T13:55:35.726088+0000 mon.a (mon.0) 251 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:55:37.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:36 gibba020 bash[25448]: cluster 2021-03-10T13:55:35.738678+0000 mon.a (mon.0) 252 : cluster [DBG] osdmap e68: 8 total, 7 up, 8 in 2021-03-10T13:55:37.627 INFO:journalctl@ceph.osd.1.gibba013.stdout:Mar 10 13:55:37 gibba013 systemd[1]: ceph-7672acc8-81a6-11eb-9080-001a4aab830c@osd.1.service: Succeeded. 2021-03-10T13:55:37.628 INFO:journalctl@ceph.osd.1.gibba013.stdout:Mar 10 13:55:37 gibba013 systemd[1]: Stopped Ceph osd.1 for 7672acc8-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:55:37.628 INFO:journalctl@ceph.osd.1.gibba013.stdout:Mar 10 13:55:37 gibba013 systemd[1]: Started Ceph osd.1 for 7672acc8-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:55:38.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:37 gibba013 bash[29418]: cluster 2021-03-10T13:55:36.436102+0000 mgr.gibba020.yqfnwy (mgr.34427) 133 : cluster [DBG] pgmap v55: 129 pgs: 18 stale+active+clean, 16 active+clean+wait, 95 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:55:38.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:37 gibba013 bash[29418]: cluster 2021-03-10T13:55:36.742320+0000 mon.a (mon.0) 253 : cluster [DBG] osdmap e69: 8 total, 7 up, 8 in 2021-03-10T13:55:38.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:37 gibba013 bash[29418]: audit 2021-03-10T13:55:37.461913+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:38.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:37 gibba013 bash[29418]: audit 2021-03-10T13:55:37.463842+0000 mon.a (mon.0) 255 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:55:38.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:37 gibba013 bash[29418]: audit 2021-03-10T13:55:37.467743+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:55:38.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:37 gibba013 bash[30381]: cluster 2021-03-10T13:55:36.436102+0000 mgr.gibba020.yqfnwy (mgr.34427) 133 : cluster [DBG] pgmap v55: 129 pgs: 18 stale+active+clean, 16 active+clean+wait, 95 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:55:38.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:37 gibba013 bash[30381]: cluster 2021-03-10T13:55:36.742320+0000 mon.a (mon.0) 253 : cluster [DBG] osdmap e69: 8 total, 7 up, 8 in 2021-03-10T13:55:38.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:37 gibba013 bash[30381]: audit 2021-03-10T13:55:37.461913+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:38.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:37 gibba013 bash[30381]: audit 2021-03-10T13:55:37.463842+0000 mon.a (mon.0) 255 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:55:38.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:37 gibba013 bash[30381]: audit 2021-03-10T13:55:37.467743+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:55:38.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:37 gibba020 bash[25448]: cluster 2021-03-10T13:55:36.436102+0000 mgr.gibba020.yqfnwy (mgr.34427) 133 : cluster [DBG] pgmap v55: 129 pgs: 18 stale+active+clean, 16 active+clean+wait, 95 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:55:38.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:37 gibba020 bash[25448]: cluster 2021-03-10T13:55:36.742320+0000 mon.a (mon.0) 253 : cluster [DBG] osdmap e69: 8 total, 7 up, 8 in 2021-03-10T13:55:38.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:37 gibba020 bash[25448]: audit 2021-03-10T13:55:37.461913+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:38.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:37 gibba020 bash[25448]: audit 2021-03-10T13:55:37.463842+0000 mon.a (mon.0) 255 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:55:38.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:37 gibba020 bash[25448]: audit 2021-03-10T13:55:37.467743+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:55:38.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:38 gibba013 bash[29418]: cluster 2021-03-10T13:55:38.753585+0000 mon.a (mon.0) 257 : cluster [WRN] Health check failed: Reduced data availability: 7 pgs inactive, 13 pgs peering (PG_AVAILABILITY) 2021-03-10T13:55:38.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:38 gibba013 bash[30381]: cluster 2021-03-10T13:55:38.753585+0000 mon.a (mon.0) 257 : cluster [WRN] Health check failed: Reduced data availability: 7 pgs inactive, 13 pgs peering (PG_AVAILABILITY) 2021-03-10T13:55:38.879 INFO:journalctl@ceph.osd.1.gibba013.stdout:Mar 10 13:55:38 gibba013 bash[33250]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-03-10T13:55:38.879 INFO:journalctl@ceph.osd.1.gibba013.stdout:Mar 10 13:55:38 gibba013 bash[33250]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2021-03-10T13:55:38.880 INFO:journalctl@ceph.osd.1.gibba013.stdout:Mar 10 13:55:38 gibba013 bash[33250]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2021-03-10T13:55:38.880 INFO:journalctl@ceph.osd.1.gibba013.stdout:Mar 10 13:55:38 gibba013 bash[33250]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2021-03-10T13:55:38.880 INFO:journalctl@ceph.osd.1.gibba013.stdout:Mar 10 13:55:38 gibba013 bash[33250]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2021-03-10T13:55:38.880 INFO:journalctl@ceph.osd.1.gibba013.stdout:Mar 10 13:55:38 gibba013 bash[33250]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-03-10T13:55:38.880 INFO:journalctl@ceph.osd.1.gibba013.stdout:Mar 10 13:55:38 gibba013 bash[33250]: --> ceph-volume lvm activate successful for osd ID: 1 2021-03-10T13:55:39.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:38 gibba020 bash[25448]: cluster 2021-03-10T13:55:38.753585+0000 mon.a (mon.0) 257 : cluster [WRN] Health check failed: Reduced data availability: 7 pgs inactive, 13 pgs peering (PG_AVAILABILITY) 2021-03-10T13:55:40.079 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:39 gibba013 bash[29418]: cluster 2021-03-10T13:55:38.437523+0000 mgr.gibba020.yqfnwy (mgr.34427) 134 : cluster [DBG] pgmap v57: 129 pgs: 51 peering, 5 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:55:40.080 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:39 gibba013 bash[30381]: cluster 2021-03-10T13:55:38.437523+0000 mgr.gibba020.yqfnwy (mgr.34427) 134 : cluster [DBG] pgmap v57: 129 pgs: 51 peering, 5 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:55:40.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:39 gibba020 bash[25448]: cluster 2021-03-10T13:55:38.437523+0000 mgr.gibba020.yqfnwy (mgr.34427) 134 : cluster [DBG] pgmap v57: 129 pgs: 51 peering, 5 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:55:40.378 INFO:journalctl@ceph.osd.1.gibba013.stdout:Mar 10 13:55:40 gibba013 bash[33378]: debug 2021-03-10T13:55:40.097+0000 7fc7c1932700 1 -- 172.21.2.113:0/3603894492 <== mon.0 v2:172.21.2.113:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ad9d3b64e0 con 0x55ad9d433400 2021-03-10T13:55:41.128 INFO:journalctl@ceph.osd.1.gibba013.stdout:Mar 10 13:55:40 gibba013 bash[33378]: debug 2021-03-10T13:55:40.657+0000 7fc7c93c7080 -1 Falling back to public interface 2021-03-10T13:55:42.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:41 gibba013 bash[29418]: cluster 2021-03-10T13:55:40.438620+0000 mgr.gibba020.yqfnwy (mgr.34427) 135 : cluster [DBG] pgmap v58: 129 pgs: 51 peering, 5 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:55:42.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:41 gibba013 bash[29418]: audit 2021-03-10T13:55:41.542743+0000 mon.a (mon.0) 258 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:42.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:41 gibba013 bash[29418]: audit 2021-03-10T13:55:41.546819+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:42.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:41 gibba013 bash[29418]: audit 2021-03-10T13:55:41.551185+0000 mon.a (mon.0) 260 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:55:42.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:41 gibba013 bash[29418]: audit 2021-03-10T13:55:41.552979+0000 mon.a (mon.0) 261 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:42.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:41 gibba013 bash[29418]: audit 2021-03-10T13:55:41.554633+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:42.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:41 gibba013 bash[29418]: audit 2021-03-10T13:55:41.556198+0000 mon.a (mon.0) 263 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:42.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:41 gibba013 bash[29418]: audit 2021-03-10T13:55:41.559368+0000 mon.a (mon.0) 264 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T13:55:42.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:41 gibba013 bash[30381]: cluster 2021-03-10T13:55:40.438620+0000 mgr.gibba020.yqfnwy (mgr.34427) 135 : cluster [DBG] pgmap v58: 129 pgs: 51 peering, 5 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:55:42.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:41 gibba013 bash[30381]: audit 2021-03-10T13:55:41.542743+0000 mon.a (mon.0) 258 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:42.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:41 gibba013 bash[30381]: audit 2021-03-10T13:55:41.546819+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:42.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:41 gibba013 bash[30381]: audit 2021-03-10T13:55:41.551185+0000 mon.a (mon.0) 260 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:55:42.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:41 gibba013 bash[30381]: audit 2021-03-10T13:55:41.552979+0000 mon.a (mon.0) 261 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:42.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:41 gibba013 bash[30381]: audit 2021-03-10T13:55:41.554633+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:42.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:41 gibba013 bash[30381]: audit 2021-03-10T13:55:41.556198+0000 mon.a (mon.0) 263 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:42.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:41 gibba013 bash[30381]: audit 2021-03-10T13:55:41.559368+0000 mon.a (mon.0) 264 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T13:55:42.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:41 gibba020 bash[25448]: cluster 2021-03-10T13:55:40.438620+0000 mgr.gibba020.yqfnwy (mgr.34427) 135 : cluster [DBG] pgmap v58: 129 pgs: 51 peering, 5 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T13:55:42.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:41 gibba020 bash[25448]: audit 2021-03-10T13:55:41.542743+0000 mon.a (mon.0) 258 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:42.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:41 gibba020 bash[25448]: audit 2021-03-10T13:55:41.546819+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:42.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:41 gibba020 bash[25448]: audit 2021-03-10T13:55:41.551185+0000 mon.a (mon.0) 260 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:55:42.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:41 gibba020 bash[25448]: audit 2021-03-10T13:55:41.552979+0000 mon.a (mon.0) 261 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:42.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:41 gibba020 bash[25448]: audit 2021-03-10T13:55:41.554633+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:42.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:41 gibba020 bash[25448]: audit 2021-03-10T13:55:41.556198+0000 mon.a (mon.0) 263 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:42.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:41 gibba020 bash[25448]: audit 2021-03-10T13:55:41.559368+0000 mon.a (mon.0) 264 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T13:55:43.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:42 gibba013 bash[29418]: cephadm 2021-03-10T13:55:41.548595+0000 mgr.gibba020.yqfnwy (mgr.34427) 136 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:55:43.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:42 gibba013 bash[29418]: cephadm 2021-03-10T13:55:41.550679+0000 mgr.gibba020.yqfnwy (mgr.34427) 137 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:55:43.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:42 gibba013 bash[29418]: cephadm 2021-03-10T13:55:41.552266+0000 mgr.gibba020.yqfnwy (mgr.34427) 138 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:55:43.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:42 gibba013 bash[29418]: cephadm 2021-03-10T13:55:41.552312+0000 mgr.gibba020.yqfnwy (mgr.34427) 139 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:55:43.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:42 gibba013 bash[29418]: cephadm 2021-03-10T13:55:41.553913+0000 mgr.gibba020.yqfnwy (mgr.34427) 140 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:55:43.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:42 gibba013 bash[29418]: cephadm 2021-03-10T13:55:41.553960+0000 mgr.gibba020.yqfnwy (mgr.34427) 141 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:55:43.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:42 gibba013 bash[29418]: cephadm 2021-03-10T13:55:41.555382+0000 mgr.gibba020.yqfnwy (mgr.34427) 142 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:55:43.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:42 gibba013 bash[29418]: cephadm 2021-03-10T13:55:41.556834+0000 mgr.gibba020.yqfnwy (mgr.34427) 143 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:55:43.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:42 gibba013 bash[29418]: cephadm 2021-03-10T13:55:41.556884+0000 mgr.gibba020.yqfnwy (mgr.34427) 144 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:55:43.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:42 gibba013 bash[29418]: audit 2021-03-10T13:55:41.557760+0000 mgr.gibba020.yqfnwy (mgr.34427) 145 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T13:55:43.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:42 gibba013 bash[29418]: cephadm 2021-03-10T13:55:41.559249+0000 mgr.gibba020.yqfnwy (mgr.34427) 146 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2021-03-10T13:55:43.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:42 gibba013 bash[30381]: cephadm 2021-03-10T13:55:41.548595+0000 mgr.gibba020.yqfnwy (mgr.34427) 136 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:55:43.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:42 gibba013 bash[30381]: cephadm 2021-03-10T13:55:41.550679+0000 mgr.gibba020.yqfnwy (mgr.34427) 137 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:55:43.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:42 gibba013 bash[30381]: cephadm 2021-03-10T13:55:41.552266+0000 mgr.gibba020.yqfnwy (mgr.34427) 138 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:55:43.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:42 gibba013 bash[30381]: cephadm 2021-03-10T13:55:41.552312+0000 mgr.gibba020.yqfnwy (mgr.34427) 139 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:55:43.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:42 gibba013 bash[30381]: cephadm 2021-03-10T13:55:41.553913+0000 mgr.gibba020.yqfnwy (mgr.34427) 140 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:55:43.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:42 gibba013 bash[30381]: cephadm 2021-03-10T13:55:41.553960+0000 mgr.gibba020.yqfnwy (mgr.34427) 141 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:55:43.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:42 gibba013 bash[30381]: cephadm 2021-03-10T13:55:41.555382+0000 mgr.gibba020.yqfnwy (mgr.34427) 142 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:55:43.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:42 gibba013 bash[30381]: cephadm 2021-03-10T13:55:41.556834+0000 mgr.gibba020.yqfnwy (mgr.34427) 143 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:55:43.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:42 gibba013 bash[30381]: cephadm 2021-03-10T13:55:41.556884+0000 mgr.gibba020.yqfnwy (mgr.34427) 144 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:55:43.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:42 gibba013 bash[30381]: audit 2021-03-10T13:55:41.557760+0000 mgr.gibba020.yqfnwy (mgr.34427) 145 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T13:55:43.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:42 gibba013 bash[30381]: cephadm 2021-03-10T13:55:41.559249+0000 mgr.gibba020.yqfnwy (mgr.34427) 146 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2021-03-10T13:55:43.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:42 gibba020 bash[25448]: cephadm 2021-03-10T13:55:41.548595+0000 mgr.gibba020.yqfnwy (mgr.34427) 136 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:55:43.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:42 gibba020 bash[25448]: cephadm 2021-03-10T13:55:41.550679+0000 mgr.gibba020.yqfnwy (mgr.34427) 137 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:55:43.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:42 gibba020 bash[25448]: cephadm 2021-03-10T13:55:41.552266+0000 mgr.gibba020.yqfnwy (mgr.34427) 138 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:55:43.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:42 gibba020 bash[25448]: cephadm 2021-03-10T13:55:41.552312+0000 mgr.gibba020.yqfnwy (mgr.34427) 139 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:55:43.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:42 gibba020 bash[25448]: cephadm 2021-03-10T13:55:41.553913+0000 mgr.gibba020.yqfnwy (mgr.34427) 140 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:55:43.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:42 gibba020 bash[25448]: cephadm 2021-03-10T13:55:41.553960+0000 mgr.gibba020.yqfnwy (mgr.34427) 141 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:55:43.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:42 gibba020 bash[25448]: cephadm 2021-03-10T13:55:41.555382+0000 mgr.gibba020.yqfnwy (mgr.34427) 142 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:55:43.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:42 gibba020 bash[25448]: cephadm 2021-03-10T13:55:41.556834+0000 mgr.gibba020.yqfnwy (mgr.34427) 143 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:55:43.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:42 gibba020 bash[25448]: cephadm 2021-03-10T13:55:41.556884+0000 mgr.gibba020.yqfnwy (mgr.34427) 144 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:55:43.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:42 gibba020 bash[25448]: audit 2021-03-10T13:55:41.557760+0000 mgr.gibba020.yqfnwy (mgr.34427) 145 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T13:55:43.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:42 gibba020 bash[25448]: cephadm 2021-03-10T13:55:41.559249+0000 mgr.gibba020.yqfnwy (mgr.34427) 146 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2021-03-10T13:55:44.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:43 gibba013 bash[29418]: cluster 2021-03-10T13:55:42.440763+0000 mgr.gibba020.yqfnwy (mgr.34427) 147 : cluster [DBG] pgmap v59: 129 pgs: 20 active+undersized+degraded, 36 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 29/192 objects degraded (15.104%) 2021-03-10T13:55:44.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:43 gibba013 bash[29418]: cluster 2021-03-10T13:55:42.820130+0000 mon.a (mon.0) 265 : cluster [WRN] Health check failed: Degraded data redundancy: 29/192 objects degraded (15.104%), 20 pgs degraded (PG_DEGRADED) 2021-03-10T13:55:44.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:43 gibba013 bash[29418]: cluster 2021-03-10T13:55:42.820269+0000 mon.a (mon.0) 266 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 7 pgs inactive, 13 pgs peering) 2021-03-10T13:55:44.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:43 gibba013 bash[30381]: cluster 2021-03-10T13:55:42.440763+0000 mgr.gibba020.yqfnwy (mgr.34427) 147 : cluster [DBG] pgmap v59: 129 pgs: 20 active+undersized+degraded, 36 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 29/192 objects degraded (15.104%) 2021-03-10T13:55:44.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:43 gibba013 bash[30381]: cluster 2021-03-10T13:55:42.820130+0000 mon.a (mon.0) 265 : cluster [WRN] Health check failed: Degraded data redundancy: 29/192 objects degraded (15.104%), 20 pgs degraded (PG_DEGRADED) 2021-03-10T13:55:44.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:43 gibba013 bash[30381]: cluster 2021-03-10T13:55:42.820269+0000 mon.a (mon.0) 266 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 7 pgs inactive, 13 pgs peering) 2021-03-10T13:55:44.130 INFO:journalctl@ceph.osd.1.gibba013.stdout:Mar 10 13:55:43 gibba013 bash[33378]: debug 2021-03-10T13:55:43.865+0000 7fc7c93c7080 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: store not yet converted to per-pg omap 2021-03-10T13:55:44.131 INFO:journalctl@ceph.osd.1.gibba013.stdout:Mar 10 13:55:43 gibba013 bash[33378]: debug 2021-03-10T13:55:43.869+0000 7fc7b468c700 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2021-03-10T13:55:44.131 INFO:journalctl@ceph.osd.1.gibba013.stdout:Mar 10 13:55:43 gibba013 bash[33378]: debug 2021-03-10T13:55:43.997+0000 7fc7c93c7080 -1 osd.1 67 log_to_monitors {default=true} 2021-03-10T13:55:44.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:43 gibba020 bash[25448]: cluster 2021-03-10T13:55:42.440763+0000 mgr.gibba020.yqfnwy (mgr.34427) 147 : cluster [DBG] pgmap v59: 129 pgs: 20 active+undersized+degraded, 36 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 29/192 objects degraded (15.104%) 2021-03-10T13:55:44.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:43 gibba020 bash[25448]: cluster 2021-03-10T13:55:42.820130+0000 mon.a (mon.0) 265 : cluster [WRN] Health check failed: Degraded data redundancy: 29/192 objects degraded (15.104%), 20 pgs degraded (PG_DEGRADED) 2021-03-10T13:55:44.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:43 gibba020 bash[25448]: cluster 2021-03-10T13:55:42.820269+0000 mon.a (mon.0) 266 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 7 pgs inactive, 13 pgs peering) 2021-03-10T13:55:45.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:44 gibba013 bash[29418]: audit 2021-03-10T13:55:44.001094+0000 mon.c (mon.1) 9 : audit [INF] from='osd.1 [v2:172.21.2.113:6808/2686359593,v1:172.21.2.113:6809/2686359593]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T13:55:45.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:44 gibba013 bash[29418]: audit 2021-03-10T13:55:44.001310+0000 mon.a (mon.0) 267 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T13:55:45.129 INFO:journalctl@ceph.osd.1.gibba013.stdout:Mar 10 13:55:44 gibba013 bash[33378]: debug 2021-03-10T13:55:44.853+0000 7fc7ba8a7700 -1 osd.1 67 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:55:45.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:44 gibba013 bash[30381]: audit 2021-03-10T13:55:44.001094+0000 mon.c (mon.1) 9 : audit [INF] from='osd.1 [v2:172.21.2.113:6808/2686359593,v1:172.21.2.113:6809/2686359593]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T13:55:45.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:44 gibba013 bash[30381]: audit 2021-03-10T13:55:44.001310+0000 mon.a (mon.0) 267 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T13:55:45.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:44 gibba020 bash[25448]: audit 2021-03-10T13:55:44.001094+0000 mon.c (mon.1) 9 : audit [INF] from='osd.1 [v2:172.21.2.113:6808/2686359593,v1:172.21.2.113:6809/2686359593]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T13:55:45.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:44 gibba020 bash[25448]: audit 2021-03-10T13:55:44.001310+0000 mon.a (mon.0) 267 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T13:55:46.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:45 gibba013 bash[29418]: cluster 2021-03-10T13:55:44.442411+0000 mgr.gibba020.yqfnwy (mgr.34427) 148 : cluster [DBG] pgmap v60: 129 pgs: 20 active+undersized+degraded, 36 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 29/192 objects degraded (15.104%) 2021-03-10T13:55:46.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:45 gibba013 bash[29418]: audit 2021-03-10T13:55:44.849614+0000 mon.a (mon.0) 268 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-03-10T13:55:46.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:45 gibba013 bash[29418]: cluster 2021-03-10T13:55:44.849681+0000 mon.a (mon.0) 269 : cluster [DBG] osdmap e70: 8 total, 7 up, 8 in 2021-03-10T13:55:46.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:45 gibba013 bash[29418]: audit 2021-03-10T13:55:44.850752+0000 mon.c (mon.1) 10 : audit [INF] from='osd.1 [v2:172.21.2.113:6808/2686359593,v1:172.21.2.113:6809/2686359593]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:55:46.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:45 gibba013 bash[29418]: audit 2021-03-10T13:55:44.851013+0000 mon.a (mon.0) 270 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:55:46.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:45 gibba013 bash[30381]: cluster 2021-03-10T13:55:44.442411+0000 mgr.gibba020.yqfnwy (mgr.34427) 148 : cluster [DBG] pgmap v60: 129 pgs: 20 active+undersized+degraded, 36 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 29/192 objects degraded (15.104%) 2021-03-10T13:55:46.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:45 gibba013 bash[30381]: audit 2021-03-10T13:55:44.849614+0000 mon.a (mon.0) 268 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-03-10T13:55:46.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:45 gibba013 bash[30381]: cluster 2021-03-10T13:55:44.849681+0000 mon.a (mon.0) 269 : cluster [DBG] osdmap e70: 8 total, 7 up, 8 in 2021-03-10T13:55:46.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:45 gibba013 bash[30381]: audit 2021-03-10T13:55:44.850752+0000 mon.c (mon.1) 10 : audit [INF] from='osd.1 [v2:172.21.2.113:6808/2686359593,v1:172.21.2.113:6809/2686359593]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:55:46.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:45 gibba013 bash[30381]: audit 2021-03-10T13:55:44.851013+0000 mon.a (mon.0) 270 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:55:46.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:45 gibba020 bash[25448]: cluster 2021-03-10T13:55:44.442411+0000 mgr.gibba020.yqfnwy (mgr.34427) 148 : cluster [DBG] pgmap v60: 129 pgs: 20 active+undersized+degraded, 36 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 29/192 objects degraded (15.104%) 2021-03-10T13:55:46.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:45 gibba020 bash[25448]: audit 2021-03-10T13:55:44.849614+0000 mon.a (mon.0) 268 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-03-10T13:55:46.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:45 gibba020 bash[25448]: cluster 2021-03-10T13:55:44.849681+0000 mon.a (mon.0) 269 : cluster [DBG] osdmap e70: 8 total, 7 up, 8 in 2021-03-10T13:55:46.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:45 gibba020 bash[25448]: audit 2021-03-10T13:55:44.850752+0000 mon.c (mon.1) 10 : audit [INF] from='osd.1 [v2:172.21.2.113:6808/2686359593,v1:172.21.2.113:6809/2686359593]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:55:46.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:45 gibba020 bash[25448]: audit 2021-03-10T13:55:44.851013+0000 mon.a (mon.0) 270 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:55:47.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:46 gibba013 bash[29418]: cluster 2021-03-10T13:55:45.849566+0000 mon.a (mon.0) 271 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:55:47.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:46 gibba013 bash[29418]: cluster 2021-03-10T13:55:45.860560+0000 mon.a (mon.0) 272 : cluster [INF] osd.1 [v2:172.21.2.113:6808/2686359593,v1:172.21.2.113:6809/2686359593] boot 2021-03-10T13:55:47.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:46 gibba013 bash[29418]: cluster 2021-03-10T13:55:45.860598+0000 mon.a (mon.0) 273 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2021-03-10T13:55:47.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:46 gibba013 bash[29418]: audit 2021-03-10T13:55:45.861004+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:55:47.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:46 gibba013 bash[29418]: cluster 2021-03-10T13:55:46.864049+0000 mon.a (mon.0) 275 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2021-03-10T13:55:47.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:46 gibba013 bash[30381]: cluster 2021-03-10T13:55:45.849566+0000 mon.a (mon.0) 271 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:55:47.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:46 gibba013 bash[30381]: cluster 2021-03-10T13:55:45.860560+0000 mon.a (mon.0) 272 : cluster [INF] osd.1 [v2:172.21.2.113:6808/2686359593,v1:172.21.2.113:6809/2686359593] boot 2021-03-10T13:55:47.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:46 gibba013 bash[30381]: cluster 2021-03-10T13:55:45.860598+0000 mon.a (mon.0) 273 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2021-03-10T13:55:47.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:46 gibba013 bash[30381]: audit 2021-03-10T13:55:45.861004+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:55:47.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:46 gibba013 bash[30381]: cluster 2021-03-10T13:55:46.864049+0000 mon.a (mon.0) 275 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2021-03-10T13:55:47.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:46 gibba020 bash[25448]: cluster 2021-03-10T13:55:45.849566+0000 mon.a (mon.0) 271 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:55:47.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:46 gibba020 bash[25448]: cluster 2021-03-10T13:55:45.860560+0000 mon.a (mon.0) 272 : cluster [INF] osd.1 [v2:172.21.2.113:6808/2686359593,v1:172.21.2.113:6809/2686359593] boot 2021-03-10T13:55:47.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:46 gibba020 bash[25448]: cluster 2021-03-10T13:55:45.860598+0000 mon.a (mon.0) 273 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2021-03-10T13:55:47.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:46 gibba020 bash[25448]: audit 2021-03-10T13:55:45.861004+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T13:55:47.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:46 gibba020 bash[25448]: cluster 2021-03-10T13:55:46.864049+0000 mon.a (mon.0) 275 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2021-03-10T13:55:48.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:47 gibba013 bash[29418]: cluster 2021-03-10T13:55:46.443604+0000 mgr.gibba020.yqfnwy (mgr.34427) 149 : cluster [DBG] pgmap v63: 129 pgs: 20 active+undersized+degraded, 36 active+undersized, 73 active+clean; 7.0 KiB data, 16 MiB used, 666 GiB / 672 GiB avail; 29/192 objects degraded (15.104%) 2021-03-10T13:55:48.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:47 gibba013 bash[30381]: cluster 2021-03-10T13:55:46.443604+0000 mgr.gibba020.yqfnwy (mgr.34427) 149 : cluster [DBG] pgmap v63: 129 pgs: 20 active+undersized+degraded, 36 active+undersized, 73 active+clean; 7.0 KiB data, 16 MiB used, 666 GiB / 672 GiB avail; 29/192 objects degraded (15.104%) 2021-03-10T13:55:48.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:47 gibba020 bash[25448]: cluster 2021-03-10T13:55:46.443604+0000 mgr.gibba020.yqfnwy (mgr.34427) 149 : cluster [DBG] pgmap v63: 129 pgs: 20 active+undersized+degraded, 36 active+undersized, 73 active+clean; 7.0 KiB data, 16 MiB used, 666 GiB / 672 GiB avail; 29/192 objects degraded (15.104%) 2021-03-10T13:55:49.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:48 gibba020 bash[25448]: cluster 2021-03-10T13:55:48.874504+0000 mon.a (mon.0) 276 : cluster [WRN] Health check update: Degraded data redundancy: 12/192 objects degraded (6.250%), 6 pgs degraded (PG_DEGRADED) 2021-03-10T13:55:49.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:48 gibba013 bash[29418]: cluster 2021-03-10T13:55:48.874504+0000 mon.a (mon.0) 276 : cluster [WRN] Health check update: Degraded data redundancy: 12/192 objects degraded (6.250%), 6 pgs degraded (PG_DEGRADED) 2021-03-10T13:55:49.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:48 gibba013 bash[30381]: cluster 2021-03-10T13:55:48.874504+0000 mon.a (mon.0) 276 : cluster [WRN] Health check update: Degraded data redundancy: 12/192 objects degraded (6.250%), 6 pgs degraded (PG_DEGRADED) 2021-03-10T13:55:50.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:49 gibba020 bash[25448]: cluster 2021-03-10T13:55:48.444893+0000 mgr.gibba020.yqfnwy (mgr.34427) 150 : cluster [DBG] pgmap v65: 129 pgs: 34 peering, 6 active+undersized+degraded, 12 active+undersized, 77 active+clean; 7.0 KiB data, 16 MiB used, 666 GiB / 672 GiB avail; 12/192 objects degraded (6.250%) 2021-03-10T13:55:50.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:49 gibba013 bash[29418]: cluster 2021-03-10T13:55:48.444893+0000 mgr.gibba020.yqfnwy (mgr.34427) 150 : cluster [DBG] pgmap v65: 129 pgs: 34 peering, 6 active+undersized+degraded, 12 active+undersized, 77 active+clean; 7.0 KiB data, 16 MiB used, 666 GiB / 672 GiB avail; 12/192 objects degraded (6.250%) 2021-03-10T13:55:50.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:49 gibba013 bash[30381]: cluster 2021-03-10T13:55:48.444893+0000 mgr.gibba020.yqfnwy (mgr.34427) 150 : cluster [DBG] pgmap v65: 129 pgs: 34 peering, 6 active+undersized+degraded, 12 active+undersized, 77 active+clean; 7.0 KiB data, 16 MiB used, 666 GiB / 672 GiB avail; 12/192 objects degraded (6.250%) 2021-03-10T13:55:51.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:50 gibba013 bash[29418]: cluster 2021-03-10T13:55:50.934857+0000 mon.a (mon.0) 277 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 12/192 objects degraded (6.250%), 6 pgs degraded) 2021-03-10T13:55:51.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:50 gibba013 bash[30381]: cluster 2021-03-10T13:55:50.934857+0000 mon.a (mon.0) 277 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 12/192 objects degraded (6.250%), 6 pgs degraded) 2021-03-10T13:55:51.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:50 gibba020 bash[25448]: cluster 2021-03-10T13:55:50.934857+0000 mon.a (mon.0) 277 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 12/192 objects degraded (6.250%), 6 pgs degraded) 2021-03-10T13:55:52.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:51 gibba013 bash[29418]: cluster 2021-03-10T13:55:50.446236+0000 mgr.gibba020.yqfnwy (mgr.34427) 151 : cluster [DBG] pgmap v66: 129 pgs: 18 active+clean+wait, 34 peering, 77 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:55:52.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:51 gibba013 bash[30381]: cluster 2021-03-10T13:55:50.446236+0000 mgr.gibba020.yqfnwy (mgr.34427) 151 : cluster [DBG] pgmap v66: 129 pgs: 18 active+clean+wait, 34 peering, 77 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:55:52.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:51 gibba020 bash[25448]: cluster 2021-03-10T13:55:50.446236+0000 mgr.gibba020.yqfnwy (mgr.34427) 151 : cluster [DBG] pgmap v66: 129 pgs: 18 active+clean+wait, 34 peering, 77 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:55:54.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:54 gibba013 bash[29418]: cluster 2021-03-10T13:55:52.448210+0000 mgr.gibba020.yqfnwy (mgr.34427) 152 : cluster [DBG] pgmap v67: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:55:54.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:54 gibba013 bash[30381]: cluster 2021-03-10T13:55:52.448210+0000 mgr.gibba020.yqfnwy (mgr.34427) 152 : cluster [DBG] pgmap v67: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:55:54.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:54 gibba020 bash[25448]: cluster 2021-03-10T13:55:52.448210+0000 mgr.gibba020.yqfnwy (mgr.34427) 152 : cluster [DBG] pgmap v67: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:55:54.617 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T13:55:54.844 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:55:54.844 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2m) 13s ago 7m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T13:55:54.845 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (7m) 77s ago 7m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T13:55:54.845 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2m) 77s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T13:55:54.845 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3m) 77s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T13:55:54.845 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2m) 13s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T13:55:54.846 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (116s) 13s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T13:55:54.846 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (88s) 77s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T13:55:54.846 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (99s) 13s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T13:55:54.846 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (7m) 13s ago 7m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T13:55:54.846 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (7m) 77s ago 7m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T13:55:54.847 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (42s) 13s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T13:55:54.847 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (15s) 13s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T13:55:54.847 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (10m) 13s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d0a99b0fd1fc 2021-03-10T13:55:54.847 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (9m) 13s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d0b507f36a88 2021-03-10T13:55:54.848 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (9m) 77s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5bcc0da1a794 2021-03-10T13:55:54.848 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (9m) 77s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 8e0d292ca03b 2021-03-10T13:55:54.848 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (8m) 77s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b54758e37be1 2021-03-10T13:55:54.848 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (8m) 77s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 75c9ee8106fc 2021-03-10T13:55:54.848 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (7m) 77s ago 7m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T13:55:54.849 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 77s ago 5m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:55:55.100 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T13:55:55.101 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T13:55:55.101 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:55:55.101 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:55:55.102 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T13:55:55.102 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:55:55.102 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:55:55.102 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T13:55:55.103 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 6, 2021-03-10T13:55:55.103 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 2 2021-03-10T13:55:55.103 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:55:55.103 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T13:55:55.103 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T13:55:55.104 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 6, 2021-03-10T13:55:55.104 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T13:55:55.104 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T13:55:55.104 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T13:55:56.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:56 gibba013 bash[29418]: cluster 2021-03-10T13:55:54.449386+0000 mgr.gibba020.yqfnwy (mgr.34427) 153 : cluster [DBG] pgmap v68: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:55:56.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:56 gibba013 bash[29418]: audit 2021-03-10T13:55:54.606280+0000 mgr.gibba020.yqfnwy (mgr.34427) 154 : audit [DBG] from='client.44184 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:55:56.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:56 gibba013 bash[29418]: audit 2021-03-10T13:55:54.831684+0000 mgr.gibba020.yqfnwy (mgr.34427) 155 : audit [DBG] from='client.44190 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:55:56.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:56 gibba013 bash[29418]: audit 2021-03-10T13:55:55.101564+0000 mon.a (mon.0) 278 : audit [DBG] from='client.? 172.21.2.113:0/1215479002' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:56.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:56 gibba013 bash[30381]: cluster 2021-03-10T13:55:54.449386+0000 mgr.gibba020.yqfnwy (mgr.34427) 153 : cluster [DBG] pgmap v68: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:55:56.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:56 gibba013 bash[30381]: audit 2021-03-10T13:55:54.606280+0000 mgr.gibba020.yqfnwy (mgr.34427) 154 : audit [DBG] from='client.44184 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:55:56.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:56 gibba013 bash[30381]: audit 2021-03-10T13:55:54.831684+0000 mgr.gibba020.yqfnwy (mgr.34427) 155 : audit [DBG] from='client.44190 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:55:56.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:56 gibba013 bash[30381]: audit 2021-03-10T13:55:55.101564+0000 mon.a (mon.0) 278 : audit [DBG] from='client.? 172.21.2.113:0/1215479002' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:56.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:56 gibba020 bash[25448]: cluster 2021-03-10T13:55:54.449386+0000 mgr.gibba020.yqfnwy (mgr.34427) 153 : cluster [DBG] pgmap v68: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:55:56.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:56 gibba020 bash[25448]: audit 2021-03-10T13:55:54.606280+0000 mgr.gibba020.yqfnwy (mgr.34427) 154 : audit [DBG] from='client.44184 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:55:56.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:56 gibba020 bash[25448]: audit 2021-03-10T13:55:54.831684+0000 mgr.gibba020.yqfnwy (mgr.34427) 155 : audit [DBG] from='client.44190 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:55:56.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:56 gibba020 bash[25448]: audit 2021-03-10T13:55:55.101564+0000 mon.a (mon.0) 278 : audit [DBG] from='client.? 172.21.2.113:0/1215479002' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:55:57.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:57 gibba013 bash[29418]: audit 2021-03-10T13:55:56.577680+0000 mon.a (mon.0) 279 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T13:55:57.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:57 gibba013 bash[30381]: audit 2021-03-10T13:55:56.577680+0000 mon.a (mon.0) 279 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T13:55:57.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:57 gibba020 bash[25448]: audit 2021-03-10T13:55:56.577680+0000 mon.a (mon.0) 279 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T13:55:58.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:58 gibba013 bash[29418]: cluster 2021-03-10T13:55:56.450471+0000 mgr.gibba020.yqfnwy (mgr.34427) 156 : cluster [DBG] pgmap v69: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:55:58.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:58 gibba013 bash[29418]: audit 2021-03-10T13:55:56.576888+0000 mgr.gibba020.yqfnwy (mgr.34427) 157 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T13:55:58.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:58 gibba013 bash[29418]: cephadm 2021-03-10T13:55:56.581427+0000 mgr.gibba020.yqfnwy (mgr.34427) 158 : cephadm [INF] Upgrade: osd.2 is safe to restart 2021-03-10T13:55:58.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:58 gibba013 bash[30381]: cluster 2021-03-10T13:55:56.450471+0000 mgr.gibba020.yqfnwy (mgr.34427) 156 : cluster [DBG] pgmap v69: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:55:58.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:58 gibba013 bash[30381]: audit 2021-03-10T13:55:56.576888+0000 mgr.gibba020.yqfnwy (mgr.34427) 157 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T13:55:58.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:58 gibba013 bash[30381]: cephadm 2021-03-10T13:55:56.581427+0000 mgr.gibba020.yqfnwy (mgr.34427) 158 : cephadm [INF] Upgrade: osd.2 is safe to restart 2021-03-10T13:55:58.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:58 gibba020 bash[25448]: cluster 2021-03-10T13:55:56.450471+0000 mgr.gibba020.yqfnwy (mgr.34427) 156 : cluster [DBG] pgmap v69: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:55:58.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:58 gibba020 bash[25448]: audit 2021-03-10T13:55:56.576888+0000 mgr.gibba020.yqfnwy (mgr.34427) 157 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T13:55:58.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:58 gibba020 bash[25448]: cephadm 2021-03-10T13:55:56.581427+0000 mgr.gibba020.yqfnwy (mgr.34427) 158 : cephadm [INF] Upgrade: osd.2 is safe to restart 2021-03-10T13:55:59.727 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:59 gibba013 bash[29418]: cluster 2021-03-10T13:55:58.452305+0000 mgr.gibba020.yqfnwy (mgr.34427) 159 : cluster [DBG] pgmap v70: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:55:59.727 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:59 gibba013 bash[29418]: cephadm 2021-03-10T13:55:58.507085+0000 mgr.gibba020.yqfnwy (mgr.34427) 160 : cephadm [INF] Upgrade: Updating osd.2 2021-03-10T13:55:59.728 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:59 gibba013 bash[29418]: audit 2021-03-10T13:55:58.514519+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:59.728 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:59 gibba013 bash[29418]: cephadm 2021-03-10T13:55:58.516763+0000 mgr.gibba020.yqfnwy (mgr.34427) 161 : cephadm [INF] Deploying daemon osd.2 on gibba013 2021-03-10T13:55:59.728 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:55:59 gibba013 bash[29418]: audit 2021-03-10T13:55:58.519578+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2021-03-10T13:55:59.729 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:59 gibba013 bash[30381]: cluster 2021-03-10T13:55:58.452305+0000 mgr.gibba020.yqfnwy (mgr.34427) 159 : cluster [DBG] pgmap v70: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:55:59.729 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:59 gibba013 bash[30381]: cephadm 2021-03-10T13:55:58.507085+0000 mgr.gibba020.yqfnwy (mgr.34427) 160 : cephadm [INF] Upgrade: Updating osd.2 2021-03-10T13:55:59.729 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:59 gibba013 bash[30381]: audit 2021-03-10T13:55:58.514519+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:59.730 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:59 gibba013 bash[30381]: cephadm 2021-03-10T13:55:58.516763+0000 mgr.gibba020.yqfnwy (mgr.34427) 161 : cephadm [INF] Deploying daemon osd.2 on gibba013 2021-03-10T13:55:59.730 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:55:59 gibba013 bash[30381]: audit 2021-03-10T13:55:58.519578+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2021-03-10T13:55:59.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:59 gibba020 bash[25448]: cluster 2021-03-10T13:55:58.452305+0000 mgr.gibba020.yqfnwy (mgr.34427) 159 : cluster [DBG] pgmap v70: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:55:59.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:59 gibba020 bash[25448]: cephadm 2021-03-10T13:55:58.507085+0000 mgr.gibba020.yqfnwy (mgr.34427) 160 : cephadm [INF] Upgrade: Updating osd.2 2021-03-10T13:55:59.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:59 gibba020 bash[25448]: audit 2021-03-10T13:55:58.514519+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:55:59.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:59 gibba020 bash[25448]: cephadm 2021-03-10T13:55:58.516763+0000 mgr.gibba020.yqfnwy (mgr.34427) 161 : cephadm [INF] Deploying daemon osd.2 on gibba013 2021-03-10T13:55:59.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:55:59 gibba020 bash[25448]: audit 2021-03-10T13:55:58.519578+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2021-03-10T13:56:00.458 INFO:journalctl@ceph.osd.2.gibba013.stdout:Mar 10 13:56:00 gibba013 systemd[1]: Stopping Ceph osd.2 for 7672acc8-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:56:00.459 INFO:journalctl@ceph.osd.2.gibba013.stdout:Mar 10 13:56:00 gibba013 bash[17903]: debug 2021-03-10T13:56:00.313+0000 7fb1d4d77700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T13:56:00.459 INFO:journalctl@ceph.osd.2.gibba013.stdout:Mar 10 13:56:00 gibba013 bash[17903]: debug 2021-03-10T13:56:00.313+0000 7fb1d4d77700 -1 osd.2 72 *** Got signal Terminated *** 2021-03-10T13:56:00.459 INFO:journalctl@ceph.osd.2.gibba013.stdout:Mar 10 13:56:00 gibba013 bash[17903]: debug 2021-03-10T13:56:00.313+0000 7fb1d4d77700 -1 osd.2 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-03-10T13:56:01.061 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:00 gibba013 bash[30381]: cluster 2021-03-10T13:56:00.433337+0000 mon.a (mon.0) 282 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T13:56:01.062 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:00 gibba013 bash[30381]: cluster 2021-03-10T13:56:00.433441+0000 mon.a (mon.0) 283 : cluster [INF] osd.2 failed (root=default,host=gibba013) (connection refused reported by osd.4) 2021-03-10T13:56:01.062 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:00 gibba013 bash[30381]: cluster 2021-03-10T13:56:00.433956+0000 mon.a (mon.0) 284 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T13:56:01.062 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:00 gibba013 bash[30381]: cluster 2021-03-10T13:56:00.630618+0000 mon.a (mon.0) 285 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T13:56:01.062 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:00 gibba013 bash[30381]: cluster 2021-03-10T13:56:00.631076+0000 mon.a (mon.0) 286 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T13:56:01.063 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:00 gibba013 bash[30381]: cluster 2021-03-10T13:56:00.631404+0000 mon.a (mon.0) 287 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T13:56:01.063 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:00 gibba013 bash[30381]: cluster 2021-03-10T13:56:00.631848+0000 mon.a (mon.0) 288 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T13:56:01.063 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:00 gibba013 bash[30381]: cluster 2021-03-10T13:56:00.632185+0000 mon.a (mon.0) 289 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T13:56:01.063 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:00 gibba013 bash[30381]: cluster 2021-03-10T13:56:00.632626+0000 mon.a (mon.0) 290 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T13:56:01.064 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:00 gibba013 bash[30381]: cluster 2021-03-10T13:56:00.633421+0000 mon.a (mon.0) 291 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T13:56:01.064 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:00 gibba013 bash[30381]: cluster 2021-03-10T13:56:00.633623+0000 mon.a (mon.0) 292 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T13:56:01.064 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:00 gibba013 bash[30381]: cluster 2021-03-10T13:56:00.634099+0000 mon.a (mon.0) 293 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T13:56:01.064 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:00 gibba013 bash[30381]: cluster 2021-03-10T13:56:00.634402+0000 mon.a (mon.0) 294 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T13:56:01.064 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:00 gibba013 bash[30381]: cluster 2021-03-10T13:56:00.634849+0000 mon.a (mon.0) 295 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T13:56:01.065 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:00 gibba013 bash[30381]: cluster 2021-03-10T13:56:00.635127+0000 mon.a (mon.0) 296 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T13:56:01.065 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:00 gibba013 bash[30381]: cluster 2021-03-10T13:56:00.635632+0000 mon.a (mon.0) 297 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T13:56:01.065 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:00 gibba013 bash[30381]: cluster 2021-03-10T13:56:00.635910+0000 mon.a (mon.0) 298 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T13:56:01.065 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:00 gibba013 bash[29418]: cluster 2021-03-10T13:56:00.433337+0000 mon.a (mon.0) 282 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T13:56:01.066 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:00 gibba013 bash[29418]: cluster 2021-03-10T13:56:00.433441+0000 mon.a (mon.0) 283 : cluster [INF] osd.2 failed (root=default,host=gibba013) (connection refused reported by osd.4) 2021-03-10T13:56:01.066 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:00 gibba013 bash[29418]: cluster 2021-03-10T13:56:00.433956+0000 mon.a (mon.0) 284 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T13:56:01.066 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:00 gibba013 bash[29418]: cluster 2021-03-10T13:56:00.630618+0000 mon.a (mon.0) 285 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T13:56:01.066 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:00 gibba013 bash[29418]: cluster 2021-03-10T13:56:00.631076+0000 mon.a (mon.0) 286 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T13:56:01.067 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:00 gibba013 bash[29418]: cluster 2021-03-10T13:56:00.631404+0000 mon.a (mon.0) 287 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T13:56:01.067 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:00 gibba013 bash[29418]: cluster 2021-03-10T13:56:00.631848+0000 mon.a (mon.0) 288 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T13:56:01.067 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:00 gibba013 bash[29418]: cluster 2021-03-10T13:56:00.632185+0000 mon.a (mon.0) 289 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T13:56:01.067 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:00 gibba013 bash[29418]: cluster 2021-03-10T13:56:00.632626+0000 mon.a (mon.0) 290 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T13:56:01.067 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:00 gibba013 bash[29418]: cluster 2021-03-10T13:56:00.633421+0000 mon.a (mon.0) 291 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T13:56:01.068 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:00 gibba013 bash[29418]: cluster 2021-03-10T13:56:00.633623+0000 mon.a (mon.0) 292 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T13:56:01.068 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:00 gibba013 bash[29418]: cluster 2021-03-10T13:56:00.634099+0000 mon.a (mon.0) 293 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T13:56:01.068 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:00 gibba013 bash[29418]: cluster 2021-03-10T13:56:00.634402+0000 mon.a (mon.0) 294 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T13:56:01.068 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:00 gibba013 bash[29418]: cluster 2021-03-10T13:56:00.634849+0000 mon.a (mon.0) 295 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T13:56:01.068 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:00 gibba013 bash[29418]: cluster 2021-03-10T13:56:00.635127+0000 mon.a (mon.0) 296 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T13:56:01.069 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:00 gibba013 bash[29418]: cluster 2021-03-10T13:56:00.635632+0000 mon.a (mon.0) 297 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T13:56:01.069 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:00 gibba013 bash[29418]: cluster 2021-03-10T13:56:00.635910+0000 mon.a (mon.0) 298 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T13:56:01.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:00 gibba020 bash[25448]: cluster 2021-03-10T13:56:00.433337+0000 mon.a (mon.0) 282 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T13:56:01.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:00 gibba020 bash[25448]: cluster 2021-03-10T13:56:00.433441+0000 mon.a (mon.0) 283 : cluster [INF] osd.2 failed (root=default,host=gibba013) (connection refused reported by osd.4) 2021-03-10T13:56:01.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:00 gibba020 bash[25448]: cluster 2021-03-10T13:56:00.433956+0000 mon.a (mon.0) 284 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T13:56:01.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:00 gibba020 bash[25448]: cluster 2021-03-10T13:56:00.630618+0000 mon.a (mon.0) 285 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T13:56:01.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:00 gibba020 bash[25448]: cluster 2021-03-10T13:56:00.631076+0000 mon.a (mon.0) 286 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T13:56:01.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:00 gibba020 bash[25448]: cluster 2021-03-10T13:56:00.631404+0000 mon.a (mon.0) 287 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T13:56:01.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:00 gibba020 bash[25448]: cluster 2021-03-10T13:56:00.631848+0000 mon.a (mon.0) 288 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T13:56:01.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:00 gibba020 bash[25448]: cluster 2021-03-10T13:56:00.632185+0000 mon.a (mon.0) 289 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T13:56:01.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:00 gibba020 bash[25448]: cluster 2021-03-10T13:56:00.632626+0000 mon.a (mon.0) 290 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T13:56:01.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:00 gibba020 bash[25448]: cluster 2021-03-10T13:56:00.633421+0000 mon.a (mon.0) 291 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T13:56:01.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:00 gibba020 bash[25448]: cluster 2021-03-10T13:56:00.633623+0000 mon.a (mon.0) 292 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T13:56:01.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:00 gibba020 bash[25448]: cluster 2021-03-10T13:56:00.634099+0000 mon.a (mon.0) 293 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T13:56:01.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:00 gibba020 bash[25448]: cluster 2021-03-10T13:56:00.634402+0000 mon.a (mon.0) 294 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T13:56:01.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:00 gibba020 bash[25448]: cluster 2021-03-10T13:56:00.634849+0000 mon.a (mon.0) 295 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T13:56:01.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:00 gibba020 bash[25448]: cluster 2021-03-10T13:56:00.635127+0000 mon.a (mon.0) 296 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T13:56:01.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:00 gibba020 bash[25448]: cluster 2021-03-10T13:56:00.635632+0000 mon.a (mon.0) 297 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T13:56:01.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:00 gibba020 bash[25448]: cluster 2021-03-10T13:56:00.635910+0000 mon.a (mon.0) 298 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T13:56:01.378 INFO:journalctl@ceph.osd.2.gibba013.stdout:Mar 10 13:56:01 gibba013 docker[34261]: ceph-7672acc8-81a6-11eb-9080-001a4aab830c-osd.2 2021-03-10T13:56:02.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:01 gibba013 bash[29418]: cluster 2021-03-10T13:56:00.453488+0000 mgr.gibba020.yqfnwy (mgr.34427) 162 : cluster [DBG] pgmap v71: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:56:02.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:01 gibba013 bash[29418]: cluster 2021-03-10T13:56:00.735926+0000 mon.a (mon.0) 299 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:56:02.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:01 gibba013 bash[29418]: cluster 2021-03-10T13:56:00.747819+0000 mon.a (mon.0) 300 : cluster [DBG] osdmap e73: 8 total, 7 up, 8 in 2021-03-10T13:56:02.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:01 gibba013 bash[29418]: audit 2021-03-10T13:56:00.865349+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:56:02.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:01 gibba013 bash[30381]: cluster 2021-03-10T13:56:00.453488+0000 mgr.gibba020.yqfnwy (mgr.34427) 162 : cluster [DBG] pgmap v71: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:56:02.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:01 gibba013 bash[30381]: cluster 2021-03-10T13:56:00.735926+0000 mon.a (mon.0) 299 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:56:02.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:01 gibba013 bash[30381]: cluster 2021-03-10T13:56:00.747819+0000 mon.a (mon.0) 300 : cluster [DBG] osdmap e73: 8 total, 7 up, 8 in 2021-03-10T13:56:02.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:01 gibba013 bash[30381]: audit 2021-03-10T13:56:00.865349+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:56:02.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:01 gibba020 bash[25448]: cluster 2021-03-10T13:56:00.453488+0000 mgr.gibba020.yqfnwy (mgr.34427) 162 : cluster [DBG] pgmap v71: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:56:02.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:01 gibba020 bash[25448]: cluster 2021-03-10T13:56:00.735926+0000 mon.a (mon.0) 299 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:56:02.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:01 gibba020 bash[25448]: cluster 2021-03-10T13:56:00.747819+0000 mon.a (mon.0) 300 : cluster [DBG] osdmap e73: 8 total, 7 up, 8 in 2021-03-10T13:56:02.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:01 gibba020 bash[25448]: audit 2021-03-10T13:56:00.865349+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:56:03.026 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:02 gibba013 bash[29418]: cluster 2021-03-10T13:56:01.755761+0000 mon.a (mon.0) 302 : cluster [DBG] osdmap e74: 8 total, 7 up, 8 in 2021-03-10T13:56:03.026 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:02 gibba013 bash[30381]: cluster 2021-03-10T13:56:01.755761+0000 mon.a (mon.0) 302 : cluster [DBG] osdmap e74: 8 total, 7 up, 8 in 2021-03-10T13:56:03.027 INFO:journalctl@ceph.osd.2.gibba013.stdout:Mar 10 13:56:02 gibba013 systemd[1]: ceph-7672acc8-81a6-11eb-9080-001a4aab830c@osd.2.service: Succeeded. 2021-03-10T13:56:03.027 INFO:journalctl@ceph.osd.2.gibba013.stdout:Mar 10 13:56:02 gibba013 systemd[1]: Stopped Ceph osd.2 for 7672acc8-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:56:03.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:02 gibba020 bash[25448]: cluster 2021-03-10T13:56:01.755761+0000 mon.a (mon.0) 302 : cluster [DBG] osdmap e74: 8 total, 7 up, 8 in 2021-03-10T13:56:03.378 INFO:journalctl@ceph.osd.2.gibba013.stdout:Mar 10 13:56:03 gibba013 systemd[1]: Started Ceph osd.2 for 7672acc8-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:56:04.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:03 gibba013 bash[29418]: cluster 2021-03-10T13:56:02.454852+0000 mgr.gibba020.yqfnwy (mgr.34427) 163 : cluster [DBG] pgmap v74: 129 pgs: 4 stale+active+clean, 21 peering, 18 active+clean+wait, 86 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:56:04.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:03 gibba013 bash[29418]: cluster 2021-03-10T13:56:02.761434+0000 mon.a (mon.0) 303 : cluster [WRN] Health check failed: Reduced data availability: 4 pgs inactive, 4 pgs peering (PG_AVAILABILITY) 2021-03-10T13:56:04.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:03 gibba013 bash[29418]: audit 2021-03-10T13:56:03.046841+0000 mon.a (mon.0) 304 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:56:04.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:03 gibba013 bash[29418]: audit 2021-03-10T13:56:03.047487+0000 mon.a (mon.0) 305 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:56:04.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:03 gibba013 bash[29418]: audit 2021-03-10T13:56:03.048788+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:56:04.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:03 gibba013 bash[30381]: cluster 2021-03-10T13:56:02.454852+0000 mgr.gibba020.yqfnwy (mgr.34427) 163 : cluster [DBG] pgmap v74: 129 pgs: 4 stale+active+clean, 21 peering, 18 active+clean+wait, 86 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:56:04.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:03 gibba013 bash[30381]: cluster 2021-03-10T13:56:02.761434+0000 mon.a (mon.0) 303 : cluster [WRN] Health check failed: Reduced data availability: 4 pgs inactive, 4 pgs peering (PG_AVAILABILITY) 2021-03-10T13:56:04.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:03 gibba013 bash[30381]: audit 2021-03-10T13:56:03.046841+0000 mon.a (mon.0) 304 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:56:04.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:03 gibba013 bash[30381]: audit 2021-03-10T13:56:03.047487+0000 mon.a (mon.0) 305 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:56:04.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:03 gibba013 bash[30381]: audit 2021-03-10T13:56:03.048788+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:56:04.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:03 gibba020 bash[25448]: cluster 2021-03-10T13:56:02.454852+0000 mgr.gibba020.yqfnwy (mgr.34427) 163 : cluster [DBG] pgmap v74: 129 pgs: 4 stale+active+clean, 21 peering, 18 active+clean+wait, 86 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T13:56:04.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:03 gibba020 bash[25448]: cluster 2021-03-10T13:56:02.761434+0000 mon.a (mon.0) 303 : cluster [WRN] Health check failed: Reduced data availability: 4 pgs inactive, 4 pgs peering (PG_AVAILABILITY) 2021-03-10T13:56:04.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:03 gibba020 bash[25448]: audit 2021-03-10T13:56:03.046841+0000 mon.a (mon.0) 304 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:56:04.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:03 gibba020 bash[25448]: audit 2021-03-10T13:56:03.047487+0000 mon.a (mon.0) 305 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:56:04.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:03 gibba020 bash[25448]: audit 2021-03-10T13:56:03.048788+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:56:04.628 INFO:journalctl@ceph.osd.2.gibba013.stdout:Mar 10 13:56:04 gibba013 bash[34427]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-03-10T13:56:04.628 INFO:journalctl@ceph.osd.2.gibba013.stdout:Mar 10 13:56:04 gibba013 bash[34427]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2021-03-10T13:56:04.628 INFO:journalctl@ceph.osd.2.gibba013.stdout:Mar 10 13:56:04 gibba013 bash[34427]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2021-03-10T13:56:04.629 INFO:journalctl@ceph.osd.2.gibba013.stdout:Mar 10 13:56:04 gibba013 bash[34427]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2021-03-10T13:56:04.629 INFO:journalctl@ceph.osd.2.gibba013.stdout:Mar 10 13:56:04 gibba013 bash[34427]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2021-03-10T13:56:04.629 INFO:journalctl@ceph.osd.2.gibba013.stdout:Mar 10 13:56:04 gibba013 bash[34427]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-03-10T13:56:04.629 INFO:journalctl@ceph.osd.2.gibba013.stdout:Mar 10 13:56:04 gibba013 bash[34427]: --> ceph-volume lvm activate successful for osd ID: 2 2021-03-10T13:56:05.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:05 gibba013 bash[29418]: cluster 2021-03-10T13:56:04.456471+0000 mgr.gibba020.yqfnwy (mgr.34427) 164 : cluster [DBG] pgmap v75: 129 pgs: 2 stale+active+clean, 1 active+undersized+degraded, 21 peering, 18 active+clean+wait, 4 active+undersized, 83 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 1/192 objects degraded (0.521%) 2021-03-10T13:56:05.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:05 gibba013 bash[29418]: cluster 2021-03-10T13:56:04.769589+0000 mon.a (mon.0) 307 : cluster [WRN] Health check failed: Degraded data redundancy: 1/192 objects degraded (0.521%), 1 pg degraded (PG_DEGRADED) 2021-03-10T13:56:05.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:05 gibba013 bash[30381]: cluster 2021-03-10T13:56:04.456471+0000 mgr.gibba020.yqfnwy (mgr.34427) 164 : cluster [DBG] pgmap v75: 129 pgs: 2 stale+active+clean, 1 active+undersized+degraded, 21 peering, 18 active+clean+wait, 4 active+undersized, 83 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 1/192 objects degraded (0.521%) 2021-03-10T13:56:05.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:05 gibba013 bash[30381]: cluster 2021-03-10T13:56:04.769589+0000 mon.a (mon.0) 307 : cluster [WRN] Health check failed: Degraded data redundancy: 1/192 objects degraded (0.521%), 1 pg degraded (PG_DEGRADED) 2021-03-10T13:56:05.879 INFO:journalctl@ceph.osd.2.gibba013.stdout:Mar 10 13:56:05 gibba013 bash[34562]: debug 2021-03-10T13:56:05.685+0000 7ffb318e0700 1 -- 172.21.2.113:0/3779831486 <== mon.1 v2:172.21.2.113:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55887a5b24e0 con 0x55887a62f000 2021-03-10T13:56:06.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:05 gibba020 bash[25448]: cluster 2021-03-10T13:56:04.456471+0000 mgr.gibba020.yqfnwy (mgr.34427) 164 : cluster [DBG] pgmap v75: 129 pgs: 2 stale+active+clean, 1 active+undersized+degraded, 21 peering, 18 active+clean+wait, 4 active+undersized, 83 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 1/192 objects degraded (0.521%) 2021-03-10T13:56:06.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:05 gibba020 bash[25448]: cluster 2021-03-10T13:56:04.769589+0000 mon.a (mon.0) 307 : cluster [WRN] Health check failed: Degraded data redundancy: 1/192 objects degraded (0.521%), 1 pg degraded (PG_DEGRADED) 2021-03-10T13:56:06.627 INFO:journalctl@ceph.osd.2.gibba013.stdout:Mar 10 13:56:06 gibba013 bash[34562]: debug 2021-03-10T13:56:06.237+0000 7ffb39375080 -1 Falling back to public interface 2021-03-10T13:56:07.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:06 gibba013 bash[29418]: audit 2021-03-10T13:56:05.846631+0000 mon.a (mon.0) 308 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:56:07.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:06 gibba013 bash[29418]: audit 2021-03-10T13:56:05.853470+0000 mon.a (mon.0) 309 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T13:56:07.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:06 gibba013 bash[29418]: audit 2021-03-10T13:56:06.735470+0000 mon.a (mon.0) 310 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:56:07.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:06 gibba013 bash[29418]: audit 2021-03-10T13:56:06.739019+0000 mon.a (mon.0) 311 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:56:07.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:06 gibba013 bash[30381]: audit 2021-03-10T13:56:05.846631+0000 mon.a (mon.0) 308 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:56:07.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:06 gibba013 bash[30381]: audit 2021-03-10T13:56:05.853470+0000 mon.a (mon.0) 309 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T13:56:07.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:06 gibba013 bash[30381]: audit 2021-03-10T13:56:06.735470+0000 mon.a (mon.0) 310 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:56:07.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:06 gibba013 bash[30381]: audit 2021-03-10T13:56:06.739019+0000 mon.a (mon.0) 311 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:56:07.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:06 gibba020 bash[25448]: audit 2021-03-10T13:56:05.846631+0000 mon.a (mon.0) 308 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:56:07.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:06 gibba020 bash[25448]: audit 2021-03-10T13:56:05.853470+0000 mon.a (mon.0) 309 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T13:56:07.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:06 gibba020 bash[25448]: audit 2021-03-10T13:56:06.735470+0000 mon.a (mon.0) 310 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:56:07.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:06 gibba020 bash[25448]: audit 2021-03-10T13:56:06.739019+0000 mon.a (mon.0) 311 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:56:08.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:07 gibba013 bash[29418]: cluster 2021-03-10T13:56:06.458075+0000 mgr.gibba020.yqfnwy (mgr.34427) 165 : cluster [DBG] pgmap v76: 129 pgs: 4 active+undersized+degraded, 21 peering, 7 active+undersized, 97 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 8/192 objects degraded (4.167%) 2021-03-10T13:56:08.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:07 gibba013 bash[29418]: cephadm 2021-03-10T13:56:06.741108+0000 mgr.gibba020.yqfnwy (mgr.34427) 166 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:56:08.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:07 gibba013 bash[29418]: audit 2021-03-10T13:56:06.743500+0000 mon.a (mon.0) 312 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:56:08.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:07 gibba013 bash[29418]: cephadm 2021-03-10T13:56:06.746748+0000 mgr.gibba020.yqfnwy (mgr.34427) 167 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:56:08.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:07 gibba013 bash[29418]: cephadm 2021-03-10T13:56:06.748039+0000 mgr.gibba020.yqfnwy (mgr.34427) 168 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:56:08.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:07 gibba013 bash[29418]: cephadm 2021-03-10T13:56:06.748084+0000 mgr.gibba020.yqfnwy (mgr.34427) 169 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:56:08.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:07 gibba013 bash[29418]: audit 2021-03-10T13:56:06.748683+0000 mon.a (mon.0) 313 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:08.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:07 gibba013 bash[29418]: cephadm 2021-03-10T13:56:06.749388+0000 mgr.gibba020.yqfnwy (mgr.34427) 170 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:56:08.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:07 gibba013 bash[29418]: cephadm 2021-03-10T13:56:06.749434+0000 mgr.gibba020.yqfnwy (mgr.34427) 171 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:56:08.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:07 gibba013 bash[29418]: audit 2021-03-10T13:56:06.750026+0000 mon.a (mon.0) 314 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:08.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:07 gibba013 bash[29418]: cephadm 2021-03-10T13:56:06.750943+0000 mgr.gibba020.yqfnwy (mgr.34427) 172 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:56:08.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:07 gibba013 bash[29418]: audit 2021-03-10T13:56:06.751425+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:08.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:07 gibba013 bash[29418]: cephadm 2021-03-10T13:56:06.752416+0000 mgr.gibba020.yqfnwy (mgr.34427) 173 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:56:08.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:07 gibba013 bash[29418]: cephadm 2021-03-10T13:56:06.752460+0000 mgr.gibba020.yqfnwy (mgr.34427) 174 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:56:08.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:07 gibba013 bash[29418]: audit 2021-03-10T13:56:06.753306+0000 mgr.gibba020.yqfnwy (mgr.34427) 175 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T13:56:08.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:07 gibba013 bash[29418]: audit 2021-03-10T13:56:06.754700+0000 mon.a (mon.0) 316 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T13:56:08.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:07 gibba013 bash[29418]: cephadm 2021-03-10T13:56:06.754878+0000 mgr.gibba020.yqfnwy (mgr.34427) 176 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2021-03-10T13:56:08.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:07 gibba013 bash[30381]: cluster 2021-03-10T13:56:06.458075+0000 mgr.gibba020.yqfnwy (mgr.34427) 165 : cluster [DBG] pgmap v76: 129 pgs: 4 active+undersized+degraded, 21 peering, 7 active+undersized, 97 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 8/192 objects degraded (4.167%) 2021-03-10T13:56:08.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:07 gibba013 bash[30381]: cephadm 2021-03-10T13:56:06.741108+0000 mgr.gibba020.yqfnwy (mgr.34427) 166 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:56:08.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:07 gibba013 bash[30381]: audit 2021-03-10T13:56:06.743500+0000 mon.a (mon.0) 312 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:56:08.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:07 gibba013 bash[30381]: cephadm 2021-03-10T13:56:06.746748+0000 mgr.gibba020.yqfnwy (mgr.34427) 167 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:56:08.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:07 gibba013 bash[30381]: cephadm 2021-03-10T13:56:06.748039+0000 mgr.gibba020.yqfnwy (mgr.34427) 168 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:56:08.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:07 gibba013 bash[30381]: cephadm 2021-03-10T13:56:06.748084+0000 mgr.gibba020.yqfnwy (mgr.34427) 169 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:56:08.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:07 gibba013 bash[30381]: audit 2021-03-10T13:56:06.748683+0000 mon.a (mon.0) 313 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:08.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:07 gibba013 bash[30381]: cephadm 2021-03-10T13:56:06.749388+0000 mgr.gibba020.yqfnwy (mgr.34427) 170 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:56:08.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:07 gibba013 bash[30381]: cephadm 2021-03-10T13:56:06.749434+0000 mgr.gibba020.yqfnwy (mgr.34427) 171 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:56:08.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:07 gibba013 bash[30381]: audit 2021-03-10T13:56:06.750026+0000 mon.a (mon.0) 314 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:08.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:07 gibba013 bash[30381]: cephadm 2021-03-10T13:56:06.750943+0000 mgr.gibba020.yqfnwy (mgr.34427) 172 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:56:08.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:07 gibba013 bash[30381]: audit 2021-03-10T13:56:06.751425+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:08.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:07 gibba013 bash[30381]: cephadm 2021-03-10T13:56:06.752416+0000 mgr.gibba020.yqfnwy (mgr.34427) 173 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:56:08.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:07 gibba013 bash[30381]: cephadm 2021-03-10T13:56:06.752460+0000 mgr.gibba020.yqfnwy (mgr.34427) 174 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:56:08.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:07 gibba013 bash[30381]: audit 2021-03-10T13:56:06.753306+0000 mgr.gibba020.yqfnwy (mgr.34427) 175 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T13:56:08.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:07 gibba013 bash[30381]: audit 2021-03-10T13:56:06.754700+0000 mon.a (mon.0) 316 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T13:56:08.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:07 gibba013 bash[30381]: cephadm 2021-03-10T13:56:06.754878+0000 mgr.gibba020.yqfnwy (mgr.34427) 176 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2021-03-10T13:56:08.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:07 gibba020 bash[25448]: cluster 2021-03-10T13:56:06.458075+0000 mgr.gibba020.yqfnwy (mgr.34427) 165 : cluster [DBG] pgmap v76: 129 pgs: 4 active+undersized+degraded, 21 peering, 7 active+undersized, 97 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 8/192 objects degraded (4.167%) 2021-03-10T13:56:08.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:07 gibba020 bash[25448]: cephadm 2021-03-10T13:56:06.741108+0000 mgr.gibba020.yqfnwy (mgr.34427) 166 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:56:08.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:07 gibba020 bash[25448]: audit 2021-03-10T13:56:06.743500+0000 mon.a (mon.0) 312 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:56:08.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:07 gibba020 bash[25448]: cephadm 2021-03-10T13:56:06.746748+0000 mgr.gibba020.yqfnwy (mgr.34427) 167 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:56:08.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:07 gibba020 bash[25448]: cephadm 2021-03-10T13:56:06.748039+0000 mgr.gibba020.yqfnwy (mgr.34427) 168 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:56:08.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:07 gibba020 bash[25448]: cephadm 2021-03-10T13:56:06.748084+0000 mgr.gibba020.yqfnwy (mgr.34427) 169 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:56:08.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:07 gibba020 bash[25448]: audit 2021-03-10T13:56:06.748683+0000 mon.a (mon.0) 313 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:08.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:07 gibba020 bash[25448]: cephadm 2021-03-10T13:56:06.749388+0000 mgr.gibba020.yqfnwy (mgr.34427) 170 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:56:08.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:07 gibba020 bash[25448]: cephadm 2021-03-10T13:56:06.749434+0000 mgr.gibba020.yqfnwy (mgr.34427) 171 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:56:08.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:07 gibba020 bash[25448]: audit 2021-03-10T13:56:06.750026+0000 mon.a (mon.0) 314 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:08.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:07 gibba020 bash[25448]: cephadm 2021-03-10T13:56:06.750943+0000 mgr.gibba020.yqfnwy (mgr.34427) 172 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:56:08.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:07 gibba020 bash[25448]: audit 2021-03-10T13:56:06.751425+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:08.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:07 gibba020 bash[25448]: cephadm 2021-03-10T13:56:06.752416+0000 mgr.gibba020.yqfnwy (mgr.34427) 173 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:56:08.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:07 gibba020 bash[25448]: cephadm 2021-03-10T13:56:06.752460+0000 mgr.gibba020.yqfnwy (mgr.34427) 174 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:56:08.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:07 gibba020 bash[25448]: audit 2021-03-10T13:56:06.753306+0000 mgr.gibba020.yqfnwy (mgr.34427) 175 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T13:56:08.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:07 gibba020 bash[25448]: audit 2021-03-10T13:56:06.754700+0000 mon.a (mon.0) 316 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T13:56:08.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:07 gibba020 bash[25448]: cephadm 2021-03-10T13:56:06.754878+0000 mgr.gibba020.yqfnwy (mgr.34427) 176 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2021-03-10T13:56:09.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:08 gibba013 bash[29418]: cluster 2021-03-10T13:56:08.749485+0000 mon.a (mon.0) 317 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs inactive, 4 pgs peering) 2021-03-10T13:56:09.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:08 gibba013 bash[30381]: cluster 2021-03-10T13:56:08.749485+0000 mon.a (mon.0) 317 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs inactive, 4 pgs peering) 2021-03-10T13:56:09.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:08 gibba020 bash[25448]: cluster 2021-03-10T13:56:08.749485+0000 mon.a (mon.0) 317 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs inactive, 4 pgs peering) 2021-03-10T13:56:09.815 INFO:journalctl@ceph.osd.2.gibba013.stdout:Mar 10 13:56:09 gibba013 bash[34562]: debug 2021-03-10T13:56:09.457+0000 7ffb39375080 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: store not yet converted to per-pg omap 2021-03-10T13:56:09.815 INFO:journalctl@ceph.osd.2.gibba013.stdout:Mar 10 13:56:09 gibba013 bash[34562]: debug 2021-03-10T13:56:09.457+0000 7ffb2463a700 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2021-03-10T13:56:09.815 INFO:journalctl@ceph.osd.2.gibba013.stdout:Mar 10 13:56:09 gibba013 bash[34562]: debug 2021-03-10T13:56:09.577+0000 7ffb39375080 -1 osd.2 72 log_to_monitors {default=true} 2021-03-10T13:56:10.128 INFO:journalctl@ceph.osd.2.gibba013.stdout:Mar 10 13:56:09 gibba013 bash[34562]: debug 2021-03-10T13:56:09.821+0000 7ffb2a054700 -1 osd.2 72 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:56:10.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:09 gibba013 bash[29418]: cluster 2021-03-10T13:56:08.460116+0000 mgr.gibba020.yqfnwy (mgr.34427) 177 : cluster [DBG] pgmap v77: 129 pgs: 8 active+undersized+degraded, 24 active+undersized, 97 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 13/192 objects degraded (6.771%) 2021-03-10T13:56:10.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:09 gibba013 bash[29418]: audit 2021-03-10T13:56:09.584061+0000 mon.c (mon.1) 11 : audit [INF] from='osd.2 [v2:172.21.2.113:6816/1668849602,v1:172.21.2.113:6817/1668849602]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T13:56:10.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:09 gibba013 bash[29418]: audit 2021-03-10T13:56:09.584323+0000 mon.a (mon.0) 318 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T13:56:10.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:09 gibba013 bash[30381]: cluster 2021-03-10T13:56:08.460116+0000 mgr.gibba020.yqfnwy (mgr.34427) 177 : cluster [DBG] pgmap v77: 129 pgs: 8 active+undersized+degraded, 24 active+undersized, 97 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 13/192 objects degraded (6.771%) 2021-03-10T13:56:10.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:09 gibba013 bash[30381]: audit 2021-03-10T13:56:09.584061+0000 mon.c (mon.1) 11 : audit [INF] from='osd.2 [v2:172.21.2.113:6816/1668849602,v1:172.21.2.113:6817/1668849602]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T13:56:10.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:09 gibba013 bash[30381]: audit 2021-03-10T13:56:09.584323+0000 mon.a (mon.0) 318 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T13:56:10.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:09 gibba020 bash[25448]: cluster 2021-03-10T13:56:08.460116+0000 mgr.gibba020.yqfnwy (mgr.34427) 177 : cluster [DBG] pgmap v77: 129 pgs: 8 active+undersized+degraded, 24 active+undersized, 97 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 13/192 objects degraded (6.771%) 2021-03-10T13:56:10.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:09 gibba020 bash[25448]: audit 2021-03-10T13:56:09.584061+0000 mon.c (mon.1) 11 : audit [INF] from='osd.2 [v2:172.21.2.113:6816/1668849602,v1:172.21.2.113:6817/1668849602]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T13:56:10.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:09 gibba020 bash[25448]: audit 2021-03-10T13:56:09.584323+0000 mon.a (mon.0) 318 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T13:56:11.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:10 gibba013 bash[29418]: audit 2021-03-10T13:56:09.814755+0000 mon.a (mon.0) 319 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-03-10T13:56:11.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:10 gibba013 bash[29418]: cluster 2021-03-10T13:56:09.814820+0000 mon.a (mon.0) 320 : cluster [DBG] osdmap e75: 8 total, 7 up, 8 in 2021-03-10T13:56:11.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:10 gibba013 bash[29418]: audit 2021-03-10T13:56:09.815507+0000 mon.c (mon.1) 12 : audit [INF] from='osd.2 [v2:172.21.2.113:6816/1668849602,v1:172.21.2.113:6817/1668849602]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:56:11.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:10 gibba013 bash[29418]: audit 2021-03-10T13:56:09.818330+0000 mon.a (mon.0) 321 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:56:11.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:10 gibba013 bash[30381]: audit 2021-03-10T13:56:09.814755+0000 mon.a (mon.0) 319 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-03-10T13:56:11.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:10 gibba013 bash[30381]: cluster 2021-03-10T13:56:09.814820+0000 mon.a (mon.0) 320 : cluster [DBG] osdmap e75: 8 total, 7 up, 8 in 2021-03-10T13:56:11.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:10 gibba013 bash[30381]: audit 2021-03-10T13:56:09.815507+0000 mon.c (mon.1) 12 : audit [INF] from='osd.2 [v2:172.21.2.113:6816/1668849602,v1:172.21.2.113:6817/1668849602]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:56:11.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:10 gibba013 bash[30381]: audit 2021-03-10T13:56:09.818330+0000 mon.a (mon.0) 321 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:56:11.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:10 gibba020 bash[25448]: audit 2021-03-10T13:56:09.814755+0000 mon.a (mon.0) 319 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-03-10T13:56:11.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:10 gibba020 bash[25448]: cluster 2021-03-10T13:56:09.814820+0000 mon.a (mon.0) 320 : cluster [DBG] osdmap e75: 8 total, 7 up, 8 in 2021-03-10T13:56:11.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:10 gibba020 bash[25448]: audit 2021-03-10T13:56:09.815507+0000 mon.c (mon.1) 12 : audit [INF] from='osd.2 [v2:172.21.2.113:6816/1668849602,v1:172.21.2.113:6817/1668849602]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:56:11.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:10 gibba020 bash[25448]: audit 2021-03-10T13:56:09.818330+0000 mon.a (mon.0) 321 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:56:12.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:11 gibba013 bash[29418]: cluster 2021-03-10T13:56:10.461692+0000 mgr.gibba020.yqfnwy (mgr.34427) 178 : cluster [DBG] pgmap v79: 129 pgs: 8 active+undersized+degraded, 24 active+undersized, 97 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 13/192 objects degraded (6.771%) 2021-03-10T13:56:12.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:11 gibba013 bash[29418]: cluster 2021-03-10T13:56:10.817844+0000 mon.a (mon.0) 322 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:56:12.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:11 gibba013 bash[29418]: cluster 2021-03-10T13:56:10.828727+0000 mon.a (mon.0) 323 : cluster [INF] osd.2 [v2:172.21.2.113:6816/1668849602,v1:172.21.2.113:6817/1668849602] boot 2021-03-10T13:56:12.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:11 gibba013 bash[29418]: cluster 2021-03-10T13:56:10.828747+0000 mon.a (mon.0) 324 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2021-03-10T13:56:12.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:11 gibba013 bash[29418]: audit 2021-03-10T13:56:10.829185+0000 mon.a (mon.0) 325 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:56:12.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:11 gibba013 bash[30381]: cluster 2021-03-10T13:56:10.461692+0000 mgr.gibba020.yqfnwy (mgr.34427) 178 : cluster [DBG] pgmap v79: 129 pgs: 8 active+undersized+degraded, 24 active+undersized, 97 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 13/192 objects degraded (6.771%) 2021-03-10T13:56:12.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:11 gibba013 bash[30381]: cluster 2021-03-10T13:56:10.817844+0000 mon.a (mon.0) 322 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:56:12.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:11 gibba013 bash[30381]: cluster 2021-03-10T13:56:10.828727+0000 mon.a (mon.0) 323 : cluster [INF] osd.2 [v2:172.21.2.113:6816/1668849602,v1:172.21.2.113:6817/1668849602] boot 2021-03-10T13:56:12.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:11 gibba013 bash[30381]: cluster 2021-03-10T13:56:10.828747+0000 mon.a (mon.0) 324 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2021-03-10T13:56:12.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:11 gibba013 bash[30381]: audit 2021-03-10T13:56:10.829185+0000 mon.a (mon.0) 325 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:56:12.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:11 gibba020 bash[25448]: cluster 2021-03-10T13:56:10.461692+0000 mgr.gibba020.yqfnwy (mgr.34427) 178 : cluster [DBG] pgmap v79: 129 pgs: 8 active+undersized+degraded, 24 active+undersized, 97 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 13/192 objects degraded (6.771%) 2021-03-10T13:56:12.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:11 gibba020 bash[25448]: cluster 2021-03-10T13:56:10.817844+0000 mon.a (mon.0) 322 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:56:12.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:11 gibba020 bash[25448]: cluster 2021-03-10T13:56:10.828727+0000 mon.a (mon.0) 323 : cluster [INF] osd.2 [v2:172.21.2.113:6816/1668849602,v1:172.21.2.113:6817/1668849602] boot 2021-03-10T13:56:12.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:11 gibba020 bash[25448]: cluster 2021-03-10T13:56:10.828747+0000 mon.a (mon.0) 324 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2021-03-10T13:56:12.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:11 gibba020 bash[25448]: audit 2021-03-10T13:56:10.829185+0000 mon.a (mon.0) 325 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T13:56:13.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:12 gibba013 bash[29418]: cluster 2021-03-10T13:56:11.832617+0000 mon.a (mon.0) 326 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2021-03-10T13:56:13.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:12 gibba013 bash[30381]: cluster 2021-03-10T13:56:11.832617+0000 mon.a (mon.0) 326 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2021-03-10T13:56:13.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:12 gibba020 bash[25448]: cluster 2021-03-10T13:56:11.832617+0000 mon.a (mon.0) 326 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2021-03-10T13:56:14.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:13 gibba013 bash[29418]: cluster 2021-03-10T13:56:12.462948+0000 mgr.gibba020.yqfnwy (mgr.34427) 179 : cluster [DBG] pgmap v82: 129 pgs: 15 peering, 4 active+undersized+degraded, 13 active+undersized, 97 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 8/192 objects degraded (4.167%) 2021-03-10T13:56:14.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:13 gibba013 bash[29418]: cluster 2021-03-10T13:56:12.836106+0000 mon.a (mon.0) 327 : cluster [WRN] Health check update: Degraded data redundancy: 8/192 objects degraded (4.167%), 4 pgs degraded (PG_DEGRADED) 2021-03-10T13:56:14.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:13 gibba013 bash[30381]: cluster 2021-03-10T13:56:12.462948+0000 mgr.gibba020.yqfnwy (mgr.34427) 179 : cluster [DBG] pgmap v82: 129 pgs: 15 peering, 4 active+undersized+degraded, 13 active+undersized, 97 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 8/192 objects degraded (4.167%) 2021-03-10T13:56:14.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:13 gibba013 bash[30381]: cluster 2021-03-10T13:56:12.836106+0000 mon.a (mon.0) 327 : cluster [WRN] Health check update: Degraded data redundancy: 8/192 objects degraded (4.167%), 4 pgs degraded (PG_DEGRADED) 2021-03-10T13:56:14.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:13 gibba020 bash[25448]: cluster 2021-03-10T13:56:12.462948+0000 mgr.gibba020.yqfnwy (mgr.34427) 179 : cluster [DBG] pgmap v82: 129 pgs: 15 peering, 4 active+undersized+degraded, 13 active+undersized, 97 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 8/192 objects degraded (4.167%) 2021-03-10T13:56:14.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:13 gibba020 bash[25448]: cluster 2021-03-10T13:56:12.836106+0000 mon.a (mon.0) 327 : cluster [WRN] Health check update: Degraded data redundancy: 8/192 objects degraded (4.167%), 4 pgs degraded (PG_DEGRADED) 2021-03-10T13:56:16.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:15 gibba013 bash[29418]: cluster 2021-03-10T13:56:14.464444+0000 mgr.gibba020.yqfnwy (mgr.34427) 180 : cluster [DBG] pgmap v83: 129 pgs: 15 peering, 3 active+undersized+degraded, 11 active+undersized, 100 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 7/192 objects degraded (3.646%) 2021-03-10T13:56:16.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:15 gibba013 bash[30381]: cluster 2021-03-10T13:56:14.464444+0000 mgr.gibba020.yqfnwy (mgr.34427) 180 : cluster [DBG] pgmap v83: 129 pgs: 15 peering, 3 active+undersized+degraded, 11 active+undersized, 100 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 7/192 objects degraded (3.646%) 2021-03-10T13:56:16.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:15 gibba020 bash[25448]: cluster 2021-03-10T13:56:14.464444+0000 mgr.gibba020.yqfnwy (mgr.34427) 180 : cluster [DBG] pgmap v83: 129 pgs: 15 peering, 3 active+undersized+degraded, 11 active+undersized, 100 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 7/192 objects degraded (3.646%) 2021-03-10T13:56:17.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:16 gibba020 bash[25448]: cluster 2021-03-10T13:56:16.852079+0000 mon.a (mon.0) 328 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/192 objects degraded (3.646%), 3 pgs degraded) 2021-03-10T13:56:17.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:16 gibba013 bash[29418]: cluster 2021-03-10T13:56:16.852079+0000 mon.a (mon.0) 328 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/192 objects degraded (3.646%), 3 pgs degraded) 2021-03-10T13:56:17.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:16 gibba013 bash[30381]: cluster 2021-03-10T13:56:16.852079+0000 mon.a (mon.0) 328 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/192 objects degraded (3.646%), 3 pgs degraded) 2021-03-10T13:56:18.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:17 gibba020 bash[25448]: cluster 2021-03-10T13:56:16.465695+0000 mgr.gibba020.yqfnwy (mgr.34427) 181 : cluster [DBG] pgmap v84: 129 pgs: 10 active+clean+wait, 15 peering, 104 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:56:18.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:17 gibba013 bash[29418]: cluster 2021-03-10T13:56:16.465695+0000 mgr.gibba020.yqfnwy (mgr.34427) 181 : cluster [DBG] pgmap v84: 129 pgs: 10 active+clean+wait, 15 peering, 104 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:56:18.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:17 gibba013 bash[30381]: cluster 2021-03-10T13:56:16.465695+0000 mgr.gibba020.yqfnwy (mgr.34427) 181 : cluster [DBG] pgmap v84: 129 pgs: 10 active+clean+wait, 15 peering, 104 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:56:20.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:19 gibba020 bash[25448]: cluster 2021-03-10T13:56:18.467466+0000 mgr.gibba020.yqfnwy (mgr.34427) 182 : cluster [DBG] pgmap v85: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:56:20.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:19 gibba013 bash[29418]: cluster 2021-03-10T13:56:18.467466+0000 mgr.gibba020.yqfnwy (mgr.34427) 182 : cluster [DBG] pgmap v85: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:56:20.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:19 gibba013 bash[30381]: cluster 2021-03-10T13:56:18.467466+0000 mgr.gibba020.yqfnwy (mgr.34427) 182 : cluster [DBG] pgmap v85: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:56:22.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:21 gibba020 bash[25448]: cluster 2021-03-10T13:56:20.468954+0000 mgr.gibba020.yqfnwy (mgr.34427) 183 : cluster [DBG] pgmap v86: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:56:22.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:21 gibba020 bash[25448]: audit 2021-03-10T13:56:21.772931+0000 mon.a (mon.0) 329 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T13:56:22.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:21 gibba013 bash[29418]: cluster 2021-03-10T13:56:20.468954+0000 mgr.gibba020.yqfnwy (mgr.34427) 183 : cluster [DBG] pgmap v86: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:56:22.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:21 gibba013 bash[29418]: audit 2021-03-10T13:56:21.772931+0000 mon.a (mon.0) 329 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T13:56:22.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:21 gibba013 bash[30381]: cluster 2021-03-10T13:56:20.468954+0000 mgr.gibba020.yqfnwy (mgr.34427) 183 : cluster [DBG] pgmap v86: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:56:22.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:21 gibba013 bash[30381]: audit 2021-03-10T13:56:21.772931+0000 mon.a (mon.0) 329 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T13:56:23.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:22 gibba020 bash[25448]: audit 2021-03-10T13:56:21.772167+0000 mgr.gibba020.yqfnwy (mgr.34427) 184 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T13:56:23.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:22 gibba020 bash[25448]: cephadm 2021-03-10T13:56:21.776531+0000 mgr.gibba020.yqfnwy (mgr.34427) 185 : cephadm [INF] Upgrade: osd.3 is safe to restart 2021-03-10T13:56:23.251 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:22 gibba013 bash[29418]: audit 2021-03-10T13:56:21.772167+0000 mgr.gibba020.yqfnwy (mgr.34427) 184 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T13:56:23.252 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:22 gibba013 bash[29418]: cephadm 2021-03-10T13:56:21.776531+0000 mgr.gibba020.yqfnwy (mgr.34427) 185 : cephadm [INF] Upgrade: osd.3 is safe to restart 2021-03-10T13:56:23.252 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:22 gibba013 bash[30381]: audit 2021-03-10T13:56:21.772167+0000 mgr.gibba020.yqfnwy (mgr.34427) 184 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T13:56:23.252 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:22 gibba013 bash[30381]: cephadm 2021-03-10T13:56:21.776531+0000 mgr.gibba020.yqfnwy (mgr.34427) 185 : cephadm [INF] Upgrade: osd.3 is safe to restart 2021-03-10T13:56:24.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:23 gibba020 bash[25448]: cluster 2021-03-10T13:56:22.470816+0000 mgr.gibba020.yqfnwy (mgr.34427) 186 : cluster [DBG] pgmap v87: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:56:24.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:23 gibba020 bash[25448]: audit 2021-03-10T13:56:23.717385+0000 mon.a (mon.0) 330 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:56:24.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:23 gibba020 bash[25448]: audit 2021-03-10T13:56:23.722575+0000 mon.a (mon.0) 331 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2021-03-10T13:56:24.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:23 gibba013 bash[29418]: cluster 2021-03-10T13:56:22.470816+0000 mgr.gibba020.yqfnwy (mgr.34427) 186 : cluster [DBG] pgmap v87: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:56:24.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:23 gibba013 bash[29418]: audit 2021-03-10T13:56:23.717385+0000 mon.a (mon.0) 330 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:56:24.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:23 gibba013 bash[29418]: audit 2021-03-10T13:56:23.722575+0000 mon.a (mon.0) 331 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2021-03-10T13:56:24.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:23 gibba013 bash[30381]: cluster 2021-03-10T13:56:22.470816+0000 mgr.gibba020.yqfnwy (mgr.34427) 186 : cluster [DBG] pgmap v87: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:56:24.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:23 gibba013 bash[30381]: audit 2021-03-10T13:56:23.717385+0000 mon.a (mon.0) 330 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:56:24.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:23 gibba013 bash[30381]: audit 2021-03-10T13:56:23.722575+0000 mon.a (mon.0) 331 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2021-03-10T13:56:25.008 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:24 gibba013 bash[29418]: cephadm 2021-03-10T13:56:23.711032+0000 mgr.gibba020.yqfnwy (mgr.34427) 187 : cephadm [INF] Upgrade: Updating osd.3 2021-03-10T13:56:25.008 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:24 gibba013 bash[29418]: cephadm 2021-03-10T13:56:23.719694+0000 mgr.gibba020.yqfnwy (mgr.34427) 188 : cephadm [INF] Deploying daemon osd.3 on gibba013 2021-03-10T13:56:25.009 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:24 gibba013 bash[30381]: cephadm 2021-03-10T13:56:23.711032+0000 mgr.gibba020.yqfnwy (mgr.34427) 187 : cephadm [INF] Upgrade: Updating osd.3 2021-03-10T13:56:25.009 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:24 gibba013 bash[30381]: cephadm 2021-03-10T13:56:23.719694+0000 mgr.gibba020.yqfnwy (mgr.34427) 188 : cephadm [INF] Deploying daemon osd.3 on gibba013 2021-03-10T13:56:25.354 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T13:56:25.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:24 gibba020 bash[25448]: cephadm 2021-03-10T13:56:23.711032+0000 mgr.gibba020.yqfnwy (mgr.34427) 187 : cephadm [INF] Upgrade: Updating osd.3 2021-03-10T13:56:25.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:24 gibba020 bash[25448]: cephadm 2021-03-10T13:56:23.719694+0000 mgr.gibba020.yqfnwy (mgr.34427) 188 : cephadm [INF] Deploying daemon osd.3 on gibba013 2021-03-10T13:56:25.589 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:56:25.589 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2m) 18s ago 8m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T13:56:25.590 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (8m) 107s ago 8m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T13:56:25.590 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3m) 107s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T13:56:25.590 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3m) 107s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T13:56:25.590 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2m) 18s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T13:56:25.591 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2m) 18s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T13:56:25.591 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (118s) 107s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T13:56:25.591 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2m) 18s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T13:56:25.591 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (8m) 18s ago 8m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T13:56:25.591 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (8m) 107s ago 8m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T13:56:25.592 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (73s) 18s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T13:56:25.592 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (46s) 18s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T13:56:25.592 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (20s) 18s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T13:56:25.592 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (10m) 18s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d0b507f36a88 2021-03-10T13:56:25.592 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (9m) 107s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5bcc0da1a794 2021-03-10T13:56:25.592 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (9m) 107s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 8e0d292ca03b 2021-03-10T13:56:25.593 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (9m) 107s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b54758e37be1 2021-03-10T13:56:25.593 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (8m) 107s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 75c9ee8106fc 2021-03-10T13:56:25.593 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (7m) 107s ago 8m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T13:56:25.593 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 107s ago 6m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:56:25.796 INFO:journalctl@ceph.osd.3.gibba013.stdout:Mar 10 13:56:25 gibba013 systemd[1]: Stopping Ceph osd.3 for 7672acc8-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:56:25.796 INFO:journalctl@ceph.osd.3.gibba013.stdout:Mar 10 13:56:25 gibba013 bash[19325]: debug 2021-03-10T13:56:25.674+0000 7f2445aef700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T13:56:25.797 INFO:journalctl@ceph.osd.3.gibba013.stdout:Mar 10 13:56:25 gibba013 bash[19325]: debug 2021-03-10T13:56:25.674+0000 7f2445aef700 -1 osd.3 77 *** Got signal Terminated *** 2021-03-10T13:56:25.797 INFO:journalctl@ceph.osd.3.gibba013.stdout:Mar 10 13:56:25 gibba013 bash[19325]: debug 2021-03-10T13:56:25.674+0000 7f2445aef700 -1 osd.3 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-03-10T13:56:25.847 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T13:56:25.848 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T13:56:25.848 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:56:25.848 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:56:25.848 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T13:56:25.848 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:56:25.849 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:56:25.849 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T13:56:25.849 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 5, 2021-03-10T13:56:25.849 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:56:25.849 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:56:25.850 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T13:56:25.850 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T13:56:25.850 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 5, 2021-03-10T13:56:25.850 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 9 2021-03-10T13:56:25.850 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T13:56:25.851 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T13:56:26.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:25 gibba013 bash[29418]: cluster 2021-03-10T13:56:24.472219+0000 mgr.gibba020.yqfnwy (mgr.34427) 189 : cluster [DBG] pgmap v88: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:56:26.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:25 gibba013 bash[29418]: cluster 2021-03-10T13:56:25.779782+0000 mon.a (mon.0) 332 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T13:56:26.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:25 gibba013 bash[29418]: cluster 2021-03-10T13:56:25.779811+0000 mon.a (mon.0) 333 : cluster [INF] osd.3 failed (root=default,host=gibba013) (connection refused reported by osd.6) 2021-03-10T13:56:26.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:25 gibba013 bash[29418]: cluster 2021-03-10T13:56:25.780041+0000 mon.a (mon.0) 334 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T13:56:26.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:25 gibba013 bash[29418]: cluster 2021-03-10T13:56:25.780181+0000 mon.a (mon.0) 335 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T13:56:26.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:25 gibba013 bash[29418]: cluster 2021-03-10T13:56:25.780238+0000 mon.a (mon.0) 336 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T13:56:26.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:25 gibba013 bash[29418]: cluster 2021-03-10T13:56:25.780289+0000 mon.a (mon.0) 337 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T13:56:26.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:25 gibba013 bash[29418]: cluster 2021-03-10T13:56:25.780360+0000 mon.a (mon.0) 338 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T13:56:26.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:25 gibba013 bash[29418]: cluster 2021-03-10T13:56:25.780437+0000 mon.a (mon.0) 339 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T13:56:26.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:25 gibba013 bash[29418]: cluster 2021-03-10T13:56:25.780530+0000 mon.a (mon.0) 340 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T13:56:26.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:25 gibba013 bash[29418]: audit 2021-03-10T13:56:25.848835+0000 mon.a (mon.0) 341 : audit [DBG] from='client.? 172.21.2.113:0/576341595' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:26.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:25 gibba013 bash[29418]: audit 2021-03-10T13:56:25.872931+0000 mon.a (mon.0) 342 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:56:26.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:25 gibba013 bash[30381]: cluster 2021-03-10T13:56:24.472219+0000 mgr.gibba020.yqfnwy (mgr.34427) 189 : cluster [DBG] pgmap v88: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:56:26.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:25 gibba013 bash[30381]: cluster 2021-03-10T13:56:25.779782+0000 mon.a (mon.0) 332 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T13:56:26.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:25 gibba013 bash[30381]: cluster 2021-03-10T13:56:25.779811+0000 mon.a (mon.0) 333 : cluster [INF] osd.3 failed (root=default,host=gibba013) (connection refused reported by osd.6) 2021-03-10T13:56:26.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:25 gibba013 bash[30381]: cluster 2021-03-10T13:56:25.780041+0000 mon.a (mon.0) 334 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T13:56:26.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:25 gibba013 bash[30381]: cluster 2021-03-10T13:56:25.780181+0000 mon.a (mon.0) 335 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T13:56:26.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:25 gibba013 bash[30381]: cluster 2021-03-10T13:56:25.780238+0000 mon.a (mon.0) 336 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T13:56:26.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:25 gibba013 bash[30381]: cluster 2021-03-10T13:56:25.780289+0000 mon.a (mon.0) 337 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T13:56:26.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:25 gibba013 bash[30381]: cluster 2021-03-10T13:56:25.780360+0000 mon.a (mon.0) 338 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T13:56:26.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:25 gibba013 bash[30381]: cluster 2021-03-10T13:56:25.780437+0000 mon.a (mon.0) 339 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T13:56:26.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:25 gibba013 bash[30381]: cluster 2021-03-10T13:56:25.780530+0000 mon.a (mon.0) 340 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T13:56:26.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:25 gibba013 bash[30381]: audit 2021-03-10T13:56:25.848835+0000 mon.a (mon.0) 341 : audit [DBG] from='client.? 172.21.2.113:0/576341595' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:26.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:25 gibba013 bash[30381]: audit 2021-03-10T13:56:25.872931+0000 mon.a (mon.0) 342 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:56:26.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:25 gibba020 bash[25448]: cluster 2021-03-10T13:56:24.472219+0000 mgr.gibba020.yqfnwy (mgr.34427) 189 : cluster [DBG] pgmap v88: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:56:26.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:25 gibba020 bash[25448]: cluster 2021-03-10T13:56:25.779782+0000 mon.a (mon.0) 332 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T13:56:26.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:25 gibba020 bash[25448]: cluster 2021-03-10T13:56:25.779811+0000 mon.a (mon.0) 333 : cluster [INF] osd.3 failed (root=default,host=gibba013) (connection refused reported by osd.6) 2021-03-10T13:56:26.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:25 gibba020 bash[25448]: cluster 2021-03-10T13:56:25.780041+0000 mon.a (mon.0) 334 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T13:56:26.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:25 gibba020 bash[25448]: cluster 2021-03-10T13:56:25.780181+0000 mon.a (mon.0) 335 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T13:56:26.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:25 gibba020 bash[25448]: cluster 2021-03-10T13:56:25.780238+0000 mon.a (mon.0) 336 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T13:56:26.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:25 gibba020 bash[25448]: cluster 2021-03-10T13:56:25.780289+0000 mon.a (mon.0) 337 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T13:56:26.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:25 gibba020 bash[25448]: cluster 2021-03-10T13:56:25.780360+0000 mon.a (mon.0) 338 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T13:56:26.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:25 gibba020 bash[25448]: cluster 2021-03-10T13:56:25.780437+0000 mon.a (mon.0) 339 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T13:56:26.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:25 gibba020 bash[25448]: cluster 2021-03-10T13:56:25.780530+0000 mon.a (mon.0) 340 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T13:56:26.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:25 gibba020 bash[25448]: audit 2021-03-10T13:56:25.848835+0000 mon.a (mon.0) 341 : audit [DBG] from='client.? 172.21.2.113:0/576341595' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:26.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:25 gibba020 bash[25448]: audit 2021-03-10T13:56:25.872931+0000 mon.a (mon.0) 342 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:56:26.878 INFO:journalctl@ceph.osd.3.gibba013.stdout:Mar 10 13:56:26 gibba013 docker[35427]: ceph-7672acc8-81a6-11eb-9080-001a4aab830c-osd.3 2021-03-10T13:56:27.274 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:26 gibba013 bash[29418]: audit 2021-03-10T13:56:25.335055+0000 mgr.gibba020.yqfnwy (mgr.34427) 190 : audit [DBG] from='client.54193 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:56:27.274 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:26 gibba013 bash[29418]: audit 2021-03-10T13:56:25.577574+0000 mgr.gibba020.yqfnwy (mgr.34427) 191 : audit [DBG] from='client.44214 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:56:27.275 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:26 gibba013 bash[29418]: cluster 2021-03-10T13:56:25.958065+0000 mon.a (mon.0) 343 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:56:27.275 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:26 gibba013 bash[29418]: cluster 2021-03-10T13:56:25.970161+0000 mon.a (mon.0) 344 : cluster [DBG] osdmap e78: 8 total, 7 up, 8 in 2021-03-10T13:56:27.275 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:26 gibba013 bash[30381]: audit 2021-03-10T13:56:25.335055+0000 mgr.gibba020.yqfnwy (mgr.34427) 190 : audit [DBG] from='client.54193 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:56:27.275 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:26 gibba013 bash[30381]: audit 2021-03-10T13:56:25.577574+0000 mgr.gibba020.yqfnwy (mgr.34427) 191 : audit [DBG] from='client.44214 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:56:27.276 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:26 gibba013 bash[30381]: cluster 2021-03-10T13:56:25.958065+0000 mon.a (mon.0) 343 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:56:27.276 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:26 gibba013 bash[30381]: cluster 2021-03-10T13:56:25.970161+0000 mon.a (mon.0) 344 : cluster [DBG] osdmap e78: 8 total, 7 up, 8 in 2021-03-10T13:56:27.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:26 gibba020 bash[25448]: audit 2021-03-10T13:56:25.335055+0000 mgr.gibba020.yqfnwy (mgr.34427) 190 : audit [DBG] from='client.54193 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:56:27.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:26 gibba020 bash[25448]: audit 2021-03-10T13:56:25.577574+0000 mgr.gibba020.yqfnwy (mgr.34427) 191 : audit [DBG] from='client.44214 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:56:27.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:26 gibba020 bash[25448]: cluster 2021-03-10T13:56:25.958065+0000 mon.a (mon.0) 343 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:56:27.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:26 gibba020 bash[25448]: cluster 2021-03-10T13:56:25.970161+0000 mon.a (mon.0) 344 : cluster [DBG] osdmap e78: 8 total, 7 up, 8 in 2021-03-10T13:56:28.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:27 gibba013 bash[29418]: cluster 2021-03-10T13:56:26.472755+0000 mgr.gibba020.yqfnwy (mgr.34427) 192 : cluster [DBG] pgmap v90: 129 pgs: 20 stale+active+clean, 10 active+clean+wait, 99 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:56:28.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:27 gibba013 bash[29418]: cluster 2021-03-10T13:56:26.976901+0000 mon.a (mon.0) 345 : cluster [DBG] osdmap e79: 8 total, 7 up, 8 in 2021-03-10T13:56:28.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:27 gibba013 bash[30381]: cluster 2021-03-10T13:56:26.472755+0000 mgr.gibba020.yqfnwy (mgr.34427) 192 : cluster [DBG] pgmap v90: 129 pgs: 20 stale+active+clean, 10 active+clean+wait, 99 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:56:28.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:27 gibba013 bash[30381]: cluster 2021-03-10T13:56:26.976901+0000 mon.a (mon.0) 345 : cluster [DBG] osdmap e79: 8 total, 7 up, 8 in 2021-03-10T13:56:28.296 INFO:journalctl@ceph.osd.3.gibba013.stdout:Mar 10 13:56:28 gibba013 systemd[1]: ceph-7672acc8-81a6-11eb-9080-001a4aab830c@osd.3.service: Succeeded. 2021-03-10T13:56:28.297 INFO:journalctl@ceph.osd.3.gibba013.stdout:Mar 10 13:56:28 gibba013 systemd[1]: Stopped Ceph osd.3 for 7672acc8-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:56:28.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:27 gibba020 bash[25448]: cluster 2021-03-10T13:56:26.472755+0000 mgr.gibba020.yqfnwy (mgr.34427) 192 : cluster [DBG] pgmap v90: 129 pgs: 20 stale+active+clean, 10 active+clean+wait, 99 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T13:56:28.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:27 gibba020 bash[25448]: cluster 2021-03-10T13:56:26.976901+0000 mon.a (mon.0) 345 : cluster [DBG] osdmap e79: 8 total, 7 up, 8 in 2021-03-10T13:56:28.627 INFO:journalctl@ceph.osd.3.gibba013.stdout:Mar 10 13:56:28 gibba013 systemd[1]: Started Ceph osd.3 for 7672acc8-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:56:29.543 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:29 gibba013 bash[29418]: audit 2021-03-10T13:56:28.393722+0000 mon.a (mon.0) 346 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:56:29.543 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:29 gibba013 bash[29418]: audit 2021-03-10T13:56:28.395448+0000 mon.a (mon.0) 347 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:56:29.544 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:29 gibba013 bash[29418]: cephadm 2021-03-10T13:56:28.398436+0000 mgr.gibba020.yqfnwy (mgr.34427) 193 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T13:56:29.544 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:29 gibba013 bash[29418]: audit 2021-03-10T13:56:28.399561+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:56:29.544 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:29 gibba013 bash[29418]: cluster 2021-03-10T13:56:28.473313+0000 mgr.gibba020.yqfnwy (mgr.34427) 194 : cluster [DBG] pgmap v92: 129 pgs: 7 stale+active+clean, 5 active+undersized+degraded, 22 peering, 10 active+clean+wait, 5 active+undersized, 80 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 6/192 objects degraded (3.125%) 2021-03-10T13:56:29.544 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:29 gibba013 bash[30381]: audit 2021-03-10T13:56:28.393722+0000 mon.a (mon.0) 346 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:56:29.544 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:29 gibba013 bash[30381]: audit 2021-03-10T13:56:28.395448+0000 mon.a (mon.0) 347 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:56:29.545 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:29 gibba013 bash[30381]: cephadm 2021-03-10T13:56:28.398436+0000 mgr.gibba020.yqfnwy (mgr.34427) 193 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T13:56:29.545 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:29 gibba013 bash[30381]: audit 2021-03-10T13:56:28.399561+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:56:29.545 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:29 gibba013 bash[30381]: cluster 2021-03-10T13:56:28.473313+0000 mgr.gibba020.yqfnwy (mgr.34427) 194 : cluster [DBG] pgmap v92: 129 pgs: 7 stale+active+clean, 5 active+undersized+degraded, 22 peering, 10 active+clean+wait, 5 active+undersized, 80 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 6/192 objects degraded (3.125%) 2021-03-10T13:56:29.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:29 gibba020 bash[25448]: audit 2021-03-10T13:56:28.393722+0000 mon.a (mon.0) 346 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:56:29.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:29 gibba020 bash[25448]: audit 2021-03-10T13:56:28.395448+0000 mon.a (mon.0) 347 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:56:29.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:29 gibba020 bash[25448]: cephadm 2021-03-10T13:56:28.398436+0000 mgr.gibba020.yqfnwy (mgr.34427) 193 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T13:56:29.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:29 gibba020 bash[25448]: audit 2021-03-10T13:56:28.399561+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:56:29.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:29 gibba020 bash[25448]: cluster 2021-03-10T13:56:28.473313+0000 mgr.gibba020.yqfnwy (mgr.34427) 194 : cluster [DBG] pgmap v92: 129 pgs: 7 stale+active+clean, 5 active+undersized+degraded, 22 peering, 10 active+clean+wait, 5 active+undersized, 80 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 6/192 objects degraded (3.125%) 2021-03-10T13:56:29.878 INFO:journalctl@ceph.osd.3.gibba013.stdout:Mar 10 13:56:29 gibba013 bash[35623]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-03-10T13:56:29.878 INFO:journalctl@ceph.osd.3.gibba013.stdout:Mar 10 13:56:29 gibba013 bash[35623]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2021-03-10T13:56:29.878 INFO:journalctl@ceph.osd.3.gibba013.stdout:Mar 10 13:56:29 gibba013 bash[35623]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3/block 2021-03-10T13:56:29.879 INFO:journalctl@ceph.osd.3.gibba013.stdout:Mar 10 13:56:29 gibba013 bash[35623]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2021-03-10T13:56:29.879 INFO:journalctl@ceph.osd.3.gibba013.stdout:Mar 10 13:56:29 gibba013 bash[35623]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2021-03-10T13:56:29.879 INFO:journalctl@ceph.osd.3.gibba013.stdout:Mar 10 13:56:29 gibba013 bash[35623]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-03-10T13:56:29.879 INFO:journalctl@ceph.osd.3.gibba013.stdout:Mar 10 13:56:29 gibba013 bash[35623]: --> ceph-volume lvm activate successful for osd ID: 3 2021-03-10T13:56:30.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:30 gibba013 bash[29418]: cluster 2021-03-10T13:56:29.392323+0000 mon.a (mon.0) 349 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs inactive, 6 pgs peering (PG_AVAILABILITY) 2021-03-10T13:56:30.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:30 gibba013 bash[29418]: cluster 2021-03-10T13:56:29.392345+0000 mon.a (mon.0) 350 : cluster [WRN] Health check failed: Degraded data redundancy: 6/192 objects degraded (3.125%), 5 pgs degraded (PG_DEGRADED) 2021-03-10T13:56:30.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:30 gibba013 bash[30381]: cluster 2021-03-10T13:56:29.392323+0000 mon.a (mon.0) 349 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs inactive, 6 pgs peering (PG_AVAILABILITY) 2021-03-10T13:56:30.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:30 gibba013 bash[30381]: cluster 2021-03-10T13:56:29.392345+0000 mon.a (mon.0) 350 : cluster [WRN] Health check failed: Degraded data redundancy: 6/192 objects degraded (3.125%), 5 pgs degraded (PG_DEGRADED) 2021-03-10T13:56:30.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:30 gibba020 bash[25448]: cluster 2021-03-10T13:56:29.392323+0000 mon.a (mon.0) 349 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs inactive, 6 pgs peering (PG_AVAILABILITY) 2021-03-10T13:56:30.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:30 gibba020 bash[25448]: cluster 2021-03-10T13:56:29.392345+0000 mon.a (mon.0) 350 : cluster [WRN] Health check failed: Degraded data redundancy: 6/192 objects degraded (3.125%), 5 pgs degraded (PG_DEGRADED) 2021-03-10T13:56:31.378 INFO:journalctl@ceph.osd.3.gibba013.stdout:Mar 10 13:56:31 gibba013 bash[35754]: debug 2021-03-10T13:56:31.082+0000 7f9d3bd92700 1 -- 172.21.2.113:0/2047735680 <== mon.0 v2:172.21.2.113:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55bc9ea644e0 con 0x55bc9eae1400 2021-03-10T13:56:31.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:31 gibba020 bash[25448]: cluster 2021-03-10T13:56:30.474280+0000 mgr.gibba020.yqfnwy (mgr.34427) 195 : cluster [DBG] pgmap v93: 129 pgs: 10 active+undersized+degraded, 22 peering, 18 active+undersized, 79 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 12/192 objects degraded (6.250%) 2021-03-10T13:56:31.878 INFO:journalctl@ceph.osd.3.gibba013.stdout:Mar 10 13:56:31 gibba013 bash[35754]: debug 2021-03-10T13:56:31.634+0000 7f9d43827080 -1 Falling back to public interface 2021-03-10T13:56:31.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:31 gibba013 bash[29418]: cluster 2021-03-10T13:56:30.474280+0000 mgr.gibba020.yqfnwy (mgr.34427) 195 : cluster [DBG] pgmap v93: 129 pgs: 10 active+undersized+degraded, 22 peering, 18 active+undersized, 79 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 12/192 objects degraded (6.250%) 2021-03-10T13:56:31.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:31 gibba013 bash[30381]: cluster 2021-03-10T13:56:30.474280+0000 mgr.gibba020.yqfnwy (mgr.34427) 195 : cluster [DBG] pgmap v93: 129 pgs: 10 active+undersized+degraded, 22 peering, 18 active+undersized, 79 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 12/192 objects degraded (6.250%) 2021-03-10T13:56:32.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:32 gibba013 bash[29418]: cluster 2021-03-10T13:56:32.531305+0000 mon.a (mon.0) 351 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive, 6 pgs peering) 2021-03-10T13:56:32.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:32 gibba013 bash[30381]: cluster 2021-03-10T13:56:32.531305+0000 mon.a (mon.0) 351 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive, 6 pgs peering) 2021-03-10T13:56:32.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:32 gibba020 bash[25448]: cluster 2021-03-10T13:56:32.531305+0000 mon.a (mon.0) 351 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive, 6 pgs peering) 2021-03-10T13:56:33.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:33 gibba013 bash[29418]: cluster 2021-03-10T13:56:32.476355+0000 mgr.gibba020.yqfnwy (mgr.34427) 196 : cluster [DBG] pgmap v94: 129 pgs: 17 active+undersized+degraded, 33 active+undersized, 79 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 23/192 objects degraded (11.979%) 2021-03-10T13:56:33.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:33 gibba013 bash[29418]: audit 2021-03-10T13:56:33.561116+0000 mon.a (mon.0) 352 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:56:33.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:33 gibba013 bash[30381]: cluster 2021-03-10T13:56:32.476355+0000 mgr.gibba020.yqfnwy (mgr.34427) 196 : cluster [DBG] pgmap v94: 129 pgs: 17 active+undersized+degraded, 33 active+undersized, 79 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 23/192 objects degraded (11.979%) 2021-03-10T13:56:33.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:33 gibba013 bash[30381]: audit 2021-03-10T13:56:33.561116+0000 mon.a (mon.0) 352 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:56:33.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:33 gibba020 bash[25448]: cluster 2021-03-10T13:56:32.476355+0000 mgr.gibba020.yqfnwy (mgr.34427) 196 : cluster [DBG] pgmap v94: 129 pgs: 17 active+undersized+degraded, 33 active+undersized, 79 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 23/192 objects degraded (11.979%) 2021-03-10T13:56:33.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:33 gibba020 bash[25448]: audit 2021-03-10T13:56:33.561116+0000 mon.a (mon.0) 352 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:56:35.054 INFO:journalctl@ceph.osd.3.gibba013.stdout:Mar 10 13:56:34 gibba013 bash[35754]: debug 2021-03-10T13:56:34.922+0000 7f9d43827080 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: store not yet converted to per-pg omap 2021-03-10T13:56:35.055 INFO:journalctl@ceph.osd.3.gibba013.stdout:Mar 10 13:56:34 gibba013 bash[35754]: debug 2021-03-10T13:56:34.922+0000 7f9d2f2ed700 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2021-03-10T13:56:35.055 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:34 gibba013 bash[29418]: cephadm 2021-03-10T13:56:33.559898+0000 mgr.gibba020.yqfnwy (mgr.34427) 197 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T13:56:35.056 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:34 gibba013 bash[29418]: audit 2021-03-10T13:56:33.781355+0000 mon.a (mon.0) 353 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:56:35.056 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:34 gibba013 bash[29418]: cephadm 2021-03-10T13:56:33.786537+0000 mgr.gibba020.yqfnwy (mgr.34427) 198 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:56:35.057 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:34 gibba013 bash[29418]: cephadm 2021-03-10T13:56:33.788342+0000 mgr.gibba020.yqfnwy (mgr.34427) 199 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:56:35.057 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:34 gibba013 bash[29418]: audit 2021-03-10T13:56:33.789034+0000 mon.a (mon.0) 354 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:56:35.057 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:34 gibba013 bash[29418]: cephadm 2021-03-10T13:56:33.789898+0000 mgr.gibba020.yqfnwy (mgr.34427) 200 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:56:35.057 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:34 gibba013 bash[29418]: cephadm 2021-03-10T13:56:33.789939+0000 mgr.gibba020.yqfnwy (mgr.34427) 201 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:56:35.058 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:34 gibba013 bash[29418]: audit 2021-03-10T13:56:33.790640+0000 mon.a (mon.0) 355 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:35.058 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:34 gibba013 bash[29418]: cephadm 2021-03-10T13:56:33.791504+0000 mgr.gibba020.yqfnwy (mgr.34427) 202 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:56:35.058 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:34 gibba013 bash[29418]: cephadm 2021-03-10T13:56:33.791545+0000 mgr.gibba020.yqfnwy (mgr.34427) 203 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:56:35.058 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:34 gibba013 bash[29418]: audit 2021-03-10T13:56:33.792158+0000 mon.a (mon.0) 356 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:35.059 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:34 gibba013 bash[29418]: cephadm 2021-03-10T13:56:33.793056+0000 mgr.gibba020.yqfnwy (mgr.34427) 204 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:56:35.059 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:34 gibba013 bash[29418]: audit 2021-03-10T13:56:33.793679+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:35.059 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:34 gibba013 bash[29418]: cephadm 2021-03-10T13:56:33.794346+0000 mgr.gibba020.yqfnwy (mgr.34427) 205 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:56:35.059 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:34 gibba013 bash[29418]: cephadm 2021-03-10T13:56:33.794389+0000 mgr.gibba020.yqfnwy (mgr.34427) 206 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:56:35.059 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:34 gibba013 bash[29418]: audit 2021-03-10T13:56:33.795040+0000 mgr.gibba020.yqfnwy (mgr.34427) 207 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T13:56:35.060 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:34 gibba013 bash[29418]: cephadm 2021-03-10T13:56:33.796005+0000 mgr.gibba020.yqfnwy (mgr.34427) 208 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2021-03-10T13:56:35.060 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:34 gibba013 bash[29418]: audit 2021-03-10T13:56:33.796558+0000 mon.a (mon.0) 358 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T13:56:35.060 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:34 gibba013 bash[29418]: cluster 2021-03-10T13:56:34.745040+0000 mon.a (mon.0) 359 : cluster [WRN] Health check update: Degraded data redundancy: 23/192 objects degraded (11.979%), 17 pgs degraded (PG_DEGRADED) 2021-03-10T13:56:35.060 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:34 gibba013 bash[30381]: cephadm 2021-03-10T13:56:33.559898+0000 mgr.gibba020.yqfnwy (mgr.34427) 197 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T13:56:35.061 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:34 gibba013 bash[30381]: audit 2021-03-10T13:56:33.781355+0000 mon.a (mon.0) 353 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:56:35.061 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:34 gibba013 bash[30381]: cephadm 2021-03-10T13:56:33.786537+0000 mgr.gibba020.yqfnwy (mgr.34427) 198 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:56:35.061 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:34 gibba013 bash[30381]: cephadm 2021-03-10T13:56:33.788342+0000 mgr.gibba020.yqfnwy (mgr.34427) 199 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:56:35.061 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:34 gibba013 bash[30381]: audit 2021-03-10T13:56:33.789034+0000 mon.a (mon.0) 354 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:56:35.061 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:34 gibba013 bash[30381]: cephadm 2021-03-10T13:56:33.789898+0000 mgr.gibba020.yqfnwy (mgr.34427) 200 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:56:35.062 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:34 gibba013 bash[30381]: cephadm 2021-03-10T13:56:33.789939+0000 mgr.gibba020.yqfnwy (mgr.34427) 201 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:56:35.062 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:34 gibba013 bash[30381]: audit 2021-03-10T13:56:33.790640+0000 mon.a (mon.0) 355 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:35.062 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:34 gibba013 bash[30381]: cephadm 2021-03-10T13:56:33.791504+0000 mgr.gibba020.yqfnwy (mgr.34427) 202 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:56:35.062 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:34 gibba013 bash[30381]: cephadm 2021-03-10T13:56:33.791545+0000 mgr.gibba020.yqfnwy (mgr.34427) 203 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:56:35.062 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:34 gibba013 bash[30381]: audit 2021-03-10T13:56:33.792158+0000 mon.a (mon.0) 356 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:35.063 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:34 gibba013 bash[30381]: cephadm 2021-03-10T13:56:33.793056+0000 mgr.gibba020.yqfnwy (mgr.34427) 204 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:56:35.063 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:34 gibba013 bash[30381]: audit 2021-03-10T13:56:33.793679+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:35.063 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:34 gibba013 bash[30381]: cephadm 2021-03-10T13:56:33.794346+0000 mgr.gibba020.yqfnwy (mgr.34427) 205 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:56:35.063 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:34 gibba013 bash[30381]: cephadm 2021-03-10T13:56:33.794389+0000 mgr.gibba020.yqfnwy (mgr.34427) 206 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:56:35.063 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:34 gibba013 bash[30381]: audit 2021-03-10T13:56:33.795040+0000 mgr.gibba020.yqfnwy (mgr.34427) 207 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T13:56:35.064 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:34 gibba013 bash[30381]: cephadm 2021-03-10T13:56:33.796005+0000 mgr.gibba020.yqfnwy (mgr.34427) 208 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2021-03-10T13:56:35.064 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:34 gibba013 bash[30381]: audit 2021-03-10T13:56:33.796558+0000 mon.a (mon.0) 358 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T13:56:35.064 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:34 gibba013 bash[30381]: cluster 2021-03-10T13:56:34.745040+0000 mon.a (mon.0) 359 : cluster [WRN] Health check update: Degraded data redundancy: 23/192 objects degraded (11.979%), 17 pgs degraded (PG_DEGRADED) 2021-03-10T13:56:35.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:34 gibba020 bash[25448]: cephadm 2021-03-10T13:56:33.559898+0000 mgr.gibba020.yqfnwy (mgr.34427) 197 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T13:56:35.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:34 gibba020 bash[25448]: audit 2021-03-10T13:56:33.781355+0000 mon.a (mon.0) 353 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:56:35.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:34 gibba020 bash[25448]: cephadm 2021-03-10T13:56:33.786537+0000 mgr.gibba020.yqfnwy (mgr.34427) 198 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:56:35.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:34 gibba020 bash[25448]: cephadm 2021-03-10T13:56:33.788342+0000 mgr.gibba020.yqfnwy (mgr.34427) 199 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:56:35.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:34 gibba020 bash[25448]: audit 2021-03-10T13:56:33.789034+0000 mon.a (mon.0) 354 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:56:35.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:34 gibba020 bash[25448]: cephadm 2021-03-10T13:56:33.789898+0000 mgr.gibba020.yqfnwy (mgr.34427) 200 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:56:35.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:34 gibba020 bash[25448]: cephadm 2021-03-10T13:56:33.789939+0000 mgr.gibba020.yqfnwy (mgr.34427) 201 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:56:35.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:34 gibba020 bash[25448]: audit 2021-03-10T13:56:33.790640+0000 mon.a (mon.0) 355 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:35.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:34 gibba020 bash[25448]: cephadm 2021-03-10T13:56:33.791504+0000 mgr.gibba020.yqfnwy (mgr.34427) 202 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:56:35.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:34 gibba020 bash[25448]: cephadm 2021-03-10T13:56:33.791545+0000 mgr.gibba020.yqfnwy (mgr.34427) 203 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:56:35.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:34 gibba020 bash[25448]: audit 2021-03-10T13:56:33.792158+0000 mon.a (mon.0) 356 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:35.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:34 gibba020 bash[25448]: cephadm 2021-03-10T13:56:33.793056+0000 mgr.gibba020.yqfnwy (mgr.34427) 204 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:56:35.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:34 gibba020 bash[25448]: audit 2021-03-10T13:56:33.793679+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:35.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:34 gibba020 bash[25448]: cephadm 2021-03-10T13:56:33.794346+0000 mgr.gibba020.yqfnwy (mgr.34427) 205 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:56:35.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:34 gibba020 bash[25448]: cephadm 2021-03-10T13:56:33.794389+0000 mgr.gibba020.yqfnwy (mgr.34427) 206 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:56:35.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:34 gibba020 bash[25448]: audit 2021-03-10T13:56:33.795040+0000 mgr.gibba020.yqfnwy (mgr.34427) 207 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T13:56:35.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:34 gibba020 bash[25448]: cephadm 2021-03-10T13:56:33.796005+0000 mgr.gibba020.yqfnwy (mgr.34427) 208 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2021-03-10T13:56:35.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:34 gibba020 bash[25448]: audit 2021-03-10T13:56:33.796558+0000 mon.a (mon.0) 358 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T13:56:35.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:34 gibba020 bash[25448]: cluster 2021-03-10T13:56:34.745040+0000 mon.a (mon.0) 359 : cluster [WRN] Health check update: Degraded data redundancy: 23/192 objects degraded (11.979%), 17 pgs degraded (PG_DEGRADED) 2021-03-10T13:56:35.378 INFO:journalctl@ceph.osd.3.gibba013.stdout:Mar 10 13:56:35 gibba013 bash[35754]: debug 2021-03-10T13:56:35.050+0000 7f9d43827080 -1 osd.3 77 log_to_monitors {default=true} 2021-03-10T13:56:36.128 INFO:journalctl@ceph.osd.3.gibba013.stdout:Mar 10 13:56:35 gibba013 bash[35754]: debug 2021-03-10T13:56:35.802+0000 7f9d34d07700 -1 osd.3 77 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:56:36.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:35 gibba013 bash[29418]: cluster 2021-03-10T13:56:34.478001+0000 mgr.gibba020.yqfnwy (mgr.34427) 209 : cluster [DBG] pgmap v95: 129 pgs: 17 active+undersized+degraded, 33 active+undersized, 79 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 23/192 objects degraded (11.979%) 2021-03-10T13:56:36.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:35 gibba013 bash[29418]: audit 2021-03-10T13:56:35.058401+0000 mon.c (mon.1) 13 : audit [INF] from='osd.3 [v2:172.21.2.113:6824/3700186321,v1:172.21.2.113:6825/3700186321]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T13:56:36.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:35 gibba013 bash[29418]: audit 2021-03-10T13:56:35.058698+0000 mon.a (mon.0) 360 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T13:56:36.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:35 gibba013 bash[30381]: cluster 2021-03-10T13:56:34.478001+0000 mgr.gibba020.yqfnwy (mgr.34427) 209 : cluster [DBG] pgmap v95: 129 pgs: 17 active+undersized+degraded, 33 active+undersized, 79 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 23/192 objects degraded (11.979%) 2021-03-10T13:56:36.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:35 gibba013 bash[30381]: audit 2021-03-10T13:56:35.058401+0000 mon.c (mon.1) 13 : audit [INF] from='osd.3 [v2:172.21.2.113:6824/3700186321,v1:172.21.2.113:6825/3700186321]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T13:56:36.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:35 gibba013 bash[30381]: audit 2021-03-10T13:56:35.058698+0000 mon.a (mon.0) 360 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T13:56:36.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:35 gibba020 bash[25448]: cluster 2021-03-10T13:56:34.478001+0000 mgr.gibba020.yqfnwy (mgr.34427) 209 : cluster [DBG] pgmap v95: 129 pgs: 17 active+undersized+degraded, 33 active+undersized, 79 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 23/192 objects degraded (11.979%) 2021-03-10T13:56:36.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:35 gibba020 bash[25448]: audit 2021-03-10T13:56:35.058401+0000 mon.c (mon.1) 13 : audit [INF] from='osd.3 [v2:172.21.2.113:6824/3700186321,v1:172.21.2.113:6825/3700186321]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T13:56:36.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:35 gibba020 bash[25448]: audit 2021-03-10T13:56:35.058698+0000 mon.a (mon.0) 360 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T13:56:37.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:36 gibba013 bash[29418]: audit 2021-03-10T13:56:35.792243+0000 mon.a (mon.0) 361 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-03-10T13:56:37.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:36 gibba013 bash[29418]: cluster 2021-03-10T13:56:35.792378+0000 mon.a (mon.0) 362 : cluster [DBG] osdmap e80: 8 total, 7 up, 8 in 2021-03-10T13:56:37.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:36 gibba013 bash[29418]: audit 2021-03-10T13:56:35.793482+0000 mon.c (mon.1) 14 : audit [INF] from='osd.3 [v2:172.21.2.113:6824/3700186321,v1:172.21.2.113:6825/3700186321]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:56:37.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:36 gibba013 bash[29418]: audit 2021-03-10T13:56:35.800920+0000 mon.a (mon.0) 363 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:56:37.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:36 gibba013 bash[30381]: audit 2021-03-10T13:56:35.792243+0000 mon.a (mon.0) 361 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-03-10T13:56:37.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:36 gibba013 bash[30381]: cluster 2021-03-10T13:56:35.792378+0000 mon.a (mon.0) 362 : cluster [DBG] osdmap e80: 8 total, 7 up, 8 in 2021-03-10T13:56:37.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:36 gibba013 bash[30381]: audit 2021-03-10T13:56:35.793482+0000 mon.c (mon.1) 14 : audit [INF] from='osd.3 [v2:172.21.2.113:6824/3700186321,v1:172.21.2.113:6825/3700186321]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:56:37.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:36 gibba013 bash[30381]: audit 2021-03-10T13:56:35.800920+0000 mon.a (mon.0) 363 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:56:37.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:36 gibba020 bash[25448]: audit 2021-03-10T13:56:35.792243+0000 mon.a (mon.0) 361 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-03-10T13:56:37.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:36 gibba020 bash[25448]: cluster 2021-03-10T13:56:35.792378+0000 mon.a (mon.0) 362 : cluster [DBG] osdmap e80: 8 total, 7 up, 8 in 2021-03-10T13:56:37.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:36 gibba020 bash[25448]: audit 2021-03-10T13:56:35.793482+0000 mon.c (mon.1) 14 : audit [INF] from='osd.3 [v2:172.21.2.113:6824/3700186321,v1:172.21.2.113:6825/3700186321]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:56:37.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:36 gibba020 bash[25448]: audit 2021-03-10T13:56:35.800920+0000 mon.a (mon.0) 363 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba013", "root=default"]}]: dispatch 2021-03-10T13:56:38.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:37 gibba013 bash[29418]: cluster 2021-03-10T13:56:36.479184+0000 mgr.gibba020.yqfnwy (mgr.34427) 210 : cluster [DBG] pgmap v97: 129 pgs: 17 active+undersized+degraded, 33 active+undersized, 79 active+clean; 7.0 KiB data, 27 MiB used, 668 GiB / 672 GiB avail; 23/192 objects degraded (11.979%) 2021-03-10T13:56:38.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:37 gibba013 bash[29418]: cluster 2021-03-10T13:56:36.799850+0000 mon.a (mon.0) 364 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:56:38.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:37 gibba013 bash[29418]: cluster 2021-03-10T13:56:36.809973+0000 mon.a (mon.0) 365 : cluster [INF] osd.3 [v2:172.21.2.113:6824/3700186321,v1:172.21.2.113:6825/3700186321] boot 2021-03-10T13:56:38.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:37 gibba013 bash[29418]: cluster 2021-03-10T13:56:36.810016+0000 mon.a (mon.0) 366 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2021-03-10T13:56:38.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:37 gibba013 bash[29418]: audit 2021-03-10T13:56:36.810506+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:56:38.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:37 gibba013 bash[29418]: cluster 2021-03-10T13:56:37.815757+0000 mon.a (mon.0) 368 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2021-03-10T13:56:38.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:37 gibba013 bash[30381]: cluster 2021-03-10T13:56:36.479184+0000 mgr.gibba020.yqfnwy (mgr.34427) 210 : cluster [DBG] pgmap v97: 129 pgs: 17 active+undersized+degraded, 33 active+undersized, 79 active+clean; 7.0 KiB data, 27 MiB used, 668 GiB / 672 GiB avail; 23/192 objects degraded (11.979%) 2021-03-10T13:56:38.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:37 gibba013 bash[30381]: cluster 2021-03-10T13:56:36.799850+0000 mon.a (mon.0) 364 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:56:38.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:37 gibba013 bash[30381]: cluster 2021-03-10T13:56:36.809973+0000 mon.a (mon.0) 365 : cluster [INF] osd.3 [v2:172.21.2.113:6824/3700186321,v1:172.21.2.113:6825/3700186321] boot 2021-03-10T13:56:38.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:37 gibba013 bash[30381]: cluster 2021-03-10T13:56:36.810016+0000 mon.a (mon.0) 366 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2021-03-10T13:56:38.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:37 gibba013 bash[30381]: audit 2021-03-10T13:56:36.810506+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:56:38.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:37 gibba013 bash[30381]: cluster 2021-03-10T13:56:37.815757+0000 mon.a (mon.0) 368 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2021-03-10T13:56:38.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:37 gibba020 bash[25448]: cluster 2021-03-10T13:56:36.479184+0000 mgr.gibba020.yqfnwy (mgr.34427) 210 : cluster [DBG] pgmap v97: 129 pgs: 17 active+undersized+degraded, 33 active+undersized, 79 active+clean; 7.0 KiB data, 27 MiB used, 668 GiB / 672 GiB avail; 23/192 objects degraded (11.979%) 2021-03-10T13:56:38.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:37 gibba020 bash[25448]: cluster 2021-03-10T13:56:36.799850+0000 mon.a (mon.0) 364 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:56:38.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:37 gibba020 bash[25448]: cluster 2021-03-10T13:56:36.809973+0000 mon.a (mon.0) 365 : cluster [INF] osd.3 [v2:172.21.2.113:6824/3700186321,v1:172.21.2.113:6825/3700186321] boot 2021-03-10T13:56:38.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:37 gibba020 bash[25448]: cluster 2021-03-10T13:56:36.810016+0000 mon.a (mon.0) 366 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2021-03-10T13:56:38.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:37 gibba020 bash[25448]: audit 2021-03-10T13:56:36.810506+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T13:56:38.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:37 gibba020 bash[25448]: cluster 2021-03-10T13:56:37.815757+0000 mon.a (mon.0) 368 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2021-03-10T13:56:40.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:39 gibba013 bash[29418]: cluster 2021-03-10T13:56:38.480539+0000 mgr.gibba020.yqfnwy (mgr.34427) 211 : cluster [DBG] pgmap v100: 129 pgs: 14 active+undersized+degraded, 30 active+undersized, 85 active+clean; 7.0 KiB data, 27 MiB used, 668 GiB / 672 GiB avail; 20/192 objects degraded (10.417%) 2021-03-10T13:56:40.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:39 gibba013 bash[29418]: cluster 2021-03-10T13:56:39.746392+0000 mon.a (mon.0) 369 : cluster [WRN] Health check update: Degraded data redundancy: 20/192 objects degraded (10.417%), 14 pgs degraded (PG_DEGRADED) 2021-03-10T13:56:40.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:39 gibba013 bash[30381]: cluster 2021-03-10T13:56:38.480539+0000 mgr.gibba020.yqfnwy (mgr.34427) 211 : cluster [DBG] pgmap v100: 129 pgs: 14 active+undersized+degraded, 30 active+undersized, 85 active+clean; 7.0 KiB data, 27 MiB used, 668 GiB / 672 GiB avail; 20/192 objects degraded (10.417%) 2021-03-10T13:56:40.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:39 gibba013 bash[30381]: cluster 2021-03-10T13:56:39.746392+0000 mon.a (mon.0) 369 : cluster [WRN] Health check update: Degraded data redundancy: 20/192 objects degraded (10.417%), 14 pgs degraded (PG_DEGRADED) 2021-03-10T13:56:40.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:39 gibba020 bash[25448]: cluster 2021-03-10T13:56:38.480539+0000 mgr.gibba020.yqfnwy (mgr.34427) 211 : cluster [DBG] pgmap v100: 129 pgs: 14 active+undersized+degraded, 30 active+undersized, 85 active+clean; 7.0 KiB data, 27 MiB used, 668 GiB / 672 GiB avail; 20/192 objects degraded (10.417%) 2021-03-10T13:56:40.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:39 gibba020 bash[25448]: cluster 2021-03-10T13:56:39.746392+0000 mon.a (mon.0) 369 : cluster [WRN] Health check update: Degraded data redundancy: 20/192 objects degraded (10.417%), 14 pgs degraded (PG_DEGRADED) 2021-03-10T13:56:42.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:41 gibba013 bash[29418]: cluster 2021-03-10T13:56:40.481934+0000 mgr.gibba020.yqfnwy (mgr.34427) 212 : cluster [DBG] pgmap v101: 129 pgs: 11 active+undersized+degraded, 22 active+undersized, 96 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail; 16/192 objects degraded (8.333%) 2021-03-10T13:56:42.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:41 gibba013 bash[30381]: cluster 2021-03-10T13:56:40.481934+0000 mgr.gibba020.yqfnwy (mgr.34427) 212 : cluster [DBG] pgmap v101: 129 pgs: 11 active+undersized+degraded, 22 active+undersized, 96 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail; 16/192 objects degraded (8.333%) 2021-03-10T13:56:42.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:41 gibba020 bash[25448]: cluster 2021-03-10T13:56:40.481934+0000 mgr.gibba020.yqfnwy (mgr.34427) 212 : cluster [DBG] pgmap v101: 129 pgs: 11 active+undersized+degraded, 22 active+undersized, 96 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail; 16/192 objects degraded (8.333%) 2021-03-10T13:56:43.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:42 gibba020 bash[25448]: cluster 2021-03-10T13:56:42.833372+0000 mon.a (mon.0) 370 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/192 objects degraded (8.333%), 11 pgs degraded) 2021-03-10T13:56:43.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:42 gibba013 bash[29418]: cluster 2021-03-10T13:56:42.833372+0000 mon.a (mon.0) 370 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/192 objects degraded (8.333%), 11 pgs degraded) 2021-03-10T13:56:43.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:42 gibba013 bash[30381]: cluster 2021-03-10T13:56:42.833372+0000 mon.a (mon.0) 370 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/192 objects degraded (8.333%), 11 pgs degraded) 2021-03-10T13:56:44.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:43 gibba020 bash[25448]: cluster 2021-03-10T13:56:42.483856+0000 mgr.gibba020.yqfnwy (mgr.34427) 213 : cluster [DBG] pgmap v102: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:56:44.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:43 gibba013 bash[29418]: cluster 2021-03-10T13:56:42.483856+0000 mgr.gibba020.yqfnwy (mgr.34427) 213 : cluster [DBG] pgmap v102: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:56:44.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:43 gibba013 bash[30381]: cluster 2021-03-10T13:56:42.483856+0000 mgr.gibba020.yqfnwy (mgr.34427) 213 : cluster [DBG] pgmap v102: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:56:46.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:45 gibba020 bash[25448]: cluster 2021-03-10T13:56:44.485197+0000 mgr.gibba020.yqfnwy (mgr.34427) 214 : cluster [DBG] pgmap v103: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:56:46.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:45 gibba020 bash[25448]: audit 2021-03-10T13:56:45.882461+0000 mon.a (mon.0) 371 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:56:46.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:45 gibba013 bash[29418]: cluster 2021-03-10T13:56:44.485197+0000 mgr.gibba020.yqfnwy (mgr.34427) 214 : cluster [DBG] pgmap v103: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:56:46.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:45 gibba013 bash[29418]: audit 2021-03-10T13:56:45.882461+0000 mon.a (mon.0) 371 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:56:46.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:45 gibba013 bash[30381]: cluster 2021-03-10T13:56:44.485197+0000 mgr.gibba020.yqfnwy (mgr.34427) 214 : cluster [DBG] pgmap v103: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:56:46.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:45 gibba013 bash[30381]: audit 2021-03-10T13:56:45.882461+0000 mon.a (mon.0) 371 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:56:48.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:47 gibba020 bash[25448]: cluster 2021-03-10T13:56:46.486758+0000 mgr.gibba020.yqfnwy (mgr.34427) 215 : cluster [DBG] pgmap v104: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:56:48.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:47 gibba013 bash[29418]: cluster 2021-03-10T13:56:46.486758+0000 mgr.gibba020.yqfnwy (mgr.34427) 215 : cluster [DBG] pgmap v104: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:56:48.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:47 gibba013 bash[30381]: cluster 2021-03-10T13:56:46.486758+0000 mgr.gibba020.yqfnwy (mgr.34427) 215 : cluster [DBG] pgmap v104: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:56:49.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:48 gibba020 bash[25448]: audit 2021-03-10T13:56:48.814751+0000 mon.a (mon.0) 372 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T13:56:49.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:48 gibba013 bash[29418]: audit 2021-03-10T13:56:48.814751+0000 mon.a (mon.0) 372 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T13:56:49.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:48 gibba013 bash[30381]: audit 2021-03-10T13:56:48.814751+0000 mon.a (mon.0) 372 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T13:56:50.044 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:49 gibba020 bash[25448]: cluster 2021-03-10T13:56:48.488540+0000 mgr.gibba020.yqfnwy (mgr.34427) 216 : cluster [DBG] pgmap v105: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:56:50.045 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:49 gibba020 bash[25448]: audit 2021-03-10T13:56:48.813867+0000 mgr.gibba020.yqfnwy (mgr.34427) 217 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T13:56:50.045 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:49 gibba020 bash[25448]: cephadm 2021-03-10T13:56:48.819339+0000 mgr.gibba020.yqfnwy (mgr.34427) 218 : cephadm [INF] Upgrade: osd.4 is safe to restart 2021-03-10T13:56:50.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:49 gibba013 bash[29418]: cluster 2021-03-10T13:56:48.488540+0000 mgr.gibba020.yqfnwy (mgr.34427) 216 : cluster [DBG] pgmap v105: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:56:50.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:49 gibba013 bash[29418]: audit 2021-03-10T13:56:48.813867+0000 mgr.gibba020.yqfnwy (mgr.34427) 217 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T13:56:50.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:49 gibba013 bash[29418]: cephadm 2021-03-10T13:56:48.819339+0000 mgr.gibba020.yqfnwy (mgr.34427) 218 : cephadm [INF] Upgrade: osd.4 is safe to restart 2021-03-10T13:56:50.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:49 gibba013 bash[30381]: cluster 2021-03-10T13:56:48.488540+0000 mgr.gibba020.yqfnwy (mgr.34427) 216 : cluster [DBG] pgmap v105: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:56:50.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:49 gibba013 bash[30381]: audit 2021-03-10T13:56:48.813867+0000 mgr.gibba020.yqfnwy (mgr.34427) 217 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T13:56:50.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:49 gibba013 bash[30381]: cephadm 2021-03-10T13:56:48.819339+0000 mgr.gibba020.yqfnwy (mgr.34427) 218 : cephadm [INF] Upgrade: osd.4 is safe to restart 2021-03-10T13:56:51.814 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:51 gibba020 bash[25448]: cluster 2021-03-10T13:56:50.489689+0000 mgr.gibba020.yqfnwy (mgr.34427) 219 : cluster [DBG] pgmap v106: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:56:51.815 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:51 gibba020 bash[25448]: cephadm 2021-03-10T13:56:50.600969+0000 mgr.gibba020.yqfnwy (mgr.34427) 220 : cephadm [INF] Upgrade: Updating osd.4 2021-03-10T13:56:51.815 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:51 gibba020 bash[25448]: cephadm 2021-03-10T13:56:50.613203+0000 mgr.gibba020.yqfnwy (mgr.34427) 221 : cephadm [INF] Deploying daemon osd.4 on gibba020 2021-03-10T13:56:51.815 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:51 gibba020 bash[25448]: audit 2021-03-10T13:56:50.613393+0000 mon.a (mon.0) 373 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:56:51.815 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:51 gibba020 bash[25448]: audit 2021-03-10T13:56:50.615551+0000 mon.a (mon.0) 374 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2021-03-10T13:56:51.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:51 gibba013 bash[29418]: cluster 2021-03-10T13:56:50.489689+0000 mgr.gibba020.yqfnwy (mgr.34427) 219 : cluster [DBG] pgmap v106: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:56:51.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:51 gibba013 bash[29418]: cephadm 2021-03-10T13:56:50.600969+0000 mgr.gibba020.yqfnwy (mgr.34427) 220 : cephadm [INF] Upgrade: Updating osd.4 2021-03-10T13:56:51.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:51 gibba013 bash[29418]: cephadm 2021-03-10T13:56:50.613203+0000 mgr.gibba020.yqfnwy (mgr.34427) 221 : cephadm [INF] Deploying daemon osd.4 on gibba020 2021-03-10T13:56:51.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:51 gibba013 bash[29418]: audit 2021-03-10T13:56:50.613393+0000 mon.a (mon.0) 373 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:56:51.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:51 gibba013 bash[29418]: audit 2021-03-10T13:56:50.615551+0000 mon.a (mon.0) 374 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2021-03-10T13:56:51.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:51 gibba013 bash[30381]: cluster 2021-03-10T13:56:50.489689+0000 mgr.gibba020.yqfnwy (mgr.34427) 219 : cluster [DBG] pgmap v106: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:56:51.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:51 gibba013 bash[30381]: cephadm 2021-03-10T13:56:50.600969+0000 mgr.gibba020.yqfnwy (mgr.34427) 220 : cephadm [INF] Upgrade: Updating osd.4 2021-03-10T13:56:51.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:51 gibba013 bash[30381]: cephadm 2021-03-10T13:56:50.613203+0000 mgr.gibba020.yqfnwy (mgr.34427) 221 : cephadm [INF] Deploying daemon osd.4 on gibba020 2021-03-10T13:56:51.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:51 gibba013 bash[30381]: audit 2021-03-10T13:56:50.613393+0000 mon.a (mon.0) 373 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:56:51.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:51 gibba013 bash[30381]: audit 2021-03-10T13:56:50.615551+0000 mon.a (mon.0) 374 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2021-03-10T13:56:52.683 INFO:journalctl@ceph.osd.4.gibba020.stdout:Mar 10 13:56:52 gibba020 systemd[1]: Stopping Ceph osd.4 for 7672acc8-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:56:52.684 INFO:journalctl@ceph.osd.4.gibba020.stdout:Mar 10 13:56:52 gibba020 bash[12207]: debug 2021-03-10T13:56:52.525+0000 7f59355e8700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T13:56:52.684 INFO:journalctl@ceph.osd.4.gibba020.stdout:Mar 10 13:56:52 gibba020 bash[12207]: debug 2021-03-10T13:56:52.525+0000 7f59355e8700 -1 osd.4 82 *** Got signal Terminated *** 2021-03-10T13:56:52.684 INFO:journalctl@ceph.osd.4.gibba020.stdout:Mar 10 13:56:52 gibba020 bash[12207]: debug 2021-03-10T13:56:52.525+0000 7f59355e8700 -1 osd.4 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-03-10T13:56:53.622 INFO:journalctl@ceph.osd.4.gibba020.stdout:Mar 10 13:56:53 gibba020 docker[26970]: ceph-7672acc8-81a6-11eb-9080-001a4aab830c-osd.4 2021-03-10T13:56:53.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:53 gibba020 bash[25448]: cluster 2021-03-10T13:56:52.490318+0000 mgr.gibba020.yqfnwy (mgr.34427) 222 : cluster [DBG] pgmap v107: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:56:53.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:53 gibba020 bash[25448]: cluster 2021-03-10T13:56:52.655352+0000 mon.a (mon.0) 375 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T13:56:53.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:53 gibba020 bash[25448]: cluster 2021-03-10T13:56:52.655383+0000 mon.a (mon.0) 376 : cluster [INF] osd.4 failed (root=default,host=gibba020) (connection refused reported by osd.3) 2021-03-10T13:56:53.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:53 gibba020 bash[25448]: cluster 2021-03-10T13:56:52.655537+0000 mon.a (mon.0) 377 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T13:56:53.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:53 gibba020 bash[25448]: cluster 2021-03-10T13:56:52.655637+0000 mon.a (mon.0) 378 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T13:56:53.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:53 gibba020 bash[25448]: cluster 2021-03-10T13:56:52.655741+0000 mon.a (mon.0) 379 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T13:56:53.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:53 gibba020 bash[25448]: cluster 2021-03-10T13:56:52.655807+0000 mon.a (mon.0) 380 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T13:56:53.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:53 gibba020 bash[25448]: cluster 2021-03-10T13:56:52.655901+0000 mon.a (mon.0) 381 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T13:56:53.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:53 gibba020 bash[25448]: cluster 2021-03-10T13:56:52.656019+0000 mon.a (mon.0) 382 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T13:56:53.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:53 gibba020 bash[25448]: cluster 2021-03-10T13:56:52.857570+0000 mon.a (mon.0) 383 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T13:56:53.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:53 gibba020 bash[25448]: cluster 2021-03-10T13:56:52.857883+0000 mon.a (mon.0) 384 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T13:56:53.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:53 gibba020 bash[25448]: cluster 2021-03-10T13:56:52.858482+0000 mon.a (mon.0) 385 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T13:56:53.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:53 gibba020 bash[25448]: cluster 2021-03-10T13:56:52.858886+0000 mon.a (mon.0) 386 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T13:56:53.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:53 gibba020 bash[25448]: cluster 2021-03-10T13:56:52.859331+0000 mon.a (mon.0) 387 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-03-10T13:56:53.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:53 gibba020 bash[25448]: cluster 2021-03-10T13:56:52.859510+0000 mon.a (mon.0) 388 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-03-10T13:56:53.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:53 gibba020 bash[25448]: cluster 2021-03-10T13:56:52.859989+0000 mon.a (mon.0) 389 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T13:56:53.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:53 gibba020 bash[25448]: cluster 2021-03-10T13:56:52.860224+0000 mon.a (mon.0) 390 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-03-10T13:56:53.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:53 gibba020 bash[25448]: cluster 2021-03-10T13:56:52.860644+0000 mon.a (mon.0) 391 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-03-10T13:56:53.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:53 gibba020 bash[25448]: cluster 2021-03-10T13:56:52.860965+0000 mon.a (mon.0) 392 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T13:56:53.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:53 gibba020 bash[25448]: cluster 2021-03-10T13:56:52.861473+0000 mon.a (mon.0) 393 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T13:56:53.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:53 gibba020 bash[25448]: cluster 2021-03-10T13:56:52.861741+0000 mon.a (mon.0) 394 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T13:56:53.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:53 gibba020 bash[25448]: cluster 2021-03-10T13:56:52.862270+0000 mon.a (mon.0) 395 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T13:56:53.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:53 gibba020 bash[25448]: cluster 2021-03-10T13:56:52.862539+0000 mon.a (mon.0) 396 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T13:56:53.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:53 gibba020 bash[25448]: cluster 2021-03-10T13:56:53.258860+0000 mon.a (mon.0) 397 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T13:56:53.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:53 gibba020 bash[25448]: cluster 2021-03-10T13:56:53.259222+0000 mon.a (mon.0) 398 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T13:56:53.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:53 gibba020 bash[25448]: cluster 2021-03-10T13:56:53.259747+0000 mon.a (mon.0) 399 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T13:56:53.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:53 gibba020 bash[25448]: cluster 2021-03-10T13:56:53.260029+0000 mon.a (mon.0) 400 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T13:56:53.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:53 gibba020 bash[25448]: cluster 2021-03-10T13:56:53.260548+0000 mon.a (mon.0) 401 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T13:56:53.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:53 gibba020 bash[25448]: cluster 2021-03-10T13:56:53.260818+0000 mon.a (mon.0) 402 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T13:56:53.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:53 gibba020 bash[25448]: cluster 2021-03-10T13:56:53.261313+0000 mon.a (mon.0) 403 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T13:56:53.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:53 gibba020 bash[25448]: cluster 2021-03-10T13:56:53.261591+0000 mon.a (mon.0) 404 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T13:56:53.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:53 gibba020 bash[25448]: cluster 2021-03-10T13:56:53.262707+0000 mon.a (mon.0) 405 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-03-10T13:56:53.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:53 gibba020 bash[25448]: cluster 2021-03-10T13:56:53.262891+0000 mon.a (mon.0) 406 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-03-10T13:56:53.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:53 gibba020 bash[25448]: cluster 2021-03-10T13:56:53.263345+0000 mon.a (mon.0) 407 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-03-10T13:56:53.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:53 gibba020 bash[25448]: cluster 2021-03-10T13:56:53.263516+0000 mon.a (mon.0) 408 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-03-10T13:56:53.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:53 gibba020 bash[25448]: cluster 2021-03-10T13:56:53.264044+0000 mon.a (mon.0) 409 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T13:56:53.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:53 gibba020 bash[25448]: cluster 2021-03-10T13:56:53.264314+0000 mon.a (mon.0) 410 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T13:56:53.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[29418]: cluster 2021-03-10T13:56:52.490318+0000 mgr.gibba020.yqfnwy (mgr.34427) 222 : cluster [DBG] pgmap v107: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:56:53.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[29418]: cluster 2021-03-10T13:56:52.655352+0000 mon.a (mon.0) 375 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T13:56:53.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[29418]: cluster 2021-03-10T13:56:52.655383+0000 mon.a (mon.0) 376 : cluster [INF] osd.4 failed (root=default,host=gibba020) (connection refused reported by osd.3) 2021-03-10T13:56:53.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[29418]: cluster 2021-03-10T13:56:52.655537+0000 mon.a (mon.0) 377 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T13:56:53.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[29418]: cluster 2021-03-10T13:56:52.655637+0000 mon.a (mon.0) 378 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T13:56:53.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[29418]: cluster 2021-03-10T13:56:52.655741+0000 mon.a (mon.0) 379 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T13:56:53.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[29418]: cluster 2021-03-10T13:56:52.655807+0000 mon.a (mon.0) 380 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T13:56:53.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[29418]: cluster 2021-03-10T13:56:52.655901+0000 mon.a (mon.0) 381 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T13:56:53.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[29418]: cluster 2021-03-10T13:56:52.656019+0000 mon.a (mon.0) 382 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T13:56:53.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[29418]: cluster 2021-03-10T13:56:52.857570+0000 mon.a (mon.0) 383 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T13:56:53.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[29418]: cluster 2021-03-10T13:56:52.857883+0000 mon.a (mon.0) 384 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T13:56:53.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[29418]: cluster 2021-03-10T13:56:52.858482+0000 mon.a (mon.0) 385 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T13:56:53.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[29418]: cluster 2021-03-10T13:56:52.858886+0000 mon.a (mon.0) 386 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T13:56:53.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[29418]: cluster 2021-03-10T13:56:52.859331+0000 mon.a (mon.0) 387 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-03-10T13:56:53.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[29418]: cluster 2021-03-10T13:56:52.859510+0000 mon.a (mon.0) 388 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-03-10T13:56:53.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[29418]: cluster 2021-03-10T13:56:52.859989+0000 mon.a (mon.0) 389 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T13:56:53.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[29418]: cluster 2021-03-10T13:56:52.860224+0000 mon.a (mon.0) 390 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-03-10T13:56:53.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[29418]: cluster 2021-03-10T13:56:52.860644+0000 mon.a (mon.0) 391 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-03-10T13:56:53.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[29418]: cluster 2021-03-10T13:56:52.860965+0000 mon.a (mon.0) 392 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T13:56:53.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[29418]: cluster 2021-03-10T13:56:52.861473+0000 mon.a (mon.0) 393 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T13:56:53.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[29418]: cluster 2021-03-10T13:56:52.861741+0000 mon.a (mon.0) 394 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T13:56:53.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[29418]: cluster 2021-03-10T13:56:52.862270+0000 mon.a (mon.0) 395 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T13:56:53.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[29418]: cluster 2021-03-10T13:56:52.862539+0000 mon.a (mon.0) 396 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T13:56:53.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[29418]: cluster 2021-03-10T13:56:53.258860+0000 mon.a (mon.0) 397 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T13:56:53.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[29418]: cluster 2021-03-10T13:56:53.259222+0000 mon.a (mon.0) 398 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T13:56:53.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[30381]: cluster 2021-03-10T13:56:52.490318+0000 mgr.gibba020.yqfnwy (mgr.34427) 222 : cluster [DBG] pgmap v107: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:56:53.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[30381]: cluster 2021-03-10T13:56:52.655352+0000 mon.a (mon.0) 375 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T13:56:53.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[30381]: cluster 2021-03-10T13:56:52.655383+0000 mon.a (mon.0) 376 : cluster [INF] osd.4 failed (root=default,host=gibba020) (connection refused reported by osd.3) 2021-03-10T13:56:53.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[30381]: cluster 2021-03-10T13:56:52.655537+0000 mon.a (mon.0) 377 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T13:56:53.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[30381]: cluster 2021-03-10T13:56:52.655637+0000 mon.a (mon.0) 378 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T13:56:53.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[30381]: cluster 2021-03-10T13:56:52.655741+0000 mon.a (mon.0) 379 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T13:56:53.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[30381]: cluster 2021-03-10T13:56:52.655807+0000 mon.a (mon.0) 380 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T13:56:53.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[30381]: cluster 2021-03-10T13:56:52.655901+0000 mon.a (mon.0) 381 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T13:56:53.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[30381]: cluster 2021-03-10T13:56:52.656019+0000 mon.a (mon.0) 382 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T13:56:53.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[30381]: cluster 2021-03-10T13:56:52.857570+0000 mon.a (mon.0) 383 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T13:56:53.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[30381]: cluster 2021-03-10T13:56:52.857883+0000 mon.a (mon.0) 384 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T13:56:53.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[30381]: cluster 2021-03-10T13:56:52.858482+0000 mon.a (mon.0) 385 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T13:56:53.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[30381]: cluster 2021-03-10T13:56:52.858886+0000 mon.a (mon.0) 386 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T13:56:53.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[30381]: cluster 2021-03-10T13:56:52.859331+0000 mon.a (mon.0) 387 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-03-10T13:56:53.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[30381]: cluster 2021-03-10T13:56:52.859510+0000 mon.a (mon.0) 388 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-03-10T13:56:53.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[30381]: cluster 2021-03-10T13:56:52.859989+0000 mon.a (mon.0) 389 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T13:56:53.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[30381]: cluster 2021-03-10T13:56:52.860224+0000 mon.a (mon.0) 390 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-03-10T13:56:53.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[30381]: cluster 2021-03-10T13:56:52.860644+0000 mon.a (mon.0) 391 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-03-10T13:56:53.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[30381]: cluster 2021-03-10T13:56:52.860965+0000 mon.a (mon.0) 392 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T13:56:53.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[30381]: cluster 2021-03-10T13:56:52.861473+0000 mon.a (mon.0) 393 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T13:56:53.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[30381]: cluster 2021-03-10T13:56:52.861741+0000 mon.a (mon.0) 394 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T13:56:53.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[30381]: cluster 2021-03-10T13:56:52.862270+0000 mon.a (mon.0) 395 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T13:56:53.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[30381]: cluster 2021-03-10T13:56:52.862539+0000 mon.a (mon.0) 396 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T13:56:53.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[30381]: cluster 2021-03-10T13:56:53.258860+0000 mon.a (mon.0) 397 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T13:56:53.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[30381]: cluster 2021-03-10T13:56:53.259222+0000 mon.a (mon.0) 398 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T13:56:53.889 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[29418]: cluster 2021-03-10T13:56:53.259747+0000 mon.a (mon.0) 399 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T13:56:53.889 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[29418]: cluster 2021-03-10T13:56:53.260029+0000 mon.a (mon.0) 400 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T13:56:53.889 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[29418]: cluster 2021-03-10T13:56:53.260548+0000 mon.a (mon.0) 401 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T13:56:53.889 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[29418]: cluster 2021-03-10T13:56:53.260818+0000 mon.a (mon.0) 402 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T13:56:53.889 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[29418]: cluster 2021-03-10T13:56:53.261313+0000 mon.a (mon.0) 403 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T13:56:53.890 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[29418]: cluster 2021-03-10T13:56:53.261591+0000 mon.a (mon.0) 404 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T13:56:53.890 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[29418]: cluster 2021-03-10T13:56:53.262707+0000 mon.a (mon.0) 405 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-03-10T13:56:53.890 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[29418]: cluster 2021-03-10T13:56:53.262891+0000 mon.a (mon.0) 406 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-03-10T13:56:53.890 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[29418]: cluster 2021-03-10T13:56:53.263345+0000 mon.a (mon.0) 407 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-03-10T13:56:53.890 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[29418]: cluster 2021-03-10T13:56:53.263516+0000 mon.a (mon.0) 408 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-03-10T13:56:53.891 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[29418]: cluster 2021-03-10T13:56:53.264044+0000 mon.a (mon.0) 409 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T13:56:53.891 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[29418]: cluster 2021-03-10T13:56:53.264314+0000 mon.a (mon.0) 410 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T13:56:53.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[30381]: cluster 2021-03-10T13:56:53.259747+0000 mon.a (mon.0) 399 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T13:56:53.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[30381]: cluster 2021-03-10T13:56:53.260029+0000 mon.a (mon.0) 400 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T13:56:53.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[30381]: cluster 2021-03-10T13:56:53.260548+0000 mon.a (mon.0) 401 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T13:56:53.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[30381]: cluster 2021-03-10T13:56:53.260818+0000 mon.a (mon.0) 402 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T13:56:53.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[30381]: cluster 2021-03-10T13:56:53.261313+0000 mon.a (mon.0) 403 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T13:56:53.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[30381]: cluster 2021-03-10T13:56:53.261591+0000 mon.a (mon.0) 404 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T13:56:53.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[30381]: cluster 2021-03-10T13:56:53.262707+0000 mon.a (mon.0) 405 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-03-10T13:56:53.893 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[30381]: cluster 2021-03-10T13:56:53.262891+0000 mon.a (mon.0) 406 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-03-10T13:56:53.893 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[30381]: cluster 2021-03-10T13:56:53.263345+0000 mon.a (mon.0) 407 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-03-10T13:56:53.893 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[30381]: cluster 2021-03-10T13:56:53.263516+0000 mon.a (mon.0) 408 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-03-10T13:56:53.893 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[30381]: cluster 2021-03-10T13:56:53.264044+0000 mon.a (mon.0) 409 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T13:56:53.893 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:53 gibba013 bash[30381]: cluster 2021-03-10T13:56:53.264314+0000 mon.a (mon.0) 410 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T13:56:54.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:54 gibba013 bash[29418]: cluster 2021-03-10T13:56:53.618928+0000 mon.a (mon.0) 411 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:56:54.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:54 gibba013 bash[29418]: cluster 2021-03-10T13:56:53.630276+0000 mon.a (mon.0) 412 : cluster [DBG] osdmap e83: 8 total, 7 up, 8 in 2021-03-10T13:56:54.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:54 gibba013 bash[30381]: cluster 2021-03-10T13:56:53.618928+0000 mon.a (mon.0) 411 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:56:54.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:54 gibba013 bash[30381]: cluster 2021-03-10T13:56:53.630276+0000 mon.a (mon.0) 412 : cluster [DBG] osdmap e83: 8 total, 7 up, 8 in 2021-03-10T13:56:54.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:54 gibba020 bash[25448]: cluster 2021-03-10T13:56:53.618928+0000 mon.a (mon.0) 411 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:56:54.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:54 gibba020 bash[25448]: cluster 2021-03-10T13:56:53.630276+0000 mon.a (mon.0) 412 : cluster [DBG] osdmap e83: 8 total, 7 up, 8 in 2021-03-10T13:56:55.636 INFO:journalctl@ceph.osd.4.gibba020.stdout:Mar 10 13:56:55 gibba020 systemd[1]: ceph-7672acc8-81a6-11eb-9080-001a4aab830c@osd.4.service: Succeeded. 2021-03-10T13:56:55.636 INFO:journalctl@ceph.osd.4.gibba020.stdout:Mar 10 13:56:55 gibba020 systemd[1]: Stopped Ceph osd.4 for 7672acc8-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:56:55.636 INFO:journalctl@ceph.osd.4.gibba020.stdout:Mar 10 13:56:55 gibba020 systemd[1]: Started Ceph osd.4 for 7672acc8-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:56:55.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:55 gibba020 bash[25448]: cluster 2021-03-10T13:56:54.490575+0000 mgr.gibba020.yqfnwy (mgr.34427) 223 : cluster [DBG] pgmap v109: 129 pgs: 18 stale+active+clean, 20 active+clean+wait, 91 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:56:55.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:55 gibba020 bash[25448]: cluster 2021-03-10T13:56:54.633530+0000 mon.a (mon.0) 413 : cluster [DBG] osdmap e84: 8 total, 7 up, 8 in 2021-03-10T13:56:55.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:55 gibba020 bash[25448]: audit 2021-03-10T13:56:55.420516+0000 mon.a (mon.0) 414 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:56:55.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:55 gibba020 bash[25448]: audit 2021-03-10T13:56:55.421583+0000 mon.a (mon.0) 415 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:56:55.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:55 gibba020 bash[25448]: audit 2021-03-10T13:56:55.423439+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:56:56.092 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T13:56:56.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:55 gibba013 bash[29418]: cluster 2021-03-10T13:56:54.490575+0000 mgr.gibba020.yqfnwy (mgr.34427) 223 : cluster [DBG] pgmap v109: 129 pgs: 18 stale+active+clean, 20 active+clean+wait, 91 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:56:56.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:55 gibba013 bash[29418]: cluster 2021-03-10T13:56:54.633530+0000 mon.a (mon.0) 413 : cluster [DBG] osdmap e84: 8 total, 7 up, 8 in 2021-03-10T13:56:56.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:55 gibba013 bash[29418]: audit 2021-03-10T13:56:55.420516+0000 mon.a (mon.0) 414 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:56:56.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:55 gibba013 bash[29418]: audit 2021-03-10T13:56:55.421583+0000 mon.a (mon.0) 415 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:56:56.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:55 gibba013 bash[29418]: audit 2021-03-10T13:56:55.423439+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:56:56.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:55 gibba013 bash[30381]: cluster 2021-03-10T13:56:54.490575+0000 mgr.gibba020.yqfnwy (mgr.34427) 223 : cluster [DBG] pgmap v109: 129 pgs: 18 stale+active+clean, 20 active+clean+wait, 91 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T13:56:56.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:55 gibba013 bash[30381]: cluster 2021-03-10T13:56:54.633530+0000 mon.a (mon.0) 413 : cluster [DBG] osdmap e84: 8 total, 7 up, 8 in 2021-03-10T13:56:56.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:55 gibba013 bash[30381]: audit 2021-03-10T13:56:55.420516+0000 mon.a (mon.0) 414 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:56:56.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:55 gibba013 bash[30381]: audit 2021-03-10T13:56:55.421583+0000 mon.a (mon.0) 415 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:56:56.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:55 gibba013 bash[30381]: audit 2021-03-10T13:56:55.423439+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:56:56.321 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:56:56.321 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3m) 22s ago 8m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T13:56:56.321 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (8m) 2m ago 8m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T13:56:56.321 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3m) 2m ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T13:56:56.322 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (4m) 2m ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T13:56:56.322 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3m) 22s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T13:56:56.322 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2m) 22s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T13:56:56.322 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2m) 2m ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T13:56:56.323 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2m) 22s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T13:56:56.323 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (8m) 22s ago 8m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T13:56:56.323 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (8m) 2m ago 8m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T13:56:56.323 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (104s) 22s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T13:56:56.323 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (77s) 22s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T13:56:56.323 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (51s) 22s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T13:56:56.324 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (26s) 22s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T13:56:56.324 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 starting - - 2021-03-10T13:56:56.324 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (10m) 2m ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 8e0d292ca03b 2021-03-10T13:56:56.324 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (9m) 2m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b54758e37be1 2021-03-10T13:56:56.325 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (9m) 2m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 75c9ee8106fc 2021-03-10T13:56:56.325 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (8m) 2m ago 9m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T13:56:56.326 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 6m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:56:56.570 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T13:56:56.570 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T13:56:56.570 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:56:56.571 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:56:56.571 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T13:56:56.571 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:56:56.571 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:56:56.571 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T13:56:56.571 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3, 2021-03-10T13:56:56.572 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 4 2021-03-10T13:56:56.572 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:56:56.572 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T13:56:56.572 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T13:56:56.573 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3, 2021-03-10T13:56:56.573 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 10 2021-03-10T13:56:56.574 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T13:56:56.574 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T13:56:56.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:56 gibba020 bash[25448]: audit 2021-03-10T13:56:56.081917+0000 mgr.gibba020.yqfnwy (mgr.34427) 224 : audit [DBG] from='client.54217 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:56:56.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:56 gibba020 bash[25448]: audit 2021-03-10T13:56:56.571274+0000 mon.a (mon.0) 417 : audit [DBG] from='client.? 172.21.2.113:0/3334995646' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:56.948 INFO:journalctl@ceph.osd.4.gibba020.stdout:Mar 10 13:56:56 gibba020 bash[27143]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-03-10T13:56:56.948 INFO:journalctl@ceph.osd.4.gibba020.stdout:Mar 10 13:56:56 gibba020 bash[27143]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2021-03-10T13:56:56.948 INFO:journalctl@ceph.osd.4.gibba020.stdout:Mar 10 13:56:56 gibba020 bash[27143]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4/block 2021-03-10T13:56:56.948 INFO:journalctl@ceph.osd.4.gibba020.stdout:Mar 10 13:56:56 gibba020 bash[27143]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2021-03-10T13:56:56.949 INFO:journalctl@ceph.osd.4.gibba020.stdout:Mar 10 13:56:56 gibba020 bash[27143]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2021-03-10T13:56:56.949 INFO:journalctl@ceph.osd.4.gibba020.stdout:Mar 10 13:56:56 gibba020 bash[27143]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-03-10T13:56:56.949 INFO:journalctl@ceph.osd.4.gibba020.stdout:Mar 10 13:56:56 gibba020 bash[27143]: --> ceph-volume lvm activate successful for osd ID: 4 2021-03-10T13:56:57.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:56 gibba013 bash[29418]: audit 2021-03-10T13:56:56.081917+0000 mgr.gibba020.yqfnwy (mgr.34427) 224 : audit [DBG] from='client.54217 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:56:57.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:56 gibba013 bash[29418]: audit 2021-03-10T13:56:56.571274+0000 mon.a (mon.0) 417 : audit [DBG] from='client.? 172.21.2.113:0/3334995646' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:57.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:56 gibba013 bash[30381]: audit 2021-03-10T13:56:56.081917+0000 mgr.gibba020.yqfnwy (mgr.34427) 224 : audit [DBG] from='client.54217 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:56:57.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:56 gibba013 bash[30381]: audit 2021-03-10T13:56:56.571274+0000 mon.a (mon.0) 417 : audit [DBG] from='client.? 172.21.2.113:0/3334995646' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:56:57.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:57 gibba020 bash[25448]: audit 2021-03-10T13:56:56.307243+0000 mgr.gibba020.yqfnwy (mgr.34427) 225 : audit [DBG] from='client.54223 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:56:57.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:57 gibba020 bash[25448]: cluster 2021-03-10T13:56:56.491011+0000 mgr.gibba020.yqfnwy (mgr.34427) 226 : cluster [DBG] pgmap v111: 129 pgs: 9 stale+active+clean, 7 active+undersized+degraded, 13 active+undersized, 100 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 9/192 objects degraded (4.688%) 2021-03-10T13:56:57.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:56:57 gibba020 bash[25448]: cluster 2021-03-10T13:56:56.636105+0000 mon.a (mon.0) 418 : cluster [WRN] Health check failed: Degraded data redundancy: 9/192 objects degraded (4.688%), 7 pgs degraded (PG_DEGRADED) 2021-03-10T13:56:58.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:57 gibba013 bash[29418]: audit 2021-03-10T13:56:56.307243+0000 mgr.gibba020.yqfnwy (mgr.34427) 225 : audit [DBG] from='client.54223 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:56:58.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:57 gibba013 bash[29418]: cluster 2021-03-10T13:56:56.491011+0000 mgr.gibba020.yqfnwy (mgr.34427) 226 : cluster [DBG] pgmap v111: 129 pgs: 9 stale+active+clean, 7 active+undersized+degraded, 13 active+undersized, 100 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 9/192 objects degraded (4.688%) 2021-03-10T13:56:58.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:56:57 gibba013 bash[29418]: cluster 2021-03-10T13:56:56.636105+0000 mon.a (mon.0) 418 : cluster [WRN] Health check failed: Degraded data redundancy: 9/192 objects degraded (4.688%), 7 pgs degraded (PG_DEGRADED) 2021-03-10T13:56:58.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:57 gibba013 bash[30381]: audit 2021-03-10T13:56:56.307243+0000 mgr.gibba020.yqfnwy (mgr.34427) 225 : audit [DBG] from='client.54223 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:56:58.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:57 gibba013 bash[30381]: cluster 2021-03-10T13:56:56.491011+0000 mgr.gibba020.yqfnwy (mgr.34427) 226 : cluster [DBG] pgmap v111: 129 pgs: 9 stale+active+clean, 7 active+undersized+degraded, 13 active+undersized, 100 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 9/192 objects degraded (4.688%) 2021-03-10T13:56:58.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:56:57 gibba013 bash[30381]: cluster 2021-03-10T13:56:56.636105+0000 mon.a (mon.0) 418 : cluster [WRN] Health check failed: Degraded data redundancy: 9/192 objects degraded (4.688%), 7 pgs degraded (PG_DEGRADED) 2021-03-10T13:56:58.447 INFO:journalctl@ceph.osd.4.gibba020.stdout:Mar 10 13:56:58 gibba020 bash[27277]: debug 2021-03-10T13:56:58.125+0000 7fd314e18700 1 -- 172.21.2.120:0/2419402530 <== mon.2 v2:172.21.2.120:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x563b51d324e0 con 0x563b51daf000 2021-03-10T13:56:58.947 INFO:journalctl@ceph.osd.4.gibba020.stdout:Mar 10 13:56:58 gibba020 bash[27277]: debug 2021-03-10T13:56:58.677+0000 7fd31c8ad080 -1 Falling back to public interface 2021-03-10T13:57:00.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:00 gibba020 bash[25448]: cluster 2021-03-10T13:56:58.491611+0000 mgr.gibba020.yqfnwy (mgr.34427) 227 : cluster [DBG] pgmap v112: 129 pgs: 22 active+undersized+degraded, 34 active+undersized, 73 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 30/192 objects degraded (15.625%) 2021-03-10T13:57:00.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:00 gibba020 bash[25448]: audit 2021-03-10T13:56:59.192326+0000 mon.a (mon.0) 419 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:57:00.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:00 gibba020 bash[25448]: audit 2021-03-10T13:56:59.195808+0000 mon.a (mon.0) 420 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:57:00.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:00 gibba020 bash[25448]: cephadm 2021-03-10T13:56:59.197201+0000 mgr.gibba020.yqfnwy (mgr.34427) 228 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:57:00.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:00 gibba020 bash[25448]: cephadm 2021-03-10T13:56:59.199529+0000 mgr.gibba020.yqfnwy (mgr.34427) 229 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:57:00.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:00 gibba020 bash[25448]: audit 2021-03-10T13:56:59.200123+0000 mon.a (mon.0) 421 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:57:00.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:00 gibba020 bash[25448]: cephadm 2021-03-10T13:56:59.201508+0000 mgr.gibba020.yqfnwy (mgr.34427) 230 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:57:00.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:00 gibba020 bash[25448]: cephadm 2021-03-10T13:56:59.201637+0000 mgr.gibba020.yqfnwy (mgr.34427) 231 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:57:00.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:00 gibba020 bash[25448]: audit 2021-03-10T13:56:59.201884+0000 mon.a (mon.0) 422 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:00.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:00 gibba020 bash[25448]: cephadm 2021-03-10T13:56:59.203347+0000 mgr.gibba020.yqfnwy (mgr.34427) 232 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:57:00.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:00 gibba020 bash[25448]: cephadm 2021-03-10T13:56:59.203397+0000 mgr.gibba020.yqfnwy (mgr.34427) 233 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:57:00.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:00 gibba020 bash[25448]: audit 2021-03-10T13:56:59.203997+0000 mon.a (mon.0) 423 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:00.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:00 gibba020 bash[25448]: cephadm 2021-03-10T13:56:59.205271+0000 mgr.gibba020.yqfnwy (mgr.34427) 234 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:57:00.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:00 gibba020 bash[25448]: audit 2021-03-10T13:56:59.205834+0000 mon.a (mon.0) 424 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:00.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:00 gibba020 bash[25448]: cephadm 2021-03-10T13:56:59.207085+0000 mgr.gibba020.yqfnwy (mgr.34427) 235 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:57:00.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:00 gibba020 bash[25448]: cephadm 2021-03-10T13:56:59.207138+0000 mgr.gibba020.yqfnwy (mgr.34427) 236 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:57:00.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:00 gibba020 bash[25448]: audit 2021-03-10T13:56:59.208196+0000 mgr.gibba020.yqfnwy (mgr.34427) 237 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T13:57:00.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:00 gibba020 bash[25448]: audit 2021-03-10T13:56:59.209819+0000 mon.a (mon.0) 425 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T13:57:00.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:00 gibba013 bash[29418]: cluster 2021-03-10T13:56:58.491611+0000 mgr.gibba020.yqfnwy (mgr.34427) 227 : cluster [DBG] pgmap v112: 129 pgs: 22 active+undersized+degraded, 34 active+undersized, 73 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 30/192 objects degraded (15.625%) 2021-03-10T13:57:00.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:00 gibba013 bash[29418]: audit 2021-03-10T13:56:59.192326+0000 mon.a (mon.0) 419 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:57:00.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:00 gibba013 bash[29418]: audit 2021-03-10T13:56:59.195808+0000 mon.a (mon.0) 420 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:57:00.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:00 gibba013 bash[29418]: cephadm 2021-03-10T13:56:59.197201+0000 mgr.gibba020.yqfnwy (mgr.34427) 228 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:57:00.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:00 gibba013 bash[29418]: cephadm 2021-03-10T13:56:59.199529+0000 mgr.gibba020.yqfnwy (mgr.34427) 229 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:57:00.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:00 gibba013 bash[29418]: audit 2021-03-10T13:56:59.200123+0000 mon.a (mon.0) 421 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:57:00.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:00 gibba013 bash[29418]: cephadm 2021-03-10T13:56:59.201508+0000 mgr.gibba020.yqfnwy (mgr.34427) 230 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:57:00.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:00 gibba013 bash[29418]: cephadm 2021-03-10T13:56:59.201637+0000 mgr.gibba020.yqfnwy (mgr.34427) 231 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:57:00.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:00 gibba013 bash[29418]: audit 2021-03-10T13:56:59.201884+0000 mon.a (mon.0) 422 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:00.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:00 gibba013 bash[29418]: cephadm 2021-03-10T13:56:59.203347+0000 mgr.gibba020.yqfnwy (mgr.34427) 232 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:57:00.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:00 gibba013 bash[29418]: cephadm 2021-03-10T13:56:59.203397+0000 mgr.gibba020.yqfnwy (mgr.34427) 233 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:57:00.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:00 gibba013 bash[29418]: audit 2021-03-10T13:56:59.203997+0000 mon.a (mon.0) 423 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:00.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:00 gibba013 bash[29418]: cephadm 2021-03-10T13:56:59.205271+0000 mgr.gibba020.yqfnwy (mgr.34427) 234 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:57:00.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:00 gibba013 bash[29418]: audit 2021-03-10T13:56:59.205834+0000 mon.a (mon.0) 424 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:00.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:00 gibba013 bash[29418]: cephadm 2021-03-10T13:56:59.207085+0000 mgr.gibba020.yqfnwy (mgr.34427) 235 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:57:00.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:00 gibba013 bash[29418]: cephadm 2021-03-10T13:56:59.207138+0000 mgr.gibba020.yqfnwy (mgr.34427) 236 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:57:00.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:00 gibba013 bash[29418]: audit 2021-03-10T13:56:59.208196+0000 mgr.gibba020.yqfnwy (mgr.34427) 237 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T13:57:00.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:00 gibba013 bash[29418]: audit 2021-03-10T13:56:59.209819+0000 mon.a (mon.0) 425 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T13:57:00.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:00 gibba013 bash[30381]: cluster 2021-03-10T13:56:58.491611+0000 mgr.gibba020.yqfnwy (mgr.34427) 227 : cluster [DBG] pgmap v112: 129 pgs: 22 active+undersized+degraded, 34 active+undersized, 73 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 30/192 objects degraded (15.625%) 2021-03-10T13:57:00.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:00 gibba013 bash[30381]: audit 2021-03-10T13:56:59.192326+0000 mon.a (mon.0) 419 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:57:00.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:00 gibba013 bash[30381]: audit 2021-03-10T13:56:59.195808+0000 mon.a (mon.0) 420 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:57:00.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:00 gibba013 bash[30381]: cephadm 2021-03-10T13:56:59.197201+0000 mgr.gibba020.yqfnwy (mgr.34427) 228 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:57:00.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:00 gibba013 bash[30381]: cephadm 2021-03-10T13:56:59.199529+0000 mgr.gibba020.yqfnwy (mgr.34427) 229 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:57:00.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:00 gibba013 bash[30381]: audit 2021-03-10T13:56:59.200123+0000 mon.a (mon.0) 421 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:57:00.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:00 gibba013 bash[30381]: cephadm 2021-03-10T13:56:59.201508+0000 mgr.gibba020.yqfnwy (mgr.34427) 230 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:57:00.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:00 gibba013 bash[30381]: cephadm 2021-03-10T13:56:59.201637+0000 mgr.gibba020.yqfnwy (mgr.34427) 231 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:57:00.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:00 gibba013 bash[30381]: audit 2021-03-10T13:56:59.201884+0000 mon.a (mon.0) 422 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:00.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:00 gibba013 bash[30381]: cephadm 2021-03-10T13:56:59.203347+0000 mgr.gibba020.yqfnwy (mgr.34427) 232 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:57:00.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:00 gibba013 bash[30381]: cephadm 2021-03-10T13:56:59.203397+0000 mgr.gibba020.yqfnwy (mgr.34427) 233 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:57:00.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:00 gibba013 bash[30381]: audit 2021-03-10T13:56:59.203997+0000 mon.a (mon.0) 423 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:00.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:00 gibba013 bash[30381]: cephadm 2021-03-10T13:56:59.205271+0000 mgr.gibba020.yqfnwy (mgr.34427) 234 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:57:00.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:00 gibba013 bash[30381]: audit 2021-03-10T13:56:59.205834+0000 mon.a (mon.0) 424 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:00.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:00 gibba013 bash[30381]: cephadm 2021-03-10T13:56:59.207085+0000 mgr.gibba020.yqfnwy (mgr.34427) 235 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:57:00.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:00 gibba013 bash[30381]: cephadm 2021-03-10T13:56:59.207138+0000 mgr.gibba020.yqfnwy (mgr.34427) 236 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:57:00.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:00 gibba013 bash[30381]: audit 2021-03-10T13:56:59.208196+0000 mgr.gibba020.yqfnwy (mgr.34427) 237 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T13:57:00.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:00 gibba013 bash[30381]: audit 2021-03-10T13:56:59.209819+0000 mon.a (mon.0) 425 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T13:57:01.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:01 gibba013 bash[29418]: cephadm 2021-03-10T13:56:59.209726+0000 mgr.gibba020.yqfnwy (mgr.34427) 238 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (8 PGs are or would become offline) 2021-03-10T13:57:01.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:01 gibba013 bash[30381]: cephadm 2021-03-10T13:56:59.209726+0000 mgr.gibba020.yqfnwy (mgr.34427) 238 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (8 PGs are or would become offline) 2021-03-10T13:57:01.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:01 gibba020 bash[25448]: cephadm 2021-03-10T13:56:59.209726+0000 mgr.gibba020.yqfnwy (mgr.34427) 238 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (8 PGs are or would become offline) 2021-03-10T13:57:02.197 INFO:journalctl@ceph.osd.4.gibba020.stdout:Mar 10 13:57:01 gibba020 bash[27277]: debug 2021-03-10T13:57:01.889+0000 7fd31c8ad080 -1 bluestore(/var/lib/ceph/osd/ceph-4) fsck warning: store not yet converted to per-pg omap 2021-03-10T13:57:02.198 INFO:journalctl@ceph.osd.4.gibba020.stdout:Mar 10 13:57:01 gibba020 bash[27277]: debug 2021-03-10T13:57:01.889+0000 7fd307371700 -1 bluestore(/var/lib/ceph/osd/ceph-4) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2021-03-10T13:57:02.198 INFO:journalctl@ceph.osd.4.gibba020.stdout:Mar 10 13:57:02 gibba020 bash[27277]: debug 2021-03-10T13:57:02.017+0000 7fd31c8ad080 -1 osd.4 82 log_to_monitors {default=true} 2021-03-10T13:57:02.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:02 gibba013 bash[29418]: cluster 2021-03-10T13:57:00.493192+0000 mgr.gibba020.yqfnwy (mgr.34427) 239 : cluster [DBG] pgmap v113: 129 pgs: 22 active+undersized+degraded, 34 active+undersized, 73 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 30/192 objects degraded (15.625%) 2021-03-10T13:57:02.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:02 gibba013 bash[29418]: audit 2021-03-10T13:57:02.026071+0000 mon.b (mon.2) 3 : audit [INF] from='osd.4 [v2:172.21.2.120:6800/1383141235,v1:172.21.2.120:6801/1383141235]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T13:57:02.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:02 gibba013 bash[29418]: audit 2021-03-10T13:57:02.029127+0000 mon.a (mon.0) 426 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T13:57:02.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:02 gibba013 bash[30381]: cluster 2021-03-10T13:57:00.493192+0000 mgr.gibba020.yqfnwy (mgr.34427) 239 : cluster [DBG] pgmap v113: 129 pgs: 22 active+undersized+degraded, 34 active+undersized, 73 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 30/192 objects degraded (15.625%) 2021-03-10T13:57:02.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:02 gibba013 bash[30381]: audit 2021-03-10T13:57:02.026071+0000 mon.b (mon.2) 3 : audit [INF] from='osd.4 [v2:172.21.2.120:6800/1383141235,v1:172.21.2.120:6801/1383141235]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T13:57:02.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:02 gibba013 bash[30381]: audit 2021-03-10T13:57:02.029127+0000 mon.a (mon.0) 426 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T13:57:02.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:02 gibba020 bash[25448]: cluster 2021-03-10T13:57:00.493192+0000 mgr.gibba020.yqfnwy (mgr.34427) 239 : cluster [DBG] pgmap v113: 129 pgs: 22 active+undersized+degraded, 34 active+undersized, 73 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 30/192 objects degraded (15.625%) 2021-03-10T13:57:02.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:02 gibba020 bash[25448]: audit 2021-03-10T13:57:02.026071+0000 mon.b (mon.2) 3 : audit [INF] from='osd.4 [v2:172.21.2.120:6800/1383141235,v1:172.21.2.120:6801/1383141235]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T13:57:02.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:02 gibba020 bash[25448]: audit 2021-03-10T13:57:02.029127+0000 mon.a (mon.0) 426 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T13:57:02.698 INFO:journalctl@ceph.osd.4.gibba020.stdout:Mar 10 13:57:02 gibba020 bash[27277]: debug 2021-03-10T13:57:02.225+0000 7fd30cd8b700 -1 osd.4 82 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:57:03.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:03 gibba013 bash[29418]: audit 2021-03-10T13:57:02.217811+0000 mon.a (mon.0) 427 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-03-10T13:57:03.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:03 gibba013 bash[29418]: cluster 2021-03-10T13:57:02.217850+0000 mon.a (mon.0) 428 : cluster [DBG] osdmap e85: 8 total, 7 up, 8 in 2021-03-10T13:57:03.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:03 gibba013 bash[29418]: audit 2021-03-10T13:57:02.221699+0000 mon.b (mon.2) 4 : audit [INF] from='osd.4 [v2:172.21.2.120:6800/1383141235,v1:172.21.2.120:6801/1383141235]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:57:03.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:03 gibba013 bash[29418]: audit 2021-03-10T13:57:02.224290+0000 mon.a (mon.0) 429 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:57:03.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:03 gibba013 bash[29418]: cluster 2021-03-10T13:57:02.494781+0000 mgr.gibba020.yqfnwy (mgr.34427) 240 : cluster [DBG] pgmap v115: 129 pgs: 22 active+undersized+degraded, 34 active+undersized, 73 active+clean; 7.0 KiB data, 33 MiB used, 669 GiB / 672 GiB avail; 30/192 objects degraded (15.625%) 2021-03-10T13:57:03.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:03 gibba013 bash[30381]: audit 2021-03-10T13:57:02.217811+0000 mon.a (mon.0) 427 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-03-10T13:57:03.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:03 gibba013 bash[30381]: cluster 2021-03-10T13:57:02.217850+0000 mon.a (mon.0) 428 : cluster [DBG] osdmap e85: 8 total, 7 up, 8 in 2021-03-10T13:57:03.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:03 gibba013 bash[30381]: audit 2021-03-10T13:57:02.221699+0000 mon.b (mon.2) 4 : audit [INF] from='osd.4 [v2:172.21.2.120:6800/1383141235,v1:172.21.2.120:6801/1383141235]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:57:03.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:03 gibba013 bash[30381]: audit 2021-03-10T13:57:02.224290+0000 mon.a (mon.0) 429 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:57:03.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:03 gibba013 bash[30381]: cluster 2021-03-10T13:57:02.494781+0000 mgr.gibba020.yqfnwy (mgr.34427) 240 : cluster [DBG] pgmap v115: 129 pgs: 22 active+undersized+degraded, 34 active+undersized, 73 active+clean; 7.0 KiB data, 33 MiB used, 669 GiB / 672 GiB avail; 30/192 objects degraded (15.625%) 2021-03-10T13:57:03.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:03 gibba020 bash[25448]: audit 2021-03-10T13:57:02.217811+0000 mon.a (mon.0) 427 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-03-10T13:57:03.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:03 gibba020 bash[25448]: cluster 2021-03-10T13:57:02.217850+0000 mon.a (mon.0) 428 : cluster [DBG] osdmap e85: 8 total, 7 up, 8 in 2021-03-10T13:57:03.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:03 gibba020 bash[25448]: audit 2021-03-10T13:57:02.221699+0000 mon.b (mon.2) 4 : audit [INF] from='osd.4 [v2:172.21.2.120:6800/1383141235,v1:172.21.2.120:6801/1383141235]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:57:03.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:03 gibba020 bash[25448]: audit 2021-03-10T13:57:02.224290+0000 mon.a (mon.0) 429 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:57:03.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:03 gibba020 bash[25448]: cluster 2021-03-10T13:57:02.494781+0000 mgr.gibba020.yqfnwy (mgr.34427) 240 : cluster [DBG] pgmap v115: 129 pgs: 22 active+undersized+degraded, 34 active+undersized, 73 active+clean; 7.0 KiB data, 33 MiB used, 669 GiB / 672 GiB avail; 30/192 objects degraded (15.625%) 2021-03-10T13:57:04.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:04 gibba013 bash[29418]: cluster 2021-03-10T13:57:03.217819+0000 mon.a (mon.0) 430 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:57:04.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:04 gibba013 bash[29418]: cluster 2021-03-10T13:57:03.227836+0000 mon.a (mon.0) 431 : cluster [INF] osd.4 [v2:172.21.2.120:6800/1383141235,v1:172.21.2.120:6801/1383141235] boot 2021-03-10T13:57:04.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:04 gibba013 bash[29418]: cluster 2021-03-10T13:57:03.227887+0000 mon.a (mon.0) 432 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2021-03-10T13:57:04.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:04 gibba013 bash[29418]: audit 2021-03-10T13:57:03.228545+0000 mon.a (mon.0) 433 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:57:04.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:04 gibba013 bash[29418]: cluster 2021-03-10T13:57:04.231861+0000 mon.a (mon.0) 434 : cluster [DBG] osdmap e87: 8 total, 8 up, 8 in 2021-03-10T13:57:04.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:04 gibba013 bash[30381]: cluster 2021-03-10T13:57:03.217819+0000 mon.a (mon.0) 430 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:57:04.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:04 gibba013 bash[30381]: cluster 2021-03-10T13:57:03.227836+0000 mon.a (mon.0) 431 : cluster [INF] osd.4 [v2:172.21.2.120:6800/1383141235,v1:172.21.2.120:6801/1383141235] boot 2021-03-10T13:57:04.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:04 gibba013 bash[30381]: cluster 2021-03-10T13:57:03.227887+0000 mon.a (mon.0) 432 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2021-03-10T13:57:04.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:04 gibba013 bash[30381]: audit 2021-03-10T13:57:03.228545+0000 mon.a (mon.0) 433 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:57:04.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:04 gibba013 bash[30381]: cluster 2021-03-10T13:57:04.231861+0000 mon.a (mon.0) 434 : cluster [DBG] osdmap e87: 8 total, 8 up, 8 in 2021-03-10T13:57:04.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:04 gibba020 bash[25448]: cluster 2021-03-10T13:57:03.217819+0000 mon.a (mon.0) 430 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:57:04.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:04 gibba020 bash[25448]: cluster 2021-03-10T13:57:03.227836+0000 mon.a (mon.0) 431 : cluster [INF] osd.4 [v2:172.21.2.120:6800/1383141235,v1:172.21.2.120:6801/1383141235] boot 2021-03-10T13:57:04.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:04 gibba020 bash[25448]: cluster 2021-03-10T13:57:03.227887+0000 mon.a (mon.0) 432 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2021-03-10T13:57:04.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:04 gibba020 bash[25448]: audit 2021-03-10T13:57:03.228545+0000 mon.a (mon.0) 433 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T13:57:04.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:04 gibba020 bash[25448]: cluster 2021-03-10T13:57:04.231861+0000 mon.a (mon.0) 434 : cluster [DBG] osdmap e87: 8 total, 8 up, 8 in 2021-03-10T13:57:05.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:05 gibba013 bash[29418]: cluster 2021-03-10T13:57:04.496367+0000 mgr.gibba020.yqfnwy (mgr.34427) 241 : cluster [DBG] pgmap v118: 129 pgs: 22 active+undersized+degraded, 34 active+undersized, 73 active+clean; 7.0 KiB data, 33 MiB used, 669 GiB / 672 GiB avail; 30/192 objects degraded (15.625%) 2021-03-10T13:57:05.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:05 gibba013 bash[29418]: cluster 2021-03-10T13:57:04.759021+0000 mon.a (mon.0) 435 : cluster [WRN] Health check update: Degraded data redundancy: 30/192 objects degraded (15.625%), 22 pgs degraded (PG_DEGRADED) 2021-03-10T13:57:05.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:05 gibba013 bash[30381]: cluster 2021-03-10T13:57:04.496367+0000 mgr.gibba020.yqfnwy (mgr.34427) 241 : cluster [DBG] pgmap v118: 129 pgs: 22 active+undersized+degraded, 34 active+undersized, 73 active+clean; 7.0 KiB data, 33 MiB used, 669 GiB / 672 GiB avail; 30/192 objects degraded (15.625%) 2021-03-10T13:57:05.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:05 gibba013 bash[30381]: cluster 2021-03-10T13:57:04.759021+0000 mon.a (mon.0) 435 : cluster [WRN] Health check update: Degraded data redundancy: 30/192 objects degraded (15.625%), 22 pgs degraded (PG_DEGRADED) 2021-03-10T13:57:05.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:05 gibba020 bash[25448]: cluster 2021-03-10T13:57:04.496367+0000 mgr.gibba020.yqfnwy (mgr.34427) 241 : cluster [DBG] pgmap v118: 129 pgs: 22 active+undersized+degraded, 34 active+undersized, 73 active+clean; 7.0 KiB data, 33 MiB used, 669 GiB / 672 GiB avail; 30/192 objects degraded (15.625%) 2021-03-10T13:57:05.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:05 gibba020 bash[25448]: cluster 2021-03-10T13:57:04.759021+0000 mon.a (mon.0) 435 : cluster [WRN] Health check update: Degraded data redundancy: 30/192 objects degraded (15.625%), 22 pgs degraded (PG_DEGRADED) 2021-03-10T13:57:06.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:06 gibba013 bash[29418]: audit 2021-03-10T13:57:05.863977+0000 mon.a (mon.0) 436 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T13:57:06.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:06 gibba013 bash[29418]: audit 2021-03-10T13:57:05.864714+0000 mon.a (mon.0) 437 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:57:06.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:06 gibba013 bash[30381]: audit 2021-03-10T13:57:05.863977+0000 mon.a (mon.0) 436 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T13:57:06.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:06 gibba013 bash[30381]: audit 2021-03-10T13:57:05.864714+0000 mon.a (mon.0) 437 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:57:06.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:06 gibba020 bash[25448]: audit 2021-03-10T13:57:05.863977+0000 mon.a (mon.0) 436 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T13:57:06.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:06 gibba020 bash[25448]: audit 2021-03-10T13:57:05.864714+0000 mon.a (mon.0) 437 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:57:07.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:07 gibba013 bash[29418]: cluster 2021-03-10T13:57:06.498102+0000 mgr.gibba020.yqfnwy (mgr.34427) 242 : cluster [DBG] pgmap v119: 129 pgs: 19 active+undersized+degraded, 26 active+undersized, 84 active+clean; 7.0 KiB data, 34 MiB used, 669 GiB / 672 GiB avail; 26/192 objects degraded (13.542%) 2021-03-10T13:57:07.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:07 gibba013 bash[30381]: cluster 2021-03-10T13:57:06.498102+0000 mgr.gibba020.yqfnwy (mgr.34427) 242 : cluster [DBG] pgmap v119: 129 pgs: 19 active+undersized+degraded, 26 active+undersized, 84 active+clean; 7.0 KiB data, 34 MiB used, 669 GiB / 672 GiB avail; 26/192 objects degraded (13.542%) 2021-03-10T13:57:07.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:07 gibba020 bash[25448]: cluster 2021-03-10T13:57:06.498102+0000 mgr.gibba020.yqfnwy (mgr.34427) 242 : cluster [DBG] pgmap v119: 129 pgs: 19 active+undersized+degraded, 26 active+undersized, 84 active+clean; 7.0 KiB data, 34 MiB used, 669 GiB / 672 GiB avail; 26/192 objects degraded (13.542%) 2021-03-10T13:57:08.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:08 gibba013 bash[29418]: cluster 2021-03-10T13:57:08.555096+0000 mon.a (mon.0) 438 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 26/192 objects degraded (13.542%), 19 pgs degraded) 2021-03-10T13:57:08.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:08 gibba013 bash[30381]: cluster 2021-03-10T13:57:08.555096+0000 mon.a (mon.0) 438 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 26/192 objects degraded (13.542%), 19 pgs degraded) 2021-03-10T13:57:08.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:08 gibba020 bash[25448]: cluster 2021-03-10T13:57:08.555096+0000 mon.a (mon.0) 438 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 26/192 objects degraded (13.542%), 19 pgs degraded) 2021-03-10T13:57:09.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:09 gibba013 bash[29418]: cluster 2021-03-10T13:57:08.499861+0000 mgr.gibba020.yqfnwy (mgr.34427) 243 : cluster [DBG] pgmap v120: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:57:09.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:09 gibba013 bash[30381]: cluster 2021-03-10T13:57:08.499861+0000 mgr.gibba020.yqfnwy (mgr.34427) 243 : cluster [DBG] pgmap v120: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:57:09.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:09 gibba020 bash[25448]: cluster 2021-03-10T13:57:08.499861+0000 mgr.gibba020.yqfnwy (mgr.34427) 243 : cluster [DBG] pgmap v120: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:57:12.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:11 gibba020 bash[25448]: cluster 2021-03-10T13:57:10.501183+0000 mgr.gibba020.yqfnwy (mgr.34427) 244 : cluster [DBG] pgmap v121: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:57:12.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:11 gibba020 bash[25448]: audit 2021-03-10T13:57:10.896160+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:57:12.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:11 gibba013 bash[29418]: cluster 2021-03-10T13:57:10.501183+0000 mgr.gibba020.yqfnwy (mgr.34427) 244 : cluster [DBG] pgmap v121: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:57:12.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:11 gibba013 bash[29418]: audit 2021-03-10T13:57:10.896160+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:57:12.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:11 gibba013 bash[30381]: cluster 2021-03-10T13:57:10.501183+0000 mgr.gibba020.yqfnwy (mgr.34427) 244 : cluster [DBG] pgmap v121: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:57:12.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:11 gibba013 bash[30381]: audit 2021-03-10T13:57:10.896160+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:57:14.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:13 gibba020 bash[25448]: cluster 2021-03-10T13:57:12.502805+0000 mgr.gibba020.yqfnwy (mgr.34427) 245 : cluster [DBG] pgmap v122: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:57:14.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:13 gibba013 bash[29418]: cluster 2021-03-10T13:57:12.502805+0000 mgr.gibba020.yqfnwy (mgr.34427) 245 : cluster [DBG] pgmap v122: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:57:14.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:13 gibba013 bash[30381]: cluster 2021-03-10T13:57:12.502805+0000 mgr.gibba020.yqfnwy (mgr.34427) 245 : cluster [DBG] pgmap v122: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:57:15.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:14 gibba020 bash[25448]: audit 2021-03-10T13:57:14.227512+0000 mon.a (mon.0) 440 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T13:57:15.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:14 gibba013 bash[29418]: audit 2021-03-10T13:57:14.227512+0000 mon.a (mon.0) 440 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T13:57:15.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:14 gibba013 bash[30381]: audit 2021-03-10T13:57:14.227512+0000 mon.a (mon.0) 440 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T13:57:16.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:15 gibba020 bash[25448]: audit 2021-03-10T13:57:14.226400+0000 mgr.gibba020.yqfnwy (mgr.34427) 246 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T13:57:16.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:15 gibba020 bash[25448]: cephadm 2021-03-10T13:57:14.230761+0000 mgr.gibba020.yqfnwy (mgr.34427) 247 : cephadm [INF] Upgrade: osd.5 is safe to restart 2021-03-10T13:57:16.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:15 gibba020 bash[25448]: cluster 2021-03-10T13:57:14.503872+0000 mgr.gibba020.yqfnwy (mgr.34427) 248 : cluster [DBG] pgmap v123: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:57:16.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:15 gibba013 bash[29418]: audit 2021-03-10T13:57:14.226400+0000 mgr.gibba020.yqfnwy (mgr.34427) 246 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T13:57:16.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:15 gibba013 bash[29418]: cephadm 2021-03-10T13:57:14.230761+0000 mgr.gibba020.yqfnwy (mgr.34427) 247 : cephadm [INF] Upgrade: osd.5 is safe to restart 2021-03-10T13:57:16.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:15 gibba013 bash[29418]: cluster 2021-03-10T13:57:14.503872+0000 mgr.gibba020.yqfnwy (mgr.34427) 248 : cluster [DBG] pgmap v123: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:57:16.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:15 gibba013 bash[30381]: audit 2021-03-10T13:57:14.226400+0000 mgr.gibba020.yqfnwy (mgr.34427) 246 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T13:57:16.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:15 gibba013 bash[30381]: cephadm 2021-03-10T13:57:14.230761+0000 mgr.gibba020.yqfnwy (mgr.34427) 247 : cephadm [INF] Upgrade: osd.5 is safe to restart 2021-03-10T13:57:16.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:15 gibba013 bash[30381]: cluster 2021-03-10T13:57:14.503872+0000 mgr.gibba020.yqfnwy (mgr.34427) 248 : cluster [DBG] pgmap v123: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:57:17.335 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:17 gibba020 bash[25448]: cephadm 2021-03-10T13:57:16.071961+0000 mgr.gibba020.yqfnwy (mgr.34427) 249 : cephadm [INF] Upgrade: Updating osd.5 2021-03-10T13:57:17.335 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:17 gibba020 bash[25448]: cephadm 2021-03-10T13:57:16.083677+0000 mgr.gibba020.yqfnwy (mgr.34427) 250 : cephadm [INF] Deploying daemon osd.5 on gibba020 2021-03-10T13:57:17.335 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:17 gibba020 bash[25448]: audit 2021-03-10T13:57:16.084396+0000 mon.a (mon.0) 441 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:57:17.336 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:17 gibba020 bash[25448]: audit 2021-03-10T13:57:16.086087+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2021-03-10T13:57:17.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:17 gibba013 bash[29418]: cephadm 2021-03-10T13:57:16.071961+0000 mgr.gibba020.yqfnwy (mgr.34427) 249 : cephadm [INF] Upgrade: Updating osd.5 2021-03-10T13:57:17.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:17 gibba013 bash[29418]: cephadm 2021-03-10T13:57:16.083677+0000 mgr.gibba020.yqfnwy (mgr.34427) 250 : cephadm [INF] Deploying daemon osd.5 on gibba020 2021-03-10T13:57:17.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:17 gibba013 bash[29418]: audit 2021-03-10T13:57:16.084396+0000 mon.a (mon.0) 441 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:57:17.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:17 gibba013 bash[29418]: audit 2021-03-10T13:57:16.086087+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2021-03-10T13:57:17.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:17 gibba013 bash[30381]: cephadm 2021-03-10T13:57:16.071961+0000 mgr.gibba020.yqfnwy (mgr.34427) 249 : cephadm [INF] Upgrade: Updating osd.5 2021-03-10T13:57:17.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:17 gibba013 bash[30381]: cephadm 2021-03-10T13:57:16.083677+0000 mgr.gibba020.yqfnwy (mgr.34427) 250 : cephadm [INF] Deploying daemon osd.5 on gibba020 2021-03-10T13:57:17.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:17 gibba013 bash[30381]: audit 2021-03-10T13:57:16.084396+0000 mon.a (mon.0) 441 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:57:17.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:17 gibba013 bash[30381]: audit 2021-03-10T13:57:16.086087+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2021-03-10T13:57:18.335 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:18 gibba020 bash[25448]: cluster 2021-03-10T13:57:16.505277+0000 mgr.gibba020.yqfnwy (mgr.34427) 251 : cluster [DBG] pgmap v124: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:57:18.336 INFO:journalctl@ceph.osd.5.gibba020.stdout:Mar 10 13:57:18 gibba020 systemd[1]: Stopping Ceph osd.5 for 7672acc8-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:57:18.336 INFO:journalctl@ceph.osd.5.gibba020.stdout:Mar 10 13:57:18 gibba020 bash[13673]: debug 2021-03-10T13:57:18.169+0000 7f945b9eb700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T13:57:18.336 INFO:journalctl@ceph.osd.5.gibba020.stdout:Mar 10 13:57:18 gibba020 bash[13673]: debug 2021-03-10T13:57:18.169+0000 7f945b9eb700 -1 osd.5 87 *** Got signal Terminated *** 2021-03-10T13:57:18.336 INFO:journalctl@ceph.osd.5.gibba020.stdout:Mar 10 13:57:18 gibba020 bash[13673]: debug 2021-03-10T13:57:18.169+0000 7f945b9eb700 -1 osd.5 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-03-10T13:57:18.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:18 gibba013 bash[29418]: cluster 2021-03-10T13:57:16.505277+0000 mgr.gibba020.yqfnwy (mgr.34427) 251 : cluster [DBG] pgmap v124: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:57:18.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:18 gibba013 bash[30381]: cluster 2021-03-10T13:57:16.505277+0000 mgr.gibba020.yqfnwy (mgr.34427) 251 : cluster [DBG] pgmap v124: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:57:19.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[29418]: cluster 2021-03-10T13:57:18.479035+0000 mon.a (mon.0) 443 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T13:57:19.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[29418]: cluster 2021-03-10T13:57:18.479133+0000 mon.a (mon.0) 444 : cluster [INF] osd.5 failed (root=default,host=gibba020) (connection refused reported by osd.6) 2021-03-10T13:57:19.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[29418]: cluster 2021-03-10T13:57:18.479761+0000 mon.a (mon.0) 445 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T13:57:19.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[29418]: cluster 2021-03-10T13:57:18.480051+0000 mon.a (mon.0) 446 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T13:57:19.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[29418]: cluster 2021-03-10T13:57:18.480484+0000 mon.a (mon.0) 447 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T13:57:19.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[29418]: cluster 2021-03-10T13:57:18.480776+0000 mon.a (mon.0) 448 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T13:57:19.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[29418]: cluster 2021-03-10T13:57:18.481284+0000 mon.a (mon.0) 449 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T13:57:19.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[29418]: cluster 2021-03-10T13:57:18.481563+0000 mon.a (mon.0) 450 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T13:57:19.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[29418]: cluster 2021-03-10T13:57:18.482131+0000 mon.a (mon.0) 451 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T13:57:19.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[29418]: cluster 2021-03-10T13:57:18.482413+0000 mon.a (mon.0) 452 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T13:57:19.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[29418]: cluster 2021-03-10T13:57:18.482909+0000 mon.a (mon.0) 453 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T13:57:19.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[29418]: cluster 2021-03-10T13:57:18.483188+0000 mon.a (mon.0) 454 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T13:57:19.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[29418]: cluster 2021-03-10T13:57:18.483682+0000 mon.a (mon.0) 455 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T13:57:19.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[29418]: cluster 2021-03-10T13:57:18.483968+0000 mon.a (mon.0) 456 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T13:57:19.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[29418]: cluster 2021-03-10T13:57:18.484435+0000 mon.a (mon.0) 457 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T13:57:19.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[29418]: cluster 2021-03-10T13:57:18.876405+0000 mon.a (mon.0) 458 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T13:57:19.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[29418]: cluster 2021-03-10T13:57:18.876759+0000 mon.a (mon.0) 459 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T13:57:19.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[29418]: cluster 2021-03-10T13:57:18.877601+0000 mon.a (mon.0) 460 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T13:57:19.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[29418]: cluster 2021-03-10T13:57:18.878572+0000 mon.a (mon.0) 461 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T13:57:19.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[29418]: cluster 2021-03-10T13:57:18.878964+0000 mon.a (mon.0) 462 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T13:57:19.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[29418]: cluster 2021-03-10T13:57:18.879656+0000 mon.a (mon.0) 463 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T13:57:19.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[29418]: cluster 2021-03-10T13:57:18.880175+0000 mon.a (mon.0) 464 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T13:57:19.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[29418]: cluster 2021-03-10T13:57:18.880453+0000 mon.a (mon.0) 465 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T13:57:19.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[29418]: cluster 2021-03-10T13:57:18.882941+0000 mon.a (mon.0) 466 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T13:57:19.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[29418]: cluster 2021-03-10T13:57:18.883131+0000 mon.a (mon.0) 467 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T13:57:19.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[29418]: cluster 2021-03-10T13:57:18.883708+0000 mon.a (mon.0) 468 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T13:57:19.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[29418]: cluster 2021-03-10T13:57:18.883995+0000 mon.a (mon.0) 469 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T13:57:19.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[29418]: cluster 2021-03-10T13:57:18.884541+0000 mon.a (mon.0) 470 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T13:57:19.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[29418]: cluster 2021-03-10T13:57:18.884803+0000 mon.a (mon.0) 471 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T13:57:19.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[30381]: cluster 2021-03-10T13:57:18.479035+0000 mon.a (mon.0) 443 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T13:57:19.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[30381]: cluster 2021-03-10T13:57:18.479133+0000 mon.a (mon.0) 444 : cluster [INF] osd.5 failed (root=default,host=gibba020) (connection refused reported by osd.6) 2021-03-10T13:57:19.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[30381]: cluster 2021-03-10T13:57:18.479761+0000 mon.a (mon.0) 445 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T13:57:19.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[30381]: cluster 2021-03-10T13:57:18.480051+0000 mon.a (mon.0) 446 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T13:57:19.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[30381]: cluster 2021-03-10T13:57:18.480484+0000 mon.a (mon.0) 447 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T13:57:19.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[30381]: cluster 2021-03-10T13:57:18.480776+0000 mon.a (mon.0) 448 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T13:57:19.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[30381]: cluster 2021-03-10T13:57:18.481284+0000 mon.a (mon.0) 449 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T13:57:19.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[30381]: cluster 2021-03-10T13:57:18.481563+0000 mon.a (mon.0) 450 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T13:57:19.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[30381]: cluster 2021-03-10T13:57:18.482131+0000 mon.a (mon.0) 451 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T13:57:19.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[30381]: cluster 2021-03-10T13:57:18.482413+0000 mon.a (mon.0) 452 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T13:57:19.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[30381]: cluster 2021-03-10T13:57:18.482909+0000 mon.a (mon.0) 453 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T13:57:19.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[30381]: cluster 2021-03-10T13:57:18.483188+0000 mon.a (mon.0) 454 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T13:57:19.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[30381]: cluster 2021-03-10T13:57:18.483682+0000 mon.a (mon.0) 455 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T13:57:19.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[30381]: cluster 2021-03-10T13:57:18.483968+0000 mon.a (mon.0) 456 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T13:57:19.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[30381]: cluster 2021-03-10T13:57:18.484435+0000 mon.a (mon.0) 457 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T13:57:19.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[30381]: cluster 2021-03-10T13:57:18.876405+0000 mon.a (mon.0) 458 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T13:57:19.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[30381]: cluster 2021-03-10T13:57:18.876759+0000 mon.a (mon.0) 459 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T13:57:19.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[30381]: cluster 2021-03-10T13:57:18.877601+0000 mon.a (mon.0) 460 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T13:57:19.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[30381]: cluster 2021-03-10T13:57:18.878572+0000 mon.a (mon.0) 461 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T13:57:19.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[30381]: cluster 2021-03-10T13:57:18.878964+0000 mon.a (mon.0) 462 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T13:57:19.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[30381]: cluster 2021-03-10T13:57:18.879656+0000 mon.a (mon.0) 463 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T13:57:19.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[30381]: cluster 2021-03-10T13:57:18.880175+0000 mon.a (mon.0) 464 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T13:57:19.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[30381]: cluster 2021-03-10T13:57:18.880453+0000 mon.a (mon.0) 465 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T13:57:19.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[30381]: cluster 2021-03-10T13:57:18.882941+0000 mon.a (mon.0) 466 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T13:57:19.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[30381]: cluster 2021-03-10T13:57:18.883131+0000 mon.a (mon.0) 467 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T13:57:19.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[30381]: cluster 2021-03-10T13:57:18.883708+0000 mon.a (mon.0) 468 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T13:57:19.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[30381]: cluster 2021-03-10T13:57:18.883995+0000 mon.a (mon.0) 469 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T13:57:19.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[30381]: cluster 2021-03-10T13:57:18.884541+0000 mon.a (mon.0) 470 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T13:57:19.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:19 gibba013 bash[30381]: cluster 2021-03-10T13:57:18.884803+0000 mon.a (mon.0) 471 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T13:57:19.447 INFO:journalctl@ceph.osd.5.gibba020.stdout:Mar 10 13:57:19 gibba020 docker[28211]: ceph-7672acc8-81a6-11eb-9080-001a4aab830c-osd.5 2021-03-10T13:57:19.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:19 gibba020 bash[25448]: cluster 2021-03-10T13:57:18.479035+0000 mon.a (mon.0) 443 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T13:57:19.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:19 gibba020 bash[25448]: cluster 2021-03-10T13:57:18.479133+0000 mon.a (mon.0) 444 : cluster [INF] osd.5 failed (root=default,host=gibba020) (connection refused reported by osd.6) 2021-03-10T13:57:19.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:19 gibba020 bash[25448]: cluster 2021-03-10T13:57:18.479761+0000 mon.a (mon.0) 445 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T13:57:19.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:19 gibba020 bash[25448]: cluster 2021-03-10T13:57:18.480051+0000 mon.a (mon.0) 446 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T13:57:19.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:19 gibba020 bash[25448]: cluster 2021-03-10T13:57:18.480484+0000 mon.a (mon.0) 447 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T13:57:19.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:19 gibba020 bash[25448]: cluster 2021-03-10T13:57:18.480776+0000 mon.a (mon.0) 448 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T13:57:19.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:19 gibba020 bash[25448]: cluster 2021-03-10T13:57:18.481284+0000 mon.a (mon.0) 449 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T13:57:19.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:19 gibba020 bash[25448]: cluster 2021-03-10T13:57:18.481563+0000 mon.a (mon.0) 450 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T13:57:19.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:19 gibba020 bash[25448]: cluster 2021-03-10T13:57:18.482131+0000 mon.a (mon.0) 451 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T13:57:19.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:19 gibba020 bash[25448]: cluster 2021-03-10T13:57:18.482413+0000 mon.a (mon.0) 452 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T13:57:19.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:19 gibba020 bash[25448]: cluster 2021-03-10T13:57:18.482909+0000 mon.a (mon.0) 453 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T13:57:19.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:19 gibba020 bash[25448]: cluster 2021-03-10T13:57:18.483188+0000 mon.a (mon.0) 454 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T13:57:19.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:19 gibba020 bash[25448]: cluster 2021-03-10T13:57:18.483682+0000 mon.a (mon.0) 455 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T13:57:19.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:19 gibba020 bash[25448]: cluster 2021-03-10T13:57:18.483968+0000 mon.a (mon.0) 456 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T13:57:19.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:19 gibba020 bash[25448]: cluster 2021-03-10T13:57:18.484435+0000 mon.a (mon.0) 457 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T13:57:19.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:19 gibba020 bash[25448]: cluster 2021-03-10T13:57:18.876405+0000 mon.a (mon.0) 458 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T13:57:19.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:19 gibba020 bash[25448]: cluster 2021-03-10T13:57:18.876759+0000 mon.a (mon.0) 459 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T13:57:19.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:19 gibba020 bash[25448]: cluster 2021-03-10T13:57:18.877601+0000 mon.a (mon.0) 460 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T13:57:19.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:19 gibba020 bash[25448]: cluster 2021-03-10T13:57:18.878572+0000 mon.a (mon.0) 461 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T13:57:19.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:19 gibba020 bash[25448]: cluster 2021-03-10T13:57:18.878964+0000 mon.a (mon.0) 462 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T13:57:19.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:19 gibba020 bash[25448]: cluster 2021-03-10T13:57:18.879656+0000 mon.a (mon.0) 463 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T13:57:19.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:19 gibba020 bash[25448]: cluster 2021-03-10T13:57:18.880175+0000 mon.a (mon.0) 464 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T13:57:19.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:19 gibba020 bash[25448]: cluster 2021-03-10T13:57:18.880453+0000 mon.a (mon.0) 465 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T13:57:19.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:19 gibba020 bash[25448]: cluster 2021-03-10T13:57:18.882941+0000 mon.a (mon.0) 466 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T13:57:19.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:19 gibba020 bash[25448]: cluster 2021-03-10T13:57:18.883131+0000 mon.a (mon.0) 467 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T13:57:19.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:19 gibba020 bash[25448]: cluster 2021-03-10T13:57:18.883708+0000 mon.a (mon.0) 468 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T13:57:19.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:19 gibba020 bash[25448]: cluster 2021-03-10T13:57:18.883995+0000 mon.a (mon.0) 469 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T13:57:19.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:19 gibba020 bash[25448]: cluster 2021-03-10T13:57:18.884541+0000 mon.a (mon.0) 470 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T13:57:19.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:19 gibba020 bash[25448]: cluster 2021-03-10T13:57:18.884803+0000 mon.a (mon.0) 471 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T13:57:20.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:20 gibba013 bash[29418]: cluster 2021-03-10T13:57:18.507039+0000 mgr.gibba020.yqfnwy (mgr.34427) 252 : cluster [DBG] pgmap v125: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:57:20.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:20 gibba013 bash[29418]: cluster 2021-03-10T13:57:19.098136+0000 mon.a (mon.0) 472 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:57:20.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:20 gibba013 bash[29418]: cluster 2021-03-10T13:57:19.109114+0000 mon.a (mon.0) 473 : cluster [DBG] osdmap e88: 8 total, 7 up, 8 in 2021-03-10T13:57:20.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:20 gibba013 bash[30381]: cluster 2021-03-10T13:57:18.507039+0000 mgr.gibba020.yqfnwy (mgr.34427) 252 : cluster [DBG] pgmap v125: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:57:20.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:20 gibba013 bash[30381]: cluster 2021-03-10T13:57:19.098136+0000 mon.a (mon.0) 472 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:57:20.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:20 gibba013 bash[30381]: cluster 2021-03-10T13:57:19.109114+0000 mon.a (mon.0) 473 : cluster [DBG] osdmap e88: 8 total, 7 up, 8 in 2021-03-10T13:57:20.380 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:20 gibba020 bash[25448]: cluster 2021-03-10T13:57:18.507039+0000 mgr.gibba020.yqfnwy (mgr.34427) 252 : cluster [DBG] pgmap v125: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:57:20.380 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:20 gibba020 bash[25448]: cluster 2021-03-10T13:57:19.098136+0000 mon.a (mon.0) 472 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:57:20.380 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:20 gibba020 bash[25448]: cluster 2021-03-10T13:57:19.109114+0000 mon.a (mon.0) 473 : cluster [DBG] osdmap e88: 8 total, 7 up, 8 in 2021-03-10T13:57:21.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:21 gibba013 bash[29418]: cluster 2021-03-10T13:57:20.119785+0000 mon.a (mon.0) 474 : cluster [DBG] osdmap e89: 8 total, 7 up, 8 in 2021-03-10T13:57:21.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:21 gibba013 bash[30381]: cluster 2021-03-10T13:57:20.119785+0000 mon.a (mon.0) 474 : cluster [DBG] osdmap e89: 8 total, 7 up, 8 in 2021-03-10T13:57:21.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:21 gibba020 bash[25448]: cluster 2021-03-10T13:57:20.119785+0000 mon.a (mon.0) 474 : cluster [DBG] osdmap e89: 8 total, 7 up, 8 in 2021-03-10T13:57:21.448 INFO:journalctl@ceph.osd.5.gibba020.stdout:Mar 10 13:57:21 gibba020 systemd[1]: ceph-7672acc8-81a6-11eb-9080-001a4aab830c@osd.5.service: Succeeded. 2021-03-10T13:57:21.448 INFO:journalctl@ceph.osd.5.gibba020.stdout:Mar 10 13:57:21 gibba020 systemd[1]: Stopped Ceph osd.5 for 7672acc8-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:57:21.448 INFO:journalctl@ceph.osd.5.gibba020.stdout:Mar 10 13:57:21 gibba020 systemd[1]: Started Ceph osd.5 for 7672acc8-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:57:22.315 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:22 gibba020 bash[25448]: cluster 2021-03-10T13:57:20.508328+0000 mgr.gibba020.yqfnwy (mgr.34427) 253 : cluster [DBG] pgmap v128: 129 pgs: 13 stale+active+clean, 14 peering, 18 active+clean+wait, 84 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:57:22.315 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:22 gibba020 bash[25448]: cluster 2021-03-10T13:57:21.119923+0000 mon.a (mon.0) 475 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs inactive, 4 pgs peering (PG_AVAILABILITY) 2021-03-10T13:57:22.315 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:22 gibba020 bash[25448]: audit 2021-03-10T13:57:21.153262+0000 mon.a (mon.0) 476 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:57:22.316 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:22 gibba020 bash[25448]: audit 2021-03-10T13:57:21.154096+0000 mon.a (mon.0) 477 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:57:22.316 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:22 gibba020 bash[25448]: audit 2021-03-10T13:57:21.155808+0000 mon.a (mon.0) 478 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:57:22.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:22 gibba013 bash[29418]: cluster 2021-03-10T13:57:20.508328+0000 mgr.gibba020.yqfnwy (mgr.34427) 253 : cluster [DBG] pgmap v128: 129 pgs: 13 stale+active+clean, 14 peering, 18 active+clean+wait, 84 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:57:22.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:22 gibba013 bash[29418]: cluster 2021-03-10T13:57:21.119923+0000 mon.a (mon.0) 475 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs inactive, 4 pgs peering (PG_AVAILABILITY) 2021-03-10T13:57:22.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:22 gibba013 bash[29418]: audit 2021-03-10T13:57:21.153262+0000 mon.a (mon.0) 476 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:57:22.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:22 gibba013 bash[29418]: audit 2021-03-10T13:57:21.154096+0000 mon.a (mon.0) 477 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:57:22.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:22 gibba013 bash[29418]: audit 2021-03-10T13:57:21.155808+0000 mon.a (mon.0) 478 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:57:22.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:22 gibba013 bash[30381]: cluster 2021-03-10T13:57:20.508328+0000 mgr.gibba020.yqfnwy (mgr.34427) 253 : cluster [DBG] pgmap v128: 129 pgs: 13 stale+active+clean, 14 peering, 18 active+clean+wait, 84 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T13:57:22.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:22 gibba013 bash[30381]: cluster 2021-03-10T13:57:21.119923+0000 mon.a (mon.0) 475 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs inactive, 4 pgs peering (PG_AVAILABILITY) 2021-03-10T13:57:22.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:22 gibba013 bash[30381]: audit 2021-03-10T13:57:21.153262+0000 mon.a (mon.0) 476 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:57:22.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:22 gibba013 bash[30381]: audit 2021-03-10T13:57:21.154096+0000 mon.a (mon.0) 477 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:57:22.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:22 gibba013 bash[30381]: audit 2021-03-10T13:57:21.155808+0000 mon.a (mon.0) 478 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:57:22.697 INFO:journalctl@ceph.osd.5.gibba020.stdout:Mar 10 13:57:22 gibba020 bash[28385]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-03-10T13:57:22.698 INFO:journalctl@ceph.osd.5.gibba020.stdout:Mar 10 13:57:22 gibba020 bash[28385]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2021-03-10T13:57:22.698 INFO:journalctl@ceph.osd.5.gibba020.stdout:Mar 10 13:57:22 gibba020 bash[28385]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5/block 2021-03-10T13:57:22.698 INFO:journalctl@ceph.osd.5.gibba020.stdout:Mar 10 13:57:22 gibba020 bash[28385]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2021-03-10T13:57:22.698 INFO:journalctl@ceph.osd.5.gibba020.stdout:Mar 10 13:57:22 gibba020 bash[28385]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2021-03-10T13:57:22.699 INFO:journalctl@ceph.osd.5.gibba020.stdout:Mar 10 13:57:22 gibba020 bash[28385]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-03-10T13:57:22.699 INFO:journalctl@ceph.osd.5.gibba020.stdout:Mar 10 13:57:22 gibba020 bash[28385]: --> ceph-volume lvm activate successful for osd ID: 5 2021-03-10T13:57:23.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:23 gibba020 bash[25448]: cluster 2021-03-10T13:57:23.126157+0000 mon.a (mon.0) 479 : cluster [WRN] Health check failed: Degraded data redundancy: 10/192 objects degraded (5.208%), 7 pgs degraded (PG_DEGRADED) 2021-03-10T13:57:23.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:23 gibba013 bash[29418]: cluster 2021-03-10T13:57:23.126157+0000 mon.a (mon.0) 479 : cluster [WRN] Health check failed: Degraded data redundancy: 10/192 objects degraded (5.208%), 7 pgs degraded (PG_DEGRADED) 2021-03-10T13:57:23.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:23 gibba013 bash[30381]: cluster 2021-03-10T13:57:23.126157+0000 mon.a (mon.0) 479 : cluster [WRN] Health check failed: Degraded data redundancy: 10/192 objects degraded (5.208%), 7 pgs degraded (PG_DEGRADED) 2021-03-10T13:57:24.183 INFO:journalctl@ceph.osd.5.gibba020.stdout:Mar 10 13:57:23 gibba020 bash[28514]: debug 2021-03-10T13:57:23.945+0000 7fe3a197b700 1 -- 172.21.2.120:0/1800009227 <== mon.2 v2:172.21.2.120:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a512e164e0 con 0x55a512e93400 2021-03-10T13:57:24.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:24 gibba020 bash[25448]: cluster 2021-03-10T13:57:22.510306+0000 mgr.gibba020.yqfnwy (mgr.34427) 254 : cluster [DBG] pgmap v129: 129 pgs: 1 stale+active+clean, 7 active+undersized+degraded, 14 peering, 18 active+undersized, 89 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 10/192 objects degraded (5.208%) 2021-03-10T13:57:24.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:24 gibba013 bash[29418]: cluster 2021-03-10T13:57:22.510306+0000 mgr.gibba020.yqfnwy (mgr.34427) 254 : cluster [DBG] pgmap v129: 129 pgs: 1 stale+active+clean, 7 active+undersized+degraded, 14 peering, 18 active+undersized, 89 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 10/192 objects degraded (5.208%) 2021-03-10T13:57:24.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:24 gibba013 bash[30381]: cluster 2021-03-10T13:57:22.510306+0000 mgr.gibba020.yqfnwy (mgr.34427) 254 : cluster [DBG] pgmap v129: 129 pgs: 1 stale+active+clean, 7 active+undersized+degraded, 14 peering, 18 active+undersized, 89 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 10/192 objects degraded (5.208%) 2021-03-10T13:57:24.947 INFO:journalctl@ceph.osd.5.gibba020.stdout:Mar 10 13:57:24 gibba020 bash[28514]: debug 2021-03-10T13:57:24.501+0000 7fe3a9410080 -1 Falling back to public interface 2021-03-10T13:57:26.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:26 gibba013 bash[29418]: cluster 2021-03-10T13:57:24.510820+0000 mgr.gibba020.yqfnwy (mgr.34427) 255 : cluster [DBG] pgmap v130: 129 pgs: 10 active+undersized+degraded, 14 peering, 20 active+undersized, 85 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 13/192 objects degraded (6.771%) 2021-03-10T13:57:26.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:26 gibba013 bash[29418]: audit 2021-03-10T13:57:25.014514+0000 mon.a (mon.0) 480 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:57:26.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:26 gibba013 bash[29418]: audit 2021-03-10T13:57:25.018306+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:57:26.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:26 gibba013 bash[29418]: cephadm 2021-03-10T13:57:25.019261+0000 mgr.gibba020.yqfnwy (mgr.34427) 256 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:57:26.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:26 gibba013 bash[29418]: cephadm 2021-03-10T13:57:25.021191+0000 mgr.gibba020.yqfnwy (mgr.34427) 257 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:57:26.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:26 gibba013 bash[29418]: audit 2021-03-10T13:57:25.021983+0000 mon.a (mon.0) 482 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:57:26.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:26 gibba013 bash[29418]: cephadm 2021-03-10T13:57:25.022523+0000 mgr.gibba020.yqfnwy (mgr.34427) 258 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:57:26.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:26 gibba013 bash[29418]: cephadm 2021-03-10T13:57:25.022602+0000 mgr.gibba020.yqfnwy (mgr.34427) 259 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:57:26.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:26 gibba013 bash[29418]: audit 2021-03-10T13:57:25.023675+0000 mon.a (mon.0) 483 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:26.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:26 gibba013 bash[29418]: cephadm 2021-03-10T13:57:25.024148+0000 mgr.gibba020.yqfnwy (mgr.34427) 260 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:57:26.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:26 gibba013 bash[29418]: cephadm 2021-03-10T13:57:25.024228+0000 mgr.gibba020.yqfnwy (mgr.34427) 261 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:57:26.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:26 gibba013 bash[29418]: audit 2021-03-10T13:57:25.025136+0000 mon.a (mon.0) 484 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:26.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:26 gibba013 bash[29418]: cephadm 2021-03-10T13:57:25.025594+0000 mgr.gibba020.yqfnwy (mgr.34427) 262 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:57:26.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:26 gibba013 bash[29418]: audit 2021-03-10T13:57:25.026669+0000 mon.a (mon.0) 485 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:26.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:26 gibba013 bash[29418]: cephadm 2021-03-10T13:57:25.026931+0000 mgr.gibba020.yqfnwy (mgr.34427) 263 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:57:26.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:26 gibba013 bash[29418]: cephadm 2021-03-10T13:57:25.027006+0000 mgr.gibba020.yqfnwy (mgr.34427) 264 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:57:26.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:26 gibba013 bash[29418]: audit 2021-03-10T13:57:25.027835+0000 mgr.gibba020.yqfnwy (mgr.34427) 265 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T13:57:26.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:26 gibba013 bash[29418]: cephadm 2021-03-10T13:57:25.029439+0000 mgr.gibba020.yqfnwy (mgr.34427) 266 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2021-03-10T13:57:26.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:26 gibba013 bash[29418]: audit 2021-03-10T13:57:25.029636+0000 mon.a (mon.0) 486 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T13:57:26.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:26 gibba013 bash[30381]: cluster 2021-03-10T13:57:24.510820+0000 mgr.gibba020.yqfnwy (mgr.34427) 255 : cluster [DBG] pgmap v130: 129 pgs: 10 active+undersized+degraded, 14 peering, 20 active+undersized, 85 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 13/192 objects degraded (6.771%) 2021-03-10T13:57:26.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:26 gibba013 bash[30381]: audit 2021-03-10T13:57:25.014514+0000 mon.a (mon.0) 480 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:57:26.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:26 gibba013 bash[30381]: audit 2021-03-10T13:57:25.018306+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:57:26.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:26 gibba013 bash[30381]: cephadm 2021-03-10T13:57:25.019261+0000 mgr.gibba020.yqfnwy (mgr.34427) 256 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:57:26.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:26 gibba013 bash[30381]: cephadm 2021-03-10T13:57:25.021191+0000 mgr.gibba020.yqfnwy (mgr.34427) 257 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:57:26.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:26 gibba013 bash[30381]: audit 2021-03-10T13:57:25.021983+0000 mon.a (mon.0) 482 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:57:26.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:26 gibba013 bash[30381]: cephadm 2021-03-10T13:57:25.022523+0000 mgr.gibba020.yqfnwy (mgr.34427) 258 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:57:26.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:26 gibba013 bash[30381]: cephadm 2021-03-10T13:57:25.022602+0000 mgr.gibba020.yqfnwy (mgr.34427) 259 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:57:26.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:26 gibba013 bash[30381]: audit 2021-03-10T13:57:25.023675+0000 mon.a (mon.0) 483 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:26.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:26 gibba013 bash[30381]: cephadm 2021-03-10T13:57:25.024148+0000 mgr.gibba020.yqfnwy (mgr.34427) 260 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:57:26.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:26 gibba013 bash[30381]: cephadm 2021-03-10T13:57:25.024228+0000 mgr.gibba020.yqfnwy (mgr.34427) 261 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:57:26.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:26 gibba013 bash[30381]: audit 2021-03-10T13:57:25.025136+0000 mon.a (mon.0) 484 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:26.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:26 gibba013 bash[30381]: cephadm 2021-03-10T13:57:25.025594+0000 mgr.gibba020.yqfnwy (mgr.34427) 262 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:57:26.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:26 gibba013 bash[30381]: audit 2021-03-10T13:57:25.026669+0000 mon.a (mon.0) 485 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:26.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:26 gibba013 bash[30381]: cephadm 2021-03-10T13:57:25.026931+0000 mgr.gibba020.yqfnwy (mgr.34427) 263 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:57:26.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:26 gibba013 bash[30381]: cephadm 2021-03-10T13:57:25.027006+0000 mgr.gibba020.yqfnwy (mgr.34427) 264 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:57:26.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:26 gibba013 bash[30381]: audit 2021-03-10T13:57:25.027835+0000 mgr.gibba020.yqfnwy (mgr.34427) 265 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T13:57:26.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:26 gibba013 bash[30381]: cephadm 2021-03-10T13:57:25.029439+0000 mgr.gibba020.yqfnwy (mgr.34427) 266 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2021-03-10T13:57:26.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:26 gibba013 bash[30381]: audit 2021-03-10T13:57:25.029636+0000 mon.a (mon.0) 486 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T13:57:26.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:26 gibba020 bash[25448]: cluster 2021-03-10T13:57:24.510820+0000 mgr.gibba020.yqfnwy (mgr.34427) 255 : cluster [DBG] pgmap v130: 129 pgs: 10 active+undersized+degraded, 14 peering, 20 active+undersized, 85 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 13/192 objects degraded (6.771%) 2021-03-10T13:57:26.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:26 gibba020 bash[25448]: audit 2021-03-10T13:57:25.014514+0000 mon.a (mon.0) 480 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:57:26.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:26 gibba020 bash[25448]: audit 2021-03-10T13:57:25.018306+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:57:26.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:26 gibba020 bash[25448]: cephadm 2021-03-10T13:57:25.019261+0000 mgr.gibba020.yqfnwy (mgr.34427) 256 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:57:26.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:26 gibba020 bash[25448]: cephadm 2021-03-10T13:57:25.021191+0000 mgr.gibba020.yqfnwy (mgr.34427) 257 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:57:26.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:26 gibba020 bash[25448]: audit 2021-03-10T13:57:25.021983+0000 mon.a (mon.0) 482 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:57:26.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:26 gibba020 bash[25448]: cephadm 2021-03-10T13:57:25.022523+0000 mgr.gibba020.yqfnwy (mgr.34427) 258 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:57:26.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:26 gibba020 bash[25448]: cephadm 2021-03-10T13:57:25.022602+0000 mgr.gibba020.yqfnwy (mgr.34427) 259 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:57:26.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:26 gibba020 bash[25448]: audit 2021-03-10T13:57:25.023675+0000 mon.a (mon.0) 483 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:26.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:26 gibba020 bash[25448]: cephadm 2021-03-10T13:57:25.024148+0000 mgr.gibba020.yqfnwy (mgr.34427) 260 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:57:26.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:26 gibba020 bash[25448]: cephadm 2021-03-10T13:57:25.024228+0000 mgr.gibba020.yqfnwy (mgr.34427) 261 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:57:26.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:26 gibba020 bash[25448]: audit 2021-03-10T13:57:25.025136+0000 mon.a (mon.0) 484 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:26.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:26 gibba020 bash[25448]: cephadm 2021-03-10T13:57:25.025594+0000 mgr.gibba020.yqfnwy (mgr.34427) 262 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:57:26.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:26 gibba020 bash[25448]: audit 2021-03-10T13:57:25.026669+0000 mon.a (mon.0) 485 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:26.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:26 gibba020 bash[25448]: cephadm 2021-03-10T13:57:25.026931+0000 mgr.gibba020.yqfnwy (mgr.34427) 263 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:57:26.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:26 gibba020 bash[25448]: cephadm 2021-03-10T13:57:25.027006+0000 mgr.gibba020.yqfnwy (mgr.34427) 264 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:57:26.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:26 gibba020 bash[25448]: audit 2021-03-10T13:57:25.027835+0000 mgr.gibba020.yqfnwy (mgr.34427) 265 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T13:57:26.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:26 gibba020 bash[25448]: cephadm 2021-03-10T13:57:25.029439+0000 mgr.gibba020.yqfnwy (mgr.34427) 266 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2021-03-10T13:57:26.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:26 gibba020 bash[25448]: audit 2021-03-10T13:57:25.029636+0000 mon.a (mon.0) 486 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T13:57:26.821 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T13:57:27.046 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:57:27.047 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3m) 53s ago 9m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T13:57:27.047 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (9m) 2s ago 9m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T13:57:27.047 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (4m) 2s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T13:57:27.047 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (4m) 2s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T13:57:27.047 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3m) 53s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T13:57:27.048 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3m) 53s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T13:57:27.048 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3m) 2s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T13:57:27.048 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3m) 53s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T13:57:27.048 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (9m) 53s ago 9m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T13:57:27.048 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (9m) 2s ago 9m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T13:57:27.049 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2m) 53s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T13:57:27.049 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (107s) 53s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T13:57:27.049 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (82s) 53s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T13:57:27.049 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (56s) 53s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T13:57:27.049 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (29s) 2s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T13:57:27.050 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (4s) 2s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T13:57:27.050 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (10m) 2s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b54758e37be1 2021-03-10T13:57:27.050 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (9m) 2s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 75c9ee8106fc 2021-03-10T13:57:27.050 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (8m) 2s ago 9m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T13:57:27.051 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2s ago 7m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:57:27.303 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T13:57:27.303 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T13:57:27.304 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:57:27.304 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:57:27.304 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T13:57:27.304 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:57:27.304 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:57:27.305 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T13:57:27.305 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2021-03-10T13:57:27.305 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 5 2021-03-10T13:57:27.305 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:57:27.305 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T13:57:27.306 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T13:57:27.306 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2021-03-10T13:57:27.306 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 11 2021-03-10T13:57:27.306 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T13:57:27.306 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T13:57:27.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:27 gibba013 bash[29418]: cluster 2021-03-10T13:57:27.013446+0000 mon.a (mon.0) 487 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive, 4 pgs peering) 2021-03-10T13:57:27.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:27 gibba013 bash[30381]: cluster 2021-03-10T13:57:27.013446+0000 mon.a (mon.0) 487 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive, 4 pgs peering) 2021-03-10T13:57:27.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:27 gibba020 bash[25448]: cluster 2021-03-10T13:57:27.013446+0000 mon.a (mon.0) 487 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive, 4 pgs peering) 2021-03-10T13:57:28.070 INFO:journalctl@ceph.osd.5.gibba020.stdout:Mar 10 13:57:27 gibba020 bash[28514]: debug 2021-03-10T13:57:27.733+0000 7fe3a9410080 -1 bluestore(/var/lib/ceph/osd/ceph-5) fsck warning: store not yet converted to per-pg omap 2021-03-10T13:57:28.070 INFO:journalctl@ceph.osd.5.gibba020.stdout:Mar 10 13:57:27 gibba020 bash[28514]: debug 2021-03-10T13:57:27.737+0000 7fe3a9410080 -1 bluestore(/var/lib/ceph/osd/ceph-5) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2021-03-10T13:57:28.071 INFO:journalctl@ceph.osd.5.gibba020.stdout:Mar 10 13:57:27 gibba020 bash[28514]: debug 2021-03-10T13:57:27.857+0000 7fe3a9410080 -1 osd.5 87 log_to_monitors {default=true} 2021-03-10T13:57:28.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:28 gibba013 bash[29418]: cluster 2021-03-10T13:57:26.512360+0000 mgr.gibba020.yqfnwy (mgr.34427) 267 : cluster [DBG] pgmap v131: 129 pgs: 12 active+undersized+degraded, 32 active+undersized, 85 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 17/192 objects degraded (8.854%) 2021-03-10T13:57:28.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:28 gibba013 bash[29418]: audit 2021-03-10T13:57:26.811034+0000 mgr.gibba020.yqfnwy (mgr.34427) 268 : audit [DBG] from='client.44250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:57:28.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:28 gibba013 bash[29418]: audit 2021-03-10T13:57:27.035883+0000 mgr.gibba020.yqfnwy (mgr.34427) 269 : audit [DBG] from='client.54241 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:57:28.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:28 gibba013 bash[29418]: audit 2021-03-10T13:57:27.304312+0000 mon.c (mon.1) 15 : audit [DBG] from='client.? 172.21.2.113:0/2646793789' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:28.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:28 gibba013 bash[29418]: audit 2021-03-10T13:57:27.865967+0000 mon.b (mon.2) 5 : audit [INF] from='osd.5 [v2:172.21.2.120:6808/307822660,v1:172.21.2.120:6809/307822660]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T13:57:28.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:28 gibba013 bash[29418]: audit 2021-03-10T13:57:27.869203+0000 mon.a (mon.0) 488 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T13:57:28.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:28 gibba013 bash[30381]: cluster 2021-03-10T13:57:26.512360+0000 mgr.gibba020.yqfnwy (mgr.34427) 267 : cluster [DBG] pgmap v131: 129 pgs: 12 active+undersized+degraded, 32 active+undersized, 85 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 17/192 objects degraded (8.854%) 2021-03-10T13:57:28.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:28 gibba013 bash[30381]: audit 2021-03-10T13:57:26.811034+0000 mgr.gibba020.yqfnwy (mgr.34427) 268 : audit [DBG] from='client.44250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:57:28.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:28 gibba013 bash[30381]: audit 2021-03-10T13:57:27.035883+0000 mgr.gibba020.yqfnwy (mgr.34427) 269 : audit [DBG] from='client.54241 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:57:28.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:28 gibba013 bash[30381]: audit 2021-03-10T13:57:27.304312+0000 mon.c (mon.1) 15 : audit [DBG] from='client.? 172.21.2.113:0/2646793789' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:28.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:28 gibba013 bash[30381]: audit 2021-03-10T13:57:27.865967+0000 mon.b (mon.2) 5 : audit [INF] from='osd.5 [v2:172.21.2.120:6808/307822660,v1:172.21.2.120:6809/307822660]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T13:57:28.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:28 gibba013 bash[30381]: audit 2021-03-10T13:57:27.869203+0000 mon.a (mon.0) 488 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T13:57:28.447 INFO:journalctl@ceph.osd.5.gibba020.stdout:Mar 10 13:57:28 gibba020 bash[28514]: debug 2021-03-10T13:57:28.085+0000 7fe39a8f0700 -1 osd.5 87 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:57:28.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:28 gibba020 bash[25448]: cluster 2021-03-10T13:57:26.512360+0000 mgr.gibba020.yqfnwy (mgr.34427) 267 : cluster [DBG] pgmap v131: 129 pgs: 12 active+undersized+degraded, 32 active+undersized, 85 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 17/192 objects degraded (8.854%) 2021-03-10T13:57:28.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:28 gibba020 bash[25448]: audit 2021-03-10T13:57:26.811034+0000 mgr.gibba020.yqfnwy (mgr.34427) 268 : audit [DBG] from='client.44250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:57:28.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:28 gibba020 bash[25448]: audit 2021-03-10T13:57:27.035883+0000 mgr.gibba020.yqfnwy (mgr.34427) 269 : audit [DBG] from='client.54241 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:57:28.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:28 gibba020 bash[25448]: audit 2021-03-10T13:57:27.304312+0000 mon.c (mon.1) 15 : audit [DBG] from='client.? 172.21.2.113:0/2646793789' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:28.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:28 gibba020 bash[25448]: audit 2021-03-10T13:57:27.865967+0000 mon.b (mon.2) 5 : audit [INF] from='osd.5 [v2:172.21.2.120:6808/307822660,v1:172.21.2.120:6809/307822660]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T13:57:28.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:28 gibba020 bash[25448]: audit 2021-03-10T13:57:27.869203+0000 mon.a (mon.0) 488 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T13:57:29.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:29 gibba013 bash[29418]: audit 2021-03-10T13:57:28.078456+0000 mon.b (mon.2) 6 : audit [INF] from='osd.5 [v2:172.21.2.120:6808/307822660,v1:172.21.2.120:6809/307822660]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:57:29.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:29 gibba013 bash[29418]: audit 2021-03-10T13:57:28.078750+0000 mon.a (mon.0) 489 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-03-10T13:57:29.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:29 gibba013 bash[29418]: cluster 2021-03-10T13:57:28.078789+0000 mon.a (mon.0) 490 : cluster [DBG] osdmap e90: 8 total, 7 up, 8 in 2021-03-10T13:57:29.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:29 gibba013 bash[29418]: audit 2021-03-10T13:57:28.080743+0000 mon.a (mon.0) 491 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:57:29.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:29 gibba013 bash[30381]: audit 2021-03-10T13:57:28.078456+0000 mon.b (mon.2) 6 : audit [INF] from='osd.5 [v2:172.21.2.120:6808/307822660,v1:172.21.2.120:6809/307822660]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:57:29.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:29 gibba013 bash[30381]: audit 2021-03-10T13:57:28.078750+0000 mon.a (mon.0) 489 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-03-10T13:57:29.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:29 gibba013 bash[30381]: cluster 2021-03-10T13:57:28.078789+0000 mon.a (mon.0) 490 : cluster [DBG] osdmap e90: 8 total, 7 up, 8 in 2021-03-10T13:57:29.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:29 gibba013 bash[30381]: audit 2021-03-10T13:57:28.080743+0000 mon.a (mon.0) 491 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:57:29.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:29 gibba020 bash[25448]: audit 2021-03-10T13:57:28.078456+0000 mon.b (mon.2) 6 : audit [INF] from='osd.5 [v2:172.21.2.120:6808/307822660,v1:172.21.2.120:6809/307822660]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:57:29.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:29 gibba020 bash[25448]: audit 2021-03-10T13:57:28.078750+0000 mon.a (mon.0) 489 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-03-10T13:57:29.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:29 gibba020 bash[25448]: cluster 2021-03-10T13:57:28.078789+0000 mon.a (mon.0) 490 : cluster [DBG] osdmap e90: 8 total, 7 up, 8 in 2021-03-10T13:57:29.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:29 gibba020 bash[25448]: audit 2021-03-10T13:57:28.080743+0000 mon.a (mon.0) 491 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:57:30.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:30 gibba013 bash[29418]: cluster 2021-03-10T13:57:28.513570+0000 mgr.gibba020.yqfnwy (mgr.34427) 270 : cluster [DBG] pgmap v133: 129 pgs: 12 active+undersized+degraded, 32 active+undersized, 85 active+clean; 7.0 KiB data, 40 MiB used, 670 GiB / 672 GiB avail; 17/192 objects degraded (8.854%) 2021-03-10T13:57:30.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:30 gibba013 bash[29418]: cluster 2021-03-10T13:57:29.078837+0000 mon.a (mon.0) 492 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:57:30.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:30 gibba013 bash[29418]: cluster 2021-03-10T13:57:29.089769+0000 mon.a (mon.0) 493 : cluster [INF] osd.5 [v2:172.21.2.120:6808/307822660,v1:172.21.2.120:6809/307822660] boot 2021-03-10T13:57:30.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:30 gibba013 bash[29418]: cluster 2021-03-10T13:57:29.089801+0000 mon.a (mon.0) 494 : cluster [DBG] osdmap e91: 8 total, 8 up, 8 in 2021-03-10T13:57:30.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:30 gibba013 bash[29418]: audit 2021-03-10T13:57:29.090260+0000 mon.a (mon.0) 495 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:57:30.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:30 gibba013 bash[29418]: cluster 2021-03-10T13:57:29.771538+0000 mon.a (mon.0) 496 : cluster [WRN] Health check update: Degraded data redundancy: 17/192 objects degraded (8.854%), 12 pgs degraded (PG_DEGRADED) 2021-03-10T13:57:30.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:30 gibba013 bash[30381]: cluster 2021-03-10T13:57:28.513570+0000 mgr.gibba020.yqfnwy (mgr.34427) 270 : cluster [DBG] pgmap v133: 129 pgs: 12 active+undersized+degraded, 32 active+undersized, 85 active+clean; 7.0 KiB data, 40 MiB used, 670 GiB / 672 GiB avail; 17/192 objects degraded (8.854%) 2021-03-10T13:57:30.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:30 gibba013 bash[30381]: cluster 2021-03-10T13:57:29.078837+0000 mon.a (mon.0) 492 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:57:30.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:30 gibba013 bash[30381]: cluster 2021-03-10T13:57:29.089769+0000 mon.a (mon.0) 493 : cluster [INF] osd.5 [v2:172.21.2.120:6808/307822660,v1:172.21.2.120:6809/307822660] boot 2021-03-10T13:57:30.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:30 gibba013 bash[30381]: cluster 2021-03-10T13:57:29.089801+0000 mon.a (mon.0) 494 : cluster [DBG] osdmap e91: 8 total, 8 up, 8 in 2021-03-10T13:57:30.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:30 gibba013 bash[30381]: audit 2021-03-10T13:57:29.090260+0000 mon.a (mon.0) 495 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:57:30.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:30 gibba013 bash[30381]: cluster 2021-03-10T13:57:29.771538+0000 mon.a (mon.0) 496 : cluster [WRN] Health check update: Degraded data redundancy: 17/192 objects degraded (8.854%), 12 pgs degraded (PG_DEGRADED) 2021-03-10T13:57:30.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:30 gibba020 bash[25448]: cluster 2021-03-10T13:57:28.513570+0000 mgr.gibba020.yqfnwy (mgr.34427) 270 : cluster [DBG] pgmap v133: 129 pgs: 12 active+undersized+degraded, 32 active+undersized, 85 active+clean; 7.0 KiB data, 40 MiB used, 670 GiB / 672 GiB avail; 17/192 objects degraded (8.854%) 2021-03-10T13:57:30.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:30 gibba020 bash[25448]: cluster 2021-03-10T13:57:29.078837+0000 mon.a (mon.0) 492 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:57:30.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:30 gibba020 bash[25448]: cluster 2021-03-10T13:57:29.089769+0000 mon.a (mon.0) 493 : cluster [INF] osd.5 [v2:172.21.2.120:6808/307822660,v1:172.21.2.120:6809/307822660] boot 2021-03-10T13:57:30.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:30 gibba020 bash[25448]: cluster 2021-03-10T13:57:29.089801+0000 mon.a (mon.0) 494 : cluster [DBG] osdmap e91: 8 total, 8 up, 8 in 2021-03-10T13:57:30.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:30 gibba020 bash[25448]: audit 2021-03-10T13:57:29.090260+0000 mon.a (mon.0) 495 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T13:57:30.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:30 gibba020 bash[25448]: cluster 2021-03-10T13:57:29.771538+0000 mon.a (mon.0) 496 : cluster [WRN] Health check update: Degraded data redundancy: 17/192 objects degraded (8.854%), 12 pgs degraded (PG_DEGRADED) 2021-03-10T13:57:31.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:31 gibba013 bash[29418]: cluster 2021-03-10T13:57:30.093237+0000 mon.a (mon.0) 497 : cluster [DBG] osdmap e92: 8 total, 8 up, 8 in 2021-03-10T13:57:31.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:31 gibba013 bash[30381]: cluster 2021-03-10T13:57:30.093237+0000 mon.a (mon.0) 497 : cluster [DBG] osdmap e92: 8 total, 8 up, 8 in 2021-03-10T13:57:31.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:31 gibba020 bash[25448]: cluster 2021-03-10T13:57:30.093237+0000 mon.a (mon.0) 497 : cluster [DBG] osdmap e92: 8 total, 8 up, 8 in 2021-03-10T13:57:32.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:32 gibba013 bash[29418]: cluster 2021-03-10T13:57:30.514979+0000 mgr.gibba020.yqfnwy (mgr.34427) 271 : cluster [DBG] pgmap v136: 129 pgs: 10 peering, 11 active+undersized+degraded, 23 active+undersized, 85 active+clean; 7.0 KiB data, 40 MiB used, 670 GiB / 672 GiB avail; 14/192 objects degraded (7.292%) 2021-03-10T13:57:32.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:32 gibba013 bash[30381]: cluster 2021-03-10T13:57:30.514979+0000 mgr.gibba020.yqfnwy (mgr.34427) 271 : cluster [DBG] pgmap v136: 129 pgs: 10 peering, 11 active+undersized+degraded, 23 active+undersized, 85 active+clean; 7.0 KiB data, 40 MiB used, 670 GiB / 672 GiB avail; 14/192 objects degraded (7.292%) 2021-03-10T13:57:32.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:32 gibba020 bash[25448]: cluster 2021-03-10T13:57:30.514979+0000 mgr.gibba020.yqfnwy (mgr.34427) 271 : cluster [DBG] pgmap v136: 129 pgs: 10 peering, 11 active+undersized+degraded, 23 active+undersized, 85 active+clean; 7.0 KiB data, 40 MiB used, 670 GiB / 672 GiB avail; 14/192 objects degraded (7.292%) 2021-03-10T13:57:34.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:34 gibba013 bash[29418]: cluster 2021-03-10T13:57:32.516939+0000 mgr.gibba020.yqfnwy (mgr.34427) 272 : cluster [DBG] pgmap v137: 129 pgs: 10 peering, 9 active+undersized+degraded, 12 active+undersized, 98 active+clean; 7.0 KiB data, 40 MiB used, 670 GiB / 672 GiB avail; 12/192 objects degraded (6.250%) 2021-03-10T13:57:34.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:34 gibba013 bash[30381]: cluster 2021-03-10T13:57:32.516939+0000 mgr.gibba020.yqfnwy (mgr.34427) 272 : cluster [DBG] pgmap v137: 129 pgs: 10 peering, 9 active+undersized+degraded, 12 active+undersized, 98 active+clean; 7.0 KiB data, 40 MiB used, 670 GiB / 672 GiB avail; 12/192 objects degraded (6.250%) 2021-03-10T13:57:34.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:34 gibba020 bash[25448]: cluster 2021-03-10T13:57:32.516939+0000 mgr.gibba020.yqfnwy (mgr.34427) 272 : cluster [DBG] pgmap v137: 129 pgs: 10 peering, 9 active+undersized+degraded, 12 active+undersized, 98 active+clean; 7.0 KiB data, 40 MiB used, 670 GiB / 672 GiB avail; 12/192 objects degraded (6.250%) 2021-03-10T13:57:35.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:35 gibba020 bash[25448]: cluster 2021-03-10T13:57:34.774126+0000 mon.a (mon.0) 498 : cluster [WRN] Health check update: Degraded data redundancy: 12/192 objects degraded (6.250%), 9 pgs degraded (PG_DEGRADED) 2021-03-10T13:57:35.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:35 gibba013 bash[29418]: cluster 2021-03-10T13:57:34.774126+0000 mon.a (mon.0) 498 : cluster [WRN] Health check update: Degraded data redundancy: 12/192 objects degraded (6.250%), 9 pgs degraded (PG_DEGRADED) 2021-03-10T13:57:35.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:35 gibba013 bash[30381]: cluster 2021-03-10T13:57:34.774126+0000 mon.a (mon.0) 498 : cluster [WRN] Health check update: Degraded data redundancy: 12/192 objects degraded (6.250%), 9 pgs degraded (PG_DEGRADED) 2021-03-10T13:57:36.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:36 gibba020 bash[25448]: cluster 2021-03-10T13:57:34.518390+0000 mgr.gibba020.yqfnwy (mgr.34427) 273 : cluster [DBG] pgmap v138: 129 pgs: 17 active+clean+wait, 10 peering, 102 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:57:36.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:36 gibba020 bash[25448]: cluster 2021-03-10T13:57:35.123005+0000 mon.a (mon.0) 499 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 12/192 objects degraded (6.250%), 9 pgs degraded) 2021-03-10T13:57:36.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:36 gibba013 bash[29418]: cluster 2021-03-10T13:57:34.518390+0000 mgr.gibba020.yqfnwy (mgr.34427) 273 : cluster [DBG] pgmap v138: 129 pgs: 17 active+clean+wait, 10 peering, 102 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:57:36.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:36 gibba013 bash[29418]: cluster 2021-03-10T13:57:35.123005+0000 mon.a (mon.0) 499 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 12/192 objects degraded (6.250%), 9 pgs degraded) 2021-03-10T13:57:36.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:36 gibba013 bash[30381]: cluster 2021-03-10T13:57:34.518390+0000 mgr.gibba020.yqfnwy (mgr.34427) 273 : cluster [DBG] pgmap v138: 129 pgs: 17 active+clean+wait, 10 peering, 102 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:57:36.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:36 gibba013 bash[30381]: cluster 2021-03-10T13:57:35.123005+0000 mon.a (mon.0) 499 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 12/192 objects degraded (6.250%), 9 pgs degraded) 2021-03-10T13:57:38.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:38 gibba020 bash[25448]: cluster 2021-03-10T13:57:36.520097+0000 mgr.gibba020.yqfnwy (mgr.34427) 274 : cluster [DBG] pgmap v139: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:57:38.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:38 gibba013 bash[29418]: cluster 2021-03-10T13:57:36.520097+0000 mgr.gibba020.yqfnwy (mgr.34427) 274 : cluster [DBG] pgmap v139: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:57:38.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:38 gibba013 bash[30381]: cluster 2021-03-10T13:57:36.520097+0000 mgr.gibba020.yqfnwy (mgr.34427) 274 : cluster [DBG] pgmap v139: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:57:40.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:40 gibba020 bash[25448]: cluster 2021-03-10T13:57:38.521713+0000 mgr.gibba020.yqfnwy (mgr.34427) 275 : cluster [DBG] pgmap v140: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:57:40.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:40 gibba020 bash[25448]: audit 2021-03-10T13:57:40.048038+0000 mon.a (mon.0) 500 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T13:57:40.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:40 gibba013 bash[29418]: cluster 2021-03-10T13:57:38.521713+0000 mgr.gibba020.yqfnwy (mgr.34427) 275 : cluster [DBG] pgmap v140: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:57:40.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:40 gibba013 bash[29418]: audit 2021-03-10T13:57:40.048038+0000 mon.a (mon.0) 500 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T13:57:40.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:40 gibba013 bash[30381]: cluster 2021-03-10T13:57:38.521713+0000 mgr.gibba020.yqfnwy (mgr.34427) 275 : cluster [DBG] pgmap v140: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:57:40.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:40 gibba013 bash[30381]: audit 2021-03-10T13:57:40.048038+0000 mon.a (mon.0) 500 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T13:57:41.397 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:41 gibba020 bash[25448]: audit 2021-03-10T13:57:40.046759+0000 mgr.gibba020.yqfnwy (mgr.34427) 276 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T13:57:41.398 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:41 gibba020 bash[25448]: cephadm 2021-03-10T13:57:40.049575+0000 mgr.gibba020.yqfnwy (mgr.34427) 277 : cephadm [INF] Upgrade: osd.6 is safe to restart 2021-03-10T13:57:41.398 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:41 gibba020 bash[25448]: audit 2021-03-10T13:57:40.910669+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:57:41.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:41 gibba013 bash[29418]: audit 2021-03-10T13:57:40.046759+0000 mgr.gibba020.yqfnwy (mgr.34427) 276 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T13:57:41.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:41 gibba013 bash[29418]: cephadm 2021-03-10T13:57:40.049575+0000 mgr.gibba020.yqfnwy (mgr.34427) 277 : cephadm [INF] Upgrade: osd.6 is safe to restart 2021-03-10T13:57:41.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:41 gibba013 bash[29418]: audit 2021-03-10T13:57:40.910669+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:57:41.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:41 gibba013 bash[30381]: audit 2021-03-10T13:57:40.046759+0000 mgr.gibba020.yqfnwy (mgr.34427) 276 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T13:57:41.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:41 gibba013 bash[30381]: cephadm 2021-03-10T13:57:40.049575+0000 mgr.gibba020.yqfnwy (mgr.34427) 277 : cephadm [INF] Upgrade: osd.6 is safe to restart 2021-03-10T13:57:41.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:41 gibba013 bash[30381]: audit 2021-03-10T13:57:40.910669+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:57:42.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:42 gibba020 bash[25448]: cluster 2021-03-10T13:57:40.523021+0000 mgr.gibba020.yqfnwy (mgr.34427) 278 : cluster [DBG] pgmap v141: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:57:42.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:42 gibba020 bash[25448]: audit 2021-03-10T13:57:41.853918+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:57:42.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:42 gibba020 bash[25448]: audit 2021-03-10T13:57:41.855602+0000 mon.a (mon.0) 503 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2021-03-10T13:57:42.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:42 gibba013 bash[29418]: cluster 2021-03-10T13:57:40.523021+0000 mgr.gibba020.yqfnwy (mgr.34427) 278 : cluster [DBG] pgmap v141: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:57:42.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:42 gibba013 bash[29418]: audit 2021-03-10T13:57:41.853918+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:57:42.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:42 gibba013 bash[29418]: audit 2021-03-10T13:57:41.855602+0000 mon.a (mon.0) 503 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2021-03-10T13:57:42.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:42 gibba013 bash[30381]: cluster 2021-03-10T13:57:40.523021+0000 mgr.gibba020.yqfnwy (mgr.34427) 278 : cluster [DBG] pgmap v141: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:57:42.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:42 gibba013 bash[30381]: audit 2021-03-10T13:57:41.853918+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:57:42.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:42 gibba013 bash[30381]: audit 2021-03-10T13:57:41.855602+0000 mon.a (mon.0) 503 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2021-03-10T13:57:43.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:43 gibba020 bash[25448]: cephadm 2021-03-10T13:57:41.847184+0000 mgr.gibba020.yqfnwy (mgr.34427) 279 : cephadm [INF] Upgrade: Updating osd.6 2021-03-10T13:57:43.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:43 gibba020 bash[25448]: cephadm 2021-03-10T13:57:41.853085+0000 mgr.gibba020.yqfnwy (mgr.34427) 280 : cephadm [INF] Deploying daemon osd.6 on gibba020 2021-03-10T13:57:43.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:43 gibba013 bash[29418]: cephadm 2021-03-10T13:57:41.847184+0000 mgr.gibba020.yqfnwy (mgr.34427) 279 : cephadm [INF] Upgrade: Updating osd.6 2021-03-10T13:57:43.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:43 gibba013 bash[29418]: cephadm 2021-03-10T13:57:41.853085+0000 mgr.gibba020.yqfnwy (mgr.34427) 280 : cephadm [INF] Deploying daemon osd.6 on gibba020 2021-03-10T13:57:43.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:43 gibba013 bash[30381]: cephadm 2021-03-10T13:57:41.847184+0000 mgr.gibba020.yqfnwy (mgr.34427) 279 : cephadm [INF] Upgrade: Updating osd.6 2021-03-10T13:57:43.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:43 gibba013 bash[30381]: cephadm 2021-03-10T13:57:41.853085+0000 mgr.gibba020.yqfnwy (mgr.34427) 280 : cephadm [INF] Deploying daemon osd.6 on gibba020 2021-03-10T13:57:43.923 INFO:journalctl@ceph.osd.6.gibba020.stdout:Mar 10 13:57:43 gibba020 systemd[1]: Stopping Ceph osd.6 for 7672acc8-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:57:43.923 INFO:journalctl@ceph.osd.6.gibba020.stdout:Mar 10 13:57:43 gibba020 bash[15161]: debug 2021-03-10T13:57:43.793+0000 7f6c45a26700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T13:57:43.923 INFO:journalctl@ceph.osd.6.gibba020.stdout:Mar 10 13:57:43 gibba020 bash[15161]: debug 2021-03-10T13:57:43.793+0000 7f6c45a26700 -1 osd.6 92 *** Got signal Terminated *** 2021-03-10T13:57:43.924 INFO:journalctl@ceph.osd.6.gibba020.stdout:Mar 10 13:57:43 gibba020 bash[15161]: debug 2021-03-10T13:57:43.793+0000 7f6c45a26700 -1 osd.6 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-03-10T13:57:44.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:44 gibba020 bash[25448]: cluster 2021-03-10T13:57:42.524705+0000 mgr.gibba020.yqfnwy (mgr.34427) 281 : cluster [DBG] pgmap v142: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:57:44.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:44 gibba020 bash[25448]: cluster 2021-03-10T13:57:43.905494+0000 mon.a (mon.0) 504 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T13:57:44.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:44 gibba020 bash[25448]: cluster 2021-03-10T13:57:43.905648+0000 mon.a (mon.0) 505 : cluster [INF] osd.6 failed (root=default,host=gibba020) (connection refused reported by osd.0) 2021-03-10T13:57:44.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:44 gibba020 bash[25448]: cluster 2021-03-10T13:57:43.906698+0000 mon.a (mon.0) 506 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T13:57:44.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:44 gibba020 bash[25448]: cluster 2021-03-10T13:57:43.907015+0000 mon.a (mon.0) 507 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T13:57:44.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:44 gibba020 bash[25448]: cluster 2021-03-10T13:57:43.907393+0000 mon.a (mon.0) 508 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T13:57:44.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:44 gibba020 bash[25448]: cluster 2021-03-10T13:57:43.907498+0000 mon.a (mon.0) 509 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T13:57:44.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:44 gibba020 bash[25448]: cluster 2021-03-10T13:57:43.907759+0000 mon.a (mon.0) 510 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T13:57:44.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:44 gibba020 bash[25448]: cluster 2021-03-10T13:57:43.907844+0000 mon.a (mon.0) 511 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T13:57:44.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:44 gibba020 bash[25448]: cluster 2021-03-10T13:57:43.908014+0000 mon.a (mon.0) 512 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T13:57:44.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:44 gibba020 bash[25448]: cluster 2021-03-10T13:57:44.017117+0000 mon.a (mon.0) 513 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T13:57:44.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:44 gibba020 bash[25448]: cluster 2021-03-10T13:57:44.108098+0000 mon.a (mon.0) 514 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-03-10T13:57:44.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:44 gibba020 bash[25448]: cluster 2021-03-10T13:57:44.108580+0000 mon.a (mon.0) 515 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T13:57:44.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:44 gibba020 bash[25448]: cluster 2021-03-10T13:57:44.109126+0000 mon.a (mon.0) 516 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-03-10T13:57:44.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:44 gibba020 bash[25448]: cluster 2021-03-10T13:57:44.109431+0000 mon.a (mon.0) 517 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T13:57:44.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:44 gibba020 bash[25448]: cluster 2021-03-10T13:57:44.109941+0000 mon.a (mon.0) 518 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T13:57:44.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:44 gibba020 bash[25448]: cluster 2021-03-10T13:57:44.110286+0000 mon.a (mon.0) 519 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T13:57:44.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:44 gibba020 bash[25448]: cluster 2021-03-10T13:57:44.110825+0000 mon.a (mon.0) 520 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T13:57:44.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:44 gibba020 bash[25448]: cluster 2021-03-10T13:57:44.111102+0000 mon.a (mon.0) 521 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T13:57:44.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:44 gibba020 bash[25448]: cluster 2021-03-10T13:57:44.111603+0000 mon.a (mon.0) 522 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T13:57:44.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:44 gibba020 bash[25448]: cluster 2021-03-10T13:57:44.111873+0000 mon.a (mon.0) 523 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T13:57:44.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:44 gibba020 bash[25448]: cluster 2021-03-10T13:57:44.112343+0000 mon.a (mon.0) 524 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T13:57:44.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:44 gibba020 bash[25448]: cluster 2021-03-10T13:57:44.112445+0000 mon.a (mon.0) 525 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T13:57:44.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:44 gibba020 bash[25448]: cluster 2021-03-10T13:57:44.112610+0000 mon.a (mon.0) 526 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T13:57:44.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:44 gibba020 bash[25448]: cluster 2021-03-10T13:57:44.112658+0000 mon.a (mon.0) 527 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T13:57:44.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[29418]: cluster 2021-03-10T13:57:42.524705+0000 mgr.gibba020.yqfnwy (mgr.34427) 281 : cluster [DBG] pgmap v142: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:57:44.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[29418]: cluster 2021-03-10T13:57:43.905494+0000 mon.a (mon.0) 504 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T13:57:44.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[29418]: cluster 2021-03-10T13:57:43.905648+0000 mon.a (mon.0) 505 : cluster [INF] osd.6 failed (root=default,host=gibba020) (connection refused reported by osd.0) 2021-03-10T13:57:44.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[29418]: cluster 2021-03-10T13:57:43.906698+0000 mon.a (mon.0) 506 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T13:57:44.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[29418]: cluster 2021-03-10T13:57:43.907015+0000 mon.a (mon.0) 507 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T13:57:44.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[29418]: cluster 2021-03-10T13:57:43.907393+0000 mon.a (mon.0) 508 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T13:57:44.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[29418]: cluster 2021-03-10T13:57:43.907498+0000 mon.a (mon.0) 509 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T13:57:44.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[29418]: cluster 2021-03-10T13:57:43.907759+0000 mon.a (mon.0) 510 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T13:57:44.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[29418]: cluster 2021-03-10T13:57:43.907844+0000 mon.a (mon.0) 511 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T13:57:44.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[29418]: cluster 2021-03-10T13:57:43.908014+0000 mon.a (mon.0) 512 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T13:57:44.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[29418]: cluster 2021-03-10T13:57:44.017117+0000 mon.a (mon.0) 513 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T13:57:44.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[29418]: cluster 2021-03-10T13:57:44.108098+0000 mon.a (mon.0) 514 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-03-10T13:57:44.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[29418]: cluster 2021-03-10T13:57:44.108580+0000 mon.a (mon.0) 515 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T13:57:44.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[29418]: cluster 2021-03-10T13:57:44.109126+0000 mon.a (mon.0) 516 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-03-10T13:57:44.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[29418]: cluster 2021-03-10T13:57:44.109431+0000 mon.a (mon.0) 517 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T13:57:44.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[29418]: cluster 2021-03-10T13:57:44.109941+0000 mon.a (mon.0) 518 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T13:57:44.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[29418]: cluster 2021-03-10T13:57:44.110286+0000 mon.a (mon.0) 519 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T13:57:44.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[29418]: cluster 2021-03-10T13:57:44.110825+0000 mon.a (mon.0) 520 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T13:57:44.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[29418]: cluster 2021-03-10T13:57:44.111102+0000 mon.a (mon.0) 521 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T13:57:44.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[29418]: cluster 2021-03-10T13:57:44.111603+0000 mon.a (mon.0) 522 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T13:57:44.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[29418]: cluster 2021-03-10T13:57:44.111873+0000 mon.a (mon.0) 523 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T13:57:44.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[29418]: cluster 2021-03-10T13:57:44.112343+0000 mon.a (mon.0) 524 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T13:57:44.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[29418]: cluster 2021-03-10T13:57:44.112445+0000 mon.a (mon.0) 525 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T13:57:44.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[29418]: cluster 2021-03-10T13:57:44.112610+0000 mon.a (mon.0) 526 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T13:57:44.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[29418]: cluster 2021-03-10T13:57:44.112658+0000 mon.a (mon.0) 527 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T13:57:44.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[30381]: cluster 2021-03-10T13:57:42.524705+0000 mgr.gibba020.yqfnwy (mgr.34427) 281 : cluster [DBG] pgmap v142: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:57:44.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[30381]: cluster 2021-03-10T13:57:43.905494+0000 mon.a (mon.0) 504 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T13:57:44.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[30381]: cluster 2021-03-10T13:57:43.905648+0000 mon.a (mon.0) 505 : cluster [INF] osd.6 failed (root=default,host=gibba020) (connection refused reported by osd.0) 2021-03-10T13:57:44.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[30381]: cluster 2021-03-10T13:57:43.906698+0000 mon.a (mon.0) 506 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T13:57:44.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[30381]: cluster 2021-03-10T13:57:43.907015+0000 mon.a (mon.0) 507 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T13:57:44.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[30381]: cluster 2021-03-10T13:57:43.907393+0000 mon.a (mon.0) 508 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T13:57:44.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[30381]: cluster 2021-03-10T13:57:43.907498+0000 mon.a (mon.0) 509 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T13:57:44.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[30381]: cluster 2021-03-10T13:57:43.907759+0000 mon.a (mon.0) 510 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T13:57:44.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[30381]: cluster 2021-03-10T13:57:43.907844+0000 mon.a (mon.0) 511 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T13:57:44.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[30381]: cluster 2021-03-10T13:57:43.908014+0000 mon.a (mon.0) 512 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T13:57:44.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[30381]: cluster 2021-03-10T13:57:44.017117+0000 mon.a (mon.0) 513 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T13:57:44.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[30381]: cluster 2021-03-10T13:57:44.108098+0000 mon.a (mon.0) 514 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-03-10T13:57:44.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[30381]: cluster 2021-03-10T13:57:44.108580+0000 mon.a (mon.0) 515 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T13:57:44.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[30381]: cluster 2021-03-10T13:57:44.109126+0000 mon.a (mon.0) 516 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-03-10T13:57:44.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[30381]: cluster 2021-03-10T13:57:44.109431+0000 mon.a (mon.0) 517 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T13:57:44.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[30381]: cluster 2021-03-10T13:57:44.109941+0000 mon.a (mon.0) 518 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T13:57:44.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[30381]: cluster 2021-03-10T13:57:44.110286+0000 mon.a (mon.0) 519 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T13:57:44.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[30381]: cluster 2021-03-10T13:57:44.110825+0000 mon.a (mon.0) 520 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-03-10T13:57:44.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[30381]: cluster 2021-03-10T13:57:44.111102+0000 mon.a (mon.0) 521 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-03-10T13:57:44.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[30381]: cluster 2021-03-10T13:57:44.111603+0000 mon.a (mon.0) 522 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T13:57:44.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[30381]: cluster 2021-03-10T13:57:44.111873+0000 mon.a (mon.0) 523 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T13:57:44.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[30381]: cluster 2021-03-10T13:57:44.112343+0000 mon.a (mon.0) 524 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T13:57:44.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[30381]: cluster 2021-03-10T13:57:44.112445+0000 mon.a (mon.0) 525 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-03-10T13:57:44.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[30381]: cluster 2021-03-10T13:57:44.112610+0000 mon.a (mon.0) 526 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-03-10T13:57:44.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:44 gibba013 bash[30381]: cluster 2021-03-10T13:57:44.112658+0000 mon.a (mon.0) 527 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-03-10T13:57:44.947 INFO:journalctl@ceph.osd.6.gibba020.stdout:Mar 10 13:57:44 gibba020 docker[29440]: ceph-7672acc8-81a6-11eb-9080-001a4aab830c-osd.6 2021-03-10T13:57:45.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:45 gibba020 bash[25448]: cluster 2021-03-10T13:57:44.185536+0000 mon.a (mon.0) 528 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:57:45.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:45 gibba020 bash[25448]: cluster 2021-03-10T13:57:44.197129+0000 mon.a (mon.0) 529 : cluster [DBG] osdmap e93: 8 total, 7 up, 8 in 2021-03-10T13:57:45.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:45 gibba013 bash[29418]: cluster 2021-03-10T13:57:44.185536+0000 mon.a (mon.0) 528 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:57:45.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:45 gibba013 bash[29418]: cluster 2021-03-10T13:57:44.197129+0000 mon.a (mon.0) 529 : cluster [DBG] osdmap e93: 8 total, 7 up, 8 in 2021-03-10T13:57:45.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:45 gibba013 bash[30381]: cluster 2021-03-10T13:57:44.185536+0000 mon.a (mon.0) 528 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:57:45.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:45 gibba013 bash[30381]: cluster 2021-03-10T13:57:44.197129+0000 mon.a (mon.0) 529 : cluster [DBG] osdmap e93: 8 total, 7 up, 8 in 2021-03-10T13:57:46.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:46 gibba020 bash[25448]: cluster 2021-03-10T13:57:44.525764+0000 mgr.gibba020.yqfnwy (mgr.34427) 282 : cluster [DBG] pgmap v144: 129 pgs: 13 stale+active+clean, 17 active+clean+wait, 99 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:57:46.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:46 gibba020 bash[25448]: cluster 2021-03-10T13:57:45.202734+0000 mon.a (mon.0) 530 : cluster [DBG] osdmap e94: 8 total, 7 up, 8 in 2021-03-10T13:57:46.459 INFO:journalctl@ceph.osd.6.gibba020.stdout:Mar 10 13:57:46 gibba020 systemd[1]: ceph-7672acc8-81a6-11eb-9080-001a4aab830c@osd.6.service: Succeeded. 2021-03-10T13:57:46.460 INFO:journalctl@ceph.osd.6.gibba020.stdout:Mar 10 13:57:46 gibba020 systemd[1]: Stopped Ceph osd.6 for 7672acc8-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:57:46.627 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:46 gibba013 bash[30381]: cluster 2021-03-10T13:57:44.525764+0000 mgr.gibba020.yqfnwy (mgr.34427) 282 : cluster [DBG] pgmap v144: 129 pgs: 13 stale+active+clean, 17 active+clean+wait, 99 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:57:46.627 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:46 gibba013 bash[30381]: cluster 2021-03-10T13:57:45.202734+0000 mon.a (mon.0) 530 : cluster [DBG] osdmap e94: 8 total, 7 up, 8 in 2021-03-10T13:57:46.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:46 gibba013 bash[29418]: cluster 2021-03-10T13:57:44.525764+0000 mgr.gibba020.yqfnwy (mgr.34427) 282 : cluster [DBG] pgmap v144: 129 pgs: 13 stale+active+clean, 17 active+clean+wait, 99 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T13:57:46.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:46 gibba013 bash[29418]: cluster 2021-03-10T13:57:45.202734+0000 mon.a (mon.0) 530 : cluster [DBG] osdmap e94: 8 total, 7 up, 8 in 2021-03-10T13:57:46.948 INFO:journalctl@ceph.osd.6.gibba020.stdout:Mar 10 13:57:46 gibba020 systemd[1]: Started Ceph osd.6 for 7672acc8-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:57:47.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:47 gibba013 bash[29418]: cluster 2021-03-10T13:57:46.526282+0000 mgr.gibba020.yqfnwy (mgr.34427) 283 : cluster [DBG] pgmap v146: 129 pgs: 11 stale+active+clean, 1 active+undersized+degraded, 4 peering, 17 active+clean+wait, 6 active+undersized, 90 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 2/192 objects degraded (1.042%) 2021-03-10T13:57:47.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:47 gibba013 bash[29418]: audit 2021-03-10T13:57:46.611553+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:57:47.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:47 gibba013 bash[29418]: cephadm 2021-03-10T13:57:46.611569+0000 mgr.gibba020.yqfnwy (mgr.34427) 284 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T13:57:47.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:47 gibba013 bash[29418]: audit 2021-03-10T13:57:46.612347+0000 mon.a (mon.0) 532 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:57:47.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:47 gibba013 bash[29418]: audit 2021-03-10T13:57:46.614035+0000 mon.a (mon.0) 533 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:57:47.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:47 gibba013 bash[29418]: cluster 2021-03-10T13:57:47.205636+0000 mon.a (mon.0) 534 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T13:57:47.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:47 gibba013 bash[29418]: cluster 2021-03-10T13:57:47.205722+0000 mon.a (mon.0) 535 : cluster [WRN] Health check failed: Degraded data redundancy: 2/192 objects degraded (1.042%), 1 pg degraded (PG_DEGRADED) 2021-03-10T13:57:47.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:47 gibba013 bash[30381]: cluster 2021-03-10T13:57:46.526282+0000 mgr.gibba020.yqfnwy (mgr.34427) 283 : cluster [DBG] pgmap v146: 129 pgs: 11 stale+active+clean, 1 active+undersized+degraded, 4 peering, 17 active+clean+wait, 6 active+undersized, 90 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 2/192 objects degraded (1.042%) 2021-03-10T13:57:47.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:47 gibba013 bash[30381]: audit 2021-03-10T13:57:46.611553+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:57:47.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:47 gibba013 bash[30381]: cephadm 2021-03-10T13:57:46.611569+0000 mgr.gibba020.yqfnwy (mgr.34427) 284 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T13:57:47.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:47 gibba013 bash[30381]: audit 2021-03-10T13:57:46.612347+0000 mon.a (mon.0) 532 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:57:47.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:47 gibba013 bash[30381]: audit 2021-03-10T13:57:46.614035+0000 mon.a (mon.0) 533 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:57:47.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:47 gibba013 bash[30381]: cluster 2021-03-10T13:57:47.205636+0000 mon.a (mon.0) 534 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T13:57:47.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:47 gibba013 bash[30381]: cluster 2021-03-10T13:57:47.205722+0000 mon.a (mon.0) 535 : cluster [WRN] Health check failed: Degraded data redundancy: 2/192 objects degraded (1.042%), 1 pg degraded (PG_DEGRADED) 2021-03-10T13:57:47.882 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:47 gibba020 bash[25448]: cluster 2021-03-10T13:57:46.526282+0000 mgr.gibba020.yqfnwy (mgr.34427) 283 : cluster [DBG] pgmap v146: 129 pgs: 11 stale+active+clean, 1 active+undersized+degraded, 4 peering, 17 active+clean+wait, 6 active+undersized, 90 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 2/192 objects degraded (1.042%) 2021-03-10T13:57:47.882 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:47 gibba020 bash[25448]: audit 2021-03-10T13:57:46.611553+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:57:47.882 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:47 gibba020 bash[25448]: cephadm 2021-03-10T13:57:46.611569+0000 mgr.gibba020.yqfnwy (mgr.34427) 284 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T13:57:47.882 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:47 gibba020 bash[25448]: audit 2021-03-10T13:57:46.612347+0000 mon.a (mon.0) 532 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:57:47.882 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:47 gibba020 bash[25448]: audit 2021-03-10T13:57:46.614035+0000 mon.a (mon.0) 533 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:57:47.883 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:47 gibba020 bash[25448]: cluster 2021-03-10T13:57:47.205636+0000 mon.a (mon.0) 534 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T13:57:47.883 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:47 gibba020 bash[25448]: cluster 2021-03-10T13:57:47.205722+0000 mon.a (mon.0) 535 : cluster [WRN] Health check failed: Degraded data redundancy: 2/192 objects degraded (1.042%), 1 pg degraded (PG_DEGRADED) 2021-03-10T13:57:48.198 INFO:journalctl@ceph.osd.6.gibba020.stdout:Mar 10 13:57:47 gibba020 bash[29614]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-03-10T13:57:48.198 INFO:journalctl@ceph.osd.6.gibba020.stdout:Mar 10 13:57:47 gibba020 bash[29614]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-6 --no-mon-config 2021-03-10T13:57:48.198 INFO:journalctl@ceph.osd.6.gibba020.stdout:Mar 10 13:57:47 gibba020 bash[29614]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6/block 2021-03-10T13:57:48.199 INFO:journalctl@ceph.osd.6.gibba020.stdout:Mar 10 13:57:47 gibba020 bash[29614]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-6/block 2021-03-10T13:57:48.199 INFO:journalctl@ceph.osd.6.gibba020.stdout:Mar 10 13:57:47 gibba020 bash[29614]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2021-03-10T13:57:48.199 INFO:journalctl@ceph.osd.6.gibba020.stdout:Mar 10 13:57:47 gibba020 bash[29614]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-03-10T13:57:48.199 INFO:journalctl@ceph.osd.6.gibba020.stdout:Mar 10 13:57:47 gibba020 bash[29614]: --> ceph-volume lvm activate successful for osd ID: 6 2021-03-10T13:57:49.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:49 gibba020 bash[25448]: cluster 2021-03-10T13:57:48.528087+0000 mgr.gibba020.yqfnwy (mgr.34427) 285 : cluster [DBG] pgmap v147: 129 pgs: 12 active+undersized+degraded, 4 peering, 27 active+undersized, 86 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 17/192 objects degraded (8.854%) 2021-03-10T13:57:49.698 INFO:journalctl@ceph.osd.6.gibba020.stdout:Mar 10 13:57:49 gibba020 bash[29747]: debug 2021-03-10T13:57:49.465+0000 7fa94db67700 1 -- 172.21.2.120:0/2582999296 <== mon.2 v2:172.21.2.120:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d5517804e0 con 0x55d5517fcc00 2021-03-10T13:57:49.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:49 gibba013 bash[29418]: cluster 2021-03-10T13:57:48.528087+0000 mgr.gibba020.yqfnwy (mgr.34427) 285 : cluster [DBG] pgmap v147: 129 pgs: 12 active+undersized+degraded, 4 peering, 27 active+undersized, 86 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 17/192 objects degraded (8.854%) 2021-03-10T13:57:49.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:49 gibba013 bash[30381]: cluster 2021-03-10T13:57:48.528087+0000 mgr.gibba020.yqfnwy (mgr.34427) 285 : cluster [DBG] pgmap v147: 129 pgs: 12 active+undersized+degraded, 4 peering, 27 active+undersized, 86 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 17/192 objects degraded (8.854%) 2021-03-10T13:57:50.447 INFO:journalctl@ceph.osd.6.gibba020.stdout:Mar 10 13:57:50 gibba020 bash[29747]: debug 2021-03-10T13:57:50.057+0000 7fa9555fc080 -1 Falling back to public interface 2021-03-10T13:57:51.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:51 gibba013 bash[29418]: cephadm 2021-03-10T13:57:50.468208+0000 mgr.gibba020.yqfnwy (mgr.34427) 286 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T13:57:51.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:51 gibba013 bash[29418]: audit 2021-03-10T13:57:50.469733+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:57:51.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:51 gibba013 bash[29418]: cluster 2021-03-10T13:57:50.528609+0000 mgr.gibba020.yqfnwy (mgr.34427) 287 : cluster [DBG] pgmap v148: 129 pgs: 14 active+undersized+degraded, 29 active+undersized, 86 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 22/192 objects degraded (11.458%) 2021-03-10T13:57:51.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:51 gibba013 bash[29418]: audit 2021-03-10T13:57:50.669997+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:57:51.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:51 gibba013 bash[29418]: cephadm 2021-03-10T13:57:50.670470+0000 mgr.gibba020.yqfnwy (mgr.34427) 288 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:57:51.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:51 gibba013 bash[29418]: audit 2021-03-10T13:57:50.673515+0000 mon.a (mon.0) 538 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:57:51.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:51 gibba013 bash[29418]: cephadm 2021-03-10T13:57:50.673951+0000 mgr.gibba020.yqfnwy (mgr.34427) 289 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:57:51.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:51 gibba013 bash[29418]: cephadm 2021-03-10T13:57:50.676645+0000 mgr.gibba020.yqfnwy (mgr.34427) 290 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:57:51.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:51 gibba013 bash[29418]: cephadm 2021-03-10T13:57:50.676682+0000 mgr.gibba020.yqfnwy (mgr.34427) 291 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:57:51.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:51 gibba013 bash[29418]: audit 2021-03-10T13:57:50.676996+0000 mon.a (mon.0) 539 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:51.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:51 gibba013 bash[29418]: cephadm 2021-03-10T13:57:50.679470+0000 mgr.gibba020.yqfnwy (mgr.34427) 292 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:57:51.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:51 gibba013 bash[29418]: cephadm 2021-03-10T13:57:50.679511+0000 mgr.gibba020.yqfnwy (mgr.34427) 293 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:57:51.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:51 gibba013 bash[29418]: audit 2021-03-10T13:57:50.679669+0000 mon.a (mon.0) 540 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:51.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:51 gibba013 bash[29418]: audit 2021-03-10T13:57:50.682343+0000 mon.a (mon.0) 541 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:51.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:51 gibba013 bash[29418]: cephadm 2021-03-10T13:57:50.682564+0000 mgr.gibba020.yqfnwy (mgr.34427) 294 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:57:51.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:51 gibba013 bash[29418]: cephadm 2021-03-10T13:57:50.686325+0000 mgr.gibba020.yqfnwy (mgr.34427) 295 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:57:51.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:51 gibba013 bash[29418]: cephadm 2021-03-10T13:57:50.686812+0000 mgr.gibba020.yqfnwy (mgr.34427) 296 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:57:51.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:51 gibba013 bash[29418]: audit 2021-03-10T13:57:50.689470+0000 mgr.gibba020.yqfnwy (mgr.34427) 297 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T13:57:51.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:51 gibba013 bash[29418]: audit 2021-03-10T13:57:50.690996+0000 mon.a (mon.0) 542 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T13:57:51.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:51 gibba013 bash[29418]: cephadm 2021-03-10T13:57:50.692666+0000 mgr.gibba020.yqfnwy (mgr.34427) 298 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2021-03-10T13:57:51.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:51 gibba013 bash[30381]: cephadm 2021-03-10T13:57:50.468208+0000 mgr.gibba020.yqfnwy (mgr.34427) 286 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T13:57:51.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:51 gibba013 bash[30381]: audit 2021-03-10T13:57:50.469733+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:57:51.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:51 gibba013 bash[30381]: cluster 2021-03-10T13:57:50.528609+0000 mgr.gibba020.yqfnwy (mgr.34427) 287 : cluster [DBG] pgmap v148: 129 pgs: 14 active+undersized+degraded, 29 active+undersized, 86 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 22/192 objects degraded (11.458%) 2021-03-10T13:57:51.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:51 gibba013 bash[30381]: audit 2021-03-10T13:57:50.669997+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:57:51.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:51 gibba013 bash[30381]: cephadm 2021-03-10T13:57:50.670470+0000 mgr.gibba020.yqfnwy (mgr.34427) 288 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:57:51.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:51 gibba013 bash[30381]: audit 2021-03-10T13:57:50.673515+0000 mon.a (mon.0) 538 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:57:51.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:51 gibba013 bash[30381]: cephadm 2021-03-10T13:57:50.673951+0000 mgr.gibba020.yqfnwy (mgr.34427) 289 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:57:51.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:51 gibba013 bash[30381]: cephadm 2021-03-10T13:57:50.676645+0000 mgr.gibba020.yqfnwy (mgr.34427) 290 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:57:51.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:51 gibba013 bash[30381]: cephadm 2021-03-10T13:57:50.676682+0000 mgr.gibba020.yqfnwy (mgr.34427) 291 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:57:51.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:51 gibba013 bash[30381]: audit 2021-03-10T13:57:50.676996+0000 mon.a (mon.0) 539 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:51.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:51 gibba013 bash[30381]: cephadm 2021-03-10T13:57:50.679470+0000 mgr.gibba020.yqfnwy (mgr.34427) 292 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:57:51.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:51 gibba013 bash[30381]: cephadm 2021-03-10T13:57:50.679511+0000 mgr.gibba020.yqfnwy (mgr.34427) 293 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:57:51.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:51 gibba013 bash[30381]: audit 2021-03-10T13:57:50.679669+0000 mon.a (mon.0) 540 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:51.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:51 gibba013 bash[30381]: audit 2021-03-10T13:57:50.682343+0000 mon.a (mon.0) 541 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:51.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:51 gibba013 bash[30381]: cephadm 2021-03-10T13:57:50.682564+0000 mgr.gibba020.yqfnwy (mgr.34427) 294 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:57:51.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:51 gibba013 bash[30381]: cephadm 2021-03-10T13:57:50.686325+0000 mgr.gibba020.yqfnwy (mgr.34427) 295 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:57:51.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:51 gibba013 bash[30381]: cephadm 2021-03-10T13:57:50.686812+0000 mgr.gibba020.yqfnwy (mgr.34427) 296 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:57:51.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:51 gibba013 bash[30381]: audit 2021-03-10T13:57:50.689470+0000 mgr.gibba020.yqfnwy (mgr.34427) 297 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T13:57:51.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:51 gibba013 bash[30381]: audit 2021-03-10T13:57:50.690996+0000 mon.a (mon.0) 542 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T13:57:51.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:51 gibba013 bash[30381]: cephadm 2021-03-10T13:57:50.692666+0000 mgr.gibba020.yqfnwy (mgr.34427) 298 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2021-03-10T13:57:51.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:51 gibba020 bash[25448]: cephadm 2021-03-10T13:57:50.468208+0000 mgr.gibba020.yqfnwy (mgr.34427) 286 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T13:57:51.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:51 gibba020 bash[25448]: audit 2021-03-10T13:57:50.469733+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:57:51.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:51 gibba020 bash[25448]: cluster 2021-03-10T13:57:50.528609+0000 mgr.gibba020.yqfnwy (mgr.34427) 287 : cluster [DBG] pgmap v148: 129 pgs: 14 active+undersized+degraded, 29 active+undersized, 86 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 22/192 objects degraded (11.458%) 2021-03-10T13:57:51.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:51 gibba020 bash[25448]: audit 2021-03-10T13:57:50.669997+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:57:51.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:51 gibba020 bash[25448]: cephadm 2021-03-10T13:57:50.670470+0000 mgr.gibba020.yqfnwy (mgr.34427) 288 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:57:51.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:51 gibba020 bash[25448]: audit 2021-03-10T13:57:50.673515+0000 mon.a (mon.0) 538 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:57:51.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:51 gibba020 bash[25448]: cephadm 2021-03-10T13:57:50.673951+0000 mgr.gibba020.yqfnwy (mgr.34427) 289 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:57:51.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:51 gibba020 bash[25448]: cephadm 2021-03-10T13:57:50.676645+0000 mgr.gibba020.yqfnwy (mgr.34427) 290 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:57:51.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:51 gibba020 bash[25448]: cephadm 2021-03-10T13:57:50.676682+0000 mgr.gibba020.yqfnwy (mgr.34427) 291 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:57:51.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:51 gibba020 bash[25448]: audit 2021-03-10T13:57:50.676996+0000 mon.a (mon.0) 539 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:51.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:51 gibba020 bash[25448]: cephadm 2021-03-10T13:57:50.679470+0000 mgr.gibba020.yqfnwy (mgr.34427) 292 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:57:51.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:51 gibba020 bash[25448]: cephadm 2021-03-10T13:57:50.679511+0000 mgr.gibba020.yqfnwy (mgr.34427) 293 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:57:51.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:51 gibba020 bash[25448]: audit 2021-03-10T13:57:50.679669+0000 mon.a (mon.0) 540 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:51.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:51 gibba020 bash[25448]: audit 2021-03-10T13:57:50.682343+0000 mon.a (mon.0) 541 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:51.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:51 gibba020 bash[25448]: cephadm 2021-03-10T13:57:50.682564+0000 mgr.gibba020.yqfnwy (mgr.34427) 294 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:57:51.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:51 gibba020 bash[25448]: cephadm 2021-03-10T13:57:50.686325+0000 mgr.gibba020.yqfnwy (mgr.34427) 295 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:57:51.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:51 gibba020 bash[25448]: cephadm 2021-03-10T13:57:50.686812+0000 mgr.gibba020.yqfnwy (mgr.34427) 296 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:57:51.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:51 gibba020 bash[25448]: audit 2021-03-10T13:57:50.689470+0000 mgr.gibba020.yqfnwy (mgr.34427) 297 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T13:57:51.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:51 gibba020 bash[25448]: audit 2021-03-10T13:57:50.690996+0000 mon.a (mon.0) 542 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T13:57:51.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:51 gibba020 bash[25448]: cephadm 2021-03-10T13:57:50.692666+0000 mgr.gibba020.yqfnwy (mgr.34427) 298 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2021-03-10T13:57:52.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:52 gibba013 bash[29418]: cluster 2021-03-10T13:57:51.464561+0000 mon.a (mon.0) 543 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T13:57:52.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:52 gibba013 bash[30381]: cluster 2021-03-10T13:57:51.464561+0000 mon.a (mon.0) 543 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T13:57:52.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:52 gibba020 bash[25448]: cluster 2021-03-10T13:57:51.464561+0000 mon.a (mon.0) 543 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T13:57:53.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:53 gibba020 bash[25448]: cluster 2021-03-10T13:57:52.529408+0000 mgr.gibba020.yqfnwy (mgr.34427) 299 : cluster [DBG] pgmap v149: 129 pgs: 14 active+undersized+degraded, 29 active+undersized, 86 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 22/192 objects degraded (11.458%) 2021-03-10T13:57:53.698 INFO:journalctl@ceph.osd.6.gibba020.stdout:Mar 10 13:57:53 gibba020 bash[29747]: debug 2021-03-10T13:57:53.353+0000 7fa9555fc080 -1 bluestore(/var/lib/ceph/osd/ceph-6) fsck warning: store not yet converted to per-pg omap 2021-03-10T13:57:53.699 INFO:journalctl@ceph.osd.6.gibba020.stdout:Mar 10 13:57:53 gibba020 bash[29747]: debug 2021-03-10T13:57:53.353+0000 7fa9420c4700 -1 bluestore(/var/lib/ceph/osd/ceph-6) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2021-03-10T13:57:53.699 INFO:journalctl@ceph.osd.6.gibba020.stdout:Mar 10 13:57:53 gibba020 bash[29747]: debug 2021-03-10T13:57:53.353+0000 7fa9420c4700 -1 bluestore(/var/lib/ceph/osd/ceph-6) fsck warning: #1:7baad65a:::INTEL_SSDPEL1K375GA_PHKM9200001J375A:head# has omap that is not per-pg or pgmeta 2021-03-10T13:57:53.699 INFO:journalctl@ceph.osd.6.gibba020.stdout:Mar 10 13:57:53 gibba020 bash[29747]: debug 2021-03-10T13:57:53.481+0000 7fa9555fc080 -1 osd.6 92 log_to_monitors {default=true} 2021-03-10T13:57:53.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:53 gibba013 bash[29418]: cluster 2021-03-10T13:57:52.529408+0000 mgr.gibba020.yqfnwy (mgr.34427) 299 : cluster [DBG] pgmap v149: 129 pgs: 14 active+undersized+degraded, 29 active+undersized, 86 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 22/192 objects degraded (11.458%) 2021-03-10T13:57:53.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:53 gibba013 bash[30381]: cluster 2021-03-10T13:57:52.529408+0000 mgr.gibba020.yqfnwy (mgr.34427) 299 : cluster [DBG] pgmap v149: 129 pgs: 14 active+undersized+degraded, 29 active+undersized, 86 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 22/192 objects degraded (11.458%) 2021-03-10T13:57:54.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:54 gibba013 bash[29418]: audit 2021-03-10T13:57:53.488522+0000 mon.b (mon.2) 7 : audit [INF] from='osd.6 [v2:172.21.2.120:6816/2087279929,v1:172.21.2.120:6817/2087279929]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T13:57:54.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:54 gibba013 bash[29418]: audit 2021-03-10T13:57:53.493267+0000 mon.a (mon.0) 544 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T13:57:54.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:54 gibba013 bash[30381]: audit 2021-03-10T13:57:53.488522+0000 mon.b (mon.2) 7 : audit [INF] from='osd.6 [v2:172.21.2.120:6816/2087279929,v1:172.21.2.120:6817/2087279929]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T13:57:54.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:54 gibba013 bash[30381]: audit 2021-03-10T13:57:53.493267+0000 mon.a (mon.0) 544 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T13:57:54.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:54 gibba020 bash[25448]: audit 2021-03-10T13:57:53.488522+0000 mon.b (mon.2) 7 : audit [INF] from='osd.6 [v2:172.21.2.120:6816/2087279929,v1:172.21.2.120:6817/2087279929]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T13:57:54.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:54 gibba020 bash[25448]: audit 2021-03-10T13:57:53.493267+0000 mon.a (mon.0) 544 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T13:57:54.948 INFO:journalctl@ceph.osd.6.gibba020.stdout:Mar 10 13:57:54 gibba020 bash[29747]: debug 2021-03-10T13:57:54.509+0000 7fa9482df700 -1 osd.6 92 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:57:55.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:55 gibba013 bash[29418]: audit 2021-03-10T13:57:54.503565+0000 mon.b (mon.2) 8 : audit [INF] from='osd.6 [v2:172.21.2.120:6816/2087279929,v1:172.21.2.120:6817/2087279929]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:57:55.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:55 gibba013 bash[29418]: audit 2021-03-10T13:57:54.503704+0000 mon.a (mon.0) 545 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-03-10T13:57:55.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:55 gibba013 bash[29418]: cluster 2021-03-10T13:57:54.504002+0000 mon.a (mon.0) 546 : cluster [DBG] osdmap e95: 8 total, 7 up, 8 in 2021-03-10T13:57:55.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:55 gibba013 bash[29418]: audit 2021-03-10T13:57:54.508636+0000 mon.a (mon.0) 547 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:57:55.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:55 gibba013 bash[29418]: cluster 2021-03-10T13:57:54.529762+0000 mgr.gibba020.yqfnwy (mgr.34427) 300 : cluster [DBG] pgmap v151: 129 pgs: 14 active+undersized+degraded, 29 active+undersized, 86 active+clean; 7.0 KiB data, 46 MiB used, 671 GiB / 672 GiB avail; 22/192 objects degraded (11.458%) 2021-03-10T13:57:55.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:55 gibba013 bash[29418]: cluster 2021-03-10T13:57:54.784286+0000 mon.a (mon.0) 548 : cluster [WRN] Health check update: Degraded data redundancy: 22/192 objects degraded (11.458%), 14 pgs degraded (PG_DEGRADED) 2021-03-10T13:57:55.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:55 gibba013 bash[30381]: audit 2021-03-10T13:57:54.503565+0000 mon.b (mon.2) 8 : audit [INF] from='osd.6 [v2:172.21.2.120:6816/2087279929,v1:172.21.2.120:6817/2087279929]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:57:55.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:55 gibba013 bash[30381]: audit 2021-03-10T13:57:54.503704+0000 mon.a (mon.0) 545 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-03-10T13:57:55.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:55 gibba013 bash[30381]: cluster 2021-03-10T13:57:54.504002+0000 mon.a (mon.0) 546 : cluster [DBG] osdmap e95: 8 total, 7 up, 8 in 2021-03-10T13:57:55.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:55 gibba013 bash[30381]: audit 2021-03-10T13:57:54.508636+0000 mon.a (mon.0) 547 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:57:55.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:55 gibba013 bash[30381]: cluster 2021-03-10T13:57:54.529762+0000 mgr.gibba020.yqfnwy (mgr.34427) 300 : cluster [DBG] pgmap v151: 129 pgs: 14 active+undersized+degraded, 29 active+undersized, 86 active+clean; 7.0 KiB data, 46 MiB used, 671 GiB / 672 GiB avail; 22/192 objects degraded (11.458%) 2021-03-10T13:57:55.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:55 gibba013 bash[30381]: cluster 2021-03-10T13:57:54.784286+0000 mon.a (mon.0) 548 : cluster [WRN] Health check update: Degraded data redundancy: 22/192 objects degraded (11.458%), 14 pgs degraded (PG_DEGRADED) 2021-03-10T13:57:55.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:55 gibba020 bash[25448]: audit 2021-03-10T13:57:54.503565+0000 mon.b (mon.2) 8 : audit [INF] from='osd.6 [v2:172.21.2.120:6816/2087279929,v1:172.21.2.120:6817/2087279929]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:57:55.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:55 gibba020 bash[25448]: audit 2021-03-10T13:57:54.503704+0000 mon.a (mon.0) 545 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-03-10T13:57:55.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:55 gibba020 bash[25448]: cluster 2021-03-10T13:57:54.504002+0000 mon.a (mon.0) 546 : cluster [DBG] osdmap e95: 8 total, 7 up, 8 in 2021-03-10T13:57:55.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:55 gibba020 bash[25448]: audit 2021-03-10T13:57:54.508636+0000 mon.a (mon.0) 547 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:57:55.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:55 gibba020 bash[25448]: cluster 2021-03-10T13:57:54.529762+0000 mgr.gibba020.yqfnwy (mgr.34427) 300 : cluster [DBG] pgmap v151: 129 pgs: 14 active+undersized+degraded, 29 active+undersized, 86 active+clean; 7.0 KiB data, 46 MiB used, 671 GiB / 672 GiB avail; 22/192 objects degraded (11.458%) 2021-03-10T13:57:55.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:55 gibba020 bash[25448]: cluster 2021-03-10T13:57:54.784286+0000 mon.a (mon.0) 548 : cluster [WRN] Health check update: Degraded data redundancy: 22/192 objects degraded (11.458%), 14 pgs degraded (PG_DEGRADED) 2021-03-10T13:57:56.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:56 gibba013 bash[29418]: cluster 2021-03-10T13:57:55.507678+0000 mon.a (mon.0) 549 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:57:56.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:56 gibba013 bash[29418]: cluster 2021-03-10T13:57:55.518680+0000 mon.a (mon.0) 550 : cluster [INF] osd.6 [v2:172.21.2.120:6816/2087279929,v1:172.21.2.120:6817/2087279929] boot 2021-03-10T13:57:56.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:56 gibba013 bash[29418]: cluster 2021-03-10T13:57:55.518710+0000 mon.a (mon.0) 551 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2021-03-10T13:57:56.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:56 gibba013 bash[29418]: audit 2021-03-10T13:57:55.519060+0000 mon.a (mon.0) 552 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:57:56.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:56 gibba013 bash[30381]: cluster 2021-03-10T13:57:55.507678+0000 mon.a (mon.0) 549 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:57:56.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:56 gibba013 bash[30381]: cluster 2021-03-10T13:57:55.518680+0000 mon.a (mon.0) 550 : cluster [INF] osd.6 [v2:172.21.2.120:6816/2087279929,v1:172.21.2.120:6817/2087279929] boot 2021-03-10T13:57:56.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:56 gibba013 bash[30381]: cluster 2021-03-10T13:57:55.518710+0000 mon.a (mon.0) 551 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2021-03-10T13:57:56.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:56 gibba013 bash[30381]: audit 2021-03-10T13:57:55.519060+0000 mon.a (mon.0) 552 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:57:56.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:56 gibba020 bash[25448]: cluster 2021-03-10T13:57:55.507678+0000 mon.a (mon.0) 549 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:57:56.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:56 gibba020 bash[25448]: cluster 2021-03-10T13:57:55.518680+0000 mon.a (mon.0) 550 : cluster [INF] osd.6 [v2:172.21.2.120:6816/2087279929,v1:172.21.2.120:6817/2087279929] boot 2021-03-10T13:57:56.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:56 gibba020 bash[25448]: cluster 2021-03-10T13:57:55.518710+0000 mon.a (mon.0) 551 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2021-03-10T13:57:56.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:56 gibba020 bash[25448]: audit 2021-03-10T13:57:55.519060+0000 mon.a (mon.0) 552 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T13:57:57.546 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T13:57:57.803 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:57:57.803 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (4m) 84s ago 9m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T13:57:57.803 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (9m) 7s ago 9m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T13:57:57.803 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (4m) 7s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T13:57:57.804 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (5m) 7s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T13:57:57.804 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (4m) 84s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T13:57:57.804 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3m) 84s ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T13:57:57.804 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3m) 7s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T13:57:57.804 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3m) 84s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T13:57:57.805 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (9m) 84s ago 10m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T13:57:57.805 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (9m) 7s ago 10m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T13:57:57.805 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2m) 84s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T13:57:57.805 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2m) 84s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T13:57:57.805 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (112s) 84s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T13:57:57.806 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (87s) 84s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T13:57:57.806 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (60s) 7s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T13:57:57.806 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (34s) 7s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T13:57:57.806 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (9s) 7s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T13:57:57.806 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (10m) 7s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 75c9ee8106fc 2021-03-10T13:57:57.807 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (9m) 7s ago 10m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T13:57:57.807 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 7s ago 7m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:57:57.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:57 gibba013 bash[29418]: cluster 2021-03-10T13:57:56.530941+0000 mgr.gibba020.yqfnwy (mgr.34427) 301 : cluster [DBG] pgmap v153: 129 pgs: 6 peering, 13 active+undersized+degraded, 24 active+undersized, 86 active+clean; 7.0 KiB data, 46 MiB used, 671 GiB / 672 GiB avail; 20/192 objects degraded (10.417%) 2021-03-10T13:57:57.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:57 gibba013 bash[29418]: cluster 2021-03-10T13:57:56.536781+0000 mon.a (mon.0) 553 : cluster [DBG] osdmap e97: 8 total, 8 up, 8 in 2021-03-10T13:57:57.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:57 gibba013 bash[30381]: cluster 2021-03-10T13:57:56.530941+0000 mgr.gibba020.yqfnwy (mgr.34427) 301 : cluster [DBG] pgmap v153: 129 pgs: 6 peering, 13 active+undersized+degraded, 24 active+undersized, 86 active+clean; 7.0 KiB data, 46 MiB used, 671 GiB / 672 GiB avail; 20/192 objects degraded (10.417%) 2021-03-10T13:57:57.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:57 gibba013 bash[30381]: cluster 2021-03-10T13:57:56.536781+0000 mon.a (mon.0) 553 : cluster [DBG] osdmap e97: 8 total, 8 up, 8 in 2021-03-10T13:57:57.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:57 gibba020 bash[25448]: cluster 2021-03-10T13:57:56.530941+0000 mgr.gibba020.yqfnwy (mgr.34427) 301 : cluster [DBG] pgmap v153: 129 pgs: 6 peering, 13 active+undersized+degraded, 24 active+undersized, 86 active+clean; 7.0 KiB data, 46 MiB used, 671 GiB / 672 GiB avail; 20/192 objects degraded (10.417%) 2021-03-10T13:57:57.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:57 gibba020 bash[25448]: cluster 2021-03-10T13:57:56.536781+0000 mon.a (mon.0) 553 : cluster [DBG] osdmap e97: 8 total, 8 up, 8 in 2021-03-10T13:57:58.055 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T13:57:58.055 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T13:57:58.055 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:57:58.055 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:57:58.056 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T13:57:58.056 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:57:58.056 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:57:58.056 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T13:57:58.057 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 1, 2021-03-10T13:57:58.057 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 7 2021-03-10T13:57:58.057 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:57:58.057 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T13:57:58.057 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T13:57:58.058 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 1, 2021-03-10T13:57:58.058 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 13 2021-03-10T13:57:58.058 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T13:57:58.058 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T13:57:58.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:58 gibba013 bash[29418]: audit 2021-03-10T13:57:57.535969+0000 mgr.gibba020.yqfnwy (mgr.34427) 302 : audit [DBG] from='client.44268 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:57:58.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:58 gibba013 bash[29418]: audit 2021-03-10T13:57:57.761558+0000 mgr.gibba020.yqfnwy (mgr.34427) 303 : audit [DBG] from='client.44274 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:57:58.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:58 gibba013 bash[29418]: audit 2021-03-10T13:57:58.056168+0000 mon.c (mon.1) 16 : audit [DBG] from='client.? 172.21.2.113:0/1212298902' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:58.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:58 gibba013 bash[30381]: audit 2021-03-10T13:57:57.535969+0000 mgr.gibba020.yqfnwy (mgr.34427) 302 : audit [DBG] from='client.44268 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:57:58.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:58 gibba013 bash[30381]: audit 2021-03-10T13:57:57.761558+0000 mgr.gibba020.yqfnwy (mgr.34427) 303 : audit [DBG] from='client.44274 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:57:58.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:58 gibba013 bash[30381]: audit 2021-03-10T13:57:58.056168+0000 mon.c (mon.1) 16 : audit [DBG] from='client.? 172.21.2.113:0/1212298902' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:58.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:58 gibba020 bash[25448]: audit 2021-03-10T13:57:57.535969+0000 mgr.gibba020.yqfnwy (mgr.34427) 302 : audit [DBG] from='client.44268 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:57:58.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:58 gibba020 bash[25448]: audit 2021-03-10T13:57:57.761558+0000 mgr.gibba020.yqfnwy (mgr.34427) 303 : audit [DBG] from='client.44274 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:57:58.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:58 gibba020 bash[25448]: audit 2021-03-10T13:57:58.056168+0000 mon.c (mon.1) 16 : audit [DBG] from='client.? 172.21.2.113:0/1212298902' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:57:59.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:57:59 gibba013 bash[29418]: cluster 2021-03-10T13:57:58.532596+0000 mgr.gibba020.yqfnwy (mgr.34427) 304 : cluster [DBG] pgmap v155: 129 pgs: 6 peering, 4 active+undersized+degraded, 12 active+undersized, 107 active+clean; 7.0 KiB data, 46 MiB used, 671 GiB / 672 GiB avail; 7/192 objects degraded (3.646%) 2021-03-10T13:57:59.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:57:59 gibba013 bash[30381]: cluster 2021-03-10T13:57:58.532596+0000 mgr.gibba020.yqfnwy (mgr.34427) 304 : cluster [DBG] pgmap v155: 129 pgs: 6 peering, 4 active+undersized+degraded, 12 active+undersized, 107 active+clean; 7.0 KiB data, 46 MiB used, 671 GiB / 672 GiB avail; 7/192 objects degraded (3.646%) 2021-03-10T13:57:59.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:57:59 gibba020 bash[25448]: cluster 2021-03-10T13:57:58.532596+0000 mgr.gibba020.yqfnwy (mgr.34427) 304 : cluster [DBG] pgmap v155: 129 pgs: 6 peering, 4 active+undersized+degraded, 12 active+undersized, 107 active+clean; 7.0 KiB data, 46 MiB used, 671 GiB / 672 GiB avail; 7/192 objects degraded (3.646%) 2021-03-10T13:58:00.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:00 gibba013 bash[29418]: cluster 2021-03-10T13:57:59.787181+0000 mon.a (mon.0) 554 : cluster [WRN] Health check update: Degraded data redundancy: 7/192 objects degraded (3.646%), 4 pgs degraded (PG_DEGRADED) 2021-03-10T13:58:00.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:00 gibba013 bash[30381]: cluster 2021-03-10T13:57:59.787181+0000 mon.a (mon.0) 554 : cluster [WRN] Health check update: Degraded data redundancy: 7/192 objects degraded (3.646%), 4 pgs degraded (PG_DEGRADED) 2021-03-10T13:58:00.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:00 gibba020 bash[25448]: cluster 2021-03-10T13:57:59.787181+0000 mon.a (mon.0) 554 : cluster [WRN] Health check update: Degraded data redundancy: 7/192 objects degraded (3.646%), 4 pgs degraded (PG_DEGRADED) 2021-03-10T13:58:01.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:01 gibba013 bash[29418]: cluster 2021-03-10T13:58:00.534181+0000 mgr.gibba020.yqfnwy (mgr.34427) 305 : cluster [DBG] pgmap v156: 129 pgs: 13 active+clean+wait, 6 peering, 110 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:58:01.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:01 gibba013 bash[29418]: cluster 2021-03-10T13:58:00.792767+0000 mon.a (mon.0) 555 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/192 objects degraded (3.646%), 4 pgs degraded) 2021-03-10T13:58:01.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:01 gibba013 bash[30381]: cluster 2021-03-10T13:58:00.534181+0000 mgr.gibba020.yqfnwy (mgr.34427) 305 : cluster [DBG] pgmap v156: 129 pgs: 13 active+clean+wait, 6 peering, 110 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:58:01.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:01 gibba013 bash[30381]: cluster 2021-03-10T13:58:00.792767+0000 mon.a (mon.0) 555 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/192 objects degraded (3.646%), 4 pgs degraded) 2021-03-10T13:58:01.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:01 gibba020 bash[25448]: cluster 2021-03-10T13:58:00.534181+0000 mgr.gibba020.yqfnwy (mgr.34427) 305 : cluster [DBG] pgmap v156: 129 pgs: 13 active+clean+wait, 6 peering, 110 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:58:01.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:01 gibba020 bash[25448]: cluster 2021-03-10T13:58:00.792767+0000 mon.a (mon.0) 555 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/192 objects degraded (3.646%), 4 pgs degraded) 2021-03-10T13:58:03.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:03 gibba013 bash[29418]: cluster 2021-03-10T13:58:02.535795+0000 mgr.gibba020.yqfnwy (mgr.34427) 306 : cluster [DBG] pgmap v157: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:58:03.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:03 gibba013 bash[30381]: cluster 2021-03-10T13:58:02.535795+0000 mgr.gibba020.yqfnwy (mgr.34427) 306 : cluster [DBG] pgmap v157: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:58:03.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:03 gibba020 bash[25448]: cluster 2021-03-10T13:58:02.535795+0000 mgr.gibba020.yqfnwy (mgr.34427) 306 : cluster [DBG] pgmap v157: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:58:06.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:05 gibba013 bash[29418]: cluster 2021-03-10T13:58:04.537219+0000 mgr.gibba020.yqfnwy (mgr.34427) 307 : cluster [DBG] pgmap v158: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:58:06.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:05 gibba013 bash[29418]: audit 2021-03-10T13:58:05.711652+0000 mon.a (mon.0) 556 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T13:58:06.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:05 gibba013 bash[29418]: audit 2021-03-10T13:58:05.751405+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T13:58:06.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:05 gibba013 bash[29418]: audit 2021-03-10T13:58:05.752134+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T13:58:06.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:05 gibba013 bash[29418]: audit 2021-03-10T13:58:05.752814+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T13:58:06.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:05 gibba013 bash[29418]: audit 2021-03-10T13:58:05.753498+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T13:58:06.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:05 gibba013 bash[30381]: cluster 2021-03-10T13:58:04.537219+0000 mgr.gibba020.yqfnwy (mgr.34427) 307 : cluster [DBG] pgmap v158: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:58:06.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:05 gibba013 bash[30381]: audit 2021-03-10T13:58:05.711652+0000 mon.a (mon.0) 556 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T13:58:06.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:05 gibba013 bash[30381]: audit 2021-03-10T13:58:05.751405+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T13:58:06.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:05 gibba013 bash[30381]: audit 2021-03-10T13:58:05.752134+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T13:58:06.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:05 gibba013 bash[30381]: audit 2021-03-10T13:58:05.752814+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T13:58:06.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:05 gibba013 bash[30381]: audit 2021-03-10T13:58:05.753498+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T13:58:06.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:05 gibba020 bash[25448]: cluster 2021-03-10T13:58:04.537219+0000 mgr.gibba020.yqfnwy (mgr.34427) 307 : cluster [DBG] pgmap v158: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:58:06.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:05 gibba020 bash[25448]: audit 2021-03-10T13:58:05.711652+0000 mon.a (mon.0) 556 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T13:58:06.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:05 gibba020 bash[25448]: audit 2021-03-10T13:58:05.751405+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T13:58:06.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:05 gibba020 bash[25448]: audit 2021-03-10T13:58:05.752134+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T13:58:06.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:05 gibba020 bash[25448]: audit 2021-03-10T13:58:05.752814+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T13:58:06.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:05 gibba020 bash[25448]: audit 2021-03-10T13:58:05.753498+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T13:58:07.065 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:06 gibba020 bash[25448]: audit 2021-03-10T13:58:05.710331+0000 mgr.gibba020.yqfnwy (mgr.34427) 308 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T13:58:07.065 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:06 gibba020 bash[25448]: cephadm 2021-03-10T13:58:05.715321+0000 mgr.gibba020.yqfnwy (mgr.34427) 309 : cephadm [INF] Upgrade: osd.7 is safe to restart 2021-03-10T13:58:07.065 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:06 gibba020 bash[25448]: audit 2021-03-10T13:58:05.869587+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T13:58:07.065 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:06 gibba020 bash[25448]: audit 2021-03-10T13:58:05.872052+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:58:07.066 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:06 gibba020 bash[25448]: audit 2021-03-10T13:58:05.922968+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:58:07.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:06 gibba013 bash[29418]: audit 2021-03-10T13:58:05.710331+0000 mgr.gibba020.yqfnwy (mgr.34427) 308 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T13:58:07.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:06 gibba013 bash[29418]: cephadm 2021-03-10T13:58:05.715321+0000 mgr.gibba020.yqfnwy (mgr.34427) 309 : cephadm [INF] Upgrade: osd.7 is safe to restart 2021-03-10T13:58:07.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:06 gibba013 bash[29418]: audit 2021-03-10T13:58:05.869587+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T13:58:07.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:06 gibba013 bash[29418]: audit 2021-03-10T13:58:05.872052+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:58:07.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:06 gibba013 bash[29418]: audit 2021-03-10T13:58:05.922968+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:58:07.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:06 gibba013 bash[30381]: audit 2021-03-10T13:58:05.710331+0000 mgr.gibba020.yqfnwy (mgr.34427) 308 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T13:58:07.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:06 gibba013 bash[30381]: cephadm 2021-03-10T13:58:05.715321+0000 mgr.gibba020.yqfnwy (mgr.34427) 309 : cephadm [INF] Upgrade: osd.7 is safe to restart 2021-03-10T13:58:07.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:06 gibba013 bash[30381]: audit 2021-03-10T13:58:05.869587+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T13:58:07.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:06 gibba013 bash[30381]: audit 2021-03-10T13:58:05.872052+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:58:07.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:06 gibba013 bash[30381]: audit 2021-03-10T13:58:05.922968+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:58:08.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:07 gibba020 bash[25448]: cluster 2021-03-10T13:58:06.538702+0000 mgr.gibba020.yqfnwy (mgr.34427) 310 : cluster [DBG] pgmap v159: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:58:08.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:07 gibba020 bash[25448]: audit 2021-03-10T13:58:07.667929+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:58:08.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:07 gibba020 bash[25448]: audit 2021-03-10T13:58:07.670178+0000 mon.a (mon.0) 565 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2021-03-10T13:58:08.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:07 gibba013 bash[29418]: cluster 2021-03-10T13:58:06.538702+0000 mgr.gibba020.yqfnwy (mgr.34427) 310 : cluster [DBG] pgmap v159: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:58:08.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:07 gibba013 bash[29418]: audit 2021-03-10T13:58:07.667929+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:58:08.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:07 gibba013 bash[29418]: audit 2021-03-10T13:58:07.670178+0000 mon.a (mon.0) 565 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2021-03-10T13:58:08.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:07 gibba013 bash[30381]: cluster 2021-03-10T13:58:06.538702+0000 mgr.gibba020.yqfnwy (mgr.34427) 310 : cluster [DBG] pgmap v159: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:58:08.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:07 gibba013 bash[30381]: audit 2021-03-10T13:58:07.667929+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:58:08.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:07 gibba013 bash[30381]: audit 2021-03-10T13:58:07.670178+0000 mon.a (mon.0) 565 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2021-03-10T13:58:09.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:08 gibba020 bash[25448]: cephadm 2021-03-10T13:58:07.655175+0000 mgr.gibba020.yqfnwy (mgr.34427) 311 : cephadm [INF] Upgrade: Updating osd.7 2021-03-10T13:58:09.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:08 gibba020 bash[25448]: cephadm 2021-03-10T13:58:07.667499+0000 mgr.gibba020.yqfnwy (mgr.34427) 312 : cephadm [INF] Deploying daemon osd.7 on gibba020 2021-03-10T13:58:09.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:08 gibba013 bash[29418]: cephadm 2021-03-10T13:58:07.655175+0000 mgr.gibba020.yqfnwy (mgr.34427) 311 : cephadm [INF] Upgrade: Updating osd.7 2021-03-10T13:58:09.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:08 gibba013 bash[29418]: cephadm 2021-03-10T13:58:07.667499+0000 mgr.gibba020.yqfnwy (mgr.34427) 312 : cephadm [INF] Deploying daemon osd.7 on gibba020 2021-03-10T13:58:09.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:08 gibba013 bash[30381]: cephadm 2021-03-10T13:58:07.655175+0000 mgr.gibba020.yqfnwy (mgr.34427) 311 : cephadm [INF] Upgrade: Updating osd.7 2021-03-10T13:58:09.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:08 gibba013 bash[30381]: cephadm 2021-03-10T13:58:07.667499+0000 mgr.gibba020.yqfnwy (mgr.34427) 312 : cephadm [INF] Deploying daemon osd.7 on gibba020 2021-03-10T13:58:09.892 INFO:journalctl@ceph.osd.7.gibba020.stdout:Mar 10 13:58:09 gibba020 systemd[1]: Stopping Ceph osd.7 for 7672acc8-81a6-11eb-9080-001a4aab830c... 2021-03-10T13:58:09.893 INFO:journalctl@ceph.osd.7.gibba020.stdout:Mar 10 13:58:09 gibba020 bash[16618]: debug 2021-03-10T13:58:09.701+0000 7f29145eb700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T13:58:09.893 INFO:journalctl@ceph.osd.7.gibba020.stdout:Mar 10 13:58:09 gibba020 bash[16618]: debug 2021-03-10T13:58:09.701+0000 7f29145eb700 -1 osd.7 97 *** Got signal Terminated *** 2021-03-10T13:58:09.893 INFO:journalctl@ceph.osd.7.gibba020.stdout:Mar 10 13:58:09 gibba020 bash[16618]: debug 2021-03-10T13:58:09.701+0000 7f29145eb700 -1 osd.7 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-03-10T13:58:10.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:09 gibba020 bash[25448]: cluster 2021-03-10T13:58:08.540277+0000 mgr.gibba020.yqfnwy (mgr.34427) 313 : cluster [DBG] pgmap v160: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:58:10.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:09 gibba013 bash[29418]: cluster 2021-03-10T13:58:08.540277+0000 mgr.gibba020.yqfnwy (mgr.34427) 313 : cluster [DBG] pgmap v160: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:58:10.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:09 gibba013 bash[30381]: cluster 2021-03-10T13:58:08.540277+0000 mgr.gibba020.yqfnwy (mgr.34427) 313 : cluster [DBG] pgmap v160: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:58:10.948 INFO:journalctl@ceph.osd.7.gibba020.stdout:Mar 10 13:58:10 gibba020 docker[30676]: ceph-7672acc8-81a6-11eb-9080-001a4aab830c-osd.7 2021-03-10T13:58:11.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[29418]: cluster 2021-03-10T13:58:10.036085+0000 mon.a (mon.0) 566 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-03-10T13:58:11.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[29418]: cluster 2021-03-10T13:58:10.036176+0000 mon.a (mon.0) 567 : cluster [INF] osd.7 failed (root=default,host=gibba020) (connection refused reported by osd.6) 2021-03-10T13:58:11.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[29418]: cluster 2021-03-10T13:58:10.036906+0000 mon.a (mon.0) 568 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T13:58:11.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[29418]: cluster 2021-03-10T13:58:10.037228+0000 mon.a (mon.0) 569 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T13:58:11.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[29418]: cluster 2021-03-10T13:58:10.037795+0000 mon.a (mon.0) 570 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T13:58:11.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[29418]: cluster 2021-03-10T13:58:10.038172+0000 mon.a (mon.0) 571 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-03-10T13:58:11.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[29418]: cluster 2021-03-10T13:58:10.038722+0000 mon.a (mon.0) 572 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T13:58:11.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[29418]: cluster 2021-03-10T13:58:10.038990+0000 mon.a (mon.0) 573 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-03-10T13:58:11.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[29418]: cluster 2021-03-10T13:58:10.039494+0000 mon.a (mon.0) 574 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T13:58:11.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[29418]: cluster 2021-03-10T13:58:10.039763+0000 mon.a (mon.0) 575 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T13:58:11.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[29418]: cluster 2021-03-10T13:58:10.040318+0000 mon.a (mon.0) 576 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T13:58:11.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[29418]: cluster 2021-03-10T13:58:10.040598+0000 mon.a (mon.0) 577 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-03-10T13:58:11.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[29418]: cluster 2021-03-10T13:58:10.041112+0000 mon.a (mon.0) 578 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T13:58:11.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[29418]: cluster 2021-03-10T13:58:10.041391+0000 mon.a (mon.0) 579 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T13:58:11.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[29418]: cluster 2021-03-10T13:58:10.041555+0000 mon.a (mon.0) 580 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T13:58:11.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[29418]: cluster 2021-03-10T13:58:10.100720+0000 mon.a (mon.0) 581 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T13:58:11.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[29418]: cluster 2021-03-10T13:58:10.102076+0000 mon.a (mon.0) 582 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T13:58:11.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[29418]: cluster 2021-03-10T13:58:10.102841+0000 mon.a (mon.0) 583 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T13:58:11.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[29418]: cluster 2021-03-10T13:58:10.103535+0000 mon.a (mon.0) 584 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T13:58:11.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[29418]: cluster 2021-03-10T13:58:10.302184+0000 mon.a (mon.0) 585 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T13:58:11.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[29418]: cluster 2021-03-10T13:58:10.302709+0000 mon.a (mon.0) 586 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T13:58:11.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[29418]: cluster 2021-03-10T13:58:10.304075+0000 mon.a (mon.0) 587 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T13:58:11.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[29418]: cluster 2021-03-10T13:58:10.437197+0000 mon.a (mon.0) 588 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T13:58:11.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[29418]: cluster 2021-03-10T13:58:10.437819+0000 mon.a (mon.0) 589 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T13:58:11.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[29418]: cluster 2021-03-10T13:58:10.438317+0000 mon.a (mon.0) 590 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T13:58:11.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[29418]: cluster 2021-03-10T13:58:10.438706+0000 mon.a (mon.0) 591 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T13:58:11.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[30381]: cluster 2021-03-10T13:58:10.036085+0000 mon.a (mon.0) 566 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-03-10T13:58:11.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[30381]: cluster 2021-03-10T13:58:10.036176+0000 mon.a (mon.0) 567 : cluster [INF] osd.7 failed (root=default,host=gibba020) (connection refused reported by osd.6) 2021-03-10T13:58:11.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[30381]: cluster 2021-03-10T13:58:10.036906+0000 mon.a (mon.0) 568 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T13:58:11.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[30381]: cluster 2021-03-10T13:58:10.037228+0000 mon.a (mon.0) 569 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T13:58:11.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[30381]: cluster 2021-03-10T13:58:10.037795+0000 mon.a (mon.0) 570 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T13:58:11.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[30381]: cluster 2021-03-10T13:58:10.038172+0000 mon.a (mon.0) 571 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-03-10T13:58:11.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[30381]: cluster 2021-03-10T13:58:10.038722+0000 mon.a (mon.0) 572 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T13:58:11.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[30381]: cluster 2021-03-10T13:58:10.038990+0000 mon.a (mon.0) 573 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-03-10T13:58:11.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[30381]: cluster 2021-03-10T13:58:10.039494+0000 mon.a (mon.0) 574 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T13:58:11.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[30381]: cluster 2021-03-10T13:58:10.039763+0000 mon.a (mon.0) 575 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T13:58:11.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[30381]: cluster 2021-03-10T13:58:10.040318+0000 mon.a (mon.0) 576 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T13:58:11.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[30381]: cluster 2021-03-10T13:58:10.040598+0000 mon.a (mon.0) 577 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-03-10T13:58:11.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[30381]: cluster 2021-03-10T13:58:10.041112+0000 mon.a (mon.0) 578 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T13:58:11.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[30381]: cluster 2021-03-10T13:58:10.041391+0000 mon.a (mon.0) 579 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T13:58:11.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[30381]: cluster 2021-03-10T13:58:10.041555+0000 mon.a (mon.0) 580 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T13:58:11.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[30381]: cluster 2021-03-10T13:58:10.100720+0000 mon.a (mon.0) 581 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T13:58:11.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[30381]: cluster 2021-03-10T13:58:10.102076+0000 mon.a (mon.0) 582 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T13:58:11.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[30381]: cluster 2021-03-10T13:58:10.102841+0000 mon.a (mon.0) 583 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T13:58:11.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[30381]: cluster 2021-03-10T13:58:10.103535+0000 mon.a (mon.0) 584 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T13:58:11.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[30381]: cluster 2021-03-10T13:58:10.302184+0000 mon.a (mon.0) 585 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T13:58:11.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[30381]: cluster 2021-03-10T13:58:10.302709+0000 mon.a (mon.0) 586 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T13:58:11.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[30381]: cluster 2021-03-10T13:58:10.304075+0000 mon.a (mon.0) 587 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T13:58:11.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[30381]: cluster 2021-03-10T13:58:10.437197+0000 mon.a (mon.0) 588 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T13:58:11.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[30381]: cluster 2021-03-10T13:58:10.437819+0000 mon.a (mon.0) 589 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T13:58:11.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[30381]: cluster 2021-03-10T13:58:10.438317+0000 mon.a (mon.0) 590 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T13:58:11.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[30381]: cluster 2021-03-10T13:58:10.438706+0000 mon.a (mon.0) 591 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T13:58:11.390 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[29418]: cluster 2021-03-10T13:58:10.439092+0000 mon.a (mon.0) 592 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T13:58:11.390 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[29418]: cluster 2021-03-10T13:58:10.439479+0000 mon.a (mon.0) 593 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T13:58:11.390 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[29418]: cluster 2021-03-10T13:58:10.439894+0000 mon.a (mon.0) 594 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T13:58:11.391 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[29418]: cluster 2021-03-10T13:58:10.440303+0000 mon.a (mon.0) 595 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-03-10T13:58:11.391 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[29418]: cluster 2021-03-10T13:58:10.440578+0000 mon.a (mon.0) 596 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T13:58:11.391 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[29418]: cluster 2021-03-10T13:58:10.441173+0000 mon.a (mon.0) 597 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T13:58:11.391 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[29418]: cluster 2021-03-10T13:58:10.441465+0000 mon.a (mon.0) 598 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-03-10T13:58:11.391 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[29418]: cluster 2021-03-10T13:58:10.441676+0000 mon.a (mon.0) 599 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-03-10T13:58:11.392 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[29418]: cluster 2021-03-10T13:58:10.441749+0000 mon.a (mon.0) 600 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T13:58:11.392 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[29418]: cluster 2021-03-10T13:58:10.441844+0000 mon.a (mon.0) 601 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-03-10T13:58:11.392 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[29418]: cluster 2021-03-10T13:58:10.701719+0000 mon.a (mon.0) 602 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T13:58:11.392 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[29418]: cluster 2021-03-10T13:58:10.702191+0000 mon.a (mon.0) 603 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T13:58:11.392 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[29418]: cluster 2021-03-10T13:58:10.708230+0000 mon.a (mon.0) 604 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T13:58:11.393 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[30381]: cluster 2021-03-10T13:58:10.439092+0000 mon.a (mon.0) 592 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T13:58:11.393 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[30381]: cluster 2021-03-10T13:58:10.439479+0000 mon.a (mon.0) 593 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T13:58:11.393 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[30381]: cluster 2021-03-10T13:58:10.439894+0000 mon.a (mon.0) 594 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T13:58:11.393 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[30381]: cluster 2021-03-10T13:58:10.440303+0000 mon.a (mon.0) 595 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-03-10T13:58:11.394 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[30381]: cluster 2021-03-10T13:58:10.440578+0000 mon.a (mon.0) 596 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T13:58:11.394 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[30381]: cluster 2021-03-10T13:58:10.441173+0000 mon.a (mon.0) 597 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T13:58:11.394 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[30381]: cluster 2021-03-10T13:58:10.441465+0000 mon.a (mon.0) 598 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-03-10T13:58:11.394 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[30381]: cluster 2021-03-10T13:58:10.441676+0000 mon.a (mon.0) 599 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-03-10T13:58:11.394 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[30381]: cluster 2021-03-10T13:58:10.441749+0000 mon.a (mon.0) 600 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T13:58:11.395 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[30381]: cluster 2021-03-10T13:58:10.441844+0000 mon.a (mon.0) 601 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-03-10T13:58:11.395 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[30381]: cluster 2021-03-10T13:58:10.701719+0000 mon.a (mon.0) 602 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T13:58:11.395 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[30381]: cluster 2021-03-10T13:58:10.702191+0000 mon.a (mon.0) 603 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T13:58:11.395 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:10 gibba013 bash[30381]: cluster 2021-03-10T13:58:10.708230+0000 mon.a (mon.0) 604 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T13:58:11.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:10 gibba020 bash[25448]: cluster 2021-03-10T13:58:10.036085+0000 mon.a (mon.0) 566 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-03-10T13:58:11.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:10 gibba020 bash[25448]: cluster 2021-03-10T13:58:10.036176+0000 mon.a (mon.0) 567 : cluster [INF] osd.7 failed (root=default,host=gibba020) (connection refused reported by osd.6) 2021-03-10T13:58:11.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:10 gibba020 bash[25448]: cluster 2021-03-10T13:58:10.036906+0000 mon.a (mon.0) 568 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T13:58:11.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:10 gibba020 bash[25448]: cluster 2021-03-10T13:58:10.037228+0000 mon.a (mon.0) 569 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T13:58:11.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:10 gibba020 bash[25448]: cluster 2021-03-10T13:58:10.037795+0000 mon.a (mon.0) 570 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T13:58:11.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:10 gibba020 bash[25448]: cluster 2021-03-10T13:58:10.038172+0000 mon.a (mon.0) 571 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-03-10T13:58:11.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:10 gibba020 bash[25448]: cluster 2021-03-10T13:58:10.038722+0000 mon.a (mon.0) 572 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T13:58:11.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:10 gibba020 bash[25448]: cluster 2021-03-10T13:58:10.038990+0000 mon.a (mon.0) 573 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-03-10T13:58:11.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:10 gibba020 bash[25448]: cluster 2021-03-10T13:58:10.039494+0000 mon.a (mon.0) 574 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T13:58:11.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:10 gibba020 bash[25448]: cluster 2021-03-10T13:58:10.039763+0000 mon.a (mon.0) 575 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T13:58:11.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:10 gibba020 bash[25448]: cluster 2021-03-10T13:58:10.040318+0000 mon.a (mon.0) 576 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T13:58:11.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:10 gibba020 bash[25448]: cluster 2021-03-10T13:58:10.040598+0000 mon.a (mon.0) 577 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-03-10T13:58:11.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:10 gibba020 bash[25448]: cluster 2021-03-10T13:58:10.041112+0000 mon.a (mon.0) 578 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T13:58:11.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:10 gibba020 bash[25448]: cluster 2021-03-10T13:58:10.041391+0000 mon.a (mon.0) 579 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T13:58:11.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:10 gibba020 bash[25448]: cluster 2021-03-10T13:58:10.041555+0000 mon.a (mon.0) 580 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T13:58:11.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:10 gibba020 bash[25448]: cluster 2021-03-10T13:58:10.100720+0000 mon.a (mon.0) 581 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T13:58:11.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:10 gibba020 bash[25448]: cluster 2021-03-10T13:58:10.102076+0000 mon.a (mon.0) 582 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T13:58:11.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:10 gibba020 bash[25448]: cluster 2021-03-10T13:58:10.102841+0000 mon.a (mon.0) 583 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T13:58:11.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:10 gibba020 bash[25448]: cluster 2021-03-10T13:58:10.103535+0000 mon.a (mon.0) 584 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T13:58:11.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:10 gibba020 bash[25448]: cluster 2021-03-10T13:58:10.302184+0000 mon.a (mon.0) 585 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T13:58:11.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:10 gibba020 bash[25448]: cluster 2021-03-10T13:58:10.302709+0000 mon.a (mon.0) 586 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T13:58:11.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:10 gibba020 bash[25448]: cluster 2021-03-10T13:58:10.304075+0000 mon.a (mon.0) 587 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T13:58:11.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:10 gibba020 bash[25448]: cluster 2021-03-10T13:58:10.437197+0000 mon.a (mon.0) 588 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T13:58:11.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:10 gibba020 bash[25448]: cluster 2021-03-10T13:58:10.437819+0000 mon.a (mon.0) 589 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T13:58:11.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:10 gibba020 bash[25448]: cluster 2021-03-10T13:58:10.438317+0000 mon.a (mon.0) 590 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T13:58:11.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:10 gibba020 bash[25448]: cluster 2021-03-10T13:58:10.438706+0000 mon.a (mon.0) 591 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T13:58:11.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:10 gibba020 bash[25448]: cluster 2021-03-10T13:58:10.439092+0000 mon.a (mon.0) 592 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T13:58:11.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:10 gibba020 bash[25448]: cluster 2021-03-10T13:58:10.439479+0000 mon.a (mon.0) 593 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T13:58:11.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:10 gibba020 bash[25448]: cluster 2021-03-10T13:58:10.439894+0000 mon.a (mon.0) 594 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T13:58:11.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:10 gibba020 bash[25448]: cluster 2021-03-10T13:58:10.440303+0000 mon.a (mon.0) 595 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-03-10T13:58:11.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:10 gibba020 bash[25448]: cluster 2021-03-10T13:58:10.440578+0000 mon.a (mon.0) 596 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T13:58:11.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:10 gibba020 bash[25448]: cluster 2021-03-10T13:58:10.441173+0000 mon.a (mon.0) 597 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T13:58:11.456 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:10 gibba020 bash[25448]: cluster 2021-03-10T13:58:10.441465+0000 mon.a (mon.0) 598 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-03-10T13:58:11.456 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:10 gibba020 bash[25448]: cluster 2021-03-10T13:58:10.441676+0000 mon.a (mon.0) 599 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-03-10T13:58:11.456 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:10 gibba020 bash[25448]: cluster 2021-03-10T13:58:10.441749+0000 mon.a (mon.0) 600 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T13:58:11.456 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:10 gibba020 bash[25448]: cluster 2021-03-10T13:58:10.441844+0000 mon.a (mon.0) 601 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-03-10T13:58:11.456 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:10 gibba020 bash[25448]: cluster 2021-03-10T13:58:10.701719+0000 mon.a (mon.0) 602 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T13:58:11.456 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:10 gibba020 bash[25448]: cluster 2021-03-10T13:58:10.702191+0000 mon.a (mon.0) 603 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T13:58:11.457 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:10 gibba020 bash[25448]: cluster 2021-03-10T13:58:10.708230+0000 mon.a (mon.0) 604 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-03-10T13:58:12.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:11 gibba013 bash[29418]: cluster 2021-03-10T13:58:10.540778+0000 mgr.gibba020.yqfnwy (mgr.34427) 314 : cluster [DBG] pgmap v161: 129 pgs: 129 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:58:12.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:11 gibba013 bash[29418]: cluster 2021-03-10T13:58:10.945487+0000 mon.a (mon.0) 605 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:58:12.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:11 gibba013 bash[29418]: cluster 2021-03-10T13:58:10.957522+0000 mon.a (mon.0) 606 : cluster [DBG] osdmap e98: 8 total, 7 up, 8 in 2021-03-10T13:58:12.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:11 gibba013 bash[30381]: cluster 2021-03-10T13:58:10.540778+0000 mgr.gibba020.yqfnwy (mgr.34427) 314 : cluster [DBG] pgmap v161: 129 pgs: 129 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:58:12.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:11 gibba013 bash[30381]: cluster 2021-03-10T13:58:10.945487+0000 mon.a (mon.0) 605 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:58:12.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:11 gibba013 bash[30381]: cluster 2021-03-10T13:58:10.957522+0000 mon.a (mon.0) 606 : cluster [DBG] osdmap e98: 8 total, 7 up, 8 in 2021-03-10T13:58:12.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:11 gibba020 bash[25448]: cluster 2021-03-10T13:58:10.540778+0000 mgr.gibba020.yqfnwy (mgr.34427) 314 : cluster [DBG] pgmap v161: 129 pgs: 129 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T13:58:12.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:11 gibba020 bash[25448]: cluster 2021-03-10T13:58:10.945487+0000 mon.a (mon.0) 605 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T13:58:12.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:11 gibba020 bash[25448]: cluster 2021-03-10T13:58:10.957522+0000 mon.a (mon.0) 606 : cluster [DBG] osdmap e98: 8 total, 7 up, 8 in 2021-03-10T13:58:12.947 INFO:journalctl@ceph.osd.7.gibba020.stdout:Mar 10 13:58:12 gibba020 systemd[1]: ceph-7672acc8-81a6-11eb-9080-001a4aab830c@osd.7.service: Succeeded. 2021-03-10T13:58:12.948 INFO:journalctl@ceph.osd.7.gibba020.stdout:Mar 10 13:58:12 gibba020 systemd[1]: Stopped Ceph osd.7 for 7672acc8-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:58:12.948 INFO:journalctl@ceph.osd.7.gibba020.stdout:Mar 10 13:58:12 gibba020 systemd[1]: Started Ceph osd.7 for 7672acc8-81a6-11eb-9080-001a4aab830c. 2021-03-10T13:58:13.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:12 gibba020 bash[25448]: cluster 2021-03-10T13:58:11.958944+0000 mon.a (mon.0) 607 : cluster [DBG] osdmap e99: 8 total, 7 up, 8 in 2021-03-10T13:58:13.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:12 gibba020 bash[25448]: audit 2021-03-10T13:58:12.817214+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:58:13.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:12 gibba020 bash[25448]: audit 2021-03-10T13:58:12.818143+0000 mon.a (mon.0) 609 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:58:13.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:12 gibba020 bash[25448]: audit 2021-03-10T13:58:12.819751+0000 mon.a (mon.0) 610 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:58:13.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:12 gibba013 bash[29418]: cluster 2021-03-10T13:58:11.958944+0000 mon.a (mon.0) 607 : cluster [DBG] osdmap e99: 8 total, 7 up, 8 in 2021-03-10T13:58:13.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:12 gibba013 bash[29418]: audit 2021-03-10T13:58:12.817214+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:58:13.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:12 gibba013 bash[29418]: audit 2021-03-10T13:58:12.818143+0000 mon.a (mon.0) 609 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:58:13.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:12 gibba013 bash[29418]: audit 2021-03-10T13:58:12.819751+0000 mon.a (mon.0) 610 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:58:13.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:12 gibba013 bash[30381]: cluster 2021-03-10T13:58:11.958944+0000 mon.a (mon.0) 607 : cluster [DBG] osdmap e99: 8 total, 7 up, 8 in 2021-03-10T13:58:13.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:12 gibba013 bash[30381]: audit 2021-03-10T13:58:12.817214+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:58:13.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:12 gibba013 bash[30381]: audit 2021-03-10T13:58:12.818143+0000 mon.a (mon.0) 609 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:58:13.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:12 gibba013 bash[30381]: audit 2021-03-10T13:58:12.819751+0000 mon.a (mon.0) 610 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T13:58:14.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:13 gibba013 bash[29418]: cluster 2021-03-10T13:58:12.542071+0000 mgr.gibba020.yqfnwy (mgr.34427) 315 : cluster [DBG] pgmap v164: 129 pgs: 7 active+undersized+degraded, 10 stale+active+clean, 4 active+undersized, 108 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail; 10/192 objects degraded (5.208%) 2021-03-10T13:58:14.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:13 gibba013 bash[29418]: cluster 2021-03-10T13:58:12.959349+0000 mon.a (mon.0) 611 : cluster [WRN] Health check failed: Degraded data redundancy: 10/192 objects degraded (5.208%), 7 pgs degraded (PG_DEGRADED) 2021-03-10T13:58:14.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:13 gibba013 bash[30381]: cluster 2021-03-10T13:58:12.542071+0000 mgr.gibba020.yqfnwy (mgr.34427) 315 : cluster [DBG] pgmap v164: 129 pgs: 7 active+undersized+degraded, 10 stale+active+clean, 4 active+undersized, 108 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail; 10/192 objects degraded (5.208%) 2021-03-10T13:58:14.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:13 gibba013 bash[30381]: cluster 2021-03-10T13:58:12.959349+0000 mon.a (mon.0) 611 : cluster [WRN] Health check failed: Degraded data redundancy: 10/192 objects degraded (5.208%), 7 pgs degraded (PG_DEGRADED) 2021-03-10T13:58:14.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:13 gibba020 bash[25448]: cluster 2021-03-10T13:58:12.542071+0000 mgr.gibba020.yqfnwy (mgr.34427) 315 : cluster [DBG] pgmap v164: 129 pgs: 7 active+undersized+degraded, 10 stale+active+clean, 4 active+undersized, 108 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail; 10/192 objects degraded (5.208%) 2021-03-10T13:58:14.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:13 gibba020 bash[25448]: cluster 2021-03-10T13:58:12.959349+0000 mon.a (mon.0) 611 : cluster [WRN] Health check failed: Degraded data redundancy: 10/192 objects degraded (5.208%), 7 pgs degraded (PG_DEGRADED) 2021-03-10T13:58:14.449 INFO:journalctl@ceph.osd.7.gibba020.stdout:Mar 10 13:58:14 gibba020 bash[30852]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-03-10T13:58:14.449 INFO:journalctl@ceph.osd.7.gibba020.stdout:Mar 10 13:58:14 gibba020 bash[30852]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-7 --no-mon-config 2021-03-10T13:58:14.449 INFO:journalctl@ceph.osd.7.gibba020.stdout:Mar 10 13:58:14 gibba020 bash[30852]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7/block 2021-03-10T13:58:14.449 INFO:journalctl@ceph.osd.7.gibba020.stdout:Mar 10 13:58:14 gibba020 bash[30852]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-7/block 2021-03-10T13:58:14.449 INFO:journalctl@ceph.osd.7.gibba020.stdout:Mar 10 13:58:14 gibba020 bash[30852]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2021-03-10T13:58:14.450 INFO:journalctl@ceph.osd.7.gibba020.stdout:Mar 10 13:58:14 gibba020 bash[30852]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-03-10T13:58:14.450 INFO:journalctl@ceph.osd.7.gibba020.stdout:Mar 10 13:58:14 gibba020 bash[30852]: --> ceph-volume lvm activate successful for osd ID: 7 2021-03-10T13:58:15.947 INFO:journalctl@ceph.osd.7.gibba020.stdout:Mar 10 13:58:15 gibba020 bash[30980]: debug 2021-03-10T13:58:15.553+0000 7f3570937700 1 -- 172.21.2.120:0/3392117682 <== mon.2 v2:172.21.2.120:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f61f2fc4e0 con 0x55f61f378c00 2021-03-10T13:58:16.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:15 gibba013 bash[29418]: cluster 2021-03-10T13:58:14.543861+0000 mgr.gibba020.yqfnwy (mgr.34427) 316 : cluster [DBG] pgmap v165: 129 pgs: 17 active+undersized+degraded, 3 stale+active+clean, 21 active+undersized, 88 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail; 22/192 objects degraded (11.458%) 2021-03-10T13:58:16.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:15 gibba013 bash[30381]: cluster 2021-03-10T13:58:14.543861+0000 mgr.gibba020.yqfnwy (mgr.34427) 316 : cluster [DBG] pgmap v165: 129 pgs: 17 active+undersized+degraded, 3 stale+active+clean, 21 active+undersized, 88 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail; 22/192 objects degraded (11.458%) 2021-03-10T13:58:16.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:15 gibba020 bash[25448]: cluster 2021-03-10T13:58:14.543861+0000 mgr.gibba020.yqfnwy (mgr.34427) 316 : cluster [DBG] pgmap v165: 129 pgs: 17 active+undersized+degraded, 3 stale+active+clean, 21 active+undersized, 88 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail; 22/192 objects degraded (11.458%) 2021-03-10T13:58:16.448 INFO:journalctl@ceph.osd.7.gibba020.stdout:Mar 10 13:58:16 gibba020 bash[30980]: debug 2021-03-10T13:58:16.093+0000 7f35783cc080 -1 Falling back to public interface 2021-03-10T13:58:17.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[29418]: audit 2021-03-10T13:58:16.525012+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:58:17.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[29418]: audit 2021-03-10T13:58:16.528821+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:58:17.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[29418]: cephadm 2021-03-10T13:58:16.530020+0000 mgr.gibba020.yqfnwy (mgr.34427) 317 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:58:17.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[29418]: cephadm 2021-03-10T13:58:16.532080+0000 mgr.gibba020.yqfnwy (mgr.34427) 318 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:58:17.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[29418]: audit 2021-03-10T13:58:16.533219+0000 mon.a (mon.0) 614 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:58:17.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[29418]: cephadm 2021-03-10T13:58:16.534043+0000 mgr.gibba020.yqfnwy (mgr.34427) 319 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:58:17.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[29418]: cephadm 2021-03-10T13:58:16.534106+0000 mgr.gibba020.yqfnwy (mgr.34427) 320 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:58:17.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[29418]: audit 2021-03-10T13:58:16.535072+0000 mon.a (mon.0) 615 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:17.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[29418]: cephadm 2021-03-10T13:58:16.535960+0000 mgr.gibba020.yqfnwy (mgr.34427) 321 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:58:17.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[29418]: cephadm 2021-03-10T13:58:16.536060+0000 mgr.gibba020.yqfnwy (mgr.34427) 322 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:58:17.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[29418]: audit 2021-03-10T13:58:16.537116+0000 mon.a (mon.0) 616 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:17.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[29418]: cephadm 2021-03-10T13:58:16.537421+0000 mgr.gibba020.yqfnwy (mgr.34427) 323 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:58:17.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[29418]: audit 2021-03-10T13:58:16.538666+0000 mon.a (mon.0) 617 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:17.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[29418]: cephadm 2021-03-10T13:58:16.538772+0000 mgr.gibba020.yqfnwy (mgr.34427) 324 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:58:17.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[29418]: cephadm 2021-03-10T13:58:16.538836+0000 mgr.gibba020.yqfnwy (mgr.34427) 325 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:58:17.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[29418]: cephadm 2021-03-10T13:58:16.540467+0000 mgr.gibba020.yqfnwy (mgr.34427) 326 : cephadm [INF] Upgrade: Setting container_image for all osd 2021-03-10T13:58:17.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[29418]: audit 2021-03-10T13:58:16.541855+0000 mon.a (mon.0) 618 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:17.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[29418]: cluster 2021-03-10T13:58:16.544967+0000 mgr.gibba020.yqfnwy (mgr.34427) 327 : cluster [DBG] pgmap v166: 129 pgs: 24 active+undersized+degraded, 33 active+undersized, 72 active+clean; 7.0 KiB data, 48 MiB used, 671 GiB / 672 GiB avail; 32/192 objects degraded (16.667%) 2021-03-10T13:58:17.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[29418]: audit 2021-03-10T13:58:16.546449+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:58:17.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[30381]: audit 2021-03-10T13:58:16.525012+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:58:17.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[30381]: audit 2021-03-10T13:58:16.528821+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:58:17.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[30381]: cephadm 2021-03-10T13:58:16.530020+0000 mgr.gibba020.yqfnwy (mgr.34427) 317 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:58:17.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[30381]: cephadm 2021-03-10T13:58:16.532080+0000 mgr.gibba020.yqfnwy (mgr.34427) 318 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:58:17.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[30381]: audit 2021-03-10T13:58:16.533219+0000 mon.a (mon.0) 614 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:58:17.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[30381]: cephadm 2021-03-10T13:58:16.534043+0000 mgr.gibba020.yqfnwy (mgr.34427) 319 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:58:17.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[30381]: cephadm 2021-03-10T13:58:16.534106+0000 mgr.gibba020.yqfnwy (mgr.34427) 320 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:58:17.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[30381]: audit 2021-03-10T13:58:16.535072+0000 mon.a (mon.0) 615 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:17.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[30381]: cephadm 2021-03-10T13:58:16.535960+0000 mgr.gibba020.yqfnwy (mgr.34427) 321 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:58:17.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[30381]: cephadm 2021-03-10T13:58:16.536060+0000 mgr.gibba020.yqfnwy (mgr.34427) 322 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:58:17.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[30381]: audit 2021-03-10T13:58:16.537116+0000 mon.a (mon.0) 616 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:17.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[30381]: cephadm 2021-03-10T13:58:16.537421+0000 mgr.gibba020.yqfnwy (mgr.34427) 323 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:58:17.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[30381]: audit 2021-03-10T13:58:16.538666+0000 mon.a (mon.0) 617 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:17.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[30381]: cephadm 2021-03-10T13:58:16.538772+0000 mgr.gibba020.yqfnwy (mgr.34427) 324 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:58:17.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[30381]: cephadm 2021-03-10T13:58:16.538836+0000 mgr.gibba020.yqfnwy (mgr.34427) 325 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:58:17.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[30381]: cephadm 2021-03-10T13:58:16.540467+0000 mgr.gibba020.yqfnwy (mgr.34427) 326 : cephadm [INF] Upgrade: Setting container_image for all osd 2021-03-10T13:58:17.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[30381]: audit 2021-03-10T13:58:16.541855+0000 mon.a (mon.0) 618 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:17.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[30381]: cluster 2021-03-10T13:58:16.544967+0000 mgr.gibba020.yqfnwy (mgr.34427) 327 : cluster [DBG] pgmap v166: 129 pgs: 24 active+undersized+degraded, 33 active+undersized, 72 active+clean; 7.0 KiB data, 48 MiB used, 671 GiB / 672 GiB avail; 32/192 objects degraded (16.667%) 2021-03-10T13:58:17.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[30381]: audit 2021-03-10T13:58:16.546449+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:58:17.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[29418]: audit 2021-03-10T13:58:16.547987+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2021-03-10T13:58:17.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[29418]: audit 2021-03-10T13:58:16.551129+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2021-03-10T13:58:17.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[29418]: audit 2021-03-10T13:58:16.552460+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2021-03-10T13:58:17.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[29418]: audit 2021-03-10T13:58:16.556154+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2021-03-10T13:58:17.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[29418]: audit 2021-03-10T13:58:16.557768+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2021-03-10T13:58:17.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[29418]: audit 2021-03-10T13:58:16.562336+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2021-03-10T13:58:17.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[29418]: audit 2021-03-10T13:58:16.564148+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2021-03-10T13:58:17.889 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[29418]: audit 2021-03-10T13:58:16.571043+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2021-03-10T13:58:17.889 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[29418]: audit 2021-03-10T13:58:16.573394+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2021-03-10T13:58:17.889 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[29418]: audit 2021-03-10T13:58:16.585315+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2021-03-10T13:58:17.889 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[29418]: audit 2021-03-10T13:58:16.587818+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2021-03-10T13:58:17.890 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[29418]: audit 2021-03-10T13:58:16.591729+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2021-03-10T13:58:17.890 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[29418]: audit 2021-03-10T13:58:16.594085+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2021-03-10T13:58:17.890 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[29418]: audit 2021-03-10T13:58:16.601498+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2021-03-10T13:58:17.890 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[29418]: audit 2021-03-10T13:58:16.603860+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2021-03-10T13:58:17.890 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[29418]: cephadm 2021-03-10T13:58:16.612551+0000 mgr.gibba020.yqfnwy (mgr.34427) 328 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T13:58:17.891 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[29418]: audit 2021-03-10T13:58:16.612978+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2021-03-10T13:58:17.891 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[29418]: cephadm 2021-03-10T13:58:16.614576+0000 mgr.gibba020.yqfnwy (mgr.34427) 329 : cephadm [INF] Upgrade: Setting require_osd_release to 17 quincy 2021-03-10T13:58:17.891 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[29418]: audit 2021-03-10T13:58:16.617505+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd require-osd-release", "release": "quincy"}]: dispatch 2021-03-10T13:58:17.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[30381]: audit 2021-03-10T13:58:16.547987+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2021-03-10T13:58:17.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[30381]: audit 2021-03-10T13:58:16.551129+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2021-03-10T13:58:17.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[30381]: audit 2021-03-10T13:58:16.552460+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2021-03-10T13:58:17.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[30381]: audit 2021-03-10T13:58:16.556154+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2021-03-10T13:58:17.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[30381]: audit 2021-03-10T13:58:16.557768+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2021-03-10T13:58:17.893 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[30381]: audit 2021-03-10T13:58:16.562336+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2021-03-10T13:58:17.893 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[30381]: audit 2021-03-10T13:58:16.564148+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2021-03-10T13:58:17.893 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[30381]: audit 2021-03-10T13:58:16.571043+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2021-03-10T13:58:17.893 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[30381]: audit 2021-03-10T13:58:16.573394+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2021-03-10T13:58:17.893 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[30381]: audit 2021-03-10T13:58:16.585315+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2021-03-10T13:58:17.894 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[30381]: audit 2021-03-10T13:58:16.587818+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2021-03-10T13:58:17.894 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[30381]: audit 2021-03-10T13:58:16.591729+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2021-03-10T13:58:17.894 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[30381]: audit 2021-03-10T13:58:16.594085+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2021-03-10T13:58:17.894 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[30381]: audit 2021-03-10T13:58:16.601498+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2021-03-10T13:58:17.895 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[30381]: audit 2021-03-10T13:58:16.603860+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2021-03-10T13:58:17.895 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[30381]: cephadm 2021-03-10T13:58:16.612551+0000 mgr.gibba020.yqfnwy (mgr.34427) 328 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T13:58:17.895 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[30381]: audit 2021-03-10T13:58:16.612978+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2021-03-10T13:58:17.895 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[30381]: cephadm 2021-03-10T13:58:16.614576+0000 mgr.gibba020.yqfnwy (mgr.34427) 329 : cephadm [INF] Upgrade: Setting require_osd_release to 17 quincy 2021-03-10T13:58:17.895 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:17 gibba013 bash[30381]: audit 2021-03-10T13:58:16.617505+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd require-osd-release", "release": "quincy"}]: dispatch 2021-03-10T13:58:17.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:17 gibba020 bash[25448]: audit 2021-03-10T13:58:16.525012+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:58:17.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:17 gibba020 bash[25448]: audit 2021-03-10T13:58:16.528821+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:58:17.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:17 gibba020 bash[25448]: cephadm 2021-03-10T13:58:16.530020+0000 mgr.gibba020.yqfnwy (mgr.34427) 317 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:58:17.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:17 gibba020 bash[25448]: cephadm 2021-03-10T13:58:16.532080+0000 mgr.gibba020.yqfnwy (mgr.34427) 318 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:58:17.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:17 gibba020 bash[25448]: audit 2021-03-10T13:58:16.533219+0000 mon.a (mon.0) 614 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:58:17.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:17 gibba020 bash[25448]: cephadm 2021-03-10T13:58:16.534043+0000 mgr.gibba020.yqfnwy (mgr.34427) 319 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:58:17.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:17 gibba020 bash[25448]: cephadm 2021-03-10T13:58:16.534106+0000 mgr.gibba020.yqfnwy (mgr.34427) 320 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:58:17.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:17 gibba020 bash[25448]: audit 2021-03-10T13:58:16.535072+0000 mon.a (mon.0) 615 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:17.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:17 gibba020 bash[25448]: cephadm 2021-03-10T13:58:16.535960+0000 mgr.gibba020.yqfnwy (mgr.34427) 321 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:58:17.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:17 gibba020 bash[25448]: cephadm 2021-03-10T13:58:16.536060+0000 mgr.gibba020.yqfnwy (mgr.34427) 322 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:58:17.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:17 gibba020 bash[25448]: audit 2021-03-10T13:58:16.537116+0000 mon.a (mon.0) 616 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:17.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:17 gibba020 bash[25448]: cephadm 2021-03-10T13:58:16.537421+0000 mgr.gibba020.yqfnwy (mgr.34427) 323 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:58:17.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:17 gibba020 bash[25448]: audit 2021-03-10T13:58:16.538666+0000 mon.a (mon.0) 617 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:17.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:17 gibba020 bash[25448]: cephadm 2021-03-10T13:58:16.538772+0000 mgr.gibba020.yqfnwy (mgr.34427) 324 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:58:17.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:17 gibba020 bash[25448]: cephadm 2021-03-10T13:58:16.538836+0000 mgr.gibba020.yqfnwy (mgr.34427) 325 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:58:17.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:17 gibba020 bash[25448]: cephadm 2021-03-10T13:58:16.540467+0000 mgr.gibba020.yqfnwy (mgr.34427) 326 : cephadm [INF] Upgrade: Setting container_image for all osd 2021-03-10T13:58:17.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:17 gibba020 bash[25448]: audit 2021-03-10T13:58:16.541855+0000 mon.a (mon.0) 618 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:17.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:17 gibba020 bash[25448]: cluster 2021-03-10T13:58:16.544967+0000 mgr.gibba020.yqfnwy (mgr.34427) 327 : cluster [DBG] pgmap v166: 129 pgs: 24 active+undersized+degraded, 33 active+undersized, 72 active+clean; 7.0 KiB data, 48 MiB used, 671 GiB / 672 GiB avail; 32/192 objects degraded (16.667%) 2021-03-10T13:58:17.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:17 gibba020 bash[25448]: audit 2021-03-10T13:58:16.546449+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:58:17.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:17 gibba020 bash[25448]: audit 2021-03-10T13:58:16.547987+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2021-03-10T13:58:17.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:17 gibba020 bash[25448]: audit 2021-03-10T13:58:16.551129+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2021-03-10T13:58:17.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:17 gibba020 bash[25448]: audit 2021-03-10T13:58:16.552460+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2021-03-10T13:58:17.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:17 gibba020 bash[25448]: audit 2021-03-10T13:58:16.556154+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2021-03-10T13:58:17.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:17 gibba020 bash[25448]: audit 2021-03-10T13:58:16.557768+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2021-03-10T13:58:17.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:17 gibba020 bash[25448]: audit 2021-03-10T13:58:16.562336+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2021-03-10T13:58:17.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:17 gibba020 bash[25448]: audit 2021-03-10T13:58:16.564148+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2021-03-10T13:58:17.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:17 gibba020 bash[25448]: audit 2021-03-10T13:58:16.571043+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2021-03-10T13:58:17.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:17 gibba020 bash[25448]: audit 2021-03-10T13:58:16.573394+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2021-03-10T13:58:17.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:17 gibba020 bash[25448]: audit 2021-03-10T13:58:16.585315+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2021-03-10T13:58:17.957 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:17 gibba020 bash[25448]: audit 2021-03-10T13:58:16.587818+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2021-03-10T13:58:17.957 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:17 gibba020 bash[25448]: audit 2021-03-10T13:58:16.591729+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2021-03-10T13:58:17.957 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:17 gibba020 bash[25448]: audit 2021-03-10T13:58:16.594085+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2021-03-10T13:58:17.957 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:17 gibba020 bash[25448]: audit 2021-03-10T13:58:16.601498+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2021-03-10T13:58:17.958 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:17 gibba020 bash[25448]: audit 2021-03-10T13:58:16.603860+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2021-03-10T13:58:17.958 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:17 gibba020 bash[25448]: cephadm 2021-03-10T13:58:16.612551+0000 mgr.gibba020.yqfnwy (mgr.34427) 328 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T13:58:17.958 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:17 gibba020 bash[25448]: audit 2021-03-10T13:58:16.612978+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2021-03-10T13:58:17.958 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:17 gibba020 bash[25448]: cephadm 2021-03-10T13:58:16.614576+0000 mgr.gibba020.yqfnwy (mgr.34427) 329 : cephadm [INF] Upgrade: Setting require_osd_release to 17 quincy 2021-03-10T13:58:17.959 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:17 gibba020 bash[25448]: audit 2021-03-10T13:58:16.617505+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd require-osd-release", "release": "quincy"}]: dispatch 2021-03-10T13:58:18.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:18 gibba013 bash[29418]: cephadm 2021-03-10T13:58:17.619613+0000 mgr.gibba020.yqfnwy (mgr.34427) 330 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T13:58:18.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:18 gibba013 bash[29418]: audit 2021-03-10T13:58:17.620356+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "osd require-osd-release", "release": "quincy"}]': finished 2021-03-10T13:58:18.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:18 gibba013 bash[29418]: cluster 2021-03-10T13:58:17.620399+0000 mon.a (mon.0) 638 : cluster [DBG] osdmap e100: 8 total, 7 up, 8 in 2021-03-10T13:58:18.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:18 gibba013 bash[29418]: cephadm 2021-03-10T13:58:17.620415+0000 mgr.gibba020.yqfnwy (mgr.34427) 331 : cephadm [INF] Upgrade: Setting container_image for all mds 2021-03-10T13:58:18.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:18 gibba013 bash[29418]: audit 2021-03-10T13:58:17.622189+0000 mon.a (mon.0) 639 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:18.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:18 gibba013 bash[29418]: cephadm 2021-03-10T13:58:17.624749+0000 mgr.gibba020.yqfnwy (mgr.34427) 332 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T13:58:18.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:18 gibba013 bash[29418]: cephadm 2021-03-10T13:58:17.624889+0000 mgr.gibba020.yqfnwy (mgr.34427) 333 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T13:58:18.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:18 gibba013 bash[29418]: cephadm 2021-03-10T13:58:17.625016+0000 mgr.gibba020.yqfnwy (mgr.34427) 334 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T13:58:18.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:18 gibba013 bash[29418]: audit 2021-03-10T13:58:17.626270+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:58:18.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:18 gibba013 bash[30381]: cephadm 2021-03-10T13:58:17.619613+0000 mgr.gibba020.yqfnwy (mgr.34427) 330 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T13:58:18.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:18 gibba013 bash[30381]: audit 2021-03-10T13:58:17.620356+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "osd require-osd-release", "release": "quincy"}]': finished 2021-03-10T13:58:18.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:18 gibba013 bash[30381]: cluster 2021-03-10T13:58:17.620399+0000 mon.a (mon.0) 638 : cluster [DBG] osdmap e100: 8 total, 7 up, 8 in 2021-03-10T13:58:18.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:18 gibba013 bash[30381]: cephadm 2021-03-10T13:58:17.620415+0000 mgr.gibba020.yqfnwy (mgr.34427) 331 : cephadm [INF] Upgrade: Setting container_image for all mds 2021-03-10T13:58:18.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:18 gibba013 bash[30381]: audit 2021-03-10T13:58:17.622189+0000 mon.a (mon.0) 639 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:18.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:18 gibba013 bash[30381]: cephadm 2021-03-10T13:58:17.624749+0000 mgr.gibba020.yqfnwy (mgr.34427) 332 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T13:58:18.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:18 gibba013 bash[30381]: cephadm 2021-03-10T13:58:17.624889+0000 mgr.gibba020.yqfnwy (mgr.34427) 333 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T13:58:18.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:18 gibba013 bash[30381]: cephadm 2021-03-10T13:58:17.625016+0000 mgr.gibba020.yqfnwy (mgr.34427) 334 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T13:58:18.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:18 gibba013 bash[30381]: audit 2021-03-10T13:58:17.626270+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:58:18.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:18 gibba020 bash[25448]: cephadm 2021-03-10T13:58:17.619613+0000 mgr.gibba020.yqfnwy (mgr.34427) 330 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T13:58:18.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:18 gibba020 bash[25448]: audit 2021-03-10T13:58:17.620356+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd='[{"prefix": "osd require-osd-release", "release": "quincy"}]': finished 2021-03-10T13:58:18.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:18 gibba020 bash[25448]: cluster 2021-03-10T13:58:17.620399+0000 mon.a (mon.0) 638 : cluster [DBG] osdmap e100: 8 total, 7 up, 8 in 2021-03-10T13:58:18.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:18 gibba020 bash[25448]: cephadm 2021-03-10T13:58:17.620415+0000 mgr.gibba020.yqfnwy (mgr.34427) 331 : cephadm [INF] Upgrade: Setting container_image for all mds 2021-03-10T13:58:18.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:18 gibba020 bash[25448]: audit 2021-03-10T13:58:17.622189+0000 mon.a (mon.0) 639 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:18.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:18 gibba020 bash[25448]: cephadm 2021-03-10T13:58:17.624749+0000 mgr.gibba020.yqfnwy (mgr.34427) 332 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T13:58:18.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:18 gibba020 bash[25448]: cephadm 2021-03-10T13:58:17.624889+0000 mgr.gibba020.yqfnwy (mgr.34427) 333 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T13:58:18.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:18 gibba020 bash[25448]: cephadm 2021-03-10T13:58:17.625016+0000 mgr.gibba020.yqfnwy (mgr.34427) 334 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T13:58:18.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:18 gibba020 bash[25448]: audit 2021-03-10T13:58:17.626270+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:58:19.639 INFO:journalctl@ceph.osd.7.gibba020.stdout:Mar 10 13:58:19 gibba020 bash[30980]: debug 2021-03-10T13:58:19.269+0000 7f35783cc080 -1 bluestore(/var/lib/ceph/osd/ceph-7) fsck warning: store not yet converted to per-pg omap 2021-03-10T13:58:19.639 INFO:journalctl@ceph.osd.7.gibba020.stdout:Mar 10 13:58:19 gibba020 bash[30980]: debug 2021-03-10T13:58:19.269+0000 7f3561e8e700 -1 bluestore(/var/lib/ceph/osd/ceph-7) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2021-03-10T13:58:19.639 INFO:journalctl@ceph.osd.7.gibba020.stdout:Mar 10 13:58:19 gibba020 bash[30980]: debug 2021-03-10T13:58:19.273+0000 7f3561e8e700 -1 bluestore(/var/lib/ceph/osd/ceph-7) fsck warning: #1:7baad65a:::INTEL_SSDPEL1K375GA_PHKM9200001J375A:head# has omap that is not per-pg or pgmeta 2021-03-10T13:58:19.639 INFO:journalctl@ceph.osd.7.gibba020.stdout:Mar 10 13:58:19 gibba020 bash[30980]: debug 2021-03-10T13:58:19.397+0000 7f35783cc080 -1 osd.7 97 log_to_monitors {default=true} 2021-03-10T13:58:19.948 INFO:journalctl@ceph.osd.7.gibba020.stdout:Mar 10 13:58:19 gibba020 bash[30980]: debug 2021-03-10T13:58:19.641+0000 7f35680a9700 -1 osd.7 97 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T13:58:19.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:19 gibba020 bash[25448]: cluster 2021-03-10T13:58:18.546522+0000 mgr.gibba020.yqfnwy (mgr.34427) 335 : cluster [DBG] pgmap v168: 129 pgs: 24 active+undersized+degraded, 33 active+undersized, 72 active+clean; 7.0 KiB data, 48 MiB used, 671 GiB / 672 GiB avail; 32/192 objects degraded (16.667%) 2021-03-10T13:58:19.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:19 gibba020 bash[25448]: audit 2021-03-10T13:58:19.404897+0000 mon.b (mon.2) 9 : audit [INF] from='osd.7 [v2:172.21.2.120:6824/1593093593,v1:172.21.2.120:6825/1593093593]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T13:58:19.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:19 gibba020 bash[25448]: audit 2021-03-10T13:58:19.408228+0000 mon.a (mon.0) 641 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T13:58:20.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:19 gibba013 bash[29418]: cluster 2021-03-10T13:58:18.546522+0000 mgr.gibba020.yqfnwy (mgr.34427) 335 : cluster [DBG] pgmap v168: 129 pgs: 24 active+undersized+degraded, 33 active+undersized, 72 active+clean; 7.0 KiB data, 48 MiB used, 671 GiB / 672 GiB avail; 32/192 objects degraded (16.667%) 2021-03-10T13:58:20.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:19 gibba013 bash[29418]: audit 2021-03-10T13:58:19.404897+0000 mon.b (mon.2) 9 : audit [INF] from='osd.7 [v2:172.21.2.120:6824/1593093593,v1:172.21.2.120:6825/1593093593]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T13:58:20.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:19 gibba013 bash[29418]: audit 2021-03-10T13:58:19.408228+0000 mon.a (mon.0) 641 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T13:58:20.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:19 gibba013 bash[30381]: cluster 2021-03-10T13:58:18.546522+0000 mgr.gibba020.yqfnwy (mgr.34427) 335 : cluster [DBG] pgmap v168: 129 pgs: 24 active+undersized+degraded, 33 active+undersized, 72 active+clean; 7.0 KiB data, 48 MiB used, 671 GiB / 672 GiB avail; 32/192 objects degraded (16.667%) 2021-03-10T13:58:20.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:19 gibba013 bash[30381]: audit 2021-03-10T13:58:19.404897+0000 mon.b (mon.2) 9 : audit [INF] from='osd.7 [v2:172.21.2.120:6824/1593093593,v1:172.21.2.120:6825/1593093593]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T13:58:20.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:19 gibba013 bash[30381]: audit 2021-03-10T13:58:19.408228+0000 mon.a (mon.0) 641 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T13:58:20.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:20 gibba020 bash[25448]: audit 2021-03-10T13:58:19.636906+0000 mon.b (mon.2) 10 : audit [INF] from='osd.7 [v2:172.21.2.120:6824/1593093593,v1:172.21.2.120:6825/1593093593]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:58:20.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:20 gibba020 bash[25448]: audit 2021-03-10T13:58:19.637831+0000 mon.a (mon.0) 642 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-03-10T13:58:20.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:20 gibba020 bash[25448]: cluster 2021-03-10T13:58:19.637909+0000 mon.a (mon.0) 643 : cluster [DBG] osdmap e101: 8 total, 7 up, 8 in 2021-03-10T13:58:20.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:20 gibba020 bash[25448]: audit 2021-03-10T13:58:19.641894+0000 mon.a (mon.0) 644 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:58:20.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:20 gibba020 bash[25448]: cluster 2021-03-10T13:58:19.797568+0000 mon.a (mon.0) 645 : cluster [WRN] Health check update: Degraded data redundancy: 32/192 objects degraded (16.667%), 24 pgs degraded (PG_DEGRADED) 2021-03-10T13:58:21.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:20 gibba013 bash[29418]: audit 2021-03-10T13:58:19.636906+0000 mon.b (mon.2) 10 : audit [INF] from='osd.7 [v2:172.21.2.120:6824/1593093593,v1:172.21.2.120:6825/1593093593]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:58:21.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:20 gibba013 bash[29418]: audit 2021-03-10T13:58:19.637831+0000 mon.a (mon.0) 642 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-03-10T13:58:21.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:20 gibba013 bash[29418]: cluster 2021-03-10T13:58:19.637909+0000 mon.a (mon.0) 643 : cluster [DBG] osdmap e101: 8 total, 7 up, 8 in 2021-03-10T13:58:21.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:20 gibba013 bash[29418]: audit 2021-03-10T13:58:19.641894+0000 mon.a (mon.0) 644 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:58:21.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:20 gibba013 bash[29418]: cluster 2021-03-10T13:58:19.797568+0000 mon.a (mon.0) 645 : cluster [WRN] Health check update: Degraded data redundancy: 32/192 objects degraded (16.667%), 24 pgs degraded (PG_DEGRADED) 2021-03-10T13:58:21.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:20 gibba013 bash[30381]: audit 2021-03-10T13:58:19.636906+0000 mon.b (mon.2) 10 : audit [INF] from='osd.7 [v2:172.21.2.120:6824/1593093593,v1:172.21.2.120:6825/1593093593]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:58:21.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:20 gibba013 bash[30381]: audit 2021-03-10T13:58:19.637831+0000 mon.a (mon.0) 642 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-03-10T13:58:21.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:20 gibba013 bash[30381]: cluster 2021-03-10T13:58:19.637909+0000 mon.a (mon.0) 643 : cluster [DBG] osdmap e101: 8 total, 7 up, 8 in 2021-03-10T13:58:21.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:20 gibba013 bash[30381]: audit 2021-03-10T13:58:19.641894+0000 mon.a (mon.0) 644 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba020", "root=default"]}]: dispatch 2021-03-10T13:58:21.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:20 gibba013 bash[30381]: cluster 2021-03-10T13:58:19.797568+0000 mon.a (mon.0) 645 : cluster [WRN] Health check update: Degraded data redundancy: 32/192 objects degraded (16.667%), 24 pgs degraded (PG_DEGRADED) 2021-03-10T13:58:21.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:21 gibba020 bash[25448]: cluster 2021-03-10T13:58:20.547069+0000 mgr.gibba020.yqfnwy (mgr.34427) 336 : cluster [DBG] pgmap v170: 129 pgs: 24 active+undersized+degraded, 33 active+undersized, 72 active+clean; 7.0 KiB data, 52 MiB used, 672 GiB / 672 GiB avail; 32/192 objects degraded (16.667%) 2021-03-10T13:58:21.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:21 gibba020 bash[25448]: cluster 2021-03-10T13:58:20.641408+0000 mon.a (mon.0) 646 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:58:21.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:21 gibba020 bash[25448]: cluster 2021-03-10T13:58:20.652587+0000 mon.a (mon.0) 647 : cluster [INF] osd.7 [v2:172.21.2.120:6824/1593093593,v1:172.21.2.120:6825/1593093593] boot 2021-03-10T13:58:21.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:21 gibba020 bash[25448]: cluster 2021-03-10T13:58:20.652626+0000 mon.a (mon.0) 648 : cluster [DBG] osdmap e102: 8 total, 8 up, 8 in 2021-03-10T13:58:21.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:21 gibba020 bash[25448]: audit 2021-03-10T13:58:20.653045+0000 mon.a (mon.0) 649 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:58:21.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:21 gibba020 bash[25448]: cluster 2021-03-10T13:58:21.648538+0000 mon.a (mon.0) 650 : cluster [DBG] osdmap e103: 8 total, 8 up, 8 in 2021-03-10T13:58:22.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:21 gibba013 bash[29418]: cluster 2021-03-10T13:58:20.547069+0000 mgr.gibba020.yqfnwy (mgr.34427) 336 : cluster [DBG] pgmap v170: 129 pgs: 24 active+undersized+degraded, 33 active+undersized, 72 active+clean; 7.0 KiB data, 52 MiB used, 672 GiB / 672 GiB avail; 32/192 objects degraded (16.667%) 2021-03-10T13:58:22.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:21 gibba013 bash[29418]: cluster 2021-03-10T13:58:20.641408+0000 mon.a (mon.0) 646 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:58:22.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:21 gibba013 bash[29418]: cluster 2021-03-10T13:58:20.652587+0000 mon.a (mon.0) 647 : cluster [INF] osd.7 [v2:172.21.2.120:6824/1593093593,v1:172.21.2.120:6825/1593093593] boot 2021-03-10T13:58:22.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:21 gibba013 bash[29418]: cluster 2021-03-10T13:58:20.652626+0000 mon.a (mon.0) 648 : cluster [DBG] osdmap e102: 8 total, 8 up, 8 in 2021-03-10T13:58:22.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:21 gibba013 bash[29418]: audit 2021-03-10T13:58:20.653045+0000 mon.a (mon.0) 649 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:58:22.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:21 gibba013 bash[29418]: cluster 2021-03-10T13:58:21.648538+0000 mon.a (mon.0) 650 : cluster [DBG] osdmap e103: 8 total, 8 up, 8 in 2021-03-10T13:58:22.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:21 gibba013 bash[30381]: cluster 2021-03-10T13:58:20.547069+0000 mgr.gibba020.yqfnwy (mgr.34427) 336 : cluster [DBG] pgmap v170: 129 pgs: 24 active+undersized+degraded, 33 active+undersized, 72 active+clean; 7.0 KiB data, 52 MiB used, 672 GiB / 672 GiB avail; 32/192 objects degraded (16.667%) 2021-03-10T13:58:22.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:21 gibba013 bash[30381]: cluster 2021-03-10T13:58:20.641408+0000 mon.a (mon.0) 646 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T13:58:22.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:21 gibba013 bash[30381]: cluster 2021-03-10T13:58:20.652587+0000 mon.a (mon.0) 647 : cluster [INF] osd.7 [v2:172.21.2.120:6824/1593093593,v1:172.21.2.120:6825/1593093593] boot 2021-03-10T13:58:22.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:21 gibba013 bash[30381]: cluster 2021-03-10T13:58:20.652626+0000 mon.a (mon.0) 648 : cluster [DBG] osdmap e102: 8 total, 8 up, 8 in 2021-03-10T13:58:22.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:21 gibba013 bash[30381]: audit 2021-03-10T13:58:20.653045+0000 mon.a (mon.0) 649 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T13:58:22.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:21 gibba013 bash[30381]: cluster 2021-03-10T13:58:21.648538+0000 mon.a (mon.0) 650 : cluster [DBG] osdmap e103: 8 total, 8 up, 8 in 2021-03-10T13:58:23.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:23 gibba020 bash[25448]: cluster 2021-03-10T13:58:22.548510+0000 mgr.gibba020.yqfnwy (mgr.34427) 337 : cluster [DBG] pgmap v173: 129 pgs: 9 peering, 17 active+undersized+degraded, 27 active+undersized, 76 active+clean; 7.0 KiB data, 53 MiB used, 672 GiB / 672 GiB avail; 22/192 objects degraded (11.458%) 2021-03-10T13:58:24.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:23 gibba013 bash[29418]: cluster 2021-03-10T13:58:22.548510+0000 mgr.gibba020.yqfnwy (mgr.34427) 337 : cluster [DBG] pgmap v173: 129 pgs: 9 peering, 17 active+undersized+degraded, 27 active+undersized, 76 active+clean; 7.0 KiB data, 53 MiB used, 672 GiB / 672 GiB avail; 22/192 objects degraded (11.458%) 2021-03-10T13:58:24.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:23 gibba013 bash[30381]: cluster 2021-03-10T13:58:22.548510+0000 mgr.gibba020.yqfnwy (mgr.34427) 337 : cluster [DBG] pgmap v173: 129 pgs: 9 peering, 17 active+undersized+degraded, 27 active+undersized, 76 active+clean; 7.0 KiB data, 53 MiB used, 672 GiB / 672 GiB avail; 22/192 objects degraded (11.458%) 2021-03-10T13:58:25.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:25 gibba020 bash[25448]: cluster 2021-03-10T13:58:24.550261+0000 mgr.gibba020.yqfnwy (mgr.34427) 338 : cluster [DBG] pgmap v174: 129 pgs: 9 peering, 11 active+undersized+degraded, 13 active+undersized, 96 active+clean; 7.0 KiB data, 53 MiB used, 672 GiB / 672 GiB avail; 15/192 objects degraded (7.812%) 2021-03-10T13:58:25.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:25 gibba020 bash[25448]: cluster 2021-03-10T13:58:24.799118+0000 mon.a (mon.0) 651 : cluster [WRN] Health check update: Degraded data redundancy: 15/192 objects degraded (7.812%), 11 pgs degraded (PG_DEGRADED) 2021-03-10T13:58:26.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:25 gibba013 bash[29418]: cluster 2021-03-10T13:58:24.550261+0000 mgr.gibba020.yqfnwy (mgr.34427) 338 : cluster [DBG] pgmap v174: 129 pgs: 9 peering, 11 active+undersized+degraded, 13 active+undersized, 96 active+clean; 7.0 KiB data, 53 MiB used, 672 GiB / 672 GiB avail; 15/192 objects degraded (7.812%) 2021-03-10T13:58:26.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:25 gibba013 bash[29418]: cluster 2021-03-10T13:58:24.799118+0000 mon.a (mon.0) 651 : cluster [WRN] Health check update: Degraded data redundancy: 15/192 objects degraded (7.812%), 11 pgs degraded (PG_DEGRADED) 2021-03-10T13:58:26.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:25 gibba013 bash[30381]: cluster 2021-03-10T13:58:24.550261+0000 mgr.gibba020.yqfnwy (mgr.34427) 338 : cluster [DBG] pgmap v174: 129 pgs: 9 peering, 11 active+undersized+degraded, 13 active+undersized, 96 active+clean; 7.0 KiB data, 53 MiB used, 672 GiB / 672 GiB avail; 15/192 objects degraded (7.812%) 2021-03-10T13:58:26.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:25 gibba013 bash[30381]: cluster 2021-03-10T13:58:24.799118+0000 mon.a (mon.0) 651 : cluster [WRN] Health check update: Degraded data redundancy: 15/192 objects degraded (7.812%), 11 pgs degraded (PG_DEGRADED) 2021-03-10T13:58:27.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:26 gibba013 bash[29418]: cluster 2021-03-10T13:58:26.673456+0000 mon.a (mon.0) 652 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 15/192 objects degraded (7.812%), 11 pgs degraded) 2021-03-10T13:58:27.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:26 gibba013 bash[30381]: cluster 2021-03-10T13:58:26.673456+0000 mon.a (mon.0) 652 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 15/192 objects degraded (7.812%), 11 pgs degraded) 2021-03-10T13:58:27.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:26 gibba020 bash[25448]: cluster 2021-03-10T13:58:26.673456+0000 mon.a (mon.0) 652 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 15/192 objects degraded (7.812%), 11 pgs degraded) 2021-03-10T13:58:28.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:27 gibba013 bash[29418]: cluster 2021-03-10T13:58:26.552025+0000 mgr.gibba020.yqfnwy (mgr.34427) 339 : cluster [DBG] pgmap v175: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:28.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:27 gibba013 bash[30381]: cluster 2021-03-10T13:58:26.552025+0000 mgr.gibba020.yqfnwy (mgr.34427) 339 : cluster [DBG] pgmap v175: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:28.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:27 gibba020 bash[25448]: cluster 2021-03-10T13:58:26.552025+0000 mgr.gibba020.yqfnwy (mgr.34427) 339 : cluster [DBG] pgmap v175: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:28.298 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T13:58:28.528 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:58:28.529 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (4m) 114s ago 10m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T13:58:28.529 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (10m) 12s ago 10m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T13:58:28.529 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (5m) 12s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T13:58:28.530 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (5m) 12s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T13:58:28.530 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (4m) 114s ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T13:58:28.530 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (4m) 114s ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T13:58:28.530 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (4m) 12s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T13:58:28.530 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (4m) 114s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T13:58:28.531 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (10m) 114s ago 10m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T13:58:28.531 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (10m) 12s ago 10m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T13:58:28.531 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3m) 114s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T13:58:28.531 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2m) 114s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T13:58:28.532 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2m) 114s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T13:58:28.532 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (118s) 114s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T13:58:28.532 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (91s) 12s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T13:58:28.532 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (65s) 12s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T13:58:28.532 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (40s) 12s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T13:58:28.533 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (13s) 12s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T13:58:28.533 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (9m) 12s ago 10m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T13:58:28.533 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 12s ago 8m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:58:28.785 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T13:58:28.786 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T13:58:28.786 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:58:28.786 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:58:28.787 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T13:58:28.787 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:58:28.787 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:58:28.787 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T13:58:28.788 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T13:58:28.788 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:58:28.788 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T13:58:28.788 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T13:58:28.788 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T13:58:28.789 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T13:58:28.789 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T13:58:30.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:29 gibba013 bash[29418]: audit 2021-03-10T13:58:28.287215+0000 mgr.gibba020.yqfnwy (mgr.34427) 340 : audit [DBG] from='client.44286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:58:30.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:29 gibba013 bash[29418]: audit 2021-03-10T13:58:28.514832+0000 mgr.gibba020.yqfnwy (mgr.34427) 341 : audit [DBG] from='client.44292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:58:30.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:29 gibba013 bash[29418]: cluster 2021-03-10T13:58:28.552512+0000 mgr.gibba020.yqfnwy (mgr.34427) 342 : cluster [DBG] pgmap v176: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:30.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:29 gibba013 bash[29418]: audit 2021-03-10T13:58:28.786660+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.2.113:0/2273954065' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:30.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:29 gibba013 bash[30381]: audit 2021-03-10T13:58:28.287215+0000 mgr.gibba020.yqfnwy (mgr.34427) 340 : audit [DBG] from='client.44286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:58:30.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:29 gibba013 bash[30381]: audit 2021-03-10T13:58:28.514832+0000 mgr.gibba020.yqfnwy (mgr.34427) 341 : audit [DBG] from='client.44292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:58:30.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:29 gibba013 bash[30381]: cluster 2021-03-10T13:58:28.552512+0000 mgr.gibba020.yqfnwy (mgr.34427) 342 : cluster [DBG] pgmap v176: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:30.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:29 gibba013 bash[30381]: audit 2021-03-10T13:58:28.786660+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.2.113:0/2273954065' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:30.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:29 gibba020 bash[25448]: audit 2021-03-10T13:58:28.287215+0000 mgr.gibba020.yqfnwy (mgr.34427) 340 : audit [DBG] from='client.44286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:58:30.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:29 gibba020 bash[25448]: audit 2021-03-10T13:58:28.514832+0000 mgr.gibba020.yqfnwy (mgr.34427) 341 : audit [DBG] from='client.44292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:58:30.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:29 gibba020 bash[25448]: cluster 2021-03-10T13:58:28.552512+0000 mgr.gibba020.yqfnwy (mgr.34427) 342 : cluster [DBG] pgmap v176: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:30.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:29 gibba020 bash[25448]: audit 2021-03-10T13:58:28.786660+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.2.113:0/2273954065' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:58:32.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:31 gibba020 bash[25448]: cluster 2021-03-10T13:58:30.553926+0000 mgr.gibba020.yqfnwy (mgr.34427) 343 : cluster [DBG] pgmap v177: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:32.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:31 gibba020 bash[25448]: audit 2021-03-10T13:58:30.936978+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:58:32.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:31 gibba013 bash[29418]: cluster 2021-03-10T13:58:30.553926+0000 mgr.gibba020.yqfnwy (mgr.34427) 343 : cluster [DBG] pgmap v177: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:32.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:31 gibba013 bash[29418]: audit 2021-03-10T13:58:30.936978+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:58:32.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:31 gibba013 bash[30381]: cluster 2021-03-10T13:58:30.553926+0000 mgr.gibba020.yqfnwy (mgr.34427) 343 : cluster [DBG] pgmap v177: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:32.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:31 gibba013 bash[30381]: audit 2021-03-10T13:58:30.936978+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:58:34.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:33 gibba020 bash[25448]: cluster 2021-03-10T13:58:32.555329+0000 mgr.gibba020.yqfnwy (mgr.34427) 344 : cluster [DBG] pgmap v178: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:34.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:33 gibba020 bash[25448]: cephadm 2021-03-10T13:58:32.640766+0000 mgr.gibba020.yqfnwy (mgr.34427) 345 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T13:58:34.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:33 gibba013 bash[29418]: cluster 2021-03-10T13:58:32.555329+0000 mgr.gibba020.yqfnwy (mgr.34427) 344 : cluster [DBG] pgmap v178: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:34.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:33 gibba013 bash[29418]: cephadm 2021-03-10T13:58:32.640766+0000 mgr.gibba020.yqfnwy (mgr.34427) 345 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T13:58:34.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:33 gibba013 bash[30381]: cluster 2021-03-10T13:58:32.555329+0000 mgr.gibba020.yqfnwy (mgr.34427) 344 : cluster [DBG] pgmap v178: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:34.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:33 gibba013 bash[30381]: cephadm 2021-03-10T13:58:32.640766+0000 mgr.gibba020.yqfnwy (mgr.34427) 345 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T13:58:36.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:35 gibba013 bash[29418]: cluster 2021-03-10T13:58:34.556792+0000 mgr.gibba020.yqfnwy (mgr.34427) 346 : cluster [DBG] pgmap v179: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:36.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:35 gibba013 bash[30381]: cluster 2021-03-10T13:58:34.556792+0000 mgr.gibba020.yqfnwy (mgr.34427) 346 : cluster [DBG] pgmap v179: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:36.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:35 gibba020 bash[25448]: cluster 2021-03-10T13:58:34.556792+0000 mgr.gibba020.yqfnwy (mgr.34427) 346 : cluster [DBG] pgmap v179: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:38.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:37 gibba013 bash[29418]: cluster 2021-03-10T13:58:36.557323+0000 mgr.gibba020.yqfnwy (mgr.34427) 347 : cluster [DBG] pgmap v180: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:38.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:37 gibba013 bash[30381]: cluster 2021-03-10T13:58:36.557323+0000 mgr.gibba020.yqfnwy (mgr.34427) 347 : cluster [DBG] pgmap v180: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:38.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:37 gibba020 bash[25448]: cluster 2021-03-10T13:58:36.557323+0000 mgr.gibba020.yqfnwy (mgr.34427) 347 : cluster [DBG] pgmap v180: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:40.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:39 gibba013 bash[29418]: cluster 2021-03-10T13:58:38.558582+0000 mgr.gibba020.yqfnwy (mgr.34427) 348 : cluster [DBG] pgmap v181: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:40.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:39 gibba013 bash[30381]: cluster 2021-03-10T13:58:38.558582+0000 mgr.gibba020.yqfnwy (mgr.34427) 348 : cluster [DBG] pgmap v181: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:40.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:39 gibba020 bash[25448]: cluster 2021-03-10T13:58:38.558582+0000 mgr.gibba020.yqfnwy (mgr.34427) 348 : cluster [DBG] pgmap v181: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:42.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:41 gibba013 bash[29418]: cluster 2021-03-10T13:58:40.560144+0000 mgr.gibba020.yqfnwy (mgr.34427) 349 : cluster [DBG] pgmap v182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:42.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:41 gibba013 bash[30381]: cluster 2021-03-10T13:58:40.560144+0000 mgr.gibba020.yqfnwy (mgr.34427) 349 : cluster [DBG] pgmap v182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:42.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:41 gibba020 bash[25448]: cluster 2021-03-10T13:58:40.560144+0000 mgr.gibba020.yqfnwy (mgr.34427) 349 : cluster [DBG] pgmap v182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:44.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:43 gibba013 bash[29418]: cluster 2021-03-10T13:58:42.561506+0000 mgr.gibba020.yqfnwy (mgr.34427) 350 : cluster [DBG] pgmap v183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:44.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:43 gibba013 bash[30381]: cluster 2021-03-10T13:58:42.561506+0000 mgr.gibba020.yqfnwy (mgr.34427) 350 : cluster [DBG] pgmap v183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:44.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:43 gibba020 bash[25448]: cluster 2021-03-10T13:58:42.561506+0000 mgr.gibba020.yqfnwy (mgr.34427) 350 : cluster [DBG] pgmap v183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:46.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:45 gibba013 bash[29418]: cluster 2021-03-10T13:58:44.562979+0000 mgr.gibba020.yqfnwy (mgr.34427) 351 : cluster [DBG] pgmap v184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:46.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:45 gibba013 bash[30381]: cluster 2021-03-10T13:58:44.562979+0000 mgr.gibba020.yqfnwy (mgr.34427) 351 : cluster [DBG] pgmap v184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:46.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:45 gibba020 bash[25448]: cluster 2021-03-10T13:58:44.562979+0000 mgr.gibba020.yqfnwy (mgr.34427) 351 : cluster [DBG] pgmap v184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:48.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:48 gibba013 bash[29418]: cluster 2021-03-10T13:58:46.564758+0000 mgr.gibba020.yqfnwy (mgr.34427) 352 : cluster [DBG] pgmap v185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:48.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:48 gibba013 bash[30381]: cluster 2021-03-10T13:58:46.564758+0000 mgr.gibba020.yqfnwy (mgr.34427) 352 : cluster [DBG] pgmap v185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:48.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:48 gibba020 bash[25448]: cluster 2021-03-10T13:58:46.564758+0000 mgr.gibba020.yqfnwy (mgr.34427) 352 : cluster [DBG] pgmap v185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:49.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:49 gibba013 bash[29418]: cephadm 2021-03-10T13:58:47.656821+0000 mgr.gibba020.yqfnwy (mgr.34427) 353 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T13:58:49.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:49 gibba013 bash[30381]: cephadm 2021-03-10T13:58:47.656821+0000 mgr.gibba020.yqfnwy (mgr.34427) 353 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T13:58:49.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:49 gibba020 bash[25448]: cephadm 2021-03-10T13:58:47.656821+0000 mgr.gibba020.yqfnwy (mgr.34427) 353 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T13:58:50.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:50 gibba013 bash[29418]: cluster 2021-03-10T13:58:48.566150+0000 mgr.gibba020.yqfnwy (mgr.34427) 354 : cluster [DBG] pgmap v186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:50.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:50 gibba013 bash[30381]: cluster 2021-03-10T13:58:48.566150+0000 mgr.gibba020.yqfnwy (mgr.34427) 354 : cluster [DBG] pgmap v186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:50.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:50 gibba020 bash[25448]: cluster 2021-03-10T13:58:48.566150+0000 mgr.gibba020.yqfnwy (mgr.34427) 354 : cluster [DBG] pgmap v186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:52.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:52 gibba013 bash[29418]: cluster 2021-03-10T13:58:50.567546+0000 mgr.gibba020.yqfnwy (mgr.34427) 355 : cluster [DBG] pgmap v187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:52.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:52 gibba013 bash[30381]: cluster 2021-03-10T13:58:50.567546+0000 mgr.gibba020.yqfnwy (mgr.34427) 355 : cluster [DBG] pgmap v187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:52.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:52 gibba020 bash[25448]: cluster 2021-03-10T13:58:50.567546+0000 mgr.gibba020.yqfnwy (mgr.34427) 355 : cluster [DBG] pgmap v187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:54.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:54 gibba013 bash[29418]: cluster 2021-03-10T13:58:52.568295+0000 mgr.gibba020.yqfnwy (mgr.34427) 356 : cluster [DBG] pgmap v188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:54.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:54 gibba013 bash[30381]: cluster 2021-03-10T13:58:52.568295+0000 mgr.gibba020.yqfnwy (mgr.34427) 356 : cluster [DBG] pgmap v188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:54.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:54 gibba020 bash[25448]: cluster 2021-03-10T13:58:52.568295+0000 mgr.gibba020.yqfnwy (mgr.34427) 356 : cluster [DBG] pgmap v188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:56.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:56 gibba013 bash[29418]: cluster 2021-03-10T13:58:54.569873+0000 mgr.gibba020.yqfnwy (mgr.34427) 357 : cluster [DBG] pgmap v189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:56.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:56 gibba013 bash[30381]: cluster 2021-03-10T13:58:54.569873+0000 mgr.gibba020.yqfnwy (mgr.34427) 357 : cluster [DBG] pgmap v189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:56.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:56 gibba020 bash[25448]: cluster 2021-03-10T13:58:54.569873+0000 mgr.gibba020.yqfnwy (mgr.34427) 357 : cluster [DBG] pgmap v189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:58.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:58:58 gibba013 bash[29418]: cluster 2021-03-10T13:58:56.571600+0000 mgr.gibba020.yqfnwy (mgr.34427) 358 : cluster [DBG] pgmap v190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:58.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:58:58 gibba013 bash[30381]: cluster 2021-03-10T13:58:56.571600+0000 mgr.gibba020.yqfnwy (mgr.34427) 358 : cluster [DBG] pgmap v190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:58.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:58:58 gibba020 bash[25448]: cluster 2021-03-10T13:58:56.571600+0000 mgr.gibba020.yqfnwy (mgr.34427) 358 : cluster [DBG] pgmap v190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:58:59.030 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T13:58:59.257 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:58:59.257 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (5m) 2m ago 10m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T13:58:59.258 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (10m) 42s ago 10m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T13:58:59.258 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (5m) 42s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T13:58:59.258 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (6m) 42s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T13:58:59.258 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (5m) 2m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T13:58:59.258 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (5m) 2m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T13:58:59.259 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (4m) 42s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T13:58:59.259 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (4m) 2m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T13:58:59.259 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (11m) 2m ago 11m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T13:58:59.259 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (11m) 42s ago 11m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T13:58:59.259 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3m) 2m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T13:58:59.260 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3m) 2m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T13:58:59.260 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2m) 2m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T13:58:59.260 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2m) 2m ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T13:58:59.260 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2m) 42s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T13:58:59.260 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (96s) 42s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T13:58:59.261 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (70s) 42s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T13:58:59.261 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (44s) 42s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T13:58:59.261 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (10m) 42s ago 11m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T13:58:59.261 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 42s ago 8m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:58:59.505 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T13:58:59.505 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T13:58:59.505 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:58:59.506 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:58:59.506 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T13:58:59.506 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:58:59.506 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:58:59.506 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T13:58:59.507 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T13:58:59.507 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:58:59.507 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T13:58:59.507 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T13:58:59.507 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T13:58:59.508 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T13:58:59.508 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T13:59:00.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:00 gibba013 bash[29418]: cluster 2021-03-10T13:58:58.572987+0000 mgr.gibba020.yqfnwy (mgr.34427) 359 : cluster [DBG] pgmap v191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:00.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:00 gibba013 bash[29418]: audit 2021-03-10T13:58:59.019373+0000 mgr.gibba020.yqfnwy (mgr.34427) 360 : audit [DBG] from='client.44304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:59:00.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:00 gibba013 bash[29418]: audit 2021-03-10T13:58:59.243978+0000 mgr.gibba020.yqfnwy (mgr.34427) 361 : audit [DBG] from='client.54295 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:59:00.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:00 gibba013 bash[29418]: audit 2021-03-10T13:58:59.506198+0000 mon.a (mon.0) 654 : audit [DBG] from='client.? 172.21.2.113:0/3498690657' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:00.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:00 gibba013 bash[30381]: cluster 2021-03-10T13:58:58.572987+0000 mgr.gibba020.yqfnwy (mgr.34427) 359 : cluster [DBG] pgmap v191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:00.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:00 gibba013 bash[30381]: audit 2021-03-10T13:58:59.019373+0000 mgr.gibba020.yqfnwy (mgr.34427) 360 : audit [DBG] from='client.44304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:59:00.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:00 gibba013 bash[30381]: audit 2021-03-10T13:58:59.243978+0000 mgr.gibba020.yqfnwy (mgr.34427) 361 : audit [DBG] from='client.54295 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:59:00.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:00 gibba013 bash[30381]: audit 2021-03-10T13:58:59.506198+0000 mon.a (mon.0) 654 : audit [DBG] from='client.? 172.21.2.113:0/3498690657' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:00.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:00 gibba020 bash[25448]: cluster 2021-03-10T13:58:58.572987+0000 mgr.gibba020.yqfnwy (mgr.34427) 359 : cluster [DBG] pgmap v191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:00.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:00 gibba020 bash[25448]: audit 2021-03-10T13:58:59.019373+0000 mgr.gibba020.yqfnwy (mgr.34427) 360 : audit [DBG] from='client.44304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:59:00.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:00 gibba020 bash[25448]: audit 2021-03-10T13:58:59.243978+0000 mgr.gibba020.yqfnwy (mgr.34427) 361 : audit [DBG] from='client.54295 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:59:00.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:00 gibba020 bash[25448]: audit 2021-03-10T13:58:59.506198+0000 mon.a (mon.0) 654 : audit [DBG] from='client.? 172.21.2.113:0/3498690657' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:02.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:02 gibba013 bash[29418]: cluster 2021-03-10T13:59:00.574640+0000 mgr.gibba020.yqfnwy (mgr.34427) 362 : cluster [DBG] pgmap v192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:02.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:02 gibba013 bash[30381]: cluster 2021-03-10T13:59:00.574640+0000 mgr.gibba020.yqfnwy (mgr.34427) 362 : cluster [DBG] pgmap v192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:02.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:02 gibba020 bash[25448]: cluster 2021-03-10T13:59:00.574640+0000 mgr.gibba020.yqfnwy (mgr.34427) 362 : cluster [DBG] pgmap v192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:04.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:04 gibba013 bash[29418]: cluster 2021-03-10T13:59:02.576148+0000 mgr.gibba020.yqfnwy (mgr.34427) 363 : cluster [DBG] pgmap v193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:04.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:04 gibba013 bash[29418]: cephadm 2021-03-10T13:59:02.672851+0000 mgr.gibba020.yqfnwy (mgr.34427) 364 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T13:59:04.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:04 gibba013 bash[30381]: cluster 2021-03-10T13:59:02.576148+0000 mgr.gibba020.yqfnwy (mgr.34427) 363 : cluster [DBG] pgmap v193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:04.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:04 gibba013 bash[30381]: cephadm 2021-03-10T13:59:02.672851+0000 mgr.gibba020.yqfnwy (mgr.34427) 364 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T13:59:04.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:04 gibba020 bash[25448]: cluster 2021-03-10T13:59:02.576148+0000 mgr.gibba020.yqfnwy (mgr.34427) 363 : cluster [DBG] pgmap v193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:04.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:04 gibba020 bash[25448]: cephadm 2021-03-10T13:59:02.672851+0000 mgr.gibba020.yqfnwy (mgr.34427) 364 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T13:59:06.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:06 gibba013 bash[29418]: cluster 2021-03-10T13:59:04.577734+0000 mgr.gibba020.yqfnwy (mgr.34427) 365 : cluster [DBG] pgmap v194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:06.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:06 gibba013 bash[29418]: audit 2021-03-10T13:59:05.761848+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T13:59:06.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:06 gibba013 bash[29418]: audit 2021-03-10T13:59:05.762616+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T13:59:06.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:06 gibba013 bash[29418]: audit 2021-03-10T13:59:05.763273+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T13:59:06.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:06 gibba013 bash[29418]: audit 2021-03-10T13:59:05.763915+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T13:59:06.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:06 gibba013 bash[29418]: audit 2021-03-10T13:59:05.882705+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:59:06.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:06 gibba013 bash[29418]: audit 2021-03-10T13:59:05.883380+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T13:59:06.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:06 gibba013 bash[30381]: cluster 2021-03-10T13:59:04.577734+0000 mgr.gibba020.yqfnwy (mgr.34427) 365 : cluster [DBG] pgmap v194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:06.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:06 gibba013 bash[30381]: audit 2021-03-10T13:59:05.761848+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T13:59:06.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:06 gibba013 bash[30381]: audit 2021-03-10T13:59:05.762616+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T13:59:06.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:06 gibba013 bash[30381]: audit 2021-03-10T13:59:05.763273+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T13:59:06.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:06 gibba013 bash[30381]: audit 2021-03-10T13:59:05.763915+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T13:59:06.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:06 gibba013 bash[30381]: audit 2021-03-10T13:59:05.882705+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:59:06.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:06 gibba013 bash[30381]: audit 2021-03-10T13:59:05.883380+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T13:59:06.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:06 gibba020 bash[25448]: cluster 2021-03-10T13:59:04.577734+0000 mgr.gibba020.yqfnwy (mgr.34427) 365 : cluster [DBG] pgmap v194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:06.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:06 gibba020 bash[25448]: audit 2021-03-10T13:59:05.761848+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T13:59:06.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:06 gibba020 bash[25448]: audit 2021-03-10T13:59:05.762616+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T13:59:06.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:06 gibba020 bash[25448]: audit 2021-03-10T13:59:05.763273+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T13:59:06.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:06 gibba020 bash[25448]: audit 2021-03-10T13:59:05.763915+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T13:59:06.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:06 gibba020 bash[25448]: audit 2021-03-10T13:59:05.882705+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T13:59:06.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:06 gibba020 bash[25448]: audit 2021-03-10T13:59:05.883380+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T13:59:08.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:08 gibba013 bash[29418]: cluster 2021-03-10T13:59:06.579458+0000 mgr.gibba020.yqfnwy (mgr.34427) 366 : cluster [DBG] pgmap v195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:08.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:08 gibba013 bash[30381]: cluster 2021-03-10T13:59:06.579458+0000 mgr.gibba020.yqfnwy (mgr.34427) 366 : cluster [DBG] pgmap v195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:08.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:08 gibba020 bash[25448]: cluster 2021-03-10T13:59:06.579458+0000 mgr.gibba020.yqfnwy (mgr.34427) 366 : cluster [DBG] pgmap v195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:10.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:10 gibba013 bash[29418]: cluster 2021-03-10T13:59:08.580347+0000 mgr.gibba020.yqfnwy (mgr.34427) 367 : cluster [DBG] pgmap v196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:10.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:10 gibba013 bash[30381]: cluster 2021-03-10T13:59:08.580347+0000 mgr.gibba020.yqfnwy (mgr.34427) 367 : cluster [DBG] pgmap v196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:10.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:10 gibba020 bash[25448]: cluster 2021-03-10T13:59:08.580347+0000 mgr.gibba020.yqfnwy (mgr.34427) 367 : cluster [DBG] pgmap v196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:12.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:12 gibba013 bash[29418]: cluster 2021-03-10T13:59:10.581808+0000 mgr.gibba020.yqfnwy (mgr.34427) 368 : cluster [DBG] pgmap v197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:12.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:12 gibba013 bash[30381]: cluster 2021-03-10T13:59:10.581808+0000 mgr.gibba020.yqfnwy (mgr.34427) 368 : cluster [DBG] pgmap v197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:12.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:12 gibba020 bash[25448]: cluster 2021-03-10T13:59:10.581808+0000 mgr.gibba020.yqfnwy (mgr.34427) 368 : cluster [DBG] pgmap v197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:14.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:14 gibba013 bash[29418]: cluster 2021-03-10T13:59:12.583304+0000 mgr.gibba020.yqfnwy (mgr.34427) 369 : cluster [DBG] pgmap v198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:14.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:14 gibba013 bash[30381]: cluster 2021-03-10T13:59:12.583304+0000 mgr.gibba020.yqfnwy (mgr.34427) 369 : cluster [DBG] pgmap v198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:14.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:14 gibba020 bash[25448]: cluster 2021-03-10T13:59:12.583304+0000 mgr.gibba020.yqfnwy (mgr.34427) 369 : cluster [DBG] pgmap v198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:16.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:16 gibba020 bash[25448]: cluster 2021-03-10T13:59:14.584816+0000 mgr.gibba020.yqfnwy (mgr.34427) 370 : cluster [DBG] pgmap v199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:16.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:16 gibba013 bash[29418]: cluster 2021-03-10T13:59:14.584816+0000 mgr.gibba020.yqfnwy (mgr.34427) 370 : cluster [DBG] pgmap v199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:16.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:16 gibba013 bash[30381]: cluster 2021-03-10T13:59:14.584816+0000 mgr.gibba020.yqfnwy (mgr.34427) 370 : cluster [DBG] pgmap v199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:18.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:18 gibba020 bash[25448]: cluster 2021-03-10T13:59:16.586274+0000 mgr.gibba020.yqfnwy (mgr.34427) 371 : cluster [DBG] pgmap v200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:18.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:18 gibba020 bash[25448]: audit 2021-03-10T13:59:17.679253+0000 mon.a (mon.0) 661 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:59:18.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:18 gibba020 bash[25448]: audit 2021-03-10T13:59:17.895101+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:59:18.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:18 gibba020 bash[25448]: audit 2021-03-10T13:59:17.898691+0000 mon.a (mon.0) 663 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:59:18.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:18 gibba020 bash[25448]: audit 2021-03-10T13:59:17.901472+0000 mon.a (mon.0) 664 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:18.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:18 gibba020 bash[25448]: audit 2021-03-10T13:59:17.903983+0000 mon.a (mon.0) 665 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:18.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:18 gibba020 bash[25448]: audit 2021-03-10T13:59:17.906152+0000 mon.a (mon.0) 666 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:18.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:18 gibba020 bash[25448]: audit 2021-03-10T13:59:17.910648+0000 mon.a (mon.0) 667 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:18.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:18 gibba020 bash[25448]: audit 2021-03-10T13:59:17.913029+0000 mon.a (mon.0) 668 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:18.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:18 gibba013 bash[29418]: cluster 2021-03-10T13:59:16.586274+0000 mgr.gibba020.yqfnwy (mgr.34427) 371 : cluster [DBG] pgmap v200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:18.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:18 gibba013 bash[29418]: audit 2021-03-10T13:59:17.679253+0000 mon.a (mon.0) 661 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:59:18.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:18 gibba013 bash[29418]: audit 2021-03-10T13:59:17.895101+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:59:18.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:18 gibba013 bash[29418]: audit 2021-03-10T13:59:17.898691+0000 mon.a (mon.0) 663 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:59:18.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:18 gibba013 bash[29418]: audit 2021-03-10T13:59:17.901472+0000 mon.a (mon.0) 664 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:18.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:18 gibba013 bash[29418]: audit 2021-03-10T13:59:17.903983+0000 mon.a (mon.0) 665 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:18.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:18 gibba013 bash[29418]: audit 2021-03-10T13:59:17.906152+0000 mon.a (mon.0) 666 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:18.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:18 gibba013 bash[29418]: audit 2021-03-10T13:59:17.910648+0000 mon.a (mon.0) 667 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:18.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:18 gibba013 bash[29418]: audit 2021-03-10T13:59:17.913029+0000 mon.a (mon.0) 668 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:18.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:18 gibba013 bash[30381]: cluster 2021-03-10T13:59:16.586274+0000 mgr.gibba020.yqfnwy (mgr.34427) 371 : cluster [DBG] pgmap v200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:18.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:18 gibba013 bash[30381]: audit 2021-03-10T13:59:17.679253+0000 mon.a (mon.0) 661 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:59:18.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:18 gibba013 bash[30381]: audit 2021-03-10T13:59:17.895101+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T13:59:18.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:18 gibba013 bash[30381]: audit 2021-03-10T13:59:17.898691+0000 mon.a (mon.0) 663 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T13:59:18.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:18 gibba013 bash[30381]: audit 2021-03-10T13:59:17.901472+0000 mon.a (mon.0) 664 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:18.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:18 gibba013 bash[30381]: audit 2021-03-10T13:59:17.903983+0000 mon.a (mon.0) 665 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:18.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:18 gibba013 bash[30381]: audit 2021-03-10T13:59:17.906152+0000 mon.a (mon.0) 666 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:18.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:18 gibba013 bash[30381]: audit 2021-03-10T13:59:17.910648+0000 mon.a (mon.0) 667 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:18.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:18 gibba013 bash[30381]: audit 2021-03-10T13:59:17.913029+0000 mon.a (mon.0) 668 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:19.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:19 gibba020 bash[25448]: cephadm 2021-03-10T13:59:17.678682+0000 mgr.gibba020.yqfnwy (mgr.34427) 372 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T13:59:19.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:19 gibba020 bash[25448]: cephadm 2021-03-10T13:59:17.679309+0000 mgr.gibba020.yqfnwy (mgr.34427) 373 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T13:59:19.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:19 gibba020 bash[25448]: cephadm 2021-03-10T13:59:17.895142+0000 mgr.gibba020.yqfnwy (mgr.34427) 374 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:59:19.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:19 gibba020 bash[25448]: cephadm 2021-03-10T13:59:17.898337+0000 mgr.gibba020.yqfnwy (mgr.34427) 375 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:59:19.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:19 gibba020 bash[25448]: cephadm 2021-03-10T13:59:17.900817+0000 mgr.gibba020.yqfnwy (mgr.34427) 376 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:59:19.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:19 gibba020 bash[25448]: cephadm 2021-03-10T13:59:17.900855+0000 mgr.gibba020.yqfnwy (mgr.34427) 377 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:59:19.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:19 gibba020 bash[25448]: cephadm 2021-03-10T13:59:17.903045+0000 mgr.gibba020.yqfnwy (mgr.34427) 378 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:59:19.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:19 gibba020 bash[25448]: cephadm 2021-03-10T13:59:17.903082+0000 mgr.gibba020.yqfnwy (mgr.34427) 379 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:59:19.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:19 gibba020 bash[25448]: cephadm 2021-03-10T13:59:17.905154+0000 mgr.gibba020.yqfnwy (mgr.34427) 380 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:59:19.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:19 gibba020 bash[25448]: cephadm 2021-03-10T13:59:17.907418+0000 mgr.gibba020.yqfnwy (mgr.34427) 381 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:59:19.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:19 gibba020 bash[25448]: cephadm 2021-03-10T13:59:17.907455+0000 mgr.gibba020.yqfnwy (mgr.34427) 382 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:59:19.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:19 gibba020 bash[25448]: cephadm 2021-03-10T13:59:17.909675+0000 mgr.gibba020.yqfnwy (mgr.34427) 383 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T13:59:19.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:19 gibba020 bash[25448]: cephadm 2021-03-10T13:59:17.909996+0000 mgr.gibba020.yqfnwy (mgr.34427) 384 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T13:59:19.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:19 gibba020 bash[25448]: cephadm 2021-03-10T13:59:17.912053+0000 mgr.gibba020.yqfnwy (mgr.34427) 385 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T13:59:19.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:19 gibba020 bash[25448]: cephadm 2021-03-10T13:59:17.912092+0000 mgr.gibba020.yqfnwy (mgr.34427) 386 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T13:59:19.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:19 gibba020 bash[25448]: cephadm 2021-03-10T13:59:17.912214+0000 mgr.gibba020.yqfnwy (mgr.34427) 387 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T13:59:19.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:19 gibba013 bash[29418]: cephadm 2021-03-10T13:59:17.678682+0000 mgr.gibba020.yqfnwy (mgr.34427) 372 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T13:59:19.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:19 gibba013 bash[29418]: cephadm 2021-03-10T13:59:17.679309+0000 mgr.gibba020.yqfnwy (mgr.34427) 373 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T13:59:19.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:19 gibba013 bash[29418]: cephadm 2021-03-10T13:59:17.895142+0000 mgr.gibba020.yqfnwy (mgr.34427) 374 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:59:19.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:19 gibba013 bash[29418]: cephadm 2021-03-10T13:59:17.898337+0000 mgr.gibba020.yqfnwy (mgr.34427) 375 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:59:19.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:19 gibba013 bash[29418]: cephadm 2021-03-10T13:59:17.900817+0000 mgr.gibba020.yqfnwy (mgr.34427) 376 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:59:19.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:19 gibba013 bash[29418]: cephadm 2021-03-10T13:59:17.900855+0000 mgr.gibba020.yqfnwy (mgr.34427) 377 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:59:19.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:19 gibba013 bash[29418]: cephadm 2021-03-10T13:59:17.903045+0000 mgr.gibba020.yqfnwy (mgr.34427) 378 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:59:19.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:19 gibba013 bash[29418]: cephadm 2021-03-10T13:59:17.903082+0000 mgr.gibba020.yqfnwy (mgr.34427) 379 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:59:19.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:19 gibba013 bash[29418]: cephadm 2021-03-10T13:59:17.905154+0000 mgr.gibba020.yqfnwy (mgr.34427) 380 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:59:19.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:19 gibba013 bash[29418]: cephadm 2021-03-10T13:59:17.907418+0000 mgr.gibba020.yqfnwy (mgr.34427) 381 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:59:19.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:19 gibba013 bash[29418]: cephadm 2021-03-10T13:59:17.907455+0000 mgr.gibba020.yqfnwy (mgr.34427) 382 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:59:19.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:19 gibba013 bash[29418]: cephadm 2021-03-10T13:59:17.909675+0000 mgr.gibba020.yqfnwy (mgr.34427) 383 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T13:59:19.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:19 gibba013 bash[29418]: cephadm 2021-03-10T13:59:17.909996+0000 mgr.gibba020.yqfnwy (mgr.34427) 384 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T13:59:19.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:19 gibba013 bash[29418]: cephadm 2021-03-10T13:59:17.912053+0000 mgr.gibba020.yqfnwy (mgr.34427) 385 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T13:59:19.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:19 gibba013 bash[29418]: cephadm 2021-03-10T13:59:17.912092+0000 mgr.gibba020.yqfnwy (mgr.34427) 386 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T13:59:19.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:19 gibba013 bash[29418]: cephadm 2021-03-10T13:59:17.912214+0000 mgr.gibba020.yqfnwy (mgr.34427) 387 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T13:59:19.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:19 gibba013 bash[30381]: cephadm 2021-03-10T13:59:17.678682+0000 mgr.gibba020.yqfnwy (mgr.34427) 372 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T13:59:19.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:19 gibba013 bash[30381]: cephadm 2021-03-10T13:59:17.679309+0000 mgr.gibba020.yqfnwy (mgr.34427) 373 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T13:59:19.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:19 gibba013 bash[30381]: cephadm 2021-03-10T13:59:17.895142+0000 mgr.gibba020.yqfnwy (mgr.34427) 374 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T13:59:19.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:19 gibba013 bash[30381]: cephadm 2021-03-10T13:59:17.898337+0000 mgr.gibba020.yqfnwy (mgr.34427) 375 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T13:59:19.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:19 gibba013 bash[30381]: cephadm 2021-03-10T13:59:17.900817+0000 mgr.gibba020.yqfnwy (mgr.34427) 376 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T13:59:19.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:19 gibba013 bash[30381]: cephadm 2021-03-10T13:59:17.900855+0000 mgr.gibba020.yqfnwy (mgr.34427) 377 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T13:59:19.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:19 gibba013 bash[30381]: cephadm 2021-03-10T13:59:17.903045+0000 mgr.gibba020.yqfnwy (mgr.34427) 378 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T13:59:19.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:19 gibba013 bash[30381]: cephadm 2021-03-10T13:59:17.903082+0000 mgr.gibba020.yqfnwy (mgr.34427) 379 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T13:59:19.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:19 gibba013 bash[30381]: cephadm 2021-03-10T13:59:17.905154+0000 mgr.gibba020.yqfnwy (mgr.34427) 380 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T13:59:19.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:19 gibba013 bash[30381]: cephadm 2021-03-10T13:59:17.907418+0000 mgr.gibba020.yqfnwy (mgr.34427) 381 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T13:59:19.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:19 gibba013 bash[30381]: cephadm 2021-03-10T13:59:17.907455+0000 mgr.gibba020.yqfnwy (mgr.34427) 382 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T13:59:19.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:19 gibba013 bash[30381]: cephadm 2021-03-10T13:59:17.909675+0000 mgr.gibba020.yqfnwy (mgr.34427) 383 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T13:59:19.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:19 gibba013 bash[30381]: cephadm 2021-03-10T13:59:17.909996+0000 mgr.gibba020.yqfnwy (mgr.34427) 384 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T13:59:19.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:19 gibba013 bash[30381]: cephadm 2021-03-10T13:59:17.912053+0000 mgr.gibba020.yqfnwy (mgr.34427) 385 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T13:59:19.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:19 gibba013 bash[30381]: cephadm 2021-03-10T13:59:17.912092+0000 mgr.gibba020.yqfnwy (mgr.34427) 386 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T13:59:19.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:19 gibba013 bash[30381]: cephadm 2021-03-10T13:59:17.912214+0000 mgr.gibba020.yqfnwy (mgr.34427) 387 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T13:59:20.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:20 gibba020 bash[25448]: cluster 2021-03-10T13:59:18.587632+0000 mgr.gibba020.yqfnwy (mgr.34427) 388 : cluster [DBG] pgmap v201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:20.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:20 gibba013 bash[29418]: cluster 2021-03-10T13:59:18.587632+0000 mgr.gibba020.yqfnwy (mgr.34427) 388 : cluster [DBG] pgmap v201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:20.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:20 gibba013 bash[30381]: cluster 2021-03-10T13:59:18.587632+0000 mgr.gibba020.yqfnwy (mgr.34427) 388 : cluster [DBG] pgmap v201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:22.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:22 gibba020 bash[25448]: cluster 2021-03-10T13:59:20.589124+0000 mgr.gibba020.yqfnwy (mgr.34427) 389 : cluster [DBG] pgmap v202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:22.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:22 gibba013 bash[29418]: cluster 2021-03-10T13:59:20.589124+0000 mgr.gibba020.yqfnwy (mgr.34427) 389 : cluster [DBG] pgmap v202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:22.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:22 gibba013 bash[30381]: cluster 2021-03-10T13:59:20.589124+0000 mgr.gibba020.yqfnwy (mgr.34427) 389 : cluster [DBG] pgmap v202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:24.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:24 gibba020 bash[25448]: cluster 2021-03-10T13:59:22.590509+0000 mgr.gibba020.yqfnwy (mgr.34427) 390 : cluster [DBG] pgmap v203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:24.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:24 gibba013 bash[29418]: cluster 2021-03-10T13:59:22.590509+0000 mgr.gibba020.yqfnwy (mgr.34427) 390 : cluster [DBG] pgmap v203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:24.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:24 gibba013 bash[30381]: cluster 2021-03-10T13:59:22.590509+0000 mgr.gibba020.yqfnwy (mgr.34427) 390 : cluster [DBG] pgmap v203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:26.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:26 gibba020 bash[25448]: cluster 2021-03-10T13:59:24.591331+0000 mgr.gibba020.yqfnwy (mgr.34427) 391 : cluster [DBG] pgmap v204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:26.627 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:26 gibba013 bash[30381]: cluster 2021-03-10T13:59:24.591331+0000 mgr.gibba020.yqfnwy (mgr.34427) 391 : cluster [DBG] pgmap v204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:26.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:26 gibba013 bash[29418]: cluster 2021-03-10T13:59:24.591331+0000 mgr.gibba020.yqfnwy (mgr.34427) 391 : cluster [DBG] pgmap v204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:28.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:28 gibba020 bash[25448]: cluster 2021-03-10T13:59:26.592924+0000 mgr.gibba020.yqfnwy (mgr.34427) 392 : cluster [DBG] pgmap v205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:28.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:28 gibba013 bash[29418]: cluster 2021-03-10T13:59:26.592924+0000 mgr.gibba020.yqfnwy (mgr.34427) 392 : cluster [DBG] pgmap v205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:28.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:28 gibba013 bash[30381]: cluster 2021-03-10T13:59:26.592924+0000 mgr.gibba020.yqfnwy (mgr.34427) 392 : cluster [DBG] pgmap v205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:29.746 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T13:59:29.974 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T13:59:29.974 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (5m) 2m ago 11m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T13:59:29.974 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (11m) 73s ago 11m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T13:59:29.975 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (6m) 73s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T13:59:29.975 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (6m) 73s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T13:59:29.975 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (5m) 2m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T13:59:29.975 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (5m) 2m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T13:59:29.975 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (5m) 73s ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T13:59:29.976 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (5m) 2m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T13:59:29.976 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (11m) 2m ago 11m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T13:59:29.976 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (11m) 73s ago 11m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T13:59:29.976 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (4m) 2m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T13:59:29.976 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3m) 2m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T13:59:29.977 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3m) 2m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T13:59:29.977 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2m) 2m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T13:59:29.977 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2m) 73s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T13:59:29.977 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2m) 73s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T13:59:29.977 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (101s) 73s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T13:59:29.978 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (75s) 73s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T13:59:29.978 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (10m) 73s ago 11m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T13:59:29.978 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 73s ago 9m docker.io/ceph/ceph:v15.2.0 2021-03-10T13:59:30.226 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T13:59:30.227 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T13:59:30.227 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:59:30.227 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:59:30.227 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T13:59:30.227 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T13:59:30.228 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:59:30.228 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T13:59:30.228 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T13:59:30.228 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T13:59:30.228 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T13:59:30.229 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T13:59:30.229 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T13:59:30.229 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T13:59:30.229 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T13:59:30.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:30 gibba020 bash[25448]: cluster 2021-03-10T13:59:28.594430+0000 mgr.gibba020.yqfnwy (mgr.34427) 393 : cluster [DBG] pgmap v206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:30.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:30 gibba013 bash[29418]: cluster 2021-03-10T13:59:28.594430+0000 mgr.gibba020.yqfnwy (mgr.34427) 393 : cluster [DBG] pgmap v206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:30.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:30 gibba013 bash[30381]: cluster 2021-03-10T13:59:28.594430+0000 mgr.gibba020.yqfnwy (mgr.34427) 393 : cluster [DBG] pgmap v206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:31.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:31 gibba013 bash[29418]: audit 2021-03-10T13:59:29.735513+0000 mgr.gibba020.yqfnwy (mgr.34427) 394 : audit [DBG] from='client.44322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:59:31.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:31 gibba013 bash[29418]: audit 2021-03-10T13:59:29.960345+0000 mgr.gibba020.yqfnwy (mgr.34427) 395 : audit [DBG] from='client.44328 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:59:31.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:31 gibba013 bash[29418]: audit 2021-03-10T13:59:30.227583+0000 mon.a (mon.0) 669 : audit [DBG] from='client.? 172.21.2.113:0/3246124599' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:31.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:31 gibba013 bash[30381]: audit 2021-03-10T13:59:29.735513+0000 mgr.gibba020.yqfnwy (mgr.34427) 394 : audit [DBG] from='client.44322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:59:31.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:31 gibba013 bash[30381]: audit 2021-03-10T13:59:29.960345+0000 mgr.gibba020.yqfnwy (mgr.34427) 395 : audit [DBG] from='client.44328 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:59:31.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:31 gibba013 bash[30381]: audit 2021-03-10T13:59:30.227583+0000 mon.a (mon.0) 669 : audit [DBG] from='client.? 172.21.2.113:0/3246124599' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:31.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:31 gibba020 bash[25448]: audit 2021-03-10T13:59:29.735513+0000 mgr.gibba020.yqfnwy (mgr.34427) 394 : audit [DBG] from='client.44322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:59:31.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:31 gibba020 bash[25448]: audit 2021-03-10T13:59:29.960345+0000 mgr.gibba020.yqfnwy (mgr.34427) 395 : audit [DBG] from='client.44328 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T13:59:31.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:31 gibba020 bash[25448]: audit 2021-03-10T13:59:30.227583+0000 mon.a (mon.0) 669 : audit [DBG] from='client.? 172.21.2.113:0/3246124599' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T13:59:32.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:32 gibba013 bash[29418]: cluster 2021-03-10T13:59:30.596133+0000 mgr.gibba020.yqfnwy (mgr.34427) 396 : cluster [DBG] pgmap v207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:32.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:32 gibba013 bash[30381]: cluster 2021-03-10T13:59:30.596133+0000 mgr.gibba020.yqfnwy (mgr.34427) 396 : cluster [DBG] pgmap v207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:32.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:32 gibba020 bash[25448]: cluster 2021-03-10T13:59:30.596133+0000 mgr.gibba020.yqfnwy (mgr.34427) 396 : cluster [DBG] pgmap v207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:34.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:34 gibba013 bash[29418]: cluster 2021-03-10T13:59:32.597391+0000 mgr.gibba020.yqfnwy (mgr.34427) 397 : cluster [DBG] pgmap v208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:34.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:34 gibba013 bash[29418]: cephadm 2021-03-10T13:59:32.921497+0000 mgr.gibba020.yqfnwy (mgr.34427) 398 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T13:59:34.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:34 gibba013 bash[30381]: cluster 2021-03-10T13:59:32.597391+0000 mgr.gibba020.yqfnwy (mgr.34427) 397 : cluster [DBG] pgmap v208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:34.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:34 gibba013 bash[30381]: cephadm 2021-03-10T13:59:32.921497+0000 mgr.gibba020.yqfnwy (mgr.34427) 398 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T13:59:34.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:34 gibba020 bash[25448]: cluster 2021-03-10T13:59:32.597391+0000 mgr.gibba020.yqfnwy (mgr.34427) 397 : cluster [DBG] pgmap v208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:34.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:34 gibba020 bash[25448]: cephadm 2021-03-10T13:59:32.921497+0000 mgr.gibba020.yqfnwy (mgr.34427) 398 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T13:59:36.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:36 gibba013 bash[29418]: cluster 2021-03-10T13:59:34.598931+0000 mgr.gibba020.yqfnwy (mgr.34427) 399 : cluster [DBG] pgmap v209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:36.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:36 gibba013 bash[30381]: cluster 2021-03-10T13:59:34.598931+0000 mgr.gibba020.yqfnwy (mgr.34427) 399 : cluster [DBG] pgmap v209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:36.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:36 gibba020 bash[25448]: cluster 2021-03-10T13:59:34.598931+0000 mgr.gibba020.yqfnwy (mgr.34427) 399 : cluster [DBG] pgmap v209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:38.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:38 gibba013 bash[29418]: cluster 2021-03-10T13:59:36.600662+0000 mgr.gibba020.yqfnwy (mgr.34427) 400 : cluster [DBG] pgmap v210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:38.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:38 gibba013 bash[30381]: cluster 2021-03-10T13:59:36.600662+0000 mgr.gibba020.yqfnwy (mgr.34427) 400 : cluster [DBG] pgmap v210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:38.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:38 gibba020 bash[25448]: cluster 2021-03-10T13:59:36.600662+0000 mgr.gibba020.yqfnwy (mgr.34427) 400 : cluster [DBG] pgmap v210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:40.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:40 gibba013 bash[29418]: cluster 2021-03-10T13:59:38.602030+0000 mgr.gibba020.yqfnwy (mgr.34427) 401 : cluster [DBG] pgmap v211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:40.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:40 gibba013 bash[30381]: cluster 2021-03-10T13:59:38.602030+0000 mgr.gibba020.yqfnwy (mgr.34427) 401 : cluster [DBG] pgmap v211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:40.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:40 gibba020 bash[25448]: cluster 2021-03-10T13:59:38.602030+0000 mgr.gibba020.yqfnwy (mgr.34427) 401 : cluster [DBG] pgmap v211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:42.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:42 gibba013 bash[29418]: cluster 2021-03-10T13:59:40.603469+0000 mgr.gibba020.yqfnwy (mgr.34427) 402 : cluster [DBG] pgmap v212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:42.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:42 gibba013 bash[30381]: cluster 2021-03-10T13:59:40.603469+0000 mgr.gibba020.yqfnwy (mgr.34427) 402 : cluster [DBG] pgmap v212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:42.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:42 gibba020 bash[25448]: cluster 2021-03-10T13:59:40.603469+0000 mgr.gibba020.yqfnwy (mgr.34427) 402 : cluster [DBG] pgmap v212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:44.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:44 gibba013 bash[29418]: cluster 2021-03-10T13:59:42.605021+0000 mgr.gibba020.yqfnwy (mgr.34427) 403 : cluster [DBG] pgmap v213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:44.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:44 gibba013 bash[30381]: cluster 2021-03-10T13:59:42.605021+0000 mgr.gibba020.yqfnwy (mgr.34427) 403 : cluster [DBG] pgmap v213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:44.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:44 gibba020 bash[25448]: cluster 2021-03-10T13:59:42.605021+0000 mgr.gibba020.yqfnwy (mgr.34427) 403 : cluster [DBG] pgmap v213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:46.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:46 gibba013 bash[29418]: cluster 2021-03-10T13:59:44.606341+0000 mgr.gibba020.yqfnwy (mgr.34427) 404 : cluster [DBG] pgmap v214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:46.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:46 gibba013 bash[30381]: cluster 2021-03-10T13:59:44.606341+0000 mgr.gibba020.yqfnwy (mgr.34427) 404 : cluster [DBG] pgmap v214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:46.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:46 gibba020 bash[25448]: cluster 2021-03-10T13:59:44.606341+0000 mgr.gibba020.yqfnwy (mgr.34427) 404 : cluster [DBG] pgmap v214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:47.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:47 gibba013 bash[29418]: cluster 2021-03-10T13:59:46.607783+0000 mgr.gibba020.yqfnwy (mgr.34427) 405 : cluster [DBG] pgmap v215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:47.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:47 gibba013 bash[30381]: cluster 2021-03-10T13:59:46.607783+0000 mgr.gibba020.yqfnwy (mgr.34427) 405 : cluster [DBG] pgmap v215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:47.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:47 gibba020 bash[25448]: cluster 2021-03-10T13:59:46.607783+0000 mgr.gibba020.yqfnwy (mgr.34427) 405 : cluster [DBG] pgmap v215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:48.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:48 gibba013 bash[29418]: cephadm 2021-03-10T13:59:47.937385+0000 mgr.gibba020.yqfnwy (mgr.34427) 406 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T13:59:48.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:48 gibba013 bash[30381]: cephadm 2021-03-10T13:59:47.937385+0000 mgr.gibba020.yqfnwy (mgr.34427) 406 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T13:59:48.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:48 gibba020 bash[25448]: cephadm 2021-03-10T13:59:47.937385+0000 mgr.gibba020.yqfnwy (mgr.34427) 406 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T13:59:49.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:49 gibba013 bash[29418]: cluster 2021-03-10T13:59:48.608775+0000 mgr.gibba020.yqfnwy (mgr.34427) 407 : cluster [DBG] pgmap v216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:49.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:49 gibba013 bash[30381]: cluster 2021-03-10T13:59:48.608775+0000 mgr.gibba020.yqfnwy (mgr.34427) 407 : cluster [DBG] pgmap v216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:49.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:49 gibba020 bash[25448]: cluster 2021-03-10T13:59:48.608775+0000 mgr.gibba020.yqfnwy (mgr.34427) 407 : cluster [DBG] pgmap v216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:52.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:51 gibba013 bash[29418]: cluster 2021-03-10T13:59:50.610333+0000 mgr.gibba020.yqfnwy (mgr.34427) 408 : cluster [DBG] pgmap v217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:52.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:51 gibba013 bash[30381]: cluster 2021-03-10T13:59:50.610333+0000 mgr.gibba020.yqfnwy (mgr.34427) 408 : cluster [DBG] pgmap v217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:52.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:51 gibba020 bash[25448]: cluster 2021-03-10T13:59:50.610333+0000 mgr.gibba020.yqfnwy (mgr.34427) 408 : cluster [DBG] pgmap v217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:54.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:53 gibba013 bash[29418]: cluster 2021-03-10T13:59:52.611873+0000 mgr.gibba020.yqfnwy (mgr.34427) 409 : cluster [DBG] pgmap v218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:54.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:53 gibba013 bash[30381]: cluster 2021-03-10T13:59:52.611873+0000 mgr.gibba020.yqfnwy (mgr.34427) 409 : cluster [DBG] pgmap v218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:54.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:53 gibba020 bash[25448]: cluster 2021-03-10T13:59:52.611873+0000 mgr.gibba020.yqfnwy (mgr.34427) 409 : cluster [DBG] pgmap v218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:56.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:55 gibba013 bash[29418]: cluster 2021-03-10T13:59:54.613214+0000 mgr.gibba020.yqfnwy (mgr.34427) 410 : cluster [DBG] pgmap v219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:56.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:55 gibba013 bash[30381]: cluster 2021-03-10T13:59:54.613214+0000 mgr.gibba020.yqfnwy (mgr.34427) 410 : cluster [DBG] pgmap v219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:56.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:55 gibba020 bash[25448]: cluster 2021-03-10T13:59:54.613214+0000 mgr.gibba020.yqfnwy (mgr.34427) 410 : cluster [DBG] pgmap v219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:58.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:57 gibba013 bash[29418]: cluster 2021-03-10T13:59:56.614297+0000 mgr.gibba020.yqfnwy (mgr.34427) 411 : cluster [DBG] pgmap v220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:58.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:57 gibba013 bash[30381]: cluster 2021-03-10T13:59:56.614297+0000 mgr.gibba020.yqfnwy (mgr.34427) 411 : cluster [DBG] pgmap v220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T13:59:58.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:57 gibba020 bash[25448]: cluster 2021-03-10T13:59:56.614297+0000 mgr.gibba020.yqfnwy (mgr.34427) 411 : cluster [DBG] pgmap v220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:00.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 13:59:59 gibba020 bash[25448]: cluster 2021-03-10T13:59:58.615501+0000 mgr.gibba020.yqfnwy (mgr.34427) 412 : cluster [DBG] pgmap v221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:00.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 13:59:59 gibba013 bash[29418]: cluster 2021-03-10T13:59:58.615501+0000 mgr.gibba020.yqfnwy (mgr.34427) 412 : cluster [DBG] pgmap v221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:00.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:00 gibba013 bash[29418]: debug 2021-03-10T13:59:59.995+0000 7fd718a82700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:00:00.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 13:59:59 gibba013 bash[30381]: cluster 2021-03-10T13:59:58.615501+0000 mgr.gibba020.yqfnwy (mgr.34427) 412 : cluster [DBG] pgmap v221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:00.471 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:00:00.699 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:00:00.700 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (6m) 3m ago 11m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:00:00.700 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (11m) 104s ago 11m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:00:00.700 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (6m) 104s ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:00:00.700 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (7m) 104s ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:00:00.701 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (6m) 3m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:00:00.701 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (6m) 3m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:00:00.701 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (5m) 104s ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:00:00.701 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (5m) 3m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:00:00.701 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (12m) 3m ago 12m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:00:00.702 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (12m) 104s ago 12m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:00:00.702 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (4m) 3m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:00:00.702 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (4m) 3m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:00:00.702 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3m) 3m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:00:00.702 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3m) 3m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:00:00.703 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3m) 104s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:00:00.703 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2m) 104s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:00:00.703 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2m) 104s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:00:00.703 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (105s) 104s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:00:00.703 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (11m) 104s ago 12m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:00:00.704 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 104s ago 10m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:00:00.950 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:00:00.951 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:00:00.951 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:00:00.951 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:00:00.952 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:00:00.952 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:00:00.952 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:00:00.952 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:00:00.952 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:00:00.953 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:00:00.953 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:00:00.953 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:00:00.953 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:00:00.954 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:00:00.954 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:00:01.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:00 gibba020 bash[25448]: cluster 2021-03-10T14:00:00.000260+0000 mon.a (mon.0) 670 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:00:01.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:00 gibba013 bash[29418]: cluster 2021-03-10T14:00:00.000260+0000 mon.a (mon.0) 670 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:00:01.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:00 gibba013 bash[30381]: cluster 2021-03-10T14:00:00.000260+0000 mon.a (mon.0) 670 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:00:02.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:01 gibba020 bash[25448]: audit 2021-03-10T14:00:00.460675+0000 mgr.gibba020.yqfnwy (mgr.34427) 413 : audit [DBG] from='client.44340 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:00:02.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:01 gibba020 bash[25448]: cluster 2021-03-10T14:00:00.617237+0000 mgr.gibba020.yqfnwy (mgr.34427) 414 : cluster [DBG] pgmap v222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:02.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:01 gibba020 bash[25448]: audit 2021-03-10T14:00:00.685442+0000 mgr.gibba020.yqfnwy (mgr.34427) 415 : audit [DBG] from='client.54331 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:00:02.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:01 gibba020 bash[25448]: audit 2021-03-10T14:00:00.951811+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.2.113:0/3147917201' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:02.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:01 gibba013 bash[29418]: audit 2021-03-10T14:00:00.460675+0000 mgr.gibba020.yqfnwy (mgr.34427) 413 : audit [DBG] from='client.44340 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:00:02.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:01 gibba013 bash[29418]: cluster 2021-03-10T14:00:00.617237+0000 mgr.gibba020.yqfnwy (mgr.34427) 414 : cluster [DBG] pgmap v222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:02.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:01 gibba013 bash[29418]: audit 2021-03-10T14:00:00.685442+0000 mgr.gibba020.yqfnwy (mgr.34427) 415 : audit [DBG] from='client.54331 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:00:02.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:01 gibba013 bash[29418]: audit 2021-03-10T14:00:00.951811+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.2.113:0/3147917201' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:02.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:01 gibba013 bash[30381]: audit 2021-03-10T14:00:00.460675+0000 mgr.gibba020.yqfnwy (mgr.34427) 413 : audit [DBG] from='client.44340 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:00:02.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:01 gibba013 bash[30381]: cluster 2021-03-10T14:00:00.617237+0000 mgr.gibba020.yqfnwy (mgr.34427) 414 : cluster [DBG] pgmap v222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:02.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:01 gibba013 bash[30381]: audit 2021-03-10T14:00:00.685442+0000 mgr.gibba020.yqfnwy (mgr.34427) 415 : audit [DBG] from='client.54331 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:00:02.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:01 gibba013 bash[30381]: audit 2021-03-10T14:00:00.951811+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.2.113:0/3147917201' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:04.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:03 gibba020 bash[25448]: cluster 2021-03-10T14:00:02.618663+0000 mgr.gibba020.yqfnwy (mgr.34427) 416 : cluster [DBG] pgmap v223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:04.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:03 gibba020 bash[25448]: cephadm 2021-03-10T14:00:02.953265+0000 mgr.gibba020.yqfnwy (mgr.34427) 417 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:00:04.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:03 gibba013 bash[29418]: cluster 2021-03-10T14:00:02.618663+0000 mgr.gibba020.yqfnwy (mgr.34427) 416 : cluster [DBG] pgmap v223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:04.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:03 gibba013 bash[29418]: cephadm 2021-03-10T14:00:02.953265+0000 mgr.gibba020.yqfnwy (mgr.34427) 417 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:00:04.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:03 gibba013 bash[30381]: cluster 2021-03-10T14:00:02.618663+0000 mgr.gibba020.yqfnwy (mgr.34427) 416 : cluster [DBG] pgmap v223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:04.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:03 gibba013 bash[30381]: cephadm 2021-03-10T14:00:02.953265+0000 mgr.gibba020.yqfnwy (mgr.34427) 417 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:00:06.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:05 gibba020 bash[25448]: cluster 2021-03-10T14:00:04.620050+0000 mgr.gibba020.yqfnwy (mgr.34427) 418 : cluster [DBG] pgmap v224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:06.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:05 gibba020 bash[25448]: audit 2021-03-10T14:00:05.771780+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T14:00:06.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:05 gibba020 bash[25448]: audit 2021-03-10T14:00:05.772518+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:00:06.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:05 gibba020 bash[25448]: audit 2021-03-10T14:00:05.773181+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:00:06.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:05 gibba020 bash[25448]: audit 2021-03-10T14:00:05.773833+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:00:06.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:05 gibba020 bash[25448]: audit 2021-03-10T14:00:05.902730+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:00:06.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:05 gibba020 bash[25448]: audit 2021-03-10T14:00:05.903356+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:00:06.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:05 gibba013 bash[29418]: cluster 2021-03-10T14:00:04.620050+0000 mgr.gibba020.yqfnwy (mgr.34427) 418 : cluster [DBG] pgmap v224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:06.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:05 gibba013 bash[29418]: audit 2021-03-10T14:00:05.771780+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T14:00:06.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:05 gibba013 bash[29418]: audit 2021-03-10T14:00:05.772518+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:00:06.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:05 gibba013 bash[29418]: audit 2021-03-10T14:00:05.773181+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:00:06.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:05 gibba013 bash[29418]: audit 2021-03-10T14:00:05.773833+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:00:06.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:05 gibba013 bash[29418]: audit 2021-03-10T14:00:05.902730+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:00:06.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:05 gibba013 bash[29418]: audit 2021-03-10T14:00:05.903356+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:00:06.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:05 gibba013 bash[30381]: cluster 2021-03-10T14:00:04.620050+0000 mgr.gibba020.yqfnwy (mgr.34427) 418 : cluster [DBG] pgmap v224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:06.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:05 gibba013 bash[30381]: audit 2021-03-10T14:00:05.771780+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T14:00:06.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:05 gibba013 bash[30381]: audit 2021-03-10T14:00:05.772518+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:00:06.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:05 gibba013 bash[30381]: audit 2021-03-10T14:00:05.773181+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:00:06.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:05 gibba013 bash[30381]: audit 2021-03-10T14:00:05.773833+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:00:06.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:05 gibba013 bash[30381]: audit 2021-03-10T14:00:05.902730+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:00:06.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:05 gibba013 bash[30381]: audit 2021-03-10T14:00:05.903356+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:00:08.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:07 gibba020 bash[25448]: cluster 2021-03-10T14:00:06.621845+0000 mgr.gibba020.yqfnwy (mgr.34427) 419 : cluster [DBG] pgmap v225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:08.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:07 gibba013 bash[29418]: cluster 2021-03-10T14:00:06.621845+0000 mgr.gibba020.yqfnwy (mgr.34427) 419 : cluster [DBG] pgmap v225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:08.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:07 gibba013 bash[30381]: cluster 2021-03-10T14:00:06.621845+0000 mgr.gibba020.yqfnwy (mgr.34427) 419 : cluster [DBG] pgmap v225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:10.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:09 gibba020 bash[25448]: cluster 2021-03-10T14:00:08.623251+0000 mgr.gibba020.yqfnwy (mgr.34427) 420 : cluster [DBG] pgmap v226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:10.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:09 gibba013 bash[29418]: cluster 2021-03-10T14:00:08.623251+0000 mgr.gibba020.yqfnwy (mgr.34427) 420 : cluster [DBG] pgmap v226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:10.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:09 gibba013 bash[30381]: cluster 2021-03-10T14:00:08.623251+0000 mgr.gibba020.yqfnwy (mgr.34427) 420 : cluster [DBG] pgmap v226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:12.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:11 gibba020 bash[25448]: cluster 2021-03-10T14:00:10.624978+0000 mgr.gibba020.yqfnwy (mgr.34427) 421 : cluster [DBG] pgmap v227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:12.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:11 gibba013 bash[29418]: cluster 2021-03-10T14:00:10.624978+0000 mgr.gibba020.yqfnwy (mgr.34427) 421 : cluster [DBG] pgmap v227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:12.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:11 gibba013 bash[30381]: cluster 2021-03-10T14:00:10.624978+0000 mgr.gibba020.yqfnwy (mgr.34427) 421 : cluster [DBG] pgmap v227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:14.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:13 gibba013 bash[29418]: cluster 2021-03-10T14:00:12.626117+0000 mgr.gibba020.yqfnwy (mgr.34427) 422 : cluster [DBG] pgmap v228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:14.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:13 gibba013 bash[30381]: cluster 2021-03-10T14:00:12.626117+0000 mgr.gibba020.yqfnwy (mgr.34427) 422 : cluster [DBG] pgmap v228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:14.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:13 gibba020 bash[25448]: cluster 2021-03-10T14:00:12.626117+0000 mgr.gibba020.yqfnwy (mgr.34427) 422 : cluster [DBG] pgmap v228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:16.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:15 gibba013 bash[29418]: cluster 2021-03-10T14:00:14.627407+0000 mgr.gibba020.yqfnwy (mgr.34427) 423 : cluster [DBG] pgmap v229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:16.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:15 gibba013 bash[30381]: cluster 2021-03-10T14:00:14.627407+0000 mgr.gibba020.yqfnwy (mgr.34427) 423 : cluster [DBG] pgmap v229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:16.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:15 gibba020 bash[25448]: cluster 2021-03-10T14:00:14.627407+0000 mgr.gibba020.yqfnwy (mgr.34427) 423 : cluster [DBG] pgmap v229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:18.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:17 gibba013 bash[29418]: cluster 2021-03-10T14:00:16.628890+0000 mgr.gibba020.yqfnwy (mgr.34427) 424 : cluster [DBG] pgmap v230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:18.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:17 gibba013 bash[30381]: cluster 2021-03-10T14:00:16.628890+0000 mgr.gibba020.yqfnwy (mgr.34427) 424 : cluster [DBG] pgmap v230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:18.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:17 gibba020 bash[25448]: cluster 2021-03-10T14:00:16.628890+0000 mgr.gibba020.yqfnwy (mgr.34427) 424 : cluster [DBG] pgmap v230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:19.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[29418]: cephadm 2021-03-10T14:00:17.974094+0000 mgr.gibba020.yqfnwy (mgr.34427) 425 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:00:19.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[29418]: cephadm 2021-03-10T14:00:17.974572+0000 mgr.gibba020.yqfnwy (mgr.34427) 426 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:00:19.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[29418]: audit 2021-03-10T14:00:17.974833+0000 mon.a (mon.0) 677 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:00:19.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[29418]: cephadm 2021-03-10T14:00:18.167785+0000 mgr.gibba020.yqfnwy (mgr.34427) 427 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:00:19.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[29418]: audit 2021-03-10T14:00:18.168210+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:00:19.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[29418]: cephadm 2021-03-10T14:00:18.169383+0000 mgr.gibba020.yqfnwy (mgr.34427) 428 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:00:19.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[29418]: cephadm 2021-03-10T14:00:18.170448+0000 mgr.gibba020.yqfnwy (mgr.34427) 429 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:00:19.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[29418]: cephadm 2021-03-10T14:00:18.170500+0000 mgr.gibba020.yqfnwy (mgr.34427) 430 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:00:19.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[29418]: audit 2021-03-10T14:00:18.171368+0000 mon.a (mon.0) 679 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:00:19.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[29418]: cephadm 2021-03-10T14:00:18.171489+0000 mgr.gibba020.yqfnwy (mgr.34427) 431 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:00:19.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[29418]: cephadm 2021-03-10T14:00:18.171523+0000 mgr.gibba020.yqfnwy (mgr.34427) 432 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:00:19.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[29418]: cephadm 2021-03-10T14:00:18.172506+0000 mgr.gibba020.yqfnwy (mgr.34427) 433 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:00:19.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[29418]: audit 2021-03-10T14:00:18.172641+0000 mon.a (mon.0) 680 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:19.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[29418]: cephadm 2021-03-10T14:00:18.173314+0000 mgr.gibba020.yqfnwy (mgr.34427) 434 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:00:19.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[29418]: cephadm 2021-03-10T14:00:18.173351+0000 mgr.gibba020.yqfnwy (mgr.34427) 435 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:00:19.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[29418]: audit 2021-03-10T14:00:18.173790+0000 mon.a (mon.0) 681 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:19.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[29418]: cephadm 2021-03-10T14:00:18.174639+0000 mgr.gibba020.yqfnwy (mgr.34427) 436 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:00:19.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[29418]: audit 2021-03-10T14:00:18.174671+0000 mon.a (mon.0) 682 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:19.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[29418]: cephadm 2021-03-10T14:00:18.174984+0000 mgr.gibba020.yqfnwy (mgr.34427) 437 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:00:19.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[29418]: cephadm 2021-03-10T14:00:18.176142+0000 mgr.gibba020.yqfnwy (mgr.34427) 438 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:00:19.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[29418]: cephadm 2021-03-10T14:00:18.176180+0000 mgr.gibba020.yqfnwy (mgr.34427) 439 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:00:19.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[30381]: cephadm 2021-03-10T14:00:17.974094+0000 mgr.gibba020.yqfnwy (mgr.34427) 425 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:00:19.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[30381]: cephadm 2021-03-10T14:00:17.974572+0000 mgr.gibba020.yqfnwy (mgr.34427) 426 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:00:19.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[30381]: audit 2021-03-10T14:00:17.974833+0000 mon.a (mon.0) 677 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:00:19.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[30381]: cephadm 2021-03-10T14:00:18.167785+0000 mgr.gibba020.yqfnwy (mgr.34427) 427 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:00:19.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[30381]: audit 2021-03-10T14:00:18.168210+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:00:19.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[30381]: cephadm 2021-03-10T14:00:18.169383+0000 mgr.gibba020.yqfnwy (mgr.34427) 428 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:00:19.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[30381]: cephadm 2021-03-10T14:00:18.170448+0000 mgr.gibba020.yqfnwy (mgr.34427) 429 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:00:19.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[30381]: cephadm 2021-03-10T14:00:18.170500+0000 mgr.gibba020.yqfnwy (mgr.34427) 430 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:00:19.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[30381]: audit 2021-03-10T14:00:18.171368+0000 mon.a (mon.0) 679 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:00:19.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[30381]: cephadm 2021-03-10T14:00:18.171489+0000 mgr.gibba020.yqfnwy (mgr.34427) 431 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:00:19.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[30381]: cephadm 2021-03-10T14:00:18.171523+0000 mgr.gibba020.yqfnwy (mgr.34427) 432 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:00:19.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[30381]: cephadm 2021-03-10T14:00:18.172506+0000 mgr.gibba020.yqfnwy (mgr.34427) 433 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:00:19.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[30381]: audit 2021-03-10T14:00:18.172641+0000 mon.a (mon.0) 680 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:19.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[30381]: cephadm 2021-03-10T14:00:18.173314+0000 mgr.gibba020.yqfnwy (mgr.34427) 434 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:00:19.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[30381]: cephadm 2021-03-10T14:00:18.173351+0000 mgr.gibba020.yqfnwy (mgr.34427) 435 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:00:19.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[30381]: audit 2021-03-10T14:00:18.173790+0000 mon.a (mon.0) 681 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:19.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[30381]: cephadm 2021-03-10T14:00:18.174639+0000 mgr.gibba020.yqfnwy (mgr.34427) 436 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:00:19.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[30381]: audit 2021-03-10T14:00:18.174671+0000 mon.a (mon.0) 682 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:19.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[30381]: cephadm 2021-03-10T14:00:18.174984+0000 mgr.gibba020.yqfnwy (mgr.34427) 437 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:00:19.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[30381]: cephadm 2021-03-10T14:00:18.176142+0000 mgr.gibba020.yqfnwy (mgr.34427) 438 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:00:19.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[30381]: cephadm 2021-03-10T14:00:18.176180+0000 mgr.gibba020.yqfnwy (mgr.34427) 439 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:00:19.390 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[29418]: cephadm 2021-03-10T14:00:18.176285+0000 mgr.gibba020.yqfnwy (mgr.34427) 440 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:00:19.390 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[29418]: audit 2021-03-10T14:00:18.176777+0000 mon.a (mon.0) 683 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:19.391 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[29418]: audit 2021-03-10T14:00:18.178242+0000 mon.a (mon.0) 684 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:19.391 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[30381]: cephadm 2021-03-10T14:00:18.176285+0000 mgr.gibba020.yqfnwy (mgr.34427) 440 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:00:19.391 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[30381]: audit 2021-03-10T14:00:18.176777+0000 mon.a (mon.0) 683 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:19.391 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:18 gibba013 bash[30381]: audit 2021-03-10T14:00:18.178242+0000 mon.a (mon.0) 684 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:19.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:18 gibba020 bash[25448]: cephadm 2021-03-10T14:00:17.974094+0000 mgr.gibba020.yqfnwy (mgr.34427) 425 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:00:19.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:18 gibba020 bash[25448]: cephadm 2021-03-10T14:00:17.974572+0000 mgr.gibba020.yqfnwy (mgr.34427) 426 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:00:19.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:18 gibba020 bash[25448]: audit 2021-03-10T14:00:17.974833+0000 mon.a (mon.0) 677 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:00:19.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:18 gibba020 bash[25448]: cephadm 2021-03-10T14:00:18.167785+0000 mgr.gibba020.yqfnwy (mgr.34427) 427 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:00:19.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:18 gibba020 bash[25448]: audit 2021-03-10T14:00:18.168210+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:00:19.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:18 gibba020 bash[25448]: cephadm 2021-03-10T14:00:18.169383+0000 mgr.gibba020.yqfnwy (mgr.34427) 428 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:00:19.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:18 gibba020 bash[25448]: cephadm 2021-03-10T14:00:18.170448+0000 mgr.gibba020.yqfnwy (mgr.34427) 429 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:00:19.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:18 gibba020 bash[25448]: cephadm 2021-03-10T14:00:18.170500+0000 mgr.gibba020.yqfnwy (mgr.34427) 430 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:00:19.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:18 gibba020 bash[25448]: audit 2021-03-10T14:00:18.171368+0000 mon.a (mon.0) 679 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:00:19.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:18 gibba020 bash[25448]: cephadm 2021-03-10T14:00:18.171489+0000 mgr.gibba020.yqfnwy (mgr.34427) 431 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:00:19.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:18 gibba020 bash[25448]: cephadm 2021-03-10T14:00:18.171523+0000 mgr.gibba020.yqfnwy (mgr.34427) 432 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:00:19.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:18 gibba020 bash[25448]: cephadm 2021-03-10T14:00:18.172506+0000 mgr.gibba020.yqfnwy (mgr.34427) 433 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:00:19.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:18 gibba020 bash[25448]: audit 2021-03-10T14:00:18.172641+0000 mon.a (mon.0) 680 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:19.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:18 gibba020 bash[25448]: cephadm 2021-03-10T14:00:18.173314+0000 mgr.gibba020.yqfnwy (mgr.34427) 434 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:00:19.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:18 gibba020 bash[25448]: cephadm 2021-03-10T14:00:18.173351+0000 mgr.gibba020.yqfnwy (mgr.34427) 435 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:00:19.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:18 gibba020 bash[25448]: audit 2021-03-10T14:00:18.173790+0000 mon.a (mon.0) 681 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:19.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:18 gibba020 bash[25448]: cephadm 2021-03-10T14:00:18.174639+0000 mgr.gibba020.yqfnwy (mgr.34427) 436 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:00:19.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:18 gibba020 bash[25448]: audit 2021-03-10T14:00:18.174671+0000 mon.a (mon.0) 682 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:19.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:18 gibba020 bash[25448]: cephadm 2021-03-10T14:00:18.174984+0000 mgr.gibba020.yqfnwy (mgr.34427) 437 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:00:19.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:18 gibba020 bash[25448]: cephadm 2021-03-10T14:00:18.176142+0000 mgr.gibba020.yqfnwy (mgr.34427) 438 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:00:19.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:18 gibba020 bash[25448]: cephadm 2021-03-10T14:00:18.176180+0000 mgr.gibba020.yqfnwy (mgr.34427) 439 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:00:19.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:18 gibba020 bash[25448]: cephadm 2021-03-10T14:00:18.176285+0000 mgr.gibba020.yqfnwy (mgr.34427) 440 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:00:19.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:18 gibba020 bash[25448]: audit 2021-03-10T14:00:18.176777+0000 mon.a (mon.0) 683 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:19.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:18 gibba020 bash[25448]: audit 2021-03-10T14:00:18.178242+0000 mon.a (mon.0) 684 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:20.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:20 gibba020 bash[25448]: cluster 2021-03-10T14:00:18.630264+0000 mgr.gibba020.yqfnwy (mgr.34427) 441 : cluster [DBG] pgmap v231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:20.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:20 gibba013 bash[29418]: cluster 2021-03-10T14:00:18.630264+0000 mgr.gibba020.yqfnwy (mgr.34427) 441 : cluster [DBG] pgmap v231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:20.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:20 gibba013 bash[30381]: cluster 2021-03-10T14:00:18.630264+0000 mgr.gibba020.yqfnwy (mgr.34427) 441 : cluster [DBG] pgmap v231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:22.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:22 gibba020 bash[25448]: cluster 2021-03-10T14:00:20.631753+0000 mgr.gibba020.yqfnwy (mgr.34427) 442 : cluster [DBG] pgmap v232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:22.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:22 gibba013 bash[29418]: cluster 2021-03-10T14:00:20.631753+0000 mgr.gibba020.yqfnwy (mgr.34427) 442 : cluster [DBG] pgmap v232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:22.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:22 gibba013 bash[30381]: cluster 2021-03-10T14:00:20.631753+0000 mgr.gibba020.yqfnwy (mgr.34427) 442 : cluster [DBG] pgmap v232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:24.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:24 gibba020 bash[25448]: cluster 2021-03-10T14:00:22.633118+0000 mgr.gibba020.yqfnwy (mgr.34427) 443 : cluster [DBG] pgmap v233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:24.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:24 gibba013 bash[29418]: cluster 2021-03-10T14:00:22.633118+0000 mgr.gibba020.yqfnwy (mgr.34427) 443 : cluster [DBG] pgmap v233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:24.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:24 gibba013 bash[30381]: cluster 2021-03-10T14:00:22.633118+0000 mgr.gibba020.yqfnwy (mgr.34427) 443 : cluster [DBG] pgmap v233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:26.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:26 gibba013 bash[29418]: cluster 2021-03-10T14:00:24.634508+0000 mgr.gibba020.yqfnwy (mgr.34427) 444 : cluster [DBG] pgmap v234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:26.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:26 gibba013 bash[30381]: cluster 2021-03-10T14:00:24.634508+0000 mgr.gibba020.yqfnwy (mgr.34427) 444 : cluster [DBG] pgmap v234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:26.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:26 gibba020 bash[25448]: cluster 2021-03-10T14:00:24.634508+0000 mgr.gibba020.yqfnwy (mgr.34427) 444 : cluster [DBG] pgmap v234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:28.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:28 gibba013 bash[29418]: cluster 2021-03-10T14:00:26.636185+0000 mgr.gibba020.yqfnwy (mgr.34427) 445 : cluster [DBG] pgmap v235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:28.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:28 gibba013 bash[30381]: cluster 2021-03-10T14:00:26.636185+0000 mgr.gibba020.yqfnwy (mgr.34427) 445 : cluster [DBG] pgmap v235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:28.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:28 gibba020 bash[25448]: cluster 2021-03-10T14:00:26.636185+0000 mgr.gibba020.yqfnwy (mgr.34427) 445 : cluster [DBG] pgmap v235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:30.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:30 gibba013 bash[29418]: cluster 2021-03-10T14:00:28.637587+0000 mgr.gibba020.yqfnwy (mgr.34427) 446 : cluster [DBG] pgmap v236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:30.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:30 gibba013 bash[30381]: cluster 2021-03-10T14:00:28.637587+0000 mgr.gibba020.yqfnwy (mgr.34427) 446 : cluster [DBG] pgmap v236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:30.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:30 gibba020 bash[25448]: cluster 2021-03-10T14:00:28.637587+0000 mgr.gibba020.yqfnwy (mgr.34427) 446 : cluster [DBG] pgmap v236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:31.195 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:00:31.424 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:00:31.425 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (7m) 3m ago 12m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:00:31.425 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (12m) 2m ago 12m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:00:31.425 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (7m) 2m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:00:31.425 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (7m) 2m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:00:31.426 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (6m) 3m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:00:31.426 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (6m) 3m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:00:31.426 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (6m) 2m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:00:31.426 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (6m) 3m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:00:31.426 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (12m) 3m ago 12m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:00:31.427 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (12m) 2m ago 12m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:00:31.427 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (5m) 3m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:00:31.427 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (4m) 3m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:00:31.427 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (4m) 3m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:00:31.428 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (4m) 3m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:00:31.428 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3m) 2m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:00:31.428 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3m) 2m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:00:31.428 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2m) 2m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:00:31.428 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2m) 2m ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:00:31.429 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (11m) 2m ago 12m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:00:31.429 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 10m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:00:31.678 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:00:31.679 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:00:31.679 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:00:31.679 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:00:31.679 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:00:31.680 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:00:31.680 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:00:31.680 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:00:31.680 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:00:31.680 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:00:31.681 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:00:31.681 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:00:31.681 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:00:31.681 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:00:31.682 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:00:32.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:32 gibba013 bash[29418]: cluster 2021-03-10T14:00:30.639267+0000 mgr.gibba020.yqfnwy (mgr.34427) 447 : cluster [DBG] pgmap v237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:32.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:32 gibba013 bash[29418]: audit 2021-03-10T14:00:31.183326+0000 mgr.gibba020.yqfnwy (mgr.34427) 448 : audit [DBG] from='client.44358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:00:32.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:32 gibba013 bash[29418]: audit 2021-03-10T14:00:31.679517+0000 mon.a (mon.0) 685 : audit [DBG] from='client.? 172.21.2.113:0/1426337208' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:32.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:32 gibba013 bash[30381]: cluster 2021-03-10T14:00:30.639267+0000 mgr.gibba020.yqfnwy (mgr.34427) 447 : cluster [DBG] pgmap v237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:32.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:32 gibba013 bash[30381]: audit 2021-03-10T14:00:31.183326+0000 mgr.gibba020.yqfnwy (mgr.34427) 448 : audit [DBG] from='client.44358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:00:32.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:32 gibba013 bash[30381]: audit 2021-03-10T14:00:31.679517+0000 mon.a (mon.0) 685 : audit [DBG] from='client.? 172.21.2.113:0/1426337208' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:32.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:32 gibba020 bash[25448]: cluster 2021-03-10T14:00:30.639267+0000 mgr.gibba020.yqfnwy (mgr.34427) 447 : cluster [DBG] pgmap v237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:32.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:32 gibba020 bash[25448]: audit 2021-03-10T14:00:31.183326+0000 mgr.gibba020.yqfnwy (mgr.34427) 448 : audit [DBG] from='client.44358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:00:32.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:32 gibba020 bash[25448]: audit 2021-03-10T14:00:31.679517+0000 mon.a (mon.0) 685 : audit [DBG] from='client.? 172.21.2.113:0/1426337208' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:00:33.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:33 gibba020 bash[25448]: audit 2021-03-10T14:00:31.410216+0000 mgr.gibba020.yqfnwy (mgr.34427) 449 : audit [DBG] from='client.54349 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:00:33.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:33 gibba013 bash[29418]: audit 2021-03-10T14:00:31.410216+0000 mgr.gibba020.yqfnwy (mgr.34427) 449 : audit [DBG] from='client.54349 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:00:33.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:33 gibba013 bash[30381]: audit 2021-03-10T14:00:31.410216+0000 mgr.gibba020.yqfnwy (mgr.34427) 449 : audit [DBG] from='client.54349 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:00:34.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:34 gibba013 bash[29418]: cluster 2021-03-10T14:00:32.640613+0000 mgr.gibba020.yqfnwy (mgr.34427) 450 : cluster [DBG] pgmap v238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:34.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:34 gibba013 bash[29418]: cephadm 2021-03-10T14:00:33.192117+0000 mgr.gibba020.yqfnwy (mgr.34427) 451 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:00:34.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:34 gibba013 bash[30381]: cluster 2021-03-10T14:00:32.640613+0000 mgr.gibba020.yqfnwy (mgr.34427) 450 : cluster [DBG] pgmap v238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:34.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:34 gibba013 bash[30381]: cephadm 2021-03-10T14:00:33.192117+0000 mgr.gibba020.yqfnwy (mgr.34427) 451 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:00:34.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:34 gibba020 bash[25448]: cluster 2021-03-10T14:00:32.640613+0000 mgr.gibba020.yqfnwy (mgr.34427) 450 : cluster [DBG] pgmap v238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:34.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:34 gibba020 bash[25448]: cephadm 2021-03-10T14:00:33.192117+0000 mgr.gibba020.yqfnwy (mgr.34427) 451 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:00:36.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:36 gibba013 bash[29418]: cluster 2021-03-10T14:00:34.642199+0000 mgr.gibba020.yqfnwy (mgr.34427) 452 : cluster [DBG] pgmap v239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:36.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:36 gibba013 bash[30381]: cluster 2021-03-10T14:00:34.642199+0000 mgr.gibba020.yqfnwy (mgr.34427) 452 : cluster [DBG] pgmap v239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:36.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:36 gibba020 bash[25448]: cluster 2021-03-10T14:00:34.642199+0000 mgr.gibba020.yqfnwy (mgr.34427) 452 : cluster [DBG] pgmap v239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:38.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:38 gibba013 bash[29418]: cluster 2021-03-10T14:00:36.643894+0000 mgr.gibba020.yqfnwy (mgr.34427) 453 : cluster [DBG] pgmap v240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:38.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:38 gibba013 bash[30381]: cluster 2021-03-10T14:00:36.643894+0000 mgr.gibba020.yqfnwy (mgr.34427) 453 : cluster [DBG] pgmap v240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:38.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:38 gibba020 bash[25448]: cluster 2021-03-10T14:00:36.643894+0000 mgr.gibba020.yqfnwy (mgr.34427) 453 : cluster [DBG] pgmap v240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:40.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:40 gibba013 bash[29418]: cluster 2021-03-10T14:00:38.645308+0000 mgr.gibba020.yqfnwy (mgr.34427) 454 : cluster [DBG] pgmap v241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:40.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:40 gibba013 bash[30381]: cluster 2021-03-10T14:00:38.645308+0000 mgr.gibba020.yqfnwy (mgr.34427) 454 : cluster [DBG] pgmap v241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:40.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:40 gibba020 bash[25448]: cluster 2021-03-10T14:00:38.645308+0000 mgr.gibba020.yqfnwy (mgr.34427) 454 : cluster [DBG] pgmap v241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:42.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:42 gibba013 bash[29418]: cluster 2021-03-10T14:00:40.646733+0000 mgr.gibba020.yqfnwy (mgr.34427) 455 : cluster [DBG] pgmap v242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:42.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:42 gibba013 bash[30381]: cluster 2021-03-10T14:00:40.646733+0000 mgr.gibba020.yqfnwy (mgr.34427) 455 : cluster [DBG] pgmap v242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:42.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:42 gibba020 bash[25448]: cluster 2021-03-10T14:00:40.646733+0000 mgr.gibba020.yqfnwy (mgr.34427) 455 : cluster [DBG] pgmap v242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:44.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:44 gibba013 bash[29418]: cluster 2021-03-10T14:00:42.648016+0000 mgr.gibba020.yqfnwy (mgr.34427) 456 : cluster [DBG] pgmap v243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:44.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:44 gibba013 bash[30381]: cluster 2021-03-10T14:00:42.648016+0000 mgr.gibba020.yqfnwy (mgr.34427) 456 : cluster [DBG] pgmap v243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:44.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:44 gibba020 bash[25448]: cluster 2021-03-10T14:00:42.648016+0000 mgr.gibba020.yqfnwy (mgr.34427) 456 : cluster [DBG] pgmap v243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:46.627 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:46 gibba013 bash[30381]: cluster 2021-03-10T14:00:44.649638+0000 mgr.gibba020.yqfnwy (mgr.34427) 457 : cluster [DBG] pgmap v244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:46.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:46 gibba013 bash[29418]: cluster 2021-03-10T14:00:44.649638+0000 mgr.gibba020.yqfnwy (mgr.34427) 457 : cluster [DBG] pgmap v244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:46.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:46 gibba020 bash[25448]: cluster 2021-03-10T14:00:44.649638+0000 mgr.gibba020.yqfnwy (mgr.34427) 457 : cluster [DBG] pgmap v244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:47.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:47 gibba013 bash[29418]: cluster 2021-03-10T14:00:46.651109+0000 mgr.gibba020.yqfnwy (mgr.34427) 458 : cluster [DBG] pgmap v245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:47.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:47 gibba013 bash[30381]: cluster 2021-03-10T14:00:46.651109+0000 mgr.gibba020.yqfnwy (mgr.34427) 458 : cluster [DBG] pgmap v245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:47.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:47 gibba020 bash[25448]: cluster 2021-03-10T14:00:46.651109+0000 mgr.gibba020.yqfnwy (mgr.34427) 458 : cluster [DBG] pgmap v245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:48.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:48 gibba013 bash[29418]: cephadm 2021-03-10T14:00:48.204684+0000 mgr.gibba020.yqfnwy (mgr.34427) 459 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:00:48.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:48 gibba013 bash[30381]: cephadm 2021-03-10T14:00:48.204684+0000 mgr.gibba020.yqfnwy (mgr.34427) 459 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:00:48.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:48 gibba020 bash[25448]: cephadm 2021-03-10T14:00:48.204684+0000 mgr.gibba020.yqfnwy (mgr.34427) 459 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:00:49.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:49 gibba013 bash[29418]: cluster 2021-03-10T14:00:48.652700+0000 mgr.gibba020.yqfnwy (mgr.34427) 460 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:49.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:49 gibba013 bash[30381]: cluster 2021-03-10T14:00:48.652700+0000 mgr.gibba020.yqfnwy (mgr.34427) 460 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:49.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:49 gibba020 bash[25448]: cluster 2021-03-10T14:00:48.652700+0000 mgr.gibba020.yqfnwy (mgr.34427) 460 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:52.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:51 gibba020 bash[25448]: cluster 2021-03-10T14:00:50.654372+0000 mgr.gibba020.yqfnwy (mgr.34427) 461 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:52.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:51 gibba013 bash[29418]: cluster 2021-03-10T14:00:50.654372+0000 mgr.gibba020.yqfnwy (mgr.34427) 461 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:52.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:51 gibba013 bash[30381]: cluster 2021-03-10T14:00:50.654372+0000 mgr.gibba020.yqfnwy (mgr.34427) 461 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:54.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:53 gibba020 bash[25448]: cluster 2021-03-10T14:00:52.655768+0000 mgr.gibba020.yqfnwy (mgr.34427) 462 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:54.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:53 gibba013 bash[29418]: cluster 2021-03-10T14:00:52.655768+0000 mgr.gibba020.yqfnwy (mgr.34427) 462 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:54.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:53 gibba013 bash[30381]: cluster 2021-03-10T14:00:52.655768+0000 mgr.gibba020.yqfnwy (mgr.34427) 462 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:56.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:55 gibba020 bash[25448]: cluster 2021-03-10T14:00:54.657234+0000 mgr.gibba020.yqfnwy (mgr.34427) 463 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:56.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:55 gibba013 bash[29418]: cluster 2021-03-10T14:00:54.657234+0000 mgr.gibba020.yqfnwy (mgr.34427) 463 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:56.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:55 gibba013 bash[30381]: cluster 2021-03-10T14:00:54.657234+0000 mgr.gibba020.yqfnwy (mgr.34427) 463 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:58.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:57 gibba020 bash[25448]: cluster 2021-03-10T14:00:56.658110+0000 mgr.gibba020.yqfnwy (mgr.34427) 464 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:58.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:57 gibba013 bash[29418]: cluster 2021-03-10T14:00:56.658110+0000 mgr.gibba020.yqfnwy (mgr.34427) 464 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:00:58.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:57 gibba013 bash[30381]: cluster 2021-03-10T14:00:56.658110+0000 mgr.gibba020.yqfnwy (mgr.34427) 464 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:00.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:00:59 gibba020 bash[25448]: cluster 2021-03-10T14:00:58.659306+0000 mgr.gibba020.yqfnwy (mgr.34427) 465 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:00.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:00:59 gibba013 bash[29418]: cluster 2021-03-10T14:00:58.659306+0000 mgr.gibba020.yqfnwy (mgr.34427) 465 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:00.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:00:59 gibba013 bash[30381]: cluster 2021-03-10T14:00:58.659306+0000 mgr.gibba020.yqfnwy (mgr.34427) 465 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:01.927 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:01:02.156 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:01:02.157 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (7m) 4m ago 12m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:01:02.157 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (12m) 2m ago 12m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:01:02.157 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (7m) 2m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:01:02.157 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (8m) 2m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:01:02.158 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (7m) 4m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:01:02.158 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (7m) 4m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:01:02.158 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (6m) 2m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:01:02.158 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (6m) 4m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:01:02.159 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (13m) 4m ago 13m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:01:02.159 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (13m) 2m ago 13m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:01:02.159 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (5m) 4m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:01:02.159 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (5m) 4m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:01:02.160 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (4m) 4m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:01:02.160 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (4m) 4m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:01:02.160 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (4m) 2m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:01:02.160 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3m) 2m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:01:02.161 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3m) 2m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:01:02.161 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2m) 2m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:01:02.161 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (12m) 2m ago 13m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:01:02.161 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 11m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:01:02.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:01 gibba020 bash[25448]: cluster 2021-03-10T14:01:00.660937+0000 mgr.gibba020.yqfnwy (mgr.34427) 466 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:02.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:01 gibba013 bash[29418]: cluster 2021-03-10T14:01:00.660937+0000 mgr.gibba020.yqfnwy (mgr.34427) 466 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:02.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:01 gibba013 bash[30381]: cluster 2021-03-10T14:01:00.660937+0000 mgr.gibba020.yqfnwy (mgr.34427) 466 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:02.406 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:01:02.406 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:01:02.406 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:01:02.407 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:01:02.407 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:01:02.407 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:01:02.408 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:01:02.408 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:01:02.408 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:01:02.408 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:01:02.408 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:01:02.409 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:01:02.409 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:01:02.409 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:01:02.409 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:01:03.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:02 gibba020 bash[25448]: audit 2021-03-10T14:01:01.915495+0000 mgr.gibba020.yqfnwy (mgr.34427) 467 : audit [DBG] from='client.44376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:01:03.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:02 gibba020 bash[25448]: audit 2021-03-10T14:01:02.142133+0000 mgr.gibba020.yqfnwy (mgr.34427) 468 : audit [DBG] from='client.54367 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:01:03.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:02 gibba020 bash[25448]: audit 2021-03-10T14:01:02.407238+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.2.113:0/4086428613' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:03.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:02 gibba013 bash[29418]: audit 2021-03-10T14:01:01.915495+0000 mgr.gibba020.yqfnwy (mgr.34427) 467 : audit [DBG] from='client.44376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:01:03.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:02 gibba013 bash[29418]: audit 2021-03-10T14:01:02.142133+0000 mgr.gibba020.yqfnwy (mgr.34427) 468 : audit [DBG] from='client.54367 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:01:03.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:02 gibba013 bash[29418]: audit 2021-03-10T14:01:02.407238+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.2.113:0/4086428613' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:03.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:02 gibba013 bash[30381]: audit 2021-03-10T14:01:01.915495+0000 mgr.gibba020.yqfnwy (mgr.34427) 467 : audit [DBG] from='client.44376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:01:03.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:02 gibba013 bash[30381]: audit 2021-03-10T14:01:02.142133+0000 mgr.gibba020.yqfnwy (mgr.34427) 468 : audit [DBG] from='client.54367 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:01:03.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:02 gibba013 bash[30381]: audit 2021-03-10T14:01:02.407238+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.2.113:0/4086428613' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:04.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:03 gibba020 bash[25448]: cluster 2021-03-10T14:01:02.662217+0000 mgr.gibba020.yqfnwy (mgr.34427) 469 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:04.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:03 gibba020 bash[25448]: cephadm 2021-03-10T14:01:03.220480+0000 mgr.gibba020.yqfnwy (mgr.34427) 470 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:01:04.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:03 gibba013 bash[29418]: cluster 2021-03-10T14:01:02.662217+0000 mgr.gibba020.yqfnwy (mgr.34427) 469 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:04.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:03 gibba013 bash[29418]: cephadm 2021-03-10T14:01:03.220480+0000 mgr.gibba020.yqfnwy (mgr.34427) 470 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:01:04.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:03 gibba013 bash[30381]: cluster 2021-03-10T14:01:02.662217+0000 mgr.gibba020.yqfnwy (mgr.34427) 469 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:04.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:03 gibba013 bash[30381]: cephadm 2021-03-10T14:01:03.220480+0000 mgr.gibba020.yqfnwy (mgr.34427) 470 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:01:06.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:05 gibba013 bash[29418]: cluster 2021-03-10T14:01:04.663525+0000 mgr.gibba020.yqfnwy (mgr.34427) 471 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:06.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:05 gibba013 bash[29418]: audit 2021-03-10T14:01:05.781397+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T14:01:06.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:05 gibba013 bash[29418]: audit 2021-03-10T14:01:05.782161+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:01:06.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:05 gibba013 bash[29418]: audit 2021-03-10T14:01:05.782825+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:01:06.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:05 gibba013 bash[29418]: audit 2021-03-10T14:01:05.783473+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T14:01:06.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:05 gibba013 bash[29418]: audit 2021-03-10T14:01:05.917435+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:01:06.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:05 gibba013 bash[29418]: audit 2021-03-10T14:01:05.918119+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:01:06.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:05 gibba013 bash[30381]: cluster 2021-03-10T14:01:04.663525+0000 mgr.gibba020.yqfnwy (mgr.34427) 471 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:06.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:05 gibba013 bash[30381]: audit 2021-03-10T14:01:05.781397+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T14:01:06.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:05 gibba013 bash[30381]: audit 2021-03-10T14:01:05.782161+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:01:06.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:05 gibba013 bash[30381]: audit 2021-03-10T14:01:05.782825+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:01:06.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:05 gibba013 bash[30381]: audit 2021-03-10T14:01:05.783473+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T14:01:06.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:05 gibba013 bash[30381]: audit 2021-03-10T14:01:05.917435+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:01:06.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:05 gibba013 bash[30381]: audit 2021-03-10T14:01:05.918119+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:01:06.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:05 gibba020 bash[25448]: cluster 2021-03-10T14:01:04.663525+0000 mgr.gibba020.yqfnwy (mgr.34427) 471 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:06.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:05 gibba020 bash[25448]: audit 2021-03-10T14:01:05.781397+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T14:01:06.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:05 gibba020 bash[25448]: audit 2021-03-10T14:01:05.782161+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:01:06.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:05 gibba020 bash[25448]: audit 2021-03-10T14:01:05.782825+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:01:06.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:05 gibba020 bash[25448]: audit 2021-03-10T14:01:05.783473+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T14:01:06.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:05 gibba020 bash[25448]: audit 2021-03-10T14:01:05.917435+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:01:06.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:05 gibba020 bash[25448]: audit 2021-03-10T14:01:05.918119+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:01:08.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:07 gibba013 bash[29418]: cluster 2021-03-10T14:01:06.664427+0000 mgr.gibba020.yqfnwy (mgr.34427) 472 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:08.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:07 gibba013 bash[30381]: cluster 2021-03-10T14:01:06.664427+0000 mgr.gibba020.yqfnwy (mgr.34427) 472 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:08.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:07 gibba020 bash[25448]: cluster 2021-03-10T14:01:06.664427+0000 mgr.gibba020.yqfnwy (mgr.34427) 472 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:10.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:09 gibba013 bash[29418]: cluster 2021-03-10T14:01:08.665734+0000 mgr.gibba020.yqfnwy (mgr.34427) 473 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:10.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:10 gibba013 bash[30381]: cluster 2021-03-10T14:01:08.665734+0000 mgr.gibba020.yqfnwy (mgr.34427) 473 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:10.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:09 gibba020 bash[25448]: cluster 2021-03-10T14:01:08.665734+0000 mgr.gibba020.yqfnwy (mgr.34427) 473 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:12.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:12 gibba013 bash[29418]: cluster 2021-03-10T14:01:10.667367+0000 mgr.gibba020.yqfnwy (mgr.34427) 474 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:12.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:12 gibba013 bash[30381]: cluster 2021-03-10T14:01:10.667367+0000 mgr.gibba020.yqfnwy (mgr.34427) 474 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:12.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:12 gibba020 bash[25448]: cluster 2021-03-10T14:01:10.667367+0000 mgr.gibba020.yqfnwy (mgr.34427) 474 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:14.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:14 gibba013 bash[29418]: cluster 2021-03-10T14:01:12.668910+0000 mgr.gibba020.yqfnwy (mgr.34427) 475 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:14.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:14 gibba013 bash[30381]: cluster 2021-03-10T14:01:12.668910+0000 mgr.gibba020.yqfnwy (mgr.34427) 475 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:14.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:14 gibba020 bash[25448]: cluster 2021-03-10T14:01:12.668910+0000 mgr.gibba020.yqfnwy (mgr.34427) 475 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:16.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:16 gibba013 bash[29418]: cluster 2021-03-10T14:01:14.670473+0000 mgr.gibba020.yqfnwy (mgr.34427) 476 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:16.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:16 gibba013 bash[30381]: cluster 2021-03-10T14:01:14.670473+0000 mgr.gibba020.yqfnwy (mgr.34427) 476 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:16.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:16 gibba020 bash[25448]: cluster 2021-03-10T14:01:14.670473+0000 mgr.gibba020.yqfnwy (mgr.34427) 476 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:18.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:18 gibba013 bash[29418]: cluster 2021-03-10T14:01:16.671187+0000 mgr.gibba020.yqfnwy (mgr.34427) 477 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:18.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:18 gibba013 bash[30381]: cluster 2021-03-10T14:01:16.671187+0000 mgr.gibba020.yqfnwy (mgr.34427) 477 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:18.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:18 gibba020 bash[25448]: cluster 2021-03-10T14:01:16.671187+0000 mgr.gibba020.yqfnwy (mgr.34427) 477 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:19.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:19 gibba013 bash[29418]: audit 2021-03-10T14:01:18.232604+0000 mon.a (mon.0) 692 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:01:19.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:19 gibba013 bash[29418]: cephadm 2021-03-10T14:01:18.234453+0000 mgr.gibba020.yqfnwy (mgr.34427) 478 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:01:19.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:19 gibba013 bash[29418]: cephadm 2021-03-10T14:01:18.236466+0000 mgr.gibba020.yqfnwy (mgr.34427) 479 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:01:19.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:19 gibba013 bash[29418]: audit 2021-03-10T14:01:18.452578+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:01:19.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:19 gibba013 bash[29418]: audit 2021-03-10T14:01:18.455512+0000 mon.a (mon.0) 694 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:01:19.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:19 gibba013 bash[29418]: audit 2021-03-10T14:01:18.456946+0000 mon.a (mon.0) 695 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:19.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:19 gibba013 bash[29418]: audit 2021-03-10T14:01:18.458352+0000 mon.a (mon.0) 696 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:19.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:19 gibba013 bash[29418]: audit 2021-03-10T14:01:18.459265+0000 mon.a (mon.0) 697 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:19.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:19 gibba013 bash[29418]: audit 2021-03-10T14:01:18.461071+0000 mon.a (mon.0) 698 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:19.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:19 gibba013 bash[29418]: audit 2021-03-10T14:01:18.462264+0000 mon.a (mon.0) 699 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:19.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:19 gibba013 bash[30381]: audit 2021-03-10T14:01:18.232604+0000 mon.a (mon.0) 692 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:01:19.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:19 gibba013 bash[30381]: cephadm 2021-03-10T14:01:18.234453+0000 mgr.gibba020.yqfnwy (mgr.34427) 478 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:01:19.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:19 gibba013 bash[30381]: cephadm 2021-03-10T14:01:18.236466+0000 mgr.gibba020.yqfnwy (mgr.34427) 479 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:01:19.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:19 gibba013 bash[30381]: audit 2021-03-10T14:01:18.452578+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:01:19.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:19 gibba013 bash[30381]: audit 2021-03-10T14:01:18.455512+0000 mon.a (mon.0) 694 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:01:19.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:19 gibba013 bash[30381]: audit 2021-03-10T14:01:18.456946+0000 mon.a (mon.0) 695 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:19.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:19 gibba013 bash[30381]: audit 2021-03-10T14:01:18.458352+0000 mon.a (mon.0) 696 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:19.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:19 gibba013 bash[30381]: audit 2021-03-10T14:01:18.459265+0000 mon.a (mon.0) 697 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:19.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:19 gibba013 bash[30381]: audit 2021-03-10T14:01:18.461071+0000 mon.a (mon.0) 698 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:19.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:19 gibba013 bash[30381]: audit 2021-03-10T14:01:18.462264+0000 mon.a (mon.0) 699 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:19.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:19 gibba020 bash[25448]: audit 2021-03-10T14:01:18.232604+0000 mon.a (mon.0) 692 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:01:19.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:19 gibba020 bash[25448]: cephadm 2021-03-10T14:01:18.234453+0000 mgr.gibba020.yqfnwy (mgr.34427) 478 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:01:19.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:19 gibba020 bash[25448]: cephadm 2021-03-10T14:01:18.236466+0000 mgr.gibba020.yqfnwy (mgr.34427) 479 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:01:19.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:19 gibba020 bash[25448]: audit 2021-03-10T14:01:18.452578+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:01:19.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:19 gibba020 bash[25448]: audit 2021-03-10T14:01:18.455512+0000 mon.a (mon.0) 694 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:01:19.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:19 gibba020 bash[25448]: audit 2021-03-10T14:01:18.456946+0000 mon.a (mon.0) 695 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:19.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:19 gibba020 bash[25448]: audit 2021-03-10T14:01:18.458352+0000 mon.a (mon.0) 696 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:19.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:19 gibba020 bash[25448]: audit 2021-03-10T14:01:18.459265+0000 mon.a (mon.0) 697 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:19.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:19 gibba020 bash[25448]: audit 2021-03-10T14:01:18.461071+0000 mon.a (mon.0) 698 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:19.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:19 gibba020 bash[25448]: audit 2021-03-10T14:01:18.462264+0000 mon.a (mon.0) 699 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:20.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:20 gibba013 bash[29418]: cephadm 2021-03-10T14:01:18.451867+0000 mgr.gibba020.yqfnwy (mgr.34427) 480 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:01:20.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:20 gibba013 bash[29418]: cephadm 2021-03-10T14:01:18.453496+0000 mgr.gibba020.yqfnwy (mgr.34427) 481 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:01:20.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:20 gibba013 bash[29418]: cephadm 2021-03-10T14:01:18.454839+0000 mgr.gibba020.yqfnwy (mgr.34427) 482 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:01:20.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:20 gibba013 bash[29418]: cephadm 2021-03-10T14:01:18.454879+0000 mgr.gibba020.yqfnwy (mgr.34427) 483 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:01:20.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:20 gibba013 bash[29418]: cephadm 2021-03-10T14:01:18.456070+0000 mgr.gibba020.yqfnwy (mgr.34427) 484 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:01:20.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:20 gibba013 bash[29418]: cephadm 2021-03-10T14:01:18.456110+0000 mgr.gibba020.yqfnwy (mgr.34427) 485 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:01:20.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:20 gibba013 bash[29418]: cephadm 2021-03-10T14:01:18.456860+0000 mgr.gibba020.yqfnwy (mgr.34427) 486 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:01:20.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:20 gibba013 bash[29418]: cephadm 2021-03-10T14:01:18.457607+0000 mgr.gibba020.yqfnwy (mgr.34427) 487 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:01:20.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:20 gibba013 bash[29418]: cephadm 2021-03-10T14:01:18.457646+0000 mgr.gibba020.yqfnwy (mgr.34427) 488 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:01:20.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:20 gibba013 bash[29418]: cephadm 2021-03-10T14:01:18.458669+0000 mgr.gibba020.yqfnwy (mgr.34427) 489 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:01:20.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:20 gibba013 bash[29418]: cephadm 2021-03-10T14:01:18.458989+0000 mgr.gibba020.yqfnwy (mgr.34427) 490 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:01:20.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:20 gibba013 bash[29418]: cephadm 2021-03-10T14:01:18.459831+0000 mgr.gibba020.yqfnwy (mgr.34427) 491 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:01:20.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:20 gibba013 bash[29418]: cephadm 2021-03-10T14:01:18.459870+0000 mgr.gibba020.yqfnwy (mgr.34427) 492 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:01:20.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:20 gibba013 bash[29418]: cephadm 2021-03-10T14:01:18.460034+0000 mgr.gibba020.yqfnwy (mgr.34427) 493 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:01:20.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:20 gibba013 bash[29418]: cluster 2021-03-10T14:01:18.672960+0000 mgr.gibba020.yqfnwy (mgr.34427) 494 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:20.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:20 gibba013 bash[30381]: cephadm 2021-03-10T14:01:18.451867+0000 mgr.gibba020.yqfnwy (mgr.34427) 480 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:01:20.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:20 gibba013 bash[30381]: cephadm 2021-03-10T14:01:18.453496+0000 mgr.gibba020.yqfnwy (mgr.34427) 481 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:01:20.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:20 gibba013 bash[30381]: cephadm 2021-03-10T14:01:18.454839+0000 mgr.gibba020.yqfnwy (mgr.34427) 482 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:01:20.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:20 gibba013 bash[30381]: cephadm 2021-03-10T14:01:18.454879+0000 mgr.gibba020.yqfnwy (mgr.34427) 483 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:01:20.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:20 gibba013 bash[30381]: cephadm 2021-03-10T14:01:18.456070+0000 mgr.gibba020.yqfnwy (mgr.34427) 484 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:01:20.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:20 gibba013 bash[30381]: cephadm 2021-03-10T14:01:18.456110+0000 mgr.gibba020.yqfnwy (mgr.34427) 485 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:01:20.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:20 gibba013 bash[30381]: cephadm 2021-03-10T14:01:18.456860+0000 mgr.gibba020.yqfnwy (mgr.34427) 486 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:01:20.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:20 gibba013 bash[30381]: cephadm 2021-03-10T14:01:18.457607+0000 mgr.gibba020.yqfnwy (mgr.34427) 487 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:01:20.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:20 gibba013 bash[30381]: cephadm 2021-03-10T14:01:18.457646+0000 mgr.gibba020.yqfnwy (mgr.34427) 488 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:01:20.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:20 gibba013 bash[30381]: cephadm 2021-03-10T14:01:18.458669+0000 mgr.gibba020.yqfnwy (mgr.34427) 489 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:01:20.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:20 gibba013 bash[30381]: cephadm 2021-03-10T14:01:18.458989+0000 mgr.gibba020.yqfnwy (mgr.34427) 490 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:01:20.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:20 gibba013 bash[30381]: cephadm 2021-03-10T14:01:18.459831+0000 mgr.gibba020.yqfnwy (mgr.34427) 491 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:01:20.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:20 gibba013 bash[30381]: cephadm 2021-03-10T14:01:18.459870+0000 mgr.gibba020.yqfnwy (mgr.34427) 492 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:01:20.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:20 gibba013 bash[30381]: cephadm 2021-03-10T14:01:18.460034+0000 mgr.gibba020.yqfnwy (mgr.34427) 493 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:01:20.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:20 gibba013 bash[30381]: cluster 2021-03-10T14:01:18.672960+0000 mgr.gibba020.yqfnwy (mgr.34427) 494 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:20.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:20 gibba020 bash[25448]: cephadm 2021-03-10T14:01:18.451867+0000 mgr.gibba020.yqfnwy (mgr.34427) 480 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:01:20.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:20 gibba020 bash[25448]: cephadm 2021-03-10T14:01:18.453496+0000 mgr.gibba020.yqfnwy (mgr.34427) 481 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:01:20.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:20 gibba020 bash[25448]: cephadm 2021-03-10T14:01:18.454839+0000 mgr.gibba020.yqfnwy (mgr.34427) 482 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:01:20.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:20 gibba020 bash[25448]: cephadm 2021-03-10T14:01:18.454879+0000 mgr.gibba020.yqfnwy (mgr.34427) 483 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:01:20.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:20 gibba020 bash[25448]: cephadm 2021-03-10T14:01:18.456070+0000 mgr.gibba020.yqfnwy (mgr.34427) 484 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:01:20.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:20 gibba020 bash[25448]: cephadm 2021-03-10T14:01:18.456110+0000 mgr.gibba020.yqfnwy (mgr.34427) 485 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:01:20.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:20 gibba020 bash[25448]: cephadm 2021-03-10T14:01:18.456860+0000 mgr.gibba020.yqfnwy (mgr.34427) 486 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:01:20.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:20 gibba020 bash[25448]: cephadm 2021-03-10T14:01:18.457607+0000 mgr.gibba020.yqfnwy (mgr.34427) 487 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:01:20.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:20 gibba020 bash[25448]: cephadm 2021-03-10T14:01:18.457646+0000 mgr.gibba020.yqfnwy (mgr.34427) 488 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:01:20.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:20 gibba020 bash[25448]: cephadm 2021-03-10T14:01:18.458669+0000 mgr.gibba020.yqfnwy (mgr.34427) 489 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:01:20.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:20 gibba020 bash[25448]: cephadm 2021-03-10T14:01:18.458989+0000 mgr.gibba020.yqfnwy (mgr.34427) 490 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:01:20.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:20 gibba020 bash[25448]: cephadm 2021-03-10T14:01:18.459831+0000 mgr.gibba020.yqfnwy (mgr.34427) 491 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:01:20.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:20 gibba020 bash[25448]: cephadm 2021-03-10T14:01:18.459870+0000 mgr.gibba020.yqfnwy (mgr.34427) 492 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:01:20.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:20 gibba020 bash[25448]: cephadm 2021-03-10T14:01:18.460034+0000 mgr.gibba020.yqfnwy (mgr.34427) 493 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:01:20.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:20 gibba020 bash[25448]: cluster 2021-03-10T14:01:18.672960+0000 mgr.gibba020.yqfnwy (mgr.34427) 494 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:22.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:22 gibba013 bash[29418]: cluster 2021-03-10T14:01:20.674705+0000 mgr.gibba020.yqfnwy (mgr.34427) 495 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:22.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:22 gibba013 bash[30381]: cluster 2021-03-10T14:01:20.674705+0000 mgr.gibba020.yqfnwy (mgr.34427) 495 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:22.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:22 gibba020 bash[25448]: cluster 2021-03-10T14:01:20.674705+0000 mgr.gibba020.yqfnwy (mgr.34427) 495 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:24.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:24 gibba013 bash[29418]: cluster 2021-03-10T14:01:22.676242+0000 mgr.gibba020.yqfnwy (mgr.34427) 496 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:24.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:24 gibba013 bash[30381]: cluster 2021-03-10T14:01:22.676242+0000 mgr.gibba020.yqfnwy (mgr.34427) 496 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:24.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:24 gibba020 bash[25448]: cluster 2021-03-10T14:01:22.676242+0000 mgr.gibba020.yqfnwy (mgr.34427) 496 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:26.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:26 gibba013 bash[29418]: cluster 2021-03-10T14:01:24.677581+0000 mgr.gibba020.yqfnwy (mgr.34427) 497 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:26.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:26 gibba013 bash[30381]: cluster 2021-03-10T14:01:24.677581+0000 mgr.gibba020.yqfnwy (mgr.34427) 497 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:26.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:26 gibba020 bash[25448]: cluster 2021-03-10T14:01:24.677581+0000 mgr.gibba020.yqfnwy (mgr.34427) 497 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:28.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:28 gibba013 bash[29418]: cluster 2021-03-10T14:01:26.678536+0000 mgr.gibba020.yqfnwy (mgr.34427) 498 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:28.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:28 gibba013 bash[30381]: cluster 2021-03-10T14:01:26.678536+0000 mgr.gibba020.yqfnwy (mgr.34427) 498 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:28.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:28 gibba020 bash[25448]: cluster 2021-03-10T14:01:26.678536+0000 mgr.gibba020.yqfnwy (mgr.34427) 498 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:30.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:30 gibba013 bash[29418]: cluster 2021-03-10T14:01:28.679981+0000 mgr.gibba020.yqfnwy (mgr.34427) 499 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:30.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:30 gibba013 bash[30381]: cluster 2021-03-10T14:01:28.679981+0000 mgr.gibba020.yqfnwy (mgr.34427) 499 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:30.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:30 gibba020 bash[25448]: cluster 2021-03-10T14:01:28.679981+0000 mgr.gibba020.yqfnwy (mgr.34427) 499 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:32.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:32 gibba013 bash[29418]: cluster 2021-03-10T14:01:30.681711+0000 mgr.gibba020.yqfnwy (mgr.34427) 500 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:32.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:32 gibba013 bash[30381]: cluster 2021-03-10T14:01:30.681711+0000 mgr.gibba020.yqfnwy (mgr.34427) 500 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:32.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:32 gibba020 bash[25448]: cluster 2021-03-10T14:01:30.681711+0000 mgr.gibba020.yqfnwy (mgr.34427) 500 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:32.652 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:01:32.908 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:01:32.909 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (8m) 4m ago 13m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:01:32.909 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (13m) 3m ago 13m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:01:32.909 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (8m) 3m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:01:32.909 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (8m) 3m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:01:32.910 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (7m) 4m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:01:32.910 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (7m) 4m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:01:32.910 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (7m) 3m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:01:32.910 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (7m) 4m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:01:32.911 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (13m) 4m ago 13m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:01:32.911 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (13m) 3m ago 13m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:01:32.911 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (6m) 4m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:01:32.911 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (5m) 4m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:01:32.911 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (5m) 4m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:01:32.912 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (5m) 4m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:01:32.912 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (4m) 3m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:01:32.912 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (4m) 3m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:01:32.912 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3m) 3m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:01:32.913 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3m) 3m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:01:32.913 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (12m) 3m ago 13m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:01:32.913 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 3m ago 11m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:01:33.167 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:01:33.167 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:01:33.168 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:01:33.168 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:01:33.168 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:01:33.168 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:01:33.169 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:01:33.169 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:01:33.169 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:01:33.169 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:01:33.170 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:01:33.170 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:01:33.170 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:01:33.170 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:01:33.171 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:01:34.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:34 gibba013 bash[29418]: audit 2021-03-10T14:01:32.641022+0000 mgr.gibba020.yqfnwy (mgr.34427) 501 : audit [DBG] from='client.44394 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:01:34.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:34 gibba013 bash[29418]: cluster 2021-03-10T14:01:32.683115+0000 mgr.gibba020.yqfnwy (mgr.34427) 502 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:34.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:34 gibba013 bash[29418]: audit 2021-03-10T14:01:32.864381+0000 mgr.gibba020.yqfnwy (mgr.34427) 503 : audit [DBG] from='client.44400 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:01:34.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:34 gibba013 bash[29418]: audit 2021-03-10T14:01:33.168116+0000 mon.a (mon.0) 700 : audit [DBG] from='client.? 172.21.2.113:0/2683343115' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:34.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:34 gibba013 bash[30381]: audit 2021-03-10T14:01:32.641022+0000 mgr.gibba020.yqfnwy (mgr.34427) 501 : audit [DBG] from='client.44394 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:01:34.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:34 gibba013 bash[30381]: cluster 2021-03-10T14:01:32.683115+0000 mgr.gibba020.yqfnwy (mgr.34427) 502 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:34.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:34 gibba013 bash[30381]: audit 2021-03-10T14:01:32.864381+0000 mgr.gibba020.yqfnwy (mgr.34427) 503 : audit [DBG] from='client.44400 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:01:34.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:34 gibba013 bash[30381]: audit 2021-03-10T14:01:33.168116+0000 mon.a (mon.0) 700 : audit [DBG] from='client.? 172.21.2.113:0/2683343115' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:34.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:34 gibba020 bash[25448]: audit 2021-03-10T14:01:32.641022+0000 mgr.gibba020.yqfnwy (mgr.34427) 501 : audit [DBG] from='client.44394 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:01:34.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:34 gibba020 bash[25448]: cluster 2021-03-10T14:01:32.683115+0000 mgr.gibba020.yqfnwy (mgr.34427) 502 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:34.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:34 gibba020 bash[25448]: audit 2021-03-10T14:01:32.864381+0000 mgr.gibba020.yqfnwy (mgr.34427) 503 : audit [DBG] from='client.44400 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:01:34.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:34 gibba020 bash[25448]: audit 2021-03-10T14:01:33.168116+0000 mon.a (mon.0) 700 : audit [DBG] from='client.? 172.21.2.113:0/2683343115' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:01:35.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:35 gibba013 bash[29418]: cephadm 2021-03-10T14:01:33.472461+0000 mgr.gibba020.yqfnwy (mgr.34427) 504 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:01:35.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:35 gibba013 bash[30381]: cephadm 2021-03-10T14:01:33.472461+0000 mgr.gibba020.yqfnwy (mgr.34427) 504 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:01:35.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:35 gibba020 bash[25448]: cephadm 2021-03-10T14:01:33.472461+0000 mgr.gibba020.yqfnwy (mgr.34427) 504 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:01:36.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:36 gibba013 bash[29418]: cluster 2021-03-10T14:01:34.684860+0000 mgr.gibba020.yqfnwy (mgr.34427) 505 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:36.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:36 gibba013 bash[30381]: cluster 2021-03-10T14:01:34.684860+0000 mgr.gibba020.yqfnwy (mgr.34427) 505 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:36.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:36 gibba020 bash[25448]: cluster 2021-03-10T14:01:34.684860+0000 mgr.gibba020.yqfnwy (mgr.34427) 505 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:38.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:38 gibba013 bash[29418]: cluster 2021-03-10T14:01:36.685853+0000 mgr.gibba020.yqfnwy (mgr.34427) 506 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:38.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:38 gibba013 bash[30381]: cluster 2021-03-10T14:01:36.685853+0000 mgr.gibba020.yqfnwy (mgr.34427) 506 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:38.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:38 gibba020 bash[25448]: cluster 2021-03-10T14:01:36.685853+0000 mgr.gibba020.yqfnwy (mgr.34427) 506 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:40.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:40 gibba013 bash[29418]: cluster 2021-03-10T14:01:38.687389+0000 mgr.gibba020.yqfnwy (mgr.34427) 507 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:40.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:40 gibba013 bash[30381]: cluster 2021-03-10T14:01:38.687389+0000 mgr.gibba020.yqfnwy (mgr.34427) 507 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:40.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:40 gibba020 bash[25448]: cluster 2021-03-10T14:01:38.687389+0000 mgr.gibba020.yqfnwy (mgr.34427) 507 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:42.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:42 gibba020 bash[25448]: cluster 2021-03-10T14:01:40.688979+0000 mgr.gibba020.yqfnwy (mgr.34427) 508 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:42.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:42 gibba013 bash[29418]: cluster 2021-03-10T14:01:40.688979+0000 mgr.gibba020.yqfnwy (mgr.34427) 508 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:42.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:42 gibba013 bash[30381]: cluster 2021-03-10T14:01:40.688979+0000 mgr.gibba020.yqfnwy (mgr.34427) 508 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:44.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:44 gibba020 bash[25448]: cluster 2021-03-10T14:01:42.690477+0000 mgr.gibba020.yqfnwy (mgr.34427) 509 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:44.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:44 gibba013 bash[29418]: cluster 2021-03-10T14:01:42.690477+0000 mgr.gibba020.yqfnwy (mgr.34427) 509 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:44.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:44 gibba013 bash[30381]: cluster 2021-03-10T14:01:42.690477+0000 mgr.gibba020.yqfnwy (mgr.34427) 509 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:46.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:46 gibba020 bash[25448]: cluster 2021-03-10T14:01:44.692203+0000 mgr.gibba020.yqfnwy (mgr.34427) 510 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:46.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:46 gibba013 bash[29418]: cluster 2021-03-10T14:01:44.692203+0000 mgr.gibba020.yqfnwy (mgr.34427) 510 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:46.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:46 gibba013 bash[30381]: cluster 2021-03-10T14:01:44.692203+0000 mgr.gibba020.yqfnwy (mgr.34427) 510 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:48.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:48 gibba020 bash[25448]: cluster 2021-03-10T14:01:46.693016+0000 mgr.gibba020.yqfnwy (mgr.34427) 511 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:48.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:48 gibba013 bash[29418]: cluster 2021-03-10T14:01:46.693016+0000 mgr.gibba020.yqfnwy (mgr.34427) 511 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:48.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:48 gibba013 bash[30381]: cluster 2021-03-10T14:01:46.693016+0000 mgr.gibba020.yqfnwy (mgr.34427) 511 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:50.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:50 gibba020 bash[25448]: cephadm 2021-03-10T14:01:48.484713+0000 mgr.gibba020.yqfnwy (mgr.34427) 512 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:01:50.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:50 gibba020 bash[25448]: cluster 2021-03-10T14:01:48.694499+0000 mgr.gibba020.yqfnwy (mgr.34427) 513 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:50.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:50 gibba013 bash[29418]: cephadm 2021-03-10T14:01:48.484713+0000 mgr.gibba020.yqfnwy (mgr.34427) 512 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:01:50.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:50 gibba013 bash[29418]: cluster 2021-03-10T14:01:48.694499+0000 mgr.gibba020.yqfnwy (mgr.34427) 513 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:50.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:50 gibba013 bash[30381]: cephadm 2021-03-10T14:01:48.484713+0000 mgr.gibba020.yqfnwy (mgr.34427) 512 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:01:50.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:50 gibba013 bash[30381]: cluster 2021-03-10T14:01:48.694499+0000 mgr.gibba020.yqfnwy (mgr.34427) 513 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:52.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:52 gibba020 bash[25448]: cluster 2021-03-10T14:01:50.696214+0000 mgr.gibba020.yqfnwy (mgr.34427) 514 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:52.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:52 gibba013 bash[29418]: cluster 2021-03-10T14:01:50.696214+0000 mgr.gibba020.yqfnwy (mgr.34427) 514 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:52.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:52 gibba013 bash[30381]: cluster 2021-03-10T14:01:50.696214+0000 mgr.gibba020.yqfnwy (mgr.34427) 514 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:54.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:54 gibba020 bash[25448]: cluster 2021-03-10T14:01:52.697718+0000 mgr.gibba020.yqfnwy (mgr.34427) 515 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:54.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:54 gibba013 bash[29418]: cluster 2021-03-10T14:01:52.697718+0000 mgr.gibba020.yqfnwy (mgr.34427) 515 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:54.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:54 gibba013 bash[30381]: cluster 2021-03-10T14:01:52.697718+0000 mgr.gibba020.yqfnwy (mgr.34427) 515 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:56.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:56 gibba020 bash[25448]: cluster 2021-03-10T14:01:54.699171+0000 mgr.gibba020.yqfnwy (mgr.34427) 516 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:56.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:56 gibba013 bash[29418]: cluster 2021-03-10T14:01:54.699171+0000 mgr.gibba020.yqfnwy (mgr.34427) 516 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:56.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:56 gibba013 bash[30381]: cluster 2021-03-10T14:01:54.699171+0000 mgr.gibba020.yqfnwy (mgr.34427) 516 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:58.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:01:58 gibba013 bash[29418]: cluster 2021-03-10T14:01:56.700304+0000 mgr.gibba020.yqfnwy (mgr.34427) 517 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:58.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:01:58 gibba013 bash[30381]: cluster 2021-03-10T14:01:56.700304+0000 mgr.gibba020.yqfnwy (mgr.34427) 517 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:01:58.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:01:58 gibba020 bash[25448]: cluster 2021-03-10T14:01:56.700304+0000 mgr.gibba020.yqfnwy (mgr.34427) 517 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:00.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:00 gibba013 bash[29418]: cluster 2021-03-10T14:01:58.701684+0000 mgr.gibba020.yqfnwy (mgr.34427) 518 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:00.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:00 gibba013 bash[30381]: cluster 2021-03-10T14:01:58.701684+0000 mgr.gibba020.yqfnwy (mgr.34427) 518 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:00.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:00 gibba020 bash[25448]: cluster 2021-03-10T14:01:58.701684+0000 mgr.gibba020.yqfnwy (mgr.34427) 518 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:02.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:02 gibba013 bash[29418]: cluster 2021-03-10T14:02:00.703257+0000 mgr.gibba020.yqfnwy (mgr.34427) 519 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:02.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:02 gibba013 bash[30381]: cluster 2021-03-10T14:02:00.703257+0000 mgr.gibba020.yqfnwy (mgr.34427) 519 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:02.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:02 gibba020 bash[25448]: cluster 2021-03-10T14:02:00.703257+0000 mgr.gibba020.yqfnwy (mgr.34427) 519 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:03.414 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:02:03.642 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:02:03.642 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (8m) 5m ago 13m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:02:03.643 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (13m) 3m ago 13m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:02:03.643 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (8m) 3m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:02:03.643 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (9m) 3m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:02:03.643 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (8m) 5m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:02:03.644 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (8m) 5m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:02:03.644 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (7m) 3m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:02:03.644 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (7m) 5m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:02:03.644 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (14m) 5m ago 14m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:02:03.645 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (14m) 3m ago 14m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:02:03.645 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (6m) 5m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:02:03.645 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (6m) 5m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:02:03.645 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (5m) 5m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:02:03.646 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (5m) 5m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:02:03.646 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (5m) 3m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:02:03.646 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (4m) 3m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:02:03.646 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (4m) 3m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:02:03.647 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3m) 3m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:02:03.647 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (13m) 3m ago 14m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:02:03.647 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 3m ago 12m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:02:03.897 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:02:03.898 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:02:03.898 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:02:03.898 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:02:03.898 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:02:03.899 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:02:03.899 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:02:03.899 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:02:03.899 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:02:03.900 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:02:03.900 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:02:03.900 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:02:03.900 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:02:03.900 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:02:03.901 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:02:04.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:04 gibba013 bash[29418]: cluster 2021-03-10T14:02:02.704711+0000 mgr.gibba020.yqfnwy (mgr.34427) 520 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:04.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:04 gibba013 bash[29418]: audit 2021-03-10T14:02:03.897958+0000 mon.a (mon.0) 701 : audit [DBG] from='client.? 172.21.2.113:0/933517009' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:04.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:04 gibba013 bash[30381]: cluster 2021-03-10T14:02:02.704711+0000 mgr.gibba020.yqfnwy (mgr.34427) 520 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:04.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:04 gibba013 bash[30381]: audit 2021-03-10T14:02:03.897958+0000 mon.a (mon.0) 701 : audit [DBG] from='client.? 172.21.2.113:0/933517009' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:04.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:04 gibba020 bash[25448]: cluster 2021-03-10T14:02:02.704711+0000 mgr.gibba020.yqfnwy (mgr.34427) 520 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:04.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:04 gibba020 bash[25448]: audit 2021-03-10T14:02:03.897958+0000 mon.a (mon.0) 701 : audit [DBG] from='client.? 172.21.2.113:0/933517009' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:05.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:05 gibba013 bash[29418]: audit 2021-03-10T14:02:03.402319+0000 mgr.gibba020.yqfnwy (mgr.34427) 521 : audit [DBG] from='client.54397 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:02:05.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:05 gibba013 bash[29418]: cephadm 2021-03-10T14:02:03.488663+0000 mgr.gibba020.yqfnwy (mgr.34427) 522 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:02:05.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:05 gibba013 bash[29418]: audit 2021-03-10T14:02:03.627253+0000 mgr.gibba020.yqfnwy (mgr.34427) 523 : audit [DBG] from='client.44418 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:02:05.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:05 gibba013 bash[30381]: audit 2021-03-10T14:02:03.402319+0000 mgr.gibba020.yqfnwy (mgr.34427) 521 : audit [DBG] from='client.54397 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:02:05.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:05 gibba013 bash[30381]: cephadm 2021-03-10T14:02:03.488663+0000 mgr.gibba020.yqfnwy (mgr.34427) 522 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:02:05.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:05 gibba013 bash[30381]: audit 2021-03-10T14:02:03.627253+0000 mgr.gibba020.yqfnwy (mgr.34427) 523 : audit [DBG] from='client.44418 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:02:05.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:05 gibba020 bash[25448]: audit 2021-03-10T14:02:03.402319+0000 mgr.gibba020.yqfnwy (mgr.34427) 521 : audit [DBG] from='client.54397 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:02:05.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:05 gibba020 bash[25448]: cephadm 2021-03-10T14:02:03.488663+0000 mgr.gibba020.yqfnwy (mgr.34427) 522 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:02:05.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:05 gibba020 bash[25448]: audit 2021-03-10T14:02:03.627253+0000 mgr.gibba020.yqfnwy (mgr.34427) 523 : audit [DBG] from='client.44418 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:02:06.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:06 gibba013 bash[29418]: cluster 2021-03-10T14:02:04.706401+0000 mgr.gibba020.yqfnwy (mgr.34427) 524 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:06.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:06 gibba013 bash[29418]: audit 2021-03-10T14:02:05.792162+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T14:02:06.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:06 gibba013 bash[29418]: audit 2021-03-10T14:02:05.792934+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:02:06.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:06 gibba013 bash[29418]: audit 2021-03-10T14:02:05.793566+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:02:06.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:06 gibba013 bash[29418]: audit 2021-03-10T14:02:05.794403+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:02:06.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:06 gibba013 bash[29418]: audit 2021-03-10T14:02:05.933477+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:02:06.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:06 gibba013 bash[29418]: audit 2021-03-10T14:02:05.934490+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:02:06.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:06 gibba013 bash[30381]: cluster 2021-03-10T14:02:04.706401+0000 mgr.gibba020.yqfnwy (mgr.34427) 524 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:06.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:06 gibba013 bash[30381]: audit 2021-03-10T14:02:05.792162+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T14:02:06.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:06 gibba013 bash[30381]: audit 2021-03-10T14:02:05.792934+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:02:06.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:06 gibba013 bash[30381]: audit 2021-03-10T14:02:05.793566+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:02:06.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:06 gibba013 bash[30381]: audit 2021-03-10T14:02:05.794403+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:02:06.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:06 gibba013 bash[30381]: audit 2021-03-10T14:02:05.933477+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:02:06.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:06 gibba013 bash[30381]: audit 2021-03-10T14:02:05.934490+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:02:06.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:06 gibba020 bash[25448]: cluster 2021-03-10T14:02:04.706401+0000 mgr.gibba020.yqfnwy (mgr.34427) 524 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:06.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:06 gibba020 bash[25448]: audit 2021-03-10T14:02:05.792162+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T14:02:06.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:06 gibba020 bash[25448]: audit 2021-03-10T14:02:05.792934+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:02:06.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:06 gibba020 bash[25448]: audit 2021-03-10T14:02:05.793566+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:02:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:06 gibba020 bash[25448]: audit 2021-03-10T14:02:05.794403+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:02:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:06 gibba020 bash[25448]: audit 2021-03-10T14:02:05.933477+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:02:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:06 gibba020 bash[25448]: audit 2021-03-10T14:02:05.934490+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:02:08.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:08 gibba013 bash[29418]: cluster 2021-03-10T14:02:06.710506+0000 mgr.gibba020.yqfnwy (mgr.34427) 525 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:08.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:08 gibba013 bash[30381]: cluster 2021-03-10T14:02:06.710506+0000 mgr.gibba020.yqfnwy (mgr.34427) 525 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:08.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:08 gibba020 bash[25448]: cluster 2021-03-10T14:02:06.710506+0000 mgr.gibba020.yqfnwy (mgr.34427) 525 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:10.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:10 gibba013 bash[29418]: cluster 2021-03-10T14:02:08.711759+0000 mgr.gibba020.yqfnwy (mgr.34427) 526 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:10.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:10 gibba013 bash[30381]: cluster 2021-03-10T14:02:08.711759+0000 mgr.gibba020.yqfnwy (mgr.34427) 526 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:10.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:10 gibba020 bash[25448]: cluster 2021-03-10T14:02:08.711759+0000 mgr.gibba020.yqfnwy (mgr.34427) 526 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:12.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:12 gibba013 bash[29418]: cluster 2021-03-10T14:02:10.713325+0000 mgr.gibba020.yqfnwy (mgr.34427) 527 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:12.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:12 gibba013 bash[30381]: cluster 2021-03-10T14:02:10.713325+0000 mgr.gibba020.yqfnwy (mgr.34427) 527 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:12.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:12 gibba020 bash[25448]: cluster 2021-03-10T14:02:10.713325+0000 mgr.gibba020.yqfnwy (mgr.34427) 527 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:14.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:14 gibba013 bash[29418]: cluster 2021-03-10T14:02:12.714591+0000 mgr.gibba020.yqfnwy (mgr.34427) 528 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:14.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:14 gibba013 bash[30381]: cluster 2021-03-10T14:02:12.714591+0000 mgr.gibba020.yqfnwy (mgr.34427) 528 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:14.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:14 gibba020 bash[25448]: cluster 2021-03-10T14:02:12.714591+0000 mgr.gibba020.yqfnwy (mgr.34427) 528 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:16.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:16 gibba013 bash[29418]: cluster 2021-03-10T14:02:14.716085+0000 mgr.gibba020.yqfnwy (mgr.34427) 529 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:16.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:16 gibba013 bash[30381]: cluster 2021-03-10T14:02:14.716085+0000 mgr.gibba020.yqfnwy (mgr.34427) 529 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:16.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:16 gibba020 bash[25448]: cluster 2021-03-10T14:02:14.716085+0000 mgr.gibba020.yqfnwy (mgr.34427) 529 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:18.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:18 gibba013 bash[29418]: cluster 2021-03-10T14:02:16.716568+0000 mgr.gibba020.yqfnwy (mgr.34427) 530 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:18.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:18 gibba013 bash[30381]: cluster 2021-03-10T14:02:16.716568+0000 mgr.gibba020.yqfnwy (mgr.34427) 530 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:18.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:18 gibba020 bash[25448]: cluster 2021-03-10T14:02:16.716568+0000 mgr.gibba020.yqfnwy (mgr.34427) 530 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:19.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:19 gibba013 bash[29418]: audit 2021-03-10T14:02:18.508363+0000 mon.a (mon.0) 708 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:02:19.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:19 gibba013 bash[29418]: audit 2021-03-10T14:02:18.718066+0000 mon.a (mon.0) 709 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:02:19.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:19 gibba013 bash[29418]: audit 2021-03-10T14:02:18.721725+0000 mon.a (mon.0) 710 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:02:19.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:19 gibba013 bash[29418]: audit 2021-03-10T14:02:18.724412+0000 mon.a (mon.0) 711 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:19.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:19 gibba013 bash[29418]: audit 2021-03-10T14:02:18.726871+0000 mon.a (mon.0) 712 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:19.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:19 gibba013 bash[29418]: audit 2021-03-10T14:02:18.729371+0000 mon.a (mon.0) 713 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:19.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:19 gibba013 bash[29418]: audit 2021-03-10T14:02:18.734213+0000 mon.a (mon.0) 714 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:19.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:19 gibba013 bash[29418]: audit 2021-03-10T14:02:18.736786+0000 mon.a (mon.0) 715 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:19.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:19 gibba013 bash[30381]: audit 2021-03-10T14:02:18.508363+0000 mon.a (mon.0) 708 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:02:19.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:19 gibba013 bash[30381]: audit 2021-03-10T14:02:18.718066+0000 mon.a (mon.0) 709 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:02:19.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:19 gibba013 bash[30381]: audit 2021-03-10T14:02:18.721725+0000 mon.a (mon.0) 710 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:02:19.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:19 gibba013 bash[30381]: audit 2021-03-10T14:02:18.724412+0000 mon.a (mon.0) 711 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:19.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:19 gibba013 bash[30381]: audit 2021-03-10T14:02:18.726871+0000 mon.a (mon.0) 712 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:19.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:19 gibba013 bash[30381]: audit 2021-03-10T14:02:18.729371+0000 mon.a (mon.0) 713 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:19.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:19 gibba013 bash[30381]: audit 2021-03-10T14:02:18.734213+0000 mon.a (mon.0) 714 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:19.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:19 gibba013 bash[30381]: audit 2021-03-10T14:02:18.736786+0000 mon.a (mon.0) 715 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:19.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:19 gibba020 bash[25448]: audit 2021-03-10T14:02:18.508363+0000 mon.a (mon.0) 708 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:02:19.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:19 gibba020 bash[25448]: audit 2021-03-10T14:02:18.718066+0000 mon.a (mon.0) 709 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:02:19.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:19 gibba020 bash[25448]: audit 2021-03-10T14:02:18.721725+0000 mon.a (mon.0) 710 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:02:19.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:19 gibba020 bash[25448]: audit 2021-03-10T14:02:18.724412+0000 mon.a (mon.0) 711 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:19.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:19 gibba020 bash[25448]: audit 2021-03-10T14:02:18.726871+0000 mon.a (mon.0) 712 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:19.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:19 gibba020 bash[25448]: audit 2021-03-10T14:02:18.729371+0000 mon.a (mon.0) 713 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:19.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:19 gibba020 bash[25448]: audit 2021-03-10T14:02:18.734213+0000 mon.a (mon.0) 714 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:19.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:19 gibba020 bash[25448]: audit 2021-03-10T14:02:18.736786+0000 mon.a (mon.0) 715 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:20.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:20 gibba013 bash[29418]: cephadm 2021-03-10T14:02:18.511456+0000 mgr.gibba020.yqfnwy (mgr.34427) 531 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:02:20.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:20 gibba013 bash[29418]: cephadm 2021-03-10T14:02:18.513104+0000 mgr.gibba020.yqfnwy (mgr.34427) 532 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:02:20.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:20 gibba013 bash[29418]: cluster 2021-03-10T14:02:18.716992+0000 mgr.gibba020.yqfnwy (mgr.34427) 533 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:20.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:20 gibba013 bash[29418]: cephadm 2021-03-10T14:02:18.717773+0000 mgr.gibba020.yqfnwy (mgr.34427) 534 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:02:20.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:20 gibba013 bash[29418]: cephadm 2021-03-10T14:02:18.720897+0000 mgr.gibba020.yqfnwy (mgr.34427) 535 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:02:20.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:20 gibba013 bash[29418]: cephadm 2021-03-10T14:02:18.723319+0000 mgr.gibba020.yqfnwy (mgr.34427) 536 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:02:20.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:20 gibba013 bash[29418]: cephadm 2021-03-10T14:02:18.723358+0000 mgr.gibba020.yqfnwy (mgr.34427) 537 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:02:20.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:20 gibba013 bash[29418]: cephadm 2021-03-10T14:02:18.725894+0000 mgr.gibba020.yqfnwy (mgr.34427) 538 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:02:20.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:20 gibba013 bash[29418]: cephadm 2021-03-10T14:02:18.725930+0000 mgr.gibba020.yqfnwy (mgr.34427) 539 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:02:20.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:20 gibba013 bash[29418]: cephadm 2021-03-10T14:02:18.728256+0000 mgr.gibba020.yqfnwy (mgr.34427) 540 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:02:20.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:20 gibba013 bash[29418]: cephadm 2021-03-10T14:02:18.730556+0000 mgr.gibba020.yqfnwy (mgr.34427) 541 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:02:20.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:20 gibba013 bash[29418]: cephadm 2021-03-10T14:02:18.730594+0000 mgr.gibba020.yqfnwy (mgr.34427) 542 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:02:20.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:20 gibba013 bash[29418]: cephadm 2021-03-10T14:02:18.733037+0000 mgr.gibba020.yqfnwy (mgr.34427) 543 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:02:20.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:20 gibba013 bash[29418]: cephadm 2021-03-10T14:02:18.733357+0000 mgr.gibba020.yqfnwy (mgr.34427) 544 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:02:20.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:20 gibba013 bash[29418]: cephadm 2021-03-10T14:02:18.735590+0000 mgr.gibba020.yqfnwy (mgr.34427) 545 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:02:20.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:20 gibba013 bash[29418]: cephadm 2021-03-10T14:02:18.735631+0000 mgr.gibba020.yqfnwy (mgr.34427) 546 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:02:20.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:20 gibba013 bash[29418]: cephadm 2021-03-10T14:02:18.735737+0000 mgr.gibba020.yqfnwy (mgr.34427) 547 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:02:20.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:20 gibba013 bash[30381]: cephadm 2021-03-10T14:02:18.511456+0000 mgr.gibba020.yqfnwy (mgr.34427) 531 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:02:20.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:20 gibba013 bash[30381]: cephadm 2021-03-10T14:02:18.513104+0000 mgr.gibba020.yqfnwy (mgr.34427) 532 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:02:20.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:20 gibba013 bash[30381]: cluster 2021-03-10T14:02:18.716992+0000 mgr.gibba020.yqfnwy (mgr.34427) 533 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:20.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:20 gibba013 bash[30381]: cephadm 2021-03-10T14:02:18.717773+0000 mgr.gibba020.yqfnwy (mgr.34427) 534 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:02:20.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:20 gibba013 bash[30381]: cephadm 2021-03-10T14:02:18.720897+0000 mgr.gibba020.yqfnwy (mgr.34427) 535 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:02:20.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:20 gibba013 bash[30381]: cephadm 2021-03-10T14:02:18.723319+0000 mgr.gibba020.yqfnwy (mgr.34427) 536 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:02:20.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:20 gibba013 bash[30381]: cephadm 2021-03-10T14:02:18.723358+0000 mgr.gibba020.yqfnwy (mgr.34427) 537 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:02:20.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:20 gibba013 bash[30381]: cephadm 2021-03-10T14:02:18.725894+0000 mgr.gibba020.yqfnwy (mgr.34427) 538 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:02:20.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:20 gibba013 bash[30381]: cephadm 2021-03-10T14:02:18.725930+0000 mgr.gibba020.yqfnwy (mgr.34427) 539 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:02:20.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:20 gibba013 bash[30381]: cephadm 2021-03-10T14:02:18.728256+0000 mgr.gibba020.yqfnwy (mgr.34427) 540 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:02:20.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:20 gibba013 bash[30381]: cephadm 2021-03-10T14:02:18.730556+0000 mgr.gibba020.yqfnwy (mgr.34427) 541 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:02:20.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:20 gibba013 bash[30381]: cephadm 2021-03-10T14:02:18.730594+0000 mgr.gibba020.yqfnwy (mgr.34427) 542 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:02:20.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:20 gibba013 bash[30381]: cephadm 2021-03-10T14:02:18.733037+0000 mgr.gibba020.yqfnwy (mgr.34427) 543 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:02:20.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:20 gibba013 bash[30381]: cephadm 2021-03-10T14:02:18.733357+0000 mgr.gibba020.yqfnwy (mgr.34427) 544 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:02:20.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:20 gibba013 bash[30381]: cephadm 2021-03-10T14:02:18.735590+0000 mgr.gibba020.yqfnwy (mgr.34427) 545 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:02:20.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:20 gibba013 bash[30381]: cephadm 2021-03-10T14:02:18.735631+0000 mgr.gibba020.yqfnwy (mgr.34427) 546 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:02:20.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:20 gibba013 bash[30381]: cephadm 2021-03-10T14:02:18.735737+0000 mgr.gibba020.yqfnwy (mgr.34427) 547 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:02:20.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:20 gibba020 bash[25448]: cephadm 2021-03-10T14:02:18.511456+0000 mgr.gibba020.yqfnwy (mgr.34427) 531 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:02:20.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:20 gibba020 bash[25448]: cephadm 2021-03-10T14:02:18.513104+0000 mgr.gibba020.yqfnwy (mgr.34427) 532 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:02:20.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:20 gibba020 bash[25448]: cluster 2021-03-10T14:02:18.716992+0000 mgr.gibba020.yqfnwy (mgr.34427) 533 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:20.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:20 gibba020 bash[25448]: cephadm 2021-03-10T14:02:18.717773+0000 mgr.gibba020.yqfnwy (mgr.34427) 534 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:02:20.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:20 gibba020 bash[25448]: cephadm 2021-03-10T14:02:18.720897+0000 mgr.gibba020.yqfnwy (mgr.34427) 535 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:02:20.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:20 gibba020 bash[25448]: cephadm 2021-03-10T14:02:18.723319+0000 mgr.gibba020.yqfnwy (mgr.34427) 536 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:02:20.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:20 gibba020 bash[25448]: cephadm 2021-03-10T14:02:18.723358+0000 mgr.gibba020.yqfnwy (mgr.34427) 537 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:02:20.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:20 gibba020 bash[25448]: cephadm 2021-03-10T14:02:18.725894+0000 mgr.gibba020.yqfnwy (mgr.34427) 538 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:02:20.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:20 gibba020 bash[25448]: cephadm 2021-03-10T14:02:18.725930+0000 mgr.gibba020.yqfnwy (mgr.34427) 539 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:02:20.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:20 gibba020 bash[25448]: cephadm 2021-03-10T14:02:18.728256+0000 mgr.gibba020.yqfnwy (mgr.34427) 540 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:02:20.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:20 gibba020 bash[25448]: cephadm 2021-03-10T14:02:18.730556+0000 mgr.gibba020.yqfnwy (mgr.34427) 541 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:02:20.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:20 gibba020 bash[25448]: cephadm 2021-03-10T14:02:18.730594+0000 mgr.gibba020.yqfnwy (mgr.34427) 542 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:02:20.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:20 gibba020 bash[25448]: cephadm 2021-03-10T14:02:18.733037+0000 mgr.gibba020.yqfnwy (mgr.34427) 543 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:02:20.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:20 gibba020 bash[25448]: cephadm 2021-03-10T14:02:18.733357+0000 mgr.gibba020.yqfnwy (mgr.34427) 544 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:02:20.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:20 gibba020 bash[25448]: cephadm 2021-03-10T14:02:18.735590+0000 mgr.gibba020.yqfnwy (mgr.34427) 545 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:02:20.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:20 gibba020 bash[25448]: cephadm 2021-03-10T14:02:18.735631+0000 mgr.gibba020.yqfnwy (mgr.34427) 546 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:02:20.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:20 gibba020 bash[25448]: cephadm 2021-03-10T14:02:18.735737+0000 mgr.gibba020.yqfnwy (mgr.34427) 547 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:02:22.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:22 gibba013 bash[29418]: cluster 2021-03-10T14:02:20.718319+0000 mgr.gibba020.yqfnwy (mgr.34427) 548 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:22.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:22 gibba013 bash[30381]: cluster 2021-03-10T14:02:20.718319+0000 mgr.gibba020.yqfnwy (mgr.34427) 548 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:22.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:22 gibba020 bash[25448]: cluster 2021-03-10T14:02:20.718319+0000 mgr.gibba020.yqfnwy (mgr.34427) 548 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:24.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:24 gibba013 bash[29418]: cluster 2021-03-10T14:02:22.719719+0000 mgr.gibba020.yqfnwy (mgr.34427) 549 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:24.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:24 gibba013 bash[30381]: cluster 2021-03-10T14:02:22.719719+0000 mgr.gibba020.yqfnwy (mgr.34427) 549 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:24.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:24 gibba020 bash[25448]: cluster 2021-03-10T14:02:22.719719+0000 mgr.gibba020.yqfnwy (mgr.34427) 549 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:26.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:26 gibba013 bash[29418]: cluster 2021-03-10T14:02:24.721159+0000 mgr.gibba020.yqfnwy (mgr.34427) 550 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:26.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:26 gibba013 bash[30381]: cluster 2021-03-10T14:02:24.721159+0000 mgr.gibba020.yqfnwy (mgr.34427) 550 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:26.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:26 gibba020 bash[25448]: cluster 2021-03-10T14:02:24.721159+0000 mgr.gibba020.yqfnwy (mgr.34427) 550 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:27.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:27 gibba020 bash[25448]: cluster 2021-03-10T14:02:26.721821+0000 mgr.gibba020.yqfnwy (mgr.34427) 551 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:27.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:27 gibba013 bash[29418]: cluster 2021-03-10T14:02:26.721821+0000 mgr.gibba020.yqfnwy (mgr.34427) 551 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:27.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:27 gibba013 bash[30381]: cluster 2021-03-10T14:02:26.721821+0000 mgr.gibba020.yqfnwy (mgr.34427) 551 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:30.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:29 gibba013 bash[29418]: cluster 2021-03-10T14:02:28.723101+0000 mgr.gibba020.yqfnwy (mgr.34427) 552 : cluster [DBG] pgmap v296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:30.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:29 gibba013 bash[30381]: cluster 2021-03-10T14:02:28.723101+0000 mgr.gibba020.yqfnwy (mgr.34427) 552 : cluster [DBG] pgmap v296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:30.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:29 gibba020 bash[25448]: cluster 2021-03-10T14:02:28.723101+0000 mgr.gibba020.yqfnwy (mgr.34427) 552 : cluster [DBG] pgmap v296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:32.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:31 gibba020 bash[25448]: cluster 2021-03-10T14:02:30.724612+0000 mgr.gibba020.yqfnwy (mgr.34427) 553 : cluster [DBG] pgmap v297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:32.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:31 gibba013 bash[29418]: cluster 2021-03-10T14:02:30.724612+0000 mgr.gibba020.yqfnwy (mgr.34427) 553 : cluster [DBG] pgmap v297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:32.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:31 gibba013 bash[30381]: cluster 2021-03-10T14:02:30.724612+0000 mgr.gibba020.yqfnwy (mgr.34427) 553 : cluster [DBG] pgmap v297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:34.145 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:02:34.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:33 gibba020 bash[25448]: cluster 2021-03-10T14:02:32.726046+0000 mgr.gibba020.yqfnwy (mgr.34427) 554 : cluster [DBG] pgmap v298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:34.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:33 gibba013 bash[29418]: cluster 2021-03-10T14:02:32.726046+0000 mgr.gibba020.yqfnwy (mgr.34427) 554 : cluster [DBG] pgmap v298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:34.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:33 gibba013 bash[30381]: cluster 2021-03-10T14:02:32.726046+0000 mgr.gibba020.yqfnwy (mgr.34427) 554 : cluster [DBG] pgmap v298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:34.380 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:02:34.380 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (9m) 6m ago 14m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:02:34.380 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (14m) 4m ago 14m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:02:34.381 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (9m) 4m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:02:34.381 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (9m) 4m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:02:34.381 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (8m) 6m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:02:34.382 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (8m) 6m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:02:34.382 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (8m) 4m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:02:34.382 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (8m) 6m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:02:34.383 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (14m) 6m ago 14m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:02:34.383 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (14m) 4m ago 14m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:02:34.383 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (7m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:02:34.384 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (6m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:02:34.384 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (6m) 6m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:02:34.384 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (6m) 6m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:02:34.385 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (5m) 4m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:02:34.385 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (5m) 4m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:02:34.385 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (4m) 4m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:02:34.386 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (4m) 4m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:02:34.386 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (13m) 4m ago 14m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:02:34.386 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 4m ago 12m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:02:34.634 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:02:34.634 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:02:34.635 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:02:34.635 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:02:34.635 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:02:34.636 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:02:34.636 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:02:34.637 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:02:34.637 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:02:34.638 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:02:34.638 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:02:34.639 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:02:34.639 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:02:34.640 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:02:34.640 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:02:35.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:34 gibba013 bash[29418]: cephadm 2021-03-10T14:02:33.751720+0000 mgr.gibba020.yqfnwy (mgr.34427) 555 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:02:35.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:34 gibba013 bash[29418]: audit 2021-03-10T14:02:34.133730+0000 mgr.gibba020.yqfnwy (mgr.34427) 556 : audit [DBG] from='client.54415 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:02:35.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:34 gibba013 bash[29418]: audit 2021-03-10T14:02:34.634273+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.2.113:0/1144923894' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:35.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:34 gibba013 bash[30381]: cephadm 2021-03-10T14:02:33.751720+0000 mgr.gibba020.yqfnwy (mgr.34427) 555 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:02:35.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:34 gibba013 bash[30381]: audit 2021-03-10T14:02:34.133730+0000 mgr.gibba020.yqfnwy (mgr.34427) 556 : audit [DBG] from='client.54415 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:02:35.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:34 gibba013 bash[30381]: audit 2021-03-10T14:02:34.634273+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.2.113:0/1144923894' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:35.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:34 gibba020 bash[25448]: cephadm 2021-03-10T14:02:33.751720+0000 mgr.gibba020.yqfnwy (mgr.34427) 555 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:02:35.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:34 gibba020 bash[25448]: audit 2021-03-10T14:02:34.133730+0000 mgr.gibba020.yqfnwy (mgr.34427) 556 : audit [DBG] from='client.54415 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:02:35.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:34 gibba020 bash[25448]: audit 2021-03-10T14:02:34.634273+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.2.113:0/1144923894' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:02:36.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:35 gibba013 bash[29418]: audit 2021-03-10T14:02:34.364043+0000 mgr.gibba020.yqfnwy (mgr.34427) 557 : audit [DBG] from='client.54421 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:02:36.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:35 gibba013 bash[29418]: cluster 2021-03-10T14:02:34.727505+0000 mgr.gibba020.yqfnwy (mgr.34427) 558 : cluster [DBG] pgmap v299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:36.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:35 gibba013 bash[30381]: audit 2021-03-10T14:02:34.364043+0000 mgr.gibba020.yqfnwy (mgr.34427) 557 : audit [DBG] from='client.54421 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:02:36.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:35 gibba013 bash[30381]: cluster 2021-03-10T14:02:34.727505+0000 mgr.gibba020.yqfnwy (mgr.34427) 558 : cluster [DBG] pgmap v299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:36.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:35 gibba020 bash[25448]: audit 2021-03-10T14:02:34.364043+0000 mgr.gibba020.yqfnwy (mgr.34427) 557 : audit [DBG] from='client.54421 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:02:36.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:35 gibba020 bash[25448]: cluster 2021-03-10T14:02:34.727505+0000 mgr.gibba020.yqfnwy (mgr.34427) 558 : cluster [DBG] pgmap v299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:38.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:37 gibba013 bash[29418]: cluster 2021-03-10T14:02:36.728367+0000 mgr.gibba020.yqfnwy (mgr.34427) 559 : cluster [DBG] pgmap v300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:38.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:37 gibba013 bash[30381]: cluster 2021-03-10T14:02:36.728367+0000 mgr.gibba020.yqfnwy (mgr.34427) 559 : cluster [DBG] pgmap v300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:38.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:37 gibba020 bash[25448]: cluster 2021-03-10T14:02:36.728367+0000 mgr.gibba020.yqfnwy (mgr.34427) 559 : cluster [DBG] pgmap v300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:40.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:39 gibba013 bash[29418]: cluster 2021-03-10T14:02:38.729865+0000 mgr.gibba020.yqfnwy (mgr.34427) 560 : cluster [DBG] pgmap v301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:40.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:39 gibba013 bash[30381]: cluster 2021-03-10T14:02:38.729865+0000 mgr.gibba020.yqfnwy (mgr.34427) 560 : cluster [DBG] pgmap v301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:40.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:39 gibba020 bash[25448]: cluster 2021-03-10T14:02:38.729865+0000 mgr.gibba020.yqfnwy (mgr.34427) 560 : cluster [DBG] pgmap v301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:42.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:41 gibba013 bash[29418]: cluster 2021-03-10T14:02:40.731424+0000 mgr.gibba020.yqfnwy (mgr.34427) 561 : cluster [DBG] pgmap v302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:42.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:41 gibba013 bash[30381]: cluster 2021-03-10T14:02:40.731424+0000 mgr.gibba020.yqfnwy (mgr.34427) 561 : cluster [DBG] pgmap v302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:42.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:41 gibba020 bash[25448]: cluster 2021-03-10T14:02:40.731424+0000 mgr.gibba020.yqfnwy (mgr.34427) 561 : cluster [DBG] pgmap v302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:44.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:43 gibba013 bash[29418]: cluster 2021-03-10T14:02:42.732984+0000 mgr.gibba020.yqfnwy (mgr.34427) 562 : cluster [DBG] pgmap v303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:44.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:43 gibba013 bash[30381]: cluster 2021-03-10T14:02:42.732984+0000 mgr.gibba020.yqfnwy (mgr.34427) 562 : cluster [DBG] pgmap v303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:44.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:43 gibba020 bash[25448]: cluster 2021-03-10T14:02:42.732984+0000 mgr.gibba020.yqfnwy (mgr.34427) 562 : cluster [DBG] pgmap v303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:46.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:46 gibba013 bash[29418]: cluster 2021-03-10T14:02:44.734422+0000 mgr.gibba020.yqfnwy (mgr.34427) 563 : cluster [DBG] pgmap v304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:46.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:46 gibba013 bash[30381]: cluster 2021-03-10T14:02:44.734422+0000 mgr.gibba020.yqfnwy (mgr.34427) 563 : cluster [DBG] pgmap v304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:46.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:46 gibba020 bash[25448]: cluster 2021-03-10T14:02:44.734422+0000 mgr.gibba020.yqfnwy (mgr.34427) 563 : cluster [DBG] pgmap v304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:48.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:48 gibba013 bash[29418]: cluster 2021-03-10T14:02:46.735338+0000 mgr.gibba020.yqfnwy (mgr.34427) 564 : cluster [DBG] pgmap v305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:48.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:48 gibba013 bash[30381]: cluster 2021-03-10T14:02:46.735338+0000 mgr.gibba020.yqfnwy (mgr.34427) 564 : cluster [DBG] pgmap v305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:48.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:48 gibba020 bash[25448]: cluster 2021-03-10T14:02:46.735338+0000 mgr.gibba020.yqfnwy (mgr.34427) 564 : cluster [DBG] pgmap v305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:50.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:50 gibba013 bash[29418]: cluster 2021-03-10T14:02:48.736784+0000 mgr.gibba020.yqfnwy (mgr.34427) 565 : cluster [DBG] pgmap v306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:50.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:50 gibba013 bash[29418]: cephadm 2021-03-10T14:02:48.767914+0000 mgr.gibba020.yqfnwy (mgr.34427) 566 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:02:50.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:50 gibba013 bash[30381]: cluster 2021-03-10T14:02:48.736784+0000 mgr.gibba020.yqfnwy (mgr.34427) 565 : cluster [DBG] pgmap v306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:50.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:50 gibba013 bash[30381]: cephadm 2021-03-10T14:02:48.767914+0000 mgr.gibba020.yqfnwy (mgr.34427) 566 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:02:50.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:50 gibba020 bash[25448]: cluster 2021-03-10T14:02:48.736784+0000 mgr.gibba020.yqfnwy (mgr.34427) 565 : cluster [DBG] pgmap v306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:50.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:50 gibba020 bash[25448]: cephadm 2021-03-10T14:02:48.767914+0000 mgr.gibba020.yqfnwy (mgr.34427) 566 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:02:52.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:52 gibba013 bash[29418]: cluster 2021-03-10T14:02:50.738493+0000 mgr.gibba020.yqfnwy (mgr.34427) 567 : cluster [DBG] pgmap v307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:52.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:52 gibba013 bash[30381]: cluster 2021-03-10T14:02:50.738493+0000 mgr.gibba020.yqfnwy (mgr.34427) 567 : cluster [DBG] pgmap v307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:52.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:52 gibba020 bash[25448]: cluster 2021-03-10T14:02:50.738493+0000 mgr.gibba020.yqfnwy (mgr.34427) 567 : cluster [DBG] pgmap v307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:54.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:54 gibba013 bash[29418]: cluster 2021-03-10T14:02:52.739865+0000 mgr.gibba020.yqfnwy (mgr.34427) 568 : cluster [DBG] pgmap v308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:54.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:54 gibba013 bash[30381]: cluster 2021-03-10T14:02:52.739865+0000 mgr.gibba020.yqfnwy (mgr.34427) 568 : cluster [DBG] pgmap v308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:54.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:54 gibba020 bash[25448]: cluster 2021-03-10T14:02:52.739865+0000 mgr.gibba020.yqfnwy (mgr.34427) 568 : cluster [DBG] pgmap v308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:56.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:56 gibba013 bash[29418]: cluster 2021-03-10T14:02:54.741313+0000 mgr.gibba020.yqfnwy (mgr.34427) 569 : cluster [DBG] pgmap v309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:56.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:56 gibba013 bash[30381]: cluster 2021-03-10T14:02:54.741313+0000 mgr.gibba020.yqfnwy (mgr.34427) 569 : cluster [DBG] pgmap v309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:56.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:56 gibba020 bash[25448]: cluster 2021-03-10T14:02:54.741313+0000 mgr.gibba020.yqfnwy (mgr.34427) 569 : cluster [DBG] pgmap v309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:58.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:02:58 gibba013 bash[29418]: cluster 2021-03-10T14:02:56.742119+0000 mgr.gibba020.yqfnwy (mgr.34427) 570 : cluster [DBG] pgmap v310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:58.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:02:58 gibba013 bash[30381]: cluster 2021-03-10T14:02:56.742119+0000 mgr.gibba020.yqfnwy (mgr.34427) 570 : cluster [DBG] pgmap v310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:02:58.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:02:58 gibba020 bash[25448]: cluster 2021-03-10T14:02:56.742119+0000 mgr.gibba020.yqfnwy (mgr.34427) 570 : cluster [DBG] pgmap v310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:00.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:00 gibba013 bash[29418]: cluster 2021-03-10T14:02:58.743376+0000 mgr.gibba020.yqfnwy (mgr.34427) 571 : cluster [DBG] pgmap v311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:00.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:00 gibba013 bash[30381]: cluster 2021-03-10T14:02:58.743376+0000 mgr.gibba020.yqfnwy (mgr.34427) 571 : cluster [DBG] pgmap v311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:00.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:00 gibba020 bash[25448]: cluster 2021-03-10T14:02:58.743376+0000 mgr.gibba020.yqfnwy (mgr.34427) 571 : cluster [DBG] pgmap v311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:02.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:02 gibba013 bash[29418]: cluster 2021-03-10T14:03:00.745119+0000 mgr.gibba020.yqfnwy (mgr.34427) 572 : cluster [DBG] pgmap v312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:02.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:02 gibba013 bash[30381]: cluster 2021-03-10T14:03:00.745119+0000 mgr.gibba020.yqfnwy (mgr.34427) 572 : cluster [DBG] pgmap v312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:02.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:02 gibba020 bash[25448]: cluster 2021-03-10T14:03:00.745119+0000 mgr.gibba020.yqfnwy (mgr.34427) 572 : cluster [DBG] pgmap v312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:04.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:04 gibba013 bash[29418]: cluster 2021-03-10T14:03:02.746389+0000 mgr.gibba020.yqfnwy (mgr.34427) 573 : cluster [DBG] pgmap v313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:04.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:04 gibba013 bash[30381]: cluster 2021-03-10T14:03:02.746389+0000 mgr.gibba020.yqfnwy (mgr.34427) 573 : cluster [DBG] pgmap v313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:04.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:04 gibba020 bash[25448]: cluster 2021-03-10T14:03:02.746389+0000 mgr.gibba020.yqfnwy (mgr.34427) 573 : cluster [DBG] pgmap v313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:04.880 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:03:05.108 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:03:05.108 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (9m) 6m ago 14m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:03:05.109 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (14m) 4m ago 14m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:03:05.109 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (9m) 4m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:03:05.109 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (10m) 4m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:03:05.109 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (9m) 6m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:03:05.110 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (9m) 6m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:03:05.110 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (8m) 4m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:03:05.110 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (8m) 6m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:03:05.110 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (15m) 6m ago 15m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:03:05.111 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (15m) 4m ago 15m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:03:05.111 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (7m) 6m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:03:05.111 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (7m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:03:05.111 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (7m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:03:05.112 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (6m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:03:05.112 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (6m) 4m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:03:05.112 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (5m) 4m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:03:05.112 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (5m) 4m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:03:05.113 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (4m) 4m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:03:05.113 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (14m) 4m ago 15m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:03:05.113 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 4m ago 13m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:03:05.360 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:03:05.360 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:03:05.360 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:03:05.361 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:03:05.361 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:03:05.361 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:03:05.361 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:03:05.361 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:03:05.362 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:03:05.362 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:03:05.362 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:03:05.362 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:03:05.363 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:03:05.363 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:03:05.363 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:03:05.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:05 gibba013 bash[29418]: cephadm 2021-03-10T14:03:03.783696+0000 mgr.gibba020.yqfnwy (mgr.34427) 574 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:03:05.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:05 gibba013 bash[30381]: cephadm 2021-03-10T14:03:03.783696+0000 mgr.gibba020.yqfnwy (mgr.34427) 574 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:03:05.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:05 gibba020 bash[25448]: cephadm 2021-03-10T14:03:03.783696+0000 mgr.gibba020.yqfnwy (mgr.34427) 574 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:03:06.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:06 gibba013 bash[29418]: cluster 2021-03-10T14:03:04.747848+0000 mgr.gibba020.yqfnwy (mgr.34427) 575 : cluster [DBG] pgmap v314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:06.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:06 gibba013 bash[29418]: audit 2021-03-10T14:03:04.868868+0000 mgr.gibba020.yqfnwy (mgr.34427) 576 : audit [DBG] from='client.44448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:03:06.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:06 gibba013 bash[29418]: audit 2021-03-10T14:03:05.096691+0000 mgr.gibba020.yqfnwy (mgr.34427) 577 : audit [DBG] from='client.44454 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:03:06.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:06 gibba013 bash[29418]: audit 2021-03-10T14:03:05.360303+0000 mon.a (mon.0) 716 : audit [DBG] from='client.? 172.21.2.113:0/971144329' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:06.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:06 gibba013 bash[29418]: audit 2021-03-10T14:03:05.802615+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:03:06.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:06 gibba013 bash[29418]: audit 2021-03-10T14:03:05.803749+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:03:06.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:06 gibba013 bash[29418]: audit 2021-03-10T14:03:05.804783+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:03:06.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:06 gibba013 bash[29418]: audit 2021-03-10T14:03:05.805848+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:03:06.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:06 gibba013 bash[29418]: audit 2021-03-10T14:03:05.947997+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:03:06.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:06 gibba013 bash[29418]: audit 2021-03-10T14:03:05.951517+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:03:06.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:06 gibba013 bash[30381]: cluster 2021-03-10T14:03:04.747848+0000 mgr.gibba020.yqfnwy (mgr.34427) 575 : cluster [DBG] pgmap v314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:06.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:06 gibba013 bash[30381]: audit 2021-03-10T14:03:04.868868+0000 mgr.gibba020.yqfnwy (mgr.34427) 576 : audit [DBG] from='client.44448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:03:06.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:06 gibba013 bash[30381]: audit 2021-03-10T14:03:05.096691+0000 mgr.gibba020.yqfnwy (mgr.34427) 577 : audit [DBG] from='client.44454 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:03:06.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:06 gibba013 bash[30381]: audit 2021-03-10T14:03:05.360303+0000 mon.a (mon.0) 716 : audit [DBG] from='client.? 172.21.2.113:0/971144329' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:06.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:06 gibba013 bash[30381]: audit 2021-03-10T14:03:05.802615+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:03:06.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:06 gibba013 bash[30381]: audit 2021-03-10T14:03:05.803749+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:03:06.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:06 gibba013 bash[30381]: audit 2021-03-10T14:03:05.804783+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:03:06.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:06 gibba013 bash[30381]: audit 2021-03-10T14:03:05.805848+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:03:06.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:06 gibba013 bash[30381]: audit 2021-03-10T14:03:05.947997+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:03:06.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:06 gibba013 bash[30381]: audit 2021-03-10T14:03:05.951517+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:03:06.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:06 gibba020 bash[25448]: cluster 2021-03-10T14:03:04.747848+0000 mgr.gibba020.yqfnwy (mgr.34427) 575 : cluster [DBG] pgmap v314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:06.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:06 gibba020 bash[25448]: audit 2021-03-10T14:03:04.868868+0000 mgr.gibba020.yqfnwy (mgr.34427) 576 : audit [DBG] from='client.44448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:03:06.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:06 gibba020 bash[25448]: audit 2021-03-10T14:03:05.096691+0000 mgr.gibba020.yqfnwy (mgr.34427) 577 : audit [DBG] from='client.44454 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:03:06.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:06 gibba020 bash[25448]: audit 2021-03-10T14:03:05.360303+0000 mon.a (mon.0) 716 : audit [DBG] from='client.? 172.21.2.113:0/971144329' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:06.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:06 gibba020 bash[25448]: audit 2021-03-10T14:03:05.802615+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:03:06.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:06 gibba020 bash[25448]: audit 2021-03-10T14:03:05.803749+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:03:06.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:06 gibba020 bash[25448]: audit 2021-03-10T14:03:05.804783+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:03:06.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:06 gibba020 bash[25448]: audit 2021-03-10T14:03:05.805848+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:03:06.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:06 gibba020 bash[25448]: audit 2021-03-10T14:03:05.947997+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:03:06.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:06 gibba020 bash[25448]: audit 2021-03-10T14:03:05.951517+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:03:08.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:08 gibba013 bash[29418]: cluster 2021-03-10T14:03:06.748551+0000 mgr.gibba020.yqfnwy (mgr.34427) 578 : cluster [DBG] pgmap v315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:08.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:08 gibba013 bash[30381]: cluster 2021-03-10T14:03:06.748551+0000 mgr.gibba020.yqfnwy (mgr.34427) 578 : cluster [DBG] pgmap v315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:08.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:08 gibba020 bash[25448]: cluster 2021-03-10T14:03:06.748551+0000 mgr.gibba020.yqfnwy (mgr.34427) 578 : cluster [DBG] pgmap v315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:10.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:10 gibba013 bash[29418]: cluster 2021-03-10T14:03:08.749967+0000 mgr.gibba020.yqfnwy (mgr.34427) 579 : cluster [DBG] pgmap v316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:10.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:10 gibba013 bash[30381]: cluster 2021-03-10T14:03:08.749967+0000 mgr.gibba020.yqfnwy (mgr.34427) 579 : cluster [DBG] pgmap v316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:10.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:10 gibba020 bash[25448]: cluster 2021-03-10T14:03:08.749967+0000 mgr.gibba020.yqfnwy (mgr.34427) 579 : cluster [DBG] pgmap v316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:12.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:12 gibba013 bash[29418]: cluster 2021-03-10T14:03:10.751696+0000 mgr.gibba020.yqfnwy (mgr.34427) 580 : cluster [DBG] pgmap v317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:12.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:12 gibba013 bash[30381]: cluster 2021-03-10T14:03:10.751696+0000 mgr.gibba020.yqfnwy (mgr.34427) 580 : cluster [DBG] pgmap v317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:12.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:12 gibba020 bash[25448]: cluster 2021-03-10T14:03:10.751696+0000 mgr.gibba020.yqfnwy (mgr.34427) 580 : cluster [DBG] pgmap v317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:14.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:14 gibba020 bash[25448]: cluster 2021-03-10T14:03:12.753469+0000 mgr.gibba020.yqfnwy (mgr.34427) 581 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:14.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:14 gibba013 bash[29418]: cluster 2021-03-10T14:03:12.753469+0000 mgr.gibba020.yqfnwy (mgr.34427) 581 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:14.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:14 gibba013 bash[30381]: cluster 2021-03-10T14:03:12.753469+0000 mgr.gibba020.yqfnwy (mgr.34427) 581 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:16.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:16 gibba020 bash[25448]: cluster 2021-03-10T14:03:14.755074+0000 mgr.gibba020.yqfnwy (mgr.34427) 582 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:16.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:16 gibba013 bash[29418]: cluster 2021-03-10T14:03:14.755074+0000 mgr.gibba020.yqfnwy (mgr.34427) 582 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:16.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:16 gibba013 bash[30381]: cluster 2021-03-10T14:03:14.755074+0000 mgr.gibba020.yqfnwy (mgr.34427) 582 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:18.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:18 gibba020 bash[25448]: cluster 2021-03-10T14:03:16.755888+0000 mgr.gibba020.yqfnwy (mgr.34427) 583 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:18.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:18 gibba013 bash[29418]: cluster 2021-03-10T14:03:16.755888+0000 mgr.gibba020.yqfnwy (mgr.34427) 583 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:18.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:18 gibba013 bash[30381]: cluster 2021-03-10T14:03:16.755888+0000 mgr.gibba020.yqfnwy (mgr.34427) 583 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:19.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:19 gibba020 bash[25448]: audit 2021-03-10T14:03:18.799946+0000 mon.a (mon.0) 723 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:03:19.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:19 gibba020 bash[25448]: audit 2021-03-10T14:03:19.013145+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:03:19.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:19 gibba020 bash[25448]: audit 2021-03-10T14:03:19.016153+0000 mon.a (mon.0) 725 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:03:19.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:19 gibba020 bash[25448]: audit 2021-03-10T14:03:19.017391+0000 mon.a (mon.0) 726 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:19.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:19 gibba020 bash[25448]: audit 2021-03-10T14:03:19.018698+0000 mon.a (mon.0) 727 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:19.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:19 gibba020 bash[25448]: audit 2021-03-10T14:03:19.020334+0000 mon.a (mon.0) 728 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:19.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:19 gibba020 bash[25448]: audit 2021-03-10T14:03:19.023199+0000 mon.a (mon.0) 729 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:19.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:19 gibba020 bash[25448]: audit 2021-03-10T14:03:19.024944+0000 mon.a (mon.0) 730 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:19.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:19 gibba013 bash[29418]: audit 2021-03-10T14:03:18.799946+0000 mon.a (mon.0) 723 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:03:19.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:19 gibba013 bash[29418]: audit 2021-03-10T14:03:19.013145+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:03:19.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:19 gibba013 bash[29418]: audit 2021-03-10T14:03:19.016153+0000 mon.a (mon.0) 725 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:03:19.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:19 gibba013 bash[29418]: audit 2021-03-10T14:03:19.017391+0000 mon.a (mon.0) 726 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:19.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:19 gibba013 bash[29418]: audit 2021-03-10T14:03:19.018698+0000 mon.a (mon.0) 727 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:19.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:19 gibba013 bash[29418]: audit 2021-03-10T14:03:19.020334+0000 mon.a (mon.0) 728 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:19.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:19 gibba013 bash[29418]: audit 2021-03-10T14:03:19.023199+0000 mon.a (mon.0) 729 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:19.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:19 gibba013 bash[29418]: audit 2021-03-10T14:03:19.024944+0000 mon.a (mon.0) 730 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:19.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:19 gibba013 bash[30381]: audit 2021-03-10T14:03:18.799946+0000 mon.a (mon.0) 723 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:03:19.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:19 gibba013 bash[30381]: audit 2021-03-10T14:03:19.013145+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:03:19.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:19 gibba013 bash[30381]: audit 2021-03-10T14:03:19.016153+0000 mon.a (mon.0) 725 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:03:19.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:19 gibba013 bash[30381]: audit 2021-03-10T14:03:19.017391+0000 mon.a (mon.0) 726 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:19.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:19 gibba013 bash[30381]: audit 2021-03-10T14:03:19.018698+0000 mon.a (mon.0) 727 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:19.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:19 gibba013 bash[30381]: audit 2021-03-10T14:03:19.020334+0000 mon.a (mon.0) 728 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:19.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:19 gibba013 bash[30381]: audit 2021-03-10T14:03:19.023199+0000 mon.a (mon.0) 729 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:19.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:19 gibba013 bash[30381]: audit 2021-03-10T14:03:19.024944+0000 mon.a (mon.0) 730 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:20.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:20 gibba020 bash[25448]: cluster 2021-03-10T14:03:18.757558+0000 mgr.gibba020.yqfnwy (mgr.34427) 584 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:20.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:20 gibba020 bash[25448]: cephadm 2021-03-10T14:03:18.801959+0000 mgr.gibba020.yqfnwy (mgr.34427) 585 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:03:20.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:20 gibba020 bash[25448]: cephadm 2021-03-10T14:03:18.804825+0000 mgr.gibba020.yqfnwy (mgr.34427) 586 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:03:20.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:20 gibba020 bash[25448]: cephadm 2021-03-10T14:03:19.012655+0000 mgr.gibba020.yqfnwy (mgr.34427) 587 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:03:20.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:20 gibba020 bash[25448]: cephadm 2021-03-10T14:03:19.014232+0000 mgr.gibba020.yqfnwy (mgr.34427) 588 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:03:20.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:20 gibba020 bash[25448]: cephadm 2021-03-10T14:03:19.015260+0000 mgr.gibba020.yqfnwy (mgr.34427) 589 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:03:20.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:20 gibba020 bash[25448]: cephadm 2021-03-10T14:03:19.015297+0000 mgr.gibba020.yqfnwy (mgr.34427) 590 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:03:20.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:20 gibba020 bash[25448]: cephadm 2021-03-10T14:03:19.016993+0000 mgr.gibba020.yqfnwy (mgr.34427) 591 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:03:20.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:20 gibba020 bash[25448]: cephadm 2021-03-10T14:03:19.017047+0000 mgr.gibba020.yqfnwy (mgr.34427) 592 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:03:20.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:20 gibba020 bash[25448]: cephadm 2021-03-10T14:03:19.018437+0000 mgr.gibba020.yqfnwy (mgr.34427) 593 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:03:20.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:20 gibba020 bash[25448]: cephadm 2021-03-10T14:03:19.019731+0000 mgr.gibba020.yqfnwy (mgr.34427) 594 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:03:20.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:20 gibba020 bash[25448]: cephadm 2021-03-10T14:03:19.019767+0000 mgr.gibba020.yqfnwy (mgr.34427) 595 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:03:20.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:20 gibba020 bash[25448]: cephadm 2021-03-10T14:03:19.021284+0000 mgr.gibba020.yqfnwy (mgr.34427) 596 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:03:20.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:20 gibba020 bash[25448]: cephadm 2021-03-10T14:03:19.021599+0000 mgr.gibba020.yqfnwy (mgr.34427) 597 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:03:20.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:20 gibba020 bash[25448]: cephadm 2021-03-10T14:03:19.022941+0000 mgr.gibba020.yqfnwy (mgr.34427) 598 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:03:20.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:20 gibba020 bash[25448]: cephadm 2021-03-10T14:03:19.022979+0000 mgr.gibba020.yqfnwy (mgr.34427) 599 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:03:20.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:20 gibba020 bash[25448]: cephadm 2021-03-10T14:03:19.023082+0000 mgr.gibba020.yqfnwy (mgr.34427) 600 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:03:20.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:20 gibba013 bash[29418]: cluster 2021-03-10T14:03:18.757558+0000 mgr.gibba020.yqfnwy (mgr.34427) 584 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:20.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:20 gibba013 bash[29418]: cephadm 2021-03-10T14:03:18.801959+0000 mgr.gibba020.yqfnwy (mgr.34427) 585 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:03:20.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:20 gibba013 bash[29418]: cephadm 2021-03-10T14:03:18.804825+0000 mgr.gibba020.yqfnwy (mgr.34427) 586 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:03:20.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:20 gibba013 bash[29418]: cephadm 2021-03-10T14:03:19.012655+0000 mgr.gibba020.yqfnwy (mgr.34427) 587 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:03:20.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:20 gibba013 bash[29418]: cephadm 2021-03-10T14:03:19.014232+0000 mgr.gibba020.yqfnwy (mgr.34427) 588 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:03:20.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:20 gibba013 bash[29418]: cephadm 2021-03-10T14:03:19.015260+0000 mgr.gibba020.yqfnwy (mgr.34427) 589 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:03:20.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:20 gibba013 bash[29418]: cephadm 2021-03-10T14:03:19.015297+0000 mgr.gibba020.yqfnwy (mgr.34427) 590 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:03:20.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:20 gibba013 bash[29418]: cephadm 2021-03-10T14:03:19.016993+0000 mgr.gibba020.yqfnwy (mgr.34427) 591 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:03:20.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:20 gibba013 bash[29418]: cephadm 2021-03-10T14:03:19.017047+0000 mgr.gibba020.yqfnwy (mgr.34427) 592 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:03:20.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:20 gibba013 bash[29418]: cephadm 2021-03-10T14:03:19.018437+0000 mgr.gibba020.yqfnwy (mgr.34427) 593 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:03:20.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:20 gibba013 bash[29418]: cephadm 2021-03-10T14:03:19.019731+0000 mgr.gibba020.yqfnwy (mgr.34427) 594 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:03:20.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:20 gibba013 bash[29418]: cephadm 2021-03-10T14:03:19.019767+0000 mgr.gibba020.yqfnwy (mgr.34427) 595 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:03:20.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:20 gibba013 bash[29418]: cephadm 2021-03-10T14:03:19.021284+0000 mgr.gibba020.yqfnwy (mgr.34427) 596 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:03:20.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:20 gibba013 bash[29418]: cephadm 2021-03-10T14:03:19.021599+0000 mgr.gibba020.yqfnwy (mgr.34427) 597 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:03:20.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:20 gibba013 bash[29418]: cephadm 2021-03-10T14:03:19.022941+0000 mgr.gibba020.yqfnwy (mgr.34427) 598 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:03:20.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:20 gibba013 bash[29418]: cephadm 2021-03-10T14:03:19.022979+0000 mgr.gibba020.yqfnwy (mgr.34427) 599 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:03:20.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:20 gibba013 bash[29418]: cephadm 2021-03-10T14:03:19.023082+0000 mgr.gibba020.yqfnwy (mgr.34427) 600 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:03:20.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:20 gibba013 bash[30381]: cluster 2021-03-10T14:03:18.757558+0000 mgr.gibba020.yqfnwy (mgr.34427) 584 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:20.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:20 gibba013 bash[30381]: cephadm 2021-03-10T14:03:18.801959+0000 mgr.gibba020.yqfnwy (mgr.34427) 585 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:03:20.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:20 gibba013 bash[30381]: cephadm 2021-03-10T14:03:18.804825+0000 mgr.gibba020.yqfnwy (mgr.34427) 586 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:03:20.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:20 gibba013 bash[30381]: cephadm 2021-03-10T14:03:19.012655+0000 mgr.gibba020.yqfnwy (mgr.34427) 587 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:03:20.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:20 gibba013 bash[30381]: cephadm 2021-03-10T14:03:19.014232+0000 mgr.gibba020.yqfnwy (mgr.34427) 588 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:03:20.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:20 gibba013 bash[30381]: cephadm 2021-03-10T14:03:19.015260+0000 mgr.gibba020.yqfnwy (mgr.34427) 589 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:03:20.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:20 gibba013 bash[30381]: cephadm 2021-03-10T14:03:19.015297+0000 mgr.gibba020.yqfnwy (mgr.34427) 590 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:03:20.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:20 gibba013 bash[30381]: cephadm 2021-03-10T14:03:19.016993+0000 mgr.gibba020.yqfnwy (mgr.34427) 591 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:03:20.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:20 gibba013 bash[30381]: cephadm 2021-03-10T14:03:19.017047+0000 mgr.gibba020.yqfnwy (mgr.34427) 592 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:03:20.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:20 gibba013 bash[30381]: cephadm 2021-03-10T14:03:19.018437+0000 mgr.gibba020.yqfnwy (mgr.34427) 593 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:03:20.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:20 gibba013 bash[30381]: cephadm 2021-03-10T14:03:19.019731+0000 mgr.gibba020.yqfnwy (mgr.34427) 594 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:03:20.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:20 gibba013 bash[30381]: cephadm 2021-03-10T14:03:19.019767+0000 mgr.gibba020.yqfnwy (mgr.34427) 595 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:03:20.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:20 gibba013 bash[30381]: cephadm 2021-03-10T14:03:19.021284+0000 mgr.gibba020.yqfnwy (mgr.34427) 596 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:03:20.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:20 gibba013 bash[30381]: cephadm 2021-03-10T14:03:19.021599+0000 mgr.gibba020.yqfnwy (mgr.34427) 597 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:03:20.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:20 gibba013 bash[30381]: cephadm 2021-03-10T14:03:19.022941+0000 mgr.gibba020.yqfnwy (mgr.34427) 598 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:03:20.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:20 gibba013 bash[30381]: cephadm 2021-03-10T14:03:19.022979+0000 mgr.gibba020.yqfnwy (mgr.34427) 599 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:03:20.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:20 gibba013 bash[30381]: cephadm 2021-03-10T14:03:19.023082+0000 mgr.gibba020.yqfnwy (mgr.34427) 600 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:03:22.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:22 gibba020 bash[25448]: cluster 2021-03-10T14:03:20.759348+0000 mgr.gibba020.yqfnwy (mgr.34427) 601 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:22.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:22 gibba013 bash[29418]: cluster 2021-03-10T14:03:20.759348+0000 mgr.gibba020.yqfnwy (mgr.34427) 601 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:22.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:22 gibba013 bash[30381]: cluster 2021-03-10T14:03:20.759348+0000 mgr.gibba020.yqfnwy (mgr.34427) 601 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:24.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:24 gibba020 bash[25448]: cluster 2021-03-10T14:03:22.760910+0000 mgr.gibba020.yqfnwy (mgr.34427) 602 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:24.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:24 gibba013 bash[29418]: cluster 2021-03-10T14:03:22.760910+0000 mgr.gibba020.yqfnwy (mgr.34427) 602 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:24.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:24 gibba013 bash[30381]: cluster 2021-03-10T14:03:22.760910+0000 mgr.gibba020.yqfnwy (mgr.34427) 602 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:26.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:26 gibba020 bash[25448]: cluster 2021-03-10T14:03:24.762360+0000 mgr.gibba020.yqfnwy (mgr.34427) 603 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:26.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:26 gibba013 bash[29418]: cluster 2021-03-10T14:03:24.762360+0000 mgr.gibba020.yqfnwy (mgr.34427) 603 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:26.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:26 gibba013 bash[30381]: cluster 2021-03-10T14:03:24.762360+0000 mgr.gibba020.yqfnwy (mgr.34427) 603 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:28.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:28 gibba013 bash[29418]: cluster 2021-03-10T14:03:26.763185+0000 mgr.gibba020.yqfnwy (mgr.34427) 604 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:28.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:28 gibba013 bash[30381]: cluster 2021-03-10T14:03:26.763185+0000 mgr.gibba020.yqfnwy (mgr.34427) 604 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:28.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:28 gibba020 bash[25448]: cluster 2021-03-10T14:03:26.763185+0000 mgr.gibba020.yqfnwy (mgr.34427) 604 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:30.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:30 gibba013 bash[29418]: cluster 2021-03-10T14:03:28.764426+0000 mgr.gibba020.yqfnwy (mgr.34427) 605 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:30.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:30 gibba013 bash[30381]: cluster 2021-03-10T14:03:28.764426+0000 mgr.gibba020.yqfnwy (mgr.34427) 605 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:30.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:30 gibba020 bash[25448]: cluster 2021-03-10T14:03:28.764426+0000 mgr.gibba020.yqfnwy (mgr.34427) 605 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:32.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:32 gibba013 bash[29418]: cluster 2021-03-10T14:03:30.766037+0000 mgr.gibba020.yqfnwy (mgr.34427) 606 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:32.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:32 gibba013 bash[30381]: cluster 2021-03-10T14:03:30.766037+0000 mgr.gibba020.yqfnwy (mgr.34427) 606 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:32.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:32 gibba020 bash[25448]: cluster 2021-03-10T14:03:30.766037+0000 mgr.gibba020.yqfnwy (mgr.34427) 606 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:34.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:34 gibba020 bash[25448]: cluster 2021-03-10T14:03:32.767688+0000 mgr.gibba020.yqfnwy (mgr.34427) 607 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:34.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:34 gibba013 bash[29418]: cluster 2021-03-10T14:03:32.767688+0000 mgr.gibba020.yqfnwy (mgr.34427) 607 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:34.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:34 gibba013 bash[30381]: cluster 2021-03-10T14:03:32.767688+0000 mgr.gibba020.yqfnwy (mgr.34427) 607 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:35.613 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:03:35.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:35 gibba013 bash[29418]: cephadm 2021-03-10T14:03:34.038818+0000 mgr.gibba020.yqfnwy (mgr.34427) 608 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:03:35.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:35 gibba013 bash[30381]: cephadm 2021-03-10T14:03:34.038818+0000 mgr.gibba020.yqfnwy (mgr.34427) 608 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:03:35.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:35 gibba020 bash[25448]: cephadm 2021-03-10T14:03:34.038818+0000 mgr.gibba020.yqfnwy (mgr.34427) 608 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:03:35.844 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:03:35.845 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (10m) 7m ago 15m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:03:35.845 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (15m) 5m ago 15m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:03:35.845 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (10m) 5m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:03:35.845 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (10m) 5m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:03:35.845 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (9m) 7m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:03:35.846 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (9m) 7m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:03:35.846 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (9m) 5m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:03:35.846 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (9m) 7m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:03:35.846 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (15m) 7m ago 15m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:03:35.847 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (15m) 5m ago 15m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:03:35.847 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (8m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:03:35.847 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (7m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:03:35.847 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (7m) 7m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:03:35.847 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (7m) 7m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:03:35.848 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (6m) 5m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:03:35.848 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (6m) 5m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:03:35.848 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (5m) 5m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:03:35.848 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (5m) 5m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:03:35.848 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (15m) 5m ago 15m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:03:35.849 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 5m ago 13m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:03:36.093 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:03:36.093 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:03:36.093 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:03:36.094 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:03:36.094 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:03:36.094 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:03:36.094 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:03:36.095 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:03:36.095 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:03:36.095 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:03:36.095 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:03:36.096 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:03:36.096 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:03:36.096 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:03:36.096 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:03:36.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:36 gibba013 bash[29418]: cluster 2021-03-10T14:03:34.769580+0000 mgr.gibba020.yqfnwy (mgr.34427) 609 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:36.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:36 gibba013 bash[29418]: audit 2021-03-10T14:03:36.093083+0000 mon.c (mon.1) 21 : audit [DBG] from='client.? 172.21.2.113:0/1485554095' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:36.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:36 gibba013 bash[30381]: cluster 2021-03-10T14:03:34.769580+0000 mgr.gibba020.yqfnwy (mgr.34427) 609 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:36.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:36 gibba013 bash[30381]: audit 2021-03-10T14:03:36.093083+0000 mon.c (mon.1) 21 : audit [DBG] from='client.? 172.21.2.113:0/1485554095' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:36.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:36 gibba020 bash[25448]: cluster 2021-03-10T14:03:34.769580+0000 mgr.gibba020.yqfnwy (mgr.34427) 609 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:36.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:36 gibba020 bash[25448]: audit 2021-03-10T14:03:36.093083+0000 mon.c (mon.1) 21 : audit [DBG] from='client.? 172.21.2.113:0/1485554095' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:03:37.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:37 gibba013 bash[29418]: audit 2021-03-10T14:03:35.592158+0000 mgr.gibba020.yqfnwy (mgr.34427) 610 : audit [DBG] from='client.44466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:03:37.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:37 gibba013 bash[29418]: audit 2021-03-10T14:03:35.829432+0000 mgr.gibba020.yqfnwy (mgr.34427) 611 : audit [DBG] from='client.44472 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:03:37.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:37 gibba013 bash[30381]: audit 2021-03-10T14:03:35.592158+0000 mgr.gibba020.yqfnwy (mgr.34427) 610 : audit [DBG] from='client.44466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:03:37.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:37 gibba013 bash[30381]: audit 2021-03-10T14:03:35.829432+0000 mgr.gibba020.yqfnwy (mgr.34427) 611 : audit [DBG] from='client.44472 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:03:37.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:37 gibba020 bash[25448]: audit 2021-03-10T14:03:35.592158+0000 mgr.gibba020.yqfnwy (mgr.34427) 610 : audit [DBG] from='client.44466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:03:37.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:37 gibba020 bash[25448]: audit 2021-03-10T14:03:35.829432+0000 mgr.gibba020.yqfnwy (mgr.34427) 611 : audit [DBG] from='client.44472 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:03:38.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:38 gibba013 bash[29418]: cluster 2021-03-10T14:03:36.770338+0000 mgr.gibba020.yqfnwy (mgr.34427) 612 : cluster [DBG] pgmap v330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:38.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:38 gibba013 bash[30381]: cluster 2021-03-10T14:03:36.770338+0000 mgr.gibba020.yqfnwy (mgr.34427) 612 : cluster [DBG] pgmap v330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:38.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:38 gibba020 bash[25448]: cluster 2021-03-10T14:03:36.770338+0000 mgr.gibba020.yqfnwy (mgr.34427) 612 : cluster [DBG] pgmap v330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:40.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:40 gibba013 bash[29418]: cluster 2021-03-10T14:03:38.772020+0000 mgr.gibba020.yqfnwy (mgr.34427) 613 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:40.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:40 gibba013 bash[30381]: cluster 2021-03-10T14:03:38.772020+0000 mgr.gibba020.yqfnwy (mgr.34427) 613 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:40.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:40 gibba020 bash[25448]: cluster 2021-03-10T14:03:38.772020+0000 mgr.gibba020.yqfnwy (mgr.34427) 613 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:42.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:42 gibba013 bash[29418]: cluster 2021-03-10T14:03:40.773897+0000 mgr.gibba020.yqfnwy (mgr.34427) 614 : cluster [DBG] pgmap v332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:42.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:42 gibba013 bash[30381]: cluster 2021-03-10T14:03:40.773897+0000 mgr.gibba020.yqfnwy (mgr.34427) 614 : cluster [DBG] pgmap v332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:42.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:42 gibba020 bash[25448]: cluster 2021-03-10T14:03:40.773897+0000 mgr.gibba020.yqfnwy (mgr.34427) 614 : cluster [DBG] pgmap v332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:44.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:44 gibba013 bash[29418]: cluster 2021-03-10T14:03:42.775634+0000 mgr.gibba020.yqfnwy (mgr.34427) 615 : cluster [DBG] pgmap v333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:44.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:44 gibba013 bash[30381]: cluster 2021-03-10T14:03:42.775634+0000 mgr.gibba020.yqfnwy (mgr.34427) 615 : cluster [DBG] pgmap v333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:44.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:44 gibba020 bash[25448]: cluster 2021-03-10T14:03:42.775634+0000 mgr.gibba020.yqfnwy (mgr.34427) 615 : cluster [DBG] pgmap v333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:46.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:46 gibba013 bash[29418]: cluster 2021-03-10T14:03:44.777382+0000 mgr.gibba020.yqfnwy (mgr.34427) 616 : cluster [DBG] pgmap v334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:46.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:46 gibba013 bash[30381]: cluster 2021-03-10T14:03:44.777382+0000 mgr.gibba020.yqfnwy (mgr.34427) 616 : cluster [DBG] pgmap v334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:46.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:46 gibba020 bash[25448]: cluster 2021-03-10T14:03:44.777382+0000 mgr.gibba020.yqfnwy (mgr.34427) 616 : cluster [DBG] pgmap v334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:48.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:48 gibba013 bash[29418]: cluster 2021-03-10T14:03:46.778182+0000 mgr.gibba020.yqfnwy (mgr.34427) 617 : cluster [DBG] pgmap v335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:48.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:48 gibba013 bash[30381]: cluster 2021-03-10T14:03:46.778182+0000 mgr.gibba020.yqfnwy (mgr.34427) 617 : cluster [DBG] pgmap v335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:48.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:48 gibba020 bash[25448]: cluster 2021-03-10T14:03:46.778182+0000 mgr.gibba020.yqfnwy (mgr.34427) 617 : cluster [DBG] pgmap v335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:50.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:50 gibba013 bash[29418]: cluster 2021-03-10T14:03:48.779849+0000 mgr.gibba020.yqfnwy (mgr.34427) 618 : cluster [DBG] pgmap v336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:50.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:50 gibba013 bash[29418]: cephadm 2021-03-10T14:03:49.052861+0000 mgr.gibba020.yqfnwy (mgr.34427) 619 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:03:50.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:50 gibba013 bash[30381]: cluster 2021-03-10T14:03:48.779849+0000 mgr.gibba020.yqfnwy (mgr.34427) 618 : cluster [DBG] pgmap v336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:50.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:50 gibba013 bash[30381]: cephadm 2021-03-10T14:03:49.052861+0000 mgr.gibba020.yqfnwy (mgr.34427) 619 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:03:50.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:50 gibba020 bash[25448]: cluster 2021-03-10T14:03:48.779849+0000 mgr.gibba020.yqfnwy (mgr.34427) 618 : cluster [DBG] pgmap v336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:50.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:50 gibba020 bash[25448]: cephadm 2021-03-10T14:03:49.052861+0000 mgr.gibba020.yqfnwy (mgr.34427) 619 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:03:52.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:52 gibba013 bash[29418]: cluster 2021-03-10T14:03:50.781636+0000 mgr.gibba020.yqfnwy (mgr.34427) 620 : cluster [DBG] pgmap v337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:52.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:52 gibba013 bash[30381]: cluster 2021-03-10T14:03:50.781636+0000 mgr.gibba020.yqfnwy (mgr.34427) 620 : cluster [DBG] pgmap v337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:52.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:52 gibba020 bash[25448]: cluster 2021-03-10T14:03:50.781636+0000 mgr.gibba020.yqfnwy (mgr.34427) 620 : cluster [DBG] pgmap v337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:54.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:54 gibba013 bash[29418]: cluster 2021-03-10T14:03:52.783185+0000 mgr.gibba020.yqfnwy (mgr.34427) 621 : cluster [DBG] pgmap v338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:54.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:54 gibba013 bash[30381]: cluster 2021-03-10T14:03:52.783185+0000 mgr.gibba020.yqfnwy (mgr.34427) 621 : cluster [DBG] pgmap v338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:54.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:54 gibba020 bash[25448]: cluster 2021-03-10T14:03:52.783185+0000 mgr.gibba020.yqfnwy (mgr.34427) 621 : cluster [DBG] pgmap v338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:56.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:56 gibba013 bash[29418]: cluster 2021-03-10T14:03:54.784933+0000 mgr.gibba020.yqfnwy (mgr.34427) 622 : cluster [DBG] pgmap v339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:56.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:56 gibba013 bash[30381]: cluster 2021-03-10T14:03:54.784933+0000 mgr.gibba020.yqfnwy (mgr.34427) 622 : cluster [DBG] pgmap v339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:56.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:56 gibba020 bash[25448]: cluster 2021-03-10T14:03:54.784933+0000 mgr.gibba020.yqfnwy (mgr.34427) 622 : cluster [DBG] pgmap v339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:58.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:03:58 gibba013 bash[29418]: cluster 2021-03-10T14:03:56.785777+0000 mgr.gibba020.yqfnwy (mgr.34427) 623 : cluster [DBG] pgmap v340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:58.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:03:58 gibba013 bash[30381]: cluster 2021-03-10T14:03:56.785777+0000 mgr.gibba020.yqfnwy (mgr.34427) 623 : cluster [DBG] pgmap v340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:03:58.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:03:58 gibba020 bash[25448]: cluster 2021-03-10T14:03:56.785777+0000 mgr.gibba020.yqfnwy (mgr.34427) 623 : cluster [DBG] pgmap v340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:00.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:00 gibba013 bash[29418]: cluster 2021-03-10T14:03:58.787250+0000 mgr.gibba020.yqfnwy (mgr.34427) 624 : cluster [DBG] pgmap v341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:00.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:00 gibba013 bash[30381]: cluster 2021-03-10T14:03:58.787250+0000 mgr.gibba020.yqfnwy (mgr.34427) 624 : cluster [DBG] pgmap v341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:00.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:00 gibba020 bash[25448]: cluster 2021-03-10T14:03:58.787250+0000 mgr.gibba020.yqfnwy (mgr.34427) 624 : cluster [DBG] pgmap v341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:02.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:02 gibba013 bash[29418]: cluster 2021-03-10T14:04:00.788967+0000 mgr.gibba020.yqfnwy (mgr.34427) 625 : cluster [DBG] pgmap v342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:02.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:02 gibba013 bash[30381]: cluster 2021-03-10T14:04:00.788967+0000 mgr.gibba020.yqfnwy (mgr.34427) 625 : cluster [DBG] pgmap v342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:02.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:02 gibba020 bash[25448]: cluster 2021-03-10T14:04:00.788967+0000 mgr.gibba020.yqfnwy (mgr.34427) 625 : cluster [DBG] pgmap v342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:03.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:03 gibba020 bash[25448]: cluster 2021-03-10T14:04:02.790541+0000 mgr.gibba020.yqfnwy (mgr.34427) 626 : cluster [DBG] pgmap v343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:03.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:03 gibba013 bash[29418]: cluster 2021-03-10T14:04:02.790541+0000 mgr.gibba020.yqfnwy (mgr.34427) 626 : cluster [DBG] pgmap v343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:03.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:03 gibba013 bash[30381]: cluster 2021-03-10T14:04:02.790541+0000 mgr.gibba020.yqfnwy (mgr.34427) 626 : cluster [DBG] pgmap v343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:04.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:04 gibba020 bash[25448]: cephadm 2021-03-10T14:04:04.068802+0000 mgr.gibba020.yqfnwy (mgr.34427) 627 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:04:04.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:04 gibba013 bash[29418]: cephadm 2021-03-10T14:04:04.068802+0000 mgr.gibba020.yqfnwy (mgr.34427) 627 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:04:04.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:04 gibba013 bash[30381]: cephadm 2021-03-10T14:04:04.068802+0000 mgr.gibba020.yqfnwy (mgr.34427) 627 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:04:06.337 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:04:06.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:05 gibba013 bash[29418]: cluster 2021-03-10T14:04:04.792083+0000 mgr.gibba020.yqfnwy (mgr.34427) 628 : cluster [DBG] pgmap v344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:06.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:05 gibba013 bash[29418]: audit 2021-03-10T14:04:05.813859+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T14:04:06.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:05 gibba013 bash[29418]: audit 2021-03-10T14:04:05.814613+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:04:06.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:05 gibba013 bash[29418]: audit 2021-03-10T14:04:05.815282+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:04:06.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:05 gibba013 bash[29418]: audit 2021-03-10T14:04:05.815986+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:04:06.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:05 gibba013 bash[29418]: audit 2021-03-10T14:04:05.967420+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:04:06.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:05 gibba013 bash[29418]: audit 2021-03-10T14:04:05.969364+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:04:06.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:05 gibba013 bash[30381]: cluster 2021-03-10T14:04:04.792083+0000 mgr.gibba020.yqfnwy (mgr.34427) 628 : cluster [DBG] pgmap v344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:06.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:05 gibba013 bash[30381]: audit 2021-03-10T14:04:05.813859+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T14:04:06.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:05 gibba013 bash[30381]: audit 2021-03-10T14:04:05.814613+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:04:06.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:05 gibba013 bash[30381]: audit 2021-03-10T14:04:05.815282+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:04:06.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:05 gibba013 bash[30381]: audit 2021-03-10T14:04:05.815986+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:04:06.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:05 gibba013 bash[30381]: audit 2021-03-10T14:04:05.967420+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:04:06.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:05 gibba013 bash[30381]: audit 2021-03-10T14:04:05.969364+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:04:06.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:05 gibba020 bash[25448]: cluster 2021-03-10T14:04:04.792083+0000 mgr.gibba020.yqfnwy (mgr.34427) 628 : cluster [DBG] pgmap v344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:06.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:05 gibba020 bash[25448]: audit 2021-03-10T14:04:05.813859+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T14:04:06.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:05 gibba020 bash[25448]: audit 2021-03-10T14:04:05.814613+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:04:06.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:05 gibba020 bash[25448]: audit 2021-03-10T14:04:05.815282+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:04:06.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:05 gibba020 bash[25448]: audit 2021-03-10T14:04:05.815986+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:04:06.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:05 gibba020 bash[25448]: audit 2021-03-10T14:04:05.967420+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:04:06.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:05 gibba020 bash[25448]: audit 2021-03-10T14:04:05.969364+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:04:06.564 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:04:06.564 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (10m) 7m ago 15m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:04:06.565 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (15m) 5m ago 15m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:04:06.565 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (11m) 5m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:04:06.565 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (11m) 5m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:04:06.565 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (10m) 7m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:04:06.566 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (10m) 7m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:04:06.566 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (9m) 5m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:04:06.566 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (9m) 7m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:04:06.566 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (16m) 7m ago 16m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:04:06.567 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (16m) 5m ago 16m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:04:06.567 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (8m) 7m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:04:06.567 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (8m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:04:06.567 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (8m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:04:06.568 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (7m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:04:06.568 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (7m) 5m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:04:06.568 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (6m) 5m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:04:06.568 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (6m) 5m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:04:06.569 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (5m) 5m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:04:06.569 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (15m) 5m ago 16m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:04:06.569 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 5m ago 14m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:04:06.823 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:04:06.823 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:04:06.823 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:04:06.823 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:04:06.824 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:04:06.824 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:04:06.824 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:04:06.824 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:04:06.825 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:04:06.825 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:04:06.825 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:04:06.825 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:04:06.826 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:04:06.826 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:04:06.826 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:04:07.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:06 gibba013 bash[29418]: audit 2021-03-10T14:04:06.325113+0000 mgr.gibba020.yqfnwy (mgr.34427) 629 : audit [DBG] from='client.54469 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:04:07.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:06 gibba013 bash[29418]: audit 2021-03-10T14:04:06.822782+0000 mon.c (mon.1) 22 : audit [DBG] from='client.? 172.21.2.113:0/3581249043' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:07.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:06 gibba013 bash[30381]: audit 2021-03-10T14:04:06.325113+0000 mgr.gibba020.yqfnwy (mgr.34427) 629 : audit [DBG] from='client.54469 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:04:07.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:06 gibba013 bash[30381]: audit 2021-03-10T14:04:06.822782+0000 mon.c (mon.1) 22 : audit [DBG] from='client.? 172.21.2.113:0/3581249043' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:06 gibba020 bash[25448]: audit 2021-03-10T14:04:06.325113+0000 mgr.gibba020.yqfnwy (mgr.34427) 629 : audit [DBG] from='client.54469 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:04:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:06 gibba020 bash[25448]: audit 2021-03-10T14:04:06.822782+0000 mon.c (mon.1) 22 : audit [DBG] from='client.? 172.21.2.113:0/3581249043' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:08.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:08 gibba013 bash[29418]: audit 2021-03-10T14:04:06.548785+0000 mgr.gibba020.yqfnwy (mgr.34427) 630 : audit [DBG] from='client.54475 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:04:08.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:08 gibba013 bash[29418]: cluster 2021-03-10T14:04:06.793732+0000 mgr.gibba020.yqfnwy (mgr.34427) 631 : cluster [DBG] pgmap v345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:08.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:08 gibba013 bash[30381]: audit 2021-03-10T14:04:06.548785+0000 mgr.gibba020.yqfnwy (mgr.34427) 630 : audit [DBG] from='client.54475 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:04:08.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:08 gibba013 bash[30381]: cluster 2021-03-10T14:04:06.793732+0000 mgr.gibba020.yqfnwy (mgr.34427) 631 : cluster [DBG] pgmap v345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:08.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:08 gibba020 bash[25448]: audit 2021-03-10T14:04:06.548785+0000 mgr.gibba020.yqfnwy (mgr.34427) 630 : audit [DBG] from='client.54475 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:04:08.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:08 gibba020 bash[25448]: cluster 2021-03-10T14:04:06.793732+0000 mgr.gibba020.yqfnwy (mgr.34427) 631 : cluster [DBG] pgmap v345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:10.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:10 gibba013 bash[29418]: cluster 2021-03-10T14:04:08.795222+0000 mgr.gibba020.yqfnwy (mgr.34427) 632 : cluster [DBG] pgmap v346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:10.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:10 gibba013 bash[30381]: cluster 2021-03-10T14:04:08.795222+0000 mgr.gibba020.yqfnwy (mgr.34427) 632 : cluster [DBG] pgmap v346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:10.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:10 gibba020 bash[25448]: cluster 2021-03-10T14:04:08.795222+0000 mgr.gibba020.yqfnwy (mgr.34427) 632 : cluster [DBG] pgmap v346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:12.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:12 gibba013 bash[29418]: cluster 2021-03-10T14:04:10.796930+0000 mgr.gibba020.yqfnwy (mgr.34427) 633 : cluster [DBG] pgmap v347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:12.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:12 gibba013 bash[30381]: cluster 2021-03-10T14:04:10.796930+0000 mgr.gibba020.yqfnwy (mgr.34427) 633 : cluster [DBG] pgmap v347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:12.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:12 gibba020 bash[25448]: cluster 2021-03-10T14:04:10.796930+0000 mgr.gibba020.yqfnwy (mgr.34427) 633 : cluster [DBG] pgmap v347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:14.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:14 gibba013 bash[29418]: cluster 2021-03-10T14:04:12.798404+0000 mgr.gibba020.yqfnwy (mgr.34427) 634 : cluster [DBG] pgmap v348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:14.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:14 gibba013 bash[30381]: cluster 2021-03-10T14:04:12.798404+0000 mgr.gibba020.yqfnwy (mgr.34427) 634 : cluster [DBG] pgmap v348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:14.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:14 gibba020 bash[25448]: cluster 2021-03-10T14:04:12.798404+0000 mgr.gibba020.yqfnwy (mgr.34427) 634 : cluster [DBG] pgmap v348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:16.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:16 gibba013 bash[29418]: cluster 2021-03-10T14:04:14.800058+0000 mgr.gibba020.yqfnwy (mgr.34427) 635 : cluster [DBG] pgmap v349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:16.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:16 gibba013 bash[30381]: cluster 2021-03-10T14:04:14.800058+0000 mgr.gibba020.yqfnwy (mgr.34427) 635 : cluster [DBG] pgmap v349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:16.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:16 gibba020 bash[25448]: cluster 2021-03-10T14:04:14.800058+0000 mgr.gibba020.yqfnwy (mgr.34427) 635 : cluster [DBG] pgmap v349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:18.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:18 gibba013 bash[29418]: cluster 2021-03-10T14:04:16.801328+0000 mgr.gibba020.yqfnwy (mgr.34427) 636 : cluster [DBG] pgmap v350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:18.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:18 gibba013 bash[30381]: cluster 2021-03-10T14:04:16.801328+0000 mgr.gibba020.yqfnwy (mgr.34427) 636 : cluster [DBG] pgmap v350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:18.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:18 gibba020 bash[25448]: cluster 2021-03-10T14:04:16.801328+0000 mgr.gibba020.yqfnwy (mgr.34427) 636 : cluster [DBG] pgmap v350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:20.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:20 gibba013 bash[29418]: cluster 2021-03-10T14:04:18.802684+0000 mgr.gibba020.yqfnwy (mgr.34427) 637 : cluster [DBG] pgmap v351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:20.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:20 gibba013 bash[29418]: audit 2021-03-10T14:04:19.087847+0000 mon.a (mon.0) 737 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:04:20.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:20 gibba013 bash[29418]: cephadm 2021-03-10T14:04:19.272718+0000 mgr.gibba020.yqfnwy (mgr.34427) 638 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:04:20.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:20 gibba013 bash[29418]: audit 2021-03-10T14:04:19.274992+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:04:20.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:20 gibba013 bash[29418]: cephadm 2021-03-10T14:04:19.279887+0000 mgr.gibba020.yqfnwy (mgr.34427) 639 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:04:20.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:20 gibba013 bash[29418]: audit 2021-03-10T14:04:19.282287+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:04:20.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:20 gibba013 bash[29418]: audit 2021-03-10T14:04:19.484456+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:04:20.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:20 gibba013 bash[29418]: audit 2021-03-10T14:04:19.487985+0000 mon.a (mon.0) 741 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:04:20.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:20 gibba013 bash[29418]: audit 2021-03-10T14:04:19.489716+0000 mon.a (mon.0) 742 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:20.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:20 gibba013 bash[29418]: audit 2021-03-10T14:04:19.491319+0000 mon.a (mon.0) 743 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:20.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:20 gibba013 bash[29418]: audit 2021-03-10T14:04:19.492808+0000 mon.a (mon.0) 744 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:20.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:20 gibba013 bash[29418]: audit 2021-03-10T14:04:19.496230+0000 mon.a (mon.0) 745 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:20.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:20 gibba013 bash[29418]: audit 2021-03-10T14:04:19.497976+0000 mon.a (mon.0) 746 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:20.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:20 gibba013 bash[30381]: cluster 2021-03-10T14:04:18.802684+0000 mgr.gibba020.yqfnwy (mgr.34427) 637 : cluster [DBG] pgmap v351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:20.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:20 gibba013 bash[30381]: audit 2021-03-10T14:04:19.087847+0000 mon.a (mon.0) 737 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:04:20.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:20 gibba013 bash[30381]: cephadm 2021-03-10T14:04:19.272718+0000 mgr.gibba020.yqfnwy (mgr.34427) 638 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:04:20.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:20 gibba013 bash[30381]: audit 2021-03-10T14:04:19.274992+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:04:20.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:20 gibba013 bash[30381]: cephadm 2021-03-10T14:04:19.279887+0000 mgr.gibba020.yqfnwy (mgr.34427) 639 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:04:20.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:20 gibba013 bash[30381]: audit 2021-03-10T14:04:19.282287+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:04:20.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:20 gibba013 bash[30381]: audit 2021-03-10T14:04:19.484456+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:04:20.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:20 gibba013 bash[30381]: audit 2021-03-10T14:04:19.487985+0000 mon.a (mon.0) 741 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:04:20.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:20 gibba013 bash[30381]: audit 2021-03-10T14:04:19.489716+0000 mon.a (mon.0) 742 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:20.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:20 gibba013 bash[30381]: audit 2021-03-10T14:04:19.491319+0000 mon.a (mon.0) 743 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:20.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:20 gibba013 bash[30381]: audit 2021-03-10T14:04:19.492808+0000 mon.a (mon.0) 744 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:20.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:20 gibba013 bash[30381]: audit 2021-03-10T14:04:19.496230+0000 mon.a (mon.0) 745 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:20.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:20 gibba013 bash[30381]: audit 2021-03-10T14:04:19.497976+0000 mon.a (mon.0) 746 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:20.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:20 gibba020 bash[25448]: cluster 2021-03-10T14:04:18.802684+0000 mgr.gibba020.yqfnwy (mgr.34427) 637 : cluster [DBG] pgmap v351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:20.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:20 gibba020 bash[25448]: audit 2021-03-10T14:04:19.087847+0000 mon.a (mon.0) 737 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:04:20.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:20 gibba020 bash[25448]: cephadm 2021-03-10T14:04:19.272718+0000 mgr.gibba020.yqfnwy (mgr.34427) 638 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:04:20.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:20 gibba020 bash[25448]: audit 2021-03-10T14:04:19.274992+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:04:20.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:20 gibba020 bash[25448]: cephadm 2021-03-10T14:04:19.279887+0000 mgr.gibba020.yqfnwy (mgr.34427) 639 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:04:20.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:20 gibba020 bash[25448]: audit 2021-03-10T14:04:19.282287+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:04:20.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:20 gibba020 bash[25448]: audit 2021-03-10T14:04:19.484456+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:04:20.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:20 gibba020 bash[25448]: audit 2021-03-10T14:04:19.487985+0000 mon.a (mon.0) 741 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:04:20.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:20 gibba020 bash[25448]: audit 2021-03-10T14:04:19.489716+0000 mon.a (mon.0) 742 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:20.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:20 gibba020 bash[25448]: audit 2021-03-10T14:04:19.491319+0000 mon.a (mon.0) 743 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:20.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:20 gibba020 bash[25448]: audit 2021-03-10T14:04:19.492808+0000 mon.a (mon.0) 744 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:20.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:20 gibba020 bash[25448]: audit 2021-03-10T14:04:19.496230+0000 mon.a (mon.0) 745 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:20.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:20 gibba020 bash[25448]: audit 2021-03-10T14:04:19.497976+0000 mon.a (mon.0) 746 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:21.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:21 gibba013 bash[29418]: cephadm 2021-03-10T14:04:19.484175+0000 mgr.gibba020.yqfnwy (mgr.34427) 640 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:04:21.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:21 gibba013 bash[29418]: cephadm 2021-03-10T14:04:19.486287+0000 mgr.gibba020.yqfnwy (mgr.34427) 641 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:04:21.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:21 gibba013 bash[29418]: cephadm 2021-03-10T14:04:19.487924+0000 mgr.gibba020.yqfnwy (mgr.34427) 642 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:04:21.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:21 gibba013 bash[29418]: cephadm 2021-03-10T14:04:19.487986+0000 mgr.gibba020.yqfnwy (mgr.34427) 643 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:04:21.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:21 gibba013 bash[29418]: cephadm 2021-03-10T14:04:19.489432+0000 mgr.gibba020.yqfnwy (mgr.34427) 644 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:04:21.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:21 gibba013 bash[29418]: cephadm 2021-03-10T14:04:19.489470+0000 mgr.gibba020.yqfnwy (mgr.34427) 645 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:04:21.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:21 gibba013 bash[29418]: cephadm 2021-03-10T14:04:19.490879+0000 mgr.gibba020.yqfnwy (mgr.34427) 646 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:04:21.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:21 gibba013 bash[29418]: cephadm 2021-03-10T14:04:19.492586+0000 mgr.gibba020.yqfnwy (mgr.34427) 647 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:04:21.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:21 gibba013 bash[29418]: cephadm 2021-03-10T14:04:19.492703+0000 mgr.gibba020.yqfnwy (mgr.34427) 648 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:04:21.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:21 gibba013 bash[29418]: cephadm 2021-03-10T14:04:19.494219+0000 mgr.gibba020.yqfnwy (mgr.34427) 649 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:04:21.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:21 gibba013 bash[29418]: cephadm 2021-03-10T14:04:19.494619+0000 mgr.gibba020.yqfnwy (mgr.34427) 650 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:04:21.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:21 gibba013 bash[29418]: cephadm 2021-03-10T14:04:19.496394+0000 mgr.gibba020.yqfnwy (mgr.34427) 651 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:04:21.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:21 gibba013 bash[29418]: cephadm 2021-03-10T14:04:19.496434+0000 mgr.gibba020.yqfnwy (mgr.34427) 652 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:04:21.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:21 gibba013 bash[29418]: cephadm 2021-03-10T14:04:19.496638+0000 mgr.gibba020.yqfnwy (mgr.34427) 653 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:04:21.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:21 gibba013 bash[30381]: cephadm 2021-03-10T14:04:19.484175+0000 mgr.gibba020.yqfnwy (mgr.34427) 640 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:04:21.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:21 gibba013 bash[30381]: cephadm 2021-03-10T14:04:19.486287+0000 mgr.gibba020.yqfnwy (mgr.34427) 641 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:04:21.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:21 gibba013 bash[30381]: cephadm 2021-03-10T14:04:19.487924+0000 mgr.gibba020.yqfnwy (mgr.34427) 642 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:04:21.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:21 gibba013 bash[30381]: cephadm 2021-03-10T14:04:19.487986+0000 mgr.gibba020.yqfnwy (mgr.34427) 643 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:04:21.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:21 gibba013 bash[30381]: cephadm 2021-03-10T14:04:19.489432+0000 mgr.gibba020.yqfnwy (mgr.34427) 644 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:04:21.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:21 gibba013 bash[30381]: cephadm 2021-03-10T14:04:19.489470+0000 mgr.gibba020.yqfnwy (mgr.34427) 645 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:04:21.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:21 gibba013 bash[30381]: cephadm 2021-03-10T14:04:19.490879+0000 mgr.gibba020.yqfnwy (mgr.34427) 646 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:04:21.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:21 gibba013 bash[30381]: cephadm 2021-03-10T14:04:19.492586+0000 mgr.gibba020.yqfnwy (mgr.34427) 647 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:04:21.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:21 gibba013 bash[30381]: cephadm 2021-03-10T14:04:19.492703+0000 mgr.gibba020.yqfnwy (mgr.34427) 648 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:04:21.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:21 gibba013 bash[30381]: cephadm 2021-03-10T14:04:19.494219+0000 mgr.gibba020.yqfnwy (mgr.34427) 649 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:04:21.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:21 gibba013 bash[30381]: cephadm 2021-03-10T14:04:19.494619+0000 mgr.gibba020.yqfnwy (mgr.34427) 650 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:04:21.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:21 gibba013 bash[30381]: cephadm 2021-03-10T14:04:19.496394+0000 mgr.gibba020.yqfnwy (mgr.34427) 651 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:04:21.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:21 gibba013 bash[30381]: cephadm 2021-03-10T14:04:19.496434+0000 mgr.gibba020.yqfnwy (mgr.34427) 652 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:04:21.391 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:21 gibba013 bash[30381]: cephadm 2021-03-10T14:04:19.496638+0000 mgr.gibba020.yqfnwy (mgr.34427) 653 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:04:21.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:21 gibba020 bash[25448]: cephadm 2021-03-10T14:04:19.484175+0000 mgr.gibba020.yqfnwy (mgr.34427) 640 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:04:21.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:21 gibba020 bash[25448]: cephadm 2021-03-10T14:04:19.486287+0000 mgr.gibba020.yqfnwy (mgr.34427) 641 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:04:21.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:21 gibba020 bash[25448]: cephadm 2021-03-10T14:04:19.487924+0000 mgr.gibba020.yqfnwy (mgr.34427) 642 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:04:21.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:21 gibba020 bash[25448]: cephadm 2021-03-10T14:04:19.487986+0000 mgr.gibba020.yqfnwy (mgr.34427) 643 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:04:21.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:21 gibba020 bash[25448]: cephadm 2021-03-10T14:04:19.489432+0000 mgr.gibba020.yqfnwy (mgr.34427) 644 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:04:21.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:21 gibba020 bash[25448]: cephadm 2021-03-10T14:04:19.489470+0000 mgr.gibba020.yqfnwy (mgr.34427) 645 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:04:21.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:21 gibba020 bash[25448]: cephadm 2021-03-10T14:04:19.490879+0000 mgr.gibba020.yqfnwy (mgr.34427) 646 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:04:21.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:21 gibba020 bash[25448]: cephadm 2021-03-10T14:04:19.492586+0000 mgr.gibba020.yqfnwy (mgr.34427) 647 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:04:21.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:21 gibba020 bash[25448]: cephadm 2021-03-10T14:04:19.492703+0000 mgr.gibba020.yqfnwy (mgr.34427) 648 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:04:21.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:21 gibba020 bash[25448]: cephadm 2021-03-10T14:04:19.494219+0000 mgr.gibba020.yqfnwy (mgr.34427) 649 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:04:21.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:21 gibba020 bash[25448]: cephadm 2021-03-10T14:04:19.494619+0000 mgr.gibba020.yqfnwy (mgr.34427) 650 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:04:21.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:21 gibba020 bash[25448]: cephadm 2021-03-10T14:04:19.496394+0000 mgr.gibba020.yqfnwy (mgr.34427) 651 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:04:21.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:21 gibba020 bash[25448]: cephadm 2021-03-10T14:04:19.496434+0000 mgr.gibba020.yqfnwy (mgr.34427) 652 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:04:21.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:21 gibba020 bash[25448]: cephadm 2021-03-10T14:04:19.496638+0000 mgr.gibba020.yqfnwy (mgr.34427) 653 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:04:22.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:22 gibba013 bash[29418]: cluster 2021-03-10T14:04:20.804184+0000 mgr.gibba020.yqfnwy (mgr.34427) 654 : cluster [DBG] pgmap v352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:22.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:22 gibba013 bash[30381]: cluster 2021-03-10T14:04:20.804184+0000 mgr.gibba020.yqfnwy (mgr.34427) 654 : cluster [DBG] pgmap v352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:22.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:22 gibba020 bash[25448]: cluster 2021-03-10T14:04:20.804184+0000 mgr.gibba020.yqfnwy (mgr.34427) 654 : cluster [DBG] pgmap v352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:24.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:24 gibba013 bash[29418]: cluster 2021-03-10T14:04:22.805508+0000 mgr.gibba020.yqfnwy (mgr.34427) 655 : cluster [DBG] pgmap v353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:24.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:24 gibba013 bash[30381]: cluster 2021-03-10T14:04:22.805508+0000 mgr.gibba020.yqfnwy (mgr.34427) 655 : cluster [DBG] pgmap v353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:24.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:24 gibba020 bash[25448]: cluster 2021-03-10T14:04:22.805508+0000 mgr.gibba020.yqfnwy (mgr.34427) 655 : cluster [DBG] pgmap v353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:26.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:26 gibba013 bash[29418]: cluster 2021-03-10T14:04:24.807176+0000 mgr.gibba020.yqfnwy (mgr.34427) 656 : cluster [DBG] pgmap v354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:26.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:26 gibba013 bash[30381]: cluster 2021-03-10T14:04:24.807176+0000 mgr.gibba020.yqfnwy (mgr.34427) 656 : cluster [DBG] pgmap v354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:26.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:26 gibba020 bash[25448]: cluster 2021-03-10T14:04:24.807176+0000 mgr.gibba020.yqfnwy (mgr.34427) 656 : cluster [DBG] pgmap v354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:28.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:28 gibba013 bash[29418]: cluster 2021-03-10T14:04:26.808538+0000 mgr.gibba020.yqfnwy (mgr.34427) 657 : cluster [DBG] pgmap v355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:28.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:28 gibba013 bash[30381]: cluster 2021-03-10T14:04:26.808538+0000 mgr.gibba020.yqfnwy (mgr.34427) 657 : cluster [DBG] pgmap v355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:28.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:28 gibba020 bash[25448]: cluster 2021-03-10T14:04:26.808538+0000 mgr.gibba020.yqfnwy (mgr.34427) 657 : cluster [DBG] pgmap v355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:30.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:30 gibba013 bash[29418]: cluster 2021-03-10T14:04:28.809841+0000 mgr.gibba020.yqfnwy (mgr.34427) 658 : cluster [DBG] pgmap v356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:30.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:30 gibba013 bash[30381]: cluster 2021-03-10T14:04:28.809841+0000 mgr.gibba020.yqfnwy (mgr.34427) 658 : cluster [DBG] pgmap v356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:30.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:30 gibba020 bash[25448]: cluster 2021-03-10T14:04:28.809841+0000 mgr.gibba020.yqfnwy (mgr.34427) 658 : cluster [DBG] pgmap v356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:32.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:32 gibba013 bash[29418]: cluster 2021-03-10T14:04:30.811490+0000 mgr.gibba020.yqfnwy (mgr.34427) 659 : cluster [DBG] pgmap v357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:32.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:32 gibba013 bash[30381]: cluster 2021-03-10T14:04:30.811490+0000 mgr.gibba020.yqfnwy (mgr.34427) 659 : cluster [DBG] pgmap v357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:32.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:32 gibba020 bash[25448]: cluster 2021-03-10T14:04:30.811490+0000 mgr.gibba020.yqfnwy (mgr.34427) 659 : cluster [DBG] pgmap v357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:34.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:34 gibba013 bash[29418]: cluster 2021-03-10T14:04:32.813067+0000 mgr.gibba020.yqfnwy (mgr.34427) 660 : cluster [DBG] pgmap v358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:34.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:34 gibba013 bash[30381]: cluster 2021-03-10T14:04:32.813067+0000 mgr.gibba020.yqfnwy (mgr.34427) 660 : cluster [DBG] pgmap v358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:34.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:34 gibba020 bash[25448]: cluster 2021-03-10T14:04:32.813067+0000 mgr.gibba020.yqfnwy (mgr.34427) 660 : cluster [DBG] pgmap v358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:36.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:36 gibba013 bash[29418]: cephadm 2021-03-10T14:04:34.512555+0000 mgr.gibba020.yqfnwy (mgr.34427) 661 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:04:36.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:36 gibba013 bash[29418]: cluster 2021-03-10T14:04:34.814787+0000 mgr.gibba020.yqfnwy (mgr.34427) 662 : cluster [DBG] pgmap v359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:36.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:36 gibba013 bash[30381]: cephadm 2021-03-10T14:04:34.512555+0000 mgr.gibba020.yqfnwy (mgr.34427) 661 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:04:36.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:36 gibba013 bash[30381]: cluster 2021-03-10T14:04:34.814787+0000 mgr.gibba020.yqfnwy (mgr.34427) 662 : cluster [DBG] pgmap v359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:36.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:36 gibba020 bash[25448]: cephadm 2021-03-10T14:04:34.512555+0000 mgr.gibba020.yqfnwy (mgr.34427) 661 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:04:36.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:36 gibba020 bash[25448]: cluster 2021-03-10T14:04:34.814787+0000 mgr.gibba020.yqfnwy (mgr.34427) 662 : cluster [DBG] pgmap v359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:37.069 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:04:37.300 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:04:37.301 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (11m) 8m ago 16m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:04:37.301 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (16m) 6m ago 16m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:04:37.301 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (11m) 6m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:04:37.302 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (11m) 6m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:04:37.302 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (10m) 8m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:04:37.302 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (10m) 8m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:04:37.302 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (10m) 6m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:04:37.303 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (10m) 8m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:04:37.303 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (16m) 8m ago 16m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:04:37.303 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (16m) 6m ago 16m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:04:37.303 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (9m) 8m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:04:37.303 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (8m) 8m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:04:37.304 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (8m) 8m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:04:37.304 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (8m) 8m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:04:37.304 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (7m) 6m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:04:37.304 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (7m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:04:37.305 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (6m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:04:37.305 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (6m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:04:37.305 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (16m) 6m ago 16m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:04:37.305 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 6m ago 14m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:04:37.550 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:04:37.550 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:04:37.550 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:04:37.550 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:04:37.551 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:04:37.551 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:04:37.551 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:04:37.551 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:04:37.551 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:04:37.552 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:04:37.552 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:04:37.552 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:04:37.552 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:04:37.552 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:04:37.553 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:04:38.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:38 gibba020 bash[25448]: cluster 2021-03-10T14:04:36.816043+0000 mgr.gibba020.yqfnwy (mgr.34427) 663 : cluster [DBG] pgmap v360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:38.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:38 gibba020 bash[25448]: audit 2021-03-10T14:04:37.056421+0000 mgr.gibba020.yqfnwy (mgr.34427) 664 : audit [DBG] from='client.44502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:04:38.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:38 gibba020 bash[25448]: audit 2021-03-10T14:04:37.285166+0000 mgr.gibba020.yqfnwy (mgr.34427) 665 : audit [DBG] from='client.54493 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:04:38.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:38 gibba020 bash[25448]: audit 2021-03-10T14:04:37.549653+0000 mon.a (mon.0) 747 : audit [DBG] from='client.? 172.21.2.113:0/2333452618' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:38.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:38 gibba013 bash[29418]: cluster 2021-03-10T14:04:36.816043+0000 mgr.gibba020.yqfnwy (mgr.34427) 663 : cluster [DBG] pgmap v360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:38.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:38 gibba013 bash[29418]: audit 2021-03-10T14:04:37.056421+0000 mgr.gibba020.yqfnwy (mgr.34427) 664 : audit [DBG] from='client.44502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:04:38.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:38 gibba013 bash[29418]: audit 2021-03-10T14:04:37.285166+0000 mgr.gibba020.yqfnwy (mgr.34427) 665 : audit [DBG] from='client.54493 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:04:38.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:38 gibba013 bash[29418]: audit 2021-03-10T14:04:37.549653+0000 mon.a (mon.0) 747 : audit [DBG] from='client.? 172.21.2.113:0/2333452618' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:38.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:38 gibba013 bash[30381]: cluster 2021-03-10T14:04:36.816043+0000 mgr.gibba020.yqfnwy (mgr.34427) 663 : cluster [DBG] pgmap v360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:38.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:38 gibba013 bash[30381]: audit 2021-03-10T14:04:37.056421+0000 mgr.gibba020.yqfnwy (mgr.34427) 664 : audit [DBG] from='client.44502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:04:38.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:38 gibba013 bash[30381]: audit 2021-03-10T14:04:37.285166+0000 mgr.gibba020.yqfnwy (mgr.34427) 665 : audit [DBG] from='client.54493 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:04:38.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:38 gibba013 bash[30381]: audit 2021-03-10T14:04:37.549653+0000 mon.a (mon.0) 747 : audit [DBG] from='client.? 172.21.2.113:0/2333452618' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:04:40.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:40 gibba020 bash[25448]: cluster 2021-03-10T14:04:38.817319+0000 mgr.gibba020.yqfnwy (mgr.34427) 666 : cluster [DBG] pgmap v361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:40.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:40 gibba013 bash[29418]: cluster 2021-03-10T14:04:38.817319+0000 mgr.gibba020.yqfnwy (mgr.34427) 666 : cluster [DBG] pgmap v361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:40.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:40 gibba013 bash[30381]: cluster 2021-03-10T14:04:38.817319+0000 mgr.gibba020.yqfnwy (mgr.34427) 666 : cluster [DBG] pgmap v361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:42.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:42 gibba020 bash[25448]: cluster 2021-03-10T14:04:40.819060+0000 mgr.gibba020.yqfnwy (mgr.34427) 667 : cluster [DBG] pgmap v362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:42.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:42 gibba013 bash[29418]: cluster 2021-03-10T14:04:40.819060+0000 mgr.gibba020.yqfnwy (mgr.34427) 667 : cluster [DBG] pgmap v362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:42.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:42 gibba013 bash[30381]: cluster 2021-03-10T14:04:40.819060+0000 mgr.gibba020.yqfnwy (mgr.34427) 667 : cluster [DBG] pgmap v362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:44.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:44 gibba020 bash[25448]: cluster 2021-03-10T14:04:42.820651+0000 mgr.gibba020.yqfnwy (mgr.34427) 668 : cluster [DBG] pgmap v363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:44.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:44 gibba013 bash[29418]: cluster 2021-03-10T14:04:42.820651+0000 mgr.gibba020.yqfnwy (mgr.34427) 668 : cluster [DBG] pgmap v363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:44.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:44 gibba013 bash[30381]: cluster 2021-03-10T14:04:42.820651+0000 mgr.gibba020.yqfnwy (mgr.34427) 668 : cluster [DBG] pgmap v363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:46.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:46 gibba020 bash[25448]: cluster 2021-03-10T14:04:44.822424+0000 mgr.gibba020.yqfnwy (mgr.34427) 669 : cluster [DBG] pgmap v364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:46.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:46 gibba013 bash[29418]: cluster 2021-03-10T14:04:44.822424+0000 mgr.gibba020.yqfnwy (mgr.34427) 669 : cluster [DBG] pgmap v364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:46.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:46 gibba013 bash[30381]: cluster 2021-03-10T14:04:44.822424+0000 mgr.gibba020.yqfnwy (mgr.34427) 669 : cluster [DBG] pgmap v364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:48.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:48 gibba020 bash[25448]: cluster 2021-03-10T14:04:46.823754+0000 mgr.gibba020.yqfnwy (mgr.34427) 670 : cluster [DBG] pgmap v365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:48.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:48 gibba013 bash[29418]: cluster 2021-03-10T14:04:46.823754+0000 mgr.gibba020.yqfnwy (mgr.34427) 670 : cluster [DBG] pgmap v365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:48.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:48 gibba013 bash[30381]: cluster 2021-03-10T14:04:46.823754+0000 mgr.gibba020.yqfnwy (mgr.34427) 670 : cluster [DBG] pgmap v365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:50.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:50 gibba020 bash[25448]: cluster 2021-03-10T14:04:48.825364+0000 mgr.gibba020.yqfnwy (mgr.34427) 671 : cluster [DBG] pgmap v366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:50.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:50 gibba013 bash[29418]: cluster 2021-03-10T14:04:48.825364+0000 mgr.gibba020.yqfnwy (mgr.34427) 671 : cluster [DBG] pgmap v366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:50.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:50 gibba013 bash[30381]: cluster 2021-03-10T14:04:48.825364+0000 mgr.gibba020.yqfnwy (mgr.34427) 671 : cluster [DBG] pgmap v366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:51.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:51 gibba020 bash[25448]: cephadm 2021-03-10T14:04:49.524979+0000 mgr.gibba020.yqfnwy (mgr.34427) 672 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:04:51.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:51 gibba013 bash[29418]: cephadm 2021-03-10T14:04:49.524979+0000 mgr.gibba020.yqfnwy (mgr.34427) 672 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:04:51.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:51 gibba013 bash[30381]: cephadm 2021-03-10T14:04:49.524979+0000 mgr.gibba020.yqfnwy (mgr.34427) 672 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:04:52.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:52 gibba013 bash[29418]: cluster 2021-03-10T14:04:50.827041+0000 mgr.gibba020.yqfnwy (mgr.34427) 673 : cluster [DBG] pgmap v367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:52.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:52 gibba013 bash[30381]: cluster 2021-03-10T14:04:50.827041+0000 mgr.gibba020.yqfnwy (mgr.34427) 673 : cluster [DBG] pgmap v367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:52.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:52 gibba020 bash[25448]: cluster 2021-03-10T14:04:50.827041+0000 mgr.gibba020.yqfnwy (mgr.34427) 673 : cluster [DBG] pgmap v367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:54.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:54 gibba013 bash[29418]: cluster 2021-03-10T14:04:52.828480+0000 mgr.gibba020.yqfnwy (mgr.34427) 674 : cluster [DBG] pgmap v368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:54.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:54 gibba013 bash[30381]: cluster 2021-03-10T14:04:52.828480+0000 mgr.gibba020.yqfnwy (mgr.34427) 674 : cluster [DBG] pgmap v368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:54.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:54 gibba020 bash[25448]: cluster 2021-03-10T14:04:52.828480+0000 mgr.gibba020.yqfnwy (mgr.34427) 674 : cluster [DBG] pgmap v368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:56.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:56 gibba013 bash[29418]: cluster 2021-03-10T14:04:54.829942+0000 mgr.gibba020.yqfnwy (mgr.34427) 675 : cluster [DBG] pgmap v369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:56.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:56 gibba013 bash[30381]: cluster 2021-03-10T14:04:54.829942+0000 mgr.gibba020.yqfnwy (mgr.34427) 675 : cluster [DBG] pgmap v369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:56.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:56 gibba020 bash[25448]: cluster 2021-03-10T14:04:54.829942+0000 mgr.gibba020.yqfnwy (mgr.34427) 675 : cluster [DBG] pgmap v369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:58.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:04:58 gibba013 bash[29418]: cluster 2021-03-10T14:04:56.831295+0000 mgr.gibba020.yqfnwy (mgr.34427) 676 : cluster [DBG] pgmap v370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:58.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:04:58 gibba013 bash[30381]: cluster 2021-03-10T14:04:56.831295+0000 mgr.gibba020.yqfnwy (mgr.34427) 676 : cluster [DBG] pgmap v370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:04:58.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:04:58 gibba020 bash[25448]: cluster 2021-03-10T14:04:56.831295+0000 mgr.gibba020.yqfnwy (mgr.34427) 676 : cluster [DBG] pgmap v370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:00.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:00 gibba013 bash[29418]: cluster 2021-03-10T14:04:58.832716+0000 mgr.gibba020.yqfnwy (mgr.34427) 677 : cluster [DBG] pgmap v371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:00.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:00 gibba013 bash[30381]: cluster 2021-03-10T14:04:58.832716+0000 mgr.gibba020.yqfnwy (mgr.34427) 677 : cluster [DBG] pgmap v371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:00.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:00 gibba020 bash[25448]: cluster 2021-03-10T14:04:58.832716+0000 mgr.gibba020.yqfnwy (mgr.34427) 677 : cluster [DBG] pgmap v371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:02.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:02 gibba013 bash[29418]: cluster 2021-03-10T14:05:00.834358+0000 mgr.gibba020.yqfnwy (mgr.34427) 678 : cluster [DBG] pgmap v372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:02.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:02 gibba013 bash[30381]: cluster 2021-03-10T14:05:00.834358+0000 mgr.gibba020.yqfnwy (mgr.34427) 678 : cluster [DBG] pgmap v372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:02.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:02 gibba020 bash[25448]: cluster 2021-03-10T14:05:00.834358+0000 mgr.gibba020.yqfnwy (mgr.34427) 678 : cluster [DBG] pgmap v372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:04.544 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:04 gibba020 bash[25448]: cluster 2021-03-10T14:05:02.835904+0000 mgr.gibba020.yqfnwy (mgr.34427) 679 : cluster [DBG] pgmap v373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:04.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:04 gibba013 bash[29418]: cluster 2021-03-10T14:05:02.835904+0000 mgr.gibba020.yqfnwy (mgr.34427) 679 : cluster [DBG] pgmap v373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:04.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:04 gibba013 bash[30381]: cluster 2021-03-10T14:05:02.835904+0000 mgr.gibba020.yqfnwy (mgr.34427) 679 : cluster [DBG] pgmap v373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:06.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:06 gibba013 bash[29418]: cephadm 2021-03-10T14:05:04.540741+0000 mgr.gibba020.yqfnwy (mgr.34427) 680 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:05:06.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:06 gibba013 bash[29418]: cluster 2021-03-10T14:05:04.836476+0000 mgr.gibba020.yqfnwy (mgr.34427) 681 : cluster [DBG] pgmap v374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:06.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:06 gibba013 bash[29418]: audit 2021-03-10T14:05:05.822837+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T14:05:06.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:06 gibba013 bash[29418]: audit 2021-03-10T14:05:05.823609+0000 mon.a (mon.0) 749 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:05:06.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:06 gibba013 bash[29418]: audit 2021-03-10T14:05:05.824242+0000 mon.a (mon.0) 750 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T14:05:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:06 gibba013 bash[29418]: audit 2021-03-10T14:05:05.824854+0000 mon.a (mon.0) 751 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:05:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:06 gibba013 bash[29418]: audit 2021-03-10T14:05:05.977173+0000 mon.a (mon.0) 752 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:05:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:06 gibba013 bash[29418]: audit 2021-03-10T14:05:05.987256+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:05:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:06 gibba013 bash[30381]: cephadm 2021-03-10T14:05:04.540741+0000 mgr.gibba020.yqfnwy (mgr.34427) 680 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:05:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:06 gibba013 bash[30381]: cluster 2021-03-10T14:05:04.836476+0000 mgr.gibba020.yqfnwy (mgr.34427) 681 : cluster [DBG] pgmap v374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:06 gibba013 bash[30381]: audit 2021-03-10T14:05:05.822837+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T14:05:06.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:06 gibba013 bash[30381]: audit 2021-03-10T14:05:05.823609+0000 mon.a (mon.0) 749 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:05:06.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:06 gibba013 bash[30381]: audit 2021-03-10T14:05:05.824242+0000 mon.a (mon.0) 750 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T14:05:06.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:06 gibba013 bash[30381]: audit 2021-03-10T14:05:05.824854+0000 mon.a (mon.0) 751 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:05:06.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:06 gibba013 bash[30381]: audit 2021-03-10T14:05:05.977173+0000 mon.a (mon.0) 752 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:05:06.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:06 gibba013 bash[30381]: audit 2021-03-10T14:05:05.987256+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:05:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:06 gibba020 bash[25448]: cephadm 2021-03-10T14:05:04.540741+0000 mgr.gibba020.yqfnwy (mgr.34427) 680 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:05:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:06 gibba020 bash[25448]: cluster 2021-03-10T14:05:04.836476+0000 mgr.gibba020.yqfnwy (mgr.34427) 681 : cluster [DBG] pgmap v374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:06 gibba020 bash[25448]: audit 2021-03-10T14:05:05.822837+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T14:05:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:06 gibba020 bash[25448]: audit 2021-03-10T14:05:05.823609+0000 mon.a (mon.0) 749 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:05:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:06 gibba020 bash[25448]: audit 2021-03-10T14:05:05.824242+0000 mon.a (mon.0) 750 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T14:05:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:06 gibba020 bash[25448]: audit 2021-03-10T14:05:05.824854+0000 mon.a (mon.0) 751 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:05:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:06 gibba020 bash[25448]: audit 2021-03-10T14:05:05.977173+0000 mon.a (mon.0) 752 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:05:06.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:06 gibba020 bash[25448]: audit 2021-03-10T14:05:05.987256+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:05:07.795 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:05:08.022 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:05:08.022 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (11m) 8m ago 17m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:05:08.022 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (16m) 6m ago 16m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:05:08.023 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (12m) 6m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:05:08.023 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (12m) 6m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:05:08.023 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (11m) 8m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:05:08.023 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (11m) 8m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:05:08.024 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (10m) 6m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:05:08.024 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (10m) 8m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:05:08.024 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (17m) 8m ago 17m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:05:08.024 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (17m) 6m ago 17m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:05:08.025 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (9m) 8m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:05:08.025 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (9m) 8m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:05:08.025 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (9m) 8m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:05:08.025 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (8m) 8m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:05:08.026 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (8m) 6m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:05:08.026 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (7m) 6m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:05:08.026 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (7m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:05:08.026 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (6m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:05:08.027 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (16m) 6m ago 17m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:05:08.027 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 6m ago 15m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:05:08.275 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:05:08.276 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:05:08.276 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:05:08.276 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:05:08.276 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:05:08.277 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:05:08.277 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:05:08.277 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:05:08.277 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:05:08.278 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:05:08.278 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:05:08.278 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:05:08.278 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:05:08.279 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:05:08.279 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:05:08.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:08 gibba013 bash[29418]: cluster 2021-03-10T14:05:06.837733+0000 mgr.gibba020.yqfnwy (mgr.34427) 682 : cluster [DBG] pgmap v375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:08.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:08 gibba013 bash[30381]: cluster 2021-03-10T14:05:06.837733+0000 mgr.gibba020.yqfnwy (mgr.34427) 682 : cluster [DBG] pgmap v375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:08.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:08 gibba020 bash[25448]: cluster 2021-03-10T14:05:06.837733+0000 mgr.gibba020.yqfnwy (mgr.34427) 682 : cluster [DBG] pgmap v375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:09.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:09 gibba013 bash[29418]: audit 2021-03-10T14:05:07.782472+0000 mgr.gibba020.yqfnwy (mgr.34427) 683 : audit [DBG] from='client.54505 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:05:09.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:09 gibba013 bash[29418]: audit 2021-03-10T14:05:08.006250+0000 mgr.gibba020.yqfnwy (mgr.34427) 684 : audit [DBG] from='client.44526 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:05:09.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:09 gibba013 bash[29418]: audit 2021-03-10T14:05:08.275073+0000 mon.a (mon.0) 754 : audit [DBG] from='client.? 172.21.2.113:0/1272088942' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:09.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:09 gibba013 bash[30381]: audit 2021-03-10T14:05:07.782472+0000 mgr.gibba020.yqfnwy (mgr.34427) 683 : audit [DBG] from='client.54505 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:05:09.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:09 gibba013 bash[30381]: audit 2021-03-10T14:05:08.006250+0000 mgr.gibba020.yqfnwy (mgr.34427) 684 : audit [DBG] from='client.44526 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:05:09.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:09 gibba013 bash[30381]: audit 2021-03-10T14:05:08.275073+0000 mon.a (mon.0) 754 : audit [DBG] from='client.? 172.21.2.113:0/1272088942' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:09.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:09 gibba020 bash[25448]: audit 2021-03-10T14:05:07.782472+0000 mgr.gibba020.yqfnwy (mgr.34427) 683 : audit [DBG] from='client.54505 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:05:09.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:09 gibba020 bash[25448]: audit 2021-03-10T14:05:08.006250+0000 mgr.gibba020.yqfnwy (mgr.34427) 684 : audit [DBG] from='client.44526 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:05:09.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:09 gibba020 bash[25448]: audit 2021-03-10T14:05:08.275073+0000 mon.a (mon.0) 754 : audit [DBG] from='client.? 172.21.2.113:0/1272088942' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:10.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:10 gibba013 bash[29418]: cluster 2021-03-10T14:05:08.839205+0000 mgr.gibba020.yqfnwy (mgr.34427) 685 : cluster [DBG] pgmap v376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:10.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:10 gibba013 bash[30381]: cluster 2021-03-10T14:05:08.839205+0000 mgr.gibba020.yqfnwy (mgr.34427) 685 : cluster [DBG] pgmap v376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:10.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:10 gibba020 bash[25448]: cluster 2021-03-10T14:05:08.839205+0000 mgr.gibba020.yqfnwy (mgr.34427) 685 : cluster [DBG] pgmap v376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:12.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:12 gibba013 bash[29418]: cluster 2021-03-10T14:05:10.840792+0000 mgr.gibba020.yqfnwy (mgr.34427) 686 : cluster [DBG] pgmap v377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:12.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:12 gibba013 bash[30381]: cluster 2021-03-10T14:05:10.840792+0000 mgr.gibba020.yqfnwy (mgr.34427) 686 : cluster [DBG] pgmap v377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:12.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:12 gibba020 bash[25448]: cluster 2021-03-10T14:05:10.840792+0000 mgr.gibba020.yqfnwy (mgr.34427) 686 : cluster [DBG] pgmap v377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:14.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:14 gibba013 bash[29418]: cluster 2021-03-10T14:05:12.842030+0000 mgr.gibba020.yqfnwy (mgr.34427) 687 : cluster [DBG] pgmap v378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:14.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:14 gibba013 bash[30381]: cluster 2021-03-10T14:05:12.842030+0000 mgr.gibba020.yqfnwy (mgr.34427) 687 : cluster [DBG] pgmap v378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:14.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:14 gibba020 bash[25448]: cluster 2021-03-10T14:05:12.842030+0000 mgr.gibba020.yqfnwy (mgr.34427) 687 : cluster [DBG] pgmap v378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:16.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:16 gibba013 bash[29418]: cluster 2021-03-10T14:05:14.843487+0000 mgr.gibba020.yqfnwy (mgr.34427) 688 : cluster [DBG] pgmap v379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:16.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:16 gibba013 bash[30381]: cluster 2021-03-10T14:05:14.843487+0000 mgr.gibba020.yqfnwy (mgr.34427) 688 : cluster [DBG] pgmap v379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:16.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:16 gibba020 bash[25448]: cluster 2021-03-10T14:05:14.843487+0000 mgr.gibba020.yqfnwy (mgr.34427) 688 : cluster [DBG] pgmap v379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:18.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:18 gibba013 bash[29418]: cluster 2021-03-10T14:05:16.845037+0000 mgr.gibba020.yqfnwy (mgr.34427) 689 : cluster [DBG] pgmap v380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:18.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:18 gibba013 bash[30381]: cluster 2021-03-10T14:05:16.845037+0000 mgr.gibba020.yqfnwy (mgr.34427) 689 : cluster [DBG] pgmap v380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:18.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:18 gibba020 bash[25448]: cluster 2021-03-10T14:05:16.845037+0000 mgr.gibba020.yqfnwy (mgr.34427) 689 : cluster [DBG] pgmap v380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:20.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:20 gibba013 bash[29418]: cluster 2021-03-10T14:05:18.846728+0000 mgr.gibba020.yqfnwy (mgr.34427) 690 : cluster [DBG] pgmap v381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:20.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:20 gibba013 bash[29418]: audit 2021-03-10T14:05:19.560710+0000 mon.a (mon.0) 755 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:05:20.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:20 gibba013 bash[29418]: audit 2021-03-10T14:05:19.796487+0000 mon.a (mon.0) 756 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:05:20.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:20 gibba013 bash[29418]: audit 2021-03-10T14:05:19.800094+0000 mon.a (mon.0) 757 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:05:20.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:20 gibba013 bash[29418]: audit 2021-03-10T14:05:19.802347+0000 mon.a (mon.0) 758 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:20.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:20 gibba013 bash[29418]: audit 2021-03-10T14:05:19.803945+0000 mon.a (mon.0) 759 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:20.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:20 gibba013 bash[29418]: audit 2021-03-10T14:05:19.805397+0000 mon.a (mon.0) 760 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:20.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:20 gibba013 bash[29418]: audit 2021-03-10T14:05:19.808691+0000 mon.a (mon.0) 761 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:20.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:20 gibba013 bash[29418]: audit 2021-03-10T14:05:19.810778+0000 mon.a (mon.0) 762 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:20.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:20 gibba013 bash[30381]: cluster 2021-03-10T14:05:18.846728+0000 mgr.gibba020.yqfnwy (mgr.34427) 690 : cluster [DBG] pgmap v381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:20.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:20 gibba013 bash[30381]: audit 2021-03-10T14:05:19.560710+0000 mon.a (mon.0) 755 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:05:20.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:20 gibba013 bash[30381]: audit 2021-03-10T14:05:19.796487+0000 mon.a (mon.0) 756 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:05:20.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:20 gibba013 bash[30381]: audit 2021-03-10T14:05:19.800094+0000 mon.a (mon.0) 757 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:05:20.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:20 gibba013 bash[30381]: audit 2021-03-10T14:05:19.802347+0000 mon.a (mon.0) 758 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:20.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:20 gibba013 bash[30381]: audit 2021-03-10T14:05:19.803945+0000 mon.a (mon.0) 759 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:20.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:20 gibba013 bash[30381]: audit 2021-03-10T14:05:19.805397+0000 mon.a (mon.0) 760 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:20.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:20 gibba013 bash[30381]: audit 2021-03-10T14:05:19.808691+0000 mon.a (mon.0) 761 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:20.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:20 gibba013 bash[30381]: audit 2021-03-10T14:05:19.810778+0000 mon.a (mon.0) 762 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:20.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:20 gibba020 bash[25448]: cluster 2021-03-10T14:05:18.846728+0000 mgr.gibba020.yqfnwy (mgr.34427) 690 : cluster [DBG] pgmap v381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:20.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:20 gibba020 bash[25448]: audit 2021-03-10T14:05:19.560710+0000 mon.a (mon.0) 755 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:05:20.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:20 gibba020 bash[25448]: audit 2021-03-10T14:05:19.796487+0000 mon.a (mon.0) 756 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:05:20.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:20 gibba020 bash[25448]: audit 2021-03-10T14:05:19.800094+0000 mon.a (mon.0) 757 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:05:20.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:20 gibba020 bash[25448]: audit 2021-03-10T14:05:19.802347+0000 mon.a (mon.0) 758 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:20.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:20 gibba020 bash[25448]: audit 2021-03-10T14:05:19.803945+0000 mon.a (mon.0) 759 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:20.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:20 gibba020 bash[25448]: audit 2021-03-10T14:05:19.805397+0000 mon.a (mon.0) 760 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:20.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:20 gibba020 bash[25448]: audit 2021-03-10T14:05:19.808691+0000 mon.a (mon.0) 761 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:20.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:20 gibba020 bash[25448]: audit 2021-03-10T14:05:19.810778+0000 mon.a (mon.0) 762 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:21.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:21 gibba013 bash[29418]: cephadm 2021-03-10T14:05:19.563380+0000 mgr.gibba020.yqfnwy (mgr.34427) 691 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:05:21.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:21 gibba013 bash[29418]: cephadm 2021-03-10T14:05:19.565304+0000 mgr.gibba020.yqfnwy (mgr.34427) 692 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:05:21.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:21 gibba013 bash[29418]: cephadm 2021-03-10T14:05:19.796430+0000 mgr.gibba020.yqfnwy (mgr.34427) 693 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:05:21.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:21 gibba013 bash[29418]: cephadm 2021-03-10T14:05:19.798767+0000 mgr.gibba020.yqfnwy (mgr.34427) 694 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:05:21.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:21 gibba013 bash[29418]: cephadm 2021-03-10T14:05:19.800467+0000 mgr.gibba020.yqfnwy (mgr.34427) 695 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:05:21.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:21 gibba013 bash[29418]: cephadm 2021-03-10T14:05:19.800514+0000 mgr.gibba020.yqfnwy (mgr.34427) 696 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:05:21.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:21 gibba013 bash[29418]: cephadm 2021-03-10T14:05:19.802003+0000 mgr.gibba020.yqfnwy (mgr.34427) 697 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:05:21.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:21 gibba013 bash[29418]: cephadm 2021-03-10T14:05:19.802047+0000 mgr.gibba020.yqfnwy (mgr.34427) 698 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:05:21.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:21 gibba013 bash[29418]: cephadm 2021-03-10T14:05:19.803582+0000 mgr.gibba020.yqfnwy (mgr.34427) 699 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:05:21.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:21 gibba013 bash[29418]: cephadm 2021-03-10T14:05:19.805115+0000 mgr.gibba020.yqfnwy (mgr.34427) 700 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:05:21.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:21 gibba013 bash[29418]: cephadm 2021-03-10T14:05:19.805165+0000 mgr.gibba020.yqfnwy (mgr.34427) 701 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:05:21.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:21 gibba013 bash[29418]: cephadm 2021-03-10T14:05:19.806854+0000 mgr.gibba020.yqfnwy (mgr.34427) 702 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:05:21.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:21 gibba013 bash[29418]: cephadm 2021-03-10T14:05:19.807379+0000 mgr.gibba020.yqfnwy (mgr.34427) 703 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:05:21.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:21 gibba013 bash[29418]: cephadm 2021-03-10T14:05:19.809897+0000 mgr.gibba020.yqfnwy (mgr.34427) 704 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:05:21.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:21 gibba013 bash[29418]: cephadm 2021-03-10T14:05:19.810199+0000 mgr.gibba020.yqfnwy (mgr.34427) 705 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:05:21.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:21 gibba013 bash[29418]: cephadm 2021-03-10T14:05:19.811191+0000 mgr.gibba020.yqfnwy (mgr.34427) 706 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:05:21.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:21 gibba013 bash[30381]: cephadm 2021-03-10T14:05:19.563380+0000 mgr.gibba020.yqfnwy (mgr.34427) 691 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:05:21.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:21 gibba013 bash[30381]: cephadm 2021-03-10T14:05:19.565304+0000 mgr.gibba020.yqfnwy (mgr.34427) 692 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:05:21.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:21 gibba013 bash[30381]: cephadm 2021-03-10T14:05:19.796430+0000 mgr.gibba020.yqfnwy (mgr.34427) 693 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:05:21.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:21 gibba013 bash[30381]: cephadm 2021-03-10T14:05:19.798767+0000 mgr.gibba020.yqfnwy (mgr.34427) 694 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:05:21.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:21 gibba013 bash[30381]: cephadm 2021-03-10T14:05:19.800467+0000 mgr.gibba020.yqfnwy (mgr.34427) 695 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:05:21.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:21 gibba013 bash[30381]: cephadm 2021-03-10T14:05:19.800514+0000 mgr.gibba020.yqfnwy (mgr.34427) 696 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:05:21.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:21 gibba013 bash[30381]: cephadm 2021-03-10T14:05:19.802003+0000 mgr.gibba020.yqfnwy (mgr.34427) 697 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:05:21.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:21 gibba013 bash[30381]: cephadm 2021-03-10T14:05:19.802047+0000 mgr.gibba020.yqfnwy (mgr.34427) 698 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:05:21.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:21 gibba013 bash[30381]: cephadm 2021-03-10T14:05:19.803582+0000 mgr.gibba020.yqfnwy (mgr.34427) 699 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:05:21.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:21 gibba013 bash[30381]: cephadm 2021-03-10T14:05:19.805115+0000 mgr.gibba020.yqfnwy (mgr.34427) 700 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:05:21.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:21 gibba013 bash[30381]: cephadm 2021-03-10T14:05:19.805165+0000 mgr.gibba020.yqfnwy (mgr.34427) 701 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:05:21.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:21 gibba013 bash[30381]: cephadm 2021-03-10T14:05:19.806854+0000 mgr.gibba020.yqfnwy (mgr.34427) 702 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:05:21.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:21 gibba013 bash[30381]: cephadm 2021-03-10T14:05:19.807379+0000 mgr.gibba020.yqfnwy (mgr.34427) 703 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:05:21.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:21 gibba013 bash[30381]: cephadm 2021-03-10T14:05:19.809897+0000 mgr.gibba020.yqfnwy (mgr.34427) 704 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:05:21.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:21 gibba013 bash[30381]: cephadm 2021-03-10T14:05:19.810199+0000 mgr.gibba020.yqfnwy (mgr.34427) 705 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:05:21.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:21 gibba013 bash[30381]: cephadm 2021-03-10T14:05:19.811191+0000 mgr.gibba020.yqfnwy (mgr.34427) 706 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:05:21.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:21 gibba020 bash[25448]: cephadm 2021-03-10T14:05:19.563380+0000 mgr.gibba020.yqfnwy (mgr.34427) 691 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:05:21.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:21 gibba020 bash[25448]: cephadm 2021-03-10T14:05:19.565304+0000 mgr.gibba020.yqfnwy (mgr.34427) 692 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:05:21.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:21 gibba020 bash[25448]: cephadm 2021-03-10T14:05:19.796430+0000 mgr.gibba020.yqfnwy (mgr.34427) 693 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:05:21.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:21 gibba020 bash[25448]: cephadm 2021-03-10T14:05:19.798767+0000 mgr.gibba020.yqfnwy (mgr.34427) 694 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:05:21.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:21 gibba020 bash[25448]: cephadm 2021-03-10T14:05:19.800467+0000 mgr.gibba020.yqfnwy (mgr.34427) 695 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:05:21.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:21 gibba020 bash[25448]: cephadm 2021-03-10T14:05:19.800514+0000 mgr.gibba020.yqfnwy (mgr.34427) 696 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:05:21.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:21 gibba020 bash[25448]: cephadm 2021-03-10T14:05:19.802003+0000 mgr.gibba020.yqfnwy (mgr.34427) 697 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:05:21.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:21 gibba020 bash[25448]: cephadm 2021-03-10T14:05:19.802047+0000 mgr.gibba020.yqfnwy (mgr.34427) 698 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:05:21.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:21 gibba020 bash[25448]: cephadm 2021-03-10T14:05:19.803582+0000 mgr.gibba020.yqfnwy (mgr.34427) 699 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:05:21.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:21 gibba020 bash[25448]: cephadm 2021-03-10T14:05:19.805115+0000 mgr.gibba020.yqfnwy (mgr.34427) 700 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:05:21.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:21 gibba020 bash[25448]: cephadm 2021-03-10T14:05:19.805165+0000 mgr.gibba020.yqfnwy (mgr.34427) 701 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:05:21.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:21 gibba020 bash[25448]: cephadm 2021-03-10T14:05:19.806854+0000 mgr.gibba020.yqfnwy (mgr.34427) 702 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:05:21.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:21 gibba020 bash[25448]: cephadm 2021-03-10T14:05:19.807379+0000 mgr.gibba020.yqfnwy (mgr.34427) 703 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:05:21.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:21 gibba020 bash[25448]: cephadm 2021-03-10T14:05:19.809897+0000 mgr.gibba020.yqfnwy (mgr.34427) 704 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:05:21.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:21 gibba020 bash[25448]: cephadm 2021-03-10T14:05:19.810199+0000 mgr.gibba020.yqfnwy (mgr.34427) 705 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:05:21.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:21 gibba020 bash[25448]: cephadm 2021-03-10T14:05:19.811191+0000 mgr.gibba020.yqfnwy (mgr.34427) 706 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:05:22.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:22 gibba013 bash[29418]: cluster 2021-03-10T14:05:20.848447+0000 mgr.gibba020.yqfnwy (mgr.34427) 707 : cluster [DBG] pgmap v382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:22.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:22 gibba013 bash[30381]: cluster 2021-03-10T14:05:20.848447+0000 mgr.gibba020.yqfnwy (mgr.34427) 707 : cluster [DBG] pgmap v382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:22.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:22 gibba020 bash[25448]: cluster 2021-03-10T14:05:20.848447+0000 mgr.gibba020.yqfnwy (mgr.34427) 707 : cluster [DBG] pgmap v382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:24.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:24 gibba013 bash[29418]: cluster 2021-03-10T14:05:22.849965+0000 mgr.gibba020.yqfnwy (mgr.34427) 708 : cluster [DBG] pgmap v383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:24.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:24 gibba013 bash[30381]: cluster 2021-03-10T14:05:22.849965+0000 mgr.gibba020.yqfnwy (mgr.34427) 708 : cluster [DBG] pgmap v383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:24.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:24 gibba020 bash[25448]: cluster 2021-03-10T14:05:22.849965+0000 mgr.gibba020.yqfnwy (mgr.34427) 708 : cluster [DBG] pgmap v383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:26.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:26 gibba013 bash[29418]: cluster 2021-03-10T14:05:24.851571+0000 mgr.gibba020.yqfnwy (mgr.34427) 709 : cluster [DBG] pgmap v384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:26.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:26 gibba013 bash[30381]: cluster 2021-03-10T14:05:24.851571+0000 mgr.gibba020.yqfnwy (mgr.34427) 709 : cluster [DBG] pgmap v384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:26.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:26 gibba020 bash[25448]: cluster 2021-03-10T14:05:24.851571+0000 mgr.gibba020.yqfnwy (mgr.34427) 709 : cluster [DBG] pgmap v384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:28.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:28 gibba013 bash[29418]: cluster 2021-03-10T14:05:26.853115+0000 mgr.gibba020.yqfnwy (mgr.34427) 710 : cluster [DBG] pgmap v385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:28.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:28 gibba013 bash[30381]: cluster 2021-03-10T14:05:26.853115+0000 mgr.gibba020.yqfnwy (mgr.34427) 710 : cluster [DBG] pgmap v385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:28.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:28 gibba020 bash[25448]: cluster 2021-03-10T14:05:26.853115+0000 mgr.gibba020.yqfnwy (mgr.34427) 710 : cluster [DBG] pgmap v385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:30.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:30 gibba020 bash[25448]: cluster 2021-03-10T14:05:28.854744+0000 mgr.gibba020.yqfnwy (mgr.34427) 711 : cluster [DBG] pgmap v386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:30.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:30 gibba013 bash[29418]: cluster 2021-03-10T14:05:28.854744+0000 mgr.gibba020.yqfnwy (mgr.34427) 711 : cluster [DBG] pgmap v386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:30.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:30 gibba013 bash[30381]: cluster 2021-03-10T14:05:28.854744+0000 mgr.gibba020.yqfnwy (mgr.34427) 711 : cluster [DBG] pgmap v386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:32.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:32 gibba020 bash[25448]: cluster 2021-03-10T14:05:30.856334+0000 mgr.gibba020.yqfnwy (mgr.34427) 712 : cluster [DBG] pgmap v387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:32.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:32 gibba013 bash[29418]: cluster 2021-03-10T14:05:30.856334+0000 mgr.gibba020.yqfnwy (mgr.34427) 712 : cluster [DBG] pgmap v387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:32.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:32 gibba013 bash[30381]: cluster 2021-03-10T14:05:30.856334+0000 mgr.gibba020.yqfnwy (mgr.34427) 712 : cluster [DBG] pgmap v387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:34.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:34 gibba020 bash[25448]: cluster 2021-03-10T14:05:32.857808+0000 mgr.gibba020.yqfnwy (mgr.34427) 713 : cluster [DBG] pgmap v388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:34.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:34 gibba013 bash[29418]: cluster 2021-03-10T14:05:32.857808+0000 mgr.gibba020.yqfnwy (mgr.34427) 713 : cluster [DBG] pgmap v388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:34.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:34 gibba013 bash[30381]: cluster 2021-03-10T14:05:32.857808+0000 mgr.gibba020.yqfnwy (mgr.34427) 713 : cluster [DBG] pgmap v388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:36.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:36 gibba020 bash[25448]: cephadm 2021-03-10T14:05:34.825044+0000 mgr.gibba020.yqfnwy (mgr.34427) 714 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:05:36.758 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:36 gibba020 bash[25448]: cluster 2021-03-10T14:05:34.859528+0000 mgr.gibba020.yqfnwy (mgr.34427) 715 : cluster [DBG] pgmap v389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:36.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:36 gibba013 bash[29418]: cephadm 2021-03-10T14:05:34.825044+0000 mgr.gibba020.yqfnwy (mgr.34427) 714 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:05:36.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:36 gibba013 bash[29418]: cluster 2021-03-10T14:05:34.859528+0000 mgr.gibba020.yqfnwy (mgr.34427) 715 : cluster [DBG] pgmap v389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:36.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:36 gibba013 bash[30381]: cephadm 2021-03-10T14:05:34.825044+0000 mgr.gibba020.yqfnwy (mgr.34427) 714 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:05:36.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:36 gibba013 bash[30381]: cluster 2021-03-10T14:05:34.859528+0000 mgr.gibba020.yqfnwy (mgr.34427) 715 : cluster [DBG] pgmap v389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:37.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:37 gibba013 bash[29418]: cluster 2021-03-10T14:05:36.861053+0000 mgr.gibba020.yqfnwy (mgr.34427) 716 : cluster [DBG] pgmap v390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:37.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:37 gibba013 bash[30381]: cluster 2021-03-10T14:05:36.861053+0000 mgr.gibba020.yqfnwy (mgr.34427) 716 : cluster [DBG] pgmap v390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:37.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:37 gibba020 bash[25448]: cluster 2021-03-10T14:05:36.861053+0000 mgr.gibba020.yqfnwy (mgr.34427) 716 : cluster [DBG] pgmap v390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:38.521 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:05:38.749 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:05:38.750 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (12m) 9m ago 17m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:05:38.750 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (17m) 7m ago 17m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:05:38.750 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (12m) 7m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:05:38.751 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (12m) 7m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:05:38.751 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (11m) 9m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:05:38.751 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (11m) 9m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:05:38.751 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (11m) 7m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:05:38.752 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (11m) 9m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:05:38.752 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (17m) 9m ago 17m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:05:38.752 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (17m) 7m ago 17m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:05:38.752 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (10m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:05:38.752 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (9m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:05:38.753 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (9m) 9m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:05:38.753 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (9m) 9m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:05:38.753 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (8m) 7m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:05:38.753 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (8m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:05:38.753 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (7m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:05:38.754 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (7m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:05:38.754 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (17m) 7m ago 17m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:05:38.754 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 7m ago 15m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:05:39.003 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:05:39.003 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:05:39.003 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:05:39.004 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:05:39.004 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:05:39.004 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:05:39.004 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:05:39.005 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:05:39.005 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:05:39.005 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:05:39.005 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:05:39.005 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:05:39.006 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:05:39.006 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:05:39.006 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:05:40.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:39 gibba020 bash[25448]: audit 2021-03-10T14:05:38.508394+0000 mgr.gibba020.yqfnwy (mgr.34427) 717 : audit [DBG] from='client.44538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:05:40.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:39 gibba020 bash[25448]: audit 2021-03-10T14:05:38.733700+0000 mgr.gibba020.yqfnwy (mgr.34427) 718 : audit [DBG] from='client.44544 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:05:40.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:39 gibba020 bash[25448]: cluster 2021-03-10T14:05:38.862636+0000 mgr.gibba020.yqfnwy (mgr.34427) 719 : cluster [DBG] pgmap v391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:40.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:39 gibba020 bash[25448]: audit 2021-03-10T14:05:39.002614+0000 mon.c (mon.1) 23 : audit [DBG] from='client.? 172.21.2.113:0/593223737' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:40.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:39 gibba013 bash[29418]: audit 2021-03-10T14:05:38.508394+0000 mgr.gibba020.yqfnwy (mgr.34427) 717 : audit [DBG] from='client.44538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:05:40.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:39 gibba013 bash[29418]: audit 2021-03-10T14:05:38.733700+0000 mgr.gibba020.yqfnwy (mgr.34427) 718 : audit [DBG] from='client.44544 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:05:40.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:39 gibba013 bash[29418]: cluster 2021-03-10T14:05:38.862636+0000 mgr.gibba020.yqfnwy (mgr.34427) 719 : cluster [DBG] pgmap v391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:40.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:39 gibba013 bash[29418]: audit 2021-03-10T14:05:39.002614+0000 mon.c (mon.1) 23 : audit [DBG] from='client.? 172.21.2.113:0/593223737' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:40.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:39 gibba013 bash[30381]: audit 2021-03-10T14:05:38.508394+0000 mgr.gibba020.yqfnwy (mgr.34427) 717 : audit [DBG] from='client.44538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:05:40.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:39 gibba013 bash[30381]: audit 2021-03-10T14:05:38.733700+0000 mgr.gibba020.yqfnwy (mgr.34427) 718 : audit [DBG] from='client.44544 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:05:40.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:39 gibba013 bash[30381]: cluster 2021-03-10T14:05:38.862636+0000 mgr.gibba020.yqfnwy (mgr.34427) 719 : cluster [DBG] pgmap v391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:40.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:39 gibba013 bash[30381]: audit 2021-03-10T14:05:39.002614+0000 mon.c (mon.1) 23 : audit [DBG] from='client.? 172.21.2.113:0/593223737' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:05:42.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:42 gibba013 bash[29418]: cluster 2021-03-10T14:05:40.864246+0000 mgr.gibba020.yqfnwy (mgr.34427) 720 : cluster [DBG] pgmap v392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:42.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:42 gibba013 bash[30381]: cluster 2021-03-10T14:05:40.864246+0000 mgr.gibba020.yqfnwy (mgr.34427) 720 : cluster [DBG] pgmap v392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:42.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:42 gibba020 bash[25448]: cluster 2021-03-10T14:05:40.864246+0000 mgr.gibba020.yqfnwy (mgr.34427) 720 : cluster [DBG] pgmap v392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:44.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:44 gibba013 bash[29418]: cluster 2021-03-10T14:05:42.865541+0000 mgr.gibba020.yqfnwy (mgr.34427) 721 : cluster [DBG] pgmap v393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:44.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:44 gibba013 bash[30381]: cluster 2021-03-10T14:05:42.865541+0000 mgr.gibba020.yqfnwy (mgr.34427) 721 : cluster [DBG] pgmap v393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:44.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:44 gibba020 bash[25448]: cluster 2021-03-10T14:05:42.865541+0000 mgr.gibba020.yqfnwy (mgr.34427) 721 : cluster [DBG] pgmap v393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:46.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:46 gibba013 bash[29418]: cluster 2021-03-10T14:05:44.867131+0000 mgr.gibba020.yqfnwy (mgr.34427) 722 : cluster [DBG] pgmap v394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:46.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:46 gibba013 bash[30381]: cluster 2021-03-10T14:05:44.867131+0000 mgr.gibba020.yqfnwy (mgr.34427) 722 : cluster [DBG] pgmap v394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:46.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:46 gibba020 bash[25448]: cluster 2021-03-10T14:05:44.867131+0000 mgr.gibba020.yqfnwy (mgr.34427) 722 : cluster [DBG] pgmap v394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:48.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:48 gibba013 bash[29418]: cluster 2021-03-10T14:05:46.868900+0000 mgr.gibba020.yqfnwy (mgr.34427) 723 : cluster [DBG] pgmap v395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:48.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:48 gibba013 bash[30381]: cluster 2021-03-10T14:05:46.868900+0000 mgr.gibba020.yqfnwy (mgr.34427) 723 : cluster [DBG] pgmap v395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:48.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:48 gibba020 bash[25448]: cluster 2021-03-10T14:05:46.868900+0000 mgr.gibba020.yqfnwy (mgr.34427) 723 : cluster [DBG] pgmap v395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:50.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:50 gibba020 bash[25448]: cluster 2021-03-10T14:05:48.870522+0000 mgr.gibba020.yqfnwy (mgr.34427) 724 : cluster [DBG] pgmap v396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:50.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:50 gibba013 bash[29418]: cluster 2021-03-10T14:05:48.870522+0000 mgr.gibba020.yqfnwy (mgr.34427) 724 : cluster [DBG] pgmap v396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:50.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:50 gibba013 bash[30381]: cluster 2021-03-10T14:05:48.870522+0000 mgr.gibba020.yqfnwy (mgr.34427) 724 : cluster [DBG] pgmap v396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:51.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:51 gibba013 bash[29418]: cephadm 2021-03-10T14:05:49.841135+0000 mgr.gibba020.yqfnwy (mgr.34427) 725 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:05:51.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:51 gibba013 bash[30381]: cephadm 2021-03-10T14:05:49.841135+0000 mgr.gibba020.yqfnwy (mgr.34427) 725 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:05:51.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:51 gibba020 bash[25448]: cephadm 2021-03-10T14:05:49.841135+0000 mgr.gibba020.yqfnwy (mgr.34427) 725 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:05:52.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:52 gibba013 bash[29418]: cluster 2021-03-10T14:05:50.872277+0000 mgr.gibba020.yqfnwy (mgr.34427) 726 : cluster [DBG] pgmap v397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:52.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:52 gibba013 bash[30381]: cluster 2021-03-10T14:05:50.872277+0000 mgr.gibba020.yqfnwy (mgr.34427) 726 : cluster [DBG] pgmap v397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:52.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:52 gibba020 bash[25448]: cluster 2021-03-10T14:05:50.872277+0000 mgr.gibba020.yqfnwy (mgr.34427) 726 : cluster [DBG] pgmap v397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:54.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:54 gibba013 bash[29418]: cluster 2021-03-10T14:05:52.873789+0000 mgr.gibba020.yqfnwy (mgr.34427) 727 : cluster [DBG] pgmap v398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:54.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:54 gibba013 bash[30381]: cluster 2021-03-10T14:05:52.873789+0000 mgr.gibba020.yqfnwy (mgr.34427) 727 : cluster [DBG] pgmap v398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:54.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:54 gibba020 bash[25448]: cluster 2021-03-10T14:05:52.873789+0000 mgr.gibba020.yqfnwy (mgr.34427) 727 : cluster [DBG] pgmap v398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:56.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:56 gibba013 bash[29418]: cluster 2021-03-10T14:05:54.875680+0000 mgr.gibba020.yqfnwy (mgr.34427) 728 : cluster [DBG] pgmap v399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:56.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:56 gibba013 bash[30381]: cluster 2021-03-10T14:05:54.875680+0000 mgr.gibba020.yqfnwy (mgr.34427) 728 : cluster [DBG] pgmap v399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:56.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:56 gibba020 bash[25448]: cluster 2021-03-10T14:05:54.875680+0000 mgr.gibba020.yqfnwy (mgr.34427) 728 : cluster [DBG] pgmap v399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:58.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:05:58 gibba013 bash[29418]: cluster 2021-03-10T14:05:56.877227+0000 mgr.gibba020.yqfnwy (mgr.34427) 729 : cluster [DBG] pgmap v400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:58.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:05:58 gibba013 bash[30381]: cluster 2021-03-10T14:05:56.877227+0000 mgr.gibba020.yqfnwy (mgr.34427) 729 : cluster [DBG] pgmap v400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:05:58.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:05:58 gibba020 bash[25448]: cluster 2021-03-10T14:05:56.877227+0000 mgr.gibba020.yqfnwy (mgr.34427) 729 : cluster [DBG] pgmap v400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:00.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:00 gibba013 bash[29418]: cluster 2021-03-10T14:05:58.878879+0000 mgr.gibba020.yqfnwy (mgr.34427) 730 : cluster [DBG] pgmap v401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:00.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:00 gibba013 bash[30381]: cluster 2021-03-10T14:05:58.878879+0000 mgr.gibba020.yqfnwy (mgr.34427) 730 : cluster [DBG] pgmap v401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:00.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:00 gibba020 bash[25448]: cluster 2021-03-10T14:05:58.878879+0000 mgr.gibba020.yqfnwy (mgr.34427) 730 : cluster [DBG] pgmap v401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:02.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:02 gibba013 bash[29418]: cluster 2021-03-10T14:06:00.880602+0000 mgr.gibba020.yqfnwy (mgr.34427) 731 : cluster [DBG] pgmap v402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:02.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:02 gibba013 bash[30381]: cluster 2021-03-10T14:06:00.880602+0000 mgr.gibba020.yqfnwy (mgr.34427) 731 : cluster [DBG] pgmap v402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:02.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:02 gibba020 bash[25448]: cluster 2021-03-10T14:06:00.880602+0000 mgr.gibba020.yqfnwy (mgr.34427) 731 : cluster [DBG] pgmap v402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:04.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:04 gibba013 bash[29418]: cluster 2021-03-10T14:06:02.882327+0000 mgr.gibba020.yqfnwy (mgr.34427) 732 : cluster [DBG] pgmap v403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:04.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:04 gibba013 bash[30381]: cluster 2021-03-10T14:06:02.882327+0000 mgr.gibba020.yqfnwy (mgr.34427) 732 : cluster [DBG] pgmap v403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:04.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:04 gibba020 bash[25448]: cluster 2021-03-10T14:06:02.882327+0000 mgr.gibba020.yqfnwy (mgr.34427) 732 : cluster [DBG] pgmap v403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:06.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:06 gibba020 bash[25448]: cephadm 2021-03-10T14:06:04.856998+0000 mgr.gibba020.yqfnwy (mgr.34427) 733 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:06:06.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:06 gibba020 bash[25448]: cluster 2021-03-10T14:06:04.884252+0000 mgr.gibba020.yqfnwy (mgr.34427) 734 : cluster [DBG] pgmap v404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:06.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:06 gibba020 bash[25448]: audit 2021-03-10T14:06:05.834605+0000 mon.a (mon.0) 763 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:06:06.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:06 gibba020 bash[25448]: audit 2021-03-10T14:06:05.835466+0000 mon.a (mon.0) 764 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:06:06.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:06 gibba020 bash[25448]: audit 2021-03-10T14:06:05.836226+0000 mon.a (mon.0) 765 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:06:06.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:06 gibba020 bash[25448]: audit 2021-03-10T14:06:05.836997+0000 mon.a (mon.0) 766 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T14:06:06.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:06 gibba020 bash[25448]: audit 2021-03-10T14:06:06.001348+0000 mon.a (mon.0) 767 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:06:06.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:06 gibba020 bash[25448]: audit 2021-03-10T14:06:06.002067+0000 mon.a (mon.0) 768 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:06:06.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:06 gibba013 bash[29418]: cephadm 2021-03-10T14:06:04.856998+0000 mgr.gibba020.yqfnwy (mgr.34427) 733 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:06:06.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:06 gibba013 bash[29418]: cluster 2021-03-10T14:06:04.884252+0000 mgr.gibba020.yqfnwy (mgr.34427) 734 : cluster [DBG] pgmap v404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:06.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:06 gibba013 bash[29418]: audit 2021-03-10T14:06:05.834605+0000 mon.a (mon.0) 763 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:06:06.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:06 gibba013 bash[29418]: audit 2021-03-10T14:06:05.835466+0000 mon.a (mon.0) 764 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:06:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:06 gibba013 bash[29418]: audit 2021-03-10T14:06:05.836226+0000 mon.a (mon.0) 765 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:06:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:06 gibba013 bash[29418]: audit 2021-03-10T14:06:05.836997+0000 mon.a (mon.0) 766 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T14:06:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:06 gibba013 bash[29418]: audit 2021-03-10T14:06:06.001348+0000 mon.a (mon.0) 767 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:06:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:06 gibba013 bash[29418]: audit 2021-03-10T14:06:06.002067+0000 mon.a (mon.0) 768 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:06:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:06 gibba013 bash[30381]: cephadm 2021-03-10T14:06:04.856998+0000 mgr.gibba020.yqfnwy (mgr.34427) 733 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:06:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:06 gibba013 bash[30381]: cluster 2021-03-10T14:06:04.884252+0000 mgr.gibba020.yqfnwy (mgr.34427) 734 : cluster [DBG] pgmap v404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:06 gibba013 bash[30381]: audit 2021-03-10T14:06:05.834605+0000 mon.a (mon.0) 763 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:06:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:06 gibba013 bash[30381]: audit 2021-03-10T14:06:05.835466+0000 mon.a (mon.0) 764 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:06:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:06 gibba013 bash[30381]: audit 2021-03-10T14:06:05.836226+0000 mon.a (mon.0) 765 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:06:06.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:06 gibba013 bash[30381]: audit 2021-03-10T14:06:05.836997+0000 mon.a (mon.0) 766 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T14:06:06.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:06 gibba013 bash[30381]: audit 2021-03-10T14:06:06.001348+0000 mon.a (mon.0) 767 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:06:06.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:06 gibba013 bash[30381]: audit 2021-03-10T14:06:06.002067+0000 mon.a (mon.0) 768 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:06:08.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:08 gibba020 bash[25448]: cluster 2021-03-10T14:06:06.885627+0000 mgr.gibba020.yqfnwy (mgr.34427) 735 : cluster [DBG] pgmap v405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:08.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:08 gibba013 bash[29418]: cluster 2021-03-10T14:06:06.885627+0000 mgr.gibba020.yqfnwy (mgr.34427) 735 : cluster [DBG] pgmap v405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:08.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:08 gibba013 bash[30381]: cluster 2021-03-10T14:06:06.885627+0000 mgr.gibba020.yqfnwy (mgr.34427) 735 : cluster [DBG] pgmap v405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:09.251 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:06:09.478 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:06:09.478 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (12m) 9m ago 18m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:06:09.479 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (17m) 7m ago 17m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:06:09.479 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (13m) 7m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:06:09.479 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (13m) 7m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:06:09.479 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (12m) 9m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:06:09.480 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (12m) 9m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:06:09.480 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (11m) 7m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:06:09.480 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (11m) 9m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:06:09.480 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (18m) 9m ago 18m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:06:09.480 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (18m) 7m ago 18m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:06:09.481 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (10m) 9m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:06:09.481 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (10m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:06:09.481 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (10m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:06:09.481 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (9m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:06:09.481 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (9m) 7m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:06:09.482 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (8m) 7m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:06:09.482 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (8m) 7m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:06:09.482 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (7m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:06:09.482 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (17m) 7m ago 18m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:06:09.483 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 7m ago 16m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:06:09.727 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:06:09.727 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:06:09.727 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:06:09.728 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:06:09.728 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:06:09.728 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:06:09.728 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:06:09.729 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:06:09.729 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:06:09.729 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:06:09.729 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:06:09.729 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:06:09.730 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:06:09.730 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:06:09.730 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:06:10.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:10 gibba020 bash[25448]: cluster 2021-03-10T14:06:08.887005+0000 mgr.gibba020.yqfnwy (mgr.34427) 736 : cluster [DBG] pgmap v406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:10.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:10 gibba020 bash[25448]: audit 2021-03-10T14:06:09.239103+0000 mgr.gibba020.yqfnwy (mgr.34427) 737 : audit [DBG] from='client.54541 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:06:10.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:10 gibba020 bash[25448]: audit 2021-03-10T14:06:09.726262+0000 mon.a (mon.0) 769 : audit [DBG] from='client.? 172.21.2.113:0/2517542781' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:10.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:10 gibba013 bash[29418]: cluster 2021-03-10T14:06:08.887005+0000 mgr.gibba020.yqfnwy (mgr.34427) 736 : cluster [DBG] pgmap v406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:10.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:10 gibba013 bash[29418]: audit 2021-03-10T14:06:09.239103+0000 mgr.gibba020.yqfnwy (mgr.34427) 737 : audit [DBG] from='client.54541 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:06:10.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:10 gibba013 bash[29418]: audit 2021-03-10T14:06:09.726262+0000 mon.a (mon.0) 769 : audit [DBG] from='client.? 172.21.2.113:0/2517542781' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:10.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:10 gibba013 bash[30381]: cluster 2021-03-10T14:06:08.887005+0000 mgr.gibba020.yqfnwy (mgr.34427) 736 : cluster [DBG] pgmap v406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:10.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:10 gibba013 bash[30381]: audit 2021-03-10T14:06:09.239103+0000 mgr.gibba020.yqfnwy (mgr.34427) 737 : audit [DBG] from='client.54541 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:06:10.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:10 gibba013 bash[30381]: audit 2021-03-10T14:06:09.726262+0000 mon.a (mon.0) 769 : audit [DBG] from='client.? 172.21.2.113:0/2517542781' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:11.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:11 gibba020 bash[25448]: audit 2021-03-10T14:06:09.461942+0000 mgr.gibba020.yqfnwy (mgr.34427) 738 : audit [DBG] from='client.44562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:06:11.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:11 gibba013 bash[29418]: audit 2021-03-10T14:06:09.461942+0000 mgr.gibba020.yqfnwy (mgr.34427) 738 : audit [DBG] from='client.44562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:06:11.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:11 gibba013 bash[30381]: audit 2021-03-10T14:06:09.461942+0000 mgr.gibba020.yqfnwy (mgr.34427) 738 : audit [DBG] from='client.44562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:06:12.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:12 gibba020 bash[25448]: cluster 2021-03-10T14:06:10.888715+0000 mgr.gibba020.yqfnwy (mgr.34427) 739 : cluster [DBG] pgmap v407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:12.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:12 gibba013 bash[29418]: cluster 2021-03-10T14:06:10.888715+0000 mgr.gibba020.yqfnwy (mgr.34427) 739 : cluster [DBG] pgmap v407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:12.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:12 gibba013 bash[30381]: cluster 2021-03-10T14:06:10.888715+0000 mgr.gibba020.yqfnwy (mgr.34427) 739 : cluster [DBG] pgmap v407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:14.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:14 gibba020 bash[25448]: cluster 2021-03-10T14:06:12.890151+0000 mgr.gibba020.yqfnwy (mgr.34427) 740 : cluster [DBG] pgmap v408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:14.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:14 gibba013 bash[29418]: cluster 2021-03-10T14:06:12.890151+0000 mgr.gibba020.yqfnwy (mgr.34427) 740 : cluster [DBG] pgmap v408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:14.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:14 gibba013 bash[30381]: cluster 2021-03-10T14:06:12.890151+0000 mgr.gibba020.yqfnwy (mgr.34427) 740 : cluster [DBG] pgmap v408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:16.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:16 gibba020 bash[25448]: cluster 2021-03-10T14:06:14.891761+0000 mgr.gibba020.yqfnwy (mgr.34427) 741 : cluster [DBG] pgmap v409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:16.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:16 gibba013 bash[29418]: cluster 2021-03-10T14:06:14.891761+0000 mgr.gibba020.yqfnwy (mgr.34427) 741 : cluster [DBG] pgmap v409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:16.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:16 gibba013 bash[30381]: cluster 2021-03-10T14:06:14.891761+0000 mgr.gibba020.yqfnwy (mgr.34427) 741 : cluster [DBG] pgmap v409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:18.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:18 gibba020 bash[25448]: cluster 2021-03-10T14:06:16.893108+0000 mgr.gibba020.yqfnwy (mgr.34427) 742 : cluster [DBG] pgmap v410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:18.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:18 gibba013 bash[29418]: cluster 2021-03-10T14:06:16.893108+0000 mgr.gibba020.yqfnwy (mgr.34427) 742 : cluster [DBG] pgmap v410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:18.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:18 gibba013 bash[30381]: cluster 2021-03-10T14:06:16.893108+0000 mgr.gibba020.yqfnwy (mgr.34427) 742 : cluster [DBG] pgmap v410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:20.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:20 gibba020 bash[25448]: cluster 2021-03-10T14:06:18.894501+0000 mgr.gibba020.yqfnwy (mgr.34427) 743 : cluster [DBG] pgmap v411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:20.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:20 gibba020 bash[25448]: audit 2021-03-10T14:06:19.872869+0000 mon.a (mon.0) 770 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:06:20.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:20 gibba020 bash[25448]: audit 2021-03-10T14:06:20.113175+0000 mon.a (mon.0) 771 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:06:20.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:20 gibba020 bash[25448]: audit 2021-03-10T14:06:20.116537+0000 mon.a (mon.0) 772 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:06:20.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:20 gibba020 bash[25448]: audit 2021-03-10T14:06:20.117782+0000 mon.a (mon.0) 773 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:20.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:20 gibba020 bash[25448]: audit 2021-03-10T14:06:20.119062+0000 mon.a (mon.0) 774 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:20.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:20 gibba020 bash[25448]: audit 2021-03-10T14:06:20.120403+0000 mon.a (mon.0) 775 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:20.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:20 gibba020 bash[25448]: audit 2021-03-10T14:06:20.123081+0000 mon.a (mon.0) 776 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:20.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:20 gibba020 bash[25448]: audit 2021-03-10T14:06:20.125168+0000 mon.a (mon.0) 777 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:20.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:20 gibba013 bash[29418]: cluster 2021-03-10T14:06:18.894501+0000 mgr.gibba020.yqfnwy (mgr.34427) 743 : cluster [DBG] pgmap v411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:20.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:20 gibba013 bash[29418]: audit 2021-03-10T14:06:19.872869+0000 mon.a (mon.0) 770 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:06:20.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:20 gibba013 bash[29418]: audit 2021-03-10T14:06:20.113175+0000 mon.a (mon.0) 771 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:06:20.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:20 gibba013 bash[29418]: audit 2021-03-10T14:06:20.116537+0000 mon.a (mon.0) 772 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:06:20.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:20 gibba013 bash[29418]: audit 2021-03-10T14:06:20.117782+0000 mon.a (mon.0) 773 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:20.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:20 gibba013 bash[29418]: audit 2021-03-10T14:06:20.119062+0000 mon.a (mon.0) 774 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:20.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:20 gibba013 bash[29418]: audit 2021-03-10T14:06:20.120403+0000 mon.a (mon.0) 775 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:20.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:20 gibba013 bash[29418]: audit 2021-03-10T14:06:20.123081+0000 mon.a (mon.0) 776 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:20.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:20 gibba013 bash[29418]: audit 2021-03-10T14:06:20.125168+0000 mon.a (mon.0) 777 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:20.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:20 gibba013 bash[30381]: cluster 2021-03-10T14:06:18.894501+0000 mgr.gibba020.yqfnwy (mgr.34427) 743 : cluster [DBG] pgmap v411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:20.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:20 gibba013 bash[30381]: audit 2021-03-10T14:06:19.872869+0000 mon.a (mon.0) 770 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:06:20.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:20 gibba013 bash[30381]: audit 2021-03-10T14:06:20.113175+0000 mon.a (mon.0) 771 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:06:20.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:20 gibba013 bash[30381]: audit 2021-03-10T14:06:20.116537+0000 mon.a (mon.0) 772 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:06:20.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:20 gibba013 bash[30381]: audit 2021-03-10T14:06:20.117782+0000 mon.a (mon.0) 773 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:20.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:20 gibba013 bash[30381]: audit 2021-03-10T14:06:20.119062+0000 mon.a (mon.0) 774 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:20.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:20 gibba013 bash[30381]: audit 2021-03-10T14:06:20.120403+0000 mon.a (mon.0) 775 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:20.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:20 gibba013 bash[30381]: audit 2021-03-10T14:06:20.123081+0000 mon.a (mon.0) 776 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:20.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:20 gibba013 bash[30381]: audit 2021-03-10T14:06:20.125168+0000 mon.a (mon.0) 777 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:21.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:21 gibba013 bash[29418]: cephadm 2021-03-10T14:06:19.875275+0000 mgr.gibba020.yqfnwy (mgr.34427) 744 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:06:21.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:21 gibba013 bash[29418]: cephadm 2021-03-10T14:06:19.877404+0000 mgr.gibba020.yqfnwy (mgr.34427) 745 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:06:21.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:21 gibba013 bash[29418]: cephadm 2021-03-10T14:06:20.112777+0000 mgr.gibba020.yqfnwy (mgr.34427) 746 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:06:21.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:21 gibba013 bash[29418]: cephadm 2021-03-10T14:06:20.114468+0000 mgr.gibba020.yqfnwy (mgr.34427) 747 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:06:21.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:21 gibba013 bash[29418]: cephadm 2021-03-10T14:06:20.115656+0000 mgr.gibba020.yqfnwy (mgr.34427) 748 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:06:21.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:21 gibba013 bash[29418]: cephadm 2021-03-10T14:06:20.115697+0000 mgr.gibba020.yqfnwy (mgr.34427) 749 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:06:21.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:21 gibba013 bash[29418]: cephadm 2021-03-10T14:06:20.117053+0000 mgr.gibba020.yqfnwy (mgr.34427) 750 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:06:21.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:21 gibba013 bash[29418]: cephadm 2021-03-10T14:06:20.117118+0000 mgr.gibba020.yqfnwy (mgr.34427) 751 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:06:21.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:21 gibba013 bash[29418]: cephadm 2021-03-10T14:06:20.118190+0000 mgr.gibba020.yqfnwy (mgr.34427) 752 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:06:21.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:21 gibba013 bash[29418]: cephadm 2021-03-10T14:06:20.119540+0000 mgr.gibba020.yqfnwy (mgr.34427) 753 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:06:21.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:21 gibba013 bash[29418]: cephadm 2021-03-10T14:06:20.119585+0000 mgr.gibba020.yqfnwy (mgr.34427) 754 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:06:21.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:21 gibba013 bash[29418]: cephadm 2021-03-10T14:06:20.121257+0000 mgr.gibba020.yqfnwy (mgr.34427) 755 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:06:21.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:21 gibba013 bash[29418]: cephadm 2021-03-10T14:06:20.121719+0000 mgr.gibba020.yqfnwy (mgr.34427) 756 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:06:21.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:21 gibba013 bash[29418]: cephadm 2021-03-10T14:06:20.123417+0000 mgr.gibba020.yqfnwy (mgr.34427) 757 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:06:21.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:21 gibba013 bash[29418]: cephadm 2021-03-10T14:06:20.123465+0000 mgr.gibba020.yqfnwy (mgr.34427) 758 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:06:21.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:21 gibba013 bash[29418]: cephadm 2021-03-10T14:06:20.123601+0000 mgr.gibba020.yqfnwy (mgr.34427) 759 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:06:21.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:21 gibba013 bash[30381]: cephadm 2021-03-10T14:06:19.875275+0000 mgr.gibba020.yqfnwy (mgr.34427) 744 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:06:21.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:21 gibba013 bash[30381]: cephadm 2021-03-10T14:06:19.877404+0000 mgr.gibba020.yqfnwy (mgr.34427) 745 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:06:21.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:21 gibba013 bash[30381]: cephadm 2021-03-10T14:06:20.112777+0000 mgr.gibba020.yqfnwy (mgr.34427) 746 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:06:21.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:21 gibba013 bash[30381]: cephadm 2021-03-10T14:06:20.114468+0000 mgr.gibba020.yqfnwy (mgr.34427) 747 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:06:21.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:21 gibba013 bash[30381]: cephadm 2021-03-10T14:06:20.115656+0000 mgr.gibba020.yqfnwy (mgr.34427) 748 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:06:21.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:21 gibba013 bash[30381]: cephadm 2021-03-10T14:06:20.115697+0000 mgr.gibba020.yqfnwy (mgr.34427) 749 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:06:21.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:21 gibba013 bash[30381]: cephadm 2021-03-10T14:06:20.117053+0000 mgr.gibba020.yqfnwy (mgr.34427) 750 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:06:21.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:21 gibba013 bash[30381]: cephadm 2021-03-10T14:06:20.117118+0000 mgr.gibba020.yqfnwy (mgr.34427) 751 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:06:21.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:21 gibba013 bash[30381]: cephadm 2021-03-10T14:06:20.118190+0000 mgr.gibba020.yqfnwy (mgr.34427) 752 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:06:21.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:21 gibba013 bash[30381]: cephadm 2021-03-10T14:06:20.119540+0000 mgr.gibba020.yqfnwy (mgr.34427) 753 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:06:21.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:21 gibba013 bash[30381]: cephadm 2021-03-10T14:06:20.119585+0000 mgr.gibba020.yqfnwy (mgr.34427) 754 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:06:21.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:21 gibba013 bash[30381]: cephadm 2021-03-10T14:06:20.121257+0000 mgr.gibba020.yqfnwy (mgr.34427) 755 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:06:21.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:21 gibba013 bash[30381]: cephadm 2021-03-10T14:06:20.121719+0000 mgr.gibba020.yqfnwy (mgr.34427) 756 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:06:21.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:21 gibba013 bash[30381]: cephadm 2021-03-10T14:06:20.123417+0000 mgr.gibba020.yqfnwy (mgr.34427) 757 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:06:21.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:21 gibba013 bash[30381]: cephadm 2021-03-10T14:06:20.123465+0000 mgr.gibba020.yqfnwy (mgr.34427) 758 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:06:21.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:21 gibba013 bash[30381]: cephadm 2021-03-10T14:06:20.123601+0000 mgr.gibba020.yqfnwy (mgr.34427) 759 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:06:21.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:21 gibba020 bash[25448]: cephadm 2021-03-10T14:06:19.875275+0000 mgr.gibba020.yqfnwy (mgr.34427) 744 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:06:21.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:21 gibba020 bash[25448]: cephadm 2021-03-10T14:06:19.877404+0000 mgr.gibba020.yqfnwy (mgr.34427) 745 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:06:21.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:21 gibba020 bash[25448]: cephadm 2021-03-10T14:06:20.112777+0000 mgr.gibba020.yqfnwy (mgr.34427) 746 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:06:21.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:21 gibba020 bash[25448]: cephadm 2021-03-10T14:06:20.114468+0000 mgr.gibba020.yqfnwy (mgr.34427) 747 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:06:21.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:21 gibba020 bash[25448]: cephadm 2021-03-10T14:06:20.115656+0000 mgr.gibba020.yqfnwy (mgr.34427) 748 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:06:21.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:21 gibba020 bash[25448]: cephadm 2021-03-10T14:06:20.115697+0000 mgr.gibba020.yqfnwy (mgr.34427) 749 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:06:21.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:21 gibba020 bash[25448]: cephadm 2021-03-10T14:06:20.117053+0000 mgr.gibba020.yqfnwy (mgr.34427) 750 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:06:21.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:21 gibba020 bash[25448]: cephadm 2021-03-10T14:06:20.117118+0000 mgr.gibba020.yqfnwy (mgr.34427) 751 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:06:21.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:21 gibba020 bash[25448]: cephadm 2021-03-10T14:06:20.118190+0000 mgr.gibba020.yqfnwy (mgr.34427) 752 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:06:21.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:21 gibba020 bash[25448]: cephadm 2021-03-10T14:06:20.119540+0000 mgr.gibba020.yqfnwy (mgr.34427) 753 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:06:21.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:21 gibba020 bash[25448]: cephadm 2021-03-10T14:06:20.119585+0000 mgr.gibba020.yqfnwy (mgr.34427) 754 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:06:21.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:21 gibba020 bash[25448]: cephadm 2021-03-10T14:06:20.121257+0000 mgr.gibba020.yqfnwy (mgr.34427) 755 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:06:21.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:21 gibba020 bash[25448]: cephadm 2021-03-10T14:06:20.121719+0000 mgr.gibba020.yqfnwy (mgr.34427) 756 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:06:21.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:21 gibba020 bash[25448]: cephadm 2021-03-10T14:06:20.123417+0000 mgr.gibba020.yqfnwy (mgr.34427) 757 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:06:21.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:21 gibba020 bash[25448]: cephadm 2021-03-10T14:06:20.123465+0000 mgr.gibba020.yqfnwy (mgr.34427) 758 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:06:21.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:21 gibba020 bash[25448]: cephadm 2021-03-10T14:06:20.123601+0000 mgr.gibba020.yqfnwy (mgr.34427) 759 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:06:22.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:22 gibba013 bash[29418]: cluster 2021-03-10T14:06:20.896173+0000 mgr.gibba020.yqfnwy (mgr.34427) 760 : cluster [DBG] pgmap v412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:22.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:22 gibba013 bash[30381]: cluster 2021-03-10T14:06:20.896173+0000 mgr.gibba020.yqfnwy (mgr.34427) 760 : cluster [DBG] pgmap v412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:22.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:22 gibba020 bash[25448]: cluster 2021-03-10T14:06:20.896173+0000 mgr.gibba020.yqfnwy (mgr.34427) 760 : cluster [DBG] pgmap v412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:24.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:24 gibba013 bash[29418]: cluster 2021-03-10T14:06:22.897753+0000 mgr.gibba020.yqfnwy (mgr.34427) 761 : cluster [DBG] pgmap v413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:24.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:24 gibba013 bash[30381]: cluster 2021-03-10T14:06:22.897753+0000 mgr.gibba020.yqfnwy (mgr.34427) 761 : cluster [DBG] pgmap v413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:24.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:24 gibba020 bash[25448]: cluster 2021-03-10T14:06:22.897753+0000 mgr.gibba020.yqfnwy (mgr.34427) 761 : cluster [DBG] pgmap v413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:26.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:26 gibba013 bash[29418]: cluster 2021-03-10T14:06:24.899201+0000 mgr.gibba020.yqfnwy (mgr.34427) 762 : cluster [DBG] pgmap v414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:26.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:26 gibba013 bash[30381]: cluster 2021-03-10T14:06:24.899201+0000 mgr.gibba020.yqfnwy (mgr.34427) 762 : cluster [DBG] pgmap v414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:26.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:26 gibba020 bash[25448]: cluster 2021-03-10T14:06:24.899201+0000 mgr.gibba020.yqfnwy (mgr.34427) 762 : cluster [DBG] pgmap v414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:28.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:28 gibba013 bash[29418]: cluster 2021-03-10T14:06:26.900628+0000 mgr.gibba020.yqfnwy (mgr.34427) 763 : cluster [DBG] pgmap v415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:28.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:28 gibba013 bash[30381]: cluster 2021-03-10T14:06:26.900628+0000 mgr.gibba020.yqfnwy (mgr.34427) 763 : cluster [DBG] pgmap v415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:28.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:28 gibba020 bash[25448]: cluster 2021-03-10T14:06:26.900628+0000 mgr.gibba020.yqfnwy (mgr.34427) 763 : cluster [DBG] pgmap v415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:30.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:30 gibba013 bash[29418]: cluster 2021-03-10T14:06:28.901960+0000 mgr.gibba020.yqfnwy (mgr.34427) 764 : cluster [DBG] pgmap v416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:30.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:30 gibba013 bash[30381]: cluster 2021-03-10T14:06:28.901960+0000 mgr.gibba020.yqfnwy (mgr.34427) 764 : cluster [DBG] pgmap v416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:30.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:30 gibba020 bash[25448]: cluster 2021-03-10T14:06:28.901960+0000 mgr.gibba020.yqfnwy (mgr.34427) 764 : cluster [DBG] pgmap v416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:32.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:32 gibba013 bash[29418]: cluster 2021-03-10T14:06:30.903647+0000 mgr.gibba020.yqfnwy (mgr.34427) 765 : cluster [DBG] pgmap v417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:32.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:32 gibba013 bash[30381]: cluster 2021-03-10T14:06:30.903647+0000 mgr.gibba020.yqfnwy (mgr.34427) 765 : cluster [DBG] pgmap v417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:32.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:32 gibba020 bash[25448]: cluster 2021-03-10T14:06:30.903647+0000 mgr.gibba020.yqfnwy (mgr.34427) 765 : cluster [DBG] pgmap v417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:34.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:34 gibba013 bash[29418]: cluster 2021-03-10T14:06:32.905076+0000 mgr.gibba020.yqfnwy (mgr.34427) 766 : cluster [DBG] pgmap v418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:34.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:34 gibba013 bash[30381]: cluster 2021-03-10T14:06:32.905076+0000 mgr.gibba020.yqfnwy (mgr.34427) 766 : cluster [DBG] pgmap v418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:34.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:34 gibba020 bash[25448]: cluster 2021-03-10T14:06:32.905076+0000 mgr.gibba020.yqfnwy (mgr.34427) 766 : cluster [DBG] pgmap v418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:36.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:36 gibba013 bash[29418]: cluster 2021-03-10T14:06:34.906671+0000 mgr.gibba020.yqfnwy (mgr.34427) 767 : cluster [DBG] pgmap v419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:36.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:36 gibba013 bash[29418]: cephadm 2021-03-10T14:06:35.132572+0000 mgr.gibba020.yqfnwy (mgr.34427) 768 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:06:36.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:36 gibba013 bash[30381]: cluster 2021-03-10T14:06:34.906671+0000 mgr.gibba020.yqfnwy (mgr.34427) 767 : cluster [DBG] pgmap v419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:36.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:36 gibba013 bash[30381]: cephadm 2021-03-10T14:06:35.132572+0000 mgr.gibba020.yqfnwy (mgr.34427) 768 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:06:36.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:36 gibba020 bash[25448]: cluster 2021-03-10T14:06:34.906671+0000 mgr.gibba020.yqfnwy (mgr.34427) 767 : cluster [DBG] pgmap v419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:36.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:36 gibba020 bash[25448]: cephadm 2021-03-10T14:06:35.132572+0000 mgr.gibba020.yqfnwy (mgr.34427) 768 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:06:38.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:38 gibba013 bash[29418]: cluster 2021-03-10T14:06:36.908211+0000 mgr.gibba020.yqfnwy (mgr.34427) 769 : cluster [DBG] pgmap v420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:38.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:38 gibba013 bash[30381]: cluster 2021-03-10T14:06:36.908211+0000 mgr.gibba020.yqfnwy (mgr.34427) 769 : cluster [DBG] pgmap v420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:38.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:38 gibba020 bash[25448]: cluster 2021-03-10T14:06:36.908211+0000 mgr.gibba020.yqfnwy (mgr.34427) 769 : cluster [DBG] pgmap v420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:39.971 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:06:40.199 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:06:40.200 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (13m) 10m ago 18m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:06:40.200 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (18m) 8m ago 18m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:06:40.200 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (13m) 8m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:06:40.200 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (13m) 8m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:06:40.201 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (12m) 10m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:06:40.201 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (12m) 10m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:06:40.201 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (12m) 8m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:06:40.201 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (12m) 10m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:06:40.201 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (18m) 10m ago 18m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:06:40.202 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (18m) 8m ago 18m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:06:40.202 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (11m) 10m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:06:40.202 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (11m) 10m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:06:40.202 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (10m) 10m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:06:40.202 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (10m) 10m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:06:40.203 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (9m) 8m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:06:40.203 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (9m) 8m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:06:40.203 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (8m) 8m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:06:40.203 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (8m) 8m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:06:40.203 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (18m) 8m ago 18m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:06:40.204 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 8m ago 16m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:06:40.457 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:06:40.457 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:06:40.457 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:06:40.458 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:06:40.458 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:06:40.458 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:06:40.458 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:06:40.458 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:06:40.459 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:06:40.459 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:06:40.459 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:06:40.459 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:06:40.460 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:06:40.460 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:06:40.460 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:06:40.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:40 gibba013 bash[29418]: cluster 2021-03-10T14:06:38.909560+0000 mgr.gibba020.yqfnwy (mgr.34427) 770 : cluster [DBG] pgmap v421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:40.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:40 gibba013 bash[30381]: cluster 2021-03-10T14:06:38.909560+0000 mgr.gibba020.yqfnwy (mgr.34427) 770 : cluster [DBG] pgmap v421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:40.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:40 gibba020 bash[25448]: cluster 2021-03-10T14:06:38.909560+0000 mgr.gibba020.yqfnwy (mgr.34427) 770 : cluster [DBG] pgmap v421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:41.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:41 gibba013 bash[29418]: audit 2021-03-10T14:06:39.958207+0000 mgr.gibba020.yqfnwy (mgr.34427) 771 : audit [DBG] from='client.54559 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:06:41.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:41 gibba013 bash[29418]: audit 2021-03-10T14:06:40.183929+0000 mgr.gibba020.yqfnwy (mgr.34427) 772 : audit [DBG] from='client.44580 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:06:41.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:41 gibba013 bash[29418]: audit 2021-03-10T14:06:40.456220+0000 mon.a (mon.0) 778 : audit [DBG] from='client.? 172.21.2.113:0/3264854874' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:41.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:41 gibba013 bash[30381]: audit 2021-03-10T14:06:39.958207+0000 mgr.gibba020.yqfnwy (mgr.34427) 771 : audit [DBG] from='client.54559 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:06:41.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:41 gibba013 bash[30381]: audit 2021-03-10T14:06:40.183929+0000 mgr.gibba020.yqfnwy (mgr.34427) 772 : audit [DBG] from='client.44580 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:06:41.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:41 gibba013 bash[30381]: audit 2021-03-10T14:06:40.456220+0000 mon.a (mon.0) 778 : audit [DBG] from='client.? 172.21.2.113:0/3264854874' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:41.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:41 gibba020 bash[25448]: audit 2021-03-10T14:06:39.958207+0000 mgr.gibba020.yqfnwy (mgr.34427) 771 : audit [DBG] from='client.54559 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:06:41.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:41 gibba020 bash[25448]: audit 2021-03-10T14:06:40.183929+0000 mgr.gibba020.yqfnwy (mgr.34427) 772 : audit [DBG] from='client.44580 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:06:41.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:41 gibba020 bash[25448]: audit 2021-03-10T14:06:40.456220+0000 mon.a (mon.0) 778 : audit [DBG] from='client.? 172.21.2.113:0/3264854874' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:06:42.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:42 gibba013 bash[29418]: cluster 2021-03-10T14:06:40.911302+0000 mgr.gibba020.yqfnwy (mgr.34427) 773 : cluster [DBG] pgmap v422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:42.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:42 gibba013 bash[30381]: cluster 2021-03-10T14:06:40.911302+0000 mgr.gibba020.yqfnwy (mgr.34427) 773 : cluster [DBG] pgmap v422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:42.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:42 gibba020 bash[25448]: cluster 2021-03-10T14:06:40.911302+0000 mgr.gibba020.yqfnwy (mgr.34427) 773 : cluster [DBG] pgmap v422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:44.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:44 gibba013 bash[29418]: cluster 2021-03-10T14:06:42.912750+0000 mgr.gibba020.yqfnwy (mgr.34427) 774 : cluster [DBG] pgmap v423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:44.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:44 gibba013 bash[30381]: cluster 2021-03-10T14:06:42.912750+0000 mgr.gibba020.yqfnwy (mgr.34427) 774 : cluster [DBG] pgmap v423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:44.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:44 gibba020 bash[25448]: cluster 2021-03-10T14:06:42.912750+0000 mgr.gibba020.yqfnwy (mgr.34427) 774 : cluster [DBG] pgmap v423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:46.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:46 gibba013 bash[29418]: cluster 2021-03-10T14:06:44.914266+0000 mgr.gibba020.yqfnwy (mgr.34427) 775 : cluster [DBG] pgmap v424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:46.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:46 gibba013 bash[30381]: cluster 2021-03-10T14:06:44.914266+0000 mgr.gibba020.yqfnwy (mgr.34427) 775 : cluster [DBG] pgmap v424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:46.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:46 gibba020 bash[25448]: cluster 2021-03-10T14:06:44.914266+0000 mgr.gibba020.yqfnwy (mgr.34427) 775 : cluster [DBG] pgmap v424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:48.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:48 gibba013 bash[29418]: cluster 2021-03-10T14:06:46.915860+0000 mgr.gibba020.yqfnwy (mgr.34427) 776 : cluster [DBG] pgmap v425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:48.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:48 gibba013 bash[30381]: cluster 2021-03-10T14:06:46.915860+0000 mgr.gibba020.yqfnwy (mgr.34427) 776 : cluster [DBG] pgmap v425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:48.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:48 gibba020 bash[25448]: cluster 2021-03-10T14:06:46.915860+0000 mgr.gibba020.yqfnwy (mgr.34427) 776 : cluster [DBG] pgmap v425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:50.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:50 gibba020 bash[25448]: cluster 2021-03-10T14:06:48.917492+0000 mgr.gibba020.yqfnwy (mgr.34427) 777 : cluster [DBG] pgmap v426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:50.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:50 gibba013 bash[29418]: cluster 2021-03-10T14:06:48.917492+0000 mgr.gibba020.yqfnwy (mgr.34427) 777 : cluster [DBG] pgmap v426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:50.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:50 gibba013 bash[30381]: cluster 2021-03-10T14:06:48.917492+0000 mgr.gibba020.yqfnwy (mgr.34427) 777 : cluster [DBG] pgmap v426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:51.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:51 gibba013 bash[29418]: cephadm 2021-03-10T14:06:50.144643+0000 mgr.gibba020.yqfnwy (mgr.34427) 778 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:06:51.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:51 gibba013 bash[30381]: cephadm 2021-03-10T14:06:50.144643+0000 mgr.gibba020.yqfnwy (mgr.34427) 778 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:06:51.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:51 gibba020 bash[25448]: cephadm 2021-03-10T14:06:50.144643+0000 mgr.gibba020.yqfnwy (mgr.34427) 778 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:06:52.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:52 gibba013 bash[29418]: cluster 2021-03-10T14:06:50.919332+0000 mgr.gibba020.yqfnwy (mgr.34427) 779 : cluster [DBG] pgmap v427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:52.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:52 gibba013 bash[30381]: cluster 2021-03-10T14:06:50.919332+0000 mgr.gibba020.yqfnwy (mgr.34427) 779 : cluster [DBG] pgmap v427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:52.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:52 gibba020 bash[25448]: cluster 2021-03-10T14:06:50.919332+0000 mgr.gibba020.yqfnwy (mgr.34427) 779 : cluster [DBG] pgmap v427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:54.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:54 gibba013 bash[29418]: cluster 2021-03-10T14:06:52.920750+0000 mgr.gibba020.yqfnwy (mgr.34427) 780 : cluster [DBG] pgmap v428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:54.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:54 gibba013 bash[30381]: cluster 2021-03-10T14:06:52.920750+0000 mgr.gibba020.yqfnwy (mgr.34427) 780 : cluster [DBG] pgmap v428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:54.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:54 gibba020 bash[25448]: cluster 2021-03-10T14:06:52.920750+0000 mgr.gibba020.yqfnwy (mgr.34427) 780 : cluster [DBG] pgmap v428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:56.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:56 gibba020 bash[25448]: cluster 2021-03-10T14:06:54.922475+0000 mgr.gibba020.yqfnwy (mgr.34427) 781 : cluster [DBG] pgmap v429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:56.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:56 gibba013 bash[29418]: cluster 2021-03-10T14:06:54.922475+0000 mgr.gibba020.yqfnwy (mgr.34427) 781 : cluster [DBG] pgmap v429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:56.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:56 gibba013 bash[30381]: cluster 2021-03-10T14:06:54.922475+0000 mgr.gibba020.yqfnwy (mgr.34427) 781 : cluster [DBG] pgmap v429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:58.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:06:58 gibba020 bash[25448]: cluster 2021-03-10T14:06:56.924053+0000 mgr.gibba020.yqfnwy (mgr.34427) 782 : cluster [DBG] pgmap v430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:58.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:06:58 gibba013 bash[29418]: cluster 2021-03-10T14:06:56.924053+0000 mgr.gibba020.yqfnwy (mgr.34427) 782 : cluster [DBG] pgmap v430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:06:58.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:06:58 gibba013 bash[30381]: cluster 2021-03-10T14:06:56.924053+0000 mgr.gibba020.yqfnwy (mgr.34427) 782 : cluster [DBG] pgmap v430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:00.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:00 gibba020 bash[25448]: cluster 2021-03-10T14:06:58.925719+0000 mgr.gibba020.yqfnwy (mgr.34427) 783 : cluster [DBG] pgmap v431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:00.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:00 gibba013 bash[29418]: cluster 2021-03-10T14:06:58.925719+0000 mgr.gibba020.yqfnwy (mgr.34427) 783 : cluster [DBG] pgmap v431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:00.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:00 gibba013 bash[30381]: cluster 2021-03-10T14:06:58.925719+0000 mgr.gibba020.yqfnwy (mgr.34427) 783 : cluster [DBG] pgmap v431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:02.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:02 gibba020 bash[25448]: cluster 2021-03-10T14:07:00.927549+0000 mgr.gibba020.yqfnwy (mgr.34427) 784 : cluster [DBG] pgmap v432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:02.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:02 gibba013 bash[29418]: cluster 2021-03-10T14:07:00.927549+0000 mgr.gibba020.yqfnwy (mgr.34427) 784 : cluster [DBG] pgmap v432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:02.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:02 gibba013 bash[30381]: cluster 2021-03-10T14:07:00.927549+0000 mgr.gibba020.yqfnwy (mgr.34427) 784 : cluster [DBG] pgmap v432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:04.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:04 gibba020 bash[25448]: cluster 2021-03-10T14:07:02.928917+0000 mgr.gibba020.yqfnwy (mgr.34427) 785 : cluster [DBG] pgmap v433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:04.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:04 gibba013 bash[29418]: cluster 2021-03-10T14:07:02.928917+0000 mgr.gibba020.yqfnwy (mgr.34427) 785 : cluster [DBG] pgmap v433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:04.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:04 gibba013 bash[30381]: cluster 2021-03-10T14:07:02.928917+0000 mgr.gibba020.yqfnwy (mgr.34427) 785 : cluster [DBG] pgmap v433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:06 gibba020 bash[25448]: cluster 2021-03-10T14:07:04.930466+0000 mgr.gibba020.yqfnwy (mgr.34427) 786 : cluster [DBG] pgmap v434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:06.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:06 gibba020 bash[25448]: cephadm 2021-03-10T14:07:05.160106+0000 mgr.gibba020.yqfnwy (mgr.34427) 787 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:07:06.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:06 gibba020 bash[25448]: audit 2021-03-10T14:07:05.844781+0000 mon.a (mon.0) 779 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T14:07:06.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:06 gibba020 bash[25448]: audit 2021-03-10T14:07:05.845550+0000 mon.a (mon.0) 780 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:07:06.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:06 gibba020 bash[25448]: audit 2021-03-10T14:07:05.846303+0000 mon.a (mon.0) 781 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:07:06.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:06 gibba020 bash[25448]: audit 2021-03-10T14:07:05.847011+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:07:06.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:06 gibba020 bash[25448]: audit 2021-03-10T14:07:06.012336+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:07:06.706 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:06 gibba020 bash[25448]: audit 2021-03-10T14:07:06.012970+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:07:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:06 gibba013 bash[29418]: cluster 2021-03-10T14:07:04.930466+0000 mgr.gibba020.yqfnwy (mgr.34427) 786 : cluster [DBG] pgmap v434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:06 gibba013 bash[29418]: cephadm 2021-03-10T14:07:05.160106+0000 mgr.gibba020.yqfnwy (mgr.34427) 787 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:07:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:06 gibba013 bash[29418]: audit 2021-03-10T14:07:05.844781+0000 mon.a (mon.0) 779 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T14:07:06.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:06 gibba013 bash[29418]: audit 2021-03-10T14:07:05.845550+0000 mon.a (mon.0) 780 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:07:06.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:06 gibba013 bash[29418]: audit 2021-03-10T14:07:05.846303+0000 mon.a (mon.0) 781 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:07:06.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:06 gibba013 bash[29418]: audit 2021-03-10T14:07:05.847011+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:07:06.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:06 gibba013 bash[29418]: audit 2021-03-10T14:07:06.012336+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:07:06.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:06 gibba013 bash[29418]: audit 2021-03-10T14:07:06.012970+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:07:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:06 gibba013 bash[30381]: cluster 2021-03-10T14:07:04.930466+0000 mgr.gibba020.yqfnwy (mgr.34427) 786 : cluster [DBG] pgmap v434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:06 gibba013 bash[30381]: cephadm 2021-03-10T14:07:05.160106+0000 mgr.gibba020.yqfnwy (mgr.34427) 787 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:07:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:06 gibba013 bash[30381]: audit 2021-03-10T14:07:05.844781+0000 mon.a (mon.0) 779 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T14:07:06.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:06 gibba013 bash[30381]: audit 2021-03-10T14:07:05.845550+0000 mon.a (mon.0) 780 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:07:06.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:06 gibba013 bash[30381]: audit 2021-03-10T14:07:05.846303+0000 mon.a (mon.0) 781 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:07:06.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:06 gibba013 bash[30381]: audit 2021-03-10T14:07:05.847011+0000 mon.a (mon.0) 782 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:07:06.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:06 gibba013 bash[30381]: audit 2021-03-10T14:07:06.012336+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:07:06.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:06 gibba013 bash[30381]: audit 2021-03-10T14:07:06.012970+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:07:08.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:08 gibba020 bash[25448]: cluster 2021-03-10T14:07:06.931850+0000 mgr.gibba020.yqfnwy (mgr.34427) 788 : cluster [DBG] pgmap v435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:08.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:08 gibba013 bash[29418]: cluster 2021-03-10T14:07:06.931850+0000 mgr.gibba020.yqfnwy (mgr.34427) 788 : cluster [DBG] pgmap v435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:08.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:08 gibba013 bash[30381]: cluster 2021-03-10T14:07:06.931850+0000 mgr.gibba020.yqfnwy (mgr.34427) 788 : cluster [DBG] pgmap v435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:10.692 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:07:10.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:10 gibba020 bash[25448]: cluster 2021-03-10T14:07:08.933484+0000 mgr.gibba020.yqfnwy (mgr.34427) 789 : cluster [DBG] pgmap v436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:10.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:10 gibba013 bash[29418]: cluster 2021-03-10T14:07:08.933484+0000 mgr.gibba020.yqfnwy (mgr.34427) 789 : cluster [DBG] pgmap v436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:10.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:10 gibba013 bash[30381]: cluster 2021-03-10T14:07:08.933484+0000 mgr.gibba020.yqfnwy (mgr.34427) 789 : cluster [DBG] pgmap v436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:10.922 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:07:10.922 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (13m) 10m ago 19m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:07:10.922 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (18m) 8m ago 18m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:07:10.923 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (14m) 8m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:07:10.923 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (14m) 8m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:07:10.923 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (13m) 10m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:07:10.923 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (13m) 10m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:07:10.924 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (12m) 8m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:07:10.924 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (12m) 10m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:07:10.924 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (19m) 10m ago 19m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:07:10.924 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (19m) 8m ago 19m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:07:10.924 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (11m) 10m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:07:10.925 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (11m) 10m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:07:10.925 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (11m) 10m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:07:10.925 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (10m) 10m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:07:10.925 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (10m) 8m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:07:10.926 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (9m) 8m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:07:10.926 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (9m) 8m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:07:10.926 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (8m) 8m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:07:10.926 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (18m) 8m ago 19m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:07:10.927 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 8m ago 17m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:07:11.172 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:07:11.172 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:07:11.172 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:07:11.172 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:07:11.173 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:07:11.173 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:07:11.173 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:07:11.173 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:07:11.173 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:07:11.174 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:07:11.174 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:07:11.174 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:07:11.174 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:07:11.174 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:07:11.175 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:07:11.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:11 gibba013 bash[29418]: audit 2021-03-10T14:07:11.171019+0000 mon.a (mon.0) 785 : audit [DBG] from='client.? 172.21.2.113:0/3692120096' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:11.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:11 gibba013 bash[30381]: audit 2021-03-10T14:07:11.171019+0000 mon.a (mon.0) 785 : audit [DBG] from='client.? 172.21.2.113:0/3692120096' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:11.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:11 gibba020 bash[25448]: audit 2021-03-10T14:07:11.171019+0000 mon.a (mon.0) 785 : audit [DBG] from='client.? 172.21.2.113:0/3692120096' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:12.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:12 gibba013 bash[29418]: audit 2021-03-10T14:07:10.679807+0000 mgr.gibba020.yqfnwy (mgr.34427) 790 : audit [DBG] from='client.44592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:07:12.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:12 gibba013 bash[29418]: audit 2021-03-10T14:07:10.906181+0000 mgr.gibba020.yqfnwy (mgr.34427) 791 : audit [DBG] from='client.44598 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:07:12.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:12 gibba013 bash[29418]: cluster 2021-03-10T14:07:10.934092+0000 mgr.gibba020.yqfnwy (mgr.34427) 792 : cluster [DBG] pgmap v437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:12.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:12 gibba013 bash[30381]: audit 2021-03-10T14:07:10.679807+0000 mgr.gibba020.yqfnwy (mgr.34427) 790 : audit [DBG] from='client.44592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:07:12.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:12 gibba013 bash[30381]: audit 2021-03-10T14:07:10.906181+0000 mgr.gibba020.yqfnwy (mgr.34427) 791 : audit [DBG] from='client.44598 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:07:12.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:12 gibba013 bash[30381]: cluster 2021-03-10T14:07:10.934092+0000 mgr.gibba020.yqfnwy (mgr.34427) 792 : cluster [DBG] pgmap v437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:12.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:12 gibba020 bash[25448]: audit 2021-03-10T14:07:10.679807+0000 mgr.gibba020.yqfnwy (mgr.34427) 790 : audit [DBG] from='client.44592 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:07:12.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:12 gibba020 bash[25448]: audit 2021-03-10T14:07:10.906181+0000 mgr.gibba020.yqfnwy (mgr.34427) 791 : audit [DBG] from='client.44598 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:07:12.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:12 gibba020 bash[25448]: cluster 2021-03-10T14:07:10.934092+0000 mgr.gibba020.yqfnwy (mgr.34427) 792 : cluster [DBG] pgmap v437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:13.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:13 gibba013 bash[29418]: cluster 2021-03-10T14:07:12.935170+0000 mgr.gibba020.yqfnwy (mgr.34427) 793 : cluster [DBG] pgmap v438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:13.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:13 gibba013 bash[30381]: cluster 2021-03-10T14:07:12.935170+0000 mgr.gibba020.yqfnwy (mgr.34427) 793 : cluster [DBG] pgmap v438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:13.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:13 gibba020 bash[25448]: cluster 2021-03-10T14:07:12.935170+0000 mgr.gibba020.yqfnwy (mgr.34427) 793 : cluster [DBG] pgmap v438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:16.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:16 gibba013 bash[29418]: cluster 2021-03-10T14:07:14.936747+0000 mgr.gibba020.yqfnwy (mgr.34427) 794 : cluster [DBG] pgmap v439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:16.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:16 gibba013 bash[30381]: cluster 2021-03-10T14:07:14.936747+0000 mgr.gibba020.yqfnwy (mgr.34427) 794 : cluster [DBG] pgmap v439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:16.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:16 gibba020 bash[25448]: cluster 2021-03-10T14:07:14.936747+0000 mgr.gibba020.yqfnwy (mgr.34427) 794 : cluster [DBG] pgmap v439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:18.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:18 gibba013 bash[29418]: cluster 2021-03-10T14:07:16.938338+0000 mgr.gibba020.yqfnwy (mgr.34427) 795 : cluster [DBG] pgmap v440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:18.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:18 gibba013 bash[30381]: cluster 2021-03-10T14:07:16.938338+0000 mgr.gibba020.yqfnwy (mgr.34427) 795 : cluster [DBG] pgmap v440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:18.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:18 gibba020 bash[25448]: cluster 2021-03-10T14:07:16.938338+0000 mgr.gibba020.yqfnwy (mgr.34427) 795 : cluster [DBG] pgmap v440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:20.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:20 gibba013 bash[29418]: cluster 2021-03-10T14:07:18.940008+0000 mgr.gibba020.yqfnwy (mgr.34427) 796 : cluster [DBG] pgmap v441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:20.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:20 gibba013 bash[30381]: cluster 2021-03-10T14:07:18.940008+0000 mgr.gibba020.yqfnwy (mgr.34427) 796 : cluster [DBG] pgmap v441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:20.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:20 gibba020 bash[25448]: cluster 2021-03-10T14:07:18.940008+0000 mgr.gibba020.yqfnwy (mgr.34427) 796 : cluster [DBG] pgmap v441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:21.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:21 gibba013 bash[29418]: audit 2021-03-10T14:07:20.178972+0000 mon.a (mon.0) 786 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:07:21.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:21 gibba013 bash[29418]: cephadm 2021-03-10T14:07:20.179499+0000 mgr.gibba020.yqfnwy (mgr.34427) 797 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:07:21.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:21 gibba013 bash[29418]: audit 2021-03-10T14:07:20.182979+0000 mon.a (mon.0) 787 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:07:21.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:21 gibba013 bash[30381]: audit 2021-03-10T14:07:20.178972+0000 mon.a (mon.0) 786 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:07:21.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:21 gibba013 bash[30381]: cephadm 2021-03-10T14:07:20.179499+0000 mgr.gibba020.yqfnwy (mgr.34427) 797 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:07:21.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:21 gibba013 bash[30381]: audit 2021-03-10T14:07:20.182979+0000 mon.a (mon.0) 787 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:07:21.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:21 gibba020 bash[25448]: audit 2021-03-10T14:07:20.178972+0000 mon.a (mon.0) 786 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:07:21.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:21 gibba020 bash[25448]: cephadm 2021-03-10T14:07:20.179499+0000 mgr.gibba020.yqfnwy (mgr.34427) 797 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:07:21.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:21 gibba020 bash[25448]: audit 2021-03-10T14:07:20.182979+0000 mon.a (mon.0) 787 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:07:22.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:22 gibba013 bash[29418]: cluster 2021-03-10T14:07:20.941614+0000 mgr.gibba020.yqfnwy (mgr.34427) 798 : cluster [DBG] pgmap v442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:22.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:22 gibba013 bash[30381]: cluster 2021-03-10T14:07:20.941614+0000 mgr.gibba020.yqfnwy (mgr.34427) 798 : cluster [DBG] pgmap v442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:22.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:22 gibba020 bash[25448]: cluster 2021-03-10T14:07:20.941614+0000 mgr.gibba020.yqfnwy (mgr.34427) 798 : cluster [DBG] pgmap v442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:24.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:24 gibba013 bash[29418]: cluster 2021-03-10T14:07:22.942964+0000 mgr.gibba020.yqfnwy (mgr.34427) 799 : cluster [DBG] pgmap v443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:24.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:24 gibba013 bash[29418]: audit 2021-03-10T14:07:23.722999+0000 mon.a (mon.0) 788 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:07:24.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:24 gibba013 bash[29418]: audit 2021-03-10T14:07:23.946273+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:07:24.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:24 gibba013 bash[29418]: audit 2021-03-10T14:07:23.959169+0000 mon.a (mon.0) 790 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:07:24.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:24 gibba013 bash[29418]: audit 2021-03-10T14:07:23.961024+0000 mon.a (mon.0) 791 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:24.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:24 gibba013 bash[29418]: audit 2021-03-10T14:07:23.962522+0000 mon.a (mon.0) 792 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:24.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:24 gibba013 bash[29418]: audit 2021-03-10T14:07:23.964256+0000 mon.a (mon.0) 793 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:24.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:24 gibba013 bash[29418]: audit 2021-03-10T14:07:23.967488+0000 mon.a (mon.0) 794 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:24.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:24 gibba013 bash[29418]: audit 2021-03-10T14:07:23.969462+0000 mon.a (mon.0) 795 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:24.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:24 gibba013 bash[30381]: cluster 2021-03-10T14:07:22.942964+0000 mgr.gibba020.yqfnwy (mgr.34427) 799 : cluster [DBG] pgmap v443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:24.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:24 gibba013 bash[30381]: audit 2021-03-10T14:07:23.722999+0000 mon.a (mon.0) 788 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:07:24.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:24 gibba013 bash[30381]: audit 2021-03-10T14:07:23.946273+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:07:24.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:24 gibba013 bash[30381]: audit 2021-03-10T14:07:23.959169+0000 mon.a (mon.0) 790 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:07:24.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:24 gibba013 bash[30381]: audit 2021-03-10T14:07:23.961024+0000 mon.a (mon.0) 791 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:24.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:24 gibba013 bash[30381]: audit 2021-03-10T14:07:23.962522+0000 mon.a (mon.0) 792 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:24.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:24 gibba013 bash[30381]: audit 2021-03-10T14:07:23.964256+0000 mon.a (mon.0) 793 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:24.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:24 gibba013 bash[30381]: audit 2021-03-10T14:07:23.967488+0000 mon.a (mon.0) 794 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:24.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:24 gibba013 bash[30381]: audit 2021-03-10T14:07:23.969462+0000 mon.a (mon.0) 795 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:24.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:24 gibba020 bash[25448]: cluster 2021-03-10T14:07:22.942964+0000 mgr.gibba020.yqfnwy (mgr.34427) 799 : cluster [DBG] pgmap v443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:24.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:24 gibba020 bash[25448]: audit 2021-03-10T14:07:23.722999+0000 mon.a (mon.0) 788 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:07:24.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:24 gibba020 bash[25448]: audit 2021-03-10T14:07:23.946273+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:07:24.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:24 gibba020 bash[25448]: audit 2021-03-10T14:07:23.959169+0000 mon.a (mon.0) 790 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:07:24.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:24 gibba020 bash[25448]: audit 2021-03-10T14:07:23.961024+0000 mon.a (mon.0) 791 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:24.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:24 gibba020 bash[25448]: audit 2021-03-10T14:07:23.962522+0000 mon.a (mon.0) 792 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:24.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:24 gibba020 bash[25448]: audit 2021-03-10T14:07:23.964256+0000 mon.a (mon.0) 793 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:24.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:24 gibba020 bash[25448]: audit 2021-03-10T14:07:23.967488+0000 mon.a (mon.0) 794 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:24.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:24 gibba020 bash[25448]: audit 2021-03-10T14:07:23.969462+0000 mon.a (mon.0) 795 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:25.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:25 gibba013 bash[29418]: cephadm 2021-03-10T14:07:23.720885+0000 mgr.gibba020.yqfnwy (mgr.34427) 800 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:07:25.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:25 gibba013 bash[29418]: cephadm 2021-03-10T14:07:23.955479+0000 mgr.gibba020.yqfnwy (mgr.34427) 801 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:07:25.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:25 gibba013 bash[29418]: cephadm 2021-03-10T14:07:23.957825+0000 mgr.gibba020.yqfnwy (mgr.34427) 802 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:07:25.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:25 gibba013 bash[29418]: cephadm 2021-03-10T14:07:23.959256+0000 mgr.gibba020.yqfnwy (mgr.34427) 803 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:07:25.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:25 gibba013 bash[29418]: cephadm 2021-03-10T14:07:23.959292+0000 mgr.gibba020.yqfnwy (mgr.34427) 804 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:07:25.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:25 gibba013 bash[29418]: cephadm 2021-03-10T14:07:23.961013+0000 mgr.gibba020.yqfnwy (mgr.34427) 805 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:07:25.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:25 gibba013 bash[29418]: cephadm 2021-03-10T14:07:23.961050+0000 mgr.gibba020.yqfnwy (mgr.34427) 806 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:07:25.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:25 gibba013 bash[29418]: cephadm 2021-03-10T14:07:23.962494+0000 mgr.gibba020.yqfnwy (mgr.34427) 807 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:07:25.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:25 gibba013 bash[29418]: cephadm 2021-03-10T14:07:23.964173+0000 mgr.gibba020.yqfnwy (mgr.34427) 808 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:07:25.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:25 gibba013 bash[29418]: cephadm 2021-03-10T14:07:23.964210+0000 mgr.gibba020.yqfnwy (mgr.34427) 809 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:07:25.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:25 gibba013 bash[29418]: cephadm 2021-03-10T14:07:23.965988+0000 mgr.gibba020.yqfnwy (mgr.34427) 810 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:07:25.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:25 gibba013 bash[29418]: cephadm 2021-03-10T14:07:23.966313+0000 mgr.gibba020.yqfnwy (mgr.34427) 811 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:07:25.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:25 gibba013 bash[29418]: cephadm 2021-03-10T14:07:23.967630+0000 mgr.gibba020.yqfnwy (mgr.34427) 812 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:07:25.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:25 gibba013 bash[29418]: cephadm 2021-03-10T14:07:23.967667+0000 mgr.gibba020.yqfnwy (mgr.34427) 813 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:07:25.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:25 gibba013 bash[29418]: cephadm 2021-03-10T14:07:23.967772+0000 mgr.gibba020.yqfnwy (mgr.34427) 814 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:07:25.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:25 gibba013 bash[30381]: cephadm 2021-03-10T14:07:23.720885+0000 mgr.gibba020.yqfnwy (mgr.34427) 800 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:07:25.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:25 gibba013 bash[30381]: cephadm 2021-03-10T14:07:23.955479+0000 mgr.gibba020.yqfnwy (mgr.34427) 801 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:07:25.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:25 gibba013 bash[30381]: cephadm 2021-03-10T14:07:23.957825+0000 mgr.gibba020.yqfnwy (mgr.34427) 802 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:07:25.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:25 gibba013 bash[30381]: cephadm 2021-03-10T14:07:23.959256+0000 mgr.gibba020.yqfnwy (mgr.34427) 803 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:07:25.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:25 gibba013 bash[30381]: cephadm 2021-03-10T14:07:23.959292+0000 mgr.gibba020.yqfnwy (mgr.34427) 804 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:07:25.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:25 gibba013 bash[30381]: cephadm 2021-03-10T14:07:23.961013+0000 mgr.gibba020.yqfnwy (mgr.34427) 805 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:07:25.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:25 gibba013 bash[30381]: cephadm 2021-03-10T14:07:23.961050+0000 mgr.gibba020.yqfnwy (mgr.34427) 806 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:07:25.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:25 gibba013 bash[30381]: cephadm 2021-03-10T14:07:23.962494+0000 mgr.gibba020.yqfnwy (mgr.34427) 807 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:07:25.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:25 gibba013 bash[30381]: cephadm 2021-03-10T14:07:23.964173+0000 mgr.gibba020.yqfnwy (mgr.34427) 808 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:07:25.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:25 gibba013 bash[30381]: cephadm 2021-03-10T14:07:23.964210+0000 mgr.gibba020.yqfnwy (mgr.34427) 809 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:07:25.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:25 gibba013 bash[30381]: cephadm 2021-03-10T14:07:23.965988+0000 mgr.gibba020.yqfnwy (mgr.34427) 810 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:07:25.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:25 gibba013 bash[30381]: cephadm 2021-03-10T14:07:23.966313+0000 mgr.gibba020.yqfnwy (mgr.34427) 811 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:07:25.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:25 gibba013 bash[30381]: cephadm 2021-03-10T14:07:23.967630+0000 mgr.gibba020.yqfnwy (mgr.34427) 812 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:07:25.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:25 gibba013 bash[30381]: cephadm 2021-03-10T14:07:23.967667+0000 mgr.gibba020.yqfnwy (mgr.34427) 813 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:07:25.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:25 gibba013 bash[30381]: cephadm 2021-03-10T14:07:23.967772+0000 mgr.gibba020.yqfnwy (mgr.34427) 814 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:07:25.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:25 gibba020 bash[25448]: cephadm 2021-03-10T14:07:23.720885+0000 mgr.gibba020.yqfnwy (mgr.34427) 800 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:07:25.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:25 gibba020 bash[25448]: cephadm 2021-03-10T14:07:23.955479+0000 mgr.gibba020.yqfnwy (mgr.34427) 801 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:07:25.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:25 gibba020 bash[25448]: cephadm 2021-03-10T14:07:23.957825+0000 mgr.gibba020.yqfnwy (mgr.34427) 802 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:07:25.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:25 gibba020 bash[25448]: cephadm 2021-03-10T14:07:23.959256+0000 mgr.gibba020.yqfnwy (mgr.34427) 803 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:07:25.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:25 gibba020 bash[25448]: cephadm 2021-03-10T14:07:23.959292+0000 mgr.gibba020.yqfnwy (mgr.34427) 804 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:07:25.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:25 gibba020 bash[25448]: cephadm 2021-03-10T14:07:23.961013+0000 mgr.gibba020.yqfnwy (mgr.34427) 805 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:07:25.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:25 gibba020 bash[25448]: cephadm 2021-03-10T14:07:23.961050+0000 mgr.gibba020.yqfnwy (mgr.34427) 806 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:07:25.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:25 gibba020 bash[25448]: cephadm 2021-03-10T14:07:23.962494+0000 mgr.gibba020.yqfnwy (mgr.34427) 807 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:07:25.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:25 gibba020 bash[25448]: cephadm 2021-03-10T14:07:23.964173+0000 mgr.gibba020.yqfnwy (mgr.34427) 808 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:07:25.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:25 gibba020 bash[25448]: cephadm 2021-03-10T14:07:23.964210+0000 mgr.gibba020.yqfnwy (mgr.34427) 809 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:07:25.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:25 gibba020 bash[25448]: cephadm 2021-03-10T14:07:23.965988+0000 mgr.gibba020.yqfnwy (mgr.34427) 810 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:07:25.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:25 gibba020 bash[25448]: cephadm 2021-03-10T14:07:23.966313+0000 mgr.gibba020.yqfnwy (mgr.34427) 811 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:07:25.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:25 gibba020 bash[25448]: cephadm 2021-03-10T14:07:23.967630+0000 mgr.gibba020.yqfnwy (mgr.34427) 812 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:07:25.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:25 gibba020 bash[25448]: cephadm 2021-03-10T14:07:23.967667+0000 mgr.gibba020.yqfnwy (mgr.34427) 813 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:07:25.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:25 gibba020 bash[25448]: cephadm 2021-03-10T14:07:23.967772+0000 mgr.gibba020.yqfnwy (mgr.34427) 814 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:07:26.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:26 gibba020 bash[25448]: cluster 2021-03-10T14:07:24.944563+0000 mgr.gibba020.yqfnwy (mgr.34427) 815 : cluster [DBG] pgmap v444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:26.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:26 gibba013 bash[30381]: cluster 2021-03-10T14:07:24.944563+0000 mgr.gibba020.yqfnwy (mgr.34427) 815 : cluster [DBG] pgmap v444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:26.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:26 gibba013 bash[29418]: cluster 2021-03-10T14:07:24.944563+0000 mgr.gibba020.yqfnwy (mgr.34427) 815 : cluster [DBG] pgmap v444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:28.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:28 gibba020 bash[25448]: cluster 2021-03-10T14:07:26.946105+0000 mgr.gibba020.yqfnwy (mgr.34427) 816 : cluster [DBG] pgmap v445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:28.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:28 gibba013 bash[29418]: cluster 2021-03-10T14:07:26.946105+0000 mgr.gibba020.yqfnwy (mgr.34427) 816 : cluster [DBG] pgmap v445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:28.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:28 gibba013 bash[30381]: cluster 2021-03-10T14:07:26.946105+0000 mgr.gibba020.yqfnwy (mgr.34427) 816 : cluster [DBG] pgmap v445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:30.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:30 gibba020 bash[25448]: cluster 2021-03-10T14:07:28.947705+0000 mgr.gibba020.yqfnwy (mgr.34427) 817 : cluster [DBG] pgmap v446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:30.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:30 gibba013 bash[29418]: cluster 2021-03-10T14:07:28.947705+0000 mgr.gibba020.yqfnwy (mgr.34427) 817 : cluster [DBG] pgmap v446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:30.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:30 gibba013 bash[30381]: cluster 2021-03-10T14:07:28.947705+0000 mgr.gibba020.yqfnwy (mgr.34427) 817 : cluster [DBG] pgmap v446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:32.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:32 gibba020 bash[25448]: cluster 2021-03-10T14:07:30.949463+0000 mgr.gibba020.yqfnwy (mgr.34427) 818 : cluster [DBG] pgmap v447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:32.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:32 gibba013 bash[29418]: cluster 2021-03-10T14:07:30.949463+0000 mgr.gibba020.yqfnwy (mgr.34427) 818 : cluster [DBG] pgmap v447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:32.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:32 gibba013 bash[30381]: cluster 2021-03-10T14:07:30.949463+0000 mgr.gibba020.yqfnwy (mgr.34427) 818 : cluster [DBG] pgmap v447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:34.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:34 gibba020 bash[25448]: cluster 2021-03-10T14:07:32.950869+0000 mgr.gibba020.yqfnwy (mgr.34427) 819 : cluster [DBG] pgmap v448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:34.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:34 gibba013 bash[29418]: cluster 2021-03-10T14:07:32.950869+0000 mgr.gibba020.yqfnwy (mgr.34427) 819 : cluster [DBG] pgmap v448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:34.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:34 gibba013 bash[30381]: cluster 2021-03-10T14:07:32.950869+0000 mgr.gibba020.yqfnwy (mgr.34427) 819 : cluster [DBG] pgmap v448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:36.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:36 gibba020 bash[25448]: cluster 2021-03-10T14:07:34.952447+0000 mgr.gibba020.yqfnwy (mgr.34427) 820 : cluster [DBG] pgmap v449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:36.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:36 gibba013 bash[29418]: cluster 2021-03-10T14:07:34.952447+0000 mgr.gibba020.yqfnwy (mgr.34427) 820 : cluster [DBG] pgmap v449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:36.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:36 gibba013 bash[30381]: cluster 2021-03-10T14:07:34.952447+0000 mgr.gibba020.yqfnwy (mgr.34427) 820 : cluster [DBG] pgmap v449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:38.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:38 gibba020 bash[25448]: cluster 2021-03-10T14:07:36.953982+0000 mgr.gibba020.yqfnwy (mgr.34427) 821 : cluster [DBG] pgmap v450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:38.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:38 gibba013 bash[29418]: cluster 2021-03-10T14:07:36.953982+0000 mgr.gibba020.yqfnwy (mgr.34427) 821 : cluster [DBG] pgmap v450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:38.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:38 gibba013 bash[30381]: cluster 2021-03-10T14:07:36.953982+0000 mgr.gibba020.yqfnwy (mgr.34427) 821 : cluster [DBG] pgmap v450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:40.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:40 gibba020 bash[25448]: cluster 2021-03-10T14:07:38.955659+0000 mgr.gibba020.yqfnwy (mgr.34427) 822 : cluster [DBG] pgmap v451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:40.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:40 gibba020 bash[25448]: cephadm 2021-03-10T14:07:38.983597+0000 mgr.gibba020.yqfnwy (mgr.34427) 823 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:07:40.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:40 gibba013 bash[29418]: cluster 2021-03-10T14:07:38.955659+0000 mgr.gibba020.yqfnwy (mgr.34427) 822 : cluster [DBG] pgmap v451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:40.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:40 gibba013 bash[29418]: cephadm 2021-03-10T14:07:38.983597+0000 mgr.gibba020.yqfnwy (mgr.34427) 823 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:07:40.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:40 gibba013 bash[30381]: cluster 2021-03-10T14:07:38.955659+0000 mgr.gibba020.yqfnwy (mgr.34427) 822 : cluster [DBG] pgmap v451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:40.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:40 gibba013 bash[30381]: cephadm 2021-03-10T14:07:38.983597+0000 mgr.gibba020.yqfnwy (mgr.34427) 823 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:07:41.418 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:07:41.649 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:07:41.650 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (14m) 17s ago 19m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:07:41.650 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (19m) 9m ago 19m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:07:41.650 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (14m) 9m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:07:41.650 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (14m) 9m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:07:41.651 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (13m) 17s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:07:41.651 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (13m) 17s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:07:41.651 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (13m) 9m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:07:41.651 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (13m) 17s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:07:41.651 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (19m) 17s ago 19m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:07:41.652 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (19m) 9m ago 19m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:07:41.652 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (12m) 17s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:07:41.652 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (12m) 17s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:07:41.652 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (11m) 17s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:07:41.652 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (11m) 17s ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:07:41.653 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (10m) 9m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:07:41.653 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (10m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:07:41.653 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (9m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:07:41.653 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (9m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:07:41.653 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (19m) 9m ago 19m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:07:41.654 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 9m ago 17m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:07:41.904 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:07:41.904 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:07:41.904 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:07:41.905 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:07:41.905 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:07:41.905 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:07:41.905 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:07:41.906 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:07:41.906 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:07:41.906 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:07:41.906 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:07:41.906 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:07:41.907 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:07:41.907 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:07:41.907 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:07:42.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:42 gibba020 bash[25448]: cluster 2021-03-10T14:07:40.957387+0000 mgr.gibba020.yqfnwy (mgr.34427) 824 : cluster [DBG] pgmap v452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:42.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:42 gibba020 bash[25448]: audit 2021-03-10T14:07:41.405118+0000 mgr.gibba020.yqfnwy (mgr.34427) 825 : audit [DBG] from='client.54595 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:07:42.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:42 gibba020 bash[25448]: audit 2021-03-10T14:07:41.903401+0000 mon.c (mon.1) 24 : audit [DBG] from='client.? 172.21.2.113:0/2650871976' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:42.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:42 gibba013 bash[29418]: cluster 2021-03-10T14:07:40.957387+0000 mgr.gibba020.yqfnwy (mgr.34427) 824 : cluster [DBG] pgmap v452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:42.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:42 gibba013 bash[29418]: audit 2021-03-10T14:07:41.405118+0000 mgr.gibba020.yqfnwy (mgr.34427) 825 : audit [DBG] from='client.54595 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:07:42.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:42 gibba013 bash[29418]: audit 2021-03-10T14:07:41.903401+0000 mon.c (mon.1) 24 : audit [DBG] from='client.? 172.21.2.113:0/2650871976' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:42.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:42 gibba013 bash[30381]: cluster 2021-03-10T14:07:40.957387+0000 mgr.gibba020.yqfnwy (mgr.34427) 824 : cluster [DBG] pgmap v452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:42.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:42 gibba013 bash[30381]: audit 2021-03-10T14:07:41.405118+0000 mgr.gibba020.yqfnwy (mgr.34427) 825 : audit [DBG] from='client.54595 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:07:42.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:42 gibba013 bash[30381]: audit 2021-03-10T14:07:41.903401+0000 mon.c (mon.1) 24 : audit [DBG] from='client.? 172.21.2.113:0/2650871976' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:07:43.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:43 gibba013 bash[29418]: audit 2021-03-10T14:07:41.634064+0000 mgr.gibba020.yqfnwy (mgr.34427) 826 : audit [DBG] from='client.54601 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:07:43.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:43 gibba013 bash[30381]: audit 2021-03-10T14:07:41.634064+0000 mgr.gibba020.yqfnwy (mgr.34427) 826 : audit [DBG] from='client.54601 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:07:43.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:43 gibba020 bash[25448]: audit 2021-03-10T14:07:41.634064+0000 mgr.gibba020.yqfnwy (mgr.34427) 826 : audit [DBG] from='client.54601 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:07:44.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:44 gibba013 bash[29418]: cluster 2021-03-10T14:07:42.958614+0000 mgr.gibba020.yqfnwy (mgr.34427) 827 : cluster [DBG] pgmap v453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:44.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:44 gibba013 bash[30381]: cluster 2021-03-10T14:07:42.958614+0000 mgr.gibba020.yqfnwy (mgr.34427) 827 : cluster [DBG] pgmap v453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:44.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:44 gibba020 bash[25448]: cluster 2021-03-10T14:07:42.958614+0000 mgr.gibba020.yqfnwy (mgr.34427) 827 : cluster [DBG] pgmap v453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:46.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:46 gibba013 bash[29418]: cluster 2021-03-10T14:07:44.960180+0000 mgr.gibba020.yqfnwy (mgr.34427) 828 : cluster [DBG] pgmap v454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:46.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:46 gibba013 bash[30381]: cluster 2021-03-10T14:07:44.960180+0000 mgr.gibba020.yqfnwy (mgr.34427) 828 : cluster [DBG] pgmap v454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:46.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:46 gibba020 bash[25448]: cluster 2021-03-10T14:07:44.960180+0000 mgr.gibba020.yqfnwy (mgr.34427) 828 : cluster [DBG] pgmap v454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:48.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:48 gibba013 bash[29418]: cluster 2021-03-10T14:07:46.961774+0000 mgr.gibba020.yqfnwy (mgr.34427) 829 : cluster [DBG] pgmap v455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:48.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:48 gibba013 bash[30381]: cluster 2021-03-10T14:07:46.961774+0000 mgr.gibba020.yqfnwy (mgr.34427) 829 : cluster [DBG] pgmap v455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:48.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:48 gibba020 bash[25448]: cluster 2021-03-10T14:07:46.961774+0000 mgr.gibba020.yqfnwy (mgr.34427) 829 : cluster [DBG] pgmap v455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:50.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:50 gibba013 bash[29418]: cluster 2021-03-10T14:07:48.963316+0000 mgr.gibba020.yqfnwy (mgr.34427) 830 : cluster [DBG] pgmap v456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:50.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:50 gibba013 bash[30381]: cluster 2021-03-10T14:07:48.963316+0000 mgr.gibba020.yqfnwy (mgr.34427) 830 : cluster [DBG] pgmap v456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:50.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:50 gibba020 bash[25448]: cluster 2021-03-10T14:07:48.963316+0000 mgr.gibba020.yqfnwy (mgr.34427) 830 : cluster [DBG] pgmap v456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:52.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:52 gibba013 bash[29418]: cluster 2021-03-10T14:07:50.965059+0000 mgr.gibba020.yqfnwy (mgr.34427) 831 : cluster [DBG] pgmap v457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:52.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:52 gibba013 bash[30381]: cluster 2021-03-10T14:07:50.965059+0000 mgr.gibba020.yqfnwy (mgr.34427) 831 : cluster [DBG] pgmap v457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:52.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:52 gibba020 bash[25448]: cluster 2021-03-10T14:07:50.965059+0000 mgr.gibba020.yqfnwy (mgr.34427) 831 : cluster [DBG] pgmap v457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:54.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:54 gibba013 bash[29418]: cluster 2021-03-10T14:07:52.966455+0000 mgr.gibba020.yqfnwy (mgr.34427) 832 : cluster [DBG] pgmap v458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:54.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:54 gibba013 bash[30381]: cluster 2021-03-10T14:07:52.966455+0000 mgr.gibba020.yqfnwy (mgr.34427) 832 : cluster [DBG] pgmap v458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:54.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:54 gibba020 bash[25448]: cluster 2021-03-10T14:07:52.966455+0000 mgr.gibba020.yqfnwy (mgr.34427) 832 : cluster [DBG] pgmap v458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:55.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:55 gibba013 bash[29418]: cephadm 2021-03-10T14:07:53.999479+0000 mgr.gibba020.yqfnwy (mgr.34427) 833 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:07:55.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:55 gibba013 bash[30381]: cephadm 2021-03-10T14:07:53.999479+0000 mgr.gibba020.yqfnwy (mgr.34427) 833 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:07:55.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:55 gibba020 bash[25448]: cephadm 2021-03-10T14:07:53.999479+0000 mgr.gibba020.yqfnwy (mgr.34427) 833 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:07:56.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:56 gibba013 bash[29418]: cluster 2021-03-10T14:07:54.968039+0000 mgr.gibba020.yqfnwy (mgr.34427) 834 : cluster [DBG] pgmap v459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:56.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:56 gibba013 bash[30381]: cluster 2021-03-10T14:07:54.968039+0000 mgr.gibba020.yqfnwy (mgr.34427) 834 : cluster [DBG] pgmap v459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:56.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:56 gibba020 bash[25448]: cluster 2021-03-10T14:07:54.968039+0000 mgr.gibba020.yqfnwy (mgr.34427) 834 : cluster [DBG] pgmap v459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:58.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:07:58 gibba013 bash[29418]: cluster 2021-03-10T14:07:56.969274+0000 mgr.gibba020.yqfnwy (mgr.34427) 835 : cluster [DBG] pgmap v460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:58.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:07:58 gibba013 bash[30381]: cluster 2021-03-10T14:07:56.969274+0000 mgr.gibba020.yqfnwy (mgr.34427) 835 : cluster [DBG] pgmap v460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:07:58.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:07:58 gibba020 bash[25448]: cluster 2021-03-10T14:07:56.969274+0000 mgr.gibba020.yqfnwy (mgr.34427) 835 : cluster [DBG] pgmap v460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:00.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:00 gibba013 bash[29418]: cluster 2021-03-10T14:07:58.970915+0000 mgr.gibba020.yqfnwy (mgr.34427) 836 : cluster [DBG] pgmap v461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:00.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:00 gibba013 bash[30381]: cluster 2021-03-10T14:07:58.970915+0000 mgr.gibba020.yqfnwy (mgr.34427) 836 : cluster [DBG] pgmap v461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:00.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:00 gibba020 bash[25448]: cluster 2021-03-10T14:07:58.970915+0000 mgr.gibba020.yqfnwy (mgr.34427) 836 : cluster [DBG] pgmap v461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:02.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:02 gibba013 bash[29418]: cluster 2021-03-10T14:08:00.972550+0000 mgr.gibba020.yqfnwy (mgr.34427) 837 : cluster [DBG] pgmap v462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:02.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:02 gibba013 bash[30381]: cluster 2021-03-10T14:08:00.972550+0000 mgr.gibba020.yqfnwy (mgr.34427) 837 : cluster [DBG] pgmap v462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:02.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:02 gibba020 bash[25448]: cluster 2021-03-10T14:08:00.972550+0000 mgr.gibba020.yqfnwy (mgr.34427) 837 : cluster [DBG] pgmap v462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:04.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:04 gibba013 bash[29418]: cluster 2021-03-10T14:08:02.973923+0000 mgr.gibba020.yqfnwy (mgr.34427) 838 : cluster [DBG] pgmap v463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:04.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:04 gibba013 bash[30381]: cluster 2021-03-10T14:08:02.973923+0000 mgr.gibba020.yqfnwy (mgr.34427) 838 : cluster [DBG] pgmap v463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:04.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:04 gibba020 bash[25448]: cluster 2021-03-10T14:08:02.973923+0000 mgr.gibba020.yqfnwy (mgr.34427) 838 : cluster [DBG] pgmap v463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:06.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:06 gibba013 bash[29418]: cluster 2021-03-10T14:08:04.975555+0000 mgr.gibba020.yqfnwy (mgr.34427) 839 : cluster [DBG] pgmap v464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:06.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:06 gibba013 bash[29418]: audit 2021-03-10T14:08:05.855540+0000 mon.a (mon.0) 796 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:08:06.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:06 gibba013 bash[29418]: audit 2021-03-10T14:08:05.856311+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:08:06.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:06 gibba013 bash[29418]: audit 2021-03-10T14:08:05.857046+0000 mon.a (mon.0) 798 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:08:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:06 gibba013 bash[29418]: audit 2021-03-10T14:08:05.857741+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:08:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:06 gibba013 bash[29418]: audit 2021-03-10T14:08:06.023067+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:08:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:06 gibba013 bash[29418]: audit 2021-03-10T14:08:06.024695+0000 mon.a (mon.0) 801 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:08:06.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:06 gibba013 bash[30381]: cluster 2021-03-10T14:08:04.975555+0000 mgr.gibba020.yqfnwy (mgr.34427) 839 : cluster [DBG] pgmap v464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:06.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:06 gibba013 bash[30381]: audit 2021-03-10T14:08:05.855540+0000 mon.a (mon.0) 796 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:08:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:06 gibba013 bash[30381]: audit 2021-03-10T14:08:05.856311+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:08:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:06 gibba013 bash[30381]: audit 2021-03-10T14:08:05.857046+0000 mon.a (mon.0) 798 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:08:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:06 gibba013 bash[30381]: audit 2021-03-10T14:08:05.857741+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:08:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:06 gibba013 bash[30381]: audit 2021-03-10T14:08:06.023067+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:08:06.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:06 gibba013 bash[30381]: audit 2021-03-10T14:08:06.024695+0000 mon.a (mon.0) 801 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:08:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:06 gibba020 bash[25448]: cluster 2021-03-10T14:08:04.975555+0000 mgr.gibba020.yqfnwy (mgr.34427) 839 : cluster [DBG] pgmap v464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:06 gibba020 bash[25448]: audit 2021-03-10T14:08:05.855540+0000 mon.a (mon.0) 796 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:08:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:06 gibba020 bash[25448]: audit 2021-03-10T14:08:05.856311+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:08:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:06 gibba020 bash[25448]: audit 2021-03-10T14:08:05.857046+0000 mon.a (mon.0) 798 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:08:06.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:06 gibba020 bash[25448]: audit 2021-03-10T14:08:05.857741+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:08:06.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:06 gibba020 bash[25448]: audit 2021-03-10T14:08:06.023067+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:08:06.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:06 gibba020 bash[25448]: audit 2021-03-10T14:08:06.024695+0000 mon.a (mon.0) 801 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:08:08.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:08 gibba013 bash[29418]: cluster 2021-03-10T14:08:06.976874+0000 mgr.gibba020.yqfnwy (mgr.34427) 840 : cluster [DBG] pgmap v465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:08.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:08 gibba013 bash[30381]: cluster 2021-03-10T14:08:06.976874+0000 mgr.gibba020.yqfnwy (mgr.34427) 840 : cluster [DBG] pgmap v465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:08.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:08 gibba020 bash[25448]: cluster 2021-03-10T14:08:06.976874+0000 mgr.gibba020.yqfnwy (mgr.34427) 840 : cluster [DBG] pgmap v465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:10.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:10 gibba013 bash[29418]: cluster 2021-03-10T14:08:08.978571+0000 mgr.gibba020.yqfnwy (mgr.34427) 841 : cluster [DBG] pgmap v466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:10.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:10 gibba013 bash[29418]: cephadm 2021-03-10T14:08:09.001594+0000 mgr.gibba020.yqfnwy (mgr.34427) 842 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:08:10.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:10 gibba013 bash[30381]: cluster 2021-03-10T14:08:08.978571+0000 mgr.gibba020.yqfnwy (mgr.34427) 841 : cluster [DBG] pgmap v466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:10.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:10 gibba013 bash[30381]: cephadm 2021-03-10T14:08:09.001594+0000 mgr.gibba020.yqfnwy (mgr.34427) 842 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:08:10.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:10 gibba020 bash[25448]: cluster 2021-03-10T14:08:08.978571+0000 mgr.gibba020.yqfnwy (mgr.34427) 841 : cluster [DBG] pgmap v466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:10.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:10 gibba020 bash[25448]: cephadm 2021-03-10T14:08:09.001594+0000 mgr.gibba020.yqfnwy (mgr.34427) 842 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:08:12.149 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:08:12.373 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:08:12.373 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (14m) 48s ago 20m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:08:12.373 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (19m) 9m ago 19m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:08:12.374 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (15m) 9m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:08:12.374 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (15m) 9m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:08:12.374 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (14m) 48s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:08:12.374 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (14m) 48s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:08:12.375 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (13m) 9m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:08:12.375 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (13m) 48s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:08:12.375 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (20m) 48s ago 20m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:08:12.375 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (20m) 9m ago 20m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:08:12.376 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (13m) 48s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:08:12.376 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (12m) 48s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:08:12.376 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (12m) 48s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:08:12.376 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (11m) 48s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:08:12.376 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (11m) 9m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:08:12.377 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (10m) 9m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:08:12.377 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (10m) 9m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:08:12.377 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (9m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:08:12.377 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (19m) 9m ago 20m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:08:12.378 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 9m ago 18m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:08:12.623 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:08:12.623 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:08:12.623 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:08:12.624 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:08:12.624 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:08:12.624 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:08:12.624 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:08:12.625 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:08:12.625 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:08:12.625 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:08:12.625 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:08:12.626 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:08:12.626 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:08:12.626 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:08:12.626 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:08:12.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:12 gibba013 bash[29418]: cluster 2021-03-10T14:08:10.980165+0000 mgr.gibba020.yqfnwy (mgr.34427) 843 : cluster [DBG] pgmap v467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:12.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:12 gibba013 bash[30381]: cluster 2021-03-10T14:08:10.980165+0000 mgr.gibba020.yqfnwy (mgr.34427) 843 : cluster [DBG] pgmap v467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:12.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:12 gibba020 bash[25448]: cluster 2021-03-10T14:08:10.980165+0000 mgr.gibba020.yqfnwy (mgr.34427) 843 : cluster [DBG] pgmap v467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:13.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:13 gibba013 bash[29418]: audit 2021-03-10T14:08:12.136681+0000 mgr.gibba020.yqfnwy (mgr.34427) 844 : audit [DBG] from='client.54613 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:08:13.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:13 gibba013 bash[29418]: audit 2021-03-10T14:08:12.360627+0000 mgr.gibba020.yqfnwy (mgr.34427) 845 : audit [DBG] from='client.44634 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:08:13.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:13 gibba013 bash[29418]: audit 2021-03-10T14:08:12.622129+0000 mon.a (mon.0) 802 : audit [DBG] from='client.? 172.21.2.113:0/2994915387' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:13.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:13 gibba013 bash[30381]: audit 2021-03-10T14:08:12.136681+0000 mgr.gibba020.yqfnwy (mgr.34427) 844 : audit [DBG] from='client.54613 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:08:13.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:13 gibba013 bash[30381]: audit 2021-03-10T14:08:12.360627+0000 mgr.gibba020.yqfnwy (mgr.34427) 845 : audit [DBG] from='client.44634 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:08:13.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:13 gibba013 bash[30381]: audit 2021-03-10T14:08:12.622129+0000 mon.a (mon.0) 802 : audit [DBG] from='client.? 172.21.2.113:0/2994915387' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:13.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:13 gibba020 bash[25448]: audit 2021-03-10T14:08:12.136681+0000 mgr.gibba020.yqfnwy (mgr.34427) 844 : audit [DBG] from='client.54613 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:08:13.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:13 gibba020 bash[25448]: audit 2021-03-10T14:08:12.360627+0000 mgr.gibba020.yqfnwy (mgr.34427) 845 : audit [DBG] from='client.44634 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:08:13.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:13 gibba020 bash[25448]: audit 2021-03-10T14:08:12.622129+0000 mon.a (mon.0) 802 : audit [DBG] from='client.? 172.21.2.113:0/2994915387' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:14.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:14 gibba013 bash[29418]: cluster 2021-03-10T14:08:12.981277+0000 mgr.gibba020.yqfnwy (mgr.34427) 846 : cluster [DBG] pgmap v468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:14.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:14 gibba013 bash[30381]: cluster 2021-03-10T14:08:12.981277+0000 mgr.gibba020.yqfnwy (mgr.34427) 846 : cluster [DBG] pgmap v468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:14.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:14 gibba020 bash[25448]: cluster 2021-03-10T14:08:12.981277+0000 mgr.gibba020.yqfnwy (mgr.34427) 846 : cluster [DBG] pgmap v468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:16.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:16 gibba013 bash[29418]: cluster 2021-03-10T14:08:14.982942+0000 mgr.gibba020.yqfnwy (mgr.34427) 847 : cluster [DBG] pgmap v469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:16.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:16 gibba013 bash[30381]: cluster 2021-03-10T14:08:14.982942+0000 mgr.gibba020.yqfnwy (mgr.34427) 847 : cluster [DBG] pgmap v469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:16.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:16 gibba020 bash[25448]: cluster 2021-03-10T14:08:14.982942+0000 mgr.gibba020.yqfnwy (mgr.34427) 847 : cluster [DBG] pgmap v469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:18.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:18 gibba013 bash[29418]: cluster 2021-03-10T14:08:16.984331+0000 mgr.gibba020.yqfnwy (mgr.34427) 848 : cluster [DBG] pgmap v470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:18.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:18 gibba013 bash[30381]: cluster 2021-03-10T14:08:16.984331+0000 mgr.gibba020.yqfnwy (mgr.34427) 848 : cluster [DBG] pgmap v470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:18.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:18 gibba020 bash[25448]: cluster 2021-03-10T14:08:16.984331+0000 mgr.gibba020.yqfnwy (mgr.34427) 848 : cluster [DBG] pgmap v470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:20.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:20 gibba013 bash[29418]: cluster 2021-03-10T14:08:18.985972+0000 mgr.gibba020.yqfnwy (mgr.34427) 849 : cluster [DBG] pgmap v471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:20.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:20 gibba013 bash[30381]: cluster 2021-03-10T14:08:18.985972+0000 mgr.gibba020.yqfnwy (mgr.34427) 849 : cluster [DBG] pgmap v471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:20.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:20 gibba020 bash[25448]: cluster 2021-03-10T14:08:18.985972+0000 mgr.gibba020.yqfnwy (mgr.34427) 849 : cluster [DBG] pgmap v471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:22.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:22 gibba020 bash[25448]: cluster 2021-03-10T14:08:20.987538+0000 mgr.gibba020.yqfnwy (mgr.34427) 850 : cluster [DBG] pgmap v472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:22.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:22 gibba013 bash[29418]: cluster 2021-03-10T14:08:20.987538+0000 mgr.gibba020.yqfnwy (mgr.34427) 850 : cluster [DBG] pgmap v472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:22.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:22 gibba013 bash[30381]: cluster 2021-03-10T14:08:20.987538+0000 mgr.gibba020.yqfnwy (mgr.34427) 850 : cluster [DBG] pgmap v472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:24.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:24 gibba020 bash[25448]: cluster 2021-03-10T14:08:22.988949+0000 mgr.gibba020.yqfnwy (mgr.34427) 851 : cluster [DBG] pgmap v473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:24.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:24 gibba020 bash[25448]: audit 2021-03-10T14:08:24.020744+0000 mon.a (mon.0) 803 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:08:24.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:24 gibba020 bash[25448]: audit 2021-03-10T14:08:24.029864+0000 mon.a (mon.0) 804 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:08:24.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:24 gibba013 bash[29418]: cluster 2021-03-10T14:08:22.988949+0000 mgr.gibba020.yqfnwy (mgr.34427) 851 : cluster [DBG] pgmap v473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:24.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:24 gibba013 bash[29418]: audit 2021-03-10T14:08:24.020744+0000 mon.a (mon.0) 803 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:08:24.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:24 gibba013 bash[29418]: audit 2021-03-10T14:08:24.029864+0000 mon.a (mon.0) 804 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:08:24.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:24 gibba013 bash[30381]: cluster 2021-03-10T14:08:22.988949+0000 mgr.gibba020.yqfnwy (mgr.34427) 851 : cluster [DBG] pgmap v473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:24.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:24 gibba013 bash[30381]: audit 2021-03-10T14:08:24.020744+0000 mon.a (mon.0) 803 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:08:24.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:24 gibba013 bash[30381]: audit 2021-03-10T14:08:24.029864+0000 mon.a (mon.0) 804 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:08:25.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:25 gibba020 bash[25448]: cephadm 2021-03-10T14:08:24.025644+0000 mgr.gibba020.yqfnwy (mgr.34427) 852 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:08:25.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:25 gibba013 bash[29418]: cephadm 2021-03-10T14:08:24.025644+0000 mgr.gibba020.yqfnwy (mgr.34427) 852 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:08:25.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:25 gibba013 bash[30381]: cephadm 2021-03-10T14:08:24.025644+0000 mgr.gibba020.yqfnwy (mgr.34427) 852 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:08:26.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:26 gibba020 bash[25448]: cluster 2021-03-10T14:08:24.990654+0000 mgr.gibba020.yqfnwy (mgr.34427) 853 : cluster [DBG] pgmap v474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:26.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:26 gibba013 bash[29418]: cluster 2021-03-10T14:08:24.990654+0000 mgr.gibba020.yqfnwy (mgr.34427) 853 : cluster [DBG] pgmap v474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:26.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:26 gibba013 bash[30381]: cluster 2021-03-10T14:08:24.990654+0000 mgr.gibba020.yqfnwy (mgr.34427) 853 : cluster [DBG] pgmap v474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:28.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:28 gibba020 bash[25448]: cluster 2021-03-10T14:08:26.991133+0000 mgr.gibba020.yqfnwy (mgr.34427) 854 : cluster [DBG] pgmap v475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:28.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:28 gibba020 bash[25448]: audit 2021-03-10T14:08:27.783157+0000 mon.a (mon.0) 805 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:08:28.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:28 gibba020 bash[25448]: audit 2021-03-10T14:08:27.977828+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:08:28.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:28 gibba020 bash[25448]: audit 2021-03-10T14:08:27.981369+0000 mon.a (mon.0) 807 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:08:28.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:28 gibba020 bash[25448]: audit 2021-03-10T14:08:27.983110+0000 mon.a (mon.0) 808 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:28.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:28 gibba020 bash[25448]: audit 2021-03-10T14:08:27.985085+0000 mon.a (mon.0) 809 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:28.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:28 gibba020 bash[25448]: audit 2021-03-10T14:08:27.986899+0000 mon.a (mon.0) 810 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:28.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:28 gibba020 bash[25448]: audit 2021-03-10T14:08:27.990266+0000 mon.a (mon.0) 811 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:28.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:28 gibba020 bash[25448]: audit 2021-03-10T14:08:27.992165+0000 mon.a (mon.0) 812 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:28.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:28 gibba013 bash[29418]: cluster 2021-03-10T14:08:26.991133+0000 mgr.gibba020.yqfnwy (mgr.34427) 854 : cluster [DBG] pgmap v475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:28.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:28 gibba013 bash[29418]: audit 2021-03-10T14:08:27.783157+0000 mon.a (mon.0) 805 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:08:28.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:28 gibba013 bash[29418]: audit 2021-03-10T14:08:27.977828+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:08:28.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:28 gibba013 bash[29418]: audit 2021-03-10T14:08:27.981369+0000 mon.a (mon.0) 807 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:08:28.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:28 gibba013 bash[29418]: audit 2021-03-10T14:08:27.983110+0000 mon.a (mon.0) 808 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:28.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:28 gibba013 bash[29418]: audit 2021-03-10T14:08:27.985085+0000 mon.a (mon.0) 809 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:28.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:28 gibba013 bash[29418]: audit 2021-03-10T14:08:27.986899+0000 mon.a (mon.0) 810 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:28.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:28 gibba013 bash[29418]: audit 2021-03-10T14:08:27.990266+0000 mon.a (mon.0) 811 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:28.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:28 gibba013 bash[29418]: audit 2021-03-10T14:08:27.992165+0000 mon.a (mon.0) 812 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:28.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:28 gibba013 bash[30381]: cluster 2021-03-10T14:08:26.991133+0000 mgr.gibba020.yqfnwy (mgr.34427) 854 : cluster [DBG] pgmap v475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:28.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:28 gibba013 bash[30381]: audit 2021-03-10T14:08:27.783157+0000 mon.a (mon.0) 805 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:08:28.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:28 gibba013 bash[30381]: audit 2021-03-10T14:08:27.977828+0000 mon.a (mon.0) 806 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:08:28.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:28 gibba013 bash[30381]: audit 2021-03-10T14:08:27.981369+0000 mon.a (mon.0) 807 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:08:28.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:28 gibba013 bash[30381]: audit 2021-03-10T14:08:27.983110+0000 mon.a (mon.0) 808 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:28.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:28 gibba013 bash[30381]: audit 2021-03-10T14:08:27.985085+0000 mon.a (mon.0) 809 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:28.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:28 gibba013 bash[30381]: audit 2021-03-10T14:08:27.986899+0000 mon.a (mon.0) 810 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:28.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:28 gibba013 bash[30381]: audit 2021-03-10T14:08:27.990266+0000 mon.a (mon.0) 811 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:28.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:28 gibba013 bash[30381]: audit 2021-03-10T14:08:27.992165+0000 mon.a (mon.0) 812 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:29.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:29 gibba020 bash[25448]: cephadm 2021-03-10T14:08:27.781687+0000 mgr.gibba020.yqfnwy (mgr.34427) 855 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:08:29.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:29 gibba020 bash[25448]: cephadm 2021-03-10T14:08:27.978234+0000 mgr.gibba020.yqfnwy (mgr.34427) 856 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:08:29.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:29 gibba020 bash[25448]: cephadm 2021-03-10T14:08:27.980353+0000 mgr.gibba020.yqfnwy (mgr.34427) 857 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:08:29.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:29 gibba020 bash[25448]: cephadm 2021-03-10T14:08:27.982022+0000 mgr.gibba020.yqfnwy (mgr.34427) 858 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:08:29.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:29 gibba020 bash[25448]: cephadm 2021-03-10T14:08:27.982095+0000 mgr.gibba020.yqfnwy (mgr.34427) 859 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:08:29.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:29 gibba020 bash[25448]: cephadm 2021-03-10T14:08:27.984027+0000 mgr.gibba020.yqfnwy (mgr.34427) 860 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:08:29.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:29 gibba020 bash[25448]: cephadm 2021-03-10T14:08:27.984097+0000 mgr.gibba020.yqfnwy (mgr.34427) 861 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:08:29.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:29 gibba020 bash[25448]: cephadm 2021-03-10T14:08:27.985707+0000 mgr.gibba020.yqfnwy (mgr.34427) 862 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:08:29.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:29 gibba020 bash[25448]: cephadm 2021-03-10T14:08:27.987432+0000 mgr.gibba020.yqfnwy (mgr.34427) 863 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:08:29.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:29 gibba020 bash[25448]: cephadm 2021-03-10T14:08:27.987466+0000 mgr.gibba020.yqfnwy (mgr.34427) 864 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:08:29.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:29 gibba020 bash[25448]: cephadm 2021-03-10T14:08:27.989144+0000 mgr.gibba020.yqfnwy (mgr.34427) 865 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:08:29.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:29 gibba020 bash[25448]: cephadm 2021-03-10T14:08:27.989449+0000 mgr.gibba020.yqfnwy (mgr.34427) 866 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:08:29.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:29 gibba020 bash[25448]: cephadm 2021-03-10T14:08:27.991153+0000 mgr.gibba020.yqfnwy (mgr.34427) 867 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:08:29.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:29 gibba020 bash[25448]: cephadm 2021-03-10T14:08:27.991186+0000 mgr.gibba020.yqfnwy (mgr.34427) 868 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:08:29.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:29 gibba020 bash[25448]: cephadm 2021-03-10T14:08:27.991284+0000 mgr.gibba020.yqfnwy (mgr.34427) 869 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:08:29.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:29 gibba013 bash[29418]: cephadm 2021-03-10T14:08:27.781687+0000 mgr.gibba020.yqfnwy (mgr.34427) 855 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:08:29.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:29 gibba013 bash[29418]: cephadm 2021-03-10T14:08:27.978234+0000 mgr.gibba020.yqfnwy (mgr.34427) 856 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:08:29.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:29 gibba013 bash[29418]: cephadm 2021-03-10T14:08:27.980353+0000 mgr.gibba020.yqfnwy (mgr.34427) 857 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:08:29.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:29 gibba013 bash[29418]: cephadm 2021-03-10T14:08:27.982022+0000 mgr.gibba020.yqfnwy (mgr.34427) 858 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:08:29.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:29 gibba013 bash[29418]: cephadm 2021-03-10T14:08:27.982095+0000 mgr.gibba020.yqfnwy (mgr.34427) 859 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:08:29.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:29 gibba013 bash[29418]: cephadm 2021-03-10T14:08:27.984027+0000 mgr.gibba020.yqfnwy (mgr.34427) 860 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:08:29.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:29 gibba013 bash[29418]: cephadm 2021-03-10T14:08:27.984097+0000 mgr.gibba020.yqfnwy (mgr.34427) 861 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:08:29.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:29 gibba013 bash[29418]: cephadm 2021-03-10T14:08:27.985707+0000 mgr.gibba020.yqfnwy (mgr.34427) 862 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:08:29.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:29 gibba013 bash[29418]: cephadm 2021-03-10T14:08:27.987432+0000 mgr.gibba020.yqfnwy (mgr.34427) 863 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:08:29.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:29 gibba013 bash[29418]: cephadm 2021-03-10T14:08:27.987466+0000 mgr.gibba020.yqfnwy (mgr.34427) 864 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:08:29.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:29 gibba013 bash[29418]: cephadm 2021-03-10T14:08:27.989144+0000 mgr.gibba020.yqfnwy (mgr.34427) 865 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:08:29.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:29 gibba013 bash[29418]: cephadm 2021-03-10T14:08:27.989449+0000 mgr.gibba020.yqfnwy (mgr.34427) 866 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:08:29.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:29 gibba013 bash[29418]: cephadm 2021-03-10T14:08:27.991153+0000 mgr.gibba020.yqfnwy (mgr.34427) 867 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:08:29.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:29 gibba013 bash[29418]: cephadm 2021-03-10T14:08:27.991186+0000 mgr.gibba020.yqfnwy (mgr.34427) 868 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:08:29.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:29 gibba013 bash[29418]: cephadm 2021-03-10T14:08:27.991284+0000 mgr.gibba020.yqfnwy (mgr.34427) 869 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:08:29.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:29 gibba013 bash[30381]: cephadm 2021-03-10T14:08:27.781687+0000 mgr.gibba020.yqfnwy (mgr.34427) 855 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:08:29.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:29 gibba013 bash[30381]: cephadm 2021-03-10T14:08:27.978234+0000 mgr.gibba020.yqfnwy (mgr.34427) 856 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:08:29.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:29 gibba013 bash[30381]: cephadm 2021-03-10T14:08:27.980353+0000 mgr.gibba020.yqfnwy (mgr.34427) 857 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:08:29.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:29 gibba013 bash[30381]: cephadm 2021-03-10T14:08:27.982022+0000 mgr.gibba020.yqfnwy (mgr.34427) 858 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:08:29.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:29 gibba013 bash[30381]: cephadm 2021-03-10T14:08:27.982095+0000 mgr.gibba020.yqfnwy (mgr.34427) 859 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:08:29.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:29 gibba013 bash[30381]: cephadm 2021-03-10T14:08:27.984027+0000 mgr.gibba020.yqfnwy (mgr.34427) 860 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:08:29.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:29 gibba013 bash[30381]: cephadm 2021-03-10T14:08:27.984097+0000 mgr.gibba020.yqfnwy (mgr.34427) 861 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:08:29.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:29 gibba013 bash[30381]: cephadm 2021-03-10T14:08:27.985707+0000 mgr.gibba020.yqfnwy (mgr.34427) 862 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:08:29.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:29 gibba013 bash[30381]: cephadm 2021-03-10T14:08:27.987432+0000 mgr.gibba020.yqfnwy (mgr.34427) 863 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:08:29.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:29 gibba013 bash[30381]: cephadm 2021-03-10T14:08:27.987466+0000 mgr.gibba020.yqfnwy (mgr.34427) 864 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:08:29.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:29 gibba013 bash[30381]: cephadm 2021-03-10T14:08:27.989144+0000 mgr.gibba020.yqfnwy (mgr.34427) 865 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:08:29.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:29 gibba013 bash[30381]: cephadm 2021-03-10T14:08:27.989449+0000 mgr.gibba020.yqfnwy (mgr.34427) 866 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:08:29.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:29 gibba013 bash[30381]: cephadm 2021-03-10T14:08:27.991153+0000 mgr.gibba020.yqfnwy (mgr.34427) 867 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:08:29.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:29 gibba013 bash[30381]: cephadm 2021-03-10T14:08:27.991186+0000 mgr.gibba020.yqfnwy (mgr.34427) 868 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:08:29.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:29 gibba013 bash[30381]: cephadm 2021-03-10T14:08:27.991284+0000 mgr.gibba020.yqfnwy (mgr.34427) 869 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:08:30.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:30 gibba020 bash[25448]: cluster 2021-03-10T14:08:28.992736+0000 mgr.gibba020.yqfnwy (mgr.34427) 870 : cluster [DBG] pgmap v476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:30.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:30 gibba013 bash[29418]: cluster 2021-03-10T14:08:28.992736+0000 mgr.gibba020.yqfnwy (mgr.34427) 870 : cluster [DBG] pgmap v476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:30.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:30 gibba013 bash[30381]: cluster 2021-03-10T14:08:28.992736+0000 mgr.gibba020.yqfnwy (mgr.34427) 870 : cluster [DBG] pgmap v476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:32.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:32 gibba020 bash[25448]: cluster 2021-03-10T14:08:30.994608+0000 mgr.gibba020.yqfnwy (mgr.34427) 871 : cluster [DBG] pgmap v477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:32.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:32 gibba013 bash[29418]: cluster 2021-03-10T14:08:30.994608+0000 mgr.gibba020.yqfnwy (mgr.34427) 871 : cluster [DBG] pgmap v477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:32.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:32 gibba013 bash[30381]: cluster 2021-03-10T14:08:30.994608+0000 mgr.gibba020.yqfnwy (mgr.34427) 871 : cluster [DBG] pgmap v477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:34.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:34 gibba013 bash[29418]: cluster 2021-03-10T14:08:32.995985+0000 mgr.gibba020.yqfnwy (mgr.34427) 872 : cluster [DBG] pgmap v478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:34.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:34 gibba013 bash[30381]: cluster 2021-03-10T14:08:32.995985+0000 mgr.gibba020.yqfnwy (mgr.34427) 872 : cluster [DBG] pgmap v478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:34.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:34 gibba020 bash[25448]: cluster 2021-03-10T14:08:32.995985+0000 mgr.gibba020.yqfnwy (mgr.34427) 872 : cluster [DBG] pgmap v478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:36.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:36 gibba013 bash[29418]: cluster 2021-03-10T14:08:34.997617+0000 mgr.gibba020.yqfnwy (mgr.34427) 873 : cluster [DBG] pgmap v479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:36.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:36 gibba013 bash[30381]: cluster 2021-03-10T14:08:34.997617+0000 mgr.gibba020.yqfnwy (mgr.34427) 873 : cluster [DBG] pgmap v479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:36.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:36 gibba020 bash[25448]: cluster 2021-03-10T14:08:34.997617+0000 mgr.gibba020.yqfnwy (mgr.34427) 873 : cluster [DBG] pgmap v479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:38.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:38 gibba013 bash[29418]: cluster 2021-03-10T14:08:36.998968+0000 mgr.gibba020.yqfnwy (mgr.34427) 874 : cluster [DBG] pgmap v480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:38.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:38 gibba013 bash[30381]: cluster 2021-03-10T14:08:36.998968+0000 mgr.gibba020.yqfnwy (mgr.34427) 874 : cluster [DBG] pgmap v480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:38.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:38 gibba020 bash[25448]: cluster 2021-03-10T14:08:36.998968+0000 mgr.gibba020.yqfnwy (mgr.34427) 874 : cluster [DBG] pgmap v480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:40.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:40 gibba013 bash[29418]: cluster 2021-03-10T14:08:39.000609+0000 mgr.gibba020.yqfnwy (mgr.34427) 875 : cluster [DBG] pgmap v481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:40.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:40 gibba013 bash[30381]: cluster 2021-03-10T14:08:39.000609+0000 mgr.gibba020.yqfnwy (mgr.34427) 875 : cluster [DBG] pgmap v481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:40.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:40 gibba020 bash[25448]: cluster 2021-03-10T14:08:39.000609+0000 mgr.gibba020.yqfnwy (mgr.34427) 875 : cluster [DBG] pgmap v481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:41.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:41 gibba013 bash[29418]: cluster 2021-03-10T14:08:41.002198+0000 mgr.gibba020.yqfnwy (mgr.34427) 876 : cluster [DBG] pgmap v482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:41.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:41 gibba013 bash[30381]: cluster 2021-03-10T14:08:41.002198+0000 mgr.gibba020.yqfnwy (mgr.34427) 876 : cluster [DBG] pgmap v482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:41.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:41 gibba020 bash[25448]: cluster 2021-03-10T14:08:41.002198+0000 mgr.gibba020.yqfnwy (mgr.34427) 876 : cluster [DBG] pgmap v482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:42.866 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:08:43.092 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:08:43.092 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (15m) 79s ago 20m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:08:43.093 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (20m) 15s ago 20m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:08:43.093 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (15m) 15s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:08:43.093 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (15m) 15s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:08:43.093 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (14m) 79s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:08:43.093 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (14m) 79s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:08:43.094 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (14m) 15s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:08:43.094 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (14m) 79s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:08:43.094 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (20m) 79s ago 20m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:08:43.094 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (20m) 15s ago 20m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:08:43.094 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (13m) 79s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:08:43.095 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (13m) 79s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:08:43.095 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (12m) 79s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:08:43.095 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (12m) 79s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:08:43.095 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (11m) 15s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:08:43.095 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (11m) 15s ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:08:43.096 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (10m) 15s ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:08:43.096 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (10m) 15s ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:08:43.096 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (20m) 15s ago 20m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:08:43.096 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 15s ago 18m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:08:43.348 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:08:43.349 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:08:43.349 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:08:43.349 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:08:43.349 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:08:43.349 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:08:43.350 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:08:43.350 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:08:43.350 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:08:43.350 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:08:43.350 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:08:43.351 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:08:43.351 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:08:43.351 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:08:43.351 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:08:44.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:44 gibba013 bash[29418]: audit 2021-03-10T14:08:42.854241+0000 mgr.gibba020.yqfnwy (mgr.34427) 877 : audit [DBG] from='client.44646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:08:44.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:44 gibba013 bash[29418]: cephadm 2021-03-10T14:08:42.997519+0000 mgr.gibba020.yqfnwy (mgr.34427) 878 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:08:44.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:44 gibba013 bash[29418]: cluster 2021-03-10T14:08:43.003433+0000 mgr.gibba020.yqfnwy (mgr.34427) 879 : cluster [DBG] pgmap v483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:44.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:44 gibba013 bash[29418]: audit 2021-03-10T14:08:43.078606+0000 mgr.gibba020.yqfnwy (mgr.34427) 880 : audit [DBG] from='client.44652 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:08:44.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:44 gibba013 bash[29418]: audit 2021-03-10T14:08:43.347590+0000 mon.a (mon.0) 813 : audit [DBG] from='client.? 172.21.2.113:0/4053852683' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:44.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:44 gibba013 bash[30381]: audit 2021-03-10T14:08:42.854241+0000 mgr.gibba020.yqfnwy (mgr.34427) 877 : audit [DBG] from='client.44646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:08:44.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:44 gibba013 bash[30381]: cephadm 2021-03-10T14:08:42.997519+0000 mgr.gibba020.yqfnwy (mgr.34427) 878 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:08:44.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:44 gibba013 bash[30381]: cluster 2021-03-10T14:08:43.003433+0000 mgr.gibba020.yqfnwy (mgr.34427) 879 : cluster [DBG] pgmap v483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:44.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:44 gibba013 bash[30381]: audit 2021-03-10T14:08:43.078606+0000 mgr.gibba020.yqfnwy (mgr.34427) 880 : audit [DBG] from='client.44652 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:08:44.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:44 gibba013 bash[30381]: audit 2021-03-10T14:08:43.347590+0000 mon.a (mon.0) 813 : audit [DBG] from='client.? 172.21.2.113:0/4053852683' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:44.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:44 gibba020 bash[25448]: audit 2021-03-10T14:08:42.854241+0000 mgr.gibba020.yqfnwy (mgr.34427) 877 : audit [DBG] from='client.44646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:08:44.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:44 gibba020 bash[25448]: cephadm 2021-03-10T14:08:42.997519+0000 mgr.gibba020.yqfnwy (mgr.34427) 878 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:08:44.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:44 gibba020 bash[25448]: cluster 2021-03-10T14:08:43.003433+0000 mgr.gibba020.yqfnwy (mgr.34427) 879 : cluster [DBG] pgmap v483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:44.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:44 gibba020 bash[25448]: audit 2021-03-10T14:08:43.078606+0000 mgr.gibba020.yqfnwy (mgr.34427) 880 : audit [DBG] from='client.44652 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:08:44.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:44 gibba020 bash[25448]: audit 2021-03-10T14:08:43.347590+0000 mon.a (mon.0) 813 : audit [DBG] from='client.? 172.21.2.113:0/4053852683' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:08:46.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:46 gibba013 bash[29418]: cluster 2021-03-10T14:08:45.005139+0000 mgr.gibba020.yqfnwy (mgr.34427) 881 : cluster [DBG] pgmap v484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:46.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:46 gibba013 bash[30381]: cluster 2021-03-10T14:08:45.005139+0000 mgr.gibba020.yqfnwy (mgr.34427) 881 : cluster [DBG] pgmap v484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:46.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:46 gibba020 bash[25448]: cluster 2021-03-10T14:08:45.005139+0000 mgr.gibba020.yqfnwy (mgr.34427) 881 : cluster [DBG] pgmap v484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:48.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:48 gibba013 bash[29418]: cluster 2021-03-10T14:08:47.006495+0000 mgr.gibba020.yqfnwy (mgr.34427) 882 : cluster [DBG] pgmap v485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:48.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:48 gibba013 bash[30381]: cluster 2021-03-10T14:08:47.006495+0000 mgr.gibba020.yqfnwy (mgr.34427) 882 : cluster [DBG] pgmap v485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:48.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:48 gibba020 bash[25448]: cluster 2021-03-10T14:08:47.006495+0000 mgr.gibba020.yqfnwy (mgr.34427) 882 : cluster [DBG] pgmap v485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:50.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:50 gibba013 bash[29418]: cluster 2021-03-10T14:08:49.007984+0000 mgr.gibba020.yqfnwy (mgr.34427) 883 : cluster [DBG] pgmap v486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:50.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:50 gibba013 bash[30381]: cluster 2021-03-10T14:08:49.007984+0000 mgr.gibba020.yqfnwy (mgr.34427) 883 : cluster [DBG] pgmap v486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:50.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:50 gibba020 bash[25448]: cluster 2021-03-10T14:08:49.007984+0000 mgr.gibba020.yqfnwy (mgr.34427) 883 : cluster [DBG] pgmap v486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:52.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:52 gibba013 bash[29418]: cluster 2021-03-10T14:08:51.009843+0000 mgr.gibba020.yqfnwy (mgr.34427) 884 : cluster [DBG] pgmap v487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:52.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:52 gibba013 bash[30381]: cluster 2021-03-10T14:08:51.009843+0000 mgr.gibba020.yqfnwy (mgr.34427) 884 : cluster [DBG] pgmap v487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:52.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:52 gibba020 bash[25448]: cluster 2021-03-10T14:08:51.009843+0000 mgr.gibba020.yqfnwy (mgr.34427) 884 : cluster [DBG] pgmap v487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:54.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:54 gibba020 bash[25448]: cluster 2021-03-10T14:08:53.011193+0000 mgr.gibba020.yqfnwy (mgr.34427) 885 : cluster [DBG] pgmap v488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:54.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:54 gibba013 bash[29418]: cluster 2021-03-10T14:08:53.011193+0000 mgr.gibba020.yqfnwy (mgr.34427) 885 : cluster [DBG] pgmap v488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:54.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:54 gibba013 bash[30381]: cluster 2021-03-10T14:08:53.011193+0000 mgr.gibba020.yqfnwy (mgr.34427) 885 : cluster [DBG] pgmap v488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:56.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:56 gibba020 bash[25448]: cluster 2021-03-10T14:08:55.012887+0000 mgr.gibba020.yqfnwy (mgr.34427) 886 : cluster [DBG] pgmap v489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:56.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:56 gibba013 bash[29418]: cluster 2021-03-10T14:08:55.012887+0000 mgr.gibba020.yqfnwy (mgr.34427) 886 : cluster [DBG] pgmap v489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:56.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:56 gibba013 bash[30381]: cluster 2021-03-10T14:08:55.012887+0000 mgr.gibba020.yqfnwy (mgr.34427) 886 : cluster [DBG] pgmap v489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:58.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:58 gibba020 bash[25448]: cluster 2021-03-10T14:08:57.014047+0000 mgr.gibba020.yqfnwy (mgr.34427) 887 : cluster [DBG] pgmap v490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:58.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:58 gibba013 bash[29418]: cluster 2021-03-10T14:08:57.014047+0000 mgr.gibba020.yqfnwy (mgr.34427) 887 : cluster [DBG] pgmap v490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:58.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:58 gibba013 bash[30381]: cluster 2021-03-10T14:08:57.014047+0000 mgr.gibba020.yqfnwy (mgr.34427) 887 : cluster [DBG] pgmap v490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:08:59.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:08:59 gibba020 bash[25448]: cephadm 2021-03-10T14:08:58.013563+0000 mgr.gibba020.yqfnwy (mgr.34427) 888 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:08:59.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:08:59 gibba013 bash[29418]: cephadm 2021-03-10T14:08:58.013563+0000 mgr.gibba020.yqfnwy (mgr.34427) 888 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:08:59.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:08:59 gibba013 bash[30381]: cephadm 2021-03-10T14:08:58.013563+0000 mgr.gibba020.yqfnwy (mgr.34427) 888 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:09:00.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:00 gibba020 bash[25448]: cluster 2021-03-10T14:08:59.015698+0000 mgr.gibba020.yqfnwy (mgr.34427) 889 : cluster [DBG] pgmap v491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:00.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:00 gibba013 bash[29418]: cluster 2021-03-10T14:08:59.015698+0000 mgr.gibba020.yqfnwy (mgr.34427) 889 : cluster [DBG] pgmap v491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:00.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:00 gibba013 bash[30381]: cluster 2021-03-10T14:08:59.015698+0000 mgr.gibba020.yqfnwy (mgr.34427) 889 : cluster [DBG] pgmap v491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:02.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:02 gibba020 bash[25448]: cluster 2021-03-10T14:09:01.017543+0000 mgr.gibba020.yqfnwy (mgr.34427) 890 : cluster [DBG] pgmap v492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:02.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:02 gibba013 bash[29418]: cluster 2021-03-10T14:09:01.017543+0000 mgr.gibba020.yqfnwy (mgr.34427) 890 : cluster [DBG] pgmap v492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:02.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:02 gibba013 bash[30381]: cluster 2021-03-10T14:09:01.017543+0000 mgr.gibba020.yqfnwy (mgr.34427) 890 : cluster [DBG] pgmap v492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:04.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:04 gibba020 bash[25448]: cluster 2021-03-10T14:09:03.018937+0000 mgr.gibba020.yqfnwy (mgr.34427) 891 : cluster [DBG] pgmap v493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:04.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:04 gibba013 bash[29418]: cluster 2021-03-10T14:09:03.018937+0000 mgr.gibba020.yqfnwy (mgr.34427) 891 : cluster [DBG] pgmap v493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:04.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:04 gibba013 bash[30381]: cluster 2021-03-10T14:09:03.018937+0000 mgr.gibba020.yqfnwy (mgr.34427) 891 : cluster [DBG] pgmap v493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:06.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:06 gibba020 bash[25448]: cluster 2021-03-10T14:09:05.020651+0000 mgr.gibba020.yqfnwy (mgr.34427) 892 : cluster [DBG] pgmap v494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:06.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:06 gibba020 bash[25448]: audit 2021-03-10T14:09:05.864886+0000 mon.a (mon.0) 814 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:09:06.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:06 gibba020 bash[25448]: audit 2021-03-10T14:09:05.865944+0000 mon.a (mon.0) 815 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T14:09:06.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:06 gibba020 bash[25448]: audit 2021-03-10T14:09:05.866692+0000 mon.a (mon.0) 816 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:09:06.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:06 gibba020 bash[25448]: audit 2021-03-10T14:09:05.867347+0000 mon.a (mon.0) 817 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:09:06.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:06 gibba020 bash[25448]: audit 2021-03-10T14:09:06.029044+0000 mon.a (mon.0) 818 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:09:06.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:06 gibba020 bash[25448]: audit 2021-03-10T14:09:06.031041+0000 mon.a (mon.0) 819 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:09:06.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:06 gibba013 bash[29418]: cluster 2021-03-10T14:09:05.020651+0000 mgr.gibba020.yqfnwy (mgr.34427) 892 : cluster [DBG] pgmap v494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:06.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:06 gibba013 bash[29418]: audit 2021-03-10T14:09:05.864886+0000 mon.a (mon.0) 814 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:09:06.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:06 gibba013 bash[29418]: audit 2021-03-10T14:09:05.865944+0000 mon.a (mon.0) 815 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T14:09:06.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:06 gibba013 bash[29418]: audit 2021-03-10T14:09:05.866692+0000 mon.a (mon.0) 816 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:09:06.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:06 gibba013 bash[29418]: audit 2021-03-10T14:09:05.867347+0000 mon.a (mon.0) 817 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:09:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:06 gibba013 bash[29418]: audit 2021-03-10T14:09:06.029044+0000 mon.a (mon.0) 818 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:09:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:06 gibba013 bash[29418]: audit 2021-03-10T14:09:06.031041+0000 mon.a (mon.0) 819 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:09:06.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:06 gibba013 bash[30381]: cluster 2021-03-10T14:09:05.020651+0000 mgr.gibba020.yqfnwy (mgr.34427) 892 : cluster [DBG] pgmap v494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:06.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:06 gibba013 bash[30381]: audit 2021-03-10T14:09:05.864886+0000 mon.a (mon.0) 814 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:09:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:06 gibba013 bash[30381]: audit 2021-03-10T14:09:05.865944+0000 mon.a (mon.0) 815 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T14:09:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:06 gibba013 bash[30381]: audit 2021-03-10T14:09:05.866692+0000 mon.a (mon.0) 816 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:09:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:06 gibba013 bash[30381]: audit 2021-03-10T14:09:05.867347+0000 mon.a (mon.0) 817 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:09:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:06 gibba013 bash[30381]: audit 2021-03-10T14:09:06.029044+0000 mon.a (mon.0) 818 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:09:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:06 gibba013 bash[30381]: audit 2021-03-10T14:09:06.031041+0000 mon.a (mon.0) 819 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:09:08.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:08 gibba013 bash[29418]: cluster 2021-03-10T14:09:07.021980+0000 mgr.gibba020.yqfnwy (mgr.34427) 893 : cluster [DBG] pgmap v495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:08.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:08 gibba013 bash[30381]: cluster 2021-03-10T14:09:07.021980+0000 mgr.gibba020.yqfnwy (mgr.34427) 893 : cluster [DBG] pgmap v495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:08.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:08 gibba020 bash[25448]: cluster 2021-03-10T14:09:07.021980+0000 mgr.gibba020.yqfnwy (mgr.34427) 893 : cluster [DBG] pgmap v495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:10.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:10 gibba013 bash[29418]: cluster 2021-03-10T14:09:09.023614+0000 mgr.gibba020.yqfnwy (mgr.34427) 894 : cluster [DBG] pgmap v496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:10.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:10 gibba013 bash[30381]: cluster 2021-03-10T14:09:09.023614+0000 mgr.gibba020.yqfnwy (mgr.34427) 894 : cluster [DBG] pgmap v496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:10.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:10 gibba020 bash[25448]: cluster 2021-03-10T14:09:09.023614+0000 mgr.gibba020.yqfnwy (mgr.34427) 894 : cluster [DBG] pgmap v496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:12.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:12 gibba013 bash[29418]: cluster 2021-03-10T14:09:11.025467+0000 mgr.gibba020.yqfnwy (mgr.34427) 895 : cluster [DBG] pgmap v497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:12.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:12 gibba013 bash[30381]: cluster 2021-03-10T14:09:11.025467+0000 mgr.gibba020.yqfnwy (mgr.34427) 895 : cluster [DBG] pgmap v497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:12.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:12 gibba020 bash[25448]: cluster 2021-03-10T14:09:11.025467+0000 mgr.gibba020.yqfnwy (mgr.34427) 895 : cluster [DBG] pgmap v497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:13.592 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:09:13.823 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:09:13.823 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (15m) 110s ago 21m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:09:13.824 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (20m) 46s ago 20m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:09:13.824 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (16m) 46s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:09:13.824 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (16m) 46s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:09:13.824 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (15m) 110s ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:09:13.824 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (15m) 110s ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:09:13.825 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (14m) 46s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:09:13.825 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (14m) 110s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:09:13.825 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (21m) 110s ago 21m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:09:13.825 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (21m) 46s ago 21m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:09:13.825 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (14m) 110s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:09:13.826 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (13m) 110s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:09:13.826 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (13m) 110s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:09:13.826 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (12m) 110s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:09:13.826 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (12m) 46s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:09:13.826 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (11m) 46s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:09:13.827 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (11m) 46s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:09:13.827 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (10m) 46s ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:09:13.827 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (20m) 46s ago 21m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:09:13.827 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 46s ago 19m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:09:14.071 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:09:14.072 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:09:14.072 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:09:14.072 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:09:14.072 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:09:14.073 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:09:14.073 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:09:14.073 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:09:14.073 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:09:14.073 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:09:14.074 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:09:14.074 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:09:14.074 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:09:14.074 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:09:14.074 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:09:14.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:14 gibba013 bash[29418]: cluster 2021-03-10T14:09:13.026839+0000 mgr.gibba020.yqfnwy (mgr.34427) 896 : cluster [DBG] pgmap v498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:14.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:14 gibba013 bash[29418]: cephadm 2021-03-10T14:09:13.029575+0000 mgr.gibba020.yqfnwy (mgr.34427) 897 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:09:14.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:14 gibba013 bash[29418]: audit 2021-03-10T14:09:14.070678+0000 mon.c (mon.1) 25 : audit [DBG] from='client.? 172.21.2.113:0/1792587599' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:14.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:14 gibba013 bash[30381]: cluster 2021-03-10T14:09:13.026839+0000 mgr.gibba020.yqfnwy (mgr.34427) 896 : cluster [DBG] pgmap v498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:14.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:14 gibba013 bash[30381]: cephadm 2021-03-10T14:09:13.029575+0000 mgr.gibba020.yqfnwy (mgr.34427) 897 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:09:14.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:14 gibba013 bash[30381]: audit 2021-03-10T14:09:14.070678+0000 mon.c (mon.1) 25 : audit [DBG] from='client.? 172.21.2.113:0/1792587599' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:14.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:14 gibba020 bash[25448]: cluster 2021-03-10T14:09:13.026839+0000 mgr.gibba020.yqfnwy (mgr.34427) 896 : cluster [DBG] pgmap v498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:14.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:14 gibba020 bash[25448]: cephadm 2021-03-10T14:09:13.029575+0000 mgr.gibba020.yqfnwy (mgr.34427) 897 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:09:14.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:14 gibba020 bash[25448]: audit 2021-03-10T14:09:14.070678+0000 mon.c (mon.1) 25 : audit [DBG] from='client.? 172.21.2.113:0/1792587599' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:15.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:15 gibba013 bash[29418]: audit 2021-03-10T14:09:13.579698+0000 mgr.gibba020.yqfnwy (mgr.34427) 898 : audit [DBG] from='client.44664 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:09:15.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:15 gibba013 bash[29418]: audit 2021-03-10T14:09:13.807325+0000 mgr.gibba020.yqfnwy (mgr.34427) 899 : audit [DBG] from='client.44670 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:09:15.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:15 gibba013 bash[30381]: audit 2021-03-10T14:09:13.579698+0000 mgr.gibba020.yqfnwy (mgr.34427) 898 : audit [DBG] from='client.44664 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:09:15.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:15 gibba013 bash[30381]: audit 2021-03-10T14:09:13.807325+0000 mgr.gibba020.yqfnwy (mgr.34427) 899 : audit [DBG] from='client.44670 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:09:15.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:15 gibba020 bash[25448]: audit 2021-03-10T14:09:13.579698+0000 mgr.gibba020.yqfnwy (mgr.34427) 898 : audit [DBG] from='client.44664 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:09:15.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:15 gibba020 bash[25448]: audit 2021-03-10T14:09:13.807325+0000 mgr.gibba020.yqfnwy (mgr.34427) 899 : audit [DBG] from='client.44670 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:09:16.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:16 gibba013 bash[30381]: cluster 2021-03-10T14:09:15.028545+0000 mgr.gibba020.yqfnwy (mgr.34427) 900 : cluster [DBG] pgmap v499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:16.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:16 gibba013 bash[29418]: cluster 2021-03-10T14:09:15.028545+0000 mgr.gibba020.yqfnwy (mgr.34427) 900 : cluster [DBG] pgmap v499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:16.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:16 gibba020 bash[25448]: cluster 2021-03-10T14:09:15.028545+0000 mgr.gibba020.yqfnwy (mgr.34427) 900 : cluster [DBG] pgmap v499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:18.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:18 gibba013 bash[29418]: cluster 2021-03-10T14:09:17.029872+0000 mgr.gibba020.yqfnwy (mgr.34427) 901 : cluster [DBG] pgmap v500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:18.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:18 gibba013 bash[30381]: cluster 2021-03-10T14:09:17.029872+0000 mgr.gibba020.yqfnwy (mgr.34427) 901 : cluster [DBG] pgmap v500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:18.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:18 gibba020 bash[25448]: cluster 2021-03-10T14:09:17.029872+0000 mgr.gibba020.yqfnwy (mgr.34427) 901 : cluster [DBG] pgmap v500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:20.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:20 gibba013 bash[29418]: cluster 2021-03-10T14:09:19.031507+0000 mgr.gibba020.yqfnwy (mgr.34427) 902 : cluster [DBG] pgmap v501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:20.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:20 gibba013 bash[30381]: cluster 2021-03-10T14:09:19.031507+0000 mgr.gibba020.yqfnwy (mgr.34427) 902 : cluster [DBG] pgmap v501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:20.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:20 gibba020 bash[25448]: cluster 2021-03-10T14:09:19.031507+0000 mgr.gibba020.yqfnwy (mgr.34427) 902 : cluster [DBG] pgmap v501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:22.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:22 gibba013 bash[29418]: cluster 2021-03-10T14:09:21.033105+0000 mgr.gibba020.yqfnwy (mgr.34427) 903 : cluster [DBG] pgmap v502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:22.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:22 gibba013 bash[30381]: cluster 2021-03-10T14:09:21.033105+0000 mgr.gibba020.yqfnwy (mgr.34427) 903 : cluster [DBG] pgmap v502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:22.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:22 gibba020 bash[25448]: cluster 2021-03-10T14:09:21.033105+0000 mgr.gibba020.yqfnwy (mgr.34427) 903 : cluster [DBG] pgmap v502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:24.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:24 gibba013 bash[29418]: cluster 2021-03-10T14:09:23.034308+0000 mgr.gibba020.yqfnwy (mgr.34427) 904 : cluster [DBG] pgmap v503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:24.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:24 gibba013 bash[30381]: cluster 2021-03-10T14:09:23.034308+0000 mgr.gibba020.yqfnwy (mgr.34427) 904 : cluster [DBG] pgmap v503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:24.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:24 gibba020 bash[25448]: cluster 2021-03-10T14:09:23.034308+0000 mgr.gibba020.yqfnwy (mgr.34427) 904 : cluster [DBG] pgmap v503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:26.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:26 gibba013 bash[30381]: cluster 2021-03-10T14:09:25.036049+0000 mgr.gibba020.yqfnwy (mgr.34427) 905 : cluster [DBG] pgmap v504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:26.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:26 gibba013 bash[29418]: cluster 2021-03-10T14:09:25.036049+0000 mgr.gibba020.yqfnwy (mgr.34427) 905 : cluster [DBG] pgmap v504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:26.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:26 gibba020 bash[25448]: cluster 2021-03-10T14:09:25.036049+0000 mgr.gibba020.yqfnwy (mgr.34427) 905 : cluster [DBG] pgmap v504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:28.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:28 gibba013 bash[29418]: cluster 2021-03-10T14:09:27.037463+0000 mgr.gibba020.yqfnwy (mgr.34427) 906 : cluster [DBG] pgmap v505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:28.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:28 gibba013 bash[29418]: audit 2021-03-10T14:09:28.047791+0000 mon.a (mon.0) 820 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:09:28.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:28 gibba013 bash[29418]: audit 2021-03-10T14:09:28.245441+0000 mon.a (mon.0) 821 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:09:28.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:28 gibba013 bash[29418]: audit 2021-03-10T14:09:28.248827+0000 mon.a (mon.0) 822 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:09:28.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:28 gibba013 bash[29418]: audit 2021-03-10T14:09:28.250248+0000 mon.a (mon.0) 823 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:28.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:28 gibba013 bash[29418]: audit 2021-03-10T14:09:28.251583+0000 mon.a (mon.0) 824 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:28.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:28 gibba013 bash[29418]: audit 2021-03-10T14:09:28.252949+0000 mon.a (mon.0) 825 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:28.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:28 gibba013 bash[29418]: audit 2021-03-10T14:09:28.255594+0000 mon.a (mon.0) 826 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:28.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:28 gibba013 bash[29418]: audit 2021-03-10T14:09:28.256964+0000 mon.a (mon.0) 827 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:28.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:28 gibba013 bash[30381]: cluster 2021-03-10T14:09:27.037463+0000 mgr.gibba020.yqfnwy (mgr.34427) 906 : cluster [DBG] pgmap v505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:28.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:28 gibba013 bash[30381]: audit 2021-03-10T14:09:28.047791+0000 mon.a (mon.0) 820 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:09:28.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:28 gibba013 bash[30381]: audit 2021-03-10T14:09:28.245441+0000 mon.a (mon.0) 821 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:09:28.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:28 gibba013 bash[30381]: audit 2021-03-10T14:09:28.248827+0000 mon.a (mon.0) 822 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:09:28.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:28 gibba013 bash[30381]: audit 2021-03-10T14:09:28.250248+0000 mon.a (mon.0) 823 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:28.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:28 gibba013 bash[30381]: audit 2021-03-10T14:09:28.251583+0000 mon.a (mon.0) 824 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:28.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:28 gibba013 bash[30381]: audit 2021-03-10T14:09:28.252949+0000 mon.a (mon.0) 825 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:28.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:28 gibba013 bash[30381]: audit 2021-03-10T14:09:28.255594+0000 mon.a (mon.0) 826 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:28.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:28 gibba013 bash[30381]: audit 2021-03-10T14:09:28.256964+0000 mon.a (mon.0) 827 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:28.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:28 gibba020 bash[25448]: cluster 2021-03-10T14:09:27.037463+0000 mgr.gibba020.yqfnwy (mgr.34427) 906 : cluster [DBG] pgmap v505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:28.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:28 gibba020 bash[25448]: audit 2021-03-10T14:09:28.047791+0000 mon.a (mon.0) 820 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:09:28.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:28 gibba020 bash[25448]: audit 2021-03-10T14:09:28.245441+0000 mon.a (mon.0) 821 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:09:28.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:28 gibba020 bash[25448]: audit 2021-03-10T14:09:28.248827+0000 mon.a (mon.0) 822 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:09:28.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:28 gibba020 bash[25448]: audit 2021-03-10T14:09:28.250248+0000 mon.a (mon.0) 823 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:28.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:28 gibba020 bash[25448]: audit 2021-03-10T14:09:28.251583+0000 mon.a (mon.0) 824 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:28.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:28 gibba020 bash[25448]: audit 2021-03-10T14:09:28.252949+0000 mon.a (mon.0) 825 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:28.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:28 gibba020 bash[25448]: audit 2021-03-10T14:09:28.255594+0000 mon.a (mon.0) 826 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:28.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:28 gibba020 bash[25448]: audit 2021-03-10T14:09:28.256964+0000 mon.a (mon.0) 827 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:29.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:29 gibba013 bash[29418]: cephadm 2021-03-10T14:09:28.050877+0000 mgr.gibba020.yqfnwy (mgr.34427) 907 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:09:29.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:29 gibba013 bash[29418]: cephadm 2021-03-10T14:09:28.051750+0000 mgr.gibba020.yqfnwy (mgr.34427) 908 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:09:29.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:29 gibba013 bash[29418]: cephadm 2021-03-10T14:09:28.245865+0000 mgr.gibba020.yqfnwy (mgr.34427) 909 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:09:29.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:29 gibba013 bash[29418]: cephadm 2021-03-10T14:09:28.247795+0000 mgr.gibba020.yqfnwy (mgr.34427) 910 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:09:29.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:29 gibba013 bash[29418]: cephadm 2021-03-10T14:09:28.249110+0000 mgr.gibba020.yqfnwy (mgr.34427) 911 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:09:29.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:29 gibba013 bash[29418]: cephadm 2021-03-10T14:09:28.249147+0000 mgr.gibba020.yqfnwy (mgr.34427) 912 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:09:29.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:29 gibba013 bash[29418]: cephadm 2021-03-10T14:09:28.250387+0000 mgr.gibba020.yqfnwy (mgr.34427) 913 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:09:29.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:29 gibba013 bash[29418]: cephadm 2021-03-10T14:09:28.250425+0000 mgr.gibba020.yqfnwy (mgr.34427) 914 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:09:29.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:29 gibba013 bash[29418]: cephadm 2021-03-10T14:09:28.251628+0000 mgr.gibba020.yqfnwy (mgr.34427) 915 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:09:29.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:29 gibba013 bash[29418]: cephadm 2021-03-10T14:09:28.252887+0000 mgr.gibba020.yqfnwy (mgr.34427) 916 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:09:29.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:29 gibba013 bash[29418]: cephadm 2021-03-10T14:09:28.252922+0000 mgr.gibba020.yqfnwy (mgr.34427) 917 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:09:29.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:29 gibba013 bash[29418]: cephadm 2021-03-10T14:09:28.254336+0000 mgr.gibba020.yqfnwy (mgr.34427) 918 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:09:29.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:29 gibba013 bash[29418]: cephadm 2021-03-10T14:09:28.254649+0000 mgr.gibba020.yqfnwy (mgr.34427) 919 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:09:29.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:29 gibba013 bash[29418]: cephadm 2021-03-10T14:09:28.255549+0000 mgr.gibba020.yqfnwy (mgr.34427) 920 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:09:29.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:29 gibba013 bash[29418]: cephadm 2021-03-10T14:09:28.255584+0000 mgr.gibba020.yqfnwy (mgr.34427) 921 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:09:29.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:29 gibba013 bash[29418]: cephadm 2021-03-10T14:09:28.255689+0000 mgr.gibba020.yqfnwy (mgr.34427) 922 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:09:29.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:29 gibba013 bash[30381]: cephadm 2021-03-10T14:09:28.050877+0000 mgr.gibba020.yqfnwy (mgr.34427) 907 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:09:29.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:29 gibba013 bash[30381]: cephadm 2021-03-10T14:09:28.051750+0000 mgr.gibba020.yqfnwy (mgr.34427) 908 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:09:29.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:29 gibba013 bash[30381]: cephadm 2021-03-10T14:09:28.245865+0000 mgr.gibba020.yqfnwy (mgr.34427) 909 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:09:29.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:29 gibba013 bash[30381]: cephadm 2021-03-10T14:09:28.247795+0000 mgr.gibba020.yqfnwy (mgr.34427) 910 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:09:29.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:29 gibba013 bash[30381]: cephadm 2021-03-10T14:09:28.249110+0000 mgr.gibba020.yqfnwy (mgr.34427) 911 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:09:29.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:29 gibba013 bash[30381]: cephadm 2021-03-10T14:09:28.249147+0000 mgr.gibba020.yqfnwy (mgr.34427) 912 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:09:29.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:29 gibba013 bash[30381]: cephadm 2021-03-10T14:09:28.250387+0000 mgr.gibba020.yqfnwy (mgr.34427) 913 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:09:29.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:29 gibba013 bash[30381]: cephadm 2021-03-10T14:09:28.250425+0000 mgr.gibba020.yqfnwy (mgr.34427) 914 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:09:29.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:29 gibba013 bash[30381]: cephadm 2021-03-10T14:09:28.251628+0000 mgr.gibba020.yqfnwy (mgr.34427) 915 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:09:29.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:29 gibba013 bash[30381]: cephadm 2021-03-10T14:09:28.252887+0000 mgr.gibba020.yqfnwy (mgr.34427) 916 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:09:29.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:29 gibba013 bash[30381]: cephadm 2021-03-10T14:09:28.252922+0000 mgr.gibba020.yqfnwy (mgr.34427) 917 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:09:29.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:29 gibba013 bash[30381]: cephadm 2021-03-10T14:09:28.254336+0000 mgr.gibba020.yqfnwy (mgr.34427) 918 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:09:29.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:29 gibba013 bash[30381]: cephadm 2021-03-10T14:09:28.254649+0000 mgr.gibba020.yqfnwy (mgr.34427) 919 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:09:29.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:29 gibba013 bash[30381]: cephadm 2021-03-10T14:09:28.255549+0000 mgr.gibba020.yqfnwy (mgr.34427) 920 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:09:29.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:29 gibba013 bash[30381]: cephadm 2021-03-10T14:09:28.255584+0000 mgr.gibba020.yqfnwy (mgr.34427) 921 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:09:29.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:29 gibba013 bash[30381]: cephadm 2021-03-10T14:09:28.255689+0000 mgr.gibba020.yqfnwy (mgr.34427) 922 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:09:29.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:29 gibba020 bash[25448]: cephadm 2021-03-10T14:09:28.050877+0000 mgr.gibba020.yqfnwy (mgr.34427) 907 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:09:29.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:29 gibba020 bash[25448]: cephadm 2021-03-10T14:09:28.051750+0000 mgr.gibba020.yqfnwy (mgr.34427) 908 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:09:29.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:29 gibba020 bash[25448]: cephadm 2021-03-10T14:09:28.245865+0000 mgr.gibba020.yqfnwy (mgr.34427) 909 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:09:29.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:29 gibba020 bash[25448]: cephadm 2021-03-10T14:09:28.247795+0000 mgr.gibba020.yqfnwy (mgr.34427) 910 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:09:29.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:29 gibba020 bash[25448]: cephadm 2021-03-10T14:09:28.249110+0000 mgr.gibba020.yqfnwy (mgr.34427) 911 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:09:29.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:29 gibba020 bash[25448]: cephadm 2021-03-10T14:09:28.249147+0000 mgr.gibba020.yqfnwy (mgr.34427) 912 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:09:29.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:29 gibba020 bash[25448]: cephadm 2021-03-10T14:09:28.250387+0000 mgr.gibba020.yqfnwy (mgr.34427) 913 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:09:29.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:29 gibba020 bash[25448]: cephadm 2021-03-10T14:09:28.250425+0000 mgr.gibba020.yqfnwy (mgr.34427) 914 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:09:29.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:29 gibba020 bash[25448]: cephadm 2021-03-10T14:09:28.251628+0000 mgr.gibba020.yqfnwy (mgr.34427) 915 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:09:29.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:29 gibba020 bash[25448]: cephadm 2021-03-10T14:09:28.252887+0000 mgr.gibba020.yqfnwy (mgr.34427) 916 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:09:29.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:29 gibba020 bash[25448]: cephadm 2021-03-10T14:09:28.252922+0000 mgr.gibba020.yqfnwy (mgr.34427) 917 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:09:29.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:29 gibba020 bash[25448]: cephadm 2021-03-10T14:09:28.254336+0000 mgr.gibba020.yqfnwy (mgr.34427) 918 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:09:29.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:29 gibba020 bash[25448]: cephadm 2021-03-10T14:09:28.254649+0000 mgr.gibba020.yqfnwy (mgr.34427) 919 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:09:29.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:29 gibba020 bash[25448]: cephadm 2021-03-10T14:09:28.255549+0000 mgr.gibba020.yqfnwy (mgr.34427) 920 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:09:29.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:29 gibba020 bash[25448]: cephadm 2021-03-10T14:09:28.255584+0000 mgr.gibba020.yqfnwy (mgr.34427) 921 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:09:29.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:29 gibba020 bash[25448]: cephadm 2021-03-10T14:09:28.255689+0000 mgr.gibba020.yqfnwy (mgr.34427) 922 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:09:30.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:30 gibba013 bash[29418]: cluster 2021-03-10T14:09:29.039103+0000 mgr.gibba020.yqfnwy (mgr.34427) 923 : cluster [DBG] pgmap v506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:30.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:30 gibba013 bash[30381]: cluster 2021-03-10T14:09:29.039103+0000 mgr.gibba020.yqfnwy (mgr.34427) 923 : cluster [DBG] pgmap v506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:30.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:30 gibba020 bash[25448]: cluster 2021-03-10T14:09:29.039103+0000 mgr.gibba020.yqfnwy (mgr.34427) 923 : cluster [DBG] pgmap v506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:32.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:32 gibba013 bash[29418]: cluster 2021-03-10T14:09:31.040877+0000 mgr.gibba020.yqfnwy (mgr.34427) 924 : cluster [DBG] pgmap v507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:32.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:32 gibba013 bash[30381]: cluster 2021-03-10T14:09:31.040877+0000 mgr.gibba020.yqfnwy (mgr.34427) 924 : cluster [DBG] pgmap v507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:32.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:32 gibba020 bash[25448]: cluster 2021-03-10T14:09:31.040877+0000 mgr.gibba020.yqfnwy (mgr.34427) 924 : cluster [DBG] pgmap v507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:34.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:34 gibba013 bash[29418]: cluster 2021-03-10T14:09:33.041663+0000 mgr.gibba020.yqfnwy (mgr.34427) 925 : cluster [DBG] pgmap v508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:34.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:34 gibba013 bash[30381]: cluster 2021-03-10T14:09:33.041663+0000 mgr.gibba020.yqfnwy (mgr.34427) 925 : cluster [DBG] pgmap v508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:34.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:34 gibba020 bash[25448]: cluster 2021-03-10T14:09:33.041663+0000 mgr.gibba020.yqfnwy (mgr.34427) 925 : cluster [DBG] pgmap v508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:36.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:36 gibba013 bash[29418]: cluster 2021-03-10T14:09:35.043259+0000 mgr.gibba020.yqfnwy (mgr.34427) 926 : cluster [DBG] pgmap v509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:36.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:36 gibba013 bash[30381]: cluster 2021-03-10T14:09:35.043259+0000 mgr.gibba020.yqfnwy (mgr.34427) 926 : cluster [DBG] pgmap v509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:36.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:36 gibba020 bash[25448]: cluster 2021-03-10T14:09:35.043259+0000 mgr.gibba020.yqfnwy (mgr.34427) 926 : cluster [DBG] pgmap v509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:38.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:38 gibba013 bash[29418]: cluster 2021-03-10T14:09:37.044662+0000 mgr.gibba020.yqfnwy (mgr.34427) 927 : cluster [DBG] pgmap v510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:38.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:38 gibba013 bash[30381]: cluster 2021-03-10T14:09:37.044662+0000 mgr.gibba020.yqfnwy (mgr.34427) 927 : cluster [DBG] pgmap v510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:38.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:38 gibba020 bash[25448]: cluster 2021-03-10T14:09:37.044662+0000 mgr.gibba020.yqfnwy (mgr.34427) 927 : cluster [DBG] pgmap v510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:40.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:40 gibba013 bash[29418]: cluster 2021-03-10T14:09:39.046432+0000 mgr.gibba020.yqfnwy (mgr.34427) 928 : cluster [DBG] pgmap v511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:40.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:40 gibba013 bash[30381]: cluster 2021-03-10T14:09:39.046432+0000 mgr.gibba020.yqfnwy (mgr.34427) 928 : cluster [DBG] pgmap v511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:40.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:40 gibba020 bash[25448]: cluster 2021-03-10T14:09:39.046432+0000 mgr.gibba020.yqfnwy (mgr.34427) 928 : cluster [DBG] pgmap v511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:42.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:42 gibba013 bash[29418]: cluster 2021-03-10T14:09:41.048218+0000 mgr.gibba020.yqfnwy (mgr.34427) 929 : cluster [DBG] pgmap v512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:42.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:42 gibba013 bash[30381]: cluster 2021-03-10T14:09:41.048218+0000 mgr.gibba020.yqfnwy (mgr.34427) 929 : cluster [DBG] pgmap v512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:42.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:42 gibba020 bash[25448]: cluster 2021-03-10T14:09:41.048218+0000 mgr.gibba020.yqfnwy (mgr.34427) 929 : cluster [DBG] pgmap v512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:44.318 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:09:44.546 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:09:44.582 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (16m) 2m ago 21m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:09:44.583 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (21m) 76s ago 21m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:09:44.583 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (16m) 76s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:09:44.583 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (16m) 76s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:09:44.584 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (15m) 2m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:09:44.584 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (15m) 2m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:09:44.584 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (15m) 76s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:09:44.584 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (15m) 2m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:09:44.585 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (21m) 2m ago 21m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:09:44.585 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (21m) 76s ago 21m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:09:44.586 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (14m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:09:44.586 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (14m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:09:44.586 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (13m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:09:44.587 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (13m) 2m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:09:44.587 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (12m) 76s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:09:44.587 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (12m) 76s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:09:44.588 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (11m) 76s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:09:44.588 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (11m) 76s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:09:44.588 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (21m) 76s ago 21m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:09:44.589 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 76s ago 19m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:09:44.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:44 gibba013 bash[29418]: cluster 2021-03-10T14:09:43.048637+0000 mgr.gibba020.yqfnwy (mgr.34427) 930 : cluster [DBG] pgmap v513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:44.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:44 gibba013 bash[29418]: cephadm 2021-03-10T14:09:43.271423+0000 mgr.gibba020.yqfnwy (mgr.34427) 931 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:09:44.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:44 gibba013 bash[30381]: cluster 2021-03-10T14:09:43.048637+0000 mgr.gibba020.yqfnwy (mgr.34427) 930 : cluster [DBG] pgmap v513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:44.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:44 gibba013 bash[30381]: cephadm 2021-03-10T14:09:43.271423+0000 mgr.gibba020.yqfnwy (mgr.34427) 931 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:09:44.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:44 gibba020 bash[25448]: cluster 2021-03-10T14:09:43.048637+0000 mgr.gibba020.yqfnwy (mgr.34427) 930 : cluster [DBG] pgmap v513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:44.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:44 gibba020 bash[25448]: cephadm 2021-03-10T14:09:43.271423+0000 mgr.gibba020.yqfnwy (mgr.34427) 931 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:09:44.798 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:09:44.798 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:09:44.799 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:09:44.799 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:09:44.799 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:09:44.799 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:09:44.799 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:09:44.800 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:09:44.800 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:09:44.800 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:09:44.800 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:09:44.801 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:09:44.801 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:09:44.801 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:09:44.801 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:09:45.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:45 gibba013 bash[29418]: audit 2021-03-10T14:09:44.305554+0000 mgr.gibba020.yqfnwy (mgr.34427) 932 : audit [DBG] from='client.54667 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:09:45.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:45 gibba013 bash[29418]: audit 2021-03-10T14:09:44.796962+0000 mon.c (mon.1) 26 : audit [DBG] from='client.? 172.21.2.113:0/241672465' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:45.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:45 gibba013 bash[30381]: audit 2021-03-10T14:09:44.305554+0000 mgr.gibba020.yqfnwy (mgr.34427) 932 : audit [DBG] from='client.54667 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:09:45.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:45 gibba013 bash[30381]: audit 2021-03-10T14:09:44.796962+0000 mon.c (mon.1) 26 : audit [DBG] from='client.? 172.21.2.113:0/241672465' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:45.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:45 gibba020 bash[25448]: audit 2021-03-10T14:09:44.305554+0000 mgr.gibba020.yqfnwy (mgr.34427) 932 : audit [DBG] from='client.54667 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:09:45.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:45 gibba020 bash[25448]: audit 2021-03-10T14:09:44.796962+0000 mon.c (mon.1) 26 : audit [DBG] from='client.? 172.21.2.113:0/241672465' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:09:46.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:46 gibba020 bash[25448]: audit 2021-03-10T14:09:44.530306+0000 mgr.gibba020.yqfnwy (mgr.34427) 933 : audit [DBG] from='client.54673 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:09:46.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:46 gibba020 bash[25448]: cluster 2021-03-10T14:09:45.050242+0000 mgr.gibba020.yqfnwy (mgr.34427) 934 : cluster [DBG] pgmap v514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:46.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:46 gibba013 bash[29418]: audit 2021-03-10T14:09:44.530306+0000 mgr.gibba020.yqfnwy (mgr.34427) 933 : audit [DBG] from='client.54673 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:09:46.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:46 gibba013 bash[29418]: cluster 2021-03-10T14:09:45.050242+0000 mgr.gibba020.yqfnwy (mgr.34427) 934 : cluster [DBG] pgmap v514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:46.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:46 gibba013 bash[30381]: audit 2021-03-10T14:09:44.530306+0000 mgr.gibba020.yqfnwy (mgr.34427) 933 : audit [DBG] from='client.54673 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:09:46.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:46 gibba013 bash[30381]: cluster 2021-03-10T14:09:45.050242+0000 mgr.gibba020.yqfnwy (mgr.34427) 934 : cluster [DBG] pgmap v514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:48.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:48 gibba020 bash[25448]: cluster 2021-03-10T14:09:47.051446+0000 mgr.gibba020.yqfnwy (mgr.34427) 935 : cluster [DBG] pgmap v515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:48.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:48 gibba013 bash[29418]: cluster 2021-03-10T14:09:47.051446+0000 mgr.gibba020.yqfnwy (mgr.34427) 935 : cluster [DBG] pgmap v515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:48.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:48 gibba013 bash[30381]: cluster 2021-03-10T14:09:47.051446+0000 mgr.gibba020.yqfnwy (mgr.34427) 935 : cluster [DBG] pgmap v515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:50.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:50 gibba020 bash[25448]: cluster 2021-03-10T14:09:49.053048+0000 mgr.gibba020.yqfnwy (mgr.34427) 936 : cluster [DBG] pgmap v516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:50.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:50 gibba013 bash[29418]: cluster 2021-03-10T14:09:49.053048+0000 mgr.gibba020.yqfnwy (mgr.34427) 936 : cluster [DBG] pgmap v516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:50.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:50 gibba013 bash[30381]: cluster 2021-03-10T14:09:49.053048+0000 mgr.gibba020.yqfnwy (mgr.34427) 936 : cluster [DBG] pgmap v516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:52.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:52 gibba020 bash[25448]: cluster 2021-03-10T14:09:51.054753+0000 mgr.gibba020.yqfnwy (mgr.34427) 937 : cluster [DBG] pgmap v517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:52.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:52 gibba013 bash[29418]: cluster 2021-03-10T14:09:51.054753+0000 mgr.gibba020.yqfnwy (mgr.34427) 937 : cluster [DBG] pgmap v517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:52.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:52 gibba013 bash[30381]: cluster 2021-03-10T14:09:51.054753+0000 mgr.gibba020.yqfnwy (mgr.34427) 937 : cluster [DBG] pgmap v517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:54.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:54 gibba020 bash[25448]: cluster 2021-03-10T14:09:53.055243+0000 mgr.gibba020.yqfnwy (mgr.34427) 938 : cluster [DBG] pgmap v518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:54.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:54 gibba013 bash[29418]: cluster 2021-03-10T14:09:53.055243+0000 mgr.gibba020.yqfnwy (mgr.34427) 938 : cluster [DBG] pgmap v518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:54.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:54 gibba013 bash[30381]: cluster 2021-03-10T14:09:53.055243+0000 mgr.gibba020.yqfnwy (mgr.34427) 938 : cluster [DBG] pgmap v518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:56.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:56 gibba020 bash[25448]: cluster 2021-03-10T14:09:55.057092+0000 mgr.gibba020.yqfnwy (mgr.34427) 939 : cluster [DBG] pgmap v519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:56.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:56 gibba013 bash[29418]: cluster 2021-03-10T14:09:55.057092+0000 mgr.gibba020.yqfnwy (mgr.34427) 939 : cluster [DBG] pgmap v519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:56.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:56 gibba013 bash[30381]: cluster 2021-03-10T14:09:55.057092+0000 mgr.gibba020.yqfnwy (mgr.34427) 939 : cluster [DBG] pgmap v519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:58.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:58 gibba020 bash[25448]: cluster 2021-03-10T14:09:57.058521+0000 mgr.gibba020.yqfnwy (mgr.34427) 940 : cluster [DBG] pgmap v520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:58.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:58 gibba013 bash[29418]: cluster 2021-03-10T14:09:57.058521+0000 mgr.gibba020.yqfnwy (mgr.34427) 940 : cluster [DBG] pgmap v520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:58.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:58 gibba013 bash[30381]: cluster 2021-03-10T14:09:57.058521+0000 mgr.gibba020.yqfnwy (mgr.34427) 940 : cluster [DBG] pgmap v520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:09:59.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:09:59 gibba020 bash[25448]: cephadm 2021-03-10T14:09:58.287182+0000 mgr.gibba020.yqfnwy (mgr.34427) 941 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:09:59.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:09:59 gibba013 bash[29418]: cephadm 2021-03-10T14:09:58.287182+0000 mgr.gibba020.yqfnwy (mgr.34427) 941 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:09:59.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:09:59 gibba013 bash[30381]: cephadm 2021-03-10T14:09:58.287182+0000 mgr.gibba020.yqfnwy (mgr.34427) 941 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:10:00.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:00 gibba013 bash[29418]: debug 2021-03-10T14:09:59.997+0000 7fd718a82700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:10:00.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:00 gibba013 bash[29418]: cluster 2021-03-10T14:09:59.060199+0000 mgr.gibba020.yqfnwy (mgr.34427) 942 : cluster [DBG] pgmap v521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:00.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:00 gibba013 bash[29418]: cluster 2021-03-10T14:10:00.000281+0000 mon.a (mon.0) 828 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:10:00.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:00 gibba013 bash[30381]: cluster 2021-03-10T14:09:59.060199+0000 mgr.gibba020.yqfnwy (mgr.34427) 942 : cluster [DBG] pgmap v521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:00.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:00 gibba013 bash[30381]: cluster 2021-03-10T14:10:00.000281+0000 mon.a (mon.0) 828 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:10:00.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:00 gibba020 bash[25448]: cluster 2021-03-10T14:09:59.060199+0000 mgr.gibba020.yqfnwy (mgr.34427) 942 : cluster [DBG] pgmap v521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:00.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:00 gibba020 bash[25448]: cluster 2021-03-10T14:10:00.000281+0000 mon.a (mon.0) 828 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:10:02.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:02 gibba013 bash[29418]: cluster 2021-03-10T14:10:01.062106+0000 mgr.gibba020.yqfnwy (mgr.34427) 943 : cluster [DBG] pgmap v522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:02.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:02 gibba013 bash[30381]: cluster 2021-03-10T14:10:01.062106+0000 mgr.gibba020.yqfnwy (mgr.34427) 943 : cluster [DBG] pgmap v522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:02.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:02 gibba020 bash[25448]: cluster 2021-03-10T14:10:01.062106+0000 mgr.gibba020.yqfnwy (mgr.34427) 943 : cluster [DBG] pgmap v522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:04.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:04 gibba013 bash[29418]: cluster 2021-03-10T14:10:03.062566+0000 mgr.gibba020.yqfnwy (mgr.34427) 944 : cluster [DBG] pgmap v523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:04.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:04 gibba013 bash[30381]: cluster 2021-03-10T14:10:03.062566+0000 mgr.gibba020.yqfnwy (mgr.34427) 944 : cluster [DBG] pgmap v523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:04.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:04 gibba020 bash[25448]: cluster 2021-03-10T14:10:03.062566+0000 mgr.gibba020.yqfnwy (mgr.34427) 944 : cluster [DBG] pgmap v523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:06.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:06 gibba013 bash[29418]: cluster 2021-03-10T14:10:05.064317+0000 mgr.gibba020.yqfnwy (mgr.34427) 945 : cluster [DBG] pgmap v524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:06 gibba013 bash[29418]: audit 2021-03-10T14:10:05.876177+0000 mon.a (mon.0) 829 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:10:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:06 gibba013 bash[29418]: audit 2021-03-10T14:10:05.876922+0000 mon.a (mon.0) 830 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:10:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:06 gibba013 bash[29418]: audit 2021-03-10T14:10:05.877577+0000 mon.a (mon.0) 831 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:10:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:06 gibba013 bash[29418]: audit 2021-03-10T14:10:05.878286+0000 mon.a (mon.0) 832 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:10:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:06 gibba013 bash[29418]: audit 2021-03-10T14:10:06.036066+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:10:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:06 gibba013 bash[29418]: audit 2021-03-10T14:10:06.037695+0000 mon.a (mon.0) 834 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:10:06.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:06 gibba013 bash[30381]: cluster 2021-03-10T14:10:05.064317+0000 mgr.gibba020.yqfnwy (mgr.34427) 945 : cluster [DBG] pgmap v524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:06.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:06 gibba013 bash[30381]: audit 2021-03-10T14:10:05.876177+0000 mon.a (mon.0) 829 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:10:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:06 gibba013 bash[30381]: audit 2021-03-10T14:10:05.876922+0000 mon.a (mon.0) 830 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:10:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:06 gibba013 bash[30381]: audit 2021-03-10T14:10:05.877577+0000 mon.a (mon.0) 831 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:10:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:06 gibba013 bash[30381]: audit 2021-03-10T14:10:05.878286+0000 mon.a (mon.0) 832 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:10:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:06 gibba013 bash[30381]: audit 2021-03-10T14:10:06.036066+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:10:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:06 gibba013 bash[30381]: audit 2021-03-10T14:10:06.037695+0000 mon.a (mon.0) 834 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:10:06.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:06 gibba020 bash[25448]: cluster 2021-03-10T14:10:05.064317+0000 mgr.gibba020.yqfnwy (mgr.34427) 945 : cluster [DBG] pgmap v524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:06.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:06 gibba020 bash[25448]: audit 2021-03-10T14:10:05.876177+0000 mon.a (mon.0) 829 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:10:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:06 gibba020 bash[25448]: audit 2021-03-10T14:10:05.876922+0000 mon.a (mon.0) 830 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:10:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:06 gibba020 bash[25448]: audit 2021-03-10T14:10:05.877577+0000 mon.a (mon.0) 831 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:10:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:06 gibba020 bash[25448]: audit 2021-03-10T14:10:05.878286+0000 mon.a (mon.0) 832 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:10:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:06 gibba020 bash[25448]: audit 2021-03-10T14:10:06.036066+0000 mon.a (mon.0) 833 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:10:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:06 gibba020 bash[25448]: audit 2021-03-10T14:10:06.037695+0000 mon.a (mon.0) 834 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:10:08.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:08 gibba013 bash[29418]: cluster 2021-03-10T14:10:07.065504+0000 mgr.gibba020.yqfnwy (mgr.34427) 946 : cluster [DBG] pgmap v525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:08.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:08 gibba013 bash[30381]: cluster 2021-03-10T14:10:07.065504+0000 mgr.gibba020.yqfnwy (mgr.34427) 946 : cluster [DBG] pgmap v525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:08.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:08 gibba020 bash[25448]: cluster 2021-03-10T14:10:07.065504+0000 mgr.gibba020.yqfnwy (mgr.34427) 946 : cluster [DBG] pgmap v525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:10.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:10 gibba013 bash[29418]: cluster 2021-03-10T14:10:09.067019+0000 mgr.gibba020.yqfnwy (mgr.34427) 947 : cluster [DBG] pgmap v526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:10.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:10 gibba013 bash[30381]: cluster 2021-03-10T14:10:09.067019+0000 mgr.gibba020.yqfnwy (mgr.34427) 947 : cluster [DBG] pgmap v526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:10.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:10 gibba020 bash[25448]: cluster 2021-03-10T14:10:09.067019+0000 mgr.gibba020.yqfnwy (mgr.34427) 947 : cluster [DBG] pgmap v526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:12.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:12 gibba013 bash[29418]: cluster 2021-03-10T14:10:11.068728+0000 mgr.gibba020.yqfnwy (mgr.34427) 948 : cluster [DBG] pgmap v527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:12.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:12 gibba013 bash[30381]: cluster 2021-03-10T14:10:11.068728+0000 mgr.gibba020.yqfnwy (mgr.34427) 948 : cluster [DBG] pgmap v527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:12.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:12 gibba020 bash[25448]: cluster 2021-03-10T14:10:11.068728+0000 mgr.gibba020.yqfnwy (mgr.34427) 948 : cluster [DBG] pgmap v527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:14.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:14 gibba013 bash[29418]: cluster 2021-03-10T14:10:13.069870+0000 mgr.gibba020.yqfnwy (mgr.34427) 949 : cluster [DBG] pgmap v528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:14.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:14 gibba013 bash[29418]: cephadm 2021-03-10T14:10:13.302949+0000 mgr.gibba020.yqfnwy (mgr.34427) 950 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:10:14.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:14 gibba013 bash[30381]: cluster 2021-03-10T14:10:13.069870+0000 mgr.gibba020.yqfnwy (mgr.34427) 949 : cluster [DBG] pgmap v528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:14.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:14 gibba013 bash[30381]: cephadm 2021-03-10T14:10:13.302949+0000 mgr.gibba020.yqfnwy (mgr.34427) 950 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:10:14.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:14 gibba020 bash[25448]: cluster 2021-03-10T14:10:13.069870+0000 mgr.gibba020.yqfnwy (mgr.34427) 949 : cluster [DBG] pgmap v528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:14.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:14 gibba020 bash[25448]: cephadm 2021-03-10T14:10:13.302949+0000 mgr.gibba020.yqfnwy (mgr.34427) 950 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:10:15.042 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:10:15.272 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:10:15.273 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (16m) 2m ago 22m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:10:15.273 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (21m) 107s ago 21m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:10:15.273 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (17m) 107s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:10:15.273 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (17m) 107s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:10:15.274 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (16m) 2m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:10:15.274 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (16m) 2m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:10:15.274 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (15m) 107s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:10:15.274 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (15m) 2m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:10:15.275 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (22m) 2m ago 22m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:10:15.275 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (22m) 107s ago 22m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:10:15.275 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (15m) 2m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:10:15.275 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (14m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:10:15.275 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (14m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:10:15.276 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (13m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:10:15.276 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (13m) 107s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:10:15.276 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (12m) 107s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:10:15.276 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (12m) 107s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:10:15.276 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (12m) 107s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:10:15.277 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (21m) 107s ago 22m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:10:15.277 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 107s ago 20m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:10:15.520 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:10:15.521 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:10:15.521 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:10:15.521 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:10:15.521 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:10:15.522 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:10:15.522 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:10:15.522 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:10:15.522 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:10:15.522 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:10:15.523 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:10:15.523 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:10:15.523 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:10:15.523 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:10:15.523 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:10:16.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:16 gibba013 bash[29418]: audit 2021-03-10T14:10:15.030266+0000 mgr.gibba020.yqfnwy (mgr.34427) 951 : audit [DBG] from='client.44700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:10:16.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:16 gibba013 bash[29418]: cluster 2021-03-10T14:10:15.071606+0000 mgr.gibba020.yqfnwy (mgr.34427) 952 : cluster [DBG] pgmap v529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:16.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:16 gibba013 bash[29418]: audit 2021-03-10T14:10:15.256591+0000 mgr.gibba020.yqfnwy (mgr.34427) 953 : audit [DBG] from='client.54691 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:10:16.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:16 gibba013 bash[29418]: audit 2021-03-10T14:10:15.519247+0000 mon.c (mon.1) 27 : audit [DBG] from='client.? 172.21.2.113:0/1893742807' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:16.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:16 gibba013 bash[30381]: audit 2021-03-10T14:10:15.030266+0000 mgr.gibba020.yqfnwy (mgr.34427) 951 : audit [DBG] from='client.44700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:10:16.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:16 gibba013 bash[30381]: cluster 2021-03-10T14:10:15.071606+0000 mgr.gibba020.yqfnwy (mgr.34427) 952 : cluster [DBG] pgmap v529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:16.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:16 gibba013 bash[30381]: audit 2021-03-10T14:10:15.256591+0000 mgr.gibba020.yqfnwy (mgr.34427) 953 : audit [DBG] from='client.54691 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:10:16.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:16 gibba013 bash[30381]: audit 2021-03-10T14:10:15.519247+0000 mon.c (mon.1) 27 : audit [DBG] from='client.? 172.21.2.113:0/1893742807' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:16.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:16 gibba020 bash[25448]: audit 2021-03-10T14:10:15.030266+0000 mgr.gibba020.yqfnwy (mgr.34427) 951 : audit [DBG] from='client.44700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:10:16.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:16 gibba020 bash[25448]: cluster 2021-03-10T14:10:15.071606+0000 mgr.gibba020.yqfnwy (mgr.34427) 952 : cluster [DBG] pgmap v529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:16.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:16 gibba020 bash[25448]: audit 2021-03-10T14:10:15.256591+0000 mgr.gibba020.yqfnwy (mgr.34427) 953 : audit [DBG] from='client.54691 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:10:16.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:16 gibba020 bash[25448]: audit 2021-03-10T14:10:15.519247+0000 mon.c (mon.1) 27 : audit [DBG] from='client.? 172.21.2.113:0/1893742807' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:17.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:17 gibba013 bash[29418]: cluster 2021-03-10T14:10:17.072737+0000 mgr.gibba020.yqfnwy (mgr.34427) 954 : cluster [DBG] pgmap v530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:17.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:17 gibba013 bash[30381]: cluster 2021-03-10T14:10:17.072737+0000 mgr.gibba020.yqfnwy (mgr.34427) 954 : cluster [DBG] pgmap v530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:17.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:17 gibba020 bash[25448]: cluster 2021-03-10T14:10:17.072737+0000 mgr.gibba020.yqfnwy (mgr.34427) 954 : cluster [DBG] pgmap v530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:20.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:20 gibba020 bash[25448]: cluster 2021-03-10T14:10:19.074233+0000 mgr.gibba020.yqfnwy (mgr.34427) 955 : cluster [DBG] pgmap v531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:20.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:20 gibba013 bash[29418]: cluster 2021-03-10T14:10:19.074233+0000 mgr.gibba020.yqfnwy (mgr.34427) 955 : cluster [DBG] pgmap v531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:20.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:20 gibba013 bash[30381]: cluster 2021-03-10T14:10:19.074233+0000 mgr.gibba020.yqfnwy (mgr.34427) 955 : cluster [DBG] pgmap v531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:22.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:22 gibba020 bash[25448]: cluster 2021-03-10T14:10:21.076070+0000 mgr.gibba020.yqfnwy (mgr.34427) 956 : cluster [DBG] pgmap v532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:22.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:22 gibba013 bash[29418]: cluster 2021-03-10T14:10:21.076070+0000 mgr.gibba020.yqfnwy (mgr.34427) 956 : cluster [DBG] pgmap v532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:22.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:22 gibba013 bash[30381]: cluster 2021-03-10T14:10:21.076070+0000 mgr.gibba020.yqfnwy (mgr.34427) 956 : cluster [DBG] pgmap v532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:24.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:24 gibba020 bash[25448]: cluster 2021-03-10T14:10:23.077304+0000 mgr.gibba020.yqfnwy (mgr.34427) 957 : cluster [DBG] pgmap v533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:24.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:24 gibba013 bash[29418]: cluster 2021-03-10T14:10:23.077304+0000 mgr.gibba020.yqfnwy (mgr.34427) 957 : cluster [DBG] pgmap v533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:24.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:24 gibba013 bash[30381]: cluster 2021-03-10T14:10:23.077304+0000 mgr.gibba020.yqfnwy (mgr.34427) 957 : cluster [DBG] pgmap v533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:26.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:26 gibba020 bash[25448]: cluster 2021-03-10T14:10:25.078869+0000 mgr.gibba020.yqfnwy (mgr.34427) 958 : cluster [DBG] pgmap v534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:26.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:26 gibba013 bash[29418]: cluster 2021-03-10T14:10:25.078869+0000 mgr.gibba020.yqfnwy (mgr.34427) 958 : cluster [DBG] pgmap v534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:26.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:26 gibba013 bash[30381]: cluster 2021-03-10T14:10:25.078869+0000 mgr.gibba020.yqfnwy (mgr.34427) 958 : cluster [DBG] pgmap v534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:28.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:28 gibba020 bash[25448]: cluster 2021-03-10T14:10:27.080360+0000 mgr.gibba020.yqfnwy (mgr.34427) 959 : cluster [DBG] pgmap v535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:28.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:28 gibba013 bash[29418]: cluster 2021-03-10T14:10:27.080360+0000 mgr.gibba020.yqfnwy (mgr.34427) 959 : cluster [DBG] pgmap v535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:28.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:28 gibba013 bash[30381]: cluster 2021-03-10T14:10:27.080360+0000 mgr.gibba020.yqfnwy (mgr.34427) 959 : cluster [DBG] pgmap v535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:29.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:29 gibba013 bash[29418]: audit 2021-03-10T14:10:28.321778+0000 mon.a (mon.0) 835 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:10:29.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:29 gibba013 bash[29418]: cephadm 2021-03-10T14:10:28.325127+0000 mgr.gibba020.yqfnwy (mgr.34427) 960 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:10:29.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:29 gibba013 bash[29418]: cephadm 2021-03-10T14:10:28.326987+0000 mgr.gibba020.yqfnwy (mgr.34427) 961 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:10:29.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:29 gibba013 bash[29418]: audit 2021-03-10T14:10:28.522668+0000 mon.a (mon.0) 836 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:10:29.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:29 gibba013 bash[29418]: audit 2021-03-10T14:10:28.525780+0000 mon.a (mon.0) 837 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:10:29.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:29 gibba013 bash[29418]: audit 2021-03-10T14:10:28.527165+0000 mon.a (mon.0) 838 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:29.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:29 gibba013 bash[29418]: audit 2021-03-10T14:10:28.528453+0000 mon.a (mon.0) 839 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:29.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:29 gibba013 bash[29418]: audit 2021-03-10T14:10:28.529885+0000 mon.a (mon.0) 840 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:29.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:29 gibba013 bash[29418]: audit 2021-03-10T14:10:28.532589+0000 mon.a (mon.0) 841 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:29.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:29 gibba013 bash[29418]: audit 2021-03-10T14:10:28.534288+0000 mon.a (mon.0) 842 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:29.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:29 gibba013 bash[30381]: audit 2021-03-10T14:10:28.321778+0000 mon.a (mon.0) 835 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:10:29.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:29 gibba013 bash[30381]: cephadm 2021-03-10T14:10:28.325127+0000 mgr.gibba020.yqfnwy (mgr.34427) 960 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:10:29.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:29 gibba013 bash[30381]: cephadm 2021-03-10T14:10:28.326987+0000 mgr.gibba020.yqfnwy (mgr.34427) 961 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:10:29.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:29 gibba013 bash[30381]: audit 2021-03-10T14:10:28.522668+0000 mon.a (mon.0) 836 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:10:29.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:29 gibba013 bash[30381]: audit 2021-03-10T14:10:28.525780+0000 mon.a (mon.0) 837 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:10:29.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:29 gibba013 bash[30381]: audit 2021-03-10T14:10:28.527165+0000 mon.a (mon.0) 838 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:29.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:29 gibba013 bash[30381]: audit 2021-03-10T14:10:28.528453+0000 mon.a (mon.0) 839 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:29.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:29 gibba013 bash[30381]: audit 2021-03-10T14:10:28.529885+0000 mon.a (mon.0) 840 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:29.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:29 gibba013 bash[30381]: audit 2021-03-10T14:10:28.532589+0000 mon.a (mon.0) 841 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:29.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:29 gibba013 bash[30381]: audit 2021-03-10T14:10:28.534288+0000 mon.a (mon.0) 842 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:29.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:29 gibba020 bash[25448]: audit 2021-03-10T14:10:28.321778+0000 mon.a (mon.0) 835 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:10:29.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:29 gibba020 bash[25448]: cephadm 2021-03-10T14:10:28.325127+0000 mgr.gibba020.yqfnwy (mgr.34427) 960 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:10:29.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:29 gibba020 bash[25448]: cephadm 2021-03-10T14:10:28.326987+0000 mgr.gibba020.yqfnwy (mgr.34427) 961 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:10:29.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:29 gibba020 bash[25448]: audit 2021-03-10T14:10:28.522668+0000 mon.a (mon.0) 836 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:10:29.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:29 gibba020 bash[25448]: audit 2021-03-10T14:10:28.525780+0000 mon.a (mon.0) 837 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:10:29.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:29 gibba020 bash[25448]: audit 2021-03-10T14:10:28.527165+0000 mon.a (mon.0) 838 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:29.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:29 gibba020 bash[25448]: audit 2021-03-10T14:10:28.528453+0000 mon.a (mon.0) 839 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:29.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:29 gibba020 bash[25448]: audit 2021-03-10T14:10:28.529885+0000 mon.a (mon.0) 840 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:29.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:29 gibba020 bash[25448]: audit 2021-03-10T14:10:28.532589+0000 mon.a (mon.0) 841 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:29.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:29 gibba020 bash[25448]: audit 2021-03-10T14:10:28.534288+0000 mon.a (mon.0) 842 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:30.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:30 gibba013 bash[29418]: cephadm 2021-03-10T14:10:28.523004+0000 mgr.gibba020.yqfnwy (mgr.34427) 962 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:10:30.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:30 gibba013 bash[29418]: cephadm 2021-03-10T14:10:28.524764+0000 mgr.gibba020.yqfnwy (mgr.34427) 963 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:10:30.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:30 gibba013 bash[29418]: cephadm 2021-03-10T14:10:28.525952+0000 mgr.gibba020.yqfnwy (mgr.34427) 964 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:10:30.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:30 gibba013 bash[29418]: cephadm 2021-03-10T14:10:28.526053+0000 mgr.gibba020.yqfnwy (mgr.34427) 965 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:10:30.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:30 gibba013 bash[29418]: cephadm 2021-03-10T14:10:28.527357+0000 mgr.gibba020.yqfnwy (mgr.34427) 966 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:10:30.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:30 gibba013 bash[29418]: cephadm 2021-03-10T14:10:28.527393+0000 mgr.gibba020.yqfnwy (mgr.34427) 967 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:10:30.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:30 gibba013 bash[29418]: cephadm 2021-03-10T14:10:28.528615+0000 mgr.gibba020.yqfnwy (mgr.34427) 968 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:10:30.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:30 gibba013 bash[29418]: cephadm 2021-03-10T14:10:28.529847+0000 mgr.gibba020.yqfnwy (mgr.34427) 969 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:10:30.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:30 gibba013 bash[29418]: cephadm 2021-03-10T14:10:28.529884+0000 mgr.gibba020.yqfnwy (mgr.34427) 970 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:10:30.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:30 gibba013 bash[29418]: cephadm 2021-03-10T14:10:28.531473+0000 mgr.gibba020.yqfnwy (mgr.34427) 971 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:10:30.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:30 gibba013 bash[29418]: cephadm 2021-03-10T14:10:28.531784+0000 mgr.gibba020.yqfnwy (mgr.34427) 972 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:10:30.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:30 gibba013 bash[29418]: cephadm 2021-03-10T14:10:28.533768+0000 mgr.gibba020.yqfnwy (mgr.34427) 973 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:10:30.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:30 gibba013 bash[29418]: cephadm 2021-03-10T14:10:28.533805+0000 mgr.gibba020.yqfnwy (mgr.34427) 974 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:10:30.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:30 gibba013 bash[29418]: cephadm 2021-03-10T14:10:28.533918+0000 mgr.gibba020.yqfnwy (mgr.34427) 975 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:10:30.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:30 gibba013 bash[29418]: cluster 2021-03-10T14:10:29.082060+0000 mgr.gibba020.yqfnwy (mgr.34427) 976 : cluster [DBG] pgmap v536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:30.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:30 gibba013 bash[30381]: cephadm 2021-03-10T14:10:28.523004+0000 mgr.gibba020.yqfnwy (mgr.34427) 962 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:10:30.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:30 gibba013 bash[30381]: cephadm 2021-03-10T14:10:28.524764+0000 mgr.gibba020.yqfnwy (mgr.34427) 963 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:10:30.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:30 gibba013 bash[30381]: cephadm 2021-03-10T14:10:28.525952+0000 mgr.gibba020.yqfnwy (mgr.34427) 964 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:10:30.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:30 gibba013 bash[30381]: cephadm 2021-03-10T14:10:28.526053+0000 mgr.gibba020.yqfnwy (mgr.34427) 965 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:10:30.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:30 gibba013 bash[30381]: cephadm 2021-03-10T14:10:28.527357+0000 mgr.gibba020.yqfnwy (mgr.34427) 966 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:10:30.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:30 gibba013 bash[30381]: cephadm 2021-03-10T14:10:28.527393+0000 mgr.gibba020.yqfnwy (mgr.34427) 967 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:10:30.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:30 gibba013 bash[30381]: cephadm 2021-03-10T14:10:28.528615+0000 mgr.gibba020.yqfnwy (mgr.34427) 968 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:10:30.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:30 gibba013 bash[30381]: cephadm 2021-03-10T14:10:28.529847+0000 mgr.gibba020.yqfnwy (mgr.34427) 969 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:10:30.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:30 gibba013 bash[30381]: cephadm 2021-03-10T14:10:28.529884+0000 mgr.gibba020.yqfnwy (mgr.34427) 970 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:10:30.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:30 gibba013 bash[30381]: cephadm 2021-03-10T14:10:28.531473+0000 mgr.gibba020.yqfnwy (mgr.34427) 971 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:10:30.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:30 gibba013 bash[30381]: cephadm 2021-03-10T14:10:28.531784+0000 mgr.gibba020.yqfnwy (mgr.34427) 972 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:10:30.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:30 gibba013 bash[30381]: cephadm 2021-03-10T14:10:28.533768+0000 mgr.gibba020.yqfnwy (mgr.34427) 973 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:10:30.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:30 gibba013 bash[30381]: cephadm 2021-03-10T14:10:28.533805+0000 mgr.gibba020.yqfnwy (mgr.34427) 974 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:10:30.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:30 gibba013 bash[30381]: cephadm 2021-03-10T14:10:28.533918+0000 mgr.gibba020.yqfnwy (mgr.34427) 975 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:10:30.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:30 gibba013 bash[30381]: cluster 2021-03-10T14:10:29.082060+0000 mgr.gibba020.yqfnwy (mgr.34427) 976 : cluster [DBG] pgmap v536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:30.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:30 gibba020 bash[25448]: cephadm 2021-03-10T14:10:28.523004+0000 mgr.gibba020.yqfnwy (mgr.34427) 962 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:10:30.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:30 gibba020 bash[25448]: cephadm 2021-03-10T14:10:28.524764+0000 mgr.gibba020.yqfnwy (mgr.34427) 963 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:10:30.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:30 gibba020 bash[25448]: cephadm 2021-03-10T14:10:28.525952+0000 mgr.gibba020.yqfnwy (mgr.34427) 964 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:10:30.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:30 gibba020 bash[25448]: cephadm 2021-03-10T14:10:28.526053+0000 mgr.gibba020.yqfnwy (mgr.34427) 965 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:10:30.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:30 gibba020 bash[25448]: cephadm 2021-03-10T14:10:28.527357+0000 mgr.gibba020.yqfnwy (mgr.34427) 966 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:10:30.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:30 gibba020 bash[25448]: cephadm 2021-03-10T14:10:28.527393+0000 mgr.gibba020.yqfnwy (mgr.34427) 967 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:10:30.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:30 gibba020 bash[25448]: cephadm 2021-03-10T14:10:28.528615+0000 mgr.gibba020.yqfnwy (mgr.34427) 968 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:10:30.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:30 gibba020 bash[25448]: cephadm 2021-03-10T14:10:28.529847+0000 mgr.gibba020.yqfnwy (mgr.34427) 969 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:10:30.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:30 gibba020 bash[25448]: cephadm 2021-03-10T14:10:28.529884+0000 mgr.gibba020.yqfnwy (mgr.34427) 970 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:10:30.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:30 gibba020 bash[25448]: cephadm 2021-03-10T14:10:28.531473+0000 mgr.gibba020.yqfnwy (mgr.34427) 971 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:10:30.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:30 gibba020 bash[25448]: cephadm 2021-03-10T14:10:28.531784+0000 mgr.gibba020.yqfnwy (mgr.34427) 972 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:10:30.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:30 gibba020 bash[25448]: cephadm 2021-03-10T14:10:28.533768+0000 mgr.gibba020.yqfnwy (mgr.34427) 973 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:10:30.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:30 gibba020 bash[25448]: cephadm 2021-03-10T14:10:28.533805+0000 mgr.gibba020.yqfnwy (mgr.34427) 974 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:10:30.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:30 gibba020 bash[25448]: cephadm 2021-03-10T14:10:28.533918+0000 mgr.gibba020.yqfnwy (mgr.34427) 975 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:10:30.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:30 gibba020 bash[25448]: cluster 2021-03-10T14:10:29.082060+0000 mgr.gibba020.yqfnwy (mgr.34427) 976 : cluster [DBG] pgmap v536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:32.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:32 gibba013 bash[29418]: cluster 2021-03-10T14:10:31.083762+0000 mgr.gibba020.yqfnwy (mgr.34427) 977 : cluster [DBG] pgmap v537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:32.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:32 gibba013 bash[30381]: cluster 2021-03-10T14:10:31.083762+0000 mgr.gibba020.yqfnwy (mgr.34427) 977 : cluster [DBG] pgmap v537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:32.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:32 gibba020 bash[25448]: cluster 2021-03-10T14:10:31.083762+0000 mgr.gibba020.yqfnwy (mgr.34427) 977 : cluster [DBG] pgmap v537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:34.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:34 gibba013 bash[29418]: cluster 2021-03-10T14:10:33.084306+0000 mgr.gibba020.yqfnwy (mgr.34427) 978 : cluster [DBG] pgmap v538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:34.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:34 gibba013 bash[30381]: cluster 2021-03-10T14:10:33.084306+0000 mgr.gibba020.yqfnwy (mgr.34427) 978 : cluster [DBG] pgmap v538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:34.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:34 gibba020 bash[25448]: cluster 2021-03-10T14:10:33.084306+0000 mgr.gibba020.yqfnwy (mgr.34427) 978 : cluster [DBG] pgmap v538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:36.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:36 gibba013 bash[30381]: cluster 2021-03-10T14:10:35.085824+0000 mgr.gibba020.yqfnwy (mgr.34427) 979 : cluster [DBG] pgmap v539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:36.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:36 gibba013 bash[29418]: cluster 2021-03-10T14:10:35.085824+0000 mgr.gibba020.yqfnwy (mgr.34427) 979 : cluster [DBG] pgmap v539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:36.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:36 gibba020 bash[25448]: cluster 2021-03-10T14:10:35.085824+0000 mgr.gibba020.yqfnwy (mgr.34427) 979 : cluster [DBG] pgmap v539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:38.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:38 gibba013 bash[29418]: cluster 2021-03-10T14:10:37.087070+0000 mgr.gibba020.yqfnwy (mgr.34427) 980 : cluster [DBG] pgmap v540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:38.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:38 gibba013 bash[30381]: cluster 2021-03-10T14:10:37.087070+0000 mgr.gibba020.yqfnwy (mgr.34427) 980 : cluster [DBG] pgmap v540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:38.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:38 gibba020 bash[25448]: cluster 2021-03-10T14:10:37.087070+0000 mgr.gibba020.yqfnwy (mgr.34427) 980 : cluster [DBG] pgmap v540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:40.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:40 gibba013 bash[29418]: cluster 2021-03-10T14:10:39.088637+0000 mgr.gibba020.yqfnwy (mgr.34427) 981 : cluster [DBG] pgmap v541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:40.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:40 gibba013 bash[30381]: cluster 2021-03-10T14:10:39.088637+0000 mgr.gibba020.yqfnwy (mgr.34427) 981 : cluster [DBG] pgmap v541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:40.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:40 gibba020 bash[25448]: cluster 2021-03-10T14:10:39.088637+0000 mgr.gibba020.yqfnwy (mgr.34427) 981 : cluster [DBG] pgmap v541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:42.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:42 gibba013 bash[29418]: cluster 2021-03-10T14:10:41.090327+0000 mgr.gibba020.yqfnwy (mgr.34427) 982 : cluster [DBG] pgmap v542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:42.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:42 gibba013 bash[30381]: cluster 2021-03-10T14:10:41.090327+0000 mgr.gibba020.yqfnwy (mgr.34427) 982 : cluster [DBG] pgmap v542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:42.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:42 gibba020 bash[25448]: cluster 2021-03-10T14:10:41.090327+0000 mgr.gibba020.yqfnwy (mgr.34427) 982 : cluster [DBG] pgmap v542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:44.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:44 gibba013 bash[29418]: cluster 2021-03-10T14:10:43.090973+0000 mgr.gibba020.yqfnwy (mgr.34427) 983 : cluster [DBG] pgmap v543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:44.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:44 gibba013 bash[30381]: cluster 2021-03-10T14:10:43.090973+0000 mgr.gibba020.yqfnwy (mgr.34427) 983 : cluster [DBG] pgmap v543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:44.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:44 gibba020 bash[25448]: cluster 2021-03-10T14:10:43.090973+0000 mgr.gibba020.yqfnwy (mgr.34427) 983 : cluster [DBG] pgmap v543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:45.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:45 gibba013 bash[29418]: cephadm 2021-03-10T14:10:43.534993+0000 mgr.gibba020.yqfnwy (mgr.34427) 984 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:10:45.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:45 gibba013 bash[30381]: cephadm 2021-03-10T14:10:43.534993+0000 mgr.gibba020.yqfnwy (mgr.34427) 984 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:10:45.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:45 gibba020 bash[25448]: cephadm 2021-03-10T14:10:43.534993+0000 mgr.gibba020.yqfnwy (mgr.34427) 984 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:10:45.765 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:10:46.023 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:10:46.023 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (17m) 3m ago 22m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:10:46.023 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (22m) 2m ago 22m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:10:46.023 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (17m) 2m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:10:46.024 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (17m) 2m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:10:46.024 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (16m) 3m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:10:46.024 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (16m) 3m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:10:46.024 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (16m) 2m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:10:46.025 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (16m) 3m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:10:46.025 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (22m) 3m ago 22m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:10:46.025 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (22m) 2m ago 22m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:10:46.025 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (15m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:10:46.025 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (15m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:10:46.026 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (14m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:10:46.026 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (14m) 3m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:10:46.026 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (13m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:10:46.026 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (13m) 2m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:10:46.026 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (12m) 2m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:10:46.027 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (12m) 2m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:10:46.027 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (22m) 2m ago 22m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:10:46.027 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 20m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:10:46.281 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:10:46.282 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:10:46.282 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:10:46.282 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:10:46.282 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:10:46.283 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:10:46.283 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:10:46.283 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:10:46.283 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:10:46.283 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:10:46.284 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:10:46.284 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:10:46.284 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:10:46.284 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:10:46.284 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:10:46.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:46 gibba013 bash[29418]: cluster 2021-03-10T14:10:45.092641+0000 mgr.gibba020.yqfnwy (mgr.34427) 985 : cluster [DBG] pgmap v544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:46.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:46 gibba013 bash[30381]: cluster 2021-03-10T14:10:45.092641+0000 mgr.gibba020.yqfnwy (mgr.34427) 985 : cluster [DBG] pgmap v544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:46.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:46 gibba020 bash[25448]: cluster 2021-03-10T14:10:45.092641+0000 mgr.gibba020.yqfnwy (mgr.34427) 985 : cluster [DBG] pgmap v544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:47.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:47 gibba013 bash[29418]: audit 2021-03-10T14:10:45.753508+0000 mgr.gibba020.yqfnwy (mgr.34427) 986 : audit [DBG] from='client.54703 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:10:47.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:47 gibba013 bash[29418]: audit 2021-03-10T14:10:45.978973+0000 mgr.gibba020.yqfnwy (mgr.34427) 987 : audit [DBG] from='client.44724 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:10:47.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:47 gibba013 bash[29418]: audit 2021-03-10T14:10:46.279652+0000 mon.a (mon.0) 843 : audit [DBG] from='client.? 172.21.2.113:0/2010237986' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:47.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:47 gibba013 bash[30381]: audit 2021-03-10T14:10:45.753508+0000 mgr.gibba020.yqfnwy (mgr.34427) 986 : audit [DBG] from='client.54703 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:10:47.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:47 gibba013 bash[30381]: audit 2021-03-10T14:10:45.978973+0000 mgr.gibba020.yqfnwy (mgr.34427) 987 : audit [DBG] from='client.44724 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:10:47.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:47 gibba013 bash[30381]: audit 2021-03-10T14:10:46.279652+0000 mon.a (mon.0) 843 : audit [DBG] from='client.? 172.21.2.113:0/2010237986' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:47.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:47 gibba020 bash[25448]: audit 2021-03-10T14:10:45.753508+0000 mgr.gibba020.yqfnwy (mgr.34427) 986 : audit [DBG] from='client.54703 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:10:47.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:47 gibba020 bash[25448]: audit 2021-03-10T14:10:45.978973+0000 mgr.gibba020.yqfnwy (mgr.34427) 987 : audit [DBG] from='client.44724 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:10:47.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:47 gibba020 bash[25448]: audit 2021-03-10T14:10:46.279652+0000 mon.a (mon.0) 843 : audit [DBG] from='client.? 172.21.2.113:0/2010237986' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:10:48.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:48 gibba013 bash[29418]: cluster 2021-03-10T14:10:47.093970+0000 mgr.gibba020.yqfnwy (mgr.34427) 988 : cluster [DBG] pgmap v545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:48.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:48 gibba013 bash[30381]: cluster 2021-03-10T14:10:47.093970+0000 mgr.gibba020.yqfnwy (mgr.34427) 988 : cluster [DBG] pgmap v545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:48.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:48 gibba020 bash[25448]: cluster 2021-03-10T14:10:47.093970+0000 mgr.gibba020.yqfnwy (mgr.34427) 988 : cluster [DBG] pgmap v545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:50.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:50 gibba013 bash[29418]: cluster 2021-03-10T14:10:49.095596+0000 mgr.gibba020.yqfnwy (mgr.34427) 989 : cluster [DBG] pgmap v546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:50.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:50 gibba013 bash[30381]: cluster 2021-03-10T14:10:49.095596+0000 mgr.gibba020.yqfnwy (mgr.34427) 989 : cluster [DBG] pgmap v546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:50.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:50 gibba020 bash[25448]: cluster 2021-03-10T14:10:49.095596+0000 mgr.gibba020.yqfnwy (mgr.34427) 989 : cluster [DBG] pgmap v546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:52.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:52 gibba013 bash[29418]: cluster 2021-03-10T14:10:51.097479+0000 mgr.gibba020.yqfnwy (mgr.34427) 990 : cluster [DBG] pgmap v547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:52.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:52 gibba013 bash[30381]: cluster 2021-03-10T14:10:51.097479+0000 mgr.gibba020.yqfnwy (mgr.34427) 990 : cluster [DBG] pgmap v547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:52.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:52 gibba020 bash[25448]: cluster 2021-03-10T14:10:51.097479+0000 mgr.gibba020.yqfnwy (mgr.34427) 990 : cluster [DBG] pgmap v547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:54.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:54 gibba013 bash[29418]: cluster 2021-03-10T14:10:53.098222+0000 mgr.gibba020.yqfnwy (mgr.34427) 991 : cluster [DBG] pgmap v548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:54.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:54 gibba013 bash[30381]: cluster 2021-03-10T14:10:53.098222+0000 mgr.gibba020.yqfnwy (mgr.34427) 991 : cluster [DBG] pgmap v548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:54.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:54 gibba020 bash[25448]: cluster 2021-03-10T14:10:53.098222+0000 mgr.gibba020.yqfnwy (mgr.34427) 991 : cluster [DBG] pgmap v548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:56.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:56 gibba013 bash[29418]: cluster 2021-03-10T14:10:55.099790+0000 mgr.gibba020.yqfnwy (mgr.34427) 992 : cluster [DBG] pgmap v549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:56.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:56 gibba013 bash[30381]: cluster 2021-03-10T14:10:55.099790+0000 mgr.gibba020.yqfnwy (mgr.34427) 992 : cluster [DBG] pgmap v549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:56.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:56 gibba020 bash[25448]: cluster 2021-03-10T14:10:55.099790+0000 mgr.gibba020.yqfnwy (mgr.34427) 992 : cluster [DBG] pgmap v549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:58.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:10:58 gibba013 bash[29418]: cluster 2021-03-10T14:10:57.101186+0000 mgr.gibba020.yqfnwy (mgr.34427) 993 : cluster [DBG] pgmap v550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:58.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:10:58 gibba013 bash[30381]: cluster 2021-03-10T14:10:57.101186+0000 mgr.gibba020.yqfnwy (mgr.34427) 993 : cluster [DBG] pgmap v550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:10:58.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:10:58 gibba020 bash[25448]: cluster 2021-03-10T14:10:57.101186+0000 mgr.gibba020.yqfnwy (mgr.34427) 993 : cluster [DBG] pgmap v550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:00.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:00 gibba013 bash[29418]: cephadm 2021-03-10T14:10:58.550867+0000 mgr.gibba020.yqfnwy (mgr.34427) 994 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:11:00.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:00 gibba013 bash[29418]: cluster 2021-03-10T14:10:59.102817+0000 mgr.gibba020.yqfnwy (mgr.34427) 995 : cluster [DBG] pgmap v551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:00.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:00 gibba013 bash[30381]: cephadm 2021-03-10T14:10:58.550867+0000 mgr.gibba020.yqfnwy (mgr.34427) 994 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:11:00.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:00 gibba013 bash[30381]: cluster 2021-03-10T14:10:59.102817+0000 mgr.gibba020.yqfnwy (mgr.34427) 995 : cluster [DBG] pgmap v551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:00.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:00 gibba020 bash[25448]: cephadm 2021-03-10T14:10:58.550867+0000 mgr.gibba020.yqfnwy (mgr.34427) 994 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:11:00.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:00 gibba020 bash[25448]: cluster 2021-03-10T14:10:59.102817+0000 mgr.gibba020.yqfnwy (mgr.34427) 995 : cluster [DBG] pgmap v551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:02.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:02 gibba013 bash[29418]: cluster 2021-03-10T14:11:01.104684+0000 mgr.gibba020.yqfnwy (mgr.34427) 996 : cluster [DBG] pgmap v552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:02.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:02 gibba013 bash[30381]: cluster 2021-03-10T14:11:01.104684+0000 mgr.gibba020.yqfnwy (mgr.34427) 996 : cluster [DBG] pgmap v552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:02.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:02 gibba020 bash[25448]: cluster 2021-03-10T14:11:01.104684+0000 mgr.gibba020.yqfnwy (mgr.34427) 996 : cluster [DBG] pgmap v552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:04.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:04 gibba013 bash[29418]: cluster 2021-03-10T14:11:03.105972+0000 mgr.gibba020.yqfnwy (mgr.34427) 997 : cluster [DBG] pgmap v553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:04.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:04 gibba013 bash[30381]: cluster 2021-03-10T14:11:03.105972+0000 mgr.gibba020.yqfnwy (mgr.34427) 997 : cluster [DBG] pgmap v553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:04.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:04 gibba020 bash[25448]: cluster 2021-03-10T14:11:03.105972+0000 mgr.gibba020.yqfnwy (mgr.34427) 997 : cluster [DBG] pgmap v553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:06.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:06 gibba013 bash[29418]: cluster 2021-03-10T14:11:05.107556+0000 mgr.gibba020.yqfnwy (mgr.34427) 998 : cluster [DBG] pgmap v554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:06 gibba013 bash[29418]: audit 2021-03-10T14:11:05.887002+0000 mon.a (mon.0) 844 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:11:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:06 gibba013 bash[29418]: audit 2021-03-10T14:11:05.887875+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:11:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:06 gibba013 bash[29418]: audit 2021-03-10T14:11:05.888713+0000 mon.a (mon.0) 846 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T14:11:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:06 gibba013 bash[29418]: audit 2021-03-10T14:11:05.889490+0000 mon.a (mon.0) 847 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:11:06.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:06 gibba013 bash[29418]: audit 2021-03-10T14:11:06.042726+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:11:06.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:06 gibba013 bash[29418]: audit 2021-03-10T14:11:06.048370+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:11:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:06 gibba013 bash[30381]: cluster 2021-03-10T14:11:05.107556+0000 mgr.gibba020.yqfnwy (mgr.34427) 998 : cluster [DBG] pgmap v554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:06 gibba013 bash[30381]: audit 2021-03-10T14:11:05.887002+0000 mon.a (mon.0) 844 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:11:06.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:06 gibba013 bash[30381]: audit 2021-03-10T14:11:05.887875+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:11:06.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:06 gibba013 bash[30381]: audit 2021-03-10T14:11:05.888713+0000 mon.a (mon.0) 846 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T14:11:06.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:06 gibba013 bash[30381]: audit 2021-03-10T14:11:05.889490+0000 mon.a (mon.0) 847 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:11:06.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:06 gibba013 bash[30381]: audit 2021-03-10T14:11:06.042726+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:11:06.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:06 gibba013 bash[30381]: audit 2021-03-10T14:11:06.048370+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:11:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:06 gibba020 bash[25448]: cluster 2021-03-10T14:11:05.107556+0000 mgr.gibba020.yqfnwy (mgr.34427) 998 : cluster [DBG] pgmap v554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:06 gibba020 bash[25448]: audit 2021-03-10T14:11:05.887002+0000 mon.a (mon.0) 844 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:11:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:06 gibba020 bash[25448]: audit 2021-03-10T14:11:05.887875+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:11:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:06 gibba020 bash[25448]: audit 2021-03-10T14:11:05.888713+0000 mon.a (mon.0) 846 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T14:11:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:06 gibba020 bash[25448]: audit 2021-03-10T14:11:05.889490+0000 mon.a (mon.0) 847 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:11:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:06 gibba020 bash[25448]: audit 2021-03-10T14:11:06.042726+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:11:06.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:06 gibba020 bash[25448]: audit 2021-03-10T14:11:06.048370+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:11:08.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:08 gibba020 bash[25448]: cluster 2021-03-10T14:11:07.108916+0000 mgr.gibba020.yqfnwy (mgr.34427) 999 : cluster [DBG] pgmap v555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:08.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:08 gibba013 bash[29418]: cluster 2021-03-10T14:11:07.108916+0000 mgr.gibba020.yqfnwy (mgr.34427) 999 : cluster [DBG] pgmap v555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:08.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:08 gibba013 bash[30381]: cluster 2021-03-10T14:11:07.108916+0000 mgr.gibba020.yqfnwy (mgr.34427) 999 : cluster [DBG] pgmap v555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:10.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:10 gibba020 bash[25448]: cluster 2021-03-10T14:11:09.110511+0000 mgr.gibba020.yqfnwy (mgr.34427) 1000 : cluster [DBG] pgmap v556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:10.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:10 gibba013 bash[29418]: cluster 2021-03-10T14:11:09.110511+0000 mgr.gibba020.yqfnwy (mgr.34427) 1000 : cluster [DBG] pgmap v556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:10.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:10 gibba013 bash[30381]: cluster 2021-03-10T14:11:09.110511+0000 mgr.gibba020.yqfnwy (mgr.34427) 1000 : cluster [DBG] pgmap v556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:12.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:12 gibba020 bash[25448]: cluster 2021-03-10T14:11:11.112273+0000 mgr.gibba020.yqfnwy (mgr.34427) 1001 : cluster [DBG] pgmap v557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:12.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:12 gibba013 bash[29418]: cluster 2021-03-10T14:11:11.112273+0000 mgr.gibba020.yqfnwy (mgr.34427) 1001 : cluster [DBG] pgmap v557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:12.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:12 gibba013 bash[30381]: cluster 2021-03-10T14:11:11.112273+0000 mgr.gibba020.yqfnwy (mgr.34427) 1001 : cluster [DBG] pgmap v557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:14.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:14 gibba020 bash[25448]: cluster 2021-03-10T14:11:13.113610+0000 mgr.gibba020.yqfnwy (mgr.34427) 1002 : cluster [DBG] pgmap v558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:14.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:14 gibba013 bash[29418]: cluster 2021-03-10T14:11:13.113610+0000 mgr.gibba020.yqfnwy (mgr.34427) 1002 : cluster [DBG] pgmap v558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:14.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:14 gibba013 bash[30381]: cluster 2021-03-10T14:11:13.113610+0000 mgr.gibba020.yqfnwy (mgr.34427) 1002 : cluster [DBG] pgmap v558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:15.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:15 gibba020 bash[25448]: cephadm 2021-03-10T14:11:13.566791+0000 mgr.gibba020.yqfnwy (mgr.34427) 1003 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:11:15.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:15 gibba013 bash[29418]: cephadm 2021-03-10T14:11:13.566791+0000 mgr.gibba020.yqfnwy (mgr.34427) 1003 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:11:15.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:15 gibba013 bash[30381]: cephadm 2021-03-10T14:11:13.566791+0000 mgr.gibba020.yqfnwy (mgr.34427) 1003 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:11:16.525 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:11:16.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:16 gibba020 bash[25448]: cluster 2021-03-10T14:11:15.115313+0000 mgr.gibba020.yqfnwy (mgr.34427) 1004 : cluster [DBG] pgmap v559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:16.763 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:11:16.763 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (17m) 3m ago 23m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:11:16.764 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (22m) 2m ago 22m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:11:16.764 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (18m) 2m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:11:16.764 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (18m) 2m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:11:16.764 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (17m) 3m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:11:16.764 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (17m) 3m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:11:16.765 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (16m) 2m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:11:16.765 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (17m) 3m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:11:16.765 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (23m) 3m ago 23m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:11:16.765 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (23m) 2m ago 23m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:11:16.765 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (16m) 3m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:11:16.766 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (15m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:11:16.766 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (15m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:11:16.766 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (14m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:11:16.766 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (14m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:11:16.766 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (13m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:11:16.767 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (13m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:11:16.767 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (13m) 2m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:11:16.767 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (22m) 2m ago 23m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:11:16.767 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 21m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:11:16.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:16 gibba013 bash[29418]: cluster 2021-03-10T14:11:15.115313+0000 mgr.gibba020.yqfnwy (mgr.34427) 1004 : cluster [DBG] pgmap v559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:16.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:16 gibba013 bash[30381]: cluster 2021-03-10T14:11:15.115313+0000 mgr.gibba020.yqfnwy (mgr.34427) 1004 : cluster [DBG] pgmap v559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:17.017 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:11:17.018 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:11:17.018 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:11:17.018 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:11:17.018 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:11:17.019 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:11:17.019 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:11:17.019 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:11:17.019 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:11:17.019 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:11:17.020 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:11:17.020 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:11:17.020 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:11:17.020 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:11:17.020 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:11:17.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:17 gibba020 bash[25448]: audit 2021-03-10T14:11:16.512568+0000 mgr.gibba020.yqfnwy (mgr.34427) 1005 : audit [DBG] from='client.44736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:11:17.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:17 gibba020 bash[25448]: audit 2021-03-10T14:11:17.016160+0000 mon.c (mon.1) 28 : audit [DBG] from='client.? 172.21.2.113:0/1029674053' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:17.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:17 gibba013 bash[29418]: audit 2021-03-10T14:11:16.512568+0000 mgr.gibba020.yqfnwy (mgr.34427) 1005 : audit [DBG] from='client.44736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:11:17.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:17 gibba013 bash[29418]: audit 2021-03-10T14:11:17.016160+0000 mon.c (mon.1) 28 : audit [DBG] from='client.? 172.21.2.113:0/1029674053' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:17.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:17 gibba013 bash[30381]: audit 2021-03-10T14:11:16.512568+0000 mgr.gibba020.yqfnwy (mgr.34427) 1005 : audit [DBG] from='client.44736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:11:17.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:17 gibba013 bash[30381]: audit 2021-03-10T14:11:17.016160+0000 mon.c (mon.1) 28 : audit [DBG] from='client.? 172.21.2.113:0/1029674053' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:18.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:18 gibba020 bash[25448]: audit 2021-03-10T14:11:16.747480+0000 mgr.gibba020.yqfnwy (mgr.34427) 1006 : audit [DBG] from='client.54727 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:11:18.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:18 gibba020 bash[25448]: cluster 2021-03-10T14:11:17.116702+0000 mgr.gibba020.yqfnwy (mgr.34427) 1007 : cluster [DBG] pgmap v560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:18.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:18 gibba013 bash[29418]: audit 2021-03-10T14:11:16.747480+0000 mgr.gibba020.yqfnwy (mgr.34427) 1006 : audit [DBG] from='client.54727 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:11:18.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:18 gibba013 bash[29418]: cluster 2021-03-10T14:11:17.116702+0000 mgr.gibba020.yqfnwy (mgr.34427) 1007 : cluster [DBG] pgmap v560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:18.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:18 gibba013 bash[30381]: audit 2021-03-10T14:11:16.747480+0000 mgr.gibba020.yqfnwy (mgr.34427) 1006 : audit [DBG] from='client.54727 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:11:18.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:18 gibba013 bash[30381]: cluster 2021-03-10T14:11:17.116702+0000 mgr.gibba020.yqfnwy (mgr.34427) 1007 : cluster [DBG] pgmap v560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:20.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:20 gibba013 bash[29418]: cluster 2021-03-10T14:11:19.118184+0000 mgr.gibba020.yqfnwy (mgr.34427) 1008 : cluster [DBG] pgmap v561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:20.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:20 gibba013 bash[30381]: cluster 2021-03-10T14:11:19.118184+0000 mgr.gibba020.yqfnwy (mgr.34427) 1008 : cluster [DBG] pgmap v561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:20.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:20 gibba020 bash[25448]: cluster 2021-03-10T14:11:19.118184+0000 mgr.gibba020.yqfnwy (mgr.34427) 1008 : cluster [DBG] pgmap v561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:22.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:22 gibba013 bash[29418]: cluster 2021-03-10T14:11:21.120090+0000 mgr.gibba020.yqfnwy (mgr.34427) 1009 : cluster [DBG] pgmap v562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:22.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:22 gibba013 bash[30381]: cluster 2021-03-10T14:11:21.120090+0000 mgr.gibba020.yqfnwy (mgr.34427) 1009 : cluster [DBG] pgmap v562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:22.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:22 gibba020 bash[25448]: cluster 2021-03-10T14:11:21.120090+0000 mgr.gibba020.yqfnwy (mgr.34427) 1009 : cluster [DBG] pgmap v562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:24.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:24 gibba013 bash[29418]: cluster 2021-03-10T14:11:23.121328+0000 mgr.gibba020.yqfnwy (mgr.34427) 1010 : cluster [DBG] pgmap v563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:24.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:24 gibba013 bash[30381]: cluster 2021-03-10T14:11:23.121328+0000 mgr.gibba020.yqfnwy (mgr.34427) 1010 : cluster [DBG] pgmap v563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:24.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:24 gibba020 bash[25448]: cluster 2021-03-10T14:11:23.121328+0000 mgr.gibba020.yqfnwy (mgr.34427) 1010 : cluster [DBG] pgmap v563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:26.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:26 gibba013 bash[29418]: cluster 2021-03-10T14:11:25.123008+0000 mgr.gibba020.yqfnwy (mgr.34427) 1011 : cluster [DBG] pgmap v564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:26.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:26 gibba013 bash[30381]: cluster 2021-03-10T14:11:25.123008+0000 mgr.gibba020.yqfnwy (mgr.34427) 1011 : cluster [DBG] pgmap v564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:26.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:26 gibba020 bash[25448]: cluster 2021-03-10T14:11:25.123008+0000 mgr.gibba020.yqfnwy (mgr.34427) 1011 : cluster [DBG] pgmap v564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:28.826 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:28 gibba020 bash[25448]: cluster 2021-03-10T14:11:27.124543+0000 mgr.gibba020.yqfnwy (mgr.34427) 1012 : cluster [DBG] pgmap v565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:28.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:28 gibba013 bash[30381]: cluster 2021-03-10T14:11:27.124543+0000 mgr.gibba020.yqfnwy (mgr.34427) 1012 : cluster [DBG] pgmap v565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:28.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:28 gibba013 bash[29418]: cluster 2021-03-10T14:11:27.124543+0000 mgr.gibba020.yqfnwy (mgr.34427) 1012 : cluster [DBG] pgmap v565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:29.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:29 gibba013 bash[29418]: audit 2021-03-10T14:11:28.583716+0000 mon.a (mon.0) 850 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:11:29.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:29 gibba013 bash[29418]: audit 2021-03-10T14:11:28.812358+0000 mon.a (mon.0) 851 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:11:29.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:29 gibba013 bash[29418]: audit 2021-03-10T14:11:28.815702+0000 mon.a (mon.0) 852 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:11:29.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:29 gibba013 bash[29418]: audit 2021-03-10T14:11:28.817033+0000 mon.a (mon.0) 853 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:29.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:29 gibba013 bash[29418]: audit 2021-03-10T14:11:28.818263+0000 mon.a (mon.0) 854 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:29.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:29 gibba013 bash[29418]: audit 2021-03-10T14:11:28.819736+0000 mon.a (mon.0) 855 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:29.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:29 gibba013 bash[29418]: audit 2021-03-10T14:11:28.821928+0000 mon.a (mon.0) 856 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:29.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:29 gibba013 bash[29418]: audit 2021-03-10T14:11:28.823879+0000 mon.a (mon.0) 857 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:29.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:29 gibba013 bash[30381]: audit 2021-03-10T14:11:28.583716+0000 mon.a (mon.0) 850 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:11:29.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:29 gibba013 bash[30381]: audit 2021-03-10T14:11:28.812358+0000 mon.a (mon.0) 851 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:11:29.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:29 gibba013 bash[30381]: audit 2021-03-10T14:11:28.815702+0000 mon.a (mon.0) 852 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:11:29.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:29 gibba013 bash[30381]: audit 2021-03-10T14:11:28.817033+0000 mon.a (mon.0) 853 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:29.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:29 gibba013 bash[30381]: audit 2021-03-10T14:11:28.818263+0000 mon.a (mon.0) 854 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:29.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:29 gibba013 bash[30381]: audit 2021-03-10T14:11:28.819736+0000 mon.a (mon.0) 855 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:29.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:29 gibba013 bash[30381]: audit 2021-03-10T14:11:28.821928+0000 mon.a (mon.0) 856 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:29.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:29 gibba013 bash[30381]: audit 2021-03-10T14:11:28.823879+0000 mon.a (mon.0) 857 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:29.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:29 gibba020 bash[25448]: audit 2021-03-10T14:11:28.583716+0000 mon.a (mon.0) 850 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:11:29.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:29 gibba020 bash[25448]: audit 2021-03-10T14:11:28.812358+0000 mon.a (mon.0) 851 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:11:29.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:29 gibba020 bash[25448]: audit 2021-03-10T14:11:28.815702+0000 mon.a (mon.0) 852 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:11:29.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:29 gibba020 bash[25448]: audit 2021-03-10T14:11:28.817033+0000 mon.a (mon.0) 853 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:29.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:29 gibba020 bash[25448]: audit 2021-03-10T14:11:28.818263+0000 mon.a (mon.0) 854 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:29.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:29 gibba020 bash[25448]: audit 2021-03-10T14:11:28.819736+0000 mon.a (mon.0) 855 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:29.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:29 gibba020 bash[25448]: audit 2021-03-10T14:11:28.821928+0000 mon.a (mon.0) 856 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:29.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:29 gibba020 bash[25448]: audit 2021-03-10T14:11:28.823879+0000 mon.a (mon.0) 857 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:30.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:30 gibba013 bash[29418]: cephadm 2021-03-10T14:11:28.586302+0000 mgr.gibba020.yqfnwy (mgr.34427) 1013 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:11:30.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:30 gibba013 bash[29418]: cephadm 2021-03-10T14:11:28.588208+0000 mgr.gibba020.yqfnwy (mgr.34427) 1014 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:11:30.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:30 gibba013 bash[29418]: cephadm 2021-03-10T14:11:28.812889+0000 mgr.gibba020.yqfnwy (mgr.34427) 1015 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:11:30.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:30 gibba013 bash[29418]: cephadm 2021-03-10T14:11:28.814551+0000 mgr.gibba020.yqfnwy (mgr.34427) 1016 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:11:30.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:30 gibba013 bash[29418]: cephadm 2021-03-10T14:11:28.815704+0000 mgr.gibba020.yqfnwy (mgr.34427) 1017 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:11:30.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:30 gibba013 bash[29418]: cephadm 2021-03-10T14:11:28.815751+0000 mgr.gibba020.yqfnwy (mgr.34427) 1018 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:11:30.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:30 gibba013 bash[29418]: cephadm 2021-03-10T14:11:28.817132+0000 mgr.gibba020.yqfnwy (mgr.34427) 1019 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:11:30.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:30 gibba013 bash[29418]: cephadm 2021-03-10T14:11:28.817191+0000 mgr.gibba020.yqfnwy (mgr.34427) 1020 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:11:30.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:30 gibba013 bash[29418]: cephadm 2021-03-10T14:11:28.818279+0000 mgr.gibba020.yqfnwy (mgr.34427) 1021 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:11:30.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:30 gibba013 bash[29418]: cephadm 2021-03-10T14:11:28.819122+0000 mgr.gibba020.yqfnwy (mgr.34427) 1022 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:11:30.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:30 gibba013 bash[29418]: cephadm 2021-03-10T14:11:28.819169+0000 mgr.gibba020.yqfnwy (mgr.34427) 1023 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:11:30.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:30 gibba013 bash[29418]: cephadm 2021-03-10T14:11:28.820952+0000 mgr.gibba020.yqfnwy (mgr.34427) 1024 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:11:30.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:30 gibba013 bash[29418]: cephadm 2021-03-10T14:11:28.821331+0000 mgr.gibba020.yqfnwy (mgr.34427) 1025 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:11:30.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:30 gibba013 bash[29418]: cephadm 2021-03-10T14:11:28.822463+0000 mgr.gibba020.yqfnwy (mgr.34427) 1026 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:11:30.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:30 gibba013 bash[29418]: cephadm 2021-03-10T14:11:28.822515+0000 mgr.gibba020.yqfnwy (mgr.34427) 1027 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:11:30.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:30 gibba013 bash[29418]: cephadm 2021-03-10T14:11:28.822648+0000 mgr.gibba020.yqfnwy (mgr.34427) 1028 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:11:30.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:30 gibba013 bash[29418]: cluster 2021-03-10T14:11:29.126228+0000 mgr.gibba020.yqfnwy (mgr.34427) 1029 : cluster [DBG] pgmap v566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:30.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:30 gibba013 bash[30381]: cephadm 2021-03-10T14:11:28.586302+0000 mgr.gibba020.yqfnwy (mgr.34427) 1013 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:11:30.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:30 gibba013 bash[30381]: cephadm 2021-03-10T14:11:28.588208+0000 mgr.gibba020.yqfnwy (mgr.34427) 1014 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:11:30.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:30 gibba013 bash[30381]: cephadm 2021-03-10T14:11:28.812889+0000 mgr.gibba020.yqfnwy (mgr.34427) 1015 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:11:30.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:30 gibba013 bash[30381]: cephadm 2021-03-10T14:11:28.814551+0000 mgr.gibba020.yqfnwy (mgr.34427) 1016 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:11:30.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:30 gibba013 bash[30381]: cephadm 2021-03-10T14:11:28.815704+0000 mgr.gibba020.yqfnwy (mgr.34427) 1017 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:11:30.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:30 gibba013 bash[30381]: cephadm 2021-03-10T14:11:28.815751+0000 mgr.gibba020.yqfnwy (mgr.34427) 1018 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:11:30.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:30 gibba013 bash[30381]: cephadm 2021-03-10T14:11:28.817132+0000 mgr.gibba020.yqfnwy (mgr.34427) 1019 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:11:30.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:30 gibba013 bash[30381]: cephadm 2021-03-10T14:11:28.817191+0000 mgr.gibba020.yqfnwy (mgr.34427) 1020 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:11:30.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:30 gibba013 bash[30381]: cephadm 2021-03-10T14:11:28.818279+0000 mgr.gibba020.yqfnwy (mgr.34427) 1021 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:11:30.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:30 gibba013 bash[30381]: cephadm 2021-03-10T14:11:28.819122+0000 mgr.gibba020.yqfnwy (mgr.34427) 1022 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:11:30.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:30 gibba013 bash[30381]: cephadm 2021-03-10T14:11:28.819169+0000 mgr.gibba020.yqfnwy (mgr.34427) 1023 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:11:30.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:30 gibba013 bash[30381]: cephadm 2021-03-10T14:11:28.820952+0000 mgr.gibba020.yqfnwy (mgr.34427) 1024 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:11:30.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:30 gibba013 bash[30381]: cephadm 2021-03-10T14:11:28.821331+0000 mgr.gibba020.yqfnwy (mgr.34427) 1025 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:11:30.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:30 gibba013 bash[30381]: cephadm 2021-03-10T14:11:28.822463+0000 mgr.gibba020.yqfnwy (mgr.34427) 1026 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:11:30.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:30 gibba013 bash[30381]: cephadm 2021-03-10T14:11:28.822515+0000 mgr.gibba020.yqfnwy (mgr.34427) 1027 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:11:30.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:30 gibba013 bash[30381]: cephadm 2021-03-10T14:11:28.822648+0000 mgr.gibba020.yqfnwy (mgr.34427) 1028 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:11:30.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:30 gibba013 bash[30381]: cluster 2021-03-10T14:11:29.126228+0000 mgr.gibba020.yqfnwy (mgr.34427) 1029 : cluster [DBG] pgmap v566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:30.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:30 gibba020 bash[25448]: cephadm 2021-03-10T14:11:28.586302+0000 mgr.gibba020.yqfnwy (mgr.34427) 1013 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:11:30.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:30 gibba020 bash[25448]: cephadm 2021-03-10T14:11:28.588208+0000 mgr.gibba020.yqfnwy (mgr.34427) 1014 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:11:30.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:30 gibba020 bash[25448]: cephadm 2021-03-10T14:11:28.812889+0000 mgr.gibba020.yqfnwy (mgr.34427) 1015 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:11:30.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:30 gibba020 bash[25448]: cephadm 2021-03-10T14:11:28.814551+0000 mgr.gibba020.yqfnwy (mgr.34427) 1016 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:11:30.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:30 gibba020 bash[25448]: cephadm 2021-03-10T14:11:28.815704+0000 mgr.gibba020.yqfnwy (mgr.34427) 1017 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:11:30.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:30 gibba020 bash[25448]: cephadm 2021-03-10T14:11:28.815751+0000 mgr.gibba020.yqfnwy (mgr.34427) 1018 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:11:30.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:30 gibba020 bash[25448]: cephadm 2021-03-10T14:11:28.817132+0000 mgr.gibba020.yqfnwy (mgr.34427) 1019 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:11:30.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:30 gibba020 bash[25448]: cephadm 2021-03-10T14:11:28.817191+0000 mgr.gibba020.yqfnwy (mgr.34427) 1020 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:11:30.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:30 gibba020 bash[25448]: cephadm 2021-03-10T14:11:28.818279+0000 mgr.gibba020.yqfnwy (mgr.34427) 1021 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:11:30.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:30 gibba020 bash[25448]: cephadm 2021-03-10T14:11:28.819122+0000 mgr.gibba020.yqfnwy (mgr.34427) 1022 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:11:30.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:30 gibba020 bash[25448]: cephadm 2021-03-10T14:11:28.819169+0000 mgr.gibba020.yqfnwy (mgr.34427) 1023 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:11:30.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:30 gibba020 bash[25448]: cephadm 2021-03-10T14:11:28.820952+0000 mgr.gibba020.yqfnwy (mgr.34427) 1024 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:11:30.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:30 gibba020 bash[25448]: cephadm 2021-03-10T14:11:28.821331+0000 mgr.gibba020.yqfnwy (mgr.34427) 1025 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:11:30.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:30 gibba020 bash[25448]: cephadm 2021-03-10T14:11:28.822463+0000 mgr.gibba020.yqfnwy (mgr.34427) 1026 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:11:30.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:30 gibba020 bash[25448]: cephadm 2021-03-10T14:11:28.822515+0000 mgr.gibba020.yqfnwy (mgr.34427) 1027 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:11:30.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:30 gibba020 bash[25448]: cephadm 2021-03-10T14:11:28.822648+0000 mgr.gibba020.yqfnwy (mgr.34427) 1028 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:11:30.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:30 gibba020 bash[25448]: cluster 2021-03-10T14:11:29.126228+0000 mgr.gibba020.yqfnwy (mgr.34427) 1029 : cluster [DBG] pgmap v566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:32.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:32 gibba013 bash[29418]: cluster 2021-03-10T14:11:31.128087+0000 mgr.gibba020.yqfnwy (mgr.34427) 1030 : cluster [DBG] pgmap v567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:32.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:32 gibba013 bash[30381]: cluster 2021-03-10T14:11:31.128087+0000 mgr.gibba020.yqfnwy (mgr.34427) 1030 : cluster [DBG] pgmap v567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:32.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:32 gibba020 bash[25448]: cluster 2021-03-10T14:11:31.128087+0000 mgr.gibba020.yqfnwy (mgr.34427) 1030 : cluster [DBG] pgmap v567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:34.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:34 gibba013 bash[29418]: cluster 2021-03-10T14:11:33.129329+0000 mgr.gibba020.yqfnwy (mgr.34427) 1031 : cluster [DBG] pgmap v568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:34.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:34 gibba013 bash[30381]: cluster 2021-03-10T14:11:33.129329+0000 mgr.gibba020.yqfnwy (mgr.34427) 1031 : cluster [DBG] pgmap v568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:34.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:34 gibba020 bash[25448]: cluster 2021-03-10T14:11:33.129329+0000 mgr.gibba020.yqfnwy (mgr.34427) 1031 : cluster [DBG] pgmap v568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:36.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:36 gibba013 bash[29418]: cluster 2021-03-10T14:11:35.131132+0000 mgr.gibba020.yqfnwy (mgr.34427) 1032 : cluster [DBG] pgmap v569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:36.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:36 gibba013 bash[30381]: cluster 2021-03-10T14:11:35.131132+0000 mgr.gibba020.yqfnwy (mgr.34427) 1032 : cluster [DBG] pgmap v569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:36.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:36 gibba020 bash[25448]: cluster 2021-03-10T14:11:35.131132+0000 mgr.gibba020.yqfnwy (mgr.34427) 1032 : cluster [DBG] pgmap v569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:38.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:38 gibba013 bash[29418]: cluster 2021-03-10T14:11:37.132448+0000 mgr.gibba020.yqfnwy (mgr.34427) 1033 : cluster [DBG] pgmap v570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:38.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:38 gibba013 bash[30381]: cluster 2021-03-10T14:11:37.132448+0000 mgr.gibba020.yqfnwy (mgr.34427) 1033 : cluster [DBG] pgmap v570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:38.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:38 gibba020 bash[25448]: cluster 2021-03-10T14:11:37.132448+0000 mgr.gibba020.yqfnwy (mgr.34427) 1033 : cluster [DBG] pgmap v570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:40.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:40 gibba013 bash[29418]: cluster 2021-03-10T14:11:39.133952+0000 mgr.gibba020.yqfnwy (mgr.34427) 1034 : cluster [DBG] pgmap v571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:40.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:40 gibba013 bash[30381]: cluster 2021-03-10T14:11:39.133952+0000 mgr.gibba020.yqfnwy (mgr.34427) 1034 : cluster [DBG] pgmap v571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:40.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:40 gibba020 bash[25448]: cluster 2021-03-10T14:11:39.133952+0000 mgr.gibba020.yqfnwy (mgr.34427) 1034 : cluster [DBG] pgmap v571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:42.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:42 gibba013 bash[29418]: cluster 2021-03-10T14:11:41.135862+0000 mgr.gibba020.yqfnwy (mgr.34427) 1035 : cluster [DBG] pgmap v572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:42.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:42 gibba013 bash[30381]: cluster 2021-03-10T14:11:41.135862+0000 mgr.gibba020.yqfnwy (mgr.34427) 1035 : cluster [DBG] pgmap v572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:42.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:42 gibba020 bash[25448]: cluster 2021-03-10T14:11:41.135862+0000 mgr.gibba020.yqfnwy (mgr.34427) 1035 : cluster [DBG] pgmap v572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:43.842 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:43 gibba020 bash[25448]: cluster 2021-03-10T14:11:43.137104+0000 mgr.gibba020.yqfnwy (mgr.34427) 1036 : cluster [DBG] pgmap v573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:43.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:43 gibba013 bash[29418]: cluster 2021-03-10T14:11:43.137104+0000 mgr.gibba020.yqfnwy (mgr.34427) 1036 : cluster [DBG] pgmap v573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:43.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:43 gibba013 bash[30381]: cluster 2021-03-10T14:11:43.137104+0000 mgr.gibba020.yqfnwy (mgr.34427) 1036 : cluster [DBG] pgmap v573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:44.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:44 gibba013 bash[29418]: cephadm 2021-03-10T14:11:43.838679+0000 mgr.gibba020.yqfnwy (mgr.34427) 1037 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:11:44.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:44 gibba013 bash[30381]: cephadm 2021-03-10T14:11:43.838679+0000 mgr.gibba020.yqfnwy (mgr.34427) 1037 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:11:44.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:44 gibba020 bash[25448]: cephadm 2021-03-10T14:11:43.838679+0000 mgr.gibba020.yqfnwy (mgr.34427) 1037 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:11:46.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:46 gibba013 bash[29418]: cluster 2021-03-10T14:11:45.138767+0000 mgr.gibba020.yqfnwy (mgr.34427) 1038 : cluster [DBG] pgmap v574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:46.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:46 gibba013 bash[30381]: cluster 2021-03-10T14:11:45.138767+0000 mgr.gibba020.yqfnwy (mgr.34427) 1038 : cluster [DBG] pgmap v574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:46.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:46 gibba020 bash[25448]: cluster 2021-03-10T14:11:45.138767+0000 mgr.gibba020.yqfnwy (mgr.34427) 1038 : cluster [DBG] pgmap v574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:47.263 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:11:47.491 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:11:47.491 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (18m) 4m ago 23m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:11:47.491 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (23m) 3m ago 23m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:11:47.491 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (18m) 3m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:11:47.492 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (18m) 3m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:11:47.492 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (17m) 4m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:11:47.492 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (17m) 4m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:11:47.492 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (17m) 3m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:11:47.492 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (17m) 4m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:11:47.493 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (23m) 4m ago 23m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:11:47.493 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (23m) 3m ago 23m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:11:47.493 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (16m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:11:47.493 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (16m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:11:47.493 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (15m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:11:47.494 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (15m) 4m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:11:47.494 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (14m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:11:47.494 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (14m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:11:47.494 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (13m) 3m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:11:47.495 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (13m) 3m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:11:47.495 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (23m) 3m ago 23m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:11:47.495 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 3m ago 21m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:11:47.741 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:11:47.741 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:11:47.741 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:11:47.741 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:11:47.742 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:11:47.742 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:11:47.742 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:11:47.742 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:11:47.743 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:11:47.743 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:11:47.743 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:11:47.743 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:11:47.743 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:11:47.744 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:11:47.744 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:11:48.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:48 gibba013 bash[29418]: cluster 2021-03-10T14:11:47.140030+0000 mgr.gibba020.yqfnwy (mgr.34427) 1039 : cluster [DBG] pgmap v575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:48.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:48 gibba013 bash[29418]: audit 2021-03-10T14:11:47.249990+0000 mgr.gibba020.yqfnwy (mgr.34427) 1040 : audit [DBG] from='client.54739 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:11:48.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:48 gibba013 bash[29418]: audit 2021-03-10T14:11:47.475139+0000 mgr.gibba020.yqfnwy (mgr.34427) 1041 : audit [DBG] from='client.44760 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:11:48.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:48 gibba013 bash[29418]: audit 2021-03-10T14:11:47.739452+0000 mon.c (mon.1) 29 : audit [DBG] from='client.? 172.21.2.113:0/2703898080' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:48.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:48 gibba013 bash[30381]: cluster 2021-03-10T14:11:47.140030+0000 mgr.gibba020.yqfnwy (mgr.34427) 1039 : cluster [DBG] pgmap v575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:48.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:48 gibba013 bash[30381]: audit 2021-03-10T14:11:47.249990+0000 mgr.gibba020.yqfnwy (mgr.34427) 1040 : audit [DBG] from='client.54739 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:11:48.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:48 gibba013 bash[30381]: audit 2021-03-10T14:11:47.475139+0000 mgr.gibba020.yqfnwy (mgr.34427) 1041 : audit [DBG] from='client.44760 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:11:48.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:48 gibba013 bash[30381]: audit 2021-03-10T14:11:47.739452+0000 mon.c (mon.1) 29 : audit [DBG] from='client.? 172.21.2.113:0/2703898080' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:48.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:48 gibba020 bash[25448]: cluster 2021-03-10T14:11:47.140030+0000 mgr.gibba020.yqfnwy (mgr.34427) 1039 : cluster [DBG] pgmap v575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:48.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:48 gibba020 bash[25448]: audit 2021-03-10T14:11:47.249990+0000 mgr.gibba020.yqfnwy (mgr.34427) 1040 : audit [DBG] from='client.54739 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:11:48.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:48 gibba020 bash[25448]: audit 2021-03-10T14:11:47.475139+0000 mgr.gibba020.yqfnwy (mgr.34427) 1041 : audit [DBG] from='client.44760 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:11:48.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:48 gibba020 bash[25448]: audit 2021-03-10T14:11:47.739452+0000 mon.c (mon.1) 29 : audit [DBG] from='client.? 172.21.2.113:0/2703898080' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:11:50.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:50 gibba013 bash[29418]: cluster 2021-03-10T14:11:49.141728+0000 mgr.gibba020.yqfnwy (mgr.34427) 1042 : cluster [DBG] pgmap v576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:50.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:50 gibba013 bash[30381]: cluster 2021-03-10T14:11:49.141728+0000 mgr.gibba020.yqfnwy (mgr.34427) 1042 : cluster [DBG] pgmap v576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:50.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:50 gibba020 bash[25448]: cluster 2021-03-10T14:11:49.141728+0000 mgr.gibba020.yqfnwy (mgr.34427) 1042 : cluster [DBG] pgmap v576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:52.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:52 gibba013 bash[29418]: cluster 2021-03-10T14:11:51.143532+0000 mgr.gibba020.yqfnwy (mgr.34427) 1043 : cluster [DBG] pgmap v577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:52.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:52 gibba013 bash[30381]: cluster 2021-03-10T14:11:51.143532+0000 mgr.gibba020.yqfnwy (mgr.34427) 1043 : cluster [DBG] pgmap v577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:52.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:52 gibba020 bash[25448]: cluster 2021-03-10T14:11:51.143532+0000 mgr.gibba020.yqfnwy (mgr.34427) 1043 : cluster [DBG] pgmap v577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:54.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:54 gibba013 bash[29418]: cluster 2021-03-10T14:11:53.144800+0000 mgr.gibba020.yqfnwy (mgr.34427) 1044 : cluster [DBG] pgmap v578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:54.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:54 gibba013 bash[30381]: cluster 2021-03-10T14:11:53.144800+0000 mgr.gibba020.yqfnwy (mgr.34427) 1044 : cluster [DBG] pgmap v578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:54.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:54 gibba020 bash[25448]: cluster 2021-03-10T14:11:53.144800+0000 mgr.gibba020.yqfnwy (mgr.34427) 1044 : cluster [DBG] pgmap v578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:56.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:56 gibba013 bash[29418]: cluster 2021-03-10T14:11:55.146669+0000 mgr.gibba020.yqfnwy (mgr.34427) 1045 : cluster [DBG] pgmap v579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:56.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:56 gibba013 bash[30381]: cluster 2021-03-10T14:11:55.146669+0000 mgr.gibba020.yqfnwy (mgr.34427) 1045 : cluster [DBG] pgmap v579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:56.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:56 gibba020 bash[25448]: cluster 2021-03-10T14:11:55.146669+0000 mgr.gibba020.yqfnwy (mgr.34427) 1045 : cluster [DBG] pgmap v579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:58.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:11:58 gibba013 bash[29418]: cluster 2021-03-10T14:11:57.148119+0000 mgr.gibba020.yqfnwy (mgr.34427) 1046 : cluster [DBG] pgmap v580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:58.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:11:58 gibba013 bash[30381]: cluster 2021-03-10T14:11:57.148119+0000 mgr.gibba020.yqfnwy (mgr.34427) 1046 : cluster [DBG] pgmap v580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:11:58.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:11:58 gibba020 bash[25448]: cluster 2021-03-10T14:11:57.148119+0000 mgr.gibba020.yqfnwy (mgr.34427) 1046 : cluster [DBG] pgmap v580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:00.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:00 gibba013 bash[29418]: cephadm 2021-03-10T14:11:58.854724+0000 mgr.gibba020.yqfnwy (mgr.34427) 1047 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:12:00.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:00 gibba013 bash[29418]: cluster 2021-03-10T14:11:59.149519+0000 mgr.gibba020.yqfnwy (mgr.34427) 1048 : cluster [DBG] pgmap v581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:00.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:00 gibba013 bash[30381]: cephadm 2021-03-10T14:11:58.854724+0000 mgr.gibba020.yqfnwy (mgr.34427) 1047 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:12:00.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:00 gibba013 bash[30381]: cluster 2021-03-10T14:11:59.149519+0000 mgr.gibba020.yqfnwy (mgr.34427) 1048 : cluster [DBG] pgmap v581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:00.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:00 gibba020 bash[25448]: cephadm 2021-03-10T14:11:58.854724+0000 mgr.gibba020.yqfnwy (mgr.34427) 1047 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:12:00.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:00 gibba020 bash[25448]: cluster 2021-03-10T14:11:59.149519+0000 mgr.gibba020.yqfnwy (mgr.34427) 1048 : cluster [DBG] pgmap v581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:02.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:02 gibba013 bash[29418]: cluster 2021-03-10T14:12:01.151108+0000 mgr.gibba020.yqfnwy (mgr.34427) 1049 : cluster [DBG] pgmap v582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:02.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:02 gibba013 bash[30381]: cluster 2021-03-10T14:12:01.151108+0000 mgr.gibba020.yqfnwy (mgr.34427) 1049 : cluster [DBG] pgmap v582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:02.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:02 gibba020 bash[25448]: cluster 2021-03-10T14:12:01.151108+0000 mgr.gibba020.yqfnwy (mgr.34427) 1049 : cluster [DBG] pgmap v582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:04.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:04 gibba013 bash[29418]: cluster 2021-03-10T14:12:03.152360+0000 mgr.gibba020.yqfnwy (mgr.34427) 1050 : cluster [DBG] pgmap v583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:04.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:04 gibba013 bash[30381]: cluster 2021-03-10T14:12:03.152360+0000 mgr.gibba020.yqfnwy (mgr.34427) 1050 : cluster [DBG] pgmap v583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:04.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:04 gibba020 bash[25448]: cluster 2021-03-10T14:12:03.152360+0000 mgr.gibba020.yqfnwy (mgr.34427) 1050 : cluster [DBG] pgmap v583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:06 gibba013 bash[29418]: cluster 2021-03-10T14:12:05.152924+0000 mgr.gibba020.yqfnwy (mgr.34427) 1051 : cluster [DBG] pgmap v584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:06 gibba013 bash[29418]: audit 2021-03-10T14:12:05.898388+0000 mon.a (mon.0) 858 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T14:12:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:06 gibba013 bash[29418]: audit 2021-03-10T14:12:05.899629+0000 mon.a (mon.0) 859 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:12:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:06 gibba013 bash[29418]: audit 2021-03-10T14:12:05.900676+0000 mon.a (mon.0) 860 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:12:06.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:06 gibba013 bash[29418]: audit 2021-03-10T14:12:05.901339+0000 mon.a (mon.0) 861 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:12:06.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:06 gibba013 bash[29418]: audit 2021-03-10T14:12:06.049615+0000 mon.a (mon.0) 862 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:12:06.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:06 gibba013 bash[29418]: audit 2021-03-10T14:12:06.055785+0000 mon.a (mon.0) 863 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:12:06.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:06 gibba013 bash[30381]: cluster 2021-03-10T14:12:05.152924+0000 mgr.gibba020.yqfnwy (mgr.34427) 1051 : cluster [DBG] pgmap v584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:06.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:06 gibba013 bash[30381]: audit 2021-03-10T14:12:05.898388+0000 mon.a (mon.0) 858 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T14:12:06.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:06 gibba013 bash[30381]: audit 2021-03-10T14:12:05.899629+0000 mon.a (mon.0) 859 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:12:06.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:06 gibba013 bash[30381]: audit 2021-03-10T14:12:05.900676+0000 mon.a (mon.0) 860 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:12:06.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:06 gibba013 bash[30381]: audit 2021-03-10T14:12:05.901339+0000 mon.a (mon.0) 861 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:12:06.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:06 gibba013 bash[30381]: audit 2021-03-10T14:12:06.049615+0000 mon.a (mon.0) 862 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:12:06.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:06 gibba013 bash[30381]: audit 2021-03-10T14:12:06.055785+0000 mon.a (mon.0) 863 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:12:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:06 gibba020 bash[25448]: cluster 2021-03-10T14:12:05.152924+0000 mgr.gibba020.yqfnwy (mgr.34427) 1051 : cluster [DBG] pgmap v584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:06 gibba020 bash[25448]: audit 2021-03-10T14:12:05.898388+0000 mon.a (mon.0) 858 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T14:12:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:06 gibba020 bash[25448]: audit 2021-03-10T14:12:05.899629+0000 mon.a (mon.0) 859 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:12:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:06 gibba020 bash[25448]: audit 2021-03-10T14:12:05.900676+0000 mon.a (mon.0) 860 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:12:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:06 gibba020 bash[25448]: audit 2021-03-10T14:12:05.901339+0000 mon.a (mon.0) 861 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:12:06.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:06 gibba020 bash[25448]: audit 2021-03-10T14:12:06.049615+0000 mon.a (mon.0) 862 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:12:06.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:06 gibba020 bash[25448]: audit 2021-03-10T14:12:06.055785+0000 mon.a (mon.0) 863 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:12:08.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:08 gibba013 bash[29418]: cluster 2021-03-10T14:12:07.154186+0000 mgr.gibba020.yqfnwy (mgr.34427) 1052 : cluster [DBG] pgmap v585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:08.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:08 gibba013 bash[30381]: cluster 2021-03-10T14:12:07.154186+0000 mgr.gibba020.yqfnwy (mgr.34427) 1052 : cluster [DBG] pgmap v585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:08.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:08 gibba020 bash[25448]: cluster 2021-03-10T14:12:07.154186+0000 mgr.gibba020.yqfnwy (mgr.34427) 1052 : cluster [DBG] pgmap v585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:10.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:10 gibba013 bash[29418]: cluster 2021-03-10T14:12:09.155734+0000 mgr.gibba020.yqfnwy (mgr.34427) 1053 : cluster [DBG] pgmap v586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:10.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:10 gibba013 bash[30381]: cluster 2021-03-10T14:12:09.155734+0000 mgr.gibba020.yqfnwy (mgr.34427) 1053 : cluster [DBG] pgmap v586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:10.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:10 gibba020 bash[25448]: cluster 2021-03-10T14:12:09.155734+0000 mgr.gibba020.yqfnwy (mgr.34427) 1053 : cluster [DBG] pgmap v586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:12.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:12 gibba013 bash[29418]: cluster 2021-03-10T14:12:11.156597+0000 mgr.gibba020.yqfnwy (mgr.34427) 1054 : cluster [DBG] pgmap v587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:12.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:12 gibba013 bash[30381]: cluster 2021-03-10T14:12:11.156597+0000 mgr.gibba020.yqfnwy (mgr.34427) 1054 : cluster [DBG] pgmap v587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:12.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:12 gibba020 bash[25448]: cluster 2021-03-10T14:12:11.156597+0000 mgr.gibba020.yqfnwy (mgr.34427) 1054 : cluster [DBG] pgmap v587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:14.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:14 gibba013 bash[29418]: cluster 2021-03-10T14:12:13.157711+0000 mgr.gibba020.yqfnwy (mgr.34427) 1055 : cluster [DBG] pgmap v588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:14.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:14 gibba013 bash[30381]: cluster 2021-03-10T14:12:13.157711+0000 mgr.gibba020.yqfnwy (mgr.34427) 1055 : cluster [DBG] pgmap v588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:14.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:14 gibba020 bash[25448]: cluster 2021-03-10T14:12:13.157711+0000 mgr.gibba020.yqfnwy (mgr.34427) 1055 : cluster [DBG] pgmap v588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:15.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:15 gibba013 bash[29418]: cephadm 2021-03-10T14:12:13.870829+0000 mgr.gibba020.yqfnwy (mgr.34427) 1056 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:12:15.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:15 gibba013 bash[30381]: cephadm 2021-03-10T14:12:13.870829+0000 mgr.gibba020.yqfnwy (mgr.34427) 1056 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:12:15.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:15 gibba020 bash[25448]: cephadm 2021-03-10T14:12:13.870829+0000 mgr.gibba020.yqfnwy (mgr.34427) 1056 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:12:16.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:16 gibba013 bash[29418]: cluster 2021-03-10T14:12:15.159289+0000 mgr.gibba020.yqfnwy (mgr.34427) 1057 : cluster [DBG] pgmap v589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:16.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:16 gibba013 bash[30381]: cluster 2021-03-10T14:12:15.159289+0000 mgr.gibba020.yqfnwy (mgr.34427) 1057 : cluster [DBG] pgmap v589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:16.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:16 gibba020 bash[25448]: cluster 2021-03-10T14:12:15.159289+0000 mgr.gibba020.yqfnwy (mgr.34427) 1057 : cluster [DBG] pgmap v589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:17.984 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:12:18.215 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:12:18.216 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (18m) 4m ago 24m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:12:18.216 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (23m) 3m ago 23m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:12:18.216 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (19m) 3m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:12:18.216 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (19m) 3m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:12:18.217 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (18m) 4m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:12:18.217 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (18m) 4m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:12:18.217 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (17m) 3m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:12:18.217 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (18m) 4m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:12:18.217 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (24m) 4m ago 24m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:12:18.218 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (24m) 3m ago 24m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:12:18.218 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (17m) 4m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:12:18.218 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (16m) 4m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:12:18.218 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (16m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:12:18.218 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (15m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:12:18.219 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (15m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:12:18.219 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (14m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:12:18.219 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (14m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:12:18.219 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (14m) 3m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:12:18.219 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (23m) 3m ago 24m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:12:18.220 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 3m ago 22m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:12:18.467 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:12:18.467 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:12:18.467 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:12:18.468 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:12:18.468 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:12:18.468 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:12:18.468 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:12:18.468 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:12:18.469 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:12:18.469 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:12:18.469 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:12:18.469 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:12:18.469 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:12:18.470 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:12:18.470 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:12:18.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:18 gibba013 bash[29418]: cluster 2021-03-10T14:12:17.159990+0000 mgr.gibba020.yqfnwy (mgr.34427) 1058 : cluster [DBG] pgmap v590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:18.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:18 gibba013 bash[30381]: cluster 2021-03-10T14:12:17.159990+0000 mgr.gibba020.yqfnwy (mgr.34427) 1058 : cluster [DBG] pgmap v590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:18.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:18 gibba020 bash[25448]: cluster 2021-03-10T14:12:17.159990+0000 mgr.gibba020.yqfnwy (mgr.34427) 1058 : cluster [DBG] pgmap v590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:19.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:19 gibba013 bash[29418]: audit 2021-03-10T14:12:17.971197+0000 mgr.gibba020.yqfnwy (mgr.34427) 1059 : audit [DBG] from='client.44772 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:12:19.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:19 gibba013 bash[29418]: audit 2021-03-10T14:12:18.199491+0000 mgr.gibba020.yqfnwy (mgr.34427) 1060 : audit [DBG] from='client.44778 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:12:19.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:19 gibba013 bash[29418]: audit 2021-03-10T14:12:18.465651+0000 mon.a (mon.0) 864 : audit [DBG] from='client.? 172.21.2.113:0/3476817435' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:19.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:19 gibba013 bash[30381]: audit 2021-03-10T14:12:17.971197+0000 mgr.gibba020.yqfnwy (mgr.34427) 1059 : audit [DBG] from='client.44772 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:12:19.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:19 gibba013 bash[30381]: audit 2021-03-10T14:12:18.199491+0000 mgr.gibba020.yqfnwy (mgr.34427) 1060 : audit [DBG] from='client.44778 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:12:19.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:19 gibba013 bash[30381]: audit 2021-03-10T14:12:18.465651+0000 mon.a (mon.0) 864 : audit [DBG] from='client.? 172.21.2.113:0/3476817435' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:19.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:19 gibba020 bash[25448]: audit 2021-03-10T14:12:17.971197+0000 mgr.gibba020.yqfnwy (mgr.34427) 1059 : audit [DBG] from='client.44772 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:12:19.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:19 gibba020 bash[25448]: audit 2021-03-10T14:12:18.199491+0000 mgr.gibba020.yqfnwy (mgr.34427) 1060 : audit [DBG] from='client.44778 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:12:19.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:19 gibba020 bash[25448]: audit 2021-03-10T14:12:18.465651+0000 mon.a (mon.0) 864 : audit [DBG] from='client.? 172.21.2.113:0/3476817435' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:20.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:20 gibba013 bash[29418]: cluster 2021-03-10T14:12:19.161300+0000 mgr.gibba020.yqfnwy (mgr.34427) 1061 : cluster [DBG] pgmap v591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:20.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:20 gibba013 bash[30381]: cluster 2021-03-10T14:12:19.161300+0000 mgr.gibba020.yqfnwy (mgr.34427) 1061 : cluster [DBG] pgmap v591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:20.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:20 gibba020 bash[25448]: cluster 2021-03-10T14:12:19.161300+0000 mgr.gibba020.yqfnwy (mgr.34427) 1061 : cluster [DBG] pgmap v591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:22.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:22 gibba013 bash[29418]: cluster 2021-03-10T14:12:21.162899+0000 mgr.gibba020.yqfnwy (mgr.34427) 1062 : cluster [DBG] pgmap v592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:22.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:22 gibba013 bash[30381]: cluster 2021-03-10T14:12:21.162899+0000 mgr.gibba020.yqfnwy (mgr.34427) 1062 : cluster [DBG] pgmap v592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:22.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:22 gibba020 bash[25448]: cluster 2021-03-10T14:12:21.162899+0000 mgr.gibba020.yqfnwy (mgr.34427) 1062 : cluster [DBG] pgmap v592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:24.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:24 gibba020 bash[25448]: cluster 2021-03-10T14:12:23.163424+0000 mgr.gibba020.yqfnwy (mgr.34427) 1063 : cluster [DBG] pgmap v593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:24.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:24 gibba013 bash[29418]: cluster 2021-03-10T14:12:23.163424+0000 mgr.gibba020.yqfnwy (mgr.34427) 1063 : cluster [DBG] pgmap v593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:24.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:24 gibba013 bash[30381]: cluster 2021-03-10T14:12:23.163424+0000 mgr.gibba020.yqfnwy (mgr.34427) 1063 : cluster [DBG] pgmap v593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:26.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:26 gibba020 bash[25448]: cluster 2021-03-10T14:12:25.165004+0000 mgr.gibba020.yqfnwy (mgr.34427) 1064 : cluster [DBG] pgmap v594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:26.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:26 gibba013 bash[29418]: cluster 2021-03-10T14:12:25.165004+0000 mgr.gibba020.yqfnwy (mgr.34427) 1064 : cluster [DBG] pgmap v594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:26.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:26 gibba013 bash[30381]: cluster 2021-03-10T14:12:25.165004+0000 mgr.gibba020.yqfnwy (mgr.34427) 1064 : cluster [DBG] pgmap v594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:28.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:28 gibba020 bash[25448]: cluster 2021-03-10T14:12:27.166270+0000 mgr.gibba020.yqfnwy (mgr.34427) 1065 : cluster [DBG] pgmap v595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:28.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:28 gibba013 bash[29418]: cluster 2021-03-10T14:12:27.166270+0000 mgr.gibba020.yqfnwy (mgr.34427) 1065 : cluster [DBG] pgmap v595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:28.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:28 gibba013 bash[30381]: cluster 2021-03-10T14:12:27.166270+0000 mgr.gibba020.yqfnwy (mgr.34427) 1065 : cluster [DBG] pgmap v595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:29.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:29 gibba020 bash[25448]: audit 2021-03-10T14:12:28.876183+0000 mon.a (mon.0) 865 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:12:29.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:29 gibba020 bash[25448]: audit 2021-03-10T14:12:29.092777+0000 mon.a (mon.0) 866 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:12:29.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:29 gibba020 bash[25448]: audit 2021-03-10T14:12:29.096326+0000 mon.a (mon.0) 867 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:12:29.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:29 gibba020 bash[25448]: audit 2021-03-10T14:12:29.097954+0000 mon.a (mon.0) 868 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:29.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:29 gibba020 bash[25448]: audit 2021-03-10T14:12:29.099439+0000 mon.a (mon.0) 869 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:29.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:29 gibba020 bash[25448]: audit 2021-03-10T14:12:29.100562+0000 mon.a (mon.0) 870 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:29.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:29 gibba020 bash[25448]: audit 2021-03-10T14:12:29.102828+0000 mon.a (mon.0) 871 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:29.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:29 gibba020 bash[25448]: audit 2021-03-10T14:12:29.104706+0000 mon.a (mon.0) 872 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:29.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:29 gibba013 bash[29418]: audit 2021-03-10T14:12:28.876183+0000 mon.a (mon.0) 865 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:12:29.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:29 gibba013 bash[29418]: audit 2021-03-10T14:12:29.092777+0000 mon.a (mon.0) 866 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:12:29.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:29 gibba013 bash[29418]: audit 2021-03-10T14:12:29.096326+0000 mon.a (mon.0) 867 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:12:29.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:29 gibba013 bash[29418]: audit 2021-03-10T14:12:29.097954+0000 mon.a (mon.0) 868 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:29.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:29 gibba013 bash[29418]: audit 2021-03-10T14:12:29.099439+0000 mon.a (mon.0) 869 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:29.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:29 gibba013 bash[29418]: audit 2021-03-10T14:12:29.100562+0000 mon.a (mon.0) 870 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:29.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:29 gibba013 bash[29418]: audit 2021-03-10T14:12:29.102828+0000 mon.a (mon.0) 871 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:29.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:29 gibba013 bash[29418]: audit 2021-03-10T14:12:29.104706+0000 mon.a (mon.0) 872 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:29.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:29 gibba013 bash[30381]: audit 2021-03-10T14:12:28.876183+0000 mon.a (mon.0) 865 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:12:29.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:29 gibba013 bash[30381]: audit 2021-03-10T14:12:29.092777+0000 mon.a (mon.0) 866 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:12:29.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:29 gibba013 bash[30381]: audit 2021-03-10T14:12:29.096326+0000 mon.a (mon.0) 867 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:12:29.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:29 gibba013 bash[30381]: audit 2021-03-10T14:12:29.097954+0000 mon.a (mon.0) 868 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:29.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:29 gibba013 bash[30381]: audit 2021-03-10T14:12:29.099439+0000 mon.a (mon.0) 869 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:29.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:29 gibba013 bash[30381]: audit 2021-03-10T14:12:29.100562+0000 mon.a (mon.0) 870 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:29.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:29 gibba013 bash[30381]: audit 2021-03-10T14:12:29.102828+0000 mon.a (mon.0) 871 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:29.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:29 gibba013 bash[30381]: audit 2021-03-10T14:12:29.104706+0000 mon.a (mon.0) 872 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:30.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:30 gibba020 bash[25448]: cephadm 2021-03-10T14:12:28.879851+0000 mgr.gibba020.yqfnwy (mgr.34427) 1066 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:12:30.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:30 gibba020 bash[25448]: cephadm 2021-03-10T14:12:28.881190+0000 mgr.gibba020.yqfnwy (mgr.34427) 1067 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:12:30.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:30 gibba020 bash[25448]: cephadm 2021-03-10T14:12:29.093324+0000 mgr.gibba020.yqfnwy (mgr.34427) 1068 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:12:30.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:30 gibba020 bash[25448]: cephadm 2021-03-10T14:12:29.095256+0000 mgr.gibba020.yqfnwy (mgr.34427) 1069 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:12:30.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:30 gibba020 bash[25448]: cephadm 2021-03-10T14:12:29.096901+0000 mgr.gibba020.yqfnwy (mgr.34427) 1070 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:12:30.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:30 gibba020 bash[25448]: cephadm 2021-03-10T14:12:29.096938+0000 mgr.gibba020.yqfnwy (mgr.34427) 1071 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:12:30.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:30 gibba020 bash[25448]: cephadm 2021-03-10T14:12:29.098086+0000 mgr.gibba020.yqfnwy (mgr.34427) 1072 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:12:30.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:30 gibba020 bash[25448]: cephadm 2021-03-10T14:12:29.098122+0000 mgr.gibba020.yqfnwy (mgr.34427) 1073 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:12:30.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:30 gibba020 bash[25448]: cephadm 2021-03-10T14:12:29.099241+0000 mgr.gibba020.yqfnwy (mgr.34427) 1074 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:12:30.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:30 gibba020 bash[25448]: cephadm 2021-03-10T14:12:29.099999+0000 mgr.gibba020.yqfnwy (mgr.34427) 1075 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:12:30.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:30 gibba020 bash[25448]: cephadm 2021-03-10T14:12:29.100056+0000 mgr.gibba020.yqfnwy (mgr.34427) 1076 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:12:30.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:30 gibba020 bash[25448]: cephadm 2021-03-10T14:12:29.101757+0000 mgr.gibba020.yqfnwy (mgr.34427) 1077 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:12:30.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:30 gibba020 bash[25448]: cephadm 2021-03-10T14:12:29.102070+0000 mgr.gibba020.yqfnwy (mgr.34427) 1078 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:12:30.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:30 gibba020 bash[25448]: cephadm 2021-03-10T14:12:29.103675+0000 mgr.gibba020.yqfnwy (mgr.34427) 1079 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:12:30.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:30 gibba020 bash[25448]: cephadm 2021-03-10T14:12:29.103715+0000 mgr.gibba020.yqfnwy (mgr.34427) 1080 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:12:30.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:30 gibba020 bash[25448]: cephadm 2021-03-10T14:12:29.103824+0000 mgr.gibba020.yqfnwy (mgr.34427) 1081 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:12:30.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:30 gibba020 bash[25448]: cluster 2021-03-10T14:12:29.167461+0000 mgr.gibba020.yqfnwy (mgr.34427) 1082 : cluster [DBG] pgmap v596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:30.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:30 gibba013 bash[29418]: cephadm 2021-03-10T14:12:28.879851+0000 mgr.gibba020.yqfnwy (mgr.34427) 1066 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:12:30.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:30 gibba013 bash[29418]: cephadm 2021-03-10T14:12:28.881190+0000 mgr.gibba020.yqfnwy (mgr.34427) 1067 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:12:30.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:30 gibba013 bash[29418]: cephadm 2021-03-10T14:12:29.093324+0000 mgr.gibba020.yqfnwy (mgr.34427) 1068 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:12:30.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:30 gibba013 bash[29418]: cephadm 2021-03-10T14:12:29.095256+0000 mgr.gibba020.yqfnwy (mgr.34427) 1069 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:12:30.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:30 gibba013 bash[29418]: cephadm 2021-03-10T14:12:29.096901+0000 mgr.gibba020.yqfnwy (mgr.34427) 1070 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:12:30.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:30 gibba013 bash[29418]: cephadm 2021-03-10T14:12:29.096938+0000 mgr.gibba020.yqfnwy (mgr.34427) 1071 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:12:30.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:30 gibba013 bash[29418]: cephadm 2021-03-10T14:12:29.098086+0000 mgr.gibba020.yqfnwy (mgr.34427) 1072 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:12:30.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:30 gibba013 bash[29418]: cephadm 2021-03-10T14:12:29.098122+0000 mgr.gibba020.yqfnwy (mgr.34427) 1073 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:12:30.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:30 gibba013 bash[29418]: cephadm 2021-03-10T14:12:29.099241+0000 mgr.gibba020.yqfnwy (mgr.34427) 1074 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:12:30.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:30 gibba013 bash[29418]: cephadm 2021-03-10T14:12:29.099999+0000 mgr.gibba020.yqfnwy (mgr.34427) 1075 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:12:30.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:30 gibba013 bash[29418]: cephadm 2021-03-10T14:12:29.100056+0000 mgr.gibba020.yqfnwy (mgr.34427) 1076 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:12:30.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:30 gibba013 bash[29418]: cephadm 2021-03-10T14:12:29.101757+0000 mgr.gibba020.yqfnwy (mgr.34427) 1077 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:12:30.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:30 gibba013 bash[29418]: cephadm 2021-03-10T14:12:29.102070+0000 mgr.gibba020.yqfnwy (mgr.34427) 1078 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:12:30.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:30 gibba013 bash[29418]: cephadm 2021-03-10T14:12:29.103675+0000 mgr.gibba020.yqfnwy (mgr.34427) 1079 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:12:30.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:30 gibba013 bash[29418]: cephadm 2021-03-10T14:12:29.103715+0000 mgr.gibba020.yqfnwy (mgr.34427) 1080 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:12:30.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:30 gibba013 bash[29418]: cephadm 2021-03-10T14:12:29.103824+0000 mgr.gibba020.yqfnwy (mgr.34427) 1081 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:12:30.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:30 gibba013 bash[29418]: cluster 2021-03-10T14:12:29.167461+0000 mgr.gibba020.yqfnwy (mgr.34427) 1082 : cluster [DBG] pgmap v596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:30.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:30 gibba013 bash[30381]: cephadm 2021-03-10T14:12:28.879851+0000 mgr.gibba020.yqfnwy (mgr.34427) 1066 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:12:30.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:30 gibba013 bash[30381]: cephadm 2021-03-10T14:12:28.881190+0000 mgr.gibba020.yqfnwy (mgr.34427) 1067 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:12:30.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:30 gibba013 bash[30381]: cephadm 2021-03-10T14:12:29.093324+0000 mgr.gibba020.yqfnwy (mgr.34427) 1068 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:12:30.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:30 gibba013 bash[30381]: cephadm 2021-03-10T14:12:29.095256+0000 mgr.gibba020.yqfnwy (mgr.34427) 1069 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:12:30.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:30 gibba013 bash[30381]: cephadm 2021-03-10T14:12:29.096901+0000 mgr.gibba020.yqfnwy (mgr.34427) 1070 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:12:30.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:30 gibba013 bash[30381]: cephadm 2021-03-10T14:12:29.096938+0000 mgr.gibba020.yqfnwy (mgr.34427) 1071 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:12:30.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:30 gibba013 bash[30381]: cephadm 2021-03-10T14:12:29.098086+0000 mgr.gibba020.yqfnwy (mgr.34427) 1072 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:12:30.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:30 gibba013 bash[30381]: cephadm 2021-03-10T14:12:29.098122+0000 mgr.gibba020.yqfnwy (mgr.34427) 1073 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:12:30.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:30 gibba013 bash[30381]: cephadm 2021-03-10T14:12:29.099241+0000 mgr.gibba020.yqfnwy (mgr.34427) 1074 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:12:30.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:30 gibba013 bash[30381]: cephadm 2021-03-10T14:12:29.099999+0000 mgr.gibba020.yqfnwy (mgr.34427) 1075 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:12:30.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:30 gibba013 bash[30381]: cephadm 2021-03-10T14:12:29.100056+0000 mgr.gibba020.yqfnwy (mgr.34427) 1076 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:12:30.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:30 gibba013 bash[30381]: cephadm 2021-03-10T14:12:29.101757+0000 mgr.gibba020.yqfnwy (mgr.34427) 1077 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:12:30.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:30 gibba013 bash[30381]: cephadm 2021-03-10T14:12:29.102070+0000 mgr.gibba020.yqfnwy (mgr.34427) 1078 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:12:30.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:30 gibba013 bash[30381]: cephadm 2021-03-10T14:12:29.103675+0000 mgr.gibba020.yqfnwy (mgr.34427) 1079 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:12:30.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:30 gibba013 bash[30381]: cephadm 2021-03-10T14:12:29.103715+0000 mgr.gibba020.yqfnwy (mgr.34427) 1080 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:12:30.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:30 gibba013 bash[30381]: cephadm 2021-03-10T14:12:29.103824+0000 mgr.gibba020.yqfnwy (mgr.34427) 1081 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:12:30.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:30 gibba013 bash[30381]: cluster 2021-03-10T14:12:29.167461+0000 mgr.gibba020.yqfnwy (mgr.34427) 1082 : cluster [DBG] pgmap v596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:32.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:32 gibba020 bash[25448]: cluster 2021-03-10T14:12:31.169162+0000 mgr.gibba020.yqfnwy (mgr.34427) 1083 : cluster [DBG] pgmap v597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:32.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:32 gibba013 bash[29418]: cluster 2021-03-10T14:12:31.169162+0000 mgr.gibba020.yqfnwy (mgr.34427) 1083 : cluster [DBG] pgmap v597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:32.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:32 gibba013 bash[30381]: cluster 2021-03-10T14:12:31.169162+0000 mgr.gibba020.yqfnwy (mgr.34427) 1083 : cluster [DBG] pgmap v597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:34.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:34 gibba020 bash[25448]: cluster 2021-03-10T14:12:33.170513+0000 mgr.gibba020.yqfnwy (mgr.34427) 1084 : cluster [DBG] pgmap v598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:34.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:34 gibba013 bash[29418]: cluster 2021-03-10T14:12:33.170513+0000 mgr.gibba020.yqfnwy (mgr.34427) 1084 : cluster [DBG] pgmap v598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:34.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:34 gibba013 bash[30381]: cluster 2021-03-10T14:12:33.170513+0000 mgr.gibba020.yqfnwy (mgr.34427) 1084 : cluster [DBG] pgmap v598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:36.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:36 gibba020 bash[25448]: cluster 2021-03-10T14:12:35.171294+0000 mgr.gibba020.yqfnwy (mgr.34427) 1085 : cluster [DBG] pgmap v599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:36.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:36 gibba013 bash[29418]: cluster 2021-03-10T14:12:35.171294+0000 mgr.gibba020.yqfnwy (mgr.34427) 1085 : cluster [DBG] pgmap v599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:36.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:36 gibba013 bash[30381]: cluster 2021-03-10T14:12:35.171294+0000 mgr.gibba020.yqfnwy (mgr.34427) 1085 : cluster [DBG] pgmap v599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:38.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:38 gibba020 bash[25448]: cluster 2021-03-10T14:12:37.172535+0000 mgr.gibba020.yqfnwy (mgr.34427) 1086 : cluster [DBG] pgmap v600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:38.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:38 gibba013 bash[29418]: cluster 2021-03-10T14:12:37.172535+0000 mgr.gibba020.yqfnwy (mgr.34427) 1086 : cluster [DBG] pgmap v600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:38.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:38 gibba013 bash[30381]: cluster 2021-03-10T14:12:37.172535+0000 mgr.gibba020.yqfnwy (mgr.34427) 1086 : cluster [DBG] pgmap v600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:40.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:40 gibba013 bash[29418]: cluster 2021-03-10T14:12:39.173940+0000 mgr.gibba020.yqfnwy (mgr.34427) 1087 : cluster [DBG] pgmap v601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:40.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:40 gibba013 bash[30381]: cluster 2021-03-10T14:12:39.173940+0000 mgr.gibba020.yqfnwy (mgr.34427) 1087 : cluster [DBG] pgmap v601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:40.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:40 gibba020 bash[25448]: cluster 2021-03-10T14:12:39.173940+0000 mgr.gibba020.yqfnwy (mgr.34427) 1087 : cluster [DBG] pgmap v601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:42.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:42 gibba013 bash[29418]: cluster 2021-03-10T14:12:41.174755+0000 mgr.gibba020.yqfnwy (mgr.34427) 1088 : cluster [DBG] pgmap v602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:42.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:42 gibba013 bash[30381]: cluster 2021-03-10T14:12:41.174755+0000 mgr.gibba020.yqfnwy (mgr.34427) 1088 : cluster [DBG] pgmap v602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:42.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:42 gibba020 bash[25448]: cluster 2021-03-10T14:12:41.174755+0000 mgr.gibba020.yqfnwy (mgr.34427) 1088 : cluster [DBG] pgmap v602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:44.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:44 gibba013 bash[29418]: cluster 2021-03-10T14:12:43.176088+0000 mgr.gibba020.yqfnwy (mgr.34427) 1089 : cluster [DBG] pgmap v603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:44.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:44 gibba013 bash[30381]: cluster 2021-03-10T14:12:43.176088+0000 mgr.gibba020.yqfnwy (mgr.34427) 1089 : cluster [DBG] pgmap v603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:44.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:44 gibba020 bash[25448]: cluster 2021-03-10T14:12:43.176088+0000 mgr.gibba020.yqfnwy (mgr.34427) 1089 : cluster [DBG] pgmap v603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:45.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:45 gibba013 bash[29418]: cephadm 2021-03-10T14:12:44.116889+0000 mgr.gibba020.yqfnwy (mgr.34427) 1090 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:12:45.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:45 gibba013 bash[30381]: cephadm 2021-03-10T14:12:44.116889+0000 mgr.gibba020.yqfnwy (mgr.34427) 1090 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:12:45.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:45 gibba020 bash[25448]: cephadm 2021-03-10T14:12:44.116889+0000 mgr.gibba020.yqfnwy (mgr.34427) 1090 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:12:46.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:46 gibba013 bash[29418]: cluster 2021-03-10T14:12:45.177769+0000 mgr.gibba020.yqfnwy (mgr.34427) 1091 : cluster [DBG] pgmap v604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:46.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:46 gibba013 bash[30381]: cluster 2021-03-10T14:12:45.177769+0000 mgr.gibba020.yqfnwy (mgr.34427) 1091 : cluster [DBG] pgmap v604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:46.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:46 gibba020 bash[25448]: cluster 2021-03-10T14:12:45.177769+0000 mgr.gibba020.yqfnwy (mgr.34427) 1091 : cluster [DBG] pgmap v604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:48.712 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:12:48.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:48 gibba013 bash[29418]: cluster 2021-03-10T14:12:47.178932+0000 mgr.gibba020.yqfnwy (mgr.34427) 1092 : cluster [DBG] pgmap v605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:48.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:48 gibba013 bash[30381]: cluster 2021-03-10T14:12:47.178932+0000 mgr.gibba020.yqfnwy (mgr.34427) 1092 : cluster [DBG] pgmap v605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:48.937 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:12:48.937 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (19m) 5m ago 24m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:12:48.937 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (24m) 4m ago 24m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:12:48.937 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (19m) 4m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:12:48.938 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (20m) 4m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:12:48.938 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (18m) 5m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:12:48.938 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (18m) 5m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:12:48.938 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (18m) 4m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:12:48.939 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (18m) 5m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:12:48.939 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (24m) 5m ago 24m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:12:48.939 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (24m) 4m ago 24m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:12:48.939 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (17m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:12:48.939 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (17m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:12:48.940 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (16m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:12:48.940 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (16m) 5m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:12:48.940 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (15m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:12:48.940 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (15m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:12:48.940 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (15m) 4m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:12:48.940 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (14m) 4m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:12:48.941 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (24m) 4m ago 24m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:12:48.941 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 4m ago 22m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:12:48.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:48 gibba020 bash[25448]: cluster 2021-03-10T14:12:47.178932+0000 mgr.gibba020.yqfnwy (mgr.34427) 1092 : cluster [DBG] pgmap v605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:49.185 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:12:49.185 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:12:49.185 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:12:49.185 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:12:49.186 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:12:49.186 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:12:49.186 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:12:49.186 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:12:49.186 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:12:49.187 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:12:49.187 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:12:49.187 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:12:49.187 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:12:49.188 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:12:49.188 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:12:49.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:49 gibba013 bash[29418]: audit 2021-03-10T14:12:49.183247+0000 mon.a (mon.0) 873 : audit [DBG] from='client.? 172.21.2.113:0/2473634599' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:49.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:49 gibba013 bash[30381]: audit 2021-03-10T14:12:49.183247+0000 mon.a (mon.0) 873 : audit [DBG] from='client.? 172.21.2.113:0/2473634599' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:49.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:49 gibba020 bash[25448]: audit 2021-03-10T14:12:49.183247+0000 mon.a (mon.0) 873 : audit [DBG] from='client.? 172.21.2.113:0/2473634599' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:12:50.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:50 gibba013 bash[29418]: audit 2021-03-10T14:12:48.699589+0000 mgr.gibba020.yqfnwy (mgr.34427) 1093 : audit [DBG] from='client.54775 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:12:50.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:50 gibba013 bash[29418]: audit 2021-03-10T14:12:48.921410+0000 mgr.gibba020.yqfnwy (mgr.34427) 1094 : audit [DBG] from='client.44796 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:12:50.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:50 gibba013 bash[29418]: cluster 2021-03-10T14:12:49.180555+0000 mgr.gibba020.yqfnwy (mgr.34427) 1095 : cluster [DBG] pgmap v606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:50.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:50 gibba013 bash[30381]: audit 2021-03-10T14:12:48.699589+0000 mgr.gibba020.yqfnwy (mgr.34427) 1093 : audit [DBG] from='client.54775 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:12:50.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:50 gibba013 bash[30381]: audit 2021-03-10T14:12:48.921410+0000 mgr.gibba020.yqfnwy (mgr.34427) 1094 : audit [DBG] from='client.44796 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:12:50.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:50 gibba013 bash[30381]: cluster 2021-03-10T14:12:49.180555+0000 mgr.gibba020.yqfnwy (mgr.34427) 1095 : cluster [DBG] pgmap v606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:50.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:50 gibba020 bash[25448]: audit 2021-03-10T14:12:48.699589+0000 mgr.gibba020.yqfnwy (mgr.34427) 1093 : audit [DBG] from='client.54775 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:12:50.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:50 gibba020 bash[25448]: audit 2021-03-10T14:12:48.921410+0000 mgr.gibba020.yqfnwy (mgr.34427) 1094 : audit [DBG] from='client.44796 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:12:50.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:50 gibba020 bash[25448]: cluster 2021-03-10T14:12:49.180555+0000 mgr.gibba020.yqfnwy (mgr.34427) 1095 : cluster [DBG] pgmap v606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:52.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:52 gibba013 bash[29418]: cluster 2021-03-10T14:12:51.182480+0000 mgr.gibba020.yqfnwy (mgr.34427) 1096 : cluster [DBG] pgmap v607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:52.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:52 gibba013 bash[30381]: cluster 2021-03-10T14:12:51.182480+0000 mgr.gibba020.yqfnwy (mgr.34427) 1096 : cluster [DBG] pgmap v607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:52.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:52 gibba020 bash[25448]: cluster 2021-03-10T14:12:51.182480+0000 mgr.gibba020.yqfnwy (mgr.34427) 1096 : cluster [DBG] pgmap v607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:54.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:54 gibba013 bash[29418]: cluster 2021-03-10T14:12:53.183896+0000 mgr.gibba020.yqfnwy (mgr.34427) 1097 : cluster [DBG] pgmap v608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:54.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:54 gibba013 bash[30381]: cluster 2021-03-10T14:12:53.183896+0000 mgr.gibba020.yqfnwy (mgr.34427) 1097 : cluster [DBG] pgmap v608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:54.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:54 gibba020 bash[25448]: cluster 2021-03-10T14:12:53.183896+0000 mgr.gibba020.yqfnwy (mgr.34427) 1097 : cluster [DBG] pgmap v608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:56.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:56 gibba013 bash[29418]: cluster 2021-03-10T14:12:55.185358+0000 mgr.gibba020.yqfnwy (mgr.34427) 1098 : cluster [DBG] pgmap v609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:56.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:56 gibba013 bash[30381]: cluster 2021-03-10T14:12:55.185358+0000 mgr.gibba020.yqfnwy (mgr.34427) 1098 : cluster [DBG] pgmap v609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:56.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:56 gibba020 bash[25448]: cluster 2021-03-10T14:12:55.185358+0000 mgr.gibba020.yqfnwy (mgr.34427) 1098 : cluster [DBG] pgmap v609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:58.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:12:58 gibba013 bash[29418]: cluster 2021-03-10T14:12:57.186794+0000 mgr.gibba020.yqfnwy (mgr.34427) 1099 : cluster [DBG] pgmap v610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:58.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:12:58 gibba013 bash[30381]: cluster 2021-03-10T14:12:57.186794+0000 mgr.gibba020.yqfnwy (mgr.34427) 1099 : cluster [DBG] pgmap v610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:12:58.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:12:58 gibba020 bash[25448]: cluster 2021-03-10T14:12:57.186794+0000 mgr.gibba020.yqfnwy (mgr.34427) 1099 : cluster [DBG] pgmap v610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:00.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:00 gibba013 bash[29418]: cephadm 2021-03-10T14:12:59.132952+0000 mgr.gibba020.yqfnwy (mgr.34427) 1100 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:13:00.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:00 gibba013 bash[29418]: cluster 2021-03-10T14:12:59.187582+0000 mgr.gibba020.yqfnwy (mgr.34427) 1101 : cluster [DBG] pgmap v611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:00.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:00 gibba013 bash[30381]: cephadm 2021-03-10T14:12:59.132952+0000 mgr.gibba020.yqfnwy (mgr.34427) 1100 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:13:00.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:00 gibba013 bash[30381]: cluster 2021-03-10T14:12:59.187582+0000 mgr.gibba020.yqfnwy (mgr.34427) 1101 : cluster [DBG] pgmap v611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:00.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:00 gibba020 bash[25448]: cephadm 2021-03-10T14:12:59.132952+0000 mgr.gibba020.yqfnwy (mgr.34427) 1100 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:13:00.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:00 gibba020 bash[25448]: cluster 2021-03-10T14:12:59.187582+0000 mgr.gibba020.yqfnwy (mgr.34427) 1101 : cluster [DBG] pgmap v611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:02.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:02 gibba013 bash[29418]: cluster 2021-03-10T14:13:01.189250+0000 mgr.gibba020.yqfnwy (mgr.34427) 1102 : cluster [DBG] pgmap v612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:02.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:02 gibba013 bash[30381]: cluster 2021-03-10T14:13:01.189250+0000 mgr.gibba020.yqfnwy (mgr.34427) 1102 : cluster [DBG] pgmap v612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:02.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:02 gibba020 bash[25448]: cluster 2021-03-10T14:13:01.189250+0000 mgr.gibba020.yqfnwy (mgr.34427) 1102 : cluster [DBG] pgmap v612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:04.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:04 gibba013 bash[29418]: cluster 2021-03-10T14:13:03.190678+0000 mgr.gibba020.yqfnwy (mgr.34427) 1103 : cluster [DBG] pgmap v613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:04.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:04 gibba013 bash[30381]: cluster 2021-03-10T14:13:03.190678+0000 mgr.gibba020.yqfnwy (mgr.34427) 1103 : cluster [DBG] pgmap v613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:04.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:04 gibba020 bash[25448]: cluster 2021-03-10T14:13:03.190678+0000 mgr.gibba020.yqfnwy (mgr.34427) 1103 : cluster [DBG] pgmap v613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:06 gibba013 bash[29418]: cluster 2021-03-10T14:13:05.191482+0000 mgr.gibba020.yqfnwy (mgr.34427) 1104 : cluster [DBG] pgmap v614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:06 gibba013 bash[29418]: audit 2021-03-10T14:13:05.911002+0000 mon.a (mon.0) 874 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:13:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:06 gibba013 bash[29418]: audit 2021-03-10T14:13:05.911797+0000 mon.a (mon.0) 875 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:13:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:06 gibba013 bash[29418]: audit 2021-03-10T14:13:05.912505+0000 mon.a (mon.0) 876 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:13:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:06 gibba013 bash[29418]: audit 2021-03-10T14:13:05.913164+0000 mon.a (mon.0) 877 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:13:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:06 gibba013 bash[29418]: audit 2021-03-10T14:13:06.056792+0000 mon.a (mon.0) 878 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:13:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:06 gibba013 bash[29418]: audit 2021-03-10T14:13:06.063331+0000 mon.a (mon.0) 879 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:13:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:06 gibba013 bash[30381]: cluster 2021-03-10T14:13:05.191482+0000 mgr.gibba020.yqfnwy (mgr.34427) 1104 : cluster [DBG] pgmap v614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:06 gibba013 bash[30381]: audit 2021-03-10T14:13:05.911002+0000 mon.a (mon.0) 874 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:13:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:06 gibba013 bash[30381]: audit 2021-03-10T14:13:05.911797+0000 mon.a (mon.0) 875 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:13:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:06 gibba013 bash[30381]: audit 2021-03-10T14:13:05.912505+0000 mon.a (mon.0) 876 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:13:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:06 gibba013 bash[30381]: audit 2021-03-10T14:13:05.913164+0000 mon.a (mon.0) 877 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:13:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:06 gibba013 bash[30381]: audit 2021-03-10T14:13:06.056792+0000 mon.a (mon.0) 878 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:13:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:06 gibba013 bash[30381]: audit 2021-03-10T14:13:06.063331+0000 mon.a (mon.0) 879 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:13:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:06 gibba020 bash[25448]: cluster 2021-03-10T14:13:05.191482+0000 mgr.gibba020.yqfnwy (mgr.34427) 1104 : cluster [DBG] pgmap v614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:06 gibba020 bash[25448]: audit 2021-03-10T14:13:05.911002+0000 mon.a (mon.0) 874 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:13:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:06 gibba020 bash[25448]: audit 2021-03-10T14:13:05.911797+0000 mon.a (mon.0) 875 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:13:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:06 gibba020 bash[25448]: audit 2021-03-10T14:13:05.912505+0000 mon.a (mon.0) 876 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:13:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:06 gibba020 bash[25448]: audit 2021-03-10T14:13:05.913164+0000 mon.a (mon.0) 877 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:13:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:06 gibba020 bash[25448]: audit 2021-03-10T14:13:06.056792+0000 mon.a (mon.0) 878 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:13:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:06 gibba020 bash[25448]: audit 2021-03-10T14:13:06.063331+0000 mon.a (mon.0) 879 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:13:07.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:07 gibba013 bash[29418]: cluster 2021-03-10T14:13:07.192787+0000 mgr.gibba020.yqfnwy (mgr.34427) 1105 : cluster [DBG] pgmap v615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:07 gibba013 bash[30381]: cluster 2021-03-10T14:13:07.192787+0000 mgr.gibba020.yqfnwy (mgr.34427) 1105 : cluster [DBG] pgmap v615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:07.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:07 gibba020 bash[25448]: cluster 2021-03-10T14:13:07.192787+0000 mgr.gibba020.yqfnwy (mgr.34427) 1105 : cluster [DBG] pgmap v615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:10.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:10 gibba013 bash[29418]: cluster 2021-03-10T14:13:09.194478+0000 mgr.gibba020.yqfnwy (mgr.34427) 1106 : cluster [DBG] pgmap v616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:10.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:10 gibba013 bash[30381]: cluster 2021-03-10T14:13:09.194478+0000 mgr.gibba020.yqfnwy (mgr.34427) 1106 : cluster [DBG] pgmap v616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:10.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:10 gibba020 bash[25448]: cluster 2021-03-10T14:13:09.194478+0000 mgr.gibba020.yqfnwy (mgr.34427) 1106 : cluster [DBG] pgmap v616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:12.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:12 gibba013 bash[29418]: cluster 2021-03-10T14:13:11.195490+0000 mgr.gibba020.yqfnwy (mgr.34427) 1107 : cluster [DBG] pgmap v617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:12.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:12 gibba013 bash[30381]: cluster 2021-03-10T14:13:11.195490+0000 mgr.gibba020.yqfnwy (mgr.34427) 1107 : cluster [DBG] pgmap v617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:12.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:12 gibba020 bash[25448]: cluster 2021-03-10T14:13:11.195490+0000 mgr.gibba020.yqfnwy (mgr.34427) 1107 : cluster [DBG] pgmap v617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:14.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:14 gibba020 bash[25448]: cluster 2021-03-10T14:13:13.196793+0000 mgr.gibba020.yqfnwy (mgr.34427) 1108 : cluster [DBG] pgmap v618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:14.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:14 gibba013 bash[29418]: cluster 2021-03-10T14:13:13.196793+0000 mgr.gibba020.yqfnwy (mgr.34427) 1108 : cluster [DBG] pgmap v618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:14.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:14 gibba013 bash[30381]: cluster 2021-03-10T14:13:13.196793+0000 mgr.gibba020.yqfnwy (mgr.34427) 1108 : cluster [DBG] pgmap v618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:15.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:15 gibba013 bash[29418]: cephadm 2021-03-10T14:13:14.148705+0000 mgr.gibba020.yqfnwy (mgr.34427) 1109 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:13:15.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:15 gibba013 bash[30381]: cephadm 2021-03-10T14:13:14.148705+0000 mgr.gibba020.yqfnwy (mgr.34427) 1109 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:13:15.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:15 gibba020 bash[25448]: cephadm 2021-03-10T14:13:14.148705+0000 mgr.gibba020.yqfnwy (mgr.34427) 1109 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:13:16.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:16 gibba013 bash[29418]: cluster 2021-03-10T14:13:15.198311+0000 mgr.gibba020.yqfnwy (mgr.34427) 1110 : cluster [DBG] pgmap v619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:16.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:16 gibba013 bash[30381]: cluster 2021-03-10T14:13:15.198311+0000 mgr.gibba020.yqfnwy (mgr.34427) 1110 : cluster [DBG] pgmap v619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:16.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:16 gibba020 bash[25448]: cluster 2021-03-10T14:13:15.198311+0000 mgr.gibba020.yqfnwy (mgr.34427) 1110 : cluster [DBG] pgmap v619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:18.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:18 gibba013 bash[29418]: cluster 2021-03-10T14:13:17.199193+0000 mgr.gibba020.yqfnwy (mgr.34427) 1111 : cluster [DBG] pgmap v620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:18.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:18 gibba013 bash[30381]: cluster 2021-03-10T14:13:17.199193+0000 mgr.gibba020.yqfnwy (mgr.34427) 1111 : cluster [DBG] pgmap v620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:18.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:18 gibba020 bash[25448]: cluster 2021-03-10T14:13:17.199193+0000 mgr.gibba020.yqfnwy (mgr.34427) 1111 : cluster [DBG] pgmap v620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:19.427 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:13:19.656 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:13:19.656 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (19m) 5m ago 25m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:13:19.657 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (25m) 4m ago 25m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:13:19.657 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (20m) 4m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:13:19.657 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (20m) 4m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:13:19.657 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (19m) 5m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:13:19.658 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (19m) 5m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:13:19.658 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (18m) 4m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:13:19.658 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (19m) 5m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:13:19.658 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (25m) 5m ago 25m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:13:19.659 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (25m) 4m ago 25m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:13:19.659 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (18m) 5m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:13:19.659 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (17m) 5m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:13:19.660 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (17m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:13:19.660 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (16m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:13:19.660 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (16m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:13:19.660 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (15m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:13:19.661 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (15m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:13:19.661 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (15m) 4m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:13:19.661 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (24m) 4m ago 25m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:13:19.662 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 4m ago 23m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:13:19.906 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:13:19.907 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:13:19.907 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:13:19.907 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:13:19.907 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:13:19.907 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:13:19.908 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:13:19.908 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:13:19.908 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:13:19.908 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:13:19.908 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:13:19.909 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:13:19.909 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:13:19.909 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:13:19.909 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:13:20.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:20 gibba013 bash[29418]: cluster 2021-03-10T14:13:19.200784+0000 mgr.gibba020.yqfnwy (mgr.34427) 1112 : cluster [DBG] pgmap v621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:20.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:20 gibba013 bash[29418]: audit 2021-03-10T14:13:19.414880+0000 mgr.gibba020.yqfnwy (mgr.34427) 1113 : audit [DBG] from='client.44808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:13:20.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:20 gibba013 bash[29418]: audit 2021-03-10T14:13:19.904793+0000 mon.a (mon.0) 880 : audit [DBG] from='client.? 172.21.2.113:0/1187334627' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:20.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:20 gibba013 bash[30381]: cluster 2021-03-10T14:13:19.200784+0000 mgr.gibba020.yqfnwy (mgr.34427) 1112 : cluster [DBG] pgmap v621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:20.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:20 gibba013 bash[30381]: audit 2021-03-10T14:13:19.414880+0000 mgr.gibba020.yqfnwy (mgr.34427) 1113 : audit [DBG] from='client.44808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:13:20.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:20 gibba013 bash[30381]: audit 2021-03-10T14:13:19.904793+0000 mon.a (mon.0) 880 : audit [DBG] from='client.? 172.21.2.113:0/1187334627' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:20.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:20 gibba020 bash[25448]: cluster 2021-03-10T14:13:19.200784+0000 mgr.gibba020.yqfnwy (mgr.34427) 1112 : cluster [DBG] pgmap v621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:20.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:20 gibba020 bash[25448]: audit 2021-03-10T14:13:19.414880+0000 mgr.gibba020.yqfnwy (mgr.34427) 1113 : audit [DBG] from='client.44808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:13:20.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:20 gibba020 bash[25448]: audit 2021-03-10T14:13:19.904793+0000 mon.a (mon.0) 880 : audit [DBG] from='client.? 172.21.2.113:0/1187334627' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:21.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:21 gibba013 bash[29418]: audit 2021-03-10T14:13:19.638960+0000 mgr.gibba020.yqfnwy (mgr.34427) 1114 : audit [DBG] from='client.44814 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:13:21.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:21 gibba013 bash[30381]: audit 2021-03-10T14:13:19.638960+0000 mgr.gibba020.yqfnwy (mgr.34427) 1114 : audit [DBG] from='client.44814 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:13:21.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:21 gibba020 bash[25448]: audit 2021-03-10T14:13:19.638960+0000 mgr.gibba020.yqfnwy (mgr.34427) 1114 : audit [DBG] from='client.44814 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:13:22.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:22 gibba013 bash[29418]: cluster 2021-03-10T14:13:21.202794+0000 mgr.gibba020.yqfnwy (mgr.34427) 1115 : cluster [DBG] pgmap v622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:22.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:22 gibba013 bash[30381]: cluster 2021-03-10T14:13:21.202794+0000 mgr.gibba020.yqfnwy (mgr.34427) 1115 : cluster [DBG] pgmap v622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:22.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:22 gibba020 bash[25448]: cluster 2021-03-10T14:13:21.202794+0000 mgr.gibba020.yqfnwy (mgr.34427) 1115 : cluster [DBG] pgmap v622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:24.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:24 gibba013 bash[29418]: cluster 2021-03-10T14:13:23.204219+0000 mgr.gibba020.yqfnwy (mgr.34427) 1116 : cluster [DBG] pgmap v623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:24.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:24 gibba013 bash[30381]: cluster 2021-03-10T14:13:23.204219+0000 mgr.gibba020.yqfnwy (mgr.34427) 1116 : cluster [DBG] pgmap v623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:24.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:24 gibba020 bash[25448]: cluster 2021-03-10T14:13:23.204219+0000 mgr.gibba020.yqfnwy (mgr.34427) 1116 : cluster [DBG] pgmap v623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:26.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:26 gibba013 bash[29418]: cluster 2021-03-10T14:13:25.205853+0000 mgr.gibba020.yqfnwy (mgr.34427) 1117 : cluster [DBG] pgmap v624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:26.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:26 gibba013 bash[30381]: cluster 2021-03-10T14:13:25.205853+0000 mgr.gibba020.yqfnwy (mgr.34427) 1117 : cluster [DBG] pgmap v624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:26.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:26 gibba020 bash[25448]: cluster 2021-03-10T14:13:25.205853+0000 mgr.gibba020.yqfnwy (mgr.34427) 1117 : cluster [DBG] pgmap v624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:28.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:28 gibba013 bash[30381]: cluster 2021-03-10T14:13:27.207427+0000 mgr.gibba020.yqfnwy (mgr.34427) 1118 : cluster [DBG] pgmap v625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:28.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:28 gibba013 bash[29418]: cluster 2021-03-10T14:13:27.207427+0000 mgr.gibba020.yqfnwy (mgr.34427) 1118 : cluster [DBG] pgmap v625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:28.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:28 gibba020 bash[25448]: cluster 2021-03-10T14:13:27.207427+0000 mgr.gibba020.yqfnwy (mgr.34427) 1118 : cluster [DBG] pgmap v625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:29.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:29 gibba013 bash[29418]: audit 2021-03-10T14:13:29.167546+0000 mon.a (mon.0) 881 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:13:29.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:29 gibba013 bash[30381]: audit 2021-03-10T14:13:29.167546+0000 mon.a (mon.0) 881 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:13:29.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:29 gibba020 bash[25448]: audit 2021-03-10T14:13:29.167546+0000 mon.a (mon.0) 881 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:13:30.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:30 gibba020 bash[25448]: cephadm 2021-03-10T14:13:29.168397+0000 mgr.gibba020.yqfnwy (mgr.34427) 1119 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:13:30.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:30 gibba020 bash[25448]: cephadm 2021-03-10T14:13:29.168812+0000 mgr.gibba020.yqfnwy (mgr.34427) 1120 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:13:30.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:30 gibba020 bash[25448]: cluster 2021-03-10T14:13:29.208033+0000 mgr.gibba020.yqfnwy (mgr.34427) 1121 : cluster [DBG] pgmap v626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:30.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:30 gibba020 bash[25448]: audit 2021-03-10T14:13:29.382992+0000 mon.a (mon.0) 882 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:13:30.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:30 gibba020 bash[25448]: cephadm 2021-03-10T14:13:29.383320+0000 mgr.gibba020.yqfnwy (mgr.34427) 1122 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:13:30.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:30 gibba020 bash[25448]: cephadm 2021-03-10T14:13:29.385119+0000 mgr.gibba020.yqfnwy (mgr.34427) 1123 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:13:30.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:30 gibba020 bash[25448]: audit 2021-03-10T14:13:29.386257+0000 mon.a (mon.0) 883 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:13:30.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:30 gibba020 bash[25448]: cephadm 2021-03-10T14:13:29.386859+0000 mgr.gibba020.yqfnwy (mgr.34427) 1124 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:13:30.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:30 gibba020 bash[25448]: cephadm 2021-03-10T14:13:29.386898+0000 mgr.gibba020.yqfnwy (mgr.34427) 1125 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:13:30.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:30 gibba020 bash[25448]: audit 2021-03-10T14:13:29.387870+0000 mon.a (mon.0) 884 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:30.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:30 gibba020 bash[25448]: cephadm 2021-03-10T14:13:29.388268+0000 mgr.gibba020.yqfnwy (mgr.34427) 1126 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:13:30.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:30 gibba020 bash[25448]: cephadm 2021-03-10T14:13:29.388306+0000 mgr.gibba020.yqfnwy (mgr.34427) 1127 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:13:30.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:30 gibba020 bash[25448]: cephadm 2021-03-10T14:13:29.389341+0000 mgr.gibba020.yqfnwy (mgr.34427) 1128 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:13:30.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:30 gibba020 bash[25448]: audit 2021-03-10T14:13:29.389673+0000 mon.a (mon.0) 885 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:30.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:30 gibba020 bash[25448]: cephadm 2021-03-10T14:13:29.390295+0000 mgr.gibba020.yqfnwy (mgr.34427) 1129 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:13:30.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:30 gibba020 bash[25448]: cephadm 2021-03-10T14:13:29.390332+0000 mgr.gibba020.yqfnwy (mgr.34427) 1130 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:13:30.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:30 gibba020 bash[25448]: audit 2021-03-10T14:13:29.390806+0000 mon.a (mon.0) 886 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:30.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:30 gibba020 bash[25448]: cephadm 2021-03-10T14:13:29.391871+0000 mgr.gibba020.yqfnwy (mgr.34427) 1131 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:13:30.706 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:30 gibba020 bash[25448]: cephadm 2021-03-10T14:13:29.392246+0000 mgr.gibba020.yqfnwy (mgr.34427) 1132 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:13:30.706 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:30 gibba020 bash[25448]: audit 2021-03-10T14:13:29.393214+0000 mon.a (mon.0) 887 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:30.706 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:30 gibba020 bash[25448]: cephadm 2021-03-10T14:13:29.393247+0000 mgr.gibba020.yqfnwy (mgr.34427) 1133 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:13:30.706 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:30 gibba020 bash[25448]: cephadm 2021-03-10T14:13:29.393284+0000 mgr.gibba020.yqfnwy (mgr.34427) 1134 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:13:30.706 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:30 gibba020 bash[25448]: cephadm 2021-03-10T14:13:29.393447+0000 mgr.gibba020.yqfnwy (mgr.34427) 1135 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:13:30.707 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:30 gibba020 bash[25448]: audit 2021-03-10T14:13:29.394922+0000 mon.a (mon.0) 888 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:30.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[29418]: cephadm 2021-03-10T14:13:29.168397+0000 mgr.gibba020.yqfnwy (mgr.34427) 1119 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:13:30.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[29418]: cephadm 2021-03-10T14:13:29.168812+0000 mgr.gibba020.yqfnwy (mgr.34427) 1120 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:13:30.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[29418]: cluster 2021-03-10T14:13:29.208033+0000 mgr.gibba020.yqfnwy (mgr.34427) 1121 : cluster [DBG] pgmap v626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:30.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[29418]: audit 2021-03-10T14:13:29.382992+0000 mon.a (mon.0) 882 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:13:30.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[29418]: cephadm 2021-03-10T14:13:29.383320+0000 mgr.gibba020.yqfnwy (mgr.34427) 1122 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:13:30.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[29418]: cephadm 2021-03-10T14:13:29.385119+0000 mgr.gibba020.yqfnwy (mgr.34427) 1123 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:13:30.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[29418]: audit 2021-03-10T14:13:29.386257+0000 mon.a (mon.0) 883 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:13:30.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[29418]: cephadm 2021-03-10T14:13:29.386859+0000 mgr.gibba020.yqfnwy (mgr.34427) 1124 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:13:30.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[29418]: cephadm 2021-03-10T14:13:29.386898+0000 mgr.gibba020.yqfnwy (mgr.34427) 1125 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:13:30.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[29418]: audit 2021-03-10T14:13:29.387870+0000 mon.a (mon.0) 884 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:30.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[29418]: cephadm 2021-03-10T14:13:29.388268+0000 mgr.gibba020.yqfnwy (mgr.34427) 1126 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:13:30.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[29418]: cephadm 2021-03-10T14:13:29.388306+0000 mgr.gibba020.yqfnwy (mgr.34427) 1127 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:13:30.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[29418]: cephadm 2021-03-10T14:13:29.389341+0000 mgr.gibba020.yqfnwy (mgr.34427) 1128 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:13:30.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[29418]: audit 2021-03-10T14:13:29.389673+0000 mon.a (mon.0) 885 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:30.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[29418]: cephadm 2021-03-10T14:13:29.390295+0000 mgr.gibba020.yqfnwy (mgr.34427) 1129 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:13:30.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[29418]: cephadm 2021-03-10T14:13:29.390332+0000 mgr.gibba020.yqfnwy (mgr.34427) 1130 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:13:30.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[29418]: audit 2021-03-10T14:13:29.390806+0000 mon.a (mon.0) 886 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:30.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[29418]: cephadm 2021-03-10T14:13:29.391871+0000 mgr.gibba020.yqfnwy (mgr.34427) 1131 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:13:30.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[29418]: cephadm 2021-03-10T14:13:29.392246+0000 mgr.gibba020.yqfnwy (mgr.34427) 1132 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:13:30.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[29418]: audit 2021-03-10T14:13:29.393214+0000 mon.a (mon.0) 887 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:30.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[29418]: cephadm 2021-03-10T14:13:29.393247+0000 mgr.gibba020.yqfnwy (mgr.34427) 1133 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:13:30.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[30381]: cephadm 2021-03-10T14:13:29.168397+0000 mgr.gibba020.yqfnwy (mgr.34427) 1119 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:13:30.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[30381]: cephadm 2021-03-10T14:13:29.168812+0000 mgr.gibba020.yqfnwy (mgr.34427) 1120 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:13:30.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[30381]: cluster 2021-03-10T14:13:29.208033+0000 mgr.gibba020.yqfnwy (mgr.34427) 1121 : cluster [DBG] pgmap v626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:30.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[30381]: audit 2021-03-10T14:13:29.382992+0000 mon.a (mon.0) 882 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:13:30.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[30381]: cephadm 2021-03-10T14:13:29.383320+0000 mgr.gibba020.yqfnwy (mgr.34427) 1122 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:13:30.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[30381]: cephadm 2021-03-10T14:13:29.385119+0000 mgr.gibba020.yqfnwy (mgr.34427) 1123 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:13:30.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[30381]: audit 2021-03-10T14:13:29.386257+0000 mon.a (mon.0) 883 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:13:30.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[30381]: cephadm 2021-03-10T14:13:29.386859+0000 mgr.gibba020.yqfnwy (mgr.34427) 1124 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:13:30.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[30381]: cephadm 2021-03-10T14:13:29.386898+0000 mgr.gibba020.yqfnwy (mgr.34427) 1125 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:13:30.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[30381]: audit 2021-03-10T14:13:29.387870+0000 mon.a (mon.0) 884 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:30.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[30381]: cephadm 2021-03-10T14:13:29.388268+0000 mgr.gibba020.yqfnwy (mgr.34427) 1126 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:13:30.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[30381]: cephadm 2021-03-10T14:13:29.388306+0000 mgr.gibba020.yqfnwy (mgr.34427) 1127 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:13:30.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[30381]: cephadm 2021-03-10T14:13:29.389341+0000 mgr.gibba020.yqfnwy (mgr.34427) 1128 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:13:30.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[30381]: audit 2021-03-10T14:13:29.389673+0000 mon.a (mon.0) 885 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:30.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[30381]: cephadm 2021-03-10T14:13:29.390295+0000 mgr.gibba020.yqfnwy (mgr.34427) 1129 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:13:30.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[30381]: cephadm 2021-03-10T14:13:29.390332+0000 mgr.gibba020.yqfnwy (mgr.34427) 1130 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:13:30.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[30381]: audit 2021-03-10T14:13:29.390806+0000 mon.a (mon.0) 886 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:30.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[30381]: cephadm 2021-03-10T14:13:29.391871+0000 mgr.gibba020.yqfnwy (mgr.34427) 1131 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:13:30.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[30381]: cephadm 2021-03-10T14:13:29.392246+0000 mgr.gibba020.yqfnwy (mgr.34427) 1132 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:13:30.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[30381]: audit 2021-03-10T14:13:29.393214+0000 mon.a (mon.0) 887 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:30.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[30381]: cephadm 2021-03-10T14:13:29.393247+0000 mgr.gibba020.yqfnwy (mgr.34427) 1133 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:13:30.891 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[29418]: cephadm 2021-03-10T14:13:29.393284+0000 mgr.gibba020.yqfnwy (mgr.34427) 1134 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:13:30.892 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[29418]: cephadm 2021-03-10T14:13:29.393447+0000 mgr.gibba020.yqfnwy (mgr.34427) 1135 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:13:30.893 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[29418]: audit 2021-03-10T14:13:29.394922+0000 mon.a (mon.0) 888 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:30.893 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[30381]: cephadm 2021-03-10T14:13:29.393284+0000 mgr.gibba020.yqfnwy (mgr.34427) 1134 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:13:30.893 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[30381]: cephadm 2021-03-10T14:13:29.393447+0000 mgr.gibba020.yqfnwy (mgr.34427) 1135 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:13:30.894 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:30 gibba013 bash[30381]: audit 2021-03-10T14:13:29.394922+0000 mon.a (mon.0) 888 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:32.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:32 gibba020 bash[25448]: cluster 2021-03-10T14:13:31.209480+0000 mgr.gibba020.yqfnwy (mgr.34427) 1136 : cluster [DBG] pgmap v627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:32.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:32 gibba013 bash[29418]: cluster 2021-03-10T14:13:31.209480+0000 mgr.gibba020.yqfnwy (mgr.34427) 1136 : cluster [DBG] pgmap v627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:32.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:32 gibba013 bash[30381]: cluster 2021-03-10T14:13:31.209480+0000 mgr.gibba020.yqfnwy (mgr.34427) 1136 : cluster [DBG] pgmap v627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:34.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:34 gibba020 bash[25448]: cluster 2021-03-10T14:13:33.210831+0000 mgr.gibba020.yqfnwy (mgr.34427) 1137 : cluster [DBG] pgmap v628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:34.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:34 gibba013 bash[29418]: cluster 2021-03-10T14:13:33.210831+0000 mgr.gibba020.yqfnwy (mgr.34427) 1137 : cluster [DBG] pgmap v628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:34.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:34 gibba013 bash[30381]: cluster 2021-03-10T14:13:33.210831+0000 mgr.gibba020.yqfnwy (mgr.34427) 1137 : cluster [DBG] pgmap v628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:36.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:36 gibba020 bash[25448]: cluster 2021-03-10T14:13:35.211759+0000 mgr.gibba020.yqfnwy (mgr.34427) 1138 : cluster [DBG] pgmap v629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:36.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:36 gibba013 bash[29418]: cluster 2021-03-10T14:13:35.211759+0000 mgr.gibba020.yqfnwy (mgr.34427) 1138 : cluster [DBG] pgmap v629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:36.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:36 gibba013 bash[30381]: cluster 2021-03-10T14:13:35.211759+0000 mgr.gibba020.yqfnwy (mgr.34427) 1138 : cluster [DBG] pgmap v629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:38.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:38 gibba020 bash[25448]: cluster 2021-03-10T14:13:37.212813+0000 mgr.gibba020.yqfnwy (mgr.34427) 1139 : cluster [DBG] pgmap v630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:38.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:38 gibba013 bash[29418]: cluster 2021-03-10T14:13:37.212813+0000 mgr.gibba020.yqfnwy (mgr.34427) 1139 : cluster [DBG] pgmap v630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:38.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:38 gibba013 bash[30381]: cluster 2021-03-10T14:13:37.212813+0000 mgr.gibba020.yqfnwy (mgr.34427) 1139 : cluster [DBG] pgmap v630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:40.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:40 gibba020 bash[25448]: cluster 2021-03-10T14:13:39.214565+0000 mgr.gibba020.yqfnwy (mgr.34427) 1140 : cluster [DBG] pgmap v631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:40.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:40 gibba013 bash[29418]: cluster 2021-03-10T14:13:39.214565+0000 mgr.gibba020.yqfnwy (mgr.34427) 1140 : cluster [DBG] pgmap v631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:40.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:40 gibba013 bash[30381]: cluster 2021-03-10T14:13:39.214565+0000 mgr.gibba020.yqfnwy (mgr.34427) 1140 : cluster [DBG] pgmap v631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:42.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:42 gibba013 bash[29418]: cluster 2021-03-10T14:13:41.215524+0000 mgr.gibba020.yqfnwy (mgr.34427) 1141 : cluster [DBG] pgmap v632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:42.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:42 gibba013 bash[30381]: cluster 2021-03-10T14:13:41.215524+0000 mgr.gibba020.yqfnwy (mgr.34427) 1141 : cluster [DBG] pgmap v632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:42.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:42 gibba020 bash[25448]: cluster 2021-03-10T14:13:41.215524+0000 mgr.gibba020.yqfnwy (mgr.34427) 1141 : cluster [DBG] pgmap v632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:44.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:44 gibba020 bash[25448]: cluster 2021-03-10T14:13:43.216815+0000 mgr.gibba020.yqfnwy (mgr.34427) 1142 : cluster [DBG] pgmap v633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:44.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:44 gibba013 bash[29418]: cluster 2021-03-10T14:13:43.216815+0000 mgr.gibba020.yqfnwy (mgr.34427) 1142 : cluster [DBG] pgmap v633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:44.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:44 gibba013 bash[30381]: cluster 2021-03-10T14:13:43.216815+0000 mgr.gibba020.yqfnwy (mgr.34427) 1142 : cluster [DBG] pgmap v633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:45.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:45 gibba013 bash[29418]: cephadm 2021-03-10T14:13:44.409433+0000 mgr.gibba020.yqfnwy (mgr.34427) 1143 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:13:45.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:45 gibba013 bash[30381]: cephadm 2021-03-10T14:13:44.409433+0000 mgr.gibba020.yqfnwy (mgr.34427) 1143 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:13:45.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:45 gibba020 bash[25448]: cephadm 2021-03-10T14:13:44.409433+0000 mgr.gibba020.yqfnwy (mgr.34427) 1143 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:13:46.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:46 gibba013 bash[29418]: cluster 2021-03-10T14:13:45.218206+0000 mgr.gibba020.yqfnwy (mgr.34427) 1144 : cluster [DBG] pgmap v634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:46.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:46 gibba013 bash[30381]: cluster 2021-03-10T14:13:45.218206+0000 mgr.gibba020.yqfnwy (mgr.34427) 1144 : cluster [DBG] pgmap v634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:46.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:46 gibba020 bash[25448]: cluster 2021-03-10T14:13:45.218206+0000 mgr.gibba020.yqfnwy (mgr.34427) 1144 : cluster [DBG] pgmap v634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:48.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:48 gibba013 bash[29418]: cluster 2021-03-10T14:13:47.219073+0000 mgr.gibba020.yqfnwy (mgr.34427) 1145 : cluster [DBG] pgmap v635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:48.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:48 gibba013 bash[30381]: cluster 2021-03-10T14:13:47.219073+0000 mgr.gibba020.yqfnwy (mgr.34427) 1145 : cluster [DBG] pgmap v635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:48.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:48 gibba020 bash[25448]: cluster 2021-03-10T14:13:47.219073+0000 mgr.gibba020.yqfnwy (mgr.34427) 1145 : cluster [DBG] pgmap v635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:50.151 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:13:50.379 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:13:50.379 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (20m) 6m ago 25m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:13:50.380 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (25m) 5m ago 25m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:13:50.380 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (20m) 5m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:13:50.380 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (21m) 5m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:13:50.380 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (20m) 6m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:13:50.381 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (19m) 6m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:13:50.381 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (19m) 5m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:13:50.381 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (19m) 6m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:13:50.381 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (25m) 6m ago 25m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:13:50.381 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (25m) 5m ago 25m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:13:50.382 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (18m) 6m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:13:50.382 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (18m) 6m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:13:50.382 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (17m) 6m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:13:50.382 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (17m) 6m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:13:50.383 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (16m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:13:50.383 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (16m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:13:50.383 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (16m) 5m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:13:50.383 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (15m) 5m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:13:50.383 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (25m) 5m ago 25m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:13:50.384 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 5m ago 23m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:13:50.630 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:13:50.630 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:13:50.631 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:13:50.631 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:13:50.631 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:13:50.631 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:13:50.632 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:13:50.632 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:13:50.632 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:13:50.632 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:13:50.632 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:13:50.633 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:13:50.633 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:13:50.633 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:13:50.633 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:13:50.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:50 gibba013 bash[29418]: cluster 2021-03-10T14:13:49.220556+0000 mgr.gibba020.yqfnwy (mgr.34427) 1146 : cluster [DBG] pgmap v636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:50.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:50 gibba013 bash[30381]: cluster 2021-03-10T14:13:49.220556+0000 mgr.gibba020.yqfnwy (mgr.34427) 1146 : cluster [DBG] pgmap v636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:50.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:50 gibba020 bash[25448]: cluster 2021-03-10T14:13:49.220556+0000 mgr.gibba020.yqfnwy (mgr.34427) 1146 : cluster [DBG] pgmap v636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:51.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:51 gibba013 bash[29418]: audit 2021-03-10T14:13:50.137412+0000 mgr.gibba020.yqfnwy (mgr.34427) 1147 : audit [DBG] from='client.44826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:13:51.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:51 gibba013 bash[29418]: audit 2021-03-10T14:13:50.362538+0000 mgr.gibba020.yqfnwy (mgr.34427) 1148 : audit [DBG] from='client.44832 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:13:51.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:51 gibba013 bash[29418]: audit 2021-03-10T14:13:50.628476+0000 mon.a (mon.0) 889 : audit [DBG] from='client.? 172.21.2.113:0/3740211500' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:51.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:51 gibba013 bash[30381]: audit 2021-03-10T14:13:50.137412+0000 mgr.gibba020.yqfnwy (mgr.34427) 1147 : audit [DBG] from='client.44826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:13:51.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:51 gibba013 bash[30381]: audit 2021-03-10T14:13:50.362538+0000 mgr.gibba020.yqfnwy (mgr.34427) 1148 : audit [DBG] from='client.44832 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:13:51.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:51 gibba013 bash[30381]: audit 2021-03-10T14:13:50.628476+0000 mon.a (mon.0) 889 : audit [DBG] from='client.? 172.21.2.113:0/3740211500' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:51.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:51 gibba020 bash[25448]: audit 2021-03-10T14:13:50.137412+0000 mgr.gibba020.yqfnwy (mgr.34427) 1147 : audit [DBG] from='client.44826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:13:51.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:51 gibba020 bash[25448]: audit 2021-03-10T14:13:50.362538+0000 mgr.gibba020.yqfnwy (mgr.34427) 1148 : audit [DBG] from='client.44832 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:13:51.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:51 gibba020 bash[25448]: audit 2021-03-10T14:13:50.628476+0000 mon.a (mon.0) 889 : audit [DBG] from='client.? 172.21.2.113:0/3740211500' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:13:52.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:52 gibba013 bash[29418]: cluster 2021-03-10T14:13:51.222153+0000 mgr.gibba020.yqfnwy (mgr.34427) 1149 : cluster [DBG] pgmap v637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:52.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:52 gibba013 bash[30381]: cluster 2021-03-10T14:13:51.222153+0000 mgr.gibba020.yqfnwy (mgr.34427) 1149 : cluster [DBG] pgmap v637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:52.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:52 gibba020 bash[25448]: cluster 2021-03-10T14:13:51.222153+0000 mgr.gibba020.yqfnwy (mgr.34427) 1149 : cluster [DBG] pgmap v637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:54.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:54 gibba013 bash[29418]: cluster 2021-03-10T14:13:53.223550+0000 mgr.gibba020.yqfnwy (mgr.34427) 1150 : cluster [DBG] pgmap v638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:54.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:54 gibba013 bash[30381]: cluster 2021-03-10T14:13:53.223550+0000 mgr.gibba020.yqfnwy (mgr.34427) 1150 : cluster [DBG] pgmap v638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:54.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:54 gibba020 bash[25448]: cluster 2021-03-10T14:13:53.223550+0000 mgr.gibba020.yqfnwy (mgr.34427) 1150 : cluster [DBG] pgmap v638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:56.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:56 gibba013 bash[29418]: cluster 2021-03-10T14:13:55.225244+0000 mgr.gibba020.yqfnwy (mgr.34427) 1151 : cluster [DBG] pgmap v639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:56.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:56 gibba013 bash[30381]: cluster 2021-03-10T14:13:55.225244+0000 mgr.gibba020.yqfnwy (mgr.34427) 1151 : cluster [DBG] pgmap v639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:56.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:56 gibba020 bash[25448]: cluster 2021-03-10T14:13:55.225244+0000 mgr.gibba020.yqfnwy (mgr.34427) 1151 : cluster [DBG] pgmap v639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:58.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:13:58 gibba013 bash[29418]: cluster 2021-03-10T14:13:57.226537+0000 mgr.gibba020.yqfnwy (mgr.34427) 1152 : cluster [DBG] pgmap v640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:58.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:13:58 gibba013 bash[30381]: cluster 2021-03-10T14:13:57.226537+0000 mgr.gibba020.yqfnwy (mgr.34427) 1152 : cluster [DBG] pgmap v640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:13:58.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:13:58 gibba020 bash[25448]: cluster 2021-03-10T14:13:57.226537+0000 mgr.gibba020.yqfnwy (mgr.34427) 1152 : cluster [DBG] pgmap v640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:00.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:00 gibba013 bash[29418]: cluster 2021-03-10T14:13:59.228153+0000 mgr.gibba020.yqfnwy (mgr.34427) 1153 : cluster [DBG] pgmap v641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:00.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:00 gibba013 bash[29418]: cephadm 2021-03-10T14:13:59.425418+0000 mgr.gibba020.yqfnwy (mgr.34427) 1154 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:14:00.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:00 gibba013 bash[30381]: cluster 2021-03-10T14:13:59.228153+0000 mgr.gibba020.yqfnwy (mgr.34427) 1153 : cluster [DBG] pgmap v641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:00.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:00 gibba013 bash[30381]: cephadm 2021-03-10T14:13:59.425418+0000 mgr.gibba020.yqfnwy (mgr.34427) 1154 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:14:00.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:00 gibba020 bash[25448]: cluster 2021-03-10T14:13:59.228153+0000 mgr.gibba020.yqfnwy (mgr.34427) 1153 : cluster [DBG] pgmap v641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:00.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:00 gibba020 bash[25448]: cephadm 2021-03-10T14:13:59.425418+0000 mgr.gibba020.yqfnwy (mgr.34427) 1154 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:14:02.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:02 gibba013 bash[29418]: cluster 2021-03-10T14:14:01.230022+0000 mgr.gibba020.yqfnwy (mgr.34427) 1155 : cluster [DBG] pgmap v642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:02.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:02 gibba013 bash[30381]: cluster 2021-03-10T14:14:01.230022+0000 mgr.gibba020.yqfnwy (mgr.34427) 1155 : cluster [DBG] pgmap v642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:02.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:02 gibba020 bash[25448]: cluster 2021-03-10T14:14:01.230022+0000 mgr.gibba020.yqfnwy (mgr.34427) 1155 : cluster [DBG] pgmap v642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:04.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:04 gibba013 bash[29418]: cluster 2021-03-10T14:14:03.231396+0000 mgr.gibba020.yqfnwy (mgr.34427) 1156 : cluster [DBG] pgmap v643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:04.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:04 gibba013 bash[30381]: cluster 2021-03-10T14:14:03.231396+0000 mgr.gibba020.yqfnwy (mgr.34427) 1156 : cluster [DBG] pgmap v643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:04.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:04 gibba020 bash[25448]: cluster 2021-03-10T14:14:03.231396+0000 mgr.gibba020.yqfnwy (mgr.34427) 1156 : cluster [DBG] pgmap v643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:06 gibba013 bash[29418]: cluster 2021-03-10T14:14:05.232445+0000 mgr.gibba020.yqfnwy (mgr.34427) 1157 : cluster [DBG] pgmap v644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:06 gibba013 bash[29418]: audit 2021-03-10T14:14:05.918966+0000 mon.a (mon.0) 890 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T14:14:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:06 gibba013 bash[29418]: audit 2021-03-10T14:14:05.919724+0000 mon.a (mon.0) 891 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:14:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:06 gibba013 bash[29418]: audit 2021-03-10T14:14:05.920410+0000 mon.a (mon.0) 892 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:14:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:06 gibba013 bash[29418]: audit 2021-03-10T14:14:05.921082+0000 mon.a (mon.0) 893 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:14:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:06 gibba013 bash[29418]: audit 2021-03-10T14:14:06.063692+0000 mon.a (mon.0) 894 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:14:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:06 gibba013 bash[29418]: audit 2021-03-10T14:14:06.070199+0000 mon.a (mon.0) 895 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:14:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:06 gibba013 bash[30381]: cluster 2021-03-10T14:14:05.232445+0000 mgr.gibba020.yqfnwy (mgr.34427) 1157 : cluster [DBG] pgmap v644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:06 gibba013 bash[30381]: audit 2021-03-10T14:14:05.918966+0000 mon.a (mon.0) 890 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T14:14:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:06 gibba013 bash[30381]: audit 2021-03-10T14:14:05.919724+0000 mon.a (mon.0) 891 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:14:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:06 gibba013 bash[30381]: audit 2021-03-10T14:14:05.920410+0000 mon.a (mon.0) 892 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:14:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:06 gibba013 bash[30381]: audit 2021-03-10T14:14:05.921082+0000 mon.a (mon.0) 893 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:14:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:06 gibba013 bash[30381]: audit 2021-03-10T14:14:06.063692+0000 mon.a (mon.0) 894 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:14:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:06 gibba013 bash[30381]: audit 2021-03-10T14:14:06.070199+0000 mon.a (mon.0) 895 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:14:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:06 gibba020 bash[25448]: cluster 2021-03-10T14:14:05.232445+0000 mgr.gibba020.yqfnwy (mgr.34427) 1157 : cluster [DBG] pgmap v644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:06 gibba020 bash[25448]: audit 2021-03-10T14:14:05.918966+0000 mon.a (mon.0) 890 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T14:14:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:06 gibba020 bash[25448]: audit 2021-03-10T14:14:05.919724+0000 mon.a (mon.0) 891 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:14:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:06 gibba020 bash[25448]: audit 2021-03-10T14:14:05.920410+0000 mon.a (mon.0) 892 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:14:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:06 gibba020 bash[25448]: audit 2021-03-10T14:14:05.921082+0000 mon.a (mon.0) 893 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:14:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:06 gibba020 bash[25448]: audit 2021-03-10T14:14:06.063692+0000 mon.a (mon.0) 894 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:14:06.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:06 gibba020 bash[25448]: audit 2021-03-10T14:14:06.070199+0000 mon.a (mon.0) 895 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:14:08.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:08 gibba013 bash[29418]: cluster 2021-03-10T14:14:07.233778+0000 mgr.gibba020.yqfnwy (mgr.34427) 1158 : cluster [DBG] pgmap v645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:08.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:08 gibba013 bash[30381]: cluster 2021-03-10T14:14:07.233778+0000 mgr.gibba020.yqfnwy (mgr.34427) 1158 : cluster [DBG] pgmap v645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:08.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:08 gibba020 bash[25448]: cluster 2021-03-10T14:14:07.233778+0000 mgr.gibba020.yqfnwy (mgr.34427) 1158 : cluster [DBG] pgmap v645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:10.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:10 gibba013 bash[29418]: cluster 2021-03-10T14:14:09.235507+0000 mgr.gibba020.yqfnwy (mgr.34427) 1159 : cluster [DBG] pgmap v646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:10.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:10 gibba013 bash[30381]: cluster 2021-03-10T14:14:09.235507+0000 mgr.gibba020.yqfnwy (mgr.34427) 1159 : cluster [DBG] pgmap v646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:10.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:10 gibba020 bash[25448]: cluster 2021-03-10T14:14:09.235507+0000 mgr.gibba020.yqfnwy (mgr.34427) 1159 : cluster [DBG] pgmap v646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:12.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:12 gibba013 bash[29418]: cluster 2021-03-10T14:14:11.237426+0000 mgr.gibba020.yqfnwy (mgr.34427) 1160 : cluster [DBG] pgmap v647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:12.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:12 gibba013 bash[30381]: cluster 2021-03-10T14:14:11.237426+0000 mgr.gibba020.yqfnwy (mgr.34427) 1160 : cluster [DBG] pgmap v647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:12.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:12 gibba020 bash[25448]: cluster 2021-03-10T14:14:11.237426+0000 mgr.gibba020.yqfnwy (mgr.34427) 1160 : cluster [DBG] pgmap v647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:14.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:14 gibba020 bash[25448]: cluster 2021-03-10T14:14:13.238891+0000 mgr.gibba020.yqfnwy (mgr.34427) 1161 : cluster [DBG] pgmap v648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:14.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:14 gibba013 bash[29418]: cluster 2021-03-10T14:14:13.238891+0000 mgr.gibba020.yqfnwy (mgr.34427) 1161 : cluster [DBG] pgmap v648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:14.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:14 gibba013 bash[30381]: cluster 2021-03-10T14:14:13.238891+0000 mgr.gibba020.yqfnwy (mgr.34427) 1161 : cluster [DBG] pgmap v648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:15.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:15 gibba013 bash[29418]: cephadm 2021-03-10T14:14:14.441223+0000 mgr.gibba020.yqfnwy (mgr.34427) 1162 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:14:15.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:15 gibba013 bash[30381]: cephadm 2021-03-10T14:14:14.441223+0000 mgr.gibba020.yqfnwy (mgr.34427) 1162 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:14:15.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:15 gibba020 bash[25448]: cephadm 2021-03-10T14:14:14.441223+0000 mgr.gibba020.yqfnwy (mgr.34427) 1162 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:14:16.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:16 gibba013 bash[29418]: cluster 2021-03-10T14:14:15.240618+0000 mgr.gibba020.yqfnwy (mgr.34427) 1163 : cluster [DBG] pgmap v649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:16.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:16 gibba013 bash[30381]: cluster 2021-03-10T14:14:15.240618+0000 mgr.gibba020.yqfnwy (mgr.34427) 1163 : cluster [DBG] pgmap v649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:16.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:16 gibba020 bash[25448]: cluster 2021-03-10T14:14:15.240618+0000 mgr.gibba020.yqfnwy (mgr.34427) 1163 : cluster [DBG] pgmap v649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:17.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:17 gibba020 bash[25448]: cluster 2021-03-10T14:14:17.241916+0000 mgr.gibba020.yqfnwy (mgr.34427) 1164 : cluster [DBG] pgmap v650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:18.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:17 gibba013 bash[29418]: cluster 2021-03-10T14:14:17.241916+0000 mgr.gibba020.yqfnwy (mgr.34427) 1164 : cluster [DBG] pgmap v650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:18.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:17 gibba013 bash[30381]: cluster 2021-03-10T14:14:17.241916+0000 mgr.gibba020.yqfnwy (mgr.34427) 1164 : cluster [DBG] pgmap v650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:20.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:20 gibba013 bash[29418]: cluster 2021-03-10T14:14:19.243629+0000 mgr.gibba020.yqfnwy (mgr.34427) 1165 : cluster [DBG] pgmap v651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:20.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:20 gibba013 bash[30381]: cluster 2021-03-10T14:14:19.243629+0000 mgr.gibba020.yqfnwy (mgr.34427) 1165 : cluster [DBG] pgmap v651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:20.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:20 gibba020 bash[25448]: cluster 2021-03-10T14:14:19.243629+0000 mgr.gibba020.yqfnwy (mgr.34427) 1165 : cluster [DBG] pgmap v651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:20.873 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:14:21.104 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:14:21.104 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (20m) 6m ago 26m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:14:21.105 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (26m) 5m ago 26m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:14:21.105 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (21m) 5m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:14:21.105 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (21m) 5m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:14:21.105 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (20m) 6m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:14:21.106 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (20m) 6m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:14:21.106 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (19m) 5m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:14:21.106 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (20m) 6m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:14:21.106 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (26m) 6m ago 26m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:14:21.106 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (26m) 5m ago 26m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:14:21.107 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (19m) 6m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:14:21.107 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (18m) 6m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:14:21.107 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (18m) 6m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:14:21.107 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (17m) 6m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:14:21.108 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (17m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:14:21.108 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (16m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:14:21.108 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (16m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:14:21.108 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (16m) 5m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:14:21.108 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (25m) 5m ago 26m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:14:21.109 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 5m ago 24m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:14:21.357 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:14:21.358 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:14:21.358 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:14:21.358 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:14:21.358 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:14:21.359 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:14:21.359 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:14:21.359 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:14:21.359 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:14:21.359 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:14:21.360 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:14:21.360 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:14:21.360 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:14:21.360 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:14:21.361 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:14:22.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:22 gibba013 bash[29418]: audit 2021-03-10T14:14:20.859494+0000 mgr.gibba020.yqfnwy (mgr.34427) 1166 : audit [DBG] from='client.54829 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:14:22.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:22 gibba013 bash[29418]: audit 2021-03-10T14:14:21.087640+0000 mgr.gibba020.yqfnwy (mgr.34427) 1167 : audit [DBG] from='client.54835 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:14:22.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:22 gibba013 bash[29418]: cluster 2021-03-10T14:14:21.245430+0000 mgr.gibba020.yqfnwy (mgr.34427) 1168 : cluster [DBG] pgmap v652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:22.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:22 gibba013 bash[29418]: audit 2021-03-10T14:14:21.355744+0000 mon.a (mon.0) 896 : audit [DBG] from='client.? 172.21.2.113:0/1992200437' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:22.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:22 gibba013 bash[30381]: audit 2021-03-10T14:14:20.859494+0000 mgr.gibba020.yqfnwy (mgr.34427) 1166 : audit [DBG] from='client.54829 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:14:22.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:22 gibba013 bash[30381]: audit 2021-03-10T14:14:21.087640+0000 mgr.gibba020.yqfnwy (mgr.34427) 1167 : audit [DBG] from='client.54835 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:14:22.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:22 gibba013 bash[30381]: cluster 2021-03-10T14:14:21.245430+0000 mgr.gibba020.yqfnwy (mgr.34427) 1168 : cluster [DBG] pgmap v652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:22.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:22 gibba013 bash[30381]: audit 2021-03-10T14:14:21.355744+0000 mon.a (mon.0) 896 : audit [DBG] from='client.? 172.21.2.113:0/1992200437' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:22.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:22 gibba020 bash[25448]: audit 2021-03-10T14:14:20.859494+0000 mgr.gibba020.yqfnwy (mgr.34427) 1166 : audit [DBG] from='client.54829 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:14:22.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:22 gibba020 bash[25448]: audit 2021-03-10T14:14:21.087640+0000 mgr.gibba020.yqfnwy (mgr.34427) 1167 : audit [DBG] from='client.54835 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:14:22.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:22 gibba020 bash[25448]: cluster 2021-03-10T14:14:21.245430+0000 mgr.gibba020.yqfnwy (mgr.34427) 1168 : cluster [DBG] pgmap v652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:22.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:22 gibba020 bash[25448]: audit 2021-03-10T14:14:21.355744+0000 mon.a (mon.0) 896 : audit [DBG] from='client.? 172.21.2.113:0/1992200437' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:24.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:24 gibba013 bash[29418]: cluster 2021-03-10T14:14:23.246771+0000 mgr.gibba020.yqfnwy (mgr.34427) 1169 : cluster [DBG] pgmap v653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:24.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:24 gibba013 bash[30381]: cluster 2021-03-10T14:14:23.246771+0000 mgr.gibba020.yqfnwy (mgr.34427) 1169 : cluster [DBG] pgmap v653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:24.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:24 gibba020 bash[25448]: cluster 2021-03-10T14:14:23.246771+0000 mgr.gibba020.yqfnwy (mgr.34427) 1169 : cluster [DBG] pgmap v653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:26.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:26 gibba013 bash[29418]: cluster 2021-03-10T14:14:25.248469+0000 mgr.gibba020.yqfnwy (mgr.34427) 1170 : cluster [DBG] pgmap v654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:26.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:26 gibba013 bash[30381]: cluster 2021-03-10T14:14:25.248469+0000 mgr.gibba020.yqfnwy (mgr.34427) 1170 : cluster [DBG] pgmap v654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:26.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:26 gibba020 bash[25448]: cluster 2021-03-10T14:14:25.248469+0000 mgr.gibba020.yqfnwy (mgr.34427) 1170 : cluster [DBG] pgmap v654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:28.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:28 gibba013 bash[29418]: cluster 2021-03-10T14:14:27.249634+0000 mgr.gibba020.yqfnwy (mgr.34427) 1171 : cluster [DBG] pgmap v655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:28.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:28 gibba013 bash[30381]: cluster 2021-03-10T14:14:27.249634+0000 mgr.gibba020.yqfnwy (mgr.34427) 1171 : cluster [DBG] pgmap v655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:28.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:28 gibba020 bash[25448]: cluster 2021-03-10T14:14:27.249634+0000 mgr.gibba020.yqfnwy (mgr.34427) 1171 : cluster [DBG] pgmap v655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:30.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:30 gibba013 bash[29418]: cluster 2021-03-10T14:14:29.251350+0000 mgr.gibba020.yqfnwy (mgr.34427) 1172 : cluster [DBG] pgmap v656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:30.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:30 gibba013 bash[29418]: audit 2021-03-10T14:14:29.460595+0000 mon.a (mon.0) 897 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:14:30.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:30 gibba013 bash[29418]: audit 2021-03-10T14:14:29.666463+0000 mon.a (mon.0) 898 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:14:30.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:30 gibba013 bash[29418]: audit 2021-03-10T14:14:29.671735+0000 mon.a (mon.0) 899 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:14:30.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:30 gibba013 bash[29418]: audit 2021-03-10T14:14:29.876554+0000 mon.a (mon.0) 900 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:14:30.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:30 gibba013 bash[29418]: audit 2021-03-10T14:14:29.879909+0000 mon.a (mon.0) 901 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:14:30.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:30 gibba013 bash[29418]: audit 2021-03-10T14:14:29.881662+0000 mon.a (mon.0) 902 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:30.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:30 gibba013 bash[29418]: audit 2021-03-10T14:14:29.882953+0000 mon.a (mon.0) 903 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:30.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:30 gibba013 bash[29418]: audit 2021-03-10T14:14:29.884209+0000 mon.a (mon.0) 904 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:30.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:30 gibba013 bash[29418]: audit 2021-03-10T14:14:29.887076+0000 mon.a (mon.0) 905 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:30.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:30 gibba013 bash[29418]: audit 2021-03-10T14:14:29.888790+0000 mon.a (mon.0) 906 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:30.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:30 gibba013 bash[30381]: cluster 2021-03-10T14:14:29.251350+0000 mgr.gibba020.yqfnwy (mgr.34427) 1172 : cluster [DBG] pgmap v656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:30.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:30 gibba013 bash[30381]: audit 2021-03-10T14:14:29.460595+0000 mon.a (mon.0) 897 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:14:30.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:30 gibba013 bash[30381]: audit 2021-03-10T14:14:29.666463+0000 mon.a (mon.0) 898 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:14:30.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:30 gibba013 bash[30381]: audit 2021-03-10T14:14:29.671735+0000 mon.a (mon.0) 899 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:14:30.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:30 gibba013 bash[30381]: audit 2021-03-10T14:14:29.876554+0000 mon.a (mon.0) 900 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:14:30.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:30 gibba013 bash[30381]: audit 2021-03-10T14:14:29.879909+0000 mon.a (mon.0) 901 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:14:30.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:30 gibba013 bash[30381]: audit 2021-03-10T14:14:29.881662+0000 mon.a (mon.0) 902 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:30.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:30 gibba013 bash[30381]: audit 2021-03-10T14:14:29.882953+0000 mon.a (mon.0) 903 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:30.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:30 gibba013 bash[30381]: audit 2021-03-10T14:14:29.884209+0000 mon.a (mon.0) 904 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:30.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:30 gibba013 bash[30381]: audit 2021-03-10T14:14:29.887076+0000 mon.a (mon.0) 905 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:30.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:30 gibba013 bash[30381]: audit 2021-03-10T14:14:29.888790+0000 mon.a (mon.0) 906 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:30.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:30 gibba020 bash[25448]: cluster 2021-03-10T14:14:29.251350+0000 mgr.gibba020.yqfnwy (mgr.34427) 1172 : cluster [DBG] pgmap v656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:30.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:30 gibba020 bash[25448]: audit 2021-03-10T14:14:29.460595+0000 mon.a (mon.0) 897 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:14:30.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:30 gibba020 bash[25448]: audit 2021-03-10T14:14:29.666463+0000 mon.a (mon.0) 898 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:14:30.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:30 gibba020 bash[25448]: audit 2021-03-10T14:14:29.671735+0000 mon.a (mon.0) 899 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:14:30.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:30 gibba020 bash[25448]: audit 2021-03-10T14:14:29.876554+0000 mon.a (mon.0) 900 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:14:30.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:30 gibba020 bash[25448]: audit 2021-03-10T14:14:29.879909+0000 mon.a (mon.0) 901 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:14:30.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:30 gibba020 bash[25448]: audit 2021-03-10T14:14:29.881662+0000 mon.a (mon.0) 902 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:30.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:30 gibba020 bash[25448]: audit 2021-03-10T14:14:29.882953+0000 mon.a (mon.0) 903 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:30.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:30 gibba020 bash[25448]: audit 2021-03-10T14:14:29.884209+0000 mon.a (mon.0) 904 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:30.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:30 gibba020 bash[25448]: audit 2021-03-10T14:14:29.887076+0000 mon.a (mon.0) 905 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:30.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:30 gibba020 bash[25448]: audit 2021-03-10T14:14:29.888790+0000 mon.a (mon.0) 906 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:31.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:31 gibba013 bash[29418]: cephadm 2021-03-10T14:14:29.664707+0000 mgr.gibba020.yqfnwy (mgr.34427) 1173 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:14:31.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:31 gibba013 bash[29418]: cephadm 2021-03-10T14:14:29.669913+0000 mgr.gibba020.yqfnwy (mgr.34427) 1174 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:14:31.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:31 gibba013 bash[29418]: cephadm 2021-03-10T14:14:29.876807+0000 mgr.gibba020.yqfnwy (mgr.34427) 1175 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:14:31.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:31 gibba013 bash[29418]: cephadm 2021-03-10T14:14:29.878713+0000 mgr.gibba020.yqfnwy (mgr.34427) 1176 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:14:31.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:31 gibba013 bash[29418]: cephadm 2021-03-10T14:14:29.880005+0000 mgr.gibba020.yqfnwy (mgr.34427) 1177 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:14:31.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:31 gibba013 bash[29418]: cephadm 2021-03-10T14:14:29.880062+0000 mgr.gibba020.yqfnwy (mgr.34427) 1178 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:14:31.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:31 gibba013 bash[29418]: cephadm 2021-03-10T14:14:29.881457+0000 mgr.gibba020.yqfnwy (mgr.34427) 1179 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:14:31.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:31 gibba013 bash[29418]: cephadm 2021-03-10T14:14:29.881501+0000 mgr.gibba020.yqfnwy (mgr.34427) 1180 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:14:31.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:31 gibba013 bash[29418]: cephadm 2021-03-10T14:14:29.882632+0000 mgr.gibba020.yqfnwy (mgr.34427) 1181 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:14:31.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:31 gibba013 bash[29418]: cephadm 2021-03-10T14:14:29.883881+0000 mgr.gibba020.yqfnwy (mgr.34427) 1182 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:14:31.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:31 gibba013 bash[29418]: cephadm 2021-03-10T14:14:29.883985+0000 mgr.gibba020.yqfnwy (mgr.34427) 1183 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:14:31.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:31 gibba013 bash[29418]: cephadm 2021-03-10T14:14:29.885548+0000 mgr.gibba020.yqfnwy (mgr.34427) 1184 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:14:31.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:31 gibba013 bash[29418]: cephadm 2021-03-10T14:14:29.885893+0000 mgr.gibba020.yqfnwy (mgr.34427) 1185 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:14:31.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:31 gibba013 bash[29418]: cephadm 2021-03-10T14:14:29.887290+0000 mgr.gibba020.yqfnwy (mgr.34427) 1186 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:14:31.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:31 gibba013 bash[29418]: cephadm 2021-03-10T14:14:29.887337+0000 mgr.gibba020.yqfnwy (mgr.34427) 1187 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:14:31.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:31 gibba013 bash[29418]: cephadm 2021-03-10T14:14:29.887452+0000 mgr.gibba020.yqfnwy (mgr.34427) 1188 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:14:31.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:31 gibba013 bash[30381]: cephadm 2021-03-10T14:14:29.664707+0000 mgr.gibba020.yqfnwy (mgr.34427) 1173 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:14:31.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:31 gibba013 bash[30381]: cephadm 2021-03-10T14:14:29.669913+0000 mgr.gibba020.yqfnwy (mgr.34427) 1174 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:14:31.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:31 gibba013 bash[30381]: cephadm 2021-03-10T14:14:29.876807+0000 mgr.gibba020.yqfnwy (mgr.34427) 1175 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:14:31.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:31 gibba013 bash[30381]: cephadm 2021-03-10T14:14:29.878713+0000 mgr.gibba020.yqfnwy (mgr.34427) 1176 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:14:31.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:31 gibba013 bash[30381]: cephadm 2021-03-10T14:14:29.880005+0000 mgr.gibba020.yqfnwy (mgr.34427) 1177 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:14:31.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:31 gibba013 bash[30381]: cephadm 2021-03-10T14:14:29.880062+0000 mgr.gibba020.yqfnwy (mgr.34427) 1178 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:14:31.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:31 gibba013 bash[30381]: cephadm 2021-03-10T14:14:29.881457+0000 mgr.gibba020.yqfnwy (mgr.34427) 1179 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:14:31.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:31 gibba013 bash[30381]: cephadm 2021-03-10T14:14:29.881501+0000 mgr.gibba020.yqfnwy (mgr.34427) 1180 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:14:31.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:31 gibba013 bash[30381]: cephadm 2021-03-10T14:14:29.882632+0000 mgr.gibba020.yqfnwy (mgr.34427) 1181 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:14:31.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:31 gibba013 bash[30381]: cephadm 2021-03-10T14:14:29.883881+0000 mgr.gibba020.yqfnwy (mgr.34427) 1182 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:14:31.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:31 gibba013 bash[30381]: cephadm 2021-03-10T14:14:29.883985+0000 mgr.gibba020.yqfnwy (mgr.34427) 1183 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:14:31.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:31 gibba013 bash[30381]: cephadm 2021-03-10T14:14:29.885548+0000 mgr.gibba020.yqfnwy (mgr.34427) 1184 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:14:31.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:31 gibba013 bash[30381]: cephadm 2021-03-10T14:14:29.885893+0000 mgr.gibba020.yqfnwy (mgr.34427) 1185 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:14:31.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:31 gibba013 bash[30381]: cephadm 2021-03-10T14:14:29.887290+0000 mgr.gibba020.yqfnwy (mgr.34427) 1186 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:14:31.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:31 gibba013 bash[30381]: cephadm 2021-03-10T14:14:29.887337+0000 mgr.gibba020.yqfnwy (mgr.34427) 1187 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:14:31.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:31 gibba013 bash[30381]: cephadm 2021-03-10T14:14:29.887452+0000 mgr.gibba020.yqfnwy (mgr.34427) 1188 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:14:31.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:31 gibba020 bash[25448]: cephadm 2021-03-10T14:14:29.664707+0000 mgr.gibba020.yqfnwy (mgr.34427) 1173 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:14:31.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:31 gibba020 bash[25448]: cephadm 2021-03-10T14:14:29.669913+0000 mgr.gibba020.yqfnwy (mgr.34427) 1174 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:14:31.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:31 gibba020 bash[25448]: cephadm 2021-03-10T14:14:29.876807+0000 mgr.gibba020.yqfnwy (mgr.34427) 1175 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:14:31.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:31 gibba020 bash[25448]: cephadm 2021-03-10T14:14:29.878713+0000 mgr.gibba020.yqfnwy (mgr.34427) 1176 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:14:31.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:31 gibba020 bash[25448]: cephadm 2021-03-10T14:14:29.880005+0000 mgr.gibba020.yqfnwy (mgr.34427) 1177 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:14:31.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:31 gibba020 bash[25448]: cephadm 2021-03-10T14:14:29.880062+0000 mgr.gibba020.yqfnwy (mgr.34427) 1178 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:14:31.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:31 gibba020 bash[25448]: cephadm 2021-03-10T14:14:29.881457+0000 mgr.gibba020.yqfnwy (mgr.34427) 1179 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:14:31.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:31 gibba020 bash[25448]: cephadm 2021-03-10T14:14:29.881501+0000 mgr.gibba020.yqfnwy (mgr.34427) 1180 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:14:31.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:31 gibba020 bash[25448]: cephadm 2021-03-10T14:14:29.882632+0000 mgr.gibba020.yqfnwy (mgr.34427) 1181 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:14:31.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:31 gibba020 bash[25448]: cephadm 2021-03-10T14:14:29.883881+0000 mgr.gibba020.yqfnwy (mgr.34427) 1182 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:14:31.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:31 gibba020 bash[25448]: cephadm 2021-03-10T14:14:29.883985+0000 mgr.gibba020.yqfnwy (mgr.34427) 1183 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:14:31.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:31 gibba020 bash[25448]: cephadm 2021-03-10T14:14:29.885548+0000 mgr.gibba020.yqfnwy (mgr.34427) 1184 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:14:31.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:31 gibba020 bash[25448]: cephadm 2021-03-10T14:14:29.885893+0000 mgr.gibba020.yqfnwy (mgr.34427) 1185 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:14:31.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:31 gibba020 bash[25448]: cephadm 2021-03-10T14:14:29.887290+0000 mgr.gibba020.yqfnwy (mgr.34427) 1186 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:14:31.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:31 gibba020 bash[25448]: cephadm 2021-03-10T14:14:29.887337+0000 mgr.gibba020.yqfnwy (mgr.34427) 1187 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:14:31.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:31 gibba020 bash[25448]: cephadm 2021-03-10T14:14:29.887452+0000 mgr.gibba020.yqfnwy (mgr.34427) 1188 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:14:32.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:32 gibba013 bash[29418]: cluster 2021-03-10T14:14:31.253088+0000 mgr.gibba020.yqfnwy (mgr.34427) 1189 : cluster [DBG] pgmap v657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:32.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:32 gibba013 bash[30381]: cluster 2021-03-10T14:14:31.253088+0000 mgr.gibba020.yqfnwy (mgr.34427) 1189 : cluster [DBG] pgmap v657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:32.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:32 gibba020 bash[25448]: cluster 2021-03-10T14:14:31.253088+0000 mgr.gibba020.yqfnwy (mgr.34427) 1189 : cluster [DBG] pgmap v657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:34.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:34 gibba013 bash[29418]: cluster 2021-03-10T14:14:33.254528+0000 mgr.gibba020.yqfnwy (mgr.34427) 1190 : cluster [DBG] pgmap v658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:34.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:34 gibba013 bash[30381]: cluster 2021-03-10T14:14:33.254528+0000 mgr.gibba020.yqfnwy (mgr.34427) 1190 : cluster [DBG] pgmap v658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:34.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:34 gibba020 bash[25448]: cluster 2021-03-10T14:14:33.254528+0000 mgr.gibba020.yqfnwy (mgr.34427) 1190 : cluster [DBG] pgmap v658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:36.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:36 gibba013 bash[29418]: cluster 2021-03-10T14:14:35.256333+0000 mgr.gibba020.yqfnwy (mgr.34427) 1191 : cluster [DBG] pgmap v659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:36.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:36 gibba013 bash[30381]: cluster 2021-03-10T14:14:35.256333+0000 mgr.gibba020.yqfnwy (mgr.34427) 1191 : cluster [DBG] pgmap v659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:36.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:36 gibba020 bash[25448]: cluster 2021-03-10T14:14:35.256333+0000 mgr.gibba020.yqfnwy (mgr.34427) 1191 : cluster [DBG] pgmap v659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:38.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:38 gibba020 bash[25448]: cluster 2021-03-10T14:14:37.257794+0000 mgr.gibba020.yqfnwy (mgr.34427) 1192 : cluster [DBG] pgmap v660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:38.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:38 gibba013 bash[29418]: cluster 2021-03-10T14:14:37.257794+0000 mgr.gibba020.yqfnwy (mgr.34427) 1192 : cluster [DBG] pgmap v660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:38.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:38 gibba013 bash[30381]: cluster 2021-03-10T14:14:37.257794+0000 mgr.gibba020.yqfnwy (mgr.34427) 1192 : cluster [DBG] pgmap v660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:40.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:40 gibba020 bash[25448]: cluster 2021-03-10T14:14:39.259167+0000 mgr.gibba020.yqfnwy (mgr.34427) 1193 : cluster [DBG] pgmap v661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:40.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:40 gibba013 bash[29418]: cluster 2021-03-10T14:14:39.259167+0000 mgr.gibba020.yqfnwy (mgr.34427) 1193 : cluster [DBG] pgmap v661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:40.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:40 gibba013 bash[30381]: cluster 2021-03-10T14:14:39.259167+0000 mgr.gibba020.yqfnwy (mgr.34427) 1193 : cluster [DBG] pgmap v661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:42.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:42 gibba020 bash[25448]: cluster 2021-03-10T14:14:41.261089+0000 mgr.gibba020.yqfnwy (mgr.34427) 1194 : cluster [DBG] pgmap v662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:42.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:42 gibba013 bash[29418]: cluster 2021-03-10T14:14:41.261089+0000 mgr.gibba020.yqfnwy (mgr.34427) 1194 : cluster [DBG] pgmap v662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:42.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:42 gibba013 bash[30381]: cluster 2021-03-10T14:14:41.261089+0000 mgr.gibba020.yqfnwy (mgr.34427) 1194 : cluster [DBG] pgmap v662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:44.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:44 gibba020 bash[25448]: cluster 2021-03-10T14:14:43.262576+0000 mgr.gibba020.yqfnwy (mgr.34427) 1195 : cluster [DBG] pgmap v663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:44.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:44 gibba013 bash[29418]: cluster 2021-03-10T14:14:43.262576+0000 mgr.gibba020.yqfnwy (mgr.34427) 1195 : cluster [DBG] pgmap v663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:44.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:44 gibba013 bash[30381]: cluster 2021-03-10T14:14:43.262576+0000 mgr.gibba020.yqfnwy (mgr.34427) 1195 : cluster [DBG] pgmap v663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:46.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:46 gibba020 bash[25448]: cephadm 2021-03-10T14:14:44.894407+0000 mgr.gibba020.yqfnwy (mgr.34427) 1196 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:14:46.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:46 gibba020 bash[25448]: cluster 2021-03-10T14:14:45.264304+0000 mgr.gibba020.yqfnwy (mgr.34427) 1197 : cluster [DBG] pgmap v664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:46.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:46 gibba013 bash[29418]: cephadm 2021-03-10T14:14:44.894407+0000 mgr.gibba020.yqfnwy (mgr.34427) 1196 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:14:46.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:46 gibba013 bash[29418]: cluster 2021-03-10T14:14:45.264304+0000 mgr.gibba020.yqfnwy (mgr.34427) 1197 : cluster [DBG] pgmap v664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:46.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:46 gibba013 bash[30381]: cephadm 2021-03-10T14:14:44.894407+0000 mgr.gibba020.yqfnwy (mgr.34427) 1196 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:14:46.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:46 gibba013 bash[30381]: cluster 2021-03-10T14:14:45.264304+0000 mgr.gibba020.yqfnwy (mgr.34427) 1197 : cluster [DBG] pgmap v664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:48.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:48 gibba020 bash[25448]: cluster 2021-03-10T14:14:47.265594+0000 mgr.gibba020.yqfnwy (mgr.34427) 1198 : cluster [DBG] pgmap v665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:48.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:48 gibba013 bash[29418]: cluster 2021-03-10T14:14:47.265594+0000 mgr.gibba020.yqfnwy (mgr.34427) 1198 : cluster [DBG] pgmap v665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:48.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:48 gibba013 bash[30381]: cluster 2021-03-10T14:14:47.265594+0000 mgr.gibba020.yqfnwy (mgr.34427) 1198 : cluster [DBG] pgmap v665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:50.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:50 gibba020 bash[25448]: cluster 2021-03-10T14:14:49.267085+0000 mgr.gibba020.yqfnwy (mgr.34427) 1199 : cluster [DBG] pgmap v666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:50.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:50 gibba013 bash[29418]: cluster 2021-03-10T14:14:49.267085+0000 mgr.gibba020.yqfnwy (mgr.34427) 1199 : cluster [DBG] pgmap v666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:50.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:50 gibba013 bash[30381]: cluster 2021-03-10T14:14:49.267085+0000 mgr.gibba020.yqfnwy (mgr.34427) 1199 : cluster [DBG] pgmap v666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:51.601 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:14:51.835 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:14:51.835 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (21m) 7m ago 26m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:14:51.836 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (26m) 6m ago 26m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:14:51.836 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (21m) 6m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:14:51.836 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (22m) 6m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:14:51.836 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (21m) 7m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:14:51.836 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (20m) 7m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:14:51.837 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (20m) 6m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:14:51.837 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (20m) 7m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:14:51.837 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (26m) 7m ago 26m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:14:51.837 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (26m) 6m ago 26m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:14:51.837 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (19m) 7m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:14:51.837 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (19m) 7m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:14:51.838 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (18m) 7m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:14:51.838 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (18m) 7m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:14:51.838 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (17m) 6m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:14:51.838 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (17m) 6m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:14:51.838 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (17m) 6m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:14:51.839 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (16m) 6m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:14:51.839 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (26m) 6m ago 26m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:14:51.839 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 6m ago 24m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:14:52.085 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:14:52.086 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:14:52.086 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:14:52.086 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:14:52.086 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:14:52.086 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:14:52.087 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:14:52.087 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:14:52.087 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:14:52.087 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:14:52.087 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:14:52.088 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:14:52.088 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:14:52.088 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:14:52.088 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:14:52.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:52 gibba020 bash[25448]: cluster 2021-03-10T14:14:51.268957+0000 mgr.gibba020.yqfnwy (mgr.34427) 1200 : cluster [DBG] pgmap v667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:52.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:52 gibba020 bash[25448]: audit 2021-03-10T14:14:51.588359+0000 mgr.gibba020.yqfnwy (mgr.34427) 1201 : audit [DBG] from='client.44862 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:14:52.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:52 gibba020 bash[25448]: audit 2021-03-10T14:14:52.083851+0000 mon.a (mon.0) 907 : audit [DBG] from='client.? 172.21.2.113:0/1429231133' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:52.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:52 gibba013 bash[29418]: cluster 2021-03-10T14:14:51.268957+0000 mgr.gibba020.yqfnwy (mgr.34427) 1200 : cluster [DBG] pgmap v667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:52.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:52 gibba013 bash[29418]: audit 2021-03-10T14:14:51.588359+0000 mgr.gibba020.yqfnwy (mgr.34427) 1201 : audit [DBG] from='client.44862 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:14:52.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:52 gibba013 bash[29418]: audit 2021-03-10T14:14:52.083851+0000 mon.a (mon.0) 907 : audit [DBG] from='client.? 172.21.2.113:0/1429231133' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:52.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:52 gibba013 bash[30381]: cluster 2021-03-10T14:14:51.268957+0000 mgr.gibba020.yqfnwy (mgr.34427) 1200 : cluster [DBG] pgmap v667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:52.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:52 gibba013 bash[30381]: audit 2021-03-10T14:14:51.588359+0000 mgr.gibba020.yqfnwy (mgr.34427) 1201 : audit [DBG] from='client.44862 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:14:52.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:52 gibba013 bash[30381]: audit 2021-03-10T14:14:52.083851+0000 mon.a (mon.0) 907 : audit [DBG] from='client.? 172.21.2.113:0/1429231133' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:14:53.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:53 gibba013 bash[29418]: audit 2021-03-10T14:14:51.820200+0000 mgr.gibba020.yqfnwy (mgr.34427) 1202 : audit [DBG] from='client.54853 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:14:53.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:53 gibba013 bash[30381]: audit 2021-03-10T14:14:51.820200+0000 mgr.gibba020.yqfnwy (mgr.34427) 1202 : audit [DBG] from='client.54853 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:14:53.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:53 gibba020 bash[25448]: audit 2021-03-10T14:14:51.820200+0000 mgr.gibba020.yqfnwy (mgr.34427) 1202 : audit [DBG] from='client.54853 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:14:54.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:54 gibba013 bash[29418]: cluster 2021-03-10T14:14:53.270372+0000 mgr.gibba020.yqfnwy (mgr.34427) 1203 : cluster [DBG] pgmap v668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:54.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:54 gibba013 bash[30381]: cluster 2021-03-10T14:14:53.270372+0000 mgr.gibba020.yqfnwy (mgr.34427) 1203 : cluster [DBG] pgmap v668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:54.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:54 gibba020 bash[25448]: cluster 2021-03-10T14:14:53.270372+0000 mgr.gibba020.yqfnwy (mgr.34427) 1203 : cluster [DBG] pgmap v668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:56.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:56 gibba013 bash[29418]: cluster 2021-03-10T14:14:55.272081+0000 mgr.gibba020.yqfnwy (mgr.34427) 1204 : cluster [DBG] pgmap v669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:56.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:56 gibba013 bash[30381]: cluster 2021-03-10T14:14:55.272081+0000 mgr.gibba020.yqfnwy (mgr.34427) 1204 : cluster [DBG] pgmap v669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:56.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:56 gibba020 bash[25448]: cluster 2021-03-10T14:14:55.272081+0000 mgr.gibba020.yqfnwy (mgr.34427) 1204 : cluster [DBG] pgmap v669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:58.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:14:58 gibba013 bash[29418]: cluster 2021-03-10T14:14:57.273327+0000 mgr.gibba020.yqfnwy (mgr.34427) 1205 : cluster [DBG] pgmap v670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:58.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:14:58 gibba013 bash[30381]: cluster 2021-03-10T14:14:57.273327+0000 mgr.gibba020.yqfnwy (mgr.34427) 1205 : cluster [DBG] pgmap v670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:14:58.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:14:58 gibba020 bash[25448]: cluster 2021-03-10T14:14:57.273327+0000 mgr.gibba020.yqfnwy (mgr.34427) 1205 : cluster [DBG] pgmap v670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:00.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:00 gibba013 bash[29418]: cluster 2021-03-10T14:14:59.274862+0000 mgr.gibba020.yqfnwy (mgr.34427) 1206 : cluster [DBG] pgmap v671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:00.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:00 gibba013 bash[30381]: cluster 2021-03-10T14:14:59.274862+0000 mgr.gibba020.yqfnwy (mgr.34427) 1206 : cluster [DBG] pgmap v671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:00.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:00 gibba020 bash[25448]: cluster 2021-03-10T14:14:59.274862+0000 mgr.gibba020.yqfnwy (mgr.34427) 1206 : cluster [DBG] pgmap v671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:01.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:01 gibba013 bash[29418]: cephadm 2021-03-10T14:14:59.910439+0000 mgr.gibba020.yqfnwy (mgr.34427) 1207 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:15:01.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:01 gibba013 bash[30381]: cephadm 2021-03-10T14:14:59.910439+0000 mgr.gibba020.yqfnwy (mgr.34427) 1207 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:15:01.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:01 gibba020 bash[25448]: cephadm 2021-03-10T14:14:59.910439+0000 mgr.gibba020.yqfnwy (mgr.34427) 1207 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:15:02.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:02 gibba013 bash[29418]: cluster 2021-03-10T14:15:01.276499+0000 mgr.gibba020.yqfnwy (mgr.34427) 1208 : cluster [DBG] pgmap v672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:02.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:02 gibba013 bash[30381]: cluster 2021-03-10T14:15:01.276499+0000 mgr.gibba020.yqfnwy (mgr.34427) 1208 : cluster [DBG] pgmap v672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:02.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:02 gibba020 bash[25448]: cluster 2021-03-10T14:15:01.276499+0000 mgr.gibba020.yqfnwy (mgr.34427) 1208 : cluster [DBG] pgmap v672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:04.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:04 gibba013 bash[29418]: cluster 2021-03-10T14:15:03.277852+0000 mgr.gibba020.yqfnwy (mgr.34427) 1209 : cluster [DBG] pgmap v673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:04.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:04 gibba013 bash[30381]: cluster 2021-03-10T14:15:03.277852+0000 mgr.gibba020.yqfnwy (mgr.34427) 1209 : cluster [DBG] pgmap v673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:04.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:04 gibba020 bash[25448]: cluster 2021-03-10T14:15:03.277852+0000 mgr.gibba020.yqfnwy (mgr.34427) 1209 : cluster [DBG] pgmap v673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:06 gibba013 bash[29418]: cluster 2021-03-10T14:15:05.279510+0000 mgr.gibba020.yqfnwy (mgr.34427) 1210 : cluster [DBG] pgmap v674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:06 gibba013 bash[29418]: audit 2021-03-10T14:15:05.929387+0000 mon.a (mon.0) 908 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:15:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:06 gibba013 bash[29418]: audit 2021-03-10T14:15:05.930140+0000 mon.a (mon.0) 909 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:15:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:06 gibba013 bash[29418]: audit 2021-03-10T14:15:05.930800+0000 mon.a (mon.0) 910 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T14:15:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:06 gibba013 bash[29418]: audit 2021-03-10T14:15:05.931452+0000 mon.a (mon.0) 911 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:15:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:06 gibba013 bash[29418]: audit 2021-03-10T14:15:06.070400+0000 mon.a (mon.0) 912 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:15:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:06 gibba013 bash[29418]: audit 2021-03-10T14:15:06.076747+0000 mon.a (mon.0) 913 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:15:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:06 gibba013 bash[30381]: cluster 2021-03-10T14:15:05.279510+0000 mgr.gibba020.yqfnwy (mgr.34427) 1210 : cluster [DBG] pgmap v674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:06 gibba013 bash[30381]: audit 2021-03-10T14:15:05.929387+0000 mon.a (mon.0) 908 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:15:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:06 gibba013 bash[30381]: audit 2021-03-10T14:15:05.930140+0000 mon.a (mon.0) 909 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:15:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:06 gibba013 bash[30381]: audit 2021-03-10T14:15:05.930800+0000 mon.a (mon.0) 910 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T14:15:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:06 gibba013 bash[30381]: audit 2021-03-10T14:15:05.931452+0000 mon.a (mon.0) 911 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:15:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:06 gibba013 bash[30381]: audit 2021-03-10T14:15:06.070400+0000 mon.a (mon.0) 912 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:15:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:06 gibba013 bash[30381]: audit 2021-03-10T14:15:06.076747+0000 mon.a (mon.0) 913 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:15:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:06 gibba020 bash[25448]: cluster 2021-03-10T14:15:05.279510+0000 mgr.gibba020.yqfnwy (mgr.34427) 1210 : cluster [DBG] pgmap v674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:06 gibba020 bash[25448]: audit 2021-03-10T14:15:05.929387+0000 mon.a (mon.0) 908 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:15:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:06 gibba020 bash[25448]: audit 2021-03-10T14:15:05.930140+0000 mon.a (mon.0) 909 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:15:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:06 gibba020 bash[25448]: audit 2021-03-10T14:15:05.930800+0000 mon.a (mon.0) 910 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T14:15:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:06 gibba020 bash[25448]: audit 2021-03-10T14:15:05.931452+0000 mon.a (mon.0) 911 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:15:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:06 gibba020 bash[25448]: audit 2021-03-10T14:15:06.070400+0000 mon.a (mon.0) 912 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:15:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:06 gibba020 bash[25448]: audit 2021-03-10T14:15:06.076747+0000 mon.a (mon.0) 913 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:15:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:08 gibba013 bash[29418]: cluster 2021-03-10T14:15:07.280936+0000 mgr.gibba020.yqfnwy (mgr.34427) 1211 : cluster [DBG] pgmap v675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:08.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:08 gibba013 bash[30381]: cluster 2021-03-10T14:15:07.280936+0000 mgr.gibba020.yqfnwy (mgr.34427) 1211 : cluster [DBG] pgmap v675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:08.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:08 gibba020 bash[25448]: cluster 2021-03-10T14:15:07.280936+0000 mgr.gibba020.yqfnwy (mgr.34427) 1211 : cluster [DBG] pgmap v675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:10.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:10 gibba013 bash[29418]: cluster 2021-03-10T14:15:09.282405+0000 mgr.gibba020.yqfnwy (mgr.34427) 1212 : cluster [DBG] pgmap v676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:10.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:10 gibba013 bash[30381]: cluster 2021-03-10T14:15:09.282405+0000 mgr.gibba020.yqfnwy (mgr.34427) 1212 : cluster [DBG] pgmap v676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:10.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:10 gibba020 bash[25448]: cluster 2021-03-10T14:15:09.282405+0000 mgr.gibba020.yqfnwy (mgr.34427) 1212 : cluster [DBG] pgmap v676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:12.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:12 gibba013 bash[29418]: cluster 2021-03-10T14:15:11.284154+0000 mgr.gibba020.yqfnwy (mgr.34427) 1213 : cluster [DBG] pgmap v677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:12.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:12 gibba013 bash[30381]: cluster 2021-03-10T14:15:11.284154+0000 mgr.gibba020.yqfnwy (mgr.34427) 1213 : cluster [DBG] pgmap v677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:12.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:12 gibba020 bash[25448]: cluster 2021-03-10T14:15:11.284154+0000 mgr.gibba020.yqfnwy (mgr.34427) 1213 : cluster [DBG] pgmap v677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:14.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:14 gibba013 bash[29418]: cluster 2021-03-10T14:15:13.285548+0000 mgr.gibba020.yqfnwy (mgr.34427) 1214 : cluster [DBG] pgmap v678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:14.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:14 gibba013 bash[30381]: cluster 2021-03-10T14:15:13.285548+0000 mgr.gibba020.yqfnwy (mgr.34427) 1214 : cluster [DBG] pgmap v678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:14.931 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:14 gibba020 bash[25448]: cluster 2021-03-10T14:15:13.285548+0000 mgr.gibba020.yqfnwy (mgr.34427) 1214 : cluster [DBG] pgmap v678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:16.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:16 gibba013 bash[29418]: cephadm 2021-03-10T14:15:14.926368+0000 mgr.gibba020.yqfnwy (mgr.34427) 1215 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:15:16.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:16 gibba013 bash[29418]: cluster 2021-03-10T14:15:15.287132+0000 mgr.gibba020.yqfnwy (mgr.34427) 1216 : cluster [DBG] pgmap v679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:16.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:16 gibba013 bash[30381]: cephadm 2021-03-10T14:15:14.926368+0000 mgr.gibba020.yqfnwy (mgr.34427) 1215 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:15:16.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:16 gibba013 bash[30381]: cluster 2021-03-10T14:15:15.287132+0000 mgr.gibba020.yqfnwy (mgr.34427) 1216 : cluster [DBG] pgmap v679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:16.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:16 gibba020 bash[25448]: cephadm 2021-03-10T14:15:14.926368+0000 mgr.gibba020.yqfnwy (mgr.34427) 1215 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:15:16.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:16 gibba020 bash[25448]: cluster 2021-03-10T14:15:15.287132+0000 mgr.gibba020.yqfnwy (mgr.34427) 1216 : cluster [DBG] pgmap v679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:18.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:18 gibba013 bash[29418]: cluster 2021-03-10T14:15:17.288776+0000 mgr.gibba020.yqfnwy (mgr.34427) 1217 : cluster [DBG] pgmap v680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:18.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:18 gibba013 bash[30381]: cluster 2021-03-10T14:15:17.288776+0000 mgr.gibba020.yqfnwy (mgr.34427) 1217 : cluster [DBG] pgmap v680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:18.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:18 gibba020 bash[25448]: cluster 2021-03-10T14:15:17.288776+0000 mgr.gibba020.yqfnwy (mgr.34427) 1217 : cluster [DBG] pgmap v680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:20.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:20 gibba013 bash[29418]: cluster 2021-03-10T14:15:19.290028+0000 mgr.gibba020.yqfnwy (mgr.34427) 1218 : cluster [DBG] pgmap v681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:20.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:20 gibba013 bash[30381]: cluster 2021-03-10T14:15:19.290028+0000 mgr.gibba020.yqfnwy (mgr.34427) 1218 : cluster [DBG] pgmap v681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:20.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:20 gibba020 bash[25448]: cluster 2021-03-10T14:15:19.290028+0000 mgr.gibba020.yqfnwy (mgr.34427) 1218 : cluster [DBG] pgmap v681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:22.332 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:15:22.561 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:15:22.561 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (21m) 7m ago 27m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:15:22.561 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (27m) 6m ago 27m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:15:22.561 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (22m) 6m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:15:22.562 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (22m) 6m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:15:22.562 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (21m) 7m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:15:22.562 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (21m) 7m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:15:22.562 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (20m) 6m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:15:22.563 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (21m) 7m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:15:22.563 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (27m) 7m ago 27m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:15:22.563 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (27m) 6m ago 27m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:15:22.563 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (20m) 7m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:15:22.563 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (19m) 7m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:15:22.564 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (19m) 7m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:15:22.564 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (18m) 7m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:15:22.564 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (18m) 6m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:15:22.564 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (17m) 6m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:15:22.565 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (17m) 6m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:15:22.565 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (17m) 6m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:15:22.565 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (26m) 6m ago 27m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:15:22.565 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 6m ago 25m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:15:22.817 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:15:22.817 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:15:22.817 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:15:22.817 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:15:22.818 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:15:22.818 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:15:22.818 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:15:22.818 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:15:22.819 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:15:22.819 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:15:22.819 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:15:22.819 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:15:22.819 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:15:22.820 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:15:22.820 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:15:22.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:22 gibba013 bash[29418]: cluster 2021-03-10T14:15:21.291614+0000 mgr.gibba020.yqfnwy (mgr.34427) 1219 : cluster [DBG] pgmap v682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:22.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:22 gibba013 bash[30381]: cluster 2021-03-10T14:15:21.291614+0000 mgr.gibba020.yqfnwy (mgr.34427) 1219 : cluster [DBG] pgmap v682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:22.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:22 gibba020 bash[25448]: cluster 2021-03-10T14:15:21.291614+0000 mgr.gibba020.yqfnwy (mgr.34427) 1219 : cluster [DBG] pgmap v682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:23.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:23 gibba013 bash[29418]: audit 2021-03-10T14:15:22.319649+0000 mgr.gibba020.yqfnwy (mgr.34427) 1220 : audit [DBG] from='client.44880 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:15:23.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:23 gibba013 bash[29418]: audit 2021-03-10T14:15:22.544222+0000 mgr.gibba020.yqfnwy (mgr.34427) 1221 : audit [DBG] from='client.44886 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:15:23.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:23 gibba013 bash[29418]: audit 2021-03-10T14:15:22.814995+0000 mon.a (mon.0) 914 : audit [DBG] from='client.? 172.21.2.113:0/3216196344' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:23.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:23 gibba013 bash[30381]: audit 2021-03-10T14:15:22.319649+0000 mgr.gibba020.yqfnwy (mgr.34427) 1220 : audit [DBG] from='client.44880 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:15:23.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:23 gibba013 bash[30381]: audit 2021-03-10T14:15:22.544222+0000 mgr.gibba020.yqfnwy (mgr.34427) 1221 : audit [DBG] from='client.44886 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:15:23.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:23 gibba013 bash[30381]: audit 2021-03-10T14:15:22.814995+0000 mon.a (mon.0) 914 : audit [DBG] from='client.? 172.21.2.113:0/3216196344' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:23.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:23 gibba020 bash[25448]: audit 2021-03-10T14:15:22.319649+0000 mgr.gibba020.yqfnwy (mgr.34427) 1220 : audit [DBG] from='client.44880 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:15:23.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:23 gibba020 bash[25448]: audit 2021-03-10T14:15:22.544222+0000 mgr.gibba020.yqfnwy (mgr.34427) 1221 : audit [DBG] from='client.44886 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:15:23.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:23 gibba020 bash[25448]: audit 2021-03-10T14:15:22.814995+0000 mon.a (mon.0) 914 : audit [DBG] from='client.? 172.21.2.113:0/3216196344' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:24.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:24 gibba013 bash[29418]: cluster 2021-03-10T14:15:23.293177+0000 mgr.gibba020.yqfnwy (mgr.34427) 1222 : cluster [DBG] pgmap v683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:24.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:24 gibba013 bash[30381]: cluster 2021-03-10T14:15:23.293177+0000 mgr.gibba020.yqfnwy (mgr.34427) 1222 : cluster [DBG] pgmap v683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:24.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:24 gibba020 bash[25448]: cluster 2021-03-10T14:15:23.293177+0000 mgr.gibba020.yqfnwy (mgr.34427) 1222 : cluster [DBG] pgmap v683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:26.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:26 gibba013 bash[29418]: cluster 2021-03-10T14:15:25.294929+0000 mgr.gibba020.yqfnwy (mgr.34427) 1223 : cluster [DBG] pgmap v684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:26.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:26 gibba013 bash[30381]: cluster 2021-03-10T14:15:25.294929+0000 mgr.gibba020.yqfnwy (mgr.34427) 1223 : cluster [DBG] pgmap v684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:26.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:26 gibba020 bash[25448]: cluster 2021-03-10T14:15:25.294929+0000 mgr.gibba020.yqfnwy (mgr.34427) 1223 : cluster [DBG] pgmap v684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:28.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:28 gibba013 bash[29418]: cluster 2021-03-10T14:15:27.296400+0000 mgr.gibba020.yqfnwy (mgr.34427) 1224 : cluster [DBG] pgmap v685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:28.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:28 gibba013 bash[30381]: cluster 2021-03-10T14:15:27.296400+0000 mgr.gibba020.yqfnwy (mgr.34427) 1224 : cluster [DBG] pgmap v685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:28.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:28 gibba020 bash[25448]: cluster 2021-03-10T14:15:27.296400+0000 mgr.gibba020.yqfnwy (mgr.34427) 1224 : cluster [DBG] pgmap v685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:30.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:30 gibba020 bash[25448]: cluster 2021-03-10T14:15:29.297974+0000 mgr.gibba020.yqfnwy (mgr.34427) 1225 : cluster [DBG] pgmap v686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:30.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:30 gibba020 bash[25448]: audit 2021-03-10T14:15:29.945821+0000 mon.a (mon.0) 915 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:15:30.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:30 gibba020 bash[25448]: audit 2021-03-10T14:15:30.175894+0000 mon.a (mon.0) 916 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:15:30.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:30 gibba020 bash[25448]: audit 2021-03-10T14:15:30.179060+0000 mon.a (mon.0) 917 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:15:30.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:30 gibba020 bash[25448]: audit 2021-03-10T14:15:30.180553+0000 mon.a (mon.0) 918 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:30.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:30 gibba020 bash[25448]: audit 2021-03-10T14:15:30.181573+0000 mon.a (mon.0) 919 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:30.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:30 gibba020 bash[25448]: audit 2021-03-10T14:15:30.182274+0000 mon.a (mon.0) 920 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:30.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:30 gibba020 bash[25448]: audit 2021-03-10T14:15:30.183847+0000 mon.a (mon.0) 921 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:30.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:30 gibba020 bash[25448]: audit 2021-03-10T14:15:30.184836+0000 mon.a (mon.0) 922 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:31.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:30 gibba013 bash[29418]: cluster 2021-03-10T14:15:29.297974+0000 mgr.gibba020.yqfnwy (mgr.34427) 1225 : cluster [DBG] pgmap v686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:31.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:30 gibba013 bash[29418]: audit 2021-03-10T14:15:29.945821+0000 mon.a (mon.0) 915 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:15:31.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:30 gibba013 bash[29418]: audit 2021-03-10T14:15:30.175894+0000 mon.a (mon.0) 916 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:15:31.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:30 gibba013 bash[29418]: audit 2021-03-10T14:15:30.179060+0000 mon.a (mon.0) 917 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:15:31.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:30 gibba013 bash[29418]: audit 2021-03-10T14:15:30.180553+0000 mon.a (mon.0) 918 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:31.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:30 gibba013 bash[29418]: audit 2021-03-10T14:15:30.181573+0000 mon.a (mon.0) 919 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:31.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:30 gibba013 bash[29418]: audit 2021-03-10T14:15:30.182274+0000 mon.a (mon.0) 920 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:31.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:30 gibba013 bash[29418]: audit 2021-03-10T14:15:30.183847+0000 mon.a (mon.0) 921 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:31.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:30 gibba013 bash[29418]: audit 2021-03-10T14:15:30.184836+0000 mon.a (mon.0) 922 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:31.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:30 gibba013 bash[30381]: cluster 2021-03-10T14:15:29.297974+0000 mgr.gibba020.yqfnwy (mgr.34427) 1225 : cluster [DBG] pgmap v686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:31.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:30 gibba013 bash[30381]: audit 2021-03-10T14:15:29.945821+0000 mon.a (mon.0) 915 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:15:31.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:30 gibba013 bash[30381]: audit 2021-03-10T14:15:30.175894+0000 mon.a (mon.0) 916 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:15:31.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:30 gibba013 bash[30381]: audit 2021-03-10T14:15:30.179060+0000 mon.a (mon.0) 917 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:15:31.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:30 gibba013 bash[30381]: audit 2021-03-10T14:15:30.180553+0000 mon.a (mon.0) 918 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:31.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:30 gibba013 bash[30381]: audit 2021-03-10T14:15:30.181573+0000 mon.a (mon.0) 919 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:31.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:30 gibba013 bash[30381]: audit 2021-03-10T14:15:30.182274+0000 mon.a (mon.0) 920 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:31.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:30 gibba013 bash[30381]: audit 2021-03-10T14:15:30.183847+0000 mon.a (mon.0) 921 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:31.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:30 gibba013 bash[30381]: audit 2021-03-10T14:15:30.184836+0000 mon.a (mon.0) 922 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:31.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:31 gibba020 bash[25448]: cephadm 2021-03-10T14:15:29.949247+0000 mgr.gibba020.yqfnwy (mgr.34427) 1226 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:15:31.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:31 gibba020 bash[25448]: cephadm 2021-03-10T14:15:29.950923+0000 mgr.gibba020.yqfnwy (mgr.34427) 1227 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:15:31.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:31 gibba020 bash[25448]: cephadm 2021-03-10T14:15:30.175905+0000 mgr.gibba020.yqfnwy (mgr.34427) 1228 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:15:31.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:31 gibba020 bash[25448]: cephadm 2021-03-10T14:15:30.177544+0000 mgr.gibba020.yqfnwy (mgr.34427) 1229 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:15:31.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:31 gibba020 bash[25448]: cephadm 2021-03-10T14:15:30.178717+0000 mgr.gibba020.yqfnwy (mgr.34427) 1230 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:15:31.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:31 gibba020 bash[25448]: cephadm 2021-03-10T14:15:30.178804+0000 mgr.gibba020.yqfnwy (mgr.34427) 1231 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:15:31.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:31 gibba020 bash[25448]: cephadm 2021-03-10T14:15:30.179571+0000 mgr.gibba020.yqfnwy (mgr.34427) 1232 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:15:31.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:31 gibba020 bash[25448]: cephadm 2021-03-10T14:15:30.179616+0000 mgr.gibba020.yqfnwy (mgr.34427) 1233 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:15:31.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:31 gibba020 bash[25448]: cephadm 2021-03-10T14:15:30.180282+0000 mgr.gibba020.yqfnwy (mgr.34427) 1234 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:15:31.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:31 gibba020 bash[25448]: cephadm 2021-03-10T14:15:30.180955+0000 mgr.gibba020.yqfnwy (mgr.34427) 1235 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:15:31.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:31 gibba020 bash[25448]: cephadm 2021-03-10T14:15:30.181000+0000 mgr.gibba020.yqfnwy (mgr.34427) 1236 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:15:31.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:31 gibba020 bash[25448]: cephadm 2021-03-10T14:15:30.181831+0000 mgr.gibba020.yqfnwy (mgr.34427) 1237 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:15:31.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:31 gibba020 bash[25448]: cephadm 2021-03-10T14:15:30.182182+0000 mgr.gibba020.yqfnwy (mgr.34427) 1238 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:15:31.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:31 gibba020 bash[25448]: cephadm 2021-03-10T14:15:30.182808+0000 mgr.gibba020.yqfnwy (mgr.34427) 1239 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:15:31.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:31 gibba020 bash[25448]: cephadm 2021-03-10T14:15:30.182855+0000 mgr.gibba020.yqfnwy (mgr.34427) 1240 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:15:31.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:31 gibba020 bash[25448]: cephadm 2021-03-10T14:15:30.183015+0000 mgr.gibba020.yqfnwy (mgr.34427) 1241 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:15:32.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:31 gibba013 bash[29418]: cephadm 2021-03-10T14:15:29.949247+0000 mgr.gibba020.yqfnwy (mgr.34427) 1226 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:15:32.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:31 gibba013 bash[29418]: cephadm 2021-03-10T14:15:29.950923+0000 mgr.gibba020.yqfnwy (mgr.34427) 1227 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:15:32.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:31 gibba013 bash[29418]: cephadm 2021-03-10T14:15:30.175905+0000 mgr.gibba020.yqfnwy (mgr.34427) 1228 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:15:32.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:31 gibba013 bash[29418]: cephadm 2021-03-10T14:15:30.177544+0000 mgr.gibba020.yqfnwy (mgr.34427) 1229 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:15:32.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:31 gibba013 bash[29418]: cephadm 2021-03-10T14:15:30.178717+0000 mgr.gibba020.yqfnwy (mgr.34427) 1230 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:15:32.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:31 gibba013 bash[29418]: cephadm 2021-03-10T14:15:30.178804+0000 mgr.gibba020.yqfnwy (mgr.34427) 1231 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:15:32.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:31 gibba013 bash[29418]: cephadm 2021-03-10T14:15:30.179571+0000 mgr.gibba020.yqfnwy (mgr.34427) 1232 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:15:32.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:31 gibba013 bash[29418]: cephadm 2021-03-10T14:15:30.179616+0000 mgr.gibba020.yqfnwy (mgr.34427) 1233 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:15:32.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:31 gibba013 bash[29418]: cephadm 2021-03-10T14:15:30.180282+0000 mgr.gibba020.yqfnwy (mgr.34427) 1234 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:15:32.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:31 gibba013 bash[29418]: cephadm 2021-03-10T14:15:30.180955+0000 mgr.gibba020.yqfnwy (mgr.34427) 1235 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:15:32.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:31 gibba013 bash[29418]: cephadm 2021-03-10T14:15:30.181000+0000 mgr.gibba020.yqfnwy (mgr.34427) 1236 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:15:32.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:31 gibba013 bash[29418]: cephadm 2021-03-10T14:15:30.181831+0000 mgr.gibba020.yqfnwy (mgr.34427) 1237 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:15:32.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:31 gibba013 bash[29418]: cephadm 2021-03-10T14:15:30.182182+0000 mgr.gibba020.yqfnwy (mgr.34427) 1238 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:15:32.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:31 gibba013 bash[29418]: cephadm 2021-03-10T14:15:30.182808+0000 mgr.gibba020.yqfnwy (mgr.34427) 1239 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:15:32.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:31 gibba013 bash[29418]: cephadm 2021-03-10T14:15:30.182855+0000 mgr.gibba020.yqfnwy (mgr.34427) 1240 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:15:32.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:31 gibba013 bash[29418]: cephadm 2021-03-10T14:15:30.183015+0000 mgr.gibba020.yqfnwy (mgr.34427) 1241 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:15:32.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:31 gibba013 bash[30381]: cephadm 2021-03-10T14:15:29.949247+0000 mgr.gibba020.yqfnwy (mgr.34427) 1226 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:15:32.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:31 gibba013 bash[30381]: cephadm 2021-03-10T14:15:29.950923+0000 mgr.gibba020.yqfnwy (mgr.34427) 1227 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:15:32.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:31 gibba013 bash[30381]: cephadm 2021-03-10T14:15:30.175905+0000 mgr.gibba020.yqfnwy (mgr.34427) 1228 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:15:32.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:31 gibba013 bash[30381]: cephadm 2021-03-10T14:15:30.177544+0000 mgr.gibba020.yqfnwy (mgr.34427) 1229 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:15:32.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:31 gibba013 bash[30381]: cephadm 2021-03-10T14:15:30.178717+0000 mgr.gibba020.yqfnwy (mgr.34427) 1230 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:15:32.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:31 gibba013 bash[30381]: cephadm 2021-03-10T14:15:30.178804+0000 mgr.gibba020.yqfnwy (mgr.34427) 1231 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:15:32.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:31 gibba013 bash[30381]: cephadm 2021-03-10T14:15:30.179571+0000 mgr.gibba020.yqfnwy (mgr.34427) 1232 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:15:32.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:31 gibba013 bash[30381]: cephadm 2021-03-10T14:15:30.179616+0000 mgr.gibba020.yqfnwy (mgr.34427) 1233 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:15:32.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:31 gibba013 bash[30381]: cephadm 2021-03-10T14:15:30.180282+0000 mgr.gibba020.yqfnwy (mgr.34427) 1234 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:15:32.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:31 gibba013 bash[30381]: cephadm 2021-03-10T14:15:30.180955+0000 mgr.gibba020.yqfnwy (mgr.34427) 1235 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:15:32.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:31 gibba013 bash[30381]: cephadm 2021-03-10T14:15:30.181000+0000 mgr.gibba020.yqfnwy (mgr.34427) 1236 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:15:32.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:31 gibba013 bash[30381]: cephadm 2021-03-10T14:15:30.181831+0000 mgr.gibba020.yqfnwy (mgr.34427) 1237 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:15:32.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:31 gibba013 bash[30381]: cephadm 2021-03-10T14:15:30.182182+0000 mgr.gibba020.yqfnwy (mgr.34427) 1238 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:15:32.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:31 gibba013 bash[30381]: cephadm 2021-03-10T14:15:30.182808+0000 mgr.gibba020.yqfnwy (mgr.34427) 1239 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:15:32.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:31 gibba013 bash[30381]: cephadm 2021-03-10T14:15:30.182855+0000 mgr.gibba020.yqfnwy (mgr.34427) 1240 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:15:32.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:31 gibba013 bash[30381]: cephadm 2021-03-10T14:15:30.183015+0000 mgr.gibba020.yqfnwy (mgr.34427) 1241 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:15:32.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:32 gibba020 bash[25448]: cluster 2021-03-10T14:15:31.299557+0000 mgr.gibba020.yqfnwy (mgr.34427) 1242 : cluster [DBG] pgmap v687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:33.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:32 gibba013 bash[29418]: cluster 2021-03-10T14:15:31.299557+0000 mgr.gibba020.yqfnwy (mgr.34427) 1242 : cluster [DBG] pgmap v687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:33.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:32 gibba013 bash[30381]: cluster 2021-03-10T14:15:31.299557+0000 mgr.gibba020.yqfnwy (mgr.34427) 1242 : cluster [DBG] pgmap v687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:33.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:33 gibba020 bash[25448]: cluster 2021-03-10T14:15:33.300930+0000 mgr.gibba020.yqfnwy (mgr.34427) 1243 : cluster [DBG] pgmap v688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:34.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:33 gibba013 bash[29418]: cluster 2021-03-10T14:15:33.300930+0000 mgr.gibba020.yqfnwy (mgr.34427) 1243 : cluster [DBG] pgmap v688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:34.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:33 gibba013 bash[30381]: cluster 2021-03-10T14:15:33.300930+0000 mgr.gibba020.yqfnwy (mgr.34427) 1243 : cluster [DBG] pgmap v688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:36.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:36 gibba013 bash[29418]: cluster 2021-03-10T14:15:35.302683+0000 mgr.gibba020.yqfnwy (mgr.34427) 1244 : cluster [DBG] pgmap v689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:36.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:36 gibba013 bash[30381]: cluster 2021-03-10T14:15:35.302683+0000 mgr.gibba020.yqfnwy (mgr.34427) 1244 : cluster [DBG] pgmap v689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:36.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:36 gibba020 bash[25448]: cluster 2021-03-10T14:15:35.302683+0000 mgr.gibba020.yqfnwy (mgr.34427) 1244 : cluster [DBG] pgmap v689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:38.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:38 gibba013 bash[29418]: cluster 2021-03-10T14:15:37.304272+0000 mgr.gibba020.yqfnwy (mgr.34427) 1245 : cluster [DBG] pgmap v690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:38.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:38 gibba013 bash[30381]: cluster 2021-03-10T14:15:37.304272+0000 mgr.gibba020.yqfnwy (mgr.34427) 1245 : cluster [DBG] pgmap v690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:38.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:38 gibba020 bash[25448]: cluster 2021-03-10T14:15:37.304272+0000 mgr.gibba020.yqfnwy (mgr.34427) 1245 : cluster [DBG] pgmap v690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:40.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:40 gibba020 bash[25448]: cluster 2021-03-10T14:15:39.305808+0000 mgr.gibba020.yqfnwy (mgr.34427) 1246 : cluster [DBG] pgmap v691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:40.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:40 gibba013 bash[29418]: cluster 2021-03-10T14:15:39.305808+0000 mgr.gibba020.yqfnwy (mgr.34427) 1246 : cluster [DBG] pgmap v691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:40.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:40 gibba013 bash[30381]: cluster 2021-03-10T14:15:39.305808+0000 mgr.gibba020.yqfnwy (mgr.34427) 1246 : cluster [DBG] pgmap v691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:42.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:42 gibba020 bash[25448]: cluster 2021-03-10T14:15:41.307399+0000 mgr.gibba020.yqfnwy (mgr.34427) 1247 : cluster [DBG] pgmap v692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:42.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:42 gibba013 bash[29418]: cluster 2021-03-10T14:15:41.307399+0000 mgr.gibba020.yqfnwy (mgr.34427) 1247 : cluster [DBG] pgmap v692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:42.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:42 gibba013 bash[30381]: cluster 2021-03-10T14:15:41.307399+0000 mgr.gibba020.yqfnwy (mgr.34427) 1247 : cluster [DBG] pgmap v692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:44.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:44 gibba020 bash[25448]: cluster 2021-03-10T14:15:43.308820+0000 mgr.gibba020.yqfnwy (mgr.34427) 1248 : cluster [DBG] pgmap v693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:44.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:44 gibba013 bash[29418]: cluster 2021-03-10T14:15:43.308820+0000 mgr.gibba020.yqfnwy (mgr.34427) 1248 : cluster [DBG] pgmap v693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:44.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:44 gibba013 bash[30381]: cluster 2021-03-10T14:15:43.308820+0000 mgr.gibba020.yqfnwy (mgr.34427) 1248 : cluster [DBG] pgmap v693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:46.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:46 gibba020 bash[25448]: cephadm 2021-03-10T14:15:45.199007+0000 mgr.gibba020.yqfnwy (mgr.34427) 1249 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:15:46.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:46 gibba020 bash[25448]: cluster 2021-03-10T14:15:45.310518+0000 mgr.gibba020.yqfnwy (mgr.34427) 1250 : cluster [DBG] pgmap v694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:46.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:46 gibba013 bash[29418]: cephadm 2021-03-10T14:15:45.199007+0000 mgr.gibba020.yqfnwy (mgr.34427) 1249 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:15:46.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:46 gibba013 bash[29418]: cluster 2021-03-10T14:15:45.310518+0000 mgr.gibba020.yqfnwy (mgr.34427) 1250 : cluster [DBG] pgmap v694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:46.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:46 gibba013 bash[30381]: cephadm 2021-03-10T14:15:45.199007+0000 mgr.gibba020.yqfnwy (mgr.34427) 1249 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:15:46.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:46 gibba013 bash[30381]: cluster 2021-03-10T14:15:45.310518+0000 mgr.gibba020.yqfnwy (mgr.34427) 1250 : cluster [DBG] pgmap v694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:48.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:48 gibba020 bash[25448]: cluster 2021-03-10T14:15:47.312040+0000 mgr.gibba020.yqfnwy (mgr.34427) 1251 : cluster [DBG] pgmap v695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:48.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:48 gibba013 bash[29418]: cluster 2021-03-10T14:15:47.312040+0000 mgr.gibba020.yqfnwy (mgr.34427) 1251 : cluster [DBG] pgmap v695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:48.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:48 gibba013 bash[30381]: cluster 2021-03-10T14:15:47.312040+0000 mgr.gibba020.yqfnwy (mgr.34427) 1251 : cluster [DBG] pgmap v695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:50.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:50 gibba020 bash[25448]: cluster 2021-03-10T14:15:49.313519+0000 mgr.gibba020.yqfnwy (mgr.34427) 1252 : cluster [DBG] pgmap v696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:50.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:50 gibba013 bash[29418]: cluster 2021-03-10T14:15:49.313519+0000 mgr.gibba020.yqfnwy (mgr.34427) 1252 : cluster [DBG] pgmap v696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:50.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:50 gibba013 bash[30381]: cluster 2021-03-10T14:15:49.313519+0000 mgr.gibba020.yqfnwy (mgr.34427) 1252 : cluster [DBG] pgmap v696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:52.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:52 gibba020 bash[25448]: cluster 2021-03-10T14:15:51.315392+0000 mgr.gibba020.yqfnwy (mgr.34427) 1253 : cluster [DBG] pgmap v697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:52.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:52 gibba013 bash[29418]: cluster 2021-03-10T14:15:51.315392+0000 mgr.gibba020.yqfnwy (mgr.34427) 1253 : cluster [DBG] pgmap v697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:52.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:52 gibba013 bash[30381]: cluster 2021-03-10T14:15:51.315392+0000 mgr.gibba020.yqfnwy (mgr.34427) 1253 : cluster [DBG] pgmap v697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:53.059 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:15:53.315 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:15:53.315 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (22m) 8m ago 27m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:15:53.315 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (27m) 7m ago 27m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:15:53.315 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (22m) 7m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:15:53.316 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (23m) 7m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:15:53.316 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (22m) 8m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:15:53.316 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (21m) 8m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:15:53.316 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (21m) 7m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:15:53.317 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (21m) 8m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:15:53.317 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (27m) 8m ago 27m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:15:53.317 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (27m) 7m ago 27m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:15:53.317 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (20m) 8m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:15:53.317 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (20m) 8m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:15:53.318 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (19m) 8m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:15:53.318 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (19m) 8m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:15:53.318 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (18m) 7m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:15:53.318 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (18m) 7m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:15:53.318 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (18m) 7m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:15:53.319 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (17m) 7m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:15:53.319 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (27m) 7m ago 27m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:15:53.319 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 7m ago 25m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:15:53.572 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:15:53.573 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:15:53.573 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:15:53.573 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:15:53.573 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:15:53.574 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:15:53.574 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:15:53.574 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:15:53.574 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:15:53.575 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:15:53.575 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:15:53.575 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:15:53.575 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:15:53.575 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:15:53.576 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:15:54.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:54 gibba020 bash[25448]: audit 2021-03-10T14:15:53.046902+0000 mgr.gibba020.yqfnwy (mgr.34427) 1254 : audit [DBG] from='client.44898 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:15:54.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:54 gibba020 bash[25448]: audit 2021-03-10T14:15:53.271258+0000 mgr.gibba020.yqfnwy (mgr.34427) 1255 : audit [DBG] from='client.44904 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:15:54.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:54 gibba020 bash[25448]: cluster 2021-03-10T14:15:53.316173+0000 mgr.gibba020.yqfnwy (mgr.34427) 1256 : cluster [DBG] pgmap v698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:54.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:54 gibba020 bash[25448]: audit 2021-03-10T14:15:53.570771+0000 mon.a (mon.0) 923 : audit [DBG] from='client.? 172.21.2.113:0/3108402442' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:54.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:54 gibba013 bash[29418]: audit 2021-03-10T14:15:53.046902+0000 mgr.gibba020.yqfnwy (mgr.34427) 1254 : audit [DBG] from='client.44898 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:15:54.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:54 gibba013 bash[29418]: audit 2021-03-10T14:15:53.271258+0000 mgr.gibba020.yqfnwy (mgr.34427) 1255 : audit [DBG] from='client.44904 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:15:54.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:54 gibba013 bash[29418]: cluster 2021-03-10T14:15:53.316173+0000 mgr.gibba020.yqfnwy (mgr.34427) 1256 : cluster [DBG] pgmap v698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:54.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:54 gibba013 bash[29418]: audit 2021-03-10T14:15:53.570771+0000 mon.a (mon.0) 923 : audit [DBG] from='client.? 172.21.2.113:0/3108402442' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:54.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:54 gibba013 bash[30381]: audit 2021-03-10T14:15:53.046902+0000 mgr.gibba020.yqfnwy (mgr.34427) 1254 : audit [DBG] from='client.44898 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:15:54.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:54 gibba013 bash[30381]: audit 2021-03-10T14:15:53.271258+0000 mgr.gibba020.yqfnwy (mgr.34427) 1255 : audit [DBG] from='client.44904 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:15:54.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:54 gibba013 bash[30381]: cluster 2021-03-10T14:15:53.316173+0000 mgr.gibba020.yqfnwy (mgr.34427) 1256 : cluster [DBG] pgmap v698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:54.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:54 gibba013 bash[30381]: audit 2021-03-10T14:15:53.570771+0000 mon.a (mon.0) 923 : audit [DBG] from='client.? 172.21.2.113:0/3108402442' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:15:56.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:56 gibba013 bash[29418]: cluster 2021-03-10T14:15:55.317518+0000 mgr.gibba020.yqfnwy (mgr.34427) 1257 : cluster [DBG] pgmap v699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:56.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:56 gibba013 bash[30381]: cluster 2021-03-10T14:15:55.317518+0000 mgr.gibba020.yqfnwy (mgr.34427) 1257 : cluster [DBG] pgmap v699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:56.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:56 gibba020 bash[25448]: cluster 2021-03-10T14:15:55.317518+0000 mgr.gibba020.yqfnwy (mgr.34427) 1257 : cluster [DBG] pgmap v699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:58.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:15:58 gibba013 bash[29418]: cluster 2021-03-10T14:15:57.318932+0000 mgr.gibba020.yqfnwy (mgr.34427) 1258 : cluster [DBG] pgmap v700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:58.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:15:58 gibba013 bash[30381]: cluster 2021-03-10T14:15:57.318932+0000 mgr.gibba020.yqfnwy (mgr.34427) 1258 : cluster [DBG] pgmap v700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:15:58.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:15:58 gibba020 bash[25448]: cluster 2021-03-10T14:15:57.318932+0000 mgr.gibba020.yqfnwy (mgr.34427) 1258 : cluster [DBG] pgmap v700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:00.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:00 gibba013 bash[29418]: cluster 2021-03-10T14:15:59.320325+0000 mgr.gibba020.yqfnwy (mgr.34427) 1259 : cluster [DBG] pgmap v701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:00.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:00 gibba013 bash[30381]: cluster 2021-03-10T14:15:59.320325+0000 mgr.gibba020.yqfnwy (mgr.34427) 1259 : cluster [DBG] pgmap v701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:00.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:00 gibba020 bash[25448]: cluster 2021-03-10T14:15:59.320325+0000 mgr.gibba020.yqfnwy (mgr.34427) 1259 : cluster [DBG] pgmap v701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:01.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:01 gibba013 bash[29418]: cephadm 2021-03-10T14:16:00.215020+0000 mgr.gibba020.yqfnwy (mgr.34427) 1260 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:16:01.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:01 gibba013 bash[30381]: cephadm 2021-03-10T14:16:00.215020+0000 mgr.gibba020.yqfnwy (mgr.34427) 1260 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:16:01.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:01 gibba020 bash[25448]: cephadm 2021-03-10T14:16:00.215020+0000 mgr.gibba020.yqfnwy (mgr.34427) 1260 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:16:02.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:02 gibba013 bash[29418]: cluster 2021-03-10T14:16:01.322165+0000 mgr.gibba020.yqfnwy (mgr.34427) 1261 : cluster [DBG] pgmap v702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:02.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:02 gibba013 bash[30381]: cluster 2021-03-10T14:16:01.322165+0000 mgr.gibba020.yqfnwy (mgr.34427) 1261 : cluster [DBG] pgmap v702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:02.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:02 gibba020 bash[25448]: cluster 2021-03-10T14:16:01.322165+0000 mgr.gibba020.yqfnwy (mgr.34427) 1261 : cluster [DBG] pgmap v702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:04.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:04 gibba013 bash[29418]: cluster 2021-03-10T14:16:03.323526+0000 mgr.gibba020.yqfnwy (mgr.34427) 1262 : cluster [DBG] pgmap v703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:04.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:04 gibba013 bash[30381]: cluster 2021-03-10T14:16:03.323526+0000 mgr.gibba020.yqfnwy (mgr.34427) 1262 : cluster [DBG] pgmap v703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:04.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:04 gibba020 bash[25448]: cluster 2021-03-10T14:16:03.323526+0000 mgr.gibba020.yqfnwy (mgr.34427) 1262 : cluster [DBG] pgmap v703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:06 gibba013 bash[29418]: cluster 2021-03-10T14:16:05.325040+0000 mgr.gibba020.yqfnwy (mgr.34427) 1263 : cluster [DBG] pgmap v704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:06 gibba013 bash[29418]: audit 2021-03-10T14:16:05.939843+0000 mon.a (mon.0) 924 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T14:16:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:06 gibba013 bash[29418]: audit 2021-03-10T14:16:05.940582+0000 mon.a (mon.0) 925 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:16:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:06 gibba013 bash[29418]: audit 2021-03-10T14:16:05.941279+0000 mon.a (mon.0) 926 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:16:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:06 gibba013 bash[29418]: audit 2021-03-10T14:16:05.941937+0000 mon.a (mon.0) 927 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:16:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:06 gibba013 bash[29418]: audit 2021-03-10T14:16:06.077001+0000 mon.a (mon.0) 928 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:16:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:06 gibba013 bash[29418]: audit 2021-03-10T14:16:06.083631+0000 mon.a (mon.0) 929 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:16:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:06 gibba013 bash[30381]: cluster 2021-03-10T14:16:05.325040+0000 mgr.gibba020.yqfnwy (mgr.34427) 1263 : cluster [DBG] pgmap v704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:06 gibba013 bash[30381]: audit 2021-03-10T14:16:05.939843+0000 mon.a (mon.0) 924 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T14:16:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:06 gibba013 bash[30381]: audit 2021-03-10T14:16:05.940582+0000 mon.a (mon.0) 925 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:16:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:06 gibba013 bash[30381]: audit 2021-03-10T14:16:05.941279+0000 mon.a (mon.0) 926 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:16:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:06 gibba013 bash[30381]: audit 2021-03-10T14:16:05.941937+0000 mon.a (mon.0) 927 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:16:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:06 gibba013 bash[30381]: audit 2021-03-10T14:16:06.077001+0000 mon.a (mon.0) 928 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:16:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:06 gibba013 bash[30381]: audit 2021-03-10T14:16:06.083631+0000 mon.a (mon.0) 929 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:16:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:06 gibba020 bash[25448]: cluster 2021-03-10T14:16:05.325040+0000 mgr.gibba020.yqfnwy (mgr.34427) 1263 : cluster [DBG] pgmap v704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:06 gibba020 bash[25448]: audit 2021-03-10T14:16:05.939843+0000 mon.a (mon.0) 924 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T14:16:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:06 gibba020 bash[25448]: audit 2021-03-10T14:16:05.940582+0000 mon.a (mon.0) 925 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:16:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:06 gibba020 bash[25448]: audit 2021-03-10T14:16:05.941279+0000 mon.a (mon.0) 926 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:16:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:06 gibba020 bash[25448]: audit 2021-03-10T14:16:05.941937+0000 mon.a (mon.0) 927 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:16:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:06 gibba020 bash[25448]: audit 2021-03-10T14:16:06.077001+0000 mon.a (mon.0) 928 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:16:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:06 gibba020 bash[25448]: audit 2021-03-10T14:16:06.083631+0000 mon.a (mon.0) 929 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:16:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:08 gibba013 bash[29418]: cluster 2021-03-10T14:16:07.326426+0000 mgr.gibba020.yqfnwy (mgr.34427) 1264 : cluster [DBG] pgmap v705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:08.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:08 gibba013 bash[30381]: cluster 2021-03-10T14:16:07.326426+0000 mgr.gibba020.yqfnwy (mgr.34427) 1264 : cluster [DBG] pgmap v705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:08.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:08 gibba020 bash[25448]: cluster 2021-03-10T14:16:07.326426+0000 mgr.gibba020.yqfnwy (mgr.34427) 1264 : cluster [DBG] pgmap v705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:10.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:10 gibba013 bash[29418]: cluster 2021-03-10T14:16:09.327816+0000 mgr.gibba020.yqfnwy (mgr.34427) 1265 : cluster [DBG] pgmap v706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:10.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:10 gibba013 bash[30381]: cluster 2021-03-10T14:16:09.327816+0000 mgr.gibba020.yqfnwy (mgr.34427) 1265 : cluster [DBG] pgmap v706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:10.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:10 gibba020 bash[25448]: cluster 2021-03-10T14:16:09.327816+0000 mgr.gibba020.yqfnwy (mgr.34427) 1265 : cluster [DBG] pgmap v706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:12.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:12 gibba013 bash[29418]: cluster 2021-03-10T14:16:11.329465+0000 mgr.gibba020.yqfnwy (mgr.34427) 1266 : cluster [DBG] pgmap v707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:12.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:12 gibba013 bash[30381]: cluster 2021-03-10T14:16:11.329465+0000 mgr.gibba020.yqfnwy (mgr.34427) 1266 : cluster [DBG] pgmap v707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:12.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:12 gibba020 bash[25448]: cluster 2021-03-10T14:16:11.329465+0000 mgr.gibba020.yqfnwy (mgr.34427) 1266 : cluster [DBG] pgmap v707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:14.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:14 gibba013 bash[29418]: cluster 2021-03-10T14:16:13.330825+0000 mgr.gibba020.yqfnwy (mgr.34427) 1267 : cluster [DBG] pgmap v708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:14.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:14 gibba013 bash[30381]: cluster 2021-03-10T14:16:13.330825+0000 mgr.gibba020.yqfnwy (mgr.34427) 1267 : cluster [DBG] pgmap v708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:14.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:14 gibba020 bash[25448]: cluster 2021-03-10T14:16:13.330825+0000 mgr.gibba020.yqfnwy (mgr.34427) 1267 : cluster [DBG] pgmap v708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:16.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:16 gibba013 bash[29418]: cephadm 2021-03-10T14:16:15.231057+0000 mgr.gibba020.yqfnwy (mgr.34427) 1268 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:16:16.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:16 gibba013 bash[29418]: cluster 2021-03-10T14:16:15.332412+0000 mgr.gibba020.yqfnwy (mgr.34427) 1269 : cluster [DBG] pgmap v709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:16.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:16 gibba013 bash[30381]: cephadm 2021-03-10T14:16:15.231057+0000 mgr.gibba020.yqfnwy (mgr.34427) 1268 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:16:16.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:16 gibba013 bash[30381]: cluster 2021-03-10T14:16:15.332412+0000 mgr.gibba020.yqfnwy (mgr.34427) 1269 : cluster [DBG] pgmap v709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:16.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:16 gibba020 bash[25448]: cephadm 2021-03-10T14:16:15.231057+0000 mgr.gibba020.yqfnwy (mgr.34427) 1268 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:16:16.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:16 gibba020 bash[25448]: cluster 2021-03-10T14:16:15.332412+0000 mgr.gibba020.yqfnwy (mgr.34427) 1269 : cluster [DBG] pgmap v709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:18.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:18 gibba013 bash[29418]: cluster 2021-03-10T14:16:17.333986+0000 mgr.gibba020.yqfnwy (mgr.34427) 1270 : cluster [DBG] pgmap v710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:18.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:18 gibba013 bash[30381]: cluster 2021-03-10T14:16:17.333986+0000 mgr.gibba020.yqfnwy (mgr.34427) 1270 : cluster [DBG] pgmap v710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:18.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:18 gibba020 bash[25448]: cluster 2021-03-10T14:16:17.333986+0000 mgr.gibba020.yqfnwy (mgr.34427) 1270 : cluster [DBG] pgmap v710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:20.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:20 gibba013 bash[29418]: cluster 2021-03-10T14:16:19.335422+0000 mgr.gibba020.yqfnwy (mgr.34427) 1271 : cluster [DBG] pgmap v711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:20.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:20 gibba013 bash[30381]: cluster 2021-03-10T14:16:19.335422+0000 mgr.gibba020.yqfnwy (mgr.34427) 1271 : cluster [DBG] pgmap v711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:20.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:20 gibba020 bash[25448]: cluster 2021-03-10T14:16:19.335422+0000 mgr.gibba020.yqfnwy (mgr.34427) 1271 : cluster [DBG] pgmap v711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:22.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:22 gibba013 bash[29418]: cluster 2021-03-10T14:16:21.337190+0000 mgr.gibba020.yqfnwy (mgr.34427) 1272 : cluster [DBG] pgmap v712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:22.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:22 gibba013 bash[30381]: cluster 2021-03-10T14:16:21.337190+0000 mgr.gibba020.yqfnwy (mgr.34427) 1272 : cluster [DBG] pgmap v712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:22.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:22 gibba020 bash[25448]: cluster 2021-03-10T14:16:21.337190+0000 mgr.gibba020.yqfnwy (mgr.34427) 1272 : cluster [DBG] pgmap v712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:23.815 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:16:24.042 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:16:24.042 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (22m) 9m ago 28m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:16:24.042 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (28m) 7m ago 28m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:16:24.043 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (23m) 7m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:16:24.043 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (23m) 7m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:16:24.043 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (22m) 9m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:16:24.043 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (22m) 9m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:16:24.044 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (21m) 7m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:16:24.044 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (22m) 9m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:16:24.044 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (28m) 9m ago 28m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:16:24.044 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (28m) 7m ago 28m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:16:24.045 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (21m) 9m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:16:24.045 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (20m) 9m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:16:24.045 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (20m) 9m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:16:24.045 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (19m) 9m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:16:24.045 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (19m) 7m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:16:24.046 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (19m) 7m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:16:24.046 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (18m) 7m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:16:24.046 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (18m) 7m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:16:24.046 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (27m) 7m ago 28m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:16:24.047 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 7m ago 26m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:16:24.287 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:16:24.287 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:16:24.287 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:16:24.288 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:16:24.288 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:16:24.288 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:16:24.288 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:16:24.289 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:16:24.289 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:16:24.289 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:16:24.289 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:16:24.290 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:16:24.290 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:16:24.290 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:16:24.290 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:16:24.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:24 gibba013 bash[29418]: cluster 2021-03-10T14:16:23.338558+0000 mgr.gibba020.yqfnwy (mgr.34427) 1273 : cluster [DBG] pgmap v713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:24.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:24 gibba013 bash[29418]: audit 2021-03-10T14:16:24.285075+0000 mon.c (mon.1) 30 : audit [DBG] from='client.? 172.21.2.113:0/3201258439' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:24.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:24 gibba013 bash[30381]: cluster 2021-03-10T14:16:23.338558+0000 mgr.gibba020.yqfnwy (mgr.34427) 1273 : cluster [DBG] pgmap v713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:24.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:24 gibba013 bash[30381]: audit 2021-03-10T14:16:24.285075+0000 mon.c (mon.1) 30 : audit [DBG] from='client.? 172.21.2.113:0/3201258439' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:24.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:24 gibba020 bash[25448]: cluster 2021-03-10T14:16:23.338558+0000 mgr.gibba020.yqfnwy (mgr.34427) 1273 : cluster [DBG] pgmap v713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:24.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:24 gibba020 bash[25448]: audit 2021-03-10T14:16:24.285075+0000 mon.c (mon.1) 30 : audit [DBG] from='client.? 172.21.2.113:0/3201258439' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:25.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:25 gibba013 bash[29418]: audit 2021-03-10T14:16:23.802011+0000 mgr.gibba020.yqfnwy (mgr.34427) 1274 : audit [DBG] from='client.54901 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:16:25.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:25 gibba013 bash[29418]: audit 2021-03-10T14:16:24.026005+0000 mgr.gibba020.yqfnwy (mgr.34427) 1275 : audit [DBG] from='client.44922 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:16:25.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:25 gibba013 bash[30381]: audit 2021-03-10T14:16:23.802011+0000 mgr.gibba020.yqfnwy (mgr.34427) 1274 : audit [DBG] from='client.54901 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:16:25.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:25 gibba013 bash[30381]: audit 2021-03-10T14:16:24.026005+0000 mgr.gibba020.yqfnwy (mgr.34427) 1275 : audit [DBG] from='client.44922 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:16:25.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:25 gibba020 bash[25448]: audit 2021-03-10T14:16:23.802011+0000 mgr.gibba020.yqfnwy (mgr.34427) 1274 : audit [DBG] from='client.54901 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:16:25.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:25 gibba020 bash[25448]: audit 2021-03-10T14:16:24.026005+0000 mgr.gibba020.yqfnwy (mgr.34427) 1275 : audit [DBG] from='client.44922 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:16:26.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:26 gibba020 bash[25448]: cluster 2021-03-10T14:16:25.339999+0000 mgr.gibba020.yqfnwy (mgr.34427) 1276 : cluster [DBG] pgmap v714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:26.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:26 gibba013 bash[29418]: cluster 2021-03-10T14:16:25.339999+0000 mgr.gibba020.yqfnwy (mgr.34427) 1276 : cluster [DBG] pgmap v714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:26.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:26 gibba013 bash[30381]: cluster 2021-03-10T14:16:25.339999+0000 mgr.gibba020.yqfnwy (mgr.34427) 1276 : cluster [DBG] pgmap v714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:28.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:28 gibba020 bash[25448]: cluster 2021-03-10T14:16:27.341480+0000 mgr.gibba020.yqfnwy (mgr.34427) 1277 : cluster [DBG] pgmap v715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:28.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:28 gibba013 bash[29418]: cluster 2021-03-10T14:16:27.341480+0000 mgr.gibba020.yqfnwy (mgr.34427) 1277 : cluster [DBG] pgmap v715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:28.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:28 gibba013 bash[30381]: cluster 2021-03-10T14:16:27.341480+0000 mgr.gibba020.yqfnwy (mgr.34427) 1277 : cluster [DBG] pgmap v715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:30.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:30 gibba020 bash[25448]: cluster 2021-03-10T14:16:29.343022+0000 mgr.gibba020.yqfnwy (mgr.34427) 1278 : cluster [DBG] pgmap v716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:30.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:30 gibba020 bash[25448]: audit 2021-03-10T14:16:30.250030+0000 mon.a (mon.0) 930 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:16:30.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:30 gibba020 bash[25448]: audit 2021-03-10T14:16:30.256718+0000 mon.a (mon.0) 931 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T14:16:30.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:30 gibba013 bash[29418]: cluster 2021-03-10T14:16:29.343022+0000 mgr.gibba020.yqfnwy (mgr.34427) 1278 : cluster [DBG] pgmap v716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:30.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:30 gibba013 bash[29418]: audit 2021-03-10T14:16:30.250030+0000 mon.a (mon.0) 930 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:16:30.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:30 gibba013 bash[29418]: audit 2021-03-10T14:16:30.256718+0000 mon.a (mon.0) 931 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T14:16:30.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:30 gibba013 bash[30381]: cluster 2021-03-10T14:16:29.343022+0000 mgr.gibba020.yqfnwy (mgr.34427) 1278 : cluster [DBG] pgmap v716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:30.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:30 gibba013 bash[30381]: audit 2021-03-10T14:16:30.250030+0000 mon.a (mon.0) 930 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:16:30.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:30 gibba013 bash[30381]: audit 2021-03-10T14:16:30.256718+0000 mon.a (mon.0) 931 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T14:16:31.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:31 gibba020 bash[25448]: cephadm 2021-03-10T14:16:30.254438+0000 mgr.gibba020.yqfnwy (mgr.34427) 1279 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:16:31.745 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:31 gibba013 bash[29418]: cephadm 2021-03-10T14:16:30.254438+0000 mgr.gibba020.yqfnwy (mgr.34427) 1279 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:16:31.745 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:31 gibba013 bash[30381]: cephadm 2021-03-10T14:16:30.254438+0000 mgr.gibba020.yqfnwy (mgr.34427) 1279 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:16:32.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:32 gibba013 bash[29418]: cluster 2021-03-10T14:16:31.344867+0000 mgr.gibba020.yqfnwy (mgr.34427) 1280 : cluster [DBG] pgmap v717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:32.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:32 gibba013 bash[30381]: cluster 2021-03-10T14:16:31.344867+0000 mgr.gibba020.yqfnwy (mgr.34427) 1280 : cluster [DBG] pgmap v717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:32.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:32 gibba020 bash[25448]: cluster 2021-03-10T14:16:31.344867+0000 mgr.gibba020.yqfnwy (mgr.34427) 1280 : cluster [DBG] pgmap v717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:34.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:34 gibba020 bash[25448]: cluster 2021-03-10T14:16:33.346310+0000 mgr.gibba020.yqfnwy (mgr.34427) 1281 : cluster [DBG] pgmap v718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:34.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:34 gibba013 bash[29418]: cluster 2021-03-10T14:16:33.346310+0000 mgr.gibba020.yqfnwy (mgr.34427) 1281 : cluster [DBG] pgmap v718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:34.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:34 gibba013 bash[30381]: cluster 2021-03-10T14:16:33.346310+0000 mgr.gibba020.yqfnwy (mgr.34427) 1281 : cluster [DBG] pgmap v718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:35.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:35 gibba020 bash[25448]: audit 2021-03-10T14:16:34.980356+0000 mon.a (mon.0) 932 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:16:35.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:35 gibba020 bash[25448]: audit 2021-03-10T14:16:35.156453+0000 mon.a (mon.0) 933 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:16:35.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:35 gibba020 bash[25448]: audit 2021-03-10T14:16:35.356435+0000 mon.a (mon.0) 934 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:16:35.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:35 gibba020 bash[25448]: audit 2021-03-10T14:16:35.359947+0000 mon.a (mon.0) 935 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:16:35.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:35 gibba020 bash[25448]: audit 2021-03-10T14:16:35.361341+0000 mon.a (mon.0) 936 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:35.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:35 gibba020 bash[25448]: audit 2021-03-10T14:16:35.362556+0000 mon.a (mon.0) 937 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:35.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:35 gibba020 bash[25448]: audit 2021-03-10T14:16:35.363614+0000 mon.a (mon.0) 938 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:35.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:35 gibba020 bash[25448]: audit 2021-03-10T14:16:35.365674+0000 mon.a (mon.0) 939 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:35.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:35 gibba020 bash[25448]: audit 2021-03-10T14:16:35.367007+0000 mon.a (mon.0) 940 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:35.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:35 gibba013 bash[29418]: audit 2021-03-10T14:16:34.980356+0000 mon.a (mon.0) 932 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:16:35.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:35 gibba013 bash[29418]: audit 2021-03-10T14:16:35.156453+0000 mon.a (mon.0) 933 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:16:35.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:35 gibba013 bash[29418]: audit 2021-03-10T14:16:35.356435+0000 mon.a (mon.0) 934 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:16:35.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:35 gibba013 bash[29418]: audit 2021-03-10T14:16:35.359947+0000 mon.a (mon.0) 935 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:16:35.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:35 gibba013 bash[29418]: audit 2021-03-10T14:16:35.361341+0000 mon.a (mon.0) 936 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:35.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:35 gibba013 bash[29418]: audit 2021-03-10T14:16:35.362556+0000 mon.a (mon.0) 937 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:35.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:35 gibba013 bash[29418]: audit 2021-03-10T14:16:35.363614+0000 mon.a (mon.0) 938 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:35.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:35 gibba013 bash[29418]: audit 2021-03-10T14:16:35.365674+0000 mon.a (mon.0) 939 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:35.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:35 gibba013 bash[29418]: audit 2021-03-10T14:16:35.367007+0000 mon.a (mon.0) 940 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:35.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:35 gibba013 bash[30381]: audit 2021-03-10T14:16:34.980356+0000 mon.a (mon.0) 932 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:16:35.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:35 gibba013 bash[30381]: audit 2021-03-10T14:16:35.156453+0000 mon.a (mon.0) 933 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:16:35.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:35 gibba013 bash[30381]: audit 2021-03-10T14:16:35.356435+0000 mon.a (mon.0) 934 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:16:35.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:35 gibba013 bash[30381]: audit 2021-03-10T14:16:35.359947+0000 mon.a (mon.0) 935 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:16:35.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:35 gibba013 bash[30381]: audit 2021-03-10T14:16:35.361341+0000 mon.a (mon.0) 936 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:35.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:35 gibba013 bash[30381]: audit 2021-03-10T14:16:35.362556+0000 mon.a (mon.0) 937 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:35.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:35 gibba013 bash[30381]: audit 2021-03-10T14:16:35.363614+0000 mon.a (mon.0) 938 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:35.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:35 gibba013 bash[30381]: audit 2021-03-10T14:16:35.365674+0000 mon.a (mon.0) 939 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:35.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:35 gibba013 bash[30381]: audit 2021-03-10T14:16:35.367007+0000 mon.a (mon.0) 940 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:36.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:36 gibba020 bash[25448]: cephadm 2021-03-10T14:16:35.155056+0000 mgr.gibba020.yqfnwy (mgr.34427) 1282 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:16:36.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:36 gibba020 bash[25448]: cluster 2021-03-10T14:16:35.347727+0000 mgr.gibba020.yqfnwy (mgr.34427) 1283 : cluster [DBG] pgmap v719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:36.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:36 gibba020 bash[25448]: cephadm 2021-03-10T14:16:35.357256+0000 mgr.gibba020.yqfnwy (mgr.34427) 1284 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:16:36.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:36 gibba020 bash[25448]: cephadm 2021-03-10T14:16:35.359067+0000 mgr.gibba020.yqfnwy (mgr.34427) 1285 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:16:36.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:36 gibba020 bash[25448]: cephadm 2021-03-10T14:16:35.360241+0000 mgr.gibba020.yqfnwy (mgr.34427) 1286 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:16:36.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:36 gibba020 bash[25448]: cephadm 2021-03-10T14:16:35.360292+0000 mgr.gibba020.yqfnwy (mgr.34427) 1287 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:16:36.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:36 gibba020 bash[25448]: cephadm 2021-03-10T14:16:35.361385+0000 mgr.gibba020.yqfnwy (mgr.34427) 1288 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:16:36.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:36 gibba020 bash[25448]: cephadm 2021-03-10T14:16:35.361432+0000 mgr.gibba020.yqfnwy (mgr.34427) 1289 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:16:36.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:36 gibba020 bash[25448]: cephadm 2021-03-10T14:16:35.362413+0000 mgr.gibba020.yqfnwy (mgr.34427) 1290 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:16:36.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:36 gibba020 bash[25448]: cephadm 2021-03-10T14:16:35.363297+0000 mgr.gibba020.yqfnwy (mgr.34427) 1291 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:16:36.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:36 gibba020 bash[25448]: cephadm 2021-03-10T14:16:35.363339+0000 mgr.gibba020.yqfnwy (mgr.34427) 1292 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:16:36.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:36 gibba020 bash[25448]: cephadm 2021-03-10T14:16:35.364483+0000 mgr.gibba020.yqfnwy (mgr.34427) 1293 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:16:36.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:36 gibba020 bash[25448]: cephadm 2021-03-10T14:16:35.364884+0000 mgr.gibba020.yqfnwy (mgr.34427) 1294 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:16:36.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:36 gibba020 bash[25448]: cephadm 2021-03-10T14:16:35.365691+0000 mgr.gibba020.yqfnwy (mgr.34427) 1295 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:16:36.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:36 gibba020 bash[25448]: cephadm 2021-03-10T14:16:35.365737+0000 mgr.gibba020.yqfnwy (mgr.34427) 1296 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:16:36.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:36 gibba020 bash[25448]: cephadm 2021-03-10T14:16:35.365861+0000 mgr.gibba020.yqfnwy (mgr.34427) 1297 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:16:36.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:36 gibba013 bash[29418]: cephadm 2021-03-10T14:16:35.155056+0000 mgr.gibba020.yqfnwy (mgr.34427) 1282 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:16:36.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:36 gibba013 bash[29418]: cluster 2021-03-10T14:16:35.347727+0000 mgr.gibba020.yqfnwy (mgr.34427) 1283 : cluster [DBG] pgmap v719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:36.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:36 gibba013 bash[29418]: cephadm 2021-03-10T14:16:35.357256+0000 mgr.gibba020.yqfnwy (mgr.34427) 1284 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:16:36.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:36 gibba013 bash[29418]: cephadm 2021-03-10T14:16:35.359067+0000 mgr.gibba020.yqfnwy (mgr.34427) 1285 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:16:36.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:36 gibba013 bash[29418]: cephadm 2021-03-10T14:16:35.360241+0000 mgr.gibba020.yqfnwy (mgr.34427) 1286 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:16:36.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:36 gibba013 bash[29418]: cephadm 2021-03-10T14:16:35.360292+0000 mgr.gibba020.yqfnwy (mgr.34427) 1287 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:16:36.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:36 gibba013 bash[29418]: cephadm 2021-03-10T14:16:35.361385+0000 mgr.gibba020.yqfnwy (mgr.34427) 1288 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:16:36.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:36 gibba013 bash[29418]: cephadm 2021-03-10T14:16:35.361432+0000 mgr.gibba020.yqfnwy (mgr.34427) 1289 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:16:36.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:36 gibba013 bash[29418]: cephadm 2021-03-10T14:16:35.362413+0000 mgr.gibba020.yqfnwy (mgr.34427) 1290 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:16:36.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:36 gibba013 bash[29418]: cephadm 2021-03-10T14:16:35.363297+0000 mgr.gibba020.yqfnwy (mgr.34427) 1291 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:16:36.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:36 gibba013 bash[29418]: cephadm 2021-03-10T14:16:35.363339+0000 mgr.gibba020.yqfnwy (mgr.34427) 1292 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:16:36.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:36 gibba013 bash[29418]: cephadm 2021-03-10T14:16:35.364483+0000 mgr.gibba020.yqfnwy (mgr.34427) 1293 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:16:36.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:36 gibba013 bash[29418]: cephadm 2021-03-10T14:16:35.364884+0000 mgr.gibba020.yqfnwy (mgr.34427) 1294 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:16:36.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:36 gibba013 bash[29418]: cephadm 2021-03-10T14:16:35.365691+0000 mgr.gibba020.yqfnwy (mgr.34427) 1295 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:16:36.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:36 gibba013 bash[29418]: cephadm 2021-03-10T14:16:35.365737+0000 mgr.gibba020.yqfnwy (mgr.34427) 1296 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:16:36.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:36 gibba013 bash[29418]: cephadm 2021-03-10T14:16:35.365861+0000 mgr.gibba020.yqfnwy (mgr.34427) 1297 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:16:36.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:36 gibba013 bash[30381]: cephadm 2021-03-10T14:16:35.155056+0000 mgr.gibba020.yqfnwy (mgr.34427) 1282 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:16:36.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:36 gibba013 bash[30381]: cluster 2021-03-10T14:16:35.347727+0000 mgr.gibba020.yqfnwy (mgr.34427) 1283 : cluster [DBG] pgmap v719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:36.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:36 gibba013 bash[30381]: cephadm 2021-03-10T14:16:35.357256+0000 mgr.gibba020.yqfnwy (mgr.34427) 1284 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:16:36.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:36 gibba013 bash[30381]: cephadm 2021-03-10T14:16:35.359067+0000 mgr.gibba020.yqfnwy (mgr.34427) 1285 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:16:36.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:36 gibba013 bash[30381]: cephadm 2021-03-10T14:16:35.360241+0000 mgr.gibba020.yqfnwy (mgr.34427) 1286 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:16:36.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:36 gibba013 bash[30381]: cephadm 2021-03-10T14:16:35.360292+0000 mgr.gibba020.yqfnwy (mgr.34427) 1287 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:16:36.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:36 gibba013 bash[30381]: cephadm 2021-03-10T14:16:35.361385+0000 mgr.gibba020.yqfnwy (mgr.34427) 1288 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:16:36.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:36 gibba013 bash[30381]: cephadm 2021-03-10T14:16:35.361432+0000 mgr.gibba020.yqfnwy (mgr.34427) 1289 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:16:36.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:36 gibba013 bash[30381]: cephadm 2021-03-10T14:16:35.362413+0000 mgr.gibba020.yqfnwy (mgr.34427) 1290 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:16:36.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:36 gibba013 bash[30381]: cephadm 2021-03-10T14:16:35.363297+0000 mgr.gibba020.yqfnwy (mgr.34427) 1291 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:16:36.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:36 gibba013 bash[30381]: cephadm 2021-03-10T14:16:35.363339+0000 mgr.gibba020.yqfnwy (mgr.34427) 1292 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:16:36.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:36 gibba013 bash[30381]: cephadm 2021-03-10T14:16:35.364483+0000 mgr.gibba020.yqfnwy (mgr.34427) 1293 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:16:36.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:36 gibba013 bash[30381]: cephadm 2021-03-10T14:16:35.364884+0000 mgr.gibba020.yqfnwy (mgr.34427) 1294 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:16:36.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:36 gibba013 bash[30381]: cephadm 2021-03-10T14:16:35.365691+0000 mgr.gibba020.yqfnwy (mgr.34427) 1295 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:16:36.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:36 gibba013 bash[30381]: cephadm 2021-03-10T14:16:35.365737+0000 mgr.gibba020.yqfnwy (mgr.34427) 1296 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:16:36.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:36 gibba013 bash[30381]: cephadm 2021-03-10T14:16:35.365861+0000 mgr.gibba020.yqfnwy (mgr.34427) 1297 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:16:38.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:38 gibba020 bash[25448]: cluster 2021-03-10T14:16:37.349147+0000 mgr.gibba020.yqfnwy (mgr.34427) 1298 : cluster [DBG] pgmap v720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:38.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:38 gibba013 bash[29418]: cluster 2021-03-10T14:16:37.349147+0000 mgr.gibba020.yqfnwy (mgr.34427) 1298 : cluster [DBG] pgmap v720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:38.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:38 gibba013 bash[30381]: cluster 2021-03-10T14:16:37.349147+0000 mgr.gibba020.yqfnwy (mgr.34427) 1298 : cluster [DBG] pgmap v720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:40.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:40 gibba013 bash[29418]: cluster 2021-03-10T14:16:39.350497+0000 mgr.gibba020.yqfnwy (mgr.34427) 1299 : cluster [DBG] pgmap v721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:40.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:40 gibba013 bash[30381]: cluster 2021-03-10T14:16:39.350497+0000 mgr.gibba020.yqfnwy (mgr.34427) 1299 : cluster [DBG] pgmap v721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:40.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:40 gibba020 bash[25448]: cluster 2021-03-10T14:16:39.350497+0000 mgr.gibba020.yqfnwy (mgr.34427) 1299 : cluster [DBG] pgmap v721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:42.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:42 gibba013 bash[29418]: cluster 2021-03-10T14:16:41.352308+0000 mgr.gibba020.yqfnwy (mgr.34427) 1300 : cluster [DBG] pgmap v722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:42.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:42 gibba013 bash[30381]: cluster 2021-03-10T14:16:41.352308+0000 mgr.gibba020.yqfnwy (mgr.34427) 1300 : cluster [DBG] pgmap v722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:42.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:42 gibba020 bash[25448]: cluster 2021-03-10T14:16:41.352308+0000 mgr.gibba020.yqfnwy (mgr.34427) 1300 : cluster [DBG] pgmap v722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:44.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:44 gibba013 bash[29418]: cluster 2021-03-10T14:16:43.353694+0000 mgr.gibba020.yqfnwy (mgr.34427) 1301 : cluster [DBG] pgmap v723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:44.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:44 gibba013 bash[30381]: cluster 2021-03-10T14:16:43.353694+0000 mgr.gibba020.yqfnwy (mgr.34427) 1301 : cluster [DBG] pgmap v723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:44.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:44 gibba020 bash[25448]: cluster 2021-03-10T14:16:43.353694+0000 mgr.gibba020.yqfnwy (mgr.34427) 1301 : cluster [DBG] pgmap v723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:46.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:46 gibba013 bash[30381]: cluster 2021-03-10T14:16:45.355081+0000 mgr.gibba020.yqfnwy (mgr.34427) 1302 : cluster [DBG] pgmap v724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:46.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:46 gibba013 bash[29418]: cluster 2021-03-10T14:16:45.355081+0000 mgr.gibba020.yqfnwy (mgr.34427) 1302 : cluster [DBG] pgmap v724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:46.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:46 gibba020 bash[25448]: cluster 2021-03-10T14:16:45.355081+0000 mgr.gibba020.yqfnwy (mgr.34427) 1302 : cluster [DBG] pgmap v724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:48.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:48 gibba013 bash[29418]: cluster 2021-03-10T14:16:47.356670+0000 mgr.gibba020.yqfnwy (mgr.34427) 1303 : cluster [DBG] pgmap v725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:48.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:48 gibba013 bash[30381]: cluster 2021-03-10T14:16:47.356670+0000 mgr.gibba020.yqfnwy (mgr.34427) 1303 : cluster [DBG] pgmap v725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:48.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:48 gibba020 bash[25448]: cluster 2021-03-10T14:16:47.356670+0000 mgr.gibba020.yqfnwy (mgr.34427) 1303 : cluster [DBG] pgmap v725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:50.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:50 gibba013 bash[29418]: cluster 2021-03-10T14:16:49.358159+0000 mgr.gibba020.yqfnwy (mgr.34427) 1304 : cluster [DBG] pgmap v726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:50.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:50 gibba013 bash[30381]: cluster 2021-03-10T14:16:49.358159+0000 mgr.gibba020.yqfnwy (mgr.34427) 1304 : cluster [DBG] pgmap v726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:50.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:50 gibba020 bash[25448]: cluster 2021-03-10T14:16:49.358159+0000 mgr.gibba020.yqfnwy (mgr.34427) 1304 : cluster [DBG] pgmap v726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:51.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:51 gibba020 bash[25448]: cephadm 2021-03-10T14:16:50.380663+0000 mgr.gibba020.yqfnwy (mgr.34427) 1305 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:16:51.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:51 gibba013 bash[29418]: cephadm 2021-03-10T14:16:50.380663+0000 mgr.gibba020.yqfnwy (mgr.34427) 1305 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:16:51.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:51 gibba013 bash[30381]: cephadm 2021-03-10T14:16:50.380663+0000 mgr.gibba020.yqfnwy (mgr.34427) 1305 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:16:52.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:52 gibba020 bash[25448]: cluster 2021-03-10T14:16:51.359889+0000 mgr.gibba020.yqfnwy (mgr.34427) 1306 : cluster [DBG] pgmap v727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:52.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:52 gibba013 bash[29418]: cluster 2021-03-10T14:16:51.359889+0000 mgr.gibba020.yqfnwy (mgr.34427) 1306 : cluster [DBG] pgmap v727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:52.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:52 gibba013 bash[30381]: cluster 2021-03-10T14:16:51.359889+0000 mgr.gibba020.yqfnwy (mgr.34427) 1306 : cluster [DBG] pgmap v727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:54.537 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:16:54.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:54 gibba020 bash[25448]: cluster 2021-03-10T14:16:53.361369+0000 mgr.gibba020.yqfnwy (mgr.34427) 1307 : cluster [DBG] pgmap v728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:54.760 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:16:54.760 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (23m) 9m ago 28m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:16:54.761 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (28m) 8m ago 28m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:16:54.761 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (23m) 8m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:16:54.761 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (24m) 8m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:16:54.761 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (23m) 9m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:16:54.761 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (22m) 9m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:16:54.762 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (22m) 8m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:16:54.762 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (22m) 9m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:16:54.763 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (28m) 9m ago 28m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:16:54.763 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (28m) 8m ago 28m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:16:54.763 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (21m) 9m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:16:54.763 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (21m) 9m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:16:54.764 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (20m) 9m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:16:54.764 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (20m) 9m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:16:54.765 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (19m) 8m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:16:54.765 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (19m) 8m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:16:54.765 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (19m) 8m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:16:54.766 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (18m) 8m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:16:54.766 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (28m) 8m ago 28m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:16:54.767 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 8m ago 26m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:16:54.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:54 gibba013 bash[29418]: cluster 2021-03-10T14:16:53.361369+0000 mgr.gibba020.yqfnwy (mgr.34427) 1307 : cluster [DBG] pgmap v728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:54.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:54 gibba013 bash[30381]: cluster 2021-03-10T14:16:53.361369+0000 mgr.gibba020.yqfnwy (mgr.34427) 1307 : cluster [DBG] pgmap v728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:55.020 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:16:55.021 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:16:55.021 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:16:55.021 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:16:55.022 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:16:55.022 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:16:55.022 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:16:55.022 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:16:55.023 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:16:55.023 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:16:55.023 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:16:55.023 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:16:55.024 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:16:55.024 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:16:55.024 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:16:55.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:55 gibba020 bash[25448]: audit 2021-03-10T14:16:54.519565+0000 mgr.gibba020.yqfnwy (mgr.34427) 1308 : audit [DBG] from='client.54919 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:16:55.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:55 gibba020 bash[25448]: audit 2021-03-10T14:16:55.018860+0000 mon.a (mon.0) 941 : audit [DBG] from='client.? 172.21.2.113:0/3382159557' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:55.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:55 gibba013 bash[29418]: audit 2021-03-10T14:16:54.519565+0000 mgr.gibba020.yqfnwy (mgr.34427) 1308 : audit [DBG] from='client.54919 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:16:55.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:55 gibba013 bash[29418]: audit 2021-03-10T14:16:55.018860+0000 mon.a (mon.0) 941 : audit [DBG] from='client.? 172.21.2.113:0/3382159557' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:55.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:55 gibba013 bash[30381]: audit 2021-03-10T14:16:54.519565+0000 mgr.gibba020.yqfnwy (mgr.34427) 1308 : audit [DBG] from='client.54919 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:16:55.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:55 gibba013 bash[30381]: audit 2021-03-10T14:16:55.018860+0000 mon.a (mon.0) 941 : audit [DBG] from='client.? 172.21.2.113:0/3382159557' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:16:56.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:56 gibba020 bash[25448]: audit 2021-03-10T14:16:54.743295+0000 mgr.gibba020.yqfnwy (mgr.34427) 1309 : audit [DBG] from='client.54925 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:16:56.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:56 gibba020 bash[25448]: cluster 2021-03-10T14:16:55.362172+0000 mgr.gibba020.yqfnwy (mgr.34427) 1310 : cluster [DBG] pgmap v729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:56.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:56 gibba013 bash[29418]: audit 2021-03-10T14:16:54.743295+0000 mgr.gibba020.yqfnwy (mgr.34427) 1309 : audit [DBG] from='client.54925 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:16:56.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:56 gibba013 bash[29418]: cluster 2021-03-10T14:16:55.362172+0000 mgr.gibba020.yqfnwy (mgr.34427) 1310 : cluster [DBG] pgmap v729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:56.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:56 gibba013 bash[30381]: audit 2021-03-10T14:16:54.743295+0000 mgr.gibba020.yqfnwy (mgr.34427) 1309 : audit [DBG] from='client.54925 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:16:56.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:56 gibba013 bash[30381]: cluster 2021-03-10T14:16:55.362172+0000 mgr.gibba020.yqfnwy (mgr.34427) 1310 : cluster [DBG] pgmap v729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:58.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:16:58 gibba020 bash[25448]: cluster 2021-03-10T14:16:57.363434+0000 mgr.gibba020.yqfnwy (mgr.34427) 1311 : cluster [DBG] pgmap v730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:58.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:16:58 gibba013 bash[29418]: cluster 2021-03-10T14:16:57.363434+0000 mgr.gibba020.yqfnwy (mgr.34427) 1311 : cluster [DBG] pgmap v730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:16:58.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:16:58 gibba013 bash[30381]: cluster 2021-03-10T14:16:57.363434+0000 mgr.gibba020.yqfnwy (mgr.34427) 1311 : cluster [DBG] pgmap v730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:00.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:00 gibba020 bash[25448]: cluster 2021-03-10T14:16:59.365011+0000 mgr.gibba020.yqfnwy (mgr.34427) 1312 : cluster [DBG] pgmap v731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:00.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:00 gibba013 bash[29418]: cluster 2021-03-10T14:16:59.365011+0000 mgr.gibba020.yqfnwy (mgr.34427) 1312 : cluster [DBG] pgmap v731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:00.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:00 gibba013 bash[30381]: cluster 2021-03-10T14:16:59.365011+0000 mgr.gibba020.yqfnwy (mgr.34427) 1312 : cluster [DBG] pgmap v731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:02.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:02 gibba020 bash[25448]: cluster 2021-03-10T14:17:01.366845+0000 mgr.gibba020.yqfnwy (mgr.34427) 1313 : cluster [DBG] pgmap v732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:02.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:02 gibba013 bash[29418]: cluster 2021-03-10T14:17:01.366845+0000 mgr.gibba020.yqfnwy (mgr.34427) 1313 : cluster [DBG] pgmap v732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:02.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:02 gibba013 bash[30381]: cluster 2021-03-10T14:17:01.366845+0000 mgr.gibba020.yqfnwy (mgr.34427) 1313 : cluster [DBG] pgmap v732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:04.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:04 gibba013 bash[29418]: cluster 2021-03-10T14:17:03.368243+0000 mgr.gibba020.yqfnwy (mgr.34427) 1314 : cluster [DBG] pgmap v733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:04.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:04 gibba013 bash[30381]: cluster 2021-03-10T14:17:03.368243+0000 mgr.gibba020.yqfnwy (mgr.34427) 1314 : cluster [DBG] pgmap v733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:04.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:04 gibba020 bash[25448]: cluster 2021-03-10T14:17:03.368243+0000 mgr.gibba020.yqfnwy (mgr.34427) 1314 : cluster [DBG] pgmap v733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:06 gibba013 bash[29418]: cluster 2021-03-10T14:17:05.368968+0000 mgr.gibba020.yqfnwy (mgr.34427) 1315 : cluster [DBG] pgmap v734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:06.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:06 gibba013 bash[29418]: cephadm 2021-03-10T14:17:05.396239+0000 mgr.gibba020.yqfnwy (mgr.34427) 1316 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:17:06.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:06 gibba013 bash[29418]: audit 2021-03-10T14:17:05.950215+0000 mon.a (mon.0) 942 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:17:06.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:06 gibba013 bash[29418]: audit 2021-03-10T14:17:05.950942+0000 mon.a (mon.0) 943 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:17:06.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:06 gibba013 bash[29418]: audit 2021-03-10T14:17:05.951679+0000 mon.a (mon.0) 944 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:17:06.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:06 gibba013 bash[29418]: audit 2021-03-10T14:17:05.952333+0000 mon.a (mon.0) 945 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:17:06.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:06 gibba013 bash[29418]: audit 2021-03-10T14:17:06.083071+0000 mon.a (mon.0) 946 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:17:06.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:06 gibba013 bash[29418]: audit 2021-03-10T14:17:06.089066+0000 mon.a (mon.0) 947 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:17:06.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:06 gibba013 bash[30381]: cluster 2021-03-10T14:17:05.368968+0000 mgr.gibba020.yqfnwy (mgr.34427) 1315 : cluster [DBG] pgmap v734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:06.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:06 gibba013 bash[30381]: cephadm 2021-03-10T14:17:05.396239+0000 mgr.gibba020.yqfnwy (mgr.34427) 1316 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:17:06.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:06 gibba013 bash[30381]: audit 2021-03-10T14:17:05.950215+0000 mon.a (mon.0) 942 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:17:06.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:06 gibba013 bash[30381]: audit 2021-03-10T14:17:05.950942+0000 mon.a (mon.0) 943 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:17:06.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:06 gibba013 bash[30381]: audit 2021-03-10T14:17:05.951679+0000 mon.a (mon.0) 944 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:17:06.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:06 gibba013 bash[30381]: audit 2021-03-10T14:17:05.952333+0000 mon.a (mon.0) 945 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:17:06.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:06 gibba013 bash[30381]: audit 2021-03-10T14:17:06.083071+0000 mon.a (mon.0) 946 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:17:06.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:06 gibba013 bash[30381]: audit 2021-03-10T14:17:06.089066+0000 mon.a (mon.0) 947 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:17:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:06 gibba020 bash[25448]: cluster 2021-03-10T14:17:05.368968+0000 mgr.gibba020.yqfnwy (mgr.34427) 1315 : cluster [DBG] pgmap v734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:06 gibba020 bash[25448]: cephadm 2021-03-10T14:17:05.396239+0000 mgr.gibba020.yqfnwy (mgr.34427) 1316 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:17:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:06 gibba020 bash[25448]: audit 2021-03-10T14:17:05.950215+0000 mon.a (mon.0) 942 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:17:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:06 gibba020 bash[25448]: audit 2021-03-10T14:17:05.950942+0000 mon.a (mon.0) 943 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:17:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:06 gibba020 bash[25448]: audit 2021-03-10T14:17:05.951679+0000 mon.a (mon.0) 944 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:17:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:06 gibba020 bash[25448]: audit 2021-03-10T14:17:05.952333+0000 mon.a (mon.0) 945 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:17:06.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:06 gibba020 bash[25448]: audit 2021-03-10T14:17:06.083071+0000 mon.a (mon.0) 946 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:17:06.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:06 gibba020 bash[25448]: audit 2021-03-10T14:17:06.089066+0000 mon.a (mon.0) 947 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:17:08.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:08 gibba020 bash[25448]: cluster 2021-03-10T14:17:07.370122+0000 mgr.gibba020.yqfnwy (mgr.34427) 1317 : cluster [DBG] pgmap v735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:08 gibba013 bash[29418]: cluster 2021-03-10T14:17:07.370122+0000 mgr.gibba020.yqfnwy (mgr.34427) 1317 : cluster [DBG] pgmap v735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:08.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:08 gibba013 bash[30381]: cluster 2021-03-10T14:17:07.370122+0000 mgr.gibba020.yqfnwy (mgr.34427) 1317 : cluster [DBG] pgmap v735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:10.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:10 gibba020 bash[25448]: cluster 2021-03-10T14:17:09.371428+0000 mgr.gibba020.yqfnwy (mgr.34427) 1318 : cluster [DBG] pgmap v736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:10.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:10 gibba013 bash[29418]: cluster 2021-03-10T14:17:09.371428+0000 mgr.gibba020.yqfnwy (mgr.34427) 1318 : cluster [DBG] pgmap v736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:10.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:10 gibba013 bash[30381]: cluster 2021-03-10T14:17:09.371428+0000 mgr.gibba020.yqfnwy (mgr.34427) 1318 : cluster [DBG] pgmap v736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:12.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:12 gibba013 bash[29418]: cluster 2021-03-10T14:17:11.373192+0000 mgr.gibba020.yqfnwy (mgr.34427) 1319 : cluster [DBG] pgmap v737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:12.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:12 gibba013 bash[30381]: cluster 2021-03-10T14:17:11.373192+0000 mgr.gibba020.yqfnwy (mgr.34427) 1319 : cluster [DBG] pgmap v737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:12.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:12 gibba020 bash[25448]: cluster 2021-03-10T14:17:11.373192+0000 mgr.gibba020.yqfnwy (mgr.34427) 1319 : cluster [DBG] pgmap v737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:14.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:14 gibba013 bash[29418]: cluster 2021-03-10T14:17:13.374695+0000 mgr.gibba020.yqfnwy (mgr.34427) 1320 : cluster [DBG] pgmap v738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:14.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:14 gibba013 bash[30381]: cluster 2021-03-10T14:17:13.374695+0000 mgr.gibba020.yqfnwy (mgr.34427) 1320 : cluster [DBG] pgmap v738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:14.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:14 gibba020 bash[25448]: cluster 2021-03-10T14:17:13.374695+0000 mgr.gibba020.yqfnwy (mgr.34427) 1320 : cluster [DBG] pgmap v738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:16.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:16 gibba013 bash[29418]: cluster 2021-03-10T14:17:15.375658+0000 mgr.gibba020.yqfnwy (mgr.34427) 1321 : cluster [DBG] pgmap v739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:16.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:16 gibba013 bash[30381]: cluster 2021-03-10T14:17:15.375658+0000 mgr.gibba020.yqfnwy (mgr.34427) 1321 : cluster [DBG] pgmap v739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:16.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:16 gibba020 bash[25448]: cluster 2021-03-10T14:17:15.375658+0000 mgr.gibba020.yqfnwy (mgr.34427) 1321 : cluster [DBG] pgmap v739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:18.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:18 gibba020 bash[25448]: cluster 2021-03-10T14:17:17.376963+0000 mgr.gibba020.yqfnwy (mgr.34427) 1322 : cluster [DBG] pgmap v740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:18.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:18 gibba013 bash[29418]: cluster 2021-03-10T14:17:17.376963+0000 mgr.gibba020.yqfnwy (mgr.34427) 1322 : cluster [DBG] pgmap v740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:18.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:18 gibba013 bash[30381]: cluster 2021-03-10T14:17:17.376963+0000 mgr.gibba020.yqfnwy (mgr.34427) 1322 : cluster [DBG] pgmap v740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:20.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:20 gibba020 bash[25448]: cluster 2021-03-10T14:17:19.378500+0000 mgr.gibba020.yqfnwy (mgr.34427) 1323 : cluster [DBG] pgmap v741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:20.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:20 gibba013 bash[29418]: cluster 2021-03-10T14:17:19.378500+0000 mgr.gibba020.yqfnwy (mgr.34427) 1323 : cluster [DBG] pgmap v741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:20.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:20 gibba013 bash[30381]: cluster 2021-03-10T14:17:19.378500+0000 mgr.gibba020.yqfnwy (mgr.34427) 1323 : cluster [DBG] pgmap v741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:21.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:21 gibba013 bash[29418]: cephadm 2021-03-10T14:17:20.411898+0000 mgr.gibba020.yqfnwy (mgr.34427) 1324 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:17:21.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:21 gibba013 bash[30381]: cephadm 2021-03-10T14:17:20.411898+0000 mgr.gibba020.yqfnwy (mgr.34427) 1324 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:17:21.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:21 gibba020 bash[25448]: cephadm 2021-03-10T14:17:20.411898+0000 mgr.gibba020.yqfnwy (mgr.34427) 1324 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:17:22.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:22 gibba013 bash[29418]: cluster 2021-03-10T14:17:21.380386+0000 mgr.gibba020.yqfnwy (mgr.34427) 1325 : cluster [DBG] pgmap v742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:22.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:22 gibba013 bash[30381]: cluster 2021-03-10T14:17:21.380386+0000 mgr.gibba020.yqfnwy (mgr.34427) 1325 : cluster [DBG] pgmap v742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:22.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:22 gibba020 bash[25448]: cluster 2021-03-10T14:17:21.380386+0000 mgr.gibba020.yqfnwy (mgr.34427) 1325 : cluster [DBG] pgmap v742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:24.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:24 gibba013 bash[29418]: cluster 2021-03-10T14:17:23.381836+0000 mgr.gibba020.yqfnwy (mgr.34427) 1326 : cluster [DBG] pgmap v743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:24.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:24 gibba013 bash[30381]: cluster 2021-03-10T14:17:23.381836+0000 mgr.gibba020.yqfnwy (mgr.34427) 1326 : cluster [DBG] pgmap v743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:24.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:24 gibba020 bash[25448]: cluster 2021-03-10T14:17:23.381836+0000 mgr.gibba020.yqfnwy (mgr.34427) 1326 : cluster [DBG] pgmap v743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:25.264 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:17:25.496 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:17:25.496 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (23m) 10m ago 29m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:17:25.496 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (29m) 8m ago 29m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:17:25.496 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (24m) 8m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:17:25.496 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (24m) 8m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:17:25.497 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (23m) 10m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:17:25.497 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (23m) 10m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:17:25.497 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (22m) 8m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:17:25.497 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (23m) 10m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:17:25.497 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (29m) 10m ago 29m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:17:25.498 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (29m) 8m ago 29m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:17:25.498 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (22m) 10m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:17:25.498 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (21m) 10m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:17:25.498 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (21m) 10m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:17:25.499 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (20m) 10m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:17:25.499 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (20m) 8m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:17:25.499 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (20m) 8m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:17:25.499 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (19m) 8m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:17:25.499 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (19m) 8m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:17:25.500 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (28m) 8m ago 29m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:17:25.500 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 8m ago 27m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:17:25.747 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:17:25.747 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:17:25.747 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:17:25.747 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:17:25.748 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:17:25.748 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:17:25.748 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:17:25.748 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:17:25.748 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:17:25.749 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:17:25.749 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:17:25.749 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:17:25.749 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:17:25.749 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:17:25.749 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:17:26.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:26 gibba020 bash[25448]: audit 2021-03-10T14:17:25.252001+0000 mgr.gibba020.yqfnwy (mgr.34427) 1327 : audit [DBG] from='client.44952 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:17:26.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:26 gibba020 bash[25448]: cluster 2021-03-10T14:17:25.382582+0000 mgr.gibba020.yqfnwy (mgr.34427) 1328 : cluster [DBG] pgmap v744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:26.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:26 gibba020 bash[25448]: audit 2021-03-10T14:17:25.480809+0000 mgr.gibba020.yqfnwy (mgr.34427) 1329 : audit [DBG] from='client.44958 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:17:26.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:26 gibba020 bash[25448]: audit 2021-03-10T14:17:25.744983+0000 mon.a (mon.0) 948 : audit [DBG] from='client.? 172.21.2.113:0/610558979' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:26.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:26 gibba013 bash[29418]: audit 2021-03-10T14:17:25.252001+0000 mgr.gibba020.yqfnwy (mgr.34427) 1327 : audit [DBG] from='client.44952 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:17:26.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:26 gibba013 bash[29418]: cluster 2021-03-10T14:17:25.382582+0000 mgr.gibba020.yqfnwy (mgr.34427) 1328 : cluster [DBG] pgmap v744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:26.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:26 gibba013 bash[29418]: audit 2021-03-10T14:17:25.480809+0000 mgr.gibba020.yqfnwy (mgr.34427) 1329 : audit [DBG] from='client.44958 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:17:26.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:26 gibba013 bash[29418]: audit 2021-03-10T14:17:25.744983+0000 mon.a (mon.0) 948 : audit [DBG] from='client.? 172.21.2.113:0/610558979' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:26.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:26 gibba013 bash[30381]: audit 2021-03-10T14:17:25.252001+0000 mgr.gibba020.yqfnwy (mgr.34427) 1327 : audit [DBG] from='client.44952 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:17:26.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:26 gibba013 bash[30381]: cluster 2021-03-10T14:17:25.382582+0000 mgr.gibba020.yqfnwy (mgr.34427) 1328 : cluster [DBG] pgmap v744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:26.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:26 gibba013 bash[30381]: audit 2021-03-10T14:17:25.480809+0000 mgr.gibba020.yqfnwy (mgr.34427) 1329 : audit [DBG] from='client.44958 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:17:26.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:26 gibba013 bash[30381]: audit 2021-03-10T14:17:25.744983+0000 mon.a (mon.0) 948 : audit [DBG] from='client.? 172.21.2.113:0/610558979' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:28.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:28 gibba013 bash[29418]: cluster 2021-03-10T14:17:27.384030+0000 mgr.gibba020.yqfnwy (mgr.34427) 1330 : cluster [DBG] pgmap v745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:28.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:28 gibba013 bash[30381]: cluster 2021-03-10T14:17:27.384030+0000 mgr.gibba020.yqfnwy (mgr.34427) 1330 : cluster [DBG] pgmap v745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:28.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:28 gibba020 bash[25448]: cluster 2021-03-10T14:17:27.384030+0000 mgr.gibba020.yqfnwy (mgr.34427) 1330 : cluster [DBG] pgmap v745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:30.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:30 gibba013 bash[29418]: cluster 2021-03-10T14:17:29.385258+0000 mgr.gibba020.yqfnwy (mgr.34427) 1331 : cluster [DBG] pgmap v746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:30.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:30 gibba013 bash[30381]: cluster 2021-03-10T14:17:29.385258+0000 mgr.gibba020.yqfnwy (mgr.34427) 1331 : cluster [DBG] pgmap v746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:30.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:30 gibba020 bash[25448]: cluster 2021-03-10T14:17:29.385258+0000 mgr.gibba020.yqfnwy (mgr.34427) 1331 : cluster [DBG] pgmap v746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:32.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:32 gibba013 bash[29418]: cluster 2021-03-10T14:17:31.387168+0000 mgr.gibba020.yqfnwy (mgr.34427) 1332 : cluster [DBG] pgmap v747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:32.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:32 gibba013 bash[30381]: cluster 2021-03-10T14:17:31.387168+0000 mgr.gibba020.yqfnwy (mgr.34427) 1332 : cluster [DBG] pgmap v747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:32.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:32 gibba020 bash[25448]: cluster 2021-03-10T14:17:31.387168+0000 mgr.gibba020.yqfnwy (mgr.34427) 1332 : cluster [DBG] pgmap v747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:34.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:34 gibba013 bash[29418]: cluster 2021-03-10T14:17:33.388588+0000 mgr.gibba020.yqfnwy (mgr.34427) 1333 : cluster [DBG] pgmap v748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:34.894 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:34 gibba013 bash[30381]: cluster 2021-03-10T14:17:33.388588+0000 mgr.gibba020.yqfnwy (mgr.34427) 1333 : cluster [DBG] pgmap v748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:34.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:34 gibba020 bash[25448]: cluster 2021-03-10T14:17:33.388588+0000 mgr.gibba020.yqfnwy (mgr.34427) 1333 : cluster [DBG] pgmap v748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:36.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:36 gibba020 bash[25448]: cluster 2021-03-10T14:17:35.389436+0000 mgr.gibba020.yqfnwy (mgr.34427) 1334 : cluster [DBG] pgmap v749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:36.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:36 gibba020 bash[25448]: audit 2021-03-10T14:17:35.429783+0000 mon.a (mon.0) 949 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:17:36.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:36 gibba020 bash[25448]: cephadm 2021-03-10T14:17:35.431179+0000 mgr.gibba020.yqfnwy (mgr.34427) 1335 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:17:36.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:36 gibba020 bash[25448]: audit 2021-03-10T14:17:35.433183+0000 mon.a (mon.0) 950 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:17:36.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:36 gibba013 bash[29418]: cluster 2021-03-10T14:17:35.389436+0000 mgr.gibba020.yqfnwy (mgr.34427) 1334 : cluster [DBG] pgmap v749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:36.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:36 gibba013 bash[29418]: audit 2021-03-10T14:17:35.429783+0000 mon.a (mon.0) 949 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:17:36.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:36 gibba013 bash[29418]: cephadm 2021-03-10T14:17:35.431179+0000 mgr.gibba020.yqfnwy (mgr.34427) 1335 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:17:36.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:36 gibba013 bash[29418]: audit 2021-03-10T14:17:35.433183+0000 mon.a (mon.0) 950 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:17:36.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:36 gibba013 bash[30381]: cluster 2021-03-10T14:17:35.389436+0000 mgr.gibba020.yqfnwy (mgr.34427) 1334 : cluster [DBG] pgmap v749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:36.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:36 gibba013 bash[30381]: audit 2021-03-10T14:17:35.429783+0000 mon.a (mon.0) 949 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:17:36.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:36 gibba013 bash[30381]: cephadm 2021-03-10T14:17:35.431179+0000 mgr.gibba020.yqfnwy (mgr.34427) 1335 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:17:36.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:36 gibba013 bash[30381]: audit 2021-03-10T14:17:35.433183+0000 mon.a (mon.0) 950 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:17:38.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:38 gibba013 bash[29418]: cluster 2021-03-10T14:17:37.390585+0000 mgr.gibba020.yqfnwy (mgr.34427) 1336 : cluster [DBG] pgmap v750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:38.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:38 gibba013 bash[30381]: cluster 2021-03-10T14:17:37.390585+0000 mgr.gibba020.yqfnwy (mgr.34427) 1336 : cluster [DBG] pgmap v750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:38.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:38 gibba020 bash[25448]: cluster 2021-03-10T14:17:37.390585+0000 mgr.gibba020.yqfnwy (mgr.34427) 1336 : cluster [DBG] pgmap v750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:40.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:39 gibba020 bash[25448]: cephadm 2021-03-10T14:17:38.918239+0000 mgr.gibba020.yqfnwy (mgr.34427) 1337 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:17:40.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:39 gibba020 bash[25448]: audit 2021-03-10T14:17:38.919283+0000 mon.a (mon.0) 951 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:17:40.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:39 gibba020 bash[25448]: audit 2021-03-10T14:17:39.125423+0000 mon.a (mon.0) 952 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:17:40.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:39 gibba020 bash[25448]: cephadm 2021-03-10T14:17:39.130314+0000 mgr.gibba020.yqfnwy (mgr.34427) 1338 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:17:40.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:39 gibba020 bash[25448]: cephadm 2021-03-10T14:17:39.132932+0000 mgr.gibba020.yqfnwy (mgr.34427) 1339 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:17:40.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:39 gibba020 bash[25448]: audit 2021-03-10T14:17:39.133001+0000 mon.a (mon.0) 953 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:17:40.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:39 gibba020 bash[25448]: cephadm 2021-03-10T14:17:39.135127+0000 mgr.gibba020.yqfnwy (mgr.34427) 1340 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:17:40.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:39 gibba020 bash[25448]: cephadm 2021-03-10T14:17:39.135169+0000 mgr.gibba020.yqfnwy (mgr.34427) 1341 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:17:40.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:39 gibba020 bash[25448]: audit 2021-03-10T14:17:39.135274+0000 mon.a (mon.0) 954 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:40.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:39 gibba020 bash[25448]: cephadm 2021-03-10T14:17:39.136982+0000 mgr.gibba020.yqfnwy (mgr.34427) 1342 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:17:40.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:39 gibba020 bash[25448]: cephadm 2021-03-10T14:17:39.137027+0000 mgr.gibba020.yqfnwy (mgr.34427) 1343 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:17:40.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:39 gibba020 bash[25448]: audit 2021-03-10T14:17:39.137313+0000 mon.a (mon.0) 955 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:40.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:39 gibba020 bash[25448]: cephadm 2021-03-10T14:17:39.139131+0000 mgr.gibba020.yqfnwy (mgr.34427) 1344 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:17:40.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:39 gibba020 bash[25448]: audit 2021-03-10T14:17:39.139286+0000 mon.a (mon.0) 956 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:40.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:39 gibba020 bash[25448]: cephadm 2021-03-10T14:17:39.140506+0000 mgr.gibba020.yqfnwy (mgr.34427) 1345 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:17:40.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:39 gibba020 bash[25448]: cephadm 2021-03-10T14:17:39.140550+0000 mgr.gibba020.yqfnwy (mgr.34427) 1346 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:17:40.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:39 gibba020 bash[25448]: cephadm 2021-03-10T14:17:39.142401+0000 mgr.gibba020.yqfnwy (mgr.34427) 1347 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:17:40.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:39 gibba020 bash[25448]: cephadm 2021-03-10T14:17:39.142873+0000 mgr.gibba020.yqfnwy (mgr.34427) 1348 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:17:40.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:39 gibba020 bash[25448]: audit 2021-03-10T14:17:39.142928+0000 mon.a (mon.0) 957 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:40.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:39 gibba020 bash[25448]: cephadm 2021-03-10T14:17:39.144364+0000 mgr.gibba020.yqfnwy (mgr.34427) 1349 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:17:40.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:39 gibba020 bash[25448]: cephadm 2021-03-10T14:17:39.144411+0000 mgr.gibba020.yqfnwy (mgr.34427) 1350 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:17:40.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:39 gibba020 bash[25448]: cephadm 2021-03-10T14:17:39.144543+0000 mgr.gibba020.yqfnwy (mgr.34427) 1351 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:17:40.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:39 gibba020 bash[25448]: audit 2021-03-10T14:17:39.144954+0000 mon.a (mon.0) 958 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:40.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:39 gibba020 bash[25448]: cluster 2021-03-10T14:17:39.391840+0000 mgr.gibba020.yqfnwy (mgr.34427) 1352 : cluster [DBG] pgmap v751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:40.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[29418]: cephadm 2021-03-10T14:17:38.918239+0000 mgr.gibba020.yqfnwy (mgr.34427) 1337 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:17:40.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[29418]: audit 2021-03-10T14:17:38.919283+0000 mon.a (mon.0) 951 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:17:40.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[29418]: audit 2021-03-10T14:17:39.125423+0000 mon.a (mon.0) 952 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:17:40.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[29418]: cephadm 2021-03-10T14:17:39.130314+0000 mgr.gibba020.yqfnwy (mgr.34427) 1338 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:17:40.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[29418]: cephadm 2021-03-10T14:17:39.132932+0000 mgr.gibba020.yqfnwy (mgr.34427) 1339 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:17:40.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[29418]: audit 2021-03-10T14:17:39.133001+0000 mon.a (mon.0) 953 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:17:40.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[29418]: cephadm 2021-03-10T14:17:39.135127+0000 mgr.gibba020.yqfnwy (mgr.34427) 1340 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:17:40.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[29418]: cephadm 2021-03-10T14:17:39.135169+0000 mgr.gibba020.yqfnwy (mgr.34427) 1341 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:17:40.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[29418]: audit 2021-03-10T14:17:39.135274+0000 mon.a (mon.0) 954 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:40.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[29418]: cephadm 2021-03-10T14:17:39.136982+0000 mgr.gibba020.yqfnwy (mgr.34427) 1342 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:17:40.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[29418]: cephadm 2021-03-10T14:17:39.137027+0000 mgr.gibba020.yqfnwy (mgr.34427) 1343 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:17:40.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[29418]: audit 2021-03-10T14:17:39.137313+0000 mon.a (mon.0) 955 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:40.387 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[29418]: cephadm 2021-03-10T14:17:39.139131+0000 mgr.gibba020.yqfnwy (mgr.34427) 1344 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:17:40.387 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[29418]: audit 2021-03-10T14:17:39.139286+0000 mon.a (mon.0) 956 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:40.388 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[29418]: cephadm 2021-03-10T14:17:39.140506+0000 mgr.gibba020.yqfnwy (mgr.34427) 1345 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:17:40.388 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[29418]: cephadm 2021-03-10T14:17:39.140550+0000 mgr.gibba020.yqfnwy (mgr.34427) 1346 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:17:40.389 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[29418]: cephadm 2021-03-10T14:17:39.142401+0000 mgr.gibba020.yqfnwy (mgr.34427) 1347 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:17:40.389 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[29418]: cephadm 2021-03-10T14:17:39.142873+0000 mgr.gibba020.yqfnwy (mgr.34427) 1348 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:17:40.389 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[29418]: audit 2021-03-10T14:17:39.142928+0000 mon.a (mon.0) 957 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:40.390 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[29418]: cephadm 2021-03-10T14:17:39.144364+0000 mgr.gibba020.yqfnwy (mgr.34427) 1349 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:17:40.390 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[29418]: cephadm 2021-03-10T14:17:39.144411+0000 mgr.gibba020.yqfnwy (mgr.34427) 1350 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:17:40.391 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[30381]: cephadm 2021-03-10T14:17:38.918239+0000 mgr.gibba020.yqfnwy (mgr.34427) 1337 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:17:40.391 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[30381]: audit 2021-03-10T14:17:38.919283+0000 mon.a (mon.0) 951 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:17:40.392 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[30381]: audit 2021-03-10T14:17:39.125423+0000 mon.a (mon.0) 952 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:17:40.393 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[30381]: cephadm 2021-03-10T14:17:39.130314+0000 mgr.gibba020.yqfnwy (mgr.34427) 1338 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:17:40.393 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[30381]: cephadm 2021-03-10T14:17:39.132932+0000 mgr.gibba020.yqfnwy (mgr.34427) 1339 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:17:40.393 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[30381]: audit 2021-03-10T14:17:39.133001+0000 mon.a (mon.0) 953 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:17:40.394 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[30381]: cephadm 2021-03-10T14:17:39.135127+0000 mgr.gibba020.yqfnwy (mgr.34427) 1340 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:17:40.394 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[30381]: cephadm 2021-03-10T14:17:39.135169+0000 mgr.gibba020.yqfnwy (mgr.34427) 1341 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:17:40.395 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[30381]: audit 2021-03-10T14:17:39.135274+0000 mon.a (mon.0) 954 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:40.395 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[30381]: cephadm 2021-03-10T14:17:39.136982+0000 mgr.gibba020.yqfnwy (mgr.34427) 1342 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:17:40.396 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[30381]: cephadm 2021-03-10T14:17:39.137027+0000 mgr.gibba020.yqfnwy (mgr.34427) 1343 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:17:40.396 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[30381]: audit 2021-03-10T14:17:39.137313+0000 mon.a (mon.0) 955 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:40.396 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[30381]: cephadm 2021-03-10T14:17:39.139131+0000 mgr.gibba020.yqfnwy (mgr.34427) 1344 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:17:40.397 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[30381]: audit 2021-03-10T14:17:39.139286+0000 mon.a (mon.0) 956 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:40.397 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[30381]: cephadm 2021-03-10T14:17:39.140506+0000 mgr.gibba020.yqfnwy (mgr.34427) 1345 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:17:40.398 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[30381]: cephadm 2021-03-10T14:17:39.140550+0000 mgr.gibba020.yqfnwy (mgr.34427) 1346 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:17:40.398 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[30381]: cephadm 2021-03-10T14:17:39.142401+0000 mgr.gibba020.yqfnwy (mgr.34427) 1347 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:17:40.399 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[30381]: cephadm 2021-03-10T14:17:39.142873+0000 mgr.gibba020.yqfnwy (mgr.34427) 1348 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:17:40.399 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[30381]: audit 2021-03-10T14:17:39.142928+0000 mon.a (mon.0) 957 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:40.399 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[30381]: cephadm 2021-03-10T14:17:39.144364+0000 mgr.gibba020.yqfnwy (mgr.34427) 1349 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:17:40.400 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[30381]: cephadm 2021-03-10T14:17:39.144411+0000 mgr.gibba020.yqfnwy (mgr.34427) 1350 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:17:40.401 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[29418]: cephadm 2021-03-10T14:17:39.144543+0000 mgr.gibba020.yqfnwy (mgr.34427) 1351 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:17:40.401 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[29418]: audit 2021-03-10T14:17:39.144954+0000 mon.a (mon.0) 958 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:40.401 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[29418]: cluster 2021-03-10T14:17:39.391840+0000 mgr.gibba020.yqfnwy (mgr.34427) 1352 : cluster [DBG] pgmap v751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:40.402 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[30381]: cephadm 2021-03-10T14:17:39.144543+0000 mgr.gibba020.yqfnwy (mgr.34427) 1351 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:17:40.402 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[30381]: audit 2021-03-10T14:17:39.144954+0000 mon.a (mon.0) 958 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:40.403 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:39 gibba013 bash[30381]: cluster 2021-03-10T14:17:39.391840+0000 mgr.gibba020.yqfnwy (mgr.34427) 1352 : cluster [DBG] pgmap v751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:42.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:42 gibba013 bash[29418]: cluster 2021-03-10T14:17:41.393481+0000 mgr.gibba020.yqfnwy (mgr.34427) 1353 : cluster [DBG] pgmap v752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:42.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:42 gibba013 bash[30381]: cluster 2021-03-10T14:17:41.393481+0000 mgr.gibba020.yqfnwy (mgr.34427) 1353 : cluster [DBG] pgmap v752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:42.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:42 gibba020 bash[25448]: cluster 2021-03-10T14:17:41.393481+0000 mgr.gibba020.yqfnwy (mgr.34427) 1353 : cluster [DBG] pgmap v752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:44.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:44 gibba013 bash[29418]: cluster 2021-03-10T14:17:43.394994+0000 mgr.gibba020.yqfnwy (mgr.34427) 1354 : cluster [DBG] pgmap v753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:44.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:44 gibba013 bash[30381]: cluster 2021-03-10T14:17:43.394994+0000 mgr.gibba020.yqfnwy (mgr.34427) 1354 : cluster [DBG] pgmap v753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:44.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:44 gibba020 bash[25448]: cluster 2021-03-10T14:17:43.394994+0000 mgr.gibba020.yqfnwy (mgr.34427) 1354 : cluster [DBG] pgmap v753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:46.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:46 gibba020 bash[25448]: cluster 2021-03-10T14:17:45.395827+0000 mgr.gibba020.yqfnwy (mgr.34427) 1355 : cluster [DBG] pgmap v754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:46.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:46 gibba013 bash[29418]: cluster 2021-03-10T14:17:45.395827+0000 mgr.gibba020.yqfnwy (mgr.34427) 1355 : cluster [DBG] pgmap v754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:46.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:46 gibba013 bash[30381]: cluster 2021-03-10T14:17:45.395827+0000 mgr.gibba020.yqfnwy (mgr.34427) 1355 : cluster [DBG] pgmap v754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:48.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:48 gibba020 bash[25448]: cluster 2021-03-10T14:17:47.397287+0000 mgr.gibba020.yqfnwy (mgr.34427) 1356 : cluster [DBG] pgmap v755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:48.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:48 gibba013 bash[29418]: cluster 2021-03-10T14:17:47.397287+0000 mgr.gibba020.yqfnwy (mgr.34427) 1356 : cluster [DBG] pgmap v755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:48.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:48 gibba013 bash[30381]: cluster 2021-03-10T14:17:47.397287+0000 mgr.gibba020.yqfnwy (mgr.34427) 1356 : cluster [DBG] pgmap v755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:50.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:50 gibba020 bash[25448]: cluster 2021-03-10T14:17:49.398516+0000 mgr.gibba020.yqfnwy (mgr.34427) 1357 : cluster [DBG] pgmap v756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:50.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:50 gibba013 bash[29418]: cluster 2021-03-10T14:17:49.398516+0000 mgr.gibba020.yqfnwy (mgr.34427) 1357 : cluster [DBG] pgmap v756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:50.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:50 gibba013 bash[30381]: cluster 2021-03-10T14:17:49.398516+0000 mgr.gibba020.yqfnwy (mgr.34427) 1357 : cluster [DBG] pgmap v756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:52.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:52 gibba020 bash[25448]: cluster 2021-03-10T14:17:51.400382+0000 mgr.gibba020.yqfnwy (mgr.34427) 1358 : cluster [DBG] pgmap v757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:52.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:52 gibba013 bash[29418]: cluster 2021-03-10T14:17:51.400382+0000 mgr.gibba020.yqfnwy (mgr.34427) 1358 : cluster [DBG] pgmap v757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:52.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:52 gibba013 bash[30381]: cluster 2021-03-10T14:17:51.400382+0000 mgr.gibba020.yqfnwy (mgr.34427) 1358 : cluster [DBG] pgmap v757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:54.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:54 gibba020 bash[25448]: cluster 2021-03-10T14:17:53.401734+0000 mgr.gibba020.yqfnwy (mgr.34427) 1359 : cluster [DBG] pgmap v758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:54.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:54 gibba013 bash[29418]: cluster 2021-03-10T14:17:53.401734+0000 mgr.gibba020.yqfnwy (mgr.34427) 1359 : cluster [DBG] pgmap v758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:54.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:54 gibba013 bash[30381]: cluster 2021-03-10T14:17:53.401734+0000 mgr.gibba020.yqfnwy (mgr.34427) 1359 : cluster [DBG] pgmap v758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:55.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:55 gibba020 bash[25448]: cephadm 2021-03-10T14:17:54.160488+0000 mgr.gibba020.yqfnwy (mgr.34427) 1360 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:17:55.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:55 gibba013 bash[29418]: cephadm 2021-03-10T14:17:54.160488+0000 mgr.gibba020.yqfnwy (mgr.34427) 1360 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:17:55.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:55 gibba013 bash[30381]: cephadm 2021-03-10T14:17:54.160488+0000 mgr.gibba020.yqfnwy (mgr.34427) 1360 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:17:55.992 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:17:56.217 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:17:56.217 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (24m) 17s ago 29m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:17:56.217 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (29m) 9m ago 29m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:17:56.218 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (24m) 9m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:17:56.218 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (25m) 9m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:17:56.218 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (24m) 17s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:17:56.218 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (23m) 17s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:17:56.219 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (23m) 9m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:17:56.219 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (23m) 17s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:17:56.219 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (29m) 17s ago 29m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:17:56.219 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (29m) 9m ago 29m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:17:56.219 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (22m) 17s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:17:56.220 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (22m) 17s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:17:56.220 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (21m) 17s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:17:56.220 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (21m) 17s ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:17:56.220 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (20m) 9m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:17:56.221 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (20m) 9m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:17:56.221 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (20m) 9m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:17:56.221 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (19m) 9m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:17:56.221 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (29m) 9m ago 30m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:17:56.222 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 9m ago 27m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:17:56.467 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:17:56.468 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:17:56.468 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:17:56.468 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:17:56.468 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:17:56.469 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:17:56.469 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:17:56.469 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:17:56.469 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:17:56.470 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:17:56.470 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:17:56.470 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:17:56.470 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:17:56.470 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:17:56.471 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:17:56.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:56 gibba020 bash[25448]: cluster 2021-03-10T14:17:55.403418+0000 mgr.gibba020.yqfnwy (mgr.34427) 1361 : cluster [DBG] pgmap v759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:56.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:56 gibba013 bash[29418]: cluster 2021-03-10T14:17:55.403418+0000 mgr.gibba020.yqfnwy (mgr.34427) 1361 : cluster [DBG] pgmap v759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:56.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:56 gibba013 bash[30381]: cluster 2021-03-10T14:17:55.403418+0000 mgr.gibba020.yqfnwy (mgr.34427) 1361 : cluster [DBG] pgmap v759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:57.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:57 gibba013 bash[29418]: audit 2021-03-10T14:17:55.979929+0000 mgr.gibba020.yqfnwy (mgr.34427) 1362 : audit [DBG] from='client.44970 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:17:57.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:57 gibba013 bash[29418]: audit 2021-03-10T14:17:56.202881+0000 mgr.gibba020.yqfnwy (mgr.34427) 1363 : audit [DBG] from='client.44976 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:17:57.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:57 gibba013 bash[29418]: audit 2021-03-10T14:17:56.465909+0000 mon.c (mon.1) 31 : audit [DBG] from='client.? 172.21.2.113:0/677904791' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:57.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:57 gibba013 bash[30381]: audit 2021-03-10T14:17:55.979929+0000 mgr.gibba020.yqfnwy (mgr.34427) 1362 : audit [DBG] from='client.44970 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:17:57.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:57 gibba013 bash[30381]: audit 2021-03-10T14:17:56.202881+0000 mgr.gibba020.yqfnwy (mgr.34427) 1363 : audit [DBG] from='client.44976 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:17:57.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:57 gibba013 bash[30381]: audit 2021-03-10T14:17:56.465909+0000 mon.c (mon.1) 31 : audit [DBG] from='client.? 172.21.2.113:0/677904791' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:57.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:57 gibba020 bash[25448]: audit 2021-03-10T14:17:55.979929+0000 mgr.gibba020.yqfnwy (mgr.34427) 1362 : audit [DBG] from='client.44970 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:17:57.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:57 gibba020 bash[25448]: audit 2021-03-10T14:17:56.202881+0000 mgr.gibba020.yqfnwy (mgr.34427) 1363 : audit [DBG] from='client.44976 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:17:57.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:57 gibba020 bash[25448]: audit 2021-03-10T14:17:56.465909+0000 mon.c (mon.1) 31 : audit [DBG] from='client.? 172.21.2.113:0/677904791' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:17:58.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:17:58 gibba013 bash[29418]: cluster 2021-03-10T14:17:57.404975+0000 mgr.gibba020.yqfnwy (mgr.34427) 1364 : cluster [DBG] pgmap v760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:58.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:17:58 gibba013 bash[30381]: cluster 2021-03-10T14:17:57.404975+0000 mgr.gibba020.yqfnwy (mgr.34427) 1364 : cluster [DBG] pgmap v760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:17:58.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:17:58 gibba020 bash[25448]: cluster 2021-03-10T14:17:57.404975+0000 mgr.gibba020.yqfnwy (mgr.34427) 1364 : cluster [DBG] pgmap v760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:00.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:00 gibba013 bash[29418]: cluster 2021-03-10T14:17:59.406383+0000 mgr.gibba020.yqfnwy (mgr.34427) 1365 : cluster [DBG] pgmap v761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:00.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:00 gibba013 bash[30381]: cluster 2021-03-10T14:17:59.406383+0000 mgr.gibba020.yqfnwy (mgr.34427) 1365 : cluster [DBG] pgmap v761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:00.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:00 gibba020 bash[25448]: cluster 2021-03-10T14:17:59.406383+0000 mgr.gibba020.yqfnwy (mgr.34427) 1365 : cluster [DBG] pgmap v761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:02.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:02 gibba013 bash[29418]: cluster 2021-03-10T14:18:01.408199+0000 mgr.gibba020.yqfnwy (mgr.34427) 1366 : cluster [DBG] pgmap v762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:02.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:02 gibba013 bash[30381]: cluster 2021-03-10T14:18:01.408199+0000 mgr.gibba020.yqfnwy (mgr.34427) 1366 : cluster [DBG] pgmap v762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:02.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:02 gibba020 bash[25448]: cluster 2021-03-10T14:18:01.408199+0000 mgr.gibba020.yqfnwy (mgr.34427) 1366 : cluster [DBG] pgmap v762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:04.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:04 gibba013 bash[29418]: cluster 2021-03-10T14:18:03.409600+0000 mgr.gibba020.yqfnwy (mgr.34427) 1367 : cluster [DBG] pgmap v763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:04.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:04 gibba013 bash[30381]: cluster 2021-03-10T14:18:03.409600+0000 mgr.gibba020.yqfnwy (mgr.34427) 1367 : cluster [DBG] pgmap v763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:04.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:04 gibba020 bash[25448]: cluster 2021-03-10T14:18:03.409600+0000 mgr.gibba020.yqfnwy (mgr.34427) 1367 : cluster [DBG] pgmap v763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:06 gibba020 bash[25448]: cluster 2021-03-10T14:18:05.410485+0000 mgr.gibba020.yqfnwy (mgr.34427) 1368 : cluster [DBG] pgmap v764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:06 gibba020 bash[25448]: audit 2021-03-10T14:18:05.961347+0000 mon.a (mon.0) 959 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T14:18:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:06 gibba020 bash[25448]: audit 2021-03-10T14:18:05.962147+0000 mon.a (mon.0) 960 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:18:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:06 gibba020 bash[25448]: audit 2021-03-10T14:18:05.962851+0000 mon.a (mon.0) 961 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:18:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:06 gibba020 bash[25448]: audit 2021-03-10T14:18:05.963504+0000 mon.a (mon.0) 962 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:18:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:06 gibba020 bash[25448]: audit 2021-03-10T14:18:06.089284+0000 mon.a (mon.0) 963 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:18:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:06 gibba020 bash[25448]: audit 2021-03-10T14:18:06.095747+0000 mon.a (mon.0) 964 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:18:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:06 gibba013 bash[29418]: cluster 2021-03-10T14:18:05.410485+0000 mgr.gibba020.yqfnwy (mgr.34427) 1368 : cluster [DBG] pgmap v764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:06 gibba013 bash[29418]: audit 2021-03-10T14:18:05.961347+0000 mon.a (mon.0) 959 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T14:18:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:06 gibba013 bash[29418]: audit 2021-03-10T14:18:05.962147+0000 mon.a (mon.0) 960 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:18:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:06 gibba013 bash[29418]: audit 2021-03-10T14:18:05.962851+0000 mon.a (mon.0) 961 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:18:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:06 gibba013 bash[29418]: audit 2021-03-10T14:18:05.963504+0000 mon.a (mon.0) 962 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:18:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:06 gibba013 bash[29418]: audit 2021-03-10T14:18:06.089284+0000 mon.a (mon.0) 963 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:18:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:06 gibba013 bash[29418]: audit 2021-03-10T14:18:06.095747+0000 mon.a (mon.0) 964 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:18:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:06 gibba013 bash[30381]: cluster 2021-03-10T14:18:05.410485+0000 mgr.gibba020.yqfnwy (mgr.34427) 1368 : cluster [DBG] pgmap v764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:06 gibba013 bash[30381]: audit 2021-03-10T14:18:05.961347+0000 mon.a (mon.0) 959 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T14:18:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:06 gibba013 bash[30381]: audit 2021-03-10T14:18:05.962147+0000 mon.a (mon.0) 960 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:18:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:06 gibba013 bash[30381]: audit 2021-03-10T14:18:05.962851+0000 mon.a (mon.0) 961 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:18:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:06 gibba013 bash[30381]: audit 2021-03-10T14:18:05.963504+0000 mon.a (mon.0) 962 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:18:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:06 gibba013 bash[30381]: audit 2021-03-10T14:18:06.089284+0000 mon.a (mon.0) 963 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:18:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:06 gibba013 bash[30381]: audit 2021-03-10T14:18:06.095747+0000 mon.a (mon.0) 964 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:18:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:08 gibba013 bash[29418]: cluster 2021-03-10T14:18:07.411790+0000 mgr.gibba020.yqfnwy (mgr.34427) 1369 : cluster [DBG] pgmap v765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:08.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:08 gibba013 bash[30381]: cluster 2021-03-10T14:18:07.411790+0000 mgr.gibba020.yqfnwy (mgr.34427) 1369 : cluster [DBG] pgmap v765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:08.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:08 gibba020 bash[25448]: cluster 2021-03-10T14:18:07.411790+0000 mgr.gibba020.yqfnwy (mgr.34427) 1369 : cluster [DBG] pgmap v765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:10.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:10 gibba013 bash[29418]: cephadm 2021-03-10T14:18:09.173046+0000 mgr.gibba020.yqfnwy (mgr.34427) 1370 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:18:10.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:10 gibba013 bash[29418]: cluster 2021-03-10T14:18:09.413347+0000 mgr.gibba020.yqfnwy (mgr.34427) 1371 : cluster [DBG] pgmap v766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:10.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:10 gibba013 bash[30381]: cephadm 2021-03-10T14:18:09.173046+0000 mgr.gibba020.yqfnwy (mgr.34427) 1370 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:18:10.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:10 gibba013 bash[30381]: cluster 2021-03-10T14:18:09.413347+0000 mgr.gibba020.yqfnwy (mgr.34427) 1371 : cluster [DBG] pgmap v766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:10.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:10 gibba020 bash[25448]: cephadm 2021-03-10T14:18:09.173046+0000 mgr.gibba020.yqfnwy (mgr.34427) 1370 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:18:10.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:10 gibba020 bash[25448]: cluster 2021-03-10T14:18:09.413347+0000 mgr.gibba020.yqfnwy (mgr.34427) 1371 : cluster [DBG] pgmap v766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:12.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:12 gibba013 bash[29418]: cluster 2021-03-10T14:18:11.415048+0000 mgr.gibba020.yqfnwy (mgr.34427) 1372 : cluster [DBG] pgmap v767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:12.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:12 gibba013 bash[30381]: cluster 2021-03-10T14:18:11.415048+0000 mgr.gibba020.yqfnwy (mgr.34427) 1372 : cluster [DBG] pgmap v767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:12.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:12 gibba020 bash[25448]: cluster 2021-03-10T14:18:11.415048+0000 mgr.gibba020.yqfnwy (mgr.34427) 1372 : cluster [DBG] pgmap v767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:14.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:14 gibba013 bash[29418]: cluster 2021-03-10T14:18:13.416506+0000 mgr.gibba020.yqfnwy (mgr.34427) 1373 : cluster [DBG] pgmap v768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:14.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:14 gibba013 bash[30381]: cluster 2021-03-10T14:18:13.416506+0000 mgr.gibba020.yqfnwy (mgr.34427) 1373 : cluster [DBG] pgmap v768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:14.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:14 gibba020 bash[25448]: cluster 2021-03-10T14:18:13.416506+0000 mgr.gibba020.yqfnwy (mgr.34427) 1373 : cluster [DBG] pgmap v768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:16.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:16 gibba020 bash[25448]: cluster 2021-03-10T14:18:15.417194+0000 mgr.gibba020.yqfnwy (mgr.34427) 1374 : cluster [DBG] pgmap v769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:16.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:16 gibba013 bash[29418]: cluster 2021-03-10T14:18:15.417194+0000 mgr.gibba020.yqfnwy (mgr.34427) 1374 : cluster [DBG] pgmap v769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:16.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:16 gibba013 bash[30381]: cluster 2021-03-10T14:18:15.417194+0000 mgr.gibba020.yqfnwy (mgr.34427) 1374 : cluster [DBG] pgmap v769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:18.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:18 gibba013 bash[29418]: cluster 2021-03-10T14:18:17.418370+0000 mgr.gibba020.yqfnwy (mgr.34427) 1375 : cluster [DBG] pgmap v770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:18.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:18 gibba013 bash[30381]: cluster 2021-03-10T14:18:17.418370+0000 mgr.gibba020.yqfnwy (mgr.34427) 1375 : cluster [DBG] pgmap v770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:18.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:18 gibba020 bash[25448]: cluster 2021-03-10T14:18:17.418370+0000 mgr.gibba020.yqfnwy (mgr.34427) 1375 : cluster [DBG] pgmap v770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:20.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:20 gibba013 bash[29418]: cluster 2021-03-10T14:18:19.419753+0000 mgr.gibba020.yqfnwy (mgr.34427) 1376 : cluster [DBG] pgmap v771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:20.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:20 gibba013 bash[30381]: cluster 2021-03-10T14:18:19.419753+0000 mgr.gibba020.yqfnwy (mgr.34427) 1376 : cluster [DBG] pgmap v771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:20.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:20 gibba020 bash[25448]: cluster 2021-03-10T14:18:19.419753+0000 mgr.gibba020.yqfnwy (mgr.34427) 1376 : cluster [DBG] pgmap v771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:22.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:22 gibba013 bash[29418]: cluster 2021-03-10T14:18:21.421487+0000 mgr.gibba020.yqfnwy (mgr.34427) 1377 : cluster [DBG] pgmap v772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:22.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:22 gibba013 bash[30381]: cluster 2021-03-10T14:18:21.421487+0000 mgr.gibba020.yqfnwy (mgr.34427) 1377 : cluster [DBG] pgmap v772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:22.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:22 gibba020 bash[25448]: cluster 2021-03-10T14:18:21.421487+0000 mgr.gibba020.yqfnwy (mgr.34427) 1377 : cluster [DBG] pgmap v772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:24.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:24 gibba013 bash[29418]: cluster 2021-03-10T14:18:23.423078+0000 mgr.gibba020.yqfnwy (mgr.34427) 1378 : cluster [DBG] pgmap v773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:24.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:24 gibba013 bash[30381]: cluster 2021-03-10T14:18:23.423078+0000 mgr.gibba020.yqfnwy (mgr.34427) 1378 : cluster [DBG] pgmap v773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:24.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:24 gibba020 bash[25448]: cluster 2021-03-10T14:18:23.423078+0000 mgr.gibba020.yqfnwy (mgr.34427) 1378 : cluster [DBG] pgmap v773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:25.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:25 gibba013 bash[29418]: cephadm 2021-03-10T14:18:24.189029+0000 mgr.gibba020.yqfnwy (mgr.34427) 1379 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:18:25.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:25 gibba013 bash[30381]: cephadm 2021-03-10T14:18:24.189029+0000 mgr.gibba020.yqfnwy (mgr.34427) 1379 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:18:25.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:25 gibba020 bash[25448]: cephadm 2021-03-10T14:18:24.189029+0000 mgr.gibba020.yqfnwy (mgr.34427) 1379 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:18:26.719 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:18:26.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:26 gibba013 bash[29418]: cluster 2021-03-10T14:18:25.424025+0000 mgr.gibba020.yqfnwy (mgr.34427) 1380 : cluster [DBG] pgmap v774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:26.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:26 gibba013 bash[30381]: cluster 2021-03-10T14:18:25.424025+0000 mgr.gibba020.yqfnwy (mgr.34427) 1380 : cluster [DBG] pgmap v774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:26.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:26 gibba020 bash[25448]: cluster 2021-03-10T14:18:25.424025+0000 mgr.gibba020.yqfnwy (mgr.34427) 1380 : cluster [DBG] pgmap v774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:26.977 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:18:26.977 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (24m) 48s ago 30m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:18:26.978 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (30m) 9m ago 30m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:18:26.978 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (25m) 9m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:18:26.978 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (25m) 9m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:18:26.978 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (24m) 48s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:18:26.979 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (24m) 48s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:18:26.979 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (24m) 9m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:18:26.979 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (24m) 48s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:18:26.979 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (30m) 48s ago 30m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:18:26.979 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (30m) 9m ago 30m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:18:26.980 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (23m) 48s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:18:26.980 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (22m) 48s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:18:26.980 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (22m) 48s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:18:26.980 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (21m) 48s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:18:26.980 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (21m) 9m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:18:26.981 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (21m) 9m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:18:26.981 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (20m) 9m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:18:26.981 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (20m) 9m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:18:26.981 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (29m) 9m ago 30m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:18:26.981 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 9m ago 28m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:18:27.225 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:18:27.226 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:18:27.226 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:18:27.226 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:18:27.226 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:18:27.226 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:18:27.227 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:18:27.227 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:18:27.227 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:18:27.227 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:18:27.228 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:18:27.228 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:18:27.228 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:18:27.228 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:18:27.228 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:18:27.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:27 gibba013 bash[29418]: audit 2021-03-10T14:18:26.707014+0000 mgr.gibba020.yqfnwy (mgr.34427) 1381 : audit [DBG] from='client.54973 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:18:27.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:27 gibba013 bash[29418]: audit 2021-03-10T14:18:27.223572+0000 mon.a (mon.0) 965 : audit [DBG] from='client.? 172.21.2.113:0/2262794757' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:27.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:27 gibba013 bash[30381]: audit 2021-03-10T14:18:26.707014+0000 mgr.gibba020.yqfnwy (mgr.34427) 1381 : audit [DBG] from='client.54973 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:18:27.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:27 gibba013 bash[30381]: audit 2021-03-10T14:18:27.223572+0000 mon.a (mon.0) 965 : audit [DBG] from='client.? 172.21.2.113:0/2262794757' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:27.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:27 gibba020 bash[25448]: audit 2021-03-10T14:18:26.707014+0000 mgr.gibba020.yqfnwy (mgr.34427) 1381 : audit [DBG] from='client.54973 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:18:27.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:27 gibba020 bash[25448]: audit 2021-03-10T14:18:27.223572+0000 mon.a (mon.0) 965 : audit [DBG] from='client.? 172.21.2.113:0/2262794757' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:28.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:28 gibba013 bash[29418]: audit 2021-03-10T14:18:26.933620+0000 mgr.gibba020.yqfnwy (mgr.34427) 1382 : audit [DBG] from='client.54979 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:18:28.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:28 gibba013 bash[29418]: cluster 2021-03-10T14:18:27.425458+0000 mgr.gibba020.yqfnwy (mgr.34427) 1383 : cluster [DBG] pgmap v775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:28.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:28 gibba013 bash[30381]: audit 2021-03-10T14:18:26.933620+0000 mgr.gibba020.yqfnwy (mgr.34427) 1382 : audit [DBG] from='client.54979 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:18:28.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:28 gibba013 bash[30381]: cluster 2021-03-10T14:18:27.425458+0000 mgr.gibba020.yqfnwy (mgr.34427) 1383 : cluster [DBG] pgmap v775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:28.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:28 gibba020 bash[25448]: audit 2021-03-10T14:18:26.933620+0000 mgr.gibba020.yqfnwy (mgr.34427) 1382 : audit [DBG] from='client.54979 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:18:28.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:28 gibba020 bash[25448]: cluster 2021-03-10T14:18:27.425458+0000 mgr.gibba020.yqfnwy (mgr.34427) 1383 : cluster [DBG] pgmap v775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:30.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:30 gibba013 bash[30381]: cluster 2021-03-10T14:18:29.426962+0000 mgr.gibba020.yqfnwy (mgr.34427) 1384 : cluster [DBG] pgmap v776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:30.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:30 gibba013 bash[29418]: cluster 2021-03-10T14:18:29.426962+0000 mgr.gibba020.yqfnwy (mgr.34427) 1384 : cluster [DBG] pgmap v776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:30.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:30 gibba020 bash[25448]: cluster 2021-03-10T14:18:29.426962+0000 mgr.gibba020.yqfnwy (mgr.34427) 1384 : cluster [DBG] pgmap v776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:32.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:32 gibba013 bash[30381]: cluster 2021-03-10T14:18:31.428855+0000 mgr.gibba020.yqfnwy (mgr.34427) 1385 : cluster [DBG] pgmap v777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:32.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:32 gibba013 bash[29418]: cluster 2021-03-10T14:18:31.428855+0000 mgr.gibba020.yqfnwy (mgr.34427) 1385 : cluster [DBG] pgmap v777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:32.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:32 gibba020 bash[25448]: cluster 2021-03-10T14:18:31.428855+0000 mgr.gibba020.yqfnwy (mgr.34427) 1385 : cluster [DBG] pgmap v777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:34.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:34 gibba013 bash[29418]: cluster 2021-03-10T14:18:33.430363+0000 mgr.gibba020.yqfnwy (mgr.34427) 1386 : cluster [DBG] pgmap v778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:34.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:34 gibba013 bash[30381]: cluster 2021-03-10T14:18:33.430363+0000 mgr.gibba020.yqfnwy (mgr.34427) 1386 : cluster [DBG] pgmap v778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:34.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:34 gibba020 bash[25448]: cluster 2021-03-10T14:18:33.430363+0000 mgr.gibba020.yqfnwy (mgr.34427) 1386 : cluster [DBG] pgmap v778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:36.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:36 gibba020 bash[25448]: cluster 2021-03-10T14:18:35.432006+0000 mgr.gibba020.yqfnwy (mgr.34427) 1387 : cluster [DBG] pgmap v779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:36.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:36 gibba013 bash[29418]: cluster 2021-03-10T14:18:35.432006+0000 mgr.gibba020.yqfnwy (mgr.34427) 1387 : cluster [DBG] pgmap v779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:36.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:36 gibba013 bash[30381]: cluster 2021-03-10T14:18:35.432006+0000 mgr.gibba020.yqfnwy (mgr.34427) 1387 : cluster [DBG] pgmap v779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:38.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:38 gibba013 bash[29418]: cluster 2021-03-10T14:18:37.433552+0000 mgr.gibba020.yqfnwy (mgr.34427) 1388 : cluster [DBG] pgmap v780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:38.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:38 gibba013 bash[30381]: cluster 2021-03-10T14:18:37.433552+0000 mgr.gibba020.yqfnwy (mgr.34427) 1388 : cluster [DBG] pgmap v780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:38.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:38 gibba020 bash[25448]: cluster 2021-03-10T14:18:37.433552+0000 mgr.gibba020.yqfnwy (mgr.34427) 1388 : cluster [DBG] pgmap v780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:39.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:39 gibba013 bash[29418]: audit 2021-03-10T14:18:39.207579+0000 mon.a (mon.0) 966 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:18:39.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:39 gibba013 bash[29418]: audit 2021-03-10T14:18:39.214956+0000 mon.a (mon.0) 967 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:18:39.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:39 gibba013 bash[30381]: audit 2021-03-10T14:18:39.207579+0000 mon.a (mon.0) 966 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:18:39.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:39 gibba013 bash[30381]: audit 2021-03-10T14:18:39.214956+0000 mon.a (mon.0) 967 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:18:39.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:39 gibba020 bash[25448]: audit 2021-03-10T14:18:39.207579+0000 mon.a (mon.0) 966 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:18:39.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:39 gibba020 bash[25448]: audit 2021-03-10T14:18:39.214956+0000 mon.a (mon.0) 967 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:18:40.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:40 gibba013 bash[29418]: cephadm 2021-03-10T14:18:39.211513+0000 mgr.gibba020.yqfnwy (mgr.34427) 1389 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:18:40.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:40 gibba013 bash[29418]: cluster 2021-03-10T14:18:39.434335+0000 mgr.gibba020.yqfnwy (mgr.34427) 1390 : cluster [DBG] pgmap v781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:40.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:40 gibba013 bash[30381]: cephadm 2021-03-10T14:18:39.211513+0000 mgr.gibba020.yqfnwy (mgr.34427) 1389 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:18:40.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:40 gibba013 bash[30381]: cluster 2021-03-10T14:18:39.434335+0000 mgr.gibba020.yqfnwy (mgr.34427) 1390 : cluster [DBG] pgmap v781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:40.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:40 gibba020 bash[25448]: cephadm 2021-03-10T14:18:39.211513+0000 mgr.gibba020.yqfnwy (mgr.34427) 1389 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:18:40.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:40 gibba020 bash[25448]: cluster 2021-03-10T14:18:39.434335+0000 mgr.gibba020.yqfnwy (mgr.34427) 1390 : cluster [DBG] pgmap v781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:42.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:42 gibba013 bash[29418]: cluster 2021-03-10T14:18:41.435768+0000 mgr.gibba020.yqfnwy (mgr.34427) 1391 : cluster [DBG] pgmap v782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:42.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:42 gibba013 bash[30381]: cluster 2021-03-10T14:18:41.435768+0000 mgr.gibba020.yqfnwy (mgr.34427) 1391 : cluster [DBG] pgmap v782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:42.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:42 gibba020 bash[25448]: cluster 2021-03-10T14:18:41.435768+0000 mgr.gibba020.yqfnwy (mgr.34427) 1391 : cluster [DBG] pgmap v782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:44.320 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:44 gibba020 bash[25448]: audit 2021-03-10T14:18:43.013162+0000 mon.a (mon.0) 968 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:18:44.320 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:44 gibba020 bash[25448]: audit 2021-03-10T14:18:43.014357+0000 mon.a (mon.0) 969 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T14:18:44.321 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:44 gibba020 bash[25448]: cluster 2021-03-10T14:18:43.437243+0000 mgr.gibba020.yqfnwy (mgr.34427) 1392 : cluster [DBG] pgmap v783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:44.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:44 gibba013 bash[29418]: audit 2021-03-10T14:18:43.013162+0000 mon.a (mon.0) 968 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:18:44.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:44 gibba013 bash[29418]: audit 2021-03-10T14:18:43.014357+0000 mon.a (mon.0) 969 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T14:18:44.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:44 gibba013 bash[29418]: cluster 2021-03-10T14:18:43.437243+0000 mgr.gibba020.yqfnwy (mgr.34427) 1392 : cluster [DBG] pgmap v783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:44.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:44 gibba013 bash[30381]: audit 2021-03-10T14:18:43.013162+0000 mon.a (mon.0) 968 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:18:44.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:44 gibba013 bash[30381]: audit 2021-03-10T14:18:43.014357+0000 mon.a (mon.0) 969 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T14:18:44.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:44 gibba013 bash[30381]: cluster 2021-03-10T14:18:43.437243+0000 mgr.gibba020.yqfnwy (mgr.34427) 1392 : cluster [DBG] pgmap v783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:46.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:46 gibba020 bash[25448]: cluster 2021-03-10T14:18:45.438714+0000 mgr.gibba020.yqfnwy (mgr.34427) 1393 : cluster [DBG] pgmap v784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:46.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:46 gibba013 bash[29418]: cluster 2021-03-10T14:18:45.438714+0000 mgr.gibba020.yqfnwy (mgr.34427) 1393 : cluster [DBG] pgmap v784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:46.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:46 gibba013 bash[30381]: cluster 2021-03-10T14:18:45.438714+0000 mgr.gibba020.yqfnwy (mgr.34427) 1393 : cluster [DBG] pgmap v784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:48.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:48 gibba013 bash[29418]: cluster 2021-03-10T14:18:47.440326+0000 mgr.gibba020.yqfnwy (mgr.34427) 1394 : cluster [DBG] pgmap v785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:48.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:48 gibba013 bash[29418]: audit 2021-03-10T14:18:47.817185+0000 mon.a (mon.0) 970 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:18:48.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:48 gibba013 bash[29418]: audit 2021-03-10T14:18:47.985142+0000 mon.a (mon.0) 971 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:18:48.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:48 gibba013 bash[29418]: audit 2021-03-10T14:18:48.181151+0000 mon.a (mon.0) 972 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:18:48.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:48 gibba013 bash[29418]: audit 2021-03-10T14:18:48.184729+0000 mon.a (mon.0) 973 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:18:48.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:48 gibba013 bash[29418]: audit 2021-03-10T14:18:48.186618+0000 mon.a (mon.0) 974 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:48.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:48 gibba013 bash[29418]: audit 2021-03-10T14:18:48.188168+0000 mon.a (mon.0) 975 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:48.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:48 gibba013 bash[29418]: audit 2021-03-10T14:18:48.189602+0000 mon.a (mon.0) 976 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:48.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:48 gibba013 bash[29418]: audit 2021-03-10T14:18:48.192823+0000 mon.a (mon.0) 977 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:48.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:48 gibba013 bash[29418]: audit 2021-03-10T14:18:48.194633+0000 mon.a (mon.0) 978 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:48.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:48 gibba013 bash[30381]: cluster 2021-03-10T14:18:47.440326+0000 mgr.gibba020.yqfnwy (mgr.34427) 1394 : cluster [DBG] pgmap v785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:48.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:48 gibba013 bash[30381]: audit 2021-03-10T14:18:47.817185+0000 mon.a (mon.0) 970 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:18:48.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:48 gibba013 bash[30381]: audit 2021-03-10T14:18:47.985142+0000 mon.a (mon.0) 971 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:18:48.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:48 gibba013 bash[30381]: audit 2021-03-10T14:18:48.181151+0000 mon.a (mon.0) 972 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:18:48.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:48 gibba013 bash[30381]: audit 2021-03-10T14:18:48.184729+0000 mon.a (mon.0) 973 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:18:48.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:48 gibba013 bash[30381]: audit 2021-03-10T14:18:48.186618+0000 mon.a (mon.0) 974 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:48.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:48 gibba013 bash[30381]: audit 2021-03-10T14:18:48.188168+0000 mon.a (mon.0) 975 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:48.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:48 gibba013 bash[30381]: audit 2021-03-10T14:18:48.189602+0000 mon.a (mon.0) 976 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:48.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:48 gibba013 bash[30381]: audit 2021-03-10T14:18:48.192823+0000 mon.a (mon.0) 977 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:48.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:48 gibba013 bash[30381]: audit 2021-03-10T14:18:48.194633+0000 mon.a (mon.0) 978 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:48.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:48 gibba020 bash[25448]: cluster 2021-03-10T14:18:47.440326+0000 mgr.gibba020.yqfnwy (mgr.34427) 1394 : cluster [DBG] pgmap v785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:48.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:48 gibba020 bash[25448]: audit 2021-03-10T14:18:47.817185+0000 mon.a (mon.0) 970 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:18:48.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:48 gibba020 bash[25448]: audit 2021-03-10T14:18:47.985142+0000 mon.a (mon.0) 971 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:18:48.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:48 gibba020 bash[25448]: audit 2021-03-10T14:18:48.181151+0000 mon.a (mon.0) 972 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:18:48.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:48 gibba020 bash[25448]: audit 2021-03-10T14:18:48.184729+0000 mon.a (mon.0) 973 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:18:48.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:48 gibba020 bash[25448]: audit 2021-03-10T14:18:48.186618+0000 mon.a (mon.0) 974 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:48.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:48 gibba020 bash[25448]: audit 2021-03-10T14:18:48.188168+0000 mon.a (mon.0) 975 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:48.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:48 gibba020 bash[25448]: audit 2021-03-10T14:18:48.189602+0000 mon.a (mon.0) 976 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:48.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:48 gibba020 bash[25448]: audit 2021-03-10T14:18:48.192823+0000 mon.a (mon.0) 977 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:48.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:48 gibba020 bash[25448]: audit 2021-03-10T14:18:48.194633+0000 mon.a (mon.0) 978 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:49.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:49 gibba013 bash[29418]: cephadm 2021-03-10T14:18:47.984298+0000 mgr.gibba020.yqfnwy (mgr.34427) 1395 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:18:49.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:49 gibba013 bash[29418]: cephadm 2021-03-10T14:18:48.182076+0000 mgr.gibba020.yqfnwy (mgr.34427) 1396 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:18:49.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:49 gibba013 bash[29418]: cephadm 2021-03-10T14:18:48.184527+0000 mgr.gibba020.yqfnwy (mgr.34427) 1397 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:18:49.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:49 gibba013 bash[29418]: cephadm 2021-03-10T14:18:48.186027+0000 mgr.gibba020.yqfnwy (mgr.34427) 1398 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:18:49.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:49 gibba013 bash[29418]: cephadm 2021-03-10T14:18:48.186065+0000 mgr.gibba020.yqfnwy (mgr.34427) 1399 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:18:49.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:49 gibba013 bash[29418]: cephadm 2021-03-10T14:18:48.187545+0000 mgr.gibba020.yqfnwy (mgr.34427) 1400 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:18:49.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:49 gibba013 bash[29418]: cephadm 2021-03-10T14:18:48.187581+0000 mgr.gibba020.yqfnwy (mgr.34427) 1401 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:18:49.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:49 gibba013 bash[29418]: cephadm 2021-03-10T14:18:48.189119+0000 mgr.gibba020.yqfnwy (mgr.34427) 1402 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:18:49.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:49 gibba013 bash[29418]: cephadm 2021-03-10T14:18:48.190646+0000 mgr.gibba020.yqfnwy (mgr.34427) 1403 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:18:49.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:49 gibba013 bash[29418]: cephadm 2021-03-10T14:18:48.190683+0000 mgr.gibba020.yqfnwy (mgr.34427) 1404 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:18:49.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:49 gibba013 bash[29418]: cephadm 2021-03-10T14:18:48.192299+0000 mgr.gibba020.yqfnwy (mgr.34427) 1405 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:18:49.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:49 gibba013 bash[29418]: cephadm 2021-03-10T14:18:48.192625+0000 mgr.gibba020.yqfnwy (mgr.34427) 1406 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:18:49.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:49 gibba013 bash[29418]: cephadm 2021-03-10T14:18:48.194199+0000 mgr.gibba020.yqfnwy (mgr.34427) 1407 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:18:49.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:49 gibba013 bash[29418]: cephadm 2021-03-10T14:18:48.194237+0000 mgr.gibba020.yqfnwy (mgr.34427) 1408 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:18:49.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:49 gibba013 bash[29418]: cephadm 2021-03-10T14:18:48.194344+0000 mgr.gibba020.yqfnwy (mgr.34427) 1409 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:18:49.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:49 gibba013 bash[30381]: cephadm 2021-03-10T14:18:47.984298+0000 mgr.gibba020.yqfnwy (mgr.34427) 1395 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:18:49.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:49 gibba013 bash[30381]: cephadm 2021-03-10T14:18:48.182076+0000 mgr.gibba020.yqfnwy (mgr.34427) 1396 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:18:49.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:49 gibba013 bash[30381]: cephadm 2021-03-10T14:18:48.184527+0000 mgr.gibba020.yqfnwy (mgr.34427) 1397 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:18:49.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:49 gibba013 bash[30381]: cephadm 2021-03-10T14:18:48.186027+0000 mgr.gibba020.yqfnwy (mgr.34427) 1398 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:18:49.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:49 gibba013 bash[30381]: cephadm 2021-03-10T14:18:48.186065+0000 mgr.gibba020.yqfnwy (mgr.34427) 1399 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:18:49.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:49 gibba013 bash[30381]: cephadm 2021-03-10T14:18:48.187545+0000 mgr.gibba020.yqfnwy (mgr.34427) 1400 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:18:49.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:49 gibba013 bash[30381]: cephadm 2021-03-10T14:18:48.187581+0000 mgr.gibba020.yqfnwy (mgr.34427) 1401 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:18:49.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:49 gibba013 bash[30381]: cephadm 2021-03-10T14:18:48.189119+0000 mgr.gibba020.yqfnwy (mgr.34427) 1402 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:18:49.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:49 gibba013 bash[30381]: cephadm 2021-03-10T14:18:48.190646+0000 mgr.gibba020.yqfnwy (mgr.34427) 1403 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:18:49.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:49 gibba013 bash[30381]: cephadm 2021-03-10T14:18:48.190683+0000 mgr.gibba020.yqfnwy (mgr.34427) 1404 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:18:49.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:49 gibba013 bash[30381]: cephadm 2021-03-10T14:18:48.192299+0000 mgr.gibba020.yqfnwy (mgr.34427) 1405 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:18:49.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:49 gibba013 bash[30381]: cephadm 2021-03-10T14:18:48.192625+0000 mgr.gibba020.yqfnwy (mgr.34427) 1406 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:18:49.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:49 gibba013 bash[30381]: cephadm 2021-03-10T14:18:48.194199+0000 mgr.gibba020.yqfnwy (mgr.34427) 1407 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:18:49.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:49 gibba013 bash[30381]: cephadm 2021-03-10T14:18:48.194237+0000 mgr.gibba020.yqfnwy (mgr.34427) 1408 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:18:49.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:49 gibba013 bash[30381]: cephadm 2021-03-10T14:18:48.194344+0000 mgr.gibba020.yqfnwy (mgr.34427) 1409 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:18:49.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:49 gibba020 bash[25448]: cephadm 2021-03-10T14:18:47.984298+0000 mgr.gibba020.yqfnwy (mgr.34427) 1395 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:18:49.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:49 gibba020 bash[25448]: cephadm 2021-03-10T14:18:48.182076+0000 mgr.gibba020.yqfnwy (mgr.34427) 1396 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:18:49.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:49 gibba020 bash[25448]: cephadm 2021-03-10T14:18:48.184527+0000 mgr.gibba020.yqfnwy (mgr.34427) 1397 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:18:49.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:49 gibba020 bash[25448]: cephadm 2021-03-10T14:18:48.186027+0000 mgr.gibba020.yqfnwy (mgr.34427) 1398 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:18:49.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:49 gibba020 bash[25448]: cephadm 2021-03-10T14:18:48.186065+0000 mgr.gibba020.yqfnwy (mgr.34427) 1399 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:18:49.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:49 gibba020 bash[25448]: cephadm 2021-03-10T14:18:48.187545+0000 mgr.gibba020.yqfnwy (mgr.34427) 1400 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:18:49.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:49 gibba020 bash[25448]: cephadm 2021-03-10T14:18:48.187581+0000 mgr.gibba020.yqfnwy (mgr.34427) 1401 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:18:49.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:49 gibba020 bash[25448]: cephadm 2021-03-10T14:18:48.189119+0000 mgr.gibba020.yqfnwy (mgr.34427) 1402 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:18:49.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:49 gibba020 bash[25448]: cephadm 2021-03-10T14:18:48.190646+0000 mgr.gibba020.yqfnwy (mgr.34427) 1403 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:18:49.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:49 gibba020 bash[25448]: cephadm 2021-03-10T14:18:48.190683+0000 mgr.gibba020.yqfnwy (mgr.34427) 1404 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:18:49.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:49 gibba020 bash[25448]: cephadm 2021-03-10T14:18:48.192299+0000 mgr.gibba020.yqfnwy (mgr.34427) 1405 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:18:49.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:49 gibba020 bash[25448]: cephadm 2021-03-10T14:18:48.192625+0000 mgr.gibba020.yqfnwy (mgr.34427) 1406 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:18:49.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:49 gibba020 bash[25448]: cephadm 2021-03-10T14:18:48.194199+0000 mgr.gibba020.yqfnwy (mgr.34427) 1407 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:18:49.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:49 gibba020 bash[25448]: cephadm 2021-03-10T14:18:48.194237+0000 mgr.gibba020.yqfnwy (mgr.34427) 1408 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:18:49.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:49 gibba020 bash[25448]: cephadm 2021-03-10T14:18:48.194344+0000 mgr.gibba020.yqfnwy (mgr.34427) 1409 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:18:50.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:50 gibba013 bash[29418]: cluster 2021-03-10T14:18:49.441801+0000 mgr.gibba020.yqfnwy (mgr.34427) 1410 : cluster [DBG] pgmap v786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:50.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:50 gibba013 bash[30381]: cluster 2021-03-10T14:18:49.441801+0000 mgr.gibba020.yqfnwy (mgr.34427) 1410 : cluster [DBG] pgmap v786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:50.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:50 gibba020 bash[25448]: cluster 2021-03-10T14:18:49.441801+0000 mgr.gibba020.yqfnwy (mgr.34427) 1410 : cluster [DBG] pgmap v786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:52.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:52 gibba013 bash[29418]: cluster 2021-03-10T14:18:51.443702+0000 mgr.gibba020.yqfnwy (mgr.34427) 1411 : cluster [DBG] pgmap v787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:52.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:52 gibba013 bash[30381]: cluster 2021-03-10T14:18:51.443702+0000 mgr.gibba020.yqfnwy (mgr.34427) 1411 : cluster [DBG] pgmap v787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:52.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:52 gibba020 bash[25448]: cluster 2021-03-10T14:18:51.443702+0000 mgr.gibba020.yqfnwy (mgr.34427) 1411 : cluster [DBG] pgmap v787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:54.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:54 gibba013 bash[29418]: cluster 2021-03-10T14:18:53.445313+0000 mgr.gibba020.yqfnwy (mgr.34427) 1412 : cluster [DBG] pgmap v788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:54.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:54 gibba013 bash[30381]: cluster 2021-03-10T14:18:53.445313+0000 mgr.gibba020.yqfnwy (mgr.34427) 1412 : cluster [DBG] pgmap v788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:54.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:54 gibba020 bash[25448]: cluster 2021-03-10T14:18:53.445313+0000 mgr.gibba020.yqfnwy (mgr.34427) 1412 : cluster [DBG] pgmap v788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:56.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:56 gibba020 bash[25448]: cluster 2021-03-10T14:18:55.446054+0000 mgr.gibba020.yqfnwy (mgr.34427) 1413 : cluster [DBG] pgmap v789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:56.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:56 gibba013 bash[29418]: cluster 2021-03-10T14:18:55.446054+0000 mgr.gibba020.yqfnwy (mgr.34427) 1413 : cluster [DBG] pgmap v789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:56.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:56 gibba013 bash[30381]: cluster 2021-03-10T14:18:55.446054+0000 mgr.gibba020.yqfnwy (mgr.34427) 1413 : cluster [DBG] pgmap v789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:57.468 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:18:57.695 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:18:57.696 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (25m) 78s ago 30m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:18:57.696 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (30m) 14s ago 30m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:18:57.697 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (25m) 14s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:18:57.697 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (26m) 14s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:18:57.698 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (25m) 78s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:18:57.698 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (24m) 78s ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:18:57.699 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (24m) 14s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:18:57.699 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (24m) 78s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:18:57.700 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (30m) 78s ago 31m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:18:57.700 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (30m) 14s ago 31m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:18:57.700 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (23m) 78s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:18:57.701 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (23m) 78s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:18:57.701 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (22m) 78s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:18:57.702 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (22m) 78s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:18:57.702 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (22m) 14s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:18:57.703 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (21m) 14s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:18:57.703 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (21m) 14s ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:18:57.704 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (20m) 14s ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:18:57.704 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (30m) 14s ago 31m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:18:57.704 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 14s ago 28m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:18:57.945 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:18:57.946 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:18:57.946 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:18:57.947 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:18:57.947 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:18:57.948 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:18:57.948 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:18:57.949 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:18:57.949 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:18:57.949 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:18:57.950 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:18:57.950 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:18:57.951 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:18:57.951 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:18:57.952 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:18:58.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:58 gibba013 bash[29418]: cluster 2021-03-10T14:18:57.447411+0000 mgr.gibba020.yqfnwy (mgr.34427) 1414 : cluster [DBG] pgmap v790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:58.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:58 gibba013 bash[29418]: audit 2021-03-10T14:18:57.456100+0000 mgr.gibba020.yqfnwy (mgr.34427) 1415 : audit [DBG] from='client.45006 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:18:58.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:58 gibba013 bash[29418]: audit 2021-03-10T14:18:57.679881+0000 mgr.gibba020.yqfnwy (mgr.34427) 1416 : audit [DBG] from='client.45012 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:18:58.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:18:58 gibba013 bash[29418]: audit 2021-03-10T14:18:57.943697+0000 mon.c (mon.1) 32 : audit [DBG] from='client.? 172.21.2.113:0/1868142627' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:58.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:58 gibba013 bash[30381]: cluster 2021-03-10T14:18:57.447411+0000 mgr.gibba020.yqfnwy (mgr.34427) 1414 : cluster [DBG] pgmap v790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:58.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:58 gibba013 bash[30381]: audit 2021-03-10T14:18:57.456100+0000 mgr.gibba020.yqfnwy (mgr.34427) 1415 : audit [DBG] from='client.45006 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:18:58.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:58 gibba013 bash[30381]: audit 2021-03-10T14:18:57.679881+0000 mgr.gibba020.yqfnwy (mgr.34427) 1416 : audit [DBG] from='client.45012 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:18:58.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:18:58 gibba013 bash[30381]: audit 2021-03-10T14:18:57.943697+0000 mon.c (mon.1) 32 : audit [DBG] from='client.? 172.21.2.113:0/1868142627' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:18:58.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:58 gibba020 bash[25448]: cluster 2021-03-10T14:18:57.447411+0000 mgr.gibba020.yqfnwy (mgr.34427) 1414 : cluster [DBG] pgmap v790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:18:58.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:58 gibba020 bash[25448]: audit 2021-03-10T14:18:57.456100+0000 mgr.gibba020.yqfnwy (mgr.34427) 1415 : audit [DBG] from='client.45006 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:18:58.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:58 gibba020 bash[25448]: audit 2021-03-10T14:18:57.679881+0000 mgr.gibba020.yqfnwy (mgr.34427) 1416 : audit [DBG] from='client.45012 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:18:58.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:18:58 gibba020 bash[25448]: audit 2021-03-10T14:18:57.943697+0000 mon.c (mon.1) 32 : audit [DBG] from='client.? 172.21.2.113:0/1868142627' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:00.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:00 gibba013 bash[29418]: cluster 2021-03-10T14:18:59.448837+0000 mgr.gibba020.yqfnwy (mgr.34427) 1417 : cluster [DBG] pgmap v791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:00.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:00 gibba013 bash[30381]: cluster 2021-03-10T14:18:59.448837+0000 mgr.gibba020.yqfnwy (mgr.34427) 1417 : cluster [DBG] pgmap v791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:00.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:00 gibba020 bash[25448]: cluster 2021-03-10T14:18:59.448837+0000 mgr.gibba020.yqfnwy (mgr.34427) 1417 : cluster [DBG] pgmap v791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:02.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:02 gibba013 bash[29418]: cluster 2021-03-10T14:19:01.450675+0000 mgr.gibba020.yqfnwy (mgr.34427) 1418 : cluster [DBG] pgmap v792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:02.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:02 gibba013 bash[30381]: cluster 2021-03-10T14:19:01.450675+0000 mgr.gibba020.yqfnwy (mgr.34427) 1418 : cluster [DBG] pgmap v792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:02.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:02 gibba020 bash[25448]: cluster 2021-03-10T14:19:01.450675+0000 mgr.gibba020.yqfnwy (mgr.34427) 1418 : cluster [DBG] pgmap v792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:04.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:04 gibba013 bash[29418]: cephadm 2021-03-10T14:19:03.209027+0000 mgr.gibba020.yqfnwy (mgr.34427) 1419 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:19:04.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:04 gibba013 bash[29418]: cluster 2021-03-10T14:19:03.452203+0000 mgr.gibba020.yqfnwy (mgr.34427) 1420 : cluster [DBG] pgmap v793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:04.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:04 gibba013 bash[30381]: cephadm 2021-03-10T14:19:03.209027+0000 mgr.gibba020.yqfnwy (mgr.34427) 1419 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:19:04.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:04 gibba013 bash[30381]: cluster 2021-03-10T14:19:03.452203+0000 mgr.gibba020.yqfnwy (mgr.34427) 1420 : cluster [DBG] pgmap v793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:04.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:04 gibba020 bash[25448]: cephadm 2021-03-10T14:19:03.209027+0000 mgr.gibba020.yqfnwy (mgr.34427) 1419 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:19:04.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:04 gibba020 bash[25448]: cluster 2021-03-10T14:19:03.452203+0000 mgr.gibba020.yqfnwy (mgr.34427) 1420 : cluster [DBG] pgmap v793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:06 gibba020 bash[25448]: cluster 2021-03-10T14:19:05.453207+0000 mgr.gibba020.yqfnwy (mgr.34427) 1421 : cluster [DBG] pgmap v794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:06 gibba020 bash[25448]: audit 2021-03-10T14:19:05.972024+0000 mon.a (mon.0) 979 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T14:19:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:06 gibba020 bash[25448]: audit 2021-03-10T14:19:05.972757+0000 mon.a (mon.0) 980 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:19:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:06 gibba020 bash[25448]: audit 2021-03-10T14:19:05.973406+0000 mon.a (mon.0) 981 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:19:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:06 gibba020 bash[25448]: audit 2021-03-10T14:19:05.974107+0000 mon.a (mon.0) 982 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:19:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:06 gibba020 bash[25448]: audit 2021-03-10T14:19:06.096155+0000 mon.a (mon.0) 983 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:19:06.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:06 gibba020 bash[25448]: audit 2021-03-10T14:19:06.102756+0000 mon.a (mon.0) 984 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:19:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:06 gibba013 bash[29418]: cluster 2021-03-10T14:19:05.453207+0000 mgr.gibba020.yqfnwy (mgr.34427) 1421 : cluster [DBG] pgmap v794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:06 gibba013 bash[29418]: audit 2021-03-10T14:19:05.972024+0000 mon.a (mon.0) 979 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T14:19:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:06 gibba013 bash[29418]: audit 2021-03-10T14:19:05.972757+0000 mon.a (mon.0) 980 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:19:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:06 gibba013 bash[29418]: audit 2021-03-10T14:19:05.973406+0000 mon.a (mon.0) 981 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:19:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:06 gibba013 bash[29418]: audit 2021-03-10T14:19:05.974107+0000 mon.a (mon.0) 982 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:19:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:06 gibba013 bash[29418]: audit 2021-03-10T14:19:06.096155+0000 mon.a (mon.0) 983 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:19:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:06 gibba013 bash[29418]: audit 2021-03-10T14:19:06.102756+0000 mon.a (mon.0) 984 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:19:06.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:06 gibba013 bash[30381]: cluster 2021-03-10T14:19:05.453207+0000 mgr.gibba020.yqfnwy (mgr.34427) 1421 : cluster [DBG] pgmap v794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:06 gibba013 bash[30381]: audit 2021-03-10T14:19:05.972024+0000 mon.a (mon.0) 979 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T14:19:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:06 gibba013 bash[30381]: audit 2021-03-10T14:19:05.972757+0000 mon.a (mon.0) 980 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:19:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:06 gibba013 bash[30381]: audit 2021-03-10T14:19:05.973406+0000 mon.a (mon.0) 981 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:19:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:06 gibba013 bash[30381]: audit 2021-03-10T14:19:05.974107+0000 mon.a (mon.0) 982 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:19:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:06 gibba013 bash[30381]: audit 2021-03-10T14:19:06.096155+0000 mon.a (mon.0) 983 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:19:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:06 gibba013 bash[30381]: audit 2021-03-10T14:19:06.102756+0000 mon.a (mon.0) 984 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:19:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:08 gibba013 bash[29418]: cluster 2021-03-10T14:19:07.454652+0000 mgr.gibba020.yqfnwy (mgr.34427) 1422 : cluster [DBG] pgmap v795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:08.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:08 gibba013 bash[30381]: cluster 2021-03-10T14:19:07.454652+0000 mgr.gibba020.yqfnwy (mgr.34427) 1422 : cluster [DBG] pgmap v795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:08.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:08 gibba020 bash[25448]: cluster 2021-03-10T14:19:07.454652+0000 mgr.gibba020.yqfnwy (mgr.34427) 1422 : cluster [DBG] pgmap v795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:10.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:10 gibba013 bash[29418]: cluster 2021-03-10T14:19:09.455921+0000 mgr.gibba020.yqfnwy (mgr.34427) 1423 : cluster [DBG] pgmap v796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:10.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:10 gibba013 bash[30381]: cluster 2021-03-10T14:19:09.455921+0000 mgr.gibba020.yqfnwy (mgr.34427) 1423 : cluster [DBG] pgmap v796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:10.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:10 gibba020 bash[25448]: cluster 2021-03-10T14:19:09.455921+0000 mgr.gibba020.yqfnwy (mgr.34427) 1423 : cluster [DBG] pgmap v796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:12.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:12 gibba013 bash[29418]: cluster 2021-03-10T14:19:11.457634+0000 mgr.gibba020.yqfnwy (mgr.34427) 1424 : cluster [DBG] pgmap v797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:12.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:12 gibba013 bash[30381]: cluster 2021-03-10T14:19:11.457634+0000 mgr.gibba020.yqfnwy (mgr.34427) 1424 : cluster [DBG] pgmap v797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:12.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:12 gibba020 bash[25448]: cluster 2021-03-10T14:19:11.457634+0000 mgr.gibba020.yqfnwy (mgr.34427) 1424 : cluster [DBG] pgmap v797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:14.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:14 gibba013 bash[29418]: cluster 2021-03-10T14:19:13.459043+0000 mgr.gibba020.yqfnwy (mgr.34427) 1425 : cluster [DBG] pgmap v798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:14.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:14 gibba013 bash[30381]: cluster 2021-03-10T14:19:13.459043+0000 mgr.gibba020.yqfnwy (mgr.34427) 1425 : cluster [DBG] pgmap v798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:14.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:14 gibba020 bash[25448]: cluster 2021-03-10T14:19:13.459043+0000 mgr.gibba020.yqfnwy (mgr.34427) 1425 : cluster [DBG] pgmap v798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:16.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:16 gibba020 bash[25448]: cluster 2021-03-10T14:19:15.460006+0000 mgr.gibba020.yqfnwy (mgr.34427) 1426 : cluster [DBG] pgmap v799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:16.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:16 gibba013 bash[29418]: cluster 2021-03-10T14:19:15.460006+0000 mgr.gibba020.yqfnwy (mgr.34427) 1426 : cluster [DBG] pgmap v799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:16.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:16 gibba013 bash[30381]: cluster 2021-03-10T14:19:15.460006+0000 mgr.gibba020.yqfnwy (mgr.34427) 1426 : cluster [DBG] pgmap v799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:18.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:18 gibba013 bash[29418]: cluster 2021-03-10T14:19:17.461443+0000 mgr.gibba020.yqfnwy (mgr.34427) 1427 : cluster [DBG] pgmap v800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:18.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:18 gibba013 bash[30381]: cluster 2021-03-10T14:19:17.461443+0000 mgr.gibba020.yqfnwy (mgr.34427) 1427 : cluster [DBG] pgmap v800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:18.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:18 gibba020 bash[25448]: cluster 2021-03-10T14:19:17.461443+0000 mgr.gibba020.yqfnwy (mgr.34427) 1427 : cluster [DBG] pgmap v800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:19.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:19 gibba013 bash[29418]: cephadm 2021-03-10T14:19:18.224736+0000 mgr.gibba020.yqfnwy (mgr.34427) 1428 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:19:19.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:19 gibba013 bash[30381]: cephadm 2021-03-10T14:19:18.224736+0000 mgr.gibba020.yqfnwy (mgr.34427) 1428 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:19:19.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:19 gibba020 bash[25448]: cephadm 2021-03-10T14:19:18.224736+0000 mgr.gibba020.yqfnwy (mgr.34427) 1428 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:19:20.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:20 gibba013 bash[29418]: cluster 2021-03-10T14:19:19.462982+0000 mgr.gibba020.yqfnwy (mgr.34427) 1429 : cluster [DBG] pgmap v801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:20.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:20 gibba013 bash[30381]: cluster 2021-03-10T14:19:19.462982+0000 mgr.gibba020.yqfnwy (mgr.34427) 1429 : cluster [DBG] pgmap v801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:20.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:20 gibba020 bash[25448]: cluster 2021-03-10T14:19:19.462982+0000 mgr.gibba020.yqfnwy (mgr.34427) 1429 : cluster [DBG] pgmap v801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:22.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:22 gibba013 bash[29418]: cluster 2021-03-10T14:19:21.464885+0000 mgr.gibba020.yqfnwy (mgr.34427) 1430 : cluster [DBG] pgmap v802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:22.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:22 gibba013 bash[30381]: cluster 2021-03-10T14:19:21.464885+0000 mgr.gibba020.yqfnwy (mgr.34427) 1430 : cluster [DBG] pgmap v802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:22.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:22 gibba020 bash[25448]: cluster 2021-03-10T14:19:21.464885+0000 mgr.gibba020.yqfnwy (mgr.34427) 1430 : cluster [DBG] pgmap v802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:24.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:24 gibba013 bash[29418]: cluster 2021-03-10T14:19:23.466250+0000 mgr.gibba020.yqfnwy (mgr.34427) 1431 : cluster [DBG] pgmap v803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:24.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:24 gibba013 bash[30381]: cluster 2021-03-10T14:19:23.466250+0000 mgr.gibba020.yqfnwy (mgr.34427) 1431 : cluster [DBG] pgmap v803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:24.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:24 gibba020 bash[25448]: cluster 2021-03-10T14:19:23.466250+0000 mgr.gibba020.yqfnwy (mgr.34427) 1431 : cluster [DBG] pgmap v803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:26.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:26 gibba020 bash[25448]: cluster 2021-03-10T14:19:25.467078+0000 mgr.gibba020.yqfnwy (mgr.34427) 1432 : cluster [DBG] pgmap v804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:26.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:26 gibba013 bash[29418]: cluster 2021-03-10T14:19:25.467078+0000 mgr.gibba020.yqfnwy (mgr.34427) 1432 : cluster [DBG] pgmap v804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:26.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:26 gibba013 bash[30381]: cluster 2021-03-10T14:19:25.467078+0000 mgr.gibba020.yqfnwy (mgr.34427) 1432 : cluster [DBG] pgmap v804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:28.190 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:19:28.419 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:19:28.419 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (25m) 109s ago 31m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:19:28.419 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (31m) 45s ago 31m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:19:28.419 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (26m) 45s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:19:28.420 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (26m) 45s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:19:28.420 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (25m) 109s ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:19:28.420 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (25m) 109s ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:19:28.420 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (25m) 45s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:19:28.420 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (25m) 109s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:19:28.421 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (31m) 109s ago 31m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:19:28.421 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (31m) 45s ago 31m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:19:28.421 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (24m) 109s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:19:28.421 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (23m) 109s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:19:28.422 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (23m) 109s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:19:28.422 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (22m) 109s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:19:28.422 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (22m) 45s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:19:28.422 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (22m) 45s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:19:28.423 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (21m) 45s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:19:28.423 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (21m) 45s ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:19:28.423 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (30m) 45s ago 31m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:19:28.423 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 45s ago 29m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:19:28.669 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:19:28.670 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:19:28.670 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:19:28.670 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:19:28.671 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:19:28.671 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:19:28.671 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:19:28.671 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:19:28.671 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:19:28.672 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:19:28.672 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:19:28.672 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:19:28.672 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:19:28.672 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:19:28.673 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:19:28.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:28 gibba013 bash[29418]: cluster 2021-03-10T14:19:27.468436+0000 mgr.gibba020.yqfnwy (mgr.34427) 1433 : cluster [DBG] pgmap v805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:28.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:28 gibba013 bash[30381]: cluster 2021-03-10T14:19:27.468436+0000 mgr.gibba020.yqfnwy (mgr.34427) 1433 : cluster [DBG] pgmap v805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:28.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:28 gibba020 bash[25448]: cluster 2021-03-10T14:19:27.468436+0000 mgr.gibba020.yqfnwy (mgr.34427) 1433 : cluster [DBG] pgmap v805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:29.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:29 gibba013 bash[29418]: audit 2021-03-10T14:19:28.178322+0000 mgr.gibba020.yqfnwy (mgr.34427) 1434 : audit [DBG] from='client.55009 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:19:29.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:29 gibba013 bash[29418]: audit 2021-03-10T14:19:28.403397+0000 mgr.gibba020.yqfnwy (mgr.34427) 1435 : audit [DBG] from='client.45030 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:19:29.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:29 gibba013 bash[29418]: audit 2021-03-10T14:19:28.668119+0000 mon.a (mon.0) 985 : audit [DBG] from='client.? 172.21.2.113:0/2294026633' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:29.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:29 gibba013 bash[30381]: audit 2021-03-10T14:19:28.178322+0000 mgr.gibba020.yqfnwy (mgr.34427) 1434 : audit [DBG] from='client.55009 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:19:29.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:29 gibba013 bash[30381]: audit 2021-03-10T14:19:28.403397+0000 mgr.gibba020.yqfnwy (mgr.34427) 1435 : audit [DBG] from='client.45030 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:19:29.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:29 gibba013 bash[30381]: audit 2021-03-10T14:19:28.668119+0000 mon.a (mon.0) 985 : audit [DBG] from='client.? 172.21.2.113:0/2294026633' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:29.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:29 gibba020 bash[25448]: audit 2021-03-10T14:19:28.178322+0000 mgr.gibba020.yqfnwy (mgr.34427) 1434 : audit [DBG] from='client.55009 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:19:29.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:29 gibba020 bash[25448]: audit 2021-03-10T14:19:28.403397+0000 mgr.gibba020.yqfnwy (mgr.34427) 1435 : audit [DBG] from='client.45030 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:19:29.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:29 gibba020 bash[25448]: audit 2021-03-10T14:19:28.668119+0000 mon.a (mon.0) 985 : audit [DBG] from='client.? 172.21.2.113:0/2294026633' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:30.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:30 gibba013 bash[29418]: cluster 2021-03-10T14:19:29.469911+0000 mgr.gibba020.yqfnwy (mgr.34427) 1436 : cluster [DBG] pgmap v806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:30.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:30 gibba013 bash[30381]: cluster 2021-03-10T14:19:29.469911+0000 mgr.gibba020.yqfnwy (mgr.34427) 1436 : cluster [DBG] pgmap v806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:30.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:30 gibba020 bash[25448]: cluster 2021-03-10T14:19:29.469911+0000 mgr.gibba020.yqfnwy (mgr.34427) 1436 : cluster [DBG] pgmap v806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:32.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:32 gibba013 bash[29418]: cluster 2021-03-10T14:19:31.471820+0000 mgr.gibba020.yqfnwy (mgr.34427) 1437 : cluster [DBG] pgmap v807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:32.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:32 gibba013 bash[30381]: cluster 2021-03-10T14:19:31.471820+0000 mgr.gibba020.yqfnwy (mgr.34427) 1437 : cluster [DBG] pgmap v807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:32.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:32 gibba020 bash[25448]: cluster 2021-03-10T14:19:31.471820+0000 mgr.gibba020.yqfnwy (mgr.34427) 1437 : cluster [DBG] pgmap v807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:34.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:34 gibba013 bash[29418]: cephadm 2021-03-10T14:19:33.240481+0000 mgr.gibba020.yqfnwy (mgr.34427) 1438 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:19:34.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:34 gibba013 bash[29418]: cluster 2021-03-10T14:19:33.473287+0000 mgr.gibba020.yqfnwy (mgr.34427) 1439 : cluster [DBG] pgmap v808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:34.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:34 gibba013 bash[30381]: cephadm 2021-03-10T14:19:33.240481+0000 mgr.gibba020.yqfnwy (mgr.34427) 1438 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:19:34.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:34 gibba013 bash[30381]: cluster 2021-03-10T14:19:33.473287+0000 mgr.gibba020.yqfnwy (mgr.34427) 1439 : cluster [DBG] pgmap v808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:34.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:34 gibba020 bash[25448]: cephadm 2021-03-10T14:19:33.240481+0000 mgr.gibba020.yqfnwy (mgr.34427) 1438 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:19:34.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:34 gibba020 bash[25448]: cluster 2021-03-10T14:19:33.473287+0000 mgr.gibba020.yqfnwy (mgr.34427) 1439 : cluster [DBG] pgmap v808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:36.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:36 gibba013 bash[29418]: cluster 2021-03-10T14:19:35.474168+0000 mgr.gibba020.yqfnwy (mgr.34427) 1440 : cluster [DBG] pgmap v809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:36.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:36 gibba013 bash[30381]: cluster 2021-03-10T14:19:35.474168+0000 mgr.gibba020.yqfnwy (mgr.34427) 1440 : cluster [DBG] pgmap v809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:36.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:36 gibba020 bash[25448]: cluster 2021-03-10T14:19:35.474168+0000 mgr.gibba020.yqfnwy (mgr.34427) 1440 : cluster [DBG] pgmap v809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:38.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:38 gibba013 bash[29418]: cluster 2021-03-10T14:19:37.475476+0000 mgr.gibba020.yqfnwy (mgr.34427) 1441 : cluster [DBG] pgmap v810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:38.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:38 gibba013 bash[30381]: cluster 2021-03-10T14:19:37.475476+0000 mgr.gibba020.yqfnwy (mgr.34427) 1441 : cluster [DBG] pgmap v810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:38.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:38 gibba020 bash[25448]: cluster 2021-03-10T14:19:37.475476+0000 mgr.gibba020.yqfnwy (mgr.34427) 1441 : cluster [DBG] pgmap v810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:40.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:40 gibba013 bash[29418]: cluster 2021-03-10T14:19:39.476988+0000 mgr.gibba020.yqfnwy (mgr.34427) 1442 : cluster [DBG] pgmap v811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:40.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:40 gibba013 bash[30381]: cluster 2021-03-10T14:19:39.476988+0000 mgr.gibba020.yqfnwy (mgr.34427) 1442 : cluster [DBG] pgmap v811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:40.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:40 gibba020 bash[25448]: cluster 2021-03-10T14:19:39.476988+0000 mgr.gibba020.yqfnwy (mgr.34427) 1442 : cluster [DBG] pgmap v811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:42.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:42 gibba013 bash[29418]: cluster 2021-03-10T14:19:41.478761+0000 mgr.gibba020.yqfnwy (mgr.34427) 1443 : cluster [DBG] pgmap v812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:42.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:42 gibba013 bash[30381]: cluster 2021-03-10T14:19:41.478761+0000 mgr.gibba020.yqfnwy (mgr.34427) 1443 : cluster [DBG] pgmap v812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:42.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:42 gibba020 bash[25448]: cluster 2021-03-10T14:19:41.478761+0000 mgr.gibba020.yqfnwy (mgr.34427) 1443 : cluster [DBG] pgmap v812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:44.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:44 gibba013 bash[29418]: cluster 2021-03-10T14:19:43.480354+0000 mgr.gibba020.yqfnwy (mgr.34427) 1444 : cluster [DBG] pgmap v813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:44.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:44 gibba013 bash[30381]: cluster 2021-03-10T14:19:43.480354+0000 mgr.gibba020.yqfnwy (mgr.34427) 1444 : cluster [DBG] pgmap v813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:44.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:44 gibba020 bash[25448]: cluster 2021-03-10T14:19:43.480354+0000 mgr.gibba020.yqfnwy (mgr.34427) 1444 : cluster [DBG] pgmap v813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:46.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:46 gibba013 bash[29418]: cluster 2021-03-10T14:19:45.480999+0000 mgr.gibba020.yqfnwy (mgr.34427) 1445 : cluster [DBG] pgmap v814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:46.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:46 gibba013 bash[30381]: cluster 2021-03-10T14:19:45.480999+0000 mgr.gibba020.yqfnwy (mgr.34427) 1445 : cluster [DBG] pgmap v814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:46.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:46 gibba020 bash[25448]: cluster 2021-03-10T14:19:45.480999+0000 mgr.gibba020.yqfnwy (mgr.34427) 1445 : cluster [DBG] pgmap v814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:48.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:48 gibba013 bash[29418]: cluster 2021-03-10T14:19:47.482312+0000 mgr.gibba020.yqfnwy (mgr.34427) 1446 : cluster [DBG] pgmap v815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:48.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:48 gibba013 bash[29418]: audit 2021-03-10T14:19:48.258823+0000 mon.a (mon.0) 986 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:19:48.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:48 gibba013 bash[29418]: audit 2021-03-10T14:19:48.481453+0000 mon.a (mon.0) 987 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:19:48.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:48 gibba013 bash[29418]: audit 2021-03-10T14:19:48.484453+0000 mon.a (mon.0) 988 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:19:48.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:48 gibba013 bash[29418]: audit 2021-03-10T14:19:48.485965+0000 mon.a (mon.0) 989 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:48.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:48 gibba013 bash[29418]: audit 2021-03-10T14:19:48.487750+0000 mon.a (mon.0) 990 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:48.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:48 gibba013 bash[29418]: audit 2021-03-10T14:19:48.489481+0000 mon.a (mon.0) 991 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:48.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:48 gibba013 bash[29418]: audit 2021-03-10T14:19:48.493260+0000 mon.a (mon.0) 992 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:48.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:48 gibba013 bash[29418]: audit 2021-03-10T14:19:48.495137+0000 mon.a (mon.0) 993 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:48.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:48 gibba013 bash[30381]: cluster 2021-03-10T14:19:47.482312+0000 mgr.gibba020.yqfnwy (mgr.34427) 1446 : cluster [DBG] pgmap v815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:48.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:48 gibba013 bash[30381]: audit 2021-03-10T14:19:48.258823+0000 mon.a (mon.0) 986 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:19:48.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:48 gibba013 bash[30381]: audit 2021-03-10T14:19:48.481453+0000 mon.a (mon.0) 987 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:19:48.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:48 gibba013 bash[30381]: audit 2021-03-10T14:19:48.484453+0000 mon.a (mon.0) 988 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:19:48.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:48 gibba013 bash[30381]: audit 2021-03-10T14:19:48.485965+0000 mon.a (mon.0) 989 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:48.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:48 gibba013 bash[30381]: audit 2021-03-10T14:19:48.487750+0000 mon.a (mon.0) 990 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:48.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:48 gibba013 bash[30381]: audit 2021-03-10T14:19:48.489481+0000 mon.a (mon.0) 991 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:48.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:48 gibba013 bash[30381]: audit 2021-03-10T14:19:48.493260+0000 mon.a (mon.0) 992 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:48.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:48 gibba013 bash[30381]: audit 2021-03-10T14:19:48.495137+0000 mon.a (mon.0) 993 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:48.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:48 gibba020 bash[25448]: cluster 2021-03-10T14:19:47.482312+0000 mgr.gibba020.yqfnwy (mgr.34427) 1446 : cluster [DBG] pgmap v815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:48.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:48 gibba020 bash[25448]: audit 2021-03-10T14:19:48.258823+0000 mon.a (mon.0) 986 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:19:48.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:48 gibba020 bash[25448]: audit 2021-03-10T14:19:48.481453+0000 mon.a (mon.0) 987 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:19:48.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:48 gibba020 bash[25448]: audit 2021-03-10T14:19:48.484453+0000 mon.a (mon.0) 988 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:19:48.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:48 gibba020 bash[25448]: audit 2021-03-10T14:19:48.485965+0000 mon.a (mon.0) 989 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:48.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:48 gibba020 bash[25448]: audit 2021-03-10T14:19:48.487750+0000 mon.a (mon.0) 990 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:48.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:48 gibba020 bash[25448]: audit 2021-03-10T14:19:48.489481+0000 mon.a (mon.0) 991 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:48.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:48 gibba020 bash[25448]: audit 2021-03-10T14:19:48.493260+0000 mon.a (mon.0) 992 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:48.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:48 gibba020 bash[25448]: audit 2021-03-10T14:19:48.495137+0000 mon.a (mon.0) 993 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:49.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:49 gibba013 bash[29418]: cephadm 2021-03-10T14:19:48.262350+0000 mgr.gibba020.yqfnwy (mgr.34427) 1447 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:19:49.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:49 gibba013 bash[29418]: cephadm 2021-03-10T14:19:48.263975+0000 mgr.gibba020.yqfnwy (mgr.34427) 1448 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:19:49.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:49 gibba013 bash[29418]: cephadm 2021-03-10T14:19:48.482227+0000 mgr.gibba020.yqfnwy (mgr.34427) 1449 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:19:49.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:49 gibba013 bash[29418]: cephadm 2021-03-10T14:19:48.483847+0000 mgr.gibba020.yqfnwy (mgr.34427) 1450 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:19:49.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:49 gibba013 bash[29418]: cephadm 2021-03-10T14:19:48.485408+0000 mgr.gibba020.yqfnwy (mgr.34427) 1451 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:19:49.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:49 gibba013 bash[29418]: cephadm 2021-03-10T14:19:48.485445+0000 mgr.gibba020.yqfnwy (mgr.34427) 1452 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:19:49.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:49 gibba013 bash[29418]: cephadm 2021-03-10T14:19:48.487258+0000 mgr.gibba020.yqfnwy (mgr.34427) 1453 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:19:49.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:49 gibba013 bash[29418]: cephadm 2021-03-10T14:19:48.487294+0000 mgr.gibba020.yqfnwy (mgr.34427) 1454 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:19:49.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:49 gibba013 bash[29418]: cephadm 2021-03-10T14:19:48.489152+0000 mgr.gibba020.yqfnwy (mgr.34427) 1455 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:19:49.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:49 gibba013 bash[29418]: cephadm 2021-03-10T14:19:48.491021+0000 mgr.gibba020.yqfnwy (mgr.34427) 1456 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:19:49.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:49 gibba013 bash[29418]: cephadm 2021-03-10T14:19:48.491057+0000 mgr.gibba020.yqfnwy (mgr.34427) 1457 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:19:49.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:49 gibba013 bash[29418]: cephadm 2021-03-10T14:19:48.492759+0000 mgr.gibba020.yqfnwy (mgr.34427) 1458 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:19:49.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:49 gibba013 bash[29418]: cephadm 2021-03-10T14:19:48.493080+0000 mgr.gibba020.yqfnwy (mgr.34427) 1459 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:19:49.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:49 gibba013 bash[29418]: cephadm 2021-03-10T14:19:48.494555+0000 mgr.gibba020.yqfnwy (mgr.34427) 1460 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:19:49.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:49 gibba013 bash[29418]: cephadm 2021-03-10T14:19:48.494594+0000 mgr.gibba020.yqfnwy (mgr.34427) 1461 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:19:49.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:49 gibba013 bash[29418]: cephadm 2021-03-10T14:19:48.494699+0000 mgr.gibba020.yqfnwy (mgr.34427) 1462 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:19:49.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:49 gibba013 bash[30381]: cephadm 2021-03-10T14:19:48.262350+0000 mgr.gibba020.yqfnwy (mgr.34427) 1447 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:19:49.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:49 gibba013 bash[30381]: cephadm 2021-03-10T14:19:48.263975+0000 mgr.gibba020.yqfnwy (mgr.34427) 1448 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:19:49.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:49 gibba013 bash[30381]: cephadm 2021-03-10T14:19:48.482227+0000 mgr.gibba020.yqfnwy (mgr.34427) 1449 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:19:49.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:49 gibba013 bash[30381]: cephadm 2021-03-10T14:19:48.483847+0000 mgr.gibba020.yqfnwy (mgr.34427) 1450 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:19:49.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:49 gibba013 bash[30381]: cephadm 2021-03-10T14:19:48.485408+0000 mgr.gibba020.yqfnwy (mgr.34427) 1451 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:19:49.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:49 gibba013 bash[30381]: cephadm 2021-03-10T14:19:48.485445+0000 mgr.gibba020.yqfnwy (mgr.34427) 1452 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:19:49.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:49 gibba013 bash[30381]: cephadm 2021-03-10T14:19:48.487258+0000 mgr.gibba020.yqfnwy (mgr.34427) 1453 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:19:49.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:49 gibba013 bash[30381]: cephadm 2021-03-10T14:19:48.487294+0000 mgr.gibba020.yqfnwy (mgr.34427) 1454 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:19:49.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:49 gibba013 bash[30381]: cephadm 2021-03-10T14:19:48.489152+0000 mgr.gibba020.yqfnwy (mgr.34427) 1455 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:19:49.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:49 gibba013 bash[30381]: cephadm 2021-03-10T14:19:48.491021+0000 mgr.gibba020.yqfnwy (mgr.34427) 1456 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:19:49.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:49 gibba013 bash[30381]: cephadm 2021-03-10T14:19:48.491057+0000 mgr.gibba020.yqfnwy (mgr.34427) 1457 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:19:49.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:49 gibba013 bash[30381]: cephadm 2021-03-10T14:19:48.492759+0000 mgr.gibba020.yqfnwy (mgr.34427) 1458 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:19:49.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:49 gibba013 bash[30381]: cephadm 2021-03-10T14:19:48.493080+0000 mgr.gibba020.yqfnwy (mgr.34427) 1459 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:19:49.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:49 gibba013 bash[30381]: cephadm 2021-03-10T14:19:48.494555+0000 mgr.gibba020.yqfnwy (mgr.34427) 1460 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:19:49.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:49 gibba013 bash[30381]: cephadm 2021-03-10T14:19:48.494594+0000 mgr.gibba020.yqfnwy (mgr.34427) 1461 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:19:49.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:49 gibba013 bash[30381]: cephadm 2021-03-10T14:19:48.494699+0000 mgr.gibba020.yqfnwy (mgr.34427) 1462 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:19:49.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:49 gibba020 bash[25448]: cephadm 2021-03-10T14:19:48.262350+0000 mgr.gibba020.yqfnwy (mgr.34427) 1447 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:19:49.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:49 gibba020 bash[25448]: cephadm 2021-03-10T14:19:48.263975+0000 mgr.gibba020.yqfnwy (mgr.34427) 1448 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:19:49.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:49 gibba020 bash[25448]: cephadm 2021-03-10T14:19:48.482227+0000 mgr.gibba020.yqfnwy (mgr.34427) 1449 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:19:49.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:49 gibba020 bash[25448]: cephadm 2021-03-10T14:19:48.483847+0000 mgr.gibba020.yqfnwy (mgr.34427) 1450 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:19:49.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:49 gibba020 bash[25448]: cephadm 2021-03-10T14:19:48.485408+0000 mgr.gibba020.yqfnwy (mgr.34427) 1451 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:19:49.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:49 gibba020 bash[25448]: cephadm 2021-03-10T14:19:48.485445+0000 mgr.gibba020.yqfnwy (mgr.34427) 1452 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:19:49.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:49 gibba020 bash[25448]: cephadm 2021-03-10T14:19:48.487258+0000 mgr.gibba020.yqfnwy (mgr.34427) 1453 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:19:49.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:49 gibba020 bash[25448]: cephadm 2021-03-10T14:19:48.487294+0000 mgr.gibba020.yqfnwy (mgr.34427) 1454 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:19:49.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:49 gibba020 bash[25448]: cephadm 2021-03-10T14:19:48.489152+0000 mgr.gibba020.yqfnwy (mgr.34427) 1455 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:19:49.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:49 gibba020 bash[25448]: cephadm 2021-03-10T14:19:48.491021+0000 mgr.gibba020.yqfnwy (mgr.34427) 1456 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:19:49.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:49 gibba020 bash[25448]: cephadm 2021-03-10T14:19:48.491057+0000 mgr.gibba020.yqfnwy (mgr.34427) 1457 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:19:49.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:49 gibba020 bash[25448]: cephadm 2021-03-10T14:19:48.492759+0000 mgr.gibba020.yqfnwy (mgr.34427) 1458 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:19:49.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:49 gibba020 bash[25448]: cephadm 2021-03-10T14:19:48.493080+0000 mgr.gibba020.yqfnwy (mgr.34427) 1459 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:19:49.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:49 gibba020 bash[25448]: cephadm 2021-03-10T14:19:48.494555+0000 mgr.gibba020.yqfnwy (mgr.34427) 1460 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:19:49.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:49 gibba020 bash[25448]: cephadm 2021-03-10T14:19:48.494594+0000 mgr.gibba020.yqfnwy (mgr.34427) 1461 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:19:49.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:49 gibba020 bash[25448]: cephadm 2021-03-10T14:19:48.494699+0000 mgr.gibba020.yqfnwy (mgr.34427) 1462 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:19:50.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:50 gibba013 bash[29418]: cluster 2021-03-10T14:19:49.483918+0000 mgr.gibba020.yqfnwy (mgr.34427) 1463 : cluster [DBG] pgmap v816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:50.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:50 gibba013 bash[30381]: cluster 2021-03-10T14:19:49.483918+0000 mgr.gibba020.yqfnwy (mgr.34427) 1463 : cluster [DBG] pgmap v816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:50.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:50 gibba020 bash[25448]: cluster 2021-03-10T14:19:49.483918+0000 mgr.gibba020.yqfnwy (mgr.34427) 1463 : cluster [DBG] pgmap v816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:52.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:52 gibba013 bash[29418]: cluster 2021-03-10T14:19:51.485830+0000 mgr.gibba020.yqfnwy (mgr.34427) 1464 : cluster [DBG] pgmap v817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:52.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:52 gibba013 bash[30381]: cluster 2021-03-10T14:19:51.485830+0000 mgr.gibba020.yqfnwy (mgr.34427) 1464 : cluster [DBG] pgmap v817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:52.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:52 gibba020 bash[25448]: cluster 2021-03-10T14:19:51.485830+0000 mgr.gibba020.yqfnwy (mgr.34427) 1464 : cluster [DBG] pgmap v817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:54.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:54 gibba013 bash[29418]: cluster 2021-03-10T14:19:53.487376+0000 mgr.gibba020.yqfnwy (mgr.34427) 1465 : cluster [DBG] pgmap v818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:54.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:54 gibba013 bash[30381]: cluster 2021-03-10T14:19:53.487376+0000 mgr.gibba020.yqfnwy (mgr.34427) 1465 : cluster [DBG] pgmap v818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:54.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:54 gibba020 bash[25448]: cluster 2021-03-10T14:19:53.487376+0000 mgr.gibba020.yqfnwy (mgr.34427) 1465 : cluster [DBG] pgmap v818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:56.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:56 gibba013 bash[29418]: cluster 2021-03-10T14:19:55.488186+0000 mgr.gibba020.yqfnwy (mgr.34427) 1466 : cluster [DBG] pgmap v819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:56.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:56 gibba013 bash[30381]: cluster 2021-03-10T14:19:55.488186+0000 mgr.gibba020.yqfnwy (mgr.34427) 1466 : cluster [DBG] pgmap v819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:56.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:56 gibba020 bash[25448]: cluster 2021-03-10T14:19:55.488186+0000 mgr.gibba020.yqfnwy (mgr.34427) 1466 : cluster [DBG] pgmap v819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:58.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:58 gibba013 bash[29418]: cluster 2021-03-10T14:19:57.489296+0000 mgr.gibba020.yqfnwy (mgr.34427) 1467 : cluster [DBG] pgmap v820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:58.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:58 gibba013 bash[30381]: cluster 2021-03-10T14:19:57.489296+0000 mgr.gibba020.yqfnwy (mgr.34427) 1467 : cluster [DBG] pgmap v820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:58.912 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:19:58.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:58 gibba020 bash[25448]: cluster 2021-03-10T14:19:57.489296+0000 mgr.gibba020.yqfnwy (mgr.34427) 1467 : cluster [DBG] pgmap v820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:19:59.139 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:19:59.139 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (26m) 2m ago 31m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:19:59.139 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (31m) 76s ago 31m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:19:59.140 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (26m) 76s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:19:59.140 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (27m) 76s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:19:59.140 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (26m) 2m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:19:59.140 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (26m) 2m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:19:59.141 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (25m) 76s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:19:59.141 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (25m) 2m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:19:59.141 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (32m) 2m ago 32m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:19:59.141 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (32m) 76s ago 32m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:19:59.142 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (24m) 2m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:19:59.142 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (24m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:19:59.142 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (23m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:19:59.142 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (23m) 2m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:19:59.143 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (23m) 76s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:19:59.143 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (22m) 76s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:19:59.143 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (22m) 76s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:19:59.143 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (21m) 76s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:19:59.144 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (31m) 76s ago 32m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:19:59.144 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 76s ago 29m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:19:59.385 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:19:59.385 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:19:59.386 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:19:59.386 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:19:59.386 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:19:59.387 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:19:59.387 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:19:59.387 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:19:59.387 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:19:59.388 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:19:59.388 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:19:59.389 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:19:59.389 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:19:59.389 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:19:59.389 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:19:59.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:19:59 gibba013 bash[29418]: audit 2021-03-10T14:19:59.383540+0000 mon.c (mon.1) 33 : audit [DBG] from='client.? 172.21.2.113:0/3409398884' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:59.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:19:59 gibba013 bash[30381]: audit 2021-03-10T14:19:59.383540+0000 mon.c (mon.1) 33 : audit [DBG] from='client.? 172.21.2.113:0/3409398884' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:19:59.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:19:59 gibba020 bash[25448]: audit 2021-03-10T14:19:59.383540+0000 mon.c (mon.1) 33 : audit [DBG] from='client.? 172.21.2.113:0/3409398884' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:00.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:00 gibba013 bash[29418]: debug 2021-03-10T14:19:59.997+0000 7fd718a82700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:20:00.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:00 gibba013 bash[29418]: audit 2021-03-10T14:19:58.900697+0000 mgr.gibba020.yqfnwy (mgr.34427) 1468 : audit [DBG] from='client.45042 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:20:00.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:00 gibba013 bash[29418]: audit 2021-03-10T14:19:59.123477+0000 mgr.gibba020.yqfnwy (mgr.34427) 1469 : audit [DBG] from='client.45048 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:20:00.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:00 gibba013 bash[29418]: cluster 2021-03-10T14:19:59.490660+0000 mgr.gibba020.yqfnwy (mgr.34427) 1470 : cluster [DBG] pgmap v821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:00.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:00 gibba013 bash[29418]: cluster 2021-03-10T14:20:00.000435+0000 mon.a (mon.0) 994 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:20:00.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:00 gibba013 bash[30381]: audit 2021-03-10T14:19:58.900697+0000 mgr.gibba020.yqfnwy (mgr.34427) 1468 : audit [DBG] from='client.45042 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:20:00.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:00 gibba013 bash[30381]: audit 2021-03-10T14:19:59.123477+0000 mgr.gibba020.yqfnwy (mgr.34427) 1469 : audit [DBG] from='client.45048 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:20:00.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:00 gibba013 bash[30381]: cluster 2021-03-10T14:19:59.490660+0000 mgr.gibba020.yqfnwy (mgr.34427) 1470 : cluster [DBG] pgmap v821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:00.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:00 gibba013 bash[30381]: cluster 2021-03-10T14:20:00.000435+0000 mon.a (mon.0) 994 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:20:00.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:00 gibba020 bash[25448]: audit 2021-03-10T14:19:58.900697+0000 mgr.gibba020.yqfnwy (mgr.34427) 1468 : audit [DBG] from='client.45042 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:20:00.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:00 gibba020 bash[25448]: audit 2021-03-10T14:19:59.123477+0000 mgr.gibba020.yqfnwy (mgr.34427) 1469 : audit [DBG] from='client.45048 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:20:00.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:00 gibba020 bash[25448]: cluster 2021-03-10T14:19:59.490660+0000 mgr.gibba020.yqfnwy (mgr.34427) 1470 : cluster [DBG] pgmap v821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:00.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:00 gibba020 bash[25448]: cluster 2021-03-10T14:20:00.000435+0000 mon.a (mon.0) 994 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:20:02.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:02 gibba013 bash[29418]: cluster 2021-03-10T14:20:01.492533+0000 mgr.gibba020.yqfnwy (mgr.34427) 1471 : cluster [DBG] pgmap v822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:02.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:02 gibba013 bash[30381]: cluster 2021-03-10T14:20:01.492533+0000 mgr.gibba020.yqfnwy (mgr.34427) 1471 : cluster [DBG] pgmap v822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:02.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:02 gibba020 bash[25448]: cluster 2021-03-10T14:20:01.492533+0000 mgr.gibba020.yqfnwy (mgr.34427) 1471 : cluster [DBG] pgmap v822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:04.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:04 gibba013 bash[29418]: cluster 2021-03-10T14:20:03.493896+0000 mgr.gibba020.yqfnwy (mgr.34427) 1472 : cluster [DBG] pgmap v823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:04.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:04 gibba013 bash[29418]: cephadm 2021-03-10T14:20:03.508678+0000 mgr.gibba020.yqfnwy (mgr.34427) 1473 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:20:04.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:04 gibba013 bash[30381]: cluster 2021-03-10T14:20:03.493896+0000 mgr.gibba020.yqfnwy (mgr.34427) 1472 : cluster [DBG] pgmap v823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:04.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:04 gibba013 bash[30381]: cephadm 2021-03-10T14:20:03.508678+0000 mgr.gibba020.yqfnwy (mgr.34427) 1473 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:20:04.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:04 gibba020 bash[25448]: cluster 2021-03-10T14:20:03.493896+0000 mgr.gibba020.yqfnwy (mgr.34427) 1472 : cluster [DBG] pgmap v823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:04.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:04 gibba020 bash[25448]: cephadm 2021-03-10T14:20:03.508678+0000 mgr.gibba020.yqfnwy (mgr.34427) 1473 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:20:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:06 gibba013 bash[29418]: cluster 2021-03-10T14:20:05.495577+0000 mgr.gibba020.yqfnwy (mgr.34427) 1474 : cluster [DBG] pgmap v824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:06 gibba013 bash[29418]: audit 2021-03-10T14:20:05.983224+0000 mon.a (mon.0) 995 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:20:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:06 gibba013 bash[29418]: audit 2021-03-10T14:20:05.984007+0000 mon.a (mon.0) 996 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:20:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:06 gibba013 bash[29418]: audit 2021-03-10T14:20:05.984716+0000 mon.a (mon.0) 997 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:20:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:06 gibba013 bash[29418]: audit 2021-03-10T14:20:05.985391+0000 mon.a (mon.0) 998 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:20:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:06 gibba013 bash[29418]: audit 2021-03-10T14:20:06.102975+0000 mon.a (mon.0) 999 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:20:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:06 gibba013 bash[29418]: audit 2021-03-10T14:20:06.109380+0000 mon.a (mon.0) 1000 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:20:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:06 gibba013 bash[30381]: cluster 2021-03-10T14:20:05.495577+0000 mgr.gibba020.yqfnwy (mgr.34427) 1474 : cluster [DBG] pgmap v824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:06 gibba013 bash[30381]: audit 2021-03-10T14:20:05.983224+0000 mon.a (mon.0) 995 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:20:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:06 gibba013 bash[30381]: audit 2021-03-10T14:20:05.984007+0000 mon.a (mon.0) 996 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:20:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:06 gibba013 bash[30381]: audit 2021-03-10T14:20:05.984716+0000 mon.a (mon.0) 997 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:20:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:06 gibba013 bash[30381]: audit 2021-03-10T14:20:05.985391+0000 mon.a (mon.0) 998 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:20:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:06 gibba013 bash[30381]: audit 2021-03-10T14:20:06.102975+0000 mon.a (mon.0) 999 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:20:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:06 gibba013 bash[30381]: audit 2021-03-10T14:20:06.109380+0000 mon.a (mon.0) 1000 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:20:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:06 gibba020 bash[25448]: cluster 2021-03-10T14:20:05.495577+0000 mgr.gibba020.yqfnwy (mgr.34427) 1474 : cluster [DBG] pgmap v824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:06 gibba020 bash[25448]: audit 2021-03-10T14:20:05.983224+0000 mon.a (mon.0) 995 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:20:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:06 gibba020 bash[25448]: audit 2021-03-10T14:20:05.984007+0000 mon.a (mon.0) 996 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:20:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:06 gibba020 bash[25448]: audit 2021-03-10T14:20:05.984716+0000 mon.a (mon.0) 997 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:20:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:06 gibba020 bash[25448]: audit 2021-03-10T14:20:05.985391+0000 mon.a (mon.0) 998 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:20:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:06 gibba020 bash[25448]: audit 2021-03-10T14:20:06.102975+0000 mon.a (mon.0) 999 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:20:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:06 gibba020 bash[25448]: audit 2021-03-10T14:20:06.109380+0000 mon.a (mon.0) 1000 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:20:08.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:08 gibba013 bash[29418]: cluster 2021-03-10T14:20:07.496910+0000 mgr.gibba020.yqfnwy (mgr.34427) 1475 : cluster [DBG] pgmap v825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:08.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:08 gibba013 bash[30381]: cluster 2021-03-10T14:20:07.496910+0000 mgr.gibba020.yqfnwy (mgr.34427) 1475 : cluster [DBG] pgmap v825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:08.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:08 gibba020 bash[25448]: cluster 2021-03-10T14:20:07.496910+0000 mgr.gibba020.yqfnwy (mgr.34427) 1475 : cluster [DBG] pgmap v825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:10.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:10 gibba013 bash[29418]: cluster 2021-03-10T14:20:09.498260+0000 mgr.gibba020.yqfnwy (mgr.34427) 1476 : cluster [DBG] pgmap v826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:10.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:10 gibba013 bash[30381]: cluster 2021-03-10T14:20:09.498260+0000 mgr.gibba020.yqfnwy (mgr.34427) 1476 : cluster [DBG] pgmap v826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:10.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:10 gibba020 bash[25448]: cluster 2021-03-10T14:20:09.498260+0000 mgr.gibba020.yqfnwy (mgr.34427) 1476 : cluster [DBG] pgmap v826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:12.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:12 gibba013 bash[29418]: cluster 2021-03-10T14:20:11.500138+0000 mgr.gibba020.yqfnwy (mgr.34427) 1477 : cluster [DBG] pgmap v827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:12.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:12 gibba013 bash[30381]: cluster 2021-03-10T14:20:11.500138+0000 mgr.gibba020.yqfnwy (mgr.34427) 1477 : cluster [DBG] pgmap v827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:12.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:12 gibba020 bash[25448]: cluster 2021-03-10T14:20:11.500138+0000 mgr.gibba020.yqfnwy (mgr.34427) 1477 : cluster [DBG] pgmap v827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:14.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:14 gibba013 bash[29418]: cluster 2021-03-10T14:20:13.501454+0000 mgr.gibba020.yqfnwy (mgr.34427) 1478 : cluster [DBG] pgmap v828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:14.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:14 gibba013 bash[30381]: cluster 2021-03-10T14:20:13.501454+0000 mgr.gibba020.yqfnwy (mgr.34427) 1478 : cluster [DBG] pgmap v828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:14.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:14 gibba020 bash[25448]: cluster 2021-03-10T14:20:13.501454+0000 mgr.gibba020.yqfnwy (mgr.34427) 1478 : cluster [DBG] pgmap v828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:16.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:16 gibba013 bash[29418]: cluster 2021-03-10T14:20:15.502060+0000 mgr.gibba020.yqfnwy (mgr.34427) 1479 : cluster [DBG] pgmap v829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:16.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:16 gibba013 bash[30381]: cluster 2021-03-10T14:20:15.502060+0000 mgr.gibba020.yqfnwy (mgr.34427) 1479 : cluster [DBG] pgmap v829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:16.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:16 gibba020 bash[25448]: cluster 2021-03-10T14:20:15.502060+0000 mgr.gibba020.yqfnwy (mgr.34427) 1479 : cluster [DBG] pgmap v829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:18.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:18 gibba013 bash[29418]: cluster 2021-03-10T14:20:17.503349+0000 mgr.gibba020.yqfnwy (mgr.34427) 1480 : cluster [DBG] pgmap v830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:18.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:18 gibba013 bash[30381]: cluster 2021-03-10T14:20:17.503349+0000 mgr.gibba020.yqfnwy (mgr.34427) 1480 : cluster [DBG] pgmap v830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:18.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:18 gibba020 bash[25448]: cluster 2021-03-10T14:20:17.503349+0000 mgr.gibba020.yqfnwy (mgr.34427) 1480 : cluster [DBG] pgmap v830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:19.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:19 gibba013 bash[29418]: cephadm 2021-03-10T14:20:18.520683+0000 mgr.gibba020.yqfnwy (mgr.34427) 1481 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:20:19.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:19 gibba013 bash[30381]: cephadm 2021-03-10T14:20:18.520683+0000 mgr.gibba020.yqfnwy (mgr.34427) 1481 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:20:19.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:19 gibba020 bash[25448]: cephadm 2021-03-10T14:20:18.520683+0000 mgr.gibba020.yqfnwy (mgr.34427) 1481 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:20:20.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:20 gibba013 bash[29418]: cluster 2021-03-10T14:20:19.504788+0000 mgr.gibba020.yqfnwy (mgr.34427) 1482 : cluster [DBG] pgmap v831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:20.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:20 gibba013 bash[30381]: cluster 2021-03-10T14:20:19.504788+0000 mgr.gibba020.yqfnwy (mgr.34427) 1482 : cluster [DBG] pgmap v831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:20.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:20 gibba020 bash[25448]: cluster 2021-03-10T14:20:19.504788+0000 mgr.gibba020.yqfnwy (mgr.34427) 1482 : cluster [DBG] pgmap v831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:22.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:22 gibba013 bash[29418]: cluster 2021-03-10T14:20:21.506616+0000 mgr.gibba020.yqfnwy (mgr.34427) 1483 : cluster [DBG] pgmap v832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:22.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:22 gibba013 bash[30381]: cluster 2021-03-10T14:20:21.506616+0000 mgr.gibba020.yqfnwy (mgr.34427) 1483 : cluster [DBG] pgmap v832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:22.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:22 gibba020 bash[25448]: cluster 2021-03-10T14:20:21.506616+0000 mgr.gibba020.yqfnwy (mgr.34427) 1483 : cluster [DBG] pgmap v832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:24.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:24 gibba013 bash[29418]: cluster 2021-03-10T14:20:23.508164+0000 mgr.gibba020.yqfnwy (mgr.34427) 1484 : cluster [DBG] pgmap v833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:24.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:24 gibba013 bash[30381]: cluster 2021-03-10T14:20:23.508164+0000 mgr.gibba020.yqfnwy (mgr.34427) 1484 : cluster [DBG] pgmap v833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:24.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:24 gibba020 bash[25448]: cluster 2021-03-10T14:20:23.508164+0000 mgr.gibba020.yqfnwy (mgr.34427) 1484 : cluster [DBG] pgmap v833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:26.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:26 gibba013 bash[29418]: cluster 2021-03-10T14:20:25.509118+0000 mgr.gibba020.yqfnwy (mgr.34427) 1485 : cluster [DBG] pgmap v834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:26.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:26 gibba013 bash[30381]: cluster 2021-03-10T14:20:25.509118+0000 mgr.gibba020.yqfnwy (mgr.34427) 1485 : cluster [DBG] pgmap v834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:26.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:26 gibba020 bash[25448]: cluster 2021-03-10T14:20:25.509118+0000 mgr.gibba020.yqfnwy (mgr.34427) 1485 : cluster [DBG] pgmap v834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:28.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:28 gibba013 bash[29418]: cluster 2021-03-10T14:20:27.510282+0000 mgr.gibba020.yqfnwy (mgr.34427) 1486 : cluster [DBG] pgmap v835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:28.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:28 gibba013 bash[30381]: cluster 2021-03-10T14:20:27.510282+0000 mgr.gibba020.yqfnwy (mgr.34427) 1486 : cluster [DBG] pgmap v835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:28.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:28 gibba020 bash[25448]: cluster 2021-03-10T14:20:27.510282+0000 mgr.gibba020.yqfnwy (mgr.34427) 1486 : cluster [DBG] pgmap v835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:29.626 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:20:29.853 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:20:29.854 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (26m) 2m ago 32m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:20:29.854 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (32m) 106s ago 32m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:20:29.854 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (27m) 106s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:20:29.854 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (27m) 106s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:20:29.855 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (26m) 2m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:20:29.855 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (26m) 2m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:20:29.855 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (26m) 106s ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:20:29.855 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (26m) 2m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:20:29.856 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (32m) 2m ago 32m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:20:29.856 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (32m) 106s ago 32m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:20:29.856 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (25m) 2m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:20:29.856 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (24m) 2m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:20:29.856 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (24m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:20:29.857 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (23m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:20:29.857 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (23m) 106s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:20:29.857 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (23m) 106s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:20:29.857 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (22m) 106s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:20:29.858 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (22m) 106s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:20:29.858 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (31m) 106s ago 32m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:20:29.858 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 106s ago 30m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:20:30.102 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:20:30.102 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:20:30.102 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:20:30.103 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:20:30.103 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:20:30.103 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:20:30.103 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:20:30.103 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:20:30.104 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:20:30.104 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:20:30.104 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:20:30.104 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:20:30.105 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:20:30.105 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:20:30.105 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:20:30.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:30 gibba013 bash[29418]: cluster 2021-03-10T14:20:29.511835+0000 mgr.gibba020.yqfnwy (mgr.34427) 1487 : cluster [DBG] pgmap v836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:30.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:30 gibba013 bash[29418]: audit 2021-03-10T14:20:29.614840+0000 mgr.gibba020.yqfnwy (mgr.34427) 1488 : audit [DBG] from='client.45060 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:20:30.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:30 gibba013 bash[29418]: audit 2021-03-10T14:20:30.100553+0000 mon.c (mon.1) 34 : audit [DBG] from='client.? 172.21.2.113:0/3911985536' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:30.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:30 gibba013 bash[30381]: cluster 2021-03-10T14:20:29.511835+0000 mgr.gibba020.yqfnwy (mgr.34427) 1487 : cluster [DBG] pgmap v836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:30.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:30 gibba013 bash[30381]: audit 2021-03-10T14:20:29.614840+0000 mgr.gibba020.yqfnwy (mgr.34427) 1488 : audit [DBG] from='client.45060 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:20:30.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:30 gibba013 bash[30381]: audit 2021-03-10T14:20:30.100553+0000 mon.c (mon.1) 34 : audit [DBG] from='client.? 172.21.2.113:0/3911985536' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:30.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:30 gibba020 bash[25448]: cluster 2021-03-10T14:20:29.511835+0000 mgr.gibba020.yqfnwy (mgr.34427) 1487 : cluster [DBG] pgmap v836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:30.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:30 gibba020 bash[25448]: audit 2021-03-10T14:20:29.614840+0000 mgr.gibba020.yqfnwy (mgr.34427) 1488 : audit [DBG] from='client.45060 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:20:30.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:30 gibba020 bash[25448]: audit 2021-03-10T14:20:30.100553+0000 mon.c (mon.1) 34 : audit [DBG] from='client.? 172.21.2.113:0/3911985536' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:31.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:31 gibba013 bash[29418]: audit 2021-03-10T14:20:29.838233+0000 mgr.gibba020.yqfnwy (mgr.34427) 1489 : audit [DBG] from='client.45066 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:20:31.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:31 gibba013 bash[30381]: audit 2021-03-10T14:20:29.838233+0000 mgr.gibba020.yqfnwy (mgr.34427) 1489 : audit [DBG] from='client.45066 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:20:31.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:31 gibba020 bash[25448]: audit 2021-03-10T14:20:29.838233+0000 mgr.gibba020.yqfnwy (mgr.34427) 1489 : audit [DBG] from='client.45066 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:20:32.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:32 gibba013 bash[29418]: cluster 2021-03-10T14:20:31.513484+0000 mgr.gibba020.yqfnwy (mgr.34427) 1490 : cluster [DBG] pgmap v837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:32.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:32 gibba013 bash[30381]: cluster 2021-03-10T14:20:31.513484+0000 mgr.gibba020.yqfnwy (mgr.34427) 1490 : cluster [DBG] pgmap v837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:32.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:32 gibba020 bash[25448]: cluster 2021-03-10T14:20:31.513484+0000 mgr.gibba020.yqfnwy (mgr.34427) 1490 : cluster [DBG] pgmap v837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:34.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:34 gibba013 bash[29418]: cluster 2021-03-10T14:20:33.514960+0000 mgr.gibba020.yqfnwy (mgr.34427) 1491 : cluster [DBG] pgmap v838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:34.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:34 gibba013 bash[29418]: cephadm 2021-03-10T14:20:33.532732+0000 mgr.gibba020.yqfnwy (mgr.34427) 1492 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:20:34.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:34 gibba013 bash[30381]: cluster 2021-03-10T14:20:33.514960+0000 mgr.gibba020.yqfnwy (mgr.34427) 1491 : cluster [DBG] pgmap v838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:34.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:34 gibba013 bash[30381]: cephadm 2021-03-10T14:20:33.532732+0000 mgr.gibba020.yqfnwy (mgr.34427) 1492 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:20:34.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:34 gibba020 bash[25448]: cluster 2021-03-10T14:20:33.514960+0000 mgr.gibba020.yqfnwy (mgr.34427) 1491 : cluster [DBG] pgmap v838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:34.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:34 gibba020 bash[25448]: cephadm 2021-03-10T14:20:33.532732+0000 mgr.gibba020.yqfnwy (mgr.34427) 1492 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:20:36.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:36 gibba013 bash[29418]: cluster 2021-03-10T14:20:35.516477+0000 mgr.gibba020.yqfnwy (mgr.34427) 1493 : cluster [DBG] pgmap v839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:36.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:36 gibba013 bash[30381]: cluster 2021-03-10T14:20:35.516477+0000 mgr.gibba020.yqfnwy (mgr.34427) 1493 : cluster [DBG] pgmap v839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:36.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:36 gibba020 bash[25448]: cluster 2021-03-10T14:20:35.516477+0000 mgr.gibba020.yqfnwy (mgr.34427) 1493 : cluster [DBG] pgmap v839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:38.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:38 gibba013 bash[29418]: cluster 2021-03-10T14:20:37.517681+0000 mgr.gibba020.yqfnwy (mgr.34427) 1494 : cluster [DBG] pgmap v840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:38.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:38 gibba013 bash[30381]: cluster 2021-03-10T14:20:37.517681+0000 mgr.gibba020.yqfnwy (mgr.34427) 1494 : cluster [DBG] pgmap v840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:38.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:38 gibba020 bash[25448]: cluster 2021-03-10T14:20:37.517681+0000 mgr.gibba020.yqfnwy (mgr.34427) 1494 : cluster [DBG] pgmap v840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:40.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:40 gibba013 bash[29418]: cluster 2021-03-10T14:20:39.518918+0000 mgr.gibba020.yqfnwy (mgr.34427) 1495 : cluster [DBG] pgmap v841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:40.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:40 gibba013 bash[30381]: cluster 2021-03-10T14:20:39.518918+0000 mgr.gibba020.yqfnwy (mgr.34427) 1495 : cluster [DBG] pgmap v841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:40.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:40 gibba020 bash[25448]: cluster 2021-03-10T14:20:39.518918+0000 mgr.gibba020.yqfnwy (mgr.34427) 1495 : cluster [DBG] pgmap v841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:42.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:42 gibba013 bash[29418]: cluster 2021-03-10T14:20:41.520752+0000 mgr.gibba020.yqfnwy (mgr.34427) 1496 : cluster [DBG] pgmap v842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:42.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:42 gibba013 bash[30381]: cluster 2021-03-10T14:20:41.520752+0000 mgr.gibba020.yqfnwy (mgr.34427) 1496 : cluster [DBG] pgmap v842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:42.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:42 gibba020 bash[25448]: cluster 2021-03-10T14:20:41.520752+0000 mgr.gibba020.yqfnwy (mgr.34427) 1496 : cluster [DBG] pgmap v842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:44.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:44 gibba013 bash[29418]: cluster 2021-03-10T14:20:43.522092+0000 mgr.gibba020.yqfnwy (mgr.34427) 1497 : cluster [DBG] pgmap v843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:44.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:44 gibba013 bash[30381]: cluster 2021-03-10T14:20:43.522092+0000 mgr.gibba020.yqfnwy (mgr.34427) 1497 : cluster [DBG] pgmap v843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:44.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:44 gibba020 bash[25448]: cluster 2021-03-10T14:20:43.522092+0000 mgr.gibba020.yqfnwy (mgr.34427) 1497 : cluster [DBG] pgmap v843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:46.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:46 gibba013 bash[29418]: cluster 2021-03-10T14:20:45.523680+0000 mgr.gibba020.yqfnwy (mgr.34427) 1498 : cluster [DBG] pgmap v844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:46.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:46 gibba013 bash[30381]: cluster 2021-03-10T14:20:45.523680+0000 mgr.gibba020.yqfnwy (mgr.34427) 1498 : cluster [DBG] pgmap v844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:46.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:46 gibba020 bash[25448]: cluster 2021-03-10T14:20:45.523680+0000 mgr.gibba020.yqfnwy (mgr.34427) 1498 : cluster [DBG] pgmap v844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:48.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:48 gibba013 bash[29418]: cluster 2021-03-10T14:20:47.525125+0000 mgr.gibba020.yqfnwy (mgr.34427) 1499 : cluster [DBG] pgmap v845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:48.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:48 gibba013 bash[29418]: audit 2021-03-10T14:20:48.551230+0000 mon.a (mon.0) 1001 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:20:48.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:48 gibba013 bash[30381]: cluster 2021-03-10T14:20:47.525125+0000 mgr.gibba020.yqfnwy (mgr.34427) 1499 : cluster [DBG] pgmap v845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:48.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:48 gibba013 bash[30381]: audit 2021-03-10T14:20:48.551230+0000 mon.a (mon.0) 1001 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:20:48.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:48 gibba020 bash[25448]: cluster 2021-03-10T14:20:47.525125+0000 mgr.gibba020.yqfnwy (mgr.34427) 1499 : cluster [DBG] pgmap v845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:48.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:48 gibba020 bash[25448]: audit 2021-03-10T14:20:48.551230+0000 mon.a (mon.0) 1001 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:20:49.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:49 gibba013 bash[29418]: cephadm 2021-03-10T14:20:48.554961+0000 mgr.gibba020.yqfnwy (mgr.34427) 1500 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:20:49.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:49 gibba013 bash[29418]: cephadm 2021-03-10T14:20:48.556917+0000 mgr.gibba020.yqfnwy (mgr.34427) 1501 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:20:49.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:49 gibba013 bash[29418]: audit 2021-03-10T14:20:48.785808+0000 mon.a (mon.0) 1002 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:20:49.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:49 gibba013 bash[29418]: audit 2021-03-10T14:20:48.789238+0000 mon.a (mon.0) 1003 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:20:49.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:49 gibba013 bash[29418]: audit 2021-03-10T14:20:48.790647+0000 mon.a (mon.0) 1004 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:49.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:49 gibba013 bash[29418]: audit 2021-03-10T14:20:48.792201+0000 mon.a (mon.0) 1005 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:49.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:49 gibba013 bash[29418]: audit 2021-03-10T14:20:48.793583+0000 mon.a (mon.0) 1006 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:49.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:49 gibba013 bash[29418]: audit 2021-03-10T14:20:48.796095+0000 mon.a (mon.0) 1007 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:49.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:49 gibba013 bash[29418]: audit 2021-03-10T14:20:48.797462+0000 mon.a (mon.0) 1008 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:49.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:49 gibba013 bash[30381]: cephadm 2021-03-10T14:20:48.554961+0000 mgr.gibba020.yqfnwy (mgr.34427) 1500 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:20:49.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:49 gibba013 bash[30381]: cephadm 2021-03-10T14:20:48.556917+0000 mgr.gibba020.yqfnwy (mgr.34427) 1501 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:20:49.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:49 gibba013 bash[30381]: audit 2021-03-10T14:20:48.785808+0000 mon.a (mon.0) 1002 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:20:49.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:49 gibba013 bash[30381]: audit 2021-03-10T14:20:48.789238+0000 mon.a (mon.0) 1003 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:20:49.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:49 gibba013 bash[30381]: audit 2021-03-10T14:20:48.790647+0000 mon.a (mon.0) 1004 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:49.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:49 gibba013 bash[30381]: audit 2021-03-10T14:20:48.792201+0000 mon.a (mon.0) 1005 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:49.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:49 gibba013 bash[30381]: audit 2021-03-10T14:20:48.793583+0000 mon.a (mon.0) 1006 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:49.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:49 gibba013 bash[30381]: audit 2021-03-10T14:20:48.796095+0000 mon.a (mon.0) 1007 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:49.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:49 gibba013 bash[30381]: audit 2021-03-10T14:20:48.797462+0000 mon.a (mon.0) 1008 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:49.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:49 gibba020 bash[25448]: cephadm 2021-03-10T14:20:48.554961+0000 mgr.gibba020.yqfnwy (mgr.34427) 1500 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:20:49.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:49 gibba020 bash[25448]: cephadm 2021-03-10T14:20:48.556917+0000 mgr.gibba020.yqfnwy (mgr.34427) 1501 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:20:49.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:49 gibba020 bash[25448]: audit 2021-03-10T14:20:48.785808+0000 mon.a (mon.0) 1002 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:20:49.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:49 gibba020 bash[25448]: audit 2021-03-10T14:20:48.789238+0000 mon.a (mon.0) 1003 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:20:49.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:49 gibba020 bash[25448]: audit 2021-03-10T14:20:48.790647+0000 mon.a (mon.0) 1004 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:49.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:49 gibba020 bash[25448]: audit 2021-03-10T14:20:48.792201+0000 mon.a (mon.0) 1005 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:49.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:49 gibba020 bash[25448]: audit 2021-03-10T14:20:48.793583+0000 mon.a (mon.0) 1006 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:49.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:49 gibba020 bash[25448]: audit 2021-03-10T14:20:48.796095+0000 mon.a (mon.0) 1007 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:49.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:49 gibba020 bash[25448]: audit 2021-03-10T14:20:48.797462+0000 mon.a (mon.0) 1008 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:20:50.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:50 gibba013 bash[29418]: cephadm 2021-03-10T14:20:48.786865+0000 mgr.gibba020.yqfnwy (mgr.34427) 1502 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:20:50.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:50 gibba013 bash[29418]: cephadm 2021-03-10T14:20:48.788464+0000 mgr.gibba020.yqfnwy (mgr.34427) 1503 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:20:50.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:50 gibba013 bash[29418]: cephadm 2021-03-10T14:20:48.789988+0000 mgr.gibba020.yqfnwy (mgr.34427) 1504 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:20:50.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:50 gibba013 bash[29418]: cephadm 2021-03-10T14:20:48.790034+0000 mgr.gibba020.yqfnwy (mgr.34427) 1505 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:20:50.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:50 gibba013 bash[29418]: cephadm 2021-03-10T14:20:48.791565+0000 mgr.gibba020.yqfnwy (mgr.34427) 1506 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:20:50.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:50 gibba013 bash[29418]: cephadm 2021-03-10T14:20:48.791609+0000 mgr.gibba020.yqfnwy (mgr.34427) 1507 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:20:50.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:50 gibba013 bash[29418]: cephadm 2021-03-10T14:20:48.792891+0000 mgr.gibba020.yqfnwy (mgr.34427) 1508 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:20:50.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:50 gibba013 bash[29418]: cephadm 2021-03-10T14:20:48.793854+0000 mgr.gibba020.yqfnwy (mgr.34427) 1509 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:20:50.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:50 gibba013 bash[29418]: cephadm 2021-03-10T14:20:48.793896+0000 mgr.gibba020.yqfnwy (mgr.34427) 1510 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:20:50.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:50 gibba013 bash[29418]: cephadm 2021-03-10T14:20:48.795137+0000 mgr.gibba020.yqfnwy (mgr.34427) 1511 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:20:50.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:50 gibba013 bash[29418]: cephadm 2021-03-10T14:20:48.795454+0000 mgr.gibba020.yqfnwy (mgr.34427) 1512 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:20:50.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:50 gibba013 bash[29418]: cephadm 2021-03-10T14:20:48.796661+0000 mgr.gibba020.yqfnwy (mgr.34427) 1513 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:20:50.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:50 gibba013 bash[29418]: cephadm 2021-03-10T14:20:48.796707+0000 mgr.gibba020.yqfnwy (mgr.34427) 1514 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:20:50.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:50 gibba013 bash[29418]: cephadm 2021-03-10T14:20:48.796821+0000 mgr.gibba020.yqfnwy (mgr.34427) 1515 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:20:50.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:50 gibba013 bash[29418]: cluster 2021-03-10T14:20:49.526503+0000 mgr.gibba020.yqfnwy (mgr.34427) 1516 : cluster [DBG] pgmap v846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:50.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:50 gibba013 bash[30381]: cephadm 2021-03-10T14:20:48.786865+0000 mgr.gibba020.yqfnwy (mgr.34427) 1502 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:20:50.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:50 gibba013 bash[30381]: cephadm 2021-03-10T14:20:48.788464+0000 mgr.gibba020.yqfnwy (mgr.34427) 1503 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:20:50.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:50 gibba013 bash[30381]: cephadm 2021-03-10T14:20:48.789988+0000 mgr.gibba020.yqfnwy (mgr.34427) 1504 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:20:50.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:50 gibba013 bash[30381]: cephadm 2021-03-10T14:20:48.790034+0000 mgr.gibba020.yqfnwy (mgr.34427) 1505 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:20:50.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:50 gibba013 bash[30381]: cephadm 2021-03-10T14:20:48.791565+0000 mgr.gibba020.yqfnwy (mgr.34427) 1506 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:20:50.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:50 gibba013 bash[30381]: cephadm 2021-03-10T14:20:48.791609+0000 mgr.gibba020.yqfnwy (mgr.34427) 1507 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:20:50.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:50 gibba013 bash[30381]: cephadm 2021-03-10T14:20:48.792891+0000 mgr.gibba020.yqfnwy (mgr.34427) 1508 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:20:50.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:50 gibba013 bash[30381]: cephadm 2021-03-10T14:20:48.793854+0000 mgr.gibba020.yqfnwy (mgr.34427) 1509 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:20:50.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:50 gibba013 bash[30381]: cephadm 2021-03-10T14:20:48.793896+0000 mgr.gibba020.yqfnwy (mgr.34427) 1510 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:20:50.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:50 gibba013 bash[30381]: cephadm 2021-03-10T14:20:48.795137+0000 mgr.gibba020.yqfnwy (mgr.34427) 1511 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:20:50.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:50 gibba013 bash[30381]: cephadm 2021-03-10T14:20:48.795454+0000 mgr.gibba020.yqfnwy (mgr.34427) 1512 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:20:50.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:50 gibba013 bash[30381]: cephadm 2021-03-10T14:20:48.796661+0000 mgr.gibba020.yqfnwy (mgr.34427) 1513 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:20:50.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:50 gibba013 bash[30381]: cephadm 2021-03-10T14:20:48.796707+0000 mgr.gibba020.yqfnwy (mgr.34427) 1514 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:20:50.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:50 gibba013 bash[30381]: cephadm 2021-03-10T14:20:48.796821+0000 mgr.gibba020.yqfnwy (mgr.34427) 1515 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:20:50.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:50 gibba013 bash[30381]: cluster 2021-03-10T14:20:49.526503+0000 mgr.gibba020.yqfnwy (mgr.34427) 1516 : cluster [DBG] pgmap v846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:50.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:50 gibba020 bash[25448]: cephadm 2021-03-10T14:20:48.786865+0000 mgr.gibba020.yqfnwy (mgr.34427) 1502 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:20:50.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:50 gibba020 bash[25448]: cephadm 2021-03-10T14:20:48.788464+0000 mgr.gibba020.yqfnwy (mgr.34427) 1503 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:20:50.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:50 gibba020 bash[25448]: cephadm 2021-03-10T14:20:48.789988+0000 mgr.gibba020.yqfnwy (mgr.34427) 1504 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:20:50.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:50 gibba020 bash[25448]: cephadm 2021-03-10T14:20:48.790034+0000 mgr.gibba020.yqfnwy (mgr.34427) 1505 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:20:50.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:50 gibba020 bash[25448]: cephadm 2021-03-10T14:20:48.791565+0000 mgr.gibba020.yqfnwy (mgr.34427) 1506 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:20:50.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:50 gibba020 bash[25448]: cephadm 2021-03-10T14:20:48.791609+0000 mgr.gibba020.yqfnwy (mgr.34427) 1507 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:20:50.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:50 gibba020 bash[25448]: cephadm 2021-03-10T14:20:48.792891+0000 mgr.gibba020.yqfnwy (mgr.34427) 1508 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:20:50.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:50 gibba020 bash[25448]: cephadm 2021-03-10T14:20:48.793854+0000 mgr.gibba020.yqfnwy (mgr.34427) 1509 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:20:50.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:50 gibba020 bash[25448]: cephadm 2021-03-10T14:20:48.793896+0000 mgr.gibba020.yqfnwy (mgr.34427) 1510 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:20:50.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:50 gibba020 bash[25448]: cephadm 2021-03-10T14:20:48.795137+0000 mgr.gibba020.yqfnwy (mgr.34427) 1511 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:20:50.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:50 gibba020 bash[25448]: cephadm 2021-03-10T14:20:48.795454+0000 mgr.gibba020.yqfnwy (mgr.34427) 1512 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:20:50.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:50 gibba020 bash[25448]: cephadm 2021-03-10T14:20:48.796661+0000 mgr.gibba020.yqfnwy (mgr.34427) 1513 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:20:50.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:50 gibba020 bash[25448]: cephadm 2021-03-10T14:20:48.796707+0000 mgr.gibba020.yqfnwy (mgr.34427) 1514 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:20:50.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:50 gibba020 bash[25448]: cephadm 2021-03-10T14:20:48.796821+0000 mgr.gibba020.yqfnwy (mgr.34427) 1515 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:20:50.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:50 gibba020 bash[25448]: cluster 2021-03-10T14:20:49.526503+0000 mgr.gibba020.yqfnwy (mgr.34427) 1516 : cluster [DBG] pgmap v846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:52.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:52 gibba013 bash[29418]: cluster 2021-03-10T14:20:51.528338+0000 mgr.gibba020.yqfnwy (mgr.34427) 1517 : cluster [DBG] pgmap v847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:52.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:52 gibba013 bash[30381]: cluster 2021-03-10T14:20:51.528338+0000 mgr.gibba020.yqfnwy (mgr.34427) 1517 : cluster [DBG] pgmap v847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:52.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:52 gibba020 bash[25448]: cluster 2021-03-10T14:20:51.528338+0000 mgr.gibba020.yqfnwy (mgr.34427) 1517 : cluster [DBG] pgmap v847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:54.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:54 gibba013 bash[29418]: cluster 2021-03-10T14:20:53.529782+0000 mgr.gibba020.yqfnwy (mgr.34427) 1518 : cluster [DBG] pgmap v848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:54.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:54 gibba013 bash[30381]: cluster 2021-03-10T14:20:53.529782+0000 mgr.gibba020.yqfnwy (mgr.34427) 1518 : cluster [DBG] pgmap v848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:54.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:54 gibba020 bash[25448]: cluster 2021-03-10T14:20:53.529782+0000 mgr.gibba020.yqfnwy (mgr.34427) 1518 : cluster [DBG] pgmap v848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:56.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:56 gibba013 bash[29418]: cluster 2021-03-10T14:20:55.530669+0000 mgr.gibba020.yqfnwy (mgr.34427) 1519 : cluster [DBG] pgmap v849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:56.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:56 gibba013 bash[30381]: cluster 2021-03-10T14:20:55.530669+0000 mgr.gibba020.yqfnwy (mgr.34427) 1519 : cluster [DBG] pgmap v849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:56.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:56 gibba020 bash[25448]: cluster 2021-03-10T14:20:55.530669+0000 mgr.gibba020.yqfnwy (mgr.34427) 1519 : cluster [DBG] pgmap v849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:58.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:20:58 gibba013 bash[29418]: cluster 2021-03-10T14:20:57.531844+0000 mgr.gibba020.yqfnwy (mgr.34427) 1520 : cluster [DBG] pgmap v850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:58.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:20:58 gibba013 bash[30381]: cluster 2021-03-10T14:20:57.531844+0000 mgr.gibba020.yqfnwy (mgr.34427) 1520 : cluster [DBG] pgmap v850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:20:58.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:20:58 gibba020 bash[25448]: cluster 2021-03-10T14:20:57.531844+0000 mgr.gibba020.yqfnwy (mgr.34427) 1520 : cluster [DBG] pgmap v850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:00.347 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:21:00.575 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:21:00.576 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (27m) 3m ago 32m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:21:00.576 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (32m) 2m ago 32m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:21:00.576 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (27m) 2m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:21:00.576 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (28m) 2m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:21:00.577 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (27m) 3m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:21:00.577 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (27m) 3m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:21:00.577 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (26m) 2m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:21:00.577 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (26m) 3m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:21:00.578 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (33m) 3m ago 33m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:21:00.578 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (33m) 2m ago 33m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:21:00.578 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (25m) 3m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:21:00.578 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (25m) 3m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:21:00.579 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (24m) 3m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:21:00.579 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (24m) 3m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:21:00.579 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (24m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:21:00.579 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (23m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:21:00.580 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (23m) 2m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:21:00.580 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (22m) 2m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:21:00.580 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (32m) 2m ago 33m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:21:00.580 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 31m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:21:00.828 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:21:00.828 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:21:00.829 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:21:00.829 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:21:00.829 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:21:00.829 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:21:00.830 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:21:00.830 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:21:00.830 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:21:00.830 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:21:00.830 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:21:00.831 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:21:00.831 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:21:00.831 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:21:00.831 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:21:00.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:00 gibba013 bash[29418]: cluster 2021-03-10T14:20:59.533157+0000 mgr.gibba020.yqfnwy (mgr.34427) 1521 : cluster [DBG] pgmap v851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:00.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:00 gibba013 bash[30381]: cluster 2021-03-10T14:20:59.533157+0000 mgr.gibba020.yqfnwy (mgr.34427) 1521 : cluster [DBG] pgmap v851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:00.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:00 gibba020 bash[25448]: cluster 2021-03-10T14:20:59.533157+0000 mgr.gibba020.yqfnwy (mgr.34427) 1521 : cluster [DBG] pgmap v851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:01.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:01 gibba013 bash[29418]: audit 2021-03-10T14:21:00.334766+0000 mgr.gibba020.yqfnwy (mgr.34427) 1522 : audit [DBG] from='client.45078 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:21:01.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:01 gibba013 bash[29418]: audit 2021-03-10T14:21:00.559697+0000 mgr.gibba020.yqfnwy (mgr.34427) 1523 : audit [DBG] from='client.55069 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:21:01.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:01 gibba013 bash[29418]: audit 2021-03-10T14:21:00.826774+0000 mon.a (mon.0) 1009 : audit [DBG] from='client.? 172.21.2.113:0/1848920565' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:01.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:01 gibba013 bash[30381]: audit 2021-03-10T14:21:00.334766+0000 mgr.gibba020.yqfnwy (mgr.34427) 1522 : audit [DBG] from='client.45078 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:21:01.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:01 gibba013 bash[30381]: audit 2021-03-10T14:21:00.559697+0000 mgr.gibba020.yqfnwy (mgr.34427) 1523 : audit [DBG] from='client.55069 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:21:01.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:01 gibba013 bash[30381]: audit 2021-03-10T14:21:00.826774+0000 mon.a (mon.0) 1009 : audit [DBG] from='client.? 172.21.2.113:0/1848920565' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:01.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:01 gibba020 bash[25448]: audit 2021-03-10T14:21:00.334766+0000 mgr.gibba020.yqfnwy (mgr.34427) 1522 : audit [DBG] from='client.45078 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:21:01.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:01 gibba020 bash[25448]: audit 2021-03-10T14:21:00.559697+0000 mgr.gibba020.yqfnwy (mgr.34427) 1523 : audit [DBG] from='client.55069 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:21:01.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:01 gibba020 bash[25448]: audit 2021-03-10T14:21:00.826774+0000 mon.a (mon.0) 1009 : audit [DBG] from='client.? 172.21.2.113:0/1848920565' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:02.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:02 gibba013 bash[29418]: cluster 2021-03-10T14:21:01.534882+0000 mgr.gibba020.yqfnwy (mgr.34427) 1524 : cluster [DBG] pgmap v852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:02.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:02 gibba013 bash[30381]: cluster 2021-03-10T14:21:01.534882+0000 mgr.gibba020.yqfnwy (mgr.34427) 1524 : cluster [DBG] pgmap v852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:02.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:02 gibba020 bash[25448]: cluster 2021-03-10T14:21:01.534882+0000 mgr.gibba020.yqfnwy (mgr.34427) 1524 : cluster [DBG] pgmap v852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:04.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:04 gibba013 bash[29418]: cluster 2021-03-10T14:21:03.536269+0000 mgr.gibba020.yqfnwy (mgr.34427) 1525 : cluster [DBG] pgmap v853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:04.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:04 gibba013 bash[30381]: cluster 2021-03-10T14:21:03.536269+0000 mgr.gibba020.yqfnwy (mgr.34427) 1525 : cluster [DBG] pgmap v853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:04.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:04 gibba020 bash[25448]: cluster 2021-03-10T14:21:03.536269+0000 mgr.gibba020.yqfnwy (mgr.34427) 1525 : cluster [DBG] pgmap v853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:05.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:05 gibba020 bash[25448]: cephadm 2021-03-10T14:21:03.812603+0000 mgr.gibba020.yqfnwy (mgr.34427) 1526 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:21:06.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:05 gibba013 bash[29418]: cephadm 2021-03-10T14:21:03.812603+0000 mgr.gibba020.yqfnwy (mgr.34427) 1526 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:21:06.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:05 gibba013 bash[30381]: cephadm 2021-03-10T14:21:03.812603+0000 mgr.gibba020.yqfnwy (mgr.34427) 1526 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:21:06.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:06 gibba020 bash[25448]: cluster 2021-03-10T14:21:05.537688+0000 mgr.gibba020.yqfnwy (mgr.34427) 1527 : cluster [DBG] pgmap v854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:06 gibba020 bash[25448]: audit 2021-03-10T14:21:05.993670+0000 mon.a (mon.0) 1010 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T14:21:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:06 gibba020 bash[25448]: audit 2021-03-10T14:21:05.994967+0000 mon.a (mon.0) 1011 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:21:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:06 gibba020 bash[25448]: audit 2021-03-10T14:21:05.996018+0000 mon.a (mon.0) 1012 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:21:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:06 gibba020 bash[25448]: audit 2021-03-10T14:21:05.997131+0000 mon.a (mon.0) 1013 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:21:06.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:06 gibba020 bash[25448]: audit 2021-03-10T14:21:06.109719+0000 mon.a (mon.0) 1014 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:21:06.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:06 gibba020 bash[25448]: audit 2021-03-10T14:21:06.116024+0000 mon.a (mon.0) 1015 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:21:07.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:06 gibba013 bash[29418]: cluster 2021-03-10T14:21:05.537688+0000 mgr.gibba020.yqfnwy (mgr.34427) 1527 : cluster [DBG] pgmap v854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:06 gibba013 bash[29418]: audit 2021-03-10T14:21:05.993670+0000 mon.a (mon.0) 1010 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T14:21:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:06 gibba013 bash[29418]: audit 2021-03-10T14:21:05.994967+0000 mon.a (mon.0) 1011 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:21:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:06 gibba013 bash[29418]: audit 2021-03-10T14:21:05.996018+0000 mon.a (mon.0) 1012 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:21:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:06 gibba013 bash[29418]: audit 2021-03-10T14:21:05.997131+0000 mon.a (mon.0) 1013 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:21:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:06 gibba013 bash[29418]: audit 2021-03-10T14:21:06.109719+0000 mon.a (mon.0) 1014 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:21:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:06 gibba013 bash[29418]: audit 2021-03-10T14:21:06.116024+0000 mon.a (mon.0) 1015 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:21:07.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:06 gibba013 bash[30381]: cluster 2021-03-10T14:21:05.537688+0000 mgr.gibba020.yqfnwy (mgr.34427) 1527 : cluster [DBG] pgmap v854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:07.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:06 gibba013 bash[30381]: audit 2021-03-10T14:21:05.993670+0000 mon.a (mon.0) 1010 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T14:21:07.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:06 gibba013 bash[30381]: audit 2021-03-10T14:21:05.994967+0000 mon.a (mon.0) 1011 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:21:07.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:06 gibba013 bash[30381]: audit 2021-03-10T14:21:05.996018+0000 mon.a (mon.0) 1012 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:21:07.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:06 gibba013 bash[30381]: audit 2021-03-10T14:21:05.997131+0000 mon.a (mon.0) 1013 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:21:07.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:06 gibba013 bash[30381]: audit 2021-03-10T14:21:06.109719+0000 mon.a (mon.0) 1014 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:21:07.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:06 gibba013 bash[30381]: audit 2021-03-10T14:21:06.116024+0000 mon.a (mon.0) 1015 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:21:08.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:08 gibba020 bash[25448]: cluster 2021-03-10T14:21:07.539089+0000 mgr.gibba020.yqfnwy (mgr.34427) 1528 : cluster [DBG] pgmap v855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:09.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:08 gibba013 bash[29418]: cluster 2021-03-10T14:21:07.539089+0000 mgr.gibba020.yqfnwy (mgr.34427) 1528 : cluster [DBG] pgmap v855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:09.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:08 gibba013 bash[30381]: cluster 2021-03-10T14:21:07.539089+0000 mgr.gibba020.yqfnwy (mgr.34427) 1528 : cluster [DBG] pgmap v855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:10.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:10 gibba020 bash[25448]: cluster 2021-03-10T14:21:09.540523+0000 mgr.gibba020.yqfnwy (mgr.34427) 1529 : cluster [DBG] pgmap v856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:11.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:10 gibba013 bash[29418]: cluster 2021-03-10T14:21:09.540523+0000 mgr.gibba020.yqfnwy (mgr.34427) 1529 : cluster [DBG] pgmap v856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:11.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:10 gibba013 bash[30381]: cluster 2021-03-10T14:21:09.540523+0000 mgr.gibba020.yqfnwy (mgr.34427) 1529 : cluster [DBG] pgmap v856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:12.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:12 gibba020 bash[25448]: cluster 2021-03-10T14:21:11.542111+0000 mgr.gibba020.yqfnwy (mgr.34427) 1530 : cluster [DBG] pgmap v857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:13.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:12 gibba013 bash[29418]: cluster 2021-03-10T14:21:11.542111+0000 mgr.gibba020.yqfnwy (mgr.34427) 1530 : cluster [DBG] pgmap v857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:13.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:12 gibba013 bash[30381]: cluster 2021-03-10T14:21:11.542111+0000 mgr.gibba020.yqfnwy (mgr.34427) 1530 : cluster [DBG] pgmap v857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:14.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:14 gibba020 bash[25448]: cluster 2021-03-10T14:21:13.543603+0000 mgr.gibba020.yqfnwy (mgr.34427) 1531 : cluster [DBG] pgmap v858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:15.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:14 gibba013 bash[29418]: cluster 2021-03-10T14:21:13.543603+0000 mgr.gibba020.yqfnwy (mgr.34427) 1531 : cluster [DBG] pgmap v858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:15.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:14 gibba013 bash[30381]: cluster 2021-03-10T14:21:13.543603+0000 mgr.gibba020.yqfnwy (mgr.34427) 1531 : cluster [DBG] pgmap v858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:16.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:16 gibba013 bash[29418]: cluster 2021-03-10T14:21:15.545187+0000 mgr.gibba020.yqfnwy (mgr.34427) 1532 : cluster [DBG] pgmap v859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:16.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:16 gibba013 bash[30381]: cluster 2021-03-10T14:21:15.545187+0000 mgr.gibba020.yqfnwy (mgr.34427) 1532 : cluster [DBG] pgmap v859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:16.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:16 gibba020 bash[25448]: cluster 2021-03-10T14:21:15.545187+0000 mgr.gibba020.yqfnwy (mgr.34427) 1532 : cluster [DBG] pgmap v859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:18.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:18 gibba013 bash[29418]: cluster 2021-03-10T14:21:17.546541+0000 mgr.gibba020.yqfnwy (mgr.34427) 1533 : cluster [DBG] pgmap v860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:18.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:18 gibba013 bash[30381]: cluster 2021-03-10T14:21:17.546541+0000 mgr.gibba020.yqfnwy (mgr.34427) 1533 : cluster [DBG] pgmap v860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:18.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:18 gibba020 bash[25448]: cluster 2021-03-10T14:21:17.546541+0000 mgr.gibba020.yqfnwy (mgr.34427) 1533 : cluster [DBG] pgmap v860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:20.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:20 gibba013 bash[29418]: cephadm 2021-03-10T14:21:18.815076+0000 mgr.gibba020.yqfnwy (mgr.34427) 1534 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:21:20.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:20 gibba013 bash[29418]: cluster 2021-03-10T14:21:19.547781+0000 mgr.gibba020.yqfnwy (mgr.34427) 1535 : cluster [DBG] pgmap v861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:20.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:20 gibba013 bash[30381]: cephadm 2021-03-10T14:21:18.815076+0000 mgr.gibba020.yqfnwy (mgr.34427) 1534 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:21:20.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:20 gibba013 bash[30381]: cluster 2021-03-10T14:21:19.547781+0000 mgr.gibba020.yqfnwy (mgr.34427) 1535 : cluster [DBG] pgmap v861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:20.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:20 gibba020 bash[25448]: cephadm 2021-03-10T14:21:18.815076+0000 mgr.gibba020.yqfnwy (mgr.34427) 1534 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:21:20.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:20 gibba020 bash[25448]: cluster 2021-03-10T14:21:19.547781+0000 mgr.gibba020.yqfnwy (mgr.34427) 1535 : cluster [DBG] pgmap v861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:22.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:22 gibba013 bash[29418]: cluster 2021-03-10T14:21:21.549266+0000 mgr.gibba020.yqfnwy (mgr.34427) 1536 : cluster [DBG] pgmap v862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:22.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:22 gibba013 bash[30381]: cluster 2021-03-10T14:21:21.549266+0000 mgr.gibba020.yqfnwy (mgr.34427) 1536 : cluster [DBG] pgmap v862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:22.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:22 gibba020 bash[25448]: cluster 2021-03-10T14:21:21.549266+0000 mgr.gibba020.yqfnwy (mgr.34427) 1536 : cluster [DBG] pgmap v862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:24.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:24 gibba020 bash[25448]: cluster 2021-03-10T14:21:23.550687+0000 mgr.gibba020.yqfnwy (mgr.34427) 1537 : cluster [DBG] pgmap v863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:25.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:24 gibba013 bash[29418]: cluster 2021-03-10T14:21:23.550687+0000 mgr.gibba020.yqfnwy (mgr.34427) 1537 : cluster [DBG] pgmap v863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:25.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:24 gibba013 bash[30381]: cluster 2021-03-10T14:21:23.550687+0000 mgr.gibba020.yqfnwy (mgr.34427) 1537 : cluster [DBG] pgmap v863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:26.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:26 gibba013 bash[29418]: cluster 2021-03-10T14:21:25.552503+0000 mgr.gibba020.yqfnwy (mgr.34427) 1538 : cluster [DBG] pgmap v864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:26.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:26 gibba013 bash[30381]: cluster 2021-03-10T14:21:25.552503+0000 mgr.gibba020.yqfnwy (mgr.34427) 1538 : cluster [DBG] pgmap v864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:26.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:26 gibba020 bash[25448]: cluster 2021-03-10T14:21:25.552503+0000 mgr.gibba020.yqfnwy (mgr.34427) 1538 : cluster [DBG] pgmap v864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:28.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:28 gibba013 bash[29418]: cluster 2021-03-10T14:21:27.554036+0000 mgr.gibba020.yqfnwy (mgr.34427) 1539 : cluster [DBG] pgmap v865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:28.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:28 gibba013 bash[30381]: cluster 2021-03-10T14:21:27.554036+0000 mgr.gibba020.yqfnwy (mgr.34427) 1539 : cluster [DBG] pgmap v865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:28.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:28 gibba020 bash[25448]: cluster 2021-03-10T14:21:27.554036+0000 mgr.gibba020.yqfnwy (mgr.34427) 1539 : cluster [DBG] pgmap v865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:30.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:30 gibba013 bash[29418]: cluster 2021-03-10T14:21:29.555586+0000 mgr.gibba020.yqfnwy (mgr.34427) 1540 : cluster [DBG] pgmap v866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:30.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:30 gibba013 bash[30381]: cluster 2021-03-10T14:21:29.555586+0000 mgr.gibba020.yqfnwy (mgr.34427) 1540 : cluster [DBG] pgmap v866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:30.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:30 gibba020 bash[25448]: cluster 2021-03-10T14:21:29.555586+0000 mgr.gibba020.yqfnwy (mgr.34427) 1540 : cluster [DBG] pgmap v866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:31.069 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:21:31.296 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:21:31.296 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (28m) 3m ago 33m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:21:31.297 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (33m) 2m ago 33m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:21:31.297 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (28m) 2m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:21:31.297 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (28m) 2m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:21:31.297 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (27m) 3m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:21:31.298 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (27m) 3m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:21:31.298 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (27m) 2m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:21:31.298 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (27m) 3m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:21:31.298 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (33m) 3m ago 33m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:21:31.298 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (33m) 2m ago 33m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:21:31.299 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (26m) 3m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:21:31.299 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (25m) 3m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:21:31.299 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (25m) 3m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:21:31.299 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (25m) 3m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:21:31.299 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (24m) 2m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:21:31.300 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (24m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:21:31.300 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (23m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:21:31.300 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (23m) 2m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:21:31.300 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (32m) 2m ago 33m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:21:31.300 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 31m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:21:31.543 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:21:31.543 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:21:31.543 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:21:31.544 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:21:31.544 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:21:31.544 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:21:31.544 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:21:31.544 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:21:31.545 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:21:31.545 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:21:31.545 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:21:31.545 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:21:31.546 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:21:31.546 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:21:31.546 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:21:31.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:31 gibba020 bash[25448]: audit 2021-03-10T14:21:31.541584+0000 mon.c (mon.1) 35 : audit [DBG] from='client.? 172.21.2.113:0/2019314017' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:32.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:31 gibba013 bash[29418]: audit 2021-03-10T14:21:31.541584+0000 mon.c (mon.1) 35 : audit [DBG] from='client.? 172.21.2.113:0/2019314017' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:32.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:31 gibba013 bash[30381]: audit 2021-03-10T14:21:31.541584+0000 mon.c (mon.1) 35 : audit [DBG] from='client.? 172.21.2.113:0/2019314017' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:32.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:32 gibba020 bash[25448]: audit 2021-03-10T14:21:31.057308+0000 mgr.gibba020.yqfnwy (mgr.34427) 1541 : audit [DBG] from='client.45096 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:21:32.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:32 gibba020 bash[25448]: audit 2021-03-10T14:21:31.280250+0000 mgr.gibba020.yqfnwy (mgr.34427) 1542 : audit [DBG] from='client.55087 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:21:32.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:32 gibba020 bash[25448]: cluster 2021-03-10T14:21:31.557380+0000 mgr.gibba020.yqfnwy (mgr.34427) 1543 : cluster [DBG] pgmap v867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:33.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:32 gibba013 bash[29418]: audit 2021-03-10T14:21:31.057308+0000 mgr.gibba020.yqfnwy (mgr.34427) 1541 : audit [DBG] from='client.45096 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:21:33.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:32 gibba013 bash[29418]: audit 2021-03-10T14:21:31.280250+0000 mgr.gibba020.yqfnwy (mgr.34427) 1542 : audit [DBG] from='client.55087 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:21:33.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:32 gibba013 bash[29418]: cluster 2021-03-10T14:21:31.557380+0000 mgr.gibba020.yqfnwy (mgr.34427) 1543 : cluster [DBG] pgmap v867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:33.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:32 gibba013 bash[30381]: audit 2021-03-10T14:21:31.057308+0000 mgr.gibba020.yqfnwy (mgr.34427) 1541 : audit [DBG] from='client.45096 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:21:33.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:32 gibba013 bash[30381]: audit 2021-03-10T14:21:31.280250+0000 mgr.gibba020.yqfnwy (mgr.34427) 1542 : audit [DBG] from='client.55087 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:21:33.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:32 gibba013 bash[30381]: cluster 2021-03-10T14:21:31.557380+0000 mgr.gibba020.yqfnwy (mgr.34427) 1543 : cluster [DBG] pgmap v867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:34.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:34 gibba020 bash[25448]: cluster 2021-03-10T14:21:33.558767+0000 mgr.gibba020.yqfnwy (mgr.34427) 1544 : cluster [DBG] pgmap v868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:35.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:34 gibba013 bash[29418]: cluster 2021-03-10T14:21:33.558767+0000 mgr.gibba020.yqfnwy (mgr.34427) 1544 : cluster [DBG] pgmap v868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:35.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:34 gibba013 bash[30381]: cluster 2021-03-10T14:21:33.558767+0000 mgr.gibba020.yqfnwy (mgr.34427) 1544 : cluster [DBG] pgmap v868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:35.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:35 gibba020 bash[25448]: cephadm 2021-03-10T14:21:33.830804+0000 mgr.gibba020.yqfnwy (mgr.34427) 1545 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:21:36.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:35 gibba013 bash[29418]: cephadm 2021-03-10T14:21:33.830804+0000 mgr.gibba020.yqfnwy (mgr.34427) 1545 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:21:36.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:35 gibba013 bash[30381]: cephadm 2021-03-10T14:21:33.830804+0000 mgr.gibba020.yqfnwy (mgr.34427) 1545 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:21:36.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:36 gibba020 bash[25448]: cluster 2021-03-10T14:21:35.560364+0000 mgr.gibba020.yqfnwy (mgr.34427) 1546 : cluster [DBG] pgmap v869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:37.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:36 gibba013 bash[29418]: cluster 2021-03-10T14:21:35.560364+0000 mgr.gibba020.yqfnwy (mgr.34427) 1546 : cluster [DBG] pgmap v869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:37.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:36 gibba013 bash[30381]: cluster 2021-03-10T14:21:35.560364+0000 mgr.gibba020.yqfnwy (mgr.34427) 1546 : cluster [DBG] pgmap v869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:38.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:38 gibba020 bash[25448]: cluster 2021-03-10T14:21:37.561931+0000 mgr.gibba020.yqfnwy (mgr.34427) 1547 : cluster [DBG] pgmap v870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:39.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:38 gibba013 bash[29418]: cluster 2021-03-10T14:21:37.561931+0000 mgr.gibba020.yqfnwy (mgr.34427) 1547 : cluster [DBG] pgmap v870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:39.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:38 gibba013 bash[30381]: cluster 2021-03-10T14:21:37.561931+0000 mgr.gibba020.yqfnwy (mgr.34427) 1547 : cluster [DBG] pgmap v870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:40.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:40 gibba020 bash[25448]: cluster 2021-03-10T14:21:39.563286+0000 mgr.gibba020.yqfnwy (mgr.34427) 1548 : cluster [DBG] pgmap v871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:41.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:40 gibba013 bash[29418]: cluster 2021-03-10T14:21:39.563286+0000 mgr.gibba020.yqfnwy (mgr.34427) 1548 : cluster [DBG] pgmap v871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:41.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:40 gibba013 bash[30381]: cluster 2021-03-10T14:21:39.563286+0000 mgr.gibba020.yqfnwy (mgr.34427) 1548 : cluster [DBG] pgmap v871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:42.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:42 gibba020 bash[25448]: cluster 2021-03-10T14:21:41.565188+0000 mgr.gibba020.yqfnwy (mgr.34427) 1549 : cluster [DBG] pgmap v872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:43.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:42 gibba013 bash[29418]: cluster 2021-03-10T14:21:41.565188+0000 mgr.gibba020.yqfnwy (mgr.34427) 1549 : cluster [DBG] pgmap v872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:43.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:42 gibba013 bash[30381]: cluster 2021-03-10T14:21:41.565188+0000 mgr.gibba020.yqfnwy (mgr.34427) 1549 : cluster [DBG] pgmap v872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:44.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:44 gibba020 bash[25448]: cluster 2021-03-10T14:21:43.566534+0000 mgr.gibba020.yqfnwy (mgr.34427) 1550 : cluster [DBG] pgmap v873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:45.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:44 gibba013 bash[29418]: cluster 2021-03-10T14:21:43.566534+0000 mgr.gibba020.yqfnwy (mgr.34427) 1550 : cluster [DBG] pgmap v873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:45.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:44 gibba013 bash[30381]: cluster 2021-03-10T14:21:43.566534+0000 mgr.gibba020.yqfnwy (mgr.34427) 1550 : cluster [DBG] pgmap v873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:46.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:46 gibba013 bash[29418]: cluster 2021-03-10T14:21:45.568193+0000 mgr.gibba020.yqfnwy (mgr.34427) 1551 : cluster [DBG] pgmap v874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:46.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:46 gibba013 bash[30381]: cluster 2021-03-10T14:21:45.568193+0000 mgr.gibba020.yqfnwy (mgr.34427) 1551 : cluster [DBG] pgmap v874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:46.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:46 gibba020 bash[25448]: cluster 2021-03-10T14:21:45.568193+0000 mgr.gibba020.yqfnwy (mgr.34427) 1551 : cluster [DBG] pgmap v874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:48.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:48 gibba020 bash[25448]: cluster 2021-03-10T14:21:47.569573+0000 mgr.gibba020.yqfnwy (mgr.34427) 1552 : cluster [DBG] pgmap v875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:49.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:48 gibba013 bash[29418]: cluster 2021-03-10T14:21:47.569573+0000 mgr.gibba020.yqfnwy (mgr.34427) 1552 : cluster [DBG] pgmap v875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:49.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:48 gibba013 bash[30381]: cluster 2021-03-10T14:21:47.569573+0000 mgr.gibba020.yqfnwy (mgr.34427) 1552 : cluster [DBG] pgmap v875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:49.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:49 gibba020 bash[25448]: audit 2021-03-10T14:21:48.849474+0000 mon.a (mon.0) 1016 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:21:49.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:49 gibba020 bash[25448]: audit 2021-03-10T14:21:49.068552+0000 mon.a (mon.0) 1017 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:21:49.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:49 gibba020 bash[25448]: audit 2021-03-10T14:21:49.071943+0000 mon.a (mon.0) 1018 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:21:49.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:49 gibba020 bash[25448]: audit 2021-03-10T14:21:49.073274+0000 mon.a (mon.0) 1019 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:49.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:49 gibba020 bash[25448]: audit 2021-03-10T14:21:49.074536+0000 mon.a (mon.0) 1020 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:49.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:49 gibba020 bash[25448]: audit 2021-03-10T14:21:49.075843+0000 mon.a (mon.0) 1021 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:49.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:49 gibba020 bash[25448]: audit 2021-03-10T14:21:49.077660+0000 mon.a (mon.0) 1022 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:49.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:49 gibba020 bash[25448]: audit 2021-03-10T14:21:49.079032+0000 mon.a (mon.0) 1023 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:50.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:49 gibba013 bash[29418]: audit 2021-03-10T14:21:48.849474+0000 mon.a (mon.0) 1016 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:21:50.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:49 gibba013 bash[29418]: audit 2021-03-10T14:21:49.068552+0000 mon.a (mon.0) 1017 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:21:50.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:49 gibba013 bash[29418]: audit 2021-03-10T14:21:49.071943+0000 mon.a (mon.0) 1018 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:21:50.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:49 gibba013 bash[29418]: audit 2021-03-10T14:21:49.073274+0000 mon.a (mon.0) 1019 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:50.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:49 gibba013 bash[29418]: audit 2021-03-10T14:21:49.074536+0000 mon.a (mon.0) 1020 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:50.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:49 gibba013 bash[29418]: audit 2021-03-10T14:21:49.075843+0000 mon.a (mon.0) 1021 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:50.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:49 gibba013 bash[29418]: audit 2021-03-10T14:21:49.077660+0000 mon.a (mon.0) 1022 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:50.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:49 gibba013 bash[29418]: audit 2021-03-10T14:21:49.079032+0000 mon.a (mon.0) 1023 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:50.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:49 gibba013 bash[30381]: audit 2021-03-10T14:21:48.849474+0000 mon.a (mon.0) 1016 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:21:50.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:49 gibba013 bash[30381]: audit 2021-03-10T14:21:49.068552+0000 mon.a (mon.0) 1017 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:21:50.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:49 gibba013 bash[30381]: audit 2021-03-10T14:21:49.071943+0000 mon.a (mon.0) 1018 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:21:50.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:49 gibba013 bash[30381]: audit 2021-03-10T14:21:49.073274+0000 mon.a (mon.0) 1019 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:50.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:49 gibba013 bash[30381]: audit 2021-03-10T14:21:49.074536+0000 mon.a (mon.0) 1020 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:50.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:49 gibba013 bash[30381]: audit 2021-03-10T14:21:49.075843+0000 mon.a (mon.0) 1021 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:50.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:49 gibba013 bash[30381]: audit 2021-03-10T14:21:49.077660+0000 mon.a (mon.0) 1022 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:50.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:49 gibba013 bash[30381]: audit 2021-03-10T14:21:49.079032+0000 mon.a (mon.0) 1023 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:21:50.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:50 gibba020 bash[25448]: cephadm 2021-03-10T14:21:48.853260+0000 mgr.gibba020.yqfnwy (mgr.34427) 1553 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:21:50.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:50 gibba020 bash[25448]: cephadm 2021-03-10T14:21:48.855153+0000 mgr.gibba020.yqfnwy (mgr.34427) 1554 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:21:50.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:50 gibba020 bash[25448]: cephadm 2021-03-10T14:21:49.069509+0000 mgr.gibba020.yqfnwy (mgr.34427) 1555 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:21:50.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:50 gibba020 bash[25448]: cephadm 2021-03-10T14:21:49.071141+0000 mgr.gibba020.yqfnwy (mgr.34427) 1556 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:21:50.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:50 gibba020 bash[25448]: cephadm 2021-03-10T14:21:49.072253+0000 mgr.gibba020.yqfnwy (mgr.34427) 1557 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:21:50.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:50 gibba020 bash[25448]: cephadm 2021-03-10T14:21:49.072290+0000 mgr.gibba020.yqfnwy (mgr.34427) 1558 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:21:50.957 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:50 gibba020 bash[25448]: cephadm 2021-03-10T14:21:49.073777+0000 mgr.gibba020.yqfnwy (mgr.34427) 1559 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:21:50.957 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:50 gibba020 bash[25448]: cephadm 2021-03-10T14:21:49.073862+0000 mgr.gibba020.yqfnwy (mgr.34427) 1560 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:21:50.957 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:50 gibba020 bash[25448]: cephadm 2021-03-10T14:21:49.074698+0000 mgr.gibba020.yqfnwy (mgr.34427) 1561 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:21:50.958 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:50 gibba020 bash[25448]: cephadm 2021-03-10T14:21:49.075450+0000 mgr.gibba020.yqfnwy (mgr.34427) 1562 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:21:50.958 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:50 gibba020 bash[25448]: cephadm 2021-03-10T14:21:49.075486+0000 mgr.gibba020.yqfnwy (mgr.34427) 1563 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:21:50.959 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:50 gibba020 bash[25448]: cephadm 2021-03-10T14:21:49.076719+0000 mgr.gibba020.yqfnwy (mgr.34427) 1564 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:21:50.959 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:50 gibba020 bash[25448]: cephadm 2021-03-10T14:21:49.077046+0000 mgr.gibba020.yqfnwy (mgr.34427) 1565 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:21:50.959 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:50 gibba020 bash[25448]: cephadm 2021-03-10T14:21:49.078049+0000 mgr.gibba020.yqfnwy (mgr.34427) 1566 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:21:50.959 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:50 gibba020 bash[25448]: cephadm 2021-03-10T14:21:49.078088+0000 mgr.gibba020.yqfnwy (mgr.34427) 1567 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:21:50.960 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:50 gibba020 bash[25448]: cephadm 2021-03-10T14:21:49.078285+0000 mgr.gibba020.yqfnwy (mgr.34427) 1568 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:21:50.960 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:50 gibba020 bash[25448]: cluster 2021-03-10T14:21:49.571060+0000 mgr.gibba020.yqfnwy (mgr.34427) 1569 : cluster [DBG] pgmap v876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:51.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:50 gibba013 bash[29418]: cephadm 2021-03-10T14:21:48.853260+0000 mgr.gibba020.yqfnwy (mgr.34427) 1553 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:21:51.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:50 gibba013 bash[29418]: cephadm 2021-03-10T14:21:48.855153+0000 mgr.gibba020.yqfnwy (mgr.34427) 1554 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:21:51.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:50 gibba013 bash[29418]: cephadm 2021-03-10T14:21:49.069509+0000 mgr.gibba020.yqfnwy (mgr.34427) 1555 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:21:51.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:50 gibba013 bash[29418]: cephadm 2021-03-10T14:21:49.071141+0000 mgr.gibba020.yqfnwy (mgr.34427) 1556 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:21:51.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:50 gibba013 bash[29418]: cephadm 2021-03-10T14:21:49.072253+0000 mgr.gibba020.yqfnwy (mgr.34427) 1557 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:21:51.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:50 gibba013 bash[29418]: cephadm 2021-03-10T14:21:49.072290+0000 mgr.gibba020.yqfnwy (mgr.34427) 1558 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:21:51.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:50 gibba013 bash[29418]: cephadm 2021-03-10T14:21:49.073777+0000 mgr.gibba020.yqfnwy (mgr.34427) 1559 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:21:51.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:50 gibba013 bash[29418]: cephadm 2021-03-10T14:21:49.073862+0000 mgr.gibba020.yqfnwy (mgr.34427) 1560 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:21:51.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:50 gibba013 bash[29418]: cephadm 2021-03-10T14:21:49.074698+0000 mgr.gibba020.yqfnwy (mgr.34427) 1561 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:21:51.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:50 gibba013 bash[29418]: cephadm 2021-03-10T14:21:49.075450+0000 mgr.gibba020.yqfnwy (mgr.34427) 1562 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:21:51.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:50 gibba013 bash[29418]: cephadm 2021-03-10T14:21:49.075486+0000 mgr.gibba020.yqfnwy (mgr.34427) 1563 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:21:51.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:50 gibba013 bash[29418]: cephadm 2021-03-10T14:21:49.076719+0000 mgr.gibba020.yqfnwy (mgr.34427) 1564 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:21:51.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:50 gibba013 bash[29418]: cephadm 2021-03-10T14:21:49.077046+0000 mgr.gibba020.yqfnwy (mgr.34427) 1565 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:21:51.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:50 gibba013 bash[29418]: cephadm 2021-03-10T14:21:49.078049+0000 mgr.gibba020.yqfnwy (mgr.34427) 1566 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:21:51.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:50 gibba013 bash[29418]: cephadm 2021-03-10T14:21:49.078088+0000 mgr.gibba020.yqfnwy (mgr.34427) 1567 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:21:51.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:50 gibba013 bash[29418]: cephadm 2021-03-10T14:21:49.078285+0000 mgr.gibba020.yqfnwy (mgr.34427) 1568 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:21:51.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:50 gibba013 bash[29418]: cluster 2021-03-10T14:21:49.571060+0000 mgr.gibba020.yqfnwy (mgr.34427) 1569 : cluster [DBG] pgmap v876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:51.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:50 gibba013 bash[30381]: cephadm 2021-03-10T14:21:48.853260+0000 mgr.gibba020.yqfnwy (mgr.34427) 1553 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:21:51.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:50 gibba013 bash[30381]: cephadm 2021-03-10T14:21:48.855153+0000 mgr.gibba020.yqfnwy (mgr.34427) 1554 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:21:51.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:50 gibba013 bash[30381]: cephadm 2021-03-10T14:21:49.069509+0000 mgr.gibba020.yqfnwy (mgr.34427) 1555 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:21:51.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:50 gibba013 bash[30381]: cephadm 2021-03-10T14:21:49.071141+0000 mgr.gibba020.yqfnwy (mgr.34427) 1556 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:21:51.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:50 gibba013 bash[30381]: cephadm 2021-03-10T14:21:49.072253+0000 mgr.gibba020.yqfnwy (mgr.34427) 1557 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:21:51.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:50 gibba013 bash[30381]: cephadm 2021-03-10T14:21:49.072290+0000 mgr.gibba020.yqfnwy (mgr.34427) 1558 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:21:51.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:50 gibba013 bash[30381]: cephadm 2021-03-10T14:21:49.073777+0000 mgr.gibba020.yqfnwy (mgr.34427) 1559 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:21:51.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:50 gibba013 bash[30381]: cephadm 2021-03-10T14:21:49.073862+0000 mgr.gibba020.yqfnwy (mgr.34427) 1560 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:21:51.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:50 gibba013 bash[30381]: cephadm 2021-03-10T14:21:49.074698+0000 mgr.gibba020.yqfnwy (mgr.34427) 1561 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:21:51.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:50 gibba013 bash[30381]: cephadm 2021-03-10T14:21:49.075450+0000 mgr.gibba020.yqfnwy (mgr.34427) 1562 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:21:51.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:50 gibba013 bash[30381]: cephadm 2021-03-10T14:21:49.075486+0000 mgr.gibba020.yqfnwy (mgr.34427) 1563 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:21:51.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:50 gibba013 bash[30381]: cephadm 2021-03-10T14:21:49.076719+0000 mgr.gibba020.yqfnwy (mgr.34427) 1564 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:21:51.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:50 gibba013 bash[30381]: cephadm 2021-03-10T14:21:49.077046+0000 mgr.gibba020.yqfnwy (mgr.34427) 1565 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:21:51.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:50 gibba013 bash[30381]: cephadm 2021-03-10T14:21:49.078049+0000 mgr.gibba020.yqfnwy (mgr.34427) 1566 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:21:51.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:50 gibba013 bash[30381]: cephadm 2021-03-10T14:21:49.078088+0000 mgr.gibba020.yqfnwy (mgr.34427) 1567 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:21:51.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:50 gibba013 bash[30381]: cephadm 2021-03-10T14:21:49.078285+0000 mgr.gibba020.yqfnwy (mgr.34427) 1568 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:21:51.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:50 gibba013 bash[30381]: cluster 2021-03-10T14:21:49.571060+0000 mgr.gibba020.yqfnwy (mgr.34427) 1569 : cluster [DBG] pgmap v876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:52.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:52 gibba020 bash[25448]: cluster 2021-03-10T14:21:51.572933+0000 mgr.gibba020.yqfnwy (mgr.34427) 1570 : cluster [DBG] pgmap v877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:53.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:52 gibba013 bash[29418]: cluster 2021-03-10T14:21:51.572933+0000 mgr.gibba020.yqfnwy (mgr.34427) 1570 : cluster [DBG] pgmap v877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:53.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:52 gibba013 bash[30381]: cluster 2021-03-10T14:21:51.572933+0000 mgr.gibba020.yqfnwy (mgr.34427) 1570 : cluster [DBG] pgmap v877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:54.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:54 gibba020 bash[25448]: cluster 2021-03-10T14:21:53.574296+0000 mgr.gibba020.yqfnwy (mgr.34427) 1571 : cluster [DBG] pgmap v878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:55.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:54 gibba013 bash[29418]: cluster 2021-03-10T14:21:53.574296+0000 mgr.gibba020.yqfnwy (mgr.34427) 1571 : cluster [DBG] pgmap v878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:55.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:54 gibba013 bash[30381]: cluster 2021-03-10T14:21:53.574296+0000 mgr.gibba020.yqfnwy (mgr.34427) 1571 : cluster [DBG] pgmap v878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:56.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:56 gibba013 bash[29418]: cluster 2021-03-10T14:21:55.575871+0000 mgr.gibba020.yqfnwy (mgr.34427) 1572 : cluster [DBG] pgmap v879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:56.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:56 gibba013 bash[30381]: cluster 2021-03-10T14:21:55.575871+0000 mgr.gibba020.yqfnwy (mgr.34427) 1572 : cluster [DBG] pgmap v879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:56.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:56 gibba020 bash[25448]: cluster 2021-03-10T14:21:55.575871+0000 mgr.gibba020.yqfnwy (mgr.34427) 1572 : cluster [DBG] pgmap v879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:58.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:21:58 gibba020 bash[25448]: cluster 2021-03-10T14:21:57.577489+0000 mgr.gibba020.yqfnwy (mgr.34427) 1573 : cluster [DBG] pgmap v880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:59.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:21:58 gibba013 bash[29418]: cluster 2021-03-10T14:21:57.577489+0000 mgr.gibba020.yqfnwy (mgr.34427) 1573 : cluster [DBG] pgmap v880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:21:59.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:21:58 gibba013 bash[30381]: cluster 2021-03-10T14:21:57.577489+0000 mgr.gibba020.yqfnwy (mgr.34427) 1573 : cluster [DBG] pgmap v880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:00.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:00 gibba020 bash[25448]: cluster 2021-03-10T14:21:59.579025+0000 mgr.gibba020.yqfnwy (mgr.34427) 1574 : cluster [DBG] pgmap v881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:01.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:00 gibba013 bash[29418]: cluster 2021-03-10T14:21:59.579025+0000 mgr.gibba020.yqfnwy (mgr.34427) 1574 : cluster [DBG] pgmap v881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:01.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:00 gibba013 bash[30381]: cluster 2021-03-10T14:21:59.579025+0000 mgr.gibba020.yqfnwy (mgr.34427) 1574 : cluster [DBG] pgmap v881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:01.790 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:22:02.045 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:22:02.046 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (28m) 4m ago 33m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:22:02.046 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (33m) 3m ago 33m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:22:02.046 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (28m) 3m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:22:02.046 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (29m) 3m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:22:02.047 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (28m) 4m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:22:02.047 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (28m) 4m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:22:02.047 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (27m) 3m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:22:02.047 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (27m) 4m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:22:02.047 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (34m) 4m ago 34m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:22:02.048 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (34m) 3m ago 34m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:22:02.048 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (26m) 4m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:22:02.048 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (26m) 4m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:22:02.048 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (25m) 4m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:22:02.049 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (25m) 4m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:22:02.049 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (25m) 3m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:22:02.049 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (24m) 3m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:22:02.049 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (24m) 3m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:22:02.049 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (23m) 3m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:22:02.050 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (33m) 3m ago 34m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:22:02.050 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 3m ago 32m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:22:02.296 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:22:02.296 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:22:02.296 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:22:02.297 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:22:02.297 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:22:02.297 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:22:02.297 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:22:02.297 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:22:02.298 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:22:02.298 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:22:02.298 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:22:02.298 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:22:02.299 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:22:02.299 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:22:02.299 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:22:02.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:02 gibba020 bash[25448]: cluster 2021-03-10T14:22:01.580872+0000 mgr.gibba020.yqfnwy (mgr.34427) 1575 : cluster [DBG] pgmap v882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:02.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:02 gibba020 bash[25448]: audit 2021-03-10T14:22:01.778107+0000 mgr.gibba020.yqfnwy (mgr.34427) 1576 : audit [DBG] from='client.45114 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:22:02.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:02 gibba020 bash[25448]: audit 2021-03-10T14:22:02.294661+0000 mon.c (mon.1) 36 : audit [DBG] from='client.? 172.21.2.113:0/1819685904' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:03.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:02 gibba013 bash[29418]: cluster 2021-03-10T14:22:01.580872+0000 mgr.gibba020.yqfnwy (mgr.34427) 1575 : cluster [DBG] pgmap v882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:03.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:02 gibba013 bash[29418]: audit 2021-03-10T14:22:01.778107+0000 mgr.gibba020.yqfnwy (mgr.34427) 1576 : audit [DBG] from='client.45114 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:22:03.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:02 gibba013 bash[29418]: audit 2021-03-10T14:22:02.294661+0000 mon.c (mon.1) 36 : audit [DBG] from='client.? 172.21.2.113:0/1819685904' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:03.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:02 gibba013 bash[30381]: cluster 2021-03-10T14:22:01.580872+0000 mgr.gibba020.yqfnwy (mgr.34427) 1575 : cluster [DBG] pgmap v882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:03.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:02 gibba013 bash[30381]: audit 2021-03-10T14:22:01.778107+0000 mgr.gibba020.yqfnwy (mgr.34427) 1576 : audit [DBG] from='client.45114 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:22:03.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:02 gibba013 bash[30381]: audit 2021-03-10T14:22:02.294661+0000 mon.c (mon.1) 36 : audit [DBG] from='client.? 172.21.2.113:0/1819685904' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:03.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:03 gibba020 bash[25448]: audit 2021-03-10T14:22:02.000385+0000 mgr.gibba020.yqfnwy (mgr.34427) 1577 : audit [DBG] from='client.45120 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:22:04.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:03 gibba013 bash[29418]: audit 2021-03-10T14:22:02.000385+0000 mgr.gibba020.yqfnwy (mgr.34427) 1577 : audit [DBG] from='client.45120 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:22:04.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:03 gibba013 bash[30381]: audit 2021-03-10T14:22:02.000385+0000 mgr.gibba020.yqfnwy (mgr.34427) 1577 : audit [DBG] from='client.45120 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:22:04.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:04 gibba020 bash[25448]: cluster 2021-03-10T14:22:03.582245+0000 mgr.gibba020.yqfnwy (mgr.34427) 1578 : cluster [DBG] pgmap v883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:05.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:04 gibba013 bash[29418]: cluster 2021-03-10T14:22:03.582245+0000 mgr.gibba020.yqfnwy (mgr.34427) 1578 : cluster [DBG] pgmap v883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:05.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:04 gibba013 bash[30381]: cluster 2021-03-10T14:22:03.582245+0000 mgr.gibba020.yqfnwy (mgr.34427) 1578 : cluster [DBG] pgmap v883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:05.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:05 gibba020 bash[25448]: cephadm 2021-03-10T14:22:04.091211+0000 mgr.gibba020.yqfnwy (mgr.34427) 1579 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:22:06.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:05 gibba013 bash[29418]: cephadm 2021-03-10T14:22:04.091211+0000 mgr.gibba020.yqfnwy (mgr.34427) 1579 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:22:06.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:05 gibba013 bash[30381]: cephadm 2021-03-10T14:22:04.091211+0000 mgr.gibba020.yqfnwy (mgr.34427) 1579 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:22:06.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:06 gibba020 bash[25448]: cluster 2021-03-10T14:22:05.584025+0000 mgr.gibba020.yqfnwy (mgr.34427) 1580 : cluster [DBG] pgmap v884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:06.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:06 gibba020 bash[25448]: audit 2021-03-10T14:22:06.005632+0000 mon.a (mon.0) 1024 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:22:06.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:06 gibba020 bash[25448]: audit 2021-03-10T14:22:06.006407+0000 mon.a (mon.0) 1025 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:22:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:06 gibba020 bash[25448]: audit 2021-03-10T14:22:06.007075+0000 mon.a (mon.0) 1026 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:22:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:06 gibba020 bash[25448]: audit 2021-03-10T14:22:06.007774+0000 mon.a (mon.0) 1027 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:22:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:06 gibba020 bash[25448]: audit 2021-03-10T14:22:06.116534+0000 mon.a (mon.0) 1028 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:22:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:06 gibba020 bash[25448]: audit 2021-03-10T14:22:06.122806+0000 mon.a (mon.0) 1029 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:22:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:06 gibba013 bash[29418]: cluster 2021-03-10T14:22:05.584025+0000 mgr.gibba020.yqfnwy (mgr.34427) 1580 : cluster [DBG] pgmap v884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:06 gibba013 bash[29418]: audit 2021-03-10T14:22:06.005632+0000 mon.a (mon.0) 1024 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:22:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:06 gibba013 bash[29418]: audit 2021-03-10T14:22:06.006407+0000 mon.a (mon.0) 1025 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:22:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:06 gibba013 bash[29418]: audit 2021-03-10T14:22:06.007075+0000 mon.a (mon.0) 1026 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:22:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:06 gibba013 bash[29418]: audit 2021-03-10T14:22:06.007774+0000 mon.a (mon.0) 1027 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:22:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:06 gibba013 bash[29418]: audit 2021-03-10T14:22:06.116534+0000 mon.a (mon.0) 1028 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:22:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:06 gibba013 bash[29418]: audit 2021-03-10T14:22:06.122806+0000 mon.a (mon.0) 1029 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:22:07.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:06 gibba013 bash[30381]: cluster 2021-03-10T14:22:05.584025+0000 mgr.gibba020.yqfnwy (mgr.34427) 1580 : cluster [DBG] pgmap v884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:07.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:06 gibba013 bash[30381]: audit 2021-03-10T14:22:06.005632+0000 mon.a (mon.0) 1024 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:22:07.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:06 gibba013 bash[30381]: audit 2021-03-10T14:22:06.006407+0000 mon.a (mon.0) 1025 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:22:07.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:06 gibba013 bash[30381]: audit 2021-03-10T14:22:06.007075+0000 mon.a (mon.0) 1026 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:22:07.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:06 gibba013 bash[30381]: audit 2021-03-10T14:22:06.007774+0000 mon.a (mon.0) 1027 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:22:07.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:06 gibba013 bash[30381]: audit 2021-03-10T14:22:06.116534+0000 mon.a (mon.0) 1028 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:22:07.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:06 gibba013 bash[30381]: audit 2021-03-10T14:22:06.122806+0000 mon.a (mon.0) 1029 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:22:08.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:08 gibba020 bash[25448]: cluster 2021-03-10T14:22:07.585278+0000 mgr.gibba020.yqfnwy (mgr.34427) 1581 : cluster [DBG] pgmap v885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:09.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:08 gibba013 bash[29418]: cluster 2021-03-10T14:22:07.585278+0000 mgr.gibba020.yqfnwy (mgr.34427) 1581 : cluster [DBG] pgmap v885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:09.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:08 gibba013 bash[30381]: cluster 2021-03-10T14:22:07.585278+0000 mgr.gibba020.yqfnwy (mgr.34427) 1581 : cluster [DBG] pgmap v885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:11.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:10 gibba013 bash[29418]: cluster 2021-03-10T14:22:09.586810+0000 mgr.gibba020.yqfnwy (mgr.34427) 1582 : cluster [DBG] pgmap v886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:11.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:10 gibba013 bash[30381]: cluster 2021-03-10T14:22:09.586810+0000 mgr.gibba020.yqfnwy (mgr.34427) 1582 : cluster [DBG] pgmap v886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:11.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:10 gibba020 bash[25448]: cluster 2021-03-10T14:22:09.586810+0000 mgr.gibba020.yqfnwy (mgr.34427) 1582 : cluster [DBG] pgmap v886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:13.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:12 gibba013 bash[29418]: cluster 2021-03-10T14:22:11.588610+0000 mgr.gibba020.yqfnwy (mgr.34427) 1583 : cluster [DBG] pgmap v887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:13.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:12 gibba013 bash[30381]: cluster 2021-03-10T14:22:11.588610+0000 mgr.gibba020.yqfnwy (mgr.34427) 1583 : cluster [DBG] pgmap v887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:13.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:12 gibba020 bash[25448]: cluster 2021-03-10T14:22:11.588610+0000 mgr.gibba020.yqfnwy (mgr.34427) 1583 : cluster [DBG] pgmap v887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:15.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:14 gibba013 bash[29418]: cluster 2021-03-10T14:22:13.590235+0000 mgr.gibba020.yqfnwy (mgr.34427) 1584 : cluster [DBG] pgmap v888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:15.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:14 gibba013 bash[30381]: cluster 2021-03-10T14:22:13.590235+0000 mgr.gibba020.yqfnwy (mgr.34427) 1584 : cluster [DBG] pgmap v888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:15.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:14 gibba020 bash[25448]: cluster 2021-03-10T14:22:13.590235+0000 mgr.gibba020.yqfnwy (mgr.34427) 1584 : cluster [DBG] pgmap v888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:16.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:16 gibba013 bash[29418]: cluster 2021-03-10T14:22:15.592102+0000 mgr.gibba020.yqfnwy (mgr.34427) 1585 : cluster [DBG] pgmap v889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:16.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:16 gibba013 bash[30381]: cluster 2021-03-10T14:22:15.592102+0000 mgr.gibba020.yqfnwy (mgr.34427) 1585 : cluster [DBG] pgmap v889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:16.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:16 gibba020 bash[25448]: cluster 2021-03-10T14:22:15.592102+0000 mgr.gibba020.yqfnwy (mgr.34427) 1585 : cluster [DBG] pgmap v889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:18.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:18 gibba020 bash[25448]: cluster 2021-03-10T14:22:17.593633+0000 mgr.gibba020.yqfnwy (mgr.34427) 1586 : cluster [DBG] pgmap v890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:19.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:18 gibba013 bash[29418]: cluster 2021-03-10T14:22:17.593633+0000 mgr.gibba020.yqfnwy (mgr.34427) 1586 : cluster [DBG] pgmap v890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:19.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:18 gibba013 bash[30381]: cluster 2021-03-10T14:22:17.593633+0000 mgr.gibba020.yqfnwy (mgr.34427) 1586 : cluster [DBG] pgmap v890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:20.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:20 gibba020 bash[25448]: cephadm 2021-03-10T14:22:19.107132+0000 mgr.gibba020.yqfnwy (mgr.34427) 1587 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:22:20.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:20 gibba020 bash[25448]: cluster 2021-03-10T14:22:19.594981+0000 mgr.gibba020.yqfnwy (mgr.34427) 1588 : cluster [DBG] pgmap v891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:21.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:20 gibba013 bash[29418]: cephadm 2021-03-10T14:22:19.107132+0000 mgr.gibba020.yqfnwy (mgr.34427) 1587 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:22:21.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:20 gibba013 bash[29418]: cluster 2021-03-10T14:22:19.594981+0000 mgr.gibba020.yqfnwy (mgr.34427) 1588 : cluster [DBG] pgmap v891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:21.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:20 gibba013 bash[30381]: cephadm 2021-03-10T14:22:19.107132+0000 mgr.gibba020.yqfnwy (mgr.34427) 1587 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:22:21.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:20 gibba013 bash[30381]: cluster 2021-03-10T14:22:19.594981+0000 mgr.gibba020.yqfnwy (mgr.34427) 1588 : cluster [DBG] pgmap v891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:22.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:22 gibba020 bash[25448]: cluster 2021-03-10T14:22:21.596723+0000 mgr.gibba020.yqfnwy (mgr.34427) 1589 : cluster [DBG] pgmap v892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:23.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:22 gibba013 bash[29418]: cluster 2021-03-10T14:22:21.596723+0000 mgr.gibba020.yqfnwy (mgr.34427) 1589 : cluster [DBG] pgmap v892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:23.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:22 gibba013 bash[30381]: cluster 2021-03-10T14:22:21.596723+0000 mgr.gibba020.yqfnwy (mgr.34427) 1589 : cluster [DBG] pgmap v892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:24.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:24 gibba020 bash[25448]: cluster 2021-03-10T14:22:23.598385+0000 mgr.gibba020.yqfnwy (mgr.34427) 1590 : cluster [DBG] pgmap v893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:25.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:24 gibba013 bash[29418]: cluster 2021-03-10T14:22:23.598385+0000 mgr.gibba020.yqfnwy (mgr.34427) 1590 : cluster [DBG] pgmap v893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:25.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:24 gibba013 bash[30381]: cluster 2021-03-10T14:22:23.598385+0000 mgr.gibba020.yqfnwy (mgr.34427) 1590 : cluster [DBG] pgmap v893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:26.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:26 gibba013 bash[29418]: cluster 2021-03-10T14:22:25.600274+0000 mgr.gibba020.yqfnwy (mgr.34427) 1591 : cluster [DBG] pgmap v894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:26.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:26 gibba013 bash[30381]: cluster 2021-03-10T14:22:25.600274+0000 mgr.gibba020.yqfnwy (mgr.34427) 1591 : cluster [DBG] pgmap v894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:26.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:26 gibba020 bash[25448]: cluster 2021-03-10T14:22:25.600274+0000 mgr.gibba020.yqfnwy (mgr.34427) 1591 : cluster [DBG] pgmap v894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:28.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:28 gibba020 bash[25448]: cluster 2021-03-10T14:22:27.601915+0000 mgr.gibba020.yqfnwy (mgr.34427) 1592 : cluster [DBG] pgmap v895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:29.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:28 gibba013 bash[29418]: cluster 2021-03-10T14:22:27.601915+0000 mgr.gibba020.yqfnwy (mgr.34427) 1592 : cluster [DBG] pgmap v895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:29.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:28 gibba013 bash[30381]: cluster 2021-03-10T14:22:27.601915+0000 mgr.gibba020.yqfnwy (mgr.34427) 1592 : cluster [DBG] pgmap v895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:30.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:30 gibba020 bash[25448]: cluster 2021-03-10T14:22:29.603258+0000 mgr.gibba020.yqfnwy (mgr.34427) 1593 : cluster [DBG] pgmap v896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:31.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:30 gibba013 bash[29418]: cluster 2021-03-10T14:22:29.603258+0000 mgr.gibba020.yqfnwy (mgr.34427) 1593 : cluster [DBG] pgmap v896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:31.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:30 gibba013 bash[30381]: cluster 2021-03-10T14:22:29.603258+0000 mgr.gibba020.yqfnwy (mgr.34427) 1593 : cluster [DBG] pgmap v896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:32.545 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:22:32.771 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:22:32.771 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (29m) 4m ago 34m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:22:32.771 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (34m) 3m ago 34m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:22:32.772 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (29m) 3m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:22:32.772 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (29m) 3m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:22:32.772 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (28m) 4m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:22:32.772 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (28m) 4m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:22:32.772 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (28m) 3m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:22:32.773 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (28m) 4m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:22:32.773 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (34m) 4m ago 34m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:22:32.773 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (34m) 3m ago 34m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:22:32.773 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (27m) 4m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:22:32.774 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (26m) 4m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:22:32.774 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (26m) 4m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:22:32.774 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (26m) 4m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:22:32.774 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (25m) 3m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:22:32.775 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (25m) 3m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:22:32.775 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (24m) 3m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:22:32.775 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (24m) 3m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:22:32.775 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (33m) 3m ago 34m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:22:32.775 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 3m ago 32m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:22:32.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:32 gibba020 bash[25448]: cluster 2021-03-10T14:22:31.605153+0000 mgr.gibba020.yqfnwy (mgr.34427) 1594 : cluster [DBG] pgmap v897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:33.017 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:22:33.018 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:22:33.018 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:22:33.018 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:22:33.018 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:22:33.019 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:22:33.019 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:22:33.019 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:22:33.019 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:22:33.020 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:22:33.020 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:22:33.020 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:22:33.020 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:22:33.020 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:22:33.021 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:22:33.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:32 gibba013 bash[29418]: cluster 2021-03-10T14:22:31.605153+0000 mgr.gibba020.yqfnwy (mgr.34427) 1594 : cluster [DBG] pgmap v897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:33.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:32 gibba013 bash[30381]: cluster 2021-03-10T14:22:31.605153+0000 mgr.gibba020.yqfnwy (mgr.34427) 1594 : cluster [DBG] pgmap v897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:33.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:33 gibba020 bash[25448]: audit 2021-03-10T14:22:32.532664+0000 mgr.gibba020.yqfnwy (mgr.34427) 1595 : audit [DBG] from='client.55117 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:22:33.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:33 gibba020 bash[25448]: audit 2021-03-10T14:22:32.755608+0000 mgr.gibba020.yqfnwy (mgr.34427) 1596 : audit [DBG] from='client.55123 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:22:33.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:33 gibba020 bash[25448]: audit 2021-03-10T14:22:33.016003+0000 mon.a (mon.0) 1030 : audit [DBG] from='client.? 172.21.2.113:0/2018131193' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:34.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:33 gibba013 bash[29418]: audit 2021-03-10T14:22:32.532664+0000 mgr.gibba020.yqfnwy (mgr.34427) 1595 : audit [DBG] from='client.55117 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:22:34.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:33 gibba013 bash[29418]: audit 2021-03-10T14:22:32.755608+0000 mgr.gibba020.yqfnwy (mgr.34427) 1596 : audit [DBG] from='client.55123 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:22:34.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:33 gibba013 bash[29418]: audit 2021-03-10T14:22:33.016003+0000 mon.a (mon.0) 1030 : audit [DBG] from='client.? 172.21.2.113:0/2018131193' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:34.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:33 gibba013 bash[30381]: audit 2021-03-10T14:22:32.532664+0000 mgr.gibba020.yqfnwy (mgr.34427) 1595 : audit [DBG] from='client.55117 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:22:34.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:33 gibba013 bash[30381]: audit 2021-03-10T14:22:32.755608+0000 mgr.gibba020.yqfnwy (mgr.34427) 1596 : audit [DBG] from='client.55123 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:22:34.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:33 gibba013 bash[30381]: audit 2021-03-10T14:22:33.016003+0000 mon.a (mon.0) 1030 : audit [DBG] from='client.? 172.21.2.113:0/2018131193' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:35.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:34 gibba013 bash[29418]: cluster 2021-03-10T14:22:33.606641+0000 mgr.gibba020.yqfnwy (mgr.34427) 1597 : cluster [DBG] pgmap v898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:35.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:34 gibba013 bash[30381]: cluster 2021-03-10T14:22:33.606641+0000 mgr.gibba020.yqfnwy (mgr.34427) 1597 : cluster [DBG] pgmap v898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:35.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:34 gibba020 bash[25448]: cluster 2021-03-10T14:22:33.606641+0000 mgr.gibba020.yqfnwy (mgr.34427) 1597 : cluster [DBG] pgmap v898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:36.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:35 gibba013 bash[29418]: cephadm 2021-03-10T14:22:34.123067+0000 mgr.gibba020.yqfnwy (mgr.34427) 1598 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:22:36.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:35 gibba013 bash[30381]: cephadm 2021-03-10T14:22:34.123067+0000 mgr.gibba020.yqfnwy (mgr.34427) 1598 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:22:36.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:35 gibba020 bash[25448]: cephadm 2021-03-10T14:22:34.123067+0000 mgr.gibba020.yqfnwy (mgr.34427) 1598 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:22:37.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:36 gibba013 bash[29418]: cluster 2021-03-10T14:22:35.608353+0000 mgr.gibba020.yqfnwy (mgr.34427) 1599 : cluster [DBG] pgmap v899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:37.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:36 gibba013 bash[30381]: cluster 2021-03-10T14:22:35.608353+0000 mgr.gibba020.yqfnwy (mgr.34427) 1599 : cluster [DBG] pgmap v899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:37.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:36 gibba020 bash[25448]: cluster 2021-03-10T14:22:35.608353+0000 mgr.gibba020.yqfnwy (mgr.34427) 1599 : cluster [DBG] pgmap v899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:39.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:38 gibba013 bash[29418]: cluster 2021-03-10T14:22:37.609710+0000 mgr.gibba020.yqfnwy (mgr.34427) 1600 : cluster [DBG] pgmap v900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:39.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:38 gibba013 bash[30381]: cluster 2021-03-10T14:22:37.609710+0000 mgr.gibba020.yqfnwy (mgr.34427) 1600 : cluster [DBG] pgmap v900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:39.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:38 gibba020 bash[25448]: cluster 2021-03-10T14:22:37.609710+0000 mgr.gibba020.yqfnwy (mgr.34427) 1600 : cluster [DBG] pgmap v900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:41.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:40 gibba013 bash[29418]: cluster 2021-03-10T14:22:39.611175+0000 mgr.gibba020.yqfnwy (mgr.34427) 1601 : cluster [DBG] pgmap v901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:41.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:40 gibba013 bash[30381]: cluster 2021-03-10T14:22:39.611175+0000 mgr.gibba020.yqfnwy (mgr.34427) 1601 : cluster [DBG] pgmap v901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:41.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:40 gibba020 bash[25448]: cluster 2021-03-10T14:22:39.611175+0000 mgr.gibba020.yqfnwy (mgr.34427) 1601 : cluster [DBG] pgmap v901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:43.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:42 gibba013 bash[29418]: cluster 2021-03-10T14:22:41.612859+0000 mgr.gibba020.yqfnwy (mgr.34427) 1602 : cluster [DBG] pgmap v902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:43.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:42 gibba013 bash[30381]: cluster 2021-03-10T14:22:41.612859+0000 mgr.gibba020.yqfnwy (mgr.34427) 1602 : cluster [DBG] pgmap v902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:43.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:42 gibba020 bash[25448]: cluster 2021-03-10T14:22:41.612859+0000 mgr.gibba020.yqfnwy (mgr.34427) 1602 : cluster [DBG] pgmap v902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:45.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:44 gibba013 bash[29418]: cluster 2021-03-10T14:22:43.614366+0000 mgr.gibba020.yqfnwy (mgr.34427) 1603 : cluster [DBG] pgmap v903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:45.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:44 gibba013 bash[30381]: cluster 2021-03-10T14:22:43.614366+0000 mgr.gibba020.yqfnwy (mgr.34427) 1603 : cluster [DBG] pgmap v903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:45.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:44 gibba020 bash[25448]: cluster 2021-03-10T14:22:43.614366+0000 mgr.gibba020.yqfnwy (mgr.34427) 1603 : cluster [DBG] pgmap v903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:46.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:46 gibba013 bash[29418]: cluster 2021-03-10T14:22:45.615817+0000 mgr.gibba020.yqfnwy (mgr.34427) 1604 : cluster [DBG] pgmap v904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:46.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:46 gibba013 bash[30381]: cluster 2021-03-10T14:22:45.615817+0000 mgr.gibba020.yqfnwy (mgr.34427) 1604 : cluster [DBG] pgmap v904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:46.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:46 gibba020 bash[25448]: cluster 2021-03-10T14:22:45.615817+0000 mgr.gibba020.yqfnwy (mgr.34427) 1604 : cluster [DBG] pgmap v904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:48.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:48 gibba020 bash[25448]: cluster 2021-03-10T14:22:47.617146+0000 mgr.gibba020.yqfnwy (mgr.34427) 1605 : cluster [DBG] pgmap v905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:49.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:48 gibba013 bash[29418]: cluster 2021-03-10T14:22:47.617146+0000 mgr.gibba020.yqfnwy (mgr.34427) 1605 : cluster [DBG] pgmap v905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:49.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:48 gibba013 bash[30381]: cluster 2021-03-10T14:22:47.617146+0000 mgr.gibba020.yqfnwy (mgr.34427) 1605 : cluster [DBG] pgmap v905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:49.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:49 gibba020 bash[25448]: audit 2021-03-10T14:22:49.141682+0000 mon.a (mon.0) 1031 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:22:49.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:49 gibba020 bash[25448]: audit 2021-03-10T14:22:49.360808+0000 mon.a (mon.0) 1032 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:22:49.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:49 gibba020 bash[25448]: audit 2021-03-10T14:22:49.364406+0000 mon.a (mon.0) 1033 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:22:49.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:49 gibba020 bash[25448]: audit 2021-03-10T14:22:49.366272+0000 mon.a (mon.0) 1034 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:49.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:49 gibba020 bash[25448]: audit 2021-03-10T14:22:49.367807+0000 mon.a (mon.0) 1035 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:49.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:49 gibba020 bash[25448]: audit 2021-03-10T14:22:49.369270+0000 mon.a (mon.0) 1036 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:49.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:49 gibba020 bash[25448]: audit 2021-03-10T14:22:49.372161+0000 mon.a (mon.0) 1037 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:49.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:49 gibba020 bash[25448]: audit 2021-03-10T14:22:49.373848+0000 mon.a (mon.0) 1038 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:50.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:49 gibba013 bash[29418]: audit 2021-03-10T14:22:49.141682+0000 mon.a (mon.0) 1031 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:22:50.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:49 gibba013 bash[29418]: audit 2021-03-10T14:22:49.360808+0000 mon.a (mon.0) 1032 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:22:50.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:49 gibba013 bash[29418]: audit 2021-03-10T14:22:49.364406+0000 mon.a (mon.0) 1033 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:22:50.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:49 gibba013 bash[29418]: audit 2021-03-10T14:22:49.366272+0000 mon.a (mon.0) 1034 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:50.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:49 gibba013 bash[29418]: audit 2021-03-10T14:22:49.367807+0000 mon.a (mon.0) 1035 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:50.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:49 gibba013 bash[29418]: audit 2021-03-10T14:22:49.369270+0000 mon.a (mon.0) 1036 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:50.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:49 gibba013 bash[29418]: audit 2021-03-10T14:22:49.372161+0000 mon.a (mon.0) 1037 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:50.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:49 gibba013 bash[29418]: audit 2021-03-10T14:22:49.373848+0000 mon.a (mon.0) 1038 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:50.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:49 gibba013 bash[30381]: audit 2021-03-10T14:22:49.141682+0000 mon.a (mon.0) 1031 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:22:50.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:49 gibba013 bash[30381]: audit 2021-03-10T14:22:49.360808+0000 mon.a (mon.0) 1032 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:22:50.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:49 gibba013 bash[30381]: audit 2021-03-10T14:22:49.364406+0000 mon.a (mon.0) 1033 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:22:50.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:49 gibba013 bash[30381]: audit 2021-03-10T14:22:49.366272+0000 mon.a (mon.0) 1034 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:50.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:49 gibba013 bash[30381]: audit 2021-03-10T14:22:49.367807+0000 mon.a (mon.0) 1035 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:50.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:49 gibba013 bash[30381]: audit 2021-03-10T14:22:49.369270+0000 mon.a (mon.0) 1036 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:50.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:49 gibba013 bash[30381]: audit 2021-03-10T14:22:49.372161+0000 mon.a (mon.0) 1037 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:50.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:49 gibba013 bash[30381]: audit 2021-03-10T14:22:49.373848+0000 mon.a (mon.0) 1038 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:22:50.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:50 gibba020 bash[25448]: cephadm 2021-03-10T14:22:49.145651+0000 mgr.gibba020.yqfnwy (mgr.34427) 1606 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:22:50.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:50 gibba020 bash[25448]: cephadm 2021-03-10T14:22:49.147575+0000 mgr.gibba020.yqfnwy (mgr.34427) 1607 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:22:50.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:50 gibba020 bash[25448]: cephadm 2021-03-10T14:22:49.361500+0000 mgr.gibba020.yqfnwy (mgr.34427) 1608 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:22:50.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:50 gibba020 bash[25448]: cephadm 2021-03-10T14:22:49.363817+0000 mgr.gibba020.yqfnwy (mgr.34427) 1609 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:22:50.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:50 gibba020 bash[25448]: cephadm 2021-03-10T14:22:49.365445+0000 mgr.gibba020.yqfnwy (mgr.34427) 1610 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:22:50.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:50 gibba020 bash[25448]: cephadm 2021-03-10T14:22:49.365483+0000 mgr.gibba020.yqfnwy (mgr.34427) 1611 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:22:50.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:50 gibba020 bash[25448]: cephadm 2021-03-10T14:22:49.366949+0000 mgr.gibba020.yqfnwy (mgr.34427) 1612 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:22:50.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:50 gibba020 bash[25448]: cephadm 2021-03-10T14:22:49.366987+0000 mgr.gibba020.yqfnwy (mgr.34427) 1613 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:22:50.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:50 gibba020 bash[25448]: cephadm 2021-03-10T14:22:49.368274+0000 mgr.gibba020.yqfnwy (mgr.34427) 1614 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:22:50.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:50 gibba020 bash[25448]: cephadm 2021-03-10T14:22:49.369634+0000 mgr.gibba020.yqfnwy (mgr.34427) 1615 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:22:50.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:50 gibba020 bash[25448]: cephadm 2021-03-10T14:22:49.369672+0000 mgr.gibba020.yqfnwy (mgr.34427) 1616 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:22:50.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:50 gibba020 bash[25448]: cephadm 2021-03-10T14:22:49.371213+0000 mgr.gibba020.yqfnwy (mgr.34427) 1617 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:22:50.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:50 gibba020 bash[25448]: cephadm 2021-03-10T14:22:49.371538+0000 mgr.gibba020.yqfnwy (mgr.34427) 1618 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:22:50.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:50 gibba020 bash[25448]: cephadm 2021-03-10T14:22:49.373101+0000 mgr.gibba020.yqfnwy (mgr.34427) 1619 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:22:50.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:50 gibba020 bash[25448]: cephadm 2021-03-10T14:22:49.373138+0000 mgr.gibba020.yqfnwy (mgr.34427) 1620 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:22:50.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:50 gibba020 bash[25448]: cephadm 2021-03-10T14:22:49.373317+0000 mgr.gibba020.yqfnwy (mgr.34427) 1621 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:22:50.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:50 gibba020 bash[25448]: cluster 2021-03-10T14:22:49.618621+0000 mgr.gibba020.yqfnwy (mgr.34427) 1622 : cluster [DBG] pgmap v906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:51.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:50 gibba013 bash[29418]: cephadm 2021-03-10T14:22:49.145651+0000 mgr.gibba020.yqfnwy (mgr.34427) 1606 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:22:51.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:50 gibba013 bash[29418]: cephadm 2021-03-10T14:22:49.147575+0000 mgr.gibba020.yqfnwy (mgr.34427) 1607 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:22:51.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:50 gibba013 bash[29418]: cephadm 2021-03-10T14:22:49.361500+0000 mgr.gibba020.yqfnwy (mgr.34427) 1608 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:22:51.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:50 gibba013 bash[29418]: cephadm 2021-03-10T14:22:49.363817+0000 mgr.gibba020.yqfnwy (mgr.34427) 1609 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:22:51.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:50 gibba013 bash[29418]: cephadm 2021-03-10T14:22:49.365445+0000 mgr.gibba020.yqfnwy (mgr.34427) 1610 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:22:51.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:50 gibba013 bash[29418]: cephadm 2021-03-10T14:22:49.365483+0000 mgr.gibba020.yqfnwy (mgr.34427) 1611 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:22:51.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:50 gibba013 bash[29418]: cephadm 2021-03-10T14:22:49.366949+0000 mgr.gibba020.yqfnwy (mgr.34427) 1612 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:22:51.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:50 gibba013 bash[29418]: cephadm 2021-03-10T14:22:49.366987+0000 mgr.gibba020.yqfnwy (mgr.34427) 1613 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:22:51.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:50 gibba013 bash[29418]: cephadm 2021-03-10T14:22:49.368274+0000 mgr.gibba020.yqfnwy (mgr.34427) 1614 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:22:51.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:50 gibba013 bash[29418]: cephadm 2021-03-10T14:22:49.369634+0000 mgr.gibba020.yqfnwy (mgr.34427) 1615 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:22:51.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:50 gibba013 bash[29418]: cephadm 2021-03-10T14:22:49.369672+0000 mgr.gibba020.yqfnwy (mgr.34427) 1616 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:22:51.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:50 gibba013 bash[29418]: cephadm 2021-03-10T14:22:49.371213+0000 mgr.gibba020.yqfnwy (mgr.34427) 1617 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:22:51.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:50 gibba013 bash[29418]: cephadm 2021-03-10T14:22:49.371538+0000 mgr.gibba020.yqfnwy (mgr.34427) 1618 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:22:51.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:50 gibba013 bash[29418]: cephadm 2021-03-10T14:22:49.373101+0000 mgr.gibba020.yqfnwy (mgr.34427) 1619 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:22:51.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:50 gibba013 bash[29418]: cephadm 2021-03-10T14:22:49.373138+0000 mgr.gibba020.yqfnwy (mgr.34427) 1620 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:22:51.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:50 gibba013 bash[29418]: cephadm 2021-03-10T14:22:49.373317+0000 mgr.gibba020.yqfnwy (mgr.34427) 1621 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:22:51.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:50 gibba013 bash[29418]: cluster 2021-03-10T14:22:49.618621+0000 mgr.gibba020.yqfnwy (mgr.34427) 1622 : cluster [DBG] pgmap v906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:51.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:50 gibba013 bash[30381]: cephadm 2021-03-10T14:22:49.145651+0000 mgr.gibba020.yqfnwy (mgr.34427) 1606 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:22:51.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:50 gibba013 bash[30381]: cephadm 2021-03-10T14:22:49.147575+0000 mgr.gibba020.yqfnwy (mgr.34427) 1607 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:22:51.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:50 gibba013 bash[30381]: cephadm 2021-03-10T14:22:49.361500+0000 mgr.gibba020.yqfnwy (mgr.34427) 1608 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:22:51.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:50 gibba013 bash[30381]: cephadm 2021-03-10T14:22:49.363817+0000 mgr.gibba020.yqfnwy (mgr.34427) 1609 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:22:51.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:50 gibba013 bash[30381]: cephadm 2021-03-10T14:22:49.365445+0000 mgr.gibba020.yqfnwy (mgr.34427) 1610 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:22:51.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:50 gibba013 bash[30381]: cephadm 2021-03-10T14:22:49.365483+0000 mgr.gibba020.yqfnwy (mgr.34427) 1611 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:22:51.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:50 gibba013 bash[30381]: cephadm 2021-03-10T14:22:49.366949+0000 mgr.gibba020.yqfnwy (mgr.34427) 1612 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:22:51.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:50 gibba013 bash[30381]: cephadm 2021-03-10T14:22:49.366987+0000 mgr.gibba020.yqfnwy (mgr.34427) 1613 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:22:51.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:50 gibba013 bash[30381]: cephadm 2021-03-10T14:22:49.368274+0000 mgr.gibba020.yqfnwy (mgr.34427) 1614 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:22:51.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:50 gibba013 bash[30381]: cephadm 2021-03-10T14:22:49.369634+0000 mgr.gibba020.yqfnwy (mgr.34427) 1615 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:22:51.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:50 gibba013 bash[30381]: cephadm 2021-03-10T14:22:49.369672+0000 mgr.gibba020.yqfnwy (mgr.34427) 1616 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:22:51.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:50 gibba013 bash[30381]: cephadm 2021-03-10T14:22:49.371213+0000 mgr.gibba020.yqfnwy (mgr.34427) 1617 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:22:51.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:50 gibba013 bash[30381]: cephadm 2021-03-10T14:22:49.371538+0000 mgr.gibba020.yqfnwy (mgr.34427) 1618 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:22:51.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:50 gibba013 bash[30381]: cephadm 2021-03-10T14:22:49.373101+0000 mgr.gibba020.yqfnwy (mgr.34427) 1619 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:22:51.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:50 gibba013 bash[30381]: cephadm 2021-03-10T14:22:49.373138+0000 mgr.gibba020.yqfnwy (mgr.34427) 1620 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:22:51.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:50 gibba013 bash[30381]: cephadm 2021-03-10T14:22:49.373317+0000 mgr.gibba020.yqfnwy (mgr.34427) 1621 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:22:51.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:50 gibba013 bash[30381]: cluster 2021-03-10T14:22:49.618621+0000 mgr.gibba020.yqfnwy (mgr.34427) 1622 : cluster [DBG] pgmap v906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:53.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:52 gibba013 bash[29418]: cluster 2021-03-10T14:22:51.620338+0000 mgr.gibba020.yqfnwy (mgr.34427) 1623 : cluster [DBG] pgmap v907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:53.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:52 gibba013 bash[30381]: cluster 2021-03-10T14:22:51.620338+0000 mgr.gibba020.yqfnwy (mgr.34427) 1623 : cluster [DBG] pgmap v907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:53.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:52 gibba020 bash[25448]: cluster 2021-03-10T14:22:51.620338+0000 mgr.gibba020.yqfnwy (mgr.34427) 1623 : cluster [DBG] pgmap v907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:55.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:54 gibba013 bash[29418]: cluster 2021-03-10T14:22:53.621925+0000 mgr.gibba020.yqfnwy (mgr.34427) 1624 : cluster [DBG] pgmap v908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:55.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:54 gibba013 bash[30381]: cluster 2021-03-10T14:22:53.621925+0000 mgr.gibba020.yqfnwy (mgr.34427) 1624 : cluster [DBG] pgmap v908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:55.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:54 gibba020 bash[25448]: cluster 2021-03-10T14:22:53.621925+0000 mgr.gibba020.yqfnwy (mgr.34427) 1624 : cluster [DBG] pgmap v908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:56.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:56 gibba013 bash[29418]: cluster 2021-03-10T14:22:55.623631+0000 mgr.gibba020.yqfnwy (mgr.34427) 1625 : cluster [DBG] pgmap v909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:56.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:56 gibba013 bash[30381]: cluster 2021-03-10T14:22:55.623631+0000 mgr.gibba020.yqfnwy (mgr.34427) 1625 : cluster [DBG] pgmap v909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:56.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:56 gibba020 bash[25448]: cluster 2021-03-10T14:22:55.623631+0000 mgr.gibba020.yqfnwy (mgr.34427) 1625 : cluster [DBG] pgmap v909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:58.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:22:58 gibba020 bash[25448]: cluster 2021-03-10T14:22:57.625158+0000 mgr.gibba020.yqfnwy (mgr.34427) 1626 : cluster [DBG] pgmap v910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:59.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:22:58 gibba013 bash[29418]: cluster 2021-03-10T14:22:57.625158+0000 mgr.gibba020.yqfnwy (mgr.34427) 1626 : cluster [DBG] pgmap v910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:22:59.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:22:58 gibba013 bash[30381]: cluster 2021-03-10T14:22:57.625158+0000 mgr.gibba020.yqfnwy (mgr.34427) 1626 : cluster [DBG] pgmap v910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:01.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:00 gibba013 bash[29418]: cluster 2021-03-10T14:22:59.626710+0000 mgr.gibba020.yqfnwy (mgr.34427) 1627 : cluster [DBG] pgmap v911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:01.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:00 gibba013 bash[30381]: cluster 2021-03-10T14:22:59.626710+0000 mgr.gibba020.yqfnwy (mgr.34427) 1627 : cluster [DBG] pgmap v911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:01.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:00 gibba020 bash[25448]: cluster 2021-03-10T14:22:59.626710+0000 mgr.gibba020.yqfnwy (mgr.34427) 1627 : cluster [DBG] pgmap v911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:03.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:02 gibba013 bash[29418]: cluster 2021-03-10T14:23:01.628473+0000 mgr.gibba020.yqfnwy (mgr.34427) 1628 : cluster [DBG] pgmap v912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:03.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:02 gibba013 bash[30381]: cluster 2021-03-10T14:23:01.628473+0000 mgr.gibba020.yqfnwy (mgr.34427) 1628 : cluster [DBG] pgmap v912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:03.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:02 gibba020 bash[25448]: cluster 2021-03-10T14:23:01.628473+0000 mgr.gibba020.yqfnwy (mgr.34427) 1628 : cluster [DBG] pgmap v912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:03.258 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:23:03.482 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:23:03.483 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (29m) 5m ago 34m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:23:03.483 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (34m) 4m ago 34m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:23:03.483 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (29m) 4m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:23:03.483 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (30m) 4m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:23:03.484 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (29m) 5m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:23:03.484 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (29m) 5m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:23:03.484 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (28m) 4m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:23:03.484 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (28m) 5m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:23:03.485 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (35m) 5m ago 35m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:23:03.485 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (35m) 4m ago 35m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:23:03.485 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (27m) 5m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:23:03.485 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (27m) 5m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:23:03.486 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (26m) 5m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:23:03.486 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (26m) 5m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:23:03.486 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (26m) 4m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:23:03.486 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (25m) 4m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:23:03.487 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (25m) 4m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:23:03.487 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (24m) 4m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:23:03.487 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (34m) 4m ago 35m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:23:03.487 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 4m ago 33m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:23:03.729 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:23:03.729 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:23:03.730 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:23:03.730 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:23:03.730 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:23:03.730 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:23:03.731 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:23:03.731 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:23:03.731 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:23:03.731 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:23:03.731 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:23:03.732 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:23:03.732 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:23:03.732 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:23:03.732 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:23:05.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:04 gibba013 bash[29418]: audit 2021-03-10T14:23:03.245966+0000 mgr.gibba020.yqfnwy (mgr.34427) 1629 : audit [DBG] from='client.45150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:23:05.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:04 gibba013 bash[29418]: audit 2021-03-10T14:23:03.466732+0000 mgr.gibba020.yqfnwy (mgr.34427) 1630 : audit [DBG] from='client.45156 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:23:05.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:04 gibba013 bash[29418]: cluster 2021-03-10T14:23:03.630110+0000 mgr.gibba020.yqfnwy (mgr.34427) 1631 : cluster [DBG] pgmap v913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:05.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:04 gibba013 bash[29418]: audit 2021-03-10T14:23:03.728135+0000 mon.a (mon.0) 1039 : audit [DBG] from='client.? 172.21.2.113:0/2892847899' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:05.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:04 gibba013 bash[30381]: audit 2021-03-10T14:23:03.245966+0000 mgr.gibba020.yqfnwy (mgr.34427) 1629 : audit [DBG] from='client.45150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:23:05.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:04 gibba013 bash[30381]: audit 2021-03-10T14:23:03.466732+0000 mgr.gibba020.yqfnwy (mgr.34427) 1630 : audit [DBG] from='client.45156 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:23:05.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:04 gibba013 bash[30381]: cluster 2021-03-10T14:23:03.630110+0000 mgr.gibba020.yqfnwy (mgr.34427) 1631 : cluster [DBG] pgmap v913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:05.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:04 gibba013 bash[30381]: audit 2021-03-10T14:23:03.728135+0000 mon.a (mon.0) 1039 : audit [DBG] from='client.? 172.21.2.113:0/2892847899' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:05.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:04 gibba020 bash[25448]: audit 2021-03-10T14:23:03.245966+0000 mgr.gibba020.yqfnwy (mgr.34427) 1629 : audit [DBG] from='client.45150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:23:05.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:04 gibba020 bash[25448]: audit 2021-03-10T14:23:03.466732+0000 mgr.gibba020.yqfnwy (mgr.34427) 1630 : audit [DBG] from='client.45156 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:23:05.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:04 gibba020 bash[25448]: cluster 2021-03-10T14:23:03.630110+0000 mgr.gibba020.yqfnwy (mgr.34427) 1631 : cluster [DBG] pgmap v913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:05.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:04 gibba020 bash[25448]: audit 2021-03-10T14:23:03.728135+0000 mon.a (mon.0) 1039 : audit [DBG] from='client.? 172.21.2.113:0/2892847899' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:06.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:05 gibba013 bash[29418]: cephadm 2021-03-10T14:23:04.375248+0000 mgr.gibba020.yqfnwy (mgr.34427) 1632 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:23:06.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:05 gibba013 bash[30381]: cephadm 2021-03-10T14:23:04.375248+0000 mgr.gibba020.yqfnwy (mgr.34427) 1632 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:23:06.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:05 gibba020 bash[25448]: cephadm 2021-03-10T14:23:04.375248+0000 mgr.gibba020.yqfnwy (mgr.34427) 1632 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:23:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:06 gibba013 bash[29418]: cluster 2021-03-10T14:23:05.631846+0000 mgr.gibba020.yqfnwy (mgr.34427) 1633 : cluster [DBG] pgmap v914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:06 gibba013 bash[29418]: audit 2021-03-10T14:23:06.015627+0000 mon.a (mon.0) 1040 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:23:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:06 gibba013 bash[29418]: audit 2021-03-10T14:23:06.016379+0000 mon.a (mon.0) 1041 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:23:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:06 gibba013 bash[29418]: audit 2021-03-10T14:23:06.017066+0000 mon.a (mon.0) 1042 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:23:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:06 gibba013 bash[29418]: audit 2021-03-10T14:23:06.017760+0000 mon.a (mon.0) 1043 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:23:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:06 gibba013 bash[29418]: audit 2021-03-10T14:23:06.123619+0000 mon.a (mon.0) 1044 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:23:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:06 gibba013 bash[29418]: audit 2021-03-10T14:23:06.129917+0000 mon.a (mon.0) 1045 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:23:07.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:06 gibba013 bash[30381]: cluster 2021-03-10T14:23:05.631846+0000 mgr.gibba020.yqfnwy (mgr.34427) 1633 : cluster [DBG] pgmap v914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:07.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:06 gibba013 bash[30381]: audit 2021-03-10T14:23:06.015627+0000 mon.a (mon.0) 1040 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:23:07.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:06 gibba013 bash[30381]: audit 2021-03-10T14:23:06.016379+0000 mon.a (mon.0) 1041 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:23:07.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:06 gibba013 bash[30381]: audit 2021-03-10T14:23:06.017066+0000 mon.a (mon.0) 1042 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:23:07.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:06 gibba013 bash[30381]: audit 2021-03-10T14:23:06.017760+0000 mon.a (mon.0) 1043 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:23:07.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:06 gibba013 bash[30381]: audit 2021-03-10T14:23:06.123619+0000 mon.a (mon.0) 1044 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:23:07.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:06 gibba013 bash[30381]: audit 2021-03-10T14:23:06.129917+0000 mon.a (mon.0) 1045 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:23:07.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:06 gibba020 bash[25448]: cluster 2021-03-10T14:23:05.631846+0000 mgr.gibba020.yqfnwy (mgr.34427) 1633 : cluster [DBG] pgmap v914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:07.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:06 gibba020 bash[25448]: audit 2021-03-10T14:23:06.015627+0000 mon.a (mon.0) 1040 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:23:07.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:06 gibba020 bash[25448]: audit 2021-03-10T14:23:06.016379+0000 mon.a (mon.0) 1041 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:23:07.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:06 gibba020 bash[25448]: audit 2021-03-10T14:23:06.017066+0000 mon.a (mon.0) 1042 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:23:07.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:06 gibba020 bash[25448]: audit 2021-03-10T14:23:06.017760+0000 mon.a (mon.0) 1043 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:23:07.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:06 gibba020 bash[25448]: audit 2021-03-10T14:23:06.123619+0000 mon.a (mon.0) 1044 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:23:07.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:06 gibba020 bash[25448]: audit 2021-03-10T14:23:06.129917+0000 mon.a (mon.0) 1045 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:23:09.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:08 gibba013 bash[29418]: cluster 2021-03-10T14:23:07.633400+0000 mgr.gibba020.yqfnwy (mgr.34427) 1634 : cluster [DBG] pgmap v915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:09.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:08 gibba013 bash[30381]: cluster 2021-03-10T14:23:07.633400+0000 mgr.gibba020.yqfnwy (mgr.34427) 1634 : cluster [DBG] pgmap v915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:09.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:08 gibba020 bash[25448]: cluster 2021-03-10T14:23:07.633400+0000 mgr.gibba020.yqfnwy (mgr.34427) 1634 : cluster [DBG] pgmap v915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:11.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:10 gibba013 bash[29418]: cluster 2021-03-10T14:23:09.635037+0000 mgr.gibba020.yqfnwy (mgr.34427) 1635 : cluster [DBG] pgmap v916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:11.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:10 gibba013 bash[30381]: cluster 2021-03-10T14:23:09.635037+0000 mgr.gibba020.yqfnwy (mgr.34427) 1635 : cluster [DBG] pgmap v916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:11.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:10 gibba020 bash[25448]: cluster 2021-03-10T14:23:09.635037+0000 mgr.gibba020.yqfnwy (mgr.34427) 1635 : cluster [DBG] pgmap v916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:13.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:12 gibba013 bash[29418]: cluster 2021-03-10T14:23:11.636563+0000 mgr.gibba020.yqfnwy (mgr.34427) 1636 : cluster [DBG] pgmap v917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:13.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:12 gibba013 bash[30381]: cluster 2021-03-10T14:23:11.636563+0000 mgr.gibba020.yqfnwy (mgr.34427) 1636 : cluster [DBG] pgmap v917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:13.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:12 gibba020 bash[25448]: cluster 2021-03-10T14:23:11.636563+0000 mgr.gibba020.yqfnwy (mgr.34427) 1636 : cluster [DBG] pgmap v917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:15.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:14 gibba013 bash[29418]: cluster 2021-03-10T14:23:13.638237+0000 mgr.gibba020.yqfnwy (mgr.34427) 1637 : cluster [DBG] pgmap v918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:15.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:14 gibba013 bash[30381]: cluster 2021-03-10T14:23:13.638237+0000 mgr.gibba020.yqfnwy (mgr.34427) 1637 : cluster [DBG] pgmap v918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:15.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:14 gibba020 bash[25448]: cluster 2021-03-10T14:23:13.638237+0000 mgr.gibba020.yqfnwy (mgr.34427) 1637 : cluster [DBG] pgmap v918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:16.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:16 gibba013 bash[29418]: cluster 2021-03-10T14:23:15.639641+0000 mgr.gibba020.yqfnwy (mgr.34427) 1638 : cluster [DBG] pgmap v919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:16.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:16 gibba013 bash[30381]: cluster 2021-03-10T14:23:15.639641+0000 mgr.gibba020.yqfnwy (mgr.34427) 1638 : cluster [DBG] pgmap v919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:16.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:16 gibba020 bash[25448]: cluster 2021-03-10T14:23:15.639641+0000 mgr.gibba020.yqfnwy (mgr.34427) 1638 : cluster [DBG] pgmap v919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:19.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:18 gibba013 bash[29418]: cluster 2021-03-10T14:23:17.641180+0000 mgr.gibba020.yqfnwy (mgr.34427) 1639 : cluster [DBG] pgmap v920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:19.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:18 gibba013 bash[30381]: cluster 2021-03-10T14:23:17.641180+0000 mgr.gibba020.yqfnwy (mgr.34427) 1639 : cluster [DBG] pgmap v920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:19.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:18 gibba020 bash[25448]: cluster 2021-03-10T14:23:17.641180+0000 mgr.gibba020.yqfnwy (mgr.34427) 1639 : cluster [DBG] pgmap v920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:21.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:20 gibba013 bash[29418]: cephadm 2021-03-10T14:23:19.388116+0000 mgr.gibba020.yqfnwy (mgr.34427) 1640 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:23:21.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:20 gibba013 bash[29418]: cluster 2021-03-10T14:23:19.642742+0000 mgr.gibba020.yqfnwy (mgr.34427) 1641 : cluster [DBG] pgmap v921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:21.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:20 gibba013 bash[30381]: cephadm 2021-03-10T14:23:19.388116+0000 mgr.gibba020.yqfnwy (mgr.34427) 1640 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:23:21.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:20 gibba013 bash[30381]: cluster 2021-03-10T14:23:19.642742+0000 mgr.gibba020.yqfnwy (mgr.34427) 1641 : cluster [DBG] pgmap v921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:21.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:20 gibba020 bash[25448]: cephadm 2021-03-10T14:23:19.388116+0000 mgr.gibba020.yqfnwy (mgr.34427) 1640 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:23:21.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:20 gibba020 bash[25448]: cluster 2021-03-10T14:23:19.642742+0000 mgr.gibba020.yqfnwy (mgr.34427) 1641 : cluster [DBG] pgmap v921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:23.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:22 gibba013 bash[29418]: cluster 2021-03-10T14:23:21.643414+0000 mgr.gibba020.yqfnwy (mgr.34427) 1642 : cluster [DBG] pgmap v922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:23.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:22 gibba013 bash[30381]: cluster 2021-03-10T14:23:21.643414+0000 mgr.gibba020.yqfnwy (mgr.34427) 1642 : cluster [DBG] pgmap v922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:23.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:22 gibba020 bash[25448]: cluster 2021-03-10T14:23:21.643414+0000 mgr.gibba020.yqfnwy (mgr.34427) 1642 : cluster [DBG] pgmap v922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:25.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:24 gibba013 bash[29418]: cluster 2021-03-10T14:23:23.644836+0000 mgr.gibba020.yqfnwy (mgr.34427) 1643 : cluster [DBG] pgmap v923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:25.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:24 gibba013 bash[30381]: cluster 2021-03-10T14:23:23.644836+0000 mgr.gibba020.yqfnwy (mgr.34427) 1643 : cluster [DBG] pgmap v923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:25.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:24 gibba020 bash[25448]: cluster 2021-03-10T14:23:23.644836+0000 mgr.gibba020.yqfnwy (mgr.34427) 1643 : cluster [DBG] pgmap v923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:26.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:26 gibba013 bash[29418]: cluster 2021-03-10T14:23:25.646498+0000 mgr.gibba020.yqfnwy (mgr.34427) 1644 : cluster [DBG] pgmap v924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:26.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:26 gibba013 bash[30381]: cluster 2021-03-10T14:23:25.646498+0000 mgr.gibba020.yqfnwy (mgr.34427) 1644 : cluster [DBG] pgmap v924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:26.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:26 gibba020 bash[25448]: cluster 2021-03-10T14:23:25.646498+0000 mgr.gibba020.yqfnwy (mgr.34427) 1644 : cluster [DBG] pgmap v924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:29.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:28 gibba013 bash[29418]: cluster 2021-03-10T14:23:27.648048+0000 mgr.gibba020.yqfnwy (mgr.34427) 1645 : cluster [DBG] pgmap v925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:29.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:28 gibba013 bash[30381]: cluster 2021-03-10T14:23:27.648048+0000 mgr.gibba020.yqfnwy (mgr.34427) 1645 : cluster [DBG] pgmap v925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:29.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:28 gibba020 bash[25448]: cluster 2021-03-10T14:23:27.648048+0000 mgr.gibba020.yqfnwy (mgr.34427) 1645 : cluster [DBG] pgmap v925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:31.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:30 gibba013 bash[29418]: cluster 2021-03-10T14:23:29.649450+0000 mgr.gibba020.yqfnwy (mgr.34427) 1646 : cluster [DBG] pgmap v926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:31.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:30 gibba013 bash[30381]: cluster 2021-03-10T14:23:29.649450+0000 mgr.gibba020.yqfnwy (mgr.34427) 1646 : cluster [DBG] pgmap v926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:31.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:30 gibba020 bash[25448]: cluster 2021-03-10T14:23:29.649450+0000 mgr.gibba020.yqfnwy (mgr.34427) 1646 : cluster [DBG] pgmap v926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:33.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:32 gibba013 bash[29418]: cluster 2021-03-10T14:23:31.650018+0000 mgr.gibba020.yqfnwy (mgr.34427) 1647 : cluster [DBG] pgmap v927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:33.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:32 gibba013 bash[30381]: cluster 2021-03-10T14:23:31.650018+0000 mgr.gibba020.yqfnwy (mgr.34427) 1647 : cluster [DBG] pgmap v927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:33.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:32 gibba020 bash[25448]: cluster 2021-03-10T14:23:31.650018+0000 mgr.gibba020.yqfnwy (mgr.34427) 1647 : cluster [DBG] pgmap v927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:33.969 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:23:34.196 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:23:34.196 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (30m) 5m ago 35m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:23:34.196 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (35m) 4m ago 35m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:23:34.196 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (30m) 4m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:23:34.197 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (30m) 4m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:23:34.197 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (29m) 5m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:23:34.197 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (29m) 5m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:23:34.197 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (29m) 4m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:23:34.198 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (29m) 5m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:23:34.198 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (35m) 5m ago 35m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:23:34.198 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (35m) 4m ago 35m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:23:34.198 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (28m) 5m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:23:34.198 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (27m) 5m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:23:34.199 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (27m) 5m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:23:34.199 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (27m) 5m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:23:34.199 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (26m) 4m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:23:34.199 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (26m) 4m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:23:34.199 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (25m) 4m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:23:34.200 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (25m) 4m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:23:34.200 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (34m) 4m ago 35m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:23:34.200 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 4m ago 33m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:23:34.446 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:23:34.446 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:23:34.446 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:23:34.446 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:23:34.447 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:23:34.447 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:23:34.447 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:23:34.447 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:23:34.447 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:23:34.448 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:23:34.448 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:23:34.448 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:23:34.448 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:23:34.448 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:23:34.449 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:23:35.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:34 gibba013 bash[29418]: cluster 2021-03-10T14:23:33.651566+0000 mgr.gibba020.yqfnwy (mgr.34427) 1648 : cluster [DBG] pgmap v928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:35.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:34 gibba013 bash[29418]: audit 2021-03-10T14:23:34.444518+0000 mon.a (mon.0) 1046 : audit [DBG] from='client.? 172.21.2.113:0/298280820' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:35.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:34 gibba013 bash[30381]: cluster 2021-03-10T14:23:33.651566+0000 mgr.gibba020.yqfnwy (mgr.34427) 1648 : cluster [DBG] pgmap v928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:35.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:34 gibba013 bash[30381]: audit 2021-03-10T14:23:34.444518+0000 mon.a (mon.0) 1046 : audit [DBG] from='client.? 172.21.2.113:0/298280820' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:35.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:34 gibba020 bash[25448]: cluster 2021-03-10T14:23:33.651566+0000 mgr.gibba020.yqfnwy (mgr.34427) 1648 : cluster [DBG] pgmap v928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:35.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:34 gibba020 bash[25448]: audit 2021-03-10T14:23:34.444518+0000 mon.a (mon.0) 1046 : audit [DBG] from='client.? 172.21.2.113:0/298280820' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:36.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:35 gibba013 bash[29418]: audit 2021-03-10T14:23:33.957626+0000 mgr.gibba020.yqfnwy (mgr.34427) 1649 : audit [DBG] from='client.45168 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:23:36.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:35 gibba013 bash[29418]: audit 2021-03-10T14:23:34.180441+0000 mgr.gibba020.yqfnwy (mgr.34427) 1650 : audit [DBG] from='client.45174 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:23:36.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:35 gibba013 bash[29418]: cephadm 2021-03-10T14:23:34.404102+0000 mgr.gibba020.yqfnwy (mgr.34427) 1651 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:23:36.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:35 gibba013 bash[30381]: audit 2021-03-10T14:23:33.957626+0000 mgr.gibba020.yqfnwy (mgr.34427) 1649 : audit [DBG] from='client.45168 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:23:36.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:35 gibba013 bash[30381]: audit 2021-03-10T14:23:34.180441+0000 mgr.gibba020.yqfnwy (mgr.34427) 1650 : audit [DBG] from='client.45174 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:23:36.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:35 gibba013 bash[30381]: cephadm 2021-03-10T14:23:34.404102+0000 mgr.gibba020.yqfnwy (mgr.34427) 1651 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:23:36.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:35 gibba020 bash[25448]: audit 2021-03-10T14:23:33.957626+0000 mgr.gibba020.yqfnwy (mgr.34427) 1649 : audit [DBG] from='client.45168 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:23:36.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:35 gibba020 bash[25448]: audit 2021-03-10T14:23:34.180441+0000 mgr.gibba020.yqfnwy (mgr.34427) 1650 : audit [DBG] from='client.45174 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:23:36.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:35 gibba020 bash[25448]: cephadm 2021-03-10T14:23:34.404102+0000 mgr.gibba020.yqfnwy (mgr.34427) 1651 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:23:37.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:36 gibba013 bash[29418]: cluster 2021-03-10T14:23:35.653052+0000 mgr.gibba020.yqfnwy (mgr.34427) 1652 : cluster [DBG] pgmap v929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:37.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:36 gibba013 bash[30381]: cluster 2021-03-10T14:23:35.653052+0000 mgr.gibba020.yqfnwy (mgr.34427) 1652 : cluster [DBG] pgmap v929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:37.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:36 gibba020 bash[25448]: cluster 2021-03-10T14:23:35.653052+0000 mgr.gibba020.yqfnwy (mgr.34427) 1652 : cluster [DBG] pgmap v929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:39.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:38 gibba013 bash[29418]: cluster 2021-03-10T14:23:37.654542+0000 mgr.gibba020.yqfnwy (mgr.34427) 1653 : cluster [DBG] pgmap v930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:39.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:38 gibba013 bash[30381]: cluster 2021-03-10T14:23:37.654542+0000 mgr.gibba020.yqfnwy (mgr.34427) 1653 : cluster [DBG] pgmap v930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:39.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:38 gibba020 bash[25448]: cluster 2021-03-10T14:23:37.654542+0000 mgr.gibba020.yqfnwy (mgr.34427) 1653 : cluster [DBG] pgmap v930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:41.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:40 gibba013 bash[29418]: cluster 2021-03-10T14:23:39.656215+0000 mgr.gibba020.yqfnwy (mgr.34427) 1654 : cluster [DBG] pgmap v931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:41.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:40 gibba013 bash[30381]: cluster 2021-03-10T14:23:39.656215+0000 mgr.gibba020.yqfnwy (mgr.34427) 1654 : cluster [DBG] pgmap v931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:41.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:40 gibba020 bash[25448]: cluster 2021-03-10T14:23:39.656215+0000 mgr.gibba020.yqfnwy (mgr.34427) 1654 : cluster [DBG] pgmap v931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:43.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:42 gibba013 bash[29418]: cluster 2021-03-10T14:23:41.656835+0000 mgr.gibba020.yqfnwy (mgr.34427) 1655 : cluster [DBG] pgmap v932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:43.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:42 gibba013 bash[30381]: cluster 2021-03-10T14:23:41.656835+0000 mgr.gibba020.yqfnwy (mgr.34427) 1655 : cluster [DBG] pgmap v932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:43.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:42 gibba020 bash[25448]: cluster 2021-03-10T14:23:41.656835+0000 mgr.gibba020.yqfnwy (mgr.34427) 1655 : cluster [DBG] pgmap v932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:45.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:44 gibba013 bash[29418]: cluster 2021-03-10T14:23:43.658241+0000 mgr.gibba020.yqfnwy (mgr.34427) 1656 : cluster [DBG] pgmap v933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:45.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:44 gibba013 bash[30381]: cluster 2021-03-10T14:23:43.658241+0000 mgr.gibba020.yqfnwy (mgr.34427) 1656 : cluster [DBG] pgmap v933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:45.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:44 gibba020 bash[25448]: cluster 2021-03-10T14:23:43.658241+0000 mgr.gibba020.yqfnwy (mgr.34427) 1656 : cluster [DBG] pgmap v933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:46.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:46 gibba013 bash[29418]: cluster 2021-03-10T14:23:45.659979+0000 mgr.gibba020.yqfnwy (mgr.34427) 1657 : cluster [DBG] pgmap v934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:46.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:46 gibba013 bash[30381]: cluster 2021-03-10T14:23:45.659979+0000 mgr.gibba020.yqfnwy (mgr.34427) 1657 : cluster [DBG] pgmap v934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:46.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:46 gibba020 bash[25448]: cluster 2021-03-10T14:23:45.659979+0000 mgr.gibba020.yqfnwy (mgr.34427) 1657 : cluster [DBG] pgmap v934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:49.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:48 gibba013 bash[29418]: cluster 2021-03-10T14:23:47.661540+0000 mgr.gibba020.yqfnwy (mgr.34427) 1658 : cluster [DBG] pgmap v935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:49.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:48 gibba013 bash[30381]: cluster 2021-03-10T14:23:47.661540+0000 mgr.gibba020.yqfnwy (mgr.34427) 1658 : cluster [DBG] pgmap v935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:49.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:48 gibba020 bash[25448]: cluster 2021-03-10T14:23:47.661540+0000 mgr.gibba020.yqfnwy (mgr.34427) 1658 : cluster [DBG] pgmap v935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:49.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:49 gibba020 bash[25448]: audit 2021-03-10T14:23:49.423023+0000 mon.a (mon.0) 1047 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:23:49.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:49 gibba020 bash[25448]: audit 2021-03-10T14:23:49.640593+0000 mon.a (mon.0) 1048 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:23:49.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:49 gibba020 bash[25448]: audit 2021-03-10T14:23:49.643950+0000 mon.a (mon.0) 1049 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:23:49.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:49 gibba020 bash[25448]: audit 2021-03-10T14:23:49.645336+0000 mon.a (mon.0) 1050 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:49.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:49 gibba020 bash[25448]: audit 2021-03-10T14:23:49.646902+0000 mon.a (mon.0) 1051 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:49.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:49 gibba020 bash[25448]: audit 2021-03-10T14:23:49.648449+0000 mon.a (mon.0) 1052 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:49.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:49 gibba020 bash[25448]: audit 2021-03-10T14:23:49.651521+0000 mon.a (mon.0) 1053 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:49.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:49 gibba020 bash[25448]: audit 2021-03-10T14:23:49.653323+0000 mon.a (mon.0) 1054 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:50.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:49 gibba013 bash[29418]: audit 2021-03-10T14:23:49.423023+0000 mon.a (mon.0) 1047 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:23:50.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:49 gibba013 bash[29418]: audit 2021-03-10T14:23:49.640593+0000 mon.a (mon.0) 1048 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:23:50.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:49 gibba013 bash[29418]: audit 2021-03-10T14:23:49.643950+0000 mon.a (mon.0) 1049 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:23:50.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:49 gibba013 bash[29418]: audit 2021-03-10T14:23:49.645336+0000 mon.a (mon.0) 1050 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:50.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:49 gibba013 bash[29418]: audit 2021-03-10T14:23:49.646902+0000 mon.a (mon.0) 1051 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:50.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:49 gibba013 bash[29418]: audit 2021-03-10T14:23:49.648449+0000 mon.a (mon.0) 1052 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:50.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:49 gibba013 bash[29418]: audit 2021-03-10T14:23:49.651521+0000 mon.a (mon.0) 1053 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:50.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:49 gibba013 bash[29418]: audit 2021-03-10T14:23:49.653323+0000 mon.a (mon.0) 1054 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:50.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:49 gibba013 bash[30381]: audit 2021-03-10T14:23:49.423023+0000 mon.a (mon.0) 1047 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:23:50.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:49 gibba013 bash[30381]: audit 2021-03-10T14:23:49.640593+0000 mon.a (mon.0) 1048 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:23:50.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:49 gibba013 bash[30381]: audit 2021-03-10T14:23:49.643950+0000 mon.a (mon.0) 1049 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:23:50.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:49 gibba013 bash[30381]: audit 2021-03-10T14:23:49.645336+0000 mon.a (mon.0) 1050 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:50.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:49 gibba013 bash[30381]: audit 2021-03-10T14:23:49.646902+0000 mon.a (mon.0) 1051 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:50.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:49 gibba013 bash[30381]: audit 2021-03-10T14:23:49.648449+0000 mon.a (mon.0) 1052 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:50.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:49 gibba013 bash[30381]: audit 2021-03-10T14:23:49.651521+0000 mon.a (mon.0) 1053 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:50.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:49 gibba013 bash[30381]: audit 2021-03-10T14:23:49.653323+0000 mon.a (mon.0) 1054 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:23:51.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:50 gibba013 bash[29418]: cephadm 2021-03-10T14:23:49.426786+0000 mgr.gibba020.yqfnwy (mgr.34427) 1659 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:23:51.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:50 gibba013 bash[29418]: cephadm 2021-03-10T14:23:49.428396+0000 mgr.gibba020.yqfnwy (mgr.34427) 1660 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:23:51.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:50 gibba013 bash[29418]: cephadm 2021-03-10T14:23:49.641181+0000 mgr.gibba020.yqfnwy (mgr.34427) 1661 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:23:51.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:50 gibba013 bash[29418]: cephadm 2021-03-10T14:23:49.642908+0000 mgr.gibba020.yqfnwy (mgr.34427) 1662 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:23:51.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:50 gibba013 bash[29418]: cephadm 2021-03-10T14:23:49.644235+0000 mgr.gibba020.yqfnwy (mgr.34427) 1663 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:23:51.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:50 gibba013 bash[29418]: cephadm 2021-03-10T14:23:49.644272+0000 mgr.gibba020.yqfnwy (mgr.34427) 1664 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:23:51.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:50 gibba013 bash[29418]: cephadm 2021-03-10T14:23:49.645988+0000 mgr.gibba020.yqfnwy (mgr.34427) 1665 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:23:51.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:50 gibba013 bash[29418]: cephadm 2021-03-10T14:23:49.646027+0000 mgr.gibba020.yqfnwy (mgr.34427) 1666 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:23:51.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:50 gibba013 bash[29418]: cephadm 2021-03-10T14:23:49.647400+0000 mgr.gibba020.yqfnwy (mgr.34427) 1667 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:23:51.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:50 gibba013 bash[29418]: cephadm 2021-03-10T14:23:49.648960+0000 mgr.gibba020.yqfnwy (mgr.34427) 1668 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:23:51.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:50 gibba013 bash[29418]: cephadm 2021-03-10T14:23:49.648996+0000 mgr.gibba020.yqfnwy (mgr.34427) 1669 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:23:51.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:50 gibba013 bash[29418]: cephadm 2021-03-10T14:23:49.650607+0000 mgr.gibba020.yqfnwy (mgr.34427) 1670 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:23:51.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:50 gibba013 bash[29418]: cephadm 2021-03-10T14:23:49.650939+0000 mgr.gibba020.yqfnwy (mgr.34427) 1671 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:23:51.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:50 gibba013 bash[29418]: cephadm 2021-03-10T14:23:49.652248+0000 mgr.gibba020.yqfnwy (mgr.34427) 1672 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:23:51.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:50 gibba013 bash[29418]: cephadm 2021-03-10T14:23:49.652286+0000 mgr.gibba020.yqfnwy (mgr.34427) 1673 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:23:51.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:50 gibba013 bash[29418]: cephadm 2021-03-10T14:23:49.652396+0000 mgr.gibba020.yqfnwy (mgr.34427) 1674 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:23:51.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:50 gibba013 bash[29418]: cluster 2021-03-10T14:23:49.662815+0000 mgr.gibba020.yqfnwy (mgr.34427) 1675 : cluster [DBG] pgmap v936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:51.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:50 gibba013 bash[30381]: cephadm 2021-03-10T14:23:49.426786+0000 mgr.gibba020.yqfnwy (mgr.34427) 1659 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:23:51.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:50 gibba013 bash[30381]: cephadm 2021-03-10T14:23:49.428396+0000 mgr.gibba020.yqfnwy (mgr.34427) 1660 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:23:51.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:50 gibba013 bash[30381]: cephadm 2021-03-10T14:23:49.641181+0000 mgr.gibba020.yqfnwy (mgr.34427) 1661 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:23:51.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:50 gibba013 bash[30381]: cephadm 2021-03-10T14:23:49.642908+0000 mgr.gibba020.yqfnwy (mgr.34427) 1662 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:23:51.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:50 gibba013 bash[30381]: cephadm 2021-03-10T14:23:49.644235+0000 mgr.gibba020.yqfnwy (mgr.34427) 1663 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:23:51.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:50 gibba013 bash[30381]: cephadm 2021-03-10T14:23:49.644272+0000 mgr.gibba020.yqfnwy (mgr.34427) 1664 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:23:51.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:50 gibba013 bash[30381]: cephadm 2021-03-10T14:23:49.645988+0000 mgr.gibba020.yqfnwy (mgr.34427) 1665 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:23:51.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:50 gibba013 bash[30381]: cephadm 2021-03-10T14:23:49.646027+0000 mgr.gibba020.yqfnwy (mgr.34427) 1666 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:23:51.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:50 gibba013 bash[30381]: cephadm 2021-03-10T14:23:49.647400+0000 mgr.gibba020.yqfnwy (mgr.34427) 1667 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:23:51.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:50 gibba013 bash[30381]: cephadm 2021-03-10T14:23:49.648960+0000 mgr.gibba020.yqfnwy (mgr.34427) 1668 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:23:51.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:50 gibba013 bash[30381]: cephadm 2021-03-10T14:23:49.648996+0000 mgr.gibba020.yqfnwy (mgr.34427) 1669 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:23:51.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:50 gibba013 bash[30381]: cephadm 2021-03-10T14:23:49.650607+0000 mgr.gibba020.yqfnwy (mgr.34427) 1670 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:23:51.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:50 gibba013 bash[30381]: cephadm 2021-03-10T14:23:49.650939+0000 mgr.gibba020.yqfnwy (mgr.34427) 1671 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:23:51.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:50 gibba013 bash[30381]: cephadm 2021-03-10T14:23:49.652248+0000 mgr.gibba020.yqfnwy (mgr.34427) 1672 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:23:51.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:50 gibba013 bash[30381]: cephadm 2021-03-10T14:23:49.652286+0000 mgr.gibba020.yqfnwy (mgr.34427) 1673 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:23:51.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:50 gibba013 bash[30381]: cephadm 2021-03-10T14:23:49.652396+0000 mgr.gibba020.yqfnwy (mgr.34427) 1674 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:23:51.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:50 gibba013 bash[30381]: cluster 2021-03-10T14:23:49.662815+0000 mgr.gibba020.yqfnwy (mgr.34427) 1675 : cluster [DBG] pgmap v936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:51.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:50 gibba020 bash[25448]: cephadm 2021-03-10T14:23:49.426786+0000 mgr.gibba020.yqfnwy (mgr.34427) 1659 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:23:51.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:50 gibba020 bash[25448]: cephadm 2021-03-10T14:23:49.428396+0000 mgr.gibba020.yqfnwy (mgr.34427) 1660 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:23:51.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:50 gibba020 bash[25448]: cephadm 2021-03-10T14:23:49.641181+0000 mgr.gibba020.yqfnwy (mgr.34427) 1661 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:23:51.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:50 gibba020 bash[25448]: cephadm 2021-03-10T14:23:49.642908+0000 mgr.gibba020.yqfnwy (mgr.34427) 1662 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:23:51.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:50 gibba020 bash[25448]: cephadm 2021-03-10T14:23:49.644235+0000 mgr.gibba020.yqfnwy (mgr.34427) 1663 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:23:51.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:50 gibba020 bash[25448]: cephadm 2021-03-10T14:23:49.644272+0000 mgr.gibba020.yqfnwy (mgr.34427) 1664 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:23:51.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:50 gibba020 bash[25448]: cephadm 2021-03-10T14:23:49.645988+0000 mgr.gibba020.yqfnwy (mgr.34427) 1665 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:23:51.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:50 gibba020 bash[25448]: cephadm 2021-03-10T14:23:49.646027+0000 mgr.gibba020.yqfnwy (mgr.34427) 1666 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:23:51.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:50 gibba020 bash[25448]: cephadm 2021-03-10T14:23:49.647400+0000 mgr.gibba020.yqfnwy (mgr.34427) 1667 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:23:51.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:50 gibba020 bash[25448]: cephadm 2021-03-10T14:23:49.648960+0000 mgr.gibba020.yqfnwy (mgr.34427) 1668 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:23:51.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:50 gibba020 bash[25448]: cephadm 2021-03-10T14:23:49.648996+0000 mgr.gibba020.yqfnwy (mgr.34427) 1669 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:23:51.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:50 gibba020 bash[25448]: cephadm 2021-03-10T14:23:49.650607+0000 mgr.gibba020.yqfnwy (mgr.34427) 1670 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:23:51.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:50 gibba020 bash[25448]: cephadm 2021-03-10T14:23:49.650939+0000 mgr.gibba020.yqfnwy (mgr.34427) 1671 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:23:51.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:50 gibba020 bash[25448]: cephadm 2021-03-10T14:23:49.652248+0000 mgr.gibba020.yqfnwy (mgr.34427) 1672 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:23:51.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:50 gibba020 bash[25448]: cephadm 2021-03-10T14:23:49.652286+0000 mgr.gibba020.yqfnwy (mgr.34427) 1673 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:23:51.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:50 gibba020 bash[25448]: cephadm 2021-03-10T14:23:49.652396+0000 mgr.gibba020.yqfnwy (mgr.34427) 1674 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:23:51.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:50 gibba020 bash[25448]: cluster 2021-03-10T14:23:49.662815+0000 mgr.gibba020.yqfnwy (mgr.34427) 1675 : cluster [DBG] pgmap v936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:53.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:52 gibba013 bash[29418]: cluster 2021-03-10T14:23:51.663546+0000 mgr.gibba020.yqfnwy (mgr.34427) 1676 : cluster [DBG] pgmap v937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:53.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:52 gibba013 bash[30381]: cluster 2021-03-10T14:23:51.663546+0000 mgr.gibba020.yqfnwy (mgr.34427) 1676 : cluster [DBG] pgmap v937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:53.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:52 gibba020 bash[25448]: cluster 2021-03-10T14:23:51.663546+0000 mgr.gibba020.yqfnwy (mgr.34427) 1676 : cluster [DBG] pgmap v937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:55.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:54 gibba013 bash[29418]: cluster 2021-03-10T14:23:53.664864+0000 mgr.gibba020.yqfnwy (mgr.34427) 1677 : cluster [DBG] pgmap v938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:55.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:54 gibba013 bash[30381]: cluster 2021-03-10T14:23:53.664864+0000 mgr.gibba020.yqfnwy (mgr.34427) 1677 : cluster [DBG] pgmap v938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:55.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:54 gibba020 bash[25448]: cluster 2021-03-10T14:23:53.664864+0000 mgr.gibba020.yqfnwy (mgr.34427) 1677 : cluster [DBG] pgmap v938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:56.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:56 gibba013 bash[29418]: cluster 2021-03-10T14:23:55.666430+0000 mgr.gibba020.yqfnwy (mgr.34427) 1678 : cluster [DBG] pgmap v939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:56.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:56 gibba013 bash[30381]: cluster 2021-03-10T14:23:55.666430+0000 mgr.gibba020.yqfnwy (mgr.34427) 1678 : cluster [DBG] pgmap v939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:56.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:56 gibba020 bash[25448]: cluster 2021-03-10T14:23:55.666430+0000 mgr.gibba020.yqfnwy (mgr.34427) 1678 : cluster [DBG] pgmap v939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:59.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:23:58 gibba013 bash[29418]: cluster 2021-03-10T14:23:57.667826+0000 mgr.gibba020.yqfnwy (mgr.34427) 1679 : cluster [DBG] pgmap v940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:59.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:23:58 gibba013 bash[30381]: cluster 2021-03-10T14:23:57.667826+0000 mgr.gibba020.yqfnwy (mgr.34427) 1679 : cluster [DBG] pgmap v940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:23:59.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:23:58 gibba020 bash[25448]: cluster 2021-03-10T14:23:57.667826+0000 mgr.gibba020.yqfnwy (mgr.34427) 1679 : cluster [DBG] pgmap v940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:01.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:00 gibba013 bash[29418]: cluster 2021-03-10T14:23:59.669217+0000 mgr.gibba020.yqfnwy (mgr.34427) 1680 : cluster [DBG] pgmap v941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:01.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:00 gibba013 bash[30381]: cluster 2021-03-10T14:23:59.669217+0000 mgr.gibba020.yqfnwy (mgr.34427) 1680 : cluster [DBG] pgmap v941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:01.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:00 gibba020 bash[25448]: cluster 2021-03-10T14:23:59.669217+0000 mgr.gibba020.yqfnwy (mgr.34427) 1680 : cluster [DBG] pgmap v941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:03.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:02 gibba013 bash[29418]: cluster 2021-03-10T14:24:01.670171+0000 mgr.gibba020.yqfnwy (mgr.34427) 1681 : cluster [DBG] pgmap v942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:03.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:02 gibba013 bash[30381]: cluster 2021-03-10T14:24:01.670171+0000 mgr.gibba020.yqfnwy (mgr.34427) 1681 : cluster [DBG] pgmap v942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:03.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:02 gibba020 bash[25448]: cluster 2021-03-10T14:24:01.670171+0000 mgr.gibba020.yqfnwy (mgr.34427) 1681 : cluster [DBG] pgmap v942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:04.691 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:24:04.920 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:24:04.921 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (30m) 6m ago 35m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:24:04.921 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (35m) 5m ago 35m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:24:04.921 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (30m) 5m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:24:04.921 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (31m) 5m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:24:04.922 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (30m) 6m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:24:04.922 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (30m) 6m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:24:04.922 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (29m) 5m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:24:04.922 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (29m) 6m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:24:04.923 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (36m) 6m ago 36m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:24:04.923 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (36m) 5m ago 36m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:24:04.923 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (28m) 6m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:24:04.923 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (28m) 6m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:24:04.923 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (28m) 6m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:24:04.924 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (27m) 6m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:24:04.924 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (27m) 5m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:24:04.924 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (26m) 5m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:24:04.924 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (26m) 5m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:24:04.924 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (25m) 5m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:24:04.925 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (35m) 5m ago 36m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:24:04.925 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 5m ago 34m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:24:04.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:04 gibba020 bash[25448]: cluster 2021-03-10T14:24:03.671697+0000 mgr.gibba020.yqfnwy (mgr.34427) 1682 : cluster [DBG] pgmap v943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:05.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:04 gibba013 bash[29418]: cluster 2021-03-10T14:24:03.671697+0000 mgr.gibba020.yqfnwy (mgr.34427) 1682 : cluster [DBG] pgmap v943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:05.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:04 gibba013 bash[30381]: cluster 2021-03-10T14:24:03.671697+0000 mgr.gibba020.yqfnwy (mgr.34427) 1682 : cluster [DBG] pgmap v943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:05.169 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:24:05.169 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:24:05.169 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:24:05.169 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:24:05.169 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:24:05.170 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:24:05.170 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:24:05.170 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:24:05.170 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:24:05.171 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:24:05.171 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:24:05.171 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:24:05.171 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:24:05.171 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:24:05.172 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:24:06.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:05 gibba013 bash[29418]: cephadm 2021-03-10T14:24:04.659243+0000 mgr.gibba020.yqfnwy (mgr.34427) 1683 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:24:06.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:05 gibba013 bash[29418]: audit 2021-03-10T14:24:04.678627+0000 mgr.gibba020.yqfnwy (mgr.34427) 1684 : audit [DBG] from='client.45186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:24:06.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:05 gibba013 bash[29418]: audit 2021-03-10T14:24:05.167705+0000 mon.a (mon.0) 1055 : audit [DBG] from='client.? 172.21.2.113:0/436908737' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:06.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:05 gibba013 bash[30381]: cephadm 2021-03-10T14:24:04.659243+0000 mgr.gibba020.yqfnwy (mgr.34427) 1683 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:24:06.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:05 gibba013 bash[30381]: audit 2021-03-10T14:24:04.678627+0000 mgr.gibba020.yqfnwy (mgr.34427) 1684 : audit [DBG] from='client.45186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:24:06.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:05 gibba013 bash[30381]: audit 2021-03-10T14:24:05.167705+0000 mon.a (mon.0) 1055 : audit [DBG] from='client.? 172.21.2.113:0/436908737' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:06.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:05 gibba020 bash[25448]: cephadm 2021-03-10T14:24:04.659243+0000 mgr.gibba020.yqfnwy (mgr.34427) 1683 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:24:06.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:05 gibba020 bash[25448]: audit 2021-03-10T14:24:04.678627+0000 mgr.gibba020.yqfnwy (mgr.34427) 1684 : audit [DBG] from='client.45186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:24:06.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:05 gibba020 bash[25448]: audit 2021-03-10T14:24:05.167705+0000 mon.a (mon.0) 1055 : audit [DBG] from='client.? 172.21.2.113:0/436908737' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:07.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:06 gibba013 bash[29418]: audit 2021-03-10T14:24:04.904723+0000 mgr.gibba020.yqfnwy (mgr.34427) 1685 : audit [DBG] from='client.45192 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:24:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:06 gibba013 bash[29418]: cluster 2021-03-10T14:24:05.673372+0000 mgr.gibba020.yqfnwy (mgr.34427) 1686 : cluster [DBG] pgmap v944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:06 gibba013 bash[29418]: audit 2021-03-10T14:24:06.027032+0000 mon.a (mon.0) 1056 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:24:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:06 gibba013 bash[29418]: audit 2021-03-10T14:24:06.027989+0000 mon.a (mon.0) 1057 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:24:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:06 gibba013 bash[29418]: audit 2021-03-10T14:24:06.028746+0000 mon.a (mon.0) 1058 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:24:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:06 gibba013 bash[29418]: audit 2021-03-10T14:24:06.029494+0000 mon.a (mon.0) 1059 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:24:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:06 gibba013 bash[29418]: audit 2021-03-10T14:24:06.130337+0000 mon.a (mon.0) 1060 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:24:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:06 gibba013 bash[29418]: audit 2021-03-10T14:24:06.136678+0000 mon.a (mon.0) 1061 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:24:07.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:06 gibba013 bash[30381]: audit 2021-03-10T14:24:04.904723+0000 mgr.gibba020.yqfnwy (mgr.34427) 1685 : audit [DBG] from='client.45192 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:24:07.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:06 gibba013 bash[30381]: cluster 2021-03-10T14:24:05.673372+0000 mgr.gibba020.yqfnwy (mgr.34427) 1686 : cluster [DBG] pgmap v944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:07.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:06 gibba013 bash[30381]: audit 2021-03-10T14:24:06.027032+0000 mon.a (mon.0) 1056 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:24:07.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:06 gibba013 bash[30381]: audit 2021-03-10T14:24:06.027989+0000 mon.a (mon.0) 1057 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:24:07.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:06 gibba013 bash[30381]: audit 2021-03-10T14:24:06.028746+0000 mon.a (mon.0) 1058 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:24:07.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:06 gibba013 bash[30381]: audit 2021-03-10T14:24:06.029494+0000 mon.a (mon.0) 1059 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:24:07.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:06 gibba013 bash[30381]: audit 2021-03-10T14:24:06.130337+0000 mon.a (mon.0) 1060 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:24:07.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:06 gibba013 bash[30381]: audit 2021-03-10T14:24:06.136678+0000 mon.a (mon.0) 1061 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:24:07.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:06 gibba020 bash[25448]: audit 2021-03-10T14:24:04.904723+0000 mgr.gibba020.yqfnwy (mgr.34427) 1685 : audit [DBG] from='client.45192 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:24:07.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:06 gibba020 bash[25448]: cluster 2021-03-10T14:24:05.673372+0000 mgr.gibba020.yqfnwy (mgr.34427) 1686 : cluster [DBG] pgmap v944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:07.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:06 gibba020 bash[25448]: audit 2021-03-10T14:24:06.027032+0000 mon.a (mon.0) 1056 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:24:07.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:06 gibba020 bash[25448]: audit 2021-03-10T14:24:06.027989+0000 mon.a (mon.0) 1057 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:24:07.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:06 gibba020 bash[25448]: audit 2021-03-10T14:24:06.028746+0000 mon.a (mon.0) 1058 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:24:07.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:06 gibba020 bash[25448]: audit 2021-03-10T14:24:06.029494+0000 mon.a (mon.0) 1059 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:24:07.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:06 gibba020 bash[25448]: audit 2021-03-10T14:24:06.130337+0000 mon.a (mon.0) 1060 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:24:07.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:06 gibba020 bash[25448]: audit 2021-03-10T14:24:06.136678+0000 mon.a (mon.0) 1061 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:24:09.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:08 gibba013 bash[29418]: cluster 2021-03-10T14:24:07.674918+0000 mgr.gibba020.yqfnwy (mgr.34427) 1687 : cluster [DBG] pgmap v945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:09.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:08 gibba013 bash[30381]: cluster 2021-03-10T14:24:07.674918+0000 mgr.gibba020.yqfnwy (mgr.34427) 1687 : cluster [DBG] pgmap v945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:09.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:08 gibba020 bash[25448]: cluster 2021-03-10T14:24:07.674918+0000 mgr.gibba020.yqfnwy (mgr.34427) 1687 : cluster [DBG] pgmap v945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:11.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:10 gibba013 bash[29418]: cluster 2021-03-10T14:24:09.676384+0000 mgr.gibba020.yqfnwy (mgr.34427) 1688 : cluster [DBG] pgmap v946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:11.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:10 gibba013 bash[30381]: cluster 2021-03-10T14:24:09.676384+0000 mgr.gibba020.yqfnwy (mgr.34427) 1688 : cluster [DBG] pgmap v946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:11.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:10 gibba020 bash[25448]: cluster 2021-03-10T14:24:09.676384+0000 mgr.gibba020.yqfnwy (mgr.34427) 1688 : cluster [DBG] pgmap v946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:13.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:12 gibba013 bash[29418]: cluster 2021-03-10T14:24:11.677327+0000 mgr.gibba020.yqfnwy (mgr.34427) 1689 : cluster [DBG] pgmap v947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:13.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:12 gibba013 bash[30381]: cluster 2021-03-10T14:24:11.677327+0000 mgr.gibba020.yqfnwy (mgr.34427) 1689 : cluster [DBG] pgmap v947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:13.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:12 gibba020 bash[25448]: cluster 2021-03-10T14:24:11.677327+0000 mgr.gibba020.yqfnwy (mgr.34427) 1689 : cluster [DBG] pgmap v947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:15.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:14 gibba013 bash[29418]: cluster 2021-03-10T14:24:13.678602+0000 mgr.gibba020.yqfnwy (mgr.34427) 1690 : cluster [DBG] pgmap v948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:15.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:14 gibba013 bash[30381]: cluster 2021-03-10T14:24:13.678602+0000 mgr.gibba020.yqfnwy (mgr.34427) 1690 : cluster [DBG] pgmap v948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:15.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:14 gibba020 bash[25448]: cluster 2021-03-10T14:24:13.678602+0000 mgr.gibba020.yqfnwy (mgr.34427) 1690 : cluster [DBG] pgmap v948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:16.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:16 gibba013 bash[29418]: cluster 2021-03-10T14:24:15.680185+0000 mgr.gibba020.yqfnwy (mgr.34427) 1691 : cluster [DBG] pgmap v949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:16.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:16 gibba013 bash[30381]: cluster 2021-03-10T14:24:15.680185+0000 mgr.gibba020.yqfnwy (mgr.34427) 1691 : cluster [DBG] pgmap v949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:16.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:16 gibba020 bash[25448]: cluster 2021-03-10T14:24:15.680185+0000 mgr.gibba020.yqfnwy (mgr.34427) 1691 : cluster [DBG] pgmap v949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:19.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:18 gibba013 bash[29418]: cluster 2021-03-10T14:24:17.681537+0000 mgr.gibba020.yqfnwy (mgr.34427) 1692 : cluster [DBG] pgmap v950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:19.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:18 gibba013 bash[30381]: cluster 2021-03-10T14:24:17.681537+0000 mgr.gibba020.yqfnwy (mgr.34427) 1692 : cluster [DBG] pgmap v950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:19.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:18 gibba020 bash[25448]: cluster 2021-03-10T14:24:17.681537+0000 mgr.gibba020.yqfnwy (mgr.34427) 1692 : cluster [DBG] pgmap v950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:21.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:20 gibba013 bash[29418]: cephadm 2021-03-10T14:24:19.675312+0000 mgr.gibba020.yqfnwy (mgr.34427) 1693 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:24:21.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:20 gibba013 bash[29418]: cluster 2021-03-10T14:24:19.683039+0000 mgr.gibba020.yqfnwy (mgr.34427) 1694 : cluster [DBG] pgmap v951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:21.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:20 gibba013 bash[30381]: cephadm 2021-03-10T14:24:19.675312+0000 mgr.gibba020.yqfnwy (mgr.34427) 1693 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:24:21.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:20 gibba013 bash[30381]: cluster 2021-03-10T14:24:19.683039+0000 mgr.gibba020.yqfnwy (mgr.34427) 1694 : cluster [DBG] pgmap v951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:21.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:20 gibba020 bash[25448]: cephadm 2021-03-10T14:24:19.675312+0000 mgr.gibba020.yqfnwy (mgr.34427) 1693 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:24:21.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:20 gibba020 bash[25448]: cluster 2021-03-10T14:24:19.683039+0000 mgr.gibba020.yqfnwy (mgr.34427) 1694 : cluster [DBG] pgmap v951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:23.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:22 gibba013 bash[29418]: cluster 2021-03-10T14:24:21.684116+0000 mgr.gibba020.yqfnwy (mgr.34427) 1695 : cluster [DBG] pgmap v952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:23.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:22 gibba013 bash[30381]: cluster 2021-03-10T14:24:21.684116+0000 mgr.gibba020.yqfnwy (mgr.34427) 1695 : cluster [DBG] pgmap v952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:23.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:22 gibba020 bash[25448]: cluster 2021-03-10T14:24:21.684116+0000 mgr.gibba020.yqfnwy (mgr.34427) 1695 : cluster [DBG] pgmap v952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:25.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:24 gibba013 bash[29418]: cluster 2021-03-10T14:24:23.685540+0000 mgr.gibba020.yqfnwy (mgr.34427) 1696 : cluster [DBG] pgmap v953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:25.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:24 gibba013 bash[30381]: cluster 2021-03-10T14:24:23.685540+0000 mgr.gibba020.yqfnwy (mgr.34427) 1696 : cluster [DBG] pgmap v953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:25.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:24 gibba020 bash[25448]: cluster 2021-03-10T14:24:23.685540+0000 mgr.gibba020.yqfnwy (mgr.34427) 1696 : cluster [DBG] pgmap v953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:26.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:26 gibba013 bash[29418]: cluster 2021-03-10T14:24:25.686833+0000 mgr.gibba020.yqfnwy (mgr.34427) 1697 : cluster [DBG] pgmap v954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:26.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:26 gibba013 bash[30381]: cluster 2021-03-10T14:24:25.686833+0000 mgr.gibba020.yqfnwy (mgr.34427) 1697 : cluster [DBG] pgmap v954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:26.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:26 gibba020 bash[25448]: cluster 2021-03-10T14:24:25.686833+0000 mgr.gibba020.yqfnwy (mgr.34427) 1697 : cluster [DBG] pgmap v954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:29.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:28 gibba013 bash[29418]: cluster 2021-03-10T14:24:27.688416+0000 mgr.gibba020.yqfnwy (mgr.34427) 1698 : cluster [DBG] pgmap v955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:29.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:28 gibba013 bash[30381]: cluster 2021-03-10T14:24:27.688416+0000 mgr.gibba020.yqfnwy (mgr.34427) 1698 : cluster [DBG] pgmap v955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:29.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:28 gibba020 bash[25448]: cluster 2021-03-10T14:24:27.688416+0000 mgr.gibba020.yqfnwy (mgr.34427) 1698 : cluster [DBG] pgmap v955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:31.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:30 gibba013 bash[29418]: cluster 2021-03-10T14:24:29.690043+0000 mgr.gibba020.yqfnwy (mgr.34427) 1699 : cluster [DBG] pgmap v956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:31.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:30 gibba013 bash[30381]: cluster 2021-03-10T14:24:29.690043+0000 mgr.gibba020.yqfnwy (mgr.34427) 1699 : cluster [DBG] pgmap v956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:31.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:30 gibba020 bash[25448]: cluster 2021-03-10T14:24:29.690043+0000 mgr.gibba020.yqfnwy (mgr.34427) 1699 : cluster [DBG] pgmap v956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:33.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:32 gibba013 bash[29418]: cluster 2021-03-10T14:24:31.691070+0000 mgr.gibba020.yqfnwy (mgr.34427) 1700 : cluster [DBG] pgmap v957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:33.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:32 gibba013 bash[30381]: cluster 2021-03-10T14:24:31.691070+0000 mgr.gibba020.yqfnwy (mgr.34427) 1700 : cluster [DBG] pgmap v957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:33.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:32 gibba020 bash[25448]: cluster 2021-03-10T14:24:31.691070+0000 mgr.gibba020.yqfnwy (mgr.34427) 1700 : cluster [DBG] pgmap v957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:34.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:34 gibba020 bash[25448]: cluster 2021-03-10T14:24:33.692860+0000 mgr.gibba020.yqfnwy (mgr.34427) 1701 : cluster [DBG] pgmap v958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:35.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:34 gibba013 bash[29418]: cluster 2021-03-10T14:24:33.692860+0000 mgr.gibba020.yqfnwy (mgr.34427) 1701 : cluster [DBG] pgmap v958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:35.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:34 gibba013 bash[30381]: cluster 2021-03-10T14:24:33.692860+0000 mgr.gibba020.yqfnwy (mgr.34427) 1701 : cluster [DBG] pgmap v958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:35.409 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:24:35.631 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:24:35.632 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (31m) 6m ago 36m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:24:35.632 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (36m) 5m ago 36m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:24:35.632 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (31m) 5m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:24:35.632 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (31m) 5m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:24:35.632 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (30m) 6m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:24:35.633 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (30m) 6m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:24:35.633 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (30m) 5m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:24:35.633 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (30m) 6m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:24:35.633 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (36m) 6m ago 36m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:24:35.634 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (36m) 5m ago 36m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:24:35.634 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (29m) 6m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:24:35.634 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (28m) 6m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:24:35.634 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (28m) 6m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:24:35.634 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (28m) 6m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:24:35.635 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (27m) 5m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:24:35.635 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (27m) 5m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:24:35.635 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (26m) 5m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:24:35.635 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (26m) 5m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:24:35.635 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (36m) 5m ago 36m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:24:35.636 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 5m ago 34m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:24:35.881 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:24:35.881 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:24:35.881 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:24:35.881 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:24:35.882 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:24:35.882 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:24:35.882 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:24:35.882 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:24:35.883 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:24:35.883 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:24:35.883 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:24:35.883 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:24:35.883 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:24:35.884 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:24:35.884 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:24:36.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:35 gibba013 bash[29418]: cephadm 2021-03-10T14:24:34.685042+0000 mgr.gibba020.yqfnwy (mgr.34427) 1702 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:24:36.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:35 gibba013 bash[30381]: cephadm 2021-03-10T14:24:34.685042+0000 mgr.gibba020.yqfnwy (mgr.34427) 1702 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:24:36.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:35 gibba020 bash[25448]: cephadm 2021-03-10T14:24:34.685042+0000 mgr.gibba020.yqfnwy (mgr.34427) 1702 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:24:37.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:36 gibba013 bash[29418]: audit 2021-03-10T14:24:35.397533+0000 mgr.gibba020.yqfnwy (mgr.34427) 1703 : audit [DBG] from='client.45204 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:24:37.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:36 gibba013 bash[29418]: audit 2021-03-10T14:24:35.619852+0000 mgr.gibba020.yqfnwy (mgr.34427) 1704 : audit [DBG] from='client.55195 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:24:37.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:36 gibba013 bash[29418]: cluster 2021-03-10T14:24:35.693881+0000 mgr.gibba020.yqfnwy (mgr.34427) 1705 : cluster [DBG] pgmap v959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:37.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:36 gibba013 bash[29418]: audit 2021-03-10T14:24:35.879744+0000 mon.c (mon.1) 37 : audit [DBG] from='client.? 172.21.2.113:0/3973708199' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:37.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:36 gibba013 bash[30381]: audit 2021-03-10T14:24:35.397533+0000 mgr.gibba020.yqfnwy (mgr.34427) 1703 : audit [DBG] from='client.45204 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:24:37.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:36 gibba013 bash[30381]: audit 2021-03-10T14:24:35.619852+0000 mgr.gibba020.yqfnwy (mgr.34427) 1704 : audit [DBG] from='client.55195 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:24:37.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:36 gibba013 bash[30381]: cluster 2021-03-10T14:24:35.693881+0000 mgr.gibba020.yqfnwy (mgr.34427) 1705 : cluster [DBG] pgmap v959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:37.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:36 gibba013 bash[30381]: audit 2021-03-10T14:24:35.879744+0000 mon.c (mon.1) 37 : audit [DBG] from='client.? 172.21.2.113:0/3973708199' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:37.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:36 gibba020 bash[25448]: audit 2021-03-10T14:24:35.397533+0000 mgr.gibba020.yqfnwy (mgr.34427) 1703 : audit [DBG] from='client.45204 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:24:37.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:36 gibba020 bash[25448]: audit 2021-03-10T14:24:35.619852+0000 mgr.gibba020.yqfnwy (mgr.34427) 1704 : audit [DBG] from='client.55195 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:24:37.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:36 gibba020 bash[25448]: cluster 2021-03-10T14:24:35.693881+0000 mgr.gibba020.yqfnwy (mgr.34427) 1705 : cluster [DBG] pgmap v959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:37.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:36 gibba020 bash[25448]: audit 2021-03-10T14:24:35.879744+0000 mon.c (mon.1) 37 : audit [DBG] from='client.? 172.21.2.113:0/3973708199' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:39.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:38 gibba013 bash[29418]: cluster 2021-03-10T14:24:37.695302+0000 mgr.gibba020.yqfnwy (mgr.34427) 1706 : cluster [DBG] pgmap v960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:39.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:38 gibba013 bash[30381]: cluster 2021-03-10T14:24:37.695302+0000 mgr.gibba020.yqfnwy (mgr.34427) 1706 : cluster [DBG] pgmap v960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:39.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:38 gibba020 bash[25448]: cluster 2021-03-10T14:24:37.695302+0000 mgr.gibba020.yqfnwy (mgr.34427) 1706 : cluster [DBG] pgmap v960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:41.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:40 gibba013 bash[29418]: cluster 2021-03-10T14:24:39.696679+0000 mgr.gibba020.yqfnwy (mgr.34427) 1707 : cluster [DBG] pgmap v961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:41.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:40 gibba013 bash[30381]: cluster 2021-03-10T14:24:39.696679+0000 mgr.gibba020.yqfnwy (mgr.34427) 1707 : cluster [DBG] pgmap v961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:41.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:40 gibba020 bash[25448]: cluster 2021-03-10T14:24:39.696679+0000 mgr.gibba020.yqfnwy (mgr.34427) 1707 : cluster [DBG] pgmap v961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:43.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:42 gibba013 bash[29418]: cluster 2021-03-10T14:24:41.697751+0000 mgr.gibba020.yqfnwy (mgr.34427) 1708 : cluster [DBG] pgmap v962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:43.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:42 gibba013 bash[30381]: cluster 2021-03-10T14:24:41.697751+0000 mgr.gibba020.yqfnwy (mgr.34427) 1708 : cluster [DBG] pgmap v962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:43.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:42 gibba020 bash[25448]: cluster 2021-03-10T14:24:41.697751+0000 mgr.gibba020.yqfnwy (mgr.34427) 1708 : cluster [DBG] pgmap v962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:45.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:44 gibba013 bash[29418]: cluster 2021-03-10T14:24:43.699045+0000 mgr.gibba020.yqfnwy (mgr.34427) 1709 : cluster [DBG] pgmap v963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:45.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:44 gibba013 bash[30381]: cluster 2021-03-10T14:24:43.699045+0000 mgr.gibba020.yqfnwy (mgr.34427) 1709 : cluster [DBG] pgmap v963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:45.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:44 gibba020 bash[25448]: cluster 2021-03-10T14:24:43.699045+0000 mgr.gibba020.yqfnwy (mgr.34427) 1709 : cluster [DBG] pgmap v963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:46.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:46 gibba013 bash[29418]: cluster 2021-03-10T14:24:45.700698+0000 mgr.gibba020.yqfnwy (mgr.34427) 1710 : cluster [DBG] pgmap v964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:46.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:46 gibba013 bash[30381]: cluster 2021-03-10T14:24:45.700698+0000 mgr.gibba020.yqfnwy (mgr.34427) 1710 : cluster [DBG] pgmap v964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:46.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:46 gibba020 bash[25448]: cluster 2021-03-10T14:24:45.700698+0000 mgr.gibba020.yqfnwy (mgr.34427) 1710 : cluster [DBG] pgmap v964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:49.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:48 gibba013 bash[29418]: cluster 2021-03-10T14:24:47.702019+0000 mgr.gibba020.yqfnwy (mgr.34427) 1711 : cluster [DBG] pgmap v965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:49.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:48 gibba013 bash[30381]: cluster 2021-03-10T14:24:47.702019+0000 mgr.gibba020.yqfnwy (mgr.34427) 1711 : cluster [DBG] pgmap v965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:49.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:48 gibba020 bash[25448]: cluster 2021-03-10T14:24:47.702019+0000 mgr.gibba020.yqfnwy (mgr.34427) 1711 : cluster [DBG] pgmap v965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:50.110 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:49 gibba020 bash[25448]: audit 2021-03-10T14:24:49.698149+0000 mon.a (mon.0) 1062 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:24:50.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:49 gibba013 bash[29418]: audit 2021-03-10T14:24:49.698149+0000 mon.a (mon.0) 1062 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:24:50.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:49 gibba013 bash[30381]: audit 2021-03-10T14:24:49.698149+0000 mon.a (mon.0) 1062 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:24:51.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:50 gibba013 bash[29418]: cluster 2021-03-10T14:24:49.703398+0000 mgr.gibba020.yqfnwy (mgr.34427) 1712 : cluster [DBG] pgmap v966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:51.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:50 gibba013 bash[29418]: audit 2021-03-10T14:24:49.893998+0000 mon.a (mon.0) 1063 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:24:51.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:50 gibba013 bash[29418]: audit 2021-03-10T14:24:49.896768+0000 mon.a (mon.0) 1064 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:24:51.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:50 gibba013 bash[29418]: audit 2021-03-10T14:24:50.095572+0000 mon.a (mon.0) 1065 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:24:51.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:50 gibba013 bash[29418]: audit 2021-03-10T14:24:50.098958+0000 mon.a (mon.0) 1066 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:24:51.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:50 gibba013 bash[29418]: audit 2021-03-10T14:24:50.100530+0000 mon.a (mon.0) 1067 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:51.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:50 gibba013 bash[29418]: audit 2021-03-10T14:24:50.102107+0000 mon.a (mon.0) 1068 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:51.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:50 gibba013 bash[29418]: audit 2021-03-10T14:24:50.103562+0000 mon.a (mon.0) 1069 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:51.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:50 gibba013 bash[29418]: audit 2021-03-10T14:24:50.106710+0000 mon.a (mon.0) 1070 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:51.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:50 gibba013 bash[29418]: audit 2021-03-10T14:24:50.108592+0000 mon.a (mon.0) 1071 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:51.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:50 gibba013 bash[30381]: cluster 2021-03-10T14:24:49.703398+0000 mgr.gibba020.yqfnwy (mgr.34427) 1712 : cluster [DBG] pgmap v966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:51.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:50 gibba013 bash[30381]: audit 2021-03-10T14:24:49.893998+0000 mon.a (mon.0) 1063 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:24:51.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:50 gibba013 bash[30381]: audit 2021-03-10T14:24:49.896768+0000 mon.a (mon.0) 1064 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:24:51.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:50 gibba013 bash[30381]: audit 2021-03-10T14:24:50.095572+0000 mon.a (mon.0) 1065 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:24:51.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:50 gibba013 bash[30381]: audit 2021-03-10T14:24:50.098958+0000 mon.a (mon.0) 1066 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:24:51.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:50 gibba013 bash[30381]: audit 2021-03-10T14:24:50.100530+0000 mon.a (mon.0) 1067 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:51.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:50 gibba013 bash[30381]: audit 2021-03-10T14:24:50.102107+0000 mon.a (mon.0) 1068 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:51.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:50 gibba013 bash[30381]: audit 2021-03-10T14:24:50.103562+0000 mon.a (mon.0) 1069 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:51.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:50 gibba013 bash[30381]: audit 2021-03-10T14:24:50.106710+0000 mon.a (mon.0) 1070 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:51.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:50 gibba013 bash[30381]: audit 2021-03-10T14:24:50.108592+0000 mon.a (mon.0) 1071 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:51.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:50 gibba020 bash[25448]: cluster 2021-03-10T14:24:49.703398+0000 mgr.gibba020.yqfnwy (mgr.34427) 1712 : cluster [DBG] pgmap v966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:51.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:50 gibba020 bash[25448]: audit 2021-03-10T14:24:49.893998+0000 mon.a (mon.0) 1063 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:24:51.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:50 gibba020 bash[25448]: audit 2021-03-10T14:24:49.896768+0000 mon.a (mon.0) 1064 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:24:51.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:50 gibba020 bash[25448]: audit 2021-03-10T14:24:50.095572+0000 mon.a (mon.0) 1065 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:24:51.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:50 gibba020 bash[25448]: audit 2021-03-10T14:24:50.098958+0000 mon.a (mon.0) 1066 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:24:51.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:50 gibba020 bash[25448]: audit 2021-03-10T14:24:50.100530+0000 mon.a (mon.0) 1067 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:51.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:50 gibba020 bash[25448]: audit 2021-03-10T14:24:50.102107+0000 mon.a (mon.0) 1068 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:51.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:50 gibba020 bash[25448]: audit 2021-03-10T14:24:50.103562+0000 mon.a (mon.0) 1069 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:51.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:50 gibba020 bash[25448]: audit 2021-03-10T14:24:50.106710+0000 mon.a (mon.0) 1070 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:51.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:50 gibba020 bash[25448]: audit 2021-03-10T14:24:50.108592+0000 mon.a (mon.0) 1071 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:24:52.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:51 gibba013 bash[29418]: cephadm 2021-03-10T14:24:49.892830+0000 mgr.gibba020.yqfnwy (mgr.34427) 1713 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:24:52.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:51 gibba013 bash[29418]: cephadm 2021-03-10T14:24:49.896180+0000 mgr.gibba020.yqfnwy (mgr.34427) 1714 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:24:52.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:51 gibba013 bash[29418]: cephadm 2021-03-10T14:24:50.096571+0000 mgr.gibba020.yqfnwy (mgr.34427) 1715 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:24:52.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:51 gibba013 bash[29418]: cephadm 2021-03-10T14:24:50.098303+0000 mgr.gibba020.yqfnwy (mgr.34427) 1716 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:24:52.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:51 gibba013 bash[29418]: cephadm 2021-03-10T14:24:50.099765+0000 mgr.gibba020.yqfnwy (mgr.34427) 1717 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:24:52.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:51 gibba013 bash[29418]: cephadm 2021-03-10T14:24:50.099802+0000 mgr.gibba020.yqfnwy (mgr.34427) 1718 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:24:52.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:51 gibba013 bash[29418]: cephadm 2021-03-10T14:24:50.101340+0000 mgr.gibba020.yqfnwy (mgr.34427) 1719 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:24:52.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:51 gibba013 bash[29418]: cephadm 2021-03-10T14:24:50.101374+0000 mgr.gibba020.yqfnwy (mgr.34427) 1720 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:24:52.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:51 gibba013 bash[29418]: cephadm 2021-03-10T14:24:50.102905+0000 mgr.gibba020.yqfnwy (mgr.34427) 1721 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:24:52.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:51 gibba013 bash[29418]: cephadm 2021-03-10T14:24:50.104365+0000 mgr.gibba020.yqfnwy (mgr.34427) 1722 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:24:52.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:51 gibba013 bash[29418]: cephadm 2021-03-10T14:24:50.104404+0000 mgr.gibba020.yqfnwy (mgr.34427) 1723 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:24:52.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:51 gibba013 bash[29418]: cephadm 2021-03-10T14:24:50.106105+0000 mgr.gibba020.yqfnwy (mgr.34427) 1724 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:24:52.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:51 gibba013 bash[29418]: cephadm 2021-03-10T14:24:50.106414+0000 mgr.gibba020.yqfnwy (mgr.34427) 1725 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:24:52.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:51 gibba013 bash[29418]: cephadm 2021-03-10T14:24:50.107828+0000 mgr.gibba020.yqfnwy (mgr.34427) 1726 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:24:52.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:51 gibba013 bash[29418]: cephadm 2021-03-10T14:24:50.107884+0000 mgr.gibba020.yqfnwy (mgr.34427) 1727 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:24:52.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:51 gibba013 bash[29418]: cephadm 2021-03-10T14:24:50.108047+0000 mgr.gibba020.yqfnwy (mgr.34427) 1728 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:24:52.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:51 gibba013 bash[30381]: cephadm 2021-03-10T14:24:49.892830+0000 mgr.gibba020.yqfnwy (mgr.34427) 1713 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:24:52.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:51 gibba013 bash[30381]: cephadm 2021-03-10T14:24:49.896180+0000 mgr.gibba020.yqfnwy (mgr.34427) 1714 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:24:52.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:51 gibba013 bash[30381]: cephadm 2021-03-10T14:24:50.096571+0000 mgr.gibba020.yqfnwy (mgr.34427) 1715 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:24:52.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:51 gibba013 bash[30381]: cephadm 2021-03-10T14:24:50.098303+0000 mgr.gibba020.yqfnwy (mgr.34427) 1716 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:24:52.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:51 gibba013 bash[30381]: cephadm 2021-03-10T14:24:50.099765+0000 mgr.gibba020.yqfnwy (mgr.34427) 1717 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:24:52.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:51 gibba013 bash[30381]: cephadm 2021-03-10T14:24:50.099802+0000 mgr.gibba020.yqfnwy (mgr.34427) 1718 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:24:52.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:51 gibba013 bash[30381]: cephadm 2021-03-10T14:24:50.101340+0000 mgr.gibba020.yqfnwy (mgr.34427) 1719 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:24:52.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:51 gibba013 bash[30381]: cephadm 2021-03-10T14:24:50.101374+0000 mgr.gibba020.yqfnwy (mgr.34427) 1720 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:24:52.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:51 gibba013 bash[30381]: cephadm 2021-03-10T14:24:50.102905+0000 mgr.gibba020.yqfnwy (mgr.34427) 1721 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:24:52.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:51 gibba013 bash[30381]: cephadm 2021-03-10T14:24:50.104365+0000 mgr.gibba020.yqfnwy (mgr.34427) 1722 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:24:52.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:51 gibba013 bash[30381]: cephadm 2021-03-10T14:24:50.104404+0000 mgr.gibba020.yqfnwy (mgr.34427) 1723 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:24:52.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:51 gibba013 bash[30381]: cephadm 2021-03-10T14:24:50.106105+0000 mgr.gibba020.yqfnwy (mgr.34427) 1724 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:24:52.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:51 gibba013 bash[30381]: cephadm 2021-03-10T14:24:50.106414+0000 mgr.gibba020.yqfnwy (mgr.34427) 1725 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:24:52.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:51 gibba013 bash[30381]: cephadm 2021-03-10T14:24:50.107828+0000 mgr.gibba020.yqfnwy (mgr.34427) 1726 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:24:52.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:51 gibba013 bash[30381]: cephadm 2021-03-10T14:24:50.107884+0000 mgr.gibba020.yqfnwy (mgr.34427) 1727 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:24:52.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:51 gibba013 bash[30381]: cephadm 2021-03-10T14:24:50.108047+0000 mgr.gibba020.yqfnwy (mgr.34427) 1728 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:24:52.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:51 gibba020 bash[25448]: cephadm 2021-03-10T14:24:49.892830+0000 mgr.gibba020.yqfnwy (mgr.34427) 1713 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:24:52.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:51 gibba020 bash[25448]: cephadm 2021-03-10T14:24:49.896180+0000 mgr.gibba020.yqfnwy (mgr.34427) 1714 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:24:52.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:51 gibba020 bash[25448]: cephadm 2021-03-10T14:24:50.096571+0000 mgr.gibba020.yqfnwy (mgr.34427) 1715 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:24:52.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:51 gibba020 bash[25448]: cephadm 2021-03-10T14:24:50.098303+0000 mgr.gibba020.yqfnwy (mgr.34427) 1716 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:24:52.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:51 gibba020 bash[25448]: cephadm 2021-03-10T14:24:50.099765+0000 mgr.gibba020.yqfnwy (mgr.34427) 1717 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:24:52.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:51 gibba020 bash[25448]: cephadm 2021-03-10T14:24:50.099802+0000 mgr.gibba020.yqfnwy (mgr.34427) 1718 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:24:52.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:51 gibba020 bash[25448]: cephadm 2021-03-10T14:24:50.101340+0000 mgr.gibba020.yqfnwy (mgr.34427) 1719 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:24:52.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:51 gibba020 bash[25448]: cephadm 2021-03-10T14:24:50.101374+0000 mgr.gibba020.yqfnwy (mgr.34427) 1720 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:24:52.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:51 gibba020 bash[25448]: cephadm 2021-03-10T14:24:50.102905+0000 mgr.gibba020.yqfnwy (mgr.34427) 1721 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:24:52.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:51 gibba020 bash[25448]: cephadm 2021-03-10T14:24:50.104365+0000 mgr.gibba020.yqfnwy (mgr.34427) 1722 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:24:52.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:51 gibba020 bash[25448]: cephadm 2021-03-10T14:24:50.104404+0000 mgr.gibba020.yqfnwy (mgr.34427) 1723 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:24:52.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:51 gibba020 bash[25448]: cephadm 2021-03-10T14:24:50.106105+0000 mgr.gibba020.yqfnwy (mgr.34427) 1724 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:24:52.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:51 gibba020 bash[25448]: cephadm 2021-03-10T14:24:50.106414+0000 mgr.gibba020.yqfnwy (mgr.34427) 1725 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:24:52.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:51 gibba020 bash[25448]: cephadm 2021-03-10T14:24:50.107828+0000 mgr.gibba020.yqfnwy (mgr.34427) 1726 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:24:52.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:51 gibba020 bash[25448]: cephadm 2021-03-10T14:24:50.107884+0000 mgr.gibba020.yqfnwy (mgr.34427) 1727 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:24:52.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:51 gibba020 bash[25448]: cephadm 2021-03-10T14:24:50.108047+0000 mgr.gibba020.yqfnwy (mgr.34427) 1728 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:24:53.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:52 gibba013 bash[29418]: cluster 2021-03-10T14:24:51.704667+0000 mgr.gibba020.yqfnwy (mgr.34427) 1729 : cluster [DBG] pgmap v967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:53.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:52 gibba013 bash[30381]: cluster 2021-03-10T14:24:51.704667+0000 mgr.gibba020.yqfnwy (mgr.34427) 1729 : cluster [DBG] pgmap v967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:53.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:52 gibba020 bash[25448]: cluster 2021-03-10T14:24:51.704667+0000 mgr.gibba020.yqfnwy (mgr.34427) 1729 : cluster [DBG] pgmap v967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:55.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:54 gibba013 bash[29418]: cluster 2021-03-10T14:24:53.706159+0000 mgr.gibba020.yqfnwy (mgr.34427) 1730 : cluster [DBG] pgmap v968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:55.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:54 gibba013 bash[30381]: cluster 2021-03-10T14:24:53.706159+0000 mgr.gibba020.yqfnwy (mgr.34427) 1730 : cluster [DBG] pgmap v968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:55.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:54 gibba020 bash[25448]: cluster 2021-03-10T14:24:53.706159+0000 mgr.gibba020.yqfnwy (mgr.34427) 1730 : cluster [DBG] pgmap v968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:56.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:56 gibba013 bash[29418]: cluster 2021-03-10T14:24:55.708075+0000 mgr.gibba020.yqfnwy (mgr.34427) 1731 : cluster [DBG] pgmap v969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:56.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:56 gibba013 bash[30381]: cluster 2021-03-10T14:24:55.708075+0000 mgr.gibba020.yqfnwy (mgr.34427) 1731 : cluster [DBG] pgmap v969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:56.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:56 gibba020 bash[25448]: cluster 2021-03-10T14:24:55.708075+0000 mgr.gibba020.yqfnwy (mgr.34427) 1731 : cluster [DBG] pgmap v969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:59.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:24:58 gibba013 bash[29418]: cluster 2021-03-10T14:24:57.709619+0000 mgr.gibba020.yqfnwy (mgr.34427) 1732 : cluster [DBG] pgmap v970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:59.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:24:58 gibba013 bash[30381]: cluster 2021-03-10T14:24:57.709619+0000 mgr.gibba020.yqfnwy (mgr.34427) 1732 : cluster [DBG] pgmap v970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:24:59.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:24:58 gibba020 bash[25448]: cluster 2021-03-10T14:24:57.709619+0000 mgr.gibba020.yqfnwy (mgr.34427) 1732 : cluster [DBG] pgmap v970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:01.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:00 gibba013 bash[29418]: cluster 2021-03-10T14:24:59.711257+0000 mgr.gibba020.yqfnwy (mgr.34427) 1733 : cluster [DBG] pgmap v971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:01.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:00 gibba013 bash[30381]: cluster 2021-03-10T14:24:59.711257+0000 mgr.gibba020.yqfnwy (mgr.34427) 1733 : cluster [DBG] pgmap v971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:01.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:00 gibba020 bash[25448]: cluster 2021-03-10T14:24:59.711257+0000 mgr.gibba020.yqfnwy (mgr.34427) 1733 : cluster [DBG] pgmap v971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:03.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:02 gibba013 bash[29418]: cluster 2021-03-10T14:25:01.713055+0000 mgr.gibba020.yqfnwy (mgr.34427) 1734 : cluster [DBG] pgmap v972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:03.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:02 gibba013 bash[30381]: cluster 2021-03-10T14:25:01.713055+0000 mgr.gibba020.yqfnwy (mgr.34427) 1734 : cluster [DBG] pgmap v972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:03.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:02 gibba020 bash[25448]: cluster 2021-03-10T14:25:01.713055+0000 mgr.gibba020.yqfnwy (mgr.34427) 1734 : cluster [DBG] pgmap v972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:05.127 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:04 gibba020 bash[25448]: cluster 2021-03-10T14:25:03.714447+0000 mgr.gibba020.yqfnwy (mgr.34427) 1735 : cluster [DBG] pgmap v973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:05.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:04 gibba013 bash[29418]: cluster 2021-03-10T14:25:03.714447+0000 mgr.gibba020.yqfnwy (mgr.34427) 1735 : cluster [DBG] pgmap v973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:05.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:04 gibba013 bash[30381]: cluster 2021-03-10T14:25:03.714447+0000 mgr.gibba020.yqfnwy (mgr.34427) 1735 : cluster [DBG] pgmap v973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:06.125 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:25:06.385 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:25:06.385 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (31m) 7m ago 36m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:25:06.385 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (36m) 6m ago 36m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:25:06.385 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (32m) 6m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:25:06.385 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (32m) 6m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:25:06.386 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (31m) 7m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:25:06.386 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (31m) 7m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:25:06.386 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (30m) 6m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:25:06.386 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (30m) 7m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:25:06.387 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (37m) 7m ago 37m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:25:06.387 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (37m) 6m ago 37m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:25:06.387 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (29m) 7m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:25:06.387 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (29m) 7m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:25:06.387 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (29m) 7m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:25:06.388 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (28m) 7m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:25:06.388 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (28m) 6m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:25:06.388 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (27m) 6m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:25:06.388 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (27m) 6m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:25:06.388 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (26m) 6m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:25:06.389 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (36m) 6m ago 37m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:25:06.389 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 6m ago 35m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:25:06.640 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:25:06.640 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:25:06.641 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:25:06.641 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:25:06.641 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:25:06.641 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:25:06.642 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:25:06.642 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:25:06.642 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:25:06.642 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:25:06.643 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:25:06.643 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:25:06.643 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:25:06.643 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:25:06.643 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:25:06.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:06 gibba013 bash[29418]: cephadm 2021-03-10T14:25:05.124141+0000 mgr.gibba020.yqfnwy (mgr.34427) 1736 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:25:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:06 gibba013 bash[29418]: cluster 2021-03-10T14:25:05.716066+0000 mgr.gibba020.yqfnwy (mgr.34427) 1737 : cluster [DBG] pgmap v974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:06 gibba013 bash[29418]: audit 2021-03-10T14:25:06.037470+0000 mon.a (mon.0) 1072 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:25:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:06 gibba013 bash[29418]: audit 2021-03-10T14:25:06.037752+0000 mon.a (mon.0) 1073 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:25:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:06 gibba013 bash[29418]: audit 2021-03-10T14:25:06.037899+0000 mon.a (mon.0) 1074 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:25:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:06 gibba013 bash[29418]: audit 2021-03-10T14:25:06.038084+0000 mon.a (mon.0) 1075 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:25:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:06 gibba013 bash[29418]: audit 2021-03-10T14:25:06.135930+0000 mon.a (mon.0) 1076 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:25:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:06 gibba013 bash[29418]: audit 2021-03-10T14:25:06.141302+0000 mon.a (mon.0) 1077 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:25:06.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:06 gibba013 bash[30381]: cephadm 2021-03-10T14:25:05.124141+0000 mgr.gibba020.yqfnwy (mgr.34427) 1736 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:25:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:06 gibba013 bash[30381]: cluster 2021-03-10T14:25:05.716066+0000 mgr.gibba020.yqfnwy (mgr.34427) 1737 : cluster [DBG] pgmap v974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:06 gibba013 bash[30381]: audit 2021-03-10T14:25:06.037470+0000 mon.a (mon.0) 1072 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:25:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:06 gibba013 bash[30381]: audit 2021-03-10T14:25:06.037752+0000 mon.a (mon.0) 1073 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:25:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:06 gibba013 bash[30381]: audit 2021-03-10T14:25:06.037899+0000 mon.a (mon.0) 1074 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:25:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:06 gibba013 bash[30381]: audit 2021-03-10T14:25:06.038084+0000 mon.a (mon.0) 1075 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:25:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:06 gibba013 bash[30381]: audit 2021-03-10T14:25:06.135930+0000 mon.a (mon.0) 1076 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:25:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:06 gibba013 bash[30381]: audit 2021-03-10T14:25:06.141302+0000 mon.a (mon.0) 1077 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:25:06.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:06 gibba020 bash[25448]: cephadm 2021-03-10T14:25:05.124141+0000 mgr.gibba020.yqfnwy (mgr.34427) 1736 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:25:06.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:06 gibba020 bash[25448]: cluster 2021-03-10T14:25:05.716066+0000 mgr.gibba020.yqfnwy (mgr.34427) 1737 : cluster [DBG] pgmap v974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:06 gibba020 bash[25448]: audit 2021-03-10T14:25:06.037470+0000 mon.a (mon.0) 1072 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:25:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:06 gibba020 bash[25448]: audit 2021-03-10T14:25:06.037752+0000 mon.a (mon.0) 1073 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:25:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:06 gibba020 bash[25448]: audit 2021-03-10T14:25:06.037899+0000 mon.a (mon.0) 1074 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:25:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:06 gibba020 bash[25448]: audit 2021-03-10T14:25:06.038084+0000 mon.a (mon.0) 1075 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:25:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:06 gibba020 bash[25448]: audit 2021-03-10T14:25:06.135930+0000 mon.a (mon.0) 1076 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:25:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:06 gibba020 bash[25448]: audit 2021-03-10T14:25:06.141302+0000 mon.a (mon.0) 1077 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:25:07.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:07 gibba013 bash[29418]: audit 2021-03-10T14:25:06.113849+0000 mgr.gibba020.yqfnwy (mgr.34427) 1738 : audit [DBG] from='client.45222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:25:07.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:07 gibba013 bash[29418]: audit 2021-03-10T14:25:06.341413+0000 mgr.gibba020.yqfnwy (mgr.34427) 1739 : audit [DBG] from='client.55213 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:25:07.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:07 gibba013 bash[29418]: audit 2021-03-10T14:25:06.639224+0000 mon.c (mon.1) 38 : audit [DBG] from='client.? 172.21.2.113:0/1610352927' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:07 gibba013 bash[30381]: audit 2021-03-10T14:25:06.113849+0000 mgr.gibba020.yqfnwy (mgr.34427) 1738 : audit [DBG] from='client.45222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:25:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:07 gibba013 bash[30381]: audit 2021-03-10T14:25:06.341413+0000 mgr.gibba020.yqfnwy (mgr.34427) 1739 : audit [DBG] from='client.55213 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:25:07.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:07 gibba013 bash[30381]: audit 2021-03-10T14:25:06.639224+0000 mon.c (mon.1) 38 : audit [DBG] from='client.? 172.21.2.113:0/1610352927' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:07 gibba020 bash[25448]: audit 2021-03-10T14:25:06.113849+0000 mgr.gibba020.yqfnwy (mgr.34427) 1738 : audit [DBG] from='client.45222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:25:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:07 gibba020 bash[25448]: audit 2021-03-10T14:25:06.341413+0000 mgr.gibba020.yqfnwy (mgr.34427) 1739 : audit [DBG] from='client.55213 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:25:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:07 gibba020 bash[25448]: audit 2021-03-10T14:25:06.639224+0000 mon.c (mon.1) 38 : audit [DBG] from='client.? 172.21.2.113:0/1610352927' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:08.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:08 gibba020 bash[25448]: cluster 2021-03-10T14:25:07.717408+0000 mgr.gibba020.yqfnwy (mgr.34427) 1740 : cluster [DBG] pgmap v975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:09.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:08 gibba013 bash[29418]: cluster 2021-03-10T14:25:07.717408+0000 mgr.gibba020.yqfnwy (mgr.34427) 1740 : cluster [DBG] pgmap v975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:09.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:08 gibba013 bash[30381]: cluster 2021-03-10T14:25:07.717408+0000 mgr.gibba020.yqfnwy (mgr.34427) 1740 : cluster [DBG] pgmap v975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:11.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:10 gibba013 bash[29418]: cluster 2021-03-10T14:25:09.718871+0000 mgr.gibba020.yqfnwy (mgr.34427) 1741 : cluster [DBG] pgmap v976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:11.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:10 gibba013 bash[30381]: cluster 2021-03-10T14:25:09.718871+0000 mgr.gibba020.yqfnwy (mgr.34427) 1741 : cluster [DBG] pgmap v976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:11.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:10 gibba020 bash[25448]: cluster 2021-03-10T14:25:09.718871+0000 mgr.gibba020.yqfnwy (mgr.34427) 1741 : cluster [DBG] pgmap v976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:13.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:12 gibba013 bash[29418]: cluster 2021-03-10T14:25:11.720113+0000 mgr.gibba020.yqfnwy (mgr.34427) 1742 : cluster [DBG] pgmap v977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:13.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:12 gibba013 bash[30381]: cluster 2021-03-10T14:25:11.720113+0000 mgr.gibba020.yqfnwy (mgr.34427) 1742 : cluster [DBG] pgmap v977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:13.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:12 gibba020 bash[25448]: cluster 2021-03-10T14:25:11.720113+0000 mgr.gibba020.yqfnwy (mgr.34427) 1742 : cluster [DBG] pgmap v977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:15.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:14 gibba013 bash[29418]: cluster 2021-03-10T14:25:13.721444+0000 mgr.gibba020.yqfnwy (mgr.34427) 1743 : cluster [DBG] pgmap v978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:15.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:14 gibba013 bash[30381]: cluster 2021-03-10T14:25:13.721444+0000 mgr.gibba020.yqfnwy (mgr.34427) 1743 : cluster [DBG] pgmap v978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:15.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:14 gibba020 bash[25448]: cluster 2021-03-10T14:25:13.721444+0000 mgr.gibba020.yqfnwy (mgr.34427) 1743 : cluster [DBG] pgmap v978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:16.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:16 gibba013 bash[29418]: cluster 2021-03-10T14:25:15.722907+0000 mgr.gibba020.yqfnwy (mgr.34427) 1744 : cluster [DBG] pgmap v979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:16.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:16 gibba013 bash[30381]: cluster 2021-03-10T14:25:15.722907+0000 mgr.gibba020.yqfnwy (mgr.34427) 1744 : cluster [DBG] pgmap v979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:16.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:16 gibba020 bash[25448]: cluster 2021-03-10T14:25:15.722907+0000 mgr.gibba020.yqfnwy (mgr.34427) 1744 : cluster [DBG] pgmap v979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:19.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:18 gibba013 bash[29418]: cluster 2021-03-10T14:25:17.724414+0000 mgr.gibba020.yqfnwy (mgr.34427) 1745 : cluster [DBG] pgmap v980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:19.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:18 gibba013 bash[30381]: cluster 2021-03-10T14:25:17.724414+0000 mgr.gibba020.yqfnwy (mgr.34427) 1745 : cluster [DBG] pgmap v980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:19.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:18 gibba020 bash[25448]: cluster 2021-03-10T14:25:17.724414+0000 mgr.gibba020.yqfnwy (mgr.34427) 1745 : cluster [DBG] pgmap v980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:21.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:20 gibba013 bash[29418]: cluster 2021-03-10T14:25:19.725778+0000 mgr.gibba020.yqfnwy (mgr.34427) 1746 : cluster [DBG] pgmap v981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:21.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:20 gibba013 bash[30381]: cluster 2021-03-10T14:25:19.725778+0000 mgr.gibba020.yqfnwy (mgr.34427) 1746 : cluster [DBG] pgmap v981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:21.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:20 gibba020 bash[25448]: cluster 2021-03-10T14:25:19.725778+0000 mgr.gibba020.yqfnwy (mgr.34427) 1746 : cluster [DBG] pgmap v981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:22.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:21 gibba013 bash[29418]: cephadm 2021-03-10T14:25:20.134337+0000 mgr.gibba020.yqfnwy (mgr.34427) 1747 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:25:22.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:21 gibba013 bash[30381]: cephadm 2021-03-10T14:25:20.134337+0000 mgr.gibba020.yqfnwy (mgr.34427) 1747 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:25:22.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:21 gibba020 bash[25448]: cephadm 2021-03-10T14:25:20.134337+0000 mgr.gibba020.yqfnwy (mgr.34427) 1747 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:25:23.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:22 gibba013 bash[29418]: cluster 2021-03-10T14:25:21.727206+0000 mgr.gibba020.yqfnwy (mgr.34427) 1748 : cluster [DBG] pgmap v982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:23.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:22 gibba013 bash[30381]: cluster 2021-03-10T14:25:21.727206+0000 mgr.gibba020.yqfnwy (mgr.34427) 1748 : cluster [DBG] pgmap v982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:23.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:22 gibba020 bash[25448]: cluster 2021-03-10T14:25:21.727206+0000 mgr.gibba020.yqfnwy (mgr.34427) 1748 : cluster [DBG] pgmap v982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:25.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:24 gibba013 bash[29418]: cluster 2021-03-10T14:25:23.728611+0000 mgr.gibba020.yqfnwy (mgr.34427) 1749 : cluster [DBG] pgmap v983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:25.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:24 gibba013 bash[30381]: cluster 2021-03-10T14:25:23.728611+0000 mgr.gibba020.yqfnwy (mgr.34427) 1749 : cluster [DBG] pgmap v983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:25.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:24 gibba020 bash[25448]: cluster 2021-03-10T14:25:23.728611+0000 mgr.gibba020.yqfnwy (mgr.34427) 1749 : cluster [DBG] pgmap v983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:26.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:26 gibba013 bash[29418]: cluster 2021-03-10T14:25:25.730363+0000 mgr.gibba020.yqfnwy (mgr.34427) 1750 : cluster [DBG] pgmap v984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:26.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:26 gibba013 bash[30381]: cluster 2021-03-10T14:25:25.730363+0000 mgr.gibba020.yqfnwy (mgr.34427) 1750 : cluster [DBG] pgmap v984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:26.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:26 gibba020 bash[25448]: cluster 2021-03-10T14:25:25.730363+0000 mgr.gibba020.yqfnwy (mgr.34427) 1750 : cluster [DBG] pgmap v984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:29.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:28 gibba013 bash[29418]: cluster 2021-03-10T14:25:27.731992+0000 mgr.gibba020.yqfnwy (mgr.34427) 1751 : cluster [DBG] pgmap v985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:29.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:28 gibba013 bash[30381]: cluster 2021-03-10T14:25:27.731992+0000 mgr.gibba020.yqfnwy (mgr.34427) 1751 : cluster [DBG] pgmap v985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:29.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:28 gibba020 bash[25448]: cluster 2021-03-10T14:25:27.731992+0000 mgr.gibba020.yqfnwy (mgr.34427) 1751 : cluster [DBG] pgmap v985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:31.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:30 gibba013 bash[29418]: cluster 2021-03-10T14:25:29.733505+0000 mgr.gibba020.yqfnwy (mgr.34427) 1752 : cluster [DBG] pgmap v986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:31.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:30 gibba013 bash[30381]: cluster 2021-03-10T14:25:29.733505+0000 mgr.gibba020.yqfnwy (mgr.34427) 1752 : cluster [DBG] pgmap v986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:31.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:30 gibba020 bash[25448]: cluster 2021-03-10T14:25:29.733505+0000 mgr.gibba020.yqfnwy (mgr.34427) 1752 : cluster [DBG] pgmap v986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:33.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:32 gibba013 bash[29418]: cluster 2021-03-10T14:25:31.735116+0000 mgr.gibba020.yqfnwy (mgr.34427) 1753 : cluster [DBG] pgmap v987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:33.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:32 gibba013 bash[30381]: cluster 2021-03-10T14:25:31.735116+0000 mgr.gibba020.yqfnwy (mgr.34427) 1753 : cluster [DBG] pgmap v987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:33.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:32 gibba020 bash[25448]: cluster 2021-03-10T14:25:31.735116+0000 mgr.gibba020.yqfnwy (mgr.34427) 1753 : cluster [DBG] pgmap v987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:35.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:34 gibba013 bash[29418]: cluster 2021-03-10T14:25:33.736600+0000 mgr.gibba020.yqfnwy (mgr.34427) 1754 : cluster [DBG] pgmap v988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:35.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:34 gibba013 bash[30381]: cluster 2021-03-10T14:25:33.736600+0000 mgr.gibba020.yqfnwy (mgr.34427) 1754 : cluster [DBG] pgmap v988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:35.151 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:34 gibba020 bash[25448]: cluster 2021-03-10T14:25:33.736600+0000 mgr.gibba020.yqfnwy (mgr.34427) 1754 : cluster [DBG] pgmap v988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:36.894 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:25:36.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:36 gibba020 bash[25448]: cephadm 2021-03-10T14:25:35.148707+0000 mgr.gibba020.yqfnwy (mgr.34427) 1755 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:25:36.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:36 gibba020 bash[25448]: cluster 2021-03-10T14:25:35.738028+0000 mgr.gibba020.yqfnwy (mgr.34427) 1756 : cluster [DBG] pgmap v989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:37.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:36 gibba013 bash[29418]: cephadm 2021-03-10T14:25:35.148707+0000 mgr.gibba020.yqfnwy (mgr.34427) 1755 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:25:37.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:36 gibba013 bash[29418]: cluster 2021-03-10T14:25:35.738028+0000 mgr.gibba020.yqfnwy (mgr.34427) 1756 : cluster [DBG] pgmap v989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:37.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:36 gibba013 bash[30381]: cephadm 2021-03-10T14:25:35.148707+0000 mgr.gibba020.yqfnwy (mgr.34427) 1755 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:25:37.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:36 gibba013 bash[30381]: cluster 2021-03-10T14:25:35.738028+0000 mgr.gibba020.yqfnwy (mgr.34427) 1756 : cluster [DBG] pgmap v989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:37.147 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:25:37.148 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (32m) 7m ago 37m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:25:37.148 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (37m) 6m ago 37m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:25:37.148 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (32m) 6m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:25:37.148 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (32m) 6m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:25:37.149 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (31m) 7m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:25:37.149 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (31m) 7m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:25:37.149 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (31m) 6m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:25:37.149 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (31m) 7m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:25:37.150 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (37m) 7m ago 37m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:25:37.150 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (37m) 6m ago 37m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:25:37.150 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (30m) 7m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:25:37.150 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (29m) 7m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:25:37.151 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (29m) 7m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:25:37.151 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (29m) 7m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:25:37.151 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (28m) 6m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:25:37.151 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (28m) 6m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:25:37.152 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (27m) 6m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:25:37.152 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (27m) 6m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:25:37.152 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (37m) 6m ago 37m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:25:37.152 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 6m ago 35m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:25:37.395 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:25:37.395 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:25:37.395 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:25:37.395 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:25:37.396 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:25:37.396 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:25:37.396 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:25:37.396 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:25:37.397 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:25:37.397 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:25:37.397 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:25:37.397 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:25:37.397 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:25:37.398 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:25:37.398 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:25:37.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:37 gibba020 bash[25448]: audit 2021-03-10T14:25:37.393769+0000 mon.c (mon.1) 39 : audit [DBG] from='client.? 172.21.2.113:0/1106425207' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:38.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:37 gibba013 bash[29418]: audit 2021-03-10T14:25:37.393769+0000 mon.c (mon.1) 39 : audit [DBG] from='client.? 172.21.2.113:0/1106425207' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:38.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:37 gibba013 bash[30381]: audit 2021-03-10T14:25:37.393769+0000 mon.c (mon.1) 39 : audit [DBG] from='client.? 172.21.2.113:0/1106425207' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:38.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:38 gibba020 bash[25448]: audit 2021-03-10T14:25:36.882995+0000 mgr.gibba020.yqfnwy (mgr.34427) 1757 : audit [DBG] from='client.45240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:25:38.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:38 gibba020 bash[25448]: audit 2021-03-10T14:25:37.104667+0000 mgr.gibba020.yqfnwy (mgr.34427) 1758 : audit [DBG] from='client.55231 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:25:38.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:38 gibba020 bash[25448]: cluster 2021-03-10T14:25:37.739289+0000 mgr.gibba020.yqfnwy (mgr.34427) 1759 : cluster [DBG] pgmap v990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:39.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:38 gibba013 bash[29418]: audit 2021-03-10T14:25:36.882995+0000 mgr.gibba020.yqfnwy (mgr.34427) 1757 : audit [DBG] from='client.45240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:25:39.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:38 gibba013 bash[29418]: audit 2021-03-10T14:25:37.104667+0000 mgr.gibba020.yqfnwy (mgr.34427) 1758 : audit [DBG] from='client.55231 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:25:39.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:38 gibba013 bash[29418]: cluster 2021-03-10T14:25:37.739289+0000 mgr.gibba020.yqfnwy (mgr.34427) 1759 : cluster [DBG] pgmap v990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:39.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:38 gibba013 bash[30381]: audit 2021-03-10T14:25:36.882995+0000 mgr.gibba020.yqfnwy (mgr.34427) 1757 : audit [DBG] from='client.45240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:25:39.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:38 gibba013 bash[30381]: audit 2021-03-10T14:25:37.104667+0000 mgr.gibba020.yqfnwy (mgr.34427) 1758 : audit [DBG] from='client.55231 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:25:39.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:38 gibba013 bash[30381]: cluster 2021-03-10T14:25:37.739289+0000 mgr.gibba020.yqfnwy (mgr.34427) 1759 : cluster [DBG] pgmap v990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:41.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:40 gibba013 bash[29418]: cluster 2021-03-10T14:25:39.740942+0000 mgr.gibba020.yqfnwy (mgr.34427) 1760 : cluster [DBG] pgmap v991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:41.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:40 gibba013 bash[30381]: cluster 2021-03-10T14:25:39.740942+0000 mgr.gibba020.yqfnwy (mgr.34427) 1760 : cluster [DBG] pgmap v991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:41.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:40 gibba020 bash[25448]: cluster 2021-03-10T14:25:39.740942+0000 mgr.gibba020.yqfnwy (mgr.34427) 1760 : cluster [DBG] pgmap v991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:43.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:42 gibba013 bash[29418]: cluster 2021-03-10T14:25:41.742486+0000 mgr.gibba020.yqfnwy (mgr.34427) 1761 : cluster [DBG] pgmap v992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:43.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:42 gibba013 bash[30381]: cluster 2021-03-10T14:25:41.742486+0000 mgr.gibba020.yqfnwy (mgr.34427) 1761 : cluster [DBG] pgmap v992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:43.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:42 gibba020 bash[25448]: cluster 2021-03-10T14:25:41.742486+0000 mgr.gibba020.yqfnwy (mgr.34427) 1761 : cluster [DBG] pgmap v992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:45.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:44 gibba013 bash[29418]: cluster 2021-03-10T14:25:43.744091+0000 mgr.gibba020.yqfnwy (mgr.34427) 1762 : cluster [DBG] pgmap v993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:45.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:44 gibba013 bash[30381]: cluster 2021-03-10T14:25:43.744091+0000 mgr.gibba020.yqfnwy (mgr.34427) 1762 : cluster [DBG] pgmap v993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:45.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:44 gibba020 bash[25448]: cluster 2021-03-10T14:25:43.744091+0000 mgr.gibba020.yqfnwy (mgr.34427) 1762 : cluster [DBG] pgmap v993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:46.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:46 gibba020 bash[25448]: cluster 2021-03-10T14:25:45.745784+0000 mgr.gibba020.yqfnwy (mgr.34427) 1763 : cluster [DBG] pgmap v994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:47.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:46 gibba013 bash[29418]: cluster 2021-03-10T14:25:45.745784+0000 mgr.gibba020.yqfnwy (mgr.34427) 1763 : cluster [DBG] pgmap v994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:47.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:46 gibba013 bash[30381]: cluster 2021-03-10T14:25:45.745784+0000 mgr.gibba020.yqfnwy (mgr.34427) 1763 : cluster [DBG] pgmap v994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:49.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:48 gibba013 bash[29418]: cluster 2021-03-10T14:25:47.747413+0000 mgr.gibba020.yqfnwy (mgr.34427) 1764 : cluster [DBG] pgmap v995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:49.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:48 gibba013 bash[30381]: cluster 2021-03-10T14:25:47.747413+0000 mgr.gibba020.yqfnwy (mgr.34427) 1764 : cluster [DBG] pgmap v995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:49.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:48 gibba020 bash[25448]: cluster 2021-03-10T14:25:47.747413+0000 mgr.gibba020.yqfnwy (mgr.34427) 1764 : cluster [DBG] pgmap v995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:51.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:50 gibba013 bash[29418]: cluster 2021-03-10T14:25:49.749201+0000 mgr.gibba020.yqfnwy (mgr.34427) 1765 : cluster [DBG] pgmap v996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:51.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:50 gibba013 bash[29418]: audit 2021-03-10T14:25:50.166688+0000 mon.a (mon.0) 1078 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:25:51.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:50 gibba013 bash[29418]: audit 2021-03-10T14:25:50.405575+0000 mon.a (mon.0) 1079 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:25:51.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:50 gibba013 bash[29418]: audit 2021-03-10T14:25:50.408592+0000 mon.a (mon.0) 1080 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:25:51.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:50 gibba013 bash[29418]: audit 2021-03-10T14:25:50.410328+0000 mon.a (mon.0) 1081 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:51.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:50 gibba013 bash[29418]: audit 2021-03-10T14:25:50.411798+0000 mon.a (mon.0) 1082 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:51.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:50 gibba013 bash[29418]: audit 2021-03-10T14:25:50.413277+0000 mon.a (mon.0) 1083 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:51.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:50 gibba013 bash[29418]: audit 2021-03-10T14:25:50.416905+0000 mon.a (mon.0) 1084 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:51.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:50 gibba013 bash[29418]: audit 2021-03-10T14:25:50.419062+0000 mon.a (mon.0) 1085 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:51.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:50 gibba013 bash[30381]: cluster 2021-03-10T14:25:49.749201+0000 mgr.gibba020.yqfnwy (mgr.34427) 1765 : cluster [DBG] pgmap v996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:51.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:50 gibba013 bash[30381]: audit 2021-03-10T14:25:50.166688+0000 mon.a (mon.0) 1078 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:25:51.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:50 gibba013 bash[30381]: audit 2021-03-10T14:25:50.405575+0000 mon.a (mon.0) 1079 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:25:51.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:50 gibba013 bash[30381]: audit 2021-03-10T14:25:50.408592+0000 mon.a (mon.0) 1080 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:25:51.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:50 gibba013 bash[30381]: audit 2021-03-10T14:25:50.410328+0000 mon.a (mon.0) 1081 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:51.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:50 gibba013 bash[30381]: audit 2021-03-10T14:25:50.411798+0000 mon.a (mon.0) 1082 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:51.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:50 gibba013 bash[30381]: audit 2021-03-10T14:25:50.413277+0000 mon.a (mon.0) 1083 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:51.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:50 gibba013 bash[30381]: audit 2021-03-10T14:25:50.416905+0000 mon.a (mon.0) 1084 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:51.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:50 gibba013 bash[30381]: audit 2021-03-10T14:25:50.419062+0000 mon.a (mon.0) 1085 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:51.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:50 gibba020 bash[25448]: cluster 2021-03-10T14:25:49.749201+0000 mgr.gibba020.yqfnwy (mgr.34427) 1765 : cluster [DBG] pgmap v996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:51.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:50 gibba020 bash[25448]: audit 2021-03-10T14:25:50.166688+0000 mon.a (mon.0) 1078 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:25:51.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:50 gibba020 bash[25448]: audit 2021-03-10T14:25:50.405575+0000 mon.a (mon.0) 1079 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:25:51.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:50 gibba020 bash[25448]: audit 2021-03-10T14:25:50.408592+0000 mon.a (mon.0) 1080 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:25:51.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:50 gibba020 bash[25448]: audit 2021-03-10T14:25:50.410328+0000 mon.a (mon.0) 1081 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:51.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:50 gibba020 bash[25448]: audit 2021-03-10T14:25:50.411798+0000 mon.a (mon.0) 1082 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:51.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:50 gibba020 bash[25448]: audit 2021-03-10T14:25:50.413277+0000 mon.a (mon.0) 1083 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:51.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:50 gibba020 bash[25448]: audit 2021-03-10T14:25:50.416905+0000 mon.a (mon.0) 1084 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:51.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:50 gibba020 bash[25448]: audit 2021-03-10T14:25:50.419062+0000 mon.a (mon.0) 1085 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:25:52.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:51 gibba013 bash[29418]: cephadm 2021-03-10T14:25:50.169572+0000 mgr.gibba020.yqfnwy (mgr.34427) 1766 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:25:52.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:51 gibba013 bash[29418]: cephadm 2021-03-10T14:25:50.171455+0000 mgr.gibba020.yqfnwy (mgr.34427) 1767 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:25:52.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:51 gibba013 bash[29418]: cephadm 2021-03-10T14:25:50.406457+0000 mgr.gibba020.yqfnwy (mgr.34427) 1768 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:25:52.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:51 gibba013 bash[29418]: cephadm 2021-03-10T14:25:50.408369+0000 mgr.gibba020.yqfnwy (mgr.34427) 1769 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:25:52.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:51 gibba013 bash[29418]: cephadm 2021-03-10T14:25:50.409687+0000 mgr.gibba020.yqfnwy (mgr.34427) 1770 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:25:52.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:51 gibba013 bash[29418]: cephadm 2021-03-10T14:25:50.409724+0000 mgr.gibba020.yqfnwy (mgr.34427) 1771 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:25:52.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:51 gibba013 bash[29418]: cephadm 2021-03-10T14:25:50.411367+0000 mgr.gibba020.yqfnwy (mgr.34427) 1772 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:25:52.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:51 gibba013 bash[29418]: cephadm 2021-03-10T14:25:50.411402+0000 mgr.gibba020.yqfnwy (mgr.34427) 1773 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:25:52.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:51 gibba013 bash[29418]: cephadm 2021-03-10T14:25:50.413403+0000 mgr.gibba020.yqfnwy (mgr.34427) 1774 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:25:52.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:51 gibba013 bash[29418]: cephadm 2021-03-10T14:25:50.414839+0000 mgr.gibba020.yqfnwy (mgr.34427) 1775 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:25:52.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:51 gibba013 bash[29418]: cephadm 2021-03-10T14:25:50.414875+0000 mgr.gibba020.yqfnwy (mgr.34427) 1776 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:25:52.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:51 gibba013 bash[29418]: cephadm 2021-03-10T14:25:50.416436+0000 mgr.gibba020.yqfnwy (mgr.34427) 1777 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:25:52.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:51 gibba013 bash[29418]: cephadm 2021-03-10T14:25:50.417085+0000 mgr.gibba020.yqfnwy (mgr.34427) 1778 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:25:52.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:51 gibba013 bash[29418]: cephadm 2021-03-10T14:25:50.419226+0000 mgr.gibba020.yqfnwy (mgr.34427) 1779 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:25:52.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:51 gibba013 bash[29418]: cephadm 2021-03-10T14:25:50.419263+0000 mgr.gibba020.yqfnwy (mgr.34427) 1780 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:25:52.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:51 gibba013 bash[29418]: cephadm 2021-03-10T14:25:50.419371+0000 mgr.gibba020.yqfnwy (mgr.34427) 1781 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:25:52.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:51 gibba013 bash[30381]: cephadm 2021-03-10T14:25:50.169572+0000 mgr.gibba020.yqfnwy (mgr.34427) 1766 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:25:52.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:51 gibba013 bash[30381]: cephadm 2021-03-10T14:25:50.171455+0000 mgr.gibba020.yqfnwy (mgr.34427) 1767 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:25:52.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:51 gibba013 bash[30381]: cephadm 2021-03-10T14:25:50.406457+0000 mgr.gibba020.yqfnwy (mgr.34427) 1768 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:25:52.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:51 gibba013 bash[30381]: cephadm 2021-03-10T14:25:50.408369+0000 mgr.gibba020.yqfnwy (mgr.34427) 1769 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:25:52.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:51 gibba013 bash[30381]: cephadm 2021-03-10T14:25:50.409687+0000 mgr.gibba020.yqfnwy (mgr.34427) 1770 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:25:52.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:51 gibba013 bash[30381]: cephadm 2021-03-10T14:25:50.409724+0000 mgr.gibba020.yqfnwy (mgr.34427) 1771 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:25:52.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:51 gibba013 bash[30381]: cephadm 2021-03-10T14:25:50.411367+0000 mgr.gibba020.yqfnwy (mgr.34427) 1772 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:25:52.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:51 gibba013 bash[30381]: cephadm 2021-03-10T14:25:50.411402+0000 mgr.gibba020.yqfnwy (mgr.34427) 1773 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:25:52.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:51 gibba013 bash[30381]: cephadm 2021-03-10T14:25:50.413403+0000 mgr.gibba020.yqfnwy (mgr.34427) 1774 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:25:52.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:51 gibba013 bash[30381]: cephadm 2021-03-10T14:25:50.414839+0000 mgr.gibba020.yqfnwy (mgr.34427) 1775 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:25:52.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:51 gibba013 bash[30381]: cephadm 2021-03-10T14:25:50.414875+0000 mgr.gibba020.yqfnwy (mgr.34427) 1776 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:25:52.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:51 gibba013 bash[30381]: cephadm 2021-03-10T14:25:50.416436+0000 mgr.gibba020.yqfnwy (mgr.34427) 1777 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:25:52.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:51 gibba013 bash[30381]: cephadm 2021-03-10T14:25:50.417085+0000 mgr.gibba020.yqfnwy (mgr.34427) 1778 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:25:52.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:51 gibba013 bash[30381]: cephadm 2021-03-10T14:25:50.419226+0000 mgr.gibba020.yqfnwy (mgr.34427) 1779 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:25:52.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:51 gibba013 bash[30381]: cephadm 2021-03-10T14:25:50.419263+0000 mgr.gibba020.yqfnwy (mgr.34427) 1780 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:25:52.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:51 gibba013 bash[30381]: cephadm 2021-03-10T14:25:50.419371+0000 mgr.gibba020.yqfnwy (mgr.34427) 1781 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:25:52.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:51 gibba020 bash[25448]: cephadm 2021-03-10T14:25:50.169572+0000 mgr.gibba020.yqfnwy (mgr.34427) 1766 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:25:52.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:51 gibba020 bash[25448]: cephadm 2021-03-10T14:25:50.171455+0000 mgr.gibba020.yqfnwy (mgr.34427) 1767 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:25:52.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:51 gibba020 bash[25448]: cephadm 2021-03-10T14:25:50.406457+0000 mgr.gibba020.yqfnwy (mgr.34427) 1768 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:25:52.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:51 gibba020 bash[25448]: cephadm 2021-03-10T14:25:50.408369+0000 mgr.gibba020.yqfnwy (mgr.34427) 1769 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:25:52.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:51 gibba020 bash[25448]: cephadm 2021-03-10T14:25:50.409687+0000 mgr.gibba020.yqfnwy (mgr.34427) 1770 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:25:52.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:51 gibba020 bash[25448]: cephadm 2021-03-10T14:25:50.409724+0000 mgr.gibba020.yqfnwy (mgr.34427) 1771 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:25:52.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:51 gibba020 bash[25448]: cephadm 2021-03-10T14:25:50.411367+0000 mgr.gibba020.yqfnwy (mgr.34427) 1772 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:25:52.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:51 gibba020 bash[25448]: cephadm 2021-03-10T14:25:50.411402+0000 mgr.gibba020.yqfnwy (mgr.34427) 1773 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:25:52.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:51 gibba020 bash[25448]: cephadm 2021-03-10T14:25:50.413403+0000 mgr.gibba020.yqfnwy (mgr.34427) 1774 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:25:52.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:51 gibba020 bash[25448]: cephadm 2021-03-10T14:25:50.414839+0000 mgr.gibba020.yqfnwy (mgr.34427) 1775 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:25:52.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:51 gibba020 bash[25448]: cephadm 2021-03-10T14:25:50.414875+0000 mgr.gibba020.yqfnwy (mgr.34427) 1776 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:25:52.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:51 gibba020 bash[25448]: cephadm 2021-03-10T14:25:50.416436+0000 mgr.gibba020.yqfnwy (mgr.34427) 1777 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:25:52.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:51 gibba020 bash[25448]: cephadm 2021-03-10T14:25:50.417085+0000 mgr.gibba020.yqfnwy (mgr.34427) 1778 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:25:52.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:51 gibba020 bash[25448]: cephadm 2021-03-10T14:25:50.419226+0000 mgr.gibba020.yqfnwy (mgr.34427) 1779 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:25:52.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:51 gibba020 bash[25448]: cephadm 2021-03-10T14:25:50.419263+0000 mgr.gibba020.yqfnwy (mgr.34427) 1780 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:25:52.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:51 gibba020 bash[25448]: cephadm 2021-03-10T14:25:50.419371+0000 mgr.gibba020.yqfnwy (mgr.34427) 1781 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:25:53.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:52 gibba013 bash[29418]: cluster 2021-03-10T14:25:51.750724+0000 mgr.gibba020.yqfnwy (mgr.34427) 1782 : cluster [DBG] pgmap v997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:53.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:52 gibba013 bash[30381]: cluster 2021-03-10T14:25:51.750724+0000 mgr.gibba020.yqfnwy (mgr.34427) 1782 : cluster [DBG] pgmap v997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:53.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:52 gibba020 bash[25448]: cluster 2021-03-10T14:25:51.750724+0000 mgr.gibba020.yqfnwy (mgr.34427) 1782 : cluster [DBG] pgmap v997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:55.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:54 gibba013 bash[29418]: cluster 2021-03-10T14:25:53.752315+0000 mgr.gibba020.yqfnwy (mgr.34427) 1783 : cluster [DBG] pgmap v998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:55.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:54 gibba013 bash[30381]: cluster 2021-03-10T14:25:53.752315+0000 mgr.gibba020.yqfnwy (mgr.34427) 1783 : cluster [DBG] pgmap v998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:55.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:54 gibba020 bash[25448]: cluster 2021-03-10T14:25:53.752315+0000 mgr.gibba020.yqfnwy (mgr.34427) 1783 : cluster [DBG] pgmap v998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:56.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:56 gibba020 bash[25448]: cluster 2021-03-10T14:25:55.754019+0000 mgr.gibba020.yqfnwy (mgr.34427) 1784 : cluster [DBG] pgmap v999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:57.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:56 gibba013 bash[29418]: cluster 2021-03-10T14:25:55.754019+0000 mgr.gibba020.yqfnwy (mgr.34427) 1784 : cluster [DBG] pgmap v999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:57.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:56 gibba013 bash[30381]: cluster 2021-03-10T14:25:55.754019+0000 mgr.gibba020.yqfnwy (mgr.34427) 1784 : cluster [DBG] pgmap v999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:59.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:25:58 gibba013 bash[29418]: cluster 2021-03-10T14:25:57.755476+0000 mgr.gibba020.yqfnwy (mgr.34427) 1785 : cluster [DBG] pgmap v1000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:59.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:25:58 gibba013 bash[30381]: cluster 2021-03-10T14:25:57.755476+0000 mgr.gibba020.yqfnwy (mgr.34427) 1785 : cluster [DBG] pgmap v1000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:25:59.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:25:58 gibba020 bash[25448]: cluster 2021-03-10T14:25:57.755476+0000 mgr.gibba020.yqfnwy (mgr.34427) 1785 : cluster [DBG] pgmap v1000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:01.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:00 gibba013 bash[29418]: cluster 2021-03-10T14:25:59.756983+0000 mgr.gibba020.yqfnwy (mgr.34427) 1786 : cluster [DBG] pgmap v1001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:01.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:00 gibba013 bash[30381]: cluster 2021-03-10T14:25:59.756983+0000 mgr.gibba020.yqfnwy (mgr.34427) 1786 : cluster [DBG] pgmap v1001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:01.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:00 gibba020 bash[25448]: cluster 2021-03-10T14:25:59.756983+0000 mgr.gibba020.yqfnwy (mgr.34427) 1786 : cluster [DBG] pgmap v1001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:03.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:02 gibba013 bash[29418]: cluster 2021-03-10T14:26:01.758754+0000 mgr.gibba020.yqfnwy (mgr.34427) 1787 : cluster [DBG] pgmap v1002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:03.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:02 gibba013 bash[30381]: cluster 2021-03-10T14:26:01.758754+0000 mgr.gibba020.yqfnwy (mgr.34427) 1787 : cluster [DBG] pgmap v1002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:03.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:02 gibba020 bash[25448]: cluster 2021-03-10T14:26:01.758754+0000 mgr.gibba020.yqfnwy (mgr.34427) 1787 : cluster [DBG] pgmap v1002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:05.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:04 gibba013 bash[29418]: cluster 2021-03-10T14:26:03.760490+0000 mgr.gibba020.yqfnwy (mgr.34427) 1788 : cluster [DBG] pgmap v1003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:05.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:04 gibba013 bash[30381]: cluster 2021-03-10T14:26:03.760490+0000 mgr.gibba020.yqfnwy (mgr.34427) 1788 : cluster [DBG] pgmap v1003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:05.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:04 gibba020 bash[25448]: cluster 2021-03-10T14:26:03.760490+0000 mgr.gibba020.yqfnwy (mgr.34427) 1788 : cluster [DBG] pgmap v1003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:06.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:06 gibba020 bash[25448]: cephadm 2021-03-10T14:26:05.420362+0000 mgr.gibba020.yqfnwy (mgr.34427) 1789 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:26:06.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:06 gibba020 bash[25448]: cluster 2021-03-10T14:26:05.761973+0000 mgr.gibba020.yqfnwy (mgr.34427) 1790 : cluster [DBG] pgmap v1004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:06.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:06 gibba020 bash[25448]: audit 2021-03-10T14:26:06.046201+0000 mon.a (mon.0) 1086 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:26:06.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:06 gibba020 bash[25448]: audit 2021-03-10T14:26:06.047007+0000 mon.a (mon.0) 1087 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:26:06.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:06 gibba020 bash[25448]: audit 2021-03-10T14:26:06.047709+0000 mon.a (mon.0) 1088 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T14:26:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:06 gibba020 bash[25448]: audit 2021-03-10T14:26:06.048402+0000 mon.a (mon.0) 1089 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:26:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:06 gibba020 bash[25448]: audit 2021-03-10T14:26:06.142308+0000 mon.a (mon.0) 1090 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:26:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:06 gibba020 bash[25448]: audit 2021-03-10T14:26:06.148788+0000 mon.a (mon.0) 1091 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:26:07.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:06 gibba013 bash[29418]: cephadm 2021-03-10T14:26:05.420362+0000 mgr.gibba020.yqfnwy (mgr.34427) 1789 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:26:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:06 gibba013 bash[29418]: cluster 2021-03-10T14:26:05.761973+0000 mgr.gibba020.yqfnwy (mgr.34427) 1790 : cluster [DBG] pgmap v1004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:06 gibba013 bash[29418]: audit 2021-03-10T14:26:06.046201+0000 mon.a (mon.0) 1086 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:26:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:06 gibba013 bash[29418]: audit 2021-03-10T14:26:06.047007+0000 mon.a (mon.0) 1087 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:26:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:06 gibba013 bash[29418]: audit 2021-03-10T14:26:06.047709+0000 mon.a (mon.0) 1088 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T14:26:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:06 gibba013 bash[29418]: audit 2021-03-10T14:26:06.048402+0000 mon.a (mon.0) 1089 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:26:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:06 gibba013 bash[29418]: audit 2021-03-10T14:26:06.142308+0000 mon.a (mon.0) 1090 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:26:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:06 gibba013 bash[29418]: audit 2021-03-10T14:26:06.148788+0000 mon.a (mon.0) 1091 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:26:07.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:06 gibba013 bash[30381]: cephadm 2021-03-10T14:26:05.420362+0000 mgr.gibba020.yqfnwy (mgr.34427) 1789 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:26:07.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:06 gibba013 bash[30381]: cluster 2021-03-10T14:26:05.761973+0000 mgr.gibba020.yqfnwy (mgr.34427) 1790 : cluster [DBG] pgmap v1004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:07.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:06 gibba013 bash[30381]: audit 2021-03-10T14:26:06.046201+0000 mon.a (mon.0) 1086 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:26:07.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:06 gibba013 bash[30381]: audit 2021-03-10T14:26:06.047007+0000 mon.a (mon.0) 1087 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:26:07.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:06 gibba013 bash[30381]: audit 2021-03-10T14:26:06.047709+0000 mon.a (mon.0) 1088 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T14:26:07.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:06 gibba013 bash[30381]: audit 2021-03-10T14:26:06.048402+0000 mon.a (mon.0) 1089 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:26:07.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:06 gibba013 bash[30381]: audit 2021-03-10T14:26:06.142308+0000 mon.a (mon.0) 1090 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:26:07.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:06 gibba013 bash[30381]: audit 2021-03-10T14:26:06.148788+0000 mon.a (mon.0) 1091 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:26:07.641 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:26:07.865 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:26:07.866 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (32m) 8m ago 38m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:26:07.866 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (37m) 7m ago 37m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:26:07.866 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (33m) 7m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:26:07.866 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (33m) 7m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:26:07.867 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (32m) 8m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:26:07.867 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (32m) 8m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:26:07.867 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (31m) 7m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:26:07.867 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (31m) 8m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:26:07.867 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (38m) 8m ago 38m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:26:07.868 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (38m) 7m ago 38m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:26:07.868 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (30m) 8m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:26:07.868 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (30m) 8m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:26:07.868 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (30m) 8m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:26:07.868 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (29m) 8m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:26:07.869 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (29m) 7m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:26:07.869 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (28m) 7m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:26:07.869 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (28m) 7m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:26:07.869 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (27m) 7m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:26:07.869 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (37m) 7m ago 38m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:26:07.870 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 7m ago 36m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:26:08.114 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:26:08.114 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:26:08.114 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:26:08.115 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:26:08.115 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:26:08.115 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:26:08.115 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:26:08.115 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:26:08.116 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:26:08.116 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:26:08.116 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:26:08.116 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:26:08.116 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:26:08.117 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:26:08.117 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:26:09.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:08 gibba013 bash[29418]: audit 2021-03-10T14:26:07.629550+0000 mgr.gibba020.yqfnwy (mgr.34427) 1791 : audit [DBG] from='client.45258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:26:09.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:08 gibba013 bash[29418]: cluster 2021-03-10T14:26:07.763449+0000 mgr.gibba020.yqfnwy (mgr.34427) 1792 : cluster [DBG] pgmap v1005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:09.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:08 gibba013 bash[29418]: audit 2021-03-10T14:26:07.853282+0000 mgr.gibba020.yqfnwy (mgr.34427) 1793 : audit [DBG] from='client.45264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:26:09.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:08 gibba013 bash[29418]: audit 2021-03-10T14:26:08.112595+0000 mon.c (mon.1) 40 : audit [DBG] from='client.? 172.21.2.113:0/824768159' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:09.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:08 gibba013 bash[30381]: audit 2021-03-10T14:26:07.629550+0000 mgr.gibba020.yqfnwy (mgr.34427) 1791 : audit [DBG] from='client.45258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:26:09.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:08 gibba013 bash[30381]: cluster 2021-03-10T14:26:07.763449+0000 mgr.gibba020.yqfnwy (mgr.34427) 1792 : cluster [DBG] pgmap v1005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:09.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:08 gibba013 bash[30381]: audit 2021-03-10T14:26:07.853282+0000 mgr.gibba020.yqfnwy (mgr.34427) 1793 : audit [DBG] from='client.45264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:26:09.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:08 gibba013 bash[30381]: audit 2021-03-10T14:26:08.112595+0000 mon.c (mon.1) 40 : audit [DBG] from='client.? 172.21.2.113:0/824768159' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:09.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:08 gibba020 bash[25448]: audit 2021-03-10T14:26:07.629550+0000 mgr.gibba020.yqfnwy (mgr.34427) 1791 : audit [DBG] from='client.45258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:26:09.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:08 gibba020 bash[25448]: cluster 2021-03-10T14:26:07.763449+0000 mgr.gibba020.yqfnwy (mgr.34427) 1792 : cluster [DBG] pgmap v1005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:09.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:08 gibba020 bash[25448]: audit 2021-03-10T14:26:07.853282+0000 mgr.gibba020.yqfnwy (mgr.34427) 1793 : audit [DBG] from='client.45264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:26:09.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:08 gibba020 bash[25448]: audit 2021-03-10T14:26:08.112595+0000 mon.c (mon.1) 40 : audit [DBG] from='client.? 172.21.2.113:0/824768159' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:11.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:10 gibba013 bash[29418]: cluster 2021-03-10T14:26:09.765007+0000 mgr.gibba020.yqfnwy (mgr.34427) 1794 : cluster [DBG] pgmap v1006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:11.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:10 gibba013 bash[30381]: cluster 2021-03-10T14:26:09.765007+0000 mgr.gibba020.yqfnwy (mgr.34427) 1794 : cluster [DBG] pgmap v1006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:11.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:10 gibba020 bash[25448]: cluster 2021-03-10T14:26:09.765007+0000 mgr.gibba020.yqfnwy (mgr.34427) 1794 : cluster [DBG] pgmap v1006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:13.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:12 gibba013 bash[29418]: cluster 2021-03-10T14:26:11.766639+0000 mgr.gibba020.yqfnwy (mgr.34427) 1795 : cluster [DBG] pgmap v1007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:13.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:12 gibba013 bash[30381]: cluster 2021-03-10T14:26:11.766639+0000 mgr.gibba020.yqfnwy (mgr.34427) 1795 : cluster [DBG] pgmap v1007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:13.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:12 gibba020 bash[25448]: cluster 2021-03-10T14:26:11.766639+0000 mgr.gibba020.yqfnwy (mgr.34427) 1795 : cluster [DBG] pgmap v1007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:15.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:14 gibba013 bash[29418]: cluster 2021-03-10T14:26:13.768104+0000 mgr.gibba020.yqfnwy (mgr.34427) 1796 : cluster [DBG] pgmap v1008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:15.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:14 gibba013 bash[30381]: cluster 2021-03-10T14:26:13.768104+0000 mgr.gibba020.yqfnwy (mgr.34427) 1796 : cluster [DBG] pgmap v1008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:15.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:14 gibba020 bash[25448]: cluster 2021-03-10T14:26:13.768104+0000 mgr.gibba020.yqfnwy (mgr.34427) 1796 : cluster [DBG] pgmap v1008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:16.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:16 gibba020 bash[25448]: cluster 2021-03-10T14:26:15.769816+0000 mgr.gibba020.yqfnwy (mgr.34427) 1797 : cluster [DBG] pgmap v1009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:17.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:16 gibba013 bash[29418]: cluster 2021-03-10T14:26:15.769816+0000 mgr.gibba020.yqfnwy (mgr.34427) 1797 : cluster [DBG] pgmap v1009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:17.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:16 gibba013 bash[30381]: cluster 2021-03-10T14:26:15.769816+0000 mgr.gibba020.yqfnwy (mgr.34427) 1797 : cluster [DBG] pgmap v1009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:19.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:18 gibba013 bash[29418]: cluster 2021-03-10T14:26:17.771261+0000 mgr.gibba020.yqfnwy (mgr.34427) 1798 : cluster [DBG] pgmap v1010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:19.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:18 gibba013 bash[30381]: cluster 2021-03-10T14:26:17.771261+0000 mgr.gibba020.yqfnwy (mgr.34427) 1798 : cluster [DBG] pgmap v1010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:19.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:18 gibba020 bash[25448]: cluster 2021-03-10T14:26:17.771261+0000 mgr.gibba020.yqfnwy (mgr.34427) 1798 : cluster [DBG] pgmap v1010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:21.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:20 gibba013 bash[29418]: cluster 2021-03-10T14:26:19.772972+0000 mgr.gibba020.yqfnwy (mgr.34427) 1799 : cluster [DBG] pgmap v1011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:21.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:20 gibba013 bash[30381]: cluster 2021-03-10T14:26:19.772972+0000 mgr.gibba020.yqfnwy (mgr.34427) 1799 : cluster [DBG] pgmap v1011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:21.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:20 gibba020 bash[25448]: cluster 2021-03-10T14:26:19.772972+0000 mgr.gibba020.yqfnwy (mgr.34427) 1799 : cluster [DBG] pgmap v1011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:22.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:21 gibba013 bash[29418]: cephadm 2021-03-10T14:26:20.429454+0000 mgr.gibba020.yqfnwy (mgr.34427) 1800 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:26:22.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:21 gibba013 bash[30381]: cephadm 2021-03-10T14:26:20.429454+0000 mgr.gibba020.yqfnwy (mgr.34427) 1800 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:26:22.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:21 gibba020 bash[25448]: cephadm 2021-03-10T14:26:20.429454+0000 mgr.gibba020.yqfnwy (mgr.34427) 1800 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:26:23.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:22 gibba013 bash[29418]: cluster 2021-03-10T14:26:21.774594+0000 mgr.gibba020.yqfnwy (mgr.34427) 1801 : cluster [DBG] pgmap v1012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:23.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:22 gibba013 bash[30381]: cluster 2021-03-10T14:26:21.774594+0000 mgr.gibba020.yqfnwy (mgr.34427) 1801 : cluster [DBG] pgmap v1012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:23.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:22 gibba020 bash[25448]: cluster 2021-03-10T14:26:21.774594+0000 mgr.gibba020.yqfnwy (mgr.34427) 1801 : cluster [DBG] pgmap v1012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:25.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:24 gibba013 bash[29418]: cluster 2021-03-10T14:26:23.776176+0000 mgr.gibba020.yqfnwy (mgr.34427) 1802 : cluster [DBG] pgmap v1013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:25.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:24 gibba013 bash[30381]: cluster 2021-03-10T14:26:23.776176+0000 mgr.gibba020.yqfnwy (mgr.34427) 1802 : cluster [DBG] pgmap v1013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:25.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:24 gibba020 bash[25448]: cluster 2021-03-10T14:26:23.776176+0000 mgr.gibba020.yqfnwy (mgr.34427) 1802 : cluster [DBG] pgmap v1013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:26.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:26 gibba020 bash[25448]: cluster 2021-03-10T14:26:25.777775+0000 mgr.gibba020.yqfnwy (mgr.34427) 1803 : cluster [DBG] pgmap v1014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:27.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:26 gibba013 bash[29418]: cluster 2021-03-10T14:26:25.777775+0000 mgr.gibba020.yqfnwy (mgr.34427) 1803 : cluster [DBG] pgmap v1014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:27.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:26 gibba013 bash[30381]: cluster 2021-03-10T14:26:25.777775+0000 mgr.gibba020.yqfnwy (mgr.34427) 1803 : cluster [DBG] pgmap v1014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:29.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:28 gibba013 bash[29418]: cluster 2021-03-10T14:26:27.779271+0000 mgr.gibba020.yqfnwy (mgr.34427) 1804 : cluster [DBG] pgmap v1015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:29.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:28 gibba013 bash[30381]: cluster 2021-03-10T14:26:27.779271+0000 mgr.gibba020.yqfnwy (mgr.34427) 1804 : cluster [DBG] pgmap v1015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:29.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:28 gibba020 bash[25448]: cluster 2021-03-10T14:26:27.779271+0000 mgr.gibba020.yqfnwy (mgr.34427) 1804 : cluster [DBG] pgmap v1015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:31.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:30 gibba013 bash[29418]: cluster 2021-03-10T14:26:29.781168+0000 mgr.gibba020.yqfnwy (mgr.34427) 1805 : cluster [DBG] pgmap v1016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:31.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:30 gibba013 bash[30381]: cluster 2021-03-10T14:26:29.781168+0000 mgr.gibba020.yqfnwy (mgr.34427) 1805 : cluster [DBG] pgmap v1016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:31.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:30 gibba020 bash[25448]: cluster 2021-03-10T14:26:29.781168+0000 mgr.gibba020.yqfnwy (mgr.34427) 1805 : cluster [DBG] pgmap v1016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:33.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:32 gibba013 bash[29418]: cluster 2021-03-10T14:26:31.782915+0000 mgr.gibba020.yqfnwy (mgr.34427) 1806 : cluster [DBG] pgmap v1017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:33.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:32 gibba013 bash[30381]: cluster 2021-03-10T14:26:31.782915+0000 mgr.gibba020.yqfnwy (mgr.34427) 1806 : cluster [DBG] pgmap v1017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:33.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:32 gibba020 bash[25448]: cluster 2021-03-10T14:26:31.782915+0000 mgr.gibba020.yqfnwy (mgr.34427) 1806 : cluster [DBG] pgmap v1017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:35.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:34 gibba013 bash[29418]: cluster 2021-03-10T14:26:33.784618+0000 mgr.gibba020.yqfnwy (mgr.34427) 1807 : cluster [DBG] pgmap v1018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:35.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:34 gibba013 bash[30381]: cluster 2021-03-10T14:26:33.784618+0000 mgr.gibba020.yqfnwy (mgr.34427) 1807 : cluster [DBG] pgmap v1018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:35.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:34 gibba020 bash[25448]: cluster 2021-03-10T14:26:33.784618+0000 mgr.gibba020.yqfnwy (mgr.34427) 1807 : cluster [DBG] pgmap v1018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:36.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:36 gibba020 bash[25448]: cephadm 2021-03-10T14:26:35.445312+0000 mgr.gibba020.yqfnwy (mgr.34427) 1808 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:26:36.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:36 gibba020 bash[25448]: cluster 2021-03-10T14:26:35.786178+0000 mgr.gibba020.yqfnwy (mgr.34427) 1809 : cluster [DBG] pgmap v1019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:37.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:36 gibba013 bash[29418]: cephadm 2021-03-10T14:26:35.445312+0000 mgr.gibba020.yqfnwy (mgr.34427) 1808 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:26:37.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:36 gibba013 bash[29418]: cluster 2021-03-10T14:26:35.786178+0000 mgr.gibba020.yqfnwy (mgr.34427) 1809 : cluster [DBG] pgmap v1019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:37.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:36 gibba013 bash[30381]: cephadm 2021-03-10T14:26:35.445312+0000 mgr.gibba020.yqfnwy (mgr.34427) 1808 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:26:37.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:36 gibba013 bash[30381]: cluster 2021-03-10T14:26:35.786178+0000 mgr.gibba020.yqfnwy (mgr.34427) 1809 : cluster [DBG] pgmap v1019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:38.356 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:26:38.582 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:26:38.582 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (33m) 8m ago 38m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:26:38.582 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (38m) 7m ago 38m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:26:38.583 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (33m) 7m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:26:38.583 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (33m) 7m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:26:38.583 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (32m) 8m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:26:38.583 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (32m) 8m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:26:38.584 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (32m) 7m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:26:38.584 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (32m) 8m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:26:38.584 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (38m) 8m ago 38m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:26:38.584 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (38m) 7m ago 38m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:26:38.584 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (31m) 8m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:26:38.585 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (30m) 8m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:26:38.585 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (30m) 8m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:26:38.585 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (30m) 8m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:26:38.585 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (29m) 7m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:26:38.585 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (29m) 7m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:26:38.586 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (28m) 7m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:26:38.586 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (28m) 7m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:26:38.586 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (38m) 7m ago 38m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:26:38.586 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 7m ago 36m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:26:38.832 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:26:38.832 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:26:38.833 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:26:38.833 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:26:38.833 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:26:38.833 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:26:38.833 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:26:38.834 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:26:38.834 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:26:38.834 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:26:38.834 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:26:38.835 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:26:38.835 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:26:38.835 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:26:38.835 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:26:39.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:38 gibba013 bash[29418]: cluster 2021-03-10T14:26:37.787653+0000 mgr.gibba020.yqfnwy (mgr.34427) 1810 : cluster [DBG] pgmap v1020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:39.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:38 gibba013 bash[29418]: audit 2021-03-10T14:26:38.831245+0000 mon.c (mon.1) 41 : audit [DBG] from='client.? 172.21.2.113:0/2463778999' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:39.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:38 gibba013 bash[30381]: cluster 2021-03-10T14:26:37.787653+0000 mgr.gibba020.yqfnwy (mgr.34427) 1810 : cluster [DBG] pgmap v1020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:39.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:38 gibba013 bash[30381]: audit 2021-03-10T14:26:38.831245+0000 mon.c (mon.1) 41 : audit [DBG] from='client.? 172.21.2.113:0/2463778999' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:39.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:38 gibba020 bash[25448]: cluster 2021-03-10T14:26:37.787653+0000 mgr.gibba020.yqfnwy (mgr.34427) 1810 : cluster [DBG] pgmap v1020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:39.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:38 gibba020 bash[25448]: audit 2021-03-10T14:26:38.831245+0000 mon.c (mon.1) 41 : audit [DBG] from='client.? 172.21.2.113:0/2463778999' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:40.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:39 gibba013 bash[29418]: audit 2021-03-10T14:26:38.344624+0000 mgr.gibba020.yqfnwy (mgr.34427) 1811 : audit [DBG] from='client.55261 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:26:40.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:39 gibba013 bash[29418]: audit 2021-03-10T14:26:38.566542+0000 mgr.gibba020.yqfnwy (mgr.34427) 1812 : audit [DBG] from='client.45282 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:26:40.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:39 gibba013 bash[30381]: audit 2021-03-10T14:26:38.344624+0000 mgr.gibba020.yqfnwy (mgr.34427) 1811 : audit [DBG] from='client.55261 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:26:40.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:39 gibba013 bash[30381]: audit 2021-03-10T14:26:38.566542+0000 mgr.gibba020.yqfnwy (mgr.34427) 1812 : audit [DBG] from='client.45282 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:26:40.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:39 gibba020 bash[25448]: audit 2021-03-10T14:26:38.344624+0000 mgr.gibba020.yqfnwy (mgr.34427) 1811 : audit [DBG] from='client.55261 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:26:40.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:39 gibba020 bash[25448]: audit 2021-03-10T14:26:38.566542+0000 mgr.gibba020.yqfnwy (mgr.34427) 1812 : audit [DBG] from='client.45282 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:26:41.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:40 gibba013 bash[29418]: cluster 2021-03-10T14:26:39.789363+0000 mgr.gibba020.yqfnwy (mgr.34427) 1813 : cluster [DBG] pgmap v1021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:41.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:40 gibba013 bash[30381]: cluster 2021-03-10T14:26:39.789363+0000 mgr.gibba020.yqfnwy (mgr.34427) 1813 : cluster [DBG] pgmap v1021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:41.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:40 gibba020 bash[25448]: cluster 2021-03-10T14:26:39.789363+0000 mgr.gibba020.yqfnwy (mgr.34427) 1813 : cluster [DBG] pgmap v1021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:43.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:42 gibba013 bash[29418]: cluster 2021-03-10T14:26:41.790954+0000 mgr.gibba020.yqfnwy (mgr.34427) 1814 : cluster [DBG] pgmap v1022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:43.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:42 gibba013 bash[30381]: cluster 2021-03-10T14:26:41.790954+0000 mgr.gibba020.yqfnwy (mgr.34427) 1814 : cluster [DBG] pgmap v1022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:43.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:42 gibba020 bash[25448]: cluster 2021-03-10T14:26:41.790954+0000 mgr.gibba020.yqfnwy (mgr.34427) 1814 : cluster [DBG] pgmap v1022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:45.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:44 gibba020 bash[25448]: cluster 2021-03-10T14:26:43.792519+0000 mgr.gibba020.yqfnwy (mgr.34427) 1815 : cluster [DBG] pgmap v1023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:45.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:44 gibba013 bash[29418]: cluster 2021-03-10T14:26:43.792519+0000 mgr.gibba020.yqfnwy (mgr.34427) 1815 : cluster [DBG] pgmap v1023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:45.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:44 gibba013 bash[30381]: cluster 2021-03-10T14:26:43.792519+0000 mgr.gibba020.yqfnwy (mgr.34427) 1815 : cluster [DBG] pgmap v1023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:46.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:46 gibba020 bash[25448]: cluster 2021-03-10T14:26:45.794362+0000 mgr.gibba020.yqfnwy (mgr.34427) 1816 : cluster [DBG] pgmap v1024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:47.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:46 gibba013 bash[29418]: cluster 2021-03-10T14:26:45.794362+0000 mgr.gibba020.yqfnwy (mgr.34427) 1816 : cluster [DBG] pgmap v1024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:47.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:46 gibba013 bash[30381]: cluster 2021-03-10T14:26:45.794362+0000 mgr.gibba020.yqfnwy (mgr.34427) 1816 : cluster [DBG] pgmap v1024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:49.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:48 gibba013 bash[29418]: cluster 2021-03-10T14:26:47.795921+0000 mgr.gibba020.yqfnwy (mgr.34427) 1817 : cluster [DBG] pgmap v1025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:49.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:48 gibba013 bash[30381]: cluster 2021-03-10T14:26:47.795921+0000 mgr.gibba020.yqfnwy (mgr.34427) 1817 : cluster [DBG] pgmap v1025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:49.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:48 gibba020 bash[25448]: cluster 2021-03-10T14:26:47.795921+0000 mgr.gibba020.yqfnwy (mgr.34427) 1817 : cluster [DBG] pgmap v1025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:50.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:50 gibba020 bash[25448]: cluster 2021-03-10T14:26:49.797747+0000 mgr.gibba020.yqfnwy (mgr.34427) 1818 : cluster [DBG] pgmap v1026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:50.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:50 gibba020 bash[25448]: audit 2021-03-10T14:26:50.458189+0000 mon.a (mon.0) 1092 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:26:50.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:50 gibba020 bash[25448]: audit 2021-03-10T14:26:50.673727+0000 mon.a (mon.0) 1093 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:26:50.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:50 gibba020 bash[25448]: audit 2021-03-10T14:26:50.676899+0000 mon.a (mon.0) 1094 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:26:50.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:50 gibba020 bash[25448]: audit 2021-03-10T14:26:50.678658+0000 mon.a (mon.0) 1095 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:50.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:50 gibba020 bash[25448]: audit 2021-03-10T14:26:50.680150+0000 mon.a (mon.0) 1096 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:50.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:50 gibba020 bash[25448]: audit 2021-03-10T14:26:50.681693+0000 mon.a (mon.0) 1097 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:50.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:50 gibba020 bash[25448]: audit 2021-03-10T14:26:50.684461+0000 mon.a (mon.0) 1098 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:50.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:50 gibba020 bash[25448]: audit 2021-03-10T14:26:50.686330+0000 mon.a (mon.0) 1099 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:51.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:50 gibba013 bash[29418]: cluster 2021-03-10T14:26:49.797747+0000 mgr.gibba020.yqfnwy (mgr.34427) 1818 : cluster [DBG] pgmap v1026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:51.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:50 gibba013 bash[29418]: audit 2021-03-10T14:26:50.458189+0000 mon.a (mon.0) 1092 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:26:51.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:50 gibba013 bash[29418]: audit 2021-03-10T14:26:50.673727+0000 mon.a (mon.0) 1093 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:26:51.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:50 gibba013 bash[29418]: audit 2021-03-10T14:26:50.676899+0000 mon.a (mon.0) 1094 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:26:51.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:50 gibba013 bash[29418]: audit 2021-03-10T14:26:50.678658+0000 mon.a (mon.0) 1095 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:51.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:50 gibba013 bash[29418]: audit 2021-03-10T14:26:50.680150+0000 mon.a (mon.0) 1096 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:51.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:50 gibba013 bash[29418]: audit 2021-03-10T14:26:50.681693+0000 mon.a (mon.0) 1097 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:51.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:50 gibba013 bash[29418]: audit 2021-03-10T14:26:50.684461+0000 mon.a (mon.0) 1098 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:51.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:50 gibba013 bash[29418]: audit 2021-03-10T14:26:50.686330+0000 mon.a (mon.0) 1099 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:51.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:50 gibba013 bash[30381]: cluster 2021-03-10T14:26:49.797747+0000 mgr.gibba020.yqfnwy (mgr.34427) 1818 : cluster [DBG] pgmap v1026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:51.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:50 gibba013 bash[30381]: audit 2021-03-10T14:26:50.458189+0000 mon.a (mon.0) 1092 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:26:51.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:50 gibba013 bash[30381]: audit 2021-03-10T14:26:50.673727+0000 mon.a (mon.0) 1093 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:26:51.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:50 gibba013 bash[30381]: audit 2021-03-10T14:26:50.676899+0000 mon.a (mon.0) 1094 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:26:51.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:50 gibba013 bash[30381]: audit 2021-03-10T14:26:50.678658+0000 mon.a (mon.0) 1095 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:51.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:50 gibba013 bash[30381]: audit 2021-03-10T14:26:50.680150+0000 mon.a (mon.0) 1096 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:51.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:50 gibba013 bash[30381]: audit 2021-03-10T14:26:50.681693+0000 mon.a (mon.0) 1097 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:51.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:50 gibba013 bash[30381]: audit 2021-03-10T14:26:50.684461+0000 mon.a (mon.0) 1098 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:51.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:50 gibba013 bash[30381]: audit 2021-03-10T14:26:50.686330+0000 mon.a (mon.0) 1099 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:26:52.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:51 gibba020 bash[25448]: cephadm 2021-03-10T14:26:50.462799+0000 mgr.gibba020.yqfnwy (mgr.34427) 1819 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:26:52.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:51 gibba020 bash[25448]: cephadm 2021-03-10T14:26:50.464433+0000 mgr.gibba020.yqfnwy (mgr.34427) 1820 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:26:52.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:51 gibba020 bash[25448]: cephadm 2021-03-10T14:26:50.674927+0000 mgr.gibba020.yqfnwy (mgr.34427) 1821 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:26:52.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:51 gibba020 bash[25448]: cephadm 2021-03-10T14:26:50.676895+0000 mgr.gibba020.yqfnwy (mgr.34427) 1822 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:26:52.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:51 gibba020 bash[25448]: cephadm 2021-03-10T14:26:50.678385+0000 mgr.gibba020.yqfnwy (mgr.34427) 1823 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:26:52.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:51 gibba020 bash[25448]: cephadm 2021-03-10T14:26:50.678422+0000 mgr.gibba020.yqfnwy (mgr.34427) 1824 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:26:52.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:51 gibba020 bash[25448]: cephadm 2021-03-10T14:26:50.679932+0000 mgr.gibba020.yqfnwy (mgr.34427) 1825 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:26:52.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:51 gibba020 bash[25448]: cephadm 2021-03-10T14:26:50.680027+0000 mgr.gibba020.yqfnwy (mgr.34427) 1826 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:26:52.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:51 gibba020 bash[25448]: cephadm 2021-03-10T14:26:50.681291+0000 mgr.gibba020.yqfnwy (mgr.34427) 1827 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:26:52.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:51 gibba020 bash[25448]: cephadm 2021-03-10T14:26:50.682630+0000 mgr.gibba020.yqfnwy (mgr.34427) 1828 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:26:52.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:51 gibba020 bash[25448]: cephadm 2021-03-10T14:26:50.682666+0000 mgr.gibba020.yqfnwy (mgr.34427) 1829 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:26:52.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:51 gibba020 bash[25448]: cephadm 2021-03-10T14:26:50.684261+0000 mgr.gibba020.yqfnwy (mgr.34427) 1830 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:26:52.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:51 gibba020 bash[25448]: cephadm 2021-03-10T14:26:50.684637+0000 mgr.gibba020.yqfnwy (mgr.34427) 1831 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:26:52.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:51 gibba020 bash[25448]: cephadm 2021-03-10T14:26:50.686209+0000 mgr.gibba020.yqfnwy (mgr.34427) 1832 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:26:52.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:51 gibba020 bash[25448]: cephadm 2021-03-10T14:26:50.686245+0000 mgr.gibba020.yqfnwy (mgr.34427) 1833 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:26:52.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:51 gibba020 bash[25448]: cephadm 2021-03-10T14:26:50.686397+0000 mgr.gibba020.yqfnwy (mgr.34427) 1834 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:26:52.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:51 gibba013 bash[29418]: cephadm 2021-03-10T14:26:50.462799+0000 mgr.gibba020.yqfnwy (mgr.34427) 1819 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:26:52.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:51 gibba013 bash[29418]: cephadm 2021-03-10T14:26:50.464433+0000 mgr.gibba020.yqfnwy (mgr.34427) 1820 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:26:52.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:51 gibba013 bash[29418]: cephadm 2021-03-10T14:26:50.674927+0000 mgr.gibba020.yqfnwy (mgr.34427) 1821 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:26:52.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:51 gibba013 bash[29418]: cephadm 2021-03-10T14:26:50.676895+0000 mgr.gibba020.yqfnwy (mgr.34427) 1822 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:26:52.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:51 gibba013 bash[29418]: cephadm 2021-03-10T14:26:50.678385+0000 mgr.gibba020.yqfnwy (mgr.34427) 1823 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:26:52.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:51 gibba013 bash[29418]: cephadm 2021-03-10T14:26:50.678422+0000 mgr.gibba020.yqfnwy (mgr.34427) 1824 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:26:52.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:51 gibba013 bash[29418]: cephadm 2021-03-10T14:26:50.679932+0000 mgr.gibba020.yqfnwy (mgr.34427) 1825 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:26:52.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:51 gibba013 bash[29418]: cephadm 2021-03-10T14:26:50.680027+0000 mgr.gibba020.yqfnwy (mgr.34427) 1826 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:26:52.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:51 gibba013 bash[29418]: cephadm 2021-03-10T14:26:50.681291+0000 mgr.gibba020.yqfnwy (mgr.34427) 1827 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:26:52.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:51 gibba013 bash[29418]: cephadm 2021-03-10T14:26:50.682630+0000 mgr.gibba020.yqfnwy (mgr.34427) 1828 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:26:52.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:51 gibba013 bash[29418]: cephadm 2021-03-10T14:26:50.682666+0000 mgr.gibba020.yqfnwy (mgr.34427) 1829 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:26:52.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:51 gibba013 bash[29418]: cephadm 2021-03-10T14:26:50.684261+0000 mgr.gibba020.yqfnwy (mgr.34427) 1830 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:26:52.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:51 gibba013 bash[29418]: cephadm 2021-03-10T14:26:50.684637+0000 mgr.gibba020.yqfnwy (mgr.34427) 1831 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:26:52.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:51 gibba013 bash[29418]: cephadm 2021-03-10T14:26:50.686209+0000 mgr.gibba020.yqfnwy (mgr.34427) 1832 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:26:52.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:51 gibba013 bash[29418]: cephadm 2021-03-10T14:26:50.686245+0000 mgr.gibba020.yqfnwy (mgr.34427) 1833 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:26:52.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:51 gibba013 bash[29418]: cephadm 2021-03-10T14:26:50.686397+0000 mgr.gibba020.yqfnwy (mgr.34427) 1834 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:26:52.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:51 gibba013 bash[30381]: cephadm 2021-03-10T14:26:50.462799+0000 mgr.gibba020.yqfnwy (mgr.34427) 1819 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:26:52.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:51 gibba013 bash[30381]: cephadm 2021-03-10T14:26:50.464433+0000 mgr.gibba020.yqfnwy (mgr.34427) 1820 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:26:52.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:51 gibba013 bash[30381]: cephadm 2021-03-10T14:26:50.674927+0000 mgr.gibba020.yqfnwy (mgr.34427) 1821 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:26:52.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:51 gibba013 bash[30381]: cephadm 2021-03-10T14:26:50.676895+0000 mgr.gibba020.yqfnwy (mgr.34427) 1822 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:26:52.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:51 gibba013 bash[30381]: cephadm 2021-03-10T14:26:50.678385+0000 mgr.gibba020.yqfnwy (mgr.34427) 1823 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:26:52.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:51 gibba013 bash[30381]: cephadm 2021-03-10T14:26:50.678422+0000 mgr.gibba020.yqfnwy (mgr.34427) 1824 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:26:52.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:51 gibba013 bash[30381]: cephadm 2021-03-10T14:26:50.679932+0000 mgr.gibba020.yqfnwy (mgr.34427) 1825 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:26:52.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:51 gibba013 bash[30381]: cephadm 2021-03-10T14:26:50.680027+0000 mgr.gibba020.yqfnwy (mgr.34427) 1826 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:26:52.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:51 gibba013 bash[30381]: cephadm 2021-03-10T14:26:50.681291+0000 mgr.gibba020.yqfnwy (mgr.34427) 1827 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:26:52.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:51 gibba013 bash[30381]: cephadm 2021-03-10T14:26:50.682630+0000 mgr.gibba020.yqfnwy (mgr.34427) 1828 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:26:52.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:51 gibba013 bash[30381]: cephadm 2021-03-10T14:26:50.682666+0000 mgr.gibba020.yqfnwy (mgr.34427) 1829 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:26:52.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:51 gibba013 bash[30381]: cephadm 2021-03-10T14:26:50.684261+0000 mgr.gibba020.yqfnwy (mgr.34427) 1830 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:26:52.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:51 gibba013 bash[30381]: cephadm 2021-03-10T14:26:50.684637+0000 mgr.gibba020.yqfnwy (mgr.34427) 1831 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:26:52.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:51 gibba013 bash[30381]: cephadm 2021-03-10T14:26:50.686209+0000 mgr.gibba020.yqfnwy (mgr.34427) 1832 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:26:52.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:51 gibba013 bash[30381]: cephadm 2021-03-10T14:26:50.686245+0000 mgr.gibba020.yqfnwy (mgr.34427) 1833 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:26:52.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:51 gibba013 bash[30381]: cephadm 2021-03-10T14:26:50.686397+0000 mgr.gibba020.yqfnwy (mgr.34427) 1834 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:26:53.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:52 gibba020 bash[25448]: cluster 2021-03-10T14:26:51.799382+0000 mgr.gibba020.yqfnwy (mgr.34427) 1835 : cluster [DBG] pgmap v1027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:53.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:52 gibba013 bash[29418]: cluster 2021-03-10T14:26:51.799382+0000 mgr.gibba020.yqfnwy (mgr.34427) 1835 : cluster [DBG] pgmap v1027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:53.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:52 gibba013 bash[30381]: cluster 2021-03-10T14:26:51.799382+0000 mgr.gibba020.yqfnwy (mgr.34427) 1835 : cluster [DBG] pgmap v1027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:55.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:54 gibba020 bash[25448]: cluster 2021-03-10T14:26:53.799888+0000 mgr.gibba020.yqfnwy (mgr.34427) 1836 : cluster [DBG] pgmap v1028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:55.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:54 gibba013 bash[29418]: cluster 2021-03-10T14:26:53.799888+0000 mgr.gibba020.yqfnwy (mgr.34427) 1836 : cluster [DBG] pgmap v1028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:55.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:54 gibba013 bash[30381]: cluster 2021-03-10T14:26:53.799888+0000 mgr.gibba020.yqfnwy (mgr.34427) 1836 : cluster [DBG] pgmap v1028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:56.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:56 gibba020 bash[25448]: cluster 2021-03-10T14:26:55.801213+0000 mgr.gibba020.yqfnwy (mgr.34427) 1837 : cluster [DBG] pgmap v1029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:57.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:56 gibba013 bash[29418]: cluster 2021-03-10T14:26:55.801213+0000 mgr.gibba020.yqfnwy (mgr.34427) 1837 : cluster [DBG] pgmap v1029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:57.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:56 gibba013 bash[30381]: cluster 2021-03-10T14:26:55.801213+0000 mgr.gibba020.yqfnwy (mgr.34427) 1837 : cluster [DBG] pgmap v1029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:59.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:26:58 gibba013 bash[29418]: cluster 2021-03-10T14:26:57.802725+0000 mgr.gibba020.yqfnwy (mgr.34427) 1838 : cluster [DBG] pgmap v1030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:59.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:26:58 gibba013 bash[30381]: cluster 2021-03-10T14:26:57.802725+0000 mgr.gibba020.yqfnwy (mgr.34427) 1838 : cluster [DBG] pgmap v1030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:26:59.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:26:58 gibba020 bash[25448]: cluster 2021-03-10T14:26:57.802725+0000 mgr.gibba020.yqfnwy (mgr.34427) 1838 : cluster [DBG] pgmap v1030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:01.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:00 gibba013 bash[29418]: cluster 2021-03-10T14:26:59.804389+0000 mgr.gibba020.yqfnwy (mgr.34427) 1839 : cluster [DBG] pgmap v1031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:01.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:00 gibba013 bash[30381]: cluster 2021-03-10T14:26:59.804389+0000 mgr.gibba020.yqfnwy (mgr.34427) 1839 : cluster [DBG] pgmap v1031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:01.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:00 gibba020 bash[25448]: cluster 2021-03-10T14:26:59.804389+0000 mgr.gibba020.yqfnwy (mgr.34427) 1839 : cluster [DBG] pgmap v1031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:03.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:02 gibba020 bash[25448]: cluster 2021-03-10T14:27:01.804887+0000 mgr.gibba020.yqfnwy (mgr.34427) 1840 : cluster [DBG] pgmap v1032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:03.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:02 gibba013 bash[29418]: cluster 2021-03-10T14:27:01.804887+0000 mgr.gibba020.yqfnwy (mgr.34427) 1840 : cluster [DBG] pgmap v1032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:03.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:02 gibba013 bash[30381]: cluster 2021-03-10T14:27:01.804887+0000 mgr.gibba020.yqfnwy (mgr.34427) 1840 : cluster [DBG] pgmap v1032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:05.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:04 gibba020 bash[25448]: cluster 2021-03-10T14:27:03.806195+0000 mgr.gibba020.yqfnwy (mgr.34427) 1841 : cluster [DBG] pgmap v1033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:05.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:04 gibba013 bash[29418]: cluster 2021-03-10T14:27:03.806195+0000 mgr.gibba020.yqfnwy (mgr.34427) 1841 : cluster [DBG] pgmap v1033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:05.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:04 gibba013 bash[30381]: cluster 2021-03-10T14:27:03.806195+0000 mgr.gibba020.yqfnwy (mgr.34427) 1841 : cluster [DBG] pgmap v1033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:06.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:06 gibba020 bash[25448]: cephadm 2021-03-10T14:27:05.701839+0000 mgr.gibba020.yqfnwy (mgr.34427) 1842 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:27:06.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:06 gibba020 bash[25448]: cluster 2021-03-10T14:27:05.807643+0000 mgr.gibba020.yqfnwy (mgr.34427) 1843 : cluster [DBG] pgmap v1034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:06.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:06 gibba020 bash[25448]: audit 2021-03-10T14:27:06.057054+0000 mon.a (mon.0) 1100 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:27:06.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:06 gibba020 bash[25448]: audit 2021-03-10T14:27:06.057915+0000 mon.a (mon.0) 1101 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:27:06.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:06 gibba020 bash[25448]: audit 2021-03-10T14:27:06.058760+0000 mon.a (mon.0) 1102 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:27:06.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:06 gibba020 bash[25448]: audit 2021-03-10T14:27:06.059597+0000 mon.a (mon.0) 1103 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:27:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:06 gibba020 bash[25448]: audit 2021-03-10T14:27:06.149113+0000 mon.a (mon.0) 1104 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:27:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:06 gibba020 bash[25448]: audit 2021-03-10T14:27:06.155201+0000 mon.a (mon.0) 1105 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:27:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:06 gibba013 bash[29418]: cephadm 2021-03-10T14:27:05.701839+0000 mgr.gibba020.yqfnwy (mgr.34427) 1842 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:27:07.297 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:06 gibba013 bash[29418]: cluster 2021-03-10T14:27:05.807643+0000 mgr.gibba020.yqfnwy (mgr.34427) 1843 : cluster [DBG] pgmap v1034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:07.298 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:06 gibba013 bash[29418]: audit 2021-03-10T14:27:06.057054+0000 mon.a (mon.0) 1100 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:27:07.298 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:06 gibba013 bash[29418]: audit 2021-03-10T14:27:06.057915+0000 mon.a (mon.0) 1101 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:27:07.299 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:06 gibba013 bash[29418]: audit 2021-03-10T14:27:06.058760+0000 mon.a (mon.0) 1102 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:27:07.299 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:06 gibba013 bash[29418]: audit 2021-03-10T14:27:06.059597+0000 mon.a (mon.0) 1103 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:27:07.299 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:06 gibba013 bash[29418]: audit 2021-03-10T14:27:06.149113+0000 mon.a (mon.0) 1104 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:27:07.299 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:06 gibba013 bash[29418]: audit 2021-03-10T14:27:06.155201+0000 mon.a (mon.0) 1105 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:27:07.300 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:06 gibba013 bash[30381]: cephadm 2021-03-10T14:27:05.701839+0000 mgr.gibba020.yqfnwy (mgr.34427) 1842 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:27:07.300 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:06 gibba013 bash[30381]: cluster 2021-03-10T14:27:05.807643+0000 mgr.gibba020.yqfnwy (mgr.34427) 1843 : cluster [DBG] pgmap v1034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:07.300 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:06 gibba013 bash[30381]: audit 2021-03-10T14:27:06.057054+0000 mon.a (mon.0) 1100 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T14:27:07.301 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:06 gibba013 bash[30381]: audit 2021-03-10T14:27:06.057915+0000 mon.a (mon.0) 1101 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:27:07.301 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:06 gibba013 bash[30381]: audit 2021-03-10T14:27:06.058760+0000 mon.a (mon.0) 1102 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:27:07.301 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:06 gibba013 bash[30381]: audit 2021-03-10T14:27:06.059597+0000 mon.a (mon.0) 1103 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:27:07.301 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:06 gibba013 bash[30381]: audit 2021-03-10T14:27:06.149113+0000 mon.a (mon.0) 1104 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:27:07.302 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:06 gibba013 bash[30381]: audit 2021-03-10T14:27:06.155201+0000 mon.a (mon.0) 1105 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:27:09.079 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:27:09.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:08 gibba013 bash[29418]: cluster 2021-03-10T14:27:07.809115+0000 mgr.gibba020.yqfnwy (mgr.34427) 1844 : cluster [DBG] pgmap v1035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:09.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:08 gibba013 bash[30381]: cluster 2021-03-10T14:27:07.809115+0000 mgr.gibba020.yqfnwy (mgr.34427) 1844 : cluster [DBG] pgmap v1035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:09.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:08 gibba020 bash[25448]: cluster 2021-03-10T14:27:07.809115+0000 mgr.gibba020.yqfnwy (mgr.34427) 1844 : cluster [DBG] pgmap v1035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:09.307 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:27:09.308 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (33m) 9m ago 39m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:27:09.308 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (38m) 8m ago 38m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:27:09.308 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (34m) 8m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:27:09.308 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (34m) 8m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:27:09.309 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (33m) 9m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:27:09.309 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (33m) 9m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:27:09.309 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (32m) 8m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:27:09.309 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (32m) 9m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:27:09.310 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (39m) 9m ago 39m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:27:09.310 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (39m) 8m ago 39m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:27:09.310 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (31m) 9m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:27:09.310 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (31m) 9m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:27:09.310 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (31m) 9m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:27:09.311 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (30m) 9m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:27:09.311 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (30m) 8m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:27:09.311 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (29m) 8m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:27:09.311 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (29m) 8m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:27:09.311 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (28m) 8m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:27:09.312 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (38m) 8m ago 39m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:27:09.312 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 8m ago 37m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:27:09.555 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:27:09.555 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:27:09.555 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:27:09.556 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:27:09.556 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:27:09.556 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:27:09.556 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:27:09.556 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:27:09.557 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:27:09.557 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:27:09.557 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:27:09.557 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:27:09.558 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:27:09.558 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:27:09.558 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:27:10.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:09 gibba013 bash[29418]: audit 2021-03-10T14:27:09.553888+0000 mon.c (mon.1) 42 : audit [DBG] from='client.? 172.21.2.113:0/3548018389' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:10.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:09 gibba013 bash[30381]: audit 2021-03-10T14:27:09.553888+0000 mon.c (mon.1) 42 : audit [DBG] from='client.? 172.21.2.113:0/3548018389' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:10.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:09 gibba020 bash[25448]: audit 2021-03-10T14:27:09.553888+0000 mon.c (mon.1) 42 : audit [DBG] from='client.? 172.21.2.113:0/3548018389' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:11.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:10 gibba020 bash[25448]: audit 2021-03-10T14:27:09.067167+0000 mgr.gibba020.yqfnwy (mgr.34427) 1845 : audit [DBG] from='client.55279 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:27:11.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:10 gibba020 bash[25448]: audit 2021-03-10T14:27:09.293039+0000 mgr.gibba020.yqfnwy (mgr.34427) 1846 : audit [DBG] from='client.45300 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:27:11.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:10 gibba020 bash[25448]: cluster 2021-03-10T14:27:09.809677+0000 mgr.gibba020.yqfnwy (mgr.34427) 1847 : cluster [DBG] pgmap v1036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:11.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:10 gibba013 bash[29418]: audit 2021-03-10T14:27:09.067167+0000 mgr.gibba020.yqfnwy (mgr.34427) 1845 : audit [DBG] from='client.55279 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:27:11.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:10 gibba013 bash[29418]: audit 2021-03-10T14:27:09.293039+0000 mgr.gibba020.yqfnwy (mgr.34427) 1846 : audit [DBG] from='client.45300 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:27:11.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:10 gibba013 bash[29418]: cluster 2021-03-10T14:27:09.809677+0000 mgr.gibba020.yqfnwy (mgr.34427) 1847 : cluster [DBG] pgmap v1036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:11.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:10 gibba013 bash[30381]: audit 2021-03-10T14:27:09.067167+0000 mgr.gibba020.yqfnwy (mgr.34427) 1845 : audit [DBG] from='client.55279 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:27:11.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:10 gibba013 bash[30381]: audit 2021-03-10T14:27:09.293039+0000 mgr.gibba020.yqfnwy (mgr.34427) 1846 : audit [DBG] from='client.45300 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:27:11.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:10 gibba013 bash[30381]: cluster 2021-03-10T14:27:09.809677+0000 mgr.gibba020.yqfnwy (mgr.34427) 1847 : cluster [DBG] pgmap v1036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:13.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:12 gibba020 bash[25448]: cluster 2021-03-10T14:27:11.811222+0000 mgr.gibba020.yqfnwy (mgr.34427) 1848 : cluster [DBG] pgmap v1037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:13.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:12 gibba013 bash[29418]: cluster 2021-03-10T14:27:11.811222+0000 mgr.gibba020.yqfnwy (mgr.34427) 1848 : cluster [DBG] pgmap v1037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:13.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:12 gibba013 bash[30381]: cluster 2021-03-10T14:27:11.811222+0000 mgr.gibba020.yqfnwy (mgr.34427) 1848 : cluster [DBG] pgmap v1037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:15.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:14 gibba020 bash[25448]: cluster 2021-03-10T14:27:13.812766+0000 mgr.gibba020.yqfnwy (mgr.34427) 1849 : cluster [DBG] pgmap v1038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:15.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:14 gibba013 bash[29418]: cluster 2021-03-10T14:27:13.812766+0000 mgr.gibba020.yqfnwy (mgr.34427) 1849 : cluster [DBG] pgmap v1038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:15.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:14 gibba013 bash[30381]: cluster 2021-03-10T14:27:13.812766+0000 mgr.gibba020.yqfnwy (mgr.34427) 1849 : cluster [DBG] pgmap v1038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:16.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:16 gibba020 bash[25448]: cluster 2021-03-10T14:27:15.814355+0000 mgr.gibba020.yqfnwy (mgr.34427) 1850 : cluster [DBG] pgmap v1039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:17.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:16 gibba013 bash[29418]: cluster 2021-03-10T14:27:15.814355+0000 mgr.gibba020.yqfnwy (mgr.34427) 1850 : cluster [DBG] pgmap v1039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:17.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:16 gibba013 bash[30381]: cluster 2021-03-10T14:27:15.814355+0000 mgr.gibba020.yqfnwy (mgr.34427) 1850 : cluster [DBG] pgmap v1039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:19.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:18 gibba013 bash[29418]: cluster 2021-03-10T14:27:17.815125+0000 mgr.gibba020.yqfnwy (mgr.34427) 1851 : cluster [DBG] pgmap v1040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:19.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:18 gibba013 bash[30381]: cluster 2021-03-10T14:27:17.815125+0000 mgr.gibba020.yqfnwy (mgr.34427) 1851 : cluster [DBG] pgmap v1040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:19.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:18 gibba020 bash[25448]: cluster 2021-03-10T14:27:17.815125+0000 mgr.gibba020.yqfnwy (mgr.34427) 1851 : cluster [DBG] pgmap v1040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:21.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:20 gibba020 bash[25448]: cluster 2021-03-10T14:27:19.816864+0000 mgr.gibba020.yqfnwy (mgr.34427) 1852 : cluster [DBG] pgmap v1041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:21.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:20 gibba013 bash[29418]: cluster 2021-03-10T14:27:19.816864+0000 mgr.gibba020.yqfnwy (mgr.34427) 1852 : cluster [DBG] pgmap v1041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:21.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:20 gibba013 bash[30381]: cluster 2021-03-10T14:27:19.816864+0000 mgr.gibba020.yqfnwy (mgr.34427) 1852 : cluster [DBG] pgmap v1041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:22.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:21 gibba020 bash[25448]: cephadm 2021-03-10T14:27:20.717299+0000 mgr.gibba020.yqfnwy (mgr.34427) 1853 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:27:22.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:21 gibba013 bash[29418]: cephadm 2021-03-10T14:27:20.717299+0000 mgr.gibba020.yqfnwy (mgr.34427) 1853 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:27:22.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:21 gibba013 bash[30381]: cephadm 2021-03-10T14:27:20.717299+0000 mgr.gibba020.yqfnwy (mgr.34427) 1853 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:27:23.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:22 gibba020 bash[25448]: cluster 2021-03-10T14:27:21.818549+0000 mgr.gibba020.yqfnwy (mgr.34427) 1854 : cluster [DBG] pgmap v1042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:23.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:22 gibba013 bash[29418]: cluster 2021-03-10T14:27:21.818549+0000 mgr.gibba020.yqfnwy (mgr.34427) 1854 : cluster [DBG] pgmap v1042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:23.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:22 gibba013 bash[30381]: cluster 2021-03-10T14:27:21.818549+0000 mgr.gibba020.yqfnwy (mgr.34427) 1854 : cluster [DBG] pgmap v1042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:25.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:24 gibba020 bash[25448]: cluster 2021-03-10T14:27:23.820214+0000 mgr.gibba020.yqfnwy (mgr.34427) 1855 : cluster [DBG] pgmap v1043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:25.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:24 gibba013 bash[29418]: cluster 2021-03-10T14:27:23.820214+0000 mgr.gibba020.yqfnwy (mgr.34427) 1855 : cluster [DBG] pgmap v1043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:25.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:24 gibba013 bash[30381]: cluster 2021-03-10T14:27:23.820214+0000 mgr.gibba020.yqfnwy (mgr.34427) 1855 : cluster [DBG] pgmap v1043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:26.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:26 gibba020 bash[25448]: cluster 2021-03-10T14:27:25.820838+0000 mgr.gibba020.yqfnwy (mgr.34427) 1856 : cluster [DBG] pgmap v1044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:27.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:26 gibba013 bash[29418]: cluster 2021-03-10T14:27:25.820838+0000 mgr.gibba020.yqfnwy (mgr.34427) 1856 : cluster [DBG] pgmap v1044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:27.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:26 gibba013 bash[30381]: cluster 2021-03-10T14:27:25.820838+0000 mgr.gibba020.yqfnwy (mgr.34427) 1856 : cluster [DBG] pgmap v1044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:29.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:28 gibba020 bash[25448]: cluster 2021-03-10T14:27:27.822141+0000 mgr.gibba020.yqfnwy (mgr.34427) 1857 : cluster [DBG] pgmap v1045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:29.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:28 gibba013 bash[29418]: cluster 2021-03-10T14:27:27.822141+0000 mgr.gibba020.yqfnwy (mgr.34427) 1857 : cluster [DBG] pgmap v1045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:29.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:28 gibba013 bash[30381]: cluster 2021-03-10T14:27:27.822141+0000 mgr.gibba020.yqfnwy (mgr.34427) 1857 : cluster [DBG] pgmap v1045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:31.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:30 gibba020 bash[25448]: cluster 2021-03-10T14:27:29.824037+0000 mgr.gibba020.yqfnwy (mgr.34427) 1858 : cluster [DBG] pgmap v1046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:31.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:30 gibba013 bash[29418]: cluster 2021-03-10T14:27:29.824037+0000 mgr.gibba020.yqfnwy (mgr.34427) 1858 : cluster [DBG] pgmap v1046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:31.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:30 gibba013 bash[30381]: cluster 2021-03-10T14:27:29.824037+0000 mgr.gibba020.yqfnwy (mgr.34427) 1858 : cluster [DBG] pgmap v1046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:33.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:32 gibba020 bash[25448]: cluster 2021-03-10T14:27:31.825699+0000 mgr.gibba020.yqfnwy (mgr.34427) 1859 : cluster [DBG] pgmap v1047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:33.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:32 gibba013 bash[29418]: cluster 2021-03-10T14:27:31.825699+0000 mgr.gibba020.yqfnwy (mgr.34427) 1859 : cluster [DBG] pgmap v1047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:33.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:32 gibba013 bash[30381]: cluster 2021-03-10T14:27:31.825699+0000 mgr.gibba020.yqfnwy (mgr.34427) 1859 : cluster [DBG] pgmap v1047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:35.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:34 gibba020 bash[25448]: cluster 2021-03-10T14:27:33.826524+0000 mgr.gibba020.yqfnwy (mgr.34427) 1860 : cluster [DBG] pgmap v1048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:35.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:34 gibba013 bash[29418]: cluster 2021-03-10T14:27:33.826524+0000 mgr.gibba020.yqfnwy (mgr.34427) 1860 : cluster [DBG] pgmap v1048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:35.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:34 gibba013 bash[30381]: cluster 2021-03-10T14:27:33.826524+0000 mgr.gibba020.yqfnwy (mgr.34427) 1860 : cluster [DBG] pgmap v1048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:36.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:36 gibba020 bash[25448]: cephadm 2021-03-10T14:27:35.732988+0000 mgr.gibba020.yqfnwy (mgr.34427) 1861 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:27:37.093 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:36 gibba020 bash[25448]: cluster 2021-03-10T14:27:35.828139+0000 mgr.gibba020.yqfnwy (mgr.34427) 1862 : cluster [DBG] pgmap v1049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:37.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:36 gibba013 bash[29418]: cephadm 2021-03-10T14:27:35.732988+0000 mgr.gibba020.yqfnwy (mgr.34427) 1861 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:27:37.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:36 gibba013 bash[29418]: cluster 2021-03-10T14:27:35.828139+0000 mgr.gibba020.yqfnwy (mgr.34427) 1862 : cluster [DBG] pgmap v1049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:37.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:36 gibba013 bash[30381]: cephadm 2021-03-10T14:27:35.732988+0000 mgr.gibba020.yqfnwy (mgr.34427) 1861 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:27:37.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:36 gibba013 bash[30381]: cluster 2021-03-10T14:27:35.828139+0000 mgr.gibba020.yqfnwy (mgr.34427) 1862 : cluster [DBG] pgmap v1049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:39.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:38 gibba020 bash[25448]: cluster 2021-03-10T14:27:37.829612+0000 mgr.gibba020.yqfnwy (mgr.34427) 1863 : cluster [DBG] pgmap v1050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:39.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:38 gibba013 bash[29418]: cluster 2021-03-10T14:27:37.829612+0000 mgr.gibba020.yqfnwy (mgr.34427) 1863 : cluster [DBG] pgmap v1050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:39.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:38 gibba013 bash[30381]: cluster 2021-03-10T14:27:37.829612+0000 mgr.gibba020.yqfnwy (mgr.34427) 1863 : cluster [DBG] pgmap v1050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:39.796 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:27:40.023 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:27:40.023 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (34m) 10m ago 39m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:27:40.023 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (39m) 8m ago 39m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:27:40.024 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (34m) 8m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:27:40.024 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (34m) 8m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:27:40.024 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (33m) 10m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:27:40.024 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (33m) 10m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:27:40.025 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (33m) 8m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:27:40.025 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (33m) 10m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:27:40.025 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (39m) 10m ago 39m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:27:40.025 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (39m) 8m ago 39m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:27:40.026 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (32m) 10m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:27:40.026 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (32m) 10m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:27:40.027 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (31m) 10m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:27:40.027 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (31m) 10m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:27:40.028 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (30m) 8m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:27:40.028 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (30m) 8m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:27:40.029 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (29m) 8m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:27:40.029 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (29m) 8m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:27:40.030 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (39m) 8m ago 39m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:27:40.031 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 8m ago 37m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:27:40.272 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:27:40.274 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:27:40.275 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:27:40.276 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:27:40.277 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:27:40.277 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:27:40.279 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:27:40.279 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:27:40.280 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:27:40.280 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:27:40.280 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:27:40.281 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:27:40.281 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:27:40.282 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:27:40.282 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:27:41.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:40 gibba020 bash[25448]: audit 2021-03-10T14:27:39.784878+0000 mgr.gibba020.yqfnwy (mgr.34427) 1864 : audit [DBG] from='client.55297 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:27:41.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:40 gibba020 bash[25448]: cluster 2021-03-10T14:27:39.831220+0000 mgr.gibba020.yqfnwy (mgr.34427) 1865 : cluster [DBG] pgmap v1051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:41.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:40 gibba020 bash[25448]: audit 2021-03-10T14:27:40.269311+0000 mon.a (mon.0) 1106 : audit [DBG] from='client.? 172.21.2.113:0/2598287457' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:41.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:40 gibba013 bash[29418]: audit 2021-03-10T14:27:39.784878+0000 mgr.gibba020.yqfnwy (mgr.34427) 1864 : audit [DBG] from='client.55297 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:27:41.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:40 gibba013 bash[29418]: cluster 2021-03-10T14:27:39.831220+0000 mgr.gibba020.yqfnwy (mgr.34427) 1865 : cluster [DBG] pgmap v1051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:41.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:40 gibba013 bash[29418]: audit 2021-03-10T14:27:40.269311+0000 mon.a (mon.0) 1106 : audit [DBG] from='client.? 172.21.2.113:0/2598287457' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:41.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:40 gibba013 bash[30381]: audit 2021-03-10T14:27:39.784878+0000 mgr.gibba020.yqfnwy (mgr.34427) 1864 : audit [DBG] from='client.55297 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:27:41.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:40 gibba013 bash[30381]: cluster 2021-03-10T14:27:39.831220+0000 mgr.gibba020.yqfnwy (mgr.34427) 1865 : cluster [DBG] pgmap v1051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:41.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:40 gibba013 bash[30381]: audit 2021-03-10T14:27:40.269311+0000 mon.a (mon.0) 1106 : audit [DBG] from='client.? 172.21.2.113:0/2598287457' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:42.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:41 gibba020 bash[25448]: audit 2021-03-10T14:27:40.007591+0000 mgr.gibba020.yqfnwy (mgr.34427) 1866 : audit [DBG] from='client.45318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:27:42.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:41 gibba013 bash[29418]: audit 2021-03-10T14:27:40.007591+0000 mgr.gibba020.yqfnwy (mgr.34427) 1866 : audit [DBG] from='client.45318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:27:42.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:41 gibba013 bash[30381]: audit 2021-03-10T14:27:40.007591+0000 mgr.gibba020.yqfnwy (mgr.34427) 1866 : audit [DBG] from='client.45318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:27:43.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:42 gibba020 bash[25448]: cluster 2021-03-10T14:27:41.832142+0000 mgr.gibba020.yqfnwy (mgr.34427) 1867 : cluster [DBG] pgmap v1052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:43.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:42 gibba013 bash[29418]: cluster 2021-03-10T14:27:41.832142+0000 mgr.gibba020.yqfnwy (mgr.34427) 1867 : cluster [DBG] pgmap v1052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:43.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:42 gibba013 bash[30381]: cluster 2021-03-10T14:27:41.832142+0000 mgr.gibba020.yqfnwy (mgr.34427) 1867 : cluster [DBG] pgmap v1052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:44.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:43 gibba020 bash[25448]: cluster 2021-03-10T14:27:43.833673+0000 mgr.gibba020.yqfnwy (mgr.34427) 1868 : cluster [DBG] pgmap v1053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:44.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:43 gibba013 bash[29418]: cluster 2021-03-10T14:27:43.833673+0000 mgr.gibba020.yqfnwy (mgr.34427) 1868 : cluster [DBG] pgmap v1053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:44.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:43 gibba013 bash[30381]: cluster 2021-03-10T14:27:43.833673+0000 mgr.gibba020.yqfnwy (mgr.34427) 1868 : cluster [DBG] pgmap v1053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:47.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:46 gibba013 bash[29418]: cluster 2021-03-10T14:27:45.835107+0000 mgr.gibba020.yqfnwy (mgr.34427) 1869 : cluster [DBG] pgmap v1054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:47.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:46 gibba013 bash[30381]: cluster 2021-03-10T14:27:45.835107+0000 mgr.gibba020.yqfnwy (mgr.34427) 1869 : cluster [DBG] pgmap v1054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:47.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:46 gibba020 bash[25448]: cluster 2021-03-10T14:27:45.835107+0000 mgr.gibba020.yqfnwy (mgr.34427) 1869 : cluster [DBG] pgmap v1054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:49.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:48 gibba020 bash[25448]: cluster 2021-03-10T14:27:47.836551+0000 mgr.gibba020.yqfnwy (mgr.34427) 1870 : cluster [DBG] pgmap v1055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:49.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:48 gibba013 bash[29418]: cluster 2021-03-10T14:27:47.836551+0000 mgr.gibba020.yqfnwy (mgr.34427) 1870 : cluster [DBG] pgmap v1055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:49.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:48 gibba013 bash[30381]: cluster 2021-03-10T14:27:47.836551+0000 mgr.gibba020.yqfnwy (mgr.34427) 1870 : cluster [DBG] pgmap v1055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:51.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:50 gibba020 bash[25448]: cluster 2021-03-10T14:27:49.837441+0000 mgr.gibba020.yqfnwy (mgr.34427) 1871 : cluster [DBG] pgmap v1056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:51.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:50 gibba020 bash[25448]: audit 2021-03-10T14:27:50.750647+0000 mon.a (mon.0) 1107 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:27:51.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:50 gibba020 bash[25448]: audit 2021-03-10T14:27:50.756370+0000 mon.a (mon.0) 1108 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:27:51.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:50 gibba013 bash[29418]: cluster 2021-03-10T14:27:49.837441+0000 mgr.gibba020.yqfnwy (mgr.34427) 1871 : cluster [DBG] pgmap v1056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:51.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:50 gibba013 bash[29418]: audit 2021-03-10T14:27:50.750647+0000 mon.a (mon.0) 1107 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:27:51.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:50 gibba013 bash[29418]: audit 2021-03-10T14:27:50.756370+0000 mon.a (mon.0) 1108 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:27:51.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:50 gibba013 bash[30381]: cluster 2021-03-10T14:27:49.837441+0000 mgr.gibba020.yqfnwy (mgr.34427) 1871 : cluster [DBG] pgmap v1056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:51.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:50 gibba013 bash[30381]: audit 2021-03-10T14:27:50.750647+0000 mon.a (mon.0) 1107 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:27:51.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:50 gibba013 bash[30381]: audit 2021-03-10T14:27:50.756370+0000 mon.a (mon.0) 1108 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:27:52.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:51 gibba020 bash[25448]: cephadm 2021-03-10T14:27:50.754751+0000 mgr.gibba020.yqfnwy (mgr.34427) 1872 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:27:52.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:51 gibba013 bash[29418]: cephadm 2021-03-10T14:27:50.754751+0000 mgr.gibba020.yqfnwy (mgr.34427) 1872 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:27:52.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:51 gibba013 bash[30381]: cephadm 2021-03-10T14:27:50.754751+0000 mgr.gibba020.yqfnwy (mgr.34427) 1872 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:27:53.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:52 gibba020 bash[25448]: cluster 2021-03-10T14:27:51.838980+0000 mgr.gibba020.yqfnwy (mgr.34427) 1873 : cluster [DBG] pgmap v1057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:53.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:52 gibba013 bash[29418]: cluster 2021-03-10T14:27:51.838980+0000 mgr.gibba020.yqfnwy (mgr.34427) 1873 : cluster [DBG] pgmap v1057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:53.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:52 gibba013 bash[30381]: cluster 2021-03-10T14:27:51.838980+0000 mgr.gibba020.yqfnwy (mgr.34427) 1873 : cluster [DBG] pgmap v1057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:54.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:53 gibba020 bash[25448]: cluster 2021-03-10T14:27:53.840739+0000 mgr.gibba020.yqfnwy (mgr.34427) 1874 : cluster [DBG] pgmap v1058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:54.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:53 gibba013 bash[29418]: cluster 2021-03-10T14:27:53.840739+0000 mgr.gibba020.yqfnwy (mgr.34427) 1874 : cluster [DBG] pgmap v1058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:54.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:53 gibba013 bash[30381]: cluster 2021-03-10T14:27:53.840739+0000 mgr.gibba020.yqfnwy (mgr.34427) 1874 : cluster [DBG] pgmap v1058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:55.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[29418]: cephadm 2021-03-10T14:27:54.284456+0000 mgr.gibba020.yqfnwy (mgr.34427) 1875 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:27:55.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[29418]: audit 2021-03-10T14:27:54.285073+0000 mon.a (mon.0) 1109 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:27:55.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[29418]: audit 2021-03-10T14:27:54.498521+0000 mon.a (mon.0) 1110 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:27:55.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[29418]: cephadm 2021-03-10T14:27:54.503863+0000 mgr.gibba020.yqfnwy (mgr.34427) 1876 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:27:55.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[29418]: audit 2021-03-10T14:27:54.506120+0000 mon.a (mon.0) 1111 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:27:55.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[29418]: cephadm 2021-03-10T14:27:54.506567+0000 mgr.gibba020.yqfnwy (mgr.34427) 1877 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:27:55.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[29418]: cephadm 2021-03-10T14:27:54.508386+0000 mgr.gibba020.yqfnwy (mgr.34427) 1878 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:27:55.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[29418]: cephadm 2021-03-10T14:27:54.508422+0000 mgr.gibba020.yqfnwy (mgr.34427) 1879 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:27:55.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[29418]: audit 2021-03-10T14:27:54.508551+0000 mon.a (mon.0) 1112 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:55.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[29418]: cephadm 2021-03-10T14:27:54.509708+0000 mgr.gibba020.yqfnwy (mgr.34427) 1880 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:27:55.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[29418]: cephadm 2021-03-10T14:27:54.509815+0000 mgr.gibba020.yqfnwy (mgr.34427) 1881 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:27:55.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[29418]: audit 2021-03-10T14:27:54.509923+0000 mon.a (mon.0) 1113 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:55.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[29418]: cephadm 2021-03-10T14:27:54.511062+0000 mgr.gibba020.yqfnwy (mgr.34427) 1882 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:27:55.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[29418]: audit 2021-03-10T14:27:54.511381+0000 mon.a (mon.0) 1114 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:55.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[29418]: cephadm 2021-03-10T14:27:54.512689+0000 mgr.gibba020.yqfnwy (mgr.34427) 1883 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:27:55.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[29418]: cephadm 2021-03-10T14:27:54.512727+0000 mgr.gibba020.yqfnwy (mgr.34427) 1884 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:27:55.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[29418]: cephadm 2021-03-10T14:27:54.514270+0000 mgr.gibba020.yqfnwy (mgr.34427) 1885 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:27:55.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[29418]: audit 2021-03-10T14:27:54.514342+0000 mon.a (mon.0) 1115 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:55.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[29418]: cephadm 2021-03-10T14:27:54.514711+0000 mgr.gibba020.yqfnwy (mgr.34427) 1886 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:27:55.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[29418]: audit 2021-03-10T14:27:54.516442+0000 mon.a (mon.0) 1116 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:55.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[30381]: cephadm 2021-03-10T14:27:54.284456+0000 mgr.gibba020.yqfnwy (mgr.34427) 1875 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:27:55.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[30381]: audit 2021-03-10T14:27:54.285073+0000 mon.a (mon.0) 1109 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:27:55.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[30381]: audit 2021-03-10T14:27:54.498521+0000 mon.a (mon.0) 1110 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:27:55.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[30381]: cephadm 2021-03-10T14:27:54.503863+0000 mgr.gibba020.yqfnwy (mgr.34427) 1876 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:27:55.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[30381]: audit 2021-03-10T14:27:54.506120+0000 mon.a (mon.0) 1111 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:27:55.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[30381]: cephadm 2021-03-10T14:27:54.506567+0000 mgr.gibba020.yqfnwy (mgr.34427) 1877 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:27:55.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[30381]: cephadm 2021-03-10T14:27:54.508386+0000 mgr.gibba020.yqfnwy (mgr.34427) 1878 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:27:55.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[30381]: cephadm 2021-03-10T14:27:54.508422+0000 mgr.gibba020.yqfnwy (mgr.34427) 1879 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:27:55.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[30381]: audit 2021-03-10T14:27:54.508551+0000 mon.a (mon.0) 1112 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:55.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[30381]: cephadm 2021-03-10T14:27:54.509708+0000 mgr.gibba020.yqfnwy (mgr.34427) 1880 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:27:55.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[30381]: cephadm 2021-03-10T14:27:54.509815+0000 mgr.gibba020.yqfnwy (mgr.34427) 1881 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:27:55.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[30381]: audit 2021-03-10T14:27:54.509923+0000 mon.a (mon.0) 1113 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:55.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[30381]: cephadm 2021-03-10T14:27:54.511062+0000 mgr.gibba020.yqfnwy (mgr.34427) 1882 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:27:55.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[30381]: audit 2021-03-10T14:27:54.511381+0000 mon.a (mon.0) 1114 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:55.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[30381]: cephadm 2021-03-10T14:27:54.512689+0000 mgr.gibba020.yqfnwy (mgr.34427) 1883 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:27:55.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[30381]: cephadm 2021-03-10T14:27:54.512727+0000 mgr.gibba020.yqfnwy (mgr.34427) 1884 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:27:55.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[30381]: cephadm 2021-03-10T14:27:54.514270+0000 mgr.gibba020.yqfnwy (mgr.34427) 1885 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:27:55.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[30381]: audit 2021-03-10T14:27:54.514342+0000 mon.a (mon.0) 1115 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:55.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[30381]: cephadm 2021-03-10T14:27:54.514711+0000 mgr.gibba020.yqfnwy (mgr.34427) 1886 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:27:55.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[30381]: audit 2021-03-10T14:27:54.516442+0000 mon.a (mon.0) 1116 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:55.642 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[29418]: cephadm 2021-03-10T14:27:54.516462+0000 mgr.gibba020.yqfnwy (mgr.34427) 1887 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:27:55.642 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[29418]: cephadm 2021-03-10T14:27:54.516508+0000 mgr.gibba020.yqfnwy (mgr.34427) 1888 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:27:55.642 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[29418]: cephadm 2021-03-10T14:27:54.516636+0000 mgr.gibba020.yqfnwy (mgr.34427) 1889 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:27:55.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[30381]: cephadm 2021-03-10T14:27:54.516462+0000 mgr.gibba020.yqfnwy (mgr.34427) 1887 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:27:55.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[30381]: cephadm 2021-03-10T14:27:54.516508+0000 mgr.gibba020.yqfnwy (mgr.34427) 1888 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:27:55.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:55 gibba013 bash[30381]: cephadm 2021-03-10T14:27:54.516636+0000 mgr.gibba020.yqfnwy (mgr.34427) 1889 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:27:55.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:55 gibba020 bash[25448]: cephadm 2021-03-10T14:27:54.284456+0000 mgr.gibba020.yqfnwy (mgr.34427) 1875 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:27:55.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:55 gibba020 bash[25448]: audit 2021-03-10T14:27:54.285073+0000 mon.a (mon.0) 1109 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:27:55.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:55 gibba020 bash[25448]: audit 2021-03-10T14:27:54.498521+0000 mon.a (mon.0) 1110 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:27:55.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:55 gibba020 bash[25448]: cephadm 2021-03-10T14:27:54.503863+0000 mgr.gibba020.yqfnwy (mgr.34427) 1876 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:27:55.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:55 gibba020 bash[25448]: audit 2021-03-10T14:27:54.506120+0000 mon.a (mon.0) 1111 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:27:55.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:55 gibba020 bash[25448]: cephadm 2021-03-10T14:27:54.506567+0000 mgr.gibba020.yqfnwy (mgr.34427) 1877 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:27:55.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:55 gibba020 bash[25448]: cephadm 2021-03-10T14:27:54.508386+0000 mgr.gibba020.yqfnwy (mgr.34427) 1878 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:27:55.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:55 gibba020 bash[25448]: cephadm 2021-03-10T14:27:54.508422+0000 mgr.gibba020.yqfnwy (mgr.34427) 1879 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:27:55.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:55 gibba020 bash[25448]: audit 2021-03-10T14:27:54.508551+0000 mon.a (mon.0) 1112 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:55.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:55 gibba020 bash[25448]: cephadm 2021-03-10T14:27:54.509708+0000 mgr.gibba020.yqfnwy (mgr.34427) 1880 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:27:55.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:55 gibba020 bash[25448]: cephadm 2021-03-10T14:27:54.509815+0000 mgr.gibba020.yqfnwy (mgr.34427) 1881 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:27:55.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:55 gibba020 bash[25448]: audit 2021-03-10T14:27:54.509923+0000 mon.a (mon.0) 1113 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:55.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:55 gibba020 bash[25448]: cephadm 2021-03-10T14:27:54.511062+0000 mgr.gibba020.yqfnwy (mgr.34427) 1882 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:27:55.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:55 gibba020 bash[25448]: audit 2021-03-10T14:27:54.511381+0000 mon.a (mon.0) 1114 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:55.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:55 gibba020 bash[25448]: cephadm 2021-03-10T14:27:54.512689+0000 mgr.gibba020.yqfnwy (mgr.34427) 1883 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:27:55.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:55 gibba020 bash[25448]: cephadm 2021-03-10T14:27:54.512727+0000 mgr.gibba020.yqfnwy (mgr.34427) 1884 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:27:55.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:55 gibba020 bash[25448]: cephadm 2021-03-10T14:27:54.514270+0000 mgr.gibba020.yqfnwy (mgr.34427) 1885 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:27:55.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:55 gibba020 bash[25448]: audit 2021-03-10T14:27:54.514342+0000 mon.a (mon.0) 1115 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:55.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:55 gibba020 bash[25448]: cephadm 2021-03-10T14:27:54.514711+0000 mgr.gibba020.yqfnwy (mgr.34427) 1886 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:27:55.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:55 gibba020 bash[25448]: audit 2021-03-10T14:27:54.516442+0000 mon.a (mon.0) 1116 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:27:55.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:55 gibba020 bash[25448]: cephadm 2021-03-10T14:27:54.516462+0000 mgr.gibba020.yqfnwy (mgr.34427) 1887 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:27:55.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:55 gibba020 bash[25448]: cephadm 2021-03-10T14:27:54.516508+0000 mgr.gibba020.yqfnwy (mgr.34427) 1888 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:27:55.706 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:55 gibba020 bash[25448]: cephadm 2021-03-10T14:27:54.516636+0000 mgr.gibba020.yqfnwy (mgr.34427) 1889 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:27:57.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:56 gibba013 bash[29418]: cluster 2021-03-10T14:27:55.842232+0000 mgr.gibba020.yqfnwy (mgr.34427) 1890 : cluster [DBG] pgmap v1059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:57.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:56 gibba013 bash[30381]: cluster 2021-03-10T14:27:55.842232+0000 mgr.gibba020.yqfnwy (mgr.34427) 1890 : cluster [DBG] pgmap v1059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:57.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:56 gibba020 bash[25448]: cluster 2021-03-10T14:27:55.842232+0000 mgr.gibba020.yqfnwy (mgr.34427) 1890 : cluster [DBG] pgmap v1059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:59.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:27:58 gibba020 bash[25448]: cluster 2021-03-10T14:27:57.843539+0000 mgr.gibba020.yqfnwy (mgr.34427) 1891 : cluster [DBG] pgmap v1060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:59.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:27:58 gibba013 bash[29418]: cluster 2021-03-10T14:27:57.843539+0000 mgr.gibba020.yqfnwy (mgr.34427) 1891 : cluster [DBG] pgmap v1060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:27:59.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:27:58 gibba013 bash[30381]: cluster 2021-03-10T14:27:57.843539+0000 mgr.gibba020.yqfnwy (mgr.34427) 1891 : cluster [DBG] pgmap v1060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:01.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:00 gibba020 bash[25448]: cluster 2021-03-10T14:27:59.845095+0000 mgr.gibba020.yqfnwy (mgr.34427) 1892 : cluster [DBG] pgmap v1061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:01.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:00 gibba013 bash[29418]: cluster 2021-03-10T14:27:59.845095+0000 mgr.gibba020.yqfnwy (mgr.34427) 1892 : cluster [DBG] pgmap v1061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:01.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:00 gibba013 bash[30381]: cluster 2021-03-10T14:27:59.845095+0000 mgr.gibba020.yqfnwy (mgr.34427) 1892 : cluster [DBG] pgmap v1061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:03.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:02 gibba020 bash[25448]: cluster 2021-03-10T14:28:01.846684+0000 mgr.gibba020.yqfnwy (mgr.34427) 1893 : cluster [DBG] pgmap v1062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:03.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:02 gibba013 bash[29418]: cluster 2021-03-10T14:28:01.846684+0000 mgr.gibba020.yqfnwy (mgr.34427) 1893 : cluster [DBG] pgmap v1062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:03.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:02 gibba013 bash[30381]: cluster 2021-03-10T14:28:01.846684+0000 mgr.gibba020.yqfnwy (mgr.34427) 1893 : cluster [DBG] pgmap v1062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:04.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:03 gibba013 bash[29418]: cluster 2021-03-10T14:28:03.848164+0000 mgr.gibba020.yqfnwy (mgr.34427) 1894 : cluster [DBG] pgmap v1063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:04.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:03 gibba013 bash[30381]: cluster 2021-03-10T14:28:03.848164+0000 mgr.gibba020.yqfnwy (mgr.34427) 1894 : cluster [DBG] pgmap v1063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:04.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:03 gibba020 bash[25448]: cluster 2021-03-10T14:28:03.848164+0000 mgr.gibba020.yqfnwy (mgr.34427) 1894 : cluster [DBG] pgmap v1063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:07.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:06 gibba013 bash[29418]: cluster 2021-03-10T14:28:05.849615+0000 mgr.gibba020.yqfnwy (mgr.34427) 1895 : cluster [DBG] pgmap v1064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:06 gibba013 bash[29418]: audit 2021-03-10T14:28:06.067466+0000 mon.a (mon.0) 1117 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:28:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:06 gibba013 bash[29418]: audit 2021-03-10T14:28:06.068192+0000 mon.a (mon.0) 1118 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:28:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:06 gibba013 bash[29418]: audit 2021-03-10T14:28:06.068868+0000 mon.a (mon.0) 1119 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:28:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:06 gibba013 bash[29418]: audit 2021-03-10T14:28:06.069535+0000 mon.a (mon.0) 1120 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:28:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:06 gibba013 bash[29418]: audit 2021-03-10T14:28:06.155569+0000 mon.a (mon.0) 1121 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:28:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:06 gibba013 bash[29418]: audit 2021-03-10T14:28:06.162038+0000 mon.a (mon.0) 1122 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:28:07.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:06 gibba013 bash[30381]: cluster 2021-03-10T14:28:05.849615+0000 mgr.gibba020.yqfnwy (mgr.34427) 1895 : cluster [DBG] pgmap v1064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:07.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:06 gibba013 bash[30381]: audit 2021-03-10T14:28:06.067466+0000 mon.a (mon.0) 1117 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:28:07.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:06 gibba013 bash[30381]: audit 2021-03-10T14:28:06.068192+0000 mon.a (mon.0) 1118 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:28:07.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:06 gibba013 bash[30381]: audit 2021-03-10T14:28:06.068868+0000 mon.a (mon.0) 1119 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:28:07.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:06 gibba013 bash[30381]: audit 2021-03-10T14:28:06.069535+0000 mon.a (mon.0) 1120 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:28:07.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:06 gibba013 bash[30381]: audit 2021-03-10T14:28:06.155569+0000 mon.a (mon.0) 1121 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:28:07.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:06 gibba013 bash[30381]: audit 2021-03-10T14:28:06.162038+0000 mon.a (mon.0) 1122 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:28:07.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:06 gibba020 bash[25448]: cluster 2021-03-10T14:28:05.849615+0000 mgr.gibba020.yqfnwy (mgr.34427) 1895 : cluster [DBG] pgmap v1064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:07.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:06 gibba020 bash[25448]: audit 2021-03-10T14:28:06.067466+0000 mon.a (mon.0) 1117 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:28:07.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:06 gibba020 bash[25448]: audit 2021-03-10T14:28:06.068192+0000 mon.a (mon.0) 1118 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:28:07.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:06 gibba020 bash[25448]: audit 2021-03-10T14:28:06.068868+0000 mon.a (mon.0) 1119 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:28:07.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:06 gibba020 bash[25448]: audit 2021-03-10T14:28:06.069535+0000 mon.a (mon.0) 1120 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:28:07.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:06 gibba020 bash[25448]: audit 2021-03-10T14:28:06.155569+0000 mon.a (mon.0) 1121 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:28:07.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:06 gibba020 bash[25448]: audit 2021-03-10T14:28:06.162038+0000 mon.a (mon.0) 1122 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:28:09.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:08 gibba020 bash[25448]: cluster 2021-03-10T14:28:07.851141+0000 mgr.gibba020.yqfnwy (mgr.34427) 1896 : cluster [DBG] pgmap v1065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:09.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:08 gibba013 bash[29418]: cluster 2021-03-10T14:28:07.851141+0000 mgr.gibba020.yqfnwy (mgr.34427) 1896 : cluster [DBG] pgmap v1065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:09.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:08 gibba013 bash[30381]: cluster 2021-03-10T14:28:07.851141+0000 mgr.gibba020.yqfnwy (mgr.34427) 1896 : cluster [DBG] pgmap v1065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:10.513 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:28:10.740 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:28:10.741 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (34m) 16s ago 40m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:28:10.741 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (39m) 9m ago 39m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:28:10.741 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (35m) 9m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:28:10.741 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (35m) 9m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:28:10.742 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (34m) 16s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:28:10.742 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (34m) 16s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:28:10.742 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (33m) 9m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:28:10.742 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (33m) 16s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:28:10.742 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (40m) 16s ago 40m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:28:10.743 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (40m) 9m ago 40m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:28:10.743 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (32m) 16s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:28:10.743 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (32m) 16s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:28:10.743 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (32m) 16s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:28:10.743 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (31m) 16s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:28:10.744 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (31m) 9m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:28:10.744 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (30m) 9m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:28:10.744 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (30m) 9m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:28:10.744 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (29m) 9m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:28:10.744 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (39m) 9m ago 40m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:28:10.745 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 9m ago 38m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:28:10.990 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:28:10.991 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:28:10.991 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:28:10.991 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:28:10.991 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:28:10.992 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:28:10.992 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:28:10.992 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:28:10.992 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:28:10.992 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:28:10.993 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:28:10.993 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:28:10.993 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:28:10.993 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:28:10.994 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:28:11.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:10 gibba020 bash[25448]: cephadm 2021-03-10T14:28:09.532579+0000 mgr.gibba020.yqfnwy (mgr.34427) 1897 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:28:11.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:10 gibba020 bash[25448]: cluster 2021-03-10T14:28:09.852872+0000 mgr.gibba020.yqfnwy (mgr.34427) 1898 : cluster [DBG] pgmap v1066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:11.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:10 gibba013 bash[29418]: cephadm 2021-03-10T14:28:09.532579+0000 mgr.gibba020.yqfnwy (mgr.34427) 1897 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:28:11.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:10 gibba013 bash[29418]: cluster 2021-03-10T14:28:09.852872+0000 mgr.gibba020.yqfnwy (mgr.34427) 1898 : cluster [DBG] pgmap v1066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:11.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:10 gibba013 bash[30381]: cephadm 2021-03-10T14:28:09.532579+0000 mgr.gibba020.yqfnwy (mgr.34427) 1897 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:28:11.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:10 gibba013 bash[30381]: cluster 2021-03-10T14:28:09.852872+0000 mgr.gibba020.yqfnwy (mgr.34427) 1898 : cluster [DBG] pgmap v1066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:12.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:11 gibba020 bash[25448]: audit 2021-03-10T14:28:10.502232+0000 mgr.gibba020.yqfnwy (mgr.34427) 1899 : audit [DBG] from='client.55315 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:28:12.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:11 gibba020 bash[25448]: audit 2021-03-10T14:28:10.725330+0000 mgr.gibba020.yqfnwy (mgr.34427) 1900 : audit [DBG] from='client.45336 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:28:12.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:11 gibba020 bash[25448]: audit 2021-03-10T14:28:10.989679+0000 mon.a (mon.0) 1123 : audit [DBG] from='client.? 172.21.2.113:0/1142867698' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:12.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:11 gibba013 bash[29418]: audit 2021-03-10T14:28:10.502232+0000 mgr.gibba020.yqfnwy (mgr.34427) 1899 : audit [DBG] from='client.55315 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:28:12.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:11 gibba013 bash[29418]: audit 2021-03-10T14:28:10.725330+0000 mgr.gibba020.yqfnwy (mgr.34427) 1900 : audit [DBG] from='client.45336 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:28:12.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:11 gibba013 bash[29418]: audit 2021-03-10T14:28:10.989679+0000 mon.a (mon.0) 1123 : audit [DBG] from='client.? 172.21.2.113:0/1142867698' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:12.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:11 gibba013 bash[30381]: audit 2021-03-10T14:28:10.502232+0000 mgr.gibba020.yqfnwy (mgr.34427) 1899 : audit [DBG] from='client.55315 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:28:12.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:11 gibba013 bash[30381]: audit 2021-03-10T14:28:10.725330+0000 mgr.gibba020.yqfnwy (mgr.34427) 1900 : audit [DBG] from='client.45336 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:28:12.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:11 gibba013 bash[30381]: audit 2021-03-10T14:28:10.989679+0000 mon.a (mon.0) 1123 : audit [DBG] from='client.? 172.21.2.113:0/1142867698' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:13.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:12 gibba020 bash[25448]: cluster 2021-03-10T14:28:11.854294+0000 mgr.gibba020.yqfnwy (mgr.34427) 1901 : cluster [DBG] pgmap v1067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:13.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:12 gibba013 bash[29418]: cluster 2021-03-10T14:28:11.854294+0000 mgr.gibba020.yqfnwy (mgr.34427) 1901 : cluster [DBG] pgmap v1067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:13.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:12 gibba013 bash[30381]: cluster 2021-03-10T14:28:11.854294+0000 mgr.gibba020.yqfnwy (mgr.34427) 1901 : cluster [DBG] pgmap v1067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:14.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:13 gibba020 bash[25448]: cluster 2021-03-10T14:28:13.855398+0000 mgr.gibba020.yqfnwy (mgr.34427) 1902 : cluster [DBG] pgmap v1068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:14.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:13 gibba013 bash[29418]: cluster 2021-03-10T14:28:13.855398+0000 mgr.gibba020.yqfnwy (mgr.34427) 1902 : cluster [DBG] pgmap v1068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:14.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:13 gibba013 bash[30381]: cluster 2021-03-10T14:28:13.855398+0000 mgr.gibba020.yqfnwy (mgr.34427) 1902 : cluster [DBG] pgmap v1068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:17.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:16 gibba013 bash[29418]: cluster 2021-03-10T14:28:15.856779+0000 mgr.gibba020.yqfnwy (mgr.34427) 1903 : cluster [DBG] pgmap v1069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:17.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:16 gibba013 bash[30381]: cluster 2021-03-10T14:28:15.856779+0000 mgr.gibba020.yqfnwy (mgr.34427) 1903 : cluster [DBG] pgmap v1069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:17.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:16 gibba020 bash[25448]: cluster 2021-03-10T14:28:15.856779+0000 mgr.gibba020.yqfnwy (mgr.34427) 1903 : cluster [DBG] pgmap v1069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:19.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:18 gibba020 bash[25448]: cluster 2021-03-10T14:28:17.858384+0000 mgr.gibba020.yqfnwy (mgr.34427) 1904 : cluster [DBG] pgmap v1070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:19.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:18 gibba013 bash[29418]: cluster 2021-03-10T14:28:17.858384+0000 mgr.gibba020.yqfnwy (mgr.34427) 1904 : cluster [DBG] pgmap v1070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:19.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:18 gibba013 bash[30381]: cluster 2021-03-10T14:28:17.858384+0000 mgr.gibba020.yqfnwy (mgr.34427) 1904 : cluster [DBG] pgmap v1070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:21.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:20 gibba020 bash[25448]: cluster 2021-03-10T14:28:19.860279+0000 mgr.gibba020.yqfnwy (mgr.34427) 1905 : cluster [DBG] pgmap v1071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:21.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:20 gibba013 bash[29418]: cluster 2021-03-10T14:28:19.860279+0000 mgr.gibba020.yqfnwy (mgr.34427) 1905 : cluster [DBG] pgmap v1071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:21.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:20 gibba013 bash[30381]: cluster 2021-03-10T14:28:19.860279+0000 mgr.gibba020.yqfnwy (mgr.34427) 1905 : cluster [DBG] pgmap v1071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:22.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:21 gibba020 bash[25448]: cluster 2021-03-10T14:28:21.861432+0000 mgr.gibba020.yqfnwy (mgr.34427) 1906 : cluster [DBG] pgmap v1072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:22.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:21 gibba013 bash[29418]: cluster 2021-03-10T14:28:21.861432+0000 mgr.gibba020.yqfnwy (mgr.34427) 1906 : cluster [DBG] pgmap v1072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:22.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:21 gibba013 bash[30381]: cluster 2021-03-10T14:28:21.861432+0000 mgr.gibba020.yqfnwy (mgr.34427) 1906 : cluster [DBG] pgmap v1072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:25.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:24 gibba020 bash[25448]: cluster 2021-03-10T14:28:23.862993+0000 mgr.gibba020.yqfnwy (mgr.34427) 1907 : cluster [DBG] pgmap v1073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:25.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:24 gibba013 bash[29418]: cluster 2021-03-10T14:28:23.862993+0000 mgr.gibba020.yqfnwy (mgr.34427) 1907 : cluster [DBG] pgmap v1073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:25.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:24 gibba013 bash[30381]: cluster 2021-03-10T14:28:23.862993+0000 mgr.gibba020.yqfnwy (mgr.34427) 1907 : cluster [DBG] pgmap v1073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:26.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:25 gibba020 bash[25448]: cephadm 2021-03-10T14:28:24.543818+0000 mgr.gibba020.yqfnwy (mgr.34427) 1908 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:28:26.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:25 gibba013 bash[29418]: cephadm 2021-03-10T14:28:24.543818+0000 mgr.gibba020.yqfnwy (mgr.34427) 1908 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:28:26.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:25 gibba013 bash[30381]: cephadm 2021-03-10T14:28:24.543818+0000 mgr.gibba020.yqfnwy (mgr.34427) 1908 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:28:27.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:26 gibba020 bash[25448]: cluster 2021-03-10T14:28:25.864465+0000 mgr.gibba020.yqfnwy (mgr.34427) 1909 : cluster [DBG] pgmap v1074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:27.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:26 gibba013 bash[29418]: cluster 2021-03-10T14:28:25.864465+0000 mgr.gibba020.yqfnwy (mgr.34427) 1909 : cluster [DBG] pgmap v1074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:27.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:26 gibba013 bash[30381]: cluster 2021-03-10T14:28:25.864465+0000 mgr.gibba020.yqfnwy (mgr.34427) 1909 : cluster [DBG] pgmap v1074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:28.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:27 gibba020 bash[25448]: cluster 2021-03-10T14:28:27.866002+0000 mgr.gibba020.yqfnwy (mgr.34427) 1910 : cluster [DBG] pgmap v1075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:28.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:27 gibba013 bash[29418]: cluster 2021-03-10T14:28:27.866002+0000 mgr.gibba020.yqfnwy (mgr.34427) 1910 : cluster [DBG] pgmap v1075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:28.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:27 gibba013 bash[30381]: cluster 2021-03-10T14:28:27.866002+0000 mgr.gibba020.yqfnwy (mgr.34427) 1910 : cluster [DBG] pgmap v1075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:31.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:30 gibba020 bash[25448]: cluster 2021-03-10T14:28:29.867346+0000 mgr.gibba020.yqfnwy (mgr.34427) 1911 : cluster [DBG] pgmap v1076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:31.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:30 gibba013 bash[29418]: cluster 2021-03-10T14:28:29.867346+0000 mgr.gibba020.yqfnwy (mgr.34427) 1911 : cluster [DBG] pgmap v1076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:31.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:30 gibba013 bash[30381]: cluster 2021-03-10T14:28:29.867346+0000 mgr.gibba020.yqfnwy (mgr.34427) 1911 : cluster [DBG] pgmap v1076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:32.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:31 gibba013 bash[29418]: cluster 2021-03-10T14:28:31.868745+0000 mgr.gibba020.yqfnwy (mgr.34427) 1912 : cluster [DBG] pgmap v1077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:32.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:31 gibba013 bash[30381]: cluster 2021-03-10T14:28:31.868745+0000 mgr.gibba020.yqfnwy (mgr.34427) 1912 : cluster [DBG] pgmap v1077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:32.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:31 gibba020 bash[25448]: cluster 2021-03-10T14:28:31.868745+0000 mgr.gibba020.yqfnwy (mgr.34427) 1912 : cluster [DBG] pgmap v1077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:35.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:34 gibba020 bash[25448]: cluster 2021-03-10T14:28:33.870499+0000 mgr.gibba020.yqfnwy (mgr.34427) 1913 : cluster [DBG] pgmap v1078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:35.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:34 gibba013 bash[29418]: cluster 2021-03-10T14:28:33.870499+0000 mgr.gibba020.yqfnwy (mgr.34427) 1913 : cluster [DBG] pgmap v1078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:35.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:34 gibba013 bash[30381]: cluster 2021-03-10T14:28:33.870499+0000 mgr.gibba020.yqfnwy (mgr.34427) 1913 : cluster [DBG] pgmap v1078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:37.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:36 gibba013 bash[29418]: cluster 2021-03-10T14:28:35.872021+0000 mgr.gibba020.yqfnwy (mgr.34427) 1914 : cluster [DBG] pgmap v1079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:37.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:36 gibba013 bash[30381]: cluster 2021-03-10T14:28:35.872021+0000 mgr.gibba020.yqfnwy (mgr.34427) 1914 : cluster [DBG] pgmap v1079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:37.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:36 gibba020 bash[25448]: cluster 2021-03-10T14:28:35.872021+0000 mgr.gibba020.yqfnwy (mgr.34427) 1914 : cluster [DBG] pgmap v1079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:39.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:38 gibba020 bash[25448]: cluster 2021-03-10T14:28:37.873075+0000 mgr.gibba020.yqfnwy (mgr.34427) 1915 : cluster [DBG] pgmap v1080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:39.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:38 gibba013 bash[29418]: cluster 2021-03-10T14:28:37.873075+0000 mgr.gibba020.yqfnwy (mgr.34427) 1915 : cluster [DBG] pgmap v1080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:39.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:38 gibba013 bash[30381]: cluster 2021-03-10T14:28:37.873075+0000 mgr.gibba020.yqfnwy (mgr.34427) 1915 : cluster [DBG] pgmap v1080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:40.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:39 gibba013 bash[29418]: cephadm 2021-03-10T14:28:39.559880+0000 mgr.gibba020.yqfnwy (mgr.34427) 1916 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:28:40.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:39 gibba013 bash[29418]: cluster 2021-03-10T14:28:39.874848+0000 mgr.gibba020.yqfnwy (mgr.34427) 1917 : cluster [DBG] pgmap v1081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:40.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:39 gibba013 bash[30381]: cephadm 2021-03-10T14:28:39.559880+0000 mgr.gibba020.yqfnwy (mgr.34427) 1916 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:28:40.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:39 gibba013 bash[30381]: cluster 2021-03-10T14:28:39.874848+0000 mgr.gibba020.yqfnwy (mgr.34427) 1917 : cluster [DBG] pgmap v1081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:40.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:39 gibba020 bash[25448]: cephadm 2021-03-10T14:28:39.559880+0000 mgr.gibba020.yqfnwy (mgr.34427) 1916 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:28:40.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:39 gibba020 bash[25448]: cluster 2021-03-10T14:28:39.874848+0000 mgr.gibba020.yqfnwy (mgr.34427) 1917 : cluster [DBG] pgmap v1081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:41.231 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:28:41.488 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:28:41.488 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (35m) 47s ago 40m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:28:41.489 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (40m) 9m ago 40m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:28:41.489 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (35m) 9m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:28:41.489 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (35m) 9m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:28:41.489 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (34m) 47s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:28:41.489 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (34m) 47s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:28:41.490 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (34m) 9m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:28:41.490 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (34m) 47s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:28:41.490 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (40m) 47s ago 40m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:28:41.490 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (40m) 9m ago 40m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:28:41.490 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (33m) 47s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:28:41.491 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (33m) 47s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:28:41.491 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (32m) 47s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:28:41.491 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (32m) 47s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:28:41.491 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (31m) 9m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:28:41.492 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (31m) 9m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:28:41.492 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (30m) 9m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:28:41.492 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (30m) 9m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:28:41.492 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (40m) 9m ago 40m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:28:41.492 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 9m ago 38m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:28:41.752 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:28:41.752 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:28:41.752 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:28:41.752 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:28:41.753 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:28:41.753 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:28:41.753 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:28:41.754 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:28:41.754 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:28:41.754 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:28:41.754 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:28:41.755 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:28:41.755 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:28:41.755 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:28:41.755 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:28:42.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:41 gibba013 bash[29418]: audit 2021-03-10T14:28:41.750198+0000 mon.a (mon.0) 1124 : audit [DBG] from='client.? 172.21.2.113:0/3370538397' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:42.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:41 gibba013 bash[30381]: audit 2021-03-10T14:28:41.750198+0000 mon.a (mon.0) 1124 : audit [DBG] from='client.? 172.21.2.113:0/3370538397' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:42.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:41 gibba020 bash[25448]: audit 2021-03-10T14:28:41.750198+0000 mon.a (mon.0) 1124 : audit [DBG] from='client.? 172.21.2.113:0/3370538397' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:43.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:42 gibba013 bash[29418]: audit 2021-03-10T14:28:41.220734+0000 mgr.gibba020.yqfnwy (mgr.34427) 1918 : audit [DBG] from='client.45348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:28:43.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:42 gibba013 bash[29418]: audit 2021-03-10T14:28:41.445718+0000 mgr.gibba020.yqfnwy (mgr.34427) 1919 : audit [DBG] from='client.55339 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:28:43.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:42 gibba013 bash[29418]: cluster 2021-03-10T14:28:41.875862+0000 mgr.gibba020.yqfnwy (mgr.34427) 1920 : cluster [DBG] pgmap v1082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:43.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:42 gibba013 bash[30381]: audit 2021-03-10T14:28:41.220734+0000 mgr.gibba020.yqfnwy (mgr.34427) 1918 : audit [DBG] from='client.45348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:28:43.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:42 gibba013 bash[30381]: audit 2021-03-10T14:28:41.445718+0000 mgr.gibba020.yqfnwy (mgr.34427) 1919 : audit [DBG] from='client.55339 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:28:43.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:42 gibba013 bash[30381]: cluster 2021-03-10T14:28:41.875862+0000 mgr.gibba020.yqfnwy (mgr.34427) 1920 : cluster [DBG] pgmap v1082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:43.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:42 gibba020 bash[25448]: audit 2021-03-10T14:28:41.220734+0000 mgr.gibba020.yqfnwy (mgr.34427) 1918 : audit [DBG] from='client.45348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:28:43.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:42 gibba020 bash[25448]: audit 2021-03-10T14:28:41.445718+0000 mgr.gibba020.yqfnwy (mgr.34427) 1919 : audit [DBG] from='client.55339 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:28:43.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:42 gibba020 bash[25448]: cluster 2021-03-10T14:28:41.875862+0000 mgr.gibba020.yqfnwy (mgr.34427) 1920 : cluster [DBG] pgmap v1082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:45.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:44 gibba020 bash[25448]: cluster 2021-03-10T14:28:43.877520+0000 mgr.gibba020.yqfnwy (mgr.34427) 1921 : cluster [DBG] pgmap v1083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:45.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:44 gibba013 bash[29418]: cluster 2021-03-10T14:28:43.877520+0000 mgr.gibba020.yqfnwy (mgr.34427) 1921 : cluster [DBG] pgmap v1083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:45.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:44 gibba013 bash[30381]: cluster 2021-03-10T14:28:43.877520+0000 mgr.gibba020.yqfnwy (mgr.34427) 1921 : cluster [DBG] pgmap v1083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:47.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:46 gibba013 bash[29418]: cluster 2021-03-10T14:28:45.878953+0000 mgr.gibba020.yqfnwy (mgr.34427) 1922 : cluster [DBG] pgmap v1084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:47.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:46 gibba013 bash[30381]: cluster 2021-03-10T14:28:45.878953+0000 mgr.gibba020.yqfnwy (mgr.34427) 1922 : cluster [DBG] pgmap v1084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:47.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:46 gibba020 bash[25448]: cluster 2021-03-10T14:28:45.878953+0000 mgr.gibba020.yqfnwy (mgr.34427) 1922 : cluster [DBG] pgmap v1084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:48.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:47 gibba013 bash[29418]: cluster 2021-03-10T14:28:47.880607+0000 mgr.gibba020.yqfnwy (mgr.34427) 1923 : cluster [DBG] pgmap v1085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:48.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:47 gibba013 bash[30381]: cluster 2021-03-10T14:28:47.880607+0000 mgr.gibba020.yqfnwy (mgr.34427) 1923 : cluster [DBG] pgmap v1085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:48.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:47 gibba020 bash[25448]: cluster 2021-03-10T14:28:47.880607+0000 mgr.gibba020.yqfnwy (mgr.34427) 1923 : cluster [DBG] pgmap v1085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:50.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:49 gibba013 bash[29418]: cluster 2021-03-10T14:28:49.882259+0000 mgr.gibba020.yqfnwy (mgr.34427) 1924 : cluster [DBG] pgmap v1086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:50.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:49 gibba013 bash[30381]: cluster 2021-03-10T14:28:49.882259+0000 mgr.gibba020.yqfnwy (mgr.34427) 1924 : cluster [DBG] pgmap v1086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:50.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:49 gibba020 bash[25448]: cluster 2021-03-10T14:28:49.882259+0000 mgr.gibba020.yqfnwy (mgr.34427) 1924 : cluster [DBG] pgmap v1086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:52.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:51 gibba013 bash[29418]: cluster 2021-03-10T14:28:51.883790+0000 mgr.gibba020.yqfnwy (mgr.34427) 1925 : cluster [DBG] pgmap v1087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:52.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:51 gibba013 bash[30381]: cluster 2021-03-10T14:28:51.883790+0000 mgr.gibba020.yqfnwy (mgr.34427) 1925 : cluster [DBG] pgmap v1087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:52.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:51 gibba020 bash[25448]: cluster 2021-03-10T14:28:51.883790+0000 mgr.gibba020.yqfnwy (mgr.34427) 1925 : cluster [DBG] pgmap v1087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:54.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:53 gibba013 bash[29418]: cluster 2021-03-10T14:28:53.885335+0000 mgr.gibba020.yqfnwy (mgr.34427) 1926 : cluster [DBG] pgmap v1088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:54.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:53 gibba013 bash[30381]: cluster 2021-03-10T14:28:53.885335+0000 mgr.gibba020.yqfnwy (mgr.34427) 1926 : cluster [DBG] pgmap v1088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:54.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:53 gibba020 bash[25448]: cluster 2021-03-10T14:28:53.885335+0000 mgr.gibba020.yqfnwy (mgr.34427) 1926 : cluster [DBG] pgmap v1088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:55.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:55 gibba013 bash[29418]: audit 2021-03-10T14:28:54.577948+0000 mon.a (mon.0) 1125 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:28:55.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:55 gibba013 bash[29418]: cephadm 2021-03-10T14:28:54.581826+0000 mgr.gibba020.yqfnwy (mgr.34427) 1927 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:28:55.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:55 gibba013 bash[29418]: audit 2021-03-10T14:28:54.584743+0000 mon.a (mon.0) 1126 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:28:55.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:55 gibba013 bash[30381]: audit 2021-03-10T14:28:54.577948+0000 mon.a (mon.0) 1125 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:28:55.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:55 gibba013 bash[30381]: cephadm 2021-03-10T14:28:54.581826+0000 mgr.gibba020.yqfnwy (mgr.34427) 1927 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:28:55.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:55 gibba013 bash[30381]: audit 2021-03-10T14:28:54.584743+0000 mon.a (mon.0) 1126 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:28:55.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:55 gibba020 bash[25448]: audit 2021-03-10T14:28:54.577948+0000 mon.a (mon.0) 1125 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:28:55.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:55 gibba020 bash[25448]: cephadm 2021-03-10T14:28:54.581826+0000 mgr.gibba020.yqfnwy (mgr.34427) 1927 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:28:55.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:55 gibba020 bash[25448]: audit 2021-03-10T14:28:54.584743+0000 mon.a (mon.0) 1126 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:28:57.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:56 gibba013 bash[29418]: cluster 2021-03-10T14:28:55.886839+0000 mgr.gibba020.yqfnwy (mgr.34427) 1928 : cluster [DBG] pgmap v1089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:57.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:56 gibba013 bash[30381]: cluster 2021-03-10T14:28:55.886839+0000 mgr.gibba020.yqfnwy (mgr.34427) 1928 : cluster [DBG] pgmap v1089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:57.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:56 gibba020 bash[25448]: cluster 2021-03-10T14:28:55.886839+0000 mgr.gibba020.yqfnwy (mgr.34427) 1928 : cluster [DBG] pgmap v1089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:58.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:57 gibba013 bash[29418]: cluster 2021-03-10T14:28:57.887380+0000 mgr.gibba020.yqfnwy (mgr.34427) 1929 : cluster [DBG] pgmap v1090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:58.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:57 gibba013 bash[30381]: cluster 2021-03-10T14:28:57.887380+0000 mgr.gibba020.yqfnwy (mgr.34427) 1929 : cluster [DBG] pgmap v1090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:58.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:57 gibba020 bash[25448]: cluster 2021-03-10T14:28:57.887380+0000 mgr.gibba020.yqfnwy (mgr.34427) 1929 : cluster [DBG] pgmap v1090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:28:59.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[29418]: cephadm 2021-03-10T14:28:58.370115+0000 mgr.gibba020.yqfnwy (mgr.34427) 1930 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:28:59.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[29418]: audit 2021-03-10T14:28:58.370544+0000 mon.a (mon.0) 1127 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:28:59.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[29418]: audit 2021-03-10T14:28:58.568748+0000 mon.a (mon.0) 1128 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:28:59.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[29418]: cephadm 2021-03-10T14:28:58.570464+0000 mgr.gibba020.yqfnwy (mgr.34427) 1931 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:28:59.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[29418]: cephadm 2021-03-10T14:28:58.572660+0000 mgr.gibba020.yqfnwy (mgr.34427) 1932 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:28:59.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[29418]: audit 2021-03-10T14:28:58.572673+0000 mon.a (mon.0) 1129 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:28:59.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[29418]: cephadm 2021-03-10T14:28:58.574223+0000 mgr.gibba020.yqfnwy (mgr.34427) 1933 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:28:59.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[29418]: cephadm 2021-03-10T14:28:58.574260+0000 mgr.gibba020.yqfnwy (mgr.34427) 1934 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:28:59.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[29418]: audit 2021-03-10T14:28:58.574288+0000 mon.a (mon.0) 1130 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:59.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[29418]: cephadm 2021-03-10T14:28:58.575712+0000 mgr.gibba020.yqfnwy (mgr.34427) 1935 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:28:59.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[29418]: cephadm 2021-03-10T14:28:58.575749+0000 mgr.gibba020.yqfnwy (mgr.34427) 1936 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:28:59.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[29418]: audit 2021-03-10T14:28:58.575856+0000 mon.a (mon.0) 1131 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:59.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[29418]: cephadm 2021-03-10T14:28:58.577038+0000 mgr.gibba020.yqfnwy (mgr.34427) 1937 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:28:59.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[29418]: audit 2021-03-10T14:28:58.577322+0000 mon.a (mon.0) 1132 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:59.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[29418]: cephadm 2021-03-10T14:28:58.578954+0000 mgr.gibba020.yqfnwy (mgr.34427) 1938 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:28:59.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[29418]: cephadm 2021-03-10T14:28:58.578990+0000 mgr.gibba020.yqfnwy (mgr.34427) 1939 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:28:59.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[29418]: cephadm 2021-03-10T14:28:58.580479+0000 mgr.gibba020.yqfnwy (mgr.34427) 1940 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:28:59.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[29418]: audit 2021-03-10T14:28:58.580688+0000 mon.a (mon.0) 1133 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:59.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[29418]: cephadm 2021-03-10T14:28:58.580788+0000 mgr.gibba020.yqfnwy (mgr.34427) 1941 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:28:59.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[29418]: audit 2021-03-10T14:28:58.582232+0000 mon.a (mon.0) 1134 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:59.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[30381]: cephadm 2021-03-10T14:28:58.370115+0000 mgr.gibba020.yqfnwy (mgr.34427) 1930 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:28:59.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[30381]: audit 2021-03-10T14:28:58.370544+0000 mon.a (mon.0) 1127 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:28:59.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[30381]: audit 2021-03-10T14:28:58.568748+0000 mon.a (mon.0) 1128 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:28:59.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[30381]: cephadm 2021-03-10T14:28:58.570464+0000 mgr.gibba020.yqfnwy (mgr.34427) 1931 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:28:59.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[30381]: cephadm 2021-03-10T14:28:58.572660+0000 mgr.gibba020.yqfnwy (mgr.34427) 1932 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:28:59.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[30381]: audit 2021-03-10T14:28:58.572673+0000 mon.a (mon.0) 1129 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:28:59.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[30381]: cephadm 2021-03-10T14:28:58.574223+0000 mgr.gibba020.yqfnwy (mgr.34427) 1933 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:28:59.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[30381]: cephadm 2021-03-10T14:28:58.574260+0000 mgr.gibba020.yqfnwy (mgr.34427) 1934 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:28:59.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[30381]: audit 2021-03-10T14:28:58.574288+0000 mon.a (mon.0) 1130 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:59.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[30381]: cephadm 2021-03-10T14:28:58.575712+0000 mgr.gibba020.yqfnwy (mgr.34427) 1935 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:28:59.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[30381]: cephadm 2021-03-10T14:28:58.575749+0000 mgr.gibba020.yqfnwy (mgr.34427) 1936 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:28:59.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[30381]: audit 2021-03-10T14:28:58.575856+0000 mon.a (mon.0) 1131 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:59.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[30381]: cephadm 2021-03-10T14:28:58.577038+0000 mgr.gibba020.yqfnwy (mgr.34427) 1937 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:28:59.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[30381]: audit 2021-03-10T14:28:58.577322+0000 mon.a (mon.0) 1132 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:59.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[30381]: cephadm 2021-03-10T14:28:58.578954+0000 mgr.gibba020.yqfnwy (mgr.34427) 1938 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:28:59.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[30381]: cephadm 2021-03-10T14:28:58.578990+0000 mgr.gibba020.yqfnwy (mgr.34427) 1939 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:28:59.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[30381]: cephadm 2021-03-10T14:28:58.580479+0000 mgr.gibba020.yqfnwy (mgr.34427) 1940 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:28:59.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[30381]: audit 2021-03-10T14:28:58.580688+0000 mon.a (mon.0) 1133 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:59.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[30381]: cephadm 2021-03-10T14:28:58.580788+0000 mgr.gibba020.yqfnwy (mgr.34427) 1941 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:28:59.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[30381]: audit 2021-03-10T14:28:58.582232+0000 mon.a (mon.0) 1134 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:59.640 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[29418]: cephadm 2021-03-10T14:28:58.582430+0000 mgr.gibba020.yqfnwy (mgr.34427) 1942 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:28:59.641 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[29418]: cephadm 2021-03-10T14:28:58.582466+0000 mgr.gibba020.yqfnwy (mgr.34427) 1943 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:28:59.641 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[29418]: cephadm 2021-03-10T14:28:58.582568+0000 mgr.gibba020.yqfnwy (mgr.34427) 1944 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:28:59.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[30381]: cephadm 2021-03-10T14:28:58.582430+0000 mgr.gibba020.yqfnwy (mgr.34427) 1942 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:28:59.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[30381]: cephadm 2021-03-10T14:28:58.582466+0000 mgr.gibba020.yqfnwy (mgr.34427) 1943 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:28:59.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:28:59 gibba013 bash[30381]: cephadm 2021-03-10T14:28:58.582568+0000 mgr.gibba020.yqfnwy (mgr.34427) 1944 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:28:59.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:59 gibba020 bash[25448]: cephadm 2021-03-10T14:28:58.370115+0000 mgr.gibba020.yqfnwy (mgr.34427) 1930 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:28:59.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:59 gibba020 bash[25448]: audit 2021-03-10T14:28:58.370544+0000 mon.a (mon.0) 1127 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:28:59.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:59 gibba020 bash[25448]: audit 2021-03-10T14:28:58.568748+0000 mon.a (mon.0) 1128 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:28:59.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:59 gibba020 bash[25448]: cephadm 2021-03-10T14:28:58.570464+0000 mgr.gibba020.yqfnwy (mgr.34427) 1931 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:28:59.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:59 gibba020 bash[25448]: cephadm 2021-03-10T14:28:58.572660+0000 mgr.gibba020.yqfnwy (mgr.34427) 1932 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:28:59.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:59 gibba020 bash[25448]: audit 2021-03-10T14:28:58.572673+0000 mon.a (mon.0) 1129 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:28:59.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:59 gibba020 bash[25448]: cephadm 2021-03-10T14:28:58.574223+0000 mgr.gibba020.yqfnwy (mgr.34427) 1933 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:28:59.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:59 gibba020 bash[25448]: cephadm 2021-03-10T14:28:58.574260+0000 mgr.gibba020.yqfnwy (mgr.34427) 1934 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:28:59.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:59 gibba020 bash[25448]: audit 2021-03-10T14:28:58.574288+0000 mon.a (mon.0) 1130 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:59.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:59 gibba020 bash[25448]: cephadm 2021-03-10T14:28:58.575712+0000 mgr.gibba020.yqfnwy (mgr.34427) 1935 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:28:59.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:59 gibba020 bash[25448]: cephadm 2021-03-10T14:28:58.575749+0000 mgr.gibba020.yqfnwy (mgr.34427) 1936 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:28:59.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:59 gibba020 bash[25448]: audit 2021-03-10T14:28:58.575856+0000 mon.a (mon.0) 1131 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:59.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:59 gibba020 bash[25448]: cephadm 2021-03-10T14:28:58.577038+0000 mgr.gibba020.yqfnwy (mgr.34427) 1937 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:28:59.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:59 gibba020 bash[25448]: audit 2021-03-10T14:28:58.577322+0000 mon.a (mon.0) 1132 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:59.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:59 gibba020 bash[25448]: cephadm 2021-03-10T14:28:58.578954+0000 mgr.gibba020.yqfnwy (mgr.34427) 1938 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:28:59.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:59 gibba020 bash[25448]: cephadm 2021-03-10T14:28:58.578990+0000 mgr.gibba020.yqfnwy (mgr.34427) 1939 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:28:59.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:59 gibba020 bash[25448]: cephadm 2021-03-10T14:28:58.580479+0000 mgr.gibba020.yqfnwy (mgr.34427) 1940 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:28:59.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:59 gibba020 bash[25448]: audit 2021-03-10T14:28:58.580688+0000 mon.a (mon.0) 1133 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:59.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:59 gibba020 bash[25448]: cephadm 2021-03-10T14:28:58.580788+0000 mgr.gibba020.yqfnwy (mgr.34427) 1941 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:28:59.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:59 gibba020 bash[25448]: audit 2021-03-10T14:28:58.582232+0000 mon.a (mon.0) 1134 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:28:59.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:59 gibba020 bash[25448]: cephadm 2021-03-10T14:28:58.582430+0000 mgr.gibba020.yqfnwy (mgr.34427) 1942 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:28:59.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:59 gibba020 bash[25448]: cephadm 2021-03-10T14:28:58.582466+0000 mgr.gibba020.yqfnwy (mgr.34427) 1943 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:28:59.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:28:59 gibba020 bash[25448]: cephadm 2021-03-10T14:28:58.582568+0000 mgr.gibba020.yqfnwy (mgr.34427) 1944 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:29:00.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:00 gibba020 bash[25448]: cluster 2021-03-10T14:28:59.888791+0000 mgr.gibba020.yqfnwy (mgr.34427) 1945 : cluster [DBG] pgmap v1091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:00.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:00 gibba013 bash[29418]: cluster 2021-03-10T14:28:59.888791+0000 mgr.gibba020.yqfnwy (mgr.34427) 1945 : cluster [DBG] pgmap v1091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:00.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:00 gibba013 bash[30381]: cluster 2021-03-10T14:28:59.888791+0000 mgr.gibba020.yqfnwy (mgr.34427) 1945 : cluster [DBG] pgmap v1091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:02.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:01 gibba013 bash[29418]: cluster 2021-03-10T14:29:01.890271+0000 mgr.gibba020.yqfnwy (mgr.34427) 1946 : cluster [DBG] pgmap v1092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:02.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:01 gibba013 bash[30381]: cluster 2021-03-10T14:29:01.890271+0000 mgr.gibba020.yqfnwy (mgr.34427) 1946 : cluster [DBG] pgmap v1092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:02.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:01 gibba020 bash[25448]: cluster 2021-03-10T14:29:01.890271+0000 mgr.gibba020.yqfnwy (mgr.34427) 1946 : cluster [DBG] pgmap v1092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:04.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:03 gibba013 bash[29418]: cluster 2021-03-10T14:29:03.891987+0000 mgr.gibba020.yqfnwy (mgr.34427) 1947 : cluster [DBG] pgmap v1093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:04.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:03 gibba013 bash[30381]: cluster 2021-03-10T14:29:03.891987+0000 mgr.gibba020.yqfnwy (mgr.34427) 1947 : cluster [DBG] pgmap v1093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:04.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:03 gibba020 bash[25448]: cluster 2021-03-10T14:29:03.891987+0000 mgr.gibba020.yqfnwy (mgr.34427) 1947 : cluster [DBG] pgmap v1093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:07.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:06 gibba013 bash[29418]: cluster 2021-03-10T14:29:05.893408+0000 mgr.gibba020.yqfnwy (mgr.34427) 1948 : cluster [DBG] pgmap v1094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:06 gibba013 bash[29418]: audit 2021-03-10T14:29:06.078134+0000 mon.a (mon.0) 1135 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T14:29:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:06 gibba013 bash[29418]: audit 2021-03-10T14:29:06.078899+0000 mon.a (mon.0) 1136 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:29:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:06 gibba013 bash[29418]: audit 2021-03-10T14:29:06.079584+0000 mon.a (mon.0) 1137 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:29:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:06 gibba013 bash[29418]: audit 2021-03-10T14:29:06.080242+0000 mon.a (mon.0) 1138 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T14:29:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:06 gibba013 bash[29418]: audit 2021-03-10T14:29:06.162581+0000 mon.a (mon.0) 1139 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:29:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:06 gibba013 bash[29418]: audit 2021-03-10T14:29:06.167672+0000 mon.a (mon.0) 1140 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:29:07.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:06 gibba013 bash[30381]: cluster 2021-03-10T14:29:05.893408+0000 mgr.gibba020.yqfnwy (mgr.34427) 1948 : cluster [DBG] pgmap v1094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:07.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:06 gibba013 bash[30381]: audit 2021-03-10T14:29:06.078134+0000 mon.a (mon.0) 1135 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T14:29:07.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:06 gibba013 bash[30381]: audit 2021-03-10T14:29:06.078899+0000 mon.a (mon.0) 1136 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:29:07.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:06 gibba013 bash[30381]: audit 2021-03-10T14:29:06.079584+0000 mon.a (mon.0) 1137 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:29:07.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:06 gibba013 bash[30381]: audit 2021-03-10T14:29:06.080242+0000 mon.a (mon.0) 1138 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T14:29:07.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:06 gibba013 bash[30381]: audit 2021-03-10T14:29:06.162581+0000 mon.a (mon.0) 1139 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:29:07.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:06 gibba013 bash[30381]: audit 2021-03-10T14:29:06.167672+0000 mon.a (mon.0) 1140 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:29:07.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:06 gibba020 bash[25448]: cluster 2021-03-10T14:29:05.893408+0000 mgr.gibba020.yqfnwy (mgr.34427) 1948 : cluster [DBG] pgmap v1094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:07.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:06 gibba020 bash[25448]: audit 2021-03-10T14:29:06.078134+0000 mon.a (mon.0) 1135 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T14:29:07.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:06 gibba020 bash[25448]: audit 2021-03-10T14:29:06.078899+0000 mon.a (mon.0) 1136 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:29:07.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:06 gibba020 bash[25448]: audit 2021-03-10T14:29:06.079584+0000 mon.a (mon.0) 1137 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:29:07.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:06 gibba020 bash[25448]: audit 2021-03-10T14:29:06.080242+0000 mon.a (mon.0) 1138 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T14:29:07.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:06 gibba020 bash[25448]: audit 2021-03-10T14:29:06.162581+0000 mon.a (mon.0) 1139 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:29:07.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:06 gibba020 bash[25448]: audit 2021-03-10T14:29:06.167672+0000 mon.a (mon.0) 1140 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:29:08.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:07 gibba013 bash[29418]: cluster 2021-03-10T14:29:07.894790+0000 mgr.gibba020.yqfnwy (mgr.34427) 1949 : cluster [DBG] pgmap v1095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:08.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:07 gibba013 bash[30381]: cluster 2021-03-10T14:29:07.894790+0000 mgr.gibba020.yqfnwy (mgr.34427) 1949 : cluster [DBG] pgmap v1095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:08.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:08 gibba020 bash[25448]: cluster 2021-03-10T14:29:07.894790+0000 mgr.gibba020.yqfnwy (mgr.34427) 1949 : cluster [DBG] pgmap v1095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:10.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:09 gibba013 bash[29418]: cluster 2021-03-10T14:29:09.896722+0000 mgr.gibba020.yqfnwy (mgr.34427) 1950 : cluster [DBG] pgmap v1096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:10.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:10 gibba013 bash[30381]: cluster 2021-03-10T14:29:09.896722+0000 mgr.gibba020.yqfnwy (mgr.34427) 1950 : cluster [DBG] pgmap v1096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:10.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:10 gibba020 bash[25448]: cluster 2021-03-10T14:29:09.896722+0000 mgr.gibba020.yqfnwy (mgr.34427) 1950 : cluster [DBG] pgmap v1096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:11.997 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:29:12.253 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:29:12.254 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (35m) 77s ago 41m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:29:12.254 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (40m) 13s ago 40m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:29:12.254 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (36m) 13s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:29:12.254 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (36m) 13s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:29:12.255 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (35m) 77s ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:29:12.255 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (35m) 77s ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:29:12.255 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (34m) 13s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:29:12.255 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (34m) 77s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:29:12.255 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (41m) 77s ago 41m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:29:12.256 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (41m) 13s ago 41m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:29:12.256 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (33m) 77s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:29:12.256 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (33m) 77s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:29:12.256 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (33m) 77s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:29:12.257 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (32m) 77s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:29:12.257 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (32m) 13s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:29:12.257 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (31m) 13s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:29:12.257 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (31m) 13s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:29:12.258 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (30m) 13s ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:29:12.258 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (40m) 13s ago 41m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:29:12.258 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 13s ago 39m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:29:12.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:11 gibba013 bash[29418]: cluster 2021-03-10T14:29:11.897827+0000 mgr.gibba020.yqfnwy (mgr.34427) 1951 : cluster [DBG] pgmap v1097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:12.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:11 gibba013 bash[30381]: cluster 2021-03-10T14:29:11.897827+0000 mgr.gibba020.yqfnwy (mgr.34427) 1951 : cluster [DBG] pgmap v1097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:12.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:12 gibba020 bash[25448]: cluster 2021-03-10T14:29:11.897827+0000 mgr.gibba020.yqfnwy (mgr.34427) 1951 : cluster [DBG] pgmap v1097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:12.504 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:29:12.504 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:29:12.505 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:29:12.505 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:29:12.505 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:29:12.505 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:29:12.506 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:29:12.506 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:29:12.506 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:29:12.506 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:29:12.506 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:29:12.507 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:29:12.507 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:29:12.507 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:29:12.507 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:29:13.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:13 gibba013 bash[29418]: audit 2021-03-10T14:29:11.985608+0000 mgr.gibba020.yqfnwy (mgr.34427) 1952 : audit [DBG] from='client.45366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:29:13.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:13 gibba013 bash[29418]: audit 2021-03-10T14:29:12.210278+0000 mgr.gibba020.yqfnwy (mgr.34427) 1953 : audit [DBG] from='client.45372 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:29:13.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:13 gibba013 bash[29418]: audit 2021-03-10T14:29:12.503362+0000 mon.a (mon.0) 1141 : audit [DBG] from='client.? 172.21.2.113:0/1502284784' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:13.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:13 gibba013 bash[30381]: audit 2021-03-10T14:29:11.985608+0000 mgr.gibba020.yqfnwy (mgr.34427) 1952 : audit [DBG] from='client.45366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:29:13.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:13 gibba013 bash[30381]: audit 2021-03-10T14:29:12.210278+0000 mgr.gibba020.yqfnwy (mgr.34427) 1953 : audit [DBG] from='client.45372 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:29:13.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:13 gibba013 bash[30381]: audit 2021-03-10T14:29:12.503362+0000 mon.a (mon.0) 1141 : audit [DBG] from='client.? 172.21.2.113:0/1502284784' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:13.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:13 gibba020 bash[25448]: audit 2021-03-10T14:29:11.985608+0000 mgr.gibba020.yqfnwy (mgr.34427) 1952 : audit [DBG] from='client.45366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:29:13.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:13 gibba020 bash[25448]: audit 2021-03-10T14:29:12.210278+0000 mgr.gibba020.yqfnwy (mgr.34427) 1953 : audit [DBG] from='client.45372 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:29:13.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:13 gibba020 bash[25448]: audit 2021-03-10T14:29:12.503362+0000 mon.a (mon.0) 1141 : audit [DBG] from='client.? 172.21.2.113:0/1502284784' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:14.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:14 gibba013 bash[29418]: cephadm 2021-03-10T14:29:13.596108+0000 mgr.gibba020.yqfnwy (mgr.34427) 1954 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:29:14.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:14 gibba013 bash[29418]: cluster 2021-03-10T14:29:13.899442+0000 mgr.gibba020.yqfnwy (mgr.34427) 1955 : cluster [DBG] pgmap v1098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:14.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:14 gibba013 bash[30381]: cephadm 2021-03-10T14:29:13.596108+0000 mgr.gibba020.yqfnwy (mgr.34427) 1954 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:29:14.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:14 gibba013 bash[30381]: cluster 2021-03-10T14:29:13.899442+0000 mgr.gibba020.yqfnwy (mgr.34427) 1955 : cluster [DBG] pgmap v1098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:14.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:14 gibba020 bash[25448]: cephadm 2021-03-10T14:29:13.596108+0000 mgr.gibba020.yqfnwy (mgr.34427) 1954 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:29:14.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:14 gibba020 bash[25448]: cluster 2021-03-10T14:29:13.899442+0000 mgr.gibba020.yqfnwy (mgr.34427) 1955 : cluster [DBG] pgmap v1098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:17.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:16 gibba013 bash[29418]: cluster 2021-03-10T14:29:15.900904+0000 mgr.gibba020.yqfnwy (mgr.34427) 1956 : cluster [DBG] pgmap v1099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:17.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:16 gibba013 bash[30381]: cluster 2021-03-10T14:29:15.900904+0000 mgr.gibba020.yqfnwy (mgr.34427) 1956 : cluster [DBG] pgmap v1099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:17.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:16 gibba020 bash[25448]: cluster 2021-03-10T14:29:15.900904+0000 mgr.gibba020.yqfnwy (mgr.34427) 1956 : cluster [DBG] pgmap v1099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:18.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:18 gibba013 bash[29418]: cluster 2021-03-10T14:29:17.902262+0000 mgr.gibba020.yqfnwy (mgr.34427) 1957 : cluster [DBG] pgmap v1100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:18.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:18 gibba013 bash[30381]: cluster 2021-03-10T14:29:17.902262+0000 mgr.gibba020.yqfnwy (mgr.34427) 1957 : cluster [DBG] pgmap v1100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:18.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:18 gibba020 bash[25448]: cluster 2021-03-10T14:29:17.902262+0000 mgr.gibba020.yqfnwy (mgr.34427) 1957 : cluster [DBG] pgmap v1100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:20.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:20 gibba013 bash[29418]: cluster 2021-03-10T14:29:19.903973+0000 mgr.gibba020.yqfnwy (mgr.34427) 1958 : cluster [DBG] pgmap v1101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:20.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:20 gibba013 bash[30381]: cluster 2021-03-10T14:29:19.903973+0000 mgr.gibba020.yqfnwy (mgr.34427) 1958 : cluster [DBG] pgmap v1101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:20.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:20 gibba020 bash[25448]: cluster 2021-03-10T14:29:19.903973+0000 mgr.gibba020.yqfnwy (mgr.34427) 1958 : cluster [DBG] pgmap v1101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:22.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:22 gibba013 bash[29418]: cluster 2021-03-10T14:29:21.909547+0000 mgr.gibba020.yqfnwy (mgr.34427) 1959 : cluster [DBG] pgmap v1102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:22.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:22 gibba013 bash[30381]: cluster 2021-03-10T14:29:21.909547+0000 mgr.gibba020.yqfnwy (mgr.34427) 1959 : cluster [DBG] pgmap v1102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:22.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:22 gibba020 bash[25448]: cluster 2021-03-10T14:29:21.909547+0000 mgr.gibba020.yqfnwy (mgr.34427) 1959 : cluster [DBG] pgmap v1102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:24.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:24 gibba013 bash[29418]: cluster 2021-03-10T14:29:23.911003+0000 mgr.gibba020.yqfnwy (mgr.34427) 1960 : cluster [DBG] pgmap v1103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:24.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:24 gibba013 bash[30381]: cluster 2021-03-10T14:29:23.911003+0000 mgr.gibba020.yqfnwy (mgr.34427) 1960 : cluster [DBG] pgmap v1103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:24.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:24 gibba020 bash[25448]: cluster 2021-03-10T14:29:23.911003+0000 mgr.gibba020.yqfnwy (mgr.34427) 1960 : cluster [DBG] pgmap v1103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:27.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:26 gibba013 bash[29418]: cluster 2021-03-10T14:29:25.912443+0000 mgr.gibba020.yqfnwy (mgr.34427) 1961 : cluster [DBG] pgmap v1104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:27.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:26 gibba013 bash[30381]: cluster 2021-03-10T14:29:25.912443+0000 mgr.gibba020.yqfnwy (mgr.34427) 1961 : cluster [DBG] pgmap v1104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:27.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:26 gibba020 bash[25448]: cluster 2021-03-10T14:29:25.912443+0000 mgr.gibba020.yqfnwy (mgr.34427) 1961 : cluster [DBG] pgmap v1104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:28.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:28 gibba013 bash[29418]: cluster 2021-03-10T14:29:27.913929+0000 mgr.gibba020.yqfnwy (mgr.34427) 1962 : cluster [DBG] pgmap v1105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:28.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:28 gibba013 bash[30381]: cluster 2021-03-10T14:29:27.913929+0000 mgr.gibba020.yqfnwy (mgr.34427) 1962 : cluster [DBG] pgmap v1105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:28.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:28 gibba020 bash[25448]: cluster 2021-03-10T14:29:27.913929+0000 mgr.gibba020.yqfnwy (mgr.34427) 1962 : cluster [DBG] pgmap v1105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:29.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:29 gibba013 bash[29418]: cephadm 2021-03-10T14:29:28.612004+0000 mgr.gibba020.yqfnwy (mgr.34427) 1963 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:29:29.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:29 gibba013 bash[30381]: cephadm 2021-03-10T14:29:28.612004+0000 mgr.gibba020.yqfnwy (mgr.34427) 1963 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:29:29.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:29 gibba020 bash[25448]: cephadm 2021-03-10T14:29:28.612004+0000 mgr.gibba020.yqfnwy (mgr.34427) 1963 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:29:30.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:30 gibba013 bash[29418]: cluster 2021-03-10T14:29:29.915731+0000 mgr.gibba020.yqfnwy (mgr.34427) 1964 : cluster [DBG] pgmap v1106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:30.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:30 gibba013 bash[30381]: cluster 2021-03-10T14:29:29.915731+0000 mgr.gibba020.yqfnwy (mgr.34427) 1964 : cluster [DBG] pgmap v1106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:30.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:30 gibba020 bash[25448]: cluster 2021-03-10T14:29:29.915731+0000 mgr.gibba020.yqfnwy (mgr.34427) 1964 : cluster [DBG] pgmap v1106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:32.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:32 gibba013 bash[29418]: cluster 2021-03-10T14:29:31.916587+0000 mgr.gibba020.yqfnwy (mgr.34427) 1965 : cluster [DBG] pgmap v1107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:32.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:32 gibba013 bash[30381]: cluster 2021-03-10T14:29:31.916587+0000 mgr.gibba020.yqfnwy (mgr.34427) 1965 : cluster [DBG] pgmap v1107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:32.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:32 gibba020 bash[25448]: cluster 2021-03-10T14:29:31.916587+0000 mgr.gibba020.yqfnwy (mgr.34427) 1965 : cluster [DBG] pgmap v1107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:34.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:34 gibba013 bash[29418]: cluster 2021-03-10T14:29:33.917937+0000 mgr.gibba020.yqfnwy (mgr.34427) 1966 : cluster [DBG] pgmap v1108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:34.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:34 gibba013 bash[30381]: cluster 2021-03-10T14:29:33.917937+0000 mgr.gibba020.yqfnwy (mgr.34427) 1966 : cluster [DBG] pgmap v1108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:34.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:34 gibba020 bash[25448]: cluster 2021-03-10T14:29:33.917937+0000 mgr.gibba020.yqfnwy (mgr.34427) 1966 : cluster [DBG] pgmap v1108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:37.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:36 gibba013 bash[29418]: cluster 2021-03-10T14:29:35.919380+0000 mgr.gibba020.yqfnwy (mgr.34427) 1967 : cluster [DBG] pgmap v1109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:37.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:36 gibba013 bash[30381]: cluster 2021-03-10T14:29:35.919380+0000 mgr.gibba020.yqfnwy (mgr.34427) 1967 : cluster [DBG] pgmap v1109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:37.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:36 gibba020 bash[25448]: cluster 2021-03-10T14:29:35.919380+0000 mgr.gibba020.yqfnwy (mgr.34427) 1967 : cluster [DBG] pgmap v1109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:38.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:38 gibba013 bash[29418]: cluster 2021-03-10T14:29:37.920962+0000 mgr.gibba020.yqfnwy (mgr.34427) 1968 : cluster [DBG] pgmap v1110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:38.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:38 gibba013 bash[30381]: cluster 2021-03-10T14:29:37.920962+0000 mgr.gibba020.yqfnwy (mgr.34427) 1968 : cluster [DBG] pgmap v1110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:38.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:38 gibba020 bash[25448]: cluster 2021-03-10T14:29:37.920962+0000 mgr.gibba020.yqfnwy (mgr.34427) 1968 : cluster [DBG] pgmap v1110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:40.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:40 gibba013 bash[29418]: cluster 2021-03-10T14:29:39.922771+0000 mgr.gibba020.yqfnwy (mgr.34427) 1969 : cluster [DBG] pgmap v1111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:40.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:40 gibba013 bash[30381]: cluster 2021-03-10T14:29:39.922771+0000 mgr.gibba020.yqfnwy (mgr.34427) 1969 : cluster [DBG] pgmap v1111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:40.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:40 gibba020 bash[25448]: cluster 2021-03-10T14:29:39.922771+0000 mgr.gibba020.yqfnwy (mgr.34427) 1969 : cluster [DBG] pgmap v1111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:42.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:42 gibba013 bash[29418]: cluster 2021-03-10T14:29:41.923195+0000 mgr.gibba020.yqfnwy (mgr.34427) 1970 : cluster [DBG] pgmap v1112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:42.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:42 gibba013 bash[30381]: cluster 2021-03-10T14:29:41.923195+0000 mgr.gibba020.yqfnwy (mgr.34427) 1970 : cluster [DBG] pgmap v1112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:42.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:42 gibba020 bash[25448]: cluster 2021-03-10T14:29:41.923195+0000 mgr.gibba020.yqfnwy (mgr.34427) 1970 : cluster [DBG] pgmap v1112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:42.746 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:29:42.971 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:29:42.972 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (36m) 108s ago 41m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:29:42.972 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (41m) 44s ago 41m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:29:42.972 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (36m) 44s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:29:42.973 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (36m) 44s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:29:42.973 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (35m) 108s ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:29:42.973 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (35m) 108s ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:29:42.973 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (35m) 44s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:29:42.973 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (35m) 108s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:29:42.974 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (41m) 108s ago 41m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:29:42.974 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (41m) 44s ago 41m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:29:42.974 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (34m) 108s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:29:42.975 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (34m) 108s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:29:42.975 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (33m) 108s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:29:42.975 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (33m) 108s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:29:42.975 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (32m) 44s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:29:42.975 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (32m) 44s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:29:42.976 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (31m) 44s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:29:42.976 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (31m) 44s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:29:42.976 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (41m) 44s ago 41m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:29:42.976 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 44s ago 39m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:29:43.220 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:29:43.220 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:29:43.220 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:29:43.221 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:29:43.221 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:29:43.221 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:29:43.221 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:29:43.222 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:29:43.222 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:29:43.222 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:29:43.222 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:29:43.223 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:29:43.223 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:29:43.223 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:29:43.223 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:29:43.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:43 gibba013 bash[29418]: audit 2021-03-10T14:29:42.735166+0000 mgr.gibba020.yqfnwy (mgr.34427) 1971 : audit [DBG] from='client.45384 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:29:43.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:43 gibba013 bash[29418]: audit 2021-03-10T14:29:42.956761+0000 mgr.gibba020.yqfnwy (mgr.34427) 1972 : audit [DBG] from='client.55375 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:29:43.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:43 gibba013 bash[30381]: audit 2021-03-10T14:29:42.735166+0000 mgr.gibba020.yqfnwy (mgr.34427) 1971 : audit [DBG] from='client.45384 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:29:43.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:43 gibba013 bash[30381]: audit 2021-03-10T14:29:42.956761+0000 mgr.gibba020.yqfnwy (mgr.34427) 1972 : audit [DBG] from='client.55375 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:29:43.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:43 gibba020 bash[25448]: audit 2021-03-10T14:29:42.735166+0000 mgr.gibba020.yqfnwy (mgr.34427) 1971 : audit [DBG] from='client.45384 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:29:43.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:43 gibba020 bash[25448]: audit 2021-03-10T14:29:42.956761+0000 mgr.gibba020.yqfnwy (mgr.34427) 1972 : audit [DBG] from='client.55375 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:29:44.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:44 gibba013 bash[29418]: audit 2021-03-10T14:29:43.219004+0000 mon.a (mon.0) 1142 : audit [DBG] from='client.? 172.21.2.113:0/3222343797' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:44.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:44 gibba013 bash[29418]: cephadm 2021-03-10T14:29:43.627847+0000 mgr.gibba020.yqfnwy (mgr.34427) 1973 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:29:44.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:44 gibba013 bash[29418]: cluster 2021-03-10T14:29:43.924678+0000 mgr.gibba020.yqfnwy (mgr.34427) 1974 : cluster [DBG] pgmap v1113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:44.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:44 gibba013 bash[30381]: audit 2021-03-10T14:29:43.219004+0000 mon.a (mon.0) 1142 : audit [DBG] from='client.? 172.21.2.113:0/3222343797' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:44.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:44 gibba013 bash[30381]: cephadm 2021-03-10T14:29:43.627847+0000 mgr.gibba020.yqfnwy (mgr.34427) 1973 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:29:44.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:44 gibba013 bash[30381]: cluster 2021-03-10T14:29:43.924678+0000 mgr.gibba020.yqfnwy (mgr.34427) 1974 : cluster [DBG] pgmap v1113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:44.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:44 gibba020 bash[25448]: audit 2021-03-10T14:29:43.219004+0000 mon.a (mon.0) 1142 : audit [DBG] from='client.? 172.21.2.113:0/3222343797' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:44.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:44 gibba020 bash[25448]: cephadm 2021-03-10T14:29:43.627847+0000 mgr.gibba020.yqfnwy (mgr.34427) 1973 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:29:44.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:44 gibba020 bash[25448]: cluster 2021-03-10T14:29:43.924678+0000 mgr.gibba020.yqfnwy (mgr.34427) 1974 : cluster [DBG] pgmap v1113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:47.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:46 gibba013 bash[29418]: cluster 2021-03-10T14:29:45.926075+0000 mgr.gibba020.yqfnwy (mgr.34427) 1975 : cluster [DBG] pgmap v1114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:47.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:46 gibba013 bash[30381]: cluster 2021-03-10T14:29:45.926075+0000 mgr.gibba020.yqfnwy (mgr.34427) 1975 : cluster [DBG] pgmap v1114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:47.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:46 gibba020 bash[25448]: cluster 2021-03-10T14:29:45.926075+0000 mgr.gibba020.yqfnwy (mgr.34427) 1975 : cluster [DBG] pgmap v1114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:48.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:48 gibba013 bash[29418]: cluster 2021-03-10T14:29:47.926986+0000 mgr.gibba020.yqfnwy (mgr.34427) 1976 : cluster [DBG] pgmap v1115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:48.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:48 gibba013 bash[30381]: cluster 2021-03-10T14:29:47.926986+0000 mgr.gibba020.yqfnwy (mgr.34427) 1976 : cluster [DBG] pgmap v1115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:48.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:48 gibba020 bash[25448]: cluster 2021-03-10T14:29:47.926986+0000 mgr.gibba020.yqfnwy (mgr.34427) 1976 : cluster [DBG] pgmap v1115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:50.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:50 gibba013 bash[29418]: cluster 2021-03-10T14:29:49.928760+0000 mgr.gibba020.yqfnwy (mgr.34427) 1977 : cluster [DBG] pgmap v1116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:50.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:50 gibba013 bash[30381]: cluster 2021-03-10T14:29:49.928760+0000 mgr.gibba020.yqfnwy (mgr.34427) 1977 : cluster [DBG] pgmap v1116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:50.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:50 gibba020 bash[25448]: cluster 2021-03-10T14:29:49.928760+0000 mgr.gibba020.yqfnwy (mgr.34427) 1977 : cluster [DBG] pgmap v1116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:52.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:52 gibba013 bash[29418]: cluster 2021-03-10T14:29:51.929615+0000 mgr.gibba020.yqfnwy (mgr.34427) 1978 : cluster [DBG] pgmap v1117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:52.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:52 gibba013 bash[30381]: cluster 2021-03-10T14:29:51.929615+0000 mgr.gibba020.yqfnwy (mgr.34427) 1978 : cluster [DBG] pgmap v1117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:52.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:52 gibba020 bash[25448]: cluster 2021-03-10T14:29:51.929615+0000 mgr.gibba020.yqfnwy (mgr.34427) 1978 : cluster [DBG] pgmap v1117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:54.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:54 gibba013 bash[29418]: cluster 2021-03-10T14:29:53.931099+0000 mgr.gibba020.yqfnwy (mgr.34427) 1979 : cluster [DBG] pgmap v1118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:54.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:54 gibba013 bash[30381]: cluster 2021-03-10T14:29:53.931099+0000 mgr.gibba020.yqfnwy (mgr.34427) 1979 : cluster [DBG] pgmap v1118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:54.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:54 gibba020 bash[25448]: cluster 2021-03-10T14:29:53.931099+0000 mgr.gibba020.yqfnwy (mgr.34427) 1979 : cluster [DBG] pgmap v1118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:57.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:56 gibba013 bash[29418]: cluster 2021-03-10T14:29:55.932549+0000 mgr.gibba020.yqfnwy (mgr.34427) 1980 : cluster [DBG] pgmap v1119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:57.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:56 gibba013 bash[30381]: cluster 2021-03-10T14:29:55.932549+0000 mgr.gibba020.yqfnwy (mgr.34427) 1980 : cluster [DBG] pgmap v1119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:57.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:56 gibba020 bash[25448]: cluster 2021-03-10T14:29:55.932549+0000 mgr.gibba020.yqfnwy (mgr.34427) 1980 : cluster [DBG] pgmap v1119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:58.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:58 gibba013 bash[29418]: cluster 2021-03-10T14:29:57.933818+0000 mgr.gibba020.yqfnwy (mgr.34427) 1981 : cluster [DBG] pgmap v1120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:58.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:58 gibba013 bash[30381]: cluster 2021-03-10T14:29:57.933818+0000 mgr.gibba020.yqfnwy (mgr.34427) 1981 : cluster [DBG] pgmap v1120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:58.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:58 gibba020 bash[25448]: cluster 2021-03-10T14:29:57.933818+0000 mgr.gibba020.yqfnwy (mgr.34427) 1981 : cluster [DBG] pgmap v1120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:29:59.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:59 gibba020 bash[25448]: audit 2021-03-10T14:29:58.645820+0000 mon.a (mon.0) 1143 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:29:59.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:59 gibba020 bash[25448]: cephadm 2021-03-10T14:29:58.649663+0000 mgr.gibba020.yqfnwy (mgr.34427) 1982 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:29:59.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:59 gibba020 bash[25448]: cephadm 2021-03-10T14:29:58.651399+0000 mgr.gibba020.yqfnwy (mgr.34427) 1983 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:29:59.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:59 gibba020 bash[25448]: audit 2021-03-10T14:29:58.867850+0000 mon.a (mon.0) 1144 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:29:59.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:59 gibba020 bash[25448]: cephadm 2021-03-10T14:29:58.872862+0000 mgr.gibba020.yqfnwy (mgr.34427) 1984 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:29:59.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:59 gibba020 bash[25448]: cephadm 2021-03-10T14:29:58.874699+0000 mgr.gibba020.yqfnwy (mgr.34427) 1985 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:29:59.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:59 gibba020 bash[25448]: audit 2021-03-10T14:29:58.874839+0000 mon.a (mon.0) 1145 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:29:59.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:59 gibba020 bash[25448]: cephadm 2021-03-10T14:29:58.876134+0000 mgr.gibba020.yqfnwy (mgr.34427) 1986 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:29:59.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:59 gibba020 bash[25448]: cephadm 2021-03-10T14:29:58.876177+0000 mgr.gibba020.yqfnwy (mgr.34427) 1987 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:29:59.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:59 gibba020 bash[25448]: audit 2021-03-10T14:29:58.876331+0000 mon.a (mon.0) 1146 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:59.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:59 gibba020 bash[25448]: cephadm 2021-03-10T14:29:58.877402+0000 mgr.gibba020.yqfnwy (mgr.34427) 1988 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:29:59.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:59 gibba020 bash[25448]: cephadm 2021-03-10T14:29:58.877442+0000 mgr.gibba020.yqfnwy (mgr.34427) 1989 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:29:59.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:59 gibba020 bash[25448]: audit 2021-03-10T14:29:58.877815+0000 mon.a (mon.0) 1147 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:59.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:59 gibba020 bash[25448]: cephadm 2021-03-10T14:29:58.878441+0000 mgr.gibba020.yqfnwy (mgr.34427) 1990 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:29:59.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:59 gibba020 bash[25448]: audit 2021-03-10T14:29:58.878834+0000 mon.a (mon.0) 1148 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:59.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:59 gibba020 bash[25448]: cephadm 2021-03-10T14:29:58.879436+0000 mgr.gibba020.yqfnwy (mgr.34427) 1991 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:29:59.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:59 gibba020 bash[25448]: cephadm 2021-03-10T14:29:58.879486+0000 mgr.gibba020.yqfnwy (mgr.34427) 1992 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:29:59.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:59 gibba020 bash[25448]: cephadm 2021-03-10T14:29:58.881084+0000 mgr.gibba020.yqfnwy (mgr.34427) 1993 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:29:59.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:59 gibba020 bash[25448]: audit 2021-03-10T14:29:58.881188+0000 mon.a (mon.0) 1149 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:59.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:59 gibba020 bash[25448]: cephadm 2021-03-10T14:29:58.881432+0000 mgr.gibba020.yqfnwy (mgr.34427) 1994 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:29:59.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:59 gibba020 bash[25448]: cephadm 2021-03-10T14:29:58.882823+0000 mgr.gibba020.yqfnwy (mgr.34427) 1995 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:29:59.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:59 gibba020 bash[25448]: cephadm 2021-03-10T14:29:58.882867+0000 mgr.gibba020.yqfnwy (mgr.34427) 1996 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:29:59.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:59 gibba020 bash[25448]: cephadm 2021-03-10T14:29:58.882982+0000 mgr.gibba020.yqfnwy (mgr.34427) 1997 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:29:59.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:29:59 gibba020 bash[25448]: audit 2021-03-10T14:29:58.883059+0000 mon.a (mon.0) 1150 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:59.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[29418]: audit 2021-03-10T14:29:58.645820+0000 mon.a (mon.0) 1143 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:29:59.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[29418]: cephadm 2021-03-10T14:29:58.649663+0000 mgr.gibba020.yqfnwy (mgr.34427) 1982 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:29:59.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[29418]: cephadm 2021-03-10T14:29:58.651399+0000 mgr.gibba020.yqfnwy (mgr.34427) 1983 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:29:59.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[29418]: audit 2021-03-10T14:29:58.867850+0000 mon.a (mon.0) 1144 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:29:59.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[29418]: cephadm 2021-03-10T14:29:58.872862+0000 mgr.gibba020.yqfnwy (mgr.34427) 1984 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:29:59.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[29418]: cephadm 2021-03-10T14:29:58.874699+0000 mgr.gibba020.yqfnwy (mgr.34427) 1985 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:29:59.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[29418]: audit 2021-03-10T14:29:58.874839+0000 mon.a (mon.0) 1145 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:29:59.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[29418]: cephadm 2021-03-10T14:29:58.876134+0000 mgr.gibba020.yqfnwy (mgr.34427) 1986 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:29:59.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[29418]: cephadm 2021-03-10T14:29:58.876177+0000 mgr.gibba020.yqfnwy (mgr.34427) 1987 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:29:59.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[29418]: audit 2021-03-10T14:29:58.876331+0000 mon.a (mon.0) 1146 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:59.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[29418]: cephadm 2021-03-10T14:29:58.877402+0000 mgr.gibba020.yqfnwy (mgr.34427) 1988 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:29:59.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[29418]: cephadm 2021-03-10T14:29:58.877442+0000 mgr.gibba020.yqfnwy (mgr.34427) 1989 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:29:59.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[29418]: audit 2021-03-10T14:29:58.877815+0000 mon.a (mon.0) 1147 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:59.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[29418]: cephadm 2021-03-10T14:29:58.878441+0000 mgr.gibba020.yqfnwy (mgr.34427) 1990 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:29:59.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[29418]: audit 2021-03-10T14:29:58.878834+0000 mon.a (mon.0) 1148 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:59.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[29418]: cephadm 2021-03-10T14:29:58.879436+0000 mgr.gibba020.yqfnwy (mgr.34427) 1991 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:29:59.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[29418]: cephadm 2021-03-10T14:29:58.879486+0000 mgr.gibba020.yqfnwy (mgr.34427) 1992 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:29:59.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[29418]: cephadm 2021-03-10T14:29:58.881084+0000 mgr.gibba020.yqfnwy (mgr.34427) 1993 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:29:59.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[29418]: audit 2021-03-10T14:29:58.881188+0000 mon.a (mon.0) 1149 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:59.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[29418]: cephadm 2021-03-10T14:29:58.881432+0000 mgr.gibba020.yqfnwy (mgr.34427) 1994 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:29:59.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[30381]: audit 2021-03-10T14:29:58.645820+0000 mon.a (mon.0) 1143 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:29:59.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[30381]: cephadm 2021-03-10T14:29:58.649663+0000 mgr.gibba020.yqfnwy (mgr.34427) 1982 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:29:59.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[30381]: cephadm 2021-03-10T14:29:58.651399+0000 mgr.gibba020.yqfnwy (mgr.34427) 1983 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:29:59.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[30381]: audit 2021-03-10T14:29:58.867850+0000 mon.a (mon.0) 1144 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:29:59.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[30381]: cephadm 2021-03-10T14:29:58.872862+0000 mgr.gibba020.yqfnwy (mgr.34427) 1984 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:29:59.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[30381]: cephadm 2021-03-10T14:29:58.874699+0000 mgr.gibba020.yqfnwy (mgr.34427) 1985 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:29:59.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[30381]: audit 2021-03-10T14:29:58.874839+0000 mon.a (mon.0) 1145 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:29:59.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[30381]: cephadm 2021-03-10T14:29:58.876134+0000 mgr.gibba020.yqfnwy (mgr.34427) 1986 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:29:59.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[30381]: cephadm 2021-03-10T14:29:58.876177+0000 mgr.gibba020.yqfnwy (mgr.34427) 1987 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:29:59.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[30381]: audit 2021-03-10T14:29:58.876331+0000 mon.a (mon.0) 1146 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:59.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[30381]: cephadm 2021-03-10T14:29:58.877402+0000 mgr.gibba020.yqfnwy (mgr.34427) 1988 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:29:59.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[30381]: cephadm 2021-03-10T14:29:58.877442+0000 mgr.gibba020.yqfnwy (mgr.34427) 1989 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:29:59.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[30381]: audit 2021-03-10T14:29:58.877815+0000 mon.a (mon.0) 1147 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:59.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[30381]: cephadm 2021-03-10T14:29:58.878441+0000 mgr.gibba020.yqfnwy (mgr.34427) 1990 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:29:59.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[30381]: audit 2021-03-10T14:29:58.878834+0000 mon.a (mon.0) 1148 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:59.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[30381]: cephadm 2021-03-10T14:29:58.879436+0000 mgr.gibba020.yqfnwy (mgr.34427) 1991 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:29:59.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[30381]: cephadm 2021-03-10T14:29:58.879486+0000 mgr.gibba020.yqfnwy (mgr.34427) 1992 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:29:59.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[30381]: cephadm 2021-03-10T14:29:58.881084+0000 mgr.gibba020.yqfnwy (mgr.34427) 1993 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:29:59.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[30381]: audit 2021-03-10T14:29:58.881188+0000 mon.a (mon.0) 1149 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:59.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[30381]: cephadm 2021-03-10T14:29:58.881432+0000 mgr.gibba020.yqfnwy (mgr.34427) 1994 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:29:59.390 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[29418]: cephadm 2021-03-10T14:29:58.882823+0000 mgr.gibba020.yqfnwy (mgr.34427) 1995 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:29:59.390 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[29418]: cephadm 2021-03-10T14:29:58.882867+0000 mgr.gibba020.yqfnwy (mgr.34427) 1996 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:29:59.391 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[29418]: cephadm 2021-03-10T14:29:58.882982+0000 mgr.gibba020.yqfnwy (mgr.34427) 1997 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:29:59.391 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[29418]: audit 2021-03-10T14:29:58.883059+0000 mon.a (mon.0) 1150 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:29:59.391 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[30381]: cephadm 2021-03-10T14:29:58.882823+0000 mgr.gibba020.yqfnwy (mgr.34427) 1995 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:29:59.391 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[30381]: cephadm 2021-03-10T14:29:58.882867+0000 mgr.gibba020.yqfnwy (mgr.34427) 1996 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:29:59.391 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[30381]: cephadm 2021-03-10T14:29:58.882982+0000 mgr.gibba020.yqfnwy (mgr.34427) 1997 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:29:59.392 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:29:59 gibba013 bash[30381]: audit 2021-03-10T14:29:58.883059+0000 mon.a (mon.0) 1150 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:00.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:00 gibba013 bash[29418]: debug 2021-03-10T14:29:59.994+0000 7fd718a82700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:30:00.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:00 gibba013 bash[29418]: cluster 2021-03-10T14:29:59.935732+0000 mgr.gibba020.yqfnwy (mgr.34427) 1998 : cluster [DBG] pgmap v1121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:00.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:00 gibba013 bash[29418]: cluster 2021-03-10T14:30:00.000240+0000 mon.a (mon.0) 1151 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:30:00.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:00 gibba013 bash[30381]: cluster 2021-03-10T14:29:59.935732+0000 mgr.gibba020.yqfnwy (mgr.34427) 1998 : cluster [DBG] pgmap v1121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:00.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:00 gibba013 bash[30381]: cluster 2021-03-10T14:30:00.000240+0000 mon.a (mon.0) 1151 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:30:00.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:00 gibba020 bash[25448]: cluster 2021-03-10T14:29:59.935732+0000 mgr.gibba020.yqfnwy (mgr.34427) 1998 : cluster [DBG] pgmap v1121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:00.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:00 gibba020 bash[25448]: cluster 2021-03-10T14:30:00.000240+0000 mon.a (mon.0) 1151 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:30:02.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:02 gibba013 bash[29418]: cluster 2021-03-10T14:30:01.936330+0000 mgr.gibba020.yqfnwy (mgr.34427) 1999 : cluster [DBG] pgmap v1122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:02.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:02 gibba013 bash[30381]: cluster 2021-03-10T14:30:01.936330+0000 mgr.gibba020.yqfnwy (mgr.34427) 1999 : cluster [DBG] pgmap v1122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:02.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:02 gibba020 bash[25448]: cluster 2021-03-10T14:30:01.936330+0000 mgr.gibba020.yqfnwy (mgr.34427) 1999 : cluster [DBG] pgmap v1122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:04.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:04 gibba013 bash[29418]: cluster 2021-03-10T14:30:03.937788+0000 mgr.gibba020.yqfnwy (mgr.34427) 2000 : cluster [DBG] pgmap v1123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:04.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:04 gibba013 bash[30381]: cluster 2021-03-10T14:30:03.937788+0000 mgr.gibba020.yqfnwy (mgr.34427) 2000 : cluster [DBG] pgmap v1123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:04.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:04 gibba020 bash[25448]: cluster 2021-03-10T14:30:03.937788+0000 mgr.gibba020.yqfnwy (mgr.34427) 2000 : cluster [DBG] pgmap v1123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:07.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:06 gibba013 bash[29418]: cluster 2021-03-10T14:30:05.939204+0000 mgr.gibba020.yqfnwy (mgr.34427) 2001 : cluster [DBG] pgmap v1124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:06 gibba013 bash[29418]: audit 2021-03-10T14:30:06.086023+0000 mon.a (mon.0) 1152 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:30:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:06 gibba013 bash[29418]: audit 2021-03-10T14:30:06.087137+0000 mon.a (mon.0) 1153 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:30:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:06 gibba013 bash[29418]: audit 2021-03-10T14:30:06.088165+0000 mon.a (mon.0) 1154 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T14:30:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:06 gibba013 bash[29418]: audit 2021-03-10T14:30:06.089249+0000 mon.a (mon.0) 1155 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:30:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:06 gibba013 bash[29418]: audit 2021-03-10T14:30:06.168319+0000 mon.a (mon.0) 1156 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:30:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:06 gibba013 bash[29418]: audit 2021-03-10T14:30:06.173902+0000 mon.a (mon.0) 1157 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:30:07.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:06 gibba013 bash[30381]: cluster 2021-03-10T14:30:05.939204+0000 mgr.gibba020.yqfnwy (mgr.34427) 2001 : cluster [DBG] pgmap v1124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:07.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:06 gibba013 bash[30381]: audit 2021-03-10T14:30:06.086023+0000 mon.a (mon.0) 1152 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:30:07.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:06 gibba013 bash[30381]: audit 2021-03-10T14:30:06.087137+0000 mon.a (mon.0) 1153 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:30:07.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:06 gibba013 bash[30381]: audit 2021-03-10T14:30:06.088165+0000 mon.a (mon.0) 1154 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T14:30:07.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:06 gibba013 bash[30381]: audit 2021-03-10T14:30:06.089249+0000 mon.a (mon.0) 1155 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:30:07.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:06 gibba013 bash[30381]: audit 2021-03-10T14:30:06.168319+0000 mon.a (mon.0) 1156 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:30:07.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:06 gibba013 bash[30381]: audit 2021-03-10T14:30:06.173902+0000 mon.a (mon.0) 1157 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:30:07.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:06 gibba020 bash[25448]: cluster 2021-03-10T14:30:05.939204+0000 mgr.gibba020.yqfnwy (mgr.34427) 2001 : cluster [DBG] pgmap v1124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:07.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:06 gibba020 bash[25448]: audit 2021-03-10T14:30:06.086023+0000 mon.a (mon.0) 1152 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:30:07.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:06 gibba020 bash[25448]: audit 2021-03-10T14:30:06.087137+0000 mon.a (mon.0) 1153 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:30:07.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:06 gibba020 bash[25448]: audit 2021-03-10T14:30:06.088165+0000 mon.a (mon.0) 1154 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T14:30:07.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:06 gibba020 bash[25448]: audit 2021-03-10T14:30:06.089249+0000 mon.a (mon.0) 1155 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:30:07.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:06 gibba020 bash[25448]: audit 2021-03-10T14:30:06.168319+0000 mon.a (mon.0) 1156 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:30:07.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:06 gibba020 bash[25448]: audit 2021-03-10T14:30:06.173902+0000 mon.a (mon.0) 1157 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:30:08.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:08 gibba013 bash[29418]: cluster 2021-03-10T14:30:07.940848+0000 mgr.gibba020.yqfnwy (mgr.34427) 2002 : cluster [DBG] pgmap v1125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:08.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:08 gibba013 bash[30381]: cluster 2021-03-10T14:30:07.940848+0000 mgr.gibba020.yqfnwy (mgr.34427) 2002 : cluster [DBG] pgmap v1125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:08.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:08 gibba020 bash[25448]: cluster 2021-03-10T14:30:07.940848+0000 mgr.gibba020.yqfnwy (mgr.34427) 2002 : cluster [DBG] pgmap v1125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:10.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:10 gibba013 bash[29418]: cluster 2021-03-10T14:30:09.942540+0000 mgr.gibba020.yqfnwy (mgr.34427) 2003 : cluster [DBG] pgmap v1126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:10.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:10 gibba013 bash[30381]: cluster 2021-03-10T14:30:09.942540+0000 mgr.gibba020.yqfnwy (mgr.34427) 2003 : cluster [DBG] pgmap v1126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:10.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:10 gibba020 bash[25448]: cluster 2021-03-10T14:30:09.942540+0000 mgr.gibba020.yqfnwy (mgr.34427) 2003 : cluster [DBG] pgmap v1126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:12.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:12 gibba013 bash[29418]: cluster 2021-03-10T14:30:11.943036+0000 mgr.gibba020.yqfnwy (mgr.34427) 2004 : cluster [DBG] pgmap v1127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:12.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:12 gibba013 bash[30381]: cluster 2021-03-10T14:30:11.943036+0000 mgr.gibba020.yqfnwy (mgr.34427) 2004 : cluster [DBG] pgmap v1127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:12.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:12 gibba020 bash[25448]: cluster 2021-03-10T14:30:11.943036+0000 mgr.gibba020.yqfnwy (mgr.34427) 2004 : cluster [DBG] pgmap v1127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:13.461 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:30:13.687 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:30:13.687 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (36m) 2m ago 42m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:30:13.688 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (41m) 75s ago 41m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:30:13.688 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (37m) 75s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:30:13.688 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (37m) 75s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:30:13.688 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (36m) 2m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:30:13.689 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (36m) 2m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:30:13.689 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (35m) 75s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:30:13.689 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (35m) 2m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:30:13.689 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (42m) 2m ago 42m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:30:13.689 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (42m) 75s ago 42m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:30:13.690 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (35m) 2m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:30:13.690 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (34m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:30:13.690 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (34m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:30:13.690 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (33m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:30:13.691 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (33m) 75s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:30:13.691 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (32m) 75s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:30:13.691 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (32m) 75s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:30:13.691 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (31m) 75s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:30:13.691 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (41m) 75s ago 42m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:30:13.692 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 75s ago 40m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:30:13.938 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:30:13.939 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:30:13.939 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:30:13.939 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:30:13.939 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:30:13.939 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:30:13.940 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:30:13.940 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:30:13.940 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:30:13.940 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:30:13.941 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:30:13.941 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:30:13.941 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:30:13.941 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:30:13.942 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:30:14.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:13 gibba020 bash[25448]: audit 2021-03-10T14:30:13.449317+0000 mgr.gibba020.yqfnwy (mgr.34427) 2005 : audit [DBG] from='client.55387 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:30:14.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:13 gibba020 bash[25448]: audit 2021-03-10T14:30:13.672762+0000 mgr.gibba020.yqfnwy (mgr.34427) 2006 : audit [DBG] from='client.55393 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:30:14.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:13 gibba020 bash[25448]: cephadm 2021-03-10T14:30:13.898971+0000 mgr.gibba020.yqfnwy (mgr.34427) 2007 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:30:14.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:13 gibba020 bash[25448]: audit 2021-03-10T14:30:13.937301+0000 mon.a (mon.0) 1158 : audit [DBG] from='client.? 172.21.2.113:0/2684284911' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:14.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:13 gibba020 bash[25448]: cluster 2021-03-10T14:30:13.944314+0000 mgr.gibba020.yqfnwy (mgr.34427) 2008 : cluster [DBG] pgmap v1128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:14.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:13 gibba013 bash[29418]: audit 2021-03-10T14:30:13.449317+0000 mgr.gibba020.yqfnwy (mgr.34427) 2005 : audit [DBG] from='client.55387 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:30:14.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:13 gibba013 bash[29418]: audit 2021-03-10T14:30:13.672762+0000 mgr.gibba020.yqfnwy (mgr.34427) 2006 : audit [DBG] from='client.55393 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:30:14.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:13 gibba013 bash[29418]: cephadm 2021-03-10T14:30:13.898971+0000 mgr.gibba020.yqfnwy (mgr.34427) 2007 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:30:14.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:13 gibba013 bash[29418]: audit 2021-03-10T14:30:13.937301+0000 mon.a (mon.0) 1158 : audit [DBG] from='client.? 172.21.2.113:0/2684284911' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:14.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:13 gibba013 bash[29418]: cluster 2021-03-10T14:30:13.944314+0000 mgr.gibba020.yqfnwy (mgr.34427) 2008 : cluster [DBG] pgmap v1128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:14.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:13 gibba013 bash[30381]: audit 2021-03-10T14:30:13.449317+0000 mgr.gibba020.yqfnwy (mgr.34427) 2005 : audit [DBG] from='client.55387 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:30:14.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:13 gibba013 bash[30381]: audit 2021-03-10T14:30:13.672762+0000 mgr.gibba020.yqfnwy (mgr.34427) 2006 : audit [DBG] from='client.55393 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:30:14.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:13 gibba013 bash[30381]: cephadm 2021-03-10T14:30:13.898971+0000 mgr.gibba020.yqfnwy (mgr.34427) 2007 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:30:14.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:13 gibba013 bash[30381]: audit 2021-03-10T14:30:13.937301+0000 mon.a (mon.0) 1158 : audit [DBG] from='client.? 172.21.2.113:0/2684284911' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:14.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:13 gibba013 bash[30381]: cluster 2021-03-10T14:30:13.944314+0000 mgr.gibba020.yqfnwy (mgr.34427) 2008 : cluster [DBG] pgmap v1128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:17.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:16 gibba013 bash[29418]: cluster 2021-03-10T14:30:15.945717+0000 mgr.gibba020.yqfnwy (mgr.34427) 2009 : cluster [DBG] pgmap v1129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:17.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:16 gibba013 bash[30381]: cluster 2021-03-10T14:30:15.945717+0000 mgr.gibba020.yqfnwy (mgr.34427) 2009 : cluster [DBG] pgmap v1129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:17.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:16 gibba020 bash[25448]: cluster 2021-03-10T14:30:15.945717+0000 mgr.gibba020.yqfnwy (mgr.34427) 2009 : cluster [DBG] pgmap v1129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:18.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:18 gibba013 bash[29418]: cluster 2021-03-10T14:30:17.947110+0000 mgr.gibba020.yqfnwy (mgr.34427) 2010 : cluster [DBG] pgmap v1130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:18.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:18 gibba013 bash[30381]: cluster 2021-03-10T14:30:17.947110+0000 mgr.gibba020.yqfnwy (mgr.34427) 2010 : cluster [DBG] pgmap v1130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:18.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:18 gibba020 bash[25448]: cluster 2021-03-10T14:30:17.947110+0000 mgr.gibba020.yqfnwy (mgr.34427) 2010 : cluster [DBG] pgmap v1130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:20.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:20 gibba013 bash[29418]: cluster 2021-03-10T14:30:19.949101+0000 mgr.gibba020.yqfnwy (mgr.34427) 2011 : cluster [DBG] pgmap v1131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:20.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:20 gibba013 bash[30381]: cluster 2021-03-10T14:30:19.949101+0000 mgr.gibba020.yqfnwy (mgr.34427) 2011 : cluster [DBG] pgmap v1131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:20.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:20 gibba020 bash[25448]: cluster 2021-03-10T14:30:19.949101+0000 mgr.gibba020.yqfnwy (mgr.34427) 2011 : cluster [DBG] pgmap v1131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:22.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:22 gibba013 bash[29418]: cluster 2021-03-10T14:30:21.950252+0000 mgr.gibba020.yqfnwy (mgr.34427) 2012 : cluster [DBG] pgmap v1132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:22.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:22 gibba013 bash[30381]: cluster 2021-03-10T14:30:21.950252+0000 mgr.gibba020.yqfnwy (mgr.34427) 2012 : cluster [DBG] pgmap v1132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:22.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:22 gibba020 bash[25448]: cluster 2021-03-10T14:30:21.950252+0000 mgr.gibba020.yqfnwy (mgr.34427) 2012 : cluster [DBG] pgmap v1132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:24.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:24 gibba013 bash[29418]: cluster 2021-03-10T14:30:23.951781+0000 mgr.gibba020.yqfnwy (mgr.34427) 2013 : cluster [DBG] pgmap v1133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:24.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:24 gibba013 bash[30381]: cluster 2021-03-10T14:30:23.951781+0000 mgr.gibba020.yqfnwy (mgr.34427) 2013 : cluster [DBG] pgmap v1133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:24.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:24 gibba020 bash[25448]: cluster 2021-03-10T14:30:23.951781+0000 mgr.gibba020.yqfnwy (mgr.34427) 2013 : cluster [DBG] pgmap v1133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:27.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:26 gibba013 bash[29418]: cluster 2021-03-10T14:30:25.953254+0000 mgr.gibba020.yqfnwy (mgr.34427) 2014 : cluster [DBG] pgmap v1134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:27.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:26 gibba013 bash[30381]: cluster 2021-03-10T14:30:25.953254+0000 mgr.gibba020.yqfnwy (mgr.34427) 2014 : cluster [DBG] pgmap v1134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:27.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:26 gibba020 bash[25448]: cluster 2021-03-10T14:30:25.953254+0000 mgr.gibba020.yqfnwy (mgr.34427) 2014 : cluster [DBG] pgmap v1134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:28.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:28 gibba013 bash[29418]: cluster 2021-03-10T14:30:27.954645+0000 mgr.gibba020.yqfnwy (mgr.34427) 2015 : cluster [DBG] pgmap v1135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:28.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:28 gibba013 bash[30381]: cluster 2021-03-10T14:30:27.954645+0000 mgr.gibba020.yqfnwy (mgr.34427) 2015 : cluster [DBG] pgmap v1135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:28.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:28 gibba020 bash[25448]: cluster 2021-03-10T14:30:27.954645+0000 mgr.gibba020.yqfnwy (mgr.34427) 2015 : cluster [DBG] pgmap v1135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:29.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:29 gibba020 bash[25448]: cephadm 2021-03-10T14:30:28.914962+0000 mgr.gibba020.yqfnwy (mgr.34427) 2016 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:30:29.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:29 gibba013 bash[29418]: cephadm 2021-03-10T14:30:28.914962+0000 mgr.gibba020.yqfnwy (mgr.34427) 2016 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:30:29.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:29 gibba013 bash[30381]: cephadm 2021-03-10T14:30:28.914962+0000 mgr.gibba020.yqfnwy (mgr.34427) 2016 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:30:30.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:30 gibba013 bash[29418]: cluster 2021-03-10T14:30:29.956615+0000 mgr.gibba020.yqfnwy (mgr.34427) 2017 : cluster [DBG] pgmap v1136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:30.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:30 gibba013 bash[30381]: cluster 2021-03-10T14:30:29.956615+0000 mgr.gibba020.yqfnwy (mgr.34427) 2017 : cluster [DBG] pgmap v1136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:30.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:30 gibba020 bash[25448]: cluster 2021-03-10T14:30:29.956615+0000 mgr.gibba020.yqfnwy (mgr.34427) 2017 : cluster [DBG] pgmap v1136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:32.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:32 gibba013 bash[29418]: cluster 2021-03-10T14:30:31.957219+0000 mgr.gibba020.yqfnwy (mgr.34427) 2018 : cluster [DBG] pgmap v1137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:32.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:32 gibba013 bash[30381]: cluster 2021-03-10T14:30:31.957219+0000 mgr.gibba020.yqfnwy (mgr.34427) 2018 : cluster [DBG] pgmap v1137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:32.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:32 gibba020 bash[25448]: cluster 2021-03-10T14:30:31.957219+0000 mgr.gibba020.yqfnwy (mgr.34427) 2018 : cluster [DBG] pgmap v1137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:34.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:34 gibba013 bash[29418]: cluster 2021-03-10T14:30:33.958676+0000 mgr.gibba020.yqfnwy (mgr.34427) 2019 : cluster [DBG] pgmap v1138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:34.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:34 gibba013 bash[30381]: cluster 2021-03-10T14:30:33.958676+0000 mgr.gibba020.yqfnwy (mgr.34427) 2019 : cluster [DBG] pgmap v1138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:34.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:34 gibba020 bash[25448]: cluster 2021-03-10T14:30:33.958676+0000 mgr.gibba020.yqfnwy (mgr.34427) 2019 : cluster [DBG] pgmap v1138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:37.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:36 gibba013 bash[29418]: cluster 2021-03-10T14:30:35.960107+0000 mgr.gibba020.yqfnwy (mgr.34427) 2020 : cluster [DBG] pgmap v1139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:37.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:36 gibba013 bash[30381]: cluster 2021-03-10T14:30:35.960107+0000 mgr.gibba020.yqfnwy (mgr.34427) 2020 : cluster [DBG] pgmap v1139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:37.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:36 gibba020 bash[25448]: cluster 2021-03-10T14:30:35.960107+0000 mgr.gibba020.yqfnwy (mgr.34427) 2020 : cluster [DBG] pgmap v1139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:38.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:38 gibba013 bash[29418]: cluster 2021-03-10T14:30:37.961707+0000 mgr.gibba020.yqfnwy (mgr.34427) 2021 : cluster [DBG] pgmap v1140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:38.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:38 gibba013 bash[30381]: cluster 2021-03-10T14:30:37.961707+0000 mgr.gibba020.yqfnwy (mgr.34427) 2021 : cluster [DBG] pgmap v1140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:38.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:38 gibba020 bash[25448]: cluster 2021-03-10T14:30:37.961707+0000 mgr.gibba020.yqfnwy (mgr.34427) 2021 : cluster [DBG] pgmap v1140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:40.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:40 gibba013 bash[29418]: cluster 2021-03-10T14:30:39.963475+0000 mgr.gibba020.yqfnwy (mgr.34427) 2022 : cluster [DBG] pgmap v1141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:40.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:40 gibba013 bash[30381]: cluster 2021-03-10T14:30:39.963475+0000 mgr.gibba020.yqfnwy (mgr.34427) 2022 : cluster [DBG] pgmap v1141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:40.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:40 gibba020 bash[25448]: cluster 2021-03-10T14:30:39.963475+0000 mgr.gibba020.yqfnwy (mgr.34427) 2022 : cluster [DBG] pgmap v1141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:42.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:42 gibba013 bash[29418]: cluster 2021-03-10T14:30:41.964003+0000 mgr.gibba020.yqfnwy (mgr.34427) 2023 : cluster [DBG] pgmap v1142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:42.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:42 gibba013 bash[30381]: cluster 2021-03-10T14:30:41.964003+0000 mgr.gibba020.yqfnwy (mgr.34427) 2023 : cluster [DBG] pgmap v1142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:42.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:42 gibba020 bash[25448]: cluster 2021-03-10T14:30:41.964003+0000 mgr.gibba020.yqfnwy (mgr.34427) 2023 : cluster [DBG] pgmap v1142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:44.184 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:30:44.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:44 gibba020 bash[25448]: cephadm 2021-03-10T14:30:43.919548+0000 mgr.gibba020.yqfnwy (mgr.34427) 2024 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:30:44.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:44 gibba020 bash[25448]: cluster 2021-03-10T14:30:43.965516+0000 mgr.gibba020.yqfnwy (mgr.34427) 2025 : cluster [DBG] pgmap v1143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:44.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:44 gibba013 bash[29418]: cephadm 2021-03-10T14:30:43.919548+0000 mgr.gibba020.yqfnwy (mgr.34427) 2024 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:30:44.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:44 gibba013 bash[29418]: cluster 2021-03-10T14:30:43.965516+0000 mgr.gibba020.yqfnwy (mgr.34427) 2025 : cluster [DBG] pgmap v1143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:44.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:44 gibba013 bash[30381]: cephadm 2021-03-10T14:30:43.919548+0000 mgr.gibba020.yqfnwy (mgr.34427) 2024 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:30:44.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:44 gibba013 bash[30381]: cluster 2021-03-10T14:30:43.965516+0000 mgr.gibba020.yqfnwy (mgr.34427) 2025 : cluster [DBG] pgmap v1143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:44.408 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:30:44.409 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (37m) 2m ago 42m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:30:44.409 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (42m) 106s ago 42m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:30:44.409 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (37m) 106s ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:30:44.409 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (37m) 106s ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:30:44.409 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (36m) 2m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:30:44.410 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (36m) 2m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:30:44.410 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (36m) 106s ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:30:44.410 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (36m) 2m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:30:44.410 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (42m) 2m ago 42m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:30:44.410 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (42m) 106s ago 42m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:30:44.411 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (35m) 2m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:30:44.411 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (35m) 2m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:30:44.411 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (34m) 2m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:30:44.411 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (34m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:30:44.411 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (33m) 106s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:30:44.412 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (33m) 106s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:30:44.412 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (32m) 106s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:30:44.412 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (32m) 106s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:30:44.412 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (42m) 106s ago 42m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:30:44.412 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 106s ago 40m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:30:44.658 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:30:44.658 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:30:44.658 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:30:44.658 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:30:44.659 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:30:44.659 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:30:44.659 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:30:44.659 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:30:44.659 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:30:44.660 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:30:44.660 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:30:44.660 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:30:44.660 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:30:44.660 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:30:44.661 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:30:45.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:45 gibba013 bash[29418]: audit 2021-03-10T14:30:44.172677+0000 mgr.gibba020.yqfnwy (mgr.34427) 2026 : audit [DBG] from='client.55405 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:30:45.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:45 gibba013 bash[29418]: audit 2021-03-10T14:30:44.394119+0000 mgr.gibba020.yqfnwy (mgr.34427) 2027 : audit [DBG] from='client.55411 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:30:45.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:45 gibba013 bash[29418]: audit 2021-03-10T14:30:44.656595+0000 mon.a (mon.0) 1159 : audit [DBG] from='client.? 172.21.2.113:0/3024267021' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:45.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:45 gibba013 bash[30381]: audit 2021-03-10T14:30:44.172677+0000 mgr.gibba020.yqfnwy (mgr.34427) 2026 : audit [DBG] from='client.55405 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:30:45.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:45 gibba013 bash[30381]: audit 2021-03-10T14:30:44.394119+0000 mgr.gibba020.yqfnwy (mgr.34427) 2027 : audit [DBG] from='client.55411 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:30:45.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:45 gibba013 bash[30381]: audit 2021-03-10T14:30:44.656595+0000 mon.a (mon.0) 1159 : audit [DBG] from='client.? 172.21.2.113:0/3024267021' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:45.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:45 gibba020 bash[25448]: audit 2021-03-10T14:30:44.172677+0000 mgr.gibba020.yqfnwy (mgr.34427) 2026 : audit [DBG] from='client.55405 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:30:45.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:45 gibba020 bash[25448]: audit 2021-03-10T14:30:44.394119+0000 mgr.gibba020.yqfnwy (mgr.34427) 2027 : audit [DBG] from='client.55411 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:30:45.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:45 gibba020 bash[25448]: audit 2021-03-10T14:30:44.656595+0000 mon.a (mon.0) 1159 : audit [DBG] from='client.? 172.21.2.113:0/3024267021' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:30:47.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:46 gibba013 bash[29418]: cluster 2021-03-10T14:30:45.966957+0000 mgr.gibba020.yqfnwy (mgr.34427) 2028 : cluster [DBG] pgmap v1144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:47.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:46 gibba013 bash[30381]: cluster 2021-03-10T14:30:45.966957+0000 mgr.gibba020.yqfnwy (mgr.34427) 2028 : cluster [DBG] pgmap v1144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:47.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:46 gibba020 bash[25448]: cluster 2021-03-10T14:30:45.966957+0000 mgr.gibba020.yqfnwy (mgr.34427) 2028 : cluster [DBG] pgmap v1144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:48.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:48 gibba013 bash[29418]: cluster 2021-03-10T14:30:47.968372+0000 mgr.gibba020.yqfnwy (mgr.34427) 2029 : cluster [DBG] pgmap v1145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:48.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:48 gibba013 bash[30381]: cluster 2021-03-10T14:30:47.968372+0000 mgr.gibba020.yqfnwy (mgr.34427) 2029 : cluster [DBG] pgmap v1145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:48.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:48 gibba020 bash[25448]: cluster 2021-03-10T14:30:47.968372+0000 mgr.gibba020.yqfnwy (mgr.34427) 2029 : cluster [DBG] pgmap v1145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:50.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:50 gibba013 bash[29418]: cluster 2021-03-10T14:30:49.970089+0000 mgr.gibba020.yqfnwy (mgr.34427) 2030 : cluster [DBG] pgmap v1146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:50.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:50 gibba013 bash[30381]: cluster 2021-03-10T14:30:49.970089+0000 mgr.gibba020.yqfnwy (mgr.34427) 2030 : cluster [DBG] pgmap v1146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:50.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:50 gibba020 bash[25448]: cluster 2021-03-10T14:30:49.970089+0000 mgr.gibba020.yqfnwy (mgr.34427) 2030 : cluster [DBG] pgmap v1146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:52.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:52 gibba013 bash[29418]: cluster 2021-03-10T14:30:51.970870+0000 mgr.gibba020.yqfnwy (mgr.34427) 2031 : cluster [DBG] pgmap v1147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:52.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:52 gibba013 bash[30381]: cluster 2021-03-10T14:30:51.970870+0000 mgr.gibba020.yqfnwy (mgr.34427) 2031 : cluster [DBG] pgmap v1147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:52.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:52 gibba020 bash[25448]: cluster 2021-03-10T14:30:51.970870+0000 mgr.gibba020.yqfnwy (mgr.34427) 2031 : cluster [DBG] pgmap v1147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:54.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:54 gibba013 bash[29418]: cluster 2021-03-10T14:30:53.972309+0000 mgr.gibba020.yqfnwy (mgr.34427) 2032 : cluster [DBG] pgmap v1148: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:54.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:54 gibba013 bash[30381]: cluster 2021-03-10T14:30:53.972309+0000 mgr.gibba020.yqfnwy (mgr.34427) 2032 : cluster [DBG] pgmap v1148: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:54.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:54 gibba020 bash[25448]: cluster 2021-03-10T14:30:53.972309+0000 mgr.gibba020.yqfnwy (mgr.34427) 2032 : cluster [DBG] pgmap v1148: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:57.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:56 gibba013 bash[29418]: cluster 2021-03-10T14:30:55.974046+0000 mgr.gibba020.yqfnwy (mgr.34427) 2033 : cluster [DBG] pgmap v1149: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:57.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:56 gibba013 bash[30381]: cluster 2021-03-10T14:30:55.974046+0000 mgr.gibba020.yqfnwy (mgr.34427) 2033 : cluster [DBG] pgmap v1149: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:57.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:56 gibba020 bash[25448]: cluster 2021-03-10T14:30:55.974046+0000 mgr.gibba020.yqfnwy (mgr.34427) 2033 : cluster [DBG] pgmap v1149: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:58.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:58 gibba013 bash[29418]: cluster 2021-03-10T14:30:57.975615+0000 mgr.gibba020.yqfnwy (mgr.34427) 2034 : cluster [DBG] pgmap v1150: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:58.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:58 gibba013 bash[30381]: cluster 2021-03-10T14:30:57.975615+0000 mgr.gibba020.yqfnwy (mgr.34427) 2034 : cluster [DBG] pgmap v1150: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:58.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:58 gibba020 bash[25448]: cluster 2021-03-10T14:30:57.975615+0000 mgr.gibba020.yqfnwy (mgr.34427) 2034 : cluster [DBG] pgmap v1150: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:30:59.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:59 gibba013 bash[29418]: audit 2021-03-10T14:30:58.937278+0000 mon.a (mon.0) 1160 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:30:59.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:59 gibba013 bash[29418]: cephadm 2021-03-10T14:30:58.940842+0000 mgr.gibba020.yqfnwy (mgr.34427) 2035 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:30:59.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:30:59 gibba013 bash[29418]: cephadm 2021-03-10T14:30:58.942766+0000 mgr.gibba020.yqfnwy (mgr.34427) 2036 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:30:59.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:59 gibba013 bash[30381]: audit 2021-03-10T14:30:58.937278+0000 mon.a (mon.0) 1160 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:30:59.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:59 gibba013 bash[30381]: cephadm 2021-03-10T14:30:58.940842+0000 mgr.gibba020.yqfnwy (mgr.34427) 2035 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:30:59.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:30:59 gibba013 bash[30381]: cephadm 2021-03-10T14:30:58.942766+0000 mgr.gibba020.yqfnwy (mgr.34427) 2036 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:30:59.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:59 gibba020 bash[25448]: audit 2021-03-10T14:30:58.937278+0000 mon.a (mon.0) 1160 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:30:59.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:59 gibba020 bash[25448]: cephadm 2021-03-10T14:30:58.940842+0000 mgr.gibba020.yqfnwy (mgr.34427) 2035 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:30:59.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:30:59 gibba020 bash[25448]: cephadm 2021-03-10T14:30:58.942766+0000 mgr.gibba020.yqfnwy (mgr.34427) 2036 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:31:00.173 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:00 gibba013 bash[30381]: audit 2021-03-10T14:30:59.164278+0000 mon.a (mon.0) 1161 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:31:00.173 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:00 gibba013 bash[30381]: cephadm 2021-03-10T14:30:59.165605+0000 mgr.gibba020.yqfnwy (mgr.34427) 2037 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:31:00.174 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:00 gibba013 bash[30381]: cephadm 2021-03-10T14:30:59.167211+0000 mgr.gibba020.yqfnwy (mgr.34427) 2038 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:31:00.174 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:00 gibba013 bash[30381]: audit 2021-03-10T14:30:59.167420+0000 mon.a (mon.0) 1162 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:31:00.174 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:00 gibba013 bash[30381]: cephadm 2021-03-10T14:30:59.168788+0000 mgr.gibba020.yqfnwy (mgr.34427) 2039 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:31:00.174 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:00 gibba013 bash[30381]: cephadm 2021-03-10T14:30:59.168824+0000 mgr.gibba020.yqfnwy (mgr.34427) 2040 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:31:00.175 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:00 gibba013 bash[30381]: audit 2021-03-10T14:30:59.168847+0000 mon.a (mon.0) 1163 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:00.175 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:00 gibba013 bash[30381]: cephadm 2021-03-10T14:30:59.170144+0000 mgr.gibba020.yqfnwy (mgr.34427) 2041 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:31:00.175 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:00 gibba013 bash[30381]: cephadm 2021-03-10T14:30:59.170187+0000 mgr.gibba020.yqfnwy (mgr.34427) 2042 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:31:00.175 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:00 gibba013 bash[30381]: audit 2021-03-10T14:30:59.170357+0000 mon.a (mon.0) 1164 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:00.176 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:00 gibba013 bash[30381]: cephadm 2021-03-10T14:30:59.171680+0000 mgr.gibba020.yqfnwy (mgr.34427) 2043 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:31:00.176 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:00 gibba013 bash[30381]: audit 2021-03-10T14:30:59.171827+0000 mon.a (mon.0) 1165 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:00.176 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:00 gibba013 bash[29418]: audit 2021-03-10T14:30:59.164278+0000 mon.a (mon.0) 1161 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:31:00.176 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:00 gibba013 bash[29418]: cephadm 2021-03-10T14:30:59.165605+0000 mgr.gibba020.yqfnwy (mgr.34427) 2037 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:31:00.177 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:00 gibba013 bash[29418]: cephadm 2021-03-10T14:30:59.167211+0000 mgr.gibba020.yqfnwy (mgr.34427) 2038 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:31:00.177 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:00 gibba013 bash[29418]: audit 2021-03-10T14:30:59.167420+0000 mon.a (mon.0) 1162 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:31:00.177 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:00 gibba013 bash[29418]: cephadm 2021-03-10T14:30:59.168788+0000 mgr.gibba020.yqfnwy (mgr.34427) 2039 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:31:00.177 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:00 gibba013 bash[29418]: cephadm 2021-03-10T14:30:59.168824+0000 mgr.gibba020.yqfnwy (mgr.34427) 2040 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:31:00.178 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:00 gibba013 bash[29418]: audit 2021-03-10T14:30:59.168847+0000 mon.a (mon.0) 1163 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:00.178 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:00 gibba013 bash[29418]: cephadm 2021-03-10T14:30:59.170144+0000 mgr.gibba020.yqfnwy (mgr.34427) 2041 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:31:00.178 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:00 gibba013 bash[29418]: cephadm 2021-03-10T14:30:59.170187+0000 mgr.gibba020.yqfnwy (mgr.34427) 2042 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:31:00.178 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:00 gibba013 bash[29418]: audit 2021-03-10T14:30:59.170357+0000 mon.a (mon.0) 1164 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:00.178 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:00 gibba013 bash[29418]: cephadm 2021-03-10T14:30:59.171680+0000 mgr.gibba020.yqfnwy (mgr.34427) 2043 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:31:00.179 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:00 gibba013 bash[29418]: audit 2021-03-10T14:30:59.171827+0000 mon.a (mon.0) 1165 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:00.179 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:00 gibba013 bash[29418]: cephadm 2021-03-10T14:30:59.172836+0000 mgr.gibba020.yqfnwy (mgr.34427) 2044 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:31:00.180 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:00 gibba013 bash[29418]: cephadm 2021-03-10T14:30:59.172873+0000 mgr.gibba020.yqfnwy (mgr.34427) 2045 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:31:00.180 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:00 gibba013 bash[29418]: cephadm 2021-03-10T14:30:59.174104+0000 mgr.gibba020.yqfnwy (mgr.34427) 2046 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:31:00.180 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:00 gibba013 bash[29418]: audit 2021-03-10T14:30:59.174357+0000 mon.a (mon.0) 1166 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:00.180 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:00 gibba013 bash[29418]: cephadm 2021-03-10T14:30:59.174449+0000 mgr.gibba020.yqfnwy (mgr.34427) 2047 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:31:00.181 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:00 gibba013 bash[29418]: cephadm 2021-03-10T14:30:59.175658+0000 mgr.gibba020.yqfnwy (mgr.34427) 2048 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:31:00.181 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:00 gibba013 bash[29418]: cephadm 2021-03-10T14:30:59.175700+0000 mgr.gibba020.yqfnwy (mgr.34427) 2049 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:31:00.181 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:00 gibba013 bash[29418]: cephadm 2021-03-10T14:30:59.175816+0000 mgr.gibba020.yqfnwy (mgr.34427) 2050 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:31:00.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:00 gibba020 bash[25448]: audit 2021-03-10T14:30:59.164278+0000 mon.a (mon.0) 1161 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:31:00.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:00 gibba020 bash[25448]: cephadm 2021-03-10T14:30:59.165605+0000 mgr.gibba020.yqfnwy (mgr.34427) 2037 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:31:00.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:00 gibba020 bash[25448]: cephadm 2021-03-10T14:30:59.167211+0000 mgr.gibba020.yqfnwy (mgr.34427) 2038 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:31:00.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:00 gibba020 bash[25448]: audit 2021-03-10T14:30:59.167420+0000 mon.a (mon.0) 1162 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:31:00.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:00 gibba020 bash[25448]: cephadm 2021-03-10T14:30:59.168788+0000 mgr.gibba020.yqfnwy (mgr.34427) 2039 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:31:00.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:00 gibba020 bash[25448]: cephadm 2021-03-10T14:30:59.168824+0000 mgr.gibba020.yqfnwy (mgr.34427) 2040 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:31:00.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:00 gibba020 bash[25448]: audit 2021-03-10T14:30:59.168847+0000 mon.a (mon.0) 1163 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:00.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:00 gibba020 bash[25448]: cephadm 2021-03-10T14:30:59.170144+0000 mgr.gibba020.yqfnwy (mgr.34427) 2041 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:31:00.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:00 gibba020 bash[25448]: cephadm 2021-03-10T14:30:59.170187+0000 mgr.gibba020.yqfnwy (mgr.34427) 2042 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:31:00.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:00 gibba020 bash[25448]: audit 2021-03-10T14:30:59.170357+0000 mon.a (mon.0) 1164 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:00.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:00 gibba020 bash[25448]: cephadm 2021-03-10T14:30:59.171680+0000 mgr.gibba020.yqfnwy (mgr.34427) 2043 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:31:00.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:00 gibba020 bash[25448]: audit 2021-03-10T14:30:59.171827+0000 mon.a (mon.0) 1165 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:00.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:00 gibba020 bash[25448]: cephadm 2021-03-10T14:30:59.172836+0000 mgr.gibba020.yqfnwy (mgr.34427) 2044 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:31:00.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:00 gibba020 bash[25448]: cephadm 2021-03-10T14:30:59.172873+0000 mgr.gibba020.yqfnwy (mgr.34427) 2045 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:31:00.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:00 gibba020 bash[25448]: cephadm 2021-03-10T14:30:59.174104+0000 mgr.gibba020.yqfnwy (mgr.34427) 2046 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:31:00.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:00 gibba020 bash[25448]: audit 2021-03-10T14:30:59.174357+0000 mon.a (mon.0) 1166 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:00.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:00 gibba020 bash[25448]: cephadm 2021-03-10T14:30:59.174449+0000 mgr.gibba020.yqfnwy (mgr.34427) 2047 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:31:00.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:00 gibba020 bash[25448]: cephadm 2021-03-10T14:30:59.175658+0000 mgr.gibba020.yqfnwy (mgr.34427) 2048 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:31:00.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:00 gibba020 bash[25448]: cephadm 2021-03-10T14:30:59.175700+0000 mgr.gibba020.yqfnwy (mgr.34427) 2049 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:31:00.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:00 gibba020 bash[25448]: cephadm 2021-03-10T14:30:59.175816+0000 mgr.gibba020.yqfnwy (mgr.34427) 2050 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:31:00.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:00 gibba020 bash[25448]: audit 2021-03-10T14:30:59.175975+0000 mon.a (mon.0) 1167 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:00.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:00 gibba020 bash[25448]: cluster 2021-03-10T14:30:59.977607+0000 mgr.gibba020.yqfnwy (mgr.34427) 2051 : cluster [DBG] pgmap v1151: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:00.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:00 gibba013 bash[29418]: audit 2021-03-10T14:30:59.175975+0000 mon.a (mon.0) 1167 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:00.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:00 gibba013 bash[29418]: cluster 2021-03-10T14:30:59.977607+0000 mgr.gibba020.yqfnwy (mgr.34427) 2051 : cluster [DBG] pgmap v1151: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:00.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:00 gibba013 bash[30381]: cephadm 2021-03-10T14:30:59.172836+0000 mgr.gibba020.yqfnwy (mgr.34427) 2044 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:31:00.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:00 gibba013 bash[30381]: cephadm 2021-03-10T14:30:59.172873+0000 mgr.gibba020.yqfnwy (mgr.34427) 2045 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:31:00.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:00 gibba013 bash[30381]: cephadm 2021-03-10T14:30:59.174104+0000 mgr.gibba020.yqfnwy (mgr.34427) 2046 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:31:00.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:00 gibba013 bash[30381]: audit 2021-03-10T14:30:59.174357+0000 mon.a (mon.0) 1166 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:00.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:00 gibba013 bash[30381]: cephadm 2021-03-10T14:30:59.174449+0000 mgr.gibba020.yqfnwy (mgr.34427) 2047 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:31:00.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:00 gibba013 bash[30381]: cephadm 2021-03-10T14:30:59.175658+0000 mgr.gibba020.yqfnwy (mgr.34427) 2048 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:31:00.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:00 gibba013 bash[30381]: cephadm 2021-03-10T14:30:59.175700+0000 mgr.gibba020.yqfnwy (mgr.34427) 2049 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:31:00.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:00 gibba013 bash[30381]: cephadm 2021-03-10T14:30:59.175816+0000 mgr.gibba020.yqfnwy (mgr.34427) 2050 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:31:00.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:00 gibba013 bash[30381]: audit 2021-03-10T14:30:59.175975+0000 mon.a (mon.0) 1167 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:00.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:00 gibba013 bash[30381]: cluster 2021-03-10T14:30:59.977607+0000 mgr.gibba020.yqfnwy (mgr.34427) 2051 : cluster [DBG] pgmap v1151: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:02.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:02 gibba013 bash[29418]: cluster 2021-03-10T14:31:01.978847+0000 mgr.gibba020.yqfnwy (mgr.34427) 2052 : cluster [DBG] pgmap v1152: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:02.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:02 gibba013 bash[30381]: cluster 2021-03-10T14:31:01.978847+0000 mgr.gibba020.yqfnwy (mgr.34427) 2052 : cluster [DBG] pgmap v1152: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:02.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:02 gibba020 bash[25448]: cluster 2021-03-10T14:31:01.978847+0000 mgr.gibba020.yqfnwy (mgr.34427) 2052 : cluster [DBG] pgmap v1152: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:04.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:04 gibba013 bash[29418]: cluster 2021-03-10T14:31:03.980421+0000 mgr.gibba020.yqfnwy (mgr.34427) 2053 : cluster [DBG] pgmap v1153: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:04.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:04 gibba013 bash[30381]: cluster 2021-03-10T14:31:03.980421+0000 mgr.gibba020.yqfnwy (mgr.34427) 2053 : cluster [DBG] pgmap v1153: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:04.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:04 gibba020 bash[25448]: cluster 2021-03-10T14:31:03.980421+0000 mgr.gibba020.yqfnwy (mgr.34427) 2053 : cluster [DBG] pgmap v1153: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:07.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:06 gibba013 bash[29418]: cluster 2021-03-10T14:31:05.981985+0000 mgr.gibba020.yqfnwy (mgr.34427) 2054 : cluster [DBG] pgmap v1154: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:06 gibba013 bash[29418]: audit 2021-03-10T14:31:06.097059+0000 mon.a (mon.0) 1168 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:31:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:06 gibba013 bash[29418]: audit 2021-03-10T14:31:06.097803+0000 mon.a (mon.0) 1169 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:31:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:06 gibba013 bash[29418]: audit 2021-03-10T14:31:06.098539+0000 mon.a (mon.0) 1170 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:31:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:06 gibba013 bash[29418]: audit 2021-03-10T14:31:06.099232+0000 mon.a (mon.0) 1171 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:31:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:06 gibba013 bash[29418]: audit 2021-03-10T14:31:06.174156+0000 mon.a (mon.0) 1172 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:31:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:06 gibba013 bash[29418]: audit 2021-03-10T14:31:06.178770+0000 mon.a (mon.0) 1173 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:31:07.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:06 gibba013 bash[30381]: cluster 2021-03-10T14:31:05.981985+0000 mgr.gibba020.yqfnwy (mgr.34427) 2054 : cluster [DBG] pgmap v1154: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:07.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:06 gibba013 bash[30381]: audit 2021-03-10T14:31:06.097059+0000 mon.a (mon.0) 1168 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:31:07.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:06 gibba013 bash[30381]: audit 2021-03-10T14:31:06.097803+0000 mon.a (mon.0) 1169 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:31:07.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:06 gibba013 bash[30381]: audit 2021-03-10T14:31:06.098539+0000 mon.a (mon.0) 1170 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:31:07.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:06 gibba013 bash[30381]: audit 2021-03-10T14:31:06.099232+0000 mon.a (mon.0) 1171 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:31:07.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:06 gibba013 bash[30381]: audit 2021-03-10T14:31:06.174156+0000 mon.a (mon.0) 1172 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:31:07.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:06 gibba013 bash[30381]: audit 2021-03-10T14:31:06.178770+0000 mon.a (mon.0) 1173 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:31:07.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:06 gibba020 bash[25448]: cluster 2021-03-10T14:31:05.981985+0000 mgr.gibba020.yqfnwy (mgr.34427) 2054 : cluster [DBG] pgmap v1154: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:07.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:06 gibba020 bash[25448]: audit 2021-03-10T14:31:06.097059+0000 mon.a (mon.0) 1168 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:31:07.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:06 gibba020 bash[25448]: audit 2021-03-10T14:31:06.097803+0000 mon.a (mon.0) 1169 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:31:07.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:06 gibba020 bash[25448]: audit 2021-03-10T14:31:06.098539+0000 mon.a (mon.0) 1170 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:31:07.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:06 gibba020 bash[25448]: audit 2021-03-10T14:31:06.099232+0000 mon.a (mon.0) 1171 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:31:07.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:06 gibba020 bash[25448]: audit 2021-03-10T14:31:06.174156+0000 mon.a (mon.0) 1172 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:31:07.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:06 gibba020 bash[25448]: audit 2021-03-10T14:31:06.178770+0000 mon.a (mon.0) 1173 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:31:08.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:08 gibba013 bash[29418]: cluster 2021-03-10T14:31:07.983573+0000 mgr.gibba020.yqfnwy (mgr.34427) 2055 : cluster [DBG] pgmap v1155: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:08.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:08 gibba013 bash[30381]: cluster 2021-03-10T14:31:07.983573+0000 mgr.gibba020.yqfnwy (mgr.34427) 2055 : cluster [DBG] pgmap v1155: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:08.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:08 gibba020 bash[25448]: cluster 2021-03-10T14:31:07.983573+0000 mgr.gibba020.yqfnwy (mgr.34427) 2055 : cluster [DBG] pgmap v1155: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:10.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:10 gibba013 bash[29418]: cluster 2021-03-10T14:31:09.985414+0000 mgr.gibba020.yqfnwy (mgr.34427) 2056 : cluster [DBG] pgmap v1156: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:10.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:10 gibba013 bash[30381]: cluster 2021-03-10T14:31:09.985414+0000 mgr.gibba020.yqfnwy (mgr.34427) 2056 : cluster [DBG] pgmap v1156: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:10.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:10 gibba020 bash[25448]: cluster 2021-03-10T14:31:09.985414+0000 mgr.gibba020.yqfnwy (mgr.34427) 2056 : cluster [DBG] pgmap v1156: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:12.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:12 gibba013 bash[29418]: cluster 2021-03-10T14:31:11.986478+0000 mgr.gibba020.yqfnwy (mgr.34427) 2057 : cluster [DBG] pgmap v1157: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:12.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:12 gibba013 bash[30381]: cluster 2021-03-10T14:31:11.986478+0000 mgr.gibba020.yqfnwy (mgr.34427) 2057 : cluster [DBG] pgmap v1157: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:12.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:12 gibba020 bash[25448]: cluster 2021-03-10T14:31:11.986478+0000 mgr.gibba020.yqfnwy (mgr.34427) 2057 : cluster [DBG] pgmap v1157: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:14.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:14 gibba013 bash[29418]: cluster 2021-03-10T14:31:13.988223+0000 mgr.gibba020.yqfnwy (mgr.34427) 2058 : cluster [DBG] pgmap v1158: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:14.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:14 gibba013 bash[30381]: cluster 2021-03-10T14:31:13.988223+0000 mgr.gibba020.yqfnwy (mgr.34427) 2058 : cluster [DBG] pgmap v1158: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:14.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:14 gibba020 bash[25448]: cluster 2021-03-10T14:31:13.988223+0000 mgr.gibba020.yqfnwy (mgr.34427) 2058 : cluster [DBG] pgmap v1158: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:14.900 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:31:15.125 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:31:15.125 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (37m) 3m ago 43m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:31:15.126 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (42m) 2m ago 42m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:31:15.126 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (38m) 2m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:31:15.126 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (38m) 2m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:31:15.126 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (37m) 3m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:31:15.127 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (37m) 3m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:31:15.127 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (36m) 2m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:31:15.127 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (36m) 3m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:31:15.127 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (43m) 3m ago 43m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:31:15.128 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (43m) 2m ago 43m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:31:15.128 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (36m) 3m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:31:15.128 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (35m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:31:15.128 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (35m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:31:15.128 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (34m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:31:15.129 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (34m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:31:15.129 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (33m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:31:15.129 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (33m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:31:15.129 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (33m) 2m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:31:15.130 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (42m) 2m ago 43m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:31:15.130 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 41m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:31:15.373 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:31:15.374 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:31:15.374 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:31:15.374 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:31:15.374 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:31:15.375 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:31:15.375 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:31:15.375 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:31:15.375 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:31:15.375 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:31:15.376 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:31:15.376 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:31:15.376 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:31:15.376 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:31:15.376 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:31:15.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:15 gibba013 bash[29418]: cephadm 2021-03-10T14:31:14.191281+0000 mgr.gibba020.yqfnwy (mgr.34427) 2059 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:31:15.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:15 gibba013 bash[29418]: audit 2021-03-10T14:31:14.889430+0000 mgr.gibba020.yqfnwy (mgr.34427) 2060 : audit [DBG] from='client.45438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:31:15.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:15 gibba013 bash[30381]: cephadm 2021-03-10T14:31:14.191281+0000 mgr.gibba020.yqfnwy (mgr.34427) 2059 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:31:15.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:15 gibba013 bash[30381]: audit 2021-03-10T14:31:14.889430+0000 mgr.gibba020.yqfnwy (mgr.34427) 2060 : audit [DBG] from='client.45438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:31:15.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:15 gibba020 bash[25448]: cephadm 2021-03-10T14:31:14.191281+0000 mgr.gibba020.yqfnwy (mgr.34427) 2059 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:31:15.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:15 gibba020 bash[25448]: audit 2021-03-10T14:31:14.889430+0000 mgr.gibba020.yqfnwy (mgr.34427) 2060 : audit [DBG] from='client.45438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:31:16.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:16 gibba013 bash[29418]: audit 2021-03-10T14:31:15.112810+0000 mgr.gibba020.yqfnwy (mgr.34427) 2061 : audit [DBG] from='client.55429 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:31:16.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:16 gibba013 bash[29418]: audit 2021-03-10T14:31:15.372410+0000 mon.c (mon.1) 43 : audit [DBG] from='client.? 172.21.2.113:0/3809591171' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:16.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:16 gibba013 bash[29418]: cluster 2021-03-10T14:31:15.989947+0000 mgr.gibba020.yqfnwy (mgr.34427) 2062 : cluster [DBG] pgmap v1159: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:16.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:16 gibba013 bash[30381]: audit 2021-03-10T14:31:15.112810+0000 mgr.gibba020.yqfnwy (mgr.34427) 2061 : audit [DBG] from='client.55429 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:31:16.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:16 gibba013 bash[30381]: audit 2021-03-10T14:31:15.372410+0000 mon.c (mon.1) 43 : audit [DBG] from='client.? 172.21.2.113:0/3809591171' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:16.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:16 gibba013 bash[30381]: cluster 2021-03-10T14:31:15.989947+0000 mgr.gibba020.yqfnwy (mgr.34427) 2062 : cluster [DBG] pgmap v1159: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:16.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:16 gibba020 bash[25448]: audit 2021-03-10T14:31:15.112810+0000 mgr.gibba020.yqfnwy (mgr.34427) 2061 : audit [DBG] from='client.55429 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:31:16.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:16 gibba020 bash[25448]: audit 2021-03-10T14:31:15.372410+0000 mon.c (mon.1) 43 : audit [DBG] from='client.? 172.21.2.113:0/3809591171' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:16.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:16 gibba020 bash[25448]: cluster 2021-03-10T14:31:15.989947+0000 mgr.gibba020.yqfnwy (mgr.34427) 2062 : cluster [DBG] pgmap v1159: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:18.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:18 gibba013 bash[29418]: cluster 2021-03-10T14:31:17.991538+0000 mgr.gibba020.yqfnwy (mgr.34427) 2063 : cluster [DBG] pgmap v1160: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:18.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:18 gibba013 bash[30381]: cluster 2021-03-10T14:31:17.991538+0000 mgr.gibba020.yqfnwy (mgr.34427) 2063 : cluster [DBG] pgmap v1160: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:18.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:18 gibba020 bash[25448]: cluster 2021-03-10T14:31:17.991538+0000 mgr.gibba020.yqfnwy (mgr.34427) 2063 : cluster [DBG] pgmap v1160: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:20.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:20 gibba013 bash[29418]: cluster 2021-03-10T14:31:19.993518+0000 mgr.gibba020.yqfnwy (mgr.34427) 2064 : cluster [DBG] pgmap v1161: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:20.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:20 gibba013 bash[30381]: cluster 2021-03-10T14:31:19.993518+0000 mgr.gibba020.yqfnwy (mgr.34427) 2064 : cluster [DBG] pgmap v1161: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:20.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:20 gibba020 bash[25448]: cluster 2021-03-10T14:31:19.993518+0000 mgr.gibba020.yqfnwy (mgr.34427) 2064 : cluster [DBG] pgmap v1161: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:22.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:22 gibba013 bash[29418]: cluster 2021-03-10T14:31:21.994416+0000 mgr.gibba020.yqfnwy (mgr.34427) 2065 : cluster [DBG] pgmap v1162: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:22.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:22 gibba013 bash[30381]: cluster 2021-03-10T14:31:21.994416+0000 mgr.gibba020.yqfnwy (mgr.34427) 2065 : cluster [DBG] pgmap v1162: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:22.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:22 gibba020 bash[25448]: cluster 2021-03-10T14:31:21.994416+0000 mgr.gibba020.yqfnwy (mgr.34427) 2065 : cluster [DBG] pgmap v1162: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:24.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:24 gibba013 bash[29418]: cluster 2021-03-10T14:31:23.996074+0000 mgr.gibba020.yqfnwy (mgr.34427) 2066 : cluster [DBG] pgmap v1163: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:24.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:24 gibba013 bash[30381]: cluster 2021-03-10T14:31:23.996074+0000 mgr.gibba020.yqfnwy (mgr.34427) 2066 : cluster [DBG] pgmap v1163: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:24.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:24 gibba020 bash[25448]: cluster 2021-03-10T14:31:23.996074+0000 mgr.gibba020.yqfnwy (mgr.34427) 2066 : cluster [DBG] pgmap v1163: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:27.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:26 gibba013 bash[29418]: cluster 2021-03-10T14:31:25.997771+0000 mgr.gibba020.yqfnwy (mgr.34427) 2067 : cluster [DBG] pgmap v1164: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:27.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:26 gibba013 bash[30381]: cluster 2021-03-10T14:31:25.997771+0000 mgr.gibba020.yqfnwy (mgr.34427) 2067 : cluster [DBG] pgmap v1164: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:27.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:26 gibba020 bash[25448]: cluster 2021-03-10T14:31:25.997771+0000 mgr.gibba020.yqfnwy (mgr.34427) 2067 : cluster [DBG] pgmap v1164: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:28.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:28 gibba013 bash[29418]: cluster 2021-03-10T14:31:27.999133+0000 mgr.gibba020.yqfnwy (mgr.34427) 2068 : cluster [DBG] pgmap v1165: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:28.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:28 gibba013 bash[30381]: cluster 2021-03-10T14:31:27.999133+0000 mgr.gibba020.yqfnwy (mgr.34427) 2068 : cluster [DBG] pgmap v1165: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:28.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:28 gibba020 bash[25448]: cluster 2021-03-10T14:31:27.999133+0000 mgr.gibba020.yqfnwy (mgr.34427) 2068 : cluster [DBG] pgmap v1165: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:30.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:30 gibba013 bash[29418]: cephadm 2021-03-10T14:31:29.206955+0000 mgr.gibba020.yqfnwy (mgr.34427) 2069 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:31:30.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:30 gibba013 bash[29418]: cluster 2021-03-10T14:31:30.001162+0000 mgr.gibba020.yqfnwy (mgr.34427) 2070 : cluster [DBG] pgmap v1166: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:30.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:30 gibba013 bash[30381]: cephadm 2021-03-10T14:31:29.206955+0000 mgr.gibba020.yqfnwy (mgr.34427) 2069 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:31:30.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:30 gibba013 bash[30381]: cluster 2021-03-10T14:31:30.001162+0000 mgr.gibba020.yqfnwy (mgr.34427) 2070 : cluster [DBG] pgmap v1166: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:30.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:30 gibba020 bash[25448]: cephadm 2021-03-10T14:31:29.206955+0000 mgr.gibba020.yqfnwy (mgr.34427) 2069 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:31:30.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:30 gibba020 bash[25448]: cluster 2021-03-10T14:31:30.001162+0000 mgr.gibba020.yqfnwy (mgr.34427) 2070 : cluster [DBG] pgmap v1166: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:32.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:32 gibba013 bash[29418]: cluster 2021-03-10T14:31:32.002015+0000 mgr.gibba020.yqfnwy (mgr.34427) 2071 : cluster [DBG] pgmap v1167: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:32.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:32 gibba013 bash[30381]: cluster 2021-03-10T14:31:32.002015+0000 mgr.gibba020.yqfnwy (mgr.34427) 2071 : cluster [DBG] pgmap v1167: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:32.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:32 gibba020 bash[25448]: cluster 2021-03-10T14:31:32.002015+0000 mgr.gibba020.yqfnwy (mgr.34427) 2071 : cluster [DBG] pgmap v1167: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:34.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:34 gibba013 bash[29418]: cluster 2021-03-10T14:31:34.003457+0000 mgr.gibba020.yqfnwy (mgr.34427) 2072 : cluster [DBG] pgmap v1168: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:34.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:34 gibba013 bash[30381]: cluster 2021-03-10T14:31:34.003457+0000 mgr.gibba020.yqfnwy (mgr.34427) 2072 : cluster [DBG] pgmap v1168: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:34.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:34 gibba020 bash[25448]: cluster 2021-03-10T14:31:34.003457+0000 mgr.gibba020.yqfnwy (mgr.34427) 2072 : cluster [DBG] pgmap v1168: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:38.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:37 gibba013 bash[29418]: cluster 2021-03-10T14:31:36.005129+0000 mgr.gibba020.yqfnwy (mgr.34427) 2073 : cluster [DBG] pgmap v1169: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:38.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:37 gibba013 bash[30381]: cluster 2021-03-10T14:31:36.005129+0000 mgr.gibba020.yqfnwy (mgr.34427) 2073 : cluster [DBG] pgmap v1169: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:38.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:37 gibba020 bash[25448]: cluster 2021-03-10T14:31:36.005129+0000 mgr.gibba020.yqfnwy (mgr.34427) 2073 : cluster [DBG] pgmap v1169: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:40.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:39 gibba013 bash[29418]: cluster 2021-03-10T14:31:38.006436+0000 mgr.gibba020.yqfnwy (mgr.34427) 2074 : cluster [DBG] pgmap v1170: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:40.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:39 gibba013 bash[30381]: cluster 2021-03-10T14:31:38.006436+0000 mgr.gibba020.yqfnwy (mgr.34427) 2074 : cluster [DBG] pgmap v1170: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:40.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:39 gibba020 bash[25448]: cluster 2021-03-10T14:31:38.006436+0000 mgr.gibba020.yqfnwy (mgr.34427) 2074 : cluster [DBG] pgmap v1170: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:42.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:41 gibba013 bash[29418]: cluster 2021-03-10T14:31:40.006996+0000 mgr.gibba020.yqfnwy (mgr.34427) 2075 : cluster [DBG] pgmap v1171: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:42.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:41 gibba013 bash[30381]: cluster 2021-03-10T14:31:40.006996+0000 mgr.gibba020.yqfnwy (mgr.34427) 2075 : cluster [DBG] pgmap v1171: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:42.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:41 gibba020 bash[25448]: cluster 2021-03-10T14:31:40.006996+0000 mgr.gibba020.yqfnwy (mgr.34427) 2075 : cluster [DBG] pgmap v1171: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:44.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:43 gibba013 bash[29418]: cluster 2021-03-10T14:31:42.007914+0000 mgr.gibba020.yqfnwy (mgr.34427) 2076 : cluster [DBG] pgmap v1172: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:44.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:43 gibba013 bash[30381]: cluster 2021-03-10T14:31:42.007914+0000 mgr.gibba020.yqfnwy (mgr.34427) 2076 : cluster [DBG] pgmap v1172: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:44.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:43 gibba020 bash[25448]: cluster 2021-03-10T14:31:42.007914+0000 mgr.gibba020.yqfnwy (mgr.34427) 2076 : cluster [DBG] pgmap v1172: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:45.616 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:31:45.844 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:31:45.844 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (38m) 3m ago 43m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:31:45.844 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (43m) 2m ago 43m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:31:45.845 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (38m) 2m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:31:45.845 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (38m) 2m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:31:45.845 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (37m) 3m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:31:45.845 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (37m) 3m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:31:45.846 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (37m) 2m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:31:45.846 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (37m) 3m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:31:45.846 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (43m) 3m ago 43m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:31:45.846 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (43m) 2m ago 43m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:31:45.846 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (36m) 3m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:31:45.847 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (36m) 3m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:31:45.847 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (35m) 3m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:31:45.847 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (35m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:31:45.847 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (34m) 2m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:31:45.847 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (34m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:31:45.848 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (33m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:31:45.848 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (33m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:31:45.848 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (43m) 2m ago 43m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:31:45.848 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 41m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:31:46.093 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:31:46.093 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:31:46.094 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:31:46.094 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:31:46.094 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:31:46.094 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:31:46.095 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:31:46.095 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:31:46.095 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:31:46.095 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:31:46.095 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:31:46.096 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:31:46.096 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:31:46.096 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:31:46.096 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:31:46.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:45 gibba013 bash[29418]: cluster 2021-03-10T14:31:44.009281+0000 mgr.gibba020.yqfnwy (mgr.34427) 2077 : cluster [DBG] pgmap v1173: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:46.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:45 gibba013 bash[29418]: cephadm 2021-03-10T14:31:44.212521+0000 mgr.gibba020.yqfnwy (mgr.34427) 2078 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:31:46.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:45 gibba013 bash[30381]: cluster 2021-03-10T14:31:44.009281+0000 mgr.gibba020.yqfnwy (mgr.34427) 2077 : cluster [DBG] pgmap v1173: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:46.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:45 gibba013 bash[30381]: cephadm 2021-03-10T14:31:44.212521+0000 mgr.gibba020.yqfnwy (mgr.34427) 2078 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:31:46.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:45 gibba020 bash[25448]: cluster 2021-03-10T14:31:44.009281+0000 mgr.gibba020.yqfnwy (mgr.34427) 2077 : cluster [DBG] pgmap v1173: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:46.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:45 gibba020 bash[25448]: cephadm 2021-03-10T14:31:44.212521+0000 mgr.gibba020.yqfnwy (mgr.34427) 2078 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:31:47.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:46 gibba013 bash[29418]: audit 2021-03-10T14:31:45.604891+0000 mgr.gibba020.yqfnwy (mgr.34427) 2079 : audit [DBG] from='client.45456 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:31:47.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:46 gibba013 bash[29418]: audit 2021-03-10T14:31:45.829868+0000 mgr.gibba020.yqfnwy (mgr.34427) 2080 : audit [DBG] from='client.45462 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:31:47.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:46 gibba013 bash[29418]: audit 2021-03-10T14:31:46.092478+0000 mon.c (mon.1) 44 : audit [DBG] from='client.? 172.21.2.113:0/712465365' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:47.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:46 gibba013 bash[30381]: audit 2021-03-10T14:31:45.604891+0000 mgr.gibba020.yqfnwy (mgr.34427) 2079 : audit [DBG] from='client.45456 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:31:47.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:46 gibba013 bash[30381]: audit 2021-03-10T14:31:45.829868+0000 mgr.gibba020.yqfnwy (mgr.34427) 2080 : audit [DBG] from='client.45462 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:31:47.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:46 gibba013 bash[30381]: audit 2021-03-10T14:31:46.092478+0000 mon.c (mon.1) 44 : audit [DBG] from='client.? 172.21.2.113:0/712465365' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:47.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:46 gibba020 bash[25448]: audit 2021-03-10T14:31:45.604891+0000 mgr.gibba020.yqfnwy (mgr.34427) 2079 : audit [DBG] from='client.45456 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:31:47.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:46 gibba020 bash[25448]: audit 2021-03-10T14:31:45.829868+0000 mgr.gibba020.yqfnwy (mgr.34427) 2080 : audit [DBG] from='client.45462 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:31:47.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:46 gibba020 bash[25448]: audit 2021-03-10T14:31:46.092478+0000 mon.c (mon.1) 44 : audit [DBG] from='client.? 172.21.2.113:0/712465365' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:31:48.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:47 gibba013 bash[29418]: cluster 2021-03-10T14:31:46.010814+0000 mgr.gibba020.yqfnwy (mgr.34427) 2081 : cluster [DBG] pgmap v1174: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:48.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:47 gibba013 bash[30381]: cluster 2021-03-10T14:31:46.010814+0000 mgr.gibba020.yqfnwy (mgr.34427) 2081 : cluster [DBG] pgmap v1174: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:48.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:47 gibba020 bash[25448]: cluster 2021-03-10T14:31:46.010814+0000 mgr.gibba020.yqfnwy (mgr.34427) 2081 : cluster [DBG] pgmap v1174: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:50.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:49 gibba013 bash[29418]: cluster 2021-03-10T14:31:48.012338+0000 mgr.gibba020.yqfnwy (mgr.34427) 2082 : cluster [DBG] pgmap v1175: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:50.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:49 gibba013 bash[30381]: cluster 2021-03-10T14:31:48.012338+0000 mgr.gibba020.yqfnwy (mgr.34427) 2082 : cluster [DBG] pgmap v1175: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:50.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:49 gibba020 bash[25448]: cluster 2021-03-10T14:31:48.012338+0000 mgr.gibba020.yqfnwy (mgr.34427) 2082 : cluster [DBG] pgmap v1175: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:52.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:51 gibba013 bash[29418]: cluster 2021-03-10T14:31:50.013038+0000 mgr.gibba020.yqfnwy (mgr.34427) 2083 : cluster [DBG] pgmap v1176: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:52.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:51 gibba013 bash[30381]: cluster 2021-03-10T14:31:50.013038+0000 mgr.gibba020.yqfnwy (mgr.34427) 2083 : cluster [DBG] pgmap v1176: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:52.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:51 gibba020 bash[25448]: cluster 2021-03-10T14:31:50.013038+0000 mgr.gibba020.yqfnwy (mgr.34427) 2083 : cluster [DBG] pgmap v1176: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:54.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:53 gibba020 bash[25448]: cluster 2021-03-10T14:31:52.014053+0000 mgr.gibba020.yqfnwy (mgr.34427) 2084 : cluster [DBG] pgmap v1177: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:54.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:53 gibba013 bash[29418]: cluster 2021-03-10T14:31:52.014053+0000 mgr.gibba020.yqfnwy (mgr.34427) 2084 : cluster [DBG] pgmap v1177: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:54.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:53 gibba013 bash[30381]: cluster 2021-03-10T14:31:52.014053+0000 mgr.gibba020.yqfnwy (mgr.34427) 2084 : cluster [DBG] pgmap v1177: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:56.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:55 gibba020 bash[25448]: cluster 2021-03-10T14:31:54.015695+0000 mgr.gibba020.yqfnwy (mgr.34427) 2085 : cluster [DBG] pgmap v1178: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:56.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:55 gibba013 bash[29418]: cluster 2021-03-10T14:31:54.015695+0000 mgr.gibba020.yqfnwy (mgr.34427) 2085 : cluster [DBG] pgmap v1178: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:56.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:55 gibba013 bash[30381]: cluster 2021-03-10T14:31:54.015695+0000 mgr.gibba020.yqfnwy (mgr.34427) 2085 : cluster [DBG] pgmap v1178: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:58.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:57 gibba020 bash[25448]: cluster 2021-03-10T14:31:56.017248+0000 mgr.gibba020.yqfnwy (mgr.34427) 2086 : cluster [DBG] pgmap v1179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:58.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:57 gibba013 bash[29418]: cluster 2021-03-10T14:31:56.017248+0000 mgr.gibba020.yqfnwy (mgr.34427) 2086 : cluster [DBG] pgmap v1179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:31:58.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:57 gibba013 bash[30381]: cluster 2021-03-10T14:31:56.017248+0000 mgr.gibba020.yqfnwy (mgr.34427) 2086 : cluster [DBG] pgmap v1179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:00.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:59 gibba020 bash[25448]: cluster 2021-03-10T14:31:58.018536+0000 mgr.gibba020.yqfnwy (mgr.34427) 2087 : cluster [DBG] pgmap v1180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:00.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:59 gibba020 bash[25448]: audit 2021-03-10T14:31:59.222293+0000 mon.a (mon.0) 1174 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:32:00.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:59 gibba020 bash[25448]: audit 2021-03-10T14:31:59.450562+0000 mon.a (mon.0) 1175 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:32:00.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:59 gibba020 bash[25448]: audit 2021-03-10T14:31:59.454182+0000 mon.a (mon.0) 1176 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:32:00.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:59 gibba020 bash[25448]: audit 2021-03-10T14:31:59.459477+0000 mon.a (mon.0) 1177 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:00.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:59 gibba020 bash[25448]: audit 2021-03-10T14:31:59.465321+0000 mon.a (mon.0) 1178 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:00.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:59 gibba020 bash[25448]: audit 2021-03-10T14:31:59.470863+0000 mon.a (mon.0) 1179 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:00.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:59 gibba020 bash[25448]: audit 2021-03-10T14:31:59.481251+0000 mon.a (mon.0) 1180 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:00.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:31:59 gibba020 bash[25448]: audit 2021-03-10T14:31:59.488673+0000 mon.a (mon.0) 1181 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:00.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:59 gibba013 bash[29418]: cluster 2021-03-10T14:31:58.018536+0000 mgr.gibba020.yqfnwy (mgr.34427) 2087 : cluster [DBG] pgmap v1180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:00.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:59 gibba013 bash[29418]: audit 2021-03-10T14:31:59.222293+0000 mon.a (mon.0) 1174 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:32:00.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:59 gibba013 bash[29418]: audit 2021-03-10T14:31:59.450562+0000 mon.a (mon.0) 1175 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:32:00.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:59 gibba013 bash[29418]: audit 2021-03-10T14:31:59.454182+0000 mon.a (mon.0) 1176 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:32:00.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:59 gibba013 bash[29418]: audit 2021-03-10T14:31:59.459477+0000 mon.a (mon.0) 1177 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:00.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:59 gibba013 bash[29418]: audit 2021-03-10T14:31:59.465321+0000 mon.a (mon.0) 1178 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:00.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:59 gibba013 bash[29418]: audit 2021-03-10T14:31:59.470863+0000 mon.a (mon.0) 1179 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:00.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:59 gibba013 bash[29418]: audit 2021-03-10T14:31:59.481251+0000 mon.a (mon.0) 1180 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:00.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:31:59 gibba013 bash[29418]: audit 2021-03-10T14:31:59.488673+0000 mon.a (mon.0) 1181 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:00.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:59 gibba013 bash[30381]: cluster 2021-03-10T14:31:58.018536+0000 mgr.gibba020.yqfnwy (mgr.34427) 2087 : cluster [DBG] pgmap v1180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:00.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:59 gibba013 bash[30381]: audit 2021-03-10T14:31:59.222293+0000 mon.a (mon.0) 1174 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:32:00.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:59 gibba013 bash[30381]: audit 2021-03-10T14:31:59.450562+0000 mon.a (mon.0) 1175 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:32:00.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:59 gibba013 bash[30381]: audit 2021-03-10T14:31:59.454182+0000 mon.a (mon.0) 1176 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:32:00.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:59 gibba013 bash[30381]: audit 2021-03-10T14:31:59.459477+0000 mon.a (mon.0) 1177 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:00.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:59 gibba013 bash[30381]: audit 2021-03-10T14:31:59.465321+0000 mon.a (mon.0) 1178 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:00.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:59 gibba013 bash[30381]: audit 2021-03-10T14:31:59.470863+0000 mon.a (mon.0) 1179 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:00.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:59 gibba013 bash[30381]: audit 2021-03-10T14:31:59.481251+0000 mon.a (mon.0) 1180 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:00.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:31:59 gibba013 bash[30381]: audit 2021-03-10T14:31:59.488673+0000 mon.a (mon.0) 1181 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:01.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:00 gibba020 bash[25448]: cephadm 2021-03-10T14:31:59.225436+0000 mgr.gibba020.yqfnwy (mgr.34427) 2088 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:32:01.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:00 gibba020 bash[25448]: cephadm 2021-03-10T14:31:59.226108+0000 mgr.gibba020.yqfnwy (mgr.34427) 2089 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:32:01.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:00 gibba020 bash[25448]: cephadm 2021-03-10T14:31:59.452238+0000 mgr.gibba020.yqfnwy (mgr.34427) 2090 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:32:01.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:00 gibba020 bash[25448]: cephadm 2021-03-10T14:31:59.457108+0000 mgr.gibba020.yqfnwy (mgr.34427) 2091 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:32:01.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:00 gibba020 bash[25448]: cephadm 2021-03-10T14:31:59.462180+0000 mgr.gibba020.yqfnwy (mgr.34427) 2092 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:32:01.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:00 gibba020 bash[25448]: cephadm 2021-03-10T14:31:59.462671+0000 mgr.gibba020.yqfnwy (mgr.34427) 2093 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:32:01.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:00 gibba020 bash[25448]: cephadm 2021-03-10T14:31:59.468179+0000 mgr.gibba020.yqfnwy (mgr.34427) 2094 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:32:01.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:00 gibba020 bash[25448]: cephadm 2021-03-10T14:31:59.468712+0000 mgr.gibba020.yqfnwy (mgr.34427) 2095 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:32:01.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:00 gibba020 bash[25448]: cephadm 2021-03-10T14:31:59.473451+0000 mgr.gibba020.yqfnwy (mgr.34427) 2096 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:32:01.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:00 gibba020 bash[25448]: cephadm 2021-03-10T14:31:59.477649+0000 mgr.gibba020.yqfnwy (mgr.34427) 2097 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:32:01.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:00 gibba020 bash[25448]: cephadm 2021-03-10T14:31:59.478277+0000 mgr.gibba020.yqfnwy (mgr.34427) 2098 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:32:01.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:00 gibba020 bash[25448]: cephadm 2021-03-10T14:31:59.484203+0000 mgr.gibba020.yqfnwy (mgr.34427) 2099 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:32:01.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:00 gibba020 bash[25448]: cephadm 2021-03-10T14:31:59.486308+0000 mgr.gibba020.yqfnwy (mgr.34427) 2100 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:32:01.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:00 gibba020 bash[25448]: cephadm 2021-03-10T14:31:59.490617+0000 mgr.gibba020.yqfnwy (mgr.34427) 2101 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:32:01.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:00 gibba020 bash[25448]: cephadm 2021-03-10T14:31:59.490918+0000 mgr.gibba020.yqfnwy (mgr.34427) 2102 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:32:01.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:00 gibba020 bash[25448]: cephadm 2021-03-10T14:31:59.491671+0000 mgr.gibba020.yqfnwy (mgr.34427) 2103 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:32:01.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:00 gibba013 bash[30381]: cephadm 2021-03-10T14:31:59.225436+0000 mgr.gibba020.yqfnwy (mgr.34427) 2088 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:32:01.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:00 gibba013 bash[30381]: cephadm 2021-03-10T14:31:59.226108+0000 mgr.gibba020.yqfnwy (mgr.34427) 2089 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:32:01.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:00 gibba013 bash[30381]: cephadm 2021-03-10T14:31:59.452238+0000 mgr.gibba020.yqfnwy (mgr.34427) 2090 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:32:01.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:00 gibba013 bash[30381]: cephadm 2021-03-10T14:31:59.457108+0000 mgr.gibba020.yqfnwy (mgr.34427) 2091 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:32:01.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:00 gibba013 bash[30381]: cephadm 2021-03-10T14:31:59.462180+0000 mgr.gibba020.yqfnwy (mgr.34427) 2092 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:32:01.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:00 gibba013 bash[30381]: cephadm 2021-03-10T14:31:59.462671+0000 mgr.gibba020.yqfnwy (mgr.34427) 2093 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:32:01.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:00 gibba013 bash[30381]: cephadm 2021-03-10T14:31:59.468179+0000 mgr.gibba020.yqfnwy (mgr.34427) 2094 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:32:01.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:00 gibba013 bash[30381]: cephadm 2021-03-10T14:31:59.468712+0000 mgr.gibba020.yqfnwy (mgr.34427) 2095 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:32:01.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:00 gibba013 bash[30381]: cephadm 2021-03-10T14:31:59.473451+0000 mgr.gibba020.yqfnwy (mgr.34427) 2096 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:32:01.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:00 gibba013 bash[30381]: cephadm 2021-03-10T14:31:59.477649+0000 mgr.gibba020.yqfnwy (mgr.34427) 2097 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:32:01.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:00 gibba013 bash[30381]: cephadm 2021-03-10T14:31:59.478277+0000 mgr.gibba020.yqfnwy (mgr.34427) 2098 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:32:01.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:00 gibba013 bash[30381]: cephadm 2021-03-10T14:31:59.484203+0000 mgr.gibba020.yqfnwy (mgr.34427) 2099 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:32:01.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:00 gibba013 bash[30381]: cephadm 2021-03-10T14:31:59.486308+0000 mgr.gibba020.yqfnwy (mgr.34427) 2100 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:32:01.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:00 gibba013 bash[30381]: cephadm 2021-03-10T14:31:59.490617+0000 mgr.gibba020.yqfnwy (mgr.34427) 2101 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:32:01.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:00 gibba013 bash[30381]: cephadm 2021-03-10T14:31:59.490918+0000 mgr.gibba020.yqfnwy (mgr.34427) 2102 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:32:01.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:00 gibba013 bash[30381]: cephadm 2021-03-10T14:31:59.491671+0000 mgr.gibba020.yqfnwy (mgr.34427) 2103 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:32:01.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:00 gibba013 bash[29418]: cephadm 2021-03-10T14:31:59.225436+0000 mgr.gibba020.yqfnwy (mgr.34427) 2088 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:32:01.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:00 gibba013 bash[29418]: cephadm 2021-03-10T14:31:59.226108+0000 mgr.gibba020.yqfnwy (mgr.34427) 2089 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:32:01.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:00 gibba013 bash[29418]: cephadm 2021-03-10T14:31:59.452238+0000 mgr.gibba020.yqfnwy (mgr.34427) 2090 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:32:01.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:00 gibba013 bash[29418]: cephadm 2021-03-10T14:31:59.457108+0000 mgr.gibba020.yqfnwy (mgr.34427) 2091 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:32:01.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:00 gibba013 bash[29418]: cephadm 2021-03-10T14:31:59.462180+0000 mgr.gibba020.yqfnwy (mgr.34427) 2092 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:32:01.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:00 gibba013 bash[29418]: cephadm 2021-03-10T14:31:59.462671+0000 mgr.gibba020.yqfnwy (mgr.34427) 2093 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:32:01.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:00 gibba013 bash[29418]: cephadm 2021-03-10T14:31:59.468179+0000 mgr.gibba020.yqfnwy (mgr.34427) 2094 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:32:01.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:00 gibba013 bash[29418]: cephadm 2021-03-10T14:31:59.468712+0000 mgr.gibba020.yqfnwy (mgr.34427) 2095 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:32:01.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:00 gibba013 bash[29418]: cephadm 2021-03-10T14:31:59.473451+0000 mgr.gibba020.yqfnwy (mgr.34427) 2096 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:32:01.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:00 gibba013 bash[29418]: cephadm 2021-03-10T14:31:59.477649+0000 mgr.gibba020.yqfnwy (mgr.34427) 2097 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:32:01.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:00 gibba013 bash[29418]: cephadm 2021-03-10T14:31:59.478277+0000 mgr.gibba020.yqfnwy (mgr.34427) 2098 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:32:01.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:00 gibba013 bash[29418]: cephadm 2021-03-10T14:31:59.484203+0000 mgr.gibba020.yqfnwy (mgr.34427) 2099 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:32:01.387 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:00 gibba013 bash[29418]: cephadm 2021-03-10T14:31:59.486308+0000 mgr.gibba020.yqfnwy (mgr.34427) 2100 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:32:01.387 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:00 gibba013 bash[29418]: cephadm 2021-03-10T14:31:59.490617+0000 mgr.gibba020.yqfnwy (mgr.34427) 2101 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:32:01.387 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:00 gibba013 bash[29418]: cephadm 2021-03-10T14:31:59.490918+0000 mgr.gibba020.yqfnwy (mgr.34427) 2102 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:32:01.387 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:00 gibba013 bash[29418]: cephadm 2021-03-10T14:31:59.491671+0000 mgr.gibba020.yqfnwy (mgr.34427) 2103 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:32:02.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:01 gibba020 bash[25448]: cluster 2021-03-10T14:32:00.019099+0000 mgr.gibba020.yqfnwy (mgr.34427) 2104 : cluster [DBG] pgmap v1181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:02.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:01 gibba013 bash[29418]: cluster 2021-03-10T14:32:00.019099+0000 mgr.gibba020.yqfnwy (mgr.34427) 2104 : cluster [DBG] pgmap v1181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:02.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:01 gibba013 bash[30381]: cluster 2021-03-10T14:32:00.019099+0000 mgr.gibba020.yqfnwy (mgr.34427) 2104 : cluster [DBG] pgmap v1181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:04.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:03 gibba020 bash[25448]: cluster 2021-03-10T14:32:02.020290+0000 mgr.gibba020.yqfnwy (mgr.34427) 2105 : cluster [DBG] pgmap v1182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:04.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:03 gibba013 bash[29418]: cluster 2021-03-10T14:32:02.020290+0000 mgr.gibba020.yqfnwy (mgr.34427) 2105 : cluster [DBG] pgmap v1182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:04.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:03 gibba013 bash[30381]: cluster 2021-03-10T14:32:02.020290+0000 mgr.gibba020.yqfnwy (mgr.34427) 2105 : cluster [DBG] pgmap v1182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:06.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:05 gibba020 bash[25448]: cluster 2021-03-10T14:32:04.021304+0000 mgr.gibba020.yqfnwy (mgr.34427) 2106 : cluster [DBG] pgmap v1183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:06.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:05 gibba013 bash[29418]: cluster 2021-03-10T14:32:04.021304+0000 mgr.gibba020.yqfnwy (mgr.34427) 2106 : cluster [DBG] pgmap v1183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:06.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:05 gibba013 bash[30381]: cluster 2021-03-10T14:32:04.021304+0000 mgr.gibba020.yqfnwy (mgr.34427) 2106 : cluster [DBG] pgmap v1183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:07.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:06 gibba013 bash[29418]: audit 2021-03-10T14:32:06.106862+0000 mon.a (mon.0) 1182 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T14:32:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:06 gibba013 bash[29418]: audit 2021-03-10T14:32:06.107639+0000 mon.a (mon.0) 1183 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:32:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:06 gibba013 bash[29418]: audit 2021-03-10T14:32:06.108348+0000 mon.a (mon.0) 1184 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:32:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:06 gibba013 bash[29418]: audit 2021-03-10T14:32:06.109072+0000 mon.a (mon.0) 1185 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:32:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:06 gibba013 bash[29418]: audit 2021-03-10T14:32:06.178725+0000 mon.a (mon.0) 1186 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:32:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:06 gibba013 bash[29418]: audit 2021-03-10T14:32:06.182740+0000 mon.a (mon.0) 1187 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:32:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:06 gibba013 bash[30381]: audit 2021-03-10T14:32:06.106862+0000 mon.a (mon.0) 1182 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T14:32:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:06 gibba013 bash[30381]: audit 2021-03-10T14:32:06.107639+0000 mon.a (mon.0) 1183 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:32:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:06 gibba013 bash[30381]: audit 2021-03-10T14:32:06.108348+0000 mon.a (mon.0) 1184 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:32:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:06 gibba013 bash[30381]: audit 2021-03-10T14:32:06.109072+0000 mon.a (mon.0) 1185 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:32:07.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:06 gibba013 bash[30381]: audit 2021-03-10T14:32:06.178725+0000 mon.a (mon.0) 1186 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:32:07.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:06 gibba013 bash[30381]: audit 2021-03-10T14:32:06.182740+0000 mon.a (mon.0) 1187 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:32:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:06 gibba020 bash[25448]: audit 2021-03-10T14:32:06.106862+0000 mon.a (mon.0) 1182 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T14:32:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:06 gibba020 bash[25448]: audit 2021-03-10T14:32:06.107639+0000 mon.a (mon.0) 1183 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:32:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:06 gibba020 bash[25448]: audit 2021-03-10T14:32:06.108348+0000 mon.a (mon.0) 1184 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:32:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:06 gibba020 bash[25448]: audit 2021-03-10T14:32:06.109072+0000 mon.a (mon.0) 1185 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:32:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:06 gibba020 bash[25448]: audit 2021-03-10T14:32:06.178725+0000 mon.a (mon.0) 1186 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:32:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:06 gibba020 bash[25448]: audit 2021-03-10T14:32:06.182740+0000 mon.a (mon.0) 1187 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:32:08.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:07 gibba013 bash[29418]: cluster 2021-03-10T14:32:06.022595+0000 mgr.gibba020.yqfnwy (mgr.34427) 2107 : cluster [DBG] pgmap v1184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:08.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:07 gibba013 bash[30381]: cluster 2021-03-10T14:32:06.022595+0000 mgr.gibba020.yqfnwy (mgr.34427) 2107 : cluster [DBG] pgmap v1184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:08.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:07 gibba020 bash[25448]: cluster 2021-03-10T14:32:06.022595+0000 mgr.gibba020.yqfnwy (mgr.34427) 2107 : cluster [DBG] pgmap v1184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:10.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:09 gibba013 bash[29418]: cluster 2021-03-10T14:32:08.024024+0000 mgr.gibba020.yqfnwy (mgr.34427) 2108 : cluster [DBG] pgmap v1185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:10.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:09 gibba013 bash[30381]: cluster 2021-03-10T14:32:08.024024+0000 mgr.gibba020.yqfnwy (mgr.34427) 2108 : cluster [DBG] pgmap v1185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:10.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:09 gibba020 bash[25448]: cluster 2021-03-10T14:32:08.024024+0000 mgr.gibba020.yqfnwy (mgr.34427) 2108 : cluster [DBG] pgmap v1185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:12.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:11 gibba013 bash[29418]: cluster 2021-03-10T14:32:10.024901+0000 mgr.gibba020.yqfnwy (mgr.34427) 2109 : cluster [DBG] pgmap v1186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:12.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:11 gibba013 bash[30381]: cluster 2021-03-10T14:32:10.024901+0000 mgr.gibba020.yqfnwy (mgr.34427) 2109 : cluster [DBG] pgmap v1186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:12.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:11 gibba020 bash[25448]: cluster 2021-03-10T14:32:10.024901+0000 mgr.gibba020.yqfnwy (mgr.34427) 2109 : cluster [DBG] pgmap v1186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:14.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:13 gibba013 bash[29418]: cluster 2021-03-10T14:32:12.025426+0000 mgr.gibba020.yqfnwy (mgr.34427) 2110 : cluster [DBG] pgmap v1187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:14.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:13 gibba013 bash[30381]: cluster 2021-03-10T14:32:12.025426+0000 mgr.gibba020.yqfnwy (mgr.34427) 2110 : cluster [DBG] pgmap v1187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:14.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:13 gibba020 bash[25448]: cluster 2021-03-10T14:32:12.025426+0000 mgr.gibba020.yqfnwy (mgr.34427) 2110 : cluster [DBG] pgmap v1187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:16.339 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:32:16.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:15 gibba013 bash[29418]: cluster 2021-03-10T14:32:14.026704+0000 mgr.gibba020.yqfnwy (mgr.34427) 2111 : cluster [DBG] pgmap v1188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:16.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:15 gibba013 bash[29418]: cephadm 2021-03-10T14:32:14.507980+0000 mgr.gibba020.yqfnwy (mgr.34427) 2112 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:32:16.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:15 gibba013 bash[30381]: cluster 2021-03-10T14:32:14.026704+0000 mgr.gibba020.yqfnwy (mgr.34427) 2111 : cluster [DBG] pgmap v1188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:16.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:15 gibba013 bash[30381]: cephadm 2021-03-10T14:32:14.507980+0000 mgr.gibba020.yqfnwy (mgr.34427) 2112 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:32:16.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:15 gibba020 bash[25448]: cluster 2021-03-10T14:32:14.026704+0000 mgr.gibba020.yqfnwy (mgr.34427) 2111 : cluster [DBG] pgmap v1188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:16.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:15 gibba020 bash[25448]: cephadm 2021-03-10T14:32:14.507980+0000 mgr.gibba020.yqfnwy (mgr.34427) 2112 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:32:16.572 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:32:16.572 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (38m) 4m ago 44m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:32:16.573 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (43m) 3m ago 43m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:32:16.573 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (39m) 3m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:32:16.573 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (39m) 3m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:32:16.573 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (38m) 4m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:32:16.573 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (38m) 4m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:32:16.574 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (37m) 3m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:32:16.574 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (38m) 4m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:32:16.574 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (44m) 4m ago 44m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:32:16.574 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (44m) 3m ago 44m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:32:16.575 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (37m) 4m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:32:16.575 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (36m) 4m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:32:16.575 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (36m) 4m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:32:16.575 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (35m) 4m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:32:16.575 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (35m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:32:16.576 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (34m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:32:16.576 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (34m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:32:16.576 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (34m) 3m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:32:16.576 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (43m) 3m ago 44m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:32:16.576 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 3m ago 42m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:32:16.831 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:32:16.832 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:32:16.832 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:32:16.832 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:32:16.832 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:32:16.833 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:32:16.833 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:32:16.833 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:32:16.833 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:32:16.833 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:32:16.834 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:32:16.834 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:32:16.834 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:32:16.834 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:32:16.835 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:32:17.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:17 gibba013 bash[29418]: audit 2021-03-10T14:32:16.830767+0000 mon.c (mon.1) 45 : audit [DBG] from='client.? 172.21.2.113:0/3164861117' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:17.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:17 gibba013 bash[30381]: audit 2021-03-10T14:32:16.830767+0000 mon.c (mon.1) 45 : audit [DBG] from='client.? 172.21.2.113:0/3164861117' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:17.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:17 gibba020 bash[25448]: audit 2021-03-10T14:32:16.830767+0000 mon.c (mon.1) 45 : audit [DBG] from='client.? 172.21.2.113:0/3164861117' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:18.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:18 gibba013 bash[29418]: cluster 2021-03-10T14:32:16.027503+0000 mgr.gibba020.yqfnwy (mgr.34427) 2113 : cluster [DBG] pgmap v1189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:18.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:18 gibba013 bash[29418]: audit 2021-03-10T14:32:16.328607+0000 mgr.gibba020.yqfnwy (mgr.34427) 2114 : audit [DBG] from='client.45474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:32:18.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:18 gibba013 bash[29418]: audit 2021-03-10T14:32:16.557929+0000 mgr.gibba020.yqfnwy (mgr.34427) 2115 : audit [DBG] from='client.55465 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:32:18.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:18 gibba013 bash[30381]: cluster 2021-03-10T14:32:16.027503+0000 mgr.gibba020.yqfnwy (mgr.34427) 2113 : cluster [DBG] pgmap v1189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:18.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:18 gibba013 bash[30381]: audit 2021-03-10T14:32:16.328607+0000 mgr.gibba020.yqfnwy (mgr.34427) 2114 : audit [DBG] from='client.45474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:32:18.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:18 gibba013 bash[30381]: audit 2021-03-10T14:32:16.557929+0000 mgr.gibba020.yqfnwy (mgr.34427) 2115 : audit [DBG] from='client.55465 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:32:18.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:18 gibba020 bash[25448]: cluster 2021-03-10T14:32:16.027503+0000 mgr.gibba020.yqfnwy (mgr.34427) 2113 : cluster [DBG] pgmap v1189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:18.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:18 gibba020 bash[25448]: audit 2021-03-10T14:32:16.328607+0000 mgr.gibba020.yqfnwy (mgr.34427) 2114 : audit [DBG] from='client.45474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:32:18.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:18 gibba020 bash[25448]: audit 2021-03-10T14:32:16.557929+0000 mgr.gibba020.yqfnwy (mgr.34427) 2115 : audit [DBG] from='client.55465 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:32:20.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:20 gibba013 bash[29418]: cluster 2021-03-10T14:32:18.028114+0000 mgr.gibba020.yqfnwy (mgr.34427) 2116 : cluster [DBG] pgmap v1190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:20.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:20 gibba013 bash[30381]: cluster 2021-03-10T14:32:18.028114+0000 mgr.gibba020.yqfnwy (mgr.34427) 2116 : cluster [DBG] pgmap v1190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:20.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:20 gibba020 bash[25448]: cluster 2021-03-10T14:32:18.028114+0000 mgr.gibba020.yqfnwy (mgr.34427) 2116 : cluster [DBG] pgmap v1190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:22.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:22 gibba013 bash[29418]: cluster 2021-03-10T14:32:20.028634+0000 mgr.gibba020.yqfnwy (mgr.34427) 2117 : cluster [DBG] pgmap v1191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:22.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:22 gibba013 bash[30381]: cluster 2021-03-10T14:32:20.028634+0000 mgr.gibba020.yqfnwy (mgr.34427) 2117 : cluster [DBG] pgmap v1191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:22.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:22 gibba020 bash[25448]: cluster 2021-03-10T14:32:20.028634+0000 mgr.gibba020.yqfnwy (mgr.34427) 2117 : cluster [DBG] pgmap v1191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:23.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:23 gibba013 bash[29418]: cluster 2021-03-10T14:32:22.029877+0000 mgr.gibba020.yqfnwy (mgr.34427) 2118 : cluster [DBG] pgmap v1192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:23.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:23 gibba013 bash[30381]: cluster 2021-03-10T14:32:22.029877+0000 mgr.gibba020.yqfnwy (mgr.34427) 2118 : cluster [DBG] pgmap v1192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:23.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:23 gibba020 bash[25448]: cluster 2021-03-10T14:32:22.029877+0000 mgr.gibba020.yqfnwy (mgr.34427) 2118 : cluster [DBG] pgmap v1192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:25.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:25 gibba013 bash[29418]: cluster 2021-03-10T14:32:24.031613+0000 mgr.gibba020.yqfnwy (mgr.34427) 2119 : cluster [DBG] pgmap v1193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:25.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:25 gibba013 bash[30381]: cluster 2021-03-10T14:32:24.031613+0000 mgr.gibba020.yqfnwy (mgr.34427) 2119 : cluster [DBG] pgmap v1193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:25.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:25 gibba020 bash[25448]: cluster 2021-03-10T14:32:24.031613+0000 mgr.gibba020.yqfnwy (mgr.34427) 2119 : cluster [DBG] pgmap v1193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:28.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:27 gibba013 bash[29418]: cluster 2021-03-10T14:32:26.033376+0000 mgr.gibba020.yqfnwy (mgr.34427) 2120 : cluster [DBG] pgmap v1194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:28.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:27 gibba013 bash[30381]: cluster 2021-03-10T14:32:26.033376+0000 mgr.gibba020.yqfnwy (mgr.34427) 2120 : cluster [DBG] pgmap v1194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:28.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:27 gibba020 bash[25448]: cluster 2021-03-10T14:32:26.033376+0000 mgr.gibba020.yqfnwy (mgr.34427) 2120 : cluster [DBG] pgmap v1194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:30.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:29 gibba013 bash[29418]: cluster 2021-03-10T14:32:28.034630+0000 mgr.gibba020.yqfnwy (mgr.34427) 2121 : cluster [DBG] pgmap v1195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:30.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:29 gibba013 bash[30381]: cluster 2021-03-10T14:32:28.034630+0000 mgr.gibba020.yqfnwy (mgr.34427) 2121 : cluster [DBG] pgmap v1195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:30.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:29 gibba020 bash[25448]: cluster 2021-03-10T14:32:28.034630+0000 mgr.gibba020.yqfnwy (mgr.34427) 2121 : cluster [DBG] pgmap v1195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:31.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:30 gibba013 bash[29418]: cephadm 2021-03-10T14:32:29.524060+0000 mgr.gibba020.yqfnwy (mgr.34427) 2122 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:32:31.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:30 gibba013 bash[30381]: cephadm 2021-03-10T14:32:29.524060+0000 mgr.gibba020.yqfnwy (mgr.34427) 2122 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:32:31.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:30 gibba020 bash[25448]: cephadm 2021-03-10T14:32:29.524060+0000 mgr.gibba020.yqfnwy (mgr.34427) 2122 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:32:32.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:31 gibba013 bash[29418]: cluster 2021-03-10T14:32:30.036493+0000 mgr.gibba020.yqfnwy (mgr.34427) 2123 : cluster [DBG] pgmap v1196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:32.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:31 gibba013 bash[30381]: cluster 2021-03-10T14:32:30.036493+0000 mgr.gibba020.yqfnwy (mgr.34427) 2123 : cluster [DBG] pgmap v1196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:32.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:31 gibba020 bash[25448]: cluster 2021-03-10T14:32:30.036493+0000 mgr.gibba020.yqfnwy (mgr.34427) 2123 : cluster [DBG] pgmap v1196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:34.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:33 gibba013 bash[29418]: cluster 2021-03-10T14:32:32.037872+0000 mgr.gibba020.yqfnwy (mgr.34427) 2124 : cluster [DBG] pgmap v1197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:34.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:33 gibba013 bash[30381]: cluster 2021-03-10T14:32:32.037872+0000 mgr.gibba020.yqfnwy (mgr.34427) 2124 : cluster [DBG] pgmap v1197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:34.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:33 gibba020 bash[25448]: cluster 2021-03-10T14:32:32.037872+0000 mgr.gibba020.yqfnwy (mgr.34427) 2124 : cluster [DBG] pgmap v1197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:36.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:35 gibba013 bash[29418]: cluster 2021-03-10T14:32:34.039382+0000 mgr.gibba020.yqfnwy (mgr.34427) 2125 : cluster [DBG] pgmap v1198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:36.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:35 gibba013 bash[30381]: cluster 2021-03-10T14:32:34.039382+0000 mgr.gibba020.yqfnwy (mgr.34427) 2125 : cluster [DBG] pgmap v1198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:36.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:35 gibba020 bash[25448]: cluster 2021-03-10T14:32:34.039382+0000 mgr.gibba020.yqfnwy (mgr.34427) 2125 : cluster [DBG] pgmap v1198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:38.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:37 gibba020 bash[25448]: cluster 2021-03-10T14:32:36.041247+0000 mgr.gibba020.yqfnwy (mgr.34427) 2126 : cluster [DBG] pgmap v1199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:38.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:37 gibba013 bash[29418]: cluster 2021-03-10T14:32:36.041247+0000 mgr.gibba020.yqfnwy (mgr.34427) 2126 : cluster [DBG] pgmap v1199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:38.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:37 gibba013 bash[30381]: cluster 2021-03-10T14:32:36.041247+0000 mgr.gibba020.yqfnwy (mgr.34427) 2126 : cluster [DBG] pgmap v1199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:40.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:39 gibba020 bash[25448]: cluster 2021-03-10T14:32:38.042518+0000 mgr.gibba020.yqfnwy (mgr.34427) 2127 : cluster [DBG] pgmap v1200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:40.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:39 gibba013 bash[29418]: cluster 2021-03-10T14:32:38.042518+0000 mgr.gibba020.yqfnwy (mgr.34427) 2127 : cluster [DBG] pgmap v1200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:40.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:39 gibba013 bash[30381]: cluster 2021-03-10T14:32:38.042518+0000 mgr.gibba020.yqfnwy (mgr.34427) 2127 : cluster [DBG] pgmap v1200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:42.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:41 gibba020 bash[25448]: cluster 2021-03-10T14:32:40.043514+0000 mgr.gibba020.yqfnwy (mgr.34427) 2128 : cluster [DBG] pgmap v1201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:42.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:41 gibba013 bash[29418]: cluster 2021-03-10T14:32:40.043514+0000 mgr.gibba020.yqfnwy (mgr.34427) 2128 : cluster [DBG] pgmap v1201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:42.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:41 gibba013 bash[30381]: cluster 2021-03-10T14:32:40.043514+0000 mgr.gibba020.yqfnwy (mgr.34427) 2128 : cluster [DBG] pgmap v1201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:44.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:43 gibba020 bash[25448]: cluster 2021-03-10T14:32:42.044822+0000 mgr.gibba020.yqfnwy (mgr.34427) 2129 : cluster [DBG] pgmap v1202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:44.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:43 gibba013 bash[29418]: cluster 2021-03-10T14:32:42.044822+0000 mgr.gibba020.yqfnwy (mgr.34427) 2129 : cluster [DBG] pgmap v1202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:44.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:43 gibba013 bash[30381]: cluster 2021-03-10T14:32:42.044822+0000 mgr.gibba020.yqfnwy (mgr.34427) 2129 : cluster [DBG] pgmap v1202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:46.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:45 gibba020 bash[25448]: cluster 2021-03-10T14:32:44.046316+0000 mgr.gibba020.yqfnwy (mgr.34427) 2130 : cluster [DBG] pgmap v1203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:46.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:45 gibba020 bash[25448]: cephadm 2021-03-10T14:32:44.540213+0000 mgr.gibba020.yqfnwy (mgr.34427) 2131 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:32:46.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:45 gibba013 bash[29418]: cluster 2021-03-10T14:32:44.046316+0000 mgr.gibba020.yqfnwy (mgr.34427) 2130 : cluster [DBG] pgmap v1203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:46.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:45 gibba013 bash[29418]: cephadm 2021-03-10T14:32:44.540213+0000 mgr.gibba020.yqfnwy (mgr.34427) 2131 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:32:46.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:45 gibba013 bash[30381]: cluster 2021-03-10T14:32:44.046316+0000 mgr.gibba020.yqfnwy (mgr.34427) 2130 : cluster [DBG] pgmap v1203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:46.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:45 gibba013 bash[30381]: cephadm 2021-03-10T14:32:44.540213+0000 mgr.gibba020.yqfnwy (mgr.34427) 2131 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:32:47.078 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:32:47.308 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:32:47.308 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (39m) 4m ago 44m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:32:47.308 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (44m) 3m ago 44m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:32:47.309 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (39m) 3m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:32:47.309 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (39m) 3m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:32:47.309 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (38m) 4m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:32:47.309 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (38m) 4m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:32:47.309 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (38m) 3m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:32:47.310 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (38m) 4m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:32:47.310 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (44m) 4m ago 44m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:32:47.310 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (44m) 3m ago 44m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:32:47.310 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (37m) 4m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:32:47.311 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (37m) 4m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:32:47.311 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (36m) 4m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:32:47.311 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (36m) 4m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:32:47.311 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (35m) 3m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:32:47.311 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (35m) 3m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:32:47.312 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (34m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:32:47.312 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (34m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:32:47.312 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (44m) 3m ago 44m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:32:47.312 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 3m ago 42m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:32:47.553 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:32:47.554 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:32:47.554 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:32:47.554 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:32:47.554 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:32:47.555 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:32:47.555 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:32:47.555 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:32:47.555 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:32:47.555 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:32:47.556 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:32:47.556 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:32:47.556 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:32:47.556 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:32:47.556 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:32:48.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:47 gibba020 bash[25448]: cluster 2021-03-10T14:32:46.048017+0000 mgr.gibba020.yqfnwy (mgr.34427) 2132 : cluster [DBG] pgmap v1204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:48.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:47 gibba020 bash[25448]: audit 2021-03-10T14:32:47.552592+0000 mon.a (mon.0) 1188 : audit [DBG] from='client.? 172.21.2.113:0/1934492149' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:48.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:47 gibba013 bash[29418]: cluster 2021-03-10T14:32:46.048017+0000 mgr.gibba020.yqfnwy (mgr.34427) 2132 : cluster [DBG] pgmap v1204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:48.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:47 gibba013 bash[29418]: audit 2021-03-10T14:32:47.552592+0000 mon.a (mon.0) 1188 : audit [DBG] from='client.? 172.21.2.113:0/1934492149' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:48.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:47 gibba013 bash[30381]: cluster 2021-03-10T14:32:46.048017+0000 mgr.gibba020.yqfnwy (mgr.34427) 2132 : cluster [DBG] pgmap v1204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:48.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:47 gibba013 bash[30381]: audit 2021-03-10T14:32:47.552592+0000 mon.a (mon.0) 1188 : audit [DBG] from='client.? 172.21.2.113:0/1934492149' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:32:49.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:48 gibba020 bash[25448]: audit 2021-03-10T14:32:47.068156+0000 mgr.gibba020.yqfnwy (mgr.34427) 2133 : audit [DBG] from='client.55477 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:32:49.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:48 gibba020 bash[25448]: audit 2021-03-10T14:32:47.293483+0000 mgr.gibba020.yqfnwy (mgr.34427) 2134 : audit [DBG] from='client.45498 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:32:49.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:48 gibba013 bash[29418]: audit 2021-03-10T14:32:47.068156+0000 mgr.gibba020.yqfnwy (mgr.34427) 2133 : audit [DBG] from='client.55477 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:32:49.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:48 gibba013 bash[29418]: audit 2021-03-10T14:32:47.293483+0000 mgr.gibba020.yqfnwy (mgr.34427) 2134 : audit [DBG] from='client.45498 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:32:49.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:48 gibba013 bash[30381]: audit 2021-03-10T14:32:47.068156+0000 mgr.gibba020.yqfnwy (mgr.34427) 2133 : audit [DBG] from='client.55477 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:32:49.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:48 gibba013 bash[30381]: audit 2021-03-10T14:32:47.293483+0000 mgr.gibba020.yqfnwy (mgr.34427) 2134 : audit [DBG] from='client.45498 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:32:50.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:49 gibba020 bash[25448]: cluster 2021-03-10T14:32:48.049095+0000 mgr.gibba020.yqfnwy (mgr.34427) 2135 : cluster [DBG] pgmap v1205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:50.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:49 gibba013 bash[29418]: cluster 2021-03-10T14:32:48.049095+0000 mgr.gibba020.yqfnwy (mgr.34427) 2135 : cluster [DBG] pgmap v1205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:50.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:49 gibba013 bash[30381]: cluster 2021-03-10T14:32:48.049095+0000 mgr.gibba020.yqfnwy (mgr.34427) 2135 : cluster [DBG] pgmap v1205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:52.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:51 gibba013 bash[29418]: cluster 2021-03-10T14:32:50.051010+0000 mgr.gibba020.yqfnwy (mgr.34427) 2136 : cluster [DBG] pgmap v1206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:52.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:51 gibba013 bash[30381]: cluster 2021-03-10T14:32:50.051010+0000 mgr.gibba020.yqfnwy (mgr.34427) 2136 : cluster [DBG] pgmap v1206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:52.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:51 gibba020 bash[25448]: cluster 2021-03-10T14:32:50.051010+0000 mgr.gibba020.yqfnwy (mgr.34427) 2136 : cluster [DBG] pgmap v1206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:54.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:53 gibba013 bash[29418]: cluster 2021-03-10T14:32:52.052319+0000 mgr.gibba020.yqfnwy (mgr.34427) 2137 : cluster [DBG] pgmap v1207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:54.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:53 gibba013 bash[30381]: cluster 2021-03-10T14:32:52.052319+0000 mgr.gibba020.yqfnwy (mgr.34427) 2137 : cluster [DBG] pgmap v1207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:54.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:53 gibba020 bash[25448]: cluster 2021-03-10T14:32:52.052319+0000 mgr.gibba020.yqfnwy (mgr.34427) 2137 : cluster [DBG] pgmap v1207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:56.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:55 gibba013 bash[29418]: cluster 2021-03-10T14:32:54.053905+0000 mgr.gibba020.yqfnwy (mgr.34427) 2138 : cluster [DBG] pgmap v1208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:56.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:55 gibba013 bash[30381]: cluster 2021-03-10T14:32:54.053905+0000 mgr.gibba020.yqfnwy (mgr.34427) 2138 : cluster [DBG] pgmap v1208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:56.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:55 gibba020 bash[25448]: cluster 2021-03-10T14:32:54.053905+0000 mgr.gibba020.yqfnwy (mgr.34427) 2138 : cluster [DBG] pgmap v1208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:58.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:57 gibba013 bash[29418]: cluster 2021-03-10T14:32:56.055687+0000 mgr.gibba020.yqfnwy (mgr.34427) 2139 : cluster [DBG] pgmap v1209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:58.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:57 gibba013 bash[30381]: cluster 2021-03-10T14:32:56.055687+0000 mgr.gibba020.yqfnwy (mgr.34427) 2139 : cluster [DBG] pgmap v1209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:32:58.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:57 gibba020 bash[25448]: cluster 2021-03-10T14:32:56.055687+0000 mgr.gibba020.yqfnwy (mgr.34427) 2139 : cluster [DBG] pgmap v1209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:00.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:59 gibba020 bash[25448]: cluster 2021-03-10T14:32:58.056131+0000 mgr.gibba020.yqfnwy (mgr.34427) 2140 : cluster [DBG] pgmap v1210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:00.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:59 gibba020 bash[25448]: audit 2021-03-10T14:32:59.547012+0000 mon.a (mon.0) 1189 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:33:00.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:59 gibba020 bash[25448]: audit 2021-03-10T14:32:59.768056+0000 mon.a (mon.0) 1190 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:33:00.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:59 gibba020 bash[25448]: audit 2021-03-10T14:32:59.771462+0000 mon.a (mon.0) 1191 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:33:00.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:59 gibba020 bash[25448]: audit 2021-03-10T14:32:59.773294+0000 mon.a (mon.0) 1192 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:00.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:59 gibba020 bash[25448]: audit 2021-03-10T14:32:59.775106+0000 mon.a (mon.0) 1193 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:00.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:59 gibba020 bash[25448]: audit 2021-03-10T14:32:59.776845+0000 mon.a (mon.0) 1194 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:00.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:59 gibba020 bash[25448]: audit 2021-03-10T14:32:59.780186+0000 mon.a (mon.0) 1195 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:00.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:32:59 gibba020 bash[25448]: audit 2021-03-10T14:32:59.782424+0000 mon.a (mon.0) 1196 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:00.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:59 gibba013 bash[29418]: cluster 2021-03-10T14:32:58.056131+0000 mgr.gibba020.yqfnwy (mgr.34427) 2140 : cluster [DBG] pgmap v1210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:00.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:59 gibba013 bash[29418]: audit 2021-03-10T14:32:59.547012+0000 mon.a (mon.0) 1189 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:33:00.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:59 gibba013 bash[29418]: audit 2021-03-10T14:32:59.768056+0000 mon.a (mon.0) 1190 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:33:00.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:59 gibba013 bash[29418]: audit 2021-03-10T14:32:59.771462+0000 mon.a (mon.0) 1191 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:33:00.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:59 gibba013 bash[29418]: audit 2021-03-10T14:32:59.773294+0000 mon.a (mon.0) 1192 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:00.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:59 gibba013 bash[29418]: audit 2021-03-10T14:32:59.775106+0000 mon.a (mon.0) 1193 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:00.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:59 gibba013 bash[29418]: audit 2021-03-10T14:32:59.776845+0000 mon.a (mon.0) 1194 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:00.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:59 gibba013 bash[29418]: audit 2021-03-10T14:32:59.780186+0000 mon.a (mon.0) 1195 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:00.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:32:59 gibba013 bash[29418]: audit 2021-03-10T14:32:59.782424+0000 mon.a (mon.0) 1196 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:00.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:59 gibba013 bash[30381]: cluster 2021-03-10T14:32:58.056131+0000 mgr.gibba020.yqfnwy (mgr.34427) 2140 : cluster [DBG] pgmap v1210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:00.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:59 gibba013 bash[30381]: audit 2021-03-10T14:32:59.547012+0000 mon.a (mon.0) 1189 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:33:00.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:59 gibba013 bash[30381]: audit 2021-03-10T14:32:59.768056+0000 mon.a (mon.0) 1190 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:33:00.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:59 gibba013 bash[30381]: audit 2021-03-10T14:32:59.771462+0000 mon.a (mon.0) 1191 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:33:00.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:59 gibba013 bash[30381]: audit 2021-03-10T14:32:59.773294+0000 mon.a (mon.0) 1192 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:00.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:59 gibba013 bash[30381]: audit 2021-03-10T14:32:59.775106+0000 mon.a (mon.0) 1193 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:00.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:59 gibba013 bash[30381]: audit 2021-03-10T14:32:59.776845+0000 mon.a (mon.0) 1194 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:00.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:59 gibba013 bash[30381]: audit 2021-03-10T14:32:59.780186+0000 mon.a (mon.0) 1195 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:00.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:32:59 gibba013 bash[30381]: audit 2021-03-10T14:32:59.782424+0000 mon.a (mon.0) 1196 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:01.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:00 gibba013 bash[29418]: cephadm 2021-03-10T14:32:59.552456+0000 mgr.gibba020.yqfnwy (mgr.34427) 2141 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:33:01.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:00 gibba013 bash[29418]: cephadm 2021-03-10T14:32:59.553877+0000 mgr.gibba020.yqfnwy (mgr.34427) 2142 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:33:01.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:00 gibba013 bash[29418]: cephadm 2021-03-10T14:32:59.769652+0000 mgr.gibba020.yqfnwy (mgr.34427) 2143 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:33:01.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:00 gibba013 bash[29418]: cephadm 2021-03-10T14:32:59.771993+0000 mgr.gibba020.yqfnwy (mgr.34427) 2144 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:33:01.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:00 gibba013 bash[29418]: cephadm 2021-03-10T14:32:59.773768+0000 mgr.gibba020.yqfnwy (mgr.34427) 2145 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:33:01.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:00 gibba013 bash[29418]: cephadm 2021-03-10T14:32:59.773830+0000 mgr.gibba020.yqfnwy (mgr.34427) 2146 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:33:01.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:00 gibba013 bash[29418]: cephadm 2021-03-10T14:32:59.775417+0000 mgr.gibba020.yqfnwy (mgr.34427) 2147 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:33:01.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:00 gibba013 bash[29418]: cephadm 2021-03-10T14:32:59.775481+0000 mgr.gibba020.yqfnwy (mgr.34427) 2148 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:33:01.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:00 gibba013 bash[29418]: cephadm 2021-03-10T14:32:59.777271+0000 mgr.gibba020.yqfnwy (mgr.34427) 2149 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:33:01.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:00 gibba013 bash[29418]: cephadm 2021-03-10T14:32:59.778643+0000 mgr.gibba020.yqfnwy (mgr.34427) 2150 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:33:01.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:00 gibba013 bash[29418]: cephadm 2021-03-10T14:32:59.778724+0000 mgr.gibba020.yqfnwy (mgr.34427) 2151 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:33:01.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:00 gibba013 bash[29418]: cephadm 2021-03-10T14:32:59.780695+0000 mgr.gibba020.yqfnwy (mgr.34427) 2152 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:33:01.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:00 gibba013 bash[29418]: cephadm 2021-03-10T14:32:59.781038+0000 mgr.gibba020.yqfnwy (mgr.34427) 2153 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:33:01.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:00 gibba013 bash[29418]: cephadm 2021-03-10T14:32:59.783165+0000 mgr.gibba020.yqfnwy (mgr.34427) 2154 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:33:01.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:00 gibba013 bash[29418]: cephadm 2021-03-10T14:32:59.783225+0000 mgr.gibba020.yqfnwy (mgr.34427) 2155 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:33:01.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:00 gibba013 bash[29418]: cephadm 2021-03-10T14:32:59.783348+0000 mgr.gibba020.yqfnwy (mgr.34427) 2156 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:33:01.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:00 gibba013 bash[30381]: cephadm 2021-03-10T14:32:59.552456+0000 mgr.gibba020.yqfnwy (mgr.34427) 2141 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:33:01.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:00 gibba013 bash[30381]: cephadm 2021-03-10T14:32:59.553877+0000 mgr.gibba020.yqfnwy (mgr.34427) 2142 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:33:01.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:00 gibba013 bash[30381]: cephadm 2021-03-10T14:32:59.769652+0000 mgr.gibba020.yqfnwy (mgr.34427) 2143 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:33:01.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:00 gibba013 bash[30381]: cephadm 2021-03-10T14:32:59.771993+0000 mgr.gibba020.yqfnwy (mgr.34427) 2144 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:33:01.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:00 gibba013 bash[30381]: cephadm 2021-03-10T14:32:59.773768+0000 mgr.gibba020.yqfnwy (mgr.34427) 2145 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:33:01.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:00 gibba013 bash[30381]: cephadm 2021-03-10T14:32:59.773830+0000 mgr.gibba020.yqfnwy (mgr.34427) 2146 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:33:01.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:00 gibba013 bash[30381]: cephadm 2021-03-10T14:32:59.775417+0000 mgr.gibba020.yqfnwy (mgr.34427) 2147 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:33:01.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:00 gibba013 bash[30381]: cephadm 2021-03-10T14:32:59.775481+0000 mgr.gibba020.yqfnwy (mgr.34427) 2148 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:33:01.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:00 gibba013 bash[30381]: cephadm 2021-03-10T14:32:59.777271+0000 mgr.gibba020.yqfnwy (mgr.34427) 2149 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:33:01.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:00 gibba013 bash[30381]: cephadm 2021-03-10T14:32:59.778643+0000 mgr.gibba020.yqfnwy (mgr.34427) 2150 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:33:01.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:00 gibba013 bash[30381]: cephadm 2021-03-10T14:32:59.778724+0000 mgr.gibba020.yqfnwy (mgr.34427) 2151 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:33:01.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:00 gibba013 bash[30381]: cephadm 2021-03-10T14:32:59.780695+0000 mgr.gibba020.yqfnwy (mgr.34427) 2152 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:33:01.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:00 gibba013 bash[30381]: cephadm 2021-03-10T14:32:59.781038+0000 mgr.gibba020.yqfnwy (mgr.34427) 2153 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:33:01.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:00 gibba013 bash[30381]: cephadm 2021-03-10T14:32:59.783165+0000 mgr.gibba020.yqfnwy (mgr.34427) 2154 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:33:01.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:00 gibba013 bash[30381]: cephadm 2021-03-10T14:32:59.783225+0000 mgr.gibba020.yqfnwy (mgr.34427) 2155 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:33:01.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:00 gibba013 bash[30381]: cephadm 2021-03-10T14:32:59.783348+0000 mgr.gibba020.yqfnwy (mgr.34427) 2156 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:33:01.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:00 gibba020 bash[25448]: cephadm 2021-03-10T14:32:59.552456+0000 mgr.gibba020.yqfnwy (mgr.34427) 2141 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:33:01.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:00 gibba020 bash[25448]: cephadm 2021-03-10T14:32:59.553877+0000 mgr.gibba020.yqfnwy (mgr.34427) 2142 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:33:01.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:00 gibba020 bash[25448]: cephadm 2021-03-10T14:32:59.769652+0000 mgr.gibba020.yqfnwy (mgr.34427) 2143 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:33:01.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:00 gibba020 bash[25448]: cephadm 2021-03-10T14:32:59.771993+0000 mgr.gibba020.yqfnwy (mgr.34427) 2144 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:33:01.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:00 gibba020 bash[25448]: cephadm 2021-03-10T14:32:59.773768+0000 mgr.gibba020.yqfnwy (mgr.34427) 2145 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:33:01.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:00 gibba020 bash[25448]: cephadm 2021-03-10T14:32:59.773830+0000 mgr.gibba020.yqfnwy (mgr.34427) 2146 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:33:01.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:00 gibba020 bash[25448]: cephadm 2021-03-10T14:32:59.775417+0000 mgr.gibba020.yqfnwy (mgr.34427) 2147 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:33:01.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:00 gibba020 bash[25448]: cephadm 2021-03-10T14:32:59.775481+0000 mgr.gibba020.yqfnwy (mgr.34427) 2148 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:33:01.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:00 gibba020 bash[25448]: cephadm 2021-03-10T14:32:59.777271+0000 mgr.gibba020.yqfnwy (mgr.34427) 2149 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:33:01.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:00 gibba020 bash[25448]: cephadm 2021-03-10T14:32:59.778643+0000 mgr.gibba020.yqfnwy (mgr.34427) 2150 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:33:01.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:00 gibba020 bash[25448]: cephadm 2021-03-10T14:32:59.778724+0000 mgr.gibba020.yqfnwy (mgr.34427) 2151 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:33:01.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:00 gibba020 bash[25448]: cephadm 2021-03-10T14:32:59.780695+0000 mgr.gibba020.yqfnwy (mgr.34427) 2152 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:33:01.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:00 gibba020 bash[25448]: cephadm 2021-03-10T14:32:59.781038+0000 mgr.gibba020.yqfnwy (mgr.34427) 2153 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:33:01.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:00 gibba020 bash[25448]: cephadm 2021-03-10T14:32:59.783165+0000 mgr.gibba020.yqfnwy (mgr.34427) 2154 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:33:01.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:00 gibba020 bash[25448]: cephadm 2021-03-10T14:32:59.783225+0000 mgr.gibba020.yqfnwy (mgr.34427) 2155 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:33:01.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:00 gibba020 bash[25448]: cephadm 2021-03-10T14:32:59.783348+0000 mgr.gibba020.yqfnwy (mgr.34427) 2156 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:33:02.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:02 gibba013 bash[29418]: cluster 2021-03-10T14:33:00.056569+0000 mgr.gibba020.yqfnwy (mgr.34427) 2157 : cluster [DBG] pgmap v1211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:02.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:02 gibba013 bash[30381]: cluster 2021-03-10T14:33:00.056569+0000 mgr.gibba020.yqfnwy (mgr.34427) 2157 : cluster [DBG] pgmap v1211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:02.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:02 gibba020 bash[25448]: cluster 2021-03-10T14:33:00.056569+0000 mgr.gibba020.yqfnwy (mgr.34427) 2157 : cluster [DBG] pgmap v1211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:04.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:04 gibba013 bash[29418]: cluster 2021-03-10T14:33:02.056892+0000 mgr.gibba020.yqfnwy (mgr.34427) 2158 : cluster [DBG] pgmap v1212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:04.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:04 gibba013 bash[30381]: cluster 2021-03-10T14:33:02.056892+0000 mgr.gibba020.yqfnwy (mgr.34427) 2158 : cluster [DBG] pgmap v1212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:04.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:04 gibba020 bash[25448]: cluster 2021-03-10T14:33:02.056892+0000 mgr.gibba020.yqfnwy (mgr.34427) 2158 : cluster [DBG] pgmap v1212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:06.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:06 gibba013 bash[29418]: cluster 2021-03-10T14:33:04.057433+0000 mgr.gibba020.yqfnwy (mgr.34427) 2159 : cluster [DBG] pgmap v1213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:06.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:06 gibba013 bash[30381]: cluster 2021-03-10T14:33:04.057433+0000 mgr.gibba020.yqfnwy (mgr.34427) 2159 : cluster [DBG] pgmap v1213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:06.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:06 gibba020 bash[25448]: cluster 2021-03-10T14:33:04.057433+0000 mgr.gibba020.yqfnwy (mgr.34427) 2159 : cluster [DBG] pgmap v1213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:07.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:07 gibba013 bash[29418]: audit 2021-03-10T14:33:06.116311+0000 mon.a (mon.0) 1197 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:33:07.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:07 gibba013 bash[29418]: audit 2021-03-10T14:33:06.117096+0000 mon.a (mon.0) 1198 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T14:33:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:07 gibba013 bash[29418]: audit 2021-03-10T14:33:06.117780+0000 mon.a (mon.0) 1199 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:33:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:07 gibba013 bash[29418]: audit 2021-03-10T14:33:06.118513+0000 mon.a (mon.0) 1200 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:33:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:07 gibba013 bash[29418]: audit 2021-03-10T14:33:06.183306+0000 mon.a (mon.0) 1201 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:33:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:07 gibba013 bash[29418]: audit 2021-03-10T14:33:06.189114+0000 mon.a (mon.0) 1202 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:33:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:07 gibba013 bash[30381]: audit 2021-03-10T14:33:06.116311+0000 mon.a (mon.0) 1197 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:33:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:07 gibba013 bash[30381]: audit 2021-03-10T14:33:06.117096+0000 mon.a (mon.0) 1198 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T14:33:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:07 gibba013 bash[30381]: audit 2021-03-10T14:33:06.117780+0000 mon.a (mon.0) 1199 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:33:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:07 gibba013 bash[30381]: audit 2021-03-10T14:33:06.118513+0000 mon.a (mon.0) 1200 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:33:07.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:07 gibba013 bash[30381]: audit 2021-03-10T14:33:06.183306+0000 mon.a (mon.0) 1201 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:33:07.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:07 gibba013 bash[30381]: audit 2021-03-10T14:33:06.189114+0000 mon.a (mon.0) 1202 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:33:07.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:07 gibba020 bash[25448]: audit 2021-03-10T14:33:06.116311+0000 mon.a (mon.0) 1197 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:33:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:07 gibba020 bash[25448]: audit 2021-03-10T14:33:06.117096+0000 mon.a (mon.0) 1198 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T14:33:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:07 gibba020 bash[25448]: audit 2021-03-10T14:33:06.117780+0000 mon.a (mon.0) 1199 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:33:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:07 gibba020 bash[25448]: audit 2021-03-10T14:33:06.118513+0000 mon.a (mon.0) 1200 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:33:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:07 gibba020 bash[25448]: audit 2021-03-10T14:33:06.183306+0000 mon.a (mon.0) 1201 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:33:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:07 gibba020 bash[25448]: audit 2021-03-10T14:33:06.189114+0000 mon.a (mon.0) 1202 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:33:08.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:08 gibba013 bash[29418]: cluster 2021-03-10T14:33:06.058239+0000 mgr.gibba020.yqfnwy (mgr.34427) 2160 : cluster [DBG] pgmap v1214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:08.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:08 gibba013 bash[30381]: cluster 2021-03-10T14:33:06.058239+0000 mgr.gibba020.yqfnwy (mgr.34427) 2160 : cluster [DBG] pgmap v1214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:08.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:08 gibba020 bash[25448]: cluster 2021-03-10T14:33:06.058239+0000 mgr.gibba020.yqfnwy (mgr.34427) 2160 : cluster [DBG] pgmap v1214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:09.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:09 gibba013 bash[29418]: cluster 2021-03-10T14:33:08.058568+0000 mgr.gibba020.yqfnwy (mgr.34427) 2161 : cluster [DBG] pgmap v1215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:09.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:09 gibba013 bash[30381]: cluster 2021-03-10T14:33:08.058568+0000 mgr.gibba020.yqfnwy (mgr.34427) 2161 : cluster [DBG] pgmap v1215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:09.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:09 gibba020 bash[25448]: cluster 2021-03-10T14:33:08.058568+0000 mgr.gibba020.yqfnwy (mgr.34427) 2161 : cluster [DBG] pgmap v1215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:12.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:11 gibba013 bash[29418]: cluster 2021-03-10T14:33:10.059378+0000 mgr.gibba020.yqfnwy (mgr.34427) 2162 : cluster [DBG] pgmap v1216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:12.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:11 gibba013 bash[30381]: cluster 2021-03-10T14:33:10.059378+0000 mgr.gibba020.yqfnwy (mgr.34427) 2162 : cluster [DBG] pgmap v1216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:12.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:11 gibba020 bash[25448]: cluster 2021-03-10T14:33:10.059378+0000 mgr.gibba020.yqfnwy (mgr.34427) 2162 : cluster [DBG] pgmap v1216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:14.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:13 gibba013 bash[29418]: cluster 2021-03-10T14:33:12.060692+0000 mgr.gibba020.yqfnwy (mgr.34427) 2163 : cluster [DBG] pgmap v1217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:14.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:13 gibba013 bash[30381]: cluster 2021-03-10T14:33:12.060692+0000 mgr.gibba020.yqfnwy (mgr.34427) 2163 : cluster [DBG] pgmap v1217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:14.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:13 gibba020 bash[25448]: cluster 2021-03-10T14:33:12.060692+0000 mgr.gibba020.yqfnwy (mgr.34427) 2163 : cluster [DBG] pgmap v1217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:16.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:15 gibba013 bash[29418]: cluster 2021-03-10T14:33:14.062442+0000 mgr.gibba020.yqfnwy (mgr.34427) 2164 : cluster [DBG] pgmap v1218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:16.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:15 gibba013 bash[29418]: cephadm 2021-03-10T14:33:14.799275+0000 mgr.gibba020.yqfnwy (mgr.34427) 2165 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:33:16.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:15 gibba013 bash[30381]: cluster 2021-03-10T14:33:14.062442+0000 mgr.gibba020.yqfnwy (mgr.34427) 2164 : cluster [DBG] pgmap v1218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:16.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:15 gibba013 bash[30381]: cephadm 2021-03-10T14:33:14.799275+0000 mgr.gibba020.yqfnwy (mgr.34427) 2165 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:33:16.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:15 gibba020 bash[25448]: cluster 2021-03-10T14:33:14.062442+0000 mgr.gibba020.yqfnwy (mgr.34427) 2164 : cluster [DBG] pgmap v1218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:16.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:15 gibba020 bash[25448]: cephadm 2021-03-10T14:33:14.799275+0000 mgr.gibba020.yqfnwy (mgr.34427) 2165 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:33:17.800 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:33:18.032 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:33:18.032 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (39m) 5m ago 45m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:33:18.032 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (44m) 4m ago 44m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:33:18.033 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (40m) 4m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:33:18.033 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (40m) 4m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:33:18.033 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (39m) 5m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:33:18.033 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (39m) 5m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:33:18.033 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (38m) 4m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:33:18.034 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (39m) 5m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:33:18.034 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (45m) 5m ago 45m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:33:18.034 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (45m) 4m ago 45m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:33:18.034 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (38m) 5m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:33:18.034 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (37m) 5m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:33:18.035 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (37m) 5m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:33:18.035 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (36m) 5m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:33:18.035 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (36m) 4m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:33:18.035 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (35m) 4m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:33:18.036 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (35m) 4m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:33:18.036 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (35m) 4m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:33:18.036 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (44m) 4m ago 45m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:33:18.036 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 4m ago 43m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:33:18.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:17 gibba020 bash[25448]: cluster 2021-03-10T14:33:16.064098+0000 mgr.gibba020.yqfnwy (mgr.34427) 2166 : cluster [DBG] pgmap v1219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:18.279 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:33:18.279 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:33:18.279 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:33:18.279 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:33:18.280 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:33:18.280 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:33:18.280 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:33:18.280 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:33:18.280 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:33:18.280 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:33:18.281 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:33:18.281 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:33:18.281 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:33:18.281 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:33:18.281 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:33:18.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:17 gibba013 bash[29418]: cluster 2021-03-10T14:33:16.064098+0000 mgr.gibba020.yqfnwy (mgr.34427) 2166 : cluster [DBG] pgmap v1219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:18.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:17 gibba013 bash[30381]: cluster 2021-03-10T14:33:16.064098+0000 mgr.gibba020.yqfnwy (mgr.34427) 2166 : cluster [DBG] pgmap v1219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:19.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:18 gibba020 bash[25448]: audit 2021-03-10T14:33:17.788595+0000 mgr.gibba020.yqfnwy (mgr.34427) 2167 : audit [DBG] from='client.55495 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:33:19.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:18 gibba020 bash[25448]: audit 2021-03-10T14:33:18.017896+0000 mgr.gibba020.yqfnwy (mgr.34427) 2168 : audit [DBG] from='client.55501 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:33:19.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:18 gibba020 bash[25448]: audit 2021-03-10T14:33:18.277908+0000 mon.a (mon.0) 1203 : audit [DBG] from='client.? 172.21.2.113:0/358529682' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:19.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:18 gibba013 bash[29418]: audit 2021-03-10T14:33:17.788595+0000 mgr.gibba020.yqfnwy (mgr.34427) 2167 : audit [DBG] from='client.55495 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:33:19.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:18 gibba013 bash[29418]: audit 2021-03-10T14:33:18.017896+0000 mgr.gibba020.yqfnwy (mgr.34427) 2168 : audit [DBG] from='client.55501 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:33:19.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:18 gibba013 bash[29418]: audit 2021-03-10T14:33:18.277908+0000 mon.a (mon.0) 1203 : audit [DBG] from='client.? 172.21.2.113:0/358529682' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:19.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:18 gibba013 bash[30381]: audit 2021-03-10T14:33:17.788595+0000 mgr.gibba020.yqfnwy (mgr.34427) 2167 : audit [DBG] from='client.55495 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:33:19.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:18 gibba013 bash[30381]: audit 2021-03-10T14:33:18.017896+0000 mgr.gibba020.yqfnwy (mgr.34427) 2168 : audit [DBG] from='client.55501 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:33:19.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:18 gibba013 bash[30381]: audit 2021-03-10T14:33:18.277908+0000 mon.a (mon.0) 1203 : audit [DBG] from='client.? 172.21.2.113:0/358529682' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:20.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:19 gibba020 bash[25448]: cluster 2021-03-10T14:33:18.064633+0000 mgr.gibba020.yqfnwy (mgr.34427) 2169 : cluster [DBG] pgmap v1220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:20.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:19 gibba013 bash[29418]: cluster 2021-03-10T14:33:18.064633+0000 mgr.gibba020.yqfnwy (mgr.34427) 2169 : cluster [DBG] pgmap v1220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:20.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:19 gibba013 bash[30381]: cluster 2021-03-10T14:33:18.064633+0000 mgr.gibba020.yqfnwy (mgr.34427) 2169 : cluster [DBG] pgmap v1220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:22.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:21 gibba020 bash[25448]: cluster 2021-03-10T14:33:20.065387+0000 mgr.gibba020.yqfnwy (mgr.34427) 2170 : cluster [DBG] pgmap v1221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:22.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:21 gibba013 bash[29418]: cluster 2021-03-10T14:33:20.065387+0000 mgr.gibba020.yqfnwy (mgr.34427) 2170 : cluster [DBG] pgmap v1221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:22.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:21 gibba013 bash[30381]: cluster 2021-03-10T14:33:20.065387+0000 mgr.gibba020.yqfnwy (mgr.34427) 2170 : cluster [DBG] pgmap v1221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:24.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:23 gibba020 bash[25448]: cluster 2021-03-10T14:33:22.066650+0000 mgr.gibba020.yqfnwy (mgr.34427) 2171 : cluster [DBG] pgmap v1222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:24.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:23 gibba013 bash[29418]: cluster 2021-03-10T14:33:22.066650+0000 mgr.gibba020.yqfnwy (mgr.34427) 2171 : cluster [DBG] pgmap v1222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:24.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:23 gibba013 bash[30381]: cluster 2021-03-10T14:33:22.066650+0000 mgr.gibba020.yqfnwy (mgr.34427) 2171 : cluster [DBG] pgmap v1222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:26.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:25 gibba020 bash[25448]: cluster 2021-03-10T14:33:24.068368+0000 mgr.gibba020.yqfnwy (mgr.34427) 2172 : cluster [DBG] pgmap v1223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:26.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:25 gibba013 bash[29418]: cluster 2021-03-10T14:33:24.068368+0000 mgr.gibba020.yqfnwy (mgr.34427) 2172 : cluster [DBG] pgmap v1223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:26.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:25 gibba013 bash[30381]: cluster 2021-03-10T14:33:24.068368+0000 mgr.gibba020.yqfnwy (mgr.34427) 2172 : cluster [DBG] pgmap v1223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:28.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:27 gibba020 bash[25448]: cluster 2021-03-10T14:33:26.070139+0000 mgr.gibba020.yqfnwy (mgr.34427) 2173 : cluster [DBG] pgmap v1224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:28.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:27 gibba013 bash[29418]: cluster 2021-03-10T14:33:26.070139+0000 mgr.gibba020.yqfnwy (mgr.34427) 2173 : cluster [DBG] pgmap v1224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:28.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:27 gibba013 bash[30381]: cluster 2021-03-10T14:33:26.070139+0000 mgr.gibba020.yqfnwy (mgr.34427) 2173 : cluster [DBG] pgmap v1224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:30.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:29 gibba020 bash[25448]: cluster 2021-03-10T14:33:28.070621+0000 mgr.gibba020.yqfnwy (mgr.34427) 2174 : cluster [DBG] pgmap v1225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:30.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:29 gibba013 bash[29418]: cluster 2021-03-10T14:33:28.070621+0000 mgr.gibba020.yqfnwy (mgr.34427) 2174 : cluster [DBG] pgmap v1225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:30.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:29 gibba013 bash[30381]: cluster 2021-03-10T14:33:28.070621+0000 mgr.gibba020.yqfnwy (mgr.34427) 2174 : cluster [DBG] pgmap v1225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:31.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:30 gibba013 bash[29418]: cephadm 2021-03-10T14:33:29.815310+0000 mgr.gibba020.yqfnwy (mgr.34427) 2175 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:33:31.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:30 gibba013 bash[30381]: cephadm 2021-03-10T14:33:29.815310+0000 mgr.gibba020.yqfnwy (mgr.34427) 2175 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:33:31.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:30 gibba020 bash[25448]: cephadm 2021-03-10T14:33:29.815310+0000 mgr.gibba020.yqfnwy (mgr.34427) 2175 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:33:32.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:31 gibba013 bash[29418]: cluster 2021-03-10T14:33:30.072519+0000 mgr.gibba020.yqfnwy (mgr.34427) 2176 : cluster [DBG] pgmap v1226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:32.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:31 gibba013 bash[30381]: cluster 2021-03-10T14:33:30.072519+0000 mgr.gibba020.yqfnwy (mgr.34427) 2176 : cluster [DBG] pgmap v1226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:32.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:31 gibba020 bash[25448]: cluster 2021-03-10T14:33:30.072519+0000 mgr.gibba020.yqfnwy (mgr.34427) 2176 : cluster [DBG] pgmap v1226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:34.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:33 gibba013 bash[29418]: cluster 2021-03-10T14:33:32.073894+0000 mgr.gibba020.yqfnwy (mgr.34427) 2177 : cluster [DBG] pgmap v1227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:34.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:33 gibba013 bash[30381]: cluster 2021-03-10T14:33:32.073894+0000 mgr.gibba020.yqfnwy (mgr.34427) 2177 : cluster [DBG] pgmap v1227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:34.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:33 gibba020 bash[25448]: cluster 2021-03-10T14:33:32.073894+0000 mgr.gibba020.yqfnwy (mgr.34427) 2177 : cluster [DBG] pgmap v1227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:36.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:35 gibba013 bash[29418]: cluster 2021-03-10T14:33:34.075412+0000 mgr.gibba020.yqfnwy (mgr.34427) 2178 : cluster [DBG] pgmap v1228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:36.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:35 gibba013 bash[30381]: cluster 2021-03-10T14:33:34.075412+0000 mgr.gibba020.yqfnwy (mgr.34427) 2178 : cluster [DBG] pgmap v1228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:36.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:35 gibba020 bash[25448]: cluster 2021-03-10T14:33:34.075412+0000 mgr.gibba020.yqfnwy (mgr.34427) 2178 : cluster [DBG] pgmap v1228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:38.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:37 gibba013 bash[29418]: cluster 2021-03-10T14:33:36.076970+0000 mgr.gibba020.yqfnwy (mgr.34427) 2179 : cluster [DBG] pgmap v1229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:38.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:37 gibba013 bash[30381]: cluster 2021-03-10T14:33:36.076970+0000 mgr.gibba020.yqfnwy (mgr.34427) 2179 : cluster [DBG] pgmap v1229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:38.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:37 gibba020 bash[25448]: cluster 2021-03-10T14:33:36.076970+0000 mgr.gibba020.yqfnwy (mgr.34427) 2179 : cluster [DBG] pgmap v1229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:40.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:39 gibba013 bash[29418]: cluster 2021-03-10T14:33:38.077444+0000 mgr.gibba020.yqfnwy (mgr.34427) 2180 : cluster [DBG] pgmap v1230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:40.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:39 gibba013 bash[30381]: cluster 2021-03-10T14:33:38.077444+0000 mgr.gibba020.yqfnwy (mgr.34427) 2180 : cluster [DBG] pgmap v1230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:40.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:39 gibba020 bash[25448]: cluster 2021-03-10T14:33:38.077444+0000 mgr.gibba020.yqfnwy (mgr.34427) 2180 : cluster [DBG] pgmap v1230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:42.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:41 gibba013 bash[29418]: cluster 2021-03-10T14:33:40.079313+0000 mgr.gibba020.yqfnwy (mgr.34427) 2181 : cluster [DBG] pgmap v1231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:42.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:41 gibba013 bash[30381]: cluster 2021-03-10T14:33:40.079313+0000 mgr.gibba020.yqfnwy (mgr.34427) 2181 : cluster [DBG] pgmap v1231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:42.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:41 gibba020 bash[25448]: cluster 2021-03-10T14:33:40.079313+0000 mgr.gibba020.yqfnwy (mgr.34427) 2181 : cluster [DBG] pgmap v1231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:44.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:44 gibba013 bash[29418]: cluster 2021-03-10T14:33:42.080709+0000 mgr.gibba020.yqfnwy (mgr.34427) 2182 : cluster [DBG] pgmap v1232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:44.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:44 gibba013 bash[30381]: cluster 2021-03-10T14:33:42.080709+0000 mgr.gibba020.yqfnwy (mgr.34427) 2182 : cluster [DBG] pgmap v1232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:44.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:44 gibba020 bash[25448]: cluster 2021-03-10T14:33:42.080709+0000 mgr.gibba020.yqfnwy (mgr.34427) 2182 : cluster [DBG] pgmap v1232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:46.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:46 gibba013 bash[29418]: cluster 2021-03-10T14:33:44.081626+0000 mgr.gibba020.yqfnwy (mgr.34427) 2183 : cluster [DBG] pgmap v1233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:46.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:46 gibba013 bash[29418]: cephadm 2021-03-10T14:33:44.831317+0000 mgr.gibba020.yqfnwy (mgr.34427) 2184 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:33:46.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:46 gibba013 bash[30381]: cluster 2021-03-10T14:33:44.081626+0000 mgr.gibba020.yqfnwy (mgr.34427) 2183 : cluster [DBG] pgmap v1233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:46.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:46 gibba013 bash[30381]: cephadm 2021-03-10T14:33:44.831317+0000 mgr.gibba020.yqfnwy (mgr.34427) 2184 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:33:46.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:46 gibba020 bash[25448]: cluster 2021-03-10T14:33:44.081626+0000 mgr.gibba020.yqfnwy (mgr.34427) 2183 : cluster [DBG] pgmap v1233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:46.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:46 gibba020 bash[25448]: cephadm 2021-03-10T14:33:44.831317+0000 mgr.gibba020.yqfnwy (mgr.34427) 2184 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:33:48.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:48 gibba013 bash[29418]: cluster 2021-03-10T14:33:46.083421+0000 mgr.gibba020.yqfnwy (mgr.34427) 2185 : cluster [DBG] pgmap v1234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:48.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:48 gibba013 bash[30381]: cluster 2021-03-10T14:33:46.083421+0000 mgr.gibba020.yqfnwy (mgr.34427) 2185 : cluster [DBG] pgmap v1234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:48.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:48 gibba020 bash[25448]: cluster 2021-03-10T14:33:46.083421+0000 mgr.gibba020.yqfnwy (mgr.34427) 2185 : cluster [DBG] pgmap v1234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:48.522 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:33:48.746 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:33:48.747 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (40m) 5m ago 45m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:33:48.747 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (45m) 4m ago 45m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:33:48.747 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (40m) 4m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:33:48.747 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (41m) 4m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:33:48.748 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (39m) 5m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:33:48.748 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (39m) 5m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:33:48.748 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (39m) 4m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:33:48.748 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (39m) 5m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:33:48.748 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (45m) 5m ago 45m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:33:48.749 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (45m) 4m ago 45m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:33:48.749 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (38m) 5m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:33:48.749 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (38m) 5m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:33:48.749 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (37m) 5m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:33:48.749 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (37m) 5m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:33:48.749 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (36m) 4m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:33:48.750 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (36m) 4m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:33:48.750 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (36m) 4m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:33:48.750 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (35m) 4m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:33:48.750 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (45m) 4m ago 45m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:33:48.751 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 4m ago 43m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:33:48.994 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:33:48.994 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:33:48.995 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:33:48.995 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:33:48.995 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:33:48.995 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:33:48.995 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:33:48.996 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:33:48.996 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:33:48.996 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:33:48.996 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:33:48.996 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:33:48.997 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:33:48.997 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:33:48.997 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:33:49.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:49 gibba013 bash[29418]: audit 2021-03-10T14:33:48.993444+0000 mon.a (mon.0) 1204 : audit [DBG] from='client.? 172.21.2.113:0/4228686718' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:49.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:49 gibba013 bash[30381]: audit 2021-03-10T14:33:48.993444+0000 mon.a (mon.0) 1204 : audit [DBG] from='client.? 172.21.2.113:0/4228686718' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:49.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:49 gibba020 bash[25448]: audit 2021-03-10T14:33:48.993444+0000 mon.a (mon.0) 1204 : audit [DBG] from='client.? 172.21.2.113:0/4228686718' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:33:50.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:50 gibba013 bash[29418]: cluster 2021-03-10T14:33:48.084127+0000 mgr.gibba020.yqfnwy (mgr.34427) 2186 : cluster [DBG] pgmap v1235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:50.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:50 gibba013 bash[29418]: audit 2021-03-10T14:33:48.511500+0000 mgr.gibba020.yqfnwy (mgr.34427) 2187 : audit [DBG] from='client.45528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:33:50.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:50 gibba013 bash[29418]: audit 2021-03-10T14:33:48.735986+0000 mgr.gibba020.yqfnwy (mgr.34427) 2188 : audit [DBG] from='client.45534 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:33:50.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:50 gibba013 bash[30381]: cluster 2021-03-10T14:33:48.084127+0000 mgr.gibba020.yqfnwy (mgr.34427) 2186 : cluster [DBG] pgmap v1235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:50.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:50 gibba013 bash[30381]: audit 2021-03-10T14:33:48.511500+0000 mgr.gibba020.yqfnwy (mgr.34427) 2187 : audit [DBG] from='client.45528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:33:50.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:50 gibba013 bash[30381]: audit 2021-03-10T14:33:48.735986+0000 mgr.gibba020.yqfnwy (mgr.34427) 2188 : audit [DBG] from='client.45534 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:33:50.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:50 gibba020 bash[25448]: cluster 2021-03-10T14:33:48.084127+0000 mgr.gibba020.yqfnwy (mgr.34427) 2186 : cluster [DBG] pgmap v1235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:50.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:50 gibba020 bash[25448]: audit 2021-03-10T14:33:48.511500+0000 mgr.gibba020.yqfnwy (mgr.34427) 2187 : audit [DBG] from='client.45528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:33:50.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:50 gibba020 bash[25448]: audit 2021-03-10T14:33:48.735986+0000 mgr.gibba020.yqfnwy (mgr.34427) 2188 : audit [DBG] from='client.45534 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:33:52.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:52 gibba013 bash[29418]: cluster 2021-03-10T14:33:50.084861+0000 mgr.gibba020.yqfnwy (mgr.34427) 2189 : cluster [DBG] pgmap v1236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:52.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:52 gibba013 bash[30381]: cluster 2021-03-10T14:33:50.084861+0000 mgr.gibba020.yqfnwy (mgr.34427) 2189 : cluster [DBG] pgmap v1236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:52.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:52 gibba020 bash[25448]: cluster 2021-03-10T14:33:50.084861+0000 mgr.gibba020.yqfnwy (mgr.34427) 2189 : cluster [DBG] pgmap v1236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:54.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:54 gibba013 bash[29418]: cluster 2021-03-10T14:33:52.085573+0000 mgr.gibba020.yqfnwy (mgr.34427) 2190 : cluster [DBG] pgmap v1237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:54.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:54 gibba013 bash[30381]: cluster 2021-03-10T14:33:52.085573+0000 mgr.gibba020.yqfnwy (mgr.34427) 2190 : cluster [DBG] pgmap v1237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:54.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:54 gibba020 bash[25448]: cluster 2021-03-10T14:33:52.085573+0000 mgr.gibba020.yqfnwy (mgr.34427) 2190 : cluster [DBG] pgmap v1237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:56.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:56 gibba013 bash[29418]: cluster 2021-03-10T14:33:54.086283+0000 mgr.gibba020.yqfnwy (mgr.34427) 2191 : cluster [DBG] pgmap v1238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:56.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:56 gibba013 bash[30381]: cluster 2021-03-10T14:33:54.086283+0000 mgr.gibba020.yqfnwy (mgr.34427) 2191 : cluster [DBG] pgmap v1238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:56.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:56 gibba020 bash[25448]: cluster 2021-03-10T14:33:54.086283+0000 mgr.gibba020.yqfnwy (mgr.34427) 2191 : cluster [DBG] pgmap v1238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:57.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:57 gibba013 bash[29418]: cluster 2021-03-10T14:33:56.086980+0000 mgr.gibba020.yqfnwy (mgr.34427) 2192 : cluster [DBG] pgmap v1239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:57.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:57 gibba013 bash[30381]: cluster 2021-03-10T14:33:56.086980+0000 mgr.gibba020.yqfnwy (mgr.34427) 2192 : cluster [DBG] pgmap v1239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:57.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:57 gibba020 bash[25448]: cluster 2021-03-10T14:33:56.086980+0000 mgr.gibba020.yqfnwy (mgr.34427) 2192 : cluster [DBG] pgmap v1239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:59.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:33:59 gibba020 bash[25448]: cluster 2021-03-10T14:33:58.087987+0000 mgr.gibba020.yqfnwy (mgr.34427) 2193 : cluster [DBG] pgmap v1240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:59.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:33:59 gibba013 bash[29418]: cluster 2021-03-10T14:33:58.087987+0000 mgr.gibba020.yqfnwy (mgr.34427) 2193 : cluster [DBG] pgmap v1240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:33:59.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:33:59 gibba013 bash[30381]: cluster 2021-03-10T14:33:58.087987+0000 mgr.gibba020.yqfnwy (mgr.34427) 2193 : cluster [DBG] pgmap v1240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:00.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:00 gibba020 bash[25448]: audit 2021-03-10T14:33:59.848937+0000 mon.a (mon.0) 1205 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:34:00.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:00 gibba020 bash[25448]: cephadm 2021-03-10T14:33:59.853917+0000 mgr.gibba020.yqfnwy (mgr.34427) 2194 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:34:00.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:00 gibba020 bash[25448]: cephadm 2021-03-10T14:33:59.855711+0000 mgr.gibba020.yqfnwy (mgr.34427) 2195 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:34:00.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:00 gibba020 bash[25448]: audit 2021-03-10T14:34:00.075260+0000 mon.a (mon.0) 1206 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:34:00.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:00 gibba020 bash[25448]: audit 2021-03-10T14:34:00.078283+0000 mon.a (mon.0) 1207 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:34:00.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:00 gibba020 bash[25448]: audit 2021-03-10T14:34:00.079393+0000 mon.a (mon.0) 1208 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:00.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:00 gibba020 bash[25448]: audit 2021-03-10T14:34:00.080283+0000 mon.a (mon.0) 1209 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:00.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:00 gibba020 bash[25448]: audit 2021-03-10T14:34:00.081780+0000 mon.a (mon.0) 1210 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:00.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:00 gibba020 bash[25448]: audit 2021-03-10T14:34:00.084328+0000 mon.a (mon.0) 1211 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:00.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:00 gibba020 bash[25448]: audit 2021-03-10T14:34:00.086185+0000 mon.a (mon.0) 1212 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:00.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:00 gibba013 bash[29418]: audit 2021-03-10T14:33:59.848937+0000 mon.a (mon.0) 1205 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:34:00.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:00 gibba013 bash[29418]: cephadm 2021-03-10T14:33:59.853917+0000 mgr.gibba020.yqfnwy (mgr.34427) 2194 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:34:00.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:00 gibba013 bash[29418]: cephadm 2021-03-10T14:33:59.855711+0000 mgr.gibba020.yqfnwy (mgr.34427) 2195 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:34:00.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:00 gibba013 bash[29418]: audit 2021-03-10T14:34:00.075260+0000 mon.a (mon.0) 1206 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:34:00.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:00 gibba013 bash[29418]: audit 2021-03-10T14:34:00.078283+0000 mon.a (mon.0) 1207 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:34:00.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:00 gibba013 bash[29418]: audit 2021-03-10T14:34:00.079393+0000 mon.a (mon.0) 1208 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:00.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:00 gibba013 bash[29418]: audit 2021-03-10T14:34:00.080283+0000 mon.a (mon.0) 1209 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:00.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:00 gibba013 bash[29418]: audit 2021-03-10T14:34:00.081780+0000 mon.a (mon.0) 1210 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:00.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:00 gibba013 bash[29418]: audit 2021-03-10T14:34:00.084328+0000 mon.a (mon.0) 1211 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:00.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:00 gibba013 bash[29418]: audit 2021-03-10T14:34:00.086185+0000 mon.a (mon.0) 1212 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:00.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:00 gibba013 bash[30381]: audit 2021-03-10T14:33:59.848937+0000 mon.a (mon.0) 1205 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:34:00.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:00 gibba013 bash[30381]: cephadm 2021-03-10T14:33:59.853917+0000 mgr.gibba020.yqfnwy (mgr.34427) 2194 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:34:00.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:00 gibba013 bash[30381]: cephadm 2021-03-10T14:33:59.855711+0000 mgr.gibba020.yqfnwy (mgr.34427) 2195 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:34:00.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:00 gibba013 bash[30381]: audit 2021-03-10T14:34:00.075260+0000 mon.a (mon.0) 1206 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:34:00.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:00 gibba013 bash[30381]: audit 2021-03-10T14:34:00.078283+0000 mon.a (mon.0) 1207 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:34:00.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:00 gibba013 bash[30381]: audit 2021-03-10T14:34:00.079393+0000 mon.a (mon.0) 1208 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:00.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:00 gibba013 bash[30381]: audit 2021-03-10T14:34:00.080283+0000 mon.a (mon.0) 1209 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:00.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:00 gibba013 bash[30381]: audit 2021-03-10T14:34:00.081780+0000 mon.a (mon.0) 1210 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:00.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:00 gibba013 bash[30381]: audit 2021-03-10T14:34:00.084328+0000 mon.a (mon.0) 1211 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:00.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:00 gibba013 bash[30381]: audit 2021-03-10T14:34:00.086185+0000 mon.a (mon.0) 1212 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:02.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:01 gibba020 bash[25448]: cephadm 2021-03-10T14:34:00.076963+0000 mgr.gibba020.yqfnwy (mgr.34427) 2196 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:34:02.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:01 gibba020 bash[25448]: cephadm 2021-03-10T14:34:00.078411+0000 mgr.gibba020.yqfnwy (mgr.34427) 2197 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:34:02.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:01 gibba020 bash[25448]: cephadm 2021-03-10T14:34:00.079293+0000 mgr.gibba020.yqfnwy (mgr.34427) 2198 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:34:02.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:01 gibba020 bash[25448]: cephadm 2021-03-10T14:34:00.079331+0000 mgr.gibba020.yqfnwy (mgr.34427) 2199 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:34:02.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:01 gibba020 bash[25448]: cephadm 2021-03-10T14:34:00.080666+0000 mgr.gibba020.yqfnwy (mgr.34427) 2200 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:34:02.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:01 gibba020 bash[25448]: cephadm 2021-03-10T14:34:00.080704+0000 mgr.gibba020.yqfnwy (mgr.34427) 2201 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:34:02.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:01 gibba020 bash[25448]: cephadm 2021-03-10T14:34:00.081781+0000 mgr.gibba020.yqfnwy (mgr.34427) 2202 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:34:02.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:01 gibba020 bash[25448]: cephadm 2021-03-10T14:34:00.083048+0000 mgr.gibba020.yqfnwy (mgr.34427) 2203 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:34:02.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:01 gibba020 bash[25448]: cephadm 2021-03-10T14:34:00.083086+0000 mgr.gibba020.yqfnwy (mgr.34427) 2204 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:34:02.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:01 gibba020 bash[25448]: cephadm 2021-03-10T14:34:00.084714+0000 mgr.gibba020.yqfnwy (mgr.34427) 2205 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:34:02.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:01 gibba020 bash[25448]: cephadm 2021-03-10T14:34:00.085037+0000 mgr.gibba020.yqfnwy (mgr.34427) 2206 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:34:02.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:01 gibba020 bash[25448]: cephadm 2021-03-10T14:34:00.086675+0000 mgr.gibba020.yqfnwy (mgr.34427) 2207 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:34:02.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:01 gibba020 bash[25448]: cephadm 2021-03-10T14:34:00.086714+0000 mgr.gibba020.yqfnwy (mgr.34427) 2208 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:34:02.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:01 gibba020 bash[25448]: cephadm 2021-03-10T14:34:00.086819+0000 mgr.gibba020.yqfnwy (mgr.34427) 2209 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:34:02.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:01 gibba020 bash[25448]: cluster 2021-03-10T14:34:00.088644+0000 mgr.gibba020.yqfnwy (mgr.34427) 2210 : cluster [DBG] pgmap v1241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:02.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:01 gibba013 bash[29418]: cephadm 2021-03-10T14:34:00.076963+0000 mgr.gibba020.yqfnwy (mgr.34427) 2196 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:34:02.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:01 gibba013 bash[29418]: cephadm 2021-03-10T14:34:00.078411+0000 mgr.gibba020.yqfnwy (mgr.34427) 2197 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:34:02.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:01 gibba013 bash[29418]: cephadm 2021-03-10T14:34:00.079293+0000 mgr.gibba020.yqfnwy (mgr.34427) 2198 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:34:02.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:01 gibba013 bash[29418]: cephadm 2021-03-10T14:34:00.079331+0000 mgr.gibba020.yqfnwy (mgr.34427) 2199 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:34:02.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:01 gibba013 bash[29418]: cephadm 2021-03-10T14:34:00.080666+0000 mgr.gibba020.yqfnwy (mgr.34427) 2200 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:34:02.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:01 gibba013 bash[29418]: cephadm 2021-03-10T14:34:00.080704+0000 mgr.gibba020.yqfnwy (mgr.34427) 2201 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:34:02.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:01 gibba013 bash[29418]: cephadm 2021-03-10T14:34:00.081781+0000 mgr.gibba020.yqfnwy (mgr.34427) 2202 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:34:02.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:01 gibba013 bash[29418]: cephadm 2021-03-10T14:34:00.083048+0000 mgr.gibba020.yqfnwy (mgr.34427) 2203 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:34:02.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:01 gibba013 bash[29418]: cephadm 2021-03-10T14:34:00.083086+0000 mgr.gibba020.yqfnwy (mgr.34427) 2204 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:34:02.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:01 gibba013 bash[29418]: cephadm 2021-03-10T14:34:00.084714+0000 mgr.gibba020.yqfnwy (mgr.34427) 2205 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:34:02.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:01 gibba013 bash[29418]: cephadm 2021-03-10T14:34:00.085037+0000 mgr.gibba020.yqfnwy (mgr.34427) 2206 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:34:02.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:01 gibba013 bash[29418]: cephadm 2021-03-10T14:34:00.086675+0000 mgr.gibba020.yqfnwy (mgr.34427) 2207 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:34:02.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:01 gibba013 bash[29418]: cephadm 2021-03-10T14:34:00.086714+0000 mgr.gibba020.yqfnwy (mgr.34427) 2208 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:34:02.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:01 gibba013 bash[29418]: cephadm 2021-03-10T14:34:00.086819+0000 mgr.gibba020.yqfnwy (mgr.34427) 2209 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:34:02.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:01 gibba013 bash[29418]: cluster 2021-03-10T14:34:00.088644+0000 mgr.gibba020.yqfnwy (mgr.34427) 2210 : cluster [DBG] pgmap v1241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:02.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:01 gibba013 bash[30381]: cephadm 2021-03-10T14:34:00.076963+0000 mgr.gibba020.yqfnwy (mgr.34427) 2196 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:34:02.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:01 gibba013 bash[30381]: cephadm 2021-03-10T14:34:00.078411+0000 mgr.gibba020.yqfnwy (mgr.34427) 2197 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:34:02.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:01 gibba013 bash[30381]: cephadm 2021-03-10T14:34:00.079293+0000 mgr.gibba020.yqfnwy (mgr.34427) 2198 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:34:02.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:01 gibba013 bash[30381]: cephadm 2021-03-10T14:34:00.079331+0000 mgr.gibba020.yqfnwy (mgr.34427) 2199 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:34:02.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:01 gibba013 bash[30381]: cephadm 2021-03-10T14:34:00.080666+0000 mgr.gibba020.yqfnwy (mgr.34427) 2200 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:34:02.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:01 gibba013 bash[30381]: cephadm 2021-03-10T14:34:00.080704+0000 mgr.gibba020.yqfnwy (mgr.34427) 2201 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:34:02.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:01 gibba013 bash[30381]: cephadm 2021-03-10T14:34:00.081781+0000 mgr.gibba020.yqfnwy (mgr.34427) 2202 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:34:02.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:01 gibba013 bash[30381]: cephadm 2021-03-10T14:34:00.083048+0000 mgr.gibba020.yqfnwy (mgr.34427) 2203 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:34:02.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:01 gibba013 bash[30381]: cephadm 2021-03-10T14:34:00.083086+0000 mgr.gibba020.yqfnwy (mgr.34427) 2204 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:34:02.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:01 gibba013 bash[30381]: cephadm 2021-03-10T14:34:00.084714+0000 mgr.gibba020.yqfnwy (mgr.34427) 2205 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:34:02.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:01 gibba013 bash[30381]: cephadm 2021-03-10T14:34:00.085037+0000 mgr.gibba020.yqfnwy (mgr.34427) 2206 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:34:02.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:01 gibba013 bash[30381]: cephadm 2021-03-10T14:34:00.086675+0000 mgr.gibba020.yqfnwy (mgr.34427) 2207 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:34:02.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:01 gibba013 bash[30381]: cephadm 2021-03-10T14:34:00.086714+0000 mgr.gibba020.yqfnwy (mgr.34427) 2208 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:34:02.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:01 gibba013 bash[30381]: cephadm 2021-03-10T14:34:00.086819+0000 mgr.gibba020.yqfnwy (mgr.34427) 2209 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:34:02.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:01 gibba013 bash[30381]: cluster 2021-03-10T14:34:00.088644+0000 mgr.gibba020.yqfnwy (mgr.34427) 2210 : cluster [DBG] pgmap v1241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:04.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:03 gibba020 bash[25448]: cluster 2021-03-10T14:34:02.089646+0000 mgr.gibba020.yqfnwy (mgr.34427) 2211 : cluster [DBG] pgmap v1242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:04.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:03 gibba013 bash[29418]: cluster 2021-03-10T14:34:02.089646+0000 mgr.gibba020.yqfnwy (mgr.34427) 2211 : cluster [DBG] pgmap v1242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:04.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:03 gibba013 bash[30381]: cluster 2021-03-10T14:34:02.089646+0000 mgr.gibba020.yqfnwy (mgr.34427) 2211 : cluster [DBG] pgmap v1242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:06.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:05 gibba020 bash[25448]: cluster 2021-03-10T14:34:04.091302+0000 mgr.gibba020.yqfnwy (mgr.34427) 2212 : cluster [DBG] pgmap v1243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:06.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:05 gibba013 bash[29418]: cluster 2021-03-10T14:34:04.091302+0000 mgr.gibba020.yqfnwy (mgr.34427) 2212 : cluster [DBG] pgmap v1243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:06.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:05 gibba013 bash[30381]: cluster 2021-03-10T14:34:04.091302+0000 mgr.gibba020.yqfnwy (mgr.34427) 2212 : cluster [DBG] pgmap v1243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:07.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:06 gibba020 bash[25448]: audit 2021-03-10T14:34:06.128194+0000 mon.a (mon.0) 1213 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:34:07.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:06 gibba020 bash[25448]: audit 2021-03-10T14:34:06.129026+0000 mon.a (mon.0) 1214 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:34:07.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:06 gibba020 bash[25448]: audit 2021-03-10T14:34:06.129771+0000 mon.a (mon.0) 1215 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:34:07.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:06 gibba020 bash[25448]: audit 2021-03-10T14:34:06.130542+0000 mon.a (mon.0) 1216 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:34:07.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:06 gibba020 bash[25448]: audit 2021-03-10T14:34:06.189470+0000 mon.a (mon.0) 1217 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:34:07.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:06 gibba020 bash[25448]: audit 2021-03-10T14:34:06.195640+0000 mon.a (mon.0) 1218 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:34:07.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:06 gibba013 bash[29418]: audit 2021-03-10T14:34:06.128194+0000 mon.a (mon.0) 1213 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:34:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:06 gibba013 bash[29418]: audit 2021-03-10T14:34:06.129026+0000 mon.a (mon.0) 1214 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:34:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:06 gibba013 bash[29418]: audit 2021-03-10T14:34:06.129771+0000 mon.a (mon.0) 1215 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:34:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:06 gibba013 bash[29418]: audit 2021-03-10T14:34:06.130542+0000 mon.a (mon.0) 1216 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:34:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:06 gibba013 bash[29418]: audit 2021-03-10T14:34:06.189470+0000 mon.a (mon.0) 1217 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:34:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:06 gibba013 bash[29418]: audit 2021-03-10T14:34:06.195640+0000 mon.a (mon.0) 1218 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:34:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:06 gibba013 bash[30381]: audit 2021-03-10T14:34:06.128194+0000 mon.a (mon.0) 1213 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:34:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:06 gibba013 bash[30381]: audit 2021-03-10T14:34:06.129026+0000 mon.a (mon.0) 1214 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:34:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:06 gibba013 bash[30381]: audit 2021-03-10T14:34:06.129771+0000 mon.a (mon.0) 1215 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:34:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:06 gibba013 bash[30381]: audit 2021-03-10T14:34:06.130542+0000 mon.a (mon.0) 1216 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:34:07.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:06 gibba013 bash[30381]: audit 2021-03-10T14:34:06.189470+0000 mon.a (mon.0) 1217 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:34:07.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:06 gibba013 bash[30381]: audit 2021-03-10T14:34:06.195640+0000 mon.a (mon.0) 1218 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:34:08.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:07 gibba020 bash[25448]: cluster 2021-03-10T14:34:06.093073+0000 mgr.gibba020.yqfnwy (mgr.34427) 2213 : cluster [DBG] pgmap v1244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:08.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:07 gibba013 bash[29418]: cluster 2021-03-10T14:34:06.093073+0000 mgr.gibba020.yqfnwy (mgr.34427) 2213 : cluster [DBG] pgmap v1244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:08.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:07 gibba013 bash[30381]: cluster 2021-03-10T14:34:06.093073+0000 mgr.gibba020.yqfnwy (mgr.34427) 2213 : cluster [DBG] pgmap v1244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:10.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:09 gibba020 bash[25448]: cluster 2021-03-10T14:34:08.093744+0000 mgr.gibba020.yqfnwy (mgr.34427) 2214 : cluster [DBG] pgmap v1245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:10.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:09 gibba013 bash[29418]: cluster 2021-03-10T14:34:08.093744+0000 mgr.gibba020.yqfnwy (mgr.34427) 2214 : cluster [DBG] pgmap v1245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:10.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:09 gibba013 bash[30381]: cluster 2021-03-10T14:34:08.093744+0000 mgr.gibba020.yqfnwy (mgr.34427) 2214 : cluster [DBG] pgmap v1245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:12.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:11 gibba020 bash[25448]: cluster 2021-03-10T14:34:10.095492+0000 mgr.gibba020.yqfnwy (mgr.34427) 2215 : cluster [DBG] pgmap v1246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:12.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:11 gibba013 bash[29418]: cluster 2021-03-10T14:34:10.095492+0000 mgr.gibba020.yqfnwy (mgr.34427) 2215 : cluster [DBG] pgmap v1246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:12.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:11 gibba013 bash[30381]: cluster 2021-03-10T14:34:10.095492+0000 mgr.gibba020.yqfnwy (mgr.34427) 2215 : cluster [DBG] pgmap v1246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:14.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:13 gibba020 bash[25448]: cluster 2021-03-10T14:34:12.096915+0000 mgr.gibba020.yqfnwy (mgr.34427) 2216 : cluster [DBG] pgmap v1247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:14.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:13 gibba013 bash[29418]: cluster 2021-03-10T14:34:12.096915+0000 mgr.gibba020.yqfnwy (mgr.34427) 2216 : cluster [DBG] pgmap v1247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:14.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:13 gibba013 bash[30381]: cluster 2021-03-10T14:34:12.096915+0000 mgr.gibba020.yqfnwy (mgr.34427) 2216 : cluster [DBG] pgmap v1247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:16.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:15 gibba020 bash[25448]: cluster 2021-03-10T14:34:14.098419+0000 mgr.gibba020.yqfnwy (mgr.34427) 2217 : cluster [DBG] pgmap v1248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:16.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:15 gibba013 bash[29418]: cluster 2021-03-10T14:34:14.098419+0000 mgr.gibba020.yqfnwy (mgr.34427) 2217 : cluster [DBG] pgmap v1248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:16.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:15 gibba013 bash[30381]: cluster 2021-03-10T14:34:14.098419+0000 mgr.gibba020.yqfnwy (mgr.34427) 2217 : cluster [DBG] pgmap v1248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:17.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:16 gibba013 bash[29418]: cephadm 2021-03-10T14:34:15.102725+0000 mgr.gibba020.yqfnwy (mgr.34427) 2218 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:34:17.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:16 gibba013 bash[30381]: cephadm 2021-03-10T14:34:15.102725+0000 mgr.gibba020.yqfnwy (mgr.34427) 2218 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:34:17.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:16 gibba020 bash[25448]: cephadm 2021-03-10T14:34:15.102725+0000 mgr.gibba020.yqfnwy (mgr.34427) 2218 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:34:18.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:17 gibba013 bash[29418]: cluster 2021-03-10T14:34:16.100025+0000 mgr.gibba020.yqfnwy (mgr.34427) 2219 : cluster [DBG] pgmap v1249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:18.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:17 gibba013 bash[30381]: cluster 2021-03-10T14:34:16.100025+0000 mgr.gibba020.yqfnwy (mgr.34427) 2219 : cluster [DBG] pgmap v1249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:18.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:17 gibba020 bash[25448]: cluster 2021-03-10T14:34:16.100025+0000 mgr.gibba020.yqfnwy (mgr.34427) 2219 : cluster [DBG] pgmap v1249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:19.235 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:34:19.463 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:34:19.463 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (40m) 6m ago 46m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:34:19.463 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (46m) 5m ago 46m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:34:19.464 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (41m) 5m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:34:19.464 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (41m) 5m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:34:19.464 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (40m) 6m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:34:19.464 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (40m) 6m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:34:19.464 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (39m) 5m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:34:19.465 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (40m) 6m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:34:19.465 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (46m) 6m ago 46m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:34:19.465 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (46m) 5m ago 46m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:34:19.465 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (39m) 6m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:34:19.465 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (38m) 6m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:34:19.466 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (38m) 6m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:34:19.466 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (37m) 6m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:34:19.466 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (37m) 5m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:34:19.466 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (36m) 5m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:34:19.466 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (36m) 5m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:34:19.467 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (36m) 5m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:34:19.467 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (45m) 5m ago 46m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:34:19.467 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 5m ago 44m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:34:19.711 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:34:19.711 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:34:19.712 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:34:19.712 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:34:19.712 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:34:19.712 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:34:19.713 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:34:19.713 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:34:19.713 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:34:19.713 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:34:19.714 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:34:19.714 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:34:19.714 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:34:19.714 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:34:19.714 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:34:20.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:19 gibba013 bash[29418]: cluster 2021-03-10T14:34:18.101059+0000 mgr.gibba020.yqfnwy (mgr.34427) 2220 : cluster [DBG] pgmap v1250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:20.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:19 gibba013 bash[29418]: audit 2021-03-10T14:34:19.710336+0000 mon.a (mon.0) 1219 : audit [DBG] from='client.? 172.21.2.113:0/790699775' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:20.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:19 gibba013 bash[30381]: cluster 2021-03-10T14:34:18.101059+0000 mgr.gibba020.yqfnwy (mgr.34427) 2220 : cluster [DBG] pgmap v1250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:20.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:19 gibba013 bash[30381]: audit 2021-03-10T14:34:19.710336+0000 mon.a (mon.0) 1219 : audit [DBG] from='client.? 172.21.2.113:0/790699775' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:20.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:19 gibba020 bash[25448]: cluster 2021-03-10T14:34:18.101059+0000 mgr.gibba020.yqfnwy (mgr.34427) 2220 : cluster [DBG] pgmap v1250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:20.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:19 gibba020 bash[25448]: audit 2021-03-10T14:34:19.710336+0000 mon.a (mon.0) 1219 : audit [DBG] from='client.? 172.21.2.113:0/790699775' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:21.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:20 gibba013 bash[29418]: audit 2021-03-10T14:34:19.224882+0000 mgr.gibba020.yqfnwy (mgr.34427) 2221 : audit [DBG] from='client.55531 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:34:21.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:20 gibba013 bash[29418]: audit 2021-03-10T14:34:19.448945+0000 mgr.gibba020.yqfnwy (mgr.34427) 2222 : audit [DBG] from='client.45552 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:34:21.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:20 gibba013 bash[30381]: audit 2021-03-10T14:34:19.224882+0000 mgr.gibba020.yqfnwy (mgr.34427) 2221 : audit [DBG] from='client.55531 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:34:21.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:20 gibba013 bash[30381]: audit 2021-03-10T14:34:19.448945+0000 mgr.gibba020.yqfnwy (mgr.34427) 2222 : audit [DBG] from='client.45552 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:34:21.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:20 gibba020 bash[25448]: audit 2021-03-10T14:34:19.224882+0000 mgr.gibba020.yqfnwy (mgr.34427) 2221 : audit [DBG] from='client.55531 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:34:21.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:20 gibba020 bash[25448]: audit 2021-03-10T14:34:19.448945+0000 mgr.gibba020.yqfnwy (mgr.34427) 2222 : audit [DBG] from='client.45552 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:34:22.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:21 gibba013 bash[29418]: cluster 2021-03-10T14:34:20.103037+0000 mgr.gibba020.yqfnwy (mgr.34427) 2223 : cluster [DBG] pgmap v1251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:22.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:21 gibba013 bash[30381]: cluster 2021-03-10T14:34:20.103037+0000 mgr.gibba020.yqfnwy (mgr.34427) 2223 : cluster [DBG] pgmap v1251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:22.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:21 gibba020 bash[25448]: cluster 2021-03-10T14:34:20.103037+0000 mgr.gibba020.yqfnwy (mgr.34427) 2223 : cluster [DBG] pgmap v1251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:24.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:23 gibba013 bash[29418]: cluster 2021-03-10T14:34:22.104435+0000 mgr.gibba020.yqfnwy (mgr.34427) 2224 : cluster [DBG] pgmap v1252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:24.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:24 gibba013 bash[30381]: cluster 2021-03-10T14:34:22.104435+0000 mgr.gibba020.yqfnwy (mgr.34427) 2224 : cluster [DBG] pgmap v1252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:24.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:23 gibba020 bash[25448]: cluster 2021-03-10T14:34:22.104435+0000 mgr.gibba020.yqfnwy (mgr.34427) 2224 : cluster [DBG] pgmap v1252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:26.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:26 gibba013 bash[29418]: cluster 2021-03-10T14:34:24.106040+0000 mgr.gibba020.yqfnwy (mgr.34427) 2225 : cluster [DBG] pgmap v1253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:26.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:26 gibba013 bash[30381]: cluster 2021-03-10T14:34:24.106040+0000 mgr.gibba020.yqfnwy (mgr.34427) 2225 : cluster [DBG] pgmap v1253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:26.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:26 gibba020 bash[25448]: cluster 2021-03-10T14:34:24.106040+0000 mgr.gibba020.yqfnwy (mgr.34427) 2225 : cluster [DBG] pgmap v1253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:28.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:28 gibba013 bash[29418]: cluster 2021-03-10T14:34:26.107587+0000 mgr.gibba020.yqfnwy (mgr.34427) 2226 : cluster [DBG] pgmap v1254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:28.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:28 gibba013 bash[30381]: cluster 2021-03-10T14:34:26.107587+0000 mgr.gibba020.yqfnwy (mgr.34427) 2226 : cluster [DBG] pgmap v1254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:28.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:28 gibba020 bash[25448]: cluster 2021-03-10T14:34:26.107587+0000 mgr.gibba020.yqfnwy (mgr.34427) 2226 : cluster [DBG] pgmap v1254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:30.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:30 gibba013 bash[29418]: cluster 2021-03-10T14:34:28.108657+0000 mgr.gibba020.yqfnwy (mgr.34427) 2227 : cluster [DBG] pgmap v1255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:30.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:30 gibba013 bash[30381]: cluster 2021-03-10T14:34:28.108657+0000 mgr.gibba020.yqfnwy (mgr.34427) 2227 : cluster [DBG] pgmap v1255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:30.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:30 gibba020 bash[25448]: cluster 2021-03-10T14:34:28.108657+0000 mgr.gibba020.yqfnwy (mgr.34427) 2227 : cluster [DBG] pgmap v1255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:32.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:32 gibba013 bash[29418]: cluster 2021-03-10T14:34:30.110342+0000 mgr.gibba020.yqfnwy (mgr.34427) 2228 : cluster [DBG] pgmap v1256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:32.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:32 gibba013 bash[29418]: cephadm 2021-03-10T14:34:30.118531+0000 mgr.gibba020.yqfnwy (mgr.34427) 2229 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:34:32.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:32 gibba013 bash[30381]: cluster 2021-03-10T14:34:30.110342+0000 mgr.gibba020.yqfnwy (mgr.34427) 2228 : cluster [DBG] pgmap v1256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:32.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:32 gibba013 bash[30381]: cephadm 2021-03-10T14:34:30.118531+0000 mgr.gibba020.yqfnwy (mgr.34427) 2229 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:34:32.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:32 gibba020 bash[25448]: cluster 2021-03-10T14:34:30.110342+0000 mgr.gibba020.yqfnwy (mgr.34427) 2228 : cluster [DBG] pgmap v1256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:32.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:32 gibba020 bash[25448]: cephadm 2021-03-10T14:34:30.118531+0000 mgr.gibba020.yqfnwy (mgr.34427) 2229 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:34:34.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:34 gibba013 bash[29418]: cluster 2021-03-10T14:34:32.111382+0000 mgr.gibba020.yqfnwy (mgr.34427) 2230 : cluster [DBG] pgmap v1257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:34.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:34 gibba013 bash[30381]: cluster 2021-03-10T14:34:32.111382+0000 mgr.gibba020.yqfnwy (mgr.34427) 2230 : cluster [DBG] pgmap v1257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:34.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:34 gibba020 bash[25448]: cluster 2021-03-10T14:34:32.111382+0000 mgr.gibba020.yqfnwy (mgr.34427) 2230 : cluster [DBG] pgmap v1257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:36.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:36 gibba013 bash[29418]: cluster 2021-03-10T14:34:34.112439+0000 mgr.gibba020.yqfnwy (mgr.34427) 2231 : cluster [DBG] pgmap v1258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:36.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:36 gibba013 bash[30381]: cluster 2021-03-10T14:34:34.112439+0000 mgr.gibba020.yqfnwy (mgr.34427) 2231 : cluster [DBG] pgmap v1258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:36.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:36 gibba020 bash[25448]: cluster 2021-03-10T14:34:34.112439+0000 mgr.gibba020.yqfnwy (mgr.34427) 2231 : cluster [DBG] pgmap v1258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:38.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:38 gibba013 bash[29418]: cluster 2021-03-10T14:34:36.114025+0000 mgr.gibba020.yqfnwy (mgr.34427) 2232 : cluster [DBG] pgmap v1259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:38.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:38 gibba013 bash[30381]: cluster 2021-03-10T14:34:36.114025+0000 mgr.gibba020.yqfnwy (mgr.34427) 2232 : cluster [DBG] pgmap v1259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:38.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:38 gibba020 bash[25448]: cluster 2021-03-10T14:34:36.114025+0000 mgr.gibba020.yqfnwy (mgr.34427) 2232 : cluster [DBG] pgmap v1259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:40.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:40 gibba013 bash[29418]: cluster 2021-03-10T14:34:38.115124+0000 mgr.gibba020.yqfnwy (mgr.34427) 2233 : cluster [DBG] pgmap v1260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:40.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:40 gibba013 bash[30381]: cluster 2021-03-10T14:34:38.115124+0000 mgr.gibba020.yqfnwy (mgr.34427) 2233 : cluster [DBG] pgmap v1260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:40.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:40 gibba020 bash[25448]: cluster 2021-03-10T14:34:38.115124+0000 mgr.gibba020.yqfnwy (mgr.34427) 2233 : cluster [DBG] pgmap v1260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:42.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:42 gibba013 bash[29418]: cluster 2021-03-10T14:34:40.117123+0000 mgr.gibba020.yqfnwy (mgr.34427) 2234 : cluster [DBG] pgmap v1261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:42.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:42 gibba013 bash[30381]: cluster 2021-03-10T14:34:40.117123+0000 mgr.gibba020.yqfnwy (mgr.34427) 2234 : cluster [DBG] pgmap v1261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:42.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:42 gibba020 bash[25448]: cluster 2021-03-10T14:34:40.117123+0000 mgr.gibba020.yqfnwy (mgr.34427) 2234 : cluster [DBG] pgmap v1261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:43.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:43 gibba013 bash[29418]: cluster 2021-03-10T14:34:42.117983+0000 mgr.gibba020.yqfnwy (mgr.34427) 2235 : cluster [DBG] pgmap v1262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:43.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:43 gibba013 bash[30381]: cluster 2021-03-10T14:34:42.117983+0000 mgr.gibba020.yqfnwy (mgr.34427) 2235 : cluster [DBG] pgmap v1262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:43.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:43 gibba020 bash[25448]: cluster 2021-03-10T14:34:42.117983+0000 mgr.gibba020.yqfnwy (mgr.34427) 2235 : cluster [DBG] pgmap v1262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:45.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:45 gibba020 bash[25448]: cluster 2021-03-10T14:34:44.119486+0000 mgr.gibba020.yqfnwy (mgr.34427) 2236 : cluster [DBG] pgmap v1263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:45.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:45 gibba013 bash[29418]: cluster 2021-03-10T14:34:44.119486+0000 mgr.gibba020.yqfnwy (mgr.34427) 2236 : cluster [DBG] pgmap v1263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:45.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:45 gibba013 bash[30381]: cluster 2021-03-10T14:34:44.119486+0000 mgr.gibba020.yqfnwy (mgr.34427) 2236 : cluster [DBG] pgmap v1263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:47.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:46 gibba020 bash[25448]: cephadm 2021-03-10T14:34:45.132742+0000 mgr.gibba020.yqfnwy (mgr.34427) 2237 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:34:47.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:46 gibba013 bash[29418]: cephadm 2021-03-10T14:34:45.132742+0000 mgr.gibba020.yqfnwy (mgr.34427) 2237 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:34:47.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:46 gibba013 bash[30381]: cephadm 2021-03-10T14:34:45.132742+0000 mgr.gibba020.yqfnwy (mgr.34427) 2237 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:34:48.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:47 gibba020 bash[25448]: cluster 2021-03-10T14:34:46.121356+0000 mgr.gibba020.yqfnwy (mgr.34427) 2238 : cluster [DBG] pgmap v1264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:48.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:47 gibba013 bash[29418]: cluster 2021-03-10T14:34:46.121356+0000 mgr.gibba020.yqfnwy (mgr.34427) 2238 : cluster [DBG] pgmap v1264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:48.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:47 gibba013 bash[30381]: cluster 2021-03-10T14:34:46.121356+0000 mgr.gibba020.yqfnwy (mgr.34427) 2238 : cluster [DBG] pgmap v1264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:49.952 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:34:50.177 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:34:50.177 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (41m) 6m ago 46m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:34:50.177 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (46m) 5m ago 46m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:34:50.177 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (41m) 5m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:34:50.178 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (42m) 5m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:34:50.178 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (41m) 6m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:34:50.178 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (40m) 6m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:34:50.178 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (40m) 5m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:34:50.178 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (40m) 6m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:34:50.179 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (46m) 6m ago 46m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:34:50.179 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (46m) 5m ago 46m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:34:50.179 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (39m) 6m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:34:50.179 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (39m) 6m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:34:50.180 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (38m) 6m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:34:50.180 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (38m) 6m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:34:50.180 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (37m) 5m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:34:50.180 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (37m) 5m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:34:50.180 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (37m) 5m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:34:50.181 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (36m) 5m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:34:50.181 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (46m) 5m ago 46m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:34:50.181 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 5m ago 44m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:34:50.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:49 gibba020 bash[25448]: cluster 2021-03-10T14:34:48.122523+0000 mgr.gibba020.yqfnwy (mgr.34427) 2239 : cluster [DBG] pgmap v1265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:50.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:49 gibba013 bash[29418]: cluster 2021-03-10T14:34:48.122523+0000 mgr.gibba020.yqfnwy (mgr.34427) 2239 : cluster [DBG] pgmap v1265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:50.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:49 gibba013 bash[30381]: cluster 2021-03-10T14:34:48.122523+0000 mgr.gibba020.yqfnwy (mgr.34427) 2239 : cluster [DBG] pgmap v1265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:50.426 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:34:50.426 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:34:50.426 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:34:50.426 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:34:50.427 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:34:50.427 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:34:50.427 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:34:50.427 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:34:50.427 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:34:50.428 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:34:50.428 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:34:50.428 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:34:50.428 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:34:50.429 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:34:50.429 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:34:51.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:50 gibba020 bash[25448]: audit 2021-03-10T14:34:49.942015+0000 mgr.gibba020.yqfnwy (mgr.34427) 2240 : audit [DBG] from='client.55549 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:34:51.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:50 gibba020 bash[25448]: audit 2021-03-10T14:34:50.424988+0000 mon.c (mon.1) 46 : audit [DBG] from='client.? 172.21.2.113:0/3260414097' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:51.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:50 gibba013 bash[29418]: audit 2021-03-10T14:34:49.942015+0000 mgr.gibba020.yqfnwy (mgr.34427) 2240 : audit [DBG] from='client.55549 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:34:51.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:50 gibba013 bash[29418]: audit 2021-03-10T14:34:50.424988+0000 mon.c (mon.1) 46 : audit [DBG] from='client.? 172.21.2.113:0/3260414097' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:51.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:50 gibba013 bash[30381]: audit 2021-03-10T14:34:49.942015+0000 mgr.gibba020.yqfnwy (mgr.34427) 2240 : audit [DBG] from='client.55549 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:34:51.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:50 gibba013 bash[30381]: audit 2021-03-10T14:34:50.424988+0000 mon.c (mon.1) 46 : audit [DBG] from='client.? 172.21.2.113:0/3260414097' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:34:52.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:51 gibba020 bash[25448]: cluster 2021-03-10T14:34:50.124266+0000 mgr.gibba020.yqfnwy (mgr.34427) 2241 : cluster [DBG] pgmap v1266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:52.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:51 gibba020 bash[25448]: audit 2021-03-10T14:34:50.165507+0000 mgr.gibba020.yqfnwy (mgr.34427) 2242 : audit [DBG] from='client.45570 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:34:52.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:51 gibba013 bash[29418]: cluster 2021-03-10T14:34:50.124266+0000 mgr.gibba020.yqfnwy (mgr.34427) 2241 : cluster [DBG] pgmap v1266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:52.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:51 gibba013 bash[29418]: audit 2021-03-10T14:34:50.165507+0000 mgr.gibba020.yqfnwy (mgr.34427) 2242 : audit [DBG] from='client.45570 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:34:52.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:51 gibba013 bash[30381]: cluster 2021-03-10T14:34:50.124266+0000 mgr.gibba020.yqfnwy (mgr.34427) 2241 : cluster [DBG] pgmap v1266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:52.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:51 gibba013 bash[30381]: audit 2021-03-10T14:34:50.165507+0000 mgr.gibba020.yqfnwy (mgr.34427) 2242 : audit [DBG] from='client.45570 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:34:54.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:53 gibba020 bash[25448]: cluster 2021-03-10T14:34:52.125557+0000 mgr.gibba020.yqfnwy (mgr.34427) 2243 : cluster [DBG] pgmap v1267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:54.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:53 gibba013 bash[29418]: cluster 2021-03-10T14:34:52.125557+0000 mgr.gibba020.yqfnwy (mgr.34427) 2243 : cluster [DBG] pgmap v1267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:54.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:53 gibba013 bash[30381]: cluster 2021-03-10T14:34:52.125557+0000 mgr.gibba020.yqfnwy (mgr.34427) 2243 : cluster [DBG] pgmap v1267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:56.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:55 gibba013 bash[29418]: cluster 2021-03-10T14:34:54.127189+0000 mgr.gibba020.yqfnwy (mgr.34427) 2244 : cluster [DBG] pgmap v1268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:56.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:55 gibba013 bash[30381]: cluster 2021-03-10T14:34:54.127189+0000 mgr.gibba020.yqfnwy (mgr.34427) 2244 : cluster [DBG] pgmap v1268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:56.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:55 gibba020 bash[25448]: cluster 2021-03-10T14:34:54.127189+0000 mgr.gibba020.yqfnwy (mgr.34427) 2244 : cluster [DBG] pgmap v1268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:58.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:57 gibba013 bash[29418]: cluster 2021-03-10T14:34:56.128945+0000 mgr.gibba020.yqfnwy (mgr.34427) 2245 : cluster [DBG] pgmap v1269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:58.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:57 gibba013 bash[30381]: cluster 2021-03-10T14:34:56.128945+0000 mgr.gibba020.yqfnwy (mgr.34427) 2245 : cluster [DBG] pgmap v1269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:34:58.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:57 gibba020 bash[25448]: cluster 2021-03-10T14:34:56.128945+0000 mgr.gibba020.yqfnwy (mgr.34427) 2245 : cluster [DBG] pgmap v1269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:00.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:34:59 gibba013 bash[29418]: cluster 2021-03-10T14:34:58.130025+0000 mgr.gibba020.yqfnwy (mgr.34427) 2246 : cluster [DBG] pgmap v1270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:00.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:34:59 gibba013 bash[30381]: cluster 2021-03-10T14:34:58.130025+0000 mgr.gibba020.yqfnwy (mgr.34427) 2246 : cluster [DBG] pgmap v1270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:00.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:34:59 gibba020 bash[25448]: cluster 2021-03-10T14:34:58.130025+0000 mgr.gibba020.yqfnwy (mgr.34427) 2246 : cluster [DBG] pgmap v1270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:01.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:00 gibba013 bash[29418]: audit 2021-03-10T14:35:00.148366+0000 mon.a (mon.0) 1220 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:35:01.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:00 gibba013 bash[29418]: audit 2021-03-10T14:35:00.342216+0000 mon.a (mon.0) 1221 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:35:01.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:00 gibba013 bash[29418]: audit 2021-03-10T14:35:00.345278+0000 mon.a (mon.0) 1222 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:35:01.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:00 gibba013 bash[29418]: audit 2021-03-10T14:35:00.546782+0000 mon.a (mon.0) 1223 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:35:01.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:00 gibba013 bash[29418]: audit 2021-03-10T14:35:00.550071+0000 mon.a (mon.0) 1224 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:35:01.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:00 gibba013 bash[29418]: audit 2021-03-10T14:35:00.551386+0000 mon.a (mon.0) 1225 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:01.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:00 gibba013 bash[29418]: audit 2021-03-10T14:35:00.552848+0000 mon.a (mon.0) 1226 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:01.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:00 gibba013 bash[29418]: audit 2021-03-10T14:35:00.554275+0000 mon.a (mon.0) 1227 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:01.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:00 gibba013 bash[29418]: audit 2021-03-10T14:35:00.557575+0000 mon.a (mon.0) 1228 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:01.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:00 gibba013 bash[29418]: audit 2021-03-10T14:35:00.559404+0000 mon.a (mon.0) 1229 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:01.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:00 gibba013 bash[30381]: audit 2021-03-10T14:35:00.148366+0000 mon.a (mon.0) 1220 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:35:01.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:00 gibba013 bash[30381]: audit 2021-03-10T14:35:00.342216+0000 mon.a (mon.0) 1221 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:35:01.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:00 gibba013 bash[30381]: audit 2021-03-10T14:35:00.345278+0000 mon.a (mon.0) 1222 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:35:01.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:00 gibba013 bash[30381]: audit 2021-03-10T14:35:00.546782+0000 mon.a (mon.0) 1223 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:35:01.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:00 gibba013 bash[30381]: audit 2021-03-10T14:35:00.550071+0000 mon.a (mon.0) 1224 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:35:01.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:00 gibba013 bash[30381]: audit 2021-03-10T14:35:00.551386+0000 mon.a (mon.0) 1225 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:01.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:00 gibba013 bash[30381]: audit 2021-03-10T14:35:00.552848+0000 mon.a (mon.0) 1226 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:01.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:00 gibba013 bash[30381]: audit 2021-03-10T14:35:00.554275+0000 mon.a (mon.0) 1227 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:01.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:00 gibba013 bash[30381]: audit 2021-03-10T14:35:00.557575+0000 mon.a (mon.0) 1228 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:01.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:00 gibba013 bash[30381]: audit 2021-03-10T14:35:00.559404+0000 mon.a (mon.0) 1229 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:01.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:00 gibba020 bash[25448]: audit 2021-03-10T14:35:00.148366+0000 mon.a (mon.0) 1220 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:35:01.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:00 gibba020 bash[25448]: audit 2021-03-10T14:35:00.342216+0000 mon.a (mon.0) 1221 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:35:01.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:00 gibba020 bash[25448]: audit 2021-03-10T14:35:00.345278+0000 mon.a (mon.0) 1222 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:35:01.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:00 gibba020 bash[25448]: audit 2021-03-10T14:35:00.546782+0000 mon.a (mon.0) 1223 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:35:01.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:00 gibba020 bash[25448]: audit 2021-03-10T14:35:00.550071+0000 mon.a (mon.0) 1224 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:35:01.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:00 gibba020 bash[25448]: audit 2021-03-10T14:35:00.551386+0000 mon.a (mon.0) 1225 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:01.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:00 gibba020 bash[25448]: audit 2021-03-10T14:35:00.552848+0000 mon.a (mon.0) 1226 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:01.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:00 gibba020 bash[25448]: audit 2021-03-10T14:35:00.554275+0000 mon.a (mon.0) 1227 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:01.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:00 gibba020 bash[25448]: audit 2021-03-10T14:35:00.557575+0000 mon.a (mon.0) 1228 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:01.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:00 gibba020 bash[25448]: audit 2021-03-10T14:35:00.559404+0000 mon.a (mon.0) 1229 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:02.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:01 gibba013 bash[29418]: cluster 2021-03-10T14:35:00.130974+0000 mgr.gibba020.yqfnwy (mgr.34427) 2247 : cluster [DBG] pgmap v1271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:02.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:01 gibba013 bash[29418]: cephadm 2021-03-10T14:35:00.342204+0000 mgr.gibba020.yqfnwy (mgr.34427) 2248 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:35:02.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:01 gibba013 bash[29418]: cephadm 2021-03-10T14:35:00.345509+0000 mgr.gibba020.yqfnwy (mgr.34427) 2249 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:35:02.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:01 gibba013 bash[29418]: cephadm 2021-03-10T14:35:00.548677+0000 mgr.gibba020.yqfnwy (mgr.34427) 2250 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:35:02.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:01 gibba013 bash[29418]: cephadm 2021-03-10T14:35:00.550357+0000 mgr.gibba020.yqfnwy (mgr.34427) 2251 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:35:02.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:01 gibba013 bash[29418]: cephadm 2021-03-10T14:35:00.551688+0000 mgr.gibba020.yqfnwy (mgr.34427) 2252 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:35:02.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:01 gibba013 bash[29418]: cephadm 2021-03-10T14:35:00.551726+0000 mgr.gibba020.yqfnwy (mgr.34427) 2253 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:35:02.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:01 gibba013 bash[29418]: cephadm 2021-03-10T14:35:00.553298+0000 mgr.gibba020.yqfnwy (mgr.34427) 2254 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:35:02.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:01 gibba013 bash[29418]: cephadm 2021-03-10T14:35:00.553334+0000 mgr.gibba020.yqfnwy (mgr.34427) 2255 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:35:02.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:01 gibba013 bash[29418]: cephadm 2021-03-10T14:35:00.554826+0000 mgr.gibba020.yqfnwy (mgr.34427) 2256 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:35:02.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:01 gibba013 bash[29418]: cephadm 2021-03-10T14:35:00.556310+0000 mgr.gibba020.yqfnwy (mgr.34427) 2257 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:35:02.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:01 gibba013 bash[29418]: cephadm 2021-03-10T14:35:00.556347+0000 mgr.gibba020.yqfnwy (mgr.34427) 2258 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:35:02.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:01 gibba013 bash[29418]: cephadm 2021-03-10T14:35:00.558022+0000 mgr.gibba020.yqfnwy (mgr.34427) 2259 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:35:02.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:01 gibba013 bash[29418]: cephadm 2021-03-10T14:35:00.558336+0000 mgr.gibba020.yqfnwy (mgr.34427) 2260 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:35:02.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:01 gibba013 bash[29418]: cephadm 2021-03-10T14:35:00.559729+0000 mgr.gibba020.yqfnwy (mgr.34427) 2261 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:35:02.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:01 gibba013 bash[29418]: cephadm 2021-03-10T14:35:00.559767+0000 mgr.gibba020.yqfnwy (mgr.34427) 2262 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:35:02.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:01 gibba013 bash[29418]: cephadm 2021-03-10T14:35:00.559871+0000 mgr.gibba020.yqfnwy (mgr.34427) 2263 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:35:02.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:01 gibba013 bash[30381]: cluster 2021-03-10T14:35:00.130974+0000 mgr.gibba020.yqfnwy (mgr.34427) 2247 : cluster [DBG] pgmap v1271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:02.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:01 gibba013 bash[30381]: cephadm 2021-03-10T14:35:00.342204+0000 mgr.gibba020.yqfnwy (mgr.34427) 2248 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:35:02.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:01 gibba013 bash[30381]: cephadm 2021-03-10T14:35:00.345509+0000 mgr.gibba020.yqfnwy (mgr.34427) 2249 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:35:02.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:01 gibba013 bash[30381]: cephadm 2021-03-10T14:35:00.548677+0000 mgr.gibba020.yqfnwy (mgr.34427) 2250 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:35:02.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:01 gibba013 bash[30381]: cephadm 2021-03-10T14:35:00.550357+0000 mgr.gibba020.yqfnwy (mgr.34427) 2251 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:35:02.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:01 gibba013 bash[30381]: cephadm 2021-03-10T14:35:00.551688+0000 mgr.gibba020.yqfnwy (mgr.34427) 2252 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:35:02.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:01 gibba013 bash[30381]: cephadm 2021-03-10T14:35:00.551726+0000 mgr.gibba020.yqfnwy (mgr.34427) 2253 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:35:02.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:01 gibba013 bash[30381]: cephadm 2021-03-10T14:35:00.553298+0000 mgr.gibba020.yqfnwy (mgr.34427) 2254 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:35:02.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:01 gibba013 bash[30381]: cephadm 2021-03-10T14:35:00.553334+0000 mgr.gibba020.yqfnwy (mgr.34427) 2255 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:35:02.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:01 gibba013 bash[30381]: cephadm 2021-03-10T14:35:00.554826+0000 mgr.gibba020.yqfnwy (mgr.34427) 2256 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:35:02.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:01 gibba013 bash[30381]: cephadm 2021-03-10T14:35:00.556310+0000 mgr.gibba020.yqfnwy (mgr.34427) 2257 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:35:02.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:01 gibba013 bash[30381]: cephadm 2021-03-10T14:35:00.556347+0000 mgr.gibba020.yqfnwy (mgr.34427) 2258 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:35:02.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:01 gibba013 bash[30381]: cephadm 2021-03-10T14:35:00.558022+0000 mgr.gibba020.yqfnwy (mgr.34427) 2259 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:35:02.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:01 gibba013 bash[30381]: cephadm 2021-03-10T14:35:00.558336+0000 mgr.gibba020.yqfnwy (mgr.34427) 2260 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:35:02.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:01 gibba013 bash[30381]: cephadm 2021-03-10T14:35:00.559729+0000 mgr.gibba020.yqfnwy (mgr.34427) 2261 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:35:02.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:01 gibba013 bash[30381]: cephadm 2021-03-10T14:35:00.559767+0000 mgr.gibba020.yqfnwy (mgr.34427) 2262 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:35:02.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:01 gibba013 bash[30381]: cephadm 2021-03-10T14:35:00.559871+0000 mgr.gibba020.yqfnwy (mgr.34427) 2263 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:35:02.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:01 gibba020 bash[25448]: cluster 2021-03-10T14:35:00.130974+0000 mgr.gibba020.yqfnwy (mgr.34427) 2247 : cluster [DBG] pgmap v1271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:02.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:01 gibba020 bash[25448]: cephadm 2021-03-10T14:35:00.342204+0000 mgr.gibba020.yqfnwy (mgr.34427) 2248 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:35:02.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:01 gibba020 bash[25448]: cephadm 2021-03-10T14:35:00.345509+0000 mgr.gibba020.yqfnwy (mgr.34427) 2249 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:35:02.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:01 gibba020 bash[25448]: cephadm 2021-03-10T14:35:00.548677+0000 mgr.gibba020.yqfnwy (mgr.34427) 2250 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:35:02.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:01 gibba020 bash[25448]: cephadm 2021-03-10T14:35:00.550357+0000 mgr.gibba020.yqfnwy (mgr.34427) 2251 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:35:02.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:01 gibba020 bash[25448]: cephadm 2021-03-10T14:35:00.551688+0000 mgr.gibba020.yqfnwy (mgr.34427) 2252 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:35:02.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:01 gibba020 bash[25448]: cephadm 2021-03-10T14:35:00.551726+0000 mgr.gibba020.yqfnwy (mgr.34427) 2253 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:35:02.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:01 gibba020 bash[25448]: cephadm 2021-03-10T14:35:00.553298+0000 mgr.gibba020.yqfnwy (mgr.34427) 2254 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:35:02.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:01 gibba020 bash[25448]: cephadm 2021-03-10T14:35:00.553334+0000 mgr.gibba020.yqfnwy (mgr.34427) 2255 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:35:02.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:01 gibba020 bash[25448]: cephadm 2021-03-10T14:35:00.554826+0000 mgr.gibba020.yqfnwy (mgr.34427) 2256 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:35:02.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:01 gibba020 bash[25448]: cephadm 2021-03-10T14:35:00.556310+0000 mgr.gibba020.yqfnwy (mgr.34427) 2257 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:35:02.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:01 gibba020 bash[25448]: cephadm 2021-03-10T14:35:00.556347+0000 mgr.gibba020.yqfnwy (mgr.34427) 2258 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:35:02.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:01 gibba020 bash[25448]: cephadm 2021-03-10T14:35:00.558022+0000 mgr.gibba020.yqfnwy (mgr.34427) 2259 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:35:02.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:01 gibba020 bash[25448]: cephadm 2021-03-10T14:35:00.558336+0000 mgr.gibba020.yqfnwy (mgr.34427) 2260 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:35:02.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:01 gibba020 bash[25448]: cephadm 2021-03-10T14:35:00.559729+0000 mgr.gibba020.yqfnwy (mgr.34427) 2261 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:35:02.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:01 gibba020 bash[25448]: cephadm 2021-03-10T14:35:00.559767+0000 mgr.gibba020.yqfnwy (mgr.34427) 2262 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:35:02.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:01 gibba020 bash[25448]: cephadm 2021-03-10T14:35:00.559871+0000 mgr.gibba020.yqfnwy (mgr.34427) 2263 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:35:04.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:03 gibba013 bash[29418]: cluster 2021-03-10T14:35:02.132272+0000 mgr.gibba020.yqfnwy (mgr.34427) 2264 : cluster [DBG] pgmap v1272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:04.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:03 gibba013 bash[30381]: cluster 2021-03-10T14:35:02.132272+0000 mgr.gibba020.yqfnwy (mgr.34427) 2264 : cluster [DBG] pgmap v1272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:04.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:03 gibba020 bash[25448]: cluster 2021-03-10T14:35:02.132272+0000 mgr.gibba020.yqfnwy (mgr.34427) 2264 : cluster [DBG] pgmap v1272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:06.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:05 gibba013 bash[29418]: cluster 2021-03-10T14:35:04.133741+0000 mgr.gibba020.yqfnwy (mgr.34427) 2265 : cluster [DBG] pgmap v1273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:06.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:05 gibba013 bash[30381]: cluster 2021-03-10T14:35:04.133741+0000 mgr.gibba020.yqfnwy (mgr.34427) 2265 : cluster [DBG] pgmap v1273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:06.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:05 gibba020 bash[25448]: cluster 2021-03-10T14:35:04.133741+0000 mgr.gibba020.yqfnwy (mgr.34427) 2265 : cluster [DBG] pgmap v1273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:07 gibba013 bash[29418]: audit 2021-03-10T14:35:06.140406+0000 mon.a (mon.0) 1230 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:35:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:07 gibba013 bash[29418]: audit 2021-03-10T14:35:06.141181+0000 mon.a (mon.0) 1231 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:35:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:07 gibba013 bash[29418]: audit 2021-03-10T14:35:06.141878+0000 mon.a (mon.0) 1232 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T14:35:07.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:07 gibba013 bash[29418]: audit 2021-03-10T14:35:06.142569+0000 mon.a (mon.0) 1233 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:35:07.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:07 gibba013 bash[29418]: audit 2021-03-10T14:35:06.195715+0000 mon.a (mon.0) 1234 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:35:07.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:07 gibba013 bash[29418]: audit 2021-03-10T14:35:06.201738+0000 mon.a (mon.0) 1235 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:35:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:07 gibba013 bash[30381]: audit 2021-03-10T14:35:06.140406+0000 mon.a (mon.0) 1230 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:35:07.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:07 gibba013 bash[30381]: audit 2021-03-10T14:35:06.141181+0000 mon.a (mon.0) 1231 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:35:07.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:07 gibba013 bash[30381]: audit 2021-03-10T14:35:06.141878+0000 mon.a (mon.0) 1232 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T14:35:07.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:07 gibba013 bash[30381]: audit 2021-03-10T14:35:06.142569+0000 mon.a (mon.0) 1233 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:35:07.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:07 gibba013 bash[30381]: audit 2021-03-10T14:35:06.195715+0000 mon.a (mon.0) 1234 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:35:07.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:07 gibba013 bash[30381]: audit 2021-03-10T14:35:06.201738+0000 mon.a (mon.0) 1235 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:35:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:07 gibba020 bash[25448]: audit 2021-03-10T14:35:06.140406+0000 mon.a (mon.0) 1230 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:35:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:07 gibba020 bash[25448]: audit 2021-03-10T14:35:06.141181+0000 mon.a (mon.0) 1231 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T14:35:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:07 gibba020 bash[25448]: audit 2021-03-10T14:35:06.141878+0000 mon.a (mon.0) 1232 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T14:35:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:07 gibba020 bash[25448]: audit 2021-03-10T14:35:06.142569+0000 mon.a (mon.0) 1233 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:35:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:07 gibba020 bash[25448]: audit 2021-03-10T14:35:06.195715+0000 mon.a (mon.0) 1234 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:35:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:07 gibba020 bash[25448]: audit 2021-03-10T14:35:06.201738+0000 mon.a (mon.0) 1235 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:35:08.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:08 gibba013 bash[29418]: cluster 2021-03-10T14:35:06.135265+0000 mgr.gibba020.yqfnwy (mgr.34427) 2266 : cluster [DBG] pgmap v1274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:08.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:08 gibba013 bash[30381]: cluster 2021-03-10T14:35:06.135265+0000 mgr.gibba020.yqfnwy (mgr.34427) 2266 : cluster [DBG] pgmap v1274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:08.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:08 gibba020 bash[25448]: cluster 2021-03-10T14:35:06.135265+0000 mgr.gibba020.yqfnwy (mgr.34427) 2266 : cluster [DBG] pgmap v1274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:10.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:10 gibba013 bash[29418]: cluster 2021-03-10T14:35:08.136388+0000 mgr.gibba020.yqfnwy (mgr.34427) 2267 : cluster [DBG] pgmap v1275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:10.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:10 gibba013 bash[30381]: cluster 2021-03-10T14:35:08.136388+0000 mgr.gibba020.yqfnwy (mgr.34427) 2267 : cluster [DBG] pgmap v1275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:10.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:10 gibba020 bash[25448]: cluster 2021-03-10T14:35:08.136388+0000 mgr.gibba020.yqfnwy (mgr.34427) 2267 : cluster [DBG] pgmap v1275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:12.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:12 gibba013 bash[29418]: cluster 2021-03-10T14:35:10.138345+0000 mgr.gibba020.yqfnwy (mgr.34427) 2268 : cluster [DBG] pgmap v1276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:12.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:12 gibba013 bash[30381]: cluster 2021-03-10T14:35:10.138345+0000 mgr.gibba020.yqfnwy (mgr.34427) 2268 : cluster [DBG] pgmap v1276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:12.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:12 gibba020 bash[25448]: cluster 2021-03-10T14:35:10.138345+0000 mgr.gibba020.yqfnwy (mgr.34427) 2268 : cluster [DBG] pgmap v1276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:14.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:14 gibba013 bash[29418]: cluster 2021-03-10T14:35:12.139686+0000 mgr.gibba020.yqfnwy (mgr.34427) 2269 : cluster [DBG] pgmap v1277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:14.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:14 gibba013 bash[30381]: cluster 2021-03-10T14:35:12.139686+0000 mgr.gibba020.yqfnwy (mgr.34427) 2269 : cluster [DBG] pgmap v1277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:14.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:14 gibba020 bash[25448]: cluster 2021-03-10T14:35:12.139686+0000 mgr.gibba020.yqfnwy (mgr.34427) 2269 : cluster [DBG] pgmap v1277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:16.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:16 gibba013 bash[29418]: cluster 2021-03-10T14:35:14.141491+0000 mgr.gibba020.yqfnwy (mgr.34427) 2270 : cluster [DBG] pgmap v1278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:16.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:16 gibba013 bash[30381]: cluster 2021-03-10T14:35:14.141491+0000 mgr.gibba020.yqfnwy (mgr.34427) 2270 : cluster [DBG] pgmap v1278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:16.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:16 gibba020 bash[25448]: cluster 2021-03-10T14:35:14.141491+0000 mgr.gibba020.yqfnwy (mgr.34427) 2270 : cluster [DBG] pgmap v1278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:17.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:17 gibba013 bash[29418]: cephadm 2021-03-10T14:35:15.575872+0000 mgr.gibba020.yqfnwy (mgr.34427) 2271 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:35:17.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:17 gibba013 bash[30381]: cephadm 2021-03-10T14:35:15.575872+0000 mgr.gibba020.yqfnwy (mgr.34427) 2271 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:35:17.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:17 gibba020 bash[25448]: cephadm 2021-03-10T14:35:15.575872+0000 mgr.gibba020.yqfnwy (mgr.34427) 2271 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:35:18.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:18 gibba013 bash[29418]: cluster 2021-03-10T14:35:16.143386+0000 mgr.gibba020.yqfnwy (mgr.34427) 2272 : cluster [DBG] pgmap v1279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:18.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:18 gibba013 bash[30381]: cluster 2021-03-10T14:35:16.143386+0000 mgr.gibba020.yqfnwy (mgr.34427) 2272 : cluster [DBG] pgmap v1279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:18.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:18 gibba020 bash[25448]: cluster 2021-03-10T14:35:16.143386+0000 mgr.gibba020.yqfnwy (mgr.34427) 2272 : cluster [DBG] pgmap v1279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:20.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:20 gibba013 bash[29418]: cluster 2021-03-10T14:35:18.144567+0000 mgr.gibba020.yqfnwy (mgr.34427) 2273 : cluster [DBG] pgmap v1280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:20.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:20 gibba013 bash[30381]: cluster 2021-03-10T14:35:18.144567+0000 mgr.gibba020.yqfnwy (mgr.34427) 2273 : cluster [DBG] pgmap v1280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:20.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:20 gibba020 bash[25448]: cluster 2021-03-10T14:35:18.144567+0000 mgr.gibba020.yqfnwy (mgr.34427) 2273 : cluster [DBG] pgmap v1280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:20.666 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:35:20.892 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:35:20.892 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (41m) 7m ago 47m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:35:20.893 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (47m) 6m ago 47m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:35:20.893 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (42m) 6m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:35:20.893 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (42m) 6m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:35:20.893 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (41m) 7m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:35:20.893 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (41m) 7m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:35:20.894 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (40m) 6m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:35:20.894 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (41m) 7m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:35:20.894 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (47m) 7m ago 47m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:35:20.894 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (47m) 6m ago 47m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:35:20.895 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (40m) 7m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:35:20.895 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (39m) 7m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:35:20.895 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (39m) 7m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:35:20.895 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (38m) 7m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:35:20.895 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (38m) 6m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:35:20.896 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (37m) 6m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:35:20.896 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (37m) 6m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:35:20.896 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (37m) 6m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:35:20.896 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (46m) 6m ago 47m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:35:20.897 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 6m ago 45m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:35:21.143 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:35:21.144 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:35:21.144 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:35:21.144 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:35:21.144 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:35:21.144 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:35:21.145 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:35:21.145 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:35:21.145 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:35:21.145 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:35:21.145 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:35:21.146 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:35:21.146 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:35:21.146 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:35:21.146 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:35:22.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:22 gibba013 bash[29418]: cluster 2021-03-10T14:35:20.146642+0000 mgr.gibba020.yqfnwy (mgr.34427) 2274 : cluster [DBG] pgmap v1281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:22.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:22 gibba013 bash[29418]: audit 2021-03-10T14:35:20.655401+0000 mgr.gibba020.yqfnwy (mgr.34427) 2275 : audit [DBG] from='client.45582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:35:22.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:22 gibba013 bash[29418]: audit 2021-03-10T14:35:20.878135+0000 mgr.gibba020.yqfnwy (mgr.34427) 2276 : audit [DBG] from='client.55573 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:35:22.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:22 gibba013 bash[29418]: audit 2021-03-10T14:35:21.142197+0000 mon.a (mon.0) 1236 : audit [DBG] from='client.? 172.21.2.113:0/3273381848' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:22.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:22 gibba013 bash[30381]: cluster 2021-03-10T14:35:20.146642+0000 mgr.gibba020.yqfnwy (mgr.34427) 2274 : cluster [DBG] pgmap v1281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:22.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:22 gibba013 bash[30381]: audit 2021-03-10T14:35:20.655401+0000 mgr.gibba020.yqfnwy (mgr.34427) 2275 : audit [DBG] from='client.45582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:35:22.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:22 gibba013 bash[30381]: audit 2021-03-10T14:35:20.878135+0000 mgr.gibba020.yqfnwy (mgr.34427) 2276 : audit [DBG] from='client.55573 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:35:22.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:22 gibba013 bash[30381]: audit 2021-03-10T14:35:21.142197+0000 mon.a (mon.0) 1236 : audit [DBG] from='client.? 172.21.2.113:0/3273381848' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:22.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:22 gibba020 bash[25448]: cluster 2021-03-10T14:35:20.146642+0000 mgr.gibba020.yqfnwy (mgr.34427) 2274 : cluster [DBG] pgmap v1281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:22.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:22 gibba020 bash[25448]: audit 2021-03-10T14:35:20.655401+0000 mgr.gibba020.yqfnwy (mgr.34427) 2275 : audit [DBG] from='client.45582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:35:22.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:22 gibba020 bash[25448]: audit 2021-03-10T14:35:20.878135+0000 mgr.gibba020.yqfnwy (mgr.34427) 2276 : audit [DBG] from='client.55573 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:35:22.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:22 gibba020 bash[25448]: audit 2021-03-10T14:35:21.142197+0000 mon.a (mon.0) 1236 : audit [DBG] from='client.? 172.21.2.113:0/3273381848' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:24.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:24 gibba013 bash[29418]: cluster 2021-03-10T14:35:22.147760+0000 mgr.gibba020.yqfnwy (mgr.34427) 2277 : cluster [DBG] pgmap v1282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:24.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:24 gibba013 bash[30381]: cluster 2021-03-10T14:35:22.147760+0000 mgr.gibba020.yqfnwy (mgr.34427) 2277 : cluster [DBG] pgmap v1282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:24.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:24 gibba020 bash[25448]: cluster 2021-03-10T14:35:22.147760+0000 mgr.gibba020.yqfnwy (mgr.34427) 2277 : cluster [DBG] pgmap v1282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:26.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:26 gibba013 bash[29418]: cluster 2021-03-10T14:35:24.148645+0000 mgr.gibba020.yqfnwy (mgr.34427) 2278 : cluster [DBG] pgmap v1283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:26.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:26 gibba013 bash[30381]: cluster 2021-03-10T14:35:24.148645+0000 mgr.gibba020.yqfnwy (mgr.34427) 2278 : cluster [DBG] pgmap v1283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:26.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:26 gibba020 bash[25448]: cluster 2021-03-10T14:35:24.148645+0000 mgr.gibba020.yqfnwy (mgr.34427) 2278 : cluster [DBG] pgmap v1283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:27.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:27 gibba020 bash[25448]: cluster 2021-03-10T14:35:26.150140+0000 mgr.gibba020.yqfnwy (mgr.34427) 2279 : cluster [DBG] pgmap v1284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:27.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:27 gibba013 bash[29418]: cluster 2021-03-10T14:35:26.150140+0000 mgr.gibba020.yqfnwy (mgr.34427) 2279 : cluster [DBG] pgmap v1284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:27.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:27 gibba013 bash[30381]: cluster 2021-03-10T14:35:26.150140+0000 mgr.gibba020.yqfnwy (mgr.34427) 2279 : cluster [DBG] pgmap v1284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:29.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:29 gibba013 bash[29418]: cluster 2021-03-10T14:35:28.151210+0000 mgr.gibba020.yqfnwy (mgr.34427) 2280 : cluster [DBG] pgmap v1285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:29.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:29 gibba013 bash[30381]: cluster 2021-03-10T14:35:28.151210+0000 mgr.gibba020.yqfnwy (mgr.34427) 2280 : cluster [DBG] pgmap v1285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:29.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:29 gibba020 bash[25448]: cluster 2021-03-10T14:35:28.151210+0000 mgr.gibba020.yqfnwy (mgr.34427) 2280 : cluster [DBG] pgmap v1285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:32.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:31 gibba020 bash[25448]: cluster 2021-03-10T14:35:30.153210+0000 mgr.gibba020.yqfnwy (mgr.34427) 2281 : cluster [DBG] pgmap v1286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:32.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:31 gibba020 bash[25448]: cephadm 2021-03-10T14:35:30.591989+0000 mgr.gibba020.yqfnwy (mgr.34427) 2282 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:35:32.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:31 gibba013 bash[29418]: cluster 2021-03-10T14:35:30.153210+0000 mgr.gibba020.yqfnwy (mgr.34427) 2281 : cluster [DBG] pgmap v1286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:32.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:31 gibba013 bash[29418]: cephadm 2021-03-10T14:35:30.591989+0000 mgr.gibba020.yqfnwy (mgr.34427) 2282 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:35:32.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:31 gibba013 bash[30381]: cluster 2021-03-10T14:35:30.153210+0000 mgr.gibba020.yqfnwy (mgr.34427) 2281 : cluster [DBG] pgmap v1286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:32.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:31 gibba013 bash[30381]: cephadm 2021-03-10T14:35:30.591989+0000 mgr.gibba020.yqfnwy (mgr.34427) 2282 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:35:34.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:33 gibba020 bash[25448]: cluster 2021-03-10T14:35:32.153657+0000 mgr.gibba020.yqfnwy (mgr.34427) 2283 : cluster [DBG] pgmap v1287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:34.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:33 gibba013 bash[29418]: cluster 2021-03-10T14:35:32.153657+0000 mgr.gibba020.yqfnwy (mgr.34427) 2283 : cluster [DBG] pgmap v1287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:34.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:33 gibba013 bash[30381]: cluster 2021-03-10T14:35:32.153657+0000 mgr.gibba020.yqfnwy (mgr.34427) 2283 : cluster [DBG] pgmap v1287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:36.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:35 gibba020 bash[25448]: cluster 2021-03-10T14:35:34.155000+0000 mgr.gibba020.yqfnwy (mgr.34427) 2284 : cluster [DBG] pgmap v1288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:36.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:35 gibba013 bash[29418]: cluster 2021-03-10T14:35:34.155000+0000 mgr.gibba020.yqfnwy (mgr.34427) 2284 : cluster [DBG] pgmap v1288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:36.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:35 gibba013 bash[30381]: cluster 2021-03-10T14:35:34.155000+0000 mgr.gibba020.yqfnwy (mgr.34427) 2284 : cluster [DBG] pgmap v1288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:38.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:37 gibba013 bash[29418]: cluster 2021-03-10T14:35:36.156758+0000 mgr.gibba020.yqfnwy (mgr.34427) 2285 : cluster [DBG] pgmap v1289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:38.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:37 gibba013 bash[30381]: cluster 2021-03-10T14:35:36.156758+0000 mgr.gibba020.yqfnwy (mgr.34427) 2285 : cluster [DBG] pgmap v1289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:38.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:37 gibba020 bash[25448]: cluster 2021-03-10T14:35:36.156758+0000 mgr.gibba020.yqfnwy (mgr.34427) 2285 : cluster [DBG] pgmap v1289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:40.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:39 gibba013 bash[29418]: cluster 2021-03-10T14:35:38.157194+0000 mgr.gibba020.yqfnwy (mgr.34427) 2286 : cluster [DBG] pgmap v1290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:40.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:39 gibba013 bash[30381]: cluster 2021-03-10T14:35:38.157194+0000 mgr.gibba020.yqfnwy (mgr.34427) 2286 : cluster [DBG] pgmap v1290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:40.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:39 gibba020 bash[25448]: cluster 2021-03-10T14:35:38.157194+0000 mgr.gibba020.yqfnwy (mgr.34427) 2286 : cluster [DBG] pgmap v1290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:42.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:41 gibba013 bash[29418]: cluster 2021-03-10T14:35:40.158759+0000 mgr.gibba020.yqfnwy (mgr.34427) 2287 : cluster [DBG] pgmap v1291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:42.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:41 gibba013 bash[30381]: cluster 2021-03-10T14:35:40.158759+0000 mgr.gibba020.yqfnwy (mgr.34427) 2287 : cluster [DBG] pgmap v1291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:42.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:41 gibba020 bash[25448]: cluster 2021-03-10T14:35:40.158759+0000 mgr.gibba020.yqfnwy (mgr.34427) 2287 : cluster [DBG] pgmap v1291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:44.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:43 gibba013 bash[29418]: cluster 2021-03-10T14:35:42.160103+0000 mgr.gibba020.yqfnwy (mgr.34427) 2288 : cluster [DBG] pgmap v1292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:44.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:43 gibba013 bash[30381]: cluster 2021-03-10T14:35:42.160103+0000 mgr.gibba020.yqfnwy (mgr.34427) 2288 : cluster [DBG] pgmap v1292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:44.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:43 gibba020 bash[25448]: cluster 2021-03-10T14:35:42.160103+0000 mgr.gibba020.yqfnwy (mgr.34427) 2288 : cluster [DBG] pgmap v1292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:46.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:45 gibba013 bash[29418]: cluster 2021-03-10T14:35:44.160644+0000 mgr.gibba020.yqfnwy (mgr.34427) 2289 : cluster [DBG] pgmap v1293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:46.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:45 gibba013 bash[30381]: cluster 2021-03-10T14:35:44.160644+0000 mgr.gibba020.yqfnwy (mgr.34427) 2289 : cluster [DBG] pgmap v1293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:46.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:45 gibba020 bash[25448]: cluster 2021-03-10T14:35:44.160644+0000 mgr.gibba020.yqfnwy (mgr.34427) 2289 : cluster [DBG] pgmap v1293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:47.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:46 gibba013 bash[29418]: cephadm 2021-03-10T14:35:45.608043+0000 mgr.gibba020.yqfnwy (mgr.34427) 2290 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:35:47.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:46 gibba013 bash[30381]: cephadm 2021-03-10T14:35:45.608043+0000 mgr.gibba020.yqfnwy (mgr.34427) 2290 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:35:47.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:46 gibba020 bash[25448]: cephadm 2021-03-10T14:35:45.608043+0000 mgr.gibba020.yqfnwy (mgr.34427) 2290 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:35:48.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:47 gibba013 bash[29418]: cluster 2021-03-10T14:35:46.162110+0000 mgr.gibba020.yqfnwy (mgr.34427) 2291 : cluster [DBG] pgmap v1294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:48.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:48 gibba013 bash[30381]: cluster 2021-03-10T14:35:46.162110+0000 mgr.gibba020.yqfnwy (mgr.34427) 2291 : cluster [DBG] pgmap v1294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:48.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:47 gibba020 bash[25448]: cluster 2021-03-10T14:35:46.162110+0000 mgr.gibba020.yqfnwy (mgr.34427) 2291 : cluster [DBG] pgmap v1294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:50.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:50 gibba013 bash[29418]: cluster 2021-03-10T14:35:48.163398+0000 mgr.gibba020.yqfnwy (mgr.34427) 2292 : cluster [DBG] pgmap v1295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:50.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:50 gibba013 bash[30381]: cluster 2021-03-10T14:35:48.163398+0000 mgr.gibba020.yqfnwy (mgr.34427) 2292 : cluster [DBG] pgmap v1295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:50.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:50 gibba020 bash[25448]: cluster 2021-03-10T14:35:48.163398+0000 mgr.gibba020.yqfnwy (mgr.34427) 2292 : cluster [DBG] pgmap v1295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:51.386 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:35:51.611 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:35:51.611 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (42m) 7m ago 47m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:35:51.611 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (47m) 6m ago 47m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:35:51.611 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (42m) 6m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:35:51.612 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (43m) 6m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:35:51.612 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (42m) 7m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:35:51.612 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (41m) 7m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:35:51.613 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (41m) 6m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:35:51.613 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (41m) 7m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:35:51.613 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (47m) 7m ago 47m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:35:51.613 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (47m) 6m ago 47m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:35:51.613 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (40m) 7m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:35:51.614 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (40m) 7m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:35:51.614 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (39m) 7m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:35:51.614 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (39m) 7m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:35:51.615 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (38m) 6m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:35:51.615 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (38m) 6m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:35:51.615 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (38m) 6m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:35:51.615 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (37m) 6m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:35:51.615 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (47m) 6m ago 47m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:35:51.616 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 6m ago 45m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:35:51.862 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:35:51.862 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:35:51.862 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:35:51.862 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:35:51.863 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:35:51.863 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:35:51.863 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:35:51.863 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:35:51.863 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:35:51.864 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:35:51.864 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:35:51.864 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:35:51.864 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:35:51.864 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:35:51.865 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:35:52.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:52 gibba013 bash[29418]: cluster 2021-03-10T14:35:50.165031+0000 mgr.gibba020.yqfnwy (mgr.34427) 2293 : cluster [DBG] pgmap v1296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:52.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:52 gibba013 bash[29418]: audit 2021-03-10T14:35:51.860521+0000 mon.a (mon.0) 1237 : audit [DBG] from='client.? 172.21.2.113:0/1502235786' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:52.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:52 gibba013 bash[30381]: cluster 2021-03-10T14:35:50.165031+0000 mgr.gibba020.yqfnwy (mgr.34427) 2293 : cluster [DBG] pgmap v1296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:52.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:52 gibba013 bash[30381]: audit 2021-03-10T14:35:51.860521+0000 mon.a (mon.0) 1237 : audit [DBG] from='client.? 172.21.2.113:0/1502235786' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:52.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:52 gibba020 bash[25448]: cluster 2021-03-10T14:35:50.165031+0000 mgr.gibba020.yqfnwy (mgr.34427) 2293 : cluster [DBG] pgmap v1296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:52.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:52 gibba020 bash[25448]: audit 2021-03-10T14:35:51.860521+0000 mon.a (mon.0) 1237 : audit [DBG] from='client.? 172.21.2.113:0/1502235786' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:35:53.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:53 gibba013 bash[29418]: audit 2021-03-10T14:35:51.375389+0000 mgr.gibba020.yqfnwy (mgr.34427) 2294 : audit [DBG] from='client.55585 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:35:53.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:53 gibba013 bash[29418]: audit 2021-03-10T14:35:51.597297+0000 mgr.gibba020.yqfnwy (mgr.34427) 2295 : audit [DBG] from='client.55591 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:35:53.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:53 gibba013 bash[30381]: audit 2021-03-10T14:35:51.375389+0000 mgr.gibba020.yqfnwy (mgr.34427) 2294 : audit [DBG] from='client.55585 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:35:53.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:53 gibba013 bash[30381]: audit 2021-03-10T14:35:51.597297+0000 mgr.gibba020.yqfnwy (mgr.34427) 2295 : audit [DBG] from='client.55591 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:35:53.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:53 gibba020 bash[25448]: audit 2021-03-10T14:35:51.375389+0000 mgr.gibba020.yqfnwy (mgr.34427) 2294 : audit [DBG] from='client.55585 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:35:53.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:53 gibba020 bash[25448]: audit 2021-03-10T14:35:51.597297+0000 mgr.gibba020.yqfnwy (mgr.34427) 2295 : audit [DBG] from='client.55591 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:35:54.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:54 gibba013 bash[29418]: cluster 2021-03-10T14:35:52.165698+0000 mgr.gibba020.yqfnwy (mgr.34427) 2296 : cluster [DBG] pgmap v1297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:54.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:54 gibba013 bash[30381]: cluster 2021-03-10T14:35:52.165698+0000 mgr.gibba020.yqfnwy (mgr.34427) 2296 : cluster [DBG] pgmap v1297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:54.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:54 gibba020 bash[25448]: cluster 2021-03-10T14:35:52.165698+0000 mgr.gibba020.yqfnwy (mgr.34427) 2296 : cluster [DBG] pgmap v1297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:56.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:56 gibba013 bash[29418]: cluster 2021-03-10T14:35:54.166982+0000 mgr.gibba020.yqfnwy (mgr.34427) 2297 : cluster [DBG] pgmap v1298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:56.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:56 gibba013 bash[30381]: cluster 2021-03-10T14:35:54.166982+0000 mgr.gibba020.yqfnwy (mgr.34427) 2297 : cluster [DBG] pgmap v1298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:56.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:56 gibba020 bash[25448]: cluster 2021-03-10T14:35:54.166982+0000 mgr.gibba020.yqfnwy (mgr.34427) 2297 : cluster [DBG] pgmap v1298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:58.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:35:58 gibba013 bash[29418]: cluster 2021-03-10T14:35:56.168621+0000 mgr.gibba020.yqfnwy (mgr.34427) 2298 : cluster [DBG] pgmap v1299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:58.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:35:58 gibba013 bash[30381]: cluster 2021-03-10T14:35:56.168621+0000 mgr.gibba020.yqfnwy (mgr.34427) 2298 : cluster [DBG] pgmap v1299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:35:58.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:35:58 gibba020 bash[25448]: cluster 2021-03-10T14:35:56.168621+0000 mgr.gibba020.yqfnwy (mgr.34427) 2298 : cluster [DBG] pgmap v1299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:00.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:00 gibba013 bash[29418]: cluster 2021-03-10T14:35:58.169830+0000 mgr.gibba020.yqfnwy (mgr.34427) 2299 : cluster [DBG] pgmap v1300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:00.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:00 gibba013 bash[30381]: cluster 2021-03-10T14:35:58.169830+0000 mgr.gibba020.yqfnwy (mgr.34427) 2299 : cluster [DBG] pgmap v1300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:00.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:00 gibba020 bash[25448]: cluster 2021-03-10T14:35:58.169830+0000 mgr.gibba020.yqfnwy (mgr.34427) 2299 : cluster [DBG] pgmap v1300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:01.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:01 gibba020 bash[25448]: audit 2021-03-10T14:36:00.625700+0000 mon.a (mon.0) 1238 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:36:01.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:01 gibba020 bash[25448]: audit 2021-03-10T14:36:00.846625+0000 mon.a (mon.0) 1239 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:36:01.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:01 gibba020 bash[25448]: audit 2021-03-10T14:36:00.849954+0000 mon.a (mon.0) 1240 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:36:01.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:01 gibba020 bash[25448]: audit 2021-03-10T14:36:00.851859+0000 mon.a (mon.0) 1241 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:01.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:01 gibba020 bash[25448]: audit 2021-03-10T14:36:00.853634+0000 mon.a (mon.0) 1242 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:01.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:01 gibba020 bash[25448]: audit 2021-03-10T14:36:00.855073+0000 mon.a (mon.0) 1243 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:01.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:01 gibba020 bash[25448]: audit 2021-03-10T14:36:00.858320+0000 mon.a (mon.0) 1244 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:01.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:01 gibba020 bash[25448]: audit 2021-03-10T14:36:00.859916+0000 mon.a (mon.0) 1245 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:01.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:01 gibba013 bash[29418]: audit 2021-03-10T14:36:00.625700+0000 mon.a (mon.0) 1238 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:36:01.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:01 gibba013 bash[29418]: audit 2021-03-10T14:36:00.846625+0000 mon.a (mon.0) 1239 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:36:01.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:01 gibba013 bash[29418]: audit 2021-03-10T14:36:00.849954+0000 mon.a (mon.0) 1240 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:36:01.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:01 gibba013 bash[29418]: audit 2021-03-10T14:36:00.851859+0000 mon.a (mon.0) 1241 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:01.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:01 gibba013 bash[29418]: audit 2021-03-10T14:36:00.853634+0000 mon.a (mon.0) 1242 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:01.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:01 gibba013 bash[29418]: audit 2021-03-10T14:36:00.855073+0000 mon.a (mon.0) 1243 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:01.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:01 gibba013 bash[29418]: audit 2021-03-10T14:36:00.858320+0000 mon.a (mon.0) 1244 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:01.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:01 gibba013 bash[29418]: audit 2021-03-10T14:36:00.859916+0000 mon.a (mon.0) 1245 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:01.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:01 gibba013 bash[30381]: audit 2021-03-10T14:36:00.625700+0000 mon.a (mon.0) 1238 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:36:01.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:01 gibba013 bash[30381]: audit 2021-03-10T14:36:00.846625+0000 mon.a (mon.0) 1239 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:36:01.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:01 gibba013 bash[30381]: audit 2021-03-10T14:36:00.849954+0000 mon.a (mon.0) 1240 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:36:01.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:01 gibba013 bash[30381]: audit 2021-03-10T14:36:00.851859+0000 mon.a (mon.0) 1241 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:01.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:01 gibba013 bash[30381]: audit 2021-03-10T14:36:00.853634+0000 mon.a (mon.0) 1242 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:01.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:01 gibba013 bash[30381]: audit 2021-03-10T14:36:00.855073+0000 mon.a (mon.0) 1243 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:01.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:01 gibba013 bash[30381]: audit 2021-03-10T14:36:00.858320+0000 mon.a (mon.0) 1244 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:01.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:01 gibba013 bash[30381]: audit 2021-03-10T14:36:00.859916+0000 mon.a (mon.0) 1245 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:02.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:02 gibba013 bash[29418]: cluster 2021-03-10T14:36:00.171398+0000 mgr.gibba020.yqfnwy (mgr.34427) 2300 : cluster [DBG] pgmap v1301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:02.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:02 gibba013 bash[29418]: cephadm 2021-03-10T14:36:00.630366+0000 mgr.gibba020.yqfnwy (mgr.34427) 2301 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:36:02.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:02 gibba013 bash[29418]: cephadm 2021-03-10T14:36:00.632388+0000 mgr.gibba020.yqfnwy (mgr.34427) 2302 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:36:02.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:02 gibba013 bash[29418]: cephadm 2021-03-10T14:36:00.848458+0000 mgr.gibba020.yqfnwy (mgr.34427) 2303 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:36:02.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:02 gibba013 bash[29418]: cephadm 2021-03-10T14:36:00.850718+0000 mgr.gibba020.yqfnwy (mgr.34427) 2304 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:36:02.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:02 gibba013 bash[29418]: cephadm 2021-03-10T14:36:00.852464+0000 mgr.gibba020.yqfnwy (mgr.34427) 2305 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:36:02.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:02 gibba013 bash[29418]: cephadm 2021-03-10T14:36:00.852500+0000 mgr.gibba020.yqfnwy (mgr.34427) 2306 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:36:02.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:02 gibba013 bash[29418]: cephadm 2021-03-10T14:36:00.853822+0000 mgr.gibba020.yqfnwy (mgr.34427) 2307 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:36:02.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:02 gibba013 bash[29418]: cephadm 2021-03-10T14:36:00.853860+0000 mgr.gibba020.yqfnwy (mgr.34427) 2308 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:36:02.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:02 gibba013 bash[29418]: cephadm 2021-03-10T14:36:00.855497+0000 mgr.gibba020.yqfnwy (mgr.34427) 2309 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:36:02.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:02 gibba013 bash[29418]: cephadm 2021-03-10T14:36:00.857060+0000 mgr.gibba020.yqfnwy (mgr.34427) 2310 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:36:02.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:02 gibba013 bash[29418]: cephadm 2021-03-10T14:36:00.857096+0000 mgr.gibba020.yqfnwy (mgr.34427) 2311 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:36:02.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:02 gibba013 bash[29418]: cephadm 2021-03-10T14:36:00.858540+0000 mgr.gibba020.yqfnwy (mgr.34427) 2312 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:36:02.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:02 gibba013 bash[29418]: cephadm 2021-03-10T14:36:00.858858+0000 mgr.gibba020.yqfnwy (mgr.34427) 2313 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:36:02.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:02 gibba013 bash[29418]: cephadm 2021-03-10T14:36:00.860291+0000 mgr.gibba020.yqfnwy (mgr.34427) 2314 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:36:02.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:02 gibba013 bash[29418]: cephadm 2021-03-10T14:36:00.860329+0000 mgr.gibba020.yqfnwy (mgr.34427) 2315 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:36:02.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:02 gibba013 bash[29418]: cephadm 2021-03-10T14:36:00.860434+0000 mgr.gibba020.yqfnwy (mgr.34427) 2316 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:36:02.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:02 gibba013 bash[30381]: cluster 2021-03-10T14:36:00.171398+0000 mgr.gibba020.yqfnwy (mgr.34427) 2300 : cluster [DBG] pgmap v1301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:02.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:02 gibba013 bash[30381]: cephadm 2021-03-10T14:36:00.630366+0000 mgr.gibba020.yqfnwy (mgr.34427) 2301 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:36:02.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:02 gibba013 bash[30381]: cephadm 2021-03-10T14:36:00.632388+0000 mgr.gibba020.yqfnwy (mgr.34427) 2302 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:36:02.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:02 gibba013 bash[30381]: cephadm 2021-03-10T14:36:00.848458+0000 mgr.gibba020.yqfnwy (mgr.34427) 2303 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:36:02.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:02 gibba013 bash[30381]: cephadm 2021-03-10T14:36:00.850718+0000 mgr.gibba020.yqfnwy (mgr.34427) 2304 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:36:02.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:02 gibba013 bash[30381]: cephadm 2021-03-10T14:36:00.852464+0000 mgr.gibba020.yqfnwy (mgr.34427) 2305 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:36:02.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:02 gibba013 bash[30381]: cephadm 2021-03-10T14:36:00.852500+0000 mgr.gibba020.yqfnwy (mgr.34427) 2306 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:36:02.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:02 gibba013 bash[30381]: cephadm 2021-03-10T14:36:00.853822+0000 mgr.gibba020.yqfnwy (mgr.34427) 2307 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:36:02.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:02 gibba013 bash[30381]: cephadm 2021-03-10T14:36:00.853860+0000 mgr.gibba020.yqfnwy (mgr.34427) 2308 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:36:02.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:02 gibba013 bash[30381]: cephadm 2021-03-10T14:36:00.855497+0000 mgr.gibba020.yqfnwy (mgr.34427) 2309 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:36:02.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:02 gibba013 bash[30381]: cephadm 2021-03-10T14:36:00.857060+0000 mgr.gibba020.yqfnwy (mgr.34427) 2310 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:36:02.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:02 gibba013 bash[30381]: cephadm 2021-03-10T14:36:00.857096+0000 mgr.gibba020.yqfnwy (mgr.34427) 2311 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:36:02.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:02 gibba013 bash[30381]: cephadm 2021-03-10T14:36:00.858540+0000 mgr.gibba020.yqfnwy (mgr.34427) 2312 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:36:02.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:02 gibba013 bash[30381]: cephadm 2021-03-10T14:36:00.858858+0000 mgr.gibba020.yqfnwy (mgr.34427) 2313 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:36:02.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:02 gibba013 bash[30381]: cephadm 2021-03-10T14:36:00.860291+0000 mgr.gibba020.yqfnwy (mgr.34427) 2314 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:36:02.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:02 gibba013 bash[30381]: cephadm 2021-03-10T14:36:00.860329+0000 mgr.gibba020.yqfnwy (mgr.34427) 2315 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:36:02.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:02 gibba013 bash[30381]: cephadm 2021-03-10T14:36:00.860434+0000 mgr.gibba020.yqfnwy (mgr.34427) 2316 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:36:02.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:02 gibba020 bash[25448]: cluster 2021-03-10T14:36:00.171398+0000 mgr.gibba020.yqfnwy (mgr.34427) 2300 : cluster [DBG] pgmap v1301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:02.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:02 gibba020 bash[25448]: cephadm 2021-03-10T14:36:00.630366+0000 mgr.gibba020.yqfnwy (mgr.34427) 2301 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:36:02.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:02 gibba020 bash[25448]: cephadm 2021-03-10T14:36:00.632388+0000 mgr.gibba020.yqfnwy (mgr.34427) 2302 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:36:02.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:02 gibba020 bash[25448]: cephadm 2021-03-10T14:36:00.848458+0000 mgr.gibba020.yqfnwy (mgr.34427) 2303 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:36:02.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:02 gibba020 bash[25448]: cephadm 2021-03-10T14:36:00.850718+0000 mgr.gibba020.yqfnwy (mgr.34427) 2304 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:36:02.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:02 gibba020 bash[25448]: cephadm 2021-03-10T14:36:00.852464+0000 mgr.gibba020.yqfnwy (mgr.34427) 2305 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:36:02.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:02 gibba020 bash[25448]: cephadm 2021-03-10T14:36:00.852500+0000 mgr.gibba020.yqfnwy (mgr.34427) 2306 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:36:02.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:02 gibba020 bash[25448]: cephadm 2021-03-10T14:36:00.853822+0000 mgr.gibba020.yqfnwy (mgr.34427) 2307 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:36:02.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:02 gibba020 bash[25448]: cephadm 2021-03-10T14:36:00.853860+0000 mgr.gibba020.yqfnwy (mgr.34427) 2308 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:36:02.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:02 gibba020 bash[25448]: cephadm 2021-03-10T14:36:00.855497+0000 mgr.gibba020.yqfnwy (mgr.34427) 2309 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:36:02.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:02 gibba020 bash[25448]: cephadm 2021-03-10T14:36:00.857060+0000 mgr.gibba020.yqfnwy (mgr.34427) 2310 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:36:02.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:02 gibba020 bash[25448]: cephadm 2021-03-10T14:36:00.857096+0000 mgr.gibba020.yqfnwy (mgr.34427) 2311 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:36:02.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:02 gibba020 bash[25448]: cephadm 2021-03-10T14:36:00.858540+0000 mgr.gibba020.yqfnwy (mgr.34427) 2312 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:36:02.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:02 gibba020 bash[25448]: cephadm 2021-03-10T14:36:00.858858+0000 mgr.gibba020.yqfnwy (mgr.34427) 2313 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:36:02.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:02 gibba020 bash[25448]: cephadm 2021-03-10T14:36:00.860291+0000 mgr.gibba020.yqfnwy (mgr.34427) 2314 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:36:02.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:02 gibba020 bash[25448]: cephadm 2021-03-10T14:36:00.860329+0000 mgr.gibba020.yqfnwy (mgr.34427) 2315 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:36:02.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:02 gibba020 bash[25448]: cephadm 2021-03-10T14:36:00.860434+0000 mgr.gibba020.yqfnwy (mgr.34427) 2316 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:36:04.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:04 gibba013 bash[29418]: cluster 2021-03-10T14:36:02.172569+0000 mgr.gibba020.yqfnwy (mgr.34427) 2317 : cluster [DBG] pgmap v1302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:04.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:04 gibba013 bash[30381]: cluster 2021-03-10T14:36:02.172569+0000 mgr.gibba020.yqfnwy (mgr.34427) 2317 : cluster [DBG] pgmap v1302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:04.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:04 gibba020 bash[25448]: cluster 2021-03-10T14:36:02.172569+0000 mgr.gibba020.yqfnwy (mgr.34427) 2317 : cluster [DBG] pgmap v1302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:06.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:06 gibba013 bash[29418]: cluster 2021-03-10T14:36:04.173741+0000 mgr.gibba020.yqfnwy (mgr.34427) 2318 : cluster [DBG] pgmap v1303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:06.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:06 gibba013 bash[30381]: cluster 2021-03-10T14:36:04.173741+0000 mgr.gibba020.yqfnwy (mgr.34427) 2318 : cluster [DBG] pgmap v1303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:06.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:06 gibba020 bash[25448]: cluster 2021-03-10T14:36:04.173741+0000 mgr.gibba020.yqfnwy (mgr.34427) 2318 : cluster [DBG] pgmap v1303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:07.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:07 gibba013 bash[29418]: audit 2021-03-10T14:36:06.151212+0000 mon.a (mon.0) 1246 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:36:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:07 gibba013 bash[29418]: audit 2021-03-10T14:36:06.151572+0000 mon.a (mon.0) 1247 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T14:36:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:07 gibba013 bash[29418]: audit 2021-03-10T14:36:06.151884+0000 mon.a (mon.0) 1248 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:36:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:07 gibba013 bash[29418]: audit 2021-03-10T14:36:06.152177+0000 mon.a (mon.0) 1249 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:36:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:07 gibba013 bash[29418]: audit 2021-03-10T14:36:06.202053+0000 mon.a (mon.0) 1250 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:36:07.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:07 gibba013 bash[29418]: audit 2021-03-10T14:36:06.208444+0000 mon.a (mon.0) 1251 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:36:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:07 gibba013 bash[30381]: audit 2021-03-10T14:36:06.151212+0000 mon.a (mon.0) 1246 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:36:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:07 gibba013 bash[30381]: audit 2021-03-10T14:36:06.151572+0000 mon.a (mon.0) 1247 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T14:36:07.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:07 gibba013 bash[30381]: audit 2021-03-10T14:36:06.151884+0000 mon.a (mon.0) 1248 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:36:07.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:07 gibba013 bash[30381]: audit 2021-03-10T14:36:06.152177+0000 mon.a (mon.0) 1249 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:36:07.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:07 gibba013 bash[30381]: audit 2021-03-10T14:36:06.202053+0000 mon.a (mon.0) 1250 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:36:07.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:07 gibba013 bash[30381]: audit 2021-03-10T14:36:06.208444+0000 mon.a (mon.0) 1251 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:36:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:07 gibba020 bash[25448]: audit 2021-03-10T14:36:06.151212+0000 mon.a (mon.0) 1246 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T14:36:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:07 gibba020 bash[25448]: audit 2021-03-10T14:36:06.151572+0000 mon.a (mon.0) 1247 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T14:36:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:07 gibba020 bash[25448]: audit 2021-03-10T14:36:06.151884+0000 mon.a (mon.0) 1248 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:36:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:07 gibba020 bash[25448]: audit 2021-03-10T14:36:06.152177+0000 mon.a (mon.0) 1249 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:36:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:07 gibba020 bash[25448]: audit 2021-03-10T14:36:06.202053+0000 mon.a (mon.0) 1250 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:36:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:07 gibba020 bash[25448]: audit 2021-03-10T14:36:06.208444+0000 mon.a (mon.0) 1251 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:36:08.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:08 gibba013 bash[29418]: cluster 2021-03-10T14:36:06.175231+0000 mgr.gibba020.yqfnwy (mgr.34427) 2319 : cluster [DBG] pgmap v1304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:08.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:08 gibba013 bash[30381]: cluster 2021-03-10T14:36:06.175231+0000 mgr.gibba020.yqfnwy (mgr.34427) 2319 : cluster [DBG] pgmap v1304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:08.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:08 gibba020 bash[25448]: cluster 2021-03-10T14:36:06.175231+0000 mgr.gibba020.yqfnwy (mgr.34427) 2319 : cluster [DBG] pgmap v1304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:09.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:09 gibba020 bash[25448]: cluster 2021-03-10T14:36:08.175723+0000 mgr.gibba020.yqfnwy (mgr.34427) 2320 : cluster [DBG] pgmap v1305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:09.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:09 gibba013 bash[29418]: cluster 2021-03-10T14:36:08.175723+0000 mgr.gibba020.yqfnwy (mgr.34427) 2320 : cluster [DBG] pgmap v1305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:09.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:09 gibba013 bash[30381]: cluster 2021-03-10T14:36:08.175723+0000 mgr.gibba020.yqfnwy (mgr.34427) 2320 : cluster [DBG] pgmap v1305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:12.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:11 gibba013 bash[29418]: cluster 2021-03-10T14:36:10.177352+0000 mgr.gibba020.yqfnwy (mgr.34427) 2321 : cluster [DBG] pgmap v1306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:12.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:11 gibba013 bash[30381]: cluster 2021-03-10T14:36:10.177352+0000 mgr.gibba020.yqfnwy (mgr.34427) 2321 : cluster [DBG] pgmap v1306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:12.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:11 gibba020 bash[25448]: cluster 2021-03-10T14:36:10.177352+0000 mgr.gibba020.yqfnwy (mgr.34427) 2321 : cluster [DBG] pgmap v1306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:14.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:13 gibba013 bash[29418]: cluster 2021-03-10T14:36:12.178432+0000 mgr.gibba020.yqfnwy (mgr.34427) 2322 : cluster [DBG] pgmap v1307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:14.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:13 gibba013 bash[30381]: cluster 2021-03-10T14:36:12.178432+0000 mgr.gibba020.yqfnwy (mgr.34427) 2322 : cluster [DBG] pgmap v1307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:14.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:13 gibba020 bash[25448]: cluster 2021-03-10T14:36:12.178432+0000 mgr.gibba020.yqfnwy (mgr.34427) 2322 : cluster [DBG] pgmap v1307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:16.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:15 gibba020 bash[25448]: cluster 2021-03-10T14:36:14.179976+0000 mgr.gibba020.yqfnwy (mgr.34427) 2323 : cluster [DBG] pgmap v1308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:16.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:15 gibba013 bash[29418]: cluster 2021-03-10T14:36:14.179976+0000 mgr.gibba020.yqfnwy (mgr.34427) 2323 : cluster [DBG] pgmap v1308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:16.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:15 gibba013 bash[30381]: cluster 2021-03-10T14:36:14.179976+0000 mgr.gibba020.yqfnwy (mgr.34427) 2323 : cluster [DBG] pgmap v1308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:17.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:16 gibba013 bash[29418]: cephadm 2021-03-10T14:36:15.876495+0000 mgr.gibba020.yqfnwy (mgr.34427) 2324 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:36:17.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:16 gibba013 bash[30381]: cephadm 2021-03-10T14:36:15.876495+0000 mgr.gibba020.yqfnwy (mgr.34427) 2324 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:36:17.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:16 gibba020 bash[25448]: cephadm 2021-03-10T14:36:15.876495+0000 mgr.gibba020.yqfnwy (mgr.34427) 2324 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:36:18.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:17 gibba013 bash[29418]: cluster 2021-03-10T14:36:16.181544+0000 mgr.gibba020.yqfnwy (mgr.34427) 2325 : cluster [DBG] pgmap v1309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:18.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:17 gibba013 bash[30381]: cluster 2021-03-10T14:36:16.181544+0000 mgr.gibba020.yqfnwy (mgr.34427) 2325 : cluster [DBG] pgmap v1309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:18.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:17 gibba020 bash[25448]: cluster 2021-03-10T14:36:16.181544+0000 mgr.gibba020.yqfnwy (mgr.34427) 2325 : cluster [DBG] pgmap v1309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:20.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:19 gibba013 bash[29418]: cluster 2021-03-10T14:36:18.182797+0000 mgr.gibba020.yqfnwy (mgr.34427) 2326 : cluster [DBG] pgmap v1310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:20.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:19 gibba013 bash[30381]: cluster 2021-03-10T14:36:18.182797+0000 mgr.gibba020.yqfnwy (mgr.34427) 2326 : cluster [DBG] pgmap v1310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:20.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:19 gibba020 bash[25448]: cluster 2021-03-10T14:36:18.182797+0000 mgr.gibba020.yqfnwy (mgr.34427) 2326 : cluster [DBG] pgmap v1310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:22.120 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:36:22.348 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:36:22.348 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (42m) 8m ago 48m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:36:22.348 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (48m) 7m ago 48m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:36:22.349 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (43m) 7m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:36:22.349 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (43m) 7m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:36:22.349 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (42m) 8m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:36:22.349 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (42m) 8m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:36:22.349 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (41m) 7m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:36:22.350 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (42m) 8m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:36:22.350 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (48m) 8m ago 48m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:36:22.350 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (48m) 7m ago 48m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:36:22.350 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (41m) 8m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:36:22.350 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (40m) 8m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:36:22.351 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (40m) 8m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:36:22.351 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (39m) 8m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:36:22.351 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (39m) 7m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:36:22.351 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (38m) 7m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:36:22.351 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (38m) 7m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:36:22.352 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (38m) 7m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:36:22.352 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (47m) 7m ago 48m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:36:22.352 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 7m ago 46m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:36:22.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:22 gibba013 bash[29418]: cluster 2021-03-10T14:36:20.183823+0000 mgr.gibba020.yqfnwy (mgr.34427) 2327 : cluster [DBG] pgmap v1311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:22.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:22 gibba013 bash[30381]: cluster 2021-03-10T14:36:20.183823+0000 mgr.gibba020.yqfnwy (mgr.34427) 2327 : cluster [DBG] pgmap v1311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:22.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:22 gibba020 bash[25448]: cluster 2021-03-10T14:36:20.183823+0000 mgr.gibba020.yqfnwy (mgr.34427) 2327 : cluster [DBG] pgmap v1311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:22.598 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:36:22.598 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:36:22.598 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:36:22.599 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:36:22.599 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:36:22.599 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:36:22.599 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:36:22.599 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:36:22.600 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:36:22.600 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:36:22.600 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:36:22.600 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:36:22.600 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:36:22.601 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:36:22.601 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:36:23.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:23 gibba013 bash[29418]: audit 2021-03-10T14:36:22.109034+0000 mgr.gibba020.yqfnwy (mgr.34427) 2328 : audit [DBG] from='client.45618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:36:23.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:23 gibba013 bash[29418]: audit 2021-03-10T14:36:22.596636+0000 mon.c (mon.1) 47 : audit [DBG] from='client.? 172.21.2.113:0/1030218095' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:23.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:23 gibba013 bash[30381]: audit 2021-03-10T14:36:22.109034+0000 mgr.gibba020.yqfnwy (mgr.34427) 2328 : audit [DBG] from='client.45618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:36:23.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:23 gibba013 bash[30381]: audit 2021-03-10T14:36:22.596636+0000 mon.c (mon.1) 47 : audit [DBG] from='client.? 172.21.2.113:0/1030218095' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:23.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:23 gibba020 bash[25448]: audit 2021-03-10T14:36:22.109034+0000 mgr.gibba020.yqfnwy (mgr.34427) 2328 : audit [DBG] from='client.45618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:36:23.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:23 gibba020 bash[25448]: audit 2021-03-10T14:36:22.596636+0000 mon.c (mon.1) 47 : audit [DBG] from='client.? 172.21.2.113:0/1030218095' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:24.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:24 gibba013 bash[29418]: cluster 2021-03-10T14:36:22.184994+0000 mgr.gibba020.yqfnwy (mgr.34427) 2329 : cluster [DBG] pgmap v1312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:24.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:24 gibba013 bash[29418]: audit 2021-03-10T14:36:22.333526+0000 mgr.gibba020.yqfnwy (mgr.34427) 2330 : audit [DBG] from='client.45624 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:36:24.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:24 gibba013 bash[30381]: cluster 2021-03-10T14:36:22.184994+0000 mgr.gibba020.yqfnwy (mgr.34427) 2329 : cluster [DBG] pgmap v1312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:24.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:24 gibba013 bash[30381]: audit 2021-03-10T14:36:22.333526+0000 mgr.gibba020.yqfnwy (mgr.34427) 2330 : audit [DBG] from='client.45624 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:36:24.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:24 gibba020 bash[25448]: cluster 2021-03-10T14:36:22.184994+0000 mgr.gibba020.yqfnwy (mgr.34427) 2329 : cluster [DBG] pgmap v1312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:24.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:24 gibba020 bash[25448]: audit 2021-03-10T14:36:22.333526+0000 mgr.gibba020.yqfnwy (mgr.34427) 2330 : audit [DBG] from='client.45624 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:36:26.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:26 gibba013 bash[29418]: cluster 2021-03-10T14:36:24.186450+0000 mgr.gibba020.yqfnwy (mgr.34427) 2331 : cluster [DBG] pgmap v1313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:26.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:26 gibba013 bash[30381]: cluster 2021-03-10T14:36:24.186450+0000 mgr.gibba020.yqfnwy (mgr.34427) 2331 : cluster [DBG] pgmap v1313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:26.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:26 gibba020 bash[25448]: cluster 2021-03-10T14:36:24.186450+0000 mgr.gibba020.yqfnwy (mgr.34427) 2331 : cluster [DBG] pgmap v1313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:28.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:28 gibba013 bash[29418]: cluster 2021-03-10T14:36:26.188105+0000 mgr.gibba020.yqfnwy (mgr.34427) 2332 : cluster [DBG] pgmap v1314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:28.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:28 gibba013 bash[30381]: cluster 2021-03-10T14:36:26.188105+0000 mgr.gibba020.yqfnwy (mgr.34427) 2332 : cluster [DBG] pgmap v1314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:28.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:28 gibba020 bash[25448]: cluster 2021-03-10T14:36:26.188105+0000 mgr.gibba020.yqfnwy (mgr.34427) 2332 : cluster [DBG] pgmap v1314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:30.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:30 gibba013 bash[29418]: cluster 2021-03-10T14:36:28.189385+0000 mgr.gibba020.yqfnwy (mgr.34427) 2333 : cluster [DBG] pgmap v1315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:30.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:30 gibba013 bash[30381]: cluster 2021-03-10T14:36:28.189385+0000 mgr.gibba020.yqfnwy (mgr.34427) 2333 : cluster [DBG] pgmap v1315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:30.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:30 gibba020 bash[25448]: cluster 2021-03-10T14:36:28.189385+0000 mgr.gibba020.yqfnwy (mgr.34427) 2333 : cluster [DBG] pgmap v1315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:32.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:32 gibba013 bash[29418]: cluster 2021-03-10T14:36:30.191106+0000 mgr.gibba020.yqfnwy (mgr.34427) 2334 : cluster [DBG] pgmap v1316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:32.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:32 gibba013 bash[29418]: cephadm 2021-03-10T14:36:30.892465+0000 mgr.gibba020.yqfnwy (mgr.34427) 2335 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:36:32.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:32 gibba013 bash[30381]: cluster 2021-03-10T14:36:30.191106+0000 mgr.gibba020.yqfnwy (mgr.34427) 2334 : cluster [DBG] pgmap v1316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:32.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:32 gibba013 bash[30381]: cephadm 2021-03-10T14:36:30.892465+0000 mgr.gibba020.yqfnwy (mgr.34427) 2335 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:36:32.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:32 gibba020 bash[25448]: cluster 2021-03-10T14:36:30.191106+0000 mgr.gibba020.yqfnwy (mgr.34427) 2334 : cluster [DBG] pgmap v1316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:32.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:32 gibba020 bash[25448]: cephadm 2021-03-10T14:36:30.892465+0000 mgr.gibba020.yqfnwy (mgr.34427) 2335 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:36:34.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:34 gibba013 bash[29418]: cluster 2021-03-10T14:36:32.191831+0000 mgr.gibba020.yqfnwy (mgr.34427) 2336 : cluster [DBG] pgmap v1317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:34.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:34 gibba013 bash[30381]: cluster 2021-03-10T14:36:32.191831+0000 mgr.gibba020.yqfnwy (mgr.34427) 2336 : cluster [DBG] pgmap v1317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:34.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:34 gibba020 bash[25448]: cluster 2021-03-10T14:36:32.191831+0000 mgr.gibba020.yqfnwy (mgr.34427) 2336 : cluster [DBG] pgmap v1317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:36.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:36 gibba013 bash[29418]: cluster 2021-03-10T14:36:34.193361+0000 mgr.gibba020.yqfnwy (mgr.34427) 2337 : cluster [DBG] pgmap v1318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:36.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:36 gibba013 bash[30381]: cluster 2021-03-10T14:36:34.193361+0000 mgr.gibba020.yqfnwy (mgr.34427) 2337 : cluster [DBG] pgmap v1318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:36.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:36 gibba020 bash[25448]: cluster 2021-03-10T14:36:34.193361+0000 mgr.gibba020.yqfnwy (mgr.34427) 2337 : cluster [DBG] pgmap v1318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:38.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:38 gibba013 bash[29418]: cluster 2021-03-10T14:36:36.194991+0000 mgr.gibba020.yqfnwy (mgr.34427) 2338 : cluster [DBG] pgmap v1319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:38.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:38 gibba013 bash[30381]: cluster 2021-03-10T14:36:36.194991+0000 mgr.gibba020.yqfnwy (mgr.34427) 2338 : cluster [DBG] pgmap v1319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:38.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:38 gibba020 bash[25448]: cluster 2021-03-10T14:36:36.194991+0000 mgr.gibba020.yqfnwy (mgr.34427) 2338 : cluster [DBG] pgmap v1319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:40.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:40 gibba013 bash[29418]: cluster 2021-03-10T14:36:38.196300+0000 mgr.gibba020.yqfnwy (mgr.34427) 2339 : cluster [DBG] pgmap v1320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:40.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:40 gibba013 bash[30381]: cluster 2021-03-10T14:36:38.196300+0000 mgr.gibba020.yqfnwy (mgr.34427) 2339 : cluster [DBG] pgmap v1320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:40.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:40 gibba020 bash[25448]: cluster 2021-03-10T14:36:38.196300+0000 mgr.gibba020.yqfnwy (mgr.34427) 2339 : cluster [DBG] pgmap v1320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:42.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:42 gibba013 bash[29418]: cluster 2021-03-10T14:36:40.198171+0000 mgr.gibba020.yqfnwy (mgr.34427) 2340 : cluster [DBG] pgmap v1321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:42.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:42 gibba013 bash[30381]: cluster 2021-03-10T14:36:40.198171+0000 mgr.gibba020.yqfnwy (mgr.34427) 2340 : cluster [DBG] pgmap v1321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:42.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:42 gibba020 bash[25448]: cluster 2021-03-10T14:36:40.198171+0000 mgr.gibba020.yqfnwy (mgr.34427) 2340 : cluster [DBG] pgmap v1321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:44.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:44 gibba013 bash[29418]: cluster 2021-03-10T14:36:42.199456+0000 mgr.gibba020.yqfnwy (mgr.34427) 2341 : cluster [DBG] pgmap v1322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:44.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:44 gibba013 bash[30381]: cluster 2021-03-10T14:36:42.199456+0000 mgr.gibba020.yqfnwy (mgr.34427) 2341 : cluster [DBG] pgmap v1322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:44.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:44 gibba020 bash[25448]: cluster 2021-03-10T14:36:42.199456+0000 mgr.gibba020.yqfnwy (mgr.34427) 2341 : cluster [DBG] pgmap v1322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:46.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:46 gibba020 bash[25448]: cluster 2021-03-10T14:36:44.201108+0000 mgr.gibba020.yqfnwy (mgr.34427) 2342 : cluster [DBG] pgmap v1323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:46.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:46 gibba013 bash[29418]: cluster 2021-03-10T14:36:44.201108+0000 mgr.gibba020.yqfnwy (mgr.34427) 2342 : cluster [DBG] pgmap v1323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:46.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:46 gibba013 bash[30381]: cluster 2021-03-10T14:36:44.201108+0000 mgr.gibba020.yqfnwy (mgr.34427) 2342 : cluster [DBG] pgmap v1323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:47.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:47 gibba013 bash[29418]: cephadm 2021-03-10T14:36:45.894447+0000 mgr.gibba020.yqfnwy (mgr.34427) 2343 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:36:47.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:47 gibba013 bash[30381]: cephadm 2021-03-10T14:36:45.894447+0000 mgr.gibba020.yqfnwy (mgr.34427) 2343 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:36:47.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:47 gibba020 bash[25448]: cephadm 2021-03-10T14:36:45.894447+0000 mgr.gibba020.yqfnwy (mgr.34427) 2343 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:36:48.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:48 gibba013 bash[29418]: cluster 2021-03-10T14:36:46.202711+0000 mgr.gibba020.yqfnwy (mgr.34427) 2344 : cluster [DBG] pgmap v1324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:48.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:48 gibba013 bash[30381]: cluster 2021-03-10T14:36:46.202711+0000 mgr.gibba020.yqfnwy (mgr.34427) 2344 : cluster [DBG] pgmap v1324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:48.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:48 gibba020 bash[25448]: cluster 2021-03-10T14:36:46.202711+0000 mgr.gibba020.yqfnwy (mgr.34427) 2344 : cluster [DBG] pgmap v1324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:49.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:49 gibba020 bash[25448]: cluster 2021-03-10T14:36:48.203936+0000 mgr.gibba020.yqfnwy (mgr.34427) 2345 : cluster [DBG] pgmap v1325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:49.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:49 gibba013 bash[29418]: cluster 2021-03-10T14:36:48.203936+0000 mgr.gibba020.yqfnwy (mgr.34427) 2345 : cluster [DBG] pgmap v1325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:49.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:49 gibba013 bash[30381]: cluster 2021-03-10T14:36:48.203936+0000 mgr.gibba020.yqfnwy (mgr.34427) 2345 : cluster [DBG] pgmap v1325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:52.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:51 gibba013 bash[29418]: cluster 2021-03-10T14:36:50.204986+0000 mgr.gibba020.yqfnwy (mgr.34427) 2346 : cluster [DBG] pgmap v1326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:52.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:51 gibba013 bash[30381]: cluster 2021-03-10T14:36:50.204986+0000 mgr.gibba020.yqfnwy (mgr.34427) 2346 : cluster [DBG] pgmap v1326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:52.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:51 gibba020 bash[25448]: cluster 2021-03-10T14:36:50.204986+0000 mgr.gibba020.yqfnwy (mgr.34427) 2346 : cluster [DBG] pgmap v1326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:52.846 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:36:53.068 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:36:53.069 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (43m) 8m ago 48m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:36:53.069 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (48m) 7m ago 48m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:36:53.069 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (43m) 7m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:36:53.070 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (44m) 7m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:36:53.070 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (43m) 8m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:36:53.070 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (42m) 8m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:36:53.070 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (42m) 7m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:36:53.070 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (42m) 8m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:36:53.071 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (48m) 8m ago 48m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:36:53.071 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (48m) 7m ago 48m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:36:53.071 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (41m) 8m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:36:53.071 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (41m) 8m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:36:53.071 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (40m) 8m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:36:53.072 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (40m) 8m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:36:53.072 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (39m) 7m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:36:53.072 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (39m) 7m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:36:53.072 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (39m) 7m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:36:53.073 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (38m) 7m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:36:53.073 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (48m) 7m ago 48m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:36:53.073 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 7m ago 46m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:36:53.319 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:36:53.319 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:36:53.319 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:36:53.319 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:36:53.320 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:36:53.320 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:36:53.320 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:36:53.320 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:36:53.321 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:36:53.321 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:36:53.321 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:36:53.321 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:36:53.322 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:36:53.322 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:36:53.322 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:36:54.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:53 gibba013 bash[29418]: cluster 2021-03-10T14:36:52.206216+0000 mgr.gibba020.yqfnwy (mgr.34427) 2347 : cluster [DBG] pgmap v1327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:54.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:53 gibba013 bash[29418]: audit 2021-03-10T14:36:52.835079+0000 mgr.gibba020.yqfnwy (mgr.34427) 2348 : audit [DBG] from='client.55621 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:36:54.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:53 gibba013 bash[29418]: audit 2021-03-10T14:36:53.057745+0000 mgr.gibba020.yqfnwy (mgr.34427) 2349 : audit [DBG] from='client.55627 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:36:54.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:53 gibba013 bash[29418]: audit 2021-03-10T14:36:53.317393+0000 mon.a (mon.0) 1252 : audit [DBG] from='client.? 172.21.2.113:0/2811137251' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:54.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:53 gibba013 bash[30381]: cluster 2021-03-10T14:36:52.206216+0000 mgr.gibba020.yqfnwy (mgr.34427) 2347 : cluster [DBG] pgmap v1327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:54.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:53 gibba013 bash[30381]: audit 2021-03-10T14:36:52.835079+0000 mgr.gibba020.yqfnwy (mgr.34427) 2348 : audit [DBG] from='client.55621 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:36:54.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:53 gibba013 bash[30381]: audit 2021-03-10T14:36:53.057745+0000 mgr.gibba020.yqfnwy (mgr.34427) 2349 : audit [DBG] from='client.55627 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:36:54.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:53 gibba013 bash[30381]: audit 2021-03-10T14:36:53.317393+0000 mon.a (mon.0) 1252 : audit [DBG] from='client.? 172.21.2.113:0/2811137251' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:54.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:53 gibba020 bash[25448]: cluster 2021-03-10T14:36:52.206216+0000 mgr.gibba020.yqfnwy (mgr.34427) 2347 : cluster [DBG] pgmap v1327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:54.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:53 gibba020 bash[25448]: audit 2021-03-10T14:36:52.835079+0000 mgr.gibba020.yqfnwy (mgr.34427) 2348 : audit [DBG] from='client.55621 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:36:54.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:53 gibba020 bash[25448]: audit 2021-03-10T14:36:53.057745+0000 mgr.gibba020.yqfnwy (mgr.34427) 2349 : audit [DBG] from='client.55627 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:36:54.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:53 gibba020 bash[25448]: audit 2021-03-10T14:36:53.317393+0000 mon.a (mon.0) 1252 : audit [DBG] from='client.? 172.21.2.113:0/2811137251' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:36:56.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:55 gibba013 bash[29418]: cluster 2021-03-10T14:36:54.207874+0000 mgr.gibba020.yqfnwy (mgr.34427) 2350 : cluster [DBG] pgmap v1328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:56.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:55 gibba013 bash[30381]: cluster 2021-03-10T14:36:54.207874+0000 mgr.gibba020.yqfnwy (mgr.34427) 2350 : cluster [DBG] pgmap v1328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:56.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:55 gibba020 bash[25448]: cluster 2021-03-10T14:36:54.207874+0000 mgr.gibba020.yqfnwy (mgr.34427) 2350 : cluster [DBG] pgmap v1328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:58.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:57 gibba013 bash[29418]: cluster 2021-03-10T14:36:56.208734+0000 mgr.gibba020.yqfnwy (mgr.34427) 2351 : cluster [DBG] pgmap v1329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:58.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:57 gibba013 bash[30381]: cluster 2021-03-10T14:36:56.208734+0000 mgr.gibba020.yqfnwy (mgr.34427) 2351 : cluster [DBG] pgmap v1329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:36:58.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:57 gibba020 bash[25448]: cluster 2021-03-10T14:36:56.208734+0000 mgr.gibba020.yqfnwy (mgr.34427) 2351 : cluster [DBG] pgmap v1329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:00.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:36:59 gibba013 bash[29418]: cluster 2021-03-10T14:36:58.209908+0000 mgr.gibba020.yqfnwy (mgr.34427) 2352 : cluster [DBG] pgmap v1330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:00.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:36:59 gibba013 bash[30381]: cluster 2021-03-10T14:36:58.209908+0000 mgr.gibba020.yqfnwy (mgr.34427) 2352 : cluster [DBG] pgmap v1330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:00.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:36:59 gibba020 bash[25448]: cluster 2021-03-10T14:36:58.209908+0000 mgr.gibba020.yqfnwy (mgr.34427) 2352 : cluster [DBG] pgmap v1330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:01.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:01 gibba013 bash[29418]: audit 2021-03-10T14:37:00.911977+0000 mon.a (mon.0) 1253 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:37:01.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:01 gibba013 bash[30381]: audit 2021-03-10T14:37:00.911977+0000 mon.a (mon.0) 1253 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:37:01.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:01 gibba020 bash[25448]: audit 2021-03-10T14:37:00.911977+0000 mon.a (mon.0) 1253 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:37:02.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:02 gibba013 bash[29418]: cluster 2021-03-10T14:37:00.211638+0000 mgr.gibba020.yqfnwy (mgr.34427) 2353 : cluster [DBG] pgmap v1331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:02.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:02 gibba013 bash[29418]: cephadm 2021-03-10T14:37:00.916684+0000 mgr.gibba020.yqfnwy (mgr.34427) 2354 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:37:02.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:02 gibba013 bash[29418]: cephadm 2021-03-10T14:37:00.918091+0000 mgr.gibba020.yqfnwy (mgr.34427) 2355 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:37:02.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:02 gibba013 bash[29418]: audit 2021-03-10T14:37:01.130590+0000 mon.a (mon.0) 1254 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:37:02.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:02 gibba013 bash[29418]: audit 2021-03-10T14:37:01.133888+0000 mon.a (mon.0) 1255 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:37:02.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:02 gibba013 bash[29418]: audit 2021-03-10T14:37:01.135509+0000 mon.a (mon.0) 1256 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:02.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:02 gibba013 bash[29418]: audit 2021-03-10T14:37:01.137220+0000 mon.a (mon.0) 1257 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:02.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:02 gibba013 bash[29418]: audit 2021-03-10T14:37:01.138610+0000 mon.a (mon.0) 1258 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:02.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:02 gibba013 bash[29418]: audit 2021-03-10T14:37:01.141484+0000 mon.a (mon.0) 1259 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:02.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:02 gibba013 bash[29418]: audit 2021-03-10T14:37:01.143068+0000 mon.a (mon.0) 1260 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:02.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:02 gibba013 bash[30381]: cluster 2021-03-10T14:37:00.211638+0000 mgr.gibba020.yqfnwy (mgr.34427) 2353 : cluster [DBG] pgmap v1331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:02.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:02 gibba013 bash[30381]: cephadm 2021-03-10T14:37:00.916684+0000 mgr.gibba020.yqfnwy (mgr.34427) 2354 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:37:02.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:02 gibba013 bash[30381]: cephadm 2021-03-10T14:37:00.918091+0000 mgr.gibba020.yqfnwy (mgr.34427) 2355 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:37:02.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:02 gibba013 bash[30381]: audit 2021-03-10T14:37:01.130590+0000 mon.a (mon.0) 1254 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:37:02.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:02 gibba013 bash[30381]: audit 2021-03-10T14:37:01.133888+0000 mon.a (mon.0) 1255 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:37:02.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:02 gibba013 bash[30381]: audit 2021-03-10T14:37:01.135509+0000 mon.a (mon.0) 1256 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:02.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:02 gibba013 bash[30381]: audit 2021-03-10T14:37:01.137220+0000 mon.a (mon.0) 1257 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:02.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:02 gibba013 bash[30381]: audit 2021-03-10T14:37:01.138610+0000 mon.a (mon.0) 1258 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:02.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:02 gibba013 bash[30381]: audit 2021-03-10T14:37:01.141484+0000 mon.a (mon.0) 1259 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:02.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:02 gibba013 bash[30381]: audit 2021-03-10T14:37:01.143068+0000 mon.a (mon.0) 1260 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:02.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:02 gibba020 bash[25448]: cluster 2021-03-10T14:37:00.211638+0000 mgr.gibba020.yqfnwy (mgr.34427) 2353 : cluster [DBG] pgmap v1331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:02.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:02 gibba020 bash[25448]: cephadm 2021-03-10T14:37:00.916684+0000 mgr.gibba020.yqfnwy (mgr.34427) 2354 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:37:02.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:02 gibba020 bash[25448]: cephadm 2021-03-10T14:37:00.918091+0000 mgr.gibba020.yqfnwy (mgr.34427) 2355 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:37:02.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:02 gibba020 bash[25448]: audit 2021-03-10T14:37:01.130590+0000 mon.a (mon.0) 1254 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:37:02.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:02 gibba020 bash[25448]: audit 2021-03-10T14:37:01.133888+0000 mon.a (mon.0) 1255 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:37:02.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:02 gibba020 bash[25448]: audit 2021-03-10T14:37:01.135509+0000 mon.a (mon.0) 1256 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:02.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:02 gibba020 bash[25448]: audit 2021-03-10T14:37:01.137220+0000 mon.a (mon.0) 1257 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:02.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:02 gibba020 bash[25448]: audit 2021-03-10T14:37:01.138610+0000 mon.a (mon.0) 1258 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:02.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:02 gibba020 bash[25448]: audit 2021-03-10T14:37:01.141484+0000 mon.a (mon.0) 1259 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:02.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:02 gibba020 bash[25448]: audit 2021-03-10T14:37:01.143068+0000 mon.a (mon.0) 1260 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:03.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:03 gibba013 bash[29418]: cephadm 2021-03-10T14:37:01.132460+0000 mgr.gibba020.yqfnwy (mgr.34427) 2356 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:37:03.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:03 gibba013 bash[29418]: cephadm 2021-03-10T14:37:01.134334+0000 mgr.gibba020.yqfnwy (mgr.34427) 2357 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:37:03.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:03 gibba013 bash[29418]: cephadm 2021-03-10T14:37:01.135924+0000 mgr.gibba020.yqfnwy (mgr.34427) 2358 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:37:03.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:03 gibba013 bash[29418]: cephadm 2021-03-10T14:37:01.136043+0000 mgr.gibba020.yqfnwy (mgr.34427) 2359 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:37:03.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:03 gibba013 bash[29418]: cephadm 2021-03-10T14:37:01.137475+0000 mgr.gibba020.yqfnwy (mgr.34427) 2360 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:37:03.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:03 gibba013 bash[29418]: cephadm 2021-03-10T14:37:01.137512+0000 mgr.gibba020.yqfnwy (mgr.34427) 2361 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:37:03.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:03 gibba013 bash[29418]: cephadm 2021-03-10T14:37:01.138812+0000 mgr.gibba020.yqfnwy (mgr.34427) 2362 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:37:03.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:03 gibba013 bash[29418]: cephadm 2021-03-10T14:37:01.140211+0000 mgr.gibba020.yqfnwy (mgr.34427) 2363 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:37:03.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:03 gibba013 bash[29418]: cephadm 2021-03-10T14:37:01.140246+0000 mgr.gibba020.yqfnwy (mgr.34427) 2364 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:37:03.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:03 gibba013 bash[29418]: cephadm 2021-03-10T14:37:01.141681+0000 mgr.gibba020.yqfnwy (mgr.34427) 2365 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:37:03.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:03 gibba013 bash[29418]: cephadm 2021-03-10T14:37:01.141998+0000 mgr.gibba020.yqfnwy (mgr.34427) 2366 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:37:03.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:03 gibba013 bash[29418]: cephadm 2021-03-10T14:37:01.143567+0000 mgr.gibba020.yqfnwy (mgr.34427) 2367 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:37:03.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:03 gibba013 bash[29418]: cephadm 2021-03-10T14:37:01.143603+0000 mgr.gibba020.yqfnwy (mgr.34427) 2368 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:37:03.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:03 gibba013 bash[29418]: cephadm 2021-03-10T14:37:01.143707+0000 mgr.gibba020.yqfnwy (mgr.34427) 2369 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:37:03.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:03 gibba013 bash[30381]: cephadm 2021-03-10T14:37:01.132460+0000 mgr.gibba020.yqfnwy (mgr.34427) 2356 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:37:03.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:03 gibba013 bash[30381]: cephadm 2021-03-10T14:37:01.134334+0000 mgr.gibba020.yqfnwy (mgr.34427) 2357 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:37:03.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:03 gibba013 bash[30381]: cephadm 2021-03-10T14:37:01.135924+0000 mgr.gibba020.yqfnwy (mgr.34427) 2358 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:37:03.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:03 gibba013 bash[30381]: cephadm 2021-03-10T14:37:01.136043+0000 mgr.gibba020.yqfnwy (mgr.34427) 2359 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:37:03.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:03 gibba013 bash[30381]: cephadm 2021-03-10T14:37:01.137475+0000 mgr.gibba020.yqfnwy (mgr.34427) 2360 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:37:03.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:03 gibba013 bash[30381]: cephadm 2021-03-10T14:37:01.137512+0000 mgr.gibba020.yqfnwy (mgr.34427) 2361 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:37:03.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:03 gibba013 bash[30381]: cephadm 2021-03-10T14:37:01.138812+0000 mgr.gibba020.yqfnwy (mgr.34427) 2362 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:37:03.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:03 gibba013 bash[30381]: cephadm 2021-03-10T14:37:01.140211+0000 mgr.gibba020.yqfnwy (mgr.34427) 2363 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:37:03.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:03 gibba013 bash[30381]: cephadm 2021-03-10T14:37:01.140246+0000 mgr.gibba020.yqfnwy (mgr.34427) 2364 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:37:03.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:03 gibba013 bash[30381]: cephadm 2021-03-10T14:37:01.141681+0000 mgr.gibba020.yqfnwy (mgr.34427) 2365 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:37:03.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:03 gibba013 bash[30381]: cephadm 2021-03-10T14:37:01.141998+0000 mgr.gibba020.yqfnwy (mgr.34427) 2366 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:37:03.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:03 gibba013 bash[30381]: cephadm 2021-03-10T14:37:01.143567+0000 mgr.gibba020.yqfnwy (mgr.34427) 2367 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:37:03.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:03 gibba013 bash[30381]: cephadm 2021-03-10T14:37:01.143603+0000 mgr.gibba020.yqfnwy (mgr.34427) 2368 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:37:03.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:03 gibba013 bash[30381]: cephadm 2021-03-10T14:37:01.143707+0000 mgr.gibba020.yqfnwy (mgr.34427) 2369 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:37:03.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:03 gibba020 bash[25448]: cephadm 2021-03-10T14:37:01.132460+0000 mgr.gibba020.yqfnwy (mgr.34427) 2356 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:37:03.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:03 gibba020 bash[25448]: cephadm 2021-03-10T14:37:01.134334+0000 mgr.gibba020.yqfnwy (mgr.34427) 2357 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:37:03.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:03 gibba020 bash[25448]: cephadm 2021-03-10T14:37:01.135924+0000 mgr.gibba020.yqfnwy (mgr.34427) 2358 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:37:03.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:03 gibba020 bash[25448]: cephadm 2021-03-10T14:37:01.136043+0000 mgr.gibba020.yqfnwy (mgr.34427) 2359 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:37:03.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:03 gibba020 bash[25448]: cephadm 2021-03-10T14:37:01.137475+0000 mgr.gibba020.yqfnwy (mgr.34427) 2360 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:37:03.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:03 gibba020 bash[25448]: cephadm 2021-03-10T14:37:01.137512+0000 mgr.gibba020.yqfnwy (mgr.34427) 2361 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:37:03.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:03 gibba020 bash[25448]: cephadm 2021-03-10T14:37:01.138812+0000 mgr.gibba020.yqfnwy (mgr.34427) 2362 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:37:03.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:03 gibba020 bash[25448]: cephadm 2021-03-10T14:37:01.140211+0000 mgr.gibba020.yqfnwy (mgr.34427) 2363 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:37:03.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:03 gibba020 bash[25448]: cephadm 2021-03-10T14:37:01.140246+0000 mgr.gibba020.yqfnwy (mgr.34427) 2364 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:37:03.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:03 gibba020 bash[25448]: cephadm 2021-03-10T14:37:01.141681+0000 mgr.gibba020.yqfnwy (mgr.34427) 2365 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:37:03.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:03 gibba020 bash[25448]: cephadm 2021-03-10T14:37:01.141998+0000 mgr.gibba020.yqfnwy (mgr.34427) 2366 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:37:03.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:03 gibba020 bash[25448]: cephadm 2021-03-10T14:37:01.143567+0000 mgr.gibba020.yqfnwy (mgr.34427) 2367 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:37:03.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:03 gibba020 bash[25448]: cephadm 2021-03-10T14:37:01.143603+0000 mgr.gibba020.yqfnwy (mgr.34427) 2368 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:37:03.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:03 gibba020 bash[25448]: cephadm 2021-03-10T14:37:01.143707+0000 mgr.gibba020.yqfnwy (mgr.34427) 2369 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:37:04.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:04 gibba013 bash[29418]: cluster 2021-03-10T14:37:02.212922+0000 mgr.gibba020.yqfnwy (mgr.34427) 2370 : cluster [DBG] pgmap v1332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:04.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:04 gibba013 bash[30381]: cluster 2021-03-10T14:37:02.212922+0000 mgr.gibba020.yqfnwy (mgr.34427) 2370 : cluster [DBG] pgmap v1332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:04.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:04 gibba020 bash[25448]: cluster 2021-03-10T14:37:02.212922+0000 mgr.gibba020.yqfnwy (mgr.34427) 2370 : cluster [DBG] pgmap v1332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:06.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:06 gibba013 bash[29418]: cluster 2021-03-10T14:37:04.214416+0000 mgr.gibba020.yqfnwy (mgr.34427) 2371 : cluster [DBG] pgmap v1333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:06.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:06 gibba013 bash[30381]: cluster 2021-03-10T14:37:04.214416+0000 mgr.gibba020.yqfnwy (mgr.34427) 2371 : cluster [DBG] pgmap v1333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:06.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:06 gibba020 bash[25448]: cluster 2021-03-10T14:37:04.214416+0000 mgr.gibba020.yqfnwy (mgr.34427) 2371 : cluster [DBG] pgmap v1333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:07 gibba013 bash[29418]: audit 2021-03-10T14:37:06.158676+0000 mon.a (mon.0) 1261 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:37:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:07 gibba013 bash[29418]: audit 2021-03-10T14:37:06.159776+0000 mon.a (mon.0) 1262 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:37:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:07 gibba013 bash[29418]: audit 2021-03-10T14:37:06.160804+0000 mon.a (mon.0) 1263 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:37:07.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:07 gibba013 bash[29418]: audit 2021-03-10T14:37:06.161842+0000 mon.a (mon.0) 1264 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:37:07.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:07 gibba013 bash[29418]: audit 2021-03-10T14:37:06.209052+0000 mon.a (mon.0) 1265 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:37:07.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:07 gibba013 bash[29418]: audit 2021-03-10T14:37:06.215562+0000 mon.a (mon.0) 1266 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:37:07.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:07 gibba013 bash[30381]: audit 2021-03-10T14:37:06.158676+0000 mon.a (mon.0) 1261 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:37:07.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:07 gibba013 bash[30381]: audit 2021-03-10T14:37:06.159776+0000 mon.a (mon.0) 1262 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:37:07.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:07 gibba013 bash[30381]: audit 2021-03-10T14:37:06.160804+0000 mon.a (mon.0) 1263 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:37:07.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:07 gibba013 bash[30381]: audit 2021-03-10T14:37:06.161842+0000 mon.a (mon.0) 1264 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:37:07.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:07 gibba013 bash[30381]: audit 2021-03-10T14:37:06.209052+0000 mon.a (mon.0) 1265 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:37:07.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:07 gibba013 bash[30381]: audit 2021-03-10T14:37:06.215562+0000 mon.a (mon.0) 1266 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:37:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:07 gibba020 bash[25448]: audit 2021-03-10T14:37:06.158676+0000 mon.a (mon.0) 1261 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:37:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:07 gibba020 bash[25448]: audit 2021-03-10T14:37:06.159776+0000 mon.a (mon.0) 1262 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:37:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:07 gibba020 bash[25448]: audit 2021-03-10T14:37:06.160804+0000 mon.a (mon.0) 1263 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:37:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:07 gibba020 bash[25448]: audit 2021-03-10T14:37:06.161842+0000 mon.a (mon.0) 1264 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:37:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:07 gibba020 bash[25448]: audit 2021-03-10T14:37:06.209052+0000 mon.a (mon.0) 1265 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:37:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:07 gibba020 bash[25448]: audit 2021-03-10T14:37:06.215562+0000 mon.a (mon.0) 1266 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:37:08.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:08 gibba013 bash[29418]: cluster 2021-03-10T14:37:06.216001+0000 mgr.gibba020.yqfnwy (mgr.34427) 2372 : cluster [DBG] pgmap v1334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:08.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:08 gibba013 bash[30381]: cluster 2021-03-10T14:37:06.216001+0000 mgr.gibba020.yqfnwy (mgr.34427) 2372 : cluster [DBG] pgmap v1334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:08.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:08 gibba020 bash[25448]: cluster 2021-03-10T14:37:06.216001+0000 mgr.gibba020.yqfnwy (mgr.34427) 2372 : cluster [DBG] pgmap v1334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:10.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:10 gibba013 bash[29418]: cluster 2021-03-10T14:37:08.217128+0000 mgr.gibba020.yqfnwy (mgr.34427) 2373 : cluster [DBG] pgmap v1335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:10.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:10 gibba013 bash[30381]: cluster 2021-03-10T14:37:08.217128+0000 mgr.gibba020.yqfnwy (mgr.34427) 2373 : cluster [DBG] pgmap v1335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:10.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:10 gibba020 bash[25448]: cluster 2021-03-10T14:37:08.217128+0000 mgr.gibba020.yqfnwy (mgr.34427) 2373 : cluster [DBG] pgmap v1335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:12.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:12 gibba013 bash[29418]: cluster 2021-03-10T14:37:10.218943+0000 mgr.gibba020.yqfnwy (mgr.34427) 2374 : cluster [DBG] pgmap v1336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:12.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:12 gibba013 bash[30381]: cluster 2021-03-10T14:37:10.218943+0000 mgr.gibba020.yqfnwy (mgr.34427) 2374 : cluster [DBG] pgmap v1336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:12.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:12 gibba020 bash[25448]: cluster 2021-03-10T14:37:10.218943+0000 mgr.gibba020.yqfnwy (mgr.34427) 2374 : cluster [DBG] pgmap v1336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:14.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:14 gibba013 bash[29418]: cluster 2021-03-10T14:37:12.220296+0000 mgr.gibba020.yqfnwy (mgr.34427) 2375 : cluster [DBG] pgmap v1337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:14.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:14 gibba013 bash[30381]: cluster 2021-03-10T14:37:12.220296+0000 mgr.gibba020.yqfnwy (mgr.34427) 2375 : cluster [DBG] pgmap v1337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:14.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:14 gibba020 bash[25448]: cluster 2021-03-10T14:37:12.220296+0000 mgr.gibba020.yqfnwy (mgr.34427) 2375 : cluster [DBG] pgmap v1337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:16.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:16 gibba013 bash[29418]: cluster 2021-03-10T14:37:14.221188+0000 mgr.gibba020.yqfnwy (mgr.34427) 2376 : cluster [DBG] pgmap v1338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:16.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:16 gibba013 bash[30381]: cluster 2021-03-10T14:37:14.221188+0000 mgr.gibba020.yqfnwy (mgr.34427) 2376 : cluster [DBG] pgmap v1338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:16.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:16 gibba020 bash[25448]: cluster 2021-03-10T14:37:14.221188+0000 mgr.gibba020.yqfnwy (mgr.34427) 2376 : cluster [DBG] pgmap v1338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:18.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:18 gibba013 bash[29418]: cephadm 2021-03-10T14:37:16.159711+0000 mgr.gibba020.yqfnwy (mgr.34427) 2377 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:37:18.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:18 gibba013 bash[29418]: cluster 2021-03-10T14:37:16.222706+0000 mgr.gibba020.yqfnwy (mgr.34427) 2378 : cluster [DBG] pgmap v1339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:18.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:18 gibba013 bash[30381]: cephadm 2021-03-10T14:37:16.159711+0000 mgr.gibba020.yqfnwy (mgr.34427) 2377 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:37:18.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:18 gibba013 bash[30381]: cluster 2021-03-10T14:37:16.222706+0000 mgr.gibba020.yqfnwy (mgr.34427) 2378 : cluster [DBG] pgmap v1339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:18.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:18 gibba020 bash[25448]: cephadm 2021-03-10T14:37:16.159711+0000 mgr.gibba020.yqfnwy (mgr.34427) 2377 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:37:18.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:18 gibba020 bash[25448]: cluster 2021-03-10T14:37:16.222706+0000 mgr.gibba020.yqfnwy (mgr.34427) 2378 : cluster [DBG] pgmap v1339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:20.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:20 gibba013 bash[29418]: cluster 2021-03-10T14:37:18.224103+0000 mgr.gibba020.yqfnwy (mgr.34427) 2379 : cluster [DBG] pgmap v1340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:20.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:20 gibba013 bash[30381]: cluster 2021-03-10T14:37:18.224103+0000 mgr.gibba020.yqfnwy (mgr.34427) 2379 : cluster [DBG] pgmap v1340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:20.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:20 gibba020 bash[25448]: cluster 2021-03-10T14:37:18.224103+0000 mgr.gibba020.yqfnwy (mgr.34427) 2379 : cluster [DBG] pgmap v1340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:22.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:22 gibba013 bash[29418]: cluster 2021-03-10T14:37:20.225423+0000 mgr.gibba020.yqfnwy (mgr.34427) 2380 : cluster [DBG] pgmap v1341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:22.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:22 gibba013 bash[30381]: cluster 2021-03-10T14:37:20.225423+0000 mgr.gibba020.yqfnwy (mgr.34427) 2380 : cluster [DBG] pgmap v1341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:22.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:22 gibba020 bash[25448]: cluster 2021-03-10T14:37:20.225423+0000 mgr.gibba020.yqfnwy (mgr.34427) 2380 : cluster [DBG] pgmap v1341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:23.558 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:37:23.785 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:37:23.786 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (43m) 9m ago 49m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:37:23.786 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (49m) 8m ago 49m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:37:23.786 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (44m) 8m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:37:23.786 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (44m) 8m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:37:23.787 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (43m) 9m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:37:23.787 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (43m) 9m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:37:23.787 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (42m) 8m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:37:23.787 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (43m) 9m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:37:23.787 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (49m) 9m ago 49m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:37:23.788 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (49m) 8m ago 49m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:37:23.788 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (42m) 9m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:37:23.789 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (41m) 9m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:37:23.789 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (41m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:37:23.789 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (40m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:37:23.790 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (40m) 8m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:37:23.790 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (40m) 8m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:37:23.790 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (39m) 8m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:37:23.791 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (39m) 8m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:37:23.791 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (48m) 8m ago 49m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:37:23.791 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 8m ago 47m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:37:24.035 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:37:24.035 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:37:24.035 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:37:24.036 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:37:24.036 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:37:24.036 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:37:24.036 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:37:24.036 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:37:24.037 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:37:24.037 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:37:24.037 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:37:24.037 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:37:24.037 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:37:24.037 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:37:24.038 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:37:24.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:24 gibba013 bash[29418]: cluster 2021-03-10T14:37:22.226559+0000 mgr.gibba020.yqfnwy (mgr.34427) 2381 : cluster [DBG] pgmap v1342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:24.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:24 gibba013 bash[29418]: audit 2021-03-10T14:37:24.033710+0000 mon.a (mon.0) 1267 : audit [DBG] from='client.? 172.21.2.113:0/1651509772' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:24.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:24 gibba013 bash[30381]: cluster 2021-03-10T14:37:22.226559+0000 mgr.gibba020.yqfnwy (mgr.34427) 2381 : cluster [DBG] pgmap v1342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:24.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:24 gibba013 bash[30381]: audit 2021-03-10T14:37:24.033710+0000 mon.a (mon.0) 1267 : audit [DBG] from='client.? 172.21.2.113:0/1651509772' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:24.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:24 gibba020 bash[25448]: cluster 2021-03-10T14:37:22.226559+0000 mgr.gibba020.yqfnwy (mgr.34427) 2381 : cluster [DBG] pgmap v1342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:24.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:24 gibba020 bash[25448]: audit 2021-03-10T14:37:24.033710+0000 mon.a (mon.0) 1267 : audit [DBG] from='client.? 172.21.2.113:0/1651509772' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:25.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:25 gibba013 bash[29418]: audit 2021-03-10T14:37:23.548361+0000 mgr.gibba020.yqfnwy (mgr.34427) 2382 : audit [DBG] from='client.45654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:37:25.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:25 gibba013 bash[29418]: audit 2021-03-10T14:37:23.770703+0000 mgr.gibba020.yqfnwy (mgr.34427) 2383 : audit [DBG] from='client.45660 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:37:25.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:25 gibba013 bash[30381]: audit 2021-03-10T14:37:23.548361+0000 mgr.gibba020.yqfnwy (mgr.34427) 2382 : audit [DBG] from='client.45654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:37:25.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:25 gibba013 bash[30381]: audit 2021-03-10T14:37:23.770703+0000 mgr.gibba020.yqfnwy (mgr.34427) 2383 : audit [DBG] from='client.45660 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:37:25.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:25 gibba020 bash[25448]: audit 2021-03-10T14:37:23.548361+0000 mgr.gibba020.yqfnwy (mgr.34427) 2382 : audit [DBG] from='client.45654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:37:25.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:25 gibba020 bash[25448]: audit 2021-03-10T14:37:23.770703+0000 mgr.gibba020.yqfnwy (mgr.34427) 2383 : audit [DBG] from='client.45660 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:37:26.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:26 gibba013 bash[29418]: cluster 2021-03-10T14:37:24.228190+0000 mgr.gibba020.yqfnwy (mgr.34427) 2384 : cluster [DBG] pgmap v1343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:26.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:26 gibba013 bash[30381]: cluster 2021-03-10T14:37:24.228190+0000 mgr.gibba020.yqfnwy (mgr.34427) 2384 : cluster [DBG] pgmap v1343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:26.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:26 gibba020 bash[25448]: cluster 2021-03-10T14:37:24.228190+0000 mgr.gibba020.yqfnwy (mgr.34427) 2384 : cluster [DBG] pgmap v1343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:28.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:28 gibba020 bash[25448]: cluster 2021-03-10T14:37:26.229761+0000 mgr.gibba020.yqfnwy (mgr.34427) 2385 : cluster [DBG] pgmap v1344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:28.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:28 gibba013 bash[29418]: cluster 2021-03-10T14:37:26.229761+0000 mgr.gibba020.yqfnwy (mgr.34427) 2385 : cluster [DBG] pgmap v1344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:28.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:28 gibba013 bash[30381]: cluster 2021-03-10T14:37:26.229761+0000 mgr.gibba020.yqfnwy (mgr.34427) 2385 : cluster [DBG] pgmap v1344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:29.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:29 gibba020 bash[25448]: cluster 2021-03-10T14:37:28.231158+0000 mgr.gibba020.yqfnwy (mgr.34427) 2386 : cluster [DBG] pgmap v1345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:29.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:29 gibba013 bash[29418]: cluster 2021-03-10T14:37:28.231158+0000 mgr.gibba020.yqfnwy (mgr.34427) 2386 : cluster [DBG] pgmap v1345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:29.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:29 gibba013 bash[30381]: cluster 2021-03-10T14:37:28.231158+0000 mgr.gibba020.yqfnwy (mgr.34427) 2386 : cluster [DBG] pgmap v1345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:32.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:31 gibba013 bash[29418]: cluster 2021-03-10T14:37:30.233043+0000 mgr.gibba020.yqfnwy (mgr.34427) 2387 : cluster [DBG] pgmap v1346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:32.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:31 gibba013 bash[30381]: cluster 2021-03-10T14:37:30.233043+0000 mgr.gibba020.yqfnwy (mgr.34427) 2387 : cluster [DBG] pgmap v1346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:32.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:31 gibba020 bash[25448]: cluster 2021-03-10T14:37:30.233043+0000 mgr.gibba020.yqfnwy (mgr.34427) 2387 : cluster [DBG] pgmap v1346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:33.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:32 gibba013 bash[29418]: cephadm 2021-03-10T14:37:31.174936+0000 mgr.gibba020.yqfnwy (mgr.34427) 2388 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:37:33.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:32 gibba013 bash[30381]: cephadm 2021-03-10T14:37:31.174936+0000 mgr.gibba020.yqfnwy (mgr.34427) 2388 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:37:33.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:32 gibba020 bash[25448]: cephadm 2021-03-10T14:37:31.174936+0000 mgr.gibba020.yqfnwy (mgr.34427) 2388 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:37:34.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:34 gibba013 bash[29418]: cluster 2021-03-10T14:37:32.234303+0000 mgr.gibba020.yqfnwy (mgr.34427) 2389 : cluster [DBG] pgmap v1347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:34.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:34 gibba013 bash[30381]: cluster 2021-03-10T14:37:32.234303+0000 mgr.gibba020.yqfnwy (mgr.34427) 2389 : cluster [DBG] pgmap v1347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:34.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:34 gibba020 bash[25448]: cluster 2021-03-10T14:37:32.234303+0000 mgr.gibba020.yqfnwy (mgr.34427) 2389 : cluster [DBG] pgmap v1347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:36.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:36 gibba013 bash[29418]: cluster 2021-03-10T14:37:34.235797+0000 mgr.gibba020.yqfnwy (mgr.34427) 2390 : cluster [DBG] pgmap v1348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:36.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:36 gibba013 bash[30381]: cluster 2021-03-10T14:37:34.235797+0000 mgr.gibba020.yqfnwy (mgr.34427) 2390 : cluster [DBG] pgmap v1348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:36.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:36 gibba020 bash[25448]: cluster 2021-03-10T14:37:34.235797+0000 mgr.gibba020.yqfnwy (mgr.34427) 2390 : cluster [DBG] pgmap v1348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:38.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:38 gibba013 bash[29418]: cluster 2021-03-10T14:37:36.237943+0000 mgr.gibba020.yqfnwy (mgr.34427) 2391 : cluster [DBG] pgmap v1349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:38.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:38 gibba013 bash[30381]: cluster 2021-03-10T14:37:36.237943+0000 mgr.gibba020.yqfnwy (mgr.34427) 2391 : cluster [DBG] pgmap v1349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:38.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:38 gibba020 bash[25448]: cluster 2021-03-10T14:37:36.237943+0000 mgr.gibba020.yqfnwy (mgr.34427) 2391 : cluster [DBG] pgmap v1349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:40.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:40 gibba013 bash[29418]: cluster 2021-03-10T14:37:38.239271+0000 mgr.gibba020.yqfnwy (mgr.34427) 2392 : cluster [DBG] pgmap v1350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:40.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:40 gibba013 bash[30381]: cluster 2021-03-10T14:37:38.239271+0000 mgr.gibba020.yqfnwy (mgr.34427) 2392 : cluster [DBG] pgmap v1350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:40.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:40 gibba020 bash[25448]: cluster 2021-03-10T14:37:38.239271+0000 mgr.gibba020.yqfnwy (mgr.34427) 2392 : cluster [DBG] pgmap v1350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:42.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:42 gibba013 bash[29418]: cluster 2021-03-10T14:37:40.240916+0000 mgr.gibba020.yqfnwy (mgr.34427) 2393 : cluster [DBG] pgmap v1351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:42.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:42 gibba013 bash[30381]: cluster 2021-03-10T14:37:40.240916+0000 mgr.gibba020.yqfnwy (mgr.34427) 2393 : cluster [DBG] pgmap v1351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:42.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:42 gibba020 bash[25448]: cluster 2021-03-10T14:37:40.240916+0000 mgr.gibba020.yqfnwy (mgr.34427) 2393 : cluster [DBG] pgmap v1351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:44.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:44 gibba013 bash[29418]: cluster 2021-03-10T14:37:42.242180+0000 mgr.gibba020.yqfnwy (mgr.34427) 2394 : cluster [DBG] pgmap v1352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:44.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:44 gibba013 bash[30381]: cluster 2021-03-10T14:37:42.242180+0000 mgr.gibba020.yqfnwy (mgr.34427) 2394 : cluster [DBG] pgmap v1352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:44.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:44 gibba020 bash[25448]: cluster 2021-03-10T14:37:42.242180+0000 mgr.gibba020.yqfnwy (mgr.34427) 2394 : cluster [DBG] pgmap v1352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:46.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:46 gibba013 bash[29418]: cluster 2021-03-10T14:37:44.244113+0000 mgr.gibba020.yqfnwy (mgr.34427) 2395 : cluster [DBG] pgmap v1353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:46.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:46 gibba013 bash[30381]: cluster 2021-03-10T14:37:44.244113+0000 mgr.gibba020.yqfnwy (mgr.34427) 2395 : cluster [DBG] pgmap v1353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:46.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:46 gibba020 bash[25448]: cluster 2021-03-10T14:37:44.244113+0000 mgr.gibba020.yqfnwy (mgr.34427) 2395 : cluster [DBG] pgmap v1353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:48.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:48 gibba013 bash[29418]: cephadm 2021-03-10T14:37:46.190889+0000 mgr.gibba020.yqfnwy (mgr.34427) 2396 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:37:48.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:48 gibba013 bash[29418]: cluster 2021-03-10T14:37:46.245891+0000 mgr.gibba020.yqfnwy (mgr.34427) 2397 : cluster [DBG] pgmap v1354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:48.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:48 gibba013 bash[30381]: cephadm 2021-03-10T14:37:46.190889+0000 mgr.gibba020.yqfnwy (mgr.34427) 2396 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:37:48.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:48 gibba013 bash[30381]: cluster 2021-03-10T14:37:46.245891+0000 mgr.gibba020.yqfnwy (mgr.34427) 2397 : cluster [DBG] pgmap v1354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:48.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:48 gibba020 bash[25448]: cephadm 2021-03-10T14:37:46.190889+0000 mgr.gibba020.yqfnwy (mgr.34427) 2396 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:37:48.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:48 gibba020 bash[25448]: cluster 2021-03-10T14:37:46.245891+0000 mgr.gibba020.yqfnwy (mgr.34427) 2397 : cluster [DBG] pgmap v1354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:50.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:50 gibba013 bash[29418]: cluster 2021-03-10T14:37:48.247448+0000 mgr.gibba020.yqfnwy (mgr.34427) 2398 : cluster [DBG] pgmap v1355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:50.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:50 gibba013 bash[30381]: cluster 2021-03-10T14:37:48.247448+0000 mgr.gibba020.yqfnwy (mgr.34427) 2398 : cluster [DBG] pgmap v1355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:50.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:50 gibba020 bash[25448]: cluster 2021-03-10T14:37:48.247448+0000 mgr.gibba020.yqfnwy (mgr.34427) 2398 : cluster [DBG] pgmap v1355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:52.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:52 gibba013 bash[29418]: cluster 2021-03-10T14:37:50.249520+0000 mgr.gibba020.yqfnwy (mgr.34427) 2399 : cluster [DBG] pgmap v1356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:52.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:52 gibba013 bash[30381]: cluster 2021-03-10T14:37:50.249520+0000 mgr.gibba020.yqfnwy (mgr.34427) 2399 : cluster [DBG] pgmap v1356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:52.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:52 gibba020 bash[25448]: cluster 2021-03-10T14:37:50.249520+0000 mgr.gibba020.yqfnwy (mgr.34427) 2399 : cluster [DBG] pgmap v1356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:54.279 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:37:54.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:54 gibba013 bash[29418]: cluster 2021-03-10T14:37:52.251055+0000 mgr.gibba020.yqfnwy (mgr.34427) 2400 : cluster [DBG] pgmap v1357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:54.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:54 gibba013 bash[30381]: cluster 2021-03-10T14:37:52.251055+0000 mgr.gibba020.yqfnwy (mgr.34427) 2400 : cluster [DBG] pgmap v1357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:54.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:54 gibba020 bash[25448]: cluster 2021-03-10T14:37:52.251055+0000 mgr.gibba020.yqfnwy (mgr.34427) 2400 : cluster [DBG] pgmap v1357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:54.511 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:37:54.511 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (44m) 10m ago 49m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:37:54.511 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (49m) 8m ago 49m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:37:54.512 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (44m) 8m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:37:54.512 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (45m) 8m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:37:54.512 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (44m) 10m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:37:54.512 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (43m) 10m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:37:54.513 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (43m) 8m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:37:54.513 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (43m) 10m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:37:54.513 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (49m) 10m ago 49m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:37:54.513 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (49m) 8m ago 49m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:37:54.513 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (42m) 10m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:37:54.514 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (42m) 10m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:37:54.514 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (41m) 10m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:37:54.514 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (41m) 10m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:37:54.514 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (40m) 8m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:37:54.514 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (40m) 8m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:37:54.515 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (40m) 8m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:37:54.515 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (39m) 8m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:37:54.515 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (49m) 8m ago 49m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:37:54.515 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 8m ago 47m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:37:54.757 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:37:54.758 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:37:54.758 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:37:54.758 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:37:54.759 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:37:54.759 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:37:54.759 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:37:54.759 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:37:54.759 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:37:54.760 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:37:54.760 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:37:54.760 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:37:54.760 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:37:54.761 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:37:54.761 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:37:55.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:55 gibba013 bash[29418]: audit 2021-03-10T14:37:54.756212+0000 mon.a (mon.0) 1268 : audit [DBG] from='client.? 172.21.2.113:0/323050759' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:55.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:55 gibba013 bash[30381]: audit 2021-03-10T14:37:54.756212+0000 mon.a (mon.0) 1268 : audit [DBG] from='client.? 172.21.2.113:0/323050759' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:55.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:55 gibba020 bash[25448]: audit 2021-03-10T14:37:54.756212+0000 mon.a (mon.0) 1268 : audit [DBG] from='client.? 172.21.2.113:0/323050759' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:37:56.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:56 gibba013 bash[29418]: cluster 2021-03-10T14:37:54.252649+0000 mgr.gibba020.yqfnwy (mgr.34427) 2401 : cluster [DBG] pgmap v1358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:56.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:56 gibba013 bash[29418]: audit 2021-03-10T14:37:54.268508+0000 mgr.gibba020.yqfnwy (mgr.34427) 2402 : audit [DBG] from='client.55657 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:37:56.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:56 gibba013 bash[29418]: audit 2021-03-10T14:37:54.496854+0000 mgr.gibba020.yqfnwy (mgr.34427) 2403 : audit [DBG] from='client.55663 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:37:56.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:56 gibba013 bash[30381]: cluster 2021-03-10T14:37:54.252649+0000 mgr.gibba020.yqfnwy (mgr.34427) 2401 : cluster [DBG] pgmap v1358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:56.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:56 gibba013 bash[30381]: audit 2021-03-10T14:37:54.268508+0000 mgr.gibba020.yqfnwy (mgr.34427) 2402 : audit [DBG] from='client.55657 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:37:56.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:56 gibba013 bash[30381]: audit 2021-03-10T14:37:54.496854+0000 mgr.gibba020.yqfnwy (mgr.34427) 2403 : audit [DBG] from='client.55663 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:37:56.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:56 gibba020 bash[25448]: cluster 2021-03-10T14:37:54.252649+0000 mgr.gibba020.yqfnwy (mgr.34427) 2401 : cluster [DBG] pgmap v1358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:56.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:56 gibba020 bash[25448]: audit 2021-03-10T14:37:54.268508+0000 mgr.gibba020.yqfnwy (mgr.34427) 2402 : audit [DBG] from='client.55657 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:37:56.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:56 gibba020 bash[25448]: audit 2021-03-10T14:37:54.496854+0000 mgr.gibba020.yqfnwy (mgr.34427) 2403 : audit [DBG] from='client.55663 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:37:58.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:37:58 gibba013 bash[29418]: cluster 2021-03-10T14:37:56.254290+0000 mgr.gibba020.yqfnwy (mgr.34427) 2404 : cluster [DBG] pgmap v1359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:58.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:37:58 gibba013 bash[30381]: cluster 2021-03-10T14:37:56.254290+0000 mgr.gibba020.yqfnwy (mgr.34427) 2404 : cluster [DBG] pgmap v1359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:37:58.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:37:58 gibba020 bash[25448]: cluster 2021-03-10T14:37:56.254290+0000 mgr.gibba020.yqfnwy (mgr.34427) 2404 : cluster [DBG] pgmap v1359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:00.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:00 gibba013 bash[29418]: cluster 2021-03-10T14:37:58.255490+0000 mgr.gibba020.yqfnwy (mgr.34427) 2405 : cluster [DBG] pgmap v1360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:00.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:00 gibba013 bash[30381]: cluster 2021-03-10T14:37:58.255490+0000 mgr.gibba020.yqfnwy (mgr.34427) 2405 : cluster [DBG] pgmap v1360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:00.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:00 gibba020 bash[25448]: cluster 2021-03-10T14:37:58.255490+0000 mgr.gibba020.yqfnwy (mgr.34427) 2405 : cluster [DBG] pgmap v1360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:02.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:02 gibba013 bash[29418]: cluster 2021-03-10T14:38:00.257350+0000 mgr.gibba020.yqfnwy (mgr.34427) 2406 : cluster [DBG] pgmap v1361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:02.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:02 gibba013 bash[29418]: audit 2021-03-10T14:38:01.198265+0000 mon.a (mon.0) 1269 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:38:02.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:02 gibba013 bash[29418]: audit 2021-03-10T14:38:01.205463+0000 mon.a (mon.0) 1270 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:38:02.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:02 gibba013 bash[30381]: cluster 2021-03-10T14:38:00.257350+0000 mgr.gibba020.yqfnwy (mgr.34427) 2406 : cluster [DBG] pgmap v1361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:02.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:02 gibba013 bash[30381]: audit 2021-03-10T14:38:01.198265+0000 mon.a (mon.0) 1269 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:38:02.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:02 gibba013 bash[30381]: audit 2021-03-10T14:38:01.205463+0000 mon.a (mon.0) 1270 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:38:02.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:02 gibba020 bash[25448]: cluster 2021-03-10T14:38:00.257350+0000 mgr.gibba020.yqfnwy (mgr.34427) 2406 : cluster [DBG] pgmap v1361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:02.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:02 gibba020 bash[25448]: audit 2021-03-10T14:38:01.198265+0000 mon.a (mon.0) 1269 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:38:02.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:02 gibba020 bash[25448]: audit 2021-03-10T14:38:01.205463+0000 mon.a (mon.0) 1270 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:38:03.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:03 gibba013 bash[29418]: cephadm 2021-03-10T14:38:01.204277+0000 mgr.gibba020.yqfnwy (mgr.34427) 2407 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:38:03.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:03 gibba013 bash[30381]: cephadm 2021-03-10T14:38:01.204277+0000 mgr.gibba020.yqfnwy (mgr.34427) 2407 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:38:03.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:03 gibba020 bash[25448]: cephadm 2021-03-10T14:38:01.204277+0000 mgr.gibba020.yqfnwy (mgr.34427) 2407 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:38:04.448 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:04 gibba013 bash[29418]: cluster 2021-03-10T14:38:02.258626+0000 mgr.gibba020.yqfnwy (mgr.34427) 2408 : cluster [DBG] pgmap v1362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:04.449 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:04 gibba013 bash[30381]: cluster 2021-03-10T14:38:02.258626+0000 mgr.gibba020.yqfnwy (mgr.34427) 2408 : cluster [DBG] pgmap v1362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:04.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:04 gibba020 bash[25448]: cluster 2021-03-10T14:38:02.258626+0000 mgr.gibba020.yqfnwy (mgr.34427) 2408 : cluster [DBG] pgmap v1362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:06.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[29418]: cluster 2021-03-10T14:38:04.260284+0000 mgr.gibba020.yqfnwy (mgr.34427) 2409 : cluster [DBG] pgmap v1363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:06.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[29418]: audit 2021-03-10T14:38:04.789087+0000 mon.a (mon.0) 1271 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:38:06.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[29418]: cephadm 2021-03-10T14:38:04.790000+0000 mgr.gibba020.yqfnwy (mgr.34427) 2410 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:38:06.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[29418]: audit 2021-03-10T14:38:05.035278+0000 mon.a (mon.0) 1272 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:38:06.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[29418]: cephadm 2021-03-10T14:38:05.047693+0000 mgr.gibba020.yqfnwy (mgr.34427) 2411 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:38:06.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[29418]: audit 2021-03-10T14:38:05.051290+0000 mon.a (mon.0) 1273 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:38:06.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[29418]: cephadm 2021-03-10T14:38:05.053457+0000 mgr.gibba020.yqfnwy (mgr.34427) 2412 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:38:06.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[29418]: audit 2021-03-10T14:38:05.055462+0000 mon.a (mon.0) 1274 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:06.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[29418]: cephadm 2021-03-10T14:38:05.057077+0000 mgr.gibba020.yqfnwy (mgr.34427) 2413 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:38:06.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[29418]: cephadm 2021-03-10T14:38:05.057340+0000 mgr.gibba020.yqfnwy (mgr.34427) 2414 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:38:06.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[29418]: audit 2021-03-10T14:38:05.059332+0000 mon.a (mon.0) 1275 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:06.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[29418]: cephadm 2021-03-10T14:38:05.060887+0000 mgr.gibba020.yqfnwy (mgr.34427) 2415 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:38:06.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[29418]: cephadm 2021-03-10T14:38:05.061218+0000 mgr.gibba020.yqfnwy (mgr.34427) 2416 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:38:06.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[29418]: audit 2021-03-10T14:38:05.062874+0000 mon.a (mon.0) 1276 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:06.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[29418]: cephadm 2021-03-10T14:38:05.064396+0000 mgr.gibba020.yqfnwy (mgr.34427) 2417 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:38:06.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[29418]: cephadm 2021-03-10T14:38:05.066997+0000 mgr.gibba020.yqfnwy (mgr.34427) 2418 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:38:06.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[29418]: cephadm 2021-03-10T14:38:05.067347+0000 mgr.gibba020.yqfnwy (mgr.34427) 2419 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:38:06.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[29418]: audit 2021-03-10T14:38:05.069717+0000 mon.a (mon.0) 1277 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:06.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[29418]: cephadm 2021-03-10T14:38:05.071290+0000 mgr.gibba020.yqfnwy (mgr.34427) 2420 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:38:06.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[29418]: cephadm 2021-03-10T14:38:05.073479+0000 mgr.gibba020.yqfnwy (mgr.34427) 2421 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:38:06.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[30381]: cluster 2021-03-10T14:38:04.260284+0000 mgr.gibba020.yqfnwy (mgr.34427) 2409 : cluster [DBG] pgmap v1363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:06.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[30381]: audit 2021-03-10T14:38:04.789087+0000 mon.a (mon.0) 1271 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:38:06.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[30381]: cephadm 2021-03-10T14:38:04.790000+0000 mgr.gibba020.yqfnwy (mgr.34427) 2410 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:38:06.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[30381]: audit 2021-03-10T14:38:05.035278+0000 mon.a (mon.0) 1272 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:38:06.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[30381]: cephadm 2021-03-10T14:38:05.047693+0000 mgr.gibba020.yqfnwy (mgr.34427) 2411 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:38:06.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[30381]: audit 2021-03-10T14:38:05.051290+0000 mon.a (mon.0) 1273 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:38:06.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[30381]: cephadm 2021-03-10T14:38:05.053457+0000 mgr.gibba020.yqfnwy (mgr.34427) 2412 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:38:06.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[30381]: audit 2021-03-10T14:38:05.055462+0000 mon.a (mon.0) 1274 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:06.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[30381]: cephadm 2021-03-10T14:38:05.057077+0000 mgr.gibba020.yqfnwy (mgr.34427) 2413 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:38:06.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[30381]: cephadm 2021-03-10T14:38:05.057340+0000 mgr.gibba020.yqfnwy (mgr.34427) 2414 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:38:06.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[30381]: audit 2021-03-10T14:38:05.059332+0000 mon.a (mon.0) 1275 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:06.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[30381]: cephadm 2021-03-10T14:38:05.060887+0000 mgr.gibba020.yqfnwy (mgr.34427) 2415 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:38:06.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[30381]: cephadm 2021-03-10T14:38:05.061218+0000 mgr.gibba020.yqfnwy (mgr.34427) 2416 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:38:06.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[30381]: audit 2021-03-10T14:38:05.062874+0000 mon.a (mon.0) 1276 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:06.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[30381]: cephadm 2021-03-10T14:38:05.064396+0000 mgr.gibba020.yqfnwy (mgr.34427) 2417 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:38:06.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[30381]: cephadm 2021-03-10T14:38:05.066997+0000 mgr.gibba020.yqfnwy (mgr.34427) 2418 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:38:06.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[30381]: cephadm 2021-03-10T14:38:05.067347+0000 mgr.gibba020.yqfnwy (mgr.34427) 2419 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:38:06.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[30381]: audit 2021-03-10T14:38:05.069717+0000 mon.a (mon.0) 1277 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:06.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[30381]: cephadm 2021-03-10T14:38:05.071290+0000 mgr.gibba020.yqfnwy (mgr.34427) 2420 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:38:06.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[30381]: cephadm 2021-03-10T14:38:05.073479+0000 mgr.gibba020.yqfnwy (mgr.34427) 2421 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:38:06.141 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[29418]: audit 2021-03-10T14:38:05.075266+0000 mon.a (mon.0) 1278 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:06.141 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[29418]: cephadm 2021-03-10T14:38:05.077218+0000 mgr.gibba020.yqfnwy (mgr.34427) 2422 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:38:06.141 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[29418]: cephadm 2021-03-10T14:38:05.077501+0000 mgr.gibba020.yqfnwy (mgr.34427) 2423 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:38:06.142 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[29418]: cephadm 2021-03-10T14:38:05.078428+0000 mgr.gibba020.yqfnwy (mgr.34427) 2424 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:38:06.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[30381]: audit 2021-03-10T14:38:05.075266+0000 mon.a (mon.0) 1278 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:06.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[30381]: cephadm 2021-03-10T14:38:05.077218+0000 mgr.gibba020.yqfnwy (mgr.34427) 2422 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:38:06.143 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[30381]: cephadm 2021-03-10T14:38:05.077501+0000 mgr.gibba020.yqfnwy (mgr.34427) 2423 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:38:06.143 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:05 gibba013 bash[30381]: cephadm 2021-03-10T14:38:05.078428+0000 mgr.gibba020.yqfnwy (mgr.34427) 2424 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:38:06.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:05 gibba020 bash[25448]: cluster 2021-03-10T14:38:04.260284+0000 mgr.gibba020.yqfnwy (mgr.34427) 2409 : cluster [DBG] pgmap v1363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:06.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:05 gibba020 bash[25448]: audit 2021-03-10T14:38:04.789087+0000 mon.a (mon.0) 1271 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:38:06.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:05 gibba020 bash[25448]: cephadm 2021-03-10T14:38:04.790000+0000 mgr.gibba020.yqfnwy (mgr.34427) 2410 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:38:06.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:05 gibba020 bash[25448]: audit 2021-03-10T14:38:05.035278+0000 mon.a (mon.0) 1272 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:38:06.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:05 gibba020 bash[25448]: cephadm 2021-03-10T14:38:05.047693+0000 mgr.gibba020.yqfnwy (mgr.34427) 2411 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:38:06.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:05 gibba020 bash[25448]: audit 2021-03-10T14:38:05.051290+0000 mon.a (mon.0) 1273 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:38:06.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:05 gibba020 bash[25448]: cephadm 2021-03-10T14:38:05.053457+0000 mgr.gibba020.yqfnwy (mgr.34427) 2412 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:38:06.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:05 gibba020 bash[25448]: audit 2021-03-10T14:38:05.055462+0000 mon.a (mon.0) 1274 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:06.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:05 gibba020 bash[25448]: cephadm 2021-03-10T14:38:05.057077+0000 mgr.gibba020.yqfnwy (mgr.34427) 2413 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:38:06.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:05 gibba020 bash[25448]: cephadm 2021-03-10T14:38:05.057340+0000 mgr.gibba020.yqfnwy (mgr.34427) 2414 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:38:06.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:05 gibba020 bash[25448]: audit 2021-03-10T14:38:05.059332+0000 mon.a (mon.0) 1275 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:06.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:05 gibba020 bash[25448]: cephadm 2021-03-10T14:38:05.060887+0000 mgr.gibba020.yqfnwy (mgr.34427) 2415 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:38:06.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:05 gibba020 bash[25448]: cephadm 2021-03-10T14:38:05.061218+0000 mgr.gibba020.yqfnwy (mgr.34427) 2416 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:38:06.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:05 gibba020 bash[25448]: audit 2021-03-10T14:38:05.062874+0000 mon.a (mon.0) 1276 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:06.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:05 gibba020 bash[25448]: cephadm 2021-03-10T14:38:05.064396+0000 mgr.gibba020.yqfnwy (mgr.34427) 2417 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:38:06.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:05 gibba020 bash[25448]: cephadm 2021-03-10T14:38:05.066997+0000 mgr.gibba020.yqfnwy (mgr.34427) 2418 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:38:06.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:05 gibba020 bash[25448]: cephadm 2021-03-10T14:38:05.067347+0000 mgr.gibba020.yqfnwy (mgr.34427) 2419 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:38:06.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:05 gibba020 bash[25448]: audit 2021-03-10T14:38:05.069717+0000 mon.a (mon.0) 1277 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:06.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:05 gibba020 bash[25448]: cephadm 2021-03-10T14:38:05.071290+0000 mgr.gibba020.yqfnwy (mgr.34427) 2420 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:38:06.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:05 gibba020 bash[25448]: cephadm 2021-03-10T14:38:05.073479+0000 mgr.gibba020.yqfnwy (mgr.34427) 2421 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:38:06.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:05 gibba020 bash[25448]: audit 2021-03-10T14:38:05.075266+0000 mon.a (mon.0) 1278 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:06.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:05 gibba020 bash[25448]: cephadm 2021-03-10T14:38:05.077218+0000 mgr.gibba020.yqfnwy (mgr.34427) 2422 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:38:06.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:05 gibba020 bash[25448]: cephadm 2021-03-10T14:38:05.077501+0000 mgr.gibba020.yqfnwy (mgr.34427) 2423 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:38:06.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:05 gibba020 bash[25448]: cephadm 2021-03-10T14:38:05.078428+0000 mgr.gibba020.yqfnwy (mgr.34427) 2424 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:38:07.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:07 gibba013 bash[29418]: audit 2021-03-10T14:38:06.171106+0000 mon.a (mon.0) 1279 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:38:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:07 gibba013 bash[29418]: audit 2021-03-10T14:38:06.171854+0000 mon.a (mon.0) 1280 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:38:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:07 gibba013 bash[29418]: audit 2021-03-10T14:38:06.172536+0000 mon.a (mon.0) 1281 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:38:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:07 gibba013 bash[29418]: audit 2021-03-10T14:38:06.173203+0000 mon.a (mon.0) 1282 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:38:07.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:07 gibba013 bash[29418]: audit 2021-03-10T14:38:06.215787+0000 mon.a (mon.0) 1283 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:38:07.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:07 gibba013 bash[29418]: audit 2021-03-10T14:38:06.221908+0000 mon.a (mon.0) 1284 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:38:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:07 gibba013 bash[30381]: audit 2021-03-10T14:38:06.171106+0000 mon.a (mon.0) 1279 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:38:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:07 gibba013 bash[30381]: audit 2021-03-10T14:38:06.171854+0000 mon.a (mon.0) 1280 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:38:07.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:07 gibba013 bash[30381]: audit 2021-03-10T14:38:06.172536+0000 mon.a (mon.0) 1281 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:38:07.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:07 gibba013 bash[30381]: audit 2021-03-10T14:38:06.173203+0000 mon.a (mon.0) 1282 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:38:07.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:07 gibba013 bash[30381]: audit 2021-03-10T14:38:06.215787+0000 mon.a (mon.0) 1283 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:38:07.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:07 gibba013 bash[30381]: audit 2021-03-10T14:38:06.221908+0000 mon.a (mon.0) 1284 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:38:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:07 gibba020 bash[25448]: audit 2021-03-10T14:38:06.171106+0000 mon.a (mon.0) 1279 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:38:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:07 gibba020 bash[25448]: audit 2021-03-10T14:38:06.171854+0000 mon.a (mon.0) 1280 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:38:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:07 gibba020 bash[25448]: audit 2021-03-10T14:38:06.172536+0000 mon.a (mon.0) 1281 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:38:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:07 gibba020 bash[25448]: audit 2021-03-10T14:38:06.173203+0000 mon.a (mon.0) 1282 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:38:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:07 gibba020 bash[25448]: audit 2021-03-10T14:38:06.215787+0000 mon.a (mon.0) 1283 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:38:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:07 gibba020 bash[25448]: audit 2021-03-10T14:38:06.221908+0000 mon.a (mon.0) 1284 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:38:08.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:08 gibba013 bash[29418]: cluster 2021-03-10T14:38:06.261864+0000 mgr.gibba020.yqfnwy (mgr.34427) 2425 : cluster [DBG] pgmap v1364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:08.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:08 gibba013 bash[30381]: cluster 2021-03-10T14:38:06.261864+0000 mgr.gibba020.yqfnwy (mgr.34427) 2425 : cluster [DBG] pgmap v1364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:08.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:08 gibba020 bash[25448]: cluster 2021-03-10T14:38:06.261864+0000 mgr.gibba020.yqfnwy (mgr.34427) 2425 : cluster [DBG] pgmap v1364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:10.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:10 gibba013 bash[29418]: cluster 2021-03-10T14:38:08.263226+0000 mgr.gibba020.yqfnwy (mgr.34427) 2426 : cluster [DBG] pgmap v1365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:10.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:10 gibba013 bash[30381]: cluster 2021-03-10T14:38:08.263226+0000 mgr.gibba020.yqfnwy (mgr.34427) 2426 : cluster [DBG] pgmap v1365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:10.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:10 gibba020 bash[25448]: cluster 2021-03-10T14:38:08.263226+0000 mgr.gibba020.yqfnwy (mgr.34427) 2426 : cluster [DBG] pgmap v1365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:12.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:12 gibba013 bash[29418]: cluster 2021-03-10T14:38:10.265017+0000 mgr.gibba020.yqfnwy (mgr.34427) 2427 : cluster [DBG] pgmap v1366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:12.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:12 gibba013 bash[30381]: cluster 2021-03-10T14:38:10.265017+0000 mgr.gibba020.yqfnwy (mgr.34427) 2427 : cluster [DBG] pgmap v1366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:12.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:12 gibba020 bash[25448]: cluster 2021-03-10T14:38:10.265017+0000 mgr.gibba020.yqfnwy (mgr.34427) 2427 : cluster [DBG] pgmap v1366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:14.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:14 gibba013 bash[29418]: cluster 2021-03-10T14:38:12.266414+0000 mgr.gibba020.yqfnwy (mgr.34427) 2428 : cluster [DBG] pgmap v1367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:14.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:14 gibba013 bash[30381]: cluster 2021-03-10T14:38:12.266414+0000 mgr.gibba020.yqfnwy (mgr.34427) 2428 : cluster [DBG] pgmap v1367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:14.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:14 gibba020 bash[25448]: cluster 2021-03-10T14:38:12.266414+0000 mgr.gibba020.yqfnwy (mgr.34427) 2428 : cluster [DBG] pgmap v1367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:16.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:16 gibba013 bash[29418]: cluster 2021-03-10T14:38:14.267838+0000 mgr.gibba020.yqfnwy (mgr.34427) 2429 : cluster [DBG] pgmap v1368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:16.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:16 gibba013 bash[30381]: cluster 2021-03-10T14:38:14.267838+0000 mgr.gibba020.yqfnwy (mgr.34427) 2429 : cluster [DBG] pgmap v1368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:16.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:16 gibba020 bash[25448]: cluster 2021-03-10T14:38:14.267838+0000 mgr.gibba020.yqfnwy (mgr.34427) 2429 : cluster [DBG] pgmap v1368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:18.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:18 gibba013 bash[29418]: cluster 2021-03-10T14:38:16.269715+0000 mgr.gibba020.yqfnwy (mgr.34427) 2430 : cluster [DBG] pgmap v1369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:18.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:18 gibba013 bash[30381]: cluster 2021-03-10T14:38:16.269715+0000 mgr.gibba020.yqfnwy (mgr.34427) 2430 : cluster [DBG] pgmap v1369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:18.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:18 gibba020 bash[25448]: cluster 2021-03-10T14:38:16.269715+0000 mgr.gibba020.yqfnwy (mgr.34427) 2430 : cluster [DBG] pgmap v1369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:20.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:20 gibba013 bash[29418]: cluster 2021-03-10T14:38:18.270968+0000 mgr.gibba020.yqfnwy (mgr.34427) 2431 : cluster [DBG] pgmap v1370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:20.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:20 gibba013 bash[30381]: cluster 2021-03-10T14:38:18.270968+0000 mgr.gibba020.yqfnwy (mgr.34427) 2431 : cluster [DBG] pgmap v1370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:20.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:20 gibba020 bash[25448]: cluster 2021-03-10T14:38:18.270968+0000 mgr.gibba020.yqfnwy (mgr.34427) 2431 : cluster [DBG] pgmap v1370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:21.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:21 gibba013 bash[29418]: cephadm 2021-03-10T14:38:20.084915+0000 mgr.gibba020.yqfnwy (mgr.34427) 2432 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:38:21.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:21 gibba013 bash[30381]: cephadm 2021-03-10T14:38:20.084915+0000 mgr.gibba020.yqfnwy (mgr.34427) 2432 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:38:21.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:21 gibba020 bash[25448]: cephadm 2021-03-10T14:38:20.084915+0000 mgr.gibba020.yqfnwy (mgr.34427) 2432 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:38:22.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:22 gibba013 bash[29418]: cluster 2021-03-10T14:38:20.272752+0000 mgr.gibba020.yqfnwy (mgr.34427) 2433 : cluster [DBG] pgmap v1371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:22.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:22 gibba013 bash[30381]: cluster 2021-03-10T14:38:20.272752+0000 mgr.gibba020.yqfnwy (mgr.34427) 2433 : cluster [DBG] pgmap v1371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:22.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:22 gibba020 bash[25448]: cluster 2021-03-10T14:38:20.272752+0000 mgr.gibba020.yqfnwy (mgr.34427) 2433 : cluster [DBG] pgmap v1371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:24.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:24 gibba013 bash[29418]: cluster 2021-03-10T14:38:22.274193+0000 mgr.gibba020.yqfnwy (mgr.34427) 2434 : cluster [DBG] pgmap v1372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:24.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:24 gibba013 bash[30381]: cluster 2021-03-10T14:38:22.274193+0000 mgr.gibba020.yqfnwy (mgr.34427) 2434 : cluster [DBG] pgmap v1372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:24.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:24 gibba020 bash[25448]: cluster 2021-03-10T14:38:22.274193+0000 mgr.gibba020.yqfnwy (mgr.34427) 2434 : cluster [DBG] pgmap v1372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:25.001 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:38:25.228 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:38:25.228 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (44m) 20s ago 50m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:38:25.229 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (50m) 9m ago 50m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:38:25.229 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (45m) 9m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:38:25.229 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (45m) 9m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:38:25.229 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (44m) 20s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:38:25.229 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (44m) 20s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:38:25.230 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (43m) 9m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:38:25.230 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (44m) 20s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:38:25.230 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (50m) 20s ago 50m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:38:25.230 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (50m) 9m ago 50m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:38:25.230 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (43m) 20s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:38:25.231 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (42m) 20s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:38:25.231 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (42m) 20s ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:38:25.231 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (41m) 20s ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:38:25.231 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (41m) 9m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:38:25.231 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (41m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:38:25.232 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (40m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:38:25.232 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (40m) 9m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:38:25.232 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (49m) 9m ago 50m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:38:25.232 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 9m ago 48m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:38:25.474 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:38:25.474 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:38:25.475 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:38:25.475 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:38:25.475 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:38:25.475 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:38:25.475 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:38:25.476 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:38:25.476 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:38:25.476 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:38:25.476 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:38:25.476 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:38:25.477 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:38:25.477 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:38:25.477 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:38:26.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:26 gibba013 bash[29418]: cluster 2021-03-10T14:38:24.275600+0000 mgr.gibba020.yqfnwy (mgr.34427) 2435 : cluster [DBG] pgmap v1373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:26.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:26 gibba013 bash[29418]: audit 2021-03-10T14:38:24.990151+0000 mgr.gibba020.yqfnwy (mgr.34427) 2436 : audit [DBG] from='client.55675 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:38:26.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:26 gibba013 bash[29418]: audit 2021-03-10T14:38:25.472959+0000 mon.c (mon.1) 48 : audit [DBG] from='client.? 172.21.2.113:0/994471105' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:26.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:26 gibba013 bash[30381]: cluster 2021-03-10T14:38:24.275600+0000 mgr.gibba020.yqfnwy (mgr.34427) 2435 : cluster [DBG] pgmap v1373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:26.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:26 gibba013 bash[30381]: audit 2021-03-10T14:38:24.990151+0000 mgr.gibba020.yqfnwy (mgr.34427) 2436 : audit [DBG] from='client.55675 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:38:26.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:26 gibba013 bash[30381]: audit 2021-03-10T14:38:25.472959+0000 mon.c (mon.1) 48 : audit [DBG] from='client.? 172.21.2.113:0/994471105' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:26.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:26 gibba020 bash[25448]: cluster 2021-03-10T14:38:24.275600+0000 mgr.gibba020.yqfnwy (mgr.34427) 2435 : cluster [DBG] pgmap v1373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:26.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:26 gibba020 bash[25448]: audit 2021-03-10T14:38:24.990151+0000 mgr.gibba020.yqfnwy (mgr.34427) 2436 : audit [DBG] from='client.55675 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:38:26.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:26 gibba020 bash[25448]: audit 2021-03-10T14:38:25.472959+0000 mon.c (mon.1) 48 : audit [DBG] from='client.? 172.21.2.113:0/994471105' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:27.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:27 gibba013 bash[29418]: audit 2021-03-10T14:38:25.216211+0000 mgr.gibba020.yqfnwy (mgr.34427) 2437 : audit [DBG] from='client.45696 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:38:27.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:27 gibba013 bash[30381]: audit 2021-03-10T14:38:25.216211+0000 mgr.gibba020.yqfnwy (mgr.34427) 2437 : audit [DBG] from='client.45696 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:38:27.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:27 gibba020 bash[25448]: audit 2021-03-10T14:38:25.216211+0000 mgr.gibba020.yqfnwy (mgr.34427) 2437 : audit [DBG] from='client.45696 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:38:28.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:28 gibba013 bash[29418]: cluster 2021-03-10T14:38:26.277467+0000 mgr.gibba020.yqfnwy (mgr.34427) 2438 : cluster [DBG] pgmap v1374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:28.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:28 gibba013 bash[30381]: cluster 2021-03-10T14:38:26.277467+0000 mgr.gibba020.yqfnwy (mgr.34427) 2438 : cluster [DBG] pgmap v1374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:28.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:28 gibba020 bash[25448]: cluster 2021-03-10T14:38:26.277467+0000 mgr.gibba020.yqfnwy (mgr.34427) 2438 : cluster [DBG] pgmap v1374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:30.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:30 gibba013 bash[29418]: cluster 2021-03-10T14:38:28.278896+0000 mgr.gibba020.yqfnwy (mgr.34427) 2439 : cluster [DBG] pgmap v1375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:30.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:30 gibba013 bash[30381]: cluster 2021-03-10T14:38:28.278896+0000 mgr.gibba020.yqfnwy (mgr.34427) 2439 : cluster [DBG] pgmap v1375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:30.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:30 gibba020 bash[25448]: cluster 2021-03-10T14:38:28.278896+0000 mgr.gibba020.yqfnwy (mgr.34427) 2439 : cluster [DBG] pgmap v1375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:32.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:32 gibba013 bash[29418]: cluster 2021-03-10T14:38:30.280550+0000 mgr.gibba020.yqfnwy (mgr.34427) 2440 : cluster [DBG] pgmap v1376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:32.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:32 gibba013 bash[30381]: cluster 2021-03-10T14:38:30.280550+0000 mgr.gibba020.yqfnwy (mgr.34427) 2440 : cluster [DBG] pgmap v1376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:32.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:32 gibba020 bash[25448]: cluster 2021-03-10T14:38:30.280550+0000 mgr.gibba020.yqfnwy (mgr.34427) 2440 : cluster [DBG] pgmap v1376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:34.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:34 gibba020 bash[25448]: cluster 2021-03-10T14:38:32.281911+0000 mgr.gibba020.yqfnwy (mgr.34427) 2441 : cluster [DBG] pgmap v1377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:34.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:34 gibba013 bash[29418]: cluster 2021-03-10T14:38:32.281911+0000 mgr.gibba020.yqfnwy (mgr.34427) 2441 : cluster [DBG] pgmap v1377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:34.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:34 gibba013 bash[30381]: cluster 2021-03-10T14:38:32.281911+0000 mgr.gibba020.yqfnwy (mgr.34427) 2441 : cluster [DBG] pgmap v1377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:36.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:36 gibba020 bash[25448]: cluster 2021-03-10T14:38:34.283573+0000 mgr.gibba020.yqfnwy (mgr.34427) 2442 : cluster [DBG] pgmap v1378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:36.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:36 gibba020 bash[25448]: cephadm 2021-03-10T14:38:35.100712+0000 mgr.gibba020.yqfnwy (mgr.34427) 2443 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:38:36.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:36 gibba013 bash[29418]: cluster 2021-03-10T14:38:34.283573+0000 mgr.gibba020.yqfnwy (mgr.34427) 2442 : cluster [DBG] pgmap v1378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:36.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:36 gibba013 bash[29418]: cephadm 2021-03-10T14:38:35.100712+0000 mgr.gibba020.yqfnwy (mgr.34427) 2443 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:38:36.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:36 gibba013 bash[30381]: cluster 2021-03-10T14:38:34.283573+0000 mgr.gibba020.yqfnwy (mgr.34427) 2442 : cluster [DBG] pgmap v1378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:36.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:36 gibba013 bash[30381]: cephadm 2021-03-10T14:38:35.100712+0000 mgr.gibba020.yqfnwy (mgr.34427) 2443 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:38:38.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:38 gibba020 bash[25448]: cluster 2021-03-10T14:38:36.285386+0000 mgr.gibba020.yqfnwy (mgr.34427) 2444 : cluster [DBG] pgmap v1379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:38.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:38 gibba013 bash[29418]: cluster 2021-03-10T14:38:36.285386+0000 mgr.gibba020.yqfnwy (mgr.34427) 2444 : cluster [DBG] pgmap v1379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:38.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:38 gibba013 bash[30381]: cluster 2021-03-10T14:38:36.285386+0000 mgr.gibba020.yqfnwy (mgr.34427) 2444 : cluster [DBG] pgmap v1379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:40.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:40 gibba020 bash[25448]: cluster 2021-03-10T14:38:38.286780+0000 mgr.gibba020.yqfnwy (mgr.34427) 2445 : cluster [DBG] pgmap v1380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:40.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:40 gibba013 bash[29418]: cluster 2021-03-10T14:38:38.286780+0000 mgr.gibba020.yqfnwy (mgr.34427) 2445 : cluster [DBG] pgmap v1380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:40.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:40 gibba013 bash[30381]: cluster 2021-03-10T14:38:38.286780+0000 mgr.gibba020.yqfnwy (mgr.34427) 2445 : cluster [DBG] pgmap v1380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:42.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:42 gibba013 bash[29418]: cluster 2021-03-10T14:38:40.288539+0000 mgr.gibba020.yqfnwy (mgr.34427) 2446 : cluster [DBG] pgmap v1381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:42.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:42 gibba013 bash[30381]: cluster 2021-03-10T14:38:40.288539+0000 mgr.gibba020.yqfnwy (mgr.34427) 2446 : cluster [DBG] pgmap v1381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:42.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:42 gibba020 bash[25448]: cluster 2021-03-10T14:38:40.288539+0000 mgr.gibba020.yqfnwy (mgr.34427) 2446 : cluster [DBG] pgmap v1381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:44.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:44 gibba013 bash[29418]: cluster 2021-03-10T14:38:42.290049+0000 mgr.gibba020.yqfnwy (mgr.34427) 2447 : cluster [DBG] pgmap v1382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:44.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:44 gibba013 bash[30381]: cluster 2021-03-10T14:38:42.290049+0000 mgr.gibba020.yqfnwy (mgr.34427) 2447 : cluster [DBG] pgmap v1382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:44.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:44 gibba020 bash[25448]: cluster 2021-03-10T14:38:42.290049+0000 mgr.gibba020.yqfnwy (mgr.34427) 2447 : cluster [DBG] pgmap v1382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:46.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:46 gibba013 bash[29418]: cluster 2021-03-10T14:38:44.291590+0000 mgr.gibba020.yqfnwy (mgr.34427) 2448 : cluster [DBG] pgmap v1383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:46.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:46 gibba013 bash[30381]: cluster 2021-03-10T14:38:44.291590+0000 mgr.gibba020.yqfnwy (mgr.34427) 2448 : cluster [DBG] pgmap v1383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:46.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:46 gibba020 bash[25448]: cluster 2021-03-10T14:38:44.291590+0000 mgr.gibba020.yqfnwy (mgr.34427) 2448 : cluster [DBG] pgmap v1383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:48.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:48 gibba013 bash[29418]: cluster 2021-03-10T14:38:46.293345+0000 mgr.gibba020.yqfnwy (mgr.34427) 2449 : cluster [DBG] pgmap v1384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:48.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:48 gibba013 bash[30381]: cluster 2021-03-10T14:38:46.293345+0000 mgr.gibba020.yqfnwy (mgr.34427) 2449 : cluster [DBG] pgmap v1384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:48.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:48 gibba020 bash[25448]: cluster 2021-03-10T14:38:46.293345+0000 mgr.gibba020.yqfnwy (mgr.34427) 2449 : cluster [DBG] pgmap v1384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:50.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:50 gibba013 bash[29418]: cluster 2021-03-10T14:38:48.294659+0000 mgr.gibba020.yqfnwy (mgr.34427) 2450 : cluster [DBG] pgmap v1385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:50.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:50 gibba013 bash[30381]: cluster 2021-03-10T14:38:48.294659+0000 mgr.gibba020.yqfnwy (mgr.34427) 2450 : cluster [DBG] pgmap v1385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:50.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:50 gibba020 bash[25448]: cluster 2021-03-10T14:38:48.294659+0000 mgr.gibba020.yqfnwy (mgr.34427) 2450 : cluster [DBG] pgmap v1385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:51.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:51 gibba013 bash[29418]: cephadm 2021-03-10T14:38:50.116514+0000 mgr.gibba020.yqfnwy (mgr.34427) 2451 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:38:51.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:51 gibba013 bash[30381]: cephadm 2021-03-10T14:38:50.116514+0000 mgr.gibba020.yqfnwy (mgr.34427) 2451 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:38:51.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:51 gibba020 bash[25448]: cephadm 2021-03-10T14:38:50.116514+0000 mgr.gibba020.yqfnwy (mgr.34427) 2451 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:38:52.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:52 gibba013 bash[29418]: cluster 2021-03-10T14:38:50.296346+0000 mgr.gibba020.yqfnwy (mgr.34427) 2452 : cluster [DBG] pgmap v1386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:52.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:52 gibba013 bash[30381]: cluster 2021-03-10T14:38:50.296346+0000 mgr.gibba020.yqfnwy (mgr.34427) 2452 : cluster [DBG] pgmap v1386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:52.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:52 gibba020 bash[25448]: cluster 2021-03-10T14:38:50.296346+0000 mgr.gibba020.yqfnwy (mgr.34427) 2452 : cluster [DBG] pgmap v1386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:54.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:54 gibba013 bash[29418]: cluster 2021-03-10T14:38:52.297569+0000 mgr.gibba020.yqfnwy (mgr.34427) 2453 : cluster [DBG] pgmap v1387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:54.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:54 gibba013 bash[30381]: cluster 2021-03-10T14:38:52.297569+0000 mgr.gibba020.yqfnwy (mgr.34427) 2453 : cluster [DBG] pgmap v1387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:54.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:54 gibba020 bash[25448]: cluster 2021-03-10T14:38:52.297569+0000 mgr.gibba020.yqfnwy (mgr.34427) 2453 : cluster [DBG] pgmap v1387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:55.715 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:38:55.942 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:38:55.942 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (45m) 51s ago 50m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:38:55.942 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (50m) 9m ago 50m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:38:55.942 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (45m) 9m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:38:55.943 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (46m) 9m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:38:55.943 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (45m) 51s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:38:55.943 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (44m) 51s ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:38:55.943 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (44m) 9m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:38:55.943 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (44m) 51s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:38:55.944 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (50m) 51s ago 50m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:38:55.944 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (50m) 9m ago 50m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:38:55.944 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (43m) 51s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:38:55.944 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (43m) 51s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:38:55.944 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (42m) 51s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:38:55.945 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (42m) 51s ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:38:55.945 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (41m) 9m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:38:55.945 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (41m) 9m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:38:55.945 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (41m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:38:55.945 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (40m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:38:55.946 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (50m) 9m ago 51m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:38:55.946 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 9m ago 48m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:38:56.192 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:38:56.192 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:38:56.193 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:38:56.193 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:38:56.193 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:38:56.193 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:38:56.194 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:38:56.194 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:38:56.194 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:38:56.194 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:38:56.194 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:38:56.195 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:38:56.195 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:38:56.195 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:38:56.195 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:38:56.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:56 gibba013 bash[29418]: cluster 2021-03-10T14:38:54.299269+0000 mgr.gibba020.yqfnwy (mgr.34427) 2454 : cluster [DBG] pgmap v1388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:56.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:56 gibba013 bash[30381]: cluster 2021-03-10T14:38:54.299269+0000 mgr.gibba020.yqfnwy (mgr.34427) 2454 : cluster [DBG] pgmap v1388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:56.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:56 gibba020 bash[25448]: cluster 2021-03-10T14:38:54.299269+0000 mgr.gibba020.yqfnwy (mgr.34427) 2454 : cluster [DBG] pgmap v1388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:57.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:57 gibba013 bash[29418]: audit 2021-03-10T14:38:55.703855+0000 mgr.gibba020.yqfnwy (mgr.34427) 2455 : audit [DBG] from='client.45708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:38:57.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:57 gibba013 bash[29418]: audit 2021-03-10T14:38:55.927230+0000 mgr.gibba020.yqfnwy (mgr.34427) 2456 : audit [DBG] from='client.45714 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:38:57.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:57 gibba013 bash[29418]: audit 2021-03-10T14:38:56.191050+0000 mon.a (mon.0) 1285 : audit [DBG] from='client.? 172.21.2.113:0/357594705' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:57.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:57 gibba013 bash[30381]: audit 2021-03-10T14:38:55.703855+0000 mgr.gibba020.yqfnwy (mgr.34427) 2455 : audit [DBG] from='client.45708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:38:57.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:57 gibba013 bash[30381]: audit 2021-03-10T14:38:55.927230+0000 mgr.gibba020.yqfnwy (mgr.34427) 2456 : audit [DBG] from='client.45714 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:38:57.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:57 gibba013 bash[30381]: audit 2021-03-10T14:38:56.191050+0000 mon.a (mon.0) 1285 : audit [DBG] from='client.? 172.21.2.113:0/357594705' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:57.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:57 gibba020 bash[25448]: audit 2021-03-10T14:38:55.703855+0000 mgr.gibba020.yqfnwy (mgr.34427) 2455 : audit [DBG] from='client.45708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:38:57.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:57 gibba020 bash[25448]: audit 2021-03-10T14:38:55.927230+0000 mgr.gibba020.yqfnwy (mgr.34427) 2456 : audit [DBG] from='client.45714 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:38:57.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:57 gibba020 bash[25448]: audit 2021-03-10T14:38:56.191050+0000 mon.a (mon.0) 1285 : audit [DBG] from='client.? 172.21.2.113:0/357594705' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:38:58.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:38:58 gibba013 bash[29418]: cluster 2021-03-10T14:38:56.301095+0000 mgr.gibba020.yqfnwy (mgr.34427) 2457 : cluster [DBG] pgmap v1389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:58.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:38:58 gibba013 bash[30381]: cluster 2021-03-10T14:38:56.301095+0000 mgr.gibba020.yqfnwy (mgr.34427) 2457 : cluster [DBG] pgmap v1389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:38:58.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:38:58 gibba020 bash[25448]: cluster 2021-03-10T14:38:56.301095+0000 mgr.gibba020.yqfnwy (mgr.34427) 2457 : cluster [DBG] pgmap v1389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:00.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:00 gibba013 bash[29418]: cluster 2021-03-10T14:38:58.302448+0000 mgr.gibba020.yqfnwy (mgr.34427) 2458 : cluster [DBG] pgmap v1390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:00.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:00 gibba013 bash[30381]: cluster 2021-03-10T14:38:58.302448+0000 mgr.gibba020.yqfnwy (mgr.34427) 2458 : cluster [DBG] pgmap v1390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:00.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:00 gibba020 bash[25448]: cluster 2021-03-10T14:38:58.302448+0000 mgr.gibba020.yqfnwy (mgr.34427) 2458 : cluster [DBG] pgmap v1390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:02.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:02 gibba013 bash[29418]: cluster 2021-03-10T14:39:00.304166+0000 mgr.gibba020.yqfnwy (mgr.34427) 2459 : cluster [DBG] pgmap v1391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:02.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:02 gibba013 bash[30381]: cluster 2021-03-10T14:39:00.304166+0000 mgr.gibba020.yqfnwy (mgr.34427) 2459 : cluster [DBG] pgmap v1391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:02.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:02 gibba020 bash[25448]: cluster 2021-03-10T14:39:00.304166+0000 mgr.gibba020.yqfnwy (mgr.34427) 2459 : cluster [DBG] pgmap v1391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:04.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:04 gibba013 bash[29418]: cluster 2021-03-10T14:39:02.305599+0000 mgr.gibba020.yqfnwy (mgr.34427) 2460 : cluster [DBG] pgmap v1392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:04.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:04 gibba013 bash[30381]: cluster 2021-03-10T14:39:02.305599+0000 mgr.gibba020.yqfnwy (mgr.34427) 2460 : cluster [DBG] pgmap v1392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:04.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:04 gibba020 bash[25448]: cluster 2021-03-10T14:39:02.305599+0000 mgr.gibba020.yqfnwy (mgr.34427) 2460 : cluster [DBG] pgmap v1392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:06.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:06 gibba020 bash[25448]: cluster 2021-03-10T14:39:04.307243+0000 mgr.gibba020.yqfnwy (mgr.34427) 2461 : cluster [DBG] pgmap v1393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:06.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:06 gibba020 bash[25448]: audit 2021-03-10T14:39:05.133077+0000 mon.a (mon.0) 1286 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:39:06.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:06 gibba020 bash[25448]: cephadm 2021-03-10T14:39:05.134343+0000 mgr.gibba020.yqfnwy (mgr.34427) 2462 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:39:06.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:06 gibba020 bash[25448]: audit 2021-03-10T14:39:05.135863+0000 mon.a (mon.0) 1287 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:39:06.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:06 gibba013 bash[29418]: cluster 2021-03-10T14:39:04.307243+0000 mgr.gibba020.yqfnwy (mgr.34427) 2461 : cluster [DBG] pgmap v1393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:06.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:06 gibba013 bash[29418]: audit 2021-03-10T14:39:05.133077+0000 mon.a (mon.0) 1286 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:39:06.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:06 gibba013 bash[29418]: cephadm 2021-03-10T14:39:05.134343+0000 mgr.gibba020.yqfnwy (mgr.34427) 2462 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:39:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:06 gibba013 bash[29418]: audit 2021-03-10T14:39:05.135863+0000 mon.a (mon.0) 1287 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:39:06.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:06 gibba013 bash[30381]: cluster 2021-03-10T14:39:04.307243+0000 mgr.gibba020.yqfnwy (mgr.34427) 2461 : cluster [DBG] pgmap v1393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:06.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:06 gibba013 bash[30381]: audit 2021-03-10T14:39:05.133077+0000 mon.a (mon.0) 1286 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:39:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:06 gibba013 bash[30381]: cephadm 2021-03-10T14:39:05.134343+0000 mgr.gibba020.yqfnwy (mgr.34427) 2462 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:39:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:06 gibba013 bash[30381]: audit 2021-03-10T14:39:05.135863+0000 mon.a (mon.0) 1287 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:39:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:07 gibba020 bash[25448]: audit 2021-03-10T14:39:06.177912+0000 mon.a (mon.0) 1288 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:39:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:07 gibba020 bash[25448]: audit 2021-03-10T14:39:06.178201+0000 mon.a (mon.0) 1289 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:39:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:07 gibba020 bash[25448]: audit 2021-03-10T14:39:06.178428+0000 mon.a (mon.0) 1290 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:39:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:07 gibba020 bash[25448]: audit 2021-03-10T14:39:06.178670+0000 mon.a (mon.0) 1291 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:39:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:07 gibba020 bash[25448]: audit 2021-03-10T14:39:06.222810+0000 mon.a (mon.0) 1292 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:39:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:07 gibba020 bash[25448]: audit 2021-03-10T14:39:06.228907+0000 mon.a (mon.0) 1293 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:39:07.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:07 gibba013 bash[29418]: audit 2021-03-10T14:39:06.177912+0000 mon.a (mon.0) 1288 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:39:07.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:07 gibba013 bash[29418]: audit 2021-03-10T14:39:06.178201+0000 mon.a (mon.0) 1289 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:39:07.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:07 gibba013 bash[29418]: audit 2021-03-10T14:39:06.178428+0000 mon.a (mon.0) 1290 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:39:07.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:07 gibba013 bash[29418]: audit 2021-03-10T14:39:06.178670+0000 mon.a (mon.0) 1291 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:39:07.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:07 gibba013 bash[29418]: audit 2021-03-10T14:39:06.222810+0000 mon.a (mon.0) 1292 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:39:07.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:07 gibba013 bash[29418]: audit 2021-03-10T14:39:06.228907+0000 mon.a (mon.0) 1293 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:39:07.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:07 gibba013 bash[30381]: audit 2021-03-10T14:39:06.177912+0000 mon.a (mon.0) 1288 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T14:39:07.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:07 gibba013 bash[30381]: audit 2021-03-10T14:39:06.178201+0000 mon.a (mon.0) 1289 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:39:07.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:07 gibba013 bash[30381]: audit 2021-03-10T14:39:06.178428+0000 mon.a (mon.0) 1290 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:39:07.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:07 gibba013 bash[30381]: audit 2021-03-10T14:39:06.178670+0000 mon.a (mon.0) 1291 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:39:07.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:07 gibba013 bash[30381]: audit 2021-03-10T14:39:06.222810+0000 mon.a (mon.0) 1292 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:39:07.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:07 gibba013 bash[30381]: audit 2021-03-10T14:39:06.228907+0000 mon.a (mon.0) 1293 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:39:08.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:08 gibba020 bash[25448]: cluster 2021-03-10T14:39:06.307882+0000 mgr.gibba020.yqfnwy (mgr.34427) 2463 : cluster [DBG] pgmap v1394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:08.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:08 gibba013 bash[29418]: cluster 2021-03-10T14:39:06.307882+0000 mgr.gibba020.yqfnwy (mgr.34427) 2463 : cluster [DBG] pgmap v1394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:08.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:08 gibba013 bash[30381]: cluster 2021-03-10T14:39:06.307882+0000 mgr.gibba020.yqfnwy (mgr.34427) 2463 : cluster [DBG] pgmap v1394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:10.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[29418]: cluster 2021-03-10T14:39:08.308231+0000 mgr.gibba020.yqfnwy (mgr.34427) 2464 : cluster [DBG] pgmap v1395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:10.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[29418]: cephadm 2021-03-10T14:39:08.840188+0000 mgr.gibba020.yqfnwy (mgr.34427) 2465 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:39:10.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[29418]: audit 2021-03-10T14:39:08.840321+0000 mon.a (mon.0) 1294 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:39:10.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[29418]: audit 2021-03-10T14:39:09.050638+0000 mon.a (mon.0) 1295 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:39:10.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[29418]: cephadm 2021-03-10T14:39:09.052833+0000 mgr.gibba020.yqfnwy (mgr.34427) 2466 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:39:10.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[29418]: audit 2021-03-10T14:39:09.054311+0000 mon.a (mon.0) 1296 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:39:10.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[29418]: cephadm 2021-03-10T14:39:09.054854+0000 mgr.gibba020.yqfnwy (mgr.34427) 2467 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:39:10.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[29418]: audit 2021-03-10T14:39:09.056061+0000 mon.a (mon.0) 1297 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:10.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[29418]: cephadm 2021-03-10T14:39:09.056375+0000 mgr.gibba020.yqfnwy (mgr.34427) 2468 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:39:10.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[29418]: cephadm 2021-03-10T14:39:09.056410+0000 mgr.gibba020.yqfnwy (mgr.34427) 2469 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:39:10.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[29418]: audit 2021-03-10T14:39:09.057549+0000 mon.a (mon.0) 1298 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:10.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[29418]: cephadm 2021-03-10T14:39:09.057725+0000 mgr.gibba020.yqfnwy (mgr.34427) 2470 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:39:10.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[29418]: cephadm 2021-03-10T14:39:09.057760+0000 mgr.gibba020.yqfnwy (mgr.34427) 2471 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:39:10.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[29418]: audit 2021-03-10T14:39:09.058764+0000 mon.a (mon.0) 1299 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:10.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[29418]: cephadm 2021-03-10T14:39:09.059057+0000 mgr.gibba020.yqfnwy (mgr.34427) 2472 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:39:10.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[29418]: cephadm 2021-03-10T14:39:09.060485+0000 mgr.gibba020.yqfnwy (mgr.34427) 2473 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:39:10.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[29418]: cephadm 2021-03-10T14:39:09.060520+0000 mgr.gibba020.yqfnwy (mgr.34427) 2474 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:39:10.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[29418]: audit 2021-03-10T14:39:09.061783+0000 mon.a (mon.0) 1300 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:10.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[29418]: cephadm 2021-03-10T14:39:09.062053+0000 mgr.gibba020.yqfnwy (mgr.34427) 2475 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:39:10.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[29418]: cephadm 2021-03-10T14:39:09.062364+0000 mgr.gibba020.yqfnwy (mgr.34427) 2476 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:39:10.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[29418]: audit 2021-03-10T14:39:09.063484+0000 mon.a (mon.0) 1301 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:10.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[29418]: cephadm 2021-03-10T14:39:09.063932+0000 mgr.gibba020.yqfnwy (mgr.34427) 2477 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:39:10.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[29418]: cephadm 2021-03-10T14:39:09.064018+0000 mgr.gibba020.yqfnwy (mgr.34427) 2478 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:39:10.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[29418]: cephadm 2021-03-10T14:39:09.064224+0000 mgr.gibba020.yqfnwy (mgr.34427) 2479 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:39:10.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[30381]: cluster 2021-03-10T14:39:08.308231+0000 mgr.gibba020.yqfnwy (mgr.34427) 2464 : cluster [DBG] pgmap v1395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:10.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[30381]: cephadm 2021-03-10T14:39:08.840188+0000 mgr.gibba020.yqfnwy (mgr.34427) 2465 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:39:10.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[30381]: audit 2021-03-10T14:39:08.840321+0000 mon.a (mon.0) 1294 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:39:10.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[30381]: audit 2021-03-10T14:39:09.050638+0000 mon.a (mon.0) 1295 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:39:10.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[30381]: cephadm 2021-03-10T14:39:09.052833+0000 mgr.gibba020.yqfnwy (mgr.34427) 2466 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:39:10.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[30381]: audit 2021-03-10T14:39:09.054311+0000 mon.a (mon.0) 1296 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:39:10.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[30381]: cephadm 2021-03-10T14:39:09.054854+0000 mgr.gibba020.yqfnwy (mgr.34427) 2467 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:39:10.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[30381]: audit 2021-03-10T14:39:09.056061+0000 mon.a (mon.0) 1297 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:10.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[30381]: cephadm 2021-03-10T14:39:09.056375+0000 mgr.gibba020.yqfnwy (mgr.34427) 2468 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:39:10.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[30381]: cephadm 2021-03-10T14:39:09.056410+0000 mgr.gibba020.yqfnwy (mgr.34427) 2469 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:39:10.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[30381]: audit 2021-03-10T14:39:09.057549+0000 mon.a (mon.0) 1298 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:10.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[30381]: cephadm 2021-03-10T14:39:09.057725+0000 mgr.gibba020.yqfnwy (mgr.34427) 2470 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:39:10.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[30381]: cephadm 2021-03-10T14:39:09.057760+0000 mgr.gibba020.yqfnwy (mgr.34427) 2471 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:39:10.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[30381]: audit 2021-03-10T14:39:09.058764+0000 mon.a (mon.0) 1299 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:10.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[30381]: cephadm 2021-03-10T14:39:09.059057+0000 mgr.gibba020.yqfnwy (mgr.34427) 2472 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:39:10.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[30381]: cephadm 2021-03-10T14:39:09.060485+0000 mgr.gibba020.yqfnwy (mgr.34427) 2473 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:39:10.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[30381]: cephadm 2021-03-10T14:39:09.060520+0000 mgr.gibba020.yqfnwy (mgr.34427) 2474 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:39:10.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[30381]: audit 2021-03-10T14:39:09.061783+0000 mon.a (mon.0) 1300 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:10.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[30381]: cephadm 2021-03-10T14:39:09.062053+0000 mgr.gibba020.yqfnwy (mgr.34427) 2475 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:39:10.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[30381]: cephadm 2021-03-10T14:39:09.062364+0000 mgr.gibba020.yqfnwy (mgr.34427) 2476 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:39:10.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[30381]: audit 2021-03-10T14:39:09.063484+0000 mon.a (mon.0) 1301 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:10.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[30381]: cephadm 2021-03-10T14:39:09.063932+0000 mgr.gibba020.yqfnwy (mgr.34427) 2477 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:39:10.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[30381]: cephadm 2021-03-10T14:39:09.064018+0000 mgr.gibba020.yqfnwy (mgr.34427) 2478 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:39:10.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:09 gibba013 bash[30381]: cephadm 2021-03-10T14:39:09.064224+0000 mgr.gibba020.yqfnwy (mgr.34427) 2479 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:39:10.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:09 gibba020 bash[25448]: cluster 2021-03-10T14:39:08.308231+0000 mgr.gibba020.yqfnwy (mgr.34427) 2464 : cluster [DBG] pgmap v1395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:10.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:09 gibba020 bash[25448]: cephadm 2021-03-10T14:39:08.840188+0000 mgr.gibba020.yqfnwy (mgr.34427) 2465 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:39:10.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:09 gibba020 bash[25448]: audit 2021-03-10T14:39:08.840321+0000 mon.a (mon.0) 1294 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:39:10.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:09 gibba020 bash[25448]: audit 2021-03-10T14:39:09.050638+0000 mon.a (mon.0) 1295 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:39:10.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:09 gibba020 bash[25448]: cephadm 2021-03-10T14:39:09.052833+0000 mgr.gibba020.yqfnwy (mgr.34427) 2466 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:39:10.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:09 gibba020 bash[25448]: audit 2021-03-10T14:39:09.054311+0000 mon.a (mon.0) 1296 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:39:10.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:09 gibba020 bash[25448]: cephadm 2021-03-10T14:39:09.054854+0000 mgr.gibba020.yqfnwy (mgr.34427) 2467 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:39:10.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:09 gibba020 bash[25448]: audit 2021-03-10T14:39:09.056061+0000 mon.a (mon.0) 1297 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:10.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:09 gibba020 bash[25448]: cephadm 2021-03-10T14:39:09.056375+0000 mgr.gibba020.yqfnwy (mgr.34427) 2468 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:39:10.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:09 gibba020 bash[25448]: cephadm 2021-03-10T14:39:09.056410+0000 mgr.gibba020.yqfnwy (mgr.34427) 2469 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:39:10.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:09 gibba020 bash[25448]: audit 2021-03-10T14:39:09.057549+0000 mon.a (mon.0) 1298 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:10.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:09 gibba020 bash[25448]: cephadm 2021-03-10T14:39:09.057725+0000 mgr.gibba020.yqfnwy (mgr.34427) 2470 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:39:10.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:09 gibba020 bash[25448]: cephadm 2021-03-10T14:39:09.057760+0000 mgr.gibba020.yqfnwy (mgr.34427) 2471 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:39:10.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:09 gibba020 bash[25448]: audit 2021-03-10T14:39:09.058764+0000 mon.a (mon.0) 1299 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:10.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:09 gibba020 bash[25448]: cephadm 2021-03-10T14:39:09.059057+0000 mgr.gibba020.yqfnwy (mgr.34427) 2472 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:39:10.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:09 gibba020 bash[25448]: cephadm 2021-03-10T14:39:09.060485+0000 mgr.gibba020.yqfnwy (mgr.34427) 2473 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:39:10.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:09 gibba020 bash[25448]: cephadm 2021-03-10T14:39:09.060520+0000 mgr.gibba020.yqfnwy (mgr.34427) 2474 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:39:10.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:09 gibba020 bash[25448]: audit 2021-03-10T14:39:09.061783+0000 mon.a (mon.0) 1300 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:10.206 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:09 gibba020 bash[25448]: cephadm 2021-03-10T14:39:09.062053+0000 mgr.gibba020.yqfnwy (mgr.34427) 2475 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:39:10.206 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:09 gibba020 bash[25448]: cephadm 2021-03-10T14:39:09.062364+0000 mgr.gibba020.yqfnwy (mgr.34427) 2476 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:39:10.206 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:09 gibba020 bash[25448]: audit 2021-03-10T14:39:09.063484+0000 mon.a (mon.0) 1301 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:10.206 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:09 gibba020 bash[25448]: cephadm 2021-03-10T14:39:09.063932+0000 mgr.gibba020.yqfnwy (mgr.34427) 2477 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:39:10.207 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:09 gibba020 bash[25448]: cephadm 2021-03-10T14:39:09.064018+0000 mgr.gibba020.yqfnwy (mgr.34427) 2478 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:39:10.207 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:09 gibba020 bash[25448]: cephadm 2021-03-10T14:39:09.064224+0000 mgr.gibba020.yqfnwy (mgr.34427) 2479 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:39:12.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:12 gibba013 bash[29418]: cluster 2021-03-10T14:39:10.309572+0000 mgr.gibba020.yqfnwy (mgr.34427) 2480 : cluster [DBG] pgmap v1396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:12.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:12 gibba013 bash[30381]: cluster 2021-03-10T14:39:10.309572+0000 mgr.gibba020.yqfnwy (mgr.34427) 2480 : cluster [DBG] pgmap v1396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:12.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:12 gibba020 bash[25448]: cluster 2021-03-10T14:39:10.309572+0000 mgr.gibba020.yqfnwy (mgr.34427) 2480 : cluster [DBG] pgmap v1396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:14.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:14 gibba013 bash[29418]: cluster 2021-03-10T14:39:12.310928+0000 mgr.gibba020.yqfnwy (mgr.34427) 2481 : cluster [DBG] pgmap v1397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:14.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:14 gibba013 bash[30381]: cluster 2021-03-10T14:39:12.310928+0000 mgr.gibba020.yqfnwy (mgr.34427) 2481 : cluster [DBG] pgmap v1397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:14.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:14 gibba020 bash[25448]: cluster 2021-03-10T14:39:12.310928+0000 mgr.gibba020.yqfnwy (mgr.34427) 2481 : cluster [DBG] pgmap v1397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:16.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:16 gibba013 bash[29418]: cluster 2021-03-10T14:39:14.312541+0000 mgr.gibba020.yqfnwy (mgr.34427) 2482 : cluster [DBG] pgmap v1398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:16.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:16 gibba013 bash[30381]: cluster 2021-03-10T14:39:14.312541+0000 mgr.gibba020.yqfnwy (mgr.34427) 2482 : cluster [DBG] pgmap v1398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:16.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:16 gibba020 bash[25448]: cluster 2021-03-10T14:39:14.312541+0000 mgr.gibba020.yqfnwy (mgr.34427) 2482 : cluster [DBG] pgmap v1398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:18.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:18 gibba013 bash[29418]: cluster 2021-03-10T14:39:16.314165+0000 mgr.gibba020.yqfnwy (mgr.34427) 2483 : cluster [DBG] pgmap v1399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:18.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:18 gibba013 bash[30381]: cluster 2021-03-10T14:39:16.314165+0000 mgr.gibba020.yqfnwy (mgr.34427) 2483 : cluster [DBG] pgmap v1399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:18.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:18 gibba020 bash[25448]: cluster 2021-03-10T14:39:16.314165+0000 mgr.gibba020.yqfnwy (mgr.34427) 2483 : cluster [DBG] pgmap v1399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:20.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:20 gibba013 bash[29418]: cluster 2021-03-10T14:39:18.315587+0000 mgr.gibba020.yqfnwy (mgr.34427) 2484 : cluster [DBG] pgmap v1400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:20.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:20 gibba013 bash[30381]: cluster 2021-03-10T14:39:18.315587+0000 mgr.gibba020.yqfnwy (mgr.34427) 2484 : cluster [DBG] pgmap v1400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:20.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:20 gibba020 bash[25448]: cluster 2021-03-10T14:39:18.315587+0000 mgr.gibba020.yqfnwy (mgr.34427) 2484 : cluster [DBG] pgmap v1400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:22.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:22 gibba013 bash[29418]: cluster 2021-03-10T14:39:20.317329+0000 mgr.gibba020.yqfnwy (mgr.34427) 2485 : cluster [DBG] pgmap v1401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:22.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:22 gibba013 bash[30381]: cluster 2021-03-10T14:39:20.317329+0000 mgr.gibba020.yqfnwy (mgr.34427) 2485 : cluster [DBG] pgmap v1401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:22.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:22 gibba020 bash[25448]: cluster 2021-03-10T14:39:20.317329+0000 mgr.gibba020.yqfnwy (mgr.34427) 2485 : cluster [DBG] pgmap v1401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:24.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:24 gibba013 bash[29418]: cluster 2021-03-10T14:39:22.318613+0000 mgr.gibba020.yqfnwy (mgr.34427) 2486 : cluster [DBG] pgmap v1402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:24.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:24 gibba013 bash[30381]: cluster 2021-03-10T14:39:22.318613+0000 mgr.gibba020.yqfnwy (mgr.34427) 2486 : cluster [DBG] pgmap v1402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:24.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:24 gibba020 bash[25448]: cluster 2021-03-10T14:39:22.318613+0000 mgr.gibba020.yqfnwy (mgr.34427) 2486 : cluster [DBG] pgmap v1402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:25.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:25 gibba013 bash[29418]: cephadm 2021-03-10T14:39:24.080281+0000 mgr.gibba020.yqfnwy (mgr.34427) 2487 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:39:25.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:25 gibba013 bash[30381]: cephadm 2021-03-10T14:39:24.080281+0000 mgr.gibba020.yqfnwy (mgr.34427) 2487 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:39:25.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:25 gibba020 bash[25448]: cephadm 2021-03-10T14:39:24.080281+0000 mgr.gibba020.yqfnwy (mgr.34427) 2487 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:39:26.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:26 gibba013 bash[29418]: cluster 2021-03-10T14:39:24.320368+0000 mgr.gibba020.yqfnwy (mgr.34427) 2488 : cluster [DBG] pgmap v1403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:26.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:26 gibba013 bash[30381]: cluster 2021-03-10T14:39:24.320368+0000 mgr.gibba020.yqfnwy (mgr.34427) 2488 : cluster [DBG] pgmap v1403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:26.439 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:39:26.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:26 gibba020 bash[25448]: cluster 2021-03-10T14:39:24.320368+0000 mgr.gibba020.yqfnwy (mgr.34427) 2488 : cluster [DBG] pgmap v1403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:26.663 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:39:26.664 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (45m) 81s ago 51m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:39:26.664 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (51m) 17s ago 51m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:39:26.664 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (46m) 17s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:39:26.664 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (46m) 17s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:39:26.665 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (45m) 81s ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:39:26.665 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (45m) 81s ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:39:26.665 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (45m) 17s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:39:26.665 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (45m) 81s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:39:26.666 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (51m) 81s ago 51m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:39:26.666 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (51m) 17s ago 51m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:39:26.666 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (44m) 81s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:39:26.666 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (43m) 81s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:39:26.667 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (43m) 81s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:39:26.667 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (42m) 81s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:39:26.667 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (42m) 17s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:39:26.667 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (42m) 17s ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:39:26.667 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (41m) 17s ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:39:26.668 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (41m) 17s ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:39:26.668 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (50m) 17s ago 51m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:39:26.668 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 17s ago 49m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:39:26.913 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:39:26.914 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:39:26.914 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:39:26.914 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:39:26.915 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:39:26.915 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:39:26.915 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:39:26.915 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:39:26.915 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:39:26.916 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:39:26.916 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:39:26.916 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:39:26.916 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:39:26.917 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:39:26.917 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:39:27.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:27 gibba013 bash[29418]: audit 2021-03-10T14:39:26.912072+0000 mon.c (mon.1) 49 : audit [DBG] from='client.? 172.21.2.113:0/4098989429' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:27.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:27 gibba013 bash[30381]: audit 2021-03-10T14:39:26.912072+0000 mon.c (mon.1) 49 : audit [DBG] from='client.? 172.21.2.113:0/4098989429' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:27.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:27 gibba020 bash[25448]: audit 2021-03-10T14:39:26.912072+0000 mon.c (mon.1) 49 : audit [DBG] from='client.? 172.21.2.113:0/4098989429' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:28.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:28 gibba013 bash[29418]: cluster 2021-03-10T14:39:26.322008+0000 mgr.gibba020.yqfnwy (mgr.34427) 2489 : cluster [DBG] pgmap v1404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:28.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:28 gibba013 bash[29418]: audit 2021-03-10T14:39:26.427391+0000 mgr.gibba020.yqfnwy (mgr.34427) 2490 : audit [DBG] from='client.45726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:39:28.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:28 gibba013 bash[29418]: audit 2021-03-10T14:39:26.652139+0000 mgr.gibba020.yqfnwy (mgr.34427) 2491 : audit [DBG] from='client.45732 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:39:28.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:28 gibba013 bash[30381]: cluster 2021-03-10T14:39:26.322008+0000 mgr.gibba020.yqfnwy (mgr.34427) 2489 : cluster [DBG] pgmap v1404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:28.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:28 gibba013 bash[30381]: audit 2021-03-10T14:39:26.427391+0000 mgr.gibba020.yqfnwy (mgr.34427) 2490 : audit [DBG] from='client.45726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:39:28.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:28 gibba013 bash[30381]: audit 2021-03-10T14:39:26.652139+0000 mgr.gibba020.yqfnwy (mgr.34427) 2491 : audit [DBG] from='client.45732 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:39:28.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:28 gibba020 bash[25448]: cluster 2021-03-10T14:39:26.322008+0000 mgr.gibba020.yqfnwy (mgr.34427) 2489 : cluster [DBG] pgmap v1404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:28.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:28 gibba020 bash[25448]: audit 2021-03-10T14:39:26.427391+0000 mgr.gibba020.yqfnwy (mgr.34427) 2490 : audit [DBG] from='client.45726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:39:28.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:28 gibba020 bash[25448]: audit 2021-03-10T14:39:26.652139+0000 mgr.gibba020.yqfnwy (mgr.34427) 2491 : audit [DBG] from='client.45732 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:39:30.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:30 gibba020 bash[25448]: cluster 2021-03-10T14:39:28.323436+0000 mgr.gibba020.yqfnwy (mgr.34427) 2492 : cluster [DBG] pgmap v1405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:30.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:30 gibba013 bash[29418]: cluster 2021-03-10T14:39:28.323436+0000 mgr.gibba020.yqfnwy (mgr.34427) 2492 : cluster [DBG] pgmap v1405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:30.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:30 gibba013 bash[30381]: cluster 2021-03-10T14:39:28.323436+0000 mgr.gibba020.yqfnwy (mgr.34427) 2492 : cluster [DBG] pgmap v1405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:32.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:32 gibba020 bash[25448]: cluster 2021-03-10T14:39:30.325081+0000 mgr.gibba020.yqfnwy (mgr.34427) 2493 : cluster [DBG] pgmap v1406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:32.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:32 gibba013 bash[29418]: cluster 2021-03-10T14:39:30.325081+0000 mgr.gibba020.yqfnwy (mgr.34427) 2493 : cluster [DBG] pgmap v1406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:32.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:32 gibba013 bash[30381]: cluster 2021-03-10T14:39:30.325081+0000 mgr.gibba020.yqfnwy (mgr.34427) 2493 : cluster [DBG] pgmap v1406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:34.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:34 gibba020 bash[25448]: cluster 2021-03-10T14:39:32.326532+0000 mgr.gibba020.yqfnwy (mgr.34427) 2494 : cluster [DBG] pgmap v1407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:34.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:34 gibba013 bash[29418]: cluster 2021-03-10T14:39:32.326532+0000 mgr.gibba020.yqfnwy (mgr.34427) 2494 : cluster [DBG] pgmap v1407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:34.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:34 gibba013 bash[30381]: cluster 2021-03-10T14:39:32.326532+0000 mgr.gibba020.yqfnwy (mgr.34427) 2494 : cluster [DBG] pgmap v1407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:36.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:36 gibba020 bash[25448]: cluster 2021-03-10T14:39:34.328229+0000 mgr.gibba020.yqfnwy (mgr.34427) 2495 : cluster [DBG] pgmap v1408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:36.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:36 gibba013 bash[30381]: cluster 2021-03-10T14:39:34.328229+0000 mgr.gibba020.yqfnwy (mgr.34427) 2495 : cluster [DBG] pgmap v1408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:36.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:36 gibba013 bash[29418]: cluster 2021-03-10T14:39:34.328229+0000 mgr.gibba020.yqfnwy (mgr.34427) 2495 : cluster [DBG] pgmap v1408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:38.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:38 gibba020 bash[25448]: cluster 2021-03-10T14:39:36.330055+0000 mgr.gibba020.yqfnwy (mgr.34427) 2496 : cluster [DBG] pgmap v1409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:38.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:38 gibba013 bash[29418]: cluster 2021-03-10T14:39:36.330055+0000 mgr.gibba020.yqfnwy (mgr.34427) 2496 : cluster [DBG] pgmap v1409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:38.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:38 gibba013 bash[30381]: cluster 2021-03-10T14:39:36.330055+0000 mgr.gibba020.yqfnwy (mgr.34427) 2496 : cluster [DBG] pgmap v1409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:40.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:40 gibba020 bash[25448]: cluster 2021-03-10T14:39:38.331467+0000 mgr.gibba020.yqfnwy (mgr.34427) 2497 : cluster [DBG] pgmap v1410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:40.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:40 gibba020 bash[25448]: cephadm 2021-03-10T14:39:39.096408+0000 mgr.gibba020.yqfnwy (mgr.34427) 2498 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:39:40.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:40 gibba013 bash[29418]: cluster 2021-03-10T14:39:38.331467+0000 mgr.gibba020.yqfnwy (mgr.34427) 2497 : cluster [DBG] pgmap v1410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:40.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:40 gibba013 bash[29418]: cephadm 2021-03-10T14:39:39.096408+0000 mgr.gibba020.yqfnwy (mgr.34427) 2498 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:39:40.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:40 gibba013 bash[30381]: cluster 2021-03-10T14:39:38.331467+0000 mgr.gibba020.yqfnwy (mgr.34427) 2497 : cluster [DBG] pgmap v1410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:40.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:40 gibba013 bash[30381]: cephadm 2021-03-10T14:39:39.096408+0000 mgr.gibba020.yqfnwy (mgr.34427) 2498 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:39:42.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:42 gibba020 bash[25448]: cluster 2021-03-10T14:39:40.332991+0000 mgr.gibba020.yqfnwy (mgr.34427) 2499 : cluster [DBG] pgmap v1411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:42.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:42 gibba013 bash[29418]: cluster 2021-03-10T14:39:40.332991+0000 mgr.gibba020.yqfnwy (mgr.34427) 2499 : cluster [DBG] pgmap v1411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:42.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:42 gibba013 bash[30381]: cluster 2021-03-10T14:39:40.332991+0000 mgr.gibba020.yqfnwy (mgr.34427) 2499 : cluster [DBG] pgmap v1411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:44.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:44 gibba020 bash[25448]: cluster 2021-03-10T14:39:42.334132+0000 mgr.gibba020.yqfnwy (mgr.34427) 2500 : cluster [DBG] pgmap v1412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:44.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:44 gibba013 bash[29418]: cluster 2021-03-10T14:39:42.334132+0000 mgr.gibba020.yqfnwy (mgr.34427) 2500 : cluster [DBG] pgmap v1412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:44.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:44 gibba013 bash[30381]: cluster 2021-03-10T14:39:42.334132+0000 mgr.gibba020.yqfnwy (mgr.34427) 2500 : cluster [DBG] pgmap v1412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:45.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:45 gibba013 bash[29418]: cluster 2021-03-10T14:39:44.335521+0000 mgr.gibba020.yqfnwy (mgr.34427) 2501 : cluster [DBG] pgmap v1413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:45.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:45 gibba013 bash[30381]: cluster 2021-03-10T14:39:44.335521+0000 mgr.gibba020.yqfnwy (mgr.34427) 2501 : cluster [DBG] pgmap v1413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:45.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:45 gibba020 bash[25448]: cluster 2021-03-10T14:39:44.335521+0000 mgr.gibba020.yqfnwy (mgr.34427) 2501 : cluster [DBG] pgmap v1413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:48.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:48 gibba013 bash[29418]: cluster 2021-03-10T14:39:46.337260+0000 mgr.gibba020.yqfnwy (mgr.34427) 2502 : cluster [DBG] pgmap v1414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:48.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:48 gibba013 bash[30381]: cluster 2021-03-10T14:39:46.337260+0000 mgr.gibba020.yqfnwy (mgr.34427) 2502 : cluster [DBG] pgmap v1414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:48.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:48 gibba020 bash[25448]: cluster 2021-03-10T14:39:46.337260+0000 mgr.gibba020.yqfnwy (mgr.34427) 2502 : cluster [DBG] pgmap v1414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:50.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:50 gibba013 bash[29418]: cluster 2021-03-10T14:39:48.338668+0000 mgr.gibba020.yqfnwy (mgr.34427) 2503 : cluster [DBG] pgmap v1415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:50.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:50 gibba013 bash[30381]: cluster 2021-03-10T14:39:48.338668+0000 mgr.gibba020.yqfnwy (mgr.34427) 2503 : cluster [DBG] pgmap v1415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:50.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:50 gibba020 bash[25448]: cluster 2021-03-10T14:39:48.338668+0000 mgr.gibba020.yqfnwy (mgr.34427) 2503 : cluster [DBG] pgmap v1415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:52.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:52 gibba013 bash[29418]: cluster 2021-03-10T14:39:50.340298+0000 mgr.gibba020.yqfnwy (mgr.34427) 2504 : cluster [DBG] pgmap v1416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:52.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:52 gibba013 bash[30381]: cluster 2021-03-10T14:39:50.340298+0000 mgr.gibba020.yqfnwy (mgr.34427) 2504 : cluster [DBG] pgmap v1416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:52.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:52 gibba020 bash[25448]: cluster 2021-03-10T14:39:50.340298+0000 mgr.gibba020.yqfnwy (mgr.34427) 2504 : cluster [DBG] pgmap v1416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:54.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:54 gibba013 bash[29418]: cluster 2021-03-10T14:39:52.341718+0000 mgr.gibba020.yqfnwy (mgr.34427) 2505 : cluster [DBG] pgmap v1417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:54.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:54 gibba013 bash[30381]: cluster 2021-03-10T14:39:52.341718+0000 mgr.gibba020.yqfnwy (mgr.34427) 2505 : cluster [DBG] pgmap v1417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:54.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:54 gibba020 bash[25448]: cluster 2021-03-10T14:39:52.341718+0000 mgr.gibba020.yqfnwy (mgr.34427) 2505 : cluster [DBG] pgmap v1417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:55.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:55 gibba013 bash[29418]: cephadm 2021-03-10T14:39:54.111934+0000 mgr.gibba020.yqfnwy (mgr.34427) 2506 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:39:55.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:55 gibba013 bash[30381]: cephadm 2021-03-10T14:39:54.111934+0000 mgr.gibba020.yqfnwy (mgr.34427) 2506 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:39:55.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:55 gibba020 bash[25448]: cephadm 2021-03-10T14:39:54.111934+0000 mgr.gibba020.yqfnwy (mgr.34427) 2506 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:39:56.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:56 gibba013 bash[29418]: cluster 2021-03-10T14:39:54.343281+0000 mgr.gibba020.yqfnwy (mgr.34427) 2507 : cluster [DBG] pgmap v1418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:56.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:56 gibba013 bash[30381]: cluster 2021-03-10T14:39:54.343281+0000 mgr.gibba020.yqfnwy (mgr.34427) 2507 : cluster [DBG] pgmap v1418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:56.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:56 gibba020 bash[25448]: cluster 2021-03-10T14:39:54.343281+0000 mgr.gibba020.yqfnwy (mgr.34427) 2507 : cluster [DBG] pgmap v1418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:57.158 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:39:57.386 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:39:57.387 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (46m) 112s ago 51m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:39:57.387 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (51m) 48s ago 51m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:39:57.387 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (46m) 48s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:39:57.387 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (47m) 48s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:39:57.387 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (46m) 112s ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:39:57.388 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (45m) 112s ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:39:57.388 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (45m) 48s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:39:57.388 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (45m) 112s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:39:57.388 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (51m) 112s ago 52m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:39:57.388 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (51m) 48s ago 52m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:39:57.389 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (44m) 112s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:39:57.389 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (44m) 112s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:39:57.389 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (43m) 112s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:39:57.389 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (43m) 112s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:39:57.389 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (43m) 48s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:39:57.390 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (42m) 48s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:39:57.390 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (42m) 48s ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:39:57.390 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (41m) 48s ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:39:57.390 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (51m) 48s ago 52m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:39:57.391 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 48s ago 49m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:39:57.631 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:39:57.631 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:39:57.632 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:39:57.632 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:39:57.632 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:39:57.632 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:39:57.632 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:39:57.633 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:39:57.633 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:39:57.633 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:39:57.633 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:39:57.633 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:39:57.634 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:39:57.634 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:39:57.634 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:39:58.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:58 gibba013 bash[29418]: cluster 2021-03-10T14:39:56.345099+0000 mgr.gibba020.yqfnwy (mgr.34427) 2508 : cluster [DBG] pgmap v1419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:58.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:58 gibba013 bash[29418]: audit 2021-03-10T14:39:57.146548+0000 mgr.gibba020.yqfnwy (mgr.34427) 2509 : audit [DBG] from='client.45744 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:39:58.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:58 gibba013 bash[29418]: audit 2021-03-10T14:39:57.629969+0000 mon.c (mon.1) 50 : audit [DBG] from='client.? 172.21.2.113:0/1380091691' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:58.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:58 gibba013 bash[30381]: cluster 2021-03-10T14:39:56.345099+0000 mgr.gibba020.yqfnwy (mgr.34427) 2508 : cluster [DBG] pgmap v1419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:58.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:58 gibba013 bash[30381]: audit 2021-03-10T14:39:57.146548+0000 mgr.gibba020.yqfnwy (mgr.34427) 2509 : audit [DBG] from='client.45744 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:39:58.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:58 gibba013 bash[30381]: audit 2021-03-10T14:39:57.629969+0000 mon.c (mon.1) 50 : audit [DBG] from='client.? 172.21.2.113:0/1380091691' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:58.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:58 gibba020 bash[25448]: cluster 2021-03-10T14:39:56.345099+0000 mgr.gibba020.yqfnwy (mgr.34427) 2508 : cluster [DBG] pgmap v1419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:39:58.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:58 gibba020 bash[25448]: audit 2021-03-10T14:39:57.146548+0000 mgr.gibba020.yqfnwy (mgr.34427) 2509 : audit [DBG] from='client.45744 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:39:58.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:58 gibba020 bash[25448]: audit 2021-03-10T14:39:57.629969+0000 mon.c (mon.1) 50 : audit [DBG] from='client.? 172.21.2.113:0/1380091691' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:39:59.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:39:59 gibba013 bash[29418]: audit 2021-03-10T14:39:57.371759+0000 mgr.gibba020.yqfnwy (mgr.34427) 2510 : audit [DBG] from='client.45750 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:39:59.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:39:59 gibba013 bash[30381]: audit 2021-03-10T14:39:57.371759+0000 mgr.gibba020.yqfnwy (mgr.34427) 2510 : audit [DBG] from='client.45750 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:39:59.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:39:59 gibba020 bash[25448]: audit 2021-03-10T14:39:57.371759+0000 mgr.gibba020.yqfnwy (mgr.34427) 2510 : audit [DBG] from='client.45750 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:40:00.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:00 gibba013 bash[29418]: debug 2021-03-10T14:39:59.999+0000 7fd718a82700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:40:00.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:00 gibba013 bash[29418]: cluster 2021-03-10T14:39:58.346505+0000 mgr.gibba020.yqfnwy (mgr.34427) 2511 : cluster [DBG] pgmap v1420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:00.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:00 gibba013 bash[29418]: cluster 2021-03-10T14:40:00.000439+0000 mon.a (mon.0) 1302 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:40:00.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:00 gibba013 bash[30381]: cluster 2021-03-10T14:39:58.346505+0000 mgr.gibba020.yqfnwy (mgr.34427) 2511 : cluster [DBG] pgmap v1420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:00.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:00 gibba013 bash[30381]: cluster 2021-03-10T14:40:00.000439+0000 mon.a (mon.0) 1302 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:40:00.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:00 gibba020 bash[25448]: cluster 2021-03-10T14:39:58.346505+0000 mgr.gibba020.yqfnwy (mgr.34427) 2511 : cluster [DBG] pgmap v1420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:00.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:00 gibba020 bash[25448]: cluster 2021-03-10T14:40:00.000439+0000 mon.a (mon.0) 1302 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:40:02.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:02 gibba013 bash[29418]: cluster 2021-03-10T14:40:00.348129+0000 mgr.gibba020.yqfnwy (mgr.34427) 2512 : cluster [DBG] pgmap v1421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:02.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:02 gibba013 bash[30381]: cluster 2021-03-10T14:40:00.348129+0000 mgr.gibba020.yqfnwy (mgr.34427) 2512 : cluster [DBG] pgmap v1421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:02.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:02 gibba020 bash[25448]: cluster 2021-03-10T14:40:00.348129+0000 mgr.gibba020.yqfnwy (mgr.34427) 2512 : cluster [DBG] pgmap v1421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:04.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:04 gibba020 bash[25448]: cluster 2021-03-10T14:40:02.349369+0000 mgr.gibba020.yqfnwy (mgr.34427) 2513 : cluster [DBG] pgmap v1422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:04.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:04 gibba013 bash[29418]: cluster 2021-03-10T14:40:02.349369+0000 mgr.gibba020.yqfnwy (mgr.34427) 2513 : cluster [DBG] pgmap v1422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:04.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:04 gibba013 bash[30381]: cluster 2021-03-10T14:40:02.349369+0000 mgr.gibba020.yqfnwy (mgr.34427) 2513 : cluster [DBG] pgmap v1422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:06.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:06 gibba020 bash[25448]: cluster 2021-03-10T14:40:04.350805+0000 mgr.gibba020.yqfnwy (mgr.34427) 2514 : cluster [DBG] pgmap v1423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:06.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:06 gibba013 bash[29418]: cluster 2021-03-10T14:40:04.350805+0000 mgr.gibba020.yqfnwy (mgr.34427) 2514 : cluster [DBG] pgmap v1423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:06.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:06 gibba013 bash[30381]: cluster 2021-03-10T14:40:04.350805+0000 mgr.gibba020.yqfnwy (mgr.34427) 2514 : cluster [DBG] pgmap v1423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:07 gibba020 bash[25448]: audit 2021-03-10T14:40:06.187050+0000 mon.a (mon.0) 1303 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:40:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:07 gibba020 bash[25448]: audit 2021-03-10T14:40:06.187326+0000 mon.a (mon.0) 1304 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:40:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:07 gibba020 bash[25448]: audit 2021-03-10T14:40:06.187555+0000 mon.a (mon.0) 1305 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:40:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:07 gibba020 bash[25448]: audit 2021-03-10T14:40:06.187792+0000 mon.a (mon.0) 1306 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T14:40:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:07 gibba020 bash[25448]: audit 2021-03-10T14:40:06.229712+0000 mon.a (mon.0) 1307 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:40:07.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:07 gibba020 bash[25448]: audit 2021-03-10T14:40:06.236136+0000 mon.a (mon.0) 1308 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:40:07.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:07 gibba013 bash[29418]: audit 2021-03-10T14:40:06.187050+0000 mon.a (mon.0) 1303 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:40:07.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:07 gibba013 bash[29418]: audit 2021-03-10T14:40:06.187326+0000 mon.a (mon.0) 1304 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:40:07.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:07 gibba013 bash[29418]: audit 2021-03-10T14:40:06.187555+0000 mon.a (mon.0) 1305 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:40:07.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:07 gibba013 bash[29418]: audit 2021-03-10T14:40:06.187792+0000 mon.a (mon.0) 1306 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T14:40:07.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:07 gibba013 bash[29418]: audit 2021-03-10T14:40:06.229712+0000 mon.a (mon.0) 1307 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:40:07.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:07 gibba013 bash[29418]: audit 2021-03-10T14:40:06.236136+0000 mon.a (mon.0) 1308 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:40:07.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:07 gibba013 bash[30381]: audit 2021-03-10T14:40:06.187050+0000 mon.a (mon.0) 1303 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T14:40:07.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:07 gibba013 bash[30381]: audit 2021-03-10T14:40:06.187326+0000 mon.a (mon.0) 1304 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:40:07.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:07 gibba013 bash[30381]: audit 2021-03-10T14:40:06.187555+0000 mon.a (mon.0) 1305 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:40:07.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:07 gibba013 bash[30381]: audit 2021-03-10T14:40:06.187792+0000 mon.a (mon.0) 1306 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T14:40:07.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:07 gibba013 bash[30381]: audit 2021-03-10T14:40:06.229712+0000 mon.a (mon.0) 1307 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:40:07.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:07 gibba013 bash[30381]: audit 2021-03-10T14:40:06.236136+0000 mon.a (mon.0) 1308 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:40:08.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:08 gibba020 bash[25448]: cluster 2021-03-10T14:40:06.352769+0000 mgr.gibba020.yqfnwy (mgr.34427) 2515 : cluster [DBG] pgmap v1424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:08.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:08 gibba013 bash[29418]: cluster 2021-03-10T14:40:06.352769+0000 mgr.gibba020.yqfnwy (mgr.34427) 2515 : cluster [DBG] pgmap v1424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:08.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:08 gibba013 bash[30381]: cluster 2021-03-10T14:40:06.352769+0000 mgr.gibba020.yqfnwy (mgr.34427) 2515 : cluster [DBG] pgmap v1424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:09.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:09 gibba020 bash[25448]: audit 2021-03-10T14:40:09.129487+0000 mon.a (mon.0) 1309 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:40:09.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:09 gibba013 bash[29418]: audit 2021-03-10T14:40:09.129487+0000 mon.a (mon.0) 1309 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:40:09.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:09 gibba013 bash[30381]: audit 2021-03-10T14:40:09.129487+0000 mon.a (mon.0) 1309 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:40:10.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:10 gibba020 bash[25448]: cluster 2021-03-10T14:40:08.354237+0000 mgr.gibba020.yqfnwy (mgr.34427) 2516 : cluster [DBG] pgmap v1425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:10.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:10 gibba020 bash[25448]: cephadm 2021-03-10T14:40:09.134418+0000 mgr.gibba020.yqfnwy (mgr.34427) 2517 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:40:10.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:10 gibba020 bash[25448]: cephadm 2021-03-10T14:40:09.136115+0000 mgr.gibba020.yqfnwy (mgr.34427) 2518 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:40:10.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:10 gibba020 bash[25448]: audit 2021-03-10T14:40:09.342797+0000 mon.a (mon.0) 1310 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:40:10.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:10 gibba020 bash[25448]: audit 2021-03-10T14:40:09.346092+0000 mon.a (mon.0) 1311 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:40:10.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:10 gibba020 bash[25448]: audit 2021-03-10T14:40:09.347583+0000 mon.a (mon.0) 1312 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:10.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:10 gibba020 bash[25448]: audit 2021-03-10T14:40:09.349087+0000 mon.a (mon.0) 1313 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:10.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:10 gibba020 bash[25448]: audit 2021-03-10T14:40:09.350332+0000 mon.a (mon.0) 1314 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:10.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:10 gibba020 bash[25448]: audit 2021-03-10T14:40:09.353118+0000 mon.a (mon.0) 1315 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:10.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:10 gibba020 bash[25448]: audit 2021-03-10T14:40:09.354758+0000 mon.a (mon.0) 1316 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:10.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:10 gibba013 bash[29418]: cluster 2021-03-10T14:40:08.354237+0000 mgr.gibba020.yqfnwy (mgr.34427) 2516 : cluster [DBG] pgmap v1425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:10.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:10 gibba013 bash[29418]: cephadm 2021-03-10T14:40:09.134418+0000 mgr.gibba020.yqfnwy (mgr.34427) 2517 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:40:10.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:10 gibba013 bash[29418]: cephadm 2021-03-10T14:40:09.136115+0000 mgr.gibba020.yqfnwy (mgr.34427) 2518 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:40:10.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:10 gibba013 bash[29418]: audit 2021-03-10T14:40:09.342797+0000 mon.a (mon.0) 1310 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:40:10.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:10 gibba013 bash[29418]: audit 2021-03-10T14:40:09.346092+0000 mon.a (mon.0) 1311 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:40:10.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:10 gibba013 bash[29418]: audit 2021-03-10T14:40:09.347583+0000 mon.a (mon.0) 1312 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:10.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:10 gibba013 bash[29418]: audit 2021-03-10T14:40:09.349087+0000 mon.a (mon.0) 1313 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:10.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:10 gibba013 bash[29418]: audit 2021-03-10T14:40:09.350332+0000 mon.a (mon.0) 1314 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:10.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:10 gibba013 bash[29418]: audit 2021-03-10T14:40:09.353118+0000 mon.a (mon.0) 1315 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:10.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:10 gibba013 bash[29418]: audit 2021-03-10T14:40:09.354758+0000 mon.a (mon.0) 1316 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:10.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:10 gibba013 bash[30381]: cluster 2021-03-10T14:40:08.354237+0000 mgr.gibba020.yqfnwy (mgr.34427) 2516 : cluster [DBG] pgmap v1425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:10.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:10 gibba013 bash[30381]: cephadm 2021-03-10T14:40:09.134418+0000 mgr.gibba020.yqfnwy (mgr.34427) 2517 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:40:10.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:10 gibba013 bash[30381]: cephadm 2021-03-10T14:40:09.136115+0000 mgr.gibba020.yqfnwy (mgr.34427) 2518 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:40:10.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:10 gibba013 bash[30381]: audit 2021-03-10T14:40:09.342797+0000 mon.a (mon.0) 1310 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:40:10.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:10 gibba013 bash[30381]: audit 2021-03-10T14:40:09.346092+0000 mon.a (mon.0) 1311 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:40:10.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:10 gibba013 bash[30381]: audit 2021-03-10T14:40:09.347583+0000 mon.a (mon.0) 1312 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:10.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:10 gibba013 bash[30381]: audit 2021-03-10T14:40:09.349087+0000 mon.a (mon.0) 1313 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:10.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:10 gibba013 bash[30381]: audit 2021-03-10T14:40:09.350332+0000 mon.a (mon.0) 1314 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:10.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:10 gibba013 bash[30381]: audit 2021-03-10T14:40:09.353118+0000 mon.a (mon.0) 1315 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:10.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:10 gibba013 bash[30381]: audit 2021-03-10T14:40:09.354758+0000 mon.a (mon.0) 1316 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:11.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:11 gibba020 bash[25448]: cephadm 2021-03-10T14:40:09.344419+0000 mgr.gibba020.yqfnwy (mgr.34427) 2519 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:40:11.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:11 gibba020 bash[25448]: cephadm 2021-03-10T14:40:09.346403+0000 mgr.gibba020.yqfnwy (mgr.34427) 2520 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:40:11.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:11 gibba020 bash[25448]: cephadm 2021-03-10T14:40:09.347799+0000 mgr.gibba020.yqfnwy (mgr.34427) 2521 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:40:11.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:11 gibba020 bash[25448]: cephadm 2021-03-10T14:40:09.347843+0000 mgr.gibba020.yqfnwy (mgr.34427) 2522 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:40:11.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:11 gibba020 bash[25448]: cephadm 2021-03-10T14:40:09.349110+0000 mgr.gibba020.yqfnwy (mgr.34427) 2523 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:40:11.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:11 gibba020 bash[25448]: cephadm 2021-03-10T14:40:09.349149+0000 mgr.gibba020.yqfnwy (mgr.34427) 2524 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:40:11.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:11 gibba020 bash[25448]: cephadm 2021-03-10T14:40:09.350457+0000 mgr.gibba020.yqfnwy (mgr.34427) 2525 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:40:11.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:11 gibba020 bash[25448]: cephadm 2021-03-10T14:40:09.351748+0000 mgr.gibba020.yqfnwy (mgr.34427) 2526 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:40:11.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:11 gibba020 bash[25448]: cephadm 2021-03-10T14:40:09.351787+0000 mgr.gibba020.yqfnwy (mgr.34427) 2527 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:40:11.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:11 gibba020 bash[25448]: cephadm 2021-03-10T14:40:09.353272+0000 mgr.gibba020.yqfnwy (mgr.34427) 2528 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:40:11.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:11 gibba020 bash[25448]: cephadm 2021-03-10T14:40:09.353588+0000 mgr.gibba020.yqfnwy (mgr.34427) 2529 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:40:11.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:11 gibba020 bash[25448]: cephadm 2021-03-10T14:40:09.355258+0000 mgr.gibba020.yqfnwy (mgr.34427) 2530 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:40:11.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:11 gibba020 bash[25448]: cephadm 2021-03-10T14:40:09.355298+0000 mgr.gibba020.yqfnwy (mgr.34427) 2531 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:40:11.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:11 gibba020 bash[25448]: cephadm 2021-03-10T14:40:09.355470+0000 mgr.gibba020.yqfnwy (mgr.34427) 2532 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:40:11.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:11 gibba013 bash[29418]: cephadm 2021-03-10T14:40:09.344419+0000 mgr.gibba020.yqfnwy (mgr.34427) 2519 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:40:11.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:11 gibba013 bash[29418]: cephadm 2021-03-10T14:40:09.346403+0000 mgr.gibba020.yqfnwy (mgr.34427) 2520 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:40:11.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:11 gibba013 bash[29418]: cephadm 2021-03-10T14:40:09.347799+0000 mgr.gibba020.yqfnwy (mgr.34427) 2521 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:40:11.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:11 gibba013 bash[29418]: cephadm 2021-03-10T14:40:09.347843+0000 mgr.gibba020.yqfnwy (mgr.34427) 2522 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:40:11.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:11 gibba013 bash[29418]: cephadm 2021-03-10T14:40:09.349110+0000 mgr.gibba020.yqfnwy (mgr.34427) 2523 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:40:11.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:11 gibba013 bash[29418]: cephadm 2021-03-10T14:40:09.349149+0000 mgr.gibba020.yqfnwy (mgr.34427) 2524 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:40:11.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:11 gibba013 bash[29418]: cephadm 2021-03-10T14:40:09.350457+0000 mgr.gibba020.yqfnwy (mgr.34427) 2525 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:40:11.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:11 gibba013 bash[29418]: cephadm 2021-03-10T14:40:09.351748+0000 mgr.gibba020.yqfnwy (mgr.34427) 2526 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:40:11.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:11 gibba013 bash[29418]: cephadm 2021-03-10T14:40:09.351787+0000 mgr.gibba020.yqfnwy (mgr.34427) 2527 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:40:11.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:11 gibba013 bash[29418]: cephadm 2021-03-10T14:40:09.353272+0000 mgr.gibba020.yqfnwy (mgr.34427) 2528 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:40:11.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:11 gibba013 bash[29418]: cephadm 2021-03-10T14:40:09.353588+0000 mgr.gibba020.yqfnwy (mgr.34427) 2529 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:40:11.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:11 gibba013 bash[29418]: cephadm 2021-03-10T14:40:09.355258+0000 mgr.gibba020.yqfnwy (mgr.34427) 2530 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:40:11.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:11 gibba013 bash[29418]: cephadm 2021-03-10T14:40:09.355298+0000 mgr.gibba020.yqfnwy (mgr.34427) 2531 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:40:11.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:11 gibba013 bash[29418]: cephadm 2021-03-10T14:40:09.355470+0000 mgr.gibba020.yqfnwy (mgr.34427) 2532 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:40:11.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:11 gibba013 bash[30381]: cephadm 2021-03-10T14:40:09.344419+0000 mgr.gibba020.yqfnwy (mgr.34427) 2519 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:40:11.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:11 gibba013 bash[30381]: cephadm 2021-03-10T14:40:09.346403+0000 mgr.gibba020.yqfnwy (mgr.34427) 2520 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:40:11.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:11 gibba013 bash[30381]: cephadm 2021-03-10T14:40:09.347799+0000 mgr.gibba020.yqfnwy (mgr.34427) 2521 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:40:11.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:11 gibba013 bash[30381]: cephadm 2021-03-10T14:40:09.347843+0000 mgr.gibba020.yqfnwy (mgr.34427) 2522 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:40:11.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:11 gibba013 bash[30381]: cephadm 2021-03-10T14:40:09.349110+0000 mgr.gibba020.yqfnwy (mgr.34427) 2523 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:40:11.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:11 gibba013 bash[30381]: cephadm 2021-03-10T14:40:09.349149+0000 mgr.gibba020.yqfnwy (mgr.34427) 2524 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:40:11.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:11 gibba013 bash[30381]: cephadm 2021-03-10T14:40:09.350457+0000 mgr.gibba020.yqfnwy (mgr.34427) 2525 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:40:11.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:11 gibba013 bash[30381]: cephadm 2021-03-10T14:40:09.351748+0000 mgr.gibba020.yqfnwy (mgr.34427) 2526 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:40:11.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:11 gibba013 bash[30381]: cephadm 2021-03-10T14:40:09.351787+0000 mgr.gibba020.yqfnwy (mgr.34427) 2527 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:40:11.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:11 gibba013 bash[30381]: cephadm 2021-03-10T14:40:09.353272+0000 mgr.gibba020.yqfnwy (mgr.34427) 2528 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:40:11.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:11 gibba013 bash[30381]: cephadm 2021-03-10T14:40:09.353588+0000 mgr.gibba020.yqfnwy (mgr.34427) 2529 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:40:11.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:11 gibba013 bash[30381]: cephadm 2021-03-10T14:40:09.355258+0000 mgr.gibba020.yqfnwy (mgr.34427) 2530 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:40:11.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:11 gibba013 bash[30381]: cephadm 2021-03-10T14:40:09.355298+0000 mgr.gibba020.yqfnwy (mgr.34427) 2531 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:40:11.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:11 gibba013 bash[30381]: cephadm 2021-03-10T14:40:09.355470+0000 mgr.gibba020.yqfnwy (mgr.34427) 2532 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:40:12.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:12 gibba020 bash[25448]: cluster 2021-03-10T14:40:10.355844+0000 mgr.gibba020.yqfnwy (mgr.34427) 2533 : cluster [DBG] pgmap v1426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:12.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:12 gibba013 bash[29418]: cluster 2021-03-10T14:40:10.355844+0000 mgr.gibba020.yqfnwy (mgr.34427) 2533 : cluster [DBG] pgmap v1426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:12.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:12 gibba013 bash[30381]: cluster 2021-03-10T14:40:10.355844+0000 mgr.gibba020.yqfnwy (mgr.34427) 2533 : cluster [DBG] pgmap v1426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:14.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:14 gibba013 bash[29418]: cluster 2021-03-10T14:40:12.357063+0000 mgr.gibba020.yqfnwy (mgr.34427) 2534 : cluster [DBG] pgmap v1427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:14.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:14 gibba013 bash[30381]: cluster 2021-03-10T14:40:12.357063+0000 mgr.gibba020.yqfnwy (mgr.34427) 2534 : cluster [DBG] pgmap v1427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:14.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:14 gibba020 bash[25448]: cluster 2021-03-10T14:40:12.357063+0000 mgr.gibba020.yqfnwy (mgr.34427) 2534 : cluster [DBG] pgmap v1427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:15.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:15 gibba013 bash[29418]: cluster 2021-03-10T14:40:14.358695+0000 mgr.gibba020.yqfnwy (mgr.34427) 2535 : cluster [DBG] pgmap v1428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:15.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:15 gibba013 bash[30381]: cluster 2021-03-10T14:40:14.358695+0000 mgr.gibba020.yqfnwy (mgr.34427) 2535 : cluster [DBG] pgmap v1428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:15.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:15 gibba020 bash[25448]: cluster 2021-03-10T14:40:14.358695+0000 mgr.gibba020.yqfnwy (mgr.34427) 2535 : cluster [DBG] pgmap v1428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:18.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:18 gibba013 bash[29418]: cluster 2021-03-10T14:40:16.360562+0000 mgr.gibba020.yqfnwy (mgr.34427) 2536 : cluster [DBG] pgmap v1429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:18.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:18 gibba013 bash[30381]: cluster 2021-03-10T14:40:16.360562+0000 mgr.gibba020.yqfnwy (mgr.34427) 2536 : cluster [DBG] pgmap v1429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:18.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:18 gibba020 bash[25448]: cluster 2021-03-10T14:40:16.360562+0000 mgr.gibba020.yqfnwy (mgr.34427) 2536 : cluster [DBG] pgmap v1429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:20.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:20 gibba013 bash[29418]: cluster 2021-03-10T14:40:18.362098+0000 mgr.gibba020.yqfnwy (mgr.34427) 2537 : cluster [DBG] pgmap v1430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:20.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:20 gibba013 bash[30381]: cluster 2021-03-10T14:40:18.362098+0000 mgr.gibba020.yqfnwy (mgr.34427) 2537 : cluster [DBG] pgmap v1430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:20.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:20 gibba020 bash[25448]: cluster 2021-03-10T14:40:18.362098+0000 mgr.gibba020.yqfnwy (mgr.34427) 2537 : cluster [DBG] pgmap v1430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:22.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:22 gibba013 bash[29418]: cluster 2021-03-10T14:40:20.363825+0000 mgr.gibba020.yqfnwy (mgr.34427) 2538 : cluster [DBG] pgmap v1431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:22.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:22 gibba013 bash[30381]: cluster 2021-03-10T14:40:20.363825+0000 mgr.gibba020.yqfnwy (mgr.34427) 2538 : cluster [DBG] pgmap v1431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:22.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:22 gibba020 bash[25448]: cluster 2021-03-10T14:40:20.363825+0000 mgr.gibba020.yqfnwy (mgr.34427) 2538 : cluster [DBG] pgmap v1431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:24.375 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:24 gibba020 bash[25448]: cluster 2021-03-10T14:40:22.365038+0000 mgr.gibba020.yqfnwy (mgr.34427) 2539 : cluster [DBG] pgmap v1432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:24.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:24 gibba013 bash[29418]: cluster 2021-03-10T14:40:22.365038+0000 mgr.gibba020.yqfnwy (mgr.34427) 2539 : cluster [DBG] pgmap v1432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:24.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:24 gibba013 bash[30381]: cluster 2021-03-10T14:40:22.365038+0000 mgr.gibba020.yqfnwy (mgr.34427) 2539 : cluster [DBG] pgmap v1432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:26.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:26 gibba013 bash[29418]: cluster 2021-03-10T14:40:24.366747+0000 mgr.gibba020.yqfnwy (mgr.34427) 2540 : cluster [DBG] pgmap v1433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:26.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:26 gibba013 bash[29418]: cephadm 2021-03-10T14:40:24.371477+0000 mgr.gibba020.yqfnwy (mgr.34427) 2541 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:40:26.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:26 gibba013 bash[30381]: cluster 2021-03-10T14:40:24.366747+0000 mgr.gibba020.yqfnwy (mgr.34427) 2540 : cluster [DBG] pgmap v1433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:26.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:26 gibba013 bash[30381]: cephadm 2021-03-10T14:40:24.371477+0000 mgr.gibba020.yqfnwy (mgr.34427) 2541 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:40:26.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:26 gibba020 bash[25448]: cluster 2021-03-10T14:40:24.366747+0000 mgr.gibba020.yqfnwy (mgr.34427) 2540 : cluster [DBG] pgmap v1433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:26.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:26 gibba020 bash[25448]: cephadm 2021-03-10T14:40:24.371477+0000 mgr.gibba020.yqfnwy (mgr.34427) 2541 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:40:27.880 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:40:28.123 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:40:28.123 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (46m) 2m ago 52m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:40:28.123 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (52m) 79s ago 52m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:40:28.124 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (47m) 79s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:40:28.124 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (47m) 79s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:40:28.124 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (46m) 2m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:40:28.124 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (46m) 2m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:40:28.125 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (46m) 79s ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:40:28.125 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (46m) 2m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:40:28.125 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (52m) 2m ago 52m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:40:28.125 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (52m) 79s ago 52m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:40:28.125 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (45m) 2m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:40:28.126 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (44m) 2m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:40:28.126 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (44m) 2m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:40:28.126 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (43m) 2m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:40:28.126 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (43m) 79s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:40:28.127 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (43m) 79s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:40:28.127 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (42m) 79s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:40:28.127 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (42m) 79s ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:40:28.127 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (51m) 79s ago 52m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:40:28.127 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 79s ago 50m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:40:28.370 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:40:28.370 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:40:28.371 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:40:28.371 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:40:28.371 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:40:28.371 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:40:28.372 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:40:28.372 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:40:28.372 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:40:28.372 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:40:28.372 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:40:28.373 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:40:28.373 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:40:28.373 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:40:28.373 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:40:28.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:28 gibba013 bash[29418]: cluster 2021-03-10T14:40:26.368672+0000 mgr.gibba020.yqfnwy (mgr.34427) 2542 : cluster [DBG] pgmap v1434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:28.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:28 gibba013 bash[30381]: cluster 2021-03-10T14:40:26.368672+0000 mgr.gibba020.yqfnwy (mgr.34427) 2542 : cluster [DBG] pgmap v1434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:28.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:28 gibba020 bash[25448]: cluster 2021-03-10T14:40:26.368672+0000 mgr.gibba020.yqfnwy (mgr.34427) 2542 : cluster [DBG] pgmap v1434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:29.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:29 gibba013 bash[29418]: audit 2021-03-10T14:40:27.863600+0000 mgr.gibba020.yqfnwy (mgr.34427) 2543 : audit [DBG] from='client.45762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:40:29.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:29 gibba013 bash[29418]: audit 2021-03-10T14:40:28.086842+0000 mgr.gibba020.yqfnwy (mgr.34427) 2544 : audit [DBG] from='client.45768 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:40:29.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:29 gibba013 bash[29418]: audit 2021-03-10T14:40:28.368542+0000 mon.a (mon.0) 1317 : audit [DBG] from='client.? 172.21.2.113:0/2313151398' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:29.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:29 gibba013 bash[30381]: audit 2021-03-10T14:40:27.863600+0000 mgr.gibba020.yqfnwy (mgr.34427) 2543 : audit [DBG] from='client.45762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:40:29.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:29 gibba013 bash[30381]: audit 2021-03-10T14:40:28.086842+0000 mgr.gibba020.yqfnwy (mgr.34427) 2544 : audit [DBG] from='client.45768 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:40:29.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:29 gibba013 bash[30381]: audit 2021-03-10T14:40:28.368542+0000 mon.a (mon.0) 1317 : audit [DBG] from='client.? 172.21.2.113:0/2313151398' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:29.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:29 gibba020 bash[25448]: audit 2021-03-10T14:40:27.863600+0000 mgr.gibba020.yqfnwy (mgr.34427) 2543 : audit [DBG] from='client.45762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:40:29.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:29 gibba020 bash[25448]: audit 2021-03-10T14:40:28.086842+0000 mgr.gibba020.yqfnwy (mgr.34427) 2544 : audit [DBG] from='client.45768 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:40:29.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:29 gibba020 bash[25448]: audit 2021-03-10T14:40:28.368542+0000 mon.a (mon.0) 1317 : audit [DBG] from='client.? 172.21.2.113:0/2313151398' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:40:30.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:30 gibba020 bash[25448]: cluster 2021-03-10T14:40:28.370188+0000 mgr.gibba020.yqfnwy (mgr.34427) 2545 : cluster [DBG] pgmap v1435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:30.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:30 gibba013 bash[29418]: cluster 2021-03-10T14:40:28.370188+0000 mgr.gibba020.yqfnwy (mgr.34427) 2545 : cluster [DBG] pgmap v1435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:30.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:30 gibba013 bash[30381]: cluster 2021-03-10T14:40:28.370188+0000 mgr.gibba020.yqfnwy (mgr.34427) 2545 : cluster [DBG] pgmap v1435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:32.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:32 gibba020 bash[25448]: cluster 2021-03-10T14:40:30.372219+0000 mgr.gibba020.yqfnwy (mgr.34427) 2546 : cluster [DBG] pgmap v1436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:32.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:32 gibba013 bash[29418]: cluster 2021-03-10T14:40:30.372219+0000 mgr.gibba020.yqfnwy (mgr.34427) 2546 : cluster [DBG] pgmap v1436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:32.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:32 gibba013 bash[30381]: cluster 2021-03-10T14:40:30.372219+0000 mgr.gibba020.yqfnwy (mgr.34427) 2546 : cluster [DBG] pgmap v1436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:34.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:34 gibba020 bash[25448]: cluster 2021-03-10T14:40:32.373496+0000 mgr.gibba020.yqfnwy (mgr.34427) 2547 : cluster [DBG] pgmap v1437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:34.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:34 gibba013 bash[29418]: cluster 2021-03-10T14:40:32.373496+0000 mgr.gibba020.yqfnwy (mgr.34427) 2547 : cluster [DBG] pgmap v1437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:34.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:34 gibba013 bash[30381]: cluster 2021-03-10T14:40:32.373496+0000 mgr.gibba020.yqfnwy (mgr.34427) 2547 : cluster [DBG] pgmap v1437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:36.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:36 gibba020 bash[25448]: cluster 2021-03-10T14:40:34.375215+0000 mgr.gibba020.yqfnwy (mgr.34427) 2548 : cluster [DBG] pgmap v1438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:36.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:36 gibba013 bash[30381]: cluster 2021-03-10T14:40:34.375215+0000 mgr.gibba020.yqfnwy (mgr.34427) 2548 : cluster [DBG] pgmap v1438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:36.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:36 gibba013 bash[29418]: cluster 2021-03-10T14:40:34.375215+0000 mgr.gibba020.yqfnwy (mgr.34427) 2548 : cluster [DBG] pgmap v1438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:38.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:38 gibba020 bash[25448]: cluster 2021-03-10T14:40:36.376853+0000 mgr.gibba020.yqfnwy (mgr.34427) 2549 : cluster [DBG] pgmap v1439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:38.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:38 gibba013 bash[29418]: cluster 2021-03-10T14:40:36.376853+0000 mgr.gibba020.yqfnwy (mgr.34427) 2549 : cluster [DBG] pgmap v1439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:38.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:38 gibba013 bash[30381]: cluster 2021-03-10T14:40:36.376853+0000 mgr.gibba020.yqfnwy (mgr.34427) 2549 : cluster [DBG] pgmap v1439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:40.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:40 gibba020 bash[25448]: cluster 2021-03-10T14:40:38.378502+0000 mgr.gibba020.yqfnwy (mgr.34427) 2550 : cluster [DBG] pgmap v1440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:40.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:40 gibba013 bash[29418]: cluster 2021-03-10T14:40:38.378502+0000 mgr.gibba020.yqfnwy (mgr.34427) 2550 : cluster [DBG] pgmap v1440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:40.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:40 gibba013 bash[30381]: cluster 2021-03-10T14:40:38.378502+0000 mgr.gibba020.yqfnwy (mgr.34427) 2550 : cluster [DBG] pgmap v1440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:41.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:41 gibba020 bash[25448]: cephadm 2021-03-10T14:40:39.387485+0000 mgr.gibba020.yqfnwy (mgr.34427) 2551 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:40:41.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:41 gibba013 bash[29418]: cephadm 2021-03-10T14:40:39.387485+0000 mgr.gibba020.yqfnwy (mgr.34427) 2551 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:40:41.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:41 gibba013 bash[30381]: cephadm 2021-03-10T14:40:39.387485+0000 mgr.gibba020.yqfnwy (mgr.34427) 2551 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:40:42.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:42 gibba020 bash[25448]: cluster 2021-03-10T14:40:40.380161+0000 mgr.gibba020.yqfnwy (mgr.34427) 2552 : cluster [DBG] pgmap v1441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:42.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:42 gibba013 bash[29418]: cluster 2021-03-10T14:40:40.380161+0000 mgr.gibba020.yqfnwy (mgr.34427) 2552 : cluster [DBG] pgmap v1441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:42.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:42 gibba013 bash[30381]: cluster 2021-03-10T14:40:40.380161+0000 mgr.gibba020.yqfnwy (mgr.34427) 2552 : cluster [DBG] pgmap v1441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:44.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:44 gibba020 bash[25448]: cluster 2021-03-10T14:40:42.381574+0000 mgr.gibba020.yqfnwy (mgr.34427) 2553 : cluster [DBG] pgmap v1442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:44.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:44 gibba013 bash[29418]: cluster 2021-03-10T14:40:42.381574+0000 mgr.gibba020.yqfnwy (mgr.34427) 2553 : cluster [DBG] pgmap v1442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:44.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:44 gibba013 bash[30381]: cluster 2021-03-10T14:40:42.381574+0000 mgr.gibba020.yqfnwy (mgr.34427) 2553 : cluster [DBG] pgmap v1442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:46.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:46 gibba013 bash[29418]: cluster 2021-03-10T14:40:44.383123+0000 mgr.gibba020.yqfnwy (mgr.34427) 2554 : cluster [DBG] pgmap v1443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:46.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:46 gibba013 bash[30381]: cluster 2021-03-10T14:40:44.383123+0000 mgr.gibba020.yqfnwy (mgr.34427) 2554 : cluster [DBG] pgmap v1443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:46.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:46 gibba020 bash[25448]: cluster 2021-03-10T14:40:44.383123+0000 mgr.gibba020.yqfnwy (mgr.34427) 2554 : cluster [DBG] pgmap v1443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:48.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:48 gibba013 bash[29418]: cluster 2021-03-10T14:40:46.384773+0000 mgr.gibba020.yqfnwy (mgr.34427) 2555 : cluster [DBG] pgmap v1444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:48.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:48 gibba013 bash[30381]: cluster 2021-03-10T14:40:46.384773+0000 mgr.gibba020.yqfnwy (mgr.34427) 2555 : cluster [DBG] pgmap v1444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:48.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:48 gibba020 bash[25448]: cluster 2021-03-10T14:40:46.384773+0000 mgr.gibba020.yqfnwy (mgr.34427) 2555 : cluster [DBG] pgmap v1444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:49.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:49 gibba013 bash[29418]: cluster 2021-03-10T14:40:48.386173+0000 mgr.gibba020.yqfnwy (mgr.34427) 2556 : cluster [DBG] pgmap v1445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:49.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:49 gibba013 bash[30381]: cluster 2021-03-10T14:40:48.386173+0000 mgr.gibba020.yqfnwy (mgr.34427) 2556 : cluster [DBG] pgmap v1445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:49.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:49 gibba020 bash[25448]: cluster 2021-03-10T14:40:48.386173+0000 mgr.gibba020.yqfnwy (mgr.34427) 2556 : cluster [DBG] pgmap v1445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:52.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:52 gibba013 bash[29418]: cluster 2021-03-10T14:40:50.387776+0000 mgr.gibba020.yqfnwy (mgr.34427) 2557 : cluster [DBG] pgmap v1446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:52.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:52 gibba013 bash[30381]: cluster 2021-03-10T14:40:50.387776+0000 mgr.gibba020.yqfnwy (mgr.34427) 2557 : cluster [DBG] pgmap v1446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:52.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:52 gibba020 bash[25448]: cluster 2021-03-10T14:40:50.387776+0000 mgr.gibba020.yqfnwy (mgr.34427) 2557 : cluster [DBG] pgmap v1446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:54.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:54 gibba013 bash[29418]: cluster 2021-03-10T14:40:52.389288+0000 mgr.gibba020.yqfnwy (mgr.34427) 2558 : cluster [DBG] pgmap v1447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:54.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:54 gibba013 bash[30381]: cluster 2021-03-10T14:40:52.389288+0000 mgr.gibba020.yqfnwy (mgr.34427) 2558 : cluster [DBG] pgmap v1447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:54.391 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:54 gibba020 bash[25448]: cluster 2021-03-10T14:40:52.389288+0000 mgr.gibba020.yqfnwy (mgr.34427) 2558 : cluster [DBG] pgmap v1447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:56.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:56 gibba013 bash[29418]: cephadm 2021-03-10T14:40:54.388995+0000 mgr.gibba020.yqfnwy (mgr.34427) 2559 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:40:56.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:56 gibba013 bash[29418]: cluster 2021-03-10T14:40:54.390785+0000 mgr.gibba020.yqfnwy (mgr.34427) 2560 : cluster [DBG] pgmap v1448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:56.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:56 gibba013 bash[30381]: cephadm 2021-03-10T14:40:54.388995+0000 mgr.gibba020.yqfnwy (mgr.34427) 2559 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:40:56.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:56 gibba013 bash[30381]: cluster 2021-03-10T14:40:54.390785+0000 mgr.gibba020.yqfnwy (mgr.34427) 2560 : cluster [DBG] pgmap v1448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:56.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:56 gibba020 bash[25448]: cephadm 2021-03-10T14:40:54.388995+0000 mgr.gibba020.yqfnwy (mgr.34427) 2559 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:40:56.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:56 gibba020 bash[25448]: cluster 2021-03-10T14:40:54.390785+0000 mgr.gibba020.yqfnwy (mgr.34427) 2560 : cluster [DBG] pgmap v1448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:58.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:40:58 gibba013 bash[29418]: cluster 2021-03-10T14:40:56.392753+0000 mgr.gibba020.yqfnwy (mgr.34427) 2561 : cluster [DBG] pgmap v1449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:58.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:40:58 gibba013 bash[30381]: cluster 2021-03-10T14:40:56.392753+0000 mgr.gibba020.yqfnwy (mgr.34427) 2561 : cluster [DBG] pgmap v1449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:58.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:40:58 gibba020 bash[25448]: cluster 2021-03-10T14:40:56.392753+0000 mgr.gibba020.yqfnwy (mgr.34427) 2561 : cluster [DBG] pgmap v1449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:40:58.614 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:40:58.842 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:40:58.843 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (47m) 2m ago 52m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:40:58.843 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (52m) 110s ago 52m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:40:58.843 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (47m) 110s ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:40:58.844 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (48m) 110s ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:40:58.844 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (47m) 2m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:40:58.844 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (47m) 2m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:40:58.844 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (46m) 110s ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:40:58.845 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (46m) 2m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:40:58.845 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (53m) 2m ago 53m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:40:58.845 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (53m) 110s ago 53m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:40:58.845 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (45m) 2m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:40:58.846 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (45m) 2m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:40:58.846 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (44m) 2m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:40:58.846 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (44m) 2m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:40:58.846 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (44m) 110s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:40:58.847 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (43m) 110s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:40:58.847 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (43m) 110s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:40:58.847 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (42m) 110s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:40:58.847 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (52m) 110s ago 53m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:40:58.847 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 110s ago 50m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:40:59.125 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:40:59.125 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:40:59.126 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:40:59.126 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:40:59.126 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:40:59.126 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:40:59.127 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:40:59.127 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:40:59.127 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:40:59.127 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:40:59.127 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:40:59.128 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:40:59.128 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:40:59.128 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:40:59.128 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:41:00.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:00 gibba013 bash[29418]: cluster 2021-03-10T14:40:58.394074+0000 mgr.gibba020.yqfnwy (mgr.34427) 2562 : cluster [DBG] pgmap v1450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:00.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:00 gibba013 bash[29418]: audit 2021-03-10T14:40:58.603121+0000 mgr.gibba020.yqfnwy (mgr.34427) 2563 : audit [DBG] from='client.45780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:41:00.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:00 gibba013 bash[29418]: audit 2021-03-10T14:40:58.827654+0000 mgr.gibba020.yqfnwy (mgr.34427) 2564 : audit [DBG] from='client.45786 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:41:00.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:00 gibba013 bash[29418]: audit 2021-03-10T14:40:59.123693+0000 mon.a (mon.0) 1318 : audit [DBG] from='client.? 172.21.2.113:0/1348755138' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:00.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:00 gibba013 bash[30381]: cluster 2021-03-10T14:40:58.394074+0000 mgr.gibba020.yqfnwy (mgr.34427) 2562 : cluster [DBG] pgmap v1450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:00.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:00 gibba013 bash[30381]: audit 2021-03-10T14:40:58.603121+0000 mgr.gibba020.yqfnwy (mgr.34427) 2563 : audit [DBG] from='client.45780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:41:00.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:00 gibba013 bash[30381]: audit 2021-03-10T14:40:58.827654+0000 mgr.gibba020.yqfnwy (mgr.34427) 2564 : audit [DBG] from='client.45786 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:41:00.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:00 gibba013 bash[30381]: audit 2021-03-10T14:40:59.123693+0000 mon.a (mon.0) 1318 : audit [DBG] from='client.? 172.21.2.113:0/1348755138' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:00.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:00 gibba020 bash[25448]: cluster 2021-03-10T14:40:58.394074+0000 mgr.gibba020.yqfnwy (mgr.34427) 2562 : cluster [DBG] pgmap v1450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:00.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:00 gibba020 bash[25448]: audit 2021-03-10T14:40:58.603121+0000 mgr.gibba020.yqfnwy (mgr.34427) 2563 : audit [DBG] from='client.45780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:41:00.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:00 gibba020 bash[25448]: audit 2021-03-10T14:40:58.827654+0000 mgr.gibba020.yqfnwy (mgr.34427) 2564 : audit [DBG] from='client.45786 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:41:00.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:00 gibba020 bash[25448]: audit 2021-03-10T14:40:59.123693+0000 mon.a (mon.0) 1318 : audit [DBG] from='client.? 172.21.2.113:0/1348755138' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:02.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:02 gibba013 bash[29418]: cluster 2021-03-10T14:41:00.395718+0000 mgr.gibba020.yqfnwy (mgr.34427) 2565 : cluster [DBG] pgmap v1451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:02.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:02 gibba013 bash[30381]: cluster 2021-03-10T14:41:00.395718+0000 mgr.gibba020.yqfnwy (mgr.34427) 2565 : cluster [DBG] pgmap v1451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:02.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:02 gibba020 bash[25448]: cluster 2021-03-10T14:41:00.395718+0000 mgr.gibba020.yqfnwy (mgr.34427) 2565 : cluster [DBG] pgmap v1451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:04.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:04 gibba020 bash[25448]: cluster 2021-03-10T14:41:02.396995+0000 mgr.gibba020.yqfnwy (mgr.34427) 2566 : cluster [DBG] pgmap v1452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:04.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:04 gibba013 bash[29418]: cluster 2021-03-10T14:41:02.396995+0000 mgr.gibba020.yqfnwy (mgr.34427) 2566 : cluster [DBG] pgmap v1452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:04.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:04 gibba013 bash[30381]: cluster 2021-03-10T14:41:02.396995+0000 mgr.gibba020.yqfnwy (mgr.34427) 2566 : cluster [DBG] pgmap v1452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:06.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:06 gibba020 bash[25448]: cluster 2021-03-10T14:41:04.398497+0000 mgr.gibba020.yqfnwy (mgr.34427) 2567 : cluster [DBG] pgmap v1453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:06.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:06 gibba013 bash[29418]: cluster 2021-03-10T14:41:04.398497+0000 mgr.gibba020.yqfnwy (mgr.34427) 2567 : cluster [DBG] pgmap v1453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:06.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:06 gibba013 bash[30381]: cluster 2021-03-10T14:41:04.398497+0000 mgr.gibba020.yqfnwy (mgr.34427) 2567 : cluster [DBG] pgmap v1453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:07 gibba020 bash[25448]: audit 2021-03-10T14:41:06.195495+0000 mon.a (mon.0) 1319 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T14:41:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:07 gibba020 bash[25448]: audit 2021-03-10T14:41:06.196261+0000 mon.a (mon.0) 1320 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:41:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:07 gibba020 bash[25448]: audit 2021-03-10T14:41:06.196948+0000 mon.a (mon.0) 1321 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:41:07.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:07 gibba020 bash[25448]: audit 2021-03-10T14:41:06.197647+0000 mon.a (mon.0) 1322 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T14:41:07.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:07 gibba020 bash[25448]: audit 2021-03-10T14:41:06.235960+0000 mon.a (mon.0) 1323 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:41:07.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:07 gibba020 bash[25448]: audit 2021-03-10T14:41:06.240411+0000 mon.a (mon.0) 1324 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:41:07.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:07 gibba013 bash[29418]: audit 2021-03-10T14:41:06.195495+0000 mon.a (mon.0) 1319 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T14:41:07.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:07 gibba013 bash[29418]: audit 2021-03-10T14:41:06.196261+0000 mon.a (mon.0) 1320 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:41:07.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:07 gibba013 bash[29418]: audit 2021-03-10T14:41:06.196948+0000 mon.a (mon.0) 1321 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:41:07.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:07 gibba013 bash[29418]: audit 2021-03-10T14:41:06.197647+0000 mon.a (mon.0) 1322 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T14:41:07.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:07 gibba013 bash[29418]: audit 2021-03-10T14:41:06.235960+0000 mon.a (mon.0) 1323 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:41:07.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:07 gibba013 bash[29418]: audit 2021-03-10T14:41:06.240411+0000 mon.a (mon.0) 1324 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:41:07.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:07 gibba013 bash[30381]: audit 2021-03-10T14:41:06.195495+0000 mon.a (mon.0) 1319 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T14:41:07.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:07 gibba013 bash[30381]: audit 2021-03-10T14:41:06.196261+0000 mon.a (mon.0) 1320 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:41:07.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:07 gibba013 bash[30381]: audit 2021-03-10T14:41:06.196948+0000 mon.a (mon.0) 1321 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:41:07.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:07 gibba013 bash[30381]: audit 2021-03-10T14:41:06.197647+0000 mon.a (mon.0) 1322 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T14:41:07.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:07 gibba013 bash[30381]: audit 2021-03-10T14:41:06.235960+0000 mon.a (mon.0) 1323 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:41:07.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:07 gibba013 bash[30381]: audit 2021-03-10T14:41:06.240411+0000 mon.a (mon.0) 1324 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:41:08.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:08 gibba020 bash[25448]: cluster 2021-03-10T14:41:06.400234+0000 mgr.gibba020.yqfnwy (mgr.34427) 2568 : cluster [DBG] pgmap v1454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:08.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:08 gibba013 bash[29418]: cluster 2021-03-10T14:41:06.400234+0000 mgr.gibba020.yqfnwy (mgr.34427) 2568 : cluster [DBG] pgmap v1454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:08.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:08 gibba013 bash[30381]: cluster 2021-03-10T14:41:06.400234+0000 mgr.gibba020.yqfnwy (mgr.34427) 2568 : cluster [DBG] pgmap v1454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:10.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:10 gibba020 bash[25448]: cluster 2021-03-10T14:41:08.401599+0000 mgr.gibba020.yqfnwy (mgr.34427) 2569 : cluster [DBG] pgmap v1455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:10.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:10 gibba020 bash[25448]: audit 2021-03-10T14:41:09.406624+0000 mon.a (mon.0) 1325 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:41:10.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:10 gibba020 bash[25448]: audit 2021-03-10T14:41:09.605738+0000 mon.a (mon.0) 1326 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:41:10.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:10 gibba020 bash[25448]: audit 2021-03-10T14:41:09.609139+0000 mon.a (mon.0) 1327 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:41:10.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:10 gibba020 bash[25448]: audit 2021-03-10T14:41:09.610773+0000 mon.a (mon.0) 1328 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:10.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:10 gibba020 bash[25448]: audit 2021-03-10T14:41:09.611992+0000 mon.a (mon.0) 1329 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:10.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:10 gibba020 bash[25448]: audit 2021-03-10T14:41:09.613171+0000 mon.a (mon.0) 1330 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:10.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:10 gibba020 bash[25448]: audit 2021-03-10T14:41:09.615395+0000 mon.a (mon.0) 1331 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:10.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:10 gibba020 bash[25448]: audit 2021-03-10T14:41:09.616724+0000 mon.a (mon.0) 1332 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:10.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:10 gibba013 bash[29418]: cluster 2021-03-10T14:41:08.401599+0000 mgr.gibba020.yqfnwy (mgr.34427) 2569 : cluster [DBG] pgmap v1455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:10.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:10 gibba013 bash[29418]: audit 2021-03-10T14:41:09.406624+0000 mon.a (mon.0) 1325 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:41:10.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:10 gibba013 bash[29418]: audit 2021-03-10T14:41:09.605738+0000 mon.a (mon.0) 1326 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:41:10.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:10 gibba013 bash[29418]: audit 2021-03-10T14:41:09.609139+0000 mon.a (mon.0) 1327 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:41:10.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:10 gibba013 bash[29418]: audit 2021-03-10T14:41:09.610773+0000 mon.a (mon.0) 1328 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:10.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:10 gibba013 bash[29418]: audit 2021-03-10T14:41:09.611992+0000 mon.a (mon.0) 1329 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:10.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:10 gibba013 bash[29418]: audit 2021-03-10T14:41:09.613171+0000 mon.a (mon.0) 1330 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:10.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:10 gibba013 bash[29418]: audit 2021-03-10T14:41:09.615395+0000 mon.a (mon.0) 1331 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:10.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:10 gibba013 bash[29418]: audit 2021-03-10T14:41:09.616724+0000 mon.a (mon.0) 1332 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:10.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:10 gibba013 bash[30381]: cluster 2021-03-10T14:41:08.401599+0000 mgr.gibba020.yqfnwy (mgr.34427) 2569 : cluster [DBG] pgmap v1455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:10.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:10 gibba013 bash[30381]: audit 2021-03-10T14:41:09.406624+0000 mon.a (mon.0) 1325 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:41:10.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:10 gibba013 bash[30381]: audit 2021-03-10T14:41:09.605738+0000 mon.a (mon.0) 1326 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:41:10.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:10 gibba013 bash[30381]: audit 2021-03-10T14:41:09.609139+0000 mon.a (mon.0) 1327 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:41:10.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:10 gibba013 bash[30381]: audit 2021-03-10T14:41:09.610773+0000 mon.a (mon.0) 1328 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:10.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:10 gibba013 bash[30381]: audit 2021-03-10T14:41:09.611992+0000 mon.a (mon.0) 1329 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:10.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:10 gibba013 bash[30381]: audit 2021-03-10T14:41:09.613171+0000 mon.a (mon.0) 1330 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:10.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:10 gibba013 bash[30381]: audit 2021-03-10T14:41:09.615395+0000 mon.a (mon.0) 1331 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:10.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:10 gibba013 bash[30381]: audit 2021-03-10T14:41:09.616724+0000 mon.a (mon.0) 1332 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:11.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:11 gibba020 bash[25448]: cephadm 2021-03-10T14:41:09.411230+0000 mgr.gibba020.yqfnwy (mgr.34427) 2570 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:41:11.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:11 gibba020 bash[25448]: cephadm 2021-03-10T14:41:09.413100+0000 mgr.gibba020.yqfnwy (mgr.34427) 2571 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:41:11.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:11 gibba020 bash[25448]: cephadm 2021-03-10T14:41:09.607602+0000 mgr.gibba020.yqfnwy (mgr.34427) 2572 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:41:11.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:11 gibba020 bash[25448]: cephadm 2021-03-10T14:41:09.609613+0000 mgr.gibba020.yqfnwy (mgr.34427) 2573 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:41:11.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:11 gibba020 bash[25448]: cephadm 2021-03-10T14:41:09.610888+0000 mgr.gibba020.yqfnwy (mgr.34427) 2574 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:41:11.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:11 gibba020 bash[25448]: cephadm 2021-03-10T14:41:09.610929+0000 mgr.gibba020.yqfnwy (mgr.34427) 2575 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:41:11.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:11 gibba020 bash[25448]: cephadm 2021-03-10T14:41:09.612070+0000 mgr.gibba020.yqfnwy (mgr.34427) 2576 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:41:11.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:11 gibba020 bash[25448]: cephadm 2021-03-10T14:41:09.612156+0000 mgr.gibba020.yqfnwy (mgr.34427) 2577 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:41:11.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:11 gibba020 bash[25448]: cephadm 2021-03-10T14:41:09.613188+0000 mgr.gibba020.yqfnwy (mgr.34427) 2578 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:41:11.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:11 gibba020 bash[25448]: cephadm 2021-03-10T14:41:09.614158+0000 mgr.gibba020.yqfnwy (mgr.34427) 2579 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:41:11.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:11 gibba020 bash[25448]: cephadm 2021-03-10T14:41:09.614241+0000 mgr.gibba020.yqfnwy (mgr.34427) 2580 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:41:11.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:11 gibba020 bash[25448]: cephadm 2021-03-10T14:41:09.615413+0000 mgr.gibba020.yqfnwy (mgr.34427) 2581 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:41:11.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:11 gibba020 bash[25448]: cephadm 2021-03-10T14:41:09.615718+0000 mgr.gibba020.yqfnwy (mgr.34427) 2582 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:41:11.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:11 gibba020 bash[25448]: cephadm 2021-03-10T14:41:09.616854+0000 mgr.gibba020.yqfnwy (mgr.34427) 2583 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:41:11.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:11 gibba020 bash[25448]: cephadm 2021-03-10T14:41:09.616886+0000 mgr.gibba020.yqfnwy (mgr.34427) 2584 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:41:11.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:11 gibba020 bash[25448]: cephadm 2021-03-10T14:41:09.616984+0000 mgr.gibba020.yqfnwy (mgr.34427) 2585 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:41:11.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:11 gibba013 bash[30381]: cephadm 2021-03-10T14:41:09.411230+0000 mgr.gibba020.yqfnwy (mgr.34427) 2570 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:41:11.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:11 gibba013 bash[30381]: cephadm 2021-03-10T14:41:09.413100+0000 mgr.gibba020.yqfnwy (mgr.34427) 2571 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:41:11.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:11 gibba013 bash[30381]: cephadm 2021-03-10T14:41:09.607602+0000 mgr.gibba020.yqfnwy (mgr.34427) 2572 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:41:11.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:11 gibba013 bash[30381]: cephadm 2021-03-10T14:41:09.609613+0000 mgr.gibba020.yqfnwy (mgr.34427) 2573 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:41:11.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:11 gibba013 bash[30381]: cephadm 2021-03-10T14:41:09.610888+0000 mgr.gibba020.yqfnwy (mgr.34427) 2574 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:41:11.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:11 gibba013 bash[30381]: cephadm 2021-03-10T14:41:09.610929+0000 mgr.gibba020.yqfnwy (mgr.34427) 2575 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:41:11.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:11 gibba013 bash[30381]: cephadm 2021-03-10T14:41:09.612070+0000 mgr.gibba020.yqfnwy (mgr.34427) 2576 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:41:11.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:11 gibba013 bash[30381]: cephadm 2021-03-10T14:41:09.612156+0000 mgr.gibba020.yqfnwy (mgr.34427) 2577 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:41:11.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:11 gibba013 bash[30381]: cephadm 2021-03-10T14:41:09.613188+0000 mgr.gibba020.yqfnwy (mgr.34427) 2578 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:41:11.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:11 gibba013 bash[30381]: cephadm 2021-03-10T14:41:09.614158+0000 mgr.gibba020.yqfnwy (mgr.34427) 2579 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:41:11.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:11 gibba013 bash[30381]: cephadm 2021-03-10T14:41:09.614241+0000 mgr.gibba020.yqfnwy (mgr.34427) 2580 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:41:11.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:11 gibba013 bash[30381]: cephadm 2021-03-10T14:41:09.615413+0000 mgr.gibba020.yqfnwy (mgr.34427) 2581 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:41:11.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:11 gibba013 bash[30381]: cephadm 2021-03-10T14:41:09.615718+0000 mgr.gibba020.yqfnwy (mgr.34427) 2582 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:41:11.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:11 gibba013 bash[30381]: cephadm 2021-03-10T14:41:09.616854+0000 mgr.gibba020.yqfnwy (mgr.34427) 2583 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:41:11.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:11 gibba013 bash[30381]: cephadm 2021-03-10T14:41:09.616886+0000 mgr.gibba020.yqfnwy (mgr.34427) 2584 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:41:11.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:11 gibba013 bash[30381]: cephadm 2021-03-10T14:41:09.616984+0000 mgr.gibba020.yqfnwy (mgr.34427) 2585 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:41:11.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:11 gibba013 bash[29418]: cephadm 2021-03-10T14:41:09.411230+0000 mgr.gibba020.yqfnwy (mgr.34427) 2570 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:41:11.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:11 gibba013 bash[29418]: cephadm 2021-03-10T14:41:09.413100+0000 mgr.gibba020.yqfnwy (mgr.34427) 2571 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:41:11.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:11 gibba013 bash[29418]: cephadm 2021-03-10T14:41:09.607602+0000 mgr.gibba020.yqfnwy (mgr.34427) 2572 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:41:11.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:11 gibba013 bash[29418]: cephadm 2021-03-10T14:41:09.609613+0000 mgr.gibba020.yqfnwy (mgr.34427) 2573 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:41:11.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:11 gibba013 bash[29418]: cephadm 2021-03-10T14:41:09.610888+0000 mgr.gibba020.yqfnwy (mgr.34427) 2574 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:41:11.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:11 gibba013 bash[29418]: cephadm 2021-03-10T14:41:09.610929+0000 mgr.gibba020.yqfnwy (mgr.34427) 2575 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:41:11.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:11 gibba013 bash[29418]: cephadm 2021-03-10T14:41:09.612070+0000 mgr.gibba020.yqfnwy (mgr.34427) 2576 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:41:11.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:11 gibba013 bash[29418]: cephadm 2021-03-10T14:41:09.612156+0000 mgr.gibba020.yqfnwy (mgr.34427) 2577 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:41:11.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:11 gibba013 bash[29418]: cephadm 2021-03-10T14:41:09.613188+0000 mgr.gibba020.yqfnwy (mgr.34427) 2578 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:41:11.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:11 gibba013 bash[29418]: cephadm 2021-03-10T14:41:09.614158+0000 mgr.gibba020.yqfnwy (mgr.34427) 2579 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:41:11.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:11 gibba013 bash[29418]: cephadm 2021-03-10T14:41:09.614241+0000 mgr.gibba020.yqfnwy (mgr.34427) 2580 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:41:11.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:11 gibba013 bash[29418]: cephadm 2021-03-10T14:41:09.615413+0000 mgr.gibba020.yqfnwy (mgr.34427) 2581 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:41:11.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:11 gibba013 bash[29418]: cephadm 2021-03-10T14:41:09.615718+0000 mgr.gibba020.yqfnwy (mgr.34427) 2582 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:41:11.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:11 gibba013 bash[29418]: cephadm 2021-03-10T14:41:09.616854+0000 mgr.gibba020.yqfnwy (mgr.34427) 2583 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:41:11.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:11 gibba013 bash[29418]: cephadm 2021-03-10T14:41:09.616886+0000 mgr.gibba020.yqfnwy (mgr.34427) 2584 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:41:11.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:11 gibba013 bash[29418]: cephadm 2021-03-10T14:41:09.616984+0000 mgr.gibba020.yqfnwy (mgr.34427) 2585 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:41:12.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:12 gibba020 bash[25448]: cluster 2021-03-10T14:41:10.403347+0000 mgr.gibba020.yqfnwy (mgr.34427) 2586 : cluster [DBG] pgmap v1456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:12.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:12 gibba013 bash[29418]: cluster 2021-03-10T14:41:10.403347+0000 mgr.gibba020.yqfnwy (mgr.34427) 2586 : cluster [DBG] pgmap v1456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:12.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:12 gibba013 bash[30381]: cluster 2021-03-10T14:41:10.403347+0000 mgr.gibba020.yqfnwy (mgr.34427) 2586 : cluster [DBG] pgmap v1456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:14.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:14 gibba020 bash[25448]: cluster 2021-03-10T14:41:12.404887+0000 mgr.gibba020.yqfnwy (mgr.34427) 2587 : cluster [DBG] pgmap v1457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:14.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:14 gibba013 bash[29418]: cluster 2021-03-10T14:41:12.404887+0000 mgr.gibba020.yqfnwy (mgr.34427) 2587 : cluster [DBG] pgmap v1457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:14.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:14 gibba013 bash[30381]: cluster 2021-03-10T14:41:12.404887+0000 mgr.gibba020.yqfnwy (mgr.34427) 2587 : cluster [DBG] pgmap v1457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:16.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:16 gibba013 bash[29418]: cluster 2021-03-10T14:41:14.406342+0000 mgr.gibba020.yqfnwy (mgr.34427) 2588 : cluster [DBG] pgmap v1458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:16.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:16 gibba013 bash[30381]: cluster 2021-03-10T14:41:14.406342+0000 mgr.gibba020.yqfnwy (mgr.34427) 2588 : cluster [DBG] pgmap v1458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:16.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:16 gibba020 bash[25448]: cluster 2021-03-10T14:41:14.406342+0000 mgr.gibba020.yqfnwy (mgr.34427) 2588 : cluster [DBG] pgmap v1458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:18.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:18 gibba013 bash[29418]: cluster 2021-03-10T14:41:16.408098+0000 mgr.gibba020.yqfnwy (mgr.34427) 2589 : cluster [DBG] pgmap v1459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:18.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:18 gibba013 bash[30381]: cluster 2021-03-10T14:41:16.408098+0000 mgr.gibba020.yqfnwy (mgr.34427) 2589 : cluster [DBG] pgmap v1459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:18.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:18 gibba020 bash[25448]: cluster 2021-03-10T14:41:16.408098+0000 mgr.gibba020.yqfnwy (mgr.34427) 2589 : cluster [DBG] pgmap v1459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:20.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:20 gibba013 bash[29418]: cluster 2021-03-10T14:41:18.409544+0000 mgr.gibba020.yqfnwy (mgr.34427) 2590 : cluster [DBG] pgmap v1460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:20.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:20 gibba013 bash[30381]: cluster 2021-03-10T14:41:18.409544+0000 mgr.gibba020.yqfnwy (mgr.34427) 2590 : cluster [DBG] pgmap v1460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:20.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:20 gibba020 bash[25448]: cluster 2021-03-10T14:41:18.409544+0000 mgr.gibba020.yqfnwy (mgr.34427) 2590 : cluster [DBG] pgmap v1460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:22.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:22 gibba013 bash[29418]: cluster 2021-03-10T14:41:20.411114+0000 mgr.gibba020.yqfnwy (mgr.34427) 2591 : cluster [DBG] pgmap v1461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:22.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:22 gibba013 bash[30381]: cluster 2021-03-10T14:41:20.411114+0000 mgr.gibba020.yqfnwy (mgr.34427) 2591 : cluster [DBG] pgmap v1461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:22.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:22 gibba020 bash[25448]: cluster 2021-03-10T14:41:20.411114+0000 mgr.gibba020.yqfnwy (mgr.34427) 2591 : cluster [DBG] pgmap v1461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:23.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:23 gibba013 bash[29418]: cluster 2021-03-10T14:41:22.412652+0000 mgr.gibba020.yqfnwy (mgr.34427) 2592 : cluster [DBG] pgmap v1462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:23.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:23 gibba013 bash[30381]: cluster 2021-03-10T14:41:22.412652+0000 mgr.gibba020.yqfnwy (mgr.34427) 2592 : cluster [DBG] pgmap v1462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:23.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:23 gibba020 bash[25448]: cluster 2021-03-10T14:41:22.412652+0000 mgr.gibba020.yqfnwy (mgr.34427) 2592 : cluster [DBG] pgmap v1462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:25.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:25 gibba013 bash[29418]: cluster 2021-03-10T14:41:24.414017+0000 mgr.gibba020.yqfnwy (mgr.34427) 2593 : cluster [DBG] pgmap v1463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:25.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:25 gibba013 bash[29418]: cephadm 2021-03-10T14:41:24.632705+0000 mgr.gibba020.yqfnwy (mgr.34427) 2594 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:41:25.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:25 gibba013 bash[30381]: cluster 2021-03-10T14:41:24.414017+0000 mgr.gibba020.yqfnwy (mgr.34427) 2593 : cluster [DBG] pgmap v1463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:25.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:25 gibba013 bash[30381]: cephadm 2021-03-10T14:41:24.632705+0000 mgr.gibba020.yqfnwy (mgr.34427) 2594 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:41:25.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:25 gibba020 bash[25448]: cluster 2021-03-10T14:41:24.414017+0000 mgr.gibba020.yqfnwy (mgr.34427) 2593 : cluster [DBG] pgmap v1463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:25.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:25 gibba020 bash[25448]: cephadm 2021-03-10T14:41:24.632705+0000 mgr.gibba020.yqfnwy (mgr.34427) 2594 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:41:28.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:28 gibba013 bash[29418]: cluster 2021-03-10T14:41:26.415918+0000 mgr.gibba020.yqfnwy (mgr.34427) 2595 : cluster [DBG] pgmap v1464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:28.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:28 gibba013 bash[30381]: cluster 2021-03-10T14:41:26.415918+0000 mgr.gibba020.yqfnwy (mgr.34427) 2595 : cluster [DBG] pgmap v1464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:28.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:28 gibba020 bash[25448]: cluster 2021-03-10T14:41:26.415918+0000 mgr.gibba020.yqfnwy (mgr.34427) 2595 : cluster [DBG] pgmap v1464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:29.369 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:41:29.594 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:41:29.594 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (47m) 3m ago 53m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:41:29.595 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (53m) 2m ago 53m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:41:29.595 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (48m) 2m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:41:29.595 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (48m) 2m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:41:29.595 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (47m) 3m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:41:29.596 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (47m) 3m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:41:29.596 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (47m) 2m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:41:29.596 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (47m) 3m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:41:29.596 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (53m) 3m ago 53m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:41:29.596 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (53m) 2m ago 53m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:41:29.597 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (46m) 3m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:41:29.597 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (45m) 3m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:41:29.597 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (45m) 3m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:41:29.597 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (44m) 3m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:41:29.597 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (44m) 2m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:41:29.598 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (44m) 2m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:41:29.598 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (43m) 2m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:41:29.598 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (43m) 2m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:41:29.598 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (52m) 2m ago 53m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:41:29.598 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 51m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:41:29.842 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:41:29.843 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:41:29.843 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:41:29.843 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:41:29.843 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:41:29.843 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:41:29.844 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:41:29.844 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:41:29.844 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:41:29.844 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:41:29.844 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:41:29.845 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:41:29.845 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:41:29.845 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:41:29.845 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:41:30.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:30 gibba013 bash[29418]: cluster 2021-03-10T14:41:28.417413+0000 mgr.gibba020.yqfnwy (mgr.34427) 2596 : cluster [DBG] pgmap v1465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:30.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:30 gibba013 bash[29418]: audit 2021-03-10T14:41:29.840798+0000 mon.a (mon.0) 1333 : audit [DBG] from='client.? 172.21.2.113:0/777651087' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:30.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:30 gibba013 bash[30381]: cluster 2021-03-10T14:41:28.417413+0000 mgr.gibba020.yqfnwy (mgr.34427) 2596 : cluster [DBG] pgmap v1465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:30.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:30 gibba013 bash[30381]: audit 2021-03-10T14:41:29.840798+0000 mon.a (mon.0) 1333 : audit [DBG] from='client.? 172.21.2.113:0/777651087' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:30.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:30 gibba020 bash[25448]: cluster 2021-03-10T14:41:28.417413+0000 mgr.gibba020.yqfnwy (mgr.34427) 2596 : cluster [DBG] pgmap v1465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:30.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:30 gibba020 bash[25448]: audit 2021-03-10T14:41:29.840798+0000 mon.a (mon.0) 1333 : audit [DBG] from='client.? 172.21.2.113:0/777651087' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:41:31.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:31 gibba013 bash[29418]: audit 2021-03-10T14:41:29.358019+0000 mgr.gibba020.yqfnwy (mgr.34427) 2597 : audit [DBG] from='client.45798 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:41:31.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:31 gibba013 bash[29418]: audit 2021-03-10T14:41:29.579492+0000 mgr.gibba020.yqfnwy (mgr.34427) 2598 : audit [DBG] from='client.45804 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:41:31.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:31 gibba013 bash[30381]: audit 2021-03-10T14:41:29.358019+0000 mgr.gibba020.yqfnwy (mgr.34427) 2597 : audit [DBG] from='client.45798 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:41:31.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:31 gibba013 bash[30381]: audit 2021-03-10T14:41:29.579492+0000 mgr.gibba020.yqfnwy (mgr.34427) 2598 : audit [DBG] from='client.45804 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:41:31.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:31 gibba020 bash[25448]: audit 2021-03-10T14:41:29.358019+0000 mgr.gibba020.yqfnwy (mgr.34427) 2597 : audit [DBG] from='client.45798 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:41:31.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:31 gibba020 bash[25448]: audit 2021-03-10T14:41:29.579492+0000 mgr.gibba020.yqfnwy (mgr.34427) 2598 : audit [DBG] from='client.45804 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:41:32.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:32 gibba013 bash[29418]: cluster 2021-03-10T14:41:30.419109+0000 mgr.gibba020.yqfnwy (mgr.34427) 2599 : cluster [DBG] pgmap v1466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:32.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:32 gibba013 bash[30381]: cluster 2021-03-10T14:41:30.419109+0000 mgr.gibba020.yqfnwy (mgr.34427) 2599 : cluster [DBG] pgmap v1466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:32.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:32 gibba020 bash[25448]: cluster 2021-03-10T14:41:30.419109+0000 mgr.gibba020.yqfnwy (mgr.34427) 2599 : cluster [DBG] pgmap v1466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:34.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:34 gibba020 bash[25448]: cluster 2021-03-10T14:41:32.420684+0000 mgr.gibba020.yqfnwy (mgr.34427) 2600 : cluster [DBG] pgmap v1467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:34.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:34 gibba013 bash[29418]: cluster 2021-03-10T14:41:32.420684+0000 mgr.gibba020.yqfnwy (mgr.34427) 2600 : cluster [DBG] pgmap v1467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:34.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:34 gibba013 bash[30381]: cluster 2021-03-10T14:41:32.420684+0000 mgr.gibba020.yqfnwy (mgr.34427) 2600 : cluster [DBG] pgmap v1467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:36.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:36 gibba020 bash[25448]: cluster 2021-03-10T14:41:34.422161+0000 mgr.gibba020.yqfnwy (mgr.34427) 2601 : cluster [DBG] pgmap v1468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:36.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:36 gibba013 bash[29418]: cluster 2021-03-10T14:41:34.422161+0000 mgr.gibba020.yqfnwy (mgr.34427) 2601 : cluster [DBG] pgmap v1468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:36.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:36 gibba013 bash[30381]: cluster 2021-03-10T14:41:34.422161+0000 mgr.gibba020.yqfnwy (mgr.34427) 2601 : cluster [DBG] pgmap v1468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:38.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:38 gibba020 bash[25448]: cluster 2021-03-10T14:41:36.423756+0000 mgr.gibba020.yqfnwy (mgr.34427) 2602 : cluster [DBG] pgmap v1469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:38.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:38 gibba013 bash[29418]: cluster 2021-03-10T14:41:36.423756+0000 mgr.gibba020.yqfnwy (mgr.34427) 2602 : cluster [DBG] pgmap v1469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:38.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:38 gibba013 bash[30381]: cluster 2021-03-10T14:41:36.423756+0000 mgr.gibba020.yqfnwy (mgr.34427) 2602 : cluster [DBG] pgmap v1469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:40.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:40 gibba020 bash[25448]: cluster 2021-03-10T14:41:38.425385+0000 mgr.gibba020.yqfnwy (mgr.34427) 2603 : cluster [DBG] pgmap v1470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:40.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:40 gibba013 bash[29418]: cluster 2021-03-10T14:41:38.425385+0000 mgr.gibba020.yqfnwy (mgr.34427) 2603 : cluster [DBG] pgmap v1470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:40.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:40 gibba013 bash[30381]: cluster 2021-03-10T14:41:38.425385+0000 mgr.gibba020.yqfnwy (mgr.34427) 2603 : cluster [DBG] pgmap v1470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:41.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:41 gibba020 bash[25448]: cephadm 2021-03-10T14:41:39.648535+0000 mgr.gibba020.yqfnwy (mgr.34427) 2604 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:41:41.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:41 gibba013 bash[29418]: cephadm 2021-03-10T14:41:39.648535+0000 mgr.gibba020.yqfnwy (mgr.34427) 2604 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:41:41.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:41 gibba013 bash[30381]: cephadm 2021-03-10T14:41:39.648535+0000 mgr.gibba020.yqfnwy (mgr.34427) 2604 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:41:42.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:42 gibba020 bash[25448]: cluster 2021-03-10T14:41:40.427039+0000 mgr.gibba020.yqfnwy (mgr.34427) 2605 : cluster [DBG] pgmap v1471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:42.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:42 gibba013 bash[29418]: cluster 2021-03-10T14:41:40.427039+0000 mgr.gibba020.yqfnwy (mgr.34427) 2605 : cluster [DBG] pgmap v1471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:42.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:42 gibba013 bash[30381]: cluster 2021-03-10T14:41:40.427039+0000 mgr.gibba020.yqfnwy (mgr.34427) 2605 : cluster [DBG] pgmap v1471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:44.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:44 gibba020 bash[25448]: cluster 2021-03-10T14:41:42.428518+0000 mgr.gibba020.yqfnwy (mgr.34427) 2606 : cluster [DBG] pgmap v1472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:44.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:44 gibba013 bash[29418]: cluster 2021-03-10T14:41:42.428518+0000 mgr.gibba020.yqfnwy (mgr.34427) 2606 : cluster [DBG] pgmap v1472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:44.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:44 gibba013 bash[30381]: cluster 2021-03-10T14:41:42.428518+0000 mgr.gibba020.yqfnwy (mgr.34427) 2606 : cluster [DBG] pgmap v1472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:46.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:46 gibba020 bash[25448]: cluster 2021-03-10T14:41:44.429886+0000 mgr.gibba020.yqfnwy (mgr.34427) 2607 : cluster [DBG] pgmap v1473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:46.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:46 gibba013 bash[29418]: cluster 2021-03-10T14:41:44.429886+0000 mgr.gibba020.yqfnwy (mgr.34427) 2607 : cluster [DBG] pgmap v1473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:46.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:46 gibba013 bash[30381]: cluster 2021-03-10T14:41:44.429886+0000 mgr.gibba020.yqfnwy (mgr.34427) 2607 : cluster [DBG] pgmap v1473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:48.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:48 gibba020 bash[25448]: cluster 2021-03-10T14:41:46.431642+0000 mgr.gibba020.yqfnwy (mgr.34427) 2608 : cluster [DBG] pgmap v1474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:48.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:48 gibba013 bash[29418]: cluster 2021-03-10T14:41:46.431642+0000 mgr.gibba020.yqfnwy (mgr.34427) 2608 : cluster [DBG] pgmap v1474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:48.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:48 gibba013 bash[30381]: cluster 2021-03-10T14:41:46.431642+0000 mgr.gibba020.yqfnwy (mgr.34427) 2608 : cluster [DBG] pgmap v1474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:50.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:50 gibba013 bash[29418]: cluster 2021-03-10T14:41:48.433046+0000 mgr.gibba020.yqfnwy (mgr.34427) 2609 : cluster [DBG] pgmap v1475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:50.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:50 gibba013 bash[30381]: cluster 2021-03-10T14:41:48.433046+0000 mgr.gibba020.yqfnwy (mgr.34427) 2609 : cluster [DBG] pgmap v1475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:50.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:50 gibba020 bash[25448]: cluster 2021-03-10T14:41:48.433046+0000 mgr.gibba020.yqfnwy (mgr.34427) 2609 : cluster [DBG] pgmap v1475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:52.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:52 gibba013 bash[29418]: cluster 2021-03-10T14:41:50.434704+0000 mgr.gibba020.yqfnwy (mgr.34427) 2610 : cluster [DBG] pgmap v1476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:52.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:52 gibba013 bash[30381]: cluster 2021-03-10T14:41:50.434704+0000 mgr.gibba020.yqfnwy (mgr.34427) 2610 : cluster [DBG] pgmap v1476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:52.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:52 gibba020 bash[25448]: cluster 2021-03-10T14:41:50.434704+0000 mgr.gibba020.yqfnwy (mgr.34427) 2610 : cluster [DBG] pgmap v1476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:54.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:54 gibba013 bash[29418]: cluster 2021-03-10T14:41:52.436239+0000 mgr.gibba020.yqfnwy (mgr.34427) 2611 : cluster [DBG] pgmap v1477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:54.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:54 gibba013 bash[30381]: cluster 2021-03-10T14:41:52.436239+0000 mgr.gibba020.yqfnwy (mgr.34427) 2611 : cluster [DBG] pgmap v1477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:54.656 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:54 gibba020 bash[25448]: cluster 2021-03-10T14:41:52.436239+0000 mgr.gibba020.yqfnwy (mgr.34427) 2611 : cluster [DBG] pgmap v1477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:56.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:56 gibba013 bash[30381]: cluster 2021-03-10T14:41:54.437768+0000 mgr.gibba020.yqfnwy (mgr.34427) 2612 : cluster [DBG] pgmap v1478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:56.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:56 gibba013 bash[30381]: cephadm 2021-03-10T14:41:54.653721+0000 mgr.gibba020.yqfnwy (mgr.34427) 2613 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:41:56.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:56 gibba013 bash[29418]: cluster 2021-03-10T14:41:54.437768+0000 mgr.gibba020.yqfnwy (mgr.34427) 2612 : cluster [DBG] pgmap v1478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:56.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:56 gibba013 bash[29418]: cephadm 2021-03-10T14:41:54.653721+0000 mgr.gibba020.yqfnwy (mgr.34427) 2613 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:41:56.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:56 gibba020 bash[25448]: cluster 2021-03-10T14:41:54.437768+0000 mgr.gibba020.yqfnwy (mgr.34427) 2612 : cluster [DBG] pgmap v1478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:56.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:56 gibba020 bash[25448]: cephadm 2021-03-10T14:41:54.653721+0000 mgr.gibba020.yqfnwy (mgr.34427) 2613 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:41:57.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:57 gibba013 bash[29418]: cluster 2021-03-10T14:41:56.439582+0000 mgr.gibba020.yqfnwy (mgr.34427) 2614 : cluster [DBG] pgmap v1479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:57.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:57 gibba013 bash[30381]: cluster 2021-03-10T14:41:56.439582+0000 mgr.gibba020.yqfnwy (mgr.34427) 2614 : cluster [DBG] pgmap v1479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:57.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:57 gibba020 bash[25448]: cluster 2021-03-10T14:41:56.439582+0000 mgr.gibba020.yqfnwy (mgr.34427) 2614 : cluster [DBG] pgmap v1479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:59.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:41:59 gibba013 bash[29418]: cluster 2021-03-10T14:41:58.441092+0000 mgr.gibba020.yqfnwy (mgr.34427) 2615 : cluster [DBG] pgmap v1480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:59.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:41:59 gibba013 bash[30381]: cluster 2021-03-10T14:41:58.441092+0000 mgr.gibba020.yqfnwy (mgr.34427) 2615 : cluster [DBG] pgmap v1480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:41:59.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:41:59 gibba020 bash[25448]: cluster 2021-03-10T14:41:58.441092+0000 mgr.gibba020.yqfnwy (mgr.34427) 2615 : cluster [DBG] pgmap v1480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:00.084 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:42:00.309 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:42:00.310 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (48m) 3m ago 53m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:42:00.310 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (53m) 2m ago 53m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:42:00.310 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (48m) 2m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:42:00.310 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (49m) 2m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:42:00.311 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (48m) 3m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:42:00.311 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (48m) 3m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:42:00.311 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (47m) 2m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:42:00.311 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (47m) 3m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:42:00.311 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (54m) 3m ago 54m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:42:00.312 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (54m) 2m ago 54m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:42:00.312 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (46m) 3m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:42:00.312 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (46m) 3m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:42:00.312 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (45m) 3m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:42:00.313 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (45m) 3m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:42:00.313 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (45m) 2m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:42:00.313 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (44m) 2m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:42:00.313 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (44m) 2m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:42:00.313 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (43m) 2m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:42:00.314 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (53m) 2m ago 54m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:42:00.314 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 52m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:42:00.561 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:42:00.561 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:42:00.561 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:42:00.561 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:42:00.562 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:42:00.562 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:42:00.562 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:42:00.562 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:42:00.562 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:42:00.563 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:42:00.563 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:42:00.563 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:42:00.563 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:42:00.563 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:42:00.564 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:42:00.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:00 gibba013 bash[29418]: audit 2021-03-10T14:42:00.073525+0000 mgr.gibba020.yqfnwy (mgr.34427) 2616 : audit [DBG] from='client.45816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:42:00.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:00 gibba013 bash[30381]: audit 2021-03-10T14:42:00.073525+0000 mgr.gibba020.yqfnwy (mgr.34427) 2616 : audit [DBG] from='client.45816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:42:00.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:00 gibba020 bash[25448]: audit 2021-03-10T14:42:00.073525+0000 mgr.gibba020.yqfnwy (mgr.34427) 2616 : audit [DBG] from='client.45816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:42:01.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:01 gibba013 bash[29418]: audit 2021-03-10T14:42:00.296517+0000 mgr.gibba020.yqfnwy (mgr.34427) 2617 : audit [DBG] from='client.45822 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:42:01.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:01 gibba013 bash[29418]: cluster 2021-03-10T14:42:00.442661+0000 mgr.gibba020.yqfnwy (mgr.34427) 2618 : cluster [DBG] pgmap v1481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:01.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:01 gibba013 bash[29418]: audit 2021-03-10T14:42:00.559254+0000 mon.a (mon.0) 1334 : audit [DBG] from='client.? 172.21.2.113:0/715591919' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:01.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:01 gibba013 bash[30381]: audit 2021-03-10T14:42:00.296517+0000 mgr.gibba020.yqfnwy (mgr.34427) 2617 : audit [DBG] from='client.45822 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:42:01.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:01 gibba013 bash[30381]: cluster 2021-03-10T14:42:00.442661+0000 mgr.gibba020.yqfnwy (mgr.34427) 2618 : cluster [DBG] pgmap v1481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:01.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:01 gibba013 bash[30381]: audit 2021-03-10T14:42:00.559254+0000 mon.a (mon.0) 1334 : audit [DBG] from='client.? 172.21.2.113:0/715591919' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:01.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:01 gibba020 bash[25448]: audit 2021-03-10T14:42:00.296517+0000 mgr.gibba020.yqfnwy (mgr.34427) 2617 : audit [DBG] from='client.45822 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:42:01.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:01 gibba020 bash[25448]: cluster 2021-03-10T14:42:00.442661+0000 mgr.gibba020.yqfnwy (mgr.34427) 2618 : cluster [DBG] pgmap v1481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:01.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:01 gibba020 bash[25448]: audit 2021-03-10T14:42:00.559254+0000 mon.a (mon.0) 1334 : audit [DBG] from='client.? 172.21.2.113:0/715591919' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:03.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:03 gibba013 bash[29418]: cluster 2021-03-10T14:42:02.444297+0000 mgr.gibba020.yqfnwy (mgr.34427) 2619 : cluster [DBG] pgmap v1482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:03.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:03 gibba013 bash[30381]: cluster 2021-03-10T14:42:02.444297+0000 mgr.gibba020.yqfnwy (mgr.34427) 2619 : cluster [DBG] pgmap v1482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:03.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:03 gibba020 bash[25448]: cluster 2021-03-10T14:42:02.444297+0000 mgr.gibba020.yqfnwy (mgr.34427) 2619 : cluster [DBG] pgmap v1482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:05.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:05 gibba013 bash[30381]: cluster 2021-03-10T14:42:04.445548+0000 mgr.gibba020.yqfnwy (mgr.34427) 2620 : cluster [DBG] pgmap v1483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:05.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:05 gibba013 bash[29418]: cluster 2021-03-10T14:42:04.445548+0000 mgr.gibba020.yqfnwy (mgr.34427) 2620 : cluster [DBG] pgmap v1483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:05.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:05 gibba020 bash[25448]: cluster 2021-03-10T14:42:04.445548+0000 mgr.gibba020.yqfnwy (mgr.34427) 2620 : cluster [DBG] pgmap v1483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:07 gibba020 bash[25448]: audit 2021-03-10T14:42:06.204511+0000 mon.a (mon.0) 1335 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:42:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:07 gibba020 bash[25448]: audit 2021-03-10T14:42:06.205148+0000 mon.a (mon.0) 1336 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:42:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:07 gibba020 bash[25448]: audit 2021-03-10T14:42:06.205726+0000 mon.a (mon.0) 1337 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:42:07.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:07 gibba020 bash[25448]: audit 2021-03-10T14:42:06.206359+0000 mon.a (mon.0) 1338 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:42:07.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:07 gibba020 bash[25448]: audit 2021-03-10T14:42:06.239573+0000 mon.a (mon.0) 1339 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:42:07.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:07 gibba020 bash[25448]: audit 2021-03-10T14:42:06.243201+0000 mon.a (mon.0) 1340 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:42:07.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:07 gibba013 bash[29418]: audit 2021-03-10T14:42:06.204511+0000 mon.a (mon.0) 1335 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:42:07.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:07 gibba013 bash[29418]: audit 2021-03-10T14:42:06.205148+0000 mon.a (mon.0) 1336 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:42:07.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:07 gibba013 bash[29418]: audit 2021-03-10T14:42:06.205726+0000 mon.a (mon.0) 1337 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:42:07.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:07 gibba013 bash[29418]: audit 2021-03-10T14:42:06.206359+0000 mon.a (mon.0) 1338 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:42:07.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:07 gibba013 bash[29418]: audit 2021-03-10T14:42:06.239573+0000 mon.a (mon.0) 1339 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:42:07.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:07 gibba013 bash[29418]: audit 2021-03-10T14:42:06.243201+0000 mon.a (mon.0) 1340 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:42:07.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:07 gibba013 bash[30381]: audit 2021-03-10T14:42:06.204511+0000 mon.a (mon.0) 1335 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:42:07.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:07 gibba013 bash[30381]: audit 2021-03-10T14:42:06.205148+0000 mon.a (mon.0) 1336 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:42:07.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:07 gibba013 bash[30381]: audit 2021-03-10T14:42:06.205726+0000 mon.a (mon.0) 1337 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:42:07.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:07 gibba013 bash[30381]: audit 2021-03-10T14:42:06.206359+0000 mon.a (mon.0) 1338 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:42:07.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:07 gibba013 bash[30381]: audit 2021-03-10T14:42:06.239573+0000 mon.a (mon.0) 1339 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:42:07.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:07 gibba013 bash[30381]: audit 2021-03-10T14:42:06.243201+0000 mon.a (mon.0) 1340 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:42:08.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:08 gibba020 bash[25448]: cluster 2021-03-10T14:42:06.447371+0000 mgr.gibba020.yqfnwy (mgr.34427) 2621 : cluster [DBG] pgmap v1484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:08.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:08 gibba013 bash[29418]: cluster 2021-03-10T14:42:06.447371+0000 mgr.gibba020.yqfnwy (mgr.34427) 2621 : cluster [DBG] pgmap v1484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:08.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:08 gibba013 bash[30381]: cluster 2021-03-10T14:42:06.447371+0000 mgr.gibba020.yqfnwy (mgr.34427) 2621 : cluster [DBG] pgmap v1484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:10.152 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:10 gibba020 bash[25448]: cluster 2021-03-10T14:42:08.448797+0000 mgr.gibba020.yqfnwy (mgr.34427) 2622 : cluster [DBG] pgmap v1485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:10.153 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:10 gibba020 bash[25448]: audit 2021-03-10T14:42:09.671501+0000 mon.a (mon.0) 1341 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:42:10.153 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:10 gibba020 bash[25448]: audit 2021-03-10T14:42:09.885671+0000 mon.a (mon.0) 1342 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:42:10.153 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:10 gibba020 bash[25448]: audit 2021-03-10T14:42:09.888762+0000 mon.a (mon.0) 1343 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:42:10.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:10 gibba020 bash[25448]: audit 2021-03-10T14:42:09.890158+0000 mon.a (mon.0) 1344 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:10.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:10 gibba020 bash[25448]: audit 2021-03-10T14:42:09.891850+0000 mon.a (mon.0) 1345 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:10.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:10 gibba020 bash[25448]: audit 2021-03-10T14:42:09.893396+0000 mon.a (mon.0) 1346 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:10.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:10 gibba020 bash[25448]: audit 2021-03-10T14:42:09.896182+0000 mon.a (mon.0) 1347 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:10.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:10 gibba020 bash[25448]: audit 2021-03-10T14:42:09.898205+0000 mon.a (mon.0) 1348 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:10.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:10 gibba013 bash[30381]: cluster 2021-03-10T14:42:08.448797+0000 mgr.gibba020.yqfnwy (mgr.34427) 2622 : cluster [DBG] pgmap v1485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:10.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:10 gibba013 bash[30381]: audit 2021-03-10T14:42:09.671501+0000 mon.a (mon.0) 1341 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:42:10.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:10 gibba013 bash[30381]: audit 2021-03-10T14:42:09.885671+0000 mon.a (mon.0) 1342 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:42:10.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:10 gibba013 bash[30381]: audit 2021-03-10T14:42:09.888762+0000 mon.a (mon.0) 1343 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:42:10.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:10 gibba013 bash[30381]: audit 2021-03-10T14:42:09.890158+0000 mon.a (mon.0) 1344 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:10.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:10 gibba013 bash[30381]: audit 2021-03-10T14:42:09.891850+0000 mon.a (mon.0) 1345 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:10.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:10 gibba013 bash[30381]: audit 2021-03-10T14:42:09.893396+0000 mon.a (mon.0) 1346 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:10.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:10 gibba013 bash[30381]: audit 2021-03-10T14:42:09.896182+0000 mon.a (mon.0) 1347 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:10.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:10 gibba013 bash[30381]: audit 2021-03-10T14:42:09.898205+0000 mon.a (mon.0) 1348 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:10.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:10 gibba013 bash[29418]: cluster 2021-03-10T14:42:08.448797+0000 mgr.gibba020.yqfnwy (mgr.34427) 2622 : cluster [DBG] pgmap v1485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:10.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:10 gibba013 bash[29418]: audit 2021-03-10T14:42:09.671501+0000 mon.a (mon.0) 1341 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:42:10.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:10 gibba013 bash[29418]: audit 2021-03-10T14:42:09.885671+0000 mon.a (mon.0) 1342 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:42:10.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:10 gibba013 bash[29418]: audit 2021-03-10T14:42:09.888762+0000 mon.a (mon.0) 1343 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:42:10.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:10 gibba013 bash[29418]: audit 2021-03-10T14:42:09.890158+0000 mon.a (mon.0) 1344 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:10.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:10 gibba013 bash[29418]: audit 2021-03-10T14:42:09.891850+0000 mon.a (mon.0) 1345 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:10.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:10 gibba013 bash[29418]: audit 2021-03-10T14:42:09.893396+0000 mon.a (mon.0) 1346 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:10.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:10 gibba013 bash[29418]: audit 2021-03-10T14:42:09.896182+0000 mon.a (mon.0) 1347 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:10.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:10 gibba013 bash[29418]: audit 2021-03-10T14:42:09.898205+0000 mon.a (mon.0) 1348 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:11.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:11 gibba020 bash[25448]: cephadm 2021-03-10T14:42:09.676395+0000 mgr.gibba020.yqfnwy (mgr.34427) 2623 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:42:11.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:11 gibba020 bash[25448]: cephadm 2021-03-10T14:42:09.678078+0000 mgr.gibba020.yqfnwy (mgr.34427) 2624 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:42:11.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:11 gibba020 bash[25448]: cephadm 2021-03-10T14:42:09.887268+0000 mgr.gibba020.yqfnwy (mgr.34427) 2625 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:42:11.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:11 gibba020 bash[25448]: cephadm 2021-03-10T14:42:09.889018+0000 mgr.gibba020.yqfnwy (mgr.34427) 2626 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:42:11.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:11 gibba020 bash[25448]: cephadm 2021-03-10T14:42:09.890468+0000 mgr.gibba020.yqfnwy (mgr.34427) 2627 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:42:11.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:11 gibba020 bash[25448]: cephadm 2021-03-10T14:42:09.890506+0000 mgr.gibba020.yqfnwy (mgr.34427) 2628 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:42:11.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:11 gibba020 bash[25448]: cephadm 2021-03-10T14:42:09.892126+0000 mgr.gibba020.yqfnwy (mgr.34427) 2629 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:42:11.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:11 gibba020 bash[25448]: cephadm 2021-03-10T14:42:09.892163+0000 mgr.gibba020.yqfnwy (mgr.34427) 2630 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:42:11.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:11 gibba020 bash[25448]: cephadm 2021-03-10T14:42:09.893516+0000 mgr.gibba020.yqfnwy (mgr.34427) 2631 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:42:11.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:11 gibba020 bash[25448]: cephadm 2021-03-10T14:42:09.894778+0000 mgr.gibba020.yqfnwy (mgr.34427) 2632 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:42:11.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:11 gibba020 bash[25448]: cephadm 2021-03-10T14:42:09.894811+0000 mgr.gibba020.yqfnwy (mgr.34427) 2633 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:42:11.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:11 gibba020 bash[25448]: cephadm 2021-03-10T14:42:09.896570+0000 mgr.gibba020.yqfnwy (mgr.34427) 2634 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:42:11.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:11 gibba020 bash[25448]: cephadm 2021-03-10T14:42:09.896920+0000 mgr.gibba020.yqfnwy (mgr.34427) 2635 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:42:11.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:11 gibba020 bash[25448]: cephadm 2021-03-10T14:42:09.898562+0000 mgr.gibba020.yqfnwy (mgr.34427) 2636 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:42:11.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:11 gibba020 bash[25448]: cephadm 2021-03-10T14:42:09.898627+0000 mgr.gibba020.yqfnwy (mgr.34427) 2637 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:42:11.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:11 gibba020 bash[25448]: cephadm 2021-03-10T14:42:09.898731+0000 mgr.gibba020.yqfnwy (mgr.34427) 2638 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:42:11.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:11 gibba013 bash[29418]: cephadm 2021-03-10T14:42:09.676395+0000 mgr.gibba020.yqfnwy (mgr.34427) 2623 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:42:11.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:11 gibba013 bash[29418]: cephadm 2021-03-10T14:42:09.678078+0000 mgr.gibba020.yqfnwy (mgr.34427) 2624 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:42:11.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:11 gibba013 bash[29418]: cephadm 2021-03-10T14:42:09.887268+0000 mgr.gibba020.yqfnwy (mgr.34427) 2625 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:42:11.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:11 gibba013 bash[29418]: cephadm 2021-03-10T14:42:09.889018+0000 mgr.gibba020.yqfnwy (mgr.34427) 2626 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:42:11.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:11 gibba013 bash[29418]: cephadm 2021-03-10T14:42:09.890468+0000 mgr.gibba020.yqfnwy (mgr.34427) 2627 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:42:11.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:11 gibba013 bash[29418]: cephadm 2021-03-10T14:42:09.890506+0000 mgr.gibba020.yqfnwy (mgr.34427) 2628 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:42:11.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:11 gibba013 bash[29418]: cephadm 2021-03-10T14:42:09.892126+0000 mgr.gibba020.yqfnwy (mgr.34427) 2629 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:42:11.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:11 gibba013 bash[29418]: cephadm 2021-03-10T14:42:09.892163+0000 mgr.gibba020.yqfnwy (mgr.34427) 2630 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:42:11.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:11 gibba013 bash[29418]: cephadm 2021-03-10T14:42:09.893516+0000 mgr.gibba020.yqfnwy (mgr.34427) 2631 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:42:11.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:11 gibba013 bash[29418]: cephadm 2021-03-10T14:42:09.894778+0000 mgr.gibba020.yqfnwy (mgr.34427) 2632 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:42:11.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:11 gibba013 bash[29418]: cephadm 2021-03-10T14:42:09.894811+0000 mgr.gibba020.yqfnwy (mgr.34427) 2633 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:42:11.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:11 gibba013 bash[29418]: cephadm 2021-03-10T14:42:09.896570+0000 mgr.gibba020.yqfnwy (mgr.34427) 2634 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:42:11.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:11 gibba013 bash[29418]: cephadm 2021-03-10T14:42:09.896920+0000 mgr.gibba020.yqfnwy (mgr.34427) 2635 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:42:11.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:11 gibba013 bash[29418]: cephadm 2021-03-10T14:42:09.898562+0000 mgr.gibba020.yqfnwy (mgr.34427) 2636 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:42:11.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:11 gibba013 bash[29418]: cephadm 2021-03-10T14:42:09.898627+0000 mgr.gibba020.yqfnwy (mgr.34427) 2637 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:42:11.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:11 gibba013 bash[29418]: cephadm 2021-03-10T14:42:09.898731+0000 mgr.gibba020.yqfnwy (mgr.34427) 2638 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:42:11.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:11 gibba013 bash[30381]: cephadm 2021-03-10T14:42:09.676395+0000 mgr.gibba020.yqfnwy (mgr.34427) 2623 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:42:11.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:11 gibba013 bash[30381]: cephadm 2021-03-10T14:42:09.678078+0000 mgr.gibba020.yqfnwy (mgr.34427) 2624 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:42:11.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:11 gibba013 bash[30381]: cephadm 2021-03-10T14:42:09.887268+0000 mgr.gibba020.yqfnwy (mgr.34427) 2625 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:42:11.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:11 gibba013 bash[30381]: cephadm 2021-03-10T14:42:09.889018+0000 mgr.gibba020.yqfnwy (mgr.34427) 2626 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:42:11.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:11 gibba013 bash[30381]: cephadm 2021-03-10T14:42:09.890468+0000 mgr.gibba020.yqfnwy (mgr.34427) 2627 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:42:11.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:11 gibba013 bash[30381]: cephadm 2021-03-10T14:42:09.890506+0000 mgr.gibba020.yqfnwy (mgr.34427) 2628 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:42:11.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:11 gibba013 bash[30381]: cephadm 2021-03-10T14:42:09.892126+0000 mgr.gibba020.yqfnwy (mgr.34427) 2629 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:42:11.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:11 gibba013 bash[30381]: cephadm 2021-03-10T14:42:09.892163+0000 mgr.gibba020.yqfnwy (mgr.34427) 2630 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:42:11.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:11 gibba013 bash[30381]: cephadm 2021-03-10T14:42:09.893516+0000 mgr.gibba020.yqfnwy (mgr.34427) 2631 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:42:11.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:11 gibba013 bash[30381]: cephadm 2021-03-10T14:42:09.894778+0000 mgr.gibba020.yqfnwy (mgr.34427) 2632 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:42:11.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:11 gibba013 bash[30381]: cephadm 2021-03-10T14:42:09.894811+0000 mgr.gibba020.yqfnwy (mgr.34427) 2633 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:42:11.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:11 gibba013 bash[30381]: cephadm 2021-03-10T14:42:09.896570+0000 mgr.gibba020.yqfnwy (mgr.34427) 2634 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:42:11.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:11 gibba013 bash[30381]: cephadm 2021-03-10T14:42:09.896920+0000 mgr.gibba020.yqfnwy (mgr.34427) 2635 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:42:11.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:11 gibba013 bash[30381]: cephadm 2021-03-10T14:42:09.898562+0000 mgr.gibba020.yqfnwy (mgr.34427) 2636 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:42:11.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:11 gibba013 bash[30381]: cephadm 2021-03-10T14:42:09.898627+0000 mgr.gibba020.yqfnwy (mgr.34427) 2637 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:42:11.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:11 gibba013 bash[30381]: cephadm 2021-03-10T14:42:09.898731+0000 mgr.gibba020.yqfnwy (mgr.34427) 2638 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:42:12.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:12 gibba020 bash[25448]: cluster 2021-03-10T14:42:10.450230+0000 mgr.gibba020.yqfnwy (mgr.34427) 2639 : cluster [DBG] pgmap v1486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:12.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:12 gibba013 bash[29418]: cluster 2021-03-10T14:42:10.450230+0000 mgr.gibba020.yqfnwy (mgr.34427) 2639 : cluster [DBG] pgmap v1486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:12.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:12 gibba013 bash[30381]: cluster 2021-03-10T14:42:10.450230+0000 mgr.gibba020.yqfnwy (mgr.34427) 2639 : cluster [DBG] pgmap v1486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:14.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:14 gibba020 bash[25448]: cluster 2021-03-10T14:42:12.451555+0000 mgr.gibba020.yqfnwy (mgr.34427) 2640 : cluster [DBG] pgmap v1487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:14.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:14 gibba013 bash[29418]: cluster 2021-03-10T14:42:12.451555+0000 mgr.gibba020.yqfnwy (mgr.34427) 2640 : cluster [DBG] pgmap v1487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:14.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:14 gibba013 bash[30381]: cluster 2021-03-10T14:42:12.451555+0000 mgr.gibba020.yqfnwy (mgr.34427) 2640 : cluster [DBG] pgmap v1487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:16.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:16 gibba020 bash[25448]: cluster 2021-03-10T14:42:14.452987+0000 mgr.gibba020.yqfnwy (mgr.34427) 2641 : cluster [DBG] pgmap v1488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:16.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:16 gibba013 bash[29418]: cluster 2021-03-10T14:42:14.452987+0000 mgr.gibba020.yqfnwy (mgr.34427) 2641 : cluster [DBG] pgmap v1488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:16.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:16 gibba013 bash[30381]: cluster 2021-03-10T14:42:14.452987+0000 mgr.gibba020.yqfnwy (mgr.34427) 2641 : cluster [DBG] pgmap v1488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:18.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:18 gibba020 bash[25448]: cluster 2021-03-10T14:42:16.454704+0000 mgr.gibba020.yqfnwy (mgr.34427) 2642 : cluster [DBG] pgmap v1489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:18.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:18 gibba013 bash[29418]: cluster 2021-03-10T14:42:16.454704+0000 mgr.gibba020.yqfnwy (mgr.34427) 2642 : cluster [DBG] pgmap v1489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:18.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:18 gibba013 bash[30381]: cluster 2021-03-10T14:42:16.454704+0000 mgr.gibba020.yqfnwy (mgr.34427) 2642 : cluster [DBG] pgmap v1489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:20.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:20 gibba020 bash[25448]: cluster 2021-03-10T14:42:18.456279+0000 mgr.gibba020.yqfnwy (mgr.34427) 2643 : cluster [DBG] pgmap v1490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:20.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:20 gibba013 bash[29418]: cluster 2021-03-10T14:42:18.456279+0000 mgr.gibba020.yqfnwy (mgr.34427) 2643 : cluster [DBG] pgmap v1490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:20.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:20 gibba013 bash[30381]: cluster 2021-03-10T14:42:18.456279+0000 mgr.gibba020.yqfnwy (mgr.34427) 2643 : cluster [DBG] pgmap v1490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:22.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:22 gibba013 bash[29418]: cluster 2021-03-10T14:42:20.457712+0000 mgr.gibba020.yqfnwy (mgr.34427) 2644 : cluster [DBG] pgmap v1491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:22.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:22 gibba013 bash[30381]: cluster 2021-03-10T14:42:20.457712+0000 mgr.gibba020.yqfnwy (mgr.34427) 2644 : cluster [DBG] pgmap v1491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:22.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:22 gibba020 bash[25448]: cluster 2021-03-10T14:42:20.457712+0000 mgr.gibba020.yqfnwy (mgr.34427) 2644 : cluster [DBG] pgmap v1491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:24.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:24 gibba013 bash[29418]: cluster 2021-03-10T14:42:22.459218+0000 mgr.gibba020.yqfnwy (mgr.34427) 2645 : cluster [DBG] pgmap v1492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:24.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:24 gibba013 bash[30381]: cluster 2021-03-10T14:42:22.459218+0000 mgr.gibba020.yqfnwy (mgr.34427) 2645 : cluster [DBG] pgmap v1492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:24.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:24 gibba020 bash[25448]: cluster 2021-03-10T14:42:22.459218+0000 mgr.gibba020.yqfnwy (mgr.34427) 2645 : cluster [DBG] pgmap v1492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:26.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:26 gibba013 bash[29418]: cluster 2021-03-10T14:42:24.460610+0000 mgr.gibba020.yqfnwy (mgr.34427) 2646 : cluster [DBG] pgmap v1493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:26.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:26 gibba013 bash[29418]: cephadm 2021-03-10T14:42:24.914741+0000 mgr.gibba020.yqfnwy (mgr.34427) 2647 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:42:26.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:26 gibba013 bash[30381]: cluster 2021-03-10T14:42:24.460610+0000 mgr.gibba020.yqfnwy (mgr.34427) 2646 : cluster [DBG] pgmap v1493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:26.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:26 gibba013 bash[30381]: cephadm 2021-03-10T14:42:24.914741+0000 mgr.gibba020.yqfnwy (mgr.34427) 2647 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:42:26.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:26 gibba020 bash[25448]: cluster 2021-03-10T14:42:24.460610+0000 mgr.gibba020.yqfnwy (mgr.34427) 2646 : cluster [DBG] pgmap v1493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:26.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:26 gibba020 bash[25448]: cephadm 2021-03-10T14:42:24.914741+0000 mgr.gibba020.yqfnwy (mgr.34427) 2647 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:42:28.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:28 gibba013 bash[29418]: cluster 2021-03-10T14:42:26.462515+0000 mgr.gibba020.yqfnwy (mgr.34427) 2648 : cluster [DBG] pgmap v1494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:28.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:28 gibba013 bash[30381]: cluster 2021-03-10T14:42:26.462515+0000 mgr.gibba020.yqfnwy (mgr.34427) 2648 : cluster [DBG] pgmap v1494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:28.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:28 gibba020 bash[25448]: cluster 2021-03-10T14:42:26.462515+0000 mgr.gibba020.yqfnwy (mgr.34427) 2648 : cluster [DBG] pgmap v1494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:30.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:30 gibba013 bash[29418]: cluster 2021-03-10T14:42:28.463924+0000 mgr.gibba020.yqfnwy (mgr.34427) 2649 : cluster [DBG] pgmap v1495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:30.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:30 gibba013 bash[30381]: cluster 2021-03-10T14:42:28.463924+0000 mgr.gibba020.yqfnwy (mgr.34427) 2649 : cluster [DBG] pgmap v1495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:30.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:30 gibba020 bash[25448]: cluster 2021-03-10T14:42:28.463924+0000 mgr.gibba020.yqfnwy (mgr.34427) 2649 : cluster [DBG] pgmap v1495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:30.803 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:42:31.030 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:42:31.030 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (48m) 4m ago 54m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:42:31.031 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (54m) 3m ago 54m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:42:31.031 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (49m) 3m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:42:31.031 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (49m) 3m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:42:31.031 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (48m) 4m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:42:31.031 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (48m) 4m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:42:31.032 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (48m) 3m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:42:31.032 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (48m) 4m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:42:31.032 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (54m) 4m ago 54m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:42:31.032 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (54m) 3m ago 54m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:42:31.032 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (47m) 4m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:42:31.033 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (46m) 4m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:42:31.033 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (46m) 4m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:42:31.033 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (46m) 4m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:42:31.033 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (45m) 3m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:42:31.033 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (45m) 3m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:42:31.034 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (44m) 3m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:42:31.034 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (44m) 3m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:42:31.034 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (53m) 3m ago 54m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:42:31.034 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 3m ago 52m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:42:31.282 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:42:31.283 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:42:31.283 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:42:31.283 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:42:31.283 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:42:31.283 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:42:31.284 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:42:31.284 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:42:31.284 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:42:31.284 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:42:31.284 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:42:31.285 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:42:31.285 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:42:31.285 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:42:31.285 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:42:32.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:32 gibba013 bash[30381]: cluster 2021-03-10T14:42:30.465711+0000 mgr.gibba020.yqfnwy (mgr.34427) 2650 : cluster [DBG] pgmap v1496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:32.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:32 gibba013 bash[30381]: audit 2021-03-10T14:42:30.791480+0000 mgr.gibba020.yqfnwy (mgr.34427) 2651 : audit [DBG] from='client.45834 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:42:32.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:32 gibba013 bash[30381]: audit 2021-03-10T14:42:31.015694+0000 mgr.gibba020.yqfnwy (mgr.34427) 2652 : audit [DBG] from='client.55825 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:42:32.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:32 gibba013 bash[30381]: audit 2021-03-10T14:42:31.280778+0000 mon.a (mon.0) 1349 : audit [DBG] from='client.? 172.21.2.113:0/1733658648' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:32.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:32 gibba013 bash[29418]: cluster 2021-03-10T14:42:30.465711+0000 mgr.gibba020.yqfnwy (mgr.34427) 2650 : cluster [DBG] pgmap v1496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:32.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:32 gibba013 bash[29418]: audit 2021-03-10T14:42:30.791480+0000 mgr.gibba020.yqfnwy (mgr.34427) 2651 : audit [DBG] from='client.45834 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:42:32.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:32 gibba013 bash[29418]: audit 2021-03-10T14:42:31.015694+0000 mgr.gibba020.yqfnwy (mgr.34427) 2652 : audit [DBG] from='client.55825 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:42:32.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:32 gibba013 bash[29418]: audit 2021-03-10T14:42:31.280778+0000 mon.a (mon.0) 1349 : audit [DBG] from='client.? 172.21.2.113:0/1733658648' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:32.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:32 gibba020 bash[25448]: cluster 2021-03-10T14:42:30.465711+0000 mgr.gibba020.yqfnwy (mgr.34427) 2650 : cluster [DBG] pgmap v1496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:32.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:32 gibba020 bash[25448]: audit 2021-03-10T14:42:30.791480+0000 mgr.gibba020.yqfnwy (mgr.34427) 2651 : audit [DBG] from='client.45834 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:42:32.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:32 gibba020 bash[25448]: audit 2021-03-10T14:42:31.015694+0000 mgr.gibba020.yqfnwy (mgr.34427) 2652 : audit [DBG] from='client.55825 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:42:32.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:32 gibba020 bash[25448]: audit 2021-03-10T14:42:31.280778+0000 mon.a (mon.0) 1349 : audit [DBG] from='client.? 172.21.2.113:0/1733658648' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:42:34.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:34 gibba013 bash[29418]: cluster 2021-03-10T14:42:32.467144+0000 mgr.gibba020.yqfnwy (mgr.34427) 2653 : cluster [DBG] pgmap v1497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:34.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:34 gibba013 bash[30381]: cluster 2021-03-10T14:42:32.467144+0000 mgr.gibba020.yqfnwy (mgr.34427) 2653 : cluster [DBG] pgmap v1497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:34.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:34 gibba020 bash[25448]: cluster 2021-03-10T14:42:32.467144+0000 mgr.gibba020.yqfnwy (mgr.34427) 2653 : cluster [DBG] pgmap v1497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:35.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:35 gibba013 bash[29418]: cluster 2021-03-10T14:42:34.468518+0000 mgr.gibba020.yqfnwy (mgr.34427) 2654 : cluster [DBG] pgmap v1498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:35.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:35 gibba013 bash[30381]: cluster 2021-03-10T14:42:34.468518+0000 mgr.gibba020.yqfnwy (mgr.34427) 2654 : cluster [DBG] pgmap v1498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:35.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:35 gibba020 bash[25448]: cluster 2021-03-10T14:42:34.468518+0000 mgr.gibba020.yqfnwy (mgr.34427) 2654 : cluster [DBG] pgmap v1498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:38.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:38 gibba020 bash[25448]: cluster 2021-03-10T14:42:36.470192+0000 mgr.gibba020.yqfnwy (mgr.34427) 2655 : cluster [DBG] pgmap v1499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:38.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:38 gibba013 bash[29418]: cluster 2021-03-10T14:42:36.470192+0000 mgr.gibba020.yqfnwy (mgr.34427) 2655 : cluster [DBG] pgmap v1499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:38.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:38 gibba013 bash[30381]: cluster 2021-03-10T14:42:36.470192+0000 mgr.gibba020.yqfnwy (mgr.34427) 2655 : cluster [DBG] pgmap v1499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:40.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:40 gibba020 bash[25448]: cluster 2021-03-10T14:42:38.471538+0000 mgr.gibba020.yqfnwy (mgr.34427) 2656 : cluster [DBG] pgmap v1500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:40.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:40 gibba013 bash[29418]: cluster 2021-03-10T14:42:38.471538+0000 mgr.gibba020.yqfnwy (mgr.34427) 2656 : cluster [DBG] pgmap v1500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:40.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:40 gibba013 bash[30381]: cluster 2021-03-10T14:42:38.471538+0000 mgr.gibba020.yqfnwy (mgr.34427) 2656 : cluster [DBG] pgmap v1500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:41.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:41 gibba020 bash[25448]: cephadm 2021-03-10T14:42:39.930827+0000 mgr.gibba020.yqfnwy (mgr.34427) 2657 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:42:41.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:41 gibba013 bash[29418]: cephadm 2021-03-10T14:42:39.930827+0000 mgr.gibba020.yqfnwy (mgr.34427) 2657 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:42:41.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:41 gibba013 bash[30381]: cephadm 2021-03-10T14:42:39.930827+0000 mgr.gibba020.yqfnwy (mgr.34427) 2657 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:42:42.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:42 gibba020 bash[25448]: cluster 2021-03-10T14:42:40.473135+0000 mgr.gibba020.yqfnwy (mgr.34427) 2658 : cluster [DBG] pgmap v1501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:42.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:42 gibba013 bash[29418]: cluster 2021-03-10T14:42:40.473135+0000 mgr.gibba020.yqfnwy (mgr.34427) 2658 : cluster [DBG] pgmap v1501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:42.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:42 gibba013 bash[30381]: cluster 2021-03-10T14:42:40.473135+0000 mgr.gibba020.yqfnwy (mgr.34427) 2658 : cluster [DBG] pgmap v1501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:44.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:44 gibba020 bash[25448]: cluster 2021-03-10T14:42:42.474523+0000 mgr.gibba020.yqfnwy (mgr.34427) 2659 : cluster [DBG] pgmap v1502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:44.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:44 gibba013 bash[29418]: cluster 2021-03-10T14:42:42.474523+0000 mgr.gibba020.yqfnwy (mgr.34427) 2659 : cluster [DBG] pgmap v1502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:44.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:44 gibba013 bash[30381]: cluster 2021-03-10T14:42:42.474523+0000 mgr.gibba020.yqfnwy (mgr.34427) 2659 : cluster [DBG] pgmap v1502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:46.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:46 gibba020 bash[25448]: cluster 2021-03-10T14:42:44.475853+0000 mgr.gibba020.yqfnwy (mgr.34427) 2660 : cluster [DBG] pgmap v1503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:46.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:46 gibba013 bash[29418]: cluster 2021-03-10T14:42:44.475853+0000 mgr.gibba020.yqfnwy (mgr.34427) 2660 : cluster [DBG] pgmap v1503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:46.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:46 gibba013 bash[30381]: cluster 2021-03-10T14:42:44.475853+0000 mgr.gibba020.yqfnwy (mgr.34427) 2660 : cluster [DBG] pgmap v1503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:48.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:48 gibba013 bash[29418]: cluster 2021-03-10T14:42:46.477455+0000 mgr.gibba020.yqfnwy (mgr.34427) 2661 : cluster [DBG] pgmap v1504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:48.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:48 gibba013 bash[30381]: cluster 2021-03-10T14:42:46.477455+0000 mgr.gibba020.yqfnwy (mgr.34427) 2661 : cluster [DBG] pgmap v1504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:48.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:48 gibba020 bash[25448]: cluster 2021-03-10T14:42:46.477455+0000 mgr.gibba020.yqfnwy (mgr.34427) 2661 : cluster [DBG] pgmap v1504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:50.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:50 gibba013 bash[29418]: cluster 2021-03-10T14:42:48.478989+0000 mgr.gibba020.yqfnwy (mgr.34427) 2662 : cluster [DBG] pgmap v1505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:50.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:50 gibba013 bash[30381]: cluster 2021-03-10T14:42:48.478989+0000 mgr.gibba020.yqfnwy (mgr.34427) 2662 : cluster [DBG] pgmap v1505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:50.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:50 gibba020 bash[25448]: cluster 2021-03-10T14:42:48.478989+0000 mgr.gibba020.yqfnwy (mgr.34427) 2662 : cluster [DBG] pgmap v1505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:52.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:52 gibba013 bash[29418]: cluster 2021-03-10T14:42:50.480808+0000 mgr.gibba020.yqfnwy (mgr.34427) 2663 : cluster [DBG] pgmap v1506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:52.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:52 gibba013 bash[30381]: cluster 2021-03-10T14:42:50.480808+0000 mgr.gibba020.yqfnwy (mgr.34427) 2663 : cluster [DBG] pgmap v1506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:52.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:52 gibba020 bash[25448]: cluster 2021-03-10T14:42:50.480808+0000 mgr.gibba020.yqfnwy (mgr.34427) 2663 : cluster [DBG] pgmap v1506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:54.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:54 gibba013 bash[29418]: cluster 2021-03-10T14:42:52.482201+0000 mgr.gibba020.yqfnwy (mgr.34427) 2664 : cluster [DBG] pgmap v1507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:54.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:54 gibba013 bash[30381]: cluster 2021-03-10T14:42:52.482201+0000 mgr.gibba020.yqfnwy (mgr.34427) 2664 : cluster [DBG] pgmap v1507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:54.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:54 gibba020 bash[25448]: cluster 2021-03-10T14:42:52.482201+0000 mgr.gibba020.yqfnwy (mgr.34427) 2664 : cluster [DBG] pgmap v1507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:56.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:56 gibba013 bash[29418]: cluster 2021-03-10T14:42:54.483675+0000 mgr.gibba020.yqfnwy (mgr.34427) 2665 : cluster [DBG] pgmap v1508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:56.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:56 gibba013 bash[29418]: cephadm 2021-03-10T14:42:54.946911+0000 mgr.gibba020.yqfnwy (mgr.34427) 2666 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:42:56.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:56 gibba013 bash[30381]: cluster 2021-03-10T14:42:54.483675+0000 mgr.gibba020.yqfnwy (mgr.34427) 2665 : cluster [DBG] pgmap v1508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:56.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:56 gibba013 bash[30381]: cephadm 2021-03-10T14:42:54.946911+0000 mgr.gibba020.yqfnwy (mgr.34427) 2666 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:42:56.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:56 gibba020 bash[25448]: cluster 2021-03-10T14:42:54.483675+0000 mgr.gibba020.yqfnwy (mgr.34427) 2665 : cluster [DBG] pgmap v1508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:56.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:56 gibba020 bash[25448]: cephadm 2021-03-10T14:42:54.946911+0000 mgr.gibba020.yqfnwy (mgr.34427) 2666 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:42:58.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:42:58 gibba013 bash[29418]: cluster 2021-03-10T14:42:56.485436+0000 mgr.gibba020.yqfnwy (mgr.34427) 2667 : cluster [DBG] pgmap v1509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:58.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:42:58 gibba013 bash[30381]: cluster 2021-03-10T14:42:56.485436+0000 mgr.gibba020.yqfnwy (mgr.34427) 2667 : cluster [DBG] pgmap v1509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:42:58.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:42:58 gibba020 bash[25448]: cluster 2021-03-10T14:42:56.485436+0000 mgr.gibba020.yqfnwy (mgr.34427) 2667 : cluster [DBG] pgmap v1509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:00.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:00 gibba013 bash[29418]: cluster 2021-03-10T14:42:58.486852+0000 mgr.gibba020.yqfnwy (mgr.34427) 2668 : cluster [DBG] pgmap v1510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:00.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:00 gibba013 bash[30381]: cluster 2021-03-10T14:42:58.486852+0000 mgr.gibba020.yqfnwy (mgr.34427) 2668 : cluster [DBG] pgmap v1510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:00.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:00 gibba020 bash[25448]: cluster 2021-03-10T14:42:58.486852+0000 mgr.gibba020.yqfnwy (mgr.34427) 2668 : cluster [DBG] pgmap v1510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:01.521 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:43:01.783 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:43:01.783 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (49m) 4m ago 54m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:43:01.783 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (54m) 3m ago 54m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:43:01.783 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (49m) 3m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:43:01.784 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (50m) 3m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:43:01.784 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (49m) 4m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:43:01.784 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (49m) 4m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:43:01.784 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (48m) 3m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:43:01.784 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (48m) 4m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:43:01.785 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (55m) 4m ago 55m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:43:01.785 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (55m) 3m ago 55m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:43:01.785 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (47m) 4m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:43:01.785 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (47m) 4m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:43:01.786 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (46m) 4m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:43:01.786 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (46m) 4m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:43:01.786 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (46m) 3m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:43:01.786 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (45m) 3m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:43:01.786 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (45m) 3m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:43:01.787 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (44m) 3m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:43:01.787 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (54m) 3m ago 55m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:43:01.787 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 3m ago 53m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:43:02.062 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:43:02.063 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:43:02.063 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:43:02.063 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:43:02.063 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:43:02.063 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:43:02.064 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:43:02.064 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:43:02.064 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:43:02.064 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:43:02.065 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:43:02.065 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:43:02.065 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:43:02.065 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:43:02.065 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:43:02.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:02 gibba020 bash[25448]: cluster 2021-03-10T14:43:00.488603+0000 mgr.gibba020.yqfnwy (mgr.34427) 2669 : cluster [DBG] pgmap v1511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:02.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:02 gibba020 bash[25448]: audit 2021-03-10T14:43:02.060655+0000 mon.a (mon.0) 1350 : audit [DBG] from='client.? 172.21.2.113:0/330339865' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:02.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:02 gibba013 bash[29418]: cluster 2021-03-10T14:43:00.488603+0000 mgr.gibba020.yqfnwy (mgr.34427) 2669 : cluster [DBG] pgmap v1511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:02.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:02 gibba013 bash[29418]: audit 2021-03-10T14:43:02.060655+0000 mon.a (mon.0) 1350 : audit [DBG] from='client.? 172.21.2.113:0/330339865' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:02.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:02 gibba013 bash[30381]: cluster 2021-03-10T14:43:00.488603+0000 mgr.gibba020.yqfnwy (mgr.34427) 2669 : cluster [DBG] pgmap v1511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:02.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:02 gibba013 bash[30381]: audit 2021-03-10T14:43:02.060655+0000 mon.a (mon.0) 1350 : audit [DBG] from='client.? 172.21.2.113:0/330339865' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:03.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:03 gibba020 bash[25448]: audit 2021-03-10T14:43:01.509804+0000 mgr.gibba020.yqfnwy (mgr.34427) 2670 : audit [DBG] from='client.45852 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:43:03.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:03 gibba020 bash[25448]: audit 2021-03-10T14:43:01.738937+0000 mgr.gibba020.yqfnwy (mgr.34427) 2671 : audit [DBG] from='client.55843 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:43:03.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:03 gibba013 bash[29418]: audit 2021-03-10T14:43:01.509804+0000 mgr.gibba020.yqfnwy (mgr.34427) 2670 : audit [DBG] from='client.45852 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:43:03.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:03 gibba013 bash[29418]: audit 2021-03-10T14:43:01.738937+0000 mgr.gibba020.yqfnwy (mgr.34427) 2671 : audit [DBG] from='client.55843 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:43:03.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:03 gibba013 bash[30381]: audit 2021-03-10T14:43:01.509804+0000 mgr.gibba020.yqfnwy (mgr.34427) 2670 : audit [DBG] from='client.45852 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:43:03.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:03 gibba013 bash[30381]: audit 2021-03-10T14:43:01.738937+0000 mgr.gibba020.yqfnwy (mgr.34427) 2671 : audit [DBG] from='client.55843 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:43:04.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:04 gibba020 bash[25448]: cluster 2021-03-10T14:43:02.490032+0000 mgr.gibba020.yqfnwy (mgr.34427) 2672 : cluster [DBG] pgmap v1512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:04.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:04 gibba013 bash[29418]: cluster 2021-03-10T14:43:02.490032+0000 mgr.gibba020.yqfnwy (mgr.34427) 2672 : cluster [DBG] pgmap v1512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:04.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:04 gibba013 bash[30381]: cluster 2021-03-10T14:43:02.490032+0000 mgr.gibba020.yqfnwy (mgr.34427) 2672 : cluster [DBG] pgmap v1512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:06.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:06 gibba020 bash[25448]: cluster 2021-03-10T14:43:04.491425+0000 mgr.gibba020.yqfnwy (mgr.34427) 2673 : cluster [DBG] pgmap v1513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:06.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:06 gibba013 bash[29418]: cluster 2021-03-10T14:43:04.491425+0000 mgr.gibba020.yqfnwy (mgr.34427) 2673 : cluster [DBG] pgmap v1513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:06.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:06 gibba013 bash[30381]: cluster 2021-03-10T14:43:04.491425+0000 mgr.gibba020.yqfnwy (mgr.34427) 2673 : cluster [DBG] pgmap v1513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:07 gibba020 bash[25448]: audit 2021-03-10T14:43:06.210496+0000 mon.a (mon.0) 1351 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:43:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:07 gibba020 bash[25448]: audit 2021-03-10T14:43:06.210783+0000 mon.a (mon.0) 1352 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:43:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:07 gibba020 bash[25448]: audit 2021-03-10T14:43:06.211033+0000 mon.a (mon.0) 1353 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T14:43:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:07 gibba020 bash[25448]: audit 2021-03-10T14:43:06.211282+0000 mon.a (mon.0) 1354 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:43:07.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:07 gibba020 bash[25448]: audit 2021-03-10T14:43:06.243086+0000 mon.a (mon.0) 1355 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:43:07.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:07 gibba020 bash[25448]: audit 2021-03-10T14:43:06.246206+0000 mon.a (mon.0) 1356 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:43:07.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:07 gibba013 bash[29418]: audit 2021-03-10T14:43:06.210496+0000 mon.a (mon.0) 1351 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:43:07.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:07 gibba013 bash[29418]: audit 2021-03-10T14:43:06.210783+0000 mon.a (mon.0) 1352 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:43:07.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:07 gibba013 bash[29418]: audit 2021-03-10T14:43:06.211033+0000 mon.a (mon.0) 1353 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T14:43:07.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:07 gibba013 bash[29418]: audit 2021-03-10T14:43:06.211282+0000 mon.a (mon.0) 1354 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:43:07.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:07 gibba013 bash[29418]: audit 2021-03-10T14:43:06.243086+0000 mon.a (mon.0) 1355 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:43:07.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:07 gibba013 bash[29418]: audit 2021-03-10T14:43:06.246206+0000 mon.a (mon.0) 1356 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:43:07.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:07 gibba013 bash[30381]: audit 2021-03-10T14:43:06.210496+0000 mon.a (mon.0) 1351 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:43:07.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:07 gibba013 bash[30381]: audit 2021-03-10T14:43:06.210783+0000 mon.a (mon.0) 1352 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:43:07.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:07 gibba013 bash[30381]: audit 2021-03-10T14:43:06.211033+0000 mon.a (mon.0) 1353 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T14:43:07.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:07 gibba013 bash[30381]: audit 2021-03-10T14:43:06.211282+0000 mon.a (mon.0) 1354 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:43:07.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:07 gibba013 bash[30381]: audit 2021-03-10T14:43:06.243086+0000 mon.a (mon.0) 1355 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:43:07.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:07 gibba013 bash[30381]: audit 2021-03-10T14:43:06.246206+0000 mon.a (mon.0) 1356 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:43:08.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:08 gibba020 bash[25448]: cluster 2021-03-10T14:43:06.493069+0000 mgr.gibba020.yqfnwy (mgr.34427) 2674 : cluster [DBG] pgmap v1514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:08.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:08 gibba013 bash[29418]: cluster 2021-03-10T14:43:06.493069+0000 mgr.gibba020.yqfnwy (mgr.34427) 2674 : cluster [DBG] pgmap v1514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:08.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:08 gibba013 bash[30381]: cluster 2021-03-10T14:43:06.493069+0000 mgr.gibba020.yqfnwy (mgr.34427) 2674 : cluster [DBG] pgmap v1514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:10.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:10 gibba013 bash[29418]: cluster 2021-03-10T14:43:08.494588+0000 mgr.gibba020.yqfnwy (mgr.34427) 2675 : cluster [DBG] pgmap v1515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:10.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:10 gibba013 bash[29418]: audit 2021-03-10T14:43:09.964680+0000 mon.a (mon.0) 1357 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:43:10.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:10 gibba013 bash[30381]: cluster 2021-03-10T14:43:08.494588+0000 mgr.gibba020.yqfnwy (mgr.34427) 2675 : cluster [DBG] pgmap v1515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:10.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:10 gibba013 bash[30381]: audit 2021-03-10T14:43:09.964680+0000 mon.a (mon.0) 1357 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:43:10.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:10 gibba020 bash[25448]: cluster 2021-03-10T14:43:08.494588+0000 mgr.gibba020.yqfnwy (mgr.34427) 2675 : cluster [DBG] pgmap v1515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:10.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:10 gibba020 bash[25448]: audit 2021-03-10T14:43:09.964680+0000 mon.a (mon.0) 1357 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:43:11.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[29418]: cephadm 2021-03-10T14:43:09.969114+0000 mgr.gibba020.yqfnwy (mgr.34427) 2676 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:43:11.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[29418]: cephadm 2021-03-10T14:43:09.971040+0000 mgr.gibba020.yqfnwy (mgr.34427) 2677 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:43:11.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[29418]: audit 2021-03-10T14:43:10.230072+0000 mon.a (mon.0) 1358 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:43:11.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[29418]: cephadm 2021-03-10T14:43:10.232009+0000 mgr.gibba020.yqfnwy (mgr.34427) 2678 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:43:11.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[29418]: audit 2021-03-10T14:43:10.233600+0000 mon.a (mon.0) 1359 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:43:11.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[29418]: cephadm 2021-03-10T14:43:10.233894+0000 mgr.gibba020.yqfnwy (mgr.34427) 2679 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:43:11.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[29418]: cephadm 2021-03-10T14:43:10.235071+0000 mgr.gibba020.yqfnwy (mgr.34427) 2680 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:43:11.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[29418]: cephadm 2021-03-10T14:43:10.235109+0000 mgr.gibba020.yqfnwy (mgr.34427) 2681 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:43:11.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[29418]: audit 2021-03-10T14:43:10.235120+0000 mon.a (mon.0) 1360 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:11.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[29418]: cephadm 2021-03-10T14:43:10.236294+0000 mgr.gibba020.yqfnwy (mgr.34427) 2682 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:43:11.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[29418]: audit 2021-03-10T14:43:10.236299+0000 mon.a (mon.0) 1361 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:11.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[29418]: cephadm 2021-03-10T14:43:10.236332+0000 mgr.gibba020.yqfnwy (mgr.34427) 2683 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:43:11.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[29418]: cephadm 2021-03-10T14:43:10.237309+0000 mgr.gibba020.yqfnwy (mgr.34427) 2684 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:43:11.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[29418]: audit 2021-03-10T14:43:10.237428+0000 mon.a (mon.0) 1362 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:11.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[29418]: cephadm 2021-03-10T14:43:10.238807+0000 mgr.gibba020.yqfnwy (mgr.34427) 2685 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:43:11.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[29418]: cephadm 2021-03-10T14:43:10.238843+0000 mgr.gibba020.yqfnwy (mgr.34427) 2686 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:43:11.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[29418]: audit 2021-03-10T14:43:10.240238+0000 mon.a (mon.0) 1363 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:11.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[29418]: cephadm 2021-03-10T14:43:10.240427+0000 mgr.gibba020.yqfnwy (mgr.34427) 2687 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:43:11.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[29418]: cephadm 2021-03-10T14:43:10.240742+0000 mgr.gibba020.yqfnwy (mgr.34427) 2688 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:43:11.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[29418]: audit 2021-03-10T14:43:10.242032+0000 mon.a (mon.0) 1364 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:11.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[29418]: cephadm 2021-03-10T14:43:10.242262+0000 mgr.gibba020.yqfnwy (mgr.34427) 2689 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:43:11.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[29418]: cephadm 2021-03-10T14:43:10.242301+0000 mgr.gibba020.yqfnwy (mgr.34427) 2690 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:43:11.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[29418]: cephadm 2021-03-10T14:43:10.242403+0000 mgr.gibba020.yqfnwy (mgr.34427) 2691 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:43:11.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[30381]: cephadm 2021-03-10T14:43:09.969114+0000 mgr.gibba020.yqfnwy (mgr.34427) 2676 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:43:11.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[30381]: cephadm 2021-03-10T14:43:09.971040+0000 mgr.gibba020.yqfnwy (mgr.34427) 2677 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:43:11.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[30381]: audit 2021-03-10T14:43:10.230072+0000 mon.a (mon.0) 1358 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:43:11.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[30381]: cephadm 2021-03-10T14:43:10.232009+0000 mgr.gibba020.yqfnwy (mgr.34427) 2678 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:43:11.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[30381]: audit 2021-03-10T14:43:10.233600+0000 mon.a (mon.0) 1359 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:43:11.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[30381]: cephadm 2021-03-10T14:43:10.233894+0000 mgr.gibba020.yqfnwy (mgr.34427) 2679 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:43:11.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[30381]: cephadm 2021-03-10T14:43:10.235071+0000 mgr.gibba020.yqfnwy (mgr.34427) 2680 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:43:11.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[30381]: cephadm 2021-03-10T14:43:10.235109+0000 mgr.gibba020.yqfnwy (mgr.34427) 2681 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:43:11.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[30381]: audit 2021-03-10T14:43:10.235120+0000 mon.a (mon.0) 1360 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:11.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[30381]: cephadm 2021-03-10T14:43:10.236294+0000 mgr.gibba020.yqfnwy (mgr.34427) 2682 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:43:11.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[30381]: audit 2021-03-10T14:43:10.236299+0000 mon.a (mon.0) 1361 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:11.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[30381]: cephadm 2021-03-10T14:43:10.236332+0000 mgr.gibba020.yqfnwy (mgr.34427) 2683 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:43:11.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[30381]: cephadm 2021-03-10T14:43:10.237309+0000 mgr.gibba020.yqfnwy (mgr.34427) 2684 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:43:11.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[30381]: audit 2021-03-10T14:43:10.237428+0000 mon.a (mon.0) 1362 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:11.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[30381]: cephadm 2021-03-10T14:43:10.238807+0000 mgr.gibba020.yqfnwy (mgr.34427) 2685 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:43:11.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[30381]: cephadm 2021-03-10T14:43:10.238843+0000 mgr.gibba020.yqfnwy (mgr.34427) 2686 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:43:11.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[30381]: audit 2021-03-10T14:43:10.240238+0000 mon.a (mon.0) 1363 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:11.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[30381]: cephadm 2021-03-10T14:43:10.240427+0000 mgr.gibba020.yqfnwy (mgr.34427) 2687 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:43:11.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[30381]: cephadm 2021-03-10T14:43:10.240742+0000 mgr.gibba020.yqfnwy (mgr.34427) 2688 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:43:11.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[30381]: audit 2021-03-10T14:43:10.242032+0000 mon.a (mon.0) 1364 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:11.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[30381]: cephadm 2021-03-10T14:43:10.242262+0000 mgr.gibba020.yqfnwy (mgr.34427) 2689 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:43:11.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[30381]: cephadm 2021-03-10T14:43:10.242301+0000 mgr.gibba020.yqfnwy (mgr.34427) 2690 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:43:11.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:11 gibba013 bash[30381]: cephadm 2021-03-10T14:43:10.242403+0000 mgr.gibba020.yqfnwy (mgr.34427) 2691 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:43:11.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:11 gibba020 bash[25448]: cephadm 2021-03-10T14:43:09.969114+0000 mgr.gibba020.yqfnwy (mgr.34427) 2676 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:43:11.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:11 gibba020 bash[25448]: cephadm 2021-03-10T14:43:09.971040+0000 mgr.gibba020.yqfnwy (mgr.34427) 2677 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:43:11.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:11 gibba020 bash[25448]: audit 2021-03-10T14:43:10.230072+0000 mon.a (mon.0) 1358 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:43:11.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:11 gibba020 bash[25448]: cephadm 2021-03-10T14:43:10.232009+0000 mgr.gibba020.yqfnwy (mgr.34427) 2678 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:43:11.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:11 gibba020 bash[25448]: audit 2021-03-10T14:43:10.233600+0000 mon.a (mon.0) 1359 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:43:11.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:11 gibba020 bash[25448]: cephadm 2021-03-10T14:43:10.233894+0000 mgr.gibba020.yqfnwy (mgr.34427) 2679 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:43:11.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:11 gibba020 bash[25448]: cephadm 2021-03-10T14:43:10.235071+0000 mgr.gibba020.yqfnwy (mgr.34427) 2680 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:43:11.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:11 gibba020 bash[25448]: cephadm 2021-03-10T14:43:10.235109+0000 mgr.gibba020.yqfnwy (mgr.34427) 2681 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:43:11.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:11 gibba020 bash[25448]: audit 2021-03-10T14:43:10.235120+0000 mon.a (mon.0) 1360 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:11.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:11 gibba020 bash[25448]: cephadm 2021-03-10T14:43:10.236294+0000 mgr.gibba020.yqfnwy (mgr.34427) 2682 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:43:11.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:11 gibba020 bash[25448]: audit 2021-03-10T14:43:10.236299+0000 mon.a (mon.0) 1361 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:11.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:11 gibba020 bash[25448]: cephadm 2021-03-10T14:43:10.236332+0000 mgr.gibba020.yqfnwy (mgr.34427) 2683 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:43:11.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:11 gibba020 bash[25448]: cephadm 2021-03-10T14:43:10.237309+0000 mgr.gibba020.yqfnwy (mgr.34427) 2684 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:43:11.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:11 gibba020 bash[25448]: audit 2021-03-10T14:43:10.237428+0000 mon.a (mon.0) 1362 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:11.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:11 gibba020 bash[25448]: cephadm 2021-03-10T14:43:10.238807+0000 mgr.gibba020.yqfnwy (mgr.34427) 2685 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:43:11.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:11 gibba020 bash[25448]: cephadm 2021-03-10T14:43:10.238843+0000 mgr.gibba020.yqfnwy (mgr.34427) 2686 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:43:11.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:11 gibba020 bash[25448]: audit 2021-03-10T14:43:10.240238+0000 mon.a (mon.0) 1363 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:11.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:11 gibba020 bash[25448]: cephadm 2021-03-10T14:43:10.240427+0000 mgr.gibba020.yqfnwy (mgr.34427) 2687 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:43:11.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:11 gibba020 bash[25448]: cephadm 2021-03-10T14:43:10.240742+0000 mgr.gibba020.yqfnwy (mgr.34427) 2688 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:43:11.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:11 gibba020 bash[25448]: audit 2021-03-10T14:43:10.242032+0000 mon.a (mon.0) 1364 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:11.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:11 gibba020 bash[25448]: cephadm 2021-03-10T14:43:10.242262+0000 mgr.gibba020.yqfnwy (mgr.34427) 2689 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:43:11.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:11 gibba020 bash[25448]: cephadm 2021-03-10T14:43:10.242301+0000 mgr.gibba020.yqfnwy (mgr.34427) 2690 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:43:11.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:11 gibba020 bash[25448]: cephadm 2021-03-10T14:43:10.242403+0000 mgr.gibba020.yqfnwy (mgr.34427) 2691 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:43:12.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:12 gibba013 bash[29418]: cluster 2021-03-10T14:43:10.496160+0000 mgr.gibba020.yqfnwy (mgr.34427) 2692 : cluster [DBG] pgmap v1516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:12.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:12 gibba013 bash[30381]: cluster 2021-03-10T14:43:10.496160+0000 mgr.gibba020.yqfnwy (mgr.34427) 2692 : cluster [DBG] pgmap v1516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:12.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:12 gibba020 bash[25448]: cluster 2021-03-10T14:43:10.496160+0000 mgr.gibba020.yqfnwy (mgr.34427) 2692 : cluster [DBG] pgmap v1516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:14.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:14 gibba013 bash[29418]: cluster 2021-03-10T14:43:12.497681+0000 mgr.gibba020.yqfnwy (mgr.34427) 2693 : cluster [DBG] pgmap v1517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:14.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:14 gibba013 bash[30381]: cluster 2021-03-10T14:43:12.497681+0000 mgr.gibba020.yqfnwy (mgr.34427) 2693 : cluster [DBG] pgmap v1517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:14.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:14 gibba020 bash[25448]: cluster 2021-03-10T14:43:12.497681+0000 mgr.gibba020.yqfnwy (mgr.34427) 2693 : cluster [DBG] pgmap v1517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:15.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:15 gibba013 bash[29418]: cluster 2021-03-10T14:43:14.499213+0000 mgr.gibba020.yqfnwy (mgr.34427) 2694 : cluster [DBG] pgmap v1518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:15.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:15 gibba013 bash[30381]: cluster 2021-03-10T14:43:14.499213+0000 mgr.gibba020.yqfnwy (mgr.34427) 2694 : cluster [DBG] pgmap v1518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:15.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:15 gibba020 bash[25448]: cluster 2021-03-10T14:43:14.499213+0000 mgr.gibba020.yqfnwy (mgr.34427) 2694 : cluster [DBG] pgmap v1518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:18.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:18 gibba020 bash[25448]: cluster 2021-03-10T14:43:16.501116+0000 mgr.gibba020.yqfnwy (mgr.34427) 2695 : cluster [DBG] pgmap v1519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:18.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:18 gibba013 bash[29418]: cluster 2021-03-10T14:43:16.501116+0000 mgr.gibba020.yqfnwy (mgr.34427) 2695 : cluster [DBG] pgmap v1519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:18.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:18 gibba013 bash[30381]: cluster 2021-03-10T14:43:16.501116+0000 mgr.gibba020.yqfnwy (mgr.34427) 2695 : cluster [DBG] pgmap v1519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:20.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:20 gibba020 bash[25448]: cluster 2021-03-10T14:43:18.502626+0000 mgr.gibba020.yqfnwy (mgr.34427) 2696 : cluster [DBG] pgmap v1520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:20.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:20 gibba013 bash[29418]: cluster 2021-03-10T14:43:18.502626+0000 mgr.gibba020.yqfnwy (mgr.34427) 2696 : cluster [DBG] pgmap v1520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:20.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:20 gibba013 bash[30381]: cluster 2021-03-10T14:43:18.502626+0000 mgr.gibba020.yqfnwy (mgr.34427) 2696 : cluster [DBG] pgmap v1520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:22.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:22 gibba020 bash[25448]: cluster 2021-03-10T14:43:20.504109+0000 mgr.gibba020.yqfnwy (mgr.34427) 2697 : cluster [DBG] pgmap v1521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:22.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:22 gibba013 bash[29418]: cluster 2021-03-10T14:43:20.504109+0000 mgr.gibba020.yqfnwy (mgr.34427) 2697 : cluster [DBG] pgmap v1521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:22.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:22 gibba013 bash[30381]: cluster 2021-03-10T14:43:20.504109+0000 mgr.gibba020.yqfnwy (mgr.34427) 2697 : cluster [DBG] pgmap v1521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:24.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:24 gibba020 bash[25448]: cluster 2021-03-10T14:43:22.505695+0000 mgr.gibba020.yqfnwy (mgr.34427) 2698 : cluster [DBG] pgmap v1522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:24.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:24 gibba013 bash[29418]: cluster 2021-03-10T14:43:22.505695+0000 mgr.gibba020.yqfnwy (mgr.34427) 2698 : cluster [DBG] pgmap v1522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:24.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:24 gibba013 bash[30381]: cluster 2021-03-10T14:43:22.505695+0000 mgr.gibba020.yqfnwy (mgr.34427) 2698 : cluster [DBG] pgmap v1522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:26.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:26 gibba013 bash[29418]: cluster 2021-03-10T14:43:24.507071+0000 mgr.gibba020.yqfnwy (mgr.34427) 2699 : cluster [DBG] pgmap v1523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:26.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:26 gibba013 bash[29418]: cephadm 2021-03-10T14:43:25.258037+0000 mgr.gibba020.yqfnwy (mgr.34427) 2700 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:43:26.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:26 gibba013 bash[30381]: cluster 2021-03-10T14:43:24.507071+0000 mgr.gibba020.yqfnwy (mgr.34427) 2699 : cluster [DBG] pgmap v1523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:26.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:26 gibba013 bash[30381]: cephadm 2021-03-10T14:43:25.258037+0000 mgr.gibba020.yqfnwy (mgr.34427) 2700 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:43:26.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:26 gibba020 bash[25448]: cluster 2021-03-10T14:43:24.507071+0000 mgr.gibba020.yqfnwy (mgr.34427) 2699 : cluster [DBG] pgmap v1523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:26.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:26 gibba020 bash[25448]: cephadm 2021-03-10T14:43:25.258037+0000 mgr.gibba020.yqfnwy (mgr.34427) 2700 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:43:28.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:28 gibba013 bash[29418]: cluster 2021-03-10T14:43:26.509037+0000 mgr.gibba020.yqfnwy (mgr.34427) 2701 : cluster [DBG] pgmap v1524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:28.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:28 gibba013 bash[30381]: cluster 2021-03-10T14:43:26.509037+0000 mgr.gibba020.yqfnwy (mgr.34427) 2701 : cluster [DBG] pgmap v1524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:28.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:28 gibba020 bash[25448]: cluster 2021-03-10T14:43:26.509037+0000 mgr.gibba020.yqfnwy (mgr.34427) 2701 : cluster [DBG] pgmap v1524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:30.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:30 gibba013 bash[29418]: cluster 2021-03-10T14:43:28.510472+0000 mgr.gibba020.yqfnwy (mgr.34427) 2702 : cluster [DBG] pgmap v1525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:30.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:30 gibba013 bash[30381]: cluster 2021-03-10T14:43:28.510472+0000 mgr.gibba020.yqfnwy (mgr.34427) 2702 : cluster [DBG] pgmap v1525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:30.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:30 gibba020 bash[25448]: cluster 2021-03-10T14:43:28.510472+0000 mgr.gibba020.yqfnwy (mgr.34427) 2702 : cluster [DBG] pgmap v1525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:32.350 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:43:32.578 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:43:32.578 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (50m) 5m ago 55m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:43:32.578 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (55m) 4m ago 55m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:43:32.579 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (50m) 4m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:43:32.579 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (50m) 4m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:43:32.579 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (49m) 5m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:43:32.580 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (49m) 5m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:43:32.580 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (49m) 4m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:43:32.580 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (49m) 5m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:43:32.580 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (55m) 5m ago 55m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:43:32.581 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (55m) 4m ago 55m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:43:32.581 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (48m) 5m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:43:32.581 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (47m) 5m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:43:32.581 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (47m) 5m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:43:32.582 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (47m) 5m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:43:32.582 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (46m) 4m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:43:32.582 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (46m) 4m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:43:32.582 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (45m) 4m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:43:32.583 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (45m) 4m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:43:32.583 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (54m) 4m ago 55m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:43:32.583 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 4m ago 53m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:43:32.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:32 gibba013 bash[29418]: cluster 2021-03-10T14:43:30.512314+0000 mgr.gibba020.yqfnwy (mgr.34427) 2703 : cluster [DBG] pgmap v1526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:32.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:32 gibba013 bash[30381]: cluster 2021-03-10T14:43:30.512314+0000 mgr.gibba020.yqfnwy (mgr.34427) 2703 : cluster [DBG] pgmap v1526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:32.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:32 gibba020 bash[25448]: cluster 2021-03-10T14:43:30.512314+0000 mgr.gibba020.yqfnwy (mgr.34427) 2703 : cluster [DBG] pgmap v1526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:32.826 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:43:32.826 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:43:32.827 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:43:32.827 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:43:32.827 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:43:32.827 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:43:32.827 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:43:32.828 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:43:32.828 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:43:32.828 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:43:32.828 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:43:32.829 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:43:32.829 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:43:32.829 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:43:32.829 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:43:33.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:33 gibba013 bash[29418]: audit 2021-03-10T14:43:32.824450+0000 mon.a (mon.0) 1365 : audit [DBG] from='client.? 172.21.2.113:0/1755794982' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:33.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:33 gibba013 bash[30381]: audit 2021-03-10T14:43:32.824450+0000 mon.a (mon.0) 1365 : audit [DBG] from='client.? 172.21.2.113:0/1755794982' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:33.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:33 gibba020 bash[25448]: audit 2021-03-10T14:43:32.824450+0000 mon.a (mon.0) 1365 : audit [DBG] from='client.? 172.21.2.113:0/1755794982' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:43:34.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:34 gibba013 bash[29418]: audit 2021-03-10T14:43:32.338514+0000 mgr.gibba020.yqfnwy (mgr.34427) 2704 : audit [DBG] from='client.45870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:43:34.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:34 gibba013 bash[29418]: cluster 2021-03-10T14:43:32.513818+0000 mgr.gibba020.yqfnwy (mgr.34427) 2705 : cluster [DBG] pgmap v1527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:34.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:34 gibba013 bash[29418]: audit 2021-03-10T14:43:32.562864+0000 mgr.gibba020.yqfnwy (mgr.34427) 2706 : audit [DBG] from='client.55861 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:43:34.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:34 gibba013 bash[30381]: audit 2021-03-10T14:43:32.338514+0000 mgr.gibba020.yqfnwy (mgr.34427) 2704 : audit [DBG] from='client.45870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:43:34.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:34 gibba013 bash[30381]: cluster 2021-03-10T14:43:32.513818+0000 mgr.gibba020.yqfnwy (mgr.34427) 2705 : cluster [DBG] pgmap v1527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:34.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:34 gibba013 bash[30381]: audit 2021-03-10T14:43:32.562864+0000 mgr.gibba020.yqfnwy (mgr.34427) 2706 : audit [DBG] from='client.55861 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:43:34.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:34 gibba020 bash[25448]: audit 2021-03-10T14:43:32.338514+0000 mgr.gibba020.yqfnwy (mgr.34427) 2704 : audit [DBG] from='client.45870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:43:34.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:34 gibba020 bash[25448]: cluster 2021-03-10T14:43:32.513818+0000 mgr.gibba020.yqfnwy (mgr.34427) 2705 : cluster [DBG] pgmap v1527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:34.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:34 gibba020 bash[25448]: audit 2021-03-10T14:43:32.562864+0000 mgr.gibba020.yqfnwy (mgr.34427) 2706 : audit [DBG] from='client.55861 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:43:36.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:36 gibba013 bash[29418]: cluster 2021-03-10T14:43:34.515187+0000 mgr.gibba020.yqfnwy (mgr.34427) 2707 : cluster [DBG] pgmap v1528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:36.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:36 gibba013 bash[30381]: cluster 2021-03-10T14:43:34.515187+0000 mgr.gibba020.yqfnwy (mgr.34427) 2707 : cluster [DBG] pgmap v1528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:36.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:36 gibba020 bash[25448]: cluster 2021-03-10T14:43:34.515187+0000 mgr.gibba020.yqfnwy (mgr.34427) 2707 : cluster [DBG] pgmap v1528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:38.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:38 gibba013 bash[29418]: cluster 2021-03-10T14:43:36.516959+0000 mgr.gibba020.yqfnwy (mgr.34427) 2708 : cluster [DBG] pgmap v1529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:38.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:38 gibba013 bash[30381]: cluster 2021-03-10T14:43:36.516959+0000 mgr.gibba020.yqfnwy (mgr.34427) 2708 : cluster [DBG] pgmap v1529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:38.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:38 gibba020 bash[25448]: cluster 2021-03-10T14:43:36.516959+0000 mgr.gibba020.yqfnwy (mgr.34427) 2708 : cluster [DBG] pgmap v1529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:40.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:40 gibba013 bash[29418]: cluster 2021-03-10T14:43:38.518445+0000 mgr.gibba020.yqfnwy (mgr.34427) 2709 : cluster [DBG] pgmap v1530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:40.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:40 gibba013 bash[30381]: cluster 2021-03-10T14:43:38.518445+0000 mgr.gibba020.yqfnwy (mgr.34427) 2709 : cluster [DBG] pgmap v1530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:40.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:40 gibba020 bash[25448]: cluster 2021-03-10T14:43:38.518445+0000 mgr.gibba020.yqfnwy (mgr.34427) 2709 : cluster [DBG] pgmap v1530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:42.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:42 gibba013 bash[29418]: cephadm 2021-03-10T14:43:40.273492+0000 mgr.gibba020.yqfnwy (mgr.34427) 2710 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:43:42.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:42 gibba013 bash[29418]: cluster 2021-03-10T14:43:40.520111+0000 mgr.gibba020.yqfnwy (mgr.34427) 2711 : cluster [DBG] pgmap v1531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:42.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:42 gibba013 bash[30381]: cephadm 2021-03-10T14:43:40.273492+0000 mgr.gibba020.yqfnwy (mgr.34427) 2710 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:43:42.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:42 gibba013 bash[30381]: cluster 2021-03-10T14:43:40.520111+0000 mgr.gibba020.yqfnwy (mgr.34427) 2711 : cluster [DBG] pgmap v1531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:42.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:42 gibba020 bash[25448]: cephadm 2021-03-10T14:43:40.273492+0000 mgr.gibba020.yqfnwy (mgr.34427) 2710 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:43:42.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:42 gibba020 bash[25448]: cluster 2021-03-10T14:43:40.520111+0000 mgr.gibba020.yqfnwy (mgr.34427) 2711 : cluster [DBG] pgmap v1531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:43.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:43 gibba013 bash[29418]: cluster 2021-03-10T14:43:42.521414+0000 mgr.gibba020.yqfnwy (mgr.34427) 2712 : cluster [DBG] pgmap v1532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:43.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:43 gibba013 bash[30381]: cluster 2021-03-10T14:43:42.521414+0000 mgr.gibba020.yqfnwy (mgr.34427) 2712 : cluster [DBG] pgmap v1532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:43.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:43 gibba020 bash[25448]: cluster 2021-03-10T14:43:42.521414+0000 mgr.gibba020.yqfnwy (mgr.34427) 2712 : cluster [DBG] pgmap v1532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:45.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:45 gibba013 bash[29418]: cluster 2021-03-10T14:43:44.522840+0000 mgr.gibba020.yqfnwy (mgr.34427) 2713 : cluster [DBG] pgmap v1533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:45.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:45 gibba013 bash[30381]: cluster 2021-03-10T14:43:44.522840+0000 mgr.gibba020.yqfnwy (mgr.34427) 2713 : cluster [DBG] pgmap v1533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:45.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:45 gibba020 bash[25448]: cluster 2021-03-10T14:43:44.522840+0000 mgr.gibba020.yqfnwy (mgr.34427) 2713 : cluster [DBG] pgmap v1533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:48.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:48 gibba020 bash[25448]: cluster 2021-03-10T14:43:46.524621+0000 mgr.gibba020.yqfnwy (mgr.34427) 2714 : cluster [DBG] pgmap v1534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:48.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:48 gibba013 bash[29418]: cluster 2021-03-10T14:43:46.524621+0000 mgr.gibba020.yqfnwy (mgr.34427) 2714 : cluster [DBG] pgmap v1534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:48.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:48 gibba013 bash[30381]: cluster 2021-03-10T14:43:46.524621+0000 mgr.gibba020.yqfnwy (mgr.34427) 2714 : cluster [DBG] pgmap v1534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:50.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:50 gibba020 bash[25448]: cluster 2021-03-10T14:43:48.526276+0000 mgr.gibba020.yqfnwy (mgr.34427) 2715 : cluster [DBG] pgmap v1535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:50.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:50 gibba013 bash[29418]: cluster 2021-03-10T14:43:48.526276+0000 mgr.gibba020.yqfnwy (mgr.34427) 2715 : cluster [DBG] pgmap v1535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:50.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:50 gibba013 bash[30381]: cluster 2021-03-10T14:43:48.526276+0000 mgr.gibba020.yqfnwy (mgr.34427) 2715 : cluster [DBG] pgmap v1535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:52.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:52 gibba013 bash[29418]: cluster 2021-03-10T14:43:50.528015+0000 mgr.gibba020.yqfnwy (mgr.34427) 2716 : cluster [DBG] pgmap v1536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:52.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:52 gibba013 bash[30381]: cluster 2021-03-10T14:43:50.528015+0000 mgr.gibba020.yqfnwy (mgr.34427) 2716 : cluster [DBG] pgmap v1536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:52.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:52 gibba020 bash[25448]: cluster 2021-03-10T14:43:50.528015+0000 mgr.gibba020.yqfnwy (mgr.34427) 2716 : cluster [DBG] pgmap v1536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:54.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:54 gibba013 bash[29418]: cluster 2021-03-10T14:43:52.529328+0000 mgr.gibba020.yqfnwy (mgr.34427) 2717 : cluster [DBG] pgmap v1537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:54.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:54 gibba013 bash[30381]: cluster 2021-03-10T14:43:52.529328+0000 mgr.gibba020.yqfnwy (mgr.34427) 2717 : cluster [DBG] pgmap v1537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:54.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:54 gibba020 bash[25448]: cluster 2021-03-10T14:43:52.529328+0000 mgr.gibba020.yqfnwy (mgr.34427) 2717 : cluster [DBG] pgmap v1537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:56.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:56 gibba013 bash[29418]: cluster 2021-03-10T14:43:54.530707+0000 mgr.gibba020.yqfnwy (mgr.34427) 2718 : cluster [DBG] pgmap v1538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:56.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:56 gibba013 bash[30381]: cluster 2021-03-10T14:43:54.530707+0000 mgr.gibba020.yqfnwy (mgr.34427) 2718 : cluster [DBG] pgmap v1538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:56.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:56 gibba020 bash[25448]: cluster 2021-03-10T14:43:54.530707+0000 mgr.gibba020.yqfnwy (mgr.34427) 2718 : cluster [DBG] pgmap v1538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:57.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:57 gibba013 bash[29418]: cephadm 2021-03-10T14:43:55.288992+0000 mgr.gibba020.yqfnwy (mgr.34427) 2719 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:43:57.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:57 gibba013 bash[30381]: cephadm 2021-03-10T14:43:55.288992+0000 mgr.gibba020.yqfnwy (mgr.34427) 2719 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:43:57.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:57 gibba020 bash[25448]: cephadm 2021-03-10T14:43:55.288992+0000 mgr.gibba020.yqfnwy (mgr.34427) 2719 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:43:58.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:43:58 gibba013 bash[29418]: cluster 2021-03-10T14:43:56.532495+0000 mgr.gibba020.yqfnwy (mgr.34427) 2720 : cluster [DBG] pgmap v1539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:58.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:43:58 gibba013 bash[30381]: cluster 2021-03-10T14:43:56.532495+0000 mgr.gibba020.yqfnwy (mgr.34427) 2720 : cluster [DBG] pgmap v1539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:43:58.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:43:58 gibba020 bash[25448]: cluster 2021-03-10T14:43:56.532495+0000 mgr.gibba020.yqfnwy (mgr.34427) 2720 : cluster [DBG] pgmap v1539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:00.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:00 gibba013 bash[29418]: cluster 2021-03-10T14:43:58.533878+0000 mgr.gibba020.yqfnwy (mgr.34427) 2721 : cluster [DBG] pgmap v1540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:00.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:00 gibba013 bash[30381]: cluster 2021-03-10T14:43:58.533878+0000 mgr.gibba020.yqfnwy (mgr.34427) 2721 : cluster [DBG] pgmap v1540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:00.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:00 gibba020 bash[25448]: cluster 2021-03-10T14:43:58.533878+0000 mgr.gibba020.yqfnwy (mgr.34427) 2721 : cluster [DBG] pgmap v1540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:02.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:02 gibba013 bash[29418]: cluster 2021-03-10T14:44:00.535545+0000 mgr.gibba020.yqfnwy (mgr.34427) 2722 : cluster [DBG] pgmap v1541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:02.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:02 gibba013 bash[30381]: cluster 2021-03-10T14:44:00.535545+0000 mgr.gibba020.yqfnwy (mgr.34427) 2722 : cluster [DBG] pgmap v1541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:02.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:02 gibba020 bash[25448]: cluster 2021-03-10T14:44:00.535545+0000 mgr.gibba020.yqfnwy (mgr.34427) 2722 : cluster [DBG] pgmap v1541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:03.070 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:44:03.298 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:44:03.299 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (50m) 5m ago 55m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:44:03.299 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (55m) 4m ago 55m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:44:03.299 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (50m) 4m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:44:03.299 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (51m) 4m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:44:03.300 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (50m) 5m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:44:03.300 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (50m) 5m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:44:03.300 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (49m) 4m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:44:03.300 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (49m) 5m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:44:03.300 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (56m) 5m ago 56m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:44:03.301 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (56m) 4m ago 56m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:44:03.301 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (48m) 5m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:44:03.301 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (48m) 5m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:44:03.301 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (47m) 5m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:44:03.301 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (47m) 5m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:44:03.302 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (47m) 4m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:44:03.302 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (46m) 4m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:44:03.302 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (46m) 4m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:44:03.302 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (45m) 4m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:44:03.302 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (55m) 4m ago 56m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:44:03.303 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 4m ago 54m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:44:03.550 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:44:03.551 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:44:03.551 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:44:03.551 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:44:03.551 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:44:03.552 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:44:03.552 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:44:03.552 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:44:03.552 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:44:03.552 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:44:03.553 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:44:03.553 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:44:03.553 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:44:03.553 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:44:03.553 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:44:04.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:04 gibba013 bash[29418]: cluster 2021-03-10T14:44:02.537078+0000 mgr.gibba020.yqfnwy (mgr.34427) 2723 : cluster [DBG] pgmap v1542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:04.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:04 gibba013 bash[29418]: audit 2021-03-10T14:44:03.058546+0000 mgr.gibba020.yqfnwy (mgr.34427) 2724 : audit [DBG] from='client.55873 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:44:04.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:04 gibba013 bash[29418]: audit 2021-03-10T14:44:03.548870+0000 mon.c (mon.1) 51 : audit [DBG] from='client.? 172.21.2.113:0/3312770750' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:04.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:04 gibba013 bash[30381]: cluster 2021-03-10T14:44:02.537078+0000 mgr.gibba020.yqfnwy (mgr.34427) 2723 : cluster [DBG] pgmap v1542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:04.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:04 gibba013 bash[30381]: audit 2021-03-10T14:44:03.058546+0000 mgr.gibba020.yqfnwy (mgr.34427) 2724 : audit [DBG] from='client.55873 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:44:04.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:04 gibba013 bash[30381]: audit 2021-03-10T14:44:03.548870+0000 mon.c (mon.1) 51 : audit [DBG] from='client.? 172.21.2.113:0/3312770750' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:04.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:04 gibba020 bash[25448]: cluster 2021-03-10T14:44:02.537078+0000 mgr.gibba020.yqfnwy (mgr.34427) 2723 : cluster [DBG] pgmap v1542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:04.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:04 gibba020 bash[25448]: audit 2021-03-10T14:44:03.058546+0000 mgr.gibba020.yqfnwy (mgr.34427) 2724 : audit [DBG] from='client.55873 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:44:04.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:04 gibba020 bash[25448]: audit 2021-03-10T14:44:03.548870+0000 mon.c (mon.1) 51 : audit [DBG] from='client.? 172.21.2.113:0/3312770750' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:05.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:05 gibba013 bash[29418]: audit 2021-03-10T14:44:03.283340+0000 mgr.gibba020.yqfnwy (mgr.34427) 2725 : audit [DBG] from='client.45894 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:44:05.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:05 gibba013 bash[30381]: audit 2021-03-10T14:44:03.283340+0000 mgr.gibba020.yqfnwy (mgr.34427) 2725 : audit [DBG] from='client.45894 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:44:05.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:05 gibba020 bash[25448]: audit 2021-03-10T14:44:03.283340+0000 mgr.gibba020.yqfnwy (mgr.34427) 2725 : audit [DBG] from='client.45894 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:44:06.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:06 gibba013 bash[29418]: cluster 2021-03-10T14:44:04.538497+0000 mgr.gibba020.yqfnwy (mgr.34427) 2726 : cluster [DBG] pgmap v1543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:06 gibba013 bash[29418]: audit 2021-03-10T14:44:06.218738+0000 mon.a (mon.0) 1366 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T14:44:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:06 gibba013 bash[29418]: audit 2021-03-10T14:44:06.219451+0000 mon.a (mon.0) 1367 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:44:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:06 gibba013 bash[29418]: audit 2021-03-10T14:44:06.220131+0000 mon.a (mon.0) 1368 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:44:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:06 gibba013 bash[29418]: audit 2021-03-10T14:44:06.220807+0000 mon.a (mon.0) 1369 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:44:06.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:06 gibba013 bash[29418]: audit 2021-03-10T14:44:06.246447+0000 mon.a (mon.0) 1370 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:44:06.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:06 gibba013 bash[29418]: audit 2021-03-10T14:44:06.249347+0000 mon.a (mon.0) 1371 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:44:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:06 gibba013 bash[30381]: cluster 2021-03-10T14:44:04.538497+0000 mgr.gibba020.yqfnwy (mgr.34427) 2726 : cluster [DBG] pgmap v1543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:06 gibba013 bash[30381]: audit 2021-03-10T14:44:06.218738+0000 mon.a (mon.0) 1366 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T14:44:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:06 gibba013 bash[30381]: audit 2021-03-10T14:44:06.219451+0000 mon.a (mon.0) 1367 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:44:06.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:06 gibba013 bash[30381]: audit 2021-03-10T14:44:06.220131+0000 mon.a (mon.0) 1368 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:44:06.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:06 gibba013 bash[30381]: audit 2021-03-10T14:44:06.220807+0000 mon.a (mon.0) 1369 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:44:06.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:06 gibba013 bash[30381]: audit 2021-03-10T14:44:06.246447+0000 mon.a (mon.0) 1370 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:44:06.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:06 gibba013 bash[30381]: audit 2021-03-10T14:44:06.249347+0000 mon.a (mon.0) 1371 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:44:06.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:06 gibba020 bash[25448]: cluster 2021-03-10T14:44:04.538497+0000 mgr.gibba020.yqfnwy (mgr.34427) 2726 : cluster [DBG] pgmap v1543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:06 gibba020 bash[25448]: audit 2021-03-10T14:44:06.218738+0000 mon.a (mon.0) 1366 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T14:44:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:06 gibba020 bash[25448]: audit 2021-03-10T14:44:06.219451+0000 mon.a (mon.0) 1367 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T14:44:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:06 gibba020 bash[25448]: audit 2021-03-10T14:44:06.220131+0000 mon.a (mon.0) 1368 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:44:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:06 gibba020 bash[25448]: audit 2021-03-10T14:44:06.220807+0000 mon.a (mon.0) 1369 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:44:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:06 gibba020 bash[25448]: audit 2021-03-10T14:44:06.246447+0000 mon.a (mon.0) 1370 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:44:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:06 gibba020 bash[25448]: audit 2021-03-10T14:44:06.249347+0000 mon.a (mon.0) 1371 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:44:07.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:07 gibba013 bash[29418]: cluster 2021-03-10T14:44:06.540326+0000 mgr.gibba020.yqfnwy (mgr.34427) 2727 : cluster [DBG] pgmap v1544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:07.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:07 gibba013 bash[30381]: cluster 2021-03-10T14:44:06.540326+0000 mgr.gibba020.yqfnwy (mgr.34427) 2727 : cluster [DBG] pgmap v1544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:07.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:07 gibba020 bash[25448]: cluster 2021-03-10T14:44:06.540326+0000 mgr.gibba020.yqfnwy (mgr.34427) 2727 : cluster [DBG] pgmap v1544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:09.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:09 gibba013 bash[29418]: cluster 2021-03-10T14:44:08.541743+0000 mgr.gibba020.yqfnwy (mgr.34427) 2728 : cluster [DBG] pgmap v1545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:09.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:09 gibba013 bash[30381]: cluster 2021-03-10T14:44:08.541743+0000 mgr.gibba020.yqfnwy (mgr.34427) 2728 : cluster [DBG] pgmap v1545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:09.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:09 gibba020 bash[25448]: cluster 2021-03-10T14:44:08.541743+0000 mgr.gibba020.yqfnwy (mgr.34427) 2728 : cluster [DBG] pgmap v1545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:10.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:10 gibba013 bash[29418]: audit 2021-03-10T14:44:10.306871+0000 mon.a (mon.0) 1372 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:44:10.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:10 gibba013 bash[29418]: audit 2021-03-10T14:44:10.532349+0000 mon.a (mon.0) 1373 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:44:10.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:10 gibba013 bash[29418]: audit 2021-03-10T14:44:10.535746+0000 mon.a (mon.0) 1374 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:44:10.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:10 gibba013 bash[29418]: audit 2021-03-10T14:44:10.537566+0000 mon.a (mon.0) 1375 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:10.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:10 gibba013 bash[29418]: audit 2021-03-10T14:44:10.538981+0000 mon.a (mon.0) 1376 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:10.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:10 gibba013 bash[29418]: audit 2021-03-10T14:44:10.540464+0000 mon.a (mon.0) 1377 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:10.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:10 gibba013 bash[29418]: audit 2021-03-10T14:44:10.543844+0000 mon.a (mon.0) 1378 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:10.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:10 gibba013 bash[29418]: audit 2021-03-10T14:44:10.545683+0000 mon.a (mon.0) 1379 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:10.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:10 gibba013 bash[30381]: audit 2021-03-10T14:44:10.306871+0000 mon.a (mon.0) 1372 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:44:10.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:10 gibba013 bash[30381]: audit 2021-03-10T14:44:10.532349+0000 mon.a (mon.0) 1373 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:44:10.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:10 gibba013 bash[30381]: audit 2021-03-10T14:44:10.535746+0000 mon.a (mon.0) 1374 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:44:10.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:10 gibba013 bash[30381]: audit 2021-03-10T14:44:10.537566+0000 mon.a (mon.0) 1375 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:10.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:10 gibba013 bash[30381]: audit 2021-03-10T14:44:10.538981+0000 mon.a (mon.0) 1376 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:10.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:10 gibba013 bash[30381]: audit 2021-03-10T14:44:10.540464+0000 mon.a (mon.0) 1377 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:10.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:10 gibba013 bash[30381]: audit 2021-03-10T14:44:10.543844+0000 mon.a (mon.0) 1378 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:10.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:10 gibba013 bash[30381]: audit 2021-03-10T14:44:10.545683+0000 mon.a (mon.0) 1379 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:10.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:10 gibba020 bash[25448]: audit 2021-03-10T14:44:10.306871+0000 mon.a (mon.0) 1372 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:44:10.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:10 gibba020 bash[25448]: audit 2021-03-10T14:44:10.532349+0000 mon.a (mon.0) 1373 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:44:10.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:10 gibba020 bash[25448]: audit 2021-03-10T14:44:10.535746+0000 mon.a (mon.0) 1374 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:44:10.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:10 gibba020 bash[25448]: audit 2021-03-10T14:44:10.537566+0000 mon.a (mon.0) 1375 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:10.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:10 gibba020 bash[25448]: audit 2021-03-10T14:44:10.538981+0000 mon.a (mon.0) 1376 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:10.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:10 gibba020 bash[25448]: audit 2021-03-10T14:44:10.540464+0000 mon.a (mon.0) 1377 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:10.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:10 gibba020 bash[25448]: audit 2021-03-10T14:44:10.543844+0000 mon.a (mon.0) 1378 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:10.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:10 gibba020 bash[25448]: audit 2021-03-10T14:44:10.545683+0000 mon.a (mon.0) 1379 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:12.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:12 gibba020 bash[25448]: cephadm 2021-03-10T14:44:10.311332+0000 mgr.gibba020.yqfnwy (mgr.34427) 2729 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:44:12.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:12 gibba020 bash[25448]: cephadm 2021-03-10T14:44:10.313166+0000 mgr.gibba020.yqfnwy (mgr.34427) 2730 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:44:12.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:12 gibba020 bash[25448]: cephadm 2021-03-10T14:44:10.534213+0000 mgr.gibba020.yqfnwy (mgr.34427) 2731 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:44:12.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:12 gibba020 bash[25448]: cephadm 2021-03-10T14:44:10.536163+0000 mgr.gibba020.yqfnwy (mgr.34427) 2732 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:44:12.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:12 gibba020 bash[25448]: cephadm 2021-03-10T14:44:10.537516+0000 mgr.gibba020.yqfnwy (mgr.34427) 2733 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:44:12.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:12 gibba020 bash[25448]: cephadm 2021-03-10T14:44:10.537576+0000 mgr.gibba020.yqfnwy (mgr.34427) 2734 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:44:12.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:12 gibba020 bash[25448]: cephadm 2021-03-10T14:44:10.539087+0000 mgr.gibba020.yqfnwy (mgr.34427) 2735 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:44:12.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:12 gibba020 bash[25448]: cephadm 2021-03-10T14:44:10.539150+0000 mgr.gibba020.yqfnwy (mgr.34427) 2736 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:44:12.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:12 gibba020 bash[25448]: cephadm 2021-03-10T14:44:10.540466+0000 mgr.gibba020.yqfnwy (mgr.34427) 2737 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:44:12.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:12 gibba020 bash[25448]: cephadm 2021-03-10T14:44:10.542191+0000 mgr.gibba020.yqfnwy (mgr.34427) 2738 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:44:12.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:12 gibba020 bash[25448]: cephadm 2021-03-10T14:44:10.542266+0000 mgr.gibba020.yqfnwy (mgr.34427) 2739 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:44:12.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:12 gibba020 bash[25448]: cluster 2021-03-10T14:44:10.542301+0000 mgr.gibba020.yqfnwy (mgr.34427) 2740 : cluster [DBG] pgmap v1546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:12.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:12 gibba020 bash[25448]: cephadm 2021-03-10T14:44:10.544044+0000 mgr.gibba020.yqfnwy (mgr.34427) 2741 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:44:12.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:12 gibba020 bash[25448]: cephadm 2021-03-10T14:44:10.544396+0000 mgr.gibba020.yqfnwy (mgr.34427) 2742 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:44:12.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:12 gibba020 bash[25448]: cephadm 2021-03-10T14:44:10.546087+0000 mgr.gibba020.yqfnwy (mgr.34427) 2743 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:44:12.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:12 gibba020 bash[25448]: cephadm 2021-03-10T14:44:10.546175+0000 mgr.gibba020.yqfnwy (mgr.34427) 2744 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:44:12.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:12 gibba020 bash[25448]: cephadm 2021-03-10T14:44:10.546277+0000 mgr.gibba020.yqfnwy (mgr.34427) 2745 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:44:12.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:12 gibba013 bash[29418]: cephadm 2021-03-10T14:44:10.311332+0000 mgr.gibba020.yqfnwy (mgr.34427) 2729 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:44:12.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:12 gibba013 bash[29418]: cephadm 2021-03-10T14:44:10.313166+0000 mgr.gibba020.yqfnwy (mgr.34427) 2730 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:44:12.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:12 gibba013 bash[29418]: cephadm 2021-03-10T14:44:10.534213+0000 mgr.gibba020.yqfnwy (mgr.34427) 2731 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:44:12.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:12 gibba013 bash[29418]: cephadm 2021-03-10T14:44:10.536163+0000 mgr.gibba020.yqfnwy (mgr.34427) 2732 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:44:12.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:12 gibba013 bash[29418]: cephadm 2021-03-10T14:44:10.537516+0000 mgr.gibba020.yqfnwy (mgr.34427) 2733 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:44:12.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:12 gibba013 bash[29418]: cephadm 2021-03-10T14:44:10.537576+0000 mgr.gibba020.yqfnwy (mgr.34427) 2734 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:44:12.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:12 gibba013 bash[29418]: cephadm 2021-03-10T14:44:10.539087+0000 mgr.gibba020.yqfnwy (mgr.34427) 2735 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:44:12.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:12 gibba013 bash[29418]: cephadm 2021-03-10T14:44:10.539150+0000 mgr.gibba020.yqfnwy (mgr.34427) 2736 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:44:12.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:12 gibba013 bash[29418]: cephadm 2021-03-10T14:44:10.540466+0000 mgr.gibba020.yqfnwy (mgr.34427) 2737 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:44:12.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:12 gibba013 bash[29418]: cephadm 2021-03-10T14:44:10.542191+0000 mgr.gibba020.yqfnwy (mgr.34427) 2738 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:44:12.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:12 gibba013 bash[29418]: cephadm 2021-03-10T14:44:10.542266+0000 mgr.gibba020.yqfnwy (mgr.34427) 2739 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:44:12.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:12 gibba013 bash[29418]: cluster 2021-03-10T14:44:10.542301+0000 mgr.gibba020.yqfnwy (mgr.34427) 2740 : cluster [DBG] pgmap v1546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:12.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:12 gibba013 bash[29418]: cephadm 2021-03-10T14:44:10.544044+0000 mgr.gibba020.yqfnwy (mgr.34427) 2741 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:44:12.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:12 gibba013 bash[29418]: cephadm 2021-03-10T14:44:10.544396+0000 mgr.gibba020.yqfnwy (mgr.34427) 2742 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:44:12.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:12 gibba013 bash[29418]: cephadm 2021-03-10T14:44:10.546087+0000 mgr.gibba020.yqfnwy (mgr.34427) 2743 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:44:12.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:12 gibba013 bash[29418]: cephadm 2021-03-10T14:44:10.546175+0000 mgr.gibba020.yqfnwy (mgr.34427) 2744 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:44:12.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:12 gibba013 bash[29418]: cephadm 2021-03-10T14:44:10.546277+0000 mgr.gibba020.yqfnwy (mgr.34427) 2745 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:44:12.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:12 gibba013 bash[30381]: cephadm 2021-03-10T14:44:10.311332+0000 mgr.gibba020.yqfnwy (mgr.34427) 2729 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:44:12.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:12 gibba013 bash[30381]: cephadm 2021-03-10T14:44:10.313166+0000 mgr.gibba020.yqfnwy (mgr.34427) 2730 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:44:12.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:12 gibba013 bash[30381]: cephadm 2021-03-10T14:44:10.534213+0000 mgr.gibba020.yqfnwy (mgr.34427) 2731 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:44:12.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:12 gibba013 bash[30381]: cephadm 2021-03-10T14:44:10.536163+0000 mgr.gibba020.yqfnwy (mgr.34427) 2732 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:44:12.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:12 gibba013 bash[30381]: cephadm 2021-03-10T14:44:10.537516+0000 mgr.gibba020.yqfnwy (mgr.34427) 2733 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:44:12.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:12 gibba013 bash[30381]: cephadm 2021-03-10T14:44:10.537576+0000 mgr.gibba020.yqfnwy (mgr.34427) 2734 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:44:12.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:12 gibba013 bash[30381]: cephadm 2021-03-10T14:44:10.539087+0000 mgr.gibba020.yqfnwy (mgr.34427) 2735 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:44:12.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:12 gibba013 bash[30381]: cephadm 2021-03-10T14:44:10.539150+0000 mgr.gibba020.yqfnwy (mgr.34427) 2736 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:44:12.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:12 gibba013 bash[30381]: cephadm 2021-03-10T14:44:10.540466+0000 mgr.gibba020.yqfnwy (mgr.34427) 2737 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:44:12.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:12 gibba013 bash[30381]: cephadm 2021-03-10T14:44:10.542191+0000 mgr.gibba020.yqfnwy (mgr.34427) 2738 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:44:12.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:12 gibba013 bash[30381]: cephadm 2021-03-10T14:44:10.542266+0000 mgr.gibba020.yqfnwy (mgr.34427) 2739 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:44:12.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:12 gibba013 bash[30381]: cluster 2021-03-10T14:44:10.542301+0000 mgr.gibba020.yqfnwy (mgr.34427) 2740 : cluster [DBG] pgmap v1546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:12.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:12 gibba013 bash[30381]: cephadm 2021-03-10T14:44:10.544044+0000 mgr.gibba020.yqfnwy (mgr.34427) 2741 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:44:12.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:12 gibba013 bash[30381]: cephadm 2021-03-10T14:44:10.544396+0000 mgr.gibba020.yqfnwy (mgr.34427) 2742 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:44:12.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:12 gibba013 bash[30381]: cephadm 2021-03-10T14:44:10.546087+0000 mgr.gibba020.yqfnwy (mgr.34427) 2743 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:44:12.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:12 gibba013 bash[30381]: cephadm 2021-03-10T14:44:10.546175+0000 mgr.gibba020.yqfnwy (mgr.34427) 2744 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:44:12.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:12 gibba013 bash[30381]: cephadm 2021-03-10T14:44:10.546277+0000 mgr.gibba020.yqfnwy (mgr.34427) 2745 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:44:14.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:14 gibba013 bash[29418]: cluster 2021-03-10T14:44:12.543700+0000 mgr.gibba020.yqfnwy (mgr.34427) 2746 : cluster [DBG] pgmap v1547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:14.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:14 gibba013 bash[30381]: cluster 2021-03-10T14:44:12.543700+0000 mgr.gibba020.yqfnwy (mgr.34427) 2746 : cluster [DBG] pgmap v1547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:14.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:14 gibba020 bash[25448]: cluster 2021-03-10T14:44:12.543700+0000 mgr.gibba020.yqfnwy (mgr.34427) 2746 : cluster [DBG] pgmap v1547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:16.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:16 gibba013 bash[29418]: cluster 2021-03-10T14:44:14.545306+0000 mgr.gibba020.yqfnwy (mgr.34427) 2747 : cluster [DBG] pgmap v1548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:16.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:16 gibba013 bash[30381]: cluster 2021-03-10T14:44:14.545306+0000 mgr.gibba020.yqfnwy (mgr.34427) 2747 : cluster [DBG] pgmap v1548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:16.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:16 gibba020 bash[25448]: cluster 2021-03-10T14:44:14.545306+0000 mgr.gibba020.yqfnwy (mgr.34427) 2747 : cluster [DBG] pgmap v1548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:18.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:18 gibba013 bash[29418]: cluster 2021-03-10T14:44:16.546816+0000 mgr.gibba020.yqfnwy (mgr.34427) 2748 : cluster [DBG] pgmap v1549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:18.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:18 gibba013 bash[30381]: cluster 2021-03-10T14:44:16.546816+0000 mgr.gibba020.yqfnwy (mgr.34427) 2748 : cluster [DBG] pgmap v1549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:18.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:18 gibba020 bash[25448]: cluster 2021-03-10T14:44:16.546816+0000 mgr.gibba020.yqfnwy (mgr.34427) 2748 : cluster [DBG] pgmap v1549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:20.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:20 gibba013 bash[29418]: cluster 2021-03-10T14:44:18.548259+0000 mgr.gibba020.yqfnwy (mgr.34427) 2749 : cluster [DBG] pgmap v1550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:20.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:20 gibba013 bash[30381]: cluster 2021-03-10T14:44:18.548259+0000 mgr.gibba020.yqfnwy (mgr.34427) 2749 : cluster [DBG] pgmap v1550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:20.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:20 gibba020 bash[25448]: cluster 2021-03-10T14:44:18.548259+0000 mgr.gibba020.yqfnwy (mgr.34427) 2749 : cluster [DBG] pgmap v1550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:22.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:22 gibba013 bash[29418]: cluster 2021-03-10T14:44:20.549973+0000 mgr.gibba020.yqfnwy (mgr.34427) 2750 : cluster [DBG] pgmap v1551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:22.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:22 gibba013 bash[30381]: cluster 2021-03-10T14:44:20.549973+0000 mgr.gibba020.yqfnwy (mgr.34427) 2750 : cluster [DBG] pgmap v1551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:22.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:22 gibba020 bash[25448]: cluster 2021-03-10T14:44:20.549973+0000 mgr.gibba020.yqfnwy (mgr.34427) 2750 : cluster [DBG] pgmap v1551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:24.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:24 gibba013 bash[29418]: cluster 2021-03-10T14:44:22.551512+0000 mgr.gibba020.yqfnwy (mgr.34427) 2751 : cluster [DBG] pgmap v1552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:24.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:24 gibba013 bash[30381]: cluster 2021-03-10T14:44:22.551512+0000 mgr.gibba020.yqfnwy (mgr.34427) 2751 : cluster [DBG] pgmap v1552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:24.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:24 gibba020 bash[25448]: cluster 2021-03-10T14:44:22.551512+0000 mgr.gibba020.yqfnwy (mgr.34427) 2751 : cluster [DBG] pgmap v1552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:26.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:26 gibba013 bash[30381]: cluster 2021-03-10T14:44:24.553053+0000 mgr.gibba020.yqfnwy (mgr.34427) 2752 : cluster [DBG] pgmap v1553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:26.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:26 gibba013 bash[29418]: cluster 2021-03-10T14:44:24.553053+0000 mgr.gibba020.yqfnwy (mgr.34427) 2752 : cluster [DBG] pgmap v1553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:26.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:26 gibba020 bash[25448]: cluster 2021-03-10T14:44:24.553053+0000 mgr.gibba020.yqfnwy (mgr.34427) 2752 : cluster [DBG] pgmap v1553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:27.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:27 gibba013 bash[29418]: cephadm 2021-03-10T14:44:25.562261+0000 mgr.gibba020.yqfnwy (mgr.34427) 2753 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:44:27.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:27 gibba013 bash[30381]: cephadm 2021-03-10T14:44:25.562261+0000 mgr.gibba020.yqfnwy (mgr.34427) 2753 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:44:27.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:27 gibba020 bash[25448]: cephadm 2021-03-10T14:44:25.562261+0000 mgr.gibba020.yqfnwy (mgr.34427) 2753 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:44:28.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:28 gibba013 bash[29418]: cluster 2021-03-10T14:44:26.554818+0000 mgr.gibba020.yqfnwy (mgr.34427) 2754 : cluster [DBG] pgmap v1554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:28.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:28 gibba013 bash[30381]: cluster 2021-03-10T14:44:26.554818+0000 mgr.gibba020.yqfnwy (mgr.34427) 2754 : cluster [DBG] pgmap v1554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:28.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:28 gibba020 bash[25448]: cluster 2021-03-10T14:44:26.554818+0000 mgr.gibba020.yqfnwy (mgr.34427) 2754 : cluster [DBG] pgmap v1554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:30.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:30 gibba013 bash[29418]: cluster 2021-03-10T14:44:28.556212+0000 mgr.gibba020.yqfnwy (mgr.34427) 2755 : cluster [DBG] pgmap v1555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:30.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:30 gibba013 bash[30381]: cluster 2021-03-10T14:44:28.556212+0000 mgr.gibba020.yqfnwy (mgr.34427) 2755 : cluster [DBG] pgmap v1555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:30.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:30 gibba020 bash[25448]: cluster 2021-03-10T14:44:28.556212+0000 mgr.gibba020.yqfnwy (mgr.34427) 2755 : cluster [DBG] pgmap v1555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:32.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:32 gibba013 bash[29418]: cluster 2021-03-10T14:44:30.557953+0000 mgr.gibba020.yqfnwy (mgr.34427) 2756 : cluster [DBG] pgmap v1556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:32.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:32 gibba013 bash[30381]: cluster 2021-03-10T14:44:30.557953+0000 mgr.gibba020.yqfnwy (mgr.34427) 2756 : cluster [DBG] pgmap v1556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:32.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:32 gibba020 bash[25448]: cluster 2021-03-10T14:44:30.557953+0000 mgr.gibba020.yqfnwy (mgr.34427) 2756 : cluster [DBG] pgmap v1556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:33.794 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:44:34.021 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:44:34.021 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (51m) 6m ago 56m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:44:34.021 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (56m) 5m ago 56m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:44:34.022 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (51m) 5m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:44:34.022 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (51m) 5m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:44:34.022 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (50m) 6m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:44:34.022 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (50m) 6m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:44:34.023 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (50m) 5m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:44:34.023 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (50m) 6m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:44:34.023 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (56m) 6m ago 56m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:44:34.023 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (56m) 5m ago 56m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:44:34.023 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (49m) 6m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:44:34.024 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (48m) 6m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:44:34.024 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (48m) 6m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:44:34.024 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (48m) 6m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:44:34.024 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (47m) 5m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:44:34.024 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (47m) 5m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:44:34.025 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (46m) 5m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:44:34.025 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (46m) 5m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:44:34.025 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (55m) 5m ago 56m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:44:34.025 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 5m ago 54m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:44:34.272 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:44:34.272 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:44:34.272 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:44:34.273 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:44:34.273 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:44:34.273 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:44:34.273 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:44:34.274 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:44:34.274 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:44:34.274 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:44:34.274 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:44:34.274 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:44:34.275 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:44:34.275 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:44:34.275 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:44:34.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:34 gibba013 bash[29418]: cluster 2021-03-10T14:44:32.559456+0000 mgr.gibba020.yqfnwy (mgr.34427) 2757 : cluster [DBG] pgmap v1557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:34.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:34 gibba013 bash[29418]: audit 2021-03-10T14:44:34.270223+0000 mon.a (mon.0) 1380 : audit [DBG] from='client.? 172.21.2.113:0/1744921724' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:34.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:34 gibba013 bash[30381]: cluster 2021-03-10T14:44:32.559456+0000 mgr.gibba020.yqfnwy (mgr.34427) 2757 : cluster [DBG] pgmap v1557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:34.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:34 gibba013 bash[30381]: audit 2021-03-10T14:44:34.270223+0000 mon.a (mon.0) 1380 : audit [DBG] from='client.? 172.21.2.113:0/1744921724' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:34.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:34 gibba020 bash[25448]: cluster 2021-03-10T14:44:32.559456+0000 mgr.gibba020.yqfnwy (mgr.34427) 2757 : cluster [DBG] pgmap v1557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:34.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:34 gibba020 bash[25448]: audit 2021-03-10T14:44:34.270223+0000 mon.a (mon.0) 1380 : audit [DBG] from='client.? 172.21.2.113:0/1744921724' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:44:35.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:35 gibba013 bash[29418]: audit 2021-03-10T14:44:33.781967+0000 mgr.gibba020.yqfnwy (mgr.34427) 2758 : audit [DBG] from='client.45906 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:44:35.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:35 gibba013 bash[29418]: audit 2021-03-10T14:44:34.005342+0000 mgr.gibba020.yqfnwy (mgr.34427) 2759 : audit [DBG] from='client.45912 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:44:35.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:35 gibba013 bash[29418]: cluster 2021-03-10T14:44:34.560992+0000 mgr.gibba020.yqfnwy (mgr.34427) 2760 : cluster [DBG] pgmap v1558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:35.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:35 gibba013 bash[30381]: audit 2021-03-10T14:44:33.781967+0000 mgr.gibba020.yqfnwy (mgr.34427) 2758 : audit [DBG] from='client.45906 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:44:35.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:35 gibba013 bash[30381]: audit 2021-03-10T14:44:34.005342+0000 mgr.gibba020.yqfnwy (mgr.34427) 2759 : audit [DBG] from='client.45912 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:44:35.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:35 gibba013 bash[30381]: cluster 2021-03-10T14:44:34.560992+0000 mgr.gibba020.yqfnwy (mgr.34427) 2760 : cluster [DBG] pgmap v1558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:35.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:35 gibba020 bash[25448]: audit 2021-03-10T14:44:33.781967+0000 mgr.gibba020.yqfnwy (mgr.34427) 2758 : audit [DBG] from='client.45906 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:44:35.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:35 gibba020 bash[25448]: audit 2021-03-10T14:44:34.005342+0000 mgr.gibba020.yqfnwy (mgr.34427) 2759 : audit [DBG] from='client.45912 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:44:35.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:35 gibba020 bash[25448]: cluster 2021-03-10T14:44:34.560992+0000 mgr.gibba020.yqfnwy (mgr.34427) 2760 : cluster [DBG] pgmap v1558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:38.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:38 gibba013 bash[29418]: cluster 2021-03-10T14:44:36.562703+0000 mgr.gibba020.yqfnwy (mgr.34427) 2761 : cluster [DBG] pgmap v1559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:38.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:38 gibba013 bash[30381]: cluster 2021-03-10T14:44:36.562703+0000 mgr.gibba020.yqfnwy (mgr.34427) 2761 : cluster [DBG] pgmap v1559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:38.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:38 gibba020 bash[25448]: cluster 2021-03-10T14:44:36.562703+0000 mgr.gibba020.yqfnwy (mgr.34427) 2761 : cluster [DBG] pgmap v1559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:40.575 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:40 gibba020 bash[25448]: cluster 2021-03-10T14:44:38.564139+0000 mgr.gibba020.yqfnwy (mgr.34427) 2762 : cluster [DBG] pgmap v1560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:40.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:40 gibba013 bash[29418]: cluster 2021-03-10T14:44:38.564139+0000 mgr.gibba020.yqfnwy (mgr.34427) 2762 : cluster [DBG] pgmap v1560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:40.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:40 gibba013 bash[30381]: cluster 2021-03-10T14:44:38.564139+0000 mgr.gibba020.yqfnwy (mgr.34427) 2762 : cluster [DBG] pgmap v1560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:42.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:42 gibba013 bash[29418]: cluster 2021-03-10T14:44:40.565726+0000 mgr.gibba020.yqfnwy (mgr.34427) 2763 : cluster [DBG] pgmap v1561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:42.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:42 gibba013 bash[29418]: cephadm 2021-03-10T14:44:40.572570+0000 mgr.gibba020.yqfnwy (mgr.34427) 2764 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:44:42.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:42 gibba013 bash[30381]: cluster 2021-03-10T14:44:40.565726+0000 mgr.gibba020.yqfnwy (mgr.34427) 2763 : cluster [DBG] pgmap v1561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:42.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:42 gibba013 bash[30381]: cephadm 2021-03-10T14:44:40.572570+0000 mgr.gibba020.yqfnwy (mgr.34427) 2764 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:44:42.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:42 gibba020 bash[25448]: cluster 2021-03-10T14:44:40.565726+0000 mgr.gibba020.yqfnwy (mgr.34427) 2763 : cluster [DBG] pgmap v1561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:42.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:42 gibba020 bash[25448]: cephadm 2021-03-10T14:44:40.572570+0000 mgr.gibba020.yqfnwy (mgr.34427) 2764 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:44:44.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:44 gibba013 bash[29418]: cluster 2021-03-10T14:44:42.567173+0000 mgr.gibba020.yqfnwy (mgr.34427) 2765 : cluster [DBG] pgmap v1562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:44.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:44 gibba013 bash[30381]: cluster 2021-03-10T14:44:42.567173+0000 mgr.gibba020.yqfnwy (mgr.34427) 2765 : cluster [DBG] pgmap v1562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:44.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:44 gibba020 bash[25448]: cluster 2021-03-10T14:44:42.567173+0000 mgr.gibba020.yqfnwy (mgr.34427) 2765 : cluster [DBG] pgmap v1562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:46.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:46 gibba013 bash[29418]: cluster 2021-03-10T14:44:44.568893+0000 mgr.gibba020.yqfnwy (mgr.34427) 2766 : cluster [DBG] pgmap v1563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:46.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:46 gibba013 bash[30381]: cluster 2021-03-10T14:44:44.568893+0000 mgr.gibba020.yqfnwy (mgr.34427) 2766 : cluster [DBG] pgmap v1563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:46.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:46 gibba020 bash[25448]: cluster 2021-03-10T14:44:44.568893+0000 mgr.gibba020.yqfnwy (mgr.34427) 2766 : cluster [DBG] pgmap v1563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:48.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:48 gibba013 bash[29418]: cluster 2021-03-10T14:44:46.570686+0000 mgr.gibba020.yqfnwy (mgr.34427) 2767 : cluster [DBG] pgmap v1564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:48.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:48 gibba013 bash[30381]: cluster 2021-03-10T14:44:46.570686+0000 mgr.gibba020.yqfnwy (mgr.34427) 2767 : cluster [DBG] pgmap v1564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:48.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:48 gibba020 bash[25448]: cluster 2021-03-10T14:44:46.570686+0000 mgr.gibba020.yqfnwy (mgr.34427) 2767 : cluster [DBG] pgmap v1564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:50.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:50 gibba013 bash[29418]: cluster 2021-03-10T14:44:48.572338+0000 mgr.gibba020.yqfnwy (mgr.34427) 2768 : cluster [DBG] pgmap v1565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:50.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:50 gibba013 bash[30381]: cluster 2021-03-10T14:44:48.572338+0000 mgr.gibba020.yqfnwy (mgr.34427) 2768 : cluster [DBG] pgmap v1565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:50.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:50 gibba020 bash[25448]: cluster 2021-03-10T14:44:48.572338+0000 mgr.gibba020.yqfnwy (mgr.34427) 2768 : cluster [DBG] pgmap v1565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:52.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:52 gibba013 bash[29418]: cluster 2021-03-10T14:44:50.574078+0000 mgr.gibba020.yqfnwy (mgr.34427) 2769 : cluster [DBG] pgmap v1566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:52.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:52 gibba013 bash[30381]: cluster 2021-03-10T14:44:50.574078+0000 mgr.gibba020.yqfnwy (mgr.34427) 2769 : cluster [DBG] pgmap v1566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:52.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:52 gibba020 bash[25448]: cluster 2021-03-10T14:44:50.574078+0000 mgr.gibba020.yqfnwy (mgr.34427) 2769 : cluster [DBG] pgmap v1566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:54.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:54 gibba013 bash[29418]: cluster 2021-03-10T14:44:52.575654+0000 mgr.gibba020.yqfnwy (mgr.34427) 2770 : cluster [DBG] pgmap v1567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:54.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:54 gibba013 bash[30381]: cluster 2021-03-10T14:44:52.575654+0000 mgr.gibba020.yqfnwy (mgr.34427) 2770 : cluster [DBG] pgmap v1567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:54.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:54 gibba020 bash[25448]: cluster 2021-03-10T14:44:52.575654+0000 mgr.gibba020.yqfnwy (mgr.34427) 2770 : cluster [DBG] pgmap v1567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:56.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:56 gibba013 bash[29418]: cluster 2021-03-10T14:44:54.577266+0000 mgr.gibba020.yqfnwy (mgr.34427) 2771 : cluster [DBG] pgmap v1568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:56.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:56 gibba013 bash[30381]: cluster 2021-03-10T14:44:54.577266+0000 mgr.gibba020.yqfnwy (mgr.34427) 2771 : cluster [DBG] pgmap v1568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:56.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:56 gibba020 bash[25448]: cluster 2021-03-10T14:44:54.577266+0000 mgr.gibba020.yqfnwy (mgr.34427) 2771 : cluster [DBG] pgmap v1568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:57.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:57 gibba013 bash[29418]: cephadm 2021-03-10T14:44:55.588659+0000 mgr.gibba020.yqfnwy (mgr.34427) 2772 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:44:57.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:57 gibba013 bash[30381]: cephadm 2021-03-10T14:44:55.588659+0000 mgr.gibba020.yqfnwy (mgr.34427) 2772 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:44:57.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:57 gibba020 bash[25448]: cephadm 2021-03-10T14:44:55.588659+0000 mgr.gibba020.yqfnwy (mgr.34427) 2772 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:44:58.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:58 gibba013 bash[29418]: cluster 2021-03-10T14:44:56.578922+0000 mgr.gibba020.yqfnwy (mgr.34427) 2773 : cluster [DBG] pgmap v1569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:58.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:58 gibba013 bash[30381]: cluster 2021-03-10T14:44:56.578922+0000 mgr.gibba020.yqfnwy (mgr.34427) 2773 : cluster [DBG] pgmap v1569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:58.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:58 gibba020 bash[25448]: cluster 2021-03-10T14:44:56.578922+0000 mgr.gibba020.yqfnwy (mgr.34427) 2773 : cluster [DBG] pgmap v1569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:59.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:44:59 gibba013 bash[29418]: cluster 2021-03-10T14:44:58.580303+0000 mgr.gibba020.yqfnwy (mgr.34427) 2774 : cluster [DBG] pgmap v1570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:59.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:44:59 gibba013 bash[30381]: cluster 2021-03-10T14:44:58.580303+0000 mgr.gibba020.yqfnwy (mgr.34427) 2774 : cluster [DBG] pgmap v1570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:44:59.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:44:59 gibba020 bash[25448]: cluster 2021-03-10T14:44:58.580303+0000 mgr.gibba020.yqfnwy (mgr.34427) 2774 : cluster [DBG] pgmap v1570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:02.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:02 gibba013 bash[29418]: cluster 2021-03-10T14:45:00.582040+0000 mgr.gibba020.yqfnwy (mgr.34427) 2775 : cluster [DBG] pgmap v1571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:02.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:02 gibba013 bash[30381]: cluster 2021-03-10T14:45:00.582040+0000 mgr.gibba020.yqfnwy (mgr.34427) 2775 : cluster [DBG] pgmap v1571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:02.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:02 gibba020 bash[25448]: cluster 2021-03-10T14:45:00.582040+0000 mgr.gibba020.yqfnwy (mgr.34427) 2775 : cluster [DBG] pgmap v1571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:04.516 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:45:04.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:04 gibba013 bash[29418]: cluster 2021-03-10T14:45:02.583314+0000 mgr.gibba020.yqfnwy (mgr.34427) 2776 : cluster [DBG] pgmap v1572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:04.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:04 gibba013 bash[30381]: cluster 2021-03-10T14:45:02.583314+0000 mgr.gibba020.yqfnwy (mgr.34427) 2776 : cluster [DBG] pgmap v1572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:04.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:04 gibba020 bash[25448]: cluster 2021-03-10T14:45:02.583314+0000 mgr.gibba020.yqfnwy (mgr.34427) 2776 : cluster [DBG] pgmap v1572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:04.745 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:45:04.745 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (51m) 6m ago 56m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:45:04.745 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (56m) 5m ago 56m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:45:04.745 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (51m) 5m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:45:04.746 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (52m) 5m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:45:04.746 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (51m) 6m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:45:04.746 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (51m) 6m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:45:04.746 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (50m) 5m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:45:04.746 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (50m) 6m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:45:04.747 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (57m) 6m ago 57m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:45:04.747 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (57m) 5m ago 57m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:45:04.747 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (49m) 6m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:45:04.747 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (49m) 6m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:45:04.747 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (48m) 6m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:45:04.748 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (48m) 6m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:45:04.748 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (48m) 5m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:45:04.748 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (47m) 5m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:45:04.748 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (47m) 5m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:45:04.749 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (46m) 5m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:45:04.749 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (56m) 5m ago 57m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:45:04.749 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 5m ago 55m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:45:04.994 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:45:04.994 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:45:04.995 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:45:04.995 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:45:04.995 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:45:04.995 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:45:04.996 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:45:04.996 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:45:04.996 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:45:04.996 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:45:04.996 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:45:04.997 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:45:04.997 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:45:04.997 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:45:04.997 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:45:05.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:05 gibba013 bash[29418]: audit 2021-03-10T14:45:04.992527+0000 mon.a (mon.0) 1381 : audit [DBG] from='client.? 172.21.2.113:0/2474811961' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:05.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:05 gibba013 bash[30381]: audit 2021-03-10T14:45:04.992527+0000 mon.a (mon.0) 1381 : audit [DBG] from='client.? 172.21.2.113:0/2474811961' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:05.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:05 gibba020 bash[25448]: audit 2021-03-10T14:45:04.992527+0000 mon.a (mon.0) 1381 : audit [DBG] from='client.? 172.21.2.113:0/2474811961' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:06.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:06 gibba013 bash[29418]: audit 2021-03-10T14:45:04.504531+0000 mgr.gibba020.yqfnwy (mgr.34427) 2777 : audit [DBG] from='client.45924 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:45:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:06 gibba013 bash[29418]: cluster 2021-03-10T14:45:04.584846+0000 mgr.gibba020.yqfnwy (mgr.34427) 2778 : cluster [DBG] pgmap v1573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:06 gibba013 bash[29418]: audit 2021-03-10T14:45:04.729399+0000 mgr.gibba020.yqfnwy (mgr.34427) 2779 : audit [DBG] from='client.45930 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:45:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:06 gibba013 bash[29418]: audit 2021-03-10T14:45:06.223867+0000 mon.a (mon.0) 1382 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:45:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:06 gibba013 bash[29418]: audit 2021-03-10T14:45:06.224021+0000 mon.a (mon.0) 1383 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:45:06.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:06 gibba013 bash[29418]: audit 2021-03-10T14:45:06.224151+0000 mon.a (mon.0) 1384 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:45:06.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:06 gibba013 bash[29418]: audit 2021-03-10T14:45:06.224283+0000 mon.a (mon.0) 1385 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:45:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:06 gibba013 bash[30381]: audit 2021-03-10T14:45:04.504531+0000 mgr.gibba020.yqfnwy (mgr.34427) 2777 : audit [DBG] from='client.45924 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:45:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:06 gibba013 bash[30381]: cluster 2021-03-10T14:45:04.584846+0000 mgr.gibba020.yqfnwy (mgr.34427) 2778 : cluster [DBG] pgmap v1573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:06.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:06 gibba013 bash[30381]: audit 2021-03-10T14:45:04.729399+0000 mgr.gibba020.yqfnwy (mgr.34427) 2779 : audit [DBG] from='client.45930 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:45:06.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:06 gibba013 bash[30381]: audit 2021-03-10T14:45:06.223867+0000 mon.a (mon.0) 1382 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:45:06.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:06 gibba013 bash[30381]: audit 2021-03-10T14:45:06.224021+0000 mon.a (mon.0) 1383 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:45:06.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:06 gibba013 bash[30381]: audit 2021-03-10T14:45:06.224151+0000 mon.a (mon.0) 1384 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:45:06.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:06 gibba013 bash[30381]: audit 2021-03-10T14:45:06.224283+0000 mon.a (mon.0) 1385 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:45:06.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:06 gibba020 bash[25448]: audit 2021-03-10T14:45:04.504531+0000 mgr.gibba020.yqfnwy (mgr.34427) 2777 : audit [DBG] from='client.45924 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:45:06.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:06 gibba020 bash[25448]: cluster 2021-03-10T14:45:04.584846+0000 mgr.gibba020.yqfnwy (mgr.34427) 2778 : cluster [DBG] pgmap v1573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:06 gibba020 bash[25448]: audit 2021-03-10T14:45:04.729399+0000 mgr.gibba020.yqfnwy (mgr.34427) 2779 : audit [DBG] from='client.45930 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:45:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:06 gibba020 bash[25448]: audit 2021-03-10T14:45:06.223867+0000 mon.a (mon.0) 1382 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T14:45:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:06 gibba020 bash[25448]: audit 2021-03-10T14:45:06.224021+0000 mon.a (mon.0) 1383 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:45:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:06 gibba020 bash[25448]: audit 2021-03-10T14:45:06.224151+0000 mon.a (mon.0) 1384 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:45:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:06 gibba020 bash[25448]: audit 2021-03-10T14:45:06.224283+0000 mon.a (mon.0) 1385 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:45:07.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:07 gibba013 bash[29418]: audit 2021-03-10T14:45:06.248832+0000 mon.a (mon.0) 1386 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:45:07.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:07 gibba013 bash[29418]: audit 2021-03-10T14:45:06.251578+0000 mon.a (mon.0) 1387 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:45:07.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:07 gibba013 bash[30381]: audit 2021-03-10T14:45:06.248832+0000 mon.a (mon.0) 1386 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:45:07.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:07 gibba013 bash[30381]: audit 2021-03-10T14:45:06.251578+0000 mon.a (mon.0) 1387 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:45:07.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:07 gibba020 bash[25448]: audit 2021-03-10T14:45:06.248832+0000 mon.a (mon.0) 1386 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:45:07.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:07 gibba020 bash[25448]: audit 2021-03-10T14:45:06.251578+0000 mon.a (mon.0) 1387 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:45:08.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:08 gibba013 bash[29418]: cluster 2021-03-10T14:45:06.586584+0000 mgr.gibba020.yqfnwy (mgr.34427) 2780 : cluster [DBG] pgmap v1574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:08.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:08 gibba013 bash[30381]: cluster 2021-03-10T14:45:06.586584+0000 mgr.gibba020.yqfnwy (mgr.34427) 2780 : cluster [DBG] pgmap v1574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:08.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:08 gibba020 bash[25448]: cluster 2021-03-10T14:45:06.586584+0000 mgr.gibba020.yqfnwy (mgr.34427) 2780 : cluster [DBG] pgmap v1574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:10.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:10 gibba013 bash[29418]: cluster 2021-03-10T14:45:08.588249+0000 mgr.gibba020.yqfnwy (mgr.34427) 2781 : cluster [DBG] pgmap v1575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:10.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:10 gibba013 bash[30381]: cluster 2021-03-10T14:45:08.588249+0000 mgr.gibba020.yqfnwy (mgr.34427) 2781 : cluster [DBG] pgmap v1575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:10.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:10 gibba020 bash[25448]: cluster 2021-03-10T14:45:08.588249+0000 mgr.gibba020.yqfnwy (mgr.34427) 2781 : cluster [DBG] pgmap v1575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:11.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:11 gibba020 bash[25448]: audit 2021-03-10T14:45:10.606748+0000 mon.a (mon.0) 1388 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:45:11.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:11 gibba020 bash[25448]: audit 2021-03-10T14:45:10.812335+0000 mon.a (mon.0) 1389 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:45:11.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:11 gibba020 bash[25448]: audit 2021-03-10T14:45:10.818091+0000 mon.a (mon.0) 1390 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:45:11.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:11 gibba020 bash[25448]: audit 2021-03-10T14:45:11.019215+0000 mon.a (mon.0) 1391 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:45:11.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:11 gibba020 bash[25448]: audit 2021-03-10T14:45:11.022362+0000 mon.a (mon.0) 1392 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:45:11.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:11 gibba020 bash[25448]: audit 2021-03-10T14:45:11.024344+0000 mon.a (mon.0) 1393 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:11.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:11 gibba020 bash[25448]: audit 2021-03-10T14:45:11.026292+0000 mon.a (mon.0) 1394 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:11.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:11 gibba020 bash[25448]: audit 2021-03-10T14:45:11.028066+0000 mon.a (mon.0) 1395 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:11.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:11 gibba020 bash[25448]: audit 2021-03-10T14:45:11.031102+0000 mon.a (mon.0) 1396 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:11.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:11 gibba020 bash[25448]: audit 2021-03-10T14:45:11.032775+0000 mon.a (mon.0) 1397 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:11.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:11 gibba013 bash[29418]: audit 2021-03-10T14:45:10.606748+0000 mon.a (mon.0) 1388 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:45:11.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:11 gibba013 bash[29418]: audit 2021-03-10T14:45:10.812335+0000 mon.a (mon.0) 1389 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:45:11.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:11 gibba013 bash[29418]: audit 2021-03-10T14:45:10.818091+0000 mon.a (mon.0) 1390 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:45:11.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:11 gibba013 bash[29418]: audit 2021-03-10T14:45:11.019215+0000 mon.a (mon.0) 1391 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:45:11.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:11 gibba013 bash[29418]: audit 2021-03-10T14:45:11.022362+0000 mon.a (mon.0) 1392 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:45:11.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:11 gibba013 bash[29418]: audit 2021-03-10T14:45:11.024344+0000 mon.a (mon.0) 1393 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:11.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:11 gibba013 bash[29418]: audit 2021-03-10T14:45:11.026292+0000 mon.a (mon.0) 1394 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:11.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:11 gibba013 bash[29418]: audit 2021-03-10T14:45:11.028066+0000 mon.a (mon.0) 1395 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:11.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:11 gibba013 bash[29418]: audit 2021-03-10T14:45:11.031102+0000 mon.a (mon.0) 1396 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:11.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:11 gibba013 bash[29418]: audit 2021-03-10T14:45:11.032775+0000 mon.a (mon.0) 1397 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:11.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:11 gibba013 bash[30381]: audit 2021-03-10T14:45:10.606748+0000 mon.a (mon.0) 1388 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:45:11.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:11 gibba013 bash[30381]: audit 2021-03-10T14:45:10.812335+0000 mon.a (mon.0) 1389 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:45:11.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:11 gibba013 bash[30381]: audit 2021-03-10T14:45:10.818091+0000 mon.a (mon.0) 1390 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:45:11.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:11 gibba013 bash[30381]: audit 2021-03-10T14:45:11.019215+0000 mon.a (mon.0) 1391 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:45:11.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:11 gibba013 bash[30381]: audit 2021-03-10T14:45:11.022362+0000 mon.a (mon.0) 1392 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:45:11.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:11 gibba013 bash[30381]: audit 2021-03-10T14:45:11.024344+0000 mon.a (mon.0) 1393 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:11.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:11 gibba013 bash[30381]: audit 2021-03-10T14:45:11.026292+0000 mon.a (mon.0) 1394 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:11.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:11 gibba013 bash[30381]: audit 2021-03-10T14:45:11.028066+0000 mon.a (mon.0) 1395 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:11.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:11 gibba013 bash[30381]: audit 2021-03-10T14:45:11.031102+0000 mon.a (mon.0) 1396 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:11.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:11 gibba013 bash[30381]: audit 2021-03-10T14:45:11.032775+0000 mon.a (mon.0) 1397 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:12.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:12 gibba013 bash[29418]: cluster 2021-03-10T14:45:10.589948+0000 mgr.gibba020.yqfnwy (mgr.34427) 2782 : cluster [DBG] pgmap v1576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:12.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:12 gibba013 bash[29418]: cephadm 2021-03-10T14:45:10.812084+0000 mgr.gibba020.yqfnwy (mgr.34427) 2783 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:45:12.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:12 gibba013 bash[29418]: cephadm 2021-03-10T14:45:10.817801+0000 mgr.gibba020.yqfnwy (mgr.34427) 2784 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:45:12.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:12 gibba013 bash[29418]: cephadm 2021-03-10T14:45:11.020745+0000 mgr.gibba020.yqfnwy (mgr.34427) 2785 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:45:12.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:12 gibba013 bash[29418]: cephadm 2021-03-10T14:45:11.022764+0000 mgr.gibba020.yqfnwy (mgr.34427) 2786 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:45:12.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:12 gibba013 bash[29418]: cephadm 2021-03-10T14:45:11.024847+0000 mgr.gibba020.yqfnwy (mgr.34427) 2787 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:45:12.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:12 gibba013 bash[29418]: cephadm 2021-03-10T14:45:11.024909+0000 mgr.gibba020.yqfnwy (mgr.34427) 2788 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:45:12.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:12 gibba013 bash[29418]: cephadm 2021-03-10T14:45:11.026506+0000 mgr.gibba020.yqfnwy (mgr.34427) 2789 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:45:12.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:12 gibba013 bash[29418]: cephadm 2021-03-10T14:45:11.026566+0000 mgr.gibba020.yqfnwy (mgr.34427) 2790 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:45:12.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:12 gibba013 bash[29418]: cephadm 2021-03-10T14:45:11.028192+0000 mgr.gibba020.yqfnwy (mgr.34427) 2791 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:45:12.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:12 gibba013 bash[29418]: cephadm 2021-03-10T14:45:11.029586+0000 mgr.gibba020.yqfnwy (mgr.34427) 2792 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:45:12.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:12 gibba013 bash[29418]: cephadm 2021-03-10T14:45:11.029646+0000 mgr.gibba020.yqfnwy (mgr.34427) 2793 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:45:12.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:12 gibba013 bash[29418]: cephadm 2021-03-10T14:45:11.031168+0000 mgr.gibba020.yqfnwy (mgr.34427) 2794 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:45:12.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:12 gibba013 bash[29418]: cephadm 2021-03-10T14:45:11.031498+0000 mgr.gibba020.yqfnwy (mgr.34427) 2795 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:45:12.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:12 gibba013 bash[29418]: cephadm 2021-03-10T14:45:11.033016+0000 mgr.gibba020.yqfnwy (mgr.34427) 2796 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:45:12.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:12 gibba013 bash[29418]: cephadm 2021-03-10T14:45:11.033075+0000 mgr.gibba020.yqfnwy (mgr.34427) 2797 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:45:12.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:12 gibba013 bash[29418]: cephadm 2021-03-10T14:45:11.033195+0000 mgr.gibba020.yqfnwy (mgr.34427) 2798 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:45:12.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:12 gibba013 bash[30381]: cluster 2021-03-10T14:45:10.589948+0000 mgr.gibba020.yqfnwy (mgr.34427) 2782 : cluster [DBG] pgmap v1576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:12.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:12 gibba013 bash[30381]: cephadm 2021-03-10T14:45:10.812084+0000 mgr.gibba020.yqfnwy (mgr.34427) 2783 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:45:12.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:12 gibba013 bash[30381]: cephadm 2021-03-10T14:45:10.817801+0000 mgr.gibba020.yqfnwy (mgr.34427) 2784 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:45:12.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:12 gibba013 bash[30381]: cephadm 2021-03-10T14:45:11.020745+0000 mgr.gibba020.yqfnwy (mgr.34427) 2785 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:45:12.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:12 gibba013 bash[30381]: cephadm 2021-03-10T14:45:11.022764+0000 mgr.gibba020.yqfnwy (mgr.34427) 2786 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:45:12.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:12 gibba013 bash[30381]: cephadm 2021-03-10T14:45:11.024847+0000 mgr.gibba020.yqfnwy (mgr.34427) 2787 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:45:12.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:12 gibba013 bash[30381]: cephadm 2021-03-10T14:45:11.024909+0000 mgr.gibba020.yqfnwy (mgr.34427) 2788 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:45:12.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:12 gibba013 bash[30381]: cephadm 2021-03-10T14:45:11.026506+0000 mgr.gibba020.yqfnwy (mgr.34427) 2789 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:45:12.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:12 gibba013 bash[30381]: cephadm 2021-03-10T14:45:11.026566+0000 mgr.gibba020.yqfnwy (mgr.34427) 2790 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:45:12.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:12 gibba013 bash[30381]: cephadm 2021-03-10T14:45:11.028192+0000 mgr.gibba020.yqfnwy (mgr.34427) 2791 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:45:12.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:12 gibba013 bash[30381]: cephadm 2021-03-10T14:45:11.029586+0000 mgr.gibba020.yqfnwy (mgr.34427) 2792 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:45:12.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:12 gibba013 bash[30381]: cephadm 2021-03-10T14:45:11.029646+0000 mgr.gibba020.yqfnwy (mgr.34427) 2793 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:45:12.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:12 gibba013 bash[30381]: cephadm 2021-03-10T14:45:11.031168+0000 mgr.gibba020.yqfnwy (mgr.34427) 2794 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:45:12.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:12 gibba013 bash[30381]: cephadm 2021-03-10T14:45:11.031498+0000 mgr.gibba020.yqfnwy (mgr.34427) 2795 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:45:12.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:12 gibba013 bash[30381]: cephadm 2021-03-10T14:45:11.033016+0000 mgr.gibba020.yqfnwy (mgr.34427) 2796 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:45:12.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:12 gibba013 bash[30381]: cephadm 2021-03-10T14:45:11.033075+0000 mgr.gibba020.yqfnwy (mgr.34427) 2797 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:45:12.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:12 gibba013 bash[30381]: cephadm 2021-03-10T14:45:11.033195+0000 mgr.gibba020.yqfnwy (mgr.34427) 2798 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:45:12.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:12 gibba020 bash[25448]: cluster 2021-03-10T14:45:10.589948+0000 mgr.gibba020.yqfnwy (mgr.34427) 2782 : cluster [DBG] pgmap v1576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:12.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:12 gibba020 bash[25448]: cephadm 2021-03-10T14:45:10.812084+0000 mgr.gibba020.yqfnwy (mgr.34427) 2783 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:45:12.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:12 gibba020 bash[25448]: cephadm 2021-03-10T14:45:10.817801+0000 mgr.gibba020.yqfnwy (mgr.34427) 2784 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:45:12.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:12 gibba020 bash[25448]: cephadm 2021-03-10T14:45:11.020745+0000 mgr.gibba020.yqfnwy (mgr.34427) 2785 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:45:12.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:12 gibba020 bash[25448]: cephadm 2021-03-10T14:45:11.022764+0000 mgr.gibba020.yqfnwy (mgr.34427) 2786 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:45:12.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:12 gibba020 bash[25448]: cephadm 2021-03-10T14:45:11.024847+0000 mgr.gibba020.yqfnwy (mgr.34427) 2787 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:45:12.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:12 gibba020 bash[25448]: cephadm 2021-03-10T14:45:11.024909+0000 mgr.gibba020.yqfnwy (mgr.34427) 2788 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:45:12.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:12 gibba020 bash[25448]: cephadm 2021-03-10T14:45:11.026506+0000 mgr.gibba020.yqfnwy (mgr.34427) 2789 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:45:12.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:12 gibba020 bash[25448]: cephadm 2021-03-10T14:45:11.026566+0000 mgr.gibba020.yqfnwy (mgr.34427) 2790 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:45:12.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:12 gibba020 bash[25448]: cephadm 2021-03-10T14:45:11.028192+0000 mgr.gibba020.yqfnwy (mgr.34427) 2791 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:45:12.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:12 gibba020 bash[25448]: cephadm 2021-03-10T14:45:11.029586+0000 mgr.gibba020.yqfnwy (mgr.34427) 2792 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:45:12.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:12 gibba020 bash[25448]: cephadm 2021-03-10T14:45:11.029646+0000 mgr.gibba020.yqfnwy (mgr.34427) 2793 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:45:12.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:12 gibba020 bash[25448]: cephadm 2021-03-10T14:45:11.031168+0000 mgr.gibba020.yqfnwy (mgr.34427) 2794 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:45:12.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:12 gibba020 bash[25448]: cephadm 2021-03-10T14:45:11.031498+0000 mgr.gibba020.yqfnwy (mgr.34427) 2795 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:45:12.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:12 gibba020 bash[25448]: cephadm 2021-03-10T14:45:11.033016+0000 mgr.gibba020.yqfnwy (mgr.34427) 2796 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:45:12.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:12 gibba020 bash[25448]: cephadm 2021-03-10T14:45:11.033075+0000 mgr.gibba020.yqfnwy (mgr.34427) 2797 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:45:12.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:12 gibba020 bash[25448]: cephadm 2021-03-10T14:45:11.033195+0000 mgr.gibba020.yqfnwy (mgr.34427) 2798 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:45:14.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:14 gibba013 bash[29418]: cluster 2021-03-10T14:45:12.591452+0000 mgr.gibba020.yqfnwy (mgr.34427) 2799 : cluster [DBG] pgmap v1577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:14.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:14 gibba013 bash[30381]: cluster 2021-03-10T14:45:12.591452+0000 mgr.gibba020.yqfnwy (mgr.34427) 2799 : cluster [DBG] pgmap v1577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:14.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:14 gibba020 bash[25448]: cluster 2021-03-10T14:45:12.591452+0000 mgr.gibba020.yqfnwy (mgr.34427) 2799 : cluster [DBG] pgmap v1577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:16.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:16 gibba013 bash[29418]: cluster 2021-03-10T14:45:14.592841+0000 mgr.gibba020.yqfnwy (mgr.34427) 2800 : cluster [DBG] pgmap v1578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:16.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:16 gibba013 bash[30381]: cluster 2021-03-10T14:45:14.592841+0000 mgr.gibba020.yqfnwy (mgr.34427) 2800 : cluster [DBG] pgmap v1578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:16.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:16 gibba020 bash[25448]: cluster 2021-03-10T14:45:14.592841+0000 mgr.gibba020.yqfnwy (mgr.34427) 2800 : cluster [DBG] pgmap v1578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:17.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:17 gibba013 bash[29418]: cluster 2021-03-10T14:45:16.594438+0000 mgr.gibba020.yqfnwy (mgr.34427) 2801 : cluster [DBG] pgmap v1579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:17.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:17 gibba013 bash[30381]: cluster 2021-03-10T14:45:16.594438+0000 mgr.gibba020.yqfnwy (mgr.34427) 2801 : cluster [DBG] pgmap v1579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:17.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:17 gibba020 bash[25448]: cluster 2021-03-10T14:45:16.594438+0000 mgr.gibba020.yqfnwy (mgr.34427) 2801 : cluster [DBG] pgmap v1579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:19.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:19 gibba020 bash[25448]: cluster 2021-03-10T14:45:18.595814+0000 mgr.gibba020.yqfnwy (mgr.34427) 2802 : cluster [DBG] pgmap v1580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:20.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:19 gibba013 bash[29418]: cluster 2021-03-10T14:45:18.595814+0000 mgr.gibba020.yqfnwy (mgr.34427) 2802 : cluster [DBG] pgmap v1580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:20.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:19 gibba013 bash[30381]: cluster 2021-03-10T14:45:18.595814+0000 mgr.gibba020.yqfnwy (mgr.34427) 2802 : cluster [DBG] pgmap v1580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:22.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:22 gibba013 bash[29418]: cluster 2021-03-10T14:45:20.597365+0000 mgr.gibba020.yqfnwy (mgr.34427) 2803 : cluster [DBG] pgmap v1581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:22.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:22 gibba013 bash[30381]: cluster 2021-03-10T14:45:20.597365+0000 mgr.gibba020.yqfnwy (mgr.34427) 2803 : cluster [DBG] pgmap v1581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:22.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:22 gibba020 bash[25448]: cluster 2021-03-10T14:45:20.597365+0000 mgr.gibba020.yqfnwy (mgr.34427) 2803 : cluster [DBG] pgmap v1581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:24.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:24 gibba013 bash[29418]: cluster 2021-03-10T14:45:22.598859+0000 mgr.gibba020.yqfnwy (mgr.34427) 2804 : cluster [DBG] pgmap v1582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:24.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:24 gibba013 bash[30381]: cluster 2021-03-10T14:45:22.598859+0000 mgr.gibba020.yqfnwy (mgr.34427) 2804 : cluster [DBG] pgmap v1582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:24.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:24 gibba020 bash[25448]: cluster 2021-03-10T14:45:22.598859+0000 mgr.gibba020.yqfnwy (mgr.34427) 2804 : cluster [DBG] pgmap v1582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:26.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:26 gibba020 bash[25448]: cluster 2021-03-10T14:45:24.600394+0000 mgr.gibba020.yqfnwy (mgr.34427) 2805 : cluster [DBG] pgmap v1583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:26.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:26 gibba013 bash[29418]: cluster 2021-03-10T14:45:24.600394+0000 mgr.gibba020.yqfnwy (mgr.34427) 2805 : cluster [DBG] pgmap v1583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:26.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:26 gibba013 bash[30381]: cluster 2021-03-10T14:45:24.600394+0000 mgr.gibba020.yqfnwy (mgr.34427) 2805 : cluster [DBG] pgmap v1583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:27.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:27 gibba013 bash[29418]: cephadm 2021-03-10T14:45:26.049224+0000 mgr.gibba020.yqfnwy (mgr.34427) 2806 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:45:27.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:27 gibba013 bash[30381]: cephadm 2021-03-10T14:45:26.049224+0000 mgr.gibba020.yqfnwy (mgr.34427) 2806 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:45:27.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:27 gibba020 bash[25448]: cephadm 2021-03-10T14:45:26.049224+0000 mgr.gibba020.yqfnwy (mgr.34427) 2806 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:45:28.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:28 gibba013 bash[29418]: cluster 2021-03-10T14:45:26.602071+0000 mgr.gibba020.yqfnwy (mgr.34427) 2807 : cluster [DBG] pgmap v1584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:28.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:28 gibba013 bash[30381]: cluster 2021-03-10T14:45:26.602071+0000 mgr.gibba020.yqfnwy (mgr.34427) 2807 : cluster [DBG] pgmap v1584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:28.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:28 gibba020 bash[25448]: cluster 2021-03-10T14:45:26.602071+0000 mgr.gibba020.yqfnwy (mgr.34427) 2807 : cluster [DBG] pgmap v1584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:30.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:30 gibba013 bash[29418]: cluster 2021-03-10T14:45:28.603473+0000 mgr.gibba020.yqfnwy (mgr.34427) 2808 : cluster [DBG] pgmap v1585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:30.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:30 gibba013 bash[30381]: cluster 2021-03-10T14:45:28.603473+0000 mgr.gibba020.yqfnwy (mgr.34427) 2808 : cluster [DBG] pgmap v1585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:30.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:30 gibba020 bash[25448]: cluster 2021-03-10T14:45:28.603473+0000 mgr.gibba020.yqfnwy (mgr.34427) 2808 : cluster [DBG] pgmap v1585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:32.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:32 gibba013 bash[29418]: cluster 2021-03-10T14:45:30.605177+0000 mgr.gibba020.yqfnwy (mgr.34427) 2809 : cluster [DBG] pgmap v1586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:32.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:32 gibba013 bash[30381]: cluster 2021-03-10T14:45:30.605177+0000 mgr.gibba020.yqfnwy (mgr.34427) 2809 : cluster [DBG] pgmap v1586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:32.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:32 gibba020 bash[25448]: cluster 2021-03-10T14:45:30.605177+0000 mgr.gibba020.yqfnwy (mgr.34427) 2809 : cluster [DBG] pgmap v1586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:34.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:34 gibba013 bash[29418]: cluster 2021-03-10T14:45:32.606646+0000 mgr.gibba020.yqfnwy (mgr.34427) 2810 : cluster [DBG] pgmap v1587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:34.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:34 gibba013 bash[30381]: cluster 2021-03-10T14:45:32.606646+0000 mgr.gibba020.yqfnwy (mgr.34427) 2810 : cluster [DBG] pgmap v1587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:34.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:34 gibba020 bash[25448]: cluster 2021-03-10T14:45:32.606646+0000 mgr.gibba020.yqfnwy (mgr.34427) 2810 : cluster [DBG] pgmap v1587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:35.234 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:45:35.460 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:45:35.461 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (52m) 7m ago 57m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:45:35.461 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (57m) 6m ago 57m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:45:35.461 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (52m) 6m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:45:35.461 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (52m) 6m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:45:35.461 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (51m) 7m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:45:35.462 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (51m) 7m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:45:35.462 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (51m) 6m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:45:35.462 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (51m) 7m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:45:35.462 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (57m) 7m ago 57m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:45:35.463 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (57m) 6m ago 57m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:45:35.463 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (50m) 7m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:45:35.463 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (49m) 7m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:45:35.463 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (49m) 7m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:45:35.463 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (49m) 7m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:45:35.464 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (48m) 6m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:45:35.464 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (48m) 6m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:45:35.464 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (47m) 6m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:45:35.464 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (47m) 6m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:45:35.464 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (57m) 6m ago 57m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:45:35.465 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 6m ago 55m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:45:35.707 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:45:35.707 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:45:35.707 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:45:35.708 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:45:35.708 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:45:35.708 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:45:35.708 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:45:35.709 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:45:35.709 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:45:35.709 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:45:35.709 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:45:35.709 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:45:35.709 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:45:35.710 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:45:35.710 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:45:36.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:36 gibba013 bash[29418]: cluster 2021-03-10T14:45:34.608248+0000 mgr.gibba020.yqfnwy (mgr.34427) 2811 : cluster [DBG] pgmap v1588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:36.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:36 gibba013 bash[29418]: audit 2021-03-10T14:45:35.222394+0000 mgr.gibba020.yqfnwy (mgr.34427) 2812 : audit [DBG] from='client.45942 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:45:36.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:36 gibba013 bash[29418]: audit 2021-03-10T14:45:35.705223+0000 mon.c (mon.1) 52 : audit [DBG] from='client.? 172.21.2.113:0/1464583883' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:36.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:36 gibba013 bash[30381]: cluster 2021-03-10T14:45:34.608248+0000 mgr.gibba020.yqfnwy (mgr.34427) 2811 : cluster [DBG] pgmap v1588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:36.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:36 gibba013 bash[30381]: audit 2021-03-10T14:45:35.222394+0000 mgr.gibba020.yqfnwy (mgr.34427) 2812 : audit [DBG] from='client.45942 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:45:36.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:36 gibba013 bash[30381]: audit 2021-03-10T14:45:35.705223+0000 mon.c (mon.1) 52 : audit [DBG] from='client.? 172.21.2.113:0/1464583883' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:36.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:36 gibba020 bash[25448]: cluster 2021-03-10T14:45:34.608248+0000 mgr.gibba020.yqfnwy (mgr.34427) 2811 : cluster [DBG] pgmap v1588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:36.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:36 gibba020 bash[25448]: audit 2021-03-10T14:45:35.222394+0000 mgr.gibba020.yqfnwy (mgr.34427) 2812 : audit [DBG] from='client.45942 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:45:36.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:36 gibba020 bash[25448]: audit 2021-03-10T14:45:35.705223+0000 mon.c (mon.1) 52 : audit [DBG] from='client.? 172.21.2.113:0/1464583883' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:45:37.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:37 gibba013 bash[29418]: audit 2021-03-10T14:45:35.447053+0000 mgr.gibba020.yqfnwy (mgr.34427) 2813 : audit [DBG] from='client.45948 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:45:37.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:37 gibba013 bash[30381]: audit 2021-03-10T14:45:35.447053+0000 mgr.gibba020.yqfnwy (mgr.34427) 2813 : audit [DBG] from='client.45948 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:45:37.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:37 gibba020 bash[25448]: audit 2021-03-10T14:45:35.447053+0000 mgr.gibba020.yqfnwy (mgr.34427) 2813 : audit [DBG] from='client.45948 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:45:38.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:38 gibba013 bash[29418]: cluster 2021-03-10T14:45:36.609926+0000 mgr.gibba020.yqfnwy (mgr.34427) 2814 : cluster [DBG] pgmap v1589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:38.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:38 gibba013 bash[30381]: cluster 2021-03-10T14:45:36.609926+0000 mgr.gibba020.yqfnwy (mgr.34427) 2814 : cluster [DBG] pgmap v1589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:38.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:38 gibba020 bash[25448]: cluster 2021-03-10T14:45:36.609926+0000 mgr.gibba020.yqfnwy (mgr.34427) 2814 : cluster [DBG] pgmap v1589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:39.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:39 gibba013 bash[29418]: cluster 2021-03-10T14:45:38.611495+0000 mgr.gibba020.yqfnwy (mgr.34427) 2815 : cluster [DBG] pgmap v1590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:39.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:39 gibba013 bash[30381]: cluster 2021-03-10T14:45:38.611495+0000 mgr.gibba020.yqfnwy (mgr.34427) 2815 : cluster [DBG] pgmap v1590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:39.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:39 gibba020 bash[25448]: cluster 2021-03-10T14:45:38.611495+0000 mgr.gibba020.yqfnwy (mgr.34427) 2815 : cluster [DBG] pgmap v1590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:42.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:42 gibba013 bash[29418]: cluster 2021-03-10T14:45:40.613215+0000 mgr.gibba020.yqfnwy (mgr.34427) 2816 : cluster [DBG] pgmap v1591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:42.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:42 gibba013 bash[29418]: cephadm 2021-03-10T14:45:41.064975+0000 mgr.gibba020.yqfnwy (mgr.34427) 2817 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:45:42.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:42 gibba013 bash[30381]: cluster 2021-03-10T14:45:40.613215+0000 mgr.gibba020.yqfnwy (mgr.34427) 2816 : cluster [DBG] pgmap v1591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:42.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:42 gibba013 bash[30381]: cephadm 2021-03-10T14:45:41.064975+0000 mgr.gibba020.yqfnwy (mgr.34427) 2817 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:45:42.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:42 gibba020 bash[25448]: cluster 2021-03-10T14:45:40.613215+0000 mgr.gibba020.yqfnwy (mgr.34427) 2816 : cluster [DBG] pgmap v1591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:42.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:42 gibba020 bash[25448]: cephadm 2021-03-10T14:45:41.064975+0000 mgr.gibba020.yqfnwy (mgr.34427) 2817 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:45:44.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:44 gibba013 bash[29418]: cluster 2021-03-10T14:45:42.614627+0000 mgr.gibba020.yqfnwy (mgr.34427) 2818 : cluster [DBG] pgmap v1592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:44.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:44 gibba013 bash[30381]: cluster 2021-03-10T14:45:42.614627+0000 mgr.gibba020.yqfnwy (mgr.34427) 2818 : cluster [DBG] pgmap v1592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:44.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:44 gibba020 bash[25448]: cluster 2021-03-10T14:45:42.614627+0000 mgr.gibba020.yqfnwy (mgr.34427) 2818 : cluster [DBG] pgmap v1592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:46.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:46 gibba013 bash[29418]: cluster 2021-03-10T14:45:44.616244+0000 mgr.gibba020.yqfnwy (mgr.34427) 2819 : cluster [DBG] pgmap v1593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:46.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:46 gibba013 bash[30381]: cluster 2021-03-10T14:45:44.616244+0000 mgr.gibba020.yqfnwy (mgr.34427) 2819 : cluster [DBG] pgmap v1593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:46.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:46 gibba020 bash[25448]: cluster 2021-03-10T14:45:44.616244+0000 mgr.gibba020.yqfnwy (mgr.34427) 2819 : cluster [DBG] pgmap v1593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:48.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:48 gibba013 bash[29418]: cluster 2021-03-10T14:45:46.618020+0000 mgr.gibba020.yqfnwy (mgr.34427) 2820 : cluster [DBG] pgmap v1594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:48.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:48 gibba013 bash[30381]: cluster 2021-03-10T14:45:46.618020+0000 mgr.gibba020.yqfnwy (mgr.34427) 2820 : cluster [DBG] pgmap v1594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:48.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:48 gibba020 bash[25448]: cluster 2021-03-10T14:45:46.618020+0000 mgr.gibba020.yqfnwy (mgr.34427) 2820 : cluster [DBG] pgmap v1594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:50.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:50 gibba013 bash[29418]: cluster 2021-03-10T14:45:48.619440+0000 mgr.gibba020.yqfnwy (mgr.34427) 2821 : cluster [DBG] pgmap v1595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:50.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:50 gibba013 bash[30381]: cluster 2021-03-10T14:45:48.619440+0000 mgr.gibba020.yqfnwy (mgr.34427) 2821 : cluster [DBG] pgmap v1595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:50.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:50 gibba020 bash[25448]: cluster 2021-03-10T14:45:48.619440+0000 mgr.gibba020.yqfnwy (mgr.34427) 2821 : cluster [DBG] pgmap v1595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:52.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:52 gibba013 bash[29418]: cluster 2021-03-10T14:45:50.621171+0000 mgr.gibba020.yqfnwy (mgr.34427) 2822 : cluster [DBG] pgmap v1596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:52.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:52 gibba013 bash[30381]: cluster 2021-03-10T14:45:50.621171+0000 mgr.gibba020.yqfnwy (mgr.34427) 2822 : cluster [DBG] pgmap v1596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:52.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:52 gibba020 bash[25448]: cluster 2021-03-10T14:45:50.621171+0000 mgr.gibba020.yqfnwy (mgr.34427) 2822 : cluster [DBG] pgmap v1596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:54.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:54 gibba013 bash[29418]: cluster 2021-03-10T14:45:52.622667+0000 mgr.gibba020.yqfnwy (mgr.34427) 2823 : cluster [DBG] pgmap v1597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:54.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:54 gibba013 bash[30381]: cluster 2021-03-10T14:45:52.622667+0000 mgr.gibba020.yqfnwy (mgr.34427) 2823 : cluster [DBG] pgmap v1597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:54.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:54 gibba020 bash[25448]: cluster 2021-03-10T14:45:52.622667+0000 mgr.gibba020.yqfnwy (mgr.34427) 2823 : cluster [DBG] pgmap v1597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:56.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:56 gibba020 bash[25448]: cluster 2021-03-10T14:45:54.624244+0000 mgr.gibba020.yqfnwy (mgr.34427) 2824 : cluster [DBG] pgmap v1598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:56.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:56 gibba013 bash[29418]: cluster 2021-03-10T14:45:54.624244+0000 mgr.gibba020.yqfnwy (mgr.34427) 2824 : cluster [DBG] pgmap v1598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:56.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:56 gibba013 bash[30381]: cluster 2021-03-10T14:45:54.624244+0000 mgr.gibba020.yqfnwy (mgr.34427) 2824 : cluster [DBG] pgmap v1598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:57.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:57 gibba013 bash[29418]: cephadm 2021-03-10T14:45:56.076876+0000 mgr.gibba020.yqfnwy (mgr.34427) 2825 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:45:57.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:57 gibba013 bash[30381]: cephadm 2021-03-10T14:45:56.076876+0000 mgr.gibba020.yqfnwy (mgr.34427) 2825 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:45:57.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:57 gibba020 bash[25448]: cephadm 2021-03-10T14:45:56.076876+0000 mgr.gibba020.yqfnwy (mgr.34427) 2825 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:45:58.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:58 gibba013 bash[29418]: cluster 2021-03-10T14:45:56.625965+0000 mgr.gibba020.yqfnwy (mgr.34427) 2826 : cluster [DBG] pgmap v1599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:58.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:58 gibba013 bash[30381]: cluster 2021-03-10T14:45:56.625965+0000 mgr.gibba020.yqfnwy (mgr.34427) 2826 : cluster [DBG] pgmap v1599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:58.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:58 gibba020 bash[25448]: cluster 2021-03-10T14:45:56.625965+0000 mgr.gibba020.yqfnwy (mgr.34427) 2826 : cluster [DBG] pgmap v1599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:59.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:45:59 gibba013 bash[29418]: cluster 2021-03-10T14:45:58.627354+0000 mgr.gibba020.yqfnwy (mgr.34427) 2827 : cluster [DBG] pgmap v1600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:59.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:45:59 gibba013 bash[30381]: cluster 2021-03-10T14:45:58.627354+0000 mgr.gibba020.yqfnwy (mgr.34427) 2827 : cluster [DBG] pgmap v1600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:45:59.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:45:59 gibba020 bash[25448]: cluster 2021-03-10T14:45:58.627354+0000 mgr.gibba020.yqfnwy (mgr.34427) 2827 : cluster [DBG] pgmap v1600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:02.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:02 gibba013 bash[29418]: cluster 2021-03-10T14:46:00.629047+0000 mgr.gibba020.yqfnwy (mgr.34427) 2828 : cluster [DBG] pgmap v1601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:02.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:02 gibba013 bash[30381]: cluster 2021-03-10T14:46:00.629047+0000 mgr.gibba020.yqfnwy (mgr.34427) 2828 : cluster [DBG] pgmap v1601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:02.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:02 gibba020 bash[25448]: cluster 2021-03-10T14:46:00.629047+0000 mgr.gibba020.yqfnwy (mgr.34427) 2828 : cluster [DBG] pgmap v1601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:04.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:04 gibba013 bash[29418]: cluster 2021-03-10T14:46:02.630542+0000 mgr.gibba020.yqfnwy (mgr.34427) 2829 : cluster [DBG] pgmap v1602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:04.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:04 gibba013 bash[30381]: cluster 2021-03-10T14:46:02.630542+0000 mgr.gibba020.yqfnwy (mgr.34427) 2829 : cluster [DBG] pgmap v1602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:04.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:04 gibba020 bash[25448]: cluster 2021-03-10T14:46:02.630542+0000 mgr.gibba020.yqfnwy (mgr.34427) 2829 : cluster [DBG] pgmap v1602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:05.953 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:46:06.183 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:46:06.183 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (52m) 8m ago 57m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:46:06.184 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (57m) 6m ago 57m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:46:06.184 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (53m) 6m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:46:06.184 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (53m) 6m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:46:06.184 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (52m) 8m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:46:06.184 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (52m) 8m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:46:06.185 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (51m) 6m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:46:06.185 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (51m) 8m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:46:06.185 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (58m) 8m ago 58m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:46:06.185 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (58m) 6m ago 58m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:46:06.186 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (50m) 8m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:46:06.186 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (50m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:46:06.186 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (50m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:46:06.186 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (49m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:46:06.186 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (49m) 6m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:46:06.187 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (48m) 6m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:46:06.187 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (48m) 6m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:46:06.187 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (47m) 6m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:46:06.187 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (57m) 6m ago 58m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:46:06.187 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 6m ago 56m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:46:06.440 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:46:06.440 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:46:06.440 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:46:06.441 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:46:06.441 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:46:06.441 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:46:06.441 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:46:06.441 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:46:06.442 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:46:06.442 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:46:06.442 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:46:06.442 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:46:06.443 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:46:06.443 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:46:06.443 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:46:06.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:06 gibba013 bash[30381]: cluster 2021-03-10T14:46:04.632121+0000 mgr.gibba020.yqfnwy (mgr.34427) 2830 : cluster [DBG] pgmap v1603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:06.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:06 gibba013 bash[30381]: audit 2021-03-10T14:46:06.227319+0000 mon.a (mon.0) 1398 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T14:46:06.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:06 gibba013 bash[30381]: audit 2021-03-10T14:46:06.227465+0000 mon.a (mon.0) 1399 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:46:06.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:06 gibba013 bash[30381]: audit 2021-03-10T14:46:06.227587+0000 mon.a (mon.0) 1400 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:46:06.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:06 gibba013 bash[30381]: audit 2021-03-10T14:46:06.227699+0000 mon.a (mon.0) 1401 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:46:06.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:06 gibba013 bash[30381]: audit 2021-03-10T14:46:06.253934+0000 mon.a (mon.0) 1402 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:46:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:06 gibba013 bash[30381]: audit 2021-03-10T14:46:06.254134+0000 mon.a (mon.0) 1403 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:46:06.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:06 gibba013 bash[29418]: cluster 2021-03-10T14:46:04.632121+0000 mgr.gibba020.yqfnwy (mgr.34427) 2830 : cluster [DBG] pgmap v1603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:06.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:06 gibba013 bash[29418]: audit 2021-03-10T14:46:06.227319+0000 mon.a (mon.0) 1398 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T14:46:06.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:06 gibba013 bash[29418]: audit 2021-03-10T14:46:06.227465+0000 mon.a (mon.0) 1399 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:46:06.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:06 gibba013 bash[29418]: audit 2021-03-10T14:46:06.227587+0000 mon.a (mon.0) 1400 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:46:06.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:06 gibba013 bash[29418]: audit 2021-03-10T14:46:06.227699+0000 mon.a (mon.0) 1401 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:46:06.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:06 gibba013 bash[29418]: audit 2021-03-10T14:46:06.253934+0000 mon.a (mon.0) 1402 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:46:06.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:06 gibba013 bash[29418]: audit 2021-03-10T14:46:06.254134+0000 mon.a (mon.0) 1403 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:46:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:06 gibba020 bash[25448]: cluster 2021-03-10T14:46:04.632121+0000 mgr.gibba020.yqfnwy (mgr.34427) 2830 : cluster [DBG] pgmap v1603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:06 gibba020 bash[25448]: audit 2021-03-10T14:46:06.227319+0000 mon.a (mon.0) 1398 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T14:46:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:06 gibba020 bash[25448]: audit 2021-03-10T14:46:06.227465+0000 mon.a (mon.0) 1399 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:46:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:06 gibba020 bash[25448]: audit 2021-03-10T14:46:06.227587+0000 mon.a (mon.0) 1400 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:46:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:06 gibba020 bash[25448]: audit 2021-03-10T14:46:06.227699+0000 mon.a (mon.0) 1401 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T14:46:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:06 gibba020 bash[25448]: audit 2021-03-10T14:46:06.253934+0000 mon.a (mon.0) 1402 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:46:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:06 gibba020 bash[25448]: audit 2021-03-10T14:46:06.254134+0000 mon.a (mon.0) 1403 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:46:07.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:07 gibba013 bash[29418]: audit 2021-03-10T14:46:05.940873+0000 mgr.gibba020.yqfnwy (mgr.34427) 2831 : audit [DBG] from='client.45960 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:46:07.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:07 gibba013 bash[29418]: audit 2021-03-10T14:46:06.168234+0000 mgr.gibba020.yqfnwy (mgr.34427) 2832 : audit [DBG] from='client.55951 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:46:07.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:07 gibba013 bash[29418]: audit 2021-03-10T14:46:06.437864+0000 mon.a (mon.0) 1404 : audit [DBG] from='client.? 172.21.2.113:0/2072154902' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:07.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:07 gibba013 bash[30381]: audit 2021-03-10T14:46:05.940873+0000 mgr.gibba020.yqfnwy (mgr.34427) 2831 : audit [DBG] from='client.45960 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:46:07.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:07 gibba013 bash[30381]: audit 2021-03-10T14:46:06.168234+0000 mgr.gibba020.yqfnwy (mgr.34427) 2832 : audit [DBG] from='client.55951 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:46:07.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:07 gibba013 bash[30381]: audit 2021-03-10T14:46:06.437864+0000 mon.a (mon.0) 1404 : audit [DBG] from='client.? 172.21.2.113:0/2072154902' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:07.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:07 gibba020 bash[25448]: audit 2021-03-10T14:46:05.940873+0000 mgr.gibba020.yqfnwy (mgr.34427) 2831 : audit [DBG] from='client.45960 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:46:07.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:07 gibba020 bash[25448]: audit 2021-03-10T14:46:06.168234+0000 mgr.gibba020.yqfnwy (mgr.34427) 2832 : audit [DBG] from='client.55951 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:46:07.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:07 gibba020 bash[25448]: audit 2021-03-10T14:46:06.437864+0000 mon.a (mon.0) 1404 : audit [DBG] from='client.? 172.21.2.113:0/2072154902' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:08.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:08 gibba013 bash[29418]: cluster 2021-03-10T14:46:06.633875+0000 mgr.gibba020.yqfnwy (mgr.34427) 2833 : cluster [DBG] pgmap v1604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:08.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:08 gibba013 bash[30381]: cluster 2021-03-10T14:46:06.633875+0000 mgr.gibba020.yqfnwy (mgr.34427) 2833 : cluster [DBG] pgmap v1604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:08.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:08 gibba020 bash[25448]: cluster 2021-03-10T14:46:06.633875+0000 mgr.gibba020.yqfnwy (mgr.34427) 2833 : cluster [DBG] pgmap v1604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:10.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:10 gibba013 bash[29418]: cluster 2021-03-10T14:46:08.635231+0000 mgr.gibba020.yqfnwy (mgr.34427) 2834 : cluster [DBG] pgmap v1605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:10.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:10 gibba013 bash[30381]: cluster 2021-03-10T14:46:08.635231+0000 mgr.gibba020.yqfnwy (mgr.34427) 2834 : cluster [DBG] pgmap v1605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:10.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:10 gibba020 bash[25448]: cluster 2021-03-10T14:46:08.635231+0000 mgr.gibba020.yqfnwy (mgr.34427) 2834 : cluster [DBG] pgmap v1605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:11.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:11 gibba013 bash[29418]: audit 2021-03-10T14:46:11.094775+0000 mon.a (mon.0) 1405 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:46:11.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:11 gibba013 bash[30381]: audit 2021-03-10T14:46:11.094775+0000 mon.a (mon.0) 1405 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:46:11.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:11 gibba020 bash[25448]: audit 2021-03-10T14:46:11.094775+0000 mon.a (mon.0) 1405 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:46:12.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:12 gibba013 bash[29418]: cluster 2021-03-10T14:46:10.636736+0000 mgr.gibba020.yqfnwy (mgr.34427) 2835 : cluster [DBG] pgmap v1606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:12.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:12 gibba013 bash[29418]: cephadm 2021-03-10T14:46:11.099206+0000 mgr.gibba020.yqfnwy (mgr.34427) 2836 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:46:12.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:12 gibba013 bash[29418]: cephadm 2021-03-10T14:46:11.101034+0000 mgr.gibba020.yqfnwy (mgr.34427) 2837 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:46:12.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:12 gibba013 bash[29418]: audit 2021-03-10T14:46:11.328226+0000 mon.a (mon.0) 1406 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:46:12.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:12 gibba013 bash[29418]: audit 2021-03-10T14:46:11.331508+0000 mon.a (mon.0) 1407 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:46:12.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:12 gibba013 bash[29418]: audit 2021-03-10T14:46:11.333114+0000 mon.a (mon.0) 1408 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:12.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:12 gibba013 bash[29418]: audit 2021-03-10T14:46:11.334829+0000 mon.a (mon.0) 1409 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:12.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:12 gibba013 bash[29418]: audit 2021-03-10T14:46:11.336636+0000 mon.a (mon.0) 1410 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:12.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:12 gibba013 bash[29418]: audit 2021-03-10T14:46:11.339458+0000 mon.a (mon.0) 1411 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:12.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:12 gibba013 bash[29418]: audit 2021-03-10T14:46:11.341274+0000 mon.a (mon.0) 1412 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:12.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:12 gibba013 bash[30381]: cluster 2021-03-10T14:46:10.636736+0000 mgr.gibba020.yqfnwy (mgr.34427) 2835 : cluster [DBG] pgmap v1606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:12.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:12 gibba013 bash[30381]: cephadm 2021-03-10T14:46:11.099206+0000 mgr.gibba020.yqfnwy (mgr.34427) 2836 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:46:12.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:12 gibba013 bash[30381]: cephadm 2021-03-10T14:46:11.101034+0000 mgr.gibba020.yqfnwy (mgr.34427) 2837 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:46:12.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:12 gibba013 bash[30381]: audit 2021-03-10T14:46:11.328226+0000 mon.a (mon.0) 1406 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:46:12.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:12 gibba013 bash[30381]: audit 2021-03-10T14:46:11.331508+0000 mon.a (mon.0) 1407 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:46:12.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:12 gibba013 bash[30381]: audit 2021-03-10T14:46:11.333114+0000 mon.a (mon.0) 1408 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:12.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:12 gibba013 bash[30381]: audit 2021-03-10T14:46:11.334829+0000 mon.a (mon.0) 1409 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:12.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:12 gibba013 bash[30381]: audit 2021-03-10T14:46:11.336636+0000 mon.a (mon.0) 1410 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:12.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:12 gibba013 bash[30381]: audit 2021-03-10T14:46:11.339458+0000 mon.a (mon.0) 1411 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:12.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:12 gibba013 bash[30381]: audit 2021-03-10T14:46:11.341274+0000 mon.a (mon.0) 1412 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:12.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:12 gibba020 bash[25448]: cluster 2021-03-10T14:46:10.636736+0000 mgr.gibba020.yqfnwy (mgr.34427) 2835 : cluster [DBG] pgmap v1606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:12.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:12 gibba020 bash[25448]: cephadm 2021-03-10T14:46:11.099206+0000 mgr.gibba020.yqfnwy (mgr.34427) 2836 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:46:12.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:12 gibba020 bash[25448]: cephadm 2021-03-10T14:46:11.101034+0000 mgr.gibba020.yqfnwy (mgr.34427) 2837 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:46:12.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:12 gibba020 bash[25448]: audit 2021-03-10T14:46:11.328226+0000 mon.a (mon.0) 1406 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:46:12.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:12 gibba020 bash[25448]: audit 2021-03-10T14:46:11.331508+0000 mon.a (mon.0) 1407 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:46:12.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:12 gibba020 bash[25448]: audit 2021-03-10T14:46:11.333114+0000 mon.a (mon.0) 1408 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:12.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:12 gibba020 bash[25448]: audit 2021-03-10T14:46:11.334829+0000 mon.a (mon.0) 1409 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:12.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:12 gibba020 bash[25448]: audit 2021-03-10T14:46:11.336636+0000 mon.a (mon.0) 1410 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:12.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:12 gibba020 bash[25448]: audit 2021-03-10T14:46:11.339458+0000 mon.a (mon.0) 1411 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:12.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:12 gibba020 bash[25448]: audit 2021-03-10T14:46:11.341274+0000 mon.a (mon.0) 1412 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:13.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:13 gibba013 bash[29418]: cephadm 2021-03-10T14:46:11.329737+0000 mgr.gibba020.yqfnwy (mgr.34427) 2838 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:46:13.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:13 gibba013 bash[29418]: cephadm 2021-03-10T14:46:11.331655+0000 mgr.gibba020.yqfnwy (mgr.34427) 2839 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:46:13.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:13 gibba013 bash[29418]: cephadm 2021-03-10T14:46:11.333333+0000 mgr.gibba020.yqfnwy (mgr.34427) 2840 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:46:13.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:13 gibba013 bash[29418]: cephadm 2021-03-10T14:46:11.333375+0000 mgr.gibba020.yqfnwy (mgr.34427) 2841 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:46:13.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:13 gibba013 bash[29418]: cephadm 2021-03-10T14:46:11.335018+0000 mgr.gibba020.yqfnwy (mgr.34427) 2842 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:46:13.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:13 gibba013 bash[29418]: cephadm 2021-03-10T14:46:11.335109+0000 mgr.gibba020.yqfnwy (mgr.34427) 2843 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:46:13.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:13 gibba013 bash[29418]: cephadm 2021-03-10T14:46:11.336536+0000 mgr.gibba020.yqfnwy (mgr.34427) 2844 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:46:13.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:13 gibba013 bash[29418]: cephadm 2021-03-10T14:46:11.337910+0000 mgr.gibba020.yqfnwy (mgr.34427) 2845 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:46:13.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:13 gibba013 bash[29418]: cephadm 2021-03-10T14:46:11.337947+0000 mgr.gibba020.yqfnwy (mgr.34427) 2846 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:46:13.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:13 gibba013 bash[29418]: cephadm 2021-03-10T14:46:11.339549+0000 mgr.gibba020.yqfnwy (mgr.34427) 2847 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:46:13.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:13 gibba013 bash[29418]: cephadm 2021-03-10T14:46:11.339860+0000 mgr.gibba020.yqfnwy (mgr.34427) 2848 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:46:13.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:13 gibba013 bash[29418]: cephadm 2021-03-10T14:46:11.341234+0000 mgr.gibba020.yqfnwy (mgr.34427) 2849 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:46:13.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:13 gibba013 bash[29418]: cephadm 2021-03-10T14:46:11.341271+0000 mgr.gibba020.yqfnwy (mgr.34427) 2850 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:46:13.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:13 gibba013 bash[29418]: cephadm 2021-03-10T14:46:11.341372+0000 mgr.gibba020.yqfnwy (mgr.34427) 2851 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:46:13.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:13 gibba013 bash[30381]: cephadm 2021-03-10T14:46:11.329737+0000 mgr.gibba020.yqfnwy (mgr.34427) 2838 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:46:13.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:13 gibba013 bash[30381]: cephadm 2021-03-10T14:46:11.331655+0000 mgr.gibba020.yqfnwy (mgr.34427) 2839 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:46:13.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:13 gibba013 bash[30381]: cephadm 2021-03-10T14:46:11.333333+0000 mgr.gibba020.yqfnwy (mgr.34427) 2840 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:46:13.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:13 gibba013 bash[30381]: cephadm 2021-03-10T14:46:11.333375+0000 mgr.gibba020.yqfnwy (mgr.34427) 2841 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:46:13.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:13 gibba013 bash[30381]: cephadm 2021-03-10T14:46:11.335018+0000 mgr.gibba020.yqfnwy (mgr.34427) 2842 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:46:13.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:13 gibba013 bash[30381]: cephadm 2021-03-10T14:46:11.335109+0000 mgr.gibba020.yqfnwy (mgr.34427) 2843 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:46:13.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:13 gibba013 bash[30381]: cephadm 2021-03-10T14:46:11.336536+0000 mgr.gibba020.yqfnwy (mgr.34427) 2844 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:46:13.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:13 gibba013 bash[30381]: cephadm 2021-03-10T14:46:11.337910+0000 mgr.gibba020.yqfnwy (mgr.34427) 2845 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:46:13.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:13 gibba013 bash[30381]: cephadm 2021-03-10T14:46:11.337947+0000 mgr.gibba020.yqfnwy (mgr.34427) 2846 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:46:13.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:13 gibba013 bash[30381]: cephadm 2021-03-10T14:46:11.339549+0000 mgr.gibba020.yqfnwy (mgr.34427) 2847 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:46:13.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:13 gibba013 bash[30381]: cephadm 2021-03-10T14:46:11.339860+0000 mgr.gibba020.yqfnwy (mgr.34427) 2848 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:46:13.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:13 gibba013 bash[30381]: cephadm 2021-03-10T14:46:11.341234+0000 mgr.gibba020.yqfnwy (mgr.34427) 2849 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:46:13.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:13 gibba013 bash[30381]: cephadm 2021-03-10T14:46:11.341271+0000 mgr.gibba020.yqfnwy (mgr.34427) 2850 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:46:13.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:13 gibba013 bash[30381]: cephadm 2021-03-10T14:46:11.341372+0000 mgr.gibba020.yqfnwy (mgr.34427) 2851 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:46:13.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:13 gibba020 bash[25448]: cephadm 2021-03-10T14:46:11.329737+0000 mgr.gibba020.yqfnwy (mgr.34427) 2838 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:46:13.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:13 gibba020 bash[25448]: cephadm 2021-03-10T14:46:11.331655+0000 mgr.gibba020.yqfnwy (mgr.34427) 2839 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:46:13.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:13 gibba020 bash[25448]: cephadm 2021-03-10T14:46:11.333333+0000 mgr.gibba020.yqfnwy (mgr.34427) 2840 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:46:13.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:13 gibba020 bash[25448]: cephadm 2021-03-10T14:46:11.333375+0000 mgr.gibba020.yqfnwy (mgr.34427) 2841 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:46:13.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:13 gibba020 bash[25448]: cephadm 2021-03-10T14:46:11.335018+0000 mgr.gibba020.yqfnwy (mgr.34427) 2842 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:46:13.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:13 gibba020 bash[25448]: cephadm 2021-03-10T14:46:11.335109+0000 mgr.gibba020.yqfnwy (mgr.34427) 2843 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:46:13.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:13 gibba020 bash[25448]: cephadm 2021-03-10T14:46:11.336536+0000 mgr.gibba020.yqfnwy (mgr.34427) 2844 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:46:13.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:13 gibba020 bash[25448]: cephadm 2021-03-10T14:46:11.337910+0000 mgr.gibba020.yqfnwy (mgr.34427) 2845 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:46:13.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:13 gibba020 bash[25448]: cephadm 2021-03-10T14:46:11.337947+0000 mgr.gibba020.yqfnwy (mgr.34427) 2846 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:46:13.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:13 gibba020 bash[25448]: cephadm 2021-03-10T14:46:11.339549+0000 mgr.gibba020.yqfnwy (mgr.34427) 2847 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:46:13.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:13 gibba020 bash[25448]: cephadm 2021-03-10T14:46:11.339860+0000 mgr.gibba020.yqfnwy (mgr.34427) 2848 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:46:13.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:13 gibba020 bash[25448]: cephadm 2021-03-10T14:46:11.341234+0000 mgr.gibba020.yqfnwy (mgr.34427) 2849 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:46:13.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:13 gibba020 bash[25448]: cephadm 2021-03-10T14:46:11.341271+0000 mgr.gibba020.yqfnwy (mgr.34427) 2850 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:46:13.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:13 gibba020 bash[25448]: cephadm 2021-03-10T14:46:11.341372+0000 mgr.gibba020.yqfnwy (mgr.34427) 2851 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:46:14.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:14 gibba013 bash[29418]: cluster 2021-03-10T14:46:12.638128+0000 mgr.gibba020.yqfnwy (mgr.34427) 2852 : cluster [DBG] pgmap v1607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:14.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:14 gibba013 bash[30381]: cluster 2021-03-10T14:46:12.638128+0000 mgr.gibba020.yqfnwy (mgr.34427) 2852 : cluster [DBG] pgmap v1607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:14.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:14 gibba020 bash[25448]: cluster 2021-03-10T14:46:12.638128+0000 mgr.gibba020.yqfnwy (mgr.34427) 2852 : cluster [DBG] pgmap v1607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:15.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:15 gibba013 bash[29418]: cluster 2021-03-10T14:46:14.639734+0000 mgr.gibba020.yqfnwy (mgr.34427) 2853 : cluster [DBG] pgmap v1608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:15.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:15 gibba013 bash[30381]: cluster 2021-03-10T14:46:14.639734+0000 mgr.gibba020.yqfnwy (mgr.34427) 2853 : cluster [DBG] pgmap v1608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:15.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:15 gibba020 bash[25448]: cluster 2021-03-10T14:46:14.639734+0000 mgr.gibba020.yqfnwy (mgr.34427) 2853 : cluster [DBG] pgmap v1608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:18.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:18 gibba013 bash[29418]: cluster 2021-03-10T14:46:16.641535+0000 mgr.gibba020.yqfnwy (mgr.34427) 2854 : cluster [DBG] pgmap v1609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:18.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:18 gibba013 bash[30381]: cluster 2021-03-10T14:46:16.641535+0000 mgr.gibba020.yqfnwy (mgr.34427) 2854 : cluster [DBG] pgmap v1609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:18.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:18 gibba020 bash[25448]: cluster 2021-03-10T14:46:16.641535+0000 mgr.gibba020.yqfnwy (mgr.34427) 2854 : cluster [DBG] pgmap v1609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:20.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:20 gibba013 bash[29418]: cluster 2021-03-10T14:46:18.642865+0000 mgr.gibba020.yqfnwy (mgr.34427) 2855 : cluster [DBG] pgmap v1610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:20.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:20 gibba013 bash[30381]: cluster 2021-03-10T14:46:18.642865+0000 mgr.gibba020.yqfnwy (mgr.34427) 2855 : cluster [DBG] pgmap v1610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:20.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:20 gibba020 bash[25448]: cluster 2021-03-10T14:46:18.642865+0000 mgr.gibba020.yqfnwy (mgr.34427) 2855 : cluster [DBG] pgmap v1610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:22.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:22 gibba013 bash[29418]: cluster 2021-03-10T14:46:20.644325+0000 mgr.gibba020.yqfnwy (mgr.34427) 2856 : cluster [DBG] pgmap v1611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:22.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:22 gibba013 bash[30381]: cluster 2021-03-10T14:46:20.644325+0000 mgr.gibba020.yqfnwy (mgr.34427) 2856 : cluster [DBG] pgmap v1611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:22.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:22 gibba020 bash[25448]: cluster 2021-03-10T14:46:20.644325+0000 mgr.gibba020.yqfnwy (mgr.34427) 2856 : cluster [DBG] pgmap v1611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:24.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:24 gibba013 bash[29418]: cluster 2021-03-10T14:46:22.645867+0000 mgr.gibba020.yqfnwy (mgr.34427) 2857 : cluster [DBG] pgmap v1612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:24.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:24 gibba013 bash[30381]: cluster 2021-03-10T14:46:22.645867+0000 mgr.gibba020.yqfnwy (mgr.34427) 2857 : cluster [DBG] pgmap v1612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:24.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:24 gibba020 bash[25448]: cluster 2021-03-10T14:46:22.645867+0000 mgr.gibba020.yqfnwy (mgr.34427) 2857 : cluster [DBG] pgmap v1612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:26.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:26 gibba013 bash[29418]: cluster 2021-03-10T14:46:24.647526+0000 mgr.gibba020.yqfnwy (mgr.34427) 2858 : cluster [DBG] pgmap v1613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:26.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:26 gibba013 bash[30381]: cluster 2021-03-10T14:46:24.647526+0000 mgr.gibba020.yqfnwy (mgr.34427) 2858 : cluster [DBG] pgmap v1613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:26.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:26 gibba020 bash[25448]: cluster 2021-03-10T14:46:24.647526+0000 mgr.gibba020.yqfnwy (mgr.34427) 2858 : cluster [DBG] pgmap v1613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:28.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:28 gibba013 bash[29418]: cephadm 2021-03-10T14:46:26.356920+0000 mgr.gibba020.yqfnwy (mgr.34427) 2859 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:46:28.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:28 gibba013 bash[29418]: cluster 2021-03-10T14:46:26.648128+0000 mgr.gibba020.yqfnwy (mgr.34427) 2860 : cluster [DBG] pgmap v1614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:28.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:28 gibba013 bash[30381]: cephadm 2021-03-10T14:46:26.356920+0000 mgr.gibba020.yqfnwy (mgr.34427) 2859 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:46:28.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:28 gibba013 bash[30381]: cluster 2021-03-10T14:46:26.648128+0000 mgr.gibba020.yqfnwy (mgr.34427) 2860 : cluster [DBG] pgmap v1614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:28.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:28 gibba020 bash[25448]: cephadm 2021-03-10T14:46:26.356920+0000 mgr.gibba020.yqfnwy (mgr.34427) 2859 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:46:28.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:28 gibba020 bash[25448]: cluster 2021-03-10T14:46:26.648128+0000 mgr.gibba020.yqfnwy (mgr.34427) 2860 : cluster [DBG] pgmap v1614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:30.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:30 gibba013 bash[29418]: cluster 2021-03-10T14:46:28.649516+0000 mgr.gibba020.yqfnwy (mgr.34427) 2861 : cluster [DBG] pgmap v1615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:30.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:30 gibba013 bash[30381]: cluster 2021-03-10T14:46:28.649516+0000 mgr.gibba020.yqfnwy (mgr.34427) 2861 : cluster [DBG] pgmap v1615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:30.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:30 gibba020 bash[25448]: cluster 2021-03-10T14:46:28.649516+0000 mgr.gibba020.yqfnwy (mgr.34427) 2861 : cluster [DBG] pgmap v1615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:32.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:32 gibba013 bash[29418]: cluster 2021-03-10T14:46:30.650994+0000 mgr.gibba020.yqfnwy (mgr.34427) 2862 : cluster [DBG] pgmap v1616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:32.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:32 gibba013 bash[30381]: cluster 2021-03-10T14:46:30.650994+0000 mgr.gibba020.yqfnwy (mgr.34427) 2862 : cluster [DBG] pgmap v1616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:32.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:32 gibba020 bash[25448]: cluster 2021-03-10T14:46:30.650994+0000 mgr.gibba020.yqfnwy (mgr.34427) 2862 : cluster [DBG] pgmap v1616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:33.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:33 gibba013 bash[29418]: cluster 2021-03-10T14:46:32.652562+0000 mgr.gibba020.yqfnwy (mgr.34427) 2863 : cluster [DBG] pgmap v1617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:33.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:33 gibba013 bash[30381]: cluster 2021-03-10T14:46:32.652562+0000 mgr.gibba020.yqfnwy (mgr.34427) 2863 : cluster [DBG] pgmap v1617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:33.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:33 gibba020 bash[25448]: cluster 2021-03-10T14:46:32.652562+0000 mgr.gibba020.yqfnwy (mgr.34427) 2863 : cluster [DBG] pgmap v1617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:36.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:35 gibba013 bash[29418]: cluster 2021-03-10T14:46:34.654148+0000 mgr.gibba020.yqfnwy (mgr.34427) 2864 : cluster [DBG] pgmap v1618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:36.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:35 gibba013 bash[30381]: cluster 2021-03-10T14:46:34.654148+0000 mgr.gibba020.yqfnwy (mgr.34427) 2864 : cluster [DBG] pgmap v1618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:36.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:35 gibba020 bash[25448]: cluster 2021-03-10T14:46:34.654148+0000 mgr.gibba020.yqfnwy (mgr.34427) 2864 : cluster [DBG] pgmap v1618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:36.689 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:46:36.922 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:46:36.922 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (53m) 8m ago 58m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:46:36.922 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (58m) 7m ago 58m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:46:36.923 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (53m) 7m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:46:36.923 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (53m) 7m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:46:36.923 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (52m) 8m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:46:36.923 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (52m) 8m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:46:36.924 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (52m) 7m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:46:36.924 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (52m) 8m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:46:36.924 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (58m) 8m ago 58m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:46:36.924 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (58m) 7m ago 58m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:46:36.924 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (51m) 8m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:46:36.925 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (50m) 8m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:46:36.925 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (50m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:46:36.925 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (50m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:46:36.925 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (49m) 7m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:46:36.925 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (49m) 7m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:46:36.926 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (48m) 7m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:46:36.926 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (48m) 7m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:46:36.926 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (58m) 7m ago 58m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:46:36.926 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 7m ago 56m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:46:37.170 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:46:37.171 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:46:37.171 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:46:37.171 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:46:37.171 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:46:37.172 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:46:37.172 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:46:37.172 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:46:37.172 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:46:37.173 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:46:37.173 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:46:37.173 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:46:37.173 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:46:37.173 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:46:37.174 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:46:37.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:37 gibba013 bash[29418]: audit 2021-03-10T14:46:37.168587+0000 mon.c (mon.1) 53 : audit [DBG] from='client.? 172.21.2.113:0/1034098854' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:37.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:37 gibba013 bash[30381]: audit 2021-03-10T14:46:37.168587+0000 mon.c (mon.1) 53 : audit [DBG] from='client.? 172.21.2.113:0/1034098854' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:37.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:37 gibba020 bash[25448]: audit 2021-03-10T14:46:37.168587+0000 mon.c (mon.1) 53 : audit [DBG] from='client.? 172.21.2.113:0/1034098854' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:46:38.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:38 gibba013 bash[29418]: cluster 2021-03-10T14:46:36.655020+0000 mgr.gibba020.yqfnwy (mgr.34427) 2865 : cluster [DBG] pgmap v1619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:38.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:38 gibba013 bash[29418]: audit 2021-03-10T14:46:36.678284+0000 mgr.gibba020.yqfnwy (mgr.34427) 2866 : audit [DBG] from='client.55963 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:46:38.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:38 gibba013 bash[29418]: audit 2021-03-10T14:46:36.906480+0000 mgr.gibba020.yqfnwy (mgr.34427) 2867 : audit [DBG] from='client.55969 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:46:38.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:38 gibba013 bash[30381]: cluster 2021-03-10T14:46:36.655020+0000 mgr.gibba020.yqfnwy (mgr.34427) 2865 : cluster [DBG] pgmap v1619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:38.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:38 gibba013 bash[30381]: audit 2021-03-10T14:46:36.678284+0000 mgr.gibba020.yqfnwy (mgr.34427) 2866 : audit [DBG] from='client.55963 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:46:38.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:38 gibba013 bash[30381]: audit 2021-03-10T14:46:36.906480+0000 mgr.gibba020.yqfnwy (mgr.34427) 2867 : audit [DBG] from='client.55969 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:46:38.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:38 gibba020 bash[25448]: cluster 2021-03-10T14:46:36.655020+0000 mgr.gibba020.yqfnwy (mgr.34427) 2865 : cluster [DBG] pgmap v1619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:38.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:38 gibba020 bash[25448]: audit 2021-03-10T14:46:36.678284+0000 mgr.gibba020.yqfnwy (mgr.34427) 2866 : audit [DBG] from='client.55963 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:46:38.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:38 gibba020 bash[25448]: audit 2021-03-10T14:46:36.906480+0000 mgr.gibba020.yqfnwy (mgr.34427) 2867 : audit [DBG] from='client.55969 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:46:40.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:40 gibba013 bash[29418]: cluster 2021-03-10T14:46:38.656333+0000 mgr.gibba020.yqfnwy (mgr.34427) 2868 : cluster [DBG] pgmap v1620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:40.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:40 gibba013 bash[30381]: cluster 2021-03-10T14:46:38.656333+0000 mgr.gibba020.yqfnwy (mgr.34427) 2868 : cluster [DBG] pgmap v1620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:40.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:40 gibba020 bash[25448]: cluster 2021-03-10T14:46:38.656333+0000 mgr.gibba020.yqfnwy (mgr.34427) 2868 : cluster [DBG] pgmap v1620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:42.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:42 gibba013 bash[29418]: cluster 2021-03-10T14:46:40.658033+0000 mgr.gibba020.yqfnwy (mgr.34427) 2869 : cluster [DBG] pgmap v1621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:42.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:42 gibba013 bash[30381]: cluster 2021-03-10T14:46:40.658033+0000 mgr.gibba020.yqfnwy (mgr.34427) 2869 : cluster [DBG] pgmap v1621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:42.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:42 gibba020 bash[25448]: cluster 2021-03-10T14:46:40.658033+0000 mgr.gibba020.yqfnwy (mgr.34427) 2869 : cluster [DBG] pgmap v1621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:43.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:43 gibba013 bash[29418]: cephadm 2021-03-10T14:46:41.372954+0000 mgr.gibba020.yqfnwy (mgr.34427) 2870 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:46:43.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:43 gibba013 bash[30381]: cephadm 2021-03-10T14:46:41.372954+0000 mgr.gibba020.yqfnwy (mgr.34427) 2870 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:46:43.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:43 gibba020 bash[25448]: cephadm 2021-03-10T14:46:41.372954+0000 mgr.gibba020.yqfnwy (mgr.34427) 2870 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:46:44.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:44 gibba013 bash[29418]: cluster 2021-03-10T14:46:42.659436+0000 mgr.gibba020.yqfnwy (mgr.34427) 2871 : cluster [DBG] pgmap v1622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:44.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:44 gibba013 bash[30381]: cluster 2021-03-10T14:46:42.659436+0000 mgr.gibba020.yqfnwy (mgr.34427) 2871 : cluster [DBG] pgmap v1622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:44.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:44 gibba020 bash[25448]: cluster 2021-03-10T14:46:42.659436+0000 mgr.gibba020.yqfnwy (mgr.34427) 2871 : cluster [DBG] pgmap v1622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:46.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:46 gibba013 bash[29418]: cluster 2021-03-10T14:46:44.661031+0000 mgr.gibba020.yqfnwy (mgr.34427) 2872 : cluster [DBG] pgmap v1623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:46.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:46 gibba013 bash[30381]: cluster 2021-03-10T14:46:44.661031+0000 mgr.gibba020.yqfnwy (mgr.34427) 2872 : cluster [DBG] pgmap v1623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:46.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:46 gibba020 bash[25448]: cluster 2021-03-10T14:46:44.661031+0000 mgr.gibba020.yqfnwy (mgr.34427) 2872 : cluster [DBG] pgmap v1623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:48.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:48 gibba013 bash[29418]: cluster 2021-03-10T14:46:46.661913+0000 mgr.gibba020.yqfnwy (mgr.34427) 2873 : cluster [DBG] pgmap v1624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:48.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:48 gibba013 bash[30381]: cluster 2021-03-10T14:46:46.661913+0000 mgr.gibba020.yqfnwy (mgr.34427) 2873 : cluster [DBG] pgmap v1624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:48.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:48 gibba020 bash[25448]: cluster 2021-03-10T14:46:46.661913+0000 mgr.gibba020.yqfnwy (mgr.34427) 2873 : cluster [DBG] pgmap v1624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:49.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:49 gibba013 bash[29418]: cluster 2021-03-10T14:46:48.663117+0000 mgr.gibba020.yqfnwy (mgr.34427) 2874 : cluster [DBG] pgmap v1625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:49.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:49 gibba013 bash[30381]: cluster 2021-03-10T14:46:48.663117+0000 mgr.gibba020.yqfnwy (mgr.34427) 2874 : cluster [DBG] pgmap v1625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:49.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:49 gibba020 bash[25448]: cluster 2021-03-10T14:46:48.663117+0000 mgr.gibba020.yqfnwy (mgr.34427) 2874 : cluster [DBG] pgmap v1625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:52.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:52 gibba013 bash[29418]: cluster 2021-03-10T14:46:50.664847+0000 mgr.gibba020.yqfnwy (mgr.34427) 2875 : cluster [DBG] pgmap v1626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:52.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:52 gibba013 bash[30381]: cluster 2021-03-10T14:46:50.664847+0000 mgr.gibba020.yqfnwy (mgr.34427) 2875 : cluster [DBG] pgmap v1626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:52.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:52 gibba020 bash[25448]: cluster 2021-03-10T14:46:50.664847+0000 mgr.gibba020.yqfnwy (mgr.34427) 2875 : cluster [DBG] pgmap v1626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:54.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:54 gibba013 bash[29418]: cluster 2021-03-10T14:46:52.666325+0000 mgr.gibba020.yqfnwy (mgr.34427) 2876 : cluster [DBG] pgmap v1627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:54.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:54 gibba013 bash[30381]: cluster 2021-03-10T14:46:52.666325+0000 mgr.gibba020.yqfnwy (mgr.34427) 2876 : cluster [DBG] pgmap v1627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:54.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:54 gibba020 bash[25448]: cluster 2021-03-10T14:46:52.666325+0000 mgr.gibba020.yqfnwy (mgr.34427) 2876 : cluster [DBG] pgmap v1627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:56.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:56 gibba013 bash[29418]: cluster 2021-03-10T14:46:54.667918+0000 mgr.gibba020.yqfnwy (mgr.34427) 2877 : cluster [DBG] pgmap v1628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:56.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:56 gibba013 bash[30381]: cluster 2021-03-10T14:46:54.667918+0000 mgr.gibba020.yqfnwy (mgr.34427) 2877 : cluster [DBG] pgmap v1628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:56.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:56 gibba020 bash[25448]: cluster 2021-03-10T14:46:54.667918+0000 mgr.gibba020.yqfnwy (mgr.34427) 2877 : cluster [DBG] pgmap v1628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:58.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:58 gibba013 bash[29418]: cephadm 2021-03-10T14:46:56.383723+0000 mgr.gibba020.yqfnwy (mgr.34427) 2878 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:46:58.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:46:58 gibba013 bash[29418]: cluster 2021-03-10T14:46:56.669031+0000 mgr.gibba020.yqfnwy (mgr.34427) 2879 : cluster [DBG] pgmap v1629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:58.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:58 gibba013 bash[30381]: cephadm 2021-03-10T14:46:56.383723+0000 mgr.gibba020.yqfnwy (mgr.34427) 2878 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:46:58.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:46:58 gibba013 bash[30381]: cluster 2021-03-10T14:46:56.669031+0000 mgr.gibba020.yqfnwy (mgr.34427) 2879 : cluster [DBG] pgmap v1629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:46:58.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:58 gibba020 bash[25448]: cephadm 2021-03-10T14:46:56.383723+0000 mgr.gibba020.yqfnwy (mgr.34427) 2878 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:46:58.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:46:58 gibba020 bash[25448]: cluster 2021-03-10T14:46:56.669031+0000 mgr.gibba020.yqfnwy (mgr.34427) 2879 : cluster [DBG] pgmap v1629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:00.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:00 gibba013 bash[29418]: cluster 2021-03-10T14:46:58.670297+0000 mgr.gibba020.yqfnwy (mgr.34427) 2880 : cluster [DBG] pgmap v1630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:00.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:00 gibba013 bash[30381]: cluster 2021-03-10T14:46:58.670297+0000 mgr.gibba020.yqfnwy (mgr.34427) 2880 : cluster [DBG] pgmap v1630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:00.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:00 gibba020 bash[25448]: cluster 2021-03-10T14:46:58.670297+0000 mgr.gibba020.yqfnwy (mgr.34427) 2880 : cluster [DBG] pgmap v1630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:02.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:02 gibba013 bash[29418]: cluster 2021-03-10T14:47:00.672078+0000 mgr.gibba020.yqfnwy (mgr.34427) 2881 : cluster [DBG] pgmap v1631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:02.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:02 gibba013 bash[30381]: cluster 2021-03-10T14:47:00.672078+0000 mgr.gibba020.yqfnwy (mgr.34427) 2881 : cluster [DBG] pgmap v1631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:02.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:02 gibba020 bash[25448]: cluster 2021-03-10T14:47:00.672078+0000 mgr.gibba020.yqfnwy (mgr.34427) 2881 : cluster [DBG] pgmap v1631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:04.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:04 gibba013 bash[29418]: cluster 2021-03-10T14:47:02.673641+0000 mgr.gibba020.yqfnwy (mgr.34427) 2882 : cluster [DBG] pgmap v1632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:04.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:04 gibba013 bash[30381]: cluster 2021-03-10T14:47:02.673641+0000 mgr.gibba020.yqfnwy (mgr.34427) 2882 : cluster [DBG] pgmap v1632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:04.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:04 gibba020 bash[25448]: cluster 2021-03-10T14:47:02.673641+0000 mgr.gibba020.yqfnwy (mgr.34427) 2882 : cluster [DBG] pgmap v1632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:06.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:06 gibba013 bash[29418]: cluster 2021-03-10T14:47:04.675127+0000 mgr.gibba020.yqfnwy (mgr.34427) 2883 : cluster [DBG] pgmap v1633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:06 gibba013 bash[29418]: audit 2021-03-10T14:47:06.234956+0000 mon.a (mon.0) 1413 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T14:47:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:06 gibba013 bash[29418]: audit 2021-03-10T14:47:06.235763+0000 mon.a (mon.0) 1414 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:47:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:06 gibba013 bash[29418]: audit 2021-03-10T14:47:06.236543+0000 mon.a (mon.0) 1415 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:47:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:06 gibba013 bash[29418]: audit 2021-03-10T14:47:06.237316+0000 mon.a (mon.0) 1416 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:47:06.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:06 gibba013 bash[29418]: audit 2021-03-10T14:47:06.256758+0000 mon.a (mon.0) 1417 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:47:06.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:06 gibba013 bash[29418]: audit 2021-03-10T14:47:06.257422+0000 mon.a (mon.0) 1418 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:47:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:06 gibba013 bash[30381]: cluster 2021-03-10T14:47:04.675127+0000 mgr.gibba020.yqfnwy (mgr.34427) 2883 : cluster [DBG] pgmap v1633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:06 gibba013 bash[30381]: audit 2021-03-10T14:47:06.234956+0000 mon.a (mon.0) 1413 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T14:47:06.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:06 gibba013 bash[30381]: audit 2021-03-10T14:47:06.235763+0000 mon.a (mon.0) 1414 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:47:06.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:06 gibba013 bash[30381]: audit 2021-03-10T14:47:06.236543+0000 mon.a (mon.0) 1415 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:47:06.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:06 gibba013 bash[30381]: audit 2021-03-10T14:47:06.237316+0000 mon.a (mon.0) 1416 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:47:06.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:06 gibba013 bash[30381]: audit 2021-03-10T14:47:06.256758+0000 mon.a (mon.0) 1417 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:47:06.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:06 gibba013 bash[30381]: audit 2021-03-10T14:47:06.257422+0000 mon.a (mon.0) 1418 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:47:06.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:06 gibba020 bash[25448]: cluster 2021-03-10T14:47:04.675127+0000 mgr.gibba020.yqfnwy (mgr.34427) 2883 : cluster [DBG] pgmap v1633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:06 gibba020 bash[25448]: audit 2021-03-10T14:47:06.234956+0000 mon.a (mon.0) 1413 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T14:47:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:06 gibba020 bash[25448]: audit 2021-03-10T14:47:06.235763+0000 mon.a (mon.0) 1414 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:47:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:06 gibba020 bash[25448]: audit 2021-03-10T14:47:06.236543+0000 mon.a (mon.0) 1415 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T14:47:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:06 gibba020 bash[25448]: audit 2021-03-10T14:47:06.237316+0000 mon.a (mon.0) 1416 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:47:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:06 gibba020 bash[25448]: audit 2021-03-10T14:47:06.256758+0000 mon.a (mon.0) 1417 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:47:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:06 gibba020 bash[25448]: audit 2021-03-10T14:47:06.257422+0000 mon.a (mon.0) 1418 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:47:07.420 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:47:07.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:07 gibba013 bash[29418]: cluster 2021-03-10T14:47:06.675883+0000 mgr.gibba020.yqfnwy (mgr.34427) 2884 : cluster [DBG] pgmap v1634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:07.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:07 gibba013 bash[30381]: cluster 2021-03-10T14:47:06.675883+0000 mgr.gibba020.yqfnwy (mgr.34427) 2884 : cluster [DBG] pgmap v1634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:07.652 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:47:07.653 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (53m) 9m ago 59m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:47:07.653 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (58m) 7m ago 58m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:47:07.653 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (54m) 7m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:47:07.653 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (54m) 7m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:47:07.653 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (53m) 9m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:47:07.654 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (53m) 9m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:47:07.654 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (52m) 7m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:47:07.654 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (52m) 9m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:47:07.654 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (59m) 9m ago 59m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:47:07.654 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (59m) 7m ago 59m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:47:07.655 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (51m) 9m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:47:07.655 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (51m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:47:07.655 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (51m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:47:07.655 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (50m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:47:07.656 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (50m) 7m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:47:07.656 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (49m) 7m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:47:07.656 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (49m) 7m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:47:07.656 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (48m) 7m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:47:07.656 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (58m) 7m ago 59m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:47:07.657 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 7m ago 57m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:47:07.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:07 gibba020 bash[25448]: cluster 2021-03-10T14:47:06.675883+0000 mgr.gibba020.yqfnwy (mgr.34427) 2884 : cluster [DBG] pgmap v1634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:07.902 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:47:07.902 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:47:07.902 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:47:07.903 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:47:07.903 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:47:07.903 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:47:07.903 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:47:07.903 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:47:07.904 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:47:07.904 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:47:07.904 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:47:07.904 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:47:07.905 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:47:07.905 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:47:07.905 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:47:08.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:08 gibba013 bash[29418]: audit 2021-03-10T14:47:07.408427+0000 mgr.gibba020.yqfnwy (mgr.34427) 2885 : audit [DBG] from='client.45996 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:47:08.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:08 gibba013 bash[29418]: audit 2021-03-10T14:47:07.637464+0000 mgr.gibba020.yqfnwy (mgr.34427) 2886 : audit [DBG] from='client.55987 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:47:08.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:08 gibba013 bash[29418]: audit 2021-03-10T14:47:07.900088+0000 mon.a (mon.0) 1419 : audit [DBG] from='client.? 172.21.2.113:0/3282396741' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:08.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:08 gibba013 bash[30381]: audit 2021-03-10T14:47:07.408427+0000 mgr.gibba020.yqfnwy (mgr.34427) 2885 : audit [DBG] from='client.45996 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:47:08.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:08 gibba013 bash[30381]: audit 2021-03-10T14:47:07.637464+0000 mgr.gibba020.yqfnwy (mgr.34427) 2886 : audit [DBG] from='client.55987 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:47:08.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:08 gibba013 bash[30381]: audit 2021-03-10T14:47:07.900088+0000 mon.a (mon.0) 1419 : audit [DBG] from='client.? 172.21.2.113:0/3282396741' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:08.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:08 gibba020 bash[25448]: audit 2021-03-10T14:47:07.408427+0000 mgr.gibba020.yqfnwy (mgr.34427) 2885 : audit [DBG] from='client.45996 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:47:08.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:08 gibba020 bash[25448]: audit 2021-03-10T14:47:07.637464+0000 mgr.gibba020.yqfnwy (mgr.34427) 2886 : audit [DBG] from='client.55987 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:47:08.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:08 gibba020 bash[25448]: audit 2021-03-10T14:47:07.900088+0000 mon.a (mon.0) 1419 : audit [DBG] from='client.? 172.21.2.113:0/3282396741' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:09.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:09 gibba013 bash[29418]: cluster 2021-03-10T14:47:08.677492+0000 mgr.gibba020.yqfnwy (mgr.34427) 2887 : cluster [DBG] pgmap v1635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:09.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:09 gibba013 bash[30381]: cluster 2021-03-10T14:47:08.677492+0000 mgr.gibba020.yqfnwy (mgr.34427) 2887 : cluster [DBG] pgmap v1635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:09.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:09 gibba020 bash[25448]: cluster 2021-03-10T14:47:08.677492+0000 mgr.gibba020.yqfnwy (mgr.34427) 2887 : cluster [DBG] pgmap v1635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:12.609 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:12 gibba013 bash[29418]: cluster 2021-03-10T14:47:10.679224+0000 mgr.gibba020.yqfnwy (mgr.34427) 2888 : cluster [DBG] pgmap v1636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:12.610 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:12 gibba013 bash[29418]: audit 2021-03-10T14:47:11.401622+0000 mon.a (mon.0) 1420 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:47:12.610 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:12 gibba013 bash[29418]: audit 2021-03-10T14:47:11.409004+0000 mon.a (mon.0) 1421 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T14:47:12.610 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:12 gibba013 bash[30381]: cluster 2021-03-10T14:47:10.679224+0000 mgr.gibba020.yqfnwy (mgr.34427) 2888 : cluster [DBG] pgmap v1636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:12.611 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:12 gibba013 bash[30381]: audit 2021-03-10T14:47:11.401622+0000 mon.a (mon.0) 1420 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:47:12.611 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:12 gibba013 bash[30381]: audit 2021-03-10T14:47:11.409004+0000 mon.a (mon.0) 1421 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T14:47:12.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:12 gibba020 bash[25448]: cluster 2021-03-10T14:47:10.679224+0000 mgr.gibba020.yqfnwy (mgr.34427) 2888 : cluster [DBG] pgmap v1636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:12.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:12 gibba020 bash[25448]: audit 2021-03-10T14:47:11.401622+0000 mon.a (mon.0) 1420 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:47:12.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:12 gibba020 bash[25448]: audit 2021-03-10T14:47:11.409004+0000 mon.a (mon.0) 1421 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T14:47:13.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:13 gibba013 bash[29418]: cephadm 2021-03-10T14:47:11.407535+0000 mgr.gibba020.yqfnwy (mgr.34427) 2889 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:47:13.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:13 gibba013 bash[30381]: cephadm 2021-03-10T14:47:11.407535+0000 mgr.gibba020.yqfnwy (mgr.34427) 2889 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:47:13.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:13 gibba020 bash[25448]: cephadm 2021-03-10T14:47:11.407535+0000 mgr.gibba020.yqfnwy (mgr.34427) 2889 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:47:14.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:14 gibba013 bash[29418]: cluster 2021-03-10T14:47:12.680756+0000 mgr.gibba020.yqfnwy (mgr.34427) 2890 : cluster [DBG] pgmap v1637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:14.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:14 gibba013 bash[30381]: cluster 2021-03-10T14:47:12.680756+0000 mgr.gibba020.yqfnwy (mgr.34427) 2890 : cluster [DBG] pgmap v1637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:14.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:14 gibba020 bash[25448]: cluster 2021-03-10T14:47:12.680756+0000 mgr.gibba020.yqfnwy (mgr.34427) 2890 : cluster [DBG] pgmap v1637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:16.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:16 gibba013 bash[29418]: cluster 2021-03-10T14:47:14.682145+0000 mgr.gibba020.yqfnwy (mgr.34427) 2891 : cluster [DBG] pgmap v1638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:16.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:16 gibba013 bash[29418]: audit 2021-03-10T14:47:16.047964+0000 mon.a (mon.0) 1422 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:47:16.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:16 gibba013 bash[29418]: audit 2021-03-10T14:47:16.225551+0000 mon.a (mon.0) 1423 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:47:16.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:16 gibba013 bash[30381]: cluster 2021-03-10T14:47:14.682145+0000 mgr.gibba020.yqfnwy (mgr.34427) 2891 : cluster [DBG] pgmap v1638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:16.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:16 gibba013 bash[30381]: audit 2021-03-10T14:47:16.047964+0000 mon.a (mon.0) 1422 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:47:16.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:16 gibba013 bash[30381]: audit 2021-03-10T14:47:16.225551+0000 mon.a (mon.0) 1423 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:47:16.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:16 gibba020 bash[25448]: cluster 2021-03-10T14:47:14.682145+0000 mgr.gibba020.yqfnwy (mgr.34427) 2891 : cluster [DBG] pgmap v1638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:16.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:16 gibba020 bash[25448]: audit 2021-03-10T14:47:16.047964+0000 mon.a (mon.0) 1422 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:47:16.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:16 gibba020 bash[25448]: audit 2021-03-10T14:47:16.225551+0000 mon.a (mon.0) 1423 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:47:17.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:17 gibba013 bash[29418]: cephadm 2021-03-10T14:47:16.226085+0000 mgr.gibba020.yqfnwy (mgr.34427) 2892 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:47:17.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:17 gibba013 bash[29418]: audit 2021-03-10T14:47:16.424569+0000 mon.a (mon.0) 1424 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:47:17.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:17 gibba013 bash[29418]: audit 2021-03-10T14:47:16.430227+0000 mon.a (mon.0) 1425 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:47:17.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:17 gibba013 bash[29418]: audit 2021-03-10T14:47:16.432475+0000 mon.a (mon.0) 1426 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:17.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:17 gibba013 bash[29418]: audit 2021-03-10T14:47:16.434652+0000 mon.a (mon.0) 1427 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:17.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:17 gibba013 bash[29418]: audit 2021-03-10T14:47:16.437203+0000 mon.a (mon.0) 1428 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:17.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:17 gibba013 bash[29418]: audit 2021-03-10T14:47:16.441890+0000 mon.a (mon.0) 1429 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:17.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:17 gibba013 bash[29418]: audit 2021-03-10T14:47:16.444485+0000 mon.a (mon.0) 1430 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:17.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:17 gibba013 bash[30381]: cephadm 2021-03-10T14:47:16.226085+0000 mgr.gibba020.yqfnwy (mgr.34427) 2892 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:47:17.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:17 gibba013 bash[30381]: audit 2021-03-10T14:47:16.424569+0000 mon.a (mon.0) 1424 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:47:17.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:17 gibba013 bash[30381]: audit 2021-03-10T14:47:16.430227+0000 mon.a (mon.0) 1425 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:47:17.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:17 gibba013 bash[30381]: audit 2021-03-10T14:47:16.432475+0000 mon.a (mon.0) 1426 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:17.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:17 gibba013 bash[30381]: audit 2021-03-10T14:47:16.434652+0000 mon.a (mon.0) 1427 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:17.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:17 gibba013 bash[30381]: audit 2021-03-10T14:47:16.437203+0000 mon.a (mon.0) 1428 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:17.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:17 gibba013 bash[30381]: audit 2021-03-10T14:47:16.441890+0000 mon.a (mon.0) 1429 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:17.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:17 gibba013 bash[30381]: audit 2021-03-10T14:47:16.444485+0000 mon.a (mon.0) 1430 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:17.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:17 gibba020 bash[25448]: cephadm 2021-03-10T14:47:16.226085+0000 mgr.gibba020.yqfnwy (mgr.34427) 2892 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:47:17.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:17 gibba020 bash[25448]: audit 2021-03-10T14:47:16.424569+0000 mon.a (mon.0) 1424 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:47:17.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:17 gibba020 bash[25448]: audit 2021-03-10T14:47:16.430227+0000 mon.a (mon.0) 1425 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:47:17.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:17 gibba020 bash[25448]: audit 2021-03-10T14:47:16.432475+0000 mon.a (mon.0) 1426 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:17.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:17 gibba020 bash[25448]: audit 2021-03-10T14:47:16.434652+0000 mon.a (mon.0) 1427 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:17.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:17 gibba020 bash[25448]: audit 2021-03-10T14:47:16.437203+0000 mon.a (mon.0) 1428 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:17.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:17 gibba020 bash[25448]: audit 2021-03-10T14:47:16.441890+0000 mon.a (mon.0) 1429 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:17.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:17 gibba020 bash[25448]: audit 2021-03-10T14:47:16.444485+0000 mon.a (mon.0) 1430 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:18.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:18 gibba013 bash[29418]: cephadm 2021-03-10T14:47:16.428282+0000 mgr.gibba020.yqfnwy (mgr.34427) 2893 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:47:18.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:18 gibba013 bash[29418]: cephadm 2021-03-10T14:47:16.430878+0000 mgr.gibba020.yqfnwy (mgr.34427) 2894 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:47:18.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:18 gibba013 bash[29418]: cephadm 2021-03-10T14:47:16.432980+0000 mgr.gibba020.yqfnwy (mgr.34427) 2895 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:47:18.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:18 gibba013 bash[29418]: cephadm 2021-03-10T14:47:16.433017+0000 mgr.gibba020.yqfnwy (mgr.34427) 2896 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:47:18.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:18 gibba013 bash[29418]: cephadm 2021-03-10T14:47:16.435572+0000 mgr.gibba020.yqfnwy (mgr.34427) 2897 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:47:18.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:18 gibba013 bash[29418]: cephadm 2021-03-10T14:47:16.435617+0000 mgr.gibba020.yqfnwy (mgr.34427) 2898 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:47:18.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:18 gibba013 bash[29418]: cephadm 2021-03-10T14:47:16.438020+0000 mgr.gibba020.yqfnwy (mgr.34427) 2899 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:47:18.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:18 gibba013 bash[29418]: cephadm 2021-03-10T14:47:16.440112+0000 mgr.gibba020.yqfnwy (mgr.34427) 2900 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:47:18.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:18 gibba013 bash[29418]: cephadm 2021-03-10T14:47:16.440157+0000 mgr.gibba020.yqfnwy (mgr.34427) 2901 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:47:18.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:18 gibba013 bash[29418]: cephadm 2021-03-10T14:47:16.442519+0000 mgr.gibba020.yqfnwy (mgr.34427) 2902 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:47:18.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:18 gibba013 bash[29418]: cephadm 2021-03-10T14:47:16.443005+0000 mgr.gibba020.yqfnwy (mgr.34427) 2903 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:47:18.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:18 gibba013 bash[29418]: cephadm 2021-03-10T14:47:16.444969+0000 mgr.gibba020.yqfnwy (mgr.34427) 2904 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:47:18.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:18 gibba013 bash[29418]: cephadm 2021-03-10T14:47:16.445019+0000 mgr.gibba020.yqfnwy (mgr.34427) 2905 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:47:18.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:18 gibba013 bash[29418]: cephadm 2021-03-10T14:47:16.445165+0000 mgr.gibba020.yqfnwy (mgr.34427) 2906 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:47:18.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:18 gibba013 bash[29418]: cluster 2021-03-10T14:47:16.683207+0000 mgr.gibba020.yqfnwy (mgr.34427) 2907 : cluster [DBG] pgmap v1639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:18.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:18 gibba013 bash[30381]: cephadm 2021-03-10T14:47:16.428282+0000 mgr.gibba020.yqfnwy (mgr.34427) 2893 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:47:18.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:18 gibba013 bash[30381]: cephadm 2021-03-10T14:47:16.430878+0000 mgr.gibba020.yqfnwy (mgr.34427) 2894 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:47:18.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:18 gibba013 bash[30381]: cephadm 2021-03-10T14:47:16.432980+0000 mgr.gibba020.yqfnwy (mgr.34427) 2895 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:47:18.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:18 gibba013 bash[30381]: cephadm 2021-03-10T14:47:16.433017+0000 mgr.gibba020.yqfnwy (mgr.34427) 2896 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:47:18.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:18 gibba013 bash[30381]: cephadm 2021-03-10T14:47:16.435572+0000 mgr.gibba020.yqfnwy (mgr.34427) 2897 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:47:18.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:18 gibba013 bash[30381]: cephadm 2021-03-10T14:47:16.435617+0000 mgr.gibba020.yqfnwy (mgr.34427) 2898 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:47:18.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:18 gibba013 bash[30381]: cephadm 2021-03-10T14:47:16.438020+0000 mgr.gibba020.yqfnwy (mgr.34427) 2899 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:47:18.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:18 gibba013 bash[30381]: cephadm 2021-03-10T14:47:16.440112+0000 mgr.gibba020.yqfnwy (mgr.34427) 2900 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:47:18.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:18 gibba013 bash[30381]: cephadm 2021-03-10T14:47:16.440157+0000 mgr.gibba020.yqfnwy (mgr.34427) 2901 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:47:18.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:18 gibba013 bash[30381]: cephadm 2021-03-10T14:47:16.442519+0000 mgr.gibba020.yqfnwy (mgr.34427) 2902 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:47:18.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:18 gibba013 bash[30381]: cephadm 2021-03-10T14:47:16.443005+0000 mgr.gibba020.yqfnwy (mgr.34427) 2903 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:47:18.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:18 gibba013 bash[30381]: cephadm 2021-03-10T14:47:16.444969+0000 mgr.gibba020.yqfnwy (mgr.34427) 2904 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:47:18.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:18 gibba013 bash[30381]: cephadm 2021-03-10T14:47:16.445019+0000 mgr.gibba020.yqfnwy (mgr.34427) 2905 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:47:18.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:18 gibba013 bash[30381]: cephadm 2021-03-10T14:47:16.445165+0000 mgr.gibba020.yqfnwy (mgr.34427) 2906 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:47:18.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:18 gibba013 bash[30381]: cluster 2021-03-10T14:47:16.683207+0000 mgr.gibba020.yqfnwy (mgr.34427) 2907 : cluster [DBG] pgmap v1639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:18.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:18 gibba020 bash[25448]: cephadm 2021-03-10T14:47:16.428282+0000 mgr.gibba020.yqfnwy (mgr.34427) 2893 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:47:18.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:18 gibba020 bash[25448]: cephadm 2021-03-10T14:47:16.430878+0000 mgr.gibba020.yqfnwy (mgr.34427) 2894 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:47:18.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:18 gibba020 bash[25448]: cephadm 2021-03-10T14:47:16.432980+0000 mgr.gibba020.yqfnwy (mgr.34427) 2895 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:47:18.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:18 gibba020 bash[25448]: cephadm 2021-03-10T14:47:16.433017+0000 mgr.gibba020.yqfnwy (mgr.34427) 2896 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:47:18.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:18 gibba020 bash[25448]: cephadm 2021-03-10T14:47:16.435572+0000 mgr.gibba020.yqfnwy (mgr.34427) 2897 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:47:18.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:18 gibba020 bash[25448]: cephadm 2021-03-10T14:47:16.435617+0000 mgr.gibba020.yqfnwy (mgr.34427) 2898 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:47:18.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:18 gibba020 bash[25448]: cephadm 2021-03-10T14:47:16.438020+0000 mgr.gibba020.yqfnwy (mgr.34427) 2899 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:47:18.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:18 gibba020 bash[25448]: cephadm 2021-03-10T14:47:16.440112+0000 mgr.gibba020.yqfnwy (mgr.34427) 2900 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:47:18.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:18 gibba020 bash[25448]: cephadm 2021-03-10T14:47:16.440157+0000 mgr.gibba020.yqfnwy (mgr.34427) 2901 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:47:18.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:18 gibba020 bash[25448]: cephadm 2021-03-10T14:47:16.442519+0000 mgr.gibba020.yqfnwy (mgr.34427) 2902 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:47:18.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:18 gibba020 bash[25448]: cephadm 2021-03-10T14:47:16.443005+0000 mgr.gibba020.yqfnwy (mgr.34427) 2903 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:47:18.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:18 gibba020 bash[25448]: cephadm 2021-03-10T14:47:16.444969+0000 mgr.gibba020.yqfnwy (mgr.34427) 2904 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:47:18.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:18 gibba020 bash[25448]: cephadm 2021-03-10T14:47:16.445019+0000 mgr.gibba020.yqfnwy (mgr.34427) 2905 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:47:18.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:18 gibba020 bash[25448]: cephadm 2021-03-10T14:47:16.445165+0000 mgr.gibba020.yqfnwy (mgr.34427) 2906 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:47:18.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:18 gibba020 bash[25448]: cluster 2021-03-10T14:47:16.683207+0000 mgr.gibba020.yqfnwy (mgr.34427) 2907 : cluster [DBG] pgmap v1639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:20.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:20 gibba013 bash[29418]: cluster 2021-03-10T14:47:18.684657+0000 mgr.gibba020.yqfnwy (mgr.34427) 2908 : cluster [DBG] pgmap v1640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:20.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:20 gibba013 bash[30381]: cluster 2021-03-10T14:47:18.684657+0000 mgr.gibba020.yqfnwy (mgr.34427) 2908 : cluster [DBG] pgmap v1640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:20.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:20 gibba020 bash[25448]: cluster 2021-03-10T14:47:18.684657+0000 mgr.gibba020.yqfnwy (mgr.34427) 2908 : cluster [DBG] pgmap v1640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:22.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:22 gibba013 bash[29418]: cluster 2021-03-10T14:47:20.686293+0000 mgr.gibba020.yqfnwy (mgr.34427) 2909 : cluster [DBG] pgmap v1641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:22.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:22 gibba013 bash[30381]: cluster 2021-03-10T14:47:20.686293+0000 mgr.gibba020.yqfnwy (mgr.34427) 2909 : cluster [DBG] pgmap v1641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:22.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:22 gibba020 bash[25448]: cluster 2021-03-10T14:47:20.686293+0000 mgr.gibba020.yqfnwy (mgr.34427) 2909 : cluster [DBG] pgmap v1641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:23.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:23 gibba020 bash[25448]: cluster 2021-03-10T14:47:22.687728+0000 mgr.gibba020.yqfnwy (mgr.34427) 2910 : cluster [DBG] pgmap v1642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:23.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:23 gibba013 bash[29418]: cluster 2021-03-10T14:47:22.687728+0000 mgr.gibba020.yqfnwy (mgr.34427) 2910 : cluster [DBG] pgmap v1642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:23.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:23 gibba013 bash[30381]: cluster 2021-03-10T14:47:22.687728+0000 mgr.gibba020.yqfnwy (mgr.34427) 2910 : cluster [DBG] pgmap v1642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:26.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:25 gibba013 bash[29418]: cluster 2021-03-10T14:47:24.689377+0000 mgr.gibba020.yqfnwy (mgr.34427) 2911 : cluster [DBG] pgmap v1643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:26.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:25 gibba013 bash[30381]: cluster 2021-03-10T14:47:24.689377+0000 mgr.gibba020.yqfnwy (mgr.34427) 2911 : cluster [DBG] pgmap v1643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:26.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:25 gibba020 bash[25448]: cluster 2021-03-10T14:47:24.689377+0000 mgr.gibba020.yqfnwy (mgr.34427) 2911 : cluster [DBG] pgmap v1643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:28.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:28 gibba013 bash[29418]: cluster 2021-03-10T14:47:26.690553+0000 mgr.gibba020.yqfnwy (mgr.34427) 2912 : cluster [DBG] pgmap v1644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:28.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:28 gibba013 bash[30381]: cluster 2021-03-10T14:47:26.690553+0000 mgr.gibba020.yqfnwy (mgr.34427) 2912 : cluster [DBG] pgmap v1644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:28.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:28 gibba020 bash[25448]: cluster 2021-03-10T14:47:26.690553+0000 mgr.gibba020.yqfnwy (mgr.34427) 2912 : cluster [DBG] pgmap v1644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:30.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:30 gibba013 bash[29418]: cluster 2021-03-10T14:47:28.692185+0000 mgr.gibba020.yqfnwy (mgr.34427) 2913 : cluster [DBG] pgmap v1645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:30.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:30 gibba013 bash[30381]: cluster 2021-03-10T14:47:28.692185+0000 mgr.gibba020.yqfnwy (mgr.34427) 2913 : cluster [DBG] pgmap v1645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:30.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:30 gibba020 bash[25448]: cluster 2021-03-10T14:47:28.692185+0000 mgr.gibba020.yqfnwy (mgr.34427) 2913 : cluster [DBG] pgmap v1645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:32.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:32 gibba013 bash[29418]: cluster 2021-03-10T14:47:30.693892+0000 mgr.gibba020.yqfnwy (mgr.34427) 2914 : cluster [DBG] pgmap v1646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:32.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:32 gibba013 bash[30381]: cluster 2021-03-10T14:47:30.693892+0000 mgr.gibba020.yqfnwy (mgr.34427) 2914 : cluster [DBG] pgmap v1646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:32.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:32 gibba020 bash[25448]: cluster 2021-03-10T14:47:30.693892+0000 mgr.gibba020.yqfnwy (mgr.34427) 2914 : cluster [DBG] pgmap v1646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:33.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:33 gibba013 bash[29418]: cephadm 2021-03-10T14:47:31.460921+0000 mgr.gibba020.yqfnwy (mgr.34427) 2915 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:47:33.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:33 gibba013 bash[30381]: cephadm 2021-03-10T14:47:31.460921+0000 mgr.gibba020.yqfnwy (mgr.34427) 2915 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:47:33.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:33 gibba020 bash[25448]: cephadm 2021-03-10T14:47:31.460921+0000 mgr.gibba020.yqfnwy (mgr.34427) 2915 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:47:34.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:34 gibba013 bash[29418]: cluster 2021-03-10T14:47:32.695283+0000 mgr.gibba020.yqfnwy (mgr.34427) 2916 : cluster [DBG] pgmap v1647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:34.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:34 gibba013 bash[30381]: cluster 2021-03-10T14:47:32.695283+0000 mgr.gibba020.yqfnwy (mgr.34427) 2916 : cluster [DBG] pgmap v1647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:34.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:34 gibba020 bash[25448]: cluster 2021-03-10T14:47:32.695283+0000 mgr.gibba020.yqfnwy (mgr.34427) 2916 : cluster [DBG] pgmap v1647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:36.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:36 gibba013 bash[29418]: cluster 2021-03-10T14:47:34.696765+0000 mgr.gibba020.yqfnwy (mgr.34427) 2917 : cluster [DBG] pgmap v1648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:36.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:36 gibba013 bash[30381]: cluster 2021-03-10T14:47:34.696765+0000 mgr.gibba020.yqfnwy (mgr.34427) 2917 : cluster [DBG] pgmap v1648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:36.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:36 gibba020 bash[25448]: cluster 2021-03-10T14:47:34.696765+0000 mgr.gibba020.yqfnwy (mgr.34427) 2917 : cluster [DBG] pgmap v1648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:37.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:37 gibba020 bash[25448]: cluster 2021-03-10T14:47:36.697578+0000 mgr.gibba020.yqfnwy (mgr.34427) 2918 : cluster [DBG] pgmap v1649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:37.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:37 gibba013 bash[29418]: cluster 2021-03-10T14:47:36.697578+0000 mgr.gibba020.yqfnwy (mgr.34427) 2918 : cluster [DBG] pgmap v1649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:37.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:37 gibba013 bash[30381]: cluster 2021-03-10T14:47:36.697578+0000 mgr.gibba020.yqfnwy (mgr.34427) 2918 : cluster [DBG] pgmap v1649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:38.145 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:47:38.398 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:47:38.398 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (54m) 9m ago 59m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:47:38.399 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (59m) 8m ago 59m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:47:38.399 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (54m) 8m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:47:38.399 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (54m) 8m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:47:38.399 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (53m) 9m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:47:38.400 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (53m) 9m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:47:38.400 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (53m) 8m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:47:38.400 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (53m) 9m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:47:38.400 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (59m) 9m ago 59m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:47:38.400 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (59m) 8m ago 59m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:47:38.401 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (52m) 9m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:47:38.401 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (51m) 9m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:47:38.401 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (51m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:47:38.401 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (51m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:47:38.402 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (50m) 8m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:47:38.402 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (50m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:47:38.402 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (49m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:47:38.402 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (49m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:47:38.402 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (59m) 8m ago 59m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:47:38.403 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 8m ago 57m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:47:38.648 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:47:38.648 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:47:38.648 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:47:38.648 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:47:38.649 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:47:38.649 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:47:38.649 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:47:38.649 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:47:38.649 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:47:38.650 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:47:38.650 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:47:38.650 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:47:38.650 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:47:38.650 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:47:38.651 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:47:38.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:38 gibba020 bash[25448]: audit 2021-03-10T14:47:38.132574+0000 mgr.gibba020.yqfnwy (mgr.34427) 2919 : audit [DBG] from='client.46014 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:47:38.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:38 gibba013 bash[29418]: audit 2021-03-10T14:47:38.132574+0000 mgr.gibba020.yqfnwy (mgr.34427) 2919 : audit [DBG] from='client.46014 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:47:38.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:38 gibba013 bash[30381]: audit 2021-03-10T14:47:38.132574+0000 mgr.gibba020.yqfnwy (mgr.34427) 2919 : audit [DBG] from='client.46014 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:47:39.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:39 gibba020 bash[25448]: audit 2021-03-10T14:47:38.356511+0000 mgr.gibba020.yqfnwy (mgr.34427) 2920 : audit [DBG] from='client.46020 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:47:39.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:39 gibba020 bash[25448]: audit 2021-03-10T14:47:38.645693+0000 mon.a (mon.0) 1431 : audit [DBG] from='client.? 172.21.2.113:0/343122776' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:39.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:39 gibba020 bash[25448]: cluster 2021-03-10T14:47:38.698804+0000 mgr.gibba020.yqfnwy (mgr.34427) 2921 : cluster [DBG] pgmap v1650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:39.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:39 gibba013 bash[29418]: audit 2021-03-10T14:47:38.356511+0000 mgr.gibba020.yqfnwy (mgr.34427) 2920 : audit [DBG] from='client.46020 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:47:39.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:39 gibba013 bash[29418]: audit 2021-03-10T14:47:38.645693+0000 mon.a (mon.0) 1431 : audit [DBG] from='client.? 172.21.2.113:0/343122776' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:39.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:39 gibba013 bash[29418]: cluster 2021-03-10T14:47:38.698804+0000 mgr.gibba020.yqfnwy (mgr.34427) 2921 : cluster [DBG] pgmap v1650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:39.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:39 gibba013 bash[30381]: audit 2021-03-10T14:47:38.356511+0000 mgr.gibba020.yqfnwy (mgr.34427) 2920 : audit [DBG] from='client.46020 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:47:39.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:39 gibba013 bash[30381]: audit 2021-03-10T14:47:38.645693+0000 mon.a (mon.0) 1431 : audit [DBG] from='client.? 172.21.2.113:0/343122776' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:47:39.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:39 gibba013 bash[30381]: cluster 2021-03-10T14:47:38.698804+0000 mgr.gibba020.yqfnwy (mgr.34427) 2921 : cluster [DBG] pgmap v1650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:42.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:42 gibba013 bash[29418]: cluster 2021-03-10T14:47:40.700320+0000 mgr.gibba020.yqfnwy (mgr.34427) 2922 : cluster [DBG] pgmap v1651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:42.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:42 gibba013 bash[30381]: cluster 2021-03-10T14:47:40.700320+0000 mgr.gibba020.yqfnwy (mgr.34427) 2922 : cluster [DBG] pgmap v1651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:42.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:42 gibba020 bash[25448]: cluster 2021-03-10T14:47:40.700320+0000 mgr.gibba020.yqfnwy (mgr.34427) 2922 : cluster [DBG] pgmap v1651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:44.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:44 gibba013 bash[29418]: cluster 2021-03-10T14:47:42.701618+0000 mgr.gibba020.yqfnwy (mgr.34427) 2923 : cluster [DBG] pgmap v1652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:44.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:44 gibba013 bash[30381]: cluster 2021-03-10T14:47:42.701618+0000 mgr.gibba020.yqfnwy (mgr.34427) 2923 : cluster [DBG] pgmap v1652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:44.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:44 gibba020 bash[25448]: cluster 2021-03-10T14:47:42.701618+0000 mgr.gibba020.yqfnwy (mgr.34427) 2923 : cluster [DBG] pgmap v1652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:46.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:46 gibba013 bash[29418]: cluster 2021-03-10T14:47:44.703222+0000 mgr.gibba020.yqfnwy (mgr.34427) 2924 : cluster [DBG] pgmap v1653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:46.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:46 gibba013 bash[30381]: cluster 2021-03-10T14:47:44.703222+0000 mgr.gibba020.yqfnwy (mgr.34427) 2924 : cluster [DBG] pgmap v1653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:46.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:46 gibba020 bash[25448]: cluster 2021-03-10T14:47:44.703222+0000 mgr.gibba020.yqfnwy (mgr.34427) 2924 : cluster [DBG] pgmap v1653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:48.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:48 gibba013 bash[29418]: cephadm 2021-03-10T14:47:46.476675+0000 mgr.gibba020.yqfnwy (mgr.34427) 2925 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:47:48.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:48 gibba013 bash[29418]: cluster 2021-03-10T14:47:46.704022+0000 mgr.gibba020.yqfnwy (mgr.34427) 2926 : cluster [DBG] pgmap v1654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:48.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:48 gibba013 bash[30381]: cephadm 2021-03-10T14:47:46.476675+0000 mgr.gibba020.yqfnwy (mgr.34427) 2925 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:47:48.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:48 gibba013 bash[30381]: cluster 2021-03-10T14:47:46.704022+0000 mgr.gibba020.yqfnwy (mgr.34427) 2926 : cluster [DBG] pgmap v1654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:48.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:48 gibba020 bash[25448]: cephadm 2021-03-10T14:47:46.476675+0000 mgr.gibba020.yqfnwy (mgr.34427) 2925 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:47:48.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:48 gibba020 bash[25448]: cluster 2021-03-10T14:47:46.704022+0000 mgr.gibba020.yqfnwy (mgr.34427) 2926 : cluster [DBG] pgmap v1654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:50.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:50 gibba013 bash[29418]: cluster 2021-03-10T14:47:48.705289+0000 mgr.gibba020.yqfnwy (mgr.34427) 2927 : cluster [DBG] pgmap v1655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:50.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:50 gibba013 bash[30381]: cluster 2021-03-10T14:47:48.705289+0000 mgr.gibba020.yqfnwy (mgr.34427) 2927 : cluster [DBG] pgmap v1655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:50.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:50 gibba020 bash[25448]: cluster 2021-03-10T14:47:48.705289+0000 mgr.gibba020.yqfnwy (mgr.34427) 2927 : cluster [DBG] pgmap v1655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:52.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:52 gibba013 bash[29418]: cluster 2021-03-10T14:47:50.706851+0000 mgr.gibba020.yqfnwy (mgr.34427) 2928 : cluster [DBG] pgmap v1656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:52.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:52 gibba013 bash[30381]: cluster 2021-03-10T14:47:50.706851+0000 mgr.gibba020.yqfnwy (mgr.34427) 2928 : cluster [DBG] pgmap v1656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:52.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:52 gibba020 bash[25448]: cluster 2021-03-10T14:47:50.706851+0000 mgr.gibba020.yqfnwy (mgr.34427) 2928 : cluster [DBG] pgmap v1656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:53.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:53 gibba020 bash[25448]: cluster 2021-03-10T14:47:52.708185+0000 mgr.gibba020.yqfnwy (mgr.34427) 2929 : cluster [DBG] pgmap v1657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:53.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:53 gibba013 bash[29418]: cluster 2021-03-10T14:47:52.708185+0000 mgr.gibba020.yqfnwy (mgr.34427) 2929 : cluster [DBG] pgmap v1657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:53.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:53 gibba013 bash[30381]: cluster 2021-03-10T14:47:52.708185+0000 mgr.gibba020.yqfnwy (mgr.34427) 2929 : cluster [DBG] pgmap v1657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:56.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:55 gibba013 bash[29418]: cluster 2021-03-10T14:47:54.709751+0000 mgr.gibba020.yqfnwy (mgr.34427) 2930 : cluster [DBG] pgmap v1658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:56.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:55 gibba013 bash[30381]: cluster 2021-03-10T14:47:54.709751+0000 mgr.gibba020.yqfnwy (mgr.34427) 2930 : cluster [DBG] pgmap v1658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:56.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:55 gibba020 bash[25448]: cluster 2021-03-10T14:47:54.709751+0000 mgr.gibba020.yqfnwy (mgr.34427) 2930 : cluster [DBG] pgmap v1658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:58.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:47:58 gibba013 bash[29418]: cluster 2021-03-10T14:47:56.711321+0000 mgr.gibba020.yqfnwy (mgr.34427) 2931 : cluster [DBG] pgmap v1659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:58.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:47:58 gibba013 bash[30381]: cluster 2021-03-10T14:47:56.711321+0000 mgr.gibba020.yqfnwy (mgr.34427) 2931 : cluster [DBG] pgmap v1659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:47:58.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:47:58 gibba020 bash[25448]: cluster 2021-03-10T14:47:56.711321+0000 mgr.gibba020.yqfnwy (mgr.34427) 2931 : cluster [DBG] pgmap v1659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:00.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:00 gibba013 bash[29418]: cluster 2021-03-10T14:47:58.712823+0000 mgr.gibba020.yqfnwy (mgr.34427) 2932 : cluster [DBG] pgmap v1660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:00.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:00 gibba013 bash[30381]: cluster 2021-03-10T14:47:58.712823+0000 mgr.gibba020.yqfnwy (mgr.34427) 2932 : cluster [DBG] pgmap v1660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:00.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:00 gibba020 bash[25448]: cluster 2021-03-10T14:47:58.712823+0000 mgr.gibba020.yqfnwy (mgr.34427) 2932 : cluster [DBG] pgmap v1660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:02.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:02 gibba013 bash[29418]: cluster 2021-03-10T14:48:00.714415+0000 mgr.gibba020.yqfnwy (mgr.34427) 2933 : cluster [DBG] pgmap v1661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:02.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:02 gibba013 bash[30381]: cluster 2021-03-10T14:48:00.714415+0000 mgr.gibba020.yqfnwy (mgr.34427) 2933 : cluster [DBG] pgmap v1661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:02.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:02 gibba020 bash[25448]: cluster 2021-03-10T14:48:00.714415+0000 mgr.gibba020.yqfnwy (mgr.34427) 2933 : cluster [DBG] pgmap v1661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:03.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:03 gibba013 bash[29418]: cephadm 2021-03-10T14:48:01.478254+0000 mgr.gibba020.yqfnwy (mgr.34427) 2934 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:48:03.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:03 gibba013 bash[30381]: cephadm 2021-03-10T14:48:01.478254+0000 mgr.gibba020.yqfnwy (mgr.34427) 2934 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:48:03.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:03 gibba020 bash[25448]: cephadm 2021-03-10T14:48:01.478254+0000 mgr.gibba020.yqfnwy (mgr.34427) 2934 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:48:04.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:04 gibba013 bash[29418]: cluster 2021-03-10T14:48:02.715810+0000 mgr.gibba020.yqfnwy (mgr.34427) 2935 : cluster [DBG] pgmap v1662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:04.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:04 gibba013 bash[30381]: cluster 2021-03-10T14:48:02.715810+0000 mgr.gibba020.yqfnwy (mgr.34427) 2935 : cluster [DBG] pgmap v1662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:04.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:04 gibba020 bash[25448]: cluster 2021-03-10T14:48:02.715810+0000 mgr.gibba020.yqfnwy (mgr.34427) 2935 : cluster [DBG] pgmap v1662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:05.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:05 gibba020 bash[25448]: cluster 2021-03-10T14:48:04.717364+0000 mgr.gibba020.yqfnwy (mgr.34427) 2936 : cluster [DBG] pgmap v1663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:05.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:05 gibba013 bash[29418]: cluster 2021-03-10T14:48:04.717364+0000 mgr.gibba020.yqfnwy (mgr.34427) 2936 : cluster [DBG] pgmap v1663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:05.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:05 gibba013 bash[30381]: cluster 2021-03-10T14:48:04.717364+0000 mgr.gibba020.yqfnwy (mgr.34427) 2936 : cluster [DBG] pgmap v1663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:06 gibba020 bash[25448]: audit 2021-03-10T14:48:06.246668+0000 mon.a (mon.0) 1432 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:48:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:06 gibba020 bash[25448]: audit 2021-03-10T14:48:06.247455+0000 mon.a (mon.0) 1433 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:48:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:06 gibba020 bash[25448]: audit 2021-03-10T14:48:06.248160+0000 mon.a (mon.0) 1434 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:48:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:06 gibba020 bash[25448]: audit 2021-03-10T14:48:06.248877+0000 mon.a (mon.0) 1435 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:48:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:06 gibba020 bash[25448]: audit 2021-03-10T14:48:06.259423+0000 mon.a (mon.0) 1436 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:48:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:06 gibba020 bash[25448]: audit 2021-03-10T14:48:06.260028+0000 mon.a (mon.0) 1437 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:48:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:06 gibba013 bash[29418]: audit 2021-03-10T14:48:06.246668+0000 mon.a (mon.0) 1432 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:48:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:06 gibba013 bash[29418]: audit 2021-03-10T14:48:06.247455+0000 mon.a (mon.0) 1433 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:48:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:06 gibba013 bash[29418]: audit 2021-03-10T14:48:06.248160+0000 mon.a (mon.0) 1434 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:48:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:06 gibba013 bash[29418]: audit 2021-03-10T14:48:06.248877+0000 mon.a (mon.0) 1435 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:48:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:06 gibba013 bash[29418]: audit 2021-03-10T14:48:06.259423+0000 mon.a (mon.0) 1436 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:48:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:06 gibba013 bash[29418]: audit 2021-03-10T14:48:06.260028+0000 mon.a (mon.0) 1437 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:48:06.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:06 gibba013 bash[30381]: audit 2021-03-10T14:48:06.246668+0000 mon.a (mon.0) 1432 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:48:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:06 gibba013 bash[30381]: audit 2021-03-10T14:48:06.247455+0000 mon.a (mon.0) 1433 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T14:48:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:06 gibba013 bash[30381]: audit 2021-03-10T14:48:06.248160+0000 mon.a (mon.0) 1434 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T14:48:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:06 gibba013 bash[30381]: audit 2021-03-10T14:48:06.248877+0000 mon.a (mon.0) 1435 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:48:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:06 gibba013 bash[30381]: audit 2021-03-10T14:48:06.259423+0000 mon.a (mon.0) 1436 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:48:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:06 gibba013 bash[30381]: audit 2021-03-10T14:48:06.260028+0000 mon.a (mon.0) 1437 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:48:07.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:07 gibba020 bash[25448]: cluster 2021-03-10T14:48:06.718845+0000 mgr.gibba020.yqfnwy (mgr.34427) 2937 : cluster [DBG] pgmap v1664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:07.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:07 gibba013 bash[29418]: cluster 2021-03-10T14:48:06.718845+0000 mgr.gibba020.yqfnwy (mgr.34427) 2937 : cluster [DBG] pgmap v1664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:07.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:07 gibba013 bash[30381]: cluster 2021-03-10T14:48:06.718845+0000 mgr.gibba020.yqfnwy (mgr.34427) 2937 : cluster [DBG] pgmap v1664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:08.894 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:48:09.122 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:48:09.122 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (54m) 10m ago 60m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:48:09.123 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (59m) 9m ago 59m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:48:09.123 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (55m) 9m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:48:09.123 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (55m) 9m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:48:09.123 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (54m) 10m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:48:09.123 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (54m) 10m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:48:09.124 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (53m) 9m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:48:09.124 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (53m) 10m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:48:09.124 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (60m) 10m ago 60m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:48:09.124 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (60m) 9m ago 60m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:48:09.124 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (52m) 10m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:48:09.125 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (52m) 10m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:48:09.125 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (52m) 10m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:48:09.125 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (51m) 10m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:48:09.125 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (51m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:48:09.125 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (50m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:48:09.126 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (50m) 9m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:48:09.126 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (49m) 9m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:48:09.126 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (59m) 9m ago 60m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:48:09.126 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 9m ago 58m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:48:09.371 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:48:09.372 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:48:09.372 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:48:09.372 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:48:09.372 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:48:09.373 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:48:09.373 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:48:09.373 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:48:09.373 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:48:09.373 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:48:09.374 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:48:09.374 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:48:09.374 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:48:09.374 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:48:09.375 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:48:10.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:09 gibba013 bash[29418]: cluster 2021-03-10T14:48:08.720252+0000 mgr.gibba020.yqfnwy (mgr.34427) 2938 : cluster [DBG] pgmap v1665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:10.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:09 gibba013 bash[29418]: audit 2021-03-10T14:48:08.881822+0000 mgr.gibba020.yqfnwy (mgr.34427) 2939 : audit [DBG] from='client.56017 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:48:10.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:09 gibba013 bash[29418]: audit 2021-03-10T14:48:09.106383+0000 mgr.gibba020.yqfnwy (mgr.34427) 2940 : audit [DBG] from='client.56023 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:48:10.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:09 gibba013 bash[29418]: audit 2021-03-10T14:48:09.369745+0000 mon.a (mon.0) 1438 : audit [DBG] from='client.? 172.21.2.113:0/2679640553' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:10.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:09 gibba013 bash[30381]: cluster 2021-03-10T14:48:08.720252+0000 mgr.gibba020.yqfnwy (mgr.34427) 2938 : cluster [DBG] pgmap v1665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:10.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:09 gibba013 bash[30381]: audit 2021-03-10T14:48:08.881822+0000 mgr.gibba020.yqfnwy (mgr.34427) 2939 : audit [DBG] from='client.56017 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:48:10.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:09 gibba013 bash[30381]: audit 2021-03-10T14:48:09.106383+0000 mgr.gibba020.yqfnwy (mgr.34427) 2940 : audit [DBG] from='client.56023 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:48:10.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:09 gibba013 bash[30381]: audit 2021-03-10T14:48:09.369745+0000 mon.a (mon.0) 1438 : audit [DBG] from='client.? 172.21.2.113:0/2679640553' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:10.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:09 gibba020 bash[25448]: cluster 2021-03-10T14:48:08.720252+0000 mgr.gibba020.yqfnwy (mgr.34427) 2938 : cluster [DBG] pgmap v1665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:10.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:09 gibba020 bash[25448]: audit 2021-03-10T14:48:08.881822+0000 mgr.gibba020.yqfnwy (mgr.34427) 2939 : audit [DBG] from='client.56017 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:48:10.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:09 gibba020 bash[25448]: audit 2021-03-10T14:48:09.106383+0000 mgr.gibba020.yqfnwy (mgr.34427) 2940 : audit [DBG] from='client.56023 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:48:10.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:09 gibba020 bash[25448]: audit 2021-03-10T14:48:09.369745+0000 mon.a (mon.0) 1438 : audit [DBG] from='client.? 172.21.2.113:0/2679640553' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:12.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:12 gibba013 bash[29418]: cluster 2021-03-10T14:48:10.721708+0000 mgr.gibba020.yqfnwy (mgr.34427) 2941 : cluster [DBG] pgmap v1666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:12.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:12 gibba013 bash[30381]: cluster 2021-03-10T14:48:10.721708+0000 mgr.gibba020.yqfnwy (mgr.34427) 2941 : cluster [DBG] pgmap v1666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:12.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:12 gibba020 bash[25448]: cluster 2021-03-10T14:48:10.721708+0000 mgr.gibba020.yqfnwy (mgr.34427) 2941 : cluster [DBG] pgmap v1666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:14.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:14 gibba013 bash[29418]: cluster 2021-03-10T14:48:12.723034+0000 mgr.gibba020.yqfnwy (mgr.34427) 2942 : cluster [DBG] pgmap v1667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:14.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:14 gibba013 bash[30381]: cluster 2021-03-10T14:48:12.723034+0000 mgr.gibba020.yqfnwy (mgr.34427) 2942 : cluster [DBG] pgmap v1667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:14.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:14 gibba020 bash[25448]: cluster 2021-03-10T14:48:12.723034+0000 mgr.gibba020.yqfnwy (mgr.34427) 2942 : cluster [DBG] pgmap v1667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:16.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:16 gibba013 bash[29418]: cluster 2021-03-10T14:48:14.724519+0000 mgr.gibba020.yqfnwy (mgr.34427) 2943 : cluster [DBG] pgmap v1668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:16.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:16 gibba013 bash[30381]: cluster 2021-03-10T14:48:14.724519+0000 mgr.gibba020.yqfnwy (mgr.34427) 2943 : cluster [DBG] pgmap v1668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:16.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:16 gibba020 bash[25448]: cluster 2021-03-10T14:48:14.724519+0000 mgr.gibba020.yqfnwy (mgr.34427) 2943 : cluster [DBG] pgmap v1668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:17.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:17 gibba013 bash[29418]: audit 2021-03-10T14:48:16.495819+0000 mon.a (mon.0) 1439 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:48:17.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:17 gibba013 bash[29418]: audit 2021-03-10T14:48:16.502240+0000 mon.a (mon.0) 1440 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:48:17.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:17 gibba013 bash[30381]: audit 2021-03-10T14:48:16.495819+0000 mon.a (mon.0) 1439 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:48:17.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:17 gibba013 bash[30381]: audit 2021-03-10T14:48:16.502240+0000 mon.a (mon.0) 1440 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:48:17.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:17 gibba020 bash[25448]: audit 2021-03-10T14:48:16.495819+0000 mon.a (mon.0) 1439 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:48:17.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:17 gibba020 bash[25448]: audit 2021-03-10T14:48:16.502240+0000 mon.a (mon.0) 1440 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:48:18.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:18 gibba013 bash[29418]: cephadm 2021-03-10T14:48:16.501042+0000 mgr.gibba020.yqfnwy (mgr.34427) 2944 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:48:18.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:18 gibba013 bash[29418]: cluster 2021-03-10T14:48:16.725160+0000 mgr.gibba020.yqfnwy (mgr.34427) 2945 : cluster [DBG] pgmap v1669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:18.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:18 gibba013 bash[30381]: cephadm 2021-03-10T14:48:16.501042+0000 mgr.gibba020.yqfnwy (mgr.34427) 2944 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:48:18.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:18 gibba013 bash[30381]: cluster 2021-03-10T14:48:16.725160+0000 mgr.gibba020.yqfnwy (mgr.34427) 2945 : cluster [DBG] pgmap v1669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:18.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:18 gibba020 bash[25448]: cephadm 2021-03-10T14:48:16.501042+0000 mgr.gibba020.yqfnwy (mgr.34427) 2944 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:48:18.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:18 gibba020 bash[25448]: cluster 2021-03-10T14:48:16.725160+0000 mgr.gibba020.yqfnwy (mgr.34427) 2945 : cluster [DBG] pgmap v1669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:20.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:20 gibba013 bash[29418]: cluster 2021-03-10T14:48:18.726544+0000 mgr.gibba020.yqfnwy (mgr.34427) 2946 : cluster [DBG] pgmap v1670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:20.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:20 gibba013 bash[29418]: audit 2021-03-10T14:48:20.005250+0000 mon.a (mon.0) 1441 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:48:20.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:20 gibba013 bash[29418]: audit 2021-03-10T14:48:20.195430+0000 mon.a (mon.0) 1442 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:48:20.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:20 gibba013 bash[29418]: audit 2021-03-10T14:48:20.201045+0000 mon.a (mon.0) 1443 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:48:20.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:20 gibba013 bash[29418]: audit 2021-03-10T14:48:20.203841+0000 mon.a (mon.0) 1444 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:20.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:20 gibba013 bash[29418]: audit 2021-03-10T14:48:20.205621+0000 mon.a (mon.0) 1445 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:20.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:20 gibba013 bash[29418]: audit 2021-03-10T14:48:20.207105+0000 mon.a (mon.0) 1446 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:20.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:20 gibba013 bash[29418]: audit 2021-03-10T14:48:20.210729+0000 mon.a (mon.0) 1447 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:20.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:20 gibba013 bash[29418]: audit 2021-03-10T14:48:20.213780+0000 mon.a (mon.0) 1448 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:20.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:20 gibba013 bash[30381]: cluster 2021-03-10T14:48:18.726544+0000 mgr.gibba020.yqfnwy (mgr.34427) 2946 : cluster [DBG] pgmap v1670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:20.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:20 gibba013 bash[30381]: audit 2021-03-10T14:48:20.005250+0000 mon.a (mon.0) 1441 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:48:20.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:20 gibba013 bash[30381]: audit 2021-03-10T14:48:20.195430+0000 mon.a (mon.0) 1442 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:48:20.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:20 gibba013 bash[30381]: audit 2021-03-10T14:48:20.201045+0000 mon.a (mon.0) 1443 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:48:20.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:20 gibba013 bash[30381]: audit 2021-03-10T14:48:20.203841+0000 mon.a (mon.0) 1444 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:20.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:20 gibba013 bash[30381]: audit 2021-03-10T14:48:20.205621+0000 mon.a (mon.0) 1445 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:20.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:20 gibba013 bash[30381]: audit 2021-03-10T14:48:20.207105+0000 mon.a (mon.0) 1446 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:20.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:20 gibba013 bash[30381]: audit 2021-03-10T14:48:20.210729+0000 mon.a (mon.0) 1447 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:20.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:20 gibba013 bash[30381]: audit 2021-03-10T14:48:20.213780+0000 mon.a (mon.0) 1448 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:20.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:20 gibba020 bash[25448]: cluster 2021-03-10T14:48:18.726544+0000 mgr.gibba020.yqfnwy (mgr.34427) 2946 : cluster [DBG] pgmap v1670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:20.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:20 gibba020 bash[25448]: audit 2021-03-10T14:48:20.005250+0000 mon.a (mon.0) 1441 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:48:20.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:20 gibba020 bash[25448]: audit 2021-03-10T14:48:20.195430+0000 mon.a (mon.0) 1442 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:48:20.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:20 gibba020 bash[25448]: audit 2021-03-10T14:48:20.201045+0000 mon.a (mon.0) 1443 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:48:20.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:20 gibba020 bash[25448]: audit 2021-03-10T14:48:20.203841+0000 mon.a (mon.0) 1444 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:20.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:20 gibba020 bash[25448]: audit 2021-03-10T14:48:20.205621+0000 mon.a (mon.0) 1445 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:20.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:20 gibba020 bash[25448]: audit 2021-03-10T14:48:20.207105+0000 mon.a (mon.0) 1446 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:20.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:20 gibba020 bash[25448]: audit 2021-03-10T14:48:20.210729+0000 mon.a (mon.0) 1447 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:20.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:20 gibba020 bash[25448]: audit 2021-03-10T14:48:20.213780+0000 mon.a (mon.0) 1448 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:21.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:21 gibba013 bash[29418]: cephadm 2021-03-10T14:48:20.004702+0000 mgr.gibba020.yqfnwy (mgr.34427) 2947 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:48:21.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:21 gibba013 bash[29418]: cephadm 2021-03-10T14:48:20.198720+0000 mgr.gibba020.yqfnwy (mgr.34427) 2948 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:48:21.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:21 gibba013 bash[29418]: cephadm 2021-03-10T14:48:20.201849+0000 mgr.gibba020.yqfnwy (mgr.34427) 2949 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:48:21.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:21 gibba013 bash[29418]: cephadm 2021-03-10T14:48:20.203910+0000 mgr.gibba020.yqfnwy (mgr.34427) 2950 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:48:21.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:21 gibba013 bash[29418]: cephadm 2021-03-10T14:48:20.204089+0000 mgr.gibba020.yqfnwy (mgr.34427) 2951 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:48:21.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:21 gibba013 bash[29418]: cephadm 2021-03-10T14:48:20.205601+0000 mgr.gibba020.yqfnwy (mgr.34427) 2952 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:48:21.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:21 gibba013 bash[29418]: cephadm 2021-03-10T14:48:20.205698+0000 mgr.gibba020.yqfnwy (mgr.34427) 2953 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:48:21.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:21 gibba013 bash[29418]: cephadm 2021-03-10T14:48:20.207164+0000 mgr.gibba020.yqfnwy (mgr.34427) 2954 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:48:21.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:21 gibba013 bash[29418]: cephadm 2021-03-10T14:48:20.208789+0000 mgr.gibba020.yqfnwy (mgr.34427) 2955 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:48:21.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:21 gibba013 bash[29418]: cephadm 2021-03-10T14:48:20.208939+0000 mgr.gibba020.yqfnwy (mgr.34427) 2956 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:48:21.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:21 gibba013 bash[29418]: cephadm 2021-03-10T14:48:20.210865+0000 mgr.gibba020.yqfnwy (mgr.34427) 2957 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:48:21.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:21 gibba013 bash[29418]: cephadm 2021-03-10T14:48:20.212106+0000 mgr.gibba020.yqfnwy (mgr.34427) 2958 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:48:21.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:21 gibba013 bash[29418]: cephadm 2021-03-10T14:48:20.213946+0000 mgr.gibba020.yqfnwy (mgr.34427) 2959 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:48:21.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:21 gibba013 bash[29418]: cephadm 2021-03-10T14:48:20.214066+0000 mgr.gibba020.yqfnwy (mgr.34427) 2960 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:48:21.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:21 gibba013 bash[29418]: cephadm 2021-03-10T14:48:20.214399+0000 mgr.gibba020.yqfnwy (mgr.34427) 2961 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:48:21.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:21 gibba013 bash[29418]: cluster 2021-03-10T14:48:20.728148+0000 mgr.gibba020.yqfnwy (mgr.34427) 2962 : cluster [DBG] pgmap v1671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:21.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:21 gibba013 bash[30381]: cephadm 2021-03-10T14:48:20.004702+0000 mgr.gibba020.yqfnwy (mgr.34427) 2947 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:48:21.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:21 gibba013 bash[30381]: cephadm 2021-03-10T14:48:20.198720+0000 mgr.gibba020.yqfnwy (mgr.34427) 2948 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:48:21.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:21 gibba013 bash[30381]: cephadm 2021-03-10T14:48:20.201849+0000 mgr.gibba020.yqfnwy (mgr.34427) 2949 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:48:21.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:21 gibba013 bash[30381]: cephadm 2021-03-10T14:48:20.203910+0000 mgr.gibba020.yqfnwy (mgr.34427) 2950 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:48:21.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:21 gibba013 bash[30381]: cephadm 2021-03-10T14:48:20.204089+0000 mgr.gibba020.yqfnwy (mgr.34427) 2951 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:48:21.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:21 gibba013 bash[30381]: cephadm 2021-03-10T14:48:20.205601+0000 mgr.gibba020.yqfnwy (mgr.34427) 2952 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:48:21.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:21 gibba013 bash[30381]: cephadm 2021-03-10T14:48:20.205698+0000 mgr.gibba020.yqfnwy (mgr.34427) 2953 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:48:21.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:21 gibba013 bash[30381]: cephadm 2021-03-10T14:48:20.207164+0000 mgr.gibba020.yqfnwy (mgr.34427) 2954 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:48:21.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:21 gibba013 bash[30381]: cephadm 2021-03-10T14:48:20.208789+0000 mgr.gibba020.yqfnwy (mgr.34427) 2955 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:48:21.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:21 gibba013 bash[30381]: cephadm 2021-03-10T14:48:20.208939+0000 mgr.gibba020.yqfnwy (mgr.34427) 2956 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:48:21.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:21 gibba013 bash[30381]: cephadm 2021-03-10T14:48:20.210865+0000 mgr.gibba020.yqfnwy (mgr.34427) 2957 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:48:21.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:21 gibba013 bash[30381]: cephadm 2021-03-10T14:48:20.212106+0000 mgr.gibba020.yqfnwy (mgr.34427) 2958 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:48:21.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:21 gibba013 bash[30381]: cephadm 2021-03-10T14:48:20.213946+0000 mgr.gibba020.yqfnwy (mgr.34427) 2959 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:48:21.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:21 gibba013 bash[30381]: cephadm 2021-03-10T14:48:20.214066+0000 mgr.gibba020.yqfnwy (mgr.34427) 2960 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:48:21.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:21 gibba013 bash[30381]: cephadm 2021-03-10T14:48:20.214399+0000 mgr.gibba020.yqfnwy (mgr.34427) 2961 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:48:21.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:21 gibba013 bash[30381]: cluster 2021-03-10T14:48:20.728148+0000 mgr.gibba020.yqfnwy (mgr.34427) 2962 : cluster [DBG] pgmap v1671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:21.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:21 gibba020 bash[25448]: cephadm 2021-03-10T14:48:20.004702+0000 mgr.gibba020.yqfnwy (mgr.34427) 2947 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:48:21.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:21 gibba020 bash[25448]: cephadm 2021-03-10T14:48:20.198720+0000 mgr.gibba020.yqfnwy (mgr.34427) 2948 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:48:21.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:21 gibba020 bash[25448]: cephadm 2021-03-10T14:48:20.201849+0000 mgr.gibba020.yqfnwy (mgr.34427) 2949 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:48:21.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:21 gibba020 bash[25448]: cephadm 2021-03-10T14:48:20.203910+0000 mgr.gibba020.yqfnwy (mgr.34427) 2950 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:48:21.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:21 gibba020 bash[25448]: cephadm 2021-03-10T14:48:20.204089+0000 mgr.gibba020.yqfnwy (mgr.34427) 2951 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:48:21.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:21 gibba020 bash[25448]: cephadm 2021-03-10T14:48:20.205601+0000 mgr.gibba020.yqfnwy (mgr.34427) 2952 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:48:21.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:21 gibba020 bash[25448]: cephadm 2021-03-10T14:48:20.205698+0000 mgr.gibba020.yqfnwy (mgr.34427) 2953 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:48:21.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:21 gibba020 bash[25448]: cephadm 2021-03-10T14:48:20.207164+0000 mgr.gibba020.yqfnwy (mgr.34427) 2954 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:48:21.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:21 gibba020 bash[25448]: cephadm 2021-03-10T14:48:20.208789+0000 mgr.gibba020.yqfnwy (mgr.34427) 2955 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:48:21.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:21 gibba020 bash[25448]: cephadm 2021-03-10T14:48:20.208939+0000 mgr.gibba020.yqfnwy (mgr.34427) 2956 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:48:21.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:21 gibba020 bash[25448]: cephadm 2021-03-10T14:48:20.210865+0000 mgr.gibba020.yqfnwy (mgr.34427) 2957 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:48:21.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:21 gibba020 bash[25448]: cephadm 2021-03-10T14:48:20.212106+0000 mgr.gibba020.yqfnwy (mgr.34427) 2958 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:48:21.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:21 gibba020 bash[25448]: cephadm 2021-03-10T14:48:20.213946+0000 mgr.gibba020.yqfnwy (mgr.34427) 2959 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:48:21.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:21 gibba020 bash[25448]: cephadm 2021-03-10T14:48:20.214066+0000 mgr.gibba020.yqfnwy (mgr.34427) 2960 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:48:21.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:21 gibba020 bash[25448]: cephadm 2021-03-10T14:48:20.214399+0000 mgr.gibba020.yqfnwy (mgr.34427) 2961 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:48:21.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:21 gibba020 bash[25448]: cluster 2021-03-10T14:48:20.728148+0000 mgr.gibba020.yqfnwy (mgr.34427) 2962 : cluster [DBG] pgmap v1671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:24.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:23 gibba013 bash[29418]: cluster 2021-03-10T14:48:22.729491+0000 mgr.gibba020.yqfnwy (mgr.34427) 2963 : cluster [DBG] pgmap v1672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:24.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:23 gibba013 bash[30381]: cluster 2021-03-10T14:48:22.729491+0000 mgr.gibba020.yqfnwy (mgr.34427) 2963 : cluster [DBG] pgmap v1672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:24.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:23 gibba020 bash[25448]: cluster 2021-03-10T14:48:22.729491+0000 mgr.gibba020.yqfnwy (mgr.34427) 2963 : cluster [DBG] pgmap v1672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:26.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:25 gibba013 bash[29418]: cluster 2021-03-10T14:48:24.731224+0000 mgr.gibba020.yqfnwy (mgr.34427) 2964 : cluster [DBG] pgmap v1673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:26.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:25 gibba013 bash[30381]: cluster 2021-03-10T14:48:24.731224+0000 mgr.gibba020.yqfnwy (mgr.34427) 2964 : cluster [DBG] pgmap v1673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:26.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:25 gibba020 bash[25448]: cluster 2021-03-10T14:48:24.731224+0000 mgr.gibba020.yqfnwy (mgr.34427) 2964 : cluster [DBG] pgmap v1673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:28.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:28 gibba013 bash[29418]: cluster 2021-03-10T14:48:26.732863+0000 mgr.gibba020.yqfnwy (mgr.34427) 2965 : cluster [DBG] pgmap v1674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:28.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:28 gibba013 bash[30381]: cluster 2021-03-10T14:48:26.732863+0000 mgr.gibba020.yqfnwy (mgr.34427) 2965 : cluster [DBG] pgmap v1674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:28.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:28 gibba020 bash[25448]: cluster 2021-03-10T14:48:26.732863+0000 mgr.gibba020.yqfnwy (mgr.34427) 2965 : cluster [DBG] pgmap v1674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:30.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:30 gibba013 bash[29418]: cluster 2021-03-10T14:48:28.734476+0000 mgr.gibba020.yqfnwy (mgr.34427) 2966 : cluster [DBG] pgmap v1675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:30.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:30 gibba013 bash[30381]: cluster 2021-03-10T14:48:28.734476+0000 mgr.gibba020.yqfnwy (mgr.34427) 2966 : cluster [DBG] pgmap v1675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:30.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:30 gibba020 bash[25448]: cluster 2021-03-10T14:48:28.734476+0000 mgr.gibba020.yqfnwy (mgr.34427) 2966 : cluster [DBG] pgmap v1675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:32.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:32 gibba013 bash[29418]: cluster 2021-03-10T14:48:30.736097+0000 mgr.gibba020.yqfnwy (mgr.34427) 2967 : cluster [DBG] pgmap v1676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:32.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:32 gibba013 bash[30381]: cluster 2021-03-10T14:48:30.736097+0000 mgr.gibba020.yqfnwy (mgr.34427) 2967 : cluster [DBG] pgmap v1676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:32.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:32 gibba020 bash[25448]: cluster 2021-03-10T14:48:30.736097+0000 mgr.gibba020.yqfnwy (mgr.34427) 2967 : cluster [DBG] pgmap v1676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:34.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:34 gibba013 bash[29418]: cluster 2021-03-10T14:48:32.737317+0000 mgr.gibba020.yqfnwy (mgr.34427) 2968 : cluster [DBG] pgmap v1677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:34.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:34 gibba013 bash[30381]: cluster 2021-03-10T14:48:32.737317+0000 mgr.gibba020.yqfnwy (mgr.34427) 2968 : cluster [DBG] pgmap v1677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:34.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:34 gibba020 bash[25448]: cluster 2021-03-10T14:48:32.737317+0000 mgr.gibba020.yqfnwy (mgr.34427) 2968 : cluster [DBG] pgmap v1677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:36.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:36 gibba013 bash[29418]: cluster 2021-03-10T14:48:34.738939+0000 mgr.gibba020.yqfnwy (mgr.34427) 2969 : cluster [DBG] pgmap v1678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:36.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:36 gibba013 bash[29418]: cephadm 2021-03-10T14:48:35.230289+0000 mgr.gibba020.yqfnwy (mgr.34427) 2970 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:48:36.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:36 gibba013 bash[30381]: cluster 2021-03-10T14:48:34.738939+0000 mgr.gibba020.yqfnwy (mgr.34427) 2969 : cluster [DBG] pgmap v1678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:36.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:36 gibba013 bash[30381]: cephadm 2021-03-10T14:48:35.230289+0000 mgr.gibba020.yqfnwy (mgr.34427) 2970 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:48:36.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:36 gibba020 bash[25448]: cluster 2021-03-10T14:48:34.738939+0000 mgr.gibba020.yqfnwy (mgr.34427) 2969 : cluster [DBG] pgmap v1678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:36.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:36 gibba020 bash[25448]: cephadm 2021-03-10T14:48:35.230289+0000 mgr.gibba020.yqfnwy (mgr.34427) 2970 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:48:37.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:37 gibba020 bash[25448]: cluster 2021-03-10T14:48:36.740527+0000 mgr.gibba020.yqfnwy (mgr.34427) 2971 : cluster [DBG] pgmap v1679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:37.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:37 gibba013 bash[29418]: cluster 2021-03-10T14:48:36.740527+0000 mgr.gibba020.yqfnwy (mgr.34427) 2971 : cluster [DBG] pgmap v1679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:37.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:37 gibba013 bash[30381]: cluster 2021-03-10T14:48:36.740527+0000 mgr.gibba020.yqfnwy (mgr.34427) 2971 : cluster [DBG] pgmap v1679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:39.616 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:48:39.842 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:48:39.842 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (55m) 19s ago 60m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:48:39.843 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (60m) 9m ago 60m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:48:39.843 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (55m) 9m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:48:39.843 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (55m) 9m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:48:39.843 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (54m) 19s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:48:39.843 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (54m) 19s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:48:39.844 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (54m) 9m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:48:39.844 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (54m) 19s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:48:39.844 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (60m) 19s ago 60m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:48:39.844 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (60m) 9m ago 60m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:48:39.845 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (53m) 19s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:48:39.845 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (53m) 19s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:48:39.845 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (52m) 19s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:48:39.845 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (52m) 19s ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:48:39.846 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (51m) 9m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:48:39.846 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (51m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:48:39.846 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (50m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:48:39.846 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (50m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:48:39.846 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (60m) 9m ago 60m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:48:39.847 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 9m ago 58m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:48:40.092 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:48:40.093 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:48:40.093 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:48:40.093 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:48:40.093 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:48:40.093 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:48:40.094 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:48:40.094 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:48:40.094 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:48:40.094 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:48:40.095 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:48:40.095 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:48:40.095 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:48:40.095 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:48:40.095 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:48:40.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:39 gibba013 bash[29418]: cluster 2021-03-10T14:48:38.742203+0000 mgr.gibba020.yqfnwy (mgr.34427) 2972 : cluster [DBG] pgmap v1680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:40.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:39 gibba013 bash[30381]: cluster 2021-03-10T14:48:38.742203+0000 mgr.gibba020.yqfnwy (mgr.34427) 2972 : cluster [DBG] pgmap v1680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:40.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:39 gibba020 bash[25448]: cluster 2021-03-10T14:48:38.742203+0000 mgr.gibba020.yqfnwy (mgr.34427) 2972 : cluster [DBG] pgmap v1680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:41.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:40 gibba013 bash[29418]: audit 2021-03-10T14:48:39.603665+0000 mgr.gibba020.yqfnwy (mgr.34427) 2973 : audit [DBG] from='client.46050 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:48:41.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:40 gibba013 bash[29418]: audit 2021-03-10T14:48:39.829578+0000 mgr.gibba020.yqfnwy (mgr.34427) 2974 : audit [DBG] from='client.46056 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:48:41.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:40 gibba013 bash[29418]: audit 2021-03-10T14:48:40.090365+0000 mon.c (mon.1) 54 : audit [DBG] from='client.? 172.21.2.113:0/1528357077' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:41.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:40 gibba013 bash[30381]: audit 2021-03-10T14:48:39.603665+0000 mgr.gibba020.yqfnwy (mgr.34427) 2973 : audit [DBG] from='client.46050 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:48:41.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:40 gibba013 bash[30381]: audit 2021-03-10T14:48:39.829578+0000 mgr.gibba020.yqfnwy (mgr.34427) 2974 : audit [DBG] from='client.46056 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:48:41.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:40 gibba013 bash[30381]: audit 2021-03-10T14:48:40.090365+0000 mon.c (mon.1) 54 : audit [DBG] from='client.? 172.21.2.113:0/1528357077' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:41.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:40 gibba020 bash[25448]: audit 2021-03-10T14:48:39.603665+0000 mgr.gibba020.yqfnwy (mgr.34427) 2973 : audit [DBG] from='client.46050 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:48:41.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:40 gibba020 bash[25448]: audit 2021-03-10T14:48:39.829578+0000 mgr.gibba020.yqfnwy (mgr.34427) 2974 : audit [DBG] from='client.46056 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:48:41.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:40 gibba020 bash[25448]: audit 2021-03-10T14:48:40.090365+0000 mon.c (mon.1) 54 : audit [DBG] from='client.? 172.21.2.113:0/1528357077' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:48:42.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:42 gibba013 bash[29418]: cluster 2021-03-10T14:48:40.743970+0000 mgr.gibba020.yqfnwy (mgr.34427) 2975 : cluster [DBG] pgmap v1681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:42.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:42 gibba013 bash[30381]: cluster 2021-03-10T14:48:40.743970+0000 mgr.gibba020.yqfnwy (mgr.34427) 2975 : cluster [DBG] pgmap v1681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:42.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:42 gibba020 bash[25448]: cluster 2021-03-10T14:48:40.743970+0000 mgr.gibba020.yqfnwy (mgr.34427) 2975 : cluster [DBG] pgmap v1681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:44.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:44 gibba013 bash[29418]: cluster 2021-03-10T14:48:42.745531+0000 mgr.gibba020.yqfnwy (mgr.34427) 2976 : cluster [DBG] pgmap v1682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:44.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:44 gibba013 bash[30381]: cluster 2021-03-10T14:48:42.745531+0000 mgr.gibba020.yqfnwy (mgr.34427) 2976 : cluster [DBG] pgmap v1682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:44.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:44 gibba020 bash[25448]: cluster 2021-03-10T14:48:42.745531+0000 mgr.gibba020.yqfnwy (mgr.34427) 2976 : cluster [DBG] pgmap v1682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:46.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:46 gibba013 bash[30381]: cluster 2021-03-10T14:48:44.747304+0000 mgr.gibba020.yqfnwy (mgr.34427) 2977 : cluster [DBG] pgmap v1683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:46.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:46 gibba013 bash[29418]: cluster 2021-03-10T14:48:44.747304+0000 mgr.gibba020.yqfnwy (mgr.34427) 2977 : cluster [DBG] pgmap v1683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:46.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:46 gibba020 bash[25448]: cluster 2021-03-10T14:48:44.747304+0000 mgr.gibba020.yqfnwy (mgr.34427) 2977 : cluster [DBG] pgmap v1683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:48.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:48 gibba013 bash[29418]: cluster 2021-03-10T14:48:46.749007+0000 mgr.gibba020.yqfnwy (mgr.34427) 2978 : cluster [DBG] pgmap v1684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:48.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:48 gibba013 bash[30381]: cluster 2021-03-10T14:48:46.749007+0000 mgr.gibba020.yqfnwy (mgr.34427) 2978 : cluster [DBG] pgmap v1684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:48.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:48 gibba020 bash[25448]: cluster 2021-03-10T14:48:46.749007+0000 mgr.gibba020.yqfnwy (mgr.34427) 2978 : cluster [DBG] pgmap v1684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:50.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:50 gibba013 bash[29418]: cluster 2021-03-10T14:48:48.750654+0000 mgr.gibba020.yqfnwy (mgr.34427) 2979 : cluster [DBG] pgmap v1685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:50.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:50 gibba013 bash[30381]: cluster 2021-03-10T14:48:48.750654+0000 mgr.gibba020.yqfnwy (mgr.34427) 2979 : cluster [DBG] pgmap v1685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:50.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:50 gibba020 bash[25448]: cluster 2021-03-10T14:48:48.750654+0000 mgr.gibba020.yqfnwy (mgr.34427) 2979 : cluster [DBG] pgmap v1685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:51.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:51 gibba013 bash[30381]: cephadm 2021-03-10T14:48:50.246343+0000 mgr.gibba020.yqfnwy (mgr.34427) 2980 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:48:51.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:51 gibba013 bash[30381]: cluster 2021-03-10T14:48:50.752267+0000 mgr.gibba020.yqfnwy (mgr.34427) 2981 : cluster [DBG] pgmap v1686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:51.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:51 gibba013 bash[29418]: cephadm 2021-03-10T14:48:50.246343+0000 mgr.gibba020.yqfnwy (mgr.34427) 2980 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:48:51.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:51 gibba013 bash[29418]: cluster 2021-03-10T14:48:50.752267+0000 mgr.gibba020.yqfnwy (mgr.34427) 2981 : cluster [DBG] pgmap v1686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:51.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:51 gibba020 bash[25448]: cephadm 2021-03-10T14:48:50.246343+0000 mgr.gibba020.yqfnwy (mgr.34427) 2980 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:48:51.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:51 gibba020 bash[25448]: cluster 2021-03-10T14:48:50.752267+0000 mgr.gibba020.yqfnwy (mgr.34427) 2981 : cluster [DBG] pgmap v1686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:54.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:53 gibba013 bash[29418]: cluster 2021-03-10T14:48:52.753556+0000 mgr.gibba020.yqfnwy (mgr.34427) 2982 : cluster [DBG] pgmap v1687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:54.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:53 gibba013 bash[30381]: cluster 2021-03-10T14:48:52.753556+0000 mgr.gibba020.yqfnwy (mgr.34427) 2982 : cluster [DBG] pgmap v1687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:54.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:53 gibba020 bash[25448]: cluster 2021-03-10T14:48:52.753556+0000 mgr.gibba020.yqfnwy (mgr.34427) 2982 : cluster [DBG] pgmap v1687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:56.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:55 gibba013 bash[29418]: cluster 2021-03-10T14:48:54.755343+0000 mgr.gibba020.yqfnwy (mgr.34427) 2983 : cluster [DBG] pgmap v1688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:56.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:55 gibba013 bash[30381]: cluster 2021-03-10T14:48:54.755343+0000 mgr.gibba020.yqfnwy (mgr.34427) 2983 : cluster [DBG] pgmap v1688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:56.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:55 gibba020 bash[25448]: cluster 2021-03-10T14:48:54.755343+0000 mgr.gibba020.yqfnwy (mgr.34427) 2983 : cluster [DBG] pgmap v1688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:58.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:48:58 gibba013 bash[29418]: cluster 2021-03-10T14:48:56.756882+0000 mgr.gibba020.yqfnwy (mgr.34427) 2984 : cluster [DBG] pgmap v1689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:58.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:48:58 gibba013 bash[30381]: cluster 2021-03-10T14:48:56.756882+0000 mgr.gibba020.yqfnwy (mgr.34427) 2984 : cluster [DBG] pgmap v1689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:48:58.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:48:58 gibba020 bash[25448]: cluster 2021-03-10T14:48:56.756882+0000 mgr.gibba020.yqfnwy (mgr.34427) 2984 : cluster [DBG] pgmap v1689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:00.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:00 gibba013 bash[29418]: cluster 2021-03-10T14:48:58.758485+0000 mgr.gibba020.yqfnwy (mgr.34427) 2985 : cluster [DBG] pgmap v1690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:00.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:00 gibba013 bash[30381]: cluster 2021-03-10T14:48:58.758485+0000 mgr.gibba020.yqfnwy (mgr.34427) 2985 : cluster [DBG] pgmap v1690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:00.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:00 gibba020 bash[25448]: cluster 2021-03-10T14:48:58.758485+0000 mgr.gibba020.yqfnwy (mgr.34427) 2985 : cluster [DBG] pgmap v1690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:02.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:02 gibba013 bash[29418]: cluster 2021-03-10T14:49:00.760104+0000 mgr.gibba020.yqfnwy (mgr.34427) 2986 : cluster [DBG] pgmap v1691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:02.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:02 gibba013 bash[30381]: cluster 2021-03-10T14:49:00.760104+0000 mgr.gibba020.yqfnwy (mgr.34427) 2986 : cluster [DBG] pgmap v1691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:02.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:02 gibba020 bash[25448]: cluster 2021-03-10T14:49:00.760104+0000 mgr.gibba020.yqfnwy (mgr.34427) 2986 : cluster [DBG] pgmap v1691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:04.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:04 gibba013 bash[29418]: cluster 2021-03-10T14:49:02.761618+0000 mgr.gibba020.yqfnwy (mgr.34427) 2987 : cluster [DBG] pgmap v1692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:04.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:04 gibba013 bash[30381]: cluster 2021-03-10T14:49:02.761618+0000 mgr.gibba020.yqfnwy (mgr.34427) 2987 : cluster [DBG] pgmap v1692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:04.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:04 gibba020 bash[25448]: cluster 2021-03-10T14:49:02.761618+0000 mgr.gibba020.yqfnwy (mgr.34427) 2987 : cluster [DBG] pgmap v1692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:05.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:05 gibba020 bash[25448]: cluster 2021-03-10T14:49:04.763097+0000 mgr.gibba020.yqfnwy (mgr.34427) 2988 : cluster [DBG] pgmap v1693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:05.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:05 gibba020 bash[25448]: cephadm 2021-03-10T14:49:05.262250+0000 mgr.gibba020.yqfnwy (mgr.34427) 2989 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:49:05.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:05 gibba013 bash[29418]: cluster 2021-03-10T14:49:04.763097+0000 mgr.gibba020.yqfnwy (mgr.34427) 2988 : cluster [DBG] pgmap v1693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:05.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:05 gibba013 bash[29418]: cephadm 2021-03-10T14:49:05.262250+0000 mgr.gibba020.yqfnwy (mgr.34427) 2989 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:49:05.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:05 gibba013 bash[30381]: cluster 2021-03-10T14:49:04.763097+0000 mgr.gibba020.yqfnwy (mgr.34427) 2988 : cluster [DBG] pgmap v1693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:05.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:05 gibba013 bash[30381]: cephadm 2021-03-10T14:49:05.262250+0000 mgr.gibba020.yqfnwy (mgr.34427) 2989 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:49:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:06 gibba020 bash[25448]: audit 2021-03-10T14:49:06.255795+0000 mon.a (mon.0) 1449 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:49:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:06 gibba020 bash[25448]: audit 2021-03-10T14:49:06.256557+0000 mon.a (mon.0) 1450 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:49:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:06 gibba020 bash[25448]: audit 2021-03-10T14:49:06.257213+0000 mon.a (mon.0) 1451 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T14:49:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:06 gibba020 bash[25448]: audit 2021-03-10T14:49:06.257856+0000 mon.a (mon.0) 1452 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:49:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:06 gibba020 bash[25448]: audit 2021-03-10T14:49:06.262947+0000 mon.a (mon.0) 1453 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:49:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:06 gibba020 bash[25448]: audit 2021-03-10T14:49:06.266546+0000 mon.a (mon.0) 1454 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:49:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:06 gibba013 bash[29418]: audit 2021-03-10T14:49:06.255795+0000 mon.a (mon.0) 1449 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:49:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:06 gibba013 bash[29418]: audit 2021-03-10T14:49:06.256557+0000 mon.a (mon.0) 1450 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:49:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:06 gibba013 bash[29418]: audit 2021-03-10T14:49:06.257213+0000 mon.a (mon.0) 1451 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T14:49:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:06 gibba013 bash[29418]: audit 2021-03-10T14:49:06.257856+0000 mon.a (mon.0) 1452 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:49:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:06 gibba013 bash[29418]: audit 2021-03-10T14:49:06.262947+0000 mon.a (mon.0) 1453 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:49:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:06 gibba013 bash[29418]: audit 2021-03-10T14:49:06.266546+0000 mon.a (mon.0) 1454 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:49:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:06 gibba013 bash[30381]: audit 2021-03-10T14:49:06.255795+0000 mon.a (mon.0) 1449 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T14:49:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:06 gibba013 bash[30381]: audit 2021-03-10T14:49:06.256557+0000 mon.a (mon.0) 1450 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:49:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:06 gibba013 bash[30381]: audit 2021-03-10T14:49:06.257213+0000 mon.a (mon.0) 1451 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T14:49:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:06 gibba013 bash[30381]: audit 2021-03-10T14:49:06.257856+0000 mon.a (mon.0) 1452 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T14:49:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:06 gibba013 bash[30381]: audit 2021-03-10T14:49:06.262947+0000 mon.a (mon.0) 1453 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:49:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:06 gibba013 bash[30381]: audit 2021-03-10T14:49:06.266546+0000 mon.a (mon.0) 1454 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:49:07.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:07 gibba020 bash[25448]: cluster 2021-03-10T14:49:06.764639+0000 mgr.gibba020.yqfnwy (mgr.34427) 2990 : cluster [DBG] pgmap v1694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:07.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:07 gibba013 bash[29418]: cluster 2021-03-10T14:49:06.764639+0000 mgr.gibba020.yqfnwy (mgr.34427) 2990 : cluster [DBG] pgmap v1694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:07.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:07 gibba013 bash[30381]: cluster 2021-03-10T14:49:06.764639+0000 mgr.gibba020.yqfnwy (mgr.34427) 2990 : cluster [DBG] pgmap v1694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:10.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:09 gibba013 bash[29418]: cluster 2021-03-10T14:49:08.766346+0000 mgr.gibba020.yqfnwy (mgr.34427) 2991 : cluster [DBG] pgmap v1695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:10.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:09 gibba013 bash[30381]: cluster 2021-03-10T14:49:08.766346+0000 mgr.gibba020.yqfnwy (mgr.34427) 2991 : cluster [DBG] pgmap v1695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:10.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:09 gibba020 bash[25448]: cluster 2021-03-10T14:49:08.766346+0000 mgr.gibba020.yqfnwy (mgr.34427) 2991 : cluster [DBG] pgmap v1695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:10.338 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:49:10.566 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:49:10.566 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (55m) 50s ago 61m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:49:10.567 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (60m) 10m ago 60m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:49:10.567 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (56m) 10m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:49:10.567 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (56m) 10m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:49:10.567 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (55m) 50s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:49:10.567 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (55m) 50s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:49:10.568 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (54m) 10m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:49:10.568 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (54m) 50s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:49:10.568 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (61m) 50s ago 61m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:49:10.568 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (61m) 10m ago 61m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:49:10.569 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (53m) 50s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:49:10.569 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (53m) 50s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:49:10.569 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (53m) 50s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:49:10.569 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (52m) 50s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:49:10.569 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (52m) 10m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:49:10.570 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (51m) 10m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:49:10.570 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (51m) 10m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:49:10.570 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (50m) 10m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:49:10.570 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (60m) 10m ago 61m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:49:10.571 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 10m ago 59m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:49:10.814 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:49:10.814 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:49:10.814 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:49:10.815 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:49:10.815 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:49:10.815 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:49:10.815 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:49:10.816 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:49:10.816 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:49:10.816 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:49:10.816 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:49:10.816 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:49:10.817 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:49:10.817 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:49:10.817 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:49:11.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:10 gibba013 bash[29418]: audit 2021-03-10T14:49:10.325559+0000 mgr.gibba020.yqfnwy (mgr.34427) 2992 : audit [DBG] from='client.56053 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:49:11.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:10 gibba013 bash[29418]: audit 2021-03-10T14:49:10.811944+0000 mon.c (mon.1) 55 : audit [DBG] from='client.? 172.21.2.113:0/3702382035' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:11.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:10 gibba013 bash[30381]: audit 2021-03-10T14:49:10.325559+0000 mgr.gibba020.yqfnwy (mgr.34427) 2992 : audit [DBG] from='client.56053 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:49:11.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:10 gibba013 bash[30381]: audit 2021-03-10T14:49:10.811944+0000 mon.c (mon.1) 55 : audit [DBG] from='client.? 172.21.2.113:0/3702382035' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:11.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:10 gibba020 bash[25448]: audit 2021-03-10T14:49:10.325559+0000 mgr.gibba020.yqfnwy (mgr.34427) 2992 : audit [DBG] from='client.56053 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:49:11.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:10 gibba020 bash[25448]: audit 2021-03-10T14:49:10.811944+0000 mon.c (mon.1) 55 : audit [DBG] from='client.? 172.21.2.113:0/3702382035' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:12.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:12 gibba013 bash[29418]: audit 2021-03-10T14:49:10.550557+0000 mgr.gibba020.yqfnwy (mgr.34427) 2993 : audit [DBG] from='client.56059 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:49:12.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:12 gibba013 bash[29418]: cluster 2021-03-10T14:49:10.767778+0000 mgr.gibba020.yqfnwy (mgr.34427) 2994 : cluster [DBG] pgmap v1696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:12.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:12 gibba013 bash[30381]: audit 2021-03-10T14:49:10.550557+0000 mgr.gibba020.yqfnwy (mgr.34427) 2993 : audit [DBG] from='client.56059 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:49:12.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:12 gibba013 bash[30381]: cluster 2021-03-10T14:49:10.767778+0000 mgr.gibba020.yqfnwy (mgr.34427) 2994 : cluster [DBG] pgmap v1696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:12.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:12 gibba020 bash[25448]: audit 2021-03-10T14:49:10.550557+0000 mgr.gibba020.yqfnwy (mgr.34427) 2993 : audit [DBG] from='client.56059 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:49:12.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:12 gibba020 bash[25448]: cluster 2021-03-10T14:49:10.767778+0000 mgr.gibba020.yqfnwy (mgr.34427) 2994 : cluster [DBG] pgmap v1696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:14.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:14 gibba013 bash[29418]: cluster 2021-03-10T14:49:12.769161+0000 mgr.gibba020.yqfnwy (mgr.34427) 2995 : cluster [DBG] pgmap v1697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:14.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:14 gibba013 bash[30381]: cluster 2021-03-10T14:49:12.769161+0000 mgr.gibba020.yqfnwy (mgr.34427) 2995 : cluster [DBG] pgmap v1697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:14.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:14 gibba020 bash[25448]: cluster 2021-03-10T14:49:12.769161+0000 mgr.gibba020.yqfnwy (mgr.34427) 2995 : cluster [DBG] pgmap v1697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:16.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:16 gibba013 bash[29418]: cluster 2021-03-10T14:49:14.770892+0000 mgr.gibba020.yqfnwy (mgr.34427) 2996 : cluster [DBG] pgmap v1698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:16.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:16 gibba013 bash[30381]: cluster 2021-03-10T14:49:14.770892+0000 mgr.gibba020.yqfnwy (mgr.34427) 2996 : cluster [DBG] pgmap v1698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:16.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:16 gibba020 bash[25448]: cluster 2021-03-10T14:49:14.770892+0000 mgr.gibba020.yqfnwy (mgr.34427) 2996 : cluster [DBG] pgmap v1698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:18.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:18 gibba013 bash[29418]: cluster 2021-03-10T14:49:16.772533+0000 mgr.gibba020.yqfnwy (mgr.34427) 2997 : cluster [DBG] pgmap v1699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:18.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:18 gibba013 bash[30381]: cluster 2021-03-10T14:49:16.772533+0000 mgr.gibba020.yqfnwy (mgr.34427) 2997 : cluster [DBG] pgmap v1699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:18.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:18 gibba020 bash[25448]: cluster 2021-03-10T14:49:16.772533+0000 mgr.gibba020.yqfnwy (mgr.34427) 2997 : cluster [DBG] pgmap v1699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:19.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:19 gibba020 bash[25448]: cluster 2021-03-10T14:49:18.773935+0000 mgr.gibba020.yqfnwy (mgr.34427) 2998 : cluster [DBG] pgmap v1700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:19.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:19 gibba013 bash[29418]: cluster 2021-03-10T14:49:18.773935+0000 mgr.gibba020.yqfnwy (mgr.34427) 2998 : cluster [DBG] pgmap v1700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:19.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:19 gibba013 bash[30381]: cluster 2021-03-10T14:49:18.773935+0000 mgr.gibba020.yqfnwy (mgr.34427) 2998 : cluster [DBG] pgmap v1700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:20.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:20 gibba020 bash[25448]: audit 2021-03-10T14:49:20.280207+0000 mon.a (mon.0) 1455 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:49:20.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:20 gibba020 bash[25448]: cephadm 2021-03-10T14:49:20.284154+0000 mgr.gibba020.yqfnwy (mgr.34427) 2999 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:49:20.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:20 gibba020 bash[25448]: audit 2021-03-10T14:49:20.287130+0000 mon.a (mon.0) 1456 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:49:20.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:20 gibba013 bash[29418]: audit 2021-03-10T14:49:20.280207+0000 mon.a (mon.0) 1455 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:49:20.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:20 gibba013 bash[29418]: cephadm 2021-03-10T14:49:20.284154+0000 mgr.gibba020.yqfnwy (mgr.34427) 2999 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:49:20.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:20 gibba013 bash[29418]: audit 2021-03-10T14:49:20.287130+0000 mon.a (mon.0) 1456 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:49:20.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:20 gibba013 bash[30381]: audit 2021-03-10T14:49:20.280207+0000 mon.a (mon.0) 1455 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:49:20.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:20 gibba013 bash[30381]: cephadm 2021-03-10T14:49:20.284154+0000 mgr.gibba020.yqfnwy (mgr.34427) 2999 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:49:20.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:20 gibba013 bash[30381]: audit 2021-03-10T14:49:20.287130+0000 mon.a (mon.0) 1456 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:49:22.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:22 gibba013 bash[29418]: cluster 2021-03-10T14:49:20.775639+0000 mgr.gibba020.yqfnwy (mgr.34427) 3000 : cluster [DBG] pgmap v1701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:22.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:22 gibba013 bash[30381]: cluster 2021-03-10T14:49:20.775639+0000 mgr.gibba020.yqfnwy (mgr.34427) 3000 : cluster [DBG] pgmap v1701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:22.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:22 gibba020 bash[25448]: cluster 2021-03-10T14:49:20.775639+0000 mgr.gibba020.yqfnwy (mgr.34427) 3000 : cluster [DBG] pgmap v1701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:24.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:24 gibba013 bash[29418]: cluster 2021-03-10T14:49:22.777090+0000 mgr.gibba020.yqfnwy (mgr.34427) 3001 : cluster [DBG] pgmap v1702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:24.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:24 gibba013 bash[29418]: audit 2021-03-10T14:49:24.036666+0000 mon.a (mon.0) 1457 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:49:24.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:24 gibba013 bash[29418]: audit 2021-03-10T14:49:24.037510+0000 mon.a (mon.0) 1458 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T14:49:24.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:24 gibba013 bash[30381]: cluster 2021-03-10T14:49:22.777090+0000 mgr.gibba020.yqfnwy (mgr.34427) 3001 : cluster [DBG] pgmap v1702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:24.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:24 gibba013 bash[30381]: audit 2021-03-10T14:49:24.036666+0000 mon.a (mon.0) 1457 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:49:24.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:24 gibba013 bash[30381]: audit 2021-03-10T14:49:24.037510+0000 mon.a (mon.0) 1458 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T14:49:24.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:24 gibba020 bash[25448]: cluster 2021-03-10T14:49:22.777090+0000 mgr.gibba020.yqfnwy (mgr.34427) 3001 : cluster [DBG] pgmap v1702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:24.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:24 gibba020 bash[25448]: audit 2021-03-10T14:49:24.036666+0000 mon.a (mon.0) 1457 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:49:24.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:24 gibba020 bash[25448]: audit 2021-03-10T14:49:24.037510+0000 mon.a (mon.0) 1458 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T14:49:26.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:26 gibba020 bash[25448]: cluster 2021-03-10T14:49:24.778728+0000 mgr.gibba020.yqfnwy (mgr.34427) 3002 : cluster [DBG] pgmap v1703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:26.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:26 gibba013 bash[29418]: cluster 2021-03-10T14:49:24.778728+0000 mgr.gibba020.yqfnwy (mgr.34427) 3002 : cluster [DBG] pgmap v1703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:26.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:26 gibba013 bash[30381]: cluster 2021-03-10T14:49:24.778728+0000 mgr.gibba020.yqfnwy (mgr.34427) 3002 : cluster [DBG] pgmap v1703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:28.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:28 gibba013 bash[29418]: cluster 2021-03-10T14:49:26.780228+0000 mgr.gibba020.yqfnwy (mgr.34427) 3003 : cluster [DBG] pgmap v1704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:28.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:28 gibba013 bash[30381]: cluster 2021-03-10T14:49:26.780228+0000 mgr.gibba020.yqfnwy (mgr.34427) 3003 : cluster [DBG] pgmap v1704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:28.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:28 gibba020 bash[25448]: cluster 2021-03-10T14:49:26.780228+0000 mgr.gibba020.yqfnwy (mgr.34427) 3003 : cluster [DBG] pgmap v1704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:29.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:29 gibba020 bash[25448]: audit 2021-03-10T14:49:28.990686+0000 mon.a (mon.0) 1459 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:49:29.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:29 gibba020 bash[25448]: audit 2021-03-10T14:49:29.159674+0000 mon.a (mon.0) 1460 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:49:29.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:29 gibba020 bash[25448]: audit 2021-03-10T14:49:29.347732+0000 mon.a (mon.0) 1461 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:49:29.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:29 gibba020 bash[25448]: audit 2021-03-10T14:49:29.351562+0000 mon.a (mon.0) 1462 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:49:29.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:29 gibba020 bash[25448]: audit 2021-03-10T14:49:29.353282+0000 mon.a (mon.0) 1463 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:29.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:29 gibba020 bash[25448]: audit 2021-03-10T14:49:29.354922+0000 mon.a (mon.0) 1464 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:29.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:29 gibba020 bash[25448]: audit 2021-03-10T14:49:29.356324+0000 mon.a (mon.0) 1465 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:29.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:29 gibba020 bash[25448]: audit 2021-03-10T14:49:29.359129+0000 mon.a (mon.0) 1466 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:29.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:29 gibba020 bash[25448]: audit 2021-03-10T14:49:29.360976+0000 mon.a (mon.0) 1467 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:29.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:29 gibba013 bash[29418]: audit 2021-03-10T14:49:28.990686+0000 mon.a (mon.0) 1459 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:49:29.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:29 gibba013 bash[29418]: audit 2021-03-10T14:49:29.159674+0000 mon.a (mon.0) 1460 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:49:29.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:29 gibba013 bash[29418]: audit 2021-03-10T14:49:29.347732+0000 mon.a (mon.0) 1461 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:49:29.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:29 gibba013 bash[29418]: audit 2021-03-10T14:49:29.351562+0000 mon.a (mon.0) 1462 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:49:29.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:29 gibba013 bash[29418]: audit 2021-03-10T14:49:29.353282+0000 mon.a (mon.0) 1463 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:29.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:29 gibba013 bash[29418]: audit 2021-03-10T14:49:29.354922+0000 mon.a (mon.0) 1464 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:29.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:29 gibba013 bash[29418]: audit 2021-03-10T14:49:29.356324+0000 mon.a (mon.0) 1465 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:29.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:29 gibba013 bash[29418]: audit 2021-03-10T14:49:29.359129+0000 mon.a (mon.0) 1466 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:29.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:29 gibba013 bash[29418]: audit 2021-03-10T14:49:29.360976+0000 mon.a (mon.0) 1467 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:29.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:29 gibba013 bash[30381]: audit 2021-03-10T14:49:28.990686+0000 mon.a (mon.0) 1459 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:49:29.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:29 gibba013 bash[30381]: audit 2021-03-10T14:49:29.159674+0000 mon.a (mon.0) 1460 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:49:29.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:29 gibba013 bash[30381]: audit 2021-03-10T14:49:29.347732+0000 mon.a (mon.0) 1461 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:49:29.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:29 gibba013 bash[30381]: audit 2021-03-10T14:49:29.351562+0000 mon.a (mon.0) 1462 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:49:29.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:29 gibba013 bash[30381]: audit 2021-03-10T14:49:29.353282+0000 mon.a (mon.0) 1463 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:29.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:29 gibba013 bash[30381]: audit 2021-03-10T14:49:29.354922+0000 mon.a (mon.0) 1464 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:29.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:29 gibba013 bash[30381]: audit 2021-03-10T14:49:29.356324+0000 mon.a (mon.0) 1465 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:29.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:29 gibba013 bash[30381]: audit 2021-03-10T14:49:29.359129+0000 mon.a (mon.0) 1466 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:29.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:29 gibba013 bash[30381]: audit 2021-03-10T14:49:29.360976+0000 mon.a (mon.0) 1467 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:30.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:30 gibba020 bash[25448]: cluster 2021-03-10T14:49:28.781641+0000 mgr.gibba020.yqfnwy (mgr.34427) 3004 : cluster [DBG] pgmap v1705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:30.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:30 gibba020 bash[25448]: cephadm 2021-03-10T14:49:29.159174+0000 mgr.gibba020.yqfnwy (mgr.34427) 3005 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:49:30.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:30 gibba020 bash[25448]: cephadm 2021-03-10T14:49:29.349581+0000 mgr.gibba020.yqfnwy (mgr.34427) 3006 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:49:30.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:30 gibba020 bash[25448]: cephadm 2021-03-10T14:49:29.351676+0000 mgr.gibba020.yqfnwy (mgr.34427) 3007 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:49:30.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:30 gibba020 bash[25448]: cephadm 2021-03-10T14:49:29.353307+0000 mgr.gibba020.yqfnwy (mgr.34427) 3008 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:49:30.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:30 gibba020 bash[25448]: cephadm 2021-03-10T14:49:29.353343+0000 mgr.gibba020.yqfnwy (mgr.34427) 3009 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:49:30.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:30 gibba020 bash[25448]: cephadm 2021-03-10T14:49:29.354751+0000 mgr.gibba020.yqfnwy (mgr.34427) 3010 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:49:30.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:30 gibba020 bash[25448]: cephadm 2021-03-10T14:49:29.354791+0000 mgr.gibba020.yqfnwy (mgr.34427) 3011 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:49:30.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:30 gibba020 bash[25448]: cephadm 2021-03-10T14:49:29.356308+0000 mgr.gibba020.yqfnwy (mgr.34427) 3012 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:49:30.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:30 gibba020 bash[25448]: cephadm 2021-03-10T14:49:29.357542+0000 mgr.gibba020.yqfnwy (mgr.34427) 3013 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:49:30.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:30 gibba020 bash[25448]: cephadm 2021-03-10T14:49:29.357579+0000 mgr.gibba020.yqfnwy (mgr.34427) 3014 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:49:30.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:30 gibba020 bash[25448]: cephadm 2021-03-10T14:49:29.358987+0000 mgr.gibba020.yqfnwy (mgr.34427) 3015 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:49:30.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:30 gibba020 bash[25448]: cephadm 2021-03-10T14:49:29.359295+0000 mgr.gibba020.yqfnwy (mgr.34427) 3016 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:49:30.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:30 gibba020 bash[25448]: cephadm 2021-03-10T14:49:29.360897+0000 mgr.gibba020.yqfnwy (mgr.34427) 3017 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:49:30.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:30 gibba020 bash[25448]: cephadm 2021-03-10T14:49:29.360935+0000 mgr.gibba020.yqfnwy (mgr.34427) 3018 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:49:30.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:30 gibba020 bash[25448]: cephadm 2021-03-10T14:49:29.361037+0000 mgr.gibba020.yqfnwy (mgr.34427) 3019 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:49:30.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:30 gibba013 bash[29418]: cluster 2021-03-10T14:49:28.781641+0000 mgr.gibba020.yqfnwy (mgr.34427) 3004 : cluster [DBG] pgmap v1705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:30.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:30 gibba013 bash[29418]: cephadm 2021-03-10T14:49:29.159174+0000 mgr.gibba020.yqfnwy (mgr.34427) 3005 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:49:30.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:30 gibba013 bash[29418]: cephadm 2021-03-10T14:49:29.349581+0000 mgr.gibba020.yqfnwy (mgr.34427) 3006 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:49:30.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:30 gibba013 bash[29418]: cephadm 2021-03-10T14:49:29.351676+0000 mgr.gibba020.yqfnwy (mgr.34427) 3007 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:49:30.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:30 gibba013 bash[29418]: cephadm 2021-03-10T14:49:29.353307+0000 mgr.gibba020.yqfnwy (mgr.34427) 3008 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:49:30.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:30 gibba013 bash[29418]: cephadm 2021-03-10T14:49:29.353343+0000 mgr.gibba020.yqfnwy (mgr.34427) 3009 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:49:30.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:30 gibba013 bash[29418]: cephadm 2021-03-10T14:49:29.354751+0000 mgr.gibba020.yqfnwy (mgr.34427) 3010 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:49:30.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:30 gibba013 bash[29418]: cephadm 2021-03-10T14:49:29.354791+0000 mgr.gibba020.yqfnwy (mgr.34427) 3011 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:49:30.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:30 gibba013 bash[29418]: cephadm 2021-03-10T14:49:29.356308+0000 mgr.gibba020.yqfnwy (mgr.34427) 3012 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:49:30.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:30 gibba013 bash[29418]: cephadm 2021-03-10T14:49:29.357542+0000 mgr.gibba020.yqfnwy (mgr.34427) 3013 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:49:30.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:30 gibba013 bash[29418]: cephadm 2021-03-10T14:49:29.357579+0000 mgr.gibba020.yqfnwy (mgr.34427) 3014 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:49:30.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:30 gibba013 bash[29418]: cephadm 2021-03-10T14:49:29.358987+0000 mgr.gibba020.yqfnwy (mgr.34427) 3015 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:49:30.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:30 gibba013 bash[29418]: cephadm 2021-03-10T14:49:29.359295+0000 mgr.gibba020.yqfnwy (mgr.34427) 3016 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:49:30.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:30 gibba013 bash[29418]: cephadm 2021-03-10T14:49:29.360897+0000 mgr.gibba020.yqfnwy (mgr.34427) 3017 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:49:30.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:30 gibba013 bash[29418]: cephadm 2021-03-10T14:49:29.360935+0000 mgr.gibba020.yqfnwy (mgr.34427) 3018 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:49:30.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:30 gibba013 bash[29418]: cephadm 2021-03-10T14:49:29.361037+0000 mgr.gibba020.yqfnwy (mgr.34427) 3019 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:49:30.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:30 gibba013 bash[30381]: cluster 2021-03-10T14:49:28.781641+0000 mgr.gibba020.yqfnwy (mgr.34427) 3004 : cluster [DBG] pgmap v1705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:30.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:30 gibba013 bash[30381]: cephadm 2021-03-10T14:49:29.159174+0000 mgr.gibba020.yqfnwy (mgr.34427) 3005 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:49:30.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:30 gibba013 bash[30381]: cephadm 2021-03-10T14:49:29.349581+0000 mgr.gibba020.yqfnwy (mgr.34427) 3006 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:49:30.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:30 gibba013 bash[30381]: cephadm 2021-03-10T14:49:29.351676+0000 mgr.gibba020.yqfnwy (mgr.34427) 3007 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:49:30.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:30 gibba013 bash[30381]: cephadm 2021-03-10T14:49:29.353307+0000 mgr.gibba020.yqfnwy (mgr.34427) 3008 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:49:30.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:30 gibba013 bash[30381]: cephadm 2021-03-10T14:49:29.353343+0000 mgr.gibba020.yqfnwy (mgr.34427) 3009 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:49:30.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:30 gibba013 bash[30381]: cephadm 2021-03-10T14:49:29.354751+0000 mgr.gibba020.yqfnwy (mgr.34427) 3010 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:49:30.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:30 gibba013 bash[30381]: cephadm 2021-03-10T14:49:29.354791+0000 mgr.gibba020.yqfnwy (mgr.34427) 3011 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:49:30.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:30 gibba013 bash[30381]: cephadm 2021-03-10T14:49:29.356308+0000 mgr.gibba020.yqfnwy (mgr.34427) 3012 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:49:30.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:30 gibba013 bash[30381]: cephadm 2021-03-10T14:49:29.357542+0000 mgr.gibba020.yqfnwy (mgr.34427) 3013 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:49:30.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:30 gibba013 bash[30381]: cephadm 2021-03-10T14:49:29.357579+0000 mgr.gibba020.yqfnwy (mgr.34427) 3014 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:49:30.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:30 gibba013 bash[30381]: cephadm 2021-03-10T14:49:29.358987+0000 mgr.gibba020.yqfnwy (mgr.34427) 3015 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:49:30.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:30 gibba013 bash[30381]: cephadm 2021-03-10T14:49:29.359295+0000 mgr.gibba020.yqfnwy (mgr.34427) 3016 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:49:30.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:30 gibba013 bash[30381]: cephadm 2021-03-10T14:49:29.360897+0000 mgr.gibba020.yqfnwy (mgr.34427) 3017 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:49:30.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:30 gibba013 bash[30381]: cephadm 2021-03-10T14:49:29.360935+0000 mgr.gibba020.yqfnwy (mgr.34427) 3018 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:49:30.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:30 gibba013 bash[30381]: cephadm 2021-03-10T14:49:29.361037+0000 mgr.gibba020.yqfnwy (mgr.34427) 3019 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:49:32.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:32 gibba013 bash[29418]: cluster 2021-03-10T14:49:30.783220+0000 mgr.gibba020.yqfnwy (mgr.34427) 3020 : cluster [DBG] pgmap v1706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:32.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:32 gibba013 bash[30381]: cluster 2021-03-10T14:49:30.783220+0000 mgr.gibba020.yqfnwy (mgr.34427) 3020 : cluster [DBG] pgmap v1706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:32.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:32 gibba020 bash[25448]: cluster 2021-03-10T14:49:30.783220+0000 mgr.gibba020.yqfnwy (mgr.34427) 3020 : cluster [DBG] pgmap v1706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:34.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:34 gibba013 bash[29418]: cluster 2021-03-10T14:49:32.784537+0000 mgr.gibba020.yqfnwy (mgr.34427) 3021 : cluster [DBG] pgmap v1707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:34.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:34 gibba013 bash[30381]: cluster 2021-03-10T14:49:32.784537+0000 mgr.gibba020.yqfnwy (mgr.34427) 3021 : cluster [DBG] pgmap v1707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:34.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:34 gibba020 bash[25448]: cluster 2021-03-10T14:49:32.784537+0000 mgr.gibba020.yqfnwy (mgr.34427) 3021 : cluster [DBG] pgmap v1707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:36.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:36 gibba013 bash[29418]: cluster 2021-03-10T14:49:34.786073+0000 mgr.gibba020.yqfnwy (mgr.34427) 3022 : cluster [DBG] pgmap v1708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:36.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:36 gibba013 bash[30381]: cluster 2021-03-10T14:49:34.786073+0000 mgr.gibba020.yqfnwy (mgr.34427) 3022 : cluster [DBG] pgmap v1708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:36.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:36 gibba020 bash[25448]: cluster 2021-03-10T14:49:34.786073+0000 mgr.gibba020.yqfnwy (mgr.34427) 3022 : cluster [DBG] pgmap v1708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:37.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:37 gibba020 bash[25448]: cluster 2021-03-10T14:49:36.787524+0000 mgr.gibba020.yqfnwy (mgr.34427) 3023 : cluster [DBG] pgmap v1709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:37.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:37 gibba013 bash[29418]: cluster 2021-03-10T14:49:36.787524+0000 mgr.gibba020.yqfnwy (mgr.34427) 3023 : cluster [DBG] pgmap v1709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:37.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:37 gibba013 bash[30381]: cluster 2021-03-10T14:49:36.787524+0000 mgr.gibba020.yqfnwy (mgr.34427) 3023 : cluster [DBG] pgmap v1709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:40.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:39 gibba013 bash[29418]: cluster 2021-03-10T14:49:38.789048+0000 mgr.gibba020.yqfnwy (mgr.34427) 3024 : cluster [DBG] pgmap v1710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:40.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:39 gibba013 bash[30381]: cluster 2021-03-10T14:49:38.789048+0000 mgr.gibba020.yqfnwy (mgr.34427) 3024 : cluster [DBG] pgmap v1710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:40.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:39 gibba020 bash[25448]: cluster 2021-03-10T14:49:38.789048+0000 mgr.gibba020.yqfnwy (mgr.34427) 3024 : cluster [DBG] pgmap v1710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:41.059 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:49:41.287 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:49:41.287 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (56m) 81s ago 61m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:49:41.287 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (61m) 17s ago 61m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:49:41.287 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (56m) 17s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:49:41.288 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (56m) 17s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:49:41.288 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (55m) 81s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:49:41.288 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (55m) 81s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:49:41.288 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (55m) 17s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:49:41.288 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (55m) 81s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:49:41.289 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (61m) 81s ago 61m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:49:41.289 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (61m) 17s ago 61m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:49:41.289 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (54m) 81s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:49:41.289 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (54m) 81s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:49:41.289 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (53m) 81s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:49:41.290 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (53m) 81s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:49:41.290 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (52m) 17s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:49:41.290 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (52m) 17s ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:49:41.290 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (51m) 17s ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:49:41.291 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (51m) 17s ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:49:41.291 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (61m) 17s ago 61m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:49:41.291 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 17s ago 59m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:49:41.543 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:49:41.543 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:49:41.543 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:49:41.544 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:49:41.544 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:49:41.544 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:49:41.544 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:49:41.544 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:49:41.545 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:49:41.545 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:49:41.545 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:49:41.545 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:49:41.545 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:49:41.546 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:49:41.546 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:49:42.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:42 gibba013 bash[29418]: cluster 2021-03-10T14:49:40.790601+0000 mgr.gibba020.yqfnwy (mgr.34427) 3025 : cluster [DBG] pgmap v1711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:42.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:42 gibba013 bash[29418]: audit 2021-03-10T14:49:41.046194+0000 mgr.gibba020.yqfnwy (mgr.34427) 3026 : audit [DBG] from='client.46086 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:49:42.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:42 gibba013 bash[29418]: audit 2021-03-10T14:49:41.271675+0000 mgr.gibba020.yqfnwy (mgr.34427) 3027 : audit [DBG] from='client.56077 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:49:42.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:42 gibba013 bash[29418]: audit 2021-03-10T14:49:41.541220+0000 mon.a (mon.0) 1468 : audit [DBG] from='client.? 172.21.2.113:0/1072620827' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:42.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:42 gibba013 bash[30381]: cluster 2021-03-10T14:49:40.790601+0000 mgr.gibba020.yqfnwy (mgr.34427) 3025 : cluster [DBG] pgmap v1711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:42.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:42 gibba013 bash[30381]: audit 2021-03-10T14:49:41.046194+0000 mgr.gibba020.yqfnwy (mgr.34427) 3026 : audit [DBG] from='client.46086 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:49:42.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:42 gibba013 bash[30381]: audit 2021-03-10T14:49:41.271675+0000 mgr.gibba020.yqfnwy (mgr.34427) 3027 : audit [DBG] from='client.56077 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:49:42.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:42 gibba013 bash[30381]: audit 2021-03-10T14:49:41.541220+0000 mon.a (mon.0) 1468 : audit [DBG] from='client.? 172.21.2.113:0/1072620827' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:42.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:42 gibba020 bash[25448]: cluster 2021-03-10T14:49:40.790601+0000 mgr.gibba020.yqfnwy (mgr.34427) 3025 : cluster [DBG] pgmap v1711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:42.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:42 gibba020 bash[25448]: audit 2021-03-10T14:49:41.046194+0000 mgr.gibba020.yqfnwy (mgr.34427) 3026 : audit [DBG] from='client.46086 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:49:42.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:42 gibba020 bash[25448]: audit 2021-03-10T14:49:41.271675+0000 mgr.gibba020.yqfnwy (mgr.34427) 3027 : audit [DBG] from='client.56077 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:49:42.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:42 gibba020 bash[25448]: audit 2021-03-10T14:49:41.541220+0000 mon.a (mon.0) 1468 : audit [DBG] from='client.? 172.21.2.113:0/1072620827' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:49:44.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:44 gibba013 bash[29418]: cluster 2021-03-10T14:49:42.792307+0000 mgr.gibba020.yqfnwy (mgr.34427) 3028 : cluster [DBG] pgmap v1712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:44.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:44 gibba013 bash[30381]: cluster 2021-03-10T14:49:42.792307+0000 mgr.gibba020.yqfnwy (mgr.34427) 3028 : cluster [DBG] pgmap v1712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:44.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:44 gibba020 bash[25448]: cluster 2021-03-10T14:49:42.792307+0000 mgr.gibba020.yqfnwy (mgr.34427) 3028 : cluster [DBG] pgmap v1712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:46.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:46 gibba013 bash[29418]: cephadm 2021-03-10T14:49:44.376145+0000 mgr.gibba020.yqfnwy (mgr.34427) 3029 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:49:46.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:46 gibba013 bash[29418]: cluster 2021-03-10T14:49:44.794094+0000 mgr.gibba020.yqfnwy (mgr.34427) 3030 : cluster [DBG] pgmap v1713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:46.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:46 gibba013 bash[30381]: cephadm 2021-03-10T14:49:44.376145+0000 mgr.gibba020.yqfnwy (mgr.34427) 3029 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:49:46.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:46 gibba013 bash[30381]: cluster 2021-03-10T14:49:44.794094+0000 mgr.gibba020.yqfnwy (mgr.34427) 3030 : cluster [DBG] pgmap v1713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:46.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:46 gibba020 bash[25448]: cephadm 2021-03-10T14:49:44.376145+0000 mgr.gibba020.yqfnwy (mgr.34427) 3029 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:49:46.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:46 gibba020 bash[25448]: cluster 2021-03-10T14:49:44.794094+0000 mgr.gibba020.yqfnwy (mgr.34427) 3030 : cluster [DBG] pgmap v1713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:48.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:48 gibba020 bash[25448]: cluster 2021-03-10T14:49:46.795664+0000 mgr.gibba020.yqfnwy (mgr.34427) 3031 : cluster [DBG] pgmap v1714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:48.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:48 gibba013 bash[29418]: cluster 2021-03-10T14:49:46.795664+0000 mgr.gibba020.yqfnwy (mgr.34427) 3031 : cluster [DBG] pgmap v1714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:48.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:48 gibba013 bash[30381]: cluster 2021-03-10T14:49:46.795664+0000 mgr.gibba020.yqfnwy (mgr.34427) 3031 : cluster [DBG] pgmap v1714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:49.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:49 gibba020 bash[25448]: cluster 2021-03-10T14:49:48.797099+0000 mgr.gibba020.yqfnwy (mgr.34427) 3032 : cluster [DBG] pgmap v1715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:49.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:49 gibba013 bash[29418]: cluster 2021-03-10T14:49:48.797099+0000 mgr.gibba020.yqfnwy (mgr.34427) 3032 : cluster [DBG] pgmap v1715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:49.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:49 gibba013 bash[30381]: cluster 2021-03-10T14:49:48.797099+0000 mgr.gibba020.yqfnwy (mgr.34427) 3032 : cluster [DBG] pgmap v1715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:52.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:52 gibba013 bash[29418]: cluster 2021-03-10T14:49:50.798816+0000 mgr.gibba020.yqfnwy (mgr.34427) 3033 : cluster [DBG] pgmap v1716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:52.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:52 gibba013 bash[30381]: cluster 2021-03-10T14:49:50.798816+0000 mgr.gibba020.yqfnwy (mgr.34427) 3033 : cluster [DBG] pgmap v1716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:52.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:52 gibba020 bash[25448]: cluster 2021-03-10T14:49:50.798816+0000 mgr.gibba020.yqfnwy (mgr.34427) 3033 : cluster [DBG] pgmap v1716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:54.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:54 gibba013 bash[29418]: cluster 2021-03-10T14:49:52.800387+0000 mgr.gibba020.yqfnwy (mgr.34427) 3034 : cluster [DBG] pgmap v1717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:54.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:54 gibba013 bash[30381]: cluster 2021-03-10T14:49:52.800387+0000 mgr.gibba020.yqfnwy (mgr.34427) 3034 : cluster [DBG] pgmap v1717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:54.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:54 gibba020 bash[25448]: cluster 2021-03-10T14:49:52.800387+0000 mgr.gibba020.yqfnwy (mgr.34427) 3034 : cluster [DBG] pgmap v1717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:56.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:56 gibba013 bash[29418]: cluster 2021-03-10T14:49:54.801972+0000 mgr.gibba020.yqfnwy (mgr.34427) 3035 : cluster [DBG] pgmap v1718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:56.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:56 gibba013 bash[30381]: cluster 2021-03-10T14:49:54.801972+0000 mgr.gibba020.yqfnwy (mgr.34427) 3035 : cluster [DBG] pgmap v1718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:56.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:56 gibba020 bash[25448]: cluster 2021-03-10T14:49:54.801972+0000 mgr.gibba020.yqfnwy (mgr.34427) 3035 : cluster [DBG] pgmap v1718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:57.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:57 gibba020 bash[25448]: cluster 2021-03-10T14:49:56.803309+0000 mgr.gibba020.yqfnwy (mgr.34427) 3036 : cluster [DBG] pgmap v1719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:57.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:57 gibba013 bash[29418]: cluster 2021-03-10T14:49:56.803309+0000 mgr.gibba020.yqfnwy (mgr.34427) 3036 : cluster [DBG] pgmap v1719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:49:57.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:57 gibba013 bash[30381]: cluster 2021-03-10T14:49:56.803309+0000 mgr.gibba020.yqfnwy (mgr.34427) 3036 : cluster [DBG] pgmap v1719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:00.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:49:59 gibba013 bash[29418]: cluster 2021-03-10T14:49:58.804718+0000 mgr.gibba020.yqfnwy (mgr.34427) 3037 : cluster [DBG] pgmap v1720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:00.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:00 gibba013 bash[29418]: debug 2021-03-10T14:49:59.995+0000 7fd718a82700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:50:00.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:49:59 gibba013 bash[30381]: cluster 2021-03-10T14:49:58.804718+0000 mgr.gibba020.yqfnwy (mgr.34427) 3037 : cluster [DBG] pgmap v1720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:00.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:49:59 gibba020 bash[25448]: cluster 2021-03-10T14:49:58.804718+0000 mgr.gibba020.yqfnwy (mgr.34427) 3037 : cluster [DBG] pgmap v1720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:01.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:00 gibba013 bash[29418]: cephadm 2021-03-10T14:49:59.387876+0000 mgr.gibba020.yqfnwy (mgr.34427) 3038 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:50:01.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:00 gibba013 bash[29418]: cluster 2021-03-10T14:50:00.000282+0000 mon.a (mon.0) 1469 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:50:01.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:00 gibba013 bash[30381]: cephadm 2021-03-10T14:49:59.387876+0000 mgr.gibba020.yqfnwy (mgr.34427) 3038 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:50:01.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:00 gibba013 bash[30381]: cluster 2021-03-10T14:50:00.000282+0000 mon.a (mon.0) 1469 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:50:01.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:00 gibba020 bash[25448]: cephadm 2021-03-10T14:49:59.387876+0000 mgr.gibba020.yqfnwy (mgr.34427) 3038 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:50:01.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:00 gibba020 bash[25448]: cluster 2021-03-10T14:50:00.000282+0000 mon.a (mon.0) 1469 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T14:50:02.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:02 gibba013 bash[29418]: cluster 2021-03-10T14:50:00.806461+0000 mgr.gibba020.yqfnwy (mgr.34427) 3039 : cluster [DBG] pgmap v1721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:02.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:02 gibba013 bash[30381]: cluster 2021-03-10T14:50:00.806461+0000 mgr.gibba020.yqfnwy (mgr.34427) 3039 : cluster [DBG] pgmap v1721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:02.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:02 gibba020 bash[25448]: cluster 2021-03-10T14:50:00.806461+0000 mgr.gibba020.yqfnwy (mgr.34427) 3039 : cluster [DBG] pgmap v1721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:04.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:04 gibba013 bash[29418]: cluster 2021-03-10T14:50:02.808063+0000 mgr.gibba020.yqfnwy (mgr.34427) 3040 : cluster [DBG] pgmap v1722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:04.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:04 gibba013 bash[30381]: cluster 2021-03-10T14:50:02.808063+0000 mgr.gibba020.yqfnwy (mgr.34427) 3040 : cluster [DBG] pgmap v1722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:04.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:04 gibba020 bash[25448]: cluster 2021-03-10T14:50:02.808063+0000 mgr.gibba020.yqfnwy (mgr.34427) 3040 : cluster [DBG] pgmap v1722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:06 gibba020 bash[25448]: cluster 2021-03-10T14:50:04.809525+0000 mgr.gibba020.yqfnwy (mgr.34427) 3041 : cluster [DBG] pgmap v1723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:06 gibba020 bash[25448]: audit 2021-03-10T14:50:06.265874+0000 mon.a (mon.0) 1470 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:50:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:06 gibba020 bash[25448]: audit 2021-03-10T14:50:06.267872+0000 mon.a (mon.0) 1471 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T14:50:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:06 gibba020 bash[25448]: audit 2021-03-10T14:50:06.268619+0000 mon.a (mon.0) 1472 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:50:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:06 gibba020 bash[25448]: audit 2021-03-10T14:50:06.270600+0000 mon.a (mon.0) 1473 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T14:50:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:06 gibba020 bash[25448]: audit 2021-03-10T14:50:06.271310+0000 mon.a (mon.0) 1474 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:50:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:06 gibba020 bash[25448]: audit 2021-03-10T14:50:06.271908+0000 mon.a (mon.0) 1475 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:50:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:06 gibba013 bash[29418]: cluster 2021-03-10T14:50:04.809525+0000 mgr.gibba020.yqfnwy (mgr.34427) 3041 : cluster [DBG] pgmap v1723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:06 gibba013 bash[29418]: audit 2021-03-10T14:50:06.265874+0000 mon.a (mon.0) 1470 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:50:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:06 gibba013 bash[29418]: audit 2021-03-10T14:50:06.267872+0000 mon.a (mon.0) 1471 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T14:50:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:06 gibba013 bash[29418]: audit 2021-03-10T14:50:06.268619+0000 mon.a (mon.0) 1472 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:50:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:06 gibba013 bash[29418]: audit 2021-03-10T14:50:06.270600+0000 mon.a (mon.0) 1473 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T14:50:06.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:06 gibba013 bash[29418]: audit 2021-03-10T14:50:06.271310+0000 mon.a (mon.0) 1474 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:50:06.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:06 gibba013 bash[29418]: audit 2021-03-10T14:50:06.271908+0000 mon.a (mon.0) 1475 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:50:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:06 gibba013 bash[30381]: cluster 2021-03-10T14:50:04.809525+0000 mgr.gibba020.yqfnwy (mgr.34427) 3041 : cluster [DBG] pgmap v1723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:06 gibba013 bash[30381]: audit 2021-03-10T14:50:06.265874+0000 mon.a (mon.0) 1470 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:50:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:06 gibba013 bash[30381]: audit 2021-03-10T14:50:06.267872+0000 mon.a (mon.0) 1471 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T14:50:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:06 gibba013 bash[30381]: audit 2021-03-10T14:50:06.268619+0000 mon.a (mon.0) 1472 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T14:50:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:06 gibba013 bash[30381]: audit 2021-03-10T14:50:06.270600+0000 mon.a (mon.0) 1473 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T14:50:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:06 gibba013 bash[30381]: audit 2021-03-10T14:50:06.271310+0000 mon.a (mon.0) 1474 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:50:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:06 gibba013 bash[30381]: audit 2021-03-10T14:50:06.271908+0000 mon.a (mon.0) 1475 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:50:07.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:07 gibba020 bash[25448]: cluster 2021-03-10T14:50:06.810988+0000 mgr.gibba020.yqfnwy (mgr.34427) 3042 : cluster [DBG] pgmap v1724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:07.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:07 gibba013 bash[29418]: cluster 2021-03-10T14:50:06.810988+0000 mgr.gibba020.yqfnwy (mgr.34427) 3042 : cluster [DBG] pgmap v1724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:07.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:07 gibba013 bash[30381]: cluster 2021-03-10T14:50:06.810988+0000 mgr.gibba020.yqfnwy (mgr.34427) 3042 : cluster [DBG] pgmap v1724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:10.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:09 gibba013 bash[29418]: cluster 2021-03-10T14:50:08.812692+0000 mgr.gibba020.yqfnwy (mgr.34427) 3043 : cluster [DBG] pgmap v1725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:10.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:09 gibba013 bash[30381]: cluster 2021-03-10T14:50:08.812692+0000 mgr.gibba020.yqfnwy (mgr.34427) 3043 : cluster [DBG] pgmap v1725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:10.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:09 gibba020 bash[25448]: cluster 2021-03-10T14:50:08.812692+0000 mgr.gibba020.yqfnwy (mgr.34427) 3043 : cluster [DBG] pgmap v1725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:11.791 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:50:12.018 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:50:12.018 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (56m) 112s ago 62m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:50:12.019 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (61m) 47s ago 61m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:50:12.019 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (57m) 47s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:50:12.019 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (57m) 47s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:50:12.019 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (56m) 112s ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:50:12.019 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (56m) 112s ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:50:12.020 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (55m) 47s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:50:12.020 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (55m) 112s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:50:12.020 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (62m) 112s ago 62m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:50:12.020 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (62m) 47s ago 62m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:50:12.020 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (54m) 112s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:50:12.021 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (54m) 112s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:50:12.021 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (54m) 112s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:50:12.021 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (53m) 112s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:50:12.021 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (53m) 47s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:50:12.021 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (52m) 47s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:50:12.022 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (52m) 47s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:50:12.022 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (51m) 47s ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:50:12.022 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (61m) 47s ago 62m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:50:12.022 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 47s ago 60m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:50:12.268 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:50:12.268 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:50:12.268 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:50:12.269 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:50:12.269 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:50:12.269 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:50:12.269 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:50:12.270 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:50:12.270 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:50:12.270 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:50:12.270 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:50:12.271 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:50:12.271 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:50:12.271 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:50:12.271 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:50:12.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:12 gibba013 bash[29418]: cluster 2021-03-10T14:50:10.814362+0000 mgr.gibba020.yqfnwy (mgr.34427) 3044 : cluster [DBG] pgmap v1726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:12.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:12 gibba013 bash[29418]: audit 2021-03-10T14:50:12.265867+0000 mon.a (mon.0) 1476 : audit [DBG] from='client.? 172.21.2.113:0/447744128' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:12.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:12 gibba013 bash[30381]: cluster 2021-03-10T14:50:10.814362+0000 mgr.gibba020.yqfnwy (mgr.34427) 3044 : cluster [DBG] pgmap v1726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:12.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:12 gibba013 bash[30381]: audit 2021-03-10T14:50:12.265867+0000 mon.a (mon.0) 1476 : audit [DBG] from='client.? 172.21.2.113:0/447744128' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:12.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:12 gibba020 bash[25448]: cluster 2021-03-10T14:50:10.814362+0000 mgr.gibba020.yqfnwy (mgr.34427) 3044 : cluster [DBG] pgmap v1726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:12.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:12 gibba020 bash[25448]: audit 2021-03-10T14:50:12.265867+0000 mon.a (mon.0) 1476 : audit [DBG] from='client.? 172.21.2.113:0/447744128' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:13.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:13 gibba020 bash[25448]: audit 2021-03-10T14:50:11.779056+0000 mgr.gibba020.yqfnwy (mgr.34427) 3045 : audit [DBG] from='client.56089 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:50:13.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:13 gibba020 bash[25448]: audit 2021-03-10T14:50:12.001768+0000 mgr.gibba020.yqfnwy (mgr.34427) 3046 : audit [DBG] from='client.46110 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:50:13.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:13 gibba013 bash[29418]: audit 2021-03-10T14:50:11.779056+0000 mgr.gibba020.yqfnwy (mgr.34427) 3045 : audit [DBG] from='client.56089 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:50:13.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:13 gibba013 bash[29418]: audit 2021-03-10T14:50:12.001768+0000 mgr.gibba020.yqfnwy (mgr.34427) 3046 : audit [DBG] from='client.46110 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:50:13.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:13 gibba013 bash[30381]: audit 2021-03-10T14:50:11.779056+0000 mgr.gibba020.yqfnwy (mgr.34427) 3045 : audit [DBG] from='client.56089 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:50:13.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:13 gibba013 bash[30381]: audit 2021-03-10T14:50:12.001768+0000 mgr.gibba020.yqfnwy (mgr.34427) 3046 : audit [DBG] from='client.46110 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:50:14.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:14 gibba020 bash[25448]: cluster 2021-03-10T14:50:12.814831+0000 mgr.gibba020.yqfnwy (mgr.34427) 3047 : cluster [DBG] pgmap v1727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:14.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:14 gibba013 bash[29418]: cluster 2021-03-10T14:50:12.814831+0000 mgr.gibba020.yqfnwy (mgr.34427) 3047 : cluster [DBG] pgmap v1727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:14.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:14 gibba013 bash[30381]: cluster 2021-03-10T14:50:12.814831+0000 mgr.gibba020.yqfnwy (mgr.34427) 3047 : cluster [DBG] pgmap v1727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:15.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:15 gibba020 bash[25448]: cephadm 2021-03-10T14:50:14.403431+0000 mgr.gibba020.yqfnwy (mgr.34427) 3048 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:50:15.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:15 gibba020 bash[25448]: cluster 2021-03-10T14:50:14.816144+0000 mgr.gibba020.yqfnwy (mgr.34427) 3049 : cluster [DBG] pgmap v1728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:15.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:15 gibba013 bash[29418]: cephadm 2021-03-10T14:50:14.403431+0000 mgr.gibba020.yqfnwy (mgr.34427) 3048 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:50:15.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:15 gibba013 bash[29418]: cluster 2021-03-10T14:50:14.816144+0000 mgr.gibba020.yqfnwy (mgr.34427) 3049 : cluster [DBG] pgmap v1728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:15.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:15 gibba013 bash[30381]: cephadm 2021-03-10T14:50:14.403431+0000 mgr.gibba020.yqfnwy (mgr.34427) 3048 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:50:15.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:15 gibba013 bash[30381]: cluster 2021-03-10T14:50:14.816144+0000 mgr.gibba020.yqfnwy (mgr.34427) 3049 : cluster [DBG] pgmap v1728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:18.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:18 gibba013 bash[29418]: cluster 2021-03-10T14:50:16.817809+0000 mgr.gibba020.yqfnwy (mgr.34427) 3050 : cluster [DBG] pgmap v1729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:18.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:18 gibba013 bash[30381]: cluster 2021-03-10T14:50:16.817809+0000 mgr.gibba020.yqfnwy (mgr.34427) 3050 : cluster [DBG] pgmap v1729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:18.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:18 gibba020 bash[25448]: cluster 2021-03-10T14:50:16.817809+0000 mgr.gibba020.yqfnwy (mgr.34427) 3050 : cluster [DBG] pgmap v1729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:20.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:20 gibba020 bash[25448]: cluster 2021-03-10T14:50:18.819122+0000 mgr.gibba020.yqfnwy (mgr.34427) 3051 : cluster [DBG] pgmap v1730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:20.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:20 gibba013 bash[29418]: cluster 2021-03-10T14:50:18.819122+0000 mgr.gibba020.yqfnwy (mgr.34427) 3051 : cluster [DBG] pgmap v1730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:20.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:20 gibba013 bash[30381]: cluster 2021-03-10T14:50:18.819122+0000 mgr.gibba020.yqfnwy (mgr.34427) 3051 : cluster [DBG] pgmap v1730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:22.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:22 gibba013 bash[29418]: cluster 2021-03-10T14:50:20.819613+0000 mgr.gibba020.yqfnwy (mgr.34427) 3052 : cluster [DBG] pgmap v1731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:22.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:22 gibba013 bash[30381]: cluster 2021-03-10T14:50:20.819613+0000 mgr.gibba020.yqfnwy (mgr.34427) 3052 : cluster [DBG] pgmap v1731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:22.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:22 gibba020 bash[25448]: cluster 2021-03-10T14:50:20.819613+0000 mgr.gibba020.yqfnwy (mgr.34427) 3052 : cluster [DBG] pgmap v1731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:24.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:24 gibba020 bash[25448]: cluster 2021-03-10T14:50:22.821015+0000 mgr.gibba020.yqfnwy (mgr.34427) 3053 : cluster [DBG] pgmap v1732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:24.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:24 gibba013 bash[29418]: cluster 2021-03-10T14:50:22.821015+0000 mgr.gibba020.yqfnwy (mgr.34427) 3053 : cluster [DBG] pgmap v1732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:24.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:24 gibba013 bash[30381]: cluster 2021-03-10T14:50:22.821015+0000 mgr.gibba020.yqfnwy (mgr.34427) 3053 : cluster [DBG] pgmap v1732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:25.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:25 gibba020 bash[25448]: cluster 2021-03-10T14:50:24.822600+0000 mgr.gibba020.yqfnwy (mgr.34427) 3054 : cluster [DBG] pgmap v1733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:25.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:25 gibba013 bash[29418]: cluster 2021-03-10T14:50:24.822600+0000 mgr.gibba020.yqfnwy (mgr.34427) 3054 : cluster [DBG] pgmap v1733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:25.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:25 gibba013 bash[30381]: cluster 2021-03-10T14:50:24.822600+0000 mgr.gibba020.yqfnwy (mgr.34427) 3054 : cluster [DBG] pgmap v1733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:28.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:28 gibba020 bash[25448]: cluster 2021-03-10T14:50:26.824297+0000 mgr.gibba020.yqfnwy (mgr.34427) 3055 : cluster [DBG] pgmap v1734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:28.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:28 gibba013 bash[29418]: cluster 2021-03-10T14:50:26.824297+0000 mgr.gibba020.yqfnwy (mgr.34427) 3055 : cluster [DBG] pgmap v1734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:28.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:28 gibba013 bash[30381]: cluster 2021-03-10T14:50:26.824297+0000 mgr.gibba020.yqfnwy (mgr.34427) 3055 : cluster [DBG] pgmap v1734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:30.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:30 gibba020 bash[25448]: cluster 2021-03-10T14:50:28.825887+0000 mgr.gibba020.yqfnwy (mgr.34427) 3056 : cluster [DBG] pgmap v1735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:30.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:30 gibba020 bash[25448]: audit 2021-03-10T14:50:29.414671+0000 mon.a (mon.0) 1477 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:50:30.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:30 gibba020 bash[25448]: audit 2021-03-10T14:50:29.628596+0000 mon.a (mon.0) 1478 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:50:30.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:30 gibba020 bash[25448]: audit 2021-03-10T14:50:29.631882+0000 mon.a (mon.0) 1479 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:50:30.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:30 gibba020 bash[25448]: audit 2021-03-10T14:50:29.633455+0000 mon.a (mon.0) 1480 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:30.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:30 gibba020 bash[25448]: audit 2021-03-10T14:50:29.634534+0000 mon.a (mon.0) 1481 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:30.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:30 gibba020 bash[25448]: audit 2021-03-10T14:50:29.635972+0000 mon.a (mon.0) 1482 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:30.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:30 gibba020 bash[25448]: audit 2021-03-10T14:50:29.638309+0000 mon.a (mon.0) 1483 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:30.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:30 gibba020 bash[25448]: audit 2021-03-10T14:50:29.639835+0000 mon.a (mon.0) 1484 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:30.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:30 gibba013 bash[29418]: cluster 2021-03-10T14:50:28.825887+0000 mgr.gibba020.yqfnwy (mgr.34427) 3056 : cluster [DBG] pgmap v1735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:30.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:30 gibba013 bash[29418]: audit 2021-03-10T14:50:29.414671+0000 mon.a (mon.0) 1477 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:50:30.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:30 gibba013 bash[29418]: audit 2021-03-10T14:50:29.628596+0000 mon.a (mon.0) 1478 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:50:30.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:30 gibba013 bash[29418]: audit 2021-03-10T14:50:29.631882+0000 mon.a (mon.0) 1479 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:50:30.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:30 gibba013 bash[29418]: audit 2021-03-10T14:50:29.633455+0000 mon.a (mon.0) 1480 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:30.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:30 gibba013 bash[29418]: audit 2021-03-10T14:50:29.634534+0000 mon.a (mon.0) 1481 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:30.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:30 gibba013 bash[29418]: audit 2021-03-10T14:50:29.635972+0000 mon.a (mon.0) 1482 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:30.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:30 gibba013 bash[29418]: audit 2021-03-10T14:50:29.638309+0000 mon.a (mon.0) 1483 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:30.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:30 gibba013 bash[29418]: audit 2021-03-10T14:50:29.639835+0000 mon.a (mon.0) 1484 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:30.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:30 gibba013 bash[30381]: cluster 2021-03-10T14:50:28.825887+0000 mgr.gibba020.yqfnwy (mgr.34427) 3056 : cluster [DBG] pgmap v1735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:30.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:30 gibba013 bash[30381]: audit 2021-03-10T14:50:29.414671+0000 mon.a (mon.0) 1477 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:50:30.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:30 gibba013 bash[30381]: audit 2021-03-10T14:50:29.628596+0000 mon.a (mon.0) 1478 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:50:30.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:30 gibba013 bash[30381]: audit 2021-03-10T14:50:29.631882+0000 mon.a (mon.0) 1479 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:50:30.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:30 gibba013 bash[30381]: audit 2021-03-10T14:50:29.633455+0000 mon.a (mon.0) 1480 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:30.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:30 gibba013 bash[30381]: audit 2021-03-10T14:50:29.634534+0000 mon.a (mon.0) 1481 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:30.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:30 gibba013 bash[30381]: audit 2021-03-10T14:50:29.635972+0000 mon.a (mon.0) 1482 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:30.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:30 gibba013 bash[30381]: audit 2021-03-10T14:50:29.638309+0000 mon.a (mon.0) 1483 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:30.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:30 gibba013 bash[30381]: audit 2021-03-10T14:50:29.639835+0000 mon.a (mon.0) 1484 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:31.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:31 gibba020 bash[25448]: cephadm 2021-03-10T14:50:29.418560+0000 mgr.gibba020.yqfnwy (mgr.34427) 3057 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:50:31.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:31 gibba020 bash[25448]: cephadm 2021-03-10T14:50:29.420332+0000 mgr.gibba020.yqfnwy (mgr.34427) 3058 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:50:31.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:31 gibba020 bash[25448]: cephadm 2021-03-10T14:50:29.630036+0000 mgr.gibba020.yqfnwy (mgr.34427) 3059 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:50:31.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:31 gibba020 bash[25448]: cephadm 2021-03-10T14:50:29.631786+0000 mgr.gibba020.yqfnwy (mgr.34427) 3060 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:50:31.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:31 gibba020 bash[25448]: cephadm 2021-03-10T14:50:29.633044+0000 mgr.gibba020.yqfnwy (mgr.34427) 3061 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:50:31.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:31 gibba020 bash[25448]: cephadm 2021-03-10T14:50:29.633083+0000 mgr.gibba020.yqfnwy (mgr.34427) 3062 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:50:31.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:31 gibba020 bash[25448]: cephadm 2021-03-10T14:50:29.634366+0000 mgr.gibba020.yqfnwy (mgr.34427) 3063 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:50:31.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:31 gibba020 bash[25448]: cephadm 2021-03-10T14:50:29.634404+0000 mgr.gibba020.yqfnwy (mgr.34427) 3064 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:50:31.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:31 gibba020 bash[25448]: cephadm 2021-03-10T14:50:29.635535+0000 mgr.gibba020.yqfnwy (mgr.34427) 3065 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:50:31.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:31 gibba020 bash[25448]: cephadm 2021-03-10T14:50:29.636482+0000 mgr.gibba020.yqfnwy (mgr.34427) 3066 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:50:31.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:31 gibba020 bash[25448]: cephadm 2021-03-10T14:50:29.636518+0000 mgr.gibba020.yqfnwy (mgr.34427) 3067 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:50:31.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:31 gibba020 bash[25448]: cephadm 2021-03-10T14:50:29.638073+0000 mgr.gibba020.yqfnwy (mgr.34427) 3068 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:50:31.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:31 gibba020 bash[25448]: cephadm 2021-03-10T14:50:29.638433+0000 mgr.gibba020.yqfnwy (mgr.34427) 3069 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:50:31.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:31 gibba020 bash[25448]: cephadm 2021-03-10T14:50:29.639330+0000 mgr.gibba020.yqfnwy (mgr.34427) 3070 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:50:31.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:31 gibba020 bash[25448]: cephadm 2021-03-10T14:50:29.639369+0000 mgr.gibba020.yqfnwy (mgr.34427) 3071 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:50:31.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:31 gibba020 bash[25448]: cephadm 2021-03-10T14:50:29.639472+0000 mgr.gibba020.yqfnwy (mgr.34427) 3072 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:50:31.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:31 gibba020 bash[25448]: cluster 2021-03-10T14:50:30.827584+0000 mgr.gibba020.yqfnwy (mgr.34427) 3073 : cluster [DBG] pgmap v1736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:31.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:31 gibba013 bash[29418]: cephadm 2021-03-10T14:50:29.418560+0000 mgr.gibba020.yqfnwy (mgr.34427) 3057 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:50:31.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:31 gibba013 bash[29418]: cephadm 2021-03-10T14:50:29.420332+0000 mgr.gibba020.yqfnwy (mgr.34427) 3058 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:50:31.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:31 gibba013 bash[29418]: cephadm 2021-03-10T14:50:29.630036+0000 mgr.gibba020.yqfnwy (mgr.34427) 3059 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:50:31.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:31 gibba013 bash[29418]: cephadm 2021-03-10T14:50:29.631786+0000 mgr.gibba020.yqfnwy (mgr.34427) 3060 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:50:31.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:31 gibba013 bash[29418]: cephadm 2021-03-10T14:50:29.633044+0000 mgr.gibba020.yqfnwy (mgr.34427) 3061 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:50:31.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:31 gibba013 bash[29418]: cephadm 2021-03-10T14:50:29.633083+0000 mgr.gibba020.yqfnwy (mgr.34427) 3062 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:50:31.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:31 gibba013 bash[29418]: cephadm 2021-03-10T14:50:29.634366+0000 mgr.gibba020.yqfnwy (mgr.34427) 3063 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:50:31.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:31 gibba013 bash[29418]: cephadm 2021-03-10T14:50:29.634404+0000 mgr.gibba020.yqfnwy (mgr.34427) 3064 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:50:31.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:31 gibba013 bash[29418]: cephadm 2021-03-10T14:50:29.635535+0000 mgr.gibba020.yqfnwy (mgr.34427) 3065 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:50:31.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:31 gibba013 bash[29418]: cephadm 2021-03-10T14:50:29.636482+0000 mgr.gibba020.yqfnwy (mgr.34427) 3066 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:50:31.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:31 gibba013 bash[29418]: cephadm 2021-03-10T14:50:29.636518+0000 mgr.gibba020.yqfnwy (mgr.34427) 3067 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:50:31.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:31 gibba013 bash[29418]: cephadm 2021-03-10T14:50:29.638073+0000 mgr.gibba020.yqfnwy (mgr.34427) 3068 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:50:31.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:31 gibba013 bash[29418]: cephadm 2021-03-10T14:50:29.638433+0000 mgr.gibba020.yqfnwy (mgr.34427) 3069 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:50:31.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:31 gibba013 bash[29418]: cephadm 2021-03-10T14:50:29.639330+0000 mgr.gibba020.yqfnwy (mgr.34427) 3070 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:50:31.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:31 gibba013 bash[29418]: cephadm 2021-03-10T14:50:29.639369+0000 mgr.gibba020.yqfnwy (mgr.34427) 3071 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:50:31.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:31 gibba013 bash[29418]: cephadm 2021-03-10T14:50:29.639472+0000 mgr.gibba020.yqfnwy (mgr.34427) 3072 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:50:31.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:31 gibba013 bash[29418]: cluster 2021-03-10T14:50:30.827584+0000 mgr.gibba020.yqfnwy (mgr.34427) 3073 : cluster [DBG] pgmap v1736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:31.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:31 gibba013 bash[30381]: cephadm 2021-03-10T14:50:29.418560+0000 mgr.gibba020.yqfnwy (mgr.34427) 3057 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:50:31.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:31 gibba013 bash[30381]: cephadm 2021-03-10T14:50:29.420332+0000 mgr.gibba020.yqfnwy (mgr.34427) 3058 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:50:31.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:31 gibba013 bash[30381]: cephadm 2021-03-10T14:50:29.630036+0000 mgr.gibba020.yqfnwy (mgr.34427) 3059 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:50:31.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:31 gibba013 bash[30381]: cephadm 2021-03-10T14:50:29.631786+0000 mgr.gibba020.yqfnwy (mgr.34427) 3060 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:50:31.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:31 gibba013 bash[30381]: cephadm 2021-03-10T14:50:29.633044+0000 mgr.gibba020.yqfnwy (mgr.34427) 3061 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:50:31.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:31 gibba013 bash[30381]: cephadm 2021-03-10T14:50:29.633083+0000 mgr.gibba020.yqfnwy (mgr.34427) 3062 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:50:31.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:31 gibba013 bash[30381]: cephadm 2021-03-10T14:50:29.634366+0000 mgr.gibba020.yqfnwy (mgr.34427) 3063 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:50:31.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:31 gibba013 bash[30381]: cephadm 2021-03-10T14:50:29.634404+0000 mgr.gibba020.yqfnwy (mgr.34427) 3064 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:50:31.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:31 gibba013 bash[30381]: cephadm 2021-03-10T14:50:29.635535+0000 mgr.gibba020.yqfnwy (mgr.34427) 3065 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:50:31.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:31 gibba013 bash[30381]: cephadm 2021-03-10T14:50:29.636482+0000 mgr.gibba020.yqfnwy (mgr.34427) 3066 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:50:31.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:31 gibba013 bash[30381]: cephadm 2021-03-10T14:50:29.636518+0000 mgr.gibba020.yqfnwy (mgr.34427) 3067 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:50:31.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:31 gibba013 bash[30381]: cephadm 2021-03-10T14:50:29.638073+0000 mgr.gibba020.yqfnwy (mgr.34427) 3068 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:50:31.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:31 gibba013 bash[30381]: cephadm 2021-03-10T14:50:29.638433+0000 mgr.gibba020.yqfnwy (mgr.34427) 3069 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:50:31.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:31 gibba013 bash[30381]: cephadm 2021-03-10T14:50:29.639330+0000 mgr.gibba020.yqfnwy (mgr.34427) 3070 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:50:31.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:31 gibba013 bash[30381]: cephadm 2021-03-10T14:50:29.639369+0000 mgr.gibba020.yqfnwy (mgr.34427) 3071 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:50:31.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:31 gibba013 bash[30381]: cephadm 2021-03-10T14:50:29.639472+0000 mgr.gibba020.yqfnwy (mgr.34427) 3072 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:50:31.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:31 gibba013 bash[30381]: cluster 2021-03-10T14:50:30.827584+0000 mgr.gibba020.yqfnwy (mgr.34427) 3073 : cluster [DBG] pgmap v1736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:34.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:33 gibba020 bash[25448]: cluster 2021-03-10T14:50:32.829021+0000 mgr.gibba020.yqfnwy (mgr.34427) 3074 : cluster [DBG] pgmap v1737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:34.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:33 gibba013 bash[29418]: cluster 2021-03-10T14:50:32.829021+0000 mgr.gibba020.yqfnwy (mgr.34427) 3074 : cluster [DBG] pgmap v1737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:34.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:33 gibba013 bash[30381]: cluster 2021-03-10T14:50:32.829021+0000 mgr.gibba020.yqfnwy (mgr.34427) 3074 : cluster [DBG] pgmap v1737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:36.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:35 gibba020 bash[25448]: cluster 2021-03-10T14:50:34.830754+0000 mgr.gibba020.yqfnwy (mgr.34427) 3075 : cluster [DBG] pgmap v1738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:36.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:35 gibba013 bash[29418]: cluster 2021-03-10T14:50:34.830754+0000 mgr.gibba020.yqfnwy (mgr.34427) 3075 : cluster [DBG] pgmap v1738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:36.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:35 gibba013 bash[30381]: cluster 2021-03-10T14:50:34.830754+0000 mgr.gibba020.yqfnwy (mgr.34427) 3075 : cluster [DBG] pgmap v1738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:38.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:38 gibba020 bash[25448]: cluster 2021-03-10T14:50:36.832273+0000 mgr.gibba020.yqfnwy (mgr.34427) 3076 : cluster [DBG] pgmap v1739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:38.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:38 gibba013 bash[29418]: cluster 2021-03-10T14:50:36.832273+0000 mgr.gibba020.yqfnwy (mgr.34427) 3076 : cluster [DBG] pgmap v1739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:38.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:38 gibba013 bash[30381]: cluster 2021-03-10T14:50:36.832273+0000 mgr.gibba020.yqfnwy (mgr.34427) 3076 : cluster [DBG] pgmap v1739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:40.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:40 gibba020 bash[25448]: cluster 2021-03-10T14:50:38.833900+0000 mgr.gibba020.yqfnwy (mgr.34427) 3077 : cluster [DBG] pgmap v1740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:40.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:40 gibba013 bash[29418]: cluster 2021-03-10T14:50:38.833900+0000 mgr.gibba020.yqfnwy (mgr.34427) 3077 : cluster [DBG] pgmap v1740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:40.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:40 gibba013 bash[30381]: cluster 2021-03-10T14:50:38.833900+0000 mgr.gibba020.yqfnwy (mgr.34427) 3077 : cluster [DBG] pgmap v1740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:42.514 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:50:42.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:42 gibba020 bash[25448]: cluster 2021-03-10T14:50:40.835337+0000 mgr.gibba020.yqfnwy (mgr.34427) 3078 : cluster [DBG] pgmap v1741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:42.743 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:50:42.744 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (57m) 2m ago 62m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:50:42.744 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (62m) 78s ago 62m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:50:42.744 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (57m) 78s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:50:42.745 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (57m) 78s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:50:42.745 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (56m) 2m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:50:42.745 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (56m) 2m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:50:42.745 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (56m) 78s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:50:42.745 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (56m) 2m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:50:42.746 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (62m) 2m ago 62m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:50:42.746 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (62m) 78s ago 62m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:50:42.746 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (55m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:50:42.746 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (55m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:50:42.747 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (54m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:50:42.747 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (54m) 2m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:50:42.747 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (53m) 78s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:50:42.747 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (53m) 78s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:50:42.748 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (52m) 78s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:50:42.748 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (52m) 78s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:50:42.748 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (62m) 78s ago 62m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:50:42.748 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 78s ago 60m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:50:42.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:42 gibba013 bash[29418]: cluster 2021-03-10T14:50:40.835337+0000 mgr.gibba020.yqfnwy (mgr.34427) 3078 : cluster [DBG] pgmap v1741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:42.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:42 gibba013 bash[30381]: cluster 2021-03-10T14:50:40.835337+0000 mgr.gibba020.yqfnwy (mgr.34427) 3078 : cluster [DBG] pgmap v1741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:42.994 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:50:42.994 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:50:42.994 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:50:42.995 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:50:42.995 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:50:42.995 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:50:42.995 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:50:42.996 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:50:42.996 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:50:42.996 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:50:42.996 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:50:42.997 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:50:42.997 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:50:42.997 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:50:42.997 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:50:43.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:43 gibba020 bash[25448]: audit 2021-03-10T14:50:42.991718+0000 mon.a (mon.0) 1485 : audit [DBG] from='client.? 172.21.2.113:0/914195138' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:43.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:43 gibba013 bash[29418]: audit 2021-03-10T14:50:42.991718+0000 mon.a (mon.0) 1485 : audit [DBG] from='client.? 172.21.2.113:0/914195138' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:43.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:43 gibba013 bash[30381]: audit 2021-03-10T14:50:42.991718+0000 mon.a (mon.0) 1485 : audit [DBG] from='client.? 172.21.2.113:0/914195138' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:50:44.659 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:44 gibba020 bash[25448]: audit 2021-03-10T14:50:42.501825+0000 mgr.gibba020.yqfnwy (mgr.34427) 3079 : audit [DBG] from='client.46122 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:50:44.660 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:44 gibba020 bash[25448]: audit 2021-03-10T14:50:42.727483+0000 mgr.gibba020.yqfnwy (mgr.34427) 3080 : audit [DBG] from='client.46128 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:50:44.660 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:44 gibba020 bash[25448]: cluster 2021-03-10T14:50:42.836813+0000 mgr.gibba020.yqfnwy (mgr.34427) 3081 : cluster [DBG] pgmap v1742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:44.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:44 gibba013 bash[29418]: audit 2021-03-10T14:50:42.501825+0000 mgr.gibba020.yqfnwy (mgr.34427) 3079 : audit [DBG] from='client.46122 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:50:44.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:44 gibba013 bash[29418]: audit 2021-03-10T14:50:42.727483+0000 mgr.gibba020.yqfnwy (mgr.34427) 3080 : audit [DBG] from='client.46128 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:50:44.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:44 gibba013 bash[29418]: cluster 2021-03-10T14:50:42.836813+0000 mgr.gibba020.yqfnwy (mgr.34427) 3081 : cluster [DBG] pgmap v1742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:44.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:44 gibba013 bash[30381]: audit 2021-03-10T14:50:42.501825+0000 mgr.gibba020.yqfnwy (mgr.34427) 3079 : audit [DBG] from='client.46122 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:50:44.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:44 gibba013 bash[30381]: audit 2021-03-10T14:50:42.727483+0000 mgr.gibba020.yqfnwy (mgr.34427) 3080 : audit [DBG] from='client.46128 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:50:44.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:44 gibba013 bash[30381]: cluster 2021-03-10T14:50:42.836813+0000 mgr.gibba020.yqfnwy (mgr.34427) 3081 : cluster [DBG] pgmap v1742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:45.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:45 gibba020 bash[25448]: cephadm 2021-03-10T14:50:44.655494+0000 mgr.gibba020.yqfnwy (mgr.34427) 3082 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:50:45.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:45 gibba020 bash[25448]: cluster 2021-03-10T14:50:44.837712+0000 mgr.gibba020.yqfnwy (mgr.34427) 3083 : cluster [DBG] pgmap v1743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:45.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:45 gibba013 bash[29418]: cephadm 2021-03-10T14:50:44.655494+0000 mgr.gibba020.yqfnwy (mgr.34427) 3082 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:50:45.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:45 gibba013 bash[29418]: cluster 2021-03-10T14:50:44.837712+0000 mgr.gibba020.yqfnwy (mgr.34427) 3083 : cluster [DBG] pgmap v1743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:45.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:45 gibba013 bash[30381]: cephadm 2021-03-10T14:50:44.655494+0000 mgr.gibba020.yqfnwy (mgr.34427) 3082 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:50:45.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:45 gibba013 bash[30381]: cluster 2021-03-10T14:50:44.837712+0000 mgr.gibba020.yqfnwy (mgr.34427) 3083 : cluster [DBG] pgmap v1743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:48.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:48 gibba020 bash[25448]: cluster 2021-03-10T14:50:46.839192+0000 mgr.gibba020.yqfnwy (mgr.34427) 3084 : cluster [DBG] pgmap v1744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:48.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:48 gibba013 bash[29418]: cluster 2021-03-10T14:50:46.839192+0000 mgr.gibba020.yqfnwy (mgr.34427) 3084 : cluster [DBG] pgmap v1744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:48.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:48 gibba013 bash[30381]: cluster 2021-03-10T14:50:46.839192+0000 mgr.gibba020.yqfnwy (mgr.34427) 3084 : cluster [DBG] pgmap v1744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:49.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:49 gibba013 bash[29418]: cluster 2021-03-10T14:50:48.840847+0000 mgr.gibba020.yqfnwy (mgr.34427) 3085 : cluster [DBG] pgmap v1745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:49.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:49 gibba013 bash[30381]: cluster 2021-03-10T14:50:48.840847+0000 mgr.gibba020.yqfnwy (mgr.34427) 3085 : cluster [DBG] pgmap v1745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:49.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:49 gibba020 bash[25448]: cluster 2021-03-10T14:50:48.840847+0000 mgr.gibba020.yqfnwy (mgr.34427) 3085 : cluster [DBG] pgmap v1745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:52.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:52 gibba020 bash[25448]: cluster 2021-03-10T14:50:50.842420+0000 mgr.gibba020.yqfnwy (mgr.34427) 3086 : cluster [DBG] pgmap v1746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:52.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:52 gibba013 bash[29418]: cluster 2021-03-10T14:50:50.842420+0000 mgr.gibba020.yqfnwy (mgr.34427) 3086 : cluster [DBG] pgmap v1746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:52.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:52 gibba013 bash[30381]: cluster 2021-03-10T14:50:50.842420+0000 mgr.gibba020.yqfnwy (mgr.34427) 3086 : cluster [DBG] pgmap v1746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:54.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:54 gibba020 bash[25448]: cluster 2021-03-10T14:50:52.843400+0000 mgr.gibba020.yqfnwy (mgr.34427) 3087 : cluster [DBG] pgmap v1747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:54.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:54 gibba013 bash[29418]: cluster 2021-03-10T14:50:52.843400+0000 mgr.gibba020.yqfnwy (mgr.34427) 3087 : cluster [DBG] pgmap v1747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:54.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:54 gibba013 bash[30381]: cluster 2021-03-10T14:50:52.843400+0000 mgr.gibba020.yqfnwy (mgr.34427) 3087 : cluster [DBG] pgmap v1747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:55.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:55 gibba020 bash[25448]: cluster 2021-03-10T14:50:54.845099+0000 mgr.gibba020.yqfnwy (mgr.34427) 3088 : cluster [DBG] pgmap v1748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:55.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:55 gibba013 bash[29418]: cluster 2021-03-10T14:50:54.845099+0000 mgr.gibba020.yqfnwy (mgr.34427) 3088 : cluster [DBG] pgmap v1748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:55.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:55 gibba013 bash[30381]: cluster 2021-03-10T14:50:54.845099+0000 mgr.gibba020.yqfnwy (mgr.34427) 3088 : cluster [DBG] pgmap v1748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:58.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:58 gibba020 bash[25448]: cluster 2021-03-10T14:50:56.846661+0000 mgr.gibba020.yqfnwy (mgr.34427) 3089 : cluster [DBG] pgmap v1749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:58.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:58 gibba013 bash[29418]: cluster 2021-03-10T14:50:56.846661+0000 mgr.gibba020.yqfnwy (mgr.34427) 3089 : cluster [DBG] pgmap v1749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:58.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:58 gibba013 bash[30381]: cluster 2021-03-10T14:50:56.846661+0000 mgr.gibba020.yqfnwy (mgr.34427) 3089 : cluster [DBG] pgmap v1749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:59.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:50:59 gibba013 bash[29418]: cluster 2021-03-10T14:50:58.848116+0000 mgr.gibba020.yqfnwy (mgr.34427) 3090 : cluster [DBG] pgmap v1750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:59.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:50:59 gibba013 bash[30381]: cluster 2021-03-10T14:50:58.848116+0000 mgr.gibba020.yqfnwy (mgr.34427) 3090 : cluster [DBG] pgmap v1750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:50:59.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:50:59 gibba020 bash[25448]: cluster 2021-03-10T14:50:58.848116+0000 mgr.gibba020.yqfnwy (mgr.34427) 3090 : cluster [DBG] pgmap v1750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:00.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:00 gibba013 bash[29418]: cephadm 2021-03-10T14:50:59.671508+0000 mgr.gibba020.yqfnwy (mgr.34427) 3091 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:51:00.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:00 gibba013 bash[30381]: cephadm 2021-03-10T14:50:59.671508+0000 mgr.gibba020.yqfnwy (mgr.34427) 3091 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:51:00.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:00 gibba020 bash[25448]: cephadm 2021-03-10T14:50:59.671508+0000 mgr.gibba020.yqfnwy (mgr.34427) 3091 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:51:02.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:02 gibba020 bash[25448]: cluster 2021-03-10T14:51:00.848838+0000 mgr.gibba020.yqfnwy (mgr.34427) 3092 : cluster [DBG] pgmap v1751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:02.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:02 gibba013 bash[29418]: cluster 2021-03-10T14:51:00.848838+0000 mgr.gibba020.yqfnwy (mgr.34427) 3092 : cluster [DBG] pgmap v1751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:02.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:02 gibba013 bash[30381]: cluster 2021-03-10T14:51:00.848838+0000 mgr.gibba020.yqfnwy (mgr.34427) 3092 : cluster [DBG] pgmap v1751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:04.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:04 gibba020 bash[25448]: cluster 2021-03-10T14:51:02.850266+0000 mgr.gibba020.yqfnwy (mgr.34427) 3093 : cluster [DBG] pgmap v1752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:04.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:04 gibba013 bash[29418]: cluster 2021-03-10T14:51:02.850266+0000 mgr.gibba020.yqfnwy (mgr.34427) 3093 : cluster [DBG] pgmap v1752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:04.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:04 gibba013 bash[30381]: cluster 2021-03-10T14:51:02.850266+0000 mgr.gibba020.yqfnwy (mgr.34427) 3093 : cluster [DBG] pgmap v1752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:05.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:05 gibba020 bash[25448]: cluster 2021-03-10T14:51:04.852014+0000 mgr.gibba020.yqfnwy (mgr.34427) 3094 : cluster [DBG] pgmap v1753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:05.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:05 gibba013 bash[29418]: cluster 2021-03-10T14:51:04.852014+0000 mgr.gibba020.yqfnwy (mgr.34427) 3094 : cluster [DBG] pgmap v1753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:05.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:05 gibba013 bash[30381]: cluster 2021-03-10T14:51:04.852014+0000 mgr.gibba020.yqfnwy (mgr.34427) 3094 : cluster [DBG] pgmap v1753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:06 gibba020 bash[25448]: audit 2021-03-10T14:51:06.271013+0000 mon.a (mon.0) 1486 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:51:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:06 gibba020 bash[25448]: audit 2021-03-10T14:51:06.278992+0000 mon.a (mon.0) 1487 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:51:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:06 gibba020 bash[25448]: audit 2021-03-10T14:51:06.284872+0000 mon.a (mon.0) 1488 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:51:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:06 gibba020 bash[25448]: audit 2021-03-10T14:51:06.285217+0000 mon.a (mon.0) 1489 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T14:51:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:06 gibba020 bash[25448]: audit 2021-03-10T14:51:06.285511+0000 mon.a (mon.0) 1490 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:51:06.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:06 gibba020 bash[25448]: audit 2021-03-10T14:51:06.285813+0000 mon.a (mon.0) 1491 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:51:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:06 gibba013 bash[29418]: audit 2021-03-10T14:51:06.271013+0000 mon.a (mon.0) 1486 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:51:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:06 gibba013 bash[29418]: audit 2021-03-10T14:51:06.278992+0000 mon.a (mon.0) 1487 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:51:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:06 gibba013 bash[29418]: audit 2021-03-10T14:51:06.284872+0000 mon.a (mon.0) 1488 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:51:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:06 gibba013 bash[29418]: audit 2021-03-10T14:51:06.285217+0000 mon.a (mon.0) 1489 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T14:51:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:06 gibba013 bash[29418]: audit 2021-03-10T14:51:06.285511+0000 mon.a (mon.0) 1490 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:51:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:06 gibba013 bash[29418]: audit 2021-03-10T14:51:06.285813+0000 mon.a (mon.0) 1491 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:51:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:06 gibba013 bash[30381]: audit 2021-03-10T14:51:06.271013+0000 mon.a (mon.0) 1486 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:51:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:06 gibba013 bash[30381]: audit 2021-03-10T14:51:06.278992+0000 mon.a (mon.0) 1487 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:51:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:06 gibba013 bash[30381]: audit 2021-03-10T14:51:06.284872+0000 mon.a (mon.0) 1488 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:51:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:06 gibba013 bash[30381]: audit 2021-03-10T14:51:06.285217+0000 mon.a (mon.0) 1489 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T14:51:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:06 gibba013 bash[30381]: audit 2021-03-10T14:51:06.285511+0000 mon.a (mon.0) 1490 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T14:51:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:06 gibba013 bash[30381]: audit 2021-03-10T14:51:06.285813+0000 mon.a (mon.0) 1491 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T14:51:07.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:07 gibba020 bash[25448]: cluster 2021-03-10T14:51:06.853771+0000 mgr.gibba020.yqfnwy (mgr.34427) 3095 : cluster [DBG] pgmap v1754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:07.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:07 gibba013 bash[29418]: cluster 2021-03-10T14:51:06.853771+0000 mgr.gibba020.yqfnwy (mgr.34427) 3095 : cluster [DBG] pgmap v1754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:07.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:07 gibba013 bash[30381]: cluster 2021-03-10T14:51:06.853771+0000 mgr.gibba020.yqfnwy (mgr.34427) 3095 : cluster [DBG] pgmap v1754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:10.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:09 gibba020 bash[25448]: cluster 2021-03-10T14:51:08.854710+0000 mgr.gibba020.yqfnwy (mgr.34427) 3096 : cluster [DBG] pgmap v1755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:10.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:09 gibba013 bash[29418]: cluster 2021-03-10T14:51:08.854710+0000 mgr.gibba020.yqfnwy (mgr.34427) 3096 : cluster [DBG] pgmap v1755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:10.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:09 gibba013 bash[30381]: cluster 2021-03-10T14:51:08.854710+0000 mgr.gibba020.yqfnwy (mgr.34427) 3096 : cluster [DBG] pgmap v1755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:12.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:12 gibba020 bash[25448]: cluster 2021-03-10T14:51:10.856070+0000 mgr.gibba020.yqfnwy (mgr.34427) 3097 : cluster [DBG] pgmap v1756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:12.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:12 gibba013 bash[29418]: cluster 2021-03-10T14:51:10.856070+0000 mgr.gibba020.yqfnwy (mgr.34427) 3097 : cluster [DBG] pgmap v1756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:12.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:12 gibba013 bash[30381]: cluster 2021-03-10T14:51:10.856070+0000 mgr.gibba020.yqfnwy (mgr.34427) 3097 : cluster [DBG] pgmap v1756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:13.238 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:51:13.464 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:51:13.464 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (57m) 2m ago 63m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:51:13.465 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (62m) 109s ago 62m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:51:13.465 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (58m) 109s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:51:13.465 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (58m) 109s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:51:13.465 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (57m) 2m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:51:13.466 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (57m) 2m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:51:13.466 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (56m) 109s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:51:13.466 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (56m) 2m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:51:13.466 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (63m) 2m ago 63m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:51:13.467 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (63m) 109s ago 63m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:51:13.467 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (56m) 2m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:51:13.467 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (55m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:51:13.468 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (55m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:51:13.468 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (54m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:51:13.469 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (54m) 109s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:51:13.469 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (53m) 109s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:51:13.469 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (53m) 109s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:51:13.469 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (52m) 109s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:51:13.469 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (62m) 109s ago 63m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:51:13.470 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 109s ago 61m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:51:13.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:13 gibba020 bash[25448]: cluster 2021-03-10T14:51:12.857351+0000 mgr.gibba020.yqfnwy (mgr.34427) 3098 : cluster [DBG] pgmap v1757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:13.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:13 gibba020 bash[25448]: audit 2021-03-10T14:51:13.225217+0000 mgr.gibba020.yqfnwy (mgr.34427) 3099 : audit [DBG] from='client.56125 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:51:13.715 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:51:13.715 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:51:13.715 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:51:13.715 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:51:13.716 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:51:13.716 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:51:13.716 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:51:13.716 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:51:13.717 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:51:13.717 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:51:13.717 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:51:13.717 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:51:13.717 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:51:13.718 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:51:13.718 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:51:13.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:13 gibba013 bash[29418]: cluster 2021-03-10T14:51:12.857351+0000 mgr.gibba020.yqfnwy (mgr.34427) 3098 : cluster [DBG] pgmap v1757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:13.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:13 gibba013 bash[29418]: audit 2021-03-10T14:51:13.225217+0000 mgr.gibba020.yqfnwy (mgr.34427) 3099 : audit [DBG] from='client.56125 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:51:13.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:13 gibba013 bash[30381]: cluster 2021-03-10T14:51:12.857351+0000 mgr.gibba020.yqfnwy (mgr.34427) 3098 : cluster [DBG] pgmap v1757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:13.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:13 gibba013 bash[30381]: audit 2021-03-10T14:51:13.225217+0000 mgr.gibba020.yqfnwy (mgr.34427) 3099 : audit [DBG] from='client.56125 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:51:14.691 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:14 gibba020 bash[25448]: audit 2021-03-10T14:51:13.450132+0000 mgr.gibba020.yqfnwy (mgr.34427) 3100 : audit [DBG] from='client.46146 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:51:14.692 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:14 gibba020 bash[25448]: audit 2021-03-10T14:51:13.712685+0000 mon.c (mon.1) 56 : audit [DBG] from='client.? 172.21.2.113:0/127737776' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:14.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:14 gibba013 bash[29418]: audit 2021-03-10T14:51:13.450132+0000 mgr.gibba020.yqfnwy (mgr.34427) 3100 : audit [DBG] from='client.46146 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:51:14.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:14 gibba013 bash[29418]: audit 2021-03-10T14:51:13.712685+0000 mon.c (mon.1) 56 : audit [DBG] from='client.? 172.21.2.113:0/127737776' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:14.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:14 gibba013 bash[30381]: audit 2021-03-10T14:51:13.450132+0000 mgr.gibba020.yqfnwy (mgr.34427) 3100 : audit [DBG] from='client.46146 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:51:14.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:14 gibba013 bash[30381]: audit 2021-03-10T14:51:13.712685+0000 mon.c (mon.1) 56 : audit [DBG] from='client.? 172.21.2.113:0/127737776' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:15.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:15 gibba020 bash[25448]: cephadm 2021-03-10T14:51:14.687395+0000 mgr.gibba020.yqfnwy (mgr.34427) 3101 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:51:15.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:15 gibba020 bash[25448]: cluster 2021-03-10T14:51:14.859042+0000 mgr.gibba020.yqfnwy (mgr.34427) 3102 : cluster [DBG] pgmap v1758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:15.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:15 gibba013 bash[29418]: cephadm 2021-03-10T14:51:14.687395+0000 mgr.gibba020.yqfnwy (mgr.34427) 3101 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:51:15.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:15 gibba013 bash[29418]: cluster 2021-03-10T14:51:14.859042+0000 mgr.gibba020.yqfnwy (mgr.34427) 3102 : cluster [DBG] pgmap v1758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:15.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:15 gibba013 bash[30381]: cephadm 2021-03-10T14:51:14.687395+0000 mgr.gibba020.yqfnwy (mgr.34427) 3101 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:51:15.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:15 gibba013 bash[30381]: cluster 2021-03-10T14:51:14.859042+0000 mgr.gibba020.yqfnwy (mgr.34427) 3102 : cluster [DBG] pgmap v1758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:17.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:17 gibba013 bash[29418]: cluster 2021-03-10T14:51:16.859840+0000 mgr.gibba020.yqfnwy (mgr.34427) 3103 : cluster [DBG] pgmap v1759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:17.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:17 gibba013 bash[30381]: cluster 2021-03-10T14:51:16.859840+0000 mgr.gibba020.yqfnwy (mgr.34427) 3103 : cluster [DBG] pgmap v1759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:17.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:17 gibba020 bash[25448]: cluster 2021-03-10T14:51:16.859840+0000 mgr.gibba020.yqfnwy (mgr.34427) 3103 : cluster [DBG] pgmap v1759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:20.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:19 gibba020 bash[25448]: cluster 2021-03-10T14:51:18.861263+0000 mgr.gibba020.yqfnwy (mgr.34427) 3104 : cluster [DBG] pgmap v1760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:20.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:19 gibba013 bash[29418]: cluster 2021-03-10T14:51:18.861263+0000 mgr.gibba020.yqfnwy (mgr.34427) 3104 : cluster [DBG] pgmap v1760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:20.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:19 gibba013 bash[30381]: cluster 2021-03-10T14:51:18.861263+0000 mgr.gibba020.yqfnwy (mgr.34427) 3104 : cluster [DBG] pgmap v1760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:22.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:22 gibba020 bash[25448]: cluster 2021-03-10T14:51:20.862937+0000 mgr.gibba020.yqfnwy (mgr.34427) 3105 : cluster [DBG] pgmap v1761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:22.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:22 gibba013 bash[29418]: cluster 2021-03-10T14:51:20.862937+0000 mgr.gibba020.yqfnwy (mgr.34427) 3105 : cluster [DBG] pgmap v1761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:22.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:22 gibba013 bash[30381]: cluster 2021-03-10T14:51:20.862937+0000 mgr.gibba020.yqfnwy (mgr.34427) 3105 : cluster [DBG] pgmap v1761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:23.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:23 gibba020 bash[25448]: cluster 2021-03-10T14:51:22.864506+0000 mgr.gibba020.yqfnwy (mgr.34427) 3106 : cluster [DBG] pgmap v1762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:23.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:23 gibba013 bash[29418]: cluster 2021-03-10T14:51:22.864506+0000 mgr.gibba020.yqfnwy (mgr.34427) 3106 : cluster [DBG] pgmap v1762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:23.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:23 gibba013 bash[30381]: cluster 2021-03-10T14:51:22.864506+0000 mgr.gibba020.yqfnwy (mgr.34427) 3106 : cluster [DBG] pgmap v1762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:26.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:25 gibba020 bash[25448]: cluster 2021-03-10T14:51:24.865443+0000 mgr.gibba020.yqfnwy (mgr.34427) 3107 : cluster [DBG] pgmap v1763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:26.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:25 gibba013 bash[29418]: cluster 2021-03-10T14:51:24.865443+0000 mgr.gibba020.yqfnwy (mgr.34427) 3107 : cluster [DBG] pgmap v1763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:26.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:25 gibba013 bash[30381]: cluster 2021-03-10T14:51:24.865443+0000 mgr.gibba020.yqfnwy (mgr.34427) 3107 : cluster [DBG] pgmap v1763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:27.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:27 gibba013 bash[29418]: cluster 2021-03-10T14:51:26.866957+0000 mgr.gibba020.yqfnwy (mgr.34427) 3108 : cluster [DBG] pgmap v1764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:27.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:27 gibba013 bash[30381]: cluster 2021-03-10T14:51:26.866957+0000 mgr.gibba020.yqfnwy (mgr.34427) 3108 : cluster [DBG] pgmap v1764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:27.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:27 gibba020 bash[25448]: cluster 2021-03-10T14:51:26.866957+0000 mgr.gibba020.yqfnwy (mgr.34427) 3108 : cluster [DBG] pgmap v1764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:30.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:29 gibba020 bash[25448]: cluster 2021-03-10T14:51:28.868363+0000 mgr.gibba020.yqfnwy (mgr.34427) 3109 : cluster [DBG] pgmap v1765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:30.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:29 gibba020 bash[25448]: audit 2021-03-10T14:51:29.705605+0000 mon.a (mon.0) 1492 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:51:30.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:29 gibba020 bash[25448]: audit 2021-03-10T14:51:29.916883+0000 mon.a (mon.0) 1493 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:51:30.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:29 gibba020 bash[25448]: audit 2021-03-10T14:51:29.920421+0000 mon.a (mon.0) 1494 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:51:30.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:29 gibba020 bash[25448]: audit 2021-03-10T14:51:29.921654+0000 mon.a (mon.0) 1495 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:30.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:29 gibba020 bash[25448]: audit 2021-03-10T14:51:29.923386+0000 mon.a (mon.0) 1496 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:30.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:29 gibba020 bash[25448]: audit 2021-03-10T14:51:29.924674+0000 mon.a (mon.0) 1497 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:30.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:29 gibba013 bash[29418]: cluster 2021-03-10T14:51:28.868363+0000 mgr.gibba020.yqfnwy (mgr.34427) 3109 : cluster [DBG] pgmap v1765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:30.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:29 gibba013 bash[29418]: audit 2021-03-10T14:51:29.705605+0000 mon.a (mon.0) 1492 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:51:30.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:29 gibba013 bash[29418]: audit 2021-03-10T14:51:29.916883+0000 mon.a (mon.0) 1493 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:51:30.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:29 gibba013 bash[29418]: audit 2021-03-10T14:51:29.920421+0000 mon.a (mon.0) 1494 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:51:30.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:29 gibba013 bash[29418]: audit 2021-03-10T14:51:29.921654+0000 mon.a (mon.0) 1495 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:30.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:29 gibba013 bash[29418]: audit 2021-03-10T14:51:29.923386+0000 mon.a (mon.0) 1496 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:30.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:29 gibba013 bash[29418]: audit 2021-03-10T14:51:29.924674+0000 mon.a (mon.0) 1497 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:30.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:29 gibba013 bash[30381]: cluster 2021-03-10T14:51:28.868363+0000 mgr.gibba020.yqfnwy (mgr.34427) 3109 : cluster [DBG] pgmap v1765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:30.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:29 gibba013 bash[30381]: audit 2021-03-10T14:51:29.705605+0000 mon.a (mon.0) 1492 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:51:30.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:29 gibba013 bash[30381]: audit 2021-03-10T14:51:29.916883+0000 mon.a (mon.0) 1493 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:51:30.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:29 gibba013 bash[30381]: audit 2021-03-10T14:51:29.920421+0000 mon.a (mon.0) 1494 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:51:30.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:29 gibba013 bash[30381]: audit 2021-03-10T14:51:29.921654+0000 mon.a (mon.0) 1495 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:30.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:29 gibba013 bash[30381]: audit 2021-03-10T14:51:29.923386+0000 mon.a (mon.0) 1496 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:30.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:29 gibba013 bash[30381]: audit 2021-03-10T14:51:29.924674+0000 mon.a (mon.0) 1497 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:31.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:30 gibba020 bash[25448]: cephadm 2021-03-10T14:51:29.709861+0000 mgr.gibba020.yqfnwy (mgr.34427) 3110 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:51:31.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:30 gibba020 bash[25448]: cephadm 2021-03-10T14:51:29.711648+0000 mgr.gibba020.yqfnwy (mgr.34427) 3111 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:51:31.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:30 gibba020 bash[25448]: cephadm 2021-03-10T14:51:29.918313+0000 mgr.gibba020.yqfnwy (mgr.34427) 3112 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:51:31.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:30 gibba020 bash[25448]: cephadm 2021-03-10T14:51:29.920133+0000 mgr.gibba020.yqfnwy (mgr.34427) 3113 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:51:31.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:30 gibba020 bash[25448]: cephadm 2021-03-10T14:51:29.921547+0000 mgr.gibba020.yqfnwy (mgr.34427) 3114 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:51:31.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:30 gibba020 bash[25448]: cephadm 2021-03-10T14:51:29.921587+0000 mgr.gibba020.yqfnwy (mgr.34427) 3115 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:51:31.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:30 gibba020 bash[25448]: cephadm 2021-03-10T14:51:29.923007+0000 mgr.gibba020.yqfnwy (mgr.34427) 3116 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:51:31.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:30 gibba020 bash[25448]: cephadm 2021-03-10T14:51:29.923047+0000 mgr.gibba020.yqfnwy (mgr.34427) 3117 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:51:31.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:30 gibba020 bash[25448]: cephadm 2021-03-10T14:51:29.924544+0000 mgr.gibba020.yqfnwy (mgr.34427) 3118 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:51:31.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:30 gibba020 bash[25448]: cephadm 2021-03-10T14:51:29.926043+0000 mgr.gibba020.yqfnwy (mgr.34427) 3119 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:51:31.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:30 gibba020 bash[25448]: cephadm 2021-03-10T14:51:29.926083+0000 mgr.gibba020.yqfnwy (mgr.34427) 3120 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:51:31.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:30 gibba020 bash[25448]: audit 2021-03-10T14:51:29.927801+0000 mon.a (mon.0) 1498 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:31.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:30 gibba020 bash[25448]: cephadm 2021-03-10T14:51:29.928846+0000 mgr.gibba020.yqfnwy (mgr.34427) 3121 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:51:31.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:30 gibba020 bash[25448]: cephadm 2021-03-10T14:51:29.929246+0000 mgr.gibba020.yqfnwy (mgr.34427) 3122 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:51:31.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:30 gibba020 bash[25448]: cephadm 2021-03-10T14:51:29.930068+0000 mgr.gibba020.yqfnwy (mgr.34427) 3123 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:51:31.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:30 gibba020 bash[25448]: cephadm 2021-03-10T14:51:29.930106+0000 mgr.gibba020.yqfnwy (mgr.34427) 3124 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:51:31.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:30 gibba020 bash[25448]: cephadm 2021-03-10T14:51:29.930218+0000 mgr.gibba020.yqfnwy (mgr.34427) 3125 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:51:31.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:30 gibba020 bash[25448]: audit 2021-03-10T14:51:29.930678+0000 mon.a (mon.0) 1499 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:31.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:30 gibba013 bash[29418]: cephadm 2021-03-10T14:51:29.709861+0000 mgr.gibba020.yqfnwy (mgr.34427) 3110 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:51:31.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:30 gibba013 bash[29418]: cephadm 2021-03-10T14:51:29.711648+0000 mgr.gibba020.yqfnwy (mgr.34427) 3111 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:51:31.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:30 gibba013 bash[29418]: cephadm 2021-03-10T14:51:29.918313+0000 mgr.gibba020.yqfnwy (mgr.34427) 3112 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:51:31.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:30 gibba013 bash[29418]: cephadm 2021-03-10T14:51:29.920133+0000 mgr.gibba020.yqfnwy (mgr.34427) 3113 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:51:31.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:30 gibba013 bash[29418]: cephadm 2021-03-10T14:51:29.921547+0000 mgr.gibba020.yqfnwy (mgr.34427) 3114 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:51:31.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:30 gibba013 bash[29418]: cephadm 2021-03-10T14:51:29.921587+0000 mgr.gibba020.yqfnwy (mgr.34427) 3115 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:51:31.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:30 gibba013 bash[29418]: cephadm 2021-03-10T14:51:29.923007+0000 mgr.gibba020.yqfnwy (mgr.34427) 3116 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:51:31.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:30 gibba013 bash[29418]: cephadm 2021-03-10T14:51:29.923047+0000 mgr.gibba020.yqfnwy (mgr.34427) 3117 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:51:31.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:30 gibba013 bash[29418]: cephadm 2021-03-10T14:51:29.924544+0000 mgr.gibba020.yqfnwy (mgr.34427) 3118 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:51:31.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:30 gibba013 bash[29418]: cephadm 2021-03-10T14:51:29.926043+0000 mgr.gibba020.yqfnwy (mgr.34427) 3119 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:51:31.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:30 gibba013 bash[29418]: cephadm 2021-03-10T14:51:29.926083+0000 mgr.gibba020.yqfnwy (mgr.34427) 3120 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:51:31.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:30 gibba013 bash[29418]: audit 2021-03-10T14:51:29.927801+0000 mon.a (mon.0) 1498 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:31.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:30 gibba013 bash[29418]: cephadm 2021-03-10T14:51:29.928846+0000 mgr.gibba020.yqfnwy (mgr.34427) 3121 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:51:31.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:30 gibba013 bash[29418]: cephadm 2021-03-10T14:51:29.929246+0000 mgr.gibba020.yqfnwy (mgr.34427) 3122 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:51:31.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:30 gibba013 bash[29418]: cephadm 2021-03-10T14:51:29.930068+0000 mgr.gibba020.yqfnwy (mgr.34427) 3123 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:51:31.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:30 gibba013 bash[29418]: cephadm 2021-03-10T14:51:29.930106+0000 mgr.gibba020.yqfnwy (mgr.34427) 3124 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:51:31.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:30 gibba013 bash[29418]: cephadm 2021-03-10T14:51:29.930218+0000 mgr.gibba020.yqfnwy (mgr.34427) 3125 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:51:31.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:30 gibba013 bash[29418]: audit 2021-03-10T14:51:29.930678+0000 mon.a (mon.0) 1499 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:31.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:30 gibba013 bash[30381]: cephadm 2021-03-10T14:51:29.709861+0000 mgr.gibba020.yqfnwy (mgr.34427) 3110 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:51:31.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:30 gibba013 bash[30381]: cephadm 2021-03-10T14:51:29.711648+0000 mgr.gibba020.yqfnwy (mgr.34427) 3111 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:51:31.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:30 gibba013 bash[30381]: cephadm 2021-03-10T14:51:29.918313+0000 mgr.gibba020.yqfnwy (mgr.34427) 3112 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:51:31.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:30 gibba013 bash[30381]: cephadm 2021-03-10T14:51:29.920133+0000 mgr.gibba020.yqfnwy (mgr.34427) 3113 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:51:31.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:30 gibba013 bash[30381]: cephadm 2021-03-10T14:51:29.921547+0000 mgr.gibba020.yqfnwy (mgr.34427) 3114 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:51:31.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:30 gibba013 bash[30381]: cephadm 2021-03-10T14:51:29.921587+0000 mgr.gibba020.yqfnwy (mgr.34427) 3115 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:51:31.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:30 gibba013 bash[30381]: cephadm 2021-03-10T14:51:29.923007+0000 mgr.gibba020.yqfnwy (mgr.34427) 3116 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:51:31.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:30 gibba013 bash[30381]: cephadm 2021-03-10T14:51:29.923047+0000 mgr.gibba020.yqfnwy (mgr.34427) 3117 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:51:31.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:30 gibba013 bash[30381]: cephadm 2021-03-10T14:51:29.924544+0000 mgr.gibba020.yqfnwy (mgr.34427) 3118 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:51:31.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:30 gibba013 bash[30381]: cephadm 2021-03-10T14:51:29.926043+0000 mgr.gibba020.yqfnwy (mgr.34427) 3119 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:51:31.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:30 gibba013 bash[30381]: cephadm 2021-03-10T14:51:29.926083+0000 mgr.gibba020.yqfnwy (mgr.34427) 3120 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:51:31.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:30 gibba013 bash[30381]: audit 2021-03-10T14:51:29.927801+0000 mon.a (mon.0) 1498 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:31.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:30 gibba013 bash[30381]: cephadm 2021-03-10T14:51:29.928846+0000 mgr.gibba020.yqfnwy (mgr.34427) 3121 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:51:31.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:30 gibba013 bash[30381]: cephadm 2021-03-10T14:51:29.929246+0000 mgr.gibba020.yqfnwy (mgr.34427) 3122 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:51:31.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:30 gibba013 bash[30381]: cephadm 2021-03-10T14:51:29.930068+0000 mgr.gibba020.yqfnwy (mgr.34427) 3123 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:51:31.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:30 gibba013 bash[30381]: cephadm 2021-03-10T14:51:29.930106+0000 mgr.gibba020.yqfnwy (mgr.34427) 3124 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:51:31.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:30 gibba013 bash[30381]: cephadm 2021-03-10T14:51:29.930218+0000 mgr.gibba020.yqfnwy (mgr.34427) 3125 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:51:31.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:30 gibba013 bash[30381]: audit 2021-03-10T14:51:29.930678+0000 mon.a (mon.0) 1499 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:32.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:32 gibba020 bash[25448]: cluster 2021-03-10T14:51:30.870023+0000 mgr.gibba020.yqfnwy (mgr.34427) 3126 : cluster [DBG] pgmap v1766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:32.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:32 gibba013 bash[29418]: cluster 2021-03-10T14:51:30.870023+0000 mgr.gibba020.yqfnwy (mgr.34427) 3126 : cluster [DBG] pgmap v1766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:32.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:32 gibba013 bash[30381]: cluster 2021-03-10T14:51:30.870023+0000 mgr.gibba020.yqfnwy (mgr.34427) 3126 : cluster [DBG] pgmap v1766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:33.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:33 gibba020 bash[25448]: cluster 2021-03-10T14:51:32.870876+0000 mgr.gibba020.yqfnwy (mgr.34427) 3127 : cluster [DBG] pgmap v1767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:33.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:33 gibba013 bash[29418]: cluster 2021-03-10T14:51:32.870876+0000 mgr.gibba020.yqfnwy (mgr.34427) 3127 : cluster [DBG] pgmap v1767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:33.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:33 gibba013 bash[30381]: cluster 2021-03-10T14:51:32.870876+0000 mgr.gibba020.yqfnwy (mgr.34427) 3127 : cluster [DBG] pgmap v1767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:36.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:35 gibba020 bash[25448]: cluster 2021-03-10T14:51:34.872543+0000 mgr.gibba020.yqfnwy (mgr.34427) 3128 : cluster [DBG] pgmap v1768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:36.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:35 gibba013 bash[29418]: cluster 2021-03-10T14:51:34.872543+0000 mgr.gibba020.yqfnwy (mgr.34427) 3128 : cluster [DBG] pgmap v1768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:36.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:35 gibba013 bash[30381]: cluster 2021-03-10T14:51:34.872543+0000 mgr.gibba020.yqfnwy (mgr.34427) 3128 : cluster [DBG] pgmap v1768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:37.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:37 gibba013 bash[29418]: cluster 2021-03-10T14:51:36.873900+0000 mgr.gibba020.yqfnwy (mgr.34427) 3129 : cluster [DBG] pgmap v1769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:37.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:37 gibba013 bash[30381]: cluster 2021-03-10T14:51:36.873900+0000 mgr.gibba020.yqfnwy (mgr.34427) 3129 : cluster [DBG] pgmap v1769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:37.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:37 gibba020 bash[25448]: cluster 2021-03-10T14:51:36.873900+0000 mgr.gibba020.yqfnwy (mgr.34427) 3129 : cluster [DBG] pgmap v1769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:40.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:39 gibba020 bash[25448]: cluster 2021-03-10T14:51:38.875505+0000 mgr.gibba020.yqfnwy (mgr.34427) 3130 : cluster [DBG] pgmap v1770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:40.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:39 gibba013 bash[29418]: cluster 2021-03-10T14:51:38.875505+0000 mgr.gibba020.yqfnwy (mgr.34427) 3130 : cluster [DBG] pgmap v1770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:40.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:39 gibba013 bash[30381]: cluster 2021-03-10T14:51:38.875505+0000 mgr.gibba020.yqfnwy (mgr.34427) 3130 : cluster [DBG] pgmap v1770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:42.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:41 gibba020 bash[25448]: cluster 2021-03-10T14:51:40.876425+0000 mgr.gibba020.yqfnwy (mgr.34427) 3131 : cluster [DBG] pgmap v1771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:42.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:41 gibba013 bash[29418]: cluster 2021-03-10T14:51:40.876425+0000 mgr.gibba020.yqfnwy (mgr.34427) 3131 : cluster [DBG] pgmap v1771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:42.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:41 gibba013 bash[30381]: cluster 2021-03-10T14:51:40.876425+0000 mgr.gibba020.yqfnwy (mgr.34427) 3131 : cluster [DBG] pgmap v1771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:43.960 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:51:44.182 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:51:44.182 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (58m) 3m ago 63m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:51:44.182 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (63m) 2m ago 63m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:51:44.183 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (58m) 2m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:51:44.183 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (58m) 2m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:51:44.183 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (57m) 3m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:51:44.183 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (57m) 3m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:51:44.183 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (57m) 2m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:51:44.184 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (57m) 3m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:51:44.184 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (63m) 3m ago 63m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:51:44.184 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (63m) 2m ago 63m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:51:44.184 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (56m) 3m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:51:44.184 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (56m) 3m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:51:44.185 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (55m) 3m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:51:44.185 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (55m) 3m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:51:44.185 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (54m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:51:44.185 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (54m) 2m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:51:44.186 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (53m) 2m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:51:44.186 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (53m) 2m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:51:44.186 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (63m) 2m ago 63m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:51:44.186 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 61m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:51:44.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:43 gibba013 bash[29418]: cluster 2021-03-10T14:51:42.877708+0000 mgr.gibba020.yqfnwy (mgr.34427) 3132 : cluster [DBG] pgmap v1772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:44.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:43 gibba013 bash[30381]: cluster 2021-03-10T14:51:42.877708+0000 mgr.gibba020.yqfnwy (mgr.34427) 3132 : cluster [DBG] pgmap v1772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:44.429 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:51:44.430 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:51:44.430 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:51:44.430 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:51:44.430 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:51:44.431 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:51:44.431 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:51:44.431 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:51:44.431 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:51:44.432 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:51:44.432 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:51:44.432 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:51:44.432 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:51:44.432 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:51:44.433 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:51:44.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:43 gibba020 bash[25448]: cluster 2021-03-10T14:51:42.877708+0000 mgr.gibba020.yqfnwy (mgr.34427) 3132 : cluster [DBG] pgmap v1772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:45.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:44 gibba020 bash[25448]: audit 2021-03-10T14:51:43.945612+0000 mgr.gibba020.yqfnwy (mgr.34427) 3133 : audit [DBG] from='client.46158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:51:45.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:44 gibba020 bash[25448]: audit 2021-03-10T14:51:44.169652+0000 mgr.gibba020.yqfnwy (mgr.34427) 3134 : audit [DBG] from='client.46164 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:51:45.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:44 gibba020 bash[25448]: audit 2021-03-10T14:51:44.427223+0000 mon.c (mon.1) 57 : audit [DBG] from='client.? 172.21.2.113:0/3903022665' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:45.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:44 gibba013 bash[29418]: audit 2021-03-10T14:51:43.945612+0000 mgr.gibba020.yqfnwy (mgr.34427) 3133 : audit [DBG] from='client.46158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:51:45.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:44 gibba013 bash[29418]: audit 2021-03-10T14:51:44.169652+0000 mgr.gibba020.yqfnwy (mgr.34427) 3134 : audit [DBG] from='client.46164 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:51:45.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:44 gibba013 bash[29418]: audit 2021-03-10T14:51:44.427223+0000 mon.c (mon.1) 57 : audit [DBG] from='client.? 172.21.2.113:0/3903022665' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:45.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:44 gibba013 bash[30381]: audit 2021-03-10T14:51:43.945612+0000 mgr.gibba020.yqfnwy (mgr.34427) 3133 : audit [DBG] from='client.46158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:51:45.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:44 gibba013 bash[30381]: audit 2021-03-10T14:51:44.169652+0000 mgr.gibba020.yqfnwy (mgr.34427) 3134 : audit [DBG] from='client.46164 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:51:45.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:44 gibba013 bash[30381]: audit 2021-03-10T14:51:44.427223+0000 mon.c (mon.1) 57 : audit [DBG] from='client.? 172.21.2.113:0/3903022665' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:51:46.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:45 gibba013 bash[29418]: cluster 2021-03-10T14:51:44.879301+0000 mgr.gibba020.yqfnwy (mgr.34427) 3135 : cluster [DBG] pgmap v1773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:46.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:45 gibba013 bash[29418]: cephadm 2021-03-10T14:51:44.938362+0000 mgr.gibba020.yqfnwy (mgr.34427) 3136 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:51:46.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:45 gibba013 bash[30381]: cluster 2021-03-10T14:51:44.879301+0000 mgr.gibba020.yqfnwy (mgr.34427) 3135 : cluster [DBG] pgmap v1773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:46.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:45 gibba013 bash[30381]: cephadm 2021-03-10T14:51:44.938362+0000 mgr.gibba020.yqfnwy (mgr.34427) 3136 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:51:46.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:45 gibba020 bash[25448]: cluster 2021-03-10T14:51:44.879301+0000 mgr.gibba020.yqfnwy (mgr.34427) 3135 : cluster [DBG] pgmap v1773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:46.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:45 gibba020 bash[25448]: cephadm 2021-03-10T14:51:44.938362+0000 mgr.gibba020.yqfnwy (mgr.34427) 3136 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:51:47.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:47 gibba013 bash[29418]: cluster 2021-03-10T14:51:46.880942+0000 mgr.gibba020.yqfnwy (mgr.34427) 3137 : cluster [DBG] pgmap v1774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:47.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:47 gibba013 bash[30381]: cluster 2021-03-10T14:51:46.880942+0000 mgr.gibba020.yqfnwy (mgr.34427) 3137 : cluster [DBG] pgmap v1774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:47.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:47 gibba020 bash[25448]: cluster 2021-03-10T14:51:46.880942+0000 mgr.gibba020.yqfnwy (mgr.34427) 3137 : cluster [DBG] pgmap v1774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:50.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:49 gibba020 bash[25448]: cluster 2021-03-10T14:51:48.882629+0000 mgr.gibba020.yqfnwy (mgr.34427) 3138 : cluster [DBG] pgmap v1775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:50.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:49 gibba013 bash[29418]: cluster 2021-03-10T14:51:48.882629+0000 mgr.gibba020.yqfnwy (mgr.34427) 3138 : cluster [DBG] pgmap v1775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:50.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:49 gibba013 bash[30381]: cluster 2021-03-10T14:51:48.882629+0000 mgr.gibba020.yqfnwy (mgr.34427) 3138 : cluster [DBG] pgmap v1775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:52.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:51 gibba013 bash[30381]: cluster 2021-03-10T14:51:50.884349+0000 mgr.gibba020.yqfnwy (mgr.34427) 3139 : cluster [DBG] pgmap v1776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:52.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:51 gibba013 bash[29418]: cluster 2021-03-10T14:51:50.884349+0000 mgr.gibba020.yqfnwy (mgr.34427) 3139 : cluster [DBG] pgmap v1776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:52.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:51 gibba020 bash[25448]: cluster 2021-03-10T14:51:50.884349+0000 mgr.gibba020.yqfnwy (mgr.34427) 3139 : cluster [DBG] pgmap v1776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:54.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:53 gibba013 bash[29418]: cluster 2021-03-10T14:51:52.885875+0000 mgr.gibba020.yqfnwy (mgr.34427) 3140 : cluster [DBG] pgmap v1777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:54.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:53 gibba013 bash[30381]: cluster 2021-03-10T14:51:52.885875+0000 mgr.gibba020.yqfnwy (mgr.34427) 3140 : cluster [DBG] pgmap v1777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:54.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:53 gibba020 bash[25448]: cluster 2021-03-10T14:51:52.885875+0000 mgr.gibba020.yqfnwy (mgr.34427) 3140 : cluster [DBG] pgmap v1777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:56.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:55 gibba013 bash[29418]: cluster 2021-03-10T14:51:54.887481+0000 mgr.gibba020.yqfnwy (mgr.34427) 3141 : cluster [DBG] pgmap v1778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:56.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:55 gibba013 bash[30381]: cluster 2021-03-10T14:51:54.887481+0000 mgr.gibba020.yqfnwy (mgr.34427) 3141 : cluster [DBG] pgmap v1778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:56.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:55 gibba020 bash[25448]: cluster 2021-03-10T14:51:54.887481+0000 mgr.gibba020.yqfnwy (mgr.34427) 3141 : cluster [DBG] pgmap v1778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:57.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:57 gibba020 bash[25448]: cluster 2021-03-10T14:51:56.888567+0000 mgr.gibba020.yqfnwy (mgr.34427) 3142 : cluster [DBG] pgmap v1779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:57.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:57 gibba013 bash[29418]: cluster 2021-03-10T14:51:56.888567+0000 mgr.gibba020.yqfnwy (mgr.34427) 3142 : cluster [DBG] pgmap v1779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:51:57.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:57 gibba013 bash[30381]: cluster 2021-03-10T14:51:56.888567+0000 mgr.gibba020.yqfnwy (mgr.34427) 3142 : cluster [DBG] pgmap v1779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:00.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:51:59 gibba013 bash[29418]: cluster 2021-03-10T14:51:58.890167+0000 mgr.gibba020.yqfnwy (mgr.34427) 3143 : cluster [DBG] pgmap v1780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:00.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:51:59 gibba013 bash[30381]: cluster 2021-03-10T14:51:58.890167+0000 mgr.gibba020.yqfnwy (mgr.34427) 3143 : cluster [DBG] pgmap v1780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:00.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:51:59 gibba020 bash[25448]: cluster 2021-03-10T14:51:58.890167+0000 mgr.gibba020.yqfnwy (mgr.34427) 3143 : cluster [DBG] pgmap v1780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:01.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:00 gibba013 bash[29418]: cephadm 2021-03-10T14:51:59.954135+0000 mgr.gibba020.yqfnwy (mgr.34427) 3144 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:52:01.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:00 gibba013 bash[30381]: cephadm 2021-03-10T14:51:59.954135+0000 mgr.gibba020.yqfnwy (mgr.34427) 3144 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:52:01.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:00 gibba020 bash[25448]: cephadm 2021-03-10T14:51:59.954135+0000 mgr.gibba020.yqfnwy (mgr.34427) 3144 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:52:02.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:01 gibba013 bash[29418]: cluster 2021-03-10T14:52:00.891917+0000 mgr.gibba020.yqfnwy (mgr.34427) 3145 : cluster [DBG] pgmap v1781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:02.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:01 gibba013 bash[30381]: cluster 2021-03-10T14:52:00.891917+0000 mgr.gibba020.yqfnwy (mgr.34427) 3145 : cluster [DBG] pgmap v1781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:02.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:01 gibba020 bash[25448]: cluster 2021-03-10T14:52:00.891917+0000 mgr.gibba020.yqfnwy (mgr.34427) 3145 : cluster [DBG] pgmap v1781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:04.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:03 gibba013 bash[29418]: cluster 2021-03-10T14:52:02.893223+0000 mgr.gibba020.yqfnwy (mgr.34427) 3146 : cluster [DBG] pgmap v1782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:04.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:03 gibba013 bash[30381]: cluster 2021-03-10T14:52:02.893223+0000 mgr.gibba020.yqfnwy (mgr.34427) 3146 : cluster [DBG] pgmap v1782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:04.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:03 gibba020 bash[25448]: cluster 2021-03-10T14:52:02.893223+0000 mgr.gibba020.yqfnwy (mgr.34427) 3146 : cluster [DBG] pgmap v1782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:06.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:05 gibba013 bash[29418]: cluster 2021-03-10T14:52:04.894831+0000 mgr.gibba020.yqfnwy (mgr.34427) 3147 : cluster [DBG] pgmap v1783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:06.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:05 gibba013 bash[30381]: cluster 2021-03-10T14:52:04.894831+0000 mgr.gibba020.yqfnwy (mgr.34427) 3147 : cluster [DBG] pgmap v1783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:06.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:05 gibba020 bash[25448]: cluster 2021-03-10T14:52:04.894831+0000 mgr.gibba020.yqfnwy (mgr.34427) 3147 : cluster [DBG] pgmap v1783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:07.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:06 gibba013 bash[29418]: audit 2021-03-10T14:52:06.276225+0000 mon.a (mon.0) 1500 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:52:07.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:06 gibba013 bash[29418]: audit 2021-03-10T14:52:06.285053+0000 mon.a (mon.0) 1501 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:52:07.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:06 gibba013 bash[29418]: audit 2021-03-10T14:52:06.296128+0000 mon.a (mon.0) 1502 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:52:07.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:06 gibba013 bash[29418]: audit 2021-03-10T14:52:06.296940+0000 mon.a (mon.0) 1503 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:52:07.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:06 gibba013 bash[29418]: audit 2021-03-10T14:52:06.297714+0000 mon.a (mon.0) 1504 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:52:07.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:06 gibba013 bash[29418]: audit 2021-03-10T14:52:06.298581+0000 mon.a (mon.0) 1505 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:52:07.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:06 gibba013 bash[30381]: audit 2021-03-10T14:52:06.276225+0000 mon.a (mon.0) 1500 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:52:07.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:06 gibba013 bash[30381]: audit 2021-03-10T14:52:06.285053+0000 mon.a (mon.0) 1501 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:52:07.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:06 gibba013 bash[30381]: audit 2021-03-10T14:52:06.296128+0000 mon.a (mon.0) 1502 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:52:07.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:06 gibba013 bash[30381]: audit 2021-03-10T14:52:06.296940+0000 mon.a (mon.0) 1503 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:52:07.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:06 gibba013 bash[30381]: audit 2021-03-10T14:52:06.297714+0000 mon.a (mon.0) 1504 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:52:07.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:06 gibba013 bash[30381]: audit 2021-03-10T14:52:06.298581+0000 mon.a (mon.0) 1505 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:52:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:06 gibba020 bash[25448]: audit 2021-03-10T14:52:06.276225+0000 mon.a (mon.0) 1500 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:52:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:06 gibba020 bash[25448]: audit 2021-03-10T14:52:06.285053+0000 mon.a (mon.0) 1501 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:52:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:06 gibba020 bash[25448]: audit 2021-03-10T14:52:06.296128+0000 mon.a (mon.0) 1502 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T14:52:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:06 gibba020 bash[25448]: audit 2021-03-10T14:52:06.296940+0000 mon.a (mon.0) 1503 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T14:52:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:06 gibba020 bash[25448]: audit 2021-03-10T14:52:06.297714+0000 mon.a (mon.0) 1504 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:52:07.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:06 gibba020 bash[25448]: audit 2021-03-10T14:52:06.298581+0000 mon.a (mon.0) 1505 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:52:08.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:07 gibba013 bash[29418]: cluster 2021-03-10T14:52:06.896528+0000 mgr.gibba020.yqfnwy (mgr.34427) 3148 : cluster [DBG] pgmap v1784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:08.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:07 gibba013 bash[30381]: cluster 2021-03-10T14:52:06.896528+0000 mgr.gibba020.yqfnwy (mgr.34427) 3148 : cluster [DBG] pgmap v1784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:08.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:07 gibba020 bash[25448]: cluster 2021-03-10T14:52:06.896528+0000 mgr.gibba020.yqfnwy (mgr.34427) 3148 : cluster [DBG] pgmap v1784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:10.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:10 gibba013 bash[29418]: cluster 2021-03-10T14:52:08.898208+0000 mgr.gibba020.yqfnwy (mgr.34427) 3149 : cluster [DBG] pgmap v1785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:10.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:10 gibba013 bash[30381]: cluster 2021-03-10T14:52:08.898208+0000 mgr.gibba020.yqfnwy (mgr.34427) 3149 : cluster [DBG] pgmap v1785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:10.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:10 gibba020 bash[25448]: cluster 2021-03-10T14:52:08.898208+0000 mgr.gibba020.yqfnwy (mgr.34427) 3149 : cluster [DBG] pgmap v1785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:12.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:12 gibba013 bash[29418]: cluster 2021-03-10T14:52:10.899933+0000 mgr.gibba020.yqfnwy (mgr.34427) 3150 : cluster [DBG] pgmap v1786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:12.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:12 gibba013 bash[30381]: cluster 2021-03-10T14:52:10.899933+0000 mgr.gibba020.yqfnwy (mgr.34427) 3150 : cluster [DBG] pgmap v1786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:12.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:12 gibba020 bash[25448]: cluster 2021-03-10T14:52:10.899933+0000 mgr.gibba020.yqfnwy (mgr.34427) 3150 : cluster [DBG] pgmap v1786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:14.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:14 gibba013 bash[29418]: cluster 2021-03-10T14:52:12.901183+0000 mgr.gibba020.yqfnwy (mgr.34427) 3151 : cluster [DBG] pgmap v1787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:14.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:14 gibba013 bash[30381]: cluster 2021-03-10T14:52:12.901183+0000 mgr.gibba020.yqfnwy (mgr.34427) 3151 : cluster [DBG] pgmap v1787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:14.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:14 gibba020 bash[25448]: cluster 2021-03-10T14:52:12.901183+0000 mgr.gibba020.yqfnwy (mgr.34427) 3151 : cluster [DBG] pgmap v1787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:14.673 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:52:14.898 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:52:14.899 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (58m) 3m ago 64m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:52:14.899 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (63m) 2m ago 63m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:52:14.899 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (59m) 2m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:52:14.899 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (59m) 2m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:52:14.900 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (58m) 3m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:52:14.900 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (58m) 3m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:52:14.900 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (57m) 2m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:52:14.900 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (57m) 3m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:52:14.900 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (64m) 3m ago 64m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:52:14.901 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (64m) 2m ago 64m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:52:14.901 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (57m) 3m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:52:14.901 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (56m) 3m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:52:14.901 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (56m) 3m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:52:14.901 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (55m) 3m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:52:14.902 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (55m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:52:14.902 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (54m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:52:14.902 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (54m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:52:14.902 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (54m) 2m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:52:14.902 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (63m) 2m ago 64m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:52:14.903 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 62m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:52:15.148 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:52:15.148 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:52:15.149 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:52:15.149 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:52:15.149 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:52:15.149 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:52:15.149 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:52:15.150 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:52:15.150 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:52:15.150 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:52:15.150 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:52:15.151 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:52:15.151 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:52:15.151 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:52:15.151 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:52:16.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:16 gibba013 bash[29418]: audit 2021-03-10T14:52:14.660384+0000 mgr.gibba020.yqfnwy (mgr.34427) 3152 : audit [DBG] from='client.46176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:52:16.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:16 gibba013 bash[29418]: audit 2021-03-10T14:52:14.882814+0000 mgr.gibba020.yqfnwy (mgr.34427) 3153 : audit [DBG] from='client.46182 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:52:16.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:16 gibba013 bash[29418]: cluster 2021-03-10T14:52:14.901945+0000 mgr.gibba020.yqfnwy (mgr.34427) 3154 : cluster [DBG] pgmap v1788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:16.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:16 gibba013 bash[29418]: cephadm 2021-03-10T14:52:14.968652+0000 mgr.gibba020.yqfnwy (mgr.34427) 3155 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:52:16.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:16 gibba013 bash[29418]: audit 2021-03-10T14:52:15.146059+0000 mon.c (mon.1) 58 : audit [DBG] from='client.? 172.21.2.113:0/3520629231' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:16.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:16 gibba013 bash[30381]: audit 2021-03-10T14:52:14.660384+0000 mgr.gibba020.yqfnwy (mgr.34427) 3152 : audit [DBG] from='client.46176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:52:16.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:16 gibba013 bash[30381]: audit 2021-03-10T14:52:14.882814+0000 mgr.gibba020.yqfnwy (mgr.34427) 3153 : audit [DBG] from='client.46182 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:52:16.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:16 gibba013 bash[30381]: cluster 2021-03-10T14:52:14.901945+0000 mgr.gibba020.yqfnwy (mgr.34427) 3154 : cluster [DBG] pgmap v1788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:16.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:16 gibba013 bash[30381]: cephadm 2021-03-10T14:52:14.968652+0000 mgr.gibba020.yqfnwy (mgr.34427) 3155 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:52:16.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:16 gibba013 bash[30381]: audit 2021-03-10T14:52:15.146059+0000 mon.c (mon.1) 58 : audit [DBG] from='client.? 172.21.2.113:0/3520629231' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:16.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:16 gibba020 bash[25448]: audit 2021-03-10T14:52:14.660384+0000 mgr.gibba020.yqfnwy (mgr.34427) 3152 : audit [DBG] from='client.46176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:52:16.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:16 gibba020 bash[25448]: audit 2021-03-10T14:52:14.882814+0000 mgr.gibba020.yqfnwy (mgr.34427) 3153 : audit [DBG] from='client.46182 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:52:16.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:16 gibba020 bash[25448]: cluster 2021-03-10T14:52:14.901945+0000 mgr.gibba020.yqfnwy (mgr.34427) 3154 : cluster [DBG] pgmap v1788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:16.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:16 gibba020 bash[25448]: cephadm 2021-03-10T14:52:14.968652+0000 mgr.gibba020.yqfnwy (mgr.34427) 3155 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:52:16.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:16 gibba020 bash[25448]: audit 2021-03-10T14:52:15.146059+0000 mon.c (mon.1) 58 : audit [DBG] from='client.? 172.21.2.113:0/3520629231' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:17.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:17 gibba020 bash[25448]: cluster 2021-03-10T14:52:16.903440+0000 mgr.gibba020.yqfnwy (mgr.34427) 3156 : cluster [DBG] pgmap v1789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:17.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:17 gibba013 bash[29418]: cluster 2021-03-10T14:52:16.903440+0000 mgr.gibba020.yqfnwy (mgr.34427) 3156 : cluster [DBG] pgmap v1789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:17.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:17 gibba013 bash[30381]: cluster 2021-03-10T14:52:16.903440+0000 mgr.gibba020.yqfnwy (mgr.34427) 3156 : cluster [DBG] pgmap v1789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:20.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:19 gibba013 bash[29418]: cluster 2021-03-10T14:52:18.904809+0000 mgr.gibba020.yqfnwy (mgr.34427) 3157 : cluster [DBG] pgmap v1790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:20.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:19 gibba013 bash[30381]: cluster 2021-03-10T14:52:18.904809+0000 mgr.gibba020.yqfnwy (mgr.34427) 3157 : cluster [DBG] pgmap v1790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:20.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:19 gibba020 bash[25448]: cluster 2021-03-10T14:52:18.904809+0000 mgr.gibba020.yqfnwy (mgr.34427) 3157 : cluster [DBG] pgmap v1790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:22.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:21 gibba013 bash[29418]: cluster 2021-03-10T14:52:20.906463+0000 mgr.gibba020.yqfnwy (mgr.34427) 3158 : cluster [DBG] pgmap v1791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:22.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:21 gibba013 bash[30381]: cluster 2021-03-10T14:52:20.906463+0000 mgr.gibba020.yqfnwy (mgr.34427) 3158 : cluster [DBG] pgmap v1791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:22.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:21 gibba020 bash[25448]: cluster 2021-03-10T14:52:20.906463+0000 mgr.gibba020.yqfnwy (mgr.34427) 3158 : cluster [DBG] pgmap v1791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:24.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:23 gibba013 bash[29418]: cluster 2021-03-10T14:52:22.908041+0000 mgr.gibba020.yqfnwy (mgr.34427) 3159 : cluster [DBG] pgmap v1792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:24.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:23 gibba013 bash[30381]: cluster 2021-03-10T14:52:22.908041+0000 mgr.gibba020.yqfnwy (mgr.34427) 3159 : cluster [DBG] pgmap v1792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:24.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:23 gibba020 bash[25448]: cluster 2021-03-10T14:52:22.908041+0000 mgr.gibba020.yqfnwy (mgr.34427) 3159 : cluster [DBG] pgmap v1792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:26.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:25 gibba013 bash[29418]: cluster 2021-03-10T14:52:24.909795+0000 mgr.gibba020.yqfnwy (mgr.34427) 3160 : cluster [DBG] pgmap v1793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:26.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:25 gibba013 bash[30381]: cluster 2021-03-10T14:52:24.909795+0000 mgr.gibba020.yqfnwy (mgr.34427) 3160 : cluster [DBG] pgmap v1793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:26.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:25 gibba020 bash[25448]: cluster 2021-03-10T14:52:24.909795+0000 mgr.gibba020.yqfnwy (mgr.34427) 3160 : cluster [DBG] pgmap v1793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:27.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:27 gibba013 bash[29418]: cluster 2021-03-10T14:52:26.911418+0000 mgr.gibba020.yqfnwy (mgr.34427) 3161 : cluster [DBG] pgmap v1794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:27.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:27 gibba013 bash[30381]: cluster 2021-03-10T14:52:26.911418+0000 mgr.gibba020.yqfnwy (mgr.34427) 3161 : cluster [DBG] pgmap v1794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:27.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:27 gibba020 bash[25448]: cluster 2021-03-10T14:52:26.911418+0000 mgr.gibba020.yqfnwy (mgr.34427) 3161 : cluster [DBG] pgmap v1794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:30.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:29 gibba013 bash[29418]: cluster 2021-03-10T14:52:28.912981+0000 mgr.gibba020.yqfnwy (mgr.34427) 3162 : cluster [DBG] pgmap v1795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:30.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:29 gibba013 bash[30381]: cluster 2021-03-10T14:52:28.912981+0000 mgr.gibba020.yqfnwy (mgr.34427) 3162 : cluster [DBG] pgmap v1795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:30.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:29 gibba020 bash[25448]: cluster 2021-03-10T14:52:28.912981+0000 mgr.gibba020.yqfnwy (mgr.34427) 3162 : cluster [DBG] pgmap v1795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:31.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[30381]: audit 2021-03-10T14:52:29.982123+0000 mon.a (mon.0) 1506 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:52:31.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[30381]: cephadm 2021-03-10T14:52:29.985043+0000 mgr.gibba020.yqfnwy (mgr.34427) 3163 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:52:31.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[30381]: cephadm 2021-03-10T14:52:29.986951+0000 mgr.gibba020.yqfnwy (mgr.34427) 3164 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:52:31.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[30381]: audit 2021-03-10T14:52:30.204072+0000 mon.a (mon.0) 1507 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:52:31.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[30381]: cephadm 2021-03-10T14:52:30.205450+0000 mgr.gibba020.yqfnwy (mgr.34427) 3165 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:52:31.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[30381]: audit 2021-03-10T14:52:30.207488+0000 mon.a (mon.0) 1508 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:52:31.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[30381]: cephadm 2021-03-10T14:52:30.207593+0000 mgr.gibba020.yqfnwy (mgr.34427) 3166 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:52:31.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[30381]: audit 2021-03-10T14:52:30.209243+0000 mon.a (mon.0) 1509 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:31.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[30381]: cephadm 2021-03-10T14:52:30.209284+0000 mgr.gibba020.yqfnwy (mgr.34427) 3167 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:52:31.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[30381]: cephadm 2021-03-10T14:52:30.209324+0000 mgr.gibba020.yqfnwy (mgr.34427) 3168 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:52:31.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[30381]: cephadm 2021-03-10T14:52:30.210809+0000 mgr.gibba020.yqfnwy (mgr.34427) 3169 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:52:31.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[30381]: cephadm 2021-03-10T14:52:30.210844+0000 mgr.gibba020.yqfnwy (mgr.34427) 3170 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:52:31.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[30381]: audit 2021-03-10T14:52:30.211060+0000 mon.a (mon.0) 1510 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:31.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[30381]: cephadm 2021-03-10T14:52:30.212131+0000 mgr.gibba020.yqfnwy (mgr.34427) 3171 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:52:31.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[30381]: audit 2021-03-10T14:52:30.212459+0000 mon.a (mon.0) 1511 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:31.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[30381]: cephadm 2021-03-10T14:52:30.213168+0000 mgr.gibba020.yqfnwy (mgr.34427) 3172 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:52:31.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[30381]: cephadm 2021-03-10T14:52:30.213205+0000 mgr.gibba020.yqfnwy (mgr.34427) 3173 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:52:31.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[30381]: cephadm 2021-03-10T14:52:30.214484+0000 mgr.gibba020.yqfnwy (mgr.34427) 3174 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:52:31.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[30381]: audit 2021-03-10T14:52:30.214861+0000 mon.a (mon.0) 1512 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:31.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[30381]: cephadm 2021-03-10T14:52:30.214895+0000 mgr.gibba020.yqfnwy (mgr.34427) 3175 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:52:31.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[30381]: cephadm 2021-03-10T14:52:30.216306+0000 mgr.gibba020.yqfnwy (mgr.34427) 3176 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:52:31.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[30381]: cephadm 2021-03-10T14:52:30.216342+0000 mgr.gibba020.yqfnwy (mgr.34427) 3177 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:52:31.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[30381]: cephadm 2021-03-10T14:52:30.216452+0000 mgr.gibba020.yqfnwy (mgr.34427) 3178 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:52:31.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[30381]: audit 2021-03-10T14:52:30.216485+0000 mon.a (mon.0) 1513 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:31.388 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[29418]: audit 2021-03-10T14:52:29.982123+0000 mon.a (mon.0) 1506 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:52:31.388 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[29418]: cephadm 2021-03-10T14:52:29.985043+0000 mgr.gibba020.yqfnwy (mgr.34427) 3163 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:52:31.388 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[29418]: cephadm 2021-03-10T14:52:29.986951+0000 mgr.gibba020.yqfnwy (mgr.34427) 3164 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:52:31.388 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[29418]: audit 2021-03-10T14:52:30.204072+0000 mon.a (mon.0) 1507 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:52:31.389 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[29418]: cephadm 2021-03-10T14:52:30.205450+0000 mgr.gibba020.yqfnwy (mgr.34427) 3165 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:52:31.389 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[29418]: audit 2021-03-10T14:52:30.207488+0000 mon.a (mon.0) 1508 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:52:31.389 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[29418]: cephadm 2021-03-10T14:52:30.207593+0000 mgr.gibba020.yqfnwy (mgr.34427) 3166 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:52:31.389 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[29418]: audit 2021-03-10T14:52:30.209243+0000 mon.a (mon.0) 1509 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:31.390 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[29418]: cephadm 2021-03-10T14:52:30.209284+0000 mgr.gibba020.yqfnwy (mgr.34427) 3167 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:52:31.390 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[29418]: cephadm 2021-03-10T14:52:30.209324+0000 mgr.gibba020.yqfnwy (mgr.34427) 3168 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:52:31.390 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[29418]: cephadm 2021-03-10T14:52:30.210809+0000 mgr.gibba020.yqfnwy (mgr.34427) 3169 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:52:31.390 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[29418]: cephadm 2021-03-10T14:52:30.210844+0000 mgr.gibba020.yqfnwy (mgr.34427) 3170 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:52:31.390 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[29418]: audit 2021-03-10T14:52:30.211060+0000 mon.a (mon.0) 1510 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:31.391 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[29418]: cephadm 2021-03-10T14:52:30.212131+0000 mgr.gibba020.yqfnwy (mgr.34427) 3171 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:52:31.391 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[29418]: audit 2021-03-10T14:52:30.212459+0000 mon.a (mon.0) 1511 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:31.391 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[29418]: cephadm 2021-03-10T14:52:30.213168+0000 mgr.gibba020.yqfnwy (mgr.34427) 3172 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:52:31.391 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[29418]: cephadm 2021-03-10T14:52:30.213205+0000 mgr.gibba020.yqfnwy (mgr.34427) 3173 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:52:31.391 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[29418]: cephadm 2021-03-10T14:52:30.214484+0000 mgr.gibba020.yqfnwy (mgr.34427) 3174 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:52:31.392 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[29418]: audit 2021-03-10T14:52:30.214861+0000 mon.a (mon.0) 1512 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:31.392 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[29418]: cephadm 2021-03-10T14:52:30.214895+0000 mgr.gibba020.yqfnwy (mgr.34427) 3175 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:52:31.392 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[29418]: cephadm 2021-03-10T14:52:30.216306+0000 mgr.gibba020.yqfnwy (mgr.34427) 3176 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:52:31.392 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[29418]: cephadm 2021-03-10T14:52:30.216342+0000 mgr.gibba020.yqfnwy (mgr.34427) 3177 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:52:31.392 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[29418]: cephadm 2021-03-10T14:52:30.216452+0000 mgr.gibba020.yqfnwy (mgr.34427) 3178 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:52:31.393 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:30 gibba013 bash[29418]: audit 2021-03-10T14:52:30.216485+0000 mon.a (mon.0) 1513 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:31.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:30 gibba020 bash[25448]: audit 2021-03-10T14:52:29.982123+0000 mon.a (mon.0) 1506 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:52:31.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:30 gibba020 bash[25448]: cephadm 2021-03-10T14:52:29.985043+0000 mgr.gibba020.yqfnwy (mgr.34427) 3163 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:52:31.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:30 gibba020 bash[25448]: cephadm 2021-03-10T14:52:29.986951+0000 mgr.gibba020.yqfnwy (mgr.34427) 3164 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:52:31.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:30 gibba020 bash[25448]: audit 2021-03-10T14:52:30.204072+0000 mon.a (mon.0) 1507 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:52:31.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:30 gibba020 bash[25448]: cephadm 2021-03-10T14:52:30.205450+0000 mgr.gibba020.yqfnwy (mgr.34427) 3165 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:52:31.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:30 gibba020 bash[25448]: audit 2021-03-10T14:52:30.207488+0000 mon.a (mon.0) 1508 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:52:31.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:30 gibba020 bash[25448]: cephadm 2021-03-10T14:52:30.207593+0000 mgr.gibba020.yqfnwy (mgr.34427) 3166 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:52:31.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:30 gibba020 bash[25448]: audit 2021-03-10T14:52:30.209243+0000 mon.a (mon.0) 1509 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:31.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:30 gibba020 bash[25448]: cephadm 2021-03-10T14:52:30.209284+0000 mgr.gibba020.yqfnwy (mgr.34427) 3167 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:52:31.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:30 gibba020 bash[25448]: cephadm 2021-03-10T14:52:30.209324+0000 mgr.gibba020.yqfnwy (mgr.34427) 3168 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:52:31.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:30 gibba020 bash[25448]: cephadm 2021-03-10T14:52:30.210809+0000 mgr.gibba020.yqfnwy (mgr.34427) 3169 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:52:31.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:30 gibba020 bash[25448]: cephadm 2021-03-10T14:52:30.210844+0000 mgr.gibba020.yqfnwy (mgr.34427) 3170 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:52:31.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:30 gibba020 bash[25448]: audit 2021-03-10T14:52:30.211060+0000 mon.a (mon.0) 1510 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:31.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:30 gibba020 bash[25448]: cephadm 2021-03-10T14:52:30.212131+0000 mgr.gibba020.yqfnwy (mgr.34427) 3171 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:52:31.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:30 gibba020 bash[25448]: audit 2021-03-10T14:52:30.212459+0000 mon.a (mon.0) 1511 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:31.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:30 gibba020 bash[25448]: cephadm 2021-03-10T14:52:30.213168+0000 mgr.gibba020.yqfnwy (mgr.34427) 3172 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:52:31.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:30 gibba020 bash[25448]: cephadm 2021-03-10T14:52:30.213205+0000 mgr.gibba020.yqfnwy (mgr.34427) 3173 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:52:31.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:30 gibba020 bash[25448]: cephadm 2021-03-10T14:52:30.214484+0000 mgr.gibba020.yqfnwy (mgr.34427) 3174 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:52:31.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:30 gibba020 bash[25448]: audit 2021-03-10T14:52:30.214861+0000 mon.a (mon.0) 1512 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:31.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:30 gibba020 bash[25448]: cephadm 2021-03-10T14:52:30.214895+0000 mgr.gibba020.yqfnwy (mgr.34427) 3175 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:52:31.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:30 gibba020 bash[25448]: cephadm 2021-03-10T14:52:30.216306+0000 mgr.gibba020.yqfnwy (mgr.34427) 3176 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:52:31.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:30 gibba020 bash[25448]: cephadm 2021-03-10T14:52:30.216342+0000 mgr.gibba020.yqfnwy (mgr.34427) 3177 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:52:31.456 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:30 gibba020 bash[25448]: cephadm 2021-03-10T14:52:30.216452+0000 mgr.gibba020.yqfnwy (mgr.34427) 3178 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:52:31.456 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:30 gibba020 bash[25448]: audit 2021-03-10T14:52:30.216485+0000 mon.a (mon.0) 1513 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:32.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:32 gibba013 bash[29418]: cluster 2021-03-10T14:52:30.914719+0000 mgr.gibba020.yqfnwy (mgr.34427) 3179 : cluster [DBG] pgmap v1796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:32.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:32 gibba013 bash[30381]: cluster 2021-03-10T14:52:30.914719+0000 mgr.gibba020.yqfnwy (mgr.34427) 3179 : cluster [DBG] pgmap v1796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:32.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:32 gibba020 bash[25448]: cluster 2021-03-10T14:52:30.914719+0000 mgr.gibba020.yqfnwy (mgr.34427) 3179 : cluster [DBG] pgmap v1796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:34.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:34 gibba013 bash[29418]: cluster 2021-03-10T14:52:32.916020+0000 mgr.gibba020.yqfnwy (mgr.34427) 3180 : cluster [DBG] pgmap v1797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:34.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:34 gibba013 bash[30381]: cluster 2021-03-10T14:52:32.916020+0000 mgr.gibba020.yqfnwy (mgr.34427) 3180 : cluster [DBG] pgmap v1797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:34.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:34 gibba020 bash[25448]: cluster 2021-03-10T14:52:32.916020+0000 mgr.gibba020.yqfnwy (mgr.34427) 3180 : cluster [DBG] pgmap v1797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:36.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:36 gibba013 bash[29418]: cluster 2021-03-10T14:52:34.917457+0000 mgr.gibba020.yqfnwy (mgr.34427) 3181 : cluster [DBG] pgmap v1798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:36.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:36 gibba013 bash[30381]: cluster 2021-03-10T14:52:34.917457+0000 mgr.gibba020.yqfnwy (mgr.34427) 3181 : cluster [DBG] pgmap v1798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:36.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:36 gibba020 bash[25448]: cluster 2021-03-10T14:52:34.917457+0000 mgr.gibba020.yqfnwy (mgr.34427) 3181 : cluster [DBG] pgmap v1798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:37.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:37 gibba013 bash[29418]: cluster 2021-03-10T14:52:36.918925+0000 mgr.gibba020.yqfnwy (mgr.34427) 3182 : cluster [DBG] pgmap v1799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:37.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:37 gibba013 bash[30381]: cluster 2021-03-10T14:52:36.918925+0000 mgr.gibba020.yqfnwy (mgr.34427) 3182 : cluster [DBG] pgmap v1799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:37.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:37 gibba020 bash[25448]: cluster 2021-03-10T14:52:36.918925+0000 mgr.gibba020.yqfnwy (mgr.34427) 3182 : cluster [DBG] pgmap v1799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:40.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:39 gibba013 bash[29418]: cluster 2021-03-10T14:52:38.920332+0000 mgr.gibba020.yqfnwy (mgr.34427) 3183 : cluster [DBG] pgmap v1800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:40.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:39 gibba013 bash[30381]: cluster 2021-03-10T14:52:38.920332+0000 mgr.gibba020.yqfnwy (mgr.34427) 3183 : cluster [DBG] pgmap v1800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:40.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:39 gibba020 bash[25448]: cluster 2021-03-10T14:52:38.920332+0000 mgr.gibba020.yqfnwy (mgr.34427) 3183 : cluster [DBG] pgmap v1800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:42.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:41 gibba013 bash[29418]: cluster 2021-03-10T14:52:40.921810+0000 mgr.gibba020.yqfnwy (mgr.34427) 3184 : cluster [DBG] pgmap v1801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:42.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:41 gibba013 bash[30381]: cluster 2021-03-10T14:52:40.921810+0000 mgr.gibba020.yqfnwy (mgr.34427) 3184 : cluster [DBG] pgmap v1801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:42.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:41 gibba020 bash[25448]: cluster 2021-03-10T14:52:40.921810+0000 mgr.gibba020.yqfnwy (mgr.34427) 3184 : cluster [DBG] pgmap v1801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:44.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:44 gibba013 bash[29418]: cluster 2021-03-10T14:52:42.923368+0000 mgr.gibba020.yqfnwy (mgr.34427) 3185 : cluster [DBG] pgmap v1802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:44.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:44 gibba013 bash[30381]: cluster 2021-03-10T14:52:42.923368+0000 mgr.gibba020.yqfnwy (mgr.34427) 3185 : cluster [DBG] pgmap v1802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:44.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:44 gibba020 bash[25448]: cluster 2021-03-10T14:52:42.923368+0000 mgr.gibba020.yqfnwy (mgr.34427) 3185 : cluster [DBG] pgmap v1802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:45.434 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:52:45.663 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:52:45.663 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (59m) 4m ago 64m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:52:45.663 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (64m) 3m ago 64m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:52:45.663 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (59m) 3m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:52:45.664 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (59m) 3m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:52:45.664 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (58m) 4m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:52:45.664 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (58m) 4m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:52:45.664 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (58m) 3m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:52:45.665 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (58m) 4m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:52:45.665 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (64m) 4m ago 64m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:52:45.665 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (64m) 3m ago 64m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:52:45.665 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (57m) 4m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:52:45.665 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (57m) 4m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:52:45.666 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (56m) 4m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:52:45.666 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (56m) 4m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:52:45.666 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (55m) 3m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:52:45.666 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (55m) 3m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:52:45.667 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (54m) 3m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:52:45.667 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (54m) 3m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:52:45.667 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (64m) 3m ago 64m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:52:45.667 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 3m ago 62m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:52:45.907 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:52:45.907 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:52:45.907 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:52:45.908 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:52:45.908 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:52:45.908 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:52:45.908 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:52:45.909 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:52:45.909 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:52:45.909 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:52:45.909 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:52:45.910 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:52:45.910 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:52:45.910 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:52:45.910 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:52:46.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:46 gibba013 bash[29418]: cluster 2021-03-10T14:52:44.925036+0000 mgr.gibba020.yqfnwy (mgr.34427) 3186 : cluster [DBG] pgmap v1803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:46.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:46 gibba013 bash[29418]: cephadm 2021-03-10T14:52:45.232569+0000 mgr.gibba020.yqfnwy (mgr.34427) 3187 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:52:46.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:46 gibba013 bash[29418]: audit 2021-03-10T14:52:45.422454+0000 mgr.gibba020.yqfnwy (mgr.34427) 3188 : audit [DBG] from='client.46194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:52:46.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:46 gibba013 bash[29418]: audit 2021-03-10T14:52:45.904689+0000 mon.a (mon.0) 1514 : audit [DBG] from='client.? 172.21.2.113:0/1820714819' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:46.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:46 gibba013 bash[30381]: cluster 2021-03-10T14:52:44.925036+0000 mgr.gibba020.yqfnwy (mgr.34427) 3186 : cluster [DBG] pgmap v1803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:46.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:46 gibba013 bash[30381]: cephadm 2021-03-10T14:52:45.232569+0000 mgr.gibba020.yqfnwy (mgr.34427) 3187 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:52:46.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:46 gibba013 bash[30381]: audit 2021-03-10T14:52:45.422454+0000 mgr.gibba020.yqfnwy (mgr.34427) 3188 : audit [DBG] from='client.46194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:52:46.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:46 gibba013 bash[30381]: audit 2021-03-10T14:52:45.904689+0000 mon.a (mon.0) 1514 : audit [DBG] from='client.? 172.21.2.113:0/1820714819' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:46.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:46 gibba020 bash[25448]: cluster 2021-03-10T14:52:44.925036+0000 mgr.gibba020.yqfnwy (mgr.34427) 3186 : cluster [DBG] pgmap v1803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:46.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:46 gibba020 bash[25448]: cephadm 2021-03-10T14:52:45.232569+0000 mgr.gibba020.yqfnwy (mgr.34427) 3187 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:52:46.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:46 gibba020 bash[25448]: audit 2021-03-10T14:52:45.422454+0000 mgr.gibba020.yqfnwy (mgr.34427) 3188 : audit [DBG] from='client.46194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:52:46.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:46 gibba020 bash[25448]: audit 2021-03-10T14:52:45.904689+0000 mon.a (mon.0) 1514 : audit [DBG] from='client.? 172.21.2.113:0/1820714819' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:52:47.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:47 gibba013 bash[29418]: audit 2021-03-10T14:52:45.646844+0000 mgr.gibba020.yqfnwy (mgr.34427) 3189 : audit [DBG] from='client.46200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:52:47.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:47 gibba013 bash[30381]: audit 2021-03-10T14:52:45.646844+0000 mgr.gibba020.yqfnwy (mgr.34427) 3189 : audit [DBG] from='client.46200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:52:47.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:47 gibba020 bash[25448]: audit 2021-03-10T14:52:45.646844+0000 mgr.gibba020.yqfnwy (mgr.34427) 3189 : audit [DBG] from='client.46200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:52:48.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:48 gibba013 bash[29418]: cluster 2021-03-10T14:52:46.926605+0000 mgr.gibba020.yqfnwy (mgr.34427) 3190 : cluster [DBG] pgmap v1804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:48.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:48 gibba013 bash[30381]: cluster 2021-03-10T14:52:46.926605+0000 mgr.gibba020.yqfnwy (mgr.34427) 3190 : cluster [DBG] pgmap v1804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:48.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:48 gibba020 bash[25448]: cluster 2021-03-10T14:52:46.926605+0000 mgr.gibba020.yqfnwy (mgr.34427) 3190 : cluster [DBG] pgmap v1804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:50.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:50 gibba013 bash[29418]: cluster 2021-03-10T14:52:48.928163+0000 mgr.gibba020.yqfnwy (mgr.34427) 3191 : cluster [DBG] pgmap v1805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:50.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:50 gibba013 bash[30381]: cluster 2021-03-10T14:52:48.928163+0000 mgr.gibba020.yqfnwy (mgr.34427) 3191 : cluster [DBG] pgmap v1805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:50.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:50 gibba020 bash[25448]: cluster 2021-03-10T14:52:48.928163+0000 mgr.gibba020.yqfnwy (mgr.34427) 3191 : cluster [DBG] pgmap v1805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:52.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:52 gibba013 bash[29418]: cluster 2021-03-10T14:52:50.929763+0000 mgr.gibba020.yqfnwy (mgr.34427) 3192 : cluster [DBG] pgmap v1806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:52.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:52 gibba013 bash[30381]: cluster 2021-03-10T14:52:50.929763+0000 mgr.gibba020.yqfnwy (mgr.34427) 3192 : cluster [DBG] pgmap v1806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:52.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:52 gibba020 bash[25448]: cluster 2021-03-10T14:52:50.929763+0000 mgr.gibba020.yqfnwy (mgr.34427) 3192 : cluster [DBG] pgmap v1806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:54.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:54 gibba013 bash[29418]: cluster 2021-03-10T14:52:52.931054+0000 mgr.gibba020.yqfnwy (mgr.34427) 3193 : cluster [DBG] pgmap v1807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:54.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:54 gibba013 bash[30381]: cluster 2021-03-10T14:52:52.931054+0000 mgr.gibba020.yqfnwy (mgr.34427) 3193 : cluster [DBG] pgmap v1807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:54.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:54 gibba020 bash[25448]: cluster 2021-03-10T14:52:52.931054+0000 mgr.gibba020.yqfnwy (mgr.34427) 3193 : cluster [DBG] pgmap v1807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:56.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:56 gibba013 bash[29418]: cluster 2021-03-10T14:52:54.932886+0000 mgr.gibba020.yqfnwy (mgr.34427) 3194 : cluster [DBG] pgmap v1808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:56.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:56 gibba013 bash[30381]: cluster 2021-03-10T14:52:54.932886+0000 mgr.gibba020.yqfnwy (mgr.34427) 3194 : cluster [DBG] pgmap v1808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:56.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:56 gibba020 bash[25448]: cluster 2021-03-10T14:52:54.932886+0000 mgr.gibba020.yqfnwy (mgr.34427) 3194 : cluster [DBG] pgmap v1808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:57.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:52:57 gibba013 bash[29418]: cluster 2021-03-10T14:52:56.934531+0000 mgr.gibba020.yqfnwy (mgr.34427) 3195 : cluster [DBG] pgmap v1809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:57.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:52:57 gibba013 bash[30381]: cluster 2021-03-10T14:52:56.934531+0000 mgr.gibba020.yqfnwy (mgr.34427) 3195 : cluster [DBG] pgmap v1809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:52:57.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:52:57 gibba020 bash[25448]: cluster 2021-03-10T14:52:56.934531+0000 mgr.gibba020.yqfnwy (mgr.34427) 3195 : cluster [DBG] pgmap v1809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:00.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:00 gibba013 bash[29418]: cluster 2021-03-10T14:52:58.936355+0000 mgr.gibba020.yqfnwy (mgr.34427) 3196 : cluster [DBG] pgmap v1810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:00.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:00 gibba013 bash[30381]: cluster 2021-03-10T14:52:58.936355+0000 mgr.gibba020.yqfnwy (mgr.34427) 3196 : cluster [DBG] pgmap v1810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:00.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:00 gibba020 bash[25448]: cluster 2021-03-10T14:52:58.936355+0000 mgr.gibba020.yqfnwy (mgr.34427) 3196 : cluster [DBG] pgmap v1810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:01.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:01 gibba013 bash[29418]: cephadm 2021-03-10T14:53:00.248420+0000 mgr.gibba020.yqfnwy (mgr.34427) 3197 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:53:01.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:01 gibba013 bash[30381]: cephadm 2021-03-10T14:53:00.248420+0000 mgr.gibba020.yqfnwy (mgr.34427) 3197 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:53:01.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:01 gibba020 bash[25448]: cephadm 2021-03-10T14:53:00.248420+0000 mgr.gibba020.yqfnwy (mgr.34427) 3197 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:53:02.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:02 gibba013 bash[29418]: cluster 2021-03-10T14:53:00.938137+0000 mgr.gibba020.yqfnwy (mgr.34427) 3198 : cluster [DBG] pgmap v1811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:02.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:02 gibba013 bash[30381]: cluster 2021-03-10T14:53:00.938137+0000 mgr.gibba020.yqfnwy (mgr.34427) 3198 : cluster [DBG] pgmap v1811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:02.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:02 gibba020 bash[25448]: cluster 2021-03-10T14:53:00.938137+0000 mgr.gibba020.yqfnwy (mgr.34427) 3198 : cluster [DBG] pgmap v1811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:04.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:04 gibba013 bash[29418]: cluster 2021-03-10T14:53:02.939645+0000 mgr.gibba020.yqfnwy (mgr.34427) 3199 : cluster [DBG] pgmap v1812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:04.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:04 gibba013 bash[30381]: cluster 2021-03-10T14:53:02.939645+0000 mgr.gibba020.yqfnwy (mgr.34427) 3199 : cluster [DBG] pgmap v1812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:04.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:04 gibba020 bash[25448]: cluster 2021-03-10T14:53:02.939645+0000 mgr.gibba020.yqfnwy (mgr.34427) 3199 : cluster [DBG] pgmap v1812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:06.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:06 gibba013 bash[29418]: cluster 2021-03-10T14:53:04.941464+0000 mgr.gibba020.yqfnwy (mgr.34427) 3200 : cluster [DBG] pgmap v1813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:06.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:06 gibba013 bash[30381]: cluster 2021-03-10T14:53:04.941464+0000 mgr.gibba020.yqfnwy (mgr.34427) 3200 : cluster [DBG] pgmap v1813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:06.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:06 gibba020 bash[25448]: cluster 2021-03-10T14:53:04.941464+0000 mgr.gibba020.yqfnwy (mgr.34427) 3200 : cluster [DBG] pgmap v1813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:07.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:07 gibba013 bash[29418]: audit 2021-03-10T14:53:06.281334+0000 mon.a (mon.0) 1515 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:53:07.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:07 gibba013 bash[29418]: audit 2021-03-10T14:53:06.291985+0000 mon.a (mon.0) 1516 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:53:07.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:07 gibba013 bash[29418]: audit 2021-03-10T14:53:06.304216+0000 mon.a (mon.0) 1517 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:53:07.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:07 gibba013 bash[29418]: audit 2021-03-10T14:53:06.304917+0000 mon.a (mon.0) 1518 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:53:07.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:07 gibba013 bash[29418]: audit 2021-03-10T14:53:06.305582+0000 mon.a (mon.0) 1519 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:53:07.387 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:07 gibba013 bash[29418]: audit 2021-03-10T14:53:06.306258+0000 mon.a (mon.0) 1520 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:53:07.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:07 gibba013 bash[30381]: audit 2021-03-10T14:53:06.281334+0000 mon.a (mon.0) 1515 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:53:07.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:07 gibba013 bash[30381]: audit 2021-03-10T14:53:06.291985+0000 mon.a (mon.0) 1516 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:53:07.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:07 gibba013 bash[30381]: audit 2021-03-10T14:53:06.304216+0000 mon.a (mon.0) 1517 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:53:07.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:07 gibba013 bash[30381]: audit 2021-03-10T14:53:06.304917+0000 mon.a (mon.0) 1518 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:53:07.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:07 gibba013 bash[30381]: audit 2021-03-10T14:53:06.305582+0000 mon.a (mon.0) 1519 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:53:07.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:07 gibba013 bash[30381]: audit 2021-03-10T14:53:06.306258+0000 mon.a (mon.0) 1520 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:53:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:07 gibba020 bash[25448]: audit 2021-03-10T14:53:06.281334+0000 mon.a (mon.0) 1515 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:53:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:07 gibba020 bash[25448]: audit 2021-03-10T14:53:06.291985+0000 mon.a (mon.0) 1516 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:53:07.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:07 gibba020 bash[25448]: audit 2021-03-10T14:53:06.304216+0000 mon.a (mon.0) 1517 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T14:53:07.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:07 gibba020 bash[25448]: audit 2021-03-10T14:53:06.304917+0000 mon.a (mon.0) 1518 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:53:07.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:07 gibba020 bash[25448]: audit 2021-03-10T14:53:06.305582+0000 mon.a (mon.0) 1519 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:53:07.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:07 gibba020 bash[25448]: audit 2021-03-10T14:53:06.306258+0000 mon.a (mon.0) 1520 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T14:53:08.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:08 gibba013 bash[29418]: cluster 2021-03-10T14:53:06.943283+0000 mgr.gibba020.yqfnwy (mgr.34427) 3201 : cluster [DBG] pgmap v1814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:08.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:08 gibba013 bash[30381]: cluster 2021-03-10T14:53:06.943283+0000 mgr.gibba020.yqfnwy (mgr.34427) 3201 : cluster [DBG] pgmap v1814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:08.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:08 gibba020 bash[25448]: cluster 2021-03-10T14:53:06.943283+0000 mgr.gibba020.yqfnwy (mgr.34427) 3201 : cluster [DBG] pgmap v1814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:10.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:10 gibba013 bash[29418]: cluster 2021-03-10T14:53:08.944905+0000 mgr.gibba020.yqfnwy (mgr.34427) 3202 : cluster [DBG] pgmap v1815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:10.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:10 gibba013 bash[30381]: cluster 2021-03-10T14:53:08.944905+0000 mgr.gibba020.yqfnwy (mgr.34427) 3202 : cluster [DBG] pgmap v1815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:10.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:10 gibba020 bash[25448]: cluster 2021-03-10T14:53:08.944905+0000 mgr.gibba020.yqfnwy (mgr.34427) 3202 : cluster [DBG] pgmap v1815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:12.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:12 gibba013 bash[29418]: cluster 2021-03-10T14:53:10.946645+0000 mgr.gibba020.yqfnwy (mgr.34427) 3203 : cluster [DBG] pgmap v1816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:12.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:12 gibba013 bash[30381]: cluster 2021-03-10T14:53:10.946645+0000 mgr.gibba020.yqfnwy (mgr.34427) 3203 : cluster [DBG] pgmap v1816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:12.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:12 gibba020 bash[25448]: cluster 2021-03-10T14:53:10.946645+0000 mgr.gibba020.yqfnwy (mgr.34427) 3203 : cluster [DBG] pgmap v1816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:14.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:14 gibba013 bash[29418]: cluster 2021-03-10T14:53:12.947900+0000 mgr.gibba020.yqfnwy (mgr.34427) 3204 : cluster [DBG] pgmap v1817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:14.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:14 gibba013 bash[30381]: cluster 2021-03-10T14:53:12.947900+0000 mgr.gibba020.yqfnwy (mgr.34427) 3204 : cluster [DBG] pgmap v1817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:14.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:14 gibba020 bash[25448]: cluster 2021-03-10T14:53:12.947900+0000 mgr.gibba020.yqfnwy (mgr.34427) 3204 : cluster [DBG] pgmap v1817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:16.151 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:53:16.380 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:53:16.380 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (59m) 4m ago 65m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:53:16.381 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (64m) 3m ago 64m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:53:16.381 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (60m) 3m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:53:16.381 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (60m) 3m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:53:16.381 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (59m) 4m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:53:16.381 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (59m) 4m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:53:16.382 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (58m) 3m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:53:16.382 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (59m) 4m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:53:16.382 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (65m) 4m ago 65m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:53:16.382 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (65m) 3m ago 65m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:53:16.382 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (58m) 4m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:53:16.383 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (57m) 4m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:53:16.383 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (57m) 4m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:53:16.383 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (56m) 4m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:53:16.383 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (56m) 3m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:53:16.383 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (55m) 3m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:53:16.384 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (55m) 3m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:53:16.384 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (55m) 3m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:53:16.384 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (64m) 3m ago 65m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:53:16.384 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 3m ago 63m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:53:16.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:16 gibba013 bash[29418]: cluster 2021-03-10T14:53:14.949691+0000 mgr.gibba020.yqfnwy (mgr.34427) 3205 : cluster [DBG] pgmap v1818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:16.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:16 gibba013 bash[29418]: cephadm 2021-03-10T14:53:15.264470+0000 mgr.gibba020.yqfnwy (mgr.34427) 3206 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:53:16.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:16 gibba013 bash[30381]: cluster 2021-03-10T14:53:14.949691+0000 mgr.gibba020.yqfnwy (mgr.34427) 3205 : cluster [DBG] pgmap v1818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:16.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:16 gibba013 bash[30381]: cephadm 2021-03-10T14:53:15.264470+0000 mgr.gibba020.yqfnwy (mgr.34427) 3206 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:53:16.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:16 gibba020 bash[25448]: cluster 2021-03-10T14:53:14.949691+0000 mgr.gibba020.yqfnwy (mgr.34427) 3205 : cluster [DBG] pgmap v1818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:16.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:16 gibba020 bash[25448]: cephadm 2021-03-10T14:53:15.264470+0000 mgr.gibba020.yqfnwy (mgr.34427) 3206 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:53:16.630 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:53:16.630 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:53:16.630 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:53:16.630 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:53:16.631 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:53:16.631 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:53:16.631 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:53:16.631 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:53:16.632 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:53:16.632 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:53:16.632 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:53:16.632 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:53:16.632 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:53:16.633 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:53:16.633 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:53:17.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:17 gibba013 bash[29418]: audit 2021-03-10T14:53:16.139374+0000 mgr.gibba020.yqfnwy (mgr.34427) 3207 : audit [DBG] from='client.46212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:53:17.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:17 gibba013 bash[29418]: audit 2021-03-10T14:53:16.364811+0000 mgr.gibba020.yqfnwy (mgr.34427) 3208 : audit [DBG] from='client.56203 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:53:17.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:17 gibba013 bash[29418]: audit 2021-03-10T14:53:16.627537+0000 mon.a (mon.0) 1521 : audit [DBG] from='client.? 172.21.2.113:0/1123098568' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:17.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:17 gibba013 bash[30381]: audit 2021-03-10T14:53:16.139374+0000 mgr.gibba020.yqfnwy (mgr.34427) 3207 : audit [DBG] from='client.46212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:53:17.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:17 gibba013 bash[30381]: audit 2021-03-10T14:53:16.364811+0000 mgr.gibba020.yqfnwy (mgr.34427) 3208 : audit [DBG] from='client.56203 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:53:17.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:17 gibba013 bash[30381]: audit 2021-03-10T14:53:16.627537+0000 mon.a (mon.0) 1521 : audit [DBG] from='client.? 172.21.2.113:0/1123098568' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:17.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:17 gibba020 bash[25448]: audit 2021-03-10T14:53:16.139374+0000 mgr.gibba020.yqfnwy (mgr.34427) 3207 : audit [DBG] from='client.46212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:53:17.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:17 gibba020 bash[25448]: audit 2021-03-10T14:53:16.364811+0000 mgr.gibba020.yqfnwy (mgr.34427) 3208 : audit [DBG] from='client.56203 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:53:17.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:17 gibba020 bash[25448]: audit 2021-03-10T14:53:16.627537+0000 mon.a (mon.0) 1521 : audit [DBG] from='client.? 172.21.2.113:0/1123098568' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:18.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:18 gibba013 bash[29418]: cluster 2021-03-10T14:53:16.951064+0000 mgr.gibba020.yqfnwy (mgr.34427) 3209 : cluster [DBG] pgmap v1819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:18.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:18 gibba013 bash[30381]: cluster 2021-03-10T14:53:16.951064+0000 mgr.gibba020.yqfnwy (mgr.34427) 3209 : cluster [DBG] pgmap v1819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:18.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:18 gibba020 bash[25448]: cluster 2021-03-10T14:53:16.951064+0000 mgr.gibba020.yqfnwy (mgr.34427) 3209 : cluster [DBG] pgmap v1819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:20.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:20 gibba013 bash[29418]: cluster 2021-03-10T14:53:18.952758+0000 mgr.gibba020.yqfnwy (mgr.34427) 3210 : cluster [DBG] pgmap v1820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:20.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:20 gibba013 bash[30381]: cluster 2021-03-10T14:53:18.952758+0000 mgr.gibba020.yqfnwy (mgr.34427) 3210 : cluster [DBG] pgmap v1820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:20.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:20 gibba020 bash[25448]: cluster 2021-03-10T14:53:18.952758+0000 mgr.gibba020.yqfnwy (mgr.34427) 3210 : cluster [DBG] pgmap v1820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:22.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:22 gibba013 bash[29418]: cluster 2021-03-10T14:53:20.954497+0000 mgr.gibba020.yqfnwy (mgr.34427) 3211 : cluster [DBG] pgmap v1821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:22.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:22 gibba013 bash[30381]: cluster 2021-03-10T14:53:20.954497+0000 mgr.gibba020.yqfnwy (mgr.34427) 3211 : cluster [DBG] pgmap v1821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:22.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:22 gibba020 bash[25448]: cluster 2021-03-10T14:53:20.954497+0000 mgr.gibba020.yqfnwy (mgr.34427) 3211 : cluster [DBG] pgmap v1821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:24.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:24 gibba013 bash[29418]: cluster 2021-03-10T14:53:22.955646+0000 mgr.gibba020.yqfnwy (mgr.34427) 3212 : cluster [DBG] pgmap v1822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:24.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:24 gibba013 bash[30381]: cluster 2021-03-10T14:53:22.955646+0000 mgr.gibba020.yqfnwy (mgr.34427) 3212 : cluster [DBG] pgmap v1822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:24.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:24 gibba020 bash[25448]: cluster 2021-03-10T14:53:22.955646+0000 mgr.gibba020.yqfnwy (mgr.34427) 3212 : cluster [DBG] pgmap v1822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:26.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:26 gibba013 bash[29418]: cluster 2021-03-10T14:53:24.957312+0000 mgr.gibba020.yqfnwy (mgr.34427) 3213 : cluster [DBG] pgmap v1823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:26.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:26 gibba013 bash[30381]: cluster 2021-03-10T14:53:24.957312+0000 mgr.gibba020.yqfnwy (mgr.34427) 3213 : cluster [DBG] pgmap v1823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:26.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:26 gibba020 bash[25448]: cluster 2021-03-10T14:53:24.957312+0000 mgr.gibba020.yqfnwy (mgr.34427) 3213 : cluster [DBG] pgmap v1823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:27.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:27 gibba013 bash[29418]: cluster 2021-03-10T14:53:26.958796+0000 mgr.gibba020.yqfnwy (mgr.34427) 3214 : cluster [DBG] pgmap v1824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:27.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:27 gibba013 bash[30381]: cluster 2021-03-10T14:53:26.958796+0000 mgr.gibba020.yqfnwy (mgr.34427) 3214 : cluster [DBG] pgmap v1824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:27.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:27 gibba020 bash[25448]: cluster 2021-03-10T14:53:26.958796+0000 mgr.gibba020.yqfnwy (mgr.34427) 3214 : cluster [DBG] pgmap v1824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:30.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:30 gibba013 bash[29418]: cluster 2021-03-10T14:53:28.960351+0000 mgr.gibba020.yqfnwy (mgr.34427) 3215 : cluster [DBG] pgmap v1825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:30.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:30 gibba013 bash[30381]: cluster 2021-03-10T14:53:28.960351+0000 mgr.gibba020.yqfnwy (mgr.34427) 3215 : cluster [DBG] pgmap v1825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:30.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:30 gibba020 bash[25448]: cluster 2021-03-10T14:53:28.960351+0000 mgr.gibba020.yqfnwy (mgr.34427) 3215 : cluster [DBG] pgmap v1825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:31.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:31 gibba013 bash[29418]: audit 2021-03-10T14:53:30.282551+0000 mon.a (mon.0) 1522 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:53:31.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:31 gibba013 bash[29418]: cephadm 2021-03-10T14:53:30.286004+0000 mgr.gibba020.yqfnwy (mgr.34427) 3216 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:53:31.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:31 gibba013 bash[29418]: cephadm 2021-03-10T14:53:30.287808+0000 mgr.gibba020.yqfnwy (mgr.34427) 3217 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:53:31.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:31 gibba013 bash[29418]: audit 2021-03-10T14:53:30.506880+0000 mon.a (mon.0) 1523 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:53:31.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:31 gibba013 bash[29418]: audit 2021-03-10T14:53:30.523219+0000 mon.a (mon.0) 1524 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:53:31.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:31 gibba013 bash[29418]: audit 2021-03-10T14:53:30.527899+0000 mon.a (mon.0) 1525 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:31.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:31 gibba013 bash[29418]: audit 2021-03-10T14:53:30.531731+0000 mon.a (mon.0) 1526 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:31.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:31 gibba013 bash[29418]: audit 2021-03-10T14:53:30.535549+0000 mon.a (mon.0) 1527 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:31.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:31 gibba013 bash[29418]: audit 2021-03-10T14:53:30.543599+0000 mon.a (mon.0) 1528 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:31.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:31 gibba013 bash[29418]: audit 2021-03-10T14:53:30.549413+0000 mon.a (mon.0) 1529 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:31.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:31 gibba013 bash[30381]: audit 2021-03-10T14:53:30.282551+0000 mon.a (mon.0) 1522 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:53:31.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:31 gibba013 bash[30381]: cephadm 2021-03-10T14:53:30.286004+0000 mgr.gibba020.yqfnwy (mgr.34427) 3216 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:53:31.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:31 gibba013 bash[30381]: cephadm 2021-03-10T14:53:30.287808+0000 mgr.gibba020.yqfnwy (mgr.34427) 3217 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:53:31.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:31 gibba013 bash[30381]: audit 2021-03-10T14:53:30.506880+0000 mon.a (mon.0) 1523 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:53:31.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:31 gibba013 bash[30381]: audit 2021-03-10T14:53:30.523219+0000 mon.a (mon.0) 1524 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:53:31.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:31 gibba013 bash[30381]: audit 2021-03-10T14:53:30.527899+0000 mon.a (mon.0) 1525 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:31.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:31 gibba013 bash[30381]: audit 2021-03-10T14:53:30.531731+0000 mon.a (mon.0) 1526 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:31.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:31 gibba013 bash[30381]: audit 2021-03-10T14:53:30.535549+0000 mon.a (mon.0) 1527 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:31.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:31 gibba013 bash[30381]: audit 2021-03-10T14:53:30.543599+0000 mon.a (mon.0) 1528 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:31.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:31 gibba013 bash[30381]: audit 2021-03-10T14:53:30.549413+0000 mon.a (mon.0) 1529 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:31.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:31 gibba020 bash[25448]: audit 2021-03-10T14:53:30.282551+0000 mon.a (mon.0) 1522 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:53:31.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:31 gibba020 bash[25448]: cephadm 2021-03-10T14:53:30.286004+0000 mgr.gibba020.yqfnwy (mgr.34427) 3216 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:53:31.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:31 gibba020 bash[25448]: cephadm 2021-03-10T14:53:30.287808+0000 mgr.gibba020.yqfnwy (mgr.34427) 3217 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:53:31.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:31 gibba020 bash[25448]: audit 2021-03-10T14:53:30.506880+0000 mon.a (mon.0) 1523 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:53:31.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:31 gibba020 bash[25448]: audit 2021-03-10T14:53:30.523219+0000 mon.a (mon.0) 1524 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:53:31.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:31 gibba020 bash[25448]: audit 2021-03-10T14:53:30.527899+0000 mon.a (mon.0) 1525 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:31.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:31 gibba020 bash[25448]: audit 2021-03-10T14:53:30.531731+0000 mon.a (mon.0) 1526 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:31.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:31 gibba020 bash[25448]: audit 2021-03-10T14:53:30.535549+0000 mon.a (mon.0) 1527 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:31.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:31 gibba020 bash[25448]: audit 2021-03-10T14:53:30.543599+0000 mon.a (mon.0) 1528 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:31.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:31 gibba020 bash[25448]: audit 2021-03-10T14:53:30.549413+0000 mon.a (mon.0) 1529 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:32.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:32 gibba013 bash[29418]: cephadm 2021-03-10T14:53:30.519184+0000 mgr.gibba020.yqfnwy (mgr.34427) 3218 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:53:32.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:32 gibba013 bash[29418]: cephadm 2021-03-10T14:53:30.525439+0000 mgr.gibba020.yqfnwy (mgr.34427) 3219 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:53:32.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:32 gibba013 bash[29418]: cephadm 2021-03-10T14:53:30.529081+0000 mgr.gibba020.yqfnwy (mgr.34427) 3220 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:53:32.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:32 gibba013 bash[29418]: cephadm 2021-03-10T14:53:30.529343+0000 mgr.gibba020.yqfnwy (mgr.34427) 3221 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:53:32.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:32 gibba013 bash[29418]: cephadm 2021-03-10T14:53:30.532921+0000 mgr.gibba020.yqfnwy (mgr.34427) 3222 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:53:32.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:32 gibba013 bash[29418]: cephadm 2021-03-10T14:53:30.533577+0000 mgr.gibba020.yqfnwy (mgr.34427) 3223 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:53:32.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:32 gibba013 bash[29418]: cephadm 2021-03-10T14:53:30.536813+0000 mgr.gibba020.yqfnwy (mgr.34427) 3224 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:53:32.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:32 gibba013 bash[29418]: cephadm 2021-03-10T14:53:30.540427+0000 mgr.gibba020.yqfnwy (mgr.34427) 3225 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:53:32.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:32 gibba013 bash[29418]: cephadm 2021-03-10T14:53:30.540657+0000 mgr.gibba020.yqfnwy (mgr.34427) 3226 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:53:32.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:32 gibba013 bash[29418]: cephadm 2021-03-10T14:53:30.544929+0000 mgr.gibba020.yqfnwy (mgr.34427) 3227 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:53:32.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:32 gibba013 bash[29418]: cephadm 2021-03-10T14:53:30.547191+0000 mgr.gibba020.yqfnwy (mgr.34427) 3228 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:53:32.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:32 gibba013 bash[29418]: cephadm 2021-03-10T14:53:30.550808+0000 mgr.gibba020.yqfnwy (mgr.34427) 3229 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:53:32.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:32 gibba013 bash[29418]: cephadm 2021-03-10T14:53:30.551401+0000 mgr.gibba020.yqfnwy (mgr.34427) 3230 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:53:32.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:32 gibba013 bash[29418]: cephadm 2021-03-10T14:53:30.552090+0000 mgr.gibba020.yqfnwy (mgr.34427) 3231 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:53:32.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:32 gibba013 bash[29418]: cluster 2021-03-10T14:53:30.962213+0000 mgr.gibba020.yqfnwy (mgr.34427) 3232 : cluster [DBG] pgmap v1826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:32.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:32 gibba013 bash[30381]: cephadm 2021-03-10T14:53:30.519184+0000 mgr.gibba020.yqfnwy (mgr.34427) 3218 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:53:32.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:32 gibba013 bash[30381]: cephadm 2021-03-10T14:53:30.525439+0000 mgr.gibba020.yqfnwy (mgr.34427) 3219 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:53:32.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:32 gibba013 bash[30381]: cephadm 2021-03-10T14:53:30.529081+0000 mgr.gibba020.yqfnwy (mgr.34427) 3220 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:53:32.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:32 gibba013 bash[30381]: cephadm 2021-03-10T14:53:30.529343+0000 mgr.gibba020.yqfnwy (mgr.34427) 3221 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:53:32.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:32 gibba013 bash[30381]: cephadm 2021-03-10T14:53:30.532921+0000 mgr.gibba020.yqfnwy (mgr.34427) 3222 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:53:32.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:32 gibba013 bash[30381]: cephadm 2021-03-10T14:53:30.533577+0000 mgr.gibba020.yqfnwy (mgr.34427) 3223 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:53:32.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:32 gibba013 bash[30381]: cephadm 2021-03-10T14:53:30.536813+0000 mgr.gibba020.yqfnwy (mgr.34427) 3224 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:53:32.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:32 gibba013 bash[30381]: cephadm 2021-03-10T14:53:30.540427+0000 mgr.gibba020.yqfnwy (mgr.34427) 3225 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:53:32.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:32 gibba013 bash[30381]: cephadm 2021-03-10T14:53:30.540657+0000 mgr.gibba020.yqfnwy (mgr.34427) 3226 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:53:32.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:32 gibba013 bash[30381]: cephadm 2021-03-10T14:53:30.544929+0000 mgr.gibba020.yqfnwy (mgr.34427) 3227 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:53:32.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:32 gibba013 bash[30381]: cephadm 2021-03-10T14:53:30.547191+0000 mgr.gibba020.yqfnwy (mgr.34427) 3228 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:53:32.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:32 gibba013 bash[30381]: cephadm 2021-03-10T14:53:30.550808+0000 mgr.gibba020.yqfnwy (mgr.34427) 3229 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:53:32.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:32 gibba013 bash[30381]: cephadm 2021-03-10T14:53:30.551401+0000 mgr.gibba020.yqfnwy (mgr.34427) 3230 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:53:32.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:32 gibba013 bash[30381]: cephadm 2021-03-10T14:53:30.552090+0000 mgr.gibba020.yqfnwy (mgr.34427) 3231 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:53:32.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:32 gibba013 bash[30381]: cluster 2021-03-10T14:53:30.962213+0000 mgr.gibba020.yqfnwy (mgr.34427) 3232 : cluster [DBG] pgmap v1826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:32.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:32 gibba020 bash[25448]: cephadm 2021-03-10T14:53:30.519184+0000 mgr.gibba020.yqfnwy (mgr.34427) 3218 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:53:32.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:32 gibba020 bash[25448]: cephadm 2021-03-10T14:53:30.525439+0000 mgr.gibba020.yqfnwy (mgr.34427) 3219 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:53:32.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:32 gibba020 bash[25448]: cephadm 2021-03-10T14:53:30.529081+0000 mgr.gibba020.yqfnwy (mgr.34427) 3220 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:53:32.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:32 gibba020 bash[25448]: cephadm 2021-03-10T14:53:30.529343+0000 mgr.gibba020.yqfnwy (mgr.34427) 3221 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:53:32.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:32 gibba020 bash[25448]: cephadm 2021-03-10T14:53:30.532921+0000 mgr.gibba020.yqfnwy (mgr.34427) 3222 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:53:32.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:32 gibba020 bash[25448]: cephadm 2021-03-10T14:53:30.533577+0000 mgr.gibba020.yqfnwy (mgr.34427) 3223 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:53:32.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:32 gibba020 bash[25448]: cephadm 2021-03-10T14:53:30.536813+0000 mgr.gibba020.yqfnwy (mgr.34427) 3224 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:53:32.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:32 gibba020 bash[25448]: cephadm 2021-03-10T14:53:30.540427+0000 mgr.gibba020.yqfnwy (mgr.34427) 3225 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:53:32.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:32 gibba020 bash[25448]: cephadm 2021-03-10T14:53:30.540657+0000 mgr.gibba020.yqfnwy (mgr.34427) 3226 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:53:32.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:32 gibba020 bash[25448]: cephadm 2021-03-10T14:53:30.544929+0000 mgr.gibba020.yqfnwy (mgr.34427) 3227 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:53:32.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:32 gibba020 bash[25448]: cephadm 2021-03-10T14:53:30.547191+0000 mgr.gibba020.yqfnwy (mgr.34427) 3228 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:53:32.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:32 gibba020 bash[25448]: cephadm 2021-03-10T14:53:30.550808+0000 mgr.gibba020.yqfnwy (mgr.34427) 3229 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:53:32.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:32 gibba020 bash[25448]: cephadm 2021-03-10T14:53:30.551401+0000 mgr.gibba020.yqfnwy (mgr.34427) 3230 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:53:32.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:32 gibba020 bash[25448]: cephadm 2021-03-10T14:53:30.552090+0000 mgr.gibba020.yqfnwy (mgr.34427) 3231 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:53:32.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:32 gibba020 bash[25448]: cluster 2021-03-10T14:53:30.962213+0000 mgr.gibba020.yqfnwy (mgr.34427) 3232 : cluster [DBG] pgmap v1826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:34.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:34 gibba013 bash[29418]: cluster 2021-03-10T14:53:32.963379+0000 mgr.gibba020.yqfnwy (mgr.34427) 3233 : cluster [DBG] pgmap v1827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:34.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:34 gibba013 bash[30381]: cluster 2021-03-10T14:53:32.963379+0000 mgr.gibba020.yqfnwy (mgr.34427) 3233 : cluster [DBG] pgmap v1827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:34.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:34 gibba020 bash[25448]: cluster 2021-03-10T14:53:32.963379+0000 mgr.gibba020.yqfnwy (mgr.34427) 3233 : cluster [DBG] pgmap v1827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:36.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:36 gibba013 bash[29418]: cluster 2021-03-10T14:53:34.965025+0000 mgr.gibba020.yqfnwy (mgr.34427) 3234 : cluster [DBG] pgmap v1828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:36.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:36 gibba013 bash[30381]: cluster 2021-03-10T14:53:34.965025+0000 mgr.gibba020.yqfnwy (mgr.34427) 3234 : cluster [DBG] pgmap v1828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:36.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:36 gibba020 bash[25448]: cluster 2021-03-10T14:53:34.965025+0000 mgr.gibba020.yqfnwy (mgr.34427) 3234 : cluster [DBG] pgmap v1828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:37.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:37 gibba013 bash[29418]: cluster 2021-03-10T14:53:36.966427+0000 mgr.gibba020.yqfnwy (mgr.34427) 3235 : cluster [DBG] pgmap v1829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:37.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:37 gibba013 bash[30381]: cluster 2021-03-10T14:53:36.966427+0000 mgr.gibba020.yqfnwy (mgr.34427) 3235 : cluster [DBG] pgmap v1829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:37.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:37 gibba020 bash[25448]: cluster 2021-03-10T14:53:36.966427+0000 mgr.gibba020.yqfnwy (mgr.34427) 3235 : cluster [DBG] pgmap v1829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:40.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:40 gibba013 bash[29418]: cluster 2021-03-10T14:53:38.967810+0000 mgr.gibba020.yqfnwy (mgr.34427) 3236 : cluster [DBG] pgmap v1830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:40.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:40 gibba013 bash[30381]: cluster 2021-03-10T14:53:38.967810+0000 mgr.gibba020.yqfnwy (mgr.34427) 3236 : cluster [DBG] pgmap v1830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:40.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:40 gibba020 bash[25448]: cluster 2021-03-10T14:53:38.967810+0000 mgr.gibba020.yqfnwy (mgr.34427) 3236 : cluster [DBG] pgmap v1830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:42.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:42 gibba013 bash[29418]: cluster 2021-03-10T14:53:40.969415+0000 mgr.gibba020.yqfnwy (mgr.34427) 3237 : cluster [DBG] pgmap v1831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:42.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:42 gibba013 bash[30381]: cluster 2021-03-10T14:53:40.969415+0000 mgr.gibba020.yqfnwy (mgr.34427) 3237 : cluster [DBG] pgmap v1831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:42.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:42 gibba020 bash[25448]: cluster 2021-03-10T14:53:40.969415+0000 mgr.gibba020.yqfnwy (mgr.34427) 3237 : cluster [DBG] pgmap v1831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:44.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:44 gibba013 bash[29418]: cluster 2021-03-10T14:53:42.970720+0000 mgr.gibba020.yqfnwy (mgr.34427) 3238 : cluster [DBG] pgmap v1832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:44.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:44 gibba013 bash[30381]: cluster 2021-03-10T14:53:42.970720+0000 mgr.gibba020.yqfnwy (mgr.34427) 3238 : cluster [DBG] pgmap v1832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:44.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:44 gibba020 bash[25448]: cluster 2021-03-10T14:53:42.970720+0000 mgr.gibba020.yqfnwy (mgr.34427) 3238 : cluster [DBG] pgmap v1832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:46.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:46 gibba013 bash[29418]: cluster 2021-03-10T14:53:44.972195+0000 mgr.gibba020.yqfnwy (mgr.34427) 3239 : cluster [DBG] pgmap v1833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:46.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:46 gibba013 bash[30381]: cluster 2021-03-10T14:53:44.972195+0000 mgr.gibba020.yqfnwy (mgr.34427) 3239 : cluster [DBG] pgmap v1833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:46.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:46 gibba020 bash[25448]: cluster 2021-03-10T14:53:44.972195+0000 mgr.gibba020.yqfnwy (mgr.34427) 3239 : cluster [DBG] pgmap v1833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:46.871 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:53:47.095 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:53:47.095 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (60m) 5m ago 65m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:53:47.096 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (65m) 4m ago 65m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:53:47.096 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (60m) 4m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:53:47.096 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (60m) 4m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:53:47.096 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (59m) 5m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:53:47.096 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (59m) 5m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:53:47.097 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (59m) 4m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:53:47.097 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (59m) 5m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:53:47.097 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (65m) 5m ago 65m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:53:47.097 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (65m) 4m ago 65m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:53:47.098 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (58m) 5m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:53:47.098 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (58m) 5m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:53:47.098 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (57m) 5m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:53:47.098 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (57m) 5m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:53:47.098 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (56m) 4m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:53:47.099 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (56m) 4m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:53:47.099 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (55m) 4m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:53:47.099 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (55m) 4m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:53:47.099 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (65m) 4m ago 65m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:53:47.099 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 4m ago 63m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:53:47.343 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:53:47.343 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:53:47.344 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:53:47.344 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:53:47.344 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:53:47.344 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:53:47.344 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:53:47.345 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:53:47.345 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:53:47.345 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:53:47.345 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:53:47.346 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:53:47.346 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:53:47.346 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:53:47.346 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:53:47.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:47 gibba013 bash[29418]: cephadm 2021-03-10T14:53:45.568121+0000 mgr.gibba020.yqfnwy (mgr.34427) 3240 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:53:47.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:47 gibba013 bash[30381]: cephadm 2021-03-10T14:53:45.568121+0000 mgr.gibba020.yqfnwy (mgr.34427) 3240 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:53:47.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:47 gibba020 bash[25448]: cephadm 2021-03-10T14:53:45.568121+0000 mgr.gibba020.yqfnwy (mgr.34427) 3240 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:53:48.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:48 gibba013 bash[29418]: audit 2021-03-10T14:53:46.858581+0000 mgr.gibba020.yqfnwy (mgr.34427) 3241 : audit [DBG] from='client.56215 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:53:48.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:48 gibba013 bash[29418]: cluster 2021-03-10T14:53:46.973601+0000 mgr.gibba020.yqfnwy (mgr.34427) 3242 : cluster [DBG] pgmap v1834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:48.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:48 gibba013 bash[29418]: audit 2021-03-10T14:53:47.082956+0000 mgr.gibba020.yqfnwy (mgr.34427) 3243 : audit [DBG] from='client.46236 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:53:48.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:48 gibba013 bash[29418]: audit 2021-03-10T14:53:47.340723+0000 mon.c (mon.1) 59 : audit [DBG] from='client.? 172.21.2.113:0/1751064100' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:48.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:48 gibba013 bash[30381]: audit 2021-03-10T14:53:46.858581+0000 mgr.gibba020.yqfnwy (mgr.34427) 3241 : audit [DBG] from='client.56215 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:53:48.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:48 gibba013 bash[30381]: cluster 2021-03-10T14:53:46.973601+0000 mgr.gibba020.yqfnwy (mgr.34427) 3242 : cluster [DBG] pgmap v1834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:48.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:48 gibba013 bash[30381]: audit 2021-03-10T14:53:47.082956+0000 mgr.gibba020.yqfnwy (mgr.34427) 3243 : audit [DBG] from='client.46236 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:53:48.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:48 gibba013 bash[30381]: audit 2021-03-10T14:53:47.340723+0000 mon.c (mon.1) 59 : audit [DBG] from='client.? 172.21.2.113:0/1751064100' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:48.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:48 gibba020 bash[25448]: audit 2021-03-10T14:53:46.858581+0000 mgr.gibba020.yqfnwy (mgr.34427) 3241 : audit [DBG] from='client.56215 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:53:48.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:48 gibba020 bash[25448]: cluster 2021-03-10T14:53:46.973601+0000 mgr.gibba020.yqfnwy (mgr.34427) 3242 : cluster [DBG] pgmap v1834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:48.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:48 gibba020 bash[25448]: audit 2021-03-10T14:53:47.082956+0000 mgr.gibba020.yqfnwy (mgr.34427) 3243 : audit [DBG] from='client.46236 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:53:48.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:48 gibba020 bash[25448]: audit 2021-03-10T14:53:47.340723+0000 mon.c (mon.1) 59 : audit [DBG] from='client.? 172.21.2.113:0/1751064100' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:53:50.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:50 gibba013 bash[29418]: cluster 2021-03-10T14:53:48.975150+0000 mgr.gibba020.yqfnwy (mgr.34427) 3244 : cluster [DBG] pgmap v1835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:50.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:50 gibba013 bash[30381]: cluster 2021-03-10T14:53:48.975150+0000 mgr.gibba020.yqfnwy (mgr.34427) 3244 : cluster [DBG] pgmap v1835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:50.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:50 gibba020 bash[25448]: cluster 2021-03-10T14:53:48.975150+0000 mgr.gibba020.yqfnwy (mgr.34427) 3244 : cluster [DBG] pgmap v1835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:52.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:52 gibba013 bash[29418]: cluster 2021-03-10T14:53:50.976762+0000 mgr.gibba020.yqfnwy (mgr.34427) 3245 : cluster [DBG] pgmap v1836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:52.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:52 gibba013 bash[30381]: cluster 2021-03-10T14:53:50.976762+0000 mgr.gibba020.yqfnwy (mgr.34427) 3245 : cluster [DBG] pgmap v1836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:52.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:52 gibba020 bash[25448]: cluster 2021-03-10T14:53:50.976762+0000 mgr.gibba020.yqfnwy (mgr.34427) 3245 : cluster [DBG] pgmap v1836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:54.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:54 gibba013 bash[29418]: cluster 2021-03-10T14:53:52.978020+0000 mgr.gibba020.yqfnwy (mgr.34427) 3246 : cluster [DBG] pgmap v1837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:54.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:54 gibba013 bash[30381]: cluster 2021-03-10T14:53:52.978020+0000 mgr.gibba020.yqfnwy (mgr.34427) 3246 : cluster [DBG] pgmap v1837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:54.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:54 gibba020 bash[25448]: cluster 2021-03-10T14:53:52.978020+0000 mgr.gibba020.yqfnwy (mgr.34427) 3246 : cluster [DBG] pgmap v1837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:56.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:56 gibba013 bash[29418]: cluster 2021-03-10T14:53:54.979742+0000 mgr.gibba020.yqfnwy (mgr.34427) 3247 : cluster [DBG] pgmap v1838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:56.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:56 gibba013 bash[30381]: cluster 2021-03-10T14:53:54.979742+0000 mgr.gibba020.yqfnwy (mgr.34427) 3247 : cluster [DBG] pgmap v1838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:56.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:56 gibba020 bash[25448]: cluster 2021-03-10T14:53:54.979742+0000 mgr.gibba020.yqfnwy (mgr.34427) 3247 : cluster [DBG] pgmap v1838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:57.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:53:57 gibba013 bash[29418]: cluster 2021-03-10T14:53:56.981231+0000 mgr.gibba020.yqfnwy (mgr.34427) 3248 : cluster [DBG] pgmap v1839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:57.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:53:57 gibba013 bash[30381]: cluster 2021-03-10T14:53:56.981231+0000 mgr.gibba020.yqfnwy (mgr.34427) 3248 : cluster [DBG] pgmap v1839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:53:57.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:53:57 gibba020 bash[25448]: cluster 2021-03-10T14:53:56.981231+0000 mgr.gibba020.yqfnwy (mgr.34427) 3248 : cluster [DBG] pgmap v1839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:00.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:00 gibba013 bash[29418]: cluster 2021-03-10T14:53:58.982871+0000 mgr.gibba020.yqfnwy (mgr.34427) 3249 : cluster [DBG] pgmap v1840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:00.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:00 gibba013 bash[30381]: cluster 2021-03-10T14:53:58.982871+0000 mgr.gibba020.yqfnwy (mgr.34427) 3249 : cluster [DBG] pgmap v1840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:00.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:00 gibba020 bash[25448]: cluster 2021-03-10T14:53:58.982871+0000 mgr.gibba020.yqfnwy (mgr.34427) 3249 : cluster [DBG] pgmap v1840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:02.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:02 gibba013 bash[29418]: cephadm 2021-03-10T14:54:00.584199+0000 mgr.gibba020.yqfnwy (mgr.34427) 3250 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:54:02.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:02 gibba013 bash[29418]: cluster 2021-03-10T14:54:00.984669+0000 mgr.gibba020.yqfnwy (mgr.34427) 3251 : cluster [DBG] pgmap v1841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:02.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:02 gibba013 bash[30381]: cephadm 2021-03-10T14:54:00.584199+0000 mgr.gibba020.yqfnwy (mgr.34427) 3250 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:54:02.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:02 gibba013 bash[30381]: cluster 2021-03-10T14:54:00.984669+0000 mgr.gibba020.yqfnwy (mgr.34427) 3251 : cluster [DBG] pgmap v1841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:02.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:02 gibba020 bash[25448]: cephadm 2021-03-10T14:54:00.584199+0000 mgr.gibba020.yqfnwy (mgr.34427) 3250 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:54:02.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:02 gibba020 bash[25448]: cluster 2021-03-10T14:54:00.984669+0000 mgr.gibba020.yqfnwy (mgr.34427) 3251 : cluster [DBG] pgmap v1841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:04.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:04 gibba013 bash[29418]: cluster 2021-03-10T14:54:02.986217+0000 mgr.gibba020.yqfnwy (mgr.34427) 3252 : cluster [DBG] pgmap v1842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:04.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:04 gibba013 bash[30381]: cluster 2021-03-10T14:54:02.986217+0000 mgr.gibba020.yqfnwy (mgr.34427) 3252 : cluster [DBG] pgmap v1842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:04.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:04 gibba020 bash[25448]: cluster 2021-03-10T14:54:02.986217+0000 mgr.gibba020.yqfnwy (mgr.34427) 3252 : cluster [DBG] pgmap v1842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:06.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:06 gibba013 bash[29418]: cluster 2021-03-10T14:54:04.987873+0000 mgr.gibba020.yqfnwy (mgr.34427) 3253 : cluster [DBG] pgmap v1843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:06.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:06 gibba013 bash[30381]: cluster 2021-03-10T14:54:04.987873+0000 mgr.gibba020.yqfnwy (mgr.34427) 3253 : cluster [DBG] pgmap v1843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:06.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:06 gibba020 bash[25448]: cluster 2021-03-10T14:54:04.987873+0000 mgr.gibba020.yqfnwy (mgr.34427) 3253 : cluster [DBG] pgmap v1843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:07.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:07 gibba013 bash[29418]: audit 2021-03-10T14:54:06.286574+0000 mon.a (mon.0) 1530 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:54:07.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:07 gibba013 bash[29418]: audit 2021-03-10T14:54:06.298418+0000 mon.a (mon.0) 1531 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:54:07.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:07 gibba013 bash[29418]: audit 2021-03-10T14:54:06.314483+0000 mon.a (mon.0) 1532 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T14:54:07.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:07 gibba013 bash[29418]: audit 2021-03-10T14:54:06.315195+0000 mon.a (mon.0) 1533 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:54:07.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:07 gibba013 bash[29418]: audit 2021-03-10T14:54:06.315870+0000 mon.a (mon.0) 1534 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:54:07.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:07 gibba013 bash[29418]: audit 2021-03-10T14:54:06.316547+0000 mon.a (mon.0) 1535 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T14:54:07.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:07 gibba013 bash[30381]: audit 2021-03-10T14:54:06.286574+0000 mon.a (mon.0) 1530 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:54:07.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:07 gibba013 bash[30381]: audit 2021-03-10T14:54:06.298418+0000 mon.a (mon.0) 1531 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:54:07.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:07 gibba013 bash[30381]: audit 2021-03-10T14:54:06.314483+0000 mon.a (mon.0) 1532 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T14:54:07.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:07 gibba013 bash[30381]: audit 2021-03-10T14:54:06.315195+0000 mon.a (mon.0) 1533 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:54:07.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:07 gibba013 bash[30381]: audit 2021-03-10T14:54:06.315870+0000 mon.a (mon.0) 1534 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:54:07.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:07 gibba013 bash[30381]: audit 2021-03-10T14:54:06.316547+0000 mon.a (mon.0) 1535 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T14:54:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:07 gibba020 bash[25448]: audit 2021-03-10T14:54:06.286574+0000 mon.a (mon.0) 1530 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:54:07.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:07 gibba020 bash[25448]: audit 2021-03-10T14:54:06.298418+0000 mon.a (mon.0) 1531 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:54:07.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:07 gibba020 bash[25448]: audit 2021-03-10T14:54:06.314483+0000 mon.a (mon.0) 1532 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T14:54:07.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:07 gibba020 bash[25448]: audit 2021-03-10T14:54:06.315195+0000 mon.a (mon.0) 1533 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T14:54:07.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:07 gibba020 bash[25448]: audit 2021-03-10T14:54:06.315870+0000 mon.a (mon.0) 1534 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:54:07.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:07 gibba020 bash[25448]: audit 2021-03-10T14:54:06.316547+0000 mon.a (mon.0) 1535 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T14:54:08.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:08 gibba013 bash[29418]: cluster 2021-03-10T14:54:06.989628+0000 mgr.gibba020.yqfnwy (mgr.34427) 3254 : cluster [DBG] pgmap v1844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:08.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:08 gibba013 bash[30381]: cluster 2021-03-10T14:54:06.989628+0000 mgr.gibba020.yqfnwy (mgr.34427) 3254 : cluster [DBG] pgmap v1844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:08.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:08 gibba020 bash[25448]: cluster 2021-03-10T14:54:06.989628+0000 mgr.gibba020.yqfnwy (mgr.34427) 3254 : cluster [DBG] pgmap v1844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:10.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:10 gibba013 bash[29418]: cluster 2021-03-10T14:54:08.991335+0000 mgr.gibba020.yqfnwy (mgr.34427) 3255 : cluster [DBG] pgmap v1845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:10.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:10 gibba013 bash[30381]: cluster 2021-03-10T14:54:08.991335+0000 mgr.gibba020.yqfnwy (mgr.34427) 3255 : cluster [DBG] pgmap v1845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:10.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:10 gibba020 bash[25448]: cluster 2021-03-10T14:54:08.991335+0000 mgr.gibba020.yqfnwy (mgr.34427) 3255 : cluster [DBG] pgmap v1845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:12.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:12 gibba013 bash[29418]: cluster 2021-03-10T14:54:10.993113+0000 mgr.gibba020.yqfnwy (mgr.34427) 3256 : cluster [DBG] pgmap v1846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:12.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:12 gibba013 bash[30381]: cluster 2021-03-10T14:54:10.993113+0000 mgr.gibba020.yqfnwy (mgr.34427) 3256 : cluster [DBG] pgmap v1846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:12.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:12 gibba020 bash[25448]: cluster 2021-03-10T14:54:10.993113+0000 mgr.gibba020.yqfnwy (mgr.34427) 3256 : cluster [DBG] pgmap v1846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:14.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:14 gibba013 bash[29418]: cluster 2021-03-10T14:54:12.994378+0000 mgr.gibba020.yqfnwy (mgr.34427) 3257 : cluster [DBG] pgmap v1847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:14.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:14 gibba013 bash[30381]: cluster 2021-03-10T14:54:12.994378+0000 mgr.gibba020.yqfnwy (mgr.34427) 3257 : cluster [DBG] pgmap v1847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:14.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:14 gibba020 bash[25448]: cluster 2021-03-10T14:54:12.994378+0000 mgr.gibba020.yqfnwy (mgr.34427) 3257 : cluster [DBG] pgmap v1847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:16.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:16 gibba013 bash[29418]: cluster 2021-03-10T14:54:14.996036+0000 mgr.gibba020.yqfnwy (mgr.34427) 3258 : cluster [DBG] pgmap v1848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:16.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:16 gibba013 bash[30381]: cluster 2021-03-10T14:54:14.996036+0000 mgr.gibba020.yqfnwy (mgr.34427) 3258 : cluster [DBG] pgmap v1848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:16.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:16 gibba020 bash[25448]: cluster 2021-03-10T14:54:14.996036+0000 mgr.gibba020.yqfnwy (mgr.34427) 3258 : cluster [DBG] pgmap v1848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:17.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:17 gibba013 bash[29418]: cephadm 2021-03-10T14:54:15.600233+0000 mgr.gibba020.yqfnwy (mgr.34427) 3259 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:54:17.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:17 gibba013 bash[30381]: cephadm 2021-03-10T14:54:15.600233+0000 mgr.gibba020.yqfnwy (mgr.34427) 3259 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:54:17.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:17 gibba020 bash[25448]: cephadm 2021-03-10T14:54:15.600233+0000 mgr.gibba020.yqfnwy (mgr.34427) 3259 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:54:17.587 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:54:17.811 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:54:17.812 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (60m) 5m ago 66m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:54:17.812 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (65m) 4m ago 65m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:54:17.812 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (61m) 4m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:54:17.812 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (61m) 4m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:54:17.813 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (60m) 5m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:54:17.813 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (60m) 5m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:54:17.813 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (59m) 4m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:54:17.813 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (60m) 5m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:54:17.814 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (66m) 5m ago 66m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:54:17.814 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (66m) 4m ago 66m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:54:17.814 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (59m) 5m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:54:17.814 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (58m) 5m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:54:17.815 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (58m) 5m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:54:17.815 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (57m) 5m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:54:17.815 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (57m) 4m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:54:17.815 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (56m) 4m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:54:17.816 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (56m) 4m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:54:17.816 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (56m) 4m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:54:17.816 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (65m) 4m ago 66m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:54:17.816 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 4m ago 64m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:54:18.058 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:54:18.059 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:54:18.059 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:54:18.059 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:54:18.060 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:54:18.060 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:54:18.060 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:54:18.060 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:54:18.060 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:54:18.061 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:54:18.061 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:54:18.061 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:54:18.062 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:54:18.062 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:54:18.062 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:54:18.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:18 gibba013 bash[29418]: cluster 2021-03-10T14:54:16.997415+0000 mgr.gibba020.yqfnwy (mgr.34427) 3260 : cluster [DBG] pgmap v1849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:18.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:18 gibba013 bash[29418]: audit 2021-03-10T14:54:18.055954+0000 mon.a (mon.0) 1536 : audit [DBG] from='client.? 172.21.2.113:0/526209352' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:18.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:18 gibba013 bash[30381]: cluster 2021-03-10T14:54:16.997415+0000 mgr.gibba020.yqfnwy (mgr.34427) 3260 : cluster [DBG] pgmap v1849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:18.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:18 gibba013 bash[30381]: audit 2021-03-10T14:54:18.055954+0000 mon.a (mon.0) 1536 : audit [DBG] from='client.? 172.21.2.113:0/526209352' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:18.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:18 gibba020 bash[25448]: cluster 2021-03-10T14:54:16.997415+0000 mgr.gibba020.yqfnwy (mgr.34427) 3260 : cluster [DBG] pgmap v1849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:18.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:18 gibba020 bash[25448]: audit 2021-03-10T14:54:18.055954+0000 mon.a (mon.0) 1536 : audit [DBG] from='client.? 172.21.2.113:0/526209352' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:19.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:19 gibba020 bash[25448]: audit 2021-03-10T14:54:17.574776+0000 mgr.gibba020.yqfnwy (mgr.34427) 3261 : audit [DBG] from='client.46248 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:54:19.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:19 gibba020 bash[25448]: audit 2021-03-10T14:54:17.795576+0000 mgr.gibba020.yqfnwy (mgr.34427) 3262 : audit [DBG] from='client.46254 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:54:19.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:19 gibba013 bash[29418]: audit 2021-03-10T14:54:17.574776+0000 mgr.gibba020.yqfnwy (mgr.34427) 3261 : audit [DBG] from='client.46248 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:54:19.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:19 gibba013 bash[29418]: audit 2021-03-10T14:54:17.795576+0000 mgr.gibba020.yqfnwy (mgr.34427) 3262 : audit [DBG] from='client.46254 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:54:19.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:19 gibba013 bash[30381]: audit 2021-03-10T14:54:17.574776+0000 mgr.gibba020.yqfnwy (mgr.34427) 3261 : audit [DBG] from='client.46248 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:54:19.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:19 gibba013 bash[30381]: audit 2021-03-10T14:54:17.795576+0000 mgr.gibba020.yqfnwy (mgr.34427) 3262 : audit [DBG] from='client.46254 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:54:20.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:20 gibba020 bash[25448]: cluster 2021-03-10T14:54:18.998788+0000 mgr.gibba020.yqfnwy (mgr.34427) 3263 : cluster [DBG] pgmap v1850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:20.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:20 gibba013 bash[29418]: cluster 2021-03-10T14:54:18.998788+0000 mgr.gibba020.yqfnwy (mgr.34427) 3263 : cluster [DBG] pgmap v1850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:20.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:20 gibba013 bash[30381]: cluster 2021-03-10T14:54:18.998788+0000 mgr.gibba020.yqfnwy (mgr.34427) 3263 : cluster [DBG] pgmap v1850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:22.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:22 gibba020 bash[25448]: cluster 2021-03-10T14:54:21.000569+0000 mgr.gibba020.yqfnwy (mgr.34427) 3264 : cluster [DBG] pgmap v1851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:22.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:22 gibba013 bash[29418]: cluster 2021-03-10T14:54:21.000569+0000 mgr.gibba020.yqfnwy (mgr.34427) 3264 : cluster [DBG] pgmap v1851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:22.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:22 gibba013 bash[30381]: cluster 2021-03-10T14:54:21.000569+0000 mgr.gibba020.yqfnwy (mgr.34427) 3264 : cluster [DBG] pgmap v1851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:24.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:24 gibba020 bash[25448]: cluster 2021-03-10T14:54:23.001810+0000 mgr.gibba020.yqfnwy (mgr.34427) 3265 : cluster [DBG] pgmap v1852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:24.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:24 gibba013 bash[29418]: cluster 2021-03-10T14:54:23.001810+0000 mgr.gibba020.yqfnwy (mgr.34427) 3265 : cluster [DBG] pgmap v1852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:24.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:24 gibba013 bash[30381]: cluster 2021-03-10T14:54:23.001810+0000 mgr.gibba020.yqfnwy (mgr.34427) 3265 : cluster [DBG] pgmap v1852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:26.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:26 gibba020 bash[25448]: cluster 2021-03-10T14:54:25.003605+0000 mgr.gibba020.yqfnwy (mgr.34427) 3266 : cluster [DBG] pgmap v1853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:26.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:26 gibba013 bash[29418]: cluster 2021-03-10T14:54:25.003605+0000 mgr.gibba020.yqfnwy (mgr.34427) 3266 : cluster [DBG] pgmap v1853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:26.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:26 gibba013 bash[30381]: cluster 2021-03-10T14:54:25.003605+0000 mgr.gibba020.yqfnwy (mgr.34427) 3266 : cluster [DBG] pgmap v1853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:27.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:27 gibba013 bash[29418]: cluster 2021-03-10T14:54:27.005011+0000 mgr.gibba020.yqfnwy (mgr.34427) 3267 : cluster [DBG] pgmap v1854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:27.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:27 gibba013 bash[30381]: cluster 2021-03-10T14:54:27.005011+0000 mgr.gibba020.yqfnwy (mgr.34427) 3267 : cluster [DBG] pgmap v1854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:27.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:27 gibba020 bash[25448]: cluster 2021-03-10T14:54:27.005011+0000 mgr.gibba020.yqfnwy (mgr.34427) 3267 : cluster [DBG] pgmap v1854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:30.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:30 gibba013 bash[29418]: cluster 2021-03-10T14:54:29.006452+0000 mgr.gibba020.yqfnwy (mgr.34427) 3268 : cluster [DBG] pgmap v1855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:30.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:30 gibba013 bash[30381]: cluster 2021-03-10T14:54:29.006452+0000 mgr.gibba020.yqfnwy (mgr.34427) 3268 : cluster [DBG] pgmap v1855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:30.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:30 gibba020 bash[25448]: cluster 2021-03-10T14:54:29.006452+0000 mgr.gibba020.yqfnwy (mgr.34427) 3268 : cluster [DBG] pgmap v1855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:31.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:31 gibba020 bash[25448]: audit 2021-03-10T14:54:30.618303+0000 mon.a (mon.0) 1537 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:54:31.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:31 gibba020 bash[25448]: audit 2021-03-10T14:54:30.843705+0000 mon.a (mon.0) 1538 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:54:31.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:31 gibba020 bash[25448]: audit 2021-03-10T14:54:30.847177+0000 mon.a (mon.0) 1539 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:54:31.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:31 gibba020 bash[25448]: audit 2021-03-10T14:54:30.849083+0000 mon.a (mon.0) 1540 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:31.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:31 gibba020 bash[25448]: audit 2021-03-10T14:54:30.850770+0000 mon.a (mon.0) 1541 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:31.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:31 gibba020 bash[25448]: audit 2021-03-10T14:54:30.852332+0000 mon.a (mon.0) 1542 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:31.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:31 gibba020 bash[25448]: audit 2021-03-10T14:54:30.855554+0000 mon.a (mon.0) 1543 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:31.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:31 gibba020 bash[25448]: audit 2021-03-10T14:54:30.857213+0000 mon.a (mon.0) 1544 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:31.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:31 gibba013 bash[29418]: audit 2021-03-10T14:54:30.618303+0000 mon.a (mon.0) 1537 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:54:31.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:31 gibba013 bash[29418]: audit 2021-03-10T14:54:30.843705+0000 mon.a (mon.0) 1538 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:54:31.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:31 gibba013 bash[29418]: audit 2021-03-10T14:54:30.847177+0000 mon.a (mon.0) 1539 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:54:31.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:31 gibba013 bash[29418]: audit 2021-03-10T14:54:30.849083+0000 mon.a (mon.0) 1540 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:31.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:31 gibba013 bash[29418]: audit 2021-03-10T14:54:30.850770+0000 mon.a (mon.0) 1541 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:31.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:31 gibba013 bash[29418]: audit 2021-03-10T14:54:30.852332+0000 mon.a (mon.0) 1542 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:31.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:31 gibba013 bash[29418]: audit 2021-03-10T14:54:30.855554+0000 mon.a (mon.0) 1543 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:31.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:31 gibba013 bash[29418]: audit 2021-03-10T14:54:30.857213+0000 mon.a (mon.0) 1544 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:31.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:31 gibba013 bash[30381]: audit 2021-03-10T14:54:30.618303+0000 mon.a (mon.0) 1537 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:54:31.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:31 gibba013 bash[30381]: audit 2021-03-10T14:54:30.843705+0000 mon.a (mon.0) 1538 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:54:31.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:31 gibba013 bash[30381]: audit 2021-03-10T14:54:30.847177+0000 mon.a (mon.0) 1539 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:54:31.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:31 gibba013 bash[30381]: audit 2021-03-10T14:54:30.849083+0000 mon.a (mon.0) 1540 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:31.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:31 gibba013 bash[30381]: audit 2021-03-10T14:54:30.850770+0000 mon.a (mon.0) 1541 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:31.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:31 gibba013 bash[30381]: audit 2021-03-10T14:54:30.852332+0000 mon.a (mon.0) 1542 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:31.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:31 gibba013 bash[30381]: audit 2021-03-10T14:54:30.855554+0000 mon.a (mon.0) 1543 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:31.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:31 gibba013 bash[30381]: audit 2021-03-10T14:54:30.857213+0000 mon.a (mon.0) 1544 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:32.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:32 gibba013 bash[29418]: cephadm 2021-03-10T14:54:30.622737+0000 mgr.gibba020.yqfnwy (mgr.34427) 3269 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:54:32.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:32 gibba013 bash[29418]: cephadm 2021-03-10T14:54:30.624592+0000 mgr.gibba020.yqfnwy (mgr.34427) 3270 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:54:32.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:32 gibba013 bash[29418]: cephadm 2021-03-10T14:54:30.845165+0000 mgr.gibba020.yqfnwy (mgr.34427) 3271 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:54:32.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:32 gibba013 bash[29418]: cephadm 2021-03-10T14:54:30.847450+0000 mgr.gibba020.yqfnwy (mgr.34427) 3272 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:54:32.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:32 gibba013 bash[29418]: cephadm 2021-03-10T14:54:30.849116+0000 mgr.gibba020.yqfnwy (mgr.34427) 3273 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:54:32.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:32 gibba013 bash[29418]: cephadm 2021-03-10T14:54:30.849151+0000 mgr.gibba020.yqfnwy (mgr.34427) 3274 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:54:32.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:32 gibba013 bash[29418]: cephadm 2021-03-10T14:54:30.850736+0000 mgr.gibba020.yqfnwy (mgr.34427) 3275 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:54:32.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:32 gibba013 bash[29418]: cephadm 2021-03-10T14:54:30.850779+0000 mgr.gibba020.yqfnwy (mgr.34427) 3276 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:54:32.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:32 gibba013 bash[29418]: cephadm 2021-03-10T14:54:30.852203+0000 mgr.gibba020.yqfnwy (mgr.34427) 3277 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:54:32.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:32 gibba013 bash[29418]: cephadm 2021-03-10T14:54:30.853859+0000 mgr.gibba020.yqfnwy (mgr.34427) 3278 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:54:32.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:32 gibba013 bash[29418]: cephadm 2021-03-10T14:54:30.853897+0000 mgr.gibba020.yqfnwy (mgr.34427) 3279 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:54:32.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:32 gibba013 bash[29418]: cephadm 2021-03-10T14:54:30.855356+0000 mgr.gibba020.yqfnwy (mgr.34427) 3280 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:54:32.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:32 gibba013 bash[29418]: cephadm 2021-03-10T14:54:30.855680+0000 mgr.gibba020.yqfnwy (mgr.34427) 3281 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:54:32.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:32 gibba013 bash[29418]: cephadm 2021-03-10T14:54:30.857145+0000 mgr.gibba020.yqfnwy (mgr.34427) 3282 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:54:32.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:32 gibba013 bash[29418]: cephadm 2021-03-10T14:54:30.857184+0000 mgr.gibba020.yqfnwy (mgr.34427) 3283 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:54:32.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:32 gibba013 bash[29418]: cephadm 2021-03-10T14:54:30.857345+0000 mgr.gibba020.yqfnwy (mgr.34427) 3284 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:54:32.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:32 gibba013 bash[29418]: cluster 2021-03-10T14:54:31.008225+0000 mgr.gibba020.yqfnwy (mgr.34427) 3285 : cluster [DBG] pgmap v1856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:32.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:32 gibba013 bash[30381]: cephadm 2021-03-10T14:54:30.622737+0000 mgr.gibba020.yqfnwy (mgr.34427) 3269 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:54:32.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:32 gibba013 bash[30381]: cephadm 2021-03-10T14:54:30.624592+0000 mgr.gibba020.yqfnwy (mgr.34427) 3270 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:54:32.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:32 gibba013 bash[30381]: cephadm 2021-03-10T14:54:30.845165+0000 mgr.gibba020.yqfnwy (mgr.34427) 3271 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:54:32.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:32 gibba013 bash[30381]: cephadm 2021-03-10T14:54:30.847450+0000 mgr.gibba020.yqfnwy (mgr.34427) 3272 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:54:32.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:32 gibba013 bash[30381]: cephadm 2021-03-10T14:54:30.849116+0000 mgr.gibba020.yqfnwy (mgr.34427) 3273 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:54:32.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:32 gibba013 bash[30381]: cephadm 2021-03-10T14:54:30.849151+0000 mgr.gibba020.yqfnwy (mgr.34427) 3274 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:54:32.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:32 gibba013 bash[30381]: cephadm 2021-03-10T14:54:30.850736+0000 mgr.gibba020.yqfnwy (mgr.34427) 3275 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:54:32.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:32 gibba013 bash[30381]: cephadm 2021-03-10T14:54:30.850779+0000 mgr.gibba020.yqfnwy (mgr.34427) 3276 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:54:32.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:32 gibba013 bash[30381]: cephadm 2021-03-10T14:54:30.852203+0000 mgr.gibba020.yqfnwy (mgr.34427) 3277 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:54:32.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:32 gibba013 bash[30381]: cephadm 2021-03-10T14:54:30.853859+0000 mgr.gibba020.yqfnwy (mgr.34427) 3278 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:54:32.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:32 gibba013 bash[30381]: cephadm 2021-03-10T14:54:30.853897+0000 mgr.gibba020.yqfnwy (mgr.34427) 3279 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:54:32.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:32 gibba013 bash[30381]: cephadm 2021-03-10T14:54:30.855356+0000 mgr.gibba020.yqfnwy (mgr.34427) 3280 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:54:32.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:32 gibba013 bash[30381]: cephadm 2021-03-10T14:54:30.855680+0000 mgr.gibba020.yqfnwy (mgr.34427) 3281 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:54:32.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:32 gibba013 bash[30381]: cephadm 2021-03-10T14:54:30.857145+0000 mgr.gibba020.yqfnwy (mgr.34427) 3282 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:54:32.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:32 gibba013 bash[30381]: cephadm 2021-03-10T14:54:30.857184+0000 mgr.gibba020.yqfnwy (mgr.34427) 3283 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:54:32.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:32 gibba013 bash[30381]: cephadm 2021-03-10T14:54:30.857345+0000 mgr.gibba020.yqfnwy (mgr.34427) 3284 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:54:32.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:32 gibba013 bash[30381]: cluster 2021-03-10T14:54:31.008225+0000 mgr.gibba020.yqfnwy (mgr.34427) 3285 : cluster [DBG] pgmap v1856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:32.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:32 gibba020 bash[25448]: cephadm 2021-03-10T14:54:30.622737+0000 mgr.gibba020.yqfnwy (mgr.34427) 3269 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:54:32.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:32 gibba020 bash[25448]: cephadm 2021-03-10T14:54:30.624592+0000 mgr.gibba020.yqfnwy (mgr.34427) 3270 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:54:32.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:32 gibba020 bash[25448]: cephadm 2021-03-10T14:54:30.845165+0000 mgr.gibba020.yqfnwy (mgr.34427) 3271 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:54:32.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:32 gibba020 bash[25448]: cephadm 2021-03-10T14:54:30.847450+0000 mgr.gibba020.yqfnwy (mgr.34427) 3272 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:54:32.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:32 gibba020 bash[25448]: cephadm 2021-03-10T14:54:30.849116+0000 mgr.gibba020.yqfnwy (mgr.34427) 3273 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:54:32.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:32 gibba020 bash[25448]: cephadm 2021-03-10T14:54:30.849151+0000 mgr.gibba020.yqfnwy (mgr.34427) 3274 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:54:32.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:32 gibba020 bash[25448]: cephadm 2021-03-10T14:54:30.850736+0000 mgr.gibba020.yqfnwy (mgr.34427) 3275 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:54:32.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:32 gibba020 bash[25448]: cephadm 2021-03-10T14:54:30.850779+0000 mgr.gibba020.yqfnwy (mgr.34427) 3276 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:54:32.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:32 gibba020 bash[25448]: cephadm 2021-03-10T14:54:30.852203+0000 mgr.gibba020.yqfnwy (mgr.34427) 3277 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:54:32.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:32 gibba020 bash[25448]: cephadm 2021-03-10T14:54:30.853859+0000 mgr.gibba020.yqfnwy (mgr.34427) 3278 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:54:32.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:32 gibba020 bash[25448]: cephadm 2021-03-10T14:54:30.853897+0000 mgr.gibba020.yqfnwy (mgr.34427) 3279 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:54:32.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:32 gibba020 bash[25448]: cephadm 2021-03-10T14:54:30.855356+0000 mgr.gibba020.yqfnwy (mgr.34427) 3280 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:54:32.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:32 gibba020 bash[25448]: cephadm 2021-03-10T14:54:30.855680+0000 mgr.gibba020.yqfnwy (mgr.34427) 3281 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:54:32.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:32 gibba020 bash[25448]: cephadm 2021-03-10T14:54:30.857145+0000 mgr.gibba020.yqfnwy (mgr.34427) 3282 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:54:32.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:32 gibba020 bash[25448]: cephadm 2021-03-10T14:54:30.857184+0000 mgr.gibba020.yqfnwy (mgr.34427) 3283 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:54:32.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:32 gibba020 bash[25448]: cephadm 2021-03-10T14:54:30.857345+0000 mgr.gibba020.yqfnwy (mgr.34427) 3284 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:54:32.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:32 gibba020 bash[25448]: cluster 2021-03-10T14:54:31.008225+0000 mgr.gibba020.yqfnwy (mgr.34427) 3285 : cluster [DBG] pgmap v1856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:34.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:34 gibba013 bash[29418]: cluster 2021-03-10T14:54:33.009374+0000 mgr.gibba020.yqfnwy (mgr.34427) 3286 : cluster [DBG] pgmap v1857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:34.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:34 gibba013 bash[30381]: cluster 2021-03-10T14:54:33.009374+0000 mgr.gibba020.yqfnwy (mgr.34427) 3286 : cluster [DBG] pgmap v1857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:34.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:34 gibba020 bash[25448]: cluster 2021-03-10T14:54:33.009374+0000 mgr.gibba020.yqfnwy (mgr.34427) 3286 : cluster [DBG] pgmap v1857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:36.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:36 gibba013 bash[29418]: cluster 2021-03-10T14:54:35.011013+0000 mgr.gibba020.yqfnwy (mgr.34427) 3287 : cluster [DBG] pgmap v1858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:36.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:36 gibba013 bash[30381]: cluster 2021-03-10T14:54:35.011013+0000 mgr.gibba020.yqfnwy (mgr.34427) 3287 : cluster [DBG] pgmap v1858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:36.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:36 gibba020 bash[25448]: cluster 2021-03-10T14:54:35.011013+0000 mgr.gibba020.yqfnwy (mgr.34427) 3287 : cluster [DBG] pgmap v1858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:37.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:37 gibba013 bash[29418]: cluster 2021-03-10T14:54:37.012426+0000 mgr.gibba020.yqfnwy (mgr.34427) 3288 : cluster [DBG] pgmap v1859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:37.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:37 gibba013 bash[30381]: cluster 2021-03-10T14:54:37.012426+0000 mgr.gibba020.yqfnwy (mgr.34427) 3288 : cluster [DBG] pgmap v1859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:37.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:37 gibba020 bash[25448]: cluster 2021-03-10T14:54:37.012426+0000 mgr.gibba020.yqfnwy (mgr.34427) 3288 : cluster [DBG] pgmap v1859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:40.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:40 gibba013 bash[29418]: cluster 2021-03-10T14:54:39.013945+0000 mgr.gibba020.yqfnwy (mgr.34427) 3289 : cluster [DBG] pgmap v1860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:40.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:40 gibba013 bash[30381]: cluster 2021-03-10T14:54:39.013945+0000 mgr.gibba020.yqfnwy (mgr.34427) 3289 : cluster [DBG] pgmap v1860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:40.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:40 gibba020 bash[25448]: cluster 2021-03-10T14:54:39.013945+0000 mgr.gibba020.yqfnwy (mgr.34427) 3289 : cluster [DBG] pgmap v1860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:42.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:42 gibba013 bash[29418]: cluster 2021-03-10T14:54:41.015681+0000 mgr.gibba020.yqfnwy (mgr.34427) 3290 : cluster [DBG] pgmap v1861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:42.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:42 gibba013 bash[30381]: cluster 2021-03-10T14:54:41.015681+0000 mgr.gibba020.yqfnwy (mgr.34427) 3290 : cluster [DBG] pgmap v1861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:42.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:42 gibba020 bash[25448]: cluster 2021-03-10T14:54:41.015681+0000 mgr.gibba020.yqfnwy (mgr.34427) 3290 : cluster [DBG] pgmap v1861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:44.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:44 gibba013 bash[29418]: cluster 2021-03-10T14:54:43.017068+0000 mgr.gibba020.yqfnwy (mgr.34427) 3291 : cluster [DBG] pgmap v1862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:44.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:44 gibba013 bash[30381]: cluster 2021-03-10T14:54:43.017068+0000 mgr.gibba020.yqfnwy (mgr.34427) 3291 : cluster [DBG] pgmap v1862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:44.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:44 gibba020 bash[25448]: cluster 2021-03-10T14:54:43.017068+0000 mgr.gibba020.yqfnwy (mgr.34427) 3291 : cluster [DBG] pgmap v1862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:46.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:46 gibba020 bash[25448]: cluster 2021-03-10T14:54:45.018824+0000 mgr.gibba020.yqfnwy (mgr.34427) 3292 : cluster [DBG] pgmap v1863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:46.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:46 gibba013 bash[29418]: cluster 2021-03-10T14:54:45.018824+0000 mgr.gibba020.yqfnwy (mgr.34427) 3292 : cluster [DBG] pgmap v1863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:46.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:46 gibba013 bash[30381]: cluster 2021-03-10T14:54:45.018824+0000 mgr.gibba020.yqfnwy (mgr.34427) 3292 : cluster [DBG] pgmap v1863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:47.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:47 gibba013 bash[29418]: cephadm 2021-03-10T14:54:45.873131+0000 mgr.gibba020.yqfnwy (mgr.34427) 3293 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:54:47.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:47 gibba013 bash[30381]: cephadm 2021-03-10T14:54:45.873131+0000 mgr.gibba020.yqfnwy (mgr.34427) 3293 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:54:47.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:47 gibba020 bash[25448]: cephadm 2021-03-10T14:54:45.873131+0000 mgr.gibba020.yqfnwy (mgr.34427) 3293 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:54:48.303 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:54:48.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:48 gibba013 bash[29418]: cluster 2021-03-10T14:54:47.020354+0000 mgr.gibba020.yqfnwy (mgr.34427) 3294 : cluster [DBG] pgmap v1864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:48.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:48 gibba013 bash[30381]: cluster 2021-03-10T14:54:47.020354+0000 mgr.gibba020.yqfnwy (mgr.34427) 3294 : cluster [DBG] pgmap v1864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:48.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:48 gibba020 bash[25448]: cluster 2021-03-10T14:54:47.020354+0000 mgr.gibba020.yqfnwy (mgr.34427) 3294 : cluster [DBG] pgmap v1864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:48.530 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:54:48.531 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (61m) 6m ago 66m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:54:48.531 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (66m) 5m ago 66m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:54:48.531 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (61m) 5m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:54:48.531 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (62m) 5m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:54:48.532 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (60m) 6m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:54:48.532 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (60m) 6m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:54:48.532 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (60m) 5m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:54:48.532 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (60m) 6m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:54:48.532 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (66m) 6m ago 66m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:54:48.533 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (66m) 5m ago 66m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:54:48.533 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (59m) 6m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:54:48.533 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (59m) 6m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:54:48.533 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (58m) 6m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:54:48.533 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (58m) 6m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:54:48.534 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (57m) 5m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:54:48.534 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (57m) 5m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:54:48.534 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (57m) 5m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:54:48.534 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (56m) 5m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:54:48.535 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (66m) 5m ago 66m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:54:48.535 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 5m ago 64m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:54:48.780 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:54:48.780 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:54:48.781 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:54:48.781 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:54:48.781 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:54:48.781 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:54:48.782 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:54:48.782 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:54:48.782 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:54:48.782 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:54:48.782 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:54:48.783 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:54:48.783 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:54:48.783 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:54:48.783 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:54:49.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:49 gibba013 bash[29418]: audit 2021-03-10T14:54:48.290740+0000 mgr.gibba020.yqfnwy (mgr.34427) 3295 : audit [DBG] from='client.56251 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:54:49.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:49 gibba013 bash[29418]: audit 2021-03-10T14:54:48.777846+0000 mon.c (mon.1) 60 : audit [DBG] from='client.? 172.21.2.113:0/1332832196' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:49.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:49 gibba013 bash[30381]: audit 2021-03-10T14:54:48.290740+0000 mgr.gibba020.yqfnwy (mgr.34427) 3295 : audit [DBG] from='client.56251 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:54:49.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:49 gibba013 bash[30381]: audit 2021-03-10T14:54:48.777846+0000 mon.c (mon.1) 60 : audit [DBG] from='client.? 172.21.2.113:0/1332832196' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:49.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:49 gibba020 bash[25448]: audit 2021-03-10T14:54:48.290740+0000 mgr.gibba020.yqfnwy (mgr.34427) 3295 : audit [DBG] from='client.56251 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:54:49.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:49 gibba020 bash[25448]: audit 2021-03-10T14:54:48.777846+0000 mon.c (mon.1) 60 : audit [DBG] from='client.? 172.21.2.113:0/1332832196' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:54:50.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:50 gibba013 bash[30381]: audit 2021-03-10T14:54:48.514491+0000 mgr.gibba020.yqfnwy (mgr.34427) 3296 : audit [DBG] from='client.56257 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:54:50.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:50 gibba013 bash[30381]: cluster 2021-03-10T14:54:49.021790+0000 mgr.gibba020.yqfnwy (mgr.34427) 3297 : cluster [DBG] pgmap v1865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:50.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:50 gibba013 bash[29418]: audit 2021-03-10T14:54:48.514491+0000 mgr.gibba020.yqfnwy (mgr.34427) 3296 : audit [DBG] from='client.56257 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:54:50.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:50 gibba013 bash[29418]: cluster 2021-03-10T14:54:49.021790+0000 mgr.gibba020.yqfnwy (mgr.34427) 3297 : cluster [DBG] pgmap v1865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:50.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:50 gibba020 bash[25448]: audit 2021-03-10T14:54:48.514491+0000 mgr.gibba020.yqfnwy (mgr.34427) 3296 : audit [DBG] from='client.56257 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:54:50.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:50 gibba020 bash[25448]: cluster 2021-03-10T14:54:49.021790+0000 mgr.gibba020.yqfnwy (mgr.34427) 3297 : cluster [DBG] pgmap v1865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:52.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:52 gibba020 bash[25448]: cluster 2021-03-10T14:54:51.023531+0000 mgr.gibba020.yqfnwy (mgr.34427) 3298 : cluster [DBG] pgmap v1866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:52.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:52 gibba013 bash[29418]: cluster 2021-03-10T14:54:51.023531+0000 mgr.gibba020.yqfnwy (mgr.34427) 3298 : cluster [DBG] pgmap v1866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:52.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:52 gibba013 bash[30381]: cluster 2021-03-10T14:54:51.023531+0000 mgr.gibba020.yqfnwy (mgr.34427) 3298 : cluster [DBG] pgmap v1866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:54.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:54 gibba020 bash[25448]: cluster 2021-03-10T14:54:53.024839+0000 mgr.gibba020.yqfnwy (mgr.34427) 3299 : cluster [DBG] pgmap v1867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:54.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:54 gibba013 bash[29418]: cluster 2021-03-10T14:54:53.024839+0000 mgr.gibba020.yqfnwy (mgr.34427) 3299 : cluster [DBG] pgmap v1867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:54.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:54 gibba013 bash[30381]: cluster 2021-03-10T14:54:53.024839+0000 mgr.gibba020.yqfnwy (mgr.34427) 3299 : cluster [DBG] pgmap v1867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:56.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:56 gibba020 bash[25448]: cluster 2021-03-10T14:54:55.026841+0000 mgr.gibba020.yqfnwy (mgr.34427) 3300 : cluster [DBG] pgmap v1868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:56.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:56 gibba013 bash[29418]: cluster 2021-03-10T14:54:55.026841+0000 mgr.gibba020.yqfnwy (mgr.34427) 3300 : cluster [DBG] pgmap v1868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:56.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:56 gibba013 bash[30381]: cluster 2021-03-10T14:54:55.026841+0000 mgr.gibba020.yqfnwy (mgr.34427) 3300 : cluster [DBG] pgmap v1868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:57.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:54:57 gibba013 bash[29418]: cluster 2021-03-10T14:54:57.028318+0000 mgr.gibba020.yqfnwy (mgr.34427) 3301 : cluster [DBG] pgmap v1869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:57.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:54:57 gibba013 bash[30381]: cluster 2021-03-10T14:54:57.028318+0000 mgr.gibba020.yqfnwy (mgr.34427) 3301 : cluster [DBG] pgmap v1869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:54:57.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:54:57 gibba020 bash[25448]: cluster 2021-03-10T14:54:57.028318+0000 mgr.gibba020.yqfnwy (mgr.34427) 3301 : cluster [DBG] pgmap v1869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:00.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:00 gibba013 bash[29418]: cluster 2021-03-10T14:54:59.029715+0000 mgr.gibba020.yqfnwy (mgr.34427) 3302 : cluster [DBG] pgmap v1870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:00.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:00 gibba013 bash[30381]: cluster 2021-03-10T14:54:59.029715+0000 mgr.gibba020.yqfnwy (mgr.34427) 3302 : cluster [DBG] pgmap v1870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:00.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:00 gibba020 bash[25448]: cluster 2021-03-10T14:54:59.029715+0000 mgr.gibba020.yqfnwy (mgr.34427) 3302 : cluster [DBG] pgmap v1870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:02.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:02 gibba013 bash[29418]: cephadm 2021-03-10T14:55:00.888554+0000 mgr.gibba020.yqfnwy (mgr.34427) 3303 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:55:02.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:02 gibba013 bash[29418]: cluster 2021-03-10T14:55:01.031464+0000 mgr.gibba020.yqfnwy (mgr.34427) 3304 : cluster [DBG] pgmap v1871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:02.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:02 gibba013 bash[30381]: cephadm 2021-03-10T14:55:00.888554+0000 mgr.gibba020.yqfnwy (mgr.34427) 3303 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:55:02.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:02 gibba013 bash[30381]: cluster 2021-03-10T14:55:01.031464+0000 mgr.gibba020.yqfnwy (mgr.34427) 3304 : cluster [DBG] pgmap v1871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:02.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:02 gibba020 bash[25448]: cephadm 2021-03-10T14:55:00.888554+0000 mgr.gibba020.yqfnwy (mgr.34427) 3303 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:55:02.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:02 gibba020 bash[25448]: cluster 2021-03-10T14:55:01.031464+0000 mgr.gibba020.yqfnwy (mgr.34427) 3304 : cluster [DBG] pgmap v1871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:04.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:04 gibba013 bash[29418]: cluster 2021-03-10T14:55:03.032811+0000 mgr.gibba020.yqfnwy (mgr.34427) 3305 : cluster [DBG] pgmap v1872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:04.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:04 gibba013 bash[30381]: cluster 2021-03-10T14:55:03.032811+0000 mgr.gibba020.yqfnwy (mgr.34427) 3305 : cluster [DBG] pgmap v1872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:04.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:04 gibba020 bash[25448]: cluster 2021-03-10T14:55:03.032811+0000 mgr.gibba020.yqfnwy (mgr.34427) 3305 : cluster [DBG] pgmap v1872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:06.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:06 gibba013 bash[30381]: cluster 2021-03-10T14:55:05.034741+0000 mgr.gibba020.yqfnwy (mgr.34427) 3306 : cluster [DBG] pgmap v1873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:06.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:06 gibba013 bash[29418]: cluster 2021-03-10T14:55:05.034741+0000 mgr.gibba020.yqfnwy (mgr.34427) 3306 : cluster [DBG] pgmap v1873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:06.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:06 gibba020 bash[25448]: cluster 2021-03-10T14:55:05.034741+0000 mgr.gibba020.yqfnwy (mgr.34427) 3306 : cluster [DBG] pgmap v1873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:07.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:07 gibba013 bash[29418]: audit 2021-03-10T14:55:06.291738+0000 mon.a (mon.0) 1545 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:55:07.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:07 gibba013 bash[29418]: audit 2021-03-10T14:55:06.305251+0000 mon.a (mon.0) 1546 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:55:07.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:07 gibba013 bash[29418]: audit 2021-03-10T14:55:06.326259+0000 mon.a (mon.0) 1547 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:55:07.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:07 gibba013 bash[29418]: audit 2021-03-10T14:55:06.327057+0000 mon.a (mon.0) 1548 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T14:55:07.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:07 gibba013 bash[29418]: audit 2021-03-10T14:55:06.327798+0000 mon.a (mon.0) 1549 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:55:07.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:07 gibba013 bash[29418]: audit 2021-03-10T14:55:06.328541+0000 mon.a (mon.0) 1550 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:55:07.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:07 gibba013 bash[30381]: audit 2021-03-10T14:55:06.291738+0000 mon.a (mon.0) 1545 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:55:07.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:07 gibba013 bash[30381]: audit 2021-03-10T14:55:06.305251+0000 mon.a (mon.0) 1546 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:55:07.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:07 gibba013 bash[30381]: audit 2021-03-10T14:55:06.326259+0000 mon.a (mon.0) 1547 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:55:07.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:07 gibba013 bash[30381]: audit 2021-03-10T14:55:06.327057+0000 mon.a (mon.0) 1548 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T14:55:07.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:07 gibba013 bash[30381]: audit 2021-03-10T14:55:06.327798+0000 mon.a (mon.0) 1549 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:55:07.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:07 gibba013 bash[30381]: audit 2021-03-10T14:55:06.328541+0000 mon.a (mon.0) 1550 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:55:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:07 gibba020 bash[25448]: audit 2021-03-10T14:55:06.291738+0000 mon.a (mon.0) 1545 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:55:07.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:07 gibba020 bash[25448]: audit 2021-03-10T14:55:06.305251+0000 mon.a (mon.0) 1546 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:55:07.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:07 gibba020 bash[25448]: audit 2021-03-10T14:55:06.326259+0000 mon.a (mon.0) 1547 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:55:07.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:07 gibba020 bash[25448]: audit 2021-03-10T14:55:06.327057+0000 mon.a (mon.0) 1548 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T14:55:07.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:07 gibba020 bash[25448]: audit 2021-03-10T14:55:06.327798+0000 mon.a (mon.0) 1549 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T14:55:07.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:07 gibba020 bash[25448]: audit 2021-03-10T14:55:06.328541+0000 mon.a (mon.0) 1550 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T14:55:08.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:08 gibba013 bash[29418]: cluster 2021-03-10T14:55:07.036376+0000 mgr.gibba020.yqfnwy (mgr.34427) 3307 : cluster [DBG] pgmap v1874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:08.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:08 gibba013 bash[30381]: cluster 2021-03-10T14:55:07.036376+0000 mgr.gibba020.yqfnwy (mgr.34427) 3307 : cluster [DBG] pgmap v1874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:08.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:08 gibba020 bash[25448]: cluster 2021-03-10T14:55:07.036376+0000 mgr.gibba020.yqfnwy (mgr.34427) 3307 : cluster [DBG] pgmap v1874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:10.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:10 gibba020 bash[25448]: cluster 2021-03-10T14:55:09.037846+0000 mgr.gibba020.yqfnwy (mgr.34427) 3308 : cluster [DBG] pgmap v1875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:10.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:10 gibba013 bash[29418]: cluster 2021-03-10T14:55:09.037846+0000 mgr.gibba020.yqfnwy (mgr.34427) 3308 : cluster [DBG] pgmap v1875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:10.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:10 gibba013 bash[30381]: cluster 2021-03-10T14:55:09.037846+0000 mgr.gibba020.yqfnwy (mgr.34427) 3308 : cluster [DBG] pgmap v1875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:12.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:12 gibba020 bash[25448]: cluster 2021-03-10T14:55:11.039783+0000 mgr.gibba020.yqfnwy (mgr.34427) 3309 : cluster [DBG] pgmap v1876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:12.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:12 gibba013 bash[29418]: cluster 2021-03-10T14:55:11.039783+0000 mgr.gibba020.yqfnwy (mgr.34427) 3309 : cluster [DBG] pgmap v1876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:12.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:12 gibba013 bash[30381]: cluster 2021-03-10T14:55:11.039783+0000 mgr.gibba020.yqfnwy (mgr.34427) 3309 : cluster [DBG] pgmap v1876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:14.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:14 gibba020 bash[25448]: cluster 2021-03-10T14:55:13.040968+0000 mgr.gibba020.yqfnwy (mgr.34427) 3310 : cluster [DBG] pgmap v1877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:14.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:14 gibba013 bash[29418]: cluster 2021-03-10T14:55:13.040968+0000 mgr.gibba020.yqfnwy (mgr.34427) 3310 : cluster [DBG] pgmap v1877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:14.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:14 gibba013 bash[30381]: cluster 2021-03-10T14:55:13.040968+0000 mgr.gibba020.yqfnwy (mgr.34427) 3310 : cluster [DBG] pgmap v1877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:16.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:16 gibba020 bash[25448]: cluster 2021-03-10T14:55:15.042756+0000 mgr.gibba020.yqfnwy (mgr.34427) 3311 : cluster [DBG] pgmap v1878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:16.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:16 gibba013 bash[29418]: cluster 2021-03-10T14:55:15.042756+0000 mgr.gibba020.yqfnwy (mgr.34427) 3311 : cluster [DBG] pgmap v1878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:16.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:16 gibba013 bash[30381]: cluster 2021-03-10T14:55:15.042756+0000 mgr.gibba020.yqfnwy (mgr.34427) 3311 : cluster [DBG] pgmap v1878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:17.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:17 gibba020 bash[25448]: cephadm 2021-03-10T14:55:15.904621+0000 mgr.gibba020.yqfnwy (mgr.34427) 3312 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:55:17.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:17 gibba013 bash[29418]: cephadm 2021-03-10T14:55:15.904621+0000 mgr.gibba020.yqfnwy (mgr.34427) 3312 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:55:17.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:17 gibba013 bash[30381]: cephadm 2021-03-10T14:55:15.904621+0000 mgr.gibba020.yqfnwy (mgr.34427) 3312 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:55:18.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:18 gibba020 bash[25448]: cluster 2021-03-10T14:55:17.044197+0000 mgr.gibba020.yqfnwy (mgr.34427) 3313 : cluster [DBG] pgmap v1879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:18.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:18 gibba013 bash[29418]: cluster 2021-03-10T14:55:17.044197+0000 mgr.gibba020.yqfnwy (mgr.34427) 3313 : cluster [DBG] pgmap v1879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:18.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:18 gibba013 bash[30381]: cluster 2021-03-10T14:55:17.044197+0000 mgr.gibba020.yqfnwy (mgr.34427) 3313 : cluster [DBG] pgmap v1879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:19.021 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:55:19.246 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:55:19.246 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (61m) 6m ago 67m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:55:19.246 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (67m) 5m ago 67m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:55:19.246 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (62m) 5m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:55:19.247 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (62m) 5m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:55:19.247 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (61m) 6m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:55:19.247 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (61m) 6m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:55:19.247 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (60m) 5m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:55:19.248 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (61m) 6m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:55:19.248 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (67m) 6m ago 67m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:55:19.248 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (67m) 5m ago 67m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:55:19.248 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (60m) 6m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:55:19.248 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (59m) 6m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:55:19.249 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (59m) 6m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:55:19.249 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (58m) 6m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:55:19.249 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (58m) 5m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:55:19.249 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (57m) 5m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:55:19.249 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (57m) 5m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:55:19.250 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (57m) 5m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:55:19.250 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (66m) 5m ago 67m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:55:19.250 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 5m ago 65m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:55:19.490 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:55:19.491 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:55:19.491 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:55:19.491 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:55:19.492 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:55:19.492 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:55:19.492 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:55:19.492 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:55:19.492 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:55:19.493 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:55:19.493 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:55:19.493 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:55:19.493 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:55:19.494 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:55:19.494 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:55:20.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:20 gibba020 bash[25448]: audit 2021-03-10T14:55:19.008889+0000 mgr.gibba020.yqfnwy (mgr.34427) 3314 : audit [DBG] from='client.46284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:55:20.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:20 gibba020 bash[25448]: cluster 2021-03-10T14:55:19.045808+0000 mgr.gibba020.yqfnwy (mgr.34427) 3315 : cluster [DBG] pgmap v1880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:20.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:20 gibba020 bash[25448]: audit 2021-03-10T14:55:19.231780+0000 mgr.gibba020.yqfnwy (mgr.34427) 3316 : audit [DBG] from='client.46290 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:55:20.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:20 gibba020 bash[25448]: audit 2021-03-10T14:55:19.487900+0000 mon.a (mon.0) 1551 : audit [DBG] from='client.? 172.21.2.113:0/2652974628' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:20.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:20 gibba013 bash[29418]: audit 2021-03-10T14:55:19.008889+0000 mgr.gibba020.yqfnwy (mgr.34427) 3314 : audit [DBG] from='client.46284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:55:20.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:20 gibba013 bash[29418]: cluster 2021-03-10T14:55:19.045808+0000 mgr.gibba020.yqfnwy (mgr.34427) 3315 : cluster [DBG] pgmap v1880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:20.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:20 gibba013 bash[29418]: audit 2021-03-10T14:55:19.231780+0000 mgr.gibba020.yqfnwy (mgr.34427) 3316 : audit [DBG] from='client.46290 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:55:20.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:20 gibba013 bash[29418]: audit 2021-03-10T14:55:19.487900+0000 mon.a (mon.0) 1551 : audit [DBG] from='client.? 172.21.2.113:0/2652974628' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:20.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:20 gibba013 bash[30381]: audit 2021-03-10T14:55:19.008889+0000 mgr.gibba020.yqfnwy (mgr.34427) 3314 : audit [DBG] from='client.46284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:55:20.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:20 gibba013 bash[30381]: cluster 2021-03-10T14:55:19.045808+0000 mgr.gibba020.yqfnwy (mgr.34427) 3315 : cluster [DBG] pgmap v1880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:20.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:20 gibba013 bash[30381]: audit 2021-03-10T14:55:19.231780+0000 mgr.gibba020.yqfnwy (mgr.34427) 3316 : audit [DBG] from='client.46290 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:55:20.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:20 gibba013 bash[30381]: audit 2021-03-10T14:55:19.487900+0000 mon.a (mon.0) 1551 : audit [DBG] from='client.? 172.21.2.113:0/2652974628' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:22.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:22 gibba020 bash[25448]: cluster 2021-03-10T14:55:21.047554+0000 mgr.gibba020.yqfnwy (mgr.34427) 3317 : cluster [DBG] pgmap v1881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:22.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:22 gibba013 bash[29418]: cluster 2021-03-10T14:55:21.047554+0000 mgr.gibba020.yqfnwy (mgr.34427) 3317 : cluster [DBG] pgmap v1881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:22.738 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:22 gibba013 bash[30381]: cluster 2021-03-10T14:55:21.047554+0000 mgr.gibba020.yqfnwy (mgr.34427) 3317 : cluster [DBG] pgmap v1881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:24.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:24 gibba013 bash[29418]: cluster 2021-03-10T14:55:23.048411+0000 mgr.gibba020.yqfnwy (mgr.34427) 3318 : cluster [DBG] pgmap v1882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:24.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:24 gibba013 bash[30381]: cluster 2021-03-10T14:55:23.048411+0000 mgr.gibba020.yqfnwy (mgr.34427) 3318 : cluster [DBG] pgmap v1882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:24.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:24 gibba020 bash[25448]: cluster 2021-03-10T14:55:23.048411+0000 mgr.gibba020.yqfnwy (mgr.34427) 3318 : cluster [DBG] pgmap v1882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:26.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:26 gibba013 bash[29418]: cluster 2021-03-10T14:55:25.049899+0000 mgr.gibba020.yqfnwy (mgr.34427) 3319 : cluster [DBG] pgmap v1883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:26.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:26 gibba013 bash[30381]: cluster 2021-03-10T14:55:25.049899+0000 mgr.gibba020.yqfnwy (mgr.34427) 3319 : cluster [DBG] pgmap v1883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:26.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:26 gibba020 bash[25448]: cluster 2021-03-10T14:55:25.049899+0000 mgr.gibba020.yqfnwy (mgr.34427) 3319 : cluster [DBG] pgmap v1883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:27.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:27 gibba013 bash[29418]: cluster 2021-03-10T14:55:27.051216+0000 mgr.gibba020.yqfnwy (mgr.34427) 3320 : cluster [DBG] pgmap v1884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:27.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:27 gibba013 bash[30381]: cluster 2021-03-10T14:55:27.051216+0000 mgr.gibba020.yqfnwy (mgr.34427) 3320 : cluster [DBG] pgmap v1884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:27.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:27 gibba020 bash[25448]: cluster 2021-03-10T14:55:27.051216+0000 mgr.gibba020.yqfnwy (mgr.34427) 3320 : cluster [DBG] pgmap v1884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:30.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:30 gibba013 bash[29418]: cluster 2021-03-10T14:55:29.052830+0000 mgr.gibba020.yqfnwy (mgr.34427) 3321 : cluster [DBG] pgmap v1885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:30.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:30 gibba013 bash[30381]: cluster 2021-03-10T14:55:29.052830+0000 mgr.gibba020.yqfnwy (mgr.34427) 3321 : cluster [DBG] pgmap v1885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:30.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:30 gibba020 bash[25448]: cluster 2021-03-10T14:55:29.052830+0000 mgr.gibba020.yqfnwy (mgr.34427) 3321 : cluster [DBG] pgmap v1885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:31.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:31 gibba013 bash[29418]: audit 2021-03-10T14:55:30.922731+0000 mon.a (mon.0) 1552 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:55:31.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:31 gibba013 bash[30381]: audit 2021-03-10T14:55:30.922731+0000 mon.a (mon.0) 1552 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:55:31.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:31 gibba020 bash[25448]: audit 2021-03-10T14:55:30.922731+0000 mon.a (mon.0) 1552 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:55:32.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:32 gibba020 bash[25448]: cluster 2021-03-10T14:55:31.053353+0000 mgr.gibba020.yqfnwy (mgr.34427) 3322 : cluster [DBG] pgmap v1886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:32.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:32 gibba020 bash[25448]: cephadm 2021-03-10T14:55:31.128464+0000 mgr.gibba020.yqfnwy (mgr.34427) 3323 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:55:32.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:32 gibba020 bash[25448]: audit 2021-03-10T14:55:31.128775+0000 mon.a (mon.0) 1553 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:55:32.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:32 gibba020 bash[25448]: cephadm 2021-03-10T14:55:31.135902+0000 mgr.gibba020.yqfnwy (mgr.34427) 3324 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:55:32.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:32 gibba020 bash[25448]: audit 2021-03-10T14:55:31.136539+0000 mon.a (mon.0) 1554 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:55:32.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:32 gibba020 bash[25448]: audit 2021-03-10T14:55:31.345380+0000 mon.a (mon.0) 1555 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:55:32.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:32 gibba020 bash[25448]: cephadm 2021-03-10T14:55:31.346740+0000 mgr.gibba020.yqfnwy (mgr.34427) 3325 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:55:32.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:32 gibba020 bash[25448]: cephadm 2021-03-10T14:55:31.348458+0000 mgr.gibba020.yqfnwy (mgr.34427) 3326 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:55:32.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:32 gibba020 bash[25448]: audit 2021-03-10T14:55:31.348598+0000 mon.a (mon.0) 1556 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:55:32.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:32 gibba020 bash[25448]: cephadm 2021-03-10T14:55:31.349642+0000 mgr.gibba020.yqfnwy (mgr.34427) 3327 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:55:32.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:32 gibba020 bash[25448]: cephadm 2021-03-10T14:55:31.349687+0000 mgr.gibba020.yqfnwy (mgr.34427) 3328 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:55:32.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:32 gibba020 bash[25448]: audit 2021-03-10T14:55:31.349915+0000 mon.a (mon.0) 1557 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:32.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:32 gibba020 bash[25448]: cephadm 2021-03-10T14:55:31.350821+0000 mgr.gibba020.yqfnwy (mgr.34427) 3329 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:55:32.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:32 gibba020 bash[25448]: cephadm 2021-03-10T14:55:31.350865+0000 mgr.gibba020.yqfnwy (mgr.34427) 3330 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:55:32.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:32 gibba020 bash[25448]: audit 2021-03-10T14:55:31.351112+0000 mon.a (mon.0) 1558 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:32.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:32 gibba020 bash[25448]: cephadm 2021-03-10T14:55:31.352147+0000 mgr.gibba020.yqfnwy (mgr.34427) 3331 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:55:32.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:32 gibba020 bash[25448]: audit 2021-03-10T14:55:31.352277+0000 mon.a (mon.0) 1559 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:32.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:32 gibba020 bash[25448]: cephadm 2021-03-10T14:55:31.353266+0000 mgr.gibba020.yqfnwy (mgr.34427) 3332 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:55:32.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:32 gibba020 bash[25448]: cephadm 2021-03-10T14:55:31.353311+0000 mgr.gibba020.yqfnwy (mgr.34427) 3333 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:55:32.456 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:32 gibba020 bash[25448]: cephadm 2021-03-10T14:55:31.354844+0000 mgr.gibba020.yqfnwy (mgr.34427) 3334 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:55:32.456 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:32 gibba020 bash[25448]: audit 2021-03-10T14:55:31.354906+0000 mon.a (mon.0) 1560 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:32.456 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:32 gibba020 bash[25448]: cephadm 2021-03-10T14:55:31.355252+0000 mgr.gibba020.yqfnwy (mgr.34427) 3335 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:55:32.456 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:32 gibba020 bash[25448]: audit 2021-03-10T14:55:31.356819+0000 mon.a (mon.0) 1561 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:32.456 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:32 gibba020 bash[25448]: cephadm 2021-03-10T14:55:31.357070+0000 mgr.gibba020.yqfnwy (mgr.34427) 3336 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:55:32.457 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:32 gibba020 bash[25448]: cephadm 2021-03-10T14:55:31.357134+0000 mgr.gibba020.yqfnwy (mgr.34427) 3337 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:55:32.457 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:32 gibba020 bash[25448]: cephadm 2021-03-10T14:55:31.357290+0000 mgr.gibba020.yqfnwy (mgr.34427) 3338 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:55:32.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[29418]: cluster 2021-03-10T14:55:31.053353+0000 mgr.gibba020.yqfnwy (mgr.34427) 3322 : cluster [DBG] pgmap v1886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:32.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[29418]: cephadm 2021-03-10T14:55:31.128464+0000 mgr.gibba020.yqfnwy (mgr.34427) 3323 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:55:32.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[29418]: audit 2021-03-10T14:55:31.128775+0000 mon.a (mon.0) 1553 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:55:32.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[29418]: cephadm 2021-03-10T14:55:31.135902+0000 mgr.gibba020.yqfnwy (mgr.34427) 3324 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:55:32.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[29418]: audit 2021-03-10T14:55:31.136539+0000 mon.a (mon.0) 1554 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:55:32.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[29418]: audit 2021-03-10T14:55:31.345380+0000 mon.a (mon.0) 1555 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:55:32.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[29418]: cephadm 2021-03-10T14:55:31.346740+0000 mgr.gibba020.yqfnwy (mgr.34427) 3325 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:55:32.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[29418]: cephadm 2021-03-10T14:55:31.348458+0000 mgr.gibba020.yqfnwy (mgr.34427) 3326 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:55:32.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[29418]: audit 2021-03-10T14:55:31.348598+0000 mon.a (mon.0) 1556 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:55:32.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[29418]: cephadm 2021-03-10T14:55:31.349642+0000 mgr.gibba020.yqfnwy (mgr.34427) 3327 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:55:32.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[29418]: cephadm 2021-03-10T14:55:31.349687+0000 mgr.gibba020.yqfnwy (mgr.34427) 3328 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:55:32.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[29418]: audit 2021-03-10T14:55:31.349915+0000 mon.a (mon.0) 1557 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:32.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[29418]: cephadm 2021-03-10T14:55:31.350821+0000 mgr.gibba020.yqfnwy (mgr.34427) 3329 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:55:32.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[29418]: cephadm 2021-03-10T14:55:31.350865+0000 mgr.gibba020.yqfnwy (mgr.34427) 3330 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:55:32.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[29418]: audit 2021-03-10T14:55:31.351112+0000 mon.a (mon.0) 1558 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:32.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[29418]: cephadm 2021-03-10T14:55:31.352147+0000 mgr.gibba020.yqfnwy (mgr.34427) 3331 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:55:32.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[29418]: audit 2021-03-10T14:55:31.352277+0000 mon.a (mon.0) 1559 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:32.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[29418]: cephadm 2021-03-10T14:55:31.353266+0000 mgr.gibba020.yqfnwy (mgr.34427) 3332 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:55:32.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[29418]: cephadm 2021-03-10T14:55:31.353311+0000 mgr.gibba020.yqfnwy (mgr.34427) 3333 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:55:32.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[29418]: cephadm 2021-03-10T14:55:31.354844+0000 mgr.gibba020.yqfnwy (mgr.34427) 3334 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:55:32.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[30381]: cluster 2021-03-10T14:55:31.053353+0000 mgr.gibba020.yqfnwy (mgr.34427) 3322 : cluster [DBG] pgmap v1886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:32.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[30381]: cephadm 2021-03-10T14:55:31.128464+0000 mgr.gibba020.yqfnwy (mgr.34427) 3323 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:55:32.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[30381]: audit 2021-03-10T14:55:31.128775+0000 mon.a (mon.0) 1553 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:55:32.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[30381]: cephadm 2021-03-10T14:55:31.135902+0000 mgr.gibba020.yqfnwy (mgr.34427) 3324 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:55:32.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[30381]: audit 2021-03-10T14:55:31.136539+0000 mon.a (mon.0) 1554 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:55:32.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[30381]: audit 2021-03-10T14:55:31.345380+0000 mon.a (mon.0) 1555 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:55:32.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[30381]: cephadm 2021-03-10T14:55:31.346740+0000 mgr.gibba020.yqfnwy (mgr.34427) 3325 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:55:32.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[30381]: cephadm 2021-03-10T14:55:31.348458+0000 mgr.gibba020.yqfnwy (mgr.34427) 3326 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:55:32.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[30381]: audit 2021-03-10T14:55:31.348598+0000 mon.a (mon.0) 1556 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:55:32.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[30381]: cephadm 2021-03-10T14:55:31.349642+0000 mgr.gibba020.yqfnwy (mgr.34427) 3327 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:55:32.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[30381]: cephadm 2021-03-10T14:55:31.349687+0000 mgr.gibba020.yqfnwy (mgr.34427) 3328 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:55:32.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[30381]: audit 2021-03-10T14:55:31.349915+0000 mon.a (mon.0) 1557 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:32.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[30381]: cephadm 2021-03-10T14:55:31.350821+0000 mgr.gibba020.yqfnwy (mgr.34427) 3329 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:55:32.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[30381]: cephadm 2021-03-10T14:55:31.350865+0000 mgr.gibba020.yqfnwy (mgr.34427) 3330 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:55:32.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[30381]: audit 2021-03-10T14:55:31.351112+0000 mon.a (mon.0) 1558 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:32.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[30381]: cephadm 2021-03-10T14:55:31.352147+0000 mgr.gibba020.yqfnwy (mgr.34427) 3331 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:55:32.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[30381]: audit 2021-03-10T14:55:31.352277+0000 mon.a (mon.0) 1559 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:32.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[30381]: cephadm 2021-03-10T14:55:31.353266+0000 mgr.gibba020.yqfnwy (mgr.34427) 3332 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:55:32.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[30381]: cephadm 2021-03-10T14:55:31.353311+0000 mgr.gibba020.yqfnwy (mgr.34427) 3333 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:55:32.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[30381]: cephadm 2021-03-10T14:55:31.354844+0000 mgr.gibba020.yqfnwy (mgr.34427) 3334 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:55:32.643 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[29418]: audit 2021-03-10T14:55:31.354906+0000 mon.a (mon.0) 1560 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:32.643 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[29418]: cephadm 2021-03-10T14:55:31.355252+0000 mgr.gibba020.yqfnwy (mgr.34427) 3335 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:55:32.643 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[29418]: audit 2021-03-10T14:55:31.356819+0000 mon.a (mon.0) 1561 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:32.643 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[29418]: cephadm 2021-03-10T14:55:31.357070+0000 mgr.gibba020.yqfnwy (mgr.34427) 3336 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:55:32.644 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[29418]: cephadm 2021-03-10T14:55:31.357134+0000 mgr.gibba020.yqfnwy (mgr.34427) 3337 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:55:32.644 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[29418]: cephadm 2021-03-10T14:55:31.357290+0000 mgr.gibba020.yqfnwy (mgr.34427) 3338 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:55:32.644 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[30381]: audit 2021-03-10T14:55:31.354906+0000 mon.a (mon.0) 1560 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:32.645 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[30381]: cephadm 2021-03-10T14:55:31.355252+0000 mgr.gibba020.yqfnwy (mgr.34427) 3335 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:55:32.645 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[30381]: audit 2021-03-10T14:55:31.356819+0000 mon.a (mon.0) 1561 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:32.645 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[30381]: cephadm 2021-03-10T14:55:31.357070+0000 mgr.gibba020.yqfnwy (mgr.34427) 3336 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:55:32.645 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[30381]: cephadm 2021-03-10T14:55:31.357134+0000 mgr.gibba020.yqfnwy (mgr.34427) 3337 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:55:32.645 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:32 gibba013 bash[30381]: cephadm 2021-03-10T14:55:31.357290+0000 mgr.gibba020.yqfnwy (mgr.34427) 3338 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:55:34.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:34 gibba020 bash[25448]: cluster 2021-03-10T14:55:33.053783+0000 mgr.gibba020.yqfnwy (mgr.34427) 3339 : cluster [DBG] pgmap v1887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:34.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:34 gibba013 bash[29418]: cluster 2021-03-10T14:55:33.053783+0000 mgr.gibba020.yqfnwy (mgr.34427) 3339 : cluster [DBG] pgmap v1887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:34.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:34 gibba013 bash[30381]: cluster 2021-03-10T14:55:33.053783+0000 mgr.gibba020.yqfnwy (mgr.34427) 3339 : cluster [DBG] pgmap v1887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:36.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:36 gibba020 bash[25448]: cluster 2021-03-10T14:55:35.055233+0000 mgr.gibba020.yqfnwy (mgr.34427) 3340 : cluster [DBG] pgmap v1888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:36.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:36 gibba013 bash[29418]: cluster 2021-03-10T14:55:35.055233+0000 mgr.gibba020.yqfnwy (mgr.34427) 3340 : cluster [DBG] pgmap v1888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:36.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:36 gibba013 bash[30381]: cluster 2021-03-10T14:55:35.055233+0000 mgr.gibba020.yqfnwy (mgr.34427) 3340 : cluster [DBG] pgmap v1888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:37.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:37 gibba013 bash[29418]: cluster 2021-03-10T14:55:37.056605+0000 mgr.gibba020.yqfnwy (mgr.34427) 3341 : cluster [DBG] pgmap v1889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:37.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:37 gibba013 bash[30381]: cluster 2021-03-10T14:55:37.056605+0000 mgr.gibba020.yqfnwy (mgr.34427) 3341 : cluster [DBG] pgmap v1889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:37.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:37 gibba020 bash[25448]: cluster 2021-03-10T14:55:37.056605+0000 mgr.gibba020.yqfnwy (mgr.34427) 3341 : cluster [DBG] pgmap v1889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:40.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:40 gibba013 bash[29418]: cluster 2021-03-10T14:55:39.058021+0000 mgr.gibba020.yqfnwy (mgr.34427) 3342 : cluster [DBG] pgmap v1890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:40.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:40 gibba013 bash[30381]: cluster 2021-03-10T14:55:39.058021+0000 mgr.gibba020.yqfnwy (mgr.34427) 3342 : cluster [DBG] pgmap v1890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:40.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:40 gibba020 bash[25448]: cluster 2021-03-10T14:55:39.058021+0000 mgr.gibba020.yqfnwy (mgr.34427) 3342 : cluster [DBG] pgmap v1890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:42.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:42 gibba020 bash[25448]: cluster 2021-03-10T14:55:41.059770+0000 mgr.gibba020.yqfnwy (mgr.34427) 3343 : cluster [DBG] pgmap v1891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:42.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:42 gibba013 bash[29418]: cluster 2021-03-10T14:55:41.059770+0000 mgr.gibba020.yqfnwy (mgr.34427) 3343 : cluster [DBG] pgmap v1891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:42.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:42 gibba013 bash[30381]: cluster 2021-03-10T14:55:41.059770+0000 mgr.gibba020.yqfnwy (mgr.34427) 3343 : cluster [DBG] pgmap v1891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:44.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:44 gibba020 bash[25448]: cluster 2021-03-10T14:55:43.060286+0000 mgr.gibba020.yqfnwy (mgr.34427) 3344 : cluster [DBG] pgmap v1892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:44.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:44 gibba013 bash[29418]: cluster 2021-03-10T14:55:43.060286+0000 mgr.gibba020.yqfnwy (mgr.34427) 3344 : cluster [DBG] pgmap v1892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:44.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:44 gibba013 bash[30381]: cluster 2021-03-10T14:55:43.060286+0000 mgr.gibba020.yqfnwy (mgr.34427) 3344 : cluster [DBG] pgmap v1892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:46.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:46 gibba020 bash[25448]: cluster 2021-03-10T14:55:45.061894+0000 mgr.gibba020.yqfnwy (mgr.34427) 3345 : cluster [DBG] pgmap v1893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:46.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:46 gibba013 bash[29418]: cluster 2021-03-10T14:55:45.061894+0000 mgr.gibba020.yqfnwy (mgr.34427) 3345 : cluster [DBG] pgmap v1893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:46.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:46 gibba013 bash[30381]: cluster 2021-03-10T14:55:45.061894+0000 mgr.gibba020.yqfnwy (mgr.34427) 3345 : cluster [DBG] pgmap v1893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:47.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:47 gibba020 bash[25448]: cephadm 2021-03-10T14:55:46.369200+0000 mgr.gibba020.yqfnwy (mgr.34427) 3346 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:55:47.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:47 gibba013 bash[29418]: cephadm 2021-03-10T14:55:46.369200+0000 mgr.gibba020.yqfnwy (mgr.34427) 3346 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:55:47.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:47 gibba013 bash[30381]: cephadm 2021-03-10T14:55:46.369200+0000 mgr.gibba020.yqfnwy (mgr.34427) 3346 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:55:48.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:48 gibba020 bash[25448]: cluster 2021-03-10T14:55:47.063235+0000 mgr.gibba020.yqfnwy (mgr.34427) 3347 : cluster [DBG] pgmap v1894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:48.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:48 gibba013 bash[29418]: cluster 2021-03-10T14:55:47.063235+0000 mgr.gibba020.yqfnwy (mgr.34427) 3347 : cluster [DBG] pgmap v1894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:48.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:48 gibba013 bash[30381]: cluster 2021-03-10T14:55:47.063235+0000 mgr.gibba020.yqfnwy (mgr.34427) 3347 : cluster [DBG] pgmap v1894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:49.733 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:55:49.959 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:55:49.959 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (62m) 7m ago 67m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:55:49.960 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (67m) 6m ago 67m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:55:49.960 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (62m) 6m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:55:49.960 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (63m) 6m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:55:49.960 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (61m) 7m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:55:49.960 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (61m) 7m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:55:49.961 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (61m) 6m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:55:49.961 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (61m) 7m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:55:49.961 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (67m) 7m ago 67m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:55:49.961 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (67m) 6m ago 67m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:55:49.961 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (60m) 7m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:55:49.962 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (60m) 7m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:55:49.962 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (59m) 7m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:55:49.962 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (59m) 7m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:55:49.962 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (58m) 6m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:55:49.962 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (58m) 6m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:55:49.963 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (58m) 6m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:55:49.963 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (57m) 6m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:55:49.963 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (67m) 6m ago 67m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:55:49.963 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 6m ago 65m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:55:50.210 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:55:50.210 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:55:50.211 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:55:50.211 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:55:50.211 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:55:50.211 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:55:50.211 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:55:50.212 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:55:50.212 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:55:50.212 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:55:50.212 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:55:50.212 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:55:50.213 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:55:50.213 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:55:50.213 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:55:50.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:50 gibba020 bash[25448]: cluster 2021-03-10T14:55:49.064877+0000 mgr.gibba020.yqfnwy (mgr.34427) 3348 : cluster [DBG] pgmap v1895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:50.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:50 gibba013 bash[29418]: cluster 2021-03-10T14:55:49.064877+0000 mgr.gibba020.yqfnwy (mgr.34427) 3348 : cluster [DBG] pgmap v1895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:50.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:50 gibba013 bash[30381]: cluster 2021-03-10T14:55:49.064877+0000 mgr.gibba020.yqfnwy (mgr.34427) 3348 : cluster [DBG] pgmap v1895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:51.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:51 gibba020 bash[25448]: audit 2021-03-10T14:55:49.720016+0000 mgr.gibba020.yqfnwy (mgr.34427) 3349 : audit [DBG] from='client.46302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:55:51.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:51 gibba020 bash[25448]: audit 2021-03-10T14:55:49.946321+0000 mgr.gibba020.yqfnwy (mgr.34427) 3350 : audit [DBG] from='client.56293 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:55:51.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:51 gibba020 bash[25448]: audit 2021-03-10T14:55:50.207684+0000 mon.a (mon.0) 1562 : audit [DBG] from='client.? 172.21.2.113:0/3906826249' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:51.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:51 gibba013 bash[29418]: audit 2021-03-10T14:55:49.720016+0000 mgr.gibba020.yqfnwy (mgr.34427) 3349 : audit [DBG] from='client.46302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:55:51.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:51 gibba013 bash[29418]: audit 2021-03-10T14:55:49.946321+0000 mgr.gibba020.yqfnwy (mgr.34427) 3350 : audit [DBG] from='client.56293 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:55:51.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:51 gibba013 bash[29418]: audit 2021-03-10T14:55:50.207684+0000 mon.a (mon.0) 1562 : audit [DBG] from='client.? 172.21.2.113:0/3906826249' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:51.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:51 gibba013 bash[30381]: audit 2021-03-10T14:55:49.720016+0000 mgr.gibba020.yqfnwy (mgr.34427) 3349 : audit [DBG] from='client.46302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:55:51.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:51 gibba013 bash[30381]: audit 2021-03-10T14:55:49.946321+0000 mgr.gibba020.yqfnwy (mgr.34427) 3350 : audit [DBG] from='client.56293 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:55:51.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:51 gibba013 bash[30381]: audit 2021-03-10T14:55:50.207684+0000 mon.a (mon.0) 1562 : audit [DBG] from='client.? 172.21.2.113:0/3906826249' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:55:52.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:52 gibba020 bash[25448]: cluster 2021-03-10T14:55:51.066581+0000 mgr.gibba020.yqfnwy (mgr.34427) 3351 : cluster [DBG] pgmap v1896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:52.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:52 gibba013 bash[29418]: cluster 2021-03-10T14:55:51.066581+0000 mgr.gibba020.yqfnwy (mgr.34427) 3351 : cluster [DBG] pgmap v1896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:52.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:52 gibba013 bash[30381]: cluster 2021-03-10T14:55:51.066581+0000 mgr.gibba020.yqfnwy (mgr.34427) 3351 : cluster [DBG] pgmap v1896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:54.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:54 gibba020 bash[25448]: cluster 2021-03-10T14:55:53.067142+0000 mgr.gibba020.yqfnwy (mgr.34427) 3352 : cluster [DBG] pgmap v1897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:54.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:54 gibba013 bash[29418]: cluster 2021-03-10T14:55:53.067142+0000 mgr.gibba020.yqfnwy (mgr.34427) 3352 : cluster [DBG] pgmap v1897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:54.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:54 gibba013 bash[30381]: cluster 2021-03-10T14:55:53.067142+0000 mgr.gibba020.yqfnwy (mgr.34427) 3352 : cluster [DBG] pgmap v1897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:56.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:56 gibba020 bash[25448]: cluster 2021-03-10T14:55:55.068821+0000 mgr.gibba020.yqfnwy (mgr.34427) 3353 : cluster [DBG] pgmap v1898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:56.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:56 gibba013 bash[29418]: cluster 2021-03-10T14:55:55.068821+0000 mgr.gibba020.yqfnwy (mgr.34427) 3353 : cluster [DBG] pgmap v1898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:56.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:56 gibba013 bash[30381]: cluster 2021-03-10T14:55:55.068821+0000 mgr.gibba020.yqfnwy (mgr.34427) 3353 : cluster [DBG] pgmap v1898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:57.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:55:57 gibba013 bash[29418]: cluster 2021-03-10T14:55:57.070060+0000 mgr.gibba020.yqfnwy (mgr.34427) 3354 : cluster [DBG] pgmap v1899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:57.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:55:57 gibba013 bash[30381]: cluster 2021-03-10T14:55:57.070060+0000 mgr.gibba020.yqfnwy (mgr.34427) 3354 : cluster [DBG] pgmap v1899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:55:57.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:55:57 gibba020 bash[25448]: cluster 2021-03-10T14:55:57.070060+0000 mgr.gibba020.yqfnwy (mgr.34427) 3354 : cluster [DBG] pgmap v1899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:00.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:00 gibba020 bash[25448]: cluster 2021-03-10T14:55:59.071676+0000 mgr.gibba020.yqfnwy (mgr.34427) 3355 : cluster [DBG] pgmap v1900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:00.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:00 gibba013 bash[29418]: cluster 2021-03-10T14:55:59.071676+0000 mgr.gibba020.yqfnwy (mgr.34427) 3355 : cluster [DBG] pgmap v1900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:00.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:00 gibba013 bash[30381]: cluster 2021-03-10T14:55:59.071676+0000 mgr.gibba020.yqfnwy (mgr.34427) 3355 : cluster [DBG] pgmap v1900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:02.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:02 gibba020 bash[25448]: cluster 2021-03-10T14:56:01.073271+0000 mgr.gibba020.yqfnwy (mgr.34427) 3356 : cluster [DBG] pgmap v1901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:02.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:02 gibba020 bash[25448]: cephadm 2021-03-10T14:56:01.384812+0000 mgr.gibba020.yqfnwy (mgr.34427) 3357 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:56:02.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:02 gibba013 bash[29418]: cluster 2021-03-10T14:56:01.073271+0000 mgr.gibba020.yqfnwy (mgr.34427) 3356 : cluster [DBG] pgmap v1901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:02.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:02 gibba013 bash[29418]: cephadm 2021-03-10T14:56:01.384812+0000 mgr.gibba020.yqfnwy (mgr.34427) 3357 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:56:02.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:02 gibba013 bash[30381]: cluster 2021-03-10T14:56:01.073271+0000 mgr.gibba020.yqfnwy (mgr.34427) 3356 : cluster [DBG] pgmap v1901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:02.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:02 gibba013 bash[30381]: cephadm 2021-03-10T14:56:01.384812+0000 mgr.gibba020.yqfnwy (mgr.34427) 3357 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:56:04.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:04 gibba020 bash[25448]: cluster 2021-03-10T14:56:03.073758+0000 mgr.gibba020.yqfnwy (mgr.34427) 3358 : cluster [DBG] pgmap v1902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:04.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:04 gibba013 bash[29418]: cluster 2021-03-10T14:56:03.073758+0000 mgr.gibba020.yqfnwy (mgr.34427) 3358 : cluster [DBG] pgmap v1902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:04.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:04 gibba013 bash[30381]: cluster 2021-03-10T14:56:03.073758+0000 mgr.gibba020.yqfnwy (mgr.34427) 3358 : cluster [DBG] pgmap v1902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:06.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:06 gibba020 bash[25448]: cluster 2021-03-10T14:56:05.075267+0000 mgr.gibba020.yqfnwy (mgr.34427) 3359 : cluster [DBG] pgmap v1903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:06 gibba013 bash[29418]: cluster 2021-03-10T14:56:05.075267+0000 mgr.gibba020.yqfnwy (mgr.34427) 3359 : cluster [DBG] pgmap v1903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:06.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:06 gibba013 bash[30381]: cluster 2021-03-10T14:56:05.075267+0000 mgr.gibba020.yqfnwy (mgr.34427) 3359 : cluster [DBG] pgmap v1903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:07 gibba020 bash[25448]: audit 2021-03-10T14:56:06.297207+0000 mon.a (mon.0) 1563 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:56:07.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:07 gibba020 bash[25448]: audit 2021-03-10T14:56:06.312206+0000 mon.a (mon.0) 1564 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:56:07.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:07 gibba020 bash[25448]: audit 2021-03-10T14:56:06.335881+0000 mon.a (mon.0) 1565 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:56:07.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:07 gibba020 bash[25448]: audit 2021-03-10T14:56:06.336555+0000 mon.a (mon.0) 1566 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T14:56:07.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:07 gibba020 bash[25448]: audit 2021-03-10T14:56:06.337288+0000 mon.a (mon.0) 1567 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:56:07.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:07 gibba020 bash[25448]: audit 2021-03-10T14:56:06.337940+0000 mon.a (mon.0) 1568 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:56:07.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:07 gibba013 bash[29418]: audit 2021-03-10T14:56:06.297207+0000 mon.a (mon.0) 1563 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:56:07.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:07 gibba013 bash[29418]: audit 2021-03-10T14:56:06.312206+0000 mon.a (mon.0) 1564 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:56:07.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:07 gibba013 bash[29418]: audit 2021-03-10T14:56:06.335881+0000 mon.a (mon.0) 1565 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:56:07.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:07 gibba013 bash[29418]: audit 2021-03-10T14:56:06.336555+0000 mon.a (mon.0) 1566 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T14:56:07.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:07 gibba013 bash[29418]: audit 2021-03-10T14:56:06.337288+0000 mon.a (mon.0) 1567 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:56:07.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:07 gibba013 bash[29418]: audit 2021-03-10T14:56:06.337940+0000 mon.a (mon.0) 1568 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:56:07.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:07 gibba013 bash[30381]: audit 2021-03-10T14:56:06.297207+0000 mon.a (mon.0) 1563 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:56:07.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:07 gibba013 bash[30381]: audit 2021-03-10T14:56:06.312206+0000 mon.a (mon.0) 1564 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:56:07.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:07 gibba013 bash[30381]: audit 2021-03-10T14:56:06.335881+0000 mon.a (mon.0) 1565 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T14:56:07.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:07 gibba013 bash[30381]: audit 2021-03-10T14:56:06.336555+0000 mon.a (mon.0) 1566 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T14:56:07.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:07 gibba013 bash[30381]: audit 2021-03-10T14:56:06.337288+0000 mon.a (mon.0) 1567 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:56:07.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:07 gibba013 bash[30381]: audit 2021-03-10T14:56:06.337940+0000 mon.a (mon.0) 1568 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T14:56:08.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:08 gibba020 bash[25448]: cluster 2021-03-10T14:56:07.076715+0000 mgr.gibba020.yqfnwy (mgr.34427) 3360 : cluster [DBG] pgmap v1904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:08.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:08 gibba013 bash[29418]: cluster 2021-03-10T14:56:07.076715+0000 mgr.gibba020.yqfnwy (mgr.34427) 3360 : cluster [DBG] pgmap v1904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:08.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:08 gibba013 bash[30381]: cluster 2021-03-10T14:56:07.076715+0000 mgr.gibba020.yqfnwy (mgr.34427) 3360 : cluster [DBG] pgmap v1904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:10.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:10 gibba020 bash[25448]: cluster 2021-03-10T14:56:09.078335+0000 mgr.gibba020.yqfnwy (mgr.34427) 3361 : cluster [DBG] pgmap v1905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:10.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:10 gibba013 bash[29418]: cluster 2021-03-10T14:56:09.078335+0000 mgr.gibba020.yqfnwy (mgr.34427) 3361 : cluster [DBG] pgmap v1905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:10.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:10 gibba013 bash[30381]: cluster 2021-03-10T14:56:09.078335+0000 mgr.gibba020.yqfnwy (mgr.34427) 3361 : cluster [DBG] pgmap v1905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:12.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:12 gibba020 bash[25448]: cluster 2021-03-10T14:56:11.080273+0000 mgr.gibba020.yqfnwy (mgr.34427) 3362 : cluster [DBG] pgmap v1906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:12.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:12 gibba013 bash[29418]: cluster 2021-03-10T14:56:11.080273+0000 mgr.gibba020.yqfnwy (mgr.34427) 3362 : cluster [DBG] pgmap v1906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:12.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:12 gibba013 bash[30381]: cluster 2021-03-10T14:56:11.080273+0000 mgr.gibba020.yqfnwy (mgr.34427) 3362 : cluster [DBG] pgmap v1906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:14.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:14 gibba020 bash[25448]: cluster 2021-03-10T14:56:13.080774+0000 mgr.gibba020.yqfnwy (mgr.34427) 3363 : cluster [DBG] pgmap v1907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:14.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:14 gibba013 bash[29418]: cluster 2021-03-10T14:56:13.080774+0000 mgr.gibba020.yqfnwy (mgr.34427) 3363 : cluster [DBG] pgmap v1907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:14.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:14 gibba013 bash[30381]: cluster 2021-03-10T14:56:13.080774+0000 mgr.gibba020.yqfnwy (mgr.34427) 3363 : cluster [DBG] pgmap v1907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:16.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:16 gibba013 bash[29418]: cluster 2021-03-10T14:56:15.082380+0000 mgr.gibba020.yqfnwy (mgr.34427) 3364 : cluster [DBG] pgmap v1908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:16.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:16 gibba013 bash[30381]: cluster 2021-03-10T14:56:15.082380+0000 mgr.gibba020.yqfnwy (mgr.34427) 3364 : cluster [DBG] pgmap v1908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:16.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:16 gibba020 bash[25448]: cluster 2021-03-10T14:56:15.082380+0000 mgr.gibba020.yqfnwy (mgr.34427) 3364 : cluster [DBG] pgmap v1908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:17.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:17 gibba013 bash[29418]: cephadm 2021-03-10T14:56:16.400888+0000 mgr.gibba020.yqfnwy (mgr.34427) 3365 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:56:17.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:17 gibba013 bash[30381]: cephadm 2021-03-10T14:56:16.400888+0000 mgr.gibba020.yqfnwy (mgr.34427) 3365 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:56:17.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:17 gibba020 bash[25448]: cephadm 2021-03-10T14:56:16.400888+0000 mgr.gibba020.yqfnwy (mgr.34427) 3365 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:56:18.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:18 gibba013 bash[29418]: cluster 2021-03-10T14:56:17.083809+0000 mgr.gibba020.yqfnwy (mgr.34427) 3366 : cluster [DBG] pgmap v1909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:18.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:18 gibba013 bash[30381]: cluster 2021-03-10T14:56:17.083809+0000 mgr.gibba020.yqfnwy (mgr.34427) 3366 : cluster [DBG] pgmap v1909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:18.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:18 gibba020 bash[25448]: cluster 2021-03-10T14:56:17.083809+0000 mgr.gibba020.yqfnwy (mgr.34427) 3366 : cluster [DBG] pgmap v1909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:20.458 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:56:20.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:20 gibba013 bash[29418]: cluster 2021-03-10T14:56:19.085574+0000 mgr.gibba020.yqfnwy (mgr.34427) 3367 : cluster [DBG] pgmap v1910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:20.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:20 gibba013 bash[30381]: cluster 2021-03-10T14:56:19.085574+0000 mgr.gibba020.yqfnwy (mgr.34427) 3367 : cluster [DBG] pgmap v1910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:20.686 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:56:20.686 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (62m) 8m ago 68m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:56:20.686 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (68m) 6m ago 68m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:56:20.687 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (63m) 6m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:56:20.687 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (63m) 6m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:56:20.687 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (62m) 8m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:56:20.687 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (62m) 8m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:56:20.688 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (61m) 6m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:56:20.688 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (62m) 8m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:56:20.688 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (68m) 8m ago 68m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:56:20.688 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (68m) 6m ago 68m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:56:20.689 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (61m) 8m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:56:20.689 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (60m) 8m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:56:20.689 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (60m) 8m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:56:20.689 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (59m) 8m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:56:20.689 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (59m) 6m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:56:20.690 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (58m) 6m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:56:20.690 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (58m) 6m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:56:20.690 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (58m) 6m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:56:20.690 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (67m) 6m ago 68m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:56:20.691 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 6m ago 66m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:56:20.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:20 gibba020 bash[25448]: cluster 2021-03-10T14:56:19.085574+0000 mgr.gibba020.yqfnwy (mgr.34427) 3367 : cluster [DBG] pgmap v1910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:20.935 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:56:20.935 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:56:20.935 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:56:20.935 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:56:20.936 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:56:20.936 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:56:20.936 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:56:20.936 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:56:20.936 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:56:20.937 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:56:20.937 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:56:20.937 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:56:20.937 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:56:20.938 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:56:20.938 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:56:21.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:21 gibba013 bash[29418]: audit 2021-03-10T14:56:20.445212+0000 mgr.gibba020.yqfnwy (mgr.34427) 3368 : audit [DBG] from='client.46320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:56:21.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:21 gibba013 bash[29418]: audit 2021-03-10T14:56:20.932208+0000 mon.c (mon.1) 61 : audit [DBG] from='client.? 172.21.2.113:0/1160112513' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:21.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:21 gibba013 bash[30381]: audit 2021-03-10T14:56:20.445212+0000 mgr.gibba020.yqfnwy (mgr.34427) 3368 : audit [DBG] from='client.46320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:56:21.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:21 gibba013 bash[30381]: audit 2021-03-10T14:56:20.932208+0000 mon.c (mon.1) 61 : audit [DBG] from='client.? 172.21.2.113:0/1160112513' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:21.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:21 gibba020 bash[25448]: audit 2021-03-10T14:56:20.445212+0000 mgr.gibba020.yqfnwy (mgr.34427) 3368 : audit [DBG] from='client.46320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:56:21.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:21 gibba020 bash[25448]: audit 2021-03-10T14:56:20.932208+0000 mon.c (mon.1) 61 : audit [DBG] from='client.? 172.21.2.113:0/1160112513' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:22.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:22 gibba013 bash[29418]: audit 2021-03-10T14:56:20.670077+0000 mgr.gibba020.yqfnwy (mgr.34427) 3369 : audit [DBG] from='client.46326 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:56:22.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:22 gibba013 bash[29418]: cluster 2021-03-10T14:56:21.087299+0000 mgr.gibba020.yqfnwy (mgr.34427) 3370 : cluster [DBG] pgmap v1911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:22.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:22 gibba013 bash[30381]: audit 2021-03-10T14:56:20.670077+0000 mgr.gibba020.yqfnwy (mgr.34427) 3369 : audit [DBG] from='client.46326 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:56:22.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:22 gibba013 bash[30381]: cluster 2021-03-10T14:56:21.087299+0000 mgr.gibba020.yqfnwy (mgr.34427) 3370 : cluster [DBG] pgmap v1911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:22.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:22 gibba020 bash[25448]: audit 2021-03-10T14:56:20.670077+0000 mgr.gibba020.yqfnwy (mgr.34427) 3369 : audit [DBG] from='client.46326 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:56:22.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:22 gibba020 bash[25448]: cluster 2021-03-10T14:56:21.087299+0000 mgr.gibba020.yqfnwy (mgr.34427) 3370 : cluster [DBG] pgmap v1911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:24.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:24 gibba013 bash[29418]: cluster 2021-03-10T14:56:23.087797+0000 mgr.gibba020.yqfnwy (mgr.34427) 3371 : cluster [DBG] pgmap v1912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:24.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:24 gibba013 bash[30381]: cluster 2021-03-10T14:56:23.087797+0000 mgr.gibba020.yqfnwy (mgr.34427) 3371 : cluster [DBG] pgmap v1912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:24.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:24 gibba020 bash[25448]: cluster 2021-03-10T14:56:23.087797+0000 mgr.gibba020.yqfnwy (mgr.34427) 3371 : cluster [DBG] pgmap v1912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:26.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:26 gibba013 bash[29418]: cluster 2021-03-10T14:56:25.089527+0000 mgr.gibba020.yqfnwy (mgr.34427) 3372 : cluster [DBG] pgmap v1913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:26.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:26 gibba013 bash[30381]: cluster 2021-03-10T14:56:25.089527+0000 mgr.gibba020.yqfnwy (mgr.34427) 3372 : cluster [DBG] pgmap v1913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:26.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:26 gibba020 bash[25448]: cluster 2021-03-10T14:56:25.089527+0000 mgr.gibba020.yqfnwy (mgr.34427) 3372 : cluster [DBG] pgmap v1913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:27.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:27 gibba013 bash[29418]: cluster 2021-03-10T14:56:27.091018+0000 mgr.gibba020.yqfnwy (mgr.34427) 3373 : cluster [DBG] pgmap v1914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:27.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:27 gibba013 bash[30381]: cluster 2021-03-10T14:56:27.091018+0000 mgr.gibba020.yqfnwy (mgr.34427) 3373 : cluster [DBG] pgmap v1914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:27.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:27 gibba020 bash[25448]: cluster 2021-03-10T14:56:27.091018+0000 mgr.gibba020.yqfnwy (mgr.34427) 3373 : cluster [DBG] pgmap v1914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:30.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:30 gibba020 bash[25448]: cluster 2021-03-10T14:56:29.092858+0000 mgr.gibba020.yqfnwy (mgr.34427) 3374 : cluster [DBG] pgmap v1915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:30.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:30 gibba013 bash[29418]: cluster 2021-03-10T14:56:29.092858+0000 mgr.gibba020.yqfnwy (mgr.34427) 3374 : cluster [DBG] pgmap v1915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:30.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:30 gibba013 bash[30381]: cluster 2021-03-10T14:56:29.092858+0000 mgr.gibba020.yqfnwy (mgr.34427) 3374 : cluster [DBG] pgmap v1915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:32.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:32 gibba020 bash[25448]: cluster 2021-03-10T14:56:31.094671+0000 mgr.gibba020.yqfnwy (mgr.34427) 3375 : cluster [DBG] pgmap v1916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:32.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:32 gibba020 bash[25448]: audit 2021-03-10T14:56:31.419043+0000 mon.a (mon.0) 1569 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:56:32.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:32 gibba020 bash[25448]: cephadm 2021-03-10T14:56:31.423744+0000 mgr.gibba020.yqfnwy (mgr.34427) 3376 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:56:32.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:32 gibba020 bash[25448]: cephadm 2021-03-10T14:56:31.425628+0000 mgr.gibba020.yqfnwy (mgr.34427) 3377 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:56:32.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:32 gibba020 bash[25448]: audit 2021-03-10T14:56:31.652118+0000 mon.a (mon.0) 1570 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:56:32.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:32 gibba020 bash[25448]: audit 2021-03-10T14:56:31.655253+0000 mon.a (mon.0) 1571 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:56:32.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:32 gibba020 bash[25448]: audit 2021-03-10T14:56:31.656549+0000 mon.a (mon.0) 1572 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:32.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:32 gibba020 bash[25448]: audit 2021-03-10T14:56:31.657878+0000 mon.a (mon.0) 1573 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:32.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:32 gibba020 bash[25448]: audit 2021-03-10T14:56:31.658957+0000 mon.a (mon.0) 1574 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:32.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:32 gibba020 bash[25448]: audit 2021-03-10T14:56:31.660797+0000 mon.a (mon.0) 1575 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:32.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:32 gibba020 bash[25448]: audit 2021-03-10T14:56:31.662041+0000 mon.a (mon.0) 1576 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:32.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:32 gibba013 bash[29418]: cluster 2021-03-10T14:56:31.094671+0000 mgr.gibba020.yqfnwy (mgr.34427) 3375 : cluster [DBG] pgmap v1916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:32.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:32 gibba013 bash[29418]: audit 2021-03-10T14:56:31.419043+0000 mon.a (mon.0) 1569 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:56:32.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:32 gibba013 bash[29418]: cephadm 2021-03-10T14:56:31.423744+0000 mgr.gibba020.yqfnwy (mgr.34427) 3376 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:56:32.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:32 gibba013 bash[29418]: cephadm 2021-03-10T14:56:31.425628+0000 mgr.gibba020.yqfnwy (mgr.34427) 3377 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:56:32.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:32 gibba013 bash[29418]: audit 2021-03-10T14:56:31.652118+0000 mon.a (mon.0) 1570 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:56:32.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:32 gibba013 bash[29418]: audit 2021-03-10T14:56:31.655253+0000 mon.a (mon.0) 1571 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:56:32.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:32 gibba013 bash[29418]: audit 2021-03-10T14:56:31.656549+0000 mon.a (mon.0) 1572 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:32.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:32 gibba013 bash[29418]: audit 2021-03-10T14:56:31.657878+0000 mon.a (mon.0) 1573 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:32.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:32 gibba013 bash[29418]: audit 2021-03-10T14:56:31.658957+0000 mon.a (mon.0) 1574 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:32.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:32 gibba013 bash[29418]: audit 2021-03-10T14:56:31.660797+0000 mon.a (mon.0) 1575 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:32.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:32 gibba013 bash[29418]: audit 2021-03-10T14:56:31.662041+0000 mon.a (mon.0) 1576 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:32.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:32 gibba013 bash[30381]: cluster 2021-03-10T14:56:31.094671+0000 mgr.gibba020.yqfnwy (mgr.34427) 3375 : cluster [DBG] pgmap v1916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:32.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:32 gibba013 bash[30381]: audit 2021-03-10T14:56:31.419043+0000 mon.a (mon.0) 1569 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:56:32.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:32 gibba013 bash[30381]: cephadm 2021-03-10T14:56:31.423744+0000 mgr.gibba020.yqfnwy (mgr.34427) 3376 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:56:32.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:32 gibba013 bash[30381]: cephadm 2021-03-10T14:56:31.425628+0000 mgr.gibba020.yqfnwy (mgr.34427) 3377 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:56:32.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:32 gibba013 bash[30381]: audit 2021-03-10T14:56:31.652118+0000 mon.a (mon.0) 1570 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:56:32.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:32 gibba013 bash[30381]: audit 2021-03-10T14:56:31.655253+0000 mon.a (mon.0) 1571 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:56:32.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:32 gibba013 bash[30381]: audit 2021-03-10T14:56:31.656549+0000 mon.a (mon.0) 1572 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:32.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:32 gibba013 bash[30381]: audit 2021-03-10T14:56:31.657878+0000 mon.a (mon.0) 1573 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:32.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:32 gibba013 bash[30381]: audit 2021-03-10T14:56:31.658957+0000 mon.a (mon.0) 1574 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:32.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:32 gibba013 bash[30381]: audit 2021-03-10T14:56:31.660797+0000 mon.a (mon.0) 1575 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:32.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:32 gibba013 bash[30381]: audit 2021-03-10T14:56:31.662041+0000 mon.a (mon.0) 1576 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:33.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:33 gibba020 bash[25448]: cephadm 2021-03-10T14:56:31.653470+0000 mgr.gibba020.yqfnwy (mgr.34427) 3378 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:56:33.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:33 gibba020 bash[25448]: cephadm 2021-03-10T14:56:31.655156+0000 mgr.gibba020.yqfnwy (mgr.34427) 3379 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:56:33.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:33 gibba020 bash[25448]: cephadm 2021-03-10T14:56:31.656416+0000 mgr.gibba020.yqfnwy (mgr.34427) 3380 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:56:33.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:33 gibba020 bash[25448]: cephadm 2021-03-10T14:56:31.656510+0000 mgr.gibba020.yqfnwy (mgr.34427) 3381 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:56:33.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:33 gibba020 bash[25448]: cephadm 2021-03-10T14:56:31.657624+0000 mgr.gibba020.yqfnwy (mgr.34427) 3382 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:56:33.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:33 gibba020 bash[25448]: cephadm 2021-03-10T14:56:31.657695+0000 mgr.gibba020.yqfnwy (mgr.34427) 3383 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:56:33.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:33 gibba020 bash[25448]: cephadm 2021-03-10T14:56:31.658526+0000 mgr.gibba020.yqfnwy (mgr.34427) 3384 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:56:33.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:33 gibba020 bash[25448]: cephadm 2021-03-10T14:56:31.659335+0000 mgr.gibba020.yqfnwy (mgr.34427) 3385 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:56:33.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:33 gibba020 bash[25448]: cephadm 2021-03-10T14:56:31.659390+0000 mgr.gibba020.yqfnwy (mgr.34427) 3386 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:56:33.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:33 gibba020 bash[25448]: cephadm 2021-03-10T14:56:31.660404+0000 mgr.gibba020.yqfnwy (mgr.34427) 3387 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:56:33.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:33 gibba020 bash[25448]: cephadm 2021-03-10T14:56:31.660731+0000 mgr.gibba020.yqfnwy (mgr.34427) 3388 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:56:33.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:33 gibba020 bash[25448]: cephadm 2021-03-10T14:56:31.661623+0000 mgr.gibba020.yqfnwy (mgr.34427) 3389 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:56:33.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:33 gibba020 bash[25448]: cephadm 2021-03-10T14:56:31.661662+0000 mgr.gibba020.yqfnwy (mgr.34427) 3390 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:56:33.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:33 gibba020 bash[25448]: cephadm 2021-03-10T14:56:31.661768+0000 mgr.gibba020.yqfnwy (mgr.34427) 3391 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:56:33.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:33 gibba013 bash[29418]: cephadm 2021-03-10T14:56:31.653470+0000 mgr.gibba020.yqfnwy (mgr.34427) 3378 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:56:33.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:33 gibba013 bash[29418]: cephadm 2021-03-10T14:56:31.655156+0000 mgr.gibba020.yqfnwy (mgr.34427) 3379 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:56:33.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:33 gibba013 bash[29418]: cephadm 2021-03-10T14:56:31.656416+0000 mgr.gibba020.yqfnwy (mgr.34427) 3380 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:56:33.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:33 gibba013 bash[29418]: cephadm 2021-03-10T14:56:31.656510+0000 mgr.gibba020.yqfnwy (mgr.34427) 3381 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:56:33.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:33 gibba013 bash[29418]: cephadm 2021-03-10T14:56:31.657624+0000 mgr.gibba020.yqfnwy (mgr.34427) 3382 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:56:33.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:33 gibba013 bash[29418]: cephadm 2021-03-10T14:56:31.657695+0000 mgr.gibba020.yqfnwy (mgr.34427) 3383 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:56:33.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:33 gibba013 bash[29418]: cephadm 2021-03-10T14:56:31.658526+0000 mgr.gibba020.yqfnwy (mgr.34427) 3384 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:56:33.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:33 gibba013 bash[29418]: cephadm 2021-03-10T14:56:31.659335+0000 mgr.gibba020.yqfnwy (mgr.34427) 3385 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:56:33.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:33 gibba013 bash[29418]: cephadm 2021-03-10T14:56:31.659390+0000 mgr.gibba020.yqfnwy (mgr.34427) 3386 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:56:33.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:33 gibba013 bash[29418]: cephadm 2021-03-10T14:56:31.660404+0000 mgr.gibba020.yqfnwy (mgr.34427) 3387 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:56:33.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:33 gibba013 bash[29418]: cephadm 2021-03-10T14:56:31.660731+0000 mgr.gibba020.yqfnwy (mgr.34427) 3388 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:56:33.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:33 gibba013 bash[29418]: cephadm 2021-03-10T14:56:31.661623+0000 mgr.gibba020.yqfnwy (mgr.34427) 3389 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:56:33.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:33 gibba013 bash[29418]: cephadm 2021-03-10T14:56:31.661662+0000 mgr.gibba020.yqfnwy (mgr.34427) 3390 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:56:33.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:33 gibba013 bash[29418]: cephadm 2021-03-10T14:56:31.661768+0000 mgr.gibba020.yqfnwy (mgr.34427) 3391 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:56:33.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:33 gibba013 bash[30381]: cephadm 2021-03-10T14:56:31.653470+0000 mgr.gibba020.yqfnwy (mgr.34427) 3378 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:56:33.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:33 gibba013 bash[30381]: cephadm 2021-03-10T14:56:31.655156+0000 mgr.gibba020.yqfnwy (mgr.34427) 3379 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:56:33.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:33 gibba013 bash[30381]: cephadm 2021-03-10T14:56:31.656416+0000 mgr.gibba020.yqfnwy (mgr.34427) 3380 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:56:33.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:33 gibba013 bash[30381]: cephadm 2021-03-10T14:56:31.656510+0000 mgr.gibba020.yqfnwy (mgr.34427) 3381 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:56:33.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:33 gibba013 bash[30381]: cephadm 2021-03-10T14:56:31.657624+0000 mgr.gibba020.yqfnwy (mgr.34427) 3382 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:56:33.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:33 gibba013 bash[30381]: cephadm 2021-03-10T14:56:31.657695+0000 mgr.gibba020.yqfnwy (mgr.34427) 3383 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:56:33.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:33 gibba013 bash[30381]: cephadm 2021-03-10T14:56:31.658526+0000 mgr.gibba020.yqfnwy (mgr.34427) 3384 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:56:33.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:33 gibba013 bash[30381]: cephadm 2021-03-10T14:56:31.659335+0000 mgr.gibba020.yqfnwy (mgr.34427) 3385 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:56:33.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:33 gibba013 bash[30381]: cephadm 2021-03-10T14:56:31.659390+0000 mgr.gibba020.yqfnwy (mgr.34427) 3386 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:56:33.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:33 gibba013 bash[30381]: cephadm 2021-03-10T14:56:31.660404+0000 mgr.gibba020.yqfnwy (mgr.34427) 3387 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:56:33.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:33 gibba013 bash[30381]: cephadm 2021-03-10T14:56:31.660731+0000 mgr.gibba020.yqfnwy (mgr.34427) 3388 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:56:33.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:33 gibba013 bash[30381]: cephadm 2021-03-10T14:56:31.661623+0000 mgr.gibba020.yqfnwy (mgr.34427) 3389 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:56:33.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:33 gibba013 bash[30381]: cephadm 2021-03-10T14:56:31.661662+0000 mgr.gibba020.yqfnwy (mgr.34427) 3390 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:56:33.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:33 gibba013 bash[30381]: cephadm 2021-03-10T14:56:31.661768+0000 mgr.gibba020.yqfnwy (mgr.34427) 3391 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:56:34.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:34 gibba020 bash[25448]: cluster 2021-03-10T14:56:33.096090+0000 mgr.gibba020.yqfnwy (mgr.34427) 3392 : cluster [DBG] pgmap v1917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:34.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:34 gibba013 bash[29418]: cluster 2021-03-10T14:56:33.096090+0000 mgr.gibba020.yqfnwy (mgr.34427) 3392 : cluster [DBG] pgmap v1917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:34.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:34 gibba013 bash[30381]: cluster 2021-03-10T14:56:33.096090+0000 mgr.gibba020.yqfnwy (mgr.34427) 3392 : cluster [DBG] pgmap v1917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:36.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:36 gibba020 bash[25448]: cluster 2021-03-10T14:56:35.098081+0000 mgr.gibba020.yqfnwy (mgr.34427) 3393 : cluster [DBG] pgmap v1918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:36.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:36 gibba013 bash[29418]: cluster 2021-03-10T14:56:35.098081+0000 mgr.gibba020.yqfnwy (mgr.34427) 3393 : cluster [DBG] pgmap v1918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:36.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:36 gibba013 bash[30381]: cluster 2021-03-10T14:56:35.098081+0000 mgr.gibba020.yqfnwy (mgr.34427) 3393 : cluster [DBG] pgmap v1918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:37.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:37 gibba013 bash[29418]: cluster 2021-03-10T14:56:37.099496+0000 mgr.gibba020.yqfnwy (mgr.34427) 3394 : cluster [DBG] pgmap v1919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:37.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:37 gibba013 bash[30381]: cluster 2021-03-10T14:56:37.099496+0000 mgr.gibba020.yqfnwy (mgr.34427) 3394 : cluster [DBG] pgmap v1919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:37.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:37 gibba020 bash[25448]: cluster 2021-03-10T14:56:37.099496+0000 mgr.gibba020.yqfnwy (mgr.34427) 3394 : cluster [DBG] pgmap v1919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:40.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:40 gibba020 bash[25448]: cluster 2021-03-10T14:56:39.101121+0000 mgr.gibba020.yqfnwy (mgr.34427) 3395 : cluster [DBG] pgmap v1920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:40.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:40 gibba013 bash[29418]: cluster 2021-03-10T14:56:39.101121+0000 mgr.gibba020.yqfnwy (mgr.34427) 3395 : cluster [DBG] pgmap v1920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:40.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:40 gibba013 bash[30381]: cluster 2021-03-10T14:56:39.101121+0000 mgr.gibba020.yqfnwy (mgr.34427) 3395 : cluster [DBG] pgmap v1920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:42.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:42 gibba020 bash[25448]: cluster 2021-03-10T14:56:41.102719+0000 mgr.gibba020.yqfnwy (mgr.34427) 3396 : cluster [DBG] pgmap v1921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:42.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:42 gibba013 bash[29418]: cluster 2021-03-10T14:56:41.102719+0000 mgr.gibba020.yqfnwy (mgr.34427) 3396 : cluster [DBG] pgmap v1921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:42.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:42 gibba013 bash[30381]: cluster 2021-03-10T14:56:41.102719+0000 mgr.gibba020.yqfnwy (mgr.34427) 3396 : cluster [DBG] pgmap v1921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:44.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:44 gibba020 bash[25448]: cluster 2021-03-10T14:56:43.103914+0000 mgr.gibba020.yqfnwy (mgr.34427) 3397 : cluster [DBG] pgmap v1922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:44.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:44 gibba013 bash[29418]: cluster 2021-03-10T14:56:43.103914+0000 mgr.gibba020.yqfnwy (mgr.34427) 3397 : cluster [DBG] pgmap v1922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:44.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:44 gibba013 bash[30381]: cluster 2021-03-10T14:56:43.103914+0000 mgr.gibba020.yqfnwy (mgr.34427) 3397 : cluster [DBG] pgmap v1922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:46.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:46 gibba020 bash[25448]: cluster 2021-03-10T14:56:45.105823+0000 mgr.gibba020.yqfnwy (mgr.34427) 3398 : cluster [DBG] pgmap v1923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:46.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:46 gibba013 bash[29418]: cluster 2021-03-10T14:56:45.105823+0000 mgr.gibba020.yqfnwy (mgr.34427) 3398 : cluster [DBG] pgmap v1923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:46.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:46 gibba013 bash[30381]: cluster 2021-03-10T14:56:45.105823+0000 mgr.gibba020.yqfnwy (mgr.34427) 3398 : cluster [DBG] pgmap v1923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:47.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:47 gibba013 bash[29418]: cephadm 2021-03-10T14:56:46.677536+0000 mgr.gibba020.yqfnwy (mgr.34427) 3399 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:56:47.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:47 gibba013 bash[29418]: cluster 2021-03-10T14:56:47.107263+0000 mgr.gibba020.yqfnwy (mgr.34427) 3400 : cluster [DBG] pgmap v1924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:47.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:47 gibba013 bash[30381]: cephadm 2021-03-10T14:56:46.677536+0000 mgr.gibba020.yqfnwy (mgr.34427) 3399 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:56:47.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:47 gibba013 bash[30381]: cluster 2021-03-10T14:56:47.107263+0000 mgr.gibba020.yqfnwy (mgr.34427) 3400 : cluster [DBG] pgmap v1924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:47.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:47 gibba020 bash[25448]: cephadm 2021-03-10T14:56:46.677536+0000 mgr.gibba020.yqfnwy (mgr.34427) 3399 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:56:47.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:47 gibba020 bash[25448]: cluster 2021-03-10T14:56:47.107263+0000 mgr.gibba020.yqfnwy (mgr.34427) 3400 : cluster [DBG] pgmap v1924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:50.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:50 gibba020 bash[25448]: cluster 2021-03-10T14:56:49.116940+0000 mgr.gibba020.yqfnwy (mgr.34427) 3401 : cluster [DBG] pgmap v1925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:50.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:50 gibba013 bash[29418]: cluster 2021-03-10T14:56:49.116940+0000 mgr.gibba020.yqfnwy (mgr.34427) 3401 : cluster [DBG] pgmap v1925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:50.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:50 gibba013 bash[30381]: cluster 2021-03-10T14:56:49.116940+0000 mgr.gibba020.yqfnwy (mgr.34427) 3401 : cluster [DBG] pgmap v1925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:51.177 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:56:51.404 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:56:51.405 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (63m) 8m ago 68m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:56:51.405 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (68m) 7m ago 68m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:56:51.405 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (63m) 7m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:56:51.405 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (64m) 7m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:56:51.405 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (63m) 8m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:56:51.406 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (62m) 8m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:56:51.406 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (62m) 7m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:56:51.406 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (62m) 8m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:56:51.406 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (68m) 8m ago 68m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:56:51.407 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (68m) 7m ago 68m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:56:51.407 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (61m) 8m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:56:51.407 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (61m) 8m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:56:51.407 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (60m) 8m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:56:51.407 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (60m) 8m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:56:51.408 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (59m) 7m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:56:51.408 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (59m) 7m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:56:51.408 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (59m) 7m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:56:51.408 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (58m) 7m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:56:51.408 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (68m) 7m ago 68m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:56:51.409 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 7m ago 66m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:56:51.654 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:56:51.655 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:56:51.655 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:56:51.655 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:56:51.655 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:56:51.656 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:56:51.656 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:56:51.656 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:56:51.656 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:56:51.656 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:56:51.657 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:56:51.657 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:56:51.657 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:56:51.657 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:56:51.657 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:56:52.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:52 gibba020 bash[25448]: cluster 2021-03-10T14:56:51.118541+0000 mgr.gibba020.yqfnwy (mgr.34427) 3402 : cluster [DBG] pgmap v1926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:52.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:52 gibba020 bash[25448]: audit 2021-03-10T14:56:51.164841+0000 mgr.gibba020.yqfnwy (mgr.34427) 3403 : audit [DBG] from='client.56323 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:56:52.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:52 gibba020 bash[25448]: audit 2021-03-10T14:56:51.388541+0000 mgr.gibba020.yqfnwy (mgr.34427) 3404 : audit [DBG] from='client.46344 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:56:52.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:52 gibba020 bash[25448]: audit 2021-03-10T14:56:51.652138+0000 mon.c (mon.1) 62 : audit [DBG] from='client.? 172.21.2.113:0/1317902032' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:52.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:52 gibba013 bash[29418]: cluster 2021-03-10T14:56:51.118541+0000 mgr.gibba020.yqfnwy (mgr.34427) 3402 : cluster [DBG] pgmap v1926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:52.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:52 gibba013 bash[29418]: audit 2021-03-10T14:56:51.164841+0000 mgr.gibba020.yqfnwy (mgr.34427) 3403 : audit [DBG] from='client.56323 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:56:52.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:52 gibba013 bash[29418]: audit 2021-03-10T14:56:51.388541+0000 mgr.gibba020.yqfnwy (mgr.34427) 3404 : audit [DBG] from='client.46344 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:56:52.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:52 gibba013 bash[29418]: audit 2021-03-10T14:56:51.652138+0000 mon.c (mon.1) 62 : audit [DBG] from='client.? 172.21.2.113:0/1317902032' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:52.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:52 gibba013 bash[30381]: cluster 2021-03-10T14:56:51.118541+0000 mgr.gibba020.yqfnwy (mgr.34427) 3402 : cluster [DBG] pgmap v1926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:52.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:52 gibba013 bash[30381]: audit 2021-03-10T14:56:51.164841+0000 mgr.gibba020.yqfnwy (mgr.34427) 3403 : audit [DBG] from='client.56323 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:56:52.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:52 gibba013 bash[30381]: audit 2021-03-10T14:56:51.388541+0000 mgr.gibba020.yqfnwy (mgr.34427) 3404 : audit [DBG] from='client.46344 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:56:52.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:52 gibba013 bash[30381]: audit 2021-03-10T14:56:51.652138+0000 mon.c (mon.1) 62 : audit [DBG] from='client.? 172.21.2.113:0/1317902032' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:56:54.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:54 gibba013 bash[29418]: cluster 2021-03-10T14:56:53.119792+0000 mgr.gibba020.yqfnwy (mgr.34427) 3405 : cluster [DBG] pgmap v1927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:54.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:54 gibba013 bash[30381]: cluster 2021-03-10T14:56:53.119792+0000 mgr.gibba020.yqfnwy (mgr.34427) 3405 : cluster [DBG] pgmap v1927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:54.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:54 gibba020 bash[25448]: cluster 2021-03-10T14:56:53.119792+0000 mgr.gibba020.yqfnwy (mgr.34427) 3405 : cluster [DBG] pgmap v1927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:56.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:56 gibba013 bash[29418]: cluster 2021-03-10T14:56:55.121674+0000 mgr.gibba020.yqfnwy (mgr.34427) 3406 : cluster [DBG] pgmap v1928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:56.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:56 gibba013 bash[30381]: cluster 2021-03-10T14:56:55.121674+0000 mgr.gibba020.yqfnwy (mgr.34427) 3406 : cluster [DBG] pgmap v1928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:56.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:56 gibba020 bash[25448]: cluster 2021-03-10T14:56:55.121674+0000 mgr.gibba020.yqfnwy (mgr.34427) 3406 : cluster [DBG] pgmap v1928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:57.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:56:57 gibba013 bash[29418]: cluster 2021-03-10T14:56:57.122404+0000 mgr.gibba020.yqfnwy (mgr.34427) 3407 : cluster [DBG] pgmap v1929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:57.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:56:57 gibba013 bash[30381]: cluster 2021-03-10T14:56:57.122404+0000 mgr.gibba020.yqfnwy (mgr.34427) 3407 : cluster [DBG] pgmap v1929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:56:57.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:56:57 gibba020 bash[25448]: cluster 2021-03-10T14:56:57.122404+0000 mgr.gibba020.yqfnwy (mgr.34427) 3407 : cluster [DBG] pgmap v1929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:00.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:00 gibba020 bash[25448]: cluster 2021-03-10T14:56:59.123665+0000 mgr.gibba020.yqfnwy (mgr.34427) 3408 : cluster [DBG] pgmap v1930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:00.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:00 gibba013 bash[29418]: cluster 2021-03-10T14:56:59.123665+0000 mgr.gibba020.yqfnwy (mgr.34427) 3408 : cluster [DBG] pgmap v1930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:00.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:00 gibba013 bash[30381]: cluster 2021-03-10T14:56:59.123665+0000 mgr.gibba020.yqfnwy (mgr.34427) 3408 : cluster [DBG] pgmap v1930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:02.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:02 gibba020 bash[25448]: cluster 2021-03-10T14:57:01.125502+0000 mgr.gibba020.yqfnwy (mgr.34427) 3409 : cluster [DBG] pgmap v1931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:02.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:02 gibba013 bash[29418]: cluster 2021-03-10T14:57:01.125502+0000 mgr.gibba020.yqfnwy (mgr.34427) 3409 : cluster [DBG] pgmap v1931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:02.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:02 gibba013 bash[30381]: cluster 2021-03-10T14:57:01.125502+0000 mgr.gibba020.yqfnwy (mgr.34427) 3409 : cluster [DBG] pgmap v1931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:03.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:03 gibba013 bash[29418]: cephadm 2021-03-10T14:57:01.693625+0000 mgr.gibba020.yqfnwy (mgr.34427) 3410 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:57:03.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:03 gibba013 bash[30381]: cephadm 2021-03-10T14:57:01.693625+0000 mgr.gibba020.yqfnwy (mgr.34427) 3410 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:57:03.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:03 gibba020 bash[25448]: cephadm 2021-03-10T14:57:01.693625+0000 mgr.gibba020.yqfnwy (mgr.34427) 3410 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:57:04.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:04 gibba013 bash[29418]: cluster 2021-03-10T14:57:03.126855+0000 mgr.gibba020.yqfnwy (mgr.34427) 3411 : cluster [DBG] pgmap v1932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:04.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:04 gibba013 bash[30381]: cluster 2021-03-10T14:57:03.126855+0000 mgr.gibba020.yqfnwy (mgr.34427) 3411 : cluster [DBG] pgmap v1932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:04.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:04 gibba020 bash[25448]: cluster 2021-03-10T14:57:03.126855+0000 mgr.gibba020.yqfnwy (mgr.34427) 3411 : cluster [DBG] pgmap v1932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:06 gibba013 bash[29418]: cluster 2021-03-10T14:57:05.128715+0000 mgr.gibba020.yqfnwy (mgr.34427) 3412 : cluster [DBG] pgmap v1933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:06.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:06 gibba013 bash[30381]: cluster 2021-03-10T14:57:05.128715+0000 mgr.gibba020.yqfnwy (mgr.34427) 3412 : cluster [DBG] pgmap v1933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:06 gibba020 bash[25448]: cluster 2021-03-10T14:57:05.128715+0000 mgr.gibba020.yqfnwy (mgr.34427) 3412 : cluster [DBG] pgmap v1933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:07.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:07 gibba013 bash[29418]: audit 2021-03-10T14:57:06.301238+0000 mon.a (mon.0) 1577 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:57:07.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:07 gibba013 bash[29418]: audit 2021-03-10T14:57:06.318818+0000 mon.a (mon.0) 1578 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:57:07.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:07 gibba013 bash[29418]: audit 2021-03-10T14:57:06.346668+0000 mon.a (mon.0) 1579 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:57:07.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:07 gibba013 bash[29418]: audit 2021-03-10T14:57:06.347396+0000 mon.a (mon.0) 1580 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:57:07.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:07 gibba013 bash[29418]: audit 2021-03-10T14:57:06.348063+0000 mon.a (mon.0) 1581 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:57:07.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:07 gibba013 bash[29418]: audit 2021-03-10T14:57:06.348726+0000 mon.a (mon.0) 1582 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:57:07.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:07 gibba013 bash[30381]: audit 2021-03-10T14:57:06.301238+0000 mon.a (mon.0) 1577 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:57:07.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:07 gibba013 bash[30381]: audit 2021-03-10T14:57:06.318818+0000 mon.a (mon.0) 1578 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:57:07.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:07 gibba013 bash[30381]: audit 2021-03-10T14:57:06.346668+0000 mon.a (mon.0) 1579 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:57:07.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:07 gibba013 bash[30381]: audit 2021-03-10T14:57:06.347396+0000 mon.a (mon.0) 1580 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:57:07.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:07 gibba013 bash[30381]: audit 2021-03-10T14:57:06.348063+0000 mon.a (mon.0) 1581 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:57:07.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:07 gibba013 bash[30381]: audit 2021-03-10T14:57:06.348726+0000 mon.a (mon.0) 1582 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:57:07.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:07 gibba020 bash[25448]: audit 2021-03-10T14:57:06.301238+0000 mon.a (mon.0) 1577 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:57:07.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:07 gibba020 bash[25448]: audit 2021-03-10T14:57:06.318818+0000 mon.a (mon.0) 1578 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:57:07.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:07 gibba020 bash[25448]: audit 2021-03-10T14:57:06.346668+0000 mon.a (mon.0) 1579 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T14:57:07.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:07 gibba020 bash[25448]: audit 2021-03-10T14:57:06.347396+0000 mon.a (mon.0) 1580 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T14:57:07.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:07 gibba020 bash[25448]: audit 2021-03-10T14:57:06.348063+0000 mon.a (mon.0) 1581 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T14:57:07.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:07 gibba020 bash[25448]: audit 2021-03-10T14:57:06.348726+0000 mon.a (mon.0) 1582 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:57:08.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:08 gibba013 bash[29418]: cluster 2021-03-10T14:57:07.129594+0000 mgr.gibba020.yqfnwy (mgr.34427) 3413 : cluster [DBG] pgmap v1934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:08.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:08 gibba013 bash[30381]: cluster 2021-03-10T14:57:07.129594+0000 mgr.gibba020.yqfnwy (mgr.34427) 3413 : cluster [DBG] pgmap v1934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:08.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:08 gibba020 bash[25448]: cluster 2021-03-10T14:57:07.129594+0000 mgr.gibba020.yqfnwy (mgr.34427) 3413 : cluster [DBG] pgmap v1934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:10.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:10 gibba013 bash[29418]: cluster 2021-03-10T14:57:09.131087+0000 mgr.gibba020.yqfnwy (mgr.34427) 3414 : cluster [DBG] pgmap v1935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:10.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:10 gibba013 bash[30381]: cluster 2021-03-10T14:57:09.131087+0000 mgr.gibba020.yqfnwy (mgr.34427) 3414 : cluster [DBG] pgmap v1935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:10.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:10 gibba020 bash[25448]: cluster 2021-03-10T14:57:09.131087+0000 mgr.gibba020.yqfnwy (mgr.34427) 3414 : cluster [DBG] pgmap v1935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:12.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:12 gibba013 bash[29418]: cluster 2021-03-10T14:57:11.132977+0000 mgr.gibba020.yqfnwy (mgr.34427) 3415 : cluster [DBG] pgmap v1936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:12.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:12 gibba013 bash[30381]: cluster 2021-03-10T14:57:11.132977+0000 mgr.gibba020.yqfnwy (mgr.34427) 3415 : cluster [DBG] pgmap v1936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:12.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:12 gibba020 bash[25448]: cluster 2021-03-10T14:57:11.132977+0000 mgr.gibba020.yqfnwy (mgr.34427) 3415 : cluster [DBG] pgmap v1936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:14.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:14 gibba013 bash[29418]: cluster 2021-03-10T14:57:13.134244+0000 mgr.gibba020.yqfnwy (mgr.34427) 3416 : cluster [DBG] pgmap v1937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:14.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:14 gibba013 bash[30381]: cluster 2021-03-10T14:57:13.134244+0000 mgr.gibba020.yqfnwy (mgr.34427) 3416 : cluster [DBG] pgmap v1937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:14.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:14 gibba020 bash[25448]: cluster 2021-03-10T14:57:13.134244+0000 mgr.gibba020.yqfnwy (mgr.34427) 3416 : cluster [DBG] pgmap v1937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:16.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:16 gibba013 bash[29418]: cluster 2021-03-10T14:57:15.136023+0000 mgr.gibba020.yqfnwy (mgr.34427) 3417 : cluster [DBG] pgmap v1938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:16.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:16 gibba013 bash[30381]: cluster 2021-03-10T14:57:15.136023+0000 mgr.gibba020.yqfnwy (mgr.34427) 3417 : cluster [DBG] pgmap v1938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:16.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:16 gibba020 bash[25448]: cluster 2021-03-10T14:57:15.136023+0000 mgr.gibba020.yqfnwy (mgr.34427) 3417 : cluster [DBG] pgmap v1938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:17.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:17 gibba013 bash[29418]: cephadm 2021-03-10T14:57:16.709442+0000 mgr.gibba020.yqfnwy (mgr.34427) 3418 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:57:17.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:17 gibba013 bash[29418]: cluster 2021-03-10T14:57:17.136460+0000 mgr.gibba020.yqfnwy (mgr.34427) 3419 : cluster [DBG] pgmap v1939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:17.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:17 gibba013 bash[30381]: cephadm 2021-03-10T14:57:16.709442+0000 mgr.gibba020.yqfnwy (mgr.34427) 3418 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:57:17.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:17 gibba013 bash[30381]: cluster 2021-03-10T14:57:17.136460+0000 mgr.gibba020.yqfnwy (mgr.34427) 3419 : cluster [DBG] pgmap v1939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:17.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:17 gibba020 bash[25448]: cephadm 2021-03-10T14:57:16.709442+0000 mgr.gibba020.yqfnwy (mgr.34427) 3418 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:57:17.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:17 gibba020 bash[25448]: cluster 2021-03-10T14:57:17.136460+0000 mgr.gibba020.yqfnwy (mgr.34427) 3419 : cluster [DBG] pgmap v1939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:20.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:20 gibba013 bash[29418]: cluster 2021-03-10T14:57:19.137901+0000 mgr.gibba020.yqfnwy (mgr.34427) 3420 : cluster [DBG] pgmap v1940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:20.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:20 gibba013 bash[30381]: cluster 2021-03-10T14:57:19.137901+0000 mgr.gibba020.yqfnwy (mgr.34427) 3420 : cluster [DBG] pgmap v1940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:20.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:20 gibba020 bash[25448]: cluster 2021-03-10T14:57:19.137901+0000 mgr.gibba020.yqfnwy (mgr.34427) 3420 : cluster [DBG] pgmap v1940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:21.901 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:57:22.130 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:57:22.130 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (63m) 9m ago 69m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:57:22.131 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (69m) 7m ago 69m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:57:22.131 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (64m) 7m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:57:22.132 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (64m) 7m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:57:22.132 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (63m) 9m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:57:22.132 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (63m) 9m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:57:22.133 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (62m) 7m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:57:22.133 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (63m) 9m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:57:22.133 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (69m) 9m ago 69m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:57:22.133 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (69m) 7m ago 69m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:57:22.134 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (62m) 9m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:57:22.134 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (61m) 9m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:57:22.134 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (61m) 9m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:57:22.135 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (60m) 9m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:57:22.135 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (60m) 7m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:57:22.135 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (59m) 7m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:57:22.135 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (59m) 7m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:57:22.136 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (59m) 7m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:57:22.136 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (68m) 7m ago 69m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:57:22.136 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 7m ago 67m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:57:22.381 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:57:22.381 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:57:22.382 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:57:22.382 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:57:22.382 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:57:22.382 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:57:22.382 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:57:22.383 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:57:22.383 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:57:22.383 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:57:22.383 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:57:22.383 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:57:22.384 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:57:22.384 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:57:22.384 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:57:22.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:22 gibba013 bash[29418]: cluster 2021-03-10T14:57:21.139694+0000 mgr.gibba020.yqfnwy (mgr.34427) 3421 : cluster [DBG] pgmap v1941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:22.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:22 gibba013 bash[30381]: cluster 2021-03-10T14:57:21.139694+0000 mgr.gibba020.yqfnwy (mgr.34427) 3421 : cluster [DBG] pgmap v1941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:22.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:22 gibba020 bash[25448]: cluster 2021-03-10T14:57:21.139694+0000 mgr.gibba020.yqfnwy (mgr.34427) 3421 : cluster [DBG] pgmap v1941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:23.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:23 gibba013 bash[29418]: audit 2021-03-10T14:57:21.888275+0000 mgr.gibba020.yqfnwy (mgr.34427) 3422 : audit [DBG] from='client.56341 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:57:23.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:23 gibba013 bash[29418]: audit 2021-03-10T14:57:22.113092+0000 mgr.gibba020.yqfnwy (mgr.34427) 3423 : audit [DBG] from='client.46362 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:57:23.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:23 gibba013 bash[29418]: audit 2021-03-10T14:57:22.378760+0000 mon.a (mon.0) 1583 : audit [DBG] from='client.? 172.21.2.113:0/3540305699' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:23.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:23 gibba013 bash[30381]: audit 2021-03-10T14:57:21.888275+0000 mgr.gibba020.yqfnwy (mgr.34427) 3422 : audit [DBG] from='client.56341 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:57:23.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:23 gibba013 bash[30381]: audit 2021-03-10T14:57:22.113092+0000 mgr.gibba020.yqfnwy (mgr.34427) 3423 : audit [DBG] from='client.46362 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:57:23.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:23 gibba013 bash[30381]: audit 2021-03-10T14:57:22.378760+0000 mon.a (mon.0) 1583 : audit [DBG] from='client.? 172.21.2.113:0/3540305699' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:23.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:23 gibba020 bash[25448]: audit 2021-03-10T14:57:21.888275+0000 mgr.gibba020.yqfnwy (mgr.34427) 3422 : audit [DBG] from='client.56341 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:57:23.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:23 gibba020 bash[25448]: audit 2021-03-10T14:57:22.113092+0000 mgr.gibba020.yqfnwy (mgr.34427) 3423 : audit [DBG] from='client.46362 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:57:23.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:23 gibba020 bash[25448]: audit 2021-03-10T14:57:22.378760+0000 mon.a (mon.0) 1583 : audit [DBG] from='client.? 172.21.2.113:0/3540305699' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:24.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:24 gibba013 bash[29418]: cluster 2021-03-10T14:57:23.140908+0000 mgr.gibba020.yqfnwy (mgr.34427) 3424 : cluster [DBG] pgmap v1942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:24.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:24 gibba013 bash[30381]: cluster 2021-03-10T14:57:23.140908+0000 mgr.gibba020.yqfnwy (mgr.34427) 3424 : cluster [DBG] pgmap v1942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:24.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:24 gibba020 bash[25448]: cluster 2021-03-10T14:57:23.140908+0000 mgr.gibba020.yqfnwy (mgr.34427) 3424 : cluster [DBG] pgmap v1942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:26.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:26 gibba013 bash[30381]: cluster 2021-03-10T14:57:25.142723+0000 mgr.gibba020.yqfnwy (mgr.34427) 3425 : cluster [DBG] pgmap v1943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:26.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:26 gibba013 bash[29418]: cluster 2021-03-10T14:57:25.142723+0000 mgr.gibba020.yqfnwy (mgr.34427) 3425 : cluster [DBG] pgmap v1943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:26.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:26 gibba020 bash[25448]: cluster 2021-03-10T14:57:25.142723+0000 mgr.gibba020.yqfnwy (mgr.34427) 3425 : cluster [DBG] pgmap v1943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:27.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:27 gibba013 bash[29418]: cluster 2021-03-10T14:57:27.143521+0000 mgr.gibba020.yqfnwy (mgr.34427) 3426 : cluster [DBG] pgmap v1944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:27.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:27 gibba013 bash[30381]: cluster 2021-03-10T14:57:27.143521+0000 mgr.gibba020.yqfnwy (mgr.34427) 3426 : cluster [DBG] pgmap v1944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:27.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:27 gibba020 bash[25448]: cluster 2021-03-10T14:57:27.143521+0000 mgr.gibba020.yqfnwy (mgr.34427) 3426 : cluster [DBG] pgmap v1944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:30.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:30 gibba013 bash[29418]: cluster 2021-03-10T14:57:29.145232+0000 mgr.gibba020.yqfnwy (mgr.34427) 3427 : cluster [DBG] pgmap v1945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:30.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:30 gibba013 bash[30381]: cluster 2021-03-10T14:57:29.145232+0000 mgr.gibba020.yqfnwy (mgr.34427) 3427 : cluster [DBG] pgmap v1945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:30.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:30 gibba020 bash[25448]: cluster 2021-03-10T14:57:29.145232+0000 mgr.gibba020.yqfnwy (mgr.34427) 3427 : cluster [DBG] pgmap v1945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:32.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:32 gibba020 bash[25448]: cluster 2021-03-10T14:57:31.147129+0000 mgr.gibba020.yqfnwy (mgr.34427) 3428 : cluster [DBG] pgmap v1946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:32.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:32 gibba020 bash[25448]: audit 2021-03-10T14:57:31.726983+0000 mon.a (mon.0) 1584 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:57:32.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:32 gibba020 bash[25448]: audit 2021-03-10T14:57:31.959616+0000 mon.a (mon.0) 1585 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:57:32.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:32 gibba020 bash[25448]: audit 2021-03-10T14:57:31.963218+0000 mon.a (mon.0) 1586 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:57:32.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:32 gibba020 bash[25448]: audit 2021-03-10T14:57:31.964997+0000 mon.a (mon.0) 1587 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:32.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:32 gibba020 bash[25448]: audit 2021-03-10T14:57:31.966632+0000 mon.a (mon.0) 1588 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:32.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:32 gibba020 bash[25448]: audit 2021-03-10T14:57:31.968225+0000 mon.a (mon.0) 1589 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:32.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:32 gibba020 bash[25448]: audit 2021-03-10T14:57:31.971185+0000 mon.a (mon.0) 1590 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:32.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:32 gibba020 bash[25448]: audit 2021-03-10T14:57:31.972982+0000 mon.a (mon.0) 1591 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:32.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:32 gibba013 bash[29418]: cluster 2021-03-10T14:57:31.147129+0000 mgr.gibba020.yqfnwy (mgr.34427) 3428 : cluster [DBG] pgmap v1946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:32.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:32 gibba013 bash[29418]: audit 2021-03-10T14:57:31.726983+0000 mon.a (mon.0) 1584 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:57:32.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:32 gibba013 bash[29418]: audit 2021-03-10T14:57:31.959616+0000 mon.a (mon.0) 1585 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:57:32.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:32 gibba013 bash[29418]: audit 2021-03-10T14:57:31.963218+0000 mon.a (mon.0) 1586 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:57:32.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:32 gibba013 bash[29418]: audit 2021-03-10T14:57:31.964997+0000 mon.a (mon.0) 1587 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:32.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:32 gibba013 bash[29418]: audit 2021-03-10T14:57:31.966632+0000 mon.a (mon.0) 1588 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:32.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:32 gibba013 bash[29418]: audit 2021-03-10T14:57:31.968225+0000 mon.a (mon.0) 1589 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:32.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:32 gibba013 bash[29418]: audit 2021-03-10T14:57:31.971185+0000 mon.a (mon.0) 1590 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:32.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:32 gibba013 bash[29418]: audit 2021-03-10T14:57:31.972982+0000 mon.a (mon.0) 1591 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:32.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:32 gibba013 bash[30381]: cluster 2021-03-10T14:57:31.147129+0000 mgr.gibba020.yqfnwy (mgr.34427) 3428 : cluster [DBG] pgmap v1946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:32.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:32 gibba013 bash[30381]: audit 2021-03-10T14:57:31.726983+0000 mon.a (mon.0) 1584 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:57:32.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:32 gibba013 bash[30381]: audit 2021-03-10T14:57:31.959616+0000 mon.a (mon.0) 1585 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:57:32.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:32 gibba013 bash[30381]: audit 2021-03-10T14:57:31.963218+0000 mon.a (mon.0) 1586 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:57:32.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:32 gibba013 bash[30381]: audit 2021-03-10T14:57:31.964997+0000 mon.a (mon.0) 1587 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:32.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:32 gibba013 bash[30381]: audit 2021-03-10T14:57:31.966632+0000 mon.a (mon.0) 1588 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:32.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:32 gibba013 bash[30381]: audit 2021-03-10T14:57:31.968225+0000 mon.a (mon.0) 1589 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:32.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:32 gibba013 bash[30381]: audit 2021-03-10T14:57:31.971185+0000 mon.a (mon.0) 1590 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:32.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:32 gibba013 bash[30381]: audit 2021-03-10T14:57:31.972982+0000 mon.a (mon.0) 1591 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:33.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:33 gibba013 bash[29418]: cephadm 2021-03-10T14:57:31.731696+0000 mgr.gibba020.yqfnwy (mgr.34427) 3429 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:57:33.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:33 gibba013 bash[29418]: cephadm 2021-03-10T14:57:31.733295+0000 mgr.gibba020.yqfnwy (mgr.34427) 3430 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:57:33.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:33 gibba013 bash[29418]: cephadm 2021-03-10T14:57:31.961315+0000 mgr.gibba020.yqfnwy (mgr.34427) 3431 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:57:33.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:33 gibba013 bash[29418]: cephadm 2021-03-10T14:57:31.963470+0000 mgr.gibba020.yqfnwy (mgr.34427) 3432 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:57:33.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:33 gibba013 bash[29418]: cephadm 2021-03-10T14:57:31.965088+0000 mgr.gibba020.yqfnwy (mgr.34427) 3433 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:57:33.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:33 gibba013 bash[29418]: cephadm 2021-03-10T14:57:31.965124+0000 mgr.gibba020.yqfnwy (mgr.34427) 3434 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:57:33.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:33 gibba013 bash[29418]: cephadm 2021-03-10T14:57:31.966654+0000 mgr.gibba020.yqfnwy (mgr.34427) 3435 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:57:33.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:33 gibba013 bash[29418]: cephadm 2021-03-10T14:57:31.966729+0000 mgr.gibba020.yqfnwy (mgr.34427) 3436 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:57:33.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:33 gibba013 bash[29418]: cephadm 2021-03-10T14:57:31.968170+0000 mgr.gibba020.yqfnwy (mgr.34427) 3437 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:57:33.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:33 gibba013 bash[29418]: cephadm 2021-03-10T14:57:31.969530+0000 mgr.gibba020.yqfnwy (mgr.34427) 3438 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:57:33.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:33 gibba013 bash[29418]: cephadm 2021-03-10T14:57:31.969603+0000 mgr.gibba020.yqfnwy (mgr.34427) 3439 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:57:33.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:33 gibba013 bash[29418]: cephadm 2021-03-10T14:57:31.971116+0000 mgr.gibba020.yqfnwy (mgr.34427) 3440 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:57:33.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:33 gibba013 bash[29418]: cephadm 2021-03-10T14:57:31.971481+0000 mgr.gibba020.yqfnwy (mgr.34427) 3441 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:57:33.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:33 gibba013 bash[29418]: cephadm 2021-03-10T14:57:31.972778+0000 mgr.gibba020.yqfnwy (mgr.34427) 3442 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:57:33.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:33 gibba013 bash[29418]: cephadm 2021-03-10T14:57:31.972812+0000 mgr.gibba020.yqfnwy (mgr.34427) 3443 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:57:33.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:33 gibba013 bash[29418]: cephadm 2021-03-10T14:57:31.972993+0000 mgr.gibba020.yqfnwy (mgr.34427) 3444 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:57:33.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:33 gibba013 bash[30381]: cephadm 2021-03-10T14:57:31.731696+0000 mgr.gibba020.yqfnwy (mgr.34427) 3429 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:57:33.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:33 gibba013 bash[30381]: cephadm 2021-03-10T14:57:31.733295+0000 mgr.gibba020.yqfnwy (mgr.34427) 3430 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:57:33.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:33 gibba013 bash[30381]: cephadm 2021-03-10T14:57:31.961315+0000 mgr.gibba020.yqfnwy (mgr.34427) 3431 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:57:33.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:33 gibba013 bash[30381]: cephadm 2021-03-10T14:57:31.963470+0000 mgr.gibba020.yqfnwy (mgr.34427) 3432 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:57:33.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:33 gibba013 bash[30381]: cephadm 2021-03-10T14:57:31.965088+0000 mgr.gibba020.yqfnwy (mgr.34427) 3433 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:57:33.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:33 gibba013 bash[30381]: cephadm 2021-03-10T14:57:31.965124+0000 mgr.gibba020.yqfnwy (mgr.34427) 3434 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:57:33.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:33 gibba013 bash[30381]: cephadm 2021-03-10T14:57:31.966654+0000 mgr.gibba020.yqfnwy (mgr.34427) 3435 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:57:33.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:33 gibba013 bash[30381]: cephadm 2021-03-10T14:57:31.966729+0000 mgr.gibba020.yqfnwy (mgr.34427) 3436 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:57:33.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:33 gibba013 bash[30381]: cephadm 2021-03-10T14:57:31.968170+0000 mgr.gibba020.yqfnwy (mgr.34427) 3437 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:57:33.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:33 gibba013 bash[30381]: cephadm 2021-03-10T14:57:31.969530+0000 mgr.gibba020.yqfnwy (mgr.34427) 3438 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:57:33.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:33 gibba013 bash[30381]: cephadm 2021-03-10T14:57:31.969603+0000 mgr.gibba020.yqfnwy (mgr.34427) 3439 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:57:33.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:33 gibba013 bash[30381]: cephadm 2021-03-10T14:57:31.971116+0000 mgr.gibba020.yqfnwy (mgr.34427) 3440 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:57:33.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:33 gibba013 bash[30381]: cephadm 2021-03-10T14:57:31.971481+0000 mgr.gibba020.yqfnwy (mgr.34427) 3441 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:57:33.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:33 gibba013 bash[30381]: cephadm 2021-03-10T14:57:31.972778+0000 mgr.gibba020.yqfnwy (mgr.34427) 3442 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:57:33.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:33 gibba013 bash[30381]: cephadm 2021-03-10T14:57:31.972812+0000 mgr.gibba020.yqfnwy (mgr.34427) 3443 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:57:33.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:33 gibba013 bash[30381]: cephadm 2021-03-10T14:57:31.972993+0000 mgr.gibba020.yqfnwy (mgr.34427) 3444 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:57:33.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:33 gibba020 bash[25448]: cephadm 2021-03-10T14:57:31.731696+0000 mgr.gibba020.yqfnwy (mgr.34427) 3429 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:57:33.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:33 gibba020 bash[25448]: cephadm 2021-03-10T14:57:31.733295+0000 mgr.gibba020.yqfnwy (mgr.34427) 3430 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:57:33.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:33 gibba020 bash[25448]: cephadm 2021-03-10T14:57:31.961315+0000 mgr.gibba020.yqfnwy (mgr.34427) 3431 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:57:33.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:33 gibba020 bash[25448]: cephadm 2021-03-10T14:57:31.963470+0000 mgr.gibba020.yqfnwy (mgr.34427) 3432 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:57:33.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:33 gibba020 bash[25448]: cephadm 2021-03-10T14:57:31.965088+0000 mgr.gibba020.yqfnwy (mgr.34427) 3433 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:57:33.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:33 gibba020 bash[25448]: cephadm 2021-03-10T14:57:31.965124+0000 mgr.gibba020.yqfnwy (mgr.34427) 3434 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:57:33.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:33 gibba020 bash[25448]: cephadm 2021-03-10T14:57:31.966654+0000 mgr.gibba020.yqfnwy (mgr.34427) 3435 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:57:33.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:33 gibba020 bash[25448]: cephadm 2021-03-10T14:57:31.966729+0000 mgr.gibba020.yqfnwy (mgr.34427) 3436 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:57:33.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:33 gibba020 bash[25448]: cephadm 2021-03-10T14:57:31.968170+0000 mgr.gibba020.yqfnwy (mgr.34427) 3437 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:57:33.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:33 gibba020 bash[25448]: cephadm 2021-03-10T14:57:31.969530+0000 mgr.gibba020.yqfnwy (mgr.34427) 3438 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:57:33.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:33 gibba020 bash[25448]: cephadm 2021-03-10T14:57:31.969603+0000 mgr.gibba020.yqfnwy (mgr.34427) 3439 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:57:33.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:33 gibba020 bash[25448]: cephadm 2021-03-10T14:57:31.971116+0000 mgr.gibba020.yqfnwy (mgr.34427) 3440 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:57:33.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:33 gibba020 bash[25448]: cephadm 2021-03-10T14:57:31.971481+0000 mgr.gibba020.yqfnwy (mgr.34427) 3441 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:57:33.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:33 gibba020 bash[25448]: cephadm 2021-03-10T14:57:31.972778+0000 mgr.gibba020.yqfnwy (mgr.34427) 3442 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:57:33.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:33 gibba020 bash[25448]: cephadm 2021-03-10T14:57:31.972812+0000 mgr.gibba020.yqfnwy (mgr.34427) 3443 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:57:33.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:33 gibba020 bash[25448]: cephadm 2021-03-10T14:57:31.972993+0000 mgr.gibba020.yqfnwy (mgr.34427) 3444 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:57:34.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:34 gibba013 bash[29418]: cluster 2021-03-10T14:57:33.148711+0000 mgr.gibba020.yqfnwy (mgr.34427) 3445 : cluster [DBG] pgmap v1947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:34.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:34 gibba013 bash[30381]: cluster 2021-03-10T14:57:33.148711+0000 mgr.gibba020.yqfnwy (mgr.34427) 3445 : cluster [DBG] pgmap v1947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:34.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:34 gibba020 bash[25448]: cluster 2021-03-10T14:57:33.148711+0000 mgr.gibba020.yqfnwy (mgr.34427) 3445 : cluster [DBG] pgmap v1947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:36.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:36 gibba013 bash[29418]: cluster 2021-03-10T14:57:35.150520+0000 mgr.gibba020.yqfnwy (mgr.34427) 3446 : cluster [DBG] pgmap v1948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:36.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:36 gibba013 bash[30381]: cluster 2021-03-10T14:57:35.150520+0000 mgr.gibba020.yqfnwy (mgr.34427) 3446 : cluster [DBG] pgmap v1948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:36.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:36 gibba020 bash[25448]: cluster 2021-03-10T14:57:35.150520+0000 mgr.gibba020.yqfnwy (mgr.34427) 3446 : cluster [DBG] pgmap v1948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:37.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:37 gibba013 bash[29418]: cluster 2021-03-10T14:57:37.151513+0000 mgr.gibba020.yqfnwy (mgr.34427) 3447 : cluster [DBG] pgmap v1949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:37.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:37 gibba013 bash[30381]: cluster 2021-03-10T14:57:37.151513+0000 mgr.gibba020.yqfnwy (mgr.34427) 3447 : cluster [DBG] pgmap v1949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:37.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:37 gibba020 bash[25448]: cluster 2021-03-10T14:57:37.151513+0000 mgr.gibba020.yqfnwy (mgr.34427) 3447 : cluster [DBG] pgmap v1949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:40.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:40 gibba013 bash[29418]: cluster 2021-03-10T14:57:39.153181+0000 mgr.gibba020.yqfnwy (mgr.34427) 3448 : cluster [DBG] pgmap v1950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:40.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:40 gibba013 bash[30381]: cluster 2021-03-10T14:57:39.153181+0000 mgr.gibba020.yqfnwy (mgr.34427) 3448 : cluster [DBG] pgmap v1950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:40.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:40 gibba020 bash[25448]: cluster 2021-03-10T14:57:39.153181+0000 mgr.gibba020.yqfnwy (mgr.34427) 3448 : cluster [DBG] pgmap v1950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:42.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:42 gibba013 bash[29418]: cluster 2021-03-10T14:57:41.154906+0000 mgr.gibba020.yqfnwy (mgr.34427) 3449 : cluster [DBG] pgmap v1951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:42.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:42 gibba013 bash[30381]: cluster 2021-03-10T14:57:41.154906+0000 mgr.gibba020.yqfnwy (mgr.34427) 3449 : cluster [DBG] pgmap v1951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:42.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:42 gibba020 bash[25448]: cluster 2021-03-10T14:57:41.154906+0000 mgr.gibba020.yqfnwy (mgr.34427) 3449 : cluster [DBG] pgmap v1951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:44.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:44 gibba013 bash[29418]: cluster 2021-03-10T14:57:43.156623+0000 mgr.gibba020.yqfnwy (mgr.34427) 3450 : cluster [DBG] pgmap v1952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:44.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:44 gibba013 bash[30381]: cluster 2021-03-10T14:57:43.156623+0000 mgr.gibba020.yqfnwy (mgr.34427) 3450 : cluster [DBG] pgmap v1952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:44.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:44 gibba020 bash[25448]: cluster 2021-03-10T14:57:43.156623+0000 mgr.gibba020.yqfnwy (mgr.34427) 3450 : cluster [DBG] pgmap v1952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:46.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:46 gibba013 bash[30381]: cluster 2021-03-10T14:57:45.158525+0000 mgr.gibba020.yqfnwy (mgr.34427) 3451 : cluster [DBG] pgmap v1953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:46.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:46 gibba013 bash[29418]: cluster 2021-03-10T14:57:45.158525+0000 mgr.gibba020.yqfnwy (mgr.34427) 3451 : cluster [DBG] pgmap v1953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:46.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:46 gibba020 bash[25448]: cluster 2021-03-10T14:57:45.158525+0000 mgr.gibba020.yqfnwy (mgr.34427) 3451 : cluster [DBG] pgmap v1953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:47.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:47 gibba013 bash[29418]: cephadm 2021-03-10T14:57:46.989021+0000 mgr.gibba020.yqfnwy (mgr.34427) 3452 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:57:47.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:47 gibba013 bash[29418]: cluster 2021-03-10T14:57:47.159968+0000 mgr.gibba020.yqfnwy (mgr.34427) 3453 : cluster [DBG] pgmap v1954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:47.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:47 gibba013 bash[30381]: cephadm 2021-03-10T14:57:46.989021+0000 mgr.gibba020.yqfnwy (mgr.34427) 3452 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:57:47.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:47 gibba013 bash[30381]: cluster 2021-03-10T14:57:47.159968+0000 mgr.gibba020.yqfnwy (mgr.34427) 3453 : cluster [DBG] pgmap v1954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:47.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:47 gibba020 bash[25448]: cephadm 2021-03-10T14:57:46.989021+0000 mgr.gibba020.yqfnwy (mgr.34427) 3452 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:57:47.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:47 gibba020 bash[25448]: cluster 2021-03-10T14:57:47.159968+0000 mgr.gibba020.yqfnwy (mgr.34427) 3453 : cluster [DBG] pgmap v1954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:50.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:50 gibba013 bash[29418]: cluster 2021-03-10T14:57:49.161630+0000 mgr.gibba020.yqfnwy (mgr.34427) 3454 : cluster [DBG] pgmap v1955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:50.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:50 gibba013 bash[30381]: cluster 2021-03-10T14:57:49.161630+0000 mgr.gibba020.yqfnwy (mgr.34427) 3454 : cluster [DBG] pgmap v1955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:50.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:50 gibba020 bash[25448]: cluster 2021-03-10T14:57:49.161630+0000 mgr.gibba020.yqfnwy (mgr.34427) 3454 : cluster [DBG] pgmap v1955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:52.626 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:57:52.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:52 gibba013 bash[30381]: cluster 2021-03-10T14:57:51.163201+0000 mgr.gibba020.yqfnwy (mgr.34427) 3455 : cluster [DBG] pgmap v1956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:52.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:52 gibba013 bash[29418]: cluster 2021-03-10T14:57:51.163201+0000 mgr.gibba020.yqfnwy (mgr.34427) 3455 : cluster [DBG] pgmap v1956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:52.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:52 gibba020 bash[25448]: cluster 2021-03-10T14:57:51.163201+0000 mgr.gibba020.yqfnwy (mgr.34427) 3455 : cluster [DBG] pgmap v1956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:52.852 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:57:52.852 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (64m) 9m ago 69m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:57:52.853 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (69m) 8m ago 69m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:57:52.853 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (64m) 8m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:57:52.853 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (65m) 8m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:57:52.853 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (64m) 9m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:57:52.853 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (63m) 9m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:57:52.854 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (63m) 8m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:57:52.854 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (63m) 9m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:57:52.854 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (69m) 9m ago 69m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:57:52.854 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (69m) 8m ago 69m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:57:52.854 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (62m) 9m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:57:52.855 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (62m) 9m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:57:52.855 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (61m) 9m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:57:52.855 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (61m) 9m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:57:52.855 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (60m) 8m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:57:52.855 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (60m) 8m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:57:52.856 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (60m) 8m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:57:52.856 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (59m) 8m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:57:52.856 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (69m) 8m ago 69m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:57:52.856 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 8m ago 67m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:57:53.101 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:57:53.101 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:57:53.101 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:57:53.102 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:57:53.102 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:57:53.102 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:57:53.102 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:57:53.103 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:57:53.103 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:57:53.103 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:57:53.103 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:57:53.104 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:57:53.104 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:57:53.104 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:57:53.104 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:57:53.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:53 gibba013 bash[29418]: audit 2021-03-10T14:57:53.098511+0000 mon.c (mon.1) 63 : audit [DBG] from='client.? 172.21.2.113:0/3080495099' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:53.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:53 gibba013 bash[30381]: audit 2021-03-10T14:57:53.098511+0000 mon.c (mon.1) 63 : audit [DBG] from='client.? 172.21.2.113:0/3080495099' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:53.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:53 gibba020 bash[25448]: audit 2021-03-10T14:57:53.098511+0000 mon.c (mon.1) 63 : audit [DBG] from='client.? 172.21.2.113:0/3080495099' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:57:54.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:54 gibba013 bash[29418]: audit 2021-03-10T14:57:52.613192+0000 mgr.gibba020.yqfnwy (mgr.34427) 3456 : audit [DBG] from='client.46374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:57:54.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:54 gibba013 bash[29418]: audit 2021-03-10T14:57:52.835828+0000 mgr.gibba020.yqfnwy (mgr.34427) 3457 : audit [DBG] from='client.46380 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:57:54.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:54 gibba013 bash[29418]: cluster 2021-03-10T14:57:53.164603+0000 mgr.gibba020.yqfnwy (mgr.34427) 3458 : cluster [DBG] pgmap v1957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:54.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:54 gibba013 bash[30381]: audit 2021-03-10T14:57:52.613192+0000 mgr.gibba020.yqfnwy (mgr.34427) 3456 : audit [DBG] from='client.46374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:57:54.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:54 gibba013 bash[30381]: audit 2021-03-10T14:57:52.835828+0000 mgr.gibba020.yqfnwy (mgr.34427) 3457 : audit [DBG] from='client.46380 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:57:54.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:54 gibba013 bash[30381]: cluster 2021-03-10T14:57:53.164603+0000 mgr.gibba020.yqfnwy (mgr.34427) 3458 : cluster [DBG] pgmap v1957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:54.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:54 gibba020 bash[25448]: audit 2021-03-10T14:57:52.613192+0000 mgr.gibba020.yqfnwy (mgr.34427) 3456 : audit [DBG] from='client.46374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:57:54.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:54 gibba020 bash[25448]: audit 2021-03-10T14:57:52.835828+0000 mgr.gibba020.yqfnwy (mgr.34427) 3457 : audit [DBG] from='client.46380 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:57:54.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:54 gibba020 bash[25448]: cluster 2021-03-10T14:57:53.164603+0000 mgr.gibba020.yqfnwy (mgr.34427) 3458 : cluster [DBG] pgmap v1957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:56.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:56 gibba013 bash[30381]: cluster 2021-03-10T14:57:55.166347+0000 mgr.gibba020.yqfnwy (mgr.34427) 3459 : cluster [DBG] pgmap v1958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:56.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:56 gibba013 bash[29418]: cluster 2021-03-10T14:57:55.166347+0000 mgr.gibba020.yqfnwy (mgr.34427) 3459 : cluster [DBG] pgmap v1958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:56.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:56 gibba020 bash[25448]: cluster 2021-03-10T14:57:55.166347+0000 mgr.gibba020.yqfnwy (mgr.34427) 3459 : cluster [DBG] pgmap v1958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:57.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:57:57 gibba013 bash[29418]: cluster 2021-03-10T14:57:57.167189+0000 mgr.gibba020.yqfnwy (mgr.34427) 3460 : cluster [DBG] pgmap v1959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:57.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:57:57 gibba013 bash[30381]: cluster 2021-03-10T14:57:57.167189+0000 mgr.gibba020.yqfnwy (mgr.34427) 3460 : cluster [DBG] pgmap v1959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:57:57.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:57:57 gibba020 bash[25448]: cluster 2021-03-10T14:57:57.167189+0000 mgr.gibba020.yqfnwy (mgr.34427) 3460 : cluster [DBG] pgmap v1959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:00.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:00 gibba013 bash[29418]: cluster 2021-03-10T14:57:59.167881+0000 mgr.gibba020.yqfnwy (mgr.34427) 3461 : cluster [DBG] pgmap v1960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:00.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:00 gibba013 bash[30381]: cluster 2021-03-10T14:57:59.167881+0000 mgr.gibba020.yqfnwy (mgr.34427) 3461 : cluster [DBG] pgmap v1960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:00.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:00 gibba020 bash[25448]: cluster 2021-03-10T14:57:59.167881+0000 mgr.gibba020.yqfnwy (mgr.34427) 3461 : cluster [DBG] pgmap v1960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:02.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:02 gibba020 bash[25448]: cluster 2021-03-10T14:58:01.169461+0000 mgr.gibba020.yqfnwy (mgr.34427) 3462 : cluster [DBG] pgmap v1961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:02.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:02 gibba013 bash[29418]: cluster 2021-03-10T14:58:01.169461+0000 mgr.gibba020.yqfnwy (mgr.34427) 3462 : cluster [DBG] pgmap v1961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:02.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:02 gibba013 bash[30381]: cluster 2021-03-10T14:58:01.169461+0000 mgr.gibba020.yqfnwy (mgr.34427) 3462 : cluster [DBG] pgmap v1961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:03.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:03 gibba013 bash[29418]: cephadm 2021-03-10T14:58:02.001012+0000 mgr.gibba020.yqfnwy (mgr.34427) 3463 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:58:03.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:03 gibba013 bash[30381]: cephadm 2021-03-10T14:58:02.001012+0000 mgr.gibba020.yqfnwy (mgr.34427) 3463 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:58:03.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:03 gibba020 bash[25448]: cephadm 2021-03-10T14:58:02.001012+0000 mgr.gibba020.yqfnwy (mgr.34427) 3463 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:58:04.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:04 gibba013 bash[29418]: cluster 2021-03-10T14:58:03.170905+0000 mgr.gibba020.yqfnwy (mgr.34427) 3464 : cluster [DBG] pgmap v1962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:04.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:04 gibba013 bash[30381]: cluster 2021-03-10T14:58:03.170905+0000 mgr.gibba020.yqfnwy (mgr.34427) 3464 : cluster [DBG] pgmap v1962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:04.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:04 gibba020 bash[25448]: cluster 2021-03-10T14:58:03.170905+0000 mgr.gibba020.yqfnwy (mgr.34427) 3464 : cluster [DBG] pgmap v1962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:06 gibba013 bash[29418]: cluster 2021-03-10T14:58:05.172567+0000 mgr.gibba020.yqfnwy (mgr.34427) 3465 : cluster [DBG] pgmap v1963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:06 gibba013 bash[30381]: cluster 2021-03-10T14:58:05.172567+0000 mgr.gibba020.yqfnwy (mgr.34427) 3465 : cluster [DBG] pgmap v1963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:06 gibba020 bash[25448]: cluster 2021-03-10T14:58:05.172567+0000 mgr.gibba020.yqfnwy (mgr.34427) 3465 : cluster [DBG] pgmap v1963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:07.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:07 gibba013 bash[29418]: audit 2021-03-10T14:58:06.304127+0000 mon.a (mon.0) 1592 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:58:07.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:07 gibba013 bash[29418]: audit 2021-03-10T14:58:06.324061+0000 mon.a (mon.0) 1593 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:58:07.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:07 gibba013 bash[29418]: audit 2021-03-10T14:58:06.355807+0000 mon.a (mon.0) 1594 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T14:58:07.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:07 gibba013 bash[29418]: audit 2021-03-10T14:58:06.356521+0000 mon.a (mon.0) 1595 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T14:58:07.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:07 gibba013 bash[29418]: audit 2021-03-10T14:58:06.357154+0000 mon.a (mon.0) 1596 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:58:07.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:07 gibba013 bash[29418]: audit 2021-03-10T14:58:06.357808+0000 mon.a (mon.0) 1597 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:58:07.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:07 gibba013 bash[30381]: audit 2021-03-10T14:58:06.304127+0000 mon.a (mon.0) 1592 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:58:07.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:07 gibba013 bash[30381]: audit 2021-03-10T14:58:06.324061+0000 mon.a (mon.0) 1593 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:58:07.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:07 gibba013 bash[30381]: audit 2021-03-10T14:58:06.355807+0000 mon.a (mon.0) 1594 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T14:58:07.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:07 gibba013 bash[30381]: audit 2021-03-10T14:58:06.356521+0000 mon.a (mon.0) 1595 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T14:58:07.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:07 gibba013 bash[30381]: audit 2021-03-10T14:58:06.357154+0000 mon.a (mon.0) 1596 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:58:07.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:07 gibba013 bash[30381]: audit 2021-03-10T14:58:06.357808+0000 mon.a (mon.0) 1597 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:58:07.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:07 gibba020 bash[25448]: audit 2021-03-10T14:58:06.304127+0000 mon.a (mon.0) 1592 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:58:07.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:07 gibba020 bash[25448]: audit 2021-03-10T14:58:06.324061+0000 mon.a (mon.0) 1593 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:58:07.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:07 gibba020 bash[25448]: audit 2021-03-10T14:58:06.355807+0000 mon.a (mon.0) 1594 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T14:58:07.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:07 gibba020 bash[25448]: audit 2021-03-10T14:58:06.356521+0000 mon.a (mon.0) 1595 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T14:58:07.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:07 gibba020 bash[25448]: audit 2021-03-10T14:58:06.357154+0000 mon.a (mon.0) 1596 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T14:58:07.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:07 gibba020 bash[25448]: audit 2021-03-10T14:58:06.357808+0000 mon.a (mon.0) 1597 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:58:08.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:08 gibba013 bash[29418]: cluster 2021-03-10T14:58:07.173971+0000 mgr.gibba020.yqfnwy (mgr.34427) 3466 : cluster [DBG] pgmap v1964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:08.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:08 gibba013 bash[30381]: cluster 2021-03-10T14:58:07.173971+0000 mgr.gibba020.yqfnwy (mgr.34427) 3466 : cluster [DBG] pgmap v1964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:08.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:08 gibba020 bash[25448]: cluster 2021-03-10T14:58:07.173971+0000 mgr.gibba020.yqfnwy (mgr.34427) 3466 : cluster [DBG] pgmap v1964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:10.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:10 gibba013 bash[29418]: cluster 2021-03-10T14:58:09.175613+0000 mgr.gibba020.yqfnwy (mgr.34427) 3467 : cluster [DBG] pgmap v1965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:10.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:10 gibba013 bash[30381]: cluster 2021-03-10T14:58:09.175613+0000 mgr.gibba020.yqfnwy (mgr.34427) 3467 : cluster [DBG] pgmap v1965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:10.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:10 gibba020 bash[25448]: cluster 2021-03-10T14:58:09.175613+0000 mgr.gibba020.yqfnwy (mgr.34427) 3467 : cluster [DBG] pgmap v1965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:12.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:12 gibba013 bash[29418]: cluster 2021-03-10T14:58:11.177245+0000 mgr.gibba020.yqfnwy (mgr.34427) 3468 : cluster [DBG] pgmap v1966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:12.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:12 gibba013 bash[30381]: cluster 2021-03-10T14:58:11.177245+0000 mgr.gibba020.yqfnwy (mgr.34427) 3468 : cluster [DBG] pgmap v1966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:12.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:12 gibba020 bash[25448]: cluster 2021-03-10T14:58:11.177245+0000 mgr.gibba020.yqfnwy (mgr.34427) 3468 : cluster [DBG] pgmap v1966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:14.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:14 gibba013 bash[29418]: cluster 2021-03-10T14:58:13.178633+0000 mgr.gibba020.yqfnwy (mgr.34427) 3469 : cluster [DBG] pgmap v1967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:14.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:14 gibba013 bash[30381]: cluster 2021-03-10T14:58:13.178633+0000 mgr.gibba020.yqfnwy (mgr.34427) 3469 : cluster [DBG] pgmap v1967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:14.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:14 gibba020 bash[25448]: cluster 2021-03-10T14:58:13.178633+0000 mgr.gibba020.yqfnwy (mgr.34427) 3469 : cluster [DBG] pgmap v1967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:16.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:16 gibba013 bash[29418]: cluster 2021-03-10T14:58:15.180338+0000 mgr.gibba020.yqfnwy (mgr.34427) 3470 : cluster [DBG] pgmap v1968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:16.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:16 gibba013 bash[30381]: cluster 2021-03-10T14:58:15.180338+0000 mgr.gibba020.yqfnwy (mgr.34427) 3470 : cluster [DBG] pgmap v1968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:16.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:16 gibba020 bash[25448]: cluster 2021-03-10T14:58:15.180338+0000 mgr.gibba020.yqfnwy (mgr.34427) 3470 : cluster [DBG] pgmap v1968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:17.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:17 gibba013 bash[29418]: cephadm 2021-03-10T14:58:17.016875+0000 mgr.gibba020.yqfnwy (mgr.34427) 3471 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:58:17.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:17 gibba013 bash[29418]: cluster 2021-03-10T14:58:17.181147+0000 mgr.gibba020.yqfnwy (mgr.34427) 3472 : cluster [DBG] pgmap v1969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:17.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:17 gibba013 bash[30381]: cephadm 2021-03-10T14:58:17.016875+0000 mgr.gibba020.yqfnwy (mgr.34427) 3471 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:58:17.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:17 gibba013 bash[30381]: cluster 2021-03-10T14:58:17.181147+0000 mgr.gibba020.yqfnwy (mgr.34427) 3472 : cluster [DBG] pgmap v1969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:17.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:17 gibba020 bash[25448]: cephadm 2021-03-10T14:58:17.016875+0000 mgr.gibba020.yqfnwy (mgr.34427) 3471 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:58:17.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:17 gibba020 bash[25448]: cluster 2021-03-10T14:58:17.181147+0000 mgr.gibba020.yqfnwy (mgr.34427) 3472 : cluster [DBG] pgmap v1969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:20.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:20 gibba013 bash[29418]: cluster 2021-03-10T14:58:19.182727+0000 mgr.gibba020.yqfnwy (mgr.34427) 3473 : cluster [DBG] pgmap v1970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:20.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:20 gibba013 bash[30381]: cluster 2021-03-10T14:58:19.182727+0000 mgr.gibba020.yqfnwy (mgr.34427) 3473 : cluster [DBG] pgmap v1970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:20.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:20 gibba020 bash[25448]: cluster 2021-03-10T14:58:19.182727+0000 mgr.gibba020.yqfnwy (mgr.34427) 3473 : cluster [DBG] pgmap v1970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:22.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:22 gibba013 bash[29418]: cluster 2021-03-10T14:58:21.184609+0000 mgr.gibba020.yqfnwy (mgr.34427) 3474 : cluster [DBG] pgmap v1971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:22.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:22 gibba013 bash[30381]: cluster 2021-03-10T14:58:21.184609+0000 mgr.gibba020.yqfnwy (mgr.34427) 3474 : cluster [DBG] pgmap v1971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:22.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:22 gibba020 bash[25448]: cluster 2021-03-10T14:58:21.184609+0000 mgr.gibba020.yqfnwy (mgr.34427) 3474 : cluster [DBG] pgmap v1971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:23.342 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:58:23.566 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:58:23.567 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (64m) 10m ago 70m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:58:23.567 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (70m) 8m ago 70m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:58:23.567 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (65m) 8m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:58:23.567 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (65m) 8m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:58:23.568 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (64m) 10m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:58:23.568 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (64m) 10m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:58:23.568 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (63m) 8m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:58:23.568 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (64m) 10m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:58:23.568 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (70m) 10m ago 70m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:58:23.568 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (70m) 8m ago 70m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:58:23.569 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (63m) 10m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:58:23.569 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (62m) 10m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:58:23.569 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (62m) 10m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:58:23.569 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (61m) 10m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:58:23.569 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (61m) 8m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:58:23.570 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (61m) 8m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:58:23.570 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (60m) 8m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:58:23.570 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (60m) 8m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:58:23.570 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (69m) 8m ago 70m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:58:23.570 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 8m ago 68m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:58:23.817 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:58:23.817 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:58:23.817 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:58:23.818 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:58:23.818 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:58:23.818 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:58:23.819 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:58:23.819 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:58:23.819 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:58:23.820 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:58:23.820 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:58:23.820 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:58:23.821 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:58:23.821 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:58:23.821 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:58:24.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:24 gibba013 bash[29418]: cluster 2021-03-10T14:58:23.186037+0000 mgr.gibba020.yqfnwy (mgr.34427) 3475 : cluster [DBG] pgmap v1972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:24.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:24 gibba013 bash[29418]: audit 2021-03-10T14:58:23.329217+0000 mgr.gibba020.yqfnwy (mgr.34427) 3476 : audit [DBG] from='client.46392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:58:24.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:24 gibba013 bash[29418]: audit 2021-03-10T14:58:23.550347+0000 mgr.gibba020.yqfnwy (mgr.34427) 3477 : audit [DBG] from='client.56383 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:58:24.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:24 gibba013 bash[29418]: audit 2021-03-10T14:58:23.814269+0000 mon.c (mon.1) 64 : audit [DBG] from='client.? 172.21.2.113:0/3410190917' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:24.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:24 gibba013 bash[30381]: cluster 2021-03-10T14:58:23.186037+0000 mgr.gibba020.yqfnwy (mgr.34427) 3475 : cluster [DBG] pgmap v1972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:24.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:24 gibba013 bash[30381]: audit 2021-03-10T14:58:23.329217+0000 mgr.gibba020.yqfnwy (mgr.34427) 3476 : audit [DBG] from='client.46392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:58:24.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:24 gibba013 bash[30381]: audit 2021-03-10T14:58:23.550347+0000 mgr.gibba020.yqfnwy (mgr.34427) 3477 : audit [DBG] from='client.56383 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:58:24.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:24 gibba013 bash[30381]: audit 2021-03-10T14:58:23.814269+0000 mon.c (mon.1) 64 : audit [DBG] from='client.? 172.21.2.113:0/3410190917' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:24.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:24 gibba020 bash[25448]: cluster 2021-03-10T14:58:23.186037+0000 mgr.gibba020.yqfnwy (mgr.34427) 3475 : cluster [DBG] pgmap v1972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:24.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:24 gibba020 bash[25448]: audit 2021-03-10T14:58:23.329217+0000 mgr.gibba020.yqfnwy (mgr.34427) 3476 : audit [DBG] from='client.46392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:58:24.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:24 gibba020 bash[25448]: audit 2021-03-10T14:58:23.550347+0000 mgr.gibba020.yqfnwy (mgr.34427) 3477 : audit [DBG] from='client.56383 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:58:24.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:24 gibba020 bash[25448]: audit 2021-03-10T14:58:23.814269+0000 mon.c (mon.1) 64 : audit [DBG] from='client.? 172.21.2.113:0/3410190917' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:26.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:26 gibba013 bash[29418]: cluster 2021-03-10T14:58:25.187636+0000 mgr.gibba020.yqfnwy (mgr.34427) 3478 : cluster [DBG] pgmap v1973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:26.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:26 gibba013 bash[30381]: cluster 2021-03-10T14:58:25.187636+0000 mgr.gibba020.yqfnwy (mgr.34427) 3478 : cluster [DBG] pgmap v1973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:26.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:26 gibba020 bash[25448]: cluster 2021-03-10T14:58:25.187636+0000 mgr.gibba020.yqfnwy (mgr.34427) 3478 : cluster [DBG] pgmap v1973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:27.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:27 gibba013 bash[29418]: cluster 2021-03-10T14:58:27.188463+0000 mgr.gibba020.yqfnwy (mgr.34427) 3479 : cluster [DBG] pgmap v1974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:27.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:27 gibba013 bash[30381]: cluster 2021-03-10T14:58:27.188463+0000 mgr.gibba020.yqfnwy (mgr.34427) 3479 : cluster [DBG] pgmap v1974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:27.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:27 gibba020 bash[25448]: cluster 2021-03-10T14:58:27.188463+0000 mgr.gibba020.yqfnwy (mgr.34427) 3479 : cluster [DBG] pgmap v1974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:30.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:30 gibba013 bash[29418]: cluster 2021-03-10T14:58:29.189903+0000 mgr.gibba020.yqfnwy (mgr.34427) 3480 : cluster [DBG] pgmap v1975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:30.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:30 gibba013 bash[30381]: cluster 2021-03-10T14:58:29.189903+0000 mgr.gibba020.yqfnwy (mgr.34427) 3480 : cluster [DBG] pgmap v1975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:30.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:30 gibba020 bash[25448]: cluster 2021-03-10T14:58:29.189903+0000 mgr.gibba020.yqfnwy (mgr.34427) 3480 : cluster [DBG] pgmap v1975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:32.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:32 gibba013 bash[29418]: cluster 2021-03-10T14:58:31.191732+0000 mgr.gibba020.yqfnwy (mgr.34427) 3481 : cluster [DBG] pgmap v1976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:32.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:32 gibba013 bash[29418]: audit 2021-03-10T14:58:32.034588+0000 mon.a (mon.0) 1598 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:58:32.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:32 gibba013 bash[29418]: audit 2021-03-10T14:58:32.041010+0000 mon.a (mon.0) 1599 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:58:32.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:32 gibba013 bash[30381]: cluster 2021-03-10T14:58:31.191732+0000 mgr.gibba020.yqfnwy (mgr.34427) 3481 : cluster [DBG] pgmap v1976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:32.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:32 gibba013 bash[30381]: audit 2021-03-10T14:58:32.034588+0000 mon.a (mon.0) 1598 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:58:32.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:32 gibba013 bash[30381]: audit 2021-03-10T14:58:32.041010+0000 mon.a (mon.0) 1599 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:58:32.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:32 gibba020 bash[25448]: cluster 2021-03-10T14:58:31.191732+0000 mgr.gibba020.yqfnwy (mgr.34427) 3481 : cluster [DBG] pgmap v1976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:32.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:32 gibba020 bash[25448]: audit 2021-03-10T14:58:32.034588+0000 mon.a (mon.0) 1598 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:58:32.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:32 gibba020 bash[25448]: audit 2021-03-10T14:58:32.041010+0000 mon.a (mon.0) 1599 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:58:33.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:33 gibba013 bash[29418]: cephadm 2021-03-10T14:58:32.039613+0000 mgr.gibba020.yqfnwy (mgr.34427) 3482 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:58:33.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:33 gibba013 bash[30381]: cephadm 2021-03-10T14:58:32.039613+0000 mgr.gibba020.yqfnwy (mgr.34427) 3482 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:58:33.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:33 gibba020 bash[25448]: cephadm 2021-03-10T14:58:32.039613+0000 mgr.gibba020.yqfnwy (mgr.34427) 3482 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:58:34.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:34 gibba013 bash[29418]: cluster 2021-03-10T14:58:33.193146+0000 mgr.gibba020.yqfnwy (mgr.34427) 3483 : cluster [DBG] pgmap v1977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:34.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:34 gibba013 bash[30381]: cluster 2021-03-10T14:58:33.193146+0000 mgr.gibba020.yqfnwy (mgr.34427) 3483 : cluster [DBG] pgmap v1977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:34.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:34 gibba020 bash[25448]: cluster 2021-03-10T14:58:33.193146+0000 mgr.gibba020.yqfnwy (mgr.34427) 3483 : cluster [DBG] pgmap v1977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:36.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:36 gibba013 bash[29418]: cluster 2021-03-10T14:58:35.194132+0000 mgr.gibba020.yqfnwy (mgr.34427) 3484 : cluster [DBG] pgmap v1978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:36.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:36 gibba013 bash[29418]: cephadm 2021-03-10T14:58:35.518759+0000 mgr.gibba020.yqfnwy (mgr.34427) 3485 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:58:36.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:36 gibba013 bash[29418]: audit 2021-03-10T14:58:35.519167+0000 mon.a (mon.0) 1600 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:58:36.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:36 gibba013 bash[29418]: audit 2021-03-10T14:58:35.746294+0000 mon.a (mon.0) 1601 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:58:36.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:36 gibba013 bash[29418]: audit 2021-03-10T14:58:35.762158+0000 mon.a (mon.0) 1602 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:58:36.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:36 gibba013 bash[29418]: audit 2021-03-10T14:58:35.766497+0000 mon.a (mon.0) 1603 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:36.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:36 gibba013 bash[29418]: audit 2021-03-10T14:58:35.770328+0000 mon.a (mon.0) 1604 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:36.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:36 gibba013 bash[29418]: audit 2021-03-10T14:58:35.773889+0000 mon.a (mon.0) 1605 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:36.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:36 gibba013 bash[29418]: audit 2021-03-10T14:58:35.781587+0000 mon.a (mon.0) 1606 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:36.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:36 gibba013 bash[29418]: audit 2021-03-10T14:58:35.786972+0000 mon.a (mon.0) 1607 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:36.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:36 gibba013 bash[30381]: cluster 2021-03-10T14:58:35.194132+0000 mgr.gibba020.yqfnwy (mgr.34427) 3484 : cluster [DBG] pgmap v1978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:36.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:36 gibba013 bash[30381]: cephadm 2021-03-10T14:58:35.518759+0000 mgr.gibba020.yqfnwy (mgr.34427) 3485 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:58:36.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:36 gibba013 bash[30381]: audit 2021-03-10T14:58:35.519167+0000 mon.a (mon.0) 1600 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:58:36.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:36 gibba013 bash[30381]: audit 2021-03-10T14:58:35.746294+0000 mon.a (mon.0) 1601 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:58:36.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:36 gibba013 bash[30381]: audit 2021-03-10T14:58:35.762158+0000 mon.a (mon.0) 1602 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:58:36.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:36 gibba013 bash[30381]: audit 2021-03-10T14:58:35.766497+0000 mon.a (mon.0) 1603 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:36.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:36 gibba013 bash[30381]: audit 2021-03-10T14:58:35.770328+0000 mon.a (mon.0) 1604 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:36.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:36 gibba013 bash[30381]: audit 2021-03-10T14:58:35.773889+0000 mon.a (mon.0) 1605 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:36.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:36 gibba013 bash[30381]: audit 2021-03-10T14:58:35.781587+0000 mon.a (mon.0) 1606 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:36.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:36 gibba013 bash[30381]: audit 2021-03-10T14:58:35.786972+0000 mon.a (mon.0) 1607 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:36.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:36 gibba020 bash[25448]: cluster 2021-03-10T14:58:35.194132+0000 mgr.gibba020.yqfnwy (mgr.34427) 3484 : cluster [DBG] pgmap v1978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:36.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:36 gibba020 bash[25448]: cephadm 2021-03-10T14:58:35.518759+0000 mgr.gibba020.yqfnwy (mgr.34427) 3485 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:58:36.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:36 gibba020 bash[25448]: audit 2021-03-10T14:58:35.519167+0000 mon.a (mon.0) 1600 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:58:36.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:36 gibba020 bash[25448]: audit 2021-03-10T14:58:35.746294+0000 mon.a (mon.0) 1601 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:58:36.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:36 gibba020 bash[25448]: audit 2021-03-10T14:58:35.762158+0000 mon.a (mon.0) 1602 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:58:36.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:36 gibba020 bash[25448]: audit 2021-03-10T14:58:35.766497+0000 mon.a (mon.0) 1603 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:36.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:36 gibba020 bash[25448]: audit 2021-03-10T14:58:35.770328+0000 mon.a (mon.0) 1604 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:36.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:36 gibba020 bash[25448]: audit 2021-03-10T14:58:35.773889+0000 mon.a (mon.0) 1605 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:36.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:36 gibba020 bash[25448]: audit 2021-03-10T14:58:35.781587+0000 mon.a (mon.0) 1606 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:36.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:36 gibba020 bash[25448]: audit 2021-03-10T14:58:35.786972+0000 mon.a (mon.0) 1607 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:37.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:37 gibba013 bash[29418]: cephadm 2021-03-10T14:58:35.758268+0000 mgr.gibba020.yqfnwy (mgr.34427) 3486 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:58:37.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:37 gibba013 bash[29418]: cephadm 2021-03-10T14:58:35.764486+0000 mgr.gibba020.yqfnwy (mgr.34427) 3487 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:58:37.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:37 gibba013 bash[29418]: cephadm 2021-03-10T14:58:35.768071+0000 mgr.gibba020.yqfnwy (mgr.34427) 3488 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:58:37.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:37 gibba013 bash[29418]: cephadm 2021-03-10T14:58:35.768309+0000 mgr.gibba020.yqfnwy (mgr.34427) 3489 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:58:37.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:37 gibba013 bash[29418]: cephadm 2021-03-10T14:58:35.771672+0000 mgr.gibba020.yqfnwy (mgr.34427) 3490 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:58:37.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:37 gibba013 bash[29418]: cephadm 2021-03-10T14:58:35.772215+0000 mgr.gibba020.yqfnwy (mgr.34427) 3491 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:58:37.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:37 gibba013 bash[29418]: cephadm 2021-03-10T14:58:35.775083+0000 mgr.gibba020.yqfnwy (mgr.34427) 3492 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:58:37.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:37 gibba013 bash[29418]: cephadm 2021-03-10T14:58:35.778364+0000 mgr.gibba020.yqfnwy (mgr.34427) 3493 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:58:37.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:37 gibba013 bash[29418]: cephadm 2021-03-10T14:58:35.778665+0000 mgr.gibba020.yqfnwy (mgr.34427) 3494 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:58:37.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:37 gibba013 bash[29418]: cephadm 2021-03-10T14:58:35.783052+0000 mgr.gibba020.yqfnwy (mgr.34427) 3495 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:58:37.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:37 gibba013 bash[29418]: cephadm 2021-03-10T14:58:35.785349+0000 mgr.gibba020.yqfnwy (mgr.34427) 3496 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:58:37.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:37 gibba013 bash[29418]: cephadm 2021-03-10T14:58:35.788518+0000 mgr.gibba020.yqfnwy (mgr.34427) 3497 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:58:37.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:37 gibba013 bash[29418]: cephadm 2021-03-10T14:58:35.788833+0000 mgr.gibba020.yqfnwy (mgr.34427) 3498 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:58:37.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:37 gibba013 bash[29418]: cephadm 2021-03-10T14:58:35.789432+0000 mgr.gibba020.yqfnwy (mgr.34427) 3499 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:58:37.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:37 gibba013 bash[30381]: cephadm 2021-03-10T14:58:35.758268+0000 mgr.gibba020.yqfnwy (mgr.34427) 3486 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:58:37.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:37 gibba013 bash[30381]: cephadm 2021-03-10T14:58:35.764486+0000 mgr.gibba020.yqfnwy (mgr.34427) 3487 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:58:37.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:37 gibba013 bash[30381]: cephadm 2021-03-10T14:58:35.768071+0000 mgr.gibba020.yqfnwy (mgr.34427) 3488 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:58:37.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:37 gibba013 bash[30381]: cephadm 2021-03-10T14:58:35.768309+0000 mgr.gibba020.yqfnwy (mgr.34427) 3489 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:58:37.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:37 gibba013 bash[30381]: cephadm 2021-03-10T14:58:35.771672+0000 mgr.gibba020.yqfnwy (mgr.34427) 3490 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:58:37.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:37 gibba013 bash[30381]: cephadm 2021-03-10T14:58:35.772215+0000 mgr.gibba020.yqfnwy (mgr.34427) 3491 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:58:37.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:37 gibba013 bash[30381]: cephadm 2021-03-10T14:58:35.775083+0000 mgr.gibba020.yqfnwy (mgr.34427) 3492 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:58:37.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:37 gibba013 bash[30381]: cephadm 2021-03-10T14:58:35.778364+0000 mgr.gibba020.yqfnwy (mgr.34427) 3493 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:58:37.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:37 gibba013 bash[30381]: cephadm 2021-03-10T14:58:35.778665+0000 mgr.gibba020.yqfnwy (mgr.34427) 3494 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:58:37.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:37 gibba013 bash[30381]: cephadm 2021-03-10T14:58:35.783052+0000 mgr.gibba020.yqfnwy (mgr.34427) 3495 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:58:37.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:37 gibba013 bash[30381]: cephadm 2021-03-10T14:58:35.785349+0000 mgr.gibba020.yqfnwy (mgr.34427) 3496 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:58:37.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:37 gibba013 bash[30381]: cephadm 2021-03-10T14:58:35.788518+0000 mgr.gibba020.yqfnwy (mgr.34427) 3497 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:58:37.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:37 gibba013 bash[30381]: cephadm 2021-03-10T14:58:35.788833+0000 mgr.gibba020.yqfnwy (mgr.34427) 3498 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:58:37.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:37 gibba013 bash[30381]: cephadm 2021-03-10T14:58:35.789432+0000 mgr.gibba020.yqfnwy (mgr.34427) 3499 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:58:37.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:37 gibba020 bash[25448]: cephadm 2021-03-10T14:58:35.758268+0000 mgr.gibba020.yqfnwy (mgr.34427) 3486 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:58:37.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:37 gibba020 bash[25448]: cephadm 2021-03-10T14:58:35.764486+0000 mgr.gibba020.yqfnwy (mgr.34427) 3487 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:58:37.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:37 gibba020 bash[25448]: cephadm 2021-03-10T14:58:35.768071+0000 mgr.gibba020.yqfnwy (mgr.34427) 3488 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:58:37.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:37 gibba020 bash[25448]: cephadm 2021-03-10T14:58:35.768309+0000 mgr.gibba020.yqfnwy (mgr.34427) 3489 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:58:37.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:37 gibba020 bash[25448]: cephadm 2021-03-10T14:58:35.771672+0000 mgr.gibba020.yqfnwy (mgr.34427) 3490 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:58:37.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:37 gibba020 bash[25448]: cephadm 2021-03-10T14:58:35.772215+0000 mgr.gibba020.yqfnwy (mgr.34427) 3491 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:58:37.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:37 gibba020 bash[25448]: cephadm 2021-03-10T14:58:35.775083+0000 mgr.gibba020.yqfnwy (mgr.34427) 3492 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:58:37.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:37 gibba020 bash[25448]: cephadm 2021-03-10T14:58:35.778364+0000 mgr.gibba020.yqfnwy (mgr.34427) 3493 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:58:37.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:37 gibba020 bash[25448]: cephadm 2021-03-10T14:58:35.778665+0000 mgr.gibba020.yqfnwy (mgr.34427) 3494 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:58:37.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:37 gibba020 bash[25448]: cephadm 2021-03-10T14:58:35.783052+0000 mgr.gibba020.yqfnwy (mgr.34427) 3495 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:58:37.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:37 gibba020 bash[25448]: cephadm 2021-03-10T14:58:35.785349+0000 mgr.gibba020.yqfnwy (mgr.34427) 3496 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:58:37.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:37 gibba020 bash[25448]: cephadm 2021-03-10T14:58:35.788518+0000 mgr.gibba020.yqfnwy (mgr.34427) 3497 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:58:37.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:37 gibba020 bash[25448]: cephadm 2021-03-10T14:58:35.788833+0000 mgr.gibba020.yqfnwy (mgr.34427) 3498 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:58:37.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:37 gibba020 bash[25448]: cephadm 2021-03-10T14:58:35.789432+0000 mgr.gibba020.yqfnwy (mgr.34427) 3499 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:58:38.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:38 gibba013 bash[29418]: cluster 2021-03-10T14:58:37.195382+0000 mgr.gibba020.yqfnwy (mgr.34427) 3500 : cluster [DBG] pgmap v1979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:38.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:38 gibba013 bash[30381]: cluster 2021-03-10T14:58:37.195382+0000 mgr.gibba020.yqfnwy (mgr.34427) 3500 : cluster [DBG] pgmap v1979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:38.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:38 gibba020 bash[25448]: cluster 2021-03-10T14:58:37.195382+0000 mgr.gibba020.yqfnwy (mgr.34427) 3500 : cluster [DBG] pgmap v1979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:40.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:40 gibba013 bash[29418]: cluster 2021-03-10T14:58:39.196834+0000 mgr.gibba020.yqfnwy (mgr.34427) 3501 : cluster [DBG] pgmap v1980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:40.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:40 gibba013 bash[30381]: cluster 2021-03-10T14:58:39.196834+0000 mgr.gibba020.yqfnwy (mgr.34427) 3501 : cluster [DBG] pgmap v1980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:40.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:40 gibba020 bash[25448]: cluster 2021-03-10T14:58:39.196834+0000 mgr.gibba020.yqfnwy (mgr.34427) 3501 : cluster [DBG] pgmap v1980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:42.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:42 gibba013 bash[29418]: cluster 2021-03-10T14:58:41.197818+0000 mgr.gibba020.yqfnwy (mgr.34427) 3502 : cluster [DBG] pgmap v1981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:42.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:42 gibba013 bash[30381]: cluster 2021-03-10T14:58:41.197818+0000 mgr.gibba020.yqfnwy (mgr.34427) 3502 : cluster [DBG] pgmap v1981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:42.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:42 gibba020 bash[25448]: cluster 2021-03-10T14:58:41.197818+0000 mgr.gibba020.yqfnwy (mgr.34427) 3502 : cluster [DBG] pgmap v1981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:44.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:44 gibba013 bash[29418]: cluster 2021-03-10T14:58:43.199120+0000 mgr.gibba020.yqfnwy (mgr.34427) 3503 : cluster [DBG] pgmap v1982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:44.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:44 gibba013 bash[30381]: cluster 2021-03-10T14:58:43.199120+0000 mgr.gibba020.yqfnwy (mgr.34427) 3503 : cluster [DBG] pgmap v1982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:44.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:44 gibba020 bash[25448]: cluster 2021-03-10T14:58:43.199120+0000 mgr.gibba020.yqfnwy (mgr.34427) 3503 : cluster [DBG] pgmap v1982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:46.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:46 gibba013 bash[29418]: cluster 2021-03-10T14:58:45.200884+0000 mgr.gibba020.yqfnwy (mgr.34427) 3504 : cluster [DBG] pgmap v1983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:46.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:46 gibba013 bash[30381]: cluster 2021-03-10T14:58:45.200884+0000 mgr.gibba020.yqfnwy (mgr.34427) 3504 : cluster [DBG] pgmap v1983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:46.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:46 gibba020 bash[25448]: cluster 2021-03-10T14:58:45.200884+0000 mgr.gibba020.yqfnwy (mgr.34427) 3504 : cluster [DBG] pgmap v1983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:47.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:47 gibba020 bash[25448]: cluster 2021-03-10T14:58:47.201513+0000 mgr.gibba020.yqfnwy (mgr.34427) 3505 : cluster [DBG] pgmap v1984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:48.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:47 gibba013 bash[29418]: cluster 2021-03-10T14:58:47.201513+0000 mgr.gibba020.yqfnwy (mgr.34427) 3505 : cluster [DBG] pgmap v1984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:48.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:47 gibba013 bash[30381]: cluster 2021-03-10T14:58:47.201513+0000 mgr.gibba020.yqfnwy (mgr.34427) 3505 : cluster [DBG] pgmap v1984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:50.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:50 gibba013 bash[29418]: cluster 2021-03-10T14:58:49.203018+0000 mgr.gibba020.yqfnwy (mgr.34427) 3506 : cluster [DBG] pgmap v1985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:50.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:50 gibba013 bash[30381]: cluster 2021-03-10T14:58:49.203018+0000 mgr.gibba020.yqfnwy (mgr.34427) 3506 : cluster [DBG] pgmap v1985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:50.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:50 gibba020 bash[25448]: cluster 2021-03-10T14:58:49.203018+0000 mgr.gibba020.yqfnwy (mgr.34427) 3506 : cluster [DBG] pgmap v1985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:52.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:52 gibba013 bash[29418]: cephadm 2021-03-10T14:58:50.805568+0000 mgr.gibba020.yqfnwy (mgr.34427) 3507 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:58:52.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:52 gibba013 bash[29418]: cluster 2021-03-10T14:58:51.204838+0000 mgr.gibba020.yqfnwy (mgr.34427) 3508 : cluster [DBG] pgmap v1986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:52.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:52 gibba013 bash[30381]: cephadm 2021-03-10T14:58:50.805568+0000 mgr.gibba020.yqfnwy (mgr.34427) 3507 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:58:52.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:52 gibba013 bash[30381]: cluster 2021-03-10T14:58:51.204838+0000 mgr.gibba020.yqfnwy (mgr.34427) 3508 : cluster [DBG] pgmap v1986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:52.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:52 gibba020 bash[25448]: cephadm 2021-03-10T14:58:50.805568+0000 mgr.gibba020.yqfnwy (mgr.34427) 3507 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:58:52.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:52 gibba020 bash[25448]: cluster 2021-03-10T14:58:51.204838+0000 mgr.gibba020.yqfnwy (mgr.34427) 3508 : cluster [DBG] pgmap v1986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:54.059 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:58:54.288 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:58:54.288 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (65m) 18s ago 70m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:58:54.288 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (70m) 9m ago 70m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:58:54.289 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (65m) 9m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:58:54.289 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (66m) 9m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:58:54.289 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (65m) 18s ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:58:54.289 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (64m) 18s ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:58:54.289 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (64m) 9m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:58:54.290 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (64m) 18s ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:58:54.290 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (70m) 18s ago 70m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:58:54.290 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (70m) 9m ago 70m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:58:54.290 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (63m) 18s ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:58:54.290 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (63m) 18s ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:58:54.291 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (62m) 18s ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:58:54.291 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (62m) 18s ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:58:54.291 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (61m) 9m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:58:54.291 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (61m) 9m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:58:54.292 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (61m) 9m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:58:54.292 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (60m) 9m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:58:54.292 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (70m) 9m ago 70m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:58:54.292 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 9m ago 68m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:58:54.540 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:58:54.540 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:58:54.540 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:58:54.540 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:58:54.541 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:58:54.541 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:58:54.541 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:58:54.541 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:58:54.541 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:58:54.542 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:58:54.542 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:58:54.542 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:58:54.542 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:58:54.543 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:58:54.543 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:58:54.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:54 gibba013 bash[29418]: cluster 2021-03-10T14:58:53.206323+0000 mgr.gibba020.yqfnwy (mgr.34427) 3509 : cluster [DBG] pgmap v1987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:54.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:54 gibba013 bash[30381]: cluster 2021-03-10T14:58:53.206323+0000 mgr.gibba020.yqfnwy (mgr.34427) 3509 : cluster [DBG] pgmap v1987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:54.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:54 gibba020 bash[25448]: cluster 2021-03-10T14:58:53.206323+0000 mgr.gibba020.yqfnwy (mgr.34427) 3509 : cluster [DBG] pgmap v1987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:55.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:55 gibba013 bash[29418]: audit 2021-03-10T14:58:54.046208+0000 mgr.gibba020.yqfnwy (mgr.34427) 3510 : audit [DBG] from='client.46410 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:58:55.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:55 gibba013 bash[29418]: audit 2021-03-10T14:58:54.271262+0000 mgr.gibba020.yqfnwy (mgr.34427) 3511 : audit [DBG] from='client.46416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:58:55.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:55 gibba013 bash[29418]: audit 2021-03-10T14:58:54.537365+0000 mon.a (mon.0) 1608 : audit [DBG] from='client.? 172.21.2.113:0/339541476' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:55.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:55 gibba013 bash[30381]: audit 2021-03-10T14:58:54.046208+0000 mgr.gibba020.yqfnwy (mgr.34427) 3510 : audit [DBG] from='client.46410 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:58:55.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:55 gibba013 bash[30381]: audit 2021-03-10T14:58:54.271262+0000 mgr.gibba020.yqfnwy (mgr.34427) 3511 : audit [DBG] from='client.46416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:58:55.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:55 gibba013 bash[30381]: audit 2021-03-10T14:58:54.537365+0000 mon.a (mon.0) 1608 : audit [DBG] from='client.? 172.21.2.113:0/339541476' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:55.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:55 gibba020 bash[25448]: audit 2021-03-10T14:58:54.046208+0000 mgr.gibba020.yqfnwy (mgr.34427) 3510 : audit [DBG] from='client.46410 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:58:55.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:55 gibba020 bash[25448]: audit 2021-03-10T14:58:54.271262+0000 mgr.gibba020.yqfnwy (mgr.34427) 3511 : audit [DBG] from='client.46416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:58:55.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:55 gibba020 bash[25448]: audit 2021-03-10T14:58:54.537365+0000 mon.a (mon.0) 1608 : audit [DBG] from='client.? 172.21.2.113:0/339541476' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:58:56.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:56 gibba013 bash[30381]: cluster 2021-03-10T14:58:55.208206+0000 mgr.gibba020.yqfnwy (mgr.34427) 3512 : cluster [DBG] pgmap v1988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:56.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:56 gibba013 bash[29418]: cluster 2021-03-10T14:58:55.208206+0000 mgr.gibba020.yqfnwy (mgr.34427) 3512 : cluster [DBG] pgmap v1988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:56.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:56 gibba020 bash[25448]: cluster 2021-03-10T14:58:55.208206+0000 mgr.gibba020.yqfnwy (mgr.34427) 3512 : cluster [DBG] pgmap v1988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:57.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:58:57 gibba020 bash[25448]: cluster 2021-03-10T14:58:57.209591+0000 mgr.gibba020.yqfnwy (mgr.34427) 3513 : cluster [DBG] pgmap v1989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:58.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:58:57 gibba013 bash[29418]: cluster 2021-03-10T14:58:57.209591+0000 mgr.gibba020.yqfnwy (mgr.34427) 3513 : cluster [DBG] pgmap v1989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:58:58.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:58:57 gibba013 bash[30381]: cluster 2021-03-10T14:58:57.209591+0000 mgr.gibba020.yqfnwy (mgr.34427) 3513 : cluster [DBG] pgmap v1989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:00.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:00 gibba013 bash[29418]: cluster 2021-03-10T14:58:59.210620+0000 mgr.gibba020.yqfnwy (mgr.34427) 3514 : cluster [DBG] pgmap v1990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:00.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:00 gibba013 bash[30381]: cluster 2021-03-10T14:58:59.210620+0000 mgr.gibba020.yqfnwy (mgr.34427) 3514 : cluster [DBG] pgmap v1990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:00.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:00 gibba020 bash[25448]: cluster 2021-03-10T14:58:59.210620+0000 mgr.gibba020.yqfnwy (mgr.34427) 3514 : cluster [DBG] pgmap v1990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:02.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:02 gibba013 bash[29418]: cluster 2021-03-10T14:59:01.212235+0000 mgr.gibba020.yqfnwy (mgr.34427) 3515 : cluster [DBG] pgmap v1991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:02.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:02 gibba013 bash[30381]: cluster 2021-03-10T14:59:01.212235+0000 mgr.gibba020.yqfnwy (mgr.34427) 3515 : cluster [DBG] pgmap v1991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:02.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:02 gibba020 bash[25448]: cluster 2021-03-10T14:59:01.212235+0000 mgr.gibba020.yqfnwy (mgr.34427) 3515 : cluster [DBG] pgmap v1991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:04.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:04 gibba013 bash[29418]: cluster 2021-03-10T14:59:03.213640+0000 mgr.gibba020.yqfnwy (mgr.34427) 3516 : cluster [DBG] pgmap v1992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:04.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:04 gibba013 bash[30381]: cluster 2021-03-10T14:59:03.213640+0000 mgr.gibba020.yqfnwy (mgr.34427) 3516 : cluster [DBG] pgmap v1992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:04.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:04 gibba020 bash[25448]: cluster 2021-03-10T14:59:03.213640+0000 mgr.gibba020.yqfnwy (mgr.34427) 3516 : cluster [DBG] pgmap v1992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:06.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:06 gibba013 bash[30381]: cluster 2021-03-10T14:59:05.214658+0000 mgr.gibba020.yqfnwy (mgr.34427) 3517 : cluster [DBG] pgmap v1993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:06 gibba013 bash[29418]: cluster 2021-03-10T14:59:05.214658+0000 mgr.gibba020.yqfnwy (mgr.34427) 3517 : cluster [DBG] pgmap v1993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:06 gibba020 bash[25448]: cluster 2021-03-10T14:59:05.214658+0000 mgr.gibba020.yqfnwy (mgr.34427) 3517 : cluster [DBG] pgmap v1993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:07.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:07 gibba013 bash[29418]: cephadm 2021-03-10T14:59:05.810663+0000 mgr.gibba020.yqfnwy (mgr.34427) 3518 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:59:07.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:07 gibba013 bash[29418]: audit 2021-03-10T14:59:06.306468+0000 mon.a (mon.0) 1609 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:59:07.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:07 gibba013 bash[29418]: audit 2021-03-10T14:59:06.326819+0000 mon.a (mon.0) 1610 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:59:07.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:07 gibba013 bash[29418]: audit 2021-03-10T14:59:06.362480+0000 mon.a (mon.0) 1611 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:59:07.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:07 gibba013 bash[29418]: audit 2021-03-10T14:59:06.362754+0000 mon.a (mon.0) 1612 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:59:07.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:07 gibba013 bash[29418]: audit 2021-03-10T14:59:06.363007+0000 mon.a (mon.0) 1613 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T14:59:07.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:07 gibba013 bash[29418]: audit 2021-03-10T14:59:06.363287+0000 mon.a (mon.0) 1614 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:59:07.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:07 gibba013 bash[30381]: cephadm 2021-03-10T14:59:05.810663+0000 mgr.gibba020.yqfnwy (mgr.34427) 3518 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:59:07.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:07 gibba013 bash[30381]: audit 2021-03-10T14:59:06.306468+0000 mon.a (mon.0) 1609 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:59:07.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:07 gibba013 bash[30381]: audit 2021-03-10T14:59:06.326819+0000 mon.a (mon.0) 1610 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:59:07.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:07 gibba013 bash[30381]: audit 2021-03-10T14:59:06.362480+0000 mon.a (mon.0) 1611 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:59:07.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:07 gibba013 bash[30381]: audit 2021-03-10T14:59:06.362754+0000 mon.a (mon.0) 1612 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:59:07.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:07 gibba013 bash[30381]: audit 2021-03-10T14:59:06.363007+0000 mon.a (mon.0) 1613 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T14:59:07.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:07 gibba013 bash[30381]: audit 2021-03-10T14:59:06.363287+0000 mon.a (mon.0) 1614 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:59:07.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:07 gibba020 bash[25448]: cephadm 2021-03-10T14:59:05.810663+0000 mgr.gibba020.yqfnwy (mgr.34427) 3518 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:59:07.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:07 gibba020 bash[25448]: audit 2021-03-10T14:59:06.306468+0000 mon.a (mon.0) 1609 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T14:59:07.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:07 gibba020 bash[25448]: audit 2021-03-10T14:59:06.326819+0000 mon.a (mon.0) 1610 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T14:59:07.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:07 gibba020 bash[25448]: audit 2021-03-10T14:59:06.362480+0000 mon.a (mon.0) 1611 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T14:59:07.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:07 gibba020 bash[25448]: audit 2021-03-10T14:59:06.362754+0000 mon.a (mon.0) 1612 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T14:59:07.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:07 gibba020 bash[25448]: audit 2021-03-10T14:59:06.363007+0000 mon.a (mon.0) 1613 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T14:59:07.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:07 gibba020 bash[25448]: audit 2021-03-10T14:59:06.363287+0000 mon.a (mon.0) 1614 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T14:59:08.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:08 gibba013 bash[29418]: cluster 2021-03-10T14:59:07.215965+0000 mgr.gibba020.yqfnwy (mgr.34427) 3519 : cluster [DBG] pgmap v1994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:08.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:08 gibba013 bash[30381]: cluster 2021-03-10T14:59:07.215965+0000 mgr.gibba020.yqfnwy (mgr.34427) 3519 : cluster [DBG] pgmap v1994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:08.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:08 gibba020 bash[25448]: cluster 2021-03-10T14:59:07.215965+0000 mgr.gibba020.yqfnwy (mgr.34427) 3519 : cluster [DBG] pgmap v1994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:10.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:10 gibba013 bash[29418]: cluster 2021-03-10T14:59:09.217606+0000 mgr.gibba020.yqfnwy (mgr.34427) 3520 : cluster [DBG] pgmap v1995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:10.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:10 gibba013 bash[30381]: cluster 2021-03-10T14:59:09.217606+0000 mgr.gibba020.yqfnwy (mgr.34427) 3520 : cluster [DBG] pgmap v1995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:10.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:10 gibba020 bash[25448]: cluster 2021-03-10T14:59:09.217606+0000 mgr.gibba020.yqfnwy (mgr.34427) 3520 : cluster [DBG] pgmap v1995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:12.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:12 gibba013 bash[29418]: cluster 2021-03-10T14:59:11.218456+0000 mgr.gibba020.yqfnwy (mgr.34427) 3521 : cluster [DBG] pgmap v1996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:12.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:12 gibba013 bash[30381]: cluster 2021-03-10T14:59:11.218456+0000 mgr.gibba020.yqfnwy (mgr.34427) 3521 : cluster [DBG] pgmap v1996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:12.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:12 gibba020 bash[25448]: cluster 2021-03-10T14:59:11.218456+0000 mgr.gibba020.yqfnwy (mgr.34427) 3521 : cluster [DBG] pgmap v1996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:14.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:14 gibba013 bash[29418]: cluster 2021-03-10T14:59:13.219728+0000 mgr.gibba020.yqfnwy (mgr.34427) 3522 : cluster [DBG] pgmap v1997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:14.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:14 gibba013 bash[30381]: cluster 2021-03-10T14:59:13.219728+0000 mgr.gibba020.yqfnwy (mgr.34427) 3522 : cluster [DBG] pgmap v1997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:14.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:14 gibba020 bash[25448]: cluster 2021-03-10T14:59:13.219728+0000 mgr.gibba020.yqfnwy (mgr.34427) 3522 : cluster [DBG] pgmap v1997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:16.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:16 gibba013 bash[29418]: cluster 2021-03-10T14:59:15.221344+0000 mgr.gibba020.yqfnwy (mgr.34427) 3523 : cluster [DBG] pgmap v1998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:16.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:16 gibba013 bash[30381]: cluster 2021-03-10T14:59:15.221344+0000 mgr.gibba020.yqfnwy (mgr.34427) 3523 : cluster [DBG] pgmap v1998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:16.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:16 gibba020 bash[25448]: cluster 2021-03-10T14:59:15.221344+0000 mgr.gibba020.yqfnwy (mgr.34427) 3523 : cluster [DBG] pgmap v1998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:17.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:17 gibba020 bash[25448]: cluster 2021-03-10T14:59:17.222701+0000 mgr.gibba020.yqfnwy (mgr.34427) 3524 : cluster [DBG] pgmap v1999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:18.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:17 gibba013 bash[29418]: cluster 2021-03-10T14:59:17.222701+0000 mgr.gibba020.yqfnwy (mgr.34427) 3524 : cluster [DBG] pgmap v1999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:18.155 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:17 gibba013 bash[30381]: cluster 2021-03-10T14:59:17.222701+0000 mgr.gibba020.yqfnwy (mgr.34427) 3524 : cluster [DBG] pgmap v1999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:20.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:20 gibba013 bash[29418]: cluster 2021-03-10T14:59:19.224376+0000 mgr.gibba020.yqfnwy (mgr.34427) 3525 : cluster [DBG] pgmap v2000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:20.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:20 gibba013 bash[30381]: cluster 2021-03-10T14:59:19.224376+0000 mgr.gibba020.yqfnwy (mgr.34427) 3525 : cluster [DBG] pgmap v2000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:20.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:20 gibba020 bash[25448]: cluster 2021-03-10T14:59:19.224376+0000 mgr.gibba020.yqfnwy (mgr.34427) 3525 : cluster [DBG] pgmap v2000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:22.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:22 gibba013 bash[29418]: cephadm 2021-03-10T14:59:20.826697+0000 mgr.gibba020.yqfnwy (mgr.34427) 3526 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:59:22.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:22 gibba013 bash[29418]: cluster 2021-03-10T14:59:21.226034+0000 mgr.gibba020.yqfnwy (mgr.34427) 3527 : cluster [DBG] pgmap v2001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:22.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:22 gibba013 bash[30381]: cephadm 2021-03-10T14:59:20.826697+0000 mgr.gibba020.yqfnwy (mgr.34427) 3526 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:59:22.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:22 gibba013 bash[30381]: cluster 2021-03-10T14:59:21.226034+0000 mgr.gibba020.yqfnwy (mgr.34427) 3527 : cluster [DBG] pgmap v2001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:22.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:22 gibba020 bash[25448]: cephadm 2021-03-10T14:59:20.826697+0000 mgr.gibba020.yqfnwy (mgr.34427) 3526 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:59:22.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:22 gibba020 bash[25448]: cluster 2021-03-10T14:59:21.226034+0000 mgr.gibba020.yqfnwy (mgr.34427) 3527 : cluster [DBG] pgmap v2001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:24.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:24 gibba013 bash[29418]: cluster 2021-03-10T14:59:23.227571+0000 mgr.gibba020.yqfnwy (mgr.34427) 3528 : cluster [DBG] pgmap v2002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:24.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:24 gibba013 bash[30381]: cluster 2021-03-10T14:59:23.227571+0000 mgr.gibba020.yqfnwy (mgr.34427) 3528 : cluster [DBG] pgmap v2002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:24.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:24 gibba020 bash[25448]: cluster 2021-03-10T14:59:23.227571+0000 mgr.gibba020.yqfnwy (mgr.34427) 3528 : cluster [DBG] pgmap v2002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:24.786 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:59:25.013 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:59:25.013 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (65m) 49s ago 71m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:59:25.013 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (71m) 10m ago 71m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:59:25.014 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (66m) 10m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:59:25.014 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (66m) 10m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:59:25.014 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (65m) 49s ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:59:25.014 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (65m) 49s ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:59:25.015 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (64m) 10m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:59:25.015 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (65m) 49s ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:59:25.015 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (71m) 49s ago 71m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:59:25.015 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (71m) 10m ago 71m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:59:25.016 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (64m) 49s ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:59:25.016 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (63m) 49s ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:59:25.016 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (63m) 49s ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:59:25.016 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (62m) 49s ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:59:25.016 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (62m) 10m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:59:25.017 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (62m) 10m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:59:25.017 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (61m) 10m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:59:25.017 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (61m) 10m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:59:25.017 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (70m) 10m ago 71m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:59:25.017 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 10m ago 69m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:59:25.263 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:59:25.263 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:59:25.263 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:59:25.264 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:59:25.264 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:59:25.264 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:59:25.264 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:59:25.264 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:59:25.265 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:59:25.265 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:59:25.265 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:59:25.265 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:59:25.265 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:59:25.266 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:59:25.266 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:59:25.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:25 gibba013 bash[29418]: audit 2021-03-10T14:59:25.260140+0000 mon.c (mon.1) 65 : audit [DBG] from='client.? 172.21.2.113:0/207362630' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:25.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:25 gibba013 bash[30381]: audit 2021-03-10T14:59:25.260140+0000 mon.c (mon.1) 65 : audit [DBG] from='client.? 172.21.2.113:0/207362630' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:25.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:25 gibba020 bash[25448]: audit 2021-03-10T14:59:25.260140+0000 mon.c (mon.1) 65 : audit [DBG] from='client.? 172.21.2.113:0/207362630' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:26.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:26 gibba013 bash[29418]: audit 2021-03-10T14:59:24.773208+0000 mgr.gibba020.yqfnwy (mgr.34427) 3529 : audit [DBG] from='client.56413 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:59:26.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:26 gibba013 bash[29418]: audit 2021-03-10T14:59:24.997256+0000 mgr.gibba020.yqfnwy (mgr.34427) 3530 : audit [DBG] from='client.46434 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:59:26.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:26 gibba013 bash[29418]: cluster 2021-03-10T14:59:25.229213+0000 mgr.gibba020.yqfnwy (mgr.34427) 3531 : cluster [DBG] pgmap v2003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:26.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:26 gibba013 bash[30381]: audit 2021-03-10T14:59:24.773208+0000 mgr.gibba020.yqfnwy (mgr.34427) 3529 : audit [DBG] from='client.56413 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:59:26.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:26 gibba013 bash[30381]: audit 2021-03-10T14:59:24.997256+0000 mgr.gibba020.yqfnwy (mgr.34427) 3530 : audit [DBG] from='client.46434 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:59:26.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:26 gibba013 bash[30381]: cluster 2021-03-10T14:59:25.229213+0000 mgr.gibba020.yqfnwy (mgr.34427) 3531 : cluster [DBG] pgmap v2003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:26.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:26 gibba020 bash[25448]: audit 2021-03-10T14:59:24.773208+0000 mgr.gibba020.yqfnwy (mgr.34427) 3529 : audit [DBG] from='client.56413 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:59:26.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:26 gibba020 bash[25448]: audit 2021-03-10T14:59:24.997256+0000 mgr.gibba020.yqfnwy (mgr.34427) 3530 : audit [DBG] from='client.46434 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:59:26.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:26 gibba020 bash[25448]: cluster 2021-03-10T14:59:25.229213+0000 mgr.gibba020.yqfnwy (mgr.34427) 3531 : cluster [DBG] pgmap v2003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:27.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:27 gibba020 bash[25448]: cluster 2021-03-10T14:59:27.230637+0000 mgr.gibba020.yqfnwy (mgr.34427) 3532 : cluster [DBG] pgmap v2004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:28.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:27 gibba013 bash[29418]: cluster 2021-03-10T14:59:27.230637+0000 mgr.gibba020.yqfnwy (mgr.34427) 3532 : cluster [DBG] pgmap v2004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:28.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:27 gibba013 bash[30381]: cluster 2021-03-10T14:59:27.230637+0000 mgr.gibba020.yqfnwy (mgr.34427) 3532 : cluster [DBG] pgmap v2004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:30.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:30 gibba013 bash[29418]: cluster 2021-03-10T14:59:29.232358+0000 mgr.gibba020.yqfnwy (mgr.34427) 3533 : cluster [DBG] pgmap v2005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:30.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:30 gibba013 bash[30381]: cluster 2021-03-10T14:59:29.232358+0000 mgr.gibba020.yqfnwy (mgr.34427) 3533 : cluster [DBG] pgmap v2005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:30.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:30 gibba020 bash[25448]: cluster 2021-03-10T14:59:29.232358+0000 mgr.gibba020.yqfnwy (mgr.34427) 3533 : cluster [DBG] pgmap v2005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:32.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:32 gibba013 bash[29418]: cluster 2021-03-10T14:59:31.234083+0000 mgr.gibba020.yqfnwy (mgr.34427) 3534 : cluster [DBG] pgmap v2006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:32.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:32 gibba013 bash[30381]: cluster 2021-03-10T14:59:31.234083+0000 mgr.gibba020.yqfnwy (mgr.34427) 3534 : cluster [DBG] pgmap v2006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:32.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:32 gibba020 bash[25448]: cluster 2021-03-10T14:59:31.234083+0000 mgr.gibba020.yqfnwy (mgr.34427) 3534 : cluster [DBG] pgmap v2006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:34.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:34 gibba013 bash[29418]: cluster 2021-03-10T14:59:33.235655+0000 mgr.gibba020.yqfnwy (mgr.34427) 3535 : cluster [DBG] pgmap v2007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:34.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:34 gibba013 bash[30381]: cluster 2021-03-10T14:59:33.235655+0000 mgr.gibba020.yqfnwy (mgr.34427) 3535 : cluster [DBG] pgmap v2007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:34.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:34 gibba020 bash[25448]: cluster 2021-03-10T14:59:33.235655+0000 mgr.gibba020.yqfnwy (mgr.34427) 3535 : cluster [DBG] pgmap v2007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:36.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:36 gibba013 bash[29418]: cluster 2021-03-10T14:59:35.237096+0000 mgr.gibba020.yqfnwy (mgr.34427) 3536 : cluster [DBG] pgmap v2008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:36.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:36 gibba013 bash[29418]: audit 2021-03-10T14:59:35.844615+0000 mon.a (mon.0) 1615 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:59:36.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:36 gibba013 bash[29418]: audit 2021-03-10T14:59:35.852138+0000 mon.a (mon.0) 1616 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:59:36.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:36 gibba013 bash[30381]: cluster 2021-03-10T14:59:35.237096+0000 mgr.gibba020.yqfnwy (mgr.34427) 3536 : cluster [DBG] pgmap v2008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:36.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:36 gibba013 bash[30381]: audit 2021-03-10T14:59:35.844615+0000 mon.a (mon.0) 1615 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:59:36.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:36 gibba013 bash[30381]: audit 2021-03-10T14:59:35.852138+0000 mon.a (mon.0) 1616 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:59:36.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:36 gibba020 bash[25448]: cluster 2021-03-10T14:59:35.237096+0000 mgr.gibba020.yqfnwy (mgr.34427) 3536 : cluster [DBG] pgmap v2008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:36.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:36 gibba020 bash[25448]: audit 2021-03-10T14:59:35.844615+0000 mon.a (mon.0) 1615 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:59:36.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:36 gibba020 bash[25448]: audit 2021-03-10T14:59:35.852138+0000 mon.a (mon.0) 1616 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T14:59:37.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:37 gibba013 bash[29418]: cephadm 2021-03-10T14:59:35.849370+0000 mgr.gibba020.yqfnwy (mgr.34427) 3537 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:59:37.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:37 gibba013 bash[30381]: cephadm 2021-03-10T14:59:35.849370+0000 mgr.gibba020.yqfnwy (mgr.34427) 3537 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:59:37.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:37 gibba020 bash[25448]: cephadm 2021-03-10T14:59:35.849370+0000 mgr.gibba020.yqfnwy (mgr.34427) 3537 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T14:59:38.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:38 gibba013 bash[29418]: cluster 2021-03-10T14:59:37.238204+0000 mgr.gibba020.yqfnwy (mgr.34427) 3538 : cluster [DBG] pgmap v2009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:38.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:38 gibba013 bash[30381]: cluster 2021-03-10T14:59:37.238204+0000 mgr.gibba020.yqfnwy (mgr.34427) 3538 : cluster [DBG] pgmap v2009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:38.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:38 gibba020 bash[25448]: cluster 2021-03-10T14:59:37.238204+0000 mgr.gibba020.yqfnwy (mgr.34427) 3538 : cluster [DBG] pgmap v2009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:40.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:40 gibba013 bash[29418]: cluster 2021-03-10T14:59:39.238755+0000 mgr.gibba020.yqfnwy (mgr.34427) 3539 : cluster [DBG] pgmap v2010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:40.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:40 gibba013 bash[29418]: audit 2021-03-10T14:59:39.626078+0000 mon.a (mon.0) 1617 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:59:40.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:40 gibba013 bash[29418]: audit 2021-03-10T14:59:39.828315+0000 mon.a (mon.0) 1618 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:59:40.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:40 gibba013 bash[29418]: audit 2021-03-10T14:59:39.835953+0000 mon.a (mon.0) 1619 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:59:40.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:40 gibba013 bash[29418]: audit 2021-03-10T14:59:39.838729+0000 mon.a (mon.0) 1620 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:40.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:40 gibba013 bash[29418]: audit 2021-03-10T14:59:39.841412+0000 mon.a (mon.0) 1621 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:40.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:40 gibba013 bash[29418]: audit 2021-03-10T14:59:39.843647+0000 mon.a (mon.0) 1622 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:40.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:40 gibba013 bash[29418]: audit 2021-03-10T14:59:39.850518+0000 mon.a (mon.0) 1623 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:40.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:40 gibba013 bash[29418]: audit 2021-03-10T14:59:39.856694+0000 mon.a (mon.0) 1624 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:40.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:40 gibba013 bash[30381]: cluster 2021-03-10T14:59:39.238755+0000 mgr.gibba020.yqfnwy (mgr.34427) 3539 : cluster [DBG] pgmap v2010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:40.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:40 gibba013 bash[30381]: audit 2021-03-10T14:59:39.626078+0000 mon.a (mon.0) 1617 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:59:40.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:40 gibba013 bash[30381]: audit 2021-03-10T14:59:39.828315+0000 mon.a (mon.0) 1618 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:59:40.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:40 gibba013 bash[30381]: audit 2021-03-10T14:59:39.835953+0000 mon.a (mon.0) 1619 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:59:40.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:40 gibba013 bash[30381]: audit 2021-03-10T14:59:39.838729+0000 mon.a (mon.0) 1620 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:40.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:40 gibba013 bash[30381]: audit 2021-03-10T14:59:39.841412+0000 mon.a (mon.0) 1621 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:40.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:40 gibba013 bash[30381]: audit 2021-03-10T14:59:39.843647+0000 mon.a (mon.0) 1622 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:40.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:40 gibba013 bash[30381]: audit 2021-03-10T14:59:39.850518+0000 mon.a (mon.0) 1623 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:40.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:40 gibba013 bash[30381]: audit 2021-03-10T14:59:39.856694+0000 mon.a (mon.0) 1624 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:40.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:40 gibba020 bash[25448]: cluster 2021-03-10T14:59:39.238755+0000 mgr.gibba020.yqfnwy (mgr.34427) 3539 : cluster [DBG] pgmap v2010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:40.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:40 gibba020 bash[25448]: audit 2021-03-10T14:59:39.626078+0000 mon.a (mon.0) 1617 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:59:40.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:40 gibba020 bash[25448]: audit 2021-03-10T14:59:39.828315+0000 mon.a (mon.0) 1618 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T14:59:40.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:40 gibba020 bash[25448]: audit 2021-03-10T14:59:39.835953+0000 mon.a (mon.0) 1619 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T14:59:40.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:40 gibba020 bash[25448]: audit 2021-03-10T14:59:39.838729+0000 mon.a (mon.0) 1620 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:40.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:40 gibba020 bash[25448]: audit 2021-03-10T14:59:39.841412+0000 mon.a (mon.0) 1621 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:40.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:40 gibba020 bash[25448]: audit 2021-03-10T14:59:39.843647+0000 mon.a (mon.0) 1622 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:40.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:40 gibba020 bash[25448]: audit 2021-03-10T14:59:39.850518+0000 mon.a (mon.0) 1623 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:40.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:40 gibba020 bash[25448]: audit 2021-03-10T14:59:39.856694+0000 mon.a (mon.0) 1624 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:41.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:41 gibba013 bash[29418]: cephadm 2021-03-10T14:59:39.625799+0000 mgr.gibba020.yqfnwy (mgr.34427) 3540 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:59:41.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:41 gibba013 bash[29418]: cephadm 2021-03-10T14:59:39.834123+0000 mgr.gibba020.yqfnwy (mgr.34427) 3541 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:59:41.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:41 gibba013 bash[29418]: cephadm 2021-03-10T14:59:39.837208+0000 mgr.gibba020.yqfnwy (mgr.34427) 3542 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:59:41.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:41 gibba013 bash[29418]: cephadm 2021-03-10T14:59:39.839787+0000 mgr.gibba020.yqfnwy (mgr.34427) 3543 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:59:41.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:41 gibba013 bash[29418]: cephadm 2021-03-10T14:59:39.839824+0000 mgr.gibba020.yqfnwy (mgr.34427) 3544 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:59:41.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:41 gibba013 bash[29418]: cephadm 2021-03-10T14:59:39.842153+0000 mgr.gibba020.yqfnwy (mgr.34427) 3545 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:59:41.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:41 gibba013 bash[29418]: cephadm 2021-03-10T14:59:39.842189+0000 mgr.gibba020.yqfnwy (mgr.34427) 3546 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:59:41.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:41 gibba013 bash[29418]: cephadm 2021-03-10T14:59:39.844393+0000 mgr.gibba020.yqfnwy (mgr.34427) 3547 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:59:41.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:41 gibba013 bash[29418]: cephadm 2021-03-10T14:59:39.847267+0000 mgr.gibba020.yqfnwy (mgr.34427) 3548 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:59:41.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:41 gibba013 bash[29418]: cephadm 2021-03-10T14:59:39.847583+0000 mgr.gibba020.yqfnwy (mgr.34427) 3549 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:59:41.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:41 gibba013 bash[29418]: cephadm 2021-03-10T14:59:39.852466+0000 mgr.gibba020.yqfnwy (mgr.34427) 3550 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:59:41.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:41 gibba013 bash[29418]: cephadm 2021-03-10T14:59:39.854558+0000 mgr.gibba020.yqfnwy (mgr.34427) 3551 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:59:41.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:41 gibba013 bash[29418]: cephadm 2021-03-10T14:59:39.858514+0000 mgr.gibba020.yqfnwy (mgr.34427) 3552 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:59:41.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:41 gibba013 bash[29418]: cephadm 2021-03-10T14:59:39.859009+0000 mgr.gibba020.yqfnwy (mgr.34427) 3553 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:59:41.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:41 gibba013 bash[29418]: cephadm 2021-03-10T14:59:39.859599+0000 mgr.gibba020.yqfnwy (mgr.34427) 3554 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:59:41.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:41 gibba013 bash[30381]: cephadm 2021-03-10T14:59:39.625799+0000 mgr.gibba020.yqfnwy (mgr.34427) 3540 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:59:41.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:41 gibba013 bash[30381]: cephadm 2021-03-10T14:59:39.834123+0000 mgr.gibba020.yqfnwy (mgr.34427) 3541 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:59:41.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:41 gibba013 bash[30381]: cephadm 2021-03-10T14:59:39.837208+0000 mgr.gibba020.yqfnwy (mgr.34427) 3542 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:59:41.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:41 gibba013 bash[30381]: cephadm 2021-03-10T14:59:39.839787+0000 mgr.gibba020.yqfnwy (mgr.34427) 3543 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:59:41.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:41 gibba013 bash[30381]: cephadm 2021-03-10T14:59:39.839824+0000 mgr.gibba020.yqfnwy (mgr.34427) 3544 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:59:41.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:41 gibba013 bash[30381]: cephadm 2021-03-10T14:59:39.842153+0000 mgr.gibba020.yqfnwy (mgr.34427) 3545 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:59:41.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:41 gibba013 bash[30381]: cephadm 2021-03-10T14:59:39.842189+0000 mgr.gibba020.yqfnwy (mgr.34427) 3546 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:59:41.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:41 gibba013 bash[30381]: cephadm 2021-03-10T14:59:39.844393+0000 mgr.gibba020.yqfnwy (mgr.34427) 3547 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:59:41.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:41 gibba013 bash[30381]: cephadm 2021-03-10T14:59:39.847267+0000 mgr.gibba020.yqfnwy (mgr.34427) 3548 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:59:41.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:41 gibba013 bash[30381]: cephadm 2021-03-10T14:59:39.847583+0000 mgr.gibba020.yqfnwy (mgr.34427) 3549 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:59:41.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:41 gibba013 bash[30381]: cephadm 2021-03-10T14:59:39.852466+0000 mgr.gibba020.yqfnwy (mgr.34427) 3550 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:59:41.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:41 gibba013 bash[30381]: cephadm 2021-03-10T14:59:39.854558+0000 mgr.gibba020.yqfnwy (mgr.34427) 3551 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:59:41.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:41 gibba013 bash[30381]: cephadm 2021-03-10T14:59:39.858514+0000 mgr.gibba020.yqfnwy (mgr.34427) 3552 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:59:41.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:41 gibba013 bash[30381]: cephadm 2021-03-10T14:59:39.859009+0000 mgr.gibba020.yqfnwy (mgr.34427) 3553 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:59:41.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:41 gibba013 bash[30381]: cephadm 2021-03-10T14:59:39.859599+0000 mgr.gibba020.yqfnwy (mgr.34427) 3554 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:59:41.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:41 gibba020 bash[25448]: cephadm 2021-03-10T14:59:39.625799+0000 mgr.gibba020.yqfnwy (mgr.34427) 3540 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T14:59:41.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:41 gibba020 bash[25448]: cephadm 2021-03-10T14:59:39.834123+0000 mgr.gibba020.yqfnwy (mgr.34427) 3541 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T14:59:41.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:41 gibba020 bash[25448]: cephadm 2021-03-10T14:59:39.837208+0000 mgr.gibba020.yqfnwy (mgr.34427) 3542 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T14:59:41.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:41 gibba020 bash[25448]: cephadm 2021-03-10T14:59:39.839787+0000 mgr.gibba020.yqfnwy (mgr.34427) 3543 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T14:59:41.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:41 gibba020 bash[25448]: cephadm 2021-03-10T14:59:39.839824+0000 mgr.gibba020.yqfnwy (mgr.34427) 3544 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T14:59:41.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:41 gibba020 bash[25448]: cephadm 2021-03-10T14:59:39.842153+0000 mgr.gibba020.yqfnwy (mgr.34427) 3545 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T14:59:41.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:41 gibba020 bash[25448]: cephadm 2021-03-10T14:59:39.842189+0000 mgr.gibba020.yqfnwy (mgr.34427) 3546 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T14:59:41.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:41 gibba020 bash[25448]: cephadm 2021-03-10T14:59:39.844393+0000 mgr.gibba020.yqfnwy (mgr.34427) 3547 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T14:59:41.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:41 gibba020 bash[25448]: cephadm 2021-03-10T14:59:39.847267+0000 mgr.gibba020.yqfnwy (mgr.34427) 3548 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T14:59:41.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:41 gibba020 bash[25448]: cephadm 2021-03-10T14:59:39.847583+0000 mgr.gibba020.yqfnwy (mgr.34427) 3549 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T14:59:41.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:41 gibba020 bash[25448]: cephadm 2021-03-10T14:59:39.852466+0000 mgr.gibba020.yqfnwy (mgr.34427) 3550 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T14:59:41.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:41 gibba020 bash[25448]: cephadm 2021-03-10T14:59:39.854558+0000 mgr.gibba020.yqfnwy (mgr.34427) 3551 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T14:59:41.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:41 gibba020 bash[25448]: cephadm 2021-03-10T14:59:39.858514+0000 mgr.gibba020.yqfnwy (mgr.34427) 3552 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T14:59:41.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:41 gibba020 bash[25448]: cephadm 2021-03-10T14:59:39.859009+0000 mgr.gibba020.yqfnwy (mgr.34427) 3553 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T14:59:41.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:41 gibba020 bash[25448]: cephadm 2021-03-10T14:59:39.859599+0000 mgr.gibba020.yqfnwy (mgr.34427) 3554 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:59:42.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:42 gibba013 bash[29418]: cluster 2021-03-10T14:59:41.240428+0000 mgr.gibba020.yqfnwy (mgr.34427) 3555 : cluster [DBG] pgmap v2011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:42.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:42 gibba013 bash[30381]: cluster 2021-03-10T14:59:41.240428+0000 mgr.gibba020.yqfnwy (mgr.34427) 3555 : cluster [DBG] pgmap v2011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:42.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:42 gibba020 bash[25448]: cluster 2021-03-10T14:59:41.240428+0000 mgr.gibba020.yqfnwy (mgr.34427) 3555 : cluster [DBG] pgmap v2011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:44.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:44 gibba013 bash[29418]: cluster 2021-03-10T14:59:43.241861+0000 mgr.gibba020.yqfnwy (mgr.34427) 3556 : cluster [DBG] pgmap v2012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:44.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:44 gibba013 bash[30381]: cluster 2021-03-10T14:59:43.241861+0000 mgr.gibba020.yqfnwy (mgr.34427) 3556 : cluster [DBG] pgmap v2012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:44.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:44 gibba020 bash[25448]: cluster 2021-03-10T14:59:43.241861+0000 mgr.gibba020.yqfnwy (mgr.34427) 3556 : cluster [DBG] pgmap v2012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:46.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:46 gibba013 bash[30381]: cluster 2021-03-10T14:59:45.243453+0000 mgr.gibba020.yqfnwy (mgr.34427) 3557 : cluster [DBG] pgmap v2013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:46.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:46 gibba013 bash[29418]: cluster 2021-03-10T14:59:45.243453+0000 mgr.gibba020.yqfnwy (mgr.34427) 3557 : cluster [DBG] pgmap v2013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:46.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:46 gibba020 bash[25448]: cluster 2021-03-10T14:59:45.243453+0000 mgr.gibba020.yqfnwy (mgr.34427) 3557 : cluster [DBG] pgmap v2013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:47.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:47 gibba020 bash[25448]: cluster 2021-03-10T14:59:47.244814+0000 mgr.gibba020.yqfnwy (mgr.34427) 3558 : cluster [DBG] pgmap v2014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:48.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:47 gibba013 bash[29418]: cluster 2021-03-10T14:59:47.244814+0000 mgr.gibba020.yqfnwy (mgr.34427) 3558 : cluster [DBG] pgmap v2014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:48.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:47 gibba013 bash[30381]: cluster 2021-03-10T14:59:47.244814+0000 mgr.gibba020.yqfnwy (mgr.34427) 3558 : cluster [DBG] pgmap v2014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:50.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:50 gibba013 bash[29418]: cluster 2021-03-10T14:59:49.246478+0000 mgr.gibba020.yqfnwy (mgr.34427) 3559 : cluster [DBG] pgmap v2015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:50.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:50 gibba013 bash[30381]: cluster 2021-03-10T14:59:49.246478+0000 mgr.gibba020.yqfnwy (mgr.34427) 3559 : cluster [DBG] pgmap v2015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:50.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:50 gibba020 bash[25448]: cluster 2021-03-10T14:59:49.246478+0000 mgr.gibba020.yqfnwy (mgr.34427) 3559 : cluster [DBG] pgmap v2015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:52.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:52 gibba013 bash[29418]: cluster 2021-03-10T14:59:51.248239+0000 mgr.gibba020.yqfnwy (mgr.34427) 3560 : cluster [DBG] pgmap v2016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:52.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:52 gibba013 bash[30381]: cluster 2021-03-10T14:59:51.248239+0000 mgr.gibba020.yqfnwy (mgr.34427) 3560 : cluster [DBG] pgmap v2016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:52.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:52 gibba020 bash[25448]: cluster 2021-03-10T14:59:51.248239+0000 mgr.gibba020.yqfnwy (mgr.34427) 3560 : cluster [DBG] pgmap v2016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:54.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:54 gibba013 bash[29418]: cluster 2021-03-10T14:59:53.249666+0000 mgr.gibba020.yqfnwy (mgr.34427) 3561 : cluster [DBG] pgmap v2017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:54.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:54 gibba013 bash[30381]: cluster 2021-03-10T14:59:53.249666+0000 mgr.gibba020.yqfnwy (mgr.34427) 3561 : cluster [DBG] pgmap v2017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:54.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:54 gibba020 bash[25448]: cluster 2021-03-10T14:59:53.249666+0000 mgr.gibba020.yqfnwy (mgr.34427) 3561 : cluster [DBG] pgmap v2017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:55.505 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T14:59:55.732 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T14:59:55.732 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (66m) 80s ago 71m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T14:59:55.732 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (71m) 16s ago 71m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T14:59:55.732 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (66m) 16s ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T14:59:55.732 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (67m) 16s ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T14:59:55.733 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (66m) 80s ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T14:59:55.733 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (65m) 80s ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T14:59:55.733 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (65m) 16s ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T14:59:55.733 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (65m) 80s ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T14:59:55.733 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (71m) 80s ago 71m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T14:59:55.734 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (71m) 16s ago 71m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T14:59:55.734 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (64m) 80s ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T14:59:55.734 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (64m) 80s ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T14:59:55.734 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (63m) 80s ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T14:59:55.734 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (63m) 80s ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T14:59:55.735 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (62m) 16s ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T14:59:55.735 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (62m) 16s ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T14:59:55.735 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (62m) 16s ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T14:59:55.735 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (61m) 16s ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T14:59:55.735 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (71m) 16s ago 72m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T14:59:55.736 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 16s ago 69m docker.io/ceph/ceph:v15.2.0 2021-03-10T14:59:55.976 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T14:59:55.977 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T14:59:55.977 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:59:55.977 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:59:55.977 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T14:59:55.977 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T14:59:55.978 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:59:55.978 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T14:59:55.978 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T14:59:55.978 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T14:59:55.978 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T14:59:55.979 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T14:59:55.979 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T14:59:55.979 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T14:59:55.979 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T14:59:56.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:56 gibba013 bash[30381]: cephadm 2021-03-10T14:59:54.875780+0000 mgr.gibba020.yqfnwy (mgr.34427) 3562 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:59:56.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:56 gibba013 bash[30381]: cluster 2021-03-10T14:59:55.251389+0000 mgr.gibba020.yqfnwy (mgr.34427) 3563 : cluster [DBG] pgmap v2018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:56.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:56 gibba013 bash[30381]: audit 2021-03-10T14:59:55.492009+0000 mgr.gibba020.yqfnwy (mgr.34427) 3564 : audit [DBG] from='client.56431 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:59:56.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:56 gibba013 bash[30381]: audit 2021-03-10T14:59:55.973771+0000 mon.a (mon.0) 1625 : audit [DBG] from='client.? 172.21.2.113:0/718969400' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:56.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:56 gibba013 bash[29418]: cephadm 2021-03-10T14:59:54.875780+0000 mgr.gibba020.yqfnwy (mgr.34427) 3562 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:59:56.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:56 gibba013 bash[29418]: cluster 2021-03-10T14:59:55.251389+0000 mgr.gibba020.yqfnwy (mgr.34427) 3563 : cluster [DBG] pgmap v2018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:56.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:56 gibba013 bash[29418]: audit 2021-03-10T14:59:55.492009+0000 mgr.gibba020.yqfnwy (mgr.34427) 3564 : audit [DBG] from='client.56431 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:59:56.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:56 gibba013 bash[29418]: audit 2021-03-10T14:59:55.973771+0000 mon.a (mon.0) 1625 : audit [DBG] from='client.? 172.21.2.113:0/718969400' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:56.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:56 gibba020 bash[25448]: cephadm 2021-03-10T14:59:54.875780+0000 mgr.gibba020.yqfnwy (mgr.34427) 3562 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T14:59:56.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:56 gibba020 bash[25448]: cluster 2021-03-10T14:59:55.251389+0000 mgr.gibba020.yqfnwy (mgr.34427) 3563 : cluster [DBG] pgmap v2018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:56.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:56 gibba020 bash[25448]: audit 2021-03-10T14:59:55.492009+0000 mgr.gibba020.yqfnwy (mgr.34427) 3564 : audit [DBG] from='client.56431 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:59:56.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:56 gibba020 bash[25448]: audit 2021-03-10T14:59:55.973771+0000 mon.a (mon.0) 1625 : audit [DBG] from='client.? 172.21.2.113:0/718969400' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T14:59:57.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:57 gibba013 bash[29418]: audit 2021-03-10T14:59:55.715306+0000 mgr.gibba020.yqfnwy (mgr.34427) 3565 : audit [DBG] from='client.46452 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:59:57.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:57 gibba013 bash[30381]: audit 2021-03-10T14:59:55.715306+0000 mgr.gibba020.yqfnwy (mgr.34427) 3565 : audit [DBG] from='client.46452 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:59:57.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:57 gibba020 bash[25448]: audit 2021-03-10T14:59:55.715306+0000 mgr.gibba020.yqfnwy (mgr.34427) 3565 : audit [DBG] from='client.46452 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T14:59:58.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 14:59:58 gibba013 bash[29418]: cluster 2021-03-10T14:59:57.252676+0000 mgr.gibba020.yqfnwy (mgr.34427) 3566 : cluster [DBG] pgmap v2019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:58.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 14:59:58 gibba013 bash[30381]: cluster 2021-03-10T14:59:57.252676+0000 mgr.gibba020.yqfnwy (mgr.34427) 3566 : cluster [DBG] pgmap v2019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T14:59:58.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 14:59:58 gibba020 bash[25448]: cluster 2021-03-10T14:59:57.252676+0000 mgr.gibba020.yqfnwy (mgr.34427) 3566 : cluster [DBG] pgmap v2019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:00.355 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:00 gibba013 bash[29418]: debug 2021-03-10T14:59:59.999+0000 7fd718a82700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:00:00.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:00 gibba013 bash[29418]: cluster 2021-03-10T14:59:59.254271+0000 mgr.gibba020.yqfnwy (mgr.34427) 3567 : cluster [DBG] pgmap v2020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:00.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:00 gibba013 bash[29418]: cluster 2021-03-10T15:00:00.000476+0000 mon.a (mon.0) 1626 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:00:00.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:00 gibba013 bash[30381]: cluster 2021-03-10T14:59:59.254271+0000 mgr.gibba020.yqfnwy (mgr.34427) 3567 : cluster [DBG] pgmap v2020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:00.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:00 gibba013 bash[30381]: cluster 2021-03-10T15:00:00.000476+0000 mon.a (mon.0) 1626 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:00:00.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:00 gibba020 bash[25448]: cluster 2021-03-10T14:59:59.254271+0000 mgr.gibba020.yqfnwy (mgr.34427) 3567 : cluster [DBG] pgmap v2020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:00.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:00 gibba020 bash[25448]: cluster 2021-03-10T15:00:00.000476+0000 mon.a (mon.0) 1626 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:00:02.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:02 gibba013 bash[29418]: cluster 2021-03-10T15:00:01.256135+0000 mgr.gibba020.yqfnwy (mgr.34427) 3568 : cluster [DBG] pgmap v2021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:02.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:02 gibba013 bash[30381]: cluster 2021-03-10T15:00:01.256135+0000 mgr.gibba020.yqfnwy (mgr.34427) 3568 : cluster [DBG] pgmap v2021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:02.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:02 gibba020 bash[25448]: cluster 2021-03-10T15:00:01.256135+0000 mgr.gibba020.yqfnwy (mgr.34427) 3568 : cluster [DBG] pgmap v2021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:04.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:04 gibba013 bash[29418]: cluster 2021-03-10T15:00:03.257549+0000 mgr.gibba020.yqfnwy (mgr.34427) 3569 : cluster [DBG] pgmap v2022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:04.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:04 gibba013 bash[30381]: cluster 2021-03-10T15:00:03.257549+0000 mgr.gibba020.yqfnwy (mgr.34427) 3569 : cluster [DBG] pgmap v2022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:04.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:04 gibba020 bash[25448]: cluster 2021-03-10T15:00:03.257549+0000 mgr.gibba020.yqfnwy (mgr.34427) 3569 : cluster [DBG] pgmap v2022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:06 gibba013 bash[29418]: cluster 2021-03-10T15:00:05.259220+0000 mgr.gibba020.yqfnwy (mgr.34427) 3570 : cluster [DBG] pgmap v2023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:06.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:06 gibba013 bash[29418]: audit 2021-03-10T15:00:06.310066+0000 mon.a (mon.0) 1627 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:00:06.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:06 gibba013 bash[29418]: audit 2021-03-10T15:00:06.330229+0000 mon.a (mon.0) 1628 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:00:06.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:06 gibba013 bash[29418]: audit 2021-03-10T15:00:06.370648+0000 mon.a (mon.0) 1629 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T15:00:06.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:06 gibba013 bash[29418]: audit 2021-03-10T15:00:06.371444+0000 mon.a (mon.0) 1630 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:00:06.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:06 gibba013 bash[29418]: audit 2021-03-10T15:00:06.372098+0000 mon.a (mon.0) 1631 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:00:06.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:06 gibba013 bash[29418]: audit 2021-03-10T15:00:06.372746+0000 mon.a (mon.0) 1632 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:00:06.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:06 gibba013 bash[30381]: cluster 2021-03-10T15:00:05.259220+0000 mgr.gibba020.yqfnwy (mgr.34427) 3570 : cluster [DBG] pgmap v2023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:06.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:06 gibba013 bash[30381]: audit 2021-03-10T15:00:06.310066+0000 mon.a (mon.0) 1627 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:00:06.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:06 gibba013 bash[30381]: audit 2021-03-10T15:00:06.330229+0000 mon.a (mon.0) 1628 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:00:06.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:06 gibba013 bash[30381]: audit 2021-03-10T15:00:06.370648+0000 mon.a (mon.0) 1629 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T15:00:06.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:06 gibba013 bash[30381]: audit 2021-03-10T15:00:06.371444+0000 mon.a (mon.0) 1630 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:00:06.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:06 gibba013 bash[30381]: audit 2021-03-10T15:00:06.372098+0000 mon.a (mon.0) 1631 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:00:06.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:06 gibba013 bash[30381]: audit 2021-03-10T15:00:06.372746+0000 mon.a (mon.0) 1632 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:00:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:06 gibba020 bash[25448]: cluster 2021-03-10T15:00:05.259220+0000 mgr.gibba020.yqfnwy (mgr.34427) 3570 : cluster [DBG] pgmap v2023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:06 gibba020 bash[25448]: audit 2021-03-10T15:00:06.310066+0000 mon.a (mon.0) 1627 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:00:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:06 gibba020 bash[25448]: audit 2021-03-10T15:00:06.330229+0000 mon.a (mon.0) 1628 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:00:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:06 gibba020 bash[25448]: audit 2021-03-10T15:00:06.370648+0000 mon.a (mon.0) 1629 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T15:00:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:06 gibba020 bash[25448]: audit 2021-03-10T15:00:06.371444+0000 mon.a (mon.0) 1630 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:00:06.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:06 gibba020 bash[25448]: audit 2021-03-10T15:00:06.372098+0000 mon.a (mon.0) 1631 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:00:06.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:06 gibba020 bash[25448]: audit 2021-03-10T15:00:06.372746+0000 mon.a (mon.0) 1632 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:00:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:07 gibba020 bash[25448]: cluster 2021-03-10T15:00:07.260699+0000 mgr.gibba020.yqfnwy (mgr.34427) 3571 : cluster [DBG] pgmap v2024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:08.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:07 gibba013 bash[29418]: cluster 2021-03-10T15:00:07.260699+0000 mgr.gibba020.yqfnwy (mgr.34427) 3571 : cluster [DBG] pgmap v2024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:08.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:07 gibba013 bash[30381]: cluster 2021-03-10T15:00:07.260699+0000 mgr.gibba020.yqfnwy (mgr.34427) 3571 : cluster [DBG] pgmap v2024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:10.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:10 gibba013 bash[29418]: cluster 2021-03-10T15:00:09.262360+0000 mgr.gibba020.yqfnwy (mgr.34427) 3572 : cluster [DBG] pgmap v2025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:10.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:10 gibba013 bash[30381]: cluster 2021-03-10T15:00:09.262360+0000 mgr.gibba020.yqfnwy (mgr.34427) 3572 : cluster [DBG] pgmap v2025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:10.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:10 gibba020 bash[25448]: cluster 2021-03-10T15:00:09.262360+0000 mgr.gibba020.yqfnwy (mgr.34427) 3572 : cluster [DBG] pgmap v2025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:11.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:11 gibba013 bash[29418]: cephadm 2021-03-10T15:00:09.891591+0000 mgr.gibba020.yqfnwy (mgr.34427) 3573 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:00:11.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:11 gibba013 bash[30381]: cephadm 2021-03-10T15:00:09.891591+0000 mgr.gibba020.yqfnwy (mgr.34427) 3573 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:00:11.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:11 gibba020 bash[25448]: cephadm 2021-03-10T15:00:09.891591+0000 mgr.gibba020.yqfnwy (mgr.34427) 3573 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:00:12.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:12 gibba013 bash[29418]: cluster 2021-03-10T15:00:11.264291+0000 mgr.gibba020.yqfnwy (mgr.34427) 3574 : cluster [DBG] pgmap v2026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:12.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:12 gibba013 bash[30381]: cluster 2021-03-10T15:00:11.264291+0000 mgr.gibba020.yqfnwy (mgr.34427) 3574 : cluster [DBG] pgmap v2026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:12.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:12 gibba020 bash[25448]: cluster 2021-03-10T15:00:11.264291+0000 mgr.gibba020.yqfnwy (mgr.34427) 3574 : cluster [DBG] pgmap v2026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:14.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:14 gibba013 bash[29418]: cluster 2021-03-10T15:00:13.265746+0000 mgr.gibba020.yqfnwy (mgr.34427) 3575 : cluster [DBG] pgmap v2027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:14.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:14 gibba013 bash[30381]: cluster 2021-03-10T15:00:13.265746+0000 mgr.gibba020.yqfnwy (mgr.34427) 3575 : cluster [DBG] pgmap v2027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:14.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:14 gibba020 bash[25448]: cluster 2021-03-10T15:00:13.265746+0000 mgr.gibba020.yqfnwy (mgr.34427) 3575 : cluster [DBG] pgmap v2027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:16.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:16 gibba013 bash[29418]: cluster 2021-03-10T15:00:15.267455+0000 mgr.gibba020.yqfnwy (mgr.34427) 3576 : cluster [DBG] pgmap v2028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:16.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:16 gibba013 bash[30381]: cluster 2021-03-10T15:00:15.267455+0000 mgr.gibba020.yqfnwy (mgr.34427) 3576 : cluster [DBG] pgmap v2028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:16.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:16 gibba020 bash[25448]: cluster 2021-03-10T15:00:15.267455+0000 mgr.gibba020.yqfnwy (mgr.34427) 3576 : cluster [DBG] pgmap v2028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:17.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:17 gibba020 bash[25448]: cluster 2021-03-10T15:00:17.268794+0000 mgr.gibba020.yqfnwy (mgr.34427) 3577 : cluster [DBG] pgmap v2029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:18.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:17 gibba013 bash[29418]: cluster 2021-03-10T15:00:17.268794+0000 mgr.gibba020.yqfnwy (mgr.34427) 3577 : cluster [DBG] pgmap v2029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:18.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:17 gibba013 bash[30381]: cluster 2021-03-10T15:00:17.268794+0000 mgr.gibba020.yqfnwy (mgr.34427) 3577 : cluster [DBG] pgmap v2029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:20.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:20 gibba013 bash[29418]: cluster 2021-03-10T15:00:19.270462+0000 mgr.gibba020.yqfnwy (mgr.34427) 3578 : cluster [DBG] pgmap v2030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:20.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:20 gibba013 bash[30381]: cluster 2021-03-10T15:00:19.270462+0000 mgr.gibba020.yqfnwy (mgr.34427) 3578 : cluster [DBG] pgmap v2030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:20.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:20 gibba020 bash[25448]: cluster 2021-03-10T15:00:19.270462+0000 mgr.gibba020.yqfnwy (mgr.34427) 3578 : cluster [DBG] pgmap v2030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:22.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:22 gibba013 bash[29418]: cluster 2021-03-10T15:00:21.272358+0000 mgr.gibba020.yqfnwy (mgr.34427) 3579 : cluster [DBG] pgmap v2031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:22.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:22 gibba013 bash[30381]: cluster 2021-03-10T15:00:21.272358+0000 mgr.gibba020.yqfnwy (mgr.34427) 3579 : cluster [DBG] pgmap v2031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:22.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:22 gibba020 bash[25448]: cluster 2021-03-10T15:00:21.272358+0000 mgr.gibba020.yqfnwy (mgr.34427) 3579 : cluster [DBG] pgmap v2031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:24.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:24 gibba013 bash[29418]: cluster 2021-03-10T15:00:23.273811+0000 mgr.gibba020.yqfnwy (mgr.34427) 3580 : cluster [DBG] pgmap v2032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:24.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:24 gibba013 bash[30381]: cluster 2021-03-10T15:00:23.273811+0000 mgr.gibba020.yqfnwy (mgr.34427) 3580 : cluster [DBG] pgmap v2032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:24.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:24 gibba020 bash[25448]: cluster 2021-03-10T15:00:23.273811+0000 mgr.gibba020.yqfnwy (mgr.34427) 3580 : cluster [DBG] pgmap v2032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:26.216 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:00:26.443 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:00:26.444 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (66m) 110s ago 72m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:00:26.444 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (72m) 46s ago 72m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:00:26.444 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (67m) 46s ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:00:26.444 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (67m) 46s ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:00:26.445 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (66m) 110s ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:00:26.445 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (66m) 110s ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:00:26.445 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (65m) 46s ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:00:26.445 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (66m) 110s ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:00:26.446 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (72m) 110s ago 72m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:00:26.446 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (72m) 46s ago 72m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:00:26.446 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (65m) 110s ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:00:26.446 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (64m) 110s ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:00:26.446 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (64m) 110s ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:00:26.447 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (63m) 110s ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:00:26.447 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (63m) 46s ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:00:26.447 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (63m) 46s ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:00:26.447 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (62m) 46s ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:00:26.448 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (62m) 46s ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:00:26.448 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (71m) 46s ago 72m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:00:26.448 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 46s ago 70m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:00:26.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:26 gibba013 bash[29418]: cephadm 2021-03-10T15:00:24.907616+0000 mgr.gibba020.yqfnwy (mgr.34427) 3581 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:00:26.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:26 gibba013 bash[29418]: cluster 2021-03-10T15:00:25.275572+0000 mgr.gibba020.yqfnwy (mgr.34427) 3582 : cluster [DBG] pgmap v2033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:26.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:26 gibba013 bash[30381]: cephadm 2021-03-10T15:00:24.907616+0000 mgr.gibba020.yqfnwy (mgr.34427) 3581 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:00:26.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:26 gibba013 bash[30381]: cluster 2021-03-10T15:00:25.275572+0000 mgr.gibba020.yqfnwy (mgr.34427) 3582 : cluster [DBG] pgmap v2033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:26.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:26 gibba020 bash[25448]: cephadm 2021-03-10T15:00:24.907616+0000 mgr.gibba020.yqfnwy (mgr.34427) 3581 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:00:26.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:26 gibba020 bash[25448]: cluster 2021-03-10T15:00:25.275572+0000 mgr.gibba020.yqfnwy (mgr.34427) 3582 : cluster [DBG] pgmap v2033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:26.702 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:00:26.703 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:00:26.703 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:00:26.703 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:00:26.703 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:00:26.704 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:00:26.704 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:00:26.704 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:00:26.704 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:00:26.704 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:00:26.705 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:00:26.705 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:00:26.705 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:00:26.705 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:00:26.706 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:00:27.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:27 gibba013 bash[29418]: audit 2021-03-10T15:00:26.204161+0000 mgr.gibba020.yqfnwy (mgr.34427) 3583 : audit [DBG] from='client.46464 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:00:27.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:27 gibba013 bash[29418]: audit 2021-03-10T15:00:26.427522+0000 mgr.gibba020.yqfnwy (mgr.34427) 3584 : audit [DBG] from='client.46470 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:00:27.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:27 gibba013 bash[29418]: audit 2021-03-10T15:00:26.700148+0000 mon.c (mon.1) 66 : audit [DBG] from='client.? 172.21.2.113:0/2002223088' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:27.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:27 gibba013 bash[30381]: audit 2021-03-10T15:00:26.204161+0000 mgr.gibba020.yqfnwy (mgr.34427) 3583 : audit [DBG] from='client.46464 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:00:27.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:27 gibba013 bash[30381]: audit 2021-03-10T15:00:26.427522+0000 mgr.gibba020.yqfnwy (mgr.34427) 3584 : audit [DBG] from='client.46470 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:00:27.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:27 gibba013 bash[30381]: audit 2021-03-10T15:00:26.700148+0000 mon.c (mon.1) 66 : audit [DBG] from='client.? 172.21.2.113:0/2002223088' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:27.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:27 gibba020 bash[25448]: audit 2021-03-10T15:00:26.204161+0000 mgr.gibba020.yqfnwy (mgr.34427) 3583 : audit [DBG] from='client.46464 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:00:27.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:27 gibba020 bash[25448]: audit 2021-03-10T15:00:26.427522+0000 mgr.gibba020.yqfnwy (mgr.34427) 3584 : audit [DBG] from='client.46470 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:00:27.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:27 gibba020 bash[25448]: audit 2021-03-10T15:00:26.700148+0000 mon.c (mon.1) 66 : audit [DBG] from='client.? 172.21.2.113:0/2002223088' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:28.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:28 gibba013 bash[29418]: cluster 2021-03-10T15:00:27.276983+0000 mgr.gibba020.yqfnwy (mgr.34427) 3585 : cluster [DBG] pgmap v2034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:28.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:28 gibba013 bash[30381]: cluster 2021-03-10T15:00:27.276983+0000 mgr.gibba020.yqfnwy (mgr.34427) 3585 : cluster [DBG] pgmap v2034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:28.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:28 gibba020 bash[25448]: cluster 2021-03-10T15:00:27.276983+0000 mgr.gibba020.yqfnwy (mgr.34427) 3585 : cluster [DBG] pgmap v2034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:30.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:30 gibba013 bash[29418]: cluster 2021-03-10T15:00:29.278357+0000 mgr.gibba020.yqfnwy (mgr.34427) 3586 : cluster [DBG] pgmap v2035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:30.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:30 gibba013 bash[30381]: cluster 2021-03-10T15:00:29.278357+0000 mgr.gibba020.yqfnwy (mgr.34427) 3586 : cluster [DBG] pgmap v2035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:30.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:30 gibba020 bash[25448]: cluster 2021-03-10T15:00:29.278357+0000 mgr.gibba020.yqfnwy (mgr.34427) 3586 : cluster [DBG] pgmap v2035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:32.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:32 gibba020 bash[25448]: cluster 2021-03-10T15:00:31.280248+0000 mgr.gibba020.yqfnwy (mgr.34427) 3587 : cluster [DBG] pgmap v2036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:32.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:32 gibba013 bash[29418]: cluster 2021-03-10T15:00:31.280248+0000 mgr.gibba020.yqfnwy (mgr.34427) 3587 : cluster [DBG] pgmap v2036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:32.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:32 gibba013 bash[30381]: cluster 2021-03-10T15:00:31.280248+0000 mgr.gibba020.yqfnwy (mgr.34427) 3587 : cluster [DBG] pgmap v2036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:34.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:34 gibba020 bash[25448]: cluster 2021-03-10T15:00:33.281706+0000 mgr.gibba020.yqfnwy (mgr.34427) 3588 : cluster [DBG] pgmap v2037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:34.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:34 gibba013 bash[29418]: cluster 2021-03-10T15:00:33.281706+0000 mgr.gibba020.yqfnwy (mgr.34427) 3588 : cluster [DBG] pgmap v2037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:34.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:34 gibba013 bash[30381]: cluster 2021-03-10T15:00:33.281706+0000 mgr.gibba020.yqfnwy (mgr.34427) 3588 : cluster [DBG] pgmap v2037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:36.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:36 gibba020 bash[25448]: cluster 2021-03-10T15:00:35.283468+0000 mgr.gibba020.yqfnwy (mgr.34427) 3589 : cluster [DBG] pgmap v2038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:36.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:36 gibba013 bash[29418]: cluster 2021-03-10T15:00:35.283468+0000 mgr.gibba020.yqfnwy (mgr.34427) 3589 : cluster [DBG] pgmap v2038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:36.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:36 gibba013 bash[30381]: cluster 2021-03-10T15:00:35.283468+0000 mgr.gibba020.yqfnwy (mgr.34427) 3589 : cluster [DBG] pgmap v2038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:37.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:37 gibba020 bash[25448]: cluster 2021-03-10T15:00:37.285054+0000 mgr.gibba020.yqfnwy (mgr.34427) 3590 : cluster [DBG] pgmap v2039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:38.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:37 gibba013 bash[29418]: cluster 2021-03-10T15:00:37.285054+0000 mgr.gibba020.yqfnwy (mgr.34427) 3590 : cluster [DBG] pgmap v2039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:38.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:37 gibba013 bash[30381]: cluster 2021-03-10T15:00:37.285054+0000 mgr.gibba020.yqfnwy (mgr.34427) 3590 : cluster [DBG] pgmap v2039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:40.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:40 gibba020 bash[25448]: cluster 2021-03-10T15:00:39.286529+0000 mgr.gibba020.yqfnwy (mgr.34427) 3591 : cluster [DBG] pgmap v2040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:40.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:40 gibba020 bash[25448]: audit 2021-03-10T15:00:39.925588+0000 mon.a (mon.0) 1633 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:00:40.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:40 gibba020 bash[25448]: audit 2021-03-10T15:00:40.157354+0000 mon.a (mon.0) 1634 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:00:40.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:40 gibba020 bash[25448]: audit 2021-03-10T15:00:40.160517+0000 mon.a (mon.0) 1635 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:00:40.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:40 gibba020 bash[25448]: audit 2021-03-10T15:00:40.161997+0000 mon.a (mon.0) 1636 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:40.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:40 gibba020 bash[25448]: audit 2021-03-10T15:00:40.163645+0000 mon.a (mon.0) 1637 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:40.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:40 gibba020 bash[25448]: audit 2021-03-10T15:00:40.165092+0000 mon.a (mon.0) 1638 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:40.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:40 gibba020 bash[25448]: audit 2021-03-10T15:00:40.167943+0000 mon.a (mon.0) 1639 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:40.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:40 gibba020 bash[25448]: audit 2021-03-10T15:00:40.169666+0000 mon.a (mon.0) 1640 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:40.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:40 gibba013 bash[29418]: cluster 2021-03-10T15:00:39.286529+0000 mgr.gibba020.yqfnwy (mgr.34427) 3591 : cluster [DBG] pgmap v2040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:40.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:40 gibba013 bash[29418]: audit 2021-03-10T15:00:39.925588+0000 mon.a (mon.0) 1633 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:00:40.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:40 gibba013 bash[29418]: audit 2021-03-10T15:00:40.157354+0000 mon.a (mon.0) 1634 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:00:40.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:40 gibba013 bash[29418]: audit 2021-03-10T15:00:40.160517+0000 mon.a (mon.0) 1635 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:00:40.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:40 gibba013 bash[29418]: audit 2021-03-10T15:00:40.161997+0000 mon.a (mon.0) 1636 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:40.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:40 gibba013 bash[29418]: audit 2021-03-10T15:00:40.163645+0000 mon.a (mon.0) 1637 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:40.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:40 gibba013 bash[29418]: audit 2021-03-10T15:00:40.165092+0000 mon.a (mon.0) 1638 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:40.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:40 gibba013 bash[29418]: audit 2021-03-10T15:00:40.167943+0000 mon.a (mon.0) 1639 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:40.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:40 gibba013 bash[29418]: audit 2021-03-10T15:00:40.169666+0000 mon.a (mon.0) 1640 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:40.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:40 gibba013 bash[30381]: cluster 2021-03-10T15:00:39.286529+0000 mgr.gibba020.yqfnwy (mgr.34427) 3591 : cluster [DBG] pgmap v2040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:40.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:40 gibba013 bash[30381]: audit 2021-03-10T15:00:39.925588+0000 mon.a (mon.0) 1633 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:00:40.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:40 gibba013 bash[30381]: audit 2021-03-10T15:00:40.157354+0000 mon.a (mon.0) 1634 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:00:40.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:40 gibba013 bash[30381]: audit 2021-03-10T15:00:40.160517+0000 mon.a (mon.0) 1635 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:00:40.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:40 gibba013 bash[30381]: audit 2021-03-10T15:00:40.161997+0000 mon.a (mon.0) 1636 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:40.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:40 gibba013 bash[30381]: audit 2021-03-10T15:00:40.163645+0000 mon.a (mon.0) 1637 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:40.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:40 gibba013 bash[30381]: audit 2021-03-10T15:00:40.165092+0000 mon.a (mon.0) 1638 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:40.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:40 gibba013 bash[30381]: audit 2021-03-10T15:00:40.167943+0000 mon.a (mon.0) 1639 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:40.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:40 gibba013 bash[30381]: audit 2021-03-10T15:00:40.169666+0000 mon.a (mon.0) 1640 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:41.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:41 gibba013 bash[29418]: cephadm 2021-03-10T15:00:39.930983+0000 mgr.gibba020.yqfnwy (mgr.34427) 3592 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:00:41.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:41 gibba013 bash[29418]: cephadm 2021-03-10T15:00:39.932788+0000 mgr.gibba020.yqfnwy (mgr.34427) 3593 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:00:41.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:41 gibba013 bash[29418]: cephadm 2021-03-10T15:00:40.158886+0000 mgr.gibba020.yqfnwy (mgr.34427) 3594 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:00:41.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:41 gibba013 bash[29418]: cephadm 2021-03-10T15:00:40.160743+0000 mgr.gibba020.yqfnwy (mgr.34427) 3595 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:00:41.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:41 gibba013 bash[29418]: cephadm 2021-03-10T15:00:40.162183+0000 mgr.gibba020.yqfnwy (mgr.34427) 3596 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:00:41.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:41 gibba013 bash[29418]: cephadm 2021-03-10T15:00:40.162222+0000 mgr.gibba020.yqfnwy (mgr.34427) 3597 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:00:41.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:41 gibba013 bash[29418]: cephadm 2021-03-10T15:00:40.163748+0000 mgr.gibba020.yqfnwy (mgr.34427) 3598 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:00:41.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:41 gibba013 bash[29418]: cephadm 2021-03-10T15:00:40.163787+0000 mgr.gibba020.yqfnwy (mgr.34427) 3599 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:00:41.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:41 gibba013 bash[29418]: cephadm 2021-03-10T15:00:40.165289+0000 mgr.gibba020.yqfnwy (mgr.34427) 3600 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:00:41.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:41 gibba013 bash[29418]: cephadm 2021-03-10T15:00:40.166441+0000 mgr.gibba020.yqfnwy (mgr.34427) 3601 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:00:41.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:41 gibba013 bash[29418]: cephadm 2021-03-10T15:00:40.166481+0000 mgr.gibba020.yqfnwy (mgr.34427) 3602 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:00:41.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:41 gibba013 bash[29418]: cephadm 2021-03-10T15:00:40.167988+0000 mgr.gibba020.yqfnwy (mgr.34427) 3603 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:00:41.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:41 gibba013 bash[29418]: cephadm 2021-03-10T15:00:40.168471+0000 mgr.gibba020.yqfnwy (mgr.34427) 3604 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:00:41.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:41 gibba013 bash[29418]: cephadm 2021-03-10T15:00:40.169841+0000 mgr.gibba020.yqfnwy (mgr.34427) 3605 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:00:41.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:41 gibba013 bash[29418]: cephadm 2021-03-10T15:00:40.169883+0000 mgr.gibba020.yqfnwy (mgr.34427) 3606 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:00:41.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:41 gibba013 bash[29418]: cephadm 2021-03-10T15:00:40.170011+0000 mgr.gibba020.yqfnwy (mgr.34427) 3607 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:00:41.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:41 gibba013 bash[30381]: cephadm 2021-03-10T15:00:39.930983+0000 mgr.gibba020.yqfnwy (mgr.34427) 3592 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:00:41.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:41 gibba013 bash[30381]: cephadm 2021-03-10T15:00:39.932788+0000 mgr.gibba020.yqfnwy (mgr.34427) 3593 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:00:41.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:41 gibba013 bash[30381]: cephadm 2021-03-10T15:00:40.158886+0000 mgr.gibba020.yqfnwy (mgr.34427) 3594 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:00:41.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:41 gibba013 bash[30381]: cephadm 2021-03-10T15:00:40.160743+0000 mgr.gibba020.yqfnwy (mgr.34427) 3595 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:00:41.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:41 gibba013 bash[30381]: cephadm 2021-03-10T15:00:40.162183+0000 mgr.gibba020.yqfnwy (mgr.34427) 3596 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:00:41.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:41 gibba013 bash[30381]: cephadm 2021-03-10T15:00:40.162222+0000 mgr.gibba020.yqfnwy (mgr.34427) 3597 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:00:41.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:41 gibba013 bash[30381]: cephadm 2021-03-10T15:00:40.163748+0000 mgr.gibba020.yqfnwy (mgr.34427) 3598 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:00:41.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:41 gibba013 bash[30381]: cephadm 2021-03-10T15:00:40.163787+0000 mgr.gibba020.yqfnwy (mgr.34427) 3599 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:00:41.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:41 gibba013 bash[30381]: cephadm 2021-03-10T15:00:40.165289+0000 mgr.gibba020.yqfnwy (mgr.34427) 3600 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:00:41.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:41 gibba013 bash[30381]: cephadm 2021-03-10T15:00:40.166441+0000 mgr.gibba020.yqfnwy (mgr.34427) 3601 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:00:41.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:41 gibba013 bash[30381]: cephadm 2021-03-10T15:00:40.166481+0000 mgr.gibba020.yqfnwy (mgr.34427) 3602 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:00:41.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:41 gibba013 bash[30381]: cephadm 2021-03-10T15:00:40.167988+0000 mgr.gibba020.yqfnwy (mgr.34427) 3603 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:00:41.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:41 gibba013 bash[30381]: cephadm 2021-03-10T15:00:40.168471+0000 mgr.gibba020.yqfnwy (mgr.34427) 3604 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:00:41.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:41 gibba013 bash[30381]: cephadm 2021-03-10T15:00:40.169841+0000 mgr.gibba020.yqfnwy (mgr.34427) 3605 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:00:41.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:41 gibba013 bash[30381]: cephadm 2021-03-10T15:00:40.169883+0000 mgr.gibba020.yqfnwy (mgr.34427) 3606 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:00:41.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:41 gibba013 bash[30381]: cephadm 2021-03-10T15:00:40.170011+0000 mgr.gibba020.yqfnwy (mgr.34427) 3607 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:00:41.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:41 gibba020 bash[25448]: cephadm 2021-03-10T15:00:39.930983+0000 mgr.gibba020.yqfnwy (mgr.34427) 3592 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:00:41.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:41 gibba020 bash[25448]: cephadm 2021-03-10T15:00:39.932788+0000 mgr.gibba020.yqfnwy (mgr.34427) 3593 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:00:41.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:41 gibba020 bash[25448]: cephadm 2021-03-10T15:00:40.158886+0000 mgr.gibba020.yqfnwy (mgr.34427) 3594 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:00:41.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:41 gibba020 bash[25448]: cephadm 2021-03-10T15:00:40.160743+0000 mgr.gibba020.yqfnwy (mgr.34427) 3595 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:00:41.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:41 gibba020 bash[25448]: cephadm 2021-03-10T15:00:40.162183+0000 mgr.gibba020.yqfnwy (mgr.34427) 3596 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:00:41.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:41 gibba020 bash[25448]: cephadm 2021-03-10T15:00:40.162222+0000 mgr.gibba020.yqfnwy (mgr.34427) 3597 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:00:41.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:41 gibba020 bash[25448]: cephadm 2021-03-10T15:00:40.163748+0000 mgr.gibba020.yqfnwy (mgr.34427) 3598 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:00:41.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:41 gibba020 bash[25448]: cephadm 2021-03-10T15:00:40.163787+0000 mgr.gibba020.yqfnwy (mgr.34427) 3599 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:00:41.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:41 gibba020 bash[25448]: cephadm 2021-03-10T15:00:40.165289+0000 mgr.gibba020.yqfnwy (mgr.34427) 3600 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:00:41.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:41 gibba020 bash[25448]: cephadm 2021-03-10T15:00:40.166441+0000 mgr.gibba020.yqfnwy (mgr.34427) 3601 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:00:41.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:41 gibba020 bash[25448]: cephadm 2021-03-10T15:00:40.166481+0000 mgr.gibba020.yqfnwy (mgr.34427) 3602 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:00:41.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:41 gibba020 bash[25448]: cephadm 2021-03-10T15:00:40.167988+0000 mgr.gibba020.yqfnwy (mgr.34427) 3603 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:00:41.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:41 gibba020 bash[25448]: cephadm 2021-03-10T15:00:40.168471+0000 mgr.gibba020.yqfnwy (mgr.34427) 3604 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:00:41.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:41 gibba020 bash[25448]: cephadm 2021-03-10T15:00:40.169841+0000 mgr.gibba020.yqfnwy (mgr.34427) 3605 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:00:41.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:41 gibba020 bash[25448]: cephadm 2021-03-10T15:00:40.169883+0000 mgr.gibba020.yqfnwy (mgr.34427) 3606 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:00:41.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:41 gibba020 bash[25448]: cephadm 2021-03-10T15:00:40.170011+0000 mgr.gibba020.yqfnwy (mgr.34427) 3607 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:00:42.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:42 gibba013 bash[29418]: cluster 2021-03-10T15:00:41.288406+0000 mgr.gibba020.yqfnwy (mgr.34427) 3608 : cluster [DBG] pgmap v2041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:42.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:42 gibba013 bash[30381]: cluster 2021-03-10T15:00:41.288406+0000 mgr.gibba020.yqfnwy (mgr.34427) 3608 : cluster [DBG] pgmap v2041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:42.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:42 gibba020 bash[25448]: cluster 2021-03-10T15:00:41.288406+0000 mgr.gibba020.yqfnwy (mgr.34427) 3608 : cluster [DBG] pgmap v2041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:44.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:44 gibba013 bash[29418]: cluster 2021-03-10T15:00:43.289912+0000 mgr.gibba020.yqfnwy (mgr.34427) 3609 : cluster [DBG] pgmap v2042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:44.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:44 gibba013 bash[30381]: cluster 2021-03-10T15:00:43.289912+0000 mgr.gibba020.yqfnwy (mgr.34427) 3609 : cluster [DBG] pgmap v2042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:44.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:44 gibba020 bash[25448]: cluster 2021-03-10T15:00:43.289912+0000 mgr.gibba020.yqfnwy (mgr.34427) 3609 : cluster [DBG] pgmap v2042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:46.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:46 gibba020 bash[25448]: cluster 2021-03-10T15:00:45.291395+0000 mgr.gibba020.yqfnwy (mgr.34427) 3610 : cluster [DBG] pgmap v2043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:46.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:46 gibba013 bash[29418]: cluster 2021-03-10T15:00:45.291395+0000 mgr.gibba020.yqfnwy (mgr.34427) 3610 : cluster [DBG] pgmap v2043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:46.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:46 gibba013 bash[30381]: cluster 2021-03-10T15:00:45.291395+0000 mgr.gibba020.yqfnwy (mgr.34427) 3610 : cluster [DBG] pgmap v2043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:47.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:47 gibba020 bash[25448]: cluster 2021-03-10T15:00:47.292994+0000 mgr.gibba020.yqfnwy (mgr.34427) 3611 : cluster [DBG] pgmap v2044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:48.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:47 gibba013 bash[29418]: cluster 2021-03-10T15:00:47.292994+0000 mgr.gibba020.yqfnwy (mgr.34427) 3611 : cluster [DBG] pgmap v2044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:48.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:47 gibba013 bash[30381]: cluster 2021-03-10T15:00:47.292994+0000 mgr.gibba020.yqfnwy (mgr.34427) 3611 : cluster [DBG] pgmap v2044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:50.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:50 gibba013 bash[29418]: cluster 2021-03-10T15:00:49.294434+0000 mgr.gibba020.yqfnwy (mgr.34427) 3612 : cluster [DBG] pgmap v2045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:50.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:50 gibba013 bash[30381]: cluster 2021-03-10T15:00:49.294434+0000 mgr.gibba020.yqfnwy (mgr.34427) 3612 : cluster [DBG] pgmap v2045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:50.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:50 gibba020 bash[25448]: cluster 2021-03-10T15:00:49.294434+0000 mgr.gibba020.yqfnwy (mgr.34427) 3612 : cluster [DBG] pgmap v2045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:52.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:52 gibba013 bash[29418]: cluster 2021-03-10T15:00:51.296196+0000 mgr.gibba020.yqfnwy (mgr.34427) 3613 : cluster [DBG] pgmap v2046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:52.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:52 gibba013 bash[30381]: cluster 2021-03-10T15:00:51.296196+0000 mgr.gibba020.yqfnwy (mgr.34427) 3613 : cluster [DBG] pgmap v2046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:52.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:52 gibba020 bash[25448]: cluster 2021-03-10T15:00:51.296196+0000 mgr.gibba020.yqfnwy (mgr.34427) 3613 : cluster [DBG] pgmap v2046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:54.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:54 gibba013 bash[29418]: cluster 2021-03-10T15:00:53.297633+0000 mgr.gibba020.yqfnwy (mgr.34427) 3614 : cluster [DBG] pgmap v2047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:54.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:54 gibba013 bash[30381]: cluster 2021-03-10T15:00:53.297633+0000 mgr.gibba020.yqfnwy (mgr.34427) 3614 : cluster [DBG] pgmap v2047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:54.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:54 gibba020 bash[25448]: cluster 2021-03-10T15:00:53.297633+0000 mgr.gibba020.yqfnwy (mgr.34427) 3614 : cluster [DBG] pgmap v2047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:56.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:56 gibba020 bash[25448]: cephadm 2021-03-10T15:00:55.186078+0000 mgr.gibba020.yqfnwy (mgr.34427) 3615 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:00:56.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:56 gibba020 bash[25448]: cluster 2021-03-10T15:00:55.299163+0000 mgr.gibba020.yqfnwy (mgr.34427) 3616 : cluster [DBG] pgmap v2048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:56.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:56 gibba013 bash[29418]: cephadm 2021-03-10T15:00:55.186078+0000 mgr.gibba020.yqfnwy (mgr.34427) 3615 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:00:56.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:56 gibba013 bash[29418]: cluster 2021-03-10T15:00:55.299163+0000 mgr.gibba020.yqfnwy (mgr.34427) 3616 : cluster [DBG] pgmap v2048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:56.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:56 gibba013 bash[30381]: cephadm 2021-03-10T15:00:55.186078+0000 mgr.gibba020.yqfnwy (mgr.34427) 3615 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:00:56.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:56 gibba013 bash[30381]: cluster 2021-03-10T15:00:55.299163+0000 mgr.gibba020.yqfnwy (mgr.34427) 3616 : cluster [DBG] pgmap v2048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:56.951 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:00:57.176 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:00:57.176 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (67m) 2m ago 72m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:00:57.177 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (72m) 77s ago 72m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:00:57.177 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (67m) 77s ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:00:57.177 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (68m) 77s ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:00:57.177 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (67m) 2m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:00:57.178 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (66m) 2m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:00:57.178 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (66m) 77s ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:00:57.178 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (66m) 2m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:00:57.178 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (72m) 2m ago 73m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:00:57.179 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (72m) 77s ago 73m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:00:57.179 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (65m) 2m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:00:57.179 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (65m) 2m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:00:57.179 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (64m) 2m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:00:57.180 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (64m) 2m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:00:57.180 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (63m) 77s ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:00:57.180 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (63m) 77s ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:00:57.180 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (63m) 77s ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:00:57.180 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (62m) 77s ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:00:57.181 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (72m) 77s ago 73m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:00:57.181 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 77s ago 70m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:00:57.423 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:00:57.424 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:00:57.424 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:00:57.425 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:00:57.425 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:00:57.426 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:00:57.426 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:00:57.426 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:00:57.427 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:00:57.427 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:00:57.428 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:00:57.428 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:00:57.428 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:00:57.429 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:00:57.429 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:00:57.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:57 gibba020 bash[25448]: audit 2021-03-10T15:00:56.938407+0000 mgr.gibba020.yqfnwy (mgr.34427) 3617 : audit [DBG] from='client.46482 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:00:57.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:57 gibba020 bash[25448]: audit 2021-03-10T15:00:57.162578+0000 mgr.gibba020.yqfnwy (mgr.34427) 3618 : audit [DBG] from='client.56473 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:00:57.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:57 gibba020 bash[25448]: cluster 2021-03-10T15:00:57.300741+0000 mgr.gibba020.yqfnwy (mgr.34427) 3619 : cluster [DBG] pgmap v2049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:57.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:00:57 gibba020 bash[25448]: audit 2021-03-10T15:00:57.420436+0000 mon.a (mon.0) 1641 : audit [DBG] from='client.? 172.21.2.113:0/1939703842' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:58.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:57 gibba013 bash[29418]: audit 2021-03-10T15:00:56.938407+0000 mgr.gibba020.yqfnwy (mgr.34427) 3617 : audit [DBG] from='client.46482 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:00:58.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:57 gibba013 bash[29418]: audit 2021-03-10T15:00:57.162578+0000 mgr.gibba020.yqfnwy (mgr.34427) 3618 : audit [DBG] from='client.56473 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:00:58.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:57 gibba013 bash[29418]: cluster 2021-03-10T15:00:57.300741+0000 mgr.gibba020.yqfnwy (mgr.34427) 3619 : cluster [DBG] pgmap v2049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:58.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:00:57 gibba013 bash[29418]: audit 2021-03-10T15:00:57.420436+0000 mon.a (mon.0) 1641 : audit [DBG] from='client.? 172.21.2.113:0/1939703842' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:00:58.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:57 gibba013 bash[30381]: audit 2021-03-10T15:00:56.938407+0000 mgr.gibba020.yqfnwy (mgr.34427) 3617 : audit [DBG] from='client.46482 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:00:58.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:57 gibba013 bash[30381]: audit 2021-03-10T15:00:57.162578+0000 mgr.gibba020.yqfnwy (mgr.34427) 3618 : audit [DBG] from='client.56473 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:00:58.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:57 gibba013 bash[30381]: cluster 2021-03-10T15:00:57.300741+0000 mgr.gibba020.yqfnwy (mgr.34427) 3619 : cluster [DBG] pgmap v2049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:00:58.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:00:57 gibba013 bash[30381]: audit 2021-03-10T15:00:57.420436+0000 mon.a (mon.0) 1641 : audit [DBG] from='client.? 172.21.2.113:0/1939703842' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:00.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:00 gibba013 bash[29418]: cluster 2021-03-10T15:00:59.302112+0000 mgr.gibba020.yqfnwy (mgr.34427) 3620 : cluster [DBG] pgmap v2050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:00.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:00 gibba013 bash[30381]: cluster 2021-03-10T15:00:59.302112+0000 mgr.gibba020.yqfnwy (mgr.34427) 3620 : cluster [DBG] pgmap v2050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:00.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:00 gibba020 bash[25448]: cluster 2021-03-10T15:00:59.302112+0000 mgr.gibba020.yqfnwy (mgr.34427) 3620 : cluster [DBG] pgmap v2050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:02.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:02 gibba013 bash[29418]: cluster 2021-03-10T15:01:01.303981+0000 mgr.gibba020.yqfnwy (mgr.34427) 3621 : cluster [DBG] pgmap v2051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:02.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:02 gibba013 bash[30381]: cluster 2021-03-10T15:01:01.303981+0000 mgr.gibba020.yqfnwy (mgr.34427) 3621 : cluster [DBG] pgmap v2051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:02.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:02 gibba020 bash[25448]: cluster 2021-03-10T15:01:01.303981+0000 mgr.gibba020.yqfnwy (mgr.34427) 3621 : cluster [DBG] pgmap v2051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:04.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:04 gibba020 bash[25448]: cluster 2021-03-10T15:01:03.305413+0000 mgr.gibba020.yqfnwy (mgr.34427) 3622 : cluster [DBG] pgmap v2052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:04.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:04 gibba013 bash[29418]: cluster 2021-03-10T15:01:03.305413+0000 mgr.gibba020.yqfnwy (mgr.34427) 3622 : cluster [DBG] pgmap v2052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:04.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:04 gibba013 bash[30381]: cluster 2021-03-10T15:01:03.305413+0000 mgr.gibba020.yqfnwy (mgr.34427) 3622 : cluster [DBG] pgmap v2052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:06 gibba020 bash[25448]: cluster 2021-03-10T15:01:05.306987+0000 mgr.gibba020.yqfnwy (mgr.34427) 3623 : cluster [DBG] pgmap v2053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:06 gibba020 bash[25448]: audit 2021-03-10T15:01:06.314919+0000 mon.a (mon.0) 1642 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:01:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:06 gibba020 bash[25448]: audit 2021-03-10T15:01:06.336954+0000 mon.a (mon.0) 1643 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:01:06.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:06 gibba020 bash[25448]: audit 2021-03-10T15:01:06.380908+0000 mon.a (mon.0) 1644 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T15:01:06.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:06 gibba020 bash[25448]: audit 2021-03-10T15:01:06.381675+0000 mon.a (mon.0) 1645 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:01:06.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:06 gibba020 bash[25448]: audit 2021-03-10T15:01:06.382363+0000 mon.a (mon.0) 1646 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:01:06.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:06 gibba020 bash[25448]: audit 2021-03-10T15:01:06.383030+0000 mon.a (mon.0) 1647 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:01:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:06 gibba013 bash[29418]: cluster 2021-03-10T15:01:05.306987+0000 mgr.gibba020.yqfnwy (mgr.34427) 3623 : cluster [DBG] pgmap v2053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:06 gibba013 bash[29418]: audit 2021-03-10T15:01:06.314919+0000 mon.a (mon.0) 1642 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:01:06.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:06 gibba013 bash[29418]: audit 2021-03-10T15:01:06.336954+0000 mon.a (mon.0) 1643 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:01:06.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:06 gibba013 bash[29418]: audit 2021-03-10T15:01:06.380908+0000 mon.a (mon.0) 1644 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T15:01:06.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:06 gibba013 bash[29418]: audit 2021-03-10T15:01:06.381675+0000 mon.a (mon.0) 1645 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:01:06.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:06 gibba013 bash[29418]: audit 2021-03-10T15:01:06.382363+0000 mon.a (mon.0) 1646 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:01:06.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:06 gibba013 bash[29418]: audit 2021-03-10T15:01:06.383030+0000 mon.a (mon.0) 1647 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:01:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:06 gibba013 bash[30381]: cluster 2021-03-10T15:01:05.306987+0000 mgr.gibba020.yqfnwy (mgr.34427) 3623 : cluster [DBG] pgmap v2053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:06 gibba013 bash[30381]: audit 2021-03-10T15:01:06.314919+0000 mon.a (mon.0) 1642 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:01:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:06 gibba013 bash[30381]: audit 2021-03-10T15:01:06.336954+0000 mon.a (mon.0) 1643 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:01:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:06 gibba013 bash[30381]: audit 2021-03-10T15:01:06.380908+0000 mon.a (mon.0) 1644 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T15:01:06.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:06 gibba013 bash[30381]: audit 2021-03-10T15:01:06.381675+0000 mon.a (mon.0) 1645 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:01:06.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:06 gibba013 bash[30381]: audit 2021-03-10T15:01:06.382363+0000 mon.a (mon.0) 1646 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:01:06.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:06 gibba013 bash[30381]: audit 2021-03-10T15:01:06.383030+0000 mon.a (mon.0) 1647 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:01:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:07 gibba020 bash[25448]: cluster 2021-03-10T15:01:07.308491+0000 mgr.gibba020.yqfnwy (mgr.34427) 3624 : cluster [DBG] pgmap v2054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:08.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:07 gibba013 bash[29418]: cluster 2021-03-10T15:01:07.308491+0000 mgr.gibba020.yqfnwy (mgr.34427) 3624 : cluster [DBG] pgmap v2054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:08.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:07 gibba013 bash[30381]: cluster 2021-03-10T15:01:07.308491+0000 mgr.gibba020.yqfnwy (mgr.34427) 3624 : cluster [DBG] pgmap v2054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:10.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:10 gibba013 bash[29418]: cluster 2021-03-10T15:01:09.309850+0000 mgr.gibba020.yqfnwy (mgr.34427) 3625 : cluster [DBG] pgmap v2055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:10.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:10 gibba013 bash[30381]: cluster 2021-03-10T15:01:09.309850+0000 mgr.gibba020.yqfnwy (mgr.34427) 3625 : cluster [DBG] pgmap v2055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:10.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:10 gibba020 bash[25448]: cluster 2021-03-10T15:01:09.309850+0000 mgr.gibba020.yqfnwy (mgr.34427) 3625 : cluster [DBG] pgmap v2055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:11.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:11 gibba020 bash[25448]: cephadm 2021-03-10T15:01:10.202236+0000 mgr.gibba020.yqfnwy (mgr.34427) 3626 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:01:11.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:11 gibba013 bash[29418]: cephadm 2021-03-10T15:01:10.202236+0000 mgr.gibba020.yqfnwy (mgr.34427) 3626 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:01:11.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:11 gibba013 bash[30381]: cephadm 2021-03-10T15:01:10.202236+0000 mgr.gibba020.yqfnwy (mgr.34427) 3626 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:01:12.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:12 gibba020 bash[25448]: cluster 2021-03-10T15:01:11.311426+0000 mgr.gibba020.yqfnwy (mgr.34427) 3627 : cluster [DBG] pgmap v2056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:12.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:12 gibba013 bash[29418]: cluster 2021-03-10T15:01:11.311426+0000 mgr.gibba020.yqfnwy (mgr.34427) 3627 : cluster [DBG] pgmap v2056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:12.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:12 gibba013 bash[30381]: cluster 2021-03-10T15:01:11.311426+0000 mgr.gibba020.yqfnwy (mgr.34427) 3627 : cluster [DBG] pgmap v2056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:14.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:14 gibba020 bash[25448]: cluster 2021-03-10T15:01:13.312869+0000 mgr.gibba020.yqfnwy (mgr.34427) 3628 : cluster [DBG] pgmap v2057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:14.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:14 gibba013 bash[29418]: cluster 2021-03-10T15:01:13.312869+0000 mgr.gibba020.yqfnwy (mgr.34427) 3628 : cluster [DBG] pgmap v2057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:14.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:14 gibba013 bash[30381]: cluster 2021-03-10T15:01:13.312869+0000 mgr.gibba020.yqfnwy (mgr.34427) 3628 : cluster [DBG] pgmap v2057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:16.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:16 gibba020 bash[25448]: cluster 2021-03-10T15:01:15.314457+0000 mgr.gibba020.yqfnwy (mgr.34427) 3629 : cluster [DBG] pgmap v2058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:16.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:16 gibba013 bash[29418]: cluster 2021-03-10T15:01:15.314457+0000 mgr.gibba020.yqfnwy (mgr.34427) 3629 : cluster [DBG] pgmap v2058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:16.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:16 gibba013 bash[30381]: cluster 2021-03-10T15:01:15.314457+0000 mgr.gibba020.yqfnwy (mgr.34427) 3629 : cluster [DBG] pgmap v2058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:17.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:17 gibba020 bash[25448]: cluster 2021-03-10T15:01:17.316030+0000 mgr.gibba020.yqfnwy (mgr.34427) 3630 : cluster [DBG] pgmap v2059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:18.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:17 gibba013 bash[29418]: cluster 2021-03-10T15:01:17.316030+0000 mgr.gibba020.yqfnwy (mgr.34427) 3630 : cluster [DBG] pgmap v2059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:18.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:17 gibba013 bash[30381]: cluster 2021-03-10T15:01:17.316030+0000 mgr.gibba020.yqfnwy (mgr.34427) 3630 : cluster [DBG] pgmap v2059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:20.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:20 gibba020 bash[25448]: cluster 2021-03-10T15:01:19.317563+0000 mgr.gibba020.yqfnwy (mgr.34427) 3631 : cluster [DBG] pgmap v2060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:20.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:20 gibba013 bash[29418]: cluster 2021-03-10T15:01:19.317563+0000 mgr.gibba020.yqfnwy (mgr.34427) 3631 : cluster [DBG] pgmap v2060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:20.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:20 gibba013 bash[30381]: cluster 2021-03-10T15:01:19.317563+0000 mgr.gibba020.yqfnwy (mgr.34427) 3631 : cluster [DBG] pgmap v2060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:22.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:22 gibba020 bash[25448]: cluster 2021-03-10T15:01:21.319301+0000 mgr.gibba020.yqfnwy (mgr.34427) 3632 : cluster [DBG] pgmap v2061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:22.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:22 gibba013 bash[29418]: cluster 2021-03-10T15:01:21.319301+0000 mgr.gibba020.yqfnwy (mgr.34427) 3632 : cluster [DBG] pgmap v2061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:22.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:22 gibba013 bash[30381]: cluster 2021-03-10T15:01:21.319301+0000 mgr.gibba020.yqfnwy (mgr.34427) 3632 : cluster [DBG] pgmap v2061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:24.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:24 gibba020 bash[25448]: cluster 2021-03-10T15:01:23.320717+0000 mgr.gibba020.yqfnwy (mgr.34427) 3633 : cluster [DBG] pgmap v2062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:24.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:24 gibba013 bash[29418]: cluster 2021-03-10T15:01:23.320717+0000 mgr.gibba020.yqfnwy (mgr.34427) 3633 : cluster [DBG] pgmap v2062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:24.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:24 gibba013 bash[30381]: cluster 2021-03-10T15:01:23.320717+0000 mgr.gibba020.yqfnwy (mgr.34427) 3633 : cluster [DBG] pgmap v2062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:26.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:26 gibba020 bash[25448]: cephadm 2021-03-10T15:01:25.218210+0000 mgr.gibba020.yqfnwy (mgr.34427) 3634 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:01:26.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:26 gibba020 bash[25448]: cluster 2021-03-10T15:01:25.322371+0000 mgr.gibba020.yqfnwy (mgr.34427) 3635 : cluster [DBG] pgmap v2063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:26.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:26 gibba013 bash[29418]: cephadm 2021-03-10T15:01:25.218210+0000 mgr.gibba020.yqfnwy (mgr.34427) 3634 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:01:26.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:26 gibba013 bash[29418]: cluster 2021-03-10T15:01:25.322371+0000 mgr.gibba020.yqfnwy (mgr.34427) 3635 : cluster [DBG] pgmap v2063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:26.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:26 gibba013 bash[30381]: cephadm 2021-03-10T15:01:25.218210+0000 mgr.gibba020.yqfnwy (mgr.34427) 3634 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:01:26.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:26 gibba013 bash[30381]: cluster 2021-03-10T15:01:25.322371+0000 mgr.gibba020.yqfnwy (mgr.34427) 3635 : cluster [DBG] pgmap v2063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:27.665 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:01:27.892 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:01:27.892 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (67m) 2m ago 73m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:01:27.893 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (73m) 108s ago 73m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:01:27.893 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (68m) 108s ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:01:27.893 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (68m) 108s ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:01:27.893 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (67m) 2m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:01:27.893 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (67m) 2m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:01:27.894 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (67m) 108s ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:01:27.894 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (67m) 2m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:01:27.894 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (73m) 2m ago 73m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:01:27.894 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (73m) 108s ago 73m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:01:27.895 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (66m) 2m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:01:27.895 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (65m) 2m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:01:27.895 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (65m) 2m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:01:27.895 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (64m) 2m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:01:27.896 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (64m) 108s ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:01:27.896 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (64m) 108s ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:01:27.896 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (63m) 108s ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:01:27.896 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (63m) 108s ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:01:27.896 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (72m) 108s ago 73m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:01:27.897 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 108s ago 71m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:01:27.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:27 gibba020 bash[25448]: cluster 2021-03-10T15:01:27.324017+0000 mgr.gibba020.yqfnwy (mgr.34427) 3636 : cluster [DBG] pgmap v2064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:28.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:27 gibba013 bash[29418]: cluster 2021-03-10T15:01:27.324017+0000 mgr.gibba020.yqfnwy (mgr.34427) 3636 : cluster [DBG] pgmap v2064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:28.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:27 gibba013 bash[30381]: cluster 2021-03-10T15:01:27.324017+0000 mgr.gibba020.yqfnwy (mgr.34427) 3636 : cluster [DBG] pgmap v2064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:28.139 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:01:28.140 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:01:28.140 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:01:28.140 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:01:28.140 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:01:28.141 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:01:28.141 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:01:28.141 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:01:28.141 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:01:28.142 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:01:28.142 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:01:28.142 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:01:28.142 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:01:28.143 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:01:28.143 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:01:28.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:28 gibba020 bash[25448]: audit 2021-03-10T15:01:27.650638+0000 mgr.gibba020.yqfnwy (mgr.34427) 3637 : audit [DBG] from='client.46500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:01:28.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:28 gibba020 bash[25448]: audit 2021-03-10T15:01:27.876128+0000 mgr.gibba020.yqfnwy (mgr.34427) 3638 : audit [DBG] from='client.46506 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:01:28.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:28 gibba020 bash[25448]: audit 2021-03-10T15:01:28.136892+0000 mon.c (mon.1) 67 : audit [DBG] from='client.? 172.21.2.113:0/4094435237' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:29.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:28 gibba013 bash[29418]: audit 2021-03-10T15:01:27.650638+0000 mgr.gibba020.yqfnwy (mgr.34427) 3637 : audit [DBG] from='client.46500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:01:29.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:28 gibba013 bash[29418]: audit 2021-03-10T15:01:27.876128+0000 mgr.gibba020.yqfnwy (mgr.34427) 3638 : audit [DBG] from='client.46506 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:01:29.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:28 gibba013 bash[29418]: audit 2021-03-10T15:01:28.136892+0000 mon.c (mon.1) 67 : audit [DBG] from='client.? 172.21.2.113:0/4094435237' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:29.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:28 gibba013 bash[30381]: audit 2021-03-10T15:01:27.650638+0000 mgr.gibba020.yqfnwy (mgr.34427) 3637 : audit [DBG] from='client.46500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:01:29.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:28 gibba013 bash[30381]: audit 2021-03-10T15:01:27.876128+0000 mgr.gibba020.yqfnwy (mgr.34427) 3638 : audit [DBG] from='client.46506 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:01:29.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:28 gibba013 bash[30381]: audit 2021-03-10T15:01:28.136892+0000 mon.c (mon.1) 67 : audit [DBG] from='client.? 172.21.2.113:0/4094435237' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:29.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:29 gibba020 bash[25448]: cluster 2021-03-10T15:01:29.325578+0000 mgr.gibba020.yqfnwy (mgr.34427) 3639 : cluster [DBG] pgmap v2065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:30.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:29 gibba013 bash[29418]: cluster 2021-03-10T15:01:29.325578+0000 mgr.gibba020.yqfnwy (mgr.34427) 3639 : cluster [DBG] pgmap v2065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:30.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:29 gibba013 bash[30381]: cluster 2021-03-10T15:01:29.325578+0000 mgr.gibba020.yqfnwy (mgr.34427) 3639 : cluster [DBG] pgmap v2065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:32.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:32 gibba020 bash[25448]: cluster 2021-03-10T15:01:31.327437+0000 mgr.gibba020.yqfnwy (mgr.34427) 3640 : cluster [DBG] pgmap v2066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:32.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:32 gibba013 bash[29418]: cluster 2021-03-10T15:01:31.327437+0000 mgr.gibba020.yqfnwy (mgr.34427) 3640 : cluster [DBG] pgmap v2066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:32.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:32 gibba013 bash[30381]: cluster 2021-03-10T15:01:31.327437+0000 mgr.gibba020.yqfnwy (mgr.34427) 3640 : cluster [DBG] pgmap v2066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:34.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:34 gibba020 bash[25448]: cluster 2021-03-10T15:01:33.328854+0000 mgr.gibba020.yqfnwy (mgr.34427) 3641 : cluster [DBG] pgmap v2067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:34.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:34 gibba013 bash[29418]: cluster 2021-03-10T15:01:33.328854+0000 mgr.gibba020.yqfnwy (mgr.34427) 3641 : cluster [DBG] pgmap v2067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:34.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:34 gibba013 bash[30381]: cluster 2021-03-10T15:01:33.328854+0000 mgr.gibba020.yqfnwy (mgr.34427) 3641 : cluster [DBG] pgmap v2067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:36.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:36 gibba020 bash[25448]: cluster 2021-03-10T15:01:35.330476+0000 mgr.gibba020.yqfnwy (mgr.34427) 3642 : cluster [DBG] pgmap v2068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:36.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:36 gibba013 bash[29418]: cluster 2021-03-10T15:01:35.330476+0000 mgr.gibba020.yqfnwy (mgr.34427) 3642 : cluster [DBG] pgmap v2068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:36.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:36 gibba013 bash[30381]: cluster 2021-03-10T15:01:35.330476+0000 mgr.gibba020.yqfnwy (mgr.34427) 3642 : cluster [DBG] pgmap v2068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:37.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:37 gibba020 bash[25448]: cluster 2021-03-10T15:01:37.332029+0000 mgr.gibba020.yqfnwy (mgr.34427) 3643 : cluster [DBG] pgmap v2069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:38.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:37 gibba013 bash[29418]: cluster 2021-03-10T15:01:37.332029+0000 mgr.gibba020.yqfnwy (mgr.34427) 3643 : cluster [DBG] pgmap v2069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:38.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:37 gibba013 bash[30381]: cluster 2021-03-10T15:01:37.332029+0000 mgr.gibba020.yqfnwy (mgr.34427) 3643 : cluster [DBG] pgmap v2069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:40.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:40 gibba020 bash[25448]: cluster 2021-03-10T15:01:39.333620+0000 mgr.gibba020.yqfnwy (mgr.34427) 3644 : cluster [DBG] pgmap v2070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:40.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:40 gibba020 bash[25448]: audit 2021-03-10T15:01:40.225196+0000 mon.a (mon.0) 1648 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:01:40.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:40 gibba013 bash[29418]: cluster 2021-03-10T15:01:39.333620+0000 mgr.gibba020.yqfnwy (mgr.34427) 3644 : cluster [DBG] pgmap v2070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:40.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:40 gibba013 bash[29418]: audit 2021-03-10T15:01:40.225196+0000 mon.a (mon.0) 1648 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:01:40.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:40 gibba013 bash[30381]: cluster 2021-03-10T15:01:39.333620+0000 mgr.gibba020.yqfnwy (mgr.34427) 3644 : cluster [DBG] pgmap v2070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:40.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:40 gibba013 bash[30381]: audit 2021-03-10T15:01:40.225196+0000 mon.a (mon.0) 1648 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:01:41.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[29418]: cephadm 2021-03-10T15:01:40.229192+0000 mgr.gibba020.yqfnwy (mgr.34427) 3645 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:01:41.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[29418]: cephadm 2021-03-10T15:01:40.231035+0000 mgr.gibba020.yqfnwy (mgr.34427) 3646 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:01:41.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[29418]: audit 2021-03-10T15:01:40.480649+0000 mon.a (mon.0) 1649 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:01:41.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[29418]: cephadm 2021-03-10T15:01:40.482960+0000 mgr.gibba020.yqfnwy (mgr.34427) 3647 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:01:41.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[29418]: audit 2021-03-10T15:01:40.484715+0000 mon.a (mon.0) 1650 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:01:41.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[29418]: cephadm 2021-03-10T15:01:40.484945+0000 mgr.gibba020.yqfnwy (mgr.34427) 3648 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:01:41.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[29418]: cephadm 2021-03-10T15:01:40.486178+0000 mgr.gibba020.yqfnwy (mgr.34427) 3649 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:01:41.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[29418]: audit 2021-03-10T15:01:40.486207+0000 mon.a (mon.0) 1651 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:41.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[29418]: cephadm 2021-03-10T15:01:40.486239+0000 mgr.gibba020.yqfnwy (mgr.34427) 3650 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:01:41.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[29418]: cephadm 2021-03-10T15:01:40.487403+0000 mgr.gibba020.yqfnwy (mgr.34427) 3651 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:01:41.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[29418]: cephadm 2021-03-10T15:01:40.487463+0000 mgr.gibba020.yqfnwy (mgr.34427) 3652 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:01:41.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[29418]: audit 2021-03-10T15:01:40.487516+0000 mon.a (mon.0) 1652 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:41.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[29418]: cephadm 2021-03-10T15:01:40.488568+0000 mgr.gibba020.yqfnwy (mgr.34427) 3653 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:01:41.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[29418]: audit 2021-03-10T15:01:40.488630+0000 mon.a (mon.0) 1653 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:41.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[29418]: cephadm 2021-03-10T15:01:40.489913+0000 mgr.gibba020.yqfnwy (mgr.34427) 3654 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:01:41.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[29418]: cephadm 2021-03-10T15:01:40.489972+0000 mgr.gibba020.yqfnwy (mgr.34427) 3655 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:01:41.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[29418]: audit 2021-03-10T15:01:40.491587+0000 mon.a (mon.0) 1654 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:41.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[29418]: cephadm 2021-03-10T15:01:40.491732+0000 mgr.gibba020.yqfnwy (mgr.34427) 3656 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:01:41.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[29418]: cephadm 2021-03-10T15:01:40.492383+0000 mgr.gibba020.yqfnwy (mgr.34427) 3657 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:01:41.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[29418]: audit 2021-03-10T15:01:40.493819+0000 mon.a (mon.0) 1655 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:41.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[29418]: cephadm 2021-03-10T15:01:40.494755+0000 mgr.gibba020.yqfnwy (mgr.34427) 3658 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:01:41.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[29418]: cephadm 2021-03-10T15:01:40.494821+0000 mgr.gibba020.yqfnwy (mgr.34427) 3659 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:01:41.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[29418]: cephadm 2021-03-10T15:01:40.494999+0000 mgr.gibba020.yqfnwy (mgr.34427) 3660 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:01:41.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[30381]: cephadm 2021-03-10T15:01:40.229192+0000 mgr.gibba020.yqfnwy (mgr.34427) 3645 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:01:41.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[30381]: cephadm 2021-03-10T15:01:40.231035+0000 mgr.gibba020.yqfnwy (mgr.34427) 3646 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:01:41.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[30381]: audit 2021-03-10T15:01:40.480649+0000 mon.a (mon.0) 1649 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:01:41.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[30381]: cephadm 2021-03-10T15:01:40.482960+0000 mgr.gibba020.yqfnwy (mgr.34427) 3647 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:01:41.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[30381]: audit 2021-03-10T15:01:40.484715+0000 mon.a (mon.0) 1650 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:01:41.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[30381]: cephadm 2021-03-10T15:01:40.484945+0000 mgr.gibba020.yqfnwy (mgr.34427) 3648 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:01:41.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[30381]: cephadm 2021-03-10T15:01:40.486178+0000 mgr.gibba020.yqfnwy (mgr.34427) 3649 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:01:41.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[30381]: audit 2021-03-10T15:01:40.486207+0000 mon.a (mon.0) 1651 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:41.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[30381]: cephadm 2021-03-10T15:01:40.486239+0000 mgr.gibba020.yqfnwy (mgr.34427) 3650 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:01:41.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[30381]: cephadm 2021-03-10T15:01:40.487403+0000 mgr.gibba020.yqfnwy (mgr.34427) 3651 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:01:41.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[30381]: cephadm 2021-03-10T15:01:40.487463+0000 mgr.gibba020.yqfnwy (mgr.34427) 3652 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:01:41.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[30381]: audit 2021-03-10T15:01:40.487516+0000 mon.a (mon.0) 1652 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:41.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[30381]: cephadm 2021-03-10T15:01:40.488568+0000 mgr.gibba020.yqfnwy (mgr.34427) 3653 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:01:41.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[30381]: audit 2021-03-10T15:01:40.488630+0000 mon.a (mon.0) 1653 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:41.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[30381]: cephadm 2021-03-10T15:01:40.489913+0000 mgr.gibba020.yqfnwy (mgr.34427) 3654 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:01:41.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[30381]: cephadm 2021-03-10T15:01:40.489972+0000 mgr.gibba020.yqfnwy (mgr.34427) 3655 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:01:41.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[30381]: audit 2021-03-10T15:01:40.491587+0000 mon.a (mon.0) 1654 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:41.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[30381]: cephadm 2021-03-10T15:01:40.491732+0000 mgr.gibba020.yqfnwy (mgr.34427) 3656 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:01:41.893 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[30381]: cephadm 2021-03-10T15:01:40.492383+0000 mgr.gibba020.yqfnwy (mgr.34427) 3657 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:01:41.893 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[30381]: audit 2021-03-10T15:01:40.493819+0000 mon.a (mon.0) 1655 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:41.893 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[30381]: cephadm 2021-03-10T15:01:40.494755+0000 mgr.gibba020.yqfnwy (mgr.34427) 3658 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:01:41.893 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[30381]: cephadm 2021-03-10T15:01:40.494821+0000 mgr.gibba020.yqfnwy (mgr.34427) 3659 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:01:41.893 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:41 gibba013 bash[30381]: cephadm 2021-03-10T15:01:40.494999+0000 mgr.gibba020.yqfnwy (mgr.34427) 3660 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:01:41.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:41 gibba020 bash[25448]: cephadm 2021-03-10T15:01:40.229192+0000 mgr.gibba020.yqfnwy (mgr.34427) 3645 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:01:41.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:41 gibba020 bash[25448]: cephadm 2021-03-10T15:01:40.231035+0000 mgr.gibba020.yqfnwy (mgr.34427) 3646 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:01:41.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:41 gibba020 bash[25448]: audit 2021-03-10T15:01:40.480649+0000 mon.a (mon.0) 1649 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:01:41.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:41 gibba020 bash[25448]: cephadm 2021-03-10T15:01:40.482960+0000 mgr.gibba020.yqfnwy (mgr.34427) 3647 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:01:41.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:41 gibba020 bash[25448]: audit 2021-03-10T15:01:40.484715+0000 mon.a (mon.0) 1650 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:01:41.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:41 gibba020 bash[25448]: cephadm 2021-03-10T15:01:40.484945+0000 mgr.gibba020.yqfnwy (mgr.34427) 3648 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:01:41.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:41 gibba020 bash[25448]: cephadm 2021-03-10T15:01:40.486178+0000 mgr.gibba020.yqfnwy (mgr.34427) 3649 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:01:41.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:41 gibba020 bash[25448]: audit 2021-03-10T15:01:40.486207+0000 mon.a (mon.0) 1651 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:41.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:41 gibba020 bash[25448]: cephadm 2021-03-10T15:01:40.486239+0000 mgr.gibba020.yqfnwy (mgr.34427) 3650 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:01:41.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:41 gibba020 bash[25448]: cephadm 2021-03-10T15:01:40.487403+0000 mgr.gibba020.yqfnwy (mgr.34427) 3651 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:01:41.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:41 gibba020 bash[25448]: cephadm 2021-03-10T15:01:40.487463+0000 mgr.gibba020.yqfnwy (mgr.34427) 3652 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:01:41.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:41 gibba020 bash[25448]: audit 2021-03-10T15:01:40.487516+0000 mon.a (mon.0) 1652 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:41.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:41 gibba020 bash[25448]: cephadm 2021-03-10T15:01:40.488568+0000 mgr.gibba020.yqfnwy (mgr.34427) 3653 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:01:41.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:41 gibba020 bash[25448]: audit 2021-03-10T15:01:40.488630+0000 mon.a (mon.0) 1653 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:41.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:41 gibba020 bash[25448]: cephadm 2021-03-10T15:01:40.489913+0000 mgr.gibba020.yqfnwy (mgr.34427) 3654 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:01:41.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:41 gibba020 bash[25448]: cephadm 2021-03-10T15:01:40.489972+0000 mgr.gibba020.yqfnwy (mgr.34427) 3655 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:01:41.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:41 gibba020 bash[25448]: audit 2021-03-10T15:01:40.491587+0000 mon.a (mon.0) 1654 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:41.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:41 gibba020 bash[25448]: cephadm 2021-03-10T15:01:40.491732+0000 mgr.gibba020.yqfnwy (mgr.34427) 3656 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:01:41.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:41 gibba020 bash[25448]: cephadm 2021-03-10T15:01:40.492383+0000 mgr.gibba020.yqfnwy (mgr.34427) 3657 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:01:41.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:41 gibba020 bash[25448]: audit 2021-03-10T15:01:40.493819+0000 mon.a (mon.0) 1655 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:41.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:41 gibba020 bash[25448]: cephadm 2021-03-10T15:01:40.494755+0000 mgr.gibba020.yqfnwy (mgr.34427) 3658 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:01:41.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:41 gibba020 bash[25448]: cephadm 2021-03-10T15:01:40.494821+0000 mgr.gibba020.yqfnwy (mgr.34427) 3659 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:01:41.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:41 gibba020 bash[25448]: cephadm 2021-03-10T15:01:40.494999+0000 mgr.gibba020.yqfnwy (mgr.34427) 3660 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:01:42.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:42 gibba013 bash[29418]: cluster 2021-03-10T15:01:41.335338+0000 mgr.gibba020.yqfnwy (mgr.34427) 3661 : cluster [DBG] pgmap v2071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:42.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:42 gibba013 bash[30381]: cluster 2021-03-10T15:01:41.335338+0000 mgr.gibba020.yqfnwy (mgr.34427) 3661 : cluster [DBG] pgmap v2071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:42.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:42 gibba020 bash[25448]: cluster 2021-03-10T15:01:41.335338+0000 mgr.gibba020.yqfnwy (mgr.34427) 3661 : cluster [DBG] pgmap v2071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:44.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:44 gibba013 bash[29418]: cluster 2021-03-10T15:01:43.336779+0000 mgr.gibba020.yqfnwy (mgr.34427) 3662 : cluster [DBG] pgmap v2072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:44.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:44 gibba013 bash[30381]: cluster 2021-03-10T15:01:43.336779+0000 mgr.gibba020.yqfnwy (mgr.34427) 3662 : cluster [DBG] pgmap v2072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:44.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:44 gibba020 bash[25448]: cluster 2021-03-10T15:01:43.336779+0000 mgr.gibba020.yqfnwy (mgr.34427) 3662 : cluster [DBG] pgmap v2072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:46.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:46 gibba013 bash[29418]: cluster 2021-03-10T15:01:45.338350+0000 mgr.gibba020.yqfnwy (mgr.34427) 3663 : cluster [DBG] pgmap v2073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:46.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:46 gibba013 bash[30381]: cluster 2021-03-10T15:01:45.338350+0000 mgr.gibba020.yqfnwy (mgr.34427) 3663 : cluster [DBG] pgmap v2073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:46.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:46 gibba020 bash[25448]: cluster 2021-03-10T15:01:45.338350+0000 mgr.gibba020.yqfnwy (mgr.34427) 3663 : cluster [DBG] pgmap v2073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:47.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:47 gibba020 bash[25448]: cluster 2021-03-10T15:01:47.339788+0000 mgr.gibba020.yqfnwy (mgr.34427) 3664 : cluster [DBG] pgmap v2074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:48.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:47 gibba013 bash[29418]: cluster 2021-03-10T15:01:47.339788+0000 mgr.gibba020.yqfnwy (mgr.34427) 3664 : cluster [DBG] pgmap v2074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:48.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:47 gibba013 bash[30381]: cluster 2021-03-10T15:01:47.339788+0000 mgr.gibba020.yqfnwy (mgr.34427) 3664 : cluster [DBG] pgmap v2074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:50.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:50 gibba020 bash[25448]: cluster 2021-03-10T15:01:49.341397+0000 mgr.gibba020.yqfnwy (mgr.34427) 3665 : cluster [DBG] pgmap v2075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:50.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:50 gibba013 bash[29418]: cluster 2021-03-10T15:01:49.341397+0000 mgr.gibba020.yqfnwy (mgr.34427) 3665 : cluster [DBG] pgmap v2075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:50.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:50 gibba013 bash[30381]: cluster 2021-03-10T15:01:49.341397+0000 mgr.gibba020.yqfnwy (mgr.34427) 3665 : cluster [DBG] pgmap v2075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:52.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:52 gibba020 bash[25448]: cluster 2021-03-10T15:01:51.342931+0000 mgr.gibba020.yqfnwy (mgr.34427) 3666 : cluster [DBG] pgmap v2076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:52.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:52 gibba013 bash[29418]: cluster 2021-03-10T15:01:51.342931+0000 mgr.gibba020.yqfnwy (mgr.34427) 3666 : cluster [DBG] pgmap v2076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:52.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:52 gibba013 bash[30381]: cluster 2021-03-10T15:01:51.342931+0000 mgr.gibba020.yqfnwy (mgr.34427) 3666 : cluster [DBG] pgmap v2076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:54.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:54 gibba020 bash[25448]: cluster 2021-03-10T15:01:53.344309+0000 mgr.gibba020.yqfnwy (mgr.34427) 3667 : cluster [DBG] pgmap v2077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:54.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:54 gibba013 bash[29418]: cluster 2021-03-10T15:01:53.344309+0000 mgr.gibba020.yqfnwy (mgr.34427) 3667 : cluster [DBG] pgmap v2077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:54.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:54 gibba013 bash[30381]: cluster 2021-03-10T15:01:53.344309+0000 mgr.gibba020.yqfnwy (mgr.34427) 3667 : cluster [DBG] pgmap v2077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:56.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:56 gibba020 bash[25448]: cluster 2021-03-10T15:01:55.346079+0000 mgr.gibba020.yqfnwy (mgr.34427) 3668 : cluster [DBG] pgmap v2078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:56.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:56 gibba020 bash[25448]: cephadm 2021-03-10T15:01:55.510802+0000 mgr.gibba020.yqfnwy (mgr.34427) 3669 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:01:56.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:56 gibba013 bash[29418]: cluster 2021-03-10T15:01:55.346079+0000 mgr.gibba020.yqfnwy (mgr.34427) 3668 : cluster [DBG] pgmap v2078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:56.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:56 gibba013 bash[29418]: cephadm 2021-03-10T15:01:55.510802+0000 mgr.gibba020.yqfnwy (mgr.34427) 3669 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:01:56.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:56 gibba013 bash[30381]: cluster 2021-03-10T15:01:55.346079+0000 mgr.gibba020.yqfnwy (mgr.34427) 3668 : cluster [DBG] pgmap v2078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:56.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:56 gibba013 bash[30381]: cephadm 2021-03-10T15:01:55.510802+0000 mgr.gibba020.yqfnwy (mgr.34427) 3669 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:01:57.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:57 gibba020 bash[25448]: cluster 2021-03-10T15:01:57.347676+0000 mgr.gibba020.yqfnwy (mgr.34427) 3670 : cluster [DBG] pgmap v2079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:58.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:57 gibba013 bash[29418]: cluster 2021-03-10T15:01:57.347676+0000 mgr.gibba020.yqfnwy (mgr.34427) 3670 : cluster [DBG] pgmap v2079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:58.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:57 gibba013 bash[30381]: cluster 2021-03-10T15:01:57.347676+0000 mgr.gibba020.yqfnwy (mgr.34427) 3670 : cluster [DBG] pgmap v2079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:01:58.384 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:01:58.637 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:01:58.637 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (68m) 3m ago 73m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:01:58.637 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (73m) 2m ago 73m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:01:58.638 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (68m) 2m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:01:58.638 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (69m) 2m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:01:58.638 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (68m) 3m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:01:58.638 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (67m) 3m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:01:58.639 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (67m) 2m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:01:58.639 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (67m) 3m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:01:58.639 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (74m) 3m ago 74m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:01:58.639 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (74m) 2m ago 74m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:01:58.640 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (66m) 3m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:01:58.640 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (66m) 3m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:01:58.640 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (65m) 3m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:01:58.640 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (65m) 3m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:01:58.641 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (65m) 2m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:01:58.641 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (64m) 2m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:01:58.641 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (64m) 2m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:01:58.641 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (63m) 2m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:01:58.641 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (73m) 2m ago 74m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:01:58.642 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 71m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:01:58.893 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:01:58.894 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:01:58.894 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:01:58.894 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:01:58.895 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:01:58.895 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:01:58.895 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:01:58.895 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:01:58.896 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:01:58.896 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:01:58.896 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:01:58.896 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:01:58.896 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:01:58.897 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:01:58.897 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:01:58.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:58 gibba020 bash[25448]: audit 2021-03-10T15:01:58.372121+0000 mgr.gibba020.yqfnwy (mgr.34427) 3671 : audit [DBG] from='client.46518 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:01:58.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:58 gibba020 bash[25448]: audit 2021-03-10T15:01:58.593070+0000 mgr.gibba020.yqfnwy (mgr.34427) 3672 : audit [DBG] from='client.56509 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:01:59.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:58 gibba013 bash[29418]: audit 2021-03-10T15:01:58.372121+0000 mgr.gibba020.yqfnwy (mgr.34427) 3671 : audit [DBG] from='client.46518 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:01:59.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:58 gibba013 bash[29418]: audit 2021-03-10T15:01:58.593070+0000 mgr.gibba020.yqfnwy (mgr.34427) 3672 : audit [DBG] from='client.56509 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:01:59.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:58 gibba013 bash[30381]: audit 2021-03-10T15:01:58.372121+0000 mgr.gibba020.yqfnwy (mgr.34427) 3671 : audit [DBG] from='client.46518 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:01:59.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:58 gibba013 bash[30381]: audit 2021-03-10T15:01:58.593070+0000 mgr.gibba020.yqfnwy (mgr.34427) 3672 : audit [DBG] from='client.56509 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:01:59.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:59 gibba020 bash[25448]: audit 2021-03-10T15:01:58.890819+0000 mon.a (mon.0) 1656 : audit [DBG] from='client.? 172.21.2.113:0/1709899765' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:01:59.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:01:59 gibba020 bash[25448]: cluster 2021-03-10T15:01:59.349223+0000 mgr.gibba020.yqfnwy (mgr.34427) 3673 : cluster [DBG] pgmap v2080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:00.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:59 gibba013 bash[29418]: audit 2021-03-10T15:01:58.890819+0000 mon.a (mon.0) 1656 : audit [DBG] from='client.? 172.21.2.113:0/1709899765' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:00.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:01:59 gibba013 bash[29418]: cluster 2021-03-10T15:01:59.349223+0000 mgr.gibba020.yqfnwy (mgr.34427) 3673 : cluster [DBG] pgmap v2080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:00.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:59 gibba013 bash[30381]: audit 2021-03-10T15:01:58.890819+0000 mon.a (mon.0) 1656 : audit [DBG] from='client.? 172.21.2.113:0/1709899765' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:00.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:01:59 gibba013 bash[30381]: cluster 2021-03-10T15:01:59.349223+0000 mgr.gibba020.yqfnwy (mgr.34427) 3673 : cluster [DBG] pgmap v2080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:02.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:02 gibba020 bash[25448]: cluster 2021-03-10T15:02:01.351057+0000 mgr.gibba020.yqfnwy (mgr.34427) 3674 : cluster [DBG] pgmap v2081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:02.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:02 gibba013 bash[29418]: cluster 2021-03-10T15:02:01.351057+0000 mgr.gibba020.yqfnwy (mgr.34427) 3674 : cluster [DBG] pgmap v2081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:02.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:02 gibba013 bash[30381]: cluster 2021-03-10T15:02:01.351057+0000 mgr.gibba020.yqfnwy (mgr.34427) 3674 : cluster [DBG] pgmap v2081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:04.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:04 gibba020 bash[25448]: cluster 2021-03-10T15:02:03.352501+0000 mgr.gibba020.yqfnwy (mgr.34427) 3675 : cluster [DBG] pgmap v2082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:04.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:04 gibba013 bash[30381]: cluster 2021-03-10T15:02:03.352501+0000 mgr.gibba020.yqfnwy (mgr.34427) 3675 : cluster [DBG] pgmap v2082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:04.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:04 gibba013 bash[29418]: cluster 2021-03-10T15:02:03.352501+0000 mgr.gibba020.yqfnwy (mgr.34427) 3675 : cluster [DBG] pgmap v2082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:06 gibba020 bash[25448]: cluster 2021-03-10T15:02:05.354260+0000 mgr.gibba020.yqfnwy (mgr.34427) 3676 : cluster [DBG] pgmap v2083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:06 gibba020 bash[25448]: audit 2021-03-10T15:02:06.320087+0000 mon.a (mon.0) 1657 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:02:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:06 gibba020 bash[25448]: audit 2021-03-10T15:02:06.343893+0000 mon.a (mon.0) 1658 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:02:06.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:06 gibba020 bash[25448]: audit 2021-03-10T15:02:06.391319+0000 mon.a (mon.0) 1659 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T15:02:06.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:06 gibba020 bash[25448]: audit 2021-03-10T15:02:06.392059+0000 mon.a (mon.0) 1660 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:02:06.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:06 gibba020 bash[25448]: audit 2021-03-10T15:02:06.392760+0000 mon.a (mon.0) 1661 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:02:06.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:06 gibba020 bash[25448]: audit 2021-03-10T15:02:06.393408+0000 mon.a (mon.0) 1662 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:02:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:06 gibba013 bash[29418]: cluster 2021-03-10T15:02:05.354260+0000 mgr.gibba020.yqfnwy (mgr.34427) 3676 : cluster [DBG] pgmap v2083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:06 gibba013 bash[29418]: audit 2021-03-10T15:02:06.320087+0000 mon.a (mon.0) 1657 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:02:06.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:06 gibba013 bash[29418]: audit 2021-03-10T15:02:06.343893+0000 mon.a (mon.0) 1658 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:02:06.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:06 gibba013 bash[29418]: audit 2021-03-10T15:02:06.391319+0000 mon.a (mon.0) 1659 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T15:02:06.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:06 gibba013 bash[29418]: audit 2021-03-10T15:02:06.392059+0000 mon.a (mon.0) 1660 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:02:06.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:06 gibba013 bash[29418]: audit 2021-03-10T15:02:06.392760+0000 mon.a (mon.0) 1661 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:02:06.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:06 gibba013 bash[29418]: audit 2021-03-10T15:02:06.393408+0000 mon.a (mon.0) 1662 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:02:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:06 gibba013 bash[30381]: cluster 2021-03-10T15:02:05.354260+0000 mgr.gibba020.yqfnwy (mgr.34427) 3676 : cluster [DBG] pgmap v2083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:06 gibba013 bash[30381]: audit 2021-03-10T15:02:06.320087+0000 mon.a (mon.0) 1657 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:02:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:06 gibba013 bash[30381]: audit 2021-03-10T15:02:06.343893+0000 mon.a (mon.0) 1658 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:02:06.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:06 gibba013 bash[30381]: audit 2021-03-10T15:02:06.391319+0000 mon.a (mon.0) 1659 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T15:02:06.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:06 gibba013 bash[30381]: audit 2021-03-10T15:02:06.392059+0000 mon.a (mon.0) 1660 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:02:06.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:06 gibba013 bash[30381]: audit 2021-03-10T15:02:06.392760+0000 mon.a (mon.0) 1661 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:02:06.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:06 gibba013 bash[30381]: audit 2021-03-10T15:02:06.393408+0000 mon.a (mon.0) 1662 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:02:07.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:07 gibba020 bash[25448]: cluster 2021-03-10T15:02:07.355867+0000 mgr.gibba020.yqfnwy (mgr.34427) 3677 : cluster [DBG] pgmap v2084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:08.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:07 gibba013 bash[29418]: cluster 2021-03-10T15:02:07.355867+0000 mgr.gibba020.yqfnwy (mgr.34427) 3677 : cluster [DBG] pgmap v2084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:08.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:07 gibba013 bash[30381]: cluster 2021-03-10T15:02:07.355867+0000 mgr.gibba020.yqfnwy (mgr.34427) 3677 : cluster [DBG] pgmap v2084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:10.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:10 gibba020 bash[25448]: cluster 2021-03-10T15:02:09.357460+0000 mgr.gibba020.yqfnwy (mgr.34427) 3678 : cluster [DBG] pgmap v2085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:10.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:10 gibba013 bash[29418]: cluster 2021-03-10T15:02:09.357460+0000 mgr.gibba020.yqfnwy (mgr.34427) 3678 : cluster [DBG] pgmap v2085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:10.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:10 gibba013 bash[30381]: cluster 2021-03-10T15:02:09.357460+0000 mgr.gibba020.yqfnwy (mgr.34427) 3678 : cluster [DBG] pgmap v2085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:11.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:11 gibba020 bash[25448]: cephadm 2021-03-10T15:02:10.526678+0000 mgr.gibba020.yqfnwy (mgr.34427) 3679 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:02:11.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:11 gibba013 bash[29418]: cephadm 2021-03-10T15:02:10.526678+0000 mgr.gibba020.yqfnwy (mgr.34427) 3679 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:02:11.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:11 gibba013 bash[30381]: cephadm 2021-03-10T15:02:10.526678+0000 mgr.gibba020.yqfnwy (mgr.34427) 3679 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:02:12.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:12 gibba020 bash[25448]: cluster 2021-03-10T15:02:11.359325+0000 mgr.gibba020.yqfnwy (mgr.34427) 3680 : cluster [DBG] pgmap v2086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:12.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:12 gibba013 bash[29418]: cluster 2021-03-10T15:02:11.359325+0000 mgr.gibba020.yqfnwy (mgr.34427) 3680 : cluster [DBG] pgmap v2086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:12.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:12 gibba013 bash[30381]: cluster 2021-03-10T15:02:11.359325+0000 mgr.gibba020.yqfnwy (mgr.34427) 3680 : cluster [DBG] pgmap v2086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:14.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:14 gibba020 bash[25448]: cluster 2021-03-10T15:02:13.360773+0000 mgr.gibba020.yqfnwy (mgr.34427) 3681 : cluster [DBG] pgmap v2087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:14.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:14 gibba013 bash[29418]: cluster 2021-03-10T15:02:13.360773+0000 mgr.gibba020.yqfnwy (mgr.34427) 3681 : cluster [DBG] pgmap v2087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:14.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:14 gibba013 bash[30381]: cluster 2021-03-10T15:02:13.360773+0000 mgr.gibba020.yqfnwy (mgr.34427) 3681 : cluster [DBG] pgmap v2087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:16.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:16 gibba013 bash[29418]: cluster 2021-03-10T15:02:15.362424+0000 mgr.gibba020.yqfnwy (mgr.34427) 3682 : cluster [DBG] pgmap v2088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:16.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:16 gibba013 bash[30381]: cluster 2021-03-10T15:02:15.362424+0000 mgr.gibba020.yqfnwy (mgr.34427) 3682 : cluster [DBG] pgmap v2088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:16.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:16 gibba020 bash[25448]: cluster 2021-03-10T15:02:15.362424+0000 mgr.gibba020.yqfnwy (mgr.34427) 3682 : cluster [DBG] pgmap v2088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:17.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:17 gibba020 bash[25448]: cluster 2021-03-10T15:02:17.364004+0000 mgr.gibba020.yqfnwy (mgr.34427) 3683 : cluster [DBG] pgmap v2089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:18.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:17 gibba013 bash[29418]: cluster 2021-03-10T15:02:17.364004+0000 mgr.gibba020.yqfnwy (mgr.34427) 3683 : cluster [DBG] pgmap v2089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:18.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:17 gibba013 bash[30381]: cluster 2021-03-10T15:02:17.364004+0000 mgr.gibba020.yqfnwy (mgr.34427) 3683 : cluster [DBG] pgmap v2089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:20.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:20 gibba020 bash[25448]: cluster 2021-03-10T15:02:19.365524+0000 mgr.gibba020.yqfnwy (mgr.34427) 3684 : cluster [DBG] pgmap v2090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:20.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:20 gibba013 bash[29418]: cluster 2021-03-10T15:02:19.365524+0000 mgr.gibba020.yqfnwy (mgr.34427) 3684 : cluster [DBG] pgmap v2090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:20.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:20 gibba013 bash[30381]: cluster 2021-03-10T15:02:19.365524+0000 mgr.gibba020.yqfnwy (mgr.34427) 3684 : cluster [DBG] pgmap v2090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:22.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:22 gibba020 bash[25448]: cluster 2021-03-10T15:02:21.367423+0000 mgr.gibba020.yqfnwy (mgr.34427) 3685 : cluster [DBG] pgmap v2091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:22.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:22 gibba013 bash[29418]: cluster 2021-03-10T15:02:21.367423+0000 mgr.gibba020.yqfnwy (mgr.34427) 3685 : cluster [DBG] pgmap v2091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:22.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:22 gibba013 bash[30381]: cluster 2021-03-10T15:02:21.367423+0000 mgr.gibba020.yqfnwy (mgr.34427) 3685 : cluster [DBG] pgmap v2091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:24.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:24 gibba013 bash[29418]: cluster 2021-03-10T15:02:23.368814+0000 mgr.gibba020.yqfnwy (mgr.34427) 3686 : cluster [DBG] pgmap v2092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:24.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:24 gibba013 bash[30381]: cluster 2021-03-10T15:02:23.368814+0000 mgr.gibba020.yqfnwy (mgr.34427) 3686 : cluster [DBG] pgmap v2092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:24.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:24 gibba020 bash[25448]: cluster 2021-03-10T15:02:23.368814+0000 mgr.gibba020.yqfnwy (mgr.34427) 3686 : cluster [DBG] pgmap v2092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:26.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:26 gibba013 bash[29418]: cluster 2021-03-10T15:02:25.370556+0000 mgr.gibba020.yqfnwy (mgr.34427) 3687 : cluster [DBG] pgmap v2093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:26.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:26 gibba013 bash[29418]: cephadm 2021-03-10T15:02:25.542455+0000 mgr.gibba020.yqfnwy (mgr.34427) 3688 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:02:26.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:26 gibba013 bash[30381]: cluster 2021-03-10T15:02:25.370556+0000 mgr.gibba020.yqfnwy (mgr.34427) 3687 : cluster [DBG] pgmap v2093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:26.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:26 gibba013 bash[30381]: cephadm 2021-03-10T15:02:25.542455+0000 mgr.gibba020.yqfnwy (mgr.34427) 3688 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:02:26.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:26 gibba020 bash[25448]: cluster 2021-03-10T15:02:25.370556+0000 mgr.gibba020.yqfnwy (mgr.34427) 3687 : cluster [DBG] pgmap v2093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:26.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:26 gibba020 bash[25448]: cephadm 2021-03-10T15:02:25.542455+0000 mgr.gibba020.yqfnwy (mgr.34427) 3688 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:02:27.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:27 gibba020 bash[25448]: cluster 2021-03-10T15:02:27.372101+0000 mgr.gibba020.yqfnwy (mgr.34427) 3689 : cluster [DBG] pgmap v2094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:28.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:27 gibba013 bash[29418]: cluster 2021-03-10T15:02:27.372101+0000 mgr.gibba020.yqfnwy (mgr.34427) 3689 : cluster [DBG] pgmap v2094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:28.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:27 gibba013 bash[30381]: cluster 2021-03-10T15:02:27.372101+0000 mgr.gibba020.yqfnwy (mgr.34427) 3689 : cluster [DBG] pgmap v2094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:29.137 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:02:29.366 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:02:29.366 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (68m) 3m ago 74m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:02:29.366 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (74m) 2m ago 74m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:02:29.367 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (69m) 2m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:02:29.367 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (69m) 2m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:02:29.367 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (68m) 3m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:02:29.367 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (68m) 3m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:02:29.368 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (68m) 2m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:02:29.368 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (68m) 3m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:02:29.368 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (74m) 3m ago 74m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:02:29.368 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (74m) 2m ago 74m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:02:29.369 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (67m) 3m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:02:29.369 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (66m) 3m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:02:29.369 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (66m) 3m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:02:29.369 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (65m) 3m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:02:29.369 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (65m) 2m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:02:29.370 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (65m) 2m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:02:29.370 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (64m) 2m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:02:29.370 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (64m) 2m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:02:29.370 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (73m) 2m ago 74m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:02:29.371 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 72m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:02:29.616 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:02:29.616 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:02:29.617 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:02:29.617 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:02:29.617 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:02:29.617 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:02:29.618 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:02:29.618 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:02:29.618 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:02:29.618 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:02:29.619 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:02:29.619 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:02:29.619 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:02:29.619 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:02:29.620 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:02:30.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:30 gibba020 bash[25448]: audit 2021-03-10T15:02:29.123736+0000 mgr.gibba020.yqfnwy (mgr.34427) 3690 : audit [DBG] from='client.46536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:02:30.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:30 gibba020 bash[25448]: audit 2021-03-10T15:02:29.349329+0000 mgr.gibba020.yqfnwy (mgr.34427) 3691 : audit [DBG] from='client.56527 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:02:30.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:30 gibba020 bash[25448]: cluster 2021-03-10T15:02:29.372690+0000 mgr.gibba020.yqfnwy (mgr.34427) 3692 : cluster [DBG] pgmap v2095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:30.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:30 gibba020 bash[25448]: audit 2021-03-10T15:02:29.613589+0000 mon.c (mon.1) 68 : audit [DBG] from='client.? 172.21.2.113:0/1261508941' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:30.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:30 gibba013 bash[29418]: audit 2021-03-10T15:02:29.123736+0000 mgr.gibba020.yqfnwy (mgr.34427) 3690 : audit [DBG] from='client.46536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:02:30.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:30 gibba013 bash[29418]: audit 2021-03-10T15:02:29.349329+0000 mgr.gibba020.yqfnwy (mgr.34427) 3691 : audit [DBG] from='client.56527 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:02:30.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:30 gibba013 bash[29418]: cluster 2021-03-10T15:02:29.372690+0000 mgr.gibba020.yqfnwy (mgr.34427) 3692 : cluster [DBG] pgmap v2095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:30.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:30 gibba013 bash[29418]: audit 2021-03-10T15:02:29.613589+0000 mon.c (mon.1) 68 : audit [DBG] from='client.? 172.21.2.113:0/1261508941' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:30.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:30 gibba013 bash[30381]: audit 2021-03-10T15:02:29.123736+0000 mgr.gibba020.yqfnwy (mgr.34427) 3690 : audit [DBG] from='client.46536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:02:30.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:30 gibba013 bash[30381]: audit 2021-03-10T15:02:29.349329+0000 mgr.gibba020.yqfnwy (mgr.34427) 3691 : audit [DBG] from='client.56527 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:02:30.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:30 gibba013 bash[30381]: cluster 2021-03-10T15:02:29.372690+0000 mgr.gibba020.yqfnwy (mgr.34427) 3692 : cluster [DBG] pgmap v2095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:30.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:30 gibba013 bash[30381]: audit 2021-03-10T15:02:29.613589+0000 mon.c (mon.1) 68 : audit [DBG] from='client.? 172.21.2.113:0/1261508941' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:32.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:32 gibba020 bash[25448]: cluster 2021-03-10T15:02:31.374360+0000 mgr.gibba020.yqfnwy (mgr.34427) 3693 : cluster [DBG] pgmap v2096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:32.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:32 gibba013 bash[29418]: cluster 2021-03-10T15:02:31.374360+0000 mgr.gibba020.yqfnwy (mgr.34427) 3693 : cluster [DBG] pgmap v2096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:32.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:32 gibba013 bash[30381]: cluster 2021-03-10T15:02:31.374360+0000 mgr.gibba020.yqfnwy (mgr.34427) 3693 : cluster [DBG] pgmap v2096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:34.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:34 gibba013 bash[29418]: cluster 2021-03-10T15:02:33.375757+0000 mgr.gibba020.yqfnwy (mgr.34427) 3694 : cluster [DBG] pgmap v2097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:34.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:34 gibba013 bash[30381]: cluster 2021-03-10T15:02:33.375757+0000 mgr.gibba020.yqfnwy (mgr.34427) 3694 : cluster [DBG] pgmap v2097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:34.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:34 gibba020 bash[25448]: cluster 2021-03-10T15:02:33.375757+0000 mgr.gibba020.yqfnwy (mgr.34427) 3694 : cluster [DBG] pgmap v2097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:36.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:36 gibba013 bash[29418]: cluster 2021-03-10T15:02:35.377496+0000 mgr.gibba020.yqfnwy (mgr.34427) 3695 : cluster [DBG] pgmap v2098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:36.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:36 gibba013 bash[30381]: cluster 2021-03-10T15:02:35.377496+0000 mgr.gibba020.yqfnwy (mgr.34427) 3695 : cluster [DBG] pgmap v2098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:36.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:36 gibba020 bash[25448]: cluster 2021-03-10T15:02:35.377496+0000 mgr.gibba020.yqfnwy (mgr.34427) 3695 : cluster [DBG] pgmap v2098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:37.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:37 gibba020 bash[25448]: cluster 2021-03-10T15:02:37.378800+0000 mgr.gibba020.yqfnwy (mgr.34427) 3696 : cluster [DBG] pgmap v2099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:38.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:37 gibba013 bash[29418]: cluster 2021-03-10T15:02:37.378800+0000 mgr.gibba020.yqfnwy (mgr.34427) 3696 : cluster [DBG] pgmap v2099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:38.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:37 gibba013 bash[30381]: cluster 2021-03-10T15:02:37.378800+0000 mgr.gibba020.yqfnwy (mgr.34427) 3696 : cluster [DBG] pgmap v2099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:40.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:40 gibba020 bash[25448]: cluster 2021-03-10T15:02:39.380382+0000 mgr.gibba020.yqfnwy (mgr.34427) 3697 : cluster [DBG] pgmap v2100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:40.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:40 gibba013 bash[29418]: cluster 2021-03-10T15:02:39.380382+0000 mgr.gibba020.yqfnwy (mgr.34427) 3697 : cluster [DBG] pgmap v2100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:40.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:40 gibba013 bash[30381]: cluster 2021-03-10T15:02:39.380382+0000 mgr.gibba020.yqfnwy (mgr.34427) 3697 : cluster [DBG] pgmap v2100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:41.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:41 gibba013 bash[29418]: audit 2021-03-10T15:02:40.560403+0000 mon.a (mon.0) 1663 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:02:41.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:41 gibba013 bash[29418]: cephadm 2021-03-10T15:02:40.565524+0000 mgr.gibba020.yqfnwy (mgr.34427) 3698 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:02:41.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:41 gibba013 bash[29418]: cephadm 2021-03-10T15:02:40.567231+0000 mgr.gibba020.yqfnwy (mgr.34427) 3699 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:02:41.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:41 gibba013 bash[29418]: audit 2021-03-10T15:02:40.776227+0000 mon.a (mon.0) 1664 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:02:41.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:41 gibba013 bash[29418]: audit 2021-03-10T15:02:40.779259+0000 mon.a (mon.0) 1665 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:02:41.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:41 gibba013 bash[29418]: audit 2021-03-10T15:02:40.780475+0000 mon.a (mon.0) 1666 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:41.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:41 gibba013 bash[29418]: audit 2021-03-10T15:02:40.781779+0000 mon.a (mon.0) 1667 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:41.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:41 gibba013 bash[29418]: audit 2021-03-10T15:02:40.783327+0000 mon.a (mon.0) 1668 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:41.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:41 gibba013 bash[29418]: audit 2021-03-10T15:02:40.786804+0000 mon.a (mon.0) 1669 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:41.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:41 gibba013 bash[29418]: audit 2021-03-10T15:02:40.788757+0000 mon.a (mon.0) 1670 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:41.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:41 gibba013 bash[30381]: audit 2021-03-10T15:02:40.560403+0000 mon.a (mon.0) 1663 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:02:41.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:41 gibba013 bash[30381]: cephadm 2021-03-10T15:02:40.565524+0000 mgr.gibba020.yqfnwy (mgr.34427) 3698 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:02:41.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:41 gibba013 bash[30381]: cephadm 2021-03-10T15:02:40.567231+0000 mgr.gibba020.yqfnwy (mgr.34427) 3699 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:02:41.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:41 gibba013 bash[30381]: audit 2021-03-10T15:02:40.776227+0000 mon.a (mon.0) 1664 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:02:41.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:41 gibba013 bash[30381]: audit 2021-03-10T15:02:40.779259+0000 mon.a (mon.0) 1665 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:02:41.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:41 gibba013 bash[30381]: audit 2021-03-10T15:02:40.780475+0000 mon.a (mon.0) 1666 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:41.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:41 gibba013 bash[30381]: audit 2021-03-10T15:02:40.781779+0000 mon.a (mon.0) 1667 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:41.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:41 gibba013 bash[30381]: audit 2021-03-10T15:02:40.783327+0000 mon.a (mon.0) 1668 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:41.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:41 gibba013 bash[30381]: audit 2021-03-10T15:02:40.786804+0000 mon.a (mon.0) 1669 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:41.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:41 gibba013 bash[30381]: audit 2021-03-10T15:02:40.788757+0000 mon.a (mon.0) 1670 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:41.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:41 gibba020 bash[25448]: audit 2021-03-10T15:02:40.560403+0000 mon.a (mon.0) 1663 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:02:41.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:41 gibba020 bash[25448]: cephadm 2021-03-10T15:02:40.565524+0000 mgr.gibba020.yqfnwy (mgr.34427) 3698 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:02:41.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:41 gibba020 bash[25448]: cephadm 2021-03-10T15:02:40.567231+0000 mgr.gibba020.yqfnwy (mgr.34427) 3699 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:02:41.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:41 gibba020 bash[25448]: audit 2021-03-10T15:02:40.776227+0000 mon.a (mon.0) 1664 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:02:41.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:41 gibba020 bash[25448]: audit 2021-03-10T15:02:40.779259+0000 mon.a (mon.0) 1665 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:02:41.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:41 gibba020 bash[25448]: audit 2021-03-10T15:02:40.780475+0000 mon.a (mon.0) 1666 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:41.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:41 gibba020 bash[25448]: audit 2021-03-10T15:02:40.781779+0000 mon.a (mon.0) 1667 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:41.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:41 gibba020 bash[25448]: audit 2021-03-10T15:02:40.783327+0000 mon.a (mon.0) 1668 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:41.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:41 gibba020 bash[25448]: audit 2021-03-10T15:02:40.786804+0000 mon.a (mon.0) 1669 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:41.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:41 gibba020 bash[25448]: audit 2021-03-10T15:02:40.788757+0000 mon.a (mon.0) 1670 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:02:42.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:42 gibba013 bash[29418]: cephadm 2021-03-10T15:02:40.777673+0000 mgr.gibba020.yqfnwy (mgr.34427) 3700 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:02:42.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:42 gibba013 bash[29418]: cephadm 2021-03-10T15:02:40.779276+0000 mgr.gibba020.yqfnwy (mgr.34427) 3701 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:02:42.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:42 gibba013 bash[29418]: cephadm 2021-03-10T15:02:40.780549+0000 mgr.gibba020.yqfnwy (mgr.34427) 3702 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:02:42.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:42 gibba013 bash[29418]: cephadm 2021-03-10T15:02:40.780584+0000 mgr.gibba020.yqfnwy (mgr.34427) 3703 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:02:42.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:42 gibba013 bash[29418]: cephadm 2021-03-10T15:02:40.781825+0000 mgr.gibba020.yqfnwy (mgr.34427) 3704 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:02:42.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:42 gibba013 bash[29418]: cephadm 2021-03-10T15:02:40.781861+0000 mgr.gibba020.yqfnwy (mgr.34427) 3705 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:02:42.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:42 gibba013 bash[29418]: cephadm 2021-03-10T15:02:40.783436+0000 mgr.gibba020.yqfnwy (mgr.34427) 3706 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:02:42.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:42 gibba013 bash[29418]: cephadm 2021-03-10T15:02:40.784988+0000 mgr.gibba020.yqfnwy (mgr.34427) 3707 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:02:42.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:42 gibba013 bash[29418]: cephadm 2021-03-10T15:02:40.785112+0000 mgr.gibba020.yqfnwy (mgr.34427) 3708 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:02:42.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:42 gibba013 bash[29418]: cephadm 2021-03-10T15:02:40.786952+0000 mgr.gibba020.yqfnwy (mgr.34427) 3709 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:02:42.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:42 gibba013 bash[29418]: cephadm 2021-03-10T15:02:40.787363+0000 mgr.gibba020.yqfnwy (mgr.34427) 3710 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:02:42.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:42 gibba013 bash[29418]: cephadm 2021-03-10T15:02:40.789283+0000 mgr.gibba020.yqfnwy (mgr.34427) 3711 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:02:42.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:42 gibba013 bash[29418]: cephadm 2021-03-10T15:02:40.789325+0000 mgr.gibba020.yqfnwy (mgr.34427) 3712 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:02:42.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:42 gibba013 bash[29418]: cephadm 2021-03-10T15:02:40.789450+0000 mgr.gibba020.yqfnwy (mgr.34427) 3713 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:02:42.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:42 gibba013 bash[29418]: cluster 2021-03-10T15:02:41.382286+0000 mgr.gibba020.yqfnwy (mgr.34427) 3714 : cluster [DBG] pgmap v2101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:42.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:42 gibba013 bash[30381]: cephadm 2021-03-10T15:02:40.777673+0000 mgr.gibba020.yqfnwy (mgr.34427) 3700 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:02:42.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:42 gibba013 bash[30381]: cephadm 2021-03-10T15:02:40.779276+0000 mgr.gibba020.yqfnwy (mgr.34427) 3701 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:02:42.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:42 gibba013 bash[30381]: cephadm 2021-03-10T15:02:40.780549+0000 mgr.gibba020.yqfnwy (mgr.34427) 3702 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:02:42.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:42 gibba013 bash[30381]: cephadm 2021-03-10T15:02:40.780584+0000 mgr.gibba020.yqfnwy (mgr.34427) 3703 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:02:42.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:42 gibba013 bash[30381]: cephadm 2021-03-10T15:02:40.781825+0000 mgr.gibba020.yqfnwy (mgr.34427) 3704 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:02:42.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:42 gibba013 bash[30381]: cephadm 2021-03-10T15:02:40.781861+0000 mgr.gibba020.yqfnwy (mgr.34427) 3705 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:02:42.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:42 gibba013 bash[30381]: cephadm 2021-03-10T15:02:40.783436+0000 mgr.gibba020.yqfnwy (mgr.34427) 3706 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:02:42.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:42 gibba013 bash[30381]: cephadm 2021-03-10T15:02:40.784988+0000 mgr.gibba020.yqfnwy (mgr.34427) 3707 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:02:42.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:42 gibba013 bash[30381]: cephadm 2021-03-10T15:02:40.785112+0000 mgr.gibba020.yqfnwy (mgr.34427) 3708 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:02:42.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:42 gibba013 bash[30381]: cephadm 2021-03-10T15:02:40.786952+0000 mgr.gibba020.yqfnwy (mgr.34427) 3709 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:02:42.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:42 gibba013 bash[30381]: cephadm 2021-03-10T15:02:40.787363+0000 mgr.gibba020.yqfnwy (mgr.34427) 3710 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:02:42.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:42 gibba013 bash[30381]: cephadm 2021-03-10T15:02:40.789283+0000 mgr.gibba020.yqfnwy (mgr.34427) 3711 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:02:42.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:42 gibba013 bash[30381]: cephadm 2021-03-10T15:02:40.789325+0000 mgr.gibba020.yqfnwy (mgr.34427) 3712 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:02:42.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:42 gibba013 bash[30381]: cephadm 2021-03-10T15:02:40.789450+0000 mgr.gibba020.yqfnwy (mgr.34427) 3713 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:02:42.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:42 gibba013 bash[30381]: cluster 2021-03-10T15:02:41.382286+0000 mgr.gibba020.yqfnwy (mgr.34427) 3714 : cluster [DBG] pgmap v2101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:42.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:42 gibba020 bash[25448]: cephadm 2021-03-10T15:02:40.777673+0000 mgr.gibba020.yqfnwy (mgr.34427) 3700 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:02:42.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:42 gibba020 bash[25448]: cephadm 2021-03-10T15:02:40.779276+0000 mgr.gibba020.yqfnwy (mgr.34427) 3701 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:02:42.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:42 gibba020 bash[25448]: cephadm 2021-03-10T15:02:40.780549+0000 mgr.gibba020.yqfnwy (mgr.34427) 3702 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:02:42.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:42 gibba020 bash[25448]: cephadm 2021-03-10T15:02:40.780584+0000 mgr.gibba020.yqfnwy (mgr.34427) 3703 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:02:42.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:42 gibba020 bash[25448]: cephadm 2021-03-10T15:02:40.781825+0000 mgr.gibba020.yqfnwy (mgr.34427) 3704 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:02:42.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:42 gibba020 bash[25448]: cephadm 2021-03-10T15:02:40.781861+0000 mgr.gibba020.yqfnwy (mgr.34427) 3705 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:02:42.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:42 gibba020 bash[25448]: cephadm 2021-03-10T15:02:40.783436+0000 mgr.gibba020.yqfnwy (mgr.34427) 3706 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:02:42.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:42 gibba020 bash[25448]: cephadm 2021-03-10T15:02:40.784988+0000 mgr.gibba020.yqfnwy (mgr.34427) 3707 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:02:42.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:42 gibba020 bash[25448]: cephadm 2021-03-10T15:02:40.785112+0000 mgr.gibba020.yqfnwy (mgr.34427) 3708 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:02:42.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:42 gibba020 bash[25448]: cephadm 2021-03-10T15:02:40.786952+0000 mgr.gibba020.yqfnwy (mgr.34427) 3709 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:02:42.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:42 gibba020 bash[25448]: cephadm 2021-03-10T15:02:40.787363+0000 mgr.gibba020.yqfnwy (mgr.34427) 3710 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:02:42.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:42 gibba020 bash[25448]: cephadm 2021-03-10T15:02:40.789283+0000 mgr.gibba020.yqfnwy (mgr.34427) 3711 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:02:42.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:42 gibba020 bash[25448]: cephadm 2021-03-10T15:02:40.789325+0000 mgr.gibba020.yqfnwy (mgr.34427) 3712 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:02:42.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:42 gibba020 bash[25448]: cephadm 2021-03-10T15:02:40.789450+0000 mgr.gibba020.yqfnwy (mgr.34427) 3713 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:02:42.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:42 gibba020 bash[25448]: cluster 2021-03-10T15:02:41.382286+0000 mgr.gibba020.yqfnwy (mgr.34427) 3714 : cluster [DBG] pgmap v2101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:44.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:44 gibba013 bash[29418]: cluster 2021-03-10T15:02:43.383679+0000 mgr.gibba020.yqfnwy (mgr.34427) 3715 : cluster [DBG] pgmap v2102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:44.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:44 gibba013 bash[30381]: cluster 2021-03-10T15:02:43.383679+0000 mgr.gibba020.yqfnwy (mgr.34427) 3715 : cluster [DBG] pgmap v2102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:44.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:44 gibba020 bash[25448]: cluster 2021-03-10T15:02:43.383679+0000 mgr.gibba020.yqfnwy (mgr.34427) 3715 : cluster [DBG] pgmap v2102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:46.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:46 gibba013 bash[29418]: cluster 2021-03-10T15:02:45.385358+0000 mgr.gibba020.yqfnwy (mgr.34427) 3716 : cluster [DBG] pgmap v2103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:46.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:46 gibba013 bash[30381]: cluster 2021-03-10T15:02:45.385358+0000 mgr.gibba020.yqfnwy (mgr.34427) 3716 : cluster [DBG] pgmap v2103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:46.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:46 gibba020 bash[25448]: cluster 2021-03-10T15:02:45.385358+0000 mgr.gibba020.yqfnwy (mgr.34427) 3716 : cluster [DBG] pgmap v2103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:48.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:47 gibba013 bash[29418]: cluster 2021-03-10T15:02:47.386957+0000 mgr.gibba020.yqfnwy (mgr.34427) 3717 : cluster [DBG] pgmap v2104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:48.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:47 gibba013 bash[30381]: cluster 2021-03-10T15:02:47.386957+0000 mgr.gibba020.yqfnwy (mgr.34427) 3717 : cluster [DBG] pgmap v2104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:48.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:47 gibba020 bash[25448]: cluster 2021-03-10T15:02:47.386957+0000 mgr.gibba020.yqfnwy (mgr.34427) 3717 : cluster [DBG] pgmap v2104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:50.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:50 gibba013 bash[29418]: cluster 2021-03-10T15:02:49.388459+0000 mgr.gibba020.yqfnwy (mgr.34427) 3718 : cluster [DBG] pgmap v2105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:50.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:50 gibba013 bash[30381]: cluster 2021-03-10T15:02:49.388459+0000 mgr.gibba020.yqfnwy (mgr.34427) 3718 : cluster [DBG] pgmap v2105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:50.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:50 gibba020 bash[25448]: cluster 2021-03-10T15:02:49.388459+0000 mgr.gibba020.yqfnwy (mgr.34427) 3718 : cluster [DBG] pgmap v2105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:52.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:52 gibba013 bash[29418]: cluster 2021-03-10T15:02:51.390085+0000 mgr.gibba020.yqfnwy (mgr.34427) 3719 : cluster [DBG] pgmap v2106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:52.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:52 gibba013 bash[30381]: cluster 2021-03-10T15:02:51.390085+0000 mgr.gibba020.yqfnwy (mgr.34427) 3719 : cluster [DBG] pgmap v2106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:52.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:52 gibba020 bash[25448]: cluster 2021-03-10T15:02:51.390085+0000 mgr.gibba020.yqfnwy (mgr.34427) 3719 : cluster [DBG] pgmap v2106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:54.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:54 gibba013 bash[29418]: cluster 2021-03-10T15:02:53.391511+0000 mgr.gibba020.yqfnwy (mgr.34427) 3720 : cluster [DBG] pgmap v2107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:54.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:54 gibba013 bash[30381]: cluster 2021-03-10T15:02:53.391511+0000 mgr.gibba020.yqfnwy (mgr.34427) 3720 : cluster [DBG] pgmap v2107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:54.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:54 gibba020 bash[25448]: cluster 2021-03-10T15:02:53.391511+0000 mgr.gibba020.yqfnwy (mgr.34427) 3720 : cluster [DBG] pgmap v2107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:56.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:56 gibba013 bash[29418]: cluster 2021-03-10T15:02:55.393232+0000 mgr.gibba020.yqfnwy (mgr.34427) 3721 : cluster [DBG] pgmap v2108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:56.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:56 gibba013 bash[30381]: cluster 2021-03-10T15:02:55.393232+0000 mgr.gibba020.yqfnwy (mgr.34427) 3721 : cluster [DBG] pgmap v2108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:56.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:56 gibba020 bash[25448]: cluster 2021-03-10T15:02:55.393232+0000 mgr.gibba020.yqfnwy (mgr.34427) 3721 : cluster [DBG] pgmap v2108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:57.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:57 gibba013 bash[29418]: cephadm 2021-03-10T15:02:55.805478+0000 mgr.gibba020.yqfnwy (mgr.34427) 3722 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:02:57.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:57 gibba013 bash[30381]: cephadm 2021-03-10T15:02:55.805478+0000 mgr.gibba020.yqfnwy (mgr.34427) 3722 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:02:57.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:57 gibba020 bash[25448]: cephadm 2021-03-10T15:02:55.805478+0000 mgr.gibba020.yqfnwy (mgr.34427) 3722 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:02:58.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:02:58 gibba013 bash[29418]: cluster 2021-03-10T15:02:57.394744+0000 mgr.gibba020.yqfnwy (mgr.34427) 3723 : cluster [DBG] pgmap v2109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:58.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:02:58 gibba013 bash[30381]: cluster 2021-03-10T15:02:57.394744+0000 mgr.gibba020.yqfnwy (mgr.34427) 3723 : cluster [DBG] pgmap v2109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:58.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:02:58 gibba020 bash[25448]: cluster 2021-03-10T15:02:57.394744+0000 mgr.gibba020.yqfnwy (mgr.34427) 3723 : cluster [DBG] pgmap v2109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:02:59.858 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:03:00.083 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:03:00.084 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (69m) 4m ago 74m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:03:00.084 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (74m) 3m ago 74m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:03:00.084 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (69m) 3m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:03:00.085 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (70m) 3m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:03:00.085 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (69m) 4m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:03:00.085 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (69m) 4m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:03:00.085 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (68m) 3m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:03:00.086 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (68m) 4m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:03:00.086 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (75m) 4m ago 75m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:03:00.086 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (75m) 3m ago 75m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:03:00.086 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (67m) 4m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:03:00.087 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (67m) 4m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:03:00.087 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (66m) 4m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:03:00.087 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (66m) 4m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:03:00.087 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (66m) 3m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:03:00.088 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (65m) 3m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:03:00.088 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (65m) 3m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:03:00.088 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (64m) 3m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:03:00.088 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (74m) 3m ago 75m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:03:00.088 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 3m ago 73m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:03:00.334 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:03:00.334 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:03:00.334 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:03:00.335 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:03:00.335 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:03:00.335 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:03:00.335 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:03:00.336 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:03:00.336 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:03:00.336 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:03:00.336 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:03:00.337 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:03:00.337 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:03:00.337 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:03:00.337 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:03:00.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:00 gibba013 bash[29418]: cluster 2021-03-10T15:02:59.396061+0000 mgr.gibba020.yqfnwy (mgr.34427) 3724 : cluster [DBG] pgmap v2110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:00.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:00 gibba013 bash[29418]: audit 2021-03-10T15:03:00.331080+0000 mon.a (mon.0) 1671 : audit [DBG] from='client.? 172.21.2.113:0/4002836681' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:00.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:00 gibba013 bash[30381]: cluster 2021-03-10T15:02:59.396061+0000 mgr.gibba020.yqfnwy (mgr.34427) 3724 : cluster [DBG] pgmap v2110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:00.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:00 gibba013 bash[30381]: audit 2021-03-10T15:03:00.331080+0000 mon.a (mon.0) 1671 : audit [DBG] from='client.? 172.21.2.113:0/4002836681' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:00.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:00 gibba020 bash[25448]: cluster 2021-03-10T15:02:59.396061+0000 mgr.gibba020.yqfnwy (mgr.34427) 3724 : cluster [DBG] pgmap v2110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:00.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:00 gibba020 bash[25448]: audit 2021-03-10T15:03:00.331080+0000 mon.a (mon.0) 1671 : audit [DBG] from='client.? 172.21.2.113:0/4002836681' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:01.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:01 gibba013 bash[29418]: audit 2021-03-10T15:02:59.845934+0000 mgr.gibba020.yqfnwy (mgr.34427) 3725 : audit [DBG] from='client.56539 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:03:01.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:01 gibba013 bash[29418]: audit 2021-03-10T15:03:00.069072+0000 mgr.gibba020.yqfnwy (mgr.34427) 3726 : audit [DBG] from='client.46560 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:03:01.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:01 gibba013 bash[30381]: audit 2021-03-10T15:02:59.845934+0000 mgr.gibba020.yqfnwy (mgr.34427) 3725 : audit [DBG] from='client.56539 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:03:01.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:01 gibba013 bash[30381]: audit 2021-03-10T15:03:00.069072+0000 mgr.gibba020.yqfnwy (mgr.34427) 3726 : audit [DBG] from='client.46560 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:03:01.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:01 gibba020 bash[25448]: audit 2021-03-10T15:02:59.845934+0000 mgr.gibba020.yqfnwy (mgr.34427) 3725 : audit [DBG] from='client.56539 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:03:01.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:01 gibba020 bash[25448]: audit 2021-03-10T15:03:00.069072+0000 mgr.gibba020.yqfnwy (mgr.34427) 3726 : audit [DBG] from='client.46560 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:03:02.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:02 gibba013 bash[29418]: cluster 2021-03-10T15:03:01.397894+0000 mgr.gibba020.yqfnwy (mgr.34427) 3727 : cluster [DBG] pgmap v2111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:02.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:02 gibba013 bash[30381]: cluster 2021-03-10T15:03:01.397894+0000 mgr.gibba020.yqfnwy (mgr.34427) 3727 : cluster [DBG] pgmap v2111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:02.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:02 gibba020 bash[25448]: cluster 2021-03-10T15:03:01.397894+0000 mgr.gibba020.yqfnwy (mgr.34427) 3727 : cluster [DBG] pgmap v2111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:04.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:04 gibba013 bash[29418]: cluster 2021-03-10T15:03:03.399275+0000 mgr.gibba020.yqfnwy (mgr.34427) 3728 : cluster [DBG] pgmap v2112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:04.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:04 gibba013 bash[30381]: cluster 2021-03-10T15:03:03.399275+0000 mgr.gibba020.yqfnwy (mgr.34427) 3728 : cluster [DBG] pgmap v2112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:04.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:04 gibba020 bash[25448]: cluster 2021-03-10T15:03:03.399275+0000 mgr.gibba020.yqfnwy (mgr.34427) 3728 : cluster [DBG] pgmap v2112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:06 gibba013 bash[29418]: cluster 2021-03-10T15:03:05.401082+0000 mgr.gibba020.yqfnwy (mgr.34427) 3729 : cluster [DBG] pgmap v2113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:06.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:06 gibba013 bash[29418]: audit 2021-03-10T15:03:06.325175+0000 mon.a (mon.0) 1672 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:03:06.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:06 gibba013 bash[29418]: audit 2021-03-10T15:03:06.350853+0000 mon.a (mon.0) 1673 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:03:06.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:06 gibba013 bash[29418]: audit 2021-03-10T15:03:06.401093+0000 mon.a (mon.0) 1674 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T15:03:06.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:06 gibba013 bash[29418]: audit 2021-03-10T15:03:06.401827+0000 mon.a (mon.0) 1675 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:03:06.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:06 gibba013 bash[29418]: audit 2021-03-10T15:03:06.402572+0000 mon.a (mon.0) 1676 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:03:06.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:06 gibba013 bash[29418]: audit 2021-03-10T15:03:06.403220+0000 mon.a (mon.0) 1677 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:03:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:06 gibba013 bash[30381]: cluster 2021-03-10T15:03:05.401082+0000 mgr.gibba020.yqfnwy (mgr.34427) 3729 : cluster [DBG] pgmap v2113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:06.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:06 gibba013 bash[30381]: audit 2021-03-10T15:03:06.325175+0000 mon.a (mon.0) 1672 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:03:06.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:06 gibba013 bash[30381]: audit 2021-03-10T15:03:06.350853+0000 mon.a (mon.0) 1673 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:03:06.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:06 gibba013 bash[30381]: audit 2021-03-10T15:03:06.401093+0000 mon.a (mon.0) 1674 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T15:03:06.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:06 gibba013 bash[30381]: audit 2021-03-10T15:03:06.401827+0000 mon.a (mon.0) 1675 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:03:06.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:06 gibba013 bash[30381]: audit 2021-03-10T15:03:06.402572+0000 mon.a (mon.0) 1676 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:03:06.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:06 gibba013 bash[30381]: audit 2021-03-10T15:03:06.403220+0000 mon.a (mon.0) 1677 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:03:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:06 gibba020 bash[25448]: cluster 2021-03-10T15:03:05.401082+0000 mgr.gibba020.yqfnwy (mgr.34427) 3729 : cluster [DBG] pgmap v2113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:06 gibba020 bash[25448]: audit 2021-03-10T15:03:06.325175+0000 mon.a (mon.0) 1672 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:03:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:06 gibba020 bash[25448]: audit 2021-03-10T15:03:06.350853+0000 mon.a (mon.0) 1673 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:03:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:06 gibba020 bash[25448]: audit 2021-03-10T15:03:06.401093+0000 mon.a (mon.0) 1674 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T15:03:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:06 gibba020 bash[25448]: audit 2021-03-10T15:03:06.401827+0000 mon.a (mon.0) 1675 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:03:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:06 gibba020 bash[25448]: audit 2021-03-10T15:03:06.402572+0000 mon.a (mon.0) 1676 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:03:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:06 gibba020 bash[25448]: audit 2021-03-10T15:03:06.403220+0000 mon.a (mon.0) 1677 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:03:08.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:07 gibba013 bash[29418]: cluster 2021-03-10T15:03:07.402629+0000 mgr.gibba020.yqfnwy (mgr.34427) 3730 : cluster [DBG] pgmap v2114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:08.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:07 gibba013 bash[30381]: cluster 2021-03-10T15:03:07.402629+0000 mgr.gibba020.yqfnwy (mgr.34427) 3730 : cluster [DBG] pgmap v2114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:08.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:07 gibba020 bash[25448]: cluster 2021-03-10T15:03:07.402629+0000 mgr.gibba020.yqfnwy (mgr.34427) 3730 : cluster [DBG] pgmap v2114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:10.825 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:10 gibba020 bash[25448]: cluster 2021-03-10T15:03:09.404240+0000 mgr.gibba020.yqfnwy (mgr.34427) 3731 : cluster [DBG] pgmap v2115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:10.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:10 gibba013 bash[29418]: cluster 2021-03-10T15:03:09.404240+0000 mgr.gibba020.yqfnwy (mgr.34427) 3731 : cluster [DBG] pgmap v2115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:10.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:10 gibba013 bash[30381]: cluster 2021-03-10T15:03:09.404240+0000 mgr.gibba020.yqfnwy (mgr.34427) 3731 : cluster [DBG] pgmap v2115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:12.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:12 gibba013 bash[29418]: cephadm 2021-03-10T15:03:10.821473+0000 mgr.gibba020.yqfnwy (mgr.34427) 3732 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:03:12.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:12 gibba013 bash[29418]: cluster 2021-03-10T15:03:11.406142+0000 mgr.gibba020.yqfnwy (mgr.34427) 3733 : cluster [DBG] pgmap v2116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:12.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:12 gibba013 bash[30381]: cephadm 2021-03-10T15:03:10.821473+0000 mgr.gibba020.yqfnwy (mgr.34427) 3732 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:03:12.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:12 gibba013 bash[30381]: cluster 2021-03-10T15:03:11.406142+0000 mgr.gibba020.yqfnwy (mgr.34427) 3733 : cluster [DBG] pgmap v2116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:12.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:12 gibba020 bash[25448]: cephadm 2021-03-10T15:03:10.821473+0000 mgr.gibba020.yqfnwy (mgr.34427) 3732 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:03:12.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:12 gibba020 bash[25448]: cluster 2021-03-10T15:03:11.406142+0000 mgr.gibba020.yqfnwy (mgr.34427) 3733 : cluster [DBG] pgmap v2116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:14.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:14 gibba013 bash[29418]: cluster 2021-03-10T15:03:13.407651+0000 mgr.gibba020.yqfnwy (mgr.34427) 3734 : cluster [DBG] pgmap v2117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:14.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:14 gibba013 bash[30381]: cluster 2021-03-10T15:03:13.407651+0000 mgr.gibba020.yqfnwy (mgr.34427) 3734 : cluster [DBG] pgmap v2117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:14.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:14 gibba020 bash[25448]: cluster 2021-03-10T15:03:13.407651+0000 mgr.gibba020.yqfnwy (mgr.34427) 3734 : cluster [DBG] pgmap v2117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:16.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:16 gibba013 bash[29418]: cluster 2021-03-10T15:03:15.409313+0000 mgr.gibba020.yqfnwy (mgr.34427) 3735 : cluster [DBG] pgmap v2118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:16.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:16 gibba013 bash[30381]: cluster 2021-03-10T15:03:15.409313+0000 mgr.gibba020.yqfnwy (mgr.34427) 3735 : cluster [DBG] pgmap v2118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:16.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:16 gibba020 bash[25448]: cluster 2021-03-10T15:03:15.409313+0000 mgr.gibba020.yqfnwy (mgr.34427) 3735 : cluster [DBG] pgmap v2118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:18.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:17 gibba013 bash[29418]: cluster 2021-03-10T15:03:17.410796+0000 mgr.gibba020.yqfnwy (mgr.34427) 3736 : cluster [DBG] pgmap v2119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:18.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:17 gibba013 bash[30381]: cluster 2021-03-10T15:03:17.410796+0000 mgr.gibba020.yqfnwy (mgr.34427) 3736 : cluster [DBG] pgmap v2119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:18.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:17 gibba020 bash[25448]: cluster 2021-03-10T15:03:17.410796+0000 mgr.gibba020.yqfnwy (mgr.34427) 3736 : cluster [DBG] pgmap v2119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:20.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:20 gibba013 bash[29418]: cluster 2021-03-10T15:03:19.412079+0000 mgr.gibba020.yqfnwy (mgr.34427) 3737 : cluster [DBG] pgmap v2120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:20.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:20 gibba013 bash[30381]: cluster 2021-03-10T15:03:19.412079+0000 mgr.gibba020.yqfnwy (mgr.34427) 3737 : cluster [DBG] pgmap v2120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:20.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:20 gibba020 bash[25448]: cluster 2021-03-10T15:03:19.412079+0000 mgr.gibba020.yqfnwy (mgr.34427) 3737 : cluster [DBG] pgmap v2120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:22.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:22 gibba013 bash[29418]: cluster 2021-03-10T15:03:21.413935+0000 mgr.gibba020.yqfnwy (mgr.34427) 3738 : cluster [DBG] pgmap v2121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:22.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:22 gibba013 bash[30381]: cluster 2021-03-10T15:03:21.413935+0000 mgr.gibba020.yqfnwy (mgr.34427) 3738 : cluster [DBG] pgmap v2121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:22.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:22 gibba020 bash[25448]: cluster 2021-03-10T15:03:21.413935+0000 mgr.gibba020.yqfnwy (mgr.34427) 3738 : cluster [DBG] pgmap v2121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:24.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:24 gibba013 bash[29418]: cluster 2021-03-10T15:03:23.415650+0000 mgr.gibba020.yqfnwy (mgr.34427) 3739 : cluster [DBG] pgmap v2122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:24.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:24 gibba013 bash[30381]: cluster 2021-03-10T15:03:23.415650+0000 mgr.gibba020.yqfnwy (mgr.34427) 3739 : cluster [DBG] pgmap v2122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:24.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:24 gibba020 bash[25448]: cluster 2021-03-10T15:03:23.415650+0000 mgr.gibba020.yqfnwy (mgr.34427) 3739 : cluster [DBG] pgmap v2122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:26.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:26 gibba013 bash[29418]: cluster 2021-03-10T15:03:25.417358+0000 mgr.gibba020.yqfnwy (mgr.34427) 3740 : cluster [DBG] pgmap v2123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:26.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:26 gibba013 bash[30381]: cluster 2021-03-10T15:03:25.417358+0000 mgr.gibba020.yqfnwy (mgr.34427) 3740 : cluster [DBG] pgmap v2123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:26.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:26 gibba020 bash[25448]: cluster 2021-03-10T15:03:25.417358+0000 mgr.gibba020.yqfnwy (mgr.34427) 3740 : cluster [DBG] pgmap v2123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:27.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:27 gibba013 bash[29418]: cephadm 2021-03-10T15:03:25.829297+0000 mgr.gibba020.yqfnwy (mgr.34427) 3741 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:03:27.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:27 gibba013 bash[30381]: cephadm 2021-03-10T15:03:25.829297+0000 mgr.gibba020.yqfnwy (mgr.34427) 3741 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:03:27.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:27 gibba020 bash[25448]: cephadm 2021-03-10T15:03:25.829297+0000 mgr.gibba020.yqfnwy (mgr.34427) 3741 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:03:28.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:28 gibba013 bash[29418]: cluster 2021-03-10T15:03:27.418655+0000 mgr.gibba020.yqfnwy (mgr.34427) 3742 : cluster [DBG] pgmap v2124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:28.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:28 gibba013 bash[30381]: cluster 2021-03-10T15:03:27.418655+0000 mgr.gibba020.yqfnwy (mgr.34427) 3742 : cluster [DBG] pgmap v2124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:28.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:28 gibba020 bash[25448]: cluster 2021-03-10T15:03:27.418655+0000 mgr.gibba020.yqfnwy (mgr.34427) 3742 : cluster [DBG] pgmap v2124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:30.579 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:03:30.806 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:03:30.807 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (69m) 4m ago 75m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:03:30.807 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (75m) 3m ago 75m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:03:30.807 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (70m) 3m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:03:30.807 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (70m) 3m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:03:30.808 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (69m) 4m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:03:30.808 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (69m) 4m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:03:30.808 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (69m) 3m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:03:30.808 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (69m) 4m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:03:30.809 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (75m) 4m ago 75m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:03:30.809 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (75m) 3m ago 75m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:03:30.809 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (68m) 4m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:03:30.809 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (67m) 4m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:03:30.810 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (67m) 4m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:03:30.810 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (67m) 4m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:03:30.810 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (66m) 3m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:03:30.810 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (66m) 3m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:03:30.811 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (65m) 3m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:03:30.811 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (65m) 3m ago 75m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:03:30.811 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (74m) 3m ago 75m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:03:30.811 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 3m ago 73m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:03:30.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:30 gibba013 bash[29418]: cluster 2021-03-10T15:03:29.420195+0000 mgr.gibba020.yqfnwy (mgr.34427) 3743 : cluster [DBG] pgmap v2125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:30.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:30 gibba013 bash[30381]: cluster 2021-03-10T15:03:29.420195+0000 mgr.gibba020.yqfnwy (mgr.34427) 3743 : cluster [DBG] pgmap v2125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:30.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:30 gibba020 bash[25448]: cluster 2021-03-10T15:03:29.420195+0000 mgr.gibba020.yqfnwy (mgr.34427) 3743 : cluster [DBG] pgmap v2125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:31.054 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:03:31.055 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:03:31.055 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:03:31.055 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:03:31.055 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:03:31.056 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:03:31.056 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:03:31.056 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:03:31.056 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:03:31.056 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:03:31.057 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:03:31.057 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:03:31.057 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:03:31.057 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:03:31.058 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:03:31.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:31 gibba013 bash[29418]: audit 2021-03-10T15:03:30.566676+0000 mgr.gibba020.yqfnwy (mgr.34427) 3744 : audit [DBG] from='client.56557 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:03:31.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:31 gibba013 bash[29418]: audit 2021-03-10T15:03:31.051534+0000 mon.c (mon.1) 69 : audit [DBG] from='client.? 172.21.2.113:0/1909438131' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:31.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:31 gibba013 bash[30381]: audit 2021-03-10T15:03:30.566676+0000 mgr.gibba020.yqfnwy (mgr.34427) 3744 : audit [DBG] from='client.56557 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:03:31.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:31 gibba013 bash[30381]: audit 2021-03-10T15:03:31.051534+0000 mon.c (mon.1) 69 : audit [DBG] from='client.? 172.21.2.113:0/1909438131' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:31.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:31 gibba020 bash[25448]: audit 2021-03-10T15:03:30.566676+0000 mgr.gibba020.yqfnwy (mgr.34427) 3744 : audit [DBG] from='client.56557 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:03:31.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:31 gibba020 bash[25448]: audit 2021-03-10T15:03:31.051534+0000 mon.c (mon.1) 69 : audit [DBG] from='client.? 172.21.2.113:0/1909438131' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:32.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:32 gibba013 bash[29418]: audit 2021-03-10T15:03:30.790496+0000 mgr.gibba020.yqfnwy (mgr.34427) 3745 : audit [DBG] from='client.46578 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:03:32.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:32 gibba013 bash[29418]: cluster 2021-03-10T15:03:31.421978+0000 mgr.gibba020.yqfnwy (mgr.34427) 3746 : cluster [DBG] pgmap v2126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:32.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:32 gibba013 bash[30381]: audit 2021-03-10T15:03:30.790496+0000 mgr.gibba020.yqfnwy (mgr.34427) 3745 : audit [DBG] from='client.46578 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:03:32.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:32 gibba013 bash[30381]: cluster 2021-03-10T15:03:31.421978+0000 mgr.gibba020.yqfnwy (mgr.34427) 3746 : cluster [DBG] pgmap v2126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:32.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:32 gibba020 bash[25448]: audit 2021-03-10T15:03:30.790496+0000 mgr.gibba020.yqfnwy (mgr.34427) 3745 : audit [DBG] from='client.46578 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:03:32.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:32 gibba020 bash[25448]: cluster 2021-03-10T15:03:31.421978+0000 mgr.gibba020.yqfnwy (mgr.34427) 3746 : cluster [DBG] pgmap v2126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:34.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:34 gibba013 bash[29418]: cluster 2021-03-10T15:03:33.423503+0000 mgr.gibba020.yqfnwy (mgr.34427) 3747 : cluster [DBG] pgmap v2127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:34.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:34 gibba013 bash[30381]: cluster 2021-03-10T15:03:33.423503+0000 mgr.gibba020.yqfnwy (mgr.34427) 3747 : cluster [DBG] pgmap v2127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:34.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:34 gibba020 bash[25448]: cluster 2021-03-10T15:03:33.423503+0000 mgr.gibba020.yqfnwy (mgr.34427) 3747 : cluster [DBG] pgmap v2127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:36.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:36 gibba013 bash[29418]: cluster 2021-03-10T15:03:35.424981+0000 mgr.gibba020.yqfnwy (mgr.34427) 3748 : cluster [DBG] pgmap v2128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:36.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:36 gibba013 bash[30381]: cluster 2021-03-10T15:03:35.424981+0000 mgr.gibba020.yqfnwy (mgr.34427) 3748 : cluster [DBG] pgmap v2128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:36.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:36 gibba020 bash[25448]: cluster 2021-03-10T15:03:35.424981+0000 mgr.gibba020.yqfnwy (mgr.34427) 3748 : cluster [DBG] pgmap v2128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:38.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:37 gibba013 bash[29418]: cluster 2021-03-10T15:03:37.426528+0000 mgr.gibba020.yqfnwy (mgr.34427) 3749 : cluster [DBG] pgmap v2129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:38.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:37 gibba013 bash[30381]: cluster 2021-03-10T15:03:37.426528+0000 mgr.gibba020.yqfnwy (mgr.34427) 3749 : cluster [DBG] pgmap v2129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:38.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:37 gibba020 bash[25448]: cluster 2021-03-10T15:03:37.426528+0000 mgr.gibba020.yqfnwy (mgr.34427) 3749 : cluster [DBG] pgmap v2129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:40.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:40 gibba013 bash[29418]: cluster 2021-03-10T15:03:39.427777+0000 mgr.gibba020.yqfnwy (mgr.34427) 3750 : cluster [DBG] pgmap v2130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:40.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:40 gibba013 bash[30381]: cluster 2021-03-10T15:03:39.427777+0000 mgr.gibba020.yqfnwy (mgr.34427) 3750 : cluster [DBG] pgmap v2130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:40.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:40 gibba020 bash[25448]: cluster 2021-03-10T15:03:39.427777+0000 mgr.gibba020.yqfnwy (mgr.34427) 3750 : cluster [DBG] pgmap v2130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:41.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:41 gibba013 bash[29418]: audit 2021-03-10T15:03:40.847061+0000 mon.a (mon.0) 1678 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:03:41.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:41 gibba013 bash[29418]: audit 2021-03-10T15:03:41.076046+0000 mon.a (mon.0) 1679 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:03:41.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:41 gibba013 bash[29418]: audit 2021-03-10T15:03:41.079158+0000 mon.a (mon.0) 1680 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:03:41.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:41 gibba013 bash[29418]: audit 2021-03-10T15:03:41.080386+0000 mon.a (mon.0) 1681 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:41.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:41 gibba013 bash[29418]: audit 2021-03-10T15:03:41.081516+0000 mon.a (mon.0) 1682 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:41.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:41 gibba013 bash[29418]: audit 2021-03-10T15:03:41.082695+0000 mon.a (mon.0) 1683 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:41.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:41 gibba013 bash[29418]: audit 2021-03-10T15:03:41.084846+0000 mon.a (mon.0) 1684 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:41.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:41 gibba013 bash[29418]: audit 2021-03-10T15:03:41.086172+0000 mon.a (mon.0) 1685 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:41.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:41 gibba013 bash[30381]: audit 2021-03-10T15:03:40.847061+0000 mon.a (mon.0) 1678 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:03:41.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:41 gibba013 bash[30381]: audit 2021-03-10T15:03:41.076046+0000 mon.a (mon.0) 1679 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:03:41.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:41 gibba013 bash[30381]: audit 2021-03-10T15:03:41.079158+0000 mon.a (mon.0) 1680 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:03:41.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:41 gibba013 bash[30381]: audit 2021-03-10T15:03:41.080386+0000 mon.a (mon.0) 1681 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:41.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:41 gibba013 bash[30381]: audit 2021-03-10T15:03:41.081516+0000 mon.a (mon.0) 1682 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:41.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:41 gibba013 bash[30381]: audit 2021-03-10T15:03:41.082695+0000 mon.a (mon.0) 1683 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:41.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:41 gibba013 bash[30381]: audit 2021-03-10T15:03:41.084846+0000 mon.a (mon.0) 1684 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:41.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:41 gibba013 bash[30381]: audit 2021-03-10T15:03:41.086172+0000 mon.a (mon.0) 1685 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:41.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:41 gibba020 bash[25448]: audit 2021-03-10T15:03:40.847061+0000 mon.a (mon.0) 1678 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:03:41.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:41 gibba020 bash[25448]: audit 2021-03-10T15:03:41.076046+0000 mon.a (mon.0) 1679 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:03:41.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:41 gibba020 bash[25448]: audit 2021-03-10T15:03:41.079158+0000 mon.a (mon.0) 1680 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:03:41.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:41 gibba020 bash[25448]: audit 2021-03-10T15:03:41.080386+0000 mon.a (mon.0) 1681 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:41.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:41 gibba020 bash[25448]: audit 2021-03-10T15:03:41.081516+0000 mon.a (mon.0) 1682 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:41.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:41 gibba020 bash[25448]: audit 2021-03-10T15:03:41.082695+0000 mon.a (mon.0) 1683 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:41.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:41 gibba020 bash[25448]: audit 2021-03-10T15:03:41.084846+0000 mon.a (mon.0) 1684 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:41.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:41 gibba020 bash[25448]: audit 2021-03-10T15:03:41.086172+0000 mon.a (mon.0) 1685 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:03:42.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:42 gibba013 bash[29418]: cephadm 2021-03-10T15:03:40.851632+0000 mgr.gibba020.yqfnwy (mgr.34427) 3751 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:03:42.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:42 gibba013 bash[29418]: cephadm 2021-03-10T15:03:40.853404+0000 mgr.gibba020.yqfnwy (mgr.34427) 3752 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:03:42.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:42 gibba013 bash[29418]: cephadm 2021-03-10T15:03:41.077586+0000 mgr.gibba020.yqfnwy (mgr.34427) 3753 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:03:42.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:42 gibba013 bash[29418]: cephadm 2021-03-10T15:03:41.079180+0000 mgr.gibba020.yqfnwy (mgr.34427) 3754 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:03:42.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:42 gibba013 bash[29418]: cephadm 2021-03-10T15:03:41.080272+0000 mgr.gibba020.yqfnwy (mgr.34427) 3755 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:03:42.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:42 gibba013 bash[29418]: cephadm 2021-03-10T15:03:41.080311+0000 mgr.gibba020.yqfnwy (mgr.34427) 3756 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:03:42.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:42 gibba013 bash[29418]: cephadm 2021-03-10T15:03:41.081517+0000 mgr.gibba020.yqfnwy (mgr.34427) 3757 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:03:42.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:42 gibba013 bash[29418]: cephadm 2021-03-10T15:03:41.081556+0000 mgr.gibba020.yqfnwy (mgr.34427) 3758 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:03:42.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:42 gibba013 bash[29418]: cephadm 2021-03-10T15:03:41.082574+0000 mgr.gibba020.yqfnwy (mgr.34427) 3759 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:03:42.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:42 gibba013 bash[29418]: cephadm 2021-03-10T15:03:41.083534+0000 mgr.gibba020.yqfnwy (mgr.34427) 3760 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:03:42.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:42 gibba013 bash[29418]: cephadm 2021-03-10T15:03:41.083571+0000 mgr.gibba020.yqfnwy (mgr.34427) 3761 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:03:42.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:42 gibba013 bash[29418]: cephadm 2021-03-10T15:03:41.084699+0000 mgr.gibba020.yqfnwy (mgr.34427) 3762 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:03:42.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:42 gibba013 bash[29418]: cephadm 2021-03-10T15:03:41.085020+0000 mgr.gibba020.yqfnwy (mgr.34427) 3763 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:03:42.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:42 gibba013 bash[29418]: cephadm 2021-03-10T15:03:41.086183+0000 mgr.gibba020.yqfnwy (mgr.34427) 3764 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:03:42.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:42 gibba013 bash[29418]: cephadm 2021-03-10T15:03:41.086222+0000 mgr.gibba020.yqfnwy (mgr.34427) 3765 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:03:42.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:42 gibba013 bash[29418]: cephadm 2021-03-10T15:03:41.086329+0000 mgr.gibba020.yqfnwy (mgr.34427) 3766 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:03:42.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:42 gibba013 bash[29418]: cluster 2021-03-10T15:03:41.429510+0000 mgr.gibba020.yqfnwy (mgr.34427) 3767 : cluster [DBG] pgmap v2131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:42.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:42 gibba013 bash[30381]: cephadm 2021-03-10T15:03:40.851632+0000 mgr.gibba020.yqfnwy (mgr.34427) 3751 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:03:42.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:42 gibba013 bash[30381]: cephadm 2021-03-10T15:03:40.853404+0000 mgr.gibba020.yqfnwy (mgr.34427) 3752 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:03:42.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:42 gibba013 bash[30381]: cephadm 2021-03-10T15:03:41.077586+0000 mgr.gibba020.yqfnwy (mgr.34427) 3753 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:03:42.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:42 gibba013 bash[30381]: cephadm 2021-03-10T15:03:41.079180+0000 mgr.gibba020.yqfnwy (mgr.34427) 3754 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:03:42.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:42 gibba013 bash[30381]: cephadm 2021-03-10T15:03:41.080272+0000 mgr.gibba020.yqfnwy (mgr.34427) 3755 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:03:42.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:42 gibba013 bash[30381]: cephadm 2021-03-10T15:03:41.080311+0000 mgr.gibba020.yqfnwy (mgr.34427) 3756 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:03:42.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:42 gibba013 bash[30381]: cephadm 2021-03-10T15:03:41.081517+0000 mgr.gibba020.yqfnwy (mgr.34427) 3757 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:03:42.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:42 gibba013 bash[30381]: cephadm 2021-03-10T15:03:41.081556+0000 mgr.gibba020.yqfnwy (mgr.34427) 3758 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:03:42.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:42 gibba013 bash[30381]: cephadm 2021-03-10T15:03:41.082574+0000 mgr.gibba020.yqfnwy (mgr.34427) 3759 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:03:42.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:42 gibba013 bash[30381]: cephadm 2021-03-10T15:03:41.083534+0000 mgr.gibba020.yqfnwy (mgr.34427) 3760 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:03:42.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:42 gibba013 bash[30381]: cephadm 2021-03-10T15:03:41.083571+0000 mgr.gibba020.yqfnwy (mgr.34427) 3761 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:03:42.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:42 gibba013 bash[30381]: cephadm 2021-03-10T15:03:41.084699+0000 mgr.gibba020.yqfnwy (mgr.34427) 3762 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:03:42.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:42 gibba013 bash[30381]: cephadm 2021-03-10T15:03:41.085020+0000 mgr.gibba020.yqfnwy (mgr.34427) 3763 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:03:42.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:42 gibba013 bash[30381]: cephadm 2021-03-10T15:03:41.086183+0000 mgr.gibba020.yqfnwy (mgr.34427) 3764 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:03:42.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:42 gibba013 bash[30381]: cephadm 2021-03-10T15:03:41.086222+0000 mgr.gibba020.yqfnwy (mgr.34427) 3765 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:03:42.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:42 gibba013 bash[30381]: cephadm 2021-03-10T15:03:41.086329+0000 mgr.gibba020.yqfnwy (mgr.34427) 3766 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:03:42.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:42 gibba013 bash[30381]: cluster 2021-03-10T15:03:41.429510+0000 mgr.gibba020.yqfnwy (mgr.34427) 3767 : cluster [DBG] pgmap v2131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:42.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:42 gibba020 bash[25448]: cephadm 2021-03-10T15:03:40.851632+0000 mgr.gibba020.yqfnwy (mgr.34427) 3751 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:03:42.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:42 gibba020 bash[25448]: cephadm 2021-03-10T15:03:40.853404+0000 mgr.gibba020.yqfnwy (mgr.34427) 3752 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:03:42.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:42 gibba020 bash[25448]: cephadm 2021-03-10T15:03:41.077586+0000 mgr.gibba020.yqfnwy (mgr.34427) 3753 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:03:42.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:42 gibba020 bash[25448]: cephadm 2021-03-10T15:03:41.079180+0000 mgr.gibba020.yqfnwy (mgr.34427) 3754 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:03:42.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:42 gibba020 bash[25448]: cephadm 2021-03-10T15:03:41.080272+0000 mgr.gibba020.yqfnwy (mgr.34427) 3755 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:03:42.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:42 gibba020 bash[25448]: cephadm 2021-03-10T15:03:41.080311+0000 mgr.gibba020.yqfnwy (mgr.34427) 3756 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:03:42.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:42 gibba020 bash[25448]: cephadm 2021-03-10T15:03:41.081517+0000 mgr.gibba020.yqfnwy (mgr.34427) 3757 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:03:42.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:42 gibba020 bash[25448]: cephadm 2021-03-10T15:03:41.081556+0000 mgr.gibba020.yqfnwy (mgr.34427) 3758 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:03:42.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:42 gibba020 bash[25448]: cephadm 2021-03-10T15:03:41.082574+0000 mgr.gibba020.yqfnwy (mgr.34427) 3759 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:03:42.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:42 gibba020 bash[25448]: cephadm 2021-03-10T15:03:41.083534+0000 mgr.gibba020.yqfnwy (mgr.34427) 3760 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:03:42.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:42 gibba020 bash[25448]: cephadm 2021-03-10T15:03:41.083571+0000 mgr.gibba020.yqfnwy (mgr.34427) 3761 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:03:42.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:42 gibba020 bash[25448]: cephadm 2021-03-10T15:03:41.084699+0000 mgr.gibba020.yqfnwy (mgr.34427) 3762 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:03:42.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:42 gibba020 bash[25448]: cephadm 2021-03-10T15:03:41.085020+0000 mgr.gibba020.yqfnwy (mgr.34427) 3763 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:03:42.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:42 gibba020 bash[25448]: cephadm 2021-03-10T15:03:41.086183+0000 mgr.gibba020.yqfnwy (mgr.34427) 3764 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:03:42.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:42 gibba020 bash[25448]: cephadm 2021-03-10T15:03:41.086222+0000 mgr.gibba020.yqfnwy (mgr.34427) 3765 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:03:42.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:42 gibba020 bash[25448]: cephadm 2021-03-10T15:03:41.086329+0000 mgr.gibba020.yqfnwy (mgr.34427) 3766 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:03:42.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:42 gibba020 bash[25448]: cluster 2021-03-10T15:03:41.429510+0000 mgr.gibba020.yqfnwy (mgr.34427) 3767 : cluster [DBG] pgmap v2131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:44.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:44 gibba013 bash[29418]: cluster 2021-03-10T15:03:43.430919+0000 mgr.gibba020.yqfnwy (mgr.34427) 3768 : cluster [DBG] pgmap v2132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:44.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:44 gibba013 bash[30381]: cluster 2021-03-10T15:03:43.430919+0000 mgr.gibba020.yqfnwy (mgr.34427) 3768 : cluster [DBG] pgmap v2132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:44.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:44 gibba020 bash[25448]: cluster 2021-03-10T15:03:43.430919+0000 mgr.gibba020.yqfnwy (mgr.34427) 3768 : cluster [DBG] pgmap v2132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:46.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:46 gibba013 bash[29418]: cluster 2021-03-10T15:03:45.432549+0000 mgr.gibba020.yqfnwy (mgr.34427) 3769 : cluster [DBG] pgmap v2133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:46.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:46 gibba013 bash[30381]: cluster 2021-03-10T15:03:45.432549+0000 mgr.gibba020.yqfnwy (mgr.34427) 3769 : cluster [DBG] pgmap v2133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:46.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:46 gibba020 bash[25448]: cluster 2021-03-10T15:03:45.432549+0000 mgr.gibba020.yqfnwy (mgr.34427) 3769 : cluster [DBG] pgmap v2133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:48.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:47 gibba013 bash[29418]: cluster 2021-03-10T15:03:47.434127+0000 mgr.gibba020.yqfnwy (mgr.34427) 3770 : cluster [DBG] pgmap v2134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:48.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:47 gibba013 bash[30381]: cluster 2021-03-10T15:03:47.434127+0000 mgr.gibba020.yqfnwy (mgr.34427) 3770 : cluster [DBG] pgmap v2134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:48.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:47 gibba020 bash[25448]: cluster 2021-03-10T15:03:47.434127+0000 mgr.gibba020.yqfnwy (mgr.34427) 3770 : cluster [DBG] pgmap v2134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:50.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:50 gibba013 bash[29418]: cluster 2021-03-10T15:03:49.435641+0000 mgr.gibba020.yqfnwy (mgr.34427) 3771 : cluster [DBG] pgmap v2135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:50.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:50 gibba013 bash[30381]: cluster 2021-03-10T15:03:49.435641+0000 mgr.gibba020.yqfnwy (mgr.34427) 3771 : cluster [DBG] pgmap v2135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:50.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:50 gibba020 bash[25448]: cluster 2021-03-10T15:03:49.435641+0000 mgr.gibba020.yqfnwy (mgr.34427) 3771 : cluster [DBG] pgmap v2135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:52.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:52 gibba013 bash[29418]: cluster 2021-03-10T15:03:51.437282+0000 mgr.gibba020.yqfnwy (mgr.34427) 3772 : cluster [DBG] pgmap v2136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:52.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:52 gibba013 bash[30381]: cluster 2021-03-10T15:03:51.437282+0000 mgr.gibba020.yqfnwy (mgr.34427) 3772 : cluster [DBG] pgmap v2136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:52.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:52 gibba020 bash[25448]: cluster 2021-03-10T15:03:51.437282+0000 mgr.gibba020.yqfnwy (mgr.34427) 3772 : cluster [DBG] pgmap v2136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:54.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:54 gibba013 bash[29418]: cluster 2021-03-10T15:03:53.438989+0000 mgr.gibba020.yqfnwy (mgr.34427) 3773 : cluster [DBG] pgmap v2137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:54.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:54 gibba013 bash[30381]: cluster 2021-03-10T15:03:53.438989+0000 mgr.gibba020.yqfnwy (mgr.34427) 3773 : cluster [DBG] pgmap v2137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:54.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:54 gibba020 bash[25448]: cluster 2021-03-10T15:03:53.438989+0000 mgr.gibba020.yqfnwy (mgr.34427) 3773 : cluster [DBG] pgmap v2137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:56.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:56 gibba013 bash[29418]: cluster 2021-03-10T15:03:55.440751+0000 mgr.gibba020.yqfnwy (mgr.34427) 3774 : cluster [DBG] pgmap v2138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:56.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:56 gibba013 bash[30381]: cluster 2021-03-10T15:03:55.440751+0000 mgr.gibba020.yqfnwy (mgr.34427) 3774 : cluster [DBG] pgmap v2138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:56.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:56 gibba020 bash[25448]: cluster 2021-03-10T15:03:55.440751+0000 mgr.gibba020.yqfnwy (mgr.34427) 3774 : cluster [DBG] pgmap v2138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:57.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:57 gibba013 bash[29418]: cephadm 2021-03-10T15:03:56.102327+0000 mgr.gibba020.yqfnwy (mgr.34427) 3775 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:03:57.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:57 gibba013 bash[30381]: cephadm 2021-03-10T15:03:56.102327+0000 mgr.gibba020.yqfnwy (mgr.34427) 3775 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:03:57.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:57 gibba020 bash[25448]: cephadm 2021-03-10T15:03:56.102327+0000 mgr.gibba020.yqfnwy (mgr.34427) 3775 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:03:58.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:03:58 gibba013 bash[29418]: cluster 2021-03-10T15:03:57.442234+0000 mgr.gibba020.yqfnwy (mgr.34427) 3776 : cluster [DBG] pgmap v2139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:58.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:03:58 gibba013 bash[30381]: cluster 2021-03-10T15:03:57.442234+0000 mgr.gibba020.yqfnwy (mgr.34427) 3776 : cluster [DBG] pgmap v2139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:03:58.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:03:58 gibba020 bash[25448]: cluster 2021-03-10T15:03:57.442234+0000 mgr.gibba020.yqfnwy (mgr.34427) 3776 : cluster [DBG] pgmap v2139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:00.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:00 gibba013 bash[29418]: cluster 2021-03-10T15:03:59.443822+0000 mgr.gibba020.yqfnwy (mgr.34427) 3777 : cluster [DBG] pgmap v2140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:00.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:00 gibba013 bash[30381]: cluster 2021-03-10T15:03:59.443822+0000 mgr.gibba020.yqfnwy (mgr.34427) 3777 : cluster [DBG] pgmap v2140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:00.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:00 gibba020 bash[25448]: cluster 2021-03-10T15:03:59.443822+0000 mgr.gibba020.yqfnwy (mgr.34427) 3777 : cluster [DBG] pgmap v2140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:01.294 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:04:01.521 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:04:01.521 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (70m) 5m ago 75m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:04:01.521 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (75m) 4m ago 75m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:04:01.522 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (70m) 4m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:04:01.522 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (71m) 4m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:04:01.522 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (70m) 5m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:04:01.522 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (70m) 5m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:04:01.522 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (69m) 4m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:04:01.523 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (69m) 5m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:04:01.523 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (76m) 5m ago 76m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:04:01.523 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (76m) 4m ago 76m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:04:01.523 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (68m) 5m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:04:01.524 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (68m) 5m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:04:01.524 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (67m) 5m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:04:01.524 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (67m) 5m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:04:01.524 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (67m) 4m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:04:01.524 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (66m) 4m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:04:01.525 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (66m) 4m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:04:01.525 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (65m) 4m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:04:01.525 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (75m) 4m ago 76m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:04:01.525 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 4m ago 74m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:04:01.778 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:04:01.778 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:04:01.779 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:04:01.779 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:04:01.779 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:04:01.779 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:04:01.779 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:04:01.780 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:04:01.780 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:04:01.780 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:04:01.780 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:04:01.781 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:04:01.781 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:04:01.781 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:04:01.781 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:04:02.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:02 gibba013 bash[29418]: audit 2021-03-10T15:04:01.281682+0000 mgr.gibba020.yqfnwy (mgr.34427) 3778 : audit [DBG] from='client.56575 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:04:02.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:02 gibba013 bash[29418]: cluster 2021-03-10T15:04:01.445772+0000 mgr.gibba020.yqfnwy (mgr.34427) 3779 : cluster [DBG] pgmap v2141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:02.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:02 gibba013 bash[29418]: audit 2021-03-10T15:04:01.504339+0000 mgr.gibba020.yqfnwy (mgr.34427) 3780 : audit [DBG] from='client.56581 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:04:02.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:02 gibba013 bash[29418]: audit 2021-03-10T15:04:01.775065+0000 mon.c (mon.1) 70 : audit [DBG] from='client.? 172.21.2.113:0/679898622' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:02.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:02 gibba013 bash[30381]: audit 2021-03-10T15:04:01.281682+0000 mgr.gibba020.yqfnwy (mgr.34427) 3778 : audit [DBG] from='client.56575 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:04:02.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:02 gibba013 bash[30381]: cluster 2021-03-10T15:04:01.445772+0000 mgr.gibba020.yqfnwy (mgr.34427) 3779 : cluster [DBG] pgmap v2141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:02.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:02 gibba013 bash[30381]: audit 2021-03-10T15:04:01.504339+0000 mgr.gibba020.yqfnwy (mgr.34427) 3780 : audit [DBG] from='client.56581 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:04:02.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:02 gibba013 bash[30381]: audit 2021-03-10T15:04:01.775065+0000 mon.c (mon.1) 70 : audit [DBG] from='client.? 172.21.2.113:0/679898622' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:02.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:02 gibba020 bash[25448]: audit 2021-03-10T15:04:01.281682+0000 mgr.gibba020.yqfnwy (mgr.34427) 3778 : audit [DBG] from='client.56575 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:04:02.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:02 gibba020 bash[25448]: cluster 2021-03-10T15:04:01.445772+0000 mgr.gibba020.yqfnwy (mgr.34427) 3779 : cluster [DBG] pgmap v2141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:02.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:02 gibba020 bash[25448]: audit 2021-03-10T15:04:01.504339+0000 mgr.gibba020.yqfnwy (mgr.34427) 3780 : audit [DBG] from='client.56581 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:04:02.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:02 gibba020 bash[25448]: audit 2021-03-10T15:04:01.775065+0000 mon.c (mon.1) 70 : audit [DBG] from='client.? 172.21.2.113:0/679898622' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:04.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:04 gibba013 bash[29418]: cluster 2021-03-10T15:04:03.447281+0000 mgr.gibba020.yqfnwy (mgr.34427) 3781 : cluster [DBG] pgmap v2142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:04.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:04 gibba013 bash[30381]: cluster 2021-03-10T15:04:03.447281+0000 mgr.gibba020.yqfnwy (mgr.34427) 3781 : cluster [DBG] pgmap v2142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:04.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:04 gibba020 bash[25448]: cluster 2021-03-10T15:04:03.447281+0000 mgr.gibba020.yqfnwy (mgr.34427) 3781 : cluster [DBG] pgmap v2142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:06.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:06 gibba013 bash[30381]: cluster 2021-03-10T15:04:05.449035+0000 mgr.gibba020.yqfnwy (mgr.34427) 3782 : cluster [DBG] pgmap v2143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:06 gibba013 bash[30381]: audit 2021-03-10T15:04:06.330327+0000 mon.a (mon.0) 1686 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:04:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:06 gibba013 bash[30381]: audit 2021-03-10T15:04:06.357493+0000 mon.a (mon.0) 1687 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:04:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:06 gibba013 bash[30381]: audit 2021-03-10T15:04:06.410479+0000 mon.a (mon.0) 1688 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:04:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:06 gibba013 bash[30381]: audit 2021-03-10T15:04:06.411206+0000 mon.a (mon.0) 1689 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:04:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:06 gibba013 bash[30381]: audit 2021-03-10T15:04:06.411850+0000 mon.a (mon.0) 1690 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:04:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:06 gibba013 bash[30381]: audit 2021-03-10T15:04:06.412498+0000 mon.a (mon.0) 1691 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:04:06.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:06 gibba013 bash[29418]: cluster 2021-03-10T15:04:05.449035+0000 mgr.gibba020.yqfnwy (mgr.34427) 3782 : cluster [DBG] pgmap v2143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:06.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:06 gibba013 bash[29418]: audit 2021-03-10T15:04:06.330327+0000 mon.a (mon.0) 1686 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:04:06.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:06 gibba013 bash[29418]: audit 2021-03-10T15:04:06.357493+0000 mon.a (mon.0) 1687 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:04:06.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:06 gibba013 bash[29418]: audit 2021-03-10T15:04:06.410479+0000 mon.a (mon.0) 1688 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:04:06.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:06 gibba013 bash[29418]: audit 2021-03-10T15:04:06.411206+0000 mon.a (mon.0) 1689 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:04:06.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:06 gibba013 bash[29418]: audit 2021-03-10T15:04:06.411850+0000 mon.a (mon.0) 1690 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:04:06.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:06 gibba013 bash[29418]: audit 2021-03-10T15:04:06.412498+0000 mon.a (mon.0) 1691 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:04:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:06 gibba020 bash[25448]: cluster 2021-03-10T15:04:05.449035+0000 mgr.gibba020.yqfnwy (mgr.34427) 3782 : cluster [DBG] pgmap v2143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:06 gibba020 bash[25448]: audit 2021-03-10T15:04:06.330327+0000 mon.a (mon.0) 1686 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:04:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:06 gibba020 bash[25448]: audit 2021-03-10T15:04:06.357493+0000 mon.a (mon.0) 1687 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:04:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:06 gibba020 bash[25448]: audit 2021-03-10T15:04:06.410479+0000 mon.a (mon.0) 1688 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:04:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:06 gibba020 bash[25448]: audit 2021-03-10T15:04:06.411206+0000 mon.a (mon.0) 1689 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:04:06.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:06 gibba020 bash[25448]: audit 2021-03-10T15:04:06.411850+0000 mon.a (mon.0) 1690 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:04:06.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:06 gibba020 bash[25448]: audit 2021-03-10T15:04:06.412498+0000 mon.a (mon.0) 1691 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:04:08.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:07 gibba013 bash[29418]: cluster 2021-03-10T15:04:07.450310+0000 mgr.gibba020.yqfnwy (mgr.34427) 3783 : cluster [DBG] pgmap v2144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:08.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:07 gibba013 bash[30381]: cluster 2021-03-10T15:04:07.450310+0000 mgr.gibba020.yqfnwy (mgr.34427) 3783 : cluster [DBG] pgmap v2144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:08.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:07 gibba020 bash[25448]: cluster 2021-03-10T15:04:07.450310+0000 mgr.gibba020.yqfnwy (mgr.34427) 3783 : cluster [DBG] pgmap v2144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:10.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:10 gibba013 bash[29418]: cluster 2021-03-10T15:04:09.451784+0000 mgr.gibba020.yqfnwy (mgr.34427) 3784 : cluster [DBG] pgmap v2145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:10.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:10 gibba013 bash[30381]: cluster 2021-03-10T15:04:09.451784+0000 mgr.gibba020.yqfnwy (mgr.34427) 3784 : cluster [DBG] pgmap v2145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:10.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:10 gibba020 bash[25448]: cluster 2021-03-10T15:04:09.451784+0000 mgr.gibba020.yqfnwy (mgr.34427) 3784 : cluster [DBG] pgmap v2145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:12.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:12 gibba013 bash[29418]: cephadm 2021-03-10T15:04:11.118373+0000 mgr.gibba020.yqfnwy (mgr.34427) 3785 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:04:12.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:12 gibba013 bash[29418]: cluster 2021-03-10T15:04:11.453485+0000 mgr.gibba020.yqfnwy (mgr.34427) 3786 : cluster [DBG] pgmap v2146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:12.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:12 gibba013 bash[30381]: cephadm 2021-03-10T15:04:11.118373+0000 mgr.gibba020.yqfnwy (mgr.34427) 3785 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:04:12.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:12 gibba013 bash[30381]: cluster 2021-03-10T15:04:11.453485+0000 mgr.gibba020.yqfnwy (mgr.34427) 3786 : cluster [DBG] pgmap v2146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:12.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:12 gibba020 bash[25448]: cephadm 2021-03-10T15:04:11.118373+0000 mgr.gibba020.yqfnwy (mgr.34427) 3785 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:04:12.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:12 gibba020 bash[25448]: cluster 2021-03-10T15:04:11.453485+0000 mgr.gibba020.yqfnwy (mgr.34427) 3786 : cluster [DBG] pgmap v2146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:14.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:14 gibba013 bash[29418]: cluster 2021-03-10T15:04:13.454825+0000 mgr.gibba020.yqfnwy (mgr.34427) 3787 : cluster [DBG] pgmap v2147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:14.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:14 gibba013 bash[30381]: cluster 2021-03-10T15:04:13.454825+0000 mgr.gibba020.yqfnwy (mgr.34427) 3787 : cluster [DBG] pgmap v2147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:14.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:14 gibba020 bash[25448]: cluster 2021-03-10T15:04:13.454825+0000 mgr.gibba020.yqfnwy (mgr.34427) 3787 : cluster [DBG] pgmap v2147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:16.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:16 gibba013 bash[29418]: cluster 2021-03-10T15:04:15.456453+0000 mgr.gibba020.yqfnwy (mgr.34427) 3788 : cluster [DBG] pgmap v2148: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:16.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:16 gibba013 bash[30381]: cluster 2021-03-10T15:04:15.456453+0000 mgr.gibba020.yqfnwy (mgr.34427) 3788 : cluster [DBG] pgmap v2148: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:16.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:16 gibba020 bash[25448]: cluster 2021-03-10T15:04:15.456453+0000 mgr.gibba020.yqfnwy (mgr.34427) 3788 : cluster [DBG] pgmap v2148: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:18.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:17 gibba013 bash[29418]: cluster 2021-03-10T15:04:17.457725+0000 mgr.gibba020.yqfnwy (mgr.34427) 3789 : cluster [DBG] pgmap v2149: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:18.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:17 gibba013 bash[30381]: cluster 2021-03-10T15:04:17.457725+0000 mgr.gibba020.yqfnwy (mgr.34427) 3789 : cluster [DBG] pgmap v2149: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:18.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:17 gibba020 bash[25448]: cluster 2021-03-10T15:04:17.457725+0000 mgr.gibba020.yqfnwy (mgr.34427) 3789 : cluster [DBG] pgmap v2149: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:20.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:20 gibba013 bash[29418]: cluster 2021-03-10T15:04:19.459189+0000 mgr.gibba020.yqfnwy (mgr.34427) 3790 : cluster [DBG] pgmap v2150: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:20.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:20 gibba013 bash[30381]: cluster 2021-03-10T15:04:19.459189+0000 mgr.gibba020.yqfnwy (mgr.34427) 3790 : cluster [DBG] pgmap v2150: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:20.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:20 gibba020 bash[25448]: cluster 2021-03-10T15:04:19.459189+0000 mgr.gibba020.yqfnwy (mgr.34427) 3790 : cluster [DBG] pgmap v2150: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:22.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:22 gibba013 bash[29418]: cluster 2021-03-10T15:04:21.461069+0000 mgr.gibba020.yqfnwy (mgr.34427) 3791 : cluster [DBG] pgmap v2151: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:22.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:22 gibba013 bash[30381]: cluster 2021-03-10T15:04:21.461069+0000 mgr.gibba020.yqfnwy (mgr.34427) 3791 : cluster [DBG] pgmap v2151: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:22.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:22 gibba020 bash[25448]: cluster 2021-03-10T15:04:21.461069+0000 mgr.gibba020.yqfnwy (mgr.34427) 3791 : cluster [DBG] pgmap v2151: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:24.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:24 gibba013 bash[29418]: cluster 2021-03-10T15:04:23.462691+0000 mgr.gibba020.yqfnwy (mgr.34427) 3792 : cluster [DBG] pgmap v2152: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:24.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:24 gibba013 bash[30381]: cluster 2021-03-10T15:04:23.462691+0000 mgr.gibba020.yqfnwy (mgr.34427) 3792 : cluster [DBG] pgmap v2152: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:24.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:24 gibba020 bash[25448]: cluster 2021-03-10T15:04:23.462691+0000 mgr.gibba020.yqfnwy (mgr.34427) 3792 : cluster [DBG] pgmap v2152: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:26.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:26 gibba013 bash[29418]: cluster 2021-03-10T15:04:25.464341+0000 mgr.gibba020.yqfnwy (mgr.34427) 3793 : cluster [DBG] pgmap v2153: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:26.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:26 gibba013 bash[30381]: cluster 2021-03-10T15:04:25.464341+0000 mgr.gibba020.yqfnwy (mgr.34427) 3793 : cluster [DBG] pgmap v2153: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:26.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:26 gibba020 bash[25448]: cluster 2021-03-10T15:04:25.464341+0000 mgr.gibba020.yqfnwy (mgr.34427) 3793 : cluster [DBG] pgmap v2153: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:27.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:27 gibba013 bash[29418]: cephadm 2021-03-10T15:04:26.125677+0000 mgr.gibba020.yqfnwy (mgr.34427) 3794 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:04:27.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:27 gibba013 bash[30381]: cephadm 2021-03-10T15:04:26.125677+0000 mgr.gibba020.yqfnwy (mgr.34427) 3794 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:04:27.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:27 gibba020 bash[25448]: cephadm 2021-03-10T15:04:26.125677+0000 mgr.gibba020.yqfnwy (mgr.34427) 3794 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:04:28.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:28 gibba013 bash[29418]: cluster 2021-03-10T15:04:27.465643+0000 mgr.gibba020.yqfnwy (mgr.34427) 3795 : cluster [DBG] pgmap v2154: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:28.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:28 gibba013 bash[30381]: cluster 2021-03-10T15:04:27.465643+0000 mgr.gibba020.yqfnwy (mgr.34427) 3795 : cluster [DBG] pgmap v2154: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:28.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:28 gibba020 bash[25448]: cluster 2021-03-10T15:04:27.465643+0000 mgr.gibba020.yqfnwy (mgr.34427) 3795 : cluster [DBG] pgmap v2154: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:30.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:30 gibba013 bash[29418]: cluster 2021-03-10T15:04:29.467128+0000 mgr.gibba020.yqfnwy (mgr.34427) 3796 : cluster [DBG] pgmap v2155: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:30.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:30 gibba013 bash[30381]: cluster 2021-03-10T15:04:29.467128+0000 mgr.gibba020.yqfnwy (mgr.34427) 3796 : cluster [DBG] pgmap v2155: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:30.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:30 gibba020 bash[25448]: cluster 2021-03-10T15:04:29.467128+0000 mgr.gibba020.yqfnwy (mgr.34427) 3796 : cluster [DBG] pgmap v2155: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:32.030 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:04:32.257 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:04:32.258 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (71m) 5m ago 76m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:04:32.258 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (76m) 4m ago 76m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:04:32.258 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (71m) 4m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:04:32.258 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (71m) 4m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:04:32.259 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (70m) 5m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:04:32.259 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (70m) 5m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:04:32.259 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (70m) 4m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:04:32.259 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (70m) 5m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:04:32.260 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (76m) 5m ago 76m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:04:32.260 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (76m) 4m ago 76m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:04:32.260 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (69m) 5m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:04:32.260 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (68m) 5m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:04:32.261 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (68m) 5m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:04:32.261 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (68m) 5m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:04:32.261 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (67m) 4m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:04:32.261 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (67m) 4m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:04:32.261 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (66m) 4m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:04:32.262 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (66m) 4m ago 76m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:04:32.262 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (75m) 4m ago 76m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:04:32.262 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 4m ago 74m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:04:32.506 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:04:32.507 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:04:32.507 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:04:32.507 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:04:32.508 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:04:32.508 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:04:32.508 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:04:32.508 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:04:32.508 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:04:32.509 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:04:32.509 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:04:32.509 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:04:32.509 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:04:32.510 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:04:32.510 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:04:32.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:32 gibba013 bash[29418]: cluster 2021-03-10T15:04:31.468910+0000 mgr.gibba020.yqfnwy (mgr.34427) 3797 : cluster [DBG] pgmap v2156: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:32.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:32 gibba013 bash[29418]: audit 2021-03-10T15:04:32.503622+0000 mon.c (mon.1) 71 : audit [DBG] from='client.? 172.21.2.113:0/3998939508' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:32.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:32 gibba013 bash[30381]: cluster 2021-03-10T15:04:31.468910+0000 mgr.gibba020.yqfnwy (mgr.34427) 3797 : cluster [DBG] pgmap v2156: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:32.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:32 gibba013 bash[30381]: audit 2021-03-10T15:04:32.503622+0000 mon.c (mon.1) 71 : audit [DBG] from='client.? 172.21.2.113:0/3998939508' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:32.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:32 gibba020 bash[25448]: cluster 2021-03-10T15:04:31.468910+0000 mgr.gibba020.yqfnwy (mgr.34427) 3797 : cluster [DBG] pgmap v2156: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:32.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:32 gibba020 bash[25448]: audit 2021-03-10T15:04:32.503622+0000 mon.c (mon.1) 71 : audit [DBG] from='client.? 172.21.2.113:0/3998939508' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:33.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:33 gibba013 bash[29418]: audit 2021-03-10T15:04:32.017156+0000 mgr.gibba020.yqfnwy (mgr.34427) 3798 : audit [DBG] from='client.46608 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:04:33.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:33 gibba013 bash[29418]: audit 2021-03-10T15:04:32.241163+0000 mgr.gibba020.yqfnwy (mgr.34427) 3799 : audit [DBG] from='client.46614 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:04:33.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:33 gibba013 bash[30381]: audit 2021-03-10T15:04:32.017156+0000 mgr.gibba020.yqfnwy (mgr.34427) 3798 : audit [DBG] from='client.46608 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:04:33.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:33 gibba013 bash[30381]: audit 2021-03-10T15:04:32.241163+0000 mgr.gibba020.yqfnwy (mgr.34427) 3799 : audit [DBG] from='client.46614 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:04:33.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:33 gibba020 bash[25448]: audit 2021-03-10T15:04:32.017156+0000 mgr.gibba020.yqfnwy (mgr.34427) 3798 : audit [DBG] from='client.46608 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:04:33.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:33 gibba020 bash[25448]: audit 2021-03-10T15:04:32.241163+0000 mgr.gibba020.yqfnwy (mgr.34427) 3799 : audit [DBG] from='client.46614 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:04:34.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:34 gibba013 bash[29418]: cluster 2021-03-10T15:04:33.470508+0000 mgr.gibba020.yqfnwy (mgr.34427) 3800 : cluster [DBG] pgmap v2157: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:34.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:34 gibba013 bash[30381]: cluster 2021-03-10T15:04:33.470508+0000 mgr.gibba020.yqfnwy (mgr.34427) 3800 : cluster [DBG] pgmap v2157: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:34.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:34 gibba020 bash[25448]: cluster 2021-03-10T15:04:33.470508+0000 mgr.gibba020.yqfnwy (mgr.34427) 3800 : cluster [DBG] pgmap v2157: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:36.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:36 gibba013 bash[29418]: cluster 2021-03-10T15:04:35.472271+0000 mgr.gibba020.yqfnwy (mgr.34427) 3801 : cluster [DBG] pgmap v2158: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:36.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:36 gibba013 bash[30381]: cluster 2021-03-10T15:04:35.472271+0000 mgr.gibba020.yqfnwy (mgr.34427) 3801 : cluster [DBG] pgmap v2158: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:36.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:36 gibba020 bash[25448]: cluster 2021-03-10T15:04:35.472271+0000 mgr.gibba020.yqfnwy (mgr.34427) 3801 : cluster [DBG] pgmap v2158: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:38.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:37 gibba013 bash[29418]: cluster 2021-03-10T15:04:37.473640+0000 mgr.gibba020.yqfnwy (mgr.34427) 3802 : cluster [DBG] pgmap v2159: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:38.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:37 gibba013 bash[30381]: cluster 2021-03-10T15:04:37.473640+0000 mgr.gibba020.yqfnwy (mgr.34427) 3802 : cluster [DBG] pgmap v2159: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:38.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:37 gibba020 bash[25448]: cluster 2021-03-10T15:04:37.473640+0000 mgr.gibba020.yqfnwy (mgr.34427) 3802 : cluster [DBG] pgmap v2159: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:40.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:40 gibba013 bash[29418]: cluster 2021-03-10T15:04:39.475070+0000 mgr.gibba020.yqfnwy (mgr.34427) 3803 : cluster [DBG] pgmap v2160: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:40.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:40 gibba013 bash[30381]: cluster 2021-03-10T15:04:39.475070+0000 mgr.gibba020.yqfnwy (mgr.34427) 3803 : cluster [DBG] pgmap v2160: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:40.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:40 gibba020 bash[25448]: cluster 2021-03-10T15:04:39.475070+0000 mgr.gibba020.yqfnwy (mgr.34427) 3803 : cluster [DBG] pgmap v2160: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:41.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:41 gibba020 bash[25448]: audit 2021-03-10T15:04:41.143467+0000 mon.a (mon.0) 1692 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:04:41.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:41 gibba020 bash[25448]: audit 2021-03-10T15:04:41.357706+0000 mon.a (mon.0) 1693 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:04:41.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:41 gibba020 bash[25448]: audit 2021-03-10T15:04:41.361111+0000 mon.a (mon.0) 1694 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:04:41.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:41 gibba020 bash[25448]: audit 2021-03-10T15:04:41.364824+0000 mon.a (mon.0) 1695 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:41.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:41 gibba020 bash[25448]: audit 2021-03-10T15:04:41.367398+0000 mon.a (mon.0) 1696 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:41.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:41 gibba020 bash[25448]: audit 2021-03-10T15:04:41.369872+0000 mon.a (mon.0) 1697 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:41.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:41 gibba020 bash[25448]: audit 2021-03-10T15:04:41.374966+0000 mon.a (mon.0) 1698 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:41.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:41 gibba020 bash[25448]: audit 2021-03-10T15:04:41.378213+0000 mon.a (mon.0) 1699 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:41.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:41 gibba013 bash[30381]: audit 2021-03-10T15:04:41.143467+0000 mon.a (mon.0) 1692 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:04:41.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:41 gibba013 bash[30381]: audit 2021-03-10T15:04:41.357706+0000 mon.a (mon.0) 1693 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:04:41.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:41 gibba013 bash[30381]: audit 2021-03-10T15:04:41.361111+0000 mon.a (mon.0) 1694 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:04:41.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:41 gibba013 bash[30381]: audit 2021-03-10T15:04:41.364824+0000 mon.a (mon.0) 1695 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:41.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:41 gibba013 bash[30381]: audit 2021-03-10T15:04:41.367398+0000 mon.a (mon.0) 1696 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:41.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:41 gibba013 bash[30381]: audit 2021-03-10T15:04:41.369872+0000 mon.a (mon.0) 1697 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:41.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:41 gibba013 bash[30381]: audit 2021-03-10T15:04:41.374966+0000 mon.a (mon.0) 1698 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:41.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:41 gibba013 bash[30381]: audit 2021-03-10T15:04:41.378213+0000 mon.a (mon.0) 1699 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:41.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:41 gibba013 bash[29418]: audit 2021-03-10T15:04:41.143467+0000 mon.a (mon.0) 1692 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:04:41.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:41 gibba013 bash[29418]: audit 2021-03-10T15:04:41.357706+0000 mon.a (mon.0) 1693 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:04:41.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:41 gibba013 bash[29418]: audit 2021-03-10T15:04:41.361111+0000 mon.a (mon.0) 1694 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:04:41.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:41 gibba013 bash[29418]: audit 2021-03-10T15:04:41.364824+0000 mon.a (mon.0) 1695 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:41.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:41 gibba013 bash[29418]: audit 2021-03-10T15:04:41.367398+0000 mon.a (mon.0) 1696 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:41.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:41 gibba013 bash[29418]: audit 2021-03-10T15:04:41.369872+0000 mon.a (mon.0) 1697 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:41.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:41 gibba013 bash[29418]: audit 2021-03-10T15:04:41.374966+0000 mon.a (mon.0) 1698 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:41.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:41 gibba013 bash[29418]: audit 2021-03-10T15:04:41.378213+0000 mon.a (mon.0) 1699 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:04:42.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:42 gibba013 bash[29418]: cephadm 2021-03-10T15:04:41.148338+0000 mgr.gibba020.yqfnwy (mgr.34427) 3804 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:04:42.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:42 gibba013 bash[29418]: cephadm 2021-03-10T15:04:41.150130+0000 mgr.gibba020.yqfnwy (mgr.34427) 3805 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:04:42.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:42 gibba013 bash[29418]: cephadm 2021-03-10T15:04:41.359218+0000 mgr.gibba020.yqfnwy (mgr.34427) 3806 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:04:42.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:42 gibba013 bash[29418]: cephadm 2021-03-10T15:04:41.363009+0000 mgr.gibba020.yqfnwy (mgr.34427) 3807 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:04:42.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:42 gibba013 bash[29418]: cephadm 2021-03-10T15:04:41.365782+0000 mgr.gibba020.yqfnwy (mgr.34427) 3808 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:04:42.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:42 gibba013 bash[29418]: cephadm 2021-03-10T15:04:41.365851+0000 mgr.gibba020.yqfnwy (mgr.34427) 3809 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:04:42.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:42 gibba013 bash[29418]: cephadm 2021-03-10T15:04:41.368304+0000 mgr.gibba020.yqfnwy (mgr.34427) 3810 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:04:42.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:42 gibba013 bash[29418]: cephadm 2021-03-10T15:04:41.368348+0000 mgr.gibba020.yqfnwy (mgr.34427) 3811 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:04:42.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:42 gibba013 bash[29418]: cephadm 2021-03-10T15:04:41.370930+0000 mgr.gibba020.yqfnwy (mgr.34427) 3812 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:04:42.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:42 gibba013 bash[29418]: cephadm 2021-03-10T15:04:41.373267+0000 mgr.gibba020.yqfnwy (mgr.34427) 3813 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:04:42.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:42 gibba013 bash[29418]: cephadm 2021-03-10T15:04:41.373311+0000 mgr.gibba020.yqfnwy (mgr.34427) 3814 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:04:42.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:42 gibba013 bash[29418]: cephadm 2021-03-10T15:04:41.376069+0000 mgr.gibba020.yqfnwy (mgr.34427) 3815 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:04:42.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:42 gibba013 bash[29418]: cephadm 2021-03-10T15:04:41.376569+0000 mgr.gibba020.yqfnwy (mgr.34427) 3816 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:04:42.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:42 gibba013 bash[29418]: cephadm 2021-03-10T15:04:41.379100+0000 mgr.gibba020.yqfnwy (mgr.34427) 3817 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:04:42.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:42 gibba013 bash[29418]: cephadm 2021-03-10T15:04:41.379151+0000 mgr.gibba020.yqfnwy (mgr.34427) 3818 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:04:42.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:42 gibba013 bash[29418]: cephadm 2021-03-10T15:04:41.379293+0000 mgr.gibba020.yqfnwy (mgr.34427) 3819 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:04:42.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:42 gibba013 bash[29418]: cluster 2021-03-10T15:04:41.476650+0000 mgr.gibba020.yqfnwy (mgr.34427) 3820 : cluster [DBG] pgmap v2161: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:42.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:42 gibba013 bash[30381]: cephadm 2021-03-10T15:04:41.148338+0000 mgr.gibba020.yqfnwy (mgr.34427) 3804 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:04:42.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:42 gibba013 bash[30381]: cephadm 2021-03-10T15:04:41.150130+0000 mgr.gibba020.yqfnwy (mgr.34427) 3805 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:04:42.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:42 gibba013 bash[30381]: cephadm 2021-03-10T15:04:41.359218+0000 mgr.gibba020.yqfnwy (mgr.34427) 3806 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:04:42.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:42 gibba013 bash[30381]: cephadm 2021-03-10T15:04:41.363009+0000 mgr.gibba020.yqfnwy (mgr.34427) 3807 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:04:42.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:42 gibba013 bash[30381]: cephadm 2021-03-10T15:04:41.365782+0000 mgr.gibba020.yqfnwy (mgr.34427) 3808 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:04:42.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:42 gibba013 bash[30381]: cephadm 2021-03-10T15:04:41.365851+0000 mgr.gibba020.yqfnwy (mgr.34427) 3809 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:04:42.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:42 gibba013 bash[30381]: cephadm 2021-03-10T15:04:41.368304+0000 mgr.gibba020.yqfnwy (mgr.34427) 3810 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:04:42.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:42 gibba013 bash[30381]: cephadm 2021-03-10T15:04:41.368348+0000 mgr.gibba020.yqfnwy (mgr.34427) 3811 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:04:42.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:42 gibba013 bash[30381]: cephadm 2021-03-10T15:04:41.370930+0000 mgr.gibba020.yqfnwy (mgr.34427) 3812 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:04:42.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:42 gibba013 bash[30381]: cephadm 2021-03-10T15:04:41.373267+0000 mgr.gibba020.yqfnwy (mgr.34427) 3813 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:04:42.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:42 gibba013 bash[30381]: cephadm 2021-03-10T15:04:41.373311+0000 mgr.gibba020.yqfnwy (mgr.34427) 3814 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:04:42.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:42 gibba013 bash[30381]: cephadm 2021-03-10T15:04:41.376069+0000 mgr.gibba020.yqfnwy (mgr.34427) 3815 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:04:42.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:42 gibba013 bash[30381]: cephadm 2021-03-10T15:04:41.376569+0000 mgr.gibba020.yqfnwy (mgr.34427) 3816 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:04:42.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:42 gibba013 bash[30381]: cephadm 2021-03-10T15:04:41.379100+0000 mgr.gibba020.yqfnwy (mgr.34427) 3817 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:04:42.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:42 gibba013 bash[30381]: cephadm 2021-03-10T15:04:41.379151+0000 mgr.gibba020.yqfnwy (mgr.34427) 3818 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:04:42.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:42 gibba013 bash[30381]: cephadm 2021-03-10T15:04:41.379293+0000 mgr.gibba020.yqfnwy (mgr.34427) 3819 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:04:42.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:42 gibba013 bash[30381]: cluster 2021-03-10T15:04:41.476650+0000 mgr.gibba020.yqfnwy (mgr.34427) 3820 : cluster [DBG] pgmap v2161: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:42.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:42 gibba020 bash[25448]: cephadm 2021-03-10T15:04:41.148338+0000 mgr.gibba020.yqfnwy (mgr.34427) 3804 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:04:42.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:42 gibba020 bash[25448]: cephadm 2021-03-10T15:04:41.150130+0000 mgr.gibba020.yqfnwy (mgr.34427) 3805 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:04:42.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:42 gibba020 bash[25448]: cephadm 2021-03-10T15:04:41.359218+0000 mgr.gibba020.yqfnwy (mgr.34427) 3806 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:04:42.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:42 gibba020 bash[25448]: cephadm 2021-03-10T15:04:41.363009+0000 mgr.gibba020.yqfnwy (mgr.34427) 3807 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:04:42.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:42 gibba020 bash[25448]: cephadm 2021-03-10T15:04:41.365782+0000 mgr.gibba020.yqfnwy (mgr.34427) 3808 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:04:42.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:42 gibba020 bash[25448]: cephadm 2021-03-10T15:04:41.365851+0000 mgr.gibba020.yqfnwy (mgr.34427) 3809 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:04:42.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:42 gibba020 bash[25448]: cephadm 2021-03-10T15:04:41.368304+0000 mgr.gibba020.yqfnwy (mgr.34427) 3810 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:04:42.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:42 gibba020 bash[25448]: cephadm 2021-03-10T15:04:41.368348+0000 mgr.gibba020.yqfnwy (mgr.34427) 3811 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:04:42.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:42 gibba020 bash[25448]: cephadm 2021-03-10T15:04:41.370930+0000 mgr.gibba020.yqfnwy (mgr.34427) 3812 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:04:42.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:42 gibba020 bash[25448]: cephadm 2021-03-10T15:04:41.373267+0000 mgr.gibba020.yqfnwy (mgr.34427) 3813 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:04:42.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:42 gibba020 bash[25448]: cephadm 2021-03-10T15:04:41.373311+0000 mgr.gibba020.yqfnwy (mgr.34427) 3814 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:04:42.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:42 gibba020 bash[25448]: cephadm 2021-03-10T15:04:41.376069+0000 mgr.gibba020.yqfnwy (mgr.34427) 3815 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:04:42.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:42 gibba020 bash[25448]: cephadm 2021-03-10T15:04:41.376569+0000 mgr.gibba020.yqfnwy (mgr.34427) 3816 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:04:42.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:42 gibba020 bash[25448]: cephadm 2021-03-10T15:04:41.379100+0000 mgr.gibba020.yqfnwy (mgr.34427) 3817 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:04:42.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:42 gibba020 bash[25448]: cephadm 2021-03-10T15:04:41.379151+0000 mgr.gibba020.yqfnwy (mgr.34427) 3818 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:04:42.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:42 gibba020 bash[25448]: cephadm 2021-03-10T15:04:41.379293+0000 mgr.gibba020.yqfnwy (mgr.34427) 3819 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:04:42.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:42 gibba020 bash[25448]: cluster 2021-03-10T15:04:41.476650+0000 mgr.gibba020.yqfnwy (mgr.34427) 3820 : cluster [DBG] pgmap v2161: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:44.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:44 gibba013 bash[29418]: cluster 2021-03-10T15:04:43.478290+0000 mgr.gibba020.yqfnwy (mgr.34427) 3821 : cluster [DBG] pgmap v2162: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:44.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:44 gibba013 bash[30381]: cluster 2021-03-10T15:04:43.478290+0000 mgr.gibba020.yqfnwy (mgr.34427) 3821 : cluster [DBG] pgmap v2162: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:44.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:44 gibba020 bash[25448]: cluster 2021-03-10T15:04:43.478290+0000 mgr.gibba020.yqfnwy (mgr.34427) 3821 : cluster [DBG] pgmap v2162: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:46.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:46 gibba013 bash[29418]: cluster 2021-03-10T15:04:45.479706+0000 mgr.gibba020.yqfnwy (mgr.34427) 3822 : cluster [DBG] pgmap v2163: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:46.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:46 gibba013 bash[30381]: cluster 2021-03-10T15:04:45.479706+0000 mgr.gibba020.yqfnwy (mgr.34427) 3822 : cluster [DBG] pgmap v2163: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:46.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:46 gibba020 bash[25448]: cluster 2021-03-10T15:04:45.479706+0000 mgr.gibba020.yqfnwy (mgr.34427) 3822 : cluster [DBG] pgmap v2163: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:48.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:47 gibba013 bash[29418]: cluster 2021-03-10T15:04:47.481071+0000 mgr.gibba020.yqfnwy (mgr.34427) 3823 : cluster [DBG] pgmap v2164: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:48.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:47 gibba013 bash[30381]: cluster 2021-03-10T15:04:47.481071+0000 mgr.gibba020.yqfnwy (mgr.34427) 3823 : cluster [DBG] pgmap v2164: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:48.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:47 gibba020 bash[25448]: cluster 2021-03-10T15:04:47.481071+0000 mgr.gibba020.yqfnwy (mgr.34427) 3823 : cluster [DBG] pgmap v2164: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:50.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:50 gibba013 bash[29418]: cluster 2021-03-10T15:04:49.482546+0000 mgr.gibba020.yqfnwy (mgr.34427) 3824 : cluster [DBG] pgmap v2165: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:50.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:50 gibba013 bash[30381]: cluster 2021-03-10T15:04:49.482546+0000 mgr.gibba020.yqfnwy (mgr.34427) 3824 : cluster [DBG] pgmap v2165: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:50.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:50 gibba020 bash[25448]: cluster 2021-03-10T15:04:49.482546+0000 mgr.gibba020.yqfnwy (mgr.34427) 3824 : cluster [DBG] pgmap v2165: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:52.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:52 gibba013 bash[29418]: cluster 2021-03-10T15:04:51.484376+0000 mgr.gibba020.yqfnwy (mgr.34427) 3825 : cluster [DBG] pgmap v2166: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:52.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:52 gibba013 bash[30381]: cluster 2021-03-10T15:04:51.484376+0000 mgr.gibba020.yqfnwy (mgr.34427) 3825 : cluster [DBG] pgmap v2166: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:52.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:52 gibba020 bash[25448]: cluster 2021-03-10T15:04:51.484376+0000 mgr.gibba020.yqfnwy (mgr.34427) 3825 : cluster [DBG] pgmap v2166: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:54.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:54 gibba013 bash[29418]: cluster 2021-03-10T15:04:53.485791+0000 mgr.gibba020.yqfnwy (mgr.34427) 3826 : cluster [DBG] pgmap v2167: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:54.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:54 gibba013 bash[30381]: cluster 2021-03-10T15:04:53.485791+0000 mgr.gibba020.yqfnwy (mgr.34427) 3826 : cluster [DBG] pgmap v2167: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:54.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:54 gibba020 bash[25448]: cluster 2021-03-10T15:04:53.485791+0000 mgr.gibba020.yqfnwy (mgr.34427) 3826 : cluster [DBG] pgmap v2167: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:56.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:56 gibba020 bash[25448]: cluster 2021-03-10T15:04:55.487452+0000 mgr.gibba020.yqfnwy (mgr.34427) 3827 : cluster [DBG] pgmap v2168: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:56.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:56 gibba013 bash[29418]: cluster 2021-03-10T15:04:55.487452+0000 mgr.gibba020.yqfnwy (mgr.34427) 3827 : cluster [DBG] pgmap v2168: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:56.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:56 gibba013 bash[30381]: cluster 2021-03-10T15:04:55.487452+0000 mgr.gibba020.yqfnwy (mgr.34427) 3827 : cluster [DBG] pgmap v2168: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:57.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:57 gibba013 bash[29418]: cephadm 2021-03-10T15:04:56.395301+0000 mgr.gibba020.yqfnwy (mgr.34427) 3828 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:04:57.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:57 gibba013 bash[30381]: cephadm 2021-03-10T15:04:56.395301+0000 mgr.gibba020.yqfnwy (mgr.34427) 3828 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:04:57.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:57 gibba020 bash[25448]: cephadm 2021-03-10T15:04:56.395301+0000 mgr.gibba020.yqfnwy (mgr.34427) 3828 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:04:58.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:04:58 gibba013 bash[29418]: cluster 2021-03-10T15:04:57.488777+0000 mgr.gibba020.yqfnwy (mgr.34427) 3829 : cluster [DBG] pgmap v2169: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:58.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:04:58 gibba013 bash[30381]: cluster 2021-03-10T15:04:57.488777+0000 mgr.gibba020.yqfnwy (mgr.34427) 3829 : cluster [DBG] pgmap v2169: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:04:58.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:04:58 gibba020 bash[25448]: cluster 2021-03-10T15:04:57.488777+0000 mgr.gibba020.yqfnwy (mgr.34427) 3829 : cluster [DBG] pgmap v2169: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:00.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:00 gibba013 bash[29418]: cluster 2021-03-10T15:04:59.490029+0000 mgr.gibba020.yqfnwy (mgr.34427) 3830 : cluster [DBG] pgmap v2170: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:00.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:00 gibba013 bash[30381]: cluster 2021-03-10T15:04:59.490029+0000 mgr.gibba020.yqfnwy (mgr.34427) 3830 : cluster [DBG] pgmap v2170: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:00.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:00 gibba020 bash[25448]: cluster 2021-03-10T15:04:59.490029+0000 mgr.gibba020.yqfnwy (mgr.34427) 3830 : cluster [DBG] pgmap v2170: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:02.756 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:05:02.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:02 gibba013 bash[29418]: cluster 2021-03-10T15:05:01.491867+0000 mgr.gibba020.yqfnwy (mgr.34427) 3831 : cluster [DBG] pgmap v2171: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:02.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:02 gibba013 bash[30381]: cluster 2021-03-10T15:05:01.491867+0000 mgr.gibba020.yqfnwy (mgr.34427) 3831 : cluster [DBG] pgmap v2171: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:02.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:02 gibba020 bash[25448]: cluster 2021-03-10T15:05:01.491867+0000 mgr.gibba020.yqfnwy (mgr.34427) 3831 : cluster [DBG] pgmap v2171: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:02.984 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:05:02.984 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (71m) 6m ago 76m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:05:02.985 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (76m) 5m ago 76m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:05:02.985 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (71m) 5m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:05:02.986 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (72m) 5m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:05:02.986 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (71m) 6m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:05:02.987 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (71m) 6m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:05:02.987 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (70m) 5m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:05:02.988 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (70m) 6m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:05:02.988 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (77m) 6m ago 77m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:05:02.989 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (77m) 5m ago 77m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:05:02.989 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (69m) 6m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:05:02.989 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (69m) 6m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:05:02.990 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (68m) 6m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:05:02.990 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (68m) 6m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:05:02.991 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (68m) 5m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:05:02.991 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (67m) 5m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:05:02.992 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (67m) 5m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:05:02.992 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (66m) 5m ago 77m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:05:02.992 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (76m) 5m ago 77m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:05:02.993 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 5m ago 75m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:05:03.230 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:05:03.230 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:05:03.230 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:05:03.231 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:05:03.231 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:05:03.231 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:05:03.231 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:05:03.232 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:05:03.232 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:05:03.232 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:05:03.232 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:05:03.233 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:05:03.233 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:05:03.233 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:05:03.233 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:05:03.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:03 gibba013 bash[29418]: audit 2021-03-10T15:05:03.227102+0000 mon.a (mon.0) 1700 : audit [DBG] from='client.? 172.21.2.113:0/4114374356' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:03.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:03 gibba013 bash[30381]: audit 2021-03-10T15:05:03.227102+0000 mon.a (mon.0) 1700 : audit [DBG] from='client.? 172.21.2.113:0/4114374356' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:03.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:03 gibba020 bash[25448]: audit 2021-03-10T15:05:03.227102+0000 mon.a (mon.0) 1700 : audit [DBG] from='client.? 172.21.2.113:0/4114374356' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:04.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:04 gibba013 bash[29418]: audit 2021-03-10T15:05:02.742727+0000 mgr.gibba020.yqfnwy (mgr.34427) 3832 : audit [DBG] from='client.56611 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:05:04.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:04 gibba013 bash[29418]: audit 2021-03-10T15:05:02.967870+0000 mgr.gibba020.yqfnwy (mgr.34427) 3833 : audit [DBG] from='client.46632 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:05:04.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:04 gibba013 bash[29418]: cluster 2021-03-10T15:05:03.493239+0000 mgr.gibba020.yqfnwy (mgr.34427) 3834 : cluster [DBG] pgmap v2172: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:04.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:04 gibba013 bash[30381]: audit 2021-03-10T15:05:02.742727+0000 mgr.gibba020.yqfnwy (mgr.34427) 3832 : audit [DBG] from='client.56611 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:05:04.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:04 gibba013 bash[30381]: audit 2021-03-10T15:05:02.967870+0000 mgr.gibba020.yqfnwy (mgr.34427) 3833 : audit [DBG] from='client.46632 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:05:04.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:04 gibba013 bash[30381]: cluster 2021-03-10T15:05:03.493239+0000 mgr.gibba020.yqfnwy (mgr.34427) 3834 : cluster [DBG] pgmap v2172: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:04.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:04 gibba020 bash[25448]: audit 2021-03-10T15:05:02.742727+0000 mgr.gibba020.yqfnwy (mgr.34427) 3832 : audit [DBG] from='client.56611 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:05:04.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:04 gibba020 bash[25448]: audit 2021-03-10T15:05:02.967870+0000 mgr.gibba020.yqfnwy (mgr.34427) 3833 : audit [DBG] from='client.46632 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:05:04.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:04 gibba020 bash[25448]: cluster 2021-03-10T15:05:03.493239+0000 mgr.gibba020.yqfnwy (mgr.34427) 3834 : cluster [DBG] pgmap v2172: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:06 gibba013 bash[29418]: cluster 2021-03-10T15:05:05.494794+0000 mgr.gibba020.yqfnwy (mgr.34427) 3835 : cluster [DBG] pgmap v2173: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:06 gibba013 bash[29418]: audit 2021-03-10T15:05:06.335035+0000 mon.a (mon.0) 1701 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:05:06.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:06 gibba013 bash[29418]: audit 2021-03-10T15:05:06.364179+0000 mon.a (mon.0) 1702 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:05:06.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:06 gibba013 bash[29418]: audit 2021-03-10T15:05:06.419051+0000 mon.a (mon.0) 1703 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:05:06.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:06 gibba013 bash[29418]: audit 2021-03-10T15:05:06.419202+0000 mon.a (mon.0) 1704 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:05:06.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:06 gibba013 bash[29418]: audit 2021-03-10T15:05:06.419325+0000 mon.a (mon.0) 1705 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:05:06.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:06 gibba013 bash[29418]: audit 2021-03-10T15:05:06.419417+0000 mon.a (mon.0) 1706 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:05:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:06 gibba013 bash[30381]: cluster 2021-03-10T15:05:05.494794+0000 mgr.gibba020.yqfnwy (mgr.34427) 3835 : cluster [DBG] pgmap v2173: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:06 gibba013 bash[30381]: audit 2021-03-10T15:05:06.335035+0000 mon.a (mon.0) 1701 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:05:06.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:06 gibba013 bash[30381]: audit 2021-03-10T15:05:06.364179+0000 mon.a (mon.0) 1702 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:05:06.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:06 gibba013 bash[30381]: audit 2021-03-10T15:05:06.419051+0000 mon.a (mon.0) 1703 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:05:06.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:06 gibba013 bash[30381]: audit 2021-03-10T15:05:06.419202+0000 mon.a (mon.0) 1704 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:05:06.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:06 gibba013 bash[30381]: audit 2021-03-10T15:05:06.419325+0000 mon.a (mon.0) 1705 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:05:06.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:06 gibba013 bash[30381]: audit 2021-03-10T15:05:06.419417+0000 mon.a (mon.0) 1706 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:05:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:06 gibba020 bash[25448]: cluster 2021-03-10T15:05:05.494794+0000 mgr.gibba020.yqfnwy (mgr.34427) 3835 : cluster [DBG] pgmap v2173: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:06 gibba020 bash[25448]: audit 2021-03-10T15:05:06.335035+0000 mon.a (mon.0) 1701 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:05:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:06 gibba020 bash[25448]: audit 2021-03-10T15:05:06.364179+0000 mon.a (mon.0) 1702 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:05:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:06 gibba020 bash[25448]: audit 2021-03-10T15:05:06.419051+0000 mon.a (mon.0) 1703 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:05:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:06 gibba020 bash[25448]: audit 2021-03-10T15:05:06.419202+0000 mon.a (mon.0) 1704 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:05:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:06 gibba020 bash[25448]: audit 2021-03-10T15:05:06.419325+0000 mon.a (mon.0) 1705 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:05:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:06 gibba020 bash[25448]: audit 2021-03-10T15:05:06.419417+0000 mon.a (mon.0) 1706 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:05:08.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:07 gibba013 bash[29418]: cluster 2021-03-10T15:05:07.496483+0000 mgr.gibba020.yqfnwy (mgr.34427) 3836 : cluster [DBG] pgmap v2174: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:08.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:07 gibba013 bash[30381]: cluster 2021-03-10T15:05:07.496483+0000 mgr.gibba020.yqfnwy (mgr.34427) 3836 : cluster [DBG] pgmap v2174: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:08.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:07 gibba020 bash[25448]: cluster 2021-03-10T15:05:07.496483+0000 mgr.gibba020.yqfnwy (mgr.34427) 3836 : cluster [DBG] pgmap v2174: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:10.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:10 gibba013 bash[29418]: cluster 2021-03-10T15:05:09.497709+0000 mgr.gibba020.yqfnwy (mgr.34427) 3837 : cluster [DBG] pgmap v2175: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:10.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:10 gibba013 bash[30381]: cluster 2021-03-10T15:05:09.497709+0000 mgr.gibba020.yqfnwy (mgr.34427) 3837 : cluster [DBG] pgmap v2175: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:10.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:10 gibba020 bash[25448]: cluster 2021-03-10T15:05:09.497709+0000 mgr.gibba020.yqfnwy (mgr.34427) 3837 : cluster [DBG] pgmap v2175: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:12.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:12 gibba013 bash[29418]: cephadm 2021-03-10T15:05:11.407503+0000 mgr.gibba020.yqfnwy (mgr.34427) 3838 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:05:12.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:12 gibba013 bash[29418]: cluster 2021-03-10T15:05:11.499512+0000 mgr.gibba020.yqfnwy (mgr.34427) 3839 : cluster [DBG] pgmap v2176: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:12.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:12 gibba013 bash[30381]: cephadm 2021-03-10T15:05:11.407503+0000 mgr.gibba020.yqfnwy (mgr.34427) 3838 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:05:12.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:12 gibba013 bash[30381]: cluster 2021-03-10T15:05:11.499512+0000 mgr.gibba020.yqfnwy (mgr.34427) 3839 : cluster [DBG] pgmap v2176: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:12.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:12 gibba020 bash[25448]: cephadm 2021-03-10T15:05:11.407503+0000 mgr.gibba020.yqfnwy (mgr.34427) 3838 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:05:12.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:12 gibba020 bash[25448]: cluster 2021-03-10T15:05:11.499512+0000 mgr.gibba020.yqfnwy (mgr.34427) 3839 : cluster [DBG] pgmap v2176: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:14.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:14 gibba013 bash[29418]: cluster 2021-03-10T15:05:13.500937+0000 mgr.gibba020.yqfnwy (mgr.34427) 3840 : cluster [DBG] pgmap v2177: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:14.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:14 gibba013 bash[30381]: cluster 2021-03-10T15:05:13.500937+0000 mgr.gibba020.yqfnwy (mgr.34427) 3840 : cluster [DBG] pgmap v2177: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:14.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:14 gibba020 bash[25448]: cluster 2021-03-10T15:05:13.500937+0000 mgr.gibba020.yqfnwy (mgr.34427) 3840 : cluster [DBG] pgmap v2177: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:16.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:16 gibba013 bash[29418]: cluster 2021-03-10T15:05:15.502600+0000 mgr.gibba020.yqfnwy (mgr.34427) 3841 : cluster [DBG] pgmap v2178: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:16.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:16 gibba013 bash[30381]: cluster 2021-03-10T15:05:15.502600+0000 mgr.gibba020.yqfnwy (mgr.34427) 3841 : cluster [DBG] pgmap v2178: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:16.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:16 gibba020 bash[25448]: cluster 2021-03-10T15:05:15.502600+0000 mgr.gibba020.yqfnwy (mgr.34427) 3841 : cluster [DBG] pgmap v2178: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:18.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:17 gibba013 bash[29418]: cluster 2021-03-10T15:05:17.504037+0000 mgr.gibba020.yqfnwy (mgr.34427) 3842 : cluster [DBG] pgmap v2179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:18.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:17 gibba013 bash[30381]: cluster 2021-03-10T15:05:17.504037+0000 mgr.gibba020.yqfnwy (mgr.34427) 3842 : cluster [DBG] pgmap v2179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:18.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:17 gibba020 bash[25448]: cluster 2021-03-10T15:05:17.504037+0000 mgr.gibba020.yqfnwy (mgr.34427) 3842 : cluster [DBG] pgmap v2179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:20.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:20 gibba013 bash[29418]: cluster 2021-03-10T15:05:19.505279+0000 mgr.gibba020.yqfnwy (mgr.34427) 3843 : cluster [DBG] pgmap v2180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:20.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:20 gibba013 bash[30381]: cluster 2021-03-10T15:05:19.505279+0000 mgr.gibba020.yqfnwy (mgr.34427) 3843 : cluster [DBG] pgmap v2180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:20.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:20 gibba020 bash[25448]: cluster 2021-03-10T15:05:19.505279+0000 mgr.gibba020.yqfnwy (mgr.34427) 3843 : cluster [DBG] pgmap v2180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:22.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:22 gibba013 bash[29418]: cluster 2021-03-10T15:05:21.507344+0000 mgr.gibba020.yqfnwy (mgr.34427) 3844 : cluster [DBG] pgmap v2181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:22.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:22 gibba013 bash[30381]: cluster 2021-03-10T15:05:21.507344+0000 mgr.gibba020.yqfnwy (mgr.34427) 3844 : cluster [DBG] pgmap v2181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:22.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:22 gibba020 bash[25448]: cluster 2021-03-10T15:05:21.507344+0000 mgr.gibba020.yqfnwy (mgr.34427) 3844 : cluster [DBG] pgmap v2181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:24.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:24 gibba013 bash[29418]: cluster 2021-03-10T15:05:23.508971+0000 mgr.gibba020.yqfnwy (mgr.34427) 3845 : cluster [DBG] pgmap v2182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:24.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:24 gibba013 bash[30381]: cluster 2021-03-10T15:05:23.508971+0000 mgr.gibba020.yqfnwy (mgr.34427) 3845 : cluster [DBG] pgmap v2182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:24.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:24 gibba020 bash[25448]: cluster 2021-03-10T15:05:23.508971+0000 mgr.gibba020.yqfnwy (mgr.34427) 3845 : cluster [DBG] pgmap v2182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:26.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:26 gibba020 bash[25448]: cluster 2021-03-10T15:05:25.510830+0000 mgr.gibba020.yqfnwy (mgr.34427) 3846 : cluster [DBG] pgmap v2183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:26.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:26 gibba013 bash[29418]: cluster 2021-03-10T15:05:25.510830+0000 mgr.gibba020.yqfnwy (mgr.34427) 3846 : cluster [DBG] pgmap v2183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:26.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:26 gibba013 bash[30381]: cluster 2021-03-10T15:05:25.510830+0000 mgr.gibba020.yqfnwy (mgr.34427) 3846 : cluster [DBG] pgmap v2183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:27.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:27 gibba013 bash[29418]: cephadm 2021-03-10T15:05:26.423295+0000 mgr.gibba020.yqfnwy (mgr.34427) 3847 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:05:27.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:27 gibba013 bash[30381]: cephadm 2021-03-10T15:05:26.423295+0000 mgr.gibba020.yqfnwy (mgr.34427) 3847 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:05:27.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:27 gibba020 bash[25448]: cephadm 2021-03-10T15:05:26.423295+0000 mgr.gibba020.yqfnwy (mgr.34427) 3847 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:05:28.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:28 gibba013 bash[29418]: cluster 2021-03-10T15:05:27.512443+0000 mgr.gibba020.yqfnwy (mgr.34427) 3848 : cluster [DBG] pgmap v2184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:28.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:28 gibba013 bash[30381]: cluster 2021-03-10T15:05:27.512443+0000 mgr.gibba020.yqfnwy (mgr.34427) 3848 : cluster [DBG] pgmap v2184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:28.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:28 gibba020 bash[25448]: cluster 2021-03-10T15:05:27.512443+0000 mgr.gibba020.yqfnwy (mgr.34427) 3848 : cluster [DBG] pgmap v2184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:30.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:30 gibba013 bash[29418]: cluster 2021-03-10T15:05:29.513808+0000 mgr.gibba020.yqfnwy (mgr.34427) 3849 : cluster [DBG] pgmap v2185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:30.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:30 gibba013 bash[30381]: cluster 2021-03-10T15:05:29.513808+0000 mgr.gibba020.yqfnwy (mgr.34427) 3849 : cluster [DBG] pgmap v2185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:30.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:30 gibba020 bash[25448]: cluster 2021-03-10T15:05:29.513808+0000 mgr.gibba020.yqfnwy (mgr.34427) 3849 : cluster [DBG] pgmap v2185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:32.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:32 gibba013 bash[29418]: cluster 2021-03-10T15:05:31.515519+0000 mgr.gibba020.yqfnwy (mgr.34427) 3850 : cluster [DBG] pgmap v2186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:32.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:32 gibba013 bash[30381]: cluster 2021-03-10T15:05:31.515519+0000 mgr.gibba020.yqfnwy (mgr.34427) 3850 : cluster [DBG] pgmap v2186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:32.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:32 gibba020 bash[25448]: cluster 2021-03-10T15:05:31.515519+0000 mgr.gibba020.yqfnwy (mgr.34427) 3850 : cluster [DBG] pgmap v2186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:33.471 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:05:33.703 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:05:33.703 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (72m) 6m ago 77m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:05:33.703 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (77m) 5m ago 77m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:05:33.704 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (72m) 5m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:05:33.704 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (72m) 5m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:05:33.704 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (71m) 6m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:05:33.704 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (71m) 6m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:05:33.705 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (71m) 5m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:05:33.705 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (71m) 6m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:05:33.705 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (77m) 6m ago 77m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:05:33.705 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (77m) 5m ago 77m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:05:33.706 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (70m) 6m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:05:33.706 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (69m) 6m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:05:33.706 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (69m) 6m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:05:33.706 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (69m) 6m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:05:33.706 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (68m) 5m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:05:33.707 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (68m) 5m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:05:33.707 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (67m) 5m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:05:33.707 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (67m) 5m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:05:33.707 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (76m) 5m ago 77m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:05:33.708 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 5m ago 75m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:05:33.956 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:05:33.956 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:05:33.956 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:05:33.957 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:05:33.957 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:05:33.957 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:05:33.957 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:05:33.958 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:05:33.958 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:05:33.958 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:05:33.958 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:05:33.959 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:05:33.959 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:05:33.959 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:05:33.959 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:05:34.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:34 gibba013 bash[29418]: audit 2021-03-10T15:05:33.457802+0000 mgr.gibba020.yqfnwy (mgr.34427) 3851 : audit [DBG] from='client.46644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:05:34.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:34 gibba013 bash[29418]: cluster 2021-03-10T15:05:33.517078+0000 mgr.gibba020.yqfnwy (mgr.34427) 3852 : cluster [DBG] pgmap v2187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:34.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:34 gibba013 bash[29418]: audit 2021-03-10T15:05:33.686817+0000 mgr.gibba020.yqfnwy (mgr.34427) 3853 : audit [DBG] from='client.46650 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:05:34.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:34 gibba013 bash[29418]: audit 2021-03-10T15:05:33.952671+0000 mon.c (mon.1) 72 : audit [DBG] from='client.? 172.21.2.113:0/1502156345' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:34.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:34 gibba013 bash[30381]: audit 2021-03-10T15:05:33.457802+0000 mgr.gibba020.yqfnwy (mgr.34427) 3851 : audit [DBG] from='client.46644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:05:34.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:34 gibba013 bash[30381]: cluster 2021-03-10T15:05:33.517078+0000 mgr.gibba020.yqfnwy (mgr.34427) 3852 : cluster [DBG] pgmap v2187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:34.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:34 gibba013 bash[30381]: audit 2021-03-10T15:05:33.686817+0000 mgr.gibba020.yqfnwy (mgr.34427) 3853 : audit [DBG] from='client.46650 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:05:34.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:34 gibba013 bash[30381]: audit 2021-03-10T15:05:33.952671+0000 mon.c (mon.1) 72 : audit [DBG] from='client.? 172.21.2.113:0/1502156345' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:34.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:34 gibba020 bash[25448]: audit 2021-03-10T15:05:33.457802+0000 mgr.gibba020.yqfnwy (mgr.34427) 3851 : audit [DBG] from='client.46644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:05:34.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:34 gibba020 bash[25448]: cluster 2021-03-10T15:05:33.517078+0000 mgr.gibba020.yqfnwy (mgr.34427) 3852 : cluster [DBG] pgmap v2187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:34.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:34 gibba020 bash[25448]: audit 2021-03-10T15:05:33.686817+0000 mgr.gibba020.yqfnwy (mgr.34427) 3853 : audit [DBG] from='client.46650 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:05:34.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:34 gibba020 bash[25448]: audit 2021-03-10T15:05:33.952671+0000 mon.c (mon.1) 72 : audit [DBG] from='client.? 172.21.2.113:0/1502156345' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:36.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:36 gibba020 bash[25448]: cluster 2021-03-10T15:05:35.518636+0000 mgr.gibba020.yqfnwy (mgr.34427) 3854 : cluster [DBG] pgmap v2188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:37.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:36 gibba013 bash[29418]: cluster 2021-03-10T15:05:35.518636+0000 mgr.gibba020.yqfnwy (mgr.34427) 3854 : cluster [DBG] pgmap v2188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:37.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:36 gibba013 bash[30381]: cluster 2021-03-10T15:05:35.518636+0000 mgr.gibba020.yqfnwy (mgr.34427) 3854 : cluster [DBG] pgmap v2188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:38.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:37 gibba013 bash[29418]: cluster 2021-03-10T15:05:37.520084+0000 mgr.gibba020.yqfnwy (mgr.34427) 3855 : cluster [DBG] pgmap v2189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:38.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:37 gibba013 bash[30381]: cluster 2021-03-10T15:05:37.520084+0000 mgr.gibba020.yqfnwy (mgr.34427) 3855 : cluster [DBG] pgmap v2189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:38.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:37 gibba020 bash[25448]: cluster 2021-03-10T15:05:37.520084+0000 mgr.gibba020.yqfnwy (mgr.34427) 3855 : cluster [DBG] pgmap v2189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:40.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:40 gibba013 bash[29418]: cluster 2021-03-10T15:05:39.521572+0000 mgr.gibba020.yqfnwy (mgr.34427) 3856 : cluster [DBG] pgmap v2190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:40.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:40 gibba013 bash[30381]: cluster 2021-03-10T15:05:39.521572+0000 mgr.gibba020.yqfnwy (mgr.34427) 3856 : cluster [DBG] pgmap v2190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:40.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:40 gibba020 bash[25448]: cluster 2021-03-10T15:05:39.521572+0000 mgr.gibba020.yqfnwy (mgr.34427) 3856 : cluster [DBG] pgmap v2190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:41.869 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:41 gibba020 bash[25448]: audit 2021-03-10T15:05:41.441726+0000 mon.a (mon.0) 1707 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:05:41.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:41 gibba013 bash[29418]: audit 2021-03-10T15:05:41.441726+0000 mon.a (mon.0) 1707 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:05:41.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:41 gibba013 bash[30381]: audit 2021-03-10T15:05:41.441726+0000 mon.a (mon.0) 1707 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:05:42.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:42 gibba020 bash[25448]: cluster 2021-03-10T15:05:41.522117+0000 mgr.gibba020.yqfnwy (mgr.34427) 3857 : cluster [DBG] pgmap v2191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:42.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:42 gibba020 bash[25448]: cephadm 2021-03-10T15:05:41.650630+0000 mgr.gibba020.yqfnwy (mgr.34427) 3858 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:05:42.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:42 gibba020 bash[25448]: audit 2021-03-10T15:05:41.650952+0000 mon.a (mon.0) 1708 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:05:42.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:42 gibba020 bash[25448]: cephadm 2021-03-10T15:05:41.661450+0000 mgr.gibba020.yqfnwy (mgr.34427) 3859 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:05:42.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:42 gibba020 bash[25448]: audit 2021-03-10T15:05:41.661908+0000 mon.a (mon.0) 1709 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:05:42.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:42 gibba020 bash[25448]: audit 2021-03-10T15:05:41.851799+0000 mon.a (mon.0) 1710 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:05:42.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:42 gibba020 bash[25448]: audit 2021-03-10T15:05:41.855517+0000 mon.a (mon.0) 1711 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:05:42.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:42 gibba020 bash[25448]: audit 2021-03-10T15:05:41.857233+0000 mon.a (mon.0) 1712 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:42.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:42 gibba020 bash[25448]: audit 2021-03-10T15:05:41.858797+0000 mon.a (mon.0) 1713 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:42.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:42 gibba020 bash[25448]: audit 2021-03-10T15:05:41.860230+0000 mon.a (mon.0) 1714 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:42.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:42 gibba020 bash[25448]: audit 2021-03-10T15:05:41.863460+0000 mon.a (mon.0) 1715 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:42.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:42 gibba020 bash[25448]: audit 2021-03-10T15:05:41.865475+0000 mon.a (mon.0) 1716 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:43.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:42 gibba013 bash[29418]: cluster 2021-03-10T15:05:41.522117+0000 mgr.gibba020.yqfnwy (mgr.34427) 3857 : cluster [DBG] pgmap v2191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:43.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:42 gibba013 bash[29418]: cephadm 2021-03-10T15:05:41.650630+0000 mgr.gibba020.yqfnwy (mgr.34427) 3858 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:05:43.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:42 gibba013 bash[29418]: audit 2021-03-10T15:05:41.650952+0000 mon.a (mon.0) 1708 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:05:43.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:42 gibba013 bash[29418]: cephadm 2021-03-10T15:05:41.661450+0000 mgr.gibba020.yqfnwy (mgr.34427) 3859 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:05:43.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:42 gibba013 bash[29418]: audit 2021-03-10T15:05:41.661908+0000 mon.a (mon.0) 1709 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:05:43.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:42 gibba013 bash[29418]: audit 2021-03-10T15:05:41.851799+0000 mon.a (mon.0) 1710 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:05:43.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:42 gibba013 bash[29418]: audit 2021-03-10T15:05:41.855517+0000 mon.a (mon.0) 1711 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:05:43.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:42 gibba013 bash[29418]: audit 2021-03-10T15:05:41.857233+0000 mon.a (mon.0) 1712 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:43.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:42 gibba013 bash[29418]: audit 2021-03-10T15:05:41.858797+0000 mon.a (mon.0) 1713 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:43.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:42 gibba013 bash[29418]: audit 2021-03-10T15:05:41.860230+0000 mon.a (mon.0) 1714 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:43.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:42 gibba013 bash[29418]: audit 2021-03-10T15:05:41.863460+0000 mon.a (mon.0) 1715 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:43.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:42 gibba013 bash[29418]: audit 2021-03-10T15:05:41.865475+0000 mon.a (mon.0) 1716 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:43.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:42 gibba013 bash[30381]: cluster 2021-03-10T15:05:41.522117+0000 mgr.gibba020.yqfnwy (mgr.34427) 3857 : cluster [DBG] pgmap v2191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:43.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:42 gibba013 bash[30381]: cephadm 2021-03-10T15:05:41.650630+0000 mgr.gibba020.yqfnwy (mgr.34427) 3858 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:05:43.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:42 gibba013 bash[30381]: audit 2021-03-10T15:05:41.650952+0000 mon.a (mon.0) 1708 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:05:43.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:42 gibba013 bash[30381]: cephadm 2021-03-10T15:05:41.661450+0000 mgr.gibba020.yqfnwy (mgr.34427) 3859 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:05:43.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:42 gibba013 bash[30381]: audit 2021-03-10T15:05:41.661908+0000 mon.a (mon.0) 1709 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:05:43.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:42 gibba013 bash[30381]: audit 2021-03-10T15:05:41.851799+0000 mon.a (mon.0) 1710 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:05:43.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:42 gibba013 bash[30381]: audit 2021-03-10T15:05:41.855517+0000 mon.a (mon.0) 1711 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:05:43.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:42 gibba013 bash[30381]: audit 2021-03-10T15:05:41.857233+0000 mon.a (mon.0) 1712 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:43.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:42 gibba013 bash[30381]: audit 2021-03-10T15:05:41.858797+0000 mon.a (mon.0) 1713 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:43.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:42 gibba013 bash[30381]: audit 2021-03-10T15:05:41.860230+0000 mon.a (mon.0) 1714 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:43.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:42 gibba013 bash[30381]: audit 2021-03-10T15:05:41.863460+0000 mon.a (mon.0) 1715 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:43.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:42 gibba013 bash[30381]: audit 2021-03-10T15:05:41.865475+0000 mon.a (mon.0) 1716 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:05:43.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:43 gibba020 bash[25448]: cephadm 2021-03-10T15:05:41.853789+0000 mgr.gibba020.yqfnwy (mgr.34427) 3860 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:05:43.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:43 gibba020 bash[25448]: cephadm 2021-03-10T15:05:41.855751+0000 mgr.gibba020.yqfnwy (mgr.34427) 3861 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:05:43.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:43 gibba020 bash[25448]: cephadm 2021-03-10T15:05:41.857236+0000 mgr.gibba020.yqfnwy (mgr.34427) 3862 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:05:43.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:43 gibba020 bash[25448]: cephadm 2021-03-10T15:05:41.857283+0000 mgr.gibba020.yqfnwy (mgr.34427) 3863 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:05:43.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:43 gibba020 bash[25448]: cephadm 2021-03-10T15:05:41.858854+0000 mgr.gibba020.yqfnwy (mgr.34427) 3864 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:05:43.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:43 gibba020 bash[25448]: cephadm 2021-03-10T15:05:41.858905+0000 mgr.gibba020.yqfnwy (mgr.34427) 3865 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:05:43.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:43 gibba020 bash[25448]: cephadm 2021-03-10T15:05:41.860358+0000 mgr.gibba020.yqfnwy (mgr.34427) 3866 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:05:43.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:43 gibba020 bash[25448]: cephadm 2021-03-10T15:05:41.861666+0000 mgr.gibba020.yqfnwy (mgr.34427) 3867 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:05:43.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:43 gibba020 bash[25448]: cephadm 2021-03-10T15:05:41.861720+0000 mgr.gibba020.yqfnwy (mgr.34427) 3868 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:05:43.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:43 gibba020 bash[25448]: cephadm 2021-03-10T15:05:41.863615+0000 mgr.gibba020.yqfnwy (mgr.34427) 3869 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:05:43.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:43 gibba020 bash[25448]: cephadm 2021-03-10T15:05:41.864084+0000 mgr.gibba020.yqfnwy (mgr.34427) 3870 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:05:43.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:43 gibba020 bash[25448]: cephadm 2021-03-10T15:05:41.865766+0000 mgr.gibba020.yqfnwy (mgr.34427) 3871 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:05:43.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:43 gibba020 bash[25448]: cephadm 2021-03-10T15:05:41.865827+0000 mgr.gibba020.yqfnwy (mgr.34427) 3872 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:05:43.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:43 gibba020 bash[25448]: cephadm 2021-03-10T15:05:41.865993+0000 mgr.gibba020.yqfnwy (mgr.34427) 3873 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:05:44.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:43 gibba013 bash[29418]: cephadm 2021-03-10T15:05:41.853789+0000 mgr.gibba020.yqfnwy (mgr.34427) 3860 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:05:44.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:43 gibba013 bash[29418]: cephadm 2021-03-10T15:05:41.855751+0000 mgr.gibba020.yqfnwy (mgr.34427) 3861 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:05:44.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:43 gibba013 bash[29418]: cephadm 2021-03-10T15:05:41.857236+0000 mgr.gibba020.yqfnwy (mgr.34427) 3862 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:05:44.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:43 gibba013 bash[29418]: cephadm 2021-03-10T15:05:41.857283+0000 mgr.gibba020.yqfnwy (mgr.34427) 3863 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:05:44.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:43 gibba013 bash[29418]: cephadm 2021-03-10T15:05:41.858854+0000 mgr.gibba020.yqfnwy (mgr.34427) 3864 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:05:44.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:43 gibba013 bash[29418]: cephadm 2021-03-10T15:05:41.858905+0000 mgr.gibba020.yqfnwy (mgr.34427) 3865 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:05:44.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:43 gibba013 bash[29418]: cephadm 2021-03-10T15:05:41.860358+0000 mgr.gibba020.yqfnwy (mgr.34427) 3866 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:05:44.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:43 gibba013 bash[29418]: cephadm 2021-03-10T15:05:41.861666+0000 mgr.gibba020.yqfnwy (mgr.34427) 3867 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:05:44.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:43 gibba013 bash[29418]: cephadm 2021-03-10T15:05:41.861720+0000 mgr.gibba020.yqfnwy (mgr.34427) 3868 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:05:44.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:43 gibba013 bash[29418]: cephadm 2021-03-10T15:05:41.863615+0000 mgr.gibba020.yqfnwy (mgr.34427) 3869 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:05:44.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:43 gibba013 bash[29418]: cephadm 2021-03-10T15:05:41.864084+0000 mgr.gibba020.yqfnwy (mgr.34427) 3870 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:05:44.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:43 gibba013 bash[29418]: cephadm 2021-03-10T15:05:41.865766+0000 mgr.gibba020.yqfnwy (mgr.34427) 3871 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:05:44.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:43 gibba013 bash[29418]: cephadm 2021-03-10T15:05:41.865827+0000 mgr.gibba020.yqfnwy (mgr.34427) 3872 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:05:44.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:43 gibba013 bash[29418]: cephadm 2021-03-10T15:05:41.865993+0000 mgr.gibba020.yqfnwy (mgr.34427) 3873 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:05:44.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:43 gibba013 bash[30381]: cephadm 2021-03-10T15:05:41.853789+0000 mgr.gibba020.yqfnwy (mgr.34427) 3860 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:05:44.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:43 gibba013 bash[30381]: cephadm 2021-03-10T15:05:41.855751+0000 mgr.gibba020.yqfnwy (mgr.34427) 3861 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:05:44.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:43 gibba013 bash[30381]: cephadm 2021-03-10T15:05:41.857236+0000 mgr.gibba020.yqfnwy (mgr.34427) 3862 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:05:44.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:43 gibba013 bash[30381]: cephadm 2021-03-10T15:05:41.857283+0000 mgr.gibba020.yqfnwy (mgr.34427) 3863 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:05:44.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:43 gibba013 bash[30381]: cephadm 2021-03-10T15:05:41.858854+0000 mgr.gibba020.yqfnwy (mgr.34427) 3864 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:05:44.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:43 gibba013 bash[30381]: cephadm 2021-03-10T15:05:41.858905+0000 mgr.gibba020.yqfnwy (mgr.34427) 3865 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:05:44.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:43 gibba013 bash[30381]: cephadm 2021-03-10T15:05:41.860358+0000 mgr.gibba020.yqfnwy (mgr.34427) 3866 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:05:44.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:43 gibba013 bash[30381]: cephadm 2021-03-10T15:05:41.861666+0000 mgr.gibba020.yqfnwy (mgr.34427) 3867 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:05:44.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:43 gibba013 bash[30381]: cephadm 2021-03-10T15:05:41.861720+0000 mgr.gibba020.yqfnwy (mgr.34427) 3868 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:05:44.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:43 gibba013 bash[30381]: cephadm 2021-03-10T15:05:41.863615+0000 mgr.gibba020.yqfnwy (mgr.34427) 3869 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:05:44.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:43 gibba013 bash[30381]: cephadm 2021-03-10T15:05:41.864084+0000 mgr.gibba020.yqfnwy (mgr.34427) 3870 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:05:44.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:43 gibba013 bash[30381]: cephadm 2021-03-10T15:05:41.865766+0000 mgr.gibba020.yqfnwy (mgr.34427) 3871 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:05:44.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:43 gibba013 bash[30381]: cephadm 2021-03-10T15:05:41.865827+0000 mgr.gibba020.yqfnwy (mgr.34427) 3872 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:05:44.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:43 gibba013 bash[30381]: cephadm 2021-03-10T15:05:41.865993+0000 mgr.gibba020.yqfnwy (mgr.34427) 3873 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:05:44.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:44 gibba020 bash[25448]: cluster 2021-03-10T15:05:43.523350+0000 mgr.gibba020.yqfnwy (mgr.34427) 3874 : cluster [DBG] pgmap v2192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:45.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:44 gibba013 bash[29418]: cluster 2021-03-10T15:05:43.523350+0000 mgr.gibba020.yqfnwy (mgr.34427) 3874 : cluster [DBG] pgmap v2192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:45.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:44 gibba013 bash[30381]: cluster 2021-03-10T15:05:43.523350+0000 mgr.gibba020.yqfnwy (mgr.34427) 3874 : cluster [DBG] pgmap v2192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:46.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:46 gibba020 bash[25448]: cluster 2021-03-10T15:05:45.525104+0000 mgr.gibba020.yqfnwy (mgr.34427) 3875 : cluster [DBG] pgmap v2193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:47.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:46 gibba013 bash[29418]: cluster 2021-03-10T15:05:45.525104+0000 mgr.gibba020.yqfnwy (mgr.34427) 3875 : cluster [DBG] pgmap v2193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:47.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:46 gibba013 bash[30381]: cluster 2021-03-10T15:05:45.525104+0000 mgr.gibba020.yqfnwy (mgr.34427) 3875 : cluster [DBG] pgmap v2193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:48.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:47 gibba013 bash[29418]: cluster 2021-03-10T15:05:47.526613+0000 mgr.gibba020.yqfnwy (mgr.34427) 3876 : cluster [DBG] pgmap v2194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:48.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:47 gibba013 bash[30381]: cluster 2021-03-10T15:05:47.526613+0000 mgr.gibba020.yqfnwy (mgr.34427) 3876 : cluster [DBG] pgmap v2194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:48.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:47 gibba020 bash[25448]: cluster 2021-03-10T15:05:47.526613+0000 mgr.gibba020.yqfnwy (mgr.34427) 3876 : cluster [DBG] pgmap v2194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:50.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:50 gibba013 bash[29418]: cluster 2021-03-10T15:05:49.528097+0000 mgr.gibba020.yqfnwy (mgr.34427) 3877 : cluster [DBG] pgmap v2195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:50.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:50 gibba013 bash[30381]: cluster 2021-03-10T15:05:49.528097+0000 mgr.gibba020.yqfnwy (mgr.34427) 3877 : cluster [DBG] pgmap v2195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:50.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:50 gibba020 bash[25448]: cluster 2021-03-10T15:05:49.528097+0000 mgr.gibba020.yqfnwy (mgr.34427) 3877 : cluster [DBG] pgmap v2195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:52.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:52 gibba013 bash[29418]: cluster 2021-03-10T15:05:51.529654+0000 mgr.gibba020.yqfnwy (mgr.34427) 3878 : cluster [DBG] pgmap v2196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:52.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:52 gibba013 bash[30381]: cluster 2021-03-10T15:05:51.529654+0000 mgr.gibba020.yqfnwy (mgr.34427) 3878 : cluster [DBG] pgmap v2196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:52.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:52 gibba020 bash[25448]: cluster 2021-03-10T15:05:51.529654+0000 mgr.gibba020.yqfnwy (mgr.34427) 3878 : cluster [DBG] pgmap v2196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:54.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:54 gibba013 bash[29418]: cluster 2021-03-10T15:05:53.531012+0000 mgr.gibba020.yqfnwy (mgr.34427) 3879 : cluster [DBG] pgmap v2197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:54.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:54 gibba013 bash[30381]: cluster 2021-03-10T15:05:53.531012+0000 mgr.gibba020.yqfnwy (mgr.34427) 3879 : cluster [DBG] pgmap v2197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:54.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:54 gibba020 bash[25448]: cluster 2021-03-10T15:05:53.531012+0000 mgr.gibba020.yqfnwy (mgr.34427) 3879 : cluster [DBG] pgmap v2197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:56.877 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:56 gibba020 bash[25448]: cluster 2021-03-10T15:05:55.532752+0000 mgr.gibba020.yqfnwy (mgr.34427) 3880 : cluster [DBG] pgmap v2198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:56.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:56 gibba013 bash[29418]: cluster 2021-03-10T15:05:55.532752+0000 mgr.gibba020.yqfnwy (mgr.34427) 3880 : cluster [DBG] pgmap v2198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:56.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:56 gibba013 bash[30381]: cluster 2021-03-10T15:05:55.532752+0000 mgr.gibba020.yqfnwy (mgr.34427) 3880 : cluster [DBG] pgmap v2198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:58.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:57 gibba013 bash[29418]: cephadm 2021-03-10T15:05:56.872934+0000 mgr.gibba020.yqfnwy (mgr.34427) 3881 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:05:58.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:05:57 gibba013 bash[29418]: cluster 2021-03-10T15:05:57.534030+0000 mgr.gibba020.yqfnwy (mgr.34427) 3882 : cluster [DBG] pgmap v2199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:58.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:57 gibba013 bash[30381]: cephadm 2021-03-10T15:05:56.872934+0000 mgr.gibba020.yqfnwy (mgr.34427) 3881 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:05:58.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:05:57 gibba013 bash[30381]: cluster 2021-03-10T15:05:57.534030+0000 mgr.gibba020.yqfnwy (mgr.34427) 3882 : cluster [DBG] pgmap v2199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:05:58.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:57 gibba020 bash[25448]: cephadm 2021-03-10T15:05:56.872934+0000 mgr.gibba020.yqfnwy (mgr.34427) 3881 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:05:58.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:05:57 gibba020 bash[25448]: cluster 2021-03-10T15:05:57.534030+0000 mgr.gibba020.yqfnwy (mgr.34427) 3882 : cluster [DBG] pgmap v2199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:00.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:00 gibba013 bash[29418]: cluster 2021-03-10T15:05:59.535528+0000 mgr.gibba020.yqfnwy (mgr.34427) 3883 : cluster [DBG] pgmap v2200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:00.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:00 gibba013 bash[30381]: cluster 2021-03-10T15:05:59.535528+0000 mgr.gibba020.yqfnwy (mgr.34427) 3883 : cluster [DBG] pgmap v2200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:00.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:00 gibba020 bash[25448]: cluster 2021-03-10T15:05:59.535528+0000 mgr.gibba020.yqfnwy (mgr.34427) 3883 : cluster [DBG] pgmap v2200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:02.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:02 gibba013 bash[29418]: cluster 2021-03-10T15:06:01.537378+0000 mgr.gibba020.yqfnwy (mgr.34427) 3884 : cluster [DBG] pgmap v2201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:02.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:02 gibba013 bash[30381]: cluster 2021-03-10T15:06:01.537378+0000 mgr.gibba020.yqfnwy (mgr.34427) 3884 : cluster [DBG] pgmap v2201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:02.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:02 gibba020 bash[25448]: cluster 2021-03-10T15:06:01.537378+0000 mgr.gibba020.yqfnwy (mgr.34427) 3884 : cluster [DBG] pgmap v2201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:04.202 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:06:04.431 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:06:04.431 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (72m) 7m ago 77m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:06:04.432 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (77m) 6m ago 77m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:06:04.432 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (72m) 6m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:06:04.432 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (73m) 6m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:06:04.432 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (72m) 7m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:06:04.432 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (72m) 7m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:06:04.433 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (71m) 6m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:06:04.433 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (71m) 7m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:06:04.433 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (78m) 7m ago 78m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:06:04.433 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (78m) 6m ago 78m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:06:04.434 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (70m) 7m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:06:04.434 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (70m) 7m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:06:04.434 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (69m) 7m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:06:04.434 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (69m) 7m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:06:04.435 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (69m) 6m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:06:04.435 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (68m) 6m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:06:04.435 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (68m) 6m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:06:04.435 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (67m) 6m ago 78m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:06:04.436 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (77m) 6m ago 78m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:06:04.436 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 6m ago 76m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:06:04.681 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:06:04.681 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:06:04.681 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:06:04.682 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:06:04.682 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:06:04.682 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:06:04.682 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:06:04.683 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:06:04.683 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:06:04.683 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:06:04.683 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:06:04.683 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:06:04.684 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:06:04.684 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:06:04.684 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:06:04.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:04 gibba013 bash[29418]: cluster 2021-03-10T15:06:03.538887+0000 mgr.gibba020.yqfnwy (mgr.34427) 3885 : cluster [DBG] pgmap v2202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:04.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:04 gibba013 bash[30381]: cluster 2021-03-10T15:06:03.538887+0000 mgr.gibba020.yqfnwy (mgr.34427) 3885 : cluster [DBG] pgmap v2202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:04.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:04 gibba020 bash[25448]: cluster 2021-03-10T15:06:03.538887+0000 mgr.gibba020.yqfnwy (mgr.34427) 3885 : cluster [DBG] pgmap v2202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:05.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:05 gibba013 bash[29418]: audit 2021-03-10T15:06:04.189864+0000 mgr.gibba020.yqfnwy (mgr.34427) 3886 : audit [DBG] from='client.46662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:06:05.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:05 gibba013 bash[29418]: audit 2021-03-10T15:06:04.415194+0000 mgr.gibba020.yqfnwy (mgr.34427) 3887 : audit [DBG] from='client.56653 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:06:05.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:05 gibba013 bash[29418]: audit 2021-03-10T15:06:04.677800+0000 mon.a (mon.0) 1717 : audit [DBG] from='client.? 172.21.2.113:0/1390953782' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:05.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:05 gibba013 bash[30381]: audit 2021-03-10T15:06:04.189864+0000 mgr.gibba020.yqfnwy (mgr.34427) 3886 : audit [DBG] from='client.46662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:06:05.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:05 gibba013 bash[30381]: audit 2021-03-10T15:06:04.415194+0000 mgr.gibba020.yqfnwy (mgr.34427) 3887 : audit [DBG] from='client.56653 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:06:05.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:05 gibba013 bash[30381]: audit 2021-03-10T15:06:04.677800+0000 mon.a (mon.0) 1717 : audit [DBG] from='client.? 172.21.2.113:0/1390953782' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:05.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:05 gibba020 bash[25448]: audit 2021-03-10T15:06:04.189864+0000 mgr.gibba020.yqfnwy (mgr.34427) 3886 : audit [DBG] from='client.46662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:06:05.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:05 gibba020 bash[25448]: audit 2021-03-10T15:06:04.415194+0000 mgr.gibba020.yqfnwy (mgr.34427) 3887 : audit [DBG] from='client.56653 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:06:05.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:05 gibba020 bash[25448]: audit 2021-03-10T15:06:04.677800+0000 mon.a (mon.0) 1717 : audit [DBG] from='client.? 172.21.2.113:0/1390953782' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:06 gibba020 bash[25448]: cluster 2021-03-10T15:06:05.540559+0000 mgr.gibba020.yqfnwy (mgr.34427) 3888 : cluster [DBG] pgmap v2203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:06 gibba020 bash[25448]: audit 2021-03-10T15:06:06.339997+0000 mon.a (mon.0) 1718 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:06:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:06 gibba020 bash[25448]: audit 2021-03-10T15:06:06.370768+0000 mon.a (mon.0) 1719 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:06:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:06 gibba020 bash[25448]: audit 2021-03-10T15:06:06.425627+0000 mon.a (mon.0) 1720 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:06:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:06 gibba020 bash[25448]: audit 2021-03-10T15:06:06.426471+0000 mon.a (mon.0) 1721 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:06:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:06 gibba020 bash[25448]: audit 2021-03-10T15:06:06.427159+0000 mon.a (mon.0) 1722 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T15:06:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:06 gibba020 bash[25448]: audit 2021-03-10T15:06:06.427829+0000 mon.a (mon.0) 1723 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:06:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:06 gibba013 bash[29418]: cluster 2021-03-10T15:06:05.540559+0000 mgr.gibba020.yqfnwy (mgr.34427) 3888 : cluster [DBG] pgmap v2203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:07.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:06 gibba013 bash[29418]: audit 2021-03-10T15:06:06.339997+0000 mon.a (mon.0) 1718 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:06:07.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:06 gibba013 bash[29418]: audit 2021-03-10T15:06:06.370768+0000 mon.a (mon.0) 1719 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:06:07.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:06 gibba013 bash[29418]: audit 2021-03-10T15:06:06.425627+0000 mon.a (mon.0) 1720 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:06:07.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:06 gibba013 bash[29418]: audit 2021-03-10T15:06:06.426471+0000 mon.a (mon.0) 1721 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:06:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:06 gibba013 bash[29418]: audit 2021-03-10T15:06:06.427159+0000 mon.a (mon.0) 1722 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T15:06:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:06 gibba013 bash[29418]: audit 2021-03-10T15:06:06.427829+0000 mon.a (mon.0) 1723 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:06:07.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:06 gibba013 bash[30381]: cluster 2021-03-10T15:06:05.540559+0000 mgr.gibba020.yqfnwy (mgr.34427) 3888 : cluster [DBG] pgmap v2203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:07.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:06 gibba013 bash[30381]: audit 2021-03-10T15:06:06.339997+0000 mon.a (mon.0) 1718 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:06:07.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:06 gibba013 bash[30381]: audit 2021-03-10T15:06:06.370768+0000 mon.a (mon.0) 1719 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:06:07.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:06 gibba013 bash[30381]: audit 2021-03-10T15:06:06.425627+0000 mon.a (mon.0) 1720 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:06:07.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:06 gibba013 bash[30381]: audit 2021-03-10T15:06:06.426471+0000 mon.a (mon.0) 1721 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:06:07.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:06 gibba013 bash[30381]: audit 2021-03-10T15:06:06.427159+0000 mon.a (mon.0) 1722 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T15:06:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:06 gibba013 bash[30381]: audit 2021-03-10T15:06:06.427829+0000 mon.a (mon.0) 1723 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:06:08.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:07 gibba013 bash[29418]: cluster 2021-03-10T15:06:07.542081+0000 mgr.gibba020.yqfnwy (mgr.34427) 3889 : cluster [DBG] pgmap v2204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:08.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:07 gibba013 bash[30381]: cluster 2021-03-10T15:06:07.542081+0000 mgr.gibba020.yqfnwy (mgr.34427) 3889 : cluster [DBG] pgmap v2204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:08.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:07 gibba020 bash[25448]: cluster 2021-03-10T15:06:07.542081+0000 mgr.gibba020.yqfnwy (mgr.34427) 3889 : cluster [DBG] pgmap v2204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:10.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:10 gibba013 bash[29418]: cluster 2021-03-10T15:06:09.543750+0000 mgr.gibba020.yqfnwy (mgr.34427) 3890 : cluster [DBG] pgmap v2205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:10.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:10 gibba013 bash[30381]: cluster 2021-03-10T15:06:09.543750+0000 mgr.gibba020.yqfnwy (mgr.34427) 3890 : cluster [DBG] pgmap v2205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:10.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:10 gibba020 bash[25448]: cluster 2021-03-10T15:06:09.543750+0000 mgr.gibba020.yqfnwy (mgr.34427) 3890 : cluster [DBG] pgmap v2205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:12.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:12 gibba013 bash[29418]: cluster 2021-03-10T15:06:11.545647+0000 mgr.gibba020.yqfnwy (mgr.34427) 3891 : cluster [DBG] pgmap v2206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:12.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:12 gibba013 bash[30381]: cluster 2021-03-10T15:06:11.545647+0000 mgr.gibba020.yqfnwy (mgr.34427) 3891 : cluster [DBG] pgmap v2206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:12.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:12 gibba020 bash[25448]: cluster 2021-03-10T15:06:11.545647+0000 mgr.gibba020.yqfnwy (mgr.34427) 3891 : cluster [DBG] pgmap v2206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:13.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:13 gibba013 bash[29418]: cephadm 2021-03-10T15:06:11.888743+0000 mgr.gibba020.yqfnwy (mgr.34427) 3892 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:06:13.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:13 gibba013 bash[30381]: cephadm 2021-03-10T15:06:11.888743+0000 mgr.gibba020.yqfnwy (mgr.34427) 3892 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:06:13.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:13 gibba020 bash[25448]: cephadm 2021-03-10T15:06:11.888743+0000 mgr.gibba020.yqfnwy (mgr.34427) 3892 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:06:14.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:14 gibba020 bash[25448]: cluster 2021-03-10T15:06:13.547065+0000 mgr.gibba020.yqfnwy (mgr.34427) 3893 : cluster [DBG] pgmap v2207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:15.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:14 gibba013 bash[29418]: cluster 2021-03-10T15:06:13.547065+0000 mgr.gibba020.yqfnwy (mgr.34427) 3893 : cluster [DBG] pgmap v2207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:15.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:14 gibba013 bash[30381]: cluster 2021-03-10T15:06:13.547065+0000 mgr.gibba020.yqfnwy (mgr.34427) 3893 : cluster [DBG] pgmap v2207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:16.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:16 gibba020 bash[25448]: cluster 2021-03-10T15:06:15.548840+0000 mgr.gibba020.yqfnwy (mgr.34427) 3894 : cluster [DBG] pgmap v2208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:17.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:16 gibba013 bash[29418]: cluster 2021-03-10T15:06:15.548840+0000 mgr.gibba020.yqfnwy (mgr.34427) 3894 : cluster [DBG] pgmap v2208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:17.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:16 gibba013 bash[30381]: cluster 2021-03-10T15:06:15.548840+0000 mgr.gibba020.yqfnwy (mgr.34427) 3894 : cluster [DBG] pgmap v2208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:18.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:17 gibba013 bash[29418]: cluster 2021-03-10T15:06:17.550445+0000 mgr.gibba020.yqfnwy (mgr.34427) 3895 : cluster [DBG] pgmap v2209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:18.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:17 gibba013 bash[30381]: cluster 2021-03-10T15:06:17.550445+0000 mgr.gibba020.yqfnwy (mgr.34427) 3895 : cluster [DBG] pgmap v2209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:18.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:17 gibba020 bash[25448]: cluster 2021-03-10T15:06:17.550445+0000 mgr.gibba020.yqfnwy (mgr.34427) 3895 : cluster [DBG] pgmap v2209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:20.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:20 gibba013 bash[29418]: cluster 2021-03-10T15:06:19.551930+0000 mgr.gibba020.yqfnwy (mgr.34427) 3896 : cluster [DBG] pgmap v2210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:20.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:20 gibba013 bash[30381]: cluster 2021-03-10T15:06:19.551930+0000 mgr.gibba020.yqfnwy (mgr.34427) 3896 : cluster [DBG] pgmap v2210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:20.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:20 gibba020 bash[25448]: cluster 2021-03-10T15:06:19.551930+0000 mgr.gibba020.yqfnwy (mgr.34427) 3896 : cluster [DBG] pgmap v2210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:22.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:22 gibba013 bash[29418]: cluster 2021-03-10T15:06:21.553711+0000 mgr.gibba020.yqfnwy (mgr.34427) 3897 : cluster [DBG] pgmap v2211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:22.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:22 gibba013 bash[30381]: cluster 2021-03-10T15:06:21.553711+0000 mgr.gibba020.yqfnwy (mgr.34427) 3897 : cluster [DBG] pgmap v2211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:22.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:22 gibba020 bash[25448]: cluster 2021-03-10T15:06:21.553711+0000 mgr.gibba020.yqfnwy (mgr.34427) 3897 : cluster [DBG] pgmap v2211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:24.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:24 gibba020 bash[25448]: cluster 2021-03-10T15:06:23.555304+0000 mgr.gibba020.yqfnwy (mgr.34427) 3898 : cluster [DBG] pgmap v2212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:25.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:24 gibba013 bash[29418]: cluster 2021-03-10T15:06:23.555304+0000 mgr.gibba020.yqfnwy (mgr.34427) 3898 : cluster [DBG] pgmap v2212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:25.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:24 gibba013 bash[30381]: cluster 2021-03-10T15:06:23.555304+0000 mgr.gibba020.yqfnwy (mgr.34427) 3898 : cluster [DBG] pgmap v2212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:26.901 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:26 gibba020 bash[25448]: cluster 2021-03-10T15:06:25.557019+0000 mgr.gibba020.yqfnwy (mgr.34427) 3899 : cluster [DBG] pgmap v2213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:27.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:26 gibba013 bash[29418]: cluster 2021-03-10T15:06:25.557019+0000 mgr.gibba020.yqfnwy (mgr.34427) 3899 : cluster [DBG] pgmap v2213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:27.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:26 gibba013 bash[30381]: cluster 2021-03-10T15:06:25.557019+0000 mgr.gibba020.yqfnwy (mgr.34427) 3899 : cluster [DBG] pgmap v2213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:28.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:27 gibba013 bash[29418]: cephadm 2021-03-10T15:06:26.897184+0000 mgr.gibba020.yqfnwy (mgr.34427) 3900 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:06:28.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:27 gibba013 bash[29418]: cluster 2021-03-10T15:06:27.558580+0000 mgr.gibba020.yqfnwy (mgr.34427) 3901 : cluster [DBG] pgmap v2214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:28.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:27 gibba013 bash[30381]: cephadm 2021-03-10T15:06:26.897184+0000 mgr.gibba020.yqfnwy (mgr.34427) 3900 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:06:28.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:27 gibba013 bash[30381]: cluster 2021-03-10T15:06:27.558580+0000 mgr.gibba020.yqfnwy (mgr.34427) 3901 : cluster [DBG] pgmap v2214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:28.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:27 gibba020 bash[25448]: cephadm 2021-03-10T15:06:26.897184+0000 mgr.gibba020.yqfnwy (mgr.34427) 3900 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:06:28.259 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:27 gibba020 bash[25448]: cluster 2021-03-10T15:06:27.558580+0000 mgr.gibba020.yqfnwy (mgr.34427) 3901 : cluster [DBG] pgmap v2214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:30.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:30 gibba013 bash[29418]: cluster 2021-03-10T15:06:29.560237+0000 mgr.gibba020.yqfnwy (mgr.34427) 3902 : cluster [DBG] pgmap v2215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:30.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:30 gibba013 bash[30381]: cluster 2021-03-10T15:06:29.560237+0000 mgr.gibba020.yqfnwy (mgr.34427) 3902 : cluster [DBG] pgmap v2215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:30.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:30 gibba020 bash[25448]: cluster 2021-03-10T15:06:29.560237+0000 mgr.gibba020.yqfnwy (mgr.34427) 3902 : cluster [DBG] pgmap v2215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:32.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:32 gibba020 bash[25448]: cluster 2021-03-10T15:06:31.561906+0000 mgr.gibba020.yqfnwy (mgr.34427) 3903 : cluster [DBG] pgmap v2216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:33.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:32 gibba013 bash[29418]: cluster 2021-03-10T15:06:31.561906+0000 mgr.gibba020.yqfnwy (mgr.34427) 3903 : cluster [DBG] pgmap v2216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:33.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:32 gibba013 bash[30381]: cluster 2021-03-10T15:06:31.561906+0000 mgr.gibba020.yqfnwy (mgr.34427) 3903 : cluster [DBG] pgmap v2216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:34.921 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:06:34.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:34 gibba020 bash[25448]: cluster 2021-03-10T15:06:33.563349+0000 mgr.gibba020.yqfnwy (mgr.34427) 3904 : cluster [DBG] pgmap v2217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:35.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:34 gibba013 bash[29418]: cluster 2021-03-10T15:06:33.563349+0000 mgr.gibba020.yqfnwy (mgr.34427) 3904 : cluster [DBG] pgmap v2217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:35.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:34 gibba013 bash[30381]: cluster 2021-03-10T15:06:33.563349+0000 mgr.gibba020.yqfnwy (mgr.34427) 3904 : cluster [DBG] pgmap v2217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:35.147 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:06:35.148 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (73m) 7m ago 78m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:06:35.148 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (78m) 6m ago 78m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:06:35.148 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (73m) 6m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:06:35.148 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (73m) 6m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:06:35.149 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (72m) 7m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:06:35.149 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (72m) 7m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:06:35.149 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (72m) 6m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:06:35.149 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (72m) 7m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:06:35.149 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (78m) 7m ago 78m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:06:35.150 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (78m) 6m ago 78m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:06:35.150 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (71m) 7m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:06:35.150 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (70m) 7m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:06:35.150 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (70m) 7m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:06:35.151 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (70m) 7m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:06:35.151 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (69m) 6m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:06:35.151 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (69m) 6m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:06:35.151 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (68m) 6m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:06:35.151 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (68m) 6m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:06:35.152 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (78m) 6m ago 78m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:06:35.152 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 6m ago 76m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:06:35.394 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:06:35.395 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:06:35.395 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:06:35.395 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:06:35.395 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:06:35.396 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:06:35.396 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:06:35.396 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:06:35.396 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:06:35.397 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:06:35.397 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:06:35.397 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:06:35.397 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:06:35.397 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:06:35.398 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:06:35.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:35 gibba020 bash[25448]: audit 2021-03-10T15:06:35.391205+0000 mon.a (mon.0) 1724 : audit [DBG] from='client.? 172.21.2.113:0/604626252' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:36.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:35 gibba013 bash[29418]: audit 2021-03-10T15:06:35.391205+0000 mon.a (mon.0) 1724 : audit [DBG] from='client.? 172.21.2.113:0/604626252' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:36.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:35 gibba013 bash[30381]: audit 2021-03-10T15:06:35.391205+0000 mon.a (mon.0) 1724 : audit [DBG] from='client.? 172.21.2.113:0/604626252' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:36.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:36 gibba020 bash[25448]: audit 2021-03-10T15:06:34.908073+0000 mgr.gibba020.yqfnwy (mgr.34427) 3905 : audit [DBG] from='client.46680 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:06:36.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:36 gibba020 bash[25448]: audit 2021-03-10T15:06:35.130864+0000 mgr.gibba020.yqfnwy (mgr.34427) 3906 : audit [DBG] from='client.56671 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:06:36.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:36 gibba020 bash[25448]: cluster 2021-03-10T15:06:35.565000+0000 mgr.gibba020.yqfnwy (mgr.34427) 3907 : cluster [DBG] pgmap v2218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:37.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:36 gibba013 bash[29418]: audit 2021-03-10T15:06:34.908073+0000 mgr.gibba020.yqfnwy (mgr.34427) 3905 : audit [DBG] from='client.46680 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:06:37.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:36 gibba013 bash[29418]: audit 2021-03-10T15:06:35.130864+0000 mgr.gibba020.yqfnwy (mgr.34427) 3906 : audit [DBG] from='client.56671 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:06:37.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:36 gibba013 bash[29418]: cluster 2021-03-10T15:06:35.565000+0000 mgr.gibba020.yqfnwy (mgr.34427) 3907 : cluster [DBG] pgmap v2218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:37.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:36 gibba013 bash[30381]: audit 2021-03-10T15:06:34.908073+0000 mgr.gibba020.yqfnwy (mgr.34427) 3905 : audit [DBG] from='client.46680 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:06:37.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:36 gibba013 bash[30381]: audit 2021-03-10T15:06:35.130864+0000 mgr.gibba020.yqfnwy (mgr.34427) 3906 : audit [DBG] from='client.56671 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:06:37.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:36 gibba013 bash[30381]: cluster 2021-03-10T15:06:35.565000+0000 mgr.gibba020.yqfnwy (mgr.34427) 3907 : cluster [DBG] pgmap v2218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:38.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:37 gibba013 bash[29418]: cluster 2021-03-10T15:06:37.566511+0000 mgr.gibba020.yqfnwy (mgr.34427) 3908 : cluster [DBG] pgmap v2219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:38.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:37 gibba013 bash[30381]: cluster 2021-03-10T15:06:37.566511+0000 mgr.gibba020.yqfnwy (mgr.34427) 3908 : cluster [DBG] pgmap v2219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:38.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:37 gibba020 bash[25448]: cluster 2021-03-10T15:06:37.566511+0000 mgr.gibba020.yqfnwy (mgr.34427) 3908 : cluster [DBG] pgmap v2219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:40.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:40 gibba020 bash[25448]: cluster 2021-03-10T15:06:39.567782+0000 mgr.gibba020.yqfnwy (mgr.34427) 3909 : cluster [DBG] pgmap v2220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:41.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:40 gibba013 bash[29418]: cluster 2021-03-10T15:06:39.567782+0000 mgr.gibba020.yqfnwy (mgr.34427) 3909 : cluster [DBG] pgmap v2220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:41.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:40 gibba013 bash[30381]: cluster 2021-03-10T15:06:39.567782+0000 mgr.gibba020.yqfnwy (mgr.34427) 3909 : cluster [DBG] pgmap v2220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:42.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:42 gibba020 bash[25448]: cluster 2021-03-10T15:06:41.569527+0000 mgr.gibba020.yqfnwy (mgr.34427) 3910 : cluster [DBG] pgmap v2221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:42.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:42 gibba020 bash[25448]: audit 2021-03-10T15:06:41.914963+0000 mon.a (mon.0) 1725 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:06:42.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:42 gibba020 bash[25448]: audit 2021-03-10T15:06:42.182673+0000 mon.a (mon.0) 1726 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:06:42.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:42 gibba020 bash[25448]: audit 2021-03-10T15:06:42.193619+0000 mon.a (mon.0) 1727 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:06:42.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:42 gibba020 bash[25448]: audit 2021-03-10T15:06:42.196263+0000 mon.a (mon.0) 1728 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:42.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:42 gibba020 bash[25448]: audit 2021-03-10T15:06:42.198306+0000 mon.a (mon.0) 1729 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:42.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:42 gibba020 bash[25448]: audit 2021-03-10T15:06:42.200346+0000 mon.a (mon.0) 1730 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:42.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:42 gibba020 bash[25448]: audit 2021-03-10T15:06:42.203425+0000 mon.a (mon.0) 1731 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:42.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:42 gibba020 bash[25448]: audit 2021-03-10T15:06:42.205854+0000 mon.a (mon.0) 1732 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:43.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:42 gibba013 bash[29418]: cluster 2021-03-10T15:06:41.569527+0000 mgr.gibba020.yqfnwy (mgr.34427) 3910 : cluster [DBG] pgmap v2221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:43.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:42 gibba013 bash[29418]: audit 2021-03-10T15:06:41.914963+0000 mon.a (mon.0) 1725 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:06:43.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:42 gibba013 bash[29418]: audit 2021-03-10T15:06:42.182673+0000 mon.a (mon.0) 1726 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:06:43.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:42 gibba013 bash[29418]: audit 2021-03-10T15:06:42.193619+0000 mon.a (mon.0) 1727 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:06:43.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:42 gibba013 bash[29418]: audit 2021-03-10T15:06:42.196263+0000 mon.a (mon.0) 1728 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:43.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:42 gibba013 bash[29418]: audit 2021-03-10T15:06:42.198306+0000 mon.a (mon.0) 1729 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:43.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:42 gibba013 bash[29418]: audit 2021-03-10T15:06:42.200346+0000 mon.a (mon.0) 1730 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:43.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:42 gibba013 bash[29418]: audit 2021-03-10T15:06:42.203425+0000 mon.a (mon.0) 1731 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:43.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:42 gibba013 bash[29418]: audit 2021-03-10T15:06:42.205854+0000 mon.a (mon.0) 1732 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:43.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:42 gibba013 bash[30381]: cluster 2021-03-10T15:06:41.569527+0000 mgr.gibba020.yqfnwy (mgr.34427) 3910 : cluster [DBG] pgmap v2221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:43.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:42 gibba013 bash[30381]: audit 2021-03-10T15:06:41.914963+0000 mon.a (mon.0) 1725 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:06:43.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:42 gibba013 bash[30381]: audit 2021-03-10T15:06:42.182673+0000 mon.a (mon.0) 1726 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:06:43.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:42 gibba013 bash[30381]: audit 2021-03-10T15:06:42.193619+0000 mon.a (mon.0) 1727 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:06:43.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:42 gibba013 bash[30381]: audit 2021-03-10T15:06:42.196263+0000 mon.a (mon.0) 1728 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:43.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:42 gibba013 bash[30381]: audit 2021-03-10T15:06:42.198306+0000 mon.a (mon.0) 1729 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:43.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:42 gibba013 bash[30381]: audit 2021-03-10T15:06:42.200346+0000 mon.a (mon.0) 1730 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:43.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:42 gibba013 bash[30381]: audit 2021-03-10T15:06:42.203425+0000 mon.a (mon.0) 1731 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:43.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:42 gibba013 bash[30381]: audit 2021-03-10T15:06:42.205854+0000 mon.a (mon.0) 1732 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:06:43.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:43 gibba020 bash[25448]: cephadm 2021-03-10T15:06:41.919904+0000 mgr.gibba020.yqfnwy (mgr.34427) 3911 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:06:43.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:43 gibba020 bash[25448]: cephadm 2021-03-10T15:06:41.921528+0000 mgr.gibba020.yqfnwy (mgr.34427) 3912 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:06:43.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:43 gibba020 bash[25448]: cephadm 2021-03-10T15:06:42.191692+0000 mgr.gibba020.yqfnwy (mgr.34427) 3913 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:06:43.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:43 gibba020 bash[25448]: cephadm 2021-03-10T15:06:42.194707+0000 mgr.gibba020.yqfnwy (mgr.34427) 3914 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:06:43.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:43 gibba020 bash[25448]: cephadm 2021-03-10T15:06:42.196680+0000 mgr.gibba020.yqfnwy (mgr.34427) 3915 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:06:43.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:43 gibba020 bash[25448]: cephadm 2021-03-10T15:06:42.196757+0000 mgr.gibba020.yqfnwy (mgr.34427) 3916 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:06:43.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:43 gibba020 bash[25448]: cephadm 2021-03-10T15:06:42.198688+0000 mgr.gibba020.yqfnwy (mgr.34427) 3917 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:06:43.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:43 gibba020 bash[25448]: cephadm 2021-03-10T15:06:42.198764+0000 mgr.gibba020.yqfnwy (mgr.34427) 3918 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:06:43.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:43 gibba020 bash[25448]: cephadm 2021-03-10T15:06:42.200397+0000 mgr.gibba020.yqfnwy (mgr.34427) 3919 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:06:43.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:43 gibba020 bash[25448]: cephadm 2021-03-10T15:06:42.201627+0000 mgr.gibba020.yqfnwy (mgr.34427) 3920 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:06:43.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:43 gibba020 bash[25448]: cephadm 2021-03-10T15:06:42.201830+0000 mgr.gibba020.yqfnwy (mgr.34427) 3921 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:06:43.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:43 gibba020 bash[25448]: cephadm 2021-03-10T15:06:42.203572+0000 mgr.gibba020.yqfnwy (mgr.34427) 3922 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:06:43.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:43 gibba020 bash[25448]: cephadm 2021-03-10T15:06:42.204585+0000 mgr.gibba020.yqfnwy (mgr.34427) 3923 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:06:43.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:43 gibba020 bash[25448]: cephadm 2021-03-10T15:06:42.206184+0000 mgr.gibba020.yqfnwy (mgr.34427) 3924 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:06:43.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:43 gibba020 bash[25448]: cephadm 2021-03-10T15:06:42.206344+0000 mgr.gibba020.yqfnwy (mgr.34427) 3925 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:06:43.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:43 gibba020 bash[25448]: cephadm 2021-03-10T15:06:42.206615+0000 mgr.gibba020.yqfnwy (mgr.34427) 3926 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:06:44.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:43 gibba013 bash[29418]: cephadm 2021-03-10T15:06:41.919904+0000 mgr.gibba020.yqfnwy (mgr.34427) 3911 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:06:44.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:43 gibba013 bash[29418]: cephadm 2021-03-10T15:06:41.921528+0000 mgr.gibba020.yqfnwy (mgr.34427) 3912 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:06:44.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:43 gibba013 bash[29418]: cephadm 2021-03-10T15:06:42.191692+0000 mgr.gibba020.yqfnwy (mgr.34427) 3913 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:06:44.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:43 gibba013 bash[29418]: cephadm 2021-03-10T15:06:42.194707+0000 mgr.gibba020.yqfnwy (mgr.34427) 3914 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:06:44.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:43 gibba013 bash[29418]: cephadm 2021-03-10T15:06:42.196680+0000 mgr.gibba020.yqfnwy (mgr.34427) 3915 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:06:44.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:43 gibba013 bash[29418]: cephadm 2021-03-10T15:06:42.196757+0000 mgr.gibba020.yqfnwy (mgr.34427) 3916 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:06:44.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:43 gibba013 bash[29418]: cephadm 2021-03-10T15:06:42.198688+0000 mgr.gibba020.yqfnwy (mgr.34427) 3917 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:06:44.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:43 gibba013 bash[29418]: cephadm 2021-03-10T15:06:42.198764+0000 mgr.gibba020.yqfnwy (mgr.34427) 3918 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:06:44.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:43 gibba013 bash[29418]: cephadm 2021-03-10T15:06:42.200397+0000 mgr.gibba020.yqfnwy (mgr.34427) 3919 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:06:44.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:43 gibba013 bash[29418]: cephadm 2021-03-10T15:06:42.201627+0000 mgr.gibba020.yqfnwy (mgr.34427) 3920 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:06:44.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:43 gibba013 bash[29418]: cephadm 2021-03-10T15:06:42.201830+0000 mgr.gibba020.yqfnwy (mgr.34427) 3921 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:06:44.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:43 gibba013 bash[29418]: cephadm 2021-03-10T15:06:42.203572+0000 mgr.gibba020.yqfnwy (mgr.34427) 3922 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:06:44.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:43 gibba013 bash[29418]: cephadm 2021-03-10T15:06:42.204585+0000 mgr.gibba020.yqfnwy (mgr.34427) 3923 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:06:44.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:43 gibba013 bash[29418]: cephadm 2021-03-10T15:06:42.206184+0000 mgr.gibba020.yqfnwy (mgr.34427) 3924 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:06:44.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:43 gibba013 bash[29418]: cephadm 2021-03-10T15:06:42.206344+0000 mgr.gibba020.yqfnwy (mgr.34427) 3925 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:06:44.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:43 gibba013 bash[29418]: cephadm 2021-03-10T15:06:42.206615+0000 mgr.gibba020.yqfnwy (mgr.34427) 3926 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:06:44.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:43 gibba013 bash[30381]: cephadm 2021-03-10T15:06:41.919904+0000 mgr.gibba020.yqfnwy (mgr.34427) 3911 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:06:44.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:43 gibba013 bash[30381]: cephadm 2021-03-10T15:06:41.921528+0000 mgr.gibba020.yqfnwy (mgr.34427) 3912 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:06:44.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:43 gibba013 bash[30381]: cephadm 2021-03-10T15:06:42.191692+0000 mgr.gibba020.yqfnwy (mgr.34427) 3913 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:06:44.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:43 gibba013 bash[30381]: cephadm 2021-03-10T15:06:42.194707+0000 mgr.gibba020.yqfnwy (mgr.34427) 3914 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:06:44.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:43 gibba013 bash[30381]: cephadm 2021-03-10T15:06:42.196680+0000 mgr.gibba020.yqfnwy (mgr.34427) 3915 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:06:44.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:43 gibba013 bash[30381]: cephadm 2021-03-10T15:06:42.196757+0000 mgr.gibba020.yqfnwy (mgr.34427) 3916 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:06:44.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:43 gibba013 bash[30381]: cephadm 2021-03-10T15:06:42.198688+0000 mgr.gibba020.yqfnwy (mgr.34427) 3917 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:06:44.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:43 gibba013 bash[30381]: cephadm 2021-03-10T15:06:42.198764+0000 mgr.gibba020.yqfnwy (mgr.34427) 3918 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:06:44.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:43 gibba013 bash[30381]: cephadm 2021-03-10T15:06:42.200397+0000 mgr.gibba020.yqfnwy (mgr.34427) 3919 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:06:44.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:43 gibba013 bash[30381]: cephadm 2021-03-10T15:06:42.201627+0000 mgr.gibba020.yqfnwy (mgr.34427) 3920 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:06:44.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:43 gibba013 bash[30381]: cephadm 2021-03-10T15:06:42.201830+0000 mgr.gibba020.yqfnwy (mgr.34427) 3921 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:06:44.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:43 gibba013 bash[30381]: cephadm 2021-03-10T15:06:42.203572+0000 mgr.gibba020.yqfnwy (mgr.34427) 3922 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:06:44.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:43 gibba013 bash[30381]: cephadm 2021-03-10T15:06:42.204585+0000 mgr.gibba020.yqfnwy (mgr.34427) 3923 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:06:44.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:43 gibba013 bash[30381]: cephadm 2021-03-10T15:06:42.206184+0000 mgr.gibba020.yqfnwy (mgr.34427) 3924 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:06:44.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:43 gibba013 bash[30381]: cephadm 2021-03-10T15:06:42.206344+0000 mgr.gibba020.yqfnwy (mgr.34427) 3925 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:06:44.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:43 gibba013 bash[30381]: cephadm 2021-03-10T15:06:42.206615+0000 mgr.gibba020.yqfnwy (mgr.34427) 3926 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:06:44.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:44 gibba020 bash[25448]: cluster 2021-03-10T15:06:43.571134+0000 mgr.gibba020.yqfnwy (mgr.34427) 3927 : cluster [DBG] pgmap v2222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:45.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:44 gibba013 bash[29418]: cluster 2021-03-10T15:06:43.571134+0000 mgr.gibba020.yqfnwy (mgr.34427) 3927 : cluster [DBG] pgmap v2222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:45.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:44 gibba013 bash[30381]: cluster 2021-03-10T15:06:43.571134+0000 mgr.gibba020.yqfnwy (mgr.34427) 3927 : cluster [DBG] pgmap v2222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:46.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:46 gibba020 bash[25448]: cluster 2021-03-10T15:06:45.572741+0000 mgr.gibba020.yqfnwy (mgr.34427) 3928 : cluster [DBG] pgmap v2223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:47.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:46 gibba013 bash[29418]: cluster 2021-03-10T15:06:45.572741+0000 mgr.gibba020.yqfnwy (mgr.34427) 3928 : cluster [DBG] pgmap v2223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:47.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:46 gibba013 bash[30381]: cluster 2021-03-10T15:06:45.572741+0000 mgr.gibba020.yqfnwy (mgr.34427) 3928 : cluster [DBG] pgmap v2223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:48.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:47 gibba013 bash[29418]: cluster 2021-03-10T15:06:47.574099+0000 mgr.gibba020.yqfnwy (mgr.34427) 3929 : cluster [DBG] pgmap v2224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:48.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:47 gibba013 bash[30381]: cluster 2021-03-10T15:06:47.574099+0000 mgr.gibba020.yqfnwy (mgr.34427) 3929 : cluster [DBG] pgmap v2224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:48.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:47 gibba020 bash[25448]: cluster 2021-03-10T15:06:47.574099+0000 mgr.gibba020.yqfnwy (mgr.34427) 3929 : cluster [DBG] pgmap v2224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:50.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:50 gibba020 bash[25448]: cluster 2021-03-10T15:06:49.575460+0000 mgr.gibba020.yqfnwy (mgr.34427) 3930 : cluster [DBG] pgmap v2225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:51.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:50 gibba013 bash[29418]: cluster 2021-03-10T15:06:49.575460+0000 mgr.gibba020.yqfnwy (mgr.34427) 3930 : cluster [DBG] pgmap v2225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:51.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:50 gibba013 bash[30381]: cluster 2021-03-10T15:06:49.575460+0000 mgr.gibba020.yqfnwy (mgr.34427) 3930 : cluster [DBG] pgmap v2225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:52.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:52 gibba020 bash[25448]: cluster 2021-03-10T15:06:51.577267+0000 mgr.gibba020.yqfnwy (mgr.34427) 3931 : cluster [DBG] pgmap v2226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:53.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:52 gibba013 bash[29418]: cluster 2021-03-10T15:06:51.577267+0000 mgr.gibba020.yqfnwy (mgr.34427) 3931 : cluster [DBG] pgmap v2226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:53.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:52 gibba013 bash[30381]: cluster 2021-03-10T15:06:51.577267+0000 mgr.gibba020.yqfnwy (mgr.34427) 3931 : cluster [DBG] pgmap v2226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:54.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:54 gibba020 bash[25448]: cluster 2021-03-10T15:06:53.578679+0000 mgr.gibba020.yqfnwy (mgr.34427) 3932 : cluster [DBG] pgmap v2227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:55.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:54 gibba013 bash[29418]: cluster 2021-03-10T15:06:53.578679+0000 mgr.gibba020.yqfnwy (mgr.34427) 3932 : cluster [DBG] pgmap v2227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:55.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:54 gibba013 bash[30381]: cluster 2021-03-10T15:06:53.578679+0000 mgr.gibba020.yqfnwy (mgr.34427) 3932 : cluster [DBG] pgmap v2227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:56.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:56 gibba020 bash[25448]: cluster 2021-03-10T15:06:55.580456+0000 mgr.gibba020.yqfnwy (mgr.34427) 3933 : cluster [DBG] pgmap v2228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:57.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:56 gibba013 bash[29418]: cluster 2021-03-10T15:06:55.580456+0000 mgr.gibba020.yqfnwy (mgr.34427) 3933 : cluster [DBG] pgmap v2228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:57.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:56 gibba013 bash[30381]: cluster 2021-03-10T15:06:55.580456+0000 mgr.gibba020.yqfnwy (mgr.34427) 3933 : cluster [DBG] pgmap v2228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:58.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:57 gibba013 bash[29418]: cephadm 2021-03-10T15:06:57.222230+0000 mgr.gibba020.yqfnwy (mgr.34427) 3934 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:06:58.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:06:57 gibba013 bash[29418]: cluster 2021-03-10T15:06:57.581736+0000 mgr.gibba020.yqfnwy (mgr.34427) 3935 : cluster [DBG] pgmap v2229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:58.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:57 gibba013 bash[30381]: cephadm 2021-03-10T15:06:57.222230+0000 mgr.gibba020.yqfnwy (mgr.34427) 3934 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:06:58.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:06:57 gibba013 bash[30381]: cluster 2021-03-10T15:06:57.581736+0000 mgr.gibba020.yqfnwy (mgr.34427) 3935 : cluster [DBG] pgmap v2229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:06:58.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:57 gibba020 bash[25448]: cephadm 2021-03-10T15:06:57.222230+0000 mgr.gibba020.yqfnwy (mgr.34427) 3934 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:06:58.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:06:57 gibba020 bash[25448]: cluster 2021-03-10T15:06:57.581736+0000 mgr.gibba020.yqfnwy (mgr.34427) 3935 : cluster [DBG] pgmap v2229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:00.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:00 gibba020 bash[25448]: cluster 2021-03-10T15:06:59.583106+0000 mgr.gibba020.yqfnwy (mgr.34427) 3936 : cluster [DBG] pgmap v2230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:01.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:00 gibba013 bash[29418]: cluster 2021-03-10T15:06:59.583106+0000 mgr.gibba020.yqfnwy (mgr.34427) 3936 : cluster [DBG] pgmap v2230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:01.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:00 gibba013 bash[30381]: cluster 2021-03-10T15:06:59.583106+0000 mgr.gibba020.yqfnwy (mgr.34427) 3936 : cluster [DBG] pgmap v2230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:02.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:02 gibba020 bash[25448]: cluster 2021-03-10T15:07:01.584954+0000 mgr.gibba020.yqfnwy (mgr.34427) 3937 : cluster [DBG] pgmap v2231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:03.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:02 gibba013 bash[29418]: cluster 2021-03-10T15:07:01.584954+0000 mgr.gibba020.yqfnwy (mgr.34427) 3937 : cluster [DBG] pgmap v2231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:03.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:02 gibba013 bash[30381]: cluster 2021-03-10T15:07:01.584954+0000 mgr.gibba020.yqfnwy (mgr.34427) 3937 : cluster [DBG] pgmap v2231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:04.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:04 gibba020 bash[25448]: cluster 2021-03-10T15:07:03.586322+0000 mgr.gibba020.yqfnwy (mgr.34427) 3938 : cluster [DBG] pgmap v2232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:05.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:04 gibba013 bash[29418]: cluster 2021-03-10T15:07:03.586322+0000 mgr.gibba020.yqfnwy (mgr.34427) 3938 : cluster [DBG] pgmap v2232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:05.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:04 gibba013 bash[30381]: cluster 2021-03-10T15:07:03.586322+0000 mgr.gibba020.yqfnwy (mgr.34427) 3938 : cluster [DBG] pgmap v2232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:05.636 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:07:05.862 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:07:05.863 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (73m) 8m ago 78m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:07:05.863 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (78m) 7m ago 78m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:07:05.863 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (74m) 7m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:07:05.864 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (74m) 7m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:07:05.864 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (73m) 8m ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:07:05.864 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (73m) 8m ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:07:05.864 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (72m) 7m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:07:05.864 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (72m) 8m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:07:05.865 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (79m) 8m ago 79m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:07:05.865 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (79m) 7m ago 79m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:07:05.865 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (71m) 8m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:07:05.865 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (71m) 8m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:07:05.865 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (71m) 8m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:07:05.866 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (70m) 8m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:07:05.866 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (70m) 7m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:07:05.866 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (69m) 7m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:07:05.867 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (69m) 7m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:07:05.867 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (68m) 7m ago 79m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:07:05.867 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (78m) 7m ago 79m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:07:05.867 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 7m ago 77m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:07:06.109 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:07:06.109 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:07:06.110 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:07:06.110 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:07:06.110 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:07:06.110 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:07:06.111 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:07:06.111 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:07:06.111 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:07:06.111 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:07:06.111 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:07:06.112 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:07:06.112 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:07:06.112 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:07:06.112 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:07:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:06 gibba020 bash[25448]: cluster 2021-03-10T15:07:05.588076+0000 mgr.gibba020.yqfnwy (mgr.34427) 3939 : cluster [DBG] pgmap v2233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:06 gibba020 bash[25448]: audit 2021-03-10T15:07:05.623139+0000 mgr.gibba020.yqfnwy (mgr.34427) 3940 : audit [DBG] from='client.46698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:07:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:06 gibba020 bash[25448]: audit 2021-03-10T15:07:06.106138+0000 mon.a (mon.0) 1733 : audit [DBG] from='client.? 172.21.2.113:0/3762194077' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:06 gibba020 bash[25448]: audit 2021-03-10T15:07:06.344844+0000 mon.a (mon.0) 1734 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:07:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:06 gibba020 bash[25448]: audit 2021-03-10T15:07:06.377058+0000 mon.a (mon.0) 1735 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:07:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:06 gibba020 bash[25448]: audit 2021-03-10T15:07:06.435257+0000 mon.a (mon.0) 1736 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T15:07:06.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:06 gibba020 bash[25448]: audit 2021-03-10T15:07:06.435972+0000 mon.a (mon.0) 1737 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:07:06.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:06 gibba020 bash[25448]: audit 2021-03-10T15:07:06.436643+0000 mon.a (mon.0) 1738 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:07:06.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:06 gibba020 bash[25448]: audit 2021-03-10T15:07:06.437279+0000 mon.a (mon.0) 1739 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:07:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:06 gibba013 bash[29418]: cluster 2021-03-10T15:07:05.588076+0000 mgr.gibba020.yqfnwy (mgr.34427) 3939 : cluster [DBG] pgmap v2233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:07.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:06 gibba013 bash[29418]: audit 2021-03-10T15:07:05.623139+0000 mgr.gibba020.yqfnwy (mgr.34427) 3940 : audit [DBG] from='client.46698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:07:07.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:06 gibba013 bash[29418]: audit 2021-03-10T15:07:06.106138+0000 mon.a (mon.0) 1733 : audit [DBG] from='client.? 172.21.2.113:0/3762194077' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:07.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:06 gibba013 bash[29418]: audit 2021-03-10T15:07:06.344844+0000 mon.a (mon.0) 1734 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:07:07.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:06 gibba013 bash[29418]: audit 2021-03-10T15:07:06.377058+0000 mon.a (mon.0) 1735 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:07:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:06 gibba013 bash[29418]: audit 2021-03-10T15:07:06.435257+0000 mon.a (mon.0) 1736 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T15:07:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:06 gibba013 bash[29418]: audit 2021-03-10T15:07:06.435972+0000 mon.a (mon.0) 1737 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:07:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:06 gibba013 bash[29418]: audit 2021-03-10T15:07:06.436643+0000 mon.a (mon.0) 1738 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:07:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:06 gibba013 bash[29418]: audit 2021-03-10T15:07:06.437279+0000 mon.a (mon.0) 1739 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:07:07.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:06 gibba013 bash[30381]: cluster 2021-03-10T15:07:05.588076+0000 mgr.gibba020.yqfnwy (mgr.34427) 3939 : cluster [DBG] pgmap v2233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:07.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:06 gibba013 bash[30381]: audit 2021-03-10T15:07:05.623139+0000 mgr.gibba020.yqfnwy (mgr.34427) 3940 : audit [DBG] from='client.46698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:07:07.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:06 gibba013 bash[30381]: audit 2021-03-10T15:07:06.106138+0000 mon.a (mon.0) 1733 : audit [DBG] from='client.? 172.21.2.113:0/3762194077' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:07.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:06 gibba013 bash[30381]: audit 2021-03-10T15:07:06.344844+0000 mon.a (mon.0) 1734 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:07:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:06 gibba013 bash[30381]: audit 2021-03-10T15:07:06.377058+0000 mon.a (mon.0) 1735 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:07:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:06 gibba013 bash[30381]: audit 2021-03-10T15:07:06.435257+0000 mon.a (mon.0) 1736 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T15:07:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:06 gibba013 bash[30381]: audit 2021-03-10T15:07:06.435972+0000 mon.a (mon.0) 1737 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:07:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:06 gibba013 bash[30381]: audit 2021-03-10T15:07:06.436643+0000 mon.a (mon.0) 1738 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:07:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:06 gibba013 bash[30381]: audit 2021-03-10T15:07:06.437279+0000 mon.a (mon.0) 1739 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:07:07.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:07 gibba020 bash[25448]: audit 2021-03-10T15:07:05.848480+0000 mgr.gibba020.yqfnwy (mgr.34427) 3941 : audit [DBG] from='client.56689 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:07:08.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:07 gibba013 bash[29418]: audit 2021-03-10T15:07:05.848480+0000 mgr.gibba020.yqfnwy (mgr.34427) 3941 : audit [DBG] from='client.56689 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:07:08.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:07 gibba013 bash[30381]: audit 2021-03-10T15:07:05.848480+0000 mgr.gibba020.yqfnwy (mgr.34427) 3941 : audit [DBG] from='client.56689 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:07:08.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:08 gibba020 bash[25448]: cluster 2021-03-10T15:07:07.589658+0000 mgr.gibba020.yqfnwy (mgr.34427) 3942 : cluster [DBG] pgmap v2234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:09.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:08 gibba013 bash[29418]: cluster 2021-03-10T15:07:07.589658+0000 mgr.gibba020.yqfnwy (mgr.34427) 3942 : cluster [DBG] pgmap v2234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:09.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:08 gibba013 bash[30381]: cluster 2021-03-10T15:07:07.589658+0000 mgr.gibba020.yqfnwy (mgr.34427) 3942 : cluster [DBG] pgmap v2234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:10.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:10 gibba020 bash[25448]: cluster 2021-03-10T15:07:09.591016+0000 mgr.gibba020.yqfnwy (mgr.34427) 3943 : cluster [DBG] pgmap v2235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:11.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:10 gibba013 bash[29418]: cluster 2021-03-10T15:07:09.591016+0000 mgr.gibba020.yqfnwy (mgr.34427) 3943 : cluster [DBG] pgmap v2235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:11.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:10 gibba013 bash[30381]: cluster 2021-03-10T15:07:09.591016+0000 mgr.gibba020.yqfnwy (mgr.34427) 3943 : cluster [DBG] pgmap v2235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:13.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:12 gibba013 bash[29418]: cluster 2021-03-10T15:07:11.592882+0000 mgr.gibba020.yqfnwy (mgr.34427) 3944 : cluster [DBG] pgmap v2236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:13.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:12 gibba013 bash[30381]: cluster 2021-03-10T15:07:11.592882+0000 mgr.gibba020.yqfnwy (mgr.34427) 3944 : cluster [DBG] pgmap v2236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:13.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:12 gibba020 bash[25448]: cluster 2021-03-10T15:07:11.592882+0000 mgr.gibba020.yqfnwy (mgr.34427) 3944 : cluster [DBG] pgmap v2236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:14.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:13 gibba013 bash[29418]: cephadm 2021-03-10T15:07:12.237735+0000 mgr.gibba020.yqfnwy (mgr.34427) 3945 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:07:14.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:13 gibba013 bash[30381]: cephadm 2021-03-10T15:07:12.237735+0000 mgr.gibba020.yqfnwy (mgr.34427) 3945 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:07:14.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:13 gibba020 bash[25448]: cephadm 2021-03-10T15:07:12.237735+0000 mgr.gibba020.yqfnwy (mgr.34427) 3945 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:07:15.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:14 gibba013 bash[29418]: cluster 2021-03-10T15:07:13.594254+0000 mgr.gibba020.yqfnwy (mgr.34427) 3946 : cluster [DBG] pgmap v2237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:15.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:14 gibba013 bash[30381]: cluster 2021-03-10T15:07:13.594254+0000 mgr.gibba020.yqfnwy (mgr.34427) 3946 : cluster [DBG] pgmap v2237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:15.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:14 gibba020 bash[25448]: cluster 2021-03-10T15:07:13.594254+0000 mgr.gibba020.yqfnwy (mgr.34427) 3946 : cluster [DBG] pgmap v2237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:17.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:16 gibba013 bash[29418]: cluster 2021-03-10T15:07:15.595832+0000 mgr.gibba020.yqfnwy (mgr.34427) 3947 : cluster [DBG] pgmap v2238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:17.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:16 gibba013 bash[30381]: cluster 2021-03-10T15:07:15.595832+0000 mgr.gibba020.yqfnwy (mgr.34427) 3947 : cluster [DBG] pgmap v2238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:17.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:16 gibba020 bash[25448]: cluster 2021-03-10T15:07:15.595832+0000 mgr.gibba020.yqfnwy (mgr.34427) 3947 : cluster [DBG] pgmap v2238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:18.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:17 gibba013 bash[29418]: cluster 2021-03-10T15:07:17.597122+0000 mgr.gibba020.yqfnwy (mgr.34427) 3948 : cluster [DBG] pgmap v2239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:18.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:17 gibba013 bash[30381]: cluster 2021-03-10T15:07:17.597122+0000 mgr.gibba020.yqfnwy (mgr.34427) 3948 : cluster [DBG] pgmap v2239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:18.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:17 gibba020 bash[25448]: cluster 2021-03-10T15:07:17.597122+0000 mgr.gibba020.yqfnwy (mgr.34427) 3948 : cluster [DBG] pgmap v2239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:20.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:20 gibba020 bash[25448]: cluster 2021-03-10T15:07:19.598486+0000 mgr.gibba020.yqfnwy (mgr.34427) 3949 : cluster [DBG] pgmap v2240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:21.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:20 gibba013 bash[29418]: cluster 2021-03-10T15:07:19.598486+0000 mgr.gibba020.yqfnwy (mgr.34427) 3949 : cluster [DBG] pgmap v2240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:21.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:20 gibba013 bash[30381]: cluster 2021-03-10T15:07:19.598486+0000 mgr.gibba020.yqfnwy (mgr.34427) 3949 : cluster [DBG] pgmap v2240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:22.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:22 gibba020 bash[25448]: cluster 2021-03-10T15:07:21.600283+0000 mgr.gibba020.yqfnwy (mgr.34427) 3950 : cluster [DBG] pgmap v2241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:23.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:22 gibba013 bash[29418]: cluster 2021-03-10T15:07:21.600283+0000 mgr.gibba020.yqfnwy (mgr.34427) 3950 : cluster [DBG] pgmap v2241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:23.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:22 gibba013 bash[30381]: cluster 2021-03-10T15:07:21.600283+0000 mgr.gibba020.yqfnwy (mgr.34427) 3950 : cluster [DBG] pgmap v2241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:24.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:24 gibba020 bash[25448]: cluster 2021-03-10T15:07:23.601939+0000 mgr.gibba020.yqfnwy (mgr.34427) 3951 : cluster [DBG] pgmap v2242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:25.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:24 gibba013 bash[29418]: cluster 2021-03-10T15:07:23.601939+0000 mgr.gibba020.yqfnwy (mgr.34427) 3951 : cluster [DBG] pgmap v2242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:25.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:24 gibba013 bash[30381]: cluster 2021-03-10T15:07:23.601939+0000 mgr.gibba020.yqfnwy (mgr.34427) 3951 : cluster [DBG] pgmap v2242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:26.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:26 gibba020 bash[25448]: cluster 2021-03-10T15:07:25.603622+0000 mgr.gibba020.yqfnwy (mgr.34427) 3952 : cluster [DBG] pgmap v2243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:27.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:26 gibba013 bash[29418]: cluster 2021-03-10T15:07:25.603622+0000 mgr.gibba020.yqfnwy (mgr.34427) 3952 : cluster [DBG] pgmap v2243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:27.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:26 gibba013 bash[30381]: cluster 2021-03-10T15:07:25.603622+0000 mgr.gibba020.yqfnwy (mgr.34427) 3952 : cluster [DBG] pgmap v2243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:28.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:27 gibba013 bash[29418]: cephadm 2021-03-10T15:07:27.253337+0000 mgr.gibba020.yqfnwy (mgr.34427) 3953 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:07:28.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:27 gibba013 bash[29418]: cluster 2021-03-10T15:07:27.605188+0000 mgr.gibba020.yqfnwy (mgr.34427) 3954 : cluster [DBG] pgmap v2244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:28.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:27 gibba013 bash[30381]: cephadm 2021-03-10T15:07:27.253337+0000 mgr.gibba020.yqfnwy (mgr.34427) 3953 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:07:28.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:27 gibba013 bash[30381]: cluster 2021-03-10T15:07:27.605188+0000 mgr.gibba020.yqfnwy (mgr.34427) 3954 : cluster [DBG] pgmap v2244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:28.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:27 gibba020 bash[25448]: cephadm 2021-03-10T15:07:27.253337+0000 mgr.gibba020.yqfnwy (mgr.34427) 3953 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:07:28.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:27 gibba020 bash[25448]: cluster 2021-03-10T15:07:27.605188+0000 mgr.gibba020.yqfnwy (mgr.34427) 3954 : cluster [DBG] pgmap v2244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:30.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:30 gibba020 bash[25448]: cluster 2021-03-10T15:07:29.606556+0000 mgr.gibba020.yqfnwy (mgr.34427) 3955 : cluster [DBG] pgmap v2245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:31.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:30 gibba013 bash[29418]: cluster 2021-03-10T15:07:29.606556+0000 mgr.gibba020.yqfnwy (mgr.34427) 3955 : cluster [DBG] pgmap v2245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:31.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:30 gibba013 bash[30381]: cluster 2021-03-10T15:07:29.606556+0000 mgr.gibba020.yqfnwy (mgr.34427) 3955 : cluster [DBG] pgmap v2245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:32.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:32 gibba020 bash[25448]: cluster 2021-03-10T15:07:31.608216+0000 mgr.gibba020.yqfnwy (mgr.34427) 3956 : cluster [DBG] pgmap v2246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:33.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:32 gibba013 bash[29418]: cluster 2021-03-10T15:07:31.608216+0000 mgr.gibba020.yqfnwy (mgr.34427) 3956 : cluster [DBG] pgmap v2246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:33.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:32 gibba013 bash[30381]: cluster 2021-03-10T15:07:31.608216+0000 mgr.gibba020.yqfnwy (mgr.34427) 3956 : cluster [DBG] pgmap v2246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:34.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:34 gibba020 bash[25448]: cluster 2021-03-10T15:07:33.609600+0000 mgr.gibba020.yqfnwy (mgr.34427) 3957 : cluster [DBG] pgmap v2247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:35.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:34 gibba013 bash[29418]: cluster 2021-03-10T15:07:33.609600+0000 mgr.gibba020.yqfnwy (mgr.34427) 3957 : cluster [DBG] pgmap v2247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:35.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:34 gibba013 bash[30381]: cluster 2021-03-10T15:07:33.609600+0000 mgr.gibba020.yqfnwy (mgr.34427) 3957 : cluster [DBG] pgmap v2247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:36.353 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:07:36.581 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:07:36.581 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (74m) 9m ago 79m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:07:36.581 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (79m) 7m ago 79m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:07:36.582 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (74m) 7m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:07:36.582 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (74m) 7m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:07:36.582 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (73m) 9m ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:07:36.582 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (73m) 9m ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:07:36.583 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (73m) 7m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:07:36.583 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (73m) 9m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:07:36.583 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (79m) 9m ago 79m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:07:36.583 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (79m) 7m ago 79m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:07:36.583 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (72m) 9m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:07:36.584 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (71m) 9m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:07:36.584 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (71m) 9m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:07:36.584 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (71m) 9m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:07:36.584 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (70m) 7m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:07:36.585 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (70m) 7m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:07:36.585 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (69m) 7m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:07:36.585 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (69m) 7m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:07:36.585 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (79m) 7m ago 79m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:07:36.585 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 7m ago 77m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:07:36.843 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:07:36.844 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:07:36.844 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:07:36.844 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:07:36.844 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:07:36.845 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:07:36.845 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:07:36.845 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:07:36.845 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:07:36.845 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:07:36.846 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:07:36.846 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:07:36.846 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:07:36.846 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:07:36.846 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:07:36.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:36 gibba020 bash[25448]: cluster 2021-03-10T15:07:35.611268+0000 mgr.gibba020.yqfnwy (mgr.34427) 3958 : cluster [DBG] pgmap v2248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:37.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:36 gibba013 bash[29418]: cluster 2021-03-10T15:07:35.611268+0000 mgr.gibba020.yqfnwy (mgr.34427) 3958 : cluster [DBG] pgmap v2248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:37.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:36 gibba013 bash[30381]: cluster 2021-03-10T15:07:35.611268+0000 mgr.gibba020.yqfnwy (mgr.34427) 3958 : cluster [DBG] pgmap v2248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:38.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:37 gibba013 bash[29418]: audit 2021-03-10T15:07:36.339640+0000 mgr.gibba020.yqfnwy (mgr.34427) 3959 : audit [DBG] from='client.46716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:07:38.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:37 gibba013 bash[29418]: audit 2021-03-10T15:07:36.564757+0000 mgr.gibba020.yqfnwy (mgr.34427) 3960 : audit [DBG] from='client.46722 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:07:38.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:37 gibba013 bash[29418]: audit 2021-03-10T15:07:36.840274+0000 mon.c (mon.1) 73 : audit [DBG] from='client.? 172.21.2.113:0/4254857217' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:38.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:37 gibba013 bash[30381]: audit 2021-03-10T15:07:36.339640+0000 mgr.gibba020.yqfnwy (mgr.34427) 3959 : audit [DBG] from='client.46716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:07:38.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:37 gibba013 bash[30381]: audit 2021-03-10T15:07:36.564757+0000 mgr.gibba020.yqfnwy (mgr.34427) 3960 : audit [DBG] from='client.46722 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:07:38.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:37 gibba013 bash[30381]: audit 2021-03-10T15:07:36.840274+0000 mon.c (mon.1) 73 : audit [DBG] from='client.? 172.21.2.113:0/4254857217' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:38.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:37 gibba020 bash[25448]: audit 2021-03-10T15:07:36.339640+0000 mgr.gibba020.yqfnwy (mgr.34427) 3959 : audit [DBG] from='client.46716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:07:38.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:37 gibba020 bash[25448]: audit 2021-03-10T15:07:36.564757+0000 mgr.gibba020.yqfnwy (mgr.34427) 3960 : audit [DBG] from='client.46722 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:07:38.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:37 gibba020 bash[25448]: audit 2021-03-10T15:07:36.840274+0000 mon.c (mon.1) 73 : audit [DBG] from='client.? 172.21.2.113:0/4254857217' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:39.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:38 gibba013 bash[29418]: cluster 2021-03-10T15:07:37.612857+0000 mgr.gibba020.yqfnwy (mgr.34427) 3961 : cluster [DBG] pgmap v2249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:39.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:38 gibba013 bash[30381]: cluster 2021-03-10T15:07:37.612857+0000 mgr.gibba020.yqfnwy (mgr.34427) 3961 : cluster [DBG] pgmap v2249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:39.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:38 gibba020 bash[25448]: cluster 2021-03-10T15:07:37.612857+0000 mgr.gibba020.yqfnwy (mgr.34427) 3961 : cluster [DBG] pgmap v2249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:41.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:40 gibba013 bash[29418]: cluster 2021-03-10T15:07:39.614320+0000 mgr.gibba020.yqfnwy (mgr.34427) 3962 : cluster [DBG] pgmap v2250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:41.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:40 gibba013 bash[30381]: cluster 2021-03-10T15:07:39.614320+0000 mgr.gibba020.yqfnwy (mgr.34427) 3962 : cluster [DBG] pgmap v2250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:41.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:40 gibba020 bash[25448]: cluster 2021-03-10T15:07:39.614320+0000 mgr.gibba020.yqfnwy (mgr.34427) 3962 : cluster [DBG] pgmap v2250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:42.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:42 gibba020 bash[25448]: cluster 2021-03-10T15:07:41.616224+0000 mgr.gibba020.yqfnwy (mgr.34427) 3963 : cluster [DBG] pgmap v2251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:42.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:42 gibba020 bash[25448]: audit 2021-03-10T15:07:42.264188+0000 mon.a (mon.0) 1740 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:07:42.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:42 gibba020 bash[25448]: audit 2021-03-10T15:07:42.510852+0000 mon.a (mon.0) 1741 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:07:42.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:42 gibba020 bash[25448]: audit 2021-03-10T15:07:42.514390+0000 mon.a (mon.0) 1742 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:07:42.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:42 gibba020 bash[25448]: audit 2021-03-10T15:07:42.516143+0000 mon.a (mon.0) 1743 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:42.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:42 gibba020 bash[25448]: audit 2021-03-10T15:07:42.519900+0000 mon.a (mon.0) 1744 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:42.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:42 gibba020 bash[25448]: audit 2021-03-10T15:07:42.523259+0000 mon.a (mon.0) 1745 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:42.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:42 gibba020 bash[25448]: audit 2021-03-10T15:07:42.530130+0000 mon.a (mon.0) 1746 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:42.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:42 gibba020 bash[25448]: audit 2021-03-10T15:07:42.535228+0000 mon.a (mon.0) 1747 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:43.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:42 gibba013 bash[29418]: cluster 2021-03-10T15:07:41.616224+0000 mgr.gibba020.yqfnwy (mgr.34427) 3963 : cluster [DBG] pgmap v2251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:43.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:42 gibba013 bash[29418]: audit 2021-03-10T15:07:42.264188+0000 mon.a (mon.0) 1740 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:07:43.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:42 gibba013 bash[29418]: audit 2021-03-10T15:07:42.510852+0000 mon.a (mon.0) 1741 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:07:43.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:42 gibba013 bash[29418]: audit 2021-03-10T15:07:42.514390+0000 mon.a (mon.0) 1742 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:07:43.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:42 gibba013 bash[29418]: audit 2021-03-10T15:07:42.516143+0000 mon.a (mon.0) 1743 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:43.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:42 gibba013 bash[29418]: audit 2021-03-10T15:07:42.519900+0000 mon.a (mon.0) 1744 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:43.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:42 gibba013 bash[29418]: audit 2021-03-10T15:07:42.523259+0000 mon.a (mon.0) 1745 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:43.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:42 gibba013 bash[29418]: audit 2021-03-10T15:07:42.530130+0000 mon.a (mon.0) 1746 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:43.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:42 gibba013 bash[29418]: audit 2021-03-10T15:07:42.535228+0000 mon.a (mon.0) 1747 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:43.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:42 gibba013 bash[30381]: cluster 2021-03-10T15:07:41.616224+0000 mgr.gibba020.yqfnwy (mgr.34427) 3963 : cluster [DBG] pgmap v2251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:43.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:42 gibba013 bash[30381]: audit 2021-03-10T15:07:42.264188+0000 mon.a (mon.0) 1740 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:07:43.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:42 gibba013 bash[30381]: audit 2021-03-10T15:07:42.510852+0000 mon.a (mon.0) 1741 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:07:43.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:42 gibba013 bash[30381]: audit 2021-03-10T15:07:42.514390+0000 mon.a (mon.0) 1742 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:07:43.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:42 gibba013 bash[30381]: audit 2021-03-10T15:07:42.516143+0000 mon.a (mon.0) 1743 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:43.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:42 gibba013 bash[30381]: audit 2021-03-10T15:07:42.519900+0000 mon.a (mon.0) 1744 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:43.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:42 gibba013 bash[30381]: audit 2021-03-10T15:07:42.523259+0000 mon.a (mon.0) 1745 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:43.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:42 gibba013 bash[30381]: audit 2021-03-10T15:07:42.530130+0000 mon.a (mon.0) 1746 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:43.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:42 gibba013 bash[30381]: audit 2021-03-10T15:07:42.535228+0000 mon.a (mon.0) 1747 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:07:44.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:43 gibba013 bash[29418]: cephadm 2021-03-10T15:07:42.268566+0000 mgr.gibba020.yqfnwy (mgr.34427) 3964 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:07:44.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:43 gibba013 bash[29418]: cephadm 2021-03-10T15:07:42.270624+0000 mgr.gibba020.yqfnwy (mgr.34427) 3965 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:07:44.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:43 gibba013 bash[29418]: cephadm 2021-03-10T15:07:42.512686+0000 mgr.gibba020.yqfnwy (mgr.34427) 3966 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:07:44.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:43 gibba013 bash[29418]: cephadm 2021-03-10T15:07:42.514629+0000 mgr.gibba020.yqfnwy (mgr.34427) 3967 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:07:44.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:43 gibba013 bash[29418]: cephadm 2021-03-10T15:07:42.517425+0000 mgr.gibba020.yqfnwy (mgr.34427) 3968 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:07:44.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:43 gibba013 bash[29418]: cephadm 2021-03-10T15:07:42.517966+0000 mgr.gibba020.yqfnwy (mgr.34427) 3969 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:07:44.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:43 gibba013 bash[29418]: cephadm 2021-03-10T15:07:42.521033+0000 mgr.gibba020.yqfnwy (mgr.34427) 3970 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:07:44.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:43 gibba013 bash[29418]: cephadm 2021-03-10T15:07:42.521600+0000 mgr.gibba020.yqfnwy (mgr.34427) 3971 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:07:44.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:43 gibba013 bash[29418]: cephadm 2021-03-10T15:07:42.524298+0000 mgr.gibba020.yqfnwy (mgr.34427) 3972 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:07:44.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:43 gibba013 bash[29418]: cephadm 2021-03-10T15:07:42.527146+0000 mgr.gibba020.yqfnwy (mgr.34427) 3973 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:07:44.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:43 gibba013 bash[29418]: cephadm 2021-03-10T15:07:42.527454+0000 mgr.gibba020.yqfnwy (mgr.34427) 3974 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:07:44.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:43 gibba013 bash[29418]: cephadm 2021-03-10T15:07:42.531371+0000 mgr.gibba020.yqfnwy (mgr.34427) 3975 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:07:44.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:43 gibba013 bash[29418]: cephadm 2021-03-10T15:07:42.533305+0000 mgr.gibba020.yqfnwy (mgr.34427) 3976 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:07:44.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:43 gibba013 bash[29418]: cephadm 2021-03-10T15:07:42.536381+0000 mgr.gibba020.yqfnwy (mgr.34427) 3977 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:07:44.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:43 gibba013 bash[29418]: cephadm 2021-03-10T15:07:42.536653+0000 mgr.gibba020.yqfnwy (mgr.34427) 3978 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:07:44.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:43 gibba013 bash[29418]: cephadm 2021-03-10T15:07:42.537389+0000 mgr.gibba020.yqfnwy (mgr.34427) 3979 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:07:44.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:43 gibba013 bash[30381]: cephadm 2021-03-10T15:07:42.268566+0000 mgr.gibba020.yqfnwy (mgr.34427) 3964 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:07:44.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:43 gibba013 bash[30381]: cephadm 2021-03-10T15:07:42.270624+0000 mgr.gibba020.yqfnwy (mgr.34427) 3965 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:07:44.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:43 gibba013 bash[30381]: cephadm 2021-03-10T15:07:42.512686+0000 mgr.gibba020.yqfnwy (mgr.34427) 3966 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:07:44.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:43 gibba013 bash[30381]: cephadm 2021-03-10T15:07:42.514629+0000 mgr.gibba020.yqfnwy (mgr.34427) 3967 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:07:44.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:43 gibba013 bash[30381]: cephadm 2021-03-10T15:07:42.517425+0000 mgr.gibba020.yqfnwy (mgr.34427) 3968 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:07:44.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:43 gibba013 bash[30381]: cephadm 2021-03-10T15:07:42.517966+0000 mgr.gibba020.yqfnwy (mgr.34427) 3969 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:07:44.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:43 gibba013 bash[30381]: cephadm 2021-03-10T15:07:42.521033+0000 mgr.gibba020.yqfnwy (mgr.34427) 3970 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:07:44.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:43 gibba013 bash[30381]: cephadm 2021-03-10T15:07:42.521600+0000 mgr.gibba020.yqfnwy (mgr.34427) 3971 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:07:44.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:43 gibba013 bash[30381]: cephadm 2021-03-10T15:07:42.524298+0000 mgr.gibba020.yqfnwy (mgr.34427) 3972 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:07:44.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:43 gibba013 bash[30381]: cephadm 2021-03-10T15:07:42.527146+0000 mgr.gibba020.yqfnwy (mgr.34427) 3973 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:07:44.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:43 gibba013 bash[30381]: cephadm 2021-03-10T15:07:42.527454+0000 mgr.gibba020.yqfnwy (mgr.34427) 3974 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:07:44.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:43 gibba013 bash[30381]: cephadm 2021-03-10T15:07:42.531371+0000 mgr.gibba020.yqfnwy (mgr.34427) 3975 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:07:44.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:43 gibba013 bash[30381]: cephadm 2021-03-10T15:07:42.533305+0000 mgr.gibba020.yqfnwy (mgr.34427) 3976 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:07:44.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:43 gibba013 bash[30381]: cephadm 2021-03-10T15:07:42.536381+0000 mgr.gibba020.yqfnwy (mgr.34427) 3977 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:07:44.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:43 gibba013 bash[30381]: cephadm 2021-03-10T15:07:42.536653+0000 mgr.gibba020.yqfnwy (mgr.34427) 3978 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:07:44.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:43 gibba013 bash[30381]: cephadm 2021-03-10T15:07:42.537389+0000 mgr.gibba020.yqfnwy (mgr.34427) 3979 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:07:44.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:43 gibba020 bash[25448]: cephadm 2021-03-10T15:07:42.268566+0000 mgr.gibba020.yqfnwy (mgr.34427) 3964 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:07:44.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:43 gibba020 bash[25448]: cephadm 2021-03-10T15:07:42.270624+0000 mgr.gibba020.yqfnwy (mgr.34427) 3965 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:07:44.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:43 gibba020 bash[25448]: cephadm 2021-03-10T15:07:42.512686+0000 mgr.gibba020.yqfnwy (mgr.34427) 3966 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:07:44.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:43 gibba020 bash[25448]: cephadm 2021-03-10T15:07:42.514629+0000 mgr.gibba020.yqfnwy (mgr.34427) 3967 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:07:44.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:43 gibba020 bash[25448]: cephadm 2021-03-10T15:07:42.517425+0000 mgr.gibba020.yqfnwy (mgr.34427) 3968 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:07:44.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:43 gibba020 bash[25448]: cephadm 2021-03-10T15:07:42.517966+0000 mgr.gibba020.yqfnwy (mgr.34427) 3969 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:07:44.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:43 gibba020 bash[25448]: cephadm 2021-03-10T15:07:42.521033+0000 mgr.gibba020.yqfnwy (mgr.34427) 3970 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:07:44.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:43 gibba020 bash[25448]: cephadm 2021-03-10T15:07:42.521600+0000 mgr.gibba020.yqfnwy (mgr.34427) 3971 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:07:44.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:43 gibba020 bash[25448]: cephadm 2021-03-10T15:07:42.524298+0000 mgr.gibba020.yqfnwy (mgr.34427) 3972 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:07:44.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:43 gibba020 bash[25448]: cephadm 2021-03-10T15:07:42.527146+0000 mgr.gibba020.yqfnwy (mgr.34427) 3973 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:07:44.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:43 gibba020 bash[25448]: cephadm 2021-03-10T15:07:42.527454+0000 mgr.gibba020.yqfnwy (mgr.34427) 3974 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:07:44.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:43 gibba020 bash[25448]: cephadm 2021-03-10T15:07:42.531371+0000 mgr.gibba020.yqfnwy (mgr.34427) 3975 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:07:44.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:43 gibba020 bash[25448]: cephadm 2021-03-10T15:07:42.533305+0000 mgr.gibba020.yqfnwy (mgr.34427) 3976 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:07:44.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:43 gibba020 bash[25448]: cephadm 2021-03-10T15:07:42.536381+0000 mgr.gibba020.yqfnwy (mgr.34427) 3977 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:07:44.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:43 gibba020 bash[25448]: cephadm 2021-03-10T15:07:42.536653+0000 mgr.gibba020.yqfnwy (mgr.34427) 3978 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:07:44.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:43 gibba020 bash[25448]: cephadm 2021-03-10T15:07:42.537389+0000 mgr.gibba020.yqfnwy (mgr.34427) 3979 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:07:45.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:44 gibba013 bash[29418]: cluster 2021-03-10T15:07:43.617616+0000 mgr.gibba020.yqfnwy (mgr.34427) 3980 : cluster [DBG] pgmap v2252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:45.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:44 gibba013 bash[30381]: cluster 2021-03-10T15:07:43.617616+0000 mgr.gibba020.yqfnwy (mgr.34427) 3980 : cluster [DBG] pgmap v2252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:45.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:44 gibba020 bash[25448]: cluster 2021-03-10T15:07:43.617616+0000 mgr.gibba020.yqfnwy (mgr.34427) 3980 : cluster [DBG] pgmap v2252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:47.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:46 gibba013 bash[29418]: cluster 2021-03-10T15:07:45.619287+0000 mgr.gibba020.yqfnwy (mgr.34427) 3981 : cluster [DBG] pgmap v2253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:47.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:46 gibba013 bash[30381]: cluster 2021-03-10T15:07:45.619287+0000 mgr.gibba020.yqfnwy (mgr.34427) 3981 : cluster [DBG] pgmap v2253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:47.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:46 gibba020 bash[25448]: cluster 2021-03-10T15:07:45.619287+0000 mgr.gibba020.yqfnwy (mgr.34427) 3981 : cluster [DBG] pgmap v2253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:48.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:47 gibba013 bash[29418]: cluster 2021-03-10T15:07:47.620840+0000 mgr.gibba020.yqfnwy (mgr.34427) 3982 : cluster [DBG] pgmap v2254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:48.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:47 gibba013 bash[30381]: cluster 2021-03-10T15:07:47.620840+0000 mgr.gibba020.yqfnwy (mgr.34427) 3982 : cluster [DBG] pgmap v2254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:48.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:47 gibba020 bash[25448]: cluster 2021-03-10T15:07:47.620840+0000 mgr.gibba020.yqfnwy (mgr.34427) 3982 : cluster [DBG] pgmap v2254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:50.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:50 gibba020 bash[25448]: cluster 2021-03-10T15:07:49.622073+0000 mgr.gibba020.yqfnwy (mgr.34427) 3983 : cluster [DBG] pgmap v2255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:51.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:50 gibba013 bash[29418]: cluster 2021-03-10T15:07:49.622073+0000 mgr.gibba020.yqfnwy (mgr.34427) 3983 : cluster [DBG] pgmap v2255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:51.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:50 gibba013 bash[30381]: cluster 2021-03-10T15:07:49.622073+0000 mgr.gibba020.yqfnwy (mgr.34427) 3983 : cluster [DBG] pgmap v2255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:52.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:52 gibba020 bash[25448]: cluster 2021-03-10T15:07:51.623777+0000 mgr.gibba020.yqfnwy (mgr.34427) 3984 : cluster [DBG] pgmap v2256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:53.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:52 gibba013 bash[29418]: cluster 2021-03-10T15:07:51.623777+0000 mgr.gibba020.yqfnwy (mgr.34427) 3984 : cluster [DBG] pgmap v2256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:53.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:52 gibba013 bash[30381]: cluster 2021-03-10T15:07:51.623777+0000 mgr.gibba020.yqfnwy (mgr.34427) 3984 : cluster [DBG] pgmap v2256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:55.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:54 gibba013 bash[29418]: cluster 2021-03-10T15:07:53.625298+0000 mgr.gibba020.yqfnwy (mgr.34427) 3985 : cluster [DBG] pgmap v2257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:55.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:54 gibba013 bash[30381]: cluster 2021-03-10T15:07:53.625298+0000 mgr.gibba020.yqfnwy (mgr.34427) 3985 : cluster [DBG] pgmap v2257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:55.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:54 gibba020 bash[25448]: cluster 2021-03-10T15:07:53.625298+0000 mgr.gibba020.yqfnwy (mgr.34427) 3985 : cluster [DBG] pgmap v2257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:57.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:56 gibba013 bash[29418]: cluster 2021-03-10T15:07:55.626980+0000 mgr.gibba020.yqfnwy (mgr.34427) 3986 : cluster [DBG] pgmap v2258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:57.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:56 gibba013 bash[30381]: cluster 2021-03-10T15:07:55.626980+0000 mgr.gibba020.yqfnwy (mgr.34427) 3986 : cluster [DBG] pgmap v2258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:57.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:56 gibba020 bash[25448]: cluster 2021-03-10T15:07:55.626980+0000 mgr.gibba020.yqfnwy (mgr.34427) 3986 : cluster [DBG] pgmap v2258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:58.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:57 gibba013 bash[29418]: cephadm 2021-03-10T15:07:57.553549+0000 mgr.gibba020.yqfnwy (mgr.34427) 3987 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:07:58.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:07:57 gibba013 bash[29418]: cluster 2021-03-10T15:07:57.628427+0000 mgr.gibba020.yqfnwy (mgr.34427) 3988 : cluster [DBG] pgmap v2259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:58.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:57 gibba013 bash[30381]: cephadm 2021-03-10T15:07:57.553549+0000 mgr.gibba020.yqfnwy (mgr.34427) 3987 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:07:58.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:07:57 gibba013 bash[30381]: cluster 2021-03-10T15:07:57.628427+0000 mgr.gibba020.yqfnwy (mgr.34427) 3988 : cluster [DBG] pgmap v2259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:07:58.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:57 gibba020 bash[25448]: cephadm 2021-03-10T15:07:57.553549+0000 mgr.gibba020.yqfnwy (mgr.34427) 3987 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:07:58.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:07:57 gibba020 bash[25448]: cluster 2021-03-10T15:07:57.628427+0000 mgr.gibba020.yqfnwy (mgr.34427) 3988 : cluster [DBG] pgmap v2259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:00.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:00 gibba020 bash[25448]: cluster 2021-03-10T15:07:59.629959+0000 mgr.gibba020.yqfnwy (mgr.34427) 3989 : cluster [DBG] pgmap v2260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:01.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:00 gibba013 bash[29418]: cluster 2021-03-10T15:07:59.629959+0000 mgr.gibba020.yqfnwy (mgr.34427) 3989 : cluster [DBG] pgmap v2260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:01.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:00 gibba013 bash[30381]: cluster 2021-03-10T15:07:59.629959+0000 mgr.gibba020.yqfnwy (mgr.34427) 3989 : cluster [DBG] pgmap v2260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:03.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:02 gibba013 bash[29418]: cluster 2021-03-10T15:08:01.631579+0000 mgr.gibba020.yqfnwy (mgr.34427) 3990 : cluster [DBG] pgmap v2261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:03.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:02 gibba013 bash[30381]: cluster 2021-03-10T15:08:01.631579+0000 mgr.gibba020.yqfnwy (mgr.34427) 3990 : cluster [DBG] pgmap v2261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:03.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:02 gibba020 bash[25448]: cluster 2021-03-10T15:08:01.631579+0000 mgr.gibba020.yqfnwy (mgr.34427) 3990 : cluster [DBG] pgmap v2261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:05.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:04 gibba013 bash[29418]: cluster 2021-03-10T15:08:03.633146+0000 mgr.gibba020.yqfnwy (mgr.34427) 3991 : cluster [DBG] pgmap v2262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:05.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:04 gibba013 bash[30381]: cluster 2021-03-10T15:08:03.633146+0000 mgr.gibba020.yqfnwy (mgr.34427) 3991 : cluster [DBG] pgmap v2262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:05.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:04 gibba020 bash[25448]: cluster 2021-03-10T15:08:03.633146+0000 mgr.gibba020.yqfnwy (mgr.34427) 3991 : cluster [DBG] pgmap v2262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:07.095 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:08:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:06 gibba013 bash[29418]: cluster 2021-03-10T15:08:05.634726+0000 mgr.gibba020.yqfnwy (mgr.34427) 3992 : cluster [DBG] pgmap v2263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:06 gibba013 bash[29418]: audit 2021-03-10T15:08:06.349736+0000 mon.a (mon.0) 1748 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:08:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:06 gibba013 bash[29418]: audit 2021-03-10T15:08:06.383415+0000 mon.a (mon.0) 1749 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:08:07.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:06 gibba013 bash[29418]: audit 2021-03-10T15:08:06.444845+0000 mon.a (mon.0) 1750 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:08:07.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:06 gibba013 bash[29418]: audit 2021-03-10T15:08:06.445628+0000 mon.a (mon.0) 1751 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:08:07.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:06 gibba013 bash[29418]: audit 2021-03-10T15:08:06.446403+0000 mon.a (mon.0) 1752 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:08:07.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:06 gibba013 bash[29418]: audit 2021-03-10T15:08:06.447178+0000 mon.a (mon.0) 1753 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:08:07.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:06 gibba013 bash[30381]: cluster 2021-03-10T15:08:05.634726+0000 mgr.gibba020.yqfnwy (mgr.34427) 3992 : cluster [DBG] pgmap v2263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:07.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:06 gibba013 bash[30381]: audit 2021-03-10T15:08:06.349736+0000 mon.a (mon.0) 1748 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:08:07.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:06 gibba013 bash[30381]: audit 2021-03-10T15:08:06.383415+0000 mon.a (mon.0) 1749 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:08:07.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:06 gibba013 bash[30381]: audit 2021-03-10T15:08:06.444845+0000 mon.a (mon.0) 1750 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:08:07.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:06 gibba013 bash[30381]: audit 2021-03-10T15:08:06.445628+0000 mon.a (mon.0) 1751 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:08:07.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:06 gibba013 bash[30381]: audit 2021-03-10T15:08:06.446403+0000 mon.a (mon.0) 1752 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:08:07.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:06 gibba013 bash[30381]: audit 2021-03-10T15:08:06.447178+0000 mon.a (mon.0) 1753 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:08:07.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:06 gibba020 bash[25448]: cluster 2021-03-10T15:08:05.634726+0000 mgr.gibba020.yqfnwy (mgr.34427) 3992 : cluster [DBG] pgmap v2263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:07.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:06 gibba020 bash[25448]: audit 2021-03-10T15:08:06.349736+0000 mon.a (mon.0) 1748 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:08:07.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:06 gibba020 bash[25448]: audit 2021-03-10T15:08:06.383415+0000 mon.a (mon.0) 1749 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:08:07.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:06 gibba020 bash[25448]: audit 2021-03-10T15:08:06.444845+0000 mon.a (mon.0) 1750 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:08:07.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:06 gibba020 bash[25448]: audit 2021-03-10T15:08:06.445628+0000 mon.a (mon.0) 1751 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:08:07.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:06 gibba020 bash[25448]: audit 2021-03-10T15:08:06.446403+0000 mon.a (mon.0) 1752 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:08:07.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:06 gibba020 bash[25448]: audit 2021-03-10T15:08:06.447178+0000 mon.a (mon.0) 1753 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:08:07.353 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:08:07.353 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (74m) 9m ago 80m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:08:07.354 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (79m) 8m ago 79m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:08:07.354 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (75m) 8m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:08:07.354 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (75m) 8m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:08:07.355 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (74m) 9m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:08:07.355 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (74m) 9m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:08:07.355 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (73m) 8m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:08:07.355 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (73m) 9m ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:08:07.356 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (80m) 9m ago 80m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:08:07.356 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (80m) 8m ago 80m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:08:07.356 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (72m) 9m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:08:07.356 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (72m) 9m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:08:07.357 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (72m) 9m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:08:07.357 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (71m) 9m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:08:07.357 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (71m) 8m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:08:07.357 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (70m) 8m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:08:07.358 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (70m) 8m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:08:07.358 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (69m) 8m ago 80m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:08:07.358 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (79m) 8m ago 80m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:08:07.358 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 8m ago 78m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:08:07.611 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:08:07.611 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:08:07.611 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:08:07.611 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:08:07.612 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:08:07.612 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:08:07.612 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:08:07.612 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:08:07.613 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:08:07.613 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:08:07.613 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:08:07.613 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:08:07.613 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:08:07.614 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:08:07.614 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:08:08.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:07 gibba013 bash[29418]: audit 2021-03-10T15:08:07.073008+0000 mgr.gibba020.yqfnwy (mgr.34427) 3993 : audit [DBG] from='client.56719 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:08:08.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:07 gibba013 bash[29418]: audit 2021-03-10T15:08:07.308761+0000 mgr.gibba020.yqfnwy (mgr.34427) 3994 : audit [DBG] from='client.46740 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:08:08.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:07 gibba013 bash[29418]: audit 2021-03-10T15:08:07.607595+0000 mon.a (mon.0) 1754 : audit [DBG] from='client.? 172.21.2.113:0/443087291' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:08.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:07 gibba013 bash[29418]: cluster 2021-03-10T15:08:07.636023+0000 mgr.gibba020.yqfnwy (mgr.34427) 3995 : cluster [DBG] pgmap v2264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:08.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:07 gibba013 bash[30381]: audit 2021-03-10T15:08:07.073008+0000 mgr.gibba020.yqfnwy (mgr.34427) 3993 : audit [DBG] from='client.56719 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:08:08.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:07 gibba013 bash[30381]: audit 2021-03-10T15:08:07.308761+0000 mgr.gibba020.yqfnwy (mgr.34427) 3994 : audit [DBG] from='client.46740 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:08:08.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:07 gibba013 bash[30381]: audit 2021-03-10T15:08:07.607595+0000 mon.a (mon.0) 1754 : audit [DBG] from='client.? 172.21.2.113:0/443087291' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:08.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:07 gibba013 bash[30381]: cluster 2021-03-10T15:08:07.636023+0000 mgr.gibba020.yqfnwy (mgr.34427) 3995 : cluster [DBG] pgmap v2264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:08.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:07 gibba020 bash[25448]: audit 2021-03-10T15:08:07.073008+0000 mgr.gibba020.yqfnwy (mgr.34427) 3993 : audit [DBG] from='client.56719 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:08:08.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:07 gibba020 bash[25448]: audit 2021-03-10T15:08:07.308761+0000 mgr.gibba020.yqfnwy (mgr.34427) 3994 : audit [DBG] from='client.46740 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:08:08.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:07 gibba020 bash[25448]: audit 2021-03-10T15:08:07.607595+0000 mon.a (mon.0) 1754 : audit [DBG] from='client.? 172.21.2.113:0/443087291' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:08.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:07 gibba020 bash[25448]: cluster 2021-03-10T15:08:07.636023+0000 mgr.gibba020.yqfnwy (mgr.34427) 3995 : cluster [DBG] pgmap v2264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:11.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:10 gibba013 bash[29418]: cluster 2021-03-10T15:08:09.637574+0000 mgr.gibba020.yqfnwy (mgr.34427) 3996 : cluster [DBG] pgmap v2265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:11.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:10 gibba013 bash[30381]: cluster 2021-03-10T15:08:09.637574+0000 mgr.gibba020.yqfnwy (mgr.34427) 3996 : cluster [DBG] pgmap v2265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:11.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:10 gibba020 bash[25448]: cluster 2021-03-10T15:08:09.637574+0000 mgr.gibba020.yqfnwy (mgr.34427) 3996 : cluster [DBG] pgmap v2265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:12.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:12 gibba020 bash[25448]: cluster 2021-03-10T15:08:11.639170+0000 mgr.gibba020.yqfnwy (mgr.34427) 3997 : cluster [DBG] pgmap v2266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:13.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:12 gibba013 bash[29418]: cluster 2021-03-10T15:08:11.639170+0000 mgr.gibba020.yqfnwy (mgr.34427) 3997 : cluster [DBG] pgmap v2266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:13.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:12 gibba013 bash[30381]: cluster 2021-03-10T15:08:11.639170+0000 mgr.gibba020.yqfnwy (mgr.34427) 3997 : cluster [DBG] pgmap v2266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:14.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:13 gibba013 bash[29418]: cephadm 2021-03-10T15:08:12.560983+0000 mgr.gibba020.yqfnwy (mgr.34427) 3998 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:08:14.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:13 gibba013 bash[30381]: cephadm 2021-03-10T15:08:12.560983+0000 mgr.gibba020.yqfnwy (mgr.34427) 3998 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:08:14.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:13 gibba020 bash[25448]: cephadm 2021-03-10T15:08:12.560983+0000 mgr.gibba020.yqfnwy (mgr.34427) 3998 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:08:15.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:14 gibba013 bash[29418]: cluster 2021-03-10T15:08:13.640860+0000 mgr.gibba020.yqfnwy (mgr.34427) 3999 : cluster [DBG] pgmap v2267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:15.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:14 gibba013 bash[30381]: cluster 2021-03-10T15:08:13.640860+0000 mgr.gibba020.yqfnwy (mgr.34427) 3999 : cluster [DBG] pgmap v2267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:15.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:14 gibba020 bash[25448]: cluster 2021-03-10T15:08:13.640860+0000 mgr.gibba020.yqfnwy (mgr.34427) 3999 : cluster [DBG] pgmap v2267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:17.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:16 gibba013 bash[29418]: cluster 2021-03-10T15:08:15.642494+0000 mgr.gibba020.yqfnwy (mgr.34427) 4000 : cluster [DBG] pgmap v2268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:17.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:16 gibba013 bash[30381]: cluster 2021-03-10T15:08:15.642494+0000 mgr.gibba020.yqfnwy (mgr.34427) 4000 : cluster [DBG] pgmap v2268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:17.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:16 gibba020 bash[25448]: cluster 2021-03-10T15:08:15.642494+0000 mgr.gibba020.yqfnwy (mgr.34427) 4000 : cluster [DBG] pgmap v2268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:18.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:17 gibba013 bash[29418]: cluster 2021-03-10T15:08:17.644118+0000 mgr.gibba020.yqfnwy (mgr.34427) 4001 : cluster [DBG] pgmap v2269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:18.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:17 gibba013 bash[30381]: cluster 2021-03-10T15:08:17.644118+0000 mgr.gibba020.yqfnwy (mgr.34427) 4001 : cluster [DBG] pgmap v2269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:18.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:17 gibba020 bash[25448]: cluster 2021-03-10T15:08:17.644118+0000 mgr.gibba020.yqfnwy (mgr.34427) 4001 : cluster [DBG] pgmap v2269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:21.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:20 gibba013 bash[29418]: cluster 2021-03-10T15:08:19.645401+0000 mgr.gibba020.yqfnwy (mgr.34427) 4002 : cluster [DBG] pgmap v2270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:21.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:20 gibba013 bash[30381]: cluster 2021-03-10T15:08:19.645401+0000 mgr.gibba020.yqfnwy (mgr.34427) 4002 : cluster [DBG] pgmap v2270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:21.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:20 gibba020 bash[25448]: cluster 2021-03-10T15:08:19.645401+0000 mgr.gibba020.yqfnwy (mgr.34427) 4002 : cluster [DBG] pgmap v2270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:23.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:22 gibba013 bash[29418]: cluster 2021-03-10T15:08:21.646216+0000 mgr.gibba020.yqfnwy (mgr.34427) 4003 : cluster [DBG] pgmap v2271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:23.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:22 gibba013 bash[30381]: cluster 2021-03-10T15:08:21.646216+0000 mgr.gibba020.yqfnwy (mgr.34427) 4003 : cluster [DBG] pgmap v2271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:23.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:22 gibba020 bash[25448]: cluster 2021-03-10T15:08:21.646216+0000 mgr.gibba020.yqfnwy (mgr.34427) 4003 : cluster [DBG] pgmap v2271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:25.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:24 gibba013 bash[29418]: cluster 2021-03-10T15:08:23.647739+0000 mgr.gibba020.yqfnwy (mgr.34427) 4004 : cluster [DBG] pgmap v2272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:25.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:24 gibba013 bash[30381]: cluster 2021-03-10T15:08:23.647739+0000 mgr.gibba020.yqfnwy (mgr.34427) 4004 : cluster [DBG] pgmap v2272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:25.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:24 gibba020 bash[25448]: cluster 2021-03-10T15:08:23.647739+0000 mgr.gibba020.yqfnwy (mgr.34427) 4004 : cluster [DBG] pgmap v2272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:27.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:26 gibba013 bash[29418]: cluster 2021-03-10T15:08:25.649417+0000 mgr.gibba020.yqfnwy (mgr.34427) 4005 : cluster [DBG] pgmap v2273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:27.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:26 gibba013 bash[30381]: cluster 2021-03-10T15:08:25.649417+0000 mgr.gibba020.yqfnwy (mgr.34427) 4005 : cluster [DBG] pgmap v2273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:27.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:26 gibba020 bash[25448]: cluster 2021-03-10T15:08:25.649417+0000 mgr.gibba020.yqfnwy (mgr.34427) 4005 : cluster [DBG] pgmap v2273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:28.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:27 gibba013 bash[29418]: cephadm 2021-03-10T15:08:27.577043+0000 mgr.gibba020.yqfnwy (mgr.34427) 4006 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:08:28.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:27 gibba013 bash[29418]: cluster 2021-03-10T15:08:27.650835+0000 mgr.gibba020.yqfnwy (mgr.34427) 4007 : cluster [DBG] pgmap v2274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:28.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:27 gibba013 bash[30381]: cephadm 2021-03-10T15:08:27.577043+0000 mgr.gibba020.yqfnwy (mgr.34427) 4006 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:08:28.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:27 gibba013 bash[30381]: cluster 2021-03-10T15:08:27.650835+0000 mgr.gibba020.yqfnwy (mgr.34427) 4007 : cluster [DBG] pgmap v2274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:28.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:27 gibba020 bash[25448]: cephadm 2021-03-10T15:08:27.577043+0000 mgr.gibba020.yqfnwy (mgr.34427) 4006 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:08:28.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:27 gibba020 bash[25448]: cluster 2021-03-10T15:08:27.650835+0000 mgr.gibba020.yqfnwy (mgr.34427) 4007 : cluster [DBG] pgmap v2274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:31.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:30 gibba013 bash[29418]: cluster 2021-03-10T15:08:29.652512+0000 mgr.gibba020.yqfnwy (mgr.34427) 4008 : cluster [DBG] pgmap v2275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:31.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:30 gibba013 bash[30381]: cluster 2021-03-10T15:08:29.652512+0000 mgr.gibba020.yqfnwy (mgr.34427) 4008 : cluster [DBG] pgmap v2275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:31.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:30 gibba020 bash[25448]: cluster 2021-03-10T15:08:29.652512+0000 mgr.gibba020.yqfnwy (mgr.34427) 4008 : cluster [DBG] pgmap v2275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:33.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:32 gibba013 bash[29418]: cluster 2021-03-10T15:08:31.653174+0000 mgr.gibba020.yqfnwy (mgr.34427) 4009 : cluster [DBG] pgmap v2276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:33.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:32 gibba013 bash[30381]: cluster 2021-03-10T15:08:31.653174+0000 mgr.gibba020.yqfnwy (mgr.34427) 4009 : cluster [DBG] pgmap v2276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:33.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:32 gibba020 bash[25448]: cluster 2021-03-10T15:08:31.653174+0000 mgr.gibba020.yqfnwy (mgr.34427) 4009 : cluster [DBG] pgmap v2276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:35.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:34 gibba013 bash[29418]: cluster 2021-03-10T15:08:33.654386+0000 mgr.gibba020.yqfnwy (mgr.34427) 4010 : cluster [DBG] pgmap v2277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:35.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:34 gibba013 bash[30381]: cluster 2021-03-10T15:08:33.654386+0000 mgr.gibba020.yqfnwy (mgr.34427) 4010 : cluster [DBG] pgmap v2277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:35.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:34 gibba020 bash[25448]: cluster 2021-03-10T15:08:33.654386+0000 mgr.gibba020.yqfnwy (mgr.34427) 4010 : cluster [DBG] pgmap v2277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:37.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:36 gibba013 bash[29418]: cluster 2021-03-10T15:08:35.656013+0000 mgr.gibba020.yqfnwy (mgr.34427) 4011 : cluster [DBG] pgmap v2278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:37.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:36 gibba013 bash[30381]: cluster 2021-03-10T15:08:35.656013+0000 mgr.gibba020.yqfnwy (mgr.34427) 4011 : cluster [DBG] pgmap v2278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:37.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:36 gibba020 bash[25448]: cluster 2021-03-10T15:08:35.656013+0000 mgr.gibba020.yqfnwy (mgr.34427) 4011 : cluster [DBG] pgmap v2278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:37.855 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:08:38.117 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:08:38.118 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (75m) 10m ago 80m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:08:38.118 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (80m) 8m ago 80m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:08:38.118 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (75m) 8m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:08:38.119 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (75m) 8m ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:08:38.119 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (74m) 10m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:08:38.119 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (74m) 10m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:08:38.119 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (74m) 8m ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:08:38.120 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (74m) 10m ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:08:38.120 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (80m) 10m ago 80m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:08:38.120 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (80m) 8m ago 80m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:08:38.120 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (73m) 10m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:08:38.121 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (72m) 10m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:08:38.121 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (72m) 10m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:08:38.121 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (72m) 10m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:08:38.121 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (71m) 8m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:08:38.121 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (71m) 8m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:08:38.122 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (70m) 8m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:08:38.122 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (70m) 8m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:08:38.122 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (80m) 8m ago 80m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:08:38.122 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 8m ago 78m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:08:38.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:37 gibba013 bash[29418]: cluster 2021-03-10T15:08:37.657326+0000 mgr.gibba020.yqfnwy (mgr.34427) 4012 : cluster [DBG] pgmap v2279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:38.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:37 gibba013 bash[30381]: cluster 2021-03-10T15:08:37.657326+0000 mgr.gibba020.yqfnwy (mgr.34427) 4012 : cluster [DBG] pgmap v2279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:38.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:37 gibba020 bash[25448]: cluster 2021-03-10T15:08:37.657326+0000 mgr.gibba020.yqfnwy (mgr.34427) 4012 : cluster [DBG] pgmap v2279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:38.379 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:08:38.379 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:08:38.380 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:08:38.380 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:08:38.380 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:08:38.380 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:08:38.381 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:08:38.381 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:08:38.381 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:08:38.381 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:08:38.382 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:08:38.382 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:08:38.382 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:08:38.382 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:08:38.383 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:08:39.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:38 gibba013 bash[29418]: audit 2021-03-10T15:08:37.841999+0000 mgr.gibba020.yqfnwy (mgr.34427) 4013 : audit [DBG] from='client.46752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:08:39.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:38 gibba013 bash[29418]: audit 2021-03-10T15:08:38.073204+0000 mgr.gibba020.yqfnwy (mgr.34427) 4014 : audit [DBG] from='client.46758 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:08:39.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:38 gibba013 bash[29418]: audit 2021-03-10T15:08:38.376047+0000 mon.a (mon.0) 1755 : audit [DBG] from='client.? 172.21.2.113:0/4148874338' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:39.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:38 gibba013 bash[30381]: audit 2021-03-10T15:08:37.841999+0000 mgr.gibba020.yqfnwy (mgr.34427) 4013 : audit [DBG] from='client.46752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:08:39.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:38 gibba013 bash[30381]: audit 2021-03-10T15:08:38.073204+0000 mgr.gibba020.yqfnwy (mgr.34427) 4014 : audit [DBG] from='client.46758 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:08:39.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:38 gibba013 bash[30381]: audit 2021-03-10T15:08:38.376047+0000 mon.a (mon.0) 1755 : audit [DBG] from='client.? 172.21.2.113:0/4148874338' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:39.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:38 gibba020 bash[25448]: audit 2021-03-10T15:08:37.841999+0000 mgr.gibba020.yqfnwy (mgr.34427) 4013 : audit [DBG] from='client.46752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:08:39.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:38 gibba020 bash[25448]: audit 2021-03-10T15:08:38.073204+0000 mgr.gibba020.yqfnwy (mgr.34427) 4014 : audit [DBG] from='client.46758 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:08:39.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:38 gibba020 bash[25448]: audit 2021-03-10T15:08:38.376047+0000 mon.a (mon.0) 1755 : audit [DBG] from='client.? 172.21.2.113:0/4148874338' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:40.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:39 gibba020 bash[25448]: cluster 2021-03-10T15:08:39.658931+0000 mgr.gibba020.yqfnwy (mgr.34427) 4015 : cluster [DBG] pgmap v2280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:40.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:39 gibba013 bash[29418]: cluster 2021-03-10T15:08:39.658931+0000 mgr.gibba020.yqfnwy (mgr.34427) 4015 : cluster [DBG] pgmap v2280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:40.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:39 gibba013 bash[30381]: cluster 2021-03-10T15:08:39.658931+0000 mgr.gibba020.yqfnwy (mgr.34427) 4015 : cluster [DBG] pgmap v2280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:43.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:42 gibba013 bash[29418]: cluster 2021-03-10T15:08:41.659611+0000 mgr.gibba020.yqfnwy (mgr.34427) 4016 : cluster [DBG] pgmap v2281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:43.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:42 gibba013 bash[29418]: audit 2021-03-10T15:08:42.595231+0000 mon.a (mon.0) 1756 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:08:43.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:42 gibba013 bash[29418]: audit 2021-03-10T15:08:42.602328+0000 mon.a (mon.0) 1757 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:08:43.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:42 gibba013 bash[30381]: cluster 2021-03-10T15:08:41.659611+0000 mgr.gibba020.yqfnwy (mgr.34427) 4016 : cluster [DBG] pgmap v2281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:43.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:42 gibba013 bash[30381]: audit 2021-03-10T15:08:42.595231+0000 mon.a (mon.0) 1756 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:08:43.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:42 gibba013 bash[30381]: audit 2021-03-10T15:08:42.602328+0000 mon.a (mon.0) 1757 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:08:43.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:42 gibba020 bash[25448]: cluster 2021-03-10T15:08:41.659611+0000 mgr.gibba020.yqfnwy (mgr.34427) 4016 : cluster [DBG] pgmap v2281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:43.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:42 gibba020 bash[25448]: audit 2021-03-10T15:08:42.595231+0000 mon.a (mon.0) 1756 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:08:43.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:42 gibba020 bash[25448]: audit 2021-03-10T15:08:42.602328+0000 mon.a (mon.0) 1757 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:08:44.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:43 gibba013 bash[29418]: cephadm 2021-03-10T15:08:42.600645+0000 mgr.gibba020.yqfnwy (mgr.34427) 4017 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:08:44.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:43 gibba013 bash[30381]: cephadm 2021-03-10T15:08:42.600645+0000 mgr.gibba020.yqfnwy (mgr.34427) 4017 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:08:44.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:43 gibba020 bash[25448]: cephadm 2021-03-10T15:08:42.600645+0000 mgr.gibba020.yqfnwy (mgr.34427) 4017 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:08:45.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:44 gibba013 bash[29418]: cluster 2021-03-10T15:08:43.660943+0000 mgr.gibba020.yqfnwy (mgr.34427) 4018 : cluster [DBG] pgmap v2282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:45.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:44 gibba013 bash[30381]: cluster 2021-03-10T15:08:43.660943+0000 mgr.gibba020.yqfnwy (mgr.34427) 4018 : cluster [DBG] pgmap v2282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:45.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:44 gibba020 bash[25448]: cluster 2021-03-10T15:08:43.660943+0000 mgr.gibba020.yqfnwy (mgr.34427) 4018 : cluster [DBG] pgmap v2282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:47.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:46 gibba013 bash[29418]: cluster 2021-03-10T15:08:45.662492+0000 mgr.gibba020.yqfnwy (mgr.34427) 4019 : cluster [DBG] pgmap v2283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:47.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:46 gibba013 bash[29418]: audit 2021-03-10T15:08:46.190523+0000 mon.a (mon.0) 1758 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:08:47.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:46 gibba013 bash[29418]: audit 2021-03-10T15:08:46.438266+0000 mon.a (mon.0) 1759 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:08:47.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:46 gibba013 bash[29418]: audit 2021-03-10T15:08:46.445971+0000 mon.a (mon.0) 1760 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:08:47.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:46 gibba013 bash[29418]: audit 2021-03-10T15:08:46.448223+0000 mon.a (mon.0) 1761 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:47.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:46 gibba013 bash[29418]: audit 2021-03-10T15:08:46.450051+0000 mon.a (mon.0) 1762 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:47.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:46 gibba013 bash[29418]: audit 2021-03-10T15:08:46.451936+0000 mon.a (mon.0) 1763 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:47.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:46 gibba013 bash[29418]: audit 2021-03-10T15:08:46.455282+0000 mon.a (mon.0) 1764 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:47.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:46 gibba013 bash[29418]: audit 2021-03-10T15:08:46.457538+0000 mon.a (mon.0) 1765 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:47.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:46 gibba013 bash[30381]: cluster 2021-03-10T15:08:45.662492+0000 mgr.gibba020.yqfnwy (mgr.34427) 4019 : cluster [DBG] pgmap v2283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:47.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:46 gibba013 bash[30381]: audit 2021-03-10T15:08:46.190523+0000 mon.a (mon.0) 1758 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:08:47.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:46 gibba013 bash[30381]: audit 2021-03-10T15:08:46.438266+0000 mon.a (mon.0) 1759 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:08:47.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:46 gibba013 bash[30381]: audit 2021-03-10T15:08:46.445971+0000 mon.a (mon.0) 1760 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:08:47.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:46 gibba013 bash[30381]: audit 2021-03-10T15:08:46.448223+0000 mon.a (mon.0) 1761 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:47.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:46 gibba013 bash[30381]: audit 2021-03-10T15:08:46.450051+0000 mon.a (mon.0) 1762 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:47.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:46 gibba013 bash[30381]: audit 2021-03-10T15:08:46.451936+0000 mon.a (mon.0) 1763 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:47.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:46 gibba013 bash[30381]: audit 2021-03-10T15:08:46.455282+0000 mon.a (mon.0) 1764 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:47.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:46 gibba013 bash[30381]: audit 2021-03-10T15:08:46.457538+0000 mon.a (mon.0) 1765 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:47.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:46 gibba020 bash[25448]: cluster 2021-03-10T15:08:45.662492+0000 mgr.gibba020.yqfnwy (mgr.34427) 4019 : cluster [DBG] pgmap v2283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:47.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:46 gibba020 bash[25448]: audit 2021-03-10T15:08:46.190523+0000 mon.a (mon.0) 1758 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:08:47.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:46 gibba020 bash[25448]: audit 2021-03-10T15:08:46.438266+0000 mon.a (mon.0) 1759 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:08:47.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:46 gibba020 bash[25448]: audit 2021-03-10T15:08:46.445971+0000 mon.a (mon.0) 1760 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:08:47.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:46 gibba020 bash[25448]: audit 2021-03-10T15:08:46.448223+0000 mon.a (mon.0) 1761 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:47.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:46 gibba020 bash[25448]: audit 2021-03-10T15:08:46.450051+0000 mon.a (mon.0) 1762 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:47.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:46 gibba020 bash[25448]: audit 2021-03-10T15:08:46.451936+0000 mon.a (mon.0) 1763 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:47.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:46 gibba020 bash[25448]: audit 2021-03-10T15:08:46.455282+0000 mon.a (mon.0) 1764 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:47.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:46 gibba020 bash[25448]: audit 2021-03-10T15:08:46.457538+0000 mon.a (mon.0) 1765 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:08:48.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:47 gibba013 bash[29418]: cephadm 2021-03-10T15:08:46.208782+0000 mgr.gibba020.yqfnwy (mgr.34427) 4020 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:08:48.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:47 gibba013 bash[29418]: cephadm 2021-03-10T15:08:46.443856+0000 mgr.gibba020.yqfnwy (mgr.34427) 4021 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:08:48.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:47 gibba013 bash[29418]: cephadm 2021-03-10T15:08:46.446521+0000 mgr.gibba020.yqfnwy (mgr.34427) 4022 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:08:48.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:47 gibba013 bash[29418]: cephadm 2021-03-10T15:08:46.448449+0000 mgr.gibba020.yqfnwy (mgr.34427) 4023 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:08:48.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:47 gibba013 bash[29418]: cephadm 2021-03-10T15:08:46.448492+0000 mgr.gibba020.yqfnwy (mgr.34427) 4024 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:08:48.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:47 gibba013 bash[29418]: cephadm 2021-03-10T15:08:46.450292+0000 mgr.gibba020.yqfnwy (mgr.34427) 4025 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:08:48.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:47 gibba013 bash[29418]: cephadm 2021-03-10T15:08:46.450335+0000 mgr.gibba020.yqfnwy (mgr.34427) 4026 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:08:48.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:47 gibba013 bash[29418]: cephadm 2021-03-10T15:08:46.451984+0000 mgr.gibba020.yqfnwy (mgr.34427) 4027 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:08:48.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:47 gibba013 bash[29418]: cephadm 2021-03-10T15:08:46.453457+0000 mgr.gibba020.yqfnwy (mgr.34427) 4028 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:08:48.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:47 gibba013 bash[29418]: cephadm 2021-03-10T15:08:46.453503+0000 mgr.gibba020.yqfnwy (mgr.34427) 4029 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:08:48.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:47 gibba013 bash[29418]: cephadm 2021-03-10T15:08:46.455432+0000 mgr.gibba020.yqfnwy (mgr.34427) 4030 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:08:48.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:47 gibba013 bash[29418]: cephadm 2021-03-10T15:08:46.455908+0000 mgr.gibba020.yqfnwy (mgr.34427) 4031 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:08:48.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:47 gibba013 bash[29418]: cephadm 2021-03-10T15:08:46.457559+0000 mgr.gibba020.yqfnwy (mgr.34427) 4032 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:08:48.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:47 gibba013 bash[29418]: cephadm 2021-03-10T15:08:46.457601+0000 mgr.gibba020.yqfnwy (mgr.34427) 4033 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:08:48.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:47 gibba013 bash[29418]: cephadm 2021-03-10T15:08:46.457745+0000 mgr.gibba020.yqfnwy (mgr.34427) 4034 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:08:48.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:47 gibba013 bash[30381]: cephadm 2021-03-10T15:08:46.208782+0000 mgr.gibba020.yqfnwy (mgr.34427) 4020 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:08:48.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:47 gibba013 bash[30381]: cephadm 2021-03-10T15:08:46.443856+0000 mgr.gibba020.yqfnwy (mgr.34427) 4021 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:08:48.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:47 gibba013 bash[30381]: cephadm 2021-03-10T15:08:46.446521+0000 mgr.gibba020.yqfnwy (mgr.34427) 4022 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:08:48.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:47 gibba013 bash[30381]: cephadm 2021-03-10T15:08:46.448449+0000 mgr.gibba020.yqfnwy (mgr.34427) 4023 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:08:48.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:47 gibba013 bash[30381]: cephadm 2021-03-10T15:08:46.448492+0000 mgr.gibba020.yqfnwy (mgr.34427) 4024 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:08:48.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:47 gibba013 bash[30381]: cephadm 2021-03-10T15:08:46.450292+0000 mgr.gibba020.yqfnwy (mgr.34427) 4025 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:08:48.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:47 gibba013 bash[30381]: cephadm 2021-03-10T15:08:46.450335+0000 mgr.gibba020.yqfnwy (mgr.34427) 4026 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:08:48.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:47 gibba013 bash[30381]: cephadm 2021-03-10T15:08:46.451984+0000 mgr.gibba020.yqfnwy (mgr.34427) 4027 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:08:48.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:47 gibba013 bash[30381]: cephadm 2021-03-10T15:08:46.453457+0000 mgr.gibba020.yqfnwy (mgr.34427) 4028 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:08:48.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:47 gibba013 bash[30381]: cephadm 2021-03-10T15:08:46.453503+0000 mgr.gibba020.yqfnwy (mgr.34427) 4029 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:08:48.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:47 gibba013 bash[30381]: cephadm 2021-03-10T15:08:46.455432+0000 mgr.gibba020.yqfnwy (mgr.34427) 4030 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:08:48.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:47 gibba013 bash[30381]: cephadm 2021-03-10T15:08:46.455908+0000 mgr.gibba020.yqfnwy (mgr.34427) 4031 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:08:48.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:47 gibba013 bash[30381]: cephadm 2021-03-10T15:08:46.457559+0000 mgr.gibba020.yqfnwy (mgr.34427) 4032 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:08:48.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:47 gibba013 bash[30381]: cephadm 2021-03-10T15:08:46.457601+0000 mgr.gibba020.yqfnwy (mgr.34427) 4033 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:08:48.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:47 gibba013 bash[30381]: cephadm 2021-03-10T15:08:46.457745+0000 mgr.gibba020.yqfnwy (mgr.34427) 4034 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:08:48.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:47 gibba020 bash[25448]: cephadm 2021-03-10T15:08:46.208782+0000 mgr.gibba020.yqfnwy (mgr.34427) 4020 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:08:48.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:47 gibba020 bash[25448]: cephadm 2021-03-10T15:08:46.443856+0000 mgr.gibba020.yqfnwy (mgr.34427) 4021 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:08:48.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:47 gibba020 bash[25448]: cephadm 2021-03-10T15:08:46.446521+0000 mgr.gibba020.yqfnwy (mgr.34427) 4022 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:08:48.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:47 gibba020 bash[25448]: cephadm 2021-03-10T15:08:46.448449+0000 mgr.gibba020.yqfnwy (mgr.34427) 4023 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:08:48.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:47 gibba020 bash[25448]: cephadm 2021-03-10T15:08:46.448492+0000 mgr.gibba020.yqfnwy (mgr.34427) 4024 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:08:48.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:47 gibba020 bash[25448]: cephadm 2021-03-10T15:08:46.450292+0000 mgr.gibba020.yqfnwy (mgr.34427) 4025 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:08:48.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:47 gibba020 bash[25448]: cephadm 2021-03-10T15:08:46.450335+0000 mgr.gibba020.yqfnwy (mgr.34427) 4026 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:08:48.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:47 gibba020 bash[25448]: cephadm 2021-03-10T15:08:46.451984+0000 mgr.gibba020.yqfnwy (mgr.34427) 4027 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:08:48.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:47 gibba020 bash[25448]: cephadm 2021-03-10T15:08:46.453457+0000 mgr.gibba020.yqfnwy (mgr.34427) 4028 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:08:48.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:47 gibba020 bash[25448]: cephadm 2021-03-10T15:08:46.453503+0000 mgr.gibba020.yqfnwy (mgr.34427) 4029 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:08:48.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:47 gibba020 bash[25448]: cephadm 2021-03-10T15:08:46.455432+0000 mgr.gibba020.yqfnwy (mgr.34427) 4030 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:08:48.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:47 gibba020 bash[25448]: cephadm 2021-03-10T15:08:46.455908+0000 mgr.gibba020.yqfnwy (mgr.34427) 4031 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:08:48.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:47 gibba020 bash[25448]: cephadm 2021-03-10T15:08:46.457559+0000 mgr.gibba020.yqfnwy (mgr.34427) 4032 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:08:48.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:47 gibba020 bash[25448]: cephadm 2021-03-10T15:08:46.457601+0000 mgr.gibba020.yqfnwy (mgr.34427) 4033 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:08:48.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:47 gibba020 bash[25448]: cephadm 2021-03-10T15:08:46.457745+0000 mgr.gibba020.yqfnwy (mgr.34427) 4034 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:08:49.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:48 gibba013 bash[29418]: cluster 2021-03-10T15:08:47.664138+0000 mgr.gibba020.yqfnwy (mgr.34427) 4035 : cluster [DBG] pgmap v2284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:49.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:48 gibba013 bash[30381]: cluster 2021-03-10T15:08:47.664138+0000 mgr.gibba020.yqfnwy (mgr.34427) 4035 : cluster [DBG] pgmap v2284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:49.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:48 gibba020 bash[25448]: cluster 2021-03-10T15:08:47.664138+0000 mgr.gibba020.yqfnwy (mgr.34427) 4035 : cluster [DBG] pgmap v2284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:51.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:50 gibba013 bash[29418]: cluster 2021-03-10T15:08:49.665739+0000 mgr.gibba020.yqfnwy (mgr.34427) 4036 : cluster [DBG] pgmap v2285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:51.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:50 gibba013 bash[30381]: cluster 2021-03-10T15:08:49.665739+0000 mgr.gibba020.yqfnwy (mgr.34427) 4036 : cluster [DBG] pgmap v2285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:51.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:50 gibba020 bash[25448]: cluster 2021-03-10T15:08:49.665739+0000 mgr.gibba020.yqfnwy (mgr.34427) 4036 : cluster [DBG] pgmap v2285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:53.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:52 gibba013 bash[29418]: cluster 2021-03-10T15:08:51.666618+0000 mgr.gibba020.yqfnwy (mgr.34427) 4037 : cluster [DBG] pgmap v2286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:53.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:52 gibba013 bash[30381]: cluster 2021-03-10T15:08:51.666618+0000 mgr.gibba020.yqfnwy (mgr.34427) 4037 : cluster [DBG] pgmap v2286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:53.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:52 gibba020 bash[25448]: cluster 2021-03-10T15:08:51.666618+0000 mgr.gibba020.yqfnwy (mgr.34427) 4037 : cluster [DBG] pgmap v2286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:55.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:54 gibba013 bash[29418]: cluster 2021-03-10T15:08:53.667904+0000 mgr.gibba020.yqfnwy (mgr.34427) 4038 : cluster [DBG] pgmap v2287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:55.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:54 gibba013 bash[30381]: cluster 2021-03-10T15:08:53.667904+0000 mgr.gibba020.yqfnwy (mgr.34427) 4038 : cluster [DBG] pgmap v2287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:55.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:54 gibba020 bash[25448]: cluster 2021-03-10T15:08:53.667904+0000 mgr.gibba020.yqfnwy (mgr.34427) 4038 : cluster [DBG] pgmap v2287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:57.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:56 gibba013 bash[29418]: cluster 2021-03-10T15:08:55.669461+0000 mgr.gibba020.yqfnwy (mgr.34427) 4039 : cluster [DBG] pgmap v2288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:57.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:56 gibba013 bash[30381]: cluster 2021-03-10T15:08:55.669461+0000 mgr.gibba020.yqfnwy (mgr.34427) 4039 : cluster [DBG] pgmap v2288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:57.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:56 gibba020 bash[25448]: cluster 2021-03-10T15:08:55.669461+0000 mgr.gibba020.yqfnwy (mgr.34427) 4039 : cluster [DBG] pgmap v2288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:58.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:08:57 gibba013 bash[29418]: cluster 2021-03-10T15:08:57.670957+0000 mgr.gibba020.yqfnwy (mgr.34427) 4040 : cluster [DBG] pgmap v2289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:58.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:08:57 gibba013 bash[30381]: cluster 2021-03-10T15:08:57.670957+0000 mgr.gibba020.yqfnwy (mgr.34427) 4040 : cluster [DBG] pgmap v2289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:08:58.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:08:57 gibba020 bash[25448]: cluster 2021-03-10T15:08:57.670957+0000 mgr.gibba020.yqfnwy (mgr.34427) 4040 : cluster [DBG] pgmap v2289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:01.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:00 gibba013 bash[29418]: cluster 2021-03-10T15:08:59.672607+0000 mgr.gibba020.yqfnwy (mgr.34427) 4041 : cluster [DBG] pgmap v2290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:01.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:00 gibba013 bash[30381]: cluster 2021-03-10T15:08:59.672607+0000 mgr.gibba020.yqfnwy (mgr.34427) 4041 : cluster [DBG] pgmap v2290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:01.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:00 gibba020 bash[25448]: cluster 2021-03-10T15:08:59.672607+0000 mgr.gibba020.yqfnwy (mgr.34427) 4041 : cluster [DBG] pgmap v2290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:03.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:02 gibba013 bash[29418]: cephadm 2021-03-10T15:09:01.473672+0000 mgr.gibba020.yqfnwy (mgr.34427) 4042 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:09:03.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:02 gibba013 bash[29418]: cluster 2021-03-10T15:09:01.673483+0000 mgr.gibba020.yqfnwy (mgr.34427) 4043 : cluster [DBG] pgmap v2291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:03.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:02 gibba013 bash[30381]: cephadm 2021-03-10T15:09:01.473672+0000 mgr.gibba020.yqfnwy (mgr.34427) 4042 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:09:03.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:02 gibba013 bash[30381]: cluster 2021-03-10T15:09:01.673483+0000 mgr.gibba020.yqfnwy (mgr.34427) 4043 : cluster [DBG] pgmap v2291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:03.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:02 gibba020 bash[25448]: cephadm 2021-03-10T15:09:01.473672+0000 mgr.gibba020.yqfnwy (mgr.34427) 4042 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:09:03.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:02 gibba020 bash[25448]: cluster 2021-03-10T15:09:01.673483+0000 mgr.gibba020.yqfnwy (mgr.34427) 4043 : cluster [DBG] pgmap v2291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:05.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:04 gibba013 bash[29418]: cluster 2021-03-10T15:09:03.675117+0000 mgr.gibba020.yqfnwy (mgr.34427) 4044 : cluster [DBG] pgmap v2292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:05.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:04 gibba013 bash[30381]: cluster 2021-03-10T15:09:03.675117+0000 mgr.gibba020.yqfnwy (mgr.34427) 4044 : cluster [DBG] pgmap v2292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:05.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:04 gibba020 bash[25448]: cluster 2021-03-10T15:09:03.675117+0000 mgr.gibba020.yqfnwy (mgr.34427) 4044 : cluster [DBG] pgmap v2292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:07.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:06 gibba013 bash[29418]: cluster 2021-03-10T15:09:05.676883+0000 mgr.gibba020.yqfnwy (mgr.34427) 4045 : cluster [DBG] pgmap v2293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:07.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:06 gibba013 bash[29418]: audit 2021-03-10T15:09:06.355066+0000 mon.a (mon.0) 1766 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:09:07.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:06 gibba013 bash[29418]: audit 2021-03-10T15:09:06.389955+0000 mon.a (mon.0) 1767 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:09:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:06 gibba013 bash[29418]: audit 2021-03-10T15:09:06.456595+0000 mon.a (mon.0) 1768 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:09:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:06 gibba013 bash[29418]: audit 2021-03-10T15:09:06.457683+0000 mon.a (mon.0) 1769 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:09:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:06 gibba013 bash[29418]: audit 2021-03-10T15:09:06.458751+0000 mon.a (mon.0) 1770 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:09:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:06 gibba013 bash[29418]: audit 2021-03-10T15:09:06.459766+0000 mon.a (mon.0) 1771 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T15:09:07.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:06 gibba013 bash[30381]: cluster 2021-03-10T15:09:05.676883+0000 mgr.gibba020.yqfnwy (mgr.34427) 4045 : cluster [DBG] pgmap v2293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:07.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:06 gibba013 bash[30381]: audit 2021-03-10T15:09:06.355066+0000 mon.a (mon.0) 1766 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:09:07.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:06 gibba013 bash[30381]: audit 2021-03-10T15:09:06.389955+0000 mon.a (mon.0) 1767 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:09:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:06 gibba013 bash[30381]: audit 2021-03-10T15:09:06.456595+0000 mon.a (mon.0) 1768 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:09:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:06 gibba013 bash[30381]: audit 2021-03-10T15:09:06.457683+0000 mon.a (mon.0) 1769 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:09:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:06 gibba013 bash[30381]: audit 2021-03-10T15:09:06.458751+0000 mon.a (mon.0) 1770 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:09:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:06 gibba013 bash[30381]: audit 2021-03-10T15:09:06.459766+0000 mon.a (mon.0) 1771 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T15:09:07.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:06 gibba020 bash[25448]: cluster 2021-03-10T15:09:05.676883+0000 mgr.gibba020.yqfnwy (mgr.34427) 4045 : cluster [DBG] pgmap v2293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:07.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:06 gibba020 bash[25448]: audit 2021-03-10T15:09:06.355066+0000 mon.a (mon.0) 1766 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:09:07.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:06 gibba020 bash[25448]: audit 2021-03-10T15:09:06.389955+0000 mon.a (mon.0) 1767 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:09:07.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:06 gibba020 bash[25448]: audit 2021-03-10T15:09:06.456595+0000 mon.a (mon.0) 1768 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:09:07.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:06 gibba020 bash[25448]: audit 2021-03-10T15:09:06.457683+0000 mon.a (mon.0) 1769 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:09:07.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:06 gibba020 bash[25448]: audit 2021-03-10T15:09:06.458751+0000 mon.a (mon.0) 1770 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:09:07.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:06 gibba020 bash[25448]: audit 2021-03-10T15:09:06.459766+0000 mon.a (mon.0) 1771 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T15:09:08.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:07 gibba020 bash[25448]: cluster 2021-03-10T15:09:07.678416+0000 mgr.gibba020.yqfnwy (mgr.34427) 4046 : cluster [DBG] pgmap v2294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:08.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:07 gibba013 bash[29418]: cluster 2021-03-10T15:09:07.678416+0000 mgr.gibba020.yqfnwy (mgr.34427) 4046 : cluster [DBG] pgmap v2294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:08.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:07 gibba013 bash[30381]: cluster 2021-03-10T15:09:07.678416+0000 mgr.gibba020.yqfnwy (mgr.34427) 4046 : cluster [DBG] pgmap v2294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:08.622 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:09:08.852 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:09:08.853 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (75m) 22s ago 81m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:09:08.853 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (80m) 9m ago 80m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:09:08.853 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (76m) 9m ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:09:08.854 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (76m) 9m ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:09:08.854 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (75m) 22s ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:09:08.854 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (75m) 22s ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:09:08.854 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (74m) 9m ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:09:08.855 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (74m) 22s ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:09:08.855 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (81m) 22s ago 81m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:09:08.855 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (81m) 9m ago 81m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:09:08.855 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (73m) 22s ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:09:08.855 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (73m) 22s ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:09:08.856 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (73m) 22s ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:09:08.856 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (72m) 22s ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:09:08.856 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (72m) 9m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:09:08.856 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (71m) 9m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:09:08.857 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (71m) 9m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:09:08.857 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (70m) 9m ago 81m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:09:08.857 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (80m) 9m ago 81m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:09:08.857 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 9m ago 79m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:09:09.108 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:09:09.108 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:09:09.108 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:09:09.109 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:09:09.109 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:09:09.109 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:09:09.109 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:09:09.109 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:09:09.110 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:09:09.110 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:09:09.110 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:09:09.110 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:09:09.111 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:09:09.111 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:09:09.111 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:09:09.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:08 gibba020 bash[25448]: audit 2021-03-10T15:09:08.609016+0000 mgr.gibba020.yqfnwy (mgr.34427) 4047 : audit [DBG] from='client.46770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:09:09.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:08 gibba020 bash[25448]: audit 2021-03-10T15:09:08.836032+0000 mgr.gibba020.yqfnwy (mgr.34427) 4048 : audit [DBG] from='client.46776 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:09:09.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:08 gibba013 bash[29418]: audit 2021-03-10T15:09:08.609016+0000 mgr.gibba020.yqfnwy (mgr.34427) 4047 : audit [DBG] from='client.46770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:09:09.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:08 gibba013 bash[29418]: audit 2021-03-10T15:09:08.836032+0000 mgr.gibba020.yqfnwy (mgr.34427) 4048 : audit [DBG] from='client.46776 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:09:09.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:08 gibba013 bash[30381]: audit 2021-03-10T15:09:08.609016+0000 mgr.gibba020.yqfnwy (mgr.34427) 4047 : audit [DBG] from='client.46770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:09:09.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:08 gibba013 bash[30381]: audit 2021-03-10T15:09:08.836032+0000 mgr.gibba020.yqfnwy (mgr.34427) 4048 : audit [DBG] from='client.46776 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:09:10.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:09 gibba020 bash[25448]: audit 2021-03-10T15:09:09.104817+0000 mon.a (mon.0) 1772 : audit [DBG] from='client.? 172.21.2.113:0/1109145295' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:10.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:09 gibba020 bash[25448]: cluster 2021-03-10T15:09:09.680073+0000 mgr.gibba020.yqfnwy (mgr.34427) 4049 : cluster [DBG] pgmap v2295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:10.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:09 gibba013 bash[29418]: audit 2021-03-10T15:09:09.104817+0000 mon.a (mon.0) 1772 : audit [DBG] from='client.? 172.21.2.113:0/1109145295' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:10.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:09 gibba013 bash[29418]: cluster 2021-03-10T15:09:09.680073+0000 mgr.gibba020.yqfnwy (mgr.34427) 4049 : cluster [DBG] pgmap v2295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:10.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:09 gibba013 bash[30381]: audit 2021-03-10T15:09:09.104817+0000 mon.a (mon.0) 1772 : audit [DBG] from='client.? 172.21.2.113:0/1109145295' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:10.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:09 gibba013 bash[30381]: cluster 2021-03-10T15:09:09.680073+0000 mgr.gibba020.yqfnwy (mgr.34427) 4049 : cluster [DBG] pgmap v2295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:13.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:12 gibba013 bash[29418]: cluster 2021-03-10T15:09:11.680965+0000 mgr.gibba020.yqfnwy (mgr.34427) 4050 : cluster [DBG] pgmap v2296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:13.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:12 gibba013 bash[30381]: cluster 2021-03-10T15:09:11.680965+0000 mgr.gibba020.yqfnwy (mgr.34427) 4050 : cluster [DBG] pgmap v2296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:13.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:12 gibba020 bash[25448]: cluster 2021-03-10T15:09:11.680965+0000 mgr.gibba020.yqfnwy (mgr.34427) 4050 : cluster [DBG] pgmap v2296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:15.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:14 gibba013 bash[29418]: cluster 2021-03-10T15:09:13.682254+0000 mgr.gibba020.yqfnwy (mgr.34427) 4051 : cluster [DBG] pgmap v2297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:15.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:14 gibba013 bash[30381]: cluster 2021-03-10T15:09:13.682254+0000 mgr.gibba020.yqfnwy (mgr.34427) 4051 : cluster [DBG] pgmap v2297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:15.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:14 gibba020 bash[25448]: cluster 2021-03-10T15:09:13.682254+0000 mgr.gibba020.yqfnwy (mgr.34427) 4051 : cluster [DBG] pgmap v2297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:17.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:16 gibba013 bash[29418]: cluster 2021-03-10T15:09:15.684035+0000 mgr.gibba020.yqfnwy (mgr.34427) 4052 : cluster [DBG] pgmap v2298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:17.155 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:16 gibba013 bash[30381]: cluster 2021-03-10T15:09:15.684035+0000 mgr.gibba020.yqfnwy (mgr.34427) 4052 : cluster [DBG] pgmap v2298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:17.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:16 gibba020 bash[25448]: cluster 2021-03-10T15:09:15.684035+0000 mgr.gibba020.yqfnwy (mgr.34427) 4052 : cluster [DBG] pgmap v2298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:18.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:17 gibba013 bash[29418]: cephadm 2021-03-10T15:09:16.476763+0000 mgr.gibba020.yqfnwy (mgr.34427) 4053 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:09:18.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:17 gibba013 bash[30381]: cephadm 2021-03-10T15:09:16.476763+0000 mgr.gibba020.yqfnwy (mgr.34427) 4053 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:09:18.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:17 gibba020 bash[25448]: cephadm 2021-03-10T15:09:16.476763+0000 mgr.gibba020.yqfnwy (mgr.34427) 4053 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:09:19.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:18 gibba013 bash[29418]: cluster 2021-03-10T15:09:17.685602+0000 mgr.gibba020.yqfnwy (mgr.34427) 4054 : cluster [DBG] pgmap v2299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:19.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:18 gibba013 bash[30381]: cluster 2021-03-10T15:09:17.685602+0000 mgr.gibba020.yqfnwy (mgr.34427) 4054 : cluster [DBG] pgmap v2299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:19.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:18 gibba020 bash[25448]: cluster 2021-03-10T15:09:17.685602+0000 mgr.gibba020.yqfnwy (mgr.34427) 4054 : cluster [DBG] pgmap v2299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:21.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:20 gibba013 bash[29418]: cluster 2021-03-10T15:09:19.686989+0000 mgr.gibba020.yqfnwy (mgr.34427) 4055 : cluster [DBG] pgmap v2300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:21.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:20 gibba013 bash[30381]: cluster 2021-03-10T15:09:19.686989+0000 mgr.gibba020.yqfnwy (mgr.34427) 4055 : cluster [DBG] pgmap v2300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:21.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:20 gibba020 bash[25448]: cluster 2021-03-10T15:09:19.686989+0000 mgr.gibba020.yqfnwy (mgr.34427) 4055 : cluster [DBG] pgmap v2300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:23.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:22 gibba013 bash[29418]: cluster 2021-03-10T15:09:21.687744+0000 mgr.gibba020.yqfnwy (mgr.34427) 4056 : cluster [DBG] pgmap v2301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:23.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:22 gibba013 bash[30381]: cluster 2021-03-10T15:09:21.687744+0000 mgr.gibba020.yqfnwy (mgr.34427) 4056 : cluster [DBG] pgmap v2301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:23.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:22 gibba020 bash[25448]: cluster 2021-03-10T15:09:21.687744+0000 mgr.gibba020.yqfnwy (mgr.34427) 4056 : cluster [DBG] pgmap v2301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:25.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:24 gibba013 bash[29418]: cluster 2021-03-10T15:09:23.689275+0000 mgr.gibba020.yqfnwy (mgr.34427) 4057 : cluster [DBG] pgmap v2302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:25.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:24 gibba013 bash[30381]: cluster 2021-03-10T15:09:23.689275+0000 mgr.gibba020.yqfnwy (mgr.34427) 4057 : cluster [DBG] pgmap v2302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:25.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:24 gibba020 bash[25448]: cluster 2021-03-10T15:09:23.689275+0000 mgr.gibba020.yqfnwy (mgr.34427) 4057 : cluster [DBG] pgmap v2302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:27.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:26 gibba013 bash[29418]: cluster 2021-03-10T15:09:25.690963+0000 mgr.gibba020.yqfnwy (mgr.34427) 4058 : cluster [DBG] pgmap v2303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:27.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:26 gibba013 bash[30381]: cluster 2021-03-10T15:09:25.690963+0000 mgr.gibba020.yqfnwy (mgr.34427) 4058 : cluster [DBG] pgmap v2303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:27.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:26 gibba020 bash[25448]: cluster 2021-03-10T15:09:25.690963+0000 mgr.gibba020.yqfnwy (mgr.34427) 4058 : cluster [DBG] pgmap v2303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:28.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:27 gibba020 bash[25448]: cluster 2021-03-10T15:09:27.692719+0000 mgr.gibba020.yqfnwy (mgr.34427) 4059 : cluster [DBG] pgmap v2304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:28.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:27 gibba013 bash[29418]: cluster 2021-03-10T15:09:27.692719+0000 mgr.gibba020.yqfnwy (mgr.34427) 4059 : cluster [DBG] pgmap v2304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:28.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:27 gibba013 bash[30381]: cluster 2021-03-10T15:09:27.692719+0000 mgr.gibba020.yqfnwy (mgr.34427) 4059 : cluster [DBG] pgmap v2304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:31.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:30 gibba013 bash[29418]: cluster 2021-03-10T15:09:29.694351+0000 mgr.gibba020.yqfnwy (mgr.34427) 4060 : cluster [DBG] pgmap v2305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:31.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:30 gibba013 bash[30381]: cluster 2021-03-10T15:09:29.694351+0000 mgr.gibba020.yqfnwy (mgr.34427) 4060 : cluster [DBG] pgmap v2305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:31.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:30 gibba020 bash[25448]: cluster 2021-03-10T15:09:29.694351+0000 mgr.gibba020.yqfnwy (mgr.34427) 4060 : cluster [DBG] pgmap v2305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:33.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:32 gibba013 bash[29418]: cephadm 2021-03-10T15:09:31.492727+0000 mgr.gibba020.yqfnwy (mgr.34427) 4061 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:09:33.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:32 gibba013 bash[29418]: cluster 2021-03-10T15:09:31.695098+0000 mgr.gibba020.yqfnwy (mgr.34427) 4062 : cluster [DBG] pgmap v2306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:33.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:32 gibba013 bash[30381]: cephadm 2021-03-10T15:09:31.492727+0000 mgr.gibba020.yqfnwy (mgr.34427) 4061 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:09:33.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:32 gibba013 bash[30381]: cluster 2021-03-10T15:09:31.695098+0000 mgr.gibba020.yqfnwy (mgr.34427) 4062 : cluster [DBG] pgmap v2306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:33.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:32 gibba020 bash[25448]: cephadm 2021-03-10T15:09:31.492727+0000 mgr.gibba020.yqfnwy (mgr.34427) 4061 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:09:33.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:32 gibba020 bash[25448]: cluster 2021-03-10T15:09:31.695098+0000 mgr.gibba020.yqfnwy (mgr.34427) 4062 : cluster [DBG] pgmap v2306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:35.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:34 gibba013 bash[29418]: cluster 2021-03-10T15:09:33.696399+0000 mgr.gibba020.yqfnwy (mgr.34427) 4063 : cluster [DBG] pgmap v2307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:35.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:34 gibba013 bash[30381]: cluster 2021-03-10T15:09:33.696399+0000 mgr.gibba020.yqfnwy (mgr.34427) 4063 : cluster [DBG] pgmap v2307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:35.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:34 gibba020 bash[25448]: cluster 2021-03-10T15:09:33.696399+0000 mgr.gibba020.yqfnwy (mgr.34427) 4063 : cluster [DBG] pgmap v2307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:37.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:36 gibba013 bash[29418]: cluster 2021-03-10T15:09:35.698061+0000 mgr.gibba020.yqfnwy (mgr.34427) 4064 : cluster [DBG] pgmap v2308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:37.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:36 gibba013 bash[30381]: cluster 2021-03-10T15:09:35.698061+0000 mgr.gibba020.yqfnwy (mgr.34427) 4064 : cluster [DBG] pgmap v2308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:37.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:36 gibba020 bash[25448]: cluster 2021-03-10T15:09:35.698061+0000 mgr.gibba020.yqfnwy (mgr.34427) 4064 : cluster [DBG] pgmap v2308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:38.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:37 gibba020 bash[25448]: cluster 2021-03-10T15:09:37.699619+0000 mgr.gibba020.yqfnwy (mgr.34427) 4065 : cluster [DBG] pgmap v2309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:38.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:37 gibba013 bash[29418]: cluster 2021-03-10T15:09:37.699619+0000 mgr.gibba020.yqfnwy (mgr.34427) 4065 : cluster [DBG] pgmap v2309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:38.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:37 gibba013 bash[30381]: cluster 2021-03-10T15:09:37.699619+0000 mgr.gibba020.yqfnwy (mgr.34427) 4065 : cluster [DBG] pgmap v2309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:39.352 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:09:39.582 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:09:39.582 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (76m) 53s ago 81m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:09:39.582 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (81m) 9m ago 81m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:09:39.582 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (76m) 9m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:09:39.583 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (76m) 9m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:09:39.583 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (75m) 53s ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:09:39.583 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (75m) 53s ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:09:39.583 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (75m) 9m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:09:39.584 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (75m) 53s ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:09:39.584 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (81m) 53s ago 81m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:09:39.584 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (81m) 9m ago 81m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:09:39.584 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (74m) 53s ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:09:39.584 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (74m) 53s ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:09:39.585 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (73m) 53s ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:09:39.585 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (73m) 53s ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:09:39.585 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (72m) 9m ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:09:39.585 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (72m) 9m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:09:39.586 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (71m) 9m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:09:39.586 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (71m) 9m ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:09:39.586 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (81m) 9m ago 81m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:09:39.586 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 9m ago 79m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:09:39.832 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:09:39.832 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:09:39.832 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:09:39.832 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:09:39.833 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:09:39.833 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:09:39.833 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:09:39.833 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:09:39.834 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:09:39.834 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:09:39.834 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:09:39.834 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:09:39.835 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:09:39.835 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:09:39.835 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:09:41.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:40 gibba013 bash[29418]: audit 2021-03-10T15:09:39.338664+0000 mgr.gibba020.yqfnwy (mgr.34427) 4066 : audit [DBG] from='client.46788 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:09:41.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:40 gibba013 bash[29418]: audit 2021-03-10T15:09:39.564737+0000 mgr.gibba020.yqfnwy (mgr.34427) 4067 : audit [DBG] from='client.46794 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:09:41.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:40 gibba013 bash[29418]: cluster 2021-03-10T15:09:39.701201+0000 mgr.gibba020.yqfnwy (mgr.34427) 4068 : cluster [DBG] pgmap v2310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:41.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:40 gibba013 bash[29418]: audit 2021-03-10T15:09:39.828660+0000 mon.a (mon.0) 1773 : audit [DBG] from='client.? 172.21.2.113:0/2390557834' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:41.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:40 gibba013 bash[30381]: audit 2021-03-10T15:09:39.338664+0000 mgr.gibba020.yqfnwy (mgr.34427) 4066 : audit [DBG] from='client.46788 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:09:41.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:40 gibba013 bash[30381]: audit 2021-03-10T15:09:39.564737+0000 mgr.gibba020.yqfnwy (mgr.34427) 4067 : audit [DBG] from='client.46794 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:09:41.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:40 gibba013 bash[30381]: cluster 2021-03-10T15:09:39.701201+0000 mgr.gibba020.yqfnwy (mgr.34427) 4068 : cluster [DBG] pgmap v2310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:41.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:40 gibba013 bash[30381]: audit 2021-03-10T15:09:39.828660+0000 mon.a (mon.0) 1773 : audit [DBG] from='client.? 172.21.2.113:0/2390557834' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:41.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:40 gibba020 bash[25448]: audit 2021-03-10T15:09:39.338664+0000 mgr.gibba020.yqfnwy (mgr.34427) 4066 : audit [DBG] from='client.46788 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:09:41.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:40 gibba020 bash[25448]: audit 2021-03-10T15:09:39.564737+0000 mgr.gibba020.yqfnwy (mgr.34427) 4067 : audit [DBG] from='client.46794 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:09:41.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:40 gibba020 bash[25448]: cluster 2021-03-10T15:09:39.701201+0000 mgr.gibba020.yqfnwy (mgr.34427) 4068 : cluster [DBG] pgmap v2310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:41.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:40 gibba020 bash[25448]: audit 2021-03-10T15:09:39.828660+0000 mon.a (mon.0) 1773 : audit [DBG] from='client.? 172.21.2.113:0/2390557834' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:43.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:42 gibba013 bash[29418]: cluster 2021-03-10T15:09:41.702184+0000 mgr.gibba020.yqfnwy (mgr.34427) 4069 : cluster [DBG] pgmap v2311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:43.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:42 gibba013 bash[30381]: cluster 2021-03-10T15:09:41.702184+0000 mgr.gibba020.yqfnwy (mgr.34427) 4069 : cluster [DBG] pgmap v2311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:43.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:42 gibba020 bash[25448]: cluster 2021-03-10T15:09:41.702184+0000 mgr.gibba020.yqfnwy (mgr.34427) 4069 : cluster [DBG] pgmap v2311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:45.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:44 gibba013 bash[29418]: cluster 2021-03-10T15:09:43.703756+0000 mgr.gibba020.yqfnwy (mgr.34427) 4070 : cluster [DBG] pgmap v2312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:45.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:44 gibba013 bash[30381]: cluster 2021-03-10T15:09:43.703756+0000 mgr.gibba020.yqfnwy (mgr.34427) 4070 : cluster [DBG] pgmap v2312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:45.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:44 gibba020 bash[25448]: cluster 2021-03-10T15:09:43.703756+0000 mgr.gibba020.yqfnwy (mgr.34427) 4070 : cluster [DBG] pgmap v2312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:47.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:46 gibba013 bash[29418]: cluster 2021-03-10T15:09:45.705417+0000 mgr.gibba020.yqfnwy (mgr.34427) 4071 : cluster [DBG] pgmap v2313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:47.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:46 gibba013 bash[29418]: audit 2021-03-10T15:09:46.510626+0000 mon.a (mon.0) 1774 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:09:47.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:46 gibba013 bash[29418]: audit 2021-03-10T15:09:46.518586+0000 mon.a (mon.0) 1775 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:09:47.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:46 gibba013 bash[30381]: cluster 2021-03-10T15:09:45.705417+0000 mgr.gibba020.yqfnwy (mgr.34427) 4071 : cluster [DBG] pgmap v2313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:47.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:46 gibba013 bash[30381]: audit 2021-03-10T15:09:46.510626+0000 mon.a (mon.0) 1774 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:09:47.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:46 gibba013 bash[30381]: audit 2021-03-10T15:09:46.518586+0000 mon.a (mon.0) 1775 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:09:47.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:46 gibba020 bash[25448]: cluster 2021-03-10T15:09:45.705417+0000 mgr.gibba020.yqfnwy (mgr.34427) 4071 : cluster [DBG] pgmap v2313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:47.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:46 gibba020 bash[25448]: audit 2021-03-10T15:09:46.510626+0000 mon.a (mon.0) 1774 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:09:47.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:46 gibba020 bash[25448]: audit 2021-03-10T15:09:46.518586+0000 mon.a (mon.0) 1775 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:09:48.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:47 gibba013 bash[29418]: cephadm 2021-03-10T15:09:46.515635+0000 mgr.gibba020.yqfnwy (mgr.34427) 4072 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:09:48.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:47 gibba013 bash[30381]: cephadm 2021-03-10T15:09:46.515635+0000 mgr.gibba020.yqfnwy (mgr.34427) 4072 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:09:48.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:47 gibba020 bash[25448]: cephadm 2021-03-10T15:09:46.515635+0000 mgr.gibba020.yqfnwy (mgr.34427) 4072 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:09:49.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:48 gibba013 bash[29418]: cluster 2021-03-10T15:09:47.706824+0000 mgr.gibba020.yqfnwy (mgr.34427) 4073 : cluster [DBG] pgmap v2314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:49.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:48 gibba013 bash[30381]: cluster 2021-03-10T15:09:47.706824+0000 mgr.gibba020.yqfnwy (mgr.34427) 4073 : cluster [DBG] pgmap v2314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:49.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:48 gibba020 bash[25448]: cluster 2021-03-10T15:09:47.706824+0000 mgr.gibba020.yqfnwy (mgr.34427) 4073 : cluster [DBG] pgmap v2314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:51.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:50 gibba013 bash[29418]: cluster 2021-03-10T15:09:49.707436+0000 mgr.gibba020.yqfnwy (mgr.34427) 4074 : cluster [DBG] pgmap v2315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:51.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:50 gibba013 bash[29418]: audit 2021-03-10T15:09:50.254623+0000 mon.a (mon.0) 1776 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:09:51.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:50 gibba013 bash[29418]: audit 2021-03-10T15:09:50.452613+0000 mon.a (mon.0) 1777 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:09:51.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:50 gibba013 bash[29418]: audit 2021-03-10T15:09:50.456282+0000 mon.a (mon.0) 1778 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:09:51.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:50 gibba013 bash[29418]: audit 2021-03-10T15:09:50.457551+0000 mon.a (mon.0) 1779 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:51.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:50 gibba013 bash[29418]: audit 2021-03-10T15:09:50.458819+0000 mon.a (mon.0) 1780 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:51.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:50 gibba013 bash[29418]: audit 2021-03-10T15:09:50.460258+0000 mon.a (mon.0) 1781 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:51.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:50 gibba013 bash[29418]: audit 2021-03-10T15:09:50.463387+0000 mon.a (mon.0) 1782 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:51.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:50 gibba013 bash[29418]: audit 2021-03-10T15:09:50.465165+0000 mon.a (mon.0) 1783 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:51.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:50 gibba013 bash[30381]: cluster 2021-03-10T15:09:49.707436+0000 mgr.gibba020.yqfnwy (mgr.34427) 4074 : cluster [DBG] pgmap v2315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:51.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:50 gibba013 bash[30381]: audit 2021-03-10T15:09:50.254623+0000 mon.a (mon.0) 1776 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:09:51.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:50 gibba013 bash[30381]: audit 2021-03-10T15:09:50.452613+0000 mon.a (mon.0) 1777 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:09:51.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:50 gibba013 bash[30381]: audit 2021-03-10T15:09:50.456282+0000 mon.a (mon.0) 1778 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:09:51.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:50 gibba013 bash[30381]: audit 2021-03-10T15:09:50.457551+0000 mon.a (mon.0) 1779 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:51.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:50 gibba013 bash[30381]: audit 2021-03-10T15:09:50.458819+0000 mon.a (mon.0) 1780 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:51.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:50 gibba013 bash[30381]: audit 2021-03-10T15:09:50.460258+0000 mon.a (mon.0) 1781 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:51.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:50 gibba013 bash[30381]: audit 2021-03-10T15:09:50.463387+0000 mon.a (mon.0) 1782 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:51.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:50 gibba013 bash[30381]: audit 2021-03-10T15:09:50.465165+0000 mon.a (mon.0) 1783 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:51.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:50 gibba020 bash[25448]: cluster 2021-03-10T15:09:49.707436+0000 mgr.gibba020.yqfnwy (mgr.34427) 4074 : cluster [DBG] pgmap v2315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:51.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:50 gibba020 bash[25448]: audit 2021-03-10T15:09:50.254623+0000 mon.a (mon.0) 1776 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:09:51.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:50 gibba020 bash[25448]: audit 2021-03-10T15:09:50.452613+0000 mon.a (mon.0) 1777 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:09:51.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:50 gibba020 bash[25448]: audit 2021-03-10T15:09:50.456282+0000 mon.a (mon.0) 1778 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:09:51.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:50 gibba020 bash[25448]: audit 2021-03-10T15:09:50.457551+0000 mon.a (mon.0) 1779 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:51.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:50 gibba020 bash[25448]: audit 2021-03-10T15:09:50.458819+0000 mon.a (mon.0) 1780 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:51.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:50 gibba020 bash[25448]: audit 2021-03-10T15:09:50.460258+0000 mon.a (mon.0) 1781 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:51.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:50 gibba020 bash[25448]: audit 2021-03-10T15:09:50.463387+0000 mon.a (mon.0) 1782 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:51.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:50 gibba020 bash[25448]: audit 2021-03-10T15:09:50.465165+0000 mon.a (mon.0) 1783 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:09:52.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:51 gibba013 bash[29418]: cephadm 2021-03-10T15:09:50.254341+0000 mgr.gibba020.yqfnwy (mgr.34427) 4075 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:09:52.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:51 gibba013 bash[29418]: cephadm 2021-03-10T15:09:50.454447+0000 mgr.gibba020.yqfnwy (mgr.34427) 4076 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:09:52.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:51 gibba013 bash[29418]: cephadm 2021-03-10T15:09:50.456181+0000 mgr.gibba020.yqfnwy (mgr.34427) 4077 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:09:52.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:51 gibba013 bash[29418]: cephadm 2021-03-10T15:09:50.457386+0000 mgr.gibba020.yqfnwy (mgr.34427) 4078 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:09:52.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:51 gibba013 bash[29418]: cephadm 2021-03-10T15:09:50.457427+0000 mgr.gibba020.yqfnwy (mgr.34427) 4079 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:09:52.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:51 gibba013 bash[29418]: cephadm 2021-03-10T15:09:50.458774+0000 mgr.gibba020.yqfnwy (mgr.34427) 4080 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:09:52.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:51 gibba013 bash[29418]: cephadm 2021-03-10T15:09:50.458816+0000 mgr.gibba020.yqfnwy (mgr.34427) 4081 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:09:52.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:51 gibba013 bash[29418]: cephadm 2021-03-10T15:09:50.460273+0000 mgr.gibba020.yqfnwy (mgr.34427) 4082 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:09:52.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:51 gibba013 bash[29418]: cephadm 2021-03-10T15:09:50.461726+0000 mgr.gibba020.yqfnwy (mgr.34427) 4083 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:09:52.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:51 gibba013 bash[29418]: cephadm 2021-03-10T15:09:50.461777+0000 mgr.gibba020.yqfnwy (mgr.34427) 4084 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:09:52.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:51 gibba013 bash[29418]: cephadm 2021-03-10T15:09:50.463359+0000 mgr.gibba020.yqfnwy (mgr.34427) 4085 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:09:52.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:51 gibba013 bash[29418]: cephadm 2021-03-10T15:09:50.463701+0000 mgr.gibba020.yqfnwy (mgr.34427) 4086 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:09:52.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:51 gibba013 bash[29418]: cephadm 2021-03-10T15:09:50.465423+0000 mgr.gibba020.yqfnwy (mgr.34427) 4087 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:09:52.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:51 gibba013 bash[29418]: cephadm 2021-03-10T15:09:50.465465+0000 mgr.gibba020.yqfnwy (mgr.34427) 4088 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:09:52.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:51 gibba013 bash[29418]: cephadm 2021-03-10T15:09:50.465619+0000 mgr.gibba020.yqfnwy (mgr.34427) 4089 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:09:52.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:51 gibba013 bash[30381]: cephadm 2021-03-10T15:09:50.254341+0000 mgr.gibba020.yqfnwy (mgr.34427) 4075 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:09:52.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:51 gibba013 bash[30381]: cephadm 2021-03-10T15:09:50.454447+0000 mgr.gibba020.yqfnwy (mgr.34427) 4076 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:09:52.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:51 gibba013 bash[30381]: cephadm 2021-03-10T15:09:50.456181+0000 mgr.gibba020.yqfnwy (mgr.34427) 4077 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:09:52.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:51 gibba013 bash[30381]: cephadm 2021-03-10T15:09:50.457386+0000 mgr.gibba020.yqfnwy (mgr.34427) 4078 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:09:52.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:51 gibba013 bash[30381]: cephadm 2021-03-10T15:09:50.457427+0000 mgr.gibba020.yqfnwy (mgr.34427) 4079 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:09:52.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:51 gibba013 bash[30381]: cephadm 2021-03-10T15:09:50.458774+0000 mgr.gibba020.yqfnwy (mgr.34427) 4080 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:09:52.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:51 gibba013 bash[30381]: cephadm 2021-03-10T15:09:50.458816+0000 mgr.gibba020.yqfnwy (mgr.34427) 4081 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:09:52.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:51 gibba013 bash[30381]: cephadm 2021-03-10T15:09:50.460273+0000 mgr.gibba020.yqfnwy (mgr.34427) 4082 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:09:52.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:51 gibba013 bash[30381]: cephadm 2021-03-10T15:09:50.461726+0000 mgr.gibba020.yqfnwy (mgr.34427) 4083 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:09:52.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:51 gibba013 bash[30381]: cephadm 2021-03-10T15:09:50.461777+0000 mgr.gibba020.yqfnwy (mgr.34427) 4084 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:09:52.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:51 gibba013 bash[30381]: cephadm 2021-03-10T15:09:50.463359+0000 mgr.gibba020.yqfnwy (mgr.34427) 4085 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:09:52.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:51 gibba013 bash[30381]: cephadm 2021-03-10T15:09:50.463701+0000 mgr.gibba020.yqfnwy (mgr.34427) 4086 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:09:52.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:51 gibba013 bash[30381]: cephadm 2021-03-10T15:09:50.465423+0000 mgr.gibba020.yqfnwy (mgr.34427) 4087 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:09:52.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:51 gibba013 bash[30381]: cephadm 2021-03-10T15:09:50.465465+0000 mgr.gibba020.yqfnwy (mgr.34427) 4088 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:09:52.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:51 gibba013 bash[30381]: cephadm 2021-03-10T15:09:50.465619+0000 mgr.gibba020.yqfnwy (mgr.34427) 4089 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:09:52.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:51 gibba020 bash[25448]: cephadm 2021-03-10T15:09:50.254341+0000 mgr.gibba020.yqfnwy (mgr.34427) 4075 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:09:52.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:51 gibba020 bash[25448]: cephadm 2021-03-10T15:09:50.454447+0000 mgr.gibba020.yqfnwy (mgr.34427) 4076 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:09:52.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:51 gibba020 bash[25448]: cephadm 2021-03-10T15:09:50.456181+0000 mgr.gibba020.yqfnwy (mgr.34427) 4077 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:09:52.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:51 gibba020 bash[25448]: cephadm 2021-03-10T15:09:50.457386+0000 mgr.gibba020.yqfnwy (mgr.34427) 4078 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:09:52.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:51 gibba020 bash[25448]: cephadm 2021-03-10T15:09:50.457427+0000 mgr.gibba020.yqfnwy (mgr.34427) 4079 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:09:52.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:51 gibba020 bash[25448]: cephadm 2021-03-10T15:09:50.458774+0000 mgr.gibba020.yqfnwy (mgr.34427) 4080 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:09:52.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:51 gibba020 bash[25448]: cephadm 2021-03-10T15:09:50.458816+0000 mgr.gibba020.yqfnwy (mgr.34427) 4081 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:09:52.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:51 gibba020 bash[25448]: cephadm 2021-03-10T15:09:50.460273+0000 mgr.gibba020.yqfnwy (mgr.34427) 4082 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:09:52.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:51 gibba020 bash[25448]: cephadm 2021-03-10T15:09:50.461726+0000 mgr.gibba020.yqfnwy (mgr.34427) 4083 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:09:52.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:51 gibba020 bash[25448]: cephadm 2021-03-10T15:09:50.461777+0000 mgr.gibba020.yqfnwy (mgr.34427) 4084 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:09:52.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:51 gibba020 bash[25448]: cephadm 2021-03-10T15:09:50.463359+0000 mgr.gibba020.yqfnwy (mgr.34427) 4085 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:09:52.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:51 gibba020 bash[25448]: cephadm 2021-03-10T15:09:50.463701+0000 mgr.gibba020.yqfnwy (mgr.34427) 4086 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:09:52.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:51 gibba020 bash[25448]: cephadm 2021-03-10T15:09:50.465423+0000 mgr.gibba020.yqfnwy (mgr.34427) 4087 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:09:52.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:51 gibba020 bash[25448]: cephadm 2021-03-10T15:09:50.465465+0000 mgr.gibba020.yqfnwy (mgr.34427) 4088 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:09:52.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:51 gibba020 bash[25448]: cephadm 2021-03-10T15:09:50.465619+0000 mgr.gibba020.yqfnwy (mgr.34427) 4089 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:09:53.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:52 gibba013 bash[29418]: cluster 2021-03-10T15:09:51.708223+0000 mgr.gibba020.yqfnwy (mgr.34427) 4090 : cluster [DBG] pgmap v2316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:53.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:52 gibba013 bash[30381]: cluster 2021-03-10T15:09:51.708223+0000 mgr.gibba020.yqfnwy (mgr.34427) 4090 : cluster [DBG] pgmap v2316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:53.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:52 gibba020 bash[25448]: cluster 2021-03-10T15:09:51.708223+0000 mgr.gibba020.yqfnwy (mgr.34427) 4090 : cluster [DBG] pgmap v2316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:55.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:54 gibba013 bash[29418]: cluster 2021-03-10T15:09:53.709819+0000 mgr.gibba020.yqfnwy (mgr.34427) 4091 : cluster [DBG] pgmap v2317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:55.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:54 gibba013 bash[30381]: cluster 2021-03-10T15:09:53.709819+0000 mgr.gibba020.yqfnwy (mgr.34427) 4091 : cluster [DBG] pgmap v2317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:55.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:54 gibba020 bash[25448]: cluster 2021-03-10T15:09:53.709819+0000 mgr.gibba020.yqfnwy (mgr.34427) 4091 : cluster [DBG] pgmap v2317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:57.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:56 gibba013 bash[29418]: cluster 2021-03-10T15:09:55.711372+0000 mgr.gibba020.yqfnwy (mgr.34427) 4092 : cluster [DBG] pgmap v2318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:57.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:56 gibba013 bash[30381]: cluster 2021-03-10T15:09:55.711372+0000 mgr.gibba020.yqfnwy (mgr.34427) 4092 : cluster [DBG] pgmap v2318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:57.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:56 gibba020 bash[25448]: cluster 2021-03-10T15:09:55.711372+0000 mgr.gibba020.yqfnwy (mgr.34427) 4092 : cluster [DBG] pgmap v2318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:58.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:09:57 gibba020 bash[25448]: cluster 2021-03-10T15:09:57.712999+0000 mgr.gibba020.yqfnwy (mgr.34427) 4093 : cluster [DBG] pgmap v2319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:58.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:09:57 gibba013 bash[29418]: cluster 2021-03-10T15:09:57.712999+0000 mgr.gibba020.yqfnwy (mgr.34427) 4093 : cluster [DBG] pgmap v2319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:09:58.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:09:57 gibba013 bash[30381]: cluster 2021-03-10T15:09:57.712999+0000 mgr.gibba020.yqfnwy (mgr.34427) 4093 : cluster [DBG] pgmap v2319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:00.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:00 gibba013 bash[29418]: debug 2021-03-10T15:09:59.999+0000 7fd718a82700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:10:01.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:00 gibba013 bash[29418]: cluster 2021-03-10T15:09:59.714622+0000 mgr.gibba020.yqfnwy (mgr.34427) 4094 : cluster [DBG] pgmap v2320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:01.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:00 gibba013 bash[29418]: cluster 2021-03-10T15:10:00.000215+0000 mon.a (mon.0) 1784 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:10:01.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:00 gibba013 bash[30381]: cluster 2021-03-10T15:09:59.714622+0000 mgr.gibba020.yqfnwy (mgr.34427) 4094 : cluster [DBG] pgmap v2320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:01.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:00 gibba013 bash[30381]: cluster 2021-03-10T15:10:00.000215+0000 mon.a (mon.0) 1784 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:10:01.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:00 gibba020 bash[25448]: cluster 2021-03-10T15:09:59.714622+0000 mgr.gibba020.yqfnwy (mgr.34427) 4094 : cluster [DBG] pgmap v2320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:01.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:00 gibba020 bash[25448]: cluster 2021-03-10T15:10:00.000215+0000 mon.a (mon.0) 1784 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:10:03.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:02 gibba013 bash[29418]: cluster 2021-03-10T15:10:01.716361+0000 mgr.gibba020.yqfnwy (mgr.34427) 4095 : cluster [DBG] pgmap v2321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:03.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:02 gibba013 bash[30381]: cluster 2021-03-10T15:10:01.716361+0000 mgr.gibba020.yqfnwy (mgr.34427) 4095 : cluster [DBG] pgmap v2321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:03.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:02 gibba020 bash[25448]: cluster 2021-03-10T15:10:01.716361+0000 mgr.gibba020.yqfnwy (mgr.34427) 4095 : cluster [DBG] pgmap v2321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:05.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:04 gibba013 bash[29418]: cluster 2021-03-10T15:10:03.718046+0000 mgr.gibba020.yqfnwy (mgr.34427) 4096 : cluster [DBG] pgmap v2322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:05.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:04 gibba013 bash[30381]: cluster 2021-03-10T15:10:03.718046+0000 mgr.gibba020.yqfnwy (mgr.34427) 4096 : cluster [DBG] pgmap v2322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:05.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:04 gibba020 bash[25448]: cluster 2021-03-10T15:10:03.718046+0000 mgr.gibba020.yqfnwy (mgr.34427) 4096 : cluster [DBG] pgmap v2322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:07.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:06 gibba013 bash[29418]: cephadm 2021-03-10T15:10:05.481706+0000 mgr.gibba020.yqfnwy (mgr.34427) 4097 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:10:07.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:06 gibba013 bash[29418]: cluster 2021-03-10T15:10:05.719620+0000 mgr.gibba020.yqfnwy (mgr.34427) 4098 : cluster [DBG] pgmap v2323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:06 gibba013 bash[29418]: audit 2021-03-10T15:10:06.360350+0000 mon.a (mon.0) 1785 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:10:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:06 gibba013 bash[29418]: audit 2021-03-10T15:10:06.396464+0000 mon.a (mon.0) 1786 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:10:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:06 gibba013 bash[29418]: audit 2021-03-10T15:10:06.468164+0000 mon.a (mon.0) 1787 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T15:10:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:06 gibba013 bash[29418]: audit 2021-03-10T15:10:06.468897+0000 mon.a (mon.0) 1788 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:10:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:06 gibba013 bash[29418]: audit 2021-03-10T15:10:06.469531+0000 mon.a (mon.0) 1789 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:10:07.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:06 gibba013 bash[29418]: audit 2021-03-10T15:10:06.470215+0000 mon.a (mon.0) 1790 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:10:07.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:06 gibba013 bash[30381]: cephadm 2021-03-10T15:10:05.481706+0000 mgr.gibba020.yqfnwy (mgr.34427) 4097 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:10:07.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:06 gibba013 bash[30381]: cluster 2021-03-10T15:10:05.719620+0000 mgr.gibba020.yqfnwy (mgr.34427) 4098 : cluster [DBG] pgmap v2323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:06 gibba013 bash[30381]: audit 2021-03-10T15:10:06.360350+0000 mon.a (mon.0) 1785 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:10:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:06 gibba013 bash[30381]: audit 2021-03-10T15:10:06.396464+0000 mon.a (mon.0) 1786 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:10:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:06 gibba013 bash[30381]: audit 2021-03-10T15:10:06.468164+0000 mon.a (mon.0) 1787 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T15:10:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:06 gibba013 bash[30381]: audit 2021-03-10T15:10:06.468897+0000 mon.a (mon.0) 1788 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:10:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:06 gibba013 bash[30381]: audit 2021-03-10T15:10:06.469531+0000 mon.a (mon.0) 1789 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:10:07.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:06 gibba013 bash[30381]: audit 2021-03-10T15:10:06.470215+0000 mon.a (mon.0) 1790 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:10:07.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:06 gibba020 bash[25448]: cephadm 2021-03-10T15:10:05.481706+0000 mgr.gibba020.yqfnwy (mgr.34427) 4097 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:10:07.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:06 gibba020 bash[25448]: cluster 2021-03-10T15:10:05.719620+0000 mgr.gibba020.yqfnwy (mgr.34427) 4098 : cluster [DBG] pgmap v2323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:07.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:06 gibba020 bash[25448]: audit 2021-03-10T15:10:06.360350+0000 mon.a (mon.0) 1785 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:10:07.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:06 gibba020 bash[25448]: audit 2021-03-10T15:10:06.396464+0000 mon.a (mon.0) 1786 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:10:07.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:06 gibba020 bash[25448]: audit 2021-03-10T15:10:06.468164+0000 mon.a (mon.0) 1787 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T15:10:07.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:06 gibba020 bash[25448]: audit 2021-03-10T15:10:06.468897+0000 mon.a (mon.0) 1788 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:10:07.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:06 gibba020 bash[25448]: audit 2021-03-10T15:10:06.469531+0000 mon.a (mon.0) 1789 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:10:07.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:06 gibba020 bash[25448]: audit 2021-03-10T15:10:06.470215+0000 mon.a (mon.0) 1790 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:10:08.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:07 gibba020 bash[25448]: cluster 2021-03-10T15:10:07.721211+0000 mgr.gibba020.yqfnwy (mgr.34427) 4099 : cluster [DBG] pgmap v2324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:08.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:07 gibba013 bash[29418]: cluster 2021-03-10T15:10:07.721211+0000 mgr.gibba020.yqfnwy (mgr.34427) 4099 : cluster [DBG] pgmap v2324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:08.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:07 gibba013 bash[30381]: cluster 2021-03-10T15:10:07.721211+0000 mgr.gibba020.yqfnwy (mgr.34427) 4099 : cluster [DBG] pgmap v2324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:10.072 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:10:10.297 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:10:10.298 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (76m) 84s ago 82m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:10:10.298 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (81m) 20s ago 81m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:10:10.298 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (77m) 20s ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:10:10.298 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (77m) 20s ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:10:10.299 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (76m) 84s ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:10:10.299 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (76m) 84s ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:10:10.299 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (75m) 20s ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:10:10.299 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (75m) 84s ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:10:10.300 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (82m) 84s ago 82m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:10:10.300 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (82m) 20s ago 82m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:10:10.300 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (74m) 84s ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:10:10.300 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (74m) 84s ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:10:10.301 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (74m) 84s ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:10:10.301 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (73m) 84s ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:10:10.301 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (73m) 20s ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:10:10.301 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (72m) 20s ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:10:10.302 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (72m) 20s ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:10:10.302 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (71m) 20s ago 82m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:10:10.302 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (81m) 20s ago 82m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:10:10.302 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 20s ago 80m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:10:10.554 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:10:10.555 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:10:10.555 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:10:10.555 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:10:10.555 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:10:10.556 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:10:10.556 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:10:10.556 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:10:10.556 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:10:10.556 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:10:10.557 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:10:10.557 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:10:10.557 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:10:10.557 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:10:10.558 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:10:11.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:10 gibba013 bash[29418]: cluster 2021-03-10T15:10:09.722813+0000 mgr.gibba020.yqfnwy (mgr.34427) 4100 : cluster [DBG] pgmap v2325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:11.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:10 gibba013 bash[29418]: audit 2021-03-10T15:10:10.551233+0000 mon.a (mon.0) 1791 : audit [DBG] from='client.? 172.21.2.113:0/1720457274' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:11.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:10 gibba013 bash[30381]: cluster 2021-03-10T15:10:09.722813+0000 mgr.gibba020.yqfnwy (mgr.34427) 4100 : cluster [DBG] pgmap v2325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:11.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:10 gibba013 bash[30381]: audit 2021-03-10T15:10:10.551233+0000 mon.a (mon.0) 1791 : audit [DBG] from='client.? 172.21.2.113:0/1720457274' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:11.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:10 gibba020 bash[25448]: cluster 2021-03-10T15:10:09.722813+0000 mgr.gibba020.yqfnwy (mgr.34427) 4100 : cluster [DBG] pgmap v2325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:11.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:10 gibba020 bash[25448]: audit 2021-03-10T15:10:10.551233+0000 mon.a (mon.0) 1791 : audit [DBG] from='client.? 172.21.2.113:0/1720457274' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:12.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:11 gibba013 bash[29418]: audit 2021-03-10T15:10:10.059495+0000 mgr.gibba020.yqfnwy (mgr.34427) 4101 : audit [DBG] from='client.56791 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:10:12.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:11 gibba013 bash[29418]: audit 2021-03-10T15:10:10.280931+0000 mgr.gibba020.yqfnwy (mgr.34427) 4102 : audit [DBG] from='client.56797 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:10:12.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:11 gibba013 bash[30381]: audit 2021-03-10T15:10:10.059495+0000 mgr.gibba020.yqfnwy (mgr.34427) 4101 : audit [DBG] from='client.56791 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:10:12.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:11 gibba013 bash[30381]: audit 2021-03-10T15:10:10.280931+0000 mgr.gibba020.yqfnwy (mgr.34427) 4102 : audit [DBG] from='client.56797 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:10:12.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:11 gibba020 bash[25448]: audit 2021-03-10T15:10:10.059495+0000 mgr.gibba020.yqfnwy (mgr.34427) 4101 : audit [DBG] from='client.56791 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:10:12.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:11 gibba020 bash[25448]: audit 2021-03-10T15:10:10.280931+0000 mgr.gibba020.yqfnwy (mgr.34427) 4102 : audit [DBG] from='client.56797 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:10:13.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:12 gibba013 bash[29418]: cluster 2021-03-10T15:10:11.724323+0000 mgr.gibba020.yqfnwy (mgr.34427) 4103 : cluster [DBG] pgmap v2326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:13.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:12 gibba013 bash[30381]: cluster 2021-03-10T15:10:11.724323+0000 mgr.gibba020.yqfnwy (mgr.34427) 4103 : cluster [DBG] pgmap v2326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:13.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:12 gibba020 bash[25448]: cluster 2021-03-10T15:10:11.724323+0000 mgr.gibba020.yqfnwy (mgr.34427) 4103 : cluster [DBG] pgmap v2326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:15.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:14 gibba013 bash[29418]: cluster 2021-03-10T15:10:13.725681+0000 mgr.gibba020.yqfnwy (mgr.34427) 4104 : cluster [DBG] pgmap v2327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:15.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:14 gibba013 bash[30381]: cluster 2021-03-10T15:10:13.725681+0000 mgr.gibba020.yqfnwy (mgr.34427) 4104 : cluster [DBG] pgmap v2327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:15.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:14 gibba020 bash[25448]: cluster 2021-03-10T15:10:13.725681+0000 mgr.gibba020.yqfnwy (mgr.34427) 4104 : cluster [DBG] pgmap v2327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:17.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:16 gibba013 bash[29418]: cluster 2021-03-10T15:10:15.727120+0000 mgr.gibba020.yqfnwy (mgr.34427) 4105 : cluster [DBG] pgmap v2328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:17.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:16 gibba013 bash[30381]: cluster 2021-03-10T15:10:15.727120+0000 mgr.gibba020.yqfnwy (mgr.34427) 4105 : cluster [DBG] pgmap v2328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:17.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:16 gibba020 bash[25448]: cluster 2021-03-10T15:10:15.727120+0000 mgr.gibba020.yqfnwy (mgr.34427) 4105 : cluster [DBG] pgmap v2328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:18.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:17 gibba020 bash[25448]: cluster 2021-03-10T15:10:17.728537+0000 mgr.gibba020.yqfnwy (mgr.34427) 4106 : cluster [DBG] pgmap v2329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:18.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:17 gibba013 bash[29418]: cluster 2021-03-10T15:10:17.728537+0000 mgr.gibba020.yqfnwy (mgr.34427) 4106 : cluster [DBG] pgmap v2329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:18.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:17 gibba013 bash[30381]: cluster 2021-03-10T15:10:17.728537+0000 mgr.gibba020.yqfnwy (mgr.34427) 4106 : cluster [DBG] pgmap v2329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:21.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:20 gibba013 bash[29418]: cluster 2021-03-10T15:10:19.729997+0000 mgr.gibba020.yqfnwy (mgr.34427) 4107 : cluster [DBG] pgmap v2330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:21.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:20 gibba013 bash[30381]: cluster 2021-03-10T15:10:19.729997+0000 mgr.gibba020.yqfnwy (mgr.34427) 4107 : cluster [DBG] pgmap v2330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:21.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:20 gibba020 bash[25448]: cluster 2021-03-10T15:10:19.729997+0000 mgr.gibba020.yqfnwy (mgr.34427) 4107 : cluster [DBG] pgmap v2330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:22.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:21 gibba013 bash[29418]: cephadm 2021-03-10T15:10:20.497647+0000 mgr.gibba020.yqfnwy (mgr.34427) 4108 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:10:22.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:21 gibba013 bash[30381]: cephadm 2021-03-10T15:10:20.497647+0000 mgr.gibba020.yqfnwy (mgr.34427) 4108 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:10:22.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:21 gibba020 bash[25448]: cephadm 2021-03-10T15:10:20.497647+0000 mgr.gibba020.yqfnwy (mgr.34427) 4108 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:10:23.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:22 gibba013 bash[29418]: cluster 2021-03-10T15:10:21.731783+0000 mgr.gibba020.yqfnwy (mgr.34427) 4109 : cluster [DBG] pgmap v2331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:23.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:22 gibba013 bash[30381]: cluster 2021-03-10T15:10:21.731783+0000 mgr.gibba020.yqfnwy (mgr.34427) 4109 : cluster [DBG] pgmap v2331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:23.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:22 gibba020 bash[25448]: cluster 2021-03-10T15:10:21.731783+0000 mgr.gibba020.yqfnwy (mgr.34427) 4109 : cluster [DBG] pgmap v2331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:25.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:24 gibba013 bash[29418]: cluster 2021-03-10T15:10:23.733213+0000 mgr.gibba020.yqfnwy (mgr.34427) 4110 : cluster [DBG] pgmap v2332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:25.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:24 gibba013 bash[30381]: cluster 2021-03-10T15:10:23.733213+0000 mgr.gibba020.yqfnwy (mgr.34427) 4110 : cluster [DBG] pgmap v2332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:25.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:24 gibba020 bash[25448]: cluster 2021-03-10T15:10:23.733213+0000 mgr.gibba020.yqfnwy (mgr.34427) 4110 : cluster [DBG] pgmap v2332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:27.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:26 gibba013 bash[29418]: cluster 2021-03-10T15:10:25.734858+0000 mgr.gibba020.yqfnwy (mgr.34427) 4111 : cluster [DBG] pgmap v2333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:27.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:26 gibba013 bash[30381]: cluster 2021-03-10T15:10:25.734858+0000 mgr.gibba020.yqfnwy (mgr.34427) 4111 : cluster [DBG] pgmap v2333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:27.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:26 gibba020 bash[25448]: cluster 2021-03-10T15:10:25.734858+0000 mgr.gibba020.yqfnwy (mgr.34427) 4111 : cluster [DBG] pgmap v2333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:28.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:27 gibba020 bash[25448]: cluster 2021-03-10T15:10:27.736190+0000 mgr.gibba020.yqfnwy (mgr.34427) 4112 : cluster [DBG] pgmap v2334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:28.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:27 gibba013 bash[29418]: cluster 2021-03-10T15:10:27.736190+0000 mgr.gibba020.yqfnwy (mgr.34427) 4112 : cluster [DBG] pgmap v2334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:28.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:27 gibba013 bash[30381]: cluster 2021-03-10T15:10:27.736190+0000 mgr.gibba020.yqfnwy (mgr.34427) 4112 : cluster [DBG] pgmap v2334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:31.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:30 gibba013 bash[29418]: cluster 2021-03-10T15:10:29.737799+0000 mgr.gibba020.yqfnwy (mgr.34427) 4113 : cluster [DBG] pgmap v2335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:31.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:30 gibba013 bash[30381]: cluster 2021-03-10T15:10:29.737799+0000 mgr.gibba020.yqfnwy (mgr.34427) 4113 : cluster [DBG] pgmap v2335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:31.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:30 gibba020 bash[25448]: cluster 2021-03-10T15:10:29.737799+0000 mgr.gibba020.yqfnwy (mgr.34427) 4113 : cluster [DBG] pgmap v2335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:33.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:32 gibba013 bash[29418]: cluster 2021-03-10T15:10:31.739518+0000 mgr.gibba020.yqfnwy (mgr.34427) 4114 : cluster [DBG] pgmap v2336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:33.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:32 gibba013 bash[30381]: cluster 2021-03-10T15:10:31.739518+0000 mgr.gibba020.yqfnwy (mgr.34427) 4114 : cluster [DBG] pgmap v2336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:33.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:32 gibba020 bash[25448]: cluster 2021-03-10T15:10:31.739518+0000 mgr.gibba020.yqfnwy (mgr.34427) 4114 : cluster [DBG] pgmap v2336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:35.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:34 gibba013 bash[29418]: cluster 2021-03-10T15:10:33.741135+0000 mgr.gibba020.yqfnwy (mgr.34427) 4115 : cluster [DBG] pgmap v2337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:35.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:34 gibba013 bash[30381]: cluster 2021-03-10T15:10:33.741135+0000 mgr.gibba020.yqfnwy (mgr.34427) 4115 : cluster [DBG] pgmap v2337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:35.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:34 gibba020 bash[25448]: cluster 2021-03-10T15:10:33.741135+0000 mgr.gibba020.yqfnwy (mgr.34427) 4115 : cluster [DBG] pgmap v2337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:37.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:36 gibba013 bash[29418]: cephadm 2021-03-10T15:10:35.513714+0000 mgr.gibba020.yqfnwy (mgr.34427) 4116 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:10:37.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:36 gibba013 bash[29418]: cluster 2021-03-10T15:10:35.742883+0000 mgr.gibba020.yqfnwy (mgr.34427) 4117 : cluster [DBG] pgmap v2338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:37.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:36 gibba013 bash[30381]: cephadm 2021-03-10T15:10:35.513714+0000 mgr.gibba020.yqfnwy (mgr.34427) 4116 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:10:37.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:36 gibba013 bash[30381]: cluster 2021-03-10T15:10:35.742883+0000 mgr.gibba020.yqfnwy (mgr.34427) 4117 : cluster [DBG] pgmap v2338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:37.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:36 gibba020 bash[25448]: cephadm 2021-03-10T15:10:35.513714+0000 mgr.gibba020.yqfnwy (mgr.34427) 4116 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:10:37.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:36 gibba020 bash[25448]: cluster 2021-03-10T15:10:35.742883+0000 mgr.gibba020.yqfnwy (mgr.34427) 4117 : cluster [DBG] pgmap v2338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:38.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:37 gibba020 bash[25448]: cluster 2021-03-10T15:10:37.744475+0000 mgr.gibba020.yqfnwy (mgr.34427) 4118 : cluster [DBG] pgmap v2339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:38.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:37 gibba013 bash[29418]: cluster 2021-03-10T15:10:37.744475+0000 mgr.gibba020.yqfnwy (mgr.34427) 4118 : cluster [DBG] pgmap v2339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:38.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:37 gibba013 bash[30381]: cluster 2021-03-10T15:10:37.744475+0000 mgr.gibba020.yqfnwy (mgr.34427) 4118 : cluster [DBG] pgmap v2339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:40.798 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:10:41.034 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:10:41.035 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (77m) 114s ago 82m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:10:41.035 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (82m) 50s ago 82m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:10:41.035 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (77m) 50s ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:10:41.036 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (77m) 50s ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:10:41.036 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (76m) 114s ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:10:41.036 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (76m) 114s ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:10:41.036 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (76m) 50s ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:10:41.036 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (76m) 114s ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:10:41.037 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (82m) 114s ago 82m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:10:41.037 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (82m) 50s ago 82m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:10:41.037 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (75m) 114s ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:10:41.037 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (75m) 114s ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:10:41.038 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (74m) 114s ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:10:41.038 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (74m) 114s ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:10:41.038 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (73m) 50s ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:10:41.038 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (73m) 50s ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:10:41.039 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (72m) 50s ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:10:41.039 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (72m) 50s ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:10:41.039 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (82m) 50s ago 82m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:10:41.039 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 50s ago 80m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:10:41.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:40 gibba013 bash[29418]: cluster 2021-03-10T15:10:39.746018+0000 mgr.gibba020.yqfnwy (mgr.34427) 4119 : cluster [DBG] pgmap v2340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:41.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:40 gibba013 bash[30381]: cluster 2021-03-10T15:10:39.746018+0000 mgr.gibba020.yqfnwy (mgr.34427) 4119 : cluster [DBG] pgmap v2340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:41.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:40 gibba020 bash[25448]: cluster 2021-03-10T15:10:39.746018+0000 mgr.gibba020.yqfnwy (mgr.34427) 4119 : cluster [DBG] pgmap v2340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:41.282 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:10:41.282 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:10:41.283 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:10:41.283 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:10:41.283 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:10:41.283 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:10:41.283 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:10:41.284 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:10:41.284 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:10:41.284 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:10:41.284 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:10:41.285 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:10:41.285 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:10:41.285 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:10:41.285 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:10:42.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:41 gibba013 bash[29418]: audit 2021-03-10T15:10:40.784743+0000 mgr.gibba020.yqfnwy (mgr.34427) 4120 : audit [DBG] from='client.46824 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:10:42.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:41 gibba013 bash[29418]: audit 2021-03-10T15:10:41.279181+0000 mon.a (mon.0) 1792 : audit [DBG] from='client.? 172.21.2.113:0/3888150470' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:42.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:41 gibba013 bash[30381]: audit 2021-03-10T15:10:40.784743+0000 mgr.gibba020.yqfnwy (mgr.34427) 4120 : audit [DBG] from='client.46824 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:10:42.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:41 gibba013 bash[30381]: audit 2021-03-10T15:10:41.279181+0000 mon.a (mon.0) 1792 : audit [DBG] from='client.? 172.21.2.113:0/3888150470' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:42.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:41 gibba020 bash[25448]: audit 2021-03-10T15:10:40.784743+0000 mgr.gibba020.yqfnwy (mgr.34427) 4120 : audit [DBG] from='client.46824 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:10:42.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:41 gibba020 bash[25448]: audit 2021-03-10T15:10:41.279181+0000 mon.a (mon.0) 1792 : audit [DBG] from='client.? 172.21.2.113:0/3888150470' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:43.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:42 gibba013 bash[29418]: audit 2021-03-10T15:10:41.017906+0000 mgr.gibba020.yqfnwy (mgr.34427) 4121 : audit [DBG] from='client.46830 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:10:43.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:42 gibba013 bash[29418]: cluster 2021-03-10T15:10:41.747491+0000 mgr.gibba020.yqfnwy (mgr.34427) 4122 : cluster [DBG] pgmap v2341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:43.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:42 gibba013 bash[30381]: audit 2021-03-10T15:10:41.017906+0000 mgr.gibba020.yqfnwy (mgr.34427) 4121 : audit [DBG] from='client.46830 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:10:43.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:42 gibba013 bash[30381]: cluster 2021-03-10T15:10:41.747491+0000 mgr.gibba020.yqfnwy (mgr.34427) 4122 : cluster [DBG] pgmap v2341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:43.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:42 gibba020 bash[25448]: audit 2021-03-10T15:10:41.017906+0000 mgr.gibba020.yqfnwy (mgr.34427) 4121 : audit [DBG] from='client.46830 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:10:43.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:42 gibba020 bash[25448]: cluster 2021-03-10T15:10:41.747491+0000 mgr.gibba020.yqfnwy (mgr.34427) 4122 : cluster [DBG] pgmap v2341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:45.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:44 gibba013 bash[29418]: cluster 2021-03-10T15:10:43.749163+0000 mgr.gibba020.yqfnwy (mgr.34427) 4123 : cluster [DBG] pgmap v2342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:45.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:44 gibba013 bash[30381]: cluster 2021-03-10T15:10:43.749163+0000 mgr.gibba020.yqfnwy (mgr.34427) 4123 : cluster [DBG] pgmap v2342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:45.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:44 gibba020 bash[25448]: cluster 2021-03-10T15:10:43.749163+0000 mgr.gibba020.yqfnwy (mgr.34427) 4123 : cluster [DBG] pgmap v2342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:47.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:46 gibba013 bash[29418]: cluster 2021-03-10T15:10:45.750813+0000 mgr.gibba020.yqfnwy (mgr.34427) 4124 : cluster [DBG] pgmap v2343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:47.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:46 gibba013 bash[30381]: cluster 2021-03-10T15:10:45.750813+0000 mgr.gibba020.yqfnwy (mgr.34427) 4124 : cluster [DBG] pgmap v2343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:47.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:46 gibba020 bash[25448]: cluster 2021-03-10T15:10:45.750813+0000 mgr.gibba020.yqfnwy (mgr.34427) 4124 : cluster [DBG] pgmap v2343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:48.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:47 gibba020 bash[25448]: cluster 2021-03-10T15:10:47.752314+0000 mgr.gibba020.yqfnwy (mgr.34427) 4125 : cluster [DBG] pgmap v2344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:48.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:47 gibba013 bash[29418]: cluster 2021-03-10T15:10:47.752314+0000 mgr.gibba020.yqfnwy (mgr.34427) 4125 : cluster [DBG] pgmap v2344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:48.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:47 gibba013 bash[30381]: cluster 2021-03-10T15:10:47.752314+0000 mgr.gibba020.yqfnwy (mgr.34427) 4125 : cluster [DBG] pgmap v2344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:51.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:50 gibba013 bash[29418]: cluster 2021-03-10T15:10:49.753740+0000 mgr.gibba020.yqfnwy (mgr.34427) 4126 : cluster [DBG] pgmap v2345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:51.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:50 gibba013 bash[29418]: audit 2021-03-10T15:10:50.531476+0000 mon.a (mon.0) 1793 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:10:51.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:50 gibba013 bash[29418]: audit 2021-03-10T15:10:50.760189+0000 mon.a (mon.0) 1794 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:10:51.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:50 gibba013 bash[29418]: audit 2021-03-10T15:10:50.763567+0000 mon.a (mon.0) 1795 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:10:51.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:50 gibba013 bash[29418]: audit 2021-03-10T15:10:50.765038+0000 mon.a (mon.0) 1796 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:51.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:50 gibba013 bash[29418]: audit 2021-03-10T15:10:50.766574+0000 mon.a (mon.0) 1797 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:51.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:50 gibba013 bash[29418]: audit 2021-03-10T15:10:50.768009+0000 mon.a (mon.0) 1798 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:51.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:50 gibba013 bash[29418]: audit 2021-03-10T15:10:50.771122+0000 mon.a (mon.0) 1799 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:51.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:50 gibba013 bash[29418]: audit 2021-03-10T15:10:50.772804+0000 mon.a (mon.0) 1800 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:51.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:50 gibba013 bash[30381]: cluster 2021-03-10T15:10:49.753740+0000 mgr.gibba020.yqfnwy (mgr.34427) 4126 : cluster [DBG] pgmap v2345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:51.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:50 gibba013 bash[30381]: audit 2021-03-10T15:10:50.531476+0000 mon.a (mon.0) 1793 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:10:51.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:50 gibba013 bash[30381]: audit 2021-03-10T15:10:50.760189+0000 mon.a (mon.0) 1794 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:10:51.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:50 gibba013 bash[30381]: audit 2021-03-10T15:10:50.763567+0000 mon.a (mon.0) 1795 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:10:51.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:50 gibba013 bash[30381]: audit 2021-03-10T15:10:50.765038+0000 mon.a (mon.0) 1796 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:51.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:50 gibba013 bash[30381]: audit 2021-03-10T15:10:50.766574+0000 mon.a (mon.0) 1797 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:51.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:50 gibba013 bash[30381]: audit 2021-03-10T15:10:50.768009+0000 mon.a (mon.0) 1798 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:51.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:50 gibba013 bash[30381]: audit 2021-03-10T15:10:50.771122+0000 mon.a (mon.0) 1799 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:51.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:50 gibba013 bash[30381]: audit 2021-03-10T15:10:50.772804+0000 mon.a (mon.0) 1800 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:51.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:50 gibba020 bash[25448]: cluster 2021-03-10T15:10:49.753740+0000 mgr.gibba020.yqfnwy (mgr.34427) 4126 : cluster [DBG] pgmap v2345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:51.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:50 gibba020 bash[25448]: audit 2021-03-10T15:10:50.531476+0000 mon.a (mon.0) 1793 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:10:51.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:50 gibba020 bash[25448]: audit 2021-03-10T15:10:50.760189+0000 mon.a (mon.0) 1794 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:10:51.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:50 gibba020 bash[25448]: audit 2021-03-10T15:10:50.763567+0000 mon.a (mon.0) 1795 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:10:51.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:50 gibba020 bash[25448]: audit 2021-03-10T15:10:50.765038+0000 mon.a (mon.0) 1796 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:51.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:50 gibba020 bash[25448]: audit 2021-03-10T15:10:50.766574+0000 mon.a (mon.0) 1797 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:51.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:50 gibba020 bash[25448]: audit 2021-03-10T15:10:50.768009+0000 mon.a (mon.0) 1798 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:51.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:50 gibba020 bash[25448]: audit 2021-03-10T15:10:50.771122+0000 mon.a (mon.0) 1799 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:51.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:50 gibba020 bash[25448]: audit 2021-03-10T15:10:50.772804+0000 mon.a (mon.0) 1800 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:10:52.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:51 gibba013 bash[29418]: cephadm 2021-03-10T15:10:50.535890+0000 mgr.gibba020.yqfnwy (mgr.34427) 4127 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:10:52.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:51 gibba013 bash[29418]: cephadm 2021-03-10T15:10:50.537756+0000 mgr.gibba020.yqfnwy (mgr.34427) 4128 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:10:52.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:51 gibba013 bash[29418]: cephadm 2021-03-10T15:10:50.761611+0000 mgr.gibba020.yqfnwy (mgr.34427) 4129 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:10:52.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:51 gibba013 bash[29418]: cephadm 2021-03-10T15:10:50.763452+0000 mgr.gibba020.yqfnwy (mgr.34427) 4130 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:10:52.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:51 gibba013 bash[29418]: cephadm 2021-03-10T15:10:50.764962+0000 mgr.gibba020.yqfnwy (mgr.34427) 4131 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:10:52.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:51 gibba013 bash[29418]: cephadm 2021-03-10T15:10:50.764999+0000 mgr.gibba020.yqfnwy (mgr.34427) 4132 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:10:52.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:51 gibba013 bash[29418]: cephadm 2021-03-10T15:10:50.766449+0000 mgr.gibba020.yqfnwy (mgr.34427) 4133 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:10:52.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:51 gibba013 bash[29418]: cephadm 2021-03-10T15:10:50.766488+0000 mgr.gibba020.yqfnwy (mgr.34427) 4134 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:10:52.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:51 gibba013 bash[29418]: cephadm 2021-03-10T15:10:50.767892+0000 mgr.gibba020.yqfnwy (mgr.34427) 4135 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:10:52.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:51 gibba013 bash[29418]: cephadm 2021-03-10T15:10:50.769382+0000 mgr.gibba020.yqfnwy (mgr.34427) 4136 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:10:52.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:51 gibba013 bash[29418]: cephadm 2021-03-10T15:10:50.769440+0000 mgr.gibba020.yqfnwy (mgr.34427) 4137 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:10:52.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:51 gibba013 bash[29418]: cephadm 2021-03-10T15:10:50.770945+0000 mgr.gibba020.yqfnwy (mgr.34427) 4138 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:10:52.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:51 gibba013 bash[29418]: cephadm 2021-03-10T15:10:50.771262+0000 mgr.gibba020.yqfnwy (mgr.34427) 4139 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:10:52.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:51 gibba013 bash[29418]: cephadm 2021-03-10T15:10:50.772672+0000 mgr.gibba020.yqfnwy (mgr.34427) 4140 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:10:52.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:51 gibba013 bash[29418]: cephadm 2021-03-10T15:10:50.772709+0000 mgr.gibba020.yqfnwy (mgr.34427) 4141 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:10:52.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:51 gibba013 bash[29418]: cephadm 2021-03-10T15:10:50.772815+0000 mgr.gibba020.yqfnwy (mgr.34427) 4142 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:10:52.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:51 gibba013 bash[30381]: cephadm 2021-03-10T15:10:50.535890+0000 mgr.gibba020.yqfnwy (mgr.34427) 4127 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:10:52.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:51 gibba013 bash[30381]: cephadm 2021-03-10T15:10:50.537756+0000 mgr.gibba020.yqfnwy (mgr.34427) 4128 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:10:52.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:51 gibba013 bash[30381]: cephadm 2021-03-10T15:10:50.761611+0000 mgr.gibba020.yqfnwy (mgr.34427) 4129 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:10:52.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:51 gibba013 bash[30381]: cephadm 2021-03-10T15:10:50.763452+0000 mgr.gibba020.yqfnwy (mgr.34427) 4130 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:10:52.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:51 gibba013 bash[30381]: cephadm 2021-03-10T15:10:50.764962+0000 mgr.gibba020.yqfnwy (mgr.34427) 4131 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:10:52.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:51 gibba013 bash[30381]: cephadm 2021-03-10T15:10:50.764999+0000 mgr.gibba020.yqfnwy (mgr.34427) 4132 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:10:52.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:51 gibba013 bash[30381]: cephadm 2021-03-10T15:10:50.766449+0000 mgr.gibba020.yqfnwy (mgr.34427) 4133 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:10:52.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:51 gibba013 bash[30381]: cephadm 2021-03-10T15:10:50.766488+0000 mgr.gibba020.yqfnwy (mgr.34427) 4134 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:10:52.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:51 gibba013 bash[30381]: cephadm 2021-03-10T15:10:50.767892+0000 mgr.gibba020.yqfnwy (mgr.34427) 4135 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:10:52.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:51 gibba013 bash[30381]: cephadm 2021-03-10T15:10:50.769382+0000 mgr.gibba020.yqfnwy (mgr.34427) 4136 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:10:52.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:51 gibba013 bash[30381]: cephadm 2021-03-10T15:10:50.769440+0000 mgr.gibba020.yqfnwy (mgr.34427) 4137 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:10:52.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:51 gibba013 bash[30381]: cephadm 2021-03-10T15:10:50.770945+0000 mgr.gibba020.yqfnwy (mgr.34427) 4138 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:10:52.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:51 gibba013 bash[30381]: cephadm 2021-03-10T15:10:50.771262+0000 mgr.gibba020.yqfnwy (mgr.34427) 4139 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:10:52.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:51 gibba013 bash[30381]: cephadm 2021-03-10T15:10:50.772672+0000 mgr.gibba020.yqfnwy (mgr.34427) 4140 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:10:52.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:51 gibba013 bash[30381]: cephadm 2021-03-10T15:10:50.772709+0000 mgr.gibba020.yqfnwy (mgr.34427) 4141 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:10:52.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:51 gibba013 bash[30381]: cephadm 2021-03-10T15:10:50.772815+0000 mgr.gibba020.yqfnwy (mgr.34427) 4142 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:10:52.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:51 gibba020 bash[25448]: cephadm 2021-03-10T15:10:50.535890+0000 mgr.gibba020.yqfnwy (mgr.34427) 4127 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:10:52.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:51 gibba020 bash[25448]: cephadm 2021-03-10T15:10:50.537756+0000 mgr.gibba020.yqfnwy (mgr.34427) 4128 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:10:52.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:51 gibba020 bash[25448]: cephadm 2021-03-10T15:10:50.761611+0000 mgr.gibba020.yqfnwy (mgr.34427) 4129 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:10:52.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:51 gibba020 bash[25448]: cephadm 2021-03-10T15:10:50.763452+0000 mgr.gibba020.yqfnwy (mgr.34427) 4130 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:10:52.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:51 gibba020 bash[25448]: cephadm 2021-03-10T15:10:50.764962+0000 mgr.gibba020.yqfnwy (mgr.34427) 4131 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:10:52.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:51 gibba020 bash[25448]: cephadm 2021-03-10T15:10:50.764999+0000 mgr.gibba020.yqfnwy (mgr.34427) 4132 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:10:52.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:51 gibba020 bash[25448]: cephadm 2021-03-10T15:10:50.766449+0000 mgr.gibba020.yqfnwy (mgr.34427) 4133 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:10:52.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:51 gibba020 bash[25448]: cephadm 2021-03-10T15:10:50.766488+0000 mgr.gibba020.yqfnwy (mgr.34427) 4134 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:10:52.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:51 gibba020 bash[25448]: cephadm 2021-03-10T15:10:50.767892+0000 mgr.gibba020.yqfnwy (mgr.34427) 4135 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:10:52.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:51 gibba020 bash[25448]: cephadm 2021-03-10T15:10:50.769382+0000 mgr.gibba020.yqfnwy (mgr.34427) 4136 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:10:52.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:51 gibba020 bash[25448]: cephadm 2021-03-10T15:10:50.769440+0000 mgr.gibba020.yqfnwy (mgr.34427) 4137 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:10:52.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:51 gibba020 bash[25448]: cephadm 2021-03-10T15:10:50.770945+0000 mgr.gibba020.yqfnwy (mgr.34427) 4138 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:10:52.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:51 gibba020 bash[25448]: cephadm 2021-03-10T15:10:50.771262+0000 mgr.gibba020.yqfnwy (mgr.34427) 4139 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:10:52.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:51 gibba020 bash[25448]: cephadm 2021-03-10T15:10:50.772672+0000 mgr.gibba020.yqfnwy (mgr.34427) 4140 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:10:52.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:51 gibba020 bash[25448]: cephadm 2021-03-10T15:10:50.772709+0000 mgr.gibba020.yqfnwy (mgr.34427) 4141 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:10:52.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:51 gibba020 bash[25448]: cephadm 2021-03-10T15:10:50.772815+0000 mgr.gibba020.yqfnwy (mgr.34427) 4142 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:10:53.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:52 gibba013 bash[29418]: cluster 2021-03-10T15:10:51.755441+0000 mgr.gibba020.yqfnwy (mgr.34427) 4143 : cluster [DBG] pgmap v2346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:53.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:52 gibba013 bash[30381]: cluster 2021-03-10T15:10:51.755441+0000 mgr.gibba020.yqfnwy (mgr.34427) 4143 : cluster [DBG] pgmap v2346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:53.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:52 gibba020 bash[25448]: cluster 2021-03-10T15:10:51.755441+0000 mgr.gibba020.yqfnwy (mgr.34427) 4143 : cluster [DBG] pgmap v2346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:55.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:54 gibba013 bash[29418]: cluster 2021-03-10T15:10:53.756995+0000 mgr.gibba020.yqfnwy (mgr.34427) 4144 : cluster [DBG] pgmap v2347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:55.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:54 gibba013 bash[30381]: cluster 2021-03-10T15:10:53.756995+0000 mgr.gibba020.yqfnwy (mgr.34427) 4144 : cluster [DBG] pgmap v2347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:55.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:54 gibba020 bash[25448]: cluster 2021-03-10T15:10:53.756995+0000 mgr.gibba020.yqfnwy (mgr.34427) 4144 : cluster [DBG] pgmap v2347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:57.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:56 gibba013 bash[29418]: cluster 2021-03-10T15:10:55.758432+0000 mgr.gibba020.yqfnwy (mgr.34427) 4145 : cluster [DBG] pgmap v2348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:57.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:56 gibba013 bash[30381]: cluster 2021-03-10T15:10:55.758432+0000 mgr.gibba020.yqfnwy (mgr.34427) 4145 : cluster [DBG] pgmap v2348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:57.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:56 gibba020 bash[25448]: cluster 2021-03-10T15:10:55.758432+0000 mgr.gibba020.yqfnwy (mgr.34427) 4145 : cluster [DBG] pgmap v2348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:58.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:10:57 gibba020 bash[25448]: cluster 2021-03-10T15:10:57.759634+0000 mgr.gibba020.yqfnwy (mgr.34427) 4146 : cluster [DBG] pgmap v2349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:58.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:10:57 gibba013 bash[29418]: cluster 2021-03-10T15:10:57.759634+0000 mgr.gibba020.yqfnwy (mgr.34427) 4146 : cluster [DBG] pgmap v2349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:10:58.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:10:57 gibba013 bash[30381]: cluster 2021-03-10T15:10:57.759634+0000 mgr.gibba020.yqfnwy (mgr.34427) 4146 : cluster [DBG] pgmap v2349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:01.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:00 gibba013 bash[29418]: cluster 2021-03-10T15:10:59.761266+0000 mgr.gibba020.yqfnwy (mgr.34427) 4147 : cluster [DBG] pgmap v2350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:01.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:00 gibba013 bash[30381]: cluster 2021-03-10T15:10:59.761266+0000 mgr.gibba020.yqfnwy (mgr.34427) 4147 : cluster [DBG] pgmap v2350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:01.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:00 gibba020 bash[25448]: cluster 2021-03-10T15:10:59.761266+0000 mgr.gibba020.yqfnwy (mgr.34427) 4147 : cluster [DBG] pgmap v2350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:03.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:02 gibba013 bash[29418]: cluster 2021-03-10T15:11:01.763182+0000 mgr.gibba020.yqfnwy (mgr.34427) 4148 : cluster [DBG] pgmap v2351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:03.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:02 gibba013 bash[30381]: cluster 2021-03-10T15:11:01.763182+0000 mgr.gibba020.yqfnwy (mgr.34427) 4148 : cluster [DBG] pgmap v2351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:03.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:02 gibba020 bash[25448]: cluster 2021-03-10T15:11:01.763182+0000 mgr.gibba020.yqfnwy (mgr.34427) 4148 : cluster [DBG] pgmap v2351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:05.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:04 gibba013 bash[29418]: cluster 2021-03-10T15:11:03.764733+0000 mgr.gibba020.yqfnwy (mgr.34427) 4149 : cluster [DBG] pgmap v2352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:05.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:04 gibba013 bash[30381]: cluster 2021-03-10T15:11:03.764733+0000 mgr.gibba020.yqfnwy (mgr.34427) 4149 : cluster [DBG] pgmap v2352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:05.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:04 gibba020 bash[25448]: cluster 2021-03-10T15:11:03.764733+0000 mgr.gibba020.yqfnwy (mgr.34427) 4149 : cluster [DBG] pgmap v2352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:06 gibba013 bash[29418]: cluster 2021-03-10T15:11:05.766597+0000 mgr.gibba020.yqfnwy (mgr.34427) 4150 : cluster [DBG] pgmap v2353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:07.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:06 gibba013 bash[29418]: cephadm 2021-03-10T15:11:05.788593+0000 mgr.gibba020.yqfnwy (mgr.34427) 4151 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:11:07.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:06 gibba013 bash[29418]: audit 2021-03-10T15:11:06.365820+0000 mon.a (mon.0) 1801 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:11:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:06 gibba013 bash[29418]: audit 2021-03-10T15:11:06.403289+0000 mon.a (mon.0) 1802 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:11:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:06 gibba013 bash[29418]: audit 2021-03-10T15:11:06.477577+0000 mon.a (mon.0) 1803 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T15:11:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:06 gibba013 bash[29418]: audit 2021-03-10T15:11:06.478370+0000 mon.a (mon.0) 1804 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:11:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:06 gibba013 bash[29418]: audit 2021-03-10T15:11:06.479022+0000 mon.a (mon.0) 1805 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:11:07.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:06 gibba013 bash[29418]: audit 2021-03-10T15:11:06.479666+0000 mon.a (mon.0) 1806 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:11:07.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:06 gibba013 bash[30381]: cluster 2021-03-10T15:11:05.766597+0000 mgr.gibba020.yqfnwy (mgr.34427) 4150 : cluster [DBG] pgmap v2353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:06 gibba013 bash[30381]: cephadm 2021-03-10T15:11:05.788593+0000 mgr.gibba020.yqfnwy (mgr.34427) 4151 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:11:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:06 gibba013 bash[30381]: audit 2021-03-10T15:11:06.365820+0000 mon.a (mon.0) 1801 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:11:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:06 gibba013 bash[30381]: audit 2021-03-10T15:11:06.403289+0000 mon.a (mon.0) 1802 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:11:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:06 gibba013 bash[30381]: audit 2021-03-10T15:11:06.477577+0000 mon.a (mon.0) 1803 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T15:11:07.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:06 gibba013 bash[30381]: audit 2021-03-10T15:11:06.478370+0000 mon.a (mon.0) 1804 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:11:07.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:06 gibba013 bash[30381]: audit 2021-03-10T15:11:06.479022+0000 mon.a (mon.0) 1805 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:11:07.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:06 gibba013 bash[30381]: audit 2021-03-10T15:11:06.479666+0000 mon.a (mon.0) 1806 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:11:07.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:06 gibba020 bash[25448]: cluster 2021-03-10T15:11:05.766597+0000 mgr.gibba020.yqfnwy (mgr.34427) 4150 : cluster [DBG] pgmap v2353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:07.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:06 gibba020 bash[25448]: cephadm 2021-03-10T15:11:05.788593+0000 mgr.gibba020.yqfnwy (mgr.34427) 4151 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:11:07.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:06 gibba020 bash[25448]: audit 2021-03-10T15:11:06.365820+0000 mon.a (mon.0) 1801 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:11:07.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:06 gibba020 bash[25448]: audit 2021-03-10T15:11:06.403289+0000 mon.a (mon.0) 1802 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:11:07.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:06 gibba020 bash[25448]: audit 2021-03-10T15:11:06.477577+0000 mon.a (mon.0) 1803 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T15:11:07.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:06 gibba020 bash[25448]: audit 2021-03-10T15:11:06.478370+0000 mon.a (mon.0) 1804 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:11:07.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:06 gibba020 bash[25448]: audit 2021-03-10T15:11:06.479022+0000 mon.a (mon.0) 1805 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:11:07.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:06 gibba020 bash[25448]: audit 2021-03-10T15:11:06.479666+0000 mon.a (mon.0) 1806 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:11:08.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:07 gibba020 bash[25448]: cluster 2021-03-10T15:11:07.768222+0000 mgr.gibba020.yqfnwy (mgr.34427) 4152 : cluster [DBG] pgmap v2354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:08.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:07 gibba013 bash[29418]: cluster 2021-03-10T15:11:07.768222+0000 mgr.gibba020.yqfnwy (mgr.34427) 4152 : cluster [DBG] pgmap v2354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:08.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:07 gibba013 bash[30381]: cluster 2021-03-10T15:11:07.768222+0000 mgr.gibba020.yqfnwy (mgr.34427) 4152 : cluster [DBG] pgmap v2354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:11.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:10 gibba013 bash[29418]: cluster 2021-03-10T15:11:09.769962+0000 mgr.gibba020.yqfnwy (mgr.34427) 4153 : cluster [DBG] pgmap v2355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:11.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:10 gibba013 bash[30381]: cluster 2021-03-10T15:11:09.769962+0000 mgr.gibba020.yqfnwy (mgr.34427) 4153 : cluster [DBG] pgmap v2355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:11.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:10 gibba020 bash[25448]: cluster 2021-03-10T15:11:09.769962+0000 mgr.gibba020.yqfnwy (mgr.34427) 4153 : cluster [DBG] pgmap v2355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:11.523 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:11:11.758 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:11:11.758 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (77m) 2m ago 83m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:11:11.759 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (82m) 81s ago 82m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:11:11.759 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (78m) 81s ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:11:11.759 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (78m) 81s ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:11:11.759 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (77m) 2m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:11:11.760 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (77m) 2m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:11:11.760 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (76m) 81s ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:11:11.760 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (76m) 2m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:11:11.760 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (83m) 2m ago 83m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:11:11.760 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (83m) 81s ago 83m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:11:11.761 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (75m) 2m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:11:11.761 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (75m) 2m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:11:11.761 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (75m) 2m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:11:11.761 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (74m) 2m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:11:11.761 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (74m) 81s ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:11:11.762 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (73m) 81s ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:11:11.762 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (73m) 81s ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:11:11.762 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (72m) 81s ago 83m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:11:11.762 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (82m) 81s ago 83m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:11:11.762 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 81s ago 81m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:11:12.049 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:11:12.049 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:11:12.049 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:11:12.050 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:11:12.050 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:11:12.050 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:11:12.050 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:11:12.051 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:11:12.051 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:11:12.051 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:11:12.051 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:11:12.051 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:11:12.052 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:11:12.052 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:11:12.052 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:11:13.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:12 gibba013 bash[29418]: audit 2021-03-10T15:11:11.509970+0000 mgr.gibba020.yqfnwy (mgr.34427) 4154 : audit [DBG] from='client.46842 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:11:13.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:12 gibba013 bash[29418]: audit 2021-03-10T15:11:11.740720+0000 mgr.gibba020.yqfnwy (mgr.34427) 4155 : audit [DBG] from='client.46848 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:11:13.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:12 gibba013 bash[29418]: cluster 2021-03-10T15:11:11.770843+0000 mgr.gibba020.yqfnwy (mgr.34427) 4156 : cluster [DBG] pgmap v2356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:13.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:12 gibba013 bash[29418]: audit 2021-03-10T15:11:12.045777+0000 mon.a (mon.0) 1807 : audit [DBG] from='client.? 172.21.2.113:0/3149448709' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:13.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:12 gibba013 bash[30381]: audit 2021-03-10T15:11:11.509970+0000 mgr.gibba020.yqfnwy (mgr.34427) 4154 : audit [DBG] from='client.46842 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:11:13.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:12 gibba013 bash[30381]: audit 2021-03-10T15:11:11.740720+0000 mgr.gibba020.yqfnwy (mgr.34427) 4155 : audit [DBG] from='client.46848 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:11:13.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:12 gibba013 bash[30381]: cluster 2021-03-10T15:11:11.770843+0000 mgr.gibba020.yqfnwy (mgr.34427) 4156 : cluster [DBG] pgmap v2356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:13.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:12 gibba013 bash[30381]: audit 2021-03-10T15:11:12.045777+0000 mon.a (mon.0) 1807 : audit [DBG] from='client.? 172.21.2.113:0/3149448709' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:13.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:12 gibba020 bash[25448]: audit 2021-03-10T15:11:11.509970+0000 mgr.gibba020.yqfnwy (mgr.34427) 4154 : audit [DBG] from='client.46842 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:11:13.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:12 gibba020 bash[25448]: audit 2021-03-10T15:11:11.740720+0000 mgr.gibba020.yqfnwy (mgr.34427) 4155 : audit [DBG] from='client.46848 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:11:13.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:12 gibba020 bash[25448]: cluster 2021-03-10T15:11:11.770843+0000 mgr.gibba020.yqfnwy (mgr.34427) 4156 : cluster [DBG] pgmap v2356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:13.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:12 gibba020 bash[25448]: audit 2021-03-10T15:11:12.045777+0000 mon.a (mon.0) 1807 : audit [DBG] from='client.? 172.21.2.113:0/3149448709' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:15.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:14 gibba013 bash[29418]: cluster 2021-03-10T15:11:13.772540+0000 mgr.gibba020.yqfnwy (mgr.34427) 4157 : cluster [DBG] pgmap v2357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:15.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:14 gibba013 bash[30381]: cluster 2021-03-10T15:11:13.772540+0000 mgr.gibba020.yqfnwy (mgr.34427) 4157 : cluster [DBG] pgmap v2357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:15.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:14 gibba020 bash[25448]: cluster 2021-03-10T15:11:13.772540+0000 mgr.gibba020.yqfnwy (mgr.34427) 4157 : cluster [DBG] pgmap v2357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:17.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:16 gibba013 bash[29418]: cluster 2021-03-10T15:11:15.774363+0000 mgr.gibba020.yqfnwy (mgr.34427) 4158 : cluster [DBG] pgmap v2358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:17.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:16 gibba013 bash[30381]: cluster 2021-03-10T15:11:15.774363+0000 mgr.gibba020.yqfnwy (mgr.34427) 4158 : cluster [DBG] pgmap v2358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:17.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:16 gibba020 bash[25448]: cluster 2021-03-10T15:11:15.774363+0000 mgr.gibba020.yqfnwy (mgr.34427) 4158 : cluster [DBG] pgmap v2358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:18.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:17 gibba020 bash[25448]: cluster 2021-03-10T15:11:17.775771+0000 mgr.gibba020.yqfnwy (mgr.34427) 4159 : cluster [DBG] pgmap v2359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:18.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:17 gibba013 bash[29418]: cluster 2021-03-10T15:11:17.775771+0000 mgr.gibba020.yqfnwy (mgr.34427) 4159 : cluster [DBG] pgmap v2359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:18.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:17 gibba013 bash[30381]: cluster 2021-03-10T15:11:17.775771+0000 mgr.gibba020.yqfnwy (mgr.34427) 4159 : cluster [DBG] pgmap v2359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:21.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:20 gibba013 bash[29418]: cluster 2021-03-10T15:11:19.777395+0000 mgr.gibba020.yqfnwy (mgr.34427) 4160 : cluster [DBG] pgmap v2360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:21.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:20 gibba013 bash[30381]: cluster 2021-03-10T15:11:19.777395+0000 mgr.gibba020.yqfnwy (mgr.34427) 4160 : cluster [DBG] pgmap v2360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:21.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:20 gibba020 bash[25448]: cluster 2021-03-10T15:11:19.777395+0000 mgr.gibba020.yqfnwy (mgr.34427) 4160 : cluster [DBG] pgmap v2360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:22.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:21 gibba013 bash[29418]: cephadm 2021-03-10T15:11:20.804681+0000 mgr.gibba020.yqfnwy (mgr.34427) 4161 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:11:22.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:21 gibba013 bash[30381]: cephadm 2021-03-10T15:11:20.804681+0000 mgr.gibba020.yqfnwy (mgr.34427) 4161 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:11:22.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:21 gibba020 bash[25448]: cephadm 2021-03-10T15:11:20.804681+0000 mgr.gibba020.yqfnwy (mgr.34427) 4161 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:11:23.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:22 gibba013 bash[29418]: cluster 2021-03-10T15:11:21.779156+0000 mgr.gibba020.yqfnwy (mgr.34427) 4162 : cluster [DBG] pgmap v2361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:23.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:22 gibba013 bash[30381]: cluster 2021-03-10T15:11:21.779156+0000 mgr.gibba020.yqfnwy (mgr.34427) 4162 : cluster [DBG] pgmap v2361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:23.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:22 gibba020 bash[25448]: cluster 2021-03-10T15:11:21.779156+0000 mgr.gibba020.yqfnwy (mgr.34427) 4162 : cluster [DBG] pgmap v2361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:25.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:24 gibba013 bash[29418]: cluster 2021-03-10T15:11:23.780551+0000 mgr.gibba020.yqfnwy (mgr.34427) 4163 : cluster [DBG] pgmap v2362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:25.271 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:24 gibba013 bash[30381]: cluster 2021-03-10T15:11:23.780551+0000 mgr.gibba020.yqfnwy (mgr.34427) 4163 : cluster [DBG] pgmap v2362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:25.271 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:24 gibba020 bash[25448]: cluster 2021-03-10T15:11:23.780551+0000 mgr.gibba020.yqfnwy (mgr.34427) 4163 : cluster [DBG] pgmap v2362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:27.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:26 gibba020 bash[25448]: cluster 2021-03-10T15:11:25.782187+0000 mgr.gibba020.yqfnwy (mgr.34427) 4164 : cluster [DBG] pgmap v2363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:27.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:26 gibba013 bash[29418]: cluster 2021-03-10T15:11:25.782187+0000 mgr.gibba020.yqfnwy (mgr.34427) 4164 : cluster [DBG] pgmap v2363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:27.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:26 gibba013 bash[30381]: cluster 2021-03-10T15:11:25.782187+0000 mgr.gibba020.yqfnwy (mgr.34427) 4164 : cluster [DBG] pgmap v2363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:28.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:27 gibba020 bash[25448]: cluster 2021-03-10T15:11:27.783468+0000 mgr.gibba020.yqfnwy (mgr.34427) 4165 : cluster [DBG] pgmap v2364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:28.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:27 gibba013 bash[29418]: cluster 2021-03-10T15:11:27.783468+0000 mgr.gibba020.yqfnwy (mgr.34427) 4165 : cluster [DBG] pgmap v2364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:28.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:27 gibba013 bash[30381]: cluster 2021-03-10T15:11:27.783468+0000 mgr.gibba020.yqfnwy (mgr.34427) 4165 : cluster [DBG] pgmap v2364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:31.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:30 gibba013 bash[29418]: cluster 2021-03-10T15:11:29.785059+0000 mgr.gibba020.yqfnwy (mgr.34427) 4166 : cluster [DBG] pgmap v2365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:31.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:30 gibba013 bash[30381]: cluster 2021-03-10T15:11:29.785059+0000 mgr.gibba020.yqfnwy (mgr.34427) 4166 : cluster [DBG] pgmap v2365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:31.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:30 gibba020 bash[25448]: cluster 2021-03-10T15:11:29.785059+0000 mgr.gibba020.yqfnwy (mgr.34427) 4166 : cluster [DBG] pgmap v2365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:33.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:32 gibba013 bash[29418]: cluster 2021-03-10T15:11:31.786553+0000 mgr.gibba020.yqfnwy (mgr.34427) 4167 : cluster [DBG] pgmap v2366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:33.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:32 gibba013 bash[30381]: cluster 2021-03-10T15:11:31.786553+0000 mgr.gibba020.yqfnwy (mgr.34427) 4167 : cluster [DBG] pgmap v2366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:33.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:32 gibba020 bash[25448]: cluster 2021-03-10T15:11:31.786553+0000 mgr.gibba020.yqfnwy (mgr.34427) 4167 : cluster [DBG] pgmap v2366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:35.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:34 gibba013 bash[29418]: cluster 2021-03-10T15:11:33.787936+0000 mgr.gibba020.yqfnwy (mgr.34427) 4168 : cluster [DBG] pgmap v2367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:35.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:34 gibba013 bash[30381]: cluster 2021-03-10T15:11:33.787936+0000 mgr.gibba020.yqfnwy (mgr.34427) 4168 : cluster [DBG] pgmap v2367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:35.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:34 gibba020 bash[25448]: cluster 2021-03-10T15:11:33.787936+0000 mgr.gibba020.yqfnwy (mgr.34427) 4168 : cluster [DBG] pgmap v2367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:37.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:36 gibba013 bash[29418]: cluster 2021-03-10T15:11:35.789631+0000 mgr.gibba020.yqfnwy (mgr.34427) 4169 : cluster [DBG] pgmap v2368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:37.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:36 gibba013 bash[29418]: cephadm 2021-03-10T15:11:35.806128+0000 mgr.gibba020.yqfnwy (mgr.34427) 4170 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:11:37.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:36 gibba013 bash[30381]: cluster 2021-03-10T15:11:35.789631+0000 mgr.gibba020.yqfnwy (mgr.34427) 4169 : cluster [DBG] pgmap v2368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:37.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:36 gibba013 bash[30381]: cephadm 2021-03-10T15:11:35.806128+0000 mgr.gibba020.yqfnwy (mgr.34427) 4170 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:11:37.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:36 gibba020 bash[25448]: cluster 2021-03-10T15:11:35.789631+0000 mgr.gibba020.yqfnwy (mgr.34427) 4169 : cluster [DBG] pgmap v2368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:37.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:36 gibba020 bash[25448]: cephadm 2021-03-10T15:11:35.806128+0000 mgr.gibba020.yqfnwy (mgr.34427) 4170 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:11:38.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:37 gibba020 bash[25448]: cluster 2021-03-10T15:11:37.791037+0000 mgr.gibba020.yqfnwy (mgr.34427) 4171 : cluster [DBG] pgmap v2369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:38.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:37 gibba013 bash[29418]: cluster 2021-03-10T15:11:37.791037+0000 mgr.gibba020.yqfnwy (mgr.34427) 4171 : cluster [DBG] pgmap v2369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:38.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:37 gibba013 bash[30381]: cluster 2021-03-10T15:11:37.791037+0000 mgr.gibba020.yqfnwy (mgr.34427) 4171 : cluster [DBG] pgmap v2369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:41.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:40 gibba013 bash[29418]: cluster 2021-03-10T15:11:39.792672+0000 mgr.gibba020.yqfnwy (mgr.34427) 4172 : cluster [DBG] pgmap v2370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:41.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:40 gibba013 bash[30381]: cluster 2021-03-10T15:11:39.792672+0000 mgr.gibba020.yqfnwy (mgr.34427) 4172 : cluster [DBG] pgmap v2370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:41.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:40 gibba020 bash[25448]: cluster 2021-03-10T15:11:39.792672+0000 mgr.gibba020.yqfnwy (mgr.34427) 4172 : cluster [DBG] pgmap v2370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:42.332 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:11:42.559 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:11:42.560 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (78m) 2m ago 83m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:11:42.560 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (83m) 112s ago 83m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:11:42.560 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (78m) 112s ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:11:42.560 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (78m) 112s ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:11:42.561 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (77m) 2m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:11:42.561 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (77m) 2m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:11:42.561 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (77m) 112s ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:11:42.561 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (77m) 2m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:11:42.562 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (83m) 2m ago 83m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:11:42.562 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (83m) 112s ago 83m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:11:42.562 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (76m) 2m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:11:42.562 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (76m) 2m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:11:42.563 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (75m) 2m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:11:42.563 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (75m) 2m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:11:42.563 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (74m) 112s ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:11:42.563 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (74m) 112s ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:11:42.564 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (73m) 112s ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:11:42.564 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (73m) 112s ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:11:42.564 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (83m) 112s ago 83m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:11:42.564 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 112s ago 81m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:11:42.809 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:11:42.809 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:11:42.810 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:11:42.810 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:11:42.810 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:11:42.810 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:11:42.811 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:11:42.811 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:11:42.811 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:11:42.811 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:11:42.811 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:11:42.812 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:11:42.812 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:11:42.812 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:11:42.812 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:11:43.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:42 gibba013 bash[29418]: cluster 2021-03-10T15:11:41.794257+0000 mgr.gibba020.yqfnwy (mgr.34427) 4173 : cluster [DBG] pgmap v2371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:43.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:42 gibba013 bash[29418]: audit 2021-03-10T15:11:42.805760+0000 mon.a (mon.0) 1808 : audit [DBG] from='client.? 172.21.2.113:0/2237227431' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:43.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:42 gibba013 bash[30381]: cluster 2021-03-10T15:11:41.794257+0000 mgr.gibba020.yqfnwy (mgr.34427) 4173 : cluster [DBG] pgmap v2371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:43.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:42 gibba013 bash[30381]: audit 2021-03-10T15:11:42.805760+0000 mon.a (mon.0) 1808 : audit [DBG] from='client.? 172.21.2.113:0/2237227431' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:43.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:42 gibba020 bash[25448]: cluster 2021-03-10T15:11:41.794257+0000 mgr.gibba020.yqfnwy (mgr.34427) 4173 : cluster [DBG] pgmap v2371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:43.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:42 gibba020 bash[25448]: audit 2021-03-10T15:11:42.805760+0000 mon.a (mon.0) 1808 : audit [DBG] from='client.? 172.21.2.113:0/2237227431' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:44.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:43 gibba013 bash[29418]: audit 2021-03-10T15:11:42.319453+0000 mgr.gibba020.yqfnwy (mgr.34427) 4174 : audit [DBG] from='client.46860 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:11:44.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:43 gibba013 bash[29418]: audit 2021-03-10T15:11:42.542934+0000 mgr.gibba020.yqfnwy (mgr.34427) 4175 : audit [DBG] from='client.46866 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:11:44.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:43 gibba013 bash[30381]: audit 2021-03-10T15:11:42.319453+0000 mgr.gibba020.yqfnwy (mgr.34427) 4174 : audit [DBG] from='client.46860 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:11:44.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:43 gibba013 bash[30381]: audit 2021-03-10T15:11:42.542934+0000 mgr.gibba020.yqfnwy (mgr.34427) 4175 : audit [DBG] from='client.46866 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:11:44.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:43 gibba020 bash[25448]: audit 2021-03-10T15:11:42.319453+0000 mgr.gibba020.yqfnwy (mgr.34427) 4174 : audit [DBG] from='client.46860 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:11:44.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:43 gibba020 bash[25448]: audit 2021-03-10T15:11:42.542934+0000 mgr.gibba020.yqfnwy (mgr.34427) 4175 : audit [DBG] from='client.46866 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:11:45.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:44 gibba020 bash[25448]: cluster 2021-03-10T15:11:43.795972+0000 mgr.gibba020.yqfnwy (mgr.34427) 4176 : cluster [DBG] pgmap v2372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:45.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:44 gibba013 bash[29418]: cluster 2021-03-10T15:11:43.795972+0000 mgr.gibba020.yqfnwy (mgr.34427) 4176 : cluster [DBG] pgmap v2372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:45.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:44 gibba013 bash[30381]: cluster 2021-03-10T15:11:43.795972+0000 mgr.gibba020.yqfnwy (mgr.34427) 4176 : cluster [DBG] pgmap v2372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:47.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:46 gibba020 bash[25448]: cluster 2021-03-10T15:11:45.797688+0000 mgr.gibba020.yqfnwy (mgr.34427) 4177 : cluster [DBG] pgmap v2373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:47.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:46 gibba013 bash[29418]: cluster 2021-03-10T15:11:45.797688+0000 mgr.gibba020.yqfnwy (mgr.34427) 4177 : cluster [DBG] pgmap v2373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:47.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:46 gibba013 bash[30381]: cluster 2021-03-10T15:11:45.797688+0000 mgr.gibba020.yqfnwy (mgr.34427) 4177 : cluster [DBG] pgmap v2373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:48.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:47 gibba013 bash[29418]: cluster 2021-03-10T15:11:47.799178+0000 mgr.gibba020.yqfnwy (mgr.34427) 4178 : cluster [DBG] pgmap v2374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:48.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:47 gibba013 bash[30381]: cluster 2021-03-10T15:11:47.799178+0000 mgr.gibba020.yqfnwy (mgr.34427) 4178 : cluster [DBG] pgmap v2374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:48.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:47 gibba020 bash[25448]: cluster 2021-03-10T15:11:47.799178+0000 mgr.gibba020.yqfnwy (mgr.34427) 4178 : cluster [DBG] pgmap v2374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:51.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:50 gibba013 bash[29418]: cluster 2021-03-10T15:11:49.800990+0000 mgr.gibba020.yqfnwy (mgr.34427) 4179 : cluster [DBG] pgmap v2375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:51.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:50 gibba013 bash[29418]: audit 2021-03-10T15:11:50.824299+0000 mon.a (mon.0) 1809 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:11:51.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:50 gibba013 bash[30381]: cluster 2021-03-10T15:11:49.800990+0000 mgr.gibba020.yqfnwy (mgr.34427) 4179 : cluster [DBG] pgmap v2375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:51.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:50 gibba013 bash[30381]: audit 2021-03-10T15:11:50.824299+0000 mon.a (mon.0) 1809 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:11:51.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:50 gibba020 bash[25448]: cluster 2021-03-10T15:11:49.800990+0000 mgr.gibba020.yqfnwy (mgr.34427) 4179 : cluster [DBG] pgmap v2375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:51.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:50 gibba020 bash[25448]: audit 2021-03-10T15:11:50.824299+0000 mon.a (mon.0) 1809 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:11:52.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:51 gibba013 bash[29418]: cephadm 2021-03-10T15:11:50.829132+0000 mgr.gibba020.yqfnwy (mgr.34427) 4180 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:11:52.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:51 gibba013 bash[29418]: cephadm 2021-03-10T15:11:50.831127+0000 mgr.gibba020.yqfnwy (mgr.34427) 4181 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:11:52.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:51 gibba013 bash[29418]: audit 2021-03-10T15:11:51.053957+0000 mon.a (mon.0) 1810 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:11:52.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:51 gibba013 bash[29418]: audit 2021-03-10T15:11:51.057255+0000 mon.a (mon.0) 1811 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:11:52.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:51 gibba013 bash[29418]: audit 2021-03-10T15:11:51.058541+0000 mon.a (mon.0) 1812 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:52.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:51 gibba013 bash[29418]: audit 2021-03-10T15:11:51.059855+0000 mon.a (mon.0) 1813 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:52.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:51 gibba013 bash[29418]: audit 2021-03-10T15:11:51.061321+0000 mon.a (mon.0) 1814 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:52.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:51 gibba013 bash[29418]: audit 2021-03-10T15:11:51.064224+0000 mon.a (mon.0) 1815 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:52.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:51 gibba013 bash[29418]: audit 2021-03-10T15:11:51.065896+0000 mon.a (mon.0) 1816 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:52.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:51 gibba013 bash[30381]: cephadm 2021-03-10T15:11:50.829132+0000 mgr.gibba020.yqfnwy (mgr.34427) 4180 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:11:52.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:51 gibba013 bash[30381]: cephadm 2021-03-10T15:11:50.831127+0000 mgr.gibba020.yqfnwy (mgr.34427) 4181 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:11:52.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:51 gibba013 bash[30381]: audit 2021-03-10T15:11:51.053957+0000 mon.a (mon.0) 1810 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:11:52.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:51 gibba013 bash[30381]: audit 2021-03-10T15:11:51.057255+0000 mon.a (mon.0) 1811 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:11:52.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:51 gibba013 bash[30381]: audit 2021-03-10T15:11:51.058541+0000 mon.a (mon.0) 1812 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:52.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:51 gibba013 bash[30381]: audit 2021-03-10T15:11:51.059855+0000 mon.a (mon.0) 1813 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:52.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:51 gibba013 bash[30381]: audit 2021-03-10T15:11:51.061321+0000 mon.a (mon.0) 1814 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:52.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:51 gibba013 bash[30381]: audit 2021-03-10T15:11:51.064224+0000 mon.a (mon.0) 1815 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:52.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:51 gibba013 bash[30381]: audit 2021-03-10T15:11:51.065896+0000 mon.a (mon.0) 1816 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:52.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:51 gibba020 bash[25448]: cephadm 2021-03-10T15:11:50.829132+0000 mgr.gibba020.yqfnwy (mgr.34427) 4180 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:11:52.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:51 gibba020 bash[25448]: cephadm 2021-03-10T15:11:50.831127+0000 mgr.gibba020.yqfnwy (mgr.34427) 4181 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:11:52.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:51 gibba020 bash[25448]: audit 2021-03-10T15:11:51.053957+0000 mon.a (mon.0) 1810 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:11:52.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:51 gibba020 bash[25448]: audit 2021-03-10T15:11:51.057255+0000 mon.a (mon.0) 1811 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:11:52.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:51 gibba020 bash[25448]: audit 2021-03-10T15:11:51.058541+0000 mon.a (mon.0) 1812 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:52.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:51 gibba020 bash[25448]: audit 2021-03-10T15:11:51.059855+0000 mon.a (mon.0) 1813 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:52.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:51 gibba020 bash[25448]: audit 2021-03-10T15:11:51.061321+0000 mon.a (mon.0) 1814 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:52.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:51 gibba020 bash[25448]: audit 2021-03-10T15:11:51.064224+0000 mon.a (mon.0) 1815 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:52.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:51 gibba020 bash[25448]: audit 2021-03-10T15:11:51.065896+0000 mon.a (mon.0) 1816 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:11:53.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:52 gibba013 bash[29418]: cephadm 2021-03-10T15:11:51.055142+0000 mgr.gibba020.yqfnwy (mgr.34427) 4182 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:11:53.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:52 gibba013 bash[29418]: cephadm 2021-03-10T15:11:51.057069+0000 mgr.gibba020.yqfnwy (mgr.34427) 4183 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:11:53.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:52 gibba013 bash[29418]: cephadm 2021-03-10T15:11:51.058204+0000 mgr.gibba020.yqfnwy (mgr.34427) 4184 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:11:53.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:52 gibba013 bash[29418]: cephadm 2021-03-10T15:11:51.058240+0000 mgr.gibba020.yqfnwy (mgr.34427) 4185 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:11:53.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:52 gibba013 bash[29418]: cephadm 2021-03-10T15:11:51.059680+0000 mgr.gibba020.yqfnwy (mgr.34427) 4186 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:11:53.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:52 gibba013 bash[29418]: cephadm 2021-03-10T15:11:51.059717+0000 mgr.gibba020.yqfnwy (mgr.34427) 4187 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:11:53.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:52 gibba013 bash[29418]: cephadm 2021-03-10T15:11:51.061197+0000 mgr.gibba020.yqfnwy (mgr.34427) 4188 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:11:53.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:52 gibba013 bash[29418]: cephadm 2021-03-10T15:11:51.062467+0000 mgr.gibba020.yqfnwy (mgr.34427) 4189 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:11:53.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:52 gibba013 bash[29418]: cephadm 2021-03-10T15:11:51.062503+0000 mgr.gibba020.yqfnwy (mgr.34427) 4190 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:11:53.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:52 gibba013 bash[29418]: cephadm 2021-03-10T15:11:51.063927+0000 mgr.gibba020.yqfnwy (mgr.34427) 4191 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:11:53.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:52 gibba013 bash[29418]: cephadm 2021-03-10T15:11:51.064382+0000 mgr.gibba020.yqfnwy (mgr.34427) 4192 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:11:53.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:52 gibba013 bash[29418]: cephadm 2021-03-10T15:11:51.065446+0000 mgr.gibba020.yqfnwy (mgr.34427) 4193 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:11:53.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:52 gibba013 bash[29418]: cephadm 2021-03-10T15:11:51.065483+0000 mgr.gibba020.yqfnwy (mgr.34427) 4194 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:11:53.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:52 gibba013 bash[29418]: cephadm 2021-03-10T15:11:51.065588+0000 mgr.gibba020.yqfnwy (mgr.34427) 4195 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:11:53.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:52 gibba013 bash[29418]: cluster 2021-03-10T15:11:51.802460+0000 mgr.gibba020.yqfnwy (mgr.34427) 4196 : cluster [DBG] pgmap v2376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:53.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:52 gibba013 bash[30381]: cephadm 2021-03-10T15:11:51.055142+0000 mgr.gibba020.yqfnwy (mgr.34427) 4182 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:11:53.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:52 gibba013 bash[30381]: cephadm 2021-03-10T15:11:51.057069+0000 mgr.gibba020.yqfnwy (mgr.34427) 4183 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:11:53.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:52 gibba013 bash[30381]: cephadm 2021-03-10T15:11:51.058204+0000 mgr.gibba020.yqfnwy (mgr.34427) 4184 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:11:53.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:52 gibba013 bash[30381]: cephadm 2021-03-10T15:11:51.058240+0000 mgr.gibba020.yqfnwy (mgr.34427) 4185 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:11:53.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:52 gibba013 bash[30381]: cephadm 2021-03-10T15:11:51.059680+0000 mgr.gibba020.yqfnwy (mgr.34427) 4186 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:11:53.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:52 gibba013 bash[30381]: cephadm 2021-03-10T15:11:51.059717+0000 mgr.gibba020.yqfnwy (mgr.34427) 4187 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:11:53.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:52 gibba013 bash[30381]: cephadm 2021-03-10T15:11:51.061197+0000 mgr.gibba020.yqfnwy (mgr.34427) 4188 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:11:53.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:52 gibba013 bash[30381]: cephadm 2021-03-10T15:11:51.062467+0000 mgr.gibba020.yqfnwy (mgr.34427) 4189 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:11:53.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:52 gibba013 bash[30381]: cephadm 2021-03-10T15:11:51.062503+0000 mgr.gibba020.yqfnwy (mgr.34427) 4190 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:11:53.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:52 gibba013 bash[30381]: cephadm 2021-03-10T15:11:51.063927+0000 mgr.gibba020.yqfnwy (mgr.34427) 4191 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:11:53.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:52 gibba013 bash[30381]: cephadm 2021-03-10T15:11:51.064382+0000 mgr.gibba020.yqfnwy (mgr.34427) 4192 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:11:53.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:52 gibba013 bash[30381]: cephadm 2021-03-10T15:11:51.065446+0000 mgr.gibba020.yqfnwy (mgr.34427) 4193 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:11:53.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:52 gibba013 bash[30381]: cephadm 2021-03-10T15:11:51.065483+0000 mgr.gibba020.yqfnwy (mgr.34427) 4194 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:11:53.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:52 gibba013 bash[30381]: cephadm 2021-03-10T15:11:51.065588+0000 mgr.gibba020.yqfnwy (mgr.34427) 4195 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:11:53.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:52 gibba013 bash[30381]: cluster 2021-03-10T15:11:51.802460+0000 mgr.gibba020.yqfnwy (mgr.34427) 4196 : cluster [DBG] pgmap v2376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:53.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:52 gibba020 bash[25448]: cephadm 2021-03-10T15:11:51.055142+0000 mgr.gibba020.yqfnwy (mgr.34427) 4182 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:11:53.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:52 gibba020 bash[25448]: cephadm 2021-03-10T15:11:51.057069+0000 mgr.gibba020.yqfnwy (mgr.34427) 4183 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:11:53.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:52 gibba020 bash[25448]: cephadm 2021-03-10T15:11:51.058204+0000 mgr.gibba020.yqfnwy (mgr.34427) 4184 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:11:53.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:52 gibba020 bash[25448]: cephadm 2021-03-10T15:11:51.058240+0000 mgr.gibba020.yqfnwy (mgr.34427) 4185 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:11:53.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:52 gibba020 bash[25448]: cephadm 2021-03-10T15:11:51.059680+0000 mgr.gibba020.yqfnwy (mgr.34427) 4186 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:11:53.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:52 gibba020 bash[25448]: cephadm 2021-03-10T15:11:51.059717+0000 mgr.gibba020.yqfnwy (mgr.34427) 4187 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:11:53.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:52 gibba020 bash[25448]: cephadm 2021-03-10T15:11:51.061197+0000 mgr.gibba020.yqfnwy (mgr.34427) 4188 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:11:53.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:52 gibba020 bash[25448]: cephadm 2021-03-10T15:11:51.062467+0000 mgr.gibba020.yqfnwy (mgr.34427) 4189 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:11:53.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:52 gibba020 bash[25448]: cephadm 2021-03-10T15:11:51.062503+0000 mgr.gibba020.yqfnwy (mgr.34427) 4190 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:11:53.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:52 gibba020 bash[25448]: cephadm 2021-03-10T15:11:51.063927+0000 mgr.gibba020.yqfnwy (mgr.34427) 4191 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:11:53.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:52 gibba020 bash[25448]: cephadm 2021-03-10T15:11:51.064382+0000 mgr.gibba020.yqfnwy (mgr.34427) 4192 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:11:53.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:52 gibba020 bash[25448]: cephadm 2021-03-10T15:11:51.065446+0000 mgr.gibba020.yqfnwy (mgr.34427) 4193 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:11:53.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:52 gibba020 bash[25448]: cephadm 2021-03-10T15:11:51.065483+0000 mgr.gibba020.yqfnwy (mgr.34427) 4194 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:11:53.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:52 gibba020 bash[25448]: cephadm 2021-03-10T15:11:51.065588+0000 mgr.gibba020.yqfnwy (mgr.34427) 4195 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:11:53.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:52 gibba020 bash[25448]: cluster 2021-03-10T15:11:51.802460+0000 mgr.gibba020.yqfnwy (mgr.34427) 4196 : cluster [DBG] pgmap v2376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:55.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:54 gibba013 bash[29418]: cluster 2021-03-10T15:11:53.803850+0000 mgr.gibba020.yqfnwy (mgr.34427) 4197 : cluster [DBG] pgmap v2377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:55.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:54 gibba013 bash[30381]: cluster 2021-03-10T15:11:53.803850+0000 mgr.gibba020.yqfnwy (mgr.34427) 4197 : cluster [DBG] pgmap v2377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:55.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:54 gibba020 bash[25448]: cluster 2021-03-10T15:11:53.803850+0000 mgr.gibba020.yqfnwy (mgr.34427) 4197 : cluster [DBG] pgmap v2377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:57.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:56 gibba020 bash[25448]: cluster 2021-03-10T15:11:55.805575+0000 mgr.gibba020.yqfnwy (mgr.34427) 4198 : cluster [DBG] pgmap v2378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:57.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:56 gibba013 bash[29418]: cluster 2021-03-10T15:11:55.805575+0000 mgr.gibba020.yqfnwy (mgr.34427) 4198 : cluster [DBG] pgmap v2378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:57.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:56 gibba013 bash[30381]: cluster 2021-03-10T15:11:55.805575+0000 mgr.gibba020.yqfnwy (mgr.34427) 4198 : cluster [DBG] pgmap v2378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:58.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:11:57 gibba013 bash[29418]: cluster 2021-03-10T15:11:57.806823+0000 mgr.gibba020.yqfnwy (mgr.34427) 4199 : cluster [DBG] pgmap v2379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:58.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:11:57 gibba013 bash[30381]: cluster 2021-03-10T15:11:57.806823+0000 mgr.gibba020.yqfnwy (mgr.34427) 4199 : cluster [DBG] pgmap v2379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:11:58.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:11:57 gibba020 bash[25448]: cluster 2021-03-10T15:11:57.806823+0000 mgr.gibba020.yqfnwy (mgr.34427) 4199 : cluster [DBG] pgmap v2379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:01.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:00 gibba013 bash[29418]: cluster 2021-03-10T15:11:59.808665+0000 mgr.gibba020.yqfnwy (mgr.34427) 4200 : cluster [DBG] pgmap v2380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:01.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:00 gibba013 bash[30381]: cluster 2021-03-10T15:11:59.808665+0000 mgr.gibba020.yqfnwy (mgr.34427) 4200 : cluster [DBG] pgmap v2380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:01.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:00 gibba020 bash[25448]: cluster 2021-03-10T15:11:59.808665+0000 mgr.gibba020.yqfnwy (mgr.34427) 4200 : cluster [DBG] pgmap v2380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:03.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:02 gibba020 bash[25448]: cluster 2021-03-10T15:12:01.810137+0000 mgr.gibba020.yqfnwy (mgr.34427) 4201 : cluster [DBG] pgmap v2381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:03.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:02 gibba013 bash[29418]: cluster 2021-03-10T15:12:01.810137+0000 mgr.gibba020.yqfnwy (mgr.34427) 4201 : cluster [DBG] pgmap v2381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:03.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:02 gibba013 bash[30381]: cluster 2021-03-10T15:12:01.810137+0000 mgr.gibba020.yqfnwy (mgr.34427) 4201 : cluster [DBG] pgmap v2381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:05.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:04 gibba020 bash[25448]: cluster 2021-03-10T15:12:03.811633+0000 mgr.gibba020.yqfnwy (mgr.34427) 4202 : cluster [DBG] pgmap v2382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:05.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:04 gibba013 bash[29418]: cluster 2021-03-10T15:12:03.811633+0000 mgr.gibba020.yqfnwy (mgr.34427) 4202 : cluster [DBG] pgmap v2382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:05.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:04 gibba013 bash[30381]: cluster 2021-03-10T15:12:03.811633+0000 mgr.gibba020.yqfnwy (mgr.34427) 4202 : cluster [DBG] pgmap v2382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:07.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:06 gibba020 bash[25448]: cluster 2021-03-10T15:12:05.813245+0000 mgr.gibba020.yqfnwy (mgr.34427) 4203 : cluster [DBG] pgmap v2383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:07.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:06 gibba020 bash[25448]: audit 2021-03-10T15:12:06.370662+0000 mon.a (mon.0) 1817 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:12:07.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:06 gibba020 bash[25448]: audit 2021-03-10T15:12:06.410367+0000 mon.a (mon.0) 1818 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:12:07.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:06 gibba020 bash[25448]: audit 2021-03-10T15:12:06.487856+0000 mon.a (mon.0) 1819 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:12:07.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:06 gibba020 bash[25448]: audit 2021-03-10T15:12:06.488603+0000 mon.a (mon.0) 1820 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:12:07.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:06 gibba020 bash[25448]: audit 2021-03-10T15:12:06.489313+0000 mon.a (mon.0) 1821 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:12:07.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:06 gibba020 bash[25448]: audit 2021-03-10T15:12:06.490006+0000 mon.a (mon.0) 1822 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:12:07.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:06 gibba013 bash[29418]: cluster 2021-03-10T15:12:05.813245+0000 mgr.gibba020.yqfnwy (mgr.34427) 4203 : cluster [DBG] pgmap v2383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:07.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:06 gibba013 bash[29418]: audit 2021-03-10T15:12:06.370662+0000 mon.a (mon.0) 1817 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:12:07.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:06 gibba013 bash[29418]: audit 2021-03-10T15:12:06.410367+0000 mon.a (mon.0) 1818 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:12:07.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:06 gibba013 bash[29418]: audit 2021-03-10T15:12:06.487856+0000 mon.a (mon.0) 1819 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:12:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:06 gibba013 bash[29418]: audit 2021-03-10T15:12:06.488603+0000 mon.a (mon.0) 1820 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:12:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:06 gibba013 bash[29418]: audit 2021-03-10T15:12:06.489313+0000 mon.a (mon.0) 1821 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:12:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:06 gibba013 bash[29418]: audit 2021-03-10T15:12:06.490006+0000 mon.a (mon.0) 1822 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:12:07.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:06 gibba013 bash[30381]: cluster 2021-03-10T15:12:05.813245+0000 mgr.gibba020.yqfnwy (mgr.34427) 4203 : cluster [DBG] pgmap v2383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:07.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:06 gibba013 bash[30381]: audit 2021-03-10T15:12:06.370662+0000 mon.a (mon.0) 1817 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:12:07.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:06 gibba013 bash[30381]: audit 2021-03-10T15:12:06.410367+0000 mon.a (mon.0) 1818 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:12:07.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:06 gibba013 bash[30381]: audit 2021-03-10T15:12:06.487856+0000 mon.a (mon.0) 1819 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:12:07.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:06 gibba013 bash[30381]: audit 2021-03-10T15:12:06.488603+0000 mon.a (mon.0) 1820 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:12:07.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:06 gibba013 bash[30381]: audit 2021-03-10T15:12:06.489313+0000 mon.a (mon.0) 1821 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:12:07.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:06 gibba013 bash[30381]: audit 2021-03-10T15:12:06.490006+0000 mon.a (mon.0) 1822 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:12:08.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:07 gibba020 bash[25448]: cephadm 2021-03-10T15:12:06.081275+0000 mgr.gibba020.yqfnwy (mgr.34427) 4204 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:12:08.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:07 gibba013 bash[29418]: cephadm 2021-03-10T15:12:06.081275+0000 mgr.gibba020.yqfnwy (mgr.34427) 4204 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:12:08.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:07 gibba013 bash[30381]: cephadm 2021-03-10T15:12:06.081275+0000 mgr.gibba020.yqfnwy (mgr.34427) 4204 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:12:09.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:08 gibba020 bash[25448]: cluster 2021-03-10T15:12:07.814762+0000 mgr.gibba020.yqfnwy (mgr.34427) 4205 : cluster [DBG] pgmap v2384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:09.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:08 gibba013 bash[29418]: cluster 2021-03-10T15:12:07.814762+0000 mgr.gibba020.yqfnwy (mgr.34427) 4205 : cluster [DBG] pgmap v2384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:09.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:08 gibba013 bash[30381]: cluster 2021-03-10T15:12:07.814762+0000 mgr.gibba020.yqfnwy (mgr.34427) 4205 : cluster [DBG] pgmap v2384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:11.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:10 gibba020 bash[25448]: cluster 2021-03-10T15:12:09.816516+0000 mgr.gibba020.yqfnwy (mgr.34427) 4206 : cluster [DBG] pgmap v2385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:11.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:10 gibba013 bash[29418]: cluster 2021-03-10T15:12:09.816516+0000 mgr.gibba020.yqfnwy (mgr.34427) 4206 : cluster [DBG] pgmap v2385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:11.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:10 gibba013 bash[30381]: cluster 2021-03-10T15:12:09.816516+0000 mgr.gibba020.yqfnwy (mgr.34427) 4206 : cluster [DBG] pgmap v2385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:12.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:11 gibba013 bash[29418]: cluster 2021-03-10T15:12:11.817823+0000 mgr.gibba020.yqfnwy (mgr.34427) 4207 : cluster [DBG] pgmap v2386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:12.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:11 gibba013 bash[30381]: cluster 2021-03-10T15:12:11.817823+0000 mgr.gibba020.yqfnwy (mgr.34427) 4207 : cluster [DBG] pgmap v2386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:12.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:11 gibba020 bash[25448]: cluster 2021-03-10T15:12:11.817823+0000 mgr.gibba020.yqfnwy (mgr.34427) 4207 : cluster [DBG] pgmap v2386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:13.053 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:12:13.315 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:12:13.315 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (78m) 3m ago 84m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:12:13.315 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (83m) 2m ago 83m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:12:13.315 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (79m) 2m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:12:13.316 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (79m) 2m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:12:13.316 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (78m) 3m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:12:13.316 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (78m) 3m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:12:13.317 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (77m) 2m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:12:13.317 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (77m) 3m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:12:13.317 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (84m) 3m ago 84m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:12:13.318 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (84m) 2m ago 84m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:12:13.318 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (77m) 3m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:12:13.318 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (76m) 3m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:12:13.319 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (76m) 3m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:12:13.319 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (75m) 3m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:12:13.319 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (75m) 2m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:12:13.320 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (74m) 2m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:12:13.320 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (74m) 2m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:12:13.320 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (73m) 2m ago 84m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:12:13.320 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (83m) 2m ago 84m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:12:13.320 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 82m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:12:13.565 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:12:13.565 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:12:13.566 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:12:13.566 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:12:13.566 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:12:13.566 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:12:13.567 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:12:13.567 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:12:13.567 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:12:13.567 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:12:13.568 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:12:13.568 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:12:13.568 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:12:13.568 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:12:13.568 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:12:13.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:13 gibba013 bash[29418]: audit 2021-03-10T15:12:13.562112+0000 mon.a (mon.0) 1823 : audit [DBG] from='client.? 172.21.2.113:0/2185329740' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:13.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:13 gibba013 bash[30381]: audit 2021-03-10T15:12:13.562112+0000 mon.a (mon.0) 1823 : audit [DBG] from='client.? 172.21.2.113:0/2185329740' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:13.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:13 gibba020 bash[25448]: audit 2021-03-10T15:12:13.562112+0000 mon.a (mon.0) 1823 : audit [DBG] from='client.? 172.21.2.113:0/2185329740' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:14.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:14 gibba013 bash[29418]: audit 2021-03-10T15:12:13.041128+0000 mgr.gibba020.yqfnwy (mgr.34427) 4208 : audit [DBG] from='client.46878 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:12:14.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:14 gibba013 bash[29418]: audit 2021-03-10T15:12:13.268625+0000 mgr.gibba020.yqfnwy (mgr.34427) 4209 : audit [DBG] from='client.46884 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:12:14.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:14 gibba013 bash[29418]: cluster 2021-03-10T15:12:13.819323+0000 mgr.gibba020.yqfnwy (mgr.34427) 4210 : cluster [DBG] pgmap v2387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:14.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:14 gibba013 bash[30381]: audit 2021-03-10T15:12:13.041128+0000 mgr.gibba020.yqfnwy (mgr.34427) 4208 : audit [DBG] from='client.46878 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:12:14.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:14 gibba013 bash[30381]: audit 2021-03-10T15:12:13.268625+0000 mgr.gibba020.yqfnwy (mgr.34427) 4209 : audit [DBG] from='client.46884 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:12:14.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:14 gibba013 bash[30381]: cluster 2021-03-10T15:12:13.819323+0000 mgr.gibba020.yqfnwy (mgr.34427) 4210 : cluster [DBG] pgmap v2387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:14.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:14 gibba020 bash[25448]: audit 2021-03-10T15:12:13.041128+0000 mgr.gibba020.yqfnwy (mgr.34427) 4208 : audit [DBG] from='client.46878 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:12:14.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:14 gibba020 bash[25448]: audit 2021-03-10T15:12:13.268625+0000 mgr.gibba020.yqfnwy (mgr.34427) 4209 : audit [DBG] from='client.46884 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:12:14.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:14 gibba020 bash[25448]: cluster 2021-03-10T15:12:13.819323+0000 mgr.gibba020.yqfnwy (mgr.34427) 4210 : cluster [DBG] pgmap v2387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:17.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:16 gibba020 bash[25448]: cluster 2021-03-10T15:12:15.821099+0000 mgr.gibba020.yqfnwy (mgr.34427) 4211 : cluster [DBG] pgmap v2388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:17.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:16 gibba013 bash[29418]: cluster 2021-03-10T15:12:15.821099+0000 mgr.gibba020.yqfnwy (mgr.34427) 4211 : cluster [DBG] pgmap v2388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:17.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:16 gibba013 bash[30381]: cluster 2021-03-10T15:12:15.821099+0000 mgr.gibba020.yqfnwy (mgr.34427) 4211 : cluster [DBG] pgmap v2388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:18.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:17 gibba013 bash[29418]: cluster 2021-03-10T15:12:17.822675+0000 mgr.gibba020.yqfnwy (mgr.34427) 4212 : cluster [DBG] pgmap v2389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:18.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:17 gibba013 bash[30381]: cluster 2021-03-10T15:12:17.822675+0000 mgr.gibba020.yqfnwy (mgr.34427) 4212 : cluster [DBG] pgmap v2389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:18.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:17 gibba020 bash[25448]: cluster 2021-03-10T15:12:17.822675+0000 mgr.gibba020.yqfnwy (mgr.34427) 4212 : cluster [DBG] pgmap v2389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:21.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:20 gibba020 bash[25448]: cluster 2021-03-10T15:12:19.824440+0000 mgr.gibba020.yqfnwy (mgr.34427) 4213 : cluster [DBG] pgmap v2390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:21.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:20 gibba013 bash[29418]: cluster 2021-03-10T15:12:19.824440+0000 mgr.gibba020.yqfnwy (mgr.34427) 4213 : cluster [DBG] pgmap v2390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:21.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:20 gibba013 bash[30381]: cluster 2021-03-10T15:12:19.824440+0000 mgr.gibba020.yqfnwy (mgr.34427) 4213 : cluster [DBG] pgmap v2390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:23.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:22 gibba020 bash[25448]: cephadm 2021-03-10T15:12:21.097317+0000 mgr.gibba020.yqfnwy (mgr.34427) 4214 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:12:23.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:22 gibba020 bash[25448]: cluster 2021-03-10T15:12:21.826045+0000 mgr.gibba020.yqfnwy (mgr.34427) 4215 : cluster [DBG] pgmap v2391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:23.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:22 gibba013 bash[29418]: cephadm 2021-03-10T15:12:21.097317+0000 mgr.gibba020.yqfnwy (mgr.34427) 4214 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:12:23.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:22 gibba013 bash[29418]: cluster 2021-03-10T15:12:21.826045+0000 mgr.gibba020.yqfnwy (mgr.34427) 4215 : cluster [DBG] pgmap v2391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:23.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:22 gibba013 bash[30381]: cephadm 2021-03-10T15:12:21.097317+0000 mgr.gibba020.yqfnwy (mgr.34427) 4214 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:12:23.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:22 gibba013 bash[30381]: cluster 2021-03-10T15:12:21.826045+0000 mgr.gibba020.yqfnwy (mgr.34427) 4215 : cluster [DBG] pgmap v2391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:25.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:24 gibba020 bash[25448]: cluster 2021-03-10T15:12:23.827668+0000 mgr.gibba020.yqfnwy (mgr.34427) 4216 : cluster [DBG] pgmap v2392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:25.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:24 gibba013 bash[29418]: cluster 2021-03-10T15:12:23.827668+0000 mgr.gibba020.yqfnwy (mgr.34427) 4216 : cluster [DBG] pgmap v2392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:25.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:24 gibba013 bash[30381]: cluster 2021-03-10T15:12:23.827668+0000 mgr.gibba020.yqfnwy (mgr.34427) 4216 : cluster [DBG] pgmap v2392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:27.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:26 gibba020 bash[25448]: cluster 2021-03-10T15:12:25.829499+0000 mgr.gibba020.yqfnwy (mgr.34427) 4217 : cluster [DBG] pgmap v2393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:27.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:26 gibba013 bash[29418]: cluster 2021-03-10T15:12:25.829499+0000 mgr.gibba020.yqfnwy (mgr.34427) 4217 : cluster [DBG] pgmap v2393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:27.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:26 gibba013 bash[30381]: cluster 2021-03-10T15:12:25.829499+0000 mgr.gibba020.yqfnwy (mgr.34427) 4217 : cluster [DBG] pgmap v2393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:28.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:27 gibba013 bash[29418]: cluster 2021-03-10T15:12:27.830853+0000 mgr.gibba020.yqfnwy (mgr.34427) 4218 : cluster [DBG] pgmap v2394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:28.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:27 gibba013 bash[30381]: cluster 2021-03-10T15:12:27.830853+0000 mgr.gibba020.yqfnwy (mgr.34427) 4218 : cluster [DBG] pgmap v2394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:28.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:27 gibba020 bash[25448]: cluster 2021-03-10T15:12:27.830853+0000 mgr.gibba020.yqfnwy (mgr.34427) 4218 : cluster [DBG] pgmap v2394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:31.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:30 gibba020 bash[25448]: cluster 2021-03-10T15:12:29.832481+0000 mgr.gibba020.yqfnwy (mgr.34427) 4219 : cluster [DBG] pgmap v2395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:31.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:30 gibba013 bash[29418]: cluster 2021-03-10T15:12:29.832481+0000 mgr.gibba020.yqfnwy (mgr.34427) 4219 : cluster [DBG] pgmap v2395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:31.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:30 gibba013 bash[30381]: cluster 2021-03-10T15:12:29.832481+0000 mgr.gibba020.yqfnwy (mgr.34427) 4219 : cluster [DBG] pgmap v2395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:33.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:32 gibba020 bash[25448]: cluster 2021-03-10T15:12:31.834205+0000 mgr.gibba020.yqfnwy (mgr.34427) 4220 : cluster [DBG] pgmap v2396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:33.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:32 gibba013 bash[29418]: cluster 2021-03-10T15:12:31.834205+0000 mgr.gibba020.yqfnwy (mgr.34427) 4220 : cluster [DBG] pgmap v2396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:33.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:32 gibba013 bash[30381]: cluster 2021-03-10T15:12:31.834205+0000 mgr.gibba020.yqfnwy (mgr.34427) 4220 : cluster [DBG] pgmap v2396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:35.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:34 gibba020 bash[25448]: cluster 2021-03-10T15:12:33.835934+0000 mgr.gibba020.yqfnwy (mgr.34427) 4221 : cluster [DBG] pgmap v2397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:35.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:34 gibba013 bash[29418]: cluster 2021-03-10T15:12:33.835934+0000 mgr.gibba020.yqfnwy (mgr.34427) 4221 : cluster [DBG] pgmap v2397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:35.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:34 gibba013 bash[30381]: cluster 2021-03-10T15:12:33.835934+0000 mgr.gibba020.yqfnwy (mgr.34427) 4221 : cluster [DBG] pgmap v2397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:37.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:36 gibba020 bash[25448]: cluster 2021-03-10T15:12:35.837591+0000 mgr.gibba020.yqfnwy (mgr.34427) 4222 : cluster [DBG] pgmap v2398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:37.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:36 gibba013 bash[29418]: cluster 2021-03-10T15:12:35.837591+0000 mgr.gibba020.yqfnwy (mgr.34427) 4222 : cluster [DBG] pgmap v2398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:37.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:36 gibba013 bash[30381]: cluster 2021-03-10T15:12:35.837591+0000 mgr.gibba020.yqfnwy (mgr.34427) 4222 : cluster [DBG] pgmap v2398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:38.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:37 gibba020 bash[25448]: cephadm 2021-03-10T15:12:36.113321+0000 mgr.gibba020.yqfnwy (mgr.34427) 4223 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:12:38.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:37 gibba013 bash[29418]: cephadm 2021-03-10T15:12:36.113321+0000 mgr.gibba020.yqfnwy (mgr.34427) 4223 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:12:38.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:37 gibba013 bash[30381]: cephadm 2021-03-10T15:12:36.113321+0000 mgr.gibba020.yqfnwy (mgr.34427) 4223 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:12:39.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:38 gibba020 bash[25448]: cluster 2021-03-10T15:12:37.838924+0000 mgr.gibba020.yqfnwy (mgr.34427) 4224 : cluster [DBG] pgmap v2399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:39.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:38 gibba013 bash[29418]: cluster 2021-03-10T15:12:37.838924+0000 mgr.gibba020.yqfnwy (mgr.34427) 4224 : cluster [DBG] pgmap v2399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:39.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:38 gibba013 bash[30381]: cluster 2021-03-10T15:12:37.838924+0000 mgr.gibba020.yqfnwy (mgr.34427) 4224 : cluster [DBG] pgmap v2399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:40.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:39 gibba020 bash[25448]: cluster 2021-03-10T15:12:39.840740+0000 mgr.gibba020.yqfnwy (mgr.34427) 4225 : cluster [DBG] pgmap v2400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:40.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:39 gibba013 bash[29418]: cluster 2021-03-10T15:12:39.840740+0000 mgr.gibba020.yqfnwy (mgr.34427) 4225 : cluster [DBG] pgmap v2400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:40.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:39 gibba013 bash[30381]: cluster 2021-03-10T15:12:39.840740+0000 mgr.gibba020.yqfnwy (mgr.34427) 4225 : cluster [DBG] pgmap v2400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:43.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:42 gibba020 bash[25448]: cluster 2021-03-10T15:12:41.842212+0000 mgr.gibba020.yqfnwy (mgr.34427) 4226 : cluster [DBG] pgmap v2401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:43.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:42 gibba013 bash[29418]: cluster 2021-03-10T15:12:41.842212+0000 mgr.gibba020.yqfnwy (mgr.34427) 4226 : cluster [DBG] pgmap v2401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:43.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:42 gibba013 bash[30381]: cluster 2021-03-10T15:12:41.842212+0000 mgr.gibba020.yqfnwy (mgr.34427) 4226 : cluster [DBG] pgmap v2401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:43.809 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:12:44.036 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:12:44.036 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (79m) 3m ago 84m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:12:44.036 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (84m) 2m ago 84m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:12:44.037 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (79m) 2m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:12:44.037 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (79m) 2m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:12:44.037 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (78m) 3m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:12:44.037 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (78m) 3m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:12:44.038 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (78m) 2m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:12:44.038 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (78m) 3m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:12:44.038 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (84m) 3m ago 84m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:12:44.038 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (84m) 2m ago 84m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:12:44.038 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (77m) 3m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:12:44.039 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (77m) 3m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:12:44.039 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (76m) 3m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:12:44.039 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (76m) 3m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:12:44.039 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (75m) 2m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:12:44.040 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (75m) 2m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:12:44.040 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (74m) 2m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:12:44.040 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (74m) 2m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:12:44.040 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (84m) 2m ago 84m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:12:44.040 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 82m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:12:44.290 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:12:44.290 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:12:44.290 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:12:44.291 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:12:44.291 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:12:44.291 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:12:44.291 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:12:44.292 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:12:44.292 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:12:44.292 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:12:44.292 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:12:44.292 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:12:44.293 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:12:44.293 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:12:44.293 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:12:45.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:44 gibba020 bash[25448]: audit 2021-03-10T15:12:43.795413+0000 mgr.gibba020.yqfnwy (mgr.34427) 4227 : audit [DBG] from='client.46896 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:12:45.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:44 gibba020 bash[25448]: cluster 2021-03-10T15:12:43.843578+0000 mgr.gibba020.yqfnwy (mgr.34427) 4228 : cluster [DBG] pgmap v2402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:45.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:44 gibba020 bash[25448]: audit 2021-03-10T15:12:44.286584+0000 mon.c (mon.1) 74 : audit [DBG] from='client.? 172.21.2.113:0/3941158995' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:45.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:44 gibba013 bash[29418]: audit 2021-03-10T15:12:43.795413+0000 mgr.gibba020.yqfnwy (mgr.34427) 4227 : audit [DBG] from='client.46896 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:12:45.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:44 gibba013 bash[29418]: cluster 2021-03-10T15:12:43.843578+0000 mgr.gibba020.yqfnwy (mgr.34427) 4228 : cluster [DBG] pgmap v2402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:45.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:44 gibba013 bash[29418]: audit 2021-03-10T15:12:44.286584+0000 mon.c (mon.1) 74 : audit [DBG] from='client.? 172.21.2.113:0/3941158995' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:45.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:44 gibba013 bash[30381]: audit 2021-03-10T15:12:43.795413+0000 mgr.gibba020.yqfnwy (mgr.34427) 4227 : audit [DBG] from='client.46896 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:12:45.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:44 gibba013 bash[30381]: cluster 2021-03-10T15:12:43.843578+0000 mgr.gibba020.yqfnwy (mgr.34427) 4228 : cluster [DBG] pgmap v2402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:45.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:44 gibba013 bash[30381]: audit 2021-03-10T15:12:44.286584+0000 mon.c (mon.1) 74 : audit [DBG] from='client.? 172.21.2.113:0/3941158995' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:46.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:45 gibba020 bash[25448]: audit 2021-03-10T15:12:44.019371+0000 mgr.gibba020.yqfnwy (mgr.34427) 4229 : audit [DBG] from='client.46902 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:12:46.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:45 gibba013 bash[29418]: audit 2021-03-10T15:12:44.019371+0000 mgr.gibba020.yqfnwy (mgr.34427) 4229 : audit [DBG] from='client.46902 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:12:46.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:45 gibba013 bash[30381]: audit 2021-03-10T15:12:44.019371+0000 mgr.gibba020.yqfnwy (mgr.34427) 4229 : audit [DBG] from='client.46902 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:12:47.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:46 gibba020 bash[25448]: cluster 2021-03-10T15:12:45.845173+0000 mgr.gibba020.yqfnwy (mgr.34427) 4230 : cluster [DBG] pgmap v2403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:47.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:46 gibba013 bash[29418]: cluster 2021-03-10T15:12:45.845173+0000 mgr.gibba020.yqfnwy (mgr.34427) 4230 : cluster [DBG] pgmap v2403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:47.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:46 gibba013 bash[30381]: cluster 2021-03-10T15:12:45.845173+0000 mgr.gibba020.yqfnwy (mgr.34427) 4230 : cluster [DBG] pgmap v2403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:48.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:47 gibba013 bash[29418]: cluster 2021-03-10T15:12:47.846575+0000 mgr.gibba020.yqfnwy (mgr.34427) 4231 : cluster [DBG] pgmap v2404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:48.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:47 gibba013 bash[30381]: cluster 2021-03-10T15:12:47.846575+0000 mgr.gibba020.yqfnwy (mgr.34427) 4231 : cluster [DBG] pgmap v2404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:48.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:47 gibba020 bash[25448]: cluster 2021-03-10T15:12:47.846575+0000 mgr.gibba020.yqfnwy (mgr.34427) 4231 : cluster [DBG] pgmap v2404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:51.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:50 gibba020 bash[25448]: cluster 2021-03-10T15:12:49.848327+0000 mgr.gibba020.yqfnwy (mgr.34427) 4232 : cluster [DBG] pgmap v2405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:51.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:50 gibba013 bash[29418]: cluster 2021-03-10T15:12:49.848327+0000 mgr.gibba020.yqfnwy (mgr.34427) 4232 : cluster [DBG] pgmap v2405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:51.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:50 gibba013 bash[30381]: cluster 2021-03-10T15:12:49.848327+0000 mgr.gibba020.yqfnwy (mgr.34427) 4232 : cluster [DBG] pgmap v2405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:52.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:51 gibba020 bash[25448]: audit 2021-03-10T15:12:51.131570+0000 mon.a (mon.0) 1824 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:12:52.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:51 gibba020 bash[25448]: audit 2021-03-10T15:12:51.351695+0000 mon.a (mon.0) 1825 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:12:52.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:51 gibba020 bash[25448]: audit 2021-03-10T15:12:51.355007+0000 mon.a (mon.0) 1826 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:12:52.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:51 gibba020 bash[25448]: audit 2021-03-10T15:12:51.356717+0000 mon.a (mon.0) 1827 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:52.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:51 gibba020 bash[25448]: audit 2021-03-10T15:12:51.358360+0000 mon.a (mon.0) 1828 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:52.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:51 gibba020 bash[25448]: audit 2021-03-10T15:12:51.360038+0000 mon.a (mon.0) 1829 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:52.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:51 gibba020 bash[25448]: audit 2021-03-10T15:12:51.363280+0000 mon.a (mon.0) 1830 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:52.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:51 gibba020 bash[25448]: audit 2021-03-10T15:12:51.365149+0000 mon.a (mon.0) 1831 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:52.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:51 gibba013 bash[29418]: audit 2021-03-10T15:12:51.131570+0000 mon.a (mon.0) 1824 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:12:52.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:51 gibba013 bash[29418]: audit 2021-03-10T15:12:51.351695+0000 mon.a (mon.0) 1825 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:12:52.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:51 gibba013 bash[29418]: audit 2021-03-10T15:12:51.355007+0000 mon.a (mon.0) 1826 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:12:52.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:51 gibba013 bash[29418]: audit 2021-03-10T15:12:51.356717+0000 mon.a (mon.0) 1827 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:52.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:51 gibba013 bash[29418]: audit 2021-03-10T15:12:51.358360+0000 mon.a (mon.0) 1828 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:52.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:51 gibba013 bash[29418]: audit 2021-03-10T15:12:51.360038+0000 mon.a (mon.0) 1829 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:52.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:51 gibba013 bash[29418]: audit 2021-03-10T15:12:51.363280+0000 mon.a (mon.0) 1830 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:52.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:51 gibba013 bash[29418]: audit 2021-03-10T15:12:51.365149+0000 mon.a (mon.0) 1831 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:52.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:51 gibba013 bash[30381]: audit 2021-03-10T15:12:51.131570+0000 mon.a (mon.0) 1824 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:12:52.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:51 gibba013 bash[30381]: audit 2021-03-10T15:12:51.351695+0000 mon.a (mon.0) 1825 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:12:52.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:51 gibba013 bash[30381]: audit 2021-03-10T15:12:51.355007+0000 mon.a (mon.0) 1826 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:12:52.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:51 gibba013 bash[30381]: audit 2021-03-10T15:12:51.356717+0000 mon.a (mon.0) 1827 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:52.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:51 gibba013 bash[30381]: audit 2021-03-10T15:12:51.358360+0000 mon.a (mon.0) 1828 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:52.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:51 gibba013 bash[30381]: audit 2021-03-10T15:12:51.360038+0000 mon.a (mon.0) 1829 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:52.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:51 gibba013 bash[30381]: audit 2021-03-10T15:12:51.363280+0000 mon.a (mon.0) 1830 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:52.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:51 gibba013 bash[30381]: audit 2021-03-10T15:12:51.365149+0000 mon.a (mon.0) 1831 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:12:53.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:52 gibba020 bash[25448]: cephadm 2021-03-10T15:12:51.135773+0000 mgr.gibba020.yqfnwy (mgr.34427) 4233 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:12:53.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:52 gibba020 bash[25448]: cephadm 2021-03-10T15:12:51.137656+0000 mgr.gibba020.yqfnwy (mgr.34427) 4234 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:12:53.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:52 gibba020 bash[25448]: cephadm 2021-03-10T15:12:51.352909+0000 mgr.gibba020.yqfnwy (mgr.34427) 4235 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:12:53.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:52 gibba020 bash[25448]: cephadm 2021-03-10T15:12:51.355143+0000 mgr.gibba020.yqfnwy (mgr.34427) 4236 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:12:53.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:52 gibba020 bash[25448]: cephadm 2021-03-10T15:12:51.356465+0000 mgr.gibba020.yqfnwy (mgr.34427) 4237 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:12:53.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:52 gibba020 bash[25448]: cephadm 2021-03-10T15:12:51.356500+0000 mgr.gibba020.yqfnwy (mgr.34427) 4238 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:12:53.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:52 gibba020 bash[25448]: cephadm 2021-03-10T15:12:51.358362+0000 mgr.gibba020.yqfnwy (mgr.34427) 4239 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:12:53.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:52 gibba020 bash[25448]: cephadm 2021-03-10T15:12:51.358399+0000 mgr.gibba020.yqfnwy (mgr.34427) 4240 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:12:53.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:52 gibba020 bash[25448]: cephadm 2021-03-10T15:12:51.359819+0000 mgr.gibba020.yqfnwy (mgr.34427) 4241 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:12:53.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:52 gibba020 bash[25448]: cephadm 2021-03-10T15:12:51.361313+0000 mgr.gibba020.yqfnwy (mgr.34427) 4242 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:12:53.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:52 gibba020 bash[25448]: cephadm 2021-03-10T15:12:51.361349+0000 mgr.gibba020.yqfnwy (mgr.34427) 4243 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:12:53.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:52 gibba020 bash[25448]: cephadm 2021-03-10T15:12:51.363180+0000 mgr.gibba020.yqfnwy (mgr.34427) 4244 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:12:53.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:52 gibba020 bash[25448]: cephadm 2021-03-10T15:12:51.363497+0000 mgr.gibba020.yqfnwy (mgr.34427) 4245 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:12:53.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:52 gibba020 bash[25448]: cephadm 2021-03-10T15:12:51.365158+0000 mgr.gibba020.yqfnwy (mgr.34427) 4246 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:12:53.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:52 gibba020 bash[25448]: cephadm 2021-03-10T15:12:51.365195+0000 mgr.gibba020.yqfnwy (mgr.34427) 4247 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:12:53.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:52 gibba020 bash[25448]: cephadm 2021-03-10T15:12:51.365297+0000 mgr.gibba020.yqfnwy (mgr.34427) 4248 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:12:53.206 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:52 gibba020 bash[25448]: cluster 2021-03-10T15:12:51.849701+0000 mgr.gibba020.yqfnwy (mgr.34427) 4249 : cluster [DBG] pgmap v2406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:53.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:52 gibba013 bash[29418]: cephadm 2021-03-10T15:12:51.135773+0000 mgr.gibba020.yqfnwy (mgr.34427) 4233 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:12:53.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:52 gibba013 bash[29418]: cephadm 2021-03-10T15:12:51.137656+0000 mgr.gibba020.yqfnwy (mgr.34427) 4234 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:12:53.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:52 gibba013 bash[29418]: cephadm 2021-03-10T15:12:51.352909+0000 mgr.gibba020.yqfnwy (mgr.34427) 4235 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:12:53.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:52 gibba013 bash[29418]: cephadm 2021-03-10T15:12:51.355143+0000 mgr.gibba020.yqfnwy (mgr.34427) 4236 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:12:53.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:52 gibba013 bash[29418]: cephadm 2021-03-10T15:12:51.356465+0000 mgr.gibba020.yqfnwy (mgr.34427) 4237 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:12:53.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:52 gibba013 bash[29418]: cephadm 2021-03-10T15:12:51.356500+0000 mgr.gibba020.yqfnwy (mgr.34427) 4238 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:12:53.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:52 gibba013 bash[29418]: cephadm 2021-03-10T15:12:51.358362+0000 mgr.gibba020.yqfnwy (mgr.34427) 4239 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:12:53.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:52 gibba013 bash[29418]: cephadm 2021-03-10T15:12:51.358399+0000 mgr.gibba020.yqfnwy (mgr.34427) 4240 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:12:53.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:52 gibba013 bash[29418]: cephadm 2021-03-10T15:12:51.359819+0000 mgr.gibba020.yqfnwy (mgr.34427) 4241 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:12:53.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:52 gibba013 bash[29418]: cephadm 2021-03-10T15:12:51.361313+0000 mgr.gibba020.yqfnwy (mgr.34427) 4242 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:12:53.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:52 gibba013 bash[29418]: cephadm 2021-03-10T15:12:51.361349+0000 mgr.gibba020.yqfnwy (mgr.34427) 4243 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:12:53.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:52 gibba013 bash[29418]: cephadm 2021-03-10T15:12:51.363180+0000 mgr.gibba020.yqfnwy (mgr.34427) 4244 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:12:53.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:52 gibba013 bash[29418]: cephadm 2021-03-10T15:12:51.363497+0000 mgr.gibba020.yqfnwy (mgr.34427) 4245 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:12:53.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:52 gibba013 bash[29418]: cephadm 2021-03-10T15:12:51.365158+0000 mgr.gibba020.yqfnwy (mgr.34427) 4246 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:12:53.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:52 gibba013 bash[29418]: cephadm 2021-03-10T15:12:51.365195+0000 mgr.gibba020.yqfnwy (mgr.34427) 4247 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:12:53.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:52 gibba013 bash[29418]: cephadm 2021-03-10T15:12:51.365297+0000 mgr.gibba020.yqfnwy (mgr.34427) 4248 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:12:53.387 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:52 gibba013 bash[29418]: cluster 2021-03-10T15:12:51.849701+0000 mgr.gibba020.yqfnwy (mgr.34427) 4249 : cluster [DBG] pgmap v2406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:53.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:52 gibba013 bash[30381]: cephadm 2021-03-10T15:12:51.135773+0000 mgr.gibba020.yqfnwy (mgr.34427) 4233 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:12:53.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:52 gibba013 bash[30381]: cephadm 2021-03-10T15:12:51.137656+0000 mgr.gibba020.yqfnwy (mgr.34427) 4234 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:12:53.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:52 gibba013 bash[30381]: cephadm 2021-03-10T15:12:51.352909+0000 mgr.gibba020.yqfnwy (mgr.34427) 4235 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:12:53.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:52 gibba013 bash[30381]: cephadm 2021-03-10T15:12:51.355143+0000 mgr.gibba020.yqfnwy (mgr.34427) 4236 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:12:53.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:52 gibba013 bash[30381]: cephadm 2021-03-10T15:12:51.356465+0000 mgr.gibba020.yqfnwy (mgr.34427) 4237 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:12:53.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:52 gibba013 bash[30381]: cephadm 2021-03-10T15:12:51.356500+0000 mgr.gibba020.yqfnwy (mgr.34427) 4238 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:12:53.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:52 gibba013 bash[30381]: cephadm 2021-03-10T15:12:51.358362+0000 mgr.gibba020.yqfnwy (mgr.34427) 4239 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:12:53.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:52 gibba013 bash[30381]: cephadm 2021-03-10T15:12:51.358399+0000 mgr.gibba020.yqfnwy (mgr.34427) 4240 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:12:53.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:52 gibba013 bash[30381]: cephadm 2021-03-10T15:12:51.359819+0000 mgr.gibba020.yqfnwy (mgr.34427) 4241 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:12:53.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:52 gibba013 bash[30381]: cephadm 2021-03-10T15:12:51.361313+0000 mgr.gibba020.yqfnwy (mgr.34427) 4242 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:12:53.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:52 gibba013 bash[30381]: cephadm 2021-03-10T15:12:51.361349+0000 mgr.gibba020.yqfnwy (mgr.34427) 4243 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:12:53.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:52 gibba013 bash[30381]: cephadm 2021-03-10T15:12:51.363180+0000 mgr.gibba020.yqfnwy (mgr.34427) 4244 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:12:53.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:52 gibba013 bash[30381]: cephadm 2021-03-10T15:12:51.363497+0000 mgr.gibba020.yqfnwy (mgr.34427) 4245 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:12:53.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:52 gibba013 bash[30381]: cephadm 2021-03-10T15:12:51.365158+0000 mgr.gibba020.yqfnwy (mgr.34427) 4246 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:12:53.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:52 gibba013 bash[30381]: cephadm 2021-03-10T15:12:51.365195+0000 mgr.gibba020.yqfnwy (mgr.34427) 4247 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:12:53.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:52 gibba013 bash[30381]: cephadm 2021-03-10T15:12:51.365297+0000 mgr.gibba020.yqfnwy (mgr.34427) 4248 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:12:53.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:52 gibba013 bash[30381]: cluster 2021-03-10T15:12:51.849701+0000 mgr.gibba020.yqfnwy (mgr.34427) 4249 : cluster [DBG] pgmap v2406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:55.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:54 gibba020 bash[25448]: cluster 2021-03-10T15:12:53.851394+0000 mgr.gibba020.yqfnwy (mgr.34427) 4250 : cluster [DBG] pgmap v2407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:55.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:54 gibba013 bash[29418]: cluster 2021-03-10T15:12:53.851394+0000 mgr.gibba020.yqfnwy (mgr.34427) 4250 : cluster [DBG] pgmap v2407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:55.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:54 gibba013 bash[30381]: cluster 2021-03-10T15:12:53.851394+0000 mgr.gibba020.yqfnwy (mgr.34427) 4250 : cluster [DBG] pgmap v2407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:56.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:55 gibba013 bash[29418]: cluster 2021-03-10T15:12:55.853149+0000 mgr.gibba020.yqfnwy (mgr.34427) 4251 : cluster [DBG] pgmap v2408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:56.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:55 gibba013 bash[30381]: cluster 2021-03-10T15:12:55.853149+0000 mgr.gibba020.yqfnwy (mgr.34427) 4251 : cluster [DBG] pgmap v2408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:56.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:55 gibba020 bash[25448]: cluster 2021-03-10T15:12:55.853149+0000 mgr.gibba020.yqfnwy (mgr.34427) 4251 : cluster [DBG] pgmap v2408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:58.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:12:57 gibba013 bash[29418]: cluster 2021-03-10T15:12:57.854486+0000 mgr.gibba020.yqfnwy (mgr.34427) 4252 : cluster [DBG] pgmap v2409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:58.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:12:57 gibba013 bash[30381]: cluster 2021-03-10T15:12:57.854486+0000 mgr.gibba020.yqfnwy (mgr.34427) 4252 : cluster [DBG] pgmap v2409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:12:58.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:12:57 gibba020 bash[25448]: cluster 2021-03-10T15:12:57.854486+0000 mgr.gibba020.yqfnwy (mgr.34427) 4252 : cluster [DBG] pgmap v2409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:01.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:00 gibba020 bash[25448]: cluster 2021-03-10T15:12:59.856303+0000 mgr.gibba020.yqfnwy (mgr.34427) 4253 : cluster [DBG] pgmap v2410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:01.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:00 gibba013 bash[29418]: cluster 2021-03-10T15:12:59.856303+0000 mgr.gibba020.yqfnwy (mgr.34427) 4253 : cluster [DBG] pgmap v2410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:01.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:00 gibba013 bash[30381]: cluster 2021-03-10T15:12:59.856303+0000 mgr.gibba020.yqfnwy (mgr.34427) 4253 : cluster [DBG] pgmap v2410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:03.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:02 gibba020 bash[25448]: cluster 2021-03-10T15:13:01.857767+0000 mgr.gibba020.yqfnwy (mgr.34427) 4254 : cluster [DBG] pgmap v2411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:03.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:02 gibba013 bash[29418]: cluster 2021-03-10T15:13:01.857767+0000 mgr.gibba020.yqfnwy (mgr.34427) 4254 : cluster [DBG] pgmap v2411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:03.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:02 gibba013 bash[30381]: cluster 2021-03-10T15:13:01.857767+0000 mgr.gibba020.yqfnwy (mgr.34427) 4254 : cluster [DBG] pgmap v2411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:05.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:04 gibba020 bash[25448]: cluster 2021-03-10T15:13:03.859313+0000 mgr.gibba020.yqfnwy (mgr.34427) 4255 : cluster [DBG] pgmap v2412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:05.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:04 gibba013 bash[29418]: cluster 2021-03-10T15:13:03.859313+0000 mgr.gibba020.yqfnwy (mgr.34427) 4255 : cluster [DBG] pgmap v2412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:05.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:04 gibba013 bash[30381]: cluster 2021-03-10T15:13:03.859313+0000 mgr.gibba020.yqfnwy (mgr.34427) 4255 : cluster [DBG] pgmap v2412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:06.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:05 gibba013 bash[29418]: cluster 2021-03-10T15:13:05.861357+0000 mgr.gibba020.yqfnwy (mgr.34427) 4256 : cluster [DBG] pgmap v2413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:06.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:05 gibba013 bash[30381]: cluster 2021-03-10T15:13:05.861357+0000 mgr.gibba020.yqfnwy (mgr.34427) 4256 : cluster [DBG] pgmap v2413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:06.385 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:05 gibba020 bash[25448]: cluster 2021-03-10T15:13:05.861357+0000 mgr.gibba020.yqfnwy (mgr.34427) 4256 : cluster [DBG] pgmap v2413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:07.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:06 gibba013 bash[29418]: audit 2021-03-10T15:13:06.375784+0000 mon.a (mon.0) 1832 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:13:07.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:06 gibba013 bash[29418]: cephadm 2021-03-10T15:13:06.380701+0000 mgr.gibba020.yqfnwy (mgr.34427) 4257 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:13:07.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:06 gibba013 bash[29418]: audit 2021-03-10T15:13:06.417042+0000 mon.a (mon.0) 1833 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:13:07.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:06 gibba013 bash[29418]: audit 2021-03-10T15:13:06.496476+0000 mon.a (mon.0) 1834 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:13:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:06 gibba013 bash[29418]: audit 2021-03-10T15:13:06.497269+0000 mon.a (mon.0) 1835 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:13:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:06 gibba013 bash[29418]: audit 2021-03-10T15:13:06.497947+0000 mon.a (mon.0) 1836 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:13:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:06 gibba013 bash[29418]: audit 2021-03-10T15:13:06.498684+0000 mon.a (mon.0) 1837 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:13:07.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:06 gibba013 bash[30381]: audit 2021-03-10T15:13:06.375784+0000 mon.a (mon.0) 1832 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:13:07.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:06 gibba013 bash[30381]: cephadm 2021-03-10T15:13:06.380701+0000 mgr.gibba020.yqfnwy (mgr.34427) 4257 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:13:07.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:06 gibba013 bash[30381]: audit 2021-03-10T15:13:06.417042+0000 mon.a (mon.0) 1833 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:13:07.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:06 gibba013 bash[30381]: audit 2021-03-10T15:13:06.496476+0000 mon.a (mon.0) 1834 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:13:07.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:06 gibba013 bash[30381]: audit 2021-03-10T15:13:06.497269+0000 mon.a (mon.0) 1835 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:13:07.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:06 gibba013 bash[30381]: audit 2021-03-10T15:13:06.497947+0000 mon.a (mon.0) 1836 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:13:07.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:06 gibba013 bash[30381]: audit 2021-03-10T15:13:06.498684+0000 mon.a (mon.0) 1837 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:13:07.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:06 gibba020 bash[25448]: audit 2021-03-10T15:13:06.375784+0000 mon.a (mon.0) 1832 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:13:07.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:06 gibba020 bash[25448]: cephadm 2021-03-10T15:13:06.380701+0000 mgr.gibba020.yqfnwy (mgr.34427) 4257 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:13:07.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:06 gibba020 bash[25448]: audit 2021-03-10T15:13:06.417042+0000 mon.a (mon.0) 1833 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:13:07.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:06 gibba020 bash[25448]: audit 2021-03-10T15:13:06.496476+0000 mon.a (mon.0) 1834 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:13:07.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:06 gibba020 bash[25448]: audit 2021-03-10T15:13:06.497269+0000 mon.a (mon.0) 1835 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:13:07.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:06 gibba020 bash[25448]: audit 2021-03-10T15:13:06.497947+0000 mon.a (mon.0) 1836 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:13:07.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:06 gibba020 bash[25448]: audit 2021-03-10T15:13:06.498684+0000 mon.a (mon.0) 1837 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:13:08.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:07 gibba013 bash[29418]: cluster 2021-03-10T15:13:07.862632+0000 mgr.gibba020.yqfnwy (mgr.34427) 4258 : cluster [DBG] pgmap v2414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:08.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:07 gibba013 bash[30381]: cluster 2021-03-10T15:13:07.862632+0000 mgr.gibba020.yqfnwy (mgr.34427) 4258 : cluster [DBG] pgmap v2414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:08.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:07 gibba020 bash[25448]: cluster 2021-03-10T15:13:07.862632+0000 mgr.gibba020.yqfnwy (mgr.34427) 4258 : cluster [DBG] pgmap v2414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:11.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:10 gibba020 bash[25448]: cluster 2021-03-10T15:13:09.864280+0000 mgr.gibba020.yqfnwy (mgr.34427) 4259 : cluster [DBG] pgmap v2415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:11.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:10 gibba013 bash[29418]: cluster 2021-03-10T15:13:09.864280+0000 mgr.gibba020.yqfnwy (mgr.34427) 4259 : cluster [DBG] pgmap v2415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:11.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:10 gibba013 bash[30381]: cluster 2021-03-10T15:13:09.864280+0000 mgr.gibba020.yqfnwy (mgr.34427) 4259 : cluster [DBG] pgmap v2415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:13.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:12 gibba020 bash[25448]: cluster 2021-03-10T15:13:11.865648+0000 mgr.gibba020.yqfnwy (mgr.34427) 4260 : cluster [DBG] pgmap v2416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:13.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:12 gibba013 bash[29418]: cluster 2021-03-10T15:13:11.865648+0000 mgr.gibba020.yqfnwy (mgr.34427) 4260 : cluster [DBG] pgmap v2416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:13.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:12 gibba013 bash[30381]: cluster 2021-03-10T15:13:11.865648+0000 mgr.gibba020.yqfnwy (mgr.34427) 4260 : cluster [DBG] pgmap v2416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:14.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:13 gibba013 bash[29418]: cluster 2021-03-10T15:13:13.867164+0000 mgr.gibba020.yqfnwy (mgr.34427) 4261 : cluster [DBG] pgmap v2417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:14.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:13 gibba013 bash[30381]: cluster 2021-03-10T15:13:13.867164+0000 mgr.gibba020.yqfnwy (mgr.34427) 4261 : cluster [DBG] pgmap v2417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:14.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:13 gibba020 bash[25448]: cluster 2021-03-10T15:13:13.867164+0000 mgr.gibba020.yqfnwy (mgr.34427) 4261 : cluster [DBG] pgmap v2417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:14.532 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:13:14.760 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:13:14.760 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (79m) 4m ago 85m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:13:14.760 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (84m) 3m ago 84m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:13:14.761 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (80m) 3m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:13:14.761 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (80m) 3m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:13:14.761 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (79m) 4m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:13:14.761 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (79m) 4m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:13:14.762 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (78m) 3m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:13:14.762 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (78m) 4m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:13:14.762 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (85m) 4m ago 85m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:13:14.762 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (85m) 3m ago 85m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:13:14.763 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (78m) 4m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:13:14.763 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (77m) 4m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:13:14.763 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (77m) 4m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:13:14.763 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (76m) 4m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:13:14.763 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (76m) 3m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:13:14.764 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (75m) 3m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:13:14.764 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (75m) 3m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:13:14.764 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (75m) 3m ago 85m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:13:14.764 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (84m) 3m ago 85m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:13:14.765 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 3m ago 83m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:13:15.013 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:13:15.013 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:13:15.013 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:13:15.014 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:13:15.014 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:13:15.014 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:13:15.014 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:13:15.015 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:13:15.015 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:13:15.015 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:13:15.015 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:13:15.015 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:13:15.016 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:13:15.016 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:13:15.016 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:13:15.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:14 gibba013 bash[29418]: audit 2021-03-10T15:13:14.518403+0000 mgr.gibba020.yqfnwy (mgr.34427) 4262 : audit [DBG] from='client.56899 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:13:15.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:14 gibba013 bash[29418]: audit 2021-03-10T15:13:14.743226+0000 mgr.gibba020.yqfnwy (mgr.34427) 4263 : audit [DBG] from='client.46920 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:13:15.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:14 gibba013 bash[30381]: audit 2021-03-10T15:13:14.518403+0000 mgr.gibba020.yqfnwy (mgr.34427) 4262 : audit [DBG] from='client.56899 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:13:15.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:14 gibba013 bash[30381]: audit 2021-03-10T15:13:14.743226+0000 mgr.gibba020.yqfnwy (mgr.34427) 4263 : audit [DBG] from='client.46920 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:13:15.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:14 gibba020 bash[25448]: audit 2021-03-10T15:13:14.518403+0000 mgr.gibba020.yqfnwy (mgr.34427) 4262 : audit [DBG] from='client.56899 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:13:15.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:14 gibba020 bash[25448]: audit 2021-03-10T15:13:14.743226+0000 mgr.gibba020.yqfnwy (mgr.34427) 4263 : audit [DBG] from='client.46920 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:13:16.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:15 gibba013 bash[29418]: audit 2021-03-10T15:13:15.009732+0000 mon.a (mon.0) 1838 : audit [DBG] from='client.? 172.21.2.113:0/480981048' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:16.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:15 gibba013 bash[29418]: cluster 2021-03-10T15:13:15.868937+0000 mgr.gibba020.yqfnwy (mgr.34427) 4264 : cluster [DBG] pgmap v2418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:16.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:16 gibba013 bash[30381]: audit 2021-03-10T15:13:15.009732+0000 mon.a (mon.0) 1838 : audit [DBG] from='client.? 172.21.2.113:0/480981048' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:16.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:16 gibba013 bash[30381]: cluster 2021-03-10T15:13:15.868937+0000 mgr.gibba020.yqfnwy (mgr.34427) 4264 : cluster [DBG] pgmap v2418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:16.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:16 gibba020 bash[25448]: audit 2021-03-10T15:13:15.009732+0000 mon.a (mon.0) 1838 : audit [DBG] from='client.? 172.21.2.113:0/480981048' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:16.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:16 gibba020 bash[25448]: cluster 2021-03-10T15:13:15.868937+0000 mgr.gibba020.yqfnwy (mgr.34427) 4264 : cluster [DBG] pgmap v2418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:18.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:17 gibba013 bash[29418]: cluster 2021-03-10T15:13:17.870282+0000 mgr.gibba020.yqfnwy (mgr.34427) 4265 : cluster [DBG] pgmap v2419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:18.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:17 gibba013 bash[30381]: cluster 2021-03-10T15:13:17.870282+0000 mgr.gibba020.yqfnwy (mgr.34427) 4265 : cluster [DBG] pgmap v2419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:18.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:17 gibba020 bash[25448]: cluster 2021-03-10T15:13:17.870282+0000 mgr.gibba020.yqfnwy (mgr.34427) 4265 : cluster [DBG] pgmap v2419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:21.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:20 gibba020 bash[25448]: cluster 2021-03-10T15:13:19.872031+0000 mgr.gibba020.yqfnwy (mgr.34427) 4266 : cluster [DBG] pgmap v2420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:21.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:20 gibba013 bash[29418]: cluster 2021-03-10T15:13:19.872031+0000 mgr.gibba020.yqfnwy (mgr.34427) 4266 : cluster [DBG] pgmap v2420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:21.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:20 gibba013 bash[30381]: cluster 2021-03-10T15:13:19.872031+0000 mgr.gibba020.yqfnwy (mgr.34427) 4266 : cluster [DBG] pgmap v2420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:23.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:22 gibba020 bash[25448]: cephadm 2021-03-10T15:13:21.393115+0000 mgr.gibba020.yqfnwy (mgr.34427) 4267 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:13:23.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:22 gibba020 bash[25448]: cluster 2021-03-10T15:13:21.873337+0000 mgr.gibba020.yqfnwy (mgr.34427) 4268 : cluster [DBG] pgmap v2421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:23.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:22 gibba013 bash[29418]: cephadm 2021-03-10T15:13:21.393115+0000 mgr.gibba020.yqfnwy (mgr.34427) 4267 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:13:23.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:22 gibba013 bash[29418]: cluster 2021-03-10T15:13:21.873337+0000 mgr.gibba020.yqfnwy (mgr.34427) 4268 : cluster [DBG] pgmap v2421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:23.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:22 gibba013 bash[30381]: cephadm 2021-03-10T15:13:21.393115+0000 mgr.gibba020.yqfnwy (mgr.34427) 4267 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:13:23.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:22 gibba013 bash[30381]: cluster 2021-03-10T15:13:21.873337+0000 mgr.gibba020.yqfnwy (mgr.34427) 4268 : cluster [DBG] pgmap v2421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:24.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:23 gibba013 bash[29418]: cluster 2021-03-10T15:13:23.874834+0000 mgr.gibba020.yqfnwy (mgr.34427) 4269 : cluster [DBG] pgmap v2422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:24.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:23 gibba013 bash[30381]: cluster 2021-03-10T15:13:23.874834+0000 mgr.gibba020.yqfnwy (mgr.34427) 4269 : cluster [DBG] pgmap v2422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:24.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:23 gibba020 bash[25448]: cluster 2021-03-10T15:13:23.874834+0000 mgr.gibba020.yqfnwy (mgr.34427) 4269 : cluster [DBG] pgmap v2422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:27.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:26 gibba020 bash[25448]: cluster 2021-03-10T15:13:25.876714+0000 mgr.gibba020.yqfnwy (mgr.34427) 4270 : cluster [DBG] pgmap v2423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:27.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:26 gibba013 bash[29418]: cluster 2021-03-10T15:13:25.876714+0000 mgr.gibba020.yqfnwy (mgr.34427) 4270 : cluster [DBG] pgmap v2423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:27.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:26 gibba013 bash[30381]: cluster 2021-03-10T15:13:25.876714+0000 mgr.gibba020.yqfnwy (mgr.34427) 4270 : cluster [DBG] pgmap v2423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:28.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:27 gibba013 bash[29418]: cluster 2021-03-10T15:13:27.877782+0000 mgr.gibba020.yqfnwy (mgr.34427) 4271 : cluster [DBG] pgmap v2424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:28.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:27 gibba013 bash[30381]: cluster 2021-03-10T15:13:27.877782+0000 mgr.gibba020.yqfnwy (mgr.34427) 4271 : cluster [DBG] pgmap v2424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:28.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:27 gibba020 bash[25448]: cluster 2021-03-10T15:13:27.877782+0000 mgr.gibba020.yqfnwy (mgr.34427) 4271 : cluster [DBG] pgmap v2424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:31.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:30 gibba020 bash[25448]: cluster 2021-03-10T15:13:29.879403+0000 mgr.gibba020.yqfnwy (mgr.34427) 4272 : cluster [DBG] pgmap v2425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:31.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:30 gibba013 bash[29418]: cluster 2021-03-10T15:13:29.879403+0000 mgr.gibba020.yqfnwy (mgr.34427) 4272 : cluster [DBG] pgmap v2425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:31.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:30 gibba013 bash[30381]: cluster 2021-03-10T15:13:29.879403+0000 mgr.gibba020.yqfnwy (mgr.34427) 4272 : cluster [DBG] pgmap v2425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:32.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:31 gibba013 bash[29418]: cluster 2021-03-10T15:13:31.880790+0000 mgr.gibba020.yqfnwy (mgr.34427) 4273 : cluster [DBG] pgmap v2426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:32.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:31 gibba013 bash[30381]: cluster 2021-03-10T15:13:31.880790+0000 mgr.gibba020.yqfnwy (mgr.34427) 4273 : cluster [DBG] pgmap v2426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:32.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:31 gibba020 bash[25448]: cluster 2021-03-10T15:13:31.880790+0000 mgr.gibba020.yqfnwy (mgr.34427) 4273 : cluster [DBG] pgmap v2426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:35.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:34 gibba013 bash[29418]: cluster 2021-03-10T15:13:33.882289+0000 mgr.gibba020.yqfnwy (mgr.34427) 4274 : cluster [DBG] pgmap v2427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:35.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:34 gibba013 bash[30381]: cluster 2021-03-10T15:13:33.882289+0000 mgr.gibba020.yqfnwy (mgr.34427) 4274 : cluster [DBG] pgmap v2427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:35.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:34 gibba020 bash[25448]: cluster 2021-03-10T15:13:33.882289+0000 mgr.gibba020.yqfnwy (mgr.34427) 4274 : cluster [DBG] pgmap v2427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:36.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:35 gibba013 bash[29418]: cluster 2021-03-10T15:13:35.884243+0000 mgr.gibba020.yqfnwy (mgr.34427) 4275 : cluster [DBG] pgmap v2428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:36.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:35 gibba013 bash[30381]: cluster 2021-03-10T15:13:35.884243+0000 mgr.gibba020.yqfnwy (mgr.34427) 4275 : cluster [DBG] pgmap v2428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:36.407 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:35 gibba020 bash[25448]: cluster 2021-03-10T15:13:35.884243+0000 mgr.gibba020.yqfnwy (mgr.34427) 4275 : cluster [DBG] pgmap v2428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:37.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:36 gibba013 bash[29418]: cephadm 2021-03-10T15:13:36.402755+0000 mgr.gibba020.yqfnwy (mgr.34427) 4276 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:13:37.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:36 gibba013 bash[30381]: cephadm 2021-03-10T15:13:36.402755+0000 mgr.gibba020.yqfnwy (mgr.34427) 4276 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:13:37.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:36 gibba020 bash[25448]: cephadm 2021-03-10T15:13:36.402755+0000 mgr.gibba020.yqfnwy (mgr.34427) 4276 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:13:38.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:37 gibba013 bash[29418]: cluster 2021-03-10T15:13:37.885607+0000 mgr.gibba020.yqfnwy (mgr.34427) 4277 : cluster [DBG] pgmap v2429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:38.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:37 gibba013 bash[30381]: cluster 2021-03-10T15:13:37.885607+0000 mgr.gibba020.yqfnwy (mgr.34427) 4277 : cluster [DBG] pgmap v2429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:38.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:37 gibba020 bash[25448]: cluster 2021-03-10T15:13:37.885607+0000 mgr.gibba020.yqfnwy (mgr.34427) 4277 : cluster [DBG] pgmap v2429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:41.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:40 gibba013 bash[29418]: cluster 2021-03-10T15:13:39.887269+0000 mgr.gibba020.yqfnwy (mgr.34427) 4278 : cluster [DBG] pgmap v2430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:41.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:40 gibba013 bash[30381]: cluster 2021-03-10T15:13:39.887269+0000 mgr.gibba020.yqfnwy (mgr.34427) 4278 : cluster [DBG] pgmap v2430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:41.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:40 gibba020 bash[25448]: cluster 2021-03-10T15:13:39.887269+0000 mgr.gibba020.yqfnwy (mgr.34427) 4278 : cluster [DBG] pgmap v2430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:42.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:41 gibba013 bash[29418]: cluster 2021-03-10T15:13:41.888613+0000 mgr.gibba020.yqfnwy (mgr.34427) 4279 : cluster [DBG] pgmap v2431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:42.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:41 gibba013 bash[30381]: cluster 2021-03-10T15:13:41.888613+0000 mgr.gibba020.yqfnwy (mgr.34427) 4279 : cluster [DBG] pgmap v2431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:42.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:41 gibba020 bash[25448]: cluster 2021-03-10T15:13:41.888613+0000 mgr.gibba020.yqfnwy (mgr.34427) 4279 : cluster [DBG] pgmap v2431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:45.256 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:13:45.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:44 gibba013 bash[30381]: cluster 2021-03-10T15:13:43.889926+0000 mgr.gibba020.yqfnwy (mgr.34427) 4280 : cluster [DBG] pgmap v2432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:45.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:44 gibba013 bash[29418]: cluster 2021-03-10T15:13:43.889926+0000 mgr.gibba020.yqfnwy (mgr.34427) 4280 : cluster [DBG] pgmap v2432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:45.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:44 gibba020 bash[25448]: cluster 2021-03-10T15:13:43.889926+0000 mgr.gibba020.yqfnwy (mgr.34427) 4280 : cluster [DBG] pgmap v2432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:45.484 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:13:45.484 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (80m) 4m ago 85m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:13:45.484 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (85m) 3m ago 85m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:13:45.484 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (80m) 3m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:13:45.485 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (80m) 3m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:13:45.485 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (79m) 4m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:13:45.485 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (79m) 4m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:13:45.485 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (79m) 3m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:13:45.486 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (79m) 4m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:13:45.486 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (85m) 4m ago 85m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:13:45.486 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (85m) 3m ago 85m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:13:45.487 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (78m) 4m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:13:45.487 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (78m) 4m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:13:45.487 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (77m) 4m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:13:45.487 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (77m) 4m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:13:45.487 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (76m) 3m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:13:45.488 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (76m) 3m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:13:45.488 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (75m) 3m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:13:45.488 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (75m) 3m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:13:45.488 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (85m) 3m ago 85m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:13:45.489 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 3m ago 83m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:13:45.734 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:13:45.735 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:13:45.735 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:13:45.735 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:13:45.736 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:13:45.736 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:13:45.736 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:13:45.736 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:13:45.737 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:13:45.737 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:13:45.737 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:13:45.737 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:13:45.738 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:13:45.738 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:13:45.738 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:13:46.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:45 gibba013 bash[29418]: audit 2021-03-10T15:13:45.242309+0000 mgr.gibba020.yqfnwy (mgr.34427) 4281 : audit [DBG] from='client.46932 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:13:46.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:45 gibba013 bash[29418]: audit 2021-03-10T15:13:45.466475+0000 mgr.gibba020.yqfnwy (mgr.34427) 4282 : audit [DBG] from='client.46938 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:13:46.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:45 gibba013 bash[29418]: audit 2021-03-10T15:13:45.731134+0000 mon.c (mon.1) 75 : audit [DBG] from='client.? 172.21.2.113:0/2238940671' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:46.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:45 gibba013 bash[29418]: cluster 2021-03-10T15:13:45.891788+0000 mgr.gibba020.yqfnwy (mgr.34427) 4283 : cluster [DBG] pgmap v2433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:46.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:45 gibba013 bash[30381]: audit 2021-03-10T15:13:45.242309+0000 mgr.gibba020.yqfnwy (mgr.34427) 4281 : audit [DBG] from='client.46932 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:13:46.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:45 gibba013 bash[30381]: audit 2021-03-10T15:13:45.466475+0000 mgr.gibba020.yqfnwy (mgr.34427) 4282 : audit [DBG] from='client.46938 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:13:46.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:45 gibba013 bash[30381]: audit 2021-03-10T15:13:45.731134+0000 mon.c (mon.1) 75 : audit [DBG] from='client.? 172.21.2.113:0/2238940671' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:46.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:45 gibba013 bash[30381]: cluster 2021-03-10T15:13:45.891788+0000 mgr.gibba020.yqfnwy (mgr.34427) 4283 : cluster [DBG] pgmap v2433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:46.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:45 gibba020 bash[25448]: audit 2021-03-10T15:13:45.242309+0000 mgr.gibba020.yqfnwy (mgr.34427) 4281 : audit [DBG] from='client.46932 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:13:46.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:45 gibba020 bash[25448]: audit 2021-03-10T15:13:45.466475+0000 mgr.gibba020.yqfnwy (mgr.34427) 4282 : audit [DBG] from='client.46938 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:13:46.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:45 gibba020 bash[25448]: audit 2021-03-10T15:13:45.731134+0000 mon.c (mon.1) 75 : audit [DBG] from='client.? 172.21.2.113:0/2238940671' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:46.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:45 gibba020 bash[25448]: cluster 2021-03-10T15:13:45.891788+0000 mgr.gibba020.yqfnwy (mgr.34427) 4283 : cluster [DBG] pgmap v2433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:48.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:47 gibba013 bash[29418]: cluster 2021-03-10T15:13:47.892973+0000 mgr.gibba020.yqfnwy (mgr.34427) 4284 : cluster [DBG] pgmap v2434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:48.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:47 gibba013 bash[30381]: cluster 2021-03-10T15:13:47.892973+0000 mgr.gibba020.yqfnwy (mgr.34427) 4284 : cluster [DBG] pgmap v2434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:48.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:47 gibba020 bash[25448]: cluster 2021-03-10T15:13:47.892973+0000 mgr.gibba020.yqfnwy (mgr.34427) 4284 : cluster [DBG] pgmap v2434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:50.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:50 gibba013 bash[29418]: cluster 2021-03-10T15:13:49.894791+0000 mgr.gibba020.yqfnwy (mgr.34427) 4285 : cluster [DBG] pgmap v2435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:50.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:50 gibba013 bash[30381]: cluster 2021-03-10T15:13:49.894791+0000 mgr.gibba020.yqfnwy (mgr.34427) 4285 : cluster [DBG] pgmap v2435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:50.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:50 gibba020 bash[25448]: cluster 2021-03-10T15:13:49.894791+0000 mgr.gibba020.yqfnwy (mgr.34427) 4285 : cluster [DBG] pgmap v2435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:51.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:51 gibba013 bash[29418]: audit 2021-03-10T15:13:51.420802+0000 mon.a (mon.0) 1839 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:13:51.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:51 gibba013 bash[30381]: audit 2021-03-10T15:13:51.420802+0000 mon.a (mon.0) 1839 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:13:51.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:51 gibba020 bash[25448]: audit 2021-03-10T15:13:51.420802+0000 mon.a (mon.0) 1839 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:13:52.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:52 gibba020 bash[25448]: cephadm 2021-03-10T15:13:51.424902+0000 mgr.gibba020.yqfnwy (mgr.34427) 4286 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:13:52.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:52 gibba020 bash[25448]: cephadm 2021-03-10T15:13:51.426784+0000 mgr.gibba020.yqfnwy (mgr.34427) 4287 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:13:52.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:52 gibba020 bash[25448]: audit 2021-03-10T15:13:51.647141+0000 mon.a (mon.0) 1840 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:13:52.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:52 gibba020 bash[25448]: cephadm 2021-03-10T15:13:51.648652+0000 mgr.gibba020.yqfnwy (mgr.34427) 4288 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:13:52.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:52 gibba020 bash[25448]: cephadm 2021-03-10T15:13:51.650225+0000 mgr.gibba020.yqfnwy (mgr.34427) 4289 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:13:52.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:52 gibba020 bash[25448]: audit 2021-03-10T15:13:51.650521+0000 mon.a (mon.0) 1841 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:13:52.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:52 gibba020 bash[25448]: cephadm 2021-03-10T15:13:51.651389+0000 mgr.gibba020.yqfnwy (mgr.34427) 4290 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:13:52.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:52 gibba020 bash[25448]: cephadm 2021-03-10T15:13:51.651431+0000 mgr.gibba020.yqfnwy (mgr.34427) 4291 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:13:52.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:52 gibba020 bash[25448]: audit 2021-03-10T15:13:51.651756+0000 mon.a (mon.0) 1842 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:52.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:52 gibba020 bash[25448]: cephadm 2021-03-10T15:13:51.652869+0000 mgr.gibba020.yqfnwy (mgr.34427) 4292 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:13:52.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:52 gibba020 bash[25448]: cephadm 2021-03-10T15:13:51.652912+0000 mgr.gibba020.yqfnwy (mgr.34427) 4293 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:13:52.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:52 gibba020 bash[25448]: audit 2021-03-10T15:13:51.652947+0000 mon.a (mon.0) 1843 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:52.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:52 gibba020 bash[25448]: cephadm 2021-03-10T15:13:51.653877+0000 mgr.gibba020.yqfnwy (mgr.34427) 4294 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:13:52.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:52 gibba020 bash[25448]: audit 2021-03-10T15:13:51.654300+0000 mon.a (mon.0) 1844 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:52.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:52 gibba020 bash[25448]: cephadm 2021-03-10T15:13:51.654695+0000 mgr.gibba020.yqfnwy (mgr.34427) 4295 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:13:52.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:52 gibba020 bash[25448]: cephadm 2021-03-10T15:13:51.654736+0000 mgr.gibba020.yqfnwy (mgr.34427) 4296 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:13:52.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:52 gibba020 bash[25448]: cephadm 2021-03-10T15:13:51.655818+0000 mgr.gibba020.yqfnwy (mgr.34427) 4297 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:13:52.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:52 gibba020 bash[25448]: cephadm 2021-03-10T15:13:51.656203+0000 mgr.gibba020.yqfnwy (mgr.34427) 4298 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:13:52.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:52 gibba020 bash[25448]: audit 2021-03-10T15:13:51.656279+0000 mon.a (mon.0) 1845 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:52.957 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:52 gibba020 bash[25448]: cephadm 2021-03-10T15:13:51.657204+0000 mgr.gibba020.yqfnwy (mgr.34427) 4299 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:13:52.957 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:52 gibba020 bash[25448]: cephadm 2021-03-10T15:13:51.657246+0000 mgr.gibba020.yqfnwy (mgr.34427) 4300 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:13:52.957 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:52 gibba020 bash[25448]: cephadm 2021-03-10T15:13:51.657362+0000 mgr.gibba020.yqfnwy (mgr.34427) 4301 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:13:52.957 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:52 gibba020 bash[25448]: audit 2021-03-10T15:13:51.657600+0000 mon.a (mon.0) 1846 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:52.957 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:52 gibba020 bash[25448]: cluster 2021-03-10T15:13:51.896275+0000 mgr.gibba020.yqfnwy (mgr.34427) 4302 : cluster [DBG] pgmap v2436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:53.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[29418]: cephadm 2021-03-10T15:13:51.424902+0000 mgr.gibba020.yqfnwy (mgr.34427) 4286 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:13:53.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[29418]: cephadm 2021-03-10T15:13:51.426784+0000 mgr.gibba020.yqfnwy (mgr.34427) 4287 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:13:53.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[29418]: audit 2021-03-10T15:13:51.647141+0000 mon.a (mon.0) 1840 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:13:53.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[29418]: cephadm 2021-03-10T15:13:51.648652+0000 mgr.gibba020.yqfnwy (mgr.34427) 4288 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:13:53.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[29418]: cephadm 2021-03-10T15:13:51.650225+0000 mgr.gibba020.yqfnwy (mgr.34427) 4289 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:13:53.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[29418]: audit 2021-03-10T15:13:51.650521+0000 mon.a (mon.0) 1841 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:13:53.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[29418]: cephadm 2021-03-10T15:13:51.651389+0000 mgr.gibba020.yqfnwy (mgr.34427) 4290 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:13:53.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[29418]: cephadm 2021-03-10T15:13:51.651431+0000 mgr.gibba020.yqfnwy (mgr.34427) 4291 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:13:53.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[29418]: audit 2021-03-10T15:13:51.651756+0000 mon.a (mon.0) 1842 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:53.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[29418]: cephadm 2021-03-10T15:13:51.652869+0000 mgr.gibba020.yqfnwy (mgr.34427) 4292 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:13:53.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[29418]: cephadm 2021-03-10T15:13:51.652912+0000 mgr.gibba020.yqfnwy (mgr.34427) 4293 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:13:53.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[29418]: audit 2021-03-10T15:13:51.652947+0000 mon.a (mon.0) 1843 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:53.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[29418]: cephadm 2021-03-10T15:13:51.653877+0000 mgr.gibba020.yqfnwy (mgr.34427) 4294 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:13:53.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[29418]: audit 2021-03-10T15:13:51.654300+0000 mon.a (mon.0) 1844 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:53.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[29418]: cephadm 2021-03-10T15:13:51.654695+0000 mgr.gibba020.yqfnwy (mgr.34427) 4295 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:13:53.138 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[29418]: cephadm 2021-03-10T15:13:51.654736+0000 mgr.gibba020.yqfnwy (mgr.34427) 4296 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:13:53.138 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[29418]: cephadm 2021-03-10T15:13:51.655818+0000 mgr.gibba020.yqfnwy (mgr.34427) 4297 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:13:53.138 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[29418]: cephadm 2021-03-10T15:13:51.656203+0000 mgr.gibba020.yqfnwy (mgr.34427) 4298 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:13:53.138 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[29418]: audit 2021-03-10T15:13:51.656279+0000 mon.a (mon.0) 1845 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:53.138 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[29418]: cephadm 2021-03-10T15:13:51.657204+0000 mgr.gibba020.yqfnwy (mgr.34427) 4299 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:13:53.139 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[29418]: cephadm 2021-03-10T15:13:51.657246+0000 mgr.gibba020.yqfnwy (mgr.34427) 4300 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:13:53.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[30381]: cephadm 2021-03-10T15:13:51.424902+0000 mgr.gibba020.yqfnwy (mgr.34427) 4286 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:13:53.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[30381]: cephadm 2021-03-10T15:13:51.426784+0000 mgr.gibba020.yqfnwy (mgr.34427) 4287 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:13:53.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[30381]: audit 2021-03-10T15:13:51.647141+0000 mon.a (mon.0) 1840 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:13:53.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[30381]: cephadm 2021-03-10T15:13:51.648652+0000 mgr.gibba020.yqfnwy (mgr.34427) 4288 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:13:53.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[30381]: cephadm 2021-03-10T15:13:51.650225+0000 mgr.gibba020.yqfnwy (mgr.34427) 4289 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:13:53.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[30381]: audit 2021-03-10T15:13:51.650521+0000 mon.a (mon.0) 1841 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:13:53.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[30381]: cephadm 2021-03-10T15:13:51.651389+0000 mgr.gibba020.yqfnwy (mgr.34427) 4290 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:13:53.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[30381]: cephadm 2021-03-10T15:13:51.651431+0000 mgr.gibba020.yqfnwy (mgr.34427) 4291 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:13:53.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[30381]: audit 2021-03-10T15:13:51.651756+0000 mon.a (mon.0) 1842 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:53.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[30381]: cephadm 2021-03-10T15:13:51.652869+0000 mgr.gibba020.yqfnwy (mgr.34427) 4292 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:13:53.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[30381]: cephadm 2021-03-10T15:13:51.652912+0000 mgr.gibba020.yqfnwy (mgr.34427) 4293 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:13:53.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[30381]: audit 2021-03-10T15:13:51.652947+0000 mon.a (mon.0) 1843 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:53.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[30381]: cephadm 2021-03-10T15:13:51.653877+0000 mgr.gibba020.yqfnwy (mgr.34427) 4294 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:13:53.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[30381]: audit 2021-03-10T15:13:51.654300+0000 mon.a (mon.0) 1844 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:53.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[30381]: cephadm 2021-03-10T15:13:51.654695+0000 mgr.gibba020.yqfnwy (mgr.34427) 4295 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:13:53.143 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[30381]: cephadm 2021-03-10T15:13:51.654736+0000 mgr.gibba020.yqfnwy (mgr.34427) 4296 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:13:53.143 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[30381]: cephadm 2021-03-10T15:13:51.655818+0000 mgr.gibba020.yqfnwy (mgr.34427) 4297 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:13:53.143 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[30381]: cephadm 2021-03-10T15:13:51.656203+0000 mgr.gibba020.yqfnwy (mgr.34427) 4298 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:13:53.143 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[30381]: audit 2021-03-10T15:13:51.656279+0000 mon.a (mon.0) 1845 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:53.143 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[30381]: cephadm 2021-03-10T15:13:51.657204+0000 mgr.gibba020.yqfnwy (mgr.34427) 4299 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:13:53.144 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[30381]: cephadm 2021-03-10T15:13:51.657246+0000 mgr.gibba020.yqfnwy (mgr.34427) 4300 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:13:53.144 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[29418]: cephadm 2021-03-10T15:13:51.657362+0000 mgr.gibba020.yqfnwy (mgr.34427) 4301 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:13:53.145 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[29418]: audit 2021-03-10T15:13:51.657600+0000 mon.a (mon.0) 1846 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:53.145 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[29418]: cluster 2021-03-10T15:13:51.896275+0000 mgr.gibba020.yqfnwy (mgr.34427) 4302 : cluster [DBG] pgmap v2436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:53.145 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[30381]: cephadm 2021-03-10T15:13:51.657362+0000 mgr.gibba020.yqfnwy (mgr.34427) 4301 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:13:53.145 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[30381]: audit 2021-03-10T15:13:51.657600+0000 mon.a (mon.0) 1846 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:13:53.146 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:52 gibba013 bash[30381]: cluster 2021-03-10T15:13:51.896275+0000 mgr.gibba020.yqfnwy (mgr.34427) 4302 : cluster [DBG] pgmap v2436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:54.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:54 gibba013 bash[29418]: cluster 2021-03-10T15:13:53.897964+0000 mgr.gibba020.yqfnwy (mgr.34427) 4303 : cluster [DBG] pgmap v2437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:54.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:54 gibba013 bash[30381]: cluster 2021-03-10T15:13:53.897964+0000 mgr.gibba020.yqfnwy (mgr.34427) 4303 : cluster [DBG] pgmap v2437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:54.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:54 gibba020 bash[25448]: cluster 2021-03-10T15:13:53.897964+0000 mgr.gibba020.yqfnwy (mgr.34427) 4303 : cluster [DBG] pgmap v2437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:56.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:56 gibba013 bash[29418]: cluster 2021-03-10T15:13:55.899583+0000 mgr.gibba020.yqfnwy (mgr.34427) 4304 : cluster [DBG] pgmap v2438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:56.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:56 gibba013 bash[30381]: cluster 2021-03-10T15:13:55.899583+0000 mgr.gibba020.yqfnwy (mgr.34427) 4304 : cluster [DBG] pgmap v2438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:56.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:56 gibba020 bash[25448]: cluster 2021-03-10T15:13:55.899583+0000 mgr.gibba020.yqfnwy (mgr.34427) 4304 : cluster [DBG] pgmap v2438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:58.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:13:57 gibba013 bash[29418]: cluster 2021-03-10T15:13:57.900838+0000 mgr.gibba020.yqfnwy (mgr.34427) 4305 : cluster [DBG] pgmap v2439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:58.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:13:57 gibba013 bash[30381]: cluster 2021-03-10T15:13:57.900838+0000 mgr.gibba020.yqfnwy (mgr.34427) 4305 : cluster [DBG] pgmap v2439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:13:58.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:13:57 gibba020 bash[25448]: cluster 2021-03-10T15:13:57.900838+0000 mgr.gibba020.yqfnwy (mgr.34427) 4305 : cluster [DBG] pgmap v2439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:00.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:00 gibba013 bash[29418]: cluster 2021-03-10T15:13:59.902727+0000 mgr.gibba020.yqfnwy (mgr.34427) 4306 : cluster [DBG] pgmap v2440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:00.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:00 gibba013 bash[30381]: cluster 2021-03-10T15:13:59.902727+0000 mgr.gibba020.yqfnwy (mgr.34427) 4306 : cluster [DBG] pgmap v2440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:00.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:00 gibba020 bash[25448]: cluster 2021-03-10T15:13:59.902727+0000 mgr.gibba020.yqfnwy (mgr.34427) 4306 : cluster [DBG] pgmap v2440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:02.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:02 gibba013 bash[29418]: cluster 2021-03-10T15:14:01.904110+0000 mgr.gibba020.yqfnwy (mgr.34427) 4307 : cluster [DBG] pgmap v2441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:02.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:02 gibba013 bash[30381]: cluster 2021-03-10T15:14:01.904110+0000 mgr.gibba020.yqfnwy (mgr.34427) 4307 : cluster [DBG] pgmap v2441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:02.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:02 gibba020 bash[25448]: cluster 2021-03-10T15:14:01.904110+0000 mgr.gibba020.yqfnwy (mgr.34427) 4307 : cluster [DBG] pgmap v2441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:04.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:04 gibba013 bash[29418]: cluster 2021-03-10T15:14:03.905732+0000 mgr.gibba020.yqfnwy (mgr.34427) 4308 : cluster [DBG] pgmap v2442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:04.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:04 gibba013 bash[30381]: cluster 2021-03-10T15:14:03.905732+0000 mgr.gibba020.yqfnwy (mgr.34427) 4308 : cluster [DBG] pgmap v2442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:04.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:04 gibba020 bash[25448]: cluster 2021-03-10T15:14:03.905732+0000 mgr.gibba020.yqfnwy (mgr.34427) 4308 : cluster [DBG] pgmap v2442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:06.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:06 gibba013 bash[29418]: cluster 2021-03-10T15:14:05.906766+0000 mgr.gibba020.yqfnwy (mgr.34427) 4309 : cluster [DBG] pgmap v2443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:06.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:06 gibba013 bash[30381]: cluster 2021-03-10T15:14:05.906766+0000 mgr.gibba020.yqfnwy (mgr.34427) 4309 : cluster [DBG] pgmap v2443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:06.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:06 gibba020 bash[25448]: cluster 2021-03-10T15:14:05.906766+0000 mgr.gibba020.yqfnwy (mgr.34427) 4309 : cluster [DBG] pgmap v2443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:07.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:07 gibba013 bash[29418]: audit 2021-03-10T15:14:06.380239+0000 mon.a (mon.0) 1847 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:14:07.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:07 gibba013 bash[29418]: audit 2021-03-10T15:14:06.423626+0000 mon.a (mon.0) 1848 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:14:07.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:07 gibba013 bash[29418]: audit 2021-03-10T15:14:06.506872+0000 mon.a (mon.0) 1849 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:14:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:07 gibba013 bash[29418]: audit 2021-03-10T15:14:06.507609+0000 mon.a (mon.0) 1850 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:14:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:07 gibba013 bash[29418]: audit 2021-03-10T15:14:06.508313+0000 mon.a (mon.0) 1851 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:14:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:07 gibba013 bash[29418]: audit 2021-03-10T15:14:06.508967+0000 mon.a (mon.0) 1852 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:14:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:07 gibba013 bash[29418]: cephadm 2021-03-10T15:14:06.663755+0000 mgr.gibba020.yqfnwy (mgr.34427) 4310 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:14:07.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:07 gibba013 bash[30381]: audit 2021-03-10T15:14:06.380239+0000 mon.a (mon.0) 1847 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:14:07.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:07 gibba013 bash[30381]: audit 2021-03-10T15:14:06.423626+0000 mon.a (mon.0) 1848 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:14:07.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:07 gibba013 bash[30381]: audit 2021-03-10T15:14:06.506872+0000 mon.a (mon.0) 1849 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:14:07.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:07 gibba013 bash[30381]: audit 2021-03-10T15:14:06.507609+0000 mon.a (mon.0) 1850 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:14:07.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:07 gibba013 bash[30381]: audit 2021-03-10T15:14:06.508313+0000 mon.a (mon.0) 1851 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:14:07.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:07 gibba013 bash[30381]: audit 2021-03-10T15:14:06.508967+0000 mon.a (mon.0) 1852 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:14:07.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:07 gibba013 bash[30381]: cephadm 2021-03-10T15:14:06.663755+0000 mgr.gibba020.yqfnwy (mgr.34427) 4310 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:14:07.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:07 gibba020 bash[25448]: audit 2021-03-10T15:14:06.380239+0000 mon.a (mon.0) 1847 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:14:07.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:07 gibba020 bash[25448]: audit 2021-03-10T15:14:06.423626+0000 mon.a (mon.0) 1848 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:14:07.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:07 gibba020 bash[25448]: audit 2021-03-10T15:14:06.506872+0000 mon.a (mon.0) 1849 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:14:07.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:07 gibba020 bash[25448]: audit 2021-03-10T15:14:06.507609+0000 mon.a (mon.0) 1850 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:14:07.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:07 gibba020 bash[25448]: audit 2021-03-10T15:14:06.508313+0000 mon.a (mon.0) 1851 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:14:07.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:07 gibba020 bash[25448]: audit 2021-03-10T15:14:06.508967+0000 mon.a (mon.0) 1852 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:14:07.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:07 gibba020 bash[25448]: cephadm 2021-03-10T15:14:06.663755+0000 mgr.gibba020.yqfnwy (mgr.34427) 4310 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:14:08.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:08 gibba013 bash[29418]: cluster 2021-03-10T15:14:07.908221+0000 mgr.gibba020.yqfnwy (mgr.34427) 4311 : cluster [DBG] pgmap v2444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:08.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:08 gibba013 bash[30381]: cluster 2021-03-10T15:14:07.908221+0000 mgr.gibba020.yqfnwy (mgr.34427) 4311 : cluster [DBG] pgmap v2444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:08.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:08 gibba020 bash[25448]: cluster 2021-03-10T15:14:07.908221+0000 mgr.gibba020.yqfnwy (mgr.34427) 4311 : cluster [DBG] pgmap v2444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:10.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:10 gibba013 bash[29418]: cluster 2021-03-10T15:14:09.910260+0000 mgr.gibba020.yqfnwy (mgr.34427) 4312 : cluster [DBG] pgmap v2445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:10.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:10 gibba013 bash[30381]: cluster 2021-03-10T15:14:09.910260+0000 mgr.gibba020.yqfnwy (mgr.34427) 4312 : cluster [DBG] pgmap v2445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:10.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:10 gibba020 bash[25448]: cluster 2021-03-10T15:14:09.910260+0000 mgr.gibba020.yqfnwy (mgr.34427) 4312 : cluster [DBG] pgmap v2445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:12.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:12 gibba013 bash[29418]: cluster 2021-03-10T15:14:11.912005+0000 mgr.gibba020.yqfnwy (mgr.34427) 4313 : cluster [DBG] pgmap v2446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:12.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:12 gibba013 bash[30381]: cluster 2021-03-10T15:14:11.912005+0000 mgr.gibba020.yqfnwy (mgr.34427) 4313 : cluster [DBG] pgmap v2446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:12.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:12 gibba020 bash[25448]: cluster 2021-03-10T15:14:11.912005+0000 mgr.gibba020.yqfnwy (mgr.34427) 4313 : cluster [DBG] pgmap v2446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:14.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:14 gibba013 bash[29418]: cluster 2021-03-10T15:14:13.913556+0000 mgr.gibba020.yqfnwy (mgr.34427) 4314 : cluster [DBG] pgmap v2447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:14.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:14 gibba013 bash[30381]: cluster 2021-03-10T15:14:13.913556+0000 mgr.gibba020.yqfnwy (mgr.34427) 4314 : cluster [DBG] pgmap v2447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:14.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:14 gibba020 bash[25448]: cluster 2021-03-10T15:14:13.913556+0000 mgr.gibba020.yqfnwy (mgr.34427) 4314 : cluster [DBG] pgmap v2447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:15.977 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:14:16.209 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:14:16.210 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (80m) 5m ago 86m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:14:16.210 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (85m) 4m ago 85m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:14:16.210 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (81m) 4m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:14:16.210 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (81m) 4m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:14:16.211 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (80m) 5m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:14:16.211 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (80m) 5m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:14:16.211 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (79m) 4m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:14:16.211 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (80m) 5m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:14:16.212 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (86m) 5m ago 86m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:14:16.212 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (86m) 4m ago 86m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:14:16.212 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (79m) 5m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:14:16.212 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (78m) 5m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:14:16.212 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (78m) 5m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:14:16.213 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (77m) 5m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:14:16.213 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (77m) 4m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:14:16.213 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (76m) 4m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:14:16.213 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (76m) 4m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:14:16.214 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (76m) 4m ago 86m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:14:16.214 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (85m) 4m ago 86m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:14:16.214 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 4m ago 84m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:14:16.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:16 gibba013 bash[29418]: cluster 2021-03-10T15:14:15.915421+0000 mgr.gibba020.yqfnwy (mgr.34427) 4315 : cluster [DBG] pgmap v2448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:16.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:16 gibba013 bash[30381]: cluster 2021-03-10T15:14:15.915421+0000 mgr.gibba020.yqfnwy (mgr.34427) 4315 : cluster [DBG] pgmap v2448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:16.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:16 gibba020 bash[25448]: cluster 2021-03-10T15:14:15.915421+0000 mgr.gibba020.yqfnwy (mgr.34427) 4315 : cluster [DBG] pgmap v2448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:16.461 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:14:16.461 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:14:16.461 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:14:16.461 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:14:16.462 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:14:16.462 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:14:16.462 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:14:16.463 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:14:16.463 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:14:16.463 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:14:16.463 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:14:16.464 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:14:16.464 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:14:16.464 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:14:16.464 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:14:17.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:17 gibba013 bash[29418]: audit 2021-03-10T15:14:15.963069+0000 mgr.gibba020.yqfnwy (mgr.34427) 4316 : audit [DBG] from='client.56935 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:14:17.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:17 gibba013 bash[29418]: audit 2021-03-10T15:14:16.192237+0000 mgr.gibba020.yqfnwy (mgr.34427) 4317 : audit [DBG] from='client.56941 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:14:17.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:17 gibba013 bash[29418]: audit 2021-03-10T15:14:16.457819+0000 mon.a (mon.0) 1853 : audit [DBG] from='client.? 172.21.2.113:0/2149912188' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:17.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:17 gibba013 bash[30381]: audit 2021-03-10T15:14:15.963069+0000 mgr.gibba020.yqfnwy (mgr.34427) 4316 : audit [DBG] from='client.56935 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:14:17.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:17 gibba013 bash[30381]: audit 2021-03-10T15:14:16.192237+0000 mgr.gibba020.yqfnwy (mgr.34427) 4317 : audit [DBG] from='client.56941 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:14:17.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:17 gibba013 bash[30381]: audit 2021-03-10T15:14:16.457819+0000 mon.a (mon.0) 1853 : audit [DBG] from='client.? 172.21.2.113:0/2149912188' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:17.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:17 gibba020 bash[25448]: audit 2021-03-10T15:14:15.963069+0000 mgr.gibba020.yqfnwy (mgr.34427) 4316 : audit [DBG] from='client.56935 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:14:17.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:17 gibba020 bash[25448]: audit 2021-03-10T15:14:16.192237+0000 mgr.gibba020.yqfnwy (mgr.34427) 4317 : audit [DBG] from='client.56941 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:14:17.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:17 gibba020 bash[25448]: audit 2021-03-10T15:14:16.457819+0000 mon.a (mon.0) 1853 : audit [DBG] from='client.? 172.21.2.113:0/2149912188' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:18.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:18 gibba013 bash[29418]: cluster 2021-03-10T15:14:17.916776+0000 mgr.gibba020.yqfnwy (mgr.34427) 4318 : cluster [DBG] pgmap v2449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:18.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:18 gibba013 bash[30381]: cluster 2021-03-10T15:14:17.916776+0000 mgr.gibba020.yqfnwy (mgr.34427) 4318 : cluster [DBG] pgmap v2449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:18.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:18 gibba020 bash[25448]: cluster 2021-03-10T15:14:17.916776+0000 mgr.gibba020.yqfnwy (mgr.34427) 4318 : cluster [DBG] pgmap v2449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:20.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:20 gibba013 bash[29418]: cluster 2021-03-10T15:14:19.918690+0000 mgr.gibba020.yqfnwy (mgr.34427) 4319 : cluster [DBG] pgmap v2450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:20.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:20 gibba013 bash[30381]: cluster 2021-03-10T15:14:19.918690+0000 mgr.gibba020.yqfnwy (mgr.34427) 4319 : cluster [DBG] pgmap v2450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:20.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:20 gibba020 bash[25448]: cluster 2021-03-10T15:14:19.918690+0000 mgr.gibba020.yqfnwy (mgr.34427) 4319 : cluster [DBG] pgmap v2450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:22.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:22 gibba013 bash[29418]: cephadm 2021-03-10T15:14:21.679218+0000 mgr.gibba020.yqfnwy (mgr.34427) 4320 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:14:22.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:22 gibba013 bash[29418]: cluster 2021-03-10T15:14:21.920173+0000 mgr.gibba020.yqfnwy (mgr.34427) 4321 : cluster [DBG] pgmap v2451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:22.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:22 gibba013 bash[30381]: cephadm 2021-03-10T15:14:21.679218+0000 mgr.gibba020.yqfnwy (mgr.34427) 4320 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:14:22.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:22 gibba013 bash[30381]: cluster 2021-03-10T15:14:21.920173+0000 mgr.gibba020.yqfnwy (mgr.34427) 4321 : cluster [DBG] pgmap v2451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:22.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:22 gibba020 bash[25448]: cephadm 2021-03-10T15:14:21.679218+0000 mgr.gibba020.yqfnwy (mgr.34427) 4320 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:14:22.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:22 gibba020 bash[25448]: cluster 2021-03-10T15:14:21.920173+0000 mgr.gibba020.yqfnwy (mgr.34427) 4321 : cluster [DBG] pgmap v2451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:24.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:24 gibba013 bash[29418]: cluster 2021-03-10T15:14:23.921792+0000 mgr.gibba020.yqfnwy (mgr.34427) 4322 : cluster [DBG] pgmap v2452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:24.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:24 gibba013 bash[30381]: cluster 2021-03-10T15:14:23.921792+0000 mgr.gibba020.yqfnwy (mgr.34427) 4322 : cluster [DBG] pgmap v2452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:24.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:24 gibba020 bash[25448]: cluster 2021-03-10T15:14:23.921792+0000 mgr.gibba020.yqfnwy (mgr.34427) 4322 : cluster [DBG] pgmap v2452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:26.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:26 gibba013 bash[29418]: cluster 2021-03-10T15:14:25.923613+0000 mgr.gibba020.yqfnwy (mgr.34427) 4323 : cluster [DBG] pgmap v2453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:26.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:26 gibba013 bash[30381]: cluster 2021-03-10T15:14:25.923613+0000 mgr.gibba020.yqfnwy (mgr.34427) 4323 : cluster [DBG] pgmap v2453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:26.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:26 gibba020 bash[25448]: cluster 2021-03-10T15:14:25.923613+0000 mgr.gibba020.yqfnwy (mgr.34427) 4323 : cluster [DBG] pgmap v2453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:28.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:28 gibba013 bash[29418]: cluster 2021-03-10T15:14:27.925103+0000 mgr.gibba020.yqfnwy (mgr.34427) 4324 : cluster [DBG] pgmap v2454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:28.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:28 gibba013 bash[30381]: cluster 2021-03-10T15:14:27.925103+0000 mgr.gibba020.yqfnwy (mgr.34427) 4324 : cluster [DBG] pgmap v2454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:28.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:27 gibba020 bash[25448]: cluster 2021-03-10T15:14:27.925103+0000 mgr.gibba020.yqfnwy (mgr.34427) 4324 : cluster [DBG] pgmap v2454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:30.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:30 gibba013 bash[29418]: cluster 2021-03-10T15:14:29.927044+0000 mgr.gibba020.yqfnwy (mgr.34427) 4325 : cluster [DBG] pgmap v2455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:30.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:30 gibba013 bash[30381]: cluster 2021-03-10T15:14:29.927044+0000 mgr.gibba020.yqfnwy (mgr.34427) 4325 : cluster [DBG] pgmap v2455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:30.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:30 gibba020 bash[25448]: cluster 2021-03-10T15:14:29.927044+0000 mgr.gibba020.yqfnwy (mgr.34427) 4325 : cluster [DBG] pgmap v2455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:32.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:32 gibba013 bash[29418]: cluster 2021-03-10T15:14:31.928269+0000 mgr.gibba020.yqfnwy (mgr.34427) 4326 : cluster [DBG] pgmap v2456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:32.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:32 gibba013 bash[30381]: cluster 2021-03-10T15:14:31.928269+0000 mgr.gibba020.yqfnwy (mgr.34427) 4326 : cluster [DBG] pgmap v2456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:32.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:32 gibba020 bash[25448]: cluster 2021-03-10T15:14:31.928269+0000 mgr.gibba020.yqfnwy (mgr.34427) 4326 : cluster [DBG] pgmap v2456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:34.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:34 gibba013 bash[29418]: cluster 2021-03-10T15:14:33.929897+0000 mgr.gibba020.yqfnwy (mgr.34427) 4327 : cluster [DBG] pgmap v2457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:34.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:34 gibba013 bash[30381]: cluster 2021-03-10T15:14:33.929897+0000 mgr.gibba020.yqfnwy (mgr.34427) 4327 : cluster [DBG] pgmap v2457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:34.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:34 gibba020 bash[25448]: cluster 2021-03-10T15:14:33.929897+0000 mgr.gibba020.yqfnwy (mgr.34427) 4327 : cluster [DBG] pgmap v2457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:36.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:36 gibba013 bash[29418]: cluster 2021-03-10T15:14:35.931781+0000 mgr.gibba020.yqfnwy (mgr.34427) 4328 : cluster [DBG] pgmap v2458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:36.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:36 gibba013 bash[30381]: cluster 2021-03-10T15:14:35.931781+0000 mgr.gibba020.yqfnwy (mgr.34427) 4328 : cluster [DBG] pgmap v2458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:36.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:36 gibba020 bash[25448]: cluster 2021-03-10T15:14:35.931781+0000 mgr.gibba020.yqfnwy (mgr.34427) 4328 : cluster [DBG] pgmap v2458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:37.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:37 gibba013 bash[29418]: cephadm 2021-03-10T15:14:36.694823+0000 mgr.gibba020.yqfnwy (mgr.34427) 4329 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:14:37.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:37 gibba013 bash[30381]: cephadm 2021-03-10T15:14:36.694823+0000 mgr.gibba020.yqfnwy (mgr.34427) 4329 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:14:37.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:37 gibba020 bash[25448]: cephadm 2021-03-10T15:14:36.694823+0000 mgr.gibba020.yqfnwy (mgr.34427) 4329 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:14:38.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:38 gibba013 bash[29418]: cluster 2021-03-10T15:14:37.932966+0000 mgr.gibba020.yqfnwy (mgr.34427) 4330 : cluster [DBG] pgmap v2459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:38.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:38 gibba013 bash[30381]: cluster 2021-03-10T15:14:37.932966+0000 mgr.gibba020.yqfnwy (mgr.34427) 4330 : cluster [DBG] pgmap v2459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:38.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:38 gibba020 bash[25448]: cluster 2021-03-10T15:14:37.932966+0000 mgr.gibba020.yqfnwy (mgr.34427) 4330 : cluster [DBG] pgmap v2459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:40.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:40 gibba013 bash[29418]: cluster 2021-03-10T15:14:39.934817+0000 mgr.gibba020.yqfnwy (mgr.34427) 4331 : cluster [DBG] pgmap v2460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:40.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:40 gibba013 bash[30381]: cluster 2021-03-10T15:14:39.934817+0000 mgr.gibba020.yqfnwy (mgr.34427) 4331 : cluster [DBG] pgmap v2460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:40.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:40 gibba020 bash[25448]: cluster 2021-03-10T15:14:39.934817+0000 mgr.gibba020.yqfnwy (mgr.34427) 4331 : cluster [DBG] pgmap v2460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:42.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:42 gibba013 bash[29418]: cluster 2021-03-10T15:14:41.936193+0000 mgr.gibba020.yqfnwy (mgr.34427) 4332 : cluster [DBG] pgmap v2461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:42.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:42 gibba013 bash[30381]: cluster 2021-03-10T15:14:41.936193+0000 mgr.gibba020.yqfnwy (mgr.34427) 4332 : cluster [DBG] pgmap v2461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:42.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:42 gibba020 bash[25448]: cluster 2021-03-10T15:14:41.936193+0000 mgr.gibba020.yqfnwy (mgr.34427) 4332 : cluster [DBG] pgmap v2461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:44.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:44 gibba013 bash[29418]: cluster 2021-03-10T15:14:43.937565+0000 mgr.gibba020.yqfnwy (mgr.34427) 4333 : cluster [DBG] pgmap v2462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:44.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:44 gibba013 bash[30381]: cluster 2021-03-10T15:14:43.937565+0000 mgr.gibba020.yqfnwy (mgr.34427) 4333 : cluster [DBG] pgmap v2462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:44.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:44 gibba020 bash[25448]: cluster 2021-03-10T15:14:43.937565+0000 mgr.gibba020.yqfnwy (mgr.34427) 4333 : cluster [DBG] pgmap v2462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:46.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:46 gibba013 bash[29418]: cluster 2021-03-10T15:14:45.939372+0000 mgr.gibba020.yqfnwy (mgr.34427) 4334 : cluster [DBG] pgmap v2463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:46.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:46 gibba013 bash[30381]: cluster 2021-03-10T15:14:45.939372+0000 mgr.gibba020.yqfnwy (mgr.34427) 4334 : cluster [DBG] pgmap v2463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:46.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:46 gibba020 bash[25448]: cluster 2021-03-10T15:14:45.939372+0000 mgr.gibba020.yqfnwy (mgr.34427) 4334 : cluster [DBG] pgmap v2463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:46.711 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:14:46.943 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:14:46.944 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (81m) 6m ago 86m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:14:46.944 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (86m) 4m ago 86m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:14:46.944 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (81m) 4m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:14:46.944 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (81m) 4m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:14:46.945 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (80m) 6m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:14:46.945 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (80m) 6m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:14:46.945 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (80m) 4m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:14:46.945 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (80m) 6m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:14:46.945 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (86m) 6m ago 86m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:14:46.946 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (86m) 4m ago 86m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:14:46.946 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (79m) 6m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:14:46.946 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (79m) 6m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:14:46.946 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (78m) 6m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:14:46.947 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (78m) 6m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:14:46.947 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (77m) 4m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:14:46.947 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (77m) 4m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:14:46.947 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (76m) 4m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:14:46.948 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (76m) 4m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:14:46.948 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (86m) 4m ago 86m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:14:46.948 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 4m ago 84m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:14:47.197 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:14:47.198 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:14:47.198 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:14:47.198 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:14:47.198 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:14:47.199 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:14:47.199 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:14:47.199 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:14:47.199 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:14:47.200 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:14:47.200 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:14:47.200 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:14:47.200 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:14:47.200 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:14:47.201 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:14:47.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:47 gibba013 bash[29418]: audit 2021-03-10T15:14:46.698576+0000 mgr.gibba020.yqfnwy (mgr.34427) 4335 : audit [DBG] from='client.46968 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:14:47.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:47 gibba013 bash[29418]: audit 2021-03-10T15:14:46.926880+0000 mgr.gibba020.yqfnwy (mgr.34427) 4336 : audit [DBG] from='client.56959 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:14:47.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:47 gibba013 bash[30381]: audit 2021-03-10T15:14:46.698576+0000 mgr.gibba020.yqfnwy (mgr.34427) 4335 : audit [DBG] from='client.46968 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:14:47.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:47 gibba013 bash[30381]: audit 2021-03-10T15:14:46.926880+0000 mgr.gibba020.yqfnwy (mgr.34427) 4336 : audit [DBG] from='client.56959 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:14:47.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:47 gibba020 bash[25448]: audit 2021-03-10T15:14:46.698576+0000 mgr.gibba020.yqfnwy (mgr.34427) 4335 : audit [DBG] from='client.46968 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:14:47.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:47 gibba020 bash[25448]: audit 2021-03-10T15:14:46.926880+0000 mgr.gibba020.yqfnwy (mgr.34427) 4336 : audit [DBG] from='client.56959 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:14:48.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:48 gibba013 bash[29418]: audit 2021-03-10T15:14:47.194167+0000 mon.a (mon.0) 1854 : audit [DBG] from='client.? 172.21.2.113:0/447905336' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:48.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:48 gibba013 bash[29418]: cluster 2021-03-10T15:14:47.940782+0000 mgr.gibba020.yqfnwy (mgr.34427) 4337 : cluster [DBG] pgmap v2464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:48.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:48 gibba013 bash[30381]: audit 2021-03-10T15:14:47.194167+0000 mon.a (mon.0) 1854 : audit [DBG] from='client.? 172.21.2.113:0/447905336' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:48.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:48 gibba013 bash[30381]: cluster 2021-03-10T15:14:47.940782+0000 mgr.gibba020.yqfnwy (mgr.34427) 4337 : cluster [DBG] pgmap v2464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:48.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:48 gibba020 bash[25448]: audit 2021-03-10T15:14:47.194167+0000 mon.a (mon.0) 1854 : audit [DBG] from='client.? 172.21.2.113:0/447905336' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:48.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:48 gibba020 bash[25448]: cluster 2021-03-10T15:14:47.940782+0000 mgr.gibba020.yqfnwy (mgr.34427) 4337 : cluster [DBG] pgmap v2464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:50.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:50 gibba013 bash[29418]: cluster 2021-03-10T15:14:49.942618+0000 mgr.gibba020.yqfnwy (mgr.34427) 4338 : cluster [DBG] pgmap v2465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:50.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:50 gibba013 bash[30381]: cluster 2021-03-10T15:14:49.942618+0000 mgr.gibba020.yqfnwy (mgr.34427) 4338 : cluster [DBG] pgmap v2465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:50.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:50 gibba020 bash[25448]: cluster 2021-03-10T15:14:49.942618+0000 mgr.gibba020.yqfnwy (mgr.34427) 4338 : cluster [DBG] pgmap v2465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:52.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:51 gibba013 bash[29418]: audit 2021-03-10T15:14:51.697237+0000 mon.a (mon.0) 1855 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:14:52.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:51 gibba013 bash[30381]: audit 2021-03-10T15:14:51.697237+0000 mon.a (mon.0) 1855 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:14:52.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:51 gibba020 bash[25448]: audit 2021-03-10T15:14:51.697237+0000 mon.a (mon.0) 1855 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:14:53.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:52 gibba020 bash[25448]: cephadm 2021-03-10T15:14:51.700033+0000 mgr.gibba020.yqfnwy (mgr.34427) 4339 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:14:53.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:52 gibba020 bash[25448]: cephadm 2021-03-10T15:14:51.700998+0000 mgr.gibba020.yqfnwy (mgr.34427) 4340 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:14:53.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:52 gibba020 bash[25448]: audit 2021-03-10T15:14:51.918913+0000 mon.a (mon.0) 1856 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:14:53.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:52 gibba020 bash[25448]: cephadm 2021-03-10T15:14:51.920315+0000 mgr.gibba020.yqfnwy (mgr.34427) 4341 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:14:53.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:52 gibba020 bash[25448]: audit 2021-03-10T15:14:51.922220+0000 mon.a (mon.0) 1857 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:14:53.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:52 gibba020 bash[25448]: cephadm 2021-03-10T15:14:51.922220+0000 mgr.gibba020.yqfnwy (mgr.34427) 4342 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:14:53.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:52 gibba020 bash[25448]: audit 2021-03-10T15:14:51.924054+0000 mon.a (mon.0) 1858 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:53.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:52 gibba020 bash[25448]: cephadm 2021-03-10T15:14:51.924091+0000 mgr.gibba020.yqfnwy (mgr.34427) 4343 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:14:53.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:52 gibba020 bash[25448]: cephadm 2021-03-10T15:14:51.924149+0000 mgr.gibba020.yqfnwy (mgr.34427) 4344 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:14:53.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:52 gibba020 bash[25448]: cephadm 2021-03-10T15:14:51.925442+0000 mgr.gibba020.yqfnwy (mgr.34427) 4345 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:14:53.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:52 gibba020 bash[25448]: cephadm 2021-03-10T15:14:51.925500+0000 mgr.gibba020.yqfnwy (mgr.34427) 4346 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:14:53.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:52 gibba020 bash[25448]: audit 2021-03-10T15:14:51.925824+0000 mon.a (mon.0) 1859 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:53.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:52 gibba020 bash[25448]: cephadm 2021-03-10T15:14:51.926463+0000 mgr.gibba020.yqfnwy (mgr.34427) 4347 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:14:53.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:52 gibba020 bash[25448]: audit 2021-03-10T15:14:51.926903+0000 mon.a (mon.0) 1860 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:53.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:52 gibba020 bash[25448]: cephadm 2021-03-10T15:14:51.927698+0000 mgr.gibba020.yqfnwy (mgr.34427) 4348 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:14:53.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:52 gibba020 bash[25448]: cephadm 2021-03-10T15:14:51.927743+0000 mgr.gibba020.yqfnwy (mgr.34427) 4349 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:14:53.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:52 gibba020 bash[25448]: cephadm 2021-03-10T15:14:51.929227+0000 mgr.gibba020.yqfnwy (mgr.34427) 4350 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:14:53.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:52 gibba020 bash[25448]: audit 2021-03-10T15:14:51.929480+0000 mon.a (mon.0) 1861 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:53.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:52 gibba020 bash[25448]: cephadm 2021-03-10T15:14:51.929559+0000 mgr.gibba020.yqfnwy (mgr.34427) 4351 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:14:53.206 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:52 gibba020 bash[25448]: cephadm 2021-03-10T15:14:51.930950+0000 mgr.gibba020.yqfnwy (mgr.34427) 4352 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:14:53.206 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:52 gibba020 bash[25448]: cephadm 2021-03-10T15:14:51.931012+0000 mgr.gibba020.yqfnwy (mgr.34427) 4353 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:14:53.206 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:52 gibba020 bash[25448]: audit 2021-03-10T15:14:51.931097+0000 mon.a (mon.0) 1862 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:53.206 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:52 gibba020 bash[25448]: cephadm 2021-03-10T15:14:51.931145+0000 mgr.gibba020.yqfnwy (mgr.34427) 4354 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:14:53.207 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:52 gibba020 bash[25448]: cluster 2021-03-10T15:14:51.943772+0000 mgr.gibba020.yqfnwy (mgr.34427) 4355 : cluster [DBG] pgmap v2466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:53.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[29418]: cephadm 2021-03-10T15:14:51.700033+0000 mgr.gibba020.yqfnwy (mgr.34427) 4339 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:14:53.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[29418]: cephadm 2021-03-10T15:14:51.700998+0000 mgr.gibba020.yqfnwy (mgr.34427) 4340 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:14:53.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[29418]: audit 2021-03-10T15:14:51.918913+0000 mon.a (mon.0) 1856 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:14:53.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[29418]: cephadm 2021-03-10T15:14:51.920315+0000 mgr.gibba020.yqfnwy (mgr.34427) 4341 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:14:53.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[29418]: audit 2021-03-10T15:14:51.922220+0000 mon.a (mon.0) 1857 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:14:53.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[29418]: cephadm 2021-03-10T15:14:51.922220+0000 mgr.gibba020.yqfnwy (mgr.34427) 4342 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:14:53.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[29418]: audit 2021-03-10T15:14:51.924054+0000 mon.a (mon.0) 1858 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:53.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[29418]: cephadm 2021-03-10T15:14:51.924091+0000 mgr.gibba020.yqfnwy (mgr.34427) 4343 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:14:53.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[29418]: cephadm 2021-03-10T15:14:51.924149+0000 mgr.gibba020.yqfnwy (mgr.34427) 4344 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:14:53.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[29418]: cephadm 2021-03-10T15:14:51.925442+0000 mgr.gibba020.yqfnwy (mgr.34427) 4345 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:14:53.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[29418]: cephadm 2021-03-10T15:14:51.925500+0000 mgr.gibba020.yqfnwy (mgr.34427) 4346 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:14:53.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[29418]: audit 2021-03-10T15:14:51.925824+0000 mon.a (mon.0) 1859 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:53.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[29418]: cephadm 2021-03-10T15:14:51.926463+0000 mgr.gibba020.yqfnwy (mgr.34427) 4347 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:14:53.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[29418]: audit 2021-03-10T15:14:51.926903+0000 mon.a (mon.0) 1860 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:53.387 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[29418]: cephadm 2021-03-10T15:14:51.927698+0000 mgr.gibba020.yqfnwy (mgr.34427) 4348 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:14:53.387 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[29418]: cephadm 2021-03-10T15:14:51.927743+0000 mgr.gibba020.yqfnwy (mgr.34427) 4349 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:14:53.387 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[29418]: cephadm 2021-03-10T15:14:51.929227+0000 mgr.gibba020.yqfnwy (mgr.34427) 4350 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:14:53.387 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[29418]: audit 2021-03-10T15:14:51.929480+0000 mon.a (mon.0) 1861 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:53.388 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[29418]: cephadm 2021-03-10T15:14:51.929559+0000 mgr.gibba020.yqfnwy (mgr.34427) 4351 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:14:53.388 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[29418]: cephadm 2021-03-10T15:14:51.930950+0000 mgr.gibba020.yqfnwy (mgr.34427) 4352 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:14:53.388 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[29418]: cephadm 2021-03-10T15:14:51.931012+0000 mgr.gibba020.yqfnwy (mgr.34427) 4353 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:14:53.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[30381]: cephadm 2021-03-10T15:14:51.700033+0000 mgr.gibba020.yqfnwy (mgr.34427) 4339 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:14:53.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[30381]: cephadm 2021-03-10T15:14:51.700998+0000 mgr.gibba020.yqfnwy (mgr.34427) 4340 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:14:53.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[30381]: audit 2021-03-10T15:14:51.918913+0000 mon.a (mon.0) 1856 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:14:53.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[30381]: cephadm 2021-03-10T15:14:51.920315+0000 mgr.gibba020.yqfnwy (mgr.34427) 4341 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:14:53.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[30381]: audit 2021-03-10T15:14:51.922220+0000 mon.a (mon.0) 1857 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:14:53.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[30381]: cephadm 2021-03-10T15:14:51.922220+0000 mgr.gibba020.yqfnwy (mgr.34427) 4342 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:14:53.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[30381]: audit 2021-03-10T15:14:51.924054+0000 mon.a (mon.0) 1858 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:53.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[30381]: cephadm 2021-03-10T15:14:51.924091+0000 mgr.gibba020.yqfnwy (mgr.34427) 4343 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:14:53.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[30381]: cephadm 2021-03-10T15:14:51.924149+0000 mgr.gibba020.yqfnwy (mgr.34427) 4344 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:14:53.391 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[30381]: cephadm 2021-03-10T15:14:51.925442+0000 mgr.gibba020.yqfnwy (mgr.34427) 4345 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:14:53.391 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[30381]: cephadm 2021-03-10T15:14:51.925500+0000 mgr.gibba020.yqfnwy (mgr.34427) 4346 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:14:53.391 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[30381]: audit 2021-03-10T15:14:51.925824+0000 mon.a (mon.0) 1859 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:53.391 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[30381]: cephadm 2021-03-10T15:14:51.926463+0000 mgr.gibba020.yqfnwy (mgr.34427) 4347 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:14:53.392 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[30381]: audit 2021-03-10T15:14:51.926903+0000 mon.a (mon.0) 1860 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:53.392 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[30381]: cephadm 2021-03-10T15:14:51.927698+0000 mgr.gibba020.yqfnwy (mgr.34427) 4348 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:14:53.392 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[30381]: cephadm 2021-03-10T15:14:51.927743+0000 mgr.gibba020.yqfnwy (mgr.34427) 4349 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:14:53.392 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[30381]: cephadm 2021-03-10T15:14:51.929227+0000 mgr.gibba020.yqfnwy (mgr.34427) 4350 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:14:53.393 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[30381]: audit 2021-03-10T15:14:51.929480+0000 mon.a (mon.0) 1861 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:53.393 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[30381]: cephadm 2021-03-10T15:14:51.929559+0000 mgr.gibba020.yqfnwy (mgr.34427) 4351 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:14:53.393 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[30381]: cephadm 2021-03-10T15:14:51.930950+0000 mgr.gibba020.yqfnwy (mgr.34427) 4352 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:14:53.393 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[30381]: cephadm 2021-03-10T15:14:51.931012+0000 mgr.gibba020.yqfnwy (mgr.34427) 4353 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:14:53.394 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[29418]: audit 2021-03-10T15:14:51.931097+0000 mon.a (mon.0) 1862 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:53.394 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[29418]: cephadm 2021-03-10T15:14:51.931145+0000 mgr.gibba020.yqfnwy (mgr.34427) 4354 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:14:53.394 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[29418]: cluster 2021-03-10T15:14:51.943772+0000 mgr.gibba020.yqfnwy (mgr.34427) 4355 : cluster [DBG] pgmap v2466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:53.395 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[30381]: audit 2021-03-10T15:14:51.931097+0000 mon.a (mon.0) 1862 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:14:53.395 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[30381]: cephadm 2021-03-10T15:14:51.931145+0000 mgr.gibba020.yqfnwy (mgr.34427) 4354 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:14:53.395 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:52 gibba013 bash[30381]: cluster 2021-03-10T15:14:51.943772+0000 mgr.gibba020.yqfnwy (mgr.34427) 4355 : cluster [DBG] pgmap v2466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:54.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:54 gibba013 bash[29418]: cluster 2021-03-10T15:14:53.945445+0000 mgr.gibba020.yqfnwy (mgr.34427) 4356 : cluster [DBG] pgmap v2467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:54.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:54 gibba013 bash[30381]: cluster 2021-03-10T15:14:53.945445+0000 mgr.gibba020.yqfnwy (mgr.34427) 4356 : cluster [DBG] pgmap v2467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:54.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:54 gibba020 bash[25448]: cluster 2021-03-10T15:14:53.945445+0000 mgr.gibba020.yqfnwy (mgr.34427) 4356 : cluster [DBG] pgmap v2467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:56.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:56 gibba013 bash[29418]: cluster 2021-03-10T15:14:55.947158+0000 mgr.gibba020.yqfnwy (mgr.34427) 4357 : cluster [DBG] pgmap v2468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:56.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:56 gibba013 bash[30381]: cluster 2021-03-10T15:14:55.947158+0000 mgr.gibba020.yqfnwy (mgr.34427) 4357 : cluster [DBG] pgmap v2468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:56.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:56 gibba020 bash[25448]: cluster 2021-03-10T15:14:55.947158+0000 mgr.gibba020.yqfnwy (mgr.34427) 4357 : cluster [DBG] pgmap v2468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:58.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:14:58 gibba013 bash[29418]: cluster 2021-03-10T15:14:57.948415+0000 mgr.gibba020.yqfnwy (mgr.34427) 4358 : cluster [DBG] pgmap v2469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:58.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:14:58 gibba013 bash[30381]: cluster 2021-03-10T15:14:57.948415+0000 mgr.gibba020.yqfnwy (mgr.34427) 4358 : cluster [DBG] pgmap v2469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:14:58.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:14:58 gibba020 bash[25448]: cluster 2021-03-10T15:14:57.948415+0000 mgr.gibba020.yqfnwy (mgr.34427) 4358 : cluster [DBG] pgmap v2469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:00.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:00 gibba013 bash[29418]: cluster 2021-03-10T15:14:59.950056+0000 mgr.gibba020.yqfnwy (mgr.34427) 4359 : cluster [DBG] pgmap v2470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:00.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:00 gibba013 bash[30381]: cluster 2021-03-10T15:14:59.950056+0000 mgr.gibba020.yqfnwy (mgr.34427) 4359 : cluster [DBG] pgmap v2470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:00.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:00 gibba020 bash[25448]: cluster 2021-03-10T15:14:59.950056+0000 mgr.gibba020.yqfnwy (mgr.34427) 4359 : cluster [DBG] pgmap v2470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:02.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:02 gibba020 bash[25448]: cluster 2021-03-10T15:15:01.951557+0000 mgr.gibba020.yqfnwy (mgr.34427) 4360 : cluster [DBG] pgmap v2471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:02.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:02 gibba013 bash[29418]: cluster 2021-03-10T15:15:01.951557+0000 mgr.gibba020.yqfnwy (mgr.34427) 4360 : cluster [DBG] pgmap v2471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:02.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:02 gibba013 bash[30381]: cluster 2021-03-10T15:15:01.951557+0000 mgr.gibba020.yqfnwy (mgr.34427) 4360 : cluster [DBG] pgmap v2471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:04.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:04 gibba013 bash[29418]: cluster 2021-03-10T15:15:03.953107+0000 mgr.gibba020.yqfnwy (mgr.34427) 4361 : cluster [DBG] pgmap v2472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:04.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:04 gibba013 bash[30381]: cluster 2021-03-10T15:15:03.953107+0000 mgr.gibba020.yqfnwy (mgr.34427) 4361 : cluster [DBG] pgmap v2472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:04.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:04 gibba020 bash[25448]: cluster 2021-03-10T15:15:03.953107+0000 mgr.gibba020.yqfnwy (mgr.34427) 4361 : cluster [DBG] pgmap v2472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:06.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:06 gibba013 bash[29418]: cluster 2021-03-10T15:15:05.954960+0000 mgr.gibba020.yqfnwy (mgr.34427) 4362 : cluster [DBG] pgmap v2473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:06.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:06 gibba013 bash[30381]: cluster 2021-03-10T15:15:05.954960+0000 mgr.gibba020.yqfnwy (mgr.34427) 4362 : cluster [DBG] pgmap v2473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:06.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:06 gibba020 bash[25448]: cluster 2021-03-10T15:15:05.954960+0000 mgr.gibba020.yqfnwy (mgr.34427) 4362 : cluster [DBG] pgmap v2473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:07.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:07 gibba013 bash[29418]: audit 2021-03-10T15:15:06.385330+0000 mon.a (mon.0) 1863 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:15:07.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:07 gibba013 bash[29418]: audit 2021-03-10T15:15:06.430664+0000 mon.a (mon.0) 1864 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:15:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:07 gibba013 bash[29418]: audit 2021-03-10T15:15:06.516794+0000 mon.a (mon.0) 1865 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T15:15:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:07 gibba013 bash[29418]: audit 2021-03-10T15:15:06.517920+0000 mon.a (mon.0) 1866 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:15:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:07 gibba013 bash[29418]: audit 2021-03-10T15:15:06.518993+0000 mon.a (mon.0) 1867 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:15:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:07 gibba013 bash[29418]: audit 2021-03-10T15:15:06.520015+0000 mon.a (mon.0) 1868 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:15:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:07 gibba013 bash[29418]: cephadm 2021-03-10T15:15:06.947225+0000 mgr.gibba020.yqfnwy (mgr.34427) 4363 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:15:07.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:07 gibba013 bash[30381]: audit 2021-03-10T15:15:06.385330+0000 mon.a (mon.0) 1863 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:15:07.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:07 gibba013 bash[30381]: audit 2021-03-10T15:15:06.430664+0000 mon.a (mon.0) 1864 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:15:07.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:07 gibba013 bash[30381]: audit 2021-03-10T15:15:06.516794+0000 mon.a (mon.0) 1865 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T15:15:07.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:07 gibba013 bash[30381]: audit 2021-03-10T15:15:06.517920+0000 mon.a (mon.0) 1866 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:15:07.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:07 gibba013 bash[30381]: audit 2021-03-10T15:15:06.518993+0000 mon.a (mon.0) 1867 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:15:07.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:07 gibba013 bash[30381]: audit 2021-03-10T15:15:06.520015+0000 mon.a (mon.0) 1868 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:15:07.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:07 gibba013 bash[30381]: cephadm 2021-03-10T15:15:06.947225+0000 mgr.gibba020.yqfnwy (mgr.34427) 4363 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:15:07.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:07 gibba020 bash[25448]: audit 2021-03-10T15:15:06.385330+0000 mon.a (mon.0) 1863 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:15:07.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:07 gibba020 bash[25448]: audit 2021-03-10T15:15:06.430664+0000 mon.a (mon.0) 1864 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:15:07.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:07 gibba020 bash[25448]: audit 2021-03-10T15:15:06.516794+0000 mon.a (mon.0) 1865 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T15:15:07.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:07 gibba020 bash[25448]: audit 2021-03-10T15:15:06.517920+0000 mon.a (mon.0) 1866 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:15:07.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:07 gibba020 bash[25448]: audit 2021-03-10T15:15:06.518993+0000 mon.a (mon.0) 1867 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:15:07.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:07 gibba020 bash[25448]: audit 2021-03-10T15:15:06.520015+0000 mon.a (mon.0) 1868 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:15:07.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:07 gibba020 bash[25448]: cephadm 2021-03-10T15:15:06.947225+0000 mgr.gibba020.yqfnwy (mgr.34427) 4363 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:15:08.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:08 gibba013 bash[29418]: cluster 2021-03-10T15:15:07.956211+0000 mgr.gibba020.yqfnwy (mgr.34427) 4364 : cluster [DBG] pgmap v2474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:08.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:08 gibba013 bash[30381]: cluster 2021-03-10T15:15:07.956211+0000 mgr.gibba020.yqfnwy (mgr.34427) 4364 : cluster [DBG] pgmap v2474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:08.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:08 gibba020 bash[25448]: cluster 2021-03-10T15:15:07.956211+0000 mgr.gibba020.yqfnwy (mgr.34427) 4364 : cluster [DBG] pgmap v2474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:10.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:10 gibba013 bash[29418]: cluster 2021-03-10T15:15:09.958077+0000 mgr.gibba020.yqfnwy (mgr.34427) 4365 : cluster [DBG] pgmap v2475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:10.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:10 gibba013 bash[30381]: cluster 2021-03-10T15:15:09.958077+0000 mgr.gibba020.yqfnwy (mgr.34427) 4365 : cluster [DBG] pgmap v2475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:10.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:10 gibba020 bash[25448]: cluster 2021-03-10T15:15:09.958077+0000 mgr.gibba020.yqfnwy (mgr.34427) 4365 : cluster [DBG] pgmap v2475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:12.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:12 gibba013 bash[29418]: cluster 2021-03-10T15:15:11.959536+0000 mgr.gibba020.yqfnwy (mgr.34427) 4366 : cluster [DBG] pgmap v2476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:12.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:12 gibba013 bash[30381]: cluster 2021-03-10T15:15:11.959536+0000 mgr.gibba020.yqfnwy (mgr.34427) 4366 : cluster [DBG] pgmap v2476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:12.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:12 gibba020 bash[25448]: cluster 2021-03-10T15:15:11.959536+0000 mgr.gibba020.yqfnwy (mgr.34427) 4366 : cluster [DBG] pgmap v2476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:14.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:14 gibba013 bash[29418]: cluster 2021-03-10T15:15:13.960986+0000 mgr.gibba020.yqfnwy (mgr.34427) 4367 : cluster [DBG] pgmap v2477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:14.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:14 gibba013 bash[30381]: cluster 2021-03-10T15:15:13.960986+0000 mgr.gibba020.yqfnwy (mgr.34427) 4367 : cluster [DBG] pgmap v2477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:14.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:14 gibba020 bash[25448]: cluster 2021-03-10T15:15:13.960986+0000 mgr.gibba020.yqfnwy (mgr.34427) 4367 : cluster [DBG] pgmap v2477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:16.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:16 gibba013 bash[29418]: cluster 2021-03-10T15:15:15.962995+0000 mgr.gibba020.yqfnwy (mgr.34427) 4368 : cluster [DBG] pgmap v2478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:16.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:16 gibba013 bash[30381]: cluster 2021-03-10T15:15:15.962995+0000 mgr.gibba020.yqfnwy (mgr.34427) 4368 : cluster [DBG] pgmap v2478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:16.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:16 gibba020 bash[25448]: cluster 2021-03-10T15:15:15.962995+0000 mgr.gibba020.yqfnwy (mgr.34427) 4368 : cluster [DBG] pgmap v2478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:17.443 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:15:17.673 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:15:17.674 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (81m) 6m ago 87m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:15:17.674 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (86m) 5m ago 86m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:15:17.674 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (82m) 5m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:15:17.675 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (82m) 5m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:15:17.675 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (81m) 6m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:15:17.675 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (81m) 6m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:15:17.676 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (80m) 5m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:15:17.676 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (81m) 6m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:15:17.676 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (87m) 6m ago 87m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:15:17.676 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (87m) 5m ago 87m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:15:17.677 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (80m) 6m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:15:17.677 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (79m) 6m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:15:17.677 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (79m) 6m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:15:17.677 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (78m) 6m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:15:17.678 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (78m) 5m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:15:17.678 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (77m) 5m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:15:17.678 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (77m) 5m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:15:17.679 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (77m) 5m ago 87m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:15:17.679 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (86m) 5m ago 87m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:15:17.679 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 5m ago 85m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:15:17.923 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:15:17.923 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:15:17.924 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:15:17.924 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:15:17.924 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:15:17.924 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:15:17.925 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:15:17.925 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:15:17.925 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:15:17.925 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:15:17.926 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:15:17.926 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:15:17.926 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:15:17.927 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:15:17.927 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:15:18.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:18 gibba013 bash[29418]: audit 2021-03-10T15:15:17.429468+0000 mgr.gibba020.yqfnwy (mgr.34427) 4369 : audit [DBG] from='client.46986 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:15:18.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:18 gibba013 bash[29418]: audit 2021-03-10T15:15:17.656758+0000 mgr.gibba020.yqfnwy (mgr.34427) 4370 : audit [DBG] from='client.46992 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:15:18.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:18 gibba013 bash[29418]: audit 2021-03-10T15:15:17.919792+0000 mon.a (mon.0) 1869 : audit [DBG] from='client.? 172.21.2.113:0/1888246148' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:18.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:18 gibba013 bash[29418]: cluster 2021-03-10T15:15:17.964467+0000 mgr.gibba020.yqfnwy (mgr.34427) 4371 : cluster [DBG] pgmap v2479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:18.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:18 gibba013 bash[30381]: audit 2021-03-10T15:15:17.429468+0000 mgr.gibba020.yqfnwy (mgr.34427) 4369 : audit [DBG] from='client.46986 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:15:18.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:18 gibba013 bash[30381]: audit 2021-03-10T15:15:17.656758+0000 mgr.gibba020.yqfnwy (mgr.34427) 4370 : audit [DBG] from='client.46992 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:15:18.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:18 gibba013 bash[30381]: audit 2021-03-10T15:15:17.919792+0000 mon.a (mon.0) 1869 : audit [DBG] from='client.? 172.21.2.113:0/1888246148' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:18.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:18 gibba013 bash[30381]: cluster 2021-03-10T15:15:17.964467+0000 mgr.gibba020.yqfnwy (mgr.34427) 4371 : cluster [DBG] pgmap v2479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:18.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:18 gibba020 bash[25448]: audit 2021-03-10T15:15:17.429468+0000 mgr.gibba020.yqfnwy (mgr.34427) 4369 : audit [DBG] from='client.46986 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:15:18.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:18 gibba020 bash[25448]: audit 2021-03-10T15:15:17.656758+0000 mgr.gibba020.yqfnwy (mgr.34427) 4370 : audit [DBG] from='client.46992 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:15:18.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:18 gibba020 bash[25448]: audit 2021-03-10T15:15:17.919792+0000 mon.a (mon.0) 1869 : audit [DBG] from='client.? 172.21.2.113:0/1888246148' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:18.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:18 gibba020 bash[25448]: cluster 2021-03-10T15:15:17.964467+0000 mgr.gibba020.yqfnwy (mgr.34427) 4371 : cluster [DBG] pgmap v2479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:20.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:20 gibba013 bash[29418]: cluster 2021-03-10T15:15:19.966537+0000 mgr.gibba020.yqfnwy (mgr.34427) 4372 : cluster [DBG] pgmap v2480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:20.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:20 gibba013 bash[30381]: cluster 2021-03-10T15:15:19.966537+0000 mgr.gibba020.yqfnwy (mgr.34427) 4372 : cluster [DBG] pgmap v2480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:20.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:20 gibba020 bash[25448]: cluster 2021-03-10T15:15:19.966537+0000 mgr.gibba020.yqfnwy (mgr.34427) 4372 : cluster [DBG] pgmap v2480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:22.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:22 gibba013 bash[29418]: cephadm 2021-03-10T15:15:21.963227+0000 mgr.gibba020.yqfnwy (mgr.34427) 4373 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:15:22.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:22 gibba013 bash[29418]: cluster 2021-03-10T15:15:21.967838+0000 mgr.gibba020.yqfnwy (mgr.34427) 4374 : cluster [DBG] pgmap v2481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:22.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:22 gibba013 bash[30381]: cephadm 2021-03-10T15:15:21.963227+0000 mgr.gibba020.yqfnwy (mgr.34427) 4373 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:15:22.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:22 gibba013 bash[30381]: cluster 2021-03-10T15:15:21.967838+0000 mgr.gibba020.yqfnwy (mgr.34427) 4374 : cluster [DBG] pgmap v2481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:22.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:22 gibba020 bash[25448]: cephadm 2021-03-10T15:15:21.963227+0000 mgr.gibba020.yqfnwy (mgr.34427) 4373 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:15:22.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:22 gibba020 bash[25448]: cluster 2021-03-10T15:15:21.967838+0000 mgr.gibba020.yqfnwy (mgr.34427) 4374 : cluster [DBG] pgmap v2481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:24.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:24 gibba013 bash[29418]: cluster 2021-03-10T15:15:23.969435+0000 mgr.gibba020.yqfnwy (mgr.34427) 4375 : cluster [DBG] pgmap v2482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:24.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:24 gibba013 bash[30381]: cluster 2021-03-10T15:15:23.969435+0000 mgr.gibba020.yqfnwy (mgr.34427) 4375 : cluster [DBG] pgmap v2482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:24.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:24 gibba020 bash[25448]: cluster 2021-03-10T15:15:23.969435+0000 mgr.gibba020.yqfnwy (mgr.34427) 4375 : cluster [DBG] pgmap v2482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:26.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:26 gibba013 bash[29418]: cluster 2021-03-10T15:15:25.971310+0000 mgr.gibba020.yqfnwy (mgr.34427) 4376 : cluster [DBG] pgmap v2483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:26.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:26 gibba013 bash[30381]: cluster 2021-03-10T15:15:25.971310+0000 mgr.gibba020.yqfnwy (mgr.34427) 4376 : cluster [DBG] pgmap v2483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:26.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:26 gibba020 bash[25448]: cluster 2021-03-10T15:15:25.971310+0000 mgr.gibba020.yqfnwy (mgr.34427) 4376 : cluster [DBG] pgmap v2483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:28.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:28 gibba013 bash[29418]: cluster 2021-03-10T15:15:27.972909+0000 mgr.gibba020.yqfnwy (mgr.34427) 4377 : cluster [DBG] pgmap v2484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:28.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:28 gibba013 bash[30381]: cluster 2021-03-10T15:15:27.972909+0000 mgr.gibba020.yqfnwy (mgr.34427) 4377 : cluster [DBG] pgmap v2484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:28.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:28 gibba020 bash[25448]: cluster 2021-03-10T15:15:27.972909+0000 mgr.gibba020.yqfnwy (mgr.34427) 4377 : cluster [DBG] pgmap v2484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:30.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:30 gibba013 bash[29418]: cluster 2021-03-10T15:15:29.974953+0000 mgr.gibba020.yqfnwy (mgr.34427) 4378 : cluster [DBG] pgmap v2485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:30.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:30 gibba013 bash[30381]: cluster 2021-03-10T15:15:29.974953+0000 mgr.gibba020.yqfnwy (mgr.34427) 4378 : cluster [DBG] pgmap v2485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:30.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:30 gibba020 bash[25448]: cluster 2021-03-10T15:15:29.974953+0000 mgr.gibba020.yqfnwy (mgr.34427) 4378 : cluster [DBG] pgmap v2485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:32.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:32 gibba013 bash[29418]: cluster 2021-03-10T15:15:31.976621+0000 mgr.gibba020.yqfnwy (mgr.34427) 4379 : cluster [DBG] pgmap v2486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:32.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:32 gibba013 bash[30381]: cluster 2021-03-10T15:15:31.976621+0000 mgr.gibba020.yqfnwy (mgr.34427) 4379 : cluster [DBG] pgmap v2486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:32.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:32 gibba020 bash[25448]: cluster 2021-03-10T15:15:31.976621+0000 mgr.gibba020.yqfnwy (mgr.34427) 4379 : cluster [DBG] pgmap v2486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:34.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:34 gibba013 bash[29418]: cluster 2021-03-10T15:15:33.978481+0000 mgr.gibba020.yqfnwy (mgr.34427) 4380 : cluster [DBG] pgmap v2487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:34.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:34 gibba013 bash[30381]: cluster 2021-03-10T15:15:33.978481+0000 mgr.gibba020.yqfnwy (mgr.34427) 4380 : cluster [DBG] pgmap v2487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:34.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:34 gibba020 bash[25448]: cluster 2021-03-10T15:15:33.978481+0000 mgr.gibba020.yqfnwy (mgr.34427) 4380 : cluster [DBG] pgmap v2487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:36.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:36 gibba013 bash[29418]: cluster 2021-03-10T15:15:35.980225+0000 mgr.gibba020.yqfnwy (mgr.34427) 4381 : cluster [DBG] pgmap v2488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:36.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:36 gibba013 bash[30381]: cluster 2021-03-10T15:15:35.980225+0000 mgr.gibba020.yqfnwy (mgr.34427) 4381 : cluster [DBG] pgmap v2488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:36.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:36 gibba020 bash[25448]: cluster 2021-03-10T15:15:35.980225+0000 mgr.gibba020.yqfnwy (mgr.34427) 4381 : cluster [DBG] pgmap v2488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:37.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:37 gibba013 bash[29418]: cephadm 2021-03-10T15:15:36.964726+0000 mgr.gibba020.yqfnwy (mgr.34427) 4382 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:15:37.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:37 gibba013 bash[30381]: cephadm 2021-03-10T15:15:36.964726+0000 mgr.gibba020.yqfnwy (mgr.34427) 4382 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:15:37.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:37 gibba020 bash[25448]: cephadm 2021-03-10T15:15:36.964726+0000 mgr.gibba020.yqfnwy (mgr.34427) 4382 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:15:38.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:38 gibba013 bash[29418]: cluster 2021-03-10T15:15:37.981622+0000 mgr.gibba020.yqfnwy (mgr.34427) 4383 : cluster [DBG] pgmap v2489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:38.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:38 gibba013 bash[30381]: cluster 2021-03-10T15:15:37.981622+0000 mgr.gibba020.yqfnwy (mgr.34427) 4383 : cluster [DBG] pgmap v2489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:38.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:38 gibba020 bash[25448]: cluster 2021-03-10T15:15:37.981622+0000 mgr.gibba020.yqfnwy (mgr.34427) 4383 : cluster [DBG] pgmap v2489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:40.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:40 gibba013 bash[29418]: cluster 2021-03-10T15:15:39.983475+0000 mgr.gibba020.yqfnwy (mgr.34427) 4384 : cluster [DBG] pgmap v2490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:40.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:40 gibba013 bash[30381]: cluster 2021-03-10T15:15:39.983475+0000 mgr.gibba020.yqfnwy (mgr.34427) 4384 : cluster [DBG] pgmap v2490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:40.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:40 gibba020 bash[25448]: cluster 2021-03-10T15:15:39.983475+0000 mgr.gibba020.yqfnwy (mgr.34427) 4384 : cluster [DBG] pgmap v2490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:42.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:42 gibba013 bash[29418]: cluster 2021-03-10T15:15:41.984899+0000 mgr.gibba020.yqfnwy (mgr.34427) 4385 : cluster [DBG] pgmap v2491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:42.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:42 gibba013 bash[30381]: cluster 2021-03-10T15:15:41.984899+0000 mgr.gibba020.yqfnwy (mgr.34427) 4385 : cluster [DBG] pgmap v2491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:42.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:42 gibba020 bash[25448]: cluster 2021-03-10T15:15:41.984899+0000 mgr.gibba020.yqfnwy (mgr.34427) 4385 : cluster [DBG] pgmap v2491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:44.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:44 gibba013 bash[29418]: cluster 2021-03-10T15:15:43.986235+0000 mgr.gibba020.yqfnwy (mgr.34427) 4386 : cluster [DBG] pgmap v2492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:44.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:44 gibba013 bash[30381]: cluster 2021-03-10T15:15:43.986235+0000 mgr.gibba020.yqfnwy (mgr.34427) 4386 : cluster [DBG] pgmap v2492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:44.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:44 gibba020 bash[25448]: cluster 2021-03-10T15:15:43.986235+0000 mgr.gibba020.yqfnwy (mgr.34427) 4386 : cluster [DBG] pgmap v2492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:46.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:46 gibba013 bash[29418]: cluster 2021-03-10T15:15:45.988105+0000 mgr.gibba020.yqfnwy (mgr.34427) 4387 : cluster [DBG] pgmap v2493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:46.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:46 gibba013 bash[30381]: cluster 2021-03-10T15:15:45.988105+0000 mgr.gibba020.yqfnwy (mgr.34427) 4387 : cluster [DBG] pgmap v2493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:46.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:46 gibba020 bash[25448]: cluster 2021-03-10T15:15:45.988105+0000 mgr.gibba020.yqfnwy (mgr.34427) 4387 : cluster [DBG] pgmap v2493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:48.168 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:15:48.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:48 gibba013 bash[30381]: cluster 2021-03-10T15:15:47.989457+0000 mgr.gibba020.yqfnwy (mgr.34427) 4388 : cluster [DBG] pgmap v2494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:48.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:48 gibba013 bash[29418]: cluster 2021-03-10T15:15:47.989457+0000 mgr.gibba020.yqfnwy (mgr.34427) 4388 : cluster [DBG] pgmap v2494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:48.425 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:15:48.426 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (82m) 7m ago 87m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:15:48.426 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (87m) 5m ago 87m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:15:48.426 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (82m) 5m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:15:48.426 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (83m) 5m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:15:48.427 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (81m) 7m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:15:48.427 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (81m) 7m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:15:48.427 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (81m) 5m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:15:48.427 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (81m) 7m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:15:48.427 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (87m) 7m ago 87m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:15:48.428 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (87m) 5m ago 87m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:15:48.428 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (80m) 7m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:15:48.428 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (80m) 7m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:15:48.428 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (79m) 7m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:15:48.429 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (79m) 7m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:15:48.429 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (78m) 5m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:15:48.429 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (78m) 5m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:15:48.429 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (77m) 5m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:15:48.429 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (77m) 5m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:15:48.430 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (87m) 5m ago 87m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:15:48.430 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 5m ago 85m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:15:48.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:48 gibba020 bash[25448]: cluster 2021-03-10T15:15:47.989457+0000 mgr.gibba020.yqfnwy (mgr.34427) 4388 : cluster [DBG] pgmap v2494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:48.680 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:15:48.680 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:15:48.681 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:15:48.681 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:15:48.681 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:15:48.681 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:15:48.682 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:15:48.682 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:15:48.682 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:15:48.682 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:15:48.683 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:15:48.683 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:15:48.683 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:15:48.683 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:15:48.683 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:15:49.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:49 gibba013 bash[29418]: audit 2021-03-10T15:15:48.155446+0000 mgr.gibba020.yqfnwy (mgr.34427) 4389 : audit [DBG] from='client.47004 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:15:49.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:49 gibba013 bash[29418]: audit 2021-03-10T15:15:48.381096+0000 mgr.gibba020.yqfnwy (mgr.34427) 4390 : audit [DBG] from='client.47010 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:15:49.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:49 gibba013 bash[29418]: audit 2021-03-10T15:15:48.676771+0000 mon.a (mon.0) 1870 : audit [DBG] from='client.? 172.21.2.113:0/353289050' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:49.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:49 gibba013 bash[30381]: audit 2021-03-10T15:15:48.155446+0000 mgr.gibba020.yqfnwy (mgr.34427) 4389 : audit [DBG] from='client.47004 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:15:49.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:49 gibba013 bash[30381]: audit 2021-03-10T15:15:48.381096+0000 mgr.gibba020.yqfnwy (mgr.34427) 4390 : audit [DBG] from='client.47010 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:15:49.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:49 gibba013 bash[30381]: audit 2021-03-10T15:15:48.676771+0000 mon.a (mon.0) 1870 : audit [DBG] from='client.? 172.21.2.113:0/353289050' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:49.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:49 gibba020 bash[25448]: audit 2021-03-10T15:15:48.155446+0000 mgr.gibba020.yqfnwy (mgr.34427) 4389 : audit [DBG] from='client.47004 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:15:49.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:49 gibba020 bash[25448]: audit 2021-03-10T15:15:48.381096+0000 mgr.gibba020.yqfnwy (mgr.34427) 4390 : audit [DBG] from='client.47010 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:15:49.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:49 gibba020 bash[25448]: audit 2021-03-10T15:15:48.676771+0000 mon.a (mon.0) 1870 : audit [DBG] from='client.? 172.21.2.113:0/353289050' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:50.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:50 gibba013 bash[29418]: cluster 2021-03-10T15:15:49.991302+0000 mgr.gibba020.yqfnwy (mgr.34427) 4391 : cluster [DBG] pgmap v2495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:50.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:50 gibba013 bash[30381]: cluster 2021-03-10T15:15:49.991302+0000 mgr.gibba020.yqfnwy (mgr.34427) 4391 : cluster [DBG] pgmap v2495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:50.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:50 gibba020 bash[25448]: cluster 2021-03-10T15:15:49.991302+0000 mgr.gibba020.yqfnwy (mgr.34427) 4391 : cluster [DBG] pgmap v2495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:52.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:52 gibba013 bash[29418]: audit 2021-03-10T15:15:51.982508+0000 mon.a (mon.0) 1871 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:15:52.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:52 gibba013 bash[29418]: cluster 2021-03-10T15:15:51.992545+0000 mgr.gibba020.yqfnwy (mgr.34427) 4392 : cluster [DBG] pgmap v2496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:52.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:52 gibba013 bash[30381]: audit 2021-03-10T15:15:51.982508+0000 mon.a (mon.0) 1871 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:15:52.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:52 gibba013 bash[30381]: cluster 2021-03-10T15:15:51.992545+0000 mgr.gibba020.yqfnwy (mgr.34427) 4392 : cluster [DBG] pgmap v2496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:52.405 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:52 gibba020 bash[25448]: audit 2021-03-10T15:15:51.982508+0000 mon.a (mon.0) 1871 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:15:52.405 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:52 gibba020 bash[25448]: cluster 2021-03-10T15:15:51.992545+0000 mgr.gibba020.yqfnwy (mgr.34427) 4392 : cluster [DBG] pgmap v2496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:53.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:53 gibba020 bash[25448]: cephadm 2021-03-10T15:15:52.178844+0000 mgr.gibba020.yqfnwy (mgr.34427) 4393 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:15:53.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:53 gibba020 bash[25448]: audit 2021-03-10T15:15:52.179413+0000 mon.a (mon.0) 1872 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:15:53.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:53 gibba020 bash[25448]: cephadm 2021-03-10T15:15:52.182038+0000 mgr.gibba020.yqfnwy (mgr.34427) 4394 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:15:53.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:53 gibba020 bash[25448]: audit 2021-03-10T15:15:52.182177+0000 mon.a (mon.0) 1873 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:15:53.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:53 gibba020 bash[25448]: audit 2021-03-10T15:15:52.379190+0000 mon.a (mon.0) 1874 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:15:53.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:53 gibba020 bash[25448]: cephadm 2021-03-10T15:15:52.380894+0000 mgr.gibba020.yqfnwy (mgr.34427) 4395 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:15:53.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:53 gibba020 bash[25448]: audit 2021-03-10T15:15:52.383245+0000 mon.a (mon.0) 1875 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:15:53.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:53 gibba020 bash[25448]: cephadm 2021-03-10T15:15:52.384312+0000 mgr.gibba020.yqfnwy (mgr.34427) 4396 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:15:53.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:53 gibba020 bash[25448]: audit 2021-03-10T15:15:52.386103+0000 mon.a (mon.0) 1876 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:53.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:53 gibba020 bash[25448]: cephadm 2021-03-10T15:15:52.386872+0000 mgr.gibba020.yqfnwy (mgr.34427) 4397 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:15:53.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:53 gibba020 bash[25448]: cephadm 2021-03-10T15:15:52.386909+0000 mgr.gibba020.yqfnwy (mgr.34427) 4398 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:15:53.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:53 gibba020 bash[25448]: audit 2021-03-10T15:15:52.388663+0000 mon.a (mon.0) 1877 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:53.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:53 gibba020 bash[25448]: cephadm 2021-03-10T15:15:52.389411+0000 mgr.gibba020.yqfnwy (mgr.34427) 4399 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:15:53.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:53 gibba020 bash[25448]: cephadm 2021-03-10T15:15:52.389449+0000 mgr.gibba020.yqfnwy (mgr.34427) 4400 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:15:53.456 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:53 gibba020 bash[25448]: audit 2021-03-10T15:15:52.391349+0000 mon.a (mon.0) 1878 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:53.456 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:53 gibba020 bash[25448]: cephadm 2021-03-10T15:15:52.392198+0000 mgr.gibba020.yqfnwy (mgr.34427) 4401 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:15:53.456 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:53 gibba020 bash[25448]: cephadm 2021-03-10T15:15:52.394475+0000 mgr.gibba020.yqfnwy (mgr.34427) 4402 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:15:53.456 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:53 gibba020 bash[25448]: cephadm 2021-03-10T15:15:52.394511+0000 mgr.gibba020.yqfnwy (mgr.34427) 4403 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:15:53.457 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:53 gibba020 bash[25448]: audit 2021-03-10T15:15:52.396368+0000 mon.a (mon.0) 1879 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:53.457 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:53 gibba020 bash[25448]: cephadm 2021-03-10T15:15:52.397292+0000 mgr.gibba020.yqfnwy (mgr.34427) 4404 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:15:53.457 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:53 gibba020 bash[25448]: cephadm 2021-03-10T15:15:52.397605+0000 mgr.gibba020.yqfnwy (mgr.34427) 4405 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:15:53.457 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:53 gibba020 bash[25448]: audit 2021-03-10T15:15:52.399571+0000 mon.a (mon.0) 1880 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:53.458 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:53 gibba020 bash[25448]: cephadm 2021-03-10T15:15:52.400360+0000 mgr.gibba020.yqfnwy (mgr.34427) 4406 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:15:53.458 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:53 gibba020 bash[25448]: cephadm 2021-03-10T15:15:52.400396+0000 mgr.gibba020.yqfnwy (mgr.34427) 4407 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:15:53.458 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:53 gibba020 bash[25448]: cephadm 2021-03-10T15:15:52.400497+0000 mgr.gibba020.yqfnwy (mgr.34427) 4408 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:15:53.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[29418]: cephadm 2021-03-10T15:15:52.178844+0000 mgr.gibba020.yqfnwy (mgr.34427) 4393 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:15:53.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[29418]: audit 2021-03-10T15:15:52.179413+0000 mon.a (mon.0) 1872 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:15:53.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[29418]: cephadm 2021-03-10T15:15:52.182038+0000 mgr.gibba020.yqfnwy (mgr.34427) 4394 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:15:53.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[29418]: audit 2021-03-10T15:15:52.182177+0000 mon.a (mon.0) 1873 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:15:53.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[29418]: audit 2021-03-10T15:15:52.379190+0000 mon.a (mon.0) 1874 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:15:53.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[29418]: cephadm 2021-03-10T15:15:52.380894+0000 mgr.gibba020.yqfnwy (mgr.34427) 4395 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:15:53.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[29418]: audit 2021-03-10T15:15:52.383245+0000 mon.a (mon.0) 1875 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:15:53.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[29418]: cephadm 2021-03-10T15:15:52.384312+0000 mgr.gibba020.yqfnwy (mgr.34427) 4396 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:15:53.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[29418]: audit 2021-03-10T15:15:52.386103+0000 mon.a (mon.0) 1876 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:53.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[29418]: cephadm 2021-03-10T15:15:52.386872+0000 mgr.gibba020.yqfnwy (mgr.34427) 4397 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:15:53.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[29418]: cephadm 2021-03-10T15:15:52.386909+0000 mgr.gibba020.yqfnwy (mgr.34427) 4398 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:15:53.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[29418]: audit 2021-03-10T15:15:52.388663+0000 mon.a (mon.0) 1877 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:53.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[29418]: cephadm 2021-03-10T15:15:52.389411+0000 mgr.gibba020.yqfnwy (mgr.34427) 4399 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:15:53.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[29418]: cephadm 2021-03-10T15:15:52.389449+0000 mgr.gibba020.yqfnwy (mgr.34427) 4400 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:15:53.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[29418]: audit 2021-03-10T15:15:52.391349+0000 mon.a (mon.0) 1878 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:53.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[29418]: cephadm 2021-03-10T15:15:52.392198+0000 mgr.gibba020.yqfnwy (mgr.34427) 4401 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:15:53.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[29418]: cephadm 2021-03-10T15:15:52.394475+0000 mgr.gibba020.yqfnwy (mgr.34427) 4402 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:15:53.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[29418]: cephadm 2021-03-10T15:15:52.394511+0000 mgr.gibba020.yqfnwy (mgr.34427) 4403 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:15:53.639 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[29418]: audit 2021-03-10T15:15:52.396368+0000 mon.a (mon.0) 1879 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:53.639 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[29418]: cephadm 2021-03-10T15:15:52.397292+0000 mgr.gibba020.yqfnwy (mgr.34427) 4404 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:15:53.639 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[29418]: cephadm 2021-03-10T15:15:52.397605+0000 mgr.gibba020.yqfnwy (mgr.34427) 4405 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:15:53.639 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[29418]: audit 2021-03-10T15:15:52.399571+0000 mon.a (mon.0) 1880 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:53.639 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[29418]: cephadm 2021-03-10T15:15:52.400360+0000 mgr.gibba020.yqfnwy (mgr.34427) 4406 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:15:53.640 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[29418]: cephadm 2021-03-10T15:15:52.400396+0000 mgr.gibba020.yqfnwy (mgr.34427) 4407 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:15:53.640 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[29418]: cephadm 2021-03-10T15:15:52.400497+0000 mgr.gibba020.yqfnwy (mgr.34427) 4408 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:15:53.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[30381]: cephadm 2021-03-10T15:15:52.178844+0000 mgr.gibba020.yqfnwy (mgr.34427) 4393 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:15:53.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[30381]: audit 2021-03-10T15:15:52.179413+0000 mon.a (mon.0) 1872 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:15:53.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[30381]: cephadm 2021-03-10T15:15:52.182038+0000 mgr.gibba020.yqfnwy (mgr.34427) 4394 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:15:53.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[30381]: audit 2021-03-10T15:15:52.182177+0000 mon.a (mon.0) 1873 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:15:53.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[30381]: audit 2021-03-10T15:15:52.379190+0000 mon.a (mon.0) 1874 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:15:53.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[30381]: cephadm 2021-03-10T15:15:52.380894+0000 mgr.gibba020.yqfnwy (mgr.34427) 4395 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:15:53.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[30381]: audit 2021-03-10T15:15:52.383245+0000 mon.a (mon.0) 1875 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:15:53.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[30381]: cephadm 2021-03-10T15:15:52.384312+0000 mgr.gibba020.yqfnwy (mgr.34427) 4396 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:15:53.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[30381]: audit 2021-03-10T15:15:52.386103+0000 mon.a (mon.0) 1876 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:53.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[30381]: cephadm 2021-03-10T15:15:52.386872+0000 mgr.gibba020.yqfnwy (mgr.34427) 4397 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:15:53.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[30381]: cephadm 2021-03-10T15:15:52.386909+0000 mgr.gibba020.yqfnwy (mgr.34427) 4398 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:15:53.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[30381]: audit 2021-03-10T15:15:52.388663+0000 mon.a (mon.0) 1877 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:53.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[30381]: cephadm 2021-03-10T15:15:52.389411+0000 mgr.gibba020.yqfnwy (mgr.34427) 4399 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:15:53.644 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[30381]: cephadm 2021-03-10T15:15:52.389449+0000 mgr.gibba020.yqfnwy (mgr.34427) 4400 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:15:53.644 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[30381]: audit 2021-03-10T15:15:52.391349+0000 mon.a (mon.0) 1878 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:53.644 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[30381]: cephadm 2021-03-10T15:15:52.392198+0000 mgr.gibba020.yqfnwy (mgr.34427) 4401 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:15:53.644 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[30381]: cephadm 2021-03-10T15:15:52.394475+0000 mgr.gibba020.yqfnwy (mgr.34427) 4402 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:15:53.645 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[30381]: cephadm 2021-03-10T15:15:52.394511+0000 mgr.gibba020.yqfnwy (mgr.34427) 4403 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:15:53.645 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[30381]: audit 2021-03-10T15:15:52.396368+0000 mon.a (mon.0) 1879 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:53.645 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[30381]: cephadm 2021-03-10T15:15:52.397292+0000 mgr.gibba020.yqfnwy (mgr.34427) 4404 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:15:53.645 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[30381]: cephadm 2021-03-10T15:15:52.397605+0000 mgr.gibba020.yqfnwy (mgr.34427) 4405 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:15:53.645 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[30381]: audit 2021-03-10T15:15:52.399571+0000 mon.a (mon.0) 1880 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:15:53.646 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[30381]: cephadm 2021-03-10T15:15:52.400360+0000 mgr.gibba020.yqfnwy (mgr.34427) 4406 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:15:53.646 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[30381]: cephadm 2021-03-10T15:15:52.400396+0000 mgr.gibba020.yqfnwy (mgr.34427) 4407 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:15:53.646 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:53 gibba013 bash[30381]: cephadm 2021-03-10T15:15:52.400497+0000 mgr.gibba020.yqfnwy (mgr.34427) 4408 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:15:54.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:54 gibba020 bash[25448]: cluster 2021-03-10T15:15:53.993939+0000 mgr.gibba020.yqfnwy (mgr.34427) 4409 : cluster [DBG] pgmap v2497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:54.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:54 gibba013 bash[29418]: cluster 2021-03-10T15:15:53.993939+0000 mgr.gibba020.yqfnwy (mgr.34427) 4409 : cluster [DBG] pgmap v2497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:54.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:54 gibba013 bash[30381]: cluster 2021-03-10T15:15:53.993939+0000 mgr.gibba020.yqfnwy (mgr.34427) 4409 : cluster [DBG] pgmap v2497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:56.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:56 gibba013 bash[29418]: cluster 2021-03-10T15:15:55.995751+0000 mgr.gibba020.yqfnwy (mgr.34427) 4410 : cluster [DBG] pgmap v2498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:56.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:56 gibba013 bash[30381]: cluster 2021-03-10T15:15:55.995751+0000 mgr.gibba020.yqfnwy (mgr.34427) 4410 : cluster [DBG] pgmap v2498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:56.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:56 gibba020 bash[25448]: cluster 2021-03-10T15:15:55.995751+0000 mgr.gibba020.yqfnwy (mgr.34427) 4410 : cluster [DBG] pgmap v2498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:58.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:15:58 gibba013 bash[29418]: cluster 2021-03-10T15:15:57.996999+0000 mgr.gibba020.yqfnwy (mgr.34427) 4411 : cluster [DBG] pgmap v2499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:58.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:15:58 gibba013 bash[30381]: cluster 2021-03-10T15:15:57.996999+0000 mgr.gibba020.yqfnwy (mgr.34427) 4411 : cluster [DBG] pgmap v2499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:15:58.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:15:58 gibba020 bash[25448]: cluster 2021-03-10T15:15:57.996999+0000 mgr.gibba020.yqfnwy (mgr.34427) 4411 : cluster [DBG] pgmap v2499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:00.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:00 gibba013 bash[29418]: cluster 2021-03-10T15:15:59.998842+0000 mgr.gibba020.yqfnwy (mgr.34427) 4412 : cluster [DBG] pgmap v2500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:00.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:00 gibba013 bash[30381]: cluster 2021-03-10T15:15:59.998842+0000 mgr.gibba020.yqfnwy (mgr.34427) 4412 : cluster [DBG] pgmap v2500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:00.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:00 gibba020 bash[25448]: cluster 2021-03-10T15:15:59.998842+0000 mgr.gibba020.yqfnwy (mgr.34427) 4412 : cluster [DBG] pgmap v2500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:02.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:02 gibba013 bash[29418]: cluster 2021-03-10T15:16:02.000377+0000 mgr.gibba020.yqfnwy (mgr.34427) 4413 : cluster [DBG] pgmap v2501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:02.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:02 gibba013 bash[30381]: cluster 2021-03-10T15:16:02.000377+0000 mgr.gibba020.yqfnwy (mgr.34427) 4413 : cluster [DBG] pgmap v2501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:02.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:02 gibba020 bash[25448]: cluster 2021-03-10T15:16:02.000377+0000 mgr.gibba020.yqfnwy (mgr.34427) 4413 : cluster [DBG] pgmap v2501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:04.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:04 gibba013 bash[29418]: cluster 2021-03-10T15:16:04.001906+0000 mgr.gibba020.yqfnwy (mgr.34427) 4414 : cluster [DBG] pgmap v2502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:04.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:04 gibba013 bash[30381]: cluster 2021-03-10T15:16:04.001906+0000 mgr.gibba020.yqfnwy (mgr.34427) 4414 : cluster [DBG] pgmap v2502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:04.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:04 gibba020 bash[25448]: cluster 2021-03-10T15:16:04.001906+0000 mgr.gibba020.yqfnwy (mgr.34427) 4414 : cluster [DBG] pgmap v2502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:06.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:06 gibba013 bash[29418]: cluster 2021-03-10T15:16:06.003743+0000 mgr.gibba020.yqfnwy (mgr.34427) 4415 : cluster [DBG] pgmap v2503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:06.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:06 gibba013 bash[30381]: cluster 2021-03-10T15:16:06.003743+0000 mgr.gibba020.yqfnwy (mgr.34427) 4415 : cluster [DBG] pgmap v2503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:06.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:06 gibba020 bash[25448]: cluster 2021-03-10T15:16:06.003743+0000 mgr.gibba020.yqfnwy (mgr.34427) 4415 : cluster [DBG] pgmap v2503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:07.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:07 gibba013 bash[29418]: audit 2021-03-10T15:16:06.390551+0000 mon.a (mon.0) 1881 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:16:07.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:07 gibba013 bash[29418]: audit 2021-03-10T15:16:06.437684+0000 mon.a (mon.0) 1882 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:16:07.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:07 gibba013 bash[29418]: audit 2021-03-10T15:16:06.527929+0000 mon.a (mon.0) 1883 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:16:07.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:07 gibba013 bash[29418]: audit 2021-03-10T15:16:06.528663+0000 mon.a (mon.0) 1884 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:16:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:07 gibba013 bash[29418]: audit 2021-03-10T15:16:06.529356+0000 mon.a (mon.0) 1885 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T15:16:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:07 gibba013 bash[29418]: audit 2021-03-10T15:16:06.530039+0000 mon.a (mon.0) 1886 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:16:07.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:07 gibba013 bash[30381]: audit 2021-03-10T15:16:06.390551+0000 mon.a (mon.0) 1881 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:16:07.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:07 gibba013 bash[30381]: audit 2021-03-10T15:16:06.437684+0000 mon.a (mon.0) 1882 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:16:07.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:07 gibba013 bash[30381]: audit 2021-03-10T15:16:06.527929+0000 mon.a (mon.0) 1883 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:16:07.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:07 gibba013 bash[30381]: audit 2021-03-10T15:16:06.528663+0000 mon.a (mon.0) 1884 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:16:07.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:07 gibba013 bash[30381]: audit 2021-03-10T15:16:06.529356+0000 mon.a (mon.0) 1885 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T15:16:07.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:07 gibba013 bash[30381]: audit 2021-03-10T15:16:06.530039+0000 mon.a (mon.0) 1886 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:16:07.421 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:07 gibba020 bash[25448]: audit 2021-03-10T15:16:06.390551+0000 mon.a (mon.0) 1881 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:16:07.422 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:07 gibba020 bash[25448]: audit 2021-03-10T15:16:06.437684+0000 mon.a (mon.0) 1882 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:16:07.422 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:07 gibba020 bash[25448]: audit 2021-03-10T15:16:06.527929+0000 mon.a (mon.0) 1883 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:16:07.422 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:07 gibba020 bash[25448]: audit 2021-03-10T15:16:06.528663+0000 mon.a (mon.0) 1884 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:16:07.422 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:07 gibba020 bash[25448]: audit 2021-03-10T15:16:06.529356+0000 mon.a (mon.0) 1885 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T15:16:07.423 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:07 gibba020 bash[25448]: audit 2021-03-10T15:16:06.530039+0000 mon.a (mon.0) 1886 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:16:08.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:08 gibba013 bash[29418]: cephadm 2021-03-10T15:16:07.416584+0000 mgr.gibba020.yqfnwy (mgr.34427) 4416 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:16:08.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:08 gibba013 bash[29418]: cluster 2021-03-10T15:16:08.004869+0000 mgr.gibba020.yqfnwy (mgr.34427) 4417 : cluster [DBG] pgmap v2504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:08.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:08 gibba013 bash[30381]: cephadm 2021-03-10T15:16:07.416584+0000 mgr.gibba020.yqfnwy (mgr.34427) 4416 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:16:08.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:08 gibba013 bash[30381]: cluster 2021-03-10T15:16:08.004869+0000 mgr.gibba020.yqfnwy (mgr.34427) 4417 : cluster [DBG] pgmap v2504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:08.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:08 gibba020 bash[25448]: cephadm 2021-03-10T15:16:07.416584+0000 mgr.gibba020.yqfnwy (mgr.34427) 4416 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:16:08.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:08 gibba020 bash[25448]: cluster 2021-03-10T15:16:08.004869+0000 mgr.gibba020.yqfnwy (mgr.34427) 4417 : cluster [DBG] pgmap v2504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:10.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:10 gibba013 bash[29418]: cluster 2021-03-10T15:16:10.006293+0000 mgr.gibba020.yqfnwy (mgr.34427) 4418 : cluster [DBG] pgmap v2505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:10.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:10 gibba013 bash[30381]: cluster 2021-03-10T15:16:10.006293+0000 mgr.gibba020.yqfnwy (mgr.34427) 4418 : cluster [DBG] pgmap v2505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:10.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:10 gibba020 bash[25448]: cluster 2021-03-10T15:16:10.006293+0000 mgr.gibba020.yqfnwy (mgr.34427) 4418 : cluster [DBG] pgmap v2505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:12.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:12 gibba013 bash[29418]: cluster 2021-03-10T15:16:12.007636+0000 mgr.gibba020.yqfnwy (mgr.34427) 4419 : cluster [DBG] pgmap v2506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:12.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:12 gibba013 bash[30381]: cluster 2021-03-10T15:16:12.007636+0000 mgr.gibba020.yqfnwy (mgr.34427) 4419 : cluster [DBG] pgmap v2506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:12.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:12 gibba020 bash[25448]: cluster 2021-03-10T15:16:12.007636+0000 mgr.gibba020.yqfnwy (mgr.34427) 4419 : cluster [DBG] pgmap v2506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:14.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:14 gibba013 bash[29418]: cluster 2021-03-10T15:16:14.009298+0000 mgr.gibba020.yqfnwy (mgr.34427) 4420 : cluster [DBG] pgmap v2507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:14.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:14 gibba013 bash[30381]: cluster 2021-03-10T15:16:14.009298+0000 mgr.gibba020.yqfnwy (mgr.34427) 4420 : cluster [DBG] pgmap v2507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:14.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:14 gibba020 bash[25448]: cluster 2021-03-10T15:16:14.009298+0000 mgr.gibba020.yqfnwy (mgr.34427) 4420 : cluster [DBG] pgmap v2507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:16.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:16 gibba013 bash[29418]: cluster 2021-03-10T15:16:16.011132+0000 mgr.gibba020.yqfnwy (mgr.34427) 4421 : cluster [DBG] pgmap v2508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:16.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:16 gibba013 bash[30381]: cluster 2021-03-10T15:16:16.011132+0000 mgr.gibba020.yqfnwy (mgr.34427) 4421 : cluster [DBG] pgmap v2508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:16.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:16 gibba020 bash[25448]: cluster 2021-03-10T15:16:16.011132+0000 mgr.gibba020.yqfnwy (mgr.34427) 4421 : cluster [DBG] pgmap v2508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:18.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:18 gibba013 bash[29418]: cluster 2021-03-10T15:16:18.012590+0000 mgr.gibba020.yqfnwy (mgr.34427) 4422 : cluster [DBG] pgmap v2509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:18.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:18 gibba013 bash[30381]: cluster 2021-03-10T15:16:18.012590+0000 mgr.gibba020.yqfnwy (mgr.34427) 4422 : cluster [DBG] pgmap v2509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:18.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:18 gibba020 bash[25448]: cluster 2021-03-10T15:16:18.012590+0000 mgr.gibba020.yqfnwy (mgr.34427) 4422 : cluster [DBG] pgmap v2509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:18.927 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:16:19.156 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:16:19.156 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (82m) 7m ago 88m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:16:19.157 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (88m) 6m ago 88m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:16:19.157 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (83m) 6m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:16:19.157 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (83m) 6m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:16:19.157 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (82m) 7m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:16:19.158 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (82m) 7m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:16:19.158 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (81m) 6m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:16:19.158 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (82m) 7m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:16:19.158 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (88m) 7m ago 88m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:16:19.159 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (88m) 6m ago 88m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:16:19.159 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (81m) 7m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:16:19.159 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (80m) 7m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:16:19.159 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (80m) 7m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:16:19.159 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (79m) 7m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:16:19.160 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (79m) 6m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:16:19.160 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (78m) 6m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:16:19.160 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (78m) 6m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:16:19.160 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (78m) 6m ago 88m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:16:19.161 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (87m) 6m ago 88m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:16:19.161 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 6m ago 86m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:16:19.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:19 gibba013 bash[29418]: audit 2021-03-10T15:16:18.913424+0000 mgr.gibba020.yqfnwy (mgr.34427) 4423 : audit [DBG] from='client.47022 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:16:19.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:19 gibba013 bash[30381]: audit 2021-03-10T15:16:18.913424+0000 mgr.gibba020.yqfnwy (mgr.34427) 4423 : audit [DBG] from='client.47022 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:16:19.409 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:16:19.409 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:16:19.410 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:16:19.410 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:16:19.410 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:16:19.410 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:16:19.411 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:16:19.411 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:16:19.411 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:16:19.411 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:16:19.411 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:16:19.412 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:16:19.412 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:16:19.412 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:16:19.412 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:16:19.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:19 gibba020 bash[25448]: audit 2021-03-10T15:16:18.913424+0000 mgr.gibba020.yqfnwy (mgr.34427) 4423 : audit [DBG] from='client.47022 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:16:20.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:20 gibba013 bash[29418]: audit 2021-03-10T15:16:19.140893+0000 mgr.gibba020.yqfnwy (mgr.34427) 4424 : audit [DBG] from='client.47028 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:16:20.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:20 gibba013 bash[29418]: audit 2021-03-10T15:16:19.406215+0000 mon.a (mon.0) 1887 : audit [DBG] from='client.? 172.21.2.113:0/2469310673' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:20.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:20 gibba013 bash[29418]: cluster 2021-03-10T15:16:20.013368+0000 mgr.gibba020.yqfnwy (mgr.34427) 4425 : cluster [DBG] pgmap v2510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:20.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:20 gibba013 bash[30381]: audit 2021-03-10T15:16:19.140893+0000 mgr.gibba020.yqfnwy (mgr.34427) 4424 : audit [DBG] from='client.47028 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:16:20.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:20 gibba013 bash[30381]: audit 2021-03-10T15:16:19.406215+0000 mon.a (mon.0) 1887 : audit [DBG] from='client.? 172.21.2.113:0/2469310673' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:20.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:20 gibba013 bash[30381]: cluster 2021-03-10T15:16:20.013368+0000 mgr.gibba020.yqfnwy (mgr.34427) 4425 : cluster [DBG] pgmap v2510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:20.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:20 gibba020 bash[25448]: audit 2021-03-10T15:16:19.140893+0000 mgr.gibba020.yqfnwy (mgr.34427) 4424 : audit [DBG] from='client.47028 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:16:20.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:20 gibba020 bash[25448]: audit 2021-03-10T15:16:19.406215+0000 mon.a (mon.0) 1887 : audit [DBG] from='client.? 172.21.2.113:0/2469310673' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:20.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:20 gibba020 bash[25448]: cluster 2021-03-10T15:16:20.013368+0000 mgr.gibba020.yqfnwy (mgr.34427) 4425 : cluster [DBG] pgmap v2510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:22.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:22 gibba013 bash[29418]: cluster 2021-03-10T15:16:22.014716+0000 mgr.gibba020.yqfnwy (mgr.34427) 4426 : cluster [DBG] pgmap v2511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:22.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:22 gibba013 bash[30381]: cluster 2021-03-10T15:16:22.014716+0000 mgr.gibba020.yqfnwy (mgr.34427) 4426 : cluster [DBG] pgmap v2511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:22.438 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:22 gibba020 bash[25448]: cluster 2021-03-10T15:16:22.014716+0000 mgr.gibba020.yqfnwy (mgr.34427) 4426 : cluster [DBG] pgmap v2511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:23.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:23 gibba013 bash[29418]: cephadm 2021-03-10T15:16:22.432747+0000 mgr.gibba020.yqfnwy (mgr.34427) 4427 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:16:23.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:23 gibba013 bash[30381]: cephadm 2021-03-10T15:16:22.432747+0000 mgr.gibba020.yqfnwy (mgr.34427) 4427 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:16:23.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:23 gibba020 bash[25448]: cephadm 2021-03-10T15:16:22.432747+0000 mgr.gibba020.yqfnwy (mgr.34427) 4427 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:16:25.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:25 gibba013 bash[29418]: cluster 2021-03-10T15:16:24.016254+0000 mgr.gibba020.yqfnwy (mgr.34427) 4428 : cluster [DBG] pgmap v2512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:25.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:25 gibba013 bash[30381]: cluster 2021-03-10T15:16:24.016254+0000 mgr.gibba020.yqfnwy (mgr.34427) 4428 : cluster [DBG] pgmap v2512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:25.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:25 gibba020 bash[25448]: cluster 2021-03-10T15:16:24.016254+0000 mgr.gibba020.yqfnwy (mgr.34427) 4428 : cluster [DBG] pgmap v2512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:27.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:27 gibba013 bash[29418]: cluster 2021-03-10T15:16:26.017952+0000 mgr.gibba020.yqfnwy (mgr.34427) 4429 : cluster [DBG] pgmap v2513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:27.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:27 gibba013 bash[30381]: cluster 2021-03-10T15:16:26.017952+0000 mgr.gibba020.yqfnwy (mgr.34427) 4429 : cluster [DBG] pgmap v2513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:27.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:27 gibba020 bash[25448]: cluster 2021-03-10T15:16:26.017952+0000 mgr.gibba020.yqfnwy (mgr.34427) 4429 : cluster [DBG] pgmap v2513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:29.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:29 gibba013 bash[29418]: cluster 2021-03-10T15:16:28.019289+0000 mgr.gibba020.yqfnwy (mgr.34427) 4430 : cluster [DBG] pgmap v2514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:29.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:29 gibba013 bash[30381]: cluster 2021-03-10T15:16:28.019289+0000 mgr.gibba020.yqfnwy (mgr.34427) 4430 : cluster [DBG] pgmap v2514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:29.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:29 gibba020 bash[25448]: cluster 2021-03-10T15:16:28.019289+0000 mgr.gibba020.yqfnwy (mgr.34427) 4430 : cluster [DBG] pgmap v2514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:31.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:31 gibba013 bash[29418]: cluster 2021-03-10T15:16:30.020124+0000 mgr.gibba020.yqfnwy (mgr.34427) 4431 : cluster [DBG] pgmap v2515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:31.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:31 gibba013 bash[30381]: cluster 2021-03-10T15:16:30.020124+0000 mgr.gibba020.yqfnwy (mgr.34427) 4431 : cluster [DBG] pgmap v2515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:31.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:31 gibba020 bash[25448]: cluster 2021-03-10T15:16:30.020124+0000 mgr.gibba020.yqfnwy (mgr.34427) 4431 : cluster [DBG] pgmap v2515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:33.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:33 gibba013 bash[29418]: cluster 2021-03-10T15:16:32.021229+0000 mgr.gibba020.yqfnwy (mgr.34427) 4432 : cluster [DBG] pgmap v2516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:33.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:33 gibba013 bash[30381]: cluster 2021-03-10T15:16:32.021229+0000 mgr.gibba020.yqfnwy (mgr.34427) 4432 : cluster [DBG] pgmap v2516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:33.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:33 gibba020 bash[25448]: cluster 2021-03-10T15:16:32.021229+0000 mgr.gibba020.yqfnwy (mgr.34427) 4432 : cluster [DBG] pgmap v2516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:35.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:35 gibba013 bash[29418]: cluster 2021-03-10T15:16:34.022626+0000 mgr.gibba020.yqfnwy (mgr.34427) 4433 : cluster [DBG] pgmap v2517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:35.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:35 gibba013 bash[30381]: cluster 2021-03-10T15:16:34.022626+0000 mgr.gibba020.yqfnwy (mgr.34427) 4433 : cluster [DBG] pgmap v2517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:35.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:35 gibba020 bash[25448]: cluster 2021-03-10T15:16:34.022626+0000 mgr.gibba020.yqfnwy (mgr.34427) 4433 : cluster [DBG] pgmap v2517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:37.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:37 gibba020 bash[25448]: cluster 2021-03-10T15:16:36.024493+0000 mgr.gibba020.yqfnwy (mgr.34427) 4434 : cluster [DBG] pgmap v2518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:37.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:37 gibba013 bash[29418]: cluster 2021-03-10T15:16:36.024493+0000 mgr.gibba020.yqfnwy (mgr.34427) 4434 : cluster [DBG] pgmap v2518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:37.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:37 gibba013 bash[30381]: cluster 2021-03-10T15:16:36.024493+0000 mgr.gibba020.yqfnwy (mgr.34427) 4434 : cluster [DBG] pgmap v2518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:38.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:38 gibba020 bash[25448]: cephadm 2021-03-10T15:16:37.448582+0000 mgr.gibba020.yqfnwy (mgr.34427) 4435 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:16:38.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:38 gibba013 bash[29418]: cephadm 2021-03-10T15:16:37.448582+0000 mgr.gibba020.yqfnwy (mgr.34427) 4435 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:16:38.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:38 gibba013 bash[30381]: cephadm 2021-03-10T15:16:37.448582+0000 mgr.gibba020.yqfnwy (mgr.34427) 4435 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:16:39.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:39 gibba020 bash[25448]: cluster 2021-03-10T15:16:38.025704+0000 mgr.gibba020.yqfnwy (mgr.34427) 4436 : cluster [DBG] pgmap v2519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:39.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:39 gibba013 bash[29418]: cluster 2021-03-10T15:16:38.025704+0000 mgr.gibba020.yqfnwy (mgr.34427) 4436 : cluster [DBG] pgmap v2519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:39.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:39 gibba013 bash[30381]: cluster 2021-03-10T15:16:38.025704+0000 mgr.gibba020.yqfnwy (mgr.34427) 4436 : cluster [DBG] pgmap v2519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:41.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:41 gibba020 bash[25448]: cluster 2021-03-10T15:16:40.026556+0000 mgr.gibba020.yqfnwy (mgr.34427) 4437 : cluster [DBG] pgmap v2520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:41.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:41 gibba013 bash[29418]: cluster 2021-03-10T15:16:40.026556+0000 mgr.gibba020.yqfnwy (mgr.34427) 4437 : cluster [DBG] pgmap v2520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:41.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:41 gibba013 bash[30381]: cluster 2021-03-10T15:16:40.026556+0000 mgr.gibba020.yqfnwy (mgr.34427) 4437 : cluster [DBG] pgmap v2520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:43.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:43 gibba020 bash[25448]: cluster 2021-03-10T15:16:42.027777+0000 mgr.gibba020.yqfnwy (mgr.34427) 4438 : cluster [DBG] pgmap v2521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:43.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:43 gibba013 bash[29418]: cluster 2021-03-10T15:16:42.027777+0000 mgr.gibba020.yqfnwy (mgr.34427) 4438 : cluster [DBG] pgmap v2521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:43.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:43 gibba013 bash[30381]: cluster 2021-03-10T15:16:42.027777+0000 mgr.gibba020.yqfnwy (mgr.34427) 4438 : cluster [DBG] pgmap v2521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:45.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:45 gibba020 bash[25448]: cluster 2021-03-10T15:16:44.029291+0000 mgr.gibba020.yqfnwy (mgr.34427) 4439 : cluster [DBG] pgmap v2522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:45.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:45 gibba013 bash[29418]: cluster 2021-03-10T15:16:44.029291+0000 mgr.gibba020.yqfnwy (mgr.34427) 4439 : cluster [DBG] pgmap v2522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:45.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:45 gibba013 bash[30381]: cluster 2021-03-10T15:16:44.029291+0000 mgr.gibba020.yqfnwy (mgr.34427) 4439 : cluster [DBG] pgmap v2522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:47.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:47 gibba020 bash[25448]: cluster 2021-03-10T15:16:46.030886+0000 mgr.gibba020.yqfnwy (mgr.34427) 4440 : cluster [DBG] pgmap v2523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:47.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:47 gibba013 bash[29418]: cluster 2021-03-10T15:16:46.030886+0000 mgr.gibba020.yqfnwy (mgr.34427) 4440 : cluster [DBG] pgmap v2523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:47.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:47 gibba013 bash[30381]: cluster 2021-03-10T15:16:46.030886+0000 mgr.gibba020.yqfnwy (mgr.34427) 4440 : cluster [DBG] pgmap v2523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:49.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:49 gibba013 bash[29418]: cluster 2021-03-10T15:16:48.032286+0000 mgr.gibba020.yqfnwy (mgr.34427) 4441 : cluster [DBG] pgmap v2524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:49.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:49 gibba013 bash[30381]: cluster 2021-03-10T15:16:48.032286+0000 mgr.gibba020.yqfnwy (mgr.34427) 4441 : cluster [DBG] pgmap v2524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:49.655 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:16:49.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:49 gibba020 bash[25448]: cluster 2021-03-10T15:16:48.032286+0000 mgr.gibba020.yqfnwy (mgr.34427) 4441 : cluster [DBG] pgmap v2524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:49.884 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:16:49.885 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (83m) 8m ago 88m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:16:49.885 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (88m) 6m ago 88m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:16:49.885 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (83m) 6m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:16:49.885 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (84m) 6m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:16:49.885 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (82m) 8m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:16:49.886 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (82m) 8m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:16:49.886 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (82m) 6m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:16:49.886 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (82m) 8m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:16:49.886 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (88m) 8m ago 88m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:16:49.887 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (88m) 6m ago 88m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:16:49.887 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (81m) 8m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:16:49.887 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (81m) 8m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:16:49.887 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (80m) 8m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:16:49.887 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (80m) 8m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:16:49.888 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (79m) 6m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:16:49.888 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (79m) 6m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:16:49.888 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (79m) 6m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:16:49.888 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (78m) 6m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:16:49.888 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (88m) 6m ago 88m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:16:49.889 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 6m ago 86m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:16:50.135 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:16:50.135 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:16:50.136 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:16:50.136 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:16:50.136 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:16:50.136 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:16:50.137 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:16:50.137 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:16:50.137 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:16:50.137 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:16:50.137 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:16:50.138 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:16:50.138 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:16:50.138 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:16:50.138 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:16:50.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:50 gibba013 bash[29418]: audit 2021-03-10T15:16:49.641222+0000 mgr.gibba020.yqfnwy (mgr.34427) 4442 : audit [DBG] from='client.57025 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:16:50.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:50 gibba013 bash[29418]: audit 2021-03-10T15:16:49.867511+0000 mgr.gibba020.yqfnwy (mgr.34427) 4443 : audit [DBG] from='client.47046 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:16:50.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:50 gibba013 bash[29418]: audit 2021-03-10T15:16:50.131926+0000 mon.a (mon.0) 1888 : audit [DBG] from='client.? 172.21.2.113:0/24651151' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:50.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:50 gibba013 bash[30381]: audit 2021-03-10T15:16:49.641222+0000 mgr.gibba020.yqfnwy (mgr.34427) 4442 : audit [DBG] from='client.57025 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:16:50.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:50 gibba013 bash[30381]: audit 2021-03-10T15:16:49.867511+0000 mgr.gibba020.yqfnwy (mgr.34427) 4443 : audit [DBG] from='client.47046 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:16:50.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:50 gibba013 bash[30381]: audit 2021-03-10T15:16:50.131926+0000 mon.a (mon.0) 1888 : audit [DBG] from='client.? 172.21.2.113:0/24651151' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:50.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:50 gibba020 bash[25448]: audit 2021-03-10T15:16:49.641222+0000 mgr.gibba020.yqfnwy (mgr.34427) 4442 : audit [DBG] from='client.57025 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:16:50.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:50 gibba020 bash[25448]: audit 2021-03-10T15:16:49.867511+0000 mgr.gibba020.yqfnwy (mgr.34427) 4443 : audit [DBG] from='client.47046 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:16:50.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:50 gibba020 bash[25448]: audit 2021-03-10T15:16:50.131926+0000 mon.a (mon.0) 1888 : audit [DBG] from='client.? 172.21.2.113:0/24651151' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:51.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:51 gibba013 bash[29418]: cluster 2021-03-10T15:16:50.033242+0000 mgr.gibba020.yqfnwy (mgr.34427) 4444 : cluster [DBG] pgmap v2525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:51.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:51 gibba013 bash[30381]: cluster 2021-03-10T15:16:50.033242+0000 mgr.gibba020.yqfnwy (mgr.34427) 4444 : cluster [DBG] pgmap v2525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:51.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:51 gibba020 bash[25448]: cluster 2021-03-10T15:16:50.033242+0000 mgr.gibba020.yqfnwy (mgr.34427) 4444 : cluster [DBG] pgmap v2525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:53.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[29418]: cluster 2021-03-10T15:16:52.034590+0000 mgr.gibba020.yqfnwy (mgr.34427) 4445 : cluster [DBG] pgmap v2526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:53.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[29418]: audit 2021-03-10T15:16:52.453249+0000 mon.a (mon.0) 1889 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:16:53.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[29418]: cephadm 2021-03-10T15:16:52.457828+0000 mgr.gibba020.yqfnwy (mgr.34427) 4446 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:16:53.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[29418]: cephadm 2021-03-10T15:16:52.459922+0000 mgr.gibba020.yqfnwy (mgr.34427) 4447 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:16:53.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[29418]: audit 2021-03-10T15:16:52.675601+0000 mon.a (mon.0) 1890 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:16:53.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[29418]: cephadm 2021-03-10T15:16:52.677090+0000 mgr.gibba020.yqfnwy (mgr.34427) 4448 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:16:53.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[29418]: audit 2021-03-10T15:16:52.678988+0000 mon.a (mon.0) 1891 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:16:53.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[29418]: cephadm 2021-03-10T15:16:52.679285+0000 mgr.gibba020.yqfnwy (mgr.34427) 4449 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:16:53.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[29418]: audit 2021-03-10T15:16:52.680815+0000 mon.a (mon.0) 1892 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:53.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[29418]: cephadm 2021-03-10T15:16:52.680995+0000 mgr.gibba020.yqfnwy (mgr.34427) 4450 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:16:53.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[29418]: cephadm 2021-03-10T15:16:52.681033+0000 mgr.gibba020.yqfnwy (mgr.34427) 4451 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:16:53.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[29418]: cephadm 2021-03-10T15:16:52.682605+0000 mgr.gibba020.yqfnwy (mgr.34427) 4452 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:16:53.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[29418]: cephadm 2021-03-10T15:16:52.682642+0000 mgr.gibba020.yqfnwy (mgr.34427) 4453 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:16:53.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[29418]: audit 2021-03-10T15:16:52.682668+0000 mon.a (mon.0) 1893 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:53.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[29418]: cephadm 2021-03-10T15:16:52.684029+0000 mgr.gibba020.yqfnwy (mgr.34427) 4454 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:16:53.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[29418]: audit 2021-03-10T15:16:52.684106+0000 mon.a (mon.0) 1894 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:53.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[29418]: cephadm 2021-03-10T15:16:52.685498+0000 mgr.gibba020.yqfnwy (mgr.34427) 4455 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:16:53.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[29418]: cephadm 2021-03-10T15:16:52.685534+0000 mgr.gibba020.yqfnwy (mgr.34427) 4456 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:16:53.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[29418]: cephadm 2021-03-10T15:16:52.687031+0000 mgr.gibba020.yqfnwy (mgr.34427) 4457 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:16:53.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[29418]: audit 2021-03-10T15:16:52.687129+0000 mon.a (mon.0) 1895 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:53.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[30381]: cluster 2021-03-10T15:16:52.034590+0000 mgr.gibba020.yqfnwy (mgr.34427) 4445 : cluster [DBG] pgmap v2526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:53.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[30381]: audit 2021-03-10T15:16:52.453249+0000 mon.a (mon.0) 1889 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:16:53.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[30381]: cephadm 2021-03-10T15:16:52.457828+0000 mgr.gibba020.yqfnwy (mgr.34427) 4446 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:16:53.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[30381]: cephadm 2021-03-10T15:16:52.459922+0000 mgr.gibba020.yqfnwy (mgr.34427) 4447 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:16:53.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[30381]: audit 2021-03-10T15:16:52.675601+0000 mon.a (mon.0) 1890 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:16:53.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[30381]: cephadm 2021-03-10T15:16:52.677090+0000 mgr.gibba020.yqfnwy (mgr.34427) 4448 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:16:53.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[30381]: audit 2021-03-10T15:16:52.678988+0000 mon.a (mon.0) 1891 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:16:53.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[30381]: cephadm 2021-03-10T15:16:52.679285+0000 mgr.gibba020.yqfnwy (mgr.34427) 4449 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:16:53.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[30381]: audit 2021-03-10T15:16:52.680815+0000 mon.a (mon.0) 1892 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:53.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[30381]: cephadm 2021-03-10T15:16:52.680995+0000 mgr.gibba020.yqfnwy (mgr.34427) 4450 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:16:53.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[30381]: cephadm 2021-03-10T15:16:52.681033+0000 mgr.gibba020.yqfnwy (mgr.34427) 4451 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:16:53.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[30381]: cephadm 2021-03-10T15:16:52.682605+0000 mgr.gibba020.yqfnwy (mgr.34427) 4452 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:16:53.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[30381]: cephadm 2021-03-10T15:16:52.682642+0000 mgr.gibba020.yqfnwy (mgr.34427) 4453 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:16:53.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[30381]: audit 2021-03-10T15:16:52.682668+0000 mon.a (mon.0) 1893 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:53.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[30381]: cephadm 2021-03-10T15:16:52.684029+0000 mgr.gibba020.yqfnwy (mgr.34427) 4454 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:16:53.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[30381]: audit 2021-03-10T15:16:52.684106+0000 mon.a (mon.0) 1894 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:53.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[30381]: cephadm 2021-03-10T15:16:52.685498+0000 mgr.gibba020.yqfnwy (mgr.34427) 4455 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:16:53.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[30381]: cephadm 2021-03-10T15:16:52.685534+0000 mgr.gibba020.yqfnwy (mgr.34427) 4456 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:16:53.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[30381]: cephadm 2021-03-10T15:16:52.687031+0000 mgr.gibba020.yqfnwy (mgr.34427) 4457 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:16:53.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[30381]: audit 2021-03-10T15:16:52.687129+0000 mon.a (mon.0) 1895 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:53.643 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[29418]: cephadm 2021-03-10T15:16:52.687355+0000 mgr.gibba020.yqfnwy (mgr.34427) 4458 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:16:53.644 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[29418]: audit 2021-03-10T15:16:52.688801+0000 mon.a (mon.0) 1896 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:53.644 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[29418]: cephadm 2021-03-10T15:16:52.689140+0000 mgr.gibba020.yqfnwy (mgr.34427) 4459 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:16:53.644 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[29418]: cephadm 2021-03-10T15:16:52.689179+0000 mgr.gibba020.yqfnwy (mgr.34427) 4460 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:16:53.644 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[29418]: cephadm 2021-03-10T15:16:52.689284+0000 mgr.gibba020.yqfnwy (mgr.34427) 4461 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:16:53.645 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[30381]: cephadm 2021-03-10T15:16:52.687355+0000 mgr.gibba020.yqfnwy (mgr.34427) 4458 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:16:53.645 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[30381]: audit 2021-03-10T15:16:52.688801+0000 mon.a (mon.0) 1896 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:53.645 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[30381]: cephadm 2021-03-10T15:16:52.689140+0000 mgr.gibba020.yqfnwy (mgr.34427) 4459 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:16:53.645 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[30381]: cephadm 2021-03-10T15:16:52.689179+0000 mgr.gibba020.yqfnwy (mgr.34427) 4460 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:16:53.645 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:53 gibba013 bash[30381]: cephadm 2021-03-10T15:16:52.689284+0000 mgr.gibba020.yqfnwy (mgr.34427) 4461 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:16:53.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:53 gibba020 bash[25448]: cluster 2021-03-10T15:16:52.034590+0000 mgr.gibba020.yqfnwy (mgr.34427) 4445 : cluster [DBG] pgmap v2526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:53.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:53 gibba020 bash[25448]: audit 2021-03-10T15:16:52.453249+0000 mon.a (mon.0) 1889 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:16:53.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:53 gibba020 bash[25448]: cephadm 2021-03-10T15:16:52.457828+0000 mgr.gibba020.yqfnwy (mgr.34427) 4446 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:16:53.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:53 gibba020 bash[25448]: cephadm 2021-03-10T15:16:52.459922+0000 mgr.gibba020.yqfnwy (mgr.34427) 4447 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:16:53.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:53 gibba020 bash[25448]: audit 2021-03-10T15:16:52.675601+0000 mon.a (mon.0) 1890 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:16:53.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:53 gibba020 bash[25448]: cephadm 2021-03-10T15:16:52.677090+0000 mgr.gibba020.yqfnwy (mgr.34427) 4448 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:16:53.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:53 gibba020 bash[25448]: audit 2021-03-10T15:16:52.678988+0000 mon.a (mon.0) 1891 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:16:53.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:53 gibba020 bash[25448]: cephadm 2021-03-10T15:16:52.679285+0000 mgr.gibba020.yqfnwy (mgr.34427) 4449 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:16:53.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:53 gibba020 bash[25448]: audit 2021-03-10T15:16:52.680815+0000 mon.a (mon.0) 1892 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:53.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:53 gibba020 bash[25448]: cephadm 2021-03-10T15:16:52.680995+0000 mgr.gibba020.yqfnwy (mgr.34427) 4450 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:16:53.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:53 gibba020 bash[25448]: cephadm 2021-03-10T15:16:52.681033+0000 mgr.gibba020.yqfnwy (mgr.34427) 4451 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:16:53.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:53 gibba020 bash[25448]: cephadm 2021-03-10T15:16:52.682605+0000 mgr.gibba020.yqfnwy (mgr.34427) 4452 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:16:53.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:53 gibba020 bash[25448]: cephadm 2021-03-10T15:16:52.682642+0000 mgr.gibba020.yqfnwy (mgr.34427) 4453 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:16:53.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:53 gibba020 bash[25448]: audit 2021-03-10T15:16:52.682668+0000 mon.a (mon.0) 1893 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:53.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:53 gibba020 bash[25448]: cephadm 2021-03-10T15:16:52.684029+0000 mgr.gibba020.yqfnwy (mgr.34427) 4454 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:16:53.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:53 gibba020 bash[25448]: audit 2021-03-10T15:16:52.684106+0000 mon.a (mon.0) 1894 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:53.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:53 gibba020 bash[25448]: cephadm 2021-03-10T15:16:52.685498+0000 mgr.gibba020.yqfnwy (mgr.34427) 4455 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:16:53.706 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:53 gibba020 bash[25448]: cephadm 2021-03-10T15:16:52.685534+0000 mgr.gibba020.yqfnwy (mgr.34427) 4456 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:16:53.706 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:53 gibba020 bash[25448]: cephadm 2021-03-10T15:16:52.687031+0000 mgr.gibba020.yqfnwy (mgr.34427) 4457 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:16:53.706 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:53 gibba020 bash[25448]: audit 2021-03-10T15:16:52.687129+0000 mon.a (mon.0) 1895 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:53.706 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:53 gibba020 bash[25448]: cephadm 2021-03-10T15:16:52.687355+0000 mgr.gibba020.yqfnwy (mgr.34427) 4458 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:16:53.707 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:53 gibba020 bash[25448]: audit 2021-03-10T15:16:52.688801+0000 mon.a (mon.0) 1896 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:16:53.707 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:53 gibba020 bash[25448]: cephadm 2021-03-10T15:16:52.689140+0000 mgr.gibba020.yqfnwy (mgr.34427) 4459 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:16:53.707 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:53 gibba020 bash[25448]: cephadm 2021-03-10T15:16:52.689179+0000 mgr.gibba020.yqfnwy (mgr.34427) 4460 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:16:53.707 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:53 gibba020 bash[25448]: cephadm 2021-03-10T15:16:52.689284+0000 mgr.gibba020.yqfnwy (mgr.34427) 4461 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:16:55.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:55 gibba013 bash[29418]: cluster 2021-03-10T15:16:54.036320+0000 mgr.gibba020.yqfnwy (mgr.34427) 4462 : cluster [DBG] pgmap v2527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:55.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:55 gibba013 bash[30381]: cluster 2021-03-10T15:16:54.036320+0000 mgr.gibba020.yqfnwy (mgr.34427) 4462 : cluster [DBG] pgmap v2527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:55.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:55 gibba020 bash[25448]: cluster 2021-03-10T15:16:54.036320+0000 mgr.gibba020.yqfnwy (mgr.34427) 4462 : cluster [DBG] pgmap v2527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:57.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:57 gibba013 bash[29418]: cluster 2021-03-10T15:16:56.038173+0000 mgr.gibba020.yqfnwy (mgr.34427) 4463 : cluster [DBG] pgmap v2528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:57.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:57 gibba013 bash[30381]: cluster 2021-03-10T15:16:56.038173+0000 mgr.gibba020.yqfnwy (mgr.34427) 4463 : cluster [DBG] pgmap v2528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:57.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:57 gibba020 bash[25448]: cluster 2021-03-10T15:16:56.038173+0000 mgr.gibba020.yqfnwy (mgr.34427) 4463 : cluster [DBG] pgmap v2528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:59.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:16:59 gibba013 bash[29418]: cluster 2021-03-10T15:16:58.039506+0000 mgr.gibba020.yqfnwy (mgr.34427) 4464 : cluster [DBG] pgmap v2529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:59.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:16:59 gibba013 bash[30381]: cluster 2021-03-10T15:16:58.039506+0000 mgr.gibba020.yqfnwy (mgr.34427) 4464 : cluster [DBG] pgmap v2529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:16:59.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:16:59 gibba020 bash[25448]: cluster 2021-03-10T15:16:58.039506+0000 mgr.gibba020.yqfnwy (mgr.34427) 4464 : cluster [DBG] pgmap v2529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:01.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:01 gibba013 bash[29418]: cluster 2021-03-10T15:17:00.040072+0000 mgr.gibba020.yqfnwy (mgr.34427) 4465 : cluster [DBG] pgmap v2530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:01.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:01 gibba013 bash[30381]: cluster 2021-03-10T15:17:00.040072+0000 mgr.gibba020.yqfnwy (mgr.34427) 4465 : cluster [DBG] pgmap v2530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:01.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:01 gibba020 bash[25448]: cluster 2021-03-10T15:17:00.040072+0000 mgr.gibba020.yqfnwy (mgr.34427) 4465 : cluster [DBG] pgmap v2530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:03.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:03 gibba013 bash[29418]: cluster 2021-03-10T15:17:02.041039+0000 mgr.gibba020.yqfnwy (mgr.34427) 4466 : cluster [DBG] pgmap v2531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:03.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:03 gibba013 bash[30381]: cluster 2021-03-10T15:17:02.041039+0000 mgr.gibba020.yqfnwy (mgr.34427) 4466 : cluster [DBG] pgmap v2531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:03.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:03 gibba020 bash[25448]: cluster 2021-03-10T15:17:02.041039+0000 mgr.gibba020.yqfnwy (mgr.34427) 4466 : cluster [DBG] pgmap v2531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:05.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:05 gibba013 bash[29418]: cluster 2021-03-10T15:17:04.042689+0000 mgr.gibba020.yqfnwy (mgr.34427) 4467 : cluster [DBG] pgmap v2532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:05.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:05 gibba013 bash[30381]: cluster 2021-03-10T15:17:04.042689+0000 mgr.gibba020.yqfnwy (mgr.34427) 4467 : cluster [DBG] pgmap v2532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:05.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:05 gibba020 bash[25448]: cluster 2021-03-10T15:17:04.042689+0000 mgr.gibba020.yqfnwy (mgr.34427) 4467 : cluster [DBG] pgmap v2532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:07.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:07 gibba013 bash[29418]: cluster 2021-03-10T15:17:06.044566+0000 mgr.gibba020.yqfnwy (mgr.34427) 4468 : cluster [DBG] pgmap v2533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:07.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:07 gibba013 bash[29418]: audit 2021-03-10T15:17:06.395241+0000 mon.a (mon.0) 1897 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:17:07.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:07 gibba013 bash[29418]: audit 2021-03-10T15:17:06.444486+0000 mon.a (mon.0) 1898 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:17:07.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:07 gibba013 bash[29418]: audit 2021-03-10T15:17:06.537365+0000 mon.a (mon.0) 1899 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:17:07.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:07 gibba013 bash[29418]: audit 2021-03-10T15:17:06.537518+0000 mon.a (mon.0) 1900 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:17:07.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:07 gibba013 bash[29418]: audit 2021-03-10T15:17:06.537656+0000 mon.a (mon.0) 1901 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:17:07.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:07 gibba013 bash[29418]: audit 2021-03-10T15:17:06.537814+0000 mon.a (mon.0) 1902 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:17:07.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:07 gibba013 bash[30381]: cluster 2021-03-10T15:17:06.044566+0000 mgr.gibba020.yqfnwy (mgr.34427) 4468 : cluster [DBG] pgmap v2533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:07.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:07 gibba013 bash[30381]: audit 2021-03-10T15:17:06.395241+0000 mon.a (mon.0) 1897 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:17:07.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:07 gibba013 bash[30381]: audit 2021-03-10T15:17:06.444486+0000 mon.a (mon.0) 1898 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:17:07.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:07 gibba013 bash[30381]: audit 2021-03-10T15:17:06.537365+0000 mon.a (mon.0) 1899 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:17:07.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:07 gibba013 bash[30381]: audit 2021-03-10T15:17:06.537518+0000 mon.a (mon.0) 1900 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:17:07.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:07 gibba013 bash[30381]: audit 2021-03-10T15:17:06.537656+0000 mon.a (mon.0) 1901 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:17:07.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:07 gibba013 bash[30381]: audit 2021-03-10T15:17:06.537814+0000 mon.a (mon.0) 1902 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:17:07.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:07 gibba020 bash[25448]: cluster 2021-03-10T15:17:06.044566+0000 mgr.gibba020.yqfnwy (mgr.34427) 4468 : cluster [DBG] pgmap v2533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:07 gibba020 bash[25448]: audit 2021-03-10T15:17:06.395241+0000 mon.a (mon.0) 1897 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:17:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:07 gibba020 bash[25448]: audit 2021-03-10T15:17:06.444486+0000 mon.a (mon.0) 1898 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:17:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:07 gibba020 bash[25448]: audit 2021-03-10T15:17:06.537365+0000 mon.a (mon.0) 1899 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:17:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:07 gibba020 bash[25448]: audit 2021-03-10T15:17:06.537518+0000 mon.a (mon.0) 1900 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:17:07.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:07 gibba020 bash[25448]: audit 2021-03-10T15:17:06.537656+0000 mon.a (mon.0) 1901 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:17:07.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:07 gibba020 bash[25448]: audit 2021-03-10T15:17:06.537814+0000 mon.a (mon.0) 1902 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:17:08.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:08 gibba013 bash[29418]: cephadm 2021-03-10T15:17:07.704938+0000 mgr.gibba020.yqfnwy (mgr.34427) 4469 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:17:08.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:08 gibba013 bash[30381]: cephadm 2021-03-10T15:17:07.704938+0000 mgr.gibba020.yqfnwy (mgr.34427) 4469 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:17:08.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:08 gibba020 bash[25448]: cephadm 2021-03-10T15:17:07.704938+0000 mgr.gibba020.yqfnwy (mgr.34427) 4469 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:17:09.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:09 gibba013 bash[29418]: cluster 2021-03-10T15:17:08.045026+0000 mgr.gibba020.yqfnwy (mgr.34427) 4470 : cluster [DBG] pgmap v2534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:09.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:09 gibba013 bash[30381]: cluster 2021-03-10T15:17:08.045026+0000 mgr.gibba020.yqfnwy (mgr.34427) 4470 : cluster [DBG] pgmap v2534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:09.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:09 gibba020 bash[25448]: cluster 2021-03-10T15:17:08.045026+0000 mgr.gibba020.yqfnwy (mgr.34427) 4470 : cluster [DBG] pgmap v2534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:11.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:11 gibba013 bash[29418]: cluster 2021-03-10T15:17:10.045912+0000 mgr.gibba020.yqfnwy (mgr.34427) 4471 : cluster [DBG] pgmap v2535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:11.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:11 gibba013 bash[30381]: cluster 2021-03-10T15:17:10.045912+0000 mgr.gibba020.yqfnwy (mgr.34427) 4471 : cluster [DBG] pgmap v2535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:11.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:11 gibba020 bash[25448]: cluster 2021-03-10T15:17:10.045912+0000 mgr.gibba020.yqfnwy (mgr.34427) 4471 : cluster [DBG] pgmap v2535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:13.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:13 gibba013 bash[29418]: cluster 2021-03-10T15:17:12.046941+0000 mgr.gibba020.yqfnwy (mgr.34427) 4472 : cluster [DBG] pgmap v2536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:13.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:13 gibba013 bash[30381]: cluster 2021-03-10T15:17:12.046941+0000 mgr.gibba020.yqfnwy (mgr.34427) 4472 : cluster [DBG] pgmap v2536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:13.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:13 gibba020 bash[25448]: cluster 2021-03-10T15:17:12.046941+0000 mgr.gibba020.yqfnwy (mgr.34427) 4472 : cluster [DBG] pgmap v2536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:15.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:15 gibba013 bash[29418]: cluster 2021-03-10T15:17:14.048385+0000 mgr.gibba020.yqfnwy (mgr.34427) 4473 : cluster [DBG] pgmap v2537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:15.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:15 gibba013 bash[30381]: cluster 2021-03-10T15:17:14.048385+0000 mgr.gibba020.yqfnwy (mgr.34427) 4473 : cluster [DBG] pgmap v2537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:15.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:15 gibba020 bash[25448]: cluster 2021-03-10T15:17:14.048385+0000 mgr.gibba020.yqfnwy (mgr.34427) 4473 : cluster [DBG] pgmap v2537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:17.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:17 gibba013 bash[29418]: cluster 2021-03-10T15:17:16.050406+0000 mgr.gibba020.yqfnwy (mgr.34427) 4474 : cluster [DBG] pgmap v2538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:17.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:17 gibba013 bash[30381]: cluster 2021-03-10T15:17:16.050406+0000 mgr.gibba020.yqfnwy (mgr.34427) 4474 : cluster [DBG] pgmap v2538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:17.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:17 gibba020 bash[25448]: cluster 2021-03-10T15:17:16.050406+0000 mgr.gibba020.yqfnwy (mgr.34427) 4474 : cluster [DBG] pgmap v2538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:19.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:19 gibba013 bash[29418]: cluster 2021-03-10T15:17:18.050927+0000 mgr.gibba020.yqfnwy (mgr.34427) 4475 : cluster [DBG] pgmap v2539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:19.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:19 gibba013 bash[30381]: cluster 2021-03-10T15:17:18.050927+0000 mgr.gibba020.yqfnwy (mgr.34427) 4475 : cluster [DBG] pgmap v2539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:19.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:19 gibba020 bash[25448]: cluster 2021-03-10T15:17:18.050927+0000 mgr.gibba020.yqfnwy (mgr.34427) 4475 : cluster [DBG] pgmap v2539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:20.378 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:17:20.607 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:17:20.608 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (83m) 8m ago 89m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:17:20.608 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (89m) 7m ago 89m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:17:20.608 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (84m) 7m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:17:20.608 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (84m) 7m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:17:20.609 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (83m) 8m ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:17:20.609 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (83m) 8m ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:17:20.609 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (82m) 7m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:17:20.609 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (83m) 8m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:17:20.609 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (89m) 8m ago 89m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:17:20.610 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (89m) 7m ago 89m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:17:20.610 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (82m) 8m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:17:20.610 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (81m) 8m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:17:20.610 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (81m) 8m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:17:20.611 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (80m) 8m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:17:20.611 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (80m) 7m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:17:20.611 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (79m) 7m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:17:20.611 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (79m) 7m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:17:20.611 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (79m) 7m ago 89m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:17:20.612 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (88m) 7m ago 89m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:17:20.612 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 7m ago 87m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:17:20.858 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:17:20.858 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:17:20.858 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:17:20.858 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:17:20.859 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:17:20.859 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:17:20.859 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:17:20.859 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:17:20.860 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:17:20.860 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:17:20.860 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:17:20.860 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:17:20.860 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:17:20.861 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:17:20.861 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:17:21.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:21 gibba013 bash[29418]: cluster 2021-03-10T15:17:20.051891+0000 mgr.gibba020.yqfnwy (mgr.34427) 4476 : cluster [DBG] pgmap v2540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:21.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:21 gibba013 bash[29418]: audit 2021-03-10T15:17:20.365479+0000 mgr.gibba020.yqfnwy (mgr.34427) 4477 : audit [DBG] from='client.57043 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:17:21.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:21 gibba013 bash[29418]: audit 2021-03-10T15:17:20.590607+0000 mgr.gibba020.yqfnwy (mgr.34427) 4478 : audit [DBG] from='client.47064 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:17:21.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:21 gibba013 bash[29418]: audit 2021-03-10T15:17:20.854536+0000 mon.c (mon.1) 76 : audit [DBG] from='client.? 172.21.2.113:0/2945006173' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:21.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:21 gibba013 bash[30381]: cluster 2021-03-10T15:17:20.051891+0000 mgr.gibba020.yqfnwy (mgr.34427) 4476 : cluster [DBG] pgmap v2540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:21.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:21 gibba013 bash[30381]: audit 2021-03-10T15:17:20.365479+0000 mgr.gibba020.yqfnwy (mgr.34427) 4477 : audit [DBG] from='client.57043 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:17:21.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:21 gibba013 bash[30381]: audit 2021-03-10T15:17:20.590607+0000 mgr.gibba020.yqfnwy (mgr.34427) 4478 : audit [DBG] from='client.47064 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:17:21.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:21 gibba013 bash[30381]: audit 2021-03-10T15:17:20.854536+0000 mon.c (mon.1) 76 : audit [DBG] from='client.? 172.21.2.113:0/2945006173' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:21.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:21 gibba020 bash[25448]: cluster 2021-03-10T15:17:20.051891+0000 mgr.gibba020.yqfnwy (mgr.34427) 4476 : cluster [DBG] pgmap v2540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:21.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:21 gibba020 bash[25448]: audit 2021-03-10T15:17:20.365479+0000 mgr.gibba020.yqfnwy (mgr.34427) 4477 : audit [DBG] from='client.57043 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:17:21.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:21 gibba020 bash[25448]: audit 2021-03-10T15:17:20.590607+0000 mgr.gibba020.yqfnwy (mgr.34427) 4478 : audit [DBG] from='client.47064 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:17:21.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:21 gibba020 bash[25448]: audit 2021-03-10T15:17:20.854536+0000 mon.c (mon.1) 76 : audit [DBG] from='client.? 172.21.2.113:0/2945006173' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:23.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:23 gibba013 bash[29418]: cluster 2021-03-10T15:17:22.053158+0000 mgr.gibba020.yqfnwy (mgr.34427) 4479 : cluster [DBG] pgmap v2541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:23.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:23 gibba013 bash[29418]: cephadm 2021-03-10T15:17:22.721042+0000 mgr.gibba020.yqfnwy (mgr.34427) 4480 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:17:23.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:23 gibba013 bash[30381]: cluster 2021-03-10T15:17:22.053158+0000 mgr.gibba020.yqfnwy (mgr.34427) 4479 : cluster [DBG] pgmap v2541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:23.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:23 gibba013 bash[30381]: cephadm 2021-03-10T15:17:22.721042+0000 mgr.gibba020.yqfnwy (mgr.34427) 4480 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:17:23.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:23 gibba020 bash[25448]: cluster 2021-03-10T15:17:22.053158+0000 mgr.gibba020.yqfnwy (mgr.34427) 4479 : cluster [DBG] pgmap v2541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:23.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:23 gibba020 bash[25448]: cephadm 2021-03-10T15:17:22.721042+0000 mgr.gibba020.yqfnwy (mgr.34427) 4480 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:17:25.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:25 gibba013 bash[29418]: cluster 2021-03-10T15:17:24.054763+0000 mgr.gibba020.yqfnwy (mgr.34427) 4481 : cluster [DBG] pgmap v2542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:25.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:25 gibba013 bash[30381]: cluster 2021-03-10T15:17:24.054763+0000 mgr.gibba020.yqfnwy (mgr.34427) 4481 : cluster [DBG] pgmap v2542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:25.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:25 gibba020 bash[25448]: cluster 2021-03-10T15:17:24.054763+0000 mgr.gibba020.yqfnwy (mgr.34427) 4481 : cluster [DBG] pgmap v2542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:27.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:27 gibba013 bash[29418]: cluster 2021-03-10T15:17:26.055354+0000 mgr.gibba020.yqfnwy (mgr.34427) 4482 : cluster [DBG] pgmap v2543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:27.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:27 gibba013 bash[30381]: cluster 2021-03-10T15:17:26.055354+0000 mgr.gibba020.yqfnwy (mgr.34427) 4482 : cluster [DBG] pgmap v2543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:27.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:27 gibba020 bash[25448]: cluster 2021-03-10T15:17:26.055354+0000 mgr.gibba020.yqfnwy (mgr.34427) 4482 : cluster [DBG] pgmap v2543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:29.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:29 gibba020 bash[25448]: cluster 2021-03-10T15:17:28.055697+0000 mgr.gibba020.yqfnwy (mgr.34427) 4483 : cluster [DBG] pgmap v2544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:29.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:29 gibba013 bash[29418]: cluster 2021-03-10T15:17:28.055697+0000 mgr.gibba020.yqfnwy (mgr.34427) 4483 : cluster [DBG] pgmap v2544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:29.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:29 gibba013 bash[30381]: cluster 2021-03-10T15:17:28.055697+0000 mgr.gibba020.yqfnwy (mgr.34427) 4483 : cluster [DBG] pgmap v2544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:31.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:31 gibba020 bash[25448]: cluster 2021-03-10T15:17:30.056548+0000 mgr.gibba020.yqfnwy (mgr.34427) 4484 : cluster [DBG] pgmap v2545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:31.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:31 gibba013 bash[29418]: cluster 2021-03-10T15:17:30.056548+0000 mgr.gibba020.yqfnwy (mgr.34427) 4484 : cluster [DBG] pgmap v2545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:31.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:31 gibba013 bash[30381]: cluster 2021-03-10T15:17:30.056548+0000 mgr.gibba020.yqfnwy (mgr.34427) 4484 : cluster [DBG] pgmap v2545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:33.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:33 gibba020 bash[25448]: cluster 2021-03-10T15:17:32.057825+0000 mgr.gibba020.yqfnwy (mgr.34427) 4485 : cluster [DBG] pgmap v2546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:33.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:33 gibba013 bash[29418]: cluster 2021-03-10T15:17:32.057825+0000 mgr.gibba020.yqfnwy (mgr.34427) 4485 : cluster [DBG] pgmap v2546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:33.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:33 gibba013 bash[30381]: cluster 2021-03-10T15:17:32.057825+0000 mgr.gibba020.yqfnwy (mgr.34427) 4485 : cluster [DBG] pgmap v2546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:35.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:35 gibba020 bash[25448]: cluster 2021-03-10T15:17:34.058325+0000 mgr.gibba020.yqfnwy (mgr.34427) 4486 : cluster [DBG] pgmap v2547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:35.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:35 gibba013 bash[29418]: cluster 2021-03-10T15:17:34.058325+0000 mgr.gibba020.yqfnwy (mgr.34427) 4486 : cluster [DBG] pgmap v2547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:35.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:35 gibba013 bash[30381]: cluster 2021-03-10T15:17:34.058325+0000 mgr.gibba020.yqfnwy (mgr.34427) 4486 : cluster [DBG] pgmap v2547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:37.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:37 gibba020 bash[25448]: cluster 2021-03-10T15:17:36.060069+0000 mgr.gibba020.yqfnwy (mgr.34427) 4487 : cluster [DBG] pgmap v2548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:37.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:37 gibba013 bash[29418]: cluster 2021-03-10T15:17:36.060069+0000 mgr.gibba020.yqfnwy (mgr.34427) 4487 : cluster [DBG] pgmap v2548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:37.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:37 gibba013 bash[30381]: cluster 2021-03-10T15:17:36.060069+0000 mgr.gibba020.yqfnwy (mgr.34427) 4487 : cluster [DBG] pgmap v2548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:38.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:38 gibba020 bash[25448]: cephadm 2021-03-10T15:17:37.736880+0000 mgr.gibba020.yqfnwy (mgr.34427) 4488 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:17:38.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:38 gibba013 bash[29418]: cephadm 2021-03-10T15:17:37.736880+0000 mgr.gibba020.yqfnwy (mgr.34427) 4488 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:17:38.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:38 gibba013 bash[30381]: cephadm 2021-03-10T15:17:37.736880+0000 mgr.gibba020.yqfnwy (mgr.34427) 4488 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:17:39.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:39 gibba020 bash[25448]: cluster 2021-03-10T15:17:38.060584+0000 mgr.gibba020.yqfnwy (mgr.34427) 4489 : cluster [DBG] pgmap v2549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:39.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:39 gibba013 bash[29418]: cluster 2021-03-10T15:17:38.060584+0000 mgr.gibba020.yqfnwy (mgr.34427) 4489 : cluster [DBG] pgmap v2549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:39.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:39 gibba013 bash[30381]: cluster 2021-03-10T15:17:38.060584+0000 mgr.gibba020.yqfnwy (mgr.34427) 4489 : cluster [DBG] pgmap v2549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:41.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:41 gibba013 bash[29418]: cluster 2021-03-10T15:17:40.061484+0000 mgr.gibba020.yqfnwy (mgr.34427) 4490 : cluster [DBG] pgmap v2550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:41.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:41 gibba013 bash[30381]: cluster 2021-03-10T15:17:40.061484+0000 mgr.gibba020.yqfnwy (mgr.34427) 4490 : cluster [DBG] pgmap v2550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:41.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:41 gibba020 bash[25448]: cluster 2021-03-10T15:17:40.061484+0000 mgr.gibba020.yqfnwy (mgr.34427) 4490 : cluster [DBG] pgmap v2550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:43.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:43 gibba013 bash[29418]: cluster 2021-03-10T15:17:42.061839+0000 mgr.gibba020.yqfnwy (mgr.34427) 4491 : cluster [DBG] pgmap v2551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:43.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:43 gibba013 bash[30381]: cluster 2021-03-10T15:17:42.061839+0000 mgr.gibba020.yqfnwy (mgr.34427) 4491 : cluster [DBG] pgmap v2551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:43.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:43 gibba020 bash[25448]: cluster 2021-03-10T15:17:42.061839+0000 mgr.gibba020.yqfnwy (mgr.34427) 4491 : cluster [DBG] pgmap v2551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:45.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:45 gibba013 bash[29418]: cluster 2021-03-10T15:17:44.063393+0000 mgr.gibba020.yqfnwy (mgr.34427) 4492 : cluster [DBG] pgmap v2552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:45.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:45 gibba013 bash[30381]: cluster 2021-03-10T15:17:44.063393+0000 mgr.gibba020.yqfnwy (mgr.34427) 4492 : cluster [DBG] pgmap v2552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:45.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:45 gibba020 bash[25448]: cluster 2021-03-10T15:17:44.063393+0000 mgr.gibba020.yqfnwy (mgr.34427) 4492 : cluster [DBG] pgmap v2552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:47.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:47 gibba013 bash[29418]: cluster 2021-03-10T15:17:46.065266+0000 mgr.gibba020.yqfnwy (mgr.34427) 4493 : cluster [DBG] pgmap v2553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:47.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:47 gibba013 bash[30381]: cluster 2021-03-10T15:17:46.065266+0000 mgr.gibba020.yqfnwy (mgr.34427) 4493 : cluster [DBG] pgmap v2553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:47.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:47 gibba020 bash[25448]: cluster 2021-03-10T15:17:46.065266+0000 mgr.gibba020.yqfnwy (mgr.34427) 4493 : cluster [DBG] pgmap v2553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:49.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:49 gibba013 bash[29418]: cluster 2021-03-10T15:17:48.065723+0000 mgr.gibba020.yqfnwy (mgr.34427) 4494 : cluster [DBG] pgmap v2554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:49.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:49 gibba013 bash[30381]: cluster 2021-03-10T15:17:48.065723+0000 mgr.gibba020.yqfnwy (mgr.34427) 4494 : cluster [DBG] pgmap v2554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:49.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:49 gibba020 bash[25448]: cluster 2021-03-10T15:17:48.065723+0000 mgr.gibba020.yqfnwy (mgr.34427) 4494 : cluster [DBG] pgmap v2554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:51.098 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:17:51.327 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:17:51.327 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (84m) 9m ago 89m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:17:51.328 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (89m) 8m ago 89m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:17:51.328 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (84m) 8m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:17:51.328 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (85m) 8m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:17:51.328 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (84m) 9m ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:17:51.329 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (83m) 9m ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:17:51.329 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (83m) 8m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:17:51.329 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (83m) 9m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:17:51.329 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (89m) 9m ago 89m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:17:51.330 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (89m) 8m ago 89m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:17:51.330 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (82m) 9m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:17:51.330 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (82m) 9m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:17:51.330 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (81m) 9m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:17:51.331 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (81m) 9m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:17:51.331 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (80m) 8m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:17:51.331 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (80m) 8m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:17:51.331 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (80m) 8m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:17:51.331 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (79m) 8m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:17:51.332 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (89m) 8m ago 89m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:17:51.332 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 8m ago 87m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:17:51.575 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:17:51.575 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:17:51.575 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:17:51.576 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:17:51.576 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:17:51.576 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:17:51.576 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:17:51.577 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:17:51.577 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:17:51.577 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:17:51.577 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:17:51.577 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:17:51.578 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:17:51.578 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:17:51.578 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:17:51.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:51 gibba013 bash[29418]: cluster 2021-03-10T15:17:50.066584+0000 mgr.gibba020.yqfnwy (mgr.34427) 4495 : cluster [DBG] pgmap v2555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:51.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:51 gibba013 bash[30381]: cluster 2021-03-10T15:17:50.066584+0000 mgr.gibba020.yqfnwy (mgr.34427) 4495 : cluster [DBG] pgmap v2555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:51.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:51 gibba020 bash[25448]: cluster 2021-03-10T15:17:50.066584+0000 mgr.gibba020.yqfnwy (mgr.34427) 4495 : cluster [DBG] pgmap v2555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:52.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:52 gibba013 bash[29418]: audit 2021-03-10T15:17:51.085076+0000 mgr.gibba020.yqfnwy (mgr.34427) 4496 : audit [DBG] from='client.47076 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:17:52.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:52 gibba013 bash[29418]: audit 2021-03-10T15:17:51.310343+0000 mgr.gibba020.yqfnwy (mgr.34427) 4497 : audit [DBG] from='client.47082 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:17:52.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:52 gibba013 bash[29418]: audit 2021-03-10T15:17:51.571359+0000 mon.a (mon.0) 1903 : audit [DBG] from='client.? 172.21.2.113:0/322519767' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:52.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:52 gibba013 bash[30381]: audit 2021-03-10T15:17:51.085076+0000 mgr.gibba020.yqfnwy (mgr.34427) 4496 : audit [DBG] from='client.47076 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:17:52.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:52 gibba013 bash[30381]: audit 2021-03-10T15:17:51.310343+0000 mgr.gibba020.yqfnwy (mgr.34427) 4497 : audit [DBG] from='client.47082 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:17:52.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:52 gibba013 bash[30381]: audit 2021-03-10T15:17:51.571359+0000 mon.a (mon.0) 1903 : audit [DBG] from='client.? 172.21.2.113:0/322519767' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:52.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:52 gibba020 bash[25448]: audit 2021-03-10T15:17:51.085076+0000 mgr.gibba020.yqfnwy (mgr.34427) 4496 : audit [DBG] from='client.47076 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:17:52.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:52 gibba020 bash[25448]: audit 2021-03-10T15:17:51.310343+0000 mgr.gibba020.yqfnwy (mgr.34427) 4497 : audit [DBG] from='client.47082 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:17:52.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:52 gibba020 bash[25448]: audit 2021-03-10T15:17:51.571359+0000 mon.a (mon.0) 1903 : audit [DBG] from='client.? 172.21.2.113:0/322519767' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:53.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:53 gibba013 bash[29418]: cluster 2021-03-10T15:17:52.067793+0000 mgr.gibba020.yqfnwy (mgr.34427) 4498 : cluster [DBG] pgmap v2556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:53.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:53 gibba013 bash[29418]: audit 2021-03-10T15:17:52.754882+0000 mon.a (mon.0) 1904 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:17:53.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:53 gibba013 bash[29418]: cephadm 2021-03-10T15:17:52.760858+0000 mgr.gibba020.yqfnwy (mgr.34427) 4499 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:17:53.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:53 gibba013 bash[29418]: audit 2021-03-10T15:17:52.762313+0000 mon.a (mon.0) 1905 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T15:17:53.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:53 gibba013 bash[30381]: cluster 2021-03-10T15:17:52.067793+0000 mgr.gibba020.yqfnwy (mgr.34427) 4498 : cluster [DBG] pgmap v2556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:53.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:53 gibba013 bash[30381]: audit 2021-03-10T15:17:52.754882+0000 mon.a (mon.0) 1904 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:17:53.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:53 gibba013 bash[30381]: cephadm 2021-03-10T15:17:52.760858+0000 mgr.gibba020.yqfnwy (mgr.34427) 4499 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:17:53.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:53 gibba013 bash[30381]: audit 2021-03-10T15:17:52.762313+0000 mon.a (mon.0) 1905 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T15:17:53.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:53 gibba020 bash[25448]: cluster 2021-03-10T15:17:52.067793+0000 mgr.gibba020.yqfnwy (mgr.34427) 4498 : cluster [DBG] pgmap v2556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:53.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:53 gibba020 bash[25448]: audit 2021-03-10T15:17:52.754882+0000 mon.a (mon.0) 1904 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:17:53.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:53 gibba020 bash[25448]: cephadm 2021-03-10T15:17:52.760858+0000 mgr.gibba020.yqfnwy (mgr.34427) 4499 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:17:53.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:53 gibba020 bash[25448]: audit 2021-03-10T15:17:52.762313+0000 mon.a (mon.0) 1905 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T15:17:55.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:55 gibba013 bash[29418]: cluster 2021-03-10T15:17:54.069238+0000 mgr.gibba020.yqfnwy (mgr.34427) 4500 : cluster [DBG] pgmap v2557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:55.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:55 gibba013 bash[30381]: cluster 2021-03-10T15:17:54.069238+0000 mgr.gibba020.yqfnwy (mgr.34427) 4500 : cluster [DBG] pgmap v2557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:55.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:55 gibba020 bash[25448]: cluster 2021-03-10T15:17:54.069238+0000 mgr.gibba020.yqfnwy (mgr.34427) 4500 : cluster [DBG] pgmap v2557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:57.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:57 gibba013 bash[29418]: cluster 2021-03-10T15:17:56.071032+0000 mgr.gibba020.yqfnwy (mgr.34427) 4501 : cluster [DBG] pgmap v2558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:57.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:57 gibba013 bash[29418]: audit 2021-03-10T15:17:57.487645+0000 mon.a (mon.0) 1906 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:17:57.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:57 gibba013 bash[30381]: cluster 2021-03-10T15:17:56.071032+0000 mgr.gibba020.yqfnwy (mgr.34427) 4501 : cluster [DBG] pgmap v2558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:57.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:57 gibba013 bash[30381]: audit 2021-03-10T15:17:57.487645+0000 mon.a (mon.0) 1906 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:17:57.899 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:57 gibba020 bash[25448]: cluster 2021-03-10T15:17:56.071032+0000 mgr.gibba020.yqfnwy (mgr.34427) 4501 : cluster [DBG] pgmap v2558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:17:57.900 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:57 gibba020 bash[25448]: audit 2021-03-10T15:17:57.487645+0000 mon.a (mon.0) 1906 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:17:58.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:58 gibba020 bash[25448]: audit 2021-03-10T15:17:57.688358+0000 mon.a (mon.0) 1907 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:17:58.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:58 gibba020 bash[25448]: cephadm 2021-03-10T15:17:57.688812+0000 mgr.gibba020.yqfnwy (mgr.34427) 4502 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:17:58.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:58 gibba020 bash[25448]: audit 2021-03-10T15:17:57.881187+0000 mon.a (mon.0) 1908 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:17:58.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:58 gibba020 bash[25448]: cephadm 2021-03-10T15:17:57.886580+0000 mgr.gibba020.yqfnwy (mgr.34427) 4503 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:17:58.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:58 gibba020 bash[25448]: audit 2021-03-10T15:17:57.888341+0000 mon.a (mon.0) 1909 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:17:58.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:58 gibba020 bash[25448]: cephadm 2021-03-10T15:17:57.888369+0000 mgr.gibba020.yqfnwy (mgr.34427) 4504 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:17:58.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:58 gibba020 bash[25448]: cephadm 2021-03-10T15:17:57.889593+0000 mgr.gibba020.yqfnwy (mgr.34427) 4505 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:17:58.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:58 gibba020 bash[25448]: cephadm 2021-03-10T15:17:57.889632+0000 mgr.gibba020.yqfnwy (mgr.34427) 4506 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:17:58.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:58 gibba020 bash[25448]: audit 2021-03-10T15:17:57.889785+0000 mon.a (mon.0) 1910 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:58.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:58 gibba020 bash[25448]: cephadm 2021-03-10T15:17:57.890875+0000 mgr.gibba020.yqfnwy (mgr.34427) 4507 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:17:58.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:58 gibba020 bash[25448]: cephadm 2021-03-10T15:17:57.890911+0000 mgr.gibba020.yqfnwy (mgr.34427) 4508 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:17:58.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:58 gibba020 bash[25448]: audit 2021-03-10T15:17:57.891078+0000 mon.a (mon.0) 1911 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:58.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:58 gibba020 bash[25448]: cephadm 2021-03-10T15:17:57.891915+0000 mgr.gibba020.yqfnwy (mgr.34427) 4509 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:17:58.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:58 gibba020 bash[25448]: audit 2021-03-10T15:17:57.892226+0000 mon.a (mon.0) 1912 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:58.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:58 gibba020 bash[25448]: cephadm 2021-03-10T15:17:57.892809+0000 mgr.gibba020.yqfnwy (mgr.34427) 4510 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:17:58.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:58 gibba020 bash[25448]: cephadm 2021-03-10T15:17:57.892850+0000 mgr.gibba020.yqfnwy (mgr.34427) 4511 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:17:58.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:58 gibba020 bash[25448]: cephadm 2021-03-10T15:17:57.894019+0000 mgr.gibba020.yqfnwy (mgr.34427) 4512 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:17:58.957 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:58 gibba020 bash[25448]: audit 2021-03-10T15:17:57.894258+0000 mon.a (mon.0) 1913 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:58.957 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:58 gibba020 bash[25448]: cephadm 2021-03-10T15:17:57.894373+0000 mgr.gibba020.yqfnwy (mgr.34427) 4513 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:17:58.957 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:58 gibba020 bash[25448]: cephadm 2021-03-10T15:17:57.895431+0000 mgr.gibba020.yqfnwy (mgr.34427) 4514 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:17:58.957 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:58 gibba020 bash[25448]: cephadm 2021-03-10T15:17:57.895475+0000 mgr.gibba020.yqfnwy (mgr.34427) 4515 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:17:58.957 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:58 gibba020 bash[25448]: cephadm 2021-03-10T15:17:57.895604+0000 mgr.gibba020.yqfnwy (mgr.34427) 4516 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:17:58.958 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:58 gibba020 bash[25448]: audit 2021-03-10T15:17:57.895669+0000 mon.a (mon.0) 1914 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:59.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[29418]: audit 2021-03-10T15:17:57.688358+0000 mon.a (mon.0) 1907 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:17:59.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[29418]: cephadm 2021-03-10T15:17:57.688812+0000 mgr.gibba020.yqfnwy (mgr.34427) 4502 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:17:59.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[29418]: audit 2021-03-10T15:17:57.881187+0000 mon.a (mon.0) 1908 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:17:59.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[29418]: cephadm 2021-03-10T15:17:57.886580+0000 mgr.gibba020.yqfnwy (mgr.34427) 4503 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:17:59.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[29418]: audit 2021-03-10T15:17:57.888341+0000 mon.a (mon.0) 1909 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:17:59.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[29418]: cephadm 2021-03-10T15:17:57.888369+0000 mgr.gibba020.yqfnwy (mgr.34427) 4504 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:17:59.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[29418]: cephadm 2021-03-10T15:17:57.889593+0000 mgr.gibba020.yqfnwy (mgr.34427) 4505 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:17:59.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[29418]: cephadm 2021-03-10T15:17:57.889632+0000 mgr.gibba020.yqfnwy (mgr.34427) 4506 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:17:59.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[29418]: audit 2021-03-10T15:17:57.889785+0000 mon.a (mon.0) 1910 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:59.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[29418]: cephadm 2021-03-10T15:17:57.890875+0000 mgr.gibba020.yqfnwy (mgr.34427) 4507 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:17:59.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[29418]: cephadm 2021-03-10T15:17:57.890911+0000 mgr.gibba020.yqfnwy (mgr.34427) 4508 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:17:59.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[29418]: audit 2021-03-10T15:17:57.891078+0000 mon.a (mon.0) 1911 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:59.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[29418]: cephadm 2021-03-10T15:17:57.891915+0000 mgr.gibba020.yqfnwy (mgr.34427) 4509 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:17:59.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[29418]: audit 2021-03-10T15:17:57.892226+0000 mon.a (mon.0) 1912 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:59.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[29418]: cephadm 2021-03-10T15:17:57.892809+0000 mgr.gibba020.yqfnwy (mgr.34427) 4510 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:17:59.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[29418]: cephadm 2021-03-10T15:17:57.892850+0000 mgr.gibba020.yqfnwy (mgr.34427) 4511 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:17:59.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[29418]: cephadm 2021-03-10T15:17:57.894019+0000 mgr.gibba020.yqfnwy (mgr.34427) 4512 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:17:59.138 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[29418]: audit 2021-03-10T15:17:57.894258+0000 mon.a (mon.0) 1913 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:59.138 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[29418]: cephadm 2021-03-10T15:17:57.894373+0000 mgr.gibba020.yqfnwy (mgr.34427) 4513 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:17:59.138 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[29418]: cephadm 2021-03-10T15:17:57.895431+0000 mgr.gibba020.yqfnwy (mgr.34427) 4514 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:17:59.138 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[29418]: cephadm 2021-03-10T15:17:57.895475+0000 mgr.gibba020.yqfnwy (mgr.34427) 4515 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:17:59.139 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[29418]: cephadm 2021-03-10T15:17:57.895604+0000 mgr.gibba020.yqfnwy (mgr.34427) 4516 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:17:59.139 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[29418]: audit 2021-03-10T15:17:57.895669+0000 mon.a (mon.0) 1914 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:59.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[30381]: audit 2021-03-10T15:17:57.688358+0000 mon.a (mon.0) 1907 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:17:59.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[30381]: cephadm 2021-03-10T15:17:57.688812+0000 mgr.gibba020.yqfnwy (mgr.34427) 4502 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:17:59.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[30381]: audit 2021-03-10T15:17:57.881187+0000 mon.a (mon.0) 1908 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:17:59.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[30381]: cephadm 2021-03-10T15:17:57.886580+0000 mgr.gibba020.yqfnwy (mgr.34427) 4503 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:17:59.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[30381]: audit 2021-03-10T15:17:57.888341+0000 mon.a (mon.0) 1909 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:17:59.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[30381]: cephadm 2021-03-10T15:17:57.888369+0000 mgr.gibba020.yqfnwy (mgr.34427) 4504 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:17:59.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[30381]: cephadm 2021-03-10T15:17:57.889593+0000 mgr.gibba020.yqfnwy (mgr.34427) 4505 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:17:59.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[30381]: cephadm 2021-03-10T15:17:57.889632+0000 mgr.gibba020.yqfnwy (mgr.34427) 4506 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:17:59.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[30381]: audit 2021-03-10T15:17:57.889785+0000 mon.a (mon.0) 1910 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:59.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[30381]: cephadm 2021-03-10T15:17:57.890875+0000 mgr.gibba020.yqfnwy (mgr.34427) 4507 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:17:59.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[30381]: cephadm 2021-03-10T15:17:57.890911+0000 mgr.gibba020.yqfnwy (mgr.34427) 4508 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:17:59.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[30381]: audit 2021-03-10T15:17:57.891078+0000 mon.a (mon.0) 1911 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:59.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[30381]: cephadm 2021-03-10T15:17:57.891915+0000 mgr.gibba020.yqfnwy (mgr.34427) 4509 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:17:59.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[30381]: audit 2021-03-10T15:17:57.892226+0000 mon.a (mon.0) 1912 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:59.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[30381]: cephadm 2021-03-10T15:17:57.892809+0000 mgr.gibba020.yqfnwy (mgr.34427) 4510 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:17:59.143 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[30381]: cephadm 2021-03-10T15:17:57.892850+0000 mgr.gibba020.yqfnwy (mgr.34427) 4511 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:17:59.143 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[30381]: cephadm 2021-03-10T15:17:57.894019+0000 mgr.gibba020.yqfnwy (mgr.34427) 4512 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:17:59.143 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[30381]: audit 2021-03-10T15:17:57.894258+0000 mon.a (mon.0) 1913 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:17:59.143 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[30381]: cephadm 2021-03-10T15:17:57.894373+0000 mgr.gibba020.yqfnwy (mgr.34427) 4513 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:17:59.144 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[30381]: cephadm 2021-03-10T15:17:57.895431+0000 mgr.gibba020.yqfnwy (mgr.34427) 4514 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:17:59.144 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[30381]: cephadm 2021-03-10T15:17:57.895475+0000 mgr.gibba020.yqfnwy (mgr.34427) 4515 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:17:59.144 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[30381]: cephadm 2021-03-10T15:17:57.895604+0000 mgr.gibba020.yqfnwy (mgr.34427) 4516 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:17:59.144 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:58 gibba013 bash[30381]: audit 2021-03-10T15:17:57.895669+0000 mon.a (mon.0) 1914 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:00.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:17:59 gibba020 bash[25448]: cluster 2021-03-10T15:17:58.071563+0000 mgr.gibba020.yqfnwy (mgr.34427) 4517 : cluster [DBG] pgmap v2559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:00.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:17:59 gibba013 bash[29418]: cluster 2021-03-10T15:17:58.071563+0000 mgr.gibba020.yqfnwy (mgr.34427) 4517 : cluster [DBG] pgmap v2559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:00.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:17:59 gibba013 bash[30381]: cluster 2021-03-10T15:17:58.071563+0000 mgr.gibba020.yqfnwy (mgr.34427) 4517 : cluster [DBG] pgmap v2559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:02.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:01 gibba020 bash[25448]: cluster 2021-03-10T15:18:00.072043+0000 mgr.gibba020.yqfnwy (mgr.34427) 4518 : cluster [DBG] pgmap v2560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:02.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:01 gibba013 bash[29418]: cluster 2021-03-10T15:18:00.072043+0000 mgr.gibba020.yqfnwy (mgr.34427) 4518 : cluster [DBG] pgmap v2560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:02.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:01 gibba013 bash[30381]: cluster 2021-03-10T15:18:00.072043+0000 mgr.gibba020.yqfnwy (mgr.34427) 4518 : cluster [DBG] pgmap v2560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:04.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:03 gibba020 bash[25448]: cluster 2021-03-10T15:18:02.073295+0000 mgr.gibba020.yqfnwy (mgr.34427) 4519 : cluster [DBG] pgmap v2561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:04.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:03 gibba013 bash[29418]: cluster 2021-03-10T15:18:02.073295+0000 mgr.gibba020.yqfnwy (mgr.34427) 4519 : cluster [DBG] pgmap v2561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:04.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:03 gibba013 bash[30381]: cluster 2021-03-10T15:18:02.073295+0000 mgr.gibba020.yqfnwy (mgr.34427) 4519 : cluster [DBG] pgmap v2561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:06.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:05 gibba020 bash[25448]: cluster 2021-03-10T15:18:04.074976+0000 mgr.gibba020.yqfnwy (mgr.34427) 4520 : cluster [DBG] pgmap v2562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:06.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:05 gibba013 bash[29418]: cluster 2021-03-10T15:18:04.074976+0000 mgr.gibba020.yqfnwy (mgr.34427) 4520 : cluster [DBG] pgmap v2562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:06.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:05 gibba013 bash[30381]: cluster 2021-03-10T15:18:04.074976+0000 mgr.gibba020.yqfnwy (mgr.34427) 4520 : cluster [DBG] pgmap v2562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:07.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:06 gibba020 bash[25448]: audit 2021-03-10T15:18:06.400197+0000 mon.a (mon.0) 1915 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:18:07.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:06 gibba020 bash[25448]: audit 2021-03-10T15:18:06.451078+0000 mon.a (mon.0) 1916 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:18:07.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:06 gibba020 bash[25448]: audit 2021-03-10T15:18:06.544682+0000 mon.a (mon.0) 1917 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:18:07.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:06 gibba020 bash[25448]: audit 2021-03-10T15:18:06.545429+0000 mon.a (mon.0) 1918 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:18:07.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:06 gibba020 bash[25448]: audit 2021-03-10T15:18:06.546189+0000 mon.a (mon.0) 1919 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:18:07.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:06 gibba020 bash[25448]: audit 2021-03-10T15:18:06.546896+0000 mon.a (mon.0) 1920 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:18:07.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:06 gibba013 bash[29418]: audit 2021-03-10T15:18:06.400197+0000 mon.a (mon.0) 1915 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:18:07.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:06 gibba013 bash[29418]: audit 2021-03-10T15:18:06.451078+0000 mon.a (mon.0) 1916 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:18:07.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:06 gibba013 bash[29418]: audit 2021-03-10T15:18:06.544682+0000 mon.a (mon.0) 1917 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:18:07.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:06 gibba013 bash[29418]: audit 2021-03-10T15:18:06.545429+0000 mon.a (mon.0) 1918 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:18:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:06 gibba013 bash[29418]: audit 2021-03-10T15:18:06.546189+0000 mon.a (mon.0) 1919 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:18:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:06 gibba013 bash[29418]: audit 2021-03-10T15:18:06.546896+0000 mon.a (mon.0) 1920 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:18:07.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:06 gibba013 bash[30381]: audit 2021-03-10T15:18:06.400197+0000 mon.a (mon.0) 1915 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:18:07.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:06 gibba013 bash[30381]: audit 2021-03-10T15:18:06.451078+0000 mon.a (mon.0) 1916 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:18:07.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:06 gibba013 bash[30381]: audit 2021-03-10T15:18:06.544682+0000 mon.a (mon.0) 1917 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:18:07.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:06 gibba013 bash[30381]: audit 2021-03-10T15:18:06.545429+0000 mon.a (mon.0) 1918 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:18:07.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:06 gibba013 bash[30381]: audit 2021-03-10T15:18:06.546189+0000 mon.a (mon.0) 1919 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:18:07.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:06 gibba013 bash[30381]: audit 2021-03-10T15:18:06.546896+0000 mon.a (mon.0) 1920 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:18:08.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:07 gibba020 bash[25448]: cluster 2021-03-10T15:18:06.075592+0000 mgr.gibba020.yqfnwy (mgr.34427) 4521 : cluster [DBG] pgmap v2563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:08.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:07 gibba013 bash[29418]: cluster 2021-03-10T15:18:06.075592+0000 mgr.gibba020.yqfnwy (mgr.34427) 4521 : cluster [DBG] pgmap v2563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:08.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:07 gibba013 bash[30381]: cluster 2021-03-10T15:18:06.075592+0000 mgr.gibba020.yqfnwy (mgr.34427) 4521 : cluster [DBG] pgmap v2563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:10.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:09 gibba020 bash[25448]: cluster 2021-03-10T15:18:08.075985+0000 mgr.gibba020.yqfnwy (mgr.34427) 4522 : cluster [DBG] pgmap v2564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:10.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:09 gibba013 bash[29418]: cluster 2021-03-10T15:18:08.075985+0000 mgr.gibba020.yqfnwy (mgr.34427) 4522 : cluster [DBG] pgmap v2564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:10.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:09 gibba013 bash[30381]: cluster 2021-03-10T15:18:08.075985+0000 mgr.gibba020.yqfnwy (mgr.34427) 4522 : cluster [DBG] pgmap v2564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:12.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:11 gibba013 bash[29418]: cluster 2021-03-10T15:18:10.077822+0000 mgr.gibba020.yqfnwy (mgr.34427) 4523 : cluster [DBG] pgmap v2565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:12.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:11 gibba013 bash[30381]: cluster 2021-03-10T15:18:10.077822+0000 mgr.gibba020.yqfnwy (mgr.34427) 4523 : cluster [DBG] pgmap v2565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:12.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:11 gibba020 bash[25448]: cluster 2021-03-10T15:18:10.077822+0000 mgr.gibba020.yqfnwy (mgr.34427) 4523 : cluster [DBG] pgmap v2565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:14.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:13 gibba013 bash[29418]: cluster 2021-03-10T15:18:12.079252+0000 mgr.gibba020.yqfnwy (mgr.34427) 4524 : cluster [DBG] pgmap v2566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:14.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:13 gibba013 bash[29418]: cephadm 2021-03-10T15:18:12.911137+0000 mgr.gibba020.yqfnwy (mgr.34427) 4525 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:18:14.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:13 gibba013 bash[30381]: cluster 2021-03-10T15:18:12.079252+0000 mgr.gibba020.yqfnwy (mgr.34427) 4524 : cluster [DBG] pgmap v2566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:14.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:13 gibba013 bash[30381]: cephadm 2021-03-10T15:18:12.911137+0000 mgr.gibba020.yqfnwy (mgr.34427) 4525 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:18:14.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:13 gibba020 bash[25448]: cluster 2021-03-10T15:18:12.079252+0000 mgr.gibba020.yqfnwy (mgr.34427) 4524 : cluster [DBG] pgmap v2566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:14.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:13 gibba020 bash[25448]: cephadm 2021-03-10T15:18:12.911137+0000 mgr.gibba020.yqfnwy (mgr.34427) 4525 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:18:16.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:15 gibba013 bash[29418]: cluster 2021-03-10T15:18:14.079801+0000 mgr.gibba020.yqfnwy (mgr.34427) 4526 : cluster [DBG] pgmap v2567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:16.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:15 gibba013 bash[30381]: cluster 2021-03-10T15:18:14.079801+0000 mgr.gibba020.yqfnwy (mgr.34427) 4526 : cluster [DBG] pgmap v2567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:16.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:15 gibba020 bash[25448]: cluster 2021-03-10T15:18:14.079801+0000 mgr.gibba020.yqfnwy (mgr.34427) 4526 : cluster [DBG] pgmap v2567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:18.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:17 gibba013 bash[29418]: cluster 2021-03-10T15:18:16.081523+0000 mgr.gibba020.yqfnwy (mgr.34427) 4527 : cluster [DBG] pgmap v2568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:18.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:17 gibba013 bash[30381]: cluster 2021-03-10T15:18:16.081523+0000 mgr.gibba020.yqfnwy (mgr.34427) 4527 : cluster [DBG] pgmap v2568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:18.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:17 gibba020 bash[25448]: cluster 2021-03-10T15:18:16.081523+0000 mgr.gibba020.yqfnwy (mgr.34427) 4527 : cluster [DBG] pgmap v2568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:20.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:19 gibba013 bash[29418]: cluster 2021-03-10T15:18:18.082573+0000 mgr.gibba020.yqfnwy (mgr.34427) 4528 : cluster [DBG] pgmap v2569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:20.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:19 gibba013 bash[30381]: cluster 2021-03-10T15:18:18.082573+0000 mgr.gibba020.yqfnwy (mgr.34427) 4528 : cluster [DBG] pgmap v2569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:20.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:19 gibba020 bash[25448]: cluster 2021-03-10T15:18:18.082573+0000 mgr.gibba020.yqfnwy (mgr.34427) 4528 : cluster [DBG] pgmap v2569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:21.822 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:18:22.050 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:18:22.051 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (84m) 9m ago 90m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:18:22.051 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (90m) 8m ago 90m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:18:22.051 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (85m) 8m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:18:22.051 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (85m) 8m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:18:22.052 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (84m) 9m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:18:22.052 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (84m) 9m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:18:22.052 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (83m) 8m ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:18:22.052 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (84m) 9m ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:18:22.053 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (90m) 9m ago 90m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:18:22.053 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (90m) 8m ago 90m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:18:22.053 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (83m) 9m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:18:22.053 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (82m) 9m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:18:22.053 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (82m) 9m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:18:22.054 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (81m) 9m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:18:22.054 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (81m) 8m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:18:22.054 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (80m) 8m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:18:22.054 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (80m) 8m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:18:22.054 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (80m) 8m ago 90m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:18:22.058 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (89m) 8m ago 90m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:18:22.058 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 8m ago 88m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:18:22.304 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:18:22.304 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:18:22.304 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:18:22.305 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:18:22.305 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:18:22.305 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:18:22.305 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:18:22.305 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:18:22.306 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:18:22.306 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:18:22.306 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:18:22.306 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:18:22.307 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:18:22.307 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:18:22.307 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:18:22.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:21 gibba013 bash[29418]: cluster 2021-03-10T15:18:20.084503+0000 mgr.gibba020.yqfnwy (mgr.34427) 4529 : cluster [DBG] pgmap v2570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:22.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:21 gibba013 bash[30381]: cluster 2021-03-10T15:18:20.084503+0000 mgr.gibba020.yqfnwy (mgr.34427) 4529 : cluster [DBG] pgmap v2570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:22.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:21 gibba020 bash[25448]: cluster 2021-03-10T15:18:20.084503+0000 mgr.gibba020.yqfnwy (mgr.34427) 4529 : cluster [DBG] pgmap v2570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:23.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:23 gibba013 bash[29418]: audit 2021-03-10T15:18:21.808688+0000 mgr.gibba020.yqfnwy (mgr.34427) 4530 : audit [DBG] from='client.57079 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:18:23.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:23 gibba013 bash[29418]: audit 2021-03-10T15:18:22.034046+0000 mgr.gibba020.yqfnwy (mgr.34427) 4531 : audit [DBG] from='client.57085 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:18:23.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:23 gibba013 bash[29418]: audit 2021-03-10T15:18:22.300384+0000 mon.a (mon.0) 1921 : audit [DBG] from='client.? 172.21.2.113:0/2079754873' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:23.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:23 gibba013 bash[30381]: audit 2021-03-10T15:18:21.808688+0000 mgr.gibba020.yqfnwy (mgr.34427) 4530 : audit [DBG] from='client.57079 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:18:23.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:23 gibba013 bash[30381]: audit 2021-03-10T15:18:22.034046+0000 mgr.gibba020.yqfnwy (mgr.34427) 4531 : audit [DBG] from='client.57085 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:18:23.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:23 gibba013 bash[30381]: audit 2021-03-10T15:18:22.300384+0000 mon.a (mon.0) 1921 : audit [DBG] from='client.? 172.21.2.113:0/2079754873' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:23.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:23 gibba020 bash[25448]: audit 2021-03-10T15:18:21.808688+0000 mgr.gibba020.yqfnwy (mgr.34427) 4530 : audit [DBG] from='client.57079 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:18:23.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:23 gibba020 bash[25448]: audit 2021-03-10T15:18:22.034046+0000 mgr.gibba020.yqfnwy (mgr.34427) 4531 : audit [DBG] from='client.57085 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:18:23.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:23 gibba020 bash[25448]: audit 2021-03-10T15:18:22.300384+0000 mon.a (mon.0) 1921 : audit [DBG] from='client.? 172.21.2.113:0/2079754873' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:24.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:24 gibba013 bash[29418]: cluster 2021-03-10T15:18:22.085259+0000 mgr.gibba020.yqfnwy (mgr.34427) 4532 : cluster [DBG] pgmap v2571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:24.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:24 gibba013 bash[30381]: cluster 2021-03-10T15:18:22.085259+0000 mgr.gibba020.yqfnwy (mgr.34427) 4532 : cluster [DBG] pgmap v2571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:24.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:24 gibba020 bash[25448]: cluster 2021-03-10T15:18:22.085259+0000 mgr.gibba020.yqfnwy (mgr.34427) 4532 : cluster [DBG] pgmap v2571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:26.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:26 gibba013 bash[29418]: cluster 2021-03-10T15:18:24.086114+0000 mgr.gibba020.yqfnwy (mgr.34427) 4533 : cluster [DBG] pgmap v2572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:26.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:26 gibba013 bash[30381]: cluster 2021-03-10T15:18:24.086114+0000 mgr.gibba020.yqfnwy (mgr.34427) 4533 : cluster [DBG] pgmap v2572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:26.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:26 gibba020 bash[25448]: cluster 2021-03-10T15:18:24.086114+0000 mgr.gibba020.yqfnwy (mgr.34427) 4533 : cluster [DBG] pgmap v2572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:28.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:28 gibba020 bash[25448]: cluster 2021-03-10T15:18:26.087006+0000 mgr.gibba020.yqfnwy (mgr.34427) 4534 : cluster [DBG] pgmap v2573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:28.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:28 gibba013 bash[29418]: cluster 2021-03-10T15:18:26.087006+0000 mgr.gibba020.yqfnwy (mgr.34427) 4534 : cluster [DBG] pgmap v2573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:28.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:28 gibba013 bash[30381]: cluster 2021-03-10T15:18:26.087006+0000 mgr.gibba020.yqfnwy (mgr.34427) 4534 : cluster [DBG] pgmap v2573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:29.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:29 gibba013 bash[29418]: cephadm 2021-03-10T15:18:27.927151+0000 mgr.gibba020.yqfnwy (mgr.34427) 4535 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:18:29.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:29 gibba013 bash[30381]: cephadm 2021-03-10T15:18:27.927151+0000 mgr.gibba020.yqfnwy (mgr.34427) 4535 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:18:29.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:29 gibba020 bash[25448]: cephadm 2021-03-10T15:18:27.927151+0000 mgr.gibba020.yqfnwy (mgr.34427) 4535 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:18:30.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:30 gibba013 bash[29418]: cluster 2021-03-10T15:18:28.087682+0000 mgr.gibba020.yqfnwy (mgr.34427) 4536 : cluster [DBG] pgmap v2574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:30.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:30 gibba013 bash[30381]: cluster 2021-03-10T15:18:28.087682+0000 mgr.gibba020.yqfnwy (mgr.34427) 4536 : cluster [DBG] pgmap v2574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:30.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:30 gibba020 bash[25448]: cluster 2021-03-10T15:18:28.087682+0000 mgr.gibba020.yqfnwy (mgr.34427) 4536 : cluster [DBG] pgmap v2574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:32.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:32 gibba013 bash[29418]: cluster 2021-03-10T15:18:30.089361+0000 mgr.gibba020.yqfnwy (mgr.34427) 4537 : cluster [DBG] pgmap v2575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:32.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:32 gibba013 bash[30381]: cluster 2021-03-10T15:18:30.089361+0000 mgr.gibba020.yqfnwy (mgr.34427) 4537 : cluster [DBG] pgmap v2575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:32.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:32 gibba020 bash[25448]: cluster 2021-03-10T15:18:30.089361+0000 mgr.gibba020.yqfnwy (mgr.34427) 4537 : cluster [DBG] pgmap v2575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:34.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:34 gibba013 bash[29418]: cluster 2021-03-10T15:18:32.090180+0000 mgr.gibba020.yqfnwy (mgr.34427) 4538 : cluster [DBG] pgmap v2576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:34.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:34 gibba013 bash[30381]: cluster 2021-03-10T15:18:32.090180+0000 mgr.gibba020.yqfnwy (mgr.34427) 4538 : cluster [DBG] pgmap v2576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:34.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:34 gibba020 bash[25448]: cluster 2021-03-10T15:18:32.090180+0000 mgr.gibba020.yqfnwy (mgr.34427) 4538 : cluster [DBG] pgmap v2576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:35.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:35 gibba013 bash[29418]: cluster 2021-03-10T15:18:34.090908+0000 mgr.gibba020.yqfnwy (mgr.34427) 4539 : cluster [DBG] pgmap v2577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:35.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:35 gibba013 bash[30381]: cluster 2021-03-10T15:18:34.090908+0000 mgr.gibba020.yqfnwy (mgr.34427) 4539 : cluster [DBG] pgmap v2577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:35.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:35 gibba020 bash[25448]: cluster 2021-03-10T15:18:34.090908+0000 mgr.gibba020.yqfnwy (mgr.34427) 4539 : cluster [DBG] pgmap v2577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:37.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:37 gibba013 bash[29418]: cluster 2021-03-10T15:18:36.092545+0000 mgr.gibba020.yqfnwy (mgr.34427) 4540 : cluster [DBG] pgmap v2578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:37.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:37 gibba013 bash[30381]: cluster 2021-03-10T15:18:36.092545+0000 mgr.gibba020.yqfnwy (mgr.34427) 4540 : cluster [DBG] pgmap v2578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:37.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:37 gibba020 bash[25448]: cluster 2021-03-10T15:18:36.092545+0000 mgr.gibba020.yqfnwy (mgr.34427) 4540 : cluster [DBG] pgmap v2578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:39.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:39 gibba020 bash[25448]: cluster 2021-03-10T15:18:38.093059+0000 mgr.gibba020.yqfnwy (mgr.34427) 4541 : cluster [DBG] pgmap v2579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:39.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:39 gibba013 bash[29418]: cluster 2021-03-10T15:18:38.093059+0000 mgr.gibba020.yqfnwy (mgr.34427) 4541 : cluster [DBG] pgmap v2579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:39.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:39 gibba013 bash[30381]: cluster 2021-03-10T15:18:38.093059+0000 mgr.gibba020.yqfnwy (mgr.34427) 4541 : cluster [DBG] pgmap v2579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:41.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:41 gibba020 bash[25448]: cluster 2021-03-10T15:18:40.094394+0000 mgr.gibba020.yqfnwy (mgr.34427) 4542 : cluster [DBG] pgmap v2580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:41.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:41 gibba013 bash[29418]: cluster 2021-03-10T15:18:40.094394+0000 mgr.gibba020.yqfnwy (mgr.34427) 4542 : cluster [DBG] pgmap v2580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:41.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:41 gibba013 bash[30381]: cluster 2021-03-10T15:18:40.094394+0000 mgr.gibba020.yqfnwy (mgr.34427) 4542 : cluster [DBG] pgmap v2580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:43.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:43 gibba020 bash[25448]: cluster 2021-03-10T15:18:42.095611+0000 mgr.gibba020.yqfnwy (mgr.34427) 4543 : cluster [DBG] pgmap v2581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:43.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:43 gibba020 bash[25448]: cephadm 2021-03-10T15:18:42.934924+0000 mgr.gibba020.yqfnwy (mgr.34427) 4544 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:18:43.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:43 gibba013 bash[29418]: cluster 2021-03-10T15:18:42.095611+0000 mgr.gibba020.yqfnwy (mgr.34427) 4543 : cluster [DBG] pgmap v2581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:43.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:43 gibba013 bash[29418]: cephadm 2021-03-10T15:18:42.934924+0000 mgr.gibba020.yqfnwy (mgr.34427) 4544 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:18:43.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:43 gibba013 bash[30381]: cluster 2021-03-10T15:18:42.095611+0000 mgr.gibba020.yqfnwy (mgr.34427) 4543 : cluster [DBG] pgmap v2581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:43.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:43 gibba013 bash[30381]: cephadm 2021-03-10T15:18:42.934924+0000 mgr.gibba020.yqfnwy (mgr.34427) 4544 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:18:45.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:45 gibba020 bash[25448]: cluster 2021-03-10T15:18:44.097274+0000 mgr.gibba020.yqfnwy (mgr.34427) 4545 : cluster [DBG] pgmap v2582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:45.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:45 gibba013 bash[29418]: cluster 2021-03-10T15:18:44.097274+0000 mgr.gibba020.yqfnwy (mgr.34427) 4545 : cluster [DBG] pgmap v2582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:45.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:45 gibba013 bash[30381]: cluster 2021-03-10T15:18:44.097274+0000 mgr.gibba020.yqfnwy (mgr.34427) 4545 : cluster [DBG] pgmap v2582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:47.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:47 gibba020 bash[25448]: cluster 2021-03-10T15:18:46.098189+0000 mgr.gibba020.yqfnwy (mgr.34427) 4546 : cluster [DBG] pgmap v2583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:47.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:47 gibba013 bash[29418]: cluster 2021-03-10T15:18:46.098189+0000 mgr.gibba020.yqfnwy (mgr.34427) 4546 : cluster [DBG] pgmap v2583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:47.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:47 gibba013 bash[30381]: cluster 2021-03-10T15:18:46.098189+0000 mgr.gibba020.yqfnwy (mgr.34427) 4546 : cluster [DBG] pgmap v2583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:49.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:49 gibba020 bash[25448]: cluster 2021-03-10T15:18:48.098775+0000 mgr.gibba020.yqfnwy (mgr.34427) 4547 : cluster [DBG] pgmap v2584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:49.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:49 gibba013 bash[29418]: cluster 2021-03-10T15:18:48.098775+0000 mgr.gibba020.yqfnwy (mgr.34427) 4547 : cluster [DBG] pgmap v2584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:49.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:49 gibba013 bash[30381]: cluster 2021-03-10T15:18:48.098775+0000 mgr.gibba020.yqfnwy (mgr.34427) 4547 : cluster [DBG] pgmap v2584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:51.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:51 gibba020 bash[25448]: cluster 2021-03-10T15:18:50.100165+0000 mgr.gibba020.yqfnwy (mgr.34427) 4548 : cluster [DBG] pgmap v2585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:51.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:51 gibba013 bash[29418]: cluster 2021-03-10T15:18:50.100165+0000 mgr.gibba020.yqfnwy (mgr.34427) 4548 : cluster [DBG] pgmap v2585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:51.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:51 gibba013 bash[30381]: cluster 2021-03-10T15:18:50.100165+0000 mgr.gibba020.yqfnwy (mgr.34427) 4548 : cluster [DBG] pgmap v2585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:52.549 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:18:52.777 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:18:52.777 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (85m) 10m ago 90m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:18:52.777 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (90m) 9m ago 90m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:18:52.778 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (85m) 9m ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:18:52.778 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (86m) 9m ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:18:52.778 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (85m) 10m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:18:52.778 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (84m) 10m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:18:52.779 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (84m) 9m ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:18:52.779 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (84m) 10m ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:18:52.779 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (90m) 10m ago 90m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:18:52.779 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (90m) 9m ago 90m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:18:52.779 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (83m) 10m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:18:52.780 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (83m) 10m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:18:52.780 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (82m) 10m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:18:52.780 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (82m) 10m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:18:52.780 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (81m) 9m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:18:52.781 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (81m) 9m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:18:52.781 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (81m) 9m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:18:52.781 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (80m) 9m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:18:52.781 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (90m) 9m ago 90m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:18:52.781 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 9m ago 88m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:18:53.029 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:18:53.029 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:18:53.029 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:18:53.029 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:18:53.030 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:18:53.030 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:18:53.030 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:18:53.030 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:18:53.031 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:18:53.031 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:18:53.031 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:18:53.031 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:18:53.031 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:18:53.032 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:18:53.032 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:18:53.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:53 gibba013 bash[29418]: cluster 2021-03-10T15:18:52.101562+0000 mgr.gibba020.yqfnwy (mgr.34427) 4549 : cluster [DBG] pgmap v2586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:53.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:53 gibba013 bash[29418]: audit 2021-03-10T15:18:52.535937+0000 mgr.gibba020.yqfnwy (mgr.34427) 4550 : audit [DBG] from='client.57097 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:18:53.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:53 gibba013 bash[29418]: audit 2021-03-10T15:18:52.759920+0000 mgr.gibba020.yqfnwy (mgr.34427) 4551 : audit [DBG] from='client.47118 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:18:53.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:53 gibba013 bash[29418]: audit 2021-03-10T15:18:53.025235+0000 mon.c (mon.1) 77 : audit [DBG] from='client.? 172.21.2.113:0/2814266426' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:53.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:53 gibba013 bash[30381]: cluster 2021-03-10T15:18:52.101562+0000 mgr.gibba020.yqfnwy (mgr.34427) 4549 : cluster [DBG] pgmap v2586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:53.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:53 gibba013 bash[30381]: audit 2021-03-10T15:18:52.535937+0000 mgr.gibba020.yqfnwy (mgr.34427) 4550 : audit [DBG] from='client.57097 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:18:53.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:53 gibba013 bash[30381]: audit 2021-03-10T15:18:52.759920+0000 mgr.gibba020.yqfnwy (mgr.34427) 4551 : audit [DBG] from='client.47118 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:18:53.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:53 gibba013 bash[30381]: audit 2021-03-10T15:18:53.025235+0000 mon.c (mon.1) 77 : audit [DBG] from='client.? 172.21.2.113:0/2814266426' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:53.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:53 gibba020 bash[25448]: cluster 2021-03-10T15:18:52.101562+0000 mgr.gibba020.yqfnwy (mgr.34427) 4549 : cluster [DBG] pgmap v2586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:53.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:53 gibba020 bash[25448]: audit 2021-03-10T15:18:52.535937+0000 mgr.gibba020.yqfnwy (mgr.34427) 4550 : audit [DBG] from='client.57097 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:18:53.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:53 gibba020 bash[25448]: audit 2021-03-10T15:18:52.759920+0000 mgr.gibba020.yqfnwy (mgr.34427) 4551 : audit [DBG] from='client.47118 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:18:53.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:53 gibba020 bash[25448]: audit 2021-03-10T15:18:53.025235+0000 mon.c (mon.1) 77 : audit [DBG] from='client.? 172.21.2.113:0/2814266426' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:18:55.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:55 gibba013 bash[29418]: cluster 2021-03-10T15:18:54.102416+0000 mgr.gibba020.yqfnwy (mgr.34427) 4552 : cluster [DBG] pgmap v2587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:55.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:55 gibba013 bash[30381]: cluster 2021-03-10T15:18:54.102416+0000 mgr.gibba020.yqfnwy (mgr.34427) 4552 : cluster [DBG] pgmap v2587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:55.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:55 gibba020 bash[25448]: cluster 2021-03-10T15:18:54.102416+0000 mgr.gibba020.yqfnwy (mgr.34427) 4552 : cluster [DBG] pgmap v2587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:57.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:57 gibba013 bash[29418]: cluster 2021-03-10T15:18:56.104129+0000 mgr.gibba020.yqfnwy (mgr.34427) 4553 : cluster [DBG] pgmap v2588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:57.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:57 gibba013 bash[30381]: cluster 2021-03-10T15:18:56.104129+0000 mgr.gibba020.yqfnwy (mgr.34427) 4553 : cluster [DBG] pgmap v2588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:57.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:57 gibba020 bash[25448]: cluster 2021-03-10T15:18:56.104129+0000 mgr.gibba020.yqfnwy (mgr.34427) 4553 : cluster [DBG] pgmap v2588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:58.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:58 gibba013 bash[29418]: audit 2021-03-10T15:18:57.952976+0000 mon.a (mon.0) 1922 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:18:58.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:58 gibba013 bash[29418]: cephadm 2021-03-10T15:18:57.958822+0000 mgr.gibba020.yqfnwy (mgr.34427) 4554 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:18:58.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:58 gibba013 bash[29418]: audit 2021-03-10T15:18:57.960145+0000 mon.a (mon.0) 1923 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:18:58.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:58 gibba013 bash[30381]: audit 2021-03-10T15:18:57.952976+0000 mon.a (mon.0) 1922 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:18:58.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:58 gibba013 bash[30381]: cephadm 2021-03-10T15:18:57.958822+0000 mgr.gibba020.yqfnwy (mgr.34427) 4554 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:18:58.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:58 gibba013 bash[30381]: audit 2021-03-10T15:18:57.960145+0000 mon.a (mon.0) 1923 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:18:58.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:58 gibba020 bash[25448]: audit 2021-03-10T15:18:57.952976+0000 mon.a (mon.0) 1922 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:18:58.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:58 gibba020 bash[25448]: cephadm 2021-03-10T15:18:57.958822+0000 mgr.gibba020.yqfnwy (mgr.34427) 4554 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:18:58.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:58 gibba020 bash[25448]: audit 2021-03-10T15:18:57.960145+0000 mon.a (mon.0) 1923 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:18:59.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:18:59 gibba013 bash[29418]: cluster 2021-03-10T15:18:58.104560+0000 mgr.gibba020.yqfnwy (mgr.34427) 4555 : cluster [DBG] pgmap v2589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:59.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:18:59 gibba013 bash[30381]: cluster 2021-03-10T15:18:58.104560+0000 mgr.gibba020.yqfnwy (mgr.34427) 4555 : cluster [DBG] pgmap v2589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:18:59.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:18:59 gibba020 bash[25448]: cluster 2021-03-10T15:18:58.104560+0000 mgr.gibba020.yqfnwy (mgr.34427) 4555 : cluster [DBG] pgmap v2589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:01.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:01 gibba013 bash[29418]: cluster 2021-03-10T15:19:00.105386+0000 mgr.gibba020.yqfnwy (mgr.34427) 4556 : cluster [DBG] pgmap v2590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:01.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:01 gibba013 bash[30381]: cluster 2021-03-10T15:19:00.105386+0000 mgr.gibba020.yqfnwy (mgr.34427) 4556 : cluster [DBG] pgmap v2590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:01.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:01 gibba020 bash[25448]: cluster 2021-03-10T15:19:00.105386+0000 mgr.gibba020.yqfnwy (mgr.34427) 4556 : cluster [DBG] pgmap v2590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:02.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[29418]: cephadm 2021-03-10T15:19:01.589591+0000 mgr.gibba020.yqfnwy (mgr.34427) 4557 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:19:02.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[29418]: audit 2021-03-10T15:19:01.590069+0000 mon.a (mon.0) 1924 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:19:02.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[29418]: audit 2021-03-10T15:19:01.812317+0000 mon.a (mon.0) 1925 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:19:02.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[29418]: cephadm 2021-03-10T15:19:01.818204+0000 mgr.gibba020.yqfnwy (mgr.34427) 4558 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:19:02.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[29418]: audit 2021-03-10T15:19:01.820262+0000 mon.a (mon.0) 1926 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:19:02.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[29418]: cephadm 2021-03-10T15:19:01.820607+0000 mgr.gibba020.yqfnwy (mgr.34427) 4559 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:19:02.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[29418]: audit 2021-03-10T15:19:01.822228+0000 mon.a (mon.0) 1927 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:02.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[29418]: cephadm 2021-03-10T15:19:01.822814+0000 mgr.gibba020.yqfnwy (mgr.34427) 4560 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:19:02.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[29418]: cephadm 2021-03-10T15:19:01.822852+0000 mgr.gibba020.yqfnwy (mgr.34427) 4561 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:19:02.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[29418]: audit 2021-03-10T15:19:01.824388+0000 mon.a (mon.0) 1928 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:02.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[29418]: cephadm 2021-03-10T15:19:01.824494+0000 mgr.gibba020.yqfnwy (mgr.34427) 4562 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:19:02.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[29418]: cephadm 2021-03-10T15:19:01.824530+0000 mgr.gibba020.yqfnwy (mgr.34427) 4563 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:19:02.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[29418]: audit 2021-03-10T15:19:01.826023+0000 mon.a (mon.0) 1929 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:02.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[29418]: cephadm 2021-03-10T15:19:01.826209+0000 mgr.gibba020.yqfnwy (mgr.34427) 4564 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:19:02.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[29418]: cephadm 2021-03-10T15:19:01.827629+0000 mgr.gibba020.yqfnwy (mgr.34427) 4565 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:19:02.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[29418]: cephadm 2021-03-10T15:19:01.827666+0000 mgr.gibba020.yqfnwy (mgr.34427) 4566 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:19:02.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[29418]: audit 2021-03-10T15:19:01.829237+0000 mon.a (mon.0) 1930 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:02.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[29418]: cephadm 2021-03-10T15:19:01.829389+0000 mgr.gibba020.yqfnwy (mgr.34427) 4567 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:19:02.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[29418]: cephadm 2021-03-10T15:19:01.829830+0000 mgr.gibba020.yqfnwy (mgr.34427) 4568 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:19:02.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[29418]: audit 2021-03-10T15:19:01.831265+0000 mon.a (mon.0) 1931 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:02.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[29418]: cephadm 2021-03-10T15:19:01.831355+0000 mgr.gibba020.yqfnwy (mgr.34427) 4569 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:19:02.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[29418]: cephadm 2021-03-10T15:19:01.831396+0000 mgr.gibba020.yqfnwy (mgr.34427) 4570 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:19:02.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[29418]: cephadm 2021-03-10T15:19:01.831522+0000 mgr.gibba020.yqfnwy (mgr.34427) 4571 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:19:02.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[30381]: cephadm 2021-03-10T15:19:01.589591+0000 mgr.gibba020.yqfnwy (mgr.34427) 4557 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:19:02.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[30381]: audit 2021-03-10T15:19:01.590069+0000 mon.a (mon.0) 1924 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:19:02.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[30381]: audit 2021-03-10T15:19:01.812317+0000 mon.a (mon.0) 1925 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:19:02.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[30381]: cephadm 2021-03-10T15:19:01.818204+0000 mgr.gibba020.yqfnwy (mgr.34427) 4558 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:19:02.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[30381]: audit 2021-03-10T15:19:01.820262+0000 mon.a (mon.0) 1926 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:19:02.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[30381]: cephadm 2021-03-10T15:19:01.820607+0000 mgr.gibba020.yqfnwy (mgr.34427) 4559 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:19:02.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[30381]: audit 2021-03-10T15:19:01.822228+0000 mon.a (mon.0) 1927 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:02.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[30381]: cephadm 2021-03-10T15:19:01.822814+0000 mgr.gibba020.yqfnwy (mgr.34427) 4560 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:19:02.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[30381]: cephadm 2021-03-10T15:19:01.822852+0000 mgr.gibba020.yqfnwy (mgr.34427) 4561 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:19:02.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[30381]: audit 2021-03-10T15:19:01.824388+0000 mon.a (mon.0) 1928 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:02.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[30381]: cephadm 2021-03-10T15:19:01.824494+0000 mgr.gibba020.yqfnwy (mgr.34427) 4562 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:19:02.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[30381]: cephadm 2021-03-10T15:19:01.824530+0000 mgr.gibba020.yqfnwy (mgr.34427) 4563 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:19:02.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[30381]: audit 2021-03-10T15:19:01.826023+0000 mon.a (mon.0) 1929 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:02.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[30381]: cephadm 2021-03-10T15:19:01.826209+0000 mgr.gibba020.yqfnwy (mgr.34427) 4564 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:19:02.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[30381]: cephadm 2021-03-10T15:19:01.827629+0000 mgr.gibba020.yqfnwy (mgr.34427) 4565 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:19:02.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[30381]: cephadm 2021-03-10T15:19:01.827666+0000 mgr.gibba020.yqfnwy (mgr.34427) 4566 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:19:02.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[30381]: audit 2021-03-10T15:19:01.829237+0000 mon.a (mon.0) 1930 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:02.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[30381]: cephadm 2021-03-10T15:19:01.829389+0000 mgr.gibba020.yqfnwy (mgr.34427) 4567 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:19:02.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[30381]: cephadm 2021-03-10T15:19:01.829830+0000 mgr.gibba020.yqfnwy (mgr.34427) 4568 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:19:02.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[30381]: audit 2021-03-10T15:19:01.831265+0000 mon.a (mon.0) 1931 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:02.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[30381]: cephadm 2021-03-10T15:19:01.831355+0000 mgr.gibba020.yqfnwy (mgr.34427) 4569 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:19:02.893 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[30381]: cephadm 2021-03-10T15:19:01.831396+0000 mgr.gibba020.yqfnwy (mgr.34427) 4570 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:19:02.893 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:02 gibba013 bash[30381]: cephadm 2021-03-10T15:19:01.831522+0000 mgr.gibba020.yqfnwy (mgr.34427) 4571 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:19:02.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:02 gibba020 bash[25448]: cephadm 2021-03-10T15:19:01.589591+0000 mgr.gibba020.yqfnwy (mgr.34427) 4557 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:19:02.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:02 gibba020 bash[25448]: audit 2021-03-10T15:19:01.590069+0000 mon.a (mon.0) 1924 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:19:02.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:02 gibba020 bash[25448]: audit 2021-03-10T15:19:01.812317+0000 mon.a (mon.0) 1925 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:19:02.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:02 gibba020 bash[25448]: cephadm 2021-03-10T15:19:01.818204+0000 mgr.gibba020.yqfnwy (mgr.34427) 4558 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:19:02.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:02 gibba020 bash[25448]: audit 2021-03-10T15:19:01.820262+0000 mon.a (mon.0) 1926 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:19:02.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:02 gibba020 bash[25448]: cephadm 2021-03-10T15:19:01.820607+0000 mgr.gibba020.yqfnwy (mgr.34427) 4559 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:19:02.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:02 gibba020 bash[25448]: audit 2021-03-10T15:19:01.822228+0000 mon.a (mon.0) 1927 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:02.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:02 gibba020 bash[25448]: cephadm 2021-03-10T15:19:01.822814+0000 mgr.gibba020.yqfnwy (mgr.34427) 4560 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:19:02.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:02 gibba020 bash[25448]: cephadm 2021-03-10T15:19:01.822852+0000 mgr.gibba020.yqfnwy (mgr.34427) 4561 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:19:02.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:02 gibba020 bash[25448]: audit 2021-03-10T15:19:01.824388+0000 mon.a (mon.0) 1928 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:02.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:02 gibba020 bash[25448]: cephadm 2021-03-10T15:19:01.824494+0000 mgr.gibba020.yqfnwy (mgr.34427) 4562 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:19:02.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:02 gibba020 bash[25448]: cephadm 2021-03-10T15:19:01.824530+0000 mgr.gibba020.yqfnwy (mgr.34427) 4563 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:19:02.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:02 gibba020 bash[25448]: audit 2021-03-10T15:19:01.826023+0000 mon.a (mon.0) 1929 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:02.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:02 gibba020 bash[25448]: cephadm 2021-03-10T15:19:01.826209+0000 mgr.gibba020.yqfnwy (mgr.34427) 4564 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:19:02.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:02 gibba020 bash[25448]: cephadm 2021-03-10T15:19:01.827629+0000 mgr.gibba020.yqfnwy (mgr.34427) 4565 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:19:02.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:02 gibba020 bash[25448]: cephadm 2021-03-10T15:19:01.827666+0000 mgr.gibba020.yqfnwy (mgr.34427) 4566 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:19:02.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:02 gibba020 bash[25448]: audit 2021-03-10T15:19:01.829237+0000 mon.a (mon.0) 1930 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:02.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:02 gibba020 bash[25448]: cephadm 2021-03-10T15:19:01.829389+0000 mgr.gibba020.yqfnwy (mgr.34427) 4567 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:19:02.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:02 gibba020 bash[25448]: cephadm 2021-03-10T15:19:01.829830+0000 mgr.gibba020.yqfnwy (mgr.34427) 4568 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:19:02.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:02 gibba020 bash[25448]: audit 2021-03-10T15:19:01.831265+0000 mon.a (mon.0) 1931 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:02.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:02 gibba020 bash[25448]: cephadm 2021-03-10T15:19:01.831355+0000 mgr.gibba020.yqfnwy (mgr.34427) 4569 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:19:02.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:02 gibba020 bash[25448]: cephadm 2021-03-10T15:19:01.831396+0000 mgr.gibba020.yqfnwy (mgr.34427) 4570 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:19:02.957 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:02 gibba020 bash[25448]: cephadm 2021-03-10T15:19:01.831522+0000 mgr.gibba020.yqfnwy (mgr.34427) 4571 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:19:04.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:03 gibba013 bash[29418]: cluster 2021-03-10T15:19:02.106064+0000 mgr.gibba020.yqfnwy (mgr.34427) 4572 : cluster [DBG] pgmap v2591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:04.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:03 gibba013 bash[30381]: cluster 2021-03-10T15:19:02.106064+0000 mgr.gibba020.yqfnwy (mgr.34427) 4572 : cluster [DBG] pgmap v2591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:04.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:03 gibba020 bash[25448]: cluster 2021-03-10T15:19:02.106064+0000 mgr.gibba020.yqfnwy (mgr.34427) 4572 : cluster [DBG] pgmap v2591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:06.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:05 gibba013 bash[29418]: cluster 2021-03-10T15:19:04.107513+0000 mgr.gibba020.yqfnwy (mgr.34427) 4573 : cluster [DBG] pgmap v2592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:06.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:05 gibba013 bash[30381]: cluster 2021-03-10T15:19:04.107513+0000 mgr.gibba020.yqfnwy (mgr.34427) 4573 : cluster [DBG] pgmap v2592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:06.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:05 gibba020 bash[25448]: cluster 2021-03-10T15:19:04.107513+0000 mgr.gibba020.yqfnwy (mgr.34427) 4573 : cluster [DBG] pgmap v2592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:07.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:06 gibba013 bash[29418]: audit 2021-03-10T15:19:06.405195+0000 mon.a (mon.0) 1932 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:19:07.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:06 gibba013 bash[29418]: audit 2021-03-10T15:19:06.458056+0000 mon.a (mon.0) 1933 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:19:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:06 gibba013 bash[29418]: audit 2021-03-10T15:19:06.553742+0000 mon.a (mon.0) 1934 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:19:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:06 gibba013 bash[29418]: audit 2021-03-10T15:19:06.554652+0000 mon.a (mon.0) 1935 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:19:07.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:06 gibba013 bash[29418]: audit 2021-03-10T15:19:06.555729+0000 mon.a (mon.0) 1936 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:19:07.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:06 gibba013 bash[29418]: audit 2021-03-10T15:19:06.556566+0000 mon.a (mon.0) 1937 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:19:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:06 gibba013 bash[30381]: audit 2021-03-10T15:19:06.405195+0000 mon.a (mon.0) 1932 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:19:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:06 gibba013 bash[30381]: audit 2021-03-10T15:19:06.458056+0000 mon.a (mon.0) 1933 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:19:07.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:06 gibba013 bash[30381]: audit 2021-03-10T15:19:06.553742+0000 mon.a (mon.0) 1934 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:19:07.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:06 gibba013 bash[30381]: audit 2021-03-10T15:19:06.554652+0000 mon.a (mon.0) 1935 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:19:07.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:06 gibba013 bash[30381]: audit 2021-03-10T15:19:06.555729+0000 mon.a (mon.0) 1936 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:19:07.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:06 gibba013 bash[30381]: audit 2021-03-10T15:19:06.556566+0000 mon.a (mon.0) 1937 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:19:07.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:06 gibba020 bash[25448]: audit 2021-03-10T15:19:06.405195+0000 mon.a (mon.0) 1932 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:19:07.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:06 gibba020 bash[25448]: audit 2021-03-10T15:19:06.458056+0000 mon.a (mon.0) 1933 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:19:07.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:06 gibba020 bash[25448]: audit 2021-03-10T15:19:06.553742+0000 mon.a (mon.0) 1934 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:19:07.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:06 gibba020 bash[25448]: audit 2021-03-10T15:19:06.554652+0000 mon.a (mon.0) 1935 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:19:07.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:06 gibba020 bash[25448]: audit 2021-03-10T15:19:06.555729+0000 mon.a (mon.0) 1936 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:19:07.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:06 gibba020 bash[25448]: audit 2021-03-10T15:19:06.556566+0000 mon.a (mon.0) 1937 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:19:08.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:07 gibba013 bash[29418]: cluster 2021-03-10T15:19:06.109265+0000 mgr.gibba020.yqfnwy (mgr.34427) 4574 : cluster [DBG] pgmap v2593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:08.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:07 gibba013 bash[30381]: cluster 2021-03-10T15:19:06.109265+0000 mgr.gibba020.yqfnwy (mgr.34427) 4574 : cluster [DBG] pgmap v2593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:08.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:07 gibba020 bash[25448]: cluster 2021-03-10T15:19:06.109265+0000 mgr.gibba020.yqfnwy (mgr.34427) 4574 : cluster [DBG] pgmap v2593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:10.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:09 gibba013 bash[29418]: cluster 2021-03-10T15:19:08.110616+0000 mgr.gibba020.yqfnwy (mgr.34427) 4575 : cluster [DBG] pgmap v2594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:10.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:09 gibba013 bash[30381]: cluster 2021-03-10T15:19:08.110616+0000 mgr.gibba020.yqfnwy (mgr.34427) 4575 : cluster [DBG] pgmap v2594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:10.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:09 gibba020 bash[25448]: cluster 2021-03-10T15:19:08.110616+0000 mgr.gibba020.yqfnwy (mgr.34427) 4575 : cluster [DBG] pgmap v2594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:12.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:11 gibba013 bash[29418]: cluster 2021-03-10T15:19:10.111760+0000 mgr.gibba020.yqfnwy (mgr.34427) 4576 : cluster [DBG] pgmap v2595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:12.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:11 gibba013 bash[30381]: cluster 2021-03-10T15:19:10.111760+0000 mgr.gibba020.yqfnwy (mgr.34427) 4576 : cluster [DBG] pgmap v2595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:12.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:11 gibba020 bash[25448]: cluster 2021-03-10T15:19:10.111760+0000 mgr.gibba020.yqfnwy (mgr.34427) 4576 : cluster [DBG] pgmap v2595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:14.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:13 gibba013 bash[29418]: cluster 2021-03-10T15:19:12.113111+0000 mgr.gibba020.yqfnwy (mgr.34427) 4577 : cluster [DBG] pgmap v2596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:14.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:13 gibba013 bash[30381]: cluster 2021-03-10T15:19:12.113111+0000 mgr.gibba020.yqfnwy (mgr.34427) 4577 : cluster [DBG] pgmap v2596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:14.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:13 gibba020 bash[25448]: cluster 2021-03-10T15:19:12.113111+0000 mgr.gibba020.yqfnwy (mgr.34427) 4577 : cluster [DBG] pgmap v2596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:16.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:15 gibba020 bash[25448]: cluster 2021-03-10T15:19:14.114772+0000 mgr.gibba020.yqfnwy (mgr.34427) 4578 : cluster [DBG] pgmap v2597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:16.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:15 gibba013 bash[29418]: cluster 2021-03-10T15:19:14.114772+0000 mgr.gibba020.yqfnwy (mgr.34427) 4578 : cluster [DBG] pgmap v2597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:16.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:15 gibba013 bash[30381]: cluster 2021-03-10T15:19:14.114772+0000 mgr.gibba020.yqfnwy (mgr.34427) 4578 : cluster [DBG] pgmap v2597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:18.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:17 gibba020 bash[25448]: cluster 2021-03-10T15:19:16.116559+0000 mgr.gibba020.yqfnwy (mgr.34427) 4579 : cluster [DBG] pgmap v2598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:18.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:17 gibba020 bash[25448]: cephadm 2021-03-10T15:19:16.847539+0000 mgr.gibba020.yqfnwy (mgr.34427) 4580 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:19:18.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:17 gibba013 bash[29418]: cluster 2021-03-10T15:19:16.116559+0000 mgr.gibba020.yqfnwy (mgr.34427) 4579 : cluster [DBG] pgmap v2598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:18.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:17 gibba013 bash[29418]: cephadm 2021-03-10T15:19:16.847539+0000 mgr.gibba020.yqfnwy (mgr.34427) 4580 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:19:18.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:17 gibba013 bash[30381]: cluster 2021-03-10T15:19:16.116559+0000 mgr.gibba020.yqfnwy (mgr.34427) 4579 : cluster [DBG] pgmap v2598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:18.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:17 gibba013 bash[30381]: cephadm 2021-03-10T15:19:16.847539+0000 mgr.gibba020.yqfnwy (mgr.34427) 4580 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:19:20.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:19 gibba020 bash[25448]: cluster 2021-03-10T15:19:18.117210+0000 mgr.gibba020.yqfnwy (mgr.34427) 4581 : cluster [DBG] pgmap v2599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:20.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:19 gibba013 bash[29418]: cluster 2021-03-10T15:19:18.117210+0000 mgr.gibba020.yqfnwy (mgr.34427) 4581 : cluster [DBG] pgmap v2599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:20.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:19 gibba013 bash[30381]: cluster 2021-03-10T15:19:18.117210+0000 mgr.gibba020.yqfnwy (mgr.34427) 4581 : cluster [DBG] pgmap v2599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:22.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:21 gibba020 bash[25448]: cluster 2021-03-10T15:19:20.118753+0000 mgr.gibba020.yqfnwy (mgr.34427) 4582 : cluster [DBG] pgmap v2600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:22.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:21 gibba013 bash[29418]: cluster 2021-03-10T15:19:20.118753+0000 mgr.gibba020.yqfnwy (mgr.34427) 4582 : cluster [DBG] pgmap v2600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:22.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:21 gibba013 bash[30381]: cluster 2021-03-10T15:19:20.118753+0000 mgr.gibba020.yqfnwy (mgr.34427) 4582 : cluster [DBG] pgmap v2600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:23.275 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:19:23.504 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:19:23.505 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (85m) 21s ago 91m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:19:23.505 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (91m) 9m ago 91m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:19:23.505 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (86m) 9m ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:19:23.505 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (86m) 9m ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:19:23.506 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (85m) 21s ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:19:23.506 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (85m) 21s ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:19:23.506 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (84m) 9m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:19:23.506 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (85m) 21s ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:19:23.506 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (91m) 21s ago 91m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:19:23.507 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (91m) 9m ago 91m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:19:23.507 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (84m) 21s ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:19:23.507 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (83m) 21s ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:19:23.507 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (83m) 21s ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:19:23.508 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (82m) 21s ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:19:23.508 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (82m) 9m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:19:23.508 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (82m) 9m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:19:23.508 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (81m) 9m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:19:23.508 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (81m) 9m ago 91m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:19:23.509 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (90m) 9m ago 91m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:19:23.509 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 9m ago 89m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:19:23.755 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:19:23.756 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:19:23.756 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:19:23.756 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:19:23.756 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:19:23.756 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:19:23.757 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:19:23.757 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:19:23.757 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:19:23.757 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:19:23.758 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:19:23.758 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:19:23.758 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:19:23.758 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:19:23.759 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:19:24.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:23 gibba020 bash[25448]: cluster 2021-03-10T15:19:22.120220+0000 mgr.gibba020.yqfnwy (mgr.34427) 4583 : cluster [DBG] pgmap v2601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:24.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:23 gibba020 bash[25448]: audit 2021-03-10T15:19:23.752108+0000 mon.c (mon.1) 78 : audit [DBG] from='client.? 172.21.2.113:0/881963543' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:24.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:23 gibba013 bash[29418]: cluster 2021-03-10T15:19:22.120220+0000 mgr.gibba020.yqfnwy (mgr.34427) 4583 : cluster [DBG] pgmap v2601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:24.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:23 gibba013 bash[29418]: audit 2021-03-10T15:19:23.752108+0000 mon.c (mon.1) 78 : audit [DBG] from='client.? 172.21.2.113:0/881963543' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:24.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:23 gibba013 bash[30381]: cluster 2021-03-10T15:19:22.120220+0000 mgr.gibba020.yqfnwy (mgr.34427) 4583 : cluster [DBG] pgmap v2601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:24.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:23 gibba013 bash[30381]: audit 2021-03-10T15:19:23.752108+0000 mon.c (mon.1) 78 : audit [DBG] from='client.? 172.21.2.113:0/881963543' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:25.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:24 gibba020 bash[25448]: audit 2021-03-10T15:19:23.261944+0000 mgr.gibba020.yqfnwy (mgr.34427) 4584 : audit [DBG] from='client.57115 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:19:25.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:24 gibba020 bash[25448]: audit 2021-03-10T15:19:23.487538+0000 mgr.gibba020.yqfnwy (mgr.34427) 4585 : audit [DBG] from='client.47136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:19:25.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:24 gibba013 bash[29418]: audit 2021-03-10T15:19:23.261944+0000 mgr.gibba020.yqfnwy (mgr.34427) 4584 : audit [DBG] from='client.57115 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:19:25.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:24 gibba013 bash[29418]: audit 2021-03-10T15:19:23.487538+0000 mgr.gibba020.yqfnwy (mgr.34427) 4585 : audit [DBG] from='client.47136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:19:25.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:24 gibba013 bash[30381]: audit 2021-03-10T15:19:23.261944+0000 mgr.gibba020.yqfnwy (mgr.34427) 4584 : audit [DBG] from='client.57115 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:19:25.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:24 gibba013 bash[30381]: audit 2021-03-10T15:19:23.487538+0000 mgr.gibba020.yqfnwy (mgr.34427) 4585 : audit [DBG] from='client.47136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:19:26.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:25 gibba020 bash[25448]: cluster 2021-03-10T15:19:24.121843+0000 mgr.gibba020.yqfnwy (mgr.34427) 4586 : cluster [DBG] pgmap v2602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:26.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:25 gibba013 bash[29418]: cluster 2021-03-10T15:19:24.121843+0000 mgr.gibba020.yqfnwy (mgr.34427) 4586 : cluster [DBG] pgmap v2602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:26.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:25 gibba013 bash[30381]: cluster 2021-03-10T15:19:24.121843+0000 mgr.gibba020.yqfnwy (mgr.34427) 4586 : cluster [DBG] pgmap v2602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:28.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:27 gibba020 bash[25448]: cluster 2021-03-10T15:19:26.122930+0000 mgr.gibba020.yqfnwy (mgr.34427) 4587 : cluster [DBG] pgmap v2603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:28.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:27 gibba013 bash[29418]: cluster 2021-03-10T15:19:26.122930+0000 mgr.gibba020.yqfnwy (mgr.34427) 4587 : cluster [DBG] pgmap v2603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:28.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:27 gibba013 bash[30381]: cluster 2021-03-10T15:19:26.122930+0000 mgr.gibba020.yqfnwy (mgr.34427) 4587 : cluster [DBG] pgmap v2603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:30.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:29 gibba013 bash[29418]: cluster 2021-03-10T15:19:28.124095+0000 mgr.gibba020.yqfnwy (mgr.34427) 4588 : cluster [DBG] pgmap v2604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:30.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:29 gibba013 bash[30381]: cluster 2021-03-10T15:19:28.124095+0000 mgr.gibba020.yqfnwy (mgr.34427) 4588 : cluster [DBG] pgmap v2604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:30.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:29 gibba020 bash[25448]: cluster 2021-03-10T15:19:28.124095+0000 mgr.gibba020.yqfnwy (mgr.34427) 4588 : cluster [DBG] pgmap v2604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:32.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:31 gibba020 bash[25448]: cluster 2021-03-10T15:19:30.125620+0000 mgr.gibba020.yqfnwy (mgr.34427) 4589 : cluster [DBG] pgmap v2605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:32.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:31 gibba013 bash[29418]: cluster 2021-03-10T15:19:30.125620+0000 mgr.gibba020.yqfnwy (mgr.34427) 4589 : cluster [DBG] pgmap v2605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:32.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:31 gibba013 bash[30381]: cluster 2021-03-10T15:19:30.125620+0000 mgr.gibba020.yqfnwy (mgr.34427) 4589 : cluster [DBG] pgmap v2605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:33.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:32 gibba013 bash[29418]: cephadm 2021-03-10T15:19:31.860867+0000 mgr.gibba020.yqfnwy (mgr.34427) 4590 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:19:33.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:32 gibba013 bash[30381]: cephadm 2021-03-10T15:19:31.860867+0000 mgr.gibba020.yqfnwy (mgr.34427) 4590 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:19:33.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:32 gibba020 bash[25448]: cephadm 2021-03-10T15:19:31.860867+0000 mgr.gibba020.yqfnwy (mgr.34427) 4590 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:19:34.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:33 gibba013 bash[29418]: cluster 2021-03-10T15:19:32.126967+0000 mgr.gibba020.yqfnwy (mgr.34427) 4591 : cluster [DBG] pgmap v2606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:34.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:33 gibba013 bash[30381]: cluster 2021-03-10T15:19:32.126967+0000 mgr.gibba020.yqfnwy (mgr.34427) 4591 : cluster [DBG] pgmap v2606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:34.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:33 gibba020 bash[25448]: cluster 2021-03-10T15:19:32.126967+0000 mgr.gibba020.yqfnwy (mgr.34427) 4591 : cluster [DBG] pgmap v2606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:36.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:35 gibba013 bash[29418]: cluster 2021-03-10T15:19:34.128151+0000 mgr.gibba020.yqfnwy (mgr.34427) 4592 : cluster [DBG] pgmap v2607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:36.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:35 gibba013 bash[30381]: cluster 2021-03-10T15:19:34.128151+0000 mgr.gibba020.yqfnwy (mgr.34427) 4592 : cluster [DBG] pgmap v2607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:36.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:35 gibba020 bash[25448]: cluster 2021-03-10T15:19:34.128151+0000 mgr.gibba020.yqfnwy (mgr.34427) 4592 : cluster [DBG] pgmap v2607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:38.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:37 gibba013 bash[29418]: cluster 2021-03-10T15:19:36.129899+0000 mgr.gibba020.yqfnwy (mgr.34427) 4593 : cluster [DBG] pgmap v2608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:38.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:37 gibba013 bash[30381]: cluster 2021-03-10T15:19:36.129899+0000 mgr.gibba020.yqfnwy (mgr.34427) 4593 : cluster [DBG] pgmap v2608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:38.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:37 gibba020 bash[25448]: cluster 2021-03-10T15:19:36.129899+0000 mgr.gibba020.yqfnwy (mgr.34427) 4593 : cluster [DBG] pgmap v2608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:40.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:40 gibba013 bash[29418]: cluster 2021-03-10T15:19:38.131087+0000 mgr.gibba020.yqfnwy (mgr.34427) 4594 : cluster [DBG] pgmap v2609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:40.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:40 gibba013 bash[30381]: cluster 2021-03-10T15:19:38.131087+0000 mgr.gibba020.yqfnwy (mgr.34427) 4594 : cluster [DBG] pgmap v2609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:40.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:40 gibba020 bash[25448]: cluster 2021-03-10T15:19:38.131087+0000 mgr.gibba020.yqfnwy (mgr.34427) 4594 : cluster [DBG] pgmap v2609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:42.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:42 gibba013 bash[29418]: cluster 2021-03-10T15:19:40.132949+0000 mgr.gibba020.yqfnwy (mgr.34427) 4595 : cluster [DBG] pgmap v2610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:42.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:42 gibba013 bash[30381]: cluster 2021-03-10T15:19:40.132949+0000 mgr.gibba020.yqfnwy (mgr.34427) 4595 : cluster [DBG] pgmap v2610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:42.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:42 gibba020 bash[25448]: cluster 2021-03-10T15:19:40.132949+0000 mgr.gibba020.yqfnwy (mgr.34427) 4595 : cluster [DBG] pgmap v2610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:44.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:44 gibba013 bash[29418]: cluster 2021-03-10T15:19:42.134252+0000 mgr.gibba020.yqfnwy (mgr.34427) 4596 : cluster [DBG] pgmap v2611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:44.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:44 gibba013 bash[30381]: cluster 2021-03-10T15:19:42.134252+0000 mgr.gibba020.yqfnwy (mgr.34427) 4596 : cluster [DBG] pgmap v2611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:44.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:44 gibba020 bash[25448]: cluster 2021-03-10T15:19:42.134252+0000 mgr.gibba020.yqfnwy (mgr.34427) 4596 : cluster [DBG] pgmap v2611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:46.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:46 gibba013 bash[29418]: cluster 2021-03-10T15:19:44.135620+0000 mgr.gibba020.yqfnwy (mgr.34427) 4597 : cluster [DBG] pgmap v2612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:46.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:46 gibba013 bash[30381]: cluster 2021-03-10T15:19:44.135620+0000 mgr.gibba020.yqfnwy (mgr.34427) 4597 : cluster [DBG] pgmap v2612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:46.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:46 gibba020 bash[25448]: cluster 2021-03-10T15:19:44.135620+0000 mgr.gibba020.yqfnwy (mgr.34427) 4597 : cluster [DBG] pgmap v2612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:48.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:48 gibba013 bash[29418]: cluster 2021-03-10T15:19:46.137472+0000 mgr.gibba020.yqfnwy (mgr.34427) 4598 : cluster [DBG] pgmap v2613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:48.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:48 gibba013 bash[29418]: cephadm 2021-03-10T15:19:46.876884+0000 mgr.gibba020.yqfnwy (mgr.34427) 4599 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:19:48.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:48 gibba013 bash[30381]: cluster 2021-03-10T15:19:46.137472+0000 mgr.gibba020.yqfnwy (mgr.34427) 4598 : cluster [DBG] pgmap v2613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:48.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:48 gibba013 bash[30381]: cephadm 2021-03-10T15:19:46.876884+0000 mgr.gibba020.yqfnwy (mgr.34427) 4599 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:19:48.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:48 gibba020 bash[25448]: cluster 2021-03-10T15:19:46.137472+0000 mgr.gibba020.yqfnwy (mgr.34427) 4598 : cluster [DBG] pgmap v2613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:48.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:48 gibba020 bash[25448]: cephadm 2021-03-10T15:19:46.876884+0000 mgr.gibba020.yqfnwy (mgr.34427) 4599 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:19:50.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:50 gibba013 bash[29418]: cluster 2021-03-10T15:19:48.138694+0000 mgr.gibba020.yqfnwy (mgr.34427) 4600 : cluster [DBG] pgmap v2614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:50.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:50 gibba013 bash[30381]: cluster 2021-03-10T15:19:48.138694+0000 mgr.gibba020.yqfnwy (mgr.34427) 4600 : cluster [DBG] pgmap v2614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:50.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:50 gibba020 bash[25448]: cluster 2021-03-10T15:19:48.138694+0000 mgr.gibba020.yqfnwy (mgr.34427) 4600 : cluster [DBG] pgmap v2614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:52.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:52 gibba013 bash[29418]: cluster 2021-03-10T15:19:50.140559+0000 mgr.gibba020.yqfnwy (mgr.34427) 4601 : cluster [DBG] pgmap v2615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:52.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:52 gibba013 bash[30381]: cluster 2021-03-10T15:19:50.140559+0000 mgr.gibba020.yqfnwy (mgr.34427) 4601 : cluster [DBG] pgmap v2615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:52.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:52 gibba020 bash[25448]: cluster 2021-03-10T15:19:50.140559+0000 mgr.gibba020.yqfnwy (mgr.34427) 4601 : cluster [DBG] pgmap v2615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:54.002 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:19:54.259 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:19:54.260 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (86m) 52s ago 91m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:19:54.260 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (91m) 10m ago 91m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:19:54.260 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (86m) 10m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:19:54.260 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (87m) 10m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:19:54.261 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (86m) 52s ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:19:54.261 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (85m) 52s ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:19:54.261 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (85m) 10m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:19:54.261 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (85m) 52s ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:19:54.261 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (91m) 52s ago 91m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:19:54.262 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (91m) 10m ago 91m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:19:54.262 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (84m) 52s ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:19:54.262 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (84m) 52s ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:19:54.262 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (83m) 52s ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:19:54.263 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (83m) 52s ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:19:54.263 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (82m) 10m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:19:54.263 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (82m) 10m ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:19:54.263 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (82m) 10m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:19:54.264 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (81m) 10m ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:19:54.264 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (91m) 10m ago 91m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:19:54.264 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 10m ago 89m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:19:54.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:54 gibba013 bash[29418]: cluster 2021-03-10T15:19:52.141564+0000 mgr.gibba020.yqfnwy (mgr.34427) 4602 : cluster [DBG] pgmap v2616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:54.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:54 gibba013 bash[30381]: cluster 2021-03-10T15:19:52.141564+0000 mgr.gibba020.yqfnwy (mgr.34427) 4602 : cluster [DBG] pgmap v2616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:54.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:54 gibba020 bash[25448]: cluster 2021-03-10T15:19:52.141564+0000 mgr.gibba020.yqfnwy (mgr.34427) 4602 : cluster [DBG] pgmap v2616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:54.516 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:19:54.516 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:19:54.516 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:19:54.517 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:19:54.517 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:19:54.517 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:19:54.517 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:19:54.518 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:19:54.518 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:19:54.518 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:19:54.518 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:19:54.519 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:19:54.519 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:19:54.519 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:19:54.519 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:19:55.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:55 gibba013 bash[29418]: audit 2021-03-10T15:19:53.988573+0000 mgr.gibba020.yqfnwy (mgr.34427) 4603 : audit [DBG] from='client.47148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:19:55.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:55 gibba013 bash[29418]: audit 2021-03-10T15:19:54.512965+0000 mon.a (mon.0) 1938 : audit [DBG] from='client.? 172.21.2.113:0/295427555' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:55.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:55 gibba013 bash[30381]: audit 2021-03-10T15:19:53.988573+0000 mgr.gibba020.yqfnwy (mgr.34427) 4603 : audit [DBG] from='client.47148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:19:55.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:55 gibba013 bash[30381]: audit 2021-03-10T15:19:54.512965+0000 mon.a (mon.0) 1938 : audit [DBG] from='client.? 172.21.2.113:0/295427555' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:55.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:55 gibba020 bash[25448]: audit 2021-03-10T15:19:53.988573+0000 mgr.gibba020.yqfnwy (mgr.34427) 4603 : audit [DBG] from='client.47148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:19:55.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:55 gibba020 bash[25448]: audit 2021-03-10T15:19:54.512965+0000 mon.a (mon.0) 1938 : audit [DBG] from='client.? 172.21.2.113:0/295427555' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:19:56.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:56 gibba013 bash[29418]: cluster 2021-03-10T15:19:54.142596+0000 mgr.gibba020.yqfnwy (mgr.34427) 4604 : cluster [DBG] pgmap v2617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:56.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:56 gibba013 bash[29418]: audit 2021-03-10T15:19:54.214680+0000 mgr.gibba020.yqfnwy (mgr.34427) 4605 : audit [DBG] from='client.57139 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:19:56.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:56 gibba013 bash[30381]: cluster 2021-03-10T15:19:54.142596+0000 mgr.gibba020.yqfnwy (mgr.34427) 4604 : cluster [DBG] pgmap v2617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:56.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:56 gibba013 bash[30381]: audit 2021-03-10T15:19:54.214680+0000 mgr.gibba020.yqfnwy (mgr.34427) 4605 : audit [DBG] from='client.57139 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:19:56.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:56 gibba020 bash[25448]: cluster 2021-03-10T15:19:54.142596+0000 mgr.gibba020.yqfnwy (mgr.34427) 4604 : cluster [DBG] pgmap v2617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:56.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:56 gibba020 bash[25448]: audit 2021-03-10T15:19:54.214680+0000 mgr.gibba020.yqfnwy (mgr.34427) 4605 : audit [DBG] from='client.57139 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:19:58.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:19:58 gibba013 bash[29418]: cluster 2021-03-10T15:19:56.143811+0000 mgr.gibba020.yqfnwy (mgr.34427) 4606 : cluster [DBG] pgmap v2618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:58.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:19:58 gibba013 bash[30381]: cluster 2021-03-10T15:19:56.143811+0000 mgr.gibba020.yqfnwy (mgr.34427) 4606 : cluster [DBG] pgmap v2618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:19:58.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:19:58 gibba020 bash[25448]: cluster 2021-03-10T15:19:56.143811+0000 mgr.gibba020.yqfnwy (mgr.34427) 4606 : cluster [DBG] pgmap v2618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:00.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:00 gibba013 bash[29418]: debug 2021-03-10T15:19:59.999+0000 7fd718a82700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:20:00.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:00 gibba013 bash[29418]: cluster 2021-03-10T15:19:58.144927+0000 mgr.gibba020.yqfnwy (mgr.34427) 4607 : cluster [DBG] pgmap v2619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:00.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:00 gibba013 bash[29418]: cluster 2021-03-10T15:20:00.000479+0000 mon.a (mon.0) 1939 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:20:00.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:00 gibba013 bash[30381]: cluster 2021-03-10T15:19:58.144927+0000 mgr.gibba020.yqfnwy (mgr.34427) 4607 : cluster [DBG] pgmap v2619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:00.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:00 gibba013 bash[30381]: cluster 2021-03-10T15:20:00.000479+0000 mon.a (mon.0) 1939 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:20:00.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:00 gibba020 bash[25448]: cluster 2021-03-10T15:19:58.144927+0000 mgr.gibba020.yqfnwy (mgr.34427) 4607 : cluster [DBG] pgmap v2619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:00.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:00 gibba020 bash[25448]: cluster 2021-03-10T15:20:00.000479+0000 mon.a (mon.0) 1939 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:20:01.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:01 gibba013 bash[29418]: cluster 2021-03-10T15:20:00.146009+0000 mgr.gibba020.yqfnwy (mgr.34427) 4608 : cluster [DBG] pgmap v2620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:01.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:01 gibba013 bash[30381]: cluster 2021-03-10T15:20:00.146009+0000 mgr.gibba020.yqfnwy (mgr.34427) 4608 : cluster [DBG] pgmap v2620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:01.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:01 gibba020 bash[25448]: cluster 2021-03-10T15:20:00.146009+0000 mgr.gibba020.yqfnwy (mgr.34427) 4608 : cluster [DBG] pgmap v2620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:02.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:02 gibba013 bash[29418]: audit 2021-03-10T15:20:01.894506+0000 mon.a (mon.0) 1940 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:20:02.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:02 gibba013 bash[29418]: cephadm 2021-03-10T15:20:01.898466+0000 mgr.gibba020.yqfnwy (mgr.34427) 4609 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:20:02.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:02 gibba013 bash[29418]: audit 2021-03-10T15:20:01.900977+0000 mon.a (mon.0) 1941 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:20:02.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:02 gibba013 bash[30381]: audit 2021-03-10T15:20:01.894506+0000 mon.a (mon.0) 1940 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:20:02.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:02 gibba013 bash[30381]: cephadm 2021-03-10T15:20:01.898466+0000 mgr.gibba020.yqfnwy (mgr.34427) 4609 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:20:02.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:02 gibba013 bash[30381]: audit 2021-03-10T15:20:01.900977+0000 mon.a (mon.0) 1941 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:20:02.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:02 gibba020 bash[25448]: audit 2021-03-10T15:20:01.894506+0000 mon.a (mon.0) 1940 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:20:02.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:02 gibba020 bash[25448]: cephadm 2021-03-10T15:20:01.898466+0000 mgr.gibba020.yqfnwy (mgr.34427) 4609 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:20:02.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:02 gibba020 bash[25448]: audit 2021-03-10T15:20:01.900977+0000 mon.a (mon.0) 1941 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:20:03.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:03 gibba020 bash[25448]: cluster 2021-03-10T15:20:02.146818+0000 mgr.gibba020.yqfnwy (mgr.34427) 4610 : cluster [DBG] pgmap v2621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:03.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:03 gibba013 bash[29418]: cluster 2021-03-10T15:20:02.146818+0000 mgr.gibba020.yqfnwy (mgr.34427) 4610 : cluster [DBG] pgmap v2621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:03.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:03 gibba013 bash[30381]: cluster 2021-03-10T15:20:02.146818+0000 mgr.gibba020.yqfnwy (mgr.34427) 4610 : cluster [DBG] pgmap v2621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:05.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:05 gibba020 bash[25448]: cluster 2021-03-10T15:20:04.148155+0000 mgr.gibba020.yqfnwy (mgr.34427) 4611 : cluster [DBG] pgmap v2622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:05.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:05 gibba013 bash[29418]: cluster 2021-03-10T15:20:04.148155+0000 mgr.gibba020.yqfnwy (mgr.34427) 4611 : cluster [DBG] pgmap v2622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:05.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:05 gibba013 bash[30381]: cluster 2021-03-10T15:20:04.148155+0000 mgr.gibba020.yqfnwy (mgr.34427) 4611 : cluster [DBG] pgmap v2622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:06 gibba020 bash[25448]: audit 2021-03-10T15:20:05.655208+0000 mon.a (mon.0) 1942 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:20:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:06 gibba020 bash[25448]: audit 2021-03-10T15:20:05.656357+0000 mon.a (mon.0) 1943 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T15:20:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:06 gibba020 bash[25448]: audit 2021-03-10T15:20:06.410244+0000 mon.a (mon.0) 1944 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:20:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:06 gibba020 bash[25448]: audit 2021-03-10T15:20:06.464648+0000 mon.a (mon.0) 1945 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:20:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:06 gibba020 bash[25448]: audit 2021-03-10T15:20:06.570626+0000 mon.a (mon.0) 1946 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:20:06.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:06 gibba020 bash[25448]: audit 2021-03-10T15:20:06.571528+0000 mon.a (mon.0) 1947 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:20:06.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:06 gibba020 bash[25448]: audit 2021-03-10T15:20:06.572343+0000 mon.a (mon.0) 1948 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:20:06.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:06 gibba020 bash[25448]: audit 2021-03-10T15:20:06.573126+0000 mon.a (mon.0) 1949 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:20:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:06 gibba013 bash[29418]: audit 2021-03-10T15:20:05.655208+0000 mon.a (mon.0) 1942 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:20:07.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:06 gibba013 bash[29418]: audit 2021-03-10T15:20:05.656357+0000 mon.a (mon.0) 1943 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T15:20:07.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:06 gibba013 bash[29418]: audit 2021-03-10T15:20:06.410244+0000 mon.a (mon.0) 1944 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:20:07.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:06 gibba013 bash[29418]: audit 2021-03-10T15:20:06.464648+0000 mon.a (mon.0) 1945 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:20:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:06 gibba013 bash[29418]: audit 2021-03-10T15:20:06.570626+0000 mon.a (mon.0) 1946 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:20:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:06 gibba013 bash[29418]: audit 2021-03-10T15:20:06.571528+0000 mon.a (mon.0) 1947 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:20:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:06 gibba013 bash[29418]: audit 2021-03-10T15:20:06.572343+0000 mon.a (mon.0) 1948 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:20:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:06 gibba013 bash[29418]: audit 2021-03-10T15:20:06.573126+0000 mon.a (mon.0) 1949 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:20:07.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:06 gibba013 bash[30381]: audit 2021-03-10T15:20:05.655208+0000 mon.a (mon.0) 1942 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:20:07.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:06 gibba013 bash[30381]: audit 2021-03-10T15:20:05.656357+0000 mon.a (mon.0) 1943 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T15:20:07.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:06 gibba013 bash[30381]: audit 2021-03-10T15:20:06.410244+0000 mon.a (mon.0) 1944 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:20:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:06 gibba013 bash[30381]: audit 2021-03-10T15:20:06.464648+0000 mon.a (mon.0) 1945 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:20:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:06 gibba013 bash[30381]: audit 2021-03-10T15:20:06.570626+0000 mon.a (mon.0) 1946 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:20:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:06 gibba013 bash[30381]: audit 2021-03-10T15:20:06.571528+0000 mon.a (mon.0) 1947 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:20:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:06 gibba013 bash[30381]: audit 2021-03-10T15:20:06.572343+0000 mon.a (mon.0) 1948 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:20:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:06 gibba013 bash[30381]: audit 2021-03-10T15:20:06.573126+0000 mon.a (mon.0) 1949 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:20:07.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:07 gibba020 bash[25448]: cluster 2021-03-10T15:20:06.149779+0000 mgr.gibba020.yqfnwy (mgr.34427) 4612 : cluster [DBG] pgmap v2623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:08.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:07 gibba013 bash[29418]: cluster 2021-03-10T15:20:06.149779+0000 mgr.gibba020.yqfnwy (mgr.34427) 4612 : cluster [DBG] pgmap v2623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:08.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:07 gibba013 bash[30381]: cluster 2021-03-10T15:20:06.149779+0000 mgr.gibba020.yqfnwy (mgr.34427) 4612 : cluster [DBG] pgmap v2623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:09.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:09 gibba020 bash[25448]: cluster 2021-03-10T15:20:08.151068+0000 mgr.gibba020.yqfnwy (mgr.34427) 4613 : cluster [DBG] pgmap v2624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:10.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:09 gibba013 bash[29418]: cluster 2021-03-10T15:20:08.151068+0000 mgr.gibba020.yqfnwy (mgr.34427) 4613 : cluster [DBG] pgmap v2624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:10.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:09 gibba013 bash[30381]: cluster 2021-03-10T15:20:08.151068+0000 mgr.gibba020.yqfnwy (mgr.34427) 4613 : cluster [DBG] pgmap v2624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:10.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:10 gibba020 bash[25448]: audit 2021-03-10T15:20:10.209473+0000 mon.a (mon.0) 1950 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:20:10.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:10 gibba020 bash[25448]: audit 2021-03-10T15:20:10.383594+0000 mon.a (mon.0) 1951 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:20:10.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:10 gibba020 bash[25448]: audit 2021-03-10T15:20:10.575741+0000 mon.a (mon.0) 1952 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:20:10.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:10 gibba020 bash[25448]: audit 2021-03-10T15:20:10.579049+0000 mon.a (mon.0) 1953 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:20:10.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:10 gibba020 bash[25448]: audit 2021-03-10T15:20:10.580620+0000 mon.a (mon.0) 1954 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:10.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:10 gibba020 bash[25448]: audit 2021-03-10T15:20:10.581915+0000 mon.a (mon.0) 1955 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:10.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:10 gibba020 bash[25448]: audit 2021-03-10T15:20:10.583259+0000 mon.a (mon.0) 1956 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:10.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:10 gibba020 bash[25448]: audit 2021-03-10T15:20:10.585526+0000 mon.a (mon.0) 1957 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:10.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:10 gibba020 bash[25448]: audit 2021-03-10T15:20:10.586844+0000 mon.a (mon.0) 1958 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:11.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:10 gibba013 bash[29418]: audit 2021-03-10T15:20:10.209473+0000 mon.a (mon.0) 1950 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:20:11.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:10 gibba013 bash[29418]: audit 2021-03-10T15:20:10.383594+0000 mon.a (mon.0) 1951 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:20:11.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:10 gibba013 bash[29418]: audit 2021-03-10T15:20:10.575741+0000 mon.a (mon.0) 1952 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:20:11.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:10 gibba013 bash[29418]: audit 2021-03-10T15:20:10.579049+0000 mon.a (mon.0) 1953 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:20:11.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:10 gibba013 bash[29418]: audit 2021-03-10T15:20:10.580620+0000 mon.a (mon.0) 1954 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:11.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:10 gibba013 bash[29418]: audit 2021-03-10T15:20:10.581915+0000 mon.a (mon.0) 1955 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:11.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:10 gibba013 bash[29418]: audit 2021-03-10T15:20:10.583259+0000 mon.a (mon.0) 1956 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:11.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:10 gibba013 bash[29418]: audit 2021-03-10T15:20:10.585526+0000 mon.a (mon.0) 1957 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:11.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:10 gibba013 bash[29418]: audit 2021-03-10T15:20:10.586844+0000 mon.a (mon.0) 1958 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:11.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:10 gibba013 bash[30381]: audit 2021-03-10T15:20:10.209473+0000 mon.a (mon.0) 1950 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:20:11.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:10 gibba013 bash[30381]: audit 2021-03-10T15:20:10.383594+0000 mon.a (mon.0) 1951 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:20:11.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:10 gibba013 bash[30381]: audit 2021-03-10T15:20:10.575741+0000 mon.a (mon.0) 1952 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:20:11.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:10 gibba013 bash[30381]: audit 2021-03-10T15:20:10.579049+0000 mon.a (mon.0) 1953 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:20:11.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:10 gibba013 bash[30381]: audit 2021-03-10T15:20:10.580620+0000 mon.a (mon.0) 1954 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:11.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:10 gibba013 bash[30381]: audit 2021-03-10T15:20:10.581915+0000 mon.a (mon.0) 1955 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:11.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:10 gibba013 bash[30381]: audit 2021-03-10T15:20:10.583259+0000 mon.a (mon.0) 1956 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:11.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:10 gibba013 bash[30381]: audit 2021-03-10T15:20:10.585526+0000 mon.a (mon.0) 1957 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:11.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:10 gibba013 bash[30381]: audit 2021-03-10T15:20:10.586844+0000 mon.a (mon.0) 1958 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:11.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:11 gibba020 bash[25448]: cluster 2021-03-10T15:20:10.152812+0000 mgr.gibba020.yqfnwy (mgr.34427) 4614 : cluster [DBG] pgmap v2625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:11.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:11 gibba020 bash[25448]: cephadm 2021-03-10T15:20:10.383346+0000 mgr.gibba020.yqfnwy (mgr.34427) 4615 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:20:11.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:11 gibba020 bash[25448]: cephadm 2021-03-10T15:20:10.577341+0000 mgr.gibba020.yqfnwy (mgr.34427) 4616 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:20:11.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:11 gibba020 bash[25448]: cephadm 2021-03-10T15:20:10.579318+0000 mgr.gibba020.yqfnwy (mgr.34427) 4617 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:20:11.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:11 gibba020 bash[25448]: cephadm 2021-03-10T15:20:10.580557+0000 mgr.gibba020.yqfnwy (mgr.34427) 4618 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:20:11.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:11 gibba020 bash[25448]: cephadm 2021-03-10T15:20:10.580595+0000 mgr.gibba020.yqfnwy (mgr.34427) 4619 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:20:11.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:11 gibba020 bash[25448]: cephadm 2021-03-10T15:20:10.581990+0000 mgr.gibba020.yqfnwy (mgr.34427) 4620 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:20:11.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:11 gibba020 bash[25448]: cephadm 2021-03-10T15:20:10.582026+0000 mgr.gibba020.yqfnwy (mgr.34427) 4621 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:20:11.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:11 gibba020 bash[25448]: cephadm 2021-03-10T15:20:10.583133+0000 mgr.gibba020.yqfnwy (mgr.34427) 4622 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:20:11.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:11 gibba020 bash[25448]: cephadm 2021-03-10T15:20:10.584161+0000 mgr.gibba020.yqfnwy (mgr.34427) 4623 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:20:11.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:11 gibba020 bash[25448]: cephadm 2021-03-10T15:20:10.584197+0000 mgr.gibba020.yqfnwy (mgr.34427) 4624 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:20:11.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:11 gibba020 bash[25448]: cephadm 2021-03-10T15:20:10.585302+0000 mgr.gibba020.yqfnwy (mgr.34427) 4625 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:20:11.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:11 gibba020 bash[25448]: cephadm 2021-03-10T15:20:10.585621+0000 mgr.gibba020.yqfnwy (mgr.34427) 4626 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:20:11.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:11 gibba020 bash[25448]: cephadm 2021-03-10T15:20:10.586718+0000 mgr.gibba020.yqfnwy (mgr.34427) 4627 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:20:11.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:11 gibba020 bash[25448]: cephadm 2021-03-10T15:20:10.586756+0000 mgr.gibba020.yqfnwy (mgr.34427) 4628 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:20:11.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:11 gibba020 bash[25448]: cephadm 2021-03-10T15:20:10.586861+0000 mgr.gibba020.yqfnwy (mgr.34427) 4629 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:20:12.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:11 gibba013 bash[29418]: cluster 2021-03-10T15:20:10.152812+0000 mgr.gibba020.yqfnwy (mgr.34427) 4614 : cluster [DBG] pgmap v2625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:12.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:11 gibba013 bash[29418]: cephadm 2021-03-10T15:20:10.383346+0000 mgr.gibba020.yqfnwy (mgr.34427) 4615 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:20:12.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:11 gibba013 bash[29418]: cephadm 2021-03-10T15:20:10.577341+0000 mgr.gibba020.yqfnwy (mgr.34427) 4616 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:20:12.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:11 gibba013 bash[29418]: cephadm 2021-03-10T15:20:10.579318+0000 mgr.gibba020.yqfnwy (mgr.34427) 4617 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:20:12.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:11 gibba013 bash[29418]: cephadm 2021-03-10T15:20:10.580557+0000 mgr.gibba020.yqfnwy (mgr.34427) 4618 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:20:12.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:11 gibba013 bash[29418]: cephadm 2021-03-10T15:20:10.580595+0000 mgr.gibba020.yqfnwy (mgr.34427) 4619 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:20:12.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:11 gibba013 bash[29418]: cephadm 2021-03-10T15:20:10.581990+0000 mgr.gibba020.yqfnwy (mgr.34427) 4620 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:20:12.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:11 gibba013 bash[29418]: cephadm 2021-03-10T15:20:10.582026+0000 mgr.gibba020.yqfnwy (mgr.34427) 4621 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:20:12.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:11 gibba013 bash[29418]: cephadm 2021-03-10T15:20:10.583133+0000 mgr.gibba020.yqfnwy (mgr.34427) 4622 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:20:12.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:11 gibba013 bash[29418]: cephadm 2021-03-10T15:20:10.584161+0000 mgr.gibba020.yqfnwy (mgr.34427) 4623 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:20:12.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:11 gibba013 bash[29418]: cephadm 2021-03-10T15:20:10.584197+0000 mgr.gibba020.yqfnwy (mgr.34427) 4624 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:20:12.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:11 gibba013 bash[29418]: cephadm 2021-03-10T15:20:10.585302+0000 mgr.gibba020.yqfnwy (mgr.34427) 4625 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:20:12.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:11 gibba013 bash[29418]: cephadm 2021-03-10T15:20:10.585621+0000 mgr.gibba020.yqfnwy (mgr.34427) 4626 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:20:12.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:11 gibba013 bash[29418]: cephadm 2021-03-10T15:20:10.586718+0000 mgr.gibba020.yqfnwy (mgr.34427) 4627 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:20:12.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:11 gibba013 bash[29418]: cephadm 2021-03-10T15:20:10.586756+0000 mgr.gibba020.yqfnwy (mgr.34427) 4628 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:20:12.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:11 gibba013 bash[29418]: cephadm 2021-03-10T15:20:10.586861+0000 mgr.gibba020.yqfnwy (mgr.34427) 4629 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:20:12.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:11 gibba013 bash[30381]: cluster 2021-03-10T15:20:10.152812+0000 mgr.gibba020.yqfnwy (mgr.34427) 4614 : cluster [DBG] pgmap v2625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:12.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:11 gibba013 bash[30381]: cephadm 2021-03-10T15:20:10.383346+0000 mgr.gibba020.yqfnwy (mgr.34427) 4615 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:20:12.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:11 gibba013 bash[30381]: cephadm 2021-03-10T15:20:10.577341+0000 mgr.gibba020.yqfnwy (mgr.34427) 4616 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:20:12.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:11 gibba013 bash[30381]: cephadm 2021-03-10T15:20:10.579318+0000 mgr.gibba020.yqfnwy (mgr.34427) 4617 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:20:12.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:11 gibba013 bash[30381]: cephadm 2021-03-10T15:20:10.580557+0000 mgr.gibba020.yqfnwy (mgr.34427) 4618 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:20:12.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:11 gibba013 bash[30381]: cephadm 2021-03-10T15:20:10.580595+0000 mgr.gibba020.yqfnwy (mgr.34427) 4619 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:20:12.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:11 gibba013 bash[30381]: cephadm 2021-03-10T15:20:10.581990+0000 mgr.gibba020.yqfnwy (mgr.34427) 4620 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:20:12.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:11 gibba013 bash[30381]: cephadm 2021-03-10T15:20:10.582026+0000 mgr.gibba020.yqfnwy (mgr.34427) 4621 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:20:12.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:11 gibba013 bash[30381]: cephadm 2021-03-10T15:20:10.583133+0000 mgr.gibba020.yqfnwy (mgr.34427) 4622 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:20:12.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:11 gibba013 bash[30381]: cephadm 2021-03-10T15:20:10.584161+0000 mgr.gibba020.yqfnwy (mgr.34427) 4623 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:20:12.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:11 gibba013 bash[30381]: cephadm 2021-03-10T15:20:10.584197+0000 mgr.gibba020.yqfnwy (mgr.34427) 4624 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:20:12.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:11 gibba013 bash[30381]: cephadm 2021-03-10T15:20:10.585302+0000 mgr.gibba020.yqfnwy (mgr.34427) 4625 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:20:12.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:11 gibba013 bash[30381]: cephadm 2021-03-10T15:20:10.585621+0000 mgr.gibba020.yqfnwy (mgr.34427) 4626 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:20:12.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:11 gibba013 bash[30381]: cephadm 2021-03-10T15:20:10.586718+0000 mgr.gibba020.yqfnwy (mgr.34427) 4627 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:20:12.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:11 gibba013 bash[30381]: cephadm 2021-03-10T15:20:10.586756+0000 mgr.gibba020.yqfnwy (mgr.34427) 4628 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:20:12.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:11 gibba013 bash[30381]: cephadm 2021-03-10T15:20:10.586861+0000 mgr.gibba020.yqfnwy (mgr.34427) 4629 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:20:13.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:13 gibba020 bash[25448]: cluster 2021-03-10T15:20:12.154177+0000 mgr.gibba020.yqfnwy (mgr.34427) 4630 : cluster [DBG] pgmap v2626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:14.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:13 gibba013 bash[29418]: cluster 2021-03-10T15:20:12.154177+0000 mgr.gibba020.yqfnwy (mgr.34427) 4630 : cluster [DBG] pgmap v2626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:14.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:13 gibba013 bash[30381]: cluster 2021-03-10T15:20:12.154177+0000 mgr.gibba020.yqfnwy (mgr.34427) 4630 : cluster [DBG] pgmap v2626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:16.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:15 gibba013 bash[29418]: cluster 2021-03-10T15:20:14.155550+0000 mgr.gibba020.yqfnwy (mgr.34427) 4631 : cluster [DBG] pgmap v2627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:16.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:15 gibba013 bash[30381]: cluster 2021-03-10T15:20:14.155550+0000 mgr.gibba020.yqfnwy (mgr.34427) 4631 : cluster [DBG] pgmap v2627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:16.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:15 gibba020 bash[25448]: cluster 2021-03-10T15:20:14.155550+0000 mgr.gibba020.yqfnwy (mgr.34427) 4631 : cluster [DBG] pgmap v2627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:18.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:17 gibba013 bash[29418]: cluster 2021-03-10T15:20:16.157361+0000 mgr.gibba020.yqfnwy (mgr.34427) 4632 : cluster [DBG] pgmap v2628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:18.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:17 gibba013 bash[30381]: cluster 2021-03-10T15:20:16.157361+0000 mgr.gibba020.yqfnwy (mgr.34427) 4632 : cluster [DBG] pgmap v2628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:18.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:17 gibba020 bash[25448]: cluster 2021-03-10T15:20:16.157361+0000 mgr.gibba020.yqfnwy (mgr.34427) 4632 : cluster [DBG] pgmap v2628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:20.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:19 gibba013 bash[29418]: cluster 2021-03-10T15:20:18.158695+0000 mgr.gibba020.yqfnwy (mgr.34427) 4633 : cluster [DBG] pgmap v2629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:20.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:19 gibba013 bash[30381]: cluster 2021-03-10T15:20:18.158695+0000 mgr.gibba020.yqfnwy (mgr.34427) 4633 : cluster [DBG] pgmap v2629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:20.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:19 gibba020 bash[25448]: cluster 2021-03-10T15:20:18.158695+0000 mgr.gibba020.yqfnwy (mgr.34427) 4633 : cluster [DBG] pgmap v2629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:22.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:21 gibba013 bash[29418]: cluster 2021-03-10T15:20:20.159544+0000 mgr.gibba020.yqfnwy (mgr.34427) 4634 : cluster [DBG] pgmap v2630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:22.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:21 gibba013 bash[30381]: cluster 2021-03-10T15:20:20.159544+0000 mgr.gibba020.yqfnwy (mgr.34427) 4634 : cluster [DBG] pgmap v2630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:22.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:21 gibba020 bash[25448]: cluster 2021-03-10T15:20:20.159544+0000 mgr.gibba020.yqfnwy (mgr.34427) 4634 : cluster [DBG] pgmap v2630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:24.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:23 gibba013 bash[29418]: cluster 2021-03-10T15:20:22.160913+0000 mgr.gibba020.yqfnwy (mgr.34427) 4635 : cluster [DBG] pgmap v2631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:24.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:23 gibba013 bash[30381]: cluster 2021-03-10T15:20:22.160913+0000 mgr.gibba020.yqfnwy (mgr.34427) 4635 : cluster [DBG] pgmap v2631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:24.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:23 gibba020 bash[25448]: cluster 2021-03-10T15:20:22.160913+0000 mgr.gibba020.yqfnwy (mgr.34427) 4635 : cluster [DBG] pgmap v2631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:24.760 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:20:24.988 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:20:24.989 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (86m) 83s ago 92m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:20:24.989 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (92m) 19s ago 92m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:20:24.989 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (87m) 19s ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:20:24.989 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (87m) 19s ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:20:24.990 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (86m) 83s ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:20:24.990 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (86m) 83s ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:20:24.990 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (85m) 19s ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:20:24.990 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (86m) 83s ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:20:24.990 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (92m) 83s ago 92m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:20:24.991 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (92m) 19s ago 92m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:20:24.991 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (85m) 83s ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:20:24.991 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (84m) 83s ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:20:24.991 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (84m) 83s ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:20:24.992 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (83m) 83s ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:20:24.992 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (83m) 19s ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:20:24.992 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (83m) 19s ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:20:24.992 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (82m) 19s ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:20:24.992 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (82m) 19s ago 92m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:20:24.993 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (91m) 19s ago 92m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:20:24.993 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 19s ago 90m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:20:25.240 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:20:25.240 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:20:25.240 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:20:25.241 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:20:25.241 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:20:25.241 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:20:25.241 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:20:25.242 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:20:25.242 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:20:25.242 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:20:25.242 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:20:25.243 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:20:25.243 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:20:25.243 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:20:25.243 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:20:25.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:25 gibba020 bash[25448]: cluster 2021-03-10T15:20:24.162459+0000 mgr.gibba020.yqfnwy (mgr.34427) 4636 : cluster [DBG] pgmap v2632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:25.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:25 gibba020 bash[25448]: audit 2021-03-10T15:20:24.747690+0000 mgr.gibba020.yqfnwy (mgr.34427) 4637 : audit [DBG] from='client.47166 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:20:25.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:25 gibba020 bash[25448]: audit 2021-03-10T15:20:24.971140+0000 mgr.gibba020.yqfnwy (mgr.34427) 4638 : audit [DBG] from='client.57157 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:20:25.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:25 gibba020 bash[25448]: audit 2021-03-10T15:20:25.236466+0000 mon.c (mon.1) 79 : audit [DBG] from='client.? 172.21.2.113:0/643412699' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:26.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:25 gibba013 bash[29418]: cluster 2021-03-10T15:20:24.162459+0000 mgr.gibba020.yqfnwy (mgr.34427) 4636 : cluster [DBG] pgmap v2632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:26.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:25 gibba013 bash[29418]: audit 2021-03-10T15:20:24.747690+0000 mgr.gibba020.yqfnwy (mgr.34427) 4637 : audit [DBG] from='client.47166 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:20:26.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:25 gibba013 bash[29418]: audit 2021-03-10T15:20:24.971140+0000 mgr.gibba020.yqfnwy (mgr.34427) 4638 : audit [DBG] from='client.57157 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:20:26.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:25 gibba013 bash[29418]: audit 2021-03-10T15:20:25.236466+0000 mon.c (mon.1) 79 : audit [DBG] from='client.? 172.21.2.113:0/643412699' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:26.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:25 gibba013 bash[30381]: cluster 2021-03-10T15:20:24.162459+0000 mgr.gibba020.yqfnwy (mgr.34427) 4636 : cluster [DBG] pgmap v2632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:26.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:25 gibba013 bash[30381]: audit 2021-03-10T15:20:24.747690+0000 mgr.gibba020.yqfnwy (mgr.34427) 4637 : audit [DBG] from='client.47166 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:20:26.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:25 gibba013 bash[30381]: audit 2021-03-10T15:20:24.971140+0000 mgr.gibba020.yqfnwy (mgr.34427) 4638 : audit [DBG] from='client.57157 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:20:26.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:25 gibba013 bash[30381]: audit 2021-03-10T15:20:25.236466+0000 mon.c (mon.1) 79 : audit [DBG] from='client.? 172.21.2.113:0/643412699' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:27.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:26 gibba013 bash[29418]: cephadm 2021-03-10T15:20:25.602927+0000 mgr.gibba020.yqfnwy (mgr.34427) 4639 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:20:27.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:26 gibba013 bash[30381]: cephadm 2021-03-10T15:20:25.602927+0000 mgr.gibba020.yqfnwy (mgr.34427) 4639 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:20:27.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:26 gibba020 bash[25448]: cephadm 2021-03-10T15:20:25.602927+0000 mgr.gibba020.yqfnwy (mgr.34427) 4639 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:20:28.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:27 gibba013 bash[29418]: cluster 2021-03-10T15:20:26.163334+0000 mgr.gibba020.yqfnwy (mgr.34427) 4640 : cluster [DBG] pgmap v2633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:28.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:27 gibba013 bash[30381]: cluster 2021-03-10T15:20:26.163334+0000 mgr.gibba020.yqfnwy (mgr.34427) 4640 : cluster [DBG] pgmap v2633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:28.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:27 gibba020 bash[25448]: cluster 2021-03-10T15:20:26.163334+0000 mgr.gibba020.yqfnwy (mgr.34427) 4640 : cluster [DBG] pgmap v2633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:30.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:29 gibba013 bash[29418]: cluster 2021-03-10T15:20:28.164621+0000 mgr.gibba020.yqfnwy (mgr.34427) 4641 : cluster [DBG] pgmap v2634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:30.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:29 gibba013 bash[30381]: cluster 2021-03-10T15:20:28.164621+0000 mgr.gibba020.yqfnwy (mgr.34427) 4641 : cluster [DBG] pgmap v2634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:30.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:29 gibba020 bash[25448]: cluster 2021-03-10T15:20:28.164621+0000 mgr.gibba020.yqfnwy (mgr.34427) 4641 : cluster [DBG] pgmap v2634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:32.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:31 gibba013 bash[29418]: cluster 2021-03-10T15:20:30.166372+0000 mgr.gibba020.yqfnwy (mgr.34427) 4642 : cluster [DBG] pgmap v2635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:32.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:31 gibba013 bash[30381]: cluster 2021-03-10T15:20:30.166372+0000 mgr.gibba020.yqfnwy (mgr.34427) 4642 : cluster [DBG] pgmap v2635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:32.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:31 gibba020 bash[25448]: cluster 2021-03-10T15:20:30.166372+0000 mgr.gibba020.yqfnwy (mgr.34427) 4642 : cluster [DBG] pgmap v2635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:34.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:33 gibba013 bash[29418]: cluster 2021-03-10T15:20:32.167043+0000 mgr.gibba020.yqfnwy (mgr.34427) 4643 : cluster [DBG] pgmap v2636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:34.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:33 gibba013 bash[30381]: cluster 2021-03-10T15:20:32.167043+0000 mgr.gibba020.yqfnwy (mgr.34427) 4643 : cluster [DBG] pgmap v2636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:34.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:33 gibba020 bash[25448]: cluster 2021-03-10T15:20:32.167043+0000 mgr.gibba020.yqfnwy (mgr.34427) 4643 : cluster [DBG] pgmap v2636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:36.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:35 gibba013 bash[29418]: cluster 2021-03-10T15:20:34.168621+0000 mgr.gibba020.yqfnwy (mgr.34427) 4644 : cluster [DBG] pgmap v2637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:36.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:35 gibba013 bash[30381]: cluster 2021-03-10T15:20:34.168621+0000 mgr.gibba020.yqfnwy (mgr.34427) 4644 : cluster [DBG] pgmap v2637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:36.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:35 gibba020 bash[25448]: cluster 2021-03-10T15:20:34.168621+0000 mgr.gibba020.yqfnwy (mgr.34427) 4644 : cluster [DBG] pgmap v2637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:38.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:37 gibba013 bash[29418]: cluster 2021-03-10T15:20:36.170628+0000 mgr.gibba020.yqfnwy (mgr.34427) 4645 : cluster [DBG] pgmap v2638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:38.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:37 gibba013 bash[30381]: cluster 2021-03-10T15:20:36.170628+0000 mgr.gibba020.yqfnwy (mgr.34427) 4645 : cluster [DBG] pgmap v2638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:38.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:37 gibba020 bash[25448]: cluster 2021-03-10T15:20:36.170628+0000 mgr.gibba020.yqfnwy (mgr.34427) 4645 : cluster [DBG] pgmap v2638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:40.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:39 gibba013 bash[29418]: cluster 2021-03-10T15:20:38.171931+0000 mgr.gibba020.yqfnwy (mgr.34427) 4646 : cluster [DBG] pgmap v2639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:40.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:39 gibba013 bash[30381]: cluster 2021-03-10T15:20:38.171931+0000 mgr.gibba020.yqfnwy (mgr.34427) 4646 : cluster [DBG] pgmap v2639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:40.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:39 gibba020 bash[25448]: cluster 2021-03-10T15:20:38.171931+0000 mgr.gibba020.yqfnwy (mgr.34427) 4646 : cluster [DBG] pgmap v2639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:42.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:41 gibba013 bash[29418]: cluster 2021-03-10T15:20:40.173809+0000 mgr.gibba020.yqfnwy (mgr.34427) 4647 : cluster [DBG] pgmap v2640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:42.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:41 gibba013 bash[29418]: cephadm 2021-03-10T15:20:40.616870+0000 mgr.gibba020.yqfnwy (mgr.34427) 4648 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:20:42.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:41 gibba013 bash[30381]: cluster 2021-03-10T15:20:40.173809+0000 mgr.gibba020.yqfnwy (mgr.34427) 4647 : cluster [DBG] pgmap v2640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:42.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:41 gibba013 bash[30381]: cephadm 2021-03-10T15:20:40.616870+0000 mgr.gibba020.yqfnwy (mgr.34427) 4648 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:20:42.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:41 gibba020 bash[25448]: cluster 2021-03-10T15:20:40.173809+0000 mgr.gibba020.yqfnwy (mgr.34427) 4647 : cluster [DBG] pgmap v2640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:42.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:41 gibba020 bash[25448]: cephadm 2021-03-10T15:20:40.616870+0000 mgr.gibba020.yqfnwy (mgr.34427) 4648 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:20:44.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:43 gibba013 bash[29418]: cluster 2021-03-10T15:20:42.175131+0000 mgr.gibba020.yqfnwy (mgr.34427) 4649 : cluster [DBG] pgmap v2641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:44.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:43 gibba013 bash[30381]: cluster 2021-03-10T15:20:42.175131+0000 mgr.gibba020.yqfnwy (mgr.34427) 4649 : cluster [DBG] pgmap v2641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:44.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:43 gibba020 bash[25448]: cluster 2021-03-10T15:20:42.175131+0000 mgr.gibba020.yqfnwy (mgr.34427) 4649 : cluster [DBG] pgmap v2641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:46.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:45 gibba013 bash[29418]: cluster 2021-03-10T15:20:44.176017+0000 mgr.gibba020.yqfnwy (mgr.34427) 4650 : cluster [DBG] pgmap v2642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:46.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:45 gibba013 bash[30381]: cluster 2021-03-10T15:20:44.176017+0000 mgr.gibba020.yqfnwy (mgr.34427) 4650 : cluster [DBG] pgmap v2642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:46.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:45 gibba020 bash[25448]: cluster 2021-03-10T15:20:44.176017+0000 mgr.gibba020.yqfnwy (mgr.34427) 4650 : cluster [DBG] pgmap v2642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:48.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:47 gibba013 bash[29418]: cluster 2021-03-10T15:20:46.177787+0000 mgr.gibba020.yqfnwy (mgr.34427) 4651 : cluster [DBG] pgmap v2643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:48.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:47 gibba013 bash[30381]: cluster 2021-03-10T15:20:46.177787+0000 mgr.gibba020.yqfnwy (mgr.34427) 4651 : cluster [DBG] pgmap v2643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:48.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:47 gibba020 bash[25448]: cluster 2021-03-10T15:20:46.177787+0000 mgr.gibba020.yqfnwy (mgr.34427) 4651 : cluster [DBG] pgmap v2643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:50.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:49 gibba013 bash[29418]: cluster 2021-03-10T15:20:48.178995+0000 mgr.gibba020.yqfnwy (mgr.34427) 4652 : cluster [DBG] pgmap v2644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:50.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:49 gibba013 bash[30381]: cluster 2021-03-10T15:20:48.178995+0000 mgr.gibba020.yqfnwy (mgr.34427) 4652 : cluster [DBG] pgmap v2644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:50.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:49 gibba020 bash[25448]: cluster 2021-03-10T15:20:48.178995+0000 mgr.gibba020.yqfnwy (mgr.34427) 4652 : cluster [DBG] pgmap v2644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:52.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:51 gibba013 bash[29418]: cluster 2021-03-10T15:20:50.179555+0000 mgr.gibba020.yqfnwy (mgr.34427) 4653 : cluster [DBG] pgmap v2645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:52.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:51 gibba013 bash[30381]: cluster 2021-03-10T15:20:50.179555+0000 mgr.gibba020.yqfnwy (mgr.34427) 4653 : cluster [DBG] pgmap v2645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:52.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:51 gibba020 bash[25448]: cluster 2021-03-10T15:20:50.179555+0000 mgr.gibba020.yqfnwy (mgr.34427) 4653 : cluster [DBG] pgmap v2645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:54.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:53 gibba013 bash[29418]: cluster 2021-03-10T15:20:52.180888+0000 mgr.gibba020.yqfnwy (mgr.34427) 4654 : cluster [DBG] pgmap v2646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:54.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:53 gibba013 bash[30381]: cluster 2021-03-10T15:20:52.180888+0000 mgr.gibba020.yqfnwy (mgr.34427) 4654 : cluster [DBG] pgmap v2646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:54.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:53 gibba020 bash[25448]: cluster 2021-03-10T15:20:52.180888+0000 mgr.gibba020.yqfnwy (mgr.34427) 4654 : cluster [DBG] pgmap v2646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:55.484 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:20:55.711 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:20:55.712 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (87m) 114s ago 92m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:20:55.712 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (92m) 50s ago 92m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:20:55.712 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (87m) 50s ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:20:55.712 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (88m) 50s ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:20:55.712 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (87m) 114s ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:20:55.713 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (86m) 114s ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:20:55.713 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (86m) 50s ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:20:55.713 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (86m) 114s ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:20:55.713 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (92m) 114s ago 92m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:20:55.713 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (92m) 50s ago 92m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:20:55.714 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (85m) 114s ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:20:55.714 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (85m) 114s ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:20:55.714 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (84m) 114s ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:20:55.714 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (84m) 114s ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:20:55.715 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (83m) 50s ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:20:55.715 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (83m) 50s ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:20:55.715 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (83m) 50s ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:20:55.715 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (82m) 50s ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:20:55.715 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (92m) 50s ago 93m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:20:55.716 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 50s ago 90m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:20:55.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:55 gibba020 bash[25448]: cluster 2021-03-10T15:20:54.182379+0000 mgr.gibba020.yqfnwy (mgr.34427) 4655 : cluster [DBG] pgmap v2647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:55.961 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:20:55.961 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:20:55.961 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:20:55.961 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:20:55.962 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:20:55.962 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:20:55.962 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:20:55.962 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:20:55.962 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:20:55.963 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:20:55.963 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:20:55.963 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:20:55.963 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:20:55.963 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:20:55.964 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:20:56.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:55 gibba013 bash[29418]: cluster 2021-03-10T15:20:54.182379+0000 mgr.gibba020.yqfnwy (mgr.34427) 4655 : cluster [DBG] pgmap v2647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:56.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:55 gibba013 bash[30381]: cluster 2021-03-10T15:20:54.182379+0000 mgr.gibba020.yqfnwy (mgr.34427) 4655 : cluster [DBG] pgmap v2647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:57.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:56 gibba020 bash[25448]: audit 2021-03-10T15:20:55.470362+0000 mgr.gibba020.yqfnwy (mgr.34427) 4656 : audit [DBG] from='client.47184 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:20:57.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:56 gibba020 bash[25448]: cephadm 2021-03-10T15:20:55.632963+0000 mgr.gibba020.yqfnwy (mgr.34427) 4657 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:20:57.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:56 gibba020 bash[25448]: audit 2021-03-10T15:20:55.694803+0000 mgr.gibba020.yqfnwy (mgr.34427) 4658 : audit [DBG] from='client.47190 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:20:57.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:56 gibba020 bash[25448]: audit 2021-03-10T15:20:55.957748+0000 mon.c (mon.1) 80 : audit [DBG] from='client.? 172.21.2.113:0/3727836178' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:57.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:56 gibba013 bash[29418]: audit 2021-03-10T15:20:55.470362+0000 mgr.gibba020.yqfnwy (mgr.34427) 4656 : audit [DBG] from='client.47184 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:20:57.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:56 gibba013 bash[29418]: cephadm 2021-03-10T15:20:55.632963+0000 mgr.gibba020.yqfnwy (mgr.34427) 4657 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:20:57.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:56 gibba013 bash[29418]: audit 2021-03-10T15:20:55.694803+0000 mgr.gibba020.yqfnwy (mgr.34427) 4658 : audit [DBG] from='client.47190 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:20:57.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:56 gibba013 bash[29418]: audit 2021-03-10T15:20:55.957748+0000 mon.c (mon.1) 80 : audit [DBG] from='client.? 172.21.2.113:0/3727836178' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:57.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:56 gibba013 bash[30381]: audit 2021-03-10T15:20:55.470362+0000 mgr.gibba020.yqfnwy (mgr.34427) 4656 : audit [DBG] from='client.47184 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:20:57.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:56 gibba013 bash[30381]: cephadm 2021-03-10T15:20:55.632963+0000 mgr.gibba020.yqfnwy (mgr.34427) 4657 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:20:57.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:56 gibba013 bash[30381]: audit 2021-03-10T15:20:55.694803+0000 mgr.gibba020.yqfnwy (mgr.34427) 4658 : audit [DBG] from='client.47190 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:20:57.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:56 gibba013 bash[30381]: audit 2021-03-10T15:20:55.957748+0000 mon.c (mon.1) 80 : audit [DBG] from='client.? 172.21.2.113:0/3727836178' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:20:58.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:57 gibba020 bash[25448]: cluster 2021-03-10T15:20:56.184090+0000 mgr.gibba020.yqfnwy (mgr.34427) 4659 : cluster [DBG] pgmap v2648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:58.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:57 gibba013 bash[29418]: cluster 2021-03-10T15:20:56.184090+0000 mgr.gibba020.yqfnwy (mgr.34427) 4659 : cluster [DBG] pgmap v2648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:20:58.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:57 gibba013 bash[30381]: cluster 2021-03-10T15:20:56.184090+0000 mgr.gibba020.yqfnwy (mgr.34427) 4659 : cluster [DBG] pgmap v2648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:00.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:20:59 gibba020 bash[25448]: cluster 2021-03-10T15:20:58.185355+0000 mgr.gibba020.yqfnwy (mgr.34427) 4660 : cluster [DBG] pgmap v2649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:00.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:20:59 gibba013 bash[29418]: cluster 2021-03-10T15:20:58.185355+0000 mgr.gibba020.yqfnwy (mgr.34427) 4660 : cluster [DBG] pgmap v2649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:00.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:20:59 gibba013 bash[30381]: cluster 2021-03-10T15:20:58.185355+0000 mgr.gibba020.yqfnwy (mgr.34427) 4660 : cluster [DBG] pgmap v2649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:02.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:01 gibba020 bash[25448]: cluster 2021-03-10T15:21:00.186907+0000 mgr.gibba020.yqfnwy (mgr.34427) 4661 : cluster [DBG] pgmap v2650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:02.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:01 gibba013 bash[29418]: cluster 2021-03-10T15:21:00.186907+0000 mgr.gibba020.yqfnwy (mgr.34427) 4661 : cluster [DBG] pgmap v2650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:02.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:01 gibba013 bash[30381]: cluster 2021-03-10T15:21:00.186907+0000 mgr.gibba020.yqfnwy (mgr.34427) 4661 : cluster [DBG] pgmap v2650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:04.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:03 gibba020 bash[25448]: cluster 2021-03-10T15:21:02.187623+0000 mgr.gibba020.yqfnwy (mgr.34427) 4662 : cluster [DBG] pgmap v2651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:04.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:03 gibba013 bash[29418]: cluster 2021-03-10T15:21:02.187623+0000 mgr.gibba020.yqfnwy (mgr.34427) 4662 : cluster [DBG] pgmap v2651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:04.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:03 gibba013 bash[30381]: cluster 2021-03-10T15:21:02.187623+0000 mgr.gibba020.yqfnwy (mgr.34427) 4662 : cluster [DBG] pgmap v2651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:06.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:05 gibba020 bash[25448]: cluster 2021-03-10T15:21:04.189194+0000 mgr.gibba020.yqfnwy (mgr.34427) 4663 : cluster [DBG] pgmap v2652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:06.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:05 gibba013 bash[29418]: cluster 2021-03-10T15:21:04.189194+0000 mgr.gibba020.yqfnwy (mgr.34427) 4663 : cluster [DBG] pgmap v2652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:06.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:05 gibba013 bash[30381]: cluster 2021-03-10T15:21:04.189194+0000 mgr.gibba020.yqfnwy (mgr.34427) 4663 : cluster [DBG] pgmap v2652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:07.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:06 gibba013 bash[29418]: audit 2021-03-10T15:21:06.414796+0000 mon.a (mon.0) 1959 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:21:07.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:06 gibba013 bash[29418]: audit 2021-03-10T15:21:06.471583+0000 mon.a (mon.0) 1960 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:21:07.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:06 gibba013 bash[29418]: audit 2021-03-10T15:21:06.578297+0000 mon.a (mon.0) 1961 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:21:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:06 gibba013 bash[29418]: audit 2021-03-10T15:21:06.579025+0000 mon.a (mon.0) 1962 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:21:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:06 gibba013 bash[29418]: audit 2021-03-10T15:21:06.579705+0000 mon.a (mon.0) 1963 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:21:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:06 gibba013 bash[29418]: audit 2021-03-10T15:21:06.580360+0000 mon.a (mon.0) 1964 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:21:07.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:06 gibba013 bash[30381]: audit 2021-03-10T15:21:06.414796+0000 mon.a (mon.0) 1959 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:21:07.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:06 gibba013 bash[30381]: audit 2021-03-10T15:21:06.471583+0000 mon.a (mon.0) 1960 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:21:07.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:06 gibba013 bash[30381]: audit 2021-03-10T15:21:06.578297+0000 mon.a (mon.0) 1961 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:21:07.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:06 gibba013 bash[30381]: audit 2021-03-10T15:21:06.579025+0000 mon.a (mon.0) 1962 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:21:07.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:06 gibba013 bash[30381]: audit 2021-03-10T15:21:06.579705+0000 mon.a (mon.0) 1963 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:21:07.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:06 gibba013 bash[30381]: audit 2021-03-10T15:21:06.580360+0000 mon.a (mon.0) 1964 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:21:07.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:06 gibba020 bash[25448]: audit 2021-03-10T15:21:06.414796+0000 mon.a (mon.0) 1959 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:21:07.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:06 gibba020 bash[25448]: audit 2021-03-10T15:21:06.471583+0000 mon.a (mon.0) 1960 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:21:07.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:06 gibba020 bash[25448]: audit 2021-03-10T15:21:06.578297+0000 mon.a (mon.0) 1961 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:21:07.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:06 gibba020 bash[25448]: audit 2021-03-10T15:21:06.579025+0000 mon.a (mon.0) 1962 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:21:07.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:06 gibba020 bash[25448]: audit 2021-03-10T15:21:06.579705+0000 mon.a (mon.0) 1963 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:21:07.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:06 gibba020 bash[25448]: audit 2021-03-10T15:21:06.580360+0000 mon.a (mon.0) 1964 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:21:08.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:07 gibba013 bash[29418]: cluster 2021-03-10T15:21:06.190885+0000 mgr.gibba020.yqfnwy (mgr.34427) 4664 : cluster [DBG] pgmap v2653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:08.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:07 gibba013 bash[30381]: cluster 2021-03-10T15:21:06.190885+0000 mgr.gibba020.yqfnwy (mgr.34427) 4664 : cluster [DBG] pgmap v2653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:08.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:07 gibba020 bash[25448]: cluster 2021-03-10T15:21:06.190885+0000 mgr.gibba020.yqfnwy (mgr.34427) 4664 : cluster [DBG] pgmap v2653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:10.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:09 gibba013 bash[29418]: cluster 2021-03-10T15:21:08.192151+0000 mgr.gibba020.yqfnwy (mgr.34427) 4665 : cluster [DBG] pgmap v2654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:10.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:09 gibba013 bash[30381]: cluster 2021-03-10T15:21:08.192151+0000 mgr.gibba020.yqfnwy (mgr.34427) 4665 : cluster [DBG] pgmap v2654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:10.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:09 gibba020 bash[25448]: cluster 2021-03-10T15:21:08.192151+0000 mgr.gibba020.yqfnwy (mgr.34427) 4665 : cluster [DBG] pgmap v2654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:11.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:10 gibba020 bash[25448]: audit 2021-03-10T15:21:10.650784+0000 mon.a (mon.0) 1965 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:21:11.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:10 gibba020 bash[25448]: audit 2021-03-10T15:21:10.859235+0000 mon.a (mon.0) 1966 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:21:11.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:10 gibba020 bash[25448]: audit 2021-03-10T15:21:10.862471+0000 mon.a (mon.0) 1967 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:21:11.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:10 gibba020 bash[25448]: audit 2021-03-10T15:21:10.863940+0000 mon.a (mon.0) 1968 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:11.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:10 gibba020 bash[25448]: audit 2021-03-10T15:21:10.865414+0000 mon.a (mon.0) 1969 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:11.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:10 gibba020 bash[25448]: audit 2021-03-10T15:21:10.866861+0000 mon.a (mon.0) 1970 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:11.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:10 gibba020 bash[25448]: audit 2021-03-10T15:21:10.869731+0000 mon.a (mon.0) 1971 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:11.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:10 gibba020 bash[25448]: audit 2021-03-10T15:21:10.871181+0000 mon.a (mon.0) 1972 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:11.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:10 gibba013 bash[29418]: audit 2021-03-10T15:21:10.650784+0000 mon.a (mon.0) 1965 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:21:11.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:10 gibba013 bash[29418]: audit 2021-03-10T15:21:10.859235+0000 mon.a (mon.0) 1966 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:21:11.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:10 gibba013 bash[29418]: audit 2021-03-10T15:21:10.862471+0000 mon.a (mon.0) 1967 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:21:11.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:10 gibba013 bash[29418]: audit 2021-03-10T15:21:10.863940+0000 mon.a (mon.0) 1968 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:11.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:10 gibba013 bash[29418]: audit 2021-03-10T15:21:10.865414+0000 mon.a (mon.0) 1969 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:11.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:10 gibba013 bash[29418]: audit 2021-03-10T15:21:10.866861+0000 mon.a (mon.0) 1970 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:11.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:10 gibba013 bash[29418]: audit 2021-03-10T15:21:10.869731+0000 mon.a (mon.0) 1971 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:11.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:10 gibba013 bash[29418]: audit 2021-03-10T15:21:10.871181+0000 mon.a (mon.0) 1972 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:11.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:10 gibba013 bash[30381]: audit 2021-03-10T15:21:10.650784+0000 mon.a (mon.0) 1965 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:21:11.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:10 gibba013 bash[30381]: audit 2021-03-10T15:21:10.859235+0000 mon.a (mon.0) 1966 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:21:11.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:10 gibba013 bash[30381]: audit 2021-03-10T15:21:10.862471+0000 mon.a (mon.0) 1967 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:21:11.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:10 gibba013 bash[30381]: audit 2021-03-10T15:21:10.863940+0000 mon.a (mon.0) 1968 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:11.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:10 gibba013 bash[30381]: audit 2021-03-10T15:21:10.865414+0000 mon.a (mon.0) 1969 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:11.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:10 gibba013 bash[30381]: audit 2021-03-10T15:21:10.866861+0000 mon.a (mon.0) 1970 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:11.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:10 gibba013 bash[30381]: audit 2021-03-10T15:21:10.869731+0000 mon.a (mon.0) 1971 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:11.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:10 gibba013 bash[30381]: audit 2021-03-10T15:21:10.871181+0000 mon.a (mon.0) 1972 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:12.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:11 gibba013 bash[29418]: cluster 2021-03-10T15:21:10.193940+0000 mgr.gibba020.yqfnwy (mgr.34427) 4666 : cluster [DBG] pgmap v2655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:12.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:11 gibba013 bash[29418]: cephadm 2021-03-10T15:21:10.655573+0000 mgr.gibba020.yqfnwy (mgr.34427) 4667 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:21:12.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:11 gibba013 bash[29418]: cephadm 2021-03-10T15:21:10.657423+0000 mgr.gibba020.yqfnwy (mgr.34427) 4668 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:21:12.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:11 gibba013 bash[29418]: cephadm 2021-03-10T15:21:10.860824+0000 mgr.gibba020.yqfnwy (mgr.34427) 4669 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:21:12.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:11 gibba013 bash[29418]: cephadm 2021-03-10T15:21:10.862642+0000 mgr.gibba020.yqfnwy (mgr.34427) 4670 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:21:12.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:11 gibba013 bash[29418]: cephadm 2021-03-10T15:21:10.864035+0000 mgr.gibba020.yqfnwy (mgr.34427) 4671 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:21:12.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:11 gibba013 bash[29418]: cephadm 2021-03-10T15:21:10.864073+0000 mgr.gibba020.yqfnwy (mgr.34427) 4672 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:21:12.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:11 gibba013 bash[29418]: cephadm 2021-03-10T15:21:10.865550+0000 mgr.gibba020.yqfnwy (mgr.34427) 4673 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:21:12.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:11 gibba013 bash[29418]: cephadm 2021-03-10T15:21:10.865587+0000 mgr.gibba020.yqfnwy (mgr.34427) 4674 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:21:12.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:11 gibba013 bash[29418]: cephadm 2021-03-10T15:21:10.866990+0000 mgr.gibba020.yqfnwy (mgr.34427) 4675 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:21:12.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:11 gibba013 bash[29418]: cephadm 2021-03-10T15:21:10.868297+0000 mgr.gibba020.yqfnwy (mgr.34427) 4676 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:21:12.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:11 gibba013 bash[29418]: cephadm 2021-03-10T15:21:10.868331+0000 mgr.gibba020.yqfnwy (mgr.34427) 4677 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:21:12.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:11 gibba013 bash[29418]: cephadm 2021-03-10T15:21:10.869690+0000 mgr.gibba020.yqfnwy (mgr.34427) 4678 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:21:12.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:11 gibba013 bash[29418]: cephadm 2021-03-10T15:21:10.870003+0000 mgr.gibba020.yqfnwy (mgr.34427) 4679 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:21:12.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:11 gibba013 bash[29418]: cephadm 2021-03-10T15:21:10.871187+0000 mgr.gibba020.yqfnwy (mgr.34427) 4680 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:21:12.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:11 gibba013 bash[29418]: cephadm 2021-03-10T15:21:10.871223+0000 mgr.gibba020.yqfnwy (mgr.34427) 4681 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:21:12.387 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:11 gibba013 bash[29418]: cephadm 2021-03-10T15:21:10.871405+0000 mgr.gibba020.yqfnwy (mgr.34427) 4682 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:21:12.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:11 gibba013 bash[30381]: cluster 2021-03-10T15:21:10.193940+0000 mgr.gibba020.yqfnwy (mgr.34427) 4666 : cluster [DBG] pgmap v2655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:12.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:11 gibba013 bash[30381]: cephadm 2021-03-10T15:21:10.655573+0000 mgr.gibba020.yqfnwy (mgr.34427) 4667 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:21:12.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:11 gibba013 bash[30381]: cephadm 2021-03-10T15:21:10.657423+0000 mgr.gibba020.yqfnwy (mgr.34427) 4668 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:21:12.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:11 gibba013 bash[30381]: cephadm 2021-03-10T15:21:10.860824+0000 mgr.gibba020.yqfnwy (mgr.34427) 4669 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:21:12.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:11 gibba013 bash[30381]: cephadm 2021-03-10T15:21:10.862642+0000 mgr.gibba020.yqfnwy (mgr.34427) 4670 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:21:12.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:11 gibba013 bash[30381]: cephadm 2021-03-10T15:21:10.864035+0000 mgr.gibba020.yqfnwy (mgr.34427) 4671 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:21:12.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:11 gibba013 bash[30381]: cephadm 2021-03-10T15:21:10.864073+0000 mgr.gibba020.yqfnwy (mgr.34427) 4672 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:21:12.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:11 gibba013 bash[30381]: cephadm 2021-03-10T15:21:10.865550+0000 mgr.gibba020.yqfnwy (mgr.34427) 4673 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:21:12.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:11 gibba013 bash[30381]: cephadm 2021-03-10T15:21:10.865587+0000 mgr.gibba020.yqfnwy (mgr.34427) 4674 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:21:12.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:11 gibba013 bash[30381]: cephadm 2021-03-10T15:21:10.866990+0000 mgr.gibba020.yqfnwy (mgr.34427) 4675 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:21:12.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:11 gibba013 bash[30381]: cephadm 2021-03-10T15:21:10.868297+0000 mgr.gibba020.yqfnwy (mgr.34427) 4676 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:21:12.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:11 gibba013 bash[30381]: cephadm 2021-03-10T15:21:10.868331+0000 mgr.gibba020.yqfnwy (mgr.34427) 4677 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:21:12.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:11 gibba013 bash[30381]: cephadm 2021-03-10T15:21:10.869690+0000 mgr.gibba020.yqfnwy (mgr.34427) 4678 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:21:12.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:11 gibba013 bash[30381]: cephadm 2021-03-10T15:21:10.870003+0000 mgr.gibba020.yqfnwy (mgr.34427) 4679 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:21:12.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:11 gibba013 bash[30381]: cephadm 2021-03-10T15:21:10.871187+0000 mgr.gibba020.yqfnwy (mgr.34427) 4680 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:21:12.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:11 gibba013 bash[30381]: cephadm 2021-03-10T15:21:10.871223+0000 mgr.gibba020.yqfnwy (mgr.34427) 4681 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:21:12.391 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:11 gibba013 bash[30381]: cephadm 2021-03-10T15:21:10.871405+0000 mgr.gibba020.yqfnwy (mgr.34427) 4682 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:21:12.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:11 gibba020 bash[25448]: cluster 2021-03-10T15:21:10.193940+0000 mgr.gibba020.yqfnwy (mgr.34427) 4666 : cluster [DBG] pgmap v2655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:12.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:11 gibba020 bash[25448]: cephadm 2021-03-10T15:21:10.655573+0000 mgr.gibba020.yqfnwy (mgr.34427) 4667 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:21:12.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:11 gibba020 bash[25448]: cephadm 2021-03-10T15:21:10.657423+0000 mgr.gibba020.yqfnwy (mgr.34427) 4668 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:21:12.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:11 gibba020 bash[25448]: cephadm 2021-03-10T15:21:10.860824+0000 mgr.gibba020.yqfnwy (mgr.34427) 4669 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:21:12.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:11 gibba020 bash[25448]: cephadm 2021-03-10T15:21:10.862642+0000 mgr.gibba020.yqfnwy (mgr.34427) 4670 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:21:12.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:11 gibba020 bash[25448]: cephadm 2021-03-10T15:21:10.864035+0000 mgr.gibba020.yqfnwy (mgr.34427) 4671 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:21:12.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:11 gibba020 bash[25448]: cephadm 2021-03-10T15:21:10.864073+0000 mgr.gibba020.yqfnwy (mgr.34427) 4672 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:21:12.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:11 gibba020 bash[25448]: cephadm 2021-03-10T15:21:10.865550+0000 mgr.gibba020.yqfnwy (mgr.34427) 4673 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:21:12.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:11 gibba020 bash[25448]: cephadm 2021-03-10T15:21:10.865587+0000 mgr.gibba020.yqfnwy (mgr.34427) 4674 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:21:12.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:11 gibba020 bash[25448]: cephadm 2021-03-10T15:21:10.866990+0000 mgr.gibba020.yqfnwy (mgr.34427) 4675 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:21:12.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:11 gibba020 bash[25448]: cephadm 2021-03-10T15:21:10.868297+0000 mgr.gibba020.yqfnwy (mgr.34427) 4676 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:21:12.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:11 gibba020 bash[25448]: cephadm 2021-03-10T15:21:10.868331+0000 mgr.gibba020.yqfnwy (mgr.34427) 4677 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:21:12.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:11 gibba020 bash[25448]: cephadm 2021-03-10T15:21:10.869690+0000 mgr.gibba020.yqfnwy (mgr.34427) 4678 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:21:12.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:11 gibba020 bash[25448]: cephadm 2021-03-10T15:21:10.870003+0000 mgr.gibba020.yqfnwy (mgr.34427) 4679 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:21:12.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:11 gibba020 bash[25448]: cephadm 2021-03-10T15:21:10.871187+0000 mgr.gibba020.yqfnwy (mgr.34427) 4680 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:21:12.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:11 gibba020 bash[25448]: cephadm 2021-03-10T15:21:10.871223+0000 mgr.gibba020.yqfnwy (mgr.34427) 4681 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:21:12.456 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:11 gibba020 bash[25448]: cephadm 2021-03-10T15:21:10.871405+0000 mgr.gibba020.yqfnwy (mgr.34427) 4682 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:21:14.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:13 gibba013 bash[29418]: cluster 2021-03-10T15:21:12.195172+0000 mgr.gibba020.yqfnwy (mgr.34427) 4683 : cluster [DBG] pgmap v2656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:14.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:13 gibba013 bash[30381]: cluster 2021-03-10T15:21:12.195172+0000 mgr.gibba020.yqfnwy (mgr.34427) 4683 : cluster [DBG] pgmap v2656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:14.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:13 gibba020 bash[25448]: cluster 2021-03-10T15:21:12.195172+0000 mgr.gibba020.yqfnwy (mgr.34427) 4683 : cluster [DBG] pgmap v2656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:16.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:16 gibba013 bash[29418]: cluster 2021-03-10T15:21:14.195921+0000 mgr.gibba020.yqfnwy (mgr.34427) 4684 : cluster [DBG] pgmap v2657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:16.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:16 gibba013 bash[30381]: cluster 2021-03-10T15:21:14.195921+0000 mgr.gibba020.yqfnwy (mgr.34427) 4684 : cluster [DBG] pgmap v2657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:16.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:16 gibba020 bash[25448]: cluster 2021-03-10T15:21:14.195921+0000 mgr.gibba020.yqfnwy (mgr.34427) 4684 : cluster [DBG] pgmap v2657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:18.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:18 gibba013 bash[30381]: cluster 2021-03-10T15:21:16.197698+0000 mgr.gibba020.yqfnwy (mgr.34427) 4685 : cluster [DBG] pgmap v2658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:18.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:18 gibba013 bash[29418]: cluster 2021-03-10T15:21:16.197698+0000 mgr.gibba020.yqfnwy (mgr.34427) 4685 : cluster [DBG] pgmap v2658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:18.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:18 gibba020 bash[25448]: cluster 2021-03-10T15:21:16.197698+0000 mgr.gibba020.yqfnwy (mgr.34427) 4685 : cluster [DBG] pgmap v2658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:20.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:20 gibba013 bash[30381]: cluster 2021-03-10T15:21:18.199061+0000 mgr.gibba020.yqfnwy (mgr.34427) 4686 : cluster [DBG] pgmap v2659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:20.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:20 gibba013 bash[29418]: cluster 2021-03-10T15:21:18.199061+0000 mgr.gibba020.yqfnwy (mgr.34427) 4686 : cluster [DBG] pgmap v2659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:20.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:20 gibba020 bash[25448]: cluster 2021-03-10T15:21:18.199061+0000 mgr.gibba020.yqfnwy (mgr.34427) 4686 : cluster [DBG] pgmap v2659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:22.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:22 gibba013 bash[29418]: cluster 2021-03-10T15:21:20.200097+0000 mgr.gibba020.yqfnwy (mgr.34427) 4687 : cluster [DBG] pgmap v2660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:22.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:22 gibba013 bash[30381]: cluster 2021-03-10T15:21:20.200097+0000 mgr.gibba020.yqfnwy (mgr.34427) 4687 : cluster [DBG] pgmap v2660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:22.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:22 gibba020 bash[25448]: cluster 2021-03-10T15:21:20.200097+0000 mgr.gibba020.yqfnwy (mgr.34427) 4687 : cluster [DBG] pgmap v2660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:24.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:24 gibba013 bash[29418]: cluster 2021-03-10T15:21:22.201414+0000 mgr.gibba020.yqfnwy (mgr.34427) 4688 : cluster [DBG] pgmap v2661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:24.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:24 gibba013 bash[30381]: cluster 2021-03-10T15:21:22.201414+0000 mgr.gibba020.yqfnwy (mgr.34427) 4688 : cluster [DBG] pgmap v2661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:24.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:24 gibba020 bash[25448]: cluster 2021-03-10T15:21:22.201414+0000 mgr.gibba020.yqfnwy (mgr.34427) 4688 : cluster [DBG] pgmap v2661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:26.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:26 gibba020 bash[25448]: cluster 2021-03-10T15:21:24.203081+0000 mgr.gibba020.yqfnwy (mgr.34427) 4689 : cluster [DBG] pgmap v2662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:26.213 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:21:26.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:26 gibba013 bash[29418]: cluster 2021-03-10T15:21:24.203081+0000 mgr.gibba020.yqfnwy (mgr.34427) 4689 : cluster [DBG] pgmap v2662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:26.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:26 gibba013 bash[30381]: cluster 2021-03-10T15:21:24.203081+0000 mgr.gibba020.yqfnwy (mgr.34427) 4689 : cluster [DBG] pgmap v2662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:26.441 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:21:26.442 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (87m) 2m ago 93m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:21:26.442 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (93m) 80s ago 93m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:21:26.442 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (88m) 80s ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:21:26.443 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (88m) 80s ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:21:26.443 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (87m) 2m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:21:26.443 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (87m) 2m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:21:26.443 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (86m) 80s ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:21:26.444 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (87m) 2m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:21:26.444 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (93m) 2m ago 93m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:21:26.444 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (93m) 80s ago 93m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:21:26.444 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (86m) 2m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:21:26.445 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (85m) 2m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:21:26.445 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (85m) 2m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:21:26.445 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (84m) 2m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:21:26.445 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (84m) 80s ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:21:26.446 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (84m) 80s ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:21:26.446 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (83m) 80s ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:21:26.446 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (83m) 80s ago 93m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:21:26.447 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (92m) 80s ago 93m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:21:26.447 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 80s ago 91m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:21:26.697 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:21:26.697 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:21:26.698 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:21:26.698 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:21:26.698 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:21:26.698 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:21:26.699 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:21:26.699 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:21:26.699 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:21:26.699 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:21:26.699 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:21:26.700 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:21:26.700 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:21:26.700 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:21:26.700 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:21:27.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:27 gibba013 bash[29418]: cephadm 2021-03-10T15:21:25.887464+0000 mgr.gibba020.yqfnwy (mgr.34427) 4690 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:21:27.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:27 gibba013 bash[29418]: audit 2021-03-10T15:21:26.693604+0000 mon.c (mon.1) 81 : audit [DBG] from='client.? 172.21.2.113:0/132141528' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:27.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:27 gibba013 bash[30381]: cephadm 2021-03-10T15:21:25.887464+0000 mgr.gibba020.yqfnwy (mgr.34427) 4690 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:21:27.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:27 gibba013 bash[30381]: audit 2021-03-10T15:21:26.693604+0000 mon.c (mon.1) 81 : audit [DBG] from='client.? 172.21.2.113:0/132141528' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:27.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:27 gibba020 bash[25448]: cephadm 2021-03-10T15:21:25.887464+0000 mgr.gibba020.yqfnwy (mgr.34427) 4690 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:21:27.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:27 gibba020 bash[25448]: audit 2021-03-10T15:21:26.693604+0000 mon.c (mon.1) 81 : audit [DBG] from='client.? 172.21.2.113:0/132141528' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:28.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:28 gibba013 bash[29418]: audit 2021-03-10T15:21:26.198997+0000 mgr.gibba020.yqfnwy (mgr.34427) 4691 : audit [DBG] from='client.57187 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:21:28.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:28 gibba013 bash[29418]: cluster 2021-03-10T15:21:26.204073+0000 mgr.gibba020.yqfnwy (mgr.34427) 4692 : cluster [DBG] pgmap v2663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:28.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:28 gibba013 bash[29418]: audit 2021-03-10T15:21:26.425104+0000 mgr.gibba020.yqfnwy (mgr.34427) 4693 : audit [DBG] from='client.47208 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:21:28.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:28 gibba013 bash[30381]: audit 2021-03-10T15:21:26.198997+0000 mgr.gibba020.yqfnwy (mgr.34427) 4691 : audit [DBG] from='client.57187 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:21:28.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:28 gibba013 bash[30381]: cluster 2021-03-10T15:21:26.204073+0000 mgr.gibba020.yqfnwy (mgr.34427) 4692 : cluster [DBG] pgmap v2663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:28.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:28 gibba013 bash[30381]: audit 2021-03-10T15:21:26.425104+0000 mgr.gibba020.yqfnwy (mgr.34427) 4693 : audit [DBG] from='client.47208 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:21:28.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:28 gibba020 bash[25448]: audit 2021-03-10T15:21:26.198997+0000 mgr.gibba020.yqfnwy (mgr.34427) 4691 : audit [DBG] from='client.57187 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:21:28.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:28 gibba020 bash[25448]: cluster 2021-03-10T15:21:26.204073+0000 mgr.gibba020.yqfnwy (mgr.34427) 4692 : cluster [DBG] pgmap v2663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:28.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:28 gibba020 bash[25448]: audit 2021-03-10T15:21:26.425104+0000 mgr.gibba020.yqfnwy (mgr.34427) 4693 : audit [DBG] from='client.47208 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:21:30.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:30 gibba013 bash[29418]: cluster 2021-03-10T15:21:28.205236+0000 mgr.gibba020.yqfnwy (mgr.34427) 4694 : cluster [DBG] pgmap v2664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:30.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:30 gibba013 bash[30381]: cluster 2021-03-10T15:21:28.205236+0000 mgr.gibba020.yqfnwy (mgr.34427) 4694 : cluster [DBG] pgmap v2664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:30.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:30 gibba020 bash[25448]: cluster 2021-03-10T15:21:28.205236+0000 mgr.gibba020.yqfnwy (mgr.34427) 4694 : cluster [DBG] pgmap v2664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:32.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:32 gibba013 bash[29418]: cluster 2021-03-10T15:21:30.207046+0000 mgr.gibba020.yqfnwy (mgr.34427) 4695 : cluster [DBG] pgmap v2665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:32.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:32 gibba013 bash[30381]: cluster 2021-03-10T15:21:30.207046+0000 mgr.gibba020.yqfnwy (mgr.34427) 4695 : cluster [DBG] pgmap v2665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:32.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:32 gibba020 bash[25448]: cluster 2021-03-10T15:21:30.207046+0000 mgr.gibba020.yqfnwy (mgr.34427) 4695 : cluster [DBG] pgmap v2665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:34.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:34 gibba013 bash[29418]: cluster 2021-03-10T15:21:32.207866+0000 mgr.gibba020.yqfnwy (mgr.34427) 4696 : cluster [DBG] pgmap v2666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:34.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:34 gibba013 bash[30381]: cluster 2021-03-10T15:21:32.207866+0000 mgr.gibba020.yqfnwy (mgr.34427) 4696 : cluster [DBG] pgmap v2666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:34.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:34 gibba020 bash[25448]: cluster 2021-03-10T15:21:32.207866+0000 mgr.gibba020.yqfnwy (mgr.34427) 4696 : cluster [DBG] pgmap v2666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:36.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:36 gibba013 bash[29418]: cluster 2021-03-10T15:21:34.209143+0000 mgr.gibba020.yqfnwy (mgr.34427) 4697 : cluster [DBG] pgmap v2667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:36.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:36 gibba013 bash[30381]: cluster 2021-03-10T15:21:34.209143+0000 mgr.gibba020.yqfnwy (mgr.34427) 4697 : cluster [DBG] pgmap v2667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:36.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:36 gibba020 bash[25448]: cluster 2021-03-10T15:21:34.209143+0000 mgr.gibba020.yqfnwy (mgr.34427) 4697 : cluster [DBG] pgmap v2667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:38.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:38 gibba013 bash[29418]: cluster 2021-03-10T15:21:36.211044+0000 mgr.gibba020.yqfnwy (mgr.34427) 4698 : cluster [DBG] pgmap v2668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:38.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:38 gibba013 bash[30381]: cluster 2021-03-10T15:21:36.211044+0000 mgr.gibba020.yqfnwy (mgr.34427) 4698 : cluster [DBG] pgmap v2668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:38.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:38 gibba020 bash[25448]: cluster 2021-03-10T15:21:36.211044+0000 mgr.gibba020.yqfnwy (mgr.34427) 4698 : cluster [DBG] pgmap v2668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:40.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:40 gibba013 bash[29418]: cluster 2021-03-10T15:21:38.212342+0000 mgr.gibba020.yqfnwy (mgr.34427) 4699 : cluster [DBG] pgmap v2669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:40.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:40 gibba013 bash[30381]: cluster 2021-03-10T15:21:38.212342+0000 mgr.gibba020.yqfnwy (mgr.34427) 4699 : cluster [DBG] pgmap v2669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:40.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:40 gibba020 bash[25448]: cluster 2021-03-10T15:21:38.212342+0000 mgr.gibba020.yqfnwy (mgr.34427) 4699 : cluster [DBG] pgmap v2669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:42.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:42 gibba013 bash[29418]: cluster 2021-03-10T15:21:40.214094+0000 mgr.gibba020.yqfnwy (mgr.34427) 4700 : cluster [DBG] pgmap v2670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:42.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:42 gibba013 bash[29418]: cephadm 2021-03-10T15:21:40.903244+0000 mgr.gibba020.yqfnwy (mgr.34427) 4701 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:21:42.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:42 gibba013 bash[30381]: cluster 2021-03-10T15:21:40.214094+0000 mgr.gibba020.yqfnwy (mgr.34427) 4700 : cluster [DBG] pgmap v2670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:42.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:42 gibba013 bash[30381]: cephadm 2021-03-10T15:21:40.903244+0000 mgr.gibba020.yqfnwy (mgr.34427) 4701 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:21:42.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:42 gibba020 bash[25448]: cluster 2021-03-10T15:21:40.214094+0000 mgr.gibba020.yqfnwy (mgr.34427) 4700 : cluster [DBG] pgmap v2670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:42.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:42 gibba020 bash[25448]: cephadm 2021-03-10T15:21:40.903244+0000 mgr.gibba020.yqfnwy (mgr.34427) 4701 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:21:44.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:44 gibba013 bash[29418]: cluster 2021-03-10T15:21:42.215343+0000 mgr.gibba020.yqfnwy (mgr.34427) 4702 : cluster [DBG] pgmap v2671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:44.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:44 gibba013 bash[30381]: cluster 2021-03-10T15:21:42.215343+0000 mgr.gibba020.yqfnwy (mgr.34427) 4702 : cluster [DBG] pgmap v2671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:44.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:44 gibba020 bash[25448]: cluster 2021-03-10T15:21:42.215343+0000 mgr.gibba020.yqfnwy (mgr.34427) 4702 : cluster [DBG] pgmap v2671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:45.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:45 gibba020 bash[25448]: cluster 2021-03-10T15:21:44.217003+0000 mgr.gibba020.yqfnwy (mgr.34427) 4703 : cluster [DBG] pgmap v2672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:45.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:45 gibba013 bash[29418]: cluster 2021-03-10T15:21:44.217003+0000 mgr.gibba020.yqfnwy (mgr.34427) 4703 : cluster [DBG] pgmap v2672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:45.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:45 gibba013 bash[30381]: cluster 2021-03-10T15:21:44.217003+0000 mgr.gibba020.yqfnwy (mgr.34427) 4703 : cluster [DBG] pgmap v2672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:47.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:47 gibba013 bash[29418]: cluster 2021-03-10T15:21:46.218890+0000 mgr.gibba020.yqfnwy (mgr.34427) 4704 : cluster [DBG] pgmap v2673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:47.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:47 gibba013 bash[30381]: cluster 2021-03-10T15:21:46.218890+0000 mgr.gibba020.yqfnwy (mgr.34427) 4704 : cluster [DBG] pgmap v2673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:47.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:47 gibba020 bash[25448]: cluster 2021-03-10T15:21:46.218890+0000 mgr.gibba020.yqfnwy (mgr.34427) 4704 : cluster [DBG] pgmap v2673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:49.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:49 gibba013 bash[29418]: cluster 2021-03-10T15:21:48.220317+0000 mgr.gibba020.yqfnwy (mgr.34427) 4705 : cluster [DBG] pgmap v2674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:49.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:49 gibba013 bash[30381]: cluster 2021-03-10T15:21:48.220317+0000 mgr.gibba020.yqfnwy (mgr.34427) 4705 : cluster [DBG] pgmap v2674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:49.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:49 gibba020 bash[25448]: cluster 2021-03-10T15:21:48.220317+0000 mgr.gibba020.yqfnwy (mgr.34427) 4705 : cluster [DBG] pgmap v2674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:51.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:51 gibba013 bash[29418]: cluster 2021-03-10T15:21:50.221164+0000 mgr.gibba020.yqfnwy (mgr.34427) 4706 : cluster [DBG] pgmap v2675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:51.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:51 gibba013 bash[30381]: cluster 2021-03-10T15:21:50.221164+0000 mgr.gibba020.yqfnwy (mgr.34427) 4706 : cluster [DBG] pgmap v2675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:51.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:51 gibba020 bash[25448]: cluster 2021-03-10T15:21:50.221164+0000 mgr.gibba020.yqfnwy (mgr.34427) 4706 : cluster [DBG] pgmap v2675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:53.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:53 gibba013 bash[29418]: cluster 2021-03-10T15:21:52.222221+0000 mgr.gibba020.yqfnwy (mgr.34427) 4707 : cluster [DBG] pgmap v2676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:53.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:53 gibba013 bash[30381]: cluster 2021-03-10T15:21:52.222221+0000 mgr.gibba020.yqfnwy (mgr.34427) 4707 : cluster [DBG] pgmap v2676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:53.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:53 gibba020 bash[25448]: cluster 2021-03-10T15:21:52.222221+0000 mgr.gibba020.yqfnwy (mgr.34427) 4707 : cluster [DBG] pgmap v2676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:55.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:55 gibba013 bash[29418]: cluster 2021-03-10T15:21:54.223874+0000 mgr.gibba020.yqfnwy (mgr.34427) 4708 : cluster [DBG] pgmap v2677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:55.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:55 gibba013 bash[30381]: cluster 2021-03-10T15:21:54.223874+0000 mgr.gibba020.yqfnwy (mgr.34427) 4708 : cluster [DBG] pgmap v2677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:55.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:55 gibba020 bash[25448]: cluster 2021-03-10T15:21:54.223874+0000 mgr.gibba020.yqfnwy (mgr.34427) 4708 : cluster [DBG] pgmap v2677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:56.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:56 gibba013 bash[29418]: cephadm 2021-03-10T15:21:55.919387+0000 mgr.gibba020.yqfnwy (mgr.34427) 4709 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:21:56.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:56 gibba013 bash[30381]: cephadm 2021-03-10T15:21:55.919387+0000 mgr.gibba020.yqfnwy (mgr.34427) 4709 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:21:56.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:56 gibba020 bash[25448]: cephadm 2021-03-10T15:21:55.919387+0000 mgr.gibba020.yqfnwy (mgr.34427) 4709 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:21:56.943 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:21:57.174 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:21:57.174 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (88m) 2m ago 93m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:21:57.175 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (93m) 111s ago 93m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:21:57.175 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (88m) 111s ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:21:57.175 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (89m) 111s ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:21:57.175 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (88m) 2m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:21:57.176 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (87m) 2m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:21:57.176 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (87m) 111s ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:21:57.176 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (87m) 2m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:21:57.176 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (93m) 2m ago 94m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:21:57.177 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (93m) 111s ago 94m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:21:57.177 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (86m) 2m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:21:57.177 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (86m) 2m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:21:57.177 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (85m) 2m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:21:57.177 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (85m) 2m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:21:57.178 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (84m) 111s ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:21:57.178 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (84m) 111s ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:21:57.178 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (84m) 111s ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:21:57.178 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (83m) 111s ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:21:57.179 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (93m) 111s ago 94m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:21:57.179 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 111s ago 91m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:21:57.430 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:21:57.430 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:21:57.430 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:21:57.431 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:21:57.431 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:21:57.431 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:21:57.431 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:21:57.432 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:21:57.432 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:21:57.432 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:21:57.432 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:21:57.432 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:21:57.433 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:21:57.433 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:21:57.433 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:21:57.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:57 gibba013 bash[29418]: cluster 2021-03-10T15:21:56.224970+0000 mgr.gibba020.yqfnwy (mgr.34427) 4710 : cluster [DBG] pgmap v2678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:57.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:57 gibba013 bash[29418]: audit 2021-03-10T15:21:56.929601+0000 mgr.gibba020.yqfnwy (mgr.34427) 4711 : audit [DBG] from='client.47220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:21:57.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:57 gibba013 bash[30381]: cluster 2021-03-10T15:21:56.224970+0000 mgr.gibba020.yqfnwy (mgr.34427) 4710 : cluster [DBG] pgmap v2678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:57.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:57 gibba013 bash[30381]: audit 2021-03-10T15:21:56.929601+0000 mgr.gibba020.yqfnwy (mgr.34427) 4711 : audit [DBG] from='client.47220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:21:57.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:57 gibba020 bash[25448]: cluster 2021-03-10T15:21:56.224970+0000 mgr.gibba020.yqfnwy (mgr.34427) 4710 : cluster [DBG] pgmap v2678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:57.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:57 gibba020 bash[25448]: audit 2021-03-10T15:21:56.929601+0000 mgr.gibba020.yqfnwy (mgr.34427) 4711 : audit [DBG] from='client.47220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:21:58.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:58 gibba013 bash[29418]: audit 2021-03-10T15:21:57.157767+0000 mgr.gibba020.yqfnwy (mgr.34427) 4712 : audit [DBG] from='client.57211 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:21:58.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:58 gibba013 bash[29418]: audit 2021-03-10T15:21:57.426604+0000 mon.a (mon.0) 1973 : audit [DBG] from='client.? 172.21.2.113:0/1899159095' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:58.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:58 gibba013 bash[30381]: audit 2021-03-10T15:21:57.157767+0000 mgr.gibba020.yqfnwy (mgr.34427) 4712 : audit [DBG] from='client.57211 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:21:58.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:58 gibba013 bash[30381]: audit 2021-03-10T15:21:57.426604+0000 mon.a (mon.0) 1973 : audit [DBG] from='client.? 172.21.2.113:0/1899159095' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:58.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:58 gibba020 bash[25448]: audit 2021-03-10T15:21:57.157767+0000 mgr.gibba020.yqfnwy (mgr.34427) 4712 : audit [DBG] from='client.57211 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:21:58.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:58 gibba020 bash[25448]: audit 2021-03-10T15:21:57.426604+0000 mon.a (mon.0) 1973 : audit [DBG] from='client.? 172.21.2.113:0/1899159095' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:21:59.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:21:59 gibba013 bash[29418]: cluster 2021-03-10T15:21:58.226190+0000 mgr.gibba020.yqfnwy (mgr.34427) 4713 : cluster [DBG] pgmap v2679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:59.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:21:59 gibba013 bash[30381]: cluster 2021-03-10T15:21:58.226190+0000 mgr.gibba020.yqfnwy (mgr.34427) 4713 : cluster [DBG] pgmap v2679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:21:59.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:21:59 gibba020 bash[25448]: cluster 2021-03-10T15:21:58.226190+0000 mgr.gibba020.yqfnwy (mgr.34427) 4713 : cluster [DBG] pgmap v2679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:01.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:01 gibba013 bash[29418]: cluster 2021-03-10T15:22:00.228138+0000 mgr.gibba020.yqfnwy (mgr.34427) 4714 : cluster [DBG] pgmap v2680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:01.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:01 gibba013 bash[30381]: cluster 2021-03-10T15:22:00.228138+0000 mgr.gibba020.yqfnwy (mgr.34427) 4714 : cluster [DBG] pgmap v2680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:01.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:01 gibba020 bash[25448]: cluster 2021-03-10T15:22:00.228138+0000 mgr.gibba020.yqfnwy (mgr.34427) 4714 : cluster [DBG] pgmap v2680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:03.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:03 gibba013 bash[29418]: cluster 2021-03-10T15:22:02.228893+0000 mgr.gibba020.yqfnwy (mgr.34427) 4715 : cluster [DBG] pgmap v2681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:03.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:03 gibba013 bash[30381]: cluster 2021-03-10T15:22:02.228893+0000 mgr.gibba020.yqfnwy (mgr.34427) 4715 : cluster [DBG] pgmap v2681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:03.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:03 gibba020 bash[25448]: cluster 2021-03-10T15:22:02.228893+0000 mgr.gibba020.yqfnwy (mgr.34427) 4715 : cluster [DBG] pgmap v2681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:05.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:05 gibba013 bash[29418]: cluster 2021-03-10T15:22:04.230421+0000 mgr.gibba020.yqfnwy (mgr.34427) 4716 : cluster [DBG] pgmap v2682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:05.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:05 gibba013 bash[30381]: cluster 2021-03-10T15:22:04.230421+0000 mgr.gibba020.yqfnwy (mgr.34427) 4716 : cluster [DBG] pgmap v2682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:05.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:05 gibba020 bash[25448]: cluster 2021-03-10T15:22:04.230421+0000 mgr.gibba020.yqfnwy (mgr.34427) 4716 : cluster [DBG] pgmap v2682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:07.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:07 gibba020 bash[25448]: cluster 2021-03-10T15:22:06.232191+0000 mgr.gibba020.yqfnwy (mgr.34427) 4717 : cluster [DBG] pgmap v2683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:07 gibba020 bash[25448]: audit 2021-03-10T15:22:06.419780+0000 mon.a (mon.0) 1974 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:22:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:07 gibba020 bash[25448]: audit 2021-03-10T15:22:06.478125+0000 mon.a (mon.0) 1975 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:22:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:07 gibba020 bash[25448]: audit 2021-03-10T15:22:06.585118+0000 mon.a (mon.0) 1976 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T15:22:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:07 gibba020 bash[25448]: audit 2021-03-10T15:22:06.585866+0000 mon.a (mon.0) 1977 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:22:07.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:07 gibba020 bash[25448]: audit 2021-03-10T15:22:06.586594+0000 mon.a (mon.0) 1978 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:22:07.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:07 gibba020 bash[25448]: audit 2021-03-10T15:22:06.587257+0000 mon.a (mon.0) 1979 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:22:07.915 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:07 gibba013 bash[29418]: cluster 2021-03-10T15:22:06.232191+0000 mgr.gibba020.yqfnwy (mgr.34427) 4717 : cluster [DBG] pgmap v2683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:07.915 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:07 gibba013 bash[29418]: audit 2021-03-10T15:22:06.419780+0000 mon.a (mon.0) 1974 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:22:07.915 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:07 gibba013 bash[29418]: audit 2021-03-10T15:22:06.478125+0000 mon.a (mon.0) 1975 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:22:07.916 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:07 gibba013 bash[29418]: audit 2021-03-10T15:22:06.585118+0000 mon.a (mon.0) 1976 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T15:22:07.916 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:07 gibba013 bash[29418]: audit 2021-03-10T15:22:06.585866+0000 mon.a (mon.0) 1977 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:22:07.916 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:07 gibba013 bash[29418]: audit 2021-03-10T15:22:06.586594+0000 mon.a (mon.0) 1978 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:22:07.916 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:07 gibba013 bash[29418]: audit 2021-03-10T15:22:06.587257+0000 mon.a (mon.0) 1979 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:22:07.917 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:07 gibba013 bash[30381]: cluster 2021-03-10T15:22:06.232191+0000 mgr.gibba020.yqfnwy (mgr.34427) 4717 : cluster [DBG] pgmap v2683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:07.917 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:07 gibba013 bash[30381]: audit 2021-03-10T15:22:06.419780+0000 mon.a (mon.0) 1974 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:22:07.917 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:07 gibba013 bash[30381]: audit 2021-03-10T15:22:06.478125+0000 mon.a (mon.0) 1975 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:22:07.917 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:07 gibba013 bash[30381]: audit 2021-03-10T15:22:06.585118+0000 mon.a (mon.0) 1976 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T15:22:07.918 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:07 gibba013 bash[30381]: audit 2021-03-10T15:22:06.585866+0000 mon.a (mon.0) 1977 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:22:07.918 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:07 gibba013 bash[30381]: audit 2021-03-10T15:22:06.586594+0000 mon.a (mon.0) 1978 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:22:07.918 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:07 gibba013 bash[30381]: audit 2021-03-10T15:22:06.587257+0000 mon.a (mon.0) 1979 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:22:09.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:09 gibba020 bash[25448]: cluster 2021-03-10T15:22:08.233662+0000 mgr.gibba020.yqfnwy (mgr.34427) 4718 : cluster [DBG] pgmap v2684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:09.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:09 gibba013 bash[29418]: cluster 2021-03-10T15:22:08.233662+0000 mgr.gibba020.yqfnwy (mgr.34427) 4718 : cluster [DBG] pgmap v2684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:09.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:09 gibba013 bash[30381]: cluster 2021-03-10T15:22:08.233662+0000 mgr.gibba020.yqfnwy (mgr.34427) 4718 : cluster [DBG] pgmap v2684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:11.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:11 gibba020 bash[25448]: cluster 2021-03-10T15:22:10.235202+0000 mgr.gibba020.yqfnwy (mgr.34427) 4719 : cluster [DBG] pgmap v2685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:11.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:11 gibba020 bash[25448]: audit 2021-03-10T15:22:10.937198+0000 mon.a (mon.0) 1980 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:22:11.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:11 gibba020 bash[25448]: cephadm 2021-03-10T15:22:10.942582+0000 mgr.gibba020.yqfnwy (mgr.34427) 4720 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:22:11.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:11 gibba020 bash[25448]: cephadm 2021-03-10T15:22:10.944299+0000 mgr.gibba020.yqfnwy (mgr.34427) 4721 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:22:11.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:11 gibba020 bash[25448]: audit 2021-03-10T15:22:11.168641+0000 mon.a (mon.0) 1981 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:22:11.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:11 gibba020 bash[25448]: audit 2021-03-10T15:22:11.171770+0000 mon.a (mon.0) 1982 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:22:11.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:11 gibba020 bash[25448]: audit 2021-03-10T15:22:11.173364+0000 mon.a (mon.0) 1983 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:11.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:11 gibba020 bash[25448]: audit 2021-03-10T15:22:11.175339+0000 mon.a (mon.0) 1984 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:11.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:11 gibba020 bash[25448]: audit 2021-03-10T15:22:11.176987+0000 mon.a (mon.0) 1985 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:11.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:11 gibba020 bash[25448]: audit 2021-03-10T15:22:11.180424+0000 mon.a (mon.0) 1986 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:11.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:11 gibba020 bash[25448]: audit 2021-03-10T15:22:11.182160+0000 mon.a (mon.0) 1987 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:11.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:11 gibba013 bash[29418]: cluster 2021-03-10T15:22:10.235202+0000 mgr.gibba020.yqfnwy (mgr.34427) 4719 : cluster [DBG] pgmap v2685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:11.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:11 gibba013 bash[29418]: audit 2021-03-10T15:22:10.937198+0000 mon.a (mon.0) 1980 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:22:11.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:11 gibba013 bash[29418]: cephadm 2021-03-10T15:22:10.942582+0000 mgr.gibba020.yqfnwy (mgr.34427) 4720 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:22:11.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:11 gibba013 bash[29418]: cephadm 2021-03-10T15:22:10.944299+0000 mgr.gibba020.yqfnwy (mgr.34427) 4721 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:22:11.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:11 gibba013 bash[29418]: audit 2021-03-10T15:22:11.168641+0000 mon.a (mon.0) 1981 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:22:11.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:11 gibba013 bash[29418]: audit 2021-03-10T15:22:11.171770+0000 mon.a (mon.0) 1982 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:22:11.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:11 gibba013 bash[29418]: audit 2021-03-10T15:22:11.173364+0000 mon.a (mon.0) 1983 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:11.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:11 gibba013 bash[29418]: audit 2021-03-10T15:22:11.175339+0000 mon.a (mon.0) 1984 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:11.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:11 gibba013 bash[29418]: audit 2021-03-10T15:22:11.176987+0000 mon.a (mon.0) 1985 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:11.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:11 gibba013 bash[29418]: audit 2021-03-10T15:22:11.180424+0000 mon.a (mon.0) 1986 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:11.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:11 gibba013 bash[29418]: audit 2021-03-10T15:22:11.182160+0000 mon.a (mon.0) 1987 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:11.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:11 gibba013 bash[30381]: cluster 2021-03-10T15:22:10.235202+0000 mgr.gibba020.yqfnwy (mgr.34427) 4719 : cluster [DBG] pgmap v2685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:11.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:11 gibba013 bash[30381]: audit 2021-03-10T15:22:10.937198+0000 mon.a (mon.0) 1980 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:22:11.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:11 gibba013 bash[30381]: cephadm 2021-03-10T15:22:10.942582+0000 mgr.gibba020.yqfnwy (mgr.34427) 4720 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:22:11.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:11 gibba013 bash[30381]: cephadm 2021-03-10T15:22:10.944299+0000 mgr.gibba020.yqfnwy (mgr.34427) 4721 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:22:11.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:11 gibba013 bash[30381]: audit 2021-03-10T15:22:11.168641+0000 mon.a (mon.0) 1981 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:22:11.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:11 gibba013 bash[30381]: audit 2021-03-10T15:22:11.171770+0000 mon.a (mon.0) 1982 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:22:11.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:11 gibba013 bash[30381]: audit 2021-03-10T15:22:11.173364+0000 mon.a (mon.0) 1983 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:11.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:11 gibba013 bash[30381]: audit 2021-03-10T15:22:11.175339+0000 mon.a (mon.0) 1984 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:11.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:11 gibba013 bash[30381]: audit 2021-03-10T15:22:11.176987+0000 mon.a (mon.0) 1985 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:11.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:11 gibba013 bash[30381]: audit 2021-03-10T15:22:11.180424+0000 mon.a (mon.0) 1986 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:11.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:11 gibba013 bash[30381]: audit 2021-03-10T15:22:11.182160+0000 mon.a (mon.0) 1987 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:12.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:12 gibba020 bash[25448]: cephadm 2021-03-10T15:22:11.170318+0000 mgr.gibba020.yqfnwy (mgr.34427) 4722 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:22:12.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:12 gibba020 bash[25448]: cephadm 2021-03-10T15:22:11.172083+0000 mgr.gibba020.yqfnwy (mgr.34427) 4723 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:22:12.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:12 gibba020 bash[25448]: cephadm 2021-03-10T15:22:11.173979+0000 mgr.gibba020.yqfnwy (mgr.34427) 4724 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:22:12.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:12 gibba020 bash[25448]: cephadm 2021-03-10T15:22:11.174020+0000 mgr.gibba020.yqfnwy (mgr.34427) 4725 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:22:12.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:12 gibba020 bash[25448]: cephadm 2021-03-10T15:22:11.175727+0000 mgr.gibba020.yqfnwy (mgr.34427) 4726 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:22:12.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:12 gibba020 bash[25448]: cephadm 2021-03-10T15:22:11.175761+0000 mgr.gibba020.yqfnwy (mgr.34427) 4727 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:22:12.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:12 gibba020 bash[25448]: cephadm 2021-03-10T15:22:11.176992+0000 mgr.gibba020.yqfnwy (mgr.34427) 4728 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:22:12.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:12 gibba020 bash[25448]: cephadm 2021-03-10T15:22:11.178968+0000 mgr.gibba020.yqfnwy (mgr.34427) 4729 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:22:12.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:12 gibba020 bash[25448]: cephadm 2021-03-10T15:22:11.179007+0000 mgr.gibba020.yqfnwy (mgr.34427) 4730 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:22:12.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:12 gibba020 bash[25448]: cephadm 2021-03-10T15:22:11.180545+0000 mgr.gibba020.yqfnwy (mgr.34427) 4731 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:22:12.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:12 gibba020 bash[25448]: cephadm 2021-03-10T15:22:11.180978+0000 mgr.gibba020.yqfnwy (mgr.34427) 4732 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:22:12.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:12 gibba020 bash[25448]: cephadm 2021-03-10T15:22:11.182293+0000 mgr.gibba020.yqfnwy (mgr.34427) 4733 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:22:12.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:12 gibba020 bash[25448]: cephadm 2021-03-10T15:22:11.182328+0000 mgr.gibba020.yqfnwy (mgr.34427) 4734 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:22:12.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:12 gibba020 bash[25448]: cephadm 2021-03-10T15:22:11.182441+0000 mgr.gibba020.yqfnwy (mgr.34427) 4735 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:22:12.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:12 gibba013 bash[29418]: cephadm 2021-03-10T15:22:11.170318+0000 mgr.gibba020.yqfnwy (mgr.34427) 4722 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:22:12.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:12 gibba013 bash[29418]: cephadm 2021-03-10T15:22:11.172083+0000 mgr.gibba020.yqfnwy (mgr.34427) 4723 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:22:12.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:12 gibba013 bash[29418]: cephadm 2021-03-10T15:22:11.173979+0000 mgr.gibba020.yqfnwy (mgr.34427) 4724 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:22:12.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:12 gibba013 bash[29418]: cephadm 2021-03-10T15:22:11.174020+0000 mgr.gibba020.yqfnwy (mgr.34427) 4725 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:22:12.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:12 gibba013 bash[29418]: cephadm 2021-03-10T15:22:11.175727+0000 mgr.gibba020.yqfnwy (mgr.34427) 4726 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:22:12.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:12 gibba013 bash[29418]: cephadm 2021-03-10T15:22:11.175761+0000 mgr.gibba020.yqfnwy (mgr.34427) 4727 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:22:12.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:12 gibba013 bash[29418]: cephadm 2021-03-10T15:22:11.176992+0000 mgr.gibba020.yqfnwy (mgr.34427) 4728 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:22:12.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:12 gibba013 bash[29418]: cephadm 2021-03-10T15:22:11.178968+0000 mgr.gibba020.yqfnwy (mgr.34427) 4729 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:22:12.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:12 gibba013 bash[29418]: cephadm 2021-03-10T15:22:11.179007+0000 mgr.gibba020.yqfnwy (mgr.34427) 4730 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:22:12.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:12 gibba013 bash[29418]: cephadm 2021-03-10T15:22:11.180545+0000 mgr.gibba020.yqfnwy (mgr.34427) 4731 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:22:12.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:12 gibba013 bash[29418]: cephadm 2021-03-10T15:22:11.180978+0000 mgr.gibba020.yqfnwy (mgr.34427) 4732 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:22:12.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:12 gibba013 bash[29418]: cephadm 2021-03-10T15:22:11.182293+0000 mgr.gibba020.yqfnwy (mgr.34427) 4733 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:22:12.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:12 gibba013 bash[29418]: cephadm 2021-03-10T15:22:11.182328+0000 mgr.gibba020.yqfnwy (mgr.34427) 4734 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:22:12.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:12 gibba013 bash[29418]: cephadm 2021-03-10T15:22:11.182441+0000 mgr.gibba020.yqfnwy (mgr.34427) 4735 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:22:12.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:12 gibba013 bash[30381]: cephadm 2021-03-10T15:22:11.170318+0000 mgr.gibba020.yqfnwy (mgr.34427) 4722 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:22:12.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:12 gibba013 bash[30381]: cephadm 2021-03-10T15:22:11.172083+0000 mgr.gibba020.yqfnwy (mgr.34427) 4723 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:22:12.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:12 gibba013 bash[30381]: cephadm 2021-03-10T15:22:11.173979+0000 mgr.gibba020.yqfnwy (mgr.34427) 4724 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:22:12.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:12 gibba013 bash[30381]: cephadm 2021-03-10T15:22:11.174020+0000 mgr.gibba020.yqfnwy (mgr.34427) 4725 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:22:12.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:12 gibba013 bash[30381]: cephadm 2021-03-10T15:22:11.175727+0000 mgr.gibba020.yqfnwy (mgr.34427) 4726 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:22:12.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:12 gibba013 bash[30381]: cephadm 2021-03-10T15:22:11.175761+0000 mgr.gibba020.yqfnwy (mgr.34427) 4727 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:22:12.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:12 gibba013 bash[30381]: cephadm 2021-03-10T15:22:11.176992+0000 mgr.gibba020.yqfnwy (mgr.34427) 4728 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:22:12.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:12 gibba013 bash[30381]: cephadm 2021-03-10T15:22:11.178968+0000 mgr.gibba020.yqfnwy (mgr.34427) 4729 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:22:12.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:12 gibba013 bash[30381]: cephadm 2021-03-10T15:22:11.179007+0000 mgr.gibba020.yqfnwy (mgr.34427) 4730 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:22:12.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:12 gibba013 bash[30381]: cephadm 2021-03-10T15:22:11.180545+0000 mgr.gibba020.yqfnwy (mgr.34427) 4731 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:22:12.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:12 gibba013 bash[30381]: cephadm 2021-03-10T15:22:11.180978+0000 mgr.gibba020.yqfnwy (mgr.34427) 4732 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:22:12.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:12 gibba013 bash[30381]: cephadm 2021-03-10T15:22:11.182293+0000 mgr.gibba020.yqfnwy (mgr.34427) 4733 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:22:12.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:12 gibba013 bash[30381]: cephadm 2021-03-10T15:22:11.182328+0000 mgr.gibba020.yqfnwy (mgr.34427) 4734 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:22:12.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:12 gibba013 bash[30381]: cephadm 2021-03-10T15:22:11.182441+0000 mgr.gibba020.yqfnwy (mgr.34427) 4735 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:22:13.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:13 gibba020 bash[25448]: cluster 2021-03-10T15:22:12.236476+0000 mgr.gibba020.yqfnwy (mgr.34427) 4736 : cluster [DBG] pgmap v2686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:13.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:13 gibba013 bash[29418]: cluster 2021-03-10T15:22:12.236476+0000 mgr.gibba020.yqfnwy (mgr.34427) 4736 : cluster [DBG] pgmap v2686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:13.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:13 gibba013 bash[30381]: cluster 2021-03-10T15:22:12.236476+0000 mgr.gibba020.yqfnwy (mgr.34427) 4736 : cluster [DBG] pgmap v2686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:15.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:15 gibba020 bash[25448]: cluster 2021-03-10T15:22:14.238068+0000 mgr.gibba020.yqfnwy (mgr.34427) 4737 : cluster [DBG] pgmap v2687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:15.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:15 gibba013 bash[29418]: cluster 2021-03-10T15:22:14.238068+0000 mgr.gibba020.yqfnwy (mgr.34427) 4737 : cluster [DBG] pgmap v2687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:15.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:15 gibba013 bash[30381]: cluster 2021-03-10T15:22:14.238068+0000 mgr.gibba020.yqfnwy (mgr.34427) 4737 : cluster [DBG] pgmap v2687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:17.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:17 gibba020 bash[25448]: cluster 2021-03-10T15:22:16.240089+0000 mgr.gibba020.yqfnwy (mgr.34427) 4738 : cluster [DBG] pgmap v2688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:17.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:17 gibba013 bash[29418]: cluster 2021-03-10T15:22:16.240089+0000 mgr.gibba020.yqfnwy (mgr.34427) 4738 : cluster [DBG] pgmap v2688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:17.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:17 gibba013 bash[30381]: cluster 2021-03-10T15:22:16.240089+0000 mgr.gibba020.yqfnwy (mgr.34427) 4738 : cluster [DBG] pgmap v2688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:19.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:19 gibba020 bash[25448]: cluster 2021-03-10T15:22:18.241496+0000 mgr.gibba020.yqfnwy (mgr.34427) 4739 : cluster [DBG] pgmap v2689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:19.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:19 gibba013 bash[29418]: cluster 2021-03-10T15:22:18.241496+0000 mgr.gibba020.yqfnwy (mgr.34427) 4739 : cluster [DBG] pgmap v2689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:19.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:19 gibba013 bash[30381]: cluster 2021-03-10T15:22:18.241496+0000 mgr.gibba020.yqfnwy (mgr.34427) 4739 : cluster [DBG] pgmap v2689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:21.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:21 gibba013 bash[29418]: cluster 2021-03-10T15:22:20.243138+0000 mgr.gibba020.yqfnwy (mgr.34427) 4740 : cluster [DBG] pgmap v2690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:21.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:21 gibba013 bash[30381]: cluster 2021-03-10T15:22:20.243138+0000 mgr.gibba020.yqfnwy (mgr.34427) 4740 : cluster [DBG] pgmap v2690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:21.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:21 gibba020 bash[25448]: cluster 2021-03-10T15:22:20.243138+0000 mgr.gibba020.yqfnwy (mgr.34427) 4740 : cluster [DBG] pgmap v2690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:23.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:23 gibba013 bash[29418]: cluster 2021-03-10T15:22:22.244579+0000 mgr.gibba020.yqfnwy (mgr.34427) 4741 : cluster [DBG] pgmap v2691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:23.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:23 gibba013 bash[30381]: cluster 2021-03-10T15:22:22.244579+0000 mgr.gibba020.yqfnwy (mgr.34427) 4741 : cluster [DBG] pgmap v2691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:23.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:23 gibba020 bash[25448]: cluster 2021-03-10T15:22:22.244579+0000 mgr.gibba020.yqfnwy (mgr.34427) 4741 : cluster [DBG] pgmap v2691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:25.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:25 gibba013 bash[29418]: cluster 2021-03-10T15:22:24.246105+0000 mgr.gibba020.yqfnwy (mgr.34427) 4742 : cluster [DBG] pgmap v2692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:25.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:25 gibba013 bash[30381]: cluster 2021-03-10T15:22:24.246105+0000 mgr.gibba020.yqfnwy (mgr.34427) 4742 : cluster [DBG] pgmap v2692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:25.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:25 gibba020 bash[25448]: cluster 2021-03-10T15:22:24.246105+0000 mgr.gibba020.yqfnwy (mgr.34427) 4742 : cluster [DBG] pgmap v2692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:27.674 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:22:27.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:27 gibba013 bash[29418]: cephadm 2021-03-10T15:22:26.198104+0000 mgr.gibba020.yqfnwy (mgr.34427) 4743 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:22:27.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:27 gibba013 bash[29418]: cluster 2021-03-10T15:22:26.247935+0000 mgr.gibba020.yqfnwy (mgr.34427) 4744 : cluster [DBG] pgmap v2693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:27.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:27 gibba013 bash[30381]: cephadm 2021-03-10T15:22:26.198104+0000 mgr.gibba020.yqfnwy (mgr.34427) 4743 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:22:27.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:27 gibba013 bash[30381]: cluster 2021-03-10T15:22:26.247935+0000 mgr.gibba020.yqfnwy (mgr.34427) 4744 : cluster [DBG] pgmap v2693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:27.901 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:22:27.901 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (88m) 3m ago 94m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:22:27.901 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (94m) 2m ago 94m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:22:27.902 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (89m) 2m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:22:27.902 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (89m) 2m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:22:27.902 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (88m) 3m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:22:27.902 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (88m) 3m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:22:27.903 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (88m) 2m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:22:27.903 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (88m) 3m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:22:27.903 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (94m) 3m ago 94m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:22:27.903 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (94m) 2m ago 94m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:22:27.903 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (87m) 3m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:22:27.904 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (86m) 3m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:22:27.904 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (86m) 3m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:22:27.904 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (85m) 3m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:22:27.904 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (85m) 2m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:22:27.905 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (85m) 2m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:22:27.905 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (84m) 2m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:22:27.905 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (84m) 2m ago 94m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:22:27.905 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (93m) 2m ago 94m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:22:27.905 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 92m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:22:27.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:27 gibba020 bash[25448]: cephadm 2021-03-10T15:22:26.198104+0000 mgr.gibba020.yqfnwy (mgr.34427) 4743 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:22:27.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:27 gibba020 bash[25448]: cluster 2021-03-10T15:22:26.247935+0000 mgr.gibba020.yqfnwy (mgr.34427) 4744 : cluster [DBG] pgmap v2693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:28.150 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:22:28.151 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:22:28.151 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:22:28.151 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:22:28.152 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:22:28.152 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:22:28.152 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:22:28.152 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:22:28.153 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:22:28.153 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:22:28.153 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:22:28.153 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:22:28.154 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:22:28.154 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:22:28.154 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:22:28.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:28 gibba013 bash[29418]: audit 2021-03-10T15:22:27.660315+0000 mgr.gibba020.yqfnwy (mgr.34427) 4745 : audit [DBG] from='client.47238 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:22:28.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:28 gibba013 bash[29418]: audit 2021-03-10T15:22:27.884206+0000 mgr.gibba020.yqfnwy (mgr.34427) 4746 : audit [DBG] from='client.57229 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:22:28.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:28 gibba013 bash[29418]: audit 2021-03-10T15:22:28.147163+0000 mon.a (mon.0) 1988 : audit [DBG] from='client.? 172.21.2.113:0/3926711525' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:28.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:28 gibba013 bash[30381]: audit 2021-03-10T15:22:27.660315+0000 mgr.gibba020.yqfnwy (mgr.34427) 4745 : audit [DBG] from='client.47238 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:22:28.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:28 gibba013 bash[30381]: audit 2021-03-10T15:22:27.884206+0000 mgr.gibba020.yqfnwy (mgr.34427) 4746 : audit [DBG] from='client.57229 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:22:28.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:28 gibba013 bash[30381]: audit 2021-03-10T15:22:28.147163+0000 mon.a (mon.0) 1988 : audit [DBG] from='client.? 172.21.2.113:0/3926711525' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:28.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:28 gibba020 bash[25448]: audit 2021-03-10T15:22:27.660315+0000 mgr.gibba020.yqfnwy (mgr.34427) 4745 : audit [DBG] from='client.47238 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:22:28.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:28 gibba020 bash[25448]: audit 2021-03-10T15:22:27.884206+0000 mgr.gibba020.yqfnwy (mgr.34427) 4746 : audit [DBG] from='client.57229 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:22:28.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:28 gibba020 bash[25448]: audit 2021-03-10T15:22:28.147163+0000 mon.a (mon.0) 1988 : audit [DBG] from='client.? 172.21.2.113:0/3926711525' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:29.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:29 gibba013 bash[29418]: cluster 2021-03-10T15:22:28.249277+0000 mgr.gibba020.yqfnwy (mgr.34427) 4747 : cluster [DBG] pgmap v2694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:29.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:29 gibba013 bash[30381]: cluster 2021-03-10T15:22:28.249277+0000 mgr.gibba020.yqfnwy (mgr.34427) 4747 : cluster [DBG] pgmap v2694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:29.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:29 gibba020 bash[25448]: cluster 2021-03-10T15:22:28.249277+0000 mgr.gibba020.yqfnwy (mgr.34427) 4747 : cluster [DBG] pgmap v2694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:31.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:31 gibba013 bash[29418]: cluster 2021-03-10T15:22:30.251103+0000 mgr.gibba020.yqfnwy (mgr.34427) 4748 : cluster [DBG] pgmap v2695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:31.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:31 gibba013 bash[30381]: cluster 2021-03-10T15:22:30.251103+0000 mgr.gibba020.yqfnwy (mgr.34427) 4748 : cluster [DBG] pgmap v2695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:31.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:31 gibba020 bash[25448]: cluster 2021-03-10T15:22:30.251103+0000 mgr.gibba020.yqfnwy (mgr.34427) 4748 : cluster [DBG] pgmap v2695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:33.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:33 gibba013 bash[29418]: cluster 2021-03-10T15:22:32.252414+0000 mgr.gibba020.yqfnwy (mgr.34427) 4749 : cluster [DBG] pgmap v2696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:33.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:33 gibba013 bash[30381]: cluster 2021-03-10T15:22:32.252414+0000 mgr.gibba020.yqfnwy (mgr.34427) 4749 : cluster [DBG] pgmap v2696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:33.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:33 gibba020 bash[25448]: cluster 2021-03-10T15:22:32.252414+0000 mgr.gibba020.yqfnwy (mgr.34427) 4749 : cluster [DBG] pgmap v2696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:35.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:35 gibba013 bash[29418]: cluster 2021-03-10T15:22:34.254039+0000 mgr.gibba020.yqfnwy (mgr.34427) 4750 : cluster [DBG] pgmap v2697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:35.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:35 gibba013 bash[30381]: cluster 2021-03-10T15:22:34.254039+0000 mgr.gibba020.yqfnwy (mgr.34427) 4750 : cluster [DBG] pgmap v2697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:35.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:35 gibba020 bash[25448]: cluster 2021-03-10T15:22:34.254039+0000 mgr.gibba020.yqfnwy (mgr.34427) 4750 : cluster [DBG] pgmap v2697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:37.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:37 gibba013 bash[29418]: cluster 2021-03-10T15:22:36.255749+0000 mgr.gibba020.yqfnwy (mgr.34427) 4751 : cluster [DBG] pgmap v2698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:37.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:37 gibba013 bash[30381]: cluster 2021-03-10T15:22:36.255749+0000 mgr.gibba020.yqfnwy (mgr.34427) 4751 : cluster [DBG] pgmap v2698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:37.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:37 gibba020 bash[25448]: cluster 2021-03-10T15:22:36.255749+0000 mgr.gibba020.yqfnwy (mgr.34427) 4751 : cluster [DBG] pgmap v2698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:39.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:39 gibba013 bash[29418]: cluster 2021-03-10T15:22:38.257160+0000 mgr.gibba020.yqfnwy (mgr.34427) 4752 : cluster [DBG] pgmap v2699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:39.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:39 gibba013 bash[30381]: cluster 2021-03-10T15:22:38.257160+0000 mgr.gibba020.yqfnwy (mgr.34427) 4752 : cluster [DBG] pgmap v2699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:39.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:39 gibba020 bash[25448]: cluster 2021-03-10T15:22:38.257160+0000 mgr.gibba020.yqfnwy (mgr.34427) 4752 : cluster [DBG] pgmap v2699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:41.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:41 gibba013 bash[29418]: cluster 2021-03-10T15:22:40.258856+0000 mgr.gibba020.yqfnwy (mgr.34427) 4753 : cluster [DBG] pgmap v2700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:41.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:41 gibba013 bash[30381]: cluster 2021-03-10T15:22:40.258856+0000 mgr.gibba020.yqfnwy (mgr.34427) 4753 : cluster [DBG] pgmap v2700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:41.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:41 gibba020 bash[25448]: cluster 2021-03-10T15:22:40.258856+0000 mgr.gibba020.yqfnwy (mgr.34427) 4753 : cluster [DBG] pgmap v2700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:42.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:42 gibba013 bash[29418]: cephadm 2021-03-10T15:22:41.213693+0000 mgr.gibba020.yqfnwy (mgr.34427) 4754 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:22:42.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:42 gibba013 bash[30381]: cephadm 2021-03-10T15:22:41.213693+0000 mgr.gibba020.yqfnwy (mgr.34427) 4754 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:22:42.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:42 gibba020 bash[25448]: cephadm 2021-03-10T15:22:41.213693+0000 mgr.gibba020.yqfnwy (mgr.34427) 4754 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:22:43.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:43 gibba013 bash[29418]: cluster 2021-03-10T15:22:42.260034+0000 mgr.gibba020.yqfnwy (mgr.34427) 4755 : cluster [DBG] pgmap v2701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:43.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:43 gibba013 bash[30381]: cluster 2021-03-10T15:22:42.260034+0000 mgr.gibba020.yqfnwy (mgr.34427) 4755 : cluster [DBG] pgmap v2701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:43.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:43 gibba020 bash[25448]: cluster 2021-03-10T15:22:42.260034+0000 mgr.gibba020.yqfnwy (mgr.34427) 4755 : cluster [DBG] pgmap v2701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:45.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:45 gibba013 bash[29418]: cluster 2021-03-10T15:22:44.261397+0000 mgr.gibba020.yqfnwy (mgr.34427) 4756 : cluster [DBG] pgmap v2702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:45.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:45 gibba013 bash[30381]: cluster 2021-03-10T15:22:44.261397+0000 mgr.gibba020.yqfnwy (mgr.34427) 4756 : cluster [DBG] pgmap v2702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:45.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:45 gibba020 bash[25448]: cluster 2021-03-10T15:22:44.261397+0000 mgr.gibba020.yqfnwy (mgr.34427) 4756 : cluster [DBG] pgmap v2702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:47.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:47 gibba013 bash[29418]: cluster 2021-03-10T15:22:46.263222+0000 mgr.gibba020.yqfnwy (mgr.34427) 4757 : cluster [DBG] pgmap v2703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:47.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:47 gibba013 bash[30381]: cluster 2021-03-10T15:22:46.263222+0000 mgr.gibba020.yqfnwy (mgr.34427) 4757 : cluster [DBG] pgmap v2703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:47.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:47 gibba020 bash[25448]: cluster 2021-03-10T15:22:46.263222+0000 mgr.gibba020.yqfnwy (mgr.34427) 4757 : cluster [DBG] pgmap v2703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:49.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:49 gibba013 bash[29418]: cluster 2021-03-10T15:22:48.264424+0000 mgr.gibba020.yqfnwy (mgr.34427) 4758 : cluster [DBG] pgmap v2704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:49.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:49 gibba013 bash[30381]: cluster 2021-03-10T15:22:48.264424+0000 mgr.gibba020.yqfnwy (mgr.34427) 4758 : cluster [DBG] pgmap v2704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:49.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:49 gibba020 bash[25448]: cluster 2021-03-10T15:22:48.264424+0000 mgr.gibba020.yqfnwy (mgr.34427) 4758 : cluster [DBG] pgmap v2704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:51.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:51 gibba013 bash[29418]: cluster 2021-03-10T15:22:50.265999+0000 mgr.gibba020.yqfnwy (mgr.34427) 4759 : cluster [DBG] pgmap v2705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:51.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:51 gibba013 bash[30381]: cluster 2021-03-10T15:22:50.265999+0000 mgr.gibba020.yqfnwy (mgr.34427) 4759 : cluster [DBG] pgmap v2705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:51.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:51 gibba020 bash[25448]: cluster 2021-03-10T15:22:50.265999+0000 mgr.gibba020.yqfnwy (mgr.34427) 4759 : cluster [DBG] pgmap v2705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:53.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:53 gibba013 bash[29418]: cluster 2021-03-10T15:22:52.267085+0000 mgr.gibba020.yqfnwy (mgr.34427) 4760 : cluster [DBG] pgmap v2706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:53.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:53 gibba013 bash[30381]: cluster 2021-03-10T15:22:52.267085+0000 mgr.gibba020.yqfnwy (mgr.34427) 4760 : cluster [DBG] pgmap v2706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:53.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:53 gibba020 bash[25448]: cluster 2021-03-10T15:22:52.267085+0000 mgr.gibba020.yqfnwy (mgr.34427) 4760 : cluster [DBG] pgmap v2706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:55.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:55 gibba013 bash[29418]: cluster 2021-03-10T15:22:54.268749+0000 mgr.gibba020.yqfnwy (mgr.34427) 4761 : cluster [DBG] pgmap v2707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:55.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:55 gibba013 bash[30381]: cluster 2021-03-10T15:22:54.268749+0000 mgr.gibba020.yqfnwy (mgr.34427) 4761 : cluster [DBG] pgmap v2707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:55.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:55 gibba020 bash[25448]: cluster 2021-03-10T15:22:54.268749+0000 mgr.gibba020.yqfnwy (mgr.34427) 4761 : cluster [DBG] pgmap v2707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:57.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:57 gibba013 bash[29418]: cephadm 2021-03-10T15:22:56.229385+0000 mgr.gibba020.yqfnwy (mgr.34427) 4762 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:22:57.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:57 gibba013 bash[29418]: cluster 2021-03-10T15:22:56.270340+0000 mgr.gibba020.yqfnwy (mgr.34427) 4763 : cluster [DBG] pgmap v2708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:57.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:57 gibba013 bash[30381]: cephadm 2021-03-10T15:22:56.229385+0000 mgr.gibba020.yqfnwy (mgr.34427) 4762 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:22:57.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:57 gibba013 bash[30381]: cluster 2021-03-10T15:22:56.270340+0000 mgr.gibba020.yqfnwy (mgr.34427) 4763 : cluster [DBG] pgmap v2708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:57.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:57 gibba020 bash[25448]: cephadm 2021-03-10T15:22:56.229385+0000 mgr.gibba020.yqfnwy (mgr.34427) 4762 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:22:57.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:57 gibba020 bash[25448]: cluster 2021-03-10T15:22:56.270340+0000 mgr.gibba020.yqfnwy (mgr.34427) 4763 : cluster [DBG] pgmap v2708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:58.394 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:22:58.622 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:22:58.622 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (89m) 3m ago 94m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:22:58.623 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (94m) 2m ago 94m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:22:58.623 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (89m) 2m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:22:58.624 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (90m) 2m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:22:58.624 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (89m) 3m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:22:58.625 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (88m) 3m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:22:58.625 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (88m) 2m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:22:58.626 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (88m) 3m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:22:58.626 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (95m) 3m ago 95m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:22:58.626 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (95m) 2m ago 95m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:22:58.627 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (87m) 3m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:22:58.627 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (87m) 3m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:22:58.628 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (86m) 3m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:22:58.628 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (86m) 3m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:22:58.629 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (86m) 2m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:22:58.629 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (85m) 2m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:22:58.630 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (85m) 2m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:22:58.630 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (84m) 2m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:22:58.630 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (94m) 2m ago 95m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:22:58.631 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 92m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:22:58.875 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:22:58.876 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:22:58.876 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:22:58.876 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:22:58.877 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:22:58.877 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:22:58.877 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:22:58.877 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:22:58.878 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:22:58.878 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:22:58.878 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:22:58.878 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:22:58.879 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:22:58.879 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:22:58.879 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:22:59.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:59 gibba013 bash[29418]: cluster 2021-03-10T15:22:58.271711+0000 mgr.gibba020.yqfnwy (mgr.34427) 4764 : cluster [DBG] pgmap v2709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:59.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:59 gibba013 bash[29418]: audit 2021-03-10T15:22:58.380878+0000 mgr.gibba020.yqfnwy (mgr.34427) 4765 : audit [DBG] from='client.47256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:22:59.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:59 gibba013 bash[29418]: audit 2021-03-10T15:22:58.605485+0000 mgr.gibba020.yqfnwy (mgr.34427) 4766 : audit [DBG] from='client.47262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:22:59.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:22:59 gibba013 bash[29418]: audit 2021-03-10T15:22:58.871974+0000 mon.c (mon.1) 82 : audit [DBG] from='client.? 172.21.2.113:0/1287916892' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:59.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:59 gibba013 bash[30381]: cluster 2021-03-10T15:22:58.271711+0000 mgr.gibba020.yqfnwy (mgr.34427) 4764 : cluster [DBG] pgmap v2709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:59.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:59 gibba013 bash[30381]: audit 2021-03-10T15:22:58.380878+0000 mgr.gibba020.yqfnwy (mgr.34427) 4765 : audit [DBG] from='client.47256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:22:59.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:59 gibba013 bash[30381]: audit 2021-03-10T15:22:58.605485+0000 mgr.gibba020.yqfnwy (mgr.34427) 4766 : audit [DBG] from='client.47262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:22:59.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:22:59 gibba013 bash[30381]: audit 2021-03-10T15:22:58.871974+0000 mon.c (mon.1) 82 : audit [DBG] from='client.? 172.21.2.113:0/1287916892' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:22:59.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:59 gibba020 bash[25448]: cluster 2021-03-10T15:22:58.271711+0000 mgr.gibba020.yqfnwy (mgr.34427) 4764 : cluster [DBG] pgmap v2709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:22:59.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:59 gibba020 bash[25448]: audit 2021-03-10T15:22:58.380878+0000 mgr.gibba020.yqfnwy (mgr.34427) 4765 : audit [DBG] from='client.47256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:22:59.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:59 gibba020 bash[25448]: audit 2021-03-10T15:22:58.605485+0000 mgr.gibba020.yqfnwy (mgr.34427) 4766 : audit [DBG] from='client.47262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:22:59.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:22:59 gibba020 bash[25448]: audit 2021-03-10T15:22:58.871974+0000 mon.c (mon.1) 82 : audit [DBG] from='client.? 172.21.2.113:0/1287916892' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:01.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:01 gibba013 bash[29418]: cluster 2021-03-10T15:23:00.273517+0000 mgr.gibba020.yqfnwy (mgr.34427) 4767 : cluster [DBG] pgmap v2710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:01.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:01 gibba013 bash[30381]: cluster 2021-03-10T15:23:00.273517+0000 mgr.gibba020.yqfnwy (mgr.34427) 4767 : cluster [DBG] pgmap v2710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:01.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:01 gibba020 bash[25448]: cluster 2021-03-10T15:23:00.273517+0000 mgr.gibba020.yqfnwy (mgr.34427) 4767 : cluster [DBG] pgmap v2710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:03.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:03 gibba013 bash[29418]: cluster 2021-03-10T15:23:02.274684+0000 mgr.gibba020.yqfnwy (mgr.34427) 4768 : cluster [DBG] pgmap v2711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:03.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:03 gibba013 bash[30381]: cluster 2021-03-10T15:23:02.274684+0000 mgr.gibba020.yqfnwy (mgr.34427) 4768 : cluster [DBG] pgmap v2711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:03.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:03 gibba020 bash[25448]: cluster 2021-03-10T15:23:02.274684+0000 mgr.gibba020.yqfnwy (mgr.34427) 4768 : cluster [DBG] pgmap v2711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:05.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:05 gibba013 bash[29418]: cluster 2021-03-10T15:23:04.276338+0000 mgr.gibba020.yqfnwy (mgr.34427) 4769 : cluster [DBG] pgmap v2712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:05.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:05 gibba013 bash[30381]: cluster 2021-03-10T15:23:04.276338+0000 mgr.gibba020.yqfnwy (mgr.34427) 4769 : cluster [DBG] pgmap v2712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:05.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:05 gibba020 bash[25448]: cluster 2021-03-10T15:23:04.276338+0000 mgr.gibba020.yqfnwy (mgr.34427) 4769 : cluster [DBG] pgmap v2712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:07.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:07 gibba013 bash[29418]: cluster 2021-03-10T15:23:06.278232+0000 mgr.gibba020.yqfnwy (mgr.34427) 4770 : cluster [DBG] pgmap v2713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:07.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:07 gibba013 bash[29418]: audit 2021-03-10T15:23:06.425054+0000 mon.a (mon.0) 1989 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:23:07.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:07 gibba013 bash[29418]: audit 2021-03-10T15:23:06.484514+0000 mon.a (mon.0) 1990 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:23:07.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:07 gibba013 bash[29418]: audit 2021-03-10T15:23:06.591153+0000 mon.a (mon.0) 1991 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:23:07.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:07 gibba013 bash[29418]: audit 2021-03-10T15:23:06.591915+0000 mon.a (mon.0) 1992 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:23:07.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:07 gibba013 bash[29418]: audit 2021-03-10T15:23:06.592575+0000 mon.a (mon.0) 1993 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:23:07.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:07 gibba013 bash[29418]: audit 2021-03-10T15:23:06.593262+0000 mon.a (mon.0) 1994 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:23:07.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:07 gibba013 bash[30381]: cluster 2021-03-10T15:23:06.278232+0000 mgr.gibba020.yqfnwy (mgr.34427) 4770 : cluster [DBG] pgmap v2713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:07.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:07 gibba013 bash[30381]: audit 2021-03-10T15:23:06.425054+0000 mon.a (mon.0) 1989 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:23:07.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:07 gibba013 bash[30381]: audit 2021-03-10T15:23:06.484514+0000 mon.a (mon.0) 1990 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:23:07.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:07 gibba013 bash[30381]: audit 2021-03-10T15:23:06.591153+0000 mon.a (mon.0) 1991 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:23:07.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:07 gibba013 bash[30381]: audit 2021-03-10T15:23:06.591915+0000 mon.a (mon.0) 1992 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:23:07.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:07 gibba013 bash[30381]: audit 2021-03-10T15:23:06.592575+0000 mon.a (mon.0) 1993 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:23:07.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:07 gibba013 bash[30381]: audit 2021-03-10T15:23:06.593262+0000 mon.a (mon.0) 1994 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:23:07.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:07 gibba020 bash[25448]: cluster 2021-03-10T15:23:06.278232+0000 mgr.gibba020.yqfnwy (mgr.34427) 4770 : cluster [DBG] pgmap v2713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:07.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:07 gibba020 bash[25448]: audit 2021-03-10T15:23:06.425054+0000 mon.a (mon.0) 1989 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:23:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:07 gibba020 bash[25448]: audit 2021-03-10T15:23:06.484514+0000 mon.a (mon.0) 1990 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:23:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:07 gibba020 bash[25448]: audit 2021-03-10T15:23:06.591153+0000 mon.a (mon.0) 1991 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:23:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:07 gibba020 bash[25448]: audit 2021-03-10T15:23:06.591915+0000 mon.a (mon.0) 1992 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:23:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:07 gibba020 bash[25448]: audit 2021-03-10T15:23:06.592575+0000 mon.a (mon.0) 1993 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:23:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:07 gibba020 bash[25448]: audit 2021-03-10T15:23:06.593262+0000 mon.a (mon.0) 1994 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:23:09.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:09 gibba013 bash[29418]: cluster 2021-03-10T15:23:08.279441+0000 mgr.gibba020.yqfnwy (mgr.34427) 4771 : cluster [DBG] pgmap v2714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:09.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:09 gibba013 bash[30381]: cluster 2021-03-10T15:23:08.279441+0000 mgr.gibba020.yqfnwy (mgr.34427) 4771 : cluster [DBG] pgmap v2714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:09.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:09 gibba020 bash[25448]: cluster 2021-03-10T15:23:08.279441+0000 mgr.gibba020.yqfnwy (mgr.34427) 4771 : cluster [DBG] pgmap v2714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:11.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:11 gibba013 bash[29418]: cluster 2021-03-10T15:23:10.281171+0000 mgr.gibba020.yqfnwy (mgr.34427) 4772 : cluster [DBG] pgmap v2715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:11.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:11 gibba013 bash[29418]: audit 2021-03-10T15:23:11.247288+0000 mon.a (mon.0) 1995 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:23:11.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:11 gibba013 bash[30381]: cluster 2021-03-10T15:23:10.281171+0000 mgr.gibba020.yqfnwy (mgr.34427) 4772 : cluster [DBG] pgmap v2715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:11.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:11 gibba013 bash[30381]: audit 2021-03-10T15:23:11.247288+0000 mon.a (mon.0) 1995 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:23:11.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:11 gibba020 bash[25448]: cluster 2021-03-10T15:23:10.281171+0000 mgr.gibba020.yqfnwy (mgr.34427) 4772 : cluster [DBG] pgmap v2715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:11.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:11 gibba020 bash[25448]: audit 2021-03-10T15:23:11.247288+0000 mon.a (mon.0) 1995 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:23:12.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[29418]: cephadm 2021-03-10T15:23:11.252437+0000 mgr.gibba020.yqfnwy (mgr.34427) 4773 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:23:12.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[29418]: cephadm 2021-03-10T15:23:11.254017+0000 mgr.gibba020.yqfnwy (mgr.34427) 4774 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:23:12.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[29418]: audit 2021-03-10T15:23:11.478997+0000 mon.a (mon.0) 1996 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:23:12.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[29418]: cephadm 2021-03-10T15:23:11.481048+0000 mgr.gibba020.yqfnwy (mgr.34427) 4775 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:23:12.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[29418]: audit 2021-03-10T15:23:11.482699+0000 mon.a (mon.0) 1997 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:23:12.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[29418]: cephadm 2021-03-10T15:23:11.483211+0000 mgr.gibba020.yqfnwy (mgr.34427) 4776 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:23:12.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[29418]: audit 2021-03-10T15:23:11.484449+0000 mon.a (mon.0) 1998 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:12.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[29418]: cephadm 2021-03-10T15:23:11.484896+0000 mgr.gibba020.yqfnwy (mgr.34427) 4777 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:23:12.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[29418]: cephadm 2021-03-10T15:23:11.484943+0000 mgr.gibba020.yqfnwy (mgr.34427) 4778 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:23:12.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[29418]: audit 2021-03-10T15:23:11.486248+0000 mon.a (mon.0) 1999 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:12.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[29418]: cephadm 2021-03-10T15:23:11.486706+0000 mgr.gibba020.yqfnwy (mgr.34427) 4779 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:23:12.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[29418]: cephadm 2021-03-10T15:23:11.486752+0000 mgr.gibba020.yqfnwy (mgr.34427) 4780 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:23:12.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[29418]: audit 2021-03-10T15:23:11.487995+0000 mon.a (mon.0) 2000 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:12.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[29418]: cephadm 2021-03-10T15:23:11.488375+0000 mgr.gibba020.yqfnwy (mgr.34427) 4781 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:23:12.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[29418]: cephadm 2021-03-10T15:23:11.489788+0000 mgr.gibba020.yqfnwy (mgr.34427) 4782 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:23:12.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[29418]: cephadm 2021-03-10T15:23:11.489834+0000 mgr.gibba020.yqfnwy (mgr.34427) 4783 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:23:12.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[29418]: audit 2021-03-10T15:23:11.491374+0000 mon.a (mon.0) 2001 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:12.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[29418]: cephadm 2021-03-10T15:23:11.491603+0000 mgr.gibba020.yqfnwy (mgr.34427) 4784 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:23:12.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[29418]: cephadm 2021-03-10T15:23:11.492024+0000 mgr.gibba020.yqfnwy (mgr.34427) 4785 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:23:12.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[29418]: audit 2021-03-10T15:23:11.493253+0000 mon.a (mon.0) 2002 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:12.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[29418]: cephadm 2021-03-10T15:23:11.493448+0000 mgr.gibba020.yqfnwy (mgr.34427) 4786 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:23:12.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[29418]: cephadm 2021-03-10T15:23:11.493494+0000 mgr.gibba020.yqfnwy (mgr.34427) 4787 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:23:12.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[29418]: cephadm 2021-03-10T15:23:11.493617+0000 mgr.gibba020.yqfnwy (mgr.34427) 4788 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:23:12.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[30381]: cephadm 2021-03-10T15:23:11.252437+0000 mgr.gibba020.yqfnwy (mgr.34427) 4773 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:23:12.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[30381]: cephadm 2021-03-10T15:23:11.254017+0000 mgr.gibba020.yqfnwy (mgr.34427) 4774 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:23:12.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[30381]: audit 2021-03-10T15:23:11.478997+0000 mon.a (mon.0) 1996 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:23:12.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[30381]: cephadm 2021-03-10T15:23:11.481048+0000 mgr.gibba020.yqfnwy (mgr.34427) 4775 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:23:12.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[30381]: audit 2021-03-10T15:23:11.482699+0000 mon.a (mon.0) 1997 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:23:12.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[30381]: cephadm 2021-03-10T15:23:11.483211+0000 mgr.gibba020.yqfnwy (mgr.34427) 4776 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:23:12.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[30381]: audit 2021-03-10T15:23:11.484449+0000 mon.a (mon.0) 1998 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:12.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[30381]: cephadm 2021-03-10T15:23:11.484896+0000 mgr.gibba020.yqfnwy (mgr.34427) 4777 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:23:12.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[30381]: cephadm 2021-03-10T15:23:11.484943+0000 mgr.gibba020.yqfnwy (mgr.34427) 4778 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:23:12.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[30381]: audit 2021-03-10T15:23:11.486248+0000 mon.a (mon.0) 1999 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:12.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[30381]: cephadm 2021-03-10T15:23:11.486706+0000 mgr.gibba020.yqfnwy (mgr.34427) 4779 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:23:12.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[30381]: cephadm 2021-03-10T15:23:11.486752+0000 mgr.gibba020.yqfnwy (mgr.34427) 4780 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:23:12.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[30381]: audit 2021-03-10T15:23:11.487995+0000 mon.a (mon.0) 2000 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:12.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[30381]: cephadm 2021-03-10T15:23:11.488375+0000 mgr.gibba020.yqfnwy (mgr.34427) 4781 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:23:12.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[30381]: cephadm 2021-03-10T15:23:11.489788+0000 mgr.gibba020.yqfnwy (mgr.34427) 4782 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:23:12.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[30381]: cephadm 2021-03-10T15:23:11.489834+0000 mgr.gibba020.yqfnwy (mgr.34427) 4783 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:23:12.893 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[30381]: audit 2021-03-10T15:23:11.491374+0000 mon.a (mon.0) 2001 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:12.893 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[30381]: cephadm 2021-03-10T15:23:11.491603+0000 mgr.gibba020.yqfnwy (mgr.34427) 4784 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:23:12.893 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[30381]: cephadm 2021-03-10T15:23:11.492024+0000 mgr.gibba020.yqfnwy (mgr.34427) 4785 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:23:12.893 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[30381]: audit 2021-03-10T15:23:11.493253+0000 mon.a (mon.0) 2002 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:12.893 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[30381]: cephadm 2021-03-10T15:23:11.493448+0000 mgr.gibba020.yqfnwy (mgr.34427) 4786 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:23:12.894 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[30381]: cephadm 2021-03-10T15:23:11.493494+0000 mgr.gibba020.yqfnwy (mgr.34427) 4787 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:23:12.894 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:12 gibba013 bash[30381]: cephadm 2021-03-10T15:23:11.493617+0000 mgr.gibba020.yqfnwy (mgr.34427) 4788 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:23:12.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:12 gibba020 bash[25448]: cephadm 2021-03-10T15:23:11.252437+0000 mgr.gibba020.yqfnwy (mgr.34427) 4773 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:23:12.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:12 gibba020 bash[25448]: cephadm 2021-03-10T15:23:11.254017+0000 mgr.gibba020.yqfnwy (mgr.34427) 4774 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:23:12.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:12 gibba020 bash[25448]: audit 2021-03-10T15:23:11.478997+0000 mon.a (mon.0) 1996 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:23:12.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:12 gibba020 bash[25448]: cephadm 2021-03-10T15:23:11.481048+0000 mgr.gibba020.yqfnwy (mgr.34427) 4775 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:23:12.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:12 gibba020 bash[25448]: audit 2021-03-10T15:23:11.482699+0000 mon.a (mon.0) 1997 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:23:12.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:12 gibba020 bash[25448]: cephadm 2021-03-10T15:23:11.483211+0000 mgr.gibba020.yqfnwy (mgr.34427) 4776 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:23:12.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:12 gibba020 bash[25448]: audit 2021-03-10T15:23:11.484449+0000 mon.a (mon.0) 1998 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:12.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:12 gibba020 bash[25448]: cephadm 2021-03-10T15:23:11.484896+0000 mgr.gibba020.yqfnwy (mgr.34427) 4777 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:23:12.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:12 gibba020 bash[25448]: cephadm 2021-03-10T15:23:11.484943+0000 mgr.gibba020.yqfnwy (mgr.34427) 4778 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:23:12.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:12 gibba020 bash[25448]: audit 2021-03-10T15:23:11.486248+0000 mon.a (mon.0) 1999 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:12.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:12 gibba020 bash[25448]: cephadm 2021-03-10T15:23:11.486706+0000 mgr.gibba020.yqfnwy (mgr.34427) 4779 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:23:12.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:12 gibba020 bash[25448]: cephadm 2021-03-10T15:23:11.486752+0000 mgr.gibba020.yqfnwy (mgr.34427) 4780 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:23:12.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:12 gibba020 bash[25448]: audit 2021-03-10T15:23:11.487995+0000 mon.a (mon.0) 2000 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:12.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:12 gibba020 bash[25448]: cephadm 2021-03-10T15:23:11.488375+0000 mgr.gibba020.yqfnwy (mgr.34427) 4781 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:23:12.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:12 gibba020 bash[25448]: cephadm 2021-03-10T15:23:11.489788+0000 mgr.gibba020.yqfnwy (mgr.34427) 4782 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:23:12.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:12 gibba020 bash[25448]: cephadm 2021-03-10T15:23:11.489834+0000 mgr.gibba020.yqfnwy (mgr.34427) 4783 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:23:12.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:12 gibba020 bash[25448]: audit 2021-03-10T15:23:11.491374+0000 mon.a (mon.0) 2001 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:12.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:12 gibba020 bash[25448]: cephadm 2021-03-10T15:23:11.491603+0000 mgr.gibba020.yqfnwy (mgr.34427) 4784 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:23:12.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:12 gibba020 bash[25448]: cephadm 2021-03-10T15:23:11.492024+0000 mgr.gibba020.yqfnwy (mgr.34427) 4785 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:23:12.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:12 gibba020 bash[25448]: audit 2021-03-10T15:23:11.493253+0000 mon.a (mon.0) 2002 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:12.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:12 gibba020 bash[25448]: cephadm 2021-03-10T15:23:11.493448+0000 mgr.gibba020.yqfnwy (mgr.34427) 4786 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:23:12.957 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:12 gibba020 bash[25448]: cephadm 2021-03-10T15:23:11.493494+0000 mgr.gibba020.yqfnwy (mgr.34427) 4787 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:23:12.957 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:12 gibba020 bash[25448]: cephadm 2021-03-10T15:23:11.493617+0000 mgr.gibba020.yqfnwy (mgr.34427) 4788 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:23:13.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:13 gibba013 bash[29418]: cluster 2021-03-10T15:23:12.281850+0000 mgr.gibba020.yqfnwy (mgr.34427) 4789 : cluster [DBG] pgmap v2716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:13.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:13 gibba013 bash[30381]: cluster 2021-03-10T15:23:12.281850+0000 mgr.gibba020.yqfnwy (mgr.34427) 4789 : cluster [DBG] pgmap v2716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:13.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:13 gibba020 bash[25448]: cluster 2021-03-10T15:23:12.281850+0000 mgr.gibba020.yqfnwy (mgr.34427) 4789 : cluster [DBG] pgmap v2716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:15.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:15 gibba013 bash[29418]: cluster 2021-03-10T15:23:14.283388+0000 mgr.gibba020.yqfnwy (mgr.34427) 4790 : cluster [DBG] pgmap v2717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:15.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:15 gibba013 bash[30381]: cluster 2021-03-10T15:23:14.283388+0000 mgr.gibba020.yqfnwy (mgr.34427) 4790 : cluster [DBG] pgmap v2717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:15.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:15 gibba020 bash[25448]: cluster 2021-03-10T15:23:14.283388+0000 mgr.gibba020.yqfnwy (mgr.34427) 4790 : cluster [DBG] pgmap v2717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:17.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:17 gibba013 bash[29418]: cluster 2021-03-10T15:23:16.285218+0000 mgr.gibba020.yqfnwy (mgr.34427) 4791 : cluster [DBG] pgmap v2718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:17.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:17 gibba013 bash[30381]: cluster 2021-03-10T15:23:16.285218+0000 mgr.gibba020.yqfnwy (mgr.34427) 4791 : cluster [DBG] pgmap v2718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:17.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:17 gibba020 bash[25448]: cluster 2021-03-10T15:23:16.285218+0000 mgr.gibba020.yqfnwy (mgr.34427) 4791 : cluster [DBG] pgmap v2718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:19.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:19 gibba013 bash[29418]: cluster 2021-03-10T15:23:18.286545+0000 mgr.gibba020.yqfnwy (mgr.34427) 4792 : cluster [DBG] pgmap v2719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:19.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:19 gibba013 bash[30381]: cluster 2021-03-10T15:23:18.286545+0000 mgr.gibba020.yqfnwy (mgr.34427) 4792 : cluster [DBG] pgmap v2719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:19.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:19 gibba020 bash[25448]: cluster 2021-03-10T15:23:18.286545+0000 mgr.gibba020.yqfnwy (mgr.34427) 4792 : cluster [DBG] pgmap v2719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:21.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:21 gibba013 bash[29418]: cluster 2021-03-10T15:23:20.288396+0000 mgr.gibba020.yqfnwy (mgr.34427) 4793 : cluster [DBG] pgmap v2720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:21.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:21 gibba013 bash[30381]: cluster 2021-03-10T15:23:20.288396+0000 mgr.gibba020.yqfnwy (mgr.34427) 4793 : cluster [DBG] pgmap v2720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:21.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:21 gibba020 bash[25448]: cluster 2021-03-10T15:23:20.288396+0000 mgr.gibba020.yqfnwy (mgr.34427) 4793 : cluster [DBG] pgmap v2720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:23.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:23 gibba013 bash[29418]: cluster 2021-03-10T15:23:22.288859+0000 mgr.gibba020.yqfnwy (mgr.34427) 4794 : cluster [DBG] pgmap v2721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:23.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:23 gibba013 bash[30381]: cluster 2021-03-10T15:23:22.288859+0000 mgr.gibba020.yqfnwy (mgr.34427) 4794 : cluster [DBG] pgmap v2721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:23.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:23 gibba020 bash[25448]: cluster 2021-03-10T15:23:22.288859+0000 mgr.gibba020.yqfnwy (mgr.34427) 4794 : cluster [DBG] pgmap v2721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:25.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:25 gibba013 bash[29418]: cluster 2021-03-10T15:23:24.290103+0000 mgr.gibba020.yqfnwy (mgr.34427) 4795 : cluster [DBG] pgmap v2722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:25.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:25 gibba013 bash[30381]: cluster 2021-03-10T15:23:24.290103+0000 mgr.gibba020.yqfnwy (mgr.34427) 4795 : cluster [DBG] pgmap v2722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:25.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:25 gibba020 bash[25448]: cluster 2021-03-10T15:23:24.290103+0000 mgr.gibba020.yqfnwy (mgr.34427) 4795 : cluster [DBG] pgmap v2722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:27.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:27 gibba013 bash[29418]: cluster 2021-03-10T15:23:26.291684+0000 mgr.gibba020.yqfnwy (mgr.34427) 4796 : cluster [DBG] pgmap v2723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:27.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:27 gibba013 bash[29418]: cephadm 2021-03-10T15:23:26.509576+0000 mgr.gibba020.yqfnwy (mgr.34427) 4797 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:23:27.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:27 gibba013 bash[30381]: cluster 2021-03-10T15:23:26.291684+0000 mgr.gibba020.yqfnwy (mgr.34427) 4796 : cluster [DBG] pgmap v2723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:27.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:27 gibba013 bash[30381]: cephadm 2021-03-10T15:23:26.509576+0000 mgr.gibba020.yqfnwy (mgr.34427) 4797 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:23:27.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:27 gibba020 bash[25448]: cluster 2021-03-10T15:23:26.291684+0000 mgr.gibba020.yqfnwy (mgr.34427) 4796 : cluster [DBG] pgmap v2723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:27.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:27 gibba020 bash[25448]: cephadm 2021-03-10T15:23:26.509576+0000 mgr.gibba020.yqfnwy (mgr.34427) 4797 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:23:29.120 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:23:29.349 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:23:29.349 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (89m) 4m ago 95m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:23:29.349 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (95m) 3m ago 95m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:23:29.349 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (90m) 3m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:23:29.350 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (90m) 3m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:23:29.350 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (89m) 4m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:23:29.350 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (89m) 4m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:23:29.350 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (89m) 3m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:23:29.351 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (89m) 4m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:23:29.351 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (95m) 4m ago 95m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:23:29.351 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (95m) 3m ago 95m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:23:29.351 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (88m) 4m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:23:29.352 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (87m) 4m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:23:29.352 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (87m) 4m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:23:29.352 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (86m) 4m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:23:29.352 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (86m) 3m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:23:29.352 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (86m) 3m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:23:29.353 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (85m) 3m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:23:29.353 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (85m) 3m ago 95m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:23:29.353 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (94m) 3m ago 95m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:23:29.353 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 3m ago 93m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:23:29.599 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:23:29.599 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:23:29.599 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:23:29.599 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:23:29.600 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:23:29.600 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:23:29.600 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:23:29.600 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:23:29.601 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:23:29.601 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:23:29.601 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:23:29.601 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:23:29.602 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:23:29.602 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:23:29.602 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:23:29.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:29 gibba013 bash[29418]: cluster 2021-03-10T15:23:28.293054+0000 mgr.gibba020.yqfnwy (mgr.34427) 4798 : cluster [DBG] pgmap v2724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:29.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:29 gibba013 bash[29418]: audit 2021-03-10T15:23:29.106695+0000 mgr.gibba020.yqfnwy (mgr.34427) 4799 : audit [DBG] from='client.47274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:23:29.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:29 gibba013 bash[30381]: cluster 2021-03-10T15:23:28.293054+0000 mgr.gibba020.yqfnwy (mgr.34427) 4798 : cluster [DBG] pgmap v2724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:29.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:29 gibba013 bash[30381]: audit 2021-03-10T15:23:29.106695+0000 mgr.gibba020.yqfnwy (mgr.34427) 4799 : audit [DBG] from='client.47274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:23:29.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:29 gibba020 bash[25448]: cluster 2021-03-10T15:23:28.293054+0000 mgr.gibba020.yqfnwy (mgr.34427) 4798 : cluster [DBG] pgmap v2724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:29.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:29 gibba020 bash[25448]: audit 2021-03-10T15:23:29.106695+0000 mgr.gibba020.yqfnwy (mgr.34427) 4799 : audit [DBG] from='client.47274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:23:30.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:30 gibba013 bash[29418]: audit 2021-03-10T15:23:29.332084+0000 mgr.gibba020.yqfnwy (mgr.34427) 4800 : audit [DBG] from='client.47280 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:23:30.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:30 gibba013 bash[29418]: audit 2021-03-10T15:23:29.595431+0000 mon.a (mon.0) 2003 : audit [DBG] from='client.? 172.21.2.113:0/4064874374' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:30.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:30 gibba013 bash[30381]: audit 2021-03-10T15:23:29.332084+0000 mgr.gibba020.yqfnwy (mgr.34427) 4800 : audit [DBG] from='client.47280 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:23:30.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:30 gibba013 bash[30381]: audit 2021-03-10T15:23:29.595431+0000 mon.a (mon.0) 2003 : audit [DBG] from='client.? 172.21.2.113:0/4064874374' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:30.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:30 gibba020 bash[25448]: audit 2021-03-10T15:23:29.332084+0000 mgr.gibba020.yqfnwy (mgr.34427) 4800 : audit [DBG] from='client.47280 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:23:30.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:30 gibba020 bash[25448]: audit 2021-03-10T15:23:29.595431+0000 mon.a (mon.0) 2003 : audit [DBG] from='client.? 172.21.2.113:0/4064874374' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:23:31.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:31 gibba020 bash[25448]: cluster 2021-03-10T15:23:30.294786+0000 mgr.gibba020.yqfnwy (mgr.34427) 4801 : cluster [DBG] pgmap v2725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:31.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:31 gibba013 bash[29418]: cluster 2021-03-10T15:23:30.294786+0000 mgr.gibba020.yqfnwy (mgr.34427) 4801 : cluster [DBG] pgmap v2725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:31.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:31 gibba013 bash[30381]: cluster 2021-03-10T15:23:30.294786+0000 mgr.gibba020.yqfnwy (mgr.34427) 4801 : cluster [DBG] pgmap v2725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:33.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:33 gibba013 bash[29418]: cluster 2021-03-10T15:23:32.295263+0000 mgr.gibba020.yqfnwy (mgr.34427) 4802 : cluster [DBG] pgmap v2726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:33.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:33 gibba013 bash[30381]: cluster 2021-03-10T15:23:32.295263+0000 mgr.gibba020.yqfnwy (mgr.34427) 4802 : cluster [DBG] pgmap v2726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:33.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:33 gibba020 bash[25448]: cluster 2021-03-10T15:23:32.295263+0000 mgr.gibba020.yqfnwy (mgr.34427) 4802 : cluster [DBG] pgmap v2726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:35.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:35 gibba013 bash[29418]: cluster 2021-03-10T15:23:34.296655+0000 mgr.gibba020.yqfnwy (mgr.34427) 4803 : cluster [DBG] pgmap v2727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:35.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:35 gibba013 bash[30381]: cluster 2021-03-10T15:23:34.296655+0000 mgr.gibba020.yqfnwy (mgr.34427) 4803 : cluster [DBG] pgmap v2727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:35.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:35 gibba020 bash[25448]: cluster 2021-03-10T15:23:34.296655+0000 mgr.gibba020.yqfnwy (mgr.34427) 4803 : cluster [DBG] pgmap v2727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:37.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:37 gibba013 bash[29418]: cluster 2021-03-10T15:23:36.298337+0000 mgr.gibba020.yqfnwy (mgr.34427) 4804 : cluster [DBG] pgmap v2728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:37.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:37 gibba013 bash[30381]: cluster 2021-03-10T15:23:36.298337+0000 mgr.gibba020.yqfnwy (mgr.34427) 4804 : cluster [DBG] pgmap v2728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:37.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:37 gibba020 bash[25448]: cluster 2021-03-10T15:23:36.298337+0000 mgr.gibba020.yqfnwy (mgr.34427) 4804 : cluster [DBG] pgmap v2728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:39.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:39 gibba013 bash[29418]: cluster 2021-03-10T15:23:38.299726+0000 mgr.gibba020.yqfnwy (mgr.34427) 4805 : cluster [DBG] pgmap v2729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:39.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:39 gibba013 bash[30381]: cluster 2021-03-10T15:23:38.299726+0000 mgr.gibba020.yqfnwy (mgr.34427) 4805 : cluster [DBG] pgmap v2729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:39.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:39 gibba020 bash[25448]: cluster 2021-03-10T15:23:38.299726+0000 mgr.gibba020.yqfnwy (mgr.34427) 4805 : cluster [DBG] pgmap v2729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:41.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:41 gibba020 bash[25448]: cluster 2021-03-10T15:23:40.301307+0000 mgr.gibba020.yqfnwy (mgr.34427) 4806 : cluster [DBG] pgmap v2730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:41.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:41 gibba013 bash[29418]: cluster 2021-03-10T15:23:40.301307+0000 mgr.gibba020.yqfnwy (mgr.34427) 4806 : cluster [DBG] pgmap v2730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:41.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:41 gibba013 bash[30381]: cluster 2021-03-10T15:23:40.301307+0000 mgr.gibba020.yqfnwy (mgr.34427) 4806 : cluster [DBG] pgmap v2730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:42.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:42 gibba020 bash[25448]: cephadm 2021-03-10T15:23:41.525520+0000 mgr.gibba020.yqfnwy (mgr.34427) 4807 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:23:42.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:42 gibba013 bash[29418]: cephadm 2021-03-10T15:23:41.525520+0000 mgr.gibba020.yqfnwy (mgr.34427) 4807 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:23:42.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:42 gibba013 bash[30381]: cephadm 2021-03-10T15:23:41.525520+0000 mgr.gibba020.yqfnwy (mgr.34427) 4807 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:23:43.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:43 gibba020 bash[25448]: cluster 2021-03-10T15:23:42.302002+0000 mgr.gibba020.yqfnwy (mgr.34427) 4808 : cluster [DBG] pgmap v2731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:43.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:43 gibba013 bash[29418]: cluster 2021-03-10T15:23:42.302002+0000 mgr.gibba020.yqfnwy (mgr.34427) 4808 : cluster [DBG] pgmap v2731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:43.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:43 gibba013 bash[30381]: cluster 2021-03-10T15:23:42.302002+0000 mgr.gibba020.yqfnwy (mgr.34427) 4808 : cluster [DBG] pgmap v2731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:45.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:45 gibba020 bash[25448]: cluster 2021-03-10T15:23:44.303426+0000 mgr.gibba020.yqfnwy (mgr.34427) 4809 : cluster [DBG] pgmap v2732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:45.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:45 gibba013 bash[29418]: cluster 2021-03-10T15:23:44.303426+0000 mgr.gibba020.yqfnwy (mgr.34427) 4809 : cluster [DBG] pgmap v2732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:45.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:45 gibba013 bash[30381]: cluster 2021-03-10T15:23:44.303426+0000 mgr.gibba020.yqfnwy (mgr.34427) 4809 : cluster [DBG] pgmap v2732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:47.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:47 gibba020 bash[25448]: cluster 2021-03-10T15:23:46.305261+0000 mgr.gibba020.yqfnwy (mgr.34427) 4810 : cluster [DBG] pgmap v2733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:47.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:47 gibba013 bash[29418]: cluster 2021-03-10T15:23:46.305261+0000 mgr.gibba020.yqfnwy (mgr.34427) 4810 : cluster [DBG] pgmap v2733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:47.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:47 gibba013 bash[30381]: cluster 2021-03-10T15:23:46.305261+0000 mgr.gibba020.yqfnwy (mgr.34427) 4810 : cluster [DBG] pgmap v2733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:49.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:49 gibba020 bash[25448]: cluster 2021-03-10T15:23:48.306526+0000 mgr.gibba020.yqfnwy (mgr.34427) 4811 : cluster [DBG] pgmap v2734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:49.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:49 gibba013 bash[29418]: cluster 2021-03-10T15:23:48.306526+0000 mgr.gibba020.yqfnwy (mgr.34427) 4811 : cluster [DBG] pgmap v2734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:49.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:49 gibba013 bash[30381]: cluster 2021-03-10T15:23:48.306526+0000 mgr.gibba020.yqfnwy (mgr.34427) 4811 : cluster [DBG] pgmap v2734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:51.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:51 gibba020 bash[25448]: cluster 2021-03-10T15:23:50.308264+0000 mgr.gibba020.yqfnwy (mgr.34427) 4812 : cluster [DBG] pgmap v2735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:51.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:51 gibba013 bash[29418]: cluster 2021-03-10T15:23:50.308264+0000 mgr.gibba020.yqfnwy (mgr.34427) 4812 : cluster [DBG] pgmap v2735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:51.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:51 gibba013 bash[30381]: cluster 2021-03-10T15:23:50.308264+0000 mgr.gibba020.yqfnwy (mgr.34427) 4812 : cluster [DBG] pgmap v2735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:53.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:53 gibba013 bash[29418]: cluster 2021-03-10T15:23:52.309037+0000 mgr.gibba020.yqfnwy (mgr.34427) 4813 : cluster [DBG] pgmap v2736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:53.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:53 gibba013 bash[30381]: cluster 2021-03-10T15:23:52.309037+0000 mgr.gibba020.yqfnwy (mgr.34427) 4813 : cluster [DBG] pgmap v2736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:53.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:53 gibba020 bash[25448]: cluster 2021-03-10T15:23:52.309037+0000 mgr.gibba020.yqfnwy (mgr.34427) 4813 : cluster [DBG] pgmap v2736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:55.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:55 gibba013 bash[29418]: cluster 2021-03-10T15:23:54.310555+0000 mgr.gibba020.yqfnwy (mgr.34427) 4814 : cluster [DBG] pgmap v2737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:55.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:55 gibba013 bash[30381]: cluster 2021-03-10T15:23:54.310555+0000 mgr.gibba020.yqfnwy (mgr.34427) 4814 : cluster [DBG] pgmap v2737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:55.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:55 gibba020 bash[25448]: cluster 2021-03-10T15:23:54.310555+0000 mgr.gibba020.yqfnwy (mgr.34427) 4814 : cluster [DBG] pgmap v2737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:57.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:57 gibba020 bash[25448]: cluster 2021-03-10T15:23:56.312137+0000 mgr.gibba020.yqfnwy (mgr.34427) 4815 : cluster [DBG] pgmap v2738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:57.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:57 gibba020 bash[25448]: cephadm 2021-03-10T15:23:56.541532+0000 mgr.gibba020.yqfnwy (mgr.34427) 4816 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:23:57.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:57 gibba013 bash[29418]: cluster 2021-03-10T15:23:56.312137+0000 mgr.gibba020.yqfnwy (mgr.34427) 4815 : cluster [DBG] pgmap v2738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:57.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:57 gibba013 bash[29418]: cephadm 2021-03-10T15:23:56.541532+0000 mgr.gibba020.yqfnwy (mgr.34427) 4816 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:23:57.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:57 gibba013 bash[30381]: cluster 2021-03-10T15:23:56.312137+0000 mgr.gibba020.yqfnwy (mgr.34427) 4815 : cluster [DBG] pgmap v2738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:57.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:57 gibba013 bash[30381]: cephadm 2021-03-10T15:23:56.541532+0000 mgr.gibba020.yqfnwy (mgr.34427) 4816 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:23:59.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:23:59 gibba020 bash[25448]: cluster 2021-03-10T15:23:58.313555+0000 mgr.gibba020.yqfnwy (mgr.34427) 4817 : cluster [DBG] pgmap v2739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:59.841 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:23:59.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:23:59 gibba013 bash[29418]: cluster 2021-03-10T15:23:58.313555+0000 mgr.gibba020.yqfnwy (mgr.34427) 4817 : cluster [DBG] pgmap v2739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:23:59.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:23:59 gibba013 bash[30381]: cluster 2021-03-10T15:23:58.313555+0000 mgr.gibba020.yqfnwy (mgr.34427) 4817 : cluster [DBG] pgmap v2739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:00.060 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:24:00.060 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (90m) 4m ago 95m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:24:00.060 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (95m) 3m ago 95m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:24:00.061 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (90m) 3m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:24:00.061 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (91m) 3m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:24:00.061 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (90m) 4m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:24:00.061 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (90m) 4m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:24:00.061 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (89m) 3m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:24:00.062 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (89m) 4m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:24:00.062 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (96m) 4m ago 96m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:24:00.062 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (96m) 3m ago 96m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:24:00.062 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (88m) 4m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:24:00.063 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (88m) 4m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:24:00.063 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (87m) 4m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:24:00.063 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (87m) 4m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:24:00.063 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (87m) 3m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:24:00.064 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (86m) 3m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:24:00.064 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (86m) 3m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:24:00.064 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (85m) 3m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:24:00.064 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (95m) 3m ago 96m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:24:00.065 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 3m ago 93m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:24:00.309 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:24:00.309 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:24:00.309 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:24:00.310 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:24:00.310 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:24:00.310 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:24:00.310 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:24:00.311 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:24:00.311 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:24:00.311 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:24:00.311 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:24:00.312 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:24:00.312 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:24:00.312 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:24:00.312 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:24:00.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:00 gibba020 bash[25448]: audit 2021-03-10T15:23:59.827456+0000 mgr.gibba020.yqfnwy (mgr.34427) 4818 : audit [DBG] from='client.47292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:24:00.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:00 gibba020 bash[25448]: audit 2021-03-10T15:24:00.047476+0000 mgr.gibba020.yqfnwy (mgr.34427) 4819 : audit [DBG] from='client.47298 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:24:00.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:00 gibba020 bash[25448]: audit 2021-03-10T15:24:00.305435+0000 mon.c (mon.1) 83 : audit [DBG] from='client.? 172.21.2.113:0/1041283578' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:00.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:00 gibba013 bash[29418]: audit 2021-03-10T15:23:59.827456+0000 mgr.gibba020.yqfnwy (mgr.34427) 4818 : audit [DBG] from='client.47292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:24:00.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:00 gibba013 bash[29418]: audit 2021-03-10T15:24:00.047476+0000 mgr.gibba020.yqfnwy (mgr.34427) 4819 : audit [DBG] from='client.47298 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:24:00.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:00 gibba013 bash[29418]: audit 2021-03-10T15:24:00.305435+0000 mon.c (mon.1) 83 : audit [DBG] from='client.? 172.21.2.113:0/1041283578' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:00.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:00 gibba013 bash[30381]: audit 2021-03-10T15:23:59.827456+0000 mgr.gibba020.yqfnwy (mgr.34427) 4818 : audit [DBG] from='client.47292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:24:00.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:00 gibba013 bash[30381]: audit 2021-03-10T15:24:00.047476+0000 mgr.gibba020.yqfnwy (mgr.34427) 4819 : audit [DBG] from='client.47298 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:24:00.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:00 gibba013 bash[30381]: audit 2021-03-10T15:24:00.305435+0000 mon.c (mon.1) 83 : audit [DBG] from='client.? 172.21.2.113:0/1041283578' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:01.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:01 gibba020 bash[25448]: cluster 2021-03-10T15:24:00.314948+0000 mgr.gibba020.yqfnwy (mgr.34427) 4820 : cluster [DBG] pgmap v2740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:01.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:01 gibba013 bash[29418]: cluster 2021-03-10T15:24:00.314948+0000 mgr.gibba020.yqfnwy (mgr.34427) 4820 : cluster [DBG] pgmap v2740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:01.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:01 gibba013 bash[30381]: cluster 2021-03-10T15:24:00.314948+0000 mgr.gibba020.yqfnwy (mgr.34427) 4820 : cluster [DBG] pgmap v2740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:03.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:03 gibba013 bash[29418]: cluster 2021-03-10T15:24:02.316074+0000 mgr.gibba020.yqfnwy (mgr.34427) 4821 : cluster [DBG] pgmap v2741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:03.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:03 gibba013 bash[30381]: cluster 2021-03-10T15:24:02.316074+0000 mgr.gibba020.yqfnwy (mgr.34427) 4821 : cluster [DBG] pgmap v2741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:03.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:03 gibba020 bash[25448]: cluster 2021-03-10T15:24:02.316074+0000 mgr.gibba020.yqfnwy (mgr.34427) 4821 : cluster [DBG] pgmap v2741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:05.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:05 gibba020 bash[25448]: cluster 2021-03-10T15:24:04.317739+0000 mgr.gibba020.yqfnwy (mgr.34427) 4822 : cluster [DBG] pgmap v2742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:05.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:05 gibba013 bash[29418]: cluster 2021-03-10T15:24:04.317739+0000 mgr.gibba020.yqfnwy (mgr.34427) 4822 : cluster [DBG] pgmap v2742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:05.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:05 gibba013 bash[30381]: cluster 2021-03-10T15:24:04.317739+0000 mgr.gibba020.yqfnwy (mgr.34427) 4822 : cluster [DBG] pgmap v2742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:07.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:07 gibba020 bash[25448]: cluster 2021-03-10T15:24:06.319632+0000 mgr.gibba020.yqfnwy (mgr.34427) 4823 : cluster [DBG] pgmap v2743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:07 gibba020 bash[25448]: audit 2021-03-10T15:24:06.430069+0000 mon.a (mon.0) 2004 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:24:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:07 gibba020 bash[25448]: audit 2021-03-10T15:24:06.491129+0000 mon.a (mon.0) 2005 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:24:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:07 gibba020 bash[25448]: audit 2021-03-10T15:24:06.598070+0000 mon.a (mon.0) 2006 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T15:24:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:07 gibba020 bash[25448]: audit 2021-03-10T15:24:06.598828+0000 mon.a (mon.0) 2007 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:24:07.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:07 gibba020 bash[25448]: audit 2021-03-10T15:24:06.599490+0000 mon.a (mon.0) 2008 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:24:07.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:07 gibba020 bash[25448]: audit 2021-03-10T15:24:06.600131+0000 mon.a (mon.0) 2009 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:24:07.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:07 gibba013 bash[29418]: cluster 2021-03-10T15:24:06.319632+0000 mgr.gibba020.yqfnwy (mgr.34427) 4823 : cluster [DBG] pgmap v2743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:07.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:07 gibba013 bash[29418]: audit 2021-03-10T15:24:06.430069+0000 mon.a (mon.0) 2004 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:24:07.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:07 gibba013 bash[29418]: audit 2021-03-10T15:24:06.491129+0000 mon.a (mon.0) 2005 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:24:07.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:07 gibba013 bash[29418]: audit 2021-03-10T15:24:06.598070+0000 mon.a (mon.0) 2006 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T15:24:07.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:07 gibba013 bash[29418]: audit 2021-03-10T15:24:06.598828+0000 mon.a (mon.0) 2007 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:24:07.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:07 gibba013 bash[29418]: audit 2021-03-10T15:24:06.599490+0000 mon.a (mon.0) 2008 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:24:07.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:07 gibba013 bash[29418]: audit 2021-03-10T15:24:06.600131+0000 mon.a (mon.0) 2009 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:24:07.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:07 gibba013 bash[30381]: cluster 2021-03-10T15:24:06.319632+0000 mgr.gibba020.yqfnwy (mgr.34427) 4823 : cluster [DBG] pgmap v2743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:07.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:07 gibba013 bash[30381]: audit 2021-03-10T15:24:06.430069+0000 mon.a (mon.0) 2004 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:24:07.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:07 gibba013 bash[30381]: audit 2021-03-10T15:24:06.491129+0000 mon.a (mon.0) 2005 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:24:07.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:07 gibba013 bash[30381]: audit 2021-03-10T15:24:06.598070+0000 mon.a (mon.0) 2006 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T15:24:07.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:07 gibba013 bash[30381]: audit 2021-03-10T15:24:06.598828+0000 mon.a (mon.0) 2007 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:24:07.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:07 gibba013 bash[30381]: audit 2021-03-10T15:24:06.599490+0000 mon.a (mon.0) 2008 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:24:07.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:07 gibba013 bash[30381]: audit 2021-03-10T15:24:06.600131+0000 mon.a (mon.0) 2009 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:24:09.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:09 gibba020 bash[25448]: cluster 2021-03-10T15:24:08.321043+0000 mgr.gibba020.yqfnwy (mgr.34427) 4824 : cluster [DBG] pgmap v2744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:09.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:09 gibba013 bash[29418]: cluster 2021-03-10T15:24:08.321043+0000 mgr.gibba020.yqfnwy (mgr.34427) 4824 : cluster [DBG] pgmap v2744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:09.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:09 gibba013 bash[30381]: cluster 2021-03-10T15:24:08.321043+0000 mgr.gibba020.yqfnwy (mgr.34427) 4824 : cluster [DBG] pgmap v2744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:11.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:11 gibba020 bash[25448]: cluster 2021-03-10T15:24:10.322465+0000 mgr.gibba020.yqfnwy (mgr.34427) 4825 : cluster [DBG] pgmap v2745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:11.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:11 gibba013 bash[29418]: cluster 2021-03-10T15:24:10.322465+0000 mgr.gibba020.yqfnwy (mgr.34427) 4825 : cluster [DBG] pgmap v2745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:11.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:11 gibba013 bash[30381]: cluster 2021-03-10T15:24:10.322465+0000 mgr.gibba020.yqfnwy (mgr.34427) 4825 : cluster [DBG] pgmap v2745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:12.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:12 gibba020 bash[25448]: audit 2021-03-10T15:24:11.559004+0000 mon.a (mon.0) 2010 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:24:12.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:12 gibba020 bash[25448]: cephadm 2021-03-10T15:24:11.563478+0000 mgr.gibba020.yqfnwy (mgr.34427) 4826 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:24:12.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:12 gibba020 bash[25448]: cephadm 2021-03-10T15:24:11.565356+0000 mgr.gibba020.yqfnwy (mgr.34427) 4827 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:24:12.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:12 gibba020 bash[25448]: audit 2021-03-10T15:24:11.786712+0000 mon.a (mon.0) 2011 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:24:12.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:12 gibba020 bash[25448]: cephadm 2021-03-10T15:24:11.788664+0000 mgr.gibba020.yqfnwy (mgr.34427) 4828 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:24:12.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:12 gibba020 bash[25448]: audit 2021-03-10T15:24:11.790095+0000 mon.a (mon.0) 2012 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:24:12.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:12 gibba020 bash[25448]: cephadm 2021-03-10T15:24:11.790379+0000 mgr.gibba020.yqfnwy (mgr.34427) 4829 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:24:12.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:12 gibba020 bash[25448]: audit 2021-03-10T15:24:11.791563+0000 mon.a (mon.0) 2013 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:12.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:12 gibba020 bash[25448]: cephadm 2021-03-10T15:24:11.791779+0000 mgr.gibba020.yqfnwy (mgr.34427) 4830 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:24:12.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:12 gibba020 bash[25448]: cephadm 2021-03-10T15:24:11.791817+0000 mgr.gibba020.yqfnwy (mgr.34427) 4831 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:24:12.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:12 gibba020 bash[25448]: audit 2021-03-10T15:24:11.793085+0000 mon.a (mon.0) 2014 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:12.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:12 gibba020 bash[25448]: cephadm 2021-03-10T15:24:11.793325+0000 mgr.gibba020.yqfnwy (mgr.34427) 4832 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:24:12.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:12 gibba020 bash[25448]: cephadm 2021-03-10T15:24:11.793467+0000 mgr.gibba020.yqfnwy (mgr.34427) 4833 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:24:12.706 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:12 gibba020 bash[25448]: audit 2021-03-10T15:24:11.794729+0000 mon.a (mon.0) 2015 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:12.706 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:12 gibba020 bash[25448]: cephadm 2021-03-10T15:24:11.795127+0000 mgr.gibba020.yqfnwy (mgr.34427) 4834 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:24:12.706 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:12 gibba020 bash[25448]: cephadm 2021-03-10T15:24:11.796987+0000 mgr.gibba020.yqfnwy (mgr.34427) 4835 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:24:12.706 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:12 gibba020 bash[25448]: cephadm 2021-03-10T15:24:11.797021+0000 mgr.gibba020.yqfnwy (mgr.34427) 4836 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:24:12.707 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:12 gibba020 bash[25448]: audit 2021-03-10T15:24:11.798281+0000 mon.a (mon.0) 2016 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:12.707 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:12 gibba020 bash[25448]: cephadm 2021-03-10T15:24:11.798469+0000 mgr.gibba020.yqfnwy (mgr.34427) 4837 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:24:12.707 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:12 gibba020 bash[25448]: cephadm 2021-03-10T15:24:11.798780+0000 mgr.gibba020.yqfnwy (mgr.34427) 4838 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:24:12.707 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:12 gibba020 bash[25448]: audit 2021-03-10T15:24:11.799799+0000 mon.a (mon.0) 2017 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:12.708 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:12 gibba020 bash[25448]: cephadm 2021-03-10T15:24:11.799880+0000 mgr.gibba020.yqfnwy (mgr.34427) 4839 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:24:12.708 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:12 gibba020 bash[25448]: cephadm 2021-03-10T15:24:11.799936+0000 mgr.gibba020.yqfnwy (mgr.34427) 4840 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:24:12.708 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:12 gibba020 bash[25448]: cephadm 2021-03-10T15:24:11.800076+0000 mgr.gibba020.yqfnwy (mgr.34427) 4841 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:24:12.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[29418]: audit 2021-03-10T15:24:11.559004+0000 mon.a (mon.0) 2010 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:24:12.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[29418]: cephadm 2021-03-10T15:24:11.563478+0000 mgr.gibba020.yqfnwy (mgr.34427) 4826 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:24:12.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[29418]: cephadm 2021-03-10T15:24:11.565356+0000 mgr.gibba020.yqfnwy (mgr.34427) 4827 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:24:12.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[29418]: audit 2021-03-10T15:24:11.786712+0000 mon.a (mon.0) 2011 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:24:12.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[29418]: cephadm 2021-03-10T15:24:11.788664+0000 mgr.gibba020.yqfnwy (mgr.34427) 4828 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:24:12.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[29418]: audit 2021-03-10T15:24:11.790095+0000 mon.a (mon.0) 2012 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:24:12.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[29418]: cephadm 2021-03-10T15:24:11.790379+0000 mgr.gibba020.yqfnwy (mgr.34427) 4829 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:24:12.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[29418]: audit 2021-03-10T15:24:11.791563+0000 mon.a (mon.0) 2013 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:12.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[29418]: cephadm 2021-03-10T15:24:11.791779+0000 mgr.gibba020.yqfnwy (mgr.34427) 4830 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:24:12.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[29418]: cephadm 2021-03-10T15:24:11.791817+0000 mgr.gibba020.yqfnwy (mgr.34427) 4831 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:24:12.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[29418]: audit 2021-03-10T15:24:11.793085+0000 mon.a (mon.0) 2014 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:12.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[29418]: cephadm 2021-03-10T15:24:11.793325+0000 mgr.gibba020.yqfnwy (mgr.34427) 4832 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:24:12.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[29418]: cephadm 2021-03-10T15:24:11.793467+0000 mgr.gibba020.yqfnwy (mgr.34427) 4833 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:24:12.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[29418]: audit 2021-03-10T15:24:11.794729+0000 mon.a (mon.0) 2015 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:12.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[29418]: cephadm 2021-03-10T15:24:11.795127+0000 mgr.gibba020.yqfnwy (mgr.34427) 4834 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:24:12.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[29418]: cephadm 2021-03-10T15:24:11.796987+0000 mgr.gibba020.yqfnwy (mgr.34427) 4835 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:24:12.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[29418]: cephadm 2021-03-10T15:24:11.797021+0000 mgr.gibba020.yqfnwy (mgr.34427) 4836 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:24:12.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[29418]: audit 2021-03-10T15:24:11.798281+0000 mon.a (mon.0) 2016 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:12.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[29418]: cephadm 2021-03-10T15:24:11.798469+0000 mgr.gibba020.yqfnwy (mgr.34427) 4837 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:24:12.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[29418]: cephadm 2021-03-10T15:24:11.798780+0000 mgr.gibba020.yqfnwy (mgr.34427) 4838 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:24:12.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[30381]: audit 2021-03-10T15:24:11.559004+0000 mon.a (mon.0) 2010 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:24:12.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[30381]: cephadm 2021-03-10T15:24:11.563478+0000 mgr.gibba020.yqfnwy (mgr.34427) 4826 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:24:12.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[30381]: cephadm 2021-03-10T15:24:11.565356+0000 mgr.gibba020.yqfnwy (mgr.34427) 4827 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:24:12.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[30381]: audit 2021-03-10T15:24:11.786712+0000 mon.a (mon.0) 2011 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:24:12.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[30381]: cephadm 2021-03-10T15:24:11.788664+0000 mgr.gibba020.yqfnwy (mgr.34427) 4828 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:24:12.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[30381]: audit 2021-03-10T15:24:11.790095+0000 mon.a (mon.0) 2012 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:24:12.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[30381]: cephadm 2021-03-10T15:24:11.790379+0000 mgr.gibba020.yqfnwy (mgr.34427) 4829 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:24:12.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[30381]: audit 2021-03-10T15:24:11.791563+0000 mon.a (mon.0) 2013 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:12.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[30381]: cephadm 2021-03-10T15:24:11.791779+0000 mgr.gibba020.yqfnwy (mgr.34427) 4830 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:24:12.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[30381]: cephadm 2021-03-10T15:24:11.791817+0000 mgr.gibba020.yqfnwy (mgr.34427) 4831 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:24:12.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[30381]: audit 2021-03-10T15:24:11.793085+0000 mon.a (mon.0) 2014 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:12.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[30381]: cephadm 2021-03-10T15:24:11.793325+0000 mgr.gibba020.yqfnwy (mgr.34427) 4832 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:24:12.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[30381]: cephadm 2021-03-10T15:24:11.793467+0000 mgr.gibba020.yqfnwy (mgr.34427) 4833 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:24:12.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[30381]: audit 2021-03-10T15:24:11.794729+0000 mon.a (mon.0) 2015 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:12.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[30381]: cephadm 2021-03-10T15:24:11.795127+0000 mgr.gibba020.yqfnwy (mgr.34427) 4834 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:24:12.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[30381]: cephadm 2021-03-10T15:24:11.796987+0000 mgr.gibba020.yqfnwy (mgr.34427) 4835 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:24:12.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[30381]: cephadm 2021-03-10T15:24:11.797021+0000 mgr.gibba020.yqfnwy (mgr.34427) 4836 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:24:12.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[30381]: audit 2021-03-10T15:24:11.798281+0000 mon.a (mon.0) 2016 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:12.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[30381]: cephadm 2021-03-10T15:24:11.798469+0000 mgr.gibba020.yqfnwy (mgr.34427) 4837 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:24:12.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[30381]: cephadm 2021-03-10T15:24:11.798780+0000 mgr.gibba020.yqfnwy (mgr.34427) 4838 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:24:12.893 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[29418]: audit 2021-03-10T15:24:11.799799+0000 mon.a (mon.0) 2017 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:12.893 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[29418]: cephadm 2021-03-10T15:24:11.799880+0000 mgr.gibba020.yqfnwy (mgr.34427) 4839 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:24:12.893 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[29418]: cephadm 2021-03-10T15:24:11.799936+0000 mgr.gibba020.yqfnwy (mgr.34427) 4840 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:24:12.894 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[29418]: cephadm 2021-03-10T15:24:11.800076+0000 mgr.gibba020.yqfnwy (mgr.34427) 4841 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:24:12.894 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[30381]: audit 2021-03-10T15:24:11.799799+0000 mon.a (mon.0) 2017 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:12.894 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[30381]: cephadm 2021-03-10T15:24:11.799880+0000 mgr.gibba020.yqfnwy (mgr.34427) 4839 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:24:12.895 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[30381]: cephadm 2021-03-10T15:24:11.799936+0000 mgr.gibba020.yqfnwy (mgr.34427) 4840 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:24:12.895 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:12 gibba013 bash[30381]: cephadm 2021-03-10T15:24:11.800076+0000 mgr.gibba020.yqfnwy (mgr.34427) 4841 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:24:13.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:13 gibba020 bash[25448]: cluster 2021-03-10T15:24:12.323546+0000 mgr.gibba020.yqfnwy (mgr.34427) 4842 : cluster [DBG] pgmap v2746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:13.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:13 gibba013 bash[29418]: cluster 2021-03-10T15:24:12.323546+0000 mgr.gibba020.yqfnwy (mgr.34427) 4842 : cluster [DBG] pgmap v2746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:13.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:13 gibba013 bash[30381]: cluster 2021-03-10T15:24:12.323546+0000 mgr.gibba020.yqfnwy (mgr.34427) 4842 : cluster [DBG] pgmap v2746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:15.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:15 gibba020 bash[25448]: cluster 2021-03-10T15:24:14.324977+0000 mgr.gibba020.yqfnwy (mgr.34427) 4843 : cluster [DBG] pgmap v2747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:15.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:15 gibba013 bash[29418]: cluster 2021-03-10T15:24:14.324977+0000 mgr.gibba020.yqfnwy (mgr.34427) 4843 : cluster [DBG] pgmap v2747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:15.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:15 gibba013 bash[30381]: cluster 2021-03-10T15:24:14.324977+0000 mgr.gibba020.yqfnwy (mgr.34427) 4843 : cluster [DBG] pgmap v2747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:17.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:17 gibba020 bash[25448]: cluster 2021-03-10T15:24:16.326683+0000 mgr.gibba020.yqfnwy (mgr.34427) 4844 : cluster [DBG] pgmap v2748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:17.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:17 gibba013 bash[29418]: cluster 2021-03-10T15:24:16.326683+0000 mgr.gibba020.yqfnwy (mgr.34427) 4844 : cluster [DBG] pgmap v2748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:17.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:17 gibba013 bash[30381]: cluster 2021-03-10T15:24:16.326683+0000 mgr.gibba020.yqfnwy (mgr.34427) 4844 : cluster [DBG] pgmap v2748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:19.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:19 gibba013 bash[29418]: cluster 2021-03-10T15:24:18.328078+0000 mgr.gibba020.yqfnwy (mgr.34427) 4845 : cluster [DBG] pgmap v2749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:19.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:19 gibba013 bash[30381]: cluster 2021-03-10T15:24:18.328078+0000 mgr.gibba020.yqfnwy (mgr.34427) 4845 : cluster [DBG] pgmap v2749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:19.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:19 gibba020 bash[25448]: cluster 2021-03-10T15:24:18.328078+0000 mgr.gibba020.yqfnwy (mgr.34427) 4845 : cluster [DBG] pgmap v2749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:21.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:21 gibba013 bash[29418]: cluster 2021-03-10T15:24:20.329617+0000 mgr.gibba020.yqfnwy (mgr.34427) 4846 : cluster [DBG] pgmap v2750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:21.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:21 gibba013 bash[30381]: cluster 2021-03-10T15:24:20.329617+0000 mgr.gibba020.yqfnwy (mgr.34427) 4846 : cluster [DBG] pgmap v2750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:21.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:21 gibba020 bash[25448]: cluster 2021-03-10T15:24:20.329617+0000 mgr.gibba020.yqfnwy (mgr.34427) 4846 : cluster [DBG] pgmap v2750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:23.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:23 gibba013 bash[29418]: cluster 2021-03-10T15:24:22.348508+0000 mgr.gibba020.yqfnwy (mgr.34427) 4847 : cluster [DBG] pgmap v2751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:23.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:23 gibba013 bash[30381]: cluster 2021-03-10T15:24:22.348508+0000 mgr.gibba020.yqfnwy (mgr.34427) 4847 : cluster [DBG] pgmap v2751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:23.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:23 gibba020 bash[25448]: cluster 2021-03-10T15:24:22.348508+0000 mgr.gibba020.yqfnwy (mgr.34427) 4847 : cluster [DBG] pgmap v2751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:25.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:25 gibba020 bash[25448]: cluster 2021-03-10T15:24:24.350220+0000 mgr.gibba020.yqfnwy (mgr.34427) 4848 : cluster [DBG] pgmap v2752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:25.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:25 gibba013 bash[29418]: cluster 2021-03-10T15:24:24.350220+0000 mgr.gibba020.yqfnwy (mgr.34427) 4848 : cluster [DBG] pgmap v2752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:25.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:25 gibba013 bash[30381]: cluster 2021-03-10T15:24:24.350220+0000 mgr.gibba020.yqfnwy (mgr.34427) 4848 : cluster [DBG] pgmap v2752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:27.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:27 gibba020 bash[25448]: cluster 2021-03-10T15:24:26.352036+0000 mgr.gibba020.yqfnwy (mgr.34427) 4849 : cluster [DBG] pgmap v2753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:27.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:27 gibba020 bash[25448]: cephadm 2021-03-10T15:24:26.812868+0000 mgr.gibba020.yqfnwy (mgr.34427) 4850 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:24:27.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:27 gibba013 bash[29418]: cluster 2021-03-10T15:24:26.352036+0000 mgr.gibba020.yqfnwy (mgr.34427) 4849 : cluster [DBG] pgmap v2753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:27.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:27 gibba013 bash[29418]: cephadm 2021-03-10T15:24:26.812868+0000 mgr.gibba020.yqfnwy (mgr.34427) 4850 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:24:27.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:27 gibba013 bash[30381]: cluster 2021-03-10T15:24:26.352036+0000 mgr.gibba020.yqfnwy (mgr.34427) 4849 : cluster [DBG] pgmap v2753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:27.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:27 gibba013 bash[30381]: cephadm 2021-03-10T15:24:26.812868+0000 mgr.gibba020.yqfnwy (mgr.34427) 4850 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:24:29.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:29 gibba020 bash[25448]: cluster 2021-03-10T15:24:28.353424+0000 mgr.gibba020.yqfnwy (mgr.34427) 4851 : cluster [DBG] pgmap v2754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:29.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:29 gibba013 bash[29418]: cluster 2021-03-10T15:24:28.353424+0000 mgr.gibba020.yqfnwy (mgr.34427) 4851 : cluster [DBG] pgmap v2754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:29.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:29 gibba013 bash[30381]: cluster 2021-03-10T15:24:28.353424+0000 mgr.gibba020.yqfnwy (mgr.34427) 4851 : cluster [DBG] pgmap v2754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:30.556 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:24:30.784 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:24:30.784 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (90m) 5m ago 96m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:24:30.785 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (96m) 4m ago 96m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:24:30.785 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (91m) 4m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:24:30.785 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (91m) 4m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:24:30.785 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (90m) 5m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:24:30.786 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (90m) 5m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:24:30.786 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (90m) 4m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:24:30.786 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (90m) 5m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:24:30.786 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (96m) 5m ago 96m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:24:30.787 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (96m) 4m ago 96m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:24:30.787 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (89m) 5m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:24:30.787 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (88m) 5m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:24:30.787 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (88m) 5m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:24:30.788 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (88m) 5m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:24:30.788 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (87m) 4m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:24:30.788 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (87m) 4m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:24:30.788 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (86m) 4m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:24:30.788 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (86m) 4m ago 96m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:24:30.789 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (95m) 4m ago 96m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:24:30.789 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 4m ago 94m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:24:31.034 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:24:31.034 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:24:31.034 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:24:31.035 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:24:31.035 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:24:31.035 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:24:31.035 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:24:31.035 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:24:31.036 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:24:31.036 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:24:31.036 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:24:31.036 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:24:31.037 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:24:31.037 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:24:31.037 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:24:31.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:31 gibba020 bash[25448]: cluster 2021-03-10T15:24:30.354961+0000 mgr.gibba020.yqfnwy (mgr.34427) 4852 : cluster [DBG] pgmap v2755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:31.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:31 gibba020 bash[25448]: audit 2021-03-10T15:24:30.542657+0000 mgr.gibba020.yqfnwy (mgr.34427) 4853 : audit [DBG] from='client.57295 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:24:31.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:31 gibba020 bash[25448]: audit 2021-03-10T15:24:30.767397+0000 mgr.gibba020.yqfnwy (mgr.34427) 4854 : audit [DBG] from='client.47316 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:24:31.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:31 gibba020 bash[25448]: audit 2021-03-10T15:24:31.030317+0000 mon.a (mon.0) 2018 : audit [DBG] from='client.? 172.21.2.113:0/1574729636' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:31.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:31 gibba013 bash[29418]: cluster 2021-03-10T15:24:30.354961+0000 mgr.gibba020.yqfnwy (mgr.34427) 4852 : cluster [DBG] pgmap v2755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:31.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:31 gibba013 bash[29418]: audit 2021-03-10T15:24:30.542657+0000 mgr.gibba020.yqfnwy (mgr.34427) 4853 : audit [DBG] from='client.57295 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:24:31.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:31 gibba013 bash[29418]: audit 2021-03-10T15:24:30.767397+0000 mgr.gibba020.yqfnwy (mgr.34427) 4854 : audit [DBG] from='client.47316 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:24:31.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:31 gibba013 bash[29418]: audit 2021-03-10T15:24:31.030317+0000 mon.a (mon.0) 2018 : audit [DBG] from='client.? 172.21.2.113:0/1574729636' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:31.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:31 gibba013 bash[30381]: cluster 2021-03-10T15:24:30.354961+0000 mgr.gibba020.yqfnwy (mgr.34427) 4852 : cluster [DBG] pgmap v2755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:31.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:31 gibba013 bash[30381]: audit 2021-03-10T15:24:30.542657+0000 mgr.gibba020.yqfnwy (mgr.34427) 4853 : audit [DBG] from='client.57295 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:24:31.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:31 gibba013 bash[30381]: audit 2021-03-10T15:24:30.767397+0000 mgr.gibba020.yqfnwy (mgr.34427) 4854 : audit [DBG] from='client.47316 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:24:31.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:31 gibba013 bash[30381]: audit 2021-03-10T15:24:31.030317+0000 mon.a (mon.0) 2018 : audit [DBG] from='client.? 172.21.2.113:0/1574729636' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:24:33.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:33 gibba013 bash[29418]: cluster 2021-03-10T15:24:32.357850+0000 mgr.gibba020.yqfnwy (mgr.34427) 4855 : cluster [DBG] pgmap v2756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:33.653 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:33 gibba013 bash[30381]: cluster 2021-03-10T15:24:32.357850+0000 mgr.gibba020.yqfnwy (mgr.34427) 4855 : cluster [DBG] pgmap v2756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:33.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:33 gibba020 bash[25448]: cluster 2021-03-10T15:24:32.357850+0000 mgr.gibba020.yqfnwy (mgr.34427) 4855 : cluster [DBG] pgmap v2756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:35.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:35 gibba020 bash[25448]: cluster 2021-03-10T15:24:34.359085+0000 mgr.gibba020.yqfnwy (mgr.34427) 4856 : cluster [DBG] pgmap v2757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:35.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:35 gibba013 bash[29418]: cluster 2021-03-10T15:24:34.359085+0000 mgr.gibba020.yqfnwy (mgr.34427) 4856 : cluster [DBG] pgmap v2757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:35.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:35 gibba013 bash[30381]: cluster 2021-03-10T15:24:34.359085+0000 mgr.gibba020.yqfnwy (mgr.34427) 4856 : cluster [DBG] pgmap v2757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:37.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:37 gibba020 bash[25448]: cluster 2021-03-10T15:24:36.360670+0000 mgr.gibba020.yqfnwy (mgr.34427) 4857 : cluster [DBG] pgmap v2758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:37.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:37 gibba013 bash[29418]: cluster 2021-03-10T15:24:36.360670+0000 mgr.gibba020.yqfnwy (mgr.34427) 4857 : cluster [DBG] pgmap v2758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:37.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:37 gibba013 bash[30381]: cluster 2021-03-10T15:24:36.360670+0000 mgr.gibba020.yqfnwy (mgr.34427) 4857 : cluster [DBG] pgmap v2758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:39.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:39 gibba020 bash[25448]: cluster 2021-03-10T15:24:38.362071+0000 mgr.gibba020.yqfnwy (mgr.34427) 4858 : cluster [DBG] pgmap v2759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:39.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:39 gibba013 bash[29418]: cluster 2021-03-10T15:24:38.362071+0000 mgr.gibba020.yqfnwy (mgr.34427) 4858 : cluster [DBG] pgmap v2759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:39.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:39 gibba013 bash[30381]: cluster 2021-03-10T15:24:38.362071+0000 mgr.gibba020.yqfnwy (mgr.34427) 4858 : cluster [DBG] pgmap v2759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:41.833 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:41 gibba020 bash[25448]: cluster 2021-03-10T15:24:40.363769+0000 mgr.gibba020.yqfnwy (mgr.34427) 4859 : cluster [DBG] pgmap v2760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:41.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:41 gibba013 bash[29418]: cluster 2021-03-10T15:24:40.363769+0000 mgr.gibba020.yqfnwy (mgr.34427) 4859 : cluster [DBG] pgmap v2760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:41.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:41 gibba013 bash[30381]: cluster 2021-03-10T15:24:40.363769+0000 mgr.gibba020.yqfnwy (mgr.34427) 4859 : cluster [DBG] pgmap v2760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:42.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:42 gibba013 bash[29418]: cephadm 2021-03-10T15:24:41.828697+0000 mgr.gibba020.yqfnwy (mgr.34427) 4860 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:24:42.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:42 gibba013 bash[30381]: cephadm 2021-03-10T15:24:41.828697+0000 mgr.gibba020.yqfnwy (mgr.34427) 4860 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:24:42.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:42 gibba020 bash[25448]: cephadm 2021-03-10T15:24:41.828697+0000 mgr.gibba020.yqfnwy (mgr.34427) 4860 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:24:43.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:43 gibba013 bash[29418]: cluster 2021-03-10T15:24:42.364639+0000 mgr.gibba020.yqfnwy (mgr.34427) 4861 : cluster [DBG] pgmap v2761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:43.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:43 gibba013 bash[30381]: cluster 2021-03-10T15:24:42.364639+0000 mgr.gibba020.yqfnwy (mgr.34427) 4861 : cluster [DBG] pgmap v2761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:43.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:43 gibba020 bash[25448]: cluster 2021-03-10T15:24:42.364639+0000 mgr.gibba020.yqfnwy (mgr.34427) 4861 : cluster [DBG] pgmap v2761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:45.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:45 gibba013 bash[29418]: cluster 2021-03-10T15:24:44.365779+0000 mgr.gibba020.yqfnwy (mgr.34427) 4862 : cluster [DBG] pgmap v2762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:45.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:45 gibba013 bash[30381]: cluster 2021-03-10T15:24:44.365779+0000 mgr.gibba020.yqfnwy (mgr.34427) 4862 : cluster [DBG] pgmap v2762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:45.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:45 gibba020 bash[25448]: cluster 2021-03-10T15:24:44.365779+0000 mgr.gibba020.yqfnwy (mgr.34427) 4862 : cluster [DBG] pgmap v2762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:47.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:47 gibba013 bash[29418]: cluster 2021-03-10T15:24:46.367361+0000 mgr.gibba020.yqfnwy (mgr.34427) 4863 : cluster [DBG] pgmap v2763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:47.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:47 gibba013 bash[30381]: cluster 2021-03-10T15:24:46.367361+0000 mgr.gibba020.yqfnwy (mgr.34427) 4863 : cluster [DBG] pgmap v2763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:47.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:47 gibba020 bash[25448]: cluster 2021-03-10T15:24:46.367361+0000 mgr.gibba020.yqfnwy (mgr.34427) 4863 : cluster [DBG] pgmap v2763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:49.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:49 gibba013 bash[29418]: cluster 2021-03-10T15:24:48.368746+0000 mgr.gibba020.yqfnwy (mgr.34427) 4864 : cluster [DBG] pgmap v2764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:49.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:49 gibba013 bash[30381]: cluster 2021-03-10T15:24:48.368746+0000 mgr.gibba020.yqfnwy (mgr.34427) 4864 : cluster [DBG] pgmap v2764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:49.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:49 gibba020 bash[25448]: cluster 2021-03-10T15:24:48.368746+0000 mgr.gibba020.yqfnwy (mgr.34427) 4864 : cluster [DBG] pgmap v2764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:51.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:51 gibba013 bash[29418]: cluster 2021-03-10T15:24:50.370301+0000 mgr.gibba020.yqfnwy (mgr.34427) 4865 : cluster [DBG] pgmap v2765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:51.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:51 gibba013 bash[30381]: cluster 2021-03-10T15:24:50.370301+0000 mgr.gibba020.yqfnwy (mgr.34427) 4865 : cluster [DBG] pgmap v2765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:51.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:51 gibba020 bash[25448]: cluster 2021-03-10T15:24:50.370301+0000 mgr.gibba020.yqfnwy (mgr.34427) 4865 : cluster [DBG] pgmap v2765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:53.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:53 gibba013 bash[29418]: cluster 2021-03-10T15:24:52.371238+0000 mgr.gibba020.yqfnwy (mgr.34427) 4866 : cluster [DBG] pgmap v2766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:53.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:53 gibba013 bash[30381]: cluster 2021-03-10T15:24:52.371238+0000 mgr.gibba020.yqfnwy (mgr.34427) 4866 : cluster [DBG] pgmap v2766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:53.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:53 gibba020 bash[25448]: cluster 2021-03-10T15:24:52.371238+0000 mgr.gibba020.yqfnwy (mgr.34427) 4866 : cluster [DBG] pgmap v2766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:55.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:55 gibba020 bash[25448]: cluster 2021-03-10T15:24:54.372566+0000 mgr.gibba020.yqfnwy (mgr.34427) 4867 : cluster [DBG] pgmap v2767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:55.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:55 gibba013 bash[29418]: cluster 2021-03-10T15:24:54.372566+0000 mgr.gibba020.yqfnwy (mgr.34427) 4867 : cluster [DBG] pgmap v2767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:55.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:55 gibba013 bash[30381]: cluster 2021-03-10T15:24:54.372566+0000 mgr.gibba020.yqfnwy (mgr.34427) 4867 : cluster [DBG] pgmap v2767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:57.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:57 gibba020 bash[25448]: cluster 2021-03-10T15:24:56.374425+0000 mgr.gibba020.yqfnwy (mgr.34427) 4868 : cluster [DBG] pgmap v2768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:57.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:57 gibba020 bash[25448]: cephadm 2021-03-10T15:24:56.842006+0000 mgr.gibba020.yqfnwy (mgr.34427) 4869 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:24:57.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:57 gibba013 bash[29418]: cluster 2021-03-10T15:24:56.374425+0000 mgr.gibba020.yqfnwy (mgr.34427) 4868 : cluster [DBG] pgmap v2768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:57.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:57 gibba013 bash[29418]: cephadm 2021-03-10T15:24:56.842006+0000 mgr.gibba020.yqfnwy (mgr.34427) 4869 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:24:57.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:57 gibba013 bash[30381]: cluster 2021-03-10T15:24:56.374425+0000 mgr.gibba020.yqfnwy (mgr.34427) 4868 : cluster [DBG] pgmap v2768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:57.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:57 gibba013 bash[30381]: cephadm 2021-03-10T15:24:56.842006+0000 mgr.gibba020.yqfnwy (mgr.34427) 4869 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:24:59.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:24:59 gibba013 bash[29418]: cluster 2021-03-10T15:24:58.375771+0000 mgr.gibba020.yqfnwy (mgr.34427) 4870 : cluster [DBG] pgmap v2769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:59.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:24:59 gibba013 bash[30381]: cluster 2021-03-10T15:24:58.375771+0000 mgr.gibba020.yqfnwy (mgr.34427) 4870 : cluster [DBG] pgmap v2769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:24:59.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:24:59 gibba020 bash[25448]: cluster 2021-03-10T15:24:58.375771+0000 mgr.gibba020.yqfnwy (mgr.34427) 4870 : cluster [DBG] pgmap v2769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:01.280 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:25:01.502 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:25:01.503 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (91m) 5m ago 96m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:25:01.503 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (96m) 4m ago 96m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:25:01.503 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (91m) 4m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:25:01.503 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (92m) 4m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:25:01.504 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (91m) 5m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:25:01.504 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (91m) 5m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:25:01.504 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (90m) 4m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:25:01.504 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (90m) 5m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:25:01.505 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (97m) 5m ago 97m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:25:01.505 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (97m) 4m ago 97m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:25:01.505 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (89m) 5m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:25:01.505 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (89m) 5m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:25:01.505 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (88m) 5m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:25:01.506 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (88m) 5m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:25:01.506 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (88m) 4m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:25:01.506 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (87m) 4m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:25:01.506 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (87m) 4m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:25:01.506 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (86m) 4m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:25:01.507 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (96m) 4m ago 97m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:25:01.507 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 4m ago 95m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:25:01.757 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:25:01.757 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:25:01.758 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:25:01.758 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:25:01.758 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:25:01.759 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:25:01.759 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:25:01.759 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:25:01.759 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:25:01.759 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:25:01.760 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:25:01.760 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:25:01.760 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:25:01.760 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:25:01.761 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:25:01.799 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:01 gibba013 bash[29418]: cluster 2021-03-10T15:25:00.377523+0000 mgr.gibba020.yqfnwy (mgr.34427) 4871 : cluster [DBG] pgmap v2770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:01.800 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:01 gibba013 bash[30381]: cluster 2021-03-10T15:25:00.377523+0000 mgr.gibba020.yqfnwy (mgr.34427) 4871 : cluster [DBG] pgmap v2770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:01.849 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:01 gibba020 bash[25448]: cluster 2021-03-10T15:25:00.377523+0000 mgr.gibba020.yqfnwy (mgr.34427) 4871 : cluster [DBG] pgmap v2770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:02.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:02 gibba013 bash[29418]: audit 2021-03-10T15:25:01.266475+0000 mgr.gibba020.yqfnwy (mgr.34427) 4872 : audit [DBG] from='client.47328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:25:02.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:02 gibba013 bash[29418]: audit 2021-03-10T15:25:01.489453+0000 mgr.gibba020.yqfnwy (mgr.34427) 4873 : audit [DBG] from='client.57319 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:25:02.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:02 gibba013 bash[29418]: audit 2021-03-10T15:25:01.753618+0000 mon.a (mon.0) 2019 : audit [DBG] from='client.? 172.21.2.113:0/1130363220' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:02.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:02 gibba013 bash[30381]: audit 2021-03-10T15:25:01.266475+0000 mgr.gibba020.yqfnwy (mgr.34427) 4872 : audit [DBG] from='client.47328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:25:02.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:02 gibba013 bash[30381]: audit 2021-03-10T15:25:01.489453+0000 mgr.gibba020.yqfnwy (mgr.34427) 4873 : audit [DBG] from='client.57319 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:25:02.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:02 gibba013 bash[30381]: audit 2021-03-10T15:25:01.753618+0000 mon.a (mon.0) 2019 : audit [DBG] from='client.? 172.21.2.113:0/1130363220' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:02.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:02 gibba020 bash[25448]: audit 2021-03-10T15:25:01.266475+0000 mgr.gibba020.yqfnwy (mgr.34427) 4872 : audit [DBG] from='client.47328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:25:02.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:02 gibba020 bash[25448]: audit 2021-03-10T15:25:01.489453+0000 mgr.gibba020.yqfnwy (mgr.34427) 4873 : audit [DBG] from='client.57319 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:25:02.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:02 gibba020 bash[25448]: audit 2021-03-10T15:25:01.753618+0000 mon.a (mon.0) 2019 : audit [DBG] from='client.? 172.21.2.113:0/1130363220' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:03.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:03 gibba013 bash[29418]: cluster 2021-03-10T15:25:02.378883+0000 mgr.gibba020.yqfnwy (mgr.34427) 4874 : cluster [DBG] pgmap v2771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:03.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:03 gibba013 bash[30381]: cluster 2021-03-10T15:25:02.378883+0000 mgr.gibba020.yqfnwy (mgr.34427) 4874 : cluster [DBG] pgmap v2771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:03.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:03 gibba020 bash[25448]: cluster 2021-03-10T15:25:02.378883+0000 mgr.gibba020.yqfnwy (mgr.34427) 4874 : cluster [DBG] pgmap v2771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:05.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:05 gibba013 bash[29418]: cluster 2021-03-10T15:25:04.380299+0000 mgr.gibba020.yqfnwy (mgr.34427) 4875 : cluster [DBG] pgmap v2772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:05.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:05 gibba013 bash[30381]: cluster 2021-03-10T15:25:04.380299+0000 mgr.gibba020.yqfnwy (mgr.34427) 4875 : cluster [DBG] pgmap v2772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:05.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:05 gibba020 bash[25448]: cluster 2021-03-10T15:25:04.380299+0000 mgr.gibba020.yqfnwy (mgr.34427) 4875 : cluster [DBG] pgmap v2772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:06 gibba013 bash[29418]: audit 2021-03-10T15:25:06.433698+0000 mon.a (mon.0) 2020 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:25:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:06 gibba013 bash[30381]: audit 2021-03-10T15:25:06.433698+0000 mon.a (mon.0) 2020 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:25:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:06 gibba020 bash[25448]: audit 2021-03-10T15:25:06.433698+0000 mon.a (mon.0) 2020 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:25:07.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:07 gibba013 bash[29418]: cluster 2021-03-10T15:25:06.381898+0000 mgr.gibba020.yqfnwy (mgr.34427) 4876 : cluster [DBG] pgmap v2773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:07.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:07 gibba013 bash[29418]: audit 2021-03-10T15:25:06.496649+0000 mon.a (mon.0) 2021 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:25:07.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:07 gibba013 bash[29418]: audit 2021-03-10T15:25:06.605481+0000 mon.a (mon.0) 2022 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:25:07.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:07 gibba013 bash[29418]: audit 2021-03-10T15:25:06.606266+0000 mon.a (mon.0) 2023 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:25:07.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:07 gibba013 bash[29418]: audit 2021-03-10T15:25:06.606943+0000 mon.a (mon.0) 2024 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:25:07.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:07 gibba013 bash[29418]: audit 2021-03-10T15:25:06.607599+0000 mon.a (mon.0) 2025 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:25:07.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:07 gibba013 bash[30381]: cluster 2021-03-10T15:25:06.381898+0000 mgr.gibba020.yqfnwy (mgr.34427) 4876 : cluster [DBG] pgmap v2773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:07.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:07 gibba013 bash[30381]: audit 2021-03-10T15:25:06.496649+0000 mon.a (mon.0) 2021 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:25:07.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:07 gibba013 bash[30381]: audit 2021-03-10T15:25:06.605481+0000 mon.a (mon.0) 2022 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:25:07.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:07 gibba013 bash[30381]: audit 2021-03-10T15:25:06.606266+0000 mon.a (mon.0) 2023 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:25:07.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:07 gibba013 bash[30381]: audit 2021-03-10T15:25:06.606943+0000 mon.a (mon.0) 2024 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:25:07.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:07 gibba013 bash[30381]: audit 2021-03-10T15:25:06.607599+0000 mon.a (mon.0) 2025 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:25:07.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:07 gibba020 bash[25448]: cluster 2021-03-10T15:25:06.381898+0000 mgr.gibba020.yqfnwy (mgr.34427) 4876 : cluster [DBG] pgmap v2773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:07.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:07 gibba020 bash[25448]: audit 2021-03-10T15:25:06.496649+0000 mon.a (mon.0) 2021 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:25:07.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:07 gibba020 bash[25448]: audit 2021-03-10T15:25:06.605481+0000 mon.a (mon.0) 2022 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:25:07.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:07 gibba020 bash[25448]: audit 2021-03-10T15:25:06.606266+0000 mon.a (mon.0) 2023 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:25:07.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:07 gibba020 bash[25448]: audit 2021-03-10T15:25:06.606943+0000 mon.a (mon.0) 2024 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:25:07.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:07 gibba020 bash[25448]: audit 2021-03-10T15:25:06.607599+0000 mon.a (mon.0) 2025 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:25:09.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:09 gibba013 bash[29418]: cluster 2021-03-10T15:25:08.383291+0000 mgr.gibba020.yqfnwy (mgr.34427) 4877 : cluster [DBG] pgmap v2774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:09.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:09 gibba013 bash[30381]: cluster 2021-03-10T15:25:08.383291+0000 mgr.gibba020.yqfnwy (mgr.34427) 4877 : cluster [DBG] pgmap v2774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:09.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:09 gibba020 bash[25448]: cluster 2021-03-10T15:25:08.383291+0000 mgr.gibba020.yqfnwy (mgr.34427) 4877 : cluster [DBG] pgmap v2774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:11.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:11 gibba013 bash[29418]: cluster 2021-03-10T15:25:10.385058+0000 mgr.gibba020.yqfnwy (mgr.34427) 4878 : cluster [DBG] pgmap v2775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:11.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:11 gibba013 bash[30381]: cluster 2021-03-10T15:25:10.385058+0000 mgr.gibba020.yqfnwy (mgr.34427) 4878 : cluster [DBG] pgmap v2775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:11.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:11 gibba020 bash[25448]: cluster 2021-03-10T15:25:10.385058+0000 mgr.gibba020.yqfnwy (mgr.34427) 4878 : cluster [DBG] pgmap v2775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:12.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[29418]: audit 2021-03-10T15:25:11.859440+0000 mon.a (mon.0) 2026 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:25:12.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[29418]: cephadm 2021-03-10T15:25:11.864272+0000 mgr.gibba020.yqfnwy (mgr.34427) 4879 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:25:12.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[29418]: cephadm 2021-03-10T15:25:11.866050+0000 mgr.gibba020.yqfnwy (mgr.34427) 4880 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:25:12.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[29418]: audit 2021-03-10T15:25:12.083479+0000 mon.a (mon.0) 2027 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:25:12.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[29418]: cephadm 2021-03-10T15:25:12.085446+0000 mgr.gibba020.yqfnwy (mgr.34427) 4881 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:25:12.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[29418]: audit 2021-03-10T15:25:12.086884+0000 mon.a (mon.0) 2028 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:25:12.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[29418]: cephadm 2021-03-10T15:25:12.087129+0000 mgr.gibba020.yqfnwy (mgr.34427) 4882 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:25:12.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[29418]: audit 2021-03-10T15:25:12.088157+0000 mon.a (mon.0) 2029 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:12.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[29418]: cephadm 2021-03-10T15:25:12.088424+0000 mgr.gibba020.yqfnwy (mgr.34427) 4883 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:25:12.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[29418]: cephadm 2021-03-10T15:25:12.088461+0000 mgr.gibba020.yqfnwy (mgr.34427) 4884 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:25:12.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[29418]: audit 2021-03-10T15:25:12.089781+0000 mon.a (mon.0) 2030 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:12.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[29418]: cephadm 2021-03-10T15:25:12.089817+0000 mgr.gibba020.yqfnwy (mgr.34427) 4885 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:25:12.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[29418]: cephadm 2021-03-10T15:25:12.089902+0000 mgr.gibba020.yqfnwy (mgr.34427) 4886 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:25:12.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[29418]: audit 2021-03-10T15:25:12.090834+0000 mon.a (mon.0) 2031 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:12.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[29418]: cephadm 2021-03-10T15:25:12.090845+0000 mgr.gibba020.yqfnwy (mgr.34427) 4887 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:25:12.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[29418]: cephadm 2021-03-10T15:25:12.091667+0000 mgr.gibba020.yqfnwy (mgr.34427) 4888 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:25:12.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[29418]: cephadm 2021-03-10T15:25:12.091704+0000 mgr.gibba020.yqfnwy (mgr.34427) 4889 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:25:12.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[29418]: cephadm 2021-03-10T15:25:12.092719+0000 mgr.gibba020.yqfnwy (mgr.34427) 4890 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:25:12.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[29418]: audit 2021-03-10T15:25:12.092746+0000 mon.a (mon.0) 2032 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:12.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[29418]: cephadm 2021-03-10T15:25:12.093147+0000 mgr.gibba020.yqfnwy (mgr.34427) 4891 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:25:12.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[30381]: audit 2021-03-10T15:25:11.859440+0000 mon.a (mon.0) 2026 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:25:12.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[30381]: cephadm 2021-03-10T15:25:11.864272+0000 mgr.gibba020.yqfnwy (mgr.34427) 4879 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:25:12.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[30381]: cephadm 2021-03-10T15:25:11.866050+0000 mgr.gibba020.yqfnwy (mgr.34427) 4880 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:25:12.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[30381]: audit 2021-03-10T15:25:12.083479+0000 mon.a (mon.0) 2027 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:25:12.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[30381]: cephadm 2021-03-10T15:25:12.085446+0000 mgr.gibba020.yqfnwy (mgr.34427) 4881 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:25:12.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[30381]: audit 2021-03-10T15:25:12.086884+0000 mon.a (mon.0) 2028 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:25:12.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[30381]: cephadm 2021-03-10T15:25:12.087129+0000 mgr.gibba020.yqfnwy (mgr.34427) 4882 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:25:12.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[30381]: audit 2021-03-10T15:25:12.088157+0000 mon.a (mon.0) 2029 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:12.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[30381]: cephadm 2021-03-10T15:25:12.088424+0000 mgr.gibba020.yqfnwy (mgr.34427) 4883 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:25:12.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[30381]: cephadm 2021-03-10T15:25:12.088461+0000 mgr.gibba020.yqfnwy (mgr.34427) 4884 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:25:12.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[30381]: audit 2021-03-10T15:25:12.089781+0000 mon.a (mon.0) 2030 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:12.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[30381]: cephadm 2021-03-10T15:25:12.089817+0000 mgr.gibba020.yqfnwy (mgr.34427) 4885 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:25:12.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[30381]: cephadm 2021-03-10T15:25:12.089902+0000 mgr.gibba020.yqfnwy (mgr.34427) 4886 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:25:12.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[30381]: audit 2021-03-10T15:25:12.090834+0000 mon.a (mon.0) 2031 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:12.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[30381]: cephadm 2021-03-10T15:25:12.090845+0000 mgr.gibba020.yqfnwy (mgr.34427) 4887 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:25:12.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[30381]: cephadm 2021-03-10T15:25:12.091667+0000 mgr.gibba020.yqfnwy (mgr.34427) 4888 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:25:12.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[30381]: cephadm 2021-03-10T15:25:12.091704+0000 mgr.gibba020.yqfnwy (mgr.34427) 4889 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:25:12.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[30381]: cephadm 2021-03-10T15:25:12.092719+0000 mgr.gibba020.yqfnwy (mgr.34427) 4890 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:25:12.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[30381]: audit 2021-03-10T15:25:12.092746+0000 mon.a (mon.0) 2032 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:12.893 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[30381]: cephadm 2021-03-10T15:25:12.093147+0000 mgr.gibba020.yqfnwy (mgr.34427) 4891 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:25:12.893 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[29418]: audit 2021-03-10T15:25:12.094111+0000 mon.a (mon.0) 2033 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:12.893 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[29418]: cephadm 2021-03-10T15:25:12.094137+0000 mgr.gibba020.yqfnwy (mgr.34427) 4892 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:25:12.894 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[29418]: cephadm 2021-03-10T15:25:12.094222+0000 mgr.gibba020.yqfnwy (mgr.34427) 4893 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:25:12.894 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[29418]: cephadm 2021-03-10T15:25:12.094327+0000 mgr.gibba020.yqfnwy (mgr.34427) 4894 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:25:12.894 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[30381]: audit 2021-03-10T15:25:12.094111+0000 mon.a (mon.0) 2033 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:12.895 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[30381]: cephadm 2021-03-10T15:25:12.094137+0000 mgr.gibba020.yqfnwy (mgr.34427) 4892 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:25:12.895 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[30381]: cephadm 2021-03-10T15:25:12.094222+0000 mgr.gibba020.yqfnwy (mgr.34427) 4893 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:25:12.895 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:12 gibba013 bash[30381]: cephadm 2021-03-10T15:25:12.094327+0000 mgr.gibba020.yqfnwy (mgr.34427) 4894 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:25:12.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:12 gibba020 bash[25448]: audit 2021-03-10T15:25:11.859440+0000 mon.a (mon.0) 2026 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:25:12.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:12 gibba020 bash[25448]: cephadm 2021-03-10T15:25:11.864272+0000 mgr.gibba020.yqfnwy (mgr.34427) 4879 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:25:12.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:12 gibba020 bash[25448]: cephadm 2021-03-10T15:25:11.866050+0000 mgr.gibba020.yqfnwy (mgr.34427) 4880 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:25:12.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:12 gibba020 bash[25448]: audit 2021-03-10T15:25:12.083479+0000 mon.a (mon.0) 2027 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:25:12.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:12 gibba020 bash[25448]: cephadm 2021-03-10T15:25:12.085446+0000 mgr.gibba020.yqfnwy (mgr.34427) 4881 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:25:12.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:12 gibba020 bash[25448]: audit 2021-03-10T15:25:12.086884+0000 mon.a (mon.0) 2028 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:25:12.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:12 gibba020 bash[25448]: cephadm 2021-03-10T15:25:12.087129+0000 mgr.gibba020.yqfnwy (mgr.34427) 4882 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:25:12.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:12 gibba020 bash[25448]: audit 2021-03-10T15:25:12.088157+0000 mon.a (mon.0) 2029 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:12.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:12 gibba020 bash[25448]: cephadm 2021-03-10T15:25:12.088424+0000 mgr.gibba020.yqfnwy (mgr.34427) 4883 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:25:12.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:12 gibba020 bash[25448]: cephadm 2021-03-10T15:25:12.088461+0000 mgr.gibba020.yqfnwy (mgr.34427) 4884 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:25:12.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:12 gibba020 bash[25448]: audit 2021-03-10T15:25:12.089781+0000 mon.a (mon.0) 2030 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:12.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:12 gibba020 bash[25448]: cephadm 2021-03-10T15:25:12.089817+0000 mgr.gibba020.yqfnwy (mgr.34427) 4885 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:25:12.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:12 gibba020 bash[25448]: cephadm 2021-03-10T15:25:12.089902+0000 mgr.gibba020.yqfnwy (mgr.34427) 4886 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:25:12.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:12 gibba020 bash[25448]: audit 2021-03-10T15:25:12.090834+0000 mon.a (mon.0) 2031 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:12.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:12 gibba020 bash[25448]: cephadm 2021-03-10T15:25:12.090845+0000 mgr.gibba020.yqfnwy (mgr.34427) 4887 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:25:12.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:12 gibba020 bash[25448]: cephadm 2021-03-10T15:25:12.091667+0000 mgr.gibba020.yqfnwy (mgr.34427) 4888 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:25:12.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:12 gibba020 bash[25448]: cephadm 2021-03-10T15:25:12.091704+0000 mgr.gibba020.yqfnwy (mgr.34427) 4889 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:25:12.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:12 gibba020 bash[25448]: cephadm 2021-03-10T15:25:12.092719+0000 mgr.gibba020.yqfnwy (mgr.34427) 4890 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:25:12.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:12 gibba020 bash[25448]: audit 2021-03-10T15:25:12.092746+0000 mon.a (mon.0) 2032 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:12.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:12 gibba020 bash[25448]: cephadm 2021-03-10T15:25:12.093147+0000 mgr.gibba020.yqfnwy (mgr.34427) 4891 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:25:12.957 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:12 gibba020 bash[25448]: audit 2021-03-10T15:25:12.094111+0000 mon.a (mon.0) 2033 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:12.957 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:12 gibba020 bash[25448]: cephadm 2021-03-10T15:25:12.094137+0000 mgr.gibba020.yqfnwy (mgr.34427) 4892 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:25:12.957 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:12 gibba020 bash[25448]: cephadm 2021-03-10T15:25:12.094222+0000 mgr.gibba020.yqfnwy (mgr.34427) 4893 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:25:12.957 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:12 gibba020 bash[25448]: cephadm 2021-03-10T15:25:12.094327+0000 mgr.gibba020.yqfnwy (mgr.34427) 4894 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:25:13.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:13 gibba013 bash[29418]: cluster 2021-03-10T15:25:12.386624+0000 mgr.gibba020.yqfnwy (mgr.34427) 4895 : cluster [DBG] pgmap v2776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:13.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:13 gibba013 bash[30381]: cluster 2021-03-10T15:25:12.386624+0000 mgr.gibba020.yqfnwy (mgr.34427) 4895 : cluster [DBG] pgmap v2776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:13.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:13 gibba020 bash[25448]: cluster 2021-03-10T15:25:12.386624+0000 mgr.gibba020.yqfnwy (mgr.34427) 4895 : cluster [DBG] pgmap v2776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:15.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:15 gibba013 bash[29418]: cluster 2021-03-10T15:25:14.388126+0000 mgr.gibba020.yqfnwy (mgr.34427) 4896 : cluster [DBG] pgmap v2777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:15.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:15 gibba013 bash[30381]: cluster 2021-03-10T15:25:14.388126+0000 mgr.gibba020.yqfnwy (mgr.34427) 4896 : cluster [DBG] pgmap v2777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:15.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:15 gibba020 bash[25448]: cluster 2021-03-10T15:25:14.388126+0000 mgr.gibba020.yqfnwy (mgr.34427) 4896 : cluster [DBG] pgmap v2777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:17.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:17 gibba013 bash[29418]: cluster 2021-03-10T15:25:16.389972+0000 mgr.gibba020.yqfnwy (mgr.34427) 4897 : cluster [DBG] pgmap v2778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:17.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:17 gibba013 bash[30381]: cluster 2021-03-10T15:25:16.389972+0000 mgr.gibba020.yqfnwy (mgr.34427) 4897 : cluster [DBG] pgmap v2778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:17.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:17 gibba020 bash[25448]: cluster 2021-03-10T15:25:16.389972+0000 mgr.gibba020.yqfnwy (mgr.34427) 4897 : cluster [DBG] pgmap v2778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:19.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:19 gibba013 bash[29418]: cluster 2021-03-10T15:25:18.391431+0000 mgr.gibba020.yqfnwy (mgr.34427) 4898 : cluster [DBG] pgmap v2779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:19.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:19 gibba013 bash[30381]: cluster 2021-03-10T15:25:18.391431+0000 mgr.gibba020.yqfnwy (mgr.34427) 4898 : cluster [DBG] pgmap v2779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:19.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:19 gibba020 bash[25448]: cluster 2021-03-10T15:25:18.391431+0000 mgr.gibba020.yqfnwy (mgr.34427) 4898 : cluster [DBG] pgmap v2779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:21.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:21 gibba013 bash[29418]: cluster 2021-03-10T15:25:20.393069+0000 mgr.gibba020.yqfnwy (mgr.34427) 4899 : cluster [DBG] pgmap v2780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:21.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:21 gibba013 bash[30381]: cluster 2021-03-10T15:25:20.393069+0000 mgr.gibba020.yqfnwy (mgr.34427) 4899 : cluster [DBG] pgmap v2780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:21.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:21 gibba020 bash[25448]: cluster 2021-03-10T15:25:20.393069+0000 mgr.gibba020.yqfnwy (mgr.34427) 4899 : cluster [DBG] pgmap v2780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:23.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:23 gibba013 bash[29418]: cluster 2021-03-10T15:25:22.393838+0000 mgr.gibba020.yqfnwy (mgr.34427) 4900 : cluster [DBG] pgmap v2781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:23.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:23 gibba013 bash[30381]: cluster 2021-03-10T15:25:22.393838+0000 mgr.gibba020.yqfnwy (mgr.34427) 4900 : cluster [DBG] pgmap v2781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:23.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:23 gibba020 bash[25448]: cluster 2021-03-10T15:25:22.393838+0000 mgr.gibba020.yqfnwy (mgr.34427) 4900 : cluster [DBG] pgmap v2781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:25.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:25 gibba013 bash[29418]: cluster 2021-03-10T15:25:24.395109+0000 mgr.gibba020.yqfnwy (mgr.34427) 4901 : cluster [DBG] pgmap v2782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:25.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:25 gibba013 bash[30381]: cluster 2021-03-10T15:25:24.395109+0000 mgr.gibba020.yqfnwy (mgr.34427) 4901 : cluster [DBG] pgmap v2782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:25.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:25 gibba020 bash[25448]: cluster 2021-03-10T15:25:24.395109+0000 mgr.gibba020.yqfnwy (mgr.34427) 4901 : cluster [DBG] pgmap v2782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:27.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:27 gibba013 bash[29418]: cluster 2021-03-10T15:25:26.397026+0000 mgr.gibba020.yqfnwy (mgr.34427) 4902 : cluster [DBG] pgmap v2783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:27.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:27 gibba013 bash[29418]: cephadm 2021-03-10T15:25:27.110398+0000 mgr.gibba020.yqfnwy (mgr.34427) 4903 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:25:27.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:27 gibba013 bash[30381]: cluster 2021-03-10T15:25:26.397026+0000 mgr.gibba020.yqfnwy (mgr.34427) 4902 : cluster [DBG] pgmap v2783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:27.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:27 gibba013 bash[30381]: cephadm 2021-03-10T15:25:27.110398+0000 mgr.gibba020.yqfnwy (mgr.34427) 4903 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:25:27.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:27 gibba020 bash[25448]: cluster 2021-03-10T15:25:26.397026+0000 mgr.gibba020.yqfnwy (mgr.34427) 4902 : cluster [DBG] pgmap v2783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:27.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:27 gibba020 bash[25448]: cephadm 2021-03-10T15:25:27.110398+0000 mgr.gibba020.yqfnwy (mgr.34427) 4903 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:25:29.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:29 gibba013 bash[29418]: cluster 2021-03-10T15:25:28.398586+0000 mgr.gibba020.yqfnwy (mgr.34427) 4904 : cluster [DBG] pgmap v2784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:29.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:29 gibba013 bash[30381]: cluster 2021-03-10T15:25:28.398586+0000 mgr.gibba020.yqfnwy (mgr.34427) 4904 : cluster [DBG] pgmap v2784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:29.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:29 gibba020 bash[25448]: cluster 2021-03-10T15:25:28.398586+0000 mgr.gibba020.yqfnwy (mgr.34427) 4904 : cluster [DBG] pgmap v2784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:31.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:31 gibba013 bash[29418]: cluster 2021-03-10T15:25:30.400265+0000 mgr.gibba020.yqfnwy (mgr.34427) 4905 : cluster [DBG] pgmap v2785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:31.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:31 gibba013 bash[30381]: cluster 2021-03-10T15:25:30.400265+0000 mgr.gibba020.yqfnwy (mgr.34427) 4905 : cluster [DBG] pgmap v2785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:31.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:31 gibba020 bash[25448]: cluster 2021-03-10T15:25:30.400265+0000 mgr.gibba020.yqfnwy (mgr.34427) 4905 : cluster [DBG] pgmap v2785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:32.006 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:25:32.234 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:25:32.235 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (92m) 6m ago 97m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:25:32.235 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (97m) 5m ago 97m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:25:32.235 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (92m) 5m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:25:32.235 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (92m) 5m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:25:32.236 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (91m) 6m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:25:32.236 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (91m) 6m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:25:32.236 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (91m) 5m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:25:32.236 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (91m) 6m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:25:32.236 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (97m) 6m ago 97m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:25:32.237 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (97m) 5m ago 97m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:25:32.237 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (90m) 6m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:25:32.237 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (89m) 6m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:25:32.237 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (89m) 6m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:25:32.238 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (89m) 6m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:25:32.238 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (88m) 5m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:25:32.238 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (88m) 5m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:25:32.238 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (87m) 5m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:25:32.239 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (87m) 5m ago 97m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:25:32.239 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (96m) 5m ago 97m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:25:32.239 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 5m ago 95m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:25:32.489 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:25:32.490 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:25:32.490 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:25:32.490 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:25:32.491 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:25:32.491 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:25:32.491 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:25:32.491 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:25:32.491 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:25:32.492 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:25:32.492 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:25:32.492 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:25:32.492 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:25:32.493 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:25:32.493 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:25:32.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:32 gibba013 bash[29418]: audit 2021-03-10T15:25:31.993303+0000 mgr.gibba020.yqfnwy (mgr.34427) 4906 : audit [DBG] from='client.57331 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:25:32.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:32 gibba013 bash[30381]: audit 2021-03-10T15:25:31.993303+0000 mgr.gibba020.yqfnwy (mgr.34427) 4906 : audit [DBG] from='client.57331 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:25:32.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:32 gibba020 bash[25448]: audit 2021-03-10T15:25:31.993303+0000 mgr.gibba020.yqfnwy (mgr.34427) 4906 : audit [DBG] from='client.57331 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:25:33.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:33 gibba013 bash[29418]: audit 2021-03-10T15:25:32.218637+0000 mgr.gibba020.yqfnwy (mgr.34427) 4907 : audit [DBG] from='client.47352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:25:33.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:33 gibba013 bash[29418]: cluster 2021-03-10T15:25:32.401219+0000 mgr.gibba020.yqfnwy (mgr.34427) 4908 : cluster [DBG] pgmap v2786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:33.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:33 gibba013 bash[29418]: audit 2021-03-10T15:25:32.485950+0000 mon.a (mon.0) 2034 : audit [DBG] from='client.? 172.21.2.113:0/1035501907' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:33.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:33 gibba013 bash[30381]: audit 2021-03-10T15:25:32.218637+0000 mgr.gibba020.yqfnwy (mgr.34427) 4907 : audit [DBG] from='client.47352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:25:33.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:33 gibba013 bash[30381]: cluster 2021-03-10T15:25:32.401219+0000 mgr.gibba020.yqfnwy (mgr.34427) 4908 : cluster [DBG] pgmap v2786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:33.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:33 gibba013 bash[30381]: audit 2021-03-10T15:25:32.485950+0000 mon.a (mon.0) 2034 : audit [DBG] from='client.? 172.21.2.113:0/1035501907' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:33.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:33 gibba020 bash[25448]: audit 2021-03-10T15:25:32.218637+0000 mgr.gibba020.yqfnwy (mgr.34427) 4907 : audit [DBG] from='client.47352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:25:33.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:33 gibba020 bash[25448]: cluster 2021-03-10T15:25:32.401219+0000 mgr.gibba020.yqfnwy (mgr.34427) 4908 : cluster [DBG] pgmap v2786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:33.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:33 gibba020 bash[25448]: audit 2021-03-10T15:25:32.485950+0000 mon.a (mon.0) 2034 : audit [DBG] from='client.? 172.21.2.113:0/1035501907' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:25:35.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:35 gibba013 bash[29418]: cluster 2021-03-10T15:25:34.402430+0000 mgr.gibba020.yqfnwy (mgr.34427) 4909 : cluster [DBG] pgmap v2787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:35.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:35 gibba013 bash[30381]: cluster 2021-03-10T15:25:34.402430+0000 mgr.gibba020.yqfnwy (mgr.34427) 4909 : cluster [DBG] pgmap v2787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:35.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:35 gibba020 bash[25448]: cluster 2021-03-10T15:25:34.402430+0000 mgr.gibba020.yqfnwy (mgr.34427) 4909 : cluster [DBG] pgmap v2787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:37.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:37 gibba013 bash[29418]: cluster 2021-03-10T15:25:36.404063+0000 mgr.gibba020.yqfnwy (mgr.34427) 4910 : cluster [DBG] pgmap v2788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:37.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:37 gibba013 bash[30381]: cluster 2021-03-10T15:25:36.404063+0000 mgr.gibba020.yqfnwy (mgr.34427) 4910 : cluster [DBG] pgmap v2788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:37.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:37 gibba020 bash[25448]: cluster 2021-03-10T15:25:36.404063+0000 mgr.gibba020.yqfnwy (mgr.34427) 4910 : cluster [DBG] pgmap v2788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:39.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:39 gibba013 bash[29418]: cluster 2021-03-10T15:25:38.405507+0000 mgr.gibba020.yqfnwy (mgr.34427) 4911 : cluster [DBG] pgmap v2789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:39.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:39 gibba013 bash[30381]: cluster 2021-03-10T15:25:38.405507+0000 mgr.gibba020.yqfnwy (mgr.34427) 4911 : cluster [DBG] pgmap v2789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:39.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:39 gibba020 bash[25448]: cluster 2021-03-10T15:25:38.405507+0000 mgr.gibba020.yqfnwy (mgr.34427) 4911 : cluster [DBG] pgmap v2789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:41.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:41 gibba013 bash[29418]: cluster 2021-03-10T15:25:40.407096+0000 mgr.gibba020.yqfnwy (mgr.34427) 4912 : cluster [DBG] pgmap v2790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:41.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:41 gibba013 bash[30381]: cluster 2021-03-10T15:25:40.407096+0000 mgr.gibba020.yqfnwy (mgr.34427) 4912 : cluster [DBG] pgmap v2790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:41.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:41 gibba020 bash[25448]: cluster 2021-03-10T15:25:40.407096+0000 mgr.gibba020.yqfnwy (mgr.34427) 4912 : cluster [DBG] pgmap v2790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:42.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:42 gibba013 bash[29418]: cephadm 2021-03-10T15:25:42.126041+0000 mgr.gibba020.yqfnwy (mgr.34427) 4913 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:25:42.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:42 gibba013 bash[30381]: cephadm 2021-03-10T15:25:42.126041+0000 mgr.gibba020.yqfnwy (mgr.34427) 4913 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:25:42.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:42 gibba020 bash[25448]: cephadm 2021-03-10T15:25:42.126041+0000 mgr.gibba020.yqfnwy (mgr.34427) 4913 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:25:43.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:43 gibba013 bash[29418]: cluster 2021-03-10T15:25:42.408687+0000 mgr.gibba020.yqfnwy (mgr.34427) 4914 : cluster [DBG] pgmap v2791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:43.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:43 gibba013 bash[30381]: cluster 2021-03-10T15:25:42.408687+0000 mgr.gibba020.yqfnwy (mgr.34427) 4914 : cluster [DBG] pgmap v2791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:43.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:43 gibba020 bash[25448]: cluster 2021-03-10T15:25:42.408687+0000 mgr.gibba020.yqfnwy (mgr.34427) 4914 : cluster [DBG] pgmap v2791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:45.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:45 gibba013 bash[29418]: cluster 2021-03-10T15:25:44.410044+0000 mgr.gibba020.yqfnwy (mgr.34427) 4915 : cluster [DBG] pgmap v2792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:45.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:45 gibba013 bash[30381]: cluster 2021-03-10T15:25:44.410044+0000 mgr.gibba020.yqfnwy (mgr.34427) 4915 : cluster [DBG] pgmap v2792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:45.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:45 gibba020 bash[25448]: cluster 2021-03-10T15:25:44.410044+0000 mgr.gibba020.yqfnwy (mgr.34427) 4915 : cluster [DBG] pgmap v2792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:47.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:47 gibba013 bash[29418]: cluster 2021-03-10T15:25:46.411749+0000 mgr.gibba020.yqfnwy (mgr.34427) 4916 : cluster [DBG] pgmap v2793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:47.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:47 gibba013 bash[30381]: cluster 2021-03-10T15:25:46.411749+0000 mgr.gibba020.yqfnwy (mgr.34427) 4916 : cluster [DBG] pgmap v2793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:47.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:47 gibba020 bash[25448]: cluster 2021-03-10T15:25:46.411749+0000 mgr.gibba020.yqfnwy (mgr.34427) 4916 : cluster [DBG] pgmap v2793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:49.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:49 gibba013 bash[29418]: cluster 2021-03-10T15:25:48.413123+0000 mgr.gibba020.yqfnwy (mgr.34427) 4917 : cluster [DBG] pgmap v2794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:49.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:49 gibba013 bash[30381]: cluster 2021-03-10T15:25:48.413123+0000 mgr.gibba020.yqfnwy (mgr.34427) 4917 : cluster [DBG] pgmap v2794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:49.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:49 gibba020 bash[25448]: cluster 2021-03-10T15:25:48.413123+0000 mgr.gibba020.yqfnwy (mgr.34427) 4917 : cluster [DBG] pgmap v2794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:51.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:51 gibba013 bash[29418]: cluster 2021-03-10T15:25:50.414675+0000 mgr.gibba020.yqfnwy (mgr.34427) 4918 : cluster [DBG] pgmap v2795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:51.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:51 gibba013 bash[30381]: cluster 2021-03-10T15:25:50.414675+0000 mgr.gibba020.yqfnwy (mgr.34427) 4918 : cluster [DBG] pgmap v2795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:51.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:51 gibba020 bash[25448]: cluster 2021-03-10T15:25:50.414675+0000 mgr.gibba020.yqfnwy (mgr.34427) 4918 : cluster [DBG] pgmap v2795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:53.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:53 gibba013 bash[29418]: cluster 2021-03-10T15:25:52.415277+0000 mgr.gibba020.yqfnwy (mgr.34427) 4919 : cluster [DBG] pgmap v2796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:53.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:53 gibba013 bash[30381]: cluster 2021-03-10T15:25:52.415277+0000 mgr.gibba020.yqfnwy (mgr.34427) 4919 : cluster [DBG] pgmap v2796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:53.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:53 gibba020 bash[25448]: cluster 2021-03-10T15:25:52.415277+0000 mgr.gibba020.yqfnwy (mgr.34427) 4919 : cluster [DBG] pgmap v2796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:55.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:55 gibba013 bash[29418]: cluster 2021-03-10T15:25:54.416558+0000 mgr.gibba020.yqfnwy (mgr.34427) 4920 : cluster [DBG] pgmap v2797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:55.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:55 gibba013 bash[30381]: cluster 2021-03-10T15:25:54.416558+0000 mgr.gibba020.yqfnwy (mgr.34427) 4920 : cluster [DBG] pgmap v2797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:55.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:55 gibba020 bash[25448]: cluster 2021-03-10T15:25:54.416558+0000 mgr.gibba020.yqfnwy (mgr.34427) 4920 : cluster [DBG] pgmap v2797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:57.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:57 gibba013 bash[29418]: cluster 2021-03-10T15:25:56.418416+0000 mgr.gibba020.yqfnwy (mgr.34427) 4921 : cluster [DBG] pgmap v2798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:57.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:57 gibba013 bash[29418]: cephadm 2021-03-10T15:25:57.142034+0000 mgr.gibba020.yqfnwy (mgr.34427) 4922 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:25:57.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:57 gibba013 bash[30381]: cluster 2021-03-10T15:25:56.418416+0000 mgr.gibba020.yqfnwy (mgr.34427) 4921 : cluster [DBG] pgmap v2798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:57.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:57 gibba013 bash[30381]: cephadm 2021-03-10T15:25:57.142034+0000 mgr.gibba020.yqfnwy (mgr.34427) 4922 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:25:57.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:57 gibba020 bash[25448]: cluster 2021-03-10T15:25:56.418416+0000 mgr.gibba020.yqfnwy (mgr.34427) 4921 : cluster [DBG] pgmap v2798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:57.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:57 gibba020 bash[25448]: cephadm 2021-03-10T15:25:57.142034+0000 mgr.gibba020.yqfnwy (mgr.34427) 4922 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:25:59.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:25:59 gibba013 bash[29418]: cluster 2021-03-10T15:25:58.419784+0000 mgr.gibba020.yqfnwy (mgr.34427) 4923 : cluster [DBG] pgmap v2799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:59.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:25:59 gibba013 bash[30381]: cluster 2021-03-10T15:25:58.419784+0000 mgr.gibba020.yqfnwy (mgr.34427) 4923 : cluster [DBG] pgmap v2799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:25:59.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:25:59 gibba020 bash[25448]: cluster 2021-03-10T15:25:58.419784+0000 mgr.gibba020.yqfnwy (mgr.34427) 4923 : cluster [DBG] pgmap v2799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:01.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:01 gibba013 bash[29418]: cluster 2021-03-10T15:26:00.421524+0000 mgr.gibba020.yqfnwy (mgr.34427) 4924 : cluster [DBG] pgmap v2800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:01.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:01 gibba013 bash[30381]: cluster 2021-03-10T15:26:00.421524+0000 mgr.gibba020.yqfnwy (mgr.34427) 4924 : cluster [DBG] pgmap v2800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:01.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:01 gibba020 bash[25448]: cluster 2021-03-10T15:26:00.421524+0000 mgr.gibba020.yqfnwy (mgr.34427) 4924 : cluster [DBG] pgmap v2800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:02.735 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:26:02.961 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:26:02.961 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (92m) 7m ago 97m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:26:02.961 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (97m) 5m ago 97m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:26:02.962 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (92m) 5m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:26:02.962 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (93m) 5m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:26:02.962 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (92m) 7m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:26:02.962 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (92m) 7m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:26:02.963 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (91m) 5m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:26:02.963 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (91m) 7m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:26:02.963 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (98m) 7m ago 98m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:26:02.963 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (98m) 5m ago 98m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:26:02.963 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (90m) 7m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:26:02.964 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (90m) 7m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:26:02.964 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (89m) 7m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:26:02.964 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (89m) 7m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:26:02.964 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (89m) 5m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:26:02.965 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (88m) 5m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:26:02.965 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (88m) 5m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:26:02.965 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (87m) 5m ago 98m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:26:02.965 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (97m) 5m ago 98m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:26:02.965 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 5m ago 96m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:26:03.210 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:26:03.211 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:26:03.211 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:26:03.211 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:26:03.212 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:26:03.212 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:26:03.212 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:26:03.212 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:26:03.212 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:26:03.213 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:26:03.213 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:26:03.213 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:26:03.213 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:26:03.214 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:26:03.214 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:26:03.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:03 gibba013 bash[29418]: cluster 2021-03-10T15:26:02.422568+0000 mgr.gibba020.yqfnwy (mgr.34427) 4925 : cluster [DBG] pgmap v2801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:03.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:03 gibba013 bash[29418]: audit 2021-03-10T15:26:02.721751+0000 mgr.gibba020.yqfnwy (mgr.34427) 4926 : audit [DBG] from='client.47364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:26:03.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:03 gibba013 bash[29418]: audit 2021-03-10T15:26:02.944423+0000 mgr.gibba020.yqfnwy (mgr.34427) 4927 : audit [DBG] from='client.47370 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:26:03.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:03 gibba013 bash[29418]: audit 2021-03-10T15:26:03.207068+0000 mon.c (mon.1) 84 : audit [DBG] from='client.? 172.21.2.113:0/3416630682' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:03.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:03 gibba013 bash[30381]: cluster 2021-03-10T15:26:02.422568+0000 mgr.gibba020.yqfnwy (mgr.34427) 4925 : cluster [DBG] pgmap v2801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:03.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:03 gibba013 bash[30381]: audit 2021-03-10T15:26:02.721751+0000 mgr.gibba020.yqfnwy (mgr.34427) 4926 : audit [DBG] from='client.47364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:26:03.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:03 gibba013 bash[30381]: audit 2021-03-10T15:26:02.944423+0000 mgr.gibba020.yqfnwy (mgr.34427) 4927 : audit [DBG] from='client.47370 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:26:03.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:03 gibba013 bash[30381]: audit 2021-03-10T15:26:03.207068+0000 mon.c (mon.1) 84 : audit [DBG] from='client.? 172.21.2.113:0/3416630682' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:03.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:03 gibba020 bash[25448]: cluster 2021-03-10T15:26:02.422568+0000 mgr.gibba020.yqfnwy (mgr.34427) 4925 : cluster [DBG] pgmap v2801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:03.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:03 gibba020 bash[25448]: audit 2021-03-10T15:26:02.721751+0000 mgr.gibba020.yqfnwy (mgr.34427) 4926 : audit [DBG] from='client.47364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:26:03.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:03 gibba020 bash[25448]: audit 2021-03-10T15:26:02.944423+0000 mgr.gibba020.yqfnwy (mgr.34427) 4927 : audit [DBG] from='client.47370 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:26:03.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:03 gibba020 bash[25448]: audit 2021-03-10T15:26:03.207068+0000 mon.c (mon.1) 84 : audit [DBG] from='client.? 172.21.2.113:0/3416630682' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:05.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:05 gibba013 bash[29418]: cluster 2021-03-10T15:26:04.424046+0000 mgr.gibba020.yqfnwy (mgr.34427) 4928 : cluster [DBG] pgmap v2802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:05.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:05 gibba013 bash[30381]: cluster 2021-03-10T15:26:04.424046+0000 mgr.gibba020.yqfnwy (mgr.34427) 4928 : cluster [DBG] pgmap v2802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:05.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:05 gibba020 bash[25448]: cluster 2021-03-10T15:26:04.424046+0000 mgr.gibba020.yqfnwy (mgr.34427) 4928 : cluster [DBG] pgmap v2802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:06 gibba013 bash[29418]: audit 2021-03-10T15:26:06.438882+0000 mon.a (mon.0) 2035 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:26:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:06 gibba013 bash[30381]: audit 2021-03-10T15:26:06.438882+0000 mon.a (mon.0) 2035 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:26:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:06 gibba020 bash[25448]: audit 2021-03-10T15:26:06.438882+0000 mon.a (mon.0) 2035 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:26:07.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:07 gibba013 bash[29418]: cluster 2021-03-10T15:26:06.425611+0000 mgr.gibba020.yqfnwy (mgr.34427) 4929 : cluster [DBG] pgmap v2803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:07.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:07 gibba013 bash[29418]: audit 2021-03-10T15:26:06.501217+0000 mon.a (mon.0) 2036 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:26:07.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:07 gibba013 bash[29418]: audit 2021-03-10T15:26:06.614113+0000 mon.a (mon.0) 2037 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:26:07.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:07 gibba013 bash[29418]: audit 2021-03-10T15:26:06.614940+0000 mon.a (mon.0) 2038 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:26:07.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:07 gibba013 bash[29418]: audit 2021-03-10T15:26:06.615821+0000 mon.a (mon.0) 2039 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:26:07.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:07 gibba013 bash[29418]: audit 2021-03-10T15:26:06.616004+0000 mon.a (mon.0) 2040 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:26:07.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:07 gibba013 bash[30381]: cluster 2021-03-10T15:26:06.425611+0000 mgr.gibba020.yqfnwy (mgr.34427) 4929 : cluster [DBG] pgmap v2803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:07.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:07 gibba013 bash[30381]: audit 2021-03-10T15:26:06.501217+0000 mon.a (mon.0) 2036 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:26:07.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:07 gibba013 bash[30381]: audit 2021-03-10T15:26:06.614113+0000 mon.a (mon.0) 2037 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:26:07.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:07 gibba013 bash[30381]: audit 2021-03-10T15:26:06.614940+0000 mon.a (mon.0) 2038 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:26:07.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:07 gibba013 bash[30381]: audit 2021-03-10T15:26:06.615821+0000 mon.a (mon.0) 2039 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:26:07.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:07 gibba013 bash[30381]: audit 2021-03-10T15:26:06.616004+0000 mon.a (mon.0) 2040 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:26:07.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:07 gibba020 bash[25448]: cluster 2021-03-10T15:26:06.425611+0000 mgr.gibba020.yqfnwy (mgr.34427) 4929 : cluster [DBG] pgmap v2803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:07.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:07 gibba020 bash[25448]: audit 2021-03-10T15:26:06.501217+0000 mon.a (mon.0) 2036 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:26:07.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:07 gibba020 bash[25448]: audit 2021-03-10T15:26:06.614113+0000 mon.a (mon.0) 2037 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:26:07.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:07 gibba020 bash[25448]: audit 2021-03-10T15:26:06.614940+0000 mon.a (mon.0) 2038 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:26:07.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:07 gibba020 bash[25448]: audit 2021-03-10T15:26:06.615821+0000 mon.a (mon.0) 2039 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:26:07.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:07 gibba020 bash[25448]: audit 2021-03-10T15:26:06.616004+0000 mon.a (mon.0) 2040 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:26:09.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:09 gibba013 bash[29418]: cluster 2021-03-10T15:26:08.427007+0000 mgr.gibba020.yqfnwy (mgr.34427) 4930 : cluster [DBG] pgmap v2804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:09.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:09 gibba013 bash[30381]: cluster 2021-03-10T15:26:08.427007+0000 mgr.gibba020.yqfnwy (mgr.34427) 4930 : cluster [DBG] pgmap v2804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:09.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:09 gibba020 bash[25448]: cluster 2021-03-10T15:26:08.427007+0000 mgr.gibba020.yqfnwy (mgr.34427) 4930 : cluster [DBG] pgmap v2804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:11.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:11 gibba013 bash[29418]: cluster 2021-03-10T15:26:10.428624+0000 mgr.gibba020.yqfnwy (mgr.34427) 4931 : cluster [DBG] pgmap v2805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:11.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:11 gibba013 bash[30381]: cluster 2021-03-10T15:26:10.428624+0000 mgr.gibba020.yqfnwy (mgr.34427) 4931 : cluster [DBG] pgmap v2805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:11.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:11 gibba020 bash[25448]: cluster 2021-03-10T15:26:10.428624+0000 mgr.gibba020.yqfnwy (mgr.34427) 4931 : cluster [DBG] pgmap v2805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:12.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:12 gibba013 bash[29418]: audit 2021-03-10T15:26:12.150230+0000 mon.a (mon.0) 2041 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:26:12.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:12 gibba013 bash[29418]: audit 2021-03-10T15:26:12.352459+0000 mon.a (mon.0) 2042 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:26:12.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:12 gibba013 bash[29418]: audit 2021-03-10T15:26:12.357053+0000 mon.a (mon.0) 2043 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:26:12.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:12 gibba013 bash[30381]: audit 2021-03-10T15:26:12.150230+0000 mon.a (mon.0) 2041 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:26:12.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:12 gibba013 bash[30381]: audit 2021-03-10T15:26:12.352459+0000 mon.a (mon.0) 2042 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:26:12.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:12 gibba013 bash[30381]: audit 2021-03-10T15:26:12.357053+0000 mon.a (mon.0) 2043 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:26:12.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:12 gibba020 bash[25448]: audit 2021-03-10T15:26:12.150230+0000 mon.a (mon.0) 2041 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:26:12.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:12 gibba020 bash[25448]: audit 2021-03-10T15:26:12.352459+0000 mon.a (mon.0) 2042 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:26:12.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:12 gibba020 bash[25448]: audit 2021-03-10T15:26:12.357053+0000 mon.a (mon.0) 2043 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:26:13.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[29418]: cephadm 2021-03-10T15:26:12.352347+0000 mgr.gibba020.yqfnwy (mgr.34427) 4932 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:26:13.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[29418]: cephadm 2021-03-10T15:26:12.356984+0000 mgr.gibba020.yqfnwy (mgr.34427) 4933 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:26:13.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[29418]: cluster 2021-03-10T15:26:12.429114+0000 mgr.gibba020.yqfnwy (mgr.34427) 4934 : cluster [DBG] pgmap v2806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:13.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[29418]: audit 2021-03-10T15:26:12.556762+0000 mon.a (mon.0) 2044 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:26:13.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[29418]: cephadm 2021-03-10T15:26:12.558489+0000 mgr.gibba020.yqfnwy (mgr.34427) 4935 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:26:13.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[29418]: audit 2021-03-10T15:26:12.560036+0000 mon.a (mon.0) 2045 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:26:13.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[29418]: cephadm 2021-03-10T15:26:12.560467+0000 mgr.gibba020.yqfnwy (mgr.34427) 4936 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:26:13.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[29418]: audit 2021-03-10T15:26:12.561642+0000 mon.a (mon.0) 2046 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:13.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[29418]: cephadm 2021-03-10T15:26:12.561843+0000 mgr.gibba020.yqfnwy (mgr.34427) 4937 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:26:13.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[29418]: cephadm 2021-03-10T15:26:12.561882+0000 mgr.gibba020.yqfnwy (mgr.34427) 4938 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:26:13.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[29418]: audit 2021-03-10T15:26:12.563064+0000 mon.a (mon.0) 2047 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:13.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[29418]: cephadm 2021-03-10T15:26:12.563228+0000 mgr.gibba020.yqfnwy (mgr.34427) 4939 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:26:13.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[29418]: cephadm 2021-03-10T15:26:12.563266+0000 mgr.gibba020.yqfnwy (mgr.34427) 4940 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:26:13.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[29418]: audit 2021-03-10T15:26:12.564387+0000 mon.a (mon.0) 2048 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:13.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[29418]: cephadm 2021-03-10T15:26:12.564548+0000 mgr.gibba020.yqfnwy (mgr.34427) 4941 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:26:13.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[29418]: cephadm 2021-03-10T15:26:12.565837+0000 mgr.gibba020.yqfnwy (mgr.34427) 4942 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:26:13.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[29418]: cephadm 2021-03-10T15:26:12.565875+0000 mgr.gibba020.yqfnwy (mgr.34427) 4943 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:26:13.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[29418]: audit 2021-03-10T15:26:12.567129+0000 mon.a (mon.0) 2049 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:13.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[29418]: cephadm 2021-03-10T15:26:12.567296+0000 mgr.gibba020.yqfnwy (mgr.34427) 4944 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:26:13.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[29418]: cephadm 2021-03-10T15:26:12.567624+0000 mgr.gibba020.yqfnwy (mgr.34427) 4945 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:26:13.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[30381]: cephadm 2021-03-10T15:26:12.352347+0000 mgr.gibba020.yqfnwy (mgr.34427) 4932 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:26:13.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[30381]: cephadm 2021-03-10T15:26:12.356984+0000 mgr.gibba020.yqfnwy (mgr.34427) 4933 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:26:13.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[30381]: cluster 2021-03-10T15:26:12.429114+0000 mgr.gibba020.yqfnwy (mgr.34427) 4934 : cluster [DBG] pgmap v2806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:13.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[30381]: audit 2021-03-10T15:26:12.556762+0000 mon.a (mon.0) 2044 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:26:13.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[30381]: cephadm 2021-03-10T15:26:12.558489+0000 mgr.gibba020.yqfnwy (mgr.34427) 4935 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:26:13.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[30381]: audit 2021-03-10T15:26:12.560036+0000 mon.a (mon.0) 2045 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:26:13.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[30381]: cephadm 2021-03-10T15:26:12.560467+0000 mgr.gibba020.yqfnwy (mgr.34427) 4936 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:26:13.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[30381]: audit 2021-03-10T15:26:12.561642+0000 mon.a (mon.0) 2046 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:13.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[30381]: cephadm 2021-03-10T15:26:12.561843+0000 mgr.gibba020.yqfnwy (mgr.34427) 4937 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:26:13.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[30381]: cephadm 2021-03-10T15:26:12.561882+0000 mgr.gibba020.yqfnwy (mgr.34427) 4938 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:26:13.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[30381]: audit 2021-03-10T15:26:12.563064+0000 mon.a (mon.0) 2047 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:13.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[30381]: cephadm 2021-03-10T15:26:12.563228+0000 mgr.gibba020.yqfnwy (mgr.34427) 4939 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:26:13.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[30381]: cephadm 2021-03-10T15:26:12.563266+0000 mgr.gibba020.yqfnwy (mgr.34427) 4940 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:26:13.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[30381]: audit 2021-03-10T15:26:12.564387+0000 mon.a (mon.0) 2048 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:13.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[30381]: cephadm 2021-03-10T15:26:12.564548+0000 mgr.gibba020.yqfnwy (mgr.34427) 4941 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:26:13.893 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[30381]: cephadm 2021-03-10T15:26:12.565837+0000 mgr.gibba020.yqfnwy (mgr.34427) 4942 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:26:13.893 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[30381]: cephadm 2021-03-10T15:26:12.565875+0000 mgr.gibba020.yqfnwy (mgr.34427) 4943 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:26:13.893 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[30381]: audit 2021-03-10T15:26:12.567129+0000 mon.a (mon.0) 2049 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:13.893 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[30381]: cephadm 2021-03-10T15:26:12.567296+0000 mgr.gibba020.yqfnwy (mgr.34427) 4944 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:26:13.893 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[30381]: cephadm 2021-03-10T15:26:12.567624+0000 mgr.gibba020.yqfnwy (mgr.34427) 4945 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:26:13.894 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[29418]: audit 2021-03-10T15:26:12.568800+0000 mon.a (mon.0) 2050 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:13.894 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[29418]: cephadm 2021-03-10T15:26:12.568966+0000 mgr.gibba020.yqfnwy (mgr.34427) 4946 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:26:13.894 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[29418]: cephadm 2021-03-10T15:26:12.569004+0000 mgr.gibba020.yqfnwy (mgr.34427) 4947 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:26:13.895 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[29418]: cephadm 2021-03-10T15:26:12.569191+0000 mgr.gibba020.yqfnwy (mgr.34427) 4948 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:26:13.895 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[30381]: audit 2021-03-10T15:26:12.568800+0000 mon.a (mon.0) 2050 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:13.895 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[30381]: cephadm 2021-03-10T15:26:12.568966+0000 mgr.gibba020.yqfnwy (mgr.34427) 4946 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:26:13.896 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[30381]: cephadm 2021-03-10T15:26:12.569004+0000 mgr.gibba020.yqfnwy (mgr.34427) 4947 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:26:13.896 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:13 gibba013 bash[30381]: cephadm 2021-03-10T15:26:12.569191+0000 mgr.gibba020.yqfnwy (mgr.34427) 4948 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:26:13.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:13 gibba020 bash[25448]: cephadm 2021-03-10T15:26:12.352347+0000 mgr.gibba020.yqfnwy (mgr.34427) 4932 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:26:13.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:13 gibba020 bash[25448]: cephadm 2021-03-10T15:26:12.356984+0000 mgr.gibba020.yqfnwy (mgr.34427) 4933 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:26:13.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:13 gibba020 bash[25448]: cluster 2021-03-10T15:26:12.429114+0000 mgr.gibba020.yqfnwy (mgr.34427) 4934 : cluster [DBG] pgmap v2806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:13.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:13 gibba020 bash[25448]: audit 2021-03-10T15:26:12.556762+0000 mon.a (mon.0) 2044 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:26:13.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:13 gibba020 bash[25448]: cephadm 2021-03-10T15:26:12.558489+0000 mgr.gibba020.yqfnwy (mgr.34427) 4935 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:26:13.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:13 gibba020 bash[25448]: audit 2021-03-10T15:26:12.560036+0000 mon.a (mon.0) 2045 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:26:13.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:13 gibba020 bash[25448]: cephadm 2021-03-10T15:26:12.560467+0000 mgr.gibba020.yqfnwy (mgr.34427) 4936 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:26:13.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:13 gibba020 bash[25448]: audit 2021-03-10T15:26:12.561642+0000 mon.a (mon.0) 2046 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:13.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:13 gibba020 bash[25448]: cephadm 2021-03-10T15:26:12.561843+0000 mgr.gibba020.yqfnwy (mgr.34427) 4937 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:26:13.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:13 gibba020 bash[25448]: cephadm 2021-03-10T15:26:12.561882+0000 mgr.gibba020.yqfnwy (mgr.34427) 4938 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:26:13.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:13 gibba020 bash[25448]: audit 2021-03-10T15:26:12.563064+0000 mon.a (mon.0) 2047 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:13.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:13 gibba020 bash[25448]: cephadm 2021-03-10T15:26:12.563228+0000 mgr.gibba020.yqfnwy (mgr.34427) 4939 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:26:13.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:13 gibba020 bash[25448]: cephadm 2021-03-10T15:26:12.563266+0000 mgr.gibba020.yqfnwy (mgr.34427) 4940 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:26:13.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:13 gibba020 bash[25448]: audit 2021-03-10T15:26:12.564387+0000 mon.a (mon.0) 2048 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:13.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:13 gibba020 bash[25448]: cephadm 2021-03-10T15:26:12.564548+0000 mgr.gibba020.yqfnwy (mgr.34427) 4941 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:26:13.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:13 gibba020 bash[25448]: cephadm 2021-03-10T15:26:12.565837+0000 mgr.gibba020.yqfnwy (mgr.34427) 4942 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:26:13.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:13 gibba020 bash[25448]: cephadm 2021-03-10T15:26:12.565875+0000 mgr.gibba020.yqfnwy (mgr.34427) 4943 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:26:13.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:13 gibba020 bash[25448]: audit 2021-03-10T15:26:12.567129+0000 mon.a (mon.0) 2049 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:13.957 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:13 gibba020 bash[25448]: cephadm 2021-03-10T15:26:12.567296+0000 mgr.gibba020.yqfnwy (mgr.34427) 4944 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:26:13.957 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:13 gibba020 bash[25448]: cephadm 2021-03-10T15:26:12.567624+0000 mgr.gibba020.yqfnwy (mgr.34427) 4945 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:26:13.957 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:13 gibba020 bash[25448]: audit 2021-03-10T15:26:12.568800+0000 mon.a (mon.0) 2050 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:13.957 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:13 gibba020 bash[25448]: cephadm 2021-03-10T15:26:12.568966+0000 mgr.gibba020.yqfnwy (mgr.34427) 4946 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:26:13.957 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:13 gibba020 bash[25448]: cephadm 2021-03-10T15:26:12.569004+0000 mgr.gibba020.yqfnwy (mgr.34427) 4947 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:26:13.958 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:13 gibba020 bash[25448]: cephadm 2021-03-10T15:26:12.569191+0000 mgr.gibba020.yqfnwy (mgr.34427) 4948 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:26:15.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:15 gibba013 bash[29418]: cluster 2021-03-10T15:26:14.430355+0000 mgr.gibba020.yqfnwy (mgr.34427) 4949 : cluster [DBG] pgmap v2807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:15.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:15 gibba013 bash[30381]: cluster 2021-03-10T15:26:14.430355+0000 mgr.gibba020.yqfnwy (mgr.34427) 4949 : cluster [DBG] pgmap v2807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:15.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:15 gibba020 bash[25448]: cluster 2021-03-10T15:26:14.430355+0000 mgr.gibba020.yqfnwy (mgr.34427) 4949 : cluster [DBG] pgmap v2807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:17.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:17 gibba013 bash[29418]: cluster 2021-03-10T15:26:16.432181+0000 mgr.gibba020.yqfnwy (mgr.34427) 4950 : cluster [DBG] pgmap v2808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:17.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:17 gibba013 bash[30381]: cluster 2021-03-10T15:26:16.432181+0000 mgr.gibba020.yqfnwy (mgr.34427) 4950 : cluster [DBG] pgmap v2808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:17.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:17 gibba020 bash[25448]: cluster 2021-03-10T15:26:16.432181+0000 mgr.gibba020.yqfnwy (mgr.34427) 4950 : cluster [DBG] pgmap v2808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:19.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:19 gibba013 bash[29418]: cluster 2021-03-10T15:26:18.433596+0000 mgr.gibba020.yqfnwy (mgr.34427) 4951 : cluster [DBG] pgmap v2809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:19.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:19 gibba013 bash[30381]: cluster 2021-03-10T15:26:18.433596+0000 mgr.gibba020.yqfnwy (mgr.34427) 4951 : cluster [DBG] pgmap v2809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:19.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:19 gibba020 bash[25448]: cluster 2021-03-10T15:26:18.433596+0000 mgr.gibba020.yqfnwy (mgr.34427) 4951 : cluster [DBG] pgmap v2809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:21.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:21 gibba013 bash[29418]: cluster 2021-03-10T15:26:20.435287+0000 mgr.gibba020.yqfnwy (mgr.34427) 4952 : cluster [DBG] pgmap v2810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:21.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:21 gibba013 bash[30381]: cluster 2021-03-10T15:26:20.435287+0000 mgr.gibba020.yqfnwy (mgr.34427) 4952 : cluster [DBG] pgmap v2810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:21.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:21 gibba020 bash[25448]: cluster 2021-03-10T15:26:20.435287+0000 mgr.gibba020.yqfnwy (mgr.34427) 4952 : cluster [DBG] pgmap v2810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:23.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:23 gibba020 bash[25448]: cluster 2021-03-10T15:26:22.436746+0000 mgr.gibba020.yqfnwy (mgr.34427) 4953 : cluster [DBG] pgmap v2811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:23.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:23 gibba013 bash[29418]: cluster 2021-03-10T15:26:22.436746+0000 mgr.gibba020.yqfnwy (mgr.34427) 4953 : cluster [DBG] pgmap v2811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:23.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:23 gibba013 bash[30381]: cluster 2021-03-10T15:26:22.436746+0000 mgr.gibba020.yqfnwy (mgr.34427) 4953 : cluster [DBG] pgmap v2811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:25.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:25 gibba013 bash[29418]: cluster 2021-03-10T15:26:24.437999+0000 mgr.gibba020.yqfnwy (mgr.34427) 4954 : cluster [DBG] pgmap v2812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:25.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:25 gibba013 bash[30381]: cluster 2021-03-10T15:26:24.437999+0000 mgr.gibba020.yqfnwy (mgr.34427) 4954 : cluster [DBG] pgmap v2812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:25.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:25 gibba020 bash[25448]: cluster 2021-03-10T15:26:24.437999+0000 mgr.gibba020.yqfnwy (mgr.34427) 4954 : cluster [DBG] pgmap v2812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:27.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:27 gibba013 bash[29418]: cluster 2021-03-10T15:26:26.439847+0000 mgr.gibba020.yqfnwy (mgr.34427) 4955 : cluster [DBG] pgmap v2813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:27.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:27 gibba013 bash[30381]: cluster 2021-03-10T15:26:26.439847+0000 mgr.gibba020.yqfnwy (mgr.34427) 4955 : cluster [DBG] pgmap v2813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:27.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:27 gibba020 bash[25448]: cluster 2021-03-10T15:26:26.439847+0000 mgr.gibba020.yqfnwy (mgr.34427) 4955 : cluster [DBG] pgmap v2813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:28.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:28 gibba013 bash[29418]: cephadm 2021-03-10T15:26:27.584915+0000 mgr.gibba020.yqfnwy (mgr.34427) 4956 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:26:28.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:28 gibba013 bash[30381]: cephadm 2021-03-10T15:26:27.584915+0000 mgr.gibba020.yqfnwy (mgr.34427) 4956 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:26:28.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:28 gibba020 bash[25448]: cephadm 2021-03-10T15:26:27.584915+0000 mgr.gibba020.yqfnwy (mgr.34427) 4956 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:26:29.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:29 gibba013 bash[29418]: cluster 2021-03-10T15:26:28.441233+0000 mgr.gibba020.yqfnwy (mgr.34427) 4957 : cluster [DBG] pgmap v2814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:29.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:29 gibba013 bash[30381]: cluster 2021-03-10T15:26:28.441233+0000 mgr.gibba020.yqfnwy (mgr.34427) 4957 : cluster [DBG] pgmap v2814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:29.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:29 gibba020 bash[25448]: cluster 2021-03-10T15:26:28.441233+0000 mgr.gibba020.yqfnwy (mgr.34427) 4957 : cluster [DBG] pgmap v2814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:31.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:31 gibba013 bash[29418]: cluster 2021-03-10T15:26:30.442938+0000 mgr.gibba020.yqfnwy (mgr.34427) 4958 : cluster [DBG] pgmap v2815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:31.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:31 gibba013 bash[30381]: cluster 2021-03-10T15:26:30.442938+0000 mgr.gibba020.yqfnwy (mgr.34427) 4958 : cluster [DBG] pgmap v2815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:31.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:31 gibba020 bash[25448]: cluster 2021-03-10T15:26:30.442938+0000 mgr.gibba020.yqfnwy (mgr.34427) 4958 : cluster [DBG] pgmap v2815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:33.454 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:26:33.682 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:26:33.683 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (93m) 7m ago 98m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:26:33.683 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (98m) 6m ago 98m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:26:33.683 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (93m) 6m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:26:33.684 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (93m) 6m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:26:33.684 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (92m) 7m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:26:33.684 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (92m) 7m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:26:33.684 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (92m) 6m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:26:33.685 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (92m) 7m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:26:33.685 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (98m) 7m ago 98m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:26:33.685 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (98m) 6m ago 98m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:26:33.685 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (91m) 7m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:26:33.686 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (90m) 7m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:26:33.686 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (90m) 7m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:26:33.686 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (90m) 7m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:26:33.686 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (89m) 6m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:26:33.687 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (89m) 6m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:26:33.687 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (88m) 6m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:26:33.687 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (88m) 6m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:26:33.687 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (97m) 6m ago 98m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:26:33.688 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 6m ago 96m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:26:33.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:33 gibba020 bash[25448]: cluster 2021-03-10T15:26:32.444245+0000 mgr.gibba020.yqfnwy (mgr.34427) 4959 : cluster [DBG] pgmap v2816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:33.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:33 gibba013 bash[29418]: cluster 2021-03-10T15:26:32.444245+0000 mgr.gibba020.yqfnwy (mgr.34427) 4959 : cluster [DBG] pgmap v2816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:33.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:33 gibba013 bash[30381]: cluster 2021-03-10T15:26:32.444245+0000 mgr.gibba020.yqfnwy (mgr.34427) 4959 : cluster [DBG] pgmap v2816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:33.931 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:26:33.932 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:26:33.932 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:26:33.932 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:26:33.932 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:26:33.933 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:26:33.933 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:26:33.933 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:26:33.933 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:26:33.934 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:26:33.934 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:26:33.934 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:26:33.934 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:26:33.935 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:26:33.935 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:26:34.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:34 gibba020 bash[25448]: audit 2021-03-10T15:26:33.441570+0000 mgr.gibba020.yqfnwy (mgr.34427) 4960 : audit [DBG] from='client.57367 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:26:34.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:34 gibba020 bash[25448]: audit 2021-03-10T15:26:33.665464+0000 mgr.gibba020.yqfnwy (mgr.34427) 4961 : audit [DBG] from='client.47388 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:26:34.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:34 gibba020 bash[25448]: audit 2021-03-10T15:26:33.928174+0000 mon.c (mon.1) 85 : audit [DBG] from='client.? 172.21.2.113:0/3694530020' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:34.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:34 gibba013 bash[29418]: audit 2021-03-10T15:26:33.441570+0000 mgr.gibba020.yqfnwy (mgr.34427) 4960 : audit [DBG] from='client.57367 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:26:34.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:34 gibba013 bash[29418]: audit 2021-03-10T15:26:33.665464+0000 mgr.gibba020.yqfnwy (mgr.34427) 4961 : audit [DBG] from='client.47388 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:26:34.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:34 gibba013 bash[29418]: audit 2021-03-10T15:26:33.928174+0000 mon.c (mon.1) 85 : audit [DBG] from='client.? 172.21.2.113:0/3694530020' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:34.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:34 gibba013 bash[30381]: audit 2021-03-10T15:26:33.441570+0000 mgr.gibba020.yqfnwy (mgr.34427) 4960 : audit [DBG] from='client.57367 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:26:34.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:34 gibba013 bash[30381]: audit 2021-03-10T15:26:33.665464+0000 mgr.gibba020.yqfnwy (mgr.34427) 4961 : audit [DBG] from='client.47388 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:26:34.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:34 gibba013 bash[30381]: audit 2021-03-10T15:26:33.928174+0000 mon.c (mon.1) 85 : audit [DBG] from='client.? 172.21.2.113:0/3694530020' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:26:35.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:35 gibba020 bash[25448]: cluster 2021-03-10T15:26:34.444939+0000 mgr.gibba020.yqfnwy (mgr.34427) 4962 : cluster [DBG] pgmap v2817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:35.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:35 gibba013 bash[29418]: cluster 2021-03-10T15:26:34.444939+0000 mgr.gibba020.yqfnwy (mgr.34427) 4962 : cluster [DBG] pgmap v2817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:35.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:35 gibba013 bash[30381]: cluster 2021-03-10T15:26:34.444939+0000 mgr.gibba020.yqfnwy (mgr.34427) 4962 : cluster [DBG] pgmap v2817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:37.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:37 gibba013 bash[29418]: cluster 2021-03-10T15:26:36.446452+0000 mgr.gibba020.yqfnwy (mgr.34427) 4963 : cluster [DBG] pgmap v2818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:37.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:37 gibba013 bash[30381]: cluster 2021-03-10T15:26:36.446452+0000 mgr.gibba020.yqfnwy (mgr.34427) 4963 : cluster [DBG] pgmap v2818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:37.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:37 gibba020 bash[25448]: cluster 2021-03-10T15:26:36.446452+0000 mgr.gibba020.yqfnwy (mgr.34427) 4963 : cluster [DBG] pgmap v2818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:39.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:39 gibba013 bash[29418]: cluster 2021-03-10T15:26:38.447871+0000 mgr.gibba020.yqfnwy (mgr.34427) 4964 : cluster [DBG] pgmap v2819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:39.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:39 gibba013 bash[30381]: cluster 2021-03-10T15:26:38.447871+0000 mgr.gibba020.yqfnwy (mgr.34427) 4964 : cluster [DBG] pgmap v2819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:39.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:39 gibba020 bash[25448]: cluster 2021-03-10T15:26:38.447871+0000 mgr.gibba020.yqfnwy (mgr.34427) 4964 : cluster [DBG] pgmap v2819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:41.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:41 gibba013 bash[29418]: cluster 2021-03-10T15:26:40.449601+0000 mgr.gibba020.yqfnwy (mgr.34427) 4965 : cluster [DBG] pgmap v2820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:41.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:41 gibba013 bash[30381]: cluster 2021-03-10T15:26:40.449601+0000 mgr.gibba020.yqfnwy (mgr.34427) 4965 : cluster [DBG] pgmap v2820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:41.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:41 gibba020 bash[25448]: cluster 2021-03-10T15:26:40.449601+0000 mgr.gibba020.yqfnwy (mgr.34427) 4965 : cluster [DBG] pgmap v2820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:43.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:43 gibba020 bash[25448]: cluster 2021-03-10T15:26:42.450659+0000 mgr.gibba020.yqfnwy (mgr.34427) 4966 : cluster [DBG] pgmap v2821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:43.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:43 gibba020 bash[25448]: cephadm 2021-03-10T15:26:42.600958+0000 mgr.gibba020.yqfnwy (mgr.34427) 4967 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:26:43.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:43 gibba013 bash[29418]: cluster 2021-03-10T15:26:42.450659+0000 mgr.gibba020.yqfnwy (mgr.34427) 4966 : cluster [DBG] pgmap v2821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:43.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:43 gibba013 bash[29418]: cephadm 2021-03-10T15:26:42.600958+0000 mgr.gibba020.yqfnwy (mgr.34427) 4967 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:26:43.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:43 gibba013 bash[30381]: cluster 2021-03-10T15:26:42.450659+0000 mgr.gibba020.yqfnwy (mgr.34427) 4966 : cluster [DBG] pgmap v2821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:43.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:43 gibba013 bash[30381]: cephadm 2021-03-10T15:26:42.600958+0000 mgr.gibba020.yqfnwy (mgr.34427) 4967 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:26:45.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:45 gibba013 bash[29418]: cluster 2021-03-10T15:26:44.451985+0000 mgr.gibba020.yqfnwy (mgr.34427) 4968 : cluster [DBG] pgmap v2822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:45.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:45 gibba013 bash[30381]: cluster 2021-03-10T15:26:44.451985+0000 mgr.gibba020.yqfnwy (mgr.34427) 4968 : cluster [DBG] pgmap v2822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:45.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:45 gibba020 bash[25448]: cluster 2021-03-10T15:26:44.451985+0000 mgr.gibba020.yqfnwy (mgr.34427) 4968 : cluster [DBG] pgmap v2822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:47.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:47 gibba013 bash[29418]: cluster 2021-03-10T15:26:46.453688+0000 mgr.gibba020.yqfnwy (mgr.34427) 4969 : cluster [DBG] pgmap v2823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:47.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:47 gibba013 bash[30381]: cluster 2021-03-10T15:26:46.453688+0000 mgr.gibba020.yqfnwy (mgr.34427) 4969 : cluster [DBG] pgmap v2823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:47.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:47 gibba020 bash[25448]: cluster 2021-03-10T15:26:46.453688+0000 mgr.gibba020.yqfnwy (mgr.34427) 4969 : cluster [DBG] pgmap v2823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:49.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:49 gibba013 bash[29418]: cluster 2021-03-10T15:26:48.455157+0000 mgr.gibba020.yqfnwy (mgr.34427) 4970 : cluster [DBG] pgmap v2824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:49.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:49 gibba013 bash[30381]: cluster 2021-03-10T15:26:48.455157+0000 mgr.gibba020.yqfnwy (mgr.34427) 4970 : cluster [DBG] pgmap v2824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:49.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:49 gibba020 bash[25448]: cluster 2021-03-10T15:26:48.455157+0000 mgr.gibba020.yqfnwy (mgr.34427) 4970 : cluster [DBG] pgmap v2824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:51.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:51 gibba013 bash[29418]: cluster 2021-03-10T15:26:50.456922+0000 mgr.gibba020.yqfnwy (mgr.34427) 4971 : cluster [DBG] pgmap v2825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:51.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:51 gibba013 bash[30381]: cluster 2021-03-10T15:26:50.456922+0000 mgr.gibba020.yqfnwy (mgr.34427) 4971 : cluster [DBG] pgmap v2825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:51.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:51 gibba020 bash[25448]: cluster 2021-03-10T15:26:50.456922+0000 mgr.gibba020.yqfnwy (mgr.34427) 4971 : cluster [DBG] pgmap v2825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:53.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:53 gibba020 bash[25448]: cluster 2021-03-10T15:26:52.457849+0000 mgr.gibba020.yqfnwy (mgr.34427) 4972 : cluster [DBG] pgmap v2826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:53.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:53 gibba013 bash[29418]: cluster 2021-03-10T15:26:52.457849+0000 mgr.gibba020.yqfnwy (mgr.34427) 4972 : cluster [DBG] pgmap v2826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:53.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:53 gibba013 bash[30381]: cluster 2021-03-10T15:26:52.457849+0000 mgr.gibba020.yqfnwy (mgr.34427) 4972 : cluster [DBG] pgmap v2826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:55.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:55 gibba013 bash[29418]: cluster 2021-03-10T15:26:54.459172+0000 mgr.gibba020.yqfnwy (mgr.34427) 4973 : cluster [DBG] pgmap v2827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:55.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:55 gibba013 bash[30381]: cluster 2021-03-10T15:26:54.459172+0000 mgr.gibba020.yqfnwy (mgr.34427) 4973 : cluster [DBG] pgmap v2827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:55.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:55 gibba020 bash[25448]: cluster 2021-03-10T15:26:54.459172+0000 mgr.gibba020.yqfnwy (mgr.34427) 4973 : cluster [DBG] pgmap v2827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:57.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:57 gibba013 bash[29418]: cluster 2021-03-10T15:26:56.461038+0000 mgr.gibba020.yqfnwy (mgr.34427) 4974 : cluster [DBG] pgmap v2828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:57.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:57 gibba013 bash[30381]: cluster 2021-03-10T15:26:56.461038+0000 mgr.gibba020.yqfnwy (mgr.34427) 4974 : cluster [DBG] pgmap v2828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:57.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:57 gibba020 bash[25448]: cluster 2021-03-10T15:26:56.461038+0000 mgr.gibba020.yqfnwy (mgr.34427) 4974 : cluster [DBG] pgmap v2828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:58.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:58 gibba013 bash[29418]: cephadm 2021-03-10T15:26:57.616727+0000 mgr.gibba020.yqfnwy (mgr.34427) 4975 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:26:58.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:58 gibba013 bash[30381]: cephadm 2021-03-10T15:26:57.616727+0000 mgr.gibba020.yqfnwy (mgr.34427) 4975 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:26:58.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:58 gibba020 bash[25448]: cephadm 2021-03-10T15:26:57.616727+0000 mgr.gibba020.yqfnwy (mgr.34427) 4975 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:26:59.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:26:59 gibba013 bash[29418]: cluster 2021-03-10T15:26:58.462462+0000 mgr.gibba020.yqfnwy (mgr.34427) 4976 : cluster [DBG] pgmap v2829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:59.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:26:59 gibba013 bash[30381]: cluster 2021-03-10T15:26:58.462462+0000 mgr.gibba020.yqfnwy (mgr.34427) 4976 : cluster [DBG] pgmap v2829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:26:59.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:26:59 gibba020 bash[25448]: cluster 2021-03-10T15:26:58.462462+0000 mgr.gibba020.yqfnwy (mgr.34427) 4976 : cluster [DBG] pgmap v2829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:01.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:01 gibba013 bash[29418]: cluster 2021-03-10T15:27:00.464200+0000 mgr.gibba020.yqfnwy (mgr.34427) 4977 : cluster [DBG] pgmap v2830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:01.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:01 gibba013 bash[30381]: cluster 2021-03-10T15:27:00.464200+0000 mgr.gibba020.yqfnwy (mgr.34427) 4977 : cluster [DBG] pgmap v2830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:01.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:01 gibba020 bash[25448]: cluster 2021-03-10T15:27:00.464200+0000 mgr.gibba020.yqfnwy (mgr.34427) 4977 : cluster [DBG] pgmap v2830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:03.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:03 gibba020 bash[25448]: cluster 2021-03-10T15:27:02.464952+0000 mgr.gibba020.yqfnwy (mgr.34427) 4978 : cluster [DBG] pgmap v2831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:03.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:03 gibba013 bash[29418]: cluster 2021-03-10T15:27:02.464952+0000 mgr.gibba020.yqfnwy (mgr.34427) 4978 : cluster [DBG] pgmap v2831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:03.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:03 gibba013 bash[30381]: cluster 2021-03-10T15:27:02.464952+0000 mgr.gibba020.yqfnwy (mgr.34427) 4978 : cluster [DBG] pgmap v2831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:04.174 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:27:04.400 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:27:04.401 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (93m) 8m ago 98m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:27:04.401 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (98m) 6m ago 98m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:27:04.401 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (93m) 6m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:27:04.402 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (94m) 6m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:27:04.402 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (93m) 8m ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:27:04.402 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (93m) 8m ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:27:04.402 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (92m) 6m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:27:04.403 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (92m) 8m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:27:04.403 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (99m) 8m ago 99m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:27:04.403 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (99m) 6m ago 99m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:27:04.403 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (91m) 8m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:27:04.404 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (91m) 8m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:27:04.404 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (90m) 8m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:27:04.404 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (90m) 8m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:27:04.404 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (90m) 6m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:27:04.405 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (89m) 6m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:27:04.405 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (89m) 6m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:27:04.405 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (88m) 6m ago 99m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:27:04.405 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (98m) 6m ago 99m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:27:04.405 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 6m ago 97m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:27:04.650 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:27:04.650 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:27:04.651 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:27:04.651 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:27:04.651 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:27:04.651 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:27:04.652 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:27:04.652 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:27:04.652 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:27:04.652 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:27:04.653 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:27:04.653 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:27:04.653 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:27:04.653 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:27:04.653 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:27:04.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:04 gibba020 bash[25448]: audit 2021-03-10T15:27:04.160456+0000 mgr.gibba020.yqfnwy (mgr.34427) 4979 : audit [DBG] from='client.47400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:27:04.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:04 gibba013 bash[29418]: audit 2021-03-10T15:27:04.160456+0000 mgr.gibba020.yqfnwy (mgr.34427) 4979 : audit [DBG] from='client.47400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:27:04.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:04 gibba013 bash[30381]: audit 2021-03-10T15:27:04.160456+0000 mgr.gibba020.yqfnwy (mgr.34427) 4979 : audit [DBG] from='client.47400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:27:05.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:05 gibba020 bash[25448]: audit 2021-03-10T15:27:04.383913+0000 mgr.gibba020.yqfnwy (mgr.34427) 4980 : audit [DBG] from='client.47406 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:27:05.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:05 gibba020 bash[25448]: cluster 2021-03-10T15:27:04.466188+0000 mgr.gibba020.yqfnwy (mgr.34427) 4981 : cluster [DBG] pgmap v2832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:05.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:05 gibba020 bash[25448]: audit 2021-03-10T15:27:04.646582+0000 mon.a (mon.0) 2051 : audit [DBG] from='client.? 172.21.2.113:0/3243744739' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:05.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:05 gibba013 bash[29418]: audit 2021-03-10T15:27:04.383913+0000 mgr.gibba020.yqfnwy (mgr.34427) 4980 : audit [DBG] from='client.47406 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:27:05.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:05 gibba013 bash[29418]: cluster 2021-03-10T15:27:04.466188+0000 mgr.gibba020.yqfnwy (mgr.34427) 4981 : cluster [DBG] pgmap v2832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:05.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:05 gibba013 bash[29418]: audit 2021-03-10T15:27:04.646582+0000 mon.a (mon.0) 2051 : audit [DBG] from='client.? 172.21.2.113:0/3243744739' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:05.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:05 gibba013 bash[30381]: audit 2021-03-10T15:27:04.383913+0000 mgr.gibba020.yqfnwy (mgr.34427) 4980 : audit [DBG] from='client.47406 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:27:05.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:05 gibba013 bash[30381]: cluster 2021-03-10T15:27:04.466188+0000 mgr.gibba020.yqfnwy (mgr.34427) 4981 : cluster [DBG] pgmap v2832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:05.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:05 gibba013 bash[30381]: audit 2021-03-10T15:27:04.646582+0000 mon.a (mon.0) 2051 : audit [DBG] from='client.? 172.21.2.113:0/3243744739' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:06.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:06 gibba013 bash[29418]: audit 2021-03-10T15:27:06.444095+0000 mon.a (mon.0) 2052 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:27:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:06 gibba013 bash[30381]: audit 2021-03-10T15:27:06.444095+0000 mon.a (mon.0) 2052 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:27:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:06 gibba020 bash[25448]: audit 2021-03-10T15:27:06.444095+0000 mon.a (mon.0) 2052 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:27:07.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:07 gibba013 bash[29418]: cluster 2021-03-10T15:27:06.467789+0000 mgr.gibba020.yqfnwy (mgr.34427) 4982 : cluster [DBG] pgmap v2833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:07.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:07 gibba013 bash[29418]: audit 2021-03-10T15:27:06.505757+0000 mon.a (mon.0) 2053 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:27:07.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:07 gibba013 bash[29418]: audit 2021-03-10T15:27:06.619238+0000 mon.a (mon.0) 2054 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:27:07.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:07 gibba013 bash[29418]: audit 2021-03-10T15:27:06.619384+0000 mon.a (mon.0) 2055 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:27:07.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:07 gibba013 bash[29418]: audit 2021-03-10T15:27:06.619503+0000 mon.a (mon.0) 2056 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:27:07.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:07 gibba013 bash[29418]: audit 2021-03-10T15:27:06.619626+0000 mon.a (mon.0) 2057 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:27:07.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:07 gibba013 bash[30381]: cluster 2021-03-10T15:27:06.467789+0000 mgr.gibba020.yqfnwy (mgr.34427) 4982 : cluster [DBG] pgmap v2833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:07.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:07 gibba013 bash[30381]: audit 2021-03-10T15:27:06.505757+0000 mon.a (mon.0) 2053 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:27:07.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:07 gibba013 bash[30381]: audit 2021-03-10T15:27:06.619238+0000 mon.a (mon.0) 2054 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:27:07.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:07 gibba013 bash[30381]: audit 2021-03-10T15:27:06.619384+0000 mon.a (mon.0) 2055 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:27:07.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:07 gibba013 bash[30381]: audit 2021-03-10T15:27:06.619503+0000 mon.a (mon.0) 2056 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:27:07.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:07 gibba013 bash[30381]: audit 2021-03-10T15:27:06.619626+0000 mon.a (mon.0) 2057 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:27:07.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:07 gibba020 bash[25448]: cluster 2021-03-10T15:27:06.467789+0000 mgr.gibba020.yqfnwy (mgr.34427) 4982 : cluster [DBG] pgmap v2833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:07.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:07 gibba020 bash[25448]: audit 2021-03-10T15:27:06.505757+0000 mon.a (mon.0) 2053 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:27:07.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:07 gibba020 bash[25448]: audit 2021-03-10T15:27:06.619238+0000 mon.a (mon.0) 2054 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:27:07.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:07 gibba020 bash[25448]: audit 2021-03-10T15:27:06.619384+0000 mon.a (mon.0) 2055 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:27:07.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:07 gibba020 bash[25448]: audit 2021-03-10T15:27:06.619503+0000 mon.a (mon.0) 2056 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:27:07.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:07 gibba020 bash[25448]: audit 2021-03-10T15:27:06.619626+0000 mon.a (mon.0) 2057 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:27:09.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:09 gibba013 bash[29418]: cluster 2021-03-10T15:27:08.469336+0000 mgr.gibba020.yqfnwy (mgr.34427) 4983 : cluster [DBG] pgmap v2834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:09.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:09 gibba013 bash[30381]: cluster 2021-03-10T15:27:08.469336+0000 mgr.gibba020.yqfnwy (mgr.34427) 4983 : cluster [DBG] pgmap v2834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:09.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:09 gibba020 bash[25448]: cluster 2021-03-10T15:27:08.469336+0000 mgr.gibba020.yqfnwy (mgr.34427) 4983 : cluster [DBG] pgmap v2834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:11.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:11 gibba013 bash[29418]: cluster 2021-03-10T15:27:10.470831+0000 mgr.gibba020.yqfnwy (mgr.34427) 4984 : cluster [DBG] pgmap v2835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:11.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:11 gibba013 bash[30381]: cluster 2021-03-10T15:27:10.470831+0000 mgr.gibba020.yqfnwy (mgr.34427) 4984 : cluster [DBG] pgmap v2835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:11.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:11 gibba020 bash[25448]: cluster 2021-03-10T15:27:10.470831+0000 mgr.gibba020.yqfnwy (mgr.34427) 4984 : cluster [DBG] pgmap v2835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:13.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:13 gibba020 bash[25448]: cluster 2021-03-10T15:27:12.472133+0000 mgr.gibba020.yqfnwy (mgr.34427) 4985 : cluster [DBG] pgmap v2836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:13.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:13 gibba020 bash[25448]: audit 2021-03-10T15:27:12.634251+0000 mon.a (mon.0) 2058 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:27:13.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:13 gibba020 bash[25448]: cephadm 2021-03-10T15:27:12.639668+0000 mgr.gibba020.yqfnwy (mgr.34427) 4986 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:27:13.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:13 gibba020 bash[25448]: cephadm 2021-03-10T15:27:12.641487+0000 mgr.gibba020.yqfnwy (mgr.34427) 4987 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:27:13.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:13 gibba020 bash[25448]: audit 2021-03-10T15:27:12.872173+0000 mon.a (mon.0) 2059 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:27:13.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:13 gibba020 bash[25448]: cephadm 2021-03-10T15:27:12.874242+0000 mgr.gibba020.yqfnwy (mgr.34427) 4988 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:27:13.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:13 gibba020 bash[25448]: audit 2021-03-10T15:27:12.875797+0000 mon.a (mon.0) 2060 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:27:13.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:13 gibba020 bash[25448]: cephadm 2021-03-10T15:27:12.876257+0000 mgr.gibba020.yqfnwy (mgr.34427) 4989 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:27:13.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:13 gibba020 bash[25448]: audit 2021-03-10T15:27:12.877439+0000 mon.a (mon.0) 2061 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:13.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:13 gibba020 bash[25448]: cephadm 2021-03-10T15:27:12.877815+0000 mgr.gibba020.yqfnwy (mgr.34427) 4990 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:27:13.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:13 gibba020 bash[25448]: cephadm 2021-03-10T15:27:12.877858+0000 mgr.gibba020.yqfnwy (mgr.34427) 4991 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:27:13.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:13 gibba020 bash[25448]: audit 2021-03-10T15:27:12.879054+0000 mon.a (mon.0) 2062 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:13.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:13 gibba020 bash[25448]: cephadm 2021-03-10T15:27:12.879213+0000 mgr.gibba020.yqfnwy (mgr.34427) 4992 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:27:13.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:13 gibba020 bash[25448]: cephadm 2021-03-10T15:27:12.879281+0000 mgr.gibba020.yqfnwy (mgr.34427) 4993 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:27:13.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:13 gibba020 bash[25448]: audit 2021-03-10T15:27:12.880354+0000 mon.a (mon.0) 2063 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:13.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:13 gibba020 bash[25448]: cephadm 2021-03-10T15:27:12.880563+0000 mgr.gibba020.yqfnwy (mgr.34427) 4994 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:27:13.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:13 gibba020 bash[25448]: cephadm 2021-03-10T15:27:12.881758+0000 mgr.gibba020.yqfnwy (mgr.34427) 4995 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:27:13.706 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:13 gibba020 bash[25448]: cephadm 2021-03-10T15:27:12.881802+0000 mgr.gibba020.yqfnwy (mgr.34427) 4996 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:27:13.706 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:13 gibba020 bash[25448]: audit 2021-03-10T15:27:12.882891+0000 mon.a (mon.0) 2064 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:13.706 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:13 gibba020 bash[25448]: cephadm 2021-03-10T15:27:12.882907+0000 mgr.gibba020.yqfnwy (mgr.34427) 4997 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:27:13.706 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:13 gibba020 bash[25448]: cephadm 2021-03-10T15:27:12.883222+0000 mgr.gibba020.yqfnwy (mgr.34427) 4998 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:27:13.707 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:13 gibba020 bash[25448]: audit 2021-03-10T15:27:12.884107+0000 mon.a (mon.0) 2065 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:13.707 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:13 gibba020 bash[25448]: cephadm 2021-03-10T15:27:12.884125+0000 mgr.gibba020.yqfnwy (mgr.34427) 4999 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:27:13.707 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:13 gibba020 bash[25448]: cephadm 2021-03-10T15:27:12.884195+0000 mgr.gibba020.yqfnwy (mgr.34427) 5000 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:27:13.707 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:13 gibba020 bash[25448]: cephadm 2021-03-10T15:27:12.884309+0000 mgr.gibba020.yqfnwy (mgr.34427) 5001 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:27:13.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[29418]: cluster 2021-03-10T15:27:12.472133+0000 mgr.gibba020.yqfnwy (mgr.34427) 4985 : cluster [DBG] pgmap v2836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:13.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[29418]: audit 2021-03-10T15:27:12.634251+0000 mon.a (mon.0) 2058 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:27:13.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[29418]: cephadm 2021-03-10T15:27:12.639668+0000 mgr.gibba020.yqfnwy (mgr.34427) 4986 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:27:13.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[29418]: cephadm 2021-03-10T15:27:12.641487+0000 mgr.gibba020.yqfnwy (mgr.34427) 4987 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:27:13.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[29418]: audit 2021-03-10T15:27:12.872173+0000 mon.a (mon.0) 2059 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:27:13.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[29418]: cephadm 2021-03-10T15:27:12.874242+0000 mgr.gibba020.yqfnwy (mgr.34427) 4988 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:27:13.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[29418]: audit 2021-03-10T15:27:12.875797+0000 mon.a (mon.0) 2060 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:27:13.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[29418]: cephadm 2021-03-10T15:27:12.876257+0000 mgr.gibba020.yqfnwy (mgr.34427) 4989 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:27:13.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[29418]: audit 2021-03-10T15:27:12.877439+0000 mon.a (mon.0) 2061 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:13.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[29418]: cephadm 2021-03-10T15:27:12.877815+0000 mgr.gibba020.yqfnwy (mgr.34427) 4990 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:27:13.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[29418]: cephadm 2021-03-10T15:27:12.877858+0000 mgr.gibba020.yqfnwy (mgr.34427) 4991 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:27:13.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[29418]: audit 2021-03-10T15:27:12.879054+0000 mon.a (mon.0) 2062 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:13.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[29418]: cephadm 2021-03-10T15:27:12.879213+0000 mgr.gibba020.yqfnwy (mgr.34427) 4992 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:27:13.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[29418]: cephadm 2021-03-10T15:27:12.879281+0000 mgr.gibba020.yqfnwy (mgr.34427) 4993 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:27:13.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[29418]: audit 2021-03-10T15:27:12.880354+0000 mon.a (mon.0) 2063 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:13.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[29418]: cephadm 2021-03-10T15:27:12.880563+0000 mgr.gibba020.yqfnwy (mgr.34427) 4994 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:27:13.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[29418]: cephadm 2021-03-10T15:27:12.881758+0000 mgr.gibba020.yqfnwy (mgr.34427) 4995 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:27:13.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[29418]: cephadm 2021-03-10T15:27:12.881802+0000 mgr.gibba020.yqfnwy (mgr.34427) 4996 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:27:13.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[29418]: audit 2021-03-10T15:27:12.882891+0000 mon.a (mon.0) 2064 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:13.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[29418]: cephadm 2021-03-10T15:27:12.882907+0000 mgr.gibba020.yqfnwy (mgr.34427) 4997 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:27:13.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[30381]: cluster 2021-03-10T15:27:12.472133+0000 mgr.gibba020.yqfnwy (mgr.34427) 4985 : cluster [DBG] pgmap v2836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:13.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[30381]: audit 2021-03-10T15:27:12.634251+0000 mon.a (mon.0) 2058 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:27:13.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[30381]: cephadm 2021-03-10T15:27:12.639668+0000 mgr.gibba020.yqfnwy (mgr.34427) 4986 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:27:13.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[30381]: cephadm 2021-03-10T15:27:12.641487+0000 mgr.gibba020.yqfnwy (mgr.34427) 4987 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:27:13.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[30381]: audit 2021-03-10T15:27:12.872173+0000 mon.a (mon.0) 2059 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:27:13.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[30381]: cephadm 2021-03-10T15:27:12.874242+0000 mgr.gibba020.yqfnwy (mgr.34427) 4988 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:27:13.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[30381]: audit 2021-03-10T15:27:12.875797+0000 mon.a (mon.0) 2060 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:27:13.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[30381]: cephadm 2021-03-10T15:27:12.876257+0000 mgr.gibba020.yqfnwy (mgr.34427) 4989 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:27:13.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[30381]: audit 2021-03-10T15:27:12.877439+0000 mon.a (mon.0) 2061 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:13.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[30381]: cephadm 2021-03-10T15:27:12.877815+0000 mgr.gibba020.yqfnwy (mgr.34427) 4990 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:27:13.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[30381]: cephadm 2021-03-10T15:27:12.877858+0000 mgr.gibba020.yqfnwy (mgr.34427) 4991 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:27:13.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[30381]: audit 2021-03-10T15:27:12.879054+0000 mon.a (mon.0) 2062 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:13.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[30381]: cephadm 2021-03-10T15:27:12.879213+0000 mgr.gibba020.yqfnwy (mgr.34427) 4992 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:27:13.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[30381]: cephadm 2021-03-10T15:27:12.879281+0000 mgr.gibba020.yqfnwy (mgr.34427) 4993 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:27:13.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[30381]: audit 2021-03-10T15:27:12.880354+0000 mon.a (mon.0) 2063 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:13.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[30381]: cephadm 2021-03-10T15:27:12.880563+0000 mgr.gibba020.yqfnwy (mgr.34427) 4994 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:27:13.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[30381]: cephadm 2021-03-10T15:27:12.881758+0000 mgr.gibba020.yqfnwy (mgr.34427) 4995 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:27:13.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[30381]: cephadm 2021-03-10T15:27:12.881802+0000 mgr.gibba020.yqfnwy (mgr.34427) 4996 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:27:13.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[30381]: audit 2021-03-10T15:27:12.882891+0000 mon.a (mon.0) 2064 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:13.893 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[30381]: cephadm 2021-03-10T15:27:12.882907+0000 mgr.gibba020.yqfnwy (mgr.34427) 4997 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:27:13.893 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[29418]: cephadm 2021-03-10T15:27:12.883222+0000 mgr.gibba020.yqfnwy (mgr.34427) 4998 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:27:13.893 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[29418]: audit 2021-03-10T15:27:12.884107+0000 mon.a (mon.0) 2065 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:13.894 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[29418]: cephadm 2021-03-10T15:27:12.884125+0000 mgr.gibba020.yqfnwy (mgr.34427) 4999 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:27:13.894 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[29418]: cephadm 2021-03-10T15:27:12.884195+0000 mgr.gibba020.yqfnwy (mgr.34427) 5000 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:27:13.894 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[29418]: cephadm 2021-03-10T15:27:12.884309+0000 mgr.gibba020.yqfnwy (mgr.34427) 5001 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:27:13.894 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[30381]: cephadm 2021-03-10T15:27:12.883222+0000 mgr.gibba020.yqfnwy (mgr.34427) 4998 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:27:13.895 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[30381]: audit 2021-03-10T15:27:12.884107+0000 mon.a (mon.0) 2065 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:13.895 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[30381]: cephadm 2021-03-10T15:27:12.884125+0000 mgr.gibba020.yqfnwy (mgr.34427) 4999 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:27:13.895 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[30381]: cephadm 2021-03-10T15:27:12.884195+0000 mgr.gibba020.yqfnwy (mgr.34427) 5000 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:27:13.895 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:13 gibba013 bash[30381]: cephadm 2021-03-10T15:27:12.884309+0000 mgr.gibba020.yqfnwy (mgr.34427) 5001 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:27:15.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:15 gibba013 bash[29418]: cluster 2021-03-10T15:27:14.473581+0000 mgr.gibba020.yqfnwy (mgr.34427) 5002 : cluster [DBG] pgmap v2837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:15.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:15 gibba013 bash[30381]: cluster 2021-03-10T15:27:14.473581+0000 mgr.gibba020.yqfnwy (mgr.34427) 5002 : cluster [DBG] pgmap v2837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:15.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:15 gibba020 bash[25448]: cluster 2021-03-10T15:27:14.473581+0000 mgr.gibba020.yqfnwy (mgr.34427) 5002 : cluster [DBG] pgmap v2837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:17.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:17 gibba013 bash[29418]: cluster 2021-03-10T15:27:16.475221+0000 mgr.gibba020.yqfnwy (mgr.34427) 5003 : cluster [DBG] pgmap v2838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:17.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:17 gibba013 bash[30381]: cluster 2021-03-10T15:27:16.475221+0000 mgr.gibba020.yqfnwy (mgr.34427) 5003 : cluster [DBG] pgmap v2838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:17.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:17 gibba020 bash[25448]: cluster 2021-03-10T15:27:16.475221+0000 mgr.gibba020.yqfnwy (mgr.34427) 5003 : cluster [DBG] pgmap v2838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:19.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:19 gibba013 bash[29418]: cluster 2021-03-10T15:27:18.476659+0000 mgr.gibba020.yqfnwy (mgr.34427) 5004 : cluster [DBG] pgmap v2839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:19.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:19 gibba013 bash[30381]: cluster 2021-03-10T15:27:18.476659+0000 mgr.gibba020.yqfnwy (mgr.34427) 5004 : cluster [DBG] pgmap v2839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:19.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:19 gibba020 bash[25448]: cluster 2021-03-10T15:27:18.476659+0000 mgr.gibba020.yqfnwy (mgr.34427) 5004 : cluster [DBG] pgmap v2839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:21.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:21 gibba013 bash[29418]: cluster 2021-03-10T15:27:20.478374+0000 mgr.gibba020.yqfnwy (mgr.34427) 5005 : cluster [DBG] pgmap v2840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:21.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:21 gibba013 bash[30381]: cluster 2021-03-10T15:27:20.478374+0000 mgr.gibba020.yqfnwy (mgr.34427) 5005 : cluster [DBG] pgmap v2840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:21.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:21 gibba020 bash[25448]: cluster 2021-03-10T15:27:20.478374+0000 mgr.gibba020.yqfnwy (mgr.34427) 5005 : cluster [DBG] pgmap v2840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:23.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:23 gibba020 bash[25448]: cluster 2021-03-10T15:27:22.479863+0000 mgr.gibba020.yqfnwy (mgr.34427) 5006 : cluster [DBG] pgmap v2841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:23.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:23 gibba013 bash[29418]: cluster 2021-03-10T15:27:22.479863+0000 mgr.gibba020.yqfnwy (mgr.34427) 5006 : cluster [DBG] pgmap v2841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:23.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:23 gibba013 bash[30381]: cluster 2021-03-10T15:27:22.479863+0000 mgr.gibba020.yqfnwy (mgr.34427) 5006 : cluster [DBG] pgmap v2841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:25.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:25 gibba013 bash[29418]: cluster 2021-03-10T15:27:24.481424+0000 mgr.gibba020.yqfnwy (mgr.34427) 5007 : cluster [DBG] pgmap v2842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:25.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:25 gibba013 bash[30381]: cluster 2021-03-10T15:27:24.481424+0000 mgr.gibba020.yqfnwy (mgr.34427) 5007 : cluster [DBG] pgmap v2842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:25.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:25 gibba020 bash[25448]: cluster 2021-03-10T15:27:24.481424+0000 mgr.gibba020.yqfnwy (mgr.34427) 5007 : cluster [DBG] pgmap v2842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:27.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:27 gibba013 bash[29418]: cluster 2021-03-10T15:27:26.483029+0000 mgr.gibba020.yqfnwy (mgr.34427) 5008 : cluster [DBG] pgmap v2843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:27.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:27 gibba013 bash[30381]: cluster 2021-03-10T15:27:26.483029+0000 mgr.gibba020.yqfnwy (mgr.34427) 5008 : cluster [DBG] pgmap v2843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:27.905 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:27 gibba020 bash[25448]: cluster 2021-03-10T15:27:26.483029+0000 mgr.gibba020.yqfnwy (mgr.34427) 5008 : cluster [DBG] pgmap v2843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:28.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:28 gibba013 bash[29418]: cephadm 2021-03-10T15:27:27.900425+0000 mgr.gibba020.yqfnwy (mgr.34427) 5009 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:27:28.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:28 gibba013 bash[30381]: cephadm 2021-03-10T15:27:27.900425+0000 mgr.gibba020.yqfnwy (mgr.34427) 5009 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:27:28.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:28 gibba020 bash[25448]: cephadm 2021-03-10T15:27:27.900425+0000 mgr.gibba020.yqfnwy (mgr.34427) 5009 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:27:29.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:29 gibba013 bash[29418]: cluster 2021-03-10T15:27:28.484602+0000 mgr.gibba020.yqfnwy (mgr.34427) 5010 : cluster [DBG] pgmap v2844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:29.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:29 gibba013 bash[30381]: cluster 2021-03-10T15:27:28.484602+0000 mgr.gibba020.yqfnwy (mgr.34427) 5010 : cluster [DBG] pgmap v2844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:29.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:29 gibba020 bash[25448]: cluster 2021-03-10T15:27:28.484602+0000 mgr.gibba020.yqfnwy (mgr.34427) 5010 : cluster [DBG] pgmap v2844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:31.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:31 gibba013 bash[29418]: cluster 2021-03-10T15:27:30.486245+0000 mgr.gibba020.yqfnwy (mgr.34427) 5011 : cluster [DBG] pgmap v2845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:31.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:31 gibba013 bash[30381]: cluster 2021-03-10T15:27:30.486245+0000 mgr.gibba020.yqfnwy (mgr.34427) 5011 : cluster [DBG] pgmap v2845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:31.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:31 gibba020 bash[25448]: cluster 2021-03-10T15:27:30.486245+0000 mgr.gibba020.yqfnwy (mgr.34427) 5011 : cluster [DBG] pgmap v2845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:33.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:33 gibba020 bash[25448]: cluster 2021-03-10T15:27:32.487315+0000 mgr.gibba020.yqfnwy (mgr.34427) 5012 : cluster [DBG] pgmap v2846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:33.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:33 gibba013 bash[29418]: cluster 2021-03-10T15:27:32.487315+0000 mgr.gibba020.yqfnwy (mgr.34427) 5012 : cluster [DBG] pgmap v2846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:33.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:33 gibba013 bash[30381]: cluster 2021-03-10T15:27:32.487315+0000 mgr.gibba020.yqfnwy (mgr.34427) 5012 : cluster [DBG] pgmap v2846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:34.893 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:27:35.120 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:27:35.121 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (94m) 8m ago 99m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:27:35.121 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (99m) 7m ago 99m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:27:35.121 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (94m) 7m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:27:35.121 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (94m) 7m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:27:35.122 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (93m) 8m ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:27:35.122 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (93m) 8m ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:27:35.122 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (93m) 7m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:27:35.123 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (93m) 8m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:27:35.123 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (99m) 8m ago 99m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:27:35.123 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (99m) 7m ago 99m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:27:35.123 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (92m) 8m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:27:35.123 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (91m) 8m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:27:35.124 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (91m) 8m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:27:35.124 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (91m) 8m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:27:35.124 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (90m) 7m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:27:35.124 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (90m) 7m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:27:35.124 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (89m) 7m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:27:35.125 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (89m) 7m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:27:35.125 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (99m) 7m ago 99m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:27:35.125 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 7m ago 97m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:27:35.366 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:27:35.367 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:27:35.367 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:27:35.367 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:27:35.367 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:27:35.368 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:27:35.368 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:27:35.368 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:27:35.368 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:27:35.368 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:27:35.369 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:27:35.369 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:27:35.369 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:27:35.370 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:27:35.370 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:27:35.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:35 gibba013 bash[29418]: cluster 2021-03-10T15:27:34.488874+0000 mgr.gibba020.yqfnwy (mgr.34427) 5013 : cluster [DBG] pgmap v2847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:35.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:35 gibba013 bash[29418]: audit 2021-03-10T15:27:34.879531+0000 mgr.gibba020.yqfnwy (mgr.34427) 5014 : audit [DBG] from='client.57403 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:27:35.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:35 gibba013 bash[29418]: audit 2021-03-10T15:27:35.104018+0000 mgr.gibba020.yqfnwy (mgr.34427) 5015 : audit [DBG] from='client.47424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:27:35.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:35 gibba013 bash[29418]: audit 2021-03-10T15:27:35.362824+0000 mon.a (mon.0) 2066 : audit [DBG] from='client.? 172.21.2.113:0/835877031' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:35.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:35 gibba013 bash[30381]: cluster 2021-03-10T15:27:34.488874+0000 mgr.gibba020.yqfnwy (mgr.34427) 5013 : cluster [DBG] pgmap v2847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:35.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:35 gibba013 bash[30381]: audit 2021-03-10T15:27:34.879531+0000 mgr.gibba020.yqfnwy (mgr.34427) 5014 : audit [DBG] from='client.57403 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:27:35.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:35 gibba013 bash[30381]: audit 2021-03-10T15:27:35.104018+0000 mgr.gibba020.yqfnwy (mgr.34427) 5015 : audit [DBG] from='client.47424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:27:35.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:35 gibba013 bash[30381]: audit 2021-03-10T15:27:35.362824+0000 mon.a (mon.0) 2066 : audit [DBG] from='client.? 172.21.2.113:0/835877031' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:35.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:35 gibba020 bash[25448]: cluster 2021-03-10T15:27:34.488874+0000 mgr.gibba020.yqfnwy (mgr.34427) 5013 : cluster [DBG] pgmap v2847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:35.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:35 gibba020 bash[25448]: audit 2021-03-10T15:27:34.879531+0000 mgr.gibba020.yqfnwy (mgr.34427) 5014 : audit [DBG] from='client.57403 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:27:35.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:35 gibba020 bash[25448]: audit 2021-03-10T15:27:35.104018+0000 mgr.gibba020.yqfnwy (mgr.34427) 5015 : audit [DBG] from='client.47424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:27:35.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:35 gibba020 bash[25448]: audit 2021-03-10T15:27:35.362824+0000 mon.a (mon.0) 2066 : audit [DBG] from='client.? 172.21.2.113:0/835877031' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:27:37.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:37 gibba013 bash[29418]: cluster 2021-03-10T15:27:36.490614+0000 mgr.gibba020.yqfnwy (mgr.34427) 5016 : cluster [DBG] pgmap v2848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:37.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:37 gibba013 bash[30381]: cluster 2021-03-10T15:27:36.490614+0000 mgr.gibba020.yqfnwy (mgr.34427) 5016 : cluster [DBG] pgmap v2848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:37.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:37 gibba020 bash[25448]: cluster 2021-03-10T15:27:36.490614+0000 mgr.gibba020.yqfnwy (mgr.34427) 5016 : cluster [DBG] pgmap v2848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:39.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:39 gibba013 bash[29418]: cluster 2021-03-10T15:27:38.492294+0000 mgr.gibba020.yqfnwy (mgr.34427) 5017 : cluster [DBG] pgmap v2849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:39.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:39 gibba013 bash[30381]: cluster 2021-03-10T15:27:38.492294+0000 mgr.gibba020.yqfnwy (mgr.34427) 5017 : cluster [DBG] pgmap v2849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:39.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:39 gibba020 bash[25448]: cluster 2021-03-10T15:27:38.492294+0000 mgr.gibba020.yqfnwy (mgr.34427) 5017 : cluster [DBG] pgmap v2849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:41.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:41 gibba013 bash[29418]: cluster 2021-03-10T15:27:40.494028+0000 mgr.gibba020.yqfnwy (mgr.34427) 5018 : cluster [DBG] pgmap v2850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:41.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:41 gibba013 bash[30381]: cluster 2021-03-10T15:27:40.494028+0000 mgr.gibba020.yqfnwy (mgr.34427) 5018 : cluster [DBG] pgmap v2850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:41.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:41 gibba020 bash[25448]: cluster 2021-03-10T15:27:40.494028+0000 mgr.gibba020.yqfnwy (mgr.34427) 5018 : cluster [DBG] pgmap v2850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:43.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:43 gibba020 bash[25448]: cluster 2021-03-10T15:27:42.495601+0000 mgr.gibba020.yqfnwy (mgr.34427) 5019 : cluster [DBG] pgmap v2851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:43.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:43 gibba020 bash[25448]: cephadm 2021-03-10T15:27:42.916489+0000 mgr.gibba020.yqfnwy (mgr.34427) 5020 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:27:43.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:43 gibba013 bash[29418]: cluster 2021-03-10T15:27:42.495601+0000 mgr.gibba020.yqfnwy (mgr.34427) 5019 : cluster [DBG] pgmap v2851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:43.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:43 gibba013 bash[29418]: cephadm 2021-03-10T15:27:42.916489+0000 mgr.gibba020.yqfnwy (mgr.34427) 5020 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:27:43.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:43 gibba013 bash[30381]: cluster 2021-03-10T15:27:42.495601+0000 mgr.gibba020.yqfnwy (mgr.34427) 5019 : cluster [DBG] pgmap v2851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:43.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:43 gibba013 bash[30381]: cephadm 2021-03-10T15:27:42.916489+0000 mgr.gibba020.yqfnwy (mgr.34427) 5020 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:27:45.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:45 gibba013 bash[29418]: cluster 2021-03-10T15:27:44.497113+0000 mgr.gibba020.yqfnwy (mgr.34427) 5021 : cluster [DBG] pgmap v2852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:45.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:45 gibba013 bash[30381]: cluster 2021-03-10T15:27:44.497113+0000 mgr.gibba020.yqfnwy (mgr.34427) 5021 : cluster [DBG] pgmap v2852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:45.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:45 gibba020 bash[25448]: cluster 2021-03-10T15:27:44.497113+0000 mgr.gibba020.yqfnwy (mgr.34427) 5021 : cluster [DBG] pgmap v2852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:47.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:47 gibba013 bash[29418]: cluster 2021-03-10T15:27:46.498958+0000 mgr.gibba020.yqfnwy (mgr.34427) 5022 : cluster [DBG] pgmap v2853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:47.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:47 gibba013 bash[30381]: cluster 2021-03-10T15:27:46.498958+0000 mgr.gibba020.yqfnwy (mgr.34427) 5022 : cluster [DBG] pgmap v2853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:47.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:47 gibba020 bash[25448]: cluster 2021-03-10T15:27:46.498958+0000 mgr.gibba020.yqfnwy (mgr.34427) 5022 : cluster [DBG] pgmap v2853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:49.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:49 gibba013 bash[29418]: cluster 2021-03-10T15:27:48.500365+0000 mgr.gibba020.yqfnwy (mgr.34427) 5023 : cluster [DBG] pgmap v2854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:49.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:49 gibba013 bash[30381]: cluster 2021-03-10T15:27:48.500365+0000 mgr.gibba020.yqfnwy (mgr.34427) 5023 : cluster [DBG] pgmap v2854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:49.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:49 gibba020 bash[25448]: cluster 2021-03-10T15:27:48.500365+0000 mgr.gibba020.yqfnwy (mgr.34427) 5023 : cluster [DBG] pgmap v2854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:51.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:51 gibba013 bash[29418]: cluster 2021-03-10T15:27:50.502121+0000 mgr.gibba020.yqfnwy (mgr.34427) 5024 : cluster [DBG] pgmap v2855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:51.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:51 gibba013 bash[30381]: cluster 2021-03-10T15:27:50.502121+0000 mgr.gibba020.yqfnwy (mgr.34427) 5024 : cluster [DBG] pgmap v2855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:51.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:51 gibba020 bash[25448]: cluster 2021-03-10T15:27:50.502121+0000 mgr.gibba020.yqfnwy (mgr.34427) 5024 : cluster [DBG] pgmap v2855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:53.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:53 gibba020 bash[25448]: cluster 2021-03-10T15:27:52.503228+0000 mgr.gibba020.yqfnwy (mgr.34427) 5025 : cluster [DBG] pgmap v2856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:53.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:53 gibba013 bash[29418]: cluster 2021-03-10T15:27:52.503228+0000 mgr.gibba020.yqfnwy (mgr.34427) 5025 : cluster [DBG] pgmap v2856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:53.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:53 gibba013 bash[30381]: cluster 2021-03-10T15:27:52.503228+0000 mgr.gibba020.yqfnwy (mgr.34427) 5025 : cluster [DBG] pgmap v2856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:55.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:55 gibba013 bash[29418]: cluster 2021-03-10T15:27:54.504715+0000 mgr.gibba020.yqfnwy (mgr.34427) 5026 : cluster [DBG] pgmap v2857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:55.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:55 gibba013 bash[30381]: cluster 2021-03-10T15:27:54.504715+0000 mgr.gibba020.yqfnwy (mgr.34427) 5026 : cluster [DBG] pgmap v2857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:55.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:55 gibba020 bash[25448]: cluster 2021-03-10T15:27:54.504715+0000 mgr.gibba020.yqfnwy (mgr.34427) 5026 : cluster [DBG] pgmap v2857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:57.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:57 gibba013 bash[29418]: cluster 2021-03-10T15:27:56.506527+0000 mgr.gibba020.yqfnwy (mgr.34427) 5027 : cluster [DBG] pgmap v2858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:57.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:57 gibba013 bash[30381]: cluster 2021-03-10T15:27:56.506527+0000 mgr.gibba020.yqfnwy (mgr.34427) 5027 : cluster [DBG] pgmap v2858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:57.937 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:57 gibba020 bash[25448]: cluster 2021-03-10T15:27:56.506527+0000 mgr.gibba020.yqfnwy (mgr.34427) 5027 : cluster [DBG] pgmap v2858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:58.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:58 gibba013 bash[29418]: cephadm 2021-03-10T15:27:57.932560+0000 mgr.gibba020.yqfnwy (mgr.34427) 5028 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:27:58.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:58 gibba013 bash[30381]: cephadm 2021-03-10T15:27:57.932560+0000 mgr.gibba020.yqfnwy (mgr.34427) 5028 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:27:58.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:58 gibba020 bash[25448]: cephadm 2021-03-10T15:27:57.932560+0000 mgr.gibba020.yqfnwy (mgr.34427) 5028 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:27:59.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:27:59 gibba013 bash[29418]: cluster 2021-03-10T15:27:58.508353+0000 mgr.gibba020.yqfnwy (mgr.34427) 5029 : cluster [DBG] pgmap v2859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:59.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:27:59 gibba013 bash[30381]: cluster 2021-03-10T15:27:58.508353+0000 mgr.gibba020.yqfnwy (mgr.34427) 5029 : cluster [DBG] pgmap v2859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:27:59.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:27:59 gibba020 bash[25448]: cluster 2021-03-10T15:27:58.508353+0000 mgr.gibba020.yqfnwy (mgr.34427) 5029 : cluster [DBG] pgmap v2859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:01.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:01 gibba013 bash[29418]: cluster 2021-03-10T15:28:00.510085+0000 mgr.gibba020.yqfnwy (mgr.34427) 5030 : cluster [DBG] pgmap v2860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:01.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:01 gibba013 bash[30381]: cluster 2021-03-10T15:28:00.510085+0000 mgr.gibba020.yqfnwy (mgr.34427) 5030 : cluster [DBG] pgmap v2860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:01.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:01 gibba020 bash[25448]: cluster 2021-03-10T15:28:00.510085+0000 mgr.gibba020.yqfnwy (mgr.34427) 5030 : cluster [DBG] pgmap v2860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:03.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:03 gibba020 bash[25448]: cluster 2021-03-10T15:28:02.511866+0000 mgr.gibba020.yqfnwy (mgr.34427) 5031 : cluster [DBG] pgmap v2861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:03.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:03 gibba013 bash[29418]: cluster 2021-03-10T15:28:02.511866+0000 mgr.gibba020.yqfnwy (mgr.34427) 5031 : cluster [DBG] pgmap v2861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:03.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:03 gibba013 bash[30381]: cluster 2021-03-10T15:28:02.511866+0000 mgr.gibba020.yqfnwy (mgr.34427) 5031 : cluster [DBG] pgmap v2861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:05.608 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:28:05.839 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:28:05.840 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (94m) 9m ago 99m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:28:05.840 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (99m) 8m ago 99m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:28:05.840 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (95m) 8m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:28:05.841 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (95m) 8m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:28:05.841 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (94m) 9m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:28:05.841 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (94m) 9m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:28:05.841 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (93m) 8m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:28:05.842 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (93m) 9m ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:28:05.842 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (100m) 9m ago 100m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:28:05.842 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (100m) 8m ago 100m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:28:05.842 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (92m) 9m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:28:05.843 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (92m) 9m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:28:05.843 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (92m) 9m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:28:05.843 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (91m) 9m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:28:05.843 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (91m) 8m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:28:05.844 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (90m) 8m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:28:05.844 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (90m) 8m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:28:05.844 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (89m) 8m ago 100m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:28:05.844 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (99m) 8m ago 100m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:28:05.845 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 8m ago 98m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:28:05.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:05 gibba013 bash[29418]: cluster 2021-03-10T15:28:04.513420+0000 mgr.gibba020.yqfnwy (mgr.34427) 5032 : cluster [DBG] pgmap v2862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:05.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:05 gibba013 bash[30381]: cluster 2021-03-10T15:28:04.513420+0000 mgr.gibba020.yqfnwy (mgr.34427) 5032 : cluster [DBG] pgmap v2862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:05.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:05 gibba020 bash[25448]: cluster 2021-03-10T15:28:04.513420+0000 mgr.gibba020.yqfnwy (mgr.34427) 5032 : cluster [DBG] pgmap v2862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:06.087 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:28:06.087 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:28:06.088 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:28:06.088 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:28:06.088 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:28:06.088 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:28:06.089 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:28:06.089 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:28:06.089 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:28:06.089 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:28:06.090 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:28:06.090 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:28:06.090 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:28:06.090 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:28:06.091 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:28:06.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:06 gibba013 bash[29418]: audit 2021-03-10T15:28:05.596499+0000 mgr.gibba020.yqfnwy (mgr.34427) 5033 : audit [DBG] from='client.57421 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:28:06.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:06 gibba013 bash[29418]: audit 2021-03-10T15:28:05.822371+0000 mgr.gibba020.yqfnwy (mgr.34427) 5034 : audit [DBG] from='client.47442 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:28:06.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:06 gibba013 bash[29418]: audit 2021-03-10T15:28:06.083814+0000 mon.a (mon.0) 2067 : audit [DBG] from='client.? 172.21.2.113:0/2921019694' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:06.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:06 gibba013 bash[29418]: audit 2021-03-10T15:28:06.449407+0000 mon.a (mon.0) 2068 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:28:06.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:06 gibba013 bash[29418]: audit 2021-03-10T15:28:06.509404+0000 mon.a (mon.0) 2069 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:28:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:06 gibba013 bash[30381]: audit 2021-03-10T15:28:05.596499+0000 mgr.gibba020.yqfnwy (mgr.34427) 5033 : audit [DBG] from='client.57421 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:28:06.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:06 gibba013 bash[30381]: audit 2021-03-10T15:28:05.822371+0000 mgr.gibba020.yqfnwy (mgr.34427) 5034 : audit [DBG] from='client.47442 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:28:06.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:06 gibba013 bash[30381]: audit 2021-03-10T15:28:06.083814+0000 mon.a (mon.0) 2067 : audit [DBG] from='client.? 172.21.2.113:0/2921019694' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:06.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:06 gibba013 bash[30381]: audit 2021-03-10T15:28:06.449407+0000 mon.a (mon.0) 2068 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:28:06.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:06 gibba013 bash[30381]: audit 2021-03-10T15:28:06.509404+0000 mon.a (mon.0) 2069 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:28:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:06 gibba020 bash[25448]: audit 2021-03-10T15:28:05.596499+0000 mgr.gibba020.yqfnwy (mgr.34427) 5033 : audit [DBG] from='client.57421 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:28:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:06 gibba020 bash[25448]: audit 2021-03-10T15:28:05.822371+0000 mgr.gibba020.yqfnwy (mgr.34427) 5034 : audit [DBG] from='client.47442 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:28:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:06 gibba020 bash[25448]: audit 2021-03-10T15:28:06.083814+0000 mon.a (mon.0) 2067 : audit [DBG] from='client.? 172.21.2.113:0/2921019694' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:06 gibba020 bash[25448]: audit 2021-03-10T15:28:06.449407+0000 mon.a (mon.0) 2068 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:28:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:06 gibba020 bash[25448]: audit 2021-03-10T15:28:06.509404+0000 mon.a (mon.0) 2069 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:28:07.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:07 gibba013 bash[29418]: cluster 2021-03-10T15:28:06.515052+0000 mgr.gibba020.yqfnwy (mgr.34427) 5035 : cluster [DBG] pgmap v2863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:07.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:07 gibba013 bash[29418]: audit 2021-03-10T15:28:06.626791+0000 mon.a (mon.0) 2070 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:28:07.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:07 gibba013 bash[29418]: audit 2021-03-10T15:28:06.626952+0000 mon.a (mon.0) 2071 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:28:07.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:07 gibba013 bash[29418]: audit 2021-03-10T15:28:06.627079+0000 mon.a (mon.0) 2072 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:28:07.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:07 gibba013 bash[29418]: audit 2021-03-10T15:28:06.627212+0000 mon.a (mon.0) 2073 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:28:07.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:07 gibba013 bash[30381]: cluster 2021-03-10T15:28:06.515052+0000 mgr.gibba020.yqfnwy (mgr.34427) 5035 : cluster [DBG] pgmap v2863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:07.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:07 gibba013 bash[30381]: audit 2021-03-10T15:28:06.626791+0000 mon.a (mon.0) 2070 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:28:07.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:07 gibba013 bash[30381]: audit 2021-03-10T15:28:06.626952+0000 mon.a (mon.0) 2071 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:28:07.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:07 gibba013 bash[30381]: audit 2021-03-10T15:28:06.627079+0000 mon.a (mon.0) 2072 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:28:07.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:07 gibba013 bash[30381]: audit 2021-03-10T15:28:06.627212+0000 mon.a (mon.0) 2073 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:28:07.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:07 gibba020 bash[25448]: cluster 2021-03-10T15:28:06.515052+0000 mgr.gibba020.yqfnwy (mgr.34427) 5035 : cluster [DBG] pgmap v2863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:07.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:07 gibba020 bash[25448]: audit 2021-03-10T15:28:06.626791+0000 mon.a (mon.0) 2070 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:28:07.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:07 gibba020 bash[25448]: audit 2021-03-10T15:28:06.626952+0000 mon.a (mon.0) 2071 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:28:07.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:07 gibba020 bash[25448]: audit 2021-03-10T15:28:06.627079+0000 mon.a (mon.0) 2072 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:28:07.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:07 gibba020 bash[25448]: audit 2021-03-10T15:28:06.627212+0000 mon.a (mon.0) 2073 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:28:09.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:09 gibba013 bash[29418]: cluster 2021-03-10T15:28:08.516649+0000 mgr.gibba020.yqfnwy (mgr.34427) 5036 : cluster [DBG] pgmap v2864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:09.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:09 gibba013 bash[30381]: cluster 2021-03-10T15:28:08.516649+0000 mgr.gibba020.yqfnwy (mgr.34427) 5036 : cluster [DBG] pgmap v2864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:09.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:09 gibba020 bash[25448]: cluster 2021-03-10T15:28:08.516649+0000 mgr.gibba020.yqfnwy (mgr.34427) 5036 : cluster [DBG] pgmap v2864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:11.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:11 gibba013 bash[29418]: cluster 2021-03-10T15:28:10.518126+0000 mgr.gibba020.yqfnwy (mgr.34427) 5037 : cluster [DBG] pgmap v2865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:11.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:11 gibba013 bash[30381]: cluster 2021-03-10T15:28:10.518126+0000 mgr.gibba020.yqfnwy (mgr.34427) 5037 : cluster [DBG] pgmap v2865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:11.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:11 gibba020 bash[25448]: cluster 2021-03-10T15:28:10.518126+0000 mgr.gibba020.yqfnwy (mgr.34427) 5037 : cluster [DBG] pgmap v2865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:13.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:13 gibba020 bash[25448]: cluster 2021-03-10T15:28:12.519746+0000 mgr.gibba020.yqfnwy (mgr.34427) 5038 : cluster [DBG] pgmap v2866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:13.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:13 gibba020 bash[25448]: audit 2021-03-10T15:28:12.950054+0000 mon.a (mon.0) 2074 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:28:13.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:13 gibba020 bash[25448]: cephadm 2021-03-10T15:28:12.955014+0000 mgr.gibba020.yqfnwy (mgr.34427) 5039 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:28:13.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:13 gibba020 bash[25448]: cephadm 2021-03-10T15:28:12.956811+0000 mgr.gibba020.yqfnwy (mgr.34427) 5040 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:28:13.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:13 gibba020 bash[25448]: audit 2021-03-10T15:28:13.186107+0000 mon.a (mon.0) 2075 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:28:13.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:13 gibba020 bash[25448]: cephadm 2021-03-10T15:28:13.198329+0000 mgr.gibba020.yqfnwy (mgr.34427) 5041 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:28:13.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:13 gibba020 bash[25448]: audit 2021-03-10T15:28:13.201951+0000 mon.a (mon.0) 2076 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:28:13.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:13 gibba020 bash[25448]: cephadm 2021-03-10T15:28:13.204568+0000 mgr.gibba020.yqfnwy (mgr.34427) 5042 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:28:13.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:13 gibba020 bash[25448]: audit 2021-03-10T15:28:13.206522+0000 mon.a (mon.0) 2077 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:13.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:13 gibba020 bash[25448]: cephadm 2021-03-10T15:28:13.208314+0000 mgr.gibba020.yqfnwy (mgr.34427) 5043 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:28:13.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:13 gibba020 bash[25448]: cephadm 2021-03-10T15:28:13.208903+0000 mgr.gibba020.yqfnwy (mgr.34427) 5044 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:28:13.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:13 gibba020 bash[25448]: audit 2021-03-10T15:28:13.210788+0000 mon.a (mon.0) 2078 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:13.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:13 gibba020 bash[25448]: cephadm 2021-03-10T15:28:13.212256+0000 mgr.gibba020.yqfnwy (mgr.34427) 5045 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:28:13.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:13 gibba020 bash[25448]: cephadm 2021-03-10T15:28:13.212529+0000 mgr.gibba020.yqfnwy (mgr.34427) 5046 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:28:13.706 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:13 gibba020 bash[25448]: audit 2021-03-10T15:28:13.213973+0000 mon.a (mon.0) 2079 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:13.706 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:13 gibba020 bash[25448]: cephadm 2021-03-10T15:28:13.215308+0000 mgr.gibba020.yqfnwy (mgr.34427) 5047 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:28:13.706 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:13 gibba020 bash[25448]: cephadm 2021-03-10T15:28:13.218071+0000 mgr.gibba020.yqfnwy (mgr.34427) 5048 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:28:13.706 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:13 gibba020 bash[25448]: cephadm 2021-03-10T15:28:13.218349+0000 mgr.gibba020.yqfnwy (mgr.34427) 5049 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:28:13.706 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:13 gibba020 bash[25448]: audit 2021-03-10T15:28:13.220660+0000 mon.a (mon.0) 2080 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:13.707 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:13 gibba020 bash[25448]: cephadm 2021-03-10T15:28:13.222022+0000 mgr.gibba020.yqfnwy (mgr.34427) 5050 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:28:13.707 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:13 gibba020 bash[25448]: cephadm 2021-03-10T15:28:13.224105+0000 mgr.gibba020.yqfnwy (mgr.34427) 5051 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:28:13.707 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:13 gibba020 bash[25448]: audit 2021-03-10T15:28:13.225534+0000 mon.a (mon.0) 2081 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:13.707 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:13 gibba020 bash[25448]: cephadm 2021-03-10T15:28:13.226941+0000 mgr.gibba020.yqfnwy (mgr.34427) 5052 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:28:13.707 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:13 gibba020 bash[25448]: cephadm 2021-03-10T15:28:13.227219+0000 mgr.gibba020.yqfnwy (mgr.34427) 5053 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:28:13.708 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:13 gibba020 bash[25448]: cephadm 2021-03-10T15:28:13.227819+0000 mgr.gibba020.yqfnwy (mgr.34427) 5054 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:28:13.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[29418]: cluster 2021-03-10T15:28:12.519746+0000 mgr.gibba020.yqfnwy (mgr.34427) 5038 : cluster [DBG] pgmap v2866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:13.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[29418]: audit 2021-03-10T15:28:12.950054+0000 mon.a (mon.0) 2074 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:28:13.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[29418]: cephadm 2021-03-10T15:28:12.955014+0000 mgr.gibba020.yqfnwy (mgr.34427) 5039 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:28:13.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[29418]: cephadm 2021-03-10T15:28:12.956811+0000 mgr.gibba020.yqfnwy (mgr.34427) 5040 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:28:13.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[29418]: audit 2021-03-10T15:28:13.186107+0000 mon.a (mon.0) 2075 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:28:13.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[29418]: cephadm 2021-03-10T15:28:13.198329+0000 mgr.gibba020.yqfnwy (mgr.34427) 5041 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:28:13.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[29418]: audit 2021-03-10T15:28:13.201951+0000 mon.a (mon.0) 2076 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:28:13.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[29418]: cephadm 2021-03-10T15:28:13.204568+0000 mgr.gibba020.yqfnwy (mgr.34427) 5042 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:28:13.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[29418]: audit 2021-03-10T15:28:13.206522+0000 mon.a (mon.0) 2077 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:13.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[29418]: cephadm 2021-03-10T15:28:13.208314+0000 mgr.gibba020.yqfnwy (mgr.34427) 5043 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:28:13.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[29418]: cephadm 2021-03-10T15:28:13.208903+0000 mgr.gibba020.yqfnwy (mgr.34427) 5044 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:28:13.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[29418]: audit 2021-03-10T15:28:13.210788+0000 mon.a (mon.0) 2078 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:13.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[29418]: cephadm 2021-03-10T15:28:13.212256+0000 mgr.gibba020.yqfnwy (mgr.34427) 5045 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:28:13.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[29418]: cephadm 2021-03-10T15:28:13.212529+0000 mgr.gibba020.yqfnwy (mgr.34427) 5046 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:28:13.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[29418]: audit 2021-03-10T15:28:13.213973+0000 mon.a (mon.0) 2079 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:13.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[29418]: cephadm 2021-03-10T15:28:13.215308+0000 mgr.gibba020.yqfnwy (mgr.34427) 5047 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:28:13.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[29418]: cephadm 2021-03-10T15:28:13.218071+0000 mgr.gibba020.yqfnwy (mgr.34427) 5048 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:28:13.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[29418]: cephadm 2021-03-10T15:28:13.218349+0000 mgr.gibba020.yqfnwy (mgr.34427) 5049 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:28:13.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[29418]: audit 2021-03-10T15:28:13.220660+0000 mon.a (mon.0) 2080 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:13.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[29418]: cephadm 2021-03-10T15:28:13.222022+0000 mgr.gibba020.yqfnwy (mgr.34427) 5050 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:28:13.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[30381]: cluster 2021-03-10T15:28:12.519746+0000 mgr.gibba020.yqfnwy (mgr.34427) 5038 : cluster [DBG] pgmap v2866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:13.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[30381]: audit 2021-03-10T15:28:12.950054+0000 mon.a (mon.0) 2074 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:28:13.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[30381]: cephadm 2021-03-10T15:28:12.955014+0000 mgr.gibba020.yqfnwy (mgr.34427) 5039 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:28:13.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[30381]: cephadm 2021-03-10T15:28:12.956811+0000 mgr.gibba020.yqfnwy (mgr.34427) 5040 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:28:13.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[30381]: audit 2021-03-10T15:28:13.186107+0000 mon.a (mon.0) 2075 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:28:13.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[30381]: cephadm 2021-03-10T15:28:13.198329+0000 mgr.gibba020.yqfnwy (mgr.34427) 5041 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:28:13.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[30381]: audit 2021-03-10T15:28:13.201951+0000 mon.a (mon.0) 2076 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:28:13.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[30381]: cephadm 2021-03-10T15:28:13.204568+0000 mgr.gibba020.yqfnwy (mgr.34427) 5042 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:28:13.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[30381]: audit 2021-03-10T15:28:13.206522+0000 mon.a (mon.0) 2077 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:13.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[30381]: cephadm 2021-03-10T15:28:13.208314+0000 mgr.gibba020.yqfnwy (mgr.34427) 5043 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:28:13.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[30381]: cephadm 2021-03-10T15:28:13.208903+0000 mgr.gibba020.yqfnwy (mgr.34427) 5044 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:28:13.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[30381]: audit 2021-03-10T15:28:13.210788+0000 mon.a (mon.0) 2078 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:13.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[30381]: cephadm 2021-03-10T15:28:13.212256+0000 mgr.gibba020.yqfnwy (mgr.34427) 5045 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:28:13.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[30381]: cephadm 2021-03-10T15:28:13.212529+0000 mgr.gibba020.yqfnwy (mgr.34427) 5046 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:28:13.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[30381]: audit 2021-03-10T15:28:13.213973+0000 mon.a (mon.0) 2079 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:13.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[30381]: cephadm 2021-03-10T15:28:13.215308+0000 mgr.gibba020.yqfnwy (mgr.34427) 5047 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:28:13.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[30381]: cephadm 2021-03-10T15:28:13.218071+0000 mgr.gibba020.yqfnwy (mgr.34427) 5048 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:28:13.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[30381]: cephadm 2021-03-10T15:28:13.218349+0000 mgr.gibba020.yqfnwy (mgr.34427) 5049 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:28:13.893 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[30381]: audit 2021-03-10T15:28:13.220660+0000 mon.a (mon.0) 2080 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:13.893 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[30381]: cephadm 2021-03-10T15:28:13.222022+0000 mgr.gibba020.yqfnwy (mgr.34427) 5050 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:28:13.893 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[29418]: cephadm 2021-03-10T15:28:13.224105+0000 mgr.gibba020.yqfnwy (mgr.34427) 5051 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:28:13.893 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[29418]: audit 2021-03-10T15:28:13.225534+0000 mon.a (mon.0) 2081 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:13.894 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[29418]: cephadm 2021-03-10T15:28:13.226941+0000 mgr.gibba020.yqfnwy (mgr.34427) 5052 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:28:13.894 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[29418]: cephadm 2021-03-10T15:28:13.227219+0000 mgr.gibba020.yqfnwy (mgr.34427) 5053 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:28:13.894 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[29418]: cephadm 2021-03-10T15:28:13.227819+0000 mgr.gibba020.yqfnwy (mgr.34427) 5054 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:28:13.894 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[30381]: cephadm 2021-03-10T15:28:13.224105+0000 mgr.gibba020.yqfnwy (mgr.34427) 5051 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:28:13.895 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[30381]: audit 2021-03-10T15:28:13.225534+0000 mon.a (mon.0) 2081 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:13.895 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[30381]: cephadm 2021-03-10T15:28:13.226941+0000 mgr.gibba020.yqfnwy (mgr.34427) 5052 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:28:13.895 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[30381]: cephadm 2021-03-10T15:28:13.227219+0000 mgr.gibba020.yqfnwy (mgr.34427) 5053 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:28:13.895 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:13 gibba013 bash[30381]: cephadm 2021-03-10T15:28:13.227819+0000 mgr.gibba020.yqfnwy (mgr.34427) 5054 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:28:15.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:15 gibba013 bash[29418]: cluster 2021-03-10T15:28:14.521259+0000 mgr.gibba020.yqfnwy (mgr.34427) 5055 : cluster [DBG] pgmap v2867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:15.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:15 gibba013 bash[30381]: cluster 2021-03-10T15:28:14.521259+0000 mgr.gibba020.yqfnwy (mgr.34427) 5055 : cluster [DBG] pgmap v2867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:15.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:15 gibba020 bash[25448]: cluster 2021-03-10T15:28:14.521259+0000 mgr.gibba020.yqfnwy (mgr.34427) 5055 : cluster [DBG] pgmap v2867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:17.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:17 gibba013 bash[29418]: cluster 2021-03-10T15:28:16.523177+0000 mgr.gibba020.yqfnwy (mgr.34427) 5056 : cluster [DBG] pgmap v2868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:17.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:17 gibba013 bash[30381]: cluster 2021-03-10T15:28:16.523177+0000 mgr.gibba020.yqfnwy (mgr.34427) 5056 : cluster [DBG] pgmap v2868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:17.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:17 gibba020 bash[25448]: cluster 2021-03-10T15:28:16.523177+0000 mgr.gibba020.yqfnwy (mgr.34427) 5056 : cluster [DBG] pgmap v2868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:19.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:19 gibba013 bash[29418]: cluster 2021-03-10T15:28:18.524566+0000 mgr.gibba020.yqfnwy (mgr.34427) 5057 : cluster [DBG] pgmap v2869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:19.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:19 gibba013 bash[30381]: cluster 2021-03-10T15:28:18.524566+0000 mgr.gibba020.yqfnwy (mgr.34427) 5057 : cluster [DBG] pgmap v2869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:19.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:19 gibba020 bash[25448]: cluster 2021-03-10T15:28:18.524566+0000 mgr.gibba020.yqfnwy (mgr.34427) 5057 : cluster [DBG] pgmap v2869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:21.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:21 gibba013 bash[29418]: cluster 2021-03-10T15:28:20.526162+0000 mgr.gibba020.yqfnwy (mgr.34427) 5058 : cluster [DBG] pgmap v2870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:21.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:21 gibba013 bash[30381]: cluster 2021-03-10T15:28:20.526162+0000 mgr.gibba020.yqfnwy (mgr.34427) 5058 : cluster [DBG] pgmap v2870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:21.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:21 gibba020 bash[25448]: cluster 2021-03-10T15:28:20.526162+0000 mgr.gibba020.yqfnwy (mgr.34427) 5058 : cluster [DBG] pgmap v2870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:23.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:23 gibba020 bash[25448]: cluster 2021-03-10T15:28:22.527737+0000 mgr.gibba020.yqfnwy (mgr.34427) 5059 : cluster [DBG] pgmap v2871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:23.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:23 gibba013 bash[29418]: cluster 2021-03-10T15:28:22.527737+0000 mgr.gibba020.yqfnwy (mgr.34427) 5059 : cluster [DBG] pgmap v2871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:23.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:23 gibba013 bash[30381]: cluster 2021-03-10T15:28:22.527737+0000 mgr.gibba020.yqfnwy (mgr.34427) 5059 : cluster [DBG] pgmap v2871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:25.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:25 gibba013 bash[29418]: cluster 2021-03-10T15:28:24.529312+0000 mgr.gibba020.yqfnwy (mgr.34427) 5060 : cluster [DBG] pgmap v2872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:25.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:25 gibba013 bash[30381]: cluster 2021-03-10T15:28:24.529312+0000 mgr.gibba020.yqfnwy (mgr.34427) 5060 : cluster [DBG] pgmap v2872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:25.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:25 gibba020 bash[25448]: cluster 2021-03-10T15:28:24.529312+0000 mgr.gibba020.yqfnwy (mgr.34427) 5060 : cluster [DBG] pgmap v2872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:27.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:27 gibba013 bash[29418]: cluster 2021-03-10T15:28:26.531129+0000 mgr.gibba020.yqfnwy (mgr.34427) 5061 : cluster [DBG] pgmap v2873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:27.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:27 gibba013 bash[30381]: cluster 2021-03-10T15:28:26.531129+0000 mgr.gibba020.yqfnwy (mgr.34427) 5061 : cluster [DBG] pgmap v2873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:27.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:27 gibba020 bash[25448]: cluster 2021-03-10T15:28:26.531129+0000 mgr.gibba020.yqfnwy (mgr.34427) 5061 : cluster [DBG] pgmap v2873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:28.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:28 gibba013 bash[29418]: cephadm 2021-03-10T15:28:28.240732+0000 mgr.gibba020.yqfnwy (mgr.34427) 5062 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:28:28.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:28 gibba013 bash[30381]: cephadm 2021-03-10T15:28:28.240732+0000 mgr.gibba020.yqfnwy (mgr.34427) 5062 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:28:28.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:28 gibba020 bash[25448]: cephadm 2021-03-10T15:28:28.240732+0000 mgr.gibba020.yqfnwy (mgr.34427) 5062 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:28:29.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:29 gibba013 bash[29418]: cluster 2021-03-10T15:28:28.532660+0000 mgr.gibba020.yqfnwy (mgr.34427) 5063 : cluster [DBG] pgmap v2874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:29.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:29 gibba013 bash[30381]: cluster 2021-03-10T15:28:28.532660+0000 mgr.gibba020.yqfnwy (mgr.34427) 5063 : cluster [DBG] pgmap v2874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:29.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:29 gibba020 bash[25448]: cluster 2021-03-10T15:28:28.532660+0000 mgr.gibba020.yqfnwy (mgr.34427) 5063 : cluster [DBG] pgmap v2874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:31.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:31 gibba013 bash[29418]: cluster 2021-03-10T15:28:30.534170+0000 mgr.gibba020.yqfnwy (mgr.34427) 5064 : cluster [DBG] pgmap v2875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:31.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:31 gibba013 bash[30381]: cluster 2021-03-10T15:28:30.534170+0000 mgr.gibba020.yqfnwy (mgr.34427) 5064 : cluster [DBG] pgmap v2875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:31.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:31 gibba020 bash[25448]: cluster 2021-03-10T15:28:30.534170+0000 mgr.gibba020.yqfnwy (mgr.34427) 5064 : cluster [DBG] pgmap v2875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:33.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:33 gibba013 bash[29418]: cluster 2021-03-10T15:28:32.535614+0000 mgr.gibba020.yqfnwy (mgr.34427) 5065 : cluster [DBG] pgmap v2876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:33.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:33 gibba013 bash[30381]: cluster 2021-03-10T15:28:32.535614+0000 mgr.gibba020.yqfnwy (mgr.34427) 5065 : cluster [DBG] pgmap v2876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:33.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:33 gibba020 bash[25448]: cluster 2021-03-10T15:28:32.535614+0000 mgr.gibba020.yqfnwy (mgr.34427) 5065 : cluster [DBG] pgmap v2876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:35.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:35 gibba013 bash[29418]: cluster 2021-03-10T15:28:34.536905+0000 mgr.gibba020.yqfnwy (mgr.34427) 5066 : cluster [DBG] pgmap v2877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:35.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:35 gibba013 bash[30381]: cluster 2021-03-10T15:28:34.536905+0000 mgr.gibba020.yqfnwy (mgr.34427) 5066 : cluster [DBG] pgmap v2877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:35.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:35 gibba020 bash[25448]: cluster 2021-03-10T15:28:34.536905+0000 mgr.gibba020.yqfnwy (mgr.34427) 5066 : cluster [DBG] pgmap v2877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:36.331 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:28:36.558 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:28:36.558 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (95m) 9m ago 100m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:28:36.558 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (100m) 8m ago 100m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:28:36.559 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (95m) 8m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:28:36.559 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (95m) 8m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:28:36.559 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (94m) 9m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:28:36.559 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (94m) 9m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:28:36.559 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (94m) 8m ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:28:36.560 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (94m) 9m ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:28:36.560 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (100m) 9m ago 100m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:28:36.560 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (100m) 8m ago 100m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:28:36.560 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (93m) 9m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:28:36.560 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (92m) 9m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:28:36.561 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (92m) 9m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:28:36.561 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (92m) 9m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:28:36.561 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (91m) 8m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:28:36.561 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (91m) 8m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:28:36.562 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (90m) 8m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:28:36.562 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (90m) 8m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:28:36.562 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (100m) 8m ago 100m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:28:36.562 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 8m ago 98m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:28:36.814 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:28:36.815 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:28:36.815 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:28:36.815 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:28:36.816 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:28:36.816 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:28:36.816 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:28:36.816 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:28:36.816 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:28:36.817 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:28:36.817 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:28:36.817 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:28:36.817 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:28:36.818 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:28:36.818 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:28:37.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:37 gibba013 bash[29418]: audit 2021-03-10T15:28:36.317819+0000 mgr.gibba020.yqfnwy (mgr.34427) 5067 : audit [DBG] from='client.57439 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:28:37.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:37 gibba013 bash[29418]: cluster 2021-03-10T15:28:36.538545+0000 mgr.gibba020.yqfnwy (mgr.34427) 5068 : cluster [DBG] pgmap v2878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:37.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:37 gibba013 bash[29418]: audit 2021-03-10T15:28:36.540913+0000 mgr.gibba020.yqfnwy (mgr.34427) 5069 : audit [DBG] from='client.47460 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:28:37.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:37 gibba013 bash[29418]: audit 2021-03-10T15:28:36.811030+0000 mon.a (mon.0) 2082 : audit [DBG] from='client.? 172.21.2.113:0/2235700598' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:37.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:37 gibba013 bash[30381]: audit 2021-03-10T15:28:36.317819+0000 mgr.gibba020.yqfnwy (mgr.34427) 5067 : audit [DBG] from='client.57439 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:28:37.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:37 gibba013 bash[30381]: cluster 2021-03-10T15:28:36.538545+0000 mgr.gibba020.yqfnwy (mgr.34427) 5068 : cluster [DBG] pgmap v2878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:37.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:37 gibba013 bash[30381]: audit 2021-03-10T15:28:36.540913+0000 mgr.gibba020.yqfnwy (mgr.34427) 5069 : audit [DBG] from='client.47460 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:28:37.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:37 gibba013 bash[30381]: audit 2021-03-10T15:28:36.811030+0000 mon.a (mon.0) 2082 : audit [DBG] from='client.? 172.21.2.113:0/2235700598' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:37.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:37 gibba020 bash[25448]: audit 2021-03-10T15:28:36.317819+0000 mgr.gibba020.yqfnwy (mgr.34427) 5067 : audit [DBG] from='client.57439 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:28:37.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:37 gibba020 bash[25448]: cluster 2021-03-10T15:28:36.538545+0000 mgr.gibba020.yqfnwy (mgr.34427) 5068 : cluster [DBG] pgmap v2878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:37.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:37 gibba020 bash[25448]: audit 2021-03-10T15:28:36.540913+0000 mgr.gibba020.yqfnwy (mgr.34427) 5069 : audit [DBG] from='client.47460 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:28:37.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:37 gibba020 bash[25448]: audit 2021-03-10T15:28:36.811030+0000 mon.a (mon.0) 2082 : audit [DBG] from='client.? 172.21.2.113:0/2235700598' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:28:39.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:39 gibba013 bash[29418]: cluster 2021-03-10T15:28:38.540067+0000 mgr.gibba020.yqfnwy (mgr.34427) 5070 : cluster [DBG] pgmap v2879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:39.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:39 gibba013 bash[30381]: cluster 2021-03-10T15:28:38.540067+0000 mgr.gibba020.yqfnwy (mgr.34427) 5070 : cluster [DBG] pgmap v2879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:39.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:39 gibba020 bash[25448]: cluster 2021-03-10T15:28:38.540067+0000 mgr.gibba020.yqfnwy (mgr.34427) 5070 : cluster [DBG] pgmap v2879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:41.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:41 gibba013 bash[29418]: cluster 2021-03-10T15:28:40.541629+0000 mgr.gibba020.yqfnwy (mgr.34427) 5071 : cluster [DBG] pgmap v2880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:41.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:41 gibba013 bash[30381]: cluster 2021-03-10T15:28:40.541629+0000 mgr.gibba020.yqfnwy (mgr.34427) 5071 : cluster [DBG] pgmap v2880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:41.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:41 gibba020 bash[25448]: cluster 2021-03-10T15:28:40.541629+0000 mgr.gibba020.yqfnwy (mgr.34427) 5071 : cluster [DBG] pgmap v2880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:43.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:43 gibba020 bash[25448]: cluster 2021-03-10T15:28:42.542923+0000 mgr.gibba020.yqfnwy (mgr.34427) 5072 : cluster [DBG] pgmap v2881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:43.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:43 gibba020 bash[25448]: cephadm 2021-03-10T15:28:43.252715+0000 mgr.gibba020.yqfnwy (mgr.34427) 5073 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:28:43.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:43 gibba013 bash[29418]: cluster 2021-03-10T15:28:42.542923+0000 mgr.gibba020.yqfnwy (mgr.34427) 5072 : cluster [DBG] pgmap v2881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:43.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:43 gibba013 bash[29418]: cephadm 2021-03-10T15:28:43.252715+0000 mgr.gibba020.yqfnwy (mgr.34427) 5073 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:28:43.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:43 gibba013 bash[30381]: cluster 2021-03-10T15:28:42.542923+0000 mgr.gibba020.yqfnwy (mgr.34427) 5072 : cluster [DBG] pgmap v2881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:43.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:43 gibba013 bash[30381]: cephadm 2021-03-10T15:28:43.252715+0000 mgr.gibba020.yqfnwy (mgr.34427) 5073 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:28:45.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:45 gibba013 bash[29418]: cluster 2021-03-10T15:28:44.544472+0000 mgr.gibba020.yqfnwy (mgr.34427) 5074 : cluster [DBG] pgmap v2882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:45.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:45 gibba013 bash[30381]: cluster 2021-03-10T15:28:44.544472+0000 mgr.gibba020.yqfnwy (mgr.34427) 5074 : cluster [DBG] pgmap v2882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:45.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:45 gibba020 bash[25448]: cluster 2021-03-10T15:28:44.544472+0000 mgr.gibba020.yqfnwy (mgr.34427) 5074 : cluster [DBG] pgmap v2882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:47.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:47 gibba013 bash[29418]: cluster 2021-03-10T15:28:46.545990+0000 mgr.gibba020.yqfnwy (mgr.34427) 5075 : cluster [DBG] pgmap v2883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:47.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:47 gibba013 bash[30381]: cluster 2021-03-10T15:28:46.545990+0000 mgr.gibba020.yqfnwy (mgr.34427) 5075 : cluster [DBG] pgmap v2883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:47.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:47 gibba020 bash[25448]: cluster 2021-03-10T15:28:46.545990+0000 mgr.gibba020.yqfnwy (mgr.34427) 5075 : cluster [DBG] pgmap v2883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:49.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:49 gibba013 bash[29418]: cluster 2021-03-10T15:28:48.547383+0000 mgr.gibba020.yqfnwy (mgr.34427) 5076 : cluster [DBG] pgmap v2884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:49.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:49 gibba013 bash[30381]: cluster 2021-03-10T15:28:48.547383+0000 mgr.gibba020.yqfnwy (mgr.34427) 5076 : cluster [DBG] pgmap v2884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:49.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:49 gibba020 bash[25448]: cluster 2021-03-10T15:28:48.547383+0000 mgr.gibba020.yqfnwy (mgr.34427) 5076 : cluster [DBG] pgmap v2884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:51.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:51 gibba020 bash[25448]: cluster 2021-03-10T15:28:50.548806+0000 mgr.gibba020.yqfnwy (mgr.34427) 5077 : cluster [DBG] pgmap v2885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:52.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:51 gibba013 bash[29418]: cluster 2021-03-10T15:28:50.548806+0000 mgr.gibba020.yqfnwy (mgr.34427) 5077 : cluster [DBG] pgmap v2885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:52.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:51 gibba013 bash[30381]: cluster 2021-03-10T15:28:50.548806+0000 mgr.gibba020.yqfnwy (mgr.34427) 5077 : cluster [DBG] pgmap v2885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:53.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:53 gibba013 bash[29418]: cluster 2021-03-10T15:28:52.550371+0000 mgr.gibba020.yqfnwy (mgr.34427) 5078 : cluster [DBG] pgmap v2886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:53.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:53 gibba013 bash[30381]: cluster 2021-03-10T15:28:52.550371+0000 mgr.gibba020.yqfnwy (mgr.34427) 5078 : cluster [DBG] pgmap v2886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:53.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:53 gibba020 bash[25448]: cluster 2021-03-10T15:28:52.550371+0000 mgr.gibba020.yqfnwy (mgr.34427) 5078 : cluster [DBG] pgmap v2886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:55.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:55 gibba013 bash[29418]: cluster 2021-03-10T15:28:54.551778+0000 mgr.gibba020.yqfnwy (mgr.34427) 5079 : cluster [DBG] pgmap v2887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:55.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:55 gibba013 bash[30381]: cluster 2021-03-10T15:28:54.551778+0000 mgr.gibba020.yqfnwy (mgr.34427) 5079 : cluster [DBG] pgmap v2887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:55.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:55 gibba020 bash[25448]: cluster 2021-03-10T15:28:54.551778+0000 mgr.gibba020.yqfnwy (mgr.34427) 5079 : cluster [DBG] pgmap v2887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:57.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:57 gibba013 bash[29418]: cluster 2021-03-10T15:28:56.553385+0000 mgr.gibba020.yqfnwy (mgr.34427) 5080 : cluster [DBG] pgmap v2888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:57.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:57 gibba013 bash[30381]: cluster 2021-03-10T15:28:56.553385+0000 mgr.gibba020.yqfnwy (mgr.34427) 5080 : cluster [DBG] pgmap v2888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:57.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:57 gibba020 bash[25448]: cluster 2021-03-10T15:28:56.553385+0000 mgr.gibba020.yqfnwy (mgr.34427) 5080 : cluster [DBG] pgmap v2888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:28:59.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:59 gibba020 bash[25448]: cephadm 2021-03-10T15:28:58.264705+0000 mgr.gibba020.yqfnwy (mgr.34427) 5081 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:28:59.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:28:59 gibba020 bash[25448]: cluster 2021-03-10T15:28:58.554779+0000 mgr.gibba020.yqfnwy (mgr.34427) 5082 : cluster [DBG] pgmap v2889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:00.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:59 gibba013 bash[29418]: cephadm 2021-03-10T15:28:58.264705+0000 mgr.gibba020.yqfnwy (mgr.34427) 5081 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:29:00.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:28:59 gibba013 bash[29418]: cluster 2021-03-10T15:28:58.554779+0000 mgr.gibba020.yqfnwy (mgr.34427) 5082 : cluster [DBG] pgmap v2889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:00.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:59 gibba013 bash[30381]: cephadm 2021-03-10T15:28:58.264705+0000 mgr.gibba020.yqfnwy (mgr.34427) 5081 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:29:00.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:28:59 gibba013 bash[30381]: cluster 2021-03-10T15:28:58.554779+0000 mgr.gibba020.yqfnwy (mgr.34427) 5082 : cluster [DBG] pgmap v2889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:01.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:01 gibba020 bash[25448]: cluster 2021-03-10T15:29:00.556389+0000 mgr.gibba020.yqfnwy (mgr.34427) 5083 : cluster [DBG] pgmap v2890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:02.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:01 gibba013 bash[29418]: cluster 2021-03-10T15:29:00.556389+0000 mgr.gibba020.yqfnwy (mgr.34427) 5083 : cluster [DBG] pgmap v2890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:02.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:01 gibba013 bash[30381]: cluster 2021-03-10T15:29:00.556389+0000 mgr.gibba020.yqfnwy (mgr.34427) 5083 : cluster [DBG] pgmap v2890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:03.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:03 gibba013 bash[29418]: cluster 2021-03-10T15:29:02.557754+0000 mgr.gibba020.yqfnwy (mgr.34427) 5084 : cluster [DBG] pgmap v2891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:03.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:03 gibba013 bash[30381]: cluster 2021-03-10T15:29:02.557754+0000 mgr.gibba020.yqfnwy (mgr.34427) 5084 : cluster [DBG] pgmap v2891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:03.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:03 gibba020 bash[25448]: cluster 2021-03-10T15:29:02.557754+0000 mgr.gibba020.yqfnwy (mgr.34427) 5084 : cluster [DBG] pgmap v2891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:05.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:05 gibba013 bash[29418]: cluster 2021-03-10T15:29:04.559407+0000 mgr.gibba020.yqfnwy (mgr.34427) 5085 : cluster [DBG] pgmap v2892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:05.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:05 gibba013 bash[30381]: cluster 2021-03-10T15:29:04.559407+0000 mgr.gibba020.yqfnwy (mgr.34427) 5085 : cluster [DBG] pgmap v2892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:05.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:05 gibba020 bash[25448]: cluster 2021-03-10T15:29:04.559407+0000 mgr.gibba020.yqfnwy (mgr.34427) 5085 : cluster [DBG] pgmap v2892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:06.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:06 gibba013 bash[29418]: audit 2021-03-10T15:29:06.454484+0000 mon.a (mon.0) 2083 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:29:06.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:06 gibba013 bash[29418]: audit 2021-03-10T15:29:06.516242+0000 mon.a (mon.0) 2084 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:29:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:06 gibba013 bash[30381]: audit 2021-03-10T15:29:06.454484+0000 mon.a (mon.0) 2083 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:29:06.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:06 gibba013 bash[30381]: audit 2021-03-10T15:29:06.516242+0000 mon.a (mon.0) 2084 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:29:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:06 gibba020 bash[25448]: audit 2021-03-10T15:29:06.454484+0000 mon.a (mon.0) 2083 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:29:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:06 gibba020 bash[25448]: audit 2021-03-10T15:29:06.516242+0000 mon.a (mon.0) 2084 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:29:07.064 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:29:07.296 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:29:07.297 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (95m) 10m ago 101m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:29:07.297 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (100m) 9m ago 100m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:29:07.297 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (96m) 9m ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:29:07.297 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (96m) 9m ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:29:07.298 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (95m) 10m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:29:07.298 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (95m) 10m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:29:07.298 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (94m) 9m ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:29:07.298 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (94m) 10m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:29:07.298 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (101m) 10m ago 101m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:29:07.299 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (101m) 9m ago 101m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:29:07.299 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (93m) 10m ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:29:07.299 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (93m) 10m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:29:07.299 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (93m) 10m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:29:07.300 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (92m) 10m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:29:07.300 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (92m) 9m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:29:07.300 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (91m) 9m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:29:07.300 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (91m) 9m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:29:07.300 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (90m) 9m ago 101m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:29:07.301 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (100m) 9m ago 101m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:29:07.301 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 9m ago 99m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:29:07.568 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:29:07.568 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:29:07.568 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:29:07.569 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:29:07.569 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:29:07.569 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:29:07.569 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:29:07.570 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:29:07.570 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:29:07.570 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:29:07.570 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:29:07.571 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:29:07.571 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:29:07.571 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:29:07.571 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:29:07.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:07 gibba020 bash[25448]: cluster 2021-03-10T15:29:06.560927+0000 mgr.gibba020.yqfnwy (mgr.34427) 5086 : cluster [DBG] pgmap v2893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:07.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:07 gibba020 bash[25448]: audit 2021-03-10T15:29:06.632056+0000 mon.a (mon.0) 2085 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T15:29:07.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:07 gibba020 bash[25448]: audit 2021-03-10T15:29:06.632290+0000 mon.a (mon.0) 2086 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:29:07.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:07 gibba020 bash[25448]: audit 2021-03-10T15:29:06.632476+0000 mon.a (mon.0) 2087 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T15:29:07.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:07 gibba020 bash[25448]: audit 2021-03-10T15:29:06.632651+0000 mon.a (mon.0) 2088 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:29:07.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:07 gibba020 bash[25448]: audit 2021-03-10T15:29:07.050476+0000 mgr.gibba020.yqfnwy (mgr.34427) 5087 : audit [DBG] from='client.57457 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:29:07.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:07 gibba020 bash[25448]: audit 2021-03-10T15:29:07.564396+0000 mon.c (mon.1) 86 : audit [DBG] from='client.? 172.21.2.113:0/1775993893' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:08.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:07 gibba013 bash[29418]: cluster 2021-03-10T15:29:06.560927+0000 mgr.gibba020.yqfnwy (mgr.34427) 5086 : cluster [DBG] pgmap v2893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:08.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:07 gibba013 bash[29418]: audit 2021-03-10T15:29:06.632056+0000 mon.a (mon.0) 2085 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T15:29:08.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:07 gibba013 bash[29418]: audit 2021-03-10T15:29:06.632290+0000 mon.a (mon.0) 2086 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:29:08.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:07 gibba013 bash[29418]: audit 2021-03-10T15:29:06.632476+0000 mon.a (mon.0) 2087 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T15:29:08.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:07 gibba013 bash[29418]: audit 2021-03-10T15:29:06.632651+0000 mon.a (mon.0) 2088 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:29:08.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:07 gibba013 bash[29418]: audit 2021-03-10T15:29:07.050476+0000 mgr.gibba020.yqfnwy (mgr.34427) 5087 : audit [DBG] from='client.57457 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:29:08.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:07 gibba013 bash[29418]: audit 2021-03-10T15:29:07.564396+0000 mon.c (mon.1) 86 : audit [DBG] from='client.? 172.21.2.113:0/1775993893' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:08.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:07 gibba013 bash[30381]: cluster 2021-03-10T15:29:06.560927+0000 mgr.gibba020.yqfnwy (mgr.34427) 5086 : cluster [DBG] pgmap v2893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:08.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:07 gibba013 bash[30381]: audit 2021-03-10T15:29:06.632056+0000 mon.a (mon.0) 2085 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T15:29:08.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:07 gibba013 bash[30381]: audit 2021-03-10T15:29:06.632290+0000 mon.a (mon.0) 2086 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:29:08.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:07 gibba013 bash[30381]: audit 2021-03-10T15:29:06.632476+0000 mon.a (mon.0) 2087 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T15:29:08.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:07 gibba013 bash[30381]: audit 2021-03-10T15:29:06.632651+0000 mon.a (mon.0) 2088 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:29:08.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:07 gibba013 bash[30381]: audit 2021-03-10T15:29:07.050476+0000 mgr.gibba020.yqfnwy (mgr.34427) 5087 : audit [DBG] from='client.57457 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:29:08.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:07 gibba013 bash[30381]: audit 2021-03-10T15:29:07.564396+0000 mon.c (mon.1) 86 : audit [DBG] from='client.? 172.21.2.113:0/1775993893' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:08.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:08 gibba020 bash[25448]: audit 2021-03-10T15:29:07.279307+0000 mgr.gibba020.yqfnwy (mgr.34427) 5088 : audit [DBG] from='client.57463 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:29:09.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:08 gibba013 bash[29418]: audit 2021-03-10T15:29:07.279307+0000 mgr.gibba020.yqfnwy (mgr.34427) 5088 : audit [DBG] from='client.57463 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:29:09.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:08 gibba013 bash[30381]: audit 2021-03-10T15:29:07.279307+0000 mgr.gibba020.yqfnwy (mgr.34427) 5088 : audit [DBG] from='client.57463 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:29:09.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:09 gibba020 bash[25448]: cluster 2021-03-10T15:29:08.562431+0000 mgr.gibba020.yqfnwy (mgr.34427) 5089 : cluster [DBG] pgmap v2894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:10.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:09 gibba013 bash[29418]: cluster 2021-03-10T15:29:08.562431+0000 mgr.gibba020.yqfnwy (mgr.34427) 5089 : cluster [DBG] pgmap v2894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:10.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:09 gibba013 bash[30381]: cluster 2021-03-10T15:29:08.562431+0000 mgr.gibba020.yqfnwy (mgr.34427) 5089 : cluster [DBG] pgmap v2894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:11.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:11 gibba020 bash[25448]: cluster 2021-03-10T15:29:10.564042+0000 mgr.gibba020.yqfnwy (mgr.34427) 5090 : cluster [DBG] pgmap v2895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:12.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:11 gibba013 bash[29418]: cluster 2021-03-10T15:29:10.564042+0000 mgr.gibba020.yqfnwy (mgr.34427) 5090 : cluster [DBG] pgmap v2895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:12.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:11 gibba013 bash[30381]: cluster 2021-03-10T15:29:10.564042+0000 mgr.gibba020.yqfnwy (mgr.34427) 5090 : cluster [DBG] pgmap v2895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:13.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:13 gibba013 bash[29418]: cluster 2021-03-10T15:29:12.565418+0000 mgr.gibba020.yqfnwy (mgr.34427) 5091 : cluster [DBG] pgmap v2896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:13.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:13 gibba013 bash[29418]: audit 2021-03-10T15:29:13.279774+0000 mon.a (mon.0) 2089 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:29:13.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:13 gibba013 bash[29418]: audit 2021-03-10T15:29:13.286493+0000 mon.a (mon.0) 2090 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:29:13.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:13 gibba013 bash[30381]: cluster 2021-03-10T15:29:12.565418+0000 mgr.gibba020.yqfnwy (mgr.34427) 5091 : cluster [DBG] pgmap v2896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:13.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:13 gibba013 bash[30381]: audit 2021-03-10T15:29:13.279774+0000 mon.a (mon.0) 2089 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:29:13.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:13 gibba013 bash[30381]: audit 2021-03-10T15:29:13.286493+0000 mon.a (mon.0) 2090 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:29:13.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:13 gibba020 bash[25448]: cluster 2021-03-10T15:29:12.565418+0000 mgr.gibba020.yqfnwy (mgr.34427) 5091 : cluster [DBG] pgmap v2896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:13.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:13 gibba020 bash[25448]: audit 2021-03-10T15:29:13.279774+0000 mon.a (mon.0) 2089 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:29:13.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:13 gibba020 bash[25448]: audit 2021-03-10T15:29:13.286493+0000 mon.a (mon.0) 2090 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:29:14.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:14 gibba013 bash[29418]: cephadm 2021-03-10T15:29:13.285200+0000 mgr.gibba020.yqfnwy (mgr.34427) 5092 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:29:14.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:14 gibba013 bash[30381]: cephadm 2021-03-10T15:29:13.285200+0000 mgr.gibba020.yqfnwy (mgr.34427) 5092 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:29:14.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:14 gibba020 bash[25448]: cephadm 2021-03-10T15:29:13.285200+0000 mgr.gibba020.yqfnwy (mgr.34427) 5092 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:29:15.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:15 gibba013 bash[29418]: cluster 2021-03-10T15:29:14.566863+0000 mgr.gibba020.yqfnwy (mgr.34427) 5093 : cluster [DBG] pgmap v2897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:15.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:15 gibba013 bash[30381]: cluster 2021-03-10T15:29:14.566863+0000 mgr.gibba020.yqfnwy (mgr.34427) 5093 : cluster [DBG] pgmap v2897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:15.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:15 gibba020 bash[25448]: cluster 2021-03-10T15:29:14.566863+0000 mgr.gibba020.yqfnwy (mgr.34427) 5093 : cluster [DBG] pgmap v2897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:18.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[29418]: cluster 2021-03-10T15:29:16.568591+0000 mgr.gibba020.yqfnwy (mgr.34427) 5094 : cluster [DBG] pgmap v2898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:18.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[29418]: audit 2021-03-10T15:29:16.818656+0000 mon.a (mon.0) 2091 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:29:18.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[29418]: cephadm 2021-03-10T15:29:16.819563+0000 mgr.gibba020.yqfnwy (mgr.34427) 5095 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:29:18.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[29418]: audit 2021-03-10T15:29:17.036287+0000 mon.a (mon.0) 2092 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:29:18.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[29418]: cephadm 2021-03-10T15:29:17.039326+0000 mgr.gibba020.yqfnwy (mgr.34427) 5096 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:29:18.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[29418]: audit 2021-03-10T15:29:17.040923+0000 mon.a (mon.0) 2093 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:29:18.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[29418]: cephadm 2021-03-10T15:29:17.041428+0000 mgr.gibba020.yqfnwy (mgr.34427) 5097 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:29:18.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[29418]: audit 2021-03-10T15:29:17.042721+0000 mon.a (mon.0) 2094 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:18.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[29418]: cephadm 2021-03-10T15:29:17.043236+0000 mgr.gibba020.yqfnwy (mgr.34427) 5098 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:29:18.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[29418]: cephadm 2021-03-10T15:29:17.043340+0000 mgr.gibba020.yqfnwy (mgr.34427) 5099 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:29:18.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[29418]: audit 2021-03-10T15:29:17.044624+0000 mon.a (mon.0) 2095 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:18.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[29418]: cephadm 2021-03-10T15:29:17.045099+0000 mgr.gibba020.yqfnwy (mgr.34427) 5100 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:29:18.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[29418]: cephadm 2021-03-10T15:29:17.045204+0000 mgr.gibba020.yqfnwy (mgr.34427) 5101 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:29:18.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[29418]: audit 2021-03-10T15:29:17.046330+0000 mon.a (mon.0) 2096 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:18.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[29418]: cephadm 2021-03-10T15:29:17.046711+0000 mgr.gibba020.yqfnwy (mgr.34427) 5102 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:29:18.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[29418]: cephadm 2021-03-10T15:29:17.048132+0000 mgr.gibba020.yqfnwy (mgr.34427) 5103 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:29:18.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[29418]: cephadm 2021-03-10T15:29:17.048262+0000 mgr.gibba020.yqfnwy (mgr.34427) 5104 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:29:18.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[29418]: audit 2021-03-10T15:29:17.049687+0000 mon.a (mon.0) 2097 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:18.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[29418]: cephadm 2021-03-10T15:29:17.050189+0000 mgr.gibba020.yqfnwy (mgr.34427) 5105 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:29:18.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[29418]: cephadm 2021-03-10T15:29:17.050960+0000 mgr.gibba020.yqfnwy (mgr.34427) 5106 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:29:18.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[29418]: audit 2021-03-10T15:29:17.052157+0000 mon.a (mon.0) 2098 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:18.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[29418]: cephadm 2021-03-10T15:29:17.052572+0000 mgr.gibba020.yqfnwy (mgr.34427) 5107 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:29:18.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[29418]: cephadm 2021-03-10T15:29:17.052675+0000 mgr.gibba020.yqfnwy (mgr.34427) 5108 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:29:18.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[29418]: cephadm 2021-03-10T15:29:17.052954+0000 mgr.gibba020.yqfnwy (mgr.34427) 5109 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:29:18.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[30381]: cluster 2021-03-10T15:29:16.568591+0000 mgr.gibba020.yqfnwy (mgr.34427) 5094 : cluster [DBG] pgmap v2898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:18.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[30381]: audit 2021-03-10T15:29:16.818656+0000 mon.a (mon.0) 2091 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:29:18.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[30381]: cephadm 2021-03-10T15:29:16.819563+0000 mgr.gibba020.yqfnwy (mgr.34427) 5095 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:29:18.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[30381]: audit 2021-03-10T15:29:17.036287+0000 mon.a (mon.0) 2092 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:29:18.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[30381]: cephadm 2021-03-10T15:29:17.039326+0000 mgr.gibba020.yqfnwy (mgr.34427) 5096 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:29:18.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[30381]: audit 2021-03-10T15:29:17.040923+0000 mon.a (mon.0) 2093 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:29:18.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[30381]: cephadm 2021-03-10T15:29:17.041428+0000 mgr.gibba020.yqfnwy (mgr.34427) 5097 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:29:18.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[30381]: audit 2021-03-10T15:29:17.042721+0000 mon.a (mon.0) 2094 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:18.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[30381]: cephadm 2021-03-10T15:29:17.043236+0000 mgr.gibba020.yqfnwy (mgr.34427) 5098 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:29:18.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[30381]: cephadm 2021-03-10T15:29:17.043340+0000 mgr.gibba020.yqfnwy (mgr.34427) 5099 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:29:18.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[30381]: audit 2021-03-10T15:29:17.044624+0000 mon.a (mon.0) 2095 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:18.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[30381]: cephadm 2021-03-10T15:29:17.045099+0000 mgr.gibba020.yqfnwy (mgr.34427) 5100 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:29:18.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[30381]: cephadm 2021-03-10T15:29:17.045204+0000 mgr.gibba020.yqfnwy (mgr.34427) 5101 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:29:18.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[30381]: audit 2021-03-10T15:29:17.046330+0000 mon.a (mon.0) 2096 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:18.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[30381]: cephadm 2021-03-10T15:29:17.046711+0000 mgr.gibba020.yqfnwy (mgr.34427) 5102 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:29:18.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[30381]: cephadm 2021-03-10T15:29:17.048132+0000 mgr.gibba020.yqfnwy (mgr.34427) 5103 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:29:18.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[30381]: cephadm 2021-03-10T15:29:17.048262+0000 mgr.gibba020.yqfnwy (mgr.34427) 5104 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:29:18.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[30381]: audit 2021-03-10T15:29:17.049687+0000 mon.a (mon.0) 2097 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:18.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[30381]: cephadm 2021-03-10T15:29:17.050189+0000 mgr.gibba020.yqfnwy (mgr.34427) 5105 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:29:18.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[30381]: cephadm 2021-03-10T15:29:17.050960+0000 mgr.gibba020.yqfnwy (mgr.34427) 5106 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:29:18.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[30381]: audit 2021-03-10T15:29:17.052157+0000 mon.a (mon.0) 2098 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:18.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[30381]: cephadm 2021-03-10T15:29:17.052572+0000 mgr.gibba020.yqfnwy (mgr.34427) 5107 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:29:18.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[30381]: cephadm 2021-03-10T15:29:17.052675+0000 mgr.gibba020.yqfnwy (mgr.34427) 5108 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:29:18.143 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:17 gibba013 bash[30381]: cephadm 2021-03-10T15:29:17.052954+0000 mgr.gibba020.yqfnwy (mgr.34427) 5109 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:29:18.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:17 gibba020 bash[25448]: cluster 2021-03-10T15:29:16.568591+0000 mgr.gibba020.yqfnwy (mgr.34427) 5094 : cluster [DBG] pgmap v2898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:18.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:17 gibba020 bash[25448]: audit 2021-03-10T15:29:16.818656+0000 mon.a (mon.0) 2091 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:29:18.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:17 gibba020 bash[25448]: cephadm 2021-03-10T15:29:16.819563+0000 mgr.gibba020.yqfnwy (mgr.34427) 5095 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:29:18.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:17 gibba020 bash[25448]: audit 2021-03-10T15:29:17.036287+0000 mon.a (mon.0) 2092 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:29:18.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:17 gibba020 bash[25448]: cephadm 2021-03-10T15:29:17.039326+0000 mgr.gibba020.yqfnwy (mgr.34427) 5096 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:29:18.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:17 gibba020 bash[25448]: audit 2021-03-10T15:29:17.040923+0000 mon.a (mon.0) 2093 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:29:18.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:17 gibba020 bash[25448]: cephadm 2021-03-10T15:29:17.041428+0000 mgr.gibba020.yqfnwy (mgr.34427) 5097 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:29:18.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:17 gibba020 bash[25448]: audit 2021-03-10T15:29:17.042721+0000 mon.a (mon.0) 2094 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:18.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:17 gibba020 bash[25448]: cephadm 2021-03-10T15:29:17.043236+0000 mgr.gibba020.yqfnwy (mgr.34427) 5098 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:29:18.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:17 gibba020 bash[25448]: cephadm 2021-03-10T15:29:17.043340+0000 mgr.gibba020.yqfnwy (mgr.34427) 5099 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:29:18.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:17 gibba020 bash[25448]: audit 2021-03-10T15:29:17.044624+0000 mon.a (mon.0) 2095 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:18.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:17 gibba020 bash[25448]: cephadm 2021-03-10T15:29:17.045099+0000 mgr.gibba020.yqfnwy (mgr.34427) 5100 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:29:18.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:17 gibba020 bash[25448]: cephadm 2021-03-10T15:29:17.045204+0000 mgr.gibba020.yqfnwy (mgr.34427) 5101 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:29:18.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:17 gibba020 bash[25448]: audit 2021-03-10T15:29:17.046330+0000 mon.a (mon.0) 2096 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:18.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:17 gibba020 bash[25448]: cephadm 2021-03-10T15:29:17.046711+0000 mgr.gibba020.yqfnwy (mgr.34427) 5102 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:29:18.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:17 gibba020 bash[25448]: cephadm 2021-03-10T15:29:17.048132+0000 mgr.gibba020.yqfnwy (mgr.34427) 5103 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:29:18.206 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:17 gibba020 bash[25448]: cephadm 2021-03-10T15:29:17.048262+0000 mgr.gibba020.yqfnwy (mgr.34427) 5104 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:29:18.206 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:17 gibba020 bash[25448]: audit 2021-03-10T15:29:17.049687+0000 mon.a (mon.0) 2097 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:18.206 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:17 gibba020 bash[25448]: cephadm 2021-03-10T15:29:17.050189+0000 mgr.gibba020.yqfnwy (mgr.34427) 5105 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:29:18.206 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:17 gibba020 bash[25448]: cephadm 2021-03-10T15:29:17.050960+0000 mgr.gibba020.yqfnwy (mgr.34427) 5106 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:29:18.206 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:17 gibba020 bash[25448]: audit 2021-03-10T15:29:17.052157+0000 mon.a (mon.0) 2098 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:18.207 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:17 gibba020 bash[25448]: cephadm 2021-03-10T15:29:17.052572+0000 mgr.gibba020.yqfnwy (mgr.34427) 5107 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:29:18.207 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:17 gibba020 bash[25448]: cephadm 2021-03-10T15:29:17.052675+0000 mgr.gibba020.yqfnwy (mgr.34427) 5108 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:29:18.207 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:17 gibba020 bash[25448]: cephadm 2021-03-10T15:29:17.052954+0000 mgr.gibba020.yqfnwy (mgr.34427) 5109 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:29:20.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:19 gibba013 bash[29418]: cluster 2021-03-10T15:29:18.570016+0000 mgr.gibba020.yqfnwy (mgr.34427) 5110 : cluster [DBG] pgmap v2899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:20.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:19 gibba013 bash[30381]: cluster 2021-03-10T15:29:18.570016+0000 mgr.gibba020.yqfnwy (mgr.34427) 5110 : cluster [DBG] pgmap v2899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:20.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:19 gibba020 bash[25448]: cluster 2021-03-10T15:29:18.570016+0000 mgr.gibba020.yqfnwy (mgr.34427) 5110 : cluster [DBG] pgmap v2899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:22.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:21 gibba013 bash[29418]: cluster 2021-03-10T15:29:20.571563+0000 mgr.gibba020.yqfnwy (mgr.34427) 5111 : cluster [DBG] pgmap v2900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:22.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:21 gibba013 bash[30381]: cluster 2021-03-10T15:29:20.571563+0000 mgr.gibba020.yqfnwy (mgr.34427) 5111 : cluster [DBG] pgmap v2900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:22.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:21 gibba020 bash[25448]: cluster 2021-03-10T15:29:20.571563+0000 mgr.gibba020.yqfnwy (mgr.34427) 5111 : cluster [DBG] pgmap v2900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:23.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:23 gibba013 bash[29418]: cluster 2021-03-10T15:29:22.572881+0000 mgr.gibba020.yqfnwy (mgr.34427) 5112 : cluster [DBG] pgmap v2901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:23.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:23 gibba013 bash[30381]: cluster 2021-03-10T15:29:22.572881+0000 mgr.gibba020.yqfnwy (mgr.34427) 5112 : cluster [DBG] pgmap v2901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:23.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:23 gibba020 bash[25448]: cluster 2021-03-10T15:29:22.572881+0000 mgr.gibba020.yqfnwy (mgr.34427) 5112 : cluster [DBG] pgmap v2901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:25.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:25 gibba020 bash[25448]: cluster 2021-03-10T15:29:24.574496+0000 mgr.gibba020.yqfnwy (mgr.34427) 5113 : cluster [DBG] pgmap v2902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:26.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:25 gibba013 bash[29418]: cluster 2021-03-10T15:29:24.574496+0000 mgr.gibba020.yqfnwy (mgr.34427) 5113 : cluster [DBG] pgmap v2902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:26.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:25 gibba013 bash[30381]: cluster 2021-03-10T15:29:24.574496+0000 mgr.gibba020.yqfnwy (mgr.34427) 5113 : cluster [DBG] pgmap v2902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:27.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:27 gibba020 bash[25448]: cluster 2021-03-10T15:29:26.576177+0000 mgr.gibba020.yqfnwy (mgr.34427) 5114 : cluster [DBG] pgmap v2903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:28.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:27 gibba013 bash[29418]: cluster 2021-03-10T15:29:26.576177+0000 mgr.gibba020.yqfnwy (mgr.34427) 5114 : cluster [DBG] pgmap v2903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:28.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:27 gibba013 bash[30381]: cluster 2021-03-10T15:29:26.576177+0000 mgr.gibba020.yqfnwy (mgr.34427) 5114 : cluster [DBG] pgmap v2903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:29.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:29 gibba020 bash[25448]: cluster 2021-03-10T15:29:28.577819+0000 mgr.gibba020.yqfnwy (mgr.34427) 5115 : cluster [DBG] pgmap v2904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:30.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:29 gibba013 bash[29418]: cluster 2021-03-10T15:29:28.577819+0000 mgr.gibba020.yqfnwy (mgr.34427) 5115 : cluster [DBG] pgmap v2904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:30.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:29 gibba013 bash[30381]: cluster 2021-03-10T15:29:28.577819+0000 mgr.gibba020.yqfnwy (mgr.34427) 5115 : cluster [DBG] pgmap v2904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:31.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:31 gibba020 bash[25448]: cluster 2021-03-10T15:29:30.579759+0000 mgr.gibba020.yqfnwy (mgr.34427) 5116 : cluster [DBG] pgmap v2905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:32.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:31 gibba013 bash[29418]: cluster 2021-03-10T15:29:30.579759+0000 mgr.gibba020.yqfnwy (mgr.34427) 5116 : cluster [DBG] pgmap v2905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:32.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:31 gibba013 bash[30381]: cluster 2021-03-10T15:29:30.579759+0000 mgr.gibba020.yqfnwy (mgr.34427) 5116 : cluster [DBG] pgmap v2905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:32.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:32 gibba020 bash[25448]: cephadm 2021-03-10T15:29:32.068946+0000 mgr.gibba020.yqfnwy (mgr.34427) 5117 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:29:33.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:32 gibba013 bash[29418]: cephadm 2021-03-10T15:29:32.068946+0000 mgr.gibba020.yqfnwy (mgr.34427) 5117 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:29:33.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:32 gibba013 bash[30381]: cephadm 2021-03-10T15:29:32.068946+0000 mgr.gibba020.yqfnwy (mgr.34427) 5117 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:29:33.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:33 gibba020 bash[25448]: cluster 2021-03-10T15:29:32.581650+0000 mgr.gibba020.yqfnwy (mgr.34427) 5118 : cluster [DBG] pgmap v2906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:34.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:33 gibba013 bash[29418]: cluster 2021-03-10T15:29:32.581650+0000 mgr.gibba020.yqfnwy (mgr.34427) 5118 : cluster [DBG] pgmap v2906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:34.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:33 gibba013 bash[30381]: cluster 2021-03-10T15:29:32.581650+0000 mgr.gibba020.yqfnwy (mgr.34427) 5118 : cluster [DBG] pgmap v2906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:35.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:35 gibba020 bash[25448]: cluster 2021-03-10T15:29:34.583379+0000 mgr.gibba020.yqfnwy (mgr.34427) 5119 : cluster [DBG] pgmap v2907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:36.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:35 gibba013 bash[29418]: cluster 2021-03-10T15:29:34.583379+0000 mgr.gibba020.yqfnwy (mgr.34427) 5119 : cluster [DBG] pgmap v2907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:36.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:35 gibba013 bash[30381]: cluster 2021-03-10T15:29:34.583379+0000 mgr.gibba020.yqfnwy (mgr.34427) 5119 : cluster [DBG] pgmap v2907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:37.813 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:29:37.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:37 gibba020 bash[25448]: cluster 2021-03-10T15:29:36.585350+0000 mgr.gibba020.yqfnwy (mgr.34427) 5120 : cluster [DBG] pgmap v2908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:38.044 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:29:38.044 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (96m) 21s ago 101m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:29:38.044 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (101m) 9m ago 101m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:29:38.045 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (96m) 9m ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:29:38.045 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (96m) 9m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:29:38.045 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (95m) 21s ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:29:38.045 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (95m) 21s ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:29:38.046 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (95m) 9m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:29:38.046 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (95m) 21s ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:29:38.046 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (101m) 21s ago 101m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:29:38.046 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (101m) 9m ago 101m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:29:38.046 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (94m) 21s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:29:38.047 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (93m) 21s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:29:38.047 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (93m) 21s ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:29:38.047 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (93m) 21s ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:29:38.047 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (92m) 9m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:29:38.048 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (92m) 9m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:29:38.048 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (91m) 9m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:29:38.048 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (91m) 9m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:29:38.048 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (101m) 9m ago 101m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:29:38.049 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 9m ago 99m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:29:38.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:37 gibba013 bash[29418]: cluster 2021-03-10T15:29:36.585350+0000 mgr.gibba020.yqfnwy (mgr.34427) 5120 : cluster [DBG] pgmap v2908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:38.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:37 gibba013 bash[30381]: cluster 2021-03-10T15:29:36.585350+0000 mgr.gibba020.yqfnwy (mgr.34427) 5120 : cluster [DBG] pgmap v2908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:38.293 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:29:38.293 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:29:38.294 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:29:38.294 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:29:38.294 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:29:38.294 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:29:38.295 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:29:38.295 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:29:38.295 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:29:38.296 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:29:38.296 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:29:38.296 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:29:38.296 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:29:38.296 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:29:38.297 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:29:38.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:38 gibba020 bash[25448]: audit 2021-03-10T15:29:37.799637+0000 mgr.gibba020.yqfnwy (mgr.34427) 5121 : audit [DBG] from='client.57475 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:29:38.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:38 gibba020 bash[25448]: audit 2021-03-10T15:29:38.026175+0000 mgr.gibba020.yqfnwy (mgr.34427) 5122 : audit [DBG] from='client.47496 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:29:38.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:38 gibba020 bash[25448]: audit 2021-03-10T15:29:38.289183+0000 mon.a (mon.0) 2099 : audit [DBG] from='client.? 172.21.2.113:0/1327192839' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:39.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:38 gibba013 bash[29418]: audit 2021-03-10T15:29:37.799637+0000 mgr.gibba020.yqfnwy (mgr.34427) 5121 : audit [DBG] from='client.57475 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:29:39.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:38 gibba013 bash[29418]: audit 2021-03-10T15:29:38.026175+0000 mgr.gibba020.yqfnwy (mgr.34427) 5122 : audit [DBG] from='client.47496 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:29:39.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:38 gibba013 bash[29418]: audit 2021-03-10T15:29:38.289183+0000 mon.a (mon.0) 2099 : audit [DBG] from='client.? 172.21.2.113:0/1327192839' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:39.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:38 gibba013 bash[30381]: audit 2021-03-10T15:29:37.799637+0000 mgr.gibba020.yqfnwy (mgr.34427) 5121 : audit [DBG] from='client.57475 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:29:39.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:38 gibba013 bash[30381]: audit 2021-03-10T15:29:38.026175+0000 mgr.gibba020.yqfnwy (mgr.34427) 5122 : audit [DBG] from='client.47496 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:29:39.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:38 gibba013 bash[30381]: audit 2021-03-10T15:29:38.289183+0000 mon.a (mon.0) 2099 : audit [DBG] from='client.? 172.21.2.113:0/1327192839' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:29:40.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:39 gibba013 bash[29418]: cluster 2021-03-10T15:29:38.586881+0000 mgr.gibba020.yqfnwy (mgr.34427) 5123 : cluster [DBG] pgmap v2909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:40.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:39 gibba013 bash[30381]: cluster 2021-03-10T15:29:38.586881+0000 mgr.gibba020.yqfnwy (mgr.34427) 5123 : cluster [DBG] pgmap v2909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:40.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:39 gibba020 bash[25448]: cluster 2021-03-10T15:29:38.586881+0000 mgr.gibba020.yqfnwy (mgr.34427) 5123 : cluster [DBG] pgmap v2909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:42.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:41 gibba013 bash[29418]: cluster 2021-03-10T15:29:40.588718+0000 mgr.gibba020.yqfnwy (mgr.34427) 5124 : cluster [DBG] pgmap v2910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:42.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:41 gibba013 bash[30381]: cluster 2021-03-10T15:29:40.588718+0000 mgr.gibba020.yqfnwy (mgr.34427) 5124 : cluster [DBG] pgmap v2910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:42.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:41 gibba020 bash[25448]: cluster 2021-03-10T15:29:40.588718+0000 mgr.gibba020.yqfnwy (mgr.34427) 5124 : cluster [DBG] pgmap v2910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:43.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:43 gibba013 bash[29418]: cluster 2021-03-10T15:29:42.590471+0000 mgr.gibba020.yqfnwy (mgr.34427) 5125 : cluster [DBG] pgmap v2911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:43.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:43 gibba013 bash[30381]: cluster 2021-03-10T15:29:42.590471+0000 mgr.gibba020.yqfnwy (mgr.34427) 5125 : cluster [DBG] pgmap v2911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:43.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:43 gibba020 bash[25448]: cluster 2021-03-10T15:29:42.590471+0000 mgr.gibba020.yqfnwy (mgr.34427) 5125 : cluster [DBG] pgmap v2911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:45.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:45 gibba020 bash[25448]: cluster 2021-03-10T15:29:44.592310+0000 mgr.gibba020.yqfnwy (mgr.34427) 5126 : cluster [DBG] pgmap v2912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:46.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:45 gibba013 bash[29418]: cluster 2021-03-10T15:29:44.592310+0000 mgr.gibba020.yqfnwy (mgr.34427) 5126 : cluster [DBG] pgmap v2912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:46.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:45 gibba013 bash[30381]: cluster 2021-03-10T15:29:44.592310+0000 mgr.gibba020.yqfnwy (mgr.34427) 5126 : cluster [DBG] pgmap v2912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:47.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:47 gibba020 bash[25448]: cluster 2021-03-10T15:29:46.594135+0000 mgr.gibba020.yqfnwy (mgr.34427) 5127 : cluster [DBG] pgmap v2913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:47.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:47 gibba020 bash[25448]: cephadm 2021-03-10T15:29:47.084968+0000 mgr.gibba020.yqfnwy (mgr.34427) 5128 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:29:48.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:47 gibba013 bash[29418]: cluster 2021-03-10T15:29:46.594135+0000 mgr.gibba020.yqfnwy (mgr.34427) 5127 : cluster [DBG] pgmap v2913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:48.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:47 gibba013 bash[29418]: cephadm 2021-03-10T15:29:47.084968+0000 mgr.gibba020.yqfnwy (mgr.34427) 5128 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:29:48.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:47 gibba013 bash[30381]: cluster 2021-03-10T15:29:46.594135+0000 mgr.gibba020.yqfnwy (mgr.34427) 5127 : cluster [DBG] pgmap v2913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:48.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:47 gibba013 bash[30381]: cephadm 2021-03-10T15:29:47.084968+0000 mgr.gibba020.yqfnwy (mgr.34427) 5128 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:29:49.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:49 gibba020 bash[25448]: cluster 2021-03-10T15:29:48.595583+0000 mgr.gibba020.yqfnwy (mgr.34427) 5129 : cluster [DBG] pgmap v2914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:50.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:49 gibba013 bash[29418]: cluster 2021-03-10T15:29:48.595583+0000 mgr.gibba020.yqfnwy (mgr.34427) 5129 : cluster [DBG] pgmap v2914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:50.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:49 gibba013 bash[30381]: cluster 2021-03-10T15:29:48.595583+0000 mgr.gibba020.yqfnwy (mgr.34427) 5129 : cluster [DBG] pgmap v2914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:51.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:51 gibba020 bash[25448]: cluster 2021-03-10T15:29:50.597058+0000 mgr.gibba020.yqfnwy (mgr.34427) 5130 : cluster [DBG] pgmap v2915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:52.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:51 gibba013 bash[29418]: cluster 2021-03-10T15:29:50.597058+0000 mgr.gibba020.yqfnwy (mgr.34427) 5130 : cluster [DBG] pgmap v2915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:52.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:51 gibba013 bash[30381]: cluster 2021-03-10T15:29:50.597058+0000 mgr.gibba020.yqfnwy (mgr.34427) 5130 : cluster [DBG] pgmap v2915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:53.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:53 gibba013 bash[29418]: cluster 2021-03-10T15:29:52.598482+0000 mgr.gibba020.yqfnwy (mgr.34427) 5131 : cluster [DBG] pgmap v2916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:53.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:53 gibba013 bash[30381]: cluster 2021-03-10T15:29:52.598482+0000 mgr.gibba020.yqfnwy (mgr.34427) 5131 : cluster [DBG] pgmap v2916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:53.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:53 gibba020 bash[25448]: cluster 2021-03-10T15:29:52.598482+0000 mgr.gibba020.yqfnwy (mgr.34427) 5131 : cluster [DBG] pgmap v2916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:55.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:55 gibba020 bash[25448]: cluster 2021-03-10T15:29:54.600070+0000 mgr.gibba020.yqfnwy (mgr.34427) 5132 : cluster [DBG] pgmap v2917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:56.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:55 gibba013 bash[29418]: cluster 2021-03-10T15:29:54.600070+0000 mgr.gibba020.yqfnwy (mgr.34427) 5132 : cluster [DBG] pgmap v2917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:56.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:55 gibba013 bash[30381]: cluster 2021-03-10T15:29:54.600070+0000 mgr.gibba020.yqfnwy (mgr.34427) 5132 : cluster [DBG] pgmap v2917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:57.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:57 gibba020 bash[25448]: cluster 2021-03-10T15:29:56.601781+0000 mgr.gibba020.yqfnwy (mgr.34427) 5133 : cluster [DBG] pgmap v2918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:58.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:57 gibba013 bash[29418]: cluster 2021-03-10T15:29:56.601781+0000 mgr.gibba020.yqfnwy (mgr.34427) 5133 : cluster [DBG] pgmap v2918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:58.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:57 gibba013 bash[30381]: cluster 2021-03-10T15:29:56.601781+0000 mgr.gibba020.yqfnwy (mgr.34427) 5133 : cluster [DBG] pgmap v2918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:29:59.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:29:59 gibba020 bash[25448]: cluster 2021-03-10T15:29:58.603427+0000 mgr.gibba020.yqfnwy (mgr.34427) 5134 : cluster [DBG] pgmap v2919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:00.006 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:29:59 gibba013 bash[29418]: cluster 2021-03-10T15:29:58.603427+0000 mgr.gibba020.yqfnwy (mgr.34427) 5134 : cluster [DBG] pgmap v2919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:00.007 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:29:59 gibba013 bash[30381]: cluster 2021-03-10T15:29:58.603427+0000 mgr.gibba020.yqfnwy (mgr.34427) 5134 : cluster [DBG] pgmap v2919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:00.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:00 gibba013 bash[29418]: debug 2021-03-10T15:29:59.996+0000 7fd718a82700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:30:00.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:00 gibba020 bash[25448]: cluster 2021-03-10T15:30:00.000294+0000 mon.a (mon.0) 2100 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:30:01.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:00 gibba013 bash[29418]: cluster 2021-03-10T15:30:00.000294+0000 mon.a (mon.0) 2100 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:30:01.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:00 gibba013 bash[30381]: cluster 2021-03-10T15:30:00.000294+0000 mon.a (mon.0) 2100 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:30:02.106 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:01 gibba020 bash[25448]: cluster 2021-03-10T15:30:00.605145+0000 mgr.gibba020.yqfnwy (mgr.34427) 5135 : cluster [DBG] pgmap v2920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:02.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:01 gibba013 bash[29418]: cluster 2021-03-10T15:30:00.605145+0000 mgr.gibba020.yqfnwy (mgr.34427) 5135 : cluster [DBG] pgmap v2920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:02.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:01 gibba013 bash[30381]: cluster 2021-03-10T15:30:00.605145+0000 mgr.gibba020.yqfnwy (mgr.34427) 5135 : cluster [DBG] pgmap v2920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:03.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:02 gibba013 bash[29418]: cephadm 2021-03-10T15:30:02.101132+0000 mgr.gibba020.yqfnwy (mgr.34427) 5136 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:30:03.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:02 gibba013 bash[30381]: cephadm 2021-03-10T15:30:02.101132+0000 mgr.gibba020.yqfnwy (mgr.34427) 5136 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:30:03.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:02 gibba020 bash[25448]: cephadm 2021-03-10T15:30:02.101132+0000 mgr.gibba020.yqfnwy (mgr.34427) 5136 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:30:04.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:03 gibba013 bash[29418]: cluster 2021-03-10T15:30:02.606453+0000 mgr.gibba020.yqfnwy (mgr.34427) 5137 : cluster [DBG] pgmap v2921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:04.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:03 gibba013 bash[30381]: cluster 2021-03-10T15:30:02.606453+0000 mgr.gibba020.yqfnwy (mgr.34427) 5137 : cluster [DBG] pgmap v2921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:04.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:03 gibba020 bash[25448]: cluster 2021-03-10T15:30:02.606453+0000 mgr.gibba020.yqfnwy (mgr.34427) 5137 : cluster [DBG] pgmap v2921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:06.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:05 gibba013 bash[29418]: cluster 2021-03-10T15:30:04.608017+0000 mgr.gibba020.yqfnwy (mgr.34427) 5138 : cluster [DBG] pgmap v2922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:06.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:05 gibba013 bash[30381]: cluster 2021-03-10T15:30:04.608017+0000 mgr.gibba020.yqfnwy (mgr.34427) 5138 : cluster [DBG] pgmap v2922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:06.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:05 gibba020 bash[25448]: cluster 2021-03-10T15:30:04.608017+0000 mgr.gibba020.yqfnwy (mgr.34427) 5138 : cluster [DBG] pgmap v2922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:07.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:06 gibba013 bash[29418]: audit 2021-03-10T15:30:06.459332+0000 mon.a (mon.0) 2101 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:30:07.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:06 gibba013 bash[29418]: audit 2021-03-10T15:30:06.522843+0000 mon.a (mon.0) 2102 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:30:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:06 gibba013 bash[29418]: audit 2021-03-10T15:30:06.634542+0000 mon.a (mon.0) 2103 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T15:30:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:06 gibba013 bash[29418]: audit 2021-03-10T15:30:06.634725+0000 mon.a (mon.0) 2104 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:30:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:06 gibba013 bash[29418]: audit 2021-03-10T15:30:06.634876+0000 mon.a (mon.0) 2105 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:30:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:06 gibba013 bash[29418]: audit 2021-03-10T15:30:06.635033+0000 mon.a (mon.0) 2106 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:30:07.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:06 gibba013 bash[30381]: audit 2021-03-10T15:30:06.459332+0000 mon.a (mon.0) 2101 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:30:07.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:06 gibba013 bash[30381]: audit 2021-03-10T15:30:06.522843+0000 mon.a (mon.0) 2102 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:30:07.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:06 gibba013 bash[30381]: audit 2021-03-10T15:30:06.634542+0000 mon.a (mon.0) 2103 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T15:30:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:06 gibba013 bash[30381]: audit 2021-03-10T15:30:06.634725+0000 mon.a (mon.0) 2104 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:30:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:06 gibba013 bash[30381]: audit 2021-03-10T15:30:06.634876+0000 mon.a (mon.0) 2105 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:30:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:06 gibba013 bash[30381]: audit 2021-03-10T15:30:06.635033+0000 mon.a (mon.0) 2106 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:30:07.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:06 gibba020 bash[25448]: audit 2021-03-10T15:30:06.459332+0000 mon.a (mon.0) 2101 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:30:07.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:06 gibba020 bash[25448]: audit 2021-03-10T15:30:06.522843+0000 mon.a (mon.0) 2102 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:30:07.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:06 gibba020 bash[25448]: audit 2021-03-10T15:30:06.634542+0000 mon.a (mon.0) 2103 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T15:30:07.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:06 gibba020 bash[25448]: audit 2021-03-10T15:30:06.634725+0000 mon.a (mon.0) 2104 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:30:07.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:06 gibba020 bash[25448]: audit 2021-03-10T15:30:06.634876+0000 mon.a (mon.0) 2105 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:30:07.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:06 gibba020 bash[25448]: audit 2021-03-10T15:30:06.635033+0000 mon.a (mon.0) 2106 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:30:08.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:07 gibba013 bash[29418]: cluster 2021-03-10T15:30:06.609664+0000 mgr.gibba020.yqfnwy (mgr.34427) 5139 : cluster [DBG] pgmap v2923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:08.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:07 gibba013 bash[30381]: cluster 2021-03-10T15:30:06.609664+0000 mgr.gibba020.yqfnwy (mgr.34427) 5139 : cluster [DBG] pgmap v2923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:08.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:07 gibba020 bash[25448]: cluster 2021-03-10T15:30:06.609664+0000 mgr.gibba020.yqfnwy (mgr.34427) 5139 : cluster [DBG] pgmap v2923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:08.545 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:30:08.785 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:30:08.786 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (96m) 51s ago 102m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:30:08.786 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (101m) 10m ago 101m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:30:08.786 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (97m) 10m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:30:08.786 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (97m) 10m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:30:08.787 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (96m) 51s ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:30:08.787 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (96m) 51s ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:30:08.787 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (95m) 10m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:30:08.787 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (95m) 51s ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:30:08.788 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (102m) 51s ago 102m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:30:08.788 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (102m) 10m ago 102m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:30:08.788 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (94m) 51s ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:30:08.788 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (94m) 51s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:30:08.788 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (94m) 51s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:30:08.789 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (93m) 51s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:30:08.789 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (93m) 10m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:30:08.789 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (92m) 10m ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:30:08.789 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (92m) 10m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:30:08.789 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (91m) 10m ago 102m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:30:08.790 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (101m) 10m ago 102m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:30:08.790 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 10m ago 100m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:30:09.033 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:30:09.033 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:30:09.034 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:30:09.034 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:30:09.034 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:30:09.034 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:30:09.035 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:30:09.035 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:30:09.035 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:30:09.035 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:30:09.036 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:30:09.036 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:30:09.036 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:30:09.036 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:30:09.036 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:30:10.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:09 gibba013 bash[29418]: audit 2021-03-10T15:30:08.523893+0000 mgr.gibba020.yqfnwy (mgr.34427) 5140 : audit [DBG] from='client.47508 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:30:10.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:09 gibba013 bash[29418]: cluster 2021-03-10T15:30:08.611194+0000 mgr.gibba020.yqfnwy (mgr.34427) 5141 : cluster [DBG] pgmap v2924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:10.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:09 gibba013 bash[29418]: audit 2021-03-10T15:30:08.770687+0000 mgr.gibba020.yqfnwy (mgr.34427) 5142 : audit [DBG] from='client.47514 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:30:10.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:09 gibba013 bash[29418]: audit 2021-03-10T15:30:09.029494+0000 mon.a (mon.0) 2107 : audit [DBG] from='client.? 172.21.2.113:0/924164448' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:10.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:09 gibba013 bash[30381]: audit 2021-03-10T15:30:08.523893+0000 mgr.gibba020.yqfnwy (mgr.34427) 5140 : audit [DBG] from='client.47508 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:30:10.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:09 gibba013 bash[30381]: cluster 2021-03-10T15:30:08.611194+0000 mgr.gibba020.yqfnwy (mgr.34427) 5141 : cluster [DBG] pgmap v2924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:10.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:09 gibba013 bash[30381]: audit 2021-03-10T15:30:08.770687+0000 mgr.gibba020.yqfnwy (mgr.34427) 5142 : audit [DBG] from='client.47514 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:30:10.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:09 gibba013 bash[30381]: audit 2021-03-10T15:30:09.029494+0000 mon.a (mon.0) 2107 : audit [DBG] from='client.? 172.21.2.113:0/924164448' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:10.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:09 gibba020 bash[25448]: audit 2021-03-10T15:30:08.523893+0000 mgr.gibba020.yqfnwy (mgr.34427) 5140 : audit [DBG] from='client.47508 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:30:10.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:09 gibba020 bash[25448]: cluster 2021-03-10T15:30:08.611194+0000 mgr.gibba020.yqfnwy (mgr.34427) 5141 : cluster [DBG] pgmap v2924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:10.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:09 gibba020 bash[25448]: audit 2021-03-10T15:30:08.770687+0000 mgr.gibba020.yqfnwy (mgr.34427) 5142 : audit [DBG] from='client.47514 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:30:10.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:09 gibba020 bash[25448]: audit 2021-03-10T15:30:09.029494+0000 mon.a (mon.0) 2107 : audit [DBG] from='client.? 172.21.2.113:0/924164448' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:12.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:11 gibba013 bash[29418]: cluster 2021-03-10T15:30:10.612941+0000 mgr.gibba020.yqfnwy (mgr.34427) 5143 : cluster [DBG] pgmap v2925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:12.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:11 gibba013 bash[30381]: cluster 2021-03-10T15:30:10.612941+0000 mgr.gibba020.yqfnwy (mgr.34427) 5143 : cluster [DBG] pgmap v2925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:12.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:11 gibba020 bash[25448]: cluster 2021-03-10T15:30:10.612941+0000 mgr.gibba020.yqfnwy (mgr.34427) 5143 : cluster [DBG] pgmap v2925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:13.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:13 gibba013 bash[29418]: cluster 2021-03-10T15:30:12.614558+0000 mgr.gibba020.yqfnwy (mgr.34427) 5144 : cluster [DBG] pgmap v2926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:13.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:13 gibba013 bash[30381]: cluster 2021-03-10T15:30:12.614558+0000 mgr.gibba020.yqfnwy (mgr.34427) 5144 : cluster [DBG] pgmap v2926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:13.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:13 gibba020 bash[25448]: cluster 2021-03-10T15:30:12.614558+0000 mgr.gibba020.yqfnwy (mgr.34427) 5144 : cluster [DBG] pgmap v2926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:15.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:15 gibba020 bash[25448]: cluster 2021-03-10T15:30:14.615901+0000 mgr.gibba020.yqfnwy (mgr.34427) 5145 : cluster [DBG] pgmap v2927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:16.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:15 gibba013 bash[29418]: cluster 2021-03-10T15:30:14.615901+0000 mgr.gibba020.yqfnwy (mgr.34427) 5145 : cluster [DBG] pgmap v2927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:16.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:15 gibba013 bash[30381]: cluster 2021-03-10T15:30:14.615901+0000 mgr.gibba020.yqfnwy (mgr.34427) 5145 : cluster [DBG] pgmap v2927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:17.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:17 gibba020 bash[25448]: cluster 2021-03-10T15:30:16.617490+0000 mgr.gibba020.yqfnwy (mgr.34427) 5146 : cluster [DBG] pgmap v2928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:18.014 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:17 gibba020 bash[25448]: audit 2021-03-10T15:30:17.118631+0000 mon.a (mon.0) 2108 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:30:18.015 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:17 gibba020 bash[25448]: cephadm 2021-03-10T15:30:17.123335+0000 mgr.gibba020.yqfnwy (mgr.34427) 5147 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:30:18.015 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:17 gibba020 bash[25448]: audit 2021-03-10T15:30:17.126819+0000 mon.a (mon.0) 2109 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:30:18.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:17 gibba013 bash[29418]: cluster 2021-03-10T15:30:16.617490+0000 mgr.gibba020.yqfnwy (mgr.34427) 5146 : cluster [DBG] pgmap v2928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:18.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:17 gibba013 bash[29418]: audit 2021-03-10T15:30:17.118631+0000 mon.a (mon.0) 2108 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:30:18.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:17 gibba013 bash[29418]: cephadm 2021-03-10T15:30:17.123335+0000 mgr.gibba020.yqfnwy (mgr.34427) 5147 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:30:18.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:17 gibba013 bash[29418]: audit 2021-03-10T15:30:17.126819+0000 mon.a (mon.0) 2109 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:30:18.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:17 gibba013 bash[30381]: cluster 2021-03-10T15:30:16.617490+0000 mgr.gibba020.yqfnwy (mgr.34427) 5146 : cluster [DBG] pgmap v2928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:18.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:17 gibba013 bash[30381]: audit 2021-03-10T15:30:17.118631+0000 mon.a (mon.0) 2108 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:30:18.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:17 gibba013 bash[30381]: cephadm 2021-03-10T15:30:17.123335+0000 mgr.gibba020.yqfnwy (mgr.34427) 5147 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:30:18.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:17 gibba013 bash[30381]: audit 2021-03-10T15:30:17.126819+0000 mon.a (mon.0) 2109 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:30:20.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:19 gibba013 bash[29418]: cluster 2021-03-10T15:30:18.618998+0000 mgr.gibba020.yqfnwy (mgr.34427) 5148 : cluster [DBG] pgmap v2929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:20.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:19 gibba013 bash[30381]: cluster 2021-03-10T15:30:18.618998+0000 mgr.gibba020.yqfnwy (mgr.34427) 5148 : cluster [DBG] pgmap v2929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:20.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:19 gibba020 bash[25448]: cluster 2021-03-10T15:30:18.618998+0000 mgr.gibba020.yqfnwy (mgr.34427) 5148 : cluster [DBG] pgmap v2929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:22.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:21 gibba020 bash[25448]: cluster 2021-03-10T15:30:20.619736+0000 mgr.gibba020.yqfnwy (mgr.34427) 5149 : cluster [DBG] pgmap v2930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:22.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:21 gibba020 bash[25448]: audit 2021-03-10T15:30:20.906030+0000 mon.a (mon.0) 2110 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:30:22.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:21 gibba020 bash[25448]: cephadm 2021-03-10T15:30:20.906055+0000 mgr.gibba020.yqfnwy (mgr.34427) 5150 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:30:22.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:21 gibba020 bash[25448]: audit 2021-03-10T15:30:21.127654+0000 mon.a (mon.0) 2111 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:30:22.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:21 gibba020 bash[25448]: cephadm 2021-03-10T15:30:21.129706+0000 mgr.gibba020.yqfnwy (mgr.34427) 5151 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:30:22.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:21 gibba020 bash[25448]: audit 2021-03-10T15:30:21.131377+0000 mon.a (mon.0) 2112 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:30:22.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:21 gibba020 bash[25448]: cephadm 2021-03-10T15:30:21.132153+0000 mgr.gibba020.yqfnwy (mgr.34427) 5152 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:30:22.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:21 gibba020 bash[25448]: audit 2021-03-10T15:30:21.133457+0000 mon.a (mon.0) 2113 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:22.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:21 gibba020 bash[25448]: cephadm 2021-03-10T15:30:21.134189+0000 mgr.gibba020.yqfnwy (mgr.34427) 5153 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:30:22.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:21 gibba020 bash[25448]: cephadm 2021-03-10T15:30:21.134239+0000 mgr.gibba020.yqfnwy (mgr.34427) 5154 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:30:22.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:21 gibba020 bash[25448]: audit 2021-03-10T15:30:21.135605+0000 mon.a (mon.0) 2114 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:22.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:21 gibba020 bash[25448]: cephadm 2021-03-10T15:30:21.136074+0000 mgr.gibba020.yqfnwy (mgr.34427) 5155 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:30:22.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:21 gibba020 bash[25448]: cephadm 2021-03-10T15:30:21.136118+0000 mgr.gibba020.yqfnwy (mgr.34427) 5156 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:30:22.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:21 gibba020 bash[25448]: audit 2021-03-10T15:30:21.137225+0000 mon.a (mon.0) 2115 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:22.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:21 gibba020 bash[25448]: cephadm 2021-03-10T15:30:21.137464+0000 mgr.gibba020.yqfnwy (mgr.34427) 5157 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:30:22.206 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:21 gibba020 bash[25448]: cephadm 2021-03-10T15:30:21.138756+0000 mgr.gibba020.yqfnwy (mgr.34427) 5158 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:30:22.206 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:21 gibba020 bash[25448]: cephadm 2021-03-10T15:30:21.138801+0000 mgr.gibba020.yqfnwy (mgr.34427) 5159 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:30:22.206 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:21 gibba020 bash[25448]: audit 2021-03-10T15:30:21.139910+0000 mon.a (mon.0) 2116 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:22.206 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:21 gibba020 bash[25448]: cephadm 2021-03-10T15:30:21.140205+0000 mgr.gibba020.yqfnwy (mgr.34427) 5160 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:30:22.207 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:21 gibba020 bash[25448]: cephadm 2021-03-10T15:30:21.140606+0000 mgr.gibba020.yqfnwy (mgr.34427) 5161 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:30:22.207 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:21 gibba020 bash[25448]: audit 2021-03-10T15:30:21.141645+0000 mon.a (mon.0) 2117 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:22.207 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:21 gibba020 bash[25448]: cephadm 2021-03-10T15:30:21.141876+0000 mgr.gibba020.yqfnwy (mgr.34427) 5162 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:30:22.207 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:21 gibba020 bash[25448]: cephadm 2021-03-10T15:30:21.141922+0000 mgr.gibba020.yqfnwy (mgr.34427) 5163 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:30:22.208 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:21 gibba020 bash[25448]: cephadm 2021-03-10T15:30:21.142047+0000 mgr.gibba020.yqfnwy (mgr.34427) 5164 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:30:22.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[29418]: cluster 2021-03-10T15:30:20.619736+0000 mgr.gibba020.yqfnwy (mgr.34427) 5149 : cluster [DBG] pgmap v2930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:22.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[29418]: audit 2021-03-10T15:30:20.906030+0000 mon.a (mon.0) 2110 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:30:22.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[29418]: cephadm 2021-03-10T15:30:20.906055+0000 mgr.gibba020.yqfnwy (mgr.34427) 5150 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:30:22.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[29418]: audit 2021-03-10T15:30:21.127654+0000 mon.a (mon.0) 2111 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:30:22.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[29418]: cephadm 2021-03-10T15:30:21.129706+0000 mgr.gibba020.yqfnwy (mgr.34427) 5151 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:30:22.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[29418]: audit 2021-03-10T15:30:21.131377+0000 mon.a (mon.0) 2112 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:30:22.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[29418]: cephadm 2021-03-10T15:30:21.132153+0000 mgr.gibba020.yqfnwy (mgr.34427) 5152 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:30:22.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[29418]: audit 2021-03-10T15:30:21.133457+0000 mon.a (mon.0) 2113 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:22.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[29418]: cephadm 2021-03-10T15:30:21.134189+0000 mgr.gibba020.yqfnwy (mgr.34427) 5153 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:30:22.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[29418]: cephadm 2021-03-10T15:30:21.134239+0000 mgr.gibba020.yqfnwy (mgr.34427) 5154 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:30:22.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[29418]: audit 2021-03-10T15:30:21.135605+0000 mon.a (mon.0) 2114 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:22.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[29418]: cephadm 2021-03-10T15:30:21.136074+0000 mgr.gibba020.yqfnwy (mgr.34427) 5155 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:30:22.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[29418]: cephadm 2021-03-10T15:30:21.136118+0000 mgr.gibba020.yqfnwy (mgr.34427) 5156 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:30:22.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[29418]: audit 2021-03-10T15:30:21.137225+0000 mon.a (mon.0) 2115 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:22.387 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[29418]: cephadm 2021-03-10T15:30:21.137464+0000 mgr.gibba020.yqfnwy (mgr.34427) 5157 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:30:22.387 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[29418]: cephadm 2021-03-10T15:30:21.138756+0000 mgr.gibba020.yqfnwy (mgr.34427) 5158 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:30:22.387 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[29418]: cephadm 2021-03-10T15:30:21.138801+0000 mgr.gibba020.yqfnwy (mgr.34427) 5159 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:30:22.387 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[29418]: audit 2021-03-10T15:30:21.139910+0000 mon.a (mon.0) 2116 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:22.388 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[29418]: cephadm 2021-03-10T15:30:21.140205+0000 mgr.gibba020.yqfnwy (mgr.34427) 5160 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:30:22.388 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[29418]: cephadm 2021-03-10T15:30:21.140606+0000 mgr.gibba020.yqfnwy (mgr.34427) 5161 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:30:22.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[30381]: cluster 2021-03-10T15:30:20.619736+0000 mgr.gibba020.yqfnwy (mgr.34427) 5149 : cluster [DBG] pgmap v2930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:22.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[30381]: audit 2021-03-10T15:30:20.906030+0000 mon.a (mon.0) 2110 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:30:22.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[30381]: cephadm 2021-03-10T15:30:20.906055+0000 mgr.gibba020.yqfnwy (mgr.34427) 5150 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:30:22.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[30381]: audit 2021-03-10T15:30:21.127654+0000 mon.a (mon.0) 2111 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:30:22.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[30381]: cephadm 2021-03-10T15:30:21.129706+0000 mgr.gibba020.yqfnwy (mgr.34427) 5151 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:30:22.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[30381]: audit 2021-03-10T15:30:21.131377+0000 mon.a (mon.0) 2112 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:30:22.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[30381]: cephadm 2021-03-10T15:30:21.132153+0000 mgr.gibba020.yqfnwy (mgr.34427) 5152 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:30:22.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[30381]: audit 2021-03-10T15:30:21.133457+0000 mon.a (mon.0) 2113 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:22.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[30381]: cephadm 2021-03-10T15:30:21.134189+0000 mgr.gibba020.yqfnwy (mgr.34427) 5153 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:30:22.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[30381]: cephadm 2021-03-10T15:30:21.134239+0000 mgr.gibba020.yqfnwy (mgr.34427) 5154 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:30:22.391 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[30381]: audit 2021-03-10T15:30:21.135605+0000 mon.a (mon.0) 2114 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:22.391 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[30381]: cephadm 2021-03-10T15:30:21.136074+0000 mgr.gibba020.yqfnwy (mgr.34427) 5155 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:30:22.392 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[30381]: cephadm 2021-03-10T15:30:21.136118+0000 mgr.gibba020.yqfnwy (mgr.34427) 5156 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:30:22.392 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[30381]: audit 2021-03-10T15:30:21.137225+0000 mon.a (mon.0) 2115 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:22.392 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[30381]: cephadm 2021-03-10T15:30:21.137464+0000 mgr.gibba020.yqfnwy (mgr.34427) 5157 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:30:22.393 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[30381]: cephadm 2021-03-10T15:30:21.138756+0000 mgr.gibba020.yqfnwy (mgr.34427) 5158 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:30:22.393 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[30381]: cephadm 2021-03-10T15:30:21.138801+0000 mgr.gibba020.yqfnwy (mgr.34427) 5159 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:30:22.393 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[30381]: audit 2021-03-10T15:30:21.139910+0000 mon.a (mon.0) 2116 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:22.393 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[30381]: cephadm 2021-03-10T15:30:21.140205+0000 mgr.gibba020.yqfnwy (mgr.34427) 5160 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:30:22.394 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[30381]: cephadm 2021-03-10T15:30:21.140606+0000 mgr.gibba020.yqfnwy (mgr.34427) 5161 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:30:22.394 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[29418]: audit 2021-03-10T15:30:21.141645+0000 mon.a (mon.0) 2117 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:22.394 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[29418]: cephadm 2021-03-10T15:30:21.141876+0000 mgr.gibba020.yqfnwy (mgr.34427) 5162 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:30:22.395 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[29418]: cephadm 2021-03-10T15:30:21.141922+0000 mgr.gibba020.yqfnwy (mgr.34427) 5163 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:30:22.395 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[29418]: cephadm 2021-03-10T15:30:21.142047+0000 mgr.gibba020.yqfnwy (mgr.34427) 5164 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:30:22.395 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[30381]: audit 2021-03-10T15:30:21.141645+0000 mon.a (mon.0) 2117 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:22.396 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[30381]: cephadm 2021-03-10T15:30:21.141876+0000 mgr.gibba020.yqfnwy (mgr.34427) 5162 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:30:22.396 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[30381]: cephadm 2021-03-10T15:30:21.141922+0000 mgr.gibba020.yqfnwy (mgr.34427) 5163 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:30:22.396 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:21 gibba013 bash[30381]: cephadm 2021-03-10T15:30:21.142047+0000 mgr.gibba020.yqfnwy (mgr.34427) 5164 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:30:23.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:23 gibba013 bash[29418]: cluster 2021-03-10T15:30:22.621165+0000 mgr.gibba020.yqfnwy (mgr.34427) 5165 : cluster [DBG] pgmap v2931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:23.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:23 gibba013 bash[30381]: cluster 2021-03-10T15:30:22.621165+0000 mgr.gibba020.yqfnwy (mgr.34427) 5165 : cluster [DBG] pgmap v2931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:23.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:23 gibba020 bash[25448]: cluster 2021-03-10T15:30:22.621165+0000 mgr.gibba020.yqfnwy (mgr.34427) 5165 : cluster [DBG] pgmap v2931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:25.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:25 gibba020 bash[25448]: cluster 2021-03-10T15:30:24.622524+0000 mgr.gibba020.yqfnwy (mgr.34427) 5166 : cluster [DBG] pgmap v2932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:26.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:25 gibba013 bash[29418]: cluster 2021-03-10T15:30:24.622524+0000 mgr.gibba020.yqfnwy (mgr.34427) 5166 : cluster [DBG] pgmap v2932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:26.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:25 gibba013 bash[30381]: cluster 2021-03-10T15:30:24.622524+0000 mgr.gibba020.yqfnwy (mgr.34427) 5166 : cluster [DBG] pgmap v2932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:27.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:27 gibba020 bash[25448]: cluster 2021-03-10T15:30:26.624188+0000 mgr.gibba020.yqfnwy (mgr.34427) 5167 : cluster [DBG] pgmap v2933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:28.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:27 gibba013 bash[29418]: cluster 2021-03-10T15:30:26.624188+0000 mgr.gibba020.yqfnwy (mgr.34427) 5167 : cluster [DBG] pgmap v2933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:28.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:27 gibba013 bash[30381]: cluster 2021-03-10T15:30:26.624188+0000 mgr.gibba020.yqfnwy (mgr.34427) 5167 : cluster [DBG] pgmap v2933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:30.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:29 gibba013 bash[29418]: cluster 2021-03-10T15:30:28.625625+0000 mgr.gibba020.yqfnwy (mgr.34427) 5168 : cluster [DBG] pgmap v2934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:30.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:29 gibba013 bash[30381]: cluster 2021-03-10T15:30:28.625625+0000 mgr.gibba020.yqfnwy (mgr.34427) 5168 : cluster [DBG] pgmap v2934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:30.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:29 gibba020 bash[25448]: cluster 2021-03-10T15:30:28.625625+0000 mgr.gibba020.yqfnwy (mgr.34427) 5168 : cluster [DBG] pgmap v2934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:32.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:31 gibba013 bash[29418]: cluster 2021-03-10T15:30:30.627327+0000 mgr.gibba020.yqfnwy (mgr.34427) 5169 : cluster [DBG] pgmap v2935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:32.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:31 gibba013 bash[30381]: cluster 2021-03-10T15:30:30.627327+0000 mgr.gibba020.yqfnwy (mgr.34427) 5169 : cluster [DBG] pgmap v2935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:32.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:31 gibba020 bash[25448]: cluster 2021-03-10T15:30:30.627327+0000 mgr.gibba020.yqfnwy (mgr.34427) 5169 : cluster [DBG] pgmap v2935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:33.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:33 gibba013 bash[29418]: cluster 2021-03-10T15:30:32.628922+0000 mgr.gibba020.yqfnwy (mgr.34427) 5170 : cluster [DBG] pgmap v2936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:33.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:33 gibba013 bash[30381]: cluster 2021-03-10T15:30:32.628922+0000 mgr.gibba020.yqfnwy (mgr.34427) 5170 : cluster [DBG] pgmap v2936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:33.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:33 gibba020 bash[25448]: cluster 2021-03-10T15:30:32.628922+0000 mgr.gibba020.yqfnwy (mgr.34427) 5170 : cluster [DBG] pgmap v2936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:35.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:35 gibba020 bash[25448]: cluster 2021-03-10T15:30:34.630534+0000 mgr.gibba020.yqfnwy (mgr.34427) 5171 : cluster [DBG] pgmap v2937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:36.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:35 gibba013 bash[29418]: cluster 2021-03-10T15:30:34.630534+0000 mgr.gibba020.yqfnwy (mgr.34427) 5171 : cluster [DBG] pgmap v2937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:36.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:35 gibba013 bash[30381]: cluster 2021-03-10T15:30:34.630534+0000 mgr.gibba020.yqfnwy (mgr.34427) 5171 : cluster [DBG] pgmap v2937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:37.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:36 gibba013 bash[29418]: cephadm 2021-03-10T15:30:36.158077+0000 mgr.gibba020.yqfnwy (mgr.34427) 5172 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:30:37.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:36 gibba013 bash[30381]: cephadm 2021-03-10T15:30:36.158077+0000 mgr.gibba020.yqfnwy (mgr.34427) 5172 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:30:37.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:36 gibba020 bash[25448]: cephadm 2021-03-10T15:30:36.158077+0000 mgr.gibba020.yqfnwy (mgr.34427) 5172 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:30:38.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:37 gibba013 bash[30381]: cluster 2021-03-10T15:30:36.632058+0000 mgr.gibba020.yqfnwy (mgr.34427) 5173 : cluster [DBG] pgmap v2938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:38.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:37 gibba013 bash[29418]: cluster 2021-03-10T15:30:36.632058+0000 mgr.gibba020.yqfnwy (mgr.34427) 5173 : cluster [DBG] pgmap v2938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:38.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:37 gibba020 bash[25448]: cluster 2021-03-10T15:30:36.632058+0000 mgr.gibba020.yqfnwy (mgr.34427) 5173 : cluster [DBG] pgmap v2938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:39.277 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:30:39.501 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:30:39.502 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (97m) 82s ago 102m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:30:39.502 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (102m) 18s ago 102m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:30:39.502 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (97m) 18s ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:30:39.502 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (97m) 18s ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:30:39.503 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (96m) 82s ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:30:39.503 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (96m) 82s ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:30:39.503 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (96m) 18s ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:30:39.503 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (96m) 82s ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:30:39.504 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (102m) 82s ago 102m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:30:39.504 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (102m) 18s ago 102m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:30:39.504 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (95m) 82s ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:30:39.504 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (95m) 82s ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:30:39.504 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (94m) 82s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:30:39.505 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (94m) 82s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:30:39.505 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (93m) 18s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:30:39.505 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (93m) 18s ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:30:39.505 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (92m) 18s ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:30:39.505 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (92m) 18s ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:30:39.506 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (102m) 18s ago 102m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:30:39.506 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 18s ago 100m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:30:39.752 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:30:39.753 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:30:39.753 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:30:39.753 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:30:39.753 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:30:39.754 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:30:39.754 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:30:39.754 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:30:39.754 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:30:39.754 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:30:39.755 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:30:39.755 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:30:39.755 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:30:39.755 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:30:39.756 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:30:40.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:39 gibba013 bash[29418]: cluster 2021-03-10T15:30:38.633389+0000 mgr.gibba020.yqfnwy (mgr.34427) 5174 : cluster [DBG] pgmap v2939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:40.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:39 gibba013 bash[29418]: audit 2021-03-10T15:30:39.263414+0000 mgr.gibba020.yqfnwy (mgr.34427) 5175 : audit [DBG] from='client.57511 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:30:40.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:39 gibba013 bash[30381]: cluster 2021-03-10T15:30:38.633389+0000 mgr.gibba020.yqfnwy (mgr.34427) 5174 : cluster [DBG] pgmap v2939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:40.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:39 gibba013 bash[30381]: audit 2021-03-10T15:30:39.263414+0000 mgr.gibba020.yqfnwy (mgr.34427) 5175 : audit [DBG] from='client.57511 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:30:40.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:39 gibba020 bash[25448]: cluster 2021-03-10T15:30:38.633389+0000 mgr.gibba020.yqfnwy (mgr.34427) 5174 : cluster [DBG] pgmap v2939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:40.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:39 gibba020 bash[25448]: audit 2021-03-10T15:30:39.263414+0000 mgr.gibba020.yqfnwy (mgr.34427) 5175 : audit [DBG] from='client.57511 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:30:41.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:40 gibba013 bash[29418]: audit 2021-03-10T15:30:39.484618+0000 mgr.gibba020.yqfnwy (mgr.34427) 5176 : audit [DBG] from='client.47532 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:30:41.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:40 gibba013 bash[29418]: audit 2021-03-10T15:30:39.748890+0000 mon.a (mon.0) 2118 : audit [DBG] from='client.? 172.21.2.113:0/1271779706' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:41.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:40 gibba013 bash[30381]: audit 2021-03-10T15:30:39.484618+0000 mgr.gibba020.yqfnwy (mgr.34427) 5176 : audit [DBG] from='client.47532 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:30:41.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:40 gibba013 bash[30381]: audit 2021-03-10T15:30:39.748890+0000 mon.a (mon.0) 2118 : audit [DBG] from='client.? 172.21.2.113:0/1271779706' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:41.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:40 gibba020 bash[25448]: audit 2021-03-10T15:30:39.484618+0000 mgr.gibba020.yqfnwy (mgr.34427) 5176 : audit [DBG] from='client.47532 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:30:41.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:40 gibba020 bash[25448]: audit 2021-03-10T15:30:39.748890+0000 mon.a (mon.0) 2118 : audit [DBG] from='client.? 172.21.2.113:0/1271779706' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:30:42.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:41 gibba013 bash[29418]: cluster 2021-03-10T15:30:40.635078+0000 mgr.gibba020.yqfnwy (mgr.34427) 5177 : cluster [DBG] pgmap v2940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:42.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:41 gibba013 bash[30381]: cluster 2021-03-10T15:30:40.635078+0000 mgr.gibba020.yqfnwy (mgr.34427) 5177 : cluster [DBG] pgmap v2940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:42.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:41 gibba020 bash[25448]: cluster 2021-03-10T15:30:40.635078+0000 mgr.gibba020.yqfnwy (mgr.34427) 5177 : cluster [DBG] pgmap v2940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:43.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:43 gibba013 bash[29418]: cluster 2021-03-10T15:30:42.636521+0000 mgr.gibba020.yqfnwy (mgr.34427) 5178 : cluster [DBG] pgmap v2941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:43.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:43 gibba013 bash[30381]: cluster 2021-03-10T15:30:42.636521+0000 mgr.gibba020.yqfnwy (mgr.34427) 5178 : cluster [DBG] pgmap v2941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:43.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:43 gibba020 bash[25448]: cluster 2021-03-10T15:30:42.636521+0000 mgr.gibba020.yqfnwy (mgr.34427) 5178 : cluster [DBG] pgmap v2941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:46.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:45 gibba013 bash[29418]: cluster 2021-03-10T15:30:44.638188+0000 mgr.gibba020.yqfnwy (mgr.34427) 5179 : cluster [DBG] pgmap v2942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:46.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:45 gibba013 bash[30381]: cluster 2021-03-10T15:30:44.638188+0000 mgr.gibba020.yqfnwy (mgr.34427) 5179 : cluster [DBG] pgmap v2942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:46.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:45 gibba020 bash[25448]: cluster 2021-03-10T15:30:44.638188+0000 mgr.gibba020.yqfnwy (mgr.34427) 5179 : cluster [DBG] pgmap v2942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:48.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:47 gibba013 bash[29418]: cluster 2021-03-10T15:30:46.639123+0000 mgr.gibba020.yqfnwy (mgr.34427) 5180 : cluster [DBG] pgmap v2943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:48.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:47 gibba013 bash[30381]: cluster 2021-03-10T15:30:46.639123+0000 mgr.gibba020.yqfnwy (mgr.34427) 5180 : cluster [DBG] pgmap v2943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:48.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:47 gibba020 bash[25448]: cluster 2021-03-10T15:30:46.639123+0000 mgr.gibba020.yqfnwy (mgr.34427) 5180 : cluster [DBG] pgmap v2943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:50.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:49 gibba013 bash[30381]: cluster 2021-03-10T15:30:48.640518+0000 mgr.gibba020.yqfnwy (mgr.34427) 5181 : cluster [DBG] pgmap v2944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:50.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:49 gibba013 bash[29418]: cluster 2021-03-10T15:30:48.640518+0000 mgr.gibba020.yqfnwy (mgr.34427) 5181 : cluster [DBG] pgmap v2944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:50.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:49 gibba020 bash[25448]: cluster 2021-03-10T15:30:48.640518+0000 mgr.gibba020.yqfnwy (mgr.34427) 5181 : cluster [DBG] pgmap v2944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:52.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:51 gibba013 bash[29418]: cluster 2021-03-10T15:30:50.642199+0000 mgr.gibba020.yqfnwy (mgr.34427) 5182 : cluster [DBG] pgmap v2945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:52.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:51 gibba013 bash[29418]: cephadm 2021-03-10T15:30:51.168960+0000 mgr.gibba020.yqfnwy (mgr.34427) 5183 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:30:52.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:51 gibba013 bash[30381]: cluster 2021-03-10T15:30:50.642199+0000 mgr.gibba020.yqfnwy (mgr.34427) 5182 : cluster [DBG] pgmap v2945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:52.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:51 gibba013 bash[30381]: cephadm 2021-03-10T15:30:51.168960+0000 mgr.gibba020.yqfnwy (mgr.34427) 5183 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:30:52.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:51 gibba020 bash[25448]: cluster 2021-03-10T15:30:50.642199+0000 mgr.gibba020.yqfnwy (mgr.34427) 5182 : cluster [DBG] pgmap v2945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:52.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:51 gibba020 bash[25448]: cephadm 2021-03-10T15:30:51.168960+0000 mgr.gibba020.yqfnwy (mgr.34427) 5183 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:30:53.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:53 gibba013 bash[29418]: cluster 2021-03-10T15:30:52.643769+0000 mgr.gibba020.yqfnwy (mgr.34427) 5184 : cluster [DBG] pgmap v2946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:53.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:53 gibba013 bash[30381]: cluster 2021-03-10T15:30:52.643769+0000 mgr.gibba020.yqfnwy (mgr.34427) 5184 : cluster [DBG] pgmap v2946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:53.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:53 gibba020 bash[25448]: cluster 2021-03-10T15:30:52.643769+0000 mgr.gibba020.yqfnwy (mgr.34427) 5184 : cluster [DBG] pgmap v2946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:56.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:55 gibba013 bash[29418]: cluster 2021-03-10T15:30:54.645193+0000 mgr.gibba020.yqfnwy (mgr.34427) 5185 : cluster [DBG] pgmap v2947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:56.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:55 gibba013 bash[30381]: cluster 2021-03-10T15:30:54.645193+0000 mgr.gibba020.yqfnwy (mgr.34427) 5185 : cluster [DBG] pgmap v2947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:56.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:55 gibba020 bash[25448]: cluster 2021-03-10T15:30:54.645193+0000 mgr.gibba020.yqfnwy (mgr.34427) 5185 : cluster [DBG] pgmap v2947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:58.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:57 gibba013 bash[29418]: cluster 2021-03-10T15:30:56.646674+0000 mgr.gibba020.yqfnwy (mgr.34427) 5186 : cluster [DBG] pgmap v2948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:58.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:57 gibba013 bash[30381]: cluster 2021-03-10T15:30:56.646674+0000 mgr.gibba020.yqfnwy (mgr.34427) 5186 : cluster [DBG] pgmap v2948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:30:58.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:57 gibba020 bash[25448]: cluster 2021-03-10T15:30:56.646674+0000 mgr.gibba020.yqfnwy (mgr.34427) 5186 : cluster [DBG] pgmap v2948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:00.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:30:59 gibba013 bash[29418]: cluster 2021-03-10T15:30:58.648063+0000 mgr.gibba020.yqfnwy (mgr.34427) 5187 : cluster [DBG] pgmap v2949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:00.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:30:59 gibba013 bash[30381]: cluster 2021-03-10T15:30:58.648063+0000 mgr.gibba020.yqfnwy (mgr.34427) 5187 : cluster [DBG] pgmap v2949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:00.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:30:59 gibba020 bash[25448]: cluster 2021-03-10T15:30:58.648063+0000 mgr.gibba020.yqfnwy (mgr.34427) 5187 : cluster [DBG] pgmap v2949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:02.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:01 gibba013 bash[29418]: cluster 2021-03-10T15:31:00.649817+0000 mgr.gibba020.yqfnwy (mgr.34427) 5188 : cluster [DBG] pgmap v2950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:02.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:01 gibba013 bash[30381]: cluster 2021-03-10T15:31:00.649817+0000 mgr.gibba020.yqfnwy (mgr.34427) 5188 : cluster [DBG] pgmap v2950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:02.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:01 gibba020 bash[25448]: cluster 2021-03-10T15:31:00.649817+0000 mgr.gibba020.yqfnwy (mgr.34427) 5188 : cluster [DBG] pgmap v2950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:03.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:03 gibba013 bash[29418]: cluster 2021-03-10T15:31:02.651226+0000 mgr.gibba020.yqfnwy (mgr.34427) 5189 : cluster [DBG] pgmap v2951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:03.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:03 gibba013 bash[30381]: cluster 2021-03-10T15:31:02.651226+0000 mgr.gibba020.yqfnwy (mgr.34427) 5189 : cluster [DBG] pgmap v2951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:03.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:03 gibba020 bash[25448]: cluster 2021-03-10T15:31:02.651226+0000 mgr.gibba020.yqfnwy (mgr.34427) 5189 : cluster [DBG] pgmap v2951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:06.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:05 gibba013 bash[29418]: cluster 2021-03-10T15:31:04.652820+0000 mgr.gibba020.yqfnwy (mgr.34427) 5190 : cluster [DBG] pgmap v2952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:06.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:05 gibba013 bash[30381]: cluster 2021-03-10T15:31:04.652820+0000 mgr.gibba020.yqfnwy (mgr.34427) 5190 : cluster [DBG] pgmap v2952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:06.183 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:05 gibba020 bash[25448]: cluster 2021-03-10T15:31:04.652820+0000 mgr.gibba020.yqfnwy (mgr.34427) 5190 : cluster [DBG] pgmap v2952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:07.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:06 gibba013 bash[29418]: cephadm 2021-03-10T15:31:06.178251+0000 mgr.gibba020.yqfnwy (mgr.34427) 5191 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:31:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:06 gibba013 bash[29418]: audit 2021-03-10T15:31:06.464685+0000 mon.a (mon.0) 2119 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:31:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:06 gibba013 bash[29418]: audit 2021-03-10T15:31:06.530152+0000 mon.a (mon.0) 2120 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:31:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:06 gibba013 bash[29418]: audit 2021-03-10T15:31:06.642017+0000 mon.a (mon.0) 2121 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T15:31:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:06 gibba013 bash[29418]: audit 2021-03-10T15:31:06.642246+0000 mon.a (mon.0) 2122 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:31:07.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:06 gibba013 bash[29418]: audit 2021-03-10T15:31:06.642455+0000 mon.a (mon.0) 2123 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T15:31:07.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:06 gibba013 bash[29418]: audit 2021-03-10T15:31:06.642650+0000 mon.a (mon.0) 2124 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:31:07.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:06 gibba013 bash[30381]: cephadm 2021-03-10T15:31:06.178251+0000 mgr.gibba020.yqfnwy (mgr.34427) 5191 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:31:07.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:06 gibba013 bash[30381]: audit 2021-03-10T15:31:06.464685+0000 mon.a (mon.0) 2119 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:31:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:06 gibba013 bash[30381]: audit 2021-03-10T15:31:06.530152+0000 mon.a (mon.0) 2120 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:31:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:06 gibba013 bash[30381]: audit 2021-03-10T15:31:06.642017+0000 mon.a (mon.0) 2121 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T15:31:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:06 gibba013 bash[30381]: audit 2021-03-10T15:31:06.642246+0000 mon.a (mon.0) 2122 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:31:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:06 gibba013 bash[30381]: audit 2021-03-10T15:31:06.642455+0000 mon.a (mon.0) 2123 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T15:31:07.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:06 gibba013 bash[30381]: audit 2021-03-10T15:31:06.642650+0000 mon.a (mon.0) 2124 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:31:07.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:06 gibba020 bash[25448]: cephadm 2021-03-10T15:31:06.178251+0000 mgr.gibba020.yqfnwy (mgr.34427) 5191 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:31:07.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:06 gibba020 bash[25448]: audit 2021-03-10T15:31:06.464685+0000 mon.a (mon.0) 2119 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:31:07.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:06 gibba020 bash[25448]: audit 2021-03-10T15:31:06.530152+0000 mon.a (mon.0) 2120 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:31:07.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:06 gibba020 bash[25448]: audit 2021-03-10T15:31:06.642017+0000 mon.a (mon.0) 2121 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T15:31:07.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:06 gibba020 bash[25448]: audit 2021-03-10T15:31:06.642246+0000 mon.a (mon.0) 2122 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:31:07.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:06 gibba020 bash[25448]: audit 2021-03-10T15:31:06.642455+0000 mon.a (mon.0) 2123 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T15:31:07.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:06 gibba020 bash[25448]: audit 2021-03-10T15:31:06.642650+0000 mon.a (mon.0) 2124 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:31:08.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:07 gibba013 bash[29418]: cluster 2021-03-10T15:31:06.653710+0000 mgr.gibba020.yqfnwy (mgr.34427) 5192 : cluster [DBG] pgmap v2953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:08.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:07 gibba013 bash[30381]: cluster 2021-03-10T15:31:06.653710+0000 mgr.gibba020.yqfnwy (mgr.34427) 5192 : cluster [DBG] pgmap v2953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:08.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:07 gibba020 bash[25448]: cluster 2021-03-10T15:31:06.653710+0000 mgr.gibba020.yqfnwy (mgr.34427) 5192 : cluster [DBG] pgmap v2953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:09.990 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:31:10.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:09 gibba013 bash[29418]: cluster 2021-03-10T15:31:08.655242+0000 mgr.gibba020.yqfnwy (mgr.34427) 5193 : cluster [DBG] pgmap v2954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:10.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:09 gibba013 bash[30381]: cluster 2021-03-10T15:31:08.655242+0000 mgr.gibba020.yqfnwy (mgr.34427) 5193 : cluster [DBG] pgmap v2954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:10.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:09 gibba020 bash[25448]: cluster 2021-03-10T15:31:08.655242+0000 mgr.gibba020.yqfnwy (mgr.34427) 5193 : cluster [DBG] pgmap v2954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:10.248 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:31:10.249 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (97m) 113s ago 103m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:31:10.249 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (102m) 49s ago 102m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:31:10.249 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (98m) 49s ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:31:10.249 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (98m) 49s ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:31:10.249 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (97m) 113s ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:31:10.250 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (97m) 113s ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:31:10.250 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (96m) 49s ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:31:10.250 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (96m) 113s ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:31:10.250 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (103m) 113s ago 103m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:31:10.251 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (103m) 49s ago 103m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:31:10.251 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (95m) 113s ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:31:10.251 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (95m) 113s ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:31:10.251 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (95m) 113s ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:31:10.252 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (94m) 113s ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:31:10.252 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (94m) 49s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:31:10.252 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (93m) 49s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:31:10.252 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (93m) 49s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:31:10.252 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (92m) 49s ago 103m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:31:10.253 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (102m) 49s ago 103m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:31:10.253 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 49s ago 101m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:31:10.504 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:31:10.505 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:31:10.505 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:31:10.505 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:31:10.505 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:31:10.505 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:31:10.506 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:31:10.506 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:31:10.506 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:31:10.506 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:31:10.507 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:31:10.507 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:31:10.507 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:31:10.507 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:31:10.508 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:31:11.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:10 gibba013 bash[29418]: audit 2021-03-10T15:31:09.976952+0000 mgr.gibba020.yqfnwy (mgr.34427) 5194 : audit [DBG] from='client.57529 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:31:11.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:10 gibba013 bash[29418]: audit 2021-03-10T15:31:10.202979+0000 mgr.gibba020.yqfnwy (mgr.34427) 5195 : audit [DBG] from='client.57535 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:31:11.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:10 gibba013 bash[29418]: audit 2021-03-10T15:31:10.500447+0000 mon.c (mon.1) 87 : audit [DBG] from='client.? 172.21.2.113:0/2358144787' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:11.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:10 gibba013 bash[30381]: audit 2021-03-10T15:31:09.976952+0000 mgr.gibba020.yqfnwy (mgr.34427) 5194 : audit [DBG] from='client.57529 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:31:11.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:10 gibba013 bash[30381]: audit 2021-03-10T15:31:10.202979+0000 mgr.gibba020.yqfnwy (mgr.34427) 5195 : audit [DBG] from='client.57535 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:31:11.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:10 gibba013 bash[30381]: audit 2021-03-10T15:31:10.500447+0000 mon.c (mon.1) 87 : audit [DBG] from='client.? 172.21.2.113:0/2358144787' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:11.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:10 gibba020 bash[25448]: audit 2021-03-10T15:31:09.976952+0000 mgr.gibba020.yqfnwy (mgr.34427) 5194 : audit [DBG] from='client.57529 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:31:11.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:10 gibba020 bash[25448]: audit 2021-03-10T15:31:10.202979+0000 mgr.gibba020.yqfnwy (mgr.34427) 5195 : audit [DBG] from='client.57535 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:31:11.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:10 gibba020 bash[25448]: audit 2021-03-10T15:31:10.500447+0000 mon.c (mon.1) 87 : audit [DBG] from='client.? 172.21.2.113:0/2358144787' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:12.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:11 gibba013 bash[29418]: cluster 2021-03-10T15:31:10.656970+0000 mgr.gibba020.yqfnwy (mgr.34427) 5196 : cluster [DBG] pgmap v2955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:12.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:11 gibba013 bash[30381]: cluster 2021-03-10T15:31:10.656970+0000 mgr.gibba020.yqfnwy (mgr.34427) 5196 : cluster [DBG] pgmap v2955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:12.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:11 gibba020 bash[25448]: cluster 2021-03-10T15:31:10.656970+0000 mgr.gibba020.yqfnwy (mgr.34427) 5196 : cluster [DBG] pgmap v2955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:13.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:13 gibba013 bash[29418]: cluster 2021-03-10T15:31:12.658460+0000 mgr.gibba020.yqfnwy (mgr.34427) 5197 : cluster [DBG] pgmap v2956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:13.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:13 gibba013 bash[30381]: cluster 2021-03-10T15:31:12.658460+0000 mgr.gibba020.yqfnwy (mgr.34427) 5197 : cluster [DBG] pgmap v2956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:13.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:13 gibba020 bash[25448]: cluster 2021-03-10T15:31:12.658460+0000 mgr.gibba020.yqfnwy (mgr.34427) 5197 : cluster [DBG] pgmap v2956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:16.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:15 gibba013 bash[29418]: cluster 2021-03-10T15:31:14.659894+0000 mgr.gibba020.yqfnwy (mgr.34427) 5198 : cluster [DBG] pgmap v2957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:16.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:15 gibba013 bash[30381]: cluster 2021-03-10T15:31:14.659894+0000 mgr.gibba020.yqfnwy (mgr.34427) 5198 : cluster [DBG] pgmap v2957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:16.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:15 gibba020 bash[25448]: cluster 2021-03-10T15:31:14.659894+0000 mgr.gibba020.yqfnwy (mgr.34427) 5198 : cluster [DBG] pgmap v2957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:18.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:17 gibba013 bash[29418]: cluster 2021-03-10T15:31:16.660946+0000 mgr.gibba020.yqfnwy (mgr.34427) 5199 : cluster [DBG] pgmap v2958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:18.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:17 gibba013 bash[30381]: cluster 2021-03-10T15:31:16.660946+0000 mgr.gibba020.yqfnwy (mgr.34427) 5199 : cluster [DBG] pgmap v2958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:18.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:17 gibba020 bash[25448]: cluster 2021-03-10T15:31:16.660946+0000 mgr.gibba020.yqfnwy (mgr.34427) 5199 : cluster [DBG] pgmap v2958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:20.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:19 gibba013 bash[29418]: cluster 2021-03-10T15:31:18.662338+0000 mgr.gibba020.yqfnwy (mgr.34427) 5200 : cluster [DBG] pgmap v2959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:20.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:19 gibba013 bash[30381]: cluster 2021-03-10T15:31:18.662338+0000 mgr.gibba020.yqfnwy (mgr.34427) 5200 : cluster [DBG] pgmap v2959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:20.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:19 gibba020 bash[25448]: cluster 2021-03-10T15:31:18.662338+0000 mgr.gibba020.yqfnwy (mgr.34427) 5200 : cluster [DBG] pgmap v2959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:22.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:21 gibba013 bash[29418]: cluster 2021-03-10T15:31:20.663985+0000 mgr.gibba020.yqfnwy (mgr.34427) 5201 : cluster [DBG] pgmap v2960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:22.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:21 gibba013 bash[29418]: audit 2021-03-10T15:31:21.195606+0000 mon.a (mon.0) 2125 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:31:22.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:21 gibba013 bash[29418]: cephadm 2021-03-10T15:31:21.200540+0000 mgr.gibba020.yqfnwy (mgr.34427) 5202 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:31:22.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:21 gibba013 bash[29418]: cephadm 2021-03-10T15:31:21.202434+0000 mgr.gibba020.yqfnwy (mgr.34427) 5203 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:31:22.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:21 gibba013 bash[29418]: audit 2021-03-10T15:31:21.406829+0000 mon.a (mon.0) 2126 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:31:22.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:21 gibba013 bash[29418]: audit 2021-03-10T15:31:21.410123+0000 mon.a (mon.0) 2127 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:31:22.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:21 gibba013 bash[29418]: audit 2021-03-10T15:31:21.412010+0000 mon.a (mon.0) 2128 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:22.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:21 gibba013 bash[29418]: audit 2021-03-10T15:31:21.413647+0000 mon.a (mon.0) 2129 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:22.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:21 gibba013 bash[29418]: audit 2021-03-10T15:31:21.415086+0000 mon.a (mon.0) 2130 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:22.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:21 gibba013 bash[29418]: audit 2021-03-10T15:31:21.418324+0000 mon.a (mon.0) 2131 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:22.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:21 gibba013 bash[29418]: audit 2021-03-10T15:31:21.420255+0000 mon.a (mon.0) 2132 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:22.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:21 gibba013 bash[30381]: cluster 2021-03-10T15:31:20.663985+0000 mgr.gibba020.yqfnwy (mgr.34427) 5201 : cluster [DBG] pgmap v2960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:22.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:21 gibba013 bash[30381]: audit 2021-03-10T15:31:21.195606+0000 mon.a (mon.0) 2125 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:31:22.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:21 gibba013 bash[30381]: cephadm 2021-03-10T15:31:21.200540+0000 mgr.gibba020.yqfnwy (mgr.34427) 5202 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:31:22.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:21 gibba013 bash[30381]: cephadm 2021-03-10T15:31:21.202434+0000 mgr.gibba020.yqfnwy (mgr.34427) 5203 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:31:22.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:21 gibba013 bash[30381]: audit 2021-03-10T15:31:21.406829+0000 mon.a (mon.0) 2126 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:31:22.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:21 gibba013 bash[30381]: audit 2021-03-10T15:31:21.410123+0000 mon.a (mon.0) 2127 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:31:22.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:21 gibba013 bash[30381]: audit 2021-03-10T15:31:21.412010+0000 mon.a (mon.0) 2128 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:22.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:21 gibba013 bash[30381]: audit 2021-03-10T15:31:21.413647+0000 mon.a (mon.0) 2129 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:22.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:21 gibba013 bash[30381]: audit 2021-03-10T15:31:21.415086+0000 mon.a (mon.0) 2130 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:22.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:21 gibba013 bash[30381]: audit 2021-03-10T15:31:21.418324+0000 mon.a (mon.0) 2131 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:22.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:21 gibba013 bash[30381]: audit 2021-03-10T15:31:21.420255+0000 mon.a (mon.0) 2132 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:22.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:21 gibba020 bash[25448]: cluster 2021-03-10T15:31:20.663985+0000 mgr.gibba020.yqfnwy (mgr.34427) 5201 : cluster [DBG] pgmap v2960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:22.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:21 gibba020 bash[25448]: audit 2021-03-10T15:31:21.195606+0000 mon.a (mon.0) 2125 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:31:22.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:21 gibba020 bash[25448]: cephadm 2021-03-10T15:31:21.200540+0000 mgr.gibba020.yqfnwy (mgr.34427) 5202 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:31:22.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:21 gibba020 bash[25448]: cephadm 2021-03-10T15:31:21.202434+0000 mgr.gibba020.yqfnwy (mgr.34427) 5203 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:31:22.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:21 gibba020 bash[25448]: audit 2021-03-10T15:31:21.406829+0000 mon.a (mon.0) 2126 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:31:22.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:21 gibba020 bash[25448]: audit 2021-03-10T15:31:21.410123+0000 mon.a (mon.0) 2127 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:31:22.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:21 gibba020 bash[25448]: audit 2021-03-10T15:31:21.412010+0000 mon.a (mon.0) 2128 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:22.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:21 gibba020 bash[25448]: audit 2021-03-10T15:31:21.413647+0000 mon.a (mon.0) 2129 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:22.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:21 gibba020 bash[25448]: audit 2021-03-10T15:31:21.415086+0000 mon.a (mon.0) 2130 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:22.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:21 gibba020 bash[25448]: audit 2021-03-10T15:31:21.418324+0000 mon.a (mon.0) 2131 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:22.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:21 gibba020 bash[25448]: audit 2021-03-10T15:31:21.420255+0000 mon.a (mon.0) 2132 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:23.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:22 gibba013 bash[29418]: cephadm 2021-03-10T15:31:21.408736+0000 mgr.gibba020.yqfnwy (mgr.34427) 5204 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:31:23.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:22 gibba013 bash[29418]: cephadm 2021-03-10T15:31:21.410670+0000 mgr.gibba020.yqfnwy (mgr.34427) 5205 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:31:23.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:22 gibba013 bash[29418]: cephadm 2021-03-10T15:31:21.412373+0000 mgr.gibba020.yqfnwy (mgr.34427) 5206 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:31:23.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:22 gibba013 bash[29418]: cephadm 2021-03-10T15:31:21.412409+0000 mgr.gibba020.yqfnwy (mgr.34427) 5207 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:31:23.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:22 gibba013 bash[29418]: cephadm 2021-03-10T15:31:21.413819+0000 mgr.gibba020.yqfnwy (mgr.34427) 5208 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:31:23.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:22 gibba013 bash[29418]: cephadm 2021-03-10T15:31:21.413855+0000 mgr.gibba020.yqfnwy (mgr.34427) 5209 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:31:23.138 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:22 gibba013 bash[29418]: cephadm 2021-03-10T15:31:21.415519+0000 mgr.gibba020.yqfnwy (mgr.34427) 5210 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:31:23.138 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:22 gibba013 bash[29418]: cephadm 2021-03-10T15:31:21.417182+0000 mgr.gibba020.yqfnwy (mgr.34427) 5211 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:31:23.138 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:22 gibba013 bash[29418]: cephadm 2021-03-10T15:31:21.417217+0000 mgr.gibba020.yqfnwy (mgr.34427) 5212 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:31:23.138 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:22 gibba013 bash[29418]: cephadm 2021-03-10T15:31:21.418803+0000 mgr.gibba020.yqfnwy (mgr.34427) 5213 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:31:23.139 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:22 gibba013 bash[29418]: cephadm 2021-03-10T15:31:21.419136+0000 mgr.gibba020.yqfnwy (mgr.34427) 5214 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:31:23.139 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:22 gibba013 bash[29418]: cephadm 2021-03-10T15:31:21.420776+0000 mgr.gibba020.yqfnwy (mgr.34427) 5215 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:31:23.139 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:22 gibba013 bash[29418]: cephadm 2021-03-10T15:31:21.420813+0000 mgr.gibba020.yqfnwy (mgr.34427) 5216 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:31:23.139 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:22 gibba013 bash[29418]: cephadm 2021-03-10T15:31:21.420918+0000 mgr.gibba020.yqfnwy (mgr.34427) 5217 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:31:23.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:22 gibba013 bash[30381]: cephadm 2021-03-10T15:31:21.408736+0000 mgr.gibba020.yqfnwy (mgr.34427) 5204 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:31:23.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:22 gibba013 bash[30381]: cephadm 2021-03-10T15:31:21.410670+0000 mgr.gibba020.yqfnwy (mgr.34427) 5205 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:31:23.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:22 gibba013 bash[30381]: cephadm 2021-03-10T15:31:21.412373+0000 mgr.gibba020.yqfnwy (mgr.34427) 5206 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:31:23.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:22 gibba013 bash[30381]: cephadm 2021-03-10T15:31:21.412409+0000 mgr.gibba020.yqfnwy (mgr.34427) 5207 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:31:23.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:22 gibba013 bash[30381]: cephadm 2021-03-10T15:31:21.413819+0000 mgr.gibba020.yqfnwy (mgr.34427) 5208 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:31:23.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:22 gibba013 bash[30381]: cephadm 2021-03-10T15:31:21.413855+0000 mgr.gibba020.yqfnwy (mgr.34427) 5209 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:31:23.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:22 gibba013 bash[30381]: cephadm 2021-03-10T15:31:21.415519+0000 mgr.gibba020.yqfnwy (mgr.34427) 5210 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:31:23.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:22 gibba013 bash[30381]: cephadm 2021-03-10T15:31:21.417182+0000 mgr.gibba020.yqfnwy (mgr.34427) 5211 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:31:23.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:22 gibba013 bash[30381]: cephadm 2021-03-10T15:31:21.417217+0000 mgr.gibba020.yqfnwy (mgr.34427) 5212 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:31:23.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:22 gibba013 bash[30381]: cephadm 2021-03-10T15:31:21.418803+0000 mgr.gibba020.yqfnwy (mgr.34427) 5213 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:31:23.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:22 gibba013 bash[30381]: cephadm 2021-03-10T15:31:21.419136+0000 mgr.gibba020.yqfnwy (mgr.34427) 5214 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:31:23.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:22 gibba013 bash[30381]: cephadm 2021-03-10T15:31:21.420776+0000 mgr.gibba020.yqfnwy (mgr.34427) 5215 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:31:23.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:22 gibba013 bash[30381]: cephadm 2021-03-10T15:31:21.420813+0000 mgr.gibba020.yqfnwy (mgr.34427) 5216 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:31:23.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:22 gibba013 bash[30381]: cephadm 2021-03-10T15:31:21.420918+0000 mgr.gibba020.yqfnwy (mgr.34427) 5217 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:31:23.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:22 gibba020 bash[25448]: cephadm 2021-03-10T15:31:21.408736+0000 mgr.gibba020.yqfnwy (mgr.34427) 5204 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:31:23.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:22 gibba020 bash[25448]: cephadm 2021-03-10T15:31:21.410670+0000 mgr.gibba020.yqfnwy (mgr.34427) 5205 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:31:23.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:22 gibba020 bash[25448]: cephadm 2021-03-10T15:31:21.412373+0000 mgr.gibba020.yqfnwy (mgr.34427) 5206 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:31:23.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:22 gibba020 bash[25448]: cephadm 2021-03-10T15:31:21.412409+0000 mgr.gibba020.yqfnwy (mgr.34427) 5207 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:31:23.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:22 gibba020 bash[25448]: cephadm 2021-03-10T15:31:21.413819+0000 mgr.gibba020.yqfnwy (mgr.34427) 5208 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:31:23.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:22 gibba020 bash[25448]: cephadm 2021-03-10T15:31:21.413855+0000 mgr.gibba020.yqfnwy (mgr.34427) 5209 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:31:23.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:22 gibba020 bash[25448]: cephadm 2021-03-10T15:31:21.415519+0000 mgr.gibba020.yqfnwy (mgr.34427) 5210 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:31:23.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:22 gibba020 bash[25448]: cephadm 2021-03-10T15:31:21.417182+0000 mgr.gibba020.yqfnwy (mgr.34427) 5211 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:31:23.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:22 gibba020 bash[25448]: cephadm 2021-03-10T15:31:21.417217+0000 mgr.gibba020.yqfnwy (mgr.34427) 5212 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:31:23.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:22 gibba020 bash[25448]: cephadm 2021-03-10T15:31:21.418803+0000 mgr.gibba020.yqfnwy (mgr.34427) 5213 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:31:23.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:22 gibba020 bash[25448]: cephadm 2021-03-10T15:31:21.419136+0000 mgr.gibba020.yqfnwy (mgr.34427) 5214 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:31:23.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:22 gibba020 bash[25448]: cephadm 2021-03-10T15:31:21.420776+0000 mgr.gibba020.yqfnwy (mgr.34427) 5215 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:31:23.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:22 gibba020 bash[25448]: cephadm 2021-03-10T15:31:21.420813+0000 mgr.gibba020.yqfnwy (mgr.34427) 5216 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:31:23.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:22 gibba020 bash[25448]: cephadm 2021-03-10T15:31:21.420918+0000 mgr.gibba020.yqfnwy (mgr.34427) 5217 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:31:24.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:23 gibba013 bash[29418]: cluster 2021-03-10T15:31:22.665536+0000 mgr.gibba020.yqfnwy (mgr.34427) 5218 : cluster [DBG] pgmap v2961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:24.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:23 gibba013 bash[30381]: cluster 2021-03-10T15:31:22.665536+0000 mgr.gibba020.yqfnwy (mgr.34427) 5218 : cluster [DBG] pgmap v2961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:24.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:23 gibba020 bash[25448]: cluster 2021-03-10T15:31:22.665536+0000 mgr.gibba020.yqfnwy (mgr.34427) 5218 : cluster [DBG] pgmap v2961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:26.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:25 gibba013 bash[29418]: cluster 2021-03-10T15:31:24.667133+0000 mgr.gibba020.yqfnwy (mgr.34427) 5219 : cluster [DBG] pgmap v2962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:26.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:25 gibba013 bash[30381]: cluster 2021-03-10T15:31:24.667133+0000 mgr.gibba020.yqfnwy (mgr.34427) 5219 : cluster [DBG] pgmap v2962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:26.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:25 gibba020 bash[25448]: cluster 2021-03-10T15:31:24.667133+0000 mgr.gibba020.yqfnwy (mgr.34427) 5219 : cluster [DBG] pgmap v2962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:28.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:27 gibba013 bash[29418]: cluster 2021-03-10T15:31:26.668070+0000 mgr.gibba020.yqfnwy (mgr.34427) 5220 : cluster [DBG] pgmap v2963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:28.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:27 gibba013 bash[30381]: cluster 2021-03-10T15:31:26.668070+0000 mgr.gibba020.yqfnwy (mgr.34427) 5220 : cluster [DBG] pgmap v2963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:28.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:27 gibba020 bash[25448]: cluster 2021-03-10T15:31:26.668070+0000 mgr.gibba020.yqfnwy (mgr.34427) 5220 : cluster [DBG] pgmap v2963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:30.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:29 gibba013 bash[29418]: cluster 2021-03-10T15:31:28.669640+0000 mgr.gibba020.yqfnwy (mgr.34427) 5221 : cluster [DBG] pgmap v2964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:30.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:29 gibba013 bash[30381]: cluster 2021-03-10T15:31:28.669640+0000 mgr.gibba020.yqfnwy (mgr.34427) 5221 : cluster [DBG] pgmap v2964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:30.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:29 gibba020 bash[25448]: cluster 2021-03-10T15:31:28.669640+0000 mgr.gibba020.yqfnwy (mgr.34427) 5221 : cluster [DBG] pgmap v2964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:32.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:31 gibba013 bash[29418]: cluster 2021-03-10T15:31:30.671374+0000 mgr.gibba020.yqfnwy (mgr.34427) 5222 : cluster [DBG] pgmap v2965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:32.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:31 gibba013 bash[30381]: cluster 2021-03-10T15:31:30.671374+0000 mgr.gibba020.yqfnwy (mgr.34427) 5222 : cluster [DBG] pgmap v2965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:32.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:31 gibba020 bash[25448]: cluster 2021-03-10T15:31:30.671374+0000 mgr.gibba020.yqfnwy (mgr.34427) 5222 : cluster [DBG] pgmap v2965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:33.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:33 gibba013 bash[29418]: cluster 2021-03-10T15:31:32.672823+0000 mgr.gibba020.yqfnwy (mgr.34427) 5223 : cluster [DBG] pgmap v2966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:33.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:33 gibba013 bash[30381]: cluster 2021-03-10T15:31:32.672823+0000 mgr.gibba020.yqfnwy (mgr.34427) 5223 : cluster [DBG] pgmap v2966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:33.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:33 gibba020 bash[25448]: cluster 2021-03-10T15:31:32.672823+0000 mgr.gibba020.yqfnwy (mgr.34427) 5223 : cluster [DBG] pgmap v2966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:36.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:35 gibba013 bash[29418]: cluster 2021-03-10T15:31:34.674422+0000 mgr.gibba020.yqfnwy (mgr.34427) 5224 : cluster [DBG] pgmap v2967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:36.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:35 gibba013 bash[30381]: cluster 2021-03-10T15:31:34.674422+0000 mgr.gibba020.yqfnwy (mgr.34427) 5224 : cluster [DBG] pgmap v2967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:36.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:35 gibba020 bash[25448]: cluster 2021-03-10T15:31:34.674422+0000 mgr.gibba020.yqfnwy (mgr.34427) 5224 : cluster [DBG] pgmap v2967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:38.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:37 gibba013 bash[29418]: cephadm 2021-03-10T15:31:36.428907+0000 mgr.gibba020.yqfnwy (mgr.34427) 5225 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:31:38.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:37 gibba013 bash[29418]: cluster 2021-03-10T15:31:36.675386+0000 mgr.gibba020.yqfnwy (mgr.34427) 5226 : cluster [DBG] pgmap v2968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:38.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:37 gibba013 bash[30381]: cephadm 2021-03-10T15:31:36.428907+0000 mgr.gibba020.yqfnwy (mgr.34427) 5225 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:31:38.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:37 gibba013 bash[30381]: cluster 2021-03-10T15:31:36.675386+0000 mgr.gibba020.yqfnwy (mgr.34427) 5226 : cluster [DBG] pgmap v2968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:38.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:37 gibba020 bash[25448]: cephadm 2021-03-10T15:31:36.428907+0000 mgr.gibba020.yqfnwy (mgr.34427) 5225 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:31:38.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:37 gibba020 bash[25448]: cluster 2021-03-10T15:31:36.675386+0000 mgr.gibba020.yqfnwy (mgr.34427) 5226 : cluster [DBG] pgmap v2968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:40.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:39 gibba013 bash[29418]: cluster 2021-03-10T15:31:38.676911+0000 mgr.gibba020.yqfnwy (mgr.34427) 5227 : cluster [DBG] pgmap v2969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:40.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:39 gibba013 bash[30381]: cluster 2021-03-10T15:31:38.676911+0000 mgr.gibba020.yqfnwy (mgr.34427) 5227 : cluster [DBG] pgmap v2969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:40.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:39 gibba020 bash[25448]: cluster 2021-03-10T15:31:38.676911+0000 mgr.gibba020.yqfnwy (mgr.34427) 5227 : cluster [DBG] pgmap v2969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:40.749 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:31:40.977 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:31:40.978 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (98m) 2m ago 103m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:31:40.978 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (103m) 80s ago 103m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:31:40.978 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (98m) 80s ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:31:40.979 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (98m) 80s ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:31:40.979 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (97m) 2m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:31:40.979 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (97m) 2m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:31:40.979 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (97m) 80s ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:31:40.980 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (97m) 2m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:31:40.980 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (103m) 2m ago 103m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:31:40.980 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (103m) 80s ago 103m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:31:40.980 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (96m) 2m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:31:40.981 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (96m) 2m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:31:40.981 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (95m) 2m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:31:40.981 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (95m) 2m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:31:40.981 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (94m) 80s ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:31:40.982 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (94m) 80s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:31:40.982 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (93m) 80s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:31:40.982 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (93m) 80s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:31:40.982 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (103m) 80s ago 103m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:31:40.983 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 80s ago 101m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:31:41.228 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:31:41.228 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:31:41.229 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:31:41.229 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:31:41.229 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:31:41.229 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:31:41.229 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:31:41.230 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:31:41.230 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:31:41.230 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:31:41.230 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:31:41.231 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:31:41.231 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:31:41.231 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:31:41.231 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:31:42.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:41 gibba013 bash[29418]: cluster 2021-03-10T15:31:40.678595+0000 mgr.gibba020.yqfnwy (mgr.34427) 5228 : cluster [DBG] pgmap v2970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:42.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:41 gibba013 bash[29418]: audit 2021-03-10T15:31:40.735761+0000 mgr.gibba020.yqfnwy (mgr.34427) 5229 : audit [DBG] from='client.47562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:31:42.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:41 gibba013 bash[29418]: audit 2021-03-10T15:31:40.960090+0000 mgr.gibba020.yqfnwy (mgr.34427) 5230 : audit [DBG] from='client.57553 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:31:42.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:41 gibba013 bash[29418]: audit 2021-03-10T15:31:41.224429+0000 mon.a (mon.0) 2133 : audit [DBG] from='client.? 172.21.2.113:0/1630278082' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:42.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:41 gibba013 bash[30381]: cluster 2021-03-10T15:31:40.678595+0000 mgr.gibba020.yqfnwy (mgr.34427) 5228 : cluster [DBG] pgmap v2970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:42.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:41 gibba013 bash[30381]: audit 2021-03-10T15:31:40.735761+0000 mgr.gibba020.yqfnwy (mgr.34427) 5229 : audit [DBG] from='client.47562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:31:42.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:41 gibba013 bash[30381]: audit 2021-03-10T15:31:40.960090+0000 mgr.gibba020.yqfnwy (mgr.34427) 5230 : audit [DBG] from='client.57553 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:31:42.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:41 gibba013 bash[30381]: audit 2021-03-10T15:31:41.224429+0000 mon.a (mon.0) 2133 : audit [DBG] from='client.? 172.21.2.113:0/1630278082' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:42.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:41 gibba020 bash[25448]: cluster 2021-03-10T15:31:40.678595+0000 mgr.gibba020.yqfnwy (mgr.34427) 5228 : cluster [DBG] pgmap v2970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:42.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:41 gibba020 bash[25448]: audit 2021-03-10T15:31:40.735761+0000 mgr.gibba020.yqfnwy (mgr.34427) 5229 : audit [DBG] from='client.47562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:31:42.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:41 gibba020 bash[25448]: audit 2021-03-10T15:31:40.960090+0000 mgr.gibba020.yqfnwy (mgr.34427) 5230 : audit [DBG] from='client.57553 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:31:42.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:41 gibba020 bash[25448]: audit 2021-03-10T15:31:41.224429+0000 mon.a (mon.0) 2133 : audit [DBG] from='client.? 172.21.2.113:0/1630278082' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:31:43.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:43 gibba013 bash[29418]: cluster 2021-03-10T15:31:42.679882+0000 mgr.gibba020.yqfnwy (mgr.34427) 5231 : cluster [DBG] pgmap v2971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:43.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:43 gibba013 bash[30381]: cluster 2021-03-10T15:31:42.679882+0000 mgr.gibba020.yqfnwy (mgr.34427) 5231 : cluster [DBG] pgmap v2971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:43.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:43 gibba020 bash[25448]: cluster 2021-03-10T15:31:42.679882+0000 mgr.gibba020.yqfnwy (mgr.34427) 5231 : cluster [DBG] pgmap v2971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:46.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:45 gibba013 bash[29418]: cluster 2021-03-10T15:31:44.681453+0000 mgr.gibba020.yqfnwy (mgr.34427) 5232 : cluster [DBG] pgmap v2972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:46.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:45 gibba013 bash[30381]: cluster 2021-03-10T15:31:44.681453+0000 mgr.gibba020.yqfnwy (mgr.34427) 5232 : cluster [DBG] pgmap v2972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:46.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:45 gibba020 bash[25448]: cluster 2021-03-10T15:31:44.681453+0000 mgr.gibba020.yqfnwy (mgr.34427) 5232 : cluster [DBG] pgmap v2972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:48.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:47 gibba013 bash[29418]: cluster 2021-03-10T15:31:46.682441+0000 mgr.gibba020.yqfnwy (mgr.34427) 5233 : cluster [DBG] pgmap v2973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:48.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:47 gibba013 bash[30381]: cluster 2021-03-10T15:31:46.682441+0000 mgr.gibba020.yqfnwy (mgr.34427) 5233 : cluster [DBG] pgmap v2973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:48.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:47 gibba020 bash[25448]: cluster 2021-03-10T15:31:46.682441+0000 mgr.gibba020.yqfnwy (mgr.34427) 5233 : cluster [DBG] pgmap v2973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:50.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:49 gibba013 bash[29418]: cluster 2021-03-10T15:31:48.683976+0000 mgr.gibba020.yqfnwy (mgr.34427) 5234 : cluster [DBG] pgmap v2974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:50.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:49 gibba013 bash[30381]: cluster 2021-03-10T15:31:48.683976+0000 mgr.gibba020.yqfnwy (mgr.34427) 5234 : cluster [DBG] pgmap v2974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:50.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:49 gibba020 bash[25448]: cluster 2021-03-10T15:31:48.683976+0000 mgr.gibba020.yqfnwy (mgr.34427) 5234 : cluster [DBG] pgmap v2974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:52.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:51 gibba013 bash[29418]: cluster 2021-03-10T15:31:50.685477+0000 mgr.gibba020.yqfnwy (mgr.34427) 5235 : cluster [DBG] pgmap v2975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:52.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:51 gibba013 bash[30381]: cluster 2021-03-10T15:31:50.685477+0000 mgr.gibba020.yqfnwy (mgr.34427) 5235 : cluster [DBG] pgmap v2975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:52.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:51 gibba020 bash[25448]: cluster 2021-03-10T15:31:50.685477+0000 mgr.gibba020.yqfnwy (mgr.34427) 5235 : cluster [DBG] pgmap v2975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:53.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:52 gibba013 bash[29418]: cephadm 2021-03-10T15:31:51.444867+0000 mgr.gibba020.yqfnwy (mgr.34427) 5236 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:31:53.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:52 gibba013 bash[30381]: cephadm 2021-03-10T15:31:51.444867+0000 mgr.gibba020.yqfnwy (mgr.34427) 5236 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:31:53.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:52 gibba020 bash[25448]: cephadm 2021-03-10T15:31:51.444867+0000 mgr.gibba020.yqfnwy (mgr.34427) 5236 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:31:54.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:53 gibba013 bash[29418]: cluster 2021-03-10T15:31:52.686996+0000 mgr.gibba020.yqfnwy (mgr.34427) 5237 : cluster [DBG] pgmap v2976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:54.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:53 gibba013 bash[30381]: cluster 2021-03-10T15:31:52.686996+0000 mgr.gibba020.yqfnwy (mgr.34427) 5237 : cluster [DBG] pgmap v2976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:54.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:53 gibba020 bash[25448]: cluster 2021-03-10T15:31:52.686996+0000 mgr.gibba020.yqfnwy (mgr.34427) 5237 : cluster [DBG] pgmap v2976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:56.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:55 gibba013 bash[29418]: cluster 2021-03-10T15:31:54.688691+0000 mgr.gibba020.yqfnwy (mgr.34427) 5238 : cluster [DBG] pgmap v2977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:56.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:55 gibba013 bash[30381]: cluster 2021-03-10T15:31:54.688691+0000 mgr.gibba020.yqfnwy (mgr.34427) 5238 : cluster [DBG] pgmap v2977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:56.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:55 gibba020 bash[25448]: cluster 2021-03-10T15:31:54.688691+0000 mgr.gibba020.yqfnwy (mgr.34427) 5238 : cluster [DBG] pgmap v2977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:58.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:57 gibba013 bash[29418]: cluster 2021-03-10T15:31:56.689591+0000 mgr.gibba020.yqfnwy (mgr.34427) 5239 : cluster [DBG] pgmap v2978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:58.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:57 gibba013 bash[30381]: cluster 2021-03-10T15:31:56.689591+0000 mgr.gibba020.yqfnwy (mgr.34427) 5239 : cluster [DBG] pgmap v2978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:31:58.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:57 gibba020 bash[25448]: cluster 2021-03-10T15:31:56.689591+0000 mgr.gibba020.yqfnwy (mgr.34427) 5239 : cluster [DBG] pgmap v2978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:00.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:31:59 gibba013 bash[29418]: cluster 2021-03-10T15:31:58.690851+0000 mgr.gibba020.yqfnwy (mgr.34427) 5240 : cluster [DBG] pgmap v2979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:00.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:31:59 gibba013 bash[30381]: cluster 2021-03-10T15:31:58.690851+0000 mgr.gibba020.yqfnwy (mgr.34427) 5240 : cluster [DBG] pgmap v2979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:00.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:31:59 gibba020 bash[25448]: cluster 2021-03-10T15:31:58.690851+0000 mgr.gibba020.yqfnwy (mgr.34427) 5240 : cluster [DBG] pgmap v2979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:02.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:01 gibba013 bash[29418]: cluster 2021-03-10T15:32:00.692648+0000 mgr.gibba020.yqfnwy (mgr.34427) 5241 : cluster [DBG] pgmap v2980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:02.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:01 gibba013 bash[30381]: cluster 2021-03-10T15:32:00.692648+0000 mgr.gibba020.yqfnwy (mgr.34427) 5241 : cluster [DBG] pgmap v2980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:02.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:01 gibba020 bash[25448]: cluster 2021-03-10T15:32:00.692648+0000 mgr.gibba020.yqfnwy (mgr.34427) 5241 : cluster [DBG] pgmap v2980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:03.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:03 gibba013 bash[29418]: cluster 2021-03-10T15:32:02.693910+0000 mgr.gibba020.yqfnwy (mgr.34427) 5242 : cluster [DBG] pgmap v2981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:03.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:03 gibba013 bash[30381]: cluster 2021-03-10T15:32:02.693910+0000 mgr.gibba020.yqfnwy (mgr.34427) 5242 : cluster [DBG] pgmap v2981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:03.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:03 gibba020 bash[25448]: cluster 2021-03-10T15:32:02.693910+0000 mgr.gibba020.yqfnwy (mgr.34427) 5242 : cluster [DBG] pgmap v2981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:06.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:05 gibba013 bash[29418]: cluster 2021-03-10T15:32:04.695221+0000 mgr.gibba020.yqfnwy (mgr.34427) 5243 : cluster [DBG] pgmap v2982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:06.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:05 gibba013 bash[30381]: cluster 2021-03-10T15:32:04.695221+0000 mgr.gibba020.yqfnwy (mgr.34427) 5243 : cluster [DBG] pgmap v2982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:06.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:05 gibba020 bash[25448]: cluster 2021-03-10T15:32:04.695221+0000 mgr.gibba020.yqfnwy (mgr.34427) 5243 : cluster [DBG] pgmap v2982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:07.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:06 gibba013 bash[29418]: audit 2021-03-10T15:32:06.469504+0000 mon.a (mon.0) 2134 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:32:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:06 gibba013 bash[29418]: audit 2021-03-10T15:32:06.536705+0000 mon.a (mon.0) 2135 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:32:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:06 gibba013 bash[29418]: audit 2021-03-10T15:32:06.650455+0000 mon.a (mon.0) 2136 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T15:32:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:06 gibba013 bash[29418]: audit 2021-03-10T15:32:06.650618+0000 mon.a (mon.0) 2137 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:32:07.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:06 gibba013 bash[29418]: audit 2021-03-10T15:32:06.650730+0000 mon.a (mon.0) 2138 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:32:07.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:06 gibba013 bash[29418]: audit 2021-03-10T15:32:06.650844+0000 mon.a (mon.0) 2139 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 0, 3, 5]}]: dispatch 2021-03-10T15:32:07.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:06 gibba013 bash[29418]: audit 2021-03-10T15:32:06.650966+0000 mon.a (mon.0) 2140 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:32:07.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:06 gibba013 bash[30381]: audit 2021-03-10T15:32:06.469504+0000 mon.a (mon.0) 2134 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:32:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:06 gibba013 bash[30381]: audit 2021-03-10T15:32:06.536705+0000 mon.a (mon.0) 2135 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:32:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:06 gibba013 bash[30381]: audit 2021-03-10T15:32:06.650455+0000 mon.a (mon.0) 2136 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T15:32:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:06 gibba013 bash[30381]: audit 2021-03-10T15:32:06.650618+0000 mon.a (mon.0) 2137 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:32:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:06 gibba013 bash[30381]: audit 2021-03-10T15:32:06.650730+0000 mon.a (mon.0) 2138 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:32:07.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:06 gibba013 bash[30381]: audit 2021-03-10T15:32:06.650844+0000 mon.a (mon.0) 2139 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 0, 3, 5]}]: dispatch 2021-03-10T15:32:07.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:06 gibba013 bash[30381]: audit 2021-03-10T15:32:06.650966+0000 mon.a (mon.0) 2140 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:32:07.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:06 gibba020 bash[25448]: audit 2021-03-10T15:32:06.469504+0000 mon.a (mon.0) 2134 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:32:07.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:06 gibba020 bash[25448]: audit 2021-03-10T15:32:06.536705+0000 mon.a (mon.0) 2135 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:32:07.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:06 gibba020 bash[25448]: audit 2021-03-10T15:32:06.650455+0000 mon.a (mon.0) 2136 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T15:32:07.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:06 gibba020 bash[25448]: audit 2021-03-10T15:32:06.650618+0000 mon.a (mon.0) 2137 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:32:07.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:06 gibba020 bash[25448]: audit 2021-03-10T15:32:06.650730+0000 mon.a (mon.0) 2138 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:32:07.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:06 gibba020 bash[25448]: audit 2021-03-10T15:32:06.650844+0000 mon.a (mon.0) 2139 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 0, 3, 5]}]: dispatch 2021-03-10T15:32:07.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:06 gibba020 bash[25448]: audit 2021-03-10T15:32:06.650966+0000 mon.a (mon.0) 2140 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:32:08.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:07 gibba013 bash[29418]: cephadm 2021-03-10T15:32:06.460826+0000 mgr.gibba020.yqfnwy (mgr.34427) 5244 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:32:08.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:07 gibba013 bash[29418]: cluster 2021-03-10T15:32:06.696279+0000 mgr.gibba020.yqfnwy (mgr.34427) 5245 : cluster [DBG] pgmap v2983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:08.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:07 gibba013 bash[30381]: cephadm 2021-03-10T15:32:06.460826+0000 mgr.gibba020.yqfnwy (mgr.34427) 5244 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:32:08.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:07 gibba013 bash[30381]: cluster 2021-03-10T15:32:06.696279+0000 mgr.gibba020.yqfnwy (mgr.34427) 5245 : cluster [DBG] pgmap v2983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:08.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:07 gibba020 bash[25448]: cephadm 2021-03-10T15:32:06.460826+0000 mgr.gibba020.yqfnwy (mgr.34427) 5244 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:32:08.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:07 gibba020 bash[25448]: cluster 2021-03-10T15:32:06.696279+0000 mgr.gibba020.yqfnwy (mgr.34427) 5245 : cluster [DBG] pgmap v2983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:10.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:09 gibba013 bash[29418]: cluster 2021-03-10T15:32:08.697585+0000 mgr.gibba020.yqfnwy (mgr.34427) 5246 : cluster [DBG] pgmap v2984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:10.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:09 gibba013 bash[30381]: cluster 2021-03-10T15:32:08.697585+0000 mgr.gibba020.yqfnwy (mgr.34427) 5246 : cluster [DBG] pgmap v2984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:10.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:09 gibba020 bash[25448]: cluster 2021-03-10T15:32:08.697585+0000 mgr.gibba020.yqfnwy (mgr.34427) 5246 : cluster [DBG] pgmap v2984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:11.471 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:32:11.703 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:32:11.703 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (98m) 2m ago 104m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:32:11.704 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (103m) 110s ago 103m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:32:11.704 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (99m) 110s ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:32:11.704 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (99m) 110s ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:32:11.704 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (98m) 2m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:32:11.704 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (98m) 2m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:32:11.705 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (97m) 110s ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:32:11.705 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (97m) 2m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:32:11.705 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (104m) 2m ago 104m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:32:11.705 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (104m) 110s ago 104m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:32:11.706 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (96m) 2m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:32:11.706 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (96m) 2m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:32:11.706 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (96m) 2m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:32:11.706 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (95m) 2m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:32:11.707 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (95m) 110s ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:32:11.707 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (94m) 110s ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:32:11.707 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (94m) 110s ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:32:11.707 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (93m) 110s ago 104m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:32:11.708 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (103m) 110s ago 104m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:32:11.708 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 110s ago 102m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:32:11.952 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:32:11.952 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:32:11.952 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:32:11.953 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:32:11.953 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:32:11.953 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:32:11.953 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:32:11.954 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:32:11.954 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:32:11.954 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:32:11.955 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:32:11.955 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:32:11.955 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:32:11.955 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:32:11.955 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:32:12.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:11 gibba013 bash[29418]: cluster 2021-03-10T15:32:10.699043+0000 mgr.gibba020.yqfnwy (mgr.34427) 5247 : cluster [DBG] pgmap v2985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:12.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:11 gibba013 bash[30381]: cluster 2021-03-10T15:32:10.699043+0000 mgr.gibba020.yqfnwy (mgr.34427) 5247 : cluster [DBG] pgmap v2985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:12.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:11 gibba020 bash[25448]: cluster 2021-03-10T15:32:10.699043+0000 mgr.gibba020.yqfnwy (mgr.34427) 5247 : cluster [DBG] pgmap v2985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:13.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:12 gibba013 bash[29418]: audit 2021-03-10T15:32:11.457434+0000 mgr.gibba020.yqfnwy (mgr.34427) 5248 : audit [DBG] from='client.57565 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:32:13.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:12 gibba013 bash[29418]: audit 2021-03-10T15:32:11.686695+0000 mgr.gibba020.yqfnwy (mgr.34427) 5249 : audit [DBG] from='client.47586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:32:13.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:12 gibba013 bash[29418]: audit 2021-03-10T15:32:11.947774+0000 mon.c (mon.1) 88 : audit [DBG] from='client.? 172.21.2.113:0/1660641342' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:13.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:12 gibba013 bash[30381]: audit 2021-03-10T15:32:11.457434+0000 mgr.gibba020.yqfnwy (mgr.34427) 5248 : audit [DBG] from='client.57565 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:32:13.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:12 gibba013 bash[30381]: audit 2021-03-10T15:32:11.686695+0000 mgr.gibba020.yqfnwy (mgr.34427) 5249 : audit [DBG] from='client.47586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:32:13.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:12 gibba013 bash[30381]: audit 2021-03-10T15:32:11.947774+0000 mon.c (mon.1) 88 : audit [DBG] from='client.? 172.21.2.113:0/1660641342' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:13.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:12 gibba020 bash[25448]: audit 2021-03-10T15:32:11.457434+0000 mgr.gibba020.yqfnwy (mgr.34427) 5248 : audit [DBG] from='client.57565 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:32:13.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:12 gibba020 bash[25448]: audit 2021-03-10T15:32:11.686695+0000 mgr.gibba020.yqfnwy (mgr.34427) 5249 : audit [DBG] from='client.47586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:32:13.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:12 gibba020 bash[25448]: audit 2021-03-10T15:32:11.947774+0000 mon.c (mon.1) 88 : audit [DBG] from='client.? 172.21.2.113:0/1660641342' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:14.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:13 gibba013 bash[29418]: cluster 2021-03-10T15:32:12.700497+0000 mgr.gibba020.yqfnwy (mgr.34427) 5250 : cluster [DBG] pgmap v2986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:14.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:13 gibba013 bash[30381]: cluster 2021-03-10T15:32:12.700497+0000 mgr.gibba020.yqfnwy (mgr.34427) 5250 : cluster [DBG] pgmap v2986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:14.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:13 gibba020 bash[25448]: cluster 2021-03-10T15:32:12.700497+0000 mgr.gibba020.yqfnwy (mgr.34427) 5250 : cluster [DBG] pgmap v2986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:16.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:15 gibba013 bash[29418]: cluster 2021-03-10T15:32:14.701851+0000 mgr.gibba020.yqfnwy (mgr.34427) 5251 : cluster [DBG] pgmap v2987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:16.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:15 gibba013 bash[30381]: cluster 2021-03-10T15:32:14.701851+0000 mgr.gibba020.yqfnwy (mgr.34427) 5251 : cluster [DBG] pgmap v2987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:16.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:15 gibba020 bash[25448]: cluster 2021-03-10T15:32:14.701851+0000 mgr.gibba020.yqfnwy (mgr.34427) 5251 : cluster [DBG] pgmap v2987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:18.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:17 gibba013 bash[29418]: cluster 2021-03-10T15:32:16.702794+0000 mgr.gibba020.yqfnwy (mgr.34427) 5252 : cluster [DBG] pgmap v2988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:18.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:17 gibba013 bash[30381]: cluster 2021-03-10T15:32:16.702794+0000 mgr.gibba020.yqfnwy (mgr.34427) 5252 : cluster [DBG] pgmap v2988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:18.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:17 gibba020 bash[25448]: cluster 2021-03-10T15:32:16.702794+0000 mgr.gibba020.yqfnwy (mgr.34427) 5252 : cluster [DBG] pgmap v2988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:20.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:19 gibba013 bash[29418]: cluster 2021-03-10T15:32:18.704062+0000 mgr.gibba020.yqfnwy (mgr.34427) 5253 : cluster [DBG] pgmap v2989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:20.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:19 gibba013 bash[30381]: cluster 2021-03-10T15:32:18.704062+0000 mgr.gibba020.yqfnwy (mgr.34427) 5253 : cluster [DBG] pgmap v2989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:20.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:19 gibba020 bash[25448]: cluster 2021-03-10T15:32:18.704062+0000 mgr.gibba020.yqfnwy (mgr.34427) 5253 : cluster [DBG] pgmap v2989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:22.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:21 gibba013 bash[30381]: cluster 2021-03-10T15:32:20.705440+0000 mgr.gibba020.yqfnwy (mgr.34427) 5254 : cluster [DBG] pgmap v2990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:22.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:21 gibba013 bash[30381]: audit 2021-03-10T15:32:21.478084+0000 mon.a (mon.0) 2141 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:32:22.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:21 gibba013 bash[30381]: audit 2021-03-10T15:32:21.694736+0000 mon.a (mon.0) 2142 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:32:22.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:21 gibba013 bash[30381]: audit 2021-03-10T15:32:21.698119+0000 mon.a (mon.0) 2143 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:32:22.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:21 gibba013 bash[30381]: audit 2021-03-10T15:32:21.699501+0000 mon.a (mon.0) 2144 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:22.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:21 gibba013 bash[30381]: audit 2021-03-10T15:32:21.700655+0000 mon.a (mon.0) 2145 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:22.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:21 gibba013 bash[30381]: audit 2021-03-10T15:32:21.701869+0000 mon.a (mon.0) 2146 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:22.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:21 gibba013 bash[30381]: audit 2021-03-10T15:32:21.704122+0000 mon.a (mon.0) 2147 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:22.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:21 gibba013 bash[30381]: audit 2021-03-10T15:32:21.705534+0000 mon.a (mon.0) 2148 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:22.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:21 gibba013 bash[29418]: cluster 2021-03-10T15:32:20.705440+0000 mgr.gibba020.yqfnwy (mgr.34427) 5254 : cluster [DBG] pgmap v2990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:22.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:21 gibba013 bash[29418]: audit 2021-03-10T15:32:21.478084+0000 mon.a (mon.0) 2141 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:32:22.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:21 gibba013 bash[29418]: audit 2021-03-10T15:32:21.694736+0000 mon.a (mon.0) 2142 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:32:22.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:21 gibba013 bash[29418]: audit 2021-03-10T15:32:21.698119+0000 mon.a (mon.0) 2143 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:32:22.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:21 gibba013 bash[29418]: audit 2021-03-10T15:32:21.699501+0000 mon.a (mon.0) 2144 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:22.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:21 gibba013 bash[29418]: audit 2021-03-10T15:32:21.700655+0000 mon.a (mon.0) 2145 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:22.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:21 gibba013 bash[29418]: audit 2021-03-10T15:32:21.701869+0000 mon.a (mon.0) 2146 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:22.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:21 gibba013 bash[29418]: audit 2021-03-10T15:32:21.704122+0000 mon.a (mon.0) 2147 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:22.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:21 gibba013 bash[29418]: audit 2021-03-10T15:32:21.705534+0000 mon.a (mon.0) 2148 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:22.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:21 gibba020 bash[25448]: cluster 2021-03-10T15:32:20.705440+0000 mgr.gibba020.yqfnwy (mgr.34427) 5254 : cluster [DBG] pgmap v2990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:22.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:21 gibba020 bash[25448]: audit 2021-03-10T15:32:21.478084+0000 mon.a (mon.0) 2141 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:32:22.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:21 gibba020 bash[25448]: audit 2021-03-10T15:32:21.694736+0000 mon.a (mon.0) 2142 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:32:22.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:21 gibba020 bash[25448]: audit 2021-03-10T15:32:21.698119+0000 mon.a (mon.0) 2143 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:32:22.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:21 gibba020 bash[25448]: audit 2021-03-10T15:32:21.699501+0000 mon.a (mon.0) 2144 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:22.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:21 gibba020 bash[25448]: audit 2021-03-10T15:32:21.700655+0000 mon.a (mon.0) 2145 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:22.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:21 gibba020 bash[25448]: audit 2021-03-10T15:32:21.701869+0000 mon.a (mon.0) 2146 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:22.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:21 gibba020 bash[25448]: audit 2021-03-10T15:32:21.704122+0000 mon.a (mon.0) 2147 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:22.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:21 gibba020 bash[25448]: audit 2021-03-10T15:32:21.705534+0000 mon.a (mon.0) 2148 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:23.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:22 gibba013 bash[29418]: cephadm 2021-03-10T15:32:21.482160+0000 mgr.gibba020.yqfnwy (mgr.34427) 5255 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:32:23.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:22 gibba013 bash[29418]: cephadm 2021-03-10T15:32:21.483898+0000 mgr.gibba020.yqfnwy (mgr.34427) 5256 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:32:23.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:22 gibba013 bash[29418]: cephadm 2021-03-10T15:32:21.696829+0000 mgr.gibba020.yqfnwy (mgr.34427) 5257 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:32:23.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:22 gibba013 bash[29418]: cephadm 2021-03-10T15:32:21.698487+0000 mgr.gibba020.yqfnwy (mgr.34427) 5258 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:32:23.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:22 gibba013 bash[29418]: cephadm 2021-03-10T15:32:21.699639+0000 mgr.gibba020.yqfnwy (mgr.34427) 5259 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:32:23.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:22 gibba013 bash[29418]: cephadm 2021-03-10T15:32:21.699676+0000 mgr.gibba020.yqfnwy (mgr.34427) 5260 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:32:23.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:22 gibba013 bash[29418]: cephadm 2021-03-10T15:32:21.700975+0000 mgr.gibba020.yqfnwy (mgr.34427) 5261 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:32:23.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:22 gibba013 bash[29418]: cephadm 2021-03-10T15:32:21.701010+0000 mgr.gibba020.yqfnwy (mgr.34427) 5262 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:32:23.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:22 gibba013 bash[29418]: cephadm 2021-03-10T15:32:21.702032+0000 mgr.gibba020.yqfnwy (mgr.34427) 5263 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:32:23.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:22 gibba013 bash[29418]: cephadm 2021-03-10T15:32:21.703018+0000 mgr.gibba020.yqfnwy (mgr.34427) 5264 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:32:23.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:22 gibba013 bash[29418]: cephadm 2021-03-10T15:32:21.703055+0000 mgr.gibba020.yqfnwy (mgr.34427) 5265 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:32:23.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:22 gibba013 bash[29418]: cephadm 2021-03-10T15:32:21.704296+0000 mgr.gibba020.yqfnwy (mgr.34427) 5266 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:32:23.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:22 gibba013 bash[29418]: cephadm 2021-03-10T15:32:21.704605+0000 mgr.gibba020.yqfnwy (mgr.34427) 5267 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:32:23.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:22 gibba013 bash[29418]: cephadm 2021-03-10T15:32:21.705847+0000 mgr.gibba020.yqfnwy (mgr.34427) 5268 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:32:23.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:22 gibba013 bash[29418]: cephadm 2021-03-10T15:32:21.705882+0000 mgr.gibba020.yqfnwy (mgr.34427) 5269 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:32:23.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:22 gibba013 bash[29418]: cephadm 2021-03-10T15:32:21.705985+0000 mgr.gibba020.yqfnwy (mgr.34427) 5270 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:32:23.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:22 gibba013 bash[30381]: cephadm 2021-03-10T15:32:21.482160+0000 mgr.gibba020.yqfnwy (mgr.34427) 5255 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:32:23.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:22 gibba013 bash[30381]: cephadm 2021-03-10T15:32:21.483898+0000 mgr.gibba020.yqfnwy (mgr.34427) 5256 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:32:23.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:22 gibba013 bash[30381]: cephadm 2021-03-10T15:32:21.696829+0000 mgr.gibba020.yqfnwy (mgr.34427) 5257 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:32:23.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:22 gibba013 bash[30381]: cephadm 2021-03-10T15:32:21.698487+0000 mgr.gibba020.yqfnwy (mgr.34427) 5258 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:32:23.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:22 gibba013 bash[30381]: cephadm 2021-03-10T15:32:21.699639+0000 mgr.gibba020.yqfnwy (mgr.34427) 5259 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:32:23.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:22 gibba013 bash[30381]: cephadm 2021-03-10T15:32:21.699676+0000 mgr.gibba020.yqfnwy (mgr.34427) 5260 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:32:23.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:22 gibba013 bash[30381]: cephadm 2021-03-10T15:32:21.700975+0000 mgr.gibba020.yqfnwy (mgr.34427) 5261 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:32:23.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:22 gibba013 bash[30381]: cephadm 2021-03-10T15:32:21.701010+0000 mgr.gibba020.yqfnwy (mgr.34427) 5262 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:32:23.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:22 gibba013 bash[30381]: cephadm 2021-03-10T15:32:21.702032+0000 mgr.gibba020.yqfnwy (mgr.34427) 5263 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:32:23.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:22 gibba013 bash[30381]: cephadm 2021-03-10T15:32:21.703018+0000 mgr.gibba020.yqfnwy (mgr.34427) 5264 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:32:23.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:22 gibba013 bash[30381]: cephadm 2021-03-10T15:32:21.703055+0000 mgr.gibba020.yqfnwy (mgr.34427) 5265 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:32:23.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:22 gibba013 bash[30381]: cephadm 2021-03-10T15:32:21.704296+0000 mgr.gibba020.yqfnwy (mgr.34427) 5266 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:32:23.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:22 gibba013 bash[30381]: cephadm 2021-03-10T15:32:21.704605+0000 mgr.gibba020.yqfnwy (mgr.34427) 5267 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:32:23.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:22 gibba013 bash[30381]: cephadm 2021-03-10T15:32:21.705847+0000 mgr.gibba020.yqfnwy (mgr.34427) 5268 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:32:23.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:22 gibba013 bash[30381]: cephadm 2021-03-10T15:32:21.705882+0000 mgr.gibba020.yqfnwy (mgr.34427) 5269 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:32:23.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:22 gibba013 bash[30381]: cephadm 2021-03-10T15:32:21.705985+0000 mgr.gibba020.yqfnwy (mgr.34427) 5270 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:32:23.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:22 gibba020 bash[25448]: cephadm 2021-03-10T15:32:21.482160+0000 mgr.gibba020.yqfnwy (mgr.34427) 5255 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:32:23.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:22 gibba020 bash[25448]: cephadm 2021-03-10T15:32:21.483898+0000 mgr.gibba020.yqfnwy (mgr.34427) 5256 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:32:23.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:22 gibba020 bash[25448]: cephadm 2021-03-10T15:32:21.696829+0000 mgr.gibba020.yqfnwy (mgr.34427) 5257 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:32:23.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:22 gibba020 bash[25448]: cephadm 2021-03-10T15:32:21.698487+0000 mgr.gibba020.yqfnwy (mgr.34427) 5258 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:32:23.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:22 gibba020 bash[25448]: cephadm 2021-03-10T15:32:21.699639+0000 mgr.gibba020.yqfnwy (mgr.34427) 5259 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:32:23.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:22 gibba020 bash[25448]: cephadm 2021-03-10T15:32:21.699676+0000 mgr.gibba020.yqfnwy (mgr.34427) 5260 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:32:23.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:22 gibba020 bash[25448]: cephadm 2021-03-10T15:32:21.700975+0000 mgr.gibba020.yqfnwy (mgr.34427) 5261 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:32:23.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:22 gibba020 bash[25448]: cephadm 2021-03-10T15:32:21.701010+0000 mgr.gibba020.yqfnwy (mgr.34427) 5262 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:32:23.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:22 gibba020 bash[25448]: cephadm 2021-03-10T15:32:21.702032+0000 mgr.gibba020.yqfnwy (mgr.34427) 5263 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:32:23.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:22 gibba020 bash[25448]: cephadm 2021-03-10T15:32:21.703018+0000 mgr.gibba020.yqfnwy (mgr.34427) 5264 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:32:23.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:22 gibba020 bash[25448]: cephadm 2021-03-10T15:32:21.703055+0000 mgr.gibba020.yqfnwy (mgr.34427) 5265 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:32:23.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:22 gibba020 bash[25448]: cephadm 2021-03-10T15:32:21.704296+0000 mgr.gibba020.yqfnwy (mgr.34427) 5266 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:32:23.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:22 gibba020 bash[25448]: cephadm 2021-03-10T15:32:21.704605+0000 mgr.gibba020.yqfnwy (mgr.34427) 5267 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:32:23.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:22 gibba020 bash[25448]: cephadm 2021-03-10T15:32:21.705847+0000 mgr.gibba020.yqfnwy (mgr.34427) 5268 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:32:23.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:22 gibba020 bash[25448]: cephadm 2021-03-10T15:32:21.705882+0000 mgr.gibba020.yqfnwy (mgr.34427) 5269 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:32:23.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:22 gibba020 bash[25448]: cephadm 2021-03-10T15:32:21.705985+0000 mgr.gibba020.yqfnwy (mgr.34427) 5270 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:32:24.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:23 gibba013 bash[29418]: cluster 2021-03-10T15:32:22.706842+0000 mgr.gibba020.yqfnwy (mgr.34427) 5271 : cluster [DBG] pgmap v2991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:24.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:23 gibba013 bash[30381]: cluster 2021-03-10T15:32:22.706842+0000 mgr.gibba020.yqfnwy (mgr.34427) 5271 : cluster [DBG] pgmap v2991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:24.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:23 gibba020 bash[25448]: cluster 2021-03-10T15:32:22.706842+0000 mgr.gibba020.yqfnwy (mgr.34427) 5271 : cluster [DBG] pgmap v2991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:26.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:25 gibba013 bash[29418]: cluster 2021-03-10T15:32:24.708373+0000 mgr.gibba020.yqfnwy (mgr.34427) 5272 : cluster [DBG] pgmap v2992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:26.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:25 gibba013 bash[30381]: cluster 2021-03-10T15:32:24.708373+0000 mgr.gibba020.yqfnwy (mgr.34427) 5272 : cluster [DBG] pgmap v2992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:26.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:25 gibba020 bash[25448]: cluster 2021-03-10T15:32:24.708373+0000 mgr.gibba020.yqfnwy (mgr.34427) 5272 : cluster [DBG] pgmap v2992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:28.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:27 gibba013 bash[29418]: cluster 2021-03-10T15:32:26.710045+0000 mgr.gibba020.yqfnwy (mgr.34427) 5273 : cluster [DBG] pgmap v2993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:28.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:27 gibba013 bash[30381]: cluster 2021-03-10T15:32:26.710045+0000 mgr.gibba020.yqfnwy (mgr.34427) 5273 : cluster [DBG] pgmap v2993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:28.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:27 gibba020 bash[25448]: cluster 2021-03-10T15:32:26.710045+0000 mgr.gibba020.yqfnwy (mgr.34427) 5273 : cluster [DBG] pgmap v2993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:30.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:29 gibba013 bash[30381]: cluster 2021-03-10T15:32:28.711709+0000 mgr.gibba020.yqfnwy (mgr.34427) 5274 : cluster [DBG] pgmap v2994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:30.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:29 gibba013 bash[29418]: cluster 2021-03-10T15:32:28.711709+0000 mgr.gibba020.yqfnwy (mgr.34427) 5274 : cluster [DBG] pgmap v2994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:30.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:29 gibba020 bash[25448]: cluster 2021-03-10T15:32:28.711709+0000 mgr.gibba020.yqfnwy (mgr.34427) 5274 : cluster [DBG] pgmap v2994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:32.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:31 gibba020 bash[25448]: cluster 2021-03-10T15:32:30.713323+0000 mgr.gibba020.yqfnwy (mgr.34427) 5275 : cluster [DBG] pgmap v2995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:32.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:31 gibba013 bash[29418]: cluster 2021-03-10T15:32:30.713323+0000 mgr.gibba020.yqfnwy (mgr.34427) 5275 : cluster [DBG] pgmap v2995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:32.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:31 gibba013 bash[30381]: cluster 2021-03-10T15:32:30.713323+0000 mgr.gibba020.yqfnwy (mgr.34427) 5275 : cluster [DBG] pgmap v2995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:33.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:33 gibba013 bash[29418]: cluster 2021-03-10T15:32:32.714614+0000 mgr.gibba020.yqfnwy (mgr.34427) 5276 : cluster [DBG] pgmap v2996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:33.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:33 gibba013 bash[30381]: cluster 2021-03-10T15:32:32.714614+0000 mgr.gibba020.yqfnwy (mgr.34427) 5276 : cluster [DBG] pgmap v2996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:33.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:33 gibba020 bash[25448]: cluster 2021-03-10T15:32:32.714614+0000 mgr.gibba020.yqfnwy (mgr.34427) 5276 : cluster [DBG] pgmap v2996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:36.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:35 gibba013 bash[29418]: cluster 2021-03-10T15:32:34.716130+0000 mgr.gibba020.yqfnwy (mgr.34427) 5277 : cluster [DBG] pgmap v2997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:36.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:35 gibba013 bash[30381]: cluster 2021-03-10T15:32:34.716130+0000 mgr.gibba020.yqfnwy (mgr.34427) 5277 : cluster [DBG] pgmap v2997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:36.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:35 gibba020 bash[25448]: cluster 2021-03-10T15:32:34.716130+0000 mgr.gibba020.yqfnwy (mgr.34427) 5277 : cluster [DBG] pgmap v2997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:38.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:37 gibba013 bash[30381]: cluster 2021-03-10T15:32:36.717261+0000 mgr.gibba020.yqfnwy (mgr.34427) 5278 : cluster [DBG] pgmap v2998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:38.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:37 gibba013 bash[30381]: cephadm 2021-03-10T15:32:36.721587+0000 mgr.gibba020.yqfnwy (mgr.34427) 5279 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:32:38.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:37 gibba013 bash[29418]: cluster 2021-03-10T15:32:36.717261+0000 mgr.gibba020.yqfnwy (mgr.34427) 5278 : cluster [DBG] pgmap v2998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:38.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:37 gibba013 bash[29418]: cephadm 2021-03-10T15:32:36.721587+0000 mgr.gibba020.yqfnwy (mgr.34427) 5279 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:32:38.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:37 gibba020 bash[25448]: cluster 2021-03-10T15:32:36.717261+0000 mgr.gibba020.yqfnwy (mgr.34427) 5278 : cluster [DBG] pgmap v2998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:38.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:37 gibba020 bash[25448]: cephadm 2021-03-10T15:32:36.721587+0000 mgr.gibba020.yqfnwy (mgr.34427) 5279 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:32:40.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:39 gibba013 bash[29418]: cluster 2021-03-10T15:32:38.718779+0000 mgr.gibba020.yqfnwy (mgr.34427) 5280 : cluster [DBG] pgmap v2999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:40.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:39 gibba013 bash[30381]: cluster 2021-03-10T15:32:38.718779+0000 mgr.gibba020.yqfnwy (mgr.34427) 5280 : cluster [DBG] pgmap v2999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:40.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:39 gibba020 bash[25448]: cluster 2021-03-10T15:32:38.718779+0000 mgr.gibba020.yqfnwy (mgr.34427) 5280 : cluster [DBG] pgmap v2999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:42.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:41 gibba013 bash[29418]: cluster 2021-03-10T15:32:40.720217+0000 mgr.gibba020.yqfnwy (mgr.34427) 5281 : cluster [DBG] pgmap v3000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:42.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:41 gibba013 bash[30381]: cluster 2021-03-10T15:32:40.720217+0000 mgr.gibba020.yqfnwy (mgr.34427) 5281 : cluster [DBG] pgmap v3000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:42.192 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:32:42.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:41 gibba020 bash[25448]: cluster 2021-03-10T15:32:40.720217+0000 mgr.gibba020.yqfnwy (mgr.34427) 5281 : cluster [DBG] pgmap v3000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:42.418 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:32:42.418 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (99m) 3m ago 104m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:32:42.418 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (104m) 2m ago 104m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:32:42.419 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (99m) 2m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:32:42.419 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (99m) 2m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:32:42.419 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (98m) 3m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:32:42.420 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (98m) 3m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:32:42.420 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (98m) 2m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:32:42.420 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (98m) 3m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:32:42.420 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (104m) 3m ago 104m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:32:42.421 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (104m) 2m ago 104m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:32:42.421 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (97m) 3m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:32:42.421 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (97m) 3m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:32:42.421 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (96m) 3m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:32:42.421 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (96m) 3m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:32:42.422 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (95m) 2m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:32:42.422 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (95m) 2m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:32:42.422 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (94m) 2m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:32:42.423 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (94m) 2m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:32:42.423 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (104m) 2m ago 104m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:32:42.423 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 102m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:32:42.669 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:32:42.669 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:32:42.669 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:32:42.670 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:32:42.670 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:32:42.670 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:32:42.670 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:32:42.671 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:32:42.671 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:32:42.671 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:32:42.671 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:32:42.672 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:32:42.672 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:32:42.672 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:32:42.672 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:32:43.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:42 gibba013 bash[29418]: audit 2021-03-10T15:32:42.178797+0000 mgr.gibba020.yqfnwy (mgr.34427) 5282 : audit [DBG] from='client.47598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:32:43.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:42 gibba013 bash[29418]: audit 2021-03-10T15:32:42.665244+0000 mon.a (mon.0) 2149 : audit [DBG] from='client.? 172.21.2.113:0/4206560599' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:43.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:42 gibba013 bash[30381]: audit 2021-03-10T15:32:42.178797+0000 mgr.gibba020.yqfnwy (mgr.34427) 5282 : audit [DBG] from='client.47598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:32:43.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:42 gibba013 bash[30381]: audit 2021-03-10T15:32:42.665244+0000 mon.a (mon.0) 2149 : audit [DBG] from='client.? 172.21.2.113:0/4206560599' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:43.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:42 gibba020 bash[25448]: audit 2021-03-10T15:32:42.178797+0000 mgr.gibba020.yqfnwy (mgr.34427) 5282 : audit [DBG] from='client.47598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:32:43.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:42 gibba020 bash[25448]: audit 2021-03-10T15:32:42.665244+0000 mon.a (mon.0) 2149 : audit [DBG] from='client.? 172.21.2.113:0/4206560599' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:32:44.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:43 gibba013 bash[29418]: audit 2021-03-10T15:32:42.401379+0000 mgr.gibba020.yqfnwy (mgr.34427) 5283 : audit [DBG] from='client.47604 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:32:44.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:43 gibba013 bash[29418]: cluster 2021-03-10T15:32:42.721775+0000 mgr.gibba020.yqfnwy (mgr.34427) 5284 : cluster [DBG] pgmap v3001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:44.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:43 gibba013 bash[30381]: audit 2021-03-10T15:32:42.401379+0000 mgr.gibba020.yqfnwy (mgr.34427) 5283 : audit [DBG] from='client.47604 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:32:44.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:43 gibba013 bash[30381]: cluster 2021-03-10T15:32:42.721775+0000 mgr.gibba020.yqfnwy (mgr.34427) 5284 : cluster [DBG] pgmap v3001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:44.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:43 gibba020 bash[25448]: audit 2021-03-10T15:32:42.401379+0000 mgr.gibba020.yqfnwy (mgr.34427) 5283 : audit [DBG] from='client.47604 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:32:44.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:43 gibba020 bash[25448]: cluster 2021-03-10T15:32:42.721775+0000 mgr.gibba020.yqfnwy (mgr.34427) 5284 : cluster [DBG] pgmap v3001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:46.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:45 gibba013 bash[29418]: cluster 2021-03-10T15:32:44.723512+0000 mgr.gibba020.yqfnwy (mgr.34427) 5285 : cluster [DBG] pgmap v3002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:46.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:45 gibba013 bash[30381]: cluster 2021-03-10T15:32:44.723512+0000 mgr.gibba020.yqfnwy (mgr.34427) 5285 : cluster [DBG] pgmap v3002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:46.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:45 gibba020 bash[25448]: cluster 2021-03-10T15:32:44.723512+0000 mgr.gibba020.yqfnwy (mgr.34427) 5285 : cluster [DBG] pgmap v3002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:48.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:47 gibba013 bash[29418]: cluster 2021-03-10T15:32:46.725476+0000 mgr.gibba020.yqfnwy (mgr.34427) 5286 : cluster [DBG] pgmap v3003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:48.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:47 gibba013 bash[30381]: cluster 2021-03-10T15:32:46.725476+0000 mgr.gibba020.yqfnwy (mgr.34427) 5286 : cluster [DBG] pgmap v3003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:48.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:47 gibba020 bash[25448]: cluster 2021-03-10T15:32:46.725476+0000 mgr.gibba020.yqfnwy (mgr.34427) 5286 : cluster [DBG] pgmap v3003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:50.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:49 gibba013 bash[29418]: cluster 2021-03-10T15:32:48.727157+0000 mgr.gibba020.yqfnwy (mgr.34427) 5287 : cluster [DBG] pgmap v3004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:50.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:49 gibba013 bash[30381]: cluster 2021-03-10T15:32:48.727157+0000 mgr.gibba020.yqfnwy (mgr.34427) 5287 : cluster [DBG] pgmap v3004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:50.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:49 gibba020 bash[25448]: cluster 2021-03-10T15:32:48.727157+0000 mgr.gibba020.yqfnwy (mgr.34427) 5287 : cluster [DBG] pgmap v3004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:52.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:51 gibba013 bash[29418]: cluster 2021-03-10T15:32:50.729076+0000 mgr.gibba020.yqfnwy (mgr.34427) 5288 : cluster [DBG] pgmap v3005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:52.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:51 gibba013 bash[30381]: cluster 2021-03-10T15:32:50.729076+0000 mgr.gibba020.yqfnwy (mgr.34427) 5288 : cluster [DBG] pgmap v3005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:52.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:51 gibba020 bash[25448]: cluster 2021-03-10T15:32:50.729076+0000 mgr.gibba020.yqfnwy (mgr.34427) 5288 : cluster [DBG] pgmap v3005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:53.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:52 gibba013 bash[29418]: cephadm 2021-03-10T15:32:51.732264+0000 mgr.gibba020.yqfnwy (mgr.34427) 5289 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:32:53.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:52 gibba013 bash[30381]: cephadm 2021-03-10T15:32:51.732264+0000 mgr.gibba020.yqfnwy (mgr.34427) 5289 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:32:53.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:52 gibba020 bash[25448]: cephadm 2021-03-10T15:32:51.732264+0000 mgr.gibba020.yqfnwy (mgr.34427) 5289 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:32:54.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:53 gibba013 bash[29418]: cluster 2021-03-10T15:32:52.730701+0000 mgr.gibba020.yqfnwy (mgr.34427) 5290 : cluster [DBG] pgmap v3006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:54.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:53 gibba013 bash[30381]: cluster 2021-03-10T15:32:52.730701+0000 mgr.gibba020.yqfnwy (mgr.34427) 5290 : cluster [DBG] pgmap v3006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:54.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:53 gibba020 bash[25448]: cluster 2021-03-10T15:32:52.730701+0000 mgr.gibba020.yqfnwy (mgr.34427) 5290 : cluster [DBG] pgmap v3006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:56.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:55 gibba013 bash[29418]: cluster 2021-03-10T15:32:54.732565+0000 mgr.gibba020.yqfnwy (mgr.34427) 5291 : cluster [DBG] pgmap v3007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:56.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:55 gibba013 bash[30381]: cluster 2021-03-10T15:32:54.732565+0000 mgr.gibba020.yqfnwy (mgr.34427) 5291 : cluster [DBG] pgmap v3007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:56.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:55 gibba020 bash[25448]: cluster 2021-03-10T15:32:54.732565+0000 mgr.gibba020.yqfnwy (mgr.34427) 5291 : cluster [DBG] pgmap v3007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:58.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:57 gibba013 bash[29418]: cluster 2021-03-10T15:32:56.734384+0000 mgr.gibba020.yqfnwy (mgr.34427) 5292 : cluster [DBG] pgmap v3008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:58.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:57 gibba013 bash[30381]: cluster 2021-03-10T15:32:56.734384+0000 mgr.gibba020.yqfnwy (mgr.34427) 5292 : cluster [DBG] pgmap v3008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:32:58.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:57 gibba020 bash[25448]: cluster 2021-03-10T15:32:56.734384+0000 mgr.gibba020.yqfnwy (mgr.34427) 5292 : cluster [DBG] pgmap v3008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:00.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:32:59 gibba020 bash[25448]: cluster 2021-03-10T15:32:58.735730+0000 mgr.gibba020.yqfnwy (mgr.34427) 5293 : cluster [DBG] pgmap v3009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:00.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:32:59 gibba013 bash[29418]: cluster 2021-03-10T15:32:58.735730+0000 mgr.gibba020.yqfnwy (mgr.34427) 5293 : cluster [DBG] pgmap v3009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:00.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:32:59 gibba013 bash[30381]: cluster 2021-03-10T15:32:58.735730+0000 mgr.gibba020.yqfnwy (mgr.34427) 5293 : cluster [DBG] pgmap v3009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:02.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:01 gibba020 bash[25448]: cluster 2021-03-10T15:33:00.737304+0000 mgr.gibba020.yqfnwy (mgr.34427) 5294 : cluster [DBG] pgmap v3010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:02.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:01 gibba013 bash[29418]: cluster 2021-03-10T15:33:00.737304+0000 mgr.gibba020.yqfnwy (mgr.34427) 5294 : cluster [DBG] pgmap v3010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:02.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:01 gibba013 bash[30381]: cluster 2021-03-10T15:33:00.737304+0000 mgr.gibba020.yqfnwy (mgr.34427) 5294 : cluster [DBG] pgmap v3010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:03.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:03 gibba013 bash[29418]: cluster 2021-03-10T15:33:02.738737+0000 mgr.gibba020.yqfnwy (mgr.34427) 5295 : cluster [DBG] pgmap v3011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:03.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:03 gibba013 bash[30381]: cluster 2021-03-10T15:33:02.738737+0000 mgr.gibba020.yqfnwy (mgr.34427) 5295 : cluster [DBG] pgmap v3011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:03.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:03 gibba020 bash[25448]: cluster 2021-03-10T15:33:02.738737+0000 mgr.gibba020.yqfnwy (mgr.34427) 5295 : cluster [DBG] pgmap v3011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:06.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:05 gibba013 bash[29418]: cluster 2021-03-10T15:33:04.740228+0000 mgr.gibba020.yqfnwy (mgr.34427) 5296 : cluster [DBG] pgmap v3012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:06.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:05 gibba013 bash[30381]: cluster 2021-03-10T15:33:04.740228+0000 mgr.gibba020.yqfnwy (mgr.34427) 5296 : cluster [DBG] pgmap v3012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:06.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:05 gibba020 bash[25448]: cluster 2021-03-10T15:33:04.740228+0000 mgr.gibba020.yqfnwy (mgr.34427) 5296 : cluster [DBG] pgmap v3012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:07.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:06 gibba013 bash[29418]: audit 2021-03-10T15:33:06.474802+0000 mon.a (mon.0) 2150 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:33:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:06 gibba013 bash[29418]: audit 2021-03-10T15:33:06.543157+0000 mon.a (mon.0) 2151 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:33:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:06 gibba013 bash[29418]: audit 2021-03-10T15:33:06.654496+0000 mon.a (mon.0) 2152 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:33:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:06 gibba013 bash[29418]: audit 2021-03-10T15:33:06.654753+0000 mon.a (mon.0) 2153 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:33:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:06 gibba013 bash[29418]: audit 2021-03-10T15:33:06.654985+0000 mon.a (mon.0) 2154 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:33:07.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:06 gibba013 bash[29418]: audit 2021-03-10T15:33:06.655221+0000 mon.a (mon.0) 2155 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T15:33:07.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:06 gibba013 bash[30381]: audit 2021-03-10T15:33:06.474802+0000 mon.a (mon.0) 2150 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:33:07.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:06 gibba013 bash[30381]: audit 2021-03-10T15:33:06.543157+0000 mon.a (mon.0) 2151 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:33:07.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:06 gibba013 bash[30381]: audit 2021-03-10T15:33:06.654496+0000 mon.a (mon.0) 2152 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:33:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:06 gibba013 bash[30381]: audit 2021-03-10T15:33:06.654753+0000 mon.a (mon.0) 2153 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:33:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:06 gibba013 bash[30381]: audit 2021-03-10T15:33:06.654985+0000 mon.a (mon.0) 2154 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:33:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:06 gibba013 bash[30381]: audit 2021-03-10T15:33:06.655221+0000 mon.a (mon.0) 2155 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T15:33:07.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:06 gibba020 bash[25448]: audit 2021-03-10T15:33:06.474802+0000 mon.a (mon.0) 2150 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:33:07.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:06 gibba020 bash[25448]: audit 2021-03-10T15:33:06.543157+0000 mon.a (mon.0) 2151 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:33:07.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:06 gibba020 bash[25448]: audit 2021-03-10T15:33:06.654496+0000 mon.a (mon.0) 2152 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:33:07.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:06 gibba020 bash[25448]: audit 2021-03-10T15:33:06.654753+0000 mon.a (mon.0) 2153 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:33:07.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:06 gibba020 bash[25448]: audit 2021-03-10T15:33:06.654985+0000 mon.a (mon.0) 2154 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:33:07.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:06 gibba020 bash[25448]: audit 2021-03-10T15:33:06.655221+0000 mon.a (mon.0) 2155 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T15:33:08.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:07 gibba013 bash[29418]: cluster 2021-03-10T15:33:06.741946+0000 mgr.gibba020.yqfnwy (mgr.34427) 5297 : cluster [DBG] pgmap v3013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:08.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:07 gibba013 bash[29418]: cephadm 2021-03-10T15:33:06.748258+0000 mgr.gibba020.yqfnwy (mgr.34427) 5298 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:33:08.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:07 gibba013 bash[30381]: cluster 2021-03-10T15:33:06.741946+0000 mgr.gibba020.yqfnwy (mgr.34427) 5297 : cluster [DBG] pgmap v3013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:08.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:07 gibba013 bash[30381]: cephadm 2021-03-10T15:33:06.748258+0000 mgr.gibba020.yqfnwy (mgr.34427) 5298 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:33:08.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:07 gibba020 bash[25448]: cluster 2021-03-10T15:33:06.741946+0000 mgr.gibba020.yqfnwy (mgr.34427) 5297 : cluster [DBG] pgmap v3013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:08.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:07 gibba020 bash[25448]: cephadm 2021-03-10T15:33:06.748258+0000 mgr.gibba020.yqfnwy (mgr.34427) 5298 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:33:10.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:09 gibba013 bash[29418]: cluster 2021-03-10T15:33:08.743536+0000 mgr.gibba020.yqfnwy (mgr.34427) 5299 : cluster [DBG] pgmap v3014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:10.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:09 gibba013 bash[30381]: cluster 2021-03-10T15:33:08.743536+0000 mgr.gibba020.yqfnwy (mgr.34427) 5299 : cluster [DBG] pgmap v3014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:10.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:09 gibba020 bash[25448]: cluster 2021-03-10T15:33:08.743536+0000 mgr.gibba020.yqfnwy (mgr.34427) 5299 : cluster [DBG] pgmap v3014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:12.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:11 gibba013 bash[29418]: cluster 2021-03-10T15:33:10.745004+0000 mgr.gibba020.yqfnwy (mgr.34427) 5300 : cluster [DBG] pgmap v3015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:12.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:11 gibba013 bash[30381]: cluster 2021-03-10T15:33:10.745004+0000 mgr.gibba020.yqfnwy (mgr.34427) 5300 : cluster [DBG] pgmap v3015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:12.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:11 gibba020 bash[25448]: cluster 2021-03-10T15:33:10.745004+0000 mgr.gibba020.yqfnwy (mgr.34427) 5300 : cluster [DBG] pgmap v3015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:12.912 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:33:13.167 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:33:13.168 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (99m) 3m ago 105m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:33:13.168 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (104m) 2m ago 104m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:33:13.168 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (100m) 2m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:33:13.168 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (100m) 2m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:33:13.169 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (99m) 3m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:33:13.169 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (99m) 3m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:33:13.169 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (98m) 2m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:33:13.169 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (98m) 3m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:33:13.170 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (105m) 3m ago 105m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:33:13.170 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (105m) 2m ago 105m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:33:13.170 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (98m) 3m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:33:13.170 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (97m) 3m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:33:13.170 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (97m) 3m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:33:13.171 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (96m) 3m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:33:13.171 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (96m) 2m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:33:13.171 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (95m) 2m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:33:13.171 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (95m) 2m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:33:13.172 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (94m) 2m ago 105m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:33:13.172 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (104m) 2m ago 105m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:33:13.172 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 103m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:33:13.420 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:33:13.420 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:33:13.421 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:33:13.421 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:33:13.421 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:33:13.421 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:33:13.422 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:33:13.422 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:33:13.422 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:33:13.422 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:33:13.423 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:33:13.423 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:33:13.423 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:33:13.423 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:33:13.424 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:33:13.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:13 gibba013 bash[29418]: cluster 2021-03-10T15:33:12.746407+0000 mgr.gibba020.yqfnwy (mgr.34427) 5301 : cluster [DBG] pgmap v3016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:13.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:13 gibba013 bash[29418]: audit 2021-03-10T15:33:12.898179+0000 mgr.gibba020.yqfnwy (mgr.34427) 5302 : audit [DBG] from='client.47616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:33:13.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:13 gibba013 bash[29418]: audit 2021-03-10T15:33:13.122111+0000 mgr.gibba020.yqfnwy (mgr.34427) 5303 : audit [DBG] from='client.47622 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:33:13.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:13 gibba013 bash[29418]: audit 2021-03-10T15:33:13.416274+0000 mon.a (mon.0) 2156 : audit [DBG] from='client.? 172.21.2.113:0/991405480' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:13.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:13 gibba013 bash[30381]: cluster 2021-03-10T15:33:12.746407+0000 mgr.gibba020.yqfnwy (mgr.34427) 5301 : cluster [DBG] pgmap v3016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:13.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:13 gibba013 bash[30381]: audit 2021-03-10T15:33:12.898179+0000 mgr.gibba020.yqfnwy (mgr.34427) 5302 : audit [DBG] from='client.47616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:33:13.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:13 gibba013 bash[30381]: audit 2021-03-10T15:33:13.122111+0000 mgr.gibba020.yqfnwy (mgr.34427) 5303 : audit [DBG] from='client.47622 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:33:13.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:13 gibba013 bash[30381]: audit 2021-03-10T15:33:13.416274+0000 mon.a (mon.0) 2156 : audit [DBG] from='client.? 172.21.2.113:0/991405480' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:13.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:13 gibba020 bash[25448]: cluster 2021-03-10T15:33:12.746407+0000 mgr.gibba020.yqfnwy (mgr.34427) 5301 : cluster [DBG] pgmap v3016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:13.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:13 gibba020 bash[25448]: audit 2021-03-10T15:33:12.898179+0000 mgr.gibba020.yqfnwy (mgr.34427) 5302 : audit [DBG] from='client.47616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:33:13.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:13 gibba020 bash[25448]: audit 2021-03-10T15:33:13.122111+0000 mgr.gibba020.yqfnwy (mgr.34427) 5303 : audit [DBG] from='client.47622 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:33:13.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:13 gibba020 bash[25448]: audit 2021-03-10T15:33:13.416274+0000 mon.a (mon.0) 2156 : audit [DBG] from='client.? 172.21.2.113:0/991405480' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:16.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:15 gibba013 bash[29418]: cluster 2021-03-10T15:33:14.748012+0000 mgr.gibba020.yqfnwy (mgr.34427) 5304 : cluster [DBG] pgmap v3017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:16.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:15 gibba013 bash[30381]: cluster 2021-03-10T15:33:14.748012+0000 mgr.gibba020.yqfnwy (mgr.34427) 5304 : cluster [DBG] pgmap v3017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:16.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:15 gibba020 bash[25448]: cluster 2021-03-10T15:33:14.748012+0000 mgr.gibba020.yqfnwy (mgr.34427) 5304 : cluster [DBG] pgmap v3017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:18.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:17 gibba013 bash[29418]: cluster 2021-03-10T15:33:16.749895+0000 mgr.gibba020.yqfnwy (mgr.34427) 5305 : cluster [DBG] pgmap v3018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:18.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:17 gibba013 bash[30381]: cluster 2021-03-10T15:33:16.749895+0000 mgr.gibba020.yqfnwy (mgr.34427) 5305 : cluster [DBG] pgmap v3018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:18.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:17 gibba020 bash[25448]: cluster 2021-03-10T15:33:16.749895+0000 mgr.gibba020.yqfnwy (mgr.34427) 5305 : cluster [DBG] pgmap v3018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:20.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:19 gibba013 bash[30381]: cluster 2021-03-10T15:33:18.751684+0000 mgr.gibba020.yqfnwy (mgr.34427) 5306 : cluster [DBG] pgmap v3019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:20.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:19 gibba013 bash[29418]: cluster 2021-03-10T15:33:18.751684+0000 mgr.gibba020.yqfnwy (mgr.34427) 5306 : cluster [DBG] pgmap v3019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:20.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:19 gibba020 bash[25448]: cluster 2021-03-10T15:33:18.751684+0000 mgr.gibba020.yqfnwy (mgr.34427) 5306 : cluster [DBG] pgmap v3019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:22.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:21 gibba013 bash[30381]: cluster 2021-03-10T15:33:20.753290+0000 mgr.gibba020.yqfnwy (mgr.34427) 5307 : cluster [DBG] pgmap v3020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:22.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:21 gibba013 bash[30381]: audit 2021-03-10T15:33:21.765865+0000 mon.a (mon.0) 2157 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:33:22.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:21 gibba013 bash[29418]: cluster 2021-03-10T15:33:20.753290+0000 mgr.gibba020.yqfnwy (mgr.34427) 5307 : cluster [DBG] pgmap v3020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:22.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:21 gibba013 bash[29418]: audit 2021-03-10T15:33:21.765865+0000 mon.a (mon.0) 2157 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:33:22.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:21 gibba020 bash[25448]: cluster 2021-03-10T15:33:20.753290+0000 mgr.gibba020.yqfnwy (mgr.34427) 5307 : cluster [DBG] pgmap v3020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:22.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:21 gibba020 bash[25448]: audit 2021-03-10T15:33:21.765865+0000 mon.a (mon.0) 2157 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:33:23.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[30381]: cephadm 2021-03-10T15:33:21.770506+0000 mgr.gibba020.yqfnwy (mgr.34427) 5308 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:33:23.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[30381]: cephadm 2021-03-10T15:33:21.772394+0000 mgr.gibba020.yqfnwy (mgr.34427) 5309 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:33:23.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[30381]: audit 2021-03-10T15:33:21.999757+0000 mon.a (mon.0) 2158 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:33:23.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[30381]: cephadm 2021-03-10T15:33:22.001785+0000 mgr.gibba020.yqfnwy (mgr.34427) 5310 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:33:23.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[30381]: audit 2021-03-10T15:33:22.003191+0000 mon.a (mon.0) 2159 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:33:23.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[30381]: cephadm 2021-03-10T15:33:22.003690+0000 mgr.gibba020.yqfnwy (mgr.34427) 5311 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:33:23.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[30381]: audit 2021-03-10T15:33:22.004857+0000 mon.a (mon.0) 2160 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:23.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[30381]: cephadm 2021-03-10T15:33:22.005390+0000 mgr.gibba020.yqfnwy (mgr.34427) 5312 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:33:23.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[30381]: cephadm 2021-03-10T15:33:22.005463+0000 mgr.gibba020.yqfnwy (mgr.34427) 5313 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:33:23.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[30381]: audit 2021-03-10T15:33:22.006667+0000 mon.a (mon.0) 2161 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:23.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[30381]: cephadm 2021-03-10T15:33:22.007059+0000 mgr.gibba020.yqfnwy (mgr.34427) 5314 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:33:23.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[30381]: cephadm 2021-03-10T15:33:22.007150+0000 mgr.gibba020.yqfnwy (mgr.34427) 5315 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:33:23.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[30381]: audit 2021-03-10T15:33:22.008231+0000 mon.a (mon.0) 2162 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:23.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[30381]: cephadm 2021-03-10T15:33:22.008542+0000 mgr.gibba020.yqfnwy (mgr.34427) 5316 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:33:23.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[30381]: cephadm 2021-03-10T15:33:22.010136+0000 mgr.gibba020.yqfnwy (mgr.34427) 5317 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:33:23.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[30381]: cephadm 2021-03-10T15:33:22.010196+0000 mgr.gibba020.yqfnwy (mgr.34427) 5318 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:33:23.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[30381]: audit 2021-03-10T15:33:22.011450+0000 mon.a (mon.0) 2163 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:23.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[30381]: cephadm 2021-03-10T15:33:22.011754+0000 mgr.gibba020.yqfnwy (mgr.34427) 5319 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:33:23.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[30381]: cephadm 2021-03-10T15:33:22.012153+0000 mgr.gibba020.yqfnwy (mgr.34427) 5320 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:33:23.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[30381]: audit 2021-03-10T15:33:22.013373+0000 mon.a (mon.0) 2164 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:23.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[30381]: cephadm 2021-03-10T15:33:22.013953+0000 mgr.gibba020.yqfnwy (mgr.34427) 5321 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:33:23.388 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[29418]: cephadm 2021-03-10T15:33:21.770506+0000 mgr.gibba020.yqfnwy (mgr.34427) 5308 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:33:23.389 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[29418]: cephadm 2021-03-10T15:33:21.772394+0000 mgr.gibba020.yqfnwy (mgr.34427) 5309 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:33:23.389 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[29418]: audit 2021-03-10T15:33:21.999757+0000 mon.a (mon.0) 2158 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:33:23.389 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[29418]: cephadm 2021-03-10T15:33:22.001785+0000 mgr.gibba020.yqfnwy (mgr.34427) 5310 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:33:23.389 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[29418]: audit 2021-03-10T15:33:22.003191+0000 mon.a (mon.0) 2159 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:33:23.389 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[29418]: cephadm 2021-03-10T15:33:22.003690+0000 mgr.gibba020.yqfnwy (mgr.34427) 5311 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:33:23.390 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[29418]: audit 2021-03-10T15:33:22.004857+0000 mon.a (mon.0) 2160 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:23.390 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[29418]: cephadm 2021-03-10T15:33:22.005390+0000 mgr.gibba020.yqfnwy (mgr.34427) 5312 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:33:23.390 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[29418]: cephadm 2021-03-10T15:33:22.005463+0000 mgr.gibba020.yqfnwy (mgr.34427) 5313 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:33:23.390 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[29418]: audit 2021-03-10T15:33:22.006667+0000 mon.a (mon.0) 2161 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:23.391 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[29418]: cephadm 2021-03-10T15:33:22.007059+0000 mgr.gibba020.yqfnwy (mgr.34427) 5314 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:33:23.391 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[29418]: cephadm 2021-03-10T15:33:22.007150+0000 mgr.gibba020.yqfnwy (mgr.34427) 5315 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:33:23.391 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[29418]: audit 2021-03-10T15:33:22.008231+0000 mon.a (mon.0) 2162 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:23.391 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[29418]: cephadm 2021-03-10T15:33:22.008542+0000 mgr.gibba020.yqfnwy (mgr.34427) 5316 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:33:23.391 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[29418]: cephadm 2021-03-10T15:33:22.010136+0000 mgr.gibba020.yqfnwy (mgr.34427) 5317 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:33:23.392 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[29418]: cephadm 2021-03-10T15:33:22.010196+0000 mgr.gibba020.yqfnwy (mgr.34427) 5318 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:33:23.392 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[29418]: audit 2021-03-10T15:33:22.011450+0000 mon.a (mon.0) 2163 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:23.392 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[29418]: cephadm 2021-03-10T15:33:22.011754+0000 mgr.gibba020.yqfnwy (mgr.34427) 5319 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:33:23.392 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[29418]: cephadm 2021-03-10T15:33:22.012153+0000 mgr.gibba020.yqfnwy (mgr.34427) 5320 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:33:23.392 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[29418]: audit 2021-03-10T15:33:22.013373+0000 mon.a (mon.0) 2164 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:23.393 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[29418]: cephadm 2021-03-10T15:33:22.013953+0000 mgr.gibba020.yqfnwy (mgr.34427) 5321 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:33:23.393 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[29418]: cephadm 2021-03-10T15:33:22.014017+0000 mgr.gibba020.yqfnwy (mgr.34427) 5322 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:33:23.393 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[29418]: cephadm 2021-03-10T15:33:22.014151+0000 mgr.gibba020.yqfnwy (mgr.34427) 5323 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:33:23.393 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[30381]: cephadm 2021-03-10T15:33:22.014017+0000 mgr.gibba020.yqfnwy (mgr.34427) 5322 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:33:23.394 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:23 gibba013 bash[30381]: cephadm 2021-03-10T15:33:22.014151+0000 mgr.gibba020.yqfnwy (mgr.34427) 5323 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:33:23.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:23 gibba020 bash[25448]: cephadm 2021-03-10T15:33:21.770506+0000 mgr.gibba020.yqfnwy (mgr.34427) 5308 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:33:23.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:23 gibba020 bash[25448]: cephadm 2021-03-10T15:33:21.772394+0000 mgr.gibba020.yqfnwy (mgr.34427) 5309 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:33:23.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:23 gibba020 bash[25448]: audit 2021-03-10T15:33:21.999757+0000 mon.a (mon.0) 2158 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:33:23.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:23 gibba020 bash[25448]: cephadm 2021-03-10T15:33:22.001785+0000 mgr.gibba020.yqfnwy (mgr.34427) 5310 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:33:23.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:23 gibba020 bash[25448]: audit 2021-03-10T15:33:22.003191+0000 mon.a (mon.0) 2159 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:33:23.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:23 gibba020 bash[25448]: cephadm 2021-03-10T15:33:22.003690+0000 mgr.gibba020.yqfnwy (mgr.34427) 5311 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:33:23.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:23 gibba020 bash[25448]: audit 2021-03-10T15:33:22.004857+0000 mon.a (mon.0) 2160 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:23.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:23 gibba020 bash[25448]: cephadm 2021-03-10T15:33:22.005390+0000 mgr.gibba020.yqfnwy (mgr.34427) 5312 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:33:23.456 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:23 gibba020 bash[25448]: cephadm 2021-03-10T15:33:22.005463+0000 mgr.gibba020.yqfnwy (mgr.34427) 5313 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:33:23.456 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:23 gibba020 bash[25448]: audit 2021-03-10T15:33:22.006667+0000 mon.a (mon.0) 2161 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:23.456 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:23 gibba020 bash[25448]: cephadm 2021-03-10T15:33:22.007059+0000 mgr.gibba020.yqfnwy (mgr.34427) 5314 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:33:23.457 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:23 gibba020 bash[25448]: cephadm 2021-03-10T15:33:22.007150+0000 mgr.gibba020.yqfnwy (mgr.34427) 5315 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:33:23.457 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:23 gibba020 bash[25448]: audit 2021-03-10T15:33:22.008231+0000 mon.a (mon.0) 2162 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:23.457 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:23 gibba020 bash[25448]: cephadm 2021-03-10T15:33:22.008542+0000 mgr.gibba020.yqfnwy (mgr.34427) 5316 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:33:23.458 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:23 gibba020 bash[25448]: cephadm 2021-03-10T15:33:22.010136+0000 mgr.gibba020.yqfnwy (mgr.34427) 5317 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:33:23.458 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:23 gibba020 bash[25448]: cephadm 2021-03-10T15:33:22.010196+0000 mgr.gibba020.yqfnwy (mgr.34427) 5318 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:33:23.459 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:23 gibba020 bash[25448]: audit 2021-03-10T15:33:22.011450+0000 mon.a (mon.0) 2163 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:23.459 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:23 gibba020 bash[25448]: cephadm 2021-03-10T15:33:22.011754+0000 mgr.gibba020.yqfnwy (mgr.34427) 5319 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:33:23.460 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:23 gibba020 bash[25448]: cephadm 2021-03-10T15:33:22.012153+0000 mgr.gibba020.yqfnwy (mgr.34427) 5320 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:33:23.460 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:23 gibba020 bash[25448]: audit 2021-03-10T15:33:22.013373+0000 mon.a (mon.0) 2164 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:23.460 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:23 gibba020 bash[25448]: cephadm 2021-03-10T15:33:22.013953+0000 mgr.gibba020.yqfnwy (mgr.34427) 5321 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:33:23.461 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:23 gibba020 bash[25448]: cephadm 2021-03-10T15:33:22.014017+0000 mgr.gibba020.yqfnwy (mgr.34427) 5322 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:33:23.461 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:23 gibba020 bash[25448]: cephadm 2021-03-10T15:33:22.014151+0000 mgr.gibba020.yqfnwy (mgr.34427) 5323 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:33:24.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:24 gibba013 bash[30381]: cluster 2021-03-10T15:33:22.754756+0000 mgr.gibba020.yqfnwy (mgr.34427) 5324 : cluster [DBG] pgmap v3021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:24.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:24 gibba013 bash[29418]: cluster 2021-03-10T15:33:22.754756+0000 mgr.gibba020.yqfnwy (mgr.34427) 5324 : cluster [DBG] pgmap v3021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:24.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:24 gibba020 bash[25448]: cluster 2021-03-10T15:33:22.754756+0000 mgr.gibba020.yqfnwy (mgr.34427) 5324 : cluster [DBG] pgmap v3021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:26.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:26 gibba013 bash[29418]: cluster 2021-03-10T15:33:24.756376+0000 mgr.gibba020.yqfnwy (mgr.34427) 5325 : cluster [DBG] pgmap v3022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:26.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:26 gibba013 bash[30381]: cluster 2021-03-10T15:33:24.756376+0000 mgr.gibba020.yqfnwy (mgr.34427) 5325 : cluster [DBG] pgmap v3022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:26.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:26 gibba020 bash[25448]: cluster 2021-03-10T15:33:24.756376+0000 mgr.gibba020.yqfnwy (mgr.34427) 5325 : cluster [DBG] pgmap v3022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:28.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:28 gibba013 bash[30381]: cluster 2021-03-10T15:33:26.758082+0000 mgr.gibba020.yqfnwy (mgr.34427) 5326 : cluster [DBG] pgmap v3023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:28.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:28 gibba013 bash[29418]: cluster 2021-03-10T15:33:26.758082+0000 mgr.gibba020.yqfnwy (mgr.34427) 5326 : cluster [DBG] pgmap v3023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:28.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:28 gibba020 bash[25448]: cluster 2021-03-10T15:33:26.758082+0000 mgr.gibba020.yqfnwy (mgr.34427) 5326 : cluster [DBG] pgmap v3023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:30.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:30 gibba013 bash[29418]: cluster 2021-03-10T15:33:28.759589+0000 mgr.gibba020.yqfnwy (mgr.34427) 5327 : cluster [DBG] pgmap v3024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:30.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:30 gibba013 bash[30381]: cluster 2021-03-10T15:33:28.759589+0000 mgr.gibba020.yqfnwy (mgr.34427) 5327 : cluster [DBG] pgmap v3024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:30.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:30 gibba020 bash[25448]: cluster 2021-03-10T15:33:28.759589+0000 mgr.gibba020.yqfnwy (mgr.34427) 5327 : cluster [DBG] pgmap v3024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:32.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:32 gibba013 bash[30381]: cluster 2021-03-10T15:33:30.761277+0000 mgr.gibba020.yqfnwy (mgr.34427) 5328 : cluster [DBG] pgmap v3025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:32.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:32 gibba013 bash[29418]: cluster 2021-03-10T15:33:30.761277+0000 mgr.gibba020.yqfnwy (mgr.34427) 5328 : cluster [DBG] pgmap v3025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:32.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:32 gibba020 bash[25448]: cluster 2021-03-10T15:33:30.761277+0000 mgr.gibba020.yqfnwy (mgr.34427) 5328 : cluster [DBG] pgmap v3025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:33.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:33 gibba013 bash[30381]: cluster 2021-03-10T15:33:32.762773+0000 mgr.gibba020.yqfnwy (mgr.34427) 5329 : cluster [DBG] pgmap v3026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:33.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:33 gibba013 bash[29418]: cluster 2021-03-10T15:33:32.762773+0000 mgr.gibba020.yqfnwy (mgr.34427) 5329 : cluster [DBG] pgmap v3026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:33.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:33 gibba020 bash[25448]: cluster 2021-03-10T15:33:32.762773+0000 mgr.gibba020.yqfnwy (mgr.34427) 5329 : cluster [DBG] pgmap v3026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:36.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:35 gibba013 bash[30381]: cluster 2021-03-10T15:33:34.764085+0000 mgr.gibba020.yqfnwy (mgr.34427) 5330 : cluster [DBG] pgmap v3027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:36.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:35 gibba013 bash[29418]: cluster 2021-03-10T15:33:34.764085+0000 mgr.gibba020.yqfnwy (mgr.34427) 5330 : cluster [DBG] pgmap v3027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:36.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:35 gibba020 bash[25448]: cluster 2021-03-10T15:33:34.764085+0000 mgr.gibba020.yqfnwy (mgr.34427) 5330 : cluster [DBG] pgmap v3027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:38.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:37 gibba013 bash[30381]: cluster 2021-03-10T15:33:36.765558+0000 mgr.gibba020.yqfnwy (mgr.34427) 5331 : cluster [DBG] pgmap v3028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:38.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:37 gibba013 bash[30381]: cephadm 2021-03-10T15:33:37.030122+0000 mgr.gibba020.yqfnwy (mgr.34427) 5332 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:33:38.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:37 gibba013 bash[29418]: cluster 2021-03-10T15:33:36.765558+0000 mgr.gibba020.yqfnwy (mgr.34427) 5331 : cluster [DBG] pgmap v3028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:38.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:37 gibba013 bash[29418]: cephadm 2021-03-10T15:33:37.030122+0000 mgr.gibba020.yqfnwy (mgr.34427) 5332 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:33:38.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:37 gibba020 bash[25448]: cluster 2021-03-10T15:33:36.765558+0000 mgr.gibba020.yqfnwy (mgr.34427) 5331 : cluster [DBG] pgmap v3028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:38.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:37 gibba020 bash[25448]: cephadm 2021-03-10T15:33:37.030122+0000 mgr.gibba020.yqfnwy (mgr.34427) 5332 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:33:40.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:39 gibba013 bash[30381]: cluster 2021-03-10T15:33:38.767068+0000 mgr.gibba020.yqfnwy (mgr.34427) 5333 : cluster [DBG] pgmap v3029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:40.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:39 gibba013 bash[29418]: cluster 2021-03-10T15:33:38.767068+0000 mgr.gibba020.yqfnwy (mgr.34427) 5333 : cluster [DBG] pgmap v3029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:40.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:39 gibba020 bash[25448]: cluster 2021-03-10T15:33:38.767068+0000 mgr.gibba020.yqfnwy (mgr.34427) 5333 : cluster [DBG] pgmap v3029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:42.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:41 gibba013 bash[29418]: cluster 2021-03-10T15:33:40.768579+0000 mgr.gibba020.yqfnwy (mgr.34427) 5334 : cluster [DBG] pgmap v3030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:42.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:41 gibba013 bash[30381]: cluster 2021-03-10T15:33:40.768579+0000 mgr.gibba020.yqfnwy (mgr.34427) 5334 : cluster [DBG] pgmap v3030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:42.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:41 gibba020 bash[25448]: cluster 2021-03-10T15:33:40.768579+0000 mgr.gibba020.yqfnwy (mgr.34427) 5334 : cluster [DBG] pgmap v3030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:43.665 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:33:43.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:43 gibba013 bash[29418]: cluster 2021-03-10T15:33:42.769854+0000 mgr.gibba020.yqfnwy (mgr.34427) 5335 : cluster [DBG] pgmap v3031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:43.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:43 gibba013 bash[30381]: cluster 2021-03-10T15:33:42.769854+0000 mgr.gibba020.yqfnwy (mgr.34427) 5335 : cluster [DBG] pgmap v3031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:43.890 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:33:43.891 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (100m) 4m ago 105m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:33:43.891 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (105m) 3m ago 105m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:33:43.891 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (100m) 3m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:33:43.891 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (100m) 3m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:33:43.891 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (99m) 4m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:33:43.892 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (99m) 4m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:33:43.892 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (99m) 3m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:33:43.892 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (99m) 4m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:33:43.893 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (105m) 4m ago 105m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:33:43.893 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (105m) 3m ago 105m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:33:43.893 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (98m) 4m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:33:43.893 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (98m) 4m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:33:43.894 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (97m) 4m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:33:43.894 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (97m) 4m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:33:43.894 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (96m) 3m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:33:43.894 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (96m) 3m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:33:43.895 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (95m) 3m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:33:43.895 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (95m) 3m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:33:43.895 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (105m) 3m ago 105m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:33:43.895 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 3m ago 103m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:33:43.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:43 gibba020 bash[25448]: cluster 2021-03-10T15:33:42.769854+0000 mgr.gibba020.yqfnwy (mgr.34427) 5335 : cluster [DBG] pgmap v3031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:44.142 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:33:44.142 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:33:44.142 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:33:44.143 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:33:44.143 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:33:44.143 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:33:44.143 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:33:44.144 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:33:44.144 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:33:44.144 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:33:44.145 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:33:44.145 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:33:44.145 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:33:44.145 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:33:44.145 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:33:44.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:44 gibba013 bash[29418]: audit 2021-03-10T15:33:43.652038+0000 mgr.gibba020.yqfnwy (mgr.34427) 5336 : audit [DBG] from='client.47634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:33:44.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:44 gibba013 bash[29418]: audit 2021-03-10T15:33:43.873800+0000 mgr.gibba020.yqfnwy (mgr.34427) 5337 : audit [DBG] from='client.47640 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:33:44.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:44 gibba013 bash[29418]: audit 2021-03-10T15:33:44.138195+0000 mon.a (mon.0) 2165 : audit [DBG] from='client.? 172.21.2.113:0/187342953' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:44.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:44 gibba013 bash[30381]: audit 2021-03-10T15:33:43.652038+0000 mgr.gibba020.yqfnwy (mgr.34427) 5336 : audit [DBG] from='client.47634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:33:44.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:44 gibba013 bash[30381]: audit 2021-03-10T15:33:43.873800+0000 mgr.gibba020.yqfnwy (mgr.34427) 5337 : audit [DBG] from='client.47640 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:33:44.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:44 gibba013 bash[30381]: audit 2021-03-10T15:33:44.138195+0000 mon.a (mon.0) 2165 : audit [DBG] from='client.? 172.21.2.113:0/187342953' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:44.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:44 gibba020 bash[25448]: audit 2021-03-10T15:33:43.652038+0000 mgr.gibba020.yqfnwy (mgr.34427) 5336 : audit [DBG] from='client.47634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:33:44.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:44 gibba020 bash[25448]: audit 2021-03-10T15:33:43.873800+0000 mgr.gibba020.yqfnwy (mgr.34427) 5337 : audit [DBG] from='client.47640 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:33:44.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:44 gibba020 bash[25448]: audit 2021-03-10T15:33:44.138195+0000 mon.a (mon.0) 2165 : audit [DBG] from='client.? 172.21.2.113:0/187342953' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:33:45.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:45 gibba013 bash[29418]: cluster 2021-03-10T15:33:44.771460+0000 mgr.gibba020.yqfnwy (mgr.34427) 5338 : cluster [DBG] pgmap v3032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:45.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:45 gibba013 bash[30381]: cluster 2021-03-10T15:33:44.771460+0000 mgr.gibba020.yqfnwy (mgr.34427) 5338 : cluster [DBG] pgmap v3032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:45.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:45 gibba020 bash[25448]: cluster 2021-03-10T15:33:44.771460+0000 mgr.gibba020.yqfnwy (mgr.34427) 5338 : cluster [DBG] pgmap v3032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:48.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:47 gibba013 bash[29418]: cluster 2021-03-10T15:33:46.773125+0000 mgr.gibba020.yqfnwy (mgr.34427) 5339 : cluster [DBG] pgmap v3033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:48.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:47 gibba013 bash[30381]: cluster 2021-03-10T15:33:46.773125+0000 mgr.gibba020.yqfnwy (mgr.34427) 5339 : cluster [DBG] pgmap v3033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:48.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:47 gibba020 bash[25448]: cluster 2021-03-10T15:33:46.773125+0000 mgr.gibba020.yqfnwy (mgr.34427) 5339 : cluster [DBG] pgmap v3033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:50.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:49 gibba013 bash[29418]: cluster 2021-03-10T15:33:48.774513+0000 mgr.gibba020.yqfnwy (mgr.34427) 5340 : cluster [DBG] pgmap v3034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:50.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:49 gibba013 bash[30381]: cluster 2021-03-10T15:33:48.774513+0000 mgr.gibba020.yqfnwy (mgr.34427) 5340 : cluster [DBG] pgmap v3034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:50.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:49 gibba020 bash[25448]: cluster 2021-03-10T15:33:48.774513+0000 mgr.gibba020.yqfnwy (mgr.34427) 5340 : cluster [DBG] pgmap v3034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:52.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:51 gibba013 bash[29418]: cluster 2021-03-10T15:33:50.776253+0000 mgr.gibba020.yqfnwy (mgr.34427) 5341 : cluster [DBG] pgmap v3035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:52.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:51 gibba013 bash[30381]: cluster 2021-03-10T15:33:50.776253+0000 mgr.gibba020.yqfnwy (mgr.34427) 5341 : cluster [DBG] pgmap v3035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:52.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:51 gibba020 bash[25448]: cluster 2021-03-10T15:33:50.776253+0000 mgr.gibba020.yqfnwy (mgr.34427) 5341 : cluster [DBG] pgmap v3035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:53.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:52 gibba013 bash[29418]: cephadm 2021-03-10T15:33:52.034189+0000 mgr.gibba020.yqfnwy (mgr.34427) 5342 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:33:53.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:52 gibba013 bash[30381]: cephadm 2021-03-10T15:33:52.034189+0000 mgr.gibba020.yqfnwy (mgr.34427) 5342 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:33:53.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:52 gibba020 bash[25448]: cephadm 2021-03-10T15:33:52.034189+0000 mgr.gibba020.yqfnwy (mgr.34427) 5342 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:33:54.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:53 gibba013 bash[29418]: cluster 2021-03-10T15:33:52.777794+0000 mgr.gibba020.yqfnwy (mgr.34427) 5343 : cluster [DBG] pgmap v3036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:54.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:53 gibba013 bash[30381]: cluster 2021-03-10T15:33:52.777794+0000 mgr.gibba020.yqfnwy (mgr.34427) 5343 : cluster [DBG] pgmap v3036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:54.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:53 gibba020 bash[25448]: cluster 2021-03-10T15:33:52.777794+0000 mgr.gibba020.yqfnwy (mgr.34427) 5343 : cluster [DBG] pgmap v3036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:56.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:55 gibba013 bash[29418]: cluster 2021-03-10T15:33:54.779273+0000 mgr.gibba020.yqfnwy (mgr.34427) 5344 : cluster [DBG] pgmap v3037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:56.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:55 gibba013 bash[30381]: cluster 2021-03-10T15:33:54.779273+0000 mgr.gibba020.yqfnwy (mgr.34427) 5344 : cluster [DBG] pgmap v3037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:56.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:55 gibba020 bash[25448]: cluster 2021-03-10T15:33:54.779273+0000 mgr.gibba020.yqfnwy (mgr.34427) 5344 : cluster [DBG] pgmap v3037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:58.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:57 gibba020 bash[25448]: cluster 2021-03-10T15:33:56.780996+0000 mgr.gibba020.yqfnwy (mgr.34427) 5345 : cluster [DBG] pgmap v3038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:58.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:57 gibba013 bash[29418]: cluster 2021-03-10T15:33:56.780996+0000 mgr.gibba020.yqfnwy (mgr.34427) 5345 : cluster [DBG] pgmap v3038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:33:58.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:57 gibba013 bash[30381]: cluster 2021-03-10T15:33:56.780996+0000 mgr.gibba020.yqfnwy (mgr.34427) 5345 : cluster [DBG] pgmap v3038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:00.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:33:59 gibba020 bash[25448]: cluster 2021-03-10T15:33:58.782346+0000 mgr.gibba020.yqfnwy (mgr.34427) 5346 : cluster [DBG] pgmap v3039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:00.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:33:59 gibba013 bash[29418]: cluster 2021-03-10T15:33:58.782346+0000 mgr.gibba020.yqfnwy (mgr.34427) 5346 : cluster [DBG] pgmap v3039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:00.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:33:59 gibba013 bash[30381]: cluster 2021-03-10T15:33:58.782346+0000 mgr.gibba020.yqfnwy (mgr.34427) 5346 : cluster [DBG] pgmap v3039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:02.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:01 gibba020 bash[25448]: cluster 2021-03-10T15:34:00.784086+0000 mgr.gibba020.yqfnwy (mgr.34427) 5347 : cluster [DBG] pgmap v3040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:02.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:01 gibba013 bash[29418]: cluster 2021-03-10T15:34:00.784086+0000 mgr.gibba020.yqfnwy (mgr.34427) 5347 : cluster [DBG] pgmap v3040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:02.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:01 gibba013 bash[30381]: cluster 2021-03-10T15:34:00.784086+0000 mgr.gibba020.yqfnwy (mgr.34427) 5347 : cluster [DBG] pgmap v3040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:03.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:03 gibba013 bash[29418]: cluster 2021-03-10T15:34:02.785324+0000 mgr.gibba020.yqfnwy (mgr.34427) 5348 : cluster [DBG] pgmap v3041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:03.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:03 gibba013 bash[30381]: cluster 2021-03-10T15:34:02.785324+0000 mgr.gibba020.yqfnwy (mgr.34427) 5348 : cluster [DBG] pgmap v3041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:03.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:03 gibba020 bash[25448]: cluster 2021-03-10T15:34:02.785324+0000 mgr.gibba020.yqfnwy (mgr.34427) 5348 : cluster [DBG] pgmap v3041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:06.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:05 gibba013 bash[29418]: cluster 2021-03-10T15:34:04.786929+0000 mgr.gibba020.yqfnwy (mgr.34427) 5349 : cluster [DBG] pgmap v3042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:06.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:05 gibba013 bash[30381]: cluster 2021-03-10T15:34:04.786929+0000 mgr.gibba020.yqfnwy (mgr.34427) 5349 : cluster [DBG] pgmap v3042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:06.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:05 gibba020 bash[25448]: cluster 2021-03-10T15:34:04.786929+0000 mgr.gibba020.yqfnwy (mgr.34427) 5349 : cluster [DBG] pgmap v3042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:07.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:06 gibba013 bash[29418]: audit 2021-03-10T15:34:06.479984+0000 mon.a (mon.0) 2166 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:34:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:06 gibba013 bash[29418]: audit 2021-03-10T15:34:06.549432+0000 mon.a (mon.0) 2167 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:34:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:06 gibba013 bash[29418]: audit 2021-03-10T15:34:06.658288+0000 mon.a (mon.0) 2168 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:34:07.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:06 gibba013 bash[29418]: audit 2021-03-10T15:34:06.658540+0000 mon.a (mon.0) 2169 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:34:07.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:06 gibba013 bash[29418]: audit 2021-03-10T15:34:06.658759+0000 mon.a (mon.0) 2170 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:34:07.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:06 gibba013 bash[29418]: audit 2021-03-10T15:34:06.658975+0000 mon.a (mon.0) 2171 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:34:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:06 gibba013 bash[30381]: audit 2021-03-10T15:34:06.479984+0000 mon.a (mon.0) 2166 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:34:07.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:06 gibba013 bash[30381]: audit 2021-03-10T15:34:06.549432+0000 mon.a (mon.0) 2167 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:34:07.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:06 gibba013 bash[30381]: audit 2021-03-10T15:34:06.658288+0000 mon.a (mon.0) 2168 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:34:07.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:06 gibba013 bash[30381]: audit 2021-03-10T15:34:06.658540+0000 mon.a (mon.0) 2169 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:34:07.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:06 gibba013 bash[30381]: audit 2021-03-10T15:34:06.658759+0000 mon.a (mon.0) 2170 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:34:07.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:06 gibba013 bash[30381]: audit 2021-03-10T15:34:06.658975+0000 mon.a (mon.0) 2171 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:34:07.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:06 gibba020 bash[25448]: audit 2021-03-10T15:34:06.479984+0000 mon.a (mon.0) 2166 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:34:07.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:06 gibba020 bash[25448]: audit 2021-03-10T15:34:06.549432+0000 mon.a (mon.0) 2167 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:34:07.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:06 gibba020 bash[25448]: audit 2021-03-10T15:34:06.658288+0000 mon.a (mon.0) 2168 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:34:07.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:06 gibba020 bash[25448]: audit 2021-03-10T15:34:06.658540+0000 mon.a (mon.0) 2169 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:34:07.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:06 gibba020 bash[25448]: audit 2021-03-10T15:34:06.658759+0000 mon.a (mon.0) 2170 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:34:07.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:06 gibba020 bash[25448]: audit 2021-03-10T15:34:06.658975+0000 mon.a (mon.0) 2171 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:34:08.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:07 gibba013 bash[29418]: cluster 2021-03-10T15:34:06.788564+0000 mgr.gibba020.yqfnwy (mgr.34427) 5350 : cluster [DBG] pgmap v3043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:08.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:07 gibba013 bash[29418]: cephadm 2021-03-10T15:34:07.050276+0000 mgr.gibba020.yqfnwy (mgr.34427) 5351 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:34:08.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:07 gibba013 bash[30381]: cluster 2021-03-10T15:34:06.788564+0000 mgr.gibba020.yqfnwy (mgr.34427) 5350 : cluster [DBG] pgmap v3043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:08.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:07 gibba013 bash[30381]: cephadm 2021-03-10T15:34:07.050276+0000 mgr.gibba020.yqfnwy (mgr.34427) 5351 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:34:08.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:07 gibba020 bash[25448]: cluster 2021-03-10T15:34:06.788564+0000 mgr.gibba020.yqfnwy (mgr.34427) 5350 : cluster [DBG] pgmap v3043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:08.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:07 gibba020 bash[25448]: cephadm 2021-03-10T15:34:07.050276+0000 mgr.gibba020.yqfnwy (mgr.34427) 5351 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:34:10.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:09 gibba013 bash[29418]: cluster 2021-03-10T15:34:08.789883+0000 mgr.gibba020.yqfnwy (mgr.34427) 5352 : cluster [DBG] pgmap v3044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:10.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:09 gibba013 bash[30381]: cluster 2021-03-10T15:34:08.789883+0000 mgr.gibba020.yqfnwy (mgr.34427) 5352 : cluster [DBG] pgmap v3044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:10.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:09 gibba020 bash[25448]: cluster 2021-03-10T15:34:08.789883+0000 mgr.gibba020.yqfnwy (mgr.34427) 5352 : cluster [DBG] pgmap v3044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:12.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:11 gibba020 bash[25448]: cluster 2021-03-10T15:34:10.791567+0000 mgr.gibba020.yqfnwy (mgr.34427) 5353 : cluster [DBG] pgmap v3045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:12.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:11 gibba013 bash[29418]: cluster 2021-03-10T15:34:10.791567+0000 mgr.gibba020.yqfnwy (mgr.34427) 5353 : cluster [DBG] pgmap v3045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:12.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:11 gibba013 bash[30381]: cluster 2021-03-10T15:34:10.791567+0000 mgr.gibba020.yqfnwy (mgr.34427) 5353 : cluster [DBG] pgmap v3045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:13.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:13 gibba013 bash[29418]: cluster 2021-03-10T15:34:12.793100+0000 mgr.gibba020.yqfnwy (mgr.34427) 5354 : cluster [DBG] pgmap v3046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:13.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:13 gibba013 bash[30381]: cluster 2021-03-10T15:34:12.793100+0000 mgr.gibba020.yqfnwy (mgr.34427) 5354 : cluster [DBG] pgmap v3046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:13.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:13 gibba020 bash[25448]: cluster 2021-03-10T15:34:12.793100+0000 mgr.gibba020.yqfnwy (mgr.34427) 5354 : cluster [DBG] pgmap v3046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:14.389 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:34:14.618 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:34:14.618 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (100m) 4m ago 106m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:34:14.619 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (105m) 3m ago 105m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:34:14.619 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (101m) 3m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:34:14.619 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (101m) 3m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:34:14.619 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (100m) 4m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:34:14.619 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (100m) 4m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:34:14.620 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (99m) 3m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:34:14.620 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (99m) 4m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:34:14.620 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (106m) 4m ago 106m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:34:14.620 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (106m) 3m ago 106m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:34:14.621 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (99m) 4m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:34:14.621 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (98m) 4m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:34:14.621 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (98m) 4m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:34:14.621 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (97m) 4m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:34:14.621 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (97m) 3m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:34:14.622 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (96m) 3m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:34:14.622 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (96m) 3m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:34:14.622 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (95m) 3m ago 106m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:34:14.622 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (105m) 3m ago 106m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:34:14.623 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 3m ago 104m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:34:14.866 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:34:14.866 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:34:14.866 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:34:14.867 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:34:14.867 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:34:14.867 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:34:14.867 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:34:14.868 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:34:14.868 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:34:14.868 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:34:14.868 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:34:14.868 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:34:14.869 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:34:14.869 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:34:14.869 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:34:16.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:15 gibba013 bash[29418]: audit 2021-03-10T15:34:14.376110+0000 mgr.gibba020.yqfnwy (mgr.34427) 5355 : audit [DBG] from='client.47652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:34:16.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:15 gibba013 bash[29418]: audit 2021-03-10T15:34:14.600961+0000 mgr.gibba020.yqfnwy (mgr.34427) 5356 : audit [DBG] from='client.57643 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:34:16.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:15 gibba013 bash[29418]: cluster 2021-03-10T15:34:14.794637+0000 mgr.gibba020.yqfnwy (mgr.34427) 5357 : cluster [DBG] pgmap v3047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:16.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:15 gibba013 bash[29418]: audit 2021-03-10T15:34:14.862291+0000 mon.a (mon.0) 2172 : audit [DBG] from='client.? 172.21.2.113:0/4188360426' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:16.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:15 gibba013 bash[30381]: audit 2021-03-10T15:34:14.376110+0000 mgr.gibba020.yqfnwy (mgr.34427) 5355 : audit [DBG] from='client.47652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:34:16.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:15 gibba013 bash[30381]: audit 2021-03-10T15:34:14.600961+0000 mgr.gibba020.yqfnwy (mgr.34427) 5356 : audit [DBG] from='client.57643 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:34:16.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:15 gibba013 bash[30381]: cluster 2021-03-10T15:34:14.794637+0000 mgr.gibba020.yqfnwy (mgr.34427) 5357 : cluster [DBG] pgmap v3047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:16.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:15 gibba013 bash[30381]: audit 2021-03-10T15:34:14.862291+0000 mon.a (mon.0) 2172 : audit [DBG] from='client.? 172.21.2.113:0/4188360426' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:16.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:15 gibba020 bash[25448]: audit 2021-03-10T15:34:14.376110+0000 mgr.gibba020.yqfnwy (mgr.34427) 5355 : audit [DBG] from='client.47652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:34:16.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:15 gibba020 bash[25448]: audit 2021-03-10T15:34:14.600961+0000 mgr.gibba020.yqfnwy (mgr.34427) 5356 : audit [DBG] from='client.57643 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:34:16.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:15 gibba020 bash[25448]: cluster 2021-03-10T15:34:14.794637+0000 mgr.gibba020.yqfnwy (mgr.34427) 5357 : cluster [DBG] pgmap v3047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:16.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:15 gibba020 bash[25448]: audit 2021-03-10T15:34:14.862291+0000 mon.a (mon.0) 2172 : audit [DBG] from='client.? 172.21.2.113:0/4188360426' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:18.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:17 gibba013 bash[29418]: cluster 2021-03-10T15:34:16.796250+0000 mgr.gibba020.yqfnwy (mgr.34427) 5358 : cluster [DBG] pgmap v3048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:18.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:17 gibba013 bash[30381]: cluster 2021-03-10T15:34:16.796250+0000 mgr.gibba020.yqfnwy (mgr.34427) 5358 : cluster [DBG] pgmap v3048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:18.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:17 gibba020 bash[25448]: cluster 2021-03-10T15:34:16.796250+0000 mgr.gibba020.yqfnwy (mgr.34427) 5358 : cluster [DBG] pgmap v3048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:20.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:19 gibba013 bash[29418]: cluster 2021-03-10T15:34:18.797618+0000 mgr.gibba020.yqfnwy (mgr.34427) 5359 : cluster [DBG] pgmap v3049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:20.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:19 gibba013 bash[30381]: cluster 2021-03-10T15:34:18.797618+0000 mgr.gibba020.yqfnwy (mgr.34427) 5359 : cluster [DBG] pgmap v3049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:20.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:19 gibba020 bash[25448]: cluster 2021-03-10T15:34:18.797618+0000 mgr.gibba020.yqfnwy (mgr.34427) 5359 : cluster [DBG] pgmap v3049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:22.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:21 gibba020 bash[25448]: cluster 2021-03-10T15:34:20.799289+0000 mgr.gibba020.yqfnwy (mgr.34427) 5360 : cluster [DBG] pgmap v3050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:22.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:21 gibba013 bash[29418]: cluster 2021-03-10T15:34:20.799289+0000 mgr.gibba020.yqfnwy (mgr.34427) 5360 : cluster [DBG] pgmap v3050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:22.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:21 gibba013 bash[30381]: cluster 2021-03-10T15:34:20.799289+0000 mgr.gibba020.yqfnwy (mgr.34427) 5360 : cluster [DBG] pgmap v3050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:23.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:22 gibba020 bash[25448]: audit 2021-03-10T15:34:22.064788+0000 mon.a (mon.0) 2173 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:34:23.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:22 gibba020 bash[25448]: cephadm 2021-03-10T15:34:22.069383+0000 mgr.gibba020.yqfnwy (mgr.34427) 5361 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:34:23.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:22 gibba020 bash[25448]: cephadm 2021-03-10T15:34:22.071343+0000 mgr.gibba020.yqfnwy (mgr.34427) 5362 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:34:23.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:22 gibba020 bash[25448]: audit 2021-03-10T15:34:22.296266+0000 mon.a (mon.0) 2174 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:34:23.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:22 gibba020 bash[25448]: cephadm 2021-03-10T15:34:22.298083+0000 mgr.gibba020.yqfnwy (mgr.34427) 5363 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:34:23.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:22 gibba020 bash[25448]: audit 2021-03-10T15:34:22.299439+0000 mon.a (mon.0) 2175 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:34:23.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:22 gibba020 bash[25448]: cephadm 2021-03-10T15:34:22.300088+0000 mgr.gibba020.yqfnwy (mgr.34427) 5364 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:34:23.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:22 gibba020 bash[25448]: audit 2021-03-10T15:34:22.301275+0000 mon.a (mon.0) 2176 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:23.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:22 gibba020 bash[25448]: cephadm 2021-03-10T15:34:22.301779+0000 mgr.gibba020.yqfnwy (mgr.34427) 5365 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:34:23.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:22 gibba020 bash[25448]: cephadm 2021-03-10T15:34:22.301817+0000 mgr.gibba020.yqfnwy (mgr.34427) 5366 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:34:23.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:22 gibba020 bash[25448]: audit 2021-03-10T15:34:22.303010+0000 mon.a (mon.0) 2177 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:23.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:22 gibba020 bash[25448]: cephadm 2021-03-10T15:34:22.303363+0000 mgr.gibba020.yqfnwy (mgr.34427) 5367 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:34:23.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:22 gibba020 bash[25448]: cephadm 2021-03-10T15:34:22.303401+0000 mgr.gibba020.yqfnwy (mgr.34427) 5368 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:34:23.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:22 gibba020 bash[25448]: audit 2021-03-10T15:34:22.304514+0000 mon.a (mon.0) 2178 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:23.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:22 gibba020 bash[25448]: cephadm 2021-03-10T15:34:22.304960+0000 mgr.gibba020.yqfnwy (mgr.34427) 5369 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:34:23.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:22 gibba020 bash[25448]: cephadm 2021-03-10T15:34:22.306347+0000 mgr.gibba020.yqfnwy (mgr.34427) 5370 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:34:23.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:22 gibba020 bash[25448]: cephadm 2021-03-10T15:34:22.306385+0000 mgr.gibba020.yqfnwy (mgr.34427) 5371 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:34:23.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:22 gibba020 bash[25448]: audit 2021-03-10T15:34:22.307623+0000 mon.a (mon.0) 2179 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:23.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:22 gibba020 bash[25448]: cephadm 2021-03-10T15:34:22.307920+0000 mgr.gibba020.yqfnwy (mgr.34427) 5372 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:34:23.206 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:22 gibba020 bash[25448]: cephadm 2021-03-10T15:34:22.308327+0000 mgr.gibba020.yqfnwy (mgr.34427) 5373 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:34:23.206 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:22 gibba020 bash[25448]: audit 2021-03-10T15:34:22.309383+0000 mon.a (mon.0) 2180 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:23.206 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:22 gibba020 bash[25448]: cephadm 2021-03-10T15:34:22.309855+0000 mgr.gibba020.yqfnwy (mgr.34427) 5374 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:34:23.206 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:22 gibba020 bash[25448]: cephadm 2021-03-10T15:34:22.309893+0000 mgr.gibba020.yqfnwy (mgr.34427) 5375 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:34:23.207 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:22 gibba020 bash[25448]: cephadm 2021-03-10T15:34:22.310000+0000 mgr.gibba020.yqfnwy (mgr.34427) 5376 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:34:23.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[29418]: audit 2021-03-10T15:34:22.064788+0000 mon.a (mon.0) 2173 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:34:23.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[29418]: cephadm 2021-03-10T15:34:22.069383+0000 mgr.gibba020.yqfnwy (mgr.34427) 5361 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:34:23.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[29418]: cephadm 2021-03-10T15:34:22.071343+0000 mgr.gibba020.yqfnwy (mgr.34427) 5362 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:34:23.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[29418]: audit 2021-03-10T15:34:22.296266+0000 mon.a (mon.0) 2174 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:34:23.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[29418]: cephadm 2021-03-10T15:34:22.298083+0000 mgr.gibba020.yqfnwy (mgr.34427) 5363 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:34:23.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[29418]: audit 2021-03-10T15:34:22.299439+0000 mon.a (mon.0) 2175 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:34:23.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[29418]: cephadm 2021-03-10T15:34:22.300088+0000 mgr.gibba020.yqfnwy (mgr.34427) 5364 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:34:23.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[29418]: audit 2021-03-10T15:34:22.301275+0000 mon.a (mon.0) 2176 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:23.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[29418]: cephadm 2021-03-10T15:34:22.301779+0000 mgr.gibba020.yqfnwy (mgr.34427) 5365 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:34:23.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[29418]: cephadm 2021-03-10T15:34:22.301817+0000 mgr.gibba020.yqfnwy (mgr.34427) 5366 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:34:23.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[29418]: audit 2021-03-10T15:34:22.303010+0000 mon.a (mon.0) 2177 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:23.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[29418]: cephadm 2021-03-10T15:34:22.303363+0000 mgr.gibba020.yqfnwy (mgr.34427) 5367 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:34:23.387 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[29418]: cephadm 2021-03-10T15:34:22.303401+0000 mgr.gibba020.yqfnwy (mgr.34427) 5368 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:34:23.387 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[29418]: audit 2021-03-10T15:34:22.304514+0000 mon.a (mon.0) 2178 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:23.387 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[29418]: cephadm 2021-03-10T15:34:22.304960+0000 mgr.gibba020.yqfnwy (mgr.34427) 5369 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:34:23.387 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[29418]: cephadm 2021-03-10T15:34:22.306347+0000 mgr.gibba020.yqfnwy (mgr.34427) 5370 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:34:23.388 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[29418]: cephadm 2021-03-10T15:34:22.306385+0000 mgr.gibba020.yqfnwy (mgr.34427) 5371 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:34:23.388 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[29418]: audit 2021-03-10T15:34:22.307623+0000 mon.a (mon.0) 2179 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:23.388 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[29418]: cephadm 2021-03-10T15:34:22.307920+0000 mgr.gibba020.yqfnwy (mgr.34427) 5372 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:34:23.388 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[29418]: cephadm 2021-03-10T15:34:22.308327+0000 mgr.gibba020.yqfnwy (mgr.34427) 5373 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:34:23.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[30381]: audit 2021-03-10T15:34:22.064788+0000 mon.a (mon.0) 2173 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:34:23.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[30381]: cephadm 2021-03-10T15:34:22.069383+0000 mgr.gibba020.yqfnwy (mgr.34427) 5361 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:34:23.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[30381]: cephadm 2021-03-10T15:34:22.071343+0000 mgr.gibba020.yqfnwy (mgr.34427) 5362 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:34:23.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[30381]: audit 2021-03-10T15:34:22.296266+0000 mon.a (mon.0) 2174 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:34:23.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[30381]: cephadm 2021-03-10T15:34:22.298083+0000 mgr.gibba020.yqfnwy (mgr.34427) 5363 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:34:23.391 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[30381]: audit 2021-03-10T15:34:22.299439+0000 mon.a (mon.0) 2175 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:34:23.391 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[30381]: cephadm 2021-03-10T15:34:22.300088+0000 mgr.gibba020.yqfnwy (mgr.34427) 5364 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:34:23.392 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[30381]: audit 2021-03-10T15:34:22.301275+0000 mon.a (mon.0) 2176 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:23.392 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[30381]: cephadm 2021-03-10T15:34:22.301779+0000 mgr.gibba020.yqfnwy (mgr.34427) 5365 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:34:23.392 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[30381]: cephadm 2021-03-10T15:34:22.301817+0000 mgr.gibba020.yqfnwy (mgr.34427) 5366 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:34:23.393 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[30381]: audit 2021-03-10T15:34:22.303010+0000 mon.a (mon.0) 2177 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:23.393 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[30381]: cephadm 2021-03-10T15:34:22.303363+0000 mgr.gibba020.yqfnwy (mgr.34427) 5367 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:34:23.393 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[30381]: cephadm 2021-03-10T15:34:22.303401+0000 mgr.gibba020.yqfnwy (mgr.34427) 5368 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:34:23.394 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[30381]: audit 2021-03-10T15:34:22.304514+0000 mon.a (mon.0) 2178 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:23.394 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[30381]: cephadm 2021-03-10T15:34:22.304960+0000 mgr.gibba020.yqfnwy (mgr.34427) 5369 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:34:23.395 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[30381]: cephadm 2021-03-10T15:34:22.306347+0000 mgr.gibba020.yqfnwy (mgr.34427) 5370 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:34:23.395 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[30381]: cephadm 2021-03-10T15:34:22.306385+0000 mgr.gibba020.yqfnwy (mgr.34427) 5371 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:34:23.395 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[30381]: audit 2021-03-10T15:34:22.307623+0000 mon.a (mon.0) 2179 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:23.395 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[30381]: cephadm 2021-03-10T15:34:22.307920+0000 mgr.gibba020.yqfnwy (mgr.34427) 5372 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:34:23.396 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[30381]: cephadm 2021-03-10T15:34:22.308327+0000 mgr.gibba020.yqfnwy (mgr.34427) 5373 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:34:23.396 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[29418]: audit 2021-03-10T15:34:22.309383+0000 mon.a (mon.0) 2180 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:23.396 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[29418]: cephadm 2021-03-10T15:34:22.309855+0000 mgr.gibba020.yqfnwy (mgr.34427) 5374 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:34:23.397 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[29418]: cephadm 2021-03-10T15:34:22.309893+0000 mgr.gibba020.yqfnwy (mgr.34427) 5375 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:34:23.397 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[29418]: cephadm 2021-03-10T15:34:22.310000+0000 mgr.gibba020.yqfnwy (mgr.34427) 5376 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:34:23.397 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[30381]: audit 2021-03-10T15:34:22.309383+0000 mon.a (mon.0) 2180 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:23.397 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[30381]: cephadm 2021-03-10T15:34:22.309855+0000 mgr.gibba020.yqfnwy (mgr.34427) 5374 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:34:23.398 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[30381]: cephadm 2021-03-10T15:34:22.309893+0000 mgr.gibba020.yqfnwy (mgr.34427) 5375 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:34:23.398 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:22 gibba013 bash[30381]: cephadm 2021-03-10T15:34:22.310000+0000 mgr.gibba020.yqfnwy (mgr.34427) 5376 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:34:24.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:23 gibba020 bash[25448]: cluster 2021-03-10T15:34:22.800867+0000 mgr.gibba020.yqfnwy (mgr.34427) 5377 : cluster [DBG] pgmap v3051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:24.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:23 gibba013 bash[29418]: cluster 2021-03-10T15:34:22.800867+0000 mgr.gibba020.yqfnwy (mgr.34427) 5377 : cluster [DBG] pgmap v3051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:24.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:23 gibba013 bash[30381]: cluster 2021-03-10T15:34:22.800867+0000 mgr.gibba020.yqfnwy (mgr.34427) 5377 : cluster [DBG] pgmap v3051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:26.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:25 gibba020 bash[25448]: cluster 2021-03-10T15:34:24.802327+0000 mgr.gibba020.yqfnwy (mgr.34427) 5378 : cluster [DBG] pgmap v3052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:26.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:25 gibba013 bash[29418]: cluster 2021-03-10T15:34:24.802327+0000 mgr.gibba020.yqfnwy (mgr.34427) 5378 : cluster [DBG] pgmap v3052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:26.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:25 gibba013 bash[30381]: cluster 2021-03-10T15:34:24.802327+0000 mgr.gibba020.yqfnwy (mgr.34427) 5378 : cluster [DBG] pgmap v3052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:28.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:27 gibba020 bash[25448]: cluster 2021-03-10T15:34:26.804153+0000 mgr.gibba020.yqfnwy (mgr.34427) 5379 : cluster [DBG] pgmap v3053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:28.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:27 gibba013 bash[29418]: cluster 2021-03-10T15:34:26.804153+0000 mgr.gibba020.yqfnwy (mgr.34427) 5379 : cluster [DBG] pgmap v3053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:28.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:27 gibba013 bash[30381]: cluster 2021-03-10T15:34:26.804153+0000 mgr.gibba020.yqfnwy (mgr.34427) 5379 : cluster [DBG] pgmap v3053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:30.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:29 gibba020 bash[25448]: cluster 2021-03-10T15:34:28.805544+0000 mgr.gibba020.yqfnwy (mgr.34427) 5380 : cluster [DBG] pgmap v3054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:30.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:29 gibba013 bash[29418]: cluster 2021-03-10T15:34:28.805544+0000 mgr.gibba020.yqfnwy (mgr.34427) 5380 : cluster [DBG] pgmap v3054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:30.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:29 gibba013 bash[30381]: cluster 2021-03-10T15:34:28.805544+0000 mgr.gibba020.yqfnwy (mgr.34427) 5380 : cluster [DBG] pgmap v3054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:32.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:31 gibba020 bash[25448]: cluster 2021-03-10T15:34:30.807094+0000 mgr.gibba020.yqfnwy (mgr.34427) 5381 : cluster [DBG] pgmap v3055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:32.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:31 gibba013 bash[29418]: cluster 2021-03-10T15:34:30.807094+0000 mgr.gibba020.yqfnwy (mgr.34427) 5381 : cluster [DBG] pgmap v3055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:32.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:31 gibba013 bash[30381]: cluster 2021-03-10T15:34:30.807094+0000 mgr.gibba020.yqfnwy (mgr.34427) 5381 : cluster [DBG] pgmap v3055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:33.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:33 gibba020 bash[25448]: cluster 2021-03-10T15:34:32.808559+0000 mgr.gibba020.yqfnwy (mgr.34427) 5382 : cluster [DBG] pgmap v3056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:34.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:33 gibba013 bash[29418]: cluster 2021-03-10T15:34:32.808559+0000 mgr.gibba020.yqfnwy (mgr.34427) 5382 : cluster [DBG] pgmap v3056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:34.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:33 gibba013 bash[30381]: cluster 2021-03-10T15:34:32.808559+0000 mgr.gibba020.yqfnwy (mgr.34427) 5382 : cluster [DBG] pgmap v3056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:36.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:35 gibba013 bash[29418]: cluster 2021-03-10T15:34:34.809924+0000 mgr.gibba020.yqfnwy (mgr.34427) 5383 : cluster [DBG] pgmap v3057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:36.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:35 gibba013 bash[30381]: cluster 2021-03-10T15:34:34.809924+0000 mgr.gibba020.yqfnwy (mgr.34427) 5383 : cluster [DBG] pgmap v3057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:36.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:35 gibba020 bash[25448]: cluster 2021-03-10T15:34:34.809924+0000 mgr.gibba020.yqfnwy (mgr.34427) 5383 : cluster [DBG] pgmap v3057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:38.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:37 gibba020 bash[25448]: cluster 2021-03-10T15:34:36.811734+0000 mgr.gibba020.yqfnwy (mgr.34427) 5384 : cluster [DBG] pgmap v3058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:38.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:37 gibba020 bash[25448]: cephadm 2021-03-10T15:34:37.326069+0000 mgr.gibba020.yqfnwy (mgr.34427) 5385 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:34:38.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:37 gibba013 bash[29418]: cluster 2021-03-10T15:34:36.811734+0000 mgr.gibba020.yqfnwy (mgr.34427) 5384 : cluster [DBG] pgmap v3058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:38.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:37 gibba013 bash[29418]: cephadm 2021-03-10T15:34:37.326069+0000 mgr.gibba020.yqfnwy (mgr.34427) 5385 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:34:38.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:37 gibba013 bash[30381]: cluster 2021-03-10T15:34:36.811734+0000 mgr.gibba020.yqfnwy (mgr.34427) 5384 : cluster [DBG] pgmap v3058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:38.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:37 gibba013 bash[30381]: cephadm 2021-03-10T15:34:37.326069+0000 mgr.gibba020.yqfnwy (mgr.34427) 5385 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:34:40.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:39 gibba020 bash[25448]: cluster 2021-03-10T15:34:38.813122+0000 mgr.gibba020.yqfnwy (mgr.34427) 5386 : cluster [DBG] pgmap v3059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:40.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:39 gibba013 bash[29418]: cluster 2021-03-10T15:34:38.813122+0000 mgr.gibba020.yqfnwy (mgr.34427) 5386 : cluster [DBG] pgmap v3059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:40.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:39 gibba013 bash[30381]: cluster 2021-03-10T15:34:38.813122+0000 mgr.gibba020.yqfnwy (mgr.34427) 5386 : cluster [DBG] pgmap v3059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:42.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:41 gibba020 bash[25448]: cluster 2021-03-10T15:34:40.814571+0000 mgr.gibba020.yqfnwy (mgr.34427) 5387 : cluster [DBG] pgmap v3060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:42.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:41 gibba013 bash[29418]: cluster 2021-03-10T15:34:40.814571+0000 mgr.gibba020.yqfnwy (mgr.34427) 5387 : cluster [DBG] pgmap v3060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:42.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:41 gibba013 bash[30381]: cluster 2021-03-10T15:34:40.814571+0000 mgr.gibba020.yqfnwy (mgr.34427) 5387 : cluster [DBG] pgmap v3060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:43.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:43 gibba020 bash[25448]: cluster 2021-03-10T15:34:42.816103+0000 mgr.gibba020.yqfnwy (mgr.34427) 5388 : cluster [DBG] pgmap v3061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:44.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:43 gibba013 bash[29418]: cluster 2021-03-10T15:34:42.816103+0000 mgr.gibba020.yqfnwy (mgr.34427) 5388 : cluster [DBG] pgmap v3061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:44.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:43 gibba013 bash[30381]: cluster 2021-03-10T15:34:42.816103+0000 mgr.gibba020.yqfnwy (mgr.34427) 5388 : cluster [DBG] pgmap v3061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:45.111 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:34:45.368 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:34:45.368 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (101m) 5m ago 106m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:34:45.368 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (106m) 4m ago 106m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:34:45.368 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (101m) 4m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:34:45.369 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (101m) 4m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:34:45.369 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (100m) 5m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:34:45.369 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (100m) 5m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:34:45.369 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (100m) 4m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:34:45.370 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (100m) 5m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:34:45.370 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (106m) 5m ago 106m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:34:45.370 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (106m) 4m ago 106m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:34:45.370 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (99m) 5m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:34:45.371 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (99m) 5m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:34:45.371 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (98m) 5m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:34:45.371 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (98m) 5m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:34:45.371 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (97m) 4m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:34:45.372 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (97m) 4m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:34:45.372 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (96m) 4m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:34:45.372 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (96m) 4m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:34:45.372 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (106m) 4m ago 106m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:34:45.372 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 4m ago 104m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:34:45.614 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:34:45.614 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:34:45.614 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:34:45.615 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:34:45.615 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:34:45.615 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:34:45.615 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:34:45.616 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:34:45.616 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:34:45.616 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:34:45.616 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:34:45.616 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:34:45.617 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:34:45.617 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:34:45.617 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:34:46.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:45 gibba020 bash[25448]: cluster 2021-03-10T15:34:44.817665+0000 mgr.gibba020.yqfnwy (mgr.34427) 5389 : cluster [DBG] pgmap v3062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:46.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:45 gibba020 bash[25448]: audit 2021-03-10T15:34:45.098797+0000 mgr.gibba020.yqfnwy (mgr.34427) 5390 : audit [DBG] from='client.57655 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:34:46.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:45 gibba020 bash[25448]: audit 2021-03-10T15:34:45.322441+0000 mgr.gibba020.yqfnwy (mgr.34427) 5391 : audit [DBG] from='client.47676 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:34:46.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:45 gibba020 bash[25448]: audit 2021-03-10T15:34:45.610112+0000 mon.c (mon.1) 89 : audit [DBG] from='client.? 172.21.2.113:0/1744176488' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:46.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:45 gibba013 bash[29418]: cluster 2021-03-10T15:34:44.817665+0000 mgr.gibba020.yqfnwy (mgr.34427) 5389 : cluster [DBG] pgmap v3062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:46.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:45 gibba013 bash[29418]: audit 2021-03-10T15:34:45.098797+0000 mgr.gibba020.yqfnwy (mgr.34427) 5390 : audit [DBG] from='client.57655 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:34:46.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:45 gibba013 bash[29418]: audit 2021-03-10T15:34:45.322441+0000 mgr.gibba020.yqfnwy (mgr.34427) 5391 : audit [DBG] from='client.47676 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:34:46.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:45 gibba013 bash[29418]: audit 2021-03-10T15:34:45.610112+0000 mon.c (mon.1) 89 : audit [DBG] from='client.? 172.21.2.113:0/1744176488' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:46.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:45 gibba013 bash[30381]: cluster 2021-03-10T15:34:44.817665+0000 mgr.gibba020.yqfnwy (mgr.34427) 5389 : cluster [DBG] pgmap v3062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:46.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:45 gibba013 bash[30381]: audit 2021-03-10T15:34:45.098797+0000 mgr.gibba020.yqfnwy (mgr.34427) 5390 : audit [DBG] from='client.57655 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:34:46.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:45 gibba013 bash[30381]: audit 2021-03-10T15:34:45.322441+0000 mgr.gibba020.yqfnwy (mgr.34427) 5391 : audit [DBG] from='client.47676 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:34:46.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:45 gibba013 bash[30381]: audit 2021-03-10T15:34:45.610112+0000 mon.c (mon.1) 89 : audit [DBG] from='client.? 172.21.2.113:0/1744176488' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:34:48.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:47 gibba020 bash[25448]: cluster 2021-03-10T15:34:46.819392+0000 mgr.gibba020.yqfnwy (mgr.34427) 5392 : cluster [DBG] pgmap v3063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:48.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:47 gibba013 bash[29418]: cluster 2021-03-10T15:34:46.819392+0000 mgr.gibba020.yqfnwy (mgr.34427) 5392 : cluster [DBG] pgmap v3063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:48.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:47 gibba013 bash[30381]: cluster 2021-03-10T15:34:46.819392+0000 mgr.gibba020.yqfnwy (mgr.34427) 5392 : cluster [DBG] pgmap v3063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:50.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:49 gibba020 bash[25448]: cluster 2021-03-10T15:34:48.820837+0000 mgr.gibba020.yqfnwy (mgr.34427) 5393 : cluster [DBG] pgmap v3064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:50.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:49 gibba013 bash[29418]: cluster 2021-03-10T15:34:48.820837+0000 mgr.gibba020.yqfnwy (mgr.34427) 5393 : cluster [DBG] pgmap v3064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:50.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:49 gibba013 bash[30381]: cluster 2021-03-10T15:34:48.820837+0000 mgr.gibba020.yqfnwy (mgr.34427) 5393 : cluster [DBG] pgmap v3064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:52.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:51 gibba020 bash[25448]: cluster 2021-03-10T15:34:50.822536+0000 mgr.gibba020.yqfnwy (mgr.34427) 5394 : cluster [DBG] pgmap v3065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:52.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:51 gibba013 bash[29418]: cluster 2021-03-10T15:34:50.822536+0000 mgr.gibba020.yqfnwy (mgr.34427) 5394 : cluster [DBG] pgmap v3065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:52.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:51 gibba013 bash[30381]: cluster 2021-03-10T15:34:50.822536+0000 mgr.gibba020.yqfnwy (mgr.34427) 5394 : cluster [DBG] pgmap v3065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:53.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:52 gibba020 bash[25448]: cephadm 2021-03-10T15:34:52.335984+0000 mgr.gibba020.yqfnwy (mgr.34427) 5395 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:34:53.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:52 gibba013 bash[29418]: cephadm 2021-03-10T15:34:52.335984+0000 mgr.gibba020.yqfnwy (mgr.34427) 5395 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:34:53.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:52 gibba013 bash[30381]: cephadm 2021-03-10T15:34:52.335984+0000 mgr.gibba020.yqfnwy (mgr.34427) 5395 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:34:54.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:53 gibba020 bash[25448]: cluster 2021-03-10T15:34:52.824081+0000 mgr.gibba020.yqfnwy (mgr.34427) 5396 : cluster [DBG] pgmap v3066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:54.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:53 gibba013 bash[29418]: cluster 2021-03-10T15:34:52.824081+0000 mgr.gibba020.yqfnwy (mgr.34427) 5396 : cluster [DBG] pgmap v3066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:54.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:53 gibba013 bash[30381]: cluster 2021-03-10T15:34:52.824081+0000 mgr.gibba020.yqfnwy (mgr.34427) 5396 : cluster [DBG] pgmap v3066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:56.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:55 gibba020 bash[25448]: cluster 2021-03-10T15:34:54.825846+0000 mgr.gibba020.yqfnwy (mgr.34427) 5397 : cluster [DBG] pgmap v3067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:56.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:55 gibba013 bash[29418]: cluster 2021-03-10T15:34:54.825846+0000 mgr.gibba020.yqfnwy (mgr.34427) 5397 : cluster [DBG] pgmap v3067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:56.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:55 gibba013 bash[30381]: cluster 2021-03-10T15:34:54.825846+0000 mgr.gibba020.yqfnwy (mgr.34427) 5397 : cluster [DBG] pgmap v3067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:58.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:57 gibba020 bash[25448]: cluster 2021-03-10T15:34:56.827825+0000 mgr.gibba020.yqfnwy (mgr.34427) 5398 : cluster [DBG] pgmap v3068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:58.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:57 gibba013 bash[29418]: cluster 2021-03-10T15:34:56.827825+0000 mgr.gibba020.yqfnwy (mgr.34427) 5398 : cluster [DBG] pgmap v3068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:34:58.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:57 gibba013 bash[30381]: cluster 2021-03-10T15:34:56.827825+0000 mgr.gibba020.yqfnwy (mgr.34427) 5398 : cluster [DBG] pgmap v3068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:00.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:34:59 gibba020 bash[25448]: cluster 2021-03-10T15:34:58.829338+0000 mgr.gibba020.yqfnwy (mgr.34427) 5399 : cluster [DBG] pgmap v3069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:00.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:34:59 gibba013 bash[29418]: cluster 2021-03-10T15:34:58.829338+0000 mgr.gibba020.yqfnwy (mgr.34427) 5399 : cluster [DBG] pgmap v3069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:00.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:34:59 gibba013 bash[30381]: cluster 2021-03-10T15:34:58.829338+0000 mgr.gibba020.yqfnwy (mgr.34427) 5399 : cluster [DBG] pgmap v3069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:02.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:01 gibba013 bash[29418]: cluster 2021-03-10T15:35:00.830960+0000 mgr.gibba020.yqfnwy (mgr.34427) 5400 : cluster [DBG] pgmap v3070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:02.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:01 gibba013 bash[30381]: cluster 2021-03-10T15:35:00.830960+0000 mgr.gibba020.yqfnwy (mgr.34427) 5400 : cluster [DBG] pgmap v3070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:02.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:01 gibba020 bash[25448]: cluster 2021-03-10T15:35:00.830960+0000 mgr.gibba020.yqfnwy (mgr.34427) 5400 : cluster [DBG] pgmap v3070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:03.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:03 gibba020 bash[25448]: cluster 2021-03-10T15:35:02.832697+0000 mgr.gibba020.yqfnwy (mgr.34427) 5401 : cluster [DBG] pgmap v3071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:04.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:03 gibba013 bash[29418]: cluster 2021-03-10T15:35:02.832697+0000 mgr.gibba020.yqfnwy (mgr.34427) 5401 : cluster [DBG] pgmap v3071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:04.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:03 gibba013 bash[30381]: cluster 2021-03-10T15:35:02.832697+0000 mgr.gibba020.yqfnwy (mgr.34427) 5401 : cluster [DBG] pgmap v3071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:06.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:05 gibba020 bash[25448]: cluster 2021-03-10T15:35:04.834301+0000 mgr.gibba020.yqfnwy (mgr.34427) 5402 : cluster [DBG] pgmap v3072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:06.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:05 gibba013 bash[29418]: cluster 2021-03-10T15:35:04.834301+0000 mgr.gibba020.yqfnwy (mgr.34427) 5402 : cluster [DBG] pgmap v3072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:06.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:05 gibba013 bash[30381]: cluster 2021-03-10T15:35:04.834301+0000 mgr.gibba020.yqfnwy (mgr.34427) 5402 : cluster [DBG] pgmap v3072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:07.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:06 gibba020 bash[25448]: audit 2021-03-10T15:35:06.484558+0000 mon.a (mon.0) 2181 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:35:07.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:06 gibba020 bash[25448]: audit 2021-03-10T15:35:06.556008+0000 mon.a (mon.0) 2182 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:35:07.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:06 gibba020 bash[25448]: audit 2021-03-10T15:35:06.661786+0000 mon.a (mon.0) 2183 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:35:07.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:06 gibba020 bash[25448]: audit 2021-03-10T15:35:06.662629+0000 mon.a (mon.0) 2184 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:35:07.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:06 gibba020 bash[25448]: audit 2021-03-10T15:35:06.663299+0000 mon.a (mon.0) 2185 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:35:07.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:06 gibba020 bash[25448]: audit 2021-03-10T15:35:06.663945+0000 mon.a (mon.0) 2186 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:35:07.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:06 gibba013 bash[29418]: audit 2021-03-10T15:35:06.484558+0000 mon.a (mon.0) 2181 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:35:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:06 gibba013 bash[29418]: audit 2021-03-10T15:35:06.556008+0000 mon.a (mon.0) 2182 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:35:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:06 gibba013 bash[29418]: audit 2021-03-10T15:35:06.661786+0000 mon.a (mon.0) 2183 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:35:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:06 gibba013 bash[29418]: audit 2021-03-10T15:35:06.662629+0000 mon.a (mon.0) 2184 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:35:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:06 gibba013 bash[29418]: audit 2021-03-10T15:35:06.663299+0000 mon.a (mon.0) 2185 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:35:07.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:06 gibba013 bash[29418]: audit 2021-03-10T15:35:06.663945+0000 mon.a (mon.0) 2186 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:35:07.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:06 gibba013 bash[30381]: audit 2021-03-10T15:35:06.484558+0000 mon.a (mon.0) 2181 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:35:07.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:06 gibba013 bash[30381]: audit 2021-03-10T15:35:06.556008+0000 mon.a (mon.0) 2182 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:35:07.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:06 gibba013 bash[30381]: audit 2021-03-10T15:35:06.661786+0000 mon.a (mon.0) 2183 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T15:35:07.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:06 gibba013 bash[30381]: audit 2021-03-10T15:35:06.662629+0000 mon.a (mon.0) 2184 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:35:07.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:06 gibba013 bash[30381]: audit 2021-03-10T15:35:06.663299+0000 mon.a (mon.0) 2185 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:35:07.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:06 gibba013 bash[30381]: audit 2021-03-10T15:35:06.663945+0000 mon.a (mon.0) 2186 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:35:08.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:07 gibba020 bash[25448]: cluster 2021-03-10T15:35:06.836152+0000 mgr.gibba020.yqfnwy (mgr.34427) 5403 : cluster [DBG] pgmap v3073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:08.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:07 gibba020 bash[25448]: cephadm 2021-03-10T15:35:07.345923+0000 mgr.gibba020.yqfnwy (mgr.34427) 5404 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:35:08.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:07 gibba013 bash[29418]: cluster 2021-03-10T15:35:06.836152+0000 mgr.gibba020.yqfnwy (mgr.34427) 5403 : cluster [DBG] pgmap v3073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:08.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:07 gibba013 bash[29418]: cephadm 2021-03-10T15:35:07.345923+0000 mgr.gibba020.yqfnwy (mgr.34427) 5404 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:35:08.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:07 gibba013 bash[30381]: cluster 2021-03-10T15:35:06.836152+0000 mgr.gibba020.yqfnwy (mgr.34427) 5403 : cluster [DBG] pgmap v3073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:08.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:07 gibba013 bash[30381]: cephadm 2021-03-10T15:35:07.345923+0000 mgr.gibba020.yqfnwy (mgr.34427) 5404 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:35:10.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:09 gibba020 bash[25448]: cluster 2021-03-10T15:35:08.837808+0000 mgr.gibba020.yqfnwy (mgr.34427) 5405 : cluster [DBG] pgmap v3074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:10.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:09 gibba013 bash[29418]: cluster 2021-03-10T15:35:08.837808+0000 mgr.gibba020.yqfnwy (mgr.34427) 5405 : cluster [DBG] pgmap v3074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:10.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:09 gibba013 bash[30381]: cluster 2021-03-10T15:35:08.837808+0000 mgr.gibba020.yqfnwy (mgr.34427) 5405 : cluster [DBG] pgmap v3074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:12.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:11 gibba020 bash[25448]: cluster 2021-03-10T15:35:10.839382+0000 mgr.gibba020.yqfnwy (mgr.34427) 5406 : cluster [DBG] pgmap v3075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:12.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:11 gibba013 bash[29418]: cluster 2021-03-10T15:35:10.839382+0000 mgr.gibba020.yqfnwy (mgr.34427) 5406 : cluster [DBG] pgmap v3075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:12.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:11 gibba013 bash[30381]: cluster 2021-03-10T15:35:10.839382+0000 mgr.gibba020.yqfnwy (mgr.34427) 5406 : cluster [DBG] pgmap v3075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:13.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:13 gibba020 bash[25448]: cluster 2021-03-10T15:35:12.840630+0000 mgr.gibba020.yqfnwy (mgr.34427) 5407 : cluster [DBG] pgmap v3076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:14.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:13 gibba013 bash[29418]: cluster 2021-03-10T15:35:12.840630+0000 mgr.gibba020.yqfnwy (mgr.34427) 5407 : cluster [DBG] pgmap v3076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:14.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:13 gibba013 bash[30381]: cluster 2021-03-10T15:35:12.840630+0000 mgr.gibba020.yqfnwy (mgr.34427) 5407 : cluster [DBG] pgmap v3076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:15.865 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:35:16.104 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:35:16.105 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (101m) 5m ago 107m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:35:16.105 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (106m) 4m ago 106m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:35:16.106 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (102m) 4m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:35:16.106 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (102m) 4m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:35:16.106 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (101m) 5m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:35:16.107 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (101m) 5m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:35:16.107 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (100m) 4m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:35:16.107 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (101m) 5m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:35:16.107 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (107m) 5m ago 107m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:35:16.108 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (107m) 4m ago 107m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:35:16.108 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (100m) 5m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:35:16.108 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (99m) 5m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:35:16.109 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (99m) 5m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:35:16.109 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (98m) 5m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:35:16.109 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (98m) 4m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:35:16.110 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (97m) 4m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:35:16.110 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (97m) 4m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:35:16.110 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (97m) 4m ago 107m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:35:16.111 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (106m) 4m ago 107m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:35:16.111 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 4m ago 105m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:35:16.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:15 gibba020 bash[25448]: cluster 2021-03-10T15:35:14.841985+0000 mgr.gibba020.yqfnwy (mgr.34427) 5408 : cluster [DBG] pgmap v3077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:16.354 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:35:16.355 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:35:16.355 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:35:16.355 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:35:16.355 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:35:16.356 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:35:16.356 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:35:16.356 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:35:16.356 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:35:16.356 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:35:16.357 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:35:16.357 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:35:16.357 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:35:16.357 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:35:16.357 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:35:16.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:15 gibba013 bash[29418]: cluster 2021-03-10T15:35:14.841985+0000 mgr.gibba020.yqfnwy (mgr.34427) 5408 : cluster [DBG] pgmap v3077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:16.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:15 gibba013 bash[30381]: cluster 2021-03-10T15:35:14.841985+0000 mgr.gibba020.yqfnwy (mgr.34427) 5408 : cluster [DBG] pgmap v3077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:17.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:16 gibba020 bash[25448]: audit 2021-03-10T15:35:15.842888+0000 mgr.gibba020.yqfnwy (mgr.34427) 5409 : audit [DBG] from='client.57673 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:35:17.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:16 gibba020 bash[25448]: audit 2021-03-10T15:35:16.087752+0000 mgr.gibba020.yqfnwy (mgr.34427) 5410 : audit [DBG] from='client.47694 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:35:17.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:16 gibba020 bash[25448]: audit 2021-03-10T15:35:16.350507+0000 mon.a (mon.0) 2187 : audit [DBG] from='client.? 172.21.2.113:0/3827752775' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:17.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:16 gibba013 bash[29418]: audit 2021-03-10T15:35:15.842888+0000 mgr.gibba020.yqfnwy (mgr.34427) 5409 : audit [DBG] from='client.57673 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:35:17.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:16 gibba013 bash[29418]: audit 2021-03-10T15:35:16.087752+0000 mgr.gibba020.yqfnwy (mgr.34427) 5410 : audit [DBG] from='client.47694 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:35:17.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:16 gibba013 bash[29418]: audit 2021-03-10T15:35:16.350507+0000 mon.a (mon.0) 2187 : audit [DBG] from='client.? 172.21.2.113:0/3827752775' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:17.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:16 gibba013 bash[30381]: audit 2021-03-10T15:35:15.842888+0000 mgr.gibba020.yqfnwy (mgr.34427) 5409 : audit [DBG] from='client.57673 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:35:17.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:16 gibba013 bash[30381]: audit 2021-03-10T15:35:16.087752+0000 mgr.gibba020.yqfnwy (mgr.34427) 5410 : audit [DBG] from='client.47694 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:35:17.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:16 gibba013 bash[30381]: audit 2021-03-10T15:35:16.350507+0000 mon.a (mon.0) 2187 : audit [DBG] from='client.? 172.21.2.113:0/3827752775' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:18.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:17 gibba020 bash[25448]: cluster 2021-03-10T15:35:16.843721+0000 mgr.gibba020.yqfnwy (mgr.34427) 5411 : cluster [DBG] pgmap v3078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:18.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:17 gibba013 bash[29418]: cluster 2021-03-10T15:35:16.843721+0000 mgr.gibba020.yqfnwy (mgr.34427) 5411 : cluster [DBG] pgmap v3078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:18.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:17 gibba013 bash[30381]: cluster 2021-03-10T15:35:16.843721+0000 mgr.gibba020.yqfnwy (mgr.34427) 5411 : cluster [DBG] pgmap v3078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:20.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:19 gibba020 bash[25448]: cluster 2021-03-10T15:35:18.845290+0000 mgr.gibba020.yqfnwy (mgr.34427) 5412 : cluster [DBG] pgmap v3079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:20.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:19 gibba013 bash[29418]: cluster 2021-03-10T15:35:18.845290+0000 mgr.gibba020.yqfnwy (mgr.34427) 5412 : cluster [DBG] pgmap v3079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:20.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:19 gibba013 bash[30381]: cluster 2021-03-10T15:35:18.845290+0000 mgr.gibba020.yqfnwy (mgr.34427) 5412 : cluster [DBG] pgmap v3079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:22.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:21 gibba020 bash[25448]: cluster 2021-03-10T15:35:20.846855+0000 mgr.gibba020.yqfnwy (mgr.34427) 5413 : cluster [DBG] pgmap v3080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:22.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:21 gibba013 bash[29418]: cluster 2021-03-10T15:35:20.846855+0000 mgr.gibba020.yqfnwy (mgr.34427) 5413 : cluster [DBG] pgmap v3080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:22.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:21 gibba013 bash[30381]: cluster 2021-03-10T15:35:20.846855+0000 mgr.gibba020.yqfnwy (mgr.34427) 5413 : cluster [DBG] pgmap v3080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:23.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:22 gibba020 bash[25448]: audit 2021-03-10T15:35:22.363216+0000 mon.a (mon.0) 2188 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:35:23.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:22 gibba020 bash[25448]: cephadm 2021-03-10T15:35:22.367778+0000 mgr.gibba020.yqfnwy (mgr.34427) 5414 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:35:23.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:22 gibba020 bash[25448]: cephadm 2021-03-10T15:35:22.369700+0000 mgr.gibba020.yqfnwy (mgr.34427) 5415 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:35:23.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:22 gibba020 bash[25448]: audit 2021-03-10T15:35:22.587335+0000 mon.a (mon.0) 2189 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:35:23.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:22 gibba020 bash[25448]: audit 2021-03-10T15:35:22.590989+0000 mon.a (mon.0) 2190 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:35:23.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:22 gibba020 bash[25448]: audit 2021-03-10T15:35:22.593365+0000 mon.a (mon.0) 2191 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:23.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:22 gibba020 bash[25448]: audit 2021-03-10T15:35:22.595864+0000 mon.a (mon.0) 2192 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:23.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:22 gibba020 bash[25448]: audit 2021-03-10T15:35:22.597922+0000 mon.a (mon.0) 2193 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:23.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:22 gibba020 bash[25448]: audit 2021-03-10T15:35:22.602351+0000 mon.a (mon.0) 2194 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:23.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:22 gibba020 bash[25448]: audit 2021-03-10T15:35:22.605169+0000 mon.a (mon.0) 2195 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:23.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:22 gibba013 bash[29418]: audit 2021-03-10T15:35:22.363216+0000 mon.a (mon.0) 2188 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:35:23.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:22 gibba013 bash[29418]: cephadm 2021-03-10T15:35:22.367778+0000 mgr.gibba020.yqfnwy (mgr.34427) 5414 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:35:23.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:22 gibba013 bash[29418]: cephadm 2021-03-10T15:35:22.369700+0000 mgr.gibba020.yqfnwy (mgr.34427) 5415 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:35:23.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:22 gibba013 bash[29418]: audit 2021-03-10T15:35:22.587335+0000 mon.a (mon.0) 2189 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:35:23.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:22 gibba013 bash[29418]: audit 2021-03-10T15:35:22.590989+0000 mon.a (mon.0) 2190 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:35:23.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:22 gibba013 bash[29418]: audit 2021-03-10T15:35:22.593365+0000 mon.a (mon.0) 2191 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:23.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:22 gibba013 bash[29418]: audit 2021-03-10T15:35:22.595864+0000 mon.a (mon.0) 2192 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:23.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:22 gibba013 bash[29418]: audit 2021-03-10T15:35:22.597922+0000 mon.a (mon.0) 2193 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:23.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:22 gibba013 bash[29418]: audit 2021-03-10T15:35:22.602351+0000 mon.a (mon.0) 2194 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:23.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:22 gibba013 bash[29418]: audit 2021-03-10T15:35:22.605169+0000 mon.a (mon.0) 2195 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:23.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:22 gibba013 bash[30381]: audit 2021-03-10T15:35:22.363216+0000 mon.a (mon.0) 2188 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:35:23.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:22 gibba013 bash[30381]: cephadm 2021-03-10T15:35:22.367778+0000 mgr.gibba020.yqfnwy (mgr.34427) 5414 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:35:23.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:22 gibba013 bash[30381]: cephadm 2021-03-10T15:35:22.369700+0000 mgr.gibba020.yqfnwy (mgr.34427) 5415 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:35:23.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:22 gibba013 bash[30381]: audit 2021-03-10T15:35:22.587335+0000 mon.a (mon.0) 2189 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:35:23.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:22 gibba013 bash[30381]: audit 2021-03-10T15:35:22.590989+0000 mon.a (mon.0) 2190 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:35:23.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:22 gibba013 bash[30381]: audit 2021-03-10T15:35:22.593365+0000 mon.a (mon.0) 2191 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:23.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:22 gibba013 bash[30381]: audit 2021-03-10T15:35:22.595864+0000 mon.a (mon.0) 2192 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:23.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:22 gibba013 bash[30381]: audit 2021-03-10T15:35:22.597922+0000 mon.a (mon.0) 2193 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:23.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:22 gibba013 bash[30381]: audit 2021-03-10T15:35:22.602351+0000 mon.a (mon.0) 2194 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:23.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:22 gibba013 bash[30381]: audit 2021-03-10T15:35:22.605169+0000 mon.a (mon.0) 2195 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:24.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:23 gibba013 bash[29418]: cephadm 2021-03-10T15:35:22.589320+0000 mgr.gibba020.yqfnwy (mgr.34427) 5416 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:35:24.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:23 gibba013 bash[29418]: cephadm 2021-03-10T15:35:22.592082+0000 mgr.gibba020.yqfnwy (mgr.34427) 5417 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:35:24.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:23 gibba013 bash[29418]: cephadm 2021-03-10T15:35:22.594505+0000 mgr.gibba020.yqfnwy (mgr.34427) 5418 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:35:24.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:23 gibba013 bash[29418]: cephadm 2021-03-10T15:35:22.594547+0000 mgr.gibba020.yqfnwy (mgr.34427) 5419 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:35:24.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:23 gibba013 bash[29418]: cephadm 2021-03-10T15:35:22.596652+0000 mgr.gibba020.yqfnwy (mgr.34427) 5420 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:35:24.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:23 gibba013 bash[29418]: cephadm 2021-03-10T15:35:22.596694+0000 mgr.gibba020.yqfnwy (mgr.34427) 5421 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:35:24.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:23 gibba013 bash[29418]: cephadm 2021-03-10T15:35:22.598919+0000 mgr.gibba020.yqfnwy (mgr.34427) 5422 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:35:24.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:23 gibba013 bash[29418]: cephadm 2021-03-10T15:35:22.600863+0000 mgr.gibba020.yqfnwy (mgr.34427) 5423 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:35:24.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:23 gibba013 bash[29418]: cephadm 2021-03-10T15:35:22.600905+0000 mgr.gibba020.yqfnwy (mgr.34427) 5424 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:35:24.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:23 gibba013 bash[29418]: cephadm 2021-03-10T15:35:22.603411+0000 mgr.gibba020.yqfnwy (mgr.34427) 5425 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:35:24.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:23 gibba013 bash[29418]: cephadm 2021-03-10T15:35:22.603830+0000 mgr.gibba020.yqfnwy (mgr.34427) 5426 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:35:24.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:23 gibba013 bash[29418]: cephadm 2021-03-10T15:35:22.606405+0000 mgr.gibba020.yqfnwy (mgr.34427) 5427 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:35:24.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:23 gibba013 bash[29418]: cephadm 2021-03-10T15:35:22.606464+0000 mgr.gibba020.yqfnwy (mgr.34427) 5428 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:35:24.387 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:23 gibba013 bash[29418]: cephadm 2021-03-10T15:35:22.606604+0000 mgr.gibba020.yqfnwy (mgr.34427) 5429 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:35:24.387 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:23 gibba013 bash[29418]: cluster 2021-03-10T15:35:22.848492+0000 mgr.gibba020.yqfnwy (mgr.34427) 5430 : cluster [DBG] pgmap v3081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:24.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:23 gibba013 bash[30381]: cephadm 2021-03-10T15:35:22.589320+0000 mgr.gibba020.yqfnwy (mgr.34427) 5416 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:35:24.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:23 gibba013 bash[30381]: cephadm 2021-03-10T15:35:22.592082+0000 mgr.gibba020.yqfnwy (mgr.34427) 5417 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:35:24.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:23 gibba013 bash[30381]: cephadm 2021-03-10T15:35:22.594505+0000 mgr.gibba020.yqfnwy (mgr.34427) 5418 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:35:24.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:23 gibba013 bash[30381]: cephadm 2021-03-10T15:35:22.594547+0000 mgr.gibba020.yqfnwy (mgr.34427) 5419 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:35:24.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:23 gibba013 bash[30381]: cephadm 2021-03-10T15:35:22.596652+0000 mgr.gibba020.yqfnwy (mgr.34427) 5420 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:35:24.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:23 gibba013 bash[30381]: cephadm 2021-03-10T15:35:22.596694+0000 mgr.gibba020.yqfnwy (mgr.34427) 5421 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:35:24.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:23 gibba013 bash[30381]: cephadm 2021-03-10T15:35:22.598919+0000 mgr.gibba020.yqfnwy (mgr.34427) 5422 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:35:24.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:23 gibba013 bash[30381]: cephadm 2021-03-10T15:35:22.600863+0000 mgr.gibba020.yqfnwy (mgr.34427) 5423 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:35:24.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:23 gibba013 bash[30381]: cephadm 2021-03-10T15:35:22.600905+0000 mgr.gibba020.yqfnwy (mgr.34427) 5424 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:35:24.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:23 gibba013 bash[30381]: cephadm 2021-03-10T15:35:22.603411+0000 mgr.gibba020.yqfnwy (mgr.34427) 5425 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:35:24.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:23 gibba013 bash[30381]: cephadm 2021-03-10T15:35:22.603830+0000 mgr.gibba020.yqfnwy (mgr.34427) 5426 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:35:24.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:23 gibba013 bash[30381]: cephadm 2021-03-10T15:35:22.606405+0000 mgr.gibba020.yqfnwy (mgr.34427) 5427 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:35:24.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:23 gibba013 bash[30381]: cephadm 2021-03-10T15:35:22.606464+0000 mgr.gibba020.yqfnwy (mgr.34427) 5428 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:35:24.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:23 gibba013 bash[30381]: cephadm 2021-03-10T15:35:22.606604+0000 mgr.gibba020.yqfnwy (mgr.34427) 5429 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:35:24.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:23 gibba013 bash[30381]: cluster 2021-03-10T15:35:22.848492+0000 mgr.gibba020.yqfnwy (mgr.34427) 5430 : cluster [DBG] pgmap v3081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:24.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:23 gibba020 bash[25448]: cephadm 2021-03-10T15:35:22.589320+0000 mgr.gibba020.yqfnwy (mgr.34427) 5416 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:35:24.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:23 gibba020 bash[25448]: cephadm 2021-03-10T15:35:22.592082+0000 mgr.gibba020.yqfnwy (mgr.34427) 5417 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:35:24.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:23 gibba020 bash[25448]: cephadm 2021-03-10T15:35:22.594505+0000 mgr.gibba020.yqfnwy (mgr.34427) 5418 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:35:24.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:23 gibba020 bash[25448]: cephadm 2021-03-10T15:35:22.594547+0000 mgr.gibba020.yqfnwy (mgr.34427) 5419 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:35:24.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:23 gibba020 bash[25448]: cephadm 2021-03-10T15:35:22.596652+0000 mgr.gibba020.yqfnwy (mgr.34427) 5420 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:35:24.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:23 gibba020 bash[25448]: cephadm 2021-03-10T15:35:22.596694+0000 mgr.gibba020.yqfnwy (mgr.34427) 5421 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:35:24.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:23 gibba020 bash[25448]: cephadm 2021-03-10T15:35:22.598919+0000 mgr.gibba020.yqfnwy (mgr.34427) 5422 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:35:24.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:23 gibba020 bash[25448]: cephadm 2021-03-10T15:35:22.600863+0000 mgr.gibba020.yqfnwy (mgr.34427) 5423 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:35:24.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:23 gibba020 bash[25448]: cephadm 2021-03-10T15:35:22.600905+0000 mgr.gibba020.yqfnwy (mgr.34427) 5424 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:35:24.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:23 gibba020 bash[25448]: cephadm 2021-03-10T15:35:22.603411+0000 mgr.gibba020.yqfnwy (mgr.34427) 5425 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:35:24.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:23 gibba020 bash[25448]: cephadm 2021-03-10T15:35:22.603830+0000 mgr.gibba020.yqfnwy (mgr.34427) 5426 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:35:24.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:23 gibba020 bash[25448]: cephadm 2021-03-10T15:35:22.606405+0000 mgr.gibba020.yqfnwy (mgr.34427) 5427 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:35:24.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:23 gibba020 bash[25448]: cephadm 2021-03-10T15:35:22.606464+0000 mgr.gibba020.yqfnwy (mgr.34427) 5428 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:35:24.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:23 gibba020 bash[25448]: cephadm 2021-03-10T15:35:22.606604+0000 mgr.gibba020.yqfnwy (mgr.34427) 5429 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:35:24.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:23 gibba020 bash[25448]: cluster 2021-03-10T15:35:22.848492+0000 mgr.gibba020.yqfnwy (mgr.34427) 5430 : cluster [DBG] pgmap v3081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:26.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:25 gibba013 bash[29418]: cluster 2021-03-10T15:35:24.850150+0000 mgr.gibba020.yqfnwy (mgr.34427) 5431 : cluster [DBG] pgmap v3082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:26.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:25 gibba013 bash[30381]: cluster 2021-03-10T15:35:24.850150+0000 mgr.gibba020.yqfnwy (mgr.34427) 5431 : cluster [DBG] pgmap v3082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:26.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:25 gibba020 bash[25448]: cluster 2021-03-10T15:35:24.850150+0000 mgr.gibba020.yqfnwy (mgr.34427) 5431 : cluster [DBG] pgmap v3082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:28.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:27 gibba013 bash[29418]: cluster 2021-03-10T15:35:26.851763+0000 mgr.gibba020.yqfnwy (mgr.34427) 5432 : cluster [DBG] pgmap v3083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:28.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:27 gibba013 bash[30381]: cluster 2021-03-10T15:35:26.851763+0000 mgr.gibba020.yqfnwy (mgr.34427) 5432 : cluster [DBG] pgmap v3083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:28.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:27 gibba020 bash[25448]: cluster 2021-03-10T15:35:26.851763+0000 mgr.gibba020.yqfnwy (mgr.34427) 5432 : cluster [DBG] pgmap v3083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:30.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:29 gibba013 bash[29418]: cluster 2021-03-10T15:35:28.853062+0000 mgr.gibba020.yqfnwy (mgr.34427) 5433 : cluster [DBG] pgmap v3084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:30.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:29 gibba013 bash[30381]: cluster 2021-03-10T15:35:28.853062+0000 mgr.gibba020.yqfnwy (mgr.34427) 5433 : cluster [DBG] pgmap v3084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:30.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:29 gibba020 bash[25448]: cluster 2021-03-10T15:35:28.853062+0000 mgr.gibba020.yqfnwy (mgr.34427) 5433 : cluster [DBG] pgmap v3084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:32.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:31 gibba013 bash[29418]: cluster 2021-03-10T15:35:30.854807+0000 mgr.gibba020.yqfnwy (mgr.34427) 5434 : cluster [DBG] pgmap v3085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:32.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:31 gibba013 bash[30381]: cluster 2021-03-10T15:35:30.854807+0000 mgr.gibba020.yqfnwy (mgr.34427) 5434 : cluster [DBG] pgmap v3085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:32.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:31 gibba020 bash[25448]: cluster 2021-03-10T15:35:30.854807+0000 mgr.gibba020.yqfnwy (mgr.34427) 5434 : cluster [DBG] pgmap v3085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:33.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:33 gibba020 bash[25448]: cluster 2021-03-10T15:35:32.856277+0000 mgr.gibba020.yqfnwy (mgr.34427) 5435 : cluster [DBG] pgmap v3086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:34.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:33 gibba013 bash[29418]: cluster 2021-03-10T15:35:32.856277+0000 mgr.gibba020.yqfnwy (mgr.34427) 5435 : cluster [DBG] pgmap v3086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:34.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:33 gibba013 bash[30381]: cluster 2021-03-10T15:35:32.856277+0000 mgr.gibba020.yqfnwy (mgr.34427) 5435 : cluster [DBG] pgmap v3086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:36.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:35 gibba020 bash[25448]: cluster 2021-03-10T15:35:34.857906+0000 mgr.gibba020.yqfnwy (mgr.34427) 5436 : cluster [DBG] pgmap v3087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:36.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:35 gibba013 bash[29418]: cluster 2021-03-10T15:35:34.857906+0000 mgr.gibba020.yqfnwy (mgr.34427) 5436 : cluster [DBG] pgmap v3087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:36.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:35 gibba013 bash[30381]: cluster 2021-03-10T15:35:34.857906+0000 mgr.gibba020.yqfnwy (mgr.34427) 5436 : cluster [DBG] pgmap v3087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:38.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:37 gibba020 bash[25448]: cluster 2021-03-10T15:35:36.859624+0000 mgr.gibba020.yqfnwy (mgr.34427) 5437 : cluster [DBG] pgmap v3088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:38.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:37 gibba013 bash[29418]: cluster 2021-03-10T15:35:36.859624+0000 mgr.gibba020.yqfnwy (mgr.34427) 5437 : cluster [DBG] pgmap v3088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:38.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:37 gibba013 bash[30381]: cluster 2021-03-10T15:35:36.859624+0000 mgr.gibba020.yqfnwy (mgr.34427) 5437 : cluster [DBG] pgmap v3088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:39.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:38 gibba020 bash[25448]: cephadm 2021-03-10T15:35:37.621048+0000 mgr.gibba020.yqfnwy (mgr.34427) 5438 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:35:39.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:38 gibba013 bash[29418]: cephadm 2021-03-10T15:35:37.621048+0000 mgr.gibba020.yqfnwy (mgr.34427) 5438 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:35:39.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:38 gibba013 bash[30381]: cephadm 2021-03-10T15:35:37.621048+0000 mgr.gibba020.yqfnwy (mgr.34427) 5438 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:35:40.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:39 gibba013 bash[29418]: cluster 2021-03-10T15:35:38.861199+0000 mgr.gibba020.yqfnwy (mgr.34427) 5439 : cluster [DBG] pgmap v3089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:40.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:39 gibba013 bash[30381]: cluster 2021-03-10T15:35:38.861199+0000 mgr.gibba020.yqfnwy (mgr.34427) 5439 : cluster [DBG] pgmap v3089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:40.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:39 gibba020 bash[25448]: cluster 2021-03-10T15:35:38.861199+0000 mgr.gibba020.yqfnwy (mgr.34427) 5439 : cluster [DBG] pgmap v3089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:42.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:41 gibba013 bash[29418]: cluster 2021-03-10T15:35:40.862750+0000 mgr.gibba020.yqfnwy (mgr.34427) 5440 : cluster [DBG] pgmap v3090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:42.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:41 gibba013 bash[30381]: cluster 2021-03-10T15:35:40.862750+0000 mgr.gibba020.yqfnwy (mgr.34427) 5440 : cluster [DBG] pgmap v3090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:42.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:41 gibba020 bash[25448]: cluster 2021-03-10T15:35:40.862750+0000 mgr.gibba020.yqfnwy (mgr.34427) 5440 : cluster [DBG] pgmap v3090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:43.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:43 gibba020 bash[25448]: cluster 2021-03-10T15:35:42.864170+0000 mgr.gibba020.yqfnwy (mgr.34427) 5441 : cluster [DBG] pgmap v3091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:44.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:43 gibba013 bash[29418]: cluster 2021-03-10T15:35:42.864170+0000 mgr.gibba020.yqfnwy (mgr.34427) 5441 : cluster [DBG] pgmap v3091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:44.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:43 gibba013 bash[30381]: cluster 2021-03-10T15:35:42.864170+0000 mgr.gibba020.yqfnwy (mgr.34427) 5441 : cluster [DBG] pgmap v3091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:46.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:45 gibba020 bash[25448]: cluster 2021-03-10T15:35:44.865438+0000 mgr.gibba020.yqfnwy (mgr.34427) 5442 : cluster [DBG] pgmap v3092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:46.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:45 gibba013 bash[29418]: cluster 2021-03-10T15:35:44.865438+0000 mgr.gibba020.yqfnwy (mgr.34427) 5442 : cluster [DBG] pgmap v3092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:46.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:45 gibba013 bash[30381]: cluster 2021-03-10T15:35:44.865438+0000 mgr.gibba020.yqfnwy (mgr.34427) 5442 : cluster [DBG] pgmap v3092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:46.601 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:35:46.833 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:35:46.834 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (102m) 6m ago 107m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:35:46.834 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (107m) 5m ago 107m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:35:46.834 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (102m) 5m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:35:46.834 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (102m) 5m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:35:46.835 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (101m) 6m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:35:46.835 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (101m) 6m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:35:46.835 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (101m) 5m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:35:46.835 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (101m) 6m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:35:46.836 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (107m) 6m ago 107m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:35:46.836 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (107m) 5m ago 107m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:35:46.836 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (100m) 6m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:35:46.836 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (100m) 6m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:35:46.836 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (99m) 6m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:35:46.837 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (99m) 6m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:35:46.837 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (98m) 5m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:35:46.837 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (98m) 5m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:35:46.837 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (97m) 5m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:35:46.838 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (97m) 5m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:35:46.838 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (107m) 5m ago 107m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:35:46.838 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 5m ago 105m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:35:47.083 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:35:47.083 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:35:47.084 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:35:47.084 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:35:47.084 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:35:47.084 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:35:47.085 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:35:47.085 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:35:47.085 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:35:47.085 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:35:47.086 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:35:47.086 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:35:47.086 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:35:47.086 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:35:47.086 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:35:48.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:47 gibba020 bash[25448]: audit 2021-03-10T15:35:46.587684+0000 mgr.gibba020.yqfnwy (mgr.34427) 5443 : audit [DBG] from='client.57691 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:35:48.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:47 gibba020 bash[25448]: audit 2021-03-10T15:35:46.816575+0000 mgr.gibba020.yqfnwy (mgr.34427) 5444 : audit [DBG] from='client.57697 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:35:48.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:47 gibba020 bash[25448]: cluster 2021-03-10T15:35:46.866276+0000 mgr.gibba020.yqfnwy (mgr.34427) 5445 : cluster [DBG] pgmap v3093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:48.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:47 gibba020 bash[25448]: audit 2021-03-10T15:35:47.079350+0000 mon.c (mon.1) 90 : audit [DBG] from='client.? 172.21.2.113:0/2615419814' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:48.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:47 gibba013 bash[29418]: audit 2021-03-10T15:35:46.587684+0000 mgr.gibba020.yqfnwy (mgr.34427) 5443 : audit [DBG] from='client.57691 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:35:48.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:47 gibba013 bash[29418]: audit 2021-03-10T15:35:46.816575+0000 mgr.gibba020.yqfnwy (mgr.34427) 5444 : audit [DBG] from='client.57697 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:35:48.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:47 gibba013 bash[29418]: cluster 2021-03-10T15:35:46.866276+0000 mgr.gibba020.yqfnwy (mgr.34427) 5445 : cluster [DBG] pgmap v3093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:48.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:47 gibba013 bash[29418]: audit 2021-03-10T15:35:47.079350+0000 mon.c (mon.1) 90 : audit [DBG] from='client.? 172.21.2.113:0/2615419814' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:48.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:47 gibba013 bash[30381]: audit 2021-03-10T15:35:46.587684+0000 mgr.gibba020.yqfnwy (mgr.34427) 5443 : audit [DBG] from='client.57691 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:35:48.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:47 gibba013 bash[30381]: audit 2021-03-10T15:35:46.816575+0000 mgr.gibba020.yqfnwy (mgr.34427) 5444 : audit [DBG] from='client.57697 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:35:48.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:47 gibba013 bash[30381]: cluster 2021-03-10T15:35:46.866276+0000 mgr.gibba020.yqfnwy (mgr.34427) 5445 : cluster [DBG] pgmap v3093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:48.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:47 gibba013 bash[30381]: audit 2021-03-10T15:35:47.079350+0000 mon.c (mon.1) 90 : audit [DBG] from='client.? 172.21.2.113:0/2615419814' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:35:50.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:49 gibba020 bash[25448]: cluster 2021-03-10T15:35:48.867666+0000 mgr.gibba020.yqfnwy (mgr.34427) 5446 : cluster [DBG] pgmap v3094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:50.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:49 gibba013 bash[29418]: cluster 2021-03-10T15:35:48.867666+0000 mgr.gibba020.yqfnwy (mgr.34427) 5446 : cluster [DBG] pgmap v3094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:50.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:49 gibba013 bash[30381]: cluster 2021-03-10T15:35:48.867666+0000 mgr.gibba020.yqfnwy (mgr.34427) 5446 : cluster [DBG] pgmap v3094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:52.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:51 gibba013 bash[29418]: cluster 2021-03-10T15:35:50.869102+0000 mgr.gibba020.yqfnwy (mgr.34427) 5447 : cluster [DBG] pgmap v3095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:52.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:51 gibba013 bash[30381]: cluster 2021-03-10T15:35:50.869102+0000 mgr.gibba020.yqfnwy (mgr.34427) 5447 : cluster [DBG] pgmap v3095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:52.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:51 gibba020 bash[25448]: cluster 2021-03-10T15:35:50.869102+0000 mgr.gibba020.yqfnwy (mgr.34427) 5447 : cluster [DBG] pgmap v3095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:53.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:53 gibba020 bash[25448]: cephadm 2021-03-10T15:35:52.637191+0000 mgr.gibba020.yqfnwy (mgr.34427) 5448 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:35:53.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:53 gibba020 bash[25448]: cluster 2021-03-10T15:35:52.870501+0000 mgr.gibba020.yqfnwy (mgr.34427) 5449 : cluster [DBG] pgmap v3096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:54.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:53 gibba013 bash[29418]: cephadm 2021-03-10T15:35:52.637191+0000 mgr.gibba020.yqfnwy (mgr.34427) 5448 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:35:54.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:53 gibba013 bash[29418]: cluster 2021-03-10T15:35:52.870501+0000 mgr.gibba020.yqfnwy (mgr.34427) 5449 : cluster [DBG] pgmap v3096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:54.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:53 gibba013 bash[30381]: cephadm 2021-03-10T15:35:52.637191+0000 mgr.gibba020.yqfnwy (mgr.34427) 5448 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:35:54.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:53 gibba013 bash[30381]: cluster 2021-03-10T15:35:52.870501+0000 mgr.gibba020.yqfnwy (mgr.34427) 5449 : cluster [DBG] pgmap v3096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:56.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:55 gibba020 bash[25448]: cluster 2021-03-10T15:35:54.871906+0000 mgr.gibba020.yqfnwy (mgr.34427) 5450 : cluster [DBG] pgmap v3097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:56.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:55 gibba013 bash[29418]: cluster 2021-03-10T15:35:54.871906+0000 mgr.gibba020.yqfnwy (mgr.34427) 5450 : cluster [DBG] pgmap v3097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:56.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:55 gibba013 bash[30381]: cluster 2021-03-10T15:35:54.871906+0000 mgr.gibba020.yqfnwy (mgr.34427) 5450 : cluster [DBG] pgmap v3097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:58.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:57 gibba020 bash[25448]: cluster 2021-03-10T15:35:56.873478+0000 mgr.gibba020.yqfnwy (mgr.34427) 5451 : cluster [DBG] pgmap v3098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:58.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:57 gibba013 bash[29418]: cluster 2021-03-10T15:35:56.873478+0000 mgr.gibba020.yqfnwy (mgr.34427) 5451 : cluster [DBG] pgmap v3098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:35:58.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:57 gibba013 bash[30381]: cluster 2021-03-10T15:35:56.873478+0000 mgr.gibba020.yqfnwy (mgr.34427) 5451 : cluster [DBG] pgmap v3098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:00.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:35:59 gibba013 bash[29418]: cluster 2021-03-10T15:35:58.875115+0000 mgr.gibba020.yqfnwy (mgr.34427) 5452 : cluster [DBG] pgmap v3099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:00.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:35:59 gibba013 bash[30381]: cluster 2021-03-10T15:35:58.875115+0000 mgr.gibba020.yqfnwy (mgr.34427) 5452 : cluster [DBG] pgmap v3099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:00.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:35:59 gibba020 bash[25448]: cluster 2021-03-10T15:35:58.875115+0000 mgr.gibba020.yqfnwy (mgr.34427) 5452 : cluster [DBG] pgmap v3099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:02.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:01 gibba013 bash[29418]: cluster 2021-03-10T15:36:00.876742+0000 mgr.gibba020.yqfnwy (mgr.34427) 5453 : cluster [DBG] pgmap v3100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:02.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:01 gibba013 bash[30381]: cluster 2021-03-10T15:36:00.876742+0000 mgr.gibba020.yqfnwy (mgr.34427) 5453 : cluster [DBG] pgmap v3100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:02.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:01 gibba020 bash[25448]: cluster 2021-03-10T15:36:00.876742+0000 mgr.gibba020.yqfnwy (mgr.34427) 5453 : cluster [DBG] pgmap v3100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:03.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:03 gibba020 bash[25448]: cluster 2021-03-10T15:36:02.878025+0000 mgr.gibba020.yqfnwy (mgr.34427) 5454 : cluster [DBG] pgmap v3101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:04.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:03 gibba013 bash[29418]: cluster 2021-03-10T15:36:02.878025+0000 mgr.gibba020.yqfnwy (mgr.34427) 5454 : cluster [DBG] pgmap v3101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:04.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:03 gibba013 bash[30381]: cluster 2021-03-10T15:36:02.878025+0000 mgr.gibba020.yqfnwy (mgr.34427) 5454 : cluster [DBG] pgmap v3101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:06.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:05 gibba020 bash[25448]: cluster 2021-03-10T15:36:04.879364+0000 mgr.gibba020.yqfnwy (mgr.34427) 5455 : cluster [DBG] pgmap v3102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:06.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:05 gibba013 bash[29418]: cluster 2021-03-10T15:36:04.879364+0000 mgr.gibba020.yqfnwy (mgr.34427) 5455 : cluster [DBG] pgmap v3102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:06.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:05 gibba013 bash[30381]: cluster 2021-03-10T15:36:04.879364+0000 mgr.gibba020.yqfnwy (mgr.34427) 5455 : cluster [DBG] pgmap v3102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:07.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:06 gibba013 bash[29418]: audit 2021-03-10T15:36:06.490310+0000 mon.a (mon.0) 2196 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:36:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:06 gibba013 bash[29418]: audit 2021-03-10T15:36:06.562871+0000 mon.a (mon.0) 2197 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:36:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:06 gibba013 bash[29418]: audit 2021-03-10T15:36:06.672164+0000 mon.a (mon.0) 2198 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:36:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:06 gibba013 bash[29418]: audit 2021-03-10T15:36:06.672796+0000 mon.a (mon.0) 2199 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:36:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:06 gibba013 bash[29418]: audit 2021-03-10T15:36:06.673308+0000 mon.a (mon.0) 2200 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:36:07.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:06 gibba013 bash[29418]: audit 2021-03-10T15:36:06.673818+0000 mon.a (mon.0) 2201 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:36:07.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:06 gibba013 bash[30381]: audit 2021-03-10T15:36:06.490310+0000 mon.a (mon.0) 2196 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:36:07.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:06 gibba013 bash[30381]: audit 2021-03-10T15:36:06.562871+0000 mon.a (mon.0) 2197 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:36:07.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:06 gibba013 bash[30381]: audit 2021-03-10T15:36:06.672164+0000 mon.a (mon.0) 2198 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:36:07.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:06 gibba013 bash[30381]: audit 2021-03-10T15:36:06.672796+0000 mon.a (mon.0) 2199 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:36:07.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:06 gibba013 bash[30381]: audit 2021-03-10T15:36:06.673308+0000 mon.a (mon.0) 2200 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:36:07.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:06 gibba013 bash[30381]: audit 2021-03-10T15:36:06.673818+0000 mon.a (mon.0) 2201 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:36:07.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:06 gibba020 bash[25448]: audit 2021-03-10T15:36:06.490310+0000 mon.a (mon.0) 2196 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:36:07.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:06 gibba020 bash[25448]: audit 2021-03-10T15:36:06.562871+0000 mon.a (mon.0) 2197 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:36:07.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:06 gibba020 bash[25448]: audit 2021-03-10T15:36:06.672164+0000 mon.a (mon.0) 2198 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:36:07.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:06 gibba020 bash[25448]: audit 2021-03-10T15:36:06.672796+0000 mon.a (mon.0) 2199 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:36:07.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:06 gibba020 bash[25448]: audit 2021-03-10T15:36:06.673308+0000 mon.a (mon.0) 2200 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:36:07.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:06 gibba020 bash[25448]: audit 2021-03-10T15:36:06.673818+0000 mon.a (mon.0) 2201 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:36:08.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:07 gibba013 bash[29418]: cluster 2021-03-10T15:36:06.881183+0000 mgr.gibba020.yqfnwy (mgr.34427) 5456 : cluster [DBG] pgmap v3103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:08.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:07 gibba013 bash[30381]: cluster 2021-03-10T15:36:06.881183+0000 mgr.gibba020.yqfnwy (mgr.34427) 5456 : cluster [DBG] pgmap v3103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:08.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:07 gibba020 bash[25448]: cluster 2021-03-10T15:36:06.881183+0000 mgr.gibba020.yqfnwy (mgr.34427) 5456 : cluster [DBG] pgmap v3103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:09.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:08 gibba013 bash[29418]: cephadm 2021-03-10T15:36:07.652986+0000 mgr.gibba020.yqfnwy (mgr.34427) 5457 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:36:09.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:08 gibba013 bash[30381]: cephadm 2021-03-10T15:36:07.652986+0000 mgr.gibba020.yqfnwy (mgr.34427) 5457 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:36:09.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:08 gibba020 bash[25448]: cephadm 2021-03-10T15:36:07.652986+0000 mgr.gibba020.yqfnwy (mgr.34427) 5457 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:36:10.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:09 gibba013 bash[29418]: cluster 2021-03-10T15:36:08.882569+0000 mgr.gibba020.yqfnwy (mgr.34427) 5458 : cluster [DBG] pgmap v3104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:10.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:09 gibba013 bash[30381]: cluster 2021-03-10T15:36:08.882569+0000 mgr.gibba020.yqfnwy (mgr.34427) 5458 : cluster [DBG] pgmap v3104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:10.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:09 gibba020 bash[25448]: cluster 2021-03-10T15:36:08.882569+0000 mgr.gibba020.yqfnwy (mgr.34427) 5458 : cluster [DBG] pgmap v3104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:12.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:11 gibba013 bash[29418]: cluster 2021-03-10T15:36:10.884358+0000 mgr.gibba020.yqfnwy (mgr.34427) 5459 : cluster [DBG] pgmap v3105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:12.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:11 gibba013 bash[30381]: cluster 2021-03-10T15:36:10.884358+0000 mgr.gibba020.yqfnwy (mgr.34427) 5459 : cluster [DBG] pgmap v3105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:12.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:11 gibba020 bash[25448]: cluster 2021-03-10T15:36:10.884358+0000 mgr.gibba020.yqfnwy (mgr.34427) 5459 : cluster [DBG] pgmap v3105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:13.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:13 gibba020 bash[25448]: cluster 2021-03-10T15:36:12.885635+0000 mgr.gibba020.yqfnwy (mgr.34427) 5460 : cluster [DBG] pgmap v3106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:14.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:13 gibba013 bash[29418]: cluster 2021-03-10T15:36:12.885635+0000 mgr.gibba020.yqfnwy (mgr.34427) 5460 : cluster [DBG] pgmap v3106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:14.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:13 gibba013 bash[30381]: cluster 2021-03-10T15:36:12.885635+0000 mgr.gibba020.yqfnwy (mgr.34427) 5460 : cluster [DBG] pgmap v3106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:16.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:15 gibba013 bash[29418]: cluster 2021-03-10T15:36:14.887085+0000 mgr.gibba020.yqfnwy (mgr.34427) 5461 : cluster [DBG] pgmap v3107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:16.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:15 gibba013 bash[30381]: cluster 2021-03-10T15:36:14.887085+0000 mgr.gibba020.yqfnwy (mgr.34427) 5461 : cluster [DBG] pgmap v3107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:16.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:15 gibba020 bash[25448]: cluster 2021-03-10T15:36:14.887085+0000 mgr.gibba020.yqfnwy (mgr.34427) 5461 : cluster [DBG] pgmap v3107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:17.325 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:36:17.552 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:36:17.552 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (102m) 7m ago 108m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:36:17.552 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (107m) 5m ago 107m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:36:17.553 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (103m) 5m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:36:17.553 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (103m) 5m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:36:17.553 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (102m) 7m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:36:17.553 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (102m) 7m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:36:17.554 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (101m) 5m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:36:17.554 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (102m) 7m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:36:17.554 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (108m) 7m ago 108m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:36:17.554 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (108m) 5m ago 108m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:36:17.555 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (101m) 7m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:36:17.555 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (100m) 7m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:36:17.555 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (100m) 7m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:36:17.555 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (99m) 7m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:36:17.556 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (99m) 5m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:36:17.556 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (98m) 5m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:36:17.556 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (98m) 5m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:36:17.556 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (98m) 5m ago 108m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:36:17.556 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (107m) 5m ago 108m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:36:17.557 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 5m ago 106m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:36:17.802 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:36:17.803 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:36:17.803 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:36:17.803 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:36:17.803 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:36:17.803 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:36:17.804 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:36:17.804 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:36:17.804 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:36:17.804 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:36:17.805 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:36:17.805 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:36:17.805 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:36:17.805 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:36:17.805 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:36:18.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:17 gibba013 bash[29418]: cluster 2021-03-10T15:36:16.888778+0000 mgr.gibba020.yqfnwy (mgr.34427) 5462 : cluster [DBG] pgmap v3108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:18.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:17 gibba013 bash[29418]: audit 2021-03-10T15:36:17.312193+0000 mgr.gibba020.yqfnwy (mgr.34427) 5463 : audit [DBG] from='client.47724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:36:18.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:17 gibba013 bash[29418]: audit 2021-03-10T15:36:17.798356+0000 mon.a (mon.0) 2202 : audit [DBG] from='client.? 172.21.2.113:0/3031721841' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:18.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:17 gibba013 bash[30381]: cluster 2021-03-10T15:36:16.888778+0000 mgr.gibba020.yqfnwy (mgr.34427) 5462 : cluster [DBG] pgmap v3108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:18.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:17 gibba013 bash[30381]: audit 2021-03-10T15:36:17.312193+0000 mgr.gibba020.yqfnwy (mgr.34427) 5463 : audit [DBG] from='client.47724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:36:18.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:17 gibba013 bash[30381]: audit 2021-03-10T15:36:17.798356+0000 mon.a (mon.0) 2202 : audit [DBG] from='client.? 172.21.2.113:0/3031721841' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:18.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:17 gibba020 bash[25448]: cluster 2021-03-10T15:36:16.888778+0000 mgr.gibba020.yqfnwy (mgr.34427) 5462 : cluster [DBG] pgmap v3108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:18.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:17 gibba020 bash[25448]: audit 2021-03-10T15:36:17.312193+0000 mgr.gibba020.yqfnwy (mgr.34427) 5463 : audit [DBG] from='client.47724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:36:18.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:17 gibba020 bash[25448]: audit 2021-03-10T15:36:17.798356+0000 mon.a (mon.0) 2202 : audit [DBG] from='client.? 172.21.2.113:0/3031721841' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:19.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:18 gibba013 bash[29418]: audit 2021-03-10T15:36:17.534786+0000 mgr.gibba020.yqfnwy (mgr.34427) 5464 : audit [DBG] from='client.47730 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:36:19.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:18 gibba013 bash[30381]: audit 2021-03-10T15:36:17.534786+0000 mgr.gibba020.yqfnwy (mgr.34427) 5464 : audit [DBG] from='client.47730 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:36:19.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:18 gibba020 bash[25448]: audit 2021-03-10T15:36:17.534786+0000 mgr.gibba020.yqfnwy (mgr.34427) 5464 : audit [DBG] from='client.47730 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:36:20.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:19 gibba013 bash[29418]: cluster 2021-03-10T15:36:18.890157+0000 mgr.gibba020.yqfnwy (mgr.34427) 5465 : cluster [DBG] pgmap v3109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:20.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:19 gibba013 bash[30381]: cluster 2021-03-10T15:36:18.890157+0000 mgr.gibba020.yqfnwy (mgr.34427) 5465 : cluster [DBG] pgmap v3109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:20.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:19 gibba020 bash[25448]: cluster 2021-03-10T15:36:18.890157+0000 mgr.gibba020.yqfnwy (mgr.34427) 5465 : cluster [DBG] pgmap v3109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:22.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:21 gibba013 bash[29418]: cluster 2021-03-10T15:36:20.891908+0000 mgr.gibba020.yqfnwy (mgr.34427) 5466 : cluster [DBG] pgmap v3110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:22.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:21 gibba013 bash[30381]: cluster 2021-03-10T15:36:20.891908+0000 mgr.gibba020.yqfnwy (mgr.34427) 5466 : cluster [DBG] pgmap v3110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:22.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:21 gibba020 bash[25448]: cluster 2021-03-10T15:36:20.891908+0000 mgr.gibba020.yqfnwy (mgr.34427) 5466 : cluster [DBG] pgmap v3110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:23.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:22 gibba013 bash[29418]: audit 2021-03-10T15:36:22.666506+0000 mon.a (mon.0) 2203 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:36:23.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:22 gibba013 bash[29418]: audit 2021-03-10T15:36:22.864647+0000 mon.a (mon.0) 2204 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:36:23.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:22 gibba013 bash[29418]: audit 2021-03-10T15:36:22.868621+0000 mon.a (mon.0) 2205 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:36:23.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:22 gibba013 bash[30381]: audit 2021-03-10T15:36:22.666506+0000 mon.a (mon.0) 2203 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:36:23.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:22 gibba013 bash[30381]: audit 2021-03-10T15:36:22.864647+0000 mon.a (mon.0) 2204 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:36:23.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:22 gibba013 bash[30381]: audit 2021-03-10T15:36:22.868621+0000 mon.a (mon.0) 2205 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:36:23.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:22 gibba020 bash[25448]: audit 2021-03-10T15:36:22.666506+0000 mon.a (mon.0) 2203 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:36:23.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:22 gibba020 bash[25448]: audit 2021-03-10T15:36:22.864647+0000 mon.a (mon.0) 2204 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:36:23.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:22 gibba020 bash[25448]: audit 2021-03-10T15:36:22.868621+0000 mon.a (mon.0) 2205 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:36:24.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[29418]: cephadm 2021-03-10T15:36:22.864578+0000 mgr.gibba020.yqfnwy (mgr.34427) 5467 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:36:24.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[29418]: cephadm 2021-03-10T15:36:22.868616+0000 mgr.gibba020.yqfnwy (mgr.34427) 5468 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:36:24.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[29418]: cluster 2021-03-10T15:36:22.892414+0000 mgr.gibba020.yqfnwy (mgr.34427) 5469 : cluster [DBG] pgmap v3111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:24.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[29418]: audit 2021-03-10T15:36:23.073191+0000 mon.a (mon.0) 2206 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:36:24.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[29418]: cephadm 2021-03-10T15:36:23.074880+0000 mgr.gibba020.yqfnwy (mgr.34427) 5470 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:36:24.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[29418]: audit 2021-03-10T15:36:23.076599+0000 mon.a (mon.0) 2207 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:36:24.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[29418]: cephadm 2021-03-10T15:36:23.077960+0000 mgr.gibba020.yqfnwy (mgr.34427) 5471 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:36:24.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[29418]: audit 2021-03-10T15:36:23.079261+0000 mon.a (mon.0) 2208 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:24.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[29418]: cephadm 2021-03-10T15:36:23.080299+0000 mgr.gibba020.yqfnwy (mgr.34427) 5472 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:36:24.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[29418]: cephadm 2021-03-10T15:36:23.080339+0000 mgr.gibba020.yqfnwy (mgr.34427) 5473 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:36:24.387 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[29418]: audit 2021-03-10T15:36:23.081642+0000 mon.a (mon.0) 2209 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:24.387 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[29418]: cephadm 2021-03-10T15:36:23.082629+0000 mgr.gibba020.yqfnwy (mgr.34427) 5474 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:36:24.387 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[29418]: cephadm 2021-03-10T15:36:23.082669+0000 mgr.gibba020.yqfnwy (mgr.34427) 5475 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:36:24.387 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[29418]: audit 2021-03-10T15:36:23.083995+0000 mon.a (mon.0) 2210 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:24.388 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[29418]: cephadm 2021-03-10T15:36:23.085012+0000 mgr.gibba020.yqfnwy (mgr.34427) 5476 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:36:24.388 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[29418]: cephadm 2021-03-10T15:36:23.086945+0000 mgr.gibba020.yqfnwy (mgr.34427) 5477 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:36:24.388 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[29418]: cephadm 2021-03-10T15:36:23.086983+0000 mgr.gibba020.yqfnwy (mgr.34427) 5478 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:36:24.388 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[29418]: audit 2021-03-10T15:36:23.088403+0000 mon.a (mon.0) 2211 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:24.389 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[29418]: cephadm 2021-03-10T15:36:23.089393+0000 mgr.gibba020.yqfnwy (mgr.34427) 5479 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:36:24.389 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[29418]: cephadm 2021-03-10T15:36:23.089739+0000 mgr.gibba020.yqfnwy (mgr.34427) 5480 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:36:24.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[30381]: cephadm 2021-03-10T15:36:22.864578+0000 mgr.gibba020.yqfnwy (mgr.34427) 5467 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:36:24.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[30381]: cephadm 2021-03-10T15:36:22.868616+0000 mgr.gibba020.yqfnwy (mgr.34427) 5468 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:36:24.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[30381]: cluster 2021-03-10T15:36:22.892414+0000 mgr.gibba020.yqfnwy (mgr.34427) 5469 : cluster [DBG] pgmap v3111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:24.391 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[30381]: audit 2021-03-10T15:36:23.073191+0000 mon.a (mon.0) 2206 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:36:24.391 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[30381]: cephadm 2021-03-10T15:36:23.074880+0000 mgr.gibba020.yqfnwy (mgr.34427) 5470 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:36:24.391 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[30381]: audit 2021-03-10T15:36:23.076599+0000 mon.a (mon.0) 2207 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:36:24.391 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[30381]: cephadm 2021-03-10T15:36:23.077960+0000 mgr.gibba020.yqfnwy (mgr.34427) 5471 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:36:24.391 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[30381]: audit 2021-03-10T15:36:23.079261+0000 mon.a (mon.0) 2208 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:24.392 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[30381]: cephadm 2021-03-10T15:36:23.080299+0000 mgr.gibba020.yqfnwy (mgr.34427) 5472 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:36:24.392 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[30381]: cephadm 2021-03-10T15:36:23.080339+0000 mgr.gibba020.yqfnwy (mgr.34427) 5473 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:36:24.392 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[30381]: audit 2021-03-10T15:36:23.081642+0000 mon.a (mon.0) 2209 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:24.392 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[30381]: cephadm 2021-03-10T15:36:23.082629+0000 mgr.gibba020.yqfnwy (mgr.34427) 5474 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:36:24.393 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[30381]: cephadm 2021-03-10T15:36:23.082669+0000 mgr.gibba020.yqfnwy (mgr.34427) 5475 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:36:24.393 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[30381]: audit 2021-03-10T15:36:23.083995+0000 mon.a (mon.0) 2210 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:24.393 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[30381]: cephadm 2021-03-10T15:36:23.085012+0000 mgr.gibba020.yqfnwy (mgr.34427) 5476 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:36:24.393 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[30381]: cephadm 2021-03-10T15:36:23.086945+0000 mgr.gibba020.yqfnwy (mgr.34427) 5477 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:36:24.393 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[30381]: cephadm 2021-03-10T15:36:23.086983+0000 mgr.gibba020.yqfnwy (mgr.34427) 5478 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:36:24.394 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[30381]: audit 2021-03-10T15:36:23.088403+0000 mon.a (mon.0) 2211 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:24.394 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[30381]: cephadm 2021-03-10T15:36:23.089393+0000 mgr.gibba020.yqfnwy (mgr.34427) 5479 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:36:24.394 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[30381]: cephadm 2021-03-10T15:36:23.089739+0000 mgr.gibba020.yqfnwy (mgr.34427) 5480 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:36:24.395 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[29418]: audit 2021-03-10T15:36:23.090990+0000 mon.a (mon.0) 2212 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:24.395 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[29418]: cephadm 2021-03-10T15:36:23.091944+0000 mgr.gibba020.yqfnwy (mgr.34427) 5481 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:36:24.395 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[29418]: cephadm 2021-03-10T15:36:23.092008+0000 mgr.gibba020.yqfnwy (mgr.34427) 5482 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:36:24.395 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[29418]: cephadm 2021-03-10T15:36:23.092112+0000 mgr.gibba020.yqfnwy (mgr.34427) 5483 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:36:24.396 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[30381]: audit 2021-03-10T15:36:23.090990+0000 mon.a (mon.0) 2212 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:24.396 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[30381]: cephadm 2021-03-10T15:36:23.091944+0000 mgr.gibba020.yqfnwy (mgr.34427) 5481 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:36:24.396 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[30381]: cephadm 2021-03-10T15:36:23.092008+0000 mgr.gibba020.yqfnwy (mgr.34427) 5482 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:36:24.396 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:24 gibba013 bash[30381]: cephadm 2021-03-10T15:36:23.092112+0000 mgr.gibba020.yqfnwy (mgr.34427) 5483 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:36:24.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:24 gibba020 bash[25448]: cephadm 2021-03-10T15:36:22.864578+0000 mgr.gibba020.yqfnwy (mgr.34427) 5467 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:36:24.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:24 gibba020 bash[25448]: cephadm 2021-03-10T15:36:22.868616+0000 mgr.gibba020.yqfnwy (mgr.34427) 5468 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:36:24.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:24 gibba020 bash[25448]: cluster 2021-03-10T15:36:22.892414+0000 mgr.gibba020.yqfnwy (mgr.34427) 5469 : cluster [DBG] pgmap v3111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:24.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:24 gibba020 bash[25448]: audit 2021-03-10T15:36:23.073191+0000 mon.a (mon.0) 2206 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:36:24.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:24 gibba020 bash[25448]: cephadm 2021-03-10T15:36:23.074880+0000 mgr.gibba020.yqfnwy (mgr.34427) 5470 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:36:24.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:24 gibba020 bash[25448]: audit 2021-03-10T15:36:23.076599+0000 mon.a (mon.0) 2207 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:36:24.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:24 gibba020 bash[25448]: cephadm 2021-03-10T15:36:23.077960+0000 mgr.gibba020.yqfnwy (mgr.34427) 5471 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:36:24.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:24 gibba020 bash[25448]: audit 2021-03-10T15:36:23.079261+0000 mon.a (mon.0) 2208 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:24.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:24 gibba020 bash[25448]: cephadm 2021-03-10T15:36:23.080299+0000 mgr.gibba020.yqfnwy (mgr.34427) 5472 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:36:24.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:24 gibba020 bash[25448]: cephadm 2021-03-10T15:36:23.080339+0000 mgr.gibba020.yqfnwy (mgr.34427) 5473 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:36:24.456 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:24 gibba020 bash[25448]: audit 2021-03-10T15:36:23.081642+0000 mon.a (mon.0) 2209 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:24.456 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:24 gibba020 bash[25448]: cephadm 2021-03-10T15:36:23.082629+0000 mgr.gibba020.yqfnwy (mgr.34427) 5474 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:36:24.456 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:24 gibba020 bash[25448]: cephadm 2021-03-10T15:36:23.082669+0000 mgr.gibba020.yqfnwy (mgr.34427) 5475 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:36:24.457 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:24 gibba020 bash[25448]: audit 2021-03-10T15:36:23.083995+0000 mon.a (mon.0) 2210 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:24.457 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:24 gibba020 bash[25448]: cephadm 2021-03-10T15:36:23.085012+0000 mgr.gibba020.yqfnwy (mgr.34427) 5476 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:36:24.457 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:24 gibba020 bash[25448]: cephadm 2021-03-10T15:36:23.086945+0000 mgr.gibba020.yqfnwy (mgr.34427) 5477 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:36:24.457 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:24 gibba020 bash[25448]: cephadm 2021-03-10T15:36:23.086983+0000 mgr.gibba020.yqfnwy (mgr.34427) 5478 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:36:24.458 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:24 gibba020 bash[25448]: audit 2021-03-10T15:36:23.088403+0000 mon.a (mon.0) 2211 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:24.458 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:24 gibba020 bash[25448]: cephadm 2021-03-10T15:36:23.089393+0000 mgr.gibba020.yqfnwy (mgr.34427) 5479 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:36:24.458 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:24 gibba020 bash[25448]: cephadm 2021-03-10T15:36:23.089739+0000 mgr.gibba020.yqfnwy (mgr.34427) 5480 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:36:24.458 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:24 gibba020 bash[25448]: audit 2021-03-10T15:36:23.090990+0000 mon.a (mon.0) 2212 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:24.459 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:24 gibba020 bash[25448]: cephadm 2021-03-10T15:36:23.091944+0000 mgr.gibba020.yqfnwy (mgr.34427) 5481 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:36:24.459 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:24 gibba020 bash[25448]: cephadm 2021-03-10T15:36:23.092008+0000 mgr.gibba020.yqfnwy (mgr.34427) 5482 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:36:24.459 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:24 gibba020 bash[25448]: cephadm 2021-03-10T15:36:23.092112+0000 mgr.gibba020.yqfnwy (mgr.34427) 5483 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:36:26.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:26 gibba013 bash[29418]: cluster 2021-03-10T15:36:24.893631+0000 mgr.gibba020.yqfnwy (mgr.34427) 5484 : cluster [DBG] pgmap v3112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:26.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:26 gibba013 bash[30381]: cluster 2021-03-10T15:36:24.893631+0000 mgr.gibba020.yqfnwy (mgr.34427) 5484 : cluster [DBG] pgmap v3112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:26.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:26 gibba020 bash[25448]: cluster 2021-03-10T15:36:24.893631+0000 mgr.gibba020.yqfnwy (mgr.34427) 5484 : cluster [DBG] pgmap v3112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:28.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:28 gibba013 bash[29418]: cluster 2021-03-10T15:36:26.895474+0000 mgr.gibba020.yqfnwy (mgr.34427) 5485 : cluster [DBG] pgmap v3113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:28.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:28 gibba013 bash[30381]: cluster 2021-03-10T15:36:26.895474+0000 mgr.gibba020.yqfnwy (mgr.34427) 5485 : cluster [DBG] pgmap v3113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:28.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:28 gibba020 bash[25448]: cluster 2021-03-10T15:36:26.895474+0000 mgr.gibba020.yqfnwy (mgr.34427) 5485 : cluster [DBG] pgmap v3113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:30.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:30 gibba013 bash[29418]: cluster 2021-03-10T15:36:28.897134+0000 mgr.gibba020.yqfnwy (mgr.34427) 5486 : cluster [DBG] pgmap v3114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:30.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:30 gibba013 bash[30381]: cluster 2021-03-10T15:36:28.897134+0000 mgr.gibba020.yqfnwy (mgr.34427) 5486 : cluster [DBG] pgmap v3114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:30.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:30 gibba020 bash[25448]: cluster 2021-03-10T15:36:28.897134+0000 mgr.gibba020.yqfnwy (mgr.34427) 5486 : cluster [DBG] pgmap v3114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:32.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:32 gibba013 bash[29418]: cluster 2021-03-10T15:36:30.898699+0000 mgr.gibba020.yqfnwy (mgr.34427) 5487 : cluster [DBG] pgmap v3115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:32.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:32 gibba013 bash[30381]: cluster 2021-03-10T15:36:30.898699+0000 mgr.gibba020.yqfnwy (mgr.34427) 5487 : cluster [DBG] pgmap v3115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:32.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:32 gibba020 bash[25448]: cluster 2021-03-10T15:36:30.898699+0000 mgr.gibba020.yqfnwy (mgr.34427) 5487 : cluster [DBG] pgmap v3115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:33.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:33 gibba020 bash[25448]: cluster 2021-03-10T15:36:32.900118+0000 mgr.gibba020.yqfnwy (mgr.34427) 5488 : cluster [DBG] pgmap v3116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:34.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:33 gibba013 bash[29418]: cluster 2021-03-10T15:36:32.900118+0000 mgr.gibba020.yqfnwy (mgr.34427) 5488 : cluster [DBG] pgmap v3116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:34.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:33 gibba013 bash[30381]: cluster 2021-03-10T15:36:32.900118+0000 mgr.gibba020.yqfnwy (mgr.34427) 5488 : cluster [DBG] pgmap v3116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:36.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:35 gibba013 bash[29418]: cluster 2021-03-10T15:36:34.901555+0000 mgr.gibba020.yqfnwy (mgr.34427) 5489 : cluster [DBG] pgmap v3117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:36.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:35 gibba013 bash[30381]: cluster 2021-03-10T15:36:34.901555+0000 mgr.gibba020.yqfnwy (mgr.34427) 5489 : cluster [DBG] pgmap v3117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:36.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:35 gibba020 bash[25448]: cluster 2021-03-10T15:36:34.901555+0000 mgr.gibba020.yqfnwy (mgr.34427) 5489 : cluster [DBG] pgmap v3117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:38.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:37 gibba013 bash[29418]: cluster 2021-03-10T15:36:36.903167+0000 mgr.gibba020.yqfnwy (mgr.34427) 5490 : cluster [DBG] pgmap v3118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:38.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:37 gibba013 bash[30381]: cluster 2021-03-10T15:36:36.903167+0000 mgr.gibba020.yqfnwy (mgr.34427) 5490 : cluster [DBG] pgmap v3118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:38.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:37 gibba020 bash[25448]: cluster 2021-03-10T15:36:36.903167+0000 mgr.gibba020.yqfnwy (mgr.34427) 5490 : cluster [DBG] pgmap v3118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:39.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:38 gibba013 bash[29418]: cephadm 2021-03-10T15:36:38.107876+0000 mgr.gibba020.yqfnwy (mgr.34427) 5491 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:36:39.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:38 gibba013 bash[30381]: cephadm 2021-03-10T15:36:38.107876+0000 mgr.gibba020.yqfnwy (mgr.34427) 5491 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:36:39.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:38 gibba020 bash[25448]: cephadm 2021-03-10T15:36:38.107876+0000 mgr.gibba020.yqfnwy (mgr.34427) 5491 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:36:40.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:39 gibba013 bash[29418]: cluster 2021-03-10T15:36:38.904179+0000 mgr.gibba020.yqfnwy (mgr.34427) 5492 : cluster [DBG] pgmap v3119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:40.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:39 gibba013 bash[30381]: cluster 2021-03-10T15:36:38.904179+0000 mgr.gibba020.yqfnwy (mgr.34427) 5492 : cluster [DBG] pgmap v3119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:40.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:39 gibba020 bash[25448]: cluster 2021-03-10T15:36:38.904179+0000 mgr.gibba020.yqfnwy (mgr.34427) 5492 : cluster [DBG] pgmap v3119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:42.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:41 gibba013 bash[29418]: cluster 2021-03-10T15:36:40.905766+0000 mgr.gibba020.yqfnwy (mgr.34427) 5493 : cluster [DBG] pgmap v3120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:42.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:42 gibba013 bash[30381]: cluster 2021-03-10T15:36:40.905766+0000 mgr.gibba020.yqfnwy (mgr.34427) 5493 : cluster [DBG] pgmap v3120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:42.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:42 gibba020 bash[25448]: cluster 2021-03-10T15:36:40.905766+0000 mgr.gibba020.yqfnwy (mgr.34427) 5493 : cluster [DBG] pgmap v3120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:44.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:43 gibba013 bash[29418]: cluster 2021-03-10T15:36:42.907267+0000 mgr.gibba020.yqfnwy (mgr.34427) 5494 : cluster [DBG] pgmap v3121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:44.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:43 gibba013 bash[30381]: cluster 2021-03-10T15:36:42.907267+0000 mgr.gibba020.yqfnwy (mgr.34427) 5494 : cluster [DBG] pgmap v3121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:44.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:43 gibba020 bash[25448]: cluster 2021-03-10T15:36:42.907267+0000 mgr.gibba020.yqfnwy (mgr.34427) 5494 : cluster [DBG] pgmap v3121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:46.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:45 gibba013 bash[29418]: cluster 2021-03-10T15:36:44.908889+0000 mgr.gibba020.yqfnwy (mgr.34427) 5495 : cluster [DBG] pgmap v3122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:46.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:45 gibba013 bash[30381]: cluster 2021-03-10T15:36:44.908889+0000 mgr.gibba020.yqfnwy (mgr.34427) 5495 : cluster [DBG] pgmap v3122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:46.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:45 gibba020 bash[25448]: cluster 2021-03-10T15:36:44.908889+0000 mgr.gibba020.yqfnwy (mgr.34427) 5495 : cluster [DBG] pgmap v3122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:48.041 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:36:48.269 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:36:48.269 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (103m) 7m ago 108m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:36:48.270 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (108m) 6m ago 108m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:36:48.270 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (103m) 6m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:36:48.270 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (104m) 6m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:36:48.270 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (102m) 7m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:36:48.271 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (102m) 7m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:36:48.271 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (102m) 6m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:36:48.271 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (102m) 7m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:36:48.271 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (108m) 7m ago 108m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:36:48.272 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (108m) 6m ago 108m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:36:48.272 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (101m) 7m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:36:48.272 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (101m) 7m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:36:48.272 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (100m) 7m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:36:48.272 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (100m) 7m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:36:48.273 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (99m) 6m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:36:48.273 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (99m) 6m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:36:48.273 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (98m) 6m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:36:48.273 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (98m) 6m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:36:48.274 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (108m) 6m ago 108m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:36:48.274 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 6m ago 106m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:36:48.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:47 gibba013 bash[29418]: cluster 2021-03-10T15:36:46.910368+0000 mgr.gibba020.yqfnwy (mgr.34427) 5496 : cluster [DBG] pgmap v3123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:48.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:47 gibba013 bash[30381]: cluster 2021-03-10T15:36:46.910368+0000 mgr.gibba020.yqfnwy (mgr.34427) 5496 : cluster [DBG] pgmap v3123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:48.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:47 gibba020 bash[25448]: cluster 2021-03-10T15:36:46.910368+0000 mgr.gibba020.yqfnwy (mgr.34427) 5496 : cluster [DBG] pgmap v3123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:48.516 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:36:48.516 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:36:48.516 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:36:48.516 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:36:48.517 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:36:48.517 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:36:48.517 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:36:48.517 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:36:48.518 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:36:48.518 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:36:48.518 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:36:48.518 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:36:48.519 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:36:48.519 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:36:48.519 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:36:49.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:48 gibba013 bash[29418]: audit 2021-03-10T15:36:48.028058+0000 mgr.gibba020.yqfnwy (mgr.34427) 5497 : audit [DBG] from='client.47742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:36:49.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:48 gibba013 bash[29418]: audit 2021-03-10T15:36:48.251925+0000 mgr.gibba020.yqfnwy (mgr.34427) 5498 : audit [DBG] from='client.57733 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:36:49.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:48 gibba013 bash[29418]: audit 2021-03-10T15:36:48.511980+0000 mon.a (mon.0) 2213 : audit [DBG] from='client.? 172.21.2.113:0/2371699040' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:49.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:48 gibba013 bash[30381]: audit 2021-03-10T15:36:48.028058+0000 mgr.gibba020.yqfnwy (mgr.34427) 5497 : audit [DBG] from='client.47742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:36:49.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:48 gibba013 bash[30381]: audit 2021-03-10T15:36:48.251925+0000 mgr.gibba020.yqfnwy (mgr.34427) 5498 : audit [DBG] from='client.57733 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:36:49.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:48 gibba013 bash[30381]: audit 2021-03-10T15:36:48.511980+0000 mon.a (mon.0) 2213 : audit [DBG] from='client.? 172.21.2.113:0/2371699040' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:49.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:48 gibba020 bash[25448]: audit 2021-03-10T15:36:48.028058+0000 mgr.gibba020.yqfnwy (mgr.34427) 5497 : audit [DBG] from='client.47742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:36:49.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:48 gibba020 bash[25448]: audit 2021-03-10T15:36:48.251925+0000 mgr.gibba020.yqfnwy (mgr.34427) 5498 : audit [DBG] from='client.57733 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:36:49.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:48 gibba020 bash[25448]: audit 2021-03-10T15:36:48.511980+0000 mon.a (mon.0) 2213 : audit [DBG] from='client.? 172.21.2.113:0/2371699040' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:36:50.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:49 gibba013 bash[29418]: cluster 2021-03-10T15:36:48.911988+0000 mgr.gibba020.yqfnwy (mgr.34427) 5499 : cluster [DBG] pgmap v3124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:50.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:49 gibba013 bash[30381]: cluster 2021-03-10T15:36:48.911988+0000 mgr.gibba020.yqfnwy (mgr.34427) 5499 : cluster [DBG] pgmap v3124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:50.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:49 gibba020 bash[25448]: cluster 2021-03-10T15:36:48.911988+0000 mgr.gibba020.yqfnwy (mgr.34427) 5499 : cluster [DBG] pgmap v3124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:52.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:52 gibba013 bash[29418]: cluster 2021-03-10T15:36:50.913745+0000 mgr.gibba020.yqfnwy (mgr.34427) 5500 : cluster [DBG] pgmap v3125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:52.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:52 gibba013 bash[30381]: cluster 2021-03-10T15:36:50.913745+0000 mgr.gibba020.yqfnwy (mgr.34427) 5500 : cluster [DBG] pgmap v3125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:52.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:52 gibba020 bash[25448]: cluster 2021-03-10T15:36:50.913745+0000 mgr.gibba020.yqfnwy (mgr.34427) 5500 : cluster [DBG] pgmap v3125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:54.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:53 gibba013 bash[29418]: cluster 2021-03-10T15:36:52.915275+0000 mgr.gibba020.yqfnwy (mgr.34427) 5501 : cluster [DBG] pgmap v3126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:54.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:53 gibba013 bash[29418]: cephadm 2021-03-10T15:36:53.110271+0000 mgr.gibba020.yqfnwy (mgr.34427) 5502 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:36:54.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:53 gibba013 bash[30381]: cluster 2021-03-10T15:36:52.915275+0000 mgr.gibba020.yqfnwy (mgr.34427) 5501 : cluster [DBG] pgmap v3126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:54.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:53 gibba013 bash[30381]: cephadm 2021-03-10T15:36:53.110271+0000 mgr.gibba020.yqfnwy (mgr.34427) 5502 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:36:54.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:53 gibba020 bash[25448]: cluster 2021-03-10T15:36:52.915275+0000 mgr.gibba020.yqfnwy (mgr.34427) 5501 : cluster [DBG] pgmap v3126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:54.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:53 gibba020 bash[25448]: cephadm 2021-03-10T15:36:53.110271+0000 mgr.gibba020.yqfnwy (mgr.34427) 5502 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:36:56.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:55 gibba013 bash[29418]: cluster 2021-03-10T15:36:54.917087+0000 mgr.gibba020.yqfnwy (mgr.34427) 5503 : cluster [DBG] pgmap v3127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:56.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:55 gibba013 bash[30381]: cluster 2021-03-10T15:36:54.917087+0000 mgr.gibba020.yqfnwy (mgr.34427) 5503 : cluster [DBG] pgmap v3127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:56.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:55 gibba020 bash[25448]: cluster 2021-03-10T15:36:54.917087+0000 mgr.gibba020.yqfnwy (mgr.34427) 5503 : cluster [DBG] pgmap v3127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:58.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:57 gibba013 bash[29418]: cluster 2021-03-10T15:36:56.918667+0000 mgr.gibba020.yqfnwy (mgr.34427) 5504 : cluster [DBG] pgmap v3128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:58.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:36:57 gibba013 bash[30381]: cluster 2021-03-10T15:36:56.918667+0000 mgr.gibba020.yqfnwy (mgr.34427) 5504 : cluster [DBG] pgmap v3128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:36:58.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:57 gibba020 bash[25448]: cluster 2021-03-10T15:36:56.918667+0000 mgr.gibba020.yqfnwy (mgr.34427) 5504 : cluster [DBG] pgmap v3128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:00.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:36:59 gibba013 bash[29418]: cluster 2021-03-10T15:36:58.920389+0000 mgr.gibba020.yqfnwy (mgr.34427) 5505 : cluster [DBG] pgmap v3129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:00.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:00 gibba013 bash[30381]: cluster 2021-03-10T15:36:58.920389+0000 mgr.gibba020.yqfnwy (mgr.34427) 5505 : cluster [DBG] pgmap v3129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:00.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:36:59 gibba020 bash[25448]: cluster 2021-03-10T15:36:58.920389+0000 mgr.gibba020.yqfnwy (mgr.34427) 5505 : cluster [DBG] pgmap v3129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:02.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:02 gibba013 bash[29418]: cluster 2021-03-10T15:37:00.922014+0000 mgr.gibba020.yqfnwy (mgr.34427) 5506 : cluster [DBG] pgmap v3130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:02.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:02 gibba013 bash[30381]: cluster 2021-03-10T15:37:00.922014+0000 mgr.gibba020.yqfnwy (mgr.34427) 5506 : cluster [DBG] pgmap v3130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:02.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:02 gibba020 bash[25448]: cluster 2021-03-10T15:37:00.922014+0000 mgr.gibba020.yqfnwy (mgr.34427) 5506 : cluster [DBG] pgmap v3130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:04.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:03 gibba013 bash[29418]: cluster 2021-03-10T15:37:02.923445+0000 mgr.gibba020.yqfnwy (mgr.34427) 5507 : cluster [DBG] pgmap v3131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:04.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:03 gibba013 bash[30381]: cluster 2021-03-10T15:37:02.923445+0000 mgr.gibba020.yqfnwy (mgr.34427) 5507 : cluster [DBG] pgmap v3131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:04.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:03 gibba020 bash[25448]: cluster 2021-03-10T15:37:02.923445+0000 mgr.gibba020.yqfnwy (mgr.34427) 5507 : cluster [DBG] pgmap v3131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:06.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:05 gibba013 bash[29418]: cluster 2021-03-10T15:37:04.925151+0000 mgr.gibba020.yqfnwy (mgr.34427) 5508 : cluster [DBG] pgmap v3132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:06.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:05 gibba013 bash[30381]: cluster 2021-03-10T15:37:04.925151+0000 mgr.gibba020.yqfnwy (mgr.34427) 5508 : cluster [DBG] pgmap v3132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:06.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:05 gibba020 bash[25448]: cluster 2021-03-10T15:37:04.925151+0000 mgr.gibba020.yqfnwy (mgr.34427) 5508 : cluster [DBG] pgmap v3132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:07.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:06 gibba013 bash[29418]: audit 2021-03-10T15:37:06.495408+0000 mon.a (mon.0) 2214 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:37:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:06 gibba013 bash[29418]: audit 2021-03-10T15:37:06.569699+0000 mon.a (mon.0) 2215 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:37:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:06 gibba013 bash[29418]: audit 2021-03-10T15:37:06.679030+0000 mon.a (mon.0) 2216 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:37:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:06 gibba013 bash[29418]: audit 2021-03-10T15:37:06.679874+0000 mon.a (mon.0) 2217 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:37:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:06 gibba013 bash[29418]: audit 2021-03-10T15:37:06.680739+0000 mon.a (mon.0) 2218 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:37:07.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:06 gibba013 bash[29418]: audit 2021-03-10T15:37:06.681516+0000 mon.a (mon.0) 2219 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:37:07.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:06 gibba013 bash[30381]: audit 2021-03-10T15:37:06.495408+0000 mon.a (mon.0) 2214 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:37:07.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:06 gibba013 bash[30381]: audit 2021-03-10T15:37:06.569699+0000 mon.a (mon.0) 2215 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:37:07.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:06 gibba013 bash[30381]: audit 2021-03-10T15:37:06.679030+0000 mon.a (mon.0) 2216 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:37:07.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:06 gibba013 bash[30381]: audit 2021-03-10T15:37:06.679874+0000 mon.a (mon.0) 2217 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:37:07.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:06 gibba013 bash[30381]: audit 2021-03-10T15:37:06.680739+0000 mon.a (mon.0) 2218 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:37:07.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:06 gibba013 bash[30381]: audit 2021-03-10T15:37:06.681516+0000 mon.a (mon.0) 2219 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:37:07.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:06 gibba020 bash[25448]: audit 2021-03-10T15:37:06.495408+0000 mon.a (mon.0) 2214 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:37:07.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:06 gibba020 bash[25448]: audit 2021-03-10T15:37:06.569699+0000 mon.a (mon.0) 2215 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:37:07.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:06 gibba020 bash[25448]: audit 2021-03-10T15:37:06.679030+0000 mon.a (mon.0) 2216 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T15:37:07.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:06 gibba020 bash[25448]: audit 2021-03-10T15:37:06.679874+0000 mon.a (mon.0) 2217 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:37:07.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:06 gibba020 bash[25448]: audit 2021-03-10T15:37:06.680739+0000 mon.a (mon.0) 2218 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:37:07.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:06 gibba020 bash[25448]: audit 2021-03-10T15:37:06.681516+0000 mon.a (mon.0) 2219 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:37:08.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:08 gibba013 bash[29418]: cluster 2021-03-10T15:37:06.926704+0000 mgr.gibba020.yqfnwy (mgr.34427) 5509 : cluster [DBG] pgmap v3133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:08.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:08 gibba013 bash[30381]: cluster 2021-03-10T15:37:06.926704+0000 mgr.gibba020.yqfnwy (mgr.34427) 5509 : cluster [DBG] pgmap v3133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:08.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:08 gibba020 bash[25448]: cluster 2021-03-10T15:37:06.926704+0000 mgr.gibba020.yqfnwy (mgr.34427) 5509 : cluster [DBG] pgmap v3133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:09.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:09 gibba013 bash[29418]: cephadm 2021-03-10T15:37:08.126368+0000 mgr.gibba020.yqfnwy (mgr.34427) 5510 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:37:09.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:09 gibba013 bash[30381]: cephadm 2021-03-10T15:37:08.126368+0000 mgr.gibba020.yqfnwy (mgr.34427) 5510 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:37:09.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:09 gibba020 bash[25448]: cephadm 2021-03-10T15:37:08.126368+0000 mgr.gibba020.yqfnwy (mgr.34427) 5510 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:37:10.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:10 gibba013 bash[29418]: cluster 2021-03-10T15:37:08.928449+0000 mgr.gibba020.yqfnwy (mgr.34427) 5511 : cluster [DBG] pgmap v3134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:10.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:10 gibba013 bash[30381]: cluster 2021-03-10T15:37:08.928449+0000 mgr.gibba020.yqfnwy (mgr.34427) 5511 : cluster [DBG] pgmap v3134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:10.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:10 gibba020 bash[25448]: cluster 2021-03-10T15:37:08.928449+0000 mgr.gibba020.yqfnwy (mgr.34427) 5511 : cluster [DBG] pgmap v3134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:12.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:12 gibba013 bash[30381]: cluster 2021-03-10T15:37:10.930150+0000 mgr.gibba020.yqfnwy (mgr.34427) 5512 : cluster [DBG] pgmap v3135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:12.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:12 gibba013 bash[29418]: cluster 2021-03-10T15:37:10.930150+0000 mgr.gibba020.yqfnwy (mgr.34427) 5512 : cluster [DBG] pgmap v3135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:12.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:12 gibba020 bash[25448]: cluster 2021-03-10T15:37:10.930150+0000 mgr.gibba020.yqfnwy (mgr.34427) 5512 : cluster [DBG] pgmap v3135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:14.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:13 gibba013 bash[29418]: cluster 2021-03-10T15:37:12.931421+0000 mgr.gibba020.yqfnwy (mgr.34427) 5513 : cluster [DBG] pgmap v3136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:14.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:13 gibba013 bash[30381]: cluster 2021-03-10T15:37:12.931421+0000 mgr.gibba020.yqfnwy (mgr.34427) 5513 : cluster [DBG] pgmap v3136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:14.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:13 gibba020 bash[25448]: cluster 2021-03-10T15:37:12.931421+0000 mgr.gibba020.yqfnwy (mgr.34427) 5513 : cluster [DBG] pgmap v3136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:16.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:15 gibba013 bash[29418]: cluster 2021-03-10T15:37:14.933188+0000 mgr.gibba020.yqfnwy (mgr.34427) 5514 : cluster [DBG] pgmap v3137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:16.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:15 gibba013 bash[30381]: cluster 2021-03-10T15:37:14.933188+0000 mgr.gibba020.yqfnwy (mgr.34427) 5514 : cluster [DBG] pgmap v3137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:16.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:15 gibba020 bash[25448]: cluster 2021-03-10T15:37:14.933188+0000 mgr.gibba020.yqfnwy (mgr.34427) 5514 : cluster [DBG] pgmap v3137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:18.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:18 gibba013 bash[29418]: cluster 2021-03-10T15:37:16.934841+0000 mgr.gibba020.yqfnwy (mgr.34427) 5515 : cluster [DBG] pgmap v3138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:18.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:18 gibba013 bash[30381]: cluster 2021-03-10T15:37:16.934841+0000 mgr.gibba020.yqfnwy (mgr.34427) 5515 : cluster [DBG] pgmap v3138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:18.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:18 gibba020 bash[25448]: cluster 2021-03-10T15:37:16.934841+0000 mgr.gibba020.yqfnwy (mgr.34427) 5515 : cluster [DBG] pgmap v3138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:18.761 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:37:18.991 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:37:18.991 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (103m) 8m ago 109m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:37:18.991 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (109m) 6m ago 109m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:37:18.992 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (104m) 6m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:37:18.992 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (104m) 6m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:37:18.992 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (103m) 8m ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:37:18.992 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (103m) 8m ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:37:18.992 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (102m) 6m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:37:18.993 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (103m) 8m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:37:18.993 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (109m) 8m ago 109m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:37:18.993 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (109m) 6m ago 109m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:37:18.993 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (102m) 8m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:37:18.994 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (101m) 8m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:37:18.994 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (101m) 8m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:37:18.994 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (100m) 8m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:37:18.994 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (100m) 6m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:37:18.995 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (99m) 6m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:37:18.995 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (99m) 6m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:37:18.995 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (99m) 6m ago 109m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:37:18.995 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (108m) 6m ago 109m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:37:18.996 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 6m ago 107m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:37:19.239 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:37:19.240 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:37:19.240 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:37:19.240 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:37:19.241 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:37:19.241 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:37:19.241 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:37:19.241 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:37:19.241 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:37:19.242 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:37:19.242 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:37:19.242 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:37:19.242 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:37:19.243 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:37:19.243 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:37:20.392 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:20 gibba013 bash[29418]: audit 2021-03-10T15:37:18.746602+0000 mgr.gibba020.yqfnwy (mgr.34427) 5516 : audit [DBG] from='client.57745 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:37:20.392 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:20 gibba013 bash[29418]: cluster 2021-03-10T15:37:18.936385+0000 mgr.gibba020.yqfnwy (mgr.34427) 5517 : cluster [DBG] pgmap v3139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:20.392 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:20 gibba013 bash[29418]: audit 2021-03-10T15:37:18.973873+0000 mgr.gibba020.yqfnwy (mgr.34427) 5518 : audit [DBG] from='client.47766 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:37:20.392 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:20 gibba013 bash[29418]: audit 2021-03-10T15:37:19.235701+0000 mon.a (mon.0) 2220 : audit [DBG] from='client.? 172.21.2.113:0/1214349301' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:20.393 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:20 gibba013 bash[30381]: audit 2021-03-10T15:37:18.746602+0000 mgr.gibba020.yqfnwy (mgr.34427) 5516 : audit [DBG] from='client.57745 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:37:20.393 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:20 gibba013 bash[30381]: cluster 2021-03-10T15:37:18.936385+0000 mgr.gibba020.yqfnwy (mgr.34427) 5517 : cluster [DBG] pgmap v3139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:20.393 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:20 gibba013 bash[30381]: audit 2021-03-10T15:37:18.973873+0000 mgr.gibba020.yqfnwy (mgr.34427) 5518 : audit [DBG] from='client.47766 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:37:20.393 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:20 gibba013 bash[30381]: audit 2021-03-10T15:37:19.235701+0000 mon.a (mon.0) 2220 : audit [DBG] from='client.? 172.21.2.113:0/1214349301' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:20.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:20 gibba020 bash[25448]: audit 2021-03-10T15:37:18.746602+0000 mgr.gibba020.yqfnwy (mgr.34427) 5516 : audit [DBG] from='client.57745 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:37:20.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:20 gibba020 bash[25448]: cluster 2021-03-10T15:37:18.936385+0000 mgr.gibba020.yqfnwy (mgr.34427) 5517 : cluster [DBG] pgmap v3139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:20.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:20 gibba020 bash[25448]: audit 2021-03-10T15:37:18.973873+0000 mgr.gibba020.yqfnwy (mgr.34427) 5518 : audit [DBG] from='client.47766 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:37:20.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:20 gibba020 bash[25448]: audit 2021-03-10T15:37:19.235701+0000 mon.a (mon.0) 2220 : audit [DBG] from='client.? 172.21.2.113:0/1214349301' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:22.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:22 gibba013 bash[29418]: cluster 2021-03-10T15:37:20.937912+0000 mgr.gibba020.yqfnwy (mgr.34427) 5519 : cluster [DBG] pgmap v3140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:22.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:22 gibba013 bash[30381]: cluster 2021-03-10T15:37:20.937912+0000 mgr.gibba020.yqfnwy (mgr.34427) 5519 : cluster [DBG] pgmap v3140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:22.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:22 gibba020 bash[25448]: cluster 2021-03-10T15:37:20.937912+0000 mgr.gibba020.yqfnwy (mgr.34427) 5519 : cluster [DBG] pgmap v3140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:23.728 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:23 gibba020 bash[25448]: cluster 2021-03-10T15:37:22.939126+0000 mgr.gibba020.yqfnwy (mgr.34427) 5520 : cluster [DBG] pgmap v3141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:23.729 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:23 gibba020 bash[25448]: audit 2021-03-10T15:37:23.143928+0000 mon.a (mon.0) 2221 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:37:23.729 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:23 gibba020 bash[25448]: cephadm 2021-03-10T15:37:23.148422+0000 mgr.gibba020.yqfnwy (mgr.34427) 5521 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:37:23.729 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:23 gibba020 bash[25448]: cephadm 2021-03-10T15:37:23.150006+0000 mgr.gibba020.yqfnwy (mgr.34427) 5522 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:37:23.730 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:23 gibba020 bash[25448]: audit 2021-03-10T15:37:23.352970+0000 mon.a (mon.0) 2222 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:37:23.730 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:23 gibba020 bash[25448]: cephadm 2021-03-10T15:37:23.354681+0000 mgr.gibba020.yqfnwy (mgr.34427) 5523 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:37:23.730 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:23 gibba020 bash[25448]: audit 2021-03-10T15:37:23.356181+0000 mon.a (mon.0) 2223 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:37:23.730 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:23 gibba020 bash[25448]: cephadm 2021-03-10T15:37:23.356738+0000 mgr.gibba020.yqfnwy (mgr.34427) 5524 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:37:23.731 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:23 gibba020 bash[25448]: audit 2021-03-10T15:37:23.357840+0000 mon.a (mon.0) 2224 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:23.731 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:23 gibba020 bash[25448]: cephadm 2021-03-10T15:37:23.358162+0000 mgr.gibba020.yqfnwy (mgr.34427) 5525 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:37:23.731 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:23 gibba020 bash[25448]: cephadm 2021-03-10T15:37:23.358202+0000 mgr.gibba020.yqfnwy (mgr.34427) 5526 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:37:23.731 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:23 gibba020 bash[25448]: audit 2021-03-10T15:37:23.359277+0000 mon.a (mon.0) 2225 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:23.732 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:23 gibba020 bash[25448]: cephadm 2021-03-10T15:37:23.359604+0000 mgr.gibba020.yqfnwy (mgr.34427) 5527 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:37:23.732 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:23 gibba020 bash[25448]: cephadm 2021-03-10T15:37:23.359642+0000 mgr.gibba020.yqfnwy (mgr.34427) 5528 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:37:23.732 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:23 gibba020 bash[25448]: audit 2021-03-10T15:37:23.360647+0000 mon.a (mon.0) 2226 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:23.732 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:23 gibba020 bash[25448]: cephadm 2021-03-10T15:37:23.360926+0000 mgr.gibba020.yqfnwy (mgr.34427) 5529 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:37:23.733 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:23 gibba020 bash[25448]: cephadm 2021-03-10T15:37:23.362684+0000 mgr.gibba020.yqfnwy (mgr.34427) 5530 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:37:23.733 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:23 gibba020 bash[25448]: cephadm 2021-03-10T15:37:23.362723+0000 mgr.gibba020.yqfnwy (mgr.34427) 5531 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:37:23.733 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:23 gibba020 bash[25448]: audit 2021-03-10T15:37:23.364234+0000 mon.a (mon.0) 2227 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:23.733 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:23 gibba020 bash[25448]: cephadm 2021-03-10T15:37:23.364827+0000 mgr.gibba020.yqfnwy (mgr.34427) 5532 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:37:23.734 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:23 gibba020 bash[25448]: cephadm 2021-03-10T15:37:23.365253+0000 mgr.gibba020.yqfnwy (mgr.34427) 5533 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:37:23.734 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:23 gibba020 bash[25448]: audit 2021-03-10T15:37:23.366507+0000 mon.a (mon.0) 2228 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:23.734 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:23 gibba020 bash[25448]: cephadm 2021-03-10T15:37:23.367091+0000 mgr.gibba020.yqfnwy (mgr.34427) 5534 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:37:23.734 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:23 gibba020 bash[25448]: cephadm 2021-03-10T15:37:23.367134+0000 mgr.gibba020.yqfnwy (mgr.34427) 5535 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:37:23.735 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:23 gibba020 bash[25448]: cephadm 2021-03-10T15:37:23.367254+0000 mgr.gibba020.yqfnwy (mgr.34427) 5536 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:37:24.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[29418]: cluster 2021-03-10T15:37:22.939126+0000 mgr.gibba020.yqfnwy (mgr.34427) 5520 : cluster [DBG] pgmap v3141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:24.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[29418]: audit 2021-03-10T15:37:23.143928+0000 mon.a (mon.0) 2221 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:37:24.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[29418]: cephadm 2021-03-10T15:37:23.148422+0000 mgr.gibba020.yqfnwy (mgr.34427) 5521 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:37:24.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[29418]: cephadm 2021-03-10T15:37:23.150006+0000 mgr.gibba020.yqfnwy (mgr.34427) 5522 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:37:24.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[29418]: audit 2021-03-10T15:37:23.352970+0000 mon.a (mon.0) 2222 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:37:24.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[29418]: cephadm 2021-03-10T15:37:23.354681+0000 mgr.gibba020.yqfnwy (mgr.34427) 5523 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:37:24.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[29418]: audit 2021-03-10T15:37:23.356181+0000 mon.a (mon.0) 2223 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:37:24.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[29418]: cephadm 2021-03-10T15:37:23.356738+0000 mgr.gibba020.yqfnwy (mgr.34427) 5524 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:37:24.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[29418]: audit 2021-03-10T15:37:23.357840+0000 mon.a (mon.0) 2224 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:24.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[29418]: cephadm 2021-03-10T15:37:23.358162+0000 mgr.gibba020.yqfnwy (mgr.34427) 5525 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:37:24.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[29418]: cephadm 2021-03-10T15:37:23.358202+0000 mgr.gibba020.yqfnwy (mgr.34427) 5526 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:37:24.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[29418]: audit 2021-03-10T15:37:23.359277+0000 mon.a (mon.0) 2225 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:24.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[29418]: cephadm 2021-03-10T15:37:23.359604+0000 mgr.gibba020.yqfnwy (mgr.34427) 5527 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:37:24.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[29418]: cephadm 2021-03-10T15:37:23.359642+0000 mgr.gibba020.yqfnwy (mgr.34427) 5528 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:37:24.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[29418]: audit 2021-03-10T15:37:23.360647+0000 mon.a (mon.0) 2226 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:24.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[29418]: cephadm 2021-03-10T15:37:23.360926+0000 mgr.gibba020.yqfnwy (mgr.34427) 5529 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:37:24.138 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[29418]: cephadm 2021-03-10T15:37:23.362684+0000 mgr.gibba020.yqfnwy (mgr.34427) 5530 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:37:24.138 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[29418]: cephadm 2021-03-10T15:37:23.362723+0000 mgr.gibba020.yqfnwy (mgr.34427) 5531 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:37:24.138 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[29418]: audit 2021-03-10T15:37:23.364234+0000 mon.a (mon.0) 2227 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:24.138 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[29418]: cephadm 2021-03-10T15:37:23.364827+0000 mgr.gibba020.yqfnwy (mgr.34427) 5532 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:37:24.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[30381]: cluster 2021-03-10T15:37:22.939126+0000 mgr.gibba020.yqfnwy (mgr.34427) 5520 : cluster [DBG] pgmap v3141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:24.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[30381]: audit 2021-03-10T15:37:23.143928+0000 mon.a (mon.0) 2221 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:37:24.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[30381]: cephadm 2021-03-10T15:37:23.148422+0000 mgr.gibba020.yqfnwy (mgr.34427) 5521 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:37:24.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[30381]: cephadm 2021-03-10T15:37:23.150006+0000 mgr.gibba020.yqfnwy (mgr.34427) 5522 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:37:24.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[30381]: audit 2021-03-10T15:37:23.352970+0000 mon.a (mon.0) 2222 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:37:24.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[30381]: cephadm 2021-03-10T15:37:23.354681+0000 mgr.gibba020.yqfnwy (mgr.34427) 5523 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:37:24.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[30381]: audit 2021-03-10T15:37:23.356181+0000 mon.a (mon.0) 2223 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:37:24.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[30381]: cephadm 2021-03-10T15:37:23.356738+0000 mgr.gibba020.yqfnwy (mgr.34427) 5524 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:37:24.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[30381]: audit 2021-03-10T15:37:23.357840+0000 mon.a (mon.0) 2224 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:24.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[30381]: cephadm 2021-03-10T15:37:23.358162+0000 mgr.gibba020.yqfnwy (mgr.34427) 5525 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:37:24.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[30381]: cephadm 2021-03-10T15:37:23.358202+0000 mgr.gibba020.yqfnwy (mgr.34427) 5526 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:37:24.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[30381]: audit 2021-03-10T15:37:23.359277+0000 mon.a (mon.0) 2225 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:24.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[30381]: cephadm 2021-03-10T15:37:23.359604+0000 mgr.gibba020.yqfnwy (mgr.34427) 5527 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:37:24.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[30381]: cephadm 2021-03-10T15:37:23.359642+0000 mgr.gibba020.yqfnwy (mgr.34427) 5528 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:37:24.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[30381]: audit 2021-03-10T15:37:23.360647+0000 mon.a (mon.0) 2226 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:24.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[30381]: cephadm 2021-03-10T15:37:23.360926+0000 mgr.gibba020.yqfnwy (mgr.34427) 5529 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:37:24.143 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[30381]: cephadm 2021-03-10T15:37:23.362684+0000 mgr.gibba020.yqfnwy (mgr.34427) 5530 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:37:24.143 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[30381]: cephadm 2021-03-10T15:37:23.362723+0000 mgr.gibba020.yqfnwy (mgr.34427) 5531 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:37:24.143 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[30381]: audit 2021-03-10T15:37:23.364234+0000 mon.a (mon.0) 2227 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:24.143 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[30381]: cephadm 2021-03-10T15:37:23.364827+0000 mgr.gibba020.yqfnwy (mgr.34427) 5532 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:37:24.144 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[29418]: cephadm 2021-03-10T15:37:23.365253+0000 mgr.gibba020.yqfnwy (mgr.34427) 5533 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:37:24.145 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[29418]: audit 2021-03-10T15:37:23.366507+0000 mon.a (mon.0) 2228 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:24.145 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[29418]: cephadm 2021-03-10T15:37:23.367091+0000 mgr.gibba020.yqfnwy (mgr.34427) 5534 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:37:24.146 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[29418]: cephadm 2021-03-10T15:37:23.367134+0000 mgr.gibba020.yqfnwy (mgr.34427) 5535 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:37:24.146 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[29418]: cephadm 2021-03-10T15:37:23.367254+0000 mgr.gibba020.yqfnwy (mgr.34427) 5536 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:37:24.147 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[30381]: cephadm 2021-03-10T15:37:23.365253+0000 mgr.gibba020.yqfnwy (mgr.34427) 5533 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:37:24.147 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[30381]: audit 2021-03-10T15:37:23.366507+0000 mon.a (mon.0) 2228 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:24.147 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[30381]: cephadm 2021-03-10T15:37:23.367091+0000 mgr.gibba020.yqfnwy (mgr.34427) 5534 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:37:24.148 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[30381]: cephadm 2021-03-10T15:37:23.367134+0000 mgr.gibba020.yqfnwy (mgr.34427) 5535 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:37:24.148 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:23 gibba013 bash[30381]: cephadm 2021-03-10T15:37:23.367254+0000 mgr.gibba020.yqfnwy (mgr.34427) 5536 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:37:26.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:26 gibba013 bash[29418]: cluster 2021-03-10T15:37:24.940893+0000 mgr.gibba020.yqfnwy (mgr.34427) 5537 : cluster [DBG] pgmap v3142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:26.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:26 gibba013 bash[30381]: cluster 2021-03-10T15:37:24.940893+0000 mgr.gibba020.yqfnwy (mgr.34427) 5537 : cluster [DBG] pgmap v3142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:26.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:26 gibba020 bash[25448]: cluster 2021-03-10T15:37:24.940893+0000 mgr.gibba020.yqfnwy (mgr.34427) 5537 : cluster [DBG] pgmap v3142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:28.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:28 gibba013 bash[29418]: cluster 2021-03-10T15:37:26.942230+0000 mgr.gibba020.yqfnwy (mgr.34427) 5538 : cluster [DBG] pgmap v3143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:28.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:28 gibba013 bash[30381]: cluster 2021-03-10T15:37:26.942230+0000 mgr.gibba020.yqfnwy (mgr.34427) 5538 : cluster [DBG] pgmap v3143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:28.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:28 gibba020 bash[25448]: cluster 2021-03-10T15:37:26.942230+0000 mgr.gibba020.yqfnwy (mgr.34427) 5538 : cluster [DBG] pgmap v3143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:30.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:30 gibba013 bash[29418]: cluster 2021-03-10T15:37:28.943821+0000 mgr.gibba020.yqfnwy (mgr.34427) 5539 : cluster [DBG] pgmap v3144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:30.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:30 gibba013 bash[30381]: cluster 2021-03-10T15:37:28.943821+0000 mgr.gibba020.yqfnwy (mgr.34427) 5539 : cluster [DBG] pgmap v3144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:30.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:30 gibba020 bash[25448]: cluster 2021-03-10T15:37:28.943821+0000 mgr.gibba020.yqfnwy (mgr.34427) 5539 : cluster [DBG] pgmap v3144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:32.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:32 gibba013 bash[29418]: cluster 2021-03-10T15:37:30.945540+0000 mgr.gibba020.yqfnwy (mgr.34427) 5540 : cluster [DBG] pgmap v3145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:32.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:32 gibba013 bash[30381]: cluster 2021-03-10T15:37:30.945540+0000 mgr.gibba020.yqfnwy (mgr.34427) 5540 : cluster [DBG] pgmap v3145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:32.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:32 gibba020 bash[25448]: cluster 2021-03-10T15:37:30.945540+0000 mgr.gibba020.yqfnwy (mgr.34427) 5540 : cluster [DBG] pgmap v3145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:34.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:33 gibba013 bash[29418]: cluster 2021-03-10T15:37:32.946895+0000 mgr.gibba020.yqfnwy (mgr.34427) 5541 : cluster [DBG] pgmap v3146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:34.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:33 gibba013 bash[30381]: cluster 2021-03-10T15:37:32.946895+0000 mgr.gibba020.yqfnwy (mgr.34427) 5541 : cluster [DBG] pgmap v3146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:34.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:33 gibba020 bash[25448]: cluster 2021-03-10T15:37:32.946895+0000 mgr.gibba020.yqfnwy (mgr.34427) 5541 : cluster [DBG] pgmap v3146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:36.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:36 gibba013 bash[29418]: cluster 2021-03-10T15:37:34.948638+0000 mgr.gibba020.yqfnwy (mgr.34427) 5542 : cluster [DBG] pgmap v3147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:36.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:36 gibba013 bash[30381]: cluster 2021-03-10T15:37:34.948638+0000 mgr.gibba020.yqfnwy (mgr.34427) 5542 : cluster [DBG] pgmap v3147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:36.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:36 gibba020 bash[25448]: cluster 2021-03-10T15:37:34.948638+0000 mgr.gibba020.yqfnwy (mgr.34427) 5542 : cluster [DBG] pgmap v3147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:38.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:38 gibba013 bash[29418]: cluster 2021-03-10T15:37:36.950197+0000 mgr.gibba020.yqfnwy (mgr.34427) 5543 : cluster [DBG] pgmap v3148: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:38.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:38 gibba013 bash[30381]: cluster 2021-03-10T15:37:36.950197+0000 mgr.gibba020.yqfnwy (mgr.34427) 5543 : cluster [DBG] pgmap v3148: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:38.388 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:38 gibba020 bash[25448]: cluster 2021-03-10T15:37:36.950197+0000 mgr.gibba020.yqfnwy (mgr.34427) 5543 : cluster [DBG] pgmap v3148: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:39.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:39 gibba013 bash[29418]: cephadm 2021-03-10T15:37:38.383380+0000 mgr.gibba020.yqfnwy (mgr.34427) 5544 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:37:39.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:39 gibba013 bash[30381]: cephadm 2021-03-10T15:37:38.383380+0000 mgr.gibba020.yqfnwy (mgr.34427) 5544 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:37:39.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:39 gibba020 bash[25448]: cephadm 2021-03-10T15:37:38.383380+0000 mgr.gibba020.yqfnwy (mgr.34427) 5544 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:37:40.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:40 gibba013 bash[29418]: cluster 2021-03-10T15:37:38.951863+0000 mgr.gibba020.yqfnwy (mgr.34427) 5545 : cluster [DBG] pgmap v3149: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:40.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:40 gibba013 bash[30381]: cluster 2021-03-10T15:37:38.951863+0000 mgr.gibba020.yqfnwy (mgr.34427) 5545 : cluster [DBG] pgmap v3149: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:40.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:40 gibba020 bash[25448]: cluster 2021-03-10T15:37:38.951863+0000 mgr.gibba020.yqfnwy (mgr.34427) 5545 : cluster [DBG] pgmap v3149: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:42.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:42 gibba013 bash[29418]: cluster 2021-03-10T15:37:40.953573+0000 mgr.gibba020.yqfnwy (mgr.34427) 5546 : cluster [DBG] pgmap v3150: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:42.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:42 gibba013 bash[30381]: cluster 2021-03-10T15:37:40.953573+0000 mgr.gibba020.yqfnwy (mgr.34427) 5546 : cluster [DBG] pgmap v3150: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:42.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:42 gibba020 bash[25448]: cluster 2021-03-10T15:37:40.953573+0000 mgr.gibba020.yqfnwy (mgr.34427) 5546 : cluster [DBG] pgmap v3150: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:44.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:43 gibba013 bash[29418]: cluster 2021-03-10T15:37:42.955006+0000 mgr.gibba020.yqfnwy (mgr.34427) 5547 : cluster [DBG] pgmap v3151: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:44.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:43 gibba013 bash[30381]: cluster 2021-03-10T15:37:42.955006+0000 mgr.gibba020.yqfnwy (mgr.34427) 5547 : cluster [DBG] pgmap v3151: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:44.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:43 gibba020 bash[25448]: cluster 2021-03-10T15:37:42.955006+0000 mgr.gibba020.yqfnwy (mgr.34427) 5547 : cluster [DBG] pgmap v3151: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:46.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:46 gibba013 bash[29418]: cluster 2021-03-10T15:37:44.956494+0000 mgr.gibba020.yqfnwy (mgr.34427) 5548 : cluster [DBG] pgmap v3152: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:46.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:46 gibba013 bash[30381]: cluster 2021-03-10T15:37:44.956494+0000 mgr.gibba020.yqfnwy (mgr.34427) 5548 : cluster [DBG] pgmap v3152: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:46.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:46 gibba020 bash[25448]: cluster 2021-03-10T15:37:44.956494+0000 mgr.gibba020.yqfnwy (mgr.34427) 5548 : cluster [DBG] pgmap v3152: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:48.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:48 gibba013 bash[29418]: cluster 2021-03-10T15:37:46.957881+0000 mgr.gibba020.yqfnwy (mgr.34427) 5549 : cluster [DBG] pgmap v3153: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:48.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:48 gibba013 bash[30381]: cluster 2021-03-10T15:37:46.957881+0000 mgr.gibba020.yqfnwy (mgr.34427) 5549 : cluster [DBG] pgmap v3153: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:48.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:48 gibba020 bash[25448]: cluster 2021-03-10T15:37:46.957881+0000 mgr.gibba020.yqfnwy (mgr.34427) 5549 : cluster [DBG] pgmap v3153: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:49.485 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:37:49.710 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:37:49.710 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (104m) 8m ago 109m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:37:49.711 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (109m) 7m ago 109m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:37:49.711 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (104m) 7m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:37:49.711 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (105m) 7m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:37:49.711 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (103m) 8m ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:37:49.712 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (103m) 8m ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:37:49.712 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (103m) 7m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:37:49.712 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (103m) 8m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:37:49.712 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (109m) 8m ago 109m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:37:49.713 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (109m) 7m ago 109m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:37:49.713 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (102m) 8m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:37:49.713 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (102m) 8m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:37:49.713 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (101m) 8m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:37:49.714 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (101m) 8m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:37:49.714 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (100m) 7m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:37:49.714 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (100m) 7m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:37:49.714 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (100m) 7m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:37:49.715 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (99m) 7m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:37:49.715 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (109m) 7m ago 109m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:37:49.715 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 7m ago 107m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:37:49.964 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:37:49.965 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:37:49.965 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:37:49.965 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:37:49.965 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:37:49.966 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:37:49.966 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:37:49.966 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:37:49.967 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:37:49.967 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:37:49.967 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:37:49.967 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:37:49.968 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:37:49.968 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:37:49.968 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:37:50.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:50 gibba013 bash[29418]: cluster 2021-03-10T15:37:48.959573+0000 mgr.gibba020.yqfnwy (mgr.34427) 5550 : cluster [DBG] pgmap v3154: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:50.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:50 gibba013 bash[29418]: audit 2021-03-10T15:37:49.960392+0000 mon.a (mon.0) 2229 : audit [DBG] from='client.? 172.21.2.113:0/933582678' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:50.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:50 gibba013 bash[30381]: cluster 2021-03-10T15:37:48.959573+0000 mgr.gibba020.yqfnwy (mgr.34427) 5550 : cluster [DBG] pgmap v3154: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:50.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:50 gibba013 bash[30381]: audit 2021-03-10T15:37:49.960392+0000 mon.a (mon.0) 2229 : audit [DBG] from='client.? 172.21.2.113:0/933582678' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:50.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:50 gibba020 bash[25448]: cluster 2021-03-10T15:37:48.959573+0000 mgr.gibba020.yqfnwy (mgr.34427) 5550 : cluster [DBG] pgmap v3154: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:50.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:50 gibba020 bash[25448]: audit 2021-03-10T15:37:49.960392+0000 mon.a (mon.0) 2229 : audit [DBG] from='client.? 172.21.2.113:0/933582678' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:37:51.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:51 gibba013 bash[29418]: audit 2021-03-10T15:37:49.470650+0000 mgr.gibba020.yqfnwy (mgr.34427) 5551 : audit [DBG] from='client.47778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:37:51.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:51 gibba013 bash[29418]: audit 2021-03-10T15:37:49.692723+0000 mgr.gibba020.yqfnwy (mgr.34427) 5552 : audit [DBG] from='client.47784 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:37:51.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:51 gibba013 bash[30381]: audit 2021-03-10T15:37:49.470650+0000 mgr.gibba020.yqfnwy (mgr.34427) 5551 : audit [DBG] from='client.47778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:37:51.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:51 gibba013 bash[30381]: audit 2021-03-10T15:37:49.692723+0000 mgr.gibba020.yqfnwy (mgr.34427) 5552 : audit [DBG] from='client.47784 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:37:51.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:51 gibba020 bash[25448]: audit 2021-03-10T15:37:49.470650+0000 mgr.gibba020.yqfnwy (mgr.34427) 5551 : audit [DBG] from='client.47778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:37:51.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:51 gibba020 bash[25448]: audit 2021-03-10T15:37:49.692723+0000 mgr.gibba020.yqfnwy (mgr.34427) 5552 : audit [DBG] from='client.47784 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:37:52.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:52 gibba013 bash[29418]: cluster 2021-03-10T15:37:50.961313+0000 mgr.gibba020.yqfnwy (mgr.34427) 5553 : cluster [DBG] pgmap v3155: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:52.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:52 gibba013 bash[30381]: cluster 2021-03-10T15:37:50.961313+0000 mgr.gibba020.yqfnwy (mgr.34427) 5553 : cluster [DBG] pgmap v3155: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:52.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:52 gibba020 bash[25448]: cluster 2021-03-10T15:37:50.961313+0000 mgr.gibba020.yqfnwy (mgr.34427) 5553 : cluster [DBG] pgmap v3155: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:54.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:53 gibba013 bash[29418]: cluster 2021-03-10T15:37:52.962701+0000 mgr.gibba020.yqfnwy (mgr.34427) 5554 : cluster [DBG] pgmap v3156: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:54.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:53 gibba013 bash[29418]: cephadm 2021-03-10T15:37:53.396720+0000 mgr.gibba020.yqfnwy (mgr.34427) 5555 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:37:54.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:53 gibba013 bash[30381]: cluster 2021-03-10T15:37:52.962701+0000 mgr.gibba020.yqfnwy (mgr.34427) 5554 : cluster [DBG] pgmap v3156: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:54.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:53 gibba013 bash[30381]: cephadm 2021-03-10T15:37:53.396720+0000 mgr.gibba020.yqfnwy (mgr.34427) 5555 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:37:54.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:53 gibba020 bash[25448]: cluster 2021-03-10T15:37:52.962701+0000 mgr.gibba020.yqfnwy (mgr.34427) 5554 : cluster [DBG] pgmap v3156: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:54.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:53 gibba020 bash[25448]: cephadm 2021-03-10T15:37:53.396720+0000 mgr.gibba020.yqfnwy (mgr.34427) 5555 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:37:56.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:56 gibba013 bash[29418]: cluster 2021-03-10T15:37:54.964272+0000 mgr.gibba020.yqfnwy (mgr.34427) 5556 : cluster [DBG] pgmap v3157: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:56.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:56 gibba013 bash[30381]: cluster 2021-03-10T15:37:54.964272+0000 mgr.gibba020.yqfnwy (mgr.34427) 5556 : cluster [DBG] pgmap v3157: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:56.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:56 gibba020 bash[25448]: cluster 2021-03-10T15:37:54.964272+0000 mgr.gibba020.yqfnwy (mgr.34427) 5556 : cluster [DBG] pgmap v3157: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:58.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:37:58 gibba013 bash[29418]: cluster 2021-03-10T15:37:56.965775+0000 mgr.gibba020.yqfnwy (mgr.34427) 5557 : cluster [DBG] pgmap v3158: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:58.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:37:58 gibba013 bash[30381]: cluster 2021-03-10T15:37:56.965775+0000 mgr.gibba020.yqfnwy (mgr.34427) 5557 : cluster [DBG] pgmap v3158: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:37:58.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:37:58 gibba020 bash[25448]: cluster 2021-03-10T15:37:56.965775+0000 mgr.gibba020.yqfnwy (mgr.34427) 5557 : cluster [DBG] pgmap v3158: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:00.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:00 gibba013 bash[29418]: cluster 2021-03-10T15:37:58.967257+0000 mgr.gibba020.yqfnwy (mgr.34427) 5558 : cluster [DBG] pgmap v3159: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:00.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:00 gibba013 bash[30381]: cluster 2021-03-10T15:37:58.967257+0000 mgr.gibba020.yqfnwy (mgr.34427) 5558 : cluster [DBG] pgmap v3159: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:00.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:00 gibba020 bash[25448]: cluster 2021-03-10T15:37:58.967257+0000 mgr.gibba020.yqfnwy (mgr.34427) 5558 : cluster [DBG] pgmap v3159: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:02.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:02 gibba013 bash[29418]: cluster 2021-03-10T15:38:00.968695+0000 mgr.gibba020.yqfnwy (mgr.34427) 5559 : cluster [DBG] pgmap v3160: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:02.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:02 gibba013 bash[30381]: cluster 2021-03-10T15:38:00.968695+0000 mgr.gibba020.yqfnwy (mgr.34427) 5559 : cluster [DBG] pgmap v3160: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:02.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:02 gibba020 bash[25448]: cluster 2021-03-10T15:38:00.968695+0000 mgr.gibba020.yqfnwy (mgr.34427) 5559 : cluster [DBG] pgmap v3160: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:04.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:03 gibba013 bash[29418]: cluster 2021-03-10T15:38:02.969968+0000 mgr.gibba020.yqfnwy (mgr.34427) 5560 : cluster [DBG] pgmap v3161: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:04.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:03 gibba013 bash[30381]: cluster 2021-03-10T15:38:02.969968+0000 mgr.gibba020.yqfnwy (mgr.34427) 5560 : cluster [DBG] pgmap v3161: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:04.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:03 gibba020 bash[25448]: cluster 2021-03-10T15:38:02.969968+0000 mgr.gibba020.yqfnwy (mgr.34427) 5560 : cluster [DBG] pgmap v3161: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:06.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:06 gibba013 bash[29418]: cluster 2021-03-10T15:38:04.971771+0000 mgr.gibba020.yqfnwy (mgr.34427) 5561 : cluster [DBG] pgmap v3162: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:06.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:06 gibba013 bash[30381]: cluster 2021-03-10T15:38:04.971771+0000 mgr.gibba020.yqfnwy (mgr.34427) 5561 : cluster [DBG] pgmap v3162: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:06.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:06 gibba020 bash[25448]: cluster 2021-03-10T15:38:04.971771+0000 mgr.gibba020.yqfnwy (mgr.34427) 5561 : cluster [DBG] pgmap v3162: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:07.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:07 gibba013 bash[29418]: audit 2021-03-10T15:38:06.500498+0000 mon.a (mon.0) 2230 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:38:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:07 gibba013 bash[29418]: audit 2021-03-10T15:38:06.576218+0000 mon.a (mon.0) 2231 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:38:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:07 gibba013 bash[29418]: audit 2021-03-10T15:38:06.687063+0000 mon.a (mon.0) 2232 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:38:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:07 gibba013 bash[29418]: audit 2021-03-10T15:38:06.687810+0000 mon.a (mon.0) 2233 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:38:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:07 gibba013 bash[29418]: audit 2021-03-10T15:38:06.688476+0000 mon.a (mon.0) 2234 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T15:38:07.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:07 gibba013 bash[29418]: audit 2021-03-10T15:38:06.689191+0000 mon.a (mon.0) 2235 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:38:07.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:07 gibba013 bash[30381]: audit 2021-03-10T15:38:06.500498+0000 mon.a (mon.0) 2230 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:38:07.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:07 gibba013 bash[30381]: audit 2021-03-10T15:38:06.576218+0000 mon.a (mon.0) 2231 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:38:07.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:07 gibba013 bash[30381]: audit 2021-03-10T15:38:06.687063+0000 mon.a (mon.0) 2232 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:38:07.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:07 gibba013 bash[30381]: audit 2021-03-10T15:38:06.687810+0000 mon.a (mon.0) 2233 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:38:07.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:07 gibba013 bash[30381]: audit 2021-03-10T15:38:06.688476+0000 mon.a (mon.0) 2234 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T15:38:07.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:07 gibba013 bash[30381]: audit 2021-03-10T15:38:06.689191+0000 mon.a (mon.0) 2235 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:38:07.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:07 gibba020 bash[25448]: audit 2021-03-10T15:38:06.500498+0000 mon.a (mon.0) 2230 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:38:07.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:07 gibba020 bash[25448]: audit 2021-03-10T15:38:06.576218+0000 mon.a (mon.0) 2231 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:38:07.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:07 gibba020 bash[25448]: audit 2021-03-10T15:38:06.687063+0000 mon.a (mon.0) 2232 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:38:07.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:07 gibba020 bash[25448]: audit 2021-03-10T15:38:06.687810+0000 mon.a (mon.0) 2233 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:38:07.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:07 gibba020 bash[25448]: audit 2021-03-10T15:38:06.688476+0000 mon.a (mon.0) 2234 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T15:38:07.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:07 gibba020 bash[25448]: audit 2021-03-10T15:38:06.689191+0000 mon.a (mon.0) 2235 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:38:08.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:08 gibba013 bash[29418]: cluster 2021-03-10T15:38:06.973359+0000 mgr.gibba020.yqfnwy (mgr.34427) 5562 : cluster [DBG] pgmap v3163: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:08.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:08 gibba013 bash[30381]: cluster 2021-03-10T15:38:06.973359+0000 mgr.gibba020.yqfnwy (mgr.34427) 5562 : cluster [DBG] pgmap v3163: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:08.403 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:08 gibba020 bash[25448]: cluster 2021-03-10T15:38:06.973359+0000 mgr.gibba020.yqfnwy (mgr.34427) 5562 : cluster [DBG] pgmap v3163: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:09.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:09 gibba013 bash[29418]: cephadm 2021-03-10T15:38:08.397777+0000 mgr.gibba020.yqfnwy (mgr.34427) 5563 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:38:09.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:09 gibba013 bash[30381]: cephadm 2021-03-10T15:38:08.397777+0000 mgr.gibba020.yqfnwy (mgr.34427) 5563 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:38:09.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:09 gibba020 bash[25448]: cephadm 2021-03-10T15:38:08.397777+0000 mgr.gibba020.yqfnwy (mgr.34427) 5563 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:38:10.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:10 gibba013 bash[29418]: cluster 2021-03-10T15:38:08.974895+0000 mgr.gibba020.yqfnwy (mgr.34427) 5564 : cluster [DBG] pgmap v3164: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:10.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:10 gibba013 bash[30381]: cluster 2021-03-10T15:38:08.974895+0000 mgr.gibba020.yqfnwy (mgr.34427) 5564 : cluster [DBG] pgmap v3164: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:10.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:10 gibba020 bash[25448]: cluster 2021-03-10T15:38:08.974895+0000 mgr.gibba020.yqfnwy (mgr.34427) 5564 : cluster [DBG] pgmap v3164: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:12.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:12 gibba013 bash[29418]: cluster 2021-03-10T15:38:10.976336+0000 mgr.gibba020.yqfnwy (mgr.34427) 5565 : cluster [DBG] pgmap v3165: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:12.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:12 gibba013 bash[30381]: cluster 2021-03-10T15:38:10.976336+0000 mgr.gibba020.yqfnwy (mgr.34427) 5565 : cluster [DBG] pgmap v3165: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:12.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:12 gibba020 bash[25448]: cluster 2021-03-10T15:38:10.976336+0000 mgr.gibba020.yqfnwy (mgr.34427) 5565 : cluster [DBG] pgmap v3165: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:14.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:13 gibba013 bash[29418]: cluster 2021-03-10T15:38:12.977611+0000 mgr.gibba020.yqfnwy (mgr.34427) 5566 : cluster [DBG] pgmap v3166: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:14.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:13 gibba013 bash[30381]: cluster 2021-03-10T15:38:12.977611+0000 mgr.gibba020.yqfnwy (mgr.34427) 5566 : cluster [DBG] pgmap v3166: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:14.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:13 gibba020 bash[25448]: cluster 2021-03-10T15:38:12.977611+0000 mgr.gibba020.yqfnwy (mgr.34427) 5566 : cluster [DBG] pgmap v3166: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:16.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:16 gibba013 bash[29418]: cluster 2021-03-10T15:38:14.979465+0000 mgr.gibba020.yqfnwy (mgr.34427) 5567 : cluster [DBG] pgmap v3167: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:16.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:16 gibba013 bash[30381]: cluster 2021-03-10T15:38:14.979465+0000 mgr.gibba020.yqfnwy (mgr.34427) 5567 : cluster [DBG] pgmap v3167: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:16.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:16 gibba020 bash[25448]: cluster 2021-03-10T15:38:14.979465+0000 mgr.gibba020.yqfnwy (mgr.34427) 5567 : cluster [DBG] pgmap v3167: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:18.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:18 gibba013 bash[29418]: cluster 2021-03-10T15:38:16.981034+0000 mgr.gibba020.yqfnwy (mgr.34427) 5568 : cluster [DBG] pgmap v3168: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:18.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:18 gibba013 bash[30381]: cluster 2021-03-10T15:38:16.981034+0000 mgr.gibba020.yqfnwy (mgr.34427) 5568 : cluster [DBG] pgmap v3168: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:18.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:18 gibba020 bash[25448]: cluster 2021-03-10T15:38:16.981034+0000 mgr.gibba020.yqfnwy (mgr.34427) 5568 : cluster [DBG] pgmap v3168: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:20.210 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:38:20.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:20 gibba013 bash[29418]: cluster 2021-03-10T15:38:18.982539+0000 mgr.gibba020.yqfnwy (mgr.34427) 5569 : cluster [DBG] pgmap v3169: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:20.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:20 gibba013 bash[30381]: cluster 2021-03-10T15:38:18.982539+0000 mgr.gibba020.yqfnwy (mgr.34427) 5569 : cluster [DBG] pgmap v3169: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:20.438 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:38:20.438 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (104m) 9m ago 110m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:38:20.439 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (110m) 7m ago 110m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:38:20.439 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (105m) 7m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:38:20.439 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (105m) 7m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:38:20.439 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (104m) 9m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:38:20.440 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (104m) 9m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:38:20.440 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (103m) 7m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:38:20.440 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (104m) 9m ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:38:20.440 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (110m) 9m ago 110m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:38:20.441 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (110m) 7m ago 110m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:38:20.441 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (103m) 9m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:38:20.441 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (102m) 9m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:38:20.441 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (102m) 9m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:38:20.441 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (101m) 9m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:38:20.442 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (101m) 7m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:38:20.442 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (100m) 7m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:38:20.442 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (100m) 7m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:38:20.442 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (100m) 7m ago 110m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:38:20.443 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (109m) 7m ago 110m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:38:20.443 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 7m ago 108m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:38:20.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:20 gibba020 bash[25448]: cluster 2021-03-10T15:38:18.982539+0000 mgr.gibba020.yqfnwy (mgr.34427) 5569 : cluster [DBG] pgmap v3169: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:20.685 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:38:20.685 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:38:20.686 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:38:20.686 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:38:20.686 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:38:20.686 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:38:20.686 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:38:20.687 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:38:20.687 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:38:20.687 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:38:20.687 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:38:20.688 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:38:20.688 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:38:20.688 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:38:20.688 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:38:21.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:21 gibba013 bash[29418]: audit 2021-03-10T15:38:20.196323+0000 mgr.gibba020.yqfnwy (mgr.34427) 5570 : audit [DBG] from='client.57781 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:38:21.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:21 gibba013 bash[29418]: audit 2021-03-10T15:38:20.420856+0000 mgr.gibba020.yqfnwy (mgr.34427) 5571 : audit [DBG] from='client.47802 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:38:21.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:21 gibba013 bash[29418]: audit 2021-03-10T15:38:20.680938+0000 mon.a (mon.0) 2236 : audit [DBG] from='client.? 172.21.2.113:0/4217503230' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:21.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:21 gibba013 bash[30381]: audit 2021-03-10T15:38:20.196323+0000 mgr.gibba020.yqfnwy (mgr.34427) 5570 : audit [DBG] from='client.57781 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:38:21.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:21 gibba013 bash[30381]: audit 2021-03-10T15:38:20.420856+0000 mgr.gibba020.yqfnwy (mgr.34427) 5571 : audit [DBG] from='client.47802 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:38:21.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:21 gibba013 bash[30381]: audit 2021-03-10T15:38:20.680938+0000 mon.a (mon.0) 2236 : audit [DBG] from='client.? 172.21.2.113:0/4217503230' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:21.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:21 gibba020 bash[25448]: audit 2021-03-10T15:38:20.196323+0000 mgr.gibba020.yqfnwy (mgr.34427) 5570 : audit [DBG] from='client.57781 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:38:21.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:21 gibba020 bash[25448]: audit 2021-03-10T15:38:20.420856+0000 mgr.gibba020.yqfnwy (mgr.34427) 5571 : audit [DBG] from='client.47802 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:38:21.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:21 gibba020 bash[25448]: audit 2021-03-10T15:38:20.680938+0000 mon.a (mon.0) 2236 : audit [DBG] from='client.? 172.21.2.113:0/4217503230' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:22.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:22 gibba013 bash[29418]: cluster 2021-03-10T15:38:20.984250+0000 mgr.gibba020.yqfnwy (mgr.34427) 5572 : cluster [DBG] pgmap v3170: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:22.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:22 gibba013 bash[30381]: cluster 2021-03-10T15:38:20.984250+0000 mgr.gibba020.yqfnwy (mgr.34427) 5572 : cluster [DBG] pgmap v3170: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:22.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:22 gibba020 bash[25448]: cluster 2021-03-10T15:38:20.984250+0000 mgr.gibba020.yqfnwy (mgr.34427) 5572 : cluster [DBG] pgmap v3170: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:23.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:23 gibba020 bash[25448]: cluster 2021-03-10T15:38:22.985626+0000 mgr.gibba020.yqfnwy (mgr.34427) 5573 : cluster [DBG] pgmap v3171: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:23.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:23 gibba020 bash[25448]: audit 2021-03-10T15:38:23.414410+0000 mon.a (mon.0) 2237 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:38:23.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:23 gibba020 bash[25448]: cephadm 2021-03-10T15:38:23.418469+0000 mgr.gibba020.yqfnwy (mgr.34427) 5574 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:38:23.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:23 gibba020 bash[25448]: cephadm 2021-03-10T15:38:23.420459+0000 mgr.gibba020.yqfnwy (mgr.34427) 5575 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:38:23.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:23 gibba020 bash[25448]: audit 2021-03-10T15:38:23.652136+0000 mon.a (mon.0) 2238 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:38:23.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:23 gibba020 bash[25448]: audit 2021-03-10T15:38:23.655688+0000 mon.a (mon.0) 2239 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:38:23.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:23 gibba020 bash[25448]: audit 2021-03-10T15:38:23.657276+0000 mon.a (mon.0) 2240 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:23.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:23 gibba020 bash[25448]: audit 2021-03-10T15:38:23.658812+0000 mon.a (mon.0) 2241 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:23.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:23 gibba020 bash[25448]: audit 2021-03-10T15:38:23.660157+0000 mon.a (mon.0) 2242 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:23.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:23 gibba020 bash[25448]: audit 2021-03-10T15:38:23.663266+0000 mon.a (mon.0) 2243 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:23.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:23 gibba020 bash[25448]: audit 2021-03-10T15:38:23.664973+0000 mon.a (mon.0) 2244 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:24.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:23 gibba013 bash[29418]: cluster 2021-03-10T15:38:22.985626+0000 mgr.gibba020.yqfnwy (mgr.34427) 5573 : cluster [DBG] pgmap v3171: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:24.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:23 gibba013 bash[29418]: audit 2021-03-10T15:38:23.414410+0000 mon.a (mon.0) 2237 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:38:24.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:23 gibba013 bash[29418]: cephadm 2021-03-10T15:38:23.418469+0000 mgr.gibba020.yqfnwy (mgr.34427) 5574 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:38:24.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:23 gibba013 bash[29418]: cephadm 2021-03-10T15:38:23.420459+0000 mgr.gibba020.yqfnwy (mgr.34427) 5575 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:38:24.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:23 gibba013 bash[29418]: audit 2021-03-10T15:38:23.652136+0000 mon.a (mon.0) 2238 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:38:24.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:23 gibba013 bash[29418]: audit 2021-03-10T15:38:23.655688+0000 mon.a (mon.0) 2239 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:38:24.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:23 gibba013 bash[29418]: audit 2021-03-10T15:38:23.657276+0000 mon.a (mon.0) 2240 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:24.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:23 gibba013 bash[29418]: audit 2021-03-10T15:38:23.658812+0000 mon.a (mon.0) 2241 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:24.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:23 gibba013 bash[29418]: audit 2021-03-10T15:38:23.660157+0000 mon.a (mon.0) 2242 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:24.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:23 gibba013 bash[29418]: audit 2021-03-10T15:38:23.663266+0000 mon.a (mon.0) 2243 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:24.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:23 gibba013 bash[29418]: audit 2021-03-10T15:38:23.664973+0000 mon.a (mon.0) 2244 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:24.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:23 gibba013 bash[30381]: cluster 2021-03-10T15:38:22.985626+0000 mgr.gibba020.yqfnwy (mgr.34427) 5573 : cluster [DBG] pgmap v3171: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:24.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:23 gibba013 bash[30381]: audit 2021-03-10T15:38:23.414410+0000 mon.a (mon.0) 2237 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:38:24.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:23 gibba013 bash[30381]: cephadm 2021-03-10T15:38:23.418469+0000 mgr.gibba020.yqfnwy (mgr.34427) 5574 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:38:24.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:23 gibba013 bash[30381]: cephadm 2021-03-10T15:38:23.420459+0000 mgr.gibba020.yqfnwy (mgr.34427) 5575 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:38:24.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:23 gibba013 bash[30381]: audit 2021-03-10T15:38:23.652136+0000 mon.a (mon.0) 2238 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:38:24.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:23 gibba013 bash[30381]: audit 2021-03-10T15:38:23.655688+0000 mon.a (mon.0) 2239 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:38:24.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:23 gibba013 bash[30381]: audit 2021-03-10T15:38:23.657276+0000 mon.a (mon.0) 2240 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:24.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:23 gibba013 bash[30381]: audit 2021-03-10T15:38:23.658812+0000 mon.a (mon.0) 2241 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:24.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:23 gibba013 bash[30381]: audit 2021-03-10T15:38:23.660157+0000 mon.a (mon.0) 2242 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:24.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:23 gibba013 bash[30381]: audit 2021-03-10T15:38:23.663266+0000 mon.a (mon.0) 2243 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:24.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:23 gibba013 bash[30381]: audit 2021-03-10T15:38:23.664973+0000 mon.a (mon.0) 2244 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:25.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:24 gibba013 bash[29418]: cephadm 2021-03-10T15:38:23.653892+0000 mgr.gibba020.yqfnwy (mgr.34427) 5576 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:38:25.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:24 gibba013 bash[29418]: cephadm 2021-03-10T15:38:23.656056+0000 mgr.gibba020.yqfnwy (mgr.34427) 5577 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:38:25.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:24 gibba013 bash[29418]: cephadm 2021-03-10T15:38:23.657494+0000 mgr.gibba020.yqfnwy (mgr.34427) 5578 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:38:25.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:24 gibba013 bash[29418]: cephadm 2021-03-10T15:38:23.657536+0000 mgr.gibba020.yqfnwy (mgr.34427) 5579 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:38:25.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:24 gibba013 bash[29418]: cephadm 2021-03-10T15:38:23.658967+0000 mgr.gibba020.yqfnwy (mgr.34427) 5580 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:38:25.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:24 gibba013 bash[29418]: cephadm 2021-03-10T15:38:23.659007+0000 mgr.gibba020.yqfnwy (mgr.34427) 5581 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:38:25.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:24 gibba013 bash[29418]: cephadm 2021-03-10T15:38:23.660524+0000 mgr.gibba020.yqfnwy (mgr.34427) 5582 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:38:25.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:24 gibba013 bash[29418]: cephadm 2021-03-10T15:38:23.661898+0000 mgr.gibba020.yqfnwy (mgr.34427) 5583 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:38:25.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:24 gibba013 bash[29418]: cephadm 2021-03-10T15:38:23.661943+0000 mgr.gibba020.yqfnwy (mgr.34427) 5584 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:38:25.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:24 gibba013 bash[29418]: cephadm 2021-03-10T15:38:23.663446+0000 mgr.gibba020.yqfnwy (mgr.34427) 5585 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:38:25.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:24 gibba013 bash[29418]: cephadm 2021-03-10T15:38:23.663819+0000 mgr.gibba020.yqfnwy (mgr.34427) 5586 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:38:25.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:24 gibba013 bash[29418]: cephadm 2021-03-10T15:38:23.665193+0000 mgr.gibba020.yqfnwy (mgr.34427) 5587 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:38:25.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:24 gibba013 bash[29418]: cephadm 2021-03-10T15:38:23.665238+0000 mgr.gibba020.yqfnwy (mgr.34427) 5588 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:38:25.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:24 gibba013 bash[29418]: cephadm 2021-03-10T15:38:23.665371+0000 mgr.gibba020.yqfnwy (mgr.34427) 5589 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:38:25.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:24 gibba013 bash[30381]: cephadm 2021-03-10T15:38:23.653892+0000 mgr.gibba020.yqfnwy (mgr.34427) 5576 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:38:25.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:24 gibba013 bash[30381]: cephadm 2021-03-10T15:38:23.656056+0000 mgr.gibba020.yqfnwy (mgr.34427) 5577 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:38:25.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:24 gibba013 bash[30381]: cephadm 2021-03-10T15:38:23.657494+0000 mgr.gibba020.yqfnwy (mgr.34427) 5578 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:38:25.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:24 gibba013 bash[30381]: cephadm 2021-03-10T15:38:23.657536+0000 mgr.gibba020.yqfnwy (mgr.34427) 5579 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:38:25.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:24 gibba013 bash[30381]: cephadm 2021-03-10T15:38:23.658967+0000 mgr.gibba020.yqfnwy (mgr.34427) 5580 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:38:25.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:24 gibba013 bash[30381]: cephadm 2021-03-10T15:38:23.659007+0000 mgr.gibba020.yqfnwy (mgr.34427) 5581 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:38:25.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:24 gibba013 bash[30381]: cephadm 2021-03-10T15:38:23.660524+0000 mgr.gibba020.yqfnwy (mgr.34427) 5582 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:38:25.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:24 gibba013 bash[30381]: cephadm 2021-03-10T15:38:23.661898+0000 mgr.gibba020.yqfnwy (mgr.34427) 5583 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:38:25.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:24 gibba013 bash[30381]: cephadm 2021-03-10T15:38:23.661943+0000 mgr.gibba020.yqfnwy (mgr.34427) 5584 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:38:25.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:24 gibba013 bash[30381]: cephadm 2021-03-10T15:38:23.663446+0000 mgr.gibba020.yqfnwy (mgr.34427) 5585 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:38:25.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:24 gibba013 bash[30381]: cephadm 2021-03-10T15:38:23.663819+0000 mgr.gibba020.yqfnwy (mgr.34427) 5586 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:38:25.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:24 gibba013 bash[30381]: cephadm 2021-03-10T15:38:23.665193+0000 mgr.gibba020.yqfnwy (mgr.34427) 5587 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:38:25.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:24 gibba013 bash[30381]: cephadm 2021-03-10T15:38:23.665238+0000 mgr.gibba020.yqfnwy (mgr.34427) 5588 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:38:25.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:24 gibba013 bash[30381]: cephadm 2021-03-10T15:38:23.665371+0000 mgr.gibba020.yqfnwy (mgr.34427) 5589 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:38:25.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:24 gibba020 bash[25448]: cephadm 2021-03-10T15:38:23.653892+0000 mgr.gibba020.yqfnwy (mgr.34427) 5576 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:38:25.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:24 gibba020 bash[25448]: cephadm 2021-03-10T15:38:23.656056+0000 mgr.gibba020.yqfnwy (mgr.34427) 5577 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:38:25.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:24 gibba020 bash[25448]: cephadm 2021-03-10T15:38:23.657494+0000 mgr.gibba020.yqfnwy (mgr.34427) 5578 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:38:25.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:24 gibba020 bash[25448]: cephadm 2021-03-10T15:38:23.657536+0000 mgr.gibba020.yqfnwy (mgr.34427) 5579 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:38:25.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:24 gibba020 bash[25448]: cephadm 2021-03-10T15:38:23.658967+0000 mgr.gibba020.yqfnwy (mgr.34427) 5580 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:38:25.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:24 gibba020 bash[25448]: cephadm 2021-03-10T15:38:23.659007+0000 mgr.gibba020.yqfnwy (mgr.34427) 5581 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:38:25.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:24 gibba020 bash[25448]: cephadm 2021-03-10T15:38:23.660524+0000 mgr.gibba020.yqfnwy (mgr.34427) 5582 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:38:25.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:24 gibba020 bash[25448]: cephadm 2021-03-10T15:38:23.661898+0000 mgr.gibba020.yqfnwy (mgr.34427) 5583 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:38:25.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:24 gibba020 bash[25448]: cephadm 2021-03-10T15:38:23.661943+0000 mgr.gibba020.yqfnwy (mgr.34427) 5584 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:38:25.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:24 gibba020 bash[25448]: cephadm 2021-03-10T15:38:23.663446+0000 mgr.gibba020.yqfnwy (mgr.34427) 5585 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:38:25.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:24 gibba020 bash[25448]: cephadm 2021-03-10T15:38:23.663819+0000 mgr.gibba020.yqfnwy (mgr.34427) 5586 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:38:25.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:24 gibba020 bash[25448]: cephadm 2021-03-10T15:38:23.665193+0000 mgr.gibba020.yqfnwy (mgr.34427) 5587 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:38:25.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:24 gibba020 bash[25448]: cephadm 2021-03-10T15:38:23.665238+0000 mgr.gibba020.yqfnwy (mgr.34427) 5588 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:38:25.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:24 gibba020 bash[25448]: cephadm 2021-03-10T15:38:23.665371+0000 mgr.gibba020.yqfnwy (mgr.34427) 5589 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:38:26.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:25 gibba013 bash[29418]: cluster 2021-03-10T15:38:24.987396+0000 mgr.gibba020.yqfnwy (mgr.34427) 5590 : cluster [DBG] pgmap v3172: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:26.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:25 gibba013 bash[30381]: cluster 2021-03-10T15:38:24.987396+0000 mgr.gibba020.yqfnwy (mgr.34427) 5590 : cluster [DBG] pgmap v3172: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:26.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:25 gibba020 bash[25448]: cluster 2021-03-10T15:38:24.987396+0000 mgr.gibba020.yqfnwy (mgr.34427) 5590 : cluster [DBG] pgmap v3172: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:28.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:28 gibba013 bash[30381]: cluster 2021-03-10T15:38:26.988833+0000 mgr.gibba020.yqfnwy (mgr.34427) 5591 : cluster [DBG] pgmap v3173: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:28.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:28 gibba013 bash[29418]: cluster 2021-03-10T15:38:26.988833+0000 mgr.gibba020.yqfnwy (mgr.34427) 5591 : cluster [DBG] pgmap v3173: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:28.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:28 gibba020 bash[25448]: cluster 2021-03-10T15:38:26.988833+0000 mgr.gibba020.yqfnwy (mgr.34427) 5591 : cluster [DBG] pgmap v3173: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:30.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:30 gibba013 bash[29418]: cluster 2021-03-10T15:38:28.990184+0000 mgr.gibba020.yqfnwy (mgr.34427) 5592 : cluster [DBG] pgmap v3174: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:30.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:30 gibba013 bash[30381]: cluster 2021-03-10T15:38:28.990184+0000 mgr.gibba020.yqfnwy (mgr.34427) 5592 : cluster [DBG] pgmap v3174: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:30.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:30 gibba020 bash[25448]: cluster 2021-03-10T15:38:28.990184+0000 mgr.gibba020.yqfnwy (mgr.34427) 5592 : cluster [DBG] pgmap v3174: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:32.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:32 gibba013 bash[29418]: cluster 2021-03-10T15:38:30.991838+0000 mgr.gibba020.yqfnwy (mgr.34427) 5593 : cluster [DBG] pgmap v3175: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:32.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:32 gibba013 bash[30381]: cluster 2021-03-10T15:38:30.991838+0000 mgr.gibba020.yqfnwy (mgr.34427) 5593 : cluster [DBG] pgmap v3175: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:32.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:32 gibba020 bash[25448]: cluster 2021-03-10T15:38:30.991838+0000 mgr.gibba020.yqfnwy (mgr.34427) 5593 : cluster [DBG] pgmap v3175: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:34.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:33 gibba013 bash[29418]: cluster 2021-03-10T15:38:32.993405+0000 mgr.gibba020.yqfnwy (mgr.34427) 5594 : cluster [DBG] pgmap v3176: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:34.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:33 gibba013 bash[30381]: cluster 2021-03-10T15:38:32.993405+0000 mgr.gibba020.yqfnwy (mgr.34427) 5594 : cluster [DBG] pgmap v3176: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:34.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:33 gibba020 bash[25448]: cluster 2021-03-10T15:38:32.993405+0000 mgr.gibba020.yqfnwy (mgr.34427) 5594 : cluster [DBG] pgmap v3176: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:36.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:36 gibba013 bash[29418]: cluster 2021-03-10T15:38:34.995264+0000 mgr.gibba020.yqfnwy (mgr.34427) 5595 : cluster [DBG] pgmap v3177: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:36.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:36 gibba013 bash[30381]: cluster 2021-03-10T15:38:34.995264+0000 mgr.gibba020.yqfnwy (mgr.34427) 5595 : cluster [DBG] pgmap v3177: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:36.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:36 gibba020 bash[25448]: cluster 2021-03-10T15:38:34.995264+0000 mgr.gibba020.yqfnwy (mgr.34427) 5595 : cluster [DBG] pgmap v3177: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:38.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:38 gibba013 bash[29418]: cluster 2021-03-10T15:38:36.996829+0000 mgr.gibba020.yqfnwy (mgr.34427) 5596 : cluster [DBG] pgmap v3178: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:38.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:38 gibba013 bash[30381]: cluster 2021-03-10T15:38:36.996829+0000 mgr.gibba020.yqfnwy (mgr.34427) 5596 : cluster [DBG] pgmap v3178: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:38.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:38 gibba020 bash[25448]: cluster 2021-03-10T15:38:36.996829+0000 mgr.gibba020.yqfnwy (mgr.34427) 5596 : cluster [DBG] pgmap v3178: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:40.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:40 gibba013 bash[29418]: cephadm 2021-03-10T15:38:38.681394+0000 mgr.gibba020.yqfnwy (mgr.34427) 5597 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:38:40.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:40 gibba013 bash[29418]: cluster 2021-03-10T15:38:38.998418+0000 mgr.gibba020.yqfnwy (mgr.34427) 5598 : cluster [DBG] pgmap v3179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:40.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:40 gibba013 bash[30381]: cephadm 2021-03-10T15:38:38.681394+0000 mgr.gibba020.yqfnwy (mgr.34427) 5597 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:38:40.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:40 gibba013 bash[30381]: cluster 2021-03-10T15:38:38.998418+0000 mgr.gibba020.yqfnwy (mgr.34427) 5598 : cluster [DBG] pgmap v3179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:40.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:40 gibba020 bash[25448]: cephadm 2021-03-10T15:38:38.681394+0000 mgr.gibba020.yqfnwy (mgr.34427) 5597 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:38:40.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:40 gibba020 bash[25448]: cluster 2021-03-10T15:38:38.998418+0000 mgr.gibba020.yqfnwy (mgr.34427) 5598 : cluster [DBG] pgmap v3179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:42.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:42 gibba013 bash[29418]: cluster 2021-03-10T15:38:41.000168+0000 mgr.gibba020.yqfnwy (mgr.34427) 5599 : cluster [DBG] pgmap v3180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:42.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:42 gibba013 bash[30381]: cluster 2021-03-10T15:38:41.000168+0000 mgr.gibba020.yqfnwy (mgr.34427) 5599 : cluster [DBG] pgmap v3180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:42.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:42 gibba020 bash[25448]: cluster 2021-03-10T15:38:41.000168+0000 mgr.gibba020.yqfnwy (mgr.34427) 5599 : cluster [DBG] pgmap v3180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:44.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:43 gibba013 bash[29418]: cluster 2021-03-10T15:38:43.001459+0000 mgr.gibba020.yqfnwy (mgr.34427) 5600 : cluster [DBG] pgmap v3181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:44.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:43 gibba013 bash[30381]: cluster 2021-03-10T15:38:43.001459+0000 mgr.gibba020.yqfnwy (mgr.34427) 5600 : cluster [DBG] pgmap v3181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:44.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:43 gibba020 bash[25448]: cluster 2021-03-10T15:38:43.001459+0000 mgr.gibba020.yqfnwy (mgr.34427) 5600 : cluster [DBG] pgmap v3181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:46.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:46 gibba013 bash[29418]: cluster 2021-03-10T15:38:45.003247+0000 mgr.gibba020.yqfnwy (mgr.34427) 5601 : cluster [DBG] pgmap v3182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:46.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:46 gibba013 bash[30381]: cluster 2021-03-10T15:38:45.003247+0000 mgr.gibba020.yqfnwy (mgr.34427) 5601 : cluster [DBG] pgmap v3182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:46.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:46 gibba020 bash[25448]: cluster 2021-03-10T15:38:45.003247+0000 mgr.gibba020.yqfnwy (mgr.34427) 5601 : cluster [DBG] pgmap v3182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:48.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:48 gibba013 bash[29418]: cluster 2021-03-10T15:38:47.004822+0000 mgr.gibba020.yqfnwy (mgr.34427) 5602 : cluster [DBG] pgmap v3183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:48.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:48 gibba013 bash[30381]: cluster 2021-03-10T15:38:47.004822+0000 mgr.gibba020.yqfnwy (mgr.34427) 5602 : cluster [DBG] pgmap v3183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:48.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:48 gibba020 bash[25448]: cluster 2021-03-10T15:38:47.004822+0000 mgr.gibba020.yqfnwy (mgr.34427) 5602 : cluster [DBG] pgmap v3183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:50.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:50 gibba013 bash[29418]: cluster 2021-03-10T15:38:49.006334+0000 mgr.gibba020.yqfnwy (mgr.34427) 5603 : cluster [DBG] pgmap v3184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:50.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:50 gibba013 bash[30381]: cluster 2021-03-10T15:38:49.006334+0000 mgr.gibba020.yqfnwy (mgr.34427) 5603 : cluster [DBG] pgmap v3184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:50.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:50 gibba020 bash[25448]: cluster 2021-03-10T15:38:49.006334+0000 mgr.gibba020.yqfnwy (mgr.34427) 5603 : cluster [DBG] pgmap v3184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:50.927 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:38:51.152 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:38:51.153 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (105m) 9m ago 110m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:38:51.153 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (110m) 8m ago 110m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:38:51.153 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (105m) 8m ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:38:51.153 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (106m) 8m ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:38:51.154 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (105m) 9m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:38:51.154 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (104m) 9m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:38:51.154 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (104m) 8m ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:38:51.154 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (104m) 9m ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:38:51.155 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (110m) 9m ago 110m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:38:51.155 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (110m) 8m ago 110m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:38:51.157 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (103m) 9m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:38:51.157 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (103m) 9m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:38:51.158 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (102m) 9m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:38:51.158 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (102m) 9m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:38:51.158 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (101m) 8m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:38:51.158 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (101m) 8m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:38:51.159 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (101m) 8m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:38:51.159 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (100m) 8m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:38:51.159 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (110m) 8m ago 110m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:38:51.159 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 8m ago 108m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:38:51.398 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:38:51.398 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:38:51.398 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:38:51.398 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:38:51.399 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:38:51.399 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:38:51.399 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:38:51.399 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:38:51.400 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:38:51.400 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:38:51.400 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:38:51.400 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:38:51.400 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:38:51.401 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:38:51.401 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:38:52.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:52 gibba013 bash[29418]: audit 2021-03-10T15:38:50.913404+0000 mgr.gibba020.yqfnwy (mgr.34427) 5604 : audit [DBG] from='client.57799 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:38:52.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:52 gibba013 bash[29418]: cluster 2021-03-10T15:38:51.008007+0000 mgr.gibba020.yqfnwy (mgr.34427) 5605 : cluster [DBG] pgmap v3185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:52.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:52 gibba013 bash[29418]: audit 2021-03-10T15:38:51.136705+0000 mgr.gibba020.yqfnwy (mgr.34427) 5606 : audit [DBG] from='client.47820 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:38:52.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:52 gibba013 bash[29418]: audit 2021-03-10T15:38:51.393602+0000 mon.a (mon.0) 2245 : audit [DBG] from='client.? 172.21.2.113:0/2086898932' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:52.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:52 gibba013 bash[30381]: audit 2021-03-10T15:38:50.913404+0000 mgr.gibba020.yqfnwy (mgr.34427) 5604 : audit [DBG] from='client.57799 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:38:52.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:52 gibba013 bash[30381]: cluster 2021-03-10T15:38:51.008007+0000 mgr.gibba020.yqfnwy (mgr.34427) 5605 : cluster [DBG] pgmap v3185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:52.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:52 gibba013 bash[30381]: audit 2021-03-10T15:38:51.136705+0000 mgr.gibba020.yqfnwy (mgr.34427) 5606 : audit [DBG] from='client.47820 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:38:52.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:52 gibba013 bash[30381]: audit 2021-03-10T15:38:51.393602+0000 mon.a (mon.0) 2245 : audit [DBG] from='client.? 172.21.2.113:0/2086898932' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:52.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:52 gibba020 bash[25448]: audit 2021-03-10T15:38:50.913404+0000 mgr.gibba020.yqfnwy (mgr.34427) 5604 : audit [DBG] from='client.57799 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:38:52.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:52 gibba020 bash[25448]: cluster 2021-03-10T15:38:51.008007+0000 mgr.gibba020.yqfnwy (mgr.34427) 5605 : cluster [DBG] pgmap v3185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:52.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:52 gibba020 bash[25448]: audit 2021-03-10T15:38:51.136705+0000 mgr.gibba020.yqfnwy (mgr.34427) 5606 : audit [DBG] from='client.47820 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:38:52.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:52 gibba020 bash[25448]: audit 2021-03-10T15:38:51.393602+0000 mon.a (mon.0) 2245 : audit [DBG] from='client.? 172.21.2.113:0/2086898932' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:38:54.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:53 gibba013 bash[29418]: cluster 2021-03-10T15:38:53.009510+0000 mgr.gibba020.yqfnwy (mgr.34427) 5607 : cluster [DBG] pgmap v3186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:54.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:53 gibba013 bash[30381]: cluster 2021-03-10T15:38:53.009510+0000 mgr.gibba020.yqfnwy (mgr.34427) 5607 : cluster [DBG] pgmap v3186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:54.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:53 gibba020 bash[25448]: cluster 2021-03-10T15:38:53.009510+0000 mgr.gibba020.yqfnwy (mgr.34427) 5607 : cluster [DBG] pgmap v3186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:55.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:54 gibba013 bash[29418]: cephadm 2021-03-10T15:38:53.697448+0000 mgr.gibba020.yqfnwy (mgr.34427) 5608 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:38:55.146 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:54 gibba013 bash[30381]: cephadm 2021-03-10T15:38:53.697448+0000 mgr.gibba020.yqfnwy (mgr.34427) 5608 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:38:55.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:54 gibba020 bash[25448]: cephadm 2021-03-10T15:38:53.697448+0000 mgr.gibba020.yqfnwy (mgr.34427) 5608 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:38:56.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:55 gibba013 bash[29418]: cluster 2021-03-10T15:38:55.011296+0000 mgr.gibba020.yqfnwy (mgr.34427) 5609 : cluster [DBG] pgmap v3187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:56.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:55 gibba013 bash[30381]: cluster 2021-03-10T15:38:55.011296+0000 mgr.gibba020.yqfnwy (mgr.34427) 5609 : cluster [DBG] pgmap v3187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:56.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:55 gibba020 bash[25448]: cluster 2021-03-10T15:38:55.011296+0000 mgr.gibba020.yqfnwy (mgr.34427) 5609 : cluster [DBG] pgmap v3187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:58.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:38:58 gibba013 bash[29418]: cluster 2021-03-10T15:38:57.012742+0000 mgr.gibba020.yqfnwy (mgr.34427) 5610 : cluster [DBG] pgmap v3188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:58.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:38:58 gibba013 bash[30381]: cluster 2021-03-10T15:38:57.012742+0000 mgr.gibba020.yqfnwy (mgr.34427) 5610 : cluster [DBG] pgmap v3188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:38:58.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:38:58 gibba020 bash[25448]: cluster 2021-03-10T15:38:57.012742+0000 mgr.gibba020.yqfnwy (mgr.34427) 5610 : cluster [DBG] pgmap v3188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:00.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:00 gibba013 bash[29418]: cluster 2021-03-10T15:38:59.014391+0000 mgr.gibba020.yqfnwy (mgr.34427) 5611 : cluster [DBG] pgmap v3189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:00.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:00 gibba013 bash[30381]: cluster 2021-03-10T15:38:59.014391+0000 mgr.gibba020.yqfnwy (mgr.34427) 5611 : cluster [DBG] pgmap v3189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:00.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:00 gibba020 bash[25448]: cluster 2021-03-10T15:38:59.014391+0000 mgr.gibba020.yqfnwy (mgr.34427) 5611 : cluster [DBG] pgmap v3189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:02.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:02 gibba013 bash[29418]: cluster 2021-03-10T15:39:01.016106+0000 mgr.gibba020.yqfnwy (mgr.34427) 5612 : cluster [DBG] pgmap v3190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:02.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:02 gibba013 bash[30381]: cluster 2021-03-10T15:39:01.016106+0000 mgr.gibba020.yqfnwy (mgr.34427) 5612 : cluster [DBG] pgmap v3190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:02.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:02 gibba020 bash[25448]: cluster 2021-03-10T15:39:01.016106+0000 mgr.gibba020.yqfnwy (mgr.34427) 5612 : cluster [DBG] pgmap v3190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:04.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:03 gibba013 bash[29418]: cluster 2021-03-10T15:39:03.017367+0000 mgr.gibba020.yqfnwy (mgr.34427) 5613 : cluster [DBG] pgmap v3191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:04.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:03 gibba013 bash[30381]: cluster 2021-03-10T15:39:03.017367+0000 mgr.gibba020.yqfnwy (mgr.34427) 5613 : cluster [DBG] pgmap v3191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:04.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:03 gibba020 bash[25448]: cluster 2021-03-10T15:39:03.017367+0000 mgr.gibba020.yqfnwy (mgr.34427) 5613 : cluster [DBG] pgmap v3191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:06.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:06 gibba013 bash[29418]: cluster 2021-03-10T15:39:05.018956+0000 mgr.gibba020.yqfnwy (mgr.34427) 5614 : cluster [DBG] pgmap v3192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:06.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:06 gibba013 bash[30381]: cluster 2021-03-10T15:39:05.018956+0000 mgr.gibba020.yqfnwy (mgr.34427) 5614 : cluster [DBG] pgmap v3192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:06.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:06 gibba020 bash[25448]: cluster 2021-03-10T15:39:05.018956+0000 mgr.gibba020.yqfnwy (mgr.34427) 5614 : cluster [DBG] pgmap v3192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:07.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:07 gibba013 bash[29418]: audit 2021-03-10T15:39:06.505546+0000 mon.a (mon.0) 2246 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:39:07.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:07 gibba013 bash[29418]: audit 2021-03-10T15:39:06.582634+0000 mon.a (mon.0) 2247 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:39:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:07 gibba013 bash[29418]: audit 2021-03-10T15:39:06.693214+0000 mon.a (mon.0) 2248 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:39:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:07 gibba013 bash[29418]: audit 2021-03-10T15:39:06.694067+0000 mon.a (mon.0) 2249 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T15:39:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:07 gibba013 bash[29418]: audit 2021-03-10T15:39:06.694746+0000 mon.a (mon.0) 2250 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:39:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:07 gibba013 bash[29418]: audit 2021-03-10T15:39:06.695394+0000 mon.a (mon.0) 2251 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:39:07.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:07 gibba013 bash[30381]: audit 2021-03-10T15:39:06.505546+0000 mon.a (mon.0) 2246 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:39:07.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:07 gibba013 bash[30381]: audit 2021-03-10T15:39:06.582634+0000 mon.a (mon.0) 2247 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:39:07.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:07 gibba013 bash[30381]: audit 2021-03-10T15:39:06.693214+0000 mon.a (mon.0) 2248 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:39:07.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:07 gibba013 bash[30381]: audit 2021-03-10T15:39:06.694067+0000 mon.a (mon.0) 2249 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T15:39:07.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:07 gibba013 bash[30381]: audit 2021-03-10T15:39:06.694746+0000 mon.a (mon.0) 2250 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:39:07.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:07 gibba013 bash[30381]: audit 2021-03-10T15:39:06.695394+0000 mon.a (mon.0) 2251 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:39:07.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:07 gibba020 bash[25448]: audit 2021-03-10T15:39:06.505546+0000 mon.a (mon.0) 2246 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:39:07.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:07 gibba020 bash[25448]: audit 2021-03-10T15:39:06.582634+0000 mon.a (mon.0) 2247 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:39:07.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:07 gibba020 bash[25448]: audit 2021-03-10T15:39:06.693214+0000 mon.a (mon.0) 2248 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:39:07.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:07 gibba020 bash[25448]: audit 2021-03-10T15:39:06.694067+0000 mon.a (mon.0) 2249 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T15:39:07.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:07 gibba020 bash[25448]: audit 2021-03-10T15:39:06.694746+0000 mon.a (mon.0) 2250 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:39:07.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:07 gibba020 bash[25448]: audit 2021-03-10T15:39:06.695394+0000 mon.a (mon.0) 2251 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:39:08.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:08 gibba013 bash[29418]: cluster 2021-03-10T15:39:07.020507+0000 mgr.gibba020.yqfnwy (mgr.34427) 5615 : cluster [DBG] pgmap v3193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:08.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:08 gibba013 bash[30381]: cluster 2021-03-10T15:39:07.020507+0000 mgr.gibba020.yqfnwy (mgr.34427) 5615 : cluster [DBG] pgmap v3193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:08.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:08 gibba020 bash[25448]: cluster 2021-03-10T15:39:07.020507+0000 mgr.gibba020.yqfnwy (mgr.34427) 5615 : cluster [DBG] pgmap v3193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:10.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:10 gibba013 bash[29418]: cephadm 2021-03-10T15:39:08.713200+0000 mgr.gibba020.yqfnwy (mgr.34427) 5616 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:39:10.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:10 gibba013 bash[29418]: cluster 2021-03-10T15:39:09.022026+0000 mgr.gibba020.yqfnwy (mgr.34427) 5617 : cluster [DBG] pgmap v3194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:10.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:10 gibba013 bash[30381]: cephadm 2021-03-10T15:39:08.713200+0000 mgr.gibba020.yqfnwy (mgr.34427) 5616 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:39:10.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:10 gibba013 bash[30381]: cluster 2021-03-10T15:39:09.022026+0000 mgr.gibba020.yqfnwy (mgr.34427) 5617 : cluster [DBG] pgmap v3194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:10.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:10 gibba020 bash[25448]: cephadm 2021-03-10T15:39:08.713200+0000 mgr.gibba020.yqfnwy (mgr.34427) 5616 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:39:10.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:10 gibba020 bash[25448]: cluster 2021-03-10T15:39:09.022026+0000 mgr.gibba020.yqfnwy (mgr.34427) 5617 : cluster [DBG] pgmap v3194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:12.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:12 gibba013 bash[29418]: cluster 2021-03-10T15:39:11.023707+0000 mgr.gibba020.yqfnwy (mgr.34427) 5618 : cluster [DBG] pgmap v3195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:12.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:12 gibba013 bash[30381]: cluster 2021-03-10T15:39:11.023707+0000 mgr.gibba020.yqfnwy (mgr.34427) 5618 : cluster [DBG] pgmap v3195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:12.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:12 gibba020 bash[25448]: cluster 2021-03-10T15:39:11.023707+0000 mgr.gibba020.yqfnwy (mgr.34427) 5618 : cluster [DBG] pgmap v3195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:14.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:13 gibba013 bash[29418]: cluster 2021-03-10T15:39:13.025254+0000 mgr.gibba020.yqfnwy (mgr.34427) 5619 : cluster [DBG] pgmap v3196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:14.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:13 gibba013 bash[30381]: cluster 2021-03-10T15:39:13.025254+0000 mgr.gibba020.yqfnwy (mgr.34427) 5619 : cluster [DBG] pgmap v3196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:14.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:13 gibba020 bash[25448]: cluster 2021-03-10T15:39:13.025254+0000 mgr.gibba020.yqfnwy (mgr.34427) 5619 : cluster [DBG] pgmap v3196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:16.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:16 gibba013 bash[29418]: cluster 2021-03-10T15:39:15.027015+0000 mgr.gibba020.yqfnwy (mgr.34427) 5620 : cluster [DBG] pgmap v3197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:16.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:16 gibba013 bash[30381]: cluster 2021-03-10T15:39:15.027015+0000 mgr.gibba020.yqfnwy (mgr.34427) 5620 : cluster [DBG] pgmap v3197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:16.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:16 gibba020 bash[25448]: cluster 2021-03-10T15:39:15.027015+0000 mgr.gibba020.yqfnwy (mgr.34427) 5620 : cluster [DBG] pgmap v3197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:18.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:18 gibba013 bash[29418]: cluster 2021-03-10T15:39:17.028560+0000 mgr.gibba020.yqfnwy (mgr.34427) 5621 : cluster [DBG] pgmap v3198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:18.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:18 gibba013 bash[30381]: cluster 2021-03-10T15:39:17.028560+0000 mgr.gibba020.yqfnwy (mgr.34427) 5621 : cluster [DBG] pgmap v3198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:18.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:18 gibba020 bash[25448]: cluster 2021-03-10T15:39:17.028560+0000 mgr.gibba020.yqfnwy (mgr.34427) 5621 : cluster [DBG] pgmap v3198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:20.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:20 gibba013 bash[29418]: cluster 2021-03-10T15:39:19.030065+0000 mgr.gibba020.yqfnwy (mgr.34427) 5622 : cluster [DBG] pgmap v3199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:20.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:20 gibba013 bash[30381]: cluster 2021-03-10T15:39:19.030065+0000 mgr.gibba020.yqfnwy (mgr.34427) 5622 : cluster [DBG] pgmap v3199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:20.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:20 gibba020 bash[25448]: cluster 2021-03-10T15:39:19.030065+0000 mgr.gibba020.yqfnwy (mgr.34427) 5622 : cluster [DBG] pgmap v3199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:21.638 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:39:21.870 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:39:21.870 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (105m) 10m ago 111m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:39:21.870 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (111m) 9m ago 111m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:39:21.871 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (106m) 9m ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:39:21.871 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (106m) 9m ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:39:21.871 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (105m) 10m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:39:21.871 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (105m) 10m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:39:21.872 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (104m) 9m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:39:21.872 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (105m) 10m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:39:21.872 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (111m) 10m ago 111m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:39:21.872 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (111m) 9m ago 111m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:39:21.873 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (104m) 10m ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:39:21.873 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (103m) 10m ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:39:21.873 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (103m) 10m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:39:21.873 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (102m) 10m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:39:21.873 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (102m) 9m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:39:21.874 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (101m) 9m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:39:21.874 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (101m) 9m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:39:21.874 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (101m) 9m ago 111m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:39:21.874 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (110m) 9m ago 111m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:39:21.874 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 9m ago 109m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:39:22.118 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:39:22.118 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:39:22.119 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:39:22.119 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:39:22.119 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:39:22.119 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:39:22.120 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:39:22.120 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:39:22.120 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:39:22.120 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:39:22.121 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:39:22.121 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:39:22.121 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:39:22.121 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:39:22.121 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:39:22.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:22 gibba013 bash[29418]: cluster 2021-03-10T15:39:21.031819+0000 mgr.gibba020.yqfnwy (mgr.34427) 5623 : cluster [DBG] pgmap v3200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:22.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:22 gibba013 bash[30381]: cluster 2021-03-10T15:39:21.031819+0000 mgr.gibba020.yqfnwy (mgr.34427) 5623 : cluster [DBG] pgmap v3200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:22.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:22 gibba020 bash[25448]: cluster 2021-03-10T15:39:21.031819+0000 mgr.gibba020.yqfnwy (mgr.34427) 5623 : cluster [DBG] pgmap v3200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:23.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:23 gibba013 bash[29418]: audit 2021-03-10T15:39:21.624494+0000 mgr.gibba020.yqfnwy (mgr.34427) 5624 : audit [DBG] from='client.57817 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:39:23.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:23 gibba013 bash[29418]: audit 2021-03-10T15:39:21.852750+0000 mgr.gibba020.yqfnwy (mgr.34427) 5625 : audit [DBG] from='client.57823 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:39:23.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:23 gibba013 bash[29418]: audit 2021-03-10T15:39:22.114028+0000 mon.a (mon.0) 2252 : audit [DBG] from='client.? 172.21.2.113:0/2504163043' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:23.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:23 gibba013 bash[30381]: audit 2021-03-10T15:39:21.624494+0000 mgr.gibba020.yqfnwy (mgr.34427) 5624 : audit [DBG] from='client.57817 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:39:23.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:23 gibba013 bash[30381]: audit 2021-03-10T15:39:21.852750+0000 mgr.gibba020.yqfnwy (mgr.34427) 5625 : audit [DBG] from='client.57823 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:39:23.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:23 gibba013 bash[30381]: audit 2021-03-10T15:39:22.114028+0000 mon.a (mon.0) 2252 : audit [DBG] from='client.? 172.21.2.113:0/2504163043' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:23.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:23 gibba020 bash[25448]: audit 2021-03-10T15:39:21.624494+0000 mgr.gibba020.yqfnwy (mgr.34427) 5624 : audit [DBG] from='client.57817 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:39:23.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:23 gibba020 bash[25448]: audit 2021-03-10T15:39:21.852750+0000 mgr.gibba020.yqfnwy (mgr.34427) 5625 : audit [DBG] from='client.57823 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:39:23.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:23 gibba020 bash[25448]: audit 2021-03-10T15:39:22.114028+0000 mon.a (mon.0) 2252 : audit [DBG] from='client.? 172.21.2.113:0/2504163043' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:24.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:24 gibba013 bash[29418]: cluster 2021-03-10T15:39:23.033303+0000 mgr.gibba020.yqfnwy (mgr.34427) 5626 : cluster [DBG] pgmap v3201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:24.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:24 gibba013 bash[29418]: audit 2021-03-10T15:39:23.720147+0000 mon.a (mon.0) 2253 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:39:24.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:24 gibba013 bash[29418]: audit 2021-03-10T15:39:23.726531+0000 mon.a (mon.0) 2254 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:39:24.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:24 gibba013 bash[30381]: cluster 2021-03-10T15:39:23.033303+0000 mgr.gibba020.yqfnwy (mgr.34427) 5626 : cluster [DBG] pgmap v3201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:24.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:24 gibba013 bash[30381]: audit 2021-03-10T15:39:23.720147+0000 mon.a (mon.0) 2253 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:39:24.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:24 gibba013 bash[30381]: audit 2021-03-10T15:39:23.726531+0000 mon.a (mon.0) 2254 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:39:24.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:24 gibba020 bash[25448]: cluster 2021-03-10T15:39:23.033303+0000 mgr.gibba020.yqfnwy (mgr.34427) 5626 : cluster [DBG] pgmap v3201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:24.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:24 gibba020 bash[25448]: audit 2021-03-10T15:39:23.720147+0000 mon.a (mon.0) 2253 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:39:24.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:24 gibba020 bash[25448]: audit 2021-03-10T15:39:23.726531+0000 mon.a (mon.0) 2254 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:39:25.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:25 gibba020 bash[25448]: cephadm 2021-03-10T15:39:23.725265+0000 mgr.gibba020.yqfnwy (mgr.34427) 5627 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:39:25.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:25 gibba013 bash[29418]: cephadm 2021-03-10T15:39:23.725265+0000 mgr.gibba020.yqfnwy (mgr.34427) 5627 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:39:25.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:25 gibba013 bash[30381]: cephadm 2021-03-10T15:39:23.725265+0000 mgr.gibba020.yqfnwy (mgr.34427) 5627 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:39:26.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:26 gibba020 bash[25448]: cluster 2021-03-10T15:39:25.035346+0000 mgr.gibba020.yqfnwy (mgr.34427) 5628 : cluster [DBG] pgmap v3202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:26.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:26 gibba013 bash[30381]: cluster 2021-03-10T15:39:25.035346+0000 mgr.gibba020.yqfnwy (mgr.34427) 5628 : cluster [DBG] pgmap v3202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:26.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:26 gibba013 bash[29418]: cluster 2021-03-10T15:39:25.035346+0000 mgr.gibba020.yqfnwy (mgr.34427) 5628 : cluster [DBG] pgmap v3202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:28.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:28 gibba013 bash[30381]: cluster 2021-03-10T15:39:27.036973+0000 mgr.gibba020.yqfnwy (mgr.34427) 5629 : cluster [DBG] pgmap v3203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:28.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:28 gibba013 bash[30381]: cephadm 2021-03-10T15:39:27.323316+0000 mgr.gibba020.yqfnwy (mgr.34427) 5630 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:39:28.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:28 gibba013 bash[30381]: audit 2021-03-10T15:39:27.323427+0000 mon.a (mon.0) 2255 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:39:28.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:28 gibba013 bash[30381]: audit 2021-03-10T15:39:27.521812+0000 mon.a (mon.0) 2256 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:39:28.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:28 gibba013 bash[30381]: audit 2021-03-10T15:39:27.529829+0000 mon.a (mon.0) 2257 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:39:28.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:28 gibba013 bash[30381]: audit 2021-03-10T15:39:27.531984+0000 mon.a (mon.0) 2258 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:28.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:28 gibba013 bash[30381]: audit 2021-03-10T15:39:27.533583+0000 mon.a (mon.0) 2259 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:28.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:28 gibba013 bash[30381]: audit 2021-03-10T15:39:27.535125+0000 mon.a (mon.0) 2260 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:28.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:28 gibba013 bash[30381]: audit 2021-03-10T15:39:27.537763+0000 mon.a (mon.0) 2261 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:28.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:28 gibba013 bash[30381]: audit 2021-03-10T15:39:27.539518+0000 mon.a (mon.0) 2262 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:28.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:28 gibba013 bash[29418]: cluster 2021-03-10T15:39:27.036973+0000 mgr.gibba020.yqfnwy (mgr.34427) 5629 : cluster [DBG] pgmap v3203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:28.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:28 gibba013 bash[29418]: cephadm 2021-03-10T15:39:27.323316+0000 mgr.gibba020.yqfnwy (mgr.34427) 5630 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:39:28.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:28 gibba013 bash[29418]: audit 2021-03-10T15:39:27.323427+0000 mon.a (mon.0) 2255 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:39:28.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:28 gibba013 bash[29418]: audit 2021-03-10T15:39:27.521812+0000 mon.a (mon.0) 2256 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:39:28.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:28 gibba013 bash[29418]: audit 2021-03-10T15:39:27.529829+0000 mon.a (mon.0) 2257 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:39:28.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:28 gibba013 bash[29418]: audit 2021-03-10T15:39:27.531984+0000 mon.a (mon.0) 2258 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:28.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:28 gibba013 bash[29418]: audit 2021-03-10T15:39:27.533583+0000 mon.a (mon.0) 2259 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:28.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:28 gibba013 bash[29418]: audit 2021-03-10T15:39:27.535125+0000 mon.a (mon.0) 2260 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:28.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:28 gibba013 bash[29418]: audit 2021-03-10T15:39:27.537763+0000 mon.a (mon.0) 2261 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:28.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:28 gibba013 bash[29418]: audit 2021-03-10T15:39:27.539518+0000 mon.a (mon.0) 2262 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:28.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:28 gibba020 bash[25448]: cluster 2021-03-10T15:39:27.036973+0000 mgr.gibba020.yqfnwy (mgr.34427) 5629 : cluster [DBG] pgmap v3203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:28.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:28 gibba020 bash[25448]: cephadm 2021-03-10T15:39:27.323316+0000 mgr.gibba020.yqfnwy (mgr.34427) 5630 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:39:28.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:28 gibba020 bash[25448]: audit 2021-03-10T15:39:27.323427+0000 mon.a (mon.0) 2255 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:39:28.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:28 gibba020 bash[25448]: audit 2021-03-10T15:39:27.521812+0000 mon.a (mon.0) 2256 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:39:28.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:28 gibba020 bash[25448]: audit 2021-03-10T15:39:27.529829+0000 mon.a (mon.0) 2257 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:39:28.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:28 gibba020 bash[25448]: audit 2021-03-10T15:39:27.531984+0000 mon.a (mon.0) 2258 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:28.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:28 gibba020 bash[25448]: audit 2021-03-10T15:39:27.533583+0000 mon.a (mon.0) 2259 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:28.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:28 gibba020 bash[25448]: audit 2021-03-10T15:39:27.535125+0000 mon.a (mon.0) 2260 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:28.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:28 gibba020 bash[25448]: audit 2021-03-10T15:39:27.537763+0000 mon.a (mon.0) 2261 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:28.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:28 gibba020 bash[25448]: audit 2021-03-10T15:39:27.539518+0000 mon.a (mon.0) 2262 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:29.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:29 gibba013 bash[29418]: cephadm 2021-03-10T15:39:27.527889+0000 mgr.gibba020.yqfnwy (mgr.34427) 5631 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:39:29.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:29 gibba013 bash[29418]: cephadm 2021-03-10T15:39:27.530538+0000 mgr.gibba020.yqfnwy (mgr.34427) 5632 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:39:29.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:29 gibba013 bash[29418]: cephadm 2021-03-10T15:39:27.532277+0000 mgr.gibba020.yqfnwy (mgr.34427) 5633 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:39:29.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:29 gibba013 bash[29418]: cephadm 2021-03-10T15:39:27.532315+0000 mgr.gibba020.yqfnwy (mgr.34427) 5634 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:39:29.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:29 gibba013 bash[29418]: cephadm 2021-03-10T15:39:27.533720+0000 mgr.gibba020.yqfnwy (mgr.34427) 5635 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:39:29.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:29 gibba013 bash[29418]: cephadm 2021-03-10T15:39:27.533757+0000 mgr.gibba020.yqfnwy (mgr.34427) 5636 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:39:29.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:29 gibba013 bash[29418]: cephadm 2021-03-10T15:39:27.535258+0000 mgr.gibba020.yqfnwy (mgr.34427) 5637 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:39:29.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:29 gibba013 bash[29418]: cephadm 2021-03-10T15:39:27.536392+0000 mgr.gibba020.yqfnwy (mgr.34427) 5638 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:39:29.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:29 gibba013 bash[29418]: cephadm 2021-03-10T15:39:27.536428+0000 mgr.gibba020.yqfnwy (mgr.34427) 5639 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:39:29.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:29 gibba013 bash[29418]: cephadm 2021-03-10T15:39:27.537989+0000 mgr.gibba020.yqfnwy (mgr.34427) 5640 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:39:29.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:29 gibba013 bash[29418]: cephadm 2021-03-10T15:39:27.538312+0000 mgr.gibba020.yqfnwy (mgr.34427) 5641 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:39:29.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:29 gibba013 bash[29418]: cephadm 2021-03-10T15:39:27.539769+0000 mgr.gibba020.yqfnwy (mgr.34427) 5642 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:39:29.639 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:29 gibba013 bash[29418]: cephadm 2021-03-10T15:39:27.539816+0000 mgr.gibba020.yqfnwy (mgr.34427) 5643 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:39:29.639 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:29 gibba013 bash[29418]: cephadm 2021-03-10T15:39:27.539968+0000 mgr.gibba020.yqfnwy (mgr.34427) 5644 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:39:29.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:29 gibba013 bash[30381]: cephadm 2021-03-10T15:39:27.527889+0000 mgr.gibba020.yqfnwy (mgr.34427) 5631 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:39:29.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:29 gibba013 bash[30381]: cephadm 2021-03-10T15:39:27.530538+0000 mgr.gibba020.yqfnwy (mgr.34427) 5632 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:39:29.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:29 gibba013 bash[30381]: cephadm 2021-03-10T15:39:27.532277+0000 mgr.gibba020.yqfnwy (mgr.34427) 5633 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:39:29.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:29 gibba013 bash[30381]: cephadm 2021-03-10T15:39:27.532315+0000 mgr.gibba020.yqfnwy (mgr.34427) 5634 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:39:29.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:29 gibba013 bash[30381]: cephadm 2021-03-10T15:39:27.533720+0000 mgr.gibba020.yqfnwy (mgr.34427) 5635 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:39:29.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:29 gibba013 bash[30381]: cephadm 2021-03-10T15:39:27.533757+0000 mgr.gibba020.yqfnwy (mgr.34427) 5636 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:39:29.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:29 gibba013 bash[30381]: cephadm 2021-03-10T15:39:27.535258+0000 mgr.gibba020.yqfnwy (mgr.34427) 5637 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:39:29.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:29 gibba013 bash[30381]: cephadm 2021-03-10T15:39:27.536392+0000 mgr.gibba020.yqfnwy (mgr.34427) 5638 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:39:29.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:29 gibba013 bash[30381]: cephadm 2021-03-10T15:39:27.536428+0000 mgr.gibba020.yqfnwy (mgr.34427) 5639 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:39:29.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:29 gibba013 bash[30381]: cephadm 2021-03-10T15:39:27.537989+0000 mgr.gibba020.yqfnwy (mgr.34427) 5640 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:39:29.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:29 gibba013 bash[30381]: cephadm 2021-03-10T15:39:27.538312+0000 mgr.gibba020.yqfnwy (mgr.34427) 5641 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:39:29.644 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:29 gibba013 bash[30381]: cephadm 2021-03-10T15:39:27.539769+0000 mgr.gibba020.yqfnwy (mgr.34427) 5642 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:39:29.644 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:29 gibba013 bash[30381]: cephadm 2021-03-10T15:39:27.539816+0000 mgr.gibba020.yqfnwy (mgr.34427) 5643 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:39:29.645 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:29 gibba013 bash[30381]: cephadm 2021-03-10T15:39:27.539968+0000 mgr.gibba020.yqfnwy (mgr.34427) 5644 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:39:29.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:29 gibba020 bash[25448]: cephadm 2021-03-10T15:39:27.527889+0000 mgr.gibba020.yqfnwy (mgr.34427) 5631 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:39:29.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:29 gibba020 bash[25448]: cephadm 2021-03-10T15:39:27.530538+0000 mgr.gibba020.yqfnwy (mgr.34427) 5632 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:39:29.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:29 gibba020 bash[25448]: cephadm 2021-03-10T15:39:27.532277+0000 mgr.gibba020.yqfnwy (mgr.34427) 5633 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:39:29.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:29 gibba020 bash[25448]: cephadm 2021-03-10T15:39:27.532315+0000 mgr.gibba020.yqfnwy (mgr.34427) 5634 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:39:29.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:29 gibba020 bash[25448]: cephadm 2021-03-10T15:39:27.533720+0000 mgr.gibba020.yqfnwy (mgr.34427) 5635 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:39:29.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:29 gibba020 bash[25448]: cephadm 2021-03-10T15:39:27.533757+0000 mgr.gibba020.yqfnwy (mgr.34427) 5636 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:39:29.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:29 gibba020 bash[25448]: cephadm 2021-03-10T15:39:27.535258+0000 mgr.gibba020.yqfnwy (mgr.34427) 5637 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:39:29.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:29 gibba020 bash[25448]: cephadm 2021-03-10T15:39:27.536392+0000 mgr.gibba020.yqfnwy (mgr.34427) 5638 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:39:29.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:29 gibba020 bash[25448]: cephadm 2021-03-10T15:39:27.536428+0000 mgr.gibba020.yqfnwy (mgr.34427) 5639 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:39:29.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:29 gibba020 bash[25448]: cephadm 2021-03-10T15:39:27.537989+0000 mgr.gibba020.yqfnwy (mgr.34427) 5640 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:39:29.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:29 gibba020 bash[25448]: cephadm 2021-03-10T15:39:27.538312+0000 mgr.gibba020.yqfnwy (mgr.34427) 5641 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:39:29.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:29 gibba020 bash[25448]: cephadm 2021-03-10T15:39:27.539769+0000 mgr.gibba020.yqfnwy (mgr.34427) 5642 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:39:29.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:29 gibba020 bash[25448]: cephadm 2021-03-10T15:39:27.539816+0000 mgr.gibba020.yqfnwy (mgr.34427) 5643 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:39:29.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:29 gibba020 bash[25448]: cephadm 2021-03-10T15:39:27.539968+0000 mgr.gibba020.yqfnwy (mgr.34427) 5644 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:39:30.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:30 gibba013 bash[29418]: cluster 2021-03-10T15:39:29.038609+0000 mgr.gibba020.yqfnwy (mgr.34427) 5645 : cluster [DBG] pgmap v3204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:30.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:30 gibba013 bash[30381]: cluster 2021-03-10T15:39:29.038609+0000 mgr.gibba020.yqfnwy (mgr.34427) 5645 : cluster [DBG] pgmap v3204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:30.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:30 gibba020 bash[25448]: cluster 2021-03-10T15:39:29.038609+0000 mgr.gibba020.yqfnwy (mgr.34427) 5645 : cluster [DBG] pgmap v3204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:32.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:32 gibba013 bash[29418]: cluster 2021-03-10T15:39:31.040310+0000 mgr.gibba020.yqfnwy (mgr.34427) 5646 : cluster [DBG] pgmap v3205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:32.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:32 gibba013 bash[30381]: cluster 2021-03-10T15:39:31.040310+0000 mgr.gibba020.yqfnwy (mgr.34427) 5646 : cluster [DBG] pgmap v3205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:32.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:32 gibba020 bash[25448]: cluster 2021-03-10T15:39:31.040310+0000 mgr.gibba020.yqfnwy (mgr.34427) 5646 : cluster [DBG] pgmap v3205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:34.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:33 gibba013 bash[29418]: cluster 2021-03-10T15:39:33.041598+0000 mgr.gibba020.yqfnwy (mgr.34427) 5647 : cluster [DBG] pgmap v3206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:34.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:33 gibba013 bash[30381]: cluster 2021-03-10T15:39:33.041598+0000 mgr.gibba020.yqfnwy (mgr.34427) 5647 : cluster [DBG] pgmap v3206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:34.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:33 gibba020 bash[25448]: cluster 2021-03-10T15:39:33.041598+0000 mgr.gibba020.yqfnwy (mgr.34427) 5647 : cluster [DBG] pgmap v3206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:36.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:36 gibba013 bash[29418]: cluster 2021-03-10T15:39:35.043296+0000 mgr.gibba020.yqfnwy (mgr.34427) 5648 : cluster [DBG] pgmap v3207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:36.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:36 gibba013 bash[30381]: cluster 2021-03-10T15:39:35.043296+0000 mgr.gibba020.yqfnwy (mgr.34427) 5648 : cluster [DBG] pgmap v3207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:36.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:36 gibba020 bash[25448]: cluster 2021-03-10T15:39:35.043296+0000 mgr.gibba020.yqfnwy (mgr.34427) 5648 : cluster [DBG] pgmap v3207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:38.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:38 gibba013 bash[29418]: cluster 2021-03-10T15:39:37.044803+0000 mgr.gibba020.yqfnwy (mgr.34427) 5649 : cluster [DBG] pgmap v3208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:38.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:38 gibba013 bash[30381]: cluster 2021-03-10T15:39:37.044803+0000 mgr.gibba020.yqfnwy (mgr.34427) 5649 : cluster [DBG] pgmap v3208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:38.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:38 gibba020 bash[25448]: cluster 2021-03-10T15:39:37.044803+0000 mgr.gibba020.yqfnwy (mgr.34427) 5649 : cluster [DBG] pgmap v3208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:40.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:40 gibba013 bash[29418]: cluster 2021-03-10T15:39:39.046426+0000 mgr.gibba020.yqfnwy (mgr.34427) 5650 : cluster [DBG] pgmap v3209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:40.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:40 gibba013 bash[30381]: cluster 2021-03-10T15:39:39.046426+0000 mgr.gibba020.yqfnwy (mgr.34427) 5650 : cluster [DBG] pgmap v3209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:40.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:40 gibba020 bash[25448]: cluster 2021-03-10T15:39:39.046426+0000 mgr.gibba020.yqfnwy (mgr.34427) 5650 : cluster [DBG] pgmap v3209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:42.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:42 gibba020 bash[25448]: cluster 2021-03-10T15:39:41.048147+0000 mgr.gibba020.yqfnwy (mgr.34427) 5651 : cluster [DBG] pgmap v3210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:42.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:42 gibba013 bash[29418]: cluster 2021-03-10T15:39:41.048147+0000 mgr.gibba020.yqfnwy (mgr.34427) 5651 : cluster [DBG] pgmap v3210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:42.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:42 gibba013 bash[30381]: cluster 2021-03-10T15:39:41.048147+0000 mgr.gibba020.yqfnwy (mgr.34427) 5651 : cluster [DBG] pgmap v3210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:44.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:43 gibba013 bash[29418]: cephadm 2021-03-10T15:39:42.540832+0000 mgr.gibba020.yqfnwy (mgr.34427) 5652 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:39:44.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:43 gibba013 bash[29418]: cluster 2021-03-10T15:39:43.048716+0000 mgr.gibba020.yqfnwy (mgr.34427) 5653 : cluster [DBG] pgmap v3211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:44.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:43 gibba013 bash[30381]: cephadm 2021-03-10T15:39:42.540832+0000 mgr.gibba020.yqfnwy (mgr.34427) 5652 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:39:44.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:43 gibba013 bash[30381]: cluster 2021-03-10T15:39:43.048716+0000 mgr.gibba020.yqfnwy (mgr.34427) 5653 : cluster [DBG] pgmap v3211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:44.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:43 gibba020 bash[25448]: cephadm 2021-03-10T15:39:42.540832+0000 mgr.gibba020.yqfnwy (mgr.34427) 5652 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:39:44.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:43 gibba020 bash[25448]: cluster 2021-03-10T15:39:43.048716+0000 mgr.gibba020.yqfnwy (mgr.34427) 5653 : cluster [DBG] pgmap v3211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:46.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:46 gibba013 bash[29418]: cluster 2021-03-10T15:39:45.050354+0000 mgr.gibba020.yqfnwy (mgr.34427) 5654 : cluster [DBG] pgmap v3212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:46.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:46 gibba013 bash[30381]: cluster 2021-03-10T15:39:45.050354+0000 mgr.gibba020.yqfnwy (mgr.34427) 5654 : cluster [DBG] pgmap v3212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:46.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:46 gibba020 bash[25448]: cluster 2021-03-10T15:39:45.050354+0000 mgr.gibba020.yqfnwy (mgr.34427) 5654 : cluster [DBG] pgmap v3212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:48.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:48 gibba013 bash[29418]: cluster 2021-03-10T15:39:47.051905+0000 mgr.gibba020.yqfnwy (mgr.34427) 5655 : cluster [DBG] pgmap v3213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:48.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:48 gibba013 bash[30381]: cluster 2021-03-10T15:39:47.051905+0000 mgr.gibba020.yqfnwy (mgr.34427) 5655 : cluster [DBG] pgmap v3213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:48.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:48 gibba020 bash[25448]: cluster 2021-03-10T15:39:47.051905+0000 mgr.gibba020.yqfnwy (mgr.34427) 5655 : cluster [DBG] pgmap v3213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:50.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:50 gibba020 bash[25448]: cluster 2021-03-10T15:39:49.053341+0000 mgr.gibba020.yqfnwy (mgr.34427) 5656 : cluster [DBG] pgmap v3214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:50.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:50 gibba013 bash[29418]: cluster 2021-03-10T15:39:49.053341+0000 mgr.gibba020.yqfnwy (mgr.34427) 5656 : cluster [DBG] pgmap v3214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:50.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:50 gibba013 bash[30381]: cluster 2021-03-10T15:39:49.053341+0000 mgr.gibba020.yqfnwy (mgr.34427) 5656 : cluster [DBG] pgmap v3214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:52.365 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:39:52.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:52 gibba020 bash[25448]: cluster 2021-03-10T15:39:51.054954+0000 mgr.gibba020.yqfnwy (mgr.34427) 5657 : cluster [DBG] pgmap v3215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:52.596 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:39:52.596 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (106m) 25s ago 111m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:39:52.596 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (111m) 9m ago 111m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:39:52.596 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (106m) 9m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:39:52.597 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (107m) 9m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:39:52.597 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (106m) 25s ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:39:52.597 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (105m) 25s ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:39:52.597 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (105m) 9m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:39:52.598 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (105m) 25s ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:39:52.598 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (111m) 25s ago 111m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:39:52.598 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (111m) 9m ago 111m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:39:52.598 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (104m) 25s ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:39:52.599 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (104m) 25s ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:39:52.599 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (103m) 25s ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:39:52.599 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (103m) 25s ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:39:52.599 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (102m) 9m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:39:52.600 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (102m) 9m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:39:52.600 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (102m) 9m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:39:52.600 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (101m) 9m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:39:52.600 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (111m) 9m ago 111m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:39:52.601 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 9m ago 109m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:39:52.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:52 gibba013 bash[29418]: cluster 2021-03-10T15:39:51.054954+0000 mgr.gibba020.yqfnwy (mgr.34427) 5657 : cluster [DBG] pgmap v3215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:52.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:52 gibba013 bash[30381]: cluster 2021-03-10T15:39:51.054954+0000 mgr.gibba020.yqfnwy (mgr.34427) 5657 : cluster [DBG] pgmap v3215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:52.848 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:39:52.849 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:39:52.849 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:39:52.849 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:39:52.849 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:39:52.849 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:39:52.850 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:39:52.850 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:39:52.850 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:39:52.850 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:39:52.851 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:39:52.851 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:39:52.851 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:39:52.851 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:39:52.851 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:39:53.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:53 gibba020 bash[25448]: audit 2021-03-10T15:39:52.350915+0000 mgr.gibba020.yqfnwy (mgr.34427) 5658 : audit [DBG] from='client.47850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:39:53.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:53 gibba020 bash[25448]: audit 2021-03-10T15:39:52.844342+0000 mon.c (mon.1) 91 : audit [DBG] from='client.? 172.21.2.113:0/2193556514' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:53.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:53 gibba013 bash[29418]: audit 2021-03-10T15:39:52.350915+0000 mgr.gibba020.yqfnwy (mgr.34427) 5658 : audit [DBG] from='client.47850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:39:53.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:53 gibba013 bash[29418]: audit 2021-03-10T15:39:52.844342+0000 mon.c (mon.1) 91 : audit [DBG] from='client.? 172.21.2.113:0/2193556514' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:53.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:53 gibba013 bash[30381]: audit 2021-03-10T15:39:52.350915+0000 mgr.gibba020.yqfnwy (mgr.34427) 5658 : audit [DBG] from='client.47850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:39:53.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:53 gibba013 bash[30381]: audit 2021-03-10T15:39:52.844342+0000 mon.c (mon.1) 91 : audit [DBG] from='client.? 172.21.2.113:0/2193556514' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:39:54.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:54 gibba020 bash[25448]: audit 2021-03-10T15:39:52.578430+0000 mgr.gibba020.yqfnwy (mgr.34427) 5659 : audit [DBG] from='client.47856 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:39:54.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:54 gibba020 bash[25448]: cluster 2021-03-10T15:39:53.055483+0000 mgr.gibba020.yqfnwy (mgr.34427) 5660 : cluster [DBG] pgmap v3216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:54.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:54 gibba013 bash[29418]: audit 2021-03-10T15:39:52.578430+0000 mgr.gibba020.yqfnwy (mgr.34427) 5659 : audit [DBG] from='client.47856 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:39:54.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:54 gibba013 bash[29418]: cluster 2021-03-10T15:39:53.055483+0000 mgr.gibba020.yqfnwy (mgr.34427) 5660 : cluster [DBG] pgmap v3216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:54.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:54 gibba013 bash[30381]: audit 2021-03-10T15:39:52.578430+0000 mgr.gibba020.yqfnwy (mgr.34427) 5659 : audit [DBG] from='client.47856 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:39:54.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:54 gibba013 bash[30381]: cluster 2021-03-10T15:39:53.055483+0000 mgr.gibba020.yqfnwy (mgr.34427) 5660 : cluster [DBG] pgmap v3216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:56.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:56 gibba020 bash[25448]: cluster 2021-03-10T15:39:55.056920+0000 mgr.gibba020.yqfnwy (mgr.34427) 5661 : cluster [DBG] pgmap v3217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:56.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:56 gibba013 bash[29418]: cluster 2021-03-10T15:39:55.056920+0000 mgr.gibba020.yqfnwy (mgr.34427) 5661 : cluster [DBG] pgmap v3217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:56.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:56 gibba013 bash[30381]: cluster 2021-03-10T15:39:55.056920+0000 mgr.gibba020.yqfnwy (mgr.34427) 5661 : cluster [DBG] pgmap v3217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:58.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:58 gibba020 bash[25448]: cluster 2021-03-10T15:39:57.058203+0000 mgr.gibba020.yqfnwy (mgr.34427) 5662 : cluster [DBG] pgmap v3218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:58.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:58 gibba013 bash[29418]: cluster 2021-03-10T15:39:57.058203+0000 mgr.gibba020.yqfnwy (mgr.34427) 5662 : cluster [DBG] pgmap v3218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:58.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:58 gibba013 bash[30381]: cluster 2021-03-10T15:39:57.058203+0000 mgr.gibba020.yqfnwy (mgr.34427) 5662 : cluster [DBG] pgmap v3218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:39:59.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:39:59 gibba020 bash[25448]: cephadm 2021-03-10T15:39:57.548612+0000 mgr.gibba020.yqfnwy (mgr.34427) 5663 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:39:59.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:39:59 gibba013 bash[29418]: cephadm 2021-03-10T15:39:57.548612+0000 mgr.gibba020.yqfnwy (mgr.34427) 5663 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:39:59.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:39:59 gibba013 bash[30381]: cephadm 2021-03-10T15:39:57.548612+0000 mgr.gibba020.yqfnwy (mgr.34427) 5663 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:40:00.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:00 gibba013 bash[29418]: debug 2021-03-10T15:39:59.996+0000 7fd718a82700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:40:00.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:00 gibba013 bash[29418]: cluster 2021-03-10T15:39:59.059728+0000 mgr.gibba020.yqfnwy (mgr.34427) 5664 : cluster [DBG] pgmap v3219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:00.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:00 gibba013 bash[29418]: cluster 2021-03-10T15:40:00.000314+0000 mon.a (mon.0) 2263 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:40:00.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:00 gibba013 bash[30381]: cluster 2021-03-10T15:39:59.059728+0000 mgr.gibba020.yqfnwy (mgr.34427) 5664 : cluster [DBG] pgmap v3219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:00.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:00 gibba013 bash[30381]: cluster 2021-03-10T15:40:00.000314+0000 mon.a (mon.0) 2263 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:40:00.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:00 gibba020 bash[25448]: cluster 2021-03-10T15:39:59.059728+0000 mgr.gibba020.yqfnwy (mgr.34427) 5664 : cluster [DBG] pgmap v3219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:00.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:00 gibba020 bash[25448]: cluster 2021-03-10T15:40:00.000314+0000 mon.a (mon.0) 2263 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:40:02.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:02 gibba020 bash[25448]: cluster 2021-03-10T15:40:01.061325+0000 mgr.gibba020.yqfnwy (mgr.34427) 5665 : cluster [DBG] pgmap v3220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:02.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:02 gibba013 bash[29418]: cluster 2021-03-10T15:40:01.061325+0000 mgr.gibba020.yqfnwy (mgr.34427) 5665 : cluster [DBG] pgmap v3220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:02.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:02 gibba013 bash[30381]: cluster 2021-03-10T15:40:01.061325+0000 mgr.gibba020.yqfnwy (mgr.34427) 5665 : cluster [DBG] pgmap v3220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:04.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:03 gibba013 bash[29418]: cluster 2021-03-10T15:40:03.061841+0000 mgr.gibba020.yqfnwy (mgr.34427) 5666 : cluster [DBG] pgmap v3221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:04.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:03 gibba013 bash[30381]: cluster 2021-03-10T15:40:03.061841+0000 mgr.gibba020.yqfnwy (mgr.34427) 5666 : cluster [DBG] pgmap v3221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:04.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:03 gibba020 bash[25448]: cluster 2021-03-10T15:40:03.061841+0000 mgr.gibba020.yqfnwy (mgr.34427) 5666 : cluster [DBG] pgmap v3221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:06.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:06 gibba013 bash[29418]: cluster 2021-03-10T15:40:05.064379+0000 mgr.gibba020.yqfnwy (mgr.34427) 5667 : cluster [DBG] pgmap v3222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:06.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:06 gibba013 bash[30381]: cluster 2021-03-10T15:40:05.064379+0000 mgr.gibba020.yqfnwy (mgr.34427) 5667 : cluster [DBG] pgmap v3222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:06.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:06 gibba020 bash[25448]: cluster 2021-03-10T15:40:05.064379+0000 mgr.gibba020.yqfnwy (mgr.34427) 5667 : cluster [DBG] pgmap v3222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:07.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:07 gibba020 bash[25448]: audit 2021-03-10T15:40:06.510882+0000 mon.a (mon.0) 2264 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:40:07.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:07 gibba020 bash[25448]: audit 2021-03-10T15:40:06.589412+0000 mon.a (mon.0) 2265 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:40:07.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:07 gibba020 bash[25448]: audit 2021-03-10T15:40:06.699854+0000 mon.a (mon.0) 2266 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:40:07.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:07 gibba020 bash[25448]: audit 2021-03-10T15:40:06.700571+0000 mon.a (mon.0) 2267 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:40:07.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:07 gibba020 bash[25448]: audit 2021-03-10T15:40:06.701244+0000 mon.a (mon.0) 2268 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:40:07.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:07 gibba020 bash[25448]: audit 2021-03-10T15:40:06.701846+0000 mon.a (mon.0) 2269 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:40:07.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:07 gibba013 bash[29418]: audit 2021-03-10T15:40:06.510882+0000 mon.a (mon.0) 2264 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:40:07.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:07 gibba013 bash[29418]: audit 2021-03-10T15:40:06.589412+0000 mon.a (mon.0) 2265 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:40:07.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:07 gibba013 bash[29418]: audit 2021-03-10T15:40:06.699854+0000 mon.a (mon.0) 2266 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:40:07.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:07 gibba013 bash[29418]: audit 2021-03-10T15:40:06.700571+0000 mon.a (mon.0) 2267 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:40:07.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:07 gibba013 bash[29418]: audit 2021-03-10T15:40:06.701244+0000 mon.a (mon.0) 2268 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:40:07.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:07 gibba013 bash[29418]: audit 2021-03-10T15:40:06.701846+0000 mon.a (mon.0) 2269 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:40:07.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:07 gibba013 bash[30381]: audit 2021-03-10T15:40:06.510882+0000 mon.a (mon.0) 2264 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:40:07.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:07 gibba013 bash[30381]: audit 2021-03-10T15:40:06.589412+0000 mon.a (mon.0) 2265 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:40:07.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:07 gibba013 bash[30381]: audit 2021-03-10T15:40:06.699854+0000 mon.a (mon.0) 2266 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T15:40:07.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:07 gibba013 bash[30381]: audit 2021-03-10T15:40:06.700571+0000 mon.a (mon.0) 2267 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:40:07.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:07 gibba013 bash[30381]: audit 2021-03-10T15:40:06.701244+0000 mon.a (mon.0) 2268 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:40:07.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:07 gibba013 bash[30381]: audit 2021-03-10T15:40:06.701846+0000 mon.a (mon.0) 2269 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:40:08.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:08 gibba020 bash[25448]: cluster 2021-03-10T15:40:07.065900+0000 mgr.gibba020.yqfnwy (mgr.34427) 5668 : cluster [DBG] pgmap v3223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:08.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:08 gibba013 bash[29418]: cluster 2021-03-10T15:40:07.065900+0000 mgr.gibba020.yqfnwy (mgr.34427) 5668 : cluster [DBG] pgmap v3223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:08.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:08 gibba013 bash[30381]: cluster 2021-03-10T15:40:07.065900+0000 mgr.gibba020.yqfnwy (mgr.34427) 5668 : cluster [DBG] pgmap v3223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:10.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:10 gibba020 bash[25448]: cluster 2021-03-10T15:40:09.067596+0000 mgr.gibba020.yqfnwy (mgr.34427) 5669 : cluster [DBG] pgmap v3224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:10.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:10 gibba013 bash[29418]: cluster 2021-03-10T15:40:09.067596+0000 mgr.gibba020.yqfnwy (mgr.34427) 5669 : cluster [DBG] pgmap v3224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:10.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:10 gibba013 bash[30381]: cluster 2021-03-10T15:40:09.067596+0000 mgr.gibba020.yqfnwy (mgr.34427) 5669 : cluster [DBG] pgmap v3224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:12.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:12 gibba020 bash[25448]: cluster 2021-03-10T15:40:11.069302+0000 mgr.gibba020.yqfnwy (mgr.34427) 5670 : cluster [DBG] pgmap v3225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:12.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:12 gibba013 bash[29418]: cluster 2021-03-10T15:40:11.069302+0000 mgr.gibba020.yqfnwy (mgr.34427) 5670 : cluster [DBG] pgmap v3225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:12.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:12 gibba013 bash[30381]: cluster 2021-03-10T15:40:11.069302+0000 mgr.gibba020.yqfnwy (mgr.34427) 5670 : cluster [DBG] pgmap v3225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:14.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:13 gibba013 bash[29418]: cephadm 2021-03-10T15:40:12.564699+0000 mgr.gibba020.yqfnwy (mgr.34427) 5671 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:40:14.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:13 gibba013 bash[29418]: cluster 2021-03-10T15:40:13.069833+0000 mgr.gibba020.yqfnwy (mgr.34427) 5672 : cluster [DBG] pgmap v3226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:14.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:13 gibba013 bash[30381]: cephadm 2021-03-10T15:40:12.564699+0000 mgr.gibba020.yqfnwy (mgr.34427) 5671 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:40:14.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:13 gibba013 bash[30381]: cluster 2021-03-10T15:40:13.069833+0000 mgr.gibba020.yqfnwy (mgr.34427) 5672 : cluster [DBG] pgmap v3226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:14.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:13 gibba020 bash[25448]: cephadm 2021-03-10T15:40:12.564699+0000 mgr.gibba020.yqfnwy (mgr.34427) 5671 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:40:14.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:13 gibba020 bash[25448]: cluster 2021-03-10T15:40:13.069833+0000 mgr.gibba020.yqfnwy (mgr.34427) 5672 : cluster [DBG] pgmap v3226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:16.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:16 gibba020 bash[25448]: cluster 2021-03-10T15:40:15.071516+0000 mgr.gibba020.yqfnwy (mgr.34427) 5673 : cluster [DBG] pgmap v3227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:16.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:16 gibba013 bash[29418]: cluster 2021-03-10T15:40:15.071516+0000 mgr.gibba020.yqfnwy (mgr.34427) 5673 : cluster [DBG] pgmap v3227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:16.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:16 gibba013 bash[30381]: cluster 2021-03-10T15:40:15.071516+0000 mgr.gibba020.yqfnwy (mgr.34427) 5673 : cluster [DBG] pgmap v3227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:18.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:18 gibba020 bash[25448]: cluster 2021-03-10T15:40:17.073051+0000 mgr.gibba020.yqfnwy (mgr.34427) 5674 : cluster [DBG] pgmap v3228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:18.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:18 gibba013 bash[30381]: cluster 2021-03-10T15:40:17.073051+0000 mgr.gibba020.yqfnwy (mgr.34427) 5674 : cluster [DBG] pgmap v3228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:18.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:18 gibba013 bash[29418]: cluster 2021-03-10T15:40:17.073051+0000 mgr.gibba020.yqfnwy (mgr.34427) 5674 : cluster [DBG] pgmap v3228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:20.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:20 gibba020 bash[25448]: cluster 2021-03-10T15:40:19.074450+0000 mgr.gibba020.yqfnwy (mgr.34427) 5675 : cluster [DBG] pgmap v3229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:20.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:20 gibba013 bash[29418]: cluster 2021-03-10T15:40:19.074450+0000 mgr.gibba020.yqfnwy (mgr.34427) 5675 : cluster [DBG] pgmap v3229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:20.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:20 gibba013 bash[30381]: cluster 2021-03-10T15:40:19.074450+0000 mgr.gibba020.yqfnwy (mgr.34427) 5675 : cluster [DBG] pgmap v3229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:22.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:22 gibba020 bash[25448]: cluster 2021-03-10T15:40:21.075250+0000 mgr.gibba020.yqfnwy (mgr.34427) 5676 : cluster [DBG] pgmap v3230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:22.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:22 gibba013 bash[29418]: cluster 2021-03-10T15:40:21.075250+0000 mgr.gibba020.yqfnwy (mgr.34427) 5676 : cluster [DBG] pgmap v3230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:22.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:22 gibba013 bash[30381]: cluster 2021-03-10T15:40:21.075250+0000 mgr.gibba020.yqfnwy (mgr.34427) 5676 : cluster [DBG] pgmap v3230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:23.087 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:40:23.318 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:40:23.319 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (106m) 55s ago 112m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:40:23.319 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (112m) 10m ago 112m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:40:23.319 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (107m) 10m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:40:23.319 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (107m) 10m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:40:23.319 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (106m) 55s ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:40:23.320 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (106m) 55s ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:40:23.320 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (105m) 10m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:40:23.320 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (106m) 55s ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:40:23.320 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (112m) 55s ago 112m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:40:23.321 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (112m) 10m ago 112m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:40:23.321 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (105m) 55s ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:40:23.321 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (104m) 55s ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:40:23.321 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (104m) 55s ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:40:23.322 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (103m) 55s ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:40:23.322 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (103m) 10m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:40:23.322 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (103m) 10m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:40:23.322 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (102m) 10m ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:40:23.323 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (102m) 10m ago 112m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:40:23.323 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (111m) 10m ago 112m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:40:23.323 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 10m ago 110m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:40:23.565 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:40:23.565 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:40:23.566 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:40:23.566 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:40:23.566 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:40:23.566 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:40:23.567 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:40:23.567 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:40:23.567 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:40:23.567 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:40:23.567 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:40:23.568 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:40:23.568 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:40:23.568 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:40:23.568 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:40:24.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:23 gibba013 bash[29418]: audit 2021-03-10T15:40:23.073848+0000 mgr.gibba020.yqfnwy (mgr.34427) 5677 : audit [DBG] from='client.47868 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:40:24.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:23 gibba013 bash[29418]: cluster 2021-03-10T15:40:23.075709+0000 mgr.gibba020.yqfnwy (mgr.34427) 5678 : cluster [DBG] pgmap v3231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:24.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:23 gibba013 bash[29418]: audit 2021-03-10T15:40:23.300919+0000 mgr.gibba020.yqfnwy (mgr.34427) 5679 : audit [DBG] from='client.47874 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:40:24.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:23 gibba013 bash[29418]: audit 2021-03-10T15:40:23.561263+0000 mon.c (mon.1) 92 : audit [DBG] from='client.? 172.21.2.113:0/3192267646' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:24.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:23 gibba013 bash[30381]: audit 2021-03-10T15:40:23.073848+0000 mgr.gibba020.yqfnwy (mgr.34427) 5677 : audit [DBG] from='client.47868 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:40:24.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:23 gibba013 bash[30381]: cluster 2021-03-10T15:40:23.075709+0000 mgr.gibba020.yqfnwy (mgr.34427) 5678 : cluster [DBG] pgmap v3231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:24.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:23 gibba013 bash[30381]: audit 2021-03-10T15:40:23.300919+0000 mgr.gibba020.yqfnwy (mgr.34427) 5679 : audit [DBG] from='client.47874 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:40:24.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:23 gibba013 bash[30381]: audit 2021-03-10T15:40:23.561263+0000 mon.c (mon.1) 92 : audit [DBG] from='client.? 172.21.2.113:0/3192267646' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:24.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:23 gibba020 bash[25448]: audit 2021-03-10T15:40:23.073848+0000 mgr.gibba020.yqfnwy (mgr.34427) 5677 : audit [DBG] from='client.47868 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:40:24.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:23 gibba020 bash[25448]: cluster 2021-03-10T15:40:23.075709+0000 mgr.gibba020.yqfnwy (mgr.34427) 5678 : cluster [DBG] pgmap v3231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:24.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:23 gibba020 bash[25448]: audit 2021-03-10T15:40:23.300919+0000 mgr.gibba020.yqfnwy (mgr.34427) 5679 : audit [DBG] from='client.47874 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:40:24.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:23 gibba020 bash[25448]: audit 2021-03-10T15:40:23.561263+0000 mon.c (mon.1) 92 : audit [DBG] from='client.? 172.21.2.113:0/3192267646' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:26.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:26 gibba020 bash[25448]: cluster 2021-03-10T15:40:25.077262+0000 mgr.gibba020.yqfnwy (mgr.34427) 5680 : cluster [DBG] pgmap v3232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:26.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:26 gibba013 bash[29418]: cluster 2021-03-10T15:40:25.077262+0000 mgr.gibba020.yqfnwy (mgr.34427) 5680 : cluster [DBG] pgmap v3232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:26.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:26 gibba013 bash[30381]: cluster 2021-03-10T15:40:25.077262+0000 mgr.gibba020.yqfnwy (mgr.34427) 5680 : cluster [DBG] pgmap v3232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:28.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:28 gibba020 bash[25448]: cluster 2021-03-10T15:40:27.078858+0000 mgr.gibba020.yqfnwy (mgr.34427) 5681 : cluster [DBG] pgmap v3233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:28.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:28 gibba020 bash[25448]: audit 2021-03-10T15:40:27.582467+0000 mon.a (mon.0) 2270 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:40:28.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:28 gibba020 bash[25448]: audit 2021-03-10T15:40:27.589912+0000 mon.a (mon.0) 2271 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:40:28.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:28 gibba013 bash[29418]: cluster 2021-03-10T15:40:27.078858+0000 mgr.gibba020.yqfnwy (mgr.34427) 5681 : cluster [DBG] pgmap v3233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:28.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:28 gibba013 bash[29418]: audit 2021-03-10T15:40:27.582467+0000 mon.a (mon.0) 2270 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:40:28.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:28 gibba013 bash[29418]: audit 2021-03-10T15:40:27.589912+0000 mon.a (mon.0) 2271 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:40:28.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:28 gibba013 bash[30381]: cluster 2021-03-10T15:40:27.078858+0000 mgr.gibba020.yqfnwy (mgr.34427) 5681 : cluster [DBG] pgmap v3233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:28.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:28 gibba013 bash[30381]: audit 2021-03-10T15:40:27.582467+0000 mon.a (mon.0) 2270 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:40:28.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:28 gibba013 bash[30381]: audit 2021-03-10T15:40:27.589912+0000 mon.a (mon.0) 2271 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:40:29.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:29 gibba020 bash[25448]: cephadm 2021-03-10T15:40:27.587198+0000 mgr.gibba020.yqfnwy (mgr.34427) 5682 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:40:29.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:29 gibba013 bash[29418]: cephadm 2021-03-10T15:40:27.587198+0000 mgr.gibba020.yqfnwy (mgr.34427) 5682 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:40:29.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:29 gibba013 bash[30381]: cephadm 2021-03-10T15:40:27.587198+0000 mgr.gibba020.yqfnwy (mgr.34427) 5682 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:40:30.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:30 gibba020 bash[25448]: cluster 2021-03-10T15:40:29.079565+0000 mgr.gibba020.yqfnwy (mgr.34427) 5683 : cluster [DBG] pgmap v3234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:30.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:30 gibba013 bash[29418]: cluster 2021-03-10T15:40:29.079565+0000 mgr.gibba020.yqfnwy (mgr.34427) 5683 : cluster [DBG] pgmap v3234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:30.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:30 gibba013 bash[30381]: cluster 2021-03-10T15:40:29.079565+0000 mgr.gibba020.yqfnwy (mgr.34427) 5683 : cluster [DBG] pgmap v3234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:32.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:32 gibba020 bash[25448]: cluster 2021-03-10T15:40:31.080025+0000 mgr.gibba020.yqfnwy (mgr.34427) 5684 : cluster [DBG] pgmap v3235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:32.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:32 gibba020 bash[25448]: cephadm 2021-03-10T15:40:31.438897+0000 mgr.gibba020.yqfnwy (mgr.34427) 5685 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:40:32.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:32 gibba020 bash[25448]: audit 2021-03-10T15:40:31.438922+0000 mon.a (mon.0) 2272 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:40:32.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:32 gibba020 bash[25448]: audit 2021-03-10T15:40:31.631639+0000 mon.a (mon.0) 2273 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:40:32.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:32 gibba020 bash[25448]: audit 2021-03-10T15:40:31.635334+0000 mon.a (mon.0) 2274 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:40:32.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:32 gibba020 bash[25448]: audit 2021-03-10T15:40:31.636737+0000 mon.a (mon.0) 2275 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:32.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:32 gibba020 bash[25448]: audit 2021-03-10T15:40:31.638354+0000 mon.a (mon.0) 2276 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:32.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:32 gibba020 bash[25448]: audit 2021-03-10T15:40:31.640521+0000 mon.a (mon.0) 2277 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:32.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:32 gibba020 bash[25448]: audit 2021-03-10T15:40:31.645877+0000 mon.a (mon.0) 2278 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:32.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:32 gibba020 bash[25448]: audit 2021-03-10T15:40:31.648739+0000 mon.a (mon.0) 2279 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:32.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:32 gibba013 bash[29418]: cluster 2021-03-10T15:40:31.080025+0000 mgr.gibba020.yqfnwy (mgr.34427) 5684 : cluster [DBG] pgmap v3235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:32.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:32 gibba013 bash[29418]: cephadm 2021-03-10T15:40:31.438897+0000 mgr.gibba020.yqfnwy (mgr.34427) 5685 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:40:32.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:32 gibba013 bash[29418]: audit 2021-03-10T15:40:31.438922+0000 mon.a (mon.0) 2272 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:40:32.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:32 gibba013 bash[29418]: audit 2021-03-10T15:40:31.631639+0000 mon.a (mon.0) 2273 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:40:32.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:32 gibba013 bash[29418]: audit 2021-03-10T15:40:31.635334+0000 mon.a (mon.0) 2274 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:40:32.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:32 gibba013 bash[29418]: audit 2021-03-10T15:40:31.636737+0000 mon.a (mon.0) 2275 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:32.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:32 gibba013 bash[29418]: audit 2021-03-10T15:40:31.638354+0000 mon.a (mon.0) 2276 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:32.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:32 gibba013 bash[29418]: audit 2021-03-10T15:40:31.640521+0000 mon.a (mon.0) 2277 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:32.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:32 gibba013 bash[29418]: audit 2021-03-10T15:40:31.645877+0000 mon.a (mon.0) 2278 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:32.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:32 gibba013 bash[29418]: audit 2021-03-10T15:40:31.648739+0000 mon.a (mon.0) 2279 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:32.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:32 gibba013 bash[30381]: cluster 2021-03-10T15:40:31.080025+0000 mgr.gibba020.yqfnwy (mgr.34427) 5684 : cluster [DBG] pgmap v3235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:32.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:32 gibba013 bash[30381]: cephadm 2021-03-10T15:40:31.438897+0000 mgr.gibba020.yqfnwy (mgr.34427) 5685 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:40:32.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:32 gibba013 bash[30381]: audit 2021-03-10T15:40:31.438922+0000 mon.a (mon.0) 2272 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:40:32.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:32 gibba013 bash[30381]: audit 2021-03-10T15:40:31.631639+0000 mon.a (mon.0) 2273 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:40:32.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:32 gibba013 bash[30381]: audit 2021-03-10T15:40:31.635334+0000 mon.a (mon.0) 2274 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:40:32.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:32 gibba013 bash[30381]: audit 2021-03-10T15:40:31.636737+0000 mon.a (mon.0) 2275 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:32.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:32 gibba013 bash[30381]: audit 2021-03-10T15:40:31.638354+0000 mon.a (mon.0) 2276 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:32.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:32 gibba013 bash[30381]: audit 2021-03-10T15:40:31.640521+0000 mon.a (mon.0) 2277 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:32.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:32 gibba013 bash[30381]: audit 2021-03-10T15:40:31.645877+0000 mon.a (mon.0) 2278 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:32.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:32 gibba013 bash[30381]: audit 2021-03-10T15:40:31.648739+0000 mon.a (mon.0) 2279 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:33.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:33 gibba020 bash[25448]: cephadm 2021-03-10T15:40:31.633824+0000 mgr.gibba020.yqfnwy (mgr.34427) 5686 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:40:33.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:33 gibba020 bash[25448]: cephadm 2021-03-10T15:40:31.635592+0000 mgr.gibba020.yqfnwy (mgr.34427) 5687 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:40:33.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:33 gibba020 bash[25448]: cephadm 2021-03-10T15:40:31.636876+0000 mgr.gibba020.yqfnwy (mgr.34427) 5688 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:40:33.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:33 gibba020 bash[25448]: cephadm 2021-03-10T15:40:31.636910+0000 mgr.gibba020.yqfnwy (mgr.34427) 5689 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:40:33.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:33 gibba020 bash[25448]: cephadm 2021-03-10T15:40:31.639153+0000 mgr.gibba020.yqfnwy (mgr.34427) 5690 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:40:33.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:33 gibba020 bash[25448]: cephadm 2021-03-10T15:40:31.639189+0000 mgr.gibba020.yqfnwy (mgr.34427) 5691 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:40:33.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:33 gibba020 bash[25448]: cephadm 2021-03-10T15:40:31.642115+0000 mgr.gibba020.yqfnwy (mgr.34427) 5692 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:40:33.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:33 gibba020 bash[25448]: cephadm 2021-03-10T15:40:31.644422+0000 mgr.gibba020.yqfnwy (mgr.34427) 5693 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:40:33.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:33 gibba020 bash[25448]: cephadm 2021-03-10T15:40:31.644457+0000 mgr.gibba020.yqfnwy (mgr.34427) 5694 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:40:33.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:33 gibba020 bash[25448]: cephadm 2021-03-10T15:40:31.646983+0000 mgr.gibba020.yqfnwy (mgr.34427) 5695 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:40:33.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:33 gibba020 bash[25448]: cephadm 2021-03-10T15:40:31.647393+0000 mgr.gibba020.yqfnwy (mgr.34427) 5696 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:40:33.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:33 gibba020 bash[25448]: cephadm 2021-03-10T15:40:31.650226+0000 mgr.gibba020.yqfnwy (mgr.34427) 5697 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:40:33.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:33 gibba020 bash[25448]: cephadm 2021-03-10T15:40:31.650267+0000 mgr.gibba020.yqfnwy (mgr.34427) 5698 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:40:33.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:33 gibba020 bash[25448]: cephadm 2021-03-10T15:40:31.650392+0000 mgr.gibba020.yqfnwy (mgr.34427) 5699 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:40:33.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:33 gibba013 bash[29418]: cephadm 2021-03-10T15:40:31.633824+0000 mgr.gibba020.yqfnwy (mgr.34427) 5686 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:40:33.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:33 gibba013 bash[29418]: cephadm 2021-03-10T15:40:31.635592+0000 mgr.gibba020.yqfnwy (mgr.34427) 5687 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:40:33.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:33 gibba013 bash[29418]: cephadm 2021-03-10T15:40:31.636876+0000 mgr.gibba020.yqfnwy (mgr.34427) 5688 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:40:33.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:33 gibba013 bash[29418]: cephadm 2021-03-10T15:40:31.636910+0000 mgr.gibba020.yqfnwy (mgr.34427) 5689 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:40:33.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:33 gibba013 bash[29418]: cephadm 2021-03-10T15:40:31.639153+0000 mgr.gibba020.yqfnwy (mgr.34427) 5690 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:40:33.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:33 gibba013 bash[29418]: cephadm 2021-03-10T15:40:31.639189+0000 mgr.gibba020.yqfnwy (mgr.34427) 5691 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:40:33.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:33 gibba013 bash[29418]: cephadm 2021-03-10T15:40:31.642115+0000 mgr.gibba020.yqfnwy (mgr.34427) 5692 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:40:33.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:33 gibba013 bash[29418]: cephadm 2021-03-10T15:40:31.644422+0000 mgr.gibba020.yqfnwy (mgr.34427) 5693 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:40:33.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:33 gibba013 bash[29418]: cephadm 2021-03-10T15:40:31.644457+0000 mgr.gibba020.yqfnwy (mgr.34427) 5694 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:40:33.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:33 gibba013 bash[29418]: cephadm 2021-03-10T15:40:31.646983+0000 mgr.gibba020.yqfnwy (mgr.34427) 5695 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:40:33.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:33 gibba013 bash[29418]: cephadm 2021-03-10T15:40:31.647393+0000 mgr.gibba020.yqfnwy (mgr.34427) 5696 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:40:33.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:33 gibba013 bash[29418]: cephadm 2021-03-10T15:40:31.650226+0000 mgr.gibba020.yqfnwy (mgr.34427) 5697 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:40:33.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:33 gibba013 bash[29418]: cephadm 2021-03-10T15:40:31.650267+0000 mgr.gibba020.yqfnwy (mgr.34427) 5698 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:40:33.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:33 gibba013 bash[29418]: cephadm 2021-03-10T15:40:31.650392+0000 mgr.gibba020.yqfnwy (mgr.34427) 5699 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:40:33.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:33 gibba013 bash[30381]: cephadm 2021-03-10T15:40:31.633824+0000 mgr.gibba020.yqfnwy (mgr.34427) 5686 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:40:33.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:33 gibba013 bash[30381]: cephadm 2021-03-10T15:40:31.635592+0000 mgr.gibba020.yqfnwy (mgr.34427) 5687 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:40:33.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:33 gibba013 bash[30381]: cephadm 2021-03-10T15:40:31.636876+0000 mgr.gibba020.yqfnwy (mgr.34427) 5688 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:40:33.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:33 gibba013 bash[30381]: cephadm 2021-03-10T15:40:31.636910+0000 mgr.gibba020.yqfnwy (mgr.34427) 5689 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:40:33.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:33 gibba013 bash[30381]: cephadm 2021-03-10T15:40:31.639153+0000 mgr.gibba020.yqfnwy (mgr.34427) 5690 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:40:33.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:33 gibba013 bash[30381]: cephadm 2021-03-10T15:40:31.639189+0000 mgr.gibba020.yqfnwy (mgr.34427) 5691 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:40:33.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:33 gibba013 bash[30381]: cephadm 2021-03-10T15:40:31.642115+0000 mgr.gibba020.yqfnwy (mgr.34427) 5692 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:40:33.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:33 gibba013 bash[30381]: cephadm 2021-03-10T15:40:31.644422+0000 mgr.gibba020.yqfnwy (mgr.34427) 5693 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:40:33.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:33 gibba013 bash[30381]: cephadm 2021-03-10T15:40:31.644457+0000 mgr.gibba020.yqfnwy (mgr.34427) 5694 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:40:33.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:33 gibba013 bash[30381]: cephadm 2021-03-10T15:40:31.646983+0000 mgr.gibba020.yqfnwy (mgr.34427) 5695 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:40:33.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:33 gibba013 bash[30381]: cephadm 2021-03-10T15:40:31.647393+0000 mgr.gibba020.yqfnwy (mgr.34427) 5696 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:40:33.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:33 gibba013 bash[30381]: cephadm 2021-03-10T15:40:31.650226+0000 mgr.gibba020.yqfnwy (mgr.34427) 5697 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:40:33.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:33 gibba013 bash[30381]: cephadm 2021-03-10T15:40:31.650267+0000 mgr.gibba020.yqfnwy (mgr.34427) 5698 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:40:33.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:33 gibba013 bash[30381]: cephadm 2021-03-10T15:40:31.650392+0000 mgr.gibba020.yqfnwy (mgr.34427) 5699 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:40:34.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:34 gibba013 bash[29418]: cluster 2021-03-10T15:40:33.081280+0000 mgr.gibba020.yqfnwy (mgr.34427) 5700 : cluster [DBG] pgmap v3236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:34.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:34 gibba013 bash[30381]: cluster 2021-03-10T15:40:33.081280+0000 mgr.gibba020.yqfnwy (mgr.34427) 5700 : cluster [DBG] pgmap v3236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:34.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:34 gibba020 bash[25448]: cluster 2021-03-10T15:40:33.081280+0000 mgr.gibba020.yqfnwy (mgr.34427) 5700 : cluster [DBG] pgmap v3236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:36.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:36 gibba013 bash[29418]: cluster 2021-03-10T15:40:35.082903+0000 mgr.gibba020.yqfnwy (mgr.34427) 5701 : cluster [DBG] pgmap v3237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:36.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:36 gibba013 bash[30381]: cluster 2021-03-10T15:40:35.082903+0000 mgr.gibba020.yqfnwy (mgr.34427) 5701 : cluster [DBG] pgmap v3237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:36.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:36 gibba020 bash[25448]: cluster 2021-03-10T15:40:35.082903+0000 mgr.gibba020.yqfnwy (mgr.34427) 5701 : cluster [DBG] pgmap v3237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:38.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:38 gibba013 bash[29418]: cluster 2021-03-10T15:40:37.083632+0000 mgr.gibba020.yqfnwy (mgr.34427) 5702 : cluster [DBG] pgmap v3238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:38.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:38 gibba013 bash[30381]: cluster 2021-03-10T15:40:37.083632+0000 mgr.gibba020.yqfnwy (mgr.34427) 5702 : cluster [DBG] pgmap v3238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:38.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:38 gibba020 bash[25448]: cluster 2021-03-10T15:40:37.083632+0000 mgr.gibba020.yqfnwy (mgr.34427) 5702 : cluster [DBG] pgmap v3238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:40.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:40 gibba013 bash[29418]: cluster 2021-03-10T15:40:39.085120+0000 mgr.gibba020.yqfnwy (mgr.34427) 5703 : cluster [DBG] pgmap v3239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:40.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:40 gibba013 bash[30381]: cluster 2021-03-10T15:40:39.085120+0000 mgr.gibba020.yqfnwy (mgr.34427) 5703 : cluster [DBG] pgmap v3239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:40.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:40 gibba020 bash[25448]: cluster 2021-03-10T15:40:39.085120+0000 mgr.gibba020.yqfnwy (mgr.34427) 5703 : cluster [DBG] pgmap v3239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:42.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:42 gibba013 bash[29418]: cluster 2021-03-10T15:40:41.086556+0000 mgr.gibba020.yqfnwy (mgr.34427) 5704 : cluster [DBG] pgmap v3240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:42.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:42 gibba013 bash[30381]: cluster 2021-03-10T15:40:41.086556+0000 mgr.gibba020.yqfnwy (mgr.34427) 5704 : cluster [DBG] pgmap v3240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:42.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:42 gibba020 bash[25448]: cluster 2021-03-10T15:40:41.086556+0000 mgr.gibba020.yqfnwy (mgr.34427) 5704 : cluster [DBG] pgmap v3240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:44.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:43 gibba013 bash[29418]: cluster 2021-03-10T15:40:43.088004+0000 mgr.gibba020.yqfnwy (mgr.34427) 5705 : cluster [DBG] pgmap v3241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:44.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:43 gibba013 bash[30381]: cluster 2021-03-10T15:40:43.088004+0000 mgr.gibba020.yqfnwy (mgr.34427) 5705 : cluster [DBG] pgmap v3241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:44.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:43 gibba020 bash[25448]: cluster 2021-03-10T15:40:43.088004+0000 mgr.gibba020.yqfnwy (mgr.34427) 5705 : cluster [DBG] pgmap v3241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:46.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:46 gibba020 bash[25448]: cluster 2021-03-10T15:40:45.088615+0000 mgr.gibba020.yqfnwy (mgr.34427) 5706 : cluster [DBG] pgmap v3242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:46.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:46 gibba013 bash[30381]: cluster 2021-03-10T15:40:45.088615+0000 mgr.gibba020.yqfnwy (mgr.34427) 5706 : cluster [DBG] pgmap v3242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:46.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:46 gibba013 bash[29418]: cluster 2021-03-10T15:40:45.088615+0000 mgr.gibba020.yqfnwy (mgr.34427) 5706 : cluster [DBG] pgmap v3242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:48.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:48 gibba020 bash[25448]: cephadm 2021-03-10T15:40:46.666463+0000 mgr.gibba020.yqfnwy (mgr.34427) 5707 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:40:48.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:48 gibba020 bash[25448]: cluster 2021-03-10T15:40:47.089866+0000 mgr.gibba020.yqfnwy (mgr.34427) 5708 : cluster [DBG] pgmap v3243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:48.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:48 gibba013 bash[29418]: cephadm 2021-03-10T15:40:46.666463+0000 mgr.gibba020.yqfnwy (mgr.34427) 5707 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:40:48.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:48 gibba013 bash[29418]: cluster 2021-03-10T15:40:47.089866+0000 mgr.gibba020.yqfnwy (mgr.34427) 5708 : cluster [DBG] pgmap v3243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:48.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:48 gibba013 bash[30381]: cephadm 2021-03-10T15:40:46.666463+0000 mgr.gibba020.yqfnwy (mgr.34427) 5707 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:40:48.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:48 gibba013 bash[30381]: cluster 2021-03-10T15:40:47.089866+0000 mgr.gibba020.yqfnwy (mgr.34427) 5708 : cluster [DBG] pgmap v3243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:50.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:50 gibba020 bash[25448]: cluster 2021-03-10T15:40:49.091508+0000 mgr.gibba020.yqfnwy (mgr.34427) 5709 : cluster [DBG] pgmap v3244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:50.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:50 gibba013 bash[29418]: cluster 2021-03-10T15:40:49.091508+0000 mgr.gibba020.yqfnwy (mgr.34427) 5709 : cluster [DBG] pgmap v3244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:50.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:50 gibba013 bash[30381]: cluster 2021-03-10T15:40:49.091508+0000 mgr.gibba020.yqfnwy (mgr.34427) 5709 : cluster [DBG] pgmap v3244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:52.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:52 gibba020 bash[25448]: cluster 2021-03-10T15:40:51.093177+0000 mgr.gibba020.yqfnwy (mgr.34427) 5710 : cluster [DBG] pgmap v3245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:52.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:52 gibba013 bash[29418]: cluster 2021-03-10T15:40:51.093177+0000 mgr.gibba020.yqfnwy (mgr.34427) 5710 : cluster [DBG] pgmap v3245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:52.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:52 gibba013 bash[30381]: cluster 2021-03-10T15:40:51.093177+0000 mgr.gibba020.yqfnwy (mgr.34427) 5710 : cluster [DBG] pgmap v3245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:53.810 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:40:54.040 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:40:54.041 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (107m) 86s ago 112m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:40:54.041 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (112m) 22s ago 112m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:40:54.041 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (107m) 22s ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:40:54.042 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (108m) 22s ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:40:54.042 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (107m) 86s ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:40:54.042 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (106m) 86s ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:40:54.042 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (106m) 22s ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:40:54.043 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (106m) 86s ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:40:54.043 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (112m) 86s ago 112m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:40:54.043 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (112m) 22s ago 112m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:40:54.043 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (105m) 86s ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:40:54.043 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (105m) 86s ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:40:54.044 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (104m) 86s ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:40:54.044 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (104m) 86s ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:40:54.044 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (103m) 22s ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:40:54.044 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (103m) 22s ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:40:54.045 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (103m) 22s ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:40:54.045 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (102m) 22s ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:40:54.045 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (112m) 22s ago 112m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:40:54.045 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 22s ago 110m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:40:54.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:53 gibba013 bash[29418]: cluster 2021-03-10T15:40:53.094600+0000 mgr.gibba020.yqfnwy (mgr.34427) 5711 : cluster [DBG] pgmap v3246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:54.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:53 gibba013 bash[30381]: cluster 2021-03-10T15:40:53.094600+0000 mgr.gibba020.yqfnwy (mgr.34427) 5711 : cluster [DBG] pgmap v3246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:54.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:53 gibba020 bash[25448]: cluster 2021-03-10T15:40:53.094600+0000 mgr.gibba020.yqfnwy (mgr.34427) 5711 : cluster [DBG] pgmap v3246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:54.297 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:40:54.298 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:40:54.298 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:40:54.298 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:40:54.298 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:40:54.299 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:40:54.299 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:40:54.299 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:40:54.299 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:40:54.299 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:40:54.300 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:40:54.300 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:40:54.300 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:40:54.301 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:40:54.301 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:40:55.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:54 gibba013 bash[29418]: audit 2021-03-10T15:40:53.796868+0000 mgr.gibba020.yqfnwy (mgr.34427) 5712 : audit [DBG] from='client.57871 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:40:55.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:54 gibba013 bash[29418]: audit 2021-03-10T15:40:54.023459+0000 mgr.gibba020.yqfnwy (mgr.34427) 5713 : audit [DBG] from='client.47892 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:40:55.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:54 gibba013 bash[29418]: audit 2021-03-10T15:40:54.293407+0000 mon.c (mon.1) 93 : audit [DBG] from='client.? 172.21.2.113:0/4252523731' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:55.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:54 gibba013 bash[30381]: audit 2021-03-10T15:40:53.796868+0000 mgr.gibba020.yqfnwy (mgr.34427) 5712 : audit [DBG] from='client.57871 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:40:55.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:54 gibba013 bash[30381]: audit 2021-03-10T15:40:54.023459+0000 mgr.gibba020.yqfnwy (mgr.34427) 5713 : audit [DBG] from='client.47892 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:40:55.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:54 gibba013 bash[30381]: audit 2021-03-10T15:40:54.293407+0000 mon.c (mon.1) 93 : audit [DBG] from='client.? 172.21.2.113:0/4252523731' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:55.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:54 gibba020 bash[25448]: audit 2021-03-10T15:40:53.796868+0000 mgr.gibba020.yqfnwy (mgr.34427) 5712 : audit [DBG] from='client.57871 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:40:55.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:54 gibba020 bash[25448]: audit 2021-03-10T15:40:54.023459+0000 mgr.gibba020.yqfnwy (mgr.34427) 5713 : audit [DBG] from='client.47892 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:40:55.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:54 gibba020 bash[25448]: audit 2021-03-10T15:40:54.293407+0000 mon.c (mon.1) 93 : audit [DBG] from='client.? 172.21.2.113:0/4252523731' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:40:56.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:55 gibba013 bash[29418]: cluster 2021-03-10T15:40:55.096443+0000 mgr.gibba020.yqfnwy (mgr.34427) 5714 : cluster [DBG] pgmap v3247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:56.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:55 gibba013 bash[30381]: cluster 2021-03-10T15:40:55.096443+0000 mgr.gibba020.yqfnwy (mgr.34427) 5714 : cluster [DBG] pgmap v3247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:56.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:55 gibba020 bash[25448]: cluster 2021-03-10T15:40:55.096443+0000 mgr.gibba020.yqfnwy (mgr.34427) 5714 : cluster [DBG] pgmap v3247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:58.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:40:58 gibba020 bash[25448]: cluster 2021-03-10T15:40:57.097859+0000 mgr.gibba020.yqfnwy (mgr.34427) 5715 : cluster [DBG] pgmap v3248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:58.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:40:58 gibba013 bash[29418]: cluster 2021-03-10T15:40:57.097859+0000 mgr.gibba020.yqfnwy (mgr.34427) 5715 : cluster [DBG] pgmap v3248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:40:58.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:40:58 gibba013 bash[30381]: cluster 2021-03-10T15:40:57.097859+0000 mgr.gibba020.yqfnwy (mgr.34427) 5715 : cluster [DBG] pgmap v3248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:00.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:00 gibba020 bash[25448]: cluster 2021-03-10T15:40:59.099519+0000 mgr.gibba020.yqfnwy (mgr.34427) 5716 : cluster [DBG] pgmap v3249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:00.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:00 gibba013 bash[29418]: cluster 2021-03-10T15:40:59.099519+0000 mgr.gibba020.yqfnwy (mgr.34427) 5716 : cluster [DBG] pgmap v3249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:00.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:00 gibba013 bash[30381]: cluster 2021-03-10T15:40:59.099519+0000 mgr.gibba020.yqfnwy (mgr.34427) 5716 : cluster [DBG] pgmap v3249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:02.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:02 gibba020 bash[25448]: cluster 2021-03-10T15:41:01.100969+0000 mgr.gibba020.yqfnwy (mgr.34427) 5717 : cluster [DBG] pgmap v3250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:02.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:02 gibba013 bash[29418]: cluster 2021-03-10T15:41:01.100969+0000 mgr.gibba020.yqfnwy (mgr.34427) 5717 : cluster [DBG] pgmap v3250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:02.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:02 gibba013 bash[30381]: cluster 2021-03-10T15:41:01.100969+0000 mgr.gibba020.yqfnwy (mgr.34427) 5717 : cluster [DBG] pgmap v3250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:03.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:03 gibba020 bash[25448]: cephadm 2021-03-10T15:41:01.679349+0000 mgr.gibba020.yqfnwy (mgr.34427) 5718 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:41:03.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:03 gibba013 bash[29418]: cephadm 2021-03-10T15:41:01.679349+0000 mgr.gibba020.yqfnwy (mgr.34427) 5718 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:41:03.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:03 gibba013 bash[30381]: cephadm 2021-03-10T15:41:01.679349+0000 mgr.gibba020.yqfnwy (mgr.34427) 5718 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:41:04.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:04 gibba020 bash[25448]: cluster 2021-03-10T15:41:03.102357+0000 mgr.gibba020.yqfnwy (mgr.34427) 5719 : cluster [DBG] pgmap v3251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:04.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:04 gibba013 bash[29418]: cluster 2021-03-10T15:41:03.102357+0000 mgr.gibba020.yqfnwy (mgr.34427) 5719 : cluster [DBG] pgmap v3251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:04.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:04 gibba013 bash[30381]: cluster 2021-03-10T15:41:03.102357+0000 mgr.gibba020.yqfnwy (mgr.34427) 5719 : cluster [DBG] pgmap v3251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:06.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:06 gibba020 bash[25448]: cluster 2021-03-10T15:41:05.104213+0000 mgr.gibba020.yqfnwy (mgr.34427) 5720 : cluster [DBG] pgmap v3252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:06.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:06 gibba013 bash[29418]: cluster 2021-03-10T15:41:05.104213+0000 mgr.gibba020.yqfnwy (mgr.34427) 5720 : cluster [DBG] pgmap v3252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:06.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:06 gibba013 bash[30381]: cluster 2021-03-10T15:41:05.104213+0000 mgr.gibba020.yqfnwy (mgr.34427) 5720 : cluster [DBG] pgmap v3252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:07.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:07 gibba013 bash[29418]: audit 2021-03-10T15:41:06.516114+0000 mon.a (mon.0) 2280 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:41:07.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:07 gibba013 bash[29418]: audit 2021-03-10T15:41:06.596079+0000 mon.a (mon.0) 2281 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:41:07.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:07 gibba013 bash[29418]: audit 2021-03-10T15:41:06.706866+0000 mon.a (mon.0) 2282 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T15:41:07.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:07 gibba013 bash[29418]: audit 2021-03-10T15:41:06.707632+0000 mon.a (mon.0) 2283 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:41:07.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:07 gibba013 bash[29418]: audit 2021-03-10T15:41:06.708384+0000 mon.a (mon.0) 2284 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T15:41:07.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:07 gibba013 bash[29418]: audit 2021-03-10T15:41:06.709047+0000 mon.a (mon.0) 2285 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:41:07.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:07 gibba013 bash[30381]: audit 2021-03-10T15:41:06.516114+0000 mon.a (mon.0) 2280 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:41:07.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:07 gibba013 bash[30381]: audit 2021-03-10T15:41:06.596079+0000 mon.a (mon.0) 2281 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:41:07.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:07 gibba013 bash[30381]: audit 2021-03-10T15:41:06.706866+0000 mon.a (mon.0) 2282 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T15:41:07.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:07 gibba013 bash[30381]: audit 2021-03-10T15:41:06.707632+0000 mon.a (mon.0) 2283 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:41:07.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:07 gibba013 bash[30381]: audit 2021-03-10T15:41:06.708384+0000 mon.a (mon.0) 2284 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T15:41:07.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:07 gibba013 bash[30381]: audit 2021-03-10T15:41:06.709047+0000 mon.a (mon.0) 2285 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:41:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:07 gibba020 bash[25448]: audit 2021-03-10T15:41:06.516114+0000 mon.a (mon.0) 2280 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:41:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:07 gibba020 bash[25448]: audit 2021-03-10T15:41:06.596079+0000 mon.a (mon.0) 2281 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:41:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:07 gibba020 bash[25448]: audit 2021-03-10T15:41:06.706866+0000 mon.a (mon.0) 2282 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T15:41:07.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:07 gibba020 bash[25448]: audit 2021-03-10T15:41:06.707632+0000 mon.a (mon.0) 2283 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:41:07.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:07 gibba020 bash[25448]: audit 2021-03-10T15:41:06.708384+0000 mon.a (mon.0) 2284 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T15:41:07.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:07 gibba020 bash[25448]: audit 2021-03-10T15:41:06.709047+0000 mon.a (mon.0) 2285 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:41:08.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:08 gibba013 bash[29418]: cluster 2021-03-10T15:41:07.105562+0000 mgr.gibba020.yqfnwy (mgr.34427) 5721 : cluster [DBG] pgmap v3253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:08.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:08 gibba013 bash[30381]: cluster 2021-03-10T15:41:07.105562+0000 mgr.gibba020.yqfnwy (mgr.34427) 5721 : cluster [DBG] pgmap v3253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:08.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:08 gibba020 bash[25448]: cluster 2021-03-10T15:41:07.105562+0000 mgr.gibba020.yqfnwy (mgr.34427) 5721 : cluster [DBG] pgmap v3253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:10.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:10 gibba013 bash[29418]: cluster 2021-03-10T15:41:09.107102+0000 mgr.gibba020.yqfnwy (mgr.34427) 5722 : cluster [DBG] pgmap v3254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:10.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:10 gibba013 bash[30381]: cluster 2021-03-10T15:41:09.107102+0000 mgr.gibba020.yqfnwy (mgr.34427) 5722 : cluster [DBG] pgmap v3254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:10.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:10 gibba020 bash[25448]: cluster 2021-03-10T15:41:09.107102+0000 mgr.gibba020.yqfnwy (mgr.34427) 5722 : cluster [DBG] pgmap v3254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:12.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:12 gibba013 bash[29418]: cluster 2021-03-10T15:41:11.108926+0000 mgr.gibba020.yqfnwy (mgr.34427) 5723 : cluster [DBG] pgmap v3255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:12.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:12 gibba013 bash[30381]: cluster 2021-03-10T15:41:11.108926+0000 mgr.gibba020.yqfnwy (mgr.34427) 5723 : cluster [DBG] pgmap v3255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:12.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:12 gibba020 bash[25448]: cluster 2021-03-10T15:41:11.108926+0000 mgr.gibba020.yqfnwy (mgr.34427) 5723 : cluster [DBG] pgmap v3255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:14.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:13 gibba013 bash[29418]: cluster 2021-03-10T15:41:13.110392+0000 mgr.gibba020.yqfnwy (mgr.34427) 5724 : cluster [DBG] pgmap v3256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:14.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:13 gibba013 bash[30381]: cluster 2021-03-10T15:41:13.110392+0000 mgr.gibba020.yqfnwy (mgr.34427) 5724 : cluster [DBG] pgmap v3256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:14.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:13 gibba020 bash[25448]: cluster 2021-03-10T15:41:13.110392+0000 mgr.gibba020.yqfnwy (mgr.34427) 5724 : cluster [DBG] pgmap v3256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:16.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:16 gibba020 bash[25448]: cluster 2021-03-10T15:41:15.112245+0000 mgr.gibba020.yqfnwy (mgr.34427) 5725 : cluster [DBG] pgmap v3257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:16.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:16 gibba013 bash[29418]: cluster 2021-03-10T15:41:15.112245+0000 mgr.gibba020.yqfnwy (mgr.34427) 5725 : cluster [DBG] pgmap v3257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:16.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:16 gibba013 bash[30381]: cluster 2021-03-10T15:41:15.112245+0000 mgr.gibba020.yqfnwy (mgr.34427) 5725 : cluster [DBG] pgmap v3257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:18.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:18 gibba020 bash[25448]: cephadm 2021-03-10T15:41:16.695332+0000 mgr.gibba020.yqfnwy (mgr.34427) 5726 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:41:18.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:18 gibba020 bash[25448]: cluster 2021-03-10T15:41:17.113326+0000 mgr.gibba020.yqfnwy (mgr.34427) 5727 : cluster [DBG] pgmap v3258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:18.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:18 gibba013 bash[29418]: cephadm 2021-03-10T15:41:16.695332+0000 mgr.gibba020.yqfnwy (mgr.34427) 5726 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:41:18.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:18 gibba013 bash[29418]: cluster 2021-03-10T15:41:17.113326+0000 mgr.gibba020.yqfnwy (mgr.34427) 5727 : cluster [DBG] pgmap v3258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:18.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:18 gibba013 bash[30381]: cephadm 2021-03-10T15:41:16.695332+0000 mgr.gibba020.yqfnwy (mgr.34427) 5726 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:41:18.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:18 gibba013 bash[30381]: cluster 2021-03-10T15:41:17.113326+0000 mgr.gibba020.yqfnwy (mgr.34427) 5727 : cluster [DBG] pgmap v3258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:20.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:20 gibba020 bash[25448]: cluster 2021-03-10T15:41:19.115013+0000 mgr.gibba020.yqfnwy (mgr.34427) 5728 : cluster [DBG] pgmap v3259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:20.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:20 gibba013 bash[29418]: cluster 2021-03-10T15:41:19.115013+0000 mgr.gibba020.yqfnwy (mgr.34427) 5728 : cluster [DBG] pgmap v3259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:20.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:20 gibba013 bash[30381]: cluster 2021-03-10T15:41:19.115013+0000 mgr.gibba020.yqfnwy (mgr.34427) 5728 : cluster [DBG] pgmap v3259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:22.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:22 gibba013 bash[29418]: cluster 2021-03-10T15:41:21.116783+0000 mgr.gibba020.yqfnwy (mgr.34427) 5729 : cluster [DBG] pgmap v3260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:22.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:22 gibba013 bash[30381]: cluster 2021-03-10T15:41:21.116783+0000 mgr.gibba020.yqfnwy (mgr.34427) 5729 : cluster [DBG] pgmap v3260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:22.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:22 gibba020 bash[25448]: cluster 2021-03-10T15:41:21.116783+0000 mgr.gibba020.yqfnwy (mgr.34427) 5729 : cluster [DBG] pgmap v3260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:24.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:23 gibba013 bash[29418]: cluster 2021-03-10T15:41:23.117362+0000 mgr.gibba020.yqfnwy (mgr.34427) 5730 : cluster [DBG] pgmap v3261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:24.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:23 gibba013 bash[30381]: cluster 2021-03-10T15:41:23.117362+0000 mgr.gibba020.yqfnwy (mgr.34427) 5730 : cluster [DBG] pgmap v3261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:24.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:23 gibba020 bash[25448]: cluster 2021-03-10T15:41:23.117362+0000 mgr.gibba020.yqfnwy (mgr.34427) 5730 : cluster [DBG] pgmap v3261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:24.541 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:41:24.769 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:41:24.770 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (107m) 117s ago 113m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:41:24.770 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (113m) 53s ago 113m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:41:24.770 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (108m) 53s ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:41:24.771 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (108m) 53s ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:41:24.771 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (107m) 117s ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:41:24.771 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (107m) 117s ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:41:24.772 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (106m) 53s ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:41:24.772 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (107m) 117s ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:41:24.772 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (113m) 117s ago 113m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:41:24.773 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (113m) 53s ago 113m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:41:24.773 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (106m) 117s ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:41:24.773 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (105m) 117s ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:41:24.774 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (105m) 117s ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:41:24.774 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (104m) 117s ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:41:24.775 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (104m) 53s ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:41:24.775 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (104m) 53s ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:41:24.775 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (103m) 53s ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:41:24.776 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (103m) 53s ago 113m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:41:24.776 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (112m) 53s ago 113m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:41:24.776 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 53s ago 111m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:41:25.020 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:41:25.021 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:41:25.021 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:41:25.021 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:41:25.021 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:41:25.022 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:41:25.022 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:41:25.022 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:41:25.023 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:41:25.023 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:41:25.023 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:41:25.023 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:41:25.024 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:41:25.024 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:41:25.024 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:41:25.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:24 gibba013 bash[29418]: audit 2021-03-10T15:41:24.526764+0000 mgr.gibba020.yqfnwy (mgr.34427) 5731 : audit [DBG] from='client.47904 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:41:25.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:24 gibba013 bash[30381]: audit 2021-03-10T15:41:24.526764+0000 mgr.gibba020.yqfnwy (mgr.34427) 5731 : audit [DBG] from='client.47904 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:41:25.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:24 gibba020 bash[25448]: audit 2021-03-10T15:41:24.526764+0000 mgr.gibba020.yqfnwy (mgr.34427) 5731 : audit [DBG] from='client.47904 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:41:26.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:25 gibba013 bash[29418]: audit 2021-03-10T15:41:24.751755+0000 mgr.gibba020.yqfnwy (mgr.34427) 5732 : audit [DBG] from='client.47910 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:41:26.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:25 gibba013 bash[29418]: audit 2021-03-10T15:41:25.016236+0000 mon.a (mon.0) 2286 : audit [DBG] from='client.? 172.21.2.113:0/2226509773' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:26.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:25 gibba013 bash[29418]: cluster 2021-03-10T15:41:25.118195+0000 mgr.gibba020.yqfnwy (mgr.34427) 5733 : cluster [DBG] pgmap v3262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:26.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:25 gibba013 bash[30381]: audit 2021-03-10T15:41:24.751755+0000 mgr.gibba020.yqfnwy (mgr.34427) 5732 : audit [DBG] from='client.47910 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:41:26.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:25 gibba013 bash[30381]: audit 2021-03-10T15:41:25.016236+0000 mon.a (mon.0) 2286 : audit [DBG] from='client.? 172.21.2.113:0/2226509773' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:26.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:25 gibba013 bash[30381]: cluster 2021-03-10T15:41:25.118195+0000 mgr.gibba020.yqfnwy (mgr.34427) 5733 : cluster [DBG] pgmap v3262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:26.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:25 gibba020 bash[25448]: audit 2021-03-10T15:41:24.751755+0000 mgr.gibba020.yqfnwy (mgr.34427) 5732 : audit [DBG] from='client.47910 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:41:26.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:25 gibba020 bash[25448]: audit 2021-03-10T15:41:25.016236+0000 mon.a (mon.0) 2286 : audit [DBG] from='client.? 172.21.2.113:0/2226509773' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:26.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:25 gibba020 bash[25448]: cluster 2021-03-10T15:41:25.118195+0000 mgr.gibba020.yqfnwy (mgr.34427) 5733 : cluster [DBG] pgmap v3262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:28.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:28 gibba020 bash[25448]: cluster 2021-03-10T15:41:27.119498+0000 mgr.gibba020.yqfnwy (mgr.34427) 5734 : cluster [DBG] pgmap v3263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:28.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:28 gibba013 bash[29418]: cluster 2021-03-10T15:41:27.119498+0000 mgr.gibba020.yqfnwy (mgr.34427) 5734 : cluster [DBG] pgmap v3263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:28.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:28 gibba013 bash[30381]: cluster 2021-03-10T15:41:27.119498+0000 mgr.gibba020.yqfnwy (mgr.34427) 5734 : cluster [DBG] pgmap v3263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:30.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:30 gibba020 bash[25448]: cluster 2021-03-10T15:41:29.121160+0000 mgr.gibba020.yqfnwy (mgr.34427) 5735 : cluster [DBG] pgmap v3264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:30.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:30 gibba013 bash[29418]: cluster 2021-03-10T15:41:29.121160+0000 mgr.gibba020.yqfnwy (mgr.34427) 5735 : cluster [DBG] pgmap v3264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:30.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:30 gibba013 bash[30381]: cluster 2021-03-10T15:41:29.121160+0000 mgr.gibba020.yqfnwy (mgr.34427) 5735 : cluster [DBG] pgmap v3264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:32.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:32 gibba013 bash[29418]: cluster 2021-03-10T15:41:31.122878+0000 mgr.gibba020.yqfnwy (mgr.34427) 5736 : cluster [DBG] pgmap v3265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:32.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:32 gibba013 bash[29418]: audit 2021-03-10T15:41:31.712541+0000 mon.a (mon.0) 2287 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:41:32.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:32 gibba013 bash[29418]: audit 2021-03-10T15:41:31.919473+0000 mon.a (mon.0) 2288 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:41:32.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:32 gibba013 bash[29418]: audit 2021-03-10T15:41:31.923307+0000 mon.a (mon.0) 2289 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:41:32.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:32 gibba013 bash[29418]: audit 2021-03-10T15:41:31.925003+0000 mon.a (mon.0) 2290 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:32.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:32 gibba013 bash[29418]: audit 2021-03-10T15:41:31.926571+0000 mon.a (mon.0) 2291 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:32.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:32 gibba013 bash[29418]: audit 2021-03-10T15:41:31.927931+0000 mon.a (mon.0) 2292 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:32.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:32 gibba013 bash[29418]: audit 2021-03-10T15:41:31.931299+0000 mon.a (mon.0) 2293 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:32.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:32 gibba013 bash[29418]: audit 2021-03-10T15:41:31.933332+0000 mon.a (mon.0) 2294 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:32.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:32 gibba013 bash[30381]: cluster 2021-03-10T15:41:31.122878+0000 mgr.gibba020.yqfnwy (mgr.34427) 5736 : cluster [DBG] pgmap v3265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:32.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:32 gibba013 bash[30381]: audit 2021-03-10T15:41:31.712541+0000 mon.a (mon.0) 2287 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:41:32.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:32 gibba013 bash[30381]: audit 2021-03-10T15:41:31.919473+0000 mon.a (mon.0) 2288 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:41:32.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:32 gibba013 bash[30381]: audit 2021-03-10T15:41:31.923307+0000 mon.a (mon.0) 2289 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:41:32.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:32 gibba013 bash[30381]: audit 2021-03-10T15:41:31.925003+0000 mon.a (mon.0) 2290 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:32.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:32 gibba013 bash[30381]: audit 2021-03-10T15:41:31.926571+0000 mon.a (mon.0) 2291 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:32.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:32 gibba013 bash[30381]: audit 2021-03-10T15:41:31.927931+0000 mon.a (mon.0) 2292 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:32.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:32 gibba013 bash[30381]: audit 2021-03-10T15:41:31.931299+0000 mon.a (mon.0) 2293 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:32.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:32 gibba013 bash[30381]: audit 2021-03-10T15:41:31.933332+0000 mon.a (mon.0) 2294 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:32.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:32 gibba020 bash[25448]: cluster 2021-03-10T15:41:31.122878+0000 mgr.gibba020.yqfnwy (mgr.34427) 5736 : cluster [DBG] pgmap v3265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:32.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:32 gibba020 bash[25448]: audit 2021-03-10T15:41:31.712541+0000 mon.a (mon.0) 2287 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:41:32.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:32 gibba020 bash[25448]: audit 2021-03-10T15:41:31.919473+0000 mon.a (mon.0) 2288 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:41:32.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:32 gibba020 bash[25448]: audit 2021-03-10T15:41:31.923307+0000 mon.a (mon.0) 2289 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:41:32.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:32 gibba020 bash[25448]: audit 2021-03-10T15:41:31.925003+0000 mon.a (mon.0) 2290 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:32.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:32 gibba020 bash[25448]: audit 2021-03-10T15:41:31.926571+0000 mon.a (mon.0) 2291 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:32.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:32 gibba020 bash[25448]: audit 2021-03-10T15:41:31.927931+0000 mon.a (mon.0) 2292 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:32.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:32 gibba020 bash[25448]: audit 2021-03-10T15:41:31.931299+0000 mon.a (mon.0) 2293 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:32.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:32 gibba020 bash[25448]: audit 2021-03-10T15:41:31.933332+0000 mon.a (mon.0) 2294 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:33.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:33 gibba013 bash[29418]: cephadm 2021-03-10T15:41:31.714902+0000 mgr.gibba020.yqfnwy (mgr.34427) 5737 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:41:33.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:33 gibba013 bash[29418]: cephadm 2021-03-10T15:41:31.715702+0000 mgr.gibba020.yqfnwy (mgr.34427) 5738 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:41:33.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:33 gibba013 bash[29418]: cephadm 2021-03-10T15:41:31.921462+0000 mgr.gibba020.yqfnwy (mgr.34427) 5739 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:41:33.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:33 gibba013 bash[29418]: cephadm 2021-03-10T15:41:31.923698+0000 mgr.gibba020.yqfnwy (mgr.34427) 5740 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:41:33.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:33 gibba013 bash[29418]: cephadm 2021-03-10T15:41:31.925188+0000 mgr.gibba020.yqfnwy (mgr.34427) 5741 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:41:33.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:33 gibba013 bash[29418]: cephadm 2021-03-10T15:41:31.925222+0000 mgr.gibba020.yqfnwy (mgr.34427) 5742 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:41:33.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:33 gibba013 bash[29418]: cephadm 2021-03-10T15:41:31.926680+0000 mgr.gibba020.yqfnwy (mgr.34427) 5743 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:41:33.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:33 gibba013 bash[29418]: cephadm 2021-03-10T15:41:31.926713+0000 mgr.gibba020.yqfnwy (mgr.34427) 5744 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:41:33.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:33 gibba013 bash[29418]: cephadm 2021-03-10T15:41:31.928136+0000 mgr.gibba020.yqfnwy (mgr.34427) 5745 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:41:33.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:33 gibba013 bash[29418]: cephadm 2021-03-10T15:41:31.929657+0000 mgr.gibba020.yqfnwy (mgr.34427) 5746 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:41:33.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:33 gibba013 bash[29418]: cephadm 2021-03-10T15:41:31.929729+0000 mgr.gibba020.yqfnwy (mgr.34427) 5747 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:41:33.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:33 gibba013 bash[29418]: cephadm 2021-03-10T15:41:31.931552+0000 mgr.gibba020.yqfnwy (mgr.34427) 5748 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:41:33.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:33 gibba013 bash[29418]: cephadm 2021-03-10T15:41:31.932022+0000 mgr.gibba020.yqfnwy (mgr.34427) 5749 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:41:33.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:33 gibba013 bash[29418]: cephadm 2021-03-10T15:41:31.933558+0000 mgr.gibba020.yqfnwy (mgr.34427) 5750 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:41:33.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:33 gibba013 bash[29418]: cephadm 2021-03-10T15:41:31.933606+0000 mgr.gibba020.yqfnwy (mgr.34427) 5751 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:41:33.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:33 gibba013 bash[29418]: cephadm 2021-03-10T15:41:31.933712+0000 mgr.gibba020.yqfnwy (mgr.34427) 5752 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:41:33.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:33 gibba013 bash[30381]: cephadm 2021-03-10T15:41:31.714902+0000 mgr.gibba020.yqfnwy (mgr.34427) 5737 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:41:33.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:33 gibba013 bash[30381]: cephadm 2021-03-10T15:41:31.715702+0000 mgr.gibba020.yqfnwy (mgr.34427) 5738 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:41:33.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:33 gibba013 bash[30381]: cephadm 2021-03-10T15:41:31.921462+0000 mgr.gibba020.yqfnwy (mgr.34427) 5739 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:41:33.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:33 gibba013 bash[30381]: cephadm 2021-03-10T15:41:31.923698+0000 mgr.gibba020.yqfnwy (mgr.34427) 5740 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:41:33.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:33 gibba013 bash[30381]: cephadm 2021-03-10T15:41:31.925188+0000 mgr.gibba020.yqfnwy (mgr.34427) 5741 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:41:33.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:33 gibba013 bash[30381]: cephadm 2021-03-10T15:41:31.925222+0000 mgr.gibba020.yqfnwy (mgr.34427) 5742 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:41:33.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:33 gibba013 bash[30381]: cephadm 2021-03-10T15:41:31.926680+0000 mgr.gibba020.yqfnwy (mgr.34427) 5743 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:41:33.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:33 gibba013 bash[30381]: cephadm 2021-03-10T15:41:31.926713+0000 mgr.gibba020.yqfnwy (mgr.34427) 5744 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:41:33.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:33 gibba013 bash[30381]: cephadm 2021-03-10T15:41:31.928136+0000 mgr.gibba020.yqfnwy (mgr.34427) 5745 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:41:33.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:33 gibba013 bash[30381]: cephadm 2021-03-10T15:41:31.929657+0000 mgr.gibba020.yqfnwy (mgr.34427) 5746 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:41:33.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:33 gibba013 bash[30381]: cephadm 2021-03-10T15:41:31.929729+0000 mgr.gibba020.yqfnwy (mgr.34427) 5747 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:41:33.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:33 gibba013 bash[30381]: cephadm 2021-03-10T15:41:31.931552+0000 mgr.gibba020.yqfnwy (mgr.34427) 5748 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:41:33.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:33 gibba013 bash[30381]: cephadm 2021-03-10T15:41:31.932022+0000 mgr.gibba020.yqfnwy (mgr.34427) 5749 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:41:33.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:33 gibba013 bash[30381]: cephadm 2021-03-10T15:41:31.933558+0000 mgr.gibba020.yqfnwy (mgr.34427) 5750 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:41:33.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:33 gibba013 bash[30381]: cephadm 2021-03-10T15:41:31.933606+0000 mgr.gibba020.yqfnwy (mgr.34427) 5751 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:41:33.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:33 gibba013 bash[30381]: cephadm 2021-03-10T15:41:31.933712+0000 mgr.gibba020.yqfnwy (mgr.34427) 5752 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:41:33.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:33 gibba020 bash[25448]: cephadm 2021-03-10T15:41:31.714902+0000 mgr.gibba020.yqfnwy (mgr.34427) 5737 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:41:33.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:33 gibba020 bash[25448]: cephadm 2021-03-10T15:41:31.715702+0000 mgr.gibba020.yqfnwy (mgr.34427) 5738 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:41:33.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:33 gibba020 bash[25448]: cephadm 2021-03-10T15:41:31.921462+0000 mgr.gibba020.yqfnwy (mgr.34427) 5739 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:41:33.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:33 gibba020 bash[25448]: cephadm 2021-03-10T15:41:31.923698+0000 mgr.gibba020.yqfnwy (mgr.34427) 5740 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:41:33.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:33 gibba020 bash[25448]: cephadm 2021-03-10T15:41:31.925188+0000 mgr.gibba020.yqfnwy (mgr.34427) 5741 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:41:33.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:33 gibba020 bash[25448]: cephadm 2021-03-10T15:41:31.925222+0000 mgr.gibba020.yqfnwy (mgr.34427) 5742 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:41:33.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:33 gibba020 bash[25448]: cephadm 2021-03-10T15:41:31.926680+0000 mgr.gibba020.yqfnwy (mgr.34427) 5743 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:41:33.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:33 gibba020 bash[25448]: cephadm 2021-03-10T15:41:31.926713+0000 mgr.gibba020.yqfnwy (mgr.34427) 5744 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:41:33.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:33 gibba020 bash[25448]: cephadm 2021-03-10T15:41:31.928136+0000 mgr.gibba020.yqfnwy (mgr.34427) 5745 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:41:33.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:33 gibba020 bash[25448]: cephadm 2021-03-10T15:41:31.929657+0000 mgr.gibba020.yqfnwy (mgr.34427) 5746 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:41:33.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:33 gibba020 bash[25448]: cephadm 2021-03-10T15:41:31.929729+0000 mgr.gibba020.yqfnwy (mgr.34427) 5747 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:41:33.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:33 gibba020 bash[25448]: cephadm 2021-03-10T15:41:31.931552+0000 mgr.gibba020.yqfnwy (mgr.34427) 5748 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:41:33.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:33 gibba020 bash[25448]: cephadm 2021-03-10T15:41:31.932022+0000 mgr.gibba020.yqfnwy (mgr.34427) 5749 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:41:33.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:33 gibba020 bash[25448]: cephadm 2021-03-10T15:41:31.933558+0000 mgr.gibba020.yqfnwy (mgr.34427) 5750 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:41:33.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:33 gibba020 bash[25448]: cephadm 2021-03-10T15:41:31.933606+0000 mgr.gibba020.yqfnwy (mgr.34427) 5751 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:41:33.706 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:33 gibba020 bash[25448]: cephadm 2021-03-10T15:41:31.933712+0000 mgr.gibba020.yqfnwy (mgr.34427) 5752 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:41:34.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:34 gibba013 bash[29418]: cluster 2021-03-10T15:41:33.123665+0000 mgr.gibba020.yqfnwy (mgr.34427) 5753 : cluster [DBG] pgmap v3266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:34.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:34 gibba013 bash[30381]: cluster 2021-03-10T15:41:33.123665+0000 mgr.gibba020.yqfnwy (mgr.34427) 5753 : cluster [DBG] pgmap v3266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:34.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:34 gibba020 bash[25448]: cluster 2021-03-10T15:41:33.123665+0000 mgr.gibba020.yqfnwy (mgr.34427) 5753 : cluster [DBG] pgmap v3266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:36.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:36 gibba013 bash[29418]: cluster 2021-03-10T15:41:35.125387+0000 mgr.gibba020.yqfnwy (mgr.34427) 5754 : cluster [DBG] pgmap v3267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:36.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:36 gibba013 bash[30381]: cluster 2021-03-10T15:41:35.125387+0000 mgr.gibba020.yqfnwy (mgr.34427) 5754 : cluster [DBG] pgmap v3267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:36.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:36 gibba020 bash[25448]: cluster 2021-03-10T15:41:35.125387+0000 mgr.gibba020.yqfnwy (mgr.34427) 5754 : cluster [DBG] pgmap v3267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:38.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:38 gibba013 bash[29418]: cluster 2021-03-10T15:41:37.126643+0000 mgr.gibba020.yqfnwy (mgr.34427) 5755 : cluster [DBG] pgmap v3268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:38.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:38 gibba013 bash[30381]: cluster 2021-03-10T15:41:37.126643+0000 mgr.gibba020.yqfnwy (mgr.34427) 5755 : cluster [DBG] pgmap v3268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:38.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:38 gibba020 bash[25448]: cluster 2021-03-10T15:41:37.126643+0000 mgr.gibba020.yqfnwy (mgr.34427) 5755 : cluster [DBG] pgmap v3268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:40.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:40 gibba013 bash[29418]: cluster 2021-03-10T15:41:39.128281+0000 mgr.gibba020.yqfnwy (mgr.34427) 5756 : cluster [DBG] pgmap v3269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:40.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:40 gibba013 bash[30381]: cluster 2021-03-10T15:41:39.128281+0000 mgr.gibba020.yqfnwy (mgr.34427) 5756 : cluster [DBG] pgmap v3269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:40.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:40 gibba020 bash[25448]: cluster 2021-03-10T15:41:39.128281+0000 mgr.gibba020.yqfnwy (mgr.34427) 5756 : cluster [DBG] pgmap v3269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:42.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:42 gibba013 bash[29418]: cluster 2021-03-10T15:41:41.129285+0000 mgr.gibba020.yqfnwy (mgr.34427) 5757 : cluster [DBG] pgmap v3270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:42.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:42 gibba013 bash[30381]: cluster 2021-03-10T15:41:41.129285+0000 mgr.gibba020.yqfnwy (mgr.34427) 5757 : cluster [DBG] pgmap v3270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:42.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:42 gibba020 bash[25448]: cluster 2021-03-10T15:41:41.129285+0000 mgr.gibba020.yqfnwy (mgr.34427) 5757 : cluster [DBG] pgmap v3270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:44.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:43 gibba013 bash[29418]: cluster 2021-03-10T15:41:43.130413+0000 mgr.gibba020.yqfnwy (mgr.34427) 5758 : cluster [DBG] pgmap v3271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:44.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:43 gibba013 bash[30381]: cluster 2021-03-10T15:41:43.130413+0000 mgr.gibba020.yqfnwy (mgr.34427) 5758 : cluster [DBG] pgmap v3271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:44.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:43 gibba020 bash[25448]: cluster 2021-03-10T15:41:43.130413+0000 mgr.gibba020.yqfnwy (mgr.34427) 5758 : cluster [DBG] pgmap v3271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:46.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:46 gibba020 bash[25448]: cluster 2021-03-10T15:41:45.132192+0000 mgr.gibba020.yqfnwy (mgr.34427) 5759 : cluster [DBG] pgmap v3272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:46.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:46 gibba013 bash[30381]: cluster 2021-03-10T15:41:45.132192+0000 mgr.gibba020.yqfnwy (mgr.34427) 5759 : cluster [DBG] pgmap v3272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:46.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:46 gibba013 bash[29418]: cluster 2021-03-10T15:41:45.132192+0000 mgr.gibba020.yqfnwy (mgr.34427) 5759 : cluster [DBG] pgmap v3272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:48.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:48 gibba013 bash[29418]: cephadm 2021-03-10T15:41:46.949833+0000 mgr.gibba020.yqfnwy (mgr.34427) 5760 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:41:48.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:48 gibba013 bash[29418]: cluster 2021-03-10T15:41:47.133416+0000 mgr.gibba020.yqfnwy (mgr.34427) 5761 : cluster [DBG] pgmap v3273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:48.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:48 gibba013 bash[30381]: cephadm 2021-03-10T15:41:46.949833+0000 mgr.gibba020.yqfnwy (mgr.34427) 5760 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:41:48.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:48 gibba013 bash[30381]: cluster 2021-03-10T15:41:47.133416+0000 mgr.gibba020.yqfnwy (mgr.34427) 5761 : cluster [DBG] pgmap v3273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:48.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:48 gibba020 bash[25448]: cephadm 2021-03-10T15:41:46.949833+0000 mgr.gibba020.yqfnwy (mgr.34427) 5760 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:41:48.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:48 gibba020 bash[25448]: cluster 2021-03-10T15:41:47.133416+0000 mgr.gibba020.yqfnwy (mgr.34427) 5761 : cluster [DBG] pgmap v3273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:50.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:50 gibba013 bash[29418]: cluster 2021-03-10T15:41:49.134748+0000 mgr.gibba020.yqfnwy (mgr.34427) 5762 : cluster [DBG] pgmap v3274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:50.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:50 gibba013 bash[30381]: cluster 2021-03-10T15:41:49.134748+0000 mgr.gibba020.yqfnwy (mgr.34427) 5762 : cluster [DBG] pgmap v3274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:50.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:50 gibba020 bash[25448]: cluster 2021-03-10T15:41:49.134748+0000 mgr.gibba020.yqfnwy (mgr.34427) 5762 : cluster [DBG] pgmap v3274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:52.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:52 gibba013 bash[29418]: cluster 2021-03-10T15:41:51.136645+0000 mgr.gibba020.yqfnwy (mgr.34427) 5763 : cluster [DBG] pgmap v3275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:52.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:52 gibba013 bash[30381]: cluster 2021-03-10T15:41:51.136645+0000 mgr.gibba020.yqfnwy (mgr.34427) 5763 : cluster [DBG] pgmap v3275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:52.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:52 gibba020 bash[25448]: cluster 2021-03-10T15:41:51.136645+0000 mgr.gibba020.yqfnwy (mgr.34427) 5763 : cluster [DBG] pgmap v3275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:54.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:53 gibba013 bash[29418]: cluster 2021-03-10T15:41:53.137996+0000 mgr.gibba020.yqfnwy (mgr.34427) 5764 : cluster [DBG] pgmap v3276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:54.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:53 gibba013 bash[30381]: cluster 2021-03-10T15:41:53.137996+0000 mgr.gibba020.yqfnwy (mgr.34427) 5764 : cluster [DBG] pgmap v3276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:54.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:53 gibba020 bash[25448]: cluster 2021-03-10T15:41:53.137996+0000 mgr.gibba020.yqfnwy (mgr.34427) 5764 : cluster [DBG] pgmap v3276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:55.262 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:41:55.490 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:41:55.490 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (108m) 2m ago 113m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:41:55.490 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (113m) 84s ago 113m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:41:55.491 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (108m) 84s ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:41:55.491 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (109m) 84s ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:41:55.491 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (108m) 2m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:41:55.491 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (107m) 2m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:41:55.491 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (107m) 84s ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:41:55.492 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (107m) 2m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:41:55.492 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (113m) 2m ago 113m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:41:55.492 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (113m) 84s ago 113m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:41:55.492 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (106m) 2m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:41:55.493 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (106m) 2m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:41:55.493 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (105m) 2m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:41:55.493 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (105m) 2m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:41:55.493 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (104m) 84s ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:41:55.494 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (104m) 84s ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:41:55.494 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (104m) 84s ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:41:55.494 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (103m) 84s ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:41:55.494 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (113m) 84s ago 114m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:41:55.495 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 84s ago 111m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:41:55.740 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:41:55.741 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:41:55.741 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:41:55.741 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:41:55.741 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:41:55.741 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:41:55.742 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:41:55.742 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:41:55.742 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:41:55.742 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:41:55.743 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:41:55.743 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:41:55.743 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:41:55.743 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:41:55.744 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:41:56.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:56 gibba013 bash[29418]: cluster 2021-03-10T15:41:55.139682+0000 mgr.gibba020.yqfnwy (mgr.34427) 5765 : cluster [DBG] pgmap v3277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:56.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:56 gibba013 bash[29418]: audit 2021-03-10T15:41:55.248813+0000 mgr.gibba020.yqfnwy (mgr.34427) 5766 : audit [DBG] from='client.57907 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:41:56.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:56 gibba013 bash[29418]: audit 2021-03-10T15:41:55.472353+0000 mgr.gibba020.yqfnwy (mgr.34427) 5767 : audit [DBG] from='client.47928 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:41:56.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:56 gibba013 bash[29418]: audit 2021-03-10T15:41:55.736289+0000 mon.c (mon.1) 94 : audit [DBG] from='client.? 172.21.2.113:0/58910548' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:56.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:56 gibba013 bash[30381]: cluster 2021-03-10T15:41:55.139682+0000 mgr.gibba020.yqfnwy (mgr.34427) 5765 : cluster [DBG] pgmap v3277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:56.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:56 gibba013 bash[30381]: audit 2021-03-10T15:41:55.248813+0000 mgr.gibba020.yqfnwy (mgr.34427) 5766 : audit [DBG] from='client.57907 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:41:56.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:56 gibba013 bash[30381]: audit 2021-03-10T15:41:55.472353+0000 mgr.gibba020.yqfnwy (mgr.34427) 5767 : audit [DBG] from='client.47928 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:41:56.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:56 gibba013 bash[30381]: audit 2021-03-10T15:41:55.736289+0000 mon.c (mon.1) 94 : audit [DBG] from='client.? 172.21.2.113:0/58910548' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:56.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:56 gibba020 bash[25448]: cluster 2021-03-10T15:41:55.139682+0000 mgr.gibba020.yqfnwy (mgr.34427) 5765 : cluster [DBG] pgmap v3277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:56.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:56 gibba020 bash[25448]: audit 2021-03-10T15:41:55.248813+0000 mgr.gibba020.yqfnwy (mgr.34427) 5766 : audit [DBG] from='client.57907 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:41:56.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:56 gibba020 bash[25448]: audit 2021-03-10T15:41:55.472353+0000 mgr.gibba020.yqfnwy (mgr.34427) 5767 : audit [DBG] from='client.47928 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:41:56.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:56 gibba020 bash[25448]: audit 2021-03-10T15:41:55.736289+0000 mon.c (mon.1) 94 : audit [DBG] from='client.? 172.21.2.113:0/58910548' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:41:58.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:41:58 gibba013 bash[29418]: cluster 2021-03-10T15:41:57.140742+0000 mgr.gibba020.yqfnwy (mgr.34427) 5768 : cluster [DBG] pgmap v3278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:58.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:41:58 gibba013 bash[30381]: cluster 2021-03-10T15:41:57.140742+0000 mgr.gibba020.yqfnwy (mgr.34427) 5768 : cluster [DBG] pgmap v3278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:41:58.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:41:58 gibba020 bash[25448]: cluster 2021-03-10T15:41:57.140742+0000 mgr.gibba020.yqfnwy (mgr.34427) 5768 : cluster [DBG] pgmap v3278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:00.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:00 gibba013 bash[29418]: cluster 2021-03-10T15:41:59.142288+0000 mgr.gibba020.yqfnwy (mgr.34427) 5769 : cluster [DBG] pgmap v3279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:00.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:00 gibba013 bash[30381]: cluster 2021-03-10T15:41:59.142288+0000 mgr.gibba020.yqfnwy (mgr.34427) 5769 : cluster [DBG] pgmap v3279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:00.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:00 gibba020 bash[25448]: cluster 2021-03-10T15:41:59.142288+0000 mgr.gibba020.yqfnwy (mgr.34427) 5769 : cluster [DBG] pgmap v3279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:02.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:02 gibba013 bash[29418]: cluster 2021-03-10T15:42:01.144139+0000 mgr.gibba020.yqfnwy (mgr.34427) 5770 : cluster [DBG] pgmap v3280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:02.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:02 gibba013 bash[30381]: cluster 2021-03-10T15:42:01.144139+0000 mgr.gibba020.yqfnwy (mgr.34427) 5770 : cluster [DBG] pgmap v3280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:02.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:02 gibba020 bash[25448]: cluster 2021-03-10T15:42:01.144139+0000 mgr.gibba020.yqfnwy (mgr.34427) 5770 : cluster [DBG] pgmap v3280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:03.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:03 gibba013 bash[29418]: cephadm 2021-03-10T15:42:01.965760+0000 mgr.gibba020.yqfnwy (mgr.34427) 5771 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:42:03.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:03 gibba013 bash[30381]: cephadm 2021-03-10T15:42:01.965760+0000 mgr.gibba020.yqfnwy (mgr.34427) 5771 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:42:03.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:03 gibba020 bash[25448]: cephadm 2021-03-10T15:42:01.965760+0000 mgr.gibba020.yqfnwy (mgr.34427) 5771 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:42:04.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:04 gibba013 bash[29418]: cluster 2021-03-10T15:42:03.145411+0000 mgr.gibba020.yqfnwy (mgr.34427) 5772 : cluster [DBG] pgmap v3281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:04.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:04 gibba013 bash[30381]: cluster 2021-03-10T15:42:03.145411+0000 mgr.gibba020.yqfnwy (mgr.34427) 5772 : cluster [DBG] pgmap v3281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:04.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:04 gibba020 bash[25448]: cluster 2021-03-10T15:42:03.145411+0000 mgr.gibba020.yqfnwy (mgr.34427) 5772 : cluster [DBG] pgmap v3281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:06 gibba013 bash[30381]: cluster 2021-03-10T15:42:05.146796+0000 mgr.gibba020.yqfnwy (mgr.34427) 5773 : cluster [DBG] pgmap v3282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:06.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:06 gibba013 bash[29418]: cluster 2021-03-10T15:42:05.146796+0000 mgr.gibba020.yqfnwy (mgr.34427) 5773 : cluster [DBG] pgmap v3282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:06 gibba020 bash[25448]: cluster 2021-03-10T15:42:05.146796+0000 mgr.gibba020.yqfnwy (mgr.34427) 5773 : cluster [DBG] pgmap v3282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:07.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:07 gibba013 bash[29418]: audit 2021-03-10T15:42:06.521317+0000 mon.a (mon.0) 2295 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:42:07.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:07 gibba013 bash[29418]: audit 2021-03-10T15:42:06.604159+0000 mon.a (mon.0) 2296 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:42:07.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:07 gibba013 bash[29418]: audit 2021-03-10T15:42:06.714749+0000 mon.a (mon.0) 2297 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:42:07.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:07 gibba013 bash[29418]: audit 2021-03-10T15:42:06.715875+0000 mon.a (mon.0) 2298 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:42:07.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:07 gibba013 bash[29418]: audit 2021-03-10T15:42:06.716893+0000 mon.a (mon.0) 2299 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:42:07.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:07 gibba013 bash[29418]: audit 2021-03-10T15:42:06.717926+0000 mon.a (mon.0) 2300 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:42:07.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:07 gibba013 bash[30381]: audit 2021-03-10T15:42:06.521317+0000 mon.a (mon.0) 2295 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:42:07.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:07 gibba013 bash[30381]: audit 2021-03-10T15:42:06.604159+0000 mon.a (mon.0) 2296 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:42:07.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:07 gibba013 bash[30381]: audit 2021-03-10T15:42:06.714749+0000 mon.a (mon.0) 2297 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:42:07.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:07 gibba013 bash[30381]: audit 2021-03-10T15:42:06.715875+0000 mon.a (mon.0) 2298 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:42:07.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:07 gibba013 bash[30381]: audit 2021-03-10T15:42:06.716893+0000 mon.a (mon.0) 2299 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:42:07.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:07 gibba013 bash[30381]: audit 2021-03-10T15:42:06.717926+0000 mon.a (mon.0) 2300 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:42:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:07 gibba020 bash[25448]: audit 2021-03-10T15:42:06.521317+0000 mon.a (mon.0) 2295 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:42:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:07 gibba020 bash[25448]: audit 2021-03-10T15:42:06.604159+0000 mon.a (mon.0) 2296 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:42:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:07 gibba020 bash[25448]: audit 2021-03-10T15:42:06.714749+0000 mon.a (mon.0) 2297 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:42:07.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:07 gibba020 bash[25448]: audit 2021-03-10T15:42:06.715875+0000 mon.a (mon.0) 2298 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:42:07.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:07 gibba020 bash[25448]: audit 2021-03-10T15:42:06.716893+0000 mon.a (mon.0) 2299 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:42:07.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:07 gibba020 bash[25448]: audit 2021-03-10T15:42:06.717926+0000 mon.a (mon.0) 2300 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:42:08.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:08 gibba013 bash[29418]: cluster 2021-03-10T15:42:07.148175+0000 mgr.gibba020.yqfnwy (mgr.34427) 5774 : cluster [DBG] pgmap v3283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:08.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:08 gibba013 bash[30381]: cluster 2021-03-10T15:42:07.148175+0000 mgr.gibba020.yqfnwy (mgr.34427) 5774 : cluster [DBG] pgmap v3283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:08.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:08 gibba020 bash[25448]: cluster 2021-03-10T15:42:07.148175+0000 mgr.gibba020.yqfnwy (mgr.34427) 5774 : cluster [DBG] pgmap v3283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:10.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:10 gibba013 bash[29418]: cluster 2021-03-10T15:42:09.149811+0000 mgr.gibba020.yqfnwy (mgr.34427) 5775 : cluster [DBG] pgmap v3284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:10.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:10 gibba013 bash[30381]: cluster 2021-03-10T15:42:09.149811+0000 mgr.gibba020.yqfnwy (mgr.34427) 5775 : cluster [DBG] pgmap v3284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:10.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:10 gibba020 bash[25448]: cluster 2021-03-10T15:42:09.149811+0000 mgr.gibba020.yqfnwy (mgr.34427) 5775 : cluster [DBG] pgmap v3284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:12.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:12 gibba013 bash[29418]: cluster 2021-03-10T15:42:11.151397+0000 mgr.gibba020.yqfnwy (mgr.34427) 5776 : cluster [DBG] pgmap v3285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:12.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:12 gibba013 bash[30381]: cluster 2021-03-10T15:42:11.151397+0000 mgr.gibba020.yqfnwy (mgr.34427) 5776 : cluster [DBG] pgmap v3285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:12.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:12 gibba020 bash[25448]: cluster 2021-03-10T15:42:11.151397+0000 mgr.gibba020.yqfnwy (mgr.34427) 5776 : cluster [DBG] pgmap v3285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:14.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:13 gibba013 bash[29418]: cluster 2021-03-10T15:42:13.152706+0000 mgr.gibba020.yqfnwy (mgr.34427) 5777 : cluster [DBG] pgmap v3286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:14.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:13 gibba013 bash[30381]: cluster 2021-03-10T15:42:13.152706+0000 mgr.gibba020.yqfnwy (mgr.34427) 5777 : cluster [DBG] pgmap v3286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:14.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:13 gibba020 bash[25448]: cluster 2021-03-10T15:42:13.152706+0000 mgr.gibba020.yqfnwy (mgr.34427) 5777 : cluster [DBG] pgmap v3286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:16.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:16 gibba013 bash[29418]: cluster 2021-03-10T15:42:15.154529+0000 mgr.gibba020.yqfnwy (mgr.34427) 5778 : cluster [DBG] pgmap v3287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:16.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:16 gibba013 bash[30381]: cluster 2021-03-10T15:42:15.154529+0000 mgr.gibba020.yqfnwy (mgr.34427) 5778 : cluster [DBG] pgmap v3287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:16.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:16 gibba020 bash[25448]: cluster 2021-03-10T15:42:15.154529+0000 mgr.gibba020.yqfnwy (mgr.34427) 5778 : cluster [DBG] pgmap v3287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:18.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:18 gibba013 bash[29418]: cephadm 2021-03-10T15:42:16.981664+0000 mgr.gibba020.yqfnwy (mgr.34427) 5779 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:42:18.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:18 gibba013 bash[29418]: cluster 2021-03-10T15:42:17.155181+0000 mgr.gibba020.yqfnwy (mgr.34427) 5780 : cluster [DBG] pgmap v3288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:18.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:18 gibba013 bash[30381]: cephadm 2021-03-10T15:42:16.981664+0000 mgr.gibba020.yqfnwy (mgr.34427) 5779 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:42:18.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:18 gibba013 bash[30381]: cluster 2021-03-10T15:42:17.155181+0000 mgr.gibba020.yqfnwy (mgr.34427) 5780 : cluster [DBG] pgmap v3288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:18.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:18 gibba020 bash[25448]: cephadm 2021-03-10T15:42:16.981664+0000 mgr.gibba020.yqfnwy (mgr.34427) 5779 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:42:18.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:18 gibba020 bash[25448]: cluster 2021-03-10T15:42:17.155181+0000 mgr.gibba020.yqfnwy (mgr.34427) 5780 : cluster [DBG] pgmap v3288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:20.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:20 gibba013 bash[29418]: cluster 2021-03-10T15:42:19.156621+0000 mgr.gibba020.yqfnwy (mgr.34427) 5781 : cluster [DBG] pgmap v3289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:20.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:20 gibba013 bash[30381]: cluster 2021-03-10T15:42:19.156621+0000 mgr.gibba020.yqfnwy (mgr.34427) 5781 : cluster [DBG] pgmap v3289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:20.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:20 gibba020 bash[25448]: cluster 2021-03-10T15:42:19.156621+0000 mgr.gibba020.yqfnwy (mgr.34427) 5781 : cluster [DBG] pgmap v3289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:22.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:22 gibba013 bash[29418]: cluster 2021-03-10T15:42:21.158399+0000 mgr.gibba020.yqfnwy (mgr.34427) 5782 : cluster [DBG] pgmap v3290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:22.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:22 gibba013 bash[30381]: cluster 2021-03-10T15:42:21.158399+0000 mgr.gibba020.yqfnwy (mgr.34427) 5782 : cluster [DBG] pgmap v3290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:22.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:22 gibba020 bash[25448]: cluster 2021-03-10T15:42:21.158399+0000 mgr.gibba020.yqfnwy (mgr.34427) 5782 : cluster [DBG] pgmap v3290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:24.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:23 gibba013 bash[29418]: cluster 2021-03-10T15:42:23.159924+0000 mgr.gibba020.yqfnwy (mgr.34427) 5783 : cluster [DBG] pgmap v3291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:24.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:23 gibba013 bash[30381]: cluster 2021-03-10T15:42:23.159924+0000 mgr.gibba020.yqfnwy (mgr.34427) 5783 : cluster [DBG] pgmap v3291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:24.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:23 gibba020 bash[25448]: cluster 2021-03-10T15:42:23.159924+0000 mgr.gibba020.yqfnwy (mgr.34427) 5783 : cluster [DBG] pgmap v3291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:25.984 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:42:26.207 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:42:26.208 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (108m) 2m ago 114m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:42:26.208 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (114m) 114s ago 114m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:42:26.208 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (109m) 114s ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:42:26.208 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (109m) 114s ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:42:26.209 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (108m) 2m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:42:26.209 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (108m) 2m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:42:26.209 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (107m) 114s ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:42:26.209 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (108m) 2m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:42:26.209 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (114m) 2m ago 114m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:42:26.210 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (114m) 114s ago 114m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:42:26.210 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (107m) 2m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:42:26.210 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (106m) 2m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:42:26.210 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (106m) 2m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:42:26.210 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (105m) 2m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:42:26.211 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (105m) 114s ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:42:26.211 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (105m) 114s ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:42:26.211 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (104m) 114s ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:42:26.211 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (104m) 114s ago 114m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:42:26.211 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (113m) 114s ago 114m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:42:26.212 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 114s ago 112m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:42:26.456 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:42:26.456 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:42:26.457 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:42:26.457 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:42:26.457 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:42:26.457 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:42:26.458 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:42:26.458 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:42:26.458 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:42:26.458 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:42:26.458 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:42:26.459 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:42:26.459 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:42:26.459 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:42:26.459 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:42:26.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:26 gibba013 bash[29418]: cluster 2021-03-10T15:42:25.161586+0000 mgr.gibba020.yqfnwy (mgr.34427) 5784 : cluster [DBG] pgmap v3292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:26.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:26 gibba013 bash[30381]: cluster 2021-03-10T15:42:25.161586+0000 mgr.gibba020.yqfnwy (mgr.34427) 5784 : cluster [DBG] pgmap v3292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:26.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:26 gibba020 bash[25448]: cluster 2021-03-10T15:42:25.161586+0000 mgr.gibba020.yqfnwy (mgr.34427) 5784 : cluster [DBG] pgmap v3292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:27.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:27 gibba013 bash[29418]: audit 2021-03-10T15:42:25.970645+0000 mgr.gibba020.yqfnwy (mgr.34427) 5785 : audit [DBG] from='client.47940 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:42:27.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:27 gibba013 bash[29418]: audit 2021-03-10T15:42:26.193205+0000 mgr.gibba020.yqfnwy (mgr.34427) 5786 : audit [DBG] from='client.57931 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:42:27.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:27 gibba013 bash[29418]: audit 2021-03-10T15:42:26.452435+0000 mon.a (mon.0) 2301 : audit [DBG] from='client.? 172.21.2.113:0/1540651560' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:27.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:27 gibba013 bash[30381]: audit 2021-03-10T15:42:25.970645+0000 mgr.gibba020.yqfnwy (mgr.34427) 5785 : audit [DBG] from='client.47940 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:42:27.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:27 gibba013 bash[30381]: audit 2021-03-10T15:42:26.193205+0000 mgr.gibba020.yqfnwy (mgr.34427) 5786 : audit [DBG] from='client.57931 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:42:27.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:27 gibba013 bash[30381]: audit 2021-03-10T15:42:26.452435+0000 mon.a (mon.0) 2301 : audit [DBG] from='client.? 172.21.2.113:0/1540651560' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:27.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:27 gibba020 bash[25448]: audit 2021-03-10T15:42:25.970645+0000 mgr.gibba020.yqfnwy (mgr.34427) 5785 : audit [DBG] from='client.47940 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:42:27.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:27 gibba020 bash[25448]: audit 2021-03-10T15:42:26.193205+0000 mgr.gibba020.yqfnwy (mgr.34427) 5786 : audit [DBG] from='client.57931 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:42:27.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:27 gibba020 bash[25448]: audit 2021-03-10T15:42:26.452435+0000 mon.a (mon.0) 2301 : audit [DBG] from='client.? 172.21.2.113:0/1540651560' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:28.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:28 gibba013 bash[29418]: cluster 2021-03-10T15:42:27.162964+0000 mgr.gibba020.yqfnwy (mgr.34427) 5787 : cluster [DBG] pgmap v3293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:28.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:28 gibba013 bash[30381]: cluster 2021-03-10T15:42:27.162964+0000 mgr.gibba020.yqfnwy (mgr.34427) 5787 : cluster [DBG] pgmap v3293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:28.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:28 gibba020 bash[25448]: cluster 2021-03-10T15:42:27.162964+0000 mgr.gibba020.yqfnwy (mgr.34427) 5787 : cluster [DBG] pgmap v3293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:30.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:30 gibba013 bash[29418]: cluster 2021-03-10T15:42:29.163736+0000 mgr.gibba020.yqfnwy (mgr.34427) 5788 : cluster [DBG] pgmap v3294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:30.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:30 gibba013 bash[30381]: cluster 2021-03-10T15:42:29.163736+0000 mgr.gibba020.yqfnwy (mgr.34427) 5788 : cluster [DBG] pgmap v3294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:30.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:30 gibba020 bash[25448]: cluster 2021-03-10T15:42:29.163736+0000 mgr.gibba020.yqfnwy (mgr.34427) 5788 : cluster [DBG] pgmap v3294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:32.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:32 gibba013 bash[29418]: cluster 2021-03-10T15:42:31.165391+0000 mgr.gibba020.yqfnwy (mgr.34427) 5789 : cluster [DBG] pgmap v3295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:32.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:32 gibba013 bash[29418]: audit 2021-03-10T15:42:31.999252+0000 mon.a (mon.0) 2302 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:42:32.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:32 gibba013 bash[29418]: audit 2021-03-10T15:42:32.211504+0000 mon.a (mon.0) 2303 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:42:32.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:32 gibba013 bash[29418]: audit 2021-03-10T15:42:32.227998+0000 mon.a (mon.0) 2304 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:42:32.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:32 gibba013 bash[29418]: audit 2021-03-10T15:42:32.232739+0000 mon.a (mon.0) 2305 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:32.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:32 gibba013 bash[29418]: audit 2021-03-10T15:42:32.237190+0000 mon.a (mon.0) 2306 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:32.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:32 gibba013 bash[29418]: audit 2021-03-10T15:42:32.241177+0000 mon.a (mon.0) 2307 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:32.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:32 gibba013 bash[29418]: audit 2021-03-10T15:42:32.249011+0000 mon.a (mon.0) 2308 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:32.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:32 gibba013 bash[30381]: cluster 2021-03-10T15:42:31.165391+0000 mgr.gibba020.yqfnwy (mgr.34427) 5789 : cluster [DBG] pgmap v3295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:32.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:32 gibba013 bash[30381]: audit 2021-03-10T15:42:31.999252+0000 mon.a (mon.0) 2302 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:42:32.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:32 gibba013 bash[30381]: audit 2021-03-10T15:42:32.211504+0000 mon.a (mon.0) 2303 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:42:32.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:32 gibba013 bash[30381]: audit 2021-03-10T15:42:32.227998+0000 mon.a (mon.0) 2304 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:42:32.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:32 gibba013 bash[30381]: audit 2021-03-10T15:42:32.232739+0000 mon.a (mon.0) 2305 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:32.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:32 gibba013 bash[30381]: audit 2021-03-10T15:42:32.237190+0000 mon.a (mon.0) 2306 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:32.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:32 gibba013 bash[30381]: audit 2021-03-10T15:42:32.241177+0000 mon.a (mon.0) 2307 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:32.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:32 gibba013 bash[30381]: audit 2021-03-10T15:42:32.249011+0000 mon.a (mon.0) 2308 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:32.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:32 gibba020 bash[25448]: cluster 2021-03-10T15:42:31.165391+0000 mgr.gibba020.yqfnwy (mgr.34427) 5789 : cluster [DBG] pgmap v3295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:32.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:32 gibba020 bash[25448]: audit 2021-03-10T15:42:31.999252+0000 mon.a (mon.0) 2302 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:42:32.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:32 gibba020 bash[25448]: audit 2021-03-10T15:42:32.211504+0000 mon.a (mon.0) 2303 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:42:32.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:32 gibba020 bash[25448]: audit 2021-03-10T15:42:32.227998+0000 mon.a (mon.0) 2304 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:42:32.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:32 gibba020 bash[25448]: audit 2021-03-10T15:42:32.232739+0000 mon.a (mon.0) 2305 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:32.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:32 gibba020 bash[25448]: audit 2021-03-10T15:42:32.237190+0000 mon.a (mon.0) 2306 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:32.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:32 gibba020 bash[25448]: audit 2021-03-10T15:42:32.241177+0000 mon.a (mon.0) 2307 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:32.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:32 gibba020 bash[25448]: audit 2021-03-10T15:42:32.249011+0000 mon.a (mon.0) 2308 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:33.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:33 gibba013 bash[29418]: cephadm 2021-03-10T15:42:32.003252+0000 mgr.gibba020.yqfnwy (mgr.34427) 5790 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:42:33.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:33 gibba013 bash[29418]: cephadm 2021-03-10T15:42:32.005282+0000 mgr.gibba020.yqfnwy (mgr.34427) 5791 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:42:33.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:33 gibba013 bash[29418]: cephadm 2021-03-10T15:42:32.224245+0000 mgr.gibba020.yqfnwy (mgr.34427) 5792 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:42:33.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:33 gibba013 bash[29418]: cephadm 2021-03-10T15:42:32.230408+0000 mgr.gibba020.yqfnwy (mgr.34427) 5793 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:42:33.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:33 gibba013 bash[29418]: cephadm 2021-03-10T15:42:32.234485+0000 mgr.gibba020.yqfnwy (mgr.34427) 5794 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:42:33.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:33 gibba013 bash[29418]: cephadm 2021-03-10T15:42:32.234836+0000 mgr.gibba020.yqfnwy (mgr.34427) 5795 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:42:33.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:33 gibba013 bash[29418]: cephadm 2021-03-10T15:42:32.238841+0000 mgr.gibba020.yqfnwy (mgr.34427) 5796 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:42:33.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:33 gibba013 bash[29418]: cephadm 2021-03-10T15:42:32.239201+0000 mgr.gibba020.yqfnwy (mgr.34427) 5797 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:42:33.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:33 gibba013 bash[29418]: cephadm 2021-03-10T15:42:32.242445+0000 mgr.gibba020.yqfnwy (mgr.34427) 5798 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:42:33.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:33 gibba013 bash[29418]: cephadm 2021-03-10T15:42:32.245875+0000 mgr.gibba020.yqfnwy (mgr.34427) 5799 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:42:33.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:33 gibba013 bash[29418]: cephadm 2021-03-10T15:42:32.246225+0000 mgr.gibba020.yqfnwy (mgr.34427) 5800 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:42:33.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:33 gibba013 bash[29418]: cephadm 2021-03-10T15:42:32.250421+0000 mgr.gibba020.yqfnwy (mgr.34427) 5801 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:42:33.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:33 gibba013 bash[29418]: cephadm 2021-03-10T15:42:32.252695+0000 mgr.gibba020.yqfnwy (mgr.34427) 5802 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:42:33.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:33 gibba013 bash[29418]: audit 2021-03-10T15:42:32.254139+0000 mon.a (mon.0) 2309 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:33.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:33 gibba013 bash[29418]: cephadm 2021-03-10T15:42:32.257048+0000 mgr.gibba020.yqfnwy (mgr.34427) 5803 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:42:33.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:33 gibba013 bash[29418]: cephadm 2021-03-10T15:42:32.257467+0000 mgr.gibba020.yqfnwy (mgr.34427) 5804 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:42:33.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:33 gibba013 bash[29418]: cephadm 2021-03-10T15:42:32.258180+0000 mgr.gibba020.yqfnwy (mgr.34427) 5805 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:42:33.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:33 gibba013 bash[30381]: cephadm 2021-03-10T15:42:32.003252+0000 mgr.gibba020.yqfnwy (mgr.34427) 5790 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:42:33.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:33 gibba013 bash[30381]: cephadm 2021-03-10T15:42:32.005282+0000 mgr.gibba020.yqfnwy (mgr.34427) 5791 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:42:33.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:33 gibba013 bash[30381]: cephadm 2021-03-10T15:42:32.224245+0000 mgr.gibba020.yqfnwy (mgr.34427) 5792 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:42:33.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:33 gibba013 bash[30381]: cephadm 2021-03-10T15:42:32.230408+0000 mgr.gibba020.yqfnwy (mgr.34427) 5793 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:42:33.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:33 gibba013 bash[30381]: cephadm 2021-03-10T15:42:32.234485+0000 mgr.gibba020.yqfnwy (mgr.34427) 5794 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:42:33.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:33 gibba013 bash[30381]: cephadm 2021-03-10T15:42:32.234836+0000 mgr.gibba020.yqfnwy (mgr.34427) 5795 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:42:33.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:33 gibba013 bash[30381]: cephadm 2021-03-10T15:42:32.238841+0000 mgr.gibba020.yqfnwy (mgr.34427) 5796 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:42:33.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:33 gibba013 bash[30381]: cephadm 2021-03-10T15:42:32.239201+0000 mgr.gibba020.yqfnwy (mgr.34427) 5797 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:42:33.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:33 gibba013 bash[30381]: cephadm 2021-03-10T15:42:32.242445+0000 mgr.gibba020.yqfnwy (mgr.34427) 5798 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:42:33.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:33 gibba013 bash[30381]: cephadm 2021-03-10T15:42:32.245875+0000 mgr.gibba020.yqfnwy (mgr.34427) 5799 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:42:33.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:33 gibba013 bash[30381]: cephadm 2021-03-10T15:42:32.246225+0000 mgr.gibba020.yqfnwy (mgr.34427) 5800 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:42:33.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:33 gibba013 bash[30381]: cephadm 2021-03-10T15:42:32.250421+0000 mgr.gibba020.yqfnwy (mgr.34427) 5801 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:42:33.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:33 gibba013 bash[30381]: cephadm 2021-03-10T15:42:32.252695+0000 mgr.gibba020.yqfnwy (mgr.34427) 5802 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:42:33.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:33 gibba013 bash[30381]: audit 2021-03-10T15:42:32.254139+0000 mon.a (mon.0) 2309 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:33.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:33 gibba013 bash[30381]: cephadm 2021-03-10T15:42:32.257048+0000 mgr.gibba020.yqfnwy (mgr.34427) 5803 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:42:33.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:33 gibba013 bash[30381]: cephadm 2021-03-10T15:42:32.257467+0000 mgr.gibba020.yqfnwy (mgr.34427) 5804 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:42:33.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:33 gibba013 bash[30381]: cephadm 2021-03-10T15:42:32.258180+0000 mgr.gibba020.yqfnwy (mgr.34427) 5805 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:42:33.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:33 gibba020 bash[25448]: cephadm 2021-03-10T15:42:32.003252+0000 mgr.gibba020.yqfnwy (mgr.34427) 5790 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:42:33.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:33 gibba020 bash[25448]: cephadm 2021-03-10T15:42:32.005282+0000 mgr.gibba020.yqfnwy (mgr.34427) 5791 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:42:33.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:33 gibba020 bash[25448]: cephadm 2021-03-10T15:42:32.224245+0000 mgr.gibba020.yqfnwy (mgr.34427) 5792 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:42:33.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:33 gibba020 bash[25448]: cephadm 2021-03-10T15:42:32.230408+0000 mgr.gibba020.yqfnwy (mgr.34427) 5793 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:42:33.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:33 gibba020 bash[25448]: cephadm 2021-03-10T15:42:32.234485+0000 mgr.gibba020.yqfnwy (mgr.34427) 5794 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:42:33.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:33 gibba020 bash[25448]: cephadm 2021-03-10T15:42:32.234836+0000 mgr.gibba020.yqfnwy (mgr.34427) 5795 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:42:33.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:33 gibba020 bash[25448]: cephadm 2021-03-10T15:42:32.238841+0000 mgr.gibba020.yqfnwy (mgr.34427) 5796 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:42:33.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:33 gibba020 bash[25448]: cephadm 2021-03-10T15:42:32.239201+0000 mgr.gibba020.yqfnwy (mgr.34427) 5797 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:42:33.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:33 gibba020 bash[25448]: cephadm 2021-03-10T15:42:32.242445+0000 mgr.gibba020.yqfnwy (mgr.34427) 5798 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:42:33.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:33 gibba020 bash[25448]: cephadm 2021-03-10T15:42:32.245875+0000 mgr.gibba020.yqfnwy (mgr.34427) 5799 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:42:33.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:33 gibba020 bash[25448]: cephadm 2021-03-10T15:42:32.246225+0000 mgr.gibba020.yqfnwy (mgr.34427) 5800 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:42:33.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:33 gibba020 bash[25448]: cephadm 2021-03-10T15:42:32.250421+0000 mgr.gibba020.yqfnwy (mgr.34427) 5801 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:42:33.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:33 gibba020 bash[25448]: cephadm 2021-03-10T15:42:32.252695+0000 mgr.gibba020.yqfnwy (mgr.34427) 5802 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:42:33.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:33 gibba020 bash[25448]: audit 2021-03-10T15:42:32.254139+0000 mon.a (mon.0) 2309 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:33.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:33 gibba020 bash[25448]: cephadm 2021-03-10T15:42:32.257048+0000 mgr.gibba020.yqfnwy (mgr.34427) 5803 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:42:33.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:33 gibba020 bash[25448]: cephadm 2021-03-10T15:42:32.257467+0000 mgr.gibba020.yqfnwy (mgr.34427) 5804 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:42:33.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:33 gibba020 bash[25448]: cephadm 2021-03-10T15:42:32.258180+0000 mgr.gibba020.yqfnwy (mgr.34427) 5805 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:42:34.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:34 gibba013 bash[29418]: cluster 2021-03-10T15:42:33.166923+0000 mgr.gibba020.yqfnwy (mgr.34427) 5806 : cluster [DBG] pgmap v3296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:34.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:34 gibba013 bash[30381]: cluster 2021-03-10T15:42:33.166923+0000 mgr.gibba020.yqfnwy (mgr.34427) 5806 : cluster [DBG] pgmap v3296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:34.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:34 gibba020 bash[25448]: cluster 2021-03-10T15:42:33.166923+0000 mgr.gibba020.yqfnwy (mgr.34427) 5806 : cluster [DBG] pgmap v3296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:36.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:36 gibba013 bash[29418]: cluster 2021-03-10T15:42:35.167725+0000 mgr.gibba020.yqfnwy (mgr.34427) 5807 : cluster [DBG] pgmap v3297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:36.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:36 gibba013 bash[30381]: cluster 2021-03-10T15:42:35.167725+0000 mgr.gibba020.yqfnwy (mgr.34427) 5807 : cluster [DBG] pgmap v3297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:36.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:36 gibba020 bash[25448]: cluster 2021-03-10T15:42:35.167725+0000 mgr.gibba020.yqfnwy (mgr.34427) 5807 : cluster [DBG] pgmap v3297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:38.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:38 gibba013 bash[29418]: cluster 2021-03-10T15:42:37.168903+0000 mgr.gibba020.yqfnwy (mgr.34427) 5808 : cluster [DBG] pgmap v3298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:38.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:38 gibba013 bash[30381]: cluster 2021-03-10T15:42:37.168903+0000 mgr.gibba020.yqfnwy (mgr.34427) 5808 : cluster [DBG] pgmap v3298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:38.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:38 gibba020 bash[25448]: cluster 2021-03-10T15:42:37.168903+0000 mgr.gibba020.yqfnwy (mgr.34427) 5808 : cluster [DBG] pgmap v3298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:40.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:40 gibba013 bash[29418]: cluster 2021-03-10T15:42:39.170582+0000 mgr.gibba020.yqfnwy (mgr.34427) 5809 : cluster [DBG] pgmap v3299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:40.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:40 gibba013 bash[30381]: cluster 2021-03-10T15:42:39.170582+0000 mgr.gibba020.yqfnwy (mgr.34427) 5809 : cluster [DBG] pgmap v3299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:40.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:40 gibba020 bash[25448]: cluster 2021-03-10T15:42:39.170582+0000 mgr.gibba020.yqfnwy (mgr.34427) 5809 : cluster [DBG] pgmap v3299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:42.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:42 gibba013 bash[29418]: cluster 2021-03-10T15:42:41.171430+0000 mgr.gibba020.yqfnwy (mgr.34427) 5810 : cluster [DBG] pgmap v3300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:42.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:42 gibba013 bash[30381]: cluster 2021-03-10T15:42:41.171430+0000 mgr.gibba020.yqfnwy (mgr.34427) 5810 : cluster [DBG] pgmap v3300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:42.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:42 gibba020 bash[25448]: cluster 2021-03-10T15:42:41.171430+0000 mgr.gibba020.yqfnwy (mgr.34427) 5810 : cluster [DBG] pgmap v3300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:44.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:43 gibba020 bash[25448]: cluster 2021-03-10T15:42:43.172766+0000 mgr.gibba020.yqfnwy (mgr.34427) 5811 : cluster [DBG] pgmap v3301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:44.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:43 gibba013 bash[29418]: cluster 2021-03-10T15:42:43.172766+0000 mgr.gibba020.yqfnwy (mgr.34427) 5811 : cluster [DBG] pgmap v3301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:44.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:43 gibba013 bash[30381]: cluster 2021-03-10T15:42:43.172766+0000 mgr.gibba020.yqfnwy (mgr.34427) 5811 : cluster [DBG] pgmap v3301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:46.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:46 gibba013 bash[29418]: cluster 2021-03-10T15:42:45.174416+0000 mgr.gibba020.yqfnwy (mgr.34427) 5812 : cluster [DBG] pgmap v3302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:46.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:46 gibba013 bash[30381]: cluster 2021-03-10T15:42:45.174416+0000 mgr.gibba020.yqfnwy (mgr.34427) 5812 : cluster [DBG] pgmap v3302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:46.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:46 gibba020 bash[25448]: cluster 2021-03-10T15:42:45.174416+0000 mgr.gibba020.yqfnwy (mgr.34427) 5812 : cluster [DBG] pgmap v3302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:48.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:48 gibba013 bash[29418]: cluster 2021-03-10T15:42:47.175167+0000 mgr.gibba020.yqfnwy (mgr.34427) 5813 : cluster [DBG] pgmap v3303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:48.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:48 gibba013 bash[29418]: cephadm 2021-03-10T15:42:47.274190+0000 mgr.gibba020.yqfnwy (mgr.34427) 5814 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:42:48.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:48 gibba013 bash[30381]: cluster 2021-03-10T15:42:47.175167+0000 mgr.gibba020.yqfnwy (mgr.34427) 5813 : cluster [DBG] pgmap v3303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:48.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:48 gibba013 bash[30381]: cephadm 2021-03-10T15:42:47.274190+0000 mgr.gibba020.yqfnwy (mgr.34427) 5814 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:42:48.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:48 gibba020 bash[25448]: cluster 2021-03-10T15:42:47.175167+0000 mgr.gibba020.yqfnwy (mgr.34427) 5813 : cluster [DBG] pgmap v3303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:48.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:48 gibba020 bash[25448]: cephadm 2021-03-10T15:42:47.274190+0000 mgr.gibba020.yqfnwy (mgr.34427) 5814 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:42:50.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:50 gibba013 bash[29418]: cluster 2021-03-10T15:42:49.176637+0000 mgr.gibba020.yqfnwy (mgr.34427) 5815 : cluster [DBG] pgmap v3304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:50.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:50 gibba013 bash[30381]: cluster 2021-03-10T15:42:49.176637+0000 mgr.gibba020.yqfnwy (mgr.34427) 5815 : cluster [DBG] pgmap v3304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:50.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:50 gibba020 bash[25448]: cluster 2021-03-10T15:42:49.176637+0000 mgr.gibba020.yqfnwy (mgr.34427) 5815 : cluster [DBG] pgmap v3304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:52.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:52 gibba013 bash[29418]: cluster 2021-03-10T15:42:51.178417+0000 mgr.gibba020.yqfnwy (mgr.34427) 5816 : cluster [DBG] pgmap v3305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:52.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:52 gibba013 bash[30381]: cluster 2021-03-10T15:42:51.178417+0000 mgr.gibba020.yqfnwy (mgr.34427) 5816 : cluster [DBG] pgmap v3305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:52.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:52 gibba020 bash[25448]: cluster 2021-03-10T15:42:51.178417+0000 mgr.gibba020.yqfnwy (mgr.34427) 5816 : cluster [DBG] pgmap v3305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:54.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:53 gibba020 bash[25448]: cluster 2021-03-10T15:42:53.179019+0000 mgr.gibba020.yqfnwy (mgr.34427) 5817 : cluster [DBG] pgmap v3306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:54.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:53 gibba013 bash[29418]: cluster 2021-03-10T15:42:53.179019+0000 mgr.gibba020.yqfnwy (mgr.34427) 5817 : cluster [DBG] pgmap v3306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:54.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:53 gibba013 bash[30381]: cluster 2021-03-10T15:42:53.179019+0000 mgr.gibba020.yqfnwy (mgr.34427) 5817 : cluster [DBG] pgmap v3306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:56.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:56 gibba013 bash[29418]: cluster 2021-03-10T15:42:55.180768+0000 mgr.gibba020.yqfnwy (mgr.34427) 5818 : cluster [DBG] pgmap v3307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:56.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:56 gibba013 bash[30381]: cluster 2021-03-10T15:42:55.180768+0000 mgr.gibba020.yqfnwy (mgr.34427) 5818 : cluster [DBG] pgmap v3307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:56.700 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:42:56.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:56 gibba020 bash[25448]: cluster 2021-03-10T15:42:55.180768+0000 mgr.gibba020.yqfnwy (mgr.34427) 5818 : cluster [DBG] pgmap v3307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:56.932 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:42:56.932 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (109m) 3m ago 114m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:42:56.932 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (114m) 2m ago 114m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:42:56.932 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (109m) 2m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:42:56.933 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (110m) 2m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:42:56.933 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (109m) 3m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:42:56.933 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (108m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:42:56.933 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (108m) 2m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:42:56.934 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (108m) 3m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:42:56.934 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (114m) 3m ago 115m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:42:56.934 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (114m) 2m ago 115m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:42:56.934 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (107m) 3m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:42:56.935 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (107m) 3m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:42:56.935 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (106m) 3m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:42:56.935 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (106m) 3m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:42:56.935 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (105m) 2m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:42:56.935 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (105m) 2m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:42:56.936 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (105m) 2m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:42:56.936 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (104m) 2m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:42:56.936 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (114m) 2m ago 115m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:42:56.936 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 112m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:42:57.177 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:42:57.178 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:42:57.178 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:42:57.178 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:42:57.178 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:42:57.179 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:42:57.179 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:42:57.179 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:42:57.179 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:42:57.180 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:42:57.180 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:42:57.180 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:42:57.180 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:42:57.180 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:42:57.181 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:42:57.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:57 gibba013 bash[29418]: audit 2021-03-10T15:42:57.173848+0000 mon.a (mon.0) 2310 : audit [DBG] from='client.? 172.21.2.113:0/3511360978' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:57.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:57 gibba013 bash[30381]: audit 2021-03-10T15:42:57.173848+0000 mon.a (mon.0) 2310 : audit [DBG] from='client.? 172.21.2.113:0/3511360978' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:57.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:57 gibba020 bash[25448]: audit 2021-03-10T15:42:57.173848+0000 mon.a (mon.0) 2310 : audit [DBG] from='client.? 172.21.2.113:0/3511360978' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:42:58.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:58 gibba013 bash[29418]: audit 2021-03-10T15:42:56.688512+0000 mgr.gibba020.yqfnwy (mgr.34427) 5819 : audit [DBG] from='client.47958 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:42:58.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:58 gibba013 bash[29418]: audit 2021-03-10T15:42:56.914861+0000 mgr.gibba020.yqfnwy (mgr.34427) 5820 : audit [DBG] from='client.47964 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:42:58.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:42:58 gibba013 bash[29418]: cluster 2021-03-10T15:42:57.182023+0000 mgr.gibba020.yqfnwy (mgr.34427) 5821 : cluster [DBG] pgmap v3308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:58.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:58 gibba013 bash[30381]: audit 2021-03-10T15:42:56.688512+0000 mgr.gibba020.yqfnwy (mgr.34427) 5819 : audit [DBG] from='client.47958 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:42:58.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:58 gibba013 bash[30381]: audit 2021-03-10T15:42:56.914861+0000 mgr.gibba020.yqfnwy (mgr.34427) 5820 : audit [DBG] from='client.47964 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:42:58.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:42:58 gibba013 bash[30381]: cluster 2021-03-10T15:42:57.182023+0000 mgr.gibba020.yqfnwy (mgr.34427) 5821 : cluster [DBG] pgmap v3308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:42:58.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:58 gibba020 bash[25448]: audit 2021-03-10T15:42:56.688512+0000 mgr.gibba020.yqfnwy (mgr.34427) 5819 : audit [DBG] from='client.47958 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:42:58.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:58 gibba020 bash[25448]: audit 2021-03-10T15:42:56.914861+0000 mgr.gibba020.yqfnwy (mgr.34427) 5820 : audit [DBG] from='client.47964 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:42:58.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:42:58 gibba020 bash[25448]: cluster 2021-03-10T15:42:57.182023+0000 mgr.gibba020.yqfnwy (mgr.34427) 5821 : cluster [DBG] pgmap v3308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:00.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:00 gibba013 bash[29418]: cluster 2021-03-10T15:42:59.182813+0000 mgr.gibba020.yqfnwy (mgr.34427) 5822 : cluster [DBG] pgmap v3309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:00.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:00 gibba013 bash[30381]: cluster 2021-03-10T15:42:59.182813+0000 mgr.gibba020.yqfnwy (mgr.34427) 5822 : cluster [DBG] pgmap v3309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:00.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:00 gibba020 bash[25448]: cluster 2021-03-10T15:42:59.182813+0000 mgr.gibba020.yqfnwy (mgr.34427) 5822 : cluster [DBG] pgmap v3309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:02.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:02 gibba013 bash[29418]: cluster 2021-03-10T15:43:01.184482+0000 mgr.gibba020.yqfnwy (mgr.34427) 5823 : cluster [DBG] pgmap v3310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:02.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:02 gibba013 bash[30381]: cluster 2021-03-10T15:43:01.184482+0000 mgr.gibba020.yqfnwy (mgr.34427) 5823 : cluster [DBG] pgmap v3310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:02.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:02 gibba020 bash[25448]: cluster 2021-03-10T15:43:01.184482+0000 mgr.gibba020.yqfnwy (mgr.34427) 5823 : cluster [DBG] pgmap v3310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:03.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:03 gibba013 bash[29418]: cephadm 2021-03-10T15:43:02.288604+0000 mgr.gibba020.yqfnwy (mgr.34427) 5824 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:43:03.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:03 gibba013 bash[30381]: cephadm 2021-03-10T15:43:02.288604+0000 mgr.gibba020.yqfnwy (mgr.34427) 5824 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:43:03.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:03 gibba020 bash[25448]: cephadm 2021-03-10T15:43:02.288604+0000 mgr.gibba020.yqfnwy (mgr.34427) 5824 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:43:04.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:04 gibba013 bash[29418]: cluster 2021-03-10T15:43:03.185944+0000 mgr.gibba020.yqfnwy (mgr.34427) 5825 : cluster [DBG] pgmap v3311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:04.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:04 gibba013 bash[30381]: cluster 2021-03-10T15:43:03.185944+0000 mgr.gibba020.yqfnwy (mgr.34427) 5825 : cluster [DBG] pgmap v3311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:04.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:04 gibba020 bash[25448]: cluster 2021-03-10T15:43:03.185944+0000 mgr.gibba020.yqfnwy (mgr.34427) 5825 : cluster [DBG] pgmap v3311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:06.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:06 gibba013 bash[29418]: cluster 2021-03-10T15:43:05.186893+0000 mgr.gibba020.yqfnwy (mgr.34427) 5826 : cluster [DBG] pgmap v3312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:06 gibba013 bash[30381]: cluster 2021-03-10T15:43:05.186893+0000 mgr.gibba020.yqfnwy (mgr.34427) 5826 : cluster [DBG] pgmap v3312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:06 gibba020 bash[25448]: cluster 2021-03-10T15:43:05.186893+0000 mgr.gibba020.yqfnwy (mgr.34427) 5826 : cluster [DBG] pgmap v3312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:07.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:07 gibba013 bash[29418]: audit 2021-03-10T15:43:06.526647+0000 mon.a (mon.0) 2311 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:43:07.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:07 gibba013 bash[29418]: audit 2021-03-10T15:43:06.611109+0000 mon.a (mon.0) 2312 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:43:07.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:07 gibba013 bash[29418]: audit 2021-03-10T15:43:06.722667+0000 mon.a (mon.0) 2313 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:43:07.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:07 gibba013 bash[29418]: audit 2021-03-10T15:43:06.723486+0000 mon.a (mon.0) 2314 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:43:07.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:07 gibba013 bash[29418]: audit 2021-03-10T15:43:06.724166+0000 mon.a (mon.0) 2315 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:43:07.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:07 gibba013 bash[29418]: audit 2021-03-10T15:43:06.724807+0000 mon.a (mon.0) 2316 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:43:07.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:07 gibba013 bash[30381]: audit 2021-03-10T15:43:06.526647+0000 mon.a (mon.0) 2311 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:43:07.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:07 gibba013 bash[30381]: audit 2021-03-10T15:43:06.611109+0000 mon.a (mon.0) 2312 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:43:07.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:07 gibba013 bash[30381]: audit 2021-03-10T15:43:06.722667+0000 mon.a (mon.0) 2313 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:43:07.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:07 gibba013 bash[30381]: audit 2021-03-10T15:43:06.723486+0000 mon.a (mon.0) 2314 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:43:07.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:07 gibba013 bash[30381]: audit 2021-03-10T15:43:06.724166+0000 mon.a (mon.0) 2315 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:43:07.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:07 gibba013 bash[30381]: audit 2021-03-10T15:43:06.724807+0000 mon.a (mon.0) 2316 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:43:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:07 gibba020 bash[25448]: audit 2021-03-10T15:43:06.526647+0000 mon.a (mon.0) 2311 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:43:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:07 gibba020 bash[25448]: audit 2021-03-10T15:43:06.611109+0000 mon.a (mon.0) 2312 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:43:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:07 gibba020 bash[25448]: audit 2021-03-10T15:43:06.722667+0000 mon.a (mon.0) 2313 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:43:07.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:07 gibba020 bash[25448]: audit 2021-03-10T15:43:06.723486+0000 mon.a (mon.0) 2314 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:43:07.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:07 gibba020 bash[25448]: audit 2021-03-10T15:43:06.724166+0000 mon.a (mon.0) 2315 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T15:43:07.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:07 gibba020 bash[25448]: audit 2021-03-10T15:43:06.724807+0000 mon.a (mon.0) 2316 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:43:08.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:08 gibba013 bash[29418]: cluster 2021-03-10T15:43:07.188185+0000 mgr.gibba020.yqfnwy (mgr.34427) 5827 : cluster [DBG] pgmap v3313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:08.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:08 gibba013 bash[30381]: cluster 2021-03-10T15:43:07.188185+0000 mgr.gibba020.yqfnwy (mgr.34427) 5827 : cluster [DBG] pgmap v3313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:08.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:08 gibba020 bash[25448]: cluster 2021-03-10T15:43:07.188185+0000 mgr.gibba020.yqfnwy (mgr.34427) 5827 : cluster [DBG] pgmap v3313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:10.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:10 gibba013 bash[29418]: cluster 2021-03-10T15:43:09.189884+0000 mgr.gibba020.yqfnwy (mgr.34427) 5828 : cluster [DBG] pgmap v3314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:10.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:10 gibba013 bash[30381]: cluster 2021-03-10T15:43:09.189884+0000 mgr.gibba020.yqfnwy (mgr.34427) 5828 : cluster [DBG] pgmap v3314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:10.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:10 gibba020 bash[25448]: cluster 2021-03-10T15:43:09.189884+0000 mgr.gibba020.yqfnwy (mgr.34427) 5828 : cluster [DBG] pgmap v3314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:12.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:12 gibba013 bash[29418]: cluster 2021-03-10T15:43:11.190873+0000 mgr.gibba020.yqfnwy (mgr.34427) 5829 : cluster [DBG] pgmap v3315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:12.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:12 gibba013 bash[30381]: cluster 2021-03-10T15:43:11.190873+0000 mgr.gibba020.yqfnwy (mgr.34427) 5829 : cluster [DBG] pgmap v3315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:12.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:12 gibba020 bash[25448]: cluster 2021-03-10T15:43:11.190873+0000 mgr.gibba020.yqfnwy (mgr.34427) 5829 : cluster [DBG] pgmap v3315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:14.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:13 gibba020 bash[25448]: cluster 2021-03-10T15:43:13.192171+0000 mgr.gibba020.yqfnwy (mgr.34427) 5830 : cluster [DBG] pgmap v3316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:14.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:13 gibba013 bash[29418]: cluster 2021-03-10T15:43:13.192171+0000 mgr.gibba020.yqfnwy (mgr.34427) 5830 : cluster [DBG] pgmap v3316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:14.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:13 gibba013 bash[30381]: cluster 2021-03-10T15:43:13.192171+0000 mgr.gibba020.yqfnwy (mgr.34427) 5830 : cluster [DBG] pgmap v3316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:16.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:16 gibba013 bash[29418]: cluster 2021-03-10T15:43:15.193911+0000 mgr.gibba020.yqfnwy (mgr.34427) 5831 : cluster [DBG] pgmap v3317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:16.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:16 gibba013 bash[30381]: cluster 2021-03-10T15:43:15.193911+0000 mgr.gibba020.yqfnwy (mgr.34427) 5831 : cluster [DBG] pgmap v3317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:16.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:16 gibba020 bash[25448]: cluster 2021-03-10T15:43:15.193911+0000 mgr.gibba020.yqfnwy (mgr.34427) 5831 : cluster [DBG] pgmap v3317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:18.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:18 gibba013 bash[29418]: cluster 2021-03-10T15:43:17.194594+0000 mgr.gibba020.yqfnwy (mgr.34427) 5832 : cluster [DBG] pgmap v3318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:18.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:18 gibba013 bash[29418]: cephadm 2021-03-10T15:43:17.292561+0000 mgr.gibba020.yqfnwy (mgr.34427) 5833 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:43:18.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:18 gibba013 bash[30381]: cluster 2021-03-10T15:43:17.194594+0000 mgr.gibba020.yqfnwy (mgr.34427) 5832 : cluster [DBG] pgmap v3318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:18.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:18 gibba013 bash[30381]: cephadm 2021-03-10T15:43:17.292561+0000 mgr.gibba020.yqfnwy (mgr.34427) 5833 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:43:18.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:18 gibba020 bash[25448]: cluster 2021-03-10T15:43:17.194594+0000 mgr.gibba020.yqfnwy (mgr.34427) 5832 : cluster [DBG] pgmap v3318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:18.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:18 gibba020 bash[25448]: cephadm 2021-03-10T15:43:17.292561+0000 mgr.gibba020.yqfnwy (mgr.34427) 5833 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:43:20.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:20 gibba013 bash[29418]: cluster 2021-03-10T15:43:19.196173+0000 mgr.gibba020.yqfnwy (mgr.34427) 5834 : cluster [DBG] pgmap v3319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:20.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:20 gibba013 bash[30381]: cluster 2021-03-10T15:43:19.196173+0000 mgr.gibba020.yqfnwy (mgr.34427) 5834 : cluster [DBG] pgmap v3319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:20.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:20 gibba020 bash[25448]: cluster 2021-03-10T15:43:19.196173+0000 mgr.gibba020.yqfnwy (mgr.34427) 5834 : cluster [DBG] pgmap v3319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:22.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:22 gibba013 bash[29418]: cluster 2021-03-10T15:43:21.198113+0000 mgr.gibba020.yqfnwy (mgr.34427) 5835 : cluster [DBG] pgmap v3320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:22.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:22 gibba013 bash[30381]: cluster 2021-03-10T15:43:21.198113+0000 mgr.gibba020.yqfnwy (mgr.34427) 5835 : cluster [DBG] pgmap v3320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:22.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:22 gibba020 bash[25448]: cluster 2021-03-10T15:43:21.198113+0000 mgr.gibba020.yqfnwy (mgr.34427) 5835 : cluster [DBG] pgmap v3320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:24.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:23 gibba020 bash[25448]: cluster 2021-03-10T15:43:23.199526+0000 mgr.gibba020.yqfnwy (mgr.34427) 5836 : cluster [DBG] pgmap v3321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:24.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:23 gibba013 bash[29418]: cluster 2021-03-10T15:43:23.199526+0000 mgr.gibba020.yqfnwy (mgr.34427) 5836 : cluster [DBG] pgmap v3321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:24.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:23 gibba013 bash[30381]: cluster 2021-03-10T15:43:23.199526+0000 mgr.gibba020.yqfnwy (mgr.34427) 5836 : cluster [DBG] pgmap v3321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:26.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:26 gibba013 bash[29418]: cluster 2021-03-10T15:43:25.201155+0000 mgr.gibba020.yqfnwy (mgr.34427) 5837 : cluster [DBG] pgmap v3322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:26.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:26 gibba013 bash[30381]: cluster 2021-03-10T15:43:25.201155+0000 mgr.gibba020.yqfnwy (mgr.34427) 5837 : cluster [DBG] pgmap v3322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:26.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:26 gibba020 bash[25448]: cluster 2021-03-10T15:43:25.201155+0000 mgr.gibba020.yqfnwy (mgr.34427) 5837 : cluster [DBG] pgmap v3322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:27.420 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:43:27.647 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:43:27.647 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (109m) 4m ago 115m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:43:27.648 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (115m) 2m ago 115m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:43:27.648 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (110m) 2m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:43:27.648 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (110m) 2m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:43:27.648 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (109m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:43:27.648 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (109m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:43:27.649 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (109m) 2m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:43:27.649 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (109m) 4m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:43:27.649 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (115m) 4m ago 115m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:43:27.649 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (115m) 2m ago 115m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:43:27.650 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (108m) 4m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:43:27.650 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (107m) 4m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:43:27.650 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (107m) 4m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:43:27.650 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (106m) 4m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:43:27.651 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (106m) 2m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:43:27.651 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (106m) 2m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:43:27.651 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (105m) 2m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:43:27.651 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (105m) 2m ago 115m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:43:27.651 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (114m) 2m ago 115m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:43:27.652 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 113m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:43:27.898 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:43:27.898 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:43:27.898 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:43:27.899 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:43:27.899 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:43:27.899 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:43:27.899 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:43:27.900 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:43:27.900 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:43:27.900 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:43:27.900 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:43:27.901 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:43:27.901 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:43:27.901 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:43:27.901 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:43:28.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:28 gibba013 bash[29418]: cluster 2021-03-10T15:43:27.202410+0000 mgr.gibba020.yqfnwy (mgr.34427) 5838 : cluster [DBG] pgmap v3323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:28.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:28 gibba013 bash[29418]: audit 2021-03-10T15:43:27.407407+0000 mgr.gibba020.yqfnwy (mgr.34427) 5839 : audit [DBG] from='client.47976 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:43:28.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:28 gibba013 bash[29418]: audit 2021-03-10T15:43:27.894564+0000 mon.c (mon.1) 95 : audit [DBG] from='client.? 172.21.2.113:0/1455481427' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:28.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:28 gibba013 bash[30381]: cluster 2021-03-10T15:43:27.202410+0000 mgr.gibba020.yqfnwy (mgr.34427) 5838 : cluster [DBG] pgmap v3323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:28.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:28 gibba013 bash[30381]: audit 2021-03-10T15:43:27.407407+0000 mgr.gibba020.yqfnwy (mgr.34427) 5839 : audit [DBG] from='client.47976 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:43:28.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:28 gibba013 bash[30381]: audit 2021-03-10T15:43:27.894564+0000 mon.c (mon.1) 95 : audit [DBG] from='client.? 172.21.2.113:0/1455481427' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:28.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:28 gibba020 bash[25448]: cluster 2021-03-10T15:43:27.202410+0000 mgr.gibba020.yqfnwy (mgr.34427) 5838 : cluster [DBG] pgmap v3323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:28.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:28 gibba020 bash[25448]: audit 2021-03-10T15:43:27.407407+0000 mgr.gibba020.yqfnwy (mgr.34427) 5839 : audit [DBG] from='client.47976 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:43:28.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:28 gibba020 bash[25448]: audit 2021-03-10T15:43:27.894564+0000 mon.c (mon.1) 95 : audit [DBG] from='client.? 172.21.2.113:0/1455481427' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:29.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:29 gibba013 bash[29418]: audit 2021-03-10T15:43:27.630497+0000 mgr.gibba020.yqfnwy (mgr.34427) 5840 : audit [DBG] from='client.47982 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:43:29.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:29 gibba013 bash[30381]: audit 2021-03-10T15:43:27.630497+0000 mgr.gibba020.yqfnwy (mgr.34427) 5840 : audit [DBG] from='client.47982 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:43:29.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:29 gibba020 bash[25448]: audit 2021-03-10T15:43:27.630497+0000 mgr.gibba020.yqfnwy (mgr.34427) 5840 : audit [DBG] from='client.47982 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:43:30.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:30 gibba013 bash[29418]: cluster 2021-03-10T15:43:29.203438+0000 mgr.gibba020.yqfnwy (mgr.34427) 5841 : cluster [DBG] pgmap v3324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:30.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:30 gibba013 bash[30381]: cluster 2021-03-10T15:43:29.203438+0000 mgr.gibba020.yqfnwy (mgr.34427) 5841 : cluster [DBG] pgmap v3324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:30.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:30 gibba020 bash[25448]: cluster 2021-03-10T15:43:29.203438+0000 mgr.gibba020.yqfnwy (mgr.34427) 5841 : cluster [DBG] pgmap v3324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:32.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:32 gibba013 bash[29418]: cluster 2021-03-10T15:43:31.205232+0000 mgr.gibba020.yqfnwy (mgr.34427) 5842 : cluster [DBG] pgmap v3325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:32.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:32 gibba013 bash[30381]: cluster 2021-03-10T15:43:31.205232+0000 mgr.gibba020.yqfnwy (mgr.34427) 5842 : cluster [DBG] pgmap v3325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:32.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:32 gibba020 bash[25448]: cluster 2021-03-10T15:43:31.205232+0000 mgr.gibba020.yqfnwy (mgr.34427) 5842 : cluster [DBG] pgmap v3325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:33.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[29418]: audit 2021-03-10T15:43:32.309475+0000 mon.a (mon.0) 2317 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:43:33.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[29418]: cephadm 2021-03-10T15:43:32.310703+0000 mgr.gibba020.yqfnwy (mgr.34427) 5843 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:43:33.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[29418]: cephadm 2021-03-10T15:43:32.311145+0000 mgr.gibba020.yqfnwy (mgr.34427) 5844 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:43:33.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[29418]: audit 2021-03-10T15:43:32.501850+0000 mon.a (mon.0) 2318 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:43:33.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[29418]: cephadm 2021-03-10T15:43:32.503455+0000 mgr.gibba020.yqfnwy (mgr.34427) 5845 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:43:33.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[29418]: audit 2021-03-10T15:43:32.505111+0000 mon.a (mon.0) 2319 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:43:33.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[29418]: cephadm 2021-03-10T15:43:32.505194+0000 mgr.gibba020.yqfnwy (mgr.34427) 5846 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:43:33.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[29418]: cephadm 2021-03-10T15:43:32.506550+0000 mgr.gibba020.yqfnwy (mgr.34427) 5847 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:43:33.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[29418]: cephadm 2021-03-10T15:43:32.506607+0000 mgr.gibba020.yqfnwy (mgr.34427) 5848 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:43:33.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[29418]: audit 2021-03-10T15:43:32.506637+0000 mon.a (mon.0) 2320 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:33.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[29418]: audit 2021-03-10T15:43:32.507956+0000 mon.a (mon.0) 2321 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:33.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[29418]: cephadm 2021-03-10T15:43:32.508071+0000 mgr.gibba020.yqfnwy (mgr.34427) 5849 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:43:33.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[29418]: cephadm 2021-03-10T15:43:32.508146+0000 mgr.gibba020.yqfnwy (mgr.34427) 5850 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:43:33.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[29418]: cephadm 2021-03-10T15:43:32.509431+0000 mgr.gibba020.yqfnwy (mgr.34427) 5851 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:43:33.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[29418]: audit 2021-03-10T15:43:32.509473+0000 mon.a (mon.0) 2322 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:33.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[29418]: cephadm 2021-03-10T15:43:32.510716+0000 mgr.gibba020.yqfnwy (mgr.34427) 5852 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:43:33.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[29418]: cephadm 2021-03-10T15:43:32.510748+0000 mgr.gibba020.yqfnwy (mgr.34427) 5853 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:43:33.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[29418]: cephadm 2021-03-10T15:43:32.512063+0000 mgr.gibba020.yqfnwy (mgr.34427) 5854 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:43:33.639 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[29418]: audit 2021-03-10T15:43:32.512219+0000 mon.a (mon.0) 2323 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:33.639 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[29418]: cephadm 2021-03-10T15:43:32.512374+0000 mgr.gibba020.yqfnwy (mgr.34427) 5855 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:43:33.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[30381]: audit 2021-03-10T15:43:32.309475+0000 mon.a (mon.0) 2317 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:43:33.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[30381]: cephadm 2021-03-10T15:43:32.310703+0000 mgr.gibba020.yqfnwy (mgr.34427) 5843 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:43:33.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[30381]: cephadm 2021-03-10T15:43:32.311145+0000 mgr.gibba020.yqfnwy (mgr.34427) 5844 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:43:33.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[30381]: audit 2021-03-10T15:43:32.501850+0000 mon.a (mon.0) 2318 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:43:33.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[30381]: cephadm 2021-03-10T15:43:32.503455+0000 mgr.gibba020.yqfnwy (mgr.34427) 5845 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:43:33.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[30381]: audit 2021-03-10T15:43:32.505111+0000 mon.a (mon.0) 2319 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:43:33.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[30381]: cephadm 2021-03-10T15:43:32.505194+0000 mgr.gibba020.yqfnwy (mgr.34427) 5846 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:43:33.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[30381]: cephadm 2021-03-10T15:43:32.506550+0000 mgr.gibba020.yqfnwy (mgr.34427) 5847 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:43:33.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[30381]: cephadm 2021-03-10T15:43:32.506607+0000 mgr.gibba020.yqfnwy (mgr.34427) 5848 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:43:33.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[30381]: audit 2021-03-10T15:43:32.506637+0000 mon.a (mon.0) 2320 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:33.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[30381]: audit 2021-03-10T15:43:32.507956+0000 mon.a (mon.0) 2321 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:33.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[30381]: cephadm 2021-03-10T15:43:32.508071+0000 mgr.gibba020.yqfnwy (mgr.34427) 5849 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:43:33.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[30381]: cephadm 2021-03-10T15:43:32.508146+0000 mgr.gibba020.yqfnwy (mgr.34427) 5850 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:43:33.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[30381]: cephadm 2021-03-10T15:43:32.509431+0000 mgr.gibba020.yqfnwy (mgr.34427) 5851 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:43:33.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[30381]: audit 2021-03-10T15:43:32.509473+0000 mon.a (mon.0) 2322 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:33.644 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[30381]: cephadm 2021-03-10T15:43:32.510716+0000 mgr.gibba020.yqfnwy (mgr.34427) 5852 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:43:33.644 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[30381]: cephadm 2021-03-10T15:43:32.510748+0000 mgr.gibba020.yqfnwy (mgr.34427) 5853 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:43:33.644 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[30381]: cephadm 2021-03-10T15:43:32.512063+0000 mgr.gibba020.yqfnwy (mgr.34427) 5854 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:43:33.644 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[30381]: audit 2021-03-10T15:43:32.512219+0000 mon.a (mon.0) 2323 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:33.645 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[30381]: cephadm 2021-03-10T15:43:32.512374+0000 mgr.gibba020.yqfnwy (mgr.34427) 5855 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:43:33.645 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[29418]: audit 2021-03-10T15:43:32.513736+0000 mon.a (mon.0) 2324 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:33.646 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[29418]: cephadm 2021-03-10T15:43:32.514633+0000 mgr.gibba020.yqfnwy (mgr.34427) 5856 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:43:33.646 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[29418]: cephadm 2021-03-10T15:43:32.514668+0000 mgr.gibba020.yqfnwy (mgr.34427) 5857 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:43:33.646 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[29418]: cephadm 2021-03-10T15:43:32.514771+0000 mgr.gibba020.yqfnwy (mgr.34427) 5858 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:43:33.647 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[30381]: audit 2021-03-10T15:43:32.513736+0000 mon.a (mon.0) 2324 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:33.647 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[30381]: cephadm 2021-03-10T15:43:32.514633+0000 mgr.gibba020.yqfnwy (mgr.34427) 5856 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:43:33.648 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[30381]: cephadm 2021-03-10T15:43:32.514668+0000 mgr.gibba020.yqfnwy (mgr.34427) 5857 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:43:33.648 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:33 gibba013 bash[30381]: cephadm 2021-03-10T15:43:32.514771+0000 mgr.gibba020.yqfnwy (mgr.34427) 5858 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:43:33.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:33 gibba020 bash[25448]: audit 2021-03-10T15:43:32.309475+0000 mon.a (mon.0) 2317 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:43:33.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:33 gibba020 bash[25448]: cephadm 2021-03-10T15:43:32.310703+0000 mgr.gibba020.yqfnwy (mgr.34427) 5843 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:43:33.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:33 gibba020 bash[25448]: cephadm 2021-03-10T15:43:32.311145+0000 mgr.gibba020.yqfnwy (mgr.34427) 5844 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:43:33.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:33 gibba020 bash[25448]: audit 2021-03-10T15:43:32.501850+0000 mon.a (mon.0) 2318 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:43:33.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:33 gibba020 bash[25448]: cephadm 2021-03-10T15:43:32.503455+0000 mgr.gibba020.yqfnwy (mgr.34427) 5845 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:43:33.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:33 gibba020 bash[25448]: audit 2021-03-10T15:43:32.505111+0000 mon.a (mon.0) 2319 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:43:33.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:33 gibba020 bash[25448]: cephadm 2021-03-10T15:43:32.505194+0000 mgr.gibba020.yqfnwy (mgr.34427) 5846 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:43:33.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:33 gibba020 bash[25448]: cephadm 2021-03-10T15:43:32.506550+0000 mgr.gibba020.yqfnwy (mgr.34427) 5847 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:43:33.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:33 gibba020 bash[25448]: cephadm 2021-03-10T15:43:32.506607+0000 mgr.gibba020.yqfnwy (mgr.34427) 5848 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:43:33.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:33 gibba020 bash[25448]: audit 2021-03-10T15:43:32.506637+0000 mon.a (mon.0) 2320 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:33.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:33 gibba020 bash[25448]: audit 2021-03-10T15:43:32.507956+0000 mon.a (mon.0) 2321 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:33.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:33 gibba020 bash[25448]: cephadm 2021-03-10T15:43:32.508071+0000 mgr.gibba020.yqfnwy (mgr.34427) 5849 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:43:33.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:33 gibba020 bash[25448]: cephadm 2021-03-10T15:43:32.508146+0000 mgr.gibba020.yqfnwy (mgr.34427) 5850 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:43:33.706 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:33 gibba020 bash[25448]: cephadm 2021-03-10T15:43:32.509431+0000 mgr.gibba020.yqfnwy (mgr.34427) 5851 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:43:33.706 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:33 gibba020 bash[25448]: audit 2021-03-10T15:43:32.509473+0000 mon.a (mon.0) 2322 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:33.706 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:33 gibba020 bash[25448]: cephadm 2021-03-10T15:43:32.510716+0000 mgr.gibba020.yqfnwy (mgr.34427) 5852 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:43:33.707 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:33 gibba020 bash[25448]: cephadm 2021-03-10T15:43:32.510748+0000 mgr.gibba020.yqfnwy (mgr.34427) 5853 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:43:33.707 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:33 gibba020 bash[25448]: cephadm 2021-03-10T15:43:32.512063+0000 mgr.gibba020.yqfnwy (mgr.34427) 5854 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:43:33.707 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:33 gibba020 bash[25448]: audit 2021-03-10T15:43:32.512219+0000 mon.a (mon.0) 2323 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:33.708 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:33 gibba020 bash[25448]: cephadm 2021-03-10T15:43:32.512374+0000 mgr.gibba020.yqfnwy (mgr.34427) 5855 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:43:33.708 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:33 gibba020 bash[25448]: audit 2021-03-10T15:43:32.513736+0000 mon.a (mon.0) 2324 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:33.708 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:33 gibba020 bash[25448]: cephadm 2021-03-10T15:43:32.514633+0000 mgr.gibba020.yqfnwy (mgr.34427) 5856 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:43:33.708 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:33 gibba020 bash[25448]: cephadm 2021-03-10T15:43:32.514668+0000 mgr.gibba020.yqfnwy (mgr.34427) 5857 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:43:33.709 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:33 gibba020 bash[25448]: cephadm 2021-03-10T15:43:32.514771+0000 mgr.gibba020.yqfnwy (mgr.34427) 5858 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:43:34.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:34 gibba013 bash[29418]: cluster 2021-03-10T15:43:33.206652+0000 mgr.gibba020.yqfnwy (mgr.34427) 5859 : cluster [DBG] pgmap v3326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:34.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:34 gibba013 bash[30381]: cluster 2021-03-10T15:43:33.206652+0000 mgr.gibba020.yqfnwy (mgr.34427) 5859 : cluster [DBG] pgmap v3326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:34.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:34 gibba020 bash[25448]: cluster 2021-03-10T15:43:33.206652+0000 mgr.gibba020.yqfnwy (mgr.34427) 5859 : cluster [DBG] pgmap v3326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:36.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:36 gibba013 bash[29418]: cluster 2021-03-10T15:43:35.207705+0000 mgr.gibba020.yqfnwy (mgr.34427) 5860 : cluster [DBG] pgmap v3327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:36.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:36 gibba013 bash[30381]: cluster 2021-03-10T15:43:35.207705+0000 mgr.gibba020.yqfnwy (mgr.34427) 5860 : cluster [DBG] pgmap v3327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:36.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:36 gibba020 bash[25448]: cluster 2021-03-10T15:43:35.207705+0000 mgr.gibba020.yqfnwy (mgr.34427) 5860 : cluster [DBG] pgmap v3327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:38.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:38 gibba013 bash[29418]: cluster 2021-03-10T15:43:37.208987+0000 mgr.gibba020.yqfnwy (mgr.34427) 5861 : cluster [DBG] pgmap v3328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:38.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:38 gibba013 bash[30381]: cluster 2021-03-10T15:43:37.208987+0000 mgr.gibba020.yqfnwy (mgr.34427) 5861 : cluster [DBG] pgmap v3328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:38.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:38 gibba020 bash[25448]: cluster 2021-03-10T15:43:37.208987+0000 mgr.gibba020.yqfnwy (mgr.34427) 5861 : cluster [DBG] pgmap v3328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:40.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:40 gibba013 bash[29418]: cluster 2021-03-10T15:43:39.210669+0000 mgr.gibba020.yqfnwy (mgr.34427) 5862 : cluster [DBG] pgmap v3329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:40.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:40 gibba013 bash[30381]: cluster 2021-03-10T15:43:39.210669+0000 mgr.gibba020.yqfnwy (mgr.34427) 5862 : cluster [DBG] pgmap v3329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:40.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:40 gibba020 bash[25448]: cluster 2021-03-10T15:43:39.210669+0000 mgr.gibba020.yqfnwy (mgr.34427) 5862 : cluster [DBG] pgmap v3329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:42.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:42 gibba013 bash[29418]: cluster 2021-03-10T15:43:41.211975+0000 mgr.gibba020.yqfnwy (mgr.34427) 5863 : cluster [DBG] pgmap v3330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:42.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:42 gibba013 bash[30381]: cluster 2021-03-10T15:43:41.211975+0000 mgr.gibba020.yqfnwy (mgr.34427) 5863 : cluster [DBG] pgmap v3330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:42.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:42 gibba020 bash[25448]: cluster 2021-03-10T15:43:41.211975+0000 mgr.gibba020.yqfnwy (mgr.34427) 5863 : cluster [DBG] pgmap v3330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:44.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:43 gibba020 bash[25448]: cluster 2021-03-10T15:43:43.213327+0000 mgr.gibba020.yqfnwy (mgr.34427) 5864 : cluster [DBG] pgmap v3331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:44.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:43 gibba013 bash[29418]: cluster 2021-03-10T15:43:43.213327+0000 mgr.gibba020.yqfnwy (mgr.34427) 5864 : cluster [DBG] pgmap v3331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:44.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:43 gibba013 bash[30381]: cluster 2021-03-10T15:43:43.213327+0000 mgr.gibba020.yqfnwy (mgr.34427) 5864 : cluster [DBG] pgmap v3331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:46.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:46 gibba013 bash[29418]: cluster 2021-03-10T15:43:45.215219+0000 mgr.gibba020.yqfnwy (mgr.34427) 5865 : cluster [DBG] pgmap v3332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:46.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:46 gibba013 bash[30381]: cluster 2021-03-10T15:43:45.215219+0000 mgr.gibba020.yqfnwy (mgr.34427) 5865 : cluster [DBG] pgmap v3332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:46.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:46 gibba020 bash[25448]: cluster 2021-03-10T15:43:45.215219+0000 mgr.gibba020.yqfnwy (mgr.34427) 5865 : cluster [DBG] pgmap v3332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:48.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:48 gibba013 bash[29418]: cluster 2021-03-10T15:43:47.216299+0000 mgr.gibba020.yqfnwy (mgr.34427) 5866 : cluster [DBG] pgmap v3333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:48.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:48 gibba013 bash[29418]: cephadm 2021-03-10T15:43:47.530848+0000 mgr.gibba020.yqfnwy (mgr.34427) 5867 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:43:48.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:48 gibba013 bash[30381]: cluster 2021-03-10T15:43:47.216299+0000 mgr.gibba020.yqfnwy (mgr.34427) 5866 : cluster [DBG] pgmap v3333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:48.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:48 gibba013 bash[30381]: cephadm 2021-03-10T15:43:47.530848+0000 mgr.gibba020.yqfnwy (mgr.34427) 5867 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:43:48.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:48 gibba020 bash[25448]: cluster 2021-03-10T15:43:47.216299+0000 mgr.gibba020.yqfnwy (mgr.34427) 5866 : cluster [DBG] pgmap v3333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:48.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:48 gibba020 bash[25448]: cephadm 2021-03-10T15:43:47.530848+0000 mgr.gibba020.yqfnwy (mgr.34427) 5867 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:43:50.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:50 gibba013 bash[29418]: cluster 2021-03-10T15:43:49.217945+0000 mgr.gibba020.yqfnwy (mgr.34427) 5868 : cluster [DBG] pgmap v3334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:50.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:50 gibba013 bash[30381]: cluster 2021-03-10T15:43:49.217945+0000 mgr.gibba020.yqfnwy (mgr.34427) 5868 : cluster [DBG] pgmap v3334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:50.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:50 gibba020 bash[25448]: cluster 2021-03-10T15:43:49.217945+0000 mgr.gibba020.yqfnwy (mgr.34427) 5868 : cluster [DBG] pgmap v3334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:52.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:52 gibba013 bash[29418]: cluster 2021-03-10T15:43:51.219821+0000 mgr.gibba020.yqfnwy (mgr.34427) 5869 : cluster [DBG] pgmap v3335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:52.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:52 gibba013 bash[30381]: cluster 2021-03-10T15:43:51.219821+0000 mgr.gibba020.yqfnwy (mgr.34427) 5869 : cluster [DBG] pgmap v3335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:52.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:52 gibba020 bash[25448]: cluster 2021-03-10T15:43:51.219821+0000 mgr.gibba020.yqfnwy (mgr.34427) 5869 : cluster [DBG] pgmap v3335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:54.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:53 gibba020 bash[25448]: cluster 2021-03-10T15:43:53.221263+0000 mgr.gibba020.yqfnwy (mgr.34427) 5870 : cluster [DBG] pgmap v3336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:54.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:53 gibba013 bash[29418]: cluster 2021-03-10T15:43:53.221263+0000 mgr.gibba020.yqfnwy (mgr.34427) 5870 : cluster [DBG] pgmap v3336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:54.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:53 gibba013 bash[30381]: cluster 2021-03-10T15:43:53.221263+0000 mgr.gibba020.yqfnwy (mgr.34427) 5870 : cluster [DBG] pgmap v3336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:56.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:56 gibba013 bash[29418]: cluster 2021-03-10T15:43:55.222983+0000 mgr.gibba020.yqfnwy (mgr.34427) 5871 : cluster [DBG] pgmap v3337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:56.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:56 gibba013 bash[30381]: cluster 2021-03-10T15:43:55.222983+0000 mgr.gibba020.yqfnwy (mgr.34427) 5871 : cluster [DBG] pgmap v3337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:56.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:56 gibba020 bash[25448]: cluster 2021-03-10T15:43:55.222983+0000 mgr.gibba020.yqfnwy (mgr.34427) 5871 : cluster [DBG] pgmap v3337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:58.144 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:43:58.404 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:43:58.404 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (110m) 4m ago 115m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:43:58.404 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (115m) 3m ago 115m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:43:58.404 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (110m) 3m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:43:58.405 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (111m) 3m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:43:58.405 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (110m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:43:58.405 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (109m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:43:58.405 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (109m) 3m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:43:58.406 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (109m) 4m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:43:58.406 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (115m) 4m ago 116m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:43:58.406 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (116m) 3m ago 116m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:43:58.406 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (108m) 4m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:43:58.406 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (108m) 4m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:43:58.407 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (107m) 4m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:43:58.407 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (107m) 4m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:43:58.407 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (107m) 3m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:43:58.407 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (106m) 3m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:43:58.408 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (106m) 3m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:43:58.408 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (105m) 3m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:43:58.408 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (115m) 3m ago 116m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:43:58.408 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 3m ago 113m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:43:58.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:58 gibba013 bash[29418]: cluster 2021-03-10T15:43:57.224369+0000 mgr.gibba020.yqfnwy (mgr.34427) 5872 : cluster [DBG] pgmap v3338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:58.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:58 gibba013 bash[30381]: cluster 2021-03-10T15:43:57.224369+0000 mgr.gibba020.yqfnwy (mgr.34427) 5872 : cluster [DBG] pgmap v3338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:58.660 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:43:58.661 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:43:58.661 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:43:58.661 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:43:58.661 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:43:58.662 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:43:58.662 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:43:58.662 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:43:58.662 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:43:58.662 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:43:58.663 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:43:58.663 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:43:58.663 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:43:58.663 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:43:58.663 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:43:58.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:58 gibba020 bash[25448]: cluster 2021-03-10T15:43:57.224369+0000 mgr.gibba020.yqfnwy (mgr.34427) 5872 : cluster [DBG] pgmap v3338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:43:59.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:59 gibba013 bash[29418]: audit 2021-03-10T15:43:58.131580+0000 mgr.gibba020.yqfnwy (mgr.34427) 5873 : audit [DBG] from='client.47994 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:43:59.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:59 gibba013 bash[29418]: audit 2021-03-10T15:43:58.360260+0000 mgr.gibba020.yqfnwy (mgr.34427) 5874 : audit [DBG] from='client.48000 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:43:59.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:43:59 gibba013 bash[29418]: audit 2021-03-10T15:43:58.657658+0000 mon.c (mon.1) 96 : audit [DBG] from='client.? 172.21.2.113:0/1966229819' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:59.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:59 gibba013 bash[30381]: audit 2021-03-10T15:43:58.131580+0000 mgr.gibba020.yqfnwy (mgr.34427) 5873 : audit [DBG] from='client.47994 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:43:59.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:59 gibba013 bash[30381]: audit 2021-03-10T15:43:58.360260+0000 mgr.gibba020.yqfnwy (mgr.34427) 5874 : audit [DBG] from='client.48000 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:43:59.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:43:59 gibba013 bash[30381]: audit 2021-03-10T15:43:58.657658+0000 mon.c (mon.1) 96 : audit [DBG] from='client.? 172.21.2.113:0/1966229819' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:43:59.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:59 gibba020 bash[25448]: audit 2021-03-10T15:43:58.131580+0000 mgr.gibba020.yqfnwy (mgr.34427) 5873 : audit [DBG] from='client.47994 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:43:59.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:59 gibba020 bash[25448]: audit 2021-03-10T15:43:58.360260+0000 mgr.gibba020.yqfnwy (mgr.34427) 5874 : audit [DBG] from='client.48000 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:43:59.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:43:59 gibba020 bash[25448]: audit 2021-03-10T15:43:58.657658+0000 mon.c (mon.1) 96 : audit [DBG] from='client.? 172.21.2.113:0/1966229819' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:00.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:00 gibba013 bash[29418]: cluster 2021-03-10T15:43:59.225550+0000 mgr.gibba020.yqfnwy (mgr.34427) 5875 : cluster [DBG] pgmap v3339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:00.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:00 gibba013 bash[30381]: cluster 2021-03-10T15:43:59.225550+0000 mgr.gibba020.yqfnwy (mgr.34427) 5875 : cluster [DBG] pgmap v3339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:00.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:00 gibba020 bash[25448]: cluster 2021-03-10T15:43:59.225550+0000 mgr.gibba020.yqfnwy (mgr.34427) 5875 : cluster [DBG] pgmap v3339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:02.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:02 gibba013 bash[29418]: cluster 2021-03-10T15:44:01.227328+0000 mgr.gibba020.yqfnwy (mgr.34427) 5876 : cluster [DBG] pgmap v3340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:02.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:02 gibba013 bash[30381]: cluster 2021-03-10T15:44:01.227328+0000 mgr.gibba020.yqfnwy (mgr.34427) 5876 : cluster [DBG] pgmap v3340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:02.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:02 gibba020 bash[25448]: cluster 2021-03-10T15:44:01.227328+0000 mgr.gibba020.yqfnwy (mgr.34427) 5876 : cluster [DBG] pgmap v3340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:03.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:03 gibba013 bash[29418]: cephadm 2021-03-10T15:44:02.544162+0000 mgr.gibba020.yqfnwy (mgr.34427) 5877 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:44:03.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:03 gibba013 bash[30381]: cephadm 2021-03-10T15:44:02.544162+0000 mgr.gibba020.yqfnwy (mgr.34427) 5877 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:44:03.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:03 gibba020 bash[25448]: cephadm 2021-03-10T15:44:02.544162+0000 mgr.gibba020.yqfnwy (mgr.34427) 5877 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:44:04.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:04 gibba013 bash[29418]: cluster 2021-03-10T15:44:03.228922+0000 mgr.gibba020.yqfnwy (mgr.34427) 5878 : cluster [DBG] pgmap v3341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:04.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:04 gibba013 bash[30381]: cluster 2021-03-10T15:44:03.228922+0000 mgr.gibba020.yqfnwy (mgr.34427) 5878 : cluster [DBG] pgmap v3341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:04.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:04 gibba020 bash[25448]: cluster 2021-03-10T15:44:03.228922+0000 mgr.gibba020.yqfnwy (mgr.34427) 5878 : cluster [DBG] pgmap v3341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:06.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:06 gibba013 bash[29418]: cluster 2021-03-10T15:44:05.230518+0000 mgr.gibba020.yqfnwy (mgr.34427) 5879 : cluster [DBG] pgmap v3342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:06 gibba013 bash[30381]: cluster 2021-03-10T15:44:05.230518+0000 mgr.gibba020.yqfnwy (mgr.34427) 5879 : cluster [DBG] pgmap v3342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:06 gibba020 bash[25448]: cluster 2021-03-10T15:44:05.230518+0000 mgr.gibba020.yqfnwy (mgr.34427) 5879 : cluster [DBG] pgmap v3342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:07.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:07 gibba013 bash[29418]: audit 2021-03-10T15:44:06.532089+0000 mon.a (mon.0) 2325 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:44:07.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:07 gibba013 bash[29418]: audit 2021-03-10T15:44:06.617191+0000 mon.a (mon.0) 2326 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:44:07.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:07 gibba013 bash[29418]: audit 2021-03-10T15:44:06.728409+0000 mon.a (mon.0) 2327 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T15:44:07.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:07 gibba013 bash[29418]: audit 2021-03-10T15:44:06.729198+0000 mon.a (mon.0) 2328 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:44:07.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:07 gibba013 bash[29418]: audit 2021-03-10T15:44:06.729856+0000 mon.a (mon.0) 2329 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:44:07.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:07 gibba013 bash[29418]: audit 2021-03-10T15:44:06.730555+0000 mon.a (mon.0) 2330 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:44:07.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:07 gibba013 bash[30381]: audit 2021-03-10T15:44:06.532089+0000 mon.a (mon.0) 2325 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:44:07.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:07 gibba013 bash[30381]: audit 2021-03-10T15:44:06.617191+0000 mon.a (mon.0) 2326 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:44:07.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:07 gibba013 bash[30381]: audit 2021-03-10T15:44:06.728409+0000 mon.a (mon.0) 2327 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T15:44:07.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:07 gibba013 bash[30381]: audit 2021-03-10T15:44:06.729198+0000 mon.a (mon.0) 2328 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:44:07.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:07 gibba013 bash[30381]: audit 2021-03-10T15:44:06.729856+0000 mon.a (mon.0) 2329 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:44:07.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:07 gibba013 bash[30381]: audit 2021-03-10T15:44:06.730555+0000 mon.a (mon.0) 2330 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:44:07.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:07 gibba020 bash[25448]: audit 2021-03-10T15:44:06.532089+0000 mon.a (mon.0) 2325 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:44:07.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:07 gibba020 bash[25448]: audit 2021-03-10T15:44:06.617191+0000 mon.a (mon.0) 2326 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:44:07.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:07 gibba020 bash[25448]: audit 2021-03-10T15:44:06.728409+0000 mon.a (mon.0) 2327 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T15:44:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:07 gibba020 bash[25448]: audit 2021-03-10T15:44:06.729198+0000 mon.a (mon.0) 2328 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:44:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:07 gibba020 bash[25448]: audit 2021-03-10T15:44:06.729856+0000 mon.a (mon.0) 2329 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:44:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:07 gibba020 bash[25448]: audit 2021-03-10T15:44:06.730555+0000 mon.a (mon.0) 2330 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:44:08.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:08 gibba013 bash[29418]: cluster 2021-03-10T15:44:07.231889+0000 mgr.gibba020.yqfnwy (mgr.34427) 5880 : cluster [DBG] pgmap v3343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:08.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:08 gibba013 bash[30381]: cluster 2021-03-10T15:44:07.231889+0000 mgr.gibba020.yqfnwy (mgr.34427) 5880 : cluster [DBG] pgmap v3343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:08.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:08 gibba020 bash[25448]: cluster 2021-03-10T15:44:07.231889+0000 mgr.gibba020.yqfnwy (mgr.34427) 5880 : cluster [DBG] pgmap v3343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:10.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:10 gibba013 bash[29418]: cluster 2021-03-10T15:44:09.233323+0000 mgr.gibba020.yqfnwy (mgr.34427) 5881 : cluster [DBG] pgmap v3344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:10.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:10 gibba013 bash[30381]: cluster 2021-03-10T15:44:09.233323+0000 mgr.gibba020.yqfnwy (mgr.34427) 5881 : cluster [DBG] pgmap v3344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:10.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:10 gibba020 bash[25448]: cluster 2021-03-10T15:44:09.233323+0000 mgr.gibba020.yqfnwy (mgr.34427) 5881 : cluster [DBG] pgmap v3344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:12.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:12 gibba013 bash[29418]: cluster 2021-03-10T15:44:11.234534+0000 mgr.gibba020.yqfnwy (mgr.34427) 5882 : cluster [DBG] pgmap v3345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:12.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:12 gibba013 bash[30381]: cluster 2021-03-10T15:44:11.234534+0000 mgr.gibba020.yqfnwy (mgr.34427) 5882 : cluster [DBG] pgmap v3345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:12.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:12 gibba020 bash[25448]: cluster 2021-03-10T15:44:11.234534+0000 mgr.gibba020.yqfnwy (mgr.34427) 5882 : cluster [DBG] pgmap v3345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:14.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:13 gibba020 bash[25448]: cluster 2021-03-10T15:44:13.235906+0000 mgr.gibba020.yqfnwy (mgr.34427) 5883 : cluster [DBG] pgmap v3346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:14.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:13 gibba013 bash[29418]: cluster 2021-03-10T15:44:13.235906+0000 mgr.gibba020.yqfnwy (mgr.34427) 5883 : cluster [DBG] pgmap v3346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:14.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:13 gibba013 bash[30381]: cluster 2021-03-10T15:44:13.235906+0000 mgr.gibba020.yqfnwy (mgr.34427) 5883 : cluster [DBG] pgmap v3346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:16.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:16 gibba013 bash[29418]: cluster 2021-03-10T15:44:15.237709+0000 mgr.gibba020.yqfnwy (mgr.34427) 5884 : cluster [DBG] pgmap v3347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:16.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:16 gibba013 bash[30381]: cluster 2021-03-10T15:44:15.237709+0000 mgr.gibba020.yqfnwy (mgr.34427) 5884 : cluster [DBG] pgmap v3347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:16.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:16 gibba020 bash[25448]: cluster 2021-03-10T15:44:15.237709+0000 mgr.gibba020.yqfnwy (mgr.34427) 5884 : cluster [DBG] pgmap v3347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:18.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:18 gibba013 bash[29418]: cluster 2021-03-10T15:44:17.238767+0000 mgr.gibba020.yqfnwy (mgr.34427) 5885 : cluster [DBG] pgmap v3348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:18.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:18 gibba013 bash[29418]: cephadm 2021-03-10T15:44:17.560228+0000 mgr.gibba020.yqfnwy (mgr.34427) 5886 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:44:18.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:18 gibba013 bash[30381]: cluster 2021-03-10T15:44:17.238767+0000 mgr.gibba020.yqfnwy (mgr.34427) 5885 : cluster [DBG] pgmap v3348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:18.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:18 gibba013 bash[30381]: cephadm 2021-03-10T15:44:17.560228+0000 mgr.gibba020.yqfnwy (mgr.34427) 5886 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:44:18.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:18 gibba020 bash[25448]: cluster 2021-03-10T15:44:17.238767+0000 mgr.gibba020.yqfnwy (mgr.34427) 5885 : cluster [DBG] pgmap v3348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:18.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:18 gibba020 bash[25448]: cephadm 2021-03-10T15:44:17.560228+0000 mgr.gibba020.yqfnwy (mgr.34427) 5886 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:44:20.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:20 gibba013 bash[29418]: cluster 2021-03-10T15:44:19.240579+0000 mgr.gibba020.yqfnwy (mgr.34427) 5887 : cluster [DBG] pgmap v3349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:20.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:20 gibba013 bash[30381]: cluster 2021-03-10T15:44:19.240579+0000 mgr.gibba020.yqfnwy (mgr.34427) 5887 : cluster [DBG] pgmap v3349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:20.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:20 gibba020 bash[25448]: cluster 2021-03-10T15:44:19.240579+0000 mgr.gibba020.yqfnwy (mgr.34427) 5887 : cluster [DBG] pgmap v3349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:22.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:22 gibba013 bash[29418]: cluster 2021-03-10T15:44:21.242671+0000 mgr.gibba020.yqfnwy (mgr.34427) 5888 : cluster [DBG] pgmap v3350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:22.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:22 gibba013 bash[30381]: cluster 2021-03-10T15:44:21.242671+0000 mgr.gibba020.yqfnwy (mgr.34427) 5888 : cluster [DBG] pgmap v3350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:22.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:22 gibba020 bash[25448]: cluster 2021-03-10T15:44:21.242671+0000 mgr.gibba020.yqfnwy (mgr.34427) 5888 : cluster [DBG] pgmap v3350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:24.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:23 gibba020 bash[25448]: cluster 2021-03-10T15:44:23.244290+0000 mgr.gibba020.yqfnwy (mgr.34427) 5889 : cluster [DBG] pgmap v3351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:24.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:23 gibba013 bash[29418]: cluster 2021-03-10T15:44:23.244290+0000 mgr.gibba020.yqfnwy (mgr.34427) 5889 : cluster [DBG] pgmap v3351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:24.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:23 gibba013 bash[30381]: cluster 2021-03-10T15:44:23.244290+0000 mgr.gibba020.yqfnwy (mgr.34427) 5889 : cluster [DBG] pgmap v3351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:26.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:26 gibba013 bash[29418]: cluster 2021-03-10T15:44:25.246181+0000 mgr.gibba020.yqfnwy (mgr.34427) 5890 : cluster [DBG] pgmap v3352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:26.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:26 gibba013 bash[30381]: cluster 2021-03-10T15:44:25.246181+0000 mgr.gibba020.yqfnwy (mgr.34427) 5890 : cluster [DBG] pgmap v3352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:26.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:26 gibba020 bash[25448]: cluster 2021-03-10T15:44:25.246181+0000 mgr.gibba020.yqfnwy (mgr.34427) 5890 : cluster [DBG] pgmap v3352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:28.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:28 gibba013 bash[29418]: cluster 2021-03-10T15:44:27.247771+0000 mgr.gibba020.yqfnwy (mgr.34427) 5891 : cluster [DBG] pgmap v3353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:28.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:28 gibba013 bash[30381]: cluster 2021-03-10T15:44:27.247771+0000 mgr.gibba020.yqfnwy (mgr.34427) 5891 : cluster [DBG] pgmap v3353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:28.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:28 gibba020 bash[25448]: cluster 2021-03-10T15:44:27.247771+0000 mgr.gibba020.yqfnwy (mgr.34427) 5891 : cluster [DBG] pgmap v3353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:28.904 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:44:29.137 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:44:29.137 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (110m) 5m ago 116m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:44:29.138 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (116m) 3m ago 116m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:44:29.138 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (111m) 3m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:44:29.138 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (111m) 3m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:44:29.138 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (110m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:44:29.139 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (110m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:44:29.139 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (110m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:44:29.139 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (110m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:44:29.139 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (116m) 5m ago 116m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:44:29.139 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (116m) 3m ago 116m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:44:29.140 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (109m) 5m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:44:29.140 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (108m) 5m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:44:29.140 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (108m) 5m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:44:29.140 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (107m) 5m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:44:29.141 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (107m) 3m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:44:29.141 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (107m) 3m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:44:29.141 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (106m) 3m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:44:29.141 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (106m) 3m ago 116m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:44:29.141 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (115m) 3m ago 116m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:44:29.142 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 3m ago 114m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:44:29.387 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:44:29.388 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:44:29.388 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:44:29.388 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:44:29.388 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:44:29.389 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:44:29.389 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:44:29.389 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:44:29.389 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:44:29.389 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:44:29.390 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:44:29.390 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:44:29.390 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:44:29.390 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:44:29.391 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:44:30.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:30 gibba013 bash[29418]: audit 2021-03-10T15:44:28.891594+0000 mgr.gibba020.yqfnwy (mgr.34427) 5892 : audit [DBG] from='client.48012 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:44:30.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:30 gibba013 bash[29418]: audit 2021-03-10T15:44:29.117873+0000 mgr.gibba020.yqfnwy (mgr.34427) 5893 : audit [DBG] from='client.58003 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:44:30.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:30 gibba013 bash[29418]: cluster 2021-03-10T15:44:29.249212+0000 mgr.gibba020.yqfnwy (mgr.34427) 5894 : cluster [DBG] pgmap v3354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:30.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:30 gibba013 bash[29418]: audit 2021-03-10T15:44:29.384626+0000 mon.c (mon.1) 97 : audit [DBG] from='client.? 172.21.2.113:0/2603705798' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:30.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:30 gibba013 bash[30381]: audit 2021-03-10T15:44:28.891594+0000 mgr.gibba020.yqfnwy (mgr.34427) 5892 : audit [DBG] from='client.48012 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:44:30.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:30 gibba013 bash[30381]: audit 2021-03-10T15:44:29.117873+0000 mgr.gibba020.yqfnwy (mgr.34427) 5893 : audit [DBG] from='client.58003 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:44:30.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:30 gibba013 bash[30381]: cluster 2021-03-10T15:44:29.249212+0000 mgr.gibba020.yqfnwy (mgr.34427) 5894 : cluster [DBG] pgmap v3354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:30.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:30 gibba013 bash[30381]: audit 2021-03-10T15:44:29.384626+0000 mon.c (mon.1) 97 : audit [DBG] from='client.? 172.21.2.113:0/2603705798' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:30.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:30 gibba020 bash[25448]: audit 2021-03-10T15:44:28.891594+0000 mgr.gibba020.yqfnwy (mgr.34427) 5892 : audit [DBG] from='client.48012 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:44:30.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:30 gibba020 bash[25448]: audit 2021-03-10T15:44:29.117873+0000 mgr.gibba020.yqfnwy (mgr.34427) 5893 : audit [DBG] from='client.58003 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:44:30.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:30 gibba020 bash[25448]: cluster 2021-03-10T15:44:29.249212+0000 mgr.gibba020.yqfnwy (mgr.34427) 5894 : cluster [DBG] pgmap v3354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:30.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:30 gibba020 bash[25448]: audit 2021-03-10T15:44:29.384626+0000 mon.c (mon.1) 97 : audit [DBG] from='client.? 172.21.2.113:0/2603705798' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:32.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:32 gibba013 bash[29418]: cluster 2021-03-10T15:44:31.251088+0000 mgr.gibba020.yqfnwy (mgr.34427) 5895 : cluster [DBG] pgmap v3355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:32.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:32 gibba013 bash[30381]: cluster 2021-03-10T15:44:31.251088+0000 mgr.gibba020.yqfnwy (mgr.34427) 5895 : cluster [DBG] pgmap v3355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:32.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:32 gibba020 bash[25448]: cluster 2021-03-10T15:44:31.251088+0000 mgr.gibba020.yqfnwy (mgr.34427) 5895 : cluster [DBG] pgmap v3355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:33.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:33 gibba013 bash[29418]: audit 2021-03-10T15:44:32.574738+0000 mon.a (mon.0) 2331 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:44:33.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:33 gibba013 bash[29418]: cephadm 2021-03-10T15:44:32.579108+0000 mgr.gibba020.yqfnwy (mgr.34427) 5896 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:44:33.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:33 gibba013 bash[29418]: cephadm 2021-03-10T15:44:32.580987+0000 mgr.gibba020.yqfnwy (mgr.34427) 5897 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:44:33.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:33 gibba013 bash[29418]: audit 2021-03-10T15:44:32.815537+0000 mon.a (mon.0) 2332 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:44:33.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:33 gibba013 bash[29418]: audit 2021-03-10T15:44:32.822912+0000 mon.a (mon.0) 2333 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:44:33.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:33 gibba013 bash[29418]: audit 2021-03-10T15:44:32.824688+0000 mon.a (mon.0) 2334 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:33.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:33 gibba013 bash[29418]: audit 2021-03-10T15:44:32.826314+0000 mon.a (mon.0) 2335 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:33.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:33 gibba013 bash[29418]: audit 2021-03-10T15:44:32.827911+0000 mon.a (mon.0) 2336 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:33.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:33 gibba013 bash[29418]: audit 2021-03-10T15:44:32.830803+0000 mon.a (mon.0) 2337 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:33.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:33 gibba013 bash[29418]: audit 2021-03-10T15:44:32.832555+0000 mon.a (mon.0) 2338 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:33.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:33 gibba013 bash[30381]: audit 2021-03-10T15:44:32.574738+0000 mon.a (mon.0) 2331 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:44:33.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:33 gibba013 bash[30381]: cephadm 2021-03-10T15:44:32.579108+0000 mgr.gibba020.yqfnwy (mgr.34427) 5896 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:44:33.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:33 gibba013 bash[30381]: cephadm 2021-03-10T15:44:32.580987+0000 mgr.gibba020.yqfnwy (mgr.34427) 5897 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:44:33.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:33 gibba013 bash[30381]: audit 2021-03-10T15:44:32.815537+0000 mon.a (mon.0) 2332 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:44:33.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:33 gibba013 bash[30381]: audit 2021-03-10T15:44:32.822912+0000 mon.a (mon.0) 2333 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:44:33.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:33 gibba013 bash[30381]: audit 2021-03-10T15:44:32.824688+0000 mon.a (mon.0) 2334 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:33.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:33 gibba013 bash[30381]: audit 2021-03-10T15:44:32.826314+0000 mon.a (mon.0) 2335 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:33.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:33 gibba013 bash[30381]: audit 2021-03-10T15:44:32.827911+0000 mon.a (mon.0) 2336 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:33.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:33 gibba013 bash[30381]: audit 2021-03-10T15:44:32.830803+0000 mon.a (mon.0) 2337 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:33.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:33 gibba013 bash[30381]: audit 2021-03-10T15:44:32.832555+0000 mon.a (mon.0) 2338 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:33.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:33 gibba020 bash[25448]: audit 2021-03-10T15:44:32.574738+0000 mon.a (mon.0) 2331 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:44:33.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:33 gibba020 bash[25448]: cephadm 2021-03-10T15:44:32.579108+0000 mgr.gibba020.yqfnwy (mgr.34427) 5896 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:44:33.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:33 gibba020 bash[25448]: cephadm 2021-03-10T15:44:32.580987+0000 mgr.gibba020.yqfnwy (mgr.34427) 5897 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:44:33.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:33 gibba020 bash[25448]: audit 2021-03-10T15:44:32.815537+0000 mon.a (mon.0) 2332 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:44:33.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:33 gibba020 bash[25448]: audit 2021-03-10T15:44:32.822912+0000 mon.a (mon.0) 2333 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:44:33.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:33 gibba020 bash[25448]: audit 2021-03-10T15:44:32.824688+0000 mon.a (mon.0) 2334 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:33.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:33 gibba020 bash[25448]: audit 2021-03-10T15:44:32.826314+0000 mon.a (mon.0) 2335 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:33.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:33 gibba020 bash[25448]: audit 2021-03-10T15:44:32.827911+0000 mon.a (mon.0) 2336 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:33.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:33 gibba020 bash[25448]: audit 2021-03-10T15:44:32.830803+0000 mon.a (mon.0) 2337 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:33.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:33 gibba020 bash[25448]: audit 2021-03-10T15:44:32.832555+0000 mon.a (mon.0) 2338 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:44:34.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:34 gibba013 bash[29418]: cephadm 2021-03-10T15:44:32.820984+0000 mgr.gibba020.yqfnwy (mgr.34427) 5898 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:44:34.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:34 gibba013 bash[29418]: cephadm 2021-03-10T15:44:32.823214+0000 mgr.gibba020.yqfnwy (mgr.34427) 5899 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:44:34.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:34 gibba013 bash[29418]: cephadm 2021-03-10T15:44:32.824886+0000 mgr.gibba020.yqfnwy (mgr.34427) 5900 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:44:34.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:34 gibba013 bash[29418]: cephadm 2021-03-10T15:44:32.824927+0000 mgr.gibba020.yqfnwy (mgr.34427) 5901 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:44:34.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:34 gibba013 bash[29418]: cephadm 2021-03-10T15:44:32.826484+0000 mgr.gibba020.yqfnwy (mgr.34427) 5902 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:44:34.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:34 gibba013 bash[29418]: cephadm 2021-03-10T15:44:32.826525+0000 mgr.gibba020.yqfnwy (mgr.34427) 5903 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:44:34.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:34 gibba013 bash[29418]: cephadm 2021-03-10T15:44:32.827946+0000 mgr.gibba020.yqfnwy (mgr.34427) 5904 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:44:34.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:34 gibba013 bash[29418]: cephadm 2021-03-10T15:44:32.829251+0000 mgr.gibba020.yqfnwy (mgr.34427) 5905 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:44:34.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:34 gibba013 bash[29418]: cephadm 2021-03-10T15:44:32.829294+0000 mgr.gibba020.yqfnwy (mgr.34427) 5906 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:44:34.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:34 gibba013 bash[29418]: cephadm 2021-03-10T15:44:32.830842+0000 mgr.gibba020.yqfnwy (mgr.34427) 5907 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:44:34.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:34 gibba013 bash[29418]: cephadm 2021-03-10T15:44:32.831198+0000 mgr.gibba020.yqfnwy (mgr.34427) 5908 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:44:34.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:34 gibba013 bash[29418]: cephadm 2021-03-10T15:44:32.832606+0000 mgr.gibba020.yqfnwy (mgr.34427) 5909 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:44:34.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:34 gibba013 bash[29418]: cephadm 2021-03-10T15:44:32.832649+0000 mgr.gibba020.yqfnwy (mgr.34427) 5910 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:44:34.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:34 gibba013 bash[29418]: cephadm 2021-03-10T15:44:32.832845+0000 mgr.gibba020.yqfnwy (mgr.34427) 5911 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:44:34.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:34 gibba013 bash[29418]: cluster 2021-03-10T15:44:33.252627+0000 mgr.gibba020.yqfnwy (mgr.34427) 5912 : cluster [DBG] pgmap v3356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:34.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:34 gibba013 bash[30381]: cephadm 2021-03-10T15:44:32.820984+0000 mgr.gibba020.yqfnwy (mgr.34427) 5898 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:44:34.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:34 gibba013 bash[30381]: cephadm 2021-03-10T15:44:32.823214+0000 mgr.gibba020.yqfnwy (mgr.34427) 5899 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:44:34.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:34 gibba013 bash[30381]: cephadm 2021-03-10T15:44:32.824886+0000 mgr.gibba020.yqfnwy (mgr.34427) 5900 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:44:34.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:34 gibba013 bash[30381]: cephadm 2021-03-10T15:44:32.824927+0000 mgr.gibba020.yqfnwy (mgr.34427) 5901 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:44:34.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:34 gibba013 bash[30381]: cephadm 2021-03-10T15:44:32.826484+0000 mgr.gibba020.yqfnwy (mgr.34427) 5902 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:44:34.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:34 gibba013 bash[30381]: cephadm 2021-03-10T15:44:32.826525+0000 mgr.gibba020.yqfnwy (mgr.34427) 5903 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:44:34.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:34 gibba013 bash[30381]: cephadm 2021-03-10T15:44:32.827946+0000 mgr.gibba020.yqfnwy (mgr.34427) 5904 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:44:34.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:34 gibba013 bash[30381]: cephadm 2021-03-10T15:44:32.829251+0000 mgr.gibba020.yqfnwy (mgr.34427) 5905 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:44:34.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:34 gibba013 bash[30381]: cephadm 2021-03-10T15:44:32.829294+0000 mgr.gibba020.yqfnwy (mgr.34427) 5906 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:44:34.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:34 gibba013 bash[30381]: cephadm 2021-03-10T15:44:32.830842+0000 mgr.gibba020.yqfnwy (mgr.34427) 5907 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:44:34.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:34 gibba013 bash[30381]: cephadm 2021-03-10T15:44:32.831198+0000 mgr.gibba020.yqfnwy (mgr.34427) 5908 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:44:34.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:34 gibba013 bash[30381]: cephadm 2021-03-10T15:44:32.832606+0000 mgr.gibba020.yqfnwy (mgr.34427) 5909 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:44:34.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:34 gibba013 bash[30381]: cephadm 2021-03-10T15:44:32.832649+0000 mgr.gibba020.yqfnwy (mgr.34427) 5910 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:44:34.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:34 gibba013 bash[30381]: cephadm 2021-03-10T15:44:32.832845+0000 mgr.gibba020.yqfnwy (mgr.34427) 5911 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:44:34.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:34 gibba013 bash[30381]: cluster 2021-03-10T15:44:33.252627+0000 mgr.gibba020.yqfnwy (mgr.34427) 5912 : cluster [DBG] pgmap v3356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:34.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:34 gibba020 bash[25448]: cephadm 2021-03-10T15:44:32.820984+0000 mgr.gibba020.yqfnwy (mgr.34427) 5898 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:44:34.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:34 gibba020 bash[25448]: cephadm 2021-03-10T15:44:32.823214+0000 mgr.gibba020.yqfnwy (mgr.34427) 5899 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:44:34.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:34 gibba020 bash[25448]: cephadm 2021-03-10T15:44:32.824886+0000 mgr.gibba020.yqfnwy (mgr.34427) 5900 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:44:34.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:34 gibba020 bash[25448]: cephadm 2021-03-10T15:44:32.824927+0000 mgr.gibba020.yqfnwy (mgr.34427) 5901 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:44:34.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:34 gibba020 bash[25448]: cephadm 2021-03-10T15:44:32.826484+0000 mgr.gibba020.yqfnwy (mgr.34427) 5902 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:44:34.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:34 gibba020 bash[25448]: cephadm 2021-03-10T15:44:32.826525+0000 mgr.gibba020.yqfnwy (mgr.34427) 5903 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:44:34.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:34 gibba020 bash[25448]: cephadm 2021-03-10T15:44:32.827946+0000 mgr.gibba020.yqfnwy (mgr.34427) 5904 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:44:34.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:34 gibba020 bash[25448]: cephadm 2021-03-10T15:44:32.829251+0000 mgr.gibba020.yqfnwy (mgr.34427) 5905 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:44:34.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:34 gibba020 bash[25448]: cephadm 2021-03-10T15:44:32.829294+0000 mgr.gibba020.yqfnwy (mgr.34427) 5906 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:44:34.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:34 gibba020 bash[25448]: cephadm 2021-03-10T15:44:32.830842+0000 mgr.gibba020.yqfnwy (mgr.34427) 5907 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:44:34.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:34 gibba020 bash[25448]: cephadm 2021-03-10T15:44:32.831198+0000 mgr.gibba020.yqfnwy (mgr.34427) 5908 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:44:34.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:34 gibba020 bash[25448]: cephadm 2021-03-10T15:44:32.832606+0000 mgr.gibba020.yqfnwy (mgr.34427) 5909 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:44:34.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:34 gibba020 bash[25448]: cephadm 2021-03-10T15:44:32.832649+0000 mgr.gibba020.yqfnwy (mgr.34427) 5910 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:44:34.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:34 gibba020 bash[25448]: cephadm 2021-03-10T15:44:32.832845+0000 mgr.gibba020.yqfnwy (mgr.34427) 5911 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:44:34.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:34 gibba020 bash[25448]: cluster 2021-03-10T15:44:33.252627+0000 mgr.gibba020.yqfnwy (mgr.34427) 5912 : cluster [DBG] pgmap v3356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:36.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:36 gibba013 bash[29418]: cluster 2021-03-10T15:44:35.254678+0000 mgr.gibba020.yqfnwy (mgr.34427) 5913 : cluster [DBG] pgmap v3357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:36.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:36 gibba013 bash[30381]: cluster 2021-03-10T15:44:35.254678+0000 mgr.gibba020.yqfnwy (mgr.34427) 5913 : cluster [DBG] pgmap v3357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:36.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:36 gibba020 bash[25448]: cluster 2021-03-10T15:44:35.254678+0000 mgr.gibba020.yqfnwy (mgr.34427) 5913 : cluster [DBG] pgmap v3357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:38.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:38 gibba013 bash[29418]: cluster 2021-03-10T15:44:37.256050+0000 mgr.gibba020.yqfnwy (mgr.34427) 5914 : cluster [DBG] pgmap v3358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:38.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:38 gibba013 bash[30381]: cluster 2021-03-10T15:44:37.256050+0000 mgr.gibba020.yqfnwy (mgr.34427) 5914 : cluster [DBG] pgmap v3358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:38.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:38 gibba020 bash[25448]: cluster 2021-03-10T15:44:37.256050+0000 mgr.gibba020.yqfnwy (mgr.34427) 5914 : cluster [DBG] pgmap v3358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:40.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:40 gibba013 bash[29418]: cluster 2021-03-10T15:44:39.257471+0000 mgr.gibba020.yqfnwy (mgr.34427) 5915 : cluster [DBG] pgmap v3359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:40.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:40 gibba013 bash[30381]: cluster 2021-03-10T15:44:39.257471+0000 mgr.gibba020.yqfnwy (mgr.34427) 5915 : cluster [DBG] pgmap v3359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:40.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:40 gibba020 bash[25448]: cluster 2021-03-10T15:44:39.257471+0000 mgr.gibba020.yqfnwy (mgr.34427) 5915 : cluster [DBG] pgmap v3359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:42.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:42 gibba020 bash[25448]: cluster 2021-03-10T15:44:41.259478+0000 mgr.gibba020.yqfnwy (mgr.34427) 5916 : cluster [DBG] pgmap v3360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:42.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:42 gibba013 bash[29418]: cluster 2021-03-10T15:44:41.259478+0000 mgr.gibba020.yqfnwy (mgr.34427) 5916 : cluster [DBG] pgmap v3360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:42.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:42 gibba013 bash[30381]: cluster 2021-03-10T15:44:41.259478+0000 mgr.gibba020.yqfnwy (mgr.34427) 5916 : cluster [DBG] pgmap v3360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:44.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:43 gibba013 bash[29418]: cluster 2021-03-10T15:44:43.261004+0000 mgr.gibba020.yqfnwy (mgr.34427) 5917 : cluster [DBG] pgmap v3361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:44.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:43 gibba013 bash[30381]: cluster 2021-03-10T15:44:43.261004+0000 mgr.gibba020.yqfnwy (mgr.34427) 5917 : cluster [DBG] pgmap v3361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:44.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:43 gibba020 bash[25448]: cluster 2021-03-10T15:44:43.261004+0000 mgr.gibba020.yqfnwy (mgr.34427) 5917 : cluster [DBG] pgmap v3361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:46.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:46 gibba013 bash[29418]: cluster 2021-03-10T15:44:45.262709+0000 mgr.gibba020.yqfnwy (mgr.34427) 5918 : cluster [DBG] pgmap v3362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:46.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:46 gibba013 bash[30381]: cluster 2021-03-10T15:44:45.262709+0000 mgr.gibba020.yqfnwy (mgr.34427) 5918 : cluster [DBG] pgmap v3362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:46.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:46 gibba020 bash[25448]: cluster 2021-03-10T15:44:45.262709+0000 mgr.gibba020.yqfnwy (mgr.34427) 5918 : cluster [DBG] pgmap v3362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:48.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:48 gibba013 bash[29418]: cluster 2021-03-10T15:44:47.264194+0000 mgr.gibba020.yqfnwy (mgr.34427) 5919 : cluster [DBG] pgmap v3363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:48.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:48 gibba013 bash[30381]: cluster 2021-03-10T15:44:47.264194+0000 mgr.gibba020.yqfnwy (mgr.34427) 5919 : cluster [DBG] pgmap v3363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:48.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:48 gibba020 bash[25448]: cluster 2021-03-10T15:44:47.264194+0000 mgr.gibba020.yqfnwy (mgr.34427) 5919 : cluster [DBG] pgmap v3363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:49.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:49 gibba013 bash[29418]: cephadm 2021-03-10T15:44:47.848921+0000 mgr.gibba020.yqfnwy (mgr.34427) 5920 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:44:49.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:49 gibba013 bash[30381]: cephadm 2021-03-10T15:44:47.848921+0000 mgr.gibba020.yqfnwy (mgr.34427) 5920 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:44:49.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:49 gibba020 bash[25448]: cephadm 2021-03-10T15:44:47.848921+0000 mgr.gibba020.yqfnwy (mgr.34427) 5920 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:44:50.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:50 gibba013 bash[29418]: cluster 2021-03-10T15:44:49.265830+0000 mgr.gibba020.yqfnwy (mgr.34427) 5921 : cluster [DBG] pgmap v3364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:50.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:50 gibba013 bash[30381]: cluster 2021-03-10T15:44:49.265830+0000 mgr.gibba020.yqfnwy (mgr.34427) 5921 : cluster [DBG] pgmap v3364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:50.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:50 gibba020 bash[25448]: cluster 2021-03-10T15:44:49.265830+0000 mgr.gibba020.yqfnwy (mgr.34427) 5921 : cluster [DBG] pgmap v3364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:52.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:52 gibba013 bash[29418]: cluster 2021-03-10T15:44:51.267680+0000 mgr.gibba020.yqfnwy (mgr.34427) 5922 : cluster [DBG] pgmap v3365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:52.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:52 gibba013 bash[30381]: cluster 2021-03-10T15:44:51.267680+0000 mgr.gibba020.yqfnwy (mgr.34427) 5922 : cluster [DBG] pgmap v3365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:52.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:52 gibba020 bash[25448]: cluster 2021-03-10T15:44:51.267680+0000 mgr.gibba020.yqfnwy (mgr.34427) 5922 : cluster [DBG] pgmap v3365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:54.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:53 gibba013 bash[29418]: cluster 2021-03-10T15:44:53.269088+0000 mgr.gibba020.yqfnwy (mgr.34427) 5923 : cluster [DBG] pgmap v3366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:54.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:53 gibba013 bash[30381]: cluster 2021-03-10T15:44:53.269088+0000 mgr.gibba020.yqfnwy (mgr.34427) 5923 : cluster [DBG] pgmap v3366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:54.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:53 gibba020 bash[25448]: cluster 2021-03-10T15:44:53.269088+0000 mgr.gibba020.yqfnwy (mgr.34427) 5923 : cluster [DBG] pgmap v3366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:56.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:56 gibba013 bash[29418]: cluster 2021-03-10T15:44:55.270779+0000 mgr.gibba020.yqfnwy (mgr.34427) 5924 : cluster [DBG] pgmap v3367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:56.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:56 gibba013 bash[30381]: cluster 2021-03-10T15:44:55.270779+0000 mgr.gibba020.yqfnwy (mgr.34427) 5924 : cluster [DBG] pgmap v3367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:56.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:56 gibba020 bash[25448]: cluster 2021-03-10T15:44:55.270779+0000 mgr.gibba020.yqfnwy (mgr.34427) 5924 : cluster [DBG] pgmap v3367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:58.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:44:58 gibba013 bash[29418]: cluster 2021-03-10T15:44:57.272185+0000 mgr.gibba020.yqfnwy (mgr.34427) 5925 : cluster [DBG] pgmap v3368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:58.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:44:58 gibba013 bash[30381]: cluster 2021-03-10T15:44:57.272185+0000 mgr.gibba020.yqfnwy (mgr.34427) 5925 : cluster [DBG] pgmap v3368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:58.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:44:58 gibba020 bash[25448]: cluster 2021-03-10T15:44:57.272185+0000 mgr.gibba020.yqfnwy (mgr.34427) 5925 : cluster [DBG] pgmap v3368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:44:59.629 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:44:59.858 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:44:59.858 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (111m) 5m ago 116m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:44:59.858 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (116m) 4m ago 116m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:44:59.859 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (111m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:44:59.859 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (112m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:44:59.859 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (111m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:44:59.859 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (111m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:44:59.860 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (110m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:44:59.860 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (110m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:44:59.860 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (117m) 5m ago 117m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:44:59.860 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (117m) 4m ago 117m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:44:59.860 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (109m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:44:59.861 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (109m) 5m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:44:59.861 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (108m) 5m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:44:59.861 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (108m) 5m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:44:59.861 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (108m) 4m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:44:59.862 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (107m) 4m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:44:59.862 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (107m) 4m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:44:59.862 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (106m) 4m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:44:59.862 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (116m) 4m ago 117m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:44:59.862 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 4m ago 114m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:45:00.105 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:45:00.105 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:45:00.106 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:45:00.106 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:45:00.106 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:45:00.106 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:45:00.107 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:45:00.107 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:45:00.107 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:45:00.107 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:45:00.108 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:45:00.108 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:45:00.108 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:45:00.108 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:45:00.108 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:45:00.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:00 gibba013 bash[29418]: cluster 2021-03-10T15:44:59.273813+0000 mgr.gibba020.yqfnwy (mgr.34427) 5926 : cluster [DBG] pgmap v3369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:00.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:00 gibba013 bash[29418]: audit 2021-03-10T15:44:59.615632+0000 mgr.gibba020.yqfnwy (mgr.34427) 5927 : audit [DBG] from='client.48030 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:45:00.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:00 gibba013 bash[29418]: audit 2021-03-10T15:45:00.102612+0000 mon.a (mon.0) 2339 : audit [DBG] from='client.? 172.21.2.113:0/2066202209' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:00.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:00 gibba013 bash[30381]: cluster 2021-03-10T15:44:59.273813+0000 mgr.gibba020.yqfnwy (mgr.34427) 5926 : cluster [DBG] pgmap v3369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:00.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:00 gibba013 bash[30381]: audit 2021-03-10T15:44:59.615632+0000 mgr.gibba020.yqfnwy (mgr.34427) 5927 : audit [DBG] from='client.48030 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:45:00.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:00 gibba013 bash[30381]: audit 2021-03-10T15:45:00.102612+0000 mon.a (mon.0) 2339 : audit [DBG] from='client.? 172.21.2.113:0/2066202209' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:00.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:00 gibba020 bash[25448]: cluster 2021-03-10T15:44:59.273813+0000 mgr.gibba020.yqfnwy (mgr.34427) 5926 : cluster [DBG] pgmap v3369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:00.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:00 gibba020 bash[25448]: audit 2021-03-10T15:44:59.615632+0000 mgr.gibba020.yqfnwy (mgr.34427) 5927 : audit [DBG] from='client.48030 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:45:00.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:00 gibba020 bash[25448]: audit 2021-03-10T15:45:00.102612+0000 mon.a (mon.0) 2339 : audit [DBG] from='client.? 172.21.2.113:0/2066202209' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:01.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:01 gibba013 bash[30381]: audit 2021-03-10T15:44:59.841770+0000 mgr.gibba020.yqfnwy (mgr.34427) 5928 : audit [DBG] from='client.58021 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:45:01.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:01 gibba013 bash[29418]: audit 2021-03-10T15:44:59.841770+0000 mgr.gibba020.yqfnwy (mgr.34427) 5928 : audit [DBG] from='client.58021 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:45:01.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:01 gibba020 bash[25448]: audit 2021-03-10T15:44:59.841770+0000 mgr.gibba020.yqfnwy (mgr.34427) 5928 : audit [DBG] from='client.58021 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:45:02.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:02 gibba013 bash[29418]: cluster 2021-03-10T15:45:01.275663+0000 mgr.gibba020.yqfnwy (mgr.34427) 5929 : cluster [DBG] pgmap v3370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:02.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:02 gibba013 bash[30381]: cluster 2021-03-10T15:45:01.275663+0000 mgr.gibba020.yqfnwy (mgr.34427) 5929 : cluster [DBG] pgmap v3370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:02.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:02 gibba020 bash[25448]: cluster 2021-03-10T15:45:01.275663+0000 mgr.gibba020.yqfnwy (mgr.34427) 5929 : cluster [DBG] pgmap v3370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:04.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:03 gibba013 bash[29418]: cephadm 2021-03-10T15:45:02.865025+0000 mgr.gibba020.yqfnwy (mgr.34427) 5930 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:45:04.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:03 gibba013 bash[29418]: cluster 2021-03-10T15:45:03.277125+0000 mgr.gibba020.yqfnwy (mgr.34427) 5931 : cluster [DBG] pgmap v3371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:04.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:03 gibba013 bash[30381]: cephadm 2021-03-10T15:45:02.865025+0000 mgr.gibba020.yqfnwy (mgr.34427) 5930 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:45:04.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:03 gibba013 bash[30381]: cluster 2021-03-10T15:45:03.277125+0000 mgr.gibba020.yqfnwy (mgr.34427) 5931 : cluster [DBG] pgmap v3371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:04.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:03 gibba020 bash[25448]: cephadm 2021-03-10T15:45:02.865025+0000 mgr.gibba020.yqfnwy (mgr.34427) 5930 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:45:04.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:03 gibba020 bash[25448]: cluster 2021-03-10T15:45:03.277125+0000 mgr.gibba020.yqfnwy (mgr.34427) 5931 : cluster [DBG] pgmap v3371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:06.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:06 gibba013 bash[30381]: cluster 2021-03-10T15:45:05.278801+0000 mgr.gibba020.yqfnwy (mgr.34427) 5932 : cluster [DBG] pgmap v3372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:06.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:06 gibba013 bash[29418]: cluster 2021-03-10T15:45:05.278801+0000 mgr.gibba020.yqfnwy (mgr.34427) 5932 : cluster [DBG] pgmap v3372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:06 gibba020 bash[25448]: cluster 2021-03-10T15:45:05.278801+0000 mgr.gibba020.yqfnwy (mgr.34427) 5932 : cluster [DBG] pgmap v3372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:07.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:07 gibba013 bash[29418]: audit 2021-03-10T15:45:06.537558+0000 mon.a (mon.0) 2340 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:45:07.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:07 gibba013 bash[29418]: audit 2021-03-10T15:45:06.622381+0000 mon.a (mon.0) 2341 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:45:07.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:07 gibba013 bash[29418]: audit 2021-03-10T15:45:06.734695+0000 mon.a (mon.0) 2342 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T15:45:07.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:07 gibba013 bash[29418]: audit 2021-03-10T15:45:06.735438+0000 mon.a (mon.0) 2343 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:45:07.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:07 gibba013 bash[29418]: audit 2021-03-10T15:45:06.736169+0000 mon.a (mon.0) 2344 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:45:07.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:07 gibba013 bash[29418]: audit 2021-03-10T15:45:06.736826+0000 mon.a (mon.0) 2345 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:45:07.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:07 gibba013 bash[30381]: audit 2021-03-10T15:45:06.537558+0000 mon.a (mon.0) 2340 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:45:07.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:07 gibba013 bash[30381]: audit 2021-03-10T15:45:06.622381+0000 mon.a (mon.0) 2341 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:45:07.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:07 gibba013 bash[30381]: audit 2021-03-10T15:45:06.734695+0000 mon.a (mon.0) 2342 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T15:45:07.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:07 gibba013 bash[30381]: audit 2021-03-10T15:45:06.735438+0000 mon.a (mon.0) 2343 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:45:07.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:07 gibba013 bash[30381]: audit 2021-03-10T15:45:06.736169+0000 mon.a (mon.0) 2344 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:45:07.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:07 gibba013 bash[30381]: audit 2021-03-10T15:45:06.736826+0000 mon.a (mon.0) 2345 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:45:07.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:07 gibba020 bash[25448]: audit 2021-03-10T15:45:06.537558+0000 mon.a (mon.0) 2340 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:45:07.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:07 gibba020 bash[25448]: audit 2021-03-10T15:45:06.622381+0000 mon.a (mon.0) 2341 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:45:07.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:07 gibba020 bash[25448]: audit 2021-03-10T15:45:06.734695+0000 mon.a (mon.0) 2342 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T15:45:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:07 gibba020 bash[25448]: audit 2021-03-10T15:45:06.735438+0000 mon.a (mon.0) 2343 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:45:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:07 gibba020 bash[25448]: audit 2021-03-10T15:45:06.736169+0000 mon.a (mon.0) 2344 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:45:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:07 gibba020 bash[25448]: audit 2021-03-10T15:45:06.736826+0000 mon.a (mon.0) 2345 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:45:08.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:08 gibba013 bash[29418]: cluster 2021-03-10T15:45:07.279924+0000 mgr.gibba020.yqfnwy (mgr.34427) 5933 : cluster [DBG] pgmap v3373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:08.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:08 gibba013 bash[30381]: cluster 2021-03-10T15:45:07.279924+0000 mgr.gibba020.yqfnwy (mgr.34427) 5933 : cluster [DBG] pgmap v3373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:08.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:08 gibba020 bash[25448]: cluster 2021-03-10T15:45:07.279924+0000 mgr.gibba020.yqfnwy (mgr.34427) 5933 : cluster [DBG] pgmap v3373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:10.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:10 gibba013 bash[29418]: cluster 2021-03-10T15:45:09.281376+0000 mgr.gibba020.yqfnwy (mgr.34427) 5934 : cluster [DBG] pgmap v3374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:10.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:10 gibba013 bash[30381]: cluster 2021-03-10T15:45:09.281376+0000 mgr.gibba020.yqfnwy (mgr.34427) 5934 : cluster [DBG] pgmap v3374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:10.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:10 gibba020 bash[25448]: cluster 2021-03-10T15:45:09.281376+0000 mgr.gibba020.yqfnwy (mgr.34427) 5934 : cluster [DBG] pgmap v3374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:12.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:12 gibba013 bash[29418]: cluster 2021-03-10T15:45:11.283250+0000 mgr.gibba020.yqfnwy (mgr.34427) 5935 : cluster [DBG] pgmap v3375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:12.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:12 gibba013 bash[30381]: cluster 2021-03-10T15:45:11.283250+0000 mgr.gibba020.yqfnwy (mgr.34427) 5935 : cluster [DBG] pgmap v3375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:12.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:12 gibba020 bash[25448]: cluster 2021-03-10T15:45:11.283250+0000 mgr.gibba020.yqfnwy (mgr.34427) 5935 : cluster [DBG] pgmap v3375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:14.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:13 gibba013 bash[29418]: cluster 2021-03-10T15:45:13.284681+0000 mgr.gibba020.yqfnwy (mgr.34427) 5936 : cluster [DBG] pgmap v3376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:14.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:13 gibba013 bash[30381]: cluster 2021-03-10T15:45:13.284681+0000 mgr.gibba020.yqfnwy (mgr.34427) 5936 : cluster [DBG] pgmap v3376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:14.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:13 gibba020 bash[25448]: cluster 2021-03-10T15:45:13.284681+0000 mgr.gibba020.yqfnwy (mgr.34427) 5936 : cluster [DBG] pgmap v3376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:16.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:16 gibba013 bash[29418]: cluster 2021-03-10T15:45:15.286357+0000 mgr.gibba020.yqfnwy (mgr.34427) 5937 : cluster [DBG] pgmap v3377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:16.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:16 gibba013 bash[30381]: cluster 2021-03-10T15:45:15.286357+0000 mgr.gibba020.yqfnwy (mgr.34427) 5937 : cluster [DBG] pgmap v3377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:16.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:16 gibba020 bash[25448]: cluster 2021-03-10T15:45:15.286357+0000 mgr.gibba020.yqfnwy (mgr.34427) 5937 : cluster [DBG] pgmap v3377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:18.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:18 gibba013 bash[29418]: cluster 2021-03-10T15:45:17.287841+0000 mgr.gibba020.yqfnwy (mgr.34427) 5938 : cluster [DBG] pgmap v3378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:18.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:18 gibba013 bash[30381]: cluster 2021-03-10T15:45:17.287841+0000 mgr.gibba020.yqfnwy (mgr.34427) 5938 : cluster [DBG] pgmap v3378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:18.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:18 gibba020 bash[25448]: cluster 2021-03-10T15:45:17.287841+0000 mgr.gibba020.yqfnwy (mgr.34427) 5938 : cluster [DBG] pgmap v3378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:19.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:19 gibba013 bash[29418]: cephadm 2021-03-10T15:45:17.880897+0000 mgr.gibba020.yqfnwy (mgr.34427) 5939 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:45:19.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:19 gibba013 bash[30381]: cephadm 2021-03-10T15:45:17.880897+0000 mgr.gibba020.yqfnwy (mgr.34427) 5939 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:45:19.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:19 gibba020 bash[25448]: cephadm 2021-03-10T15:45:17.880897+0000 mgr.gibba020.yqfnwy (mgr.34427) 5939 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:45:20.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:20 gibba013 bash[29418]: cluster 2021-03-10T15:45:19.289338+0000 mgr.gibba020.yqfnwy (mgr.34427) 5940 : cluster [DBG] pgmap v3379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:20.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:20 gibba013 bash[30381]: cluster 2021-03-10T15:45:19.289338+0000 mgr.gibba020.yqfnwy (mgr.34427) 5940 : cluster [DBG] pgmap v3379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:20.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:20 gibba020 bash[25448]: cluster 2021-03-10T15:45:19.289338+0000 mgr.gibba020.yqfnwy (mgr.34427) 5940 : cluster [DBG] pgmap v3379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:22.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:22 gibba020 bash[25448]: cluster 2021-03-10T15:45:21.291215+0000 mgr.gibba020.yqfnwy (mgr.34427) 5941 : cluster [DBG] pgmap v3380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:22.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:22 gibba013 bash[29418]: cluster 2021-03-10T15:45:21.291215+0000 mgr.gibba020.yqfnwy (mgr.34427) 5941 : cluster [DBG] pgmap v3380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:22.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:22 gibba013 bash[30381]: cluster 2021-03-10T15:45:21.291215+0000 mgr.gibba020.yqfnwy (mgr.34427) 5941 : cluster [DBG] pgmap v3380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:24.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:23 gibba013 bash[29418]: cluster 2021-03-10T15:45:23.292806+0000 mgr.gibba020.yqfnwy (mgr.34427) 5942 : cluster [DBG] pgmap v3381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:24.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:23 gibba013 bash[30381]: cluster 2021-03-10T15:45:23.292806+0000 mgr.gibba020.yqfnwy (mgr.34427) 5942 : cluster [DBG] pgmap v3381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:24.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:23 gibba020 bash[25448]: cluster 2021-03-10T15:45:23.292806+0000 mgr.gibba020.yqfnwy (mgr.34427) 5942 : cluster [DBG] pgmap v3381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:26.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:26 gibba013 bash[29418]: cluster 2021-03-10T15:45:25.294370+0000 mgr.gibba020.yqfnwy (mgr.34427) 5943 : cluster [DBG] pgmap v3382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:26.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:26 gibba013 bash[30381]: cluster 2021-03-10T15:45:25.294370+0000 mgr.gibba020.yqfnwy (mgr.34427) 5943 : cluster [DBG] pgmap v3382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:26.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:26 gibba020 bash[25448]: cluster 2021-03-10T15:45:25.294370+0000 mgr.gibba020.yqfnwy (mgr.34427) 5943 : cluster [DBG] pgmap v3382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:28.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:28 gibba013 bash[29418]: cluster 2021-03-10T15:45:27.296018+0000 mgr.gibba020.yqfnwy (mgr.34427) 5944 : cluster [DBG] pgmap v3383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:28.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:28 gibba013 bash[30381]: cluster 2021-03-10T15:45:27.296018+0000 mgr.gibba020.yqfnwy (mgr.34427) 5944 : cluster [DBG] pgmap v3383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:28.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:28 gibba020 bash[25448]: cluster 2021-03-10T15:45:27.296018+0000 mgr.gibba020.yqfnwy (mgr.34427) 5944 : cluster [DBG] pgmap v3383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:30.350 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:45:30.581 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:45:30.581 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (111m) 6m ago 117m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:45:30.581 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (117m) 4m ago 117m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:45:30.582 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (112m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:45:30.582 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (112m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:45:30.582 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (111m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:45:30.582 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (111m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:45:30.583 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (111m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:45:30.583 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (111m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:45:30.583 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (117m) 6m ago 117m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:45:30.583 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (117m) 4m ago 117m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:45:30.584 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (110m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:45:30.584 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (109m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:45:30.584 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (109m) 6m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:45:30.584 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (109m) 6m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:45:30.584 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (108m) 4m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:45:30.585 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (108m) 4m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:45:30.585 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (107m) 4m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:45:30.585 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (107m) 4m ago 117m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:45:30.585 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (116m) 4m ago 117m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:45:30.586 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 4m ago 115m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:45:30.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:30 gibba013 bash[29418]: cluster 2021-03-10T15:45:29.297508+0000 mgr.gibba020.yqfnwy (mgr.34427) 5945 : cluster [DBG] pgmap v3384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:30.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:30 gibba013 bash[30381]: cluster 2021-03-10T15:45:29.297508+0000 mgr.gibba020.yqfnwy (mgr.34427) 5945 : cluster [DBG] pgmap v3384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:30.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:30 gibba020 bash[25448]: cluster 2021-03-10T15:45:29.297508+0000 mgr.gibba020.yqfnwy (mgr.34427) 5945 : cluster [DBG] pgmap v3384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:30.833 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:45:30.833 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:45:30.833 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:45:30.834 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:45:30.834 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:45:30.834 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:45:30.834 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:45:30.835 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:45:30.835 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:45:30.835 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:45:30.835 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:45:30.836 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:45:30.836 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:45:30.836 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:45:30.836 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:45:31.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:31 gibba013 bash[29418]: audit 2021-03-10T15:45:30.337412+0000 mgr.gibba020.yqfnwy (mgr.34427) 5946 : audit [DBG] from='client.58033 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:45:31.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:31 gibba013 bash[29418]: audit 2021-03-10T15:45:30.564908+0000 mgr.gibba020.yqfnwy (mgr.34427) 5947 : audit [DBG] from='client.48054 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:45:31.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:31 gibba013 bash[29418]: audit 2021-03-10T15:45:30.830160+0000 mon.a (mon.0) 2346 : audit [DBG] from='client.? 172.21.2.113:0/3783592397' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:31.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:31 gibba013 bash[30381]: audit 2021-03-10T15:45:30.337412+0000 mgr.gibba020.yqfnwy (mgr.34427) 5946 : audit [DBG] from='client.58033 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:45:31.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:31 gibba013 bash[30381]: audit 2021-03-10T15:45:30.564908+0000 mgr.gibba020.yqfnwy (mgr.34427) 5947 : audit [DBG] from='client.48054 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:45:31.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:31 gibba013 bash[30381]: audit 2021-03-10T15:45:30.830160+0000 mon.a (mon.0) 2346 : audit [DBG] from='client.? 172.21.2.113:0/3783592397' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:31.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:31 gibba020 bash[25448]: audit 2021-03-10T15:45:30.337412+0000 mgr.gibba020.yqfnwy (mgr.34427) 5946 : audit [DBG] from='client.58033 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:45:31.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:31 gibba020 bash[25448]: audit 2021-03-10T15:45:30.564908+0000 mgr.gibba020.yqfnwy (mgr.34427) 5947 : audit [DBG] from='client.48054 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:45:31.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:31 gibba020 bash[25448]: audit 2021-03-10T15:45:30.830160+0000 mon.a (mon.0) 2346 : audit [DBG] from='client.? 172.21.2.113:0/3783592397' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:32.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:32 gibba020 bash[25448]: cluster 2021-03-10T15:45:31.299440+0000 mgr.gibba020.yqfnwy (mgr.34427) 5948 : cluster [DBG] pgmap v3385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:32.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:32 gibba013 bash[29418]: cluster 2021-03-10T15:45:31.299440+0000 mgr.gibba020.yqfnwy (mgr.34427) 5948 : cluster [DBG] pgmap v3385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:32.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:32 gibba013 bash[30381]: cluster 2021-03-10T15:45:31.299440+0000 mgr.gibba020.yqfnwy (mgr.34427) 5948 : cluster [DBG] pgmap v3385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:33.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:33 gibba020 bash[25448]: audit 2021-03-10T15:45:32.898746+0000 mon.a (mon.0) 2347 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:45:33.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:33 gibba020 bash[25448]: audit 2021-03-10T15:45:33.128545+0000 mon.a (mon.0) 2348 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:45:33.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:33 gibba020 bash[25448]: audit 2021-03-10T15:45:33.132308+0000 mon.a (mon.0) 2349 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:45:33.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:33 gibba020 bash[25448]: audit 2021-03-10T15:45:33.134000+0000 mon.a (mon.0) 2350 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:33.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:33 gibba020 bash[25448]: audit 2021-03-10T15:45:33.135692+0000 mon.a (mon.0) 2351 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:33.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:33 gibba020 bash[25448]: audit 2021-03-10T15:45:33.137288+0000 mon.a (mon.0) 2352 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:33.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:33 gibba020 bash[25448]: audit 2021-03-10T15:45:33.140317+0000 mon.a (mon.0) 2353 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:33.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:33 gibba020 bash[25448]: audit 2021-03-10T15:45:33.142126+0000 mon.a (mon.0) 2354 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:33.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:33 gibba013 bash[29418]: audit 2021-03-10T15:45:32.898746+0000 mon.a (mon.0) 2347 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:45:33.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:33 gibba013 bash[29418]: audit 2021-03-10T15:45:33.128545+0000 mon.a (mon.0) 2348 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:45:33.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:33 gibba013 bash[29418]: audit 2021-03-10T15:45:33.132308+0000 mon.a (mon.0) 2349 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:45:33.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:33 gibba013 bash[29418]: audit 2021-03-10T15:45:33.134000+0000 mon.a (mon.0) 2350 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:33.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:33 gibba013 bash[29418]: audit 2021-03-10T15:45:33.135692+0000 mon.a (mon.0) 2351 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:33.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:33 gibba013 bash[29418]: audit 2021-03-10T15:45:33.137288+0000 mon.a (mon.0) 2352 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:33.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:33 gibba013 bash[29418]: audit 2021-03-10T15:45:33.140317+0000 mon.a (mon.0) 2353 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:33.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:33 gibba013 bash[29418]: audit 2021-03-10T15:45:33.142126+0000 mon.a (mon.0) 2354 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:33.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:33 gibba013 bash[30381]: audit 2021-03-10T15:45:32.898746+0000 mon.a (mon.0) 2347 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:45:33.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:33 gibba013 bash[30381]: audit 2021-03-10T15:45:33.128545+0000 mon.a (mon.0) 2348 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:45:33.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:33 gibba013 bash[30381]: audit 2021-03-10T15:45:33.132308+0000 mon.a (mon.0) 2349 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:45:33.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:33 gibba013 bash[30381]: audit 2021-03-10T15:45:33.134000+0000 mon.a (mon.0) 2350 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:33.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:33 gibba013 bash[30381]: audit 2021-03-10T15:45:33.135692+0000 mon.a (mon.0) 2351 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:33.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:33 gibba013 bash[30381]: audit 2021-03-10T15:45:33.137288+0000 mon.a (mon.0) 2352 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:33.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:33 gibba013 bash[30381]: audit 2021-03-10T15:45:33.140317+0000 mon.a (mon.0) 2353 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:33.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:33 gibba013 bash[30381]: audit 2021-03-10T15:45:33.142126+0000 mon.a (mon.0) 2354 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:45:34.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:34 gibba020 bash[25448]: cephadm 2021-03-10T15:45:32.903338+0000 mgr.gibba020.yqfnwy (mgr.34427) 5949 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:45:34.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:34 gibba020 bash[25448]: cephadm 2021-03-10T15:45:32.905296+0000 mgr.gibba020.yqfnwy (mgr.34427) 5950 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:45:34.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:34 gibba020 bash[25448]: cephadm 2021-03-10T15:45:33.130291+0000 mgr.gibba020.yqfnwy (mgr.34427) 5951 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:45:34.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:34 gibba020 bash[25448]: cephadm 2021-03-10T15:45:33.132515+0000 mgr.gibba020.yqfnwy (mgr.34427) 5952 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:45:34.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:34 gibba020 bash[25448]: cephadm 2021-03-10T15:45:33.134126+0000 mgr.gibba020.yqfnwy (mgr.34427) 5953 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:45:34.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:34 gibba020 bash[25448]: cephadm 2021-03-10T15:45:33.134172+0000 mgr.gibba020.yqfnwy (mgr.34427) 5954 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:45:34.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:34 gibba020 bash[25448]: cephadm 2021-03-10T15:45:33.135767+0000 mgr.gibba020.yqfnwy (mgr.34427) 5955 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:45:34.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:34 gibba020 bash[25448]: cephadm 2021-03-10T15:45:33.135812+0000 mgr.gibba020.yqfnwy (mgr.34427) 5956 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:45:34.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:34 gibba020 bash[25448]: cephadm 2021-03-10T15:45:33.137335+0000 mgr.gibba020.yqfnwy (mgr.34427) 5957 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:45:34.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:34 gibba020 bash[25448]: cephadm 2021-03-10T15:45:33.138700+0000 mgr.gibba020.yqfnwy (mgr.34427) 5958 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:45:34.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:34 gibba020 bash[25448]: cephadm 2021-03-10T15:45:33.138747+0000 mgr.gibba020.yqfnwy (mgr.34427) 5959 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:45:34.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:34 gibba020 bash[25448]: cephadm 2021-03-10T15:45:33.140289+0000 mgr.gibba020.yqfnwy (mgr.34427) 5960 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:45:34.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:34 gibba020 bash[25448]: cephadm 2021-03-10T15:45:33.140711+0000 mgr.gibba020.yqfnwy (mgr.34427) 5961 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:45:34.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:34 gibba020 bash[25448]: cephadm 2021-03-10T15:45:33.142101+0000 mgr.gibba020.yqfnwy (mgr.34427) 5962 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:45:34.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:34 gibba020 bash[25448]: cephadm 2021-03-10T15:45:33.142157+0000 mgr.gibba020.yqfnwy (mgr.34427) 5963 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:45:34.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:34 gibba020 bash[25448]: cephadm 2021-03-10T15:45:33.142305+0000 mgr.gibba020.yqfnwy (mgr.34427) 5964 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:45:34.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:34 gibba020 bash[25448]: cluster 2021-03-10T15:45:33.300897+0000 mgr.gibba020.yqfnwy (mgr.34427) 5965 : cluster [DBG] pgmap v3386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:34.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:34 gibba013 bash[29418]: cephadm 2021-03-10T15:45:32.903338+0000 mgr.gibba020.yqfnwy (mgr.34427) 5949 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:45:34.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:34 gibba013 bash[29418]: cephadm 2021-03-10T15:45:32.905296+0000 mgr.gibba020.yqfnwy (mgr.34427) 5950 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:45:34.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:34 gibba013 bash[29418]: cephadm 2021-03-10T15:45:33.130291+0000 mgr.gibba020.yqfnwy (mgr.34427) 5951 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:45:34.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:34 gibba013 bash[29418]: cephadm 2021-03-10T15:45:33.132515+0000 mgr.gibba020.yqfnwy (mgr.34427) 5952 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:45:34.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:34 gibba013 bash[29418]: cephadm 2021-03-10T15:45:33.134126+0000 mgr.gibba020.yqfnwy (mgr.34427) 5953 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:45:34.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:34 gibba013 bash[29418]: cephadm 2021-03-10T15:45:33.134172+0000 mgr.gibba020.yqfnwy (mgr.34427) 5954 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:45:34.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:34 gibba013 bash[29418]: cephadm 2021-03-10T15:45:33.135767+0000 mgr.gibba020.yqfnwy (mgr.34427) 5955 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:45:34.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:34 gibba013 bash[29418]: cephadm 2021-03-10T15:45:33.135812+0000 mgr.gibba020.yqfnwy (mgr.34427) 5956 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:45:34.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:34 gibba013 bash[29418]: cephadm 2021-03-10T15:45:33.137335+0000 mgr.gibba020.yqfnwy (mgr.34427) 5957 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:45:34.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:34 gibba013 bash[29418]: cephadm 2021-03-10T15:45:33.138700+0000 mgr.gibba020.yqfnwy (mgr.34427) 5958 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:45:34.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:34 gibba013 bash[29418]: cephadm 2021-03-10T15:45:33.138747+0000 mgr.gibba020.yqfnwy (mgr.34427) 5959 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:45:34.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:34 gibba013 bash[29418]: cephadm 2021-03-10T15:45:33.140289+0000 mgr.gibba020.yqfnwy (mgr.34427) 5960 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:45:34.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:34 gibba013 bash[29418]: cephadm 2021-03-10T15:45:33.140711+0000 mgr.gibba020.yqfnwy (mgr.34427) 5961 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:45:34.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:34 gibba013 bash[29418]: cephadm 2021-03-10T15:45:33.142101+0000 mgr.gibba020.yqfnwy (mgr.34427) 5962 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:45:34.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:34 gibba013 bash[29418]: cephadm 2021-03-10T15:45:33.142157+0000 mgr.gibba020.yqfnwy (mgr.34427) 5963 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:45:34.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:34 gibba013 bash[29418]: cephadm 2021-03-10T15:45:33.142305+0000 mgr.gibba020.yqfnwy (mgr.34427) 5964 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:45:34.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:34 gibba013 bash[29418]: cluster 2021-03-10T15:45:33.300897+0000 mgr.gibba020.yqfnwy (mgr.34427) 5965 : cluster [DBG] pgmap v3386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:34.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:34 gibba013 bash[30381]: cephadm 2021-03-10T15:45:32.903338+0000 mgr.gibba020.yqfnwy (mgr.34427) 5949 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:45:34.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:34 gibba013 bash[30381]: cephadm 2021-03-10T15:45:32.905296+0000 mgr.gibba020.yqfnwy (mgr.34427) 5950 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:45:34.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:34 gibba013 bash[30381]: cephadm 2021-03-10T15:45:33.130291+0000 mgr.gibba020.yqfnwy (mgr.34427) 5951 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:45:34.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:34 gibba013 bash[30381]: cephadm 2021-03-10T15:45:33.132515+0000 mgr.gibba020.yqfnwy (mgr.34427) 5952 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:45:34.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:34 gibba013 bash[30381]: cephadm 2021-03-10T15:45:33.134126+0000 mgr.gibba020.yqfnwy (mgr.34427) 5953 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:45:34.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:34 gibba013 bash[30381]: cephadm 2021-03-10T15:45:33.134172+0000 mgr.gibba020.yqfnwy (mgr.34427) 5954 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:45:34.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:34 gibba013 bash[30381]: cephadm 2021-03-10T15:45:33.135767+0000 mgr.gibba020.yqfnwy (mgr.34427) 5955 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:45:34.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:34 gibba013 bash[30381]: cephadm 2021-03-10T15:45:33.135812+0000 mgr.gibba020.yqfnwy (mgr.34427) 5956 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:45:34.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:34 gibba013 bash[30381]: cephadm 2021-03-10T15:45:33.137335+0000 mgr.gibba020.yqfnwy (mgr.34427) 5957 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:45:34.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:34 gibba013 bash[30381]: cephadm 2021-03-10T15:45:33.138700+0000 mgr.gibba020.yqfnwy (mgr.34427) 5958 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:45:34.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:34 gibba013 bash[30381]: cephadm 2021-03-10T15:45:33.138747+0000 mgr.gibba020.yqfnwy (mgr.34427) 5959 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:45:34.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:34 gibba013 bash[30381]: cephadm 2021-03-10T15:45:33.140289+0000 mgr.gibba020.yqfnwy (mgr.34427) 5960 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:45:34.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:34 gibba013 bash[30381]: cephadm 2021-03-10T15:45:33.140711+0000 mgr.gibba020.yqfnwy (mgr.34427) 5961 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:45:34.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:34 gibba013 bash[30381]: cephadm 2021-03-10T15:45:33.142101+0000 mgr.gibba020.yqfnwy (mgr.34427) 5962 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:45:34.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:34 gibba013 bash[30381]: cephadm 2021-03-10T15:45:33.142157+0000 mgr.gibba020.yqfnwy (mgr.34427) 5963 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:45:34.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:34 gibba013 bash[30381]: cephadm 2021-03-10T15:45:33.142305+0000 mgr.gibba020.yqfnwy (mgr.34427) 5964 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:45:34.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:34 gibba013 bash[30381]: cluster 2021-03-10T15:45:33.300897+0000 mgr.gibba020.yqfnwy (mgr.34427) 5965 : cluster [DBG] pgmap v3386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:36.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:36 gibba020 bash[25448]: cluster 2021-03-10T15:45:35.302466+0000 mgr.gibba020.yqfnwy (mgr.34427) 5966 : cluster [DBG] pgmap v3387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:36.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:36 gibba013 bash[29418]: cluster 2021-03-10T15:45:35.302466+0000 mgr.gibba020.yqfnwy (mgr.34427) 5966 : cluster [DBG] pgmap v3387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:36.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:36 gibba013 bash[30381]: cluster 2021-03-10T15:45:35.302466+0000 mgr.gibba020.yqfnwy (mgr.34427) 5966 : cluster [DBG] pgmap v3387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:38.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:38 gibba020 bash[25448]: cluster 2021-03-10T15:45:37.303883+0000 mgr.gibba020.yqfnwy (mgr.34427) 5967 : cluster [DBG] pgmap v3388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:38.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:38 gibba013 bash[29418]: cluster 2021-03-10T15:45:37.303883+0000 mgr.gibba020.yqfnwy (mgr.34427) 5967 : cluster [DBG] pgmap v3388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:38.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:38 gibba013 bash[30381]: cluster 2021-03-10T15:45:37.303883+0000 mgr.gibba020.yqfnwy (mgr.34427) 5967 : cluster [DBG] pgmap v3388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:40.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:40 gibba020 bash[25448]: cluster 2021-03-10T15:45:39.305130+0000 mgr.gibba020.yqfnwy (mgr.34427) 5968 : cluster [DBG] pgmap v3389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:40.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:40 gibba013 bash[29418]: cluster 2021-03-10T15:45:39.305130+0000 mgr.gibba020.yqfnwy (mgr.34427) 5968 : cluster [DBG] pgmap v3389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:40.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:40 gibba013 bash[30381]: cluster 2021-03-10T15:45:39.305130+0000 mgr.gibba020.yqfnwy (mgr.34427) 5968 : cluster [DBG] pgmap v3389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:42.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:42 gibba020 bash[25448]: cluster 2021-03-10T15:45:41.306870+0000 mgr.gibba020.yqfnwy (mgr.34427) 5969 : cluster [DBG] pgmap v3390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:42.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:42 gibba013 bash[29418]: cluster 2021-03-10T15:45:41.306870+0000 mgr.gibba020.yqfnwy (mgr.34427) 5969 : cluster [DBG] pgmap v3390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:42.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:42 gibba013 bash[30381]: cluster 2021-03-10T15:45:41.306870+0000 mgr.gibba020.yqfnwy (mgr.34427) 5969 : cluster [DBG] pgmap v3390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:44.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:43 gibba013 bash[29418]: cluster 2021-03-10T15:45:43.308438+0000 mgr.gibba020.yqfnwy (mgr.34427) 5970 : cluster [DBG] pgmap v3391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:44.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:43 gibba013 bash[30381]: cluster 2021-03-10T15:45:43.308438+0000 mgr.gibba020.yqfnwy (mgr.34427) 5970 : cluster [DBG] pgmap v3391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:44.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:43 gibba020 bash[25448]: cluster 2021-03-10T15:45:43.308438+0000 mgr.gibba020.yqfnwy (mgr.34427) 5970 : cluster [DBG] pgmap v3391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:46.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:46 gibba013 bash[29418]: cluster 2021-03-10T15:45:45.309900+0000 mgr.gibba020.yqfnwy (mgr.34427) 5971 : cluster [DBG] pgmap v3392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:46.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:46 gibba013 bash[30381]: cluster 2021-03-10T15:45:45.309900+0000 mgr.gibba020.yqfnwy (mgr.34427) 5971 : cluster [DBG] pgmap v3392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:46.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:46 gibba020 bash[25448]: cluster 2021-03-10T15:45:45.309900+0000 mgr.gibba020.yqfnwy (mgr.34427) 5971 : cluster [DBG] pgmap v3392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:48.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:48 gibba020 bash[25448]: cluster 2021-03-10T15:45:47.311333+0000 mgr.gibba020.yqfnwy (mgr.34427) 5972 : cluster [DBG] pgmap v3393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:48.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:48 gibba013 bash[29418]: cluster 2021-03-10T15:45:47.311333+0000 mgr.gibba020.yqfnwy (mgr.34427) 5972 : cluster [DBG] pgmap v3393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:48.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:48 gibba013 bash[30381]: cluster 2021-03-10T15:45:47.311333+0000 mgr.gibba020.yqfnwy (mgr.34427) 5972 : cluster [DBG] pgmap v3393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:49.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:49 gibba020 bash[25448]: cephadm 2021-03-10T15:45:48.158207+0000 mgr.gibba020.yqfnwy (mgr.34427) 5973 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:45:49.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:49 gibba013 bash[29418]: cephadm 2021-03-10T15:45:48.158207+0000 mgr.gibba020.yqfnwy (mgr.34427) 5973 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:45:49.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:49 gibba013 bash[30381]: cephadm 2021-03-10T15:45:48.158207+0000 mgr.gibba020.yqfnwy (mgr.34427) 5973 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:45:50.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:50 gibba020 bash[25448]: cluster 2021-03-10T15:45:49.312749+0000 mgr.gibba020.yqfnwy (mgr.34427) 5974 : cluster [DBG] pgmap v3394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:50.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:50 gibba013 bash[29418]: cluster 2021-03-10T15:45:49.312749+0000 mgr.gibba020.yqfnwy (mgr.34427) 5974 : cluster [DBG] pgmap v3394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:50.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:50 gibba013 bash[30381]: cluster 2021-03-10T15:45:49.312749+0000 mgr.gibba020.yqfnwy (mgr.34427) 5974 : cluster [DBG] pgmap v3394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:52.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:52 gibba020 bash[25448]: cluster 2021-03-10T15:45:51.314364+0000 mgr.gibba020.yqfnwy (mgr.34427) 5975 : cluster [DBG] pgmap v3395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:52.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:52 gibba013 bash[29418]: cluster 2021-03-10T15:45:51.314364+0000 mgr.gibba020.yqfnwy (mgr.34427) 5975 : cluster [DBG] pgmap v3395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:52.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:52 gibba013 bash[30381]: cluster 2021-03-10T15:45:51.314364+0000 mgr.gibba020.yqfnwy (mgr.34427) 5975 : cluster [DBG] pgmap v3395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:54.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:53 gibba013 bash[29418]: cluster 2021-03-10T15:45:53.315740+0000 mgr.gibba020.yqfnwy (mgr.34427) 5976 : cluster [DBG] pgmap v3396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:54.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:53 gibba013 bash[30381]: cluster 2021-03-10T15:45:53.315740+0000 mgr.gibba020.yqfnwy (mgr.34427) 5976 : cluster [DBG] pgmap v3396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:54.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:53 gibba020 bash[25448]: cluster 2021-03-10T15:45:53.315740+0000 mgr.gibba020.yqfnwy (mgr.34427) 5976 : cluster [DBG] pgmap v3396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:56.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:56 gibba020 bash[25448]: cluster 2021-03-10T15:45:55.317405+0000 mgr.gibba020.yqfnwy (mgr.34427) 5977 : cluster [DBG] pgmap v3397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:56.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:56 gibba013 bash[29418]: cluster 2021-03-10T15:45:55.317405+0000 mgr.gibba020.yqfnwy (mgr.34427) 5977 : cluster [DBG] pgmap v3397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:56.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:56 gibba013 bash[30381]: cluster 2021-03-10T15:45:55.317405+0000 mgr.gibba020.yqfnwy (mgr.34427) 5977 : cluster [DBG] pgmap v3397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:58.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:45:58 gibba020 bash[25448]: cluster 2021-03-10T15:45:57.318692+0000 mgr.gibba020.yqfnwy (mgr.34427) 5978 : cluster [DBG] pgmap v3398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:58.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:45:58 gibba013 bash[29418]: cluster 2021-03-10T15:45:57.318692+0000 mgr.gibba020.yqfnwy (mgr.34427) 5978 : cluster [DBG] pgmap v3398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:45:58.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:45:58 gibba013 bash[30381]: cluster 2021-03-10T15:45:57.318692+0000 mgr.gibba020.yqfnwy (mgr.34427) 5978 : cluster [DBG] pgmap v3398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:00.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:00 gibba020 bash[25448]: cluster 2021-03-10T15:45:59.320124+0000 mgr.gibba020.yqfnwy (mgr.34427) 5979 : cluster [DBG] pgmap v3399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:00.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:00 gibba013 bash[29418]: cluster 2021-03-10T15:45:59.320124+0000 mgr.gibba020.yqfnwy (mgr.34427) 5979 : cluster [DBG] pgmap v3399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:00.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:00 gibba013 bash[30381]: cluster 2021-03-10T15:45:59.320124+0000 mgr.gibba020.yqfnwy (mgr.34427) 5979 : cluster [DBG] pgmap v3399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:01.078 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:46:01.307 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:46:01.307 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (112m) 6m ago 117m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:46:01.307 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (117m) 5m ago 117m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:46:01.308 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (112m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:46:01.308 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (113m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:46:01.308 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (112m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:46:01.308 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (112m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:46:01.308 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (111m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:46:01.309 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (111m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:46:01.309 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (118m) 6m ago 118m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:46:01.309 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (118m) 5m ago 118m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:46:01.309 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (110m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:46:01.310 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (110m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:46:01.310 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (109m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:46:01.310 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (109m) 6m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:46:01.310 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (109m) 5m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:46:01.310 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (108m) 5m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:46:01.311 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (108m) 5m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:46:01.311 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (107m) 5m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:46:01.311 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (117m) 5m ago 118m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:46:01.311 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 5m ago 116m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:46:01.555 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:46:01.556 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:46:01.556 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:46:01.556 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:46:01.556 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:46:01.556 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:46:01.557 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:46:01.557 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:46:01.557 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:46:01.557 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:46:01.558 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:46:01.558 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:46:01.558 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:46:01.558 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:46:01.559 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:46:02.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:02 gibba020 bash[25448]: audit 2021-03-10T15:46:01.065952+0000 mgr.gibba020.yqfnwy (mgr.34427) 5980 : audit [DBG] from='client.48066 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:46:02.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:02 gibba020 bash[25448]: audit 2021-03-10T15:46:01.291219+0000 mgr.gibba020.yqfnwy (mgr.34427) 5981 : audit [DBG] from='client.48072 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:46:02.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:02 gibba020 bash[25448]: cluster 2021-03-10T15:46:01.320831+0000 mgr.gibba020.yqfnwy (mgr.34427) 5982 : cluster [DBG] pgmap v3400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:02.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:02 gibba020 bash[25448]: audit 2021-03-10T15:46:01.552808+0000 mon.a (mon.0) 2355 : audit [DBG] from='client.? 172.21.2.113:0/3641403698' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:02.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:02 gibba013 bash[29418]: audit 2021-03-10T15:46:01.065952+0000 mgr.gibba020.yqfnwy (mgr.34427) 5980 : audit [DBG] from='client.48066 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:46:02.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:02 gibba013 bash[29418]: audit 2021-03-10T15:46:01.291219+0000 mgr.gibba020.yqfnwy (mgr.34427) 5981 : audit [DBG] from='client.48072 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:46:02.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:02 gibba013 bash[29418]: cluster 2021-03-10T15:46:01.320831+0000 mgr.gibba020.yqfnwy (mgr.34427) 5982 : cluster [DBG] pgmap v3400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:02.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:02 gibba013 bash[29418]: audit 2021-03-10T15:46:01.552808+0000 mon.a (mon.0) 2355 : audit [DBG] from='client.? 172.21.2.113:0/3641403698' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:02.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:02 gibba013 bash[30381]: audit 2021-03-10T15:46:01.065952+0000 mgr.gibba020.yqfnwy (mgr.34427) 5980 : audit [DBG] from='client.48066 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:46:02.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:02 gibba013 bash[30381]: audit 2021-03-10T15:46:01.291219+0000 mgr.gibba020.yqfnwy (mgr.34427) 5981 : audit [DBG] from='client.48072 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:46:02.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:02 gibba013 bash[30381]: cluster 2021-03-10T15:46:01.320831+0000 mgr.gibba020.yqfnwy (mgr.34427) 5982 : cluster [DBG] pgmap v3400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:02.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:02 gibba013 bash[30381]: audit 2021-03-10T15:46:01.552808+0000 mon.a (mon.0) 2355 : audit [DBG] from='client.? 172.21.2.113:0/3641403698' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:04.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:03 gibba013 bash[29418]: cephadm 2021-03-10T15:46:03.173999+0000 mgr.gibba020.yqfnwy (mgr.34427) 5983 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:46:04.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:03 gibba013 bash[29418]: cluster 2021-03-10T15:46:03.322113+0000 mgr.gibba020.yqfnwy (mgr.34427) 5984 : cluster [DBG] pgmap v3401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:04.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:03 gibba013 bash[30381]: cephadm 2021-03-10T15:46:03.173999+0000 mgr.gibba020.yqfnwy (mgr.34427) 5983 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:46:04.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:03 gibba013 bash[30381]: cluster 2021-03-10T15:46:03.322113+0000 mgr.gibba020.yqfnwy (mgr.34427) 5984 : cluster [DBG] pgmap v3401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:04.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:03 gibba020 bash[25448]: cephadm 2021-03-10T15:46:03.173999+0000 mgr.gibba020.yqfnwy (mgr.34427) 5983 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:46:04.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:03 gibba020 bash[25448]: cluster 2021-03-10T15:46:03.322113+0000 mgr.gibba020.yqfnwy (mgr.34427) 5984 : cluster [DBG] pgmap v3401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:06 gibba020 bash[25448]: cluster 2021-03-10T15:46:05.323744+0000 mgr.gibba020.yqfnwy (mgr.34427) 5985 : cluster [DBG] pgmap v3402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:06 gibba013 bash[29418]: cluster 2021-03-10T15:46:05.323744+0000 mgr.gibba020.yqfnwy (mgr.34427) 5985 : cluster [DBG] pgmap v3402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:06.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:06 gibba013 bash[30381]: cluster 2021-03-10T15:46:05.323744+0000 mgr.gibba020.yqfnwy (mgr.34427) 5985 : cluster [DBG] pgmap v3402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:07.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:07 gibba020 bash[25448]: audit 2021-03-10T15:46:06.542604+0000 mon.a (mon.0) 2356 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:46:07.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:07 gibba020 bash[25448]: audit 2021-03-10T15:46:06.627264+0000 mon.a (mon.0) 2357 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:46:07.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:07 gibba020 bash[25448]: audit 2021-03-10T15:46:06.744733+0000 mon.a (mon.0) 2358 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:46:07.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:07 gibba020 bash[25448]: audit 2021-03-10T15:46:06.745488+0000 mon.a (mon.0) 2359 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:46:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:07 gibba020 bash[25448]: audit 2021-03-10T15:46:06.746191+0000 mon.a (mon.0) 2360 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:46:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:07 gibba020 bash[25448]: audit 2021-03-10T15:46:06.746848+0000 mon.a (mon.0) 2361 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:46:07.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:07 gibba013 bash[29418]: audit 2021-03-10T15:46:06.542604+0000 mon.a (mon.0) 2356 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:46:07.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:07 gibba013 bash[29418]: audit 2021-03-10T15:46:06.627264+0000 mon.a (mon.0) 2357 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:46:07.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:07 gibba013 bash[29418]: audit 2021-03-10T15:46:06.744733+0000 mon.a (mon.0) 2358 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:46:07.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:07 gibba013 bash[29418]: audit 2021-03-10T15:46:06.745488+0000 mon.a (mon.0) 2359 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:46:07.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:07 gibba013 bash[29418]: audit 2021-03-10T15:46:06.746191+0000 mon.a (mon.0) 2360 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:46:07.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:07 gibba013 bash[29418]: audit 2021-03-10T15:46:06.746848+0000 mon.a (mon.0) 2361 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:46:07.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:07 gibba013 bash[30381]: audit 2021-03-10T15:46:06.542604+0000 mon.a (mon.0) 2356 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:46:07.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:07 gibba013 bash[30381]: audit 2021-03-10T15:46:06.627264+0000 mon.a (mon.0) 2357 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:46:07.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:07 gibba013 bash[30381]: audit 2021-03-10T15:46:06.744733+0000 mon.a (mon.0) 2358 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:46:07.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:07 gibba013 bash[30381]: audit 2021-03-10T15:46:06.745488+0000 mon.a (mon.0) 2359 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:46:07.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:07 gibba013 bash[30381]: audit 2021-03-10T15:46:06.746191+0000 mon.a (mon.0) 2360 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:46:07.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:07 gibba013 bash[30381]: audit 2021-03-10T15:46:06.746848+0000 mon.a (mon.0) 2361 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:46:08.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:08 gibba020 bash[25448]: cluster 2021-03-10T15:46:07.325018+0000 mgr.gibba020.yqfnwy (mgr.34427) 5986 : cluster [DBG] pgmap v3403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:08 gibba013 bash[29418]: cluster 2021-03-10T15:46:07.325018+0000 mgr.gibba020.yqfnwy (mgr.34427) 5986 : cluster [DBG] pgmap v3403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:08.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:08 gibba013 bash[30381]: cluster 2021-03-10T15:46:07.325018+0000 mgr.gibba020.yqfnwy (mgr.34427) 5986 : cluster [DBG] pgmap v3403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:10.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:10 gibba020 bash[25448]: cluster 2021-03-10T15:46:09.326556+0000 mgr.gibba020.yqfnwy (mgr.34427) 5987 : cluster [DBG] pgmap v3404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:10.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:10 gibba013 bash[29418]: cluster 2021-03-10T15:46:09.326556+0000 mgr.gibba020.yqfnwy (mgr.34427) 5987 : cluster [DBG] pgmap v3404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:10.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:10 gibba013 bash[30381]: cluster 2021-03-10T15:46:09.326556+0000 mgr.gibba020.yqfnwy (mgr.34427) 5987 : cluster [DBG] pgmap v3404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:12.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:12 gibba020 bash[25448]: cluster 2021-03-10T15:46:11.328470+0000 mgr.gibba020.yqfnwy (mgr.34427) 5988 : cluster [DBG] pgmap v3405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:12.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:12 gibba013 bash[29418]: cluster 2021-03-10T15:46:11.328470+0000 mgr.gibba020.yqfnwy (mgr.34427) 5988 : cluster [DBG] pgmap v3405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:12.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:12 gibba013 bash[30381]: cluster 2021-03-10T15:46:11.328470+0000 mgr.gibba020.yqfnwy (mgr.34427) 5988 : cluster [DBG] pgmap v3405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:14.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:13 gibba013 bash[29418]: cluster 2021-03-10T15:46:13.330115+0000 mgr.gibba020.yqfnwy (mgr.34427) 5989 : cluster [DBG] pgmap v3406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:14.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:13 gibba013 bash[30381]: cluster 2021-03-10T15:46:13.330115+0000 mgr.gibba020.yqfnwy (mgr.34427) 5989 : cluster [DBG] pgmap v3406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:14.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:13 gibba020 bash[25448]: cluster 2021-03-10T15:46:13.330115+0000 mgr.gibba020.yqfnwy (mgr.34427) 5989 : cluster [DBG] pgmap v3406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:16.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:16 gibba020 bash[25448]: cluster 2021-03-10T15:46:15.331800+0000 mgr.gibba020.yqfnwy (mgr.34427) 5990 : cluster [DBG] pgmap v3407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:16.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:16 gibba013 bash[29418]: cluster 2021-03-10T15:46:15.331800+0000 mgr.gibba020.yqfnwy (mgr.34427) 5990 : cluster [DBG] pgmap v3407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:16.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:16 gibba013 bash[30381]: cluster 2021-03-10T15:46:15.331800+0000 mgr.gibba020.yqfnwy (mgr.34427) 5990 : cluster [DBG] pgmap v3407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:18.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:18 gibba020 bash[25448]: cluster 2021-03-10T15:46:17.333151+0000 mgr.gibba020.yqfnwy (mgr.34427) 5991 : cluster [DBG] pgmap v3408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:18.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:18 gibba013 bash[29418]: cluster 2021-03-10T15:46:17.333151+0000 mgr.gibba020.yqfnwy (mgr.34427) 5991 : cluster [DBG] pgmap v3408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:18.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:18 gibba013 bash[30381]: cluster 2021-03-10T15:46:17.333151+0000 mgr.gibba020.yqfnwy (mgr.34427) 5991 : cluster [DBG] pgmap v3408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:19.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:19 gibba020 bash[25448]: cephadm 2021-03-10T15:46:18.189791+0000 mgr.gibba020.yqfnwy (mgr.34427) 5992 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:46:19.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:19 gibba013 bash[29418]: cephadm 2021-03-10T15:46:18.189791+0000 mgr.gibba020.yqfnwy (mgr.34427) 5992 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:46:19.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:19 gibba013 bash[30381]: cephadm 2021-03-10T15:46:18.189791+0000 mgr.gibba020.yqfnwy (mgr.34427) 5992 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:46:20.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:20 gibba020 bash[25448]: cluster 2021-03-10T15:46:19.334394+0000 mgr.gibba020.yqfnwy (mgr.34427) 5993 : cluster [DBG] pgmap v3409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:20.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:20 gibba013 bash[29418]: cluster 2021-03-10T15:46:19.334394+0000 mgr.gibba020.yqfnwy (mgr.34427) 5993 : cluster [DBG] pgmap v3409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:20.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:20 gibba013 bash[30381]: cluster 2021-03-10T15:46:19.334394+0000 mgr.gibba020.yqfnwy (mgr.34427) 5993 : cluster [DBG] pgmap v3409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:22.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:22 gibba020 bash[25448]: cluster 2021-03-10T15:46:21.336173+0000 mgr.gibba020.yqfnwy (mgr.34427) 5994 : cluster [DBG] pgmap v3410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:22.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:22 gibba013 bash[29418]: cluster 2021-03-10T15:46:21.336173+0000 mgr.gibba020.yqfnwy (mgr.34427) 5994 : cluster [DBG] pgmap v3410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:22.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:22 gibba013 bash[30381]: cluster 2021-03-10T15:46:21.336173+0000 mgr.gibba020.yqfnwy (mgr.34427) 5994 : cluster [DBG] pgmap v3410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:24.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:24 gibba013 bash[29418]: cluster 2021-03-10T15:46:23.337657+0000 mgr.gibba020.yqfnwy (mgr.34427) 5995 : cluster [DBG] pgmap v3411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:24.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:24 gibba013 bash[30381]: cluster 2021-03-10T15:46:23.337657+0000 mgr.gibba020.yqfnwy (mgr.34427) 5995 : cluster [DBG] pgmap v3411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:24.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:23 gibba020 bash[25448]: cluster 2021-03-10T15:46:23.337657+0000 mgr.gibba020.yqfnwy (mgr.34427) 5995 : cluster [DBG] pgmap v3411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:26.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:26 gibba020 bash[25448]: cluster 2021-03-10T15:46:25.339272+0000 mgr.gibba020.yqfnwy (mgr.34427) 5996 : cluster [DBG] pgmap v3412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:26.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:26 gibba013 bash[29418]: cluster 2021-03-10T15:46:25.339272+0000 mgr.gibba020.yqfnwy (mgr.34427) 5996 : cluster [DBG] pgmap v3412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:26.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:26 gibba013 bash[30381]: cluster 2021-03-10T15:46:25.339272+0000 mgr.gibba020.yqfnwy (mgr.34427) 5996 : cluster [DBG] pgmap v3412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:28.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:28 gibba020 bash[25448]: cluster 2021-03-10T15:46:27.340719+0000 mgr.gibba020.yqfnwy (mgr.34427) 5997 : cluster [DBG] pgmap v3413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:28.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:28 gibba013 bash[29418]: cluster 2021-03-10T15:46:27.340719+0000 mgr.gibba020.yqfnwy (mgr.34427) 5997 : cluster [DBG] pgmap v3413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:28.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:28 gibba013 bash[30381]: cluster 2021-03-10T15:46:27.340719+0000 mgr.gibba020.yqfnwy (mgr.34427) 5997 : cluster [DBG] pgmap v3413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:30.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:30 gibba020 bash[25448]: cluster 2021-03-10T15:46:29.342284+0000 mgr.gibba020.yqfnwy (mgr.34427) 5998 : cluster [DBG] pgmap v3414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:30.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:30 gibba013 bash[29418]: cluster 2021-03-10T15:46:29.342284+0000 mgr.gibba020.yqfnwy (mgr.34427) 5998 : cluster [DBG] pgmap v3414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:30.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:30 gibba013 bash[30381]: cluster 2021-03-10T15:46:29.342284+0000 mgr.gibba020.yqfnwy (mgr.34427) 5998 : cluster [DBG] pgmap v3414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:31.807 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:46:32.035 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:46:32.035 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (113m) 7m ago 118m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:46:32.035 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (118m) 6m ago 118m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:46:32.036 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (113m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:46:32.036 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (113m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:46:32.036 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (112m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:46:32.036 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (112m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:46:32.036 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (112m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:46:32.037 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (112m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:46:32.037 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (118m) 7m ago 118m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:46:32.037 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (118m) 6m ago 118m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:46:32.037 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (111m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:46:32.038 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (110m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:46:32.038 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (110m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:46:32.038 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (110m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:46:32.038 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (109m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:46:32.038 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (109m) 6m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:46:32.039 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (108m) 6m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:46:32.039 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (108m) 6m ago 118m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:46:32.039 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (117m) 6m ago 118m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:46:32.039 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 6m ago 116m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:46:32.284 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:46:32.284 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:46:32.285 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:46:32.285 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:46:32.285 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:46:32.285 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:46:32.285 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:46:32.286 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:46:32.286 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:46:32.286 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:46:32.286 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:46:32.287 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:46:32.287 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:46:32.287 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:46:32.287 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:46:32.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:32 gibba020 bash[25448]: cluster 2021-03-10T15:46:31.344051+0000 mgr.gibba020.yqfnwy (mgr.34427) 5999 : cluster [DBG] pgmap v3415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:32.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:32 gibba020 bash[25448]: audit 2021-03-10T15:46:32.281799+0000 mon.a (mon.0) 2362 : audit [DBG] from='client.? 172.21.2.113:0/1759045721' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:32.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:32 gibba013 bash[29418]: cluster 2021-03-10T15:46:31.344051+0000 mgr.gibba020.yqfnwy (mgr.34427) 5999 : cluster [DBG] pgmap v3415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:32.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:32 gibba013 bash[29418]: audit 2021-03-10T15:46:32.281799+0000 mon.a (mon.0) 2362 : audit [DBG] from='client.? 172.21.2.113:0/1759045721' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:32.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:32 gibba013 bash[30381]: cluster 2021-03-10T15:46:31.344051+0000 mgr.gibba020.yqfnwy (mgr.34427) 5999 : cluster [DBG] pgmap v3415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:32.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:32 gibba013 bash[30381]: audit 2021-03-10T15:46:32.281799+0000 mon.a (mon.0) 2362 : audit [DBG] from='client.? 172.21.2.113:0/1759045721' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:33.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:33 gibba020 bash[25448]: audit 2021-03-10T15:46:31.794981+0000 mgr.gibba020.yqfnwy (mgr.34427) 6000 : audit [DBG] from='client.48084 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:46:33.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:33 gibba020 bash[25448]: audit 2021-03-10T15:46:32.019147+0000 mgr.gibba020.yqfnwy (mgr.34427) 6001 : audit [DBG] from='client.58075 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:46:33.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:33 gibba020 bash[25448]: audit 2021-03-10T15:46:33.196458+0000 mon.a (mon.0) 2363 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:46:33.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:33 gibba020 bash[25448]: audit 2021-03-10T15:46:33.395813+0000 mon.a (mon.0) 2364 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:46:33.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:33 gibba020 bash[25448]: audit 2021-03-10T15:46:33.398737+0000 mon.a (mon.0) 2365 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:46:33.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:33 gibba013 bash[29418]: audit 2021-03-10T15:46:31.794981+0000 mgr.gibba020.yqfnwy (mgr.34427) 6000 : audit [DBG] from='client.48084 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:46:33.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:33 gibba013 bash[29418]: audit 2021-03-10T15:46:32.019147+0000 mgr.gibba020.yqfnwy (mgr.34427) 6001 : audit [DBG] from='client.58075 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:46:33.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:33 gibba013 bash[29418]: audit 2021-03-10T15:46:33.196458+0000 mon.a (mon.0) 2363 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:46:33.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:33 gibba013 bash[29418]: audit 2021-03-10T15:46:33.395813+0000 mon.a (mon.0) 2364 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:46:33.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:33 gibba013 bash[29418]: audit 2021-03-10T15:46:33.398737+0000 mon.a (mon.0) 2365 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:46:33.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:33 gibba013 bash[30381]: audit 2021-03-10T15:46:31.794981+0000 mgr.gibba020.yqfnwy (mgr.34427) 6000 : audit [DBG] from='client.48084 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:46:33.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:33 gibba013 bash[30381]: audit 2021-03-10T15:46:32.019147+0000 mgr.gibba020.yqfnwy (mgr.34427) 6001 : audit [DBG] from='client.58075 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:46:33.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:33 gibba013 bash[30381]: audit 2021-03-10T15:46:33.196458+0000 mon.a (mon.0) 2363 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:46:33.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:33 gibba013 bash[30381]: audit 2021-03-10T15:46:33.395813+0000 mon.a (mon.0) 2364 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:46:33.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:33 gibba013 bash[30381]: audit 2021-03-10T15:46:33.398737+0000 mon.a (mon.0) 2365 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:46:34.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[29418]: cluster 2021-03-10T15:46:33.344568+0000 mgr.gibba020.yqfnwy (mgr.34427) 6002 : cluster [DBG] pgmap v3416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:34.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[29418]: cephadm 2021-03-10T15:46:33.395308+0000 mgr.gibba020.yqfnwy (mgr.34427) 6003 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:46:34.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[29418]: cephadm 2021-03-10T15:46:33.398461+0000 mgr.gibba020.yqfnwy (mgr.34427) 6004 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:46:34.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[29418]: audit 2021-03-10T15:46:33.600779+0000 mon.a (mon.0) 2366 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:46:34.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[29418]: cephadm 2021-03-10T15:46:33.602190+0000 mgr.gibba020.yqfnwy (mgr.34427) 6005 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:46:34.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[29418]: cephadm 2021-03-10T15:46:33.603848+0000 mgr.gibba020.yqfnwy (mgr.34427) 6006 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:46:34.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[29418]: audit 2021-03-10T15:46:33.603889+0000 mon.a (mon.0) 2367 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:46:34.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[29418]: cephadm 2021-03-10T15:46:33.605182+0000 mgr.gibba020.yqfnwy (mgr.34427) 6007 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:46:34.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[29418]: cephadm 2021-03-10T15:46:33.605220+0000 mgr.gibba020.yqfnwy (mgr.34427) 6008 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:46:34.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[29418]: audit 2021-03-10T15:46:33.605381+0000 mon.a (mon.0) 2368 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:34.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[29418]: cephadm 2021-03-10T15:46:33.606692+0000 mgr.gibba020.yqfnwy (mgr.34427) 6009 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:46:34.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[29418]: cephadm 2021-03-10T15:46:33.606731+0000 mgr.gibba020.yqfnwy (mgr.34427) 6010 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:46:34.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[29418]: audit 2021-03-10T15:46:33.606829+0000 mon.a (mon.0) 2369 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:34.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[29418]: cephadm 2021-03-10T15:46:33.607971+0000 mgr.gibba020.yqfnwy (mgr.34427) 6011 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:46:34.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[29418]: audit 2021-03-10T15:46:33.608189+0000 mon.a (mon.0) 2370 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:34.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[29418]: cephadm 2021-03-10T15:46:33.609283+0000 mgr.gibba020.yqfnwy (mgr.34427) 6012 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:46:34.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[29418]: cephadm 2021-03-10T15:46:33.609321+0000 mgr.gibba020.yqfnwy (mgr.34427) 6013 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:46:34.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[29418]: cephadm 2021-03-10T15:46:33.610728+0000 mgr.gibba020.yqfnwy (mgr.34427) 6014 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:46:34.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[29418]: audit 2021-03-10T15:46:33.610909+0000 mon.a (mon.0) 2371 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:34.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[29418]: cephadm 2021-03-10T15:46:33.611068+0000 mgr.gibba020.yqfnwy (mgr.34427) 6015 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:46:34.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[29418]: cephadm 2021-03-10T15:46:33.612306+0000 mgr.gibba020.yqfnwy (mgr.34427) 6016 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:46:34.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[30381]: cluster 2021-03-10T15:46:33.344568+0000 mgr.gibba020.yqfnwy (mgr.34427) 6002 : cluster [DBG] pgmap v3416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:34.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[30381]: cephadm 2021-03-10T15:46:33.395308+0000 mgr.gibba020.yqfnwy (mgr.34427) 6003 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:46:34.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[30381]: cephadm 2021-03-10T15:46:33.398461+0000 mgr.gibba020.yqfnwy (mgr.34427) 6004 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:46:34.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[30381]: audit 2021-03-10T15:46:33.600779+0000 mon.a (mon.0) 2366 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:46:34.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[30381]: cephadm 2021-03-10T15:46:33.602190+0000 mgr.gibba020.yqfnwy (mgr.34427) 6005 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:46:34.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[30381]: cephadm 2021-03-10T15:46:33.603848+0000 mgr.gibba020.yqfnwy (mgr.34427) 6006 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:46:34.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[30381]: audit 2021-03-10T15:46:33.603889+0000 mon.a (mon.0) 2367 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:46:34.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[30381]: cephadm 2021-03-10T15:46:33.605182+0000 mgr.gibba020.yqfnwy (mgr.34427) 6007 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:46:34.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[30381]: cephadm 2021-03-10T15:46:33.605220+0000 mgr.gibba020.yqfnwy (mgr.34427) 6008 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:46:34.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[30381]: audit 2021-03-10T15:46:33.605381+0000 mon.a (mon.0) 2368 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:34.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[30381]: cephadm 2021-03-10T15:46:33.606692+0000 mgr.gibba020.yqfnwy (mgr.34427) 6009 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:46:34.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[30381]: cephadm 2021-03-10T15:46:33.606731+0000 mgr.gibba020.yqfnwy (mgr.34427) 6010 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:46:34.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[30381]: audit 2021-03-10T15:46:33.606829+0000 mon.a (mon.0) 2369 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:34.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[30381]: cephadm 2021-03-10T15:46:33.607971+0000 mgr.gibba020.yqfnwy (mgr.34427) 6011 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:46:34.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[30381]: audit 2021-03-10T15:46:33.608189+0000 mon.a (mon.0) 2370 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:34.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[30381]: cephadm 2021-03-10T15:46:33.609283+0000 mgr.gibba020.yqfnwy (mgr.34427) 6012 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:46:34.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[30381]: cephadm 2021-03-10T15:46:33.609321+0000 mgr.gibba020.yqfnwy (mgr.34427) 6013 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:46:34.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[30381]: cephadm 2021-03-10T15:46:33.610728+0000 mgr.gibba020.yqfnwy (mgr.34427) 6014 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:46:34.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[30381]: audit 2021-03-10T15:46:33.610909+0000 mon.a (mon.0) 2371 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:34.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[30381]: cephadm 2021-03-10T15:46:33.611068+0000 mgr.gibba020.yqfnwy (mgr.34427) 6015 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:46:34.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[30381]: cephadm 2021-03-10T15:46:33.612306+0000 mgr.gibba020.yqfnwy (mgr.34427) 6016 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:46:34.891 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[29418]: cephadm 2021-03-10T15:46:33.612349+0000 mgr.gibba020.yqfnwy (mgr.34427) 6017 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:46:34.891 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[29418]: cephadm 2021-03-10T15:46:33.612469+0000 mgr.gibba020.yqfnwy (mgr.34427) 6018 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:46:34.892 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[29418]: audit 2021-03-10T15:46:33.612499+0000 mon.a (mon.0) 2372 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:34.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[30381]: cephadm 2021-03-10T15:46:33.612349+0000 mgr.gibba020.yqfnwy (mgr.34427) 6017 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:46:34.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[30381]: cephadm 2021-03-10T15:46:33.612469+0000 mgr.gibba020.yqfnwy (mgr.34427) 6018 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:46:34.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:34 gibba013 bash[30381]: audit 2021-03-10T15:46:33.612499+0000 mon.a (mon.0) 2372 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:34.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:34 gibba020 bash[25448]: cluster 2021-03-10T15:46:33.344568+0000 mgr.gibba020.yqfnwy (mgr.34427) 6002 : cluster [DBG] pgmap v3416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:34.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:34 gibba020 bash[25448]: cephadm 2021-03-10T15:46:33.395308+0000 mgr.gibba020.yqfnwy (mgr.34427) 6003 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:46:34.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:34 gibba020 bash[25448]: cephadm 2021-03-10T15:46:33.398461+0000 mgr.gibba020.yqfnwy (mgr.34427) 6004 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:46:34.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:34 gibba020 bash[25448]: audit 2021-03-10T15:46:33.600779+0000 mon.a (mon.0) 2366 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:46:34.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:34 gibba020 bash[25448]: cephadm 2021-03-10T15:46:33.602190+0000 mgr.gibba020.yqfnwy (mgr.34427) 6005 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:46:34.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:34 gibba020 bash[25448]: cephadm 2021-03-10T15:46:33.603848+0000 mgr.gibba020.yqfnwy (mgr.34427) 6006 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:46:34.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:34 gibba020 bash[25448]: audit 2021-03-10T15:46:33.603889+0000 mon.a (mon.0) 2367 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:46:34.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:34 gibba020 bash[25448]: cephadm 2021-03-10T15:46:33.605182+0000 mgr.gibba020.yqfnwy (mgr.34427) 6007 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:46:34.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:34 gibba020 bash[25448]: cephadm 2021-03-10T15:46:33.605220+0000 mgr.gibba020.yqfnwy (mgr.34427) 6008 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:46:34.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:34 gibba020 bash[25448]: audit 2021-03-10T15:46:33.605381+0000 mon.a (mon.0) 2368 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:34.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:34 gibba020 bash[25448]: cephadm 2021-03-10T15:46:33.606692+0000 mgr.gibba020.yqfnwy (mgr.34427) 6009 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:46:34.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:34 gibba020 bash[25448]: cephadm 2021-03-10T15:46:33.606731+0000 mgr.gibba020.yqfnwy (mgr.34427) 6010 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:46:34.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:34 gibba020 bash[25448]: audit 2021-03-10T15:46:33.606829+0000 mon.a (mon.0) 2369 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:34.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:34 gibba020 bash[25448]: cephadm 2021-03-10T15:46:33.607971+0000 mgr.gibba020.yqfnwy (mgr.34427) 6011 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:46:34.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:34 gibba020 bash[25448]: audit 2021-03-10T15:46:33.608189+0000 mon.a (mon.0) 2370 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:34.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:34 gibba020 bash[25448]: cephadm 2021-03-10T15:46:33.609283+0000 mgr.gibba020.yqfnwy (mgr.34427) 6012 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:46:34.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:34 gibba020 bash[25448]: cephadm 2021-03-10T15:46:33.609321+0000 mgr.gibba020.yqfnwy (mgr.34427) 6013 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:46:34.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:34 gibba020 bash[25448]: cephadm 2021-03-10T15:46:33.610728+0000 mgr.gibba020.yqfnwy (mgr.34427) 6014 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:46:34.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:34 gibba020 bash[25448]: audit 2021-03-10T15:46:33.610909+0000 mon.a (mon.0) 2371 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:34.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:34 gibba020 bash[25448]: cephadm 2021-03-10T15:46:33.611068+0000 mgr.gibba020.yqfnwy (mgr.34427) 6015 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:46:34.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:34 gibba020 bash[25448]: cephadm 2021-03-10T15:46:33.612306+0000 mgr.gibba020.yqfnwy (mgr.34427) 6016 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:46:34.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:34 gibba020 bash[25448]: cephadm 2021-03-10T15:46:33.612349+0000 mgr.gibba020.yqfnwy (mgr.34427) 6017 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:46:34.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:34 gibba020 bash[25448]: cephadm 2021-03-10T15:46:33.612469+0000 mgr.gibba020.yqfnwy (mgr.34427) 6018 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:46:34.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:34 gibba020 bash[25448]: audit 2021-03-10T15:46:33.612499+0000 mon.a (mon.0) 2372 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:46:36.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:36 gibba013 bash[29418]: cluster 2021-03-10T15:46:35.346110+0000 mgr.gibba020.yqfnwy (mgr.34427) 6019 : cluster [DBG] pgmap v3417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:36.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:36 gibba013 bash[30381]: cluster 2021-03-10T15:46:35.346110+0000 mgr.gibba020.yqfnwy (mgr.34427) 6019 : cluster [DBG] pgmap v3417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:36.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:36 gibba020 bash[25448]: cluster 2021-03-10T15:46:35.346110+0000 mgr.gibba020.yqfnwy (mgr.34427) 6019 : cluster [DBG] pgmap v3417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:38.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:38 gibba013 bash[29418]: cluster 2021-03-10T15:46:37.347691+0000 mgr.gibba020.yqfnwy (mgr.34427) 6020 : cluster [DBG] pgmap v3418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:38.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:38 gibba013 bash[30381]: cluster 2021-03-10T15:46:37.347691+0000 mgr.gibba020.yqfnwy (mgr.34427) 6020 : cluster [DBG] pgmap v3418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:38.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:38 gibba020 bash[25448]: cluster 2021-03-10T15:46:37.347691+0000 mgr.gibba020.yqfnwy (mgr.34427) 6020 : cluster [DBG] pgmap v3418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:40.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:40 gibba020 bash[25448]: cluster 2021-03-10T15:46:39.348943+0000 mgr.gibba020.yqfnwy (mgr.34427) 6021 : cluster [DBG] pgmap v3419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:41.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:40 gibba013 bash[29418]: cluster 2021-03-10T15:46:39.348943+0000 mgr.gibba020.yqfnwy (mgr.34427) 6021 : cluster [DBG] pgmap v3419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:41.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:40 gibba013 bash[30381]: cluster 2021-03-10T15:46:39.348943+0000 mgr.gibba020.yqfnwy (mgr.34427) 6021 : cluster [DBG] pgmap v3419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:42.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:42 gibba020 bash[25448]: cluster 2021-03-10T15:46:41.350540+0000 mgr.gibba020.yqfnwy (mgr.34427) 6022 : cluster [DBG] pgmap v3420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:43.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:42 gibba013 bash[29418]: cluster 2021-03-10T15:46:41.350540+0000 mgr.gibba020.yqfnwy (mgr.34427) 6022 : cluster [DBG] pgmap v3420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:43.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:42 gibba013 bash[30381]: cluster 2021-03-10T15:46:41.350540+0000 mgr.gibba020.yqfnwy (mgr.34427) 6022 : cluster [DBG] pgmap v3420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:44.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:44 gibba013 bash[29418]: cluster 2021-03-10T15:46:43.352138+0000 mgr.gibba020.yqfnwy (mgr.34427) 6023 : cluster [DBG] pgmap v3421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:44.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:44 gibba013 bash[30381]: cluster 2021-03-10T15:46:43.352138+0000 mgr.gibba020.yqfnwy (mgr.34427) 6023 : cluster [DBG] pgmap v3421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:44.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:44 gibba020 bash[25448]: cluster 2021-03-10T15:46:43.352138+0000 mgr.gibba020.yqfnwy (mgr.34427) 6023 : cluster [DBG] pgmap v3421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:46.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:46 gibba020 bash[25448]: cluster 2021-03-10T15:46:45.353585+0000 mgr.gibba020.yqfnwy (mgr.34427) 6024 : cluster [DBG] pgmap v3422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:46.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:46 gibba013 bash[29418]: cluster 2021-03-10T15:46:45.353585+0000 mgr.gibba020.yqfnwy (mgr.34427) 6024 : cluster [DBG] pgmap v3422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:46.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:46 gibba013 bash[30381]: cluster 2021-03-10T15:46:45.353585+0000 mgr.gibba020.yqfnwy (mgr.34427) 6024 : cluster [DBG] pgmap v3422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:48.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:48 gibba020 bash[25448]: cluster 2021-03-10T15:46:47.355099+0000 mgr.gibba020.yqfnwy (mgr.34427) 6025 : cluster [DBG] pgmap v3423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:48.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:48 gibba013 bash[29418]: cluster 2021-03-10T15:46:47.355099+0000 mgr.gibba020.yqfnwy (mgr.34427) 6025 : cluster [DBG] pgmap v3423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:48.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:48 gibba013 bash[30381]: cluster 2021-03-10T15:46:47.355099+0000 mgr.gibba020.yqfnwy (mgr.34427) 6025 : cluster [DBG] pgmap v3423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:49.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:49 gibba020 bash[25448]: cephadm 2021-03-10T15:46:48.628283+0000 mgr.gibba020.yqfnwy (mgr.34427) 6026 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:46:49.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:49 gibba013 bash[29418]: cephadm 2021-03-10T15:46:48.628283+0000 mgr.gibba020.yqfnwy (mgr.34427) 6026 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:46:49.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:49 gibba013 bash[30381]: cephadm 2021-03-10T15:46:48.628283+0000 mgr.gibba020.yqfnwy (mgr.34427) 6026 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:46:50.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:50 gibba020 bash[25448]: cluster 2021-03-10T15:46:49.356378+0000 mgr.gibba020.yqfnwy (mgr.34427) 6027 : cluster [DBG] pgmap v3424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:50.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:50 gibba013 bash[29418]: cluster 2021-03-10T15:46:49.356378+0000 mgr.gibba020.yqfnwy (mgr.34427) 6027 : cluster [DBG] pgmap v3424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:50.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:50 gibba013 bash[30381]: cluster 2021-03-10T15:46:49.356378+0000 mgr.gibba020.yqfnwy (mgr.34427) 6027 : cluster [DBG] pgmap v3424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:52.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:52 gibba013 bash[29418]: cluster 2021-03-10T15:46:51.358252+0000 mgr.gibba020.yqfnwy (mgr.34427) 6028 : cluster [DBG] pgmap v3425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:52.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:52 gibba013 bash[30381]: cluster 2021-03-10T15:46:51.358252+0000 mgr.gibba020.yqfnwy (mgr.34427) 6028 : cluster [DBG] pgmap v3425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:52.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:52 gibba020 bash[25448]: cluster 2021-03-10T15:46:51.358252+0000 mgr.gibba020.yqfnwy (mgr.34427) 6028 : cluster [DBG] pgmap v3425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:54.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:54 gibba013 bash[29418]: cluster 2021-03-10T15:46:53.359767+0000 mgr.gibba020.yqfnwy (mgr.34427) 6029 : cluster [DBG] pgmap v3426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:54.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:54 gibba013 bash[30381]: cluster 2021-03-10T15:46:53.359767+0000 mgr.gibba020.yqfnwy (mgr.34427) 6029 : cluster [DBG] pgmap v3426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:54.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:54 gibba020 bash[25448]: cluster 2021-03-10T15:46:53.359767+0000 mgr.gibba020.yqfnwy (mgr.34427) 6029 : cluster [DBG] pgmap v3426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:56.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:56 gibba020 bash[25448]: cluster 2021-03-10T15:46:55.361324+0000 mgr.gibba020.yqfnwy (mgr.34427) 6030 : cluster [DBG] pgmap v3427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:56.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:56 gibba013 bash[29418]: cluster 2021-03-10T15:46:55.361324+0000 mgr.gibba020.yqfnwy (mgr.34427) 6030 : cluster [DBG] pgmap v3427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:56.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:56 gibba013 bash[30381]: cluster 2021-03-10T15:46:55.361324+0000 mgr.gibba020.yqfnwy (mgr.34427) 6030 : cluster [DBG] pgmap v3427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:58.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:46:58 gibba020 bash[25448]: cluster 2021-03-10T15:46:57.362776+0000 mgr.gibba020.yqfnwy (mgr.34427) 6031 : cluster [DBG] pgmap v3428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:58.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:46:58 gibba013 bash[29418]: cluster 2021-03-10T15:46:57.362776+0000 mgr.gibba020.yqfnwy (mgr.34427) 6031 : cluster [DBG] pgmap v3428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:46:58.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:46:58 gibba013 bash[30381]: cluster 2021-03-10T15:46:57.362776+0000 mgr.gibba020.yqfnwy (mgr.34427) 6031 : cluster [DBG] pgmap v3428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:00.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:00 gibba020 bash[25448]: cluster 2021-03-10T15:46:59.364337+0000 mgr.gibba020.yqfnwy (mgr.34427) 6032 : cluster [DBG] pgmap v3429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:00.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:00 gibba013 bash[29418]: cluster 2021-03-10T15:46:59.364337+0000 mgr.gibba020.yqfnwy (mgr.34427) 6032 : cluster [DBG] pgmap v3429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:00.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:00 gibba013 bash[30381]: cluster 2021-03-10T15:46:59.364337+0000 mgr.gibba020.yqfnwy (mgr.34427) 6032 : cluster [DBG] pgmap v3429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:02.533 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:47:02.760 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:47:02.760 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (113m) 7m ago 118m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:47:02.760 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (118m) 6m ago 118m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:47:02.761 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (113m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:47:02.761 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (114m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:47:02.761 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (113m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:47:02.761 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (113m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:47:02.761 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (112m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:47:02.762 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (112m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:47:02.762 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (119m) 7m ago 119m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:47:02.762 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (119m) 6m ago 119m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:47:02.762 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (111m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:47:02.763 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (111m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:47:02.763 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (110m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:47:02.763 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (110m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:47:02.763 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (110m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:47:02.763 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (109m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:47:02.764 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (109m) 6m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:47:02.764 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (108m) 6m ago 119m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:47:02.764 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (118m) 6m ago 119m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:47:02.764 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 6m ago 117m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:47:02.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:02 gibba013 bash[29418]: cluster 2021-03-10T15:47:01.366098+0000 mgr.gibba020.yqfnwy (mgr.34427) 6033 : cluster [DBG] pgmap v3430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:02.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:02 gibba013 bash[30381]: cluster 2021-03-10T15:47:01.366098+0000 mgr.gibba020.yqfnwy (mgr.34427) 6033 : cluster [DBG] pgmap v3430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:02.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:02 gibba020 bash[25448]: cluster 2021-03-10T15:47:01.366098+0000 mgr.gibba020.yqfnwy (mgr.34427) 6033 : cluster [DBG] pgmap v3430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:03.010 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:47:03.010 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:47:03.011 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:47:03.011 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:47:03.011 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:47:03.011 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:47:03.012 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:47:03.012 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:47:03.012 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:47:03.012 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:47:03.012 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:47:03.013 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:47:03.013 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:47:03.013 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:47:03.013 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:47:03.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:03 gibba013 bash[29418]: audit 2021-03-10T15:47:02.521066+0000 mgr.gibba020.yqfnwy (mgr.34427) 6034 : audit [DBG] from='client.48102 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:47:03.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:03 gibba013 bash[29418]: audit 2021-03-10T15:47:03.008155+0000 mon.c (mon.1) 98 : audit [DBG] from='client.? 172.21.2.113:0/1689982818' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:03.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:03 gibba013 bash[30381]: audit 2021-03-10T15:47:02.521066+0000 mgr.gibba020.yqfnwy (mgr.34427) 6034 : audit [DBG] from='client.48102 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:47:03.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:03 gibba013 bash[30381]: audit 2021-03-10T15:47:03.008155+0000 mon.c (mon.1) 98 : audit [DBG] from='client.? 172.21.2.113:0/1689982818' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:03.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:03 gibba020 bash[25448]: audit 2021-03-10T15:47:02.521066+0000 mgr.gibba020.yqfnwy (mgr.34427) 6034 : audit [DBG] from='client.48102 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:47:03.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:03 gibba020 bash[25448]: audit 2021-03-10T15:47:03.008155+0000 mon.c (mon.1) 98 : audit [DBG] from='client.? 172.21.2.113:0/1689982818' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:04.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:04 gibba013 bash[29418]: audit 2021-03-10T15:47:02.744329+0000 mgr.gibba020.yqfnwy (mgr.34427) 6035 : audit [DBG] from='client.48108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:47:04.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:04 gibba013 bash[29418]: cluster 2021-03-10T15:47:03.367462+0000 mgr.gibba020.yqfnwy (mgr.34427) 6036 : cluster [DBG] pgmap v3431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:04.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:04 gibba013 bash[29418]: cephadm 2021-03-10T15:47:03.644426+0000 mgr.gibba020.yqfnwy (mgr.34427) 6037 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:47:04.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:04 gibba013 bash[30381]: audit 2021-03-10T15:47:02.744329+0000 mgr.gibba020.yqfnwy (mgr.34427) 6035 : audit [DBG] from='client.48108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:47:04.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:04 gibba013 bash[30381]: cluster 2021-03-10T15:47:03.367462+0000 mgr.gibba020.yqfnwy (mgr.34427) 6036 : cluster [DBG] pgmap v3431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:04.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:04 gibba013 bash[30381]: cephadm 2021-03-10T15:47:03.644426+0000 mgr.gibba020.yqfnwy (mgr.34427) 6037 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:47:04.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:04 gibba020 bash[25448]: audit 2021-03-10T15:47:02.744329+0000 mgr.gibba020.yqfnwy (mgr.34427) 6035 : audit [DBG] from='client.48108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:47:04.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:04 gibba020 bash[25448]: cluster 2021-03-10T15:47:03.367462+0000 mgr.gibba020.yqfnwy (mgr.34427) 6036 : cluster [DBG] pgmap v3431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:04.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:04 gibba020 bash[25448]: cephadm 2021-03-10T15:47:03.644426+0000 mgr.gibba020.yqfnwy (mgr.34427) 6037 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:47:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:06 gibba013 bash[29418]: cluster 2021-03-10T15:47:05.369130+0000 mgr.gibba020.yqfnwy (mgr.34427) 6038 : cluster [DBG] pgmap v3432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:06.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:06 gibba013 bash[30381]: cluster 2021-03-10T15:47:05.369130+0000 mgr.gibba020.yqfnwy (mgr.34427) 6038 : cluster [DBG] pgmap v3432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:06.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:06 gibba020 bash[25448]: cluster 2021-03-10T15:47:05.369130+0000 mgr.gibba020.yqfnwy (mgr.34427) 6038 : cluster [DBG] pgmap v3432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:07.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:07 gibba013 bash[29418]: audit 2021-03-10T15:47:06.547729+0000 mon.a (mon.0) 2373 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:47:07.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:07 gibba013 bash[29418]: audit 2021-03-10T15:47:06.629609+0000 mon.a (mon.0) 2374 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:47:07.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:07 gibba013 bash[29418]: audit 2021-03-10T15:47:06.754731+0000 mon.a (mon.0) 2375 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:47:07.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:07 gibba013 bash[29418]: audit 2021-03-10T15:47:06.755632+0000 mon.a (mon.0) 2376 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:47:07.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:07 gibba013 bash[29418]: audit 2021-03-10T15:47:06.756574+0000 mon.a (mon.0) 2377 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:47:07.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:07 gibba013 bash[29418]: audit 2021-03-10T15:47:06.757355+0000 mon.a (mon.0) 2378 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:47:07.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:07 gibba013 bash[30381]: audit 2021-03-10T15:47:06.547729+0000 mon.a (mon.0) 2373 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:47:07.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:07 gibba013 bash[30381]: audit 2021-03-10T15:47:06.629609+0000 mon.a (mon.0) 2374 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:47:07.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:07 gibba013 bash[30381]: audit 2021-03-10T15:47:06.754731+0000 mon.a (mon.0) 2375 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:47:07.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:07 gibba013 bash[30381]: audit 2021-03-10T15:47:06.755632+0000 mon.a (mon.0) 2376 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:47:07.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:07 gibba013 bash[30381]: audit 2021-03-10T15:47:06.756574+0000 mon.a (mon.0) 2377 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:47:07.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:07 gibba013 bash[30381]: audit 2021-03-10T15:47:06.757355+0000 mon.a (mon.0) 2378 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:47:07.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:07 gibba020 bash[25448]: audit 2021-03-10T15:47:06.547729+0000 mon.a (mon.0) 2373 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:47:07.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:07 gibba020 bash[25448]: audit 2021-03-10T15:47:06.629609+0000 mon.a (mon.0) 2374 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:47:07.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:07 gibba020 bash[25448]: audit 2021-03-10T15:47:06.754731+0000 mon.a (mon.0) 2375 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:47:07.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:07 gibba020 bash[25448]: audit 2021-03-10T15:47:06.755632+0000 mon.a (mon.0) 2376 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:47:07.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:07 gibba020 bash[25448]: audit 2021-03-10T15:47:06.756574+0000 mon.a (mon.0) 2377 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:47:07.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:07 gibba020 bash[25448]: audit 2021-03-10T15:47:06.757355+0000 mon.a (mon.0) 2378 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:47:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:08 gibba013 bash[29418]: cluster 2021-03-10T15:47:07.370634+0000 mgr.gibba020.yqfnwy (mgr.34427) 6039 : cluster [DBG] pgmap v3433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:08.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:08 gibba013 bash[30381]: cluster 2021-03-10T15:47:07.370634+0000 mgr.gibba020.yqfnwy (mgr.34427) 6039 : cluster [DBG] pgmap v3433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:08.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:08 gibba020 bash[25448]: cluster 2021-03-10T15:47:07.370634+0000 mgr.gibba020.yqfnwy (mgr.34427) 6039 : cluster [DBG] pgmap v3433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:10.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:10 gibba013 bash[29418]: cluster 2021-03-10T15:47:09.372232+0000 mgr.gibba020.yqfnwy (mgr.34427) 6040 : cluster [DBG] pgmap v3434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:10.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:10 gibba013 bash[30381]: cluster 2021-03-10T15:47:09.372232+0000 mgr.gibba020.yqfnwy (mgr.34427) 6040 : cluster [DBG] pgmap v3434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:10.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:10 gibba020 bash[25448]: cluster 2021-03-10T15:47:09.372232+0000 mgr.gibba020.yqfnwy (mgr.34427) 6040 : cluster [DBG] pgmap v3434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:12.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:12 gibba013 bash[29418]: cluster 2021-03-10T15:47:11.373819+0000 mgr.gibba020.yqfnwy (mgr.34427) 6041 : cluster [DBG] pgmap v3435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:12.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:12 gibba013 bash[30381]: cluster 2021-03-10T15:47:11.373819+0000 mgr.gibba020.yqfnwy (mgr.34427) 6041 : cluster [DBG] pgmap v3435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:12.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:12 gibba020 bash[25448]: cluster 2021-03-10T15:47:11.373819+0000 mgr.gibba020.yqfnwy (mgr.34427) 6041 : cluster [DBG] pgmap v3435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:14.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:14 gibba013 bash[29418]: cluster 2021-03-10T15:47:13.375211+0000 mgr.gibba020.yqfnwy (mgr.34427) 6042 : cluster [DBG] pgmap v3436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:14.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:14 gibba013 bash[30381]: cluster 2021-03-10T15:47:13.375211+0000 mgr.gibba020.yqfnwy (mgr.34427) 6042 : cluster [DBG] pgmap v3436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:14.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:14 gibba020 bash[25448]: cluster 2021-03-10T15:47:13.375211+0000 mgr.gibba020.yqfnwy (mgr.34427) 6042 : cluster [DBG] pgmap v3436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:16.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:16 gibba020 bash[25448]: cluster 2021-03-10T15:47:15.376942+0000 mgr.gibba020.yqfnwy (mgr.34427) 6043 : cluster [DBG] pgmap v3437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:16.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:16 gibba013 bash[29418]: cluster 2021-03-10T15:47:15.376942+0000 mgr.gibba020.yqfnwy (mgr.34427) 6043 : cluster [DBG] pgmap v3437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:16.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:16 gibba013 bash[30381]: cluster 2021-03-10T15:47:15.376942+0000 mgr.gibba020.yqfnwy (mgr.34427) 6043 : cluster [DBG] pgmap v3437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:18.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:18 gibba013 bash[29418]: cluster 2021-03-10T15:47:17.378513+0000 mgr.gibba020.yqfnwy (mgr.34427) 6044 : cluster [DBG] pgmap v3438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:18.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:18 gibba013 bash[30381]: cluster 2021-03-10T15:47:17.378513+0000 mgr.gibba020.yqfnwy (mgr.34427) 6044 : cluster [DBG] pgmap v3438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:18.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:18 gibba020 bash[25448]: cluster 2021-03-10T15:47:17.378513+0000 mgr.gibba020.yqfnwy (mgr.34427) 6044 : cluster [DBG] pgmap v3438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:19.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:19 gibba013 bash[29418]: cephadm 2021-03-10T15:47:18.660592+0000 mgr.gibba020.yqfnwy (mgr.34427) 6045 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:47:19.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:19 gibba013 bash[30381]: cephadm 2021-03-10T15:47:18.660592+0000 mgr.gibba020.yqfnwy (mgr.34427) 6045 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:47:19.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:19 gibba020 bash[25448]: cephadm 2021-03-10T15:47:18.660592+0000 mgr.gibba020.yqfnwy (mgr.34427) 6045 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:47:20.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:20 gibba013 bash[29418]: cluster 2021-03-10T15:47:19.380278+0000 mgr.gibba020.yqfnwy (mgr.34427) 6046 : cluster [DBG] pgmap v3439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:20.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:20 gibba013 bash[30381]: cluster 2021-03-10T15:47:19.380278+0000 mgr.gibba020.yqfnwy (mgr.34427) 6046 : cluster [DBG] pgmap v3439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:20.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:20 gibba020 bash[25448]: cluster 2021-03-10T15:47:19.380278+0000 mgr.gibba020.yqfnwy (mgr.34427) 6046 : cluster [DBG] pgmap v3439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:22.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:22 gibba013 bash[29418]: cluster 2021-03-10T15:47:21.382201+0000 mgr.gibba020.yqfnwy (mgr.34427) 6047 : cluster [DBG] pgmap v3440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:22.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:22 gibba013 bash[30381]: cluster 2021-03-10T15:47:21.382201+0000 mgr.gibba020.yqfnwy (mgr.34427) 6047 : cluster [DBG] pgmap v3440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:22.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:22 gibba020 bash[25448]: cluster 2021-03-10T15:47:21.382201+0000 mgr.gibba020.yqfnwy (mgr.34427) 6047 : cluster [DBG] pgmap v3440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:24.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:24 gibba013 bash[29418]: cluster 2021-03-10T15:47:23.383829+0000 mgr.gibba020.yqfnwy (mgr.34427) 6048 : cluster [DBG] pgmap v3441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:24.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:24 gibba013 bash[30381]: cluster 2021-03-10T15:47:23.383829+0000 mgr.gibba020.yqfnwy (mgr.34427) 6048 : cluster [DBG] pgmap v3441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:24.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:24 gibba020 bash[25448]: cluster 2021-03-10T15:47:23.383829+0000 mgr.gibba020.yqfnwy (mgr.34427) 6048 : cluster [DBG] pgmap v3441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:26.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:26 gibba013 bash[29418]: cluster 2021-03-10T15:47:25.385650+0000 mgr.gibba020.yqfnwy (mgr.34427) 6049 : cluster [DBG] pgmap v3442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:26.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:26 gibba013 bash[30381]: cluster 2021-03-10T15:47:25.385650+0000 mgr.gibba020.yqfnwy (mgr.34427) 6049 : cluster [DBG] pgmap v3442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:26.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:26 gibba020 bash[25448]: cluster 2021-03-10T15:47:25.385650+0000 mgr.gibba020.yqfnwy (mgr.34427) 6049 : cluster [DBG] pgmap v3442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:28.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:28 gibba013 bash[29418]: cluster 2021-03-10T15:47:27.387229+0000 mgr.gibba020.yqfnwy (mgr.34427) 6050 : cluster [DBG] pgmap v3443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:28.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:28 gibba013 bash[30381]: cluster 2021-03-10T15:47:27.387229+0000 mgr.gibba020.yqfnwy (mgr.34427) 6050 : cluster [DBG] pgmap v3443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:28.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:28 gibba020 bash[25448]: cluster 2021-03-10T15:47:27.387229+0000 mgr.gibba020.yqfnwy (mgr.34427) 6050 : cluster [DBG] pgmap v3443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:30.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:30 gibba013 bash[29418]: cluster 2021-03-10T15:47:29.388790+0000 mgr.gibba020.yqfnwy (mgr.34427) 6051 : cluster [DBG] pgmap v3444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:30.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:30 gibba013 bash[30381]: cluster 2021-03-10T15:47:29.388790+0000 mgr.gibba020.yqfnwy (mgr.34427) 6051 : cluster [DBG] pgmap v3444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:30.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:30 gibba020 bash[25448]: cluster 2021-03-10T15:47:29.388790+0000 mgr.gibba020.yqfnwy (mgr.34427) 6051 : cluster [DBG] pgmap v3444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:32.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:32 gibba013 bash[29418]: cluster 2021-03-10T15:47:31.390667+0000 mgr.gibba020.yqfnwy (mgr.34427) 6052 : cluster [DBG] pgmap v3445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:32.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:32 gibba013 bash[30381]: cluster 2021-03-10T15:47:31.390667+0000 mgr.gibba020.yqfnwy (mgr.34427) 6052 : cluster [DBG] pgmap v3445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:32.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:32 gibba020 bash[25448]: cluster 2021-03-10T15:47:31.390667+0000 mgr.gibba020.yqfnwy (mgr.34427) 6052 : cluster [DBG] pgmap v3445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:33.261 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:47:33.488 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:47:33.488 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (114m) 8m ago 119m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:47:33.488 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (119m) 7m ago 119m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:47:33.489 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (114m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:47:33.489 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (114m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:47:33.489 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (113m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:47:33.489 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (113m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:47:33.490 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (113m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:47:33.490 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (113m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:47:33.490 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (119m) 8m ago 119m 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:47:33.490 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (119m) 7m ago 119m 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:47:33.491 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (112m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:47:33.491 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (111m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:47:33.491 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (111m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:47:33.491 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (111m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:47:33.492 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (110m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:47:33.492 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (110m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:47:33.492 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (109m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:47:33.492 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (109m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:47:33.492 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (118m) 7m ago 119m 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:47:33.493 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 7m ago 117m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:47:33.738 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:47:33.738 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:47:33.738 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:47:33.738 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:47:33.739 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:47:33.739 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:47:33.739 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:47:33.739 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:47:33.740 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:47:33.740 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:47:33.740 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:47:33.740 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:47:33.741 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:47:33.741 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:47:33.741 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:47:34.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:34 gibba020 bash[25448]: audit 2021-03-10T15:47:33.248649+0000 mgr.gibba020.yqfnwy (mgr.34427) 6053 : audit [DBG] from='client.48120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:47:34.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:34 gibba020 bash[25448]: cluster 2021-03-10T15:47:33.392289+0000 mgr.gibba020.yqfnwy (mgr.34427) 6054 : cluster [DBG] pgmap v3446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:34.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:34 gibba020 bash[25448]: audit 2021-03-10T15:47:33.472363+0000 mgr.gibba020.yqfnwy (mgr.34427) 6055 : audit [DBG] from='client.58111 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:47:34.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:34 gibba020 bash[25448]: audit 2021-03-10T15:47:33.673889+0000 mon.a (mon.0) 2379 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:47:34.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:34 gibba020 bash[25448]: cephadm 2021-03-10T15:47:33.676976+0000 mgr.gibba020.yqfnwy (mgr.34427) 6056 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:47:34.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:34 gibba020 bash[25448]: cephadm 2021-03-10T15:47:33.679014+0000 mgr.gibba020.yqfnwy (mgr.34427) 6057 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:47:34.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:34 gibba020 bash[25448]: audit 2021-03-10T15:47:33.735671+0000 mon.a (mon.0) 2380 : audit [DBG] from='client.? 172.21.2.113:0/2657816603' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:34.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:34 gibba020 bash[25448]: audit 2021-03-10T15:47:33.896386+0000 mon.a (mon.0) 2381 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:47:34.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:34 gibba020 bash[25448]: audit 2021-03-10T15:47:33.899840+0000 mon.a (mon.0) 2382 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:47:34.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:34 gibba020 bash[25448]: audit 2021-03-10T15:47:33.901522+0000 mon.a (mon.0) 2383 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:34.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:34 gibba020 bash[25448]: audit 2021-03-10T15:47:33.903122+0000 mon.a (mon.0) 2384 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:34.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:34 gibba020 bash[25448]: audit 2021-03-10T15:47:33.904356+0000 mon.a (mon.0) 2385 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:34.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:34 gibba020 bash[25448]: audit 2021-03-10T15:47:33.905947+0000 mon.a (mon.0) 2386 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:34.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:34 gibba020 bash[25448]: audit 2021-03-10T15:47:33.907349+0000 mon.a (mon.0) 2387 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:34.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:34 gibba013 bash[29418]: audit 2021-03-10T15:47:33.248649+0000 mgr.gibba020.yqfnwy (mgr.34427) 6053 : audit [DBG] from='client.48120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:47:34.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:34 gibba013 bash[29418]: cluster 2021-03-10T15:47:33.392289+0000 mgr.gibba020.yqfnwy (mgr.34427) 6054 : cluster [DBG] pgmap v3446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:34.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:34 gibba013 bash[29418]: audit 2021-03-10T15:47:33.472363+0000 mgr.gibba020.yqfnwy (mgr.34427) 6055 : audit [DBG] from='client.58111 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:47:34.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:34 gibba013 bash[29418]: audit 2021-03-10T15:47:33.673889+0000 mon.a (mon.0) 2379 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:47:34.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:34 gibba013 bash[29418]: cephadm 2021-03-10T15:47:33.676976+0000 mgr.gibba020.yqfnwy (mgr.34427) 6056 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:47:34.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:34 gibba013 bash[29418]: cephadm 2021-03-10T15:47:33.679014+0000 mgr.gibba020.yqfnwy (mgr.34427) 6057 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:47:34.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:34 gibba013 bash[29418]: audit 2021-03-10T15:47:33.735671+0000 mon.a (mon.0) 2380 : audit [DBG] from='client.? 172.21.2.113:0/2657816603' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:34.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:34 gibba013 bash[29418]: audit 2021-03-10T15:47:33.896386+0000 mon.a (mon.0) 2381 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:47:34.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:34 gibba013 bash[29418]: audit 2021-03-10T15:47:33.899840+0000 mon.a (mon.0) 2382 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:47:34.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:34 gibba013 bash[29418]: audit 2021-03-10T15:47:33.901522+0000 mon.a (mon.0) 2383 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:34.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:34 gibba013 bash[29418]: audit 2021-03-10T15:47:33.903122+0000 mon.a (mon.0) 2384 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:34.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:34 gibba013 bash[29418]: audit 2021-03-10T15:47:33.904356+0000 mon.a (mon.0) 2385 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:34.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:34 gibba013 bash[29418]: audit 2021-03-10T15:47:33.905947+0000 mon.a (mon.0) 2386 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:34.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:34 gibba013 bash[29418]: audit 2021-03-10T15:47:33.907349+0000 mon.a (mon.0) 2387 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:34.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:34 gibba013 bash[30381]: audit 2021-03-10T15:47:33.248649+0000 mgr.gibba020.yqfnwy (mgr.34427) 6053 : audit [DBG] from='client.48120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:47:34.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:34 gibba013 bash[30381]: cluster 2021-03-10T15:47:33.392289+0000 mgr.gibba020.yqfnwy (mgr.34427) 6054 : cluster [DBG] pgmap v3446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:34.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:34 gibba013 bash[30381]: audit 2021-03-10T15:47:33.472363+0000 mgr.gibba020.yqfnwy (mgr.34427) 6055 : audit [DBG] from='client.58111 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:47:34.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:34 gibba013 bash[30381]: audit 2021-03-10T15:47:33.673889+0000 mon.a (mon.0) 2379 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:47:34.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:34 gibba013 bash[30381]: cephadm 2021-03-10T15:47:33.676976+0000 mgr.gibba020.yqfnwy (mgr.34427) 6056 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:47:34.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:34 gibba013 bash[30381]: cephadm 2021-03-10T15:47:33.679014+0000 mgr.gibba020.yqfnwy (mgr.34427) 6057 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:47:34.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:34 gibba013 bash[30381]: audit 2021-03-10T15:47:33.735671+0000 mon.a (mon.0) 2380 : audit [DBG] from='client.? 172.21.2.113:0/2657816603' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:34.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:34 gibba013 bash[30381]: audit 2021-03-10T15:47:33.896386+0000 mon.a (mon.0) 2381 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:47:34.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:34 gibba013 bash[30381]: audit 2021-03-10T15:47:33.899840+0000 mon.a (mon.0) 2382 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:47:34.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:34 gibba013 bash[30381]: audit 2021-03-10T15:47:33.901522+0000 mon.a (mon.0) 2383 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:34.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:34 gibba013 bash[30381]: audit 2021-03-10T15:47:33.903122+0000 mon.a (mon.0) 2384 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:34.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:34 gibba013 bash[30381]: audit 2021-03-10T15:47:33.904356+0000 mon.a (mon.0) 2385 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:34.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:34 gibba013 bash[30381]: audit 2021-03-10T15:47:33.905947+0000 mon.a (mon.0) 2386 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:34.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:34 gibba013 bash[30381]: audit 2021-03-10T15:47:33.907349+0000 mon.a (mon.0) 2387 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:47:35.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:35 gibba013 bash[29418]: cephadm 2021-03-10T15:47:33.897878+0000 mgr.gibba020.yqfnwy (mgr.34427) 6058 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:47:35.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:35 gibba013 bash[29418]: cephadm 2021-03-10T15:47:33.899875+0000 mgr.gibba020.yqfnwy (mgr.34427) 6059 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:47:35.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:35 gibba013 bash[29418]: cephadm 2021-03-10T15:47:33.901498+0000 mgr.gibba020.yqfnwy (mgr.34427) 6060 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:47:35.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:35 gibba013 bash[29418]: cephadm 2021-03-10T15:47:33.901536+0000 mgr.gibba020.yqfnwy (mgr.34427) 6061 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:47:35.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:35 gibba013 bash[29418]: cephadm 2021-03-10T15:47:33.902991+0000 mgr.gibba020.yqfnwy (mgr.34427) 6062 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:47:35.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:35 gibba013 bash[29418]: cephadm 2021-03-10T15:47:33.903030+0000 mgr.gibba020.yqfnwy (mgr.34427) 6063 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:47:35.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:35 gibba013 bash[29418]: cephadm 2021-03-10T15:47:33.903848+0000 mgr.gibba020.yqfnwy (mgr.34427) 6064 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:47:35.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:35 gibba013 bash[29418]: cephadm 2021-03-10T15:47:33.904524+0000 mgr.gibba020.yqfnwy (mgr.34427) 6065 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:47:35.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:35 gibba013 bash[29418]: cephadm 2021-03-10T15:47:33.904561+0000 mgr.gibba020.yqfnwy (mgr.34427) 6066 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:47:35.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:35 gibba013 bash[29418]: cephadm 2021-03-10T15:47:33.905612+0000 mgr.gibba020.yqfnwy (mgr.34427) 6067 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:47:35.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:35 gibba013 bash[29418]: cephadm 2021-03-10T15:47:33.905936+0000 mgr.gibba020.yqfnwy (mgr.34427) 6068 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:47:35.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:35 gibba013 bash[29418]: cephadm 2021-03-10T15:47:33.906953+0000 mgr.gibba020.yqfnwy (mgr.34427) 6069 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:47:35.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:35 gibba013 bash[29418]: cephadm 2021-03-10T15:47:33.906991+0000 mgr.gibba020.yqfnwy (mgr.34427) 6070 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:47:35.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:35 gibba013 bash[29418]: cephadm 2021-03-10T15:47:33.907096+0000 mgr.gibba020.yqfnwy (mgr.34427) 6071 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:47:35.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:35 gibba013 bash[30381]: cephadm 2021-03-10T15:47:33.897878+0000 mgr.gibba020.yqfnwy (mgr.34427) 6058 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:47:35.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:35 gibba013 bash[30381]: cephadm 2021-03-10T15:47:33.899875+0000 mgr.gibba020.yqfnwy (mgr.34427) 6059 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:47:35.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:35 gibba013 bash[30381]: cephadm 2021-03-10T15:47:33.901498+0000 mgr.gibba020.yqfnwy (mgr.34427) 6060 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:47:35.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:35 gibba013 bash[30381]: cephadm 2021-03-10T15:47:33.901536+0000 mgr.gibba020.yqfnwy (mgr.34427) 6061 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:47:35.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:35 gibba013 bash[30381]: cephadm 2021-03-10T15:47:33.902991+0000 mgr.gibba020.yqfnwy (mgr.34427) 6062 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:47:35.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:35 gibba013 bash[30381]: cephadm 2021-03-10T15:47:33.903030+0000 mgr.gibba020.yqfnwy (mgr.34427) 6063 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:47:35.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:35 gibba013 bash[30381]: cephadm 2021-03-10T15:47:33.903848+0000 mgr.gibba020.yqfnwy (mgr.34427) 6064 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:47:35.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:35 gibba013 bash[30381]: cephadm 2021-03-10T15:47:33.904524+0000 mgr.gibba020.yqfnwy (mgr.34427) 6065 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:47:35.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:35 gibba013 bash[30381]: cephadm 2021-03-10T15:47:33.904561+0000 mgr.gibba020.yqfnwy (mgr.34427) 6066 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:47:35.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:35 gibba013 bash[30381]: cephadm 2021-03-10T15:47:33.905612+0000 mgr.gibba020.yqfnwy (mgr.34427) 6067 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:47:35.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:35 gibba013 bash[30381]: cephadm 2021-03-10T15:47:33.905936+0000 mgr.gibba020.yqfnwy (mgr.34427) 6068 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:47:35.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:35 gibba013 bash[30381]: cephadm 2021-03-10T15:47:33.906953+0000 mgr.gibba020.yqfnwy (mgr.34427) 6069 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:47:35.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:35 gibba013 bash[30381]: cephadm 2021-03-10T15:47:33.906991+0000 mgr.gibba020.yqfnwy (mgr.34427) 6070 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:47:35.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:35 gibba013 bash[30381]: cephadm 2021-03-10T15:47:33.907096+0000 mgr.gibba020.yqfnwy (mgr.34427) 6071 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:47:35.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:35 gibba020 bash[25448]: cephadm 2021-03-10T15:47:33.897878+0000 mgr.gibba020.yqfnwy (mgr.34427) 6058 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:47:35.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:35 gibba020 bash[25448]: cephadm 2021-03-10T15:47:33.899875+0000 mgr.gibba020.yqfnwy (mgr.34427) 6059 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:47:35.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:35 gibba020 bash[25448]: cephadm 2021-03-10T15:47:33.901498+0000 mgr.gibba020.yqfnwy (mgr.34427) 6060 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:47:35.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:35 gibba020 bash[25448]: cephadm 2021-03-10T15:47:33.901536+0000 mgr.gibba020.yqfnwy (mgr.34427) 6061 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:47:35.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:35 gibba020 bash[25448]: cephadm 2021-03-10T15:47:33.902991+0000 mgr.gibba020.yqfnwy (mgr.34427) 6062 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:47:35.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:35 gibba020 bash[25448]: cephadm 2021-03-10T15:47:33.903030+0000 mgr.gibba020.yqfnwy (mgr.34427) 6063 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:47:35.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:35 gibba020 bash[25448]: cephadm 2021-03-10T15:47:33.903848+0000 mgr.gibba020.yqfnwy (mgr.34427) 6064 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:47:35.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:35 gibba020 bash[25448]: cephadm 2021-03-10T15:47:33.904524+0000 mgr.gibba020.yqfnwy (mgr.34427) 6065 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:47:35.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:35 gibba020 bash[25448]: cephadm 2021-03-10T15:47:33.904561+0000 mgr.gibba020.yqfnwy (mgr.34427) 6066 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:47:35.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:35 gibba020 bash[25448]: cephadm 2021-03-10T15:47:33.905612+0000 mgr.gibba020.yqfnwy (mgr.34427) 6067 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:47:35.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:35 gibba020 bash[25448]: cephadm 2021-03-10T15:47:33.905936+0000 mgr.gibba020.yqfnwy (mgr.34427) 6068 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:47:35.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:35 gibba020 bash[25448]: cephadm 2021-03-10T15:47:33.906953+0000 mgr.gibba020.yqfnwy (mgr.34427) 6069 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:47:35.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:35 gibba020 bash[25448]: cephadm 2021-03-10T15:47:33.906991+0000 mgr.gibba020.yqfnwy (mgr.34427) 6070 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:47:35.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:35 gibba020 bash[25448]: cephadm 2021-03-10T15:47:33.907096+0000 mgr.gibba020.yqfnwy (mgr.34427) 6071 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:47:36.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:36 gibba013 bash[29418]: cluster 2021-03-10T15:47:35.393928+0000 mgr.gibba020.yqfnwy (mgr.34427) 6072 : cluster [DBG] pgmap v3447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:36.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:36 gibba013 bash[30381]: cluster 2021-03-10T15:47:35.393928+0000 mgr.gibba020.yqfnwy (mgr.34427) 6072 : cluster [DBG] pgmap v3447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:36.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:36 gibba020 bash[25448]: cluster 2021-03-10T15:47:35.393928+0000 mgr.gibba020.yqfnwy (mgr.34427) 6072 : cluster [DBG] pgmap v3447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:38.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:38 gibba013 bash[29418]: cluster 2021-03-10T15:47:37.395457+0000 mgr.gibba020.yqfnwy (mgr.34427) 6073 : cluster [DBG] pgmap v3448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:38.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:38 gibba013 bash[30381]: cluster 2021-03-10T15:47:37.395457+0000 mgr.gibba020.yqfnwy (mgr.34427) 6073 : cluster [DBG] pgmap v3448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:38.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:38 gibba020 bash[25448]: cluster 2021-03-10T15:47:37.395457+0000 mgr.gibba020.yqfnwy (mgr.34427) 6073 : cluster [DBG] pgmap v3448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:40.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:40 gibba013 bash[29418]: cluster 2021-03-10T15:47:39.396872+0000 mgr.gibba020.yqfnwy (mgr.34427) 6074 : cluster [DBG] pgmap v3449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:40.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:40 gibba013 bash[30381]: cluster 2021-03-10T15:47:39.396872+0000 mgr.gibba020.yqfnwy (mgr.34427) 6074 : cluster [DBG] pgmap v3449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:40.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:40 gibba020 bash[25448]: cluster 2021-03-10T15:47:39.396872+0000 mgr.gibba020.yqfnwy (mgr.34427) 6074 : cluster [DBG] pgmap v3449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:42.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:42 gibba013 bash[29418]: cluster 2021-03-10T15:47:41.398764+0000 mgr.gibba020.yqfnwy (mgr.34427) 6075 : cluster [DBG] pgmap v3450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:42.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:42 gibba013 bash[30381]: cluster 2021-03-10T15:47:41.398764+0000 mgr.gibba020.yqfnwy (mgr.34427) 6075 : cluster [DBG] pgmap v3450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:42.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:42 gibba020 bash[25448]: cluster 2021-03-10T15:47:41.398764+0000 mgr.gibba020.yqfnwy (mgr.34427) 6075 : cluster [DBG] pgmap v3450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:44.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:44 gibba013 bash[29418]: cluster 2021-03-10T15:47:43.400177+0000 mgr.gibba020.yqfnwy (mgr.34427) 6076 : cluster [DBG] pgmap v3451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:44.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:44 gibba013 bash[30381]: cluster 2021-03-10T15:47:43.400177+0000 mgr.gibba020.yqfnwy (mgr.34427) 6076 : cluster [DBG] pgmap v3451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:44.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:44 gibba020 bash[25448]: cluster 2021-03-10T15:47:43.400177+0000 mgr.gibba020.yqfnwy (mgr.34427) 6076 : cluster [DBG] pgmap v3451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:46.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:46 gibba013 bash[29418]: cluster 2021-03-10T15:47:45.401833+0000 mgr.gibba020.yqfnwy (mgr.34427) 6077 : cluster [DBG] pgmap v3452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:46.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:46 gibba013 bash[30381]: cluster 2021-03-10T15:47:45.401833+0000 mgr.gibba020.yqfnwy (mgr.34427) 6077 : cluster [DBG] pgmap v3452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:46.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:46 gibba020 bash[25448]: cluster 2021-03-10T15:47:45.401833+0000 mgr.gibba020.yqfnwy (mgr.34427) 6077 : cluster [DBG] pgmap v3452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:48.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:48 gibba013 bash[29418]: cluster 2021-03-10T15:47:47.403243+0000 mgr.gibba020.yqfnwy (mgr.34427) 6078 : cluster [DBG] pgmap v3453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:48.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:48 gibba013 bash[30381]: cluster 2021-03-10T15:47:47.403243+0000 mgr.gibba020.yqfnwy (mgr.34427) 6078 : cluster [DBG] pgmap v3453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:48.926 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:48 gibba020 bash[25448]: cluster 2021-03-10T15:47:47.403243+0000 mgr.gibba020.yqfnwy (mgr.34427) 6078 : cluster [DBG] pgmap v3453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:50.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:50 gibba013 bash[29418]: cephadm 2021-03-10T15:47:48.923027+0000 mgr.gibba020.yqfnwy (mgr.34427) 6079 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:47:50.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:50 gibba013 bash[29418]: cluster 2021-03-10T15:47:49.404508+0000 mgr.gibba020.yqfnwy (mgr.34427) 6080 : cluster [DBG] pgmap v3454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:50.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:50 gibba013 bash[30381]: cephadm 2021-03-10T15:47:48.923027+0000 mgr.gibba020.yqfnwy (mgr.34427) 6079 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:47:50.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:50 gibba013 bash[30381]: cluster 2021-03-10T15:47:49.404508+0000 mgr.gibba020.yqfnwy (mgr.34427) 6080 : cluster [DBG] pgmap v3454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:50.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:50 gibba020 bash[25448]: cephadm 2021-03-10T15:47:48.923027+0000 mgr.gibba020.yqfnwy (mgr.34427) 6079 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:47:50.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:50 gibba020 bash[25448]: cluster 2021-03-10T15:47:49.404508+0000 mgr.gibba020.yqfnwy (mgr.34427) 6080 : cluster [DBG] pgmap v3454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:52.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:52 gibba013 bash[29418]: cluster 2021-03-10T15:47:51.406380+0000 mgr.gibba020.yqfnwy (mgr.34427) 6081 : cluster [DBG] pgmap v3455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:52.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:52 gibba013 bash[30381]: cluster 2021-03-10T15:47:51.406380+0000 mgr.gibba020.yqfnwy (mgr.34427) 6081 : cluster [DBG] pgmap v3455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:52.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:52 gibba020 bash[25448]: cluster 2021-03-10T15:47:51.406380+0000 mgr.gibba020.yqfnwy (mgr.34427) 6081 : cluster [DBG] pgmap v3455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:54.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:54 gibba013 bash[29418]: cluster 2021-03-10T15:47:53.407785+0000 mgr.gibba020.yqfnwy (mgr.34427) 6082 : cluster [DBG] pgmap v3456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:54.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:54 gibba013 bash[30381]: cluster 2021-03-10T15:47:53.407785+0000 mgr.gibba020.yqfnwy (mgr.34427) 6082 : cluster [DBG] pgmap v3456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:54.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:54 gibba020 bash[25448]: cluster 2021-03-10T15:47:53.407785+0000 mgr.gibba020.yqfnwy (mgr.34427) 6082 : cluster [DBG] pgmap v3456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:56.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:56 gibba013 bash[29418]: cluster 2021-03-10T15:47:55.409397+0000 mgr.gibba020.yqfnwy (mgr.34427) 6083 : cluster [DBG] pgmap v3457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:56.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:56 gibba013 bash[30381]: cluster 2021-03-10T15:47:55.409397+0000 mgr.gibba020.yqfnwy (mgr.34427) 6083 : cluster [DBG] pgmap v3457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:56.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:56 gibba020 bash[25448]: cluster 2021-03-10T15:47:55.409397+0000 mgr.gibba020.yqfnwy (mgr.34427) 6083 : cluster [DBG] pgmap v3457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:58.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:47:58 gibba013 bash[29418]: cluster 2021-03-10T15:47:57.410704+0000 mgr.gibba020.yqfnwy (mgr.34427) 6084 : cluster [DBG] pgmap v3458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:58.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:47:58 gibba013 bash[30381]: cluster 2021-03-10T15:47:57.410704+0000 mgr.gibba020.yqfnwy (mgr.34427) 6084 : cluster [DBG] pgmap v3458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:47:58.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:47:58 gibba020 bash[25448]: cluster 2021-03-10T15:47:57.410704+0000 mgr.gibba020.yqfnwy (mgr.34427) 6084 : cluster [DBG] pgmap v3458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:00.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:00 gibba013 bash[29418]: cluster 2021-03-10T15:47:59.412073+0000 mgr.gibba020.yqfnwy (mgr.34427) 6085 : cluster [DBG] pgmap v3459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:00.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:00 gibba013 bash[30381]: cluster 2021-03-10T15:47:59.412073+0000 mgr.gibba020.yqfnwy (mgr.34427) 6085 : cluster [DBG] pgmap v3459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:00.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:00 gibba020 bash[25448]: cluster 2021-03-10T15:47:59.412073+0000 mgr.gibba020.yqfnwy (mgr.34427) 6085 : cluster [DBG] pgmap v3459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:02.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:02 gibba013 bash[29418]: cluster 2021-03-10T15:48:01.413723+0000 mgr.gibba020.yqfnwy (mgr.34427) 6086 : cluster [DBG] pgmap v3460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:02.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:02 gibba013 bash[30381]: cluster 2021-03-10T15:48:01.413723+0000 mgr.gibba020.yqfnwy (mgr.34427) 6086 : cluster [DBG] pgmap v3460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:02.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:02 gibba020 bash[25448]: cluster 2021-03-10T15:48:01.413723+0000 mgr.gibba020.yqfnwy (mgr.34427) 6086 : cluster [DBG] pgmap v3460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:03.983 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:48:04.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:04 gibba020 bash[25448]: cluster 2021-03-10T15:48:03.415095+0000 mgr.gibba020.yqfnwy (mgr.34427) 6087 : cluster [DBG] pgmap v3461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:04.241 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:48:04.241 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (114m) 8m ago 119m 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:48:04.241 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (119m) 7m ago 119m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:48:04.242 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (114m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:48:04.242 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (115m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:48:04.242 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (114m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:48:04.242 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (114m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:48:04.243 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (113m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:48:04.243 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (113m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:48:04.243 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:48:04.243 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:48:04.244 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (112m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:48:04.244 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (112m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:48:04.244 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (111m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:48:04.244 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (111m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:48:04.244 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (111m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:48:04.245 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (110m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:48:04.245 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (110m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:48:04.245 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (109m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:48:04.245 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (119m) 7m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:48:04.245 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 7m ago 118m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:48:04.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:04 gibba013 bash[29418]: cluster 2021-03-10T15:48:03.415095+0000 mgr.gibba020.yqfnwy (mgr.34427) 6087 : cluster [DBG] pgmap v3461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:04.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:04 gibba013 bash[30381]: cluster 2021-03-10T15:48:03.415095+0000 mgr.gibba020.yqfnwy (mgr.34427) 6087 : cluster [DBG] pgmap v3461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:04.490 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:48:04.490 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:48:04.491 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:48:04.491 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:48:04.491 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:48:04.491 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:48:04.492 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:48:04.492 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:48:04.492 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:48:04.492 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:48:04.493 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:48:04.493 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:48:04.493 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:48:04.493 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:48:04.493 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:48:05.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:05 gibba013 bash[29418]: cephadm 2021-03-10T15:48:03.939070+0000 mgr.gibba020.yqfnwy (mgr.34427) 6088 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:48:05.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:05 gibba013 bash[29418]: audit 2021-03-10T15:48:03.970959+0000 mgr.gibba020.yqfnwy (mgr.34427) 6089 : audit [DBG] from='client.48138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:48:05.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:05 gibba013 bash[29418]: audit 2021-03-10T15:48:04.197048+0000 mgr.gibba020.yqfnwy (mgr.34427) 6090 : audit [DBG] from='client.48144 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:48:05.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:05 gibba013 bash[29418]: audit 2021-03-10T15:48:04.488690+0000 mon.a (mon.0) 2388 : audit [DBG] from='client.? 172.21.2.113:0/2720430941' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:05.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:05 gibba013 bash[30381]: cephadm 2021-03-10T15:48:03.939070+0000 mgr.gibba020.yqfnwy (mgr.34427) 6088 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:48:05.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:05 gibba013 bash[30381]: audit 2021-03-10T15:48:03.970959+0000 mgr.gibba020.yqfnwy (mgr.34427) 6089 : audit [DBG] from='client.48138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:48:05.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:05 gibba013 bash[30381]: audit 2021-03-10T15:48:04.197048+0000 mgr.gibba020.yqfnwy (mgr.34427) 6090 : audit [DBG] from='client.48144 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:48:05.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:05 gibba013 bash[30381]: audit 2021-03-10T15:48:04.488690+0000 mon.a (mon.0) 2388 : audit [DBG] from='client.? 172.21.2.113:0/2720430941' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:05.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:05 gibba020 bash[25448]: cephadm 2021-03-10T15:48:03.939070+0000 mgr.gibba020.yqfnwy (mgr.34427) 6088 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:48:05.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:05 gibba020 bash[25448]: audit 2021-03-10T15:48:03.970959+0000 mgr.gibba020.yqfnwy (mgr.34427) 6089 : audit [DBG] from='client.48138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:48:05.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:05 gibba020 bash[25448]: audit 2021-03-10T15:48:04.197048+0000 mgr.gibba020.yqfnwy (mgr.34427) 6090 : audit [DBG] from='client.48144 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:48:05.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:05 gibba020 bash[25448]: audit 2021-03-10T15:48:04.488690+0000 mon.a (mon.0) 2388 : audit [DBG] from='client.? 172.21.2.113:0/2720430941' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:06.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:06 gibba013 bash[29418]: cluster 2021-03-10T15:48:05.416844+0000 mgr.gibba020.yqfnwy (mgr.34427) 6091 : cluster [DBG] pgmap v3462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:06.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:06 gibba013 bash[30381]: cluster 2021-03-10T15:48:05.416844+0000 mgr.gibba020.yqfnwy (mgr.34427) 6091 : cluster [DBG] pgmap v3462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:06.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:06 gibba020 bash[25448]: cluster 2021-03-10T15:48:05.416844+0000 mgr.gibba020.yqfnwy (mgr.34427) 6091 : cluster [DBG] pgmap v3462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:07 gibba013 bash[29418]: audit 2021-03-10T15:48:06.552898+0000 mon.a (mon.0) 2389 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:48:07.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:07 gibba013 bash[29418]: audit 2021-03-10T15:48:06.634904+0000 mon.a (mon.0) 2390 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:48:07.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:07 gibba013 bash[29418]: audit 2021-03-10T15:48:06.765628+0000 mon.a (mon.0) 2391 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:48:07.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:07 gibba013 bash[29418]: audit 2021-03-10T15:48:06.766465+0000 mon.a (mon.0) 2392 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:48:07.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:07 gibba013 bash[29418]: audit 2021-03-10T15:48:06.767129+0000 mon.a (mon.0) 2393 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:48:07.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:07 gibba013 bash[29418]: audit 2021-03-10T15:48:06.767820+0000 mon.a (mon.0) 2394 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:48:07.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:07 gibba013 bash[30381]: audit 2021-03-10T15:48:06.552898+0000 mon.a (mon.0) 2389 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:48:07.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:07 gibba013 bash[30381]: audit 2021-03-10T15:48:06.634904+0000 mon.a (mon.0) 2390 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:48:07.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:07 gibba013 bash[30381]: audit 2021-03-10T15:48:06.765628+0000 mon.a (mon.0) 2391 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:48:07.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:07 gibba013 bash[30381]: audit 2021-03-10T15:48:06.766465+0000 mon.a (mon.0) 2392 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:48:07.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:07 gibba013 bash[30381]: audit 2021-03-10T15:48:06.767129+0000 mon.a (mon.0) 2393 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:48:07.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:07 gibba013 bash[30381]: audit 2021-03-10T15:48:06.767820+0000 mon.a (mon.0) 2394 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:48:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:07 gibba020 bash[25448]: audit 2021-03-10T15:48:06.552898+0000 mon.a (mon.0) 2389 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:48:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:07 gibba020 bash[25448]: audit 2021-03-10T15:48:06.634904+0000 mon.a (mon.0) 2390 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:48:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:07 gibba020 bash[25448]: audit 2021-03-10T15:48:06.765628+0000 mon.a (mon.0) 2391 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T15:48:07.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:07 gibba020 bash[25448]: audit 2021-03-10T15:48:06.766465+0000 mon.a (mon.0) 2392 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:48:07.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:07 gibba020 bash[25448]: audit 2021-03-10T15:48:06.767129+0000 mon.a (mon.0) 2393 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T15:48:07.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:07 gibba020 bash[25448]: audit 2021-03-10T15:48:06.767820+0000 mon.a (mon.0) 2394 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:48:08.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:08 gibba013 bash[29418]: cluster 2021-03-10T15:48:07.418269+0000 mgr.gibba020.yqfnwy (mgr.34427) 6092 : cluster [DBG] pgmap v3463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:08.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:08 gibba013 bash[30381]: cluster 2021-03-10T15:48:07.418269+0000 mgr.gibba020.yqfnwy (mgr.34427) 6092 : cluster [DBG] pgmap v3463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:08.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:08 gibba020 bash[25448]: cluster 2021-03-10T15:48:07.418269+0000 mgr.gibba020.yqfnwy (mgr.34427) 6092 : cluster [DBG] pgmap v3463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:10.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:10 gibba013 bash[29418]: cluster 2021-03-10T15:48:09.419742+0000 mgr.gibba020.yqfnwy (mgr.34427) 6093 : cluster [DBG] pgmap v3464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:10.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:10 gibba013 bash[30381]: cluster 2021-03-10T15:48:09.419742+0000 mgr.gibba020.yqfnwy (mgr.34427) 6093 : cluster [DBG] pgmap v3464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:10.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:10 gibba020 bash[25448]: cluster 2021-03-10T15:48:09.419742+0000 mgr.gibba020.yqfnwy (mgr.34427) 6093 : cluster [DBG] pgmap v3464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:12.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:12 gibba013 bash[29418]: cluster 2021-03-10T15:48:11.421474+0000 mgr.gibba020.yqfnwy (mgr.34427) 6094 : cluster [DBG] pgmap v3465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:12.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:12 gibba013 bash[30381]: cluster 2021-03-10T15:48:11.421474+0000 mgr.gibba020.yqfnwy (mgr.34427) 6094 : cluster [DBG] pgmap v3465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:12.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:12 gibba020 bash[25448]: cluster 2021-03-10T15:48:11.421474+0000 mgr.gibba020.yqfnwy (mgr.34427) 6094 : cluster [DBG] pgmap v3465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:14.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:14 gibba013 bash[29418]: cluster 2021-03-10T15:48:13.422770+0000 mgr.gibba020.yqfnwy (mgr.34427) 6095 : cluster [DBG] pgmap v3466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:14.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:14 gibba013 bash[30381]: cluster 2021-03-10T15:48:13.422770+0000 mgr.gibba020.yqfnwy (mgr.34427) 6095 : cluster [DBG] pgmap v3466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:14.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:14 gibba020 bash[25448]: cluster 2021-03-10T15:48:13.422770+0000 mgr.gibba020.yqfnwy (mgr.34427) 6095 : cluster [DBG] pgmap v3466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:16.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:16 gibba013 bash[29418]: cluster 2021-03-10T15:48:15.424492+0000 mgr.gibba020.yqfnwy (mgr.34427) 6096 : cluster [DBG] pgmap v3467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:16.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:16 gibba013 bash[30381]: cluster 2021-03-10T15:48:15.424492+0000 mgr.gibba020.yqfnwy (mgr.34427) 6096 : cluster [DBG] pgmap v3467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:16.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:16 gibba020 bash[25448]: cluster 2021-03-10T15:48:15.424492+0000 mgr.gibba020.yqfnwy (mgr.34427) 6096 : cluster [DBG] pgmap v3467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:18.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:18 gibba013 bash[29418]: cluster 2021-03-10T15:48:17.426074+0000 mgr.gibba020.yqfnwy (mgr.34427) 6097 : cluster [DBG] pgmap v3468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:18.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:18 gibba013 bash[30381]: cluster 2021-03-10T15:48:17.426074+0000 mgr.gibba020.yqfnwy (mgr.34427) 6097 : cluster [DBG] pgmap v3468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:18.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:18 gibba020 bash[25448]: cluster 2021-03-10T15:48:17.426074+0000 mgr.gibba020.yqfnwy (mgr.34427) 6097 : cluster [DBG] pgmap v3468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:20.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:20 gibba013 bash[29418]: cephadm 2021-03-10T15:48:18.952925+0000 mgr.gibba020.yqfnwy (mgr.34427) 6098 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:48:20.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:20 gibba013 bash[29418]: cluster 2021-03-10T15:48:19.427545+0000 mgr.gibba020.yqfnwy (mgr.34427) 6099 : cluster [DBG] pgmap v3469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:20.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:20 gibba013 bash[30381]: cephadm 2021-03-10T15:48:18.952925+0000 mgr.gibba020.yqfnwy (mgr.34427) 6098 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:48:20.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:20 gibba013 bash[30381]: cluster 2021-03-10T15:48:19.427545+0000 mgr.gibba020.yqfnwy (mgr.34427) 6099 : cluster [DBG] pgmap v3469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:20.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:20 gibba020 bash[25448]: cephadm 2021-03-10T15:48:18.952925+0000 mgr.gibba020.yqfnwy (mgr.34427) 6098 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:48:20.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:20 gibba020 bash[25448]: cluster 2021-03-10T15:48:19.427545+0000 mgr.gibba020.yqfnwy (mgr.34427) 6099 : cluster [DBG] pgmap v3469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:22.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:22 gibba013 bash[29418]: cluster 2021-03-10T15:48:21.429302+0000 mgr.gibba020.yqfnwy (mgr.34427) 6100 : cluster [DBG] pgmap v3470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:22.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:22 gibba013 bash[30381]: cluster 2021-03-10T15:48:21.429302+0000 mgr.gibba020.yqfnwy (mgr.34427) 6100 : cluster [DBG] pgmap v3470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:22.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:22 gibba020 bash[25448]: cluster 2021-03-10T15:48:21.429302+0000 mgr.gibba020.yqfnwy (mgr.34427) 6100 : cluster [DBG] pgmap v3470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:24.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:24 gibba013 bash[29418]: cluster 2021-03-10T15:48:23.430621+0000 mgr.gibba020.yqfnwy (mgr.34427) 6101 : cluster [DBG] pgmap v3471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:24.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:24 gibba013 bash[30381]: cluster 2021-03-10T15:48:23.430621+0000 mgr.gibba020.yqfnwy (mgr.34427) 6101 : cluster [DBG] pgmap v3471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:24.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:24 gibba020 bash[25448]: cluster 2021-03-10T15:48:23.430621+0000 mgr.gibba020.yqfnwy (mgr.34427) 6101 : cluster [DBG] pgmap v3471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:26.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:26 gibba013 bash[29418]: cluster 2021-03-10T15:48:25.432349+0000 mgr.gibba020.yqfnwy (mgr.34427) 6102 : cluster [DBG] pgmap v3472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:26.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:26 gibba013 bash[30381]: cluster 2021-03-10T15:48:25.432349+0000 mgr.gibba020.yqfnwy (mgr.34427) 6102 : cluster [DBG] pgmap v3472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:26.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:26 gibba020 bash[25448]: cluster 2021-03-10T15:48:25.432349+0000 mgr.gibba020.yqfnwy (mgr.34427) 6102 : cluster [DBG] pgmap v3472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:28.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:28 gibba013 bash[29418]: cluster 2021-03-10T15:48:27.433757+0000 mgr.gibba020.yqfnwy (mgr.34427) 6103 : cluster [DBG] pgmap v3473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:28.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:28 gibba013 bash[30381]: cluster 2021-03-10T15:48:27.433757+0000 mgr.gibba020.yqfnwy (mgr.34427) 6103 : cluster [DBG] pgmap v3473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:28.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:28 gibba020 bash[25448]: cluster 2021-03-10T15:48:27.433757+0000 mgr.gibba020.yqfnwy (mgr.34427) 6103 : cluster [DBG] pgmap v3473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:30.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:30 gibba013 bash[29418]: cluster 2021-03-10T15:48:29.435200+0000 mgr.gibba020.yqfnwy (mgr.34427) 6104 : cluster [DBG] pgmap v3474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:30.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:30 gibba013 bash[30381]: cluster 2021-03-10T15:48:29.435200+0000 mgr.gibba020.yqfnwy (mgr.34427) 6104 : cluster [DBG] pgmap v3474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:30.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:30 gibba020 bash[25448]: cluster 2021-03-10T15:48:29.435200+0000 mgr.gibba020.yqfnwy (mgr.34427) 6104 : cluster [DBG] pgmap v3474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:32.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:32 gibba013 bash[29418]: cluster 2021-03-10T15:48:31.437103+0000 mgr.gibba020.yqfnwy (mgr.34427) 6105 : cluster [DBG] pgmap v3475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:32.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:32 gibba013 bash[30381]: cluster 2021-03-10T15:48:31.437103+0000 mgr.gibba020.yqfnwy (mgr.34427) 6105 : cluster [DBG] pgmap v3475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:32.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:32 gibba020 bash[25448]: cluster 2021-03-10T15:48:31.437103+0000 mgr.gibba020.yqfnwy (mgr.34427) 6105 : cluster [DBG] pgmap v3475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:34.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:34 gibba013 bash[29418]: cluster 2021-03-10T15:48:33.438475+0000 mgr.gibba020.yqfnwy (mgr.34427) 6106 : cluster [DBG] pgmap v3476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:34.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:34 gibba013 bash[29418]: audit 2021-03-10T15:48:33.970710+0000 mon.a (mon.0) 2395 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:48:34.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:34 gibba013 bash[29418]: audit 2021-03-10T15:48:33.977439+0000 mon.a (mon.0) 2396 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T15:48:34.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:34 gibba013 bash[30381]: cluster 2021-03-10T15:48:33.438475+0000 mgr.gibba020.yqfnwy (mgr.34427) 6106 : cluster [DBG] pgmap v3476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:34.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:34 gibba013 bash[30381]: audit 2021-03-10T15:48:33.970710+0000 mon.a (mon.0) 2395 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:48:34.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:34 gibba013 bash[30381]: audit 2021-03-10T15:48:33.977439+0000 mon.a (mon.0) 2396 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T15:48:34.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:34 gibba020 bash[25448]: cluster 2021-03-10T15:48:33.438475+0000 mgr.gibba020.yqfnwy (mgr.34427) 6106 : cluster [DBG] pgmap v3476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:34.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:34 gibba020 bash[25448]: audit 2021-03-10T15:48:33.970710+0000 mon.a (mon.0) 2395 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:48:34.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:34 gibba020 bash[25448]: audit 2021-03-10T15:48:33.977439+0000 mon.a (mon.0) 2396 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T15:48:34.738 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:48:34.970 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:48:34.970 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (115m) 9m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:48:34.971 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 8m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:48:34.971 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (115m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:48:34.971 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (115m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:48:34.971 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (114m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:48:34.971 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (114m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:48:34.972 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (114m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:48:34.972 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (114m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:48:34.972 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:48:34.972 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:48:34.973 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (113m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:48:34.973 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (112m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:48:34.973 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (112m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:48:34.973 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (112m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:48:34.973 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (111m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:48:34.974 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (111m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:48:34.974 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (110m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:48:34.974 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (110m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:48:34.974 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 8m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:48:34.974 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 8m ago 118m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:48:35.234 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:48:35.234 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:48:35.234 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:48:35.234 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:48:35.235 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:48:35.235 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:48:35.235 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:48:35.235 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:48:35.235 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:48:35.236 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:48:35.236 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:48:35.236 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:48:35.236 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:48:35.236 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:48:35.237 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:48:35.309 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:35 gibba013 bash[29418]: cephadm 2021-03-10T15:48:33.975788+0000 mgr.gibba020.yqfnwy (mgr.34427) 6107 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:48:35.310 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:35 gibba013 bash[30381]: cephadm 2021-03-10T15:48:33.975788+0000 mgr.gibba020.yqfnwy (mgr.34427) 6107 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:48:35.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:35 gibba020 bash[25448]: cephadm 2021-03-10T15:48:33.975788+0000 mgr.gibba020.yqfnwy (mgr.34427) 6107 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:48:36.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:36 gibba013 bash[29418]: audit 2021-03-10T15:48:34.726098+0000 mgr.gibba020.yqfnwy (mgr.34427) 6108 : audit [DBG] from='client.58141 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:48:36.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:36 gibba013 bash[29418]: audit 2021-03-10T15:48:34.954761+0000 mgr.gibba020.yqfnwy (mgr.34427) 6109 : audit [DBG] from='client.58147 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:48:36.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:36 gibba013 bash[29418]: audit 2021-03-10T15:48:35.232278+0000 mon.c (mon.1) 99 : audit [DBG] from='client.? 172.21.2.113:0/3462214237' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:36.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:36 gibba013 bash[29418]: cluster 2021-03-10T15:48:35.439918+0000 mgr.gibba020.yqfnwy (mgr.34427) 6110 : cluster [DBG] pgmap v3477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:36.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:36 gibba013 bash[30381]: audit 2021-03-10T15:48:34.726098+0000 mgr.gibba020.yqfnwy (mgr.34427) 6108 : audit [DBG] from='client.58141 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:48:36.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:36 gibba013 bash[30381]: audit 2021-03-10T15:48:34.954761+0000 mgr.gibba020.yqfnwy (mgr.34427) 6109 : audit [DBG] from='client.58147 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:48:36.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:36 gibba013 bash[30381]: audit 2021-03-10T15:48:35.232278+0000 mon.c (mon.1) 99 : audit [DBG] from='client.? 172.21.2.113:0/3462214237' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:36.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:36 gibba013 bash[30381]: cluster 2021-03-10T15:48:35.439918+0000 mgr.gibba020.yqfnwy (mgr.34427) 6110 : cluster [DBG] pgmap v3477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:36.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:36 gibba020 bash[25448]: audit 2021-03-10T15:48:34.726098+0000 mgr.gibba020.yqfnwy (mgr.34427) 6108 : audit [DBG] from='client.58141 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:48:36.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:36 gibba020 bash[25448]: audit 2021-03-10T15:48:34.954761+0000 mgr.gibba020.yqfnwy (mgr.34427) 6109 : audit [DBG] from='client.58147 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:48:36.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:36 gibba020 bash[25448]: audit 2021-03-10T15:48:35.232278+0000 mon.c (mon.1) 99 : audit [DBG] from='client.? 172.21.2.113:0/3462214237' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:36.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:36 gibba020 bash[25448]: cluster 2021-03-10T15:48:35.439918+0000 mgr.gibba020.yqfnwy (mgr.34427) 6110 : cluster [DBG] pgmap v3477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:38.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:38 gibba013 bash[29418]: cluster 2021-03-10T15:48:37.441555+0000 mgr.gibba020.yqfnwy (mgr.34427) 6111 : cluster [DBG] pgmap v3478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:38.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:38 gibba013 bash[30381]: cluster 2021-03-10T15:48:37.441555+0000 mgr.gibba020.yqfnwy (mgr.34427) 6111 : cluster [DBG] pgmap v3478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:38.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:38 gibba020 bash[25448]: cluster 2021-03-10T15:48:37.441555+0000 mgr.gibba020.yqfnwy (mgr.34427) 6111 : cluster [DBG] pgmap v3478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:39.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:39 gibba013 bash[29418]: audit 2021-03-10T15:48:38.575368+0000 mon.a (mon.0) 2397 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:48:39.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:39 gibba013 bash[29418]: audit 2021-03-10T15:48:38.754042+0000 mon.a (mon.0) 2398 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:48:39.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:39 gibba013 bash[29418]: audit 2021-03-10T15:48:38.945653+0000 mon.a (mon.0) 2399 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:48:39.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:39 gibba013 bash[29418]: audit 2021-03-10T15:48:38.953902+0000 mon.a (mon.0) 2400 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:48:39.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:39 gibba013 bash[29418]: audit 2021-03-10T15:48:38.955379+0000 mon.a (mon.0) 2401 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:39.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:39 gibba013 bash[29418]: audit 2021-03-10T15:48:38.956466+0000 mon.a (mon.0) 2402 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:39.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:39 gibba013 bash[29418]: audit 2021-03-10T15:48:38.957579+0000 mon.a (mon.0) 2403 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:39.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:39 gibba013 bash[29418]: audit 2021-03-10T15:48:38.959590+0000 mon.a (mon.0) 2404 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:39.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:39 gibba013 bash[29418]: audit 2021-03-10T15:48:38.960690+0000 mon.a (mon.0) 2405 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:39.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:39 gibba013 bash[30381]: audit 2021-03-10T15:48:38.575368+0000 mon.a (mon.0) 2397 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:48:39.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:39 gibba013 bash[30381]: audit 2021-03-10T15:48:38.754042+0000 mon.a (mon.0) 2398 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:48:39.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:39 gibba013 bash[30381]: audit 2021-03-10T15:48:38.945653+0000 mon.a (mon.0) 2399 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:48:39.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:39 gibba013 bash[30381]: audit 2021-03-10T15:48:38.953902+0000 mon.a (mon.0) 2400 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:48:39.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:39 gibba013 bash[30381]: audit 2021-03-10T15:48:38.955379+0000 mon.a (mon.0) 2401 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:39.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:39 gibba013 bash[30381]: audit 2021-03-10T15:48:38.956466+0000 mon.a (mon.0) 2402 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:39.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:39 gibba013 bash[30381]: audit 2021-03-10T15:48:38.957579+0000 mon.a (mon.0) 2403 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:39.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:39 gibba013 bash[30381]: audit 2021-03-10T15:48:38.959590+0000 mon.a (mon.0) 2404 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:39.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:39 gibba013 bash[30381]: audit 2021-03-10T15:48:38.960690+0000 mon.a (mon.0) 2405 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:39.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:39 gibba020 bash[25448]: audit 2021-03-10T15:48:38.575368+0000 mon.a (mon.0) 2397 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:48:39.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:39 gibba020 bash[25448]: audit 2021-03-10T15:48:38.754042+0000 mon.a (mon.0) 2398 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:48:39.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:39 gibba020 bash[25448]: audit 2021-03-10T15:48:38.945653+0000 mon.a (mon.0) 2399 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:48:39.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:39 gibba020 bash[25448]: audit 2021-03-10T15:48:38.953902+0000 mon.a (mon.0) 2400 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:48:39.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:39 gibba020 bash[25448]: audit 2021-03-10T15:48:38.955379+0000 mon.a (mon.0) 2401 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:39.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:39 gibba020 bash[25448]: audit 2021-03-10T15:48:38.956466+0000 mon.a (mon.0) 2402 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:39.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:39 gibba020 bash[25448]: audit 2021-03-10T15:48:38.957579+0000 mon.a (mon.0) 2403 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:39.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:39 gibba020 bash[25448]: audit 2021-03-10T15:48:38.959590+0000 mon.a (mon.0) 2404 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:39.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:39 gibba020 bash[25448]: audit 2021-03-10T15:48:38.960690+0000 mon.a (mon.0) 2405 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:48:40.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:40 gibba013 bash[29418]: cephadm 2021-03-10T15:48:38.754527+0000 mgr.gibba020.yqfnwy (mgr.34427) 6112 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:48:40.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:40 gibba013 bash[29418]: cephadm 2021-03-10T15:48:38.952108+0000 mgr.gibba020.yqfnwy (mgr.34427) 6113 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:48:40.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:40 gibba013 bash[29418]: cephadm 2021-03-10T15:48:38.953901+0000 mgr.gibba020.yqfnwy (mgr.34427) 6114 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:48:40.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:40 gibba013 bash[29418]: cephadm 2021-03-10T15:48:38.954982+0000 mgr.gibba020.yqfnwy (mgr.34427) 6115 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:48:40.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:40 gibba013 bash[29418]: cephadm 2021-03-10T15:48:38.955020+0000 mgr.gibba020.yqfnwy (mgr.34427) 6116 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:48:40.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:40 gibba013 bash[29418]: cephadm 2021-03-10T15:48:38.956184+0000 mgr.gibba020.yqfnwy (mgr.34427) 6117 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:48:40.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:40 gibba013 bash[29418]: cephadm 2021-03-10T15:48:38.956223+0000 mgr.gibba020.yqfnwy (mgr.34427) 6118 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:48:40.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:40 gibba013 bash[29418]: cephadm 2021-03-10T15:48:38.957201+0000 mgr.gibba020.yqfnwy (mgr.34427) 6119 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:48:40.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:40 gibba013 bash[29418]: cephadm 2021-03-10T15:48:38.958060+0000 mgr.gibba020.yqfnwy (mgr.34427) 6120 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:48:40.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:40 gibba013 bash[29418]: cephadm 2021-03-10T15:48:38.958099+0000 mgr.gibba020.yqfnwy (mgr.34427) 6121 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:48:40.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:40 gibba013 bash[29418]: cephadm 2021-03-10T15:48:38.959052+0000 mgr.gibba020.yqfnwy (mgr.34427) 6122 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:48:40.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:40 gibba013 bash[29418]: cephadm 2021-03-10T15:48:38.959375+0000 mgr.gibba020.yqfnwy (mgr.34427) 6123 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:48:40.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:40 gibba013 bash[29418]: cephadm 2021-03-10T15:48:38.960193+0000 mgr.gibba020.yqfnwy (mgr.34427) 6124 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:48:40.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:40 gibba013 bash[29418]: cephadm 2021-03-10T15:48:38.960233+0000 mgr.gibba020.yqfnwy (mgr.34427) 6125 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:48:40.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:40 gibba013 bash[29418]: cephadm 2021-03-10T15:48:38.960340+0000 mgr.gibba020.yqfnwy (mgr.34427) 6126 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:48:40.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:40 gibba013 bash[29418]: cluster 2021-03-10T15:48:39.443237+0000 mgr.gibba020.yqfnwy (mgr.34427) 6127 : cluster [DBG] pgmap v3479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:40.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:40 gibba013 bash[30381]: cephadm 2021-03-10T15:48:38.754527+0000 mgr.gibba020.yqfnwy (mgr.34427) 6112 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:48:40.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:40 gibba013 bash[30381]: cephadm 2021-03-10T15:48:38.952108+0000 mgr.gibba020.yqfnwy (mgr.34427) 6113 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:48:40.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:40 gibba013 bash[30381]: cephadm 2021-03-10T15:48:38.953901+0000 mgr.gibba020.yqfnwy (mgr.34427) 6114 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:48:40.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:40 gibba013 bash[30381]: cephadm 2021-03-10T15:48:38.954982+0000 mgr.gibba020.yqfnwy (mgr.34427) 6115 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:48:40.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:40 gibba013 bash[30381]: cephadm 2021-03-10T15:48:38.955020+0000 mgr.gibba020.yqfnwy (mgr.34427) 6116 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:48:40.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:40 gibba013 bash[30381]: cephadm 2021-03-10T15:48:38.956184+0000 mgr.gibba020.yqfnwy (mgr.34427) 6117 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:48:40.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:40 gibba013 bash[30381]: cephadm 2021-03-10T15:48:38.956223+0000 mgr.gibba020.yqfnwy (mgr.34427) 6118 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:48:40.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:40 gibba013 bash[30381]: cephadm 2021-03-10T15:48:38.957201+0000 mgr.gibba020.yqfnwy (mgr.34427) 6119 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:48:40.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:40 gibba013 bash[30381]: cephadm 2021-03-10T15:48:38.958060+0000 mgr.gibba020.yqfnwy (mgr.34427) 6120 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:48:40.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:40 gibba013 bash[30381]: cephadm 2021-03-10T15:48:38.958099+0000 mgr.gibba020.yqfnwy (mgr.34427) 6121 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:48:40.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:40 gibba013 bash[30381]: cephadm 2021-03-10T15:48:38.959052+0000 mgr.gibba020.yqfnwy (mgr.34427) 6122 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:48:40.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:40 gibba013 bash[30381]: cephadm 2021-03-10T15:48:38.959375+0000 mgr.gibba020.yqfnwy (mgr.34427) 6123 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:48:40.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:40 gibba013 bash[30381]: cephadm 2021-03-10T15:48:38.960193+0000 mgr.gibba020.yqfnwy (mgr.34427) 6124 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:48:40.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:40 gibba013 bash[30381]: cephadm 2021-03-10T15:48:38.960233+0000 mgr.gibba020.yqfnwy (mgr.34427) 6125 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:48:40.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:40 gibba013 bash[30381]: cephadm 2021-03-10T15:48:38.960340+0000 mgr.gibba020.yqfnwy (mgr.34427) 6126 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:48:40.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:40 gibba013 bash[30381]: cluster 2021-03-10T15:48:39.443237+0000 mgr.gibba020.yqfnwy (mgr.34427) 6127 : cluster [DBG] pgmap v3479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:40.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:40 gibba020 bash[25448]: cephadm 2021-03-10T15:48:38.754527+0000 mgr.gibba020.yqfnwy (mgr.34427) 6112 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:48:40.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:40 gibba020 bash[25448]: cephadm 2021-03-10T15:48:38.952108+0000 mgr.gibba020.yqfnwy (mgr.34427) 6113 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:48:40.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:40 gibba020 bash[25448]: cephadm 2021-03-10T15:48:38.953901+0000 mgr.gibba020.yqfnwy (mgr.34427) 6114 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:48:40.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:40 gibba020 bash[25448]: cephadm 2021-03-10T15:48:38.954982+0000 mgr.gibba020.yqfnwy (mgr.34427) 6115 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:48:40.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:40 gibba020 bash[25448]: cephadm 2021-03-10T15:48:38.955020+0000 mgr.gibba020.yqfnwy (mgr.34427) 6116 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:48:40.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:40 gibba020 bash[25448]: cephadm 2021-03-10T15:48:38.956184+0000 mgr.gibba020.yqfnwy (mgr.34427) 6117 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:48:40.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:40 gibba020 bash[25448]: cephadm 2021-03-10T15:48:38.956223+0000 mgr.gibba020.yqfnwy (mgr.34427) 6118 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:48:40.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:40 gibba020 bash[25448]: cephadm 2021-03-10T15:48:38.957201+0000 mgr.gibba020.yqfnwy (mgr.34427) 6119 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:48:40.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:40 gibba020 bash[25448]: cephadm 2021-03-10T15:48:38.958060+0000 mgr.gibba020.yqfnwy (mgr.34427) 6120 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:48:40.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:40 gibba020 bash[25448]: cephadm 2021-03-10T15:48:38.958099+0000 mgr.gibba020.yqfnwy (mgr.34427) 6121 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:48:40.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:40 gibba020 bash[25448]: cephadm 2021-03-10T15:48:38.959052+0000 mgr.gibba020.yqfnwy (mgr.34427) 6122 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:48:40.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:40 gibba020 bash[25448]: cephadm 2021-03-10T15:48:38.959375+0000 mgr.gibba020.yqfnwy (mgr.34427) 6123 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:48:40.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:40 gibba020 bash[25448]: cephadm 2021-03-10T15:48:38.960193+0000 mgr.gibba020.yqfnwy (mgr.34427) 6124 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:48:40.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:40 gibba020 bash[25448]: cephadm 2021-03-10T15:48:38.960233+0000 mgr.gibba020.yqfnwy (mgr.34427) 6125 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:48:40.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:40 gibba020 bash[25448]: cephadm 2021-03-10T15:48:38.960340+0000 mgr.gibba020.yqfnwy (mgr.34427) 6126 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:48:40.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:40 gibba020 bash[25448]: cluster 2021-03-10T15:48:39.443237+0000 mgr.gibba020.yqfnwy (mgr.34427) 6127 : cluster [DBG] pgmap v3479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:42.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:42 gibba013 bash[29418]: cluster 2021-03-10T15:48:41.445410+0000 mgr.gibba020.yqfnwy (mgr.34427) 6128 : cluster [DBG] pgmap v3480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:42.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:42 gibba013 bash[30381]: cluster 2021-03-10T15:48:41.445410+0000 mgr.gibba020.yqfnwy (mgr.34427) 6128 : cluster [DBG] pgmap v3480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:42.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:42 gibba020 bash[25448]: cluster 2021-03-10T15:48:41.445410+0000 mgr.gibba020.yqfnwy (mgr.34427) 6128 : cluster [DBG] pgmap v3480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:44.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:44 gibba013 bash[29418]: cluster 2021-03-10T15:48:43.447071+0000 mgr.gibba020.yqfnwy (mgr.34427) 6129 : cluster [DBG] pgmap v3481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:44.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:44 gibba013 bash[30381]: cluster 2021-03-10T15:48:43.447071+0000 mgr.gibba020.yqfnwy (mgr.34427) 6129 : cluster [DBG] pgmap v3481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:44.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:44 gibba020 bash[25448]: cluster 2021-03-10T15:48:43.447071+0000 mgr.gibba020.yqfnwy (mgr.34427) 6129 : cluster [DBG] pgmap v3481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:46.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:46 gibba013 bash[29418]: cluster 2021-03-10T15:48:45.448980+0000 mgr.gibba020.yqfnwy (mgr.34427) 6130 : cluster [DBG] pgmap v3482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:46.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:46 gibba013 bash[30381]: cluster 2021-03-10T15:48:45.448980+0000 mgr.gibba020.yqfnwy (mgr.34427) 6130 : cluster [DBG] pgmap v3482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:46.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:46 gibba020 bash[25448]: cluster 2021-03-10T15:48:45.448980+0000 mgr.gibba020.yqfnwy (mgr.34427) 6130 : cluster [DBG] pgmap v3482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:48.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:48 gibba013 bash[29418]: cluster 2021-03-10T15:48:47.450663+0000 mgr.gibba020.yqfnwy (mgr.34427) 6131 : cluster [DBG] pgmap v3483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:48.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:48 gibba013 bash[30381]: cluster 2021-03-10T15:48:47.450663+0000 mgr.gibba020.yqfnwy (mgr.34427) 6131 : cluster [DBG] pgmap v3483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:48.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:48 gibba020 bash[25448]: cluster 2021-03-10T15:48:47.450663+0000 mgr.gibba020.yqfnwy (mgr.34427) 6131 : cluster [DBG] pgmap v3483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:50.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:50 gibba013 bash[30381]: cluster 2021-03-10T15:48:49.452391+0000 mgr.gibba020.yqfnwy (mgr.34427) 6132 : cluster [DBG] pgmap v3484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:50.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:50 gibba013 bash[29418]: cluster 2021-03-10T15:48:49.452391+0000 mgr.gibba020.yqfnwy (mgr.34427) 6132 : cluster [DBG] pgmap v3484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:50.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:50 gibba020 bash[25448]: cluster 2021-03-10T15:48:49.452391+0000 mgr.gibba020.yqfnwy (mgr.34427) 6132 : cluster [DBG] pgmap v3484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:52.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:52 gibba013 bash[29418]: cluster 2021-03-10T15:48:51.454348+0000 mgr.gibba020.yqfnwy (mgr.34427) 6133 : cluster [DBG] pgmap v3485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:52.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:52 gibba013 bash[30381]: cluster 2021-03-10T15:48:51.454348+0000 mgr.gibba020.yqfnwy (mgr.34427) 6133 : cluster [DBG] pgmap v3485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:52.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:52 gibba020 bash[25448]: cluster 2021-03-10T15:48:51.454348+0000 mgr.gibba020.yqfnwy (mgr.34427) 6133 : cluster [DBG] pgmap v3485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:54.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:54 gibba013 bash[29418]: cluster 2021-03-10T15:48:53.456081+0000 mgr.gibba020.yqfnwy (mgr.34427) 6134 : cluster [DBG] pgmap v3486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:54.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:54 gibba013 bash[30381]: cluster 2021-03-10T15:48:53.456081+0000 mgr.gibba020.yqfnwy (mgr.34427) 6134 : cluster [DBG] pgmap v3486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:54.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:54 gibba020 bash[25448]: cluster 2021-03-10T15:48:53.456081+0000 mgr.gibba020.yqfnwy (mgr.34427) 6134 : cluster [DBG] pgmap v3486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:55.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:55 gibba013 bash[29418]: cephadm 2021-03-10T15:48:53.972768+0000 mgr.gibba020.yqfnwy (mgr.34427) 6135 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:48:55.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:55 gibba013 bash[30381]: cephadm 2021-03-10T15:48:53.972768+0000 mgr.gibba020.yqfnwy (mgr.34427) 6135 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:48:55.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:55 gibba020 bash[25448]: cephadm 2021-03-10T15:48:53.972768+0000 mgr.gibba020.yqfnwy (mgr.34427) 6135 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:48:56.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:56 gibba013 bash[29418]: cluster 2021-03-10T15:48:55.457529+0000 mgr.gibba020.yqfnwy (mgr.34427) 6136 : cluster [DBG] pgmap v3487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:56.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:56 gibba013 bash[30381]: cluster 2021-03-10T15:48:55.457529+0000 mgr.gibba020.yqfnwy (mgr.34427) 6136 : cluster [DBG] pgmap v3487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:56.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:56 gibba020 bash[25448]: cluster 2021-03-10T15:48:55.457529+0000 mgr.gibba020.yqfnwy (mgr.34427) 6136 : cluster [DBG] pgmap v3487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:58.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:48:58 gibba013 bash[29418]: cluster 2021-03-10T15:48:57.459213+0000 mgr.gibba020.yqfnwy (mgr.34427) 6137 : cluster [DBG] pgmap v3488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:58.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:48:58 gibba013 bash[30381]: cluster 2021-03-10T15:48:57.459213+0000 mgr.gibba020.yqfnwy (mgr.34427) 6137 : cluster [DBG] pgmap v3488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:48:58.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:48:58 gibba020 bash[25448]: cluster 2021-03-10T15:48:57.459213+0000 mgr.gibba020.yqfnwy (mgr.34427) 6137 : cluster [DBG] pgmap v3488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:00.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:00 gibba013 bash[29418]: cluster 2021-03-10T15:48:59.460792+0000 mgr.gibba020.yqfnwy (mgr.34427) 6138 : cluster [DBG] pgmap v3489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:00.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:00 gibba013 bash[30381]: cluster 2021-03-10T15:48:59.460792+0000 mgr.gibba020.yqfnwy (mgr.34427) 6138 : cluster [DBG] pgmap v3489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:00.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:00 gibba020 bash[25448]: cluster 2021-03-10T15:48:59.460792+0000 mgr.gibba020.yqfnwy (mgr.34427) 6138 : cluster [DBG] pgmap v3489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:02.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:02 gibba013 bash[29418]: cluster 2021-03-10T15:49:01.462767+0000 mgr.gibba020.yqfnwy (mgr.34427) 6139 : cluster [DBG] pgmap v3490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:02.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:02 gibba013 bash[30381]: cluster 2021-03-10T15:49:01.462767+0000 mgr.gibba020.yqfnwy (mgr.34427) 6139 : cluster [DBG] pgmap v3490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:02.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:02 gibba020 bash[25448]: cluster 2021-03-10T15:49:01.462767+0000 mgr.gibba020.yqfnwy (mgr.34427) 6139 : cluster [DBG] pgmap v3490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:04.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:04 gibba013 bash[29418]: cluster 2021-03-10T15:49:03.464390+0000 mgr.gibba020.yqfnwy (mgr.34427) 6140 : cluster [DBG] pgmap v3491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:04.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:04 gibba013 bash[30381]: cluster 2021-03-10T15:49:03.464390+0000 mgr.gibba020.yqfnwy (mgr.34427) 6140 : cluster [DBG] pgmap v3491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:04.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:04 gibba020 bash[25448]: cluster 2021-03-10T15:49:03.464390+0000 mgr.gibba020.yqfnwy (mgr.34427) 6140 : cluster [DBG] pgmap v3491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:05.480 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:49:05.741 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:49:05.742 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (115m) 9m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:49:05.742 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 8m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:49:05.742 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (116m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:49:05.742 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (116m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:49:05.743 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (115m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:49:05.743 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (115m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:49:05.743 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (114m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:49:05.743 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (114m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:49:05.743 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:49:05.744 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:49:05.744 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (113m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:49:05.744 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (113m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:49:05.744 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (113m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:49:05.744 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (112m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:49:05.745 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (112m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:49:05.745 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (111m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:49:05.745 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (111m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:49:05.745 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (110m) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:49:05.745 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 8m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:49:05.746 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 8m ago 119m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:49:05.991 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:49:05.992 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:49:05.992 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:49:05.992 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:49:05.992 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:49:05.992 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:49:05.993 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:49:05.993 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:49:05.993 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:49:05.993 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:49:05.993 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:49:05.994 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:49:05.994 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:49:05.994 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:49:05.994 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:49:06.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:06 gibba013 bash[29418]: cluster 2021-03-10T15:49:05.466069+0000 mgr.gibba020.yqfnwy (mgr.34427) 6141 : cluster [DBG] pgmap v3492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:06 gibba013 bash[29418]: audit 2021-03-10T15:49:05.468103+0000 mgr.gibba020.yqfnwy (mgr.34427) 6142 : audit [DBG] from='client.48174 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:49:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:06 gibba013 bash[29418]: audit 2021-03-10T15:49:05.698283+0000 mgr.gibba020.yqfnwy (mgr.34427) 6143 : audit [DBG] from='client.58165 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:49:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:06 gibba013 bash[29418]: audit 2021-03-10T15:49:05.989897+0000 mon.a (mon.0) 2406 : audit [DBG] from='client.? 172.21.2.113:0/1274394606' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:06.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:06 gibba013 bash[30381]: cluster 2021-03-10T15:49:05.466069+0000 mgr.gibba020.yqfnwy (mgr.34427) 6141 : cluster [DBG] pgmap v3492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:06.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:06 gibba013 bash[30381]: audit 2021-03-10T15:49:05.468103+0000 mgr.gibba020.yqfnwy (mgr.34427) 6142 : audit [DBG] from='client.48174 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:49:06.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:06 gibba013 bash[30381]: audit 2021-03-10T15:49:05.698283+0000 mgr.gibba020.yqfnwy (mgr.34427) 6143 : audit [DBG] from='client.58165 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:49:06.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:06 gibba013 bash[30381]: audit 2021-03-10T15:49:05.989897+0000 mon.a (mon.0) 2406 : audit [DBG] from='client.? 172.21.2.113:0/1274394606' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:06.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:06 gibba020 bash[25448]: cluster 2021-03-10T15:49:05.466069+0000 mgr.gibba020.yqfnwy (mgr.34427) 6141 : cluster [DBG] pgmap v3492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:06.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:06 gibba020 bash[25448]: audit 2021-03-10T15:49:05.468103+0000 mgr.gibba020.yqfnwy (mgr.34427) 6142 : audit [DBG] from='client.48174 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:49:06.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:06 gibba020 bash[25448]: audit 2021-03-10T15:49:05.698283+0000 mgr.gibba020.yqfnwy (mgr.34427) 6143 : audit [DBG] from='client.58165 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:49:06.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:06 gibba020 bash[25448]: audit 2021-03-10T15:49:05.989897+0000 mon.a (mon.0) 2406 : audit [DBG] from='client.? 172.21.2.113:0/1274394606' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:07.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:07 gibba013 bash[29418]: audit 2021-03-10T15:49:06.557210+0000 mon.a (mon.0) 2407 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:49:07.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:07 gibba013 bash[29418]: audit 2021-03-10T15:49:06.640479+0000 mon.a (mon.0) 2408 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:49:07.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:07 gibba013 bash[29418]: audit 2021-03-10T15:49:06.775685+0000 mon.a (mon.0) 2409 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:49:07.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:07 gibba013 bash[29418]: audit 2021-03-10T15:49:06.776522+0000 mon.a (mon.0) 2410 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:49:07.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:07 gibba013 bash[29418]: audit 2021-03-10T15:49:06.777309+0000 mon.a (mon.0) 2411 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:49:07.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:07 gibba013 bash[29418]: audit 2021-03-10T15:49:06.778129+0000 mon.a (mon.0) 2412 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:49:07.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:07 gibba013 bash[30381]: audit 2021-03-10T15:49:06.557210+0000 mon.a (mon.0) 2407 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:49:07.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:07 gibba013 bash[30381]: audit 2021-03-10T15:49:06.640479+0000 mon.a (mon.0) 2408 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:49:07.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:07 gibba013 bash[30381]: audit 2021-03-10T15:49:06.775685+0000 mon.a (mon.0) 2409 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:49:07.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:07 gibba013 bash[30381]: audit 2021-03-10T15:49:06.776522+0000 mon.a (mon.0) 2410 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:49:07.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:07 gibba013 bash[30381]: audit 2021-03-10T15:49:06.777309+0000 mon.a (mon.0) 2411 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:49:07.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:07 gibba013 bash[30381]: audit 2021-03-10T15:49:06.778129+0000 mon.a (mon.0) 2412 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:49:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:07 gibba020 bash[25448]: audit 2021-03-10T15:49:06.557210+0000 mon.a (mon.0) 2407 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:49:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:07 gibba020 bash[25448]: audit 2021-03-10T15:49:06.640479+0000 mon.a (mon.0) 2408 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:49:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:07 gibba020 bash[25448]: audit 2021-03-10T15:49:06.775685+0000 mon.a (mon.0) 2409 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T15:49:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:07 gibba020 bash[25448]: audit 2021-03-10T15:49:06.776522+0000 mon.a (mon.0) 2410 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:49:07.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:07 gibba020 bash[25448]: audit 2021-03-10T15:49:06.777309+0000 mon.a (mon.0) 2411 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T15:49:07.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:07 gibba020 bash[25448]: audit 2021-03-10T15:49:06.778129+0000 mon.a (mon.0) 2412 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:49:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:08 gibba013 bash[29418]: cluster 2021-03-10T15:49:07.467694+0000 mgr.gibba020.yqfnwy (mgr.34427) 6144 : cluster [DBG] pgmap v3493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:08.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:08 gibba013 bash[30381]: cluster 2021-03-10T15:49:07.467694+0000 mgr.gibba020.yqfnwy (mgr.34427) 6144 : cluster [DBG] pgmap v3493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:08.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:08 gibba020 bash[25448]: cluster 2021-03-10T15:49:07.467694+0000 mgr.gibba020.yqfnwy (mgr.34427) 6144 : cluster [DBG] pgmap v3493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:10.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:10 gibba013 bash[29418]: cephadm 2021-03-10T15:49:08.988679+0000 mgr.gibba020.yqfnwy (mgr.34427) 6145 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:49:10.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:10 gibba013 bash[29418]: cluster 2021-03-10T15:49:09.469127+0000 mgr.gibba020.yqfnwy (mgr.34427) 6146 : cluster [DBG] pgmap v3494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:10.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:10 gibba013 bash[30381]: cephadm 2021-03-10T15:49:08.988679+0000 mgr.gibba020.yqfnwy (mgr.34427) 6145 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:49:10.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:10 gibba013 bash[30381]: cluster 2021-03-10T15:49:09.469127+0000 mgr.gibba020.yqfnwy (mgr.34427) 6146 : cluster [DBG] pgmap v3494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:10.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:10 gibba020 bash[25448]: cephadm 2021-03-10T15:49:08.988679+0000 mgr.gibba020.yqfnwy (mgr.34427) 6145 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:49:10.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:10 gibba020 bash[25448]: cluster 2021-03-10T15:49:09.469127+0000 mgr.gibba020.yqfnwy (mgr.34427) 6146 : cluster [DBG] pgmap v3494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:12.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:12 gibba013 bash[29418]: cluster 2021-03-10T15:49:11.470913+0000 mgr.gibba020.yqfnwy (mgr.34427) 6147 : cluster [DBG] pgmap v3495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:12.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:12 gibba013 bash[30381]: cluster 2021-03-10T15:49:11.470913+0000 mgr.gibba020.yqfnwy (mgr.34427) 6147 : cluster [DBG] pgmap v3495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:12.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:12 gibba020 bash[25448]: cluster 2021-03-10T15:49:11.470913+0000 mgr.gibba020.yqfnwy (mgr.34427) 6147 : cluster [DBG] pgmap v3495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:14.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:14 gibba013 bash[29418]: cluster 2021-03-10T15:49:13.472337+0000 mgr.gibba020.yqfnwy (mgr.34427) 6148 : cluster [DBG] pgmap v3496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:14.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:14 gibba013 bash[30381]: cluster 2021-03-10T15:49:13.472337+0000 mgr.gibba020.yqfnwy (mgr.34427) 6148 : cluster [DBG] pgmap v3496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:14.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:14 gibba020 bash[25448]: cluster 2021-03-10T15:49:13.472337+0000 mgr.gibba020.yqfnwy (mgr.34427) 6148 : cluster [DBG] pgmap v3496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:16.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:16 gibba013 bash[29418]: cluster 2021-03-10T15:49:15.474042+0000 mgr.gibba020.yqfnwy (mgr.34427) 6149 : cluster [DBG] pgmap v3497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:16.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:16 gibba013 bash[30381]: cluster 2021-03-10T15:49:15.474042+0000 mgr.gibba020.yqfnwy (mgr.34427) 6149 : cluster [DBG] pgmap v3497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:16.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:16 gibba020 bash[25448]: cluster 2021-03-10T15:49:15.474042+0000 mgr.gibba020.yqfnwy (mgr.34427) 6149 : cluster [DBG] pgmap v3497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:18.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:18 gibba013 bash[29418]: cluster 2021-03-10T15:49:17.475438+0000 mgr.gibba020.yqfnwy (mgr.34427) 6150 : cluster [DBG] pgmap v3498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:18.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:18 gibba013 bash[30381]: cluster 2021-03-10T15:49:17.475438+0000 mgr.gibba020.yqfnwy (mgr.34427) 6150 : cluster [DBG] pgmap v3498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:18.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:18 gibba020 bash[25448]: cluster 2021-03-10T15:49:17.475438+0000 mgr.gibba020.yqfnwy (mgr.34427) 6150 : cluster [DBG] pgmap v3498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:20.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:20 gibba013 bash[29418]: cluster 2021-03-10T15:49:19.477008+0000 mgr.gibba020.yqfnwy (mgr.34427) 6151 : cluster [DBG] pgmap v3499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:20.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:20 gibba013 bash[30381]: cluster 2021-03-10T15:49:19.477008+0000 mgr.gibba020.yqfnwy (mgr.34427) 6151 : cluster [DBG] pgmap v3499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:20.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:20 gibba020 bash[25448]: cluster 2021-03-10T15:49:19.477008+0000 mgr.gibba020.yqfnwy (mgr.34427) 6151 : cluster [DBG] pgmap v3499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:22.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:22 gibba013 bash[29418]: cluster 2021-03-10T15:49:21.478773+0000 mgr.gibba020.yqfnwy (mgr.34427) 6152 : cluster [DBG] pgmap v3500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:22.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:22 gibba013 bash[30381]: cluster 2021-03-10T15:49:21.478773+0000 mgr.gibba020.yqfnwy (mgr.34427) 6152 : cluster [DBG] pgmap v3500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:22.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:22 gibba020 bash[25448]: cluster 2021-03-10T15:49:21.478773+0000 mgr.gibba020.yqfnwy (mgr.34427) 6152 : cluster [DBG] pgmap v3500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:24.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:24 gibba013 bash[29418]: cluster 2021-03-10T15:49:23.480193+0000 mgr.gibba020.yqfnwy (mgr.34427) 6153 : cluster [DBG] pgmap v3501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:24.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:24 gibba013 bash[30381]: cluster 2021-03-10T15:49:23.480193+0000 mgr.gibba020.yqfnwy (mgr.34427) 6153 : cluster [DBG] pgmap v3501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:24.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:24 gibba020 bash[25448]: cluster 2021-03-10T15:49:23.480193+0000 mgr.gibba020.yqfnwy (mgr.34427) 6153 : cluster [DBG] pgmap v3501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:25.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:25 gibba013 bash[29418]: cephadm 2021-03-10T15:49:24.004717+0000 mgr.gibba020.yqfnwy (mgr.34427) 6154 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:49:25.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:25 gibba013 bash[30381]: cephadm 2021-03-10T15:49:24.004717+0000 mgr.gibba020.yqfnwy (mgr.34427) 6154 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:49:25.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:25 gibba020 bash[25448]: cephadm 2021-03-10T15:49:24.004717+0000 mgr.gibba020.yqfnwy (mgr.34427) 6154 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:49:26.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:26 gibba013 bash[29418]: cluster 2021-03-10T15:49:25.481737+0000 mgr.gibba020.yqfnwy (mgr.34427) 6155 : cluster [DBG] pgmap v3502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:26.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:26 gibba013 bash[30381]: cluster 2021-03-10T15:49:25.481737+0000 mgr.gibba020.yqfnwy (mgr.34427) 6155 : cluster [DBG] pgmap v3502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:26.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:26 gibba020 bash[25448]: cluster 2021-03-10T15:49:25.481737+0000 mgr.gibba020.yqfnwy (mgr.34427) 6155 : cluster [DBG] pgmap v3502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:28.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:28 gibba013 bash[29418]: cluster 2021-03-10T15:49:27.483134+0000 mgr.gibba020.yqfnwy (mgr.34427) 6156 : cluster [DBG] pgmap v3503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:28.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:28 gibba013 bash[30381]: cluster 2021-03-10T15:49:27.483134+0000 mgr.gibba020.yqfnwy (mgr.34427) 6156 : cluster [DBG] pgmap v3503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:28.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:28 gibba020 bash[25448]: cluster 2021-03-10T15:49:27.483134+0000 mgr.gibba020.yqfnwy (mgr.34427) 6156 : cluster [DBG] pgmap v3503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:30.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:30 gibba013 bash[29418]: cluster 2021-03-10T15:49:29.484616+0000 mgr.gibba020.yqfnwy (mgr.34427) 6157 : cluster [DBG] pgmap v3504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:30.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:30 gibba013 bash[30381]: cluster 2021-03-10T15:49:29.484616+0000 mgr.gibba020.yqfnwy (mgr.34427) 6157 : cluster [DBG] pgmap v3504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:30.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:30 gibba020 bash[25448]: cluster 2021-03-10T15:49:29.484616+0000 mgr.gibba020.yqfnwy (mgr.34427) 6157 : cluster [DBG] pgmap v3504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:32.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:32 gibba013 bash[29418]: cluster 2021-03-10T15:49:31.486454+0000 mgr.gibba020.yqfnwy (mgr.34427) 6158 : cluster [DBG] pgmap v3505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:32.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:32 gibba013 bash[30381]: cluster 2021-03-10T15:49:31.486454+0000 mgr.gibba020.yqfnwy (mgr.34427) 6158 : cluster [DBG] pgmap v3505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:32.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:32 gibba020 bash[25448]: cluster 2021-03-10T15:49:31.486454+0000 mgr.gibba020.yqfnwy (mgr.34427) 6158 : cluster [DBG] pgmap v3505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:34.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:34 gibba013 bash[29418]: cluster 2021-03-10T15:49:33.487851+0000 mgr.gibba020.yqfnwy (mgr.34427) 6159 : cluster [DBG] pgmap v3506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:34.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:34 gibba013 bash[30381]: cluster 2021-03-10T15:49:33.487851+0000 mgr.gibba020.yqfnwy (mgr.34427) 6159 : cluster [DBG] pgmap v3506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:34.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:34 gibba020 bash[25448]: cluster 2021-03-10T15:49:33.487851+0000 mgr.gibba020.yqfnwy (mgr.34427) 6159 : cluster [DBG] pgmap v3506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:36.235 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:49:36.464 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:49:36.464 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (116m) 10m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:49:36.465 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 9m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:49:36.465 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (116m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:49:36.465 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (116m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:49:36.465 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (115m) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:49:36.466 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (115m) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:49:36.466 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (115m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:49:36.466 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (115m) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:49:36.466 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 10m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:49:36.467 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:49:36.467 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (114m) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:49:36.467 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (113m) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:49:36.467 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (113m) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:49:36.467 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (113m) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:49:36.468 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (112m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:49:36.468 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (112m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:49:36.468 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (111m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:49:36.468 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (111m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:49:36.468 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 9m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:49:36.469 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 9m ago 119m docker.io/ceph/ceph:v15.2.0 2021-03-10T15:49:36.721 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:49:36.722 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:49:36.722 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:49:36.722 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:49:36.722 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:49:36.723 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:49:36.723 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:49:36.723 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:49:36.723 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:49:36.724 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:49:36.724 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:49:36.724 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:49:36.724 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:49:36.724 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:49:36.725 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:49:36.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:36 gibba013 bash[29418]: cluster 2021-03-10T15:49:35.489608+0000 mgr.gibba020.yqfnwy (mgr.34427) 6160 : cluster [DBG] pgmap v3507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:36.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:36 gibba013 bash[30381]: cluster 2021-03-10T15:49:35.489608+0000 mgr.gibba020.yqfnwy (mgr.34427) 6160 : cluster [DBG] pgmap v3507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:36.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:36 gibba020 bash[25448]: cluster 2021-03-10T15:49:35.489608+0000 mgr.gibba020.yqfnwy (mgr.34427) 6160 : cluster [DBG] pgmap v3507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:37.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:37 gibba013 bash[29418]: audit 2021-03-10T15:49:36.222980+0000 mgr.gibba020.yqfnwy (mgr.34427) 6161 : audit [DBG] from='client.58177 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:49:37.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:37 gibba013 bash[29418]: audit 2021-03-10T15:49:36.448362+0000 mgr.gibba020.yqfnwy (mgr.34427) 6162 : audit [DBG] from='client.58183 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:49:37.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:37 gibba013 bash[29418]: audit 2021-03-10T15:49:36.719970+0000 mon.c (mon.1) 100 : audit [DBG] from='client.? 172.21.2.113:0/2917736844' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:37.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:37 gibba013 bash[30381]: audit 2021-03-10T15:49:36.222980+0000 mgr.gibba020.yqfnwy (mgr.34427) 6161 : audit [DBG] from='client.58177 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:49:37.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:37 gibba013 bash[30381]: audit 2021-03-10T15:49:36.448362+0000 mgr.gibba020.yqfnwy (mgr.34427) 6162 : audit [DBG] from='client.58183 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:49:37.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:37 gibba013 bash[30381]: audit 2021-03-10T15:49:36.719970+0000 mon.c (mon.1) 100 : audit [DBG] from='client.? 172.21.2.113:0/2917736844' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:37.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:37 gibba020 bash[25448]: audit 2021-03-10T15:49:36.222980+0000 mgr.gibba020.yqfnwy (mgr.34427) 6161 : audit [DBG] from='client.58177 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:49:37.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:37 gibba020 bash[25448]: audit 2021-03-10T15:49:36.448362+0000 mgr.gibba020.yqfnwy (mgr.34427) 6162 : audit [DBG] from='client.58183 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:49:37.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:37 gibba020 bash[25448]: audit 2021-03-10T15:49:36.719970+0000 mon.c (mon.1) 100 : audit [DBG] from='client.? 172.21.2.113:0/2917736844' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:38.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:38 gibba013 bash[29418]: cluster 2021-03-10T15:49:37.491013+0000 mgr.gibba020.yqfnwy (mgr.34427) 6163 : cluster [DBG] pgmap v3508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:38.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:38 gibba013 bash[30381]: cluster 2021-03-10T15:49:37.491013+0000 mgr.gibba020.yqfnwy (mgr.34427) 6163 : cluster [DBG] pgmap v3508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:38.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:38 gibba020 bash[25448]: cluster 2021-03-10T15:49:37.491013+0000 mgr.gibba020.yqfnwy (mgr.34427) 6163 : cluster [DBG] pgmap v3508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:39.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:39 gibba013 bash[29418]: audit 2021-03-10T15:49:39.022870+0000 mon.a (mon.0) 2413 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:49:39.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:39 gibba013 bash[29418]: audit 2021-03-10T15:49:39.029889+0000 mon.a (mon.0) 2414 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:49:39.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:39 gibba013 bash[30381]: audit 2021-03-10T15:49:39.022870+0000 mon.a (mon.0) 2413 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:49:39.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:39 gibba013 bash[30381]: audit 2021-03-10T15:49:39.029889+0000 mon.a (mon.0) 2414 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:49:39.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:39 gibba020 bash[25448]: audit 2021-03-10T15:49:39.022870+0000 mon.a (mon.0) 2413 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:49:39.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:39 gibba020 bash[25448]: audit 2021-03-10T15:49:39.029889+0000 mon.a (mon.0) 2414 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:49:40.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:40 gibba013 bash[29418]: cephadm 2021-03-10T15:49:39.028238+0000 mgr.gibba020.yqfnwy (mgr.34427) 6164 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:49:40.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:40 gibba013 bash[29418]: cluster 2021-03-10T15:49:39.492447+0000 mgr.gibba020.yqfnwy (mgr.34427) 6165 : cluster [DBG] pgmap v3509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:40.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:40 gibba013 bash[30381]: cephadm 2021-03-10T15:49:39.028238+0000 mgr.gibba020.yqfnwy (mgr.34427) 6164 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:49:40.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:40 gibba013 bash[30381]: cluster 2021-03-10T15:49:39.492447+0000 mgr.gibba020.yqfnwy (mgr.34427) 6165 : cluster [DBG] pgmap v3509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:40.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:40 gibba020 bash[25448]: cephadm 2021-03-10T15:49:39.028238+0000 mgr.gibba020.yqfnwy (mgr.34427) 6164 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:49:40.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:40 gibba020 bash[25448]: cluster 2021-03-10T15:49:39.492447+0000 mgr.gibba020.yqfnwy (mgr.34427) 6165 : cluster [DBG] pgmap v3509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:42.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:42 gibba013 bash[29418]: cluster 2021-03-10T15:49:41.494018+0000 mgr.gibba020.yqfnwy (mgr.34427) 6166 : cluster [DBG] pgmap v3510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:42.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:42 gibba013 bash[29418]: audit 2021-03-10T15:49:42.524562+0000 mon.a (mon.0) 2415 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:49:42.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:42 gibba013 bash[30381]: cluster 2021-03-10T15:49:41.494018+0000 mgr.gibba020.yqfnwy (mgr.34427) 6166 : cluster [DBG] pgmap v3510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:42.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:42 gibba013 bash[30381]: audit 2021-03-10T15:49:42.524562+0000 mon.a (mon.0) 2415 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:49:42.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:42 gibba020 bash[25448]: cluster 2021-03-10T15:49:41.494018+0000 mgr.gibba020.yqfnwy (mgr.34427) 6166 : cluster [DBG] pgmap v3510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:42.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:42 gibba020 bash[25448]: audit 2021-03-10T15:49:42.524562+0000 mon.a (mon.0) 2415 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:49:44.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:43 gibba013 bash[29418]: cephadm 2021-03-10T15:49:42.523979+0000 mgr.gibba020.yqfnwy (mgr.34427) 6167 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:49:44.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:43 gibba013 bash[29418]: audit 2021-03-10T15:49:42.722290+0000 mon.a (mon.0) 2416 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:49:44.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:43 gibba013 bash[29418]: cephadm 2021-03-10T15:49:42.727750+0000 mgr.gibba020.yqfnwy (mgr.34427) 6168 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:49:44.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:43 gibba013 bash[29418]: cephadm 2021-03-10T15:49:42.729744+0000 mgr.gibba020.yqfnwy (mgr.34427) 6169 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:49:44.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:43 gibba013 bash[29418]: audit 2021-03-10T15:49:42.729907+0000 mon.a (mon.0) 2417 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:49:44.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:43 gibba013 bash[29418]: cephadm 2021-03-10T15:49:42.731247+0000 mgr.gibba020.yqfnwy (mgr.34427) 6170 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:49:44.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:43 gibba013 bash[29418]: audit 2021-03-10T15:49:42.731260+0000 mon.a (mon.0) 2418 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:44.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:43 gibba013 bash[29418]: cephadm 2021-03-10T15:49:42.731287+0000 mgr.gibba020.yqfnwy (mgr.34427) 6171 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:49:44.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:43 gibba013 bash[29418]: cephadm 2021-03-10T15:49:42.732783+0000 mgr.gibba020.yqfnwy (mgr.34427) 6172 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:49:44.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:43 gibba013 bash[29418]: cephadm 2021-03-10T15:49:42.732823+0000 mgr.gibba020.yqfnwy (mgr.34427) 6173 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:49:44.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:43 gibba013 bash[29418]: audit 2021-03-10T15:49:42.732956+0000 mon.a (mon.0) 2419 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:44.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:43 gibba013 bash[29418]: cephadm 2021-03-10T15:49:42.734475+0000 mgr.gibba020.yqfnwy (mgr.34427) 6174 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:49:44.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:43 gibba013 bash[29418]: audit 2021-03-10T15:49:42.734535+0000 mon.a (mon.0) 2420 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:44.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:43 gibba013 bash[29418]: cephadm 2021-03-10T15:49:42.735976+0000 mgr.gibba020.yqfnwy (mgr.34427) 6175 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:49:44.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:43 gibba013 bash[29418]: cephadm 2021-03-10T15:49:42.736015+0000 mgr.gibba020.yqfnwy (mgr.34427) 6176 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:49:44.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:43 gibba013 bash[29418]: audit 2021-03-10T15:49:42.737802+0000 mon.a (mon.0) 2421 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:44.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:43 gibba013 bash[29418]: audit 2021-03-10T15:49:42.739355+0000 mon.a (mon.0) 2422 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:44.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:43 gibba013 bash[30381]: cephadm 2021-03-10T15:49:42.523979+0000 mgr.gibba020.yqfnwy (mgr.34427) 6167 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:49:44.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:43 gibba013 bash[30381]: audit 2021-03-10T15:49:42.722290+0000 mon.a (mon.0) 2416 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:49:44.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:43 gibba013 bash[30381]: cephadm 2021-03-10T15:49:42.727750+0000 mgr.gibba020.yqfnwy (mgr.34427) 6168 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:49:44.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:43 gibba013 bash[30381]: cephadm 2021-03-10T15:49:42.729744+0000 mgr.gibba020.yqfnwy (mgr.34427) 6169 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:49:44.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:43 gibba013 bash[30381]: audit 2021-03-10T15:49:42.729907+0000 mon.a (mon.0) 2417 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:49:44.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:43 gibba013 bash[30381]: cephadm 2021-03-10T15:49:42.731247+0000 mgr.gibba020.yqfnwy (mgr.34427) 6170 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:49:44.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:43 gibba013 bash[30381]: audit 2021-03-10T15:49:42.731260+0000 mon.a (mon.0) 2418 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:44.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:43 gibba013 bash[30381]: cephadm 2021-03-10T15:49:42.731287+0000 mgr.gibba020.yqfnwy (mgr.34427) 6171 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:49:44.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:43 gibba013 bash[30381]: cephadm 2021-03-10T15:49:42.732783+0000 mgr.gibba020.yqfnwy (mgr.34427) 6172 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:49:44.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:43 gibba013 bash[30381]: cephadm 2021-03-10T15:49:42.732823+0000 mgr.gibba020.yqfnwy (mgr.34427) 6173 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:49:44.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:43 gibba013 bash[30381]: audit 2021-03-10T15:49:42.732956+0000 mon.a (mon.0) 2419 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:44.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:43 gibba013 bash[30381]: cephadm 2021-03-10T15:49:42.734475+0000 mgr.gibba020.yqfnwy (mgr.34427) 6174 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:49:44.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:43 gibba013 bash[30381]: audit 2021-03-10T15:49:42.734535+0000 mon.a (mon.0) 2420 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:44.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:43 gibba013 bash[30381]: cephadm 2021-03-10T15:49:42.735976+0000 mgr.gibba020.yqfnwy (mgr.34427) 6175 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:49:44.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:43 gibba013 bash[30381]: cephadm 2021-03-10T15:49:42.736015+0000 mgr.gibba020.yqfnwy (mgr.34427) 6176 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:49:44.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:43 gibba013 bash[30381]: audit 2021-03-10T15:49:42.737802+0000 mon.a (mon.0) 2421 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:44.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:43 gibba013 bash[30381]: audit 2021-03-10T15:49:42.739355+0000 mon.a (mon.0) 2422 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:44.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:43 gibba020 bash[25448]: cephadm 2021-03-10T15:49:42.523979+0000 mgr.gibba020.yqfnwy (mgr.34427) 6167 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:49:44.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:43 gibba020 bash[25448]: audit 2021-03-10T15:49:42.722290+0000 mon.a (mon.0) 2416 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:49:44.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:43 gibba020 bash[25448]: cephadm 2021-03-10T15:49:42.727750+0000 mgr.gibba020.yqfnwy (mgr.34427) 6168 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:49:44.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:43 gibba020 bash[25448]: cephadm 2021-03-10T15:49:42.729744+0000 mgr.gibba020.yqfnwy (mgr.34427) 6169 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:49:44.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:43 gibba020 bash[25448]: audit 2021-03-10T15:49:42.729907+0000 mon.a (mon.0) 2417 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:49:44.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:43 gibba020 bash[25448]: cephadm 2021-03-10T15:49:42.731247+0000 mgr.gibba020.yqfnwy (mgr.34427) 6170 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:49:44.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:43 gibba020 bash[25448]: audit 2021-03-10T15:49:42.731260+0000 mon.a (mon.0) 2418 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:44.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:43 gibba020 bash[25448]: cephadm 2021-03-10T15:49:42.731287+0000 mgr.gibba020.yqfnwy (mgr.34427) 6171 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:49:44.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:43 gibba020 bash[25448]: cephadm 2021-03-10T15:49:42.732783+0000 mgr.gibba020.yqfnwy (mgr.34427) 6172 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:49:44.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:43 gibba020 bash[25448]: cephadm 2021-03-10T15:49:42.732823+0000 mgr.gibba020.yqfnwy (mgr.34427) 6173 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:49:44.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:43 gibba020 bash[25448]: audit 2021-03-10T15:49:42.732956+0000 mon.a (mon.0) 2419 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:44.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:43 gibba020 bash[25448]: cephadm 2021-03-10T15:49:42.734475+0000 mgr.gibba020.yqfnwy (mgr.34427) 6174 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:49:44.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:43 gibba020 bash[25448]: audit 2021-03-10T15:49:42.734535+0000 mon.a (mon.0) 2420 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:44.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:43 gibba020 bash[25448]: cephadm 2021-03-10T15:49:42.735976+0000 mgr.gibba020.yqfnwy (mgr.34427) 6175 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:49:44.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:43 gibba020 bash[25448]: cephadm 2021-03-10T15:49:42.736015+0000 mgr.gibba020.yqfnwy (mgr.34427) 6176 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:49:44.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:43 gibba020 bash[25448]: audit 2021-03-10T15:49:42.737802+0000 mon.a (mon.0) 2421 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:44.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:43 gibba020 bash[25448]: audit 2021-03-10T15:49:42.739355+0000 mon.a (mon.0) 2422 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:49:45.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:44 gibba013 bash[29418]: cephadm 2021-03-10T15:49:42.737534+0000 mgr.gibba020.yqfnwy (mgr.34427) 6177 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:49:45.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:44 gibba013 bash[29418]: cephadm 2021-03-10T15:49:42.737905+0000 mgr.gibba020.yqfnwy (mgr.34427) 6178 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:49:45.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:44 gibba013 bash[29418]: cephadm 2021-03-10T15:49:42.739293+0000 mgr.gibba020.yqfnwy (mgr.34427) 6179 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:49:45.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:44 gibba013 bash[29418]: cephadm 2021-03-10T15:49:42.739336+0000 mgr.gibba020.yqfnwy (mgr.34427) 6180 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:49:45.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:44 gibba013 bash[29418]: cephadm 2021-03-10T15:49:42.739454+0000 mgr.gibba020.yqfnwy (mgr.34427) 6181 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:49:45.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:44 gibba013 bash[29418]: cluster 2021-03-10T15:49:43.495681+0000 mgr.gibba020.yqfnwy (mgr.34427) 6182 : cluster [DBG] pgmap v3511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:45.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:44 gibba013 bash[30381]: cephadm 2021-03-10T15:49:42.737534+0000 mgr.gibba020.yqfnwy (mgr.34427) 6177 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:49:45.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:44 gibba013 bash[30381]: cephadm 2021-03-10T15:49:42.737905+0000 mgr.gibba020.yqfnwy (mgr.34427) 6178 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:49:45.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:44 gibba013 bash[30381]: cephadm 2021-03-10T15:49:42.739293+0000 mgr.gibba020.yqfnwy (mgr.34427) 6179 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:49:45.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:44 gibba013 bash[30381]: cephadm 2021-03-10T15:49:42.739336+0000 mgr.gibba020.yqfnwy (mgr.34427) 6180 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:49:45.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:44 gibba013 bash[30381]: cephadm 2021-03-10T15:49:42.739454+0000 mgr.gibba020.yqfnwy (mgr.34427) 6181 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:49:45.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:44 gibba013 bash[30381]: cluster 2021-03-10T15:49:43.495681+0000 mgr.gibba020.yqfnwy (mgr.34427) 6182 : cluster [DBG] pgmap v3511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:45.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:44 gibba020 bash[25448]: cephadm 2021-03-10T15:49:42.737534+0000 mgr.gibba020.yqfnwy (mgr.34427) 6177 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:49:45.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:44 gibba020 bash[25448]: cephadm 2021-03-10T15:49:42.737905+0000 mgr.gibba020.yqfnwy (mgr.34427) 6178 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:49:45.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:44 gibba020 bash[25448]: cephadm 2021-03-10T15:49:42.739293+0000 mgr.gibba020.yqfnwy (mgr.34427) 6179 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:49:45.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:44 gibba020 bash[25448]: cephadm 2021-03-10T15:49:42.739336+0000 mgr.gibba020.yqfnwy (mgr.34427) 6180 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:49:45.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:44 gibba020 bash[25448]: cephadm 2021-03-10T15:49:42.739454+0000 mgr.gibba020.yqfnwy (mgr.34427) 6181 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:49:45.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:44 gibba020 bash[25448]: cluster 2021-03-10T15:49:43.495681+0000 mgr.gibba020.yqfnwy (mgr.34427) 6182 : cluster [DBG] pgmap v3511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:47.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:46 gibba013 bash[29418]: cluster 2021-03-10T15:49:45.497351+0000 mgr.gibba020.yqfnwy (mgr.34427) 6183 : cluster [DBG] pgmap v3512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:47.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:46 gibba013 bash[30381]: cluster 2021-03-10T15:49:45.497351+0000 mgr.gibba020.yqfnwy (mgr.34427) 6183 : cluster [DBG] pgmap v3512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:47.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:46 gibba020 bash[25448]: cluster 2021-03-10T15:49:45.497351+0000 mgr.gibba020.yqfnwy (mgr.34427) 6183 : cluster [DBG] pgmap v3512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:48.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:47 gibba013 bash[29418]: cluster 2021-03-10T15:49:47.498864+0000 mgr.gibba020.yqfnwy (mgr.34427) 6184 : cluster [DBG] pgmap v3513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:48.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:47 gibba013 bash[30381]: cluster 2021-03-10T15:49:47.498864+0000 mgr.gibba020.yqfnwy (mgr.34427) 6184 : cluster [DBG] pgmap v3513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:48.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:47 gibba020 bash[25448]: cluster 2021-03-10T15:49:47.498864+0000 mgr.gibba020.yqfnwy (mgr.34427) 6184 : cluster [DBG] pgmap v3513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:50.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:50 gibba013 bash[29418]: cluster 2021-03-10T15:49:49.500111+0000 mgr.gibba020.yqfnwy (mgr.34427) 6185 : cluster [DBG] pgmap v3514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:50.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:50 gibba013 bash[30381]: cluster 2021-03-10T15:49:49.500111+0000 mgr.gibba020.yqfnwy (mgr.34427) 6185 : cluster [DBG] pgmap v3514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:50.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:50 gibba020 bash[25448]: cluster 2021-03-10T15:49:49.500111+0000 mgr.gibba020.yqfnwy (mgr.34427) 6185 : cluster [DBG] pgmap v3514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:52.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:52 gibba013 bash[29418]: cluster 2021-03-10T15:49:51.501693+0000 mgr.gibba020.yqfnwy (mgr.34427) 6186 : cluster [DBG] pgmap v3515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:52.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:52 gibba013 bash[30381]: cluster 2021-03-10T15:49:51.501693+0000 mgr.gibba020.yqfnwy (mgr.34427) 6186 : cluster [DBG] pgmap v3515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:52.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:52 gibba020 bash[25448]: cluster 2021-03-10T15:49:51.501693+0000 mgr.gibba020.yqfnwy (mgr.34427) 6186 : cluster [DBG] pgmap v3515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:54.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:54 gibba013 bash[29418]: cluster 2021-03-10T15:49:53.503077+0000 mgr.gibba020.yqfnwy (mgr.34427) 6187 : cluster [DBG] pgmap v3516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:54.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:54 gibba013 bash[30381]: cluster 2021-03-10T15:49:53.503077+0000 mgr.gibba020.yqfnwy (mgr.34427) 6187 : cluster [DBG] pgmap v3516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:54.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:54 gibba020 bash[25448]: cluster 2021-03-10T15:49:53.503077+0000 mgr.gibba020.yqfnwy (mgr.34427) 6187 : cluster [DBG] pgmap v3516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:56.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:56 gibba013 bash[29418]: cluster 2021-03-10T15:49:55.504770+0000 mgr.gibba020.yqfnwy (mgr.34427) 6188 : cluster [DBG] pgmap v3517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:56.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:56 gibba013 bash[30381]: cluster 2021-03-10T15:49:55.504770+0000 mgr.gibba020.yqfnwy (mgr.34427) 6188 : cluster [DBG] pgmap v3517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:56.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:56 gibba020 bash[25448]: cluster 2021-03-10T15:49:55.504770+0000 mgr.gibba020.yqfnwy (mgr.34427) 6188 : cluster [DBG] pgmap v3517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:58.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:58 gibba013 bash[29418]: cluster 2021-03-10T15:49:57.506265+0000 mgr.gibba020.yqfnwy (mgr.34427) 6189 : cluster [DBG] pgmap v3518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:58.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:58 gibba013 bash[30381]: cluster 2021-03-10T15:49:57.506265+0000 mgr.gibba020.yqfnwy (mgr.34427) 6189 : cluster [DBG] pgmap v3518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:58.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:58 gibba020 bash[25448]: cluster 2021-03-10T15:49:57.506265+0000 mgr.gibba020.yqfnwy (mgr.34427) 6189 : cluster [DBG] pgmap v3518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:49:59.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:49:59 gibba013 bash[29418]: cephadm 2021-03-10T15:49:57.755446+0000 mgr.gibba020.yqfnwy (mgr.34427) 6190 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:49:59.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:49:59 gibba013 bash[30381]: cephadm 2021-03-10T15:49:57.755446+0000 mgr.gibba020.yqfnwy (mgr.34427) 6190 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:49:59.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:49:59 gibba020 bash[25448]: cephadm 2021-03-10T15:49:57.755446+0000 mgr.gibba020.yqfnwy (mgr.34427) 6190 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:50:00.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:00 gibba013 bash[29418]: debug 2021-03-10T15:49:59.996+0000 7fd718a82700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:50:00.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:00 gibba013 bash[29418]: cluster 2021-03-10T15:49:59.507816+0000 mgr.gibba020.yqfnwy (mgr.34427) 6191 : cluster [DBG] pgmap v3519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:00.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:00 gibba013 bash[29418]: cluster 2021-03-10T15:50:00.000198+0000 mon.a (mon.0) 2423 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:50:00.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:00 gibba013 bash[30381]: cluster 2021-03-10T15:49:59.507816+0000 mgr.gibba020.yqfnwy (mgr.34427) 6191 : cluster [DBG] pgmap v3519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:00.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:00 gibba013 bash[30381]: cluster 2021-03-10T15:50:00.000198+0000 mon.a (mon.0) 2423 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:50:00.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:00 gibba020 bash[25448]: cluster 2021-03-10T15:49:59.507816+0000 mgr.gibba020.yqfnwy (mgr.34427) 6191 : cluster [DBG] pgmap v3519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:00.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:00 gibba020 bash[25448]: cluster 2021-03-10T15:50:00.000198+0000 mon.a (mon.0) 2423 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T15:50:02.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:02 gibba013 bash[29418]: cluster 2021-03-10T15:50:01.509734+0000 mgr.gibba020.yqfnwy (mgr.34427) 6192 : cluster [DBG] pgmap v3520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:02.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:02 gibba013 bash[30381]: cluster 2021-03-10T15:50:01.509734+0000 mgr.gibba020.yqfnwy (mgr.34427) 6192 : cluster [DBG] pgmap v3520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:02.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:02 gibba020 bash[25448]: cluster 2021-03-10T15:50:01.509734+0000 mgr.gibba020.yqfnwy (mgr.34427) 6192 : cluster [DBG] pgmap v3520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:04.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:04 gibba013 bash[29418]: cluster 2021-03-10T15:50:03.511239+0000 mgr.gibba020.yqfnwy (mgr.34427) 6193 : cluster [DBG] pgmap v3521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:04.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:04 gibba013 bash[30381]: cluster 2021-03-10T15:50:03.511239+0000 mgr.gibba020.yqfnwy (mgr.34427) 6193 : cluster [DBG] pgmap v3521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:04.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:04 gibba020 bash[25448]: cluster 2021-03-10T15:50:03.511239+0000 mgr.gibba020.yqfnwy (mgr.34427) 6193 : cluster [DBG] pgmap v3521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:06.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:06 gibba013 bash[29418]: cluster 2021-03-10T15:50:05.513003+0000 mgr.gibba020.yqfnwy (mgr.34427) 6194 : cluster [DBG] pgmap v3522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:06.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:06 gibba013 bash[29418]: audit 2021-03-10T15:50:06.560088+0000 mon.a (mon.0) 2424 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:50:06.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:06 gibba013 bash[30381]: cluster 2021-03-10T15:50:05.513003+0000 mgr.gibba020.yqfnwy (mgr.34427) 6194 : cluster [DBG] pgmap v3522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:06.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:06 gibba013 bash[30381]: audit 2021-03-10T15:50:06.560088+0000 mon.a (mon.0) 2424 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:50:06.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:06 gibba020 bash[25448]: cluster 2021-03-10T15:50:05.513003+0000 mgr.gibba020.yqfnwy (mgr.34427) 6194 : cluster [DBG] pgmap v3522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:06.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:06 gibba020 bash[25448]: audit 2021-03-10T15:50:06.560088+0000 mon.a (mon.0) 2424 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:50:06.970 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:50:07.199 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:50:07.200 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (116m) 24s ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:50:07.200 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 9m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:50:07.200 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (117m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:50:07.200 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (117m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:50:07.201 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (116m) 24s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:50:07.201 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (116m) 24s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:50:07.201 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (115m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:50:07.201 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (115m) 24s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:50:07.201 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 24s ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:50:07.202 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:50:07.202 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (114m) 24s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:50:07.202 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (114m) 24s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:50:07.202 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (114m) 24s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:50:07.203 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (113m) 24s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:50:07.203 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (113m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:50:07.203 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (112m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:50:07.203 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (112m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:50:07.203 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (111m) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:50:07.204 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 9m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:50:07.204 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 9m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:50:07.446 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:50:07.447 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:50:07.447 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:50:07.447 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:50:07.447 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:50:07.448 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:50:07.448 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:50:07.448 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:50:07.448 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:50:07.448 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:50:07.449 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:50:07.449 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:50:07.449 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:50:07.449 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:50:07.449 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:50:07.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:07 gibba013 bash[29418]: audit 2021-03-10T15:50:06.644320+0000 mon.a (mon.0) 2425 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:50:07.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:07 gibba013 bash[29418]: audit 2021-03-10T15:50:06.782297+0000 mon.a (mon.0) 2426 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T15:50:07.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:07 gibba013 bash[29418]: audit 2021-03-10T15:50:06.782438+0000 mon.a (mon.0) 2427 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:50:07.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:07 gibba013 bash[29418]: audit 2021-03-10T15:50:06.782601+0000 mon.a (mon.0) 2428 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:50:07.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:07 gibba013 bash[29418]: audit 2021-03-10T15:50:06.782718+0000 mon.a (mon.0) 2429 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:50:07.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:07 gibba013 bash[29418]: audit 2021-03-10T15:50:07.444831+0000 mon.c (mon.1) 101 : audit [DBG] from='client.? 172.21.2.113:0/2375377570' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:07.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:07 gibba013 bash[30381]: audit 2021-03-10T15:50:06.644320+0000 mon.a (mon.0) 2425 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:50:07.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:07 gibba013 bash[30381]: audit 2021-03-10T15:50:06.782297+0000 mon.a (mon.0) 2426 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T15:50:07.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:07 gibba013 bash[30381]: audit 2021-03-10T15:50:06.782438+0000 mon.a (mon.0) 2427 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:50:07.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:07 gibba013 bash[30381]: audit 2021-03-10T15:50:06.782601+0000 mon.a (mon.0) 2428 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:50:07.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:07 gibba013 bash[30381]: audit 2021-03-10T15:50:06.782718+0000 mon.a (mon.0) 2429 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:50:07.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:07 gibba013 bash[30381]: audit 2021-03-10T15:50:07.444831+0000 mon.c (mon.1) 101 : audit [DBG] from='client.? 172.21.2.113:0/2375377570' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:07.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:07 gibba020 bash[25448]: audit 2021-03-10T15:50:06.644320+0000 mon.a (mon.0) 2425 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:50:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:07 gibba020 bash[25448]: audit 2021-03-10T15:50:06.782297+0000 mon.a (mon.0) 2426 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T15:50:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:07 gibba020 bash[25448]: audit 2021-03-10T15:50:06.782438+0000 mon.a (mon.0) 2427 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T15:50:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:07 gibba020 bash[25448]: audit 2021-03-10T15:50:06.782601+0000 mon.a (mon.0) 2428 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:50:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:07 gibba020 bash[25448]: audit 2021-03-10T15:50:06.782718+0000 mon.a (mon.0) 2429 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:50:07.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:07 gibba020 bash[25448]: audit 2021-03-10T15:50:07.444831+0000 mon.c (mon.1) 101 : audit [DBG] from='client.? 172.21.2.113:0/2375377570' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:08.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:08 gibba013 bash[29418]: audit 2021-03-10T15:50:06.959515+0000 mgr.gibba020.yqfnwy (mgr.34427) 6195 : audit [DBG] from='client.48210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:50:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:08 gibba013 bash[29418]: audit 2021-03-10T15:50:07.184562+0000 mgr.gibba020.yqfnwy (mgr.34427) 6196 : audit [DBG] from='client.58201 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:50:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:08 gibba013 bash[29418]: cluster 2021-03-10T15:50:07.514575+0000 mgr.gibba020.yqfnwy (mgr.34427) 6197 : cluster [DBG] pgmap v3523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:08.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:08 gibba013 bash[30381]: audit 2021-03-10T15:50:06.959515+0000 mgr.gibba020.yqfnwy (mgr.34427) 6195 : audit [DBG] from='client.48210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:50:08.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:08 gibba013 bash[30381]: audit 2021-03-10T15:50:07.184562+0000 mgr.gibba020.yqfnwy (mgr.34427) 6196 : audit [DBG] from='client.58201 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:50:08.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:08 gibba013 bash[30381]: cluster 2021-03-10T15:50:07.514575+0000 mgr.gibba020.yqfnwy (mgr.34427) 6197 : cluster [DBG] pgmap v3523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:08.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:08 gibba020 bash[25448]: audit 2021-03-10T15:50:06.959515+0000 mgr.gibba020.yqfnwy (mgr.34427) 6195 : audit [DBG] from='client.48210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:50:08.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:08 gibba020 bash[25448]: audit 2021-03-10T15:50:07.184562+0000 mgr.gibba020.yqfnwy (mgr.34427) 6196 : audit [DBG] from='client.58201 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:50:08.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:08 gibba020 bash[25448]: cluster 2021-03-10T15:50:07.514575+0000 mgr.gibba020.yqfnwy (mgr.34427) 6197 : cluster [DBG] pgmap v3523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:10.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:10 gibba013 bash[29418]: cluster 2021-03-10T15:50:09.516097+0000 mgr.gibba020.yqfnwy (mgr.34427) 6198 : cluster [DBG] pgmap v3524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:10.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:10 gibba013 bash[30381]: cluster 2021-03-10T15:50:09.516097+0000 mgr.gibba020.yqfnwy (mgr.34427) 6198 : cluster [DBG] pgmap v3524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:10.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:10 gibba020 bash[25448]: cluster 2021-03-10T15:50:09.516097+0000 mgr.gibba020.yqfnwy (mgr.34427) 6198 : cluster [DBG] pgmap v3524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:12.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:12 gibba013 bash[29418]: cluster 2021-03-10T15:50:11.517898+0000 mgr.gibba020.yqfnwy (mgr.34427) 6199 : cluster [DBG] pgmap v3525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:12.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:12 gibba013 bash[30381]: cluster 2021-03-10T15:50:11.517898+0000 mgr.gibba020.yqfnwy (mgr.34427) 6199 : cluster [DBG] pgmap v3525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:12.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:12 gibba020 bash[25448]: cluster 2021-03-10T15:50:11.517898+0000 mgr.gibba020.yqfnwy (mgr.34427) 6199 : cluster [DBG] pgmap v3525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:14.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:14 gibba013 bash[29418]: cephadm 2021-03-10T15:50:12.760939+0000 mgr.gibba020.yqfnwy (mgr.34427) 6200 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:50:14.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:14 gibba013 bash[29418]: cluster 2021-03-10T15:50:13.519344+0000 mgr.gibba020.yqfnwy (mgr.34427) 6201 : cluster [DBG] pgmap v3526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:14.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:14 gibba013 bash[30381]: cephadm 2021-03-10T15:50:12.760939+0000 mgr.gibba020.yqfnwy (mgr.34427) 6200 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:50:14.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:14 gibba013 bash[30381]: cluster 2021-03-10T15:50:13.519344+0000 mgr.gibba020.yqfnwy (mgr.34427) 6201 : cluster [DBG] pgmap v3526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:14.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:14 gibba020 bash[25448]: cephadm 2021-03-10T15:50:12.760939+0000 mgr.gibba020.yqfnwy (mgr.34427) 6200 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:50:14.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:14 gibba020 bash[25448]: cluster 2021-03-10T15:50:13.519344+0000 mgr.gibba020.yqfnwy (mgr.34427) 6201 : cluster [DBG] pgmap v3526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:16.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:16 gibba013 bash[29418]: cluster 2021-03-10T15:50:15.520964+0000 mgr.gibba020.yqfnwy (mgr.34427) 6202 : cluster [DBG] pgmap v3527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:16.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:16 gibba013 bash[30381]: cluster 2021-03-10T15:50:15.520964+0000 mgr.gibba020.yqfnwy (mgr.34427) 6202 : cluster [DBG] pgmap v3527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:16.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:16 gibba020 bash[25448]: cluster 2021-03-10T15:50:15.520964+0000 mgr.gibba020.yqfnwy (mgr.34427) 6202 : cluster [DBG] pgmap v3527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:18.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:18 gibba013 bash[29418]: cluster 2021-03-10T15:50:17.522445+0000 mgr.gibba020.yqfnwy (mgr.34427) 6203 : cluster [DBG] pgmap v3528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:18.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:18 gibba013 bash[30381]: cluster 2021-03-10T15:50:17.522445+0000 mgr.gibba020.yqfnwy (mgr.34427) 6203 : cluster [DBG] pgmap v3528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:18.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:18 gibba020 bash[25448]: cluster 2021-03-10T15:50:17.522445+0000 mgr.gibba020.yqfnwy (mgr.34427) 6203 : cluster [DBG] pgmap v3528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:20.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:20 gibba013 bash[29418]: cluster 2021-03-10T15:50:19.523811+0000 mgr.gibba020.yqfnwy (mgr.34427) 6204 : cluster [DBG] pgmap v3529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:20.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:20 gibba013 bash[30381]: cluster 2021-03-10T15:50:19.523811+0000 mgr.gibba020.yqfnwy (mgr.34427) 6204 : cluster [DBG] pgmap v3529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:20.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:20 gibba020 bash[25448]: cluster 2021-03-10T15:50:19.523811+0000 mgr.gibba020.yqfnwy (mgr.34427) 6204 : cluster [DBG] pgmap v3529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:22.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:22 gibba013 bash[29418]: cluster 2021-03-10T15:50:21.525649+0000 mgr.gibba020.yqfnwy (mgr.34427) 6205 : cluster [DBG] pgmap v3530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:22.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:22 gibba013 bash[30381]: cluster 2021-03-10T15:50:21.525649+0000 mgr.gibba020.yqfnwy (mgr.34427) 6205 : cluster [DBG] pgmap v3530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:22.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:22 gibba020 bash[25448]: cluster 2021-03-10T15:50:21.525649+0000 mgr.gibba020.yqfnwy (mgr.34427) 6205 : cluster [DBG] pgmap v3530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:24.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:24 gibba013 bash[29418]: cluster 2021-03-10T15:50:23.527164+0000 mgr.gibba020.yqfnwy (mgr.34427) 6206 : cluster [DBG] pgmap v3531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:24.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:24 gibba013 bash[30381]: cluster 2021-03-10T15:50:23.527164+0000 mgr.gibba020.yqfnwy (mgr.34427) 6206 : cluster [DBG] pgmap v3531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:24.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:24 gibba020 bash[25448]: cluster 2021-03-10T15:50:23.527164+0000 mgr.gibba020.yqfnwy (mgr.34427) 6206 : cluster [DBG] pgmap v3531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:26.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:26 gibba013 bash[29418]: cluster 2021-03-10T15:50:25.528937+0000 mgr.gibba020.yqfnwy (mgr.34427) 6207 : cluster [DBG] pgmap v3532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:26.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:26 gibba013 bash[30381]: cluster 2021-03-10T15:50:25.528937+0000 mgr.gibba020.yqfnwy (mgr.34427) 6207 : cluster [DBG] pgmap v3532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:26.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:26 gibba020 bash[25448]: cluster 2021-03-10T15:50:25.528937+0000 mgr.gibba020.yqfnwy (mgr.34427) 6207 : cluster [DBG] pgmap v3532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:28.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:28 gibba013 bash[29418]: cluster 2021-03-10T15:50:27.530512+0000 mgr.gibba020.yqfnwy (mgr.34427) 6208 : cluster [DBG] pgmap v3533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:28.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:28 gibba013 bash[30381]: cluster 2021-03-10T15:50:27.530512+0000 mgr.gibba020.yqfnwy (mgr.34427) 6208 : cluster [DBG] pgmap v3533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:28.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:28 gibba020 bash[25448]: cluster 2021-03-10T15:50:27.530512+0000 mgr.gibba020.yqfnwy (mgr.34427) 6208 : cluster [DBG] pgmap v3533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:29.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:29 gibba013 bash[29418]: cephadm 2021-03-10T15:50:27.776974+0000 mgr.gibba020.yqfnwy (mgr.34427) 6209 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:50:29.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:29 gibba013 bash[30381]: cephadm 2021-03-10T15:50:27.776974+0000 mgr.gibba020.yqfnwy (mgr.34427) 6209 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:50:29.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:29 gibba020 bash[25448]: cephadm 2021-03-10T15:50:27.776974+0000 mgr.gibba020.yqfnwy (mgr.34427) 6209 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:50:30.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:30 gibba013 bash[29418]: cluster 2021-03-10T15:50:29.532018+0000 mgr.gibba020.yqfnwy (mgr.34427) 6210 : cluster [DBG] pgmap v3534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:30.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:30 gibba013 bash[30381]: cluster 2021-03-10T15:50:29.532018+0000 mgr.gibba020.yqfnwy (mgr.34427) 6210 : cluster [DBG] pgmap v3534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:30.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:30 gibba020 bash[25448]: cluster 2021-03-10T15:50:29.532018+0000 mgr.gibba020.yqfnwy (mgr.34427) 6210 : cluster [DBG] pgmap v3534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:32.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:32 gibba013 bash[29418]: cluster 2021-03-10T15:50:31.533956+0000 mgr.gibba020.yqfnwy (mgr.34427) 6211 : cluster [DBG] pgmap v3535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:32.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:32 gibba013 bash[30381]: cluster 2021-03-10T15:50:31.533956+0000 mgr.gibba020.yqfnwy (mgr.34427) 6211 : cluster [DBG] pgmap v3535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:32.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:32 gibba020 bash[25448]: cluster 2021-03-10T15:50:31.533956+0000 mgr.gibba020.yqfnwy (mgr.34427) 6211 : cluster [DBG] pgmap v3535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:34.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:34 gibba013 bash[29418]: cluster 2021-03-10T15:50:33.535296+0000 mgr.gibba020.yqfnwy (mgr.34427) 6212 : cluster [DBG] pgmap v3536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:34.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:34 gibba013 bash[30381]: cluster 2021-03-10T15:50:33.535296+0000 mgr.gibba020.yqfnwy (mgr.34427) 6212 : cluster [DBG] pgmap v3536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:34.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:34 gibba020 bash[25448]: cluster 2021-03-10T15:50:33.535296+0000 mgr.gibba020.yqfnwy (mgr.34427) 6212 : cluster [DBG] pgmap v3536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:36.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:36 gibba013 bash[29418]: cluster 2021-03-10T15:50:35.537022+0000 mgr.gibba020.yqfnwy (mgr.34427) 6213 : cluster [DBG] pgmap v3537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:36.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:36 gibba013 bash[30381]: cluster 2021-03-10T15:50:35.537022+0000 mgr.gibba020.yqfnwy (mgr.34427) 6213 : cluster [DBG] pgmap v3537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:36.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:36 gibba020 bash[25448]: cluster 2021-03-10T15:50:35.537022+0000 mgr.gibba020.yqfnwy (mgr.34427) 6213 : cluster [DBG] pgmap v3537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:37.688 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:50:37.915 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:50:37.915 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (117m) 55s ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:50:37.915 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 10m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:50:37.916 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (117m) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:50:37.916 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (117m) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:50:37.916 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (116m) 55s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:50:37.916 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (116m) 55s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:50:37.916 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (116m) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:50:37.917 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (116m) 55s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:50:37.917 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 55s ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:50:37.917 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 10m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:50:37.917 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (115m) 55s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:50:37.918 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (114m) 55s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:50:37.918 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (114m) 55s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:50:37.918 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (114m) 55s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:50:37.918 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (113m) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:50:37.918 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (113m) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:50:37.919 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (112m) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:50:37.919 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (112m) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:50:37.919 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 10m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:50:37.919 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 10m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:50:38.167 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:50:38.168 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:50:38.168 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:50:38.168 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:50:38.168 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:50:38.169 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:50:38.169 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:50:38.169 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:50:38.169 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:50:38.169 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:50:38.170 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:50:38.170 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:50:38.170 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:50:38.170 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:50:38.170 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:50:38.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:38 gibba013 bash[29418]: cluster 2021-03-10T15:50:37.538402+0000 mgr.gibba020.yqfnwy (mgr.34427) 6214 : cluster [DBG] pgmap v3538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:38.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:38 gibba013 bash[29418]: audit 2021-03-10T15:50:37.676908+0000 mgr.gibba020.yqfnwy (mgr.34427) 6215 : audit [DBG] from='client.58213 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:50:38.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:38 gibba013 bash[29418]: audit 2021-03-10T15:50:38.166182+0000 mon.a (mon.0) 2430 : audit [DBG] from='client.? 172.21.2.113:0/3176376141' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:38.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:38 gibba013 bash[30381]: cluster 2021-03-10T15:50:37.538402+0000 mgr.gibba020.yqfnwy (mgr.34427) 6214 : cluster [DBG] pgmap v3538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:38.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:38 gibba013 bash[30381]: audit 2021-03-10T15:50:37.676908+0000 mgr.gibba020.yqfnwy (mgr.34427) 6215 : audit [DBG] from='client.58213 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:50:38.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:38 gibba013 bash[30381]: audit 2021-03-10T15:50:38.166182+0000 mon.a (mon.0) 2430 : audit [DBG] from='client.? 172.21.2.113:0/3176376141' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:38.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:38 gibba020 bash[25448]: cluster 2021-03-10T15:50:37.538402+0000 mgr.gibba020.yqfnwy (mgr.34427) 6214 : cluster [DBG] pgmap v3538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:38.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:38 gibba020 bash[25448]: audit 2021-03-10T15:50:37.676908+0000 mgr.gibba020.yqfnwy (mgr.34427) 6215 : audit [DBG] from='client.58213 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:50:38.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:38 gibba020 bash[25448]: audit 2021-03-10T15:50:38.166182+0000 mon.a (mon.0) 2430 : audit [DBG] from='client.? 172.21.2.113:0/3176376141' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:39.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:39 gibba013 bash[29418]: audit 2021-03-10T15:50:37.899128+0000 mgr.gibba020.yqfnwy (mgr.34427) 6216 : audit [DBG] from='client.48234 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:50:39.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:39 gibba013 bash[30381]: audit 2021-03-10T15:50:37.899128+0000 mgr.gibba020.yqfnwy (mgr.34427) 6216 : audit [DBG] from='client.48234 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:50:39.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:39 gibba020 bash[25448]: audit 2021-03-10T15:50:37.899128+0000 mgr.gibba020.yqfnwy (mgr.34427) 6216 : audit [DBG] from='client.48234 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:50:40.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:40 gibba013 bash[29418]: cluster 2021-03-10T15:50:39.539917+0000 mgr.gibba020.yqfnwy (mgr.34427) 6217 : cluster [DBG] pgmap v3539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:40.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:40 gibba013 bash[30381]: cluster 2021-03-10T15:50:39.539917+0000 mgr.gibba020.yqfnwy (mgr.34427) 6217 : cluster [DBG] pgmap v3539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:40.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:40 gibba020 bash[25448]: cluster 2021-03-10T15:50:39.539917+0000 mgr.gibba020.yqfnwy (mgr.34427) 6217 : cluster [DBG] pgmap v3539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:42.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:42 gibba020 bash[25448]: cluster 2021-03-10T15:50:41.541789+0000 mgr.gibba020.yqfnwy (mgr.34427) 6218 : cluster [DBG] pgmap v3540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:43.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:42 gibba013 bash[29418]: cluster 2021-03-10T15:50:41.541789+0000 mgr.gibba020.yqfnwy (mgr.34427) 6218 : cluster [DBG] pgmap v3540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:43.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:42 gibba013 bash[30381]: cluster 2021-03-10T15:50:41.541789+0000 mgr.gibba020.yqfnwy (mgr.34427) 6218 : cluster [DBG] pgmap v3540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:43.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:43 gibba020 bash[25448]: audit 2021-03-10T15:50:42.782969+0000 mon.a (mon.0) 2431 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:50:43.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:43 gibba020 bash[25448]: audit 2021-03-10T15:50:42.790828+0000 mon.a (mon.0) 2432 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:50:44.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:43 gibba013 bash[29418]: audit 2021-03-10T15:50:42.782969+0000 mon.a (mon.0) 2431 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:50:44.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:43 gibba013 bash[29418]: audit 2021-03-10T15:50:42.790828+0000 mon.a (mon.0) 2432 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:50:44.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:43 gibba013 bash[30381]: audit 2021-03-10T15:50:42.782969+0000 mon.a (mon.0) 2431 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:50:44.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:43 gibba013 bash[30381]: audit 2021-03-10T15:50:42.790828+0000 mon.a (mon.0) 2432 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:50:44.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:44 gibba020 bash[25448]: cephadm 2021-03-10T15:50:42.787481+0000 mgr.gibba020.yqfnwy (mgr.34427) 6219 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:50:44.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:44 gibba020 bash[25448]: cluster 2021-03-10T15:50:43.543132+0000 mgr.gibba020.yqfnwy (mgr.34427) 6220 : cluster [DBG] pgmap v3541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:45.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:44 gibba013 bash[29418]: cephadm 2021-03-10T15:50:42.787481+0000 mgr.gibba020.yqfnwy (mgr.34427) 6219 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:50:45.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:44 gibba013 bash[29418]: cluster 2021-03-10T15:50:43.543132+0000 mgr.gibba020.yqfnwy (mgr.34427) 6220 : cluster [DBG] pgmap v3541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:45.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:44 gibba013 bash[30381]: cephadm 2021-03-10T15:50:42.787481+0000 mgr.gibba020.yqfnwy (mgr.34427) 6219 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:50:45.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:44 gibba013 bash[30381]: cluster 2021-03-10T15:50:43.543132+0000 mgr.gibba020.yqfnwy (mgr.34427) 6220 : cluster [DBG] pgmap v3541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:46.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:46 gibba020 bash[25448]: cluster 2021-03-10T15:50:45.544831+0000 mgr.gibba020.yqfnwy (mgr.34427) 6221 : cluster [DBG] pgmap v3542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:46.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:46 gibba020 bash[25448]: audit 2021-03-10T15:50:46.636313+0000 mon.a (mon.0) 2433 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:50:46.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:46 gibba020 bash[25448]: audit 2021-03-10T15:50:46.637193+0000 mon.a (mon.0) 2434 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T15:50:47.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:46 gibba013 bash[29418]: cluster 2021-03-10T15:50:45.544831+0000 mgr.gibba020.yqfnwy (mgr.34427) 6221 : cluster [DBG] pgmap v3542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:47.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:46 gibba013 bash[29418]: audit 2021-03-10T15:50:46.636313+0000 mon.a (mon.0) 2433 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:50:47.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:46 gibba013 bash[29418]: audit 2021-03-10T15:50:46.637193+0000 mon.a (mon.0) 2434 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T15:50:47.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:46 gibba013 bash[30381]: cluster 2021-03-10T15:50:45.544831+0000 mgr.gibba020.yqfnwy (mgr.34427) 6221 : cluster [DBG] pgmap v3542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:47.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:46 gibba013 bash[30381]: audit 2021-03-10T15:50:46.636313+0000 mon.a (mon.0) 2433 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:50:47.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:46 gibba013 bash[30381]: audit 2021-03-10T15:50:46.637193+0000 mon.a (mon.0) 2434 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T15:50:48.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:48 gibba020 bash[25448]: cluster 2021-03-10T15:50:47.546096+0000 mgr.gibba020.yqfnwy (mgr.34427) 6222 : cluster [DBG] pgmap v3543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:49.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:48 gibba013 bash[29418]: cluster 2021-03-10T15:50:47.546096+0000 mgr.gibba020.yqfnwy (mgr.34427) 6222 : cluster [DBG] pgmap v3543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:49.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:48 gibba013 bash[30381]: cluster 2021-03-10T15:50:47.546096+0000 mgr.gibba020.yqfnwy (mgr.34427) 6222 : cluster [DBG] pgmap v3543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:50.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:50 gibba020 bash[25448]: cluster 2021-03-10T15:50:49.546597+0000 mgr.gibba020.yqfnwy (mgr.34427) 6223 : cluster [DBG] pgmap v3544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:51.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:50 gibba013 bash[29418]: cluster 2021-03-10T15:50:49.546597+0000 mgr.gibba020.yqfnwy (mgr.34427) 6223 : cluster [DBG] pgmap v3544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:51.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:50 gibba013 bash[30381]: cluster 2021-03-10T15:50:49.546597+0000 mgr.gibba020.yqfnwy (mgr.34427) 6223 : cluster [DBG] pgmap v3544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:51.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:51 gibba020 bash[25448]: audit 2021-03-10T15:50:51.397293+0000 mon.a (mon.0) 2435 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:50:51.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:51 gibba020 bash[25448]: audit 2021-03-10T15:50:51.567327+0000 mon.a (mon.0) 2436 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:50:52.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:51 gibba013 bash[29418]: audit 2021-03-10T15:50:51.397293+0000 mon.a (mon.0) 2435 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:50:52.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:51 gibba013 bash[29418]: audit 2021-03-10T15:50:51.567327+0000 mon.a (mon.0) 2436 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:50:52.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:51 gibba013 bash[30381]: audit 2021-03-10T15:50:51.397293+0000 mon.a (mon.0) 2435 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:50:52.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:51 gibba013 bash[30381]: audit 2021-03-10T15:50:51.567327+0000 mon.a (mon.0) 2436 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:50:53.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:52 gibba013 bash[29418]: cluster 2021-03-10T15:50:51.547164+0000 mgr.gibba020.yqfnwy (mgr.34427) 6224 : cluster [DBG] pgmap v3545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:53.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:52 gibba013 bash[29418]: cephadm 2021-03-10T15:50:51.566817+0000 mgr.gibba020.yqfnwy (mgr.34427) 6225 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:50:53.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:52 gibba013 bash[29418]: audit 2021-03-10T15:50:51.756949+0000 mon.a (mon.0) 2437 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:50:53.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:52 gibba013 bash[29418]: cephadm 2021-03-10T15:50:51.758383+0000 mgr.gibba020.yqfnwy (mgr.34427) 6226 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:50:53.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:52 gibba013 bash[29418]: cephadm 2021-03-10T15:50:51.759834+0000 mgr.gibba020.yqfnwy (mgr.34427) 6227 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:50:53.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:52 gibba013 bash[29418]: audit 2021-03-10T15:50:51.760290+0000 mon.a (mon.0) 2438 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:50:53.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:52 gibba013 bash[29418]: cephadm 2021-03-10T15:50:51.760791+0000 mgr.gibba020.yqfnwy (mgr.34427) 6228 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:50:53.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:52 gibba013 bash[29418]: cephadm 2021-03-10T15:50:51.760828+0000 mgr.gibba020.yqfnwy (mgr.34427) 6229 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:50:53.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:52 gibba013 bash[29418]: audit 2021-03-10T15:50:51.761389+0000 mon.a (mon.0) 2439 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:53.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:52 gibba013 bash[29418]: cephadm 2021-03-10T15:50:51.761905+0000 mgr.gibba020.yqfnwy (mgr.34427) 6230 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:50:53.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:52 gibba013 bash[29418]: cephadm 2021-03-10T15:50:51.761958+0000 mgr.gibba020.yqfnwy (mgr.34427) 6231 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:50:53.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:52 gibba013 bash[29418]: audit 2021-03-10T15:50:51.762476+0000 mon.a (mon.0) 2440 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:53.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:52 gibba013 bash[29418]: cephadm 2021-03-10T15:50:51.762777+0000 mgr.gibba020.yqfnwy (mgr.34427) 6232 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:50:53.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:52 gibba013 bash[29418]: audit 2021-03-10T15:50:51.763376+0000 mon.a (mon.0) 2441 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:53.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:52 gibba013 bash[29418]: cephadm 2021-03-10T15:50:51.763513+0000 mgr.gibba020.yqfnwy (mgr.34427) 6233 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:50:53.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:52 gibba013 bash[29418]: cephadm 2021-03-10T15:50:51.763547+0000 mgr.gibba020.yqfnwy (mgr.34427) 6234 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:50:53.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:52 gibba013 bash[29418]: audit 2021-03-10T15:50:51.765112+0000 mon.a (mon.0) 2442 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:53.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:52 gibba013 bash[29418]: audit 2021-03-10T15:50:51.766189+0000 mon.a (mon.0) 2443 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:53.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:52 gibba013 bash[30381]: cluster 2021-03-10T15:50:51.547164+0000 mgr.gibba020.yqfnwy (mgr.34427) 6224 : cluster [DBG] pgmap v3545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:53.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:52 gibba013 bash[30381]: cephadm 2021-03-10T15:50:51.566817+0000 mgr.gibba020.yqfnwy (mgr.34427) 6225 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:50:53.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:52 gibba013 bash[30381]: audit 2021-03-10T15:50:51.756949+0000 mon.a (mon.0) 2437 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:50:53.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:52 gibba013 bash[30381]: cephadm 2021-03-10T15:50:51.758383+0000 mgr.gibba020.yqfnwy (mgr.34427) 6226 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:50:53.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:52 gibba013 bash[30381]: cephadm 2021-03-10T15:50:51.759834+0000 mgr.gibba020.yqfnwy (mgr.34427) 6227 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:50:53.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:52 gibba013 bash[30381]: audit 2021-03-10T15:50:51.760290+0000 mon.a (mon.0) 2438 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:50:53.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:52 gibba013 bash[30381]: cephadm 2021-03-10T15:50:51.760791+0000 mgr.gibba020.yqfnwy (mgr.34427) 6228 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:50:53.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:52 gibba013 bash[30381]: cephadm 2021-03-10T15:50:51.760828+0000 mgr.gibba020.yqfnwy (mgr.34427) 6229 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:50:53.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:52 gibba013 bash[30381]: audit 2021-03-10T15:50:51.761389+0000 mon.a (mon.0) 2439 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:53.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:52 gibba013 bash[30381]: cephadm 2021-03-10T15:50:51.761905+0000 mgr.gibba020.yqfnwy (mgr.34427) 6230 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:50:53.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:52 gibba013 bash[30381]: cephadm 2021-03-10T15:50:51.761958+0000 mgr.gibba020.yqfnwy (mgr.34427) 6231 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:50:53.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:52 gibba013 bash[30381]: audit 2021-03-10T15:50:51.762476+0000 mon.a (mon.0) 2440 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:53.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:52 gibba013 bash[30381]: cephadm 2021-03-10T15:50:51.762777+0000 mgr.gibba020.yqfnwy (mgr.34427) 6232 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:50:53.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:52 gibba013 bash[30381]: audit 2021-03-10T15:50:51.763376+0000 mon.a (mon.0) 2441 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:53.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:52 gibba013 bash[30381]: cephadm 2021-03-10T15:50:51.763513+0000 mgr.gibba020.yqfnwy (mgr.34427) 6233 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:50:53.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:52 gibba013 bash[30381]: cephadm 2021-03-10T15:50:51.763547+0000 mgr.gibba020.yqfnwy (mgr.34427) 6234 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:50:53.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:52 gibba013 bash[30381]: audit 2021-03-10T15:50:51.765112+0000 mon.a (mon.0) 2442 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:53.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:52 gibba013 bash[30381]: audit 2021-03-10T15:50:51.766189+0000 mon.a (mon.0) 2443 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:53.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:52 gibba020 bash[25448]: cluster 2021-03-10T15:50:51.547164+0000 mgr.gibba020.yqfnwy (mgr.34427) 6224 : cluster [DBG] pgmap v3545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:53.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:52 gibba020 bash[25448]: cephadm 2021-03-10T15:50:51.566817+0000 mgr.gibba020.yqfnwy (mgr.34427) 6225 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:50:53.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:52 gibba020 bash[25448]: audit 2021-03-10T15:50:51.756949+0000 mon.a (mon.0) 2437 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:50:53.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:52 gibba020 bash[25448]: cephadm 2021-03-10T15:50:51.758383+0000 mgr.gibba020.yqfnwy (mgr.34427) 6226 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:50:53.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:52 gibba020 bash[25448]: cephadm 2021-03-10T15:50:51.759834+0000 mgr.gibba020.yqfnwy (mgr.34427) 6227 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:50:53.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:52 gibba020 bash[25448]: audit 2021-03-10T15:50:51.760290+0000 mon.a (mon.0) 2438 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:50:53.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:52 gibba020 bash[25448]: cephadm 2021-03-10T15:50:51.760791+0000 mgr.gibba020.yqfnwy (mgr.34427) 6228 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:50:53.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:52 gibba020 bash[25448]: cephadm 2021-03-10T15:50:51.760828+0000 mgr.gibba020.yqfnwy (mgr.34427) 6229 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:50:53.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:52 gibba020 bash[25448]: audit 2021-03-10T15:50:51.761389+0000 mon.a (mon.0) 2439 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:53.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:52 gibba020 bash[25448]: cephadm 2021-03-10T15:50:51.761905+0000 mgr.gibba020.yqfnwy (mgr.34427) 6230 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:50:53.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:52 gibba020 bash[25448]: cephadm 2021-03-10T15:50:51.761958+0000 mgr.gibba020.yqfnwy (mgr.34427) 6231 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:50:53.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:52 gibba020 bash[25448]: audit 2021-03-10T15:50:51.762476+0000 mon.a (mon.0) 2440 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:53.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:52 gibba020 bash[25448]: cephadm 2021-03-10T15:50:51.762777+0000 mgr.gibba020.yqfnwy (mgr.34427) 6232 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:50:53.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:52 gibba020 bash[25448]: audit 2021-03-10T15:50:51.763376+0000 mon.a (mon.0) 2441 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:53.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:52 gibba020 bash[25448]: cephadm 2021-03-10T15:50:51.763513+0000 mgr.gibba020.yqfnwy (mgr.34427) 6233 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:50:53.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:52 gibba020 bash[25448]: cephadm 2021-03-10T15:50:51.763547+0000 mgr.gibba020.yqfnwy (mgr.34427) 6234 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:50:53.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:52 gibba020 bash[25448]: audit 2021-03-10T15:50:51.765112+0000 mon.a (mon.0) 2442 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:53.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:52 gibba020 bash[25448]: audit 2021-03-10T15:50:51.766189+0000 mon.a (mon.0) 2443 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:50:54.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:53 gibba013 bash[29418]: cephadm 2021-03-10T15:50:51.764469+0000 mgr.gibba020.yqfnwy (mgr.34427) 6235 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:50:54.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:53 gibba013 bash[29418]: cephadm 2021-03-10T15:50:51.764788+0000 mgr.gibba020.yqfnwy (mgr.34427) 6236 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:50:54.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:53 gibba013 bash[29418]: cephadm 2021-03-10T15:50:51.765572+0000 mgr.gibba020.yqfnwy (mgr.34427) 6237 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:50:54.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:53 gibba013 bash[29418]: cephadm 2021-03-10T15:50:51.765612+0000 mgr.gibba020.yqfnwy (mgr.34427) 6238 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:50:54.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:53 gibba013 bash[29418]: cephadm 2021-03-10T15:50:51.765789+0000 mgr.gibba020.yqfnwy (mgr.34427) 6239 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:50:54.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:53 gibba013 bash[30381]: cephadm 2021-03-10T15:50:51.764469+0000 mgr.gibba020.yqfnwy (mgr.34427) 6235 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:50:54.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:53 gibba013 bash[30381]: cephadm 2021-03-10T15:50:51.764788+0000 mgr.gibba020.yqfnwy (mgr.34427) 6236 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:50:54.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:53 gibba013 bash[30381]: cephadm 2021-03-10T15:50:51.765572+0000 mgr.gibba020.yqfnwy (mgr.34427) 6237 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:50:54.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:53 gibba013 bash[30381]: cephadm 2021-03-10T15:50:51.765612+0000 mgr.gibba020.yqfnwy (mgr.34427) 6238 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:50:54.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:53 gibba013 bash[30381]: cephadm 2021-03-10T15:50:51.765789+0000 mgr.gibba020.yqfnwy (mgr.34427) 6239 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:50:54.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:53 gibba020 bash[25448]: cephadm 2021-03-10T15:50:51.764469+0000 mgr.gibba020.yqfnwy (mgr.34427) 6235 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:50:54.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:53 gibba020 bash[25448]: cephadm 2021-03-10T15:50:51.764788+0000 mgr.gibba020.yqfnwy (mgr.34427) 6236 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:50:54.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:53 gibba020 bash[25448]: cephadm 2021-03-10T15:50:51.765572+0000 mgr.gibba020.yqfnwy (mgr.34427) 6237 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:50:54.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:53 gibba020 bash[25448]: cephadm 2021-03-10T15:50:51.765612+0000 mgr.gibba020.yqfnwy (mgr.34427) 6238 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:50:54.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:53 gibba020 bash[25448]: cephadm 2021-03-10T15:50:51.765789+0000 mgr.gibba020.yqfnwy (mgr.34427) 6239 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:50:55.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:54 gibba013 bash[29418]: cluster 2021-03-10T15:50:53.548482+0000 mgr.gibba020.yqfnwy (mgr.34427) 6240 : cluster [DBG] pgmap v3546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:55.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:54 gibba013 bash[30381]: cluster 2021-03-10T15:50:53.548482+0000 mgr.gibba020.yqfnwy (mgr.34427) 6240 : cluster [DBG] pgmap v3546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:55.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:54 gibba020 bash[25448]: cluster 2021-03-10T15:50:53.548482+0000 mgr.gibba020.yqfnwy (mgr.34427) 6240 : cluster [DBG] pgmap v3546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:56.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:55 gibba013 bash[29418]: cluster 2021-03-10T15:50:55.550122+0000 mgr.gibba020.yqfnwy (mgr.34427) 6241 : cluster [DBG] pgmap v3547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:56.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:55 gibba013 bash[30381]: cluster 2021-03-10T15:50:55.550122+0000 mgr.gibba020.yqfnwy (mgr.34427) 6241 : cluster [DBG] pgmap v3547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:56.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:55 gibba020 bash[25448]: cluster 2021-03-10T15:50:55.550122+0000 mgr.gibba020.yqfnwy (mgr.34427) 6241 : cluster [DBG] pgmap v3547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:58.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:50:58 gibba013 bash[29418]: cluster 2021-03-10T15:50:57.551541+0000 mgr.gibba020.yqfnwy (mgr.34427) 6242 : cluster [DBG] pgmap v3548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:58.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:50:58 gibba013 bash[30381]: cluster 2021-03-10T15:50:57.551541+0000 mgr.gibba020.yqfnwy (mgr.34427) 6242 : cluster [DBG] pgmap v3548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:50:58.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:50:58 gibba020 bash[25448]: cluster 2021-03-10T15:50:57.551541+0000 mgr.gibba020.yqfnwy (mgr.34427) 6242 : cluster [DBG] pgmap v3548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:00.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:00 gibba013 bash[29418]: cluster 2021-03-10T15:50:59.553055+0000 mgr.gibba020.yqfnwy (mgr.34427) 6243 : cluster [DBG] pgmap v3549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:00.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:00 gibba013 bash[30381]: cluster 2021-03-10T15:50:59.553055+0000 mgr.gibba020.yqfnwy (mgr.34427) 6243 : cluster [DBG] pgmap v3549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:00.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:00 gibba020 bash[25448]: cluster 2021-03-10T15:50:59.553055+0000 mgr.gibba020.yqfnwy (mgr.34427) 6243 : cluster [DBG] pgmap v3549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:02.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:02 gibba020 bash[25448]: cluster 2021-03-10T15:51:01.554925+0000 mgr.gibba020.yqfnwy (mgr.34427) 6244 : cluster [DBG] pgmap v3550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:03.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:02 gibba013 bash[29418]: cluster 2021-03-10T15:51:01.554925+0000 mgr.gibba020.yqfnwy (mgr.34427) 6244 : cluster [DBG] pgmap v3550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:03.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:02 gibba013 bash[30381]: cluster 2021-03-10T15:51:01.554925+0000 mgr.gibba020.yqfnwy (mgr.34427) 6244 : cluster [DBG] pgmap v3550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:04.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:04 gibba020 bash[25448]: cluster 2021-03-10T15:51:03.556323+0000 mgr.gibba020.yqfnwy (mgr.34427) 6245 : cluster [DBG] pgmap v3551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:04.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:04 gibba013 bash[29418]: cluster 2021-03-10T15:51:03.556323+0000 mgr.gibba020.yqfnwy (mgr.34427) 6245 : cluster [DBG] pgmap v3551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:04.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:04 gibba013 bash[30381]: cluster 2021-03-10T15:51:03.556323+0000 mgr.gibba020.yqfnwy (mgr.34427) 6245 : cluster [DBG] pgmap v3551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:06.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:06 gibba013 bash[29418]: cluster 2021-03-10T15:51:05.557978+0000 mgr.gibba020.yqfnwy (mgr.34427) 6246 : cluster [DBG] pgmap v3552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:06 gibba013 bash[29418]: audit 2021-03-10T15:51:06.565078+0000 mon.a (mon.0) 2444 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:51:06.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:06 gibba013 bash[30381]: cluster 2021-03-10T15:51:05.557978+0000 mgr.gibba020.yqfnwy (mgr.34427) 6246 : cluster [DBG] pgmap v3552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:06.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:06 gibba013 bash[30381]: audit 2021-03-10T15:51:06.565078+0000 mon.a (mon.0) 2444 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:51:06.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:06 gibba020 bash[25448]: cluster 2021-03-10T15:51:05.557978+0000 mgr.gibba020.yqfnwy (mgr.34427) 6246 : cluster [DBG] pgmap v3552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:06.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:06 gibba020 bash[25448]: audit 2021-03-10T15:51:06.565078+0000 mon.a (mon.0) 2444 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:51:07.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:07 gibba013 bash[29418]: audit 2021-03-10T15:51:06.649683+0000 mon.a (mon.0) 2445 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:51:07.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:07 gibba013 bash[29418]: audit 2021-03-10T15:51:06.789977+0000 mon.a (mon.0) 2446 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:51:07.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:07 gibba013 bash[29418]: audit 2021-03-10T15:51:06.790872+0000 mon.a (mon.0) 2447 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:51:07.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:07 gibba013 bash[29418]: audit 2021-03-10T15:51:06.791558+0000 mon.a (mon.0) 2448 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:51:07.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:07 gibba013 bash[29418]: audit 2021-03-10T15:51:06.792226+0000 mon.a (mon.0) 2449 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:51:07.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:07 gibba013 bash[30381]: audit 2021-03-10T15:51:06.649683+0000 mon.a (mon.0) 2445 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:51:07.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:07 gibba013 bash[30381]: audit 2021-03-10T15:51:06.789977+0000 mon.a (mon.0) 2446 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:51:07.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:07 gibba013 bash[30381]: audit 2021-03-10T15:51:06.790872+0000 mon.a (mon.0) 2447 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:51:07.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:07 gibba013 bash[30381]: audit 2021-03-10T15:51:06.791558+0000 mon.a (mon.0) 2448 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:51:07.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:07 gibba013 bash[30381]: audit 2021-03-10T15:51:06.792226+0000 mon.a (mon.0) 2449 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:51:07.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:07 gibba020 bash[25448]: audit 2021-03-10T15:51:06.649683+0000 mon.a (mon.0) 2445 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:51:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:07 gibba020 bash[25448]: audit 2021-03-10T15:51:06.789977+0000 mon.a (mon.0) 2446 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T15:51:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:07 gibba020 bash[25448]: audit 2021-03-10T15:51:06.790872+0000 mon.a (mon.0) 2447 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:51:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:07 gibba020 bash[25448]: audit 2021-03-10T15:51:06.791558+0000 mon.a (mon.0) 2448 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T15:51:07.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:07 gibba020 bash[25448]: audit 2021-03-10T15:51:06.792226+0000 mon.a (mon.0) 2449 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T15:51:08.412 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:51:08.639 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:51:08.640 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (117m) 86s ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:51:08.640 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 22s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:51:08.640 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (118m) 22s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:51:08.641 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (118m) 22s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:51:08.641 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (117m) 86s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:51:08.641 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (117m) 86s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:51:08.641 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (116m) 22s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:51:08.642 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (116m) 86s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:51:08.642 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 86s ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:51:08.642 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 22s ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:51:08.642 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (115m) 86s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:51:08.643 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (115m) 86s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:51:08.643 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (115m) 86s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:51:08.643 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (114m) 86s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:51:08.643 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (114m) 22s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:51:08.644 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (113m) 22s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:51:08.644 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (113m) 22s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:51:08.644 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (112m) 22s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:51:08.645 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 22s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:51:08.645 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 22s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:51:08.885 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:51:08.886 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:51:08.886 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:51:08.886 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:51:08.887 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:51:08.887 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:51:08.887 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:51:08.887 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:51:08.888 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:51:08.888 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:51:08.888 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:51:08.888 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:51:08.889 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:51:08.889 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:51:08.889 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:51:08.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:08 gibba020 bash[25448]: cephadm 2021-03-10T15:51:06.781859+0000 mgr.gibba020.yqfnwy (mgr.34427) 6247 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:51:08.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:08 gibba020 bash[25448]: cluster 2021-03-10T15:51:07.559514+0000 mgr.gibba020.yqfnwy (mgr.34427) 6248 : cluster [DBG] pgmap v3553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:09.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:08 gibba013 bash[29418]: cephadm 2021-03-10T15:51:06.781859+0000 mgr.gibba020.yqfnwy (mgr.34427) 6247 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:51:09.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:08 gibba013 bash[29418]: cluster 2021-03-10T15:51:07.559514+0000 mgr.gibba020.yqfnwy (mgr.34427) 6248 : cluster [DBG] pgmap v3553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:09.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:08 gibba013 bash[30381]: cephadm 2021-03-10T15:51:06.781859+0000 mgr.gibba020.yqfnwy (mgr.34427) 6247 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:51:09.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:08 gibba013 bash[30381]: cluster 2021-03-10T15:51:07.559514+0000 mgr.gibba020.yqfnwy (mgr.34427) 6248 : cluster [DBG] pgmap v3553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:09.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:09 gibba020 bash[25448]: audit 2021-03-10T15:51:08.400426+0000 mgr.gibba020.yqfnwy (mgr.34427) 6249 : audit [DBG] from='client.48246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:51:09.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:09 gibba020 bash[25448]: audit 2021-03-10T15:51:08.624412+0000 mgr.gibba020.yqfnwy (mgr.34427) 6250 : audit [DBG] from='client.58237 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:51:09.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:09 gibba020 bash[25448]: audit 2021-03-10T15:51:08.884182+0000 mon.c (mon.1) 102 : audit [DBG] from='client.? 172.21.2.113:0/1811992617' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:10.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:09 gibba013 bash[29418]: audit 2021-03-10T15:51:08.400426+0000 mgr.gibba020.yqfnwy (mgr.34427) 6249 : audit [DBG] from='client.48246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:51:10.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:09 gibba013 bash[29418]: audit 2021-03-10T15:51:08.624412+0000 mgr.gibba020.yqfnwy (mgr.34427) 6250 : audit [DBG] from='client.58237 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:51:10.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:09 gibba013 bash[29418]: audit 2021-03-10T15:51:08.884182+0000 mon.c (mon.1) 102 : audit [DBG] from='client.? 172.21.2.113:0/1811992617' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:10.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:09 gibba013 bash[30381]: audit 2021-03-10T15:51:08.400426+0000 mgr.gibba020.yqfnwy (mgr.34427) 6249 : audit [DBG] from='client.48246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:51:10.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:09 gibba013 bash[30381]: audit 2021-03-10T15:51:08.624412+0000 mgr.gibba020.yqfnwy (mgr.34427) 6250 : audit [DBG] from='client.58237 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:51:10.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:09 gibba013 bash[30381]: audit 2021-03-10T15:51:08.884182+0000 mon.c (mon.1) 102 : audit [DBG] from='client.? 172.21.2.113:0/1811992617' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:10.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:10 gibba020 bash[25448]: cluster 2021-03-10T15:51:09.560990+0000 mgr.gibba020.yqfnwy (mgr.34427) 6251 : cluster [DBG] pgmap v3554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:11.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:10 gibba013 bash[29418]: cluster 2021-03-10T15:51:09.560990+0000 mgr.gibba020.yqfnwy (mgr.34427) 6251 : cluster [DBG] pgmap v3554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:11.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:10 gibba013 bash[30381]: cluster 2021-03-10T15:51:09.560990+0000 mgr.gibba020.yqfnwy (mgr.34427) 6251 : cluster [DBG] pgmap v3554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:12.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:12 gibba020 bash[25448]: cluster 2021-03-10T15:51:11.562680+0000 mgr.gibba020.yqfnwy (mgr.34427) 6252 : cluster [DBG] pgmap v3555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:13.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:12 gibba013 bash[29418]: cluster 2021-03-10T15:51:11.562680+0000 mgr.gibba020.yqfnwy (mgr.34427) 6252 : cluster [DBG] pgmap v3555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:13.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:12 gibba013 bash[30381]: cluster 2021-03-10T15:51:11.562680+0000 mgr.gibba020.yqfnwy (mgr.34427) 6252 : cluster [DBG] pgmap v3555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:14.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:14 gibba020 bash[25448]: cluster 2021-03-10T15:51:13.564088+0000 mgr.gibba020.yqfnwy (mgr.34427) 6253 : cluster [DBG] pgmap v3556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:14.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:14 gibba013 bash[29418]: cluster 2021-03-10T15:51:13.564088+0000 mgr.gibba020.yqfnwy (mgr.34427) 6253 : cluster [DBG] pgmap v3556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:14.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:14 gibba013 bash[30381]: cluster 2021-03-10T15:51:13.564088+0000 mgr.gibba020.yqfnwy (mgr.34427) 6253 : cluster [DBG] pgmap v3556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:16.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:16 gibba013 bash[29418]: cluster 2021-03-10T15:51:15.565468+0000 mgr.gibba020.yqfnwy (mgr.34427) 6254 : cluster [DBG] pgmap v3557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:16.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:16 gibba013 bash[30381]: cluster 2021-03-10T15:51:15.565468+0000 mgr.gibba020.yqfnwy (mgr.34427) 6254 : cluster [DBG] pgmap v3557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:16.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:16 gibba020 bash[25448]: cluster 2021-03-10T15:51:15.565468+0000 mgr.gibba020.yqfnwy (mgr.34427) 6254 : cluster [DBG] pgmap v3557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:18.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:18 gibba020 bash[25448]: cluster 2021-03-10T15:51:17.566960+0000 mgr.gibba020.yqfnwy (mgr.34427) 6255 : cluster [DBG] pgmap v3558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:19.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:18 gibba013 bash[29418]: cluster 2021-03-10T15:51:17.566960+0000 mgr.gibba020.yqfnwy (mgr.34427) 6255 : cluster [DBG] pgmap v3558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:19.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:18 gibba013 bash[30381]: cluster 2021-03-10T15:51:17.566960+0000 mgr.gibba020.yqfnwy (mgr.34427) 6255 : cluster [DBG] pgmap v3558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:20.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:20 gibba020 bash[25448]: cluster 2021-03-10T15:51:19.568608+0000 mgr.gibba020.yqfnwy (mgr.34427) 6256 : cluster [DBG] pgmap v3559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:21.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:20 gibba013 bash[29418]: cluster 2021-03-10T15:51:19.568608+0000 mgr.gibba020.yqfnwy (mgr.34427) 6256 : cluster [DBG] pgmap v3559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:21.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:20 gibba013 bash[30381]: cluster 2021-03-10T15:51:19.568608+0000 mgr.gibba020.yqfnwy (mgr.34427) 6256 : cluster [DBG] pgmap v3559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:22.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:22 gibba020 bash[25448]: cluster 2021-03-10T15:51:21.570354+0000 mgr.gibba020.yqfnwy (mgr.34427) 6257 : cluster [DBG] pgmap v3560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:23.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:22 gibba013 bash[29418]: cluster 2021-03-10T15:51:21.570354+0000 mgr.gibba020.yqfnwy (mgr.34427) 6257 : cluster [DBG] pgmap v3560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:23.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:22 gibba013 bash[30381]: cluster 2021-03-10T15:51:21.570354+0000 mgr.gibba020.yqfnwy (mgr.34427) 6257 : cluster [DBG] pgmap v3560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:23.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:23 gibba020 bash[25448]: cephadm 2021-03-10T15:51:21.797885+0000 mgr.gibba020.yqfnwy (mgr.34427) 6258 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:51:24.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:23 gibba013 bash[29418]: cephadm 2021-03-10T15:51:21.797885+0000 mgr.gibba020.yqfnwy (mgr.34427) 6258 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:51:24.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:23 gibba013 bash[30381]: cephadm 2021-03-10T15:51:21.797885+0000 mgr.gibba020.yqfnwy (mgr.34427) 6258 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:51:24.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:24 gibba020 bash[25448]: cluster 2021-03-10T15:51:23.572004+0000 mgr.gibba020.yqfnwy (mgr.34427) 6259 : cluster [DBG] pgmap v3561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:25.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:24 gibba013 bash[29418]: cluster 2021-03-10T15:51:23.572004+0000 mgr.gibba020.yqfnwy (mgr.34427) 6259 : cluster [DBG] pgmap v3561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:25.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:24 gibba013 bash[30381]: cluster 2021-03-10T15:51:23.572004+0000 mgr.gibba020.yqfnwy (mgr.34427) 6259 : cluster [DBG] pgmap v3561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:26.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:26 gibba020 bash[25448]: cluster 2021-03-10T15:51:25.573641+0000 mgr.gibba020.yqfnwy (mgr.34427) 6260 : cluster [DBG] pgmap v3562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:27.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:26 gibba013 bash[29418]: cluster 2021-03-10T15:51:25.573641+0000 mgr.gibba020.yqfnwy (mgr.34427) 6260 : cluster [DBG] pgmap v3562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:27.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:26 gibba013 bash[30381]: cluster 2021-03-10T15:51:25.573641+0000 mgr.gibba020.yqfnwy (mgr.34427) 6260 : cluster [DBG] pgmap v3562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:28.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:28 gibba020 bash[25448]: cluster 2021-03-10T15:51:27.575034+0000 mgr.gibba020.yqfnwy (mgr.34427) 6261 : cluster [DBG] pgmap v3563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:29.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:28 gibba013 bash[29418]: cluster 2021-03-10T15:51:27.575034+0000 mgr.gibba020.yqfnwy (mgr.34427) 6261 : cluster [DBG] pgmap v3563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:29.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:28 gibba013 bash[30381]: cluster 2021-03-10T15:51:27.575034+0000 mgr.gibba020.yqfnwy (mgr.34427) 6261 : cluster [DBG] pgmap v3563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:30.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:30 gibba020 bash[25448]: cluster 2021-03-10T15:51:29.576545+0000 mgr.gibba020.yqfnwy (mgr.34427) 6262 : cluster [DBG] pgmap v3564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:31.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:30 gibba013 bash[29418]: cluster 2021-03-10T15:51:29.576545+0000 mgr.gibba020.yqfnwy (mgr.34427) 6262 : cluster [DBG] pgmap v3564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:31.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:30 gibba013 bash[30381]: cluster 2021-03-10T15:51:29.576545+0000 mgr.gibba020.yqfnwy (mgr.34427) 6262 : cluster [DBG] pgmap v3564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:32.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:32 gibba020 bash[25448]: cluster 2021-03-10T15:51:31.578322+0000 mgr.gibba020.yqfnwy (mgr.34427) 6263 : cluster [DBG] pgmap v3565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:33.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:32 gibba013 bash[30381]: cluster 2021-03-10T15:51:31.578322+0000 mgr.gibba020.yqfnwy (mgr.34427) 6263 : cluster [DBG] pgmap v3565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:33.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:32 gibba013 bash[29418]: cluster 2021-03-10T15:51:31.578322+0000 mgr.gibba020.yqfnwy (mgr.34427) 6263 : cluster [DBG] pgmap v3565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:34.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:34 gibba020 bash[25448]: cluster 2021-03-10T15:51:33.580004+0000 mgr.gibba020.yqfnwy (mgr.34427) 6264 : cluster [DBG] pgmap v3566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:34.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:34 gibba013 bash[29418]: cluster 2021-03-10T15:51:33.580004+0000 mgr.gibba020.yqfnwy (mgr.34427) 6264 : cluster [DBG] pgmap v3566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:34.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:34 gibba013 bash[30381]: cluster 2021-03-10T15:51:33.580004+0000 mgr.gibba020.yqfnwy (mgr.34427) 6264 : cluster [DBG] pgmap v3566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:36.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:36 gibba020 bash[25448]: cluster 2021-03-10T15:51:35.581401+0000 mgr.gibba020.yqfnwy (mgr.34427) 6265 : cluster [DBG] pgmap v3567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:37.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:36 gibba013 bash[29418]: cluster 2021-03-10T15:51:35.581401+0000 mgr.gibba020.yqfnwy (mgr.34427) 6265 : cluster [DBG] pgmap v3567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:37.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:36 gibba013 bash[30381]: cluster 2021-03-10T15:51:35.581401+0000 mgr.gibba020.yqfnwy (mgr.34427) 6265 : cluster [DBG] pgmap v3567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:38.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:38 gibba020 bash[25448]: cephadm 2021-03-10T15:51:36.812905+0000 mgr.gibba020.yqfnwy (mgr.34427) 6266 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:51:38.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:38 gibba020 bash[25448]: cluster 2021-03-10T15:51:37.582665+0000 mgr.gibba020.yqfnwy (mgr.34427) 6267 : cluster [DBG] pgmap v3568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:39.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:38 gibba013 bash[29418]: cephadm 2021-03-10T15:51:36.812905+0000 mgr.gibba020.yqfnwy (mgr.34427) 6266 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:51:39.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:38 gibba013 bash[29418]: cluster 2021-03-10T15:51:37.582665+0000 mgr.gibba020.yqfnwy (mgr.34427) 6267 : cluster [DBG] pgmap v3568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:39.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:38 gibba013 bash[30381]: cephadm 2021-03-10T15:51:36.812905+0000 mgr.gibba020.yqfnwy (mgr.34427) 6266 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:51:39.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:38 gibba013 bash[30381]: cluster 2021-03-10T15:51:37.582665+0000 mgr.gibba020.yqfnwy (mgr.34427) 6267 : cluster [DBG] pgmap v3568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:39.139 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:51:39.381 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:51:39.381 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (118m) 116s ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:51:39.381 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 52s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:51:39.382 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (118m) 52s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:51:39.382 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (118m) 52s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:51:39.382 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (117m) 116s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:51:39.382 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (117m) 116s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:51:39.383 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (117m) 52s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:51:39.383 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (117m) 116s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:51:39.383 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 116s ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:51:39.383 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 52s ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:51:39.384 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (116m) 116s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:51:39.384 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (116m) 116s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:51:39.384 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (115m) 116s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:51:39.384 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (115m) 116s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:51:39.384 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (114m) 52s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:51:39.385 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (114m) 52s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:51:39.385 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (113m) 52s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:51:39.385 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (113m) 52s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:51:39.385 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 52s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:51:39.386 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 52s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:51:39.629 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:51:39.630 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:51:39.630 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:51:39.630 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:51:39.631 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:51:39.631 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:51:39.631 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:51:39.631 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:51:39.631 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:51:39.632 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:51:39.632 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:51:39.632 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:51:39.632 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:51:39.633 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:51:39.633 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:51:39.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:39 gibba020 bash[25448]: audit 2021-03-10T15:51:39.628340+0000 mon.c (mon.1) 103 : audit [DBG] from='client.? 172.21.2.113:0/756957126' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:40.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:39 gibba013 bash[29418]: audit 2021-03-10T15:51:39.628340+0000 mon.c (mon.1) 103 : audit [DBG] from='client.? 172.21.2.113:0/756957126' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:40.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:39 gibba013 bash[30381]: audit 2021-03-10T15:51:39.628340+0000 mon.c (mon.1) 103 : audit [DBG] from='client.? 172.21.2.113:0/756957126' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:40.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:40 gibba020 bash[25448]: audit 2021-03-10T15:51:39.119212+0000 mgr.gibba020.yqfnwy (mgr.34427) 6268 : audit [DBG] from='client.58249 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:51:40.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:40 gibba020 bash[25448]: audit 2021-03-10T15:51:39.366080+0000 mgr.gibba020.yqfnwy (mgr.34427) 6269 : audit [DBG] from='client.48270 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:51:40.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:40 gibba020 bash[25448]: cluster 2021-03-10T15:51:39.584180+0000 mgr.gibba020.yqfnwy (mgr.34427) 6270 : cluster [DBG] pgmap v3569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:41.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:40 gibba013 bash[29418]: audit 2021-03-10T15:51:39.119212+0000 mgr.gibba020.yqfnwy (mgr.34427) 6268 : audit [DBG] from='client.58249 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:51:41.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:40 gibba013 bash[29418]: audit 2021-03-10T15:51:39.366080+0000 mgr.gibba020.yqfnwy (mgr.34427) 6269 : audit [DBG] from='client.48270 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:51:41.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:40 gibba013 bash[29418]: cluster 2021-03-10T15:51:39.584180+0000 mgr.gibba020.yqfnwy (mgr.34427) 6270 : cluster [DBG] pgmap v3569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:41.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:40 gibba013 bash[30381]: audit 2021-03-10T15:51:39.119212+0000 mgr.gibba020.yqfnwy (mgr.34427) 6268 : audit [DBG] from='client.58249 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:51:41.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:40 gibba013 bash[30381]: audit 2021-03-10T15:51:39.366080+0000 mgr.gibba020.yqfnwy (mgr.34427) 6269 : audit [DBG] from='client.48270 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:51:41.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:40 gibba013 bash[30381]: cluster 2021-03-10T15:51:39.584180+0000 mgr.gibba020.yqfnwy (mgr.34427) 6270 : cluster [DBG] pgmap v3569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:42.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:42 gibba020 bash[25448]: cluster 2021-03-10T15:51:41.585900+0000 mgr.gibba020.yqfnwy (mgr.34427) 6271 : cluster [DBG] pgmap v3570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:43.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:42 gibba013 bash[29418]: cluster 2021-03-10T15:51:41.585900+0000 mgr.gibba020.yqfnwy (mgr.34427) 6271 : cluster [DBG] pgmap v3570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:43.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:42 gibba013 bash[30381]: cluster 2021-03-10T15:51:41.585900+0000 mgr.gibba020.yqfnwy (mgr.34427) 6271 : cluster [DBG] pgmap v3570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:44.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:44 gibba020 bash[25448]: cluster 2021-03-10T15:51:43.587598+0000 mgr.gibba020.yqfnwy (mgr.34427) 6272 : cluster [DBG] pgmap v3571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:44.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:44 gibba013 bash[29418]: cluster 2021-03-10T15:51:43.587598+0000 mgr.gibba020.yqfnwy (mgr.34427) 6272 : cluster [DBG] pgmap v3571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:44.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:44 gibba013 bash[30381]: cluster 2021-03-10T15:51:43.587598+0000 mgr.gibba020.yqfnwy (mgr.34427) 6272 : cluster [DBG] pgmap v3571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:46.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:46 gibba020 bash[25448]: cluster 2021-03-10T15:51:45.589436+0000 mgr.gibba020.yqfnwy (mgr.34427) 6273 : cluster [DBG] pgmap v3572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:47.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:46 gibba013 bash[29418]: cluster 2021-03-10T15:51:45.589436+0000 mgr.gibba020.yqfnwy (mgr.34427) 6273 : cluster [DBG] pgmap v3572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:47.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:46 gibba013 bash[30381]: cluster 2021-03-10T15:51:45.589436+0000 mgr.gibba020.yqfnwy (mgr.34427) 6273 : cluster [DBG] pgmap v3572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:48.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:48 gibba020 bash[25448]: cluster 2021-03-10T15:51:47.590924+0000 mgr.gibba020.yqfnwy (mgr.34427) 6274 : cluster [DBG] pgmap v3573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:49.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:48 gibba013 bash[29418]: cluster 2021-03-10T15:51:47.590924+0000 mgr.gibba020.yqfnwy (mgr.34427) 6274 : cluster [DBG] pgmap v3573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:49.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:48 gibba013 bash[30381]: cluster 2021-03-10T15:51:47.590924+0000 mgr.gibba020.yqfnwy (mgr.34427) 6274 : cluster [DBG] pgmap v3573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:50.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:50 gibba020 bash[25448]: cluster 2021-03-10T15:51:49.592508+0000 mgr.gibba020.yqfnwy (mgr.34427) 6275 : cluster [DBG] pgmap v3574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:51.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:50 gibba013 bash[29418]: cluster 2021-03-10T15:51:49.592508+0000 mgr.gibba020.yqfnwy (mgr.34427) 6275 : cluster [DBG] pgmap v3574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:51.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:50 gibba013 bash[30381]: cluster 2021-03-10T15:51:49.592508+0000 mgr.gibba020.yqfnwy (mgr.34427) 6275 : cluster [DBG] pgmap v3574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:52.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:52 gibba020 bash[25448]: cluster 2021-03-10T15:51:51.594092+0000 mgr.gibba020.yqfnwy (mgr.34427) 6276 : cluster [DBG] pgmap v3575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:52.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:52 gibba020 bash[25448]: audit 2021-03-10T15:51:51.830918+0000 mon.a (mon.0) 2450 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:51:52.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:52 gibba020 bash[25448]: audit 2021-03-10T15:51:52.055427+0000 mon.a (mon.0) 2451 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:51:52.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:52 gibba020 bash[25448]: audit 2021-03-10T15:51:52.058865+0000 mon.a (mon.0) 2452 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:51:52.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:52 gibba020 bash[25448]: audit 2021-03-10T15:51:52.060409+0000 mon.a (mon.0) 2453 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:52.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:52 gibba020 bash[25448]: audit 2021-03-10T15:51:52.061993+0000 mon.a (mon.0) 2454 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:52.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:52 gibba020 bash[25448]: audit 2021-03-10T15:51:52.063379+0000 mon.a (mon.0) 2455 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:52.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:52 gibba020 bash[25448]: audit 2021-03-10T15:51:52.065864+0000 mon.a (mon.0) 2456 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:52.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:52 gibba020 bash[25448]: audit 2021-03-10T15:51:52.067471+0000 mon.a (mon.0) 2457 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:53.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:52 gibba013 bash[29418]: cluster 2021-03-10T15:51:51.594092+0000 mgr.gibba020.yqfnwy (mgr.34427) 6276 : cluster [DBG] pgmap v3575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:53.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:52 gibba013 bash[29418]: audit 2021-03-10T15:51:51.830918+0000 mon.a (mon.0) 2450 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:51:53.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:52 gibba013 bash[29418]: audit 2021-03-10T15:51:52.055427+0000 mon.a (mon.0) 2451 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:51:53.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:52 gibba013 bash[29418]: audit 2021-03-10T15:51:52.058865+0000 mon.a (mon.0) 2452 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:51:53.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:52 gibba013 bash[29418]: audit 2021-03-10T15:51:52.060409+0000 mon.a (mon.0) 2453 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:53.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:52 gibba013 bash[29418]: audit 2021-03-10T15:51:52.061993+0000 mon.a (mon.0) 2454 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:53.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:52 gibba013 bash[29418]: audit 2021-03-10T15:51:52.063379+0000 mon.a (mon.0) 2455 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:53.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:52 gibba013 bash[29418]: audit 2021-03-10T15:51:52.065864+0000 mon.a (mon.0) 2456 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:53.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:52 gibba013 bash[29418]: audit 2021-03-10T15:51:52.067471+0000 mon.a (mon.0) 2457 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:53.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:52 gibba013 bash[30381]: cluster 2021-03-10T15:51:51.594092+0000 mgr.gibba020.yqfnwy (mgr.34427) 6276 : cluster [DBG] pgmap v3575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:53.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:52 gibba013 bash[30381]: audit 2021-03-10T15:51:51.830918+0000 mon.a (mon.0) 2450 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:51:53.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:52 gibba013 bash[30381]: audit 2021-03-10T15:51:52.055427+0000 mon.a (mon.0) 2451 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:51:53.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:52 gibba013 bash[30381]: audit 2021-03-10T15:51:52.058865+0000 mon.a (mon.0) 2452 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:51:53.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:52 gibba013 bash[30381]: audit 2021-03-10T15:51:52.060409+0000 mon.a (mon.0) 2453 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:53.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:52 gibba013 bash[30381]: audit 2021-03-10T15:51:52.061993+0000 mon.a (mon.0) 2454 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:53.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:52 gibba013 bash[30381]: audit 2021-03-10T15:51:52.063379+0000 mon.a (mon.0) 2455 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:53.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:52 gibba013 bash[30381]: audit 2021-03-10T15:51:52.065864+0000 mon.a (mon.0) 2456 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:53.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:52 gibba013 bash[30381]: audit 2021-03-10T15:51:52.067471+0000 mon.a (mon.0) 2457 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:51:53.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:53 gibba020 bash[25448]: cephadm 2021-03-10T15:51:51.834575+0000 mgr.gibba020.yqfnwy (mgr.34427) 6277 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:51:53.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:53 gibba020 bash[25448]: cephadm 2021-03-10T15:51:51.836772+0000 mgr.gibba020.yqfnwy (mgr.34427) 6278 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:51:53.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:53 gibba020 bash[25448]: cephadm 2021-03-10T15:51:52.056827+0000 mgr.gibba020.yqfnwy (mgr.34427) 6279 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:51:53.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:53 gibba020 bash[25448]: cephadm 2021-03-10T15:51:52.058633+0000 mgr.gibba020.yqfnwy (mgr.34427) 6280 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:51:53.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:53 gibba020 bash[25448]: cephadm 2021-03-10T15:51:52.060212+0000 mgr.gibba020.yqfnwy (mgr.34427) 6281 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:51:53.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:53 gibba020 bash[25448]: cephadm 2021-03-10T15:51:52.060251+0000 mgr.gibba020.yqfnwy (mgr.34427) 6282 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:51:53.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:53 gibba020 bash[25448]: cephadm 2021-03-10T15:51:52.061668+0000 mgr.gibba020.yqfnwy (mgr.34427) 6283 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:51:53.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:53 gibba020 bash[25448]: cephadm 2021-03-10T15:51:52.061706+0000 mgr.gibba020.yqfnwy (mgr.34427) 6284 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:51:53.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:53 gibba020 bash[25448]: cephadm 2021-03-10T15:51:52.062906+0000 mgr.gibba020.yqfnwy (mgr.34427) 6285 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:51:53.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:53 gibba020 bash[25448]: cephadm 2021-03-10T15:51:52.064047+0000 mgr.gibba020.yqfnwy (mgr.34427) 6286 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:51:53.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:53 gibba020 bash[25448]: cephadm 2021-03-10T15:51:52.064085+0000 mgr.gibba020.yqfnwy (mgr.34427) 6287 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:51:53.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:53 gibba020 bash[25448]: cephadm 2021-03-10T15:51:52.065489+0000 mgr.gibba020.yqfnwy (mgr.34427) 6288 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:51:53.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:53 gibba020 bash[25448]: cephadm 2021-03-10T15:51:52.065807+0000 mgr.gibba020.yqfnwy (mgr.34427) 6289 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:51:53.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:53 gibba020 bash[25448]: cephadm 2021-03-10T15:51:52.067082+0000 mgr.gibba020.yqfnwy (mgr.34427) 6290 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:51:53.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:53 gibba020 bash[25448]: cephadm 2021-03-10T15:51:52.067119+0000 mgr.gibba020.yqfnwy (mgr.34427) 6291 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:51:53.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:53 gibba020 bash[25448]: cephadm 2021-03-10T15:51:52.067222+0000 mgr.gibba020.yqfnwy (mgr.34427) 6292 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:51:54.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:53 gibba013 bash[29418]: cephadm 2021-03-10T15:51:51.834575+0000 mgr.gibba020.yqfnwy (mgr.34427) 6277 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:51:54.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:53 gibba013 bash[29418]: cephadm 2021-03-10T15:51:51.836772+0000 mgr.gibba020.yqfnwy (mgr.34427) 6278 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:51:54.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:53 gibba013 bash[29418]: cephadm 2021-03-10T15:51:52.056827+0000 mgr.gibba020.yqfnwy (mgr.34427) 6279 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:51:54.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:53 gibba013 bash[29418]: cephadm 2021-03-10T15:51:52.058633+0000 mgr.gibba020.yqfnwy (mgr.34427) 6280 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:51:54.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:53 gibba013 bash[29418]: cephadm 2021-03-10T15:51:52.060212+0000 mgr.gibba020.yqfnwy (mgr.34427) 6281 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:51:54.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:53 gibba013 bash[29418]: cephadm 2021-03-10T15:51:52.060251+0000 mgr.gibba020.yqfnwy (mgr.34427) 6282 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:51:54.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:53 gibba013 bash[29418]: cephadm 2021-03-10T15:51:52.061668+0000 mgr.gibba020.yqfnwy (mgr.34427) 6283 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:51:54.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:53 gibba013 bash[29418]: cephadm 2021-03-10T15:51:52.061706+0000 mgr.gibba020.yqfnwy (mgr.34427) 6284 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:51:54.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:53 gibba013 bash[29418]: cephadm 2021-03-10T15:51:52.062906+0000 mgr.gibba020.yqfnwy (mgr.34427) 6285 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:51:54.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:53 gibba013 bash[29418]: cephadm 2021-03-10T15:51:52.064047+0000 mgr.gibba020.yqfnwy (mgr.34427) 6286 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:51:54.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:53 gibba013 bash[29418]: cephadm 2021-03-10T15:51:52.064085+0000 mgr.gibba020.yqfnwy (mgr.34427) 6287 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:51:54.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:53 gibba013 bash[29418]: cephadm 2021-03-10T15:51:52.065489+0000 mgr.gibba020.yqfnwy (mgr.34427) 6288 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:51:54.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:53 gibba013 bash[29418]: cephadm 2021-03-10T15:51:52.065807+0000 mgr.gibba020.yqfnwy (mgr.34427) 6289 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:51:54.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:53 gibba013 bash[29418]: cephadm 2021-03-10T15:51:52.067082+0000 mgr.gibba020.yqfnwy (mgr.34427) 6290 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:51:54.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:53 gibba013 bash[29418]: cephadm 2021-03-10T15:51:52.067119+0000 mgr.gibba020.yqfnwy (mgr.34427) 6291 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:51:54.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:53 gibba013 bash[29418]: cephadm 2021-03-10T15:51:52.067222+0000 mgr.gibba020.yqfnwy (mgr.34427) 6292 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:51:54.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:53 gibba013 bash[30381]: cephadm 2021-03-10T15:51:51.834575+0000 mgr.gibba020.yqfnwy (mgr.34427) 6277 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:51:54.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:53 gibba013 bash[30381]: cephadm 2021-03-10T15:51:51.836772+0000 mgr.gibba020.yqfnwy (mgr.34427) 6278 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:51:54.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:53 gibba013 bash[30381]: cephadm 2021-03-10T15:51:52.056827+0000 mgr.gibba020.yqfnwy (mgr.34427) 6279 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:51:54.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:53 gibba013 bash[30381]: cephadm 2021-03-10T15:51:52.058633+0000 mgr.gibba020.yqfnwy (mgr.34427) 6280 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:51:54.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:53 gibba013 bash[30381]: cephadm 2021-03-10T15:51:52.060212+0000 mgr.gibba020.yqfnwy (mgr.34427) 6281 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:51:54.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:53 gibba013 bash[30381]: cephadm 2021-03-10T15:51:52.060251+0000 mgr.gibba020.yqfnwy (mgr.34427) 6282 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:51:54.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:53 gibba013 bash[30381]: cephadm 2021-03-10T15:51:52.061668+0000 mgr.gibba020.yqfnwy (mgr.34427) 6283 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:51:54.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:53 gibba013 bash[30381]: cephadm 2021-03-10T15:51:52.061706+0000 mgr.gibba020.yqfnwy (mgr.34427) 6284 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:51:54.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:53 gibba013 bash[30381]: cephadm 2021-03-10T15:51:52.062906+0000 mgr.gibba020.yqfnwy (mgr.34427) 6285 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:51:54.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:53 gibba013 bash[30381]: cephadm 2021-03-10T15:51:52.064047+0000 mgr.gibba020.yqfnwy (mgr.34427) 6286 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:51:54.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:53 gibba013 bash[30381]: cephadm 2021-03-10T15:51:52.064085+0000 mgr.gibba020.yqfnwy (mgr.34427) 6287 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:51:54.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:53 gibba013 bash[30381]: cephadm 2021-03-10T15:51:52.065489+0000 mgr.gibba020.yqfnwy (mgr.34427) 6288 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:51:54.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:53 gibba013 bash[30381]: cephadm 2021-03-10T15:51:52.065807+0000 mgr.gibba020.yqfnwy (mgr.34427) 6289 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:51:54.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:53 gibba013 bash[30381]: cephadm 2021-03-10T15:51:52.067082+0000 mgr.gibba020.yqfnwy (mgr.34427) 6290 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:51:54.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:53 gibba013 bash[30381]: cephadm 2021-03-10T15:51:52.067119+0000 mgr.gibba020.yqfnwy (mgr.34427) 6291 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:51:54.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:53 gibba013 bash[30381]: cephadm 2021-03-10T15:51:52.067222+0000 mgr.gibba020.yqfnwy (mgr.34427) 6292 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:51:54.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:54 gibba020 bash[25448]: cluster 2021-03-10T15:51:53.595784+0000 mgr.gibba020.yqfnwy (mgr.34427) 6293 : cluster [DBG] pgmap v3576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:55.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:54 gibba013 bash[29418]: cluster 2021-03-10T15:51:53.595784+0000 mgr.gibba020.yqfnwy (mgr.34427) 6293 : cluster [DBG] pgmap v3576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:55.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:54 gibba013 bash[30381]: cluster 2021-03-10T15:51:53.595784+0000 mgr.gibba020.yqfnwy (mgr.34427) 6293 : cluster [DBG] pgmap v3576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:56.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:56 gibba020 bash[25448]: cluster 2021-03-10T15:51:55.597298+0000 mgr.gibba020.yqfnwy (mgr.34427) 6294 : cluster [DBG] pgmap v3577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:57.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:56 gibba013 bash[29418]: cluster 2021-03-10T15:51:55.597298+0000 mgr.gibba020.yqfnwy (mgr.34427) 6294 : cluster [DBG] pgmap v3577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:57.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:56 gibba013 bash[30381]: cluster 2021-03-10T15:51:55.597298+0000 mgr.gibba020.yqfnwy (mgr.34427) 6294 : cluster [DBG] pgmap v3577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:59.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:51:58 gibba013 bash[29418]: cluster 2021-03-10T15:51:57.598656+0000 mgr.gibba020.yqfnwy (mgr.34427) 6295 : cluster [DBG] pgmap v3578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:59.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:51:58 gibba013 bash[30381]: cluster 2021-03-10T15:51:57.598656+0000 mgr.gibba020.yqfnwy (mgr.34427) 6295 : cluster [DBG] pgmap v3578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:51:59.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:51:58 gibba020 bash[25448]: cluster 2021-03-10T15:51:57.598656+0000 mgr.gibba020.yqfnwy (mgr.34427) 6295 : cluster [DBG] pgmap v3578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:01.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:00 gibba013 bash[29418]: cluster 2021-03-10T15:51:59.600219+0000 mgr.gibba020.yqfnwy (mgr.34427) 6296 : cluster [DBG] pgmap v3579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:01.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:00 gibba013 bash[30381]: cluster 2021-03-10T15:51:59.600219+0000 mgr.gibba020.yqfnwy (mgr.34427) 6296 : cluster [DBG] pgmap v3579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:01.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:00 gibba020 bash[25448]: cluster 2021-03-10T15:51:59.600219+0000 mgr.gibba020.yqfnwy (mgr.34427) 6296 : cluster [DBG] pgmap v3579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:03.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:02 gibba013 bash[29418]: cluster 2021-03-10T15:52:01.602053+0000 mgr.gibba020.yqfnwy (mgr.34427) 6297 : cluster [DBG] pgmap v3580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:03.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:02 gibba013 bash[30381]: cluster 2021-03-10T15:52:01.602053+0000 mgr.gibba020.yqfnwy (mgr.34427) 6297 : cluster [DBG] pgmap v3580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:03.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:02 gibba020 bash[25448]: cluster 2021-03-10T15:52:01.602053+0000 mgr.gibba020.yqfnwy (mgr.34427) 6297 : cluster [DBG] pgmap v3580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:04.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:04 gibba020 bash[25448]: cluster 2021-03-10T15:52:03.603462+0000 mgr.gibba020.yqfnwy (mgr.34427) 6298 : cluster [DBG] pgmap v3581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:04.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:04 gibba013 bash[29418]: cluster 2021-03-10T15:52:03.603462+0000 mgr.gibba020.yqfnwy (mgr.34427) 6298 : cluster [DBG] pgmap v3581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:04.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:04 gibba013 bash[30381]: cluster 2021-03-10T15:52:03.603462+0000 mgr.gibba020.yqfnwy (mgr.34427) 6298 : cluster [DBG] pgmap v3581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:06.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:06 gibba020 bash[25448]: cluster 2021-03-10T15:52:05.605167+0000 mgr.gibba020.yqfnwy (mgr.34427) 6299 : cluster [DBG] pgmap v3582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:06.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:06 gibba020 bash[25448]: audit 2021-03-10T15:52:06.570496+0000 mon.a (mon.0) 2458 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:52:06.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:06 gibba020 bash[25448]: audit 2021-03-10T15:52:06.654993+0000 mon.a (mon.0) 2459 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:52:07.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:06 gibba013 bash[29418]: cluster 2021-03-10T15:52:05.605167+0000 mgr.gibba020.yqfnwy (mgr.34427) 6299 : cluster [DBG] pgmap v3582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:06 gibba013 bash[29418]: audit 2021-03-10T15:52:06.570496+0000 mon.a (mon.0) 2458 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:52:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:06 gibba013 bash[29418]: audit 2021-03-10T15:52:06.654993+0000 mon.a (mon.0) 2459 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:52:07.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:06 gibba013 bash[30381]: cluster 2021-03-10T15:52:05.605167+0000 mgr.gibba020.yqfnwy (mgr.34427) 6299 : cluster [DBG] pgmap v3582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:07.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:06 gibba013 bash[30381]: audit 2021-03-10T15:52:06.570496+0000 mon.a (mon.0) 2458 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:52:07.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:06 gibba013 bash[30381]: audit 2021-03-10T15:52:06.654993+0000 mon.a (mon.0) 2459 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:52:07.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:07 gibba020 bash[25448]: audit 2021-03-10T15:52:06.799635+0000 mon.a (mon.0) 2460 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:52:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:07 gibba020 bash[25448]: audit 2021-03-10T15:52:06.800439+0000 mon.a (mon.0) 2461 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:52:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:07 gibba020 bash[25448]: audit 2021-03-10T15:52:06.801099+0000 mon.a (mon.0) 2462 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:52:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:07 gibba020 bash[25448]: audit 2021-03-10T15:52:06.801796+0000 mon.a (mon.0) 2463 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:52:08.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:07 gibba013 bash[30381]: audit 2021-03-10T15:52:06.799635+0000 mon.a (mon.0) 2460 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:52:08.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:07 gibba013 bash[30381]: audit 2021-03-10T15:52:06.800439+0000 mon.a (mon.0) 2461 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:52:08.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:07 gibba013 bash[30381]: audit 2021-03-10T15:52:06.801099+0000 mon.a (mon.0) 2462 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:52:08.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:07 gibba013 bash[30381]: audit 2021-03-10T15:52:06.801796+0000 mon.a (mon.0) 2463 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:52:08.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:07 gibba013 bash[29418]: audit 2021-03-10T15:52:06.799635+0000 mon.a (mon.0) 2460 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:52:08.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:07 gibba013 bash[29418]: audit 2021-03-10T15:52:06.800439+0000 mon.a (mon.0) 2461 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:52:08.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:07 gibba013 bash[29418]: audit 2021-03-10T15:52:06.801099+0000 mon.a (mon.0) 2462 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:52:08.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:07 gibba013 bash[29418]: audit 2021-03-10T15:52:06.801796+0000 mon.a (mon.0) 2463 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:52:08.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:08 gibba020 bash[25448]: cephadm 2021-03-10T15:52:07.083160+0000 mgr.gibba020.yqfnwy (mgr.34427) 6300 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:52:08.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:08 gibba020 bash[25448]: cluster 2021-03-10T15:52:07.606581+0000 mgr.gibba020.yqfnwy (mgr.34427) 6301 : cluster [DBG] pgmap v3583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:09.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:08 gibba013 bash[29418]: cephadm 2021-03-10T15:52:07.083160+0000 mgr.gibba020.yqfnwy (mgr.34427) 6300 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:52:09.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:08 gibba013 bash[29418]: cluster 2021-03-10T15:52:07.606581+0000 mgr.gibba020.yqfnwy (mgr.34427) 6301 : cluster [DBG] pgmap v3583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:09.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:08 gibba013 bash[30381]: cephadm 2021-03-10T15:52:07.083160+0000 mgr.gibba020.yqfnwy (mgr.34427) 6300 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:52:09.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:08 gibba013 bash[30381]: cluster 2021-03-10T15:52:07.606581+0000 mgr.gibba020.yqfnwy (mgr.34427) 6301 : cluster [DBG] pgmap v3583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:09.874 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:52:10.099 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:52:10.099 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (118m) 2m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:52:10.100 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 83s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:52:10.100 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (119m) 83s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:52:10.100 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (119m) 83s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:52:10.100 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (118m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:52:10.101 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (118m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:52:10.101 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (117m) 83s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:52:10.101 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (117m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:52:10.101 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:52:10.102 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 83s ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:52:10.102 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (116m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:52:10.102 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (116m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:52:10.102 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (116m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:52:10.102 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (115m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:52:10.103 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (115m) 83s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:52:10.103 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (114m) 83s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:52:10.103 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (114m) 83s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:52:10.103 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (113m) 83s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:52:10.104 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 83s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:52:10.104 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 83s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:52:10.350 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:52:10.350 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:52:10.351 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:52:10.351 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:52:10.351 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:52:10.351 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:52:10.352 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:52:10.352 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:52:10.352 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:52:10.352 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:52:10.352 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:52:10.353 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:52:10.353 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:52:10.353 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:52:10.353 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:52:10.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:10 gibba020 bash[25448]: cluster 2021-03-10T15:52:09.608191+0000 mgr.gibba020.yqfnwy (mgr.34427) 6302 : cluster [DBG] pgmap v3584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:10.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:10 gibba020 bash[25448]: audit 2021-03-10T15:52:10.349084+0000 mon.a (mon.0) 2464 : audit [DBG] from='client.? 172.21.2.113:0/2367280122' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:11.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:10 gibba013 bash[29418]: cluster 2021-03-10T15:52:09.608191+0000 mgr.gibba020.yqfnwy (mgr.34427) 6302 : cluster [DBG] pgmap v3584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:11.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:10 gibba013 bash[29418]: audit 2021-03-10T15:52:10.349084+0000 mon.a (mon.0) 2464 : audit [DBG] from='client.? 172.21.2.113:0/2367280122' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:11.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:10 gibba013 bash[30381]: cluster 2021-03-10T15:52:09.608191+0000 mgr.gibba020.yqfnwy (mgr.34427) 6302 : cluster [DBG] pgmap v3584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:11.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:10 gibba013 bash[30381]: audit 2021-03-10T15:52:10.349084+0000 mon.a (mon.0) 2464 : audit [DBG] from='client.? 172.21.2.113:0/2367280122' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:12.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:11 gibba013 bash[29418]: audit 2021-03-10T15:52:09.862863+0000 mgr.gibba020.yqfnwy (mgr.34427) 6303 : audit [DBG] from='client.48282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:52:12.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:11 gibba013 bash[29418]: audit 2021-03-10T15:52:10.084986+0000 mgr.gibba020.yqfnwy (mgr.34427) 6304 : audit [DBG] from='client.48288 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:52:12.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:11 gibba013 bash[30381]: audit 2021-03-10T15:52:09.862863+0000 mgr.gibba020.yqfnwy (mgr.34427) 6303 : audit [DBG] from='client.48282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:52:12.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:11 gibba013 bash[30381]: audit 2021-03-10T15:52:10.084986+0000 mgr.gibba020.yqfnwy (mgr.34427) 6304 : audit [DBG] from='client.48288 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:52:12.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:11 gibba020 bash[25448]: audit 2021-03-10T15:52:09.862863+0000 mgr.gibba020.yqfnwy (mgr.34427) 6303 : audit [DBG] from='client.48282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:52:12.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:11 gibba020 bash[25448]: audit 2021-03-10T15:52:10.084986+0000 mgr.gibba020.yqfnwy (mgr.34427) 6304 : audit [DBG] from='client.48288 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:52:13.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:12 gibba013 bash[29418]: cluster 2021-03-10T15:52:11.609767+0000 mgr.gibba020.yqfnwy (mgr.34427) 6305 : cluster [DBG] pgmap v3585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:13.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:12 gibba013 bash[30381]: cluster 2021-03-10T15:52:11.609767+0000 mgr.gibba020.yqfnwy (mgr.34427) 6305 : cluster [DBG] pgmap v3585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:13.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:12 gibba020 bash[25448]: cluster 2021-03-10T15:52:11.609767+0000 mgr.gibba020.yqfnwy (mgr.34427) 6305 : cluster [DBG] pgmap v3585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:14.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:14 gibba020 bash[25448]: cluster 2021-03-10T15:52:13.611473+0000 mgr.gibba020.yqfnwy (mgr.34427) 6306 : cluster [DBG] pgmap v3586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:14.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:14 gibba013 bash[29418]: cluster 2021-03-10T15:52:13.611473+0000 mgr.gibba020.yqfnwy (mgr.34427) 6306 : cluster [DBG] pgmap v3586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:14.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:14 gibba013 bash[30381]: cluster 2021-03-10T15:52:13.611473+0000 mgr.gibba020.yqfnwy (mgr.34427) 6306 : cluster [DBG] pgmap v3586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:16.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:16 gibba020 bash[25448]: cluster 2021-03-10T15:52:15.613202+0000 mgr.gibba020.yqfnwy (mgr.34427) 6307 : cluster [DBG] pgmap v3587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:17.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:16 gibba013 bash[29418]: cluster 2021-03-10T15:52:15.613202+0000 mgr.gibba020.yqfnwy (mgr.34427) 6307 : cluster [DBG] pgmap v3587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:17.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:16 gibba013 bash[30381]: cluster 2021-03-10T15:52:15.613202+0000 mgr.gibba020.yqfnwy (mgr.34427) 6307 : cluster [DBG] pgmap v3587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:18.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:18 gibba020 bash[25448]: cluster 2021-03-10T15:52:17.614638+0000 mgr.gibba020.yqfnwy (mgr.34427) 6308 : cluster [DBG] pgmap v3588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:19.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:18 gibba013 bash[29418]: cluster 2021-03-10T15:52:17.614638+0000 mgr.gibba020.yqfnwy (mgr.34427) 6308 : cluster [DBG] pgmap v3588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:19.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:18 gibba013 bash[30381]: cluster 2021-03-10T15:52:17.614638+0000 mgr.gibba020.yqfnwy (mgr.34427) 6308 : cluster [DBG] pgmap v3588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:20.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:20 gibba020 bash[25448]: cluster 2021-03-10T15:52:19.616136+0000 mgr.gibba020.yqfnwy (mgr.34427) 6309 : cluster [DBG] pgmap v3589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:21.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:20 gibba013 bash[29418]: cluster 2021-03-10T15:52:19.616136+0000 mgr.gibba020.yqfnwy (mgr.34427) 6309 : cluster [DBG] pgmap v3589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:21.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:20 gibba013 bash[30381]: cluster 2021-03-10T15:52:19.616136+0000 mgr.gibba020.yqfnwy (mgr.34427) 6309 : cluster [DBG] pgmap v3589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:23.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:22 gibba013 bash[29418]: cluster 2021-03-10T15:52:21.617933+0000 mgr.gibba020.yqfnwy (mgr.34427) 6310 : cluster [DBG] pgmap v3590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:23.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:22 gibba013 bash[30381]: cluster 2021-03-10T15:52:21.617933+0000 mgr.gibba020.yqfnwy (mgr.34427) 6310 : cluster [DBG] pgmap v3590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:23.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:22 gibba020 bash[25448]: cluster 2021-03-10T15:52:21.617933+0000 mgr.gibba020.yqfnwy (mgr.34427) 6310 : cluster [DBG] pgmap v3590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:24.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:23 gibba013 bash[29418]: cephadm 2021-03-10T15:52:22.093680+0000 mgr.gibba020.yqfnwy (mgr.34427) 6311 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:52:24.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:23 gibba013 bash[30381]: cephadm 2021-03-10T15:52:22.093680+0000 mgr.gibba020.yqfnwy (mgr.34427) 6311 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:52:24.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:23 gibba020 bash[25448]: cephadm 2021-03-10T15:52:22.093680+0000 mgr.gibba020.yqfnwy (mgr.34427) 6311 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:52:25.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:24 gibba013 bash[29418]: cluster 2021-03-10T15:52:23.619324+0000 mgr.gibba020.yqfnwy (mgr.34427) 6312 : cluster [DBG] pgmap v3591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:25.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:24 gibba013 bash[30381]: cluster 2021-03-10T15:52:23.619324+0000 mgr.gibba020.yqfnwy (mgr.34427) 6312 : cluster [DBG] pgmap v3591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:25.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:24 gibba020 bash[25448]: cluster 2021-03-10T15:52:23.619324+0000 mgr.gibba020.yqfnwy (mgr.34427) 6312 : cluster [DBG] pgmap v3591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:27.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:26 gibba013 bash[29418]: cluster 2021-03-10T15:52:25.621052+0000 mgr.gibba020.yqfnwy (mgr.34427) 6313 : cluster [DBG] pgmap v3592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:27.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:26 gibba013 bash[30381]: cluster 2021-03-10T15:52:25.621052+0000 mgr.gibba020.yqfnwy (mgr.34427) 6313 : cluster [DBG] pgmap v3592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:27.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:26 gibba020 bash[25448]: cluster 2021-03-10T15:52:25.621052+0000 mgr.gibba020.yqfnwy (mgr.34427) 6313 : cluster [DBG] pgmap v3592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:29.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:28 gibba013 bash[29418]: cluster 2021-03-10T15:52:27.622583+0000 mgr.gibba020.yqfnwy (mgr.34427) 6314 : cluster [DBG] pgmap v3593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:29.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:28 gibba013 bash[30381]: cluster 2021-03-10T15:52:27.622583+0000 mgr.gibba020.yqfnwy (mgr.34427) 6314 : cluster [DBG] pgmap v3593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:29.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:28 gibba020 bash[25448]: cluster 2021-03-10T15:52:27.622583+0000 mgr.gibba020.yqfnwy (mgr.34427) 6314 : cluster [DBG] pgmap v3593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:31.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:30 gibba013 bash[29418]: cluster 2021-03-10T15:52:29.624090+0000 mgr.gibba020.yqfnwy (mgr.34427) 6315 : cluster [DBG] pgmap v3594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:31.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:30 gibba013 bash[30381]: cluster 2021-03-10T15:52:29.624090+0000 mgr.gibba020.yqfnwy (mgr.34427) 6315 : cluster [DBG] pgmap v3594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:31.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:30 gibba020 bash[25448]: cluster 2021-03-10T15:52:29.624090+0000 mgr.gibba020.yqfnwy (mgr.34427) 6315 : cluster [DBG] pgmap v3594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:33.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:32 gibba013 bash[29418]: cluster 2021-03-10T15:52:31.624731+0000 mgr.gibba020.yqfnwy (mgr.34427) 6316 : cluster [DBG] pgmap v3595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:33.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:32 gibba013 bash[30381]: cluster 2021-03-10T15:52:31.624731+0000 mgr.gibba020.yqfnwy (mgr.34427) 6316 : cluster [DBG] pgmap v3595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:33.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:32 gibba020 bash[25448]: cluster 2021-03-10T15:52:31.624731+0000 mgr.gibba020.yqfnwy (mgr.34427) 6316 : cluster [DBG] pgmap v3595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:34.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:34 gibba020 bash[25448]: cluster 2021-03-10T15:52:33.626011+0000 mgr.gibba020.yqfnwy (mgr.34427) 6317 : cluster [DBG] pgmap v3596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:34.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:34 gibba013 bash[29418]: cluster 2021-03-10T15:52:33.626011+0000 mgr.gibba020.yqfnwy (mgr.34427) 6317 : cluster [DBG] pgmap v3596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:34.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:34 gibba013 bash[30381]: cluster 2021-03-10T15:52:33.626011+0000 mgr.gibba020.yqfnwy (mgr.34427) 6317 : cluster [DBG] pgmap v3596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:36.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:36 gibba020 bash[25448]: cluster 2021-03-10T15:52:35.627585+0000 mgr.gibba020.yqfnwy (mgr.34427) 6318 : cluster [DBG] pgmap v3597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:37.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:36 gibba013 bash[29418]: cluster 2021-03-10T15:52:35.627585+0000 mgr.gibba020.yqfnwy (mgr.34427) 6318 : cluster [DBG] pgmap v3597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:37.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:36 gibba013 bash[30381]: cluster 2021-03-10T15:52:35.627585+0000 mgr.gibba020.yqfnwy (mgr.34427) 6318 : cluster [DBG] pgmap v3597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:39.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:38 gibba013 bash[29418]: cephadm 2021-03-10T15:52:37.109745+0000 mgr.gibba020.yqfnwy (mgr.34427) 6319 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:52:39.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:38 gibba013 bash[29418]: cluster 2021-03-10T15:52:37.629101+0000 mgr.gibba020.yqfnwy (mgr.34427) 6320 : cluster [DBG] pgmap v3598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:39.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:38 gibba013 bash[30381]: cephadm 2021-03-10T15:52:37.109745+0000 mgr.gibba020.yqfnwy (mgr.34427) 6319 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:52:39.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:38 gibba013 bash[30381]: cluster 2021-03-10T15:52:37.629101+0000 mgr.gibba020.yqfnwy (mgr.34427) 6320 : cluster [DBG] pgmap v3598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:39.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:38 gibba020 bash[25448]: cephadm 2021-03-10T15:52:37.109745+0000 mgr.gibba020.yqfnwy (mgr.34427) 6319 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:52:39.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:38 gibba020 bash[25448]: cluster 2021-03-10T15:52:37.629101+0000 mgr.gibba020.yqfnwy (mgr.34427) 6320 : cluster [DBG] pgmap v3598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:40.593 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:52:40.827 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:52:40.827 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (119m) 2m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:52:40.827 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 114s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:52:40.827 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (119m) 114s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:52:40.828 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (119m) 114s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:52:40.828 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (118m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:52:40.828 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (118m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:52:40.828 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (118m) 114s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:52:40.829 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (118m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:52:40.829 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:52:40.829 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 114s ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:52:40.829 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (117m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:52:40.829 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (117m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:52:40.830 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (116m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:52:40.830 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (116m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:52:40.830 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (115m) 114s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:52:40.830 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (115m) 114s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:52:40.831 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (114m) 114s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:52:40.831 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (114m) 114s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:52:40.831 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 114s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:52:40.831 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 114s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:52:41.079 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:52:41.079 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:52:41.079 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:52:41.079 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:52:41.080 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:52:41.080 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:52:41.080 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:52:41.080 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:52:41.081 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:52:41.081 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:52:41.081 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:52:41.081 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:52:41.081 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:52:41.082 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:52:41.082 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:52:41.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:40 gibba013 bash[29418]: cluster 2021-03-10T15:52:39.630331+0000 mgr.gibba020.yqfnwy (mgr.34427) 6321 : cluster [DBG] pgmap v3599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:41.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:40 gibba013 bash[30381]: cluster 2021-03-10T15:52:39.630331+0000 mgr.gibba020.yqfnwy (mgr.34427) 6321 : cluster [DBG] pgmap v3599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:41.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:40 gibba020 bash[25448]: cluster 2021-03-10T15:52:39.630331+0000 mgr.gibba020.yqfnwy (mgr.34427) 6321 : cluster [DBG] pgmap v3599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:42.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:41 gibba013 bash[29418]: audit 2021-03-10T15:52:40.581613+0000 mgr.gibba020.yqfnwy (mgr.34427) 6322 : audit [DBG] from='client.48300 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:52:42.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:41 gibba013 bash[29418]: audit 2021-03-10T15:52:41.077836+0000 mon.a (mon.0) 2465 : audit [DBG] from='client.? 172.21.2.113:0/1615029377' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:42.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:41 gibba013 bash[30381]: audit 2021-03-10T15:52:40.581613+0000 mgr.gibba020.yqfnwy (mgr.34427) 6322 : audit [DBG] from='client.48300 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:52:42.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:41 gibba013 bash[30381]: audit 2021-03-10T15:52:41.077836+0000 mon.a (mon.0) 2465 : audit [DBG] from='client.? 172.21.2.113:0/1615029377' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:42.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:41 gibba020 bash[25448]: audit 2021-03-10T15:52:40.581613+0000 mgr.gibba020.yqfnwy (mgr.34427) 6322 : audit [DBG] from='client.48300 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:52:42.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:41 gibba020 bash[25448]: audit 2021-03-10T15:52:41.077836+0000 mon.a (mon.0) 2465 : audit [DBG] from='client.? 172.21.2.113:0/1615029377' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:43.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:42 gibba013 bash[29418]: audit 2021-03-10T15:52:40.811735+0000 mgr.gibba020.yqfnwy (mgr.34427) 6323 : audit [DBG] from='client.48306 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:52:43.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:42 gibba013 bash[29418]: cluster 2021-03-10T15:52:41.631912+0000 mgr.gibba020.yqfnwy (mgr.34427) 6324 : cluster [DBG] pgmap v3600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:43.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:42 gibba013 bash[30381]: audit 2021-03-10T15:52:40.811735+0000 mgr.gibba020.yqfnwy (mgr.34427) 6323 : audit [DBG] from='client.48306 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:52:43.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:42 gibba013 bash[30381]: cluster 2021-03-10T15:52:41.631912+0000 mgr.gibba020.yqfnwy (mgr.34427) 6324 : cluster [DBG] pgmap v3600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:43.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:42 gibba020 bash[25448]: audit 2021-03-10T15:52:40.811735+0000 mgr.gibba020.yqfnwy (mgr.34427) 6323 : audit [DBG] from='client.48306 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:52:43.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:42 gibba020 bash[25448]: cluster 2021-03-10T15:52:41.631912+0000 mgr.gibba020.yqfnwy (mgr.34427) 6324 : cluster [DBG] pgmap v3600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:44.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:44 gibba020 bash[25448]: cluster 2021-03-10T15:52:43.633566+0000 mgr.gibba020.yqfnwy (mgr.34427) 6325 : cluster [DBG] pgmap v3601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:44.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:44 gibba013 bash[29418]: cluster 2021-03-10T15:52:43.633566+0000 mgr.gibba020.yqfnwy (mgr.34427) 6325 : cluster [DBG] pgmap v3601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:44.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:44 gibba013 bash[30381]: cluster 2021-03-10T15:52:43.633566+0000 mgr.gibba020.yqfnwy (mgr.34427) 6325 : cluster [DBG] pgmap v3601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:47.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:46 gibba013 bash[29418]: cluster 2021-03-10T15:52:45.635261+0000 mgr.gibba020.yqfnwy (mgr.34427) 6326 : cluster [DBG] pgmap v3602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:47.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:46 gibba013 bash[30381]: cluster 2021-03-10T15:52:45.635261+0000 mgr.gibba020.yqfnwy (mgr.34427) 6326 : cluster [DBG] pgmap v3602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:47.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:46 gibba020 bash[25448]: cluster 2021-03-10T15:52:45.635261+0000 mgr.gibba020.yqfnwy (mgr.34427) 6326 : cluster [DBG] pgmap v3602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:49.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:48 gibba013 bash[29418]: cluster 2021-03-10T15:52:47.636816+0000 mgr.gibba020.yqfnwy (mgr.34427) 6327 : cluster [DBG] pgmap v3603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:49.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:48 gibba013 bash[30381]: cluster 2021-03-10T15:52:47.636816+0000 mgr.gibba020.yqfnwy (mgr.34427) 6327 : cluster [DBG] pgmap v3603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:49.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:48 gibba020 bash[25448]: cluster 2021-03-10T15:52:47.636816+0000 mgr.gibba020.yqfnwy (mgr.34427) 6327 : cluster [DBG] pgmap v3603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:51.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:50 gibba013 bash[29418]: cluster 2021-03-10T15:52:49.638519+0000 mgr.gibba020.yqfnwy (mgr.34427) 6328 : cluster [DBG] pgmap v3604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:51.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:50 gibba013 bash[30381]: cluster 2021-03-10T15:52:49.638519+0000 mgr.gibba020.yqfnwy (mgr.34427) 6328 : cluster [DBG] pgmap v3604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:51.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:50 gibba020 bash[25448]: cluster 2021-03-10T15:52:49.638519+0000 mgr.gibba020.yqfnwy (mgr.34427) 6328 : cluster [DBG] pgmap v3604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:53.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:52 gibba013 bash[30381]: cluster 2021-03-10T15:52:51.639478+0000 mgr.gibba020.yqfnwy (mgr.34427) 6329 : cluster [DBG] pgmap v3605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:53.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:52 gibba013 bash[30381]: audit 2021-03-10T15:52:52.127856+0000 mon.a (mon.0) 2466 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:52:53.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:52 gibba013 bash[30381]: audit 2021-03-10T15:52:52.334944+0000 mon.a (mon.0) 2467 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:52:53.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:52 gibba013 bash[30381]: audit 2021-03-10T15:52:52.338127+0000 mon.a (mon.0) 2468 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:52:53.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:52 gibba013 bash[30381]: audit 2021-03-10T15:52:52.339973+0000 mon.a (mon.0) 2469 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:53.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:52 gibba013 bash[30381]: audit 2021-03-10T15:52:52.341328+0000 mon.a (mon.0) 2470 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:53.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:52 gibba013 bash[30381]: audit 2021-03-10T15:52:52.343190+0000 mon.a (mon.0) 2471 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:53.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:52 gibba013 bash[30381]: audit 2021-03-10T15:52:52.346799+0000 mon.a (mon.0) 2472 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:53.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:52 gibba013 bash[30381]: audit 2021-03-10T15:52:52.348963+0000 mon.a (mon.0) 2473 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:53.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:52 gibba013 bash[29418]: cluster 2021-03-10T15:52:51.639478+0000 mgr.gibba020.yqfnwy (mgr.34427) 6329 : cluster [DBG] pgmap v3605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:53.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:52 gibba013 bash[29418]: audit 2021-03-10T15:52:52.127856+0000 mon.a (mon.0) 2466 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:52:53.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:52 gibba013 bash[29418]: audit 2021-03-10T15:52:52.334944+0000 mon.a (mon.0) 2467 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:52:53.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:52 gibba013 bash[29418]: audit 2021-03-10T15:52:52.338127+0000 mon.a (mon.0) 2468 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:52:53.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:52 gibba013 bash[29418]: audit 2021-03-10T15:52:52.339973+0000 mon.a (mon.0) 2469 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:53.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:52 gibba013 bash[29418]: audit 2021-03-10T15:52:52.341328+0000 mon.a (mon.0) 2470 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:53.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:52 gibba013 bash[29418]: audit 2021-03-10T15:52:52.343190+0000 mon.a (mon.0) 2471 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:53.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:52 gibba013 bash[29418]: audit 2021-03-10T15:52:52.346799+0000 mon.a (mon.0) 2472 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:53.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:52 gibba013 bash[29418]: audit 2021-03-10T15:52:52.348963+0000 mon.a (mon.0) 2473 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:53.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:52 gibba020 bash[25448]: cluster 2021-03-10T15:52:51.639478+0000 mgr.gibba020.yqfnwy (mgr.34427) 6329 : cluster [DBG] pgmap v3605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:53.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:52 gibba020 bash[25448]: audit 2021-03-10T15:52:52.127856+0000 mon.a (mon.0) 2466 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:52:53.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:52 gibba020 bash[25448]: audit 2021-03-10T15:52:52.334944+0000 mon.a (mon.0) 2467 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:52:53.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:52 gibba020 bash[25448]: audit 2021-03-10T15:52:52.338127+0000 mon.a (mon.0) 2468 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:52:53.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:52 gibba020 bash[25448]: audit 2021-03-10T15:52:52.339973+0000 mon.a (mon.0) 2469 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:53.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:52 gibba020 bash[25448]: audit 2021-03-10T15:52:52.341328+0000 mon.a (mon.0) 2470 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:53.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:52 gibba020 bash[25448]: audit 2021-03-10T15:52:52.343190+0000 mon.a (mon.0) 2471 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:53.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:52 gibba020 bash[25448]: audit 2021-03-10T15:52:52.346799+0000 mon.a (mon.0) 2472 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:53.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:52 gibba020 bash[25448]: audit 2021-03-10T15:52:52.348963+0000 mon.a (mon.0) 2473 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:52:54.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:53 gibba013 bash[29418]: cephadm 2021-03-10T15:52:52.132060+0000 mgr.gibba020.yqfnwy (mgr.34427) 6330 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:52:54.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:53 gibba013 bash[29418]: cephadm 2021-03-10T15:52:52.133978+0000 mgr.gibba020.yqfnwy (mgr.34427) 6331 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:52:54.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:53 gibba013 bash[29418]: cephadm 2021-03-10T15:52:52.336116+0000 mgr.gibba020.yqfnwy (mgr.34427) 6332 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:52:54.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:53 gibba013 bash[29418]: cephadm 2021-03-10T15:52:52.338063+0000 mgr.gibba020.yqfnwy (mgr.34427) 6333 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:52:54.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:53 gibba013 bash[29418]: cephadm 2021-03-10T15:52:52.339610+0000 mgr.gibba020.yqfnwy (mgr.34427) 6334 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:52:54.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:53 gibba013 bash[29418]: cephadm 2021-03-10T15:52:52.339646+0000 mgr.gibba020.yqfnwy (mgr.34427) 6335 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:52:54.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:53 gibba013 bash[29418]: cephadm 2021-03-10T15:52:52.341239+0000 mgr.gibba020.yqfnwy (mgr.34427) 6336 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:52:54.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:53 gibba013 bash[29418]: cephadm 2021-03-10T15:52:52.341272+0000 mgr.gibba020.yqfnwy (mgr.34427) 6337 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:52:54.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:53 gibba013 bash[29418]: cephadm 2021-03-10T15:52:52.343499+0000 mgr.gibba020.yqfnwy (mgr.34427) 6338 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:52:54.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:53 gibba013 bash[29418]: cephadm 2021-03-10T15:52:52.344882+0000 mgr.gibba020.yqfnwy (mgr.34427) 6339 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:52:54.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:53 gibba013 bash[29418]: cephadm 2021-03-10T15:52:52.344921+0000 mgr.gibba020.yqfnwy (mgr.34427) 6340 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:52:54.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:53 gibba013 bash[29418]: cephadm 2021-03-10T15:52:52.346677+0000 mgr.gibba020.yqfnwy (mgr.34427) 6341 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:52:54.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:53 gibba013 bash[29418]: cephadm 2021-03-10T15:52:52.347099+0000 mgr.gibba020.yqfnwy (mgr.34427) 6342 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:52:54.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:53 gibba013 bash[29418]: cephadm 2021-03-10T15:52:52.349277+0000 mgr.gibba020.yqfnwy (mgr.34427) 6343 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:52:54.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:53 gibba013 bash[29418]: cephadm 2021-03-10T15:52:52.349316+0000 mgr.gibba020.yqfnwy (mgr.34427) 6344 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:52:54.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:53 gibba013 bash[29418]: cephadm 2021-03-10T15:52:52.349428+0000 mgr.gibba020.yqfnwy (mgr.34427) 6345 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:52:54.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:53 gibba013 bash[30381]: cephadm 2021-03-10T15:52:52.132060+0000 mgr.gibba020.yqfnwy (mgr.34427) 6330 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:52:54.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:53 gibba013 bash[30381]: cephadm 2021-03-10T15:52:52.133978+0000 mgr.gibba020.yqfnwy (mgr.34427) 6331 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:52:54.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:53 gibba013 bash[30381]: cephadm 2021-03-10T15:52:52.336116+0000 mgr.gibba020.yqfnwy (mgr.34427) 6332 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:52:54.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:53 gibba013 bash[30381]: cephadm 2021-03-10T15:52:52.338063+0000 mgr.gibba020.yqfnwy (mgr.34427) 6333 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:52:54.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:53 gibba013 bash[30381]: cephadm 2021-03-10T15:52:52.339610+0000 mgr.gibba020.yqfnwy (mgr.34427) 6334 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:52:54.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:53 gibba013 bash[30381]: cephadm 2021-03-10T15:52:52.339646+0000 mgr.gibba020.yqfnwy (mgr.34427) 6335 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:52:54.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:53 gibba013 bash[30381]: cephadm 2021-03-10T15:52:52.341239+0000 mgr.gibba020.yqfnwy (mgr.34427) 6336 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:52:54.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:53 gibba013 bash[30381]: cephadm 2021-03-10T15:52:52.341272+0000 mgr.gibba020.yqfnwy (mgr.34427) 6337 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:52:54.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:53 gibba013 bash[30381]: cephadm 2021-03-10T15:52:52.343499+0000 mgr.gibba020.yqfnwy (mgr.34427) 6338 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:52:54.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:53 gibba013 bash[30381]: cephadm 2021-03-10T15:52:52.344882+0000 mgr.gibba020.yqfnwy (mgr.34427) 6339 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:52:54.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:53 gibba013 bash[30381]: cephadm 2021-03-10T15:52:52.344921+0000 mgr.gibba020.yqfnwy (mgr.34427) 6340 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:52:54.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:53 gibba013 bash[30381]: cephadm 2021-03-10T15:52:52.346677+0000 mgr.gibba020.yqfnwy (mgr.34427) 6341 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:52:54.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:53 gibba013 bash[30381]: cephadm 2021-03-10T15:52:52.347099+0000 mgr.gibba020.yqfnwy (mgr.34427) 6342 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:52:54.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:53 gibba013 bash[30381]: cephadm 2021-03-10T15:52:52.349277+0000 mgr.gibba020.yqfnwy (mgr.34427) 6343 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:52:54.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:53 gibba013 bash[30381]: cephadm 2021-03-10T15:52:52.349316+0000 mgr.gibba020.yqfnwy (mgr.34427) 6344 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:52:54.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:53 gibba013 bash[30381]: cephadm 2021-03-10T15:52:52.349428+0000 mgr.gibba020.yqfnwy (mgr.34427) 6345 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:52:54.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:53 gibba020 bash[25448]: cephadm 2021-03-10T15:52:52.132060+0000 mgr.gibba020.yqfnwy (mgr.34427) 6330 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:52:54.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:53 gibba020 bash[25448]: cephadm 2021-03-10T15:52:52.133978+0000 mgr.gibba020.yqfnwy (mgr.34427) 6331 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:52:54.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:53 gibba020 bash[25448]: cephadm 2021-03-10T15:52:52.336116+0000 mgr.gibba020.yqfnwy (mgr.34427) 6332 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:52:54.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:53 gibba020 bash[25448]: cephadm 2021-03-10T15:52:52.338063+0000 mgr.gibba020.yqfnwy (mgr.34427) 6333 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:52:54.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:53 gibba020 bash[25448]: cephadm 2021-03-10T15:52:52.339610+0000 mgr.gibba020.yqfnwy (mgr.34427) 6334 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:52:54.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:53 gibba020 bash[25448]: cephadm 2021-03-10T15:52:52.339646+0000 mgr.gibba020.yqfnwy (mgr.34427) 6335 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:52:54.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:53 gibba020 bash[25448]: cephadm 2021-03-10T15:52:52.341239+0000 mgr.gibba020.yqfnwy (mgr.34427) 6336 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:52:54.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:53 gibba020 bash[25448]: cephadm 2021-03-10T15:52:52.341272+0000 mgr.gibba020.yqfnwy (mgr.34427) 6337 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:52:54.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:53 gibba020 bash[25448]: cephadm 2021-03-10T15:52:52.343499+0000 mgr.gibba020.yqfnwy (mgr.34427) 6338 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:52:54.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:53 gibba020 bash[25448]: cephadm 2021-03-10T15:52:52.344882+0000 mgr.gibba020.yqfnwy (mgr.34427) 6339 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:52:54.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:53 gibba020 bash[25448]: cephadm 2021-03-10T15:52:52.344921+0000 mgr.gibba020.yqfnwy (mgr.34427) 6340 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:52:54.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:53 gibba020 bash[25448]: cephadm 2021-03-10T15:52:52.346677+0000 mgr.gibba020.yqfnwy (mgr.34427) 6341 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:52:54.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:53 gibba020 bash[25448]: cephadm 2021-03-10T15:52:52.347099+0000 mgr.gibba020.yqfnwy (mgr.34427) 6342 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:52:54.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:53 gibba020 bash[25448]: cephadm 2021-03-10T15:52:52.349277+0000 mgr.gibba020.yqfnwy (mgr.34427) 6343 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:52:54.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:53 gibba020 bash[25448]: cephadm 2021-03-10T15:52:52.349316+0000 mgr.gibba020.yqfnwy (mgr.34427) 6344 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:52:54.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:53 gibba020 bash[25448]: cephadm 2021-03-10T15:52:52.349428+0000 mgr.gibba020.yqfnwy (mgr.34427) 6345 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:52:55.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:54 gibba013 bash[29418]: cluster 2021-03-10T15:52:53.641051+0000 mgr.gibba020.yqfnwy (mgr.34427) 6346 : cluster [DBG] pgmap v3606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:55.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:54 gibba013 bash[30381]: cluster 2021-03-10T15:52:53.641051+0000 mgr.gibba020.yqfnwy (mgr.34427) 6346 : cluster [DBG] pgmap v3606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:55.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:54 gibba020 bash[25448]: cluster 2021-03-10T15:52:53.641051+0000 mgr.gibba020.yqfnwy (mgr.34427) 6346 : cluster [DBG] pgmap v3606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:57.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:56 gibba013 bash[29418]: cluster 2021-03-10T15:52:55.642727+0000 mgr.gibba020.yqfnwy (mgr.34427) 6347 : cluster [DBG] pgmap v3607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:57.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:56 gibba013 bash[30381]: cluster 2021-03-10T15:52:55.642727+0000 mgr.gibba020.yqfnwy (mgr.34427) 6347 : cluster [DBG] pgmap v3607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:57.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:56 gibba020 bash[25448]: cluster 2021-03-10T15:52:55.642727+0000 mgr.gibba020.yqfnwy (mgr.34427) 6347 : cluster [DBG] pgmap v3607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:59.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:52:58 gibba013 bash[29418]: cluster 2021-03-10T15:52:57.644280+0000 mgr.gibba020.yqfnwy (mgr.34427) 6348 : cluster [DBG] pgmap v3608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:59.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:52:58 gibba013 bash[30381]: cluster 2021-03-10T15:52:57.644280+0000 mgr.gibba020.yqfnwy (mgr.34427) 6348 : cluster [DBG] pgmap v3608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:52:59.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:52:58 gibba020 bash[25448]: cluster 2021-03-10T15:52:57.644280+0000 mgr.gibba020.yqfnwy (mgr.34427) 6348 : cluster [DBG] pgmap v3608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:01.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:00 gibba013 bash[29418]: cluster 2021-03-10T15:52:59.645856+0000 mgr.gibba020.yqfnwy (mgr.34427) 6349 : cluster [DBG] pgmap v3609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:01.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:00 gibba013 bash[30381]: cluster 2021-03-10T15:52:59.645856+0000 mgr.gibba020.yqfnwy (mgr.34427) 6349 : cluster [DBG] pgmap v3609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:01.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:00 gibba020 bash[25448]: cluster 2021-03-10T15:52:59.645856+0000 mgr.gibba020.yqfnwy (mgr.34427) 6349 : cluster [DBG] pgmap v3609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:03.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:02 gibba013 bash[29418]: cluster 2021-03-10T15:53:01.646722+0000 mgr.gibba020.yqfnwy (mgr.34427) 6350 : cluster [DBG] pgmap v3610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:03.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:02 gibba013 bash[30381]: cluster 2021-03-10T15:53:01.646722+0000 mgr.gibba020.yqfnwy (mgr.34427) 6350 : cluster [DBG] pgmap v3610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:03.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:02 gibba020 bash[25448]: cluster 2021-03-10T15:53:01.646722+0000 mgr.gibba020.yqfnwy (mgr.34427) 6350 : cluster [DBG] pgmap v3610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:04.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:04 gibba013 bash[29418]: cluster 2021-03-10T15:53:03.648343+0000 mgr.gibba020.yqfnwy (mgr.34427) 6351 : cluster [DBG] pgmap v3611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:04.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:04 gibba013 bash[30381]: cluster 2021-03-10T15:53:03.648343+0000 mgr.gibba020.yqfnwy (mgr.34427) 6351 : cluster [DBG] pgmap v3611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:04.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:04 gibba020 bash[25448]: cluster 2021-03-10T15:53:03.648343+0000 mgr.gibba020.yqfnwy (mgr.34427) 6351 : cluster [DBG] pgmap v3611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:07.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:06 gibba013 bash[29418]: cluster 2021-03-10T15:53:05.649768+0000 mgr.gibba020.yqfnwy (mgr.34427) 6352 : cluster [DBG] pgmap v3612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:06 gibba013 bash[29418]: audit 2021-03-10T15:53:06.575535+0000 mon.a (mon.0) 2474 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:53:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:06 gibba013 bash[29418]: audit 2021-03-10T15:53:06.657261+0000 mon.a (mon.0) 2475 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:53:07.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:06 gibba013 bash[30381]: cluster 2021-03-10T15:53:05.649768+0000 mgr.gibba020.yqfnwy (mgr.34427) 6352 : cluster [DBG] pgmap v3612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:07.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:06 gibba013 bash[30381]: audit 2021-03-10T15:53:06.575535+0000 mon.a (mon.0) 2474 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:53:07.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:06 gibba013 bash[30381]: audit 2021-03-10T15:53:06.657261+0000 mon.a (mon.0) 2475 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:53:07.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:06 gibba020 bash[25448]: cluster 2021-03-10T15:53:05.649768+0000 mgr.gibba020.yqfnwy (mgr.34427) 6352 : cluster [DBG] pgmap v3612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:07.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:06 gibba020 bash[25448]: audit 2021-03-10T15:53:06.575535+0000 mon.a (mon.0) 2474 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:53:07.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:06 gibba020 bash[25448]: audit 2021-03-10T15:53:06.657261+0000 mon.a (mon.0) 2475 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:53:08.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:07 gibba013 bash[29418]: audit 2021-03-10T15:53:06.809563+0000 mon.a (mon.0) 2476 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:53:08.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:07 gibba013 bash[29418]: audit 2021-03-10T15:53:06.810429+0000 mon.a (mon.0) 2477 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:53:08.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:07 gibba013 bash[29418]: audit 2021-03-10T15:53:06.811113+0000 mon.a (mon.0) 2478 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:53:08.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:07 gibba013 bash[29418]: audit 2021-03-10T15:53:06.811819+0000 mon.a (mon.0) 2479 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:53:08.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:07 gibba013 bash[30381]: audit 2021-03-10T15:53:06.809563+0000 mon.a (mon.0) 2476 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:53:08.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:07 gibba013 bash[30381]: audit 2021-03-10T15:53:06.810429+0000 mon.a (mon.0) 2477 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:53:08.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:07 gibba013 bash[30381]: audit 2021-03-10T15:53:06.811113+0000 mon.a (mon.0) 2478 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:53:08.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:07 gibba013 bash[30381]: audit 2021-03-10T15:53:06.811819+0000 mon.a (mon.0) 2479 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:53:08.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:07 gibba020 bash[25448]: audit 2021-03-10T15:53:06.809563+0000 mon.a (mon.0) 2476 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T15:53:08.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:07 gibba020 bash[25448]: audit 2021-03-10T15:53:06.810429+0000 mon.a (mon.0) 2477 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T15:53:08.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:07 gibba020 bash[25448]: audit 2021-03-10T15:53:06.811113+0000 mon.a (mon.0) 2478 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T15:53:08.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:07 gibba020 bash[25448]: audit 2021-03-10T15:53:06.811819+0000 mon.a (mon.0) 2479 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T15:53:09.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:08 gibba013 bash[29418]: cephadm 2021-03-10T15:53:07.365493+0000 mgr.gibba020.yqfnwy (mgr.34427) 6353 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:53:09.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:08 gibba013 bash[29418]: cluster 2021-03-10T15:53:07.651403+0000 mgr.gibba020.yqfnwy (mgr.34427) 6354 : cluster [DBG] pgmap v3613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:09.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:08 gibba013 bash[30381]: cephadm 2021-03-10T15:53:07.365493+0000 mgr.gibba020.yqfnwy (mgr.34427) 6353 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:53:09.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:08 gibba013 bash[30381]: cluster 2021-03-10T15:53:07.651403+0000 mgr.gibba020.yqfnwy (mgr.34427) 6354 : cluster [DBG] pgmap v3613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:09.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:08 gibba020 bash[25448]: cephadm 2021-03-10T15:53:07.365493+0000 mgr.gibba020.yqfnwy (mgr.34427) 6353 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:53:09.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:08 gibba020 bash[25448]: cluster 2021-03-10T15:53:07.651403+0000 mgr.gibba020.yqfnwy (mgr.34427) 6354 : cluster [DBG] pgmap v3613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:11.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:10 gibba013 bash[29418]: cluster 2021-03-10T15:53:09.653046+0000 mgr.gibba020.yqfnwy (mgr.34427) 6355 : cluster [DBG] pgmap v3614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:11.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:10 gibba013 bash[30381]: cluster 2021-03-10T15:53:09.653046+0000 mgr.gibba020.yqfnwy (mgr.34427) 6355 : cluster [DBG] pgmap v3614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:11.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:10 gibba020 bash[25448]: cluster 2021-03-10T15:53:09.653046+0000 mgr.gibba020.yqfnwy (mgr.34427) 6355 : cluster [DBG] pgmap v3614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:11.324 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:53:11.552 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:53:11.552 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (119m) 3m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:53:11.553 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 2m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:53:11.553 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:53:11.553 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:53:11.553 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (119m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:53:11.553 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (119m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:53:11.554 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (118m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:53:11.554 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (118m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:53:11.554 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:53:11.554 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:53:11.555 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (117m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:53:11.555 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (117m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:53:11.555 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (117m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:53:11.555 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (116m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:53:11.555 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (116m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:53:11.556 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (115m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:53:11.556 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (115m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:53:11.556 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (114m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:53:11.556 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 2m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:53:11.557 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:53:11.809 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:53:11.810 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:53:11.810 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:53:11.810 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:53:11.810 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:53:11.811 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:53:11.811 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:53:11.811 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:53:11.811 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:53:11.811 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:53:11.812 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:53:11.812 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:53:11.812 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:53:11.812 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:53:11.812 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:53:13.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:12 gibba013 bash[29418]: audit 2021-03-10T15:53:11.312610+0000 mgr.gibba020.yqfnwy (mgr.34427) 6356 : audit [DBG] from='client.48318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:53:13.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:12 gibba013 bash[29418]: audit 2021-03-10T15:53:11.537138+0000 mgr.gibba020.yqfnwy (mgr.34427) 6357 : audit [DBG] from='client.48324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:53:13.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:12 gibba013 bash[29418]: cluster 2021-03-10T15:53:11.653888+0000 mgr.gibba020.yqfnwy (mgr.34427) 6358 : cluster [DBG] pgmap v3615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:13.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:12 gibba013 bash[29418]: audit 2021-03-10T15:53:11.808607+0000 mon.c (mon.1) 104 : audit [DBG] from='client.? 172.21.2.113:0/3551246403' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:13.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:12 gibba013 bash[30381]: audit 2021-03-10T15:53:11.312610+0000 mgr.gibba020.yqfnwy (mgr.34427) 6356 : audit [DBG] from='client.48318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:53:13.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:12 gibba013 bash[30381]: audit 2021-03-10T15:53:11.537138+0000 mgr.gibba020.yqfnwy (mgr.34427) 6357 : audit [DBG] from='client.48324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:53:13.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:12 gibba013 bash[30381]: cluster 2021-03-10T15:53:11.653888+0000 mgr.gibba020.yqfnwy (mgr.34427) 6358 : cluster [DBG] pgmap v3615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:13.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:12 gibba013 bash[30381]: audit 2021-03-10T15:53:11.808607+0000 mon.c (mon.1) 104 : audit [DBG] from='client.? 172.21.2.113:0/3551246403' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:13.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:12 gibba020 bash[25448]: audit 2021-03-10T15:53:11.312610+0000 mgr.gibba020.yqfnwy (mgr.34427) 6356 : audit [DBG] from='client.48318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:53:13.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:12 gibba020 bash[25448]: audit 2021-03-10T15:53:11.537138+0000 mgr.gibba020.yqfnwy (mgr.34427) 6357 : audit [DBG] from='client.48324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:53:13.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:12 gibba020 bash[25448]: cluster 2021-03-10T15:53:11.653888+0000 mgr.gibba020.yqfnwy (mgr.34427) 6358 : cluster [DBG] pgmap v3615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:13.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:12 gibba020 bash[25448]: audit 2021-03-10T15:53:11.808607+0000 mon.c (mon.1) 104 : audit [DBG] from='client.? 172.21.2.113:0/3551246403' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:14.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:14 gibba013 bash[29418]: cluster 2021-03-10T15:53:13.655288+0000 mgr.gibba020.yqfnwy (mgr.34427) 6359 : cluster [DBG] pgmap v3616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:14.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:14 gibba013 bash[30381]: cluster 2021-03-10T15:53:13.655288+0000 mgr.gibba020.yqfnwy (mgr.34427) 6359 : cluster [DBG] pgmap v3616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:14.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:14 gibba020 bash[25448]: cluster 2021-03-10T15:53:13.655288+0000 mgr.gibba020.yqfnwy (mgr.34427) 6359 : cluster [DBG] pgmap v3616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:17.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:16 gibba013 bash[29418]: cluster 2021-03-10T15:53:15.656902+0000 mgr.gibba020.yqfnwy (mgr.34427) 6360 : cluster [DBG] pgmap v3617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:17.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:16 gibba013 bash[30381]: cluster 2021-03-10T15:53:15.656902+0000 mgr.gibba020.yqfnwy (mgr.34427) 6360 : cluster [DBG] pgmap v3617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:17.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:16 gibba020 bash[25448]: cluster 2021-03-10T15:53:15.656902+0000 mgr.gibba020.yqfnwy (mgr.34427) 6360 : cluster [DBG] pgmap v3617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:19.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:18 gibba013 bash[29418]: cluster 2021-03-10T15:53:17.658182+0000 mgr.gibba020.yqfnwy (mgr.34427) 6361 : cluster [DBG] pgmap v3618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:19.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:18 gibba013 bash[30381]: cluster 2021-03-10T15:53:17.658182+0000 mgr.gibba020.yqfnwy (mgr.34427) 6361 : cluster [DBG] pgmap v3618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:19.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:18 gibba020 bash[25448]: cluster 2021-03-10T15:53:17.658182+0000 mgr.gibba020.yqfnwy (mgr.34427) 6361 : cluster [DBG] pgmap v3618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:21.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:20 gibba013 bash[29418]: cluster 2021-03-10T15:53:19.659627+0000 mgr.gibba020.yqfnwy (mgr.34427) 6362 : cluster [DBG] pgmap v3619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:21.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:20 gibba013 bash[30381]: cluster 2021-03-10T15:53:19.659627+0000 mgr.gibba020.yqfnwy (mgr.34427) 6362 : cluster [DBG] pgmap v3619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:21.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:20 gibba020 bash[25448]: cluster 2021-03-10T15:53:19.659627+0000 mgr.gibba020.yqfnwy (mgr.34427) 6362 : cluster [DBG] pgmap v3619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:23.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:22 gibba013 bash[29418]: cluster 2021-03-10T15:53:21.660407+0000 mgr.gibba020.yqfnwy (mgr.34427) 6363 : cluster [DBG] pgmap v3620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:23.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:22 gibba013 bash[30381]: cluster 2021-03-10T15:53:21.660407+0000 mgr.gibba020.yqfnwy (mgr.34427) 6363 : cluster [DBG] pgmap v3620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:23.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:22 gibba020 bash[25448]: cluster 2021-03-10T15:53:21.660407+0000 mgr.gibba020.yqfnwy (mgr.34427) 6363 : cluster [DBG] pgmap v3620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:24.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:23 gibba013 bash[29418]: cephadm 2021-03-10T15:53:22.377619+0000 mgr.gibba020.yqfnwy (mgr.34427) 6364 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:53:24.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:23 gibba013 bash[30381]: cephadm 2021-03-10T15:53:22.377619+0000 mgr.gibba020.yqfnwy (mgr.34427) 6364 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:53:24.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:23 gibba020 bash[25448]: cephadm 2021-03-10T15:53:22.377619+0000 mgr.gibba020.yqfnwy (mgr.34427) 6364 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:53:25.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:24 gibba013 bash[29418]: cluster 2021-03-10T15:53:23.661771+0000 mgr.gibba020.yqfnwy (mgr.34427) 6365 : cluster [DBG] pgmap v3621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:25.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:24 gibba013 bash[30381]: cluster 2021-03-10T15:53:23.661771+0000 mgr.gibba020.yqfnwy (mgr.34427) 6365 : cluster [DBG] pgmap v3621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:25.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:24 gibba020 bash[25448]: cluster 2021-03-10T15:53:23.661771+0000 mgr.gibba020.yqfnwy (mgr.34427) 6365 : cluster [DBG] pgmap v3621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:27.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:26 gibba013 bash[29418]: cluster 2021-03-10T15:53:25.663337+0000 mgr.gibba020.yqfnwy (mgr.34427) 6366 : cluster [DBG] pgmap v3622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:27.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:26 gibba013 bash[30381]: cluster 2021-03-10T15:53:25.663337+0000 mgr.gibba020.yqfnwy (mgr.34427) 6366 : cluster [DBG] pgmap v3622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:27.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:26 gibba020 bash[25448]: cluster 2021-03-10T15:53:25.663337+0000 mgr.gibba020.yqfnwy (mgr.34427) 6366 : cluster [DBG] pgmap v3622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:29.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:28 gibba013 bash[29418]: cluster 2021-03-10T15:53:27.664963+0000 mgr.gibba020.yqfnwy (mgr.34427) 6367 : cluster [DBG] pgmap v3623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:29.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:28 gibba013 bash[30381]: cluster 2021-03-10T15:53:27.664963+0000 mgr.gibba020.yqfnwy (mgr.34427) 6367 : cluster [DBG] pgmap v3623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:29.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:28 gibba020 bash[25448]: cluster 2021-03-10T15:53:27.664963+0000 mgr.gibba020.yqfnwy (mgr.34427) 6367 : cluster [DBG] pgmap v3623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:31.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:30 gibba013 bash[29418]: cluster 2021-03-10T15:53:29.666354+0000 mgr.gibba020.yqfnwy (mgr.34427) 6368 : cluster [DBG] pgmap v3624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:31.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:30 gibba013 bash[30381]: cluster 2021-03-10T15:53:29.666354+0000 mgr.gibba020.yqfnwy (mgr.34427) 6368 : cluster [DBG] pgmap v3624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:31.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:30 gibba020 bash[25448]: cluster 2021-03-10T15:53:29.666354+0000 mgr.gibba020.yqfnwy (mgr.34427) 6368 : cluster [DBG] pgmap v3624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:33.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:32 gibba013 bash[29418]: cluster 2021-03-10T15:53:31.667355+0000 mgr.gibba020.yqfnwy (mgr.34427) 6369 : cluster [DBG] pgmap v3625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:33.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:32 gibba013 bash[30381]: cluster 2021-03-10T15:53:31.667355+0000 mgr.gibba020.yqfnwy (mgr.34427) 6369 : cluster [DBG] pgmap v3625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:33.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:32 gibba020 bash[25448]: cluster 2021-03-10T15:53:31.667355+0000 mgr.gibba020.yqfnwy (mgr.34427) 6369 : cluster [DBG] pgmap v3625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:34.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:34 gibba013 bash[29418]: cluster 2021-03-10T15:53:33.668914+0000 mgr.gibba020.yqfnwy (mgr.34427) 6370 : cluster [DBG] pgmap v3626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:34.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:34 gibba013 bash[30381]: cluster 2021-03-10T15:53:33.668914+0000 mgr.gibba020.yqfnwy (mgr.34427) 6370 : cluster [DBG] pgmap v3626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:34.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:34 gibba020 bash[25448]: cluster 2021-03-10T15:53:33.668914+0000 mgr.gibba020.yqfnwy (mgr.34427) 6370 : cluster [DBG] pgmap v3626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:37.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:36 gibba013 bash[29418]: cluster 2021-03-10T15:53:35.670583+0000 mgr.gibba020.yqfnwy (mgr.34427) 6371 : cluster [DBG] pgmap v3627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:37.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:36 gibba013 bash[30381]: cluster 2021-03-10T15:53:35.670583+0000 mgr.gibba020.yqfnwy (mgr.34427) 6371 : cluster [DBG] pgmap v3627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:37.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:36 gibba020 bash[25448]: cluster 2021-03-10T15:53:35.670583+0000 mgr.gibba020.yqfnwy (mgr.34427) 6371 : cluster [DBG] pgmap v3627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:39.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:38 gibba013 bash[29418]: cephadm 2021-03-10T15:53:37.381042+0000 mgr.gibba020.yqfnwy (mgr.34427) 6372 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:53:39.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:38 gibba013 bash[29418]: cluster 2021-03-10T15:53:37.672172+0000 mgr.gibba020.yqfnwy (mgr.34427) 6373 : cluster [DBG] pgmap v3628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:39.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:38 gibba013 bash[30381]: cephadm 2021-03-10T15:53:37.381042+0000 mgr.gibba020.yqfnwy (mgr.34427) 6372 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:53:39.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:38 gibba013 bash[30381]: cluster 2021-03-10T15:53:37.672172+0000 mgr.gibba020.yqfnwy (mgr.34427) 6373 : cluster [DBG] pgmap v3628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:39.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:38 gibba020 bash[25448]: cephadm 2021-03-10T15:53:37.381042+0000 mgr.gibba020.yqfnwy (mgr.34427) 6372 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:53:39.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:38 gibba020 bash[25448]: cluster 2021-03-10T15:53:37.672172+0000 mgr.gibba020.yqfnwy (mgr.34427) 6373 : cluster [DBG] pgmap v3628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:41.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:40 gibba013 bash[29418]: cluster 2021-03-10T15:53:39.673753+0000 mgr.gibba020.yqfnwy (mgr.34427) 6374 : cluster [DBG] pgmap v3629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:41.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:40 gibba013 bash[30381]: cluster 2021-03-10T15:53:39.673753+0000 mgr.gibba020.yqfnwy (mgr.34427) 6374 : cluster [DBG] pgmap v3629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:41.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:40 gibba020 bash[25448]: cluster 2021-03-10T15:53:39.673753+0000 mgr.gibba020.yqfnwy (mgr.34427) 6374 : cluster [DBG] pgmap v3629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:42.049 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:53:42.278 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:53:42.278 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 3m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:53:42.278 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 2m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:53:42.279 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:53:42.279 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:53:42.279 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (119m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:53:42.279 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (119m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:53:42.280 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (119m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:53:42.280 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (119m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:53:42.280 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:53:42.280 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:53:42.280 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (118m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:53:42.281 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (118m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:53:42.281 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (117m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:53:42.281 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (117m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:53:42.281 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (116m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:53:42.281 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (116m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:53:42.282 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (115m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:53:42.282 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (115m) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:53:42.282 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 2m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:53:42.282 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:53:42.527 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:53:42.528 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:53:42.528 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:53:42.528 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:53:42.528 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:53:42.529 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:53:42.529 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:53:42.529 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:53:42.529 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:53:42.530 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:53:42.530 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:53:42.530 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:53:42.530 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:53:42.530 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:53:42.531 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:53:43.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:42 gibba013 bash[29418]: cluster 2021-03-10T15:53:41.674748+0000 mgr.gibba020.yqfnwy (mgr.34427) 6375 : cluster [DBG] pgmap v3630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:43.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:42 gibba013 bash[29418]: audit 2021-03-10T15:53:42.526710+0000 mon.a (mon.0) 2480 : audit [DBG] from='client.? 172.21.2.113:0/295640594' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:43.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:42 gibba013 bash[30381]: cluster 2021-03-10T15:53:41.674748+0000 mgr.gibba020.yqfnwy (mgr.34427) 6375 : cluster [DBG] pgmap v3630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:43.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:42 gibba013 bash[30381]: audit 2021-03-10T15:53:42.526710+0000 mon.a (mon.0) 2480 : audit [DBG] from='client.? 172.21.2.113:0/295640594' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:43.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:42 gibba020 bash[25448]: cluster 2021-03-10T15:53:41.674748+0000 mgr.gibba020.yqfnwy (mgr.34427) 6375 : cluster [DBG] pgmap v3630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:43.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:42 gibba020 bash[25448]: audit 2021-03-10T15:53:42.526710+0000 mon.a (mon.0) 2480 : audit [DBG] from='client.? 172.21.2.113:0/295640594' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:44.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:43 gibba013 bash[29418]: audit 2021-03-10T15:53:42.038213+0000 mgr.gibba020.yqfnwy (mgr.34427) 6376 : audit [DBG] from='client.48336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:53:44.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:43 gibba013 bash[29418]: audit 2021-03-10T15:53:42.262795+0000 mgr.gibba020.yqfnwy (mgr.34427) 6377 : audit [DBG] from='client.48342 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:53:44.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:43 gibba013 bash[30381]: audit 2021-03-10T15:53:42.038213+0000 mgr.gibba020.yqfnwy (mgr.34427) 6376 : audit [DBG] from='client.48336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:53:44.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:43 gibba013 bash[30381]: audit 2021-03-10T15:53:42.262795+0000 mgr.gibba020.yqfnwy (mgr.34427) 6377 : audit [DBG] from='client.48342 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:53:44.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:43 gibba020 bash[25448]: audit 2021-03-10T15:53:42.038213+0000 mgr.gibba020.yqfnwy (mgr.34427) 6376 : audit [DBG] from='client.48336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:53:44.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:43 gibba020 bash[25448]: audit 2021-03-10T15:53:42.262795+0000 mgr.gibba020.yqfnwy (mgr.34427) 6377 : audit [DBG] from='client.48342 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:53:45.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:44 gibba013 bash[29418]: cluster 2021-03-10T15:53:43.676044+0000 mgr.gibba020.yqfnwy (mgr.34427) 6378 : cluster [DBG] pgmap v3631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:45.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:44 gibba013 bash[30381]: cluster 2021-03-10T15:53:43.676044+0000 mgr.gibba020.yqfnwy (mgr.34427) 6378 : cluster [DBG] pgmap v3631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:45.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:44 gibba020 bash[25448]: cluster 2021-03-10T15:53:43.676044+0000 mgr.gibba020.yqfnwy (mgr.34427) 6378 : cluster [DBG] pgmap v3631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:47.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:46 gibba013 bash[29418]: cluster 2021-03-10T15:53:45.677718+0000 mgr.gibba020.yqfnwy (mgr.34427) 6379 : cluster [DBG] pgmap v3632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:47.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:46 gibba013 bash[30381]: cluster 2021-03-10T15:53:45.677718+0000 mgr.gibba020.yqfnwy (mgr.34427) 6379 : cluster [DBG] pgmap v3632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:47.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:46 gibba020 bash[25448]: cluster 2021-03-10T15:53:45.677718+0000 mgr.gibba020.yqfnwy (mgr.34427) 6379 : cluster [DBG] pgmap v3632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:49.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:48 gibba013 bash[29418]: cluster 2021-03-10T15:53:47.678927+0000 mgr.gibba020.yqfnwy (mgr.34427) 6380 : cluster [DBG] pgmap v3633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:49.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:48 gibba013 bash[30381]: cluster 2021-03-10T15:53:47.678927+0000 mgr.gibba020.yqfnwy (mgr.34427) 6380 : cluster [DBG] pgmap v3633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:49.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:48 gibba020 bash[25448]: cluster 2021-03-10T15:53:47.678927+0000 mgr.gibba020.yqfnwy (mgr.34427) 6380 : cluster [DBG] pgmap v3633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:51.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:50 gibba013 bash[29418]: cluster 2021-03-10T15:53:49.680519+0000 mgr.gibba020.yqfnwy (mgr.34427) 6381 : cluster [DBG] pgmap v3634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:51.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:50 gibba013 bash[30381]: cluster 2021-03-10T15:53:49.680519+0000 mgr.gibba020.yqfnwy (mgr.34427) 6381 : cluster [DBG] pgmap v3634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:51.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:50 gibba020 bash[25448]: cluster 2021-03-10T15:53:49.680519+0000 mgr.gibba020.yqfnwy (mgr.34427) 6381 : cluster [DBG] pgmap v3634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:52.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:52 gibba020 bash[25448]: cluster 2021-03-10T15:53:51.681262+0000 mgr.gibba020.yqfnwy (mgr.34427) 6382 : cluster [DBG] pgmap v3635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:52.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:52 gibba020 bash[25448]: audit 2021-03-10T15:53:52.389687+0000 mon.a (mon.0) 2481 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:53:52.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:52 gibba020 bash[25448]: audit 2021-03-10T15:53:52.604359+0000 mon.a (mon.0) 2482 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:53:52.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:52 gibba020 bash[25448]: audit 2021-03-10T15:53:52.607568+0000 mon.a (mon.0) 2483 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:53:52.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:52 gibba020 bash[25448]: audit 2021-03-10T15:53:52.609167+0000 mon.a (mon.0) 2484 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:52.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:52 gibba020 bash[25448]: audit 2021-03-10T15:53:52.610878+0000 mon.a (mon.0) 2485 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:52.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:52 gibba020 bash[25448]: audit 2021-03-10T15:53:52.612651+0000 mon.a (mon.0) 2486 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:52.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:52 gibba020 bash[25448]: audit 2021-03-10T15:53:52.615980+0000 mon.a (mon.0) 2487 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:52.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:52 gibba020 bash[25448]: audit 2021-03-10T15:53:52.617853+0000 mon.a (mon.0) 2488 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:53.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:52 gibba013 bash[29418]: cluster 2021-03-10T15:53:51.681262+0000 mgr.gibba020.yqfnwy (mgr.34427) 6382 : cluster [DBG] pgmap v3635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:53.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:52 gibba013 bash[29418]: audit 2021-03-10T15:53:52.389687+0000 mon.a (mon.0) 2481 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:53:53.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:52 gibba013 bash[29418]: audit 2021-03-10T15:53:52.604359+0000 mon.a (mon.0) 2482 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:53:53.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:52 gibba013 bash[29418]: audit 2021-03-10T15:53:52.607568+0000 mon.a (mon.0) 2483 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:53:53.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:52 gibba013 bash[29418]: audit 2021-03-10T15:53:52.609167+0000 mon.a (mon.0) 2484 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:53.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:52 gibba013 bash[29418]: audit 2021-03-10T15:53:52.610878+0000 mon.a (mon.0) 2485 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:53.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:52 gibba013 bash[29418]: audit 2021-03-10T15:53:52.612651+0000 mon.a (mon.0) 2486 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:53.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:52 gibba013 bash[29418]: audit 2021-03-10T15:53:52.615980+0000 mon.a (mon.0) 2487 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:53.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:52 gibba013 bash[29418]: audit 2021-03-10T15:53:52.617853+0000 mon.a (mon.0) 2488 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:53.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:52 gibba013 bash[30381]: cluster 2021-03-10T15:53:51.681262+0000 mgr.gibba020.yqfnwy (mgr.34427) 6382 : cluster [DBG] pgmap v3635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:53.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:52 gibba013 bash[30381]: audit 2021-03-10T15:53:52.389687+0000 mon.a (mon.0) 2481 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:53:53.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:52 gibba013 bash[30381]: audit 2021-03-10T15:53:52.604359+0000 mon.a (mon.0) 2482 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:53:53.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:52 gibba013 bash[30381]: audit 2021-03-10T15:53:52.607568+0000 mon.a (mon.0) 2483 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:53:53.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:52 gibba013 bash[30381]: audit 2021-03-10T15:53:52.609167+0000 mon.a (mon.0) 2484 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:53.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:52 gibba013 bash[30381]: audit 2021-03-10T15:53:52.610878+0000 mon.a (mon.0) 2485 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:53.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:52 gibba013 bash[30381]: audit 2021-03-10T15:53:52.612651+0000 mon.a (mon.0) 2486 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:53.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:52 gibba013 bash[30381]: audit 2021-03-10T15:53:52.615980+0000 mon.a (mon.0) 2487 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:53.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:52 gibba013 bash[30381]: audit 2021-03-10T15:53:52.617853+0000 mon.a (mon.0) 2488 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:53:54.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:53 gibba013 bash[29418]: cephadm 2021-03-10T15:53:52.394059+0000 mgr.gibba020.yqfnwy (mgr.34427) 6383 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:53:54.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:53 gibba013 bash[29418]: cephadm 2021-03-10T15:53:52.395640+0000 mgr.gibba020.yqfnwy (mgr.34427) 6384 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:53:54.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:53 gibba013 bash[29418]: cephadm 2021-03-10T15:53:52.605542+0000 mgr.gibba020.yqfnwy (mgr.34427) 6385 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:53:54.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:53 gibba013 bash[29418]: cephadm 2021-03-10T15:53:52.607341+0000 mgr.gibba020.yqfnwy (mgr.34427) 6386 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:53:54.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:53 gibba013 bash[29418]: cephadm 2021-03-10T15:53:52.609141+0000 mgr.gibba020.yqfnwy (mgr.34427) 6387 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:53:54.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:53 gibba013 bash[29418]: cephadm 2021-03-10T15:53:52.609182+0000 mgr.gibba020.yqfnwy (mgr.34427) 6388 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:53:54.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:53 gibba013 bash[29418]: cephadm 2021-03-10T15:53:52.610753+0000 mgr.gibba020.yqfnwy (mgr.34427) 6389 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:53:54.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:53 gibba013 bash[29418]: cephadm 2021-03-10T15:53:52.610789+0000 mgr.gibba020.yqfnwy (mgr.34427) 6390 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:53:54.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:53 gibba013 bash[29418]: cephadm 2021-03-10T15:53:52.612452+0000 mgr.gibba020.yqfnwy (mgr.34427) 6391 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:53:54.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:53 gibba013 bash[29418]: cephadm 2021-03-10T15:53:52.614029+0000 mgr.gibba020.yqfnwy (mgr.34427) 6392 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:53:54.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:53 gibba013 bash[29418]: cephadm 2021-03-10T15:53:52.614065+0000 mgr.gibba020.yqfnwy (mgr.34427) 6393 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:53:54.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:53 gibba013 bash[29418]: cephadm 2021-03-10T15:53:52.615628+0000 mgr.gibba020.yqfnwy (mgr.34427) 6394 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:53:54.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:53 gibba013 bash[29418]: cephadm 2021-03-10T15:53:52.616093+0000 mgr.gibba020.yqfnwy (mgr.34427) 6395 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:53:54.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:53 gibba013 bash[29418]: cephadm 2021-03-10T15:53:52.617501+0000 mgr.gibba020.yqfnwy (mgr.34427) 6396 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:53:54.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:53 gibba013 bash[29418]: cephadm 2021-03-10T15:53:52.617537+0000 mgr.gibba020.yqfnwy (mgr.34427) 6397 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:53:54.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:53 gibba013 bash[29418]: cephadm 2021-03-10T15:53:52.617643+0000 mgr.gibba020.yqfnwy (mgr.34427) 6398 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:53:54.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:53 gibba013 bash[30381]: cephadm 2021-03-10T15:53:52.394059+0000 mgr.gibba020.yqfnwy (mgr.34427) 6383 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:53:54.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:53 gibba013 bash[30381]: cephadm 2021-03-10T15:53:52.395640+0000 mgr.gibba020.yqfnwy (mgr.34427) 6384 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:53:54.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:53 gibba013 bash[30381]: cephadm 2021-03-10T15:53:52.605542+0000 mgr.gibba020.yqfnwy (mgr.34427) 6385 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:53:54.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:53 gibba013 bash[30381]: cephadm 2021-03-10T15:53:52.607341+0000 mgr.gibba020.yqfnwy (mgr.34427) 6386 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:53:54.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:53 gibba013 bash[30381]: cephadm 2021-03-10T15:53:52.609141+0000 mgr.gibba020.yqfnwy (mgr.34427) 6387 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:53:54.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:53 gibba013 bash[30381]: cephadm 2021-03-10T15:53:52.609182+0000 mgr.gibba020.yqfnwy (mgr.34427) 6388 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:53:54.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:53 gibba013 bash[30381]: cephadm 2021-03-10T15:53:52.610753+0000 mgr.gibba020.yqfnwy (mgr.34427) 6389 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:53:54.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:53 gibba013 bash[30381]: cephadm 2021-03-10T15:53:52.610789+0000 mgr.gibba020.yqfnwy (mgr.34427) 6390 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:53:54.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:53 gibba013 bash[30381]: cephadm 2021-03-10T15:53:52.612452+0000 mgr.gibba020.yqfnwy (mgr.34427) 6391 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:53:54.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:53 gibba013 bash[30381]: cephadm 2021-03-10T15:53:52.614029+0000 mgr.gibba020.yqfnwy (mgr.34427) 6392 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:53:54.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:53 gibba013 bash[30381]: cephadm 2021-03-10T15:53:52.614065+0000 mgr.gibba020.yqfnwy (mgr.34427) 6393 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:53:54.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:53 gibba013 bash[30381]: cephadm 2021-03-10T15:53:52.615628+0000 mgr.gibba020.yqfnwy (mgr.34427) 6394 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:53:54.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:53 gibba013 bash[30381]: cephadm 2021-03-10T15:53:52.616093+0000 mgr.gibba020.yqfnwy (mgr.34427) 6395 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:53:54.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:53 gibba013 bash[30381]: cephadm 2021-03-10T15:53:52.617501+0000 mgr.gibba020.yqfnwy (mgr.34427) 6396 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:53:54.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:53 gibba013 bash[30381]: cephadm 2021-03-10T15:53:52.617537+0000 mgr.gibba020.yqfnwy (mgr.34427) 6397 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:53:54.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:53 gibba013 bash[30381]: cephadm 2021-03-10T15:53:52.617643+0000 mgr.gibba020.yqfnwy (mgr.34427) 6398 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:53:54.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:53 gibba020 bash[25448]: cephadm 2021-03-10T15:53:52.394059+0000 mgr.gibba020.yqfnwy (mgr.34427) 6383 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:53:54.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:53 gibba020 bash[25448]: cephadm 2021-03-10T15:53:52.395640+0000 mgr.gibba020.yqfnwy (mgr.34427) 6384 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:53:54.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:53 gibba020 bash[25448]: cephadm 2021-03-10T15:53:52.605542+0000 mgr.gibba020.yqfnwy (mgr.34427) 6385 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:53:54.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:53 gibba020 bash[25448]: cephadm 2021-03-10T15:53:52.607341+0000 mgr.gibba020.yqfnwy (mgr.34427) 6386 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:53:54.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:53 gibba020 bash[25448]: cephadm 2021-03-10T15:53:52.609141+0000 mgr.gibba020.yqfnwy (mgr.34427) 6387 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:53:54.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:53 gibba020 bash[25448]: cephadm 2021-03-10T15:53:52.609182+0000 mgr.gibba020.yqfnwy (mgr.34427) 6388 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:53:54.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:53 gibba020 bash[25448]: cephadm 2021-03-10T15:53:52.610753+0000 mgr.gibba020.yqfnwy (mgr.34427) 6389 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:53:54.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:53 gibba020 bash[25448]: cephadm 2021-03-10T15:53:52.610789+0000 mgr.gibba020.yqfnwy (mgr.34427) 6390 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:53:54.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:53 gibba020 bash[25448]: cephadm 2021-03-10T15:53:52.612452+0000 mgr.gibba020.yqfnwy (mgr.34427) 6391 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:53:54.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:53 gibba020 bash[25448]: cephadm 2021-03-10T15:53:52.614029+0000 mgr.gibba020.yqfnwy (mgr.34427) 6392 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:53:54.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:53 gibba020 bash[25448]: cephadm 2021-03-10T15:53:52.614065+0000 mgr.gibba020.yqfnwy (mgr.34427) 6393 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:53:54.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:53 gibba020 bash[25448]: cephadm 2021-03-10T15:53:52.615628+0000 mgr.gibba020.yqfnwy (mgr.34427) 6394 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:53:54.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:53 gibba020 bash[25448]: cephadm 2021-03-10T15:53:52.616093+0000 mgr.gibba020.yqfnwy (mgr.34427) 6395 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:53:54.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:53 gibba020 bash[25448]: cephadm 2021-03-10T15:53:52.617501+0000 mgr.gibba020.yqfnwy (mgr.34427) 6396 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:53:54.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:53 gibba020 bash[25448]: cephadm 2021-03-10T15:53:52.617537+0000 mgr.gibba020.yqfnwy (mgr.34427) 6397 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:53:54.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:53 gibba020 bash[25448]: cephadm 2021-03-10T15:53:52.617643+0000 mgr.gibba020.yqfnwy (mgr.34427) 6398 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:53:55.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:54 gibba013 bash[29418]: cluster 2021-03-10T15:53:53.682653+0000 mgr.gibba020.yqfnwy (mgr.34427) 6399 : cluster [DBG] pgmap v3636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:55.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:54 gibba013 bash[30381]: cluster 2021-03-10T15:53:53.682653+0000 mgr.gibba020.yqfnwy (mgr.34427) 6399 : cluster [DBG] pgmap v3636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:55.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:54 gibba020 bash[25448]: cluster 2021-03-10T15:53:53.682653+0000 mgr.gibba020.yqfnwy (mgr.34427) 6399 : cluster [DBG] pgmap v3636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:57.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:56 gibba013 bash[29418]: cluster 2021-03-10T15:53:55.684152+0000 mgr.gibba020.yqfnwy (mgr.34427) 6400 : cluster [DBG] pgmap v3637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:57.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:56 gibba013 bash[30381]: cluster 2021-03-10T15:53:55.684152+0000 mgr.gibba020.yqfnwy (mgr.34427) 6400 : cluster [DBG] pgmap v3637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:57.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:56 gibba020 bash[25448]: cluster 2021-03-10T15:53:55.684152+0000 mgr.gibba020.yqfnwy (mgr.34427) 6400 : cluster [DBG] pgmap v3637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:59.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:53:58 gibba013 bash[29418]: cluster 2021-03-10T15:53:57.685367+0000 mgr.gibba020.yqfnwy (mgr.34427) 6401 : cluster [DBG] pgmap v3638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:59.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:53:58 gibba013 bash[30381]: cluster 2021-03-10T15:53:57.685367+0000 mgr.gibba020.yqfnwy (mgr.34427) 6401 : cluster [DBG] pgmap v3638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:53:59.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:53:58 gibba020 bash[25448]: cluster 2021-03-10T15:53:57.685367+0000 mgr.gibba020.yqfnwy (mgr.34427) 6401 : cluster [DBG] pgmap v3638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:01.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:00 gibba013 bash[29418]: cluster 2021-03-10T15:53:59.686936+0000 mgr.gibba020.yqfnwy (mgr.34427) 6402 : cluster [DBG] pgmap v3639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:01.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:00 gibba013 bash[30381]: cluster 2021-03-10T15:53:59.686936+0000 mgr.gibba020.yqfnwy (mgr.34427) 6402 : cluster [DBG] pgmap v3639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:01.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:00 gibba020 bash[25448]: cluster 2021-03-10T15:53:59.686936+0000 mgr.gibba020.yqfnwy (mgr.34427) 6402 : cluster [DBG] pgmap v3639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:03.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:02 gibba013 bash[29418]: cluster 2021-03-10T15:54:01.687857+0000 mgr.gibba020.yqfnwy (mgr.34427) 6403 : cluster [DBG] pgmap v3640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:03.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:02 gibba013 bash[30381]: cluster 2021-03-10T15:54:01.687857+0000 mgr.gibba020.yqfnwy (mgr.34427) 6403 : cluster [DBG] pgmap v3640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:03.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:02 gibba020 bash[25448]: cluster 2021-03-10T15:54:01.687857+0000 mgr.gibba020.yqfnwy (mgr.34427) 6403 : cluster [DBG] pgmap v3640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:04.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:04 gibba013 bash[29418]: cluster 2021-03-10T15:54:03.689136+0000 mgr.gibba020.yqfnwy (mgr.34427) 6404 : cluster [DBG] pgmap v3641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:04.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:04 gibba013 bash[30381]: cluster 2021-03-10T15:54:03.689136+0000 mgr.gibba020.yqfnwy (mgr.34427) 6404 : cluster [DBG] pgmap v3641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:04.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:04 gibba020 bash[25448]: cluster 2021-03-10T15:54:03.689136+0000 mgr.gibba020.yqfnwy (mgr.34427) 6404 : cluster [DBG] pgmap v3641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:07.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:06 gibba013 bash[29418]: cluster 2021-03-10T15:54:05.690824+0000 mgr.gibba020.yqfnwy (mgr.34427) 6405 : cluster [DBG] pgmap v3642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:07.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:06 gibba013 bash[29418]: audit 2021-03-10T15:54:06.580876+0000 mon.a (mon.0) 2489 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:54:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:06 gibba013 bash[29418]: audit 2021-03-10T15:54:06.658994+0000 mon.a (mon.0) 2490 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:54:07.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:06 gibba013 bash[30381]: cluster 2021-03-10T15:54:05.690824+0000 mgr.gibba020.yqfnwy (mgr.34427) 6405 : cluster [DBG] pgmap v3642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:07.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:06 gibba013 bash[30381]: audit 2021-03-10T15:54:06.580876+0000 mon.a (mon.0) 2489 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:54:07.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:06 gibba013 bash[30381]: audit 2021-03-10T15:54:06.658994+0000 mon.a (mon.0) 2490 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:54:07.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:06 gibba020 bash[25448]: cluster 2021-03-10T15:54:05.690824+0000 mgr.gibba020.yqfnwy (mgr.34427) 6405 : cluster [DBG] pgmap v3642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:07.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:06 gibba020 bash[25448]: audit 2021-03-10T15:54:06.580876+0000 mon.a (mon.0) 2489 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:54:07.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:06 gibba020 bash[25448]: audit 2021-03-10T15:54:06.658994+0000 mon.a (mon.0) 2490 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:54:07.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:07 gibba020 bash[25448]: audit 2021-03-10T15:54:06.817143+0000 mon.a (mon.0) 2491 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:54:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:07 gibba020 bash[25448]: audit 2021-03-10T15:54:06.817678+0000 mon.a (mon.0) 2492 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:54:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:07 gibba020 bash[25448]: audit 2021-03-10T15:54:06.818265+0000 mon.a (mon.0) 2493 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T15:54:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:07 gibba020 bash[25448]: audit 2021-03-10T15:54:06.818795+0000 mon.a (mon.0) 2494 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:54:08.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:07 gibba013 bash[29418]: audit 2021-03-10T15:54:06.817143+0000 mon.a (mon.0) 2491 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:54:08.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:07 gibba013 bash[29418]: audit 2021-03-10T15:54:06.817678+0000 mon.a (mon.0) 2492 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:54:08.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:07 gibba013 bash[29418]: audit 2021-03-10T15:54:06.818265+0000 mon.a (mon.0) 2493 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T15:54:08.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:07 gibba013 bash[29418]: audit 2021-03-10T15:54:06.818795+0000 mon.a (mon.0) 2494 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:54:08.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:07 gibba013 bash[30381]: audit 2021-03-10T15:54:06.817143+0000 mon.a (mon.0) 2491 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T15:54:08.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:07 gibba013 bash[30381]: audit 2021-03-10T15:54:06.817678+0000 mon.a (mon.0) 2492 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T15:54:08.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:07 gibba013 bash[30381]: audit 2021-03-10T15:54:06.818265+0000 mon.a (mon.0) 2493 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T15:54:08.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:07 gibba013 bash[30381]: audit 2021-03-10T15:54:06.818795+0000 mon.a (mon.0) 2494 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:54:09.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:08 gibba013 bash[29418]: cephadm 2021-03-10T15:54:07.633613+0000 mgr.gibba020.yqfnwy (mgr.34427) 6406 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:54:09.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:08 gibba013 bash[29418]: cluster 2021-03-10T15:54:07.692413+0000 mgr.gibba020.yqfnwy (mgr.34427) 6407 : cluster [DBG] pgmap v3643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:09.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:08 gibba013 bash[30381]: cephadm 2021-03-10T15:54:07.633613+0000 mgr.gibba020.yqfnwy (mgr.34427) 6406 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:54:09.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:08 gibba013 bash[30381]: cluster 2021-03-10T15:54:07.692413+0000 mgr.gibba020.yqfnwy (mgr.34427) 6407 : cluster [DBG] pgmap v3643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:09.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:08 gibba020 bash[25448]: cephadm 2021-03-10T15:54:07.633613+0000 mgr.gibba020.yqfnwy (mgr.34427) 6406 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:54:09.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:08 gibba020 bash[25448]: cluster 2021-03-10T15:54:07.692413+0000 mgr.gibba020.yqfnwy (mgr.34427) 6407 : cluster [DBG] pgmap v3643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:11.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:10 gibba013 bash[29418]: cluster 2021-03-10T15:54:09.694011+0000 mgr.gibba020.yqfnwy (mgr.34427) 6408 : cluster [DBG] pgmap v3644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:11.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:10 gibba013 bash[30381]: cluster 2021-03-10T15:54:09.694011+0000 mgr.gibba020.yqfnwy (mgr.34427) 6408 : cluster [DBG] pgmap v3644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:11.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:10 gibba020 bash[25448]: cluster 2021-03-10T15:54:09.694011+0000 mgr.gibba020.yqfnwy (mgr.34427) 6408 : cluster [DBG] pgmap v3644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:12.771 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:54:13.003 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:54:13.003 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 4m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:54:13.003 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 3m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:54:13.003 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:54:13.004 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:54:13.004 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:54:13.004 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:54:13.004 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (119m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:54:13.005 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (119m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:54:13.005 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:54:13.005 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:54:13.005 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (119m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:54:13.006 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (118m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:54:13.006 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (118m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:54:13.006 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (117m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:54:13.006 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (117m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:54:13.007 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (116m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:54:13.007 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (116m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:54:13.007 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (115m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:54:13.007 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 3m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:54:13.008 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 3m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:54:13.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:12 gibba013 bash[29418]: cluster 2021-03-10T15:54:11.694953+0000 mgr.gibba020.yqfnwy (mgr.34427) 6409 : cluster [DBG] pgmap v3645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:13.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:12 gibba013 bash[30381]: cluster 2021-03-10T15:54:11.694953+0000 mgr.gibba020.yqfnwy (mgr.34427) 6409 : cluster [DBG] pgmap v3645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:13.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:12 gibba020 bash[25448]: cluster 2021-03-10T15:54:11.694953+0000 mgr.gibba020.yqfnwy (mgr.34427) 6409 : cluster [DBG] pgmap v3645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:13.255 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:54:13.255 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:54:13.255 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:54:13.255 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:54:13.256 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:54:13.256 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:54:13.256 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:54:13.256 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:54:13.257 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:54:13.257 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:54:13.257 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:54:13.257 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:54:13.258 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:54:13.258 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:54:13.258 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:54:14.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:13 gibba013 bash[29418]: audit 2021-03-10T15:54:12.759993+0000 mgr.gibba020.yqfnwy (mgr.34427) 6410 : audit [DBG] from='client.48354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:54:14.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:13 gibba013 bash[29418]: audit 2021-03-10T15:54:13.254300+0000 mon.a (mon.0) 2495 : audit [DBG] from='client.? 172.21.2.113:0/3085718338' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:14.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:13 gibba013 bash[30381]: audit 2021-03-10T15:54:12.759993+0000 mgr.gibba020.yqfnwy (mgr.34427) 6410 : audit [DBG] from='client.48354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:54:14.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:13 gibba013 bash[30381]: audit 2021-03-10T15:54:13.254300+0000 mon.a (mon.0) 2495 : audit [DBG] from='client.? 172.21.2.113:0/3085718338' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:14.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:13 gibba020 bash[25448]: audit 2021-03-10T15:54:12.759993+0000 mgr.gibba020.yqfnwy (mgr.34427) 6410 : audit [DBG] from='client.48354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:54:14.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:13 gibba020 bash[25448]: audit 2021-03-10T15:54:13.254300+0000 mon.a (mon.0) 2495 : audit [DBG] from='client.? 172.21.2.113:0/3085718338' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:15.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:14 gibba013 bash[29418]: audit 2021-03-10T15:54:12.988065+0000 mgr.gibba020.yqfnwy (mgr.34427) 6411 : audit [DBG] from='client.48360 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:54:15.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:14 gibba013 bash[29418]: cluster 2021-03-10T15:54:13.696509+0000 mgr.gibba020.yqfnwy (mgr.34427) 6412 : cluster [DBG] pgmap v3646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:15.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:14 gibba013 bash[30381]: audit 2021-03-10T15:54:12.988065+0000 mgr.gibba020.yqfnwy (mgr.34427) 6411 : audit [DBG] from='client.48360 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:54:15.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:14 gibba013 bash[30381]: cluster 2021-03-10T15:54:13.696509+0000 mgr.gibba020.yqfnwy (mgr.34427) 6412 : cluster [DBG] pgmap v3646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:15.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:14 gibba020 bash[25448]: audit 2021-03-10T15:54:12.988065+0000 mgr.gibba020.yqfnwy (mgr.34427) 6411 : audit [DBG] from='client.48360 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:54:15.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:14 gibba020 bash[25448]: cluster 2021-03-10T15:54:13.696509+0000 mgr.gibba020.yqfnwy (mgr.34427) 6412 : cluster [DBG] pgmap v3646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:17.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:16 gibba013 bash[29418]: cluster 2021-03-10T15:54:15.698035+0000 mgr.gibba020.yqfnwy (mgr.34427) 6413 : cluster [DBG] pgmap v3647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:17.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:16 gibba013 bash[30381]: cluster 2021-03-10T15:54:15.698035+0000 mgr.gibba020.yqfnwy (mgr.34427) 6413 : cluster [DBG] pgmap v3647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:17.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:16 gibba020 bash[25448]: cluster 2021-03-10T15:54:15.698035+0000 mgr.gibba020.yqfnwy (mgr.34427) 6413 : cluster [DBG] pgmap v3647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:19.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:18 gibba013 bash[29418]: cluster 2021-03-10T15:54:17.699548+0000 mgr.gibba020.yqfnwy (mgr.34427) 6414 : cluster [DBG] pgmap v3648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:19.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:18 gibba013 bash[30381]: cluster 2021-03-10T15:54:17.699548+0000 mgr.gibba020.yqfnwy (mgr.34427) 6414 : cluster [DBG] pgmap v3648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:19.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:18 gibba020 bash[25448]: cluster 2021-03-10T15:54:17.699548+0000 mgr.gibba020.yqfnwy (mgr.34427) 6414 : cluster [DBG] pgmap v3648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:21.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:20 gibba013 bash[29418]: cluster 2021-03-10T15:54:19.701103+0000 mgr.gibba020.yqfnwy (mgr.34427) 6415 : cluster [DBG] pgmap v3649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:21.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:20 gibba013 bash[30381]: cluster 2021-03-10T15:54:19.701103+0000 mgr.gibba020.yqfnwy (mgr.34427) 6415 : cluster [DBG] pgmap v3649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:21.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:20 gibba020 bash[25448]: cluster 2021-03-10T15:54:19.701103+0000 mgr.gibba020.yqfnwy (mgr.34427) 6415 : cluster [DBG] pgmap v3649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:22.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:22 gibba020 bash[25448]: cluster 2021-03-10T15:54:21.701838+0000 mgr.gibba020.yqfnwy (mgr.34427) 6416 : cluster [DBG] pgmap v3650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:23.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:22 gibba013 bash[29418]: cluster 2021-03-10T15:54:21.701838+0000 mgr.gibba020.yqfnwy (mgr.34427) 6416 : cluster [DBG] pgmap v3650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:23.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:22 gibba013 bash[30381]: cluster 2021-03-10T15:54:21.701838+0000 mgr.gibba020.yqfnwy (mgr.34427) 6416 : cluster [DBG] pgmap v3650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:24.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:23 gibba013 bash[29418]: cephadm 2021-03-10T15:54:22.638845+0000 mgr.gibba020.yqfnwy (mgr.34427) 6417 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:54:24.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:23 gibba013 bash[30381]: cephadm 2021-03-10T15:54:22.638845+0000 mgr.gibba020.yqfnwy (mgr.34427) 6417 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:54:24.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:23 gibba020 bash[25448]: cephadm 2021-03-10T15:54:22.638845+0000 mgr.gibba020.yqfnwy (mgr.34427) 6417 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:54:25.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:24 gibba013 bash[29418]: cluster 2021-03-10T15:54:23.703246+0000 mgr.gibba020.yqfnwy (mgr.34427) 6418 : cluster [DBG] pgmap v3651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:25.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:24 gibba013 bash[30381]: cluster 2021-03-10T15:54:23.703246+0000 mgr.gibba020.yqfnwy (mgr.34427) 6418 : cluster [DBG] pgmap v3651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:25.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:24 gibba020 bash[25448]: cluster 2021-03-10T15:54:23.703246+0000 mgr.gibba020.yqfnwy (mgr.34427) 6418 : cluster [DBG] pgmap v3651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:27.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:26 gibba013 bash[29418]: cluster 2021-03-10T15:54:25.705029+0000 mgr.gibba020.yqfnwy (mgr.34427) 6419 : cluster [DBG] pgmap v3652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:27.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:26 gibba013 bash[30381]: cluster 2021-03-10T15:54:25.705029+0000 mgr.gibba020.yqfnwy (mgr.34427) 6419 : cluster [DBG] pgmap v3652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:27.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:26 gibba020 bash[25448]: cluster 2021-03-10T15:54:25.705029+0000 mgr.gibba020.yqfnwy (mgr.34427) 6419 : cluster [DBG] pgmap v3652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:29.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:28 gibba013 bash[29418]: cluster 2021-03-10T15:54:27.706610+0000 mgr.gibba020.yqfnwy (mgr.34427) 6420 : cluster [DBG] pgmap v3653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:29.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:28 gibba013 bash[30381]: cluster 2021-03-10T15:54:27.706610+0000 mgr.gibba020.yqfnwy (mgr.34427) 6420 : cluster [DBG] pgmap v3653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:29.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:28 gibba020 bash[25448]: cluster 2021-03-10T15:54:27.706610+0000 mgr.gibba020.yqfnwy (mgr.34427) 6420 : cluster [DBG] pgmap v3653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:30.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:29 gibba013 bash[29418]: cluster 2021-03-10T15:54:29.708282+0000 mgr.gibba020.yqfnwy (mgr.34427) 6421 : cluster [DBG] pgmap v3654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:30.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:29 gibba013 bash[30381]: cluster 2021-03-10T15:54:29.708282+0000 mgr.gibba020.yqfnwy (mgr.34427) 6421 : cluster [DBG] pgmap v3654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:30.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:29 gibba020 bash[25448]: cluster 2021-03-10T15:54:29.708282+0000 mgr.gibba020.yqfnwy (mgr.34427) 6421 : cluster [DBG] pgmap v3654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:33.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:32 gibba013 bash[29418]: cluster 2021-03-10T15:54:31.709288+0000 mgr.gibba020.yqfnwy (mgr.34427) 6422 : cluster [DBG] pgmap v3655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:33.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:32 gibba013 bash[30381]: cluster 2021-03-10T15:54:31.709288+0000 mgr.gibba020.yqfnwy (mgr.34427) 6422 : cluster [DBG] pgmap v3655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:33.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:32 gibba020 bash[25448]: cluster 2021-03-10T15:54:31.709288+0000 mgr.gibba020.yqfnwy (mgr.34427) 6422 : cluster [DBG] pgmap v3655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:34.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:34 gibba013 bash[29418]: cluster 2021-03-10T15:54:33.710887+0000 mgr.gibba020.yqfnwy (mgr.34427) 6423 : cluster [DBG] pgmap v3656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:34.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:34 gibba013 bash[30381]: cluster 2021-03-10T15:54:33.710887+0000 mgr.gibba020.yqfnwy (mgr.34427) 6423 : cluster [DBG] pgmap v3656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:34.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:34 gibba020 bash[25448]: cluster 2021-03-10T15:54:33.710887+0000 mgr.gibba020.yqfnwy (mgr.34427) 6423 : cluster [DBG] pgmap v3656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:37.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:36 gibba013 bash[29418]: cluster 2021-03-10T15:54:35.712613+0000 mgr.gibba020.yqfnwy (mgr.34427) 6424 : cluster [DBG] pgmap v3657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:37.161 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:36 gibba013 bash[30381]: cluster 2021-03-10T15:54:35.712613+0000 mgr.gibba020.yqfnwy (mgr.34427) 6424 : cluster [DBG] pgmap v3657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:37.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:36 gibba020 bash[25448]: cluster 2021-03-10T15:54:35.712613+0000 mgr.gibba020.yqfnwy (mgr.34427) 6424 : cluster [DBG] pgmap v3657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:39.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:38 gibba013 bash[29418]: cephadm 2021-03-10T15:54:37.652659+0000 mgr.gibba020.yqfnwy (mgr.34427) 6425 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:54:39.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:38 gibba013 bash[29418]: cluster 2021-03-10T15:54:37.714021+0000 mgr.gibba020.yqfnwy (mgr.34427) 6426 : cluster [DBG] pgmap v3658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:39.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:38 gibba013 bash[30381]: cephadm 2021-03-10T15:54:37.652659+0000 mgr.gibba020.yqfnwy (mgr.34427) 6425 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:54:39.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:38 gibba013 bash[30381]: cluster 2021-03-10T15:54:37.714021+0000 mgr.gibba020.yqfnwy (mgr.34427) 6426 : cluster [DBG] pgmap v3658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:39.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:38 gibba020 bash[25448]: cephadm 2021-03-10T15:54:37.652659+0000 mgr.gibba020.yqfnwy (mgr.34427) 6425 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:54:39.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:38 gibba020 bash[25448]: cluster 2021-03-10T15:54:37.714021+0000 mgr.gibba020.yqfnwy (mgr.34427) 6426 : cluster [DBG] pgmap v3658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:41.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:40 gibba013 bash[29418]: cluster 2021-03-10T15:54:39.715641+0000 mgr.gibba020.yqfnwy (mgr.34427) 6427 : cluster [DBG] pgmap v3659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:41.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:40 gibba013 bash[30381]: cluster 2021-03-10T15:54:39.715641+0000 mgr.gibba020.yqfnwy (mgr.34427) 6427 : cluster [DBG] pgmap v3659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:41.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:40 gibba020 bash[25448]: cluster 2021-03-10T15:54:39.715641+0000 mgr.gibba020.yqfnwy (mgr.34427) 6427 : cluster [DBG] pgmap v3659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:43.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:42 gibba013 bash[29418]: cluster 2021-03-10T15:54:41.717186+0000 mgr.gibba020.yqfnwy (mgr.34427) 6428 : cluster [DBG] pgmap v3660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:43.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:42 gibba013 bash[30381]: cluster 2021-03-10T15:54:41.717186+0000 mgr.gibba020.yqfnwy (mgr.34427) 6428 : cluster [DBG] pgmap v3660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:43.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:42 gibba020 bash[25448]: cluster 2021-03-10T15:54:41.717186+0000 mgr.gibba020.yqfnwy (mgr.34427) 6428 : cluster [DBG] pgmap v3660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:43.494 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:54:43.724 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:54:43.725 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 5m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:54:43.725 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 3m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:54:43.725 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:54:43.726 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:54:43.726 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:54:43.726 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:54:43.726 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:54:43.727 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:54:43.727 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:54:43.727 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:54:43.728 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (119m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:54:43.728 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (119m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:54:43.728 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (118m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:54:43.728 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (118m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:54:43.729 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (117m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:54:43.729 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (117m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:54:43.729 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (116m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:54:43.730 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (116m) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:54:43.730 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 3m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:54:43.730 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 3m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:54:43.976 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:54:43.976 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:54:43.976 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:54:43.977 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:54:43.977 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:54:43.977 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:54:43.977 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:54:43.977 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:54:43.978 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:54:43.978 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:54:43.978 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:54:43.978 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:54:43.979 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:54:43.979 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:54:43.979 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:54:44.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:44 gibba013 bash[29418]: audit 2021-03-10T15:54:43.483536+0000 mgr.gibba020.yqfnwy (mgr.34427) 6429 : audit [DBG] from='client.48372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:54:44.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:44 gibba013 bash[29418]: audit 2021-03-10T15:54:43.709558+0000 mgr.gibba020.yqfnwy (mgr.34427) 6430 : audit [DBG] from='client.48378 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:54:44.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:44 gibba013 bash[29418]: cluster 2021-03-10T15:54:43.717653+0000 mgr.gibba020.yqfnwy (mgr.34427) 6431 : cluster [DBG] pgmap v3661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:44.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:44 gibba013 bash[29418]: audit 2021-03-10T15:54:43.974976+0000 mon.c (mon.1) 105 : audit [DBG] from='client.? 172.21.2.113:0/2389636223' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:44.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:44 gibba013 bash[30381]: audit 2021-03-10T15:54:43.483536+0000 mgr.gibba020.yqfnwy (mgr.34427) 6429 : audit [DBG] from='client.48372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:54:44.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:44 gibba013 bash[30381]: audit 2021-03-10T15:54:43.709558+0000 mgr.gibba020.yqfnwy (mgr.34427) 6430 : audit [DBG] from='client.48378 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:54:44.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:44 gibba013 bash[30381]: cluster 2021-03-10T15:54:43.717653+0000 mgr.gibba020.yqfnwy (mgr.34427) 6431 : cluster [DBG] pgmap v3661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:44.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:44 gibba013 bash[30381]: audit 2021-03-10T15:54:43.974976+0000 mon.c (mon.1) 105 : audit [DBG] from='client.? 172.21.2.113:0/2389636223' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:44.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:44 gibba020 bash[25448]: audit 2021-03-10T15:54:43.483536+0000 mgr.gibba020.yqfnwy (mgr.34427) 6429 : audit [DBG] from='client.48372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:54:44.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:44 gibba020 bash[25448]: audit 2021-03-10T15:54:43.709558+0000 mgr.gibba020.yqfnwy (mgr.34427) 6430 : audit [DBG] from='client.48378 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:54:44.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:44 gibba020 bash[25448]: cluster 2021-03-10T15:54:43.717653+0000 mgr.gibba020.yqfnwy (mgr.34427) 6431 : cluster [DBG] pgmap v3661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:44.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:44 gibba020 bash[25448]: audit 2021-03-10T15:54:43.974976+0000 mon.c (mon.1) 105 : audit [DBG] from='client.? 172.21.2.113:0/2389636223' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:47.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:46 gibba013 bash[29418]: cluster 2021-03-10T15:54:45.719192+0000 mgr.gibba020.yqfnwy (mgr.34427) 6432 : cluster [DBG] pgmap v3662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:47.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:46 gibba013 bash[30381]: cluster 2021-03-10T15:54:45.719192+0000 mgr.gibba020.yqfnwy (mgr.34427) 6432 : cluster [DBG] pgmap v3662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:47.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:46 gibba020 bash[25448]: cluster 2021-03-10T15:54:45.719192+0000 mgr.gibba020.yqfnwy (mgr.34427) 6432 : cluster [DBG] pgmap v3662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:49.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:48 gibba013 bash[29418]: cluster 2021-03-10T15:54:47.720661+0000 mgr.gibba020.yqfnwy (mgr.34427) 6433 : cluster [DBG] pgmap v3663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:49.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:48 gibba013 bash[30381]: cluster 2021-03-10T15:54:47.720661+0000 mgr.gibba020.yqfnwy (mgr.34427) 6433 : cluster [DBG] pgmap v3663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:49.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:48 gibba020 bash[25448]: cluster 2021-03-10T15:54:47.720661+0000 mgr.gibba020.yqfnwy (mgr.34427) 6433 : cluster [DBG] pgmap v3663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:51.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:50 gibba013 bash[29418]: cluster 2021-03-10T15:54:49.722055+0000 mgr.gibba020.yqfnwy (mgr.34427) 6434 : cluster [DBG] pgmap v3664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:51.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:50 gibba013 bash[30381]: cluster 2021-03-10T15:54:49.722055+0000 mgr.gibba020.yqfnwy (mgr.34427) 6434 : cluster [DBG] pgmap v3664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:51.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:50 gibba020 bash[25448]: cluster 2021-03-10T15:54:49.722055+0000 mgr.gibba020.yqfnwy (mgr.34427) 6434 : cluster [DBG] pgmap v3664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:53.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:52 gibba013 bash[29418]: cluster 2021-03-10T15:54:51.723239+0000 mgr.gibba020.yqfnwy (mgr.34427) 6435 : cluster [DBG] pgmap v3665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:53.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:52 gibba013 bash[29418]: audit 2021-03-10T15:54:52.670964+0000 mon.a (mon.0) 2496 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:54:53.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:52 gibba013 bash[30381]: cluster 2021-03-10T15:54:51.723239+0000 mgr.gibba020.yqfnwy (mgr.34427) 6435 : cluster [DBG] pgmap v3665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:53.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:52 gibba013 bash[30381]: audit 2021-03-10T15:54:52.670964+0000 mon.a (mon.0) 2496 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:54:53.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:52 gibba020 bash[25448]: cluster 2021-03-10T15:54:51.723239+0000 mgr.gibba020.yqfnwy (mgr.34427) 6435 : cluster [DBG] pgmap v3665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:53.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:52 gibba020 bash[25448]: audit 2021-03-10T15:54:52.670964+0000 mon.a (mon.0) 2496 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:54:54.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:53 gibba013 bash[29418]: cephadm 2021-03-10T15:54:52.675501+0000 mgr.gibba020.yqfnwy (mgr.34427) 6436 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:54:54.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:53 gibba013 bash[29418]: cephadm 2021-03-10T15:54:52.676944+0000 mgr.gibba020.yqfnwy (mgr.34427) 6437 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:54:54.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:53 gibba013 bash[29418]: audit 2021-03-10T15:54:52.871078+0000 mon.a (mon.0) 2497 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:54:54.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:53 gibba013 bash[29418]: audit 2021-03-10T15:54:52.874282+0000 mon.a (mon.0) 2498 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:54:54.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:53 gibba013 bash[29418]: audit 2021-03-10T15:54:52.875963+0000 mon.a (mon.0) 2499 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:54.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:53 gibba013 bash[29418]: audit 2021-03-10T15:54:52.877686+0000 mon.a (mon.0) 2500 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:54.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:53 gibba013 bash[29418]: audit 2021-03-10T15:54:52.879081+0000 mon.a (mon.0) 2501 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:54.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:53 gibba013 bash[29418]: audit 2021-03-10T15:54:52.882257+0000 mon.a (mon.0) 2502 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:54.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:53 gibba013 bash[29418]: audit 2021-03-10T15:54:52.884239+0000 mon.a (mon.0) 2503 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:54.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:53 gibba013 bash[30381]: cephadm 2021-03-10T15:54:52.675501+0000 mgr.gibba020.yqfnwy (mgr.34427) 6436 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:54:54.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:53 gibba013 bash[30381]: cephadm 2021-03-10T15:54:52.676944+0000 mgr.gibba020.yqfnwy (mgr.34427) 6437 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:54:54.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:53 gibba013 bash[30381]: audit 2021-03-10T15:54:52.871078+0000 mon.a (mon.0) 2497 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:54:54.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:53 gibba013 bash[30381]: audit 2021-03-10T15:54:52.874282+0000 mon.a (mon.0) 2498 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:54:54.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:53 gibba013 bash[30381]: audit 2021-03-10T15:54:52.875963+0000 mon.a (mon.0) 2499 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:54.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:53 gibba013 bash[30381]: audit 2021-03-10T15:54:52.877686+0000 mon.a (mon.0) 2500 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:54.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:53 gibba013 bash[30381]: audit 2021-03-10T15:54:52.879081+0000 mon.a (mon.0) 2501 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:54.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:53 gibba013 bash[30381]: audit 2021-03-10T15:54:52.882257+0000 mon.a (mon.0) 2502 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:54.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:53 gibba013 bash[30381]: audit 2021-03-10T15:54:52.884239+0000 mon.a (mon.0) 2503 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:54.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:53 gibba020 bash[25448]: cephadm 2021-03-10T15:54:52.675501+0000 mgr.gibba020.yqfnwy (mgr.34427) 6436 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:54:54.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:53 gibba020 bash[25448]: cephadm 2021-03-10T15:54:52.676944+0000 mgr.gibba020.yqfnwy (mgr.34427) 6437 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:54:54.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:53 gibba020 bash[25448]: audit 2021-03-10T15:54:52.871078+0000 mon.a (mon.0) 2497 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:54:54.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:53 gibba020 bash[25448]: audit 2021-03-10T15:54:52.874282+0000 mon.a (mon.0) 2498 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:54:54.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:53 gibba020 bash[25448]: audit 2021-03-10T15:54:52.875963+0000 mon.a (mon.0) 2499 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:54.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:53 gibba020 bash[25448]: audit 2021-03-10T15:54:52.877686+0000 mon.a (mon.0) 2500 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:54.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:53 gibba020 bash[25448]: audit 2021-03-10T15:54:52.879081+0000 mon.a (mon.0) 2501 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:54.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:53 gibba020 bash[25448]: audit 2021-03-10T15:54:52.882257+0000 mon.a (mon.0) 2502 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:54.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:53 gibba020 bash[25448]: audit 2021-03-10T15:54:52.884239+0000 mon.a (mon.0) 2503 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:54:55.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:54 gibba013 bash[29418]: cephadm 2021-03-10T15:54:52.872091+0000 mgr.gibba020.yqfnwy (mgr.34427) 6438 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:54:55.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:54 gibba013 bash[29418]: cephadm 2021-03-10T15:54:52.873904+0000 mgr.gibba020.yqfnwy (mgr.34427) 6439 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:54:55.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:54 gibba013 bash[29418]: cephadm 2021-03-10T15:54:52.875686+0000 mgr.gibba020.yqfnwy (mgr.34427) 6440 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:54:55.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:54 gibba013 bash[29418]: cephadm 2021-03-10T15:54:52.875724+0000 mgr.gibba020.yqfnwy (mgr.34427) 6441 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:54:55.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:54 gibba013 bash[29418]: cephadm 2021-03-10T15:54:52.877084+0000 mgr.gibba020.yqfnwy (mgr.34427) 6442 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:54:55.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:54 gibba013 bash[29418]: cephadm 2021-03-10T15:54:52.877119+0000 mgr.gibba020.yqfnwy (mgr.34427) 6443 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:54:55.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:54 gibba013 bash[29418]: cephadm 2021-03-10T15:54:52.878832+0000 mgr.gibba020.yqfnwy (mgr.34427) 6444 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:54:55.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:54 gibba013 bash[29418]: cephadm 2021-03-10T15:54:52.880250+0000 mgr.gibba020.yqfnwy (mgr.34427) 6445 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:54:55.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:54 gibba013 bash[29418]: cephadm 2021-03-10T15:54:52.880280+0000 mgr.gibba020.yqfnwy (mgr.34427) 6446 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:54:55.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:54 gibba013 bash[29418]: cephadm 2021-03-10T15:54:52.881941+0000 mgr.gibba020.yqfnwy (mgr.34427) 6447 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:54:55.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:54 gibba013 bash[29418]: cephadm 2021-03-10T15:54:52.882254+0000 mgr.gibba020.yqfnwy (mgr.34427) 6448 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:54:55.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:54 gibba013 bash[29418]: cephadm 2021-03-10T15:54:52.883904+0000 mgr.gibba020.yqfnwy (mgr.34427) 6449 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:54:55.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:54 gibba013 bash[29418]: cephadm 2021-03-10T15:54:52.883981+0000 mgr.gibba020.yqfnwy (mgr.34427) 6450 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:54:55.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:54 gibba013 bash[29418]: cephadm 2021-03-10T15:54:52.884147+0000 mgr.gibba020.yqfnwy (mgr.34427) 6451 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:54:55.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:54 gibba013 bash[29418]: cluster 2021-03-10T15:54:53.724882+0000 mgr.gibba020.yqfnwy (mgr.34427) 6452 : cluster [DBG] pgmap v3666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:55.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:54 gibba013 bash[30381]: cephadm 2021-03-10T15:54:52.872091+0000 mgr.gibba020.yqfnwy (mgr.34427) 6438 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:54:55.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:54 gibba013 bash[30381]: cephadm 2021-03-10T15:54:52.873904+0000 mgr.gibba020.yqfnwy (mgr.34427) 6439 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:54:55.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:54 gibba013 bash[30381]: cephadm 2021-03-10T15:54:52.875686+0000 mgr.gibba020.yqfnwy (mgr.34427) 6440 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:54:55.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:54 gibba013 bash[30381]: cephadm 2021-03-10T15:54:52.875724+0000 mgr.gibba020.yqfnwy (mgr.34427) 6441 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:54:55.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:54 gibba013 bash[30381]: cephadm 2021-03-10T15:54:52.877084+0000 mgr.gibba020.yqfnwy (mgr.34427) 6442 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:54:55.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:54 gibba013 bash[30381]: cephadm 2021-03-10T15:54:52.877119+0000 mgr.gibba020.yqfnwy (mgr.34427) 6443 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:54:55.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:54 gibba013 bash[30381]: cephadm 2021-03-10T15:54:52.878832+0000 mgr.gibba020.yqfnwy (mgr.34427) 6444 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:54:55.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:54 gibba013 bash[30381]: cephadm 2021-03-10T15:54:52.880250+0000 mgr.gibba020.yqfnwy (mgr.34427) 6445 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:54:55.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:54 gibba013 bash[30381]: cephadm 2021-03-10T15:54:52.880280+0000 mgr.gibba020.yqfnwy (mgr.34427) 6446 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:54:55.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:54 gibba013 bash[30381]: cephadm 2021-03-10T15:54:52.881941+0000 mgr.gibba020.yqfnwy (mgr.34427) 6447 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:54:55.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:54 gibba013 bash[30381]: cephadm 2021-03-10T15:54:52.882254+0000 mgr.gibba020.yqfnwy (mgr.34427) 6448 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:54:55.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:54 gibba013 bash[30381]: cephadm 2021-03-10T15:54:52.883904+0000 mgr.gibba020.yqfnwy (mgr.34427) 6449 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:54:55.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:54 gibba013 bash[30381]: cephadm 2021-03-10T15:54:52.883981+0000 mgr.gibba020.yqfnwy (mgr.34427) 6450 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:54:55.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:54 gibba013 bash[30381]: cephadm 2021-03-10T15:54:52.884147+0000 mgr.gibba020.yqfnwy (mgr.34427) 6451 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:54:55.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:54 gibba013 bash[30381]: cluster 2021-03-10T15:54:53.724882+0000 mgr.gibba020.yqfnwy (mgr.34427) 6452 : cluster [DBG] pgmap v3666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:55.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:54 gibba020 bash[25448]: cephadm 2021-03-10T15:54:52.872091+0000 mgr.gibba020.yqfnwy (mgr.34427) 6438 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:54:55.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:54 gibba020 bash[25448]: cephadm 2021-03-10T15:54:52.873904+0000 mgr.gibba020.yqfnwy (mgr.34427) 6439 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:54:55.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:54 gibba020 bash[25448]: cephadm 2021-03-10T15:54:52.875686+0000 mgr.gibba020.yqfnwy (mgr.34427) 6440 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:54:55.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:54 gibba020 bash[25448]: cephadm 2021-03-10T15:54:52.875724+0000 mgr.gibba020.yqfnwy (mgr.34427) 6441 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:54:55.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:54 gibba020 bash[25448]: cephadm 2021-03-10T15:54:52.877084+0000 mgr.gibba020.yqfnwy (mgr.34427) 6442 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:54:55.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:54 gibba020 bash[25448]: cephadm 2021-03-10T15:54:52.877119+0000 mgr.gibba020.yqfnwy (mgr.34427) 6443 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:54:55.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:54 gibba020 bash[25448]: cephadm 2021-03-10T15:54:52.878832+0000 mgr.gibba020.yqfnwy (mgr.34427) 6444 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:54:55.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:54 gibba020 bash[25448]: cephadm 2021-03-10T15:54:52.880250+0000 mgr.gibba020.yqfnwy (mgr.34427) 6445 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:54:55.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:54 gibba020 bash[25448]: cephadm 2021-03-10T15:54:52.880280+0000 mgr.gibba020.yqfnwy (mgr.34427) 6446 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:54:55.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:54 gibba020 bash[25448]: cephadm 2021-03-10T15:54:52.881941+0000 mgr.gibba020.yqfnwy (mgr.34427) 6447 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:54:55.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:54 gibba020 bash[25448]: cephadm 2021-03-10T15:54:52.882254+0000 mgr.gibba020.yqfnwy (mgr.34427) 6448 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:54:55.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:54 gibba020 bash[25448]: cephadm 2021-03-10T15:54:52.883904+0000 mgr.gibba020.yqfnwy (mgr.34427) 6449 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:54:55.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:54 gibba020 bash[25448]: cephadm 2021-03-10T15:54:52.883981+0000 mgr.gibba020.yqfnwy (mgr.34427) 6450 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:54:55.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:54 gibba020 bash[25448]: cephadm 2021-03-10T15:54:52.884147+0000 mgr.gibba020.yqfnwy (mgr.34427) 6451 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:54:55.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:54 gibba020 bash[25448]: cluster 2021-03-10T15:54:53.724882+0000 mgr.gibba020.yqfnwy (mgr.34427) 6452 : cluster [DBG] pgmap v3666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:57.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:56 gibba013 bash[29418]: cluster 2021-03-10T15:54:55.726738+0000 mgr.gibba020.yqfnwy (mgr.34427) 6453 : cluster [DBG] pgmap v3667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:57.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:56 gibba013 bash[30381]: cluster 2021-03-10T15:54:55.726738+0000 mgr.gibba020.yqfnwy (mgr.34427) 6453 : cluster [DBG] pgmap v3667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:57.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:56 gibba020 bash[25448]: cluster 2021-03-10T15:54:55.726738+0000 mgr.gibba020.yqfnwy (mgr.34427) 6453 : cluster [DBG] pgmap v3667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:59.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:54:58 gibba013 bash[29418]: cluster 2021-03-10T15:54:57.728271+0000 mgr.gibba020.yqfnwy (mgr.34427) 6454 : cluster [DBG] pgmap v3668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:59.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:54:58 gibba013 bash[30381]: cluster 2021-03-10T15:54:57.728271+0000 mgr.gibba020.yqfnwy (mgr.34427) 6454 : cluster [DBG] pgmap v3668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:54:59.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:54:58 gibba020 bash[25448]: cluster 2021-03-10T15:54:57.728271+0000 mgr.gibba020.yqfnwy (mgr.34427) 6454 : cluster [DBG] pgmap v3668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:01.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:00 gibba013 bash[29418]: cluster 2021-03-10T15:54:59.729614+0000 mgr.gibba020.yqfnwy (mgr.34427) 6455 : cluster [DBG] pgmap v3669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:01.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:00 gibba013 bash[30381]: cluster 2021-03-10T15:54:59.729614+0000 mgr.gibba020.yqfnwy (mgr.34427) 6455 : cluster [DBG] pgmap v3669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:01.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:00 gibba020 bash[25448]: cluster 2021-03-10T15:54:59.729614+0000 mgr.gibba020.yqfnwy (mgr.34427) 6455 : cluster [DBG] pgmap v3669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:03.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:02 gibba013 bash[29418]: cluster 2021-03-10T15:55:01.730727+0000 mgr.gibba020.yqfnwy (mgr.34427) 6456 : cluster [DBG] pgmap v3670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:03.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:02 gibba013 bash[30381]: cluster 2021-03-10T15:55:01.730727+0000 mgr.gibba020.yqfnwy (mgr.34427) 6456 : cluster [DBG] pgmap v3670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:03.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:02 gibba020 bash[25448]: cluster 2021-03-10T15:55:01.730727+0000 mgr.gibba020.yqfnwy (mgr.34427) 6456 : cluster [DBG] pgmap v3670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:04.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:04 gibba013 bash[29418]: cluster 2021-03-10T15:55:03.732460+0000 mgr.gibba020.yqfnwy (mgr.34427) 6457 : cluster [DBG] pgmap v3671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:04.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:04 gibba013 bash[30381]: cluster 2021-03-10T15:55:03.732460+0000 mgr.gibba020.yqfnwy (mgr.34427) 6457 : cluster [DBG] pgmap v3671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:04.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:04 gibba020 bash[25448]: cluster 2021-03-10T15:55:03.732460+0000 mgr.gibba020.yqfnwy (mgr.34427) 6457 : cluster [DBG] pgmap v3671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:07.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:06 gibba013 bash[29418]: cluster 2021-03-10T15:55:05.734330+0000 mgr.gibba020.yqfnwy (mgr.34427) 6458 : cluster [DBG] pgmap v3672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:07.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:06 gibba013 bash[29418]: audit 2021-03-10T15:55:06.586262+0000 mon.a (mon.0) 2504 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:55:07.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:06 gibba013 bash[29418]: audit 2021-03-10T15:55:06.661602+0000 mon.a (mon.0) 2505 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:55:07.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:06 gibba013 bash[30381]: cluster 2021-03-10T15:55:05.734330+0000 mgr.gibba020.yqfnwy (mgr.34427) 6458 : cluster [DBG] pgmap v3672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:07.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:06 gibba013 bash[30381]: audit 2021-03-10T15:55:06.586262+0000 mon.a (mon.0) 2504 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:55:07.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:06 gibba013 bash[30381]: audit 2021-03-10T15:55:06.661602+0000 mon.a (mon.0) 2505 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:55:07.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:06 gibba020 bash[25448]: cluster 2021-03-10T15:55:05.734330+0000 mgr.gibba020.yqfnwy (mgr.34427) 6458 : cluster [DBG] pgmap v3672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:07.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:06 gibba020 bash[25448]: audit 2021-03-10T15:55:06.586262+0000 mon.a (mon.0) 2504 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:55:07.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:06 gibba020 bash[25448]: audit 2021-03-10T15:55:06.661602+0000 mon.a (mon.0) 2505 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:55:08.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:07 gibba013 bash[29418]: audit 2021-03-10T15:55:06.824179+0000 mon.a (mon.0) 2506 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T15:55:08.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:07 gibba013 bash[29418]: audit 2021-03-10T15:55:06.824389+0000 mon.a (mon.0) 2507 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:55:08.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:07 gibba013 bash[29418]: audit 2021-03-10T15:55:06.824563+0000 mon.a (mon.0) 2508 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:55:08.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:07 gibba013 bash[29418]: audit 2021-03-10T15:55:06.824743+0000 mon.a (mon.0) 2509 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:55:08.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:07 gibba013 bash[30381]: audit 2021-03-10T15:55:06.824179+0000 mon.a (mon.0) 2506 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T15:55:08.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:07 gibba013 bash[30381]: audit 2021-03-10T15:55:06.824389+0000 mon.a (mon.0) 2507 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:55:08.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:07 gibba013 bash[30381]: audit 2021-03-10T15:55:06.824563+0000 mon.a (mon.0) 2508 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:55:08.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:07 gibba013 bash[30381]: audit 2021-03-10T15:55:06.824743+0000 mon.a (mon.0) 2509 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:55:08.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:07 gibba020 bash[25448]: audit 2021-03-10T15:55:06.824179+0000 mon.a (mon.0) 2506 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T15:55:08.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:07 gibba020 bash[25448]: audit 2021-03-10T15:55:06.824389+0000 mon.a (mon.0) 2507 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T15:55:08.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:07 gibba020 bash[25448]: audit 2021-03-10T15:55:06.824563+0000 mon.a (mon.0) 2508 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T15:55:08.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:07 gibba020 bash[25448]: audit 2021-03-10T15:55:06.824743+0000 mon.a (mon.0) 2509 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T15:55:09.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:08 gibba013 bash[29418]: cluster 2021-03-10T15:55:07.735828+0000 mgr.gibba020.yqfnwy (mgr.34427) 6459 : cluster [DBG] pgmap v3673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:09.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:08 gibba013 bash[30381]: cluster 2021-03-10T15:55:07.735828+0000 mgr.gibba020.yqfnwy (mgr.34427) 6459 : cluster [DBG] pgmap v3673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:09.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:08 gibba020 bash[25448]: cluster 2021-03-10T15:55:07.735828+0000 mgr.gibba020.yqfnwy (mgr.34427) 6459 : cluster [DBG] pgmap v3673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:10.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:09 gibba013 bash[29418]: cephadm 2021-03-10T15:55:07.899932+0000 mgr.gibba020.yqfnwy (mgr.34427) 6460 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:55:10.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:09 gibba013 bash[30381]: cephadm 2021-03-10T15:55:07.899932+0000 mgr.gibba020.yqfnwy (mgr.34427) 6460 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:55:10.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:09 gibba020 bash[25448]: cephadm 2021-03-10T15:55:07.899932+0000 mgr.gibba020.yqfnwy (mgr.34427) 6460 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:55:11.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:10 gibba013 bash[29418]: cluster 2021-03-10T15:55:09.737444+0000 mgr.gibba020.yqfnwy (mgr.34427) 6461 : cluster [DBG] pgmap v3674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:11.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:10 gibba013 bash[30381]: cluster 2021-03-10T15:55:09.737444+0000 mgr.gibba020.yqfnwy (mgr.34427) 6461 : cluster [DBG] pgmap v3674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:11.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:10 gibba020 bash[25448]: cluster 2021-03-10T15:55:09.737444+0000 mgr.gibba020.yqfnwy (mgr.34427) 6461 : cluster [DBG] pgmap v3674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:13.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:12 gibba013 bash[29418]: cluster 2021-03-10T15:55:11.738616+0000 mgr.gibba020.yqfnwy (mgr.34427) 6462 : cluster [DBG] pgmap v3675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:13.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:12 gibba013 bash[30381]: cluster 2021-03-10T15:55:11.738616+0000 mgr.gibba020.yqfnwy (mgr.34427) 6462 : cluster [DBG] pgmap v3675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:13.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:12 gibba020 bash[25448]: cluster 2021-03-10T15:55:11.738616+0000 mgr.gibba020.yqfnwy (mgr.34427) 6462 : cluster [DBG] pgmap v3675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:14.215 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:55:14.449 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:55:14.450 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 5m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:55:14.450 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 4m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:55:14.450 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:55:14.450 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:55:14.451 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:55:14.451 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:55:14.451 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:55:14.451 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:55:14.452 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:55:14.452 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:55:14.452 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:55:14.452 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (119m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:55:14.452 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (119m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:55:14.453 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (118m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:55:14.453 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (118m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:55:14.453 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (117m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:55:14.453 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (117m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:55:14.453 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (116m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:55:14.454 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 4m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:55:14.454 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 4m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:55:14.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:14 gibba013 bash[29418]: cluster 2021-03-10T15:55:13.740157+0000 mgr.gibba020.yqfnwy (mgr.34427) 6463 : cluster [DBG] pgmap v3676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:14.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:14 gibba013 bash[30381]: cluster 2021-03-10T15:55:13.740157+0000 mgr.gibba020.yqfnwy (mgr.34427) 6463 : cluster [DBG] pgmap v3676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:14.699 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:55:14.701 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:55:14.702 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:55:14.702 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:55:14.702 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:55:14.703 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:55:14.703 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:55:14.703 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:55:14.703 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:55:14.703 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:55:14.704 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:55:14.704 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:55:14.704 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:55:14.704 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:55:14.705 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:55:14.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:14 gibba020 bash[25448]: cluster 2021-03-10T15:55:13.740157+0000 mgr.gibba020.yqfnwy (mgr.34427) 6463 : cluster [DBG] pgmap v3676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:15.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:15 gibba013 bash[29418]: audit 2021-03-10T15:55:14.204217+0000 mgr.gibba020.yqfnwy (mgr.34427) 6464 : audit [DBG] from='client.48390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:55:15.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:15 gibba013 bash[29418]: audit 2021-03-10T15:55:14.434753+0000 mgr.gibba020.yqfnwy (mgr.34427) 6465 : audit [DBG] from='client.58381 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:55:15.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:15 gibba013 bash[29418]: audit 2021-03-10T15:55:14.698393+0000 mon.a (mon.0) 2510 : audit [DBG] from='client.? 172.21.2.113:0/3688448845' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:15.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:15 gibba013 bash[30381]: audit 2021-03-10T15:55:14.204217+0000 mgr.gibba020.yqfnwy (mgr.34427) 6464 : audit [DBG] from='client.48390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:55:15.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:15 gibba013 bash[30381]: audit 2021-03-10T15:55:14.434753+0000 mgr.gibba020.yqfnwy (mgr.34427) 6465 : audit [DBG] from='client.58381 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:55:15.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:15 gibba013 bash[30381]: audit 2021-03-10T15:55:14.698393+0000 mon.a (mon.0) 2510 : audit [DBG] from='client.? 172.21.2.113:0/3688448845' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:15.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:15 gibba020 bash[25448]: audit 2021-03-10T15:55:14.204217+0000 mgr.gibba020.yqfnwy (mgr.34427) 6464 : audit [DBG] from='client.48390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:55:15.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:15 gibba020 bash[25448]: audit 2021-03-10T15:55:14.434753+0000 mgr.gibba020.yqfnwy (mgr.34427) 6465 : audit [DBG] from='client.58381 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:55:15.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:15 gibba020 bash[25448]: audit 2021-03-10T15:55:14.698393+0000 mon.a (mon.0) 2510 : audit [DBG] from='client.? 172.21.2.113:0/3688448845' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:16.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:16 gibba013 bash[29418]: cluster 2021-03-10T15:55:15.741619+0000 mgr.gibba020.yqfnwy (mgr.34427) 6466 : cluster [DBG] pgmap v3677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:16.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:16 gibba013 bash[30381]: cluster 2021-03-10T15:55:15.741619+0000 mgr.gibba020.yqfnwy (mgr.34427) 6466 : cluster [DBG] pgmap v3677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:16.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:16 gibba020 bash[25448]: cluster 2021-03-10T15:55:15.741619+0000 mgr.gibba020.yqfnwy (mgr.34427) 6466 : cluster [DBG] pgmap v3677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:19.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:18 gibba013 bash[29418]: cluster 2021-03-10T15:55:17.743141+0000 mgr.gibba020.yqfnwy (mgr.34427) 6467 : cluster [DBG] pgmap v3678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:19.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:18 gibba013 bash[30381]: cluster 2021-03-10T15:55:17.743141+0000 mgr.gibba020.yqfnwy (mgr.34427) 6467 : cluster [DBG] pgmap v3678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:19.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:18 gibba020 bash[25448]: cluster 2021-03-10T15:55:17.743141+0000 mgr.gibba020.yqfnwy (mgr.34427) 6467 : cluster [DBG] pgmap v3678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:21.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:20 gibba013 bash[29418]: cluster 2021-03-10T15:55:19.744667+0000 mgr.gibba020.yqfnwy (mgr.34427) 6468 : cluster [DBG] pgmap v3679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:21.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:20 gibba013 bash[30381]: cluster 2021-03-10T15:55:19.744667+0000 mgr.gibba020.yqfnwy (mgr.34427) 6468 : cluster [DBG] pgmap v3679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:21.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:20 gibba020 bash[25448]: cluster 2021-03-10T15:55:19.744667+0000 mgr.gibba020.yqfnwy (mgr.34427) 6468 : cluster [DBG] pgmap v3679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:23.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:22 gibba013 bash[29418]: cluster 2021-03-10T15:55:21.746398+0000 mgr.gibba020.yqfnwy (mgr.34427) 6469 : cluster [DBG] pgmap v3680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:23.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:22 gibba013 bash[30381]: cluster 2021-03-10T15:55:21.746398+0000 mgr.gibba020.yqfnwy (mgr.34427) 6469 : cluster [DBG] pgmap v3680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:23.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:22 gibba020 bash[25448]: cluster 2021-03-10T15:55:21.746398+0000 mgr.gibba020.yqfnwy (mgr.34427) 6469 : cluster [DBG] pgmap v3680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:24.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:24 gibba013 bash[29418]: cephadm 2021-03-10T15:55:22.915867+0000 mgr.gibba020.yqfnwy (mgr.34427) 6470 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:55:24.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:24 gibba013 bash[29418]: cluster 2021-03-10T15:55:23.747877+0000 mgr.gibba020.yqfnwy (mgr.34427) 6471 : cluster [DBG] pgmap v3681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:24.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:24 gibba013 bash[30381]: cephadm 2021-03-10T15:55:22.915867+0000 mgr.gibba020.yqfnwy (mgr.34427) 6470 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:55:24.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:24 gibba013 bash[30381]: cluster 2021-03-10T15:55:23.747877+0000 mgr.gibba020.yqfnwy (mgr.34427) 6471 : cluster [DBG] pgmap v3681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:24.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:24 gibba020 bash[25448]: cephadm 2021-03-10T15:55:22.915867+0000 mgr.gibba020.yqfnwy (mgr.34427) 6470 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:55:24.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:24 gibba020 bash[25448]: cluster 2021-03-10T15:55:23.747877+0000 mgr.gibba020.yqfnwy (mgr.34427) 6471 : cluster [DBG] pgmap v3681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:27.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:26 gibba013 bash[29418]: cluster 2021-03-10T15:55:25.749413+0000 mgr.gibba020.yqfnwy (mgr.34427) 6472 : cluster [DBG] pgmap v3682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:27.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:26 gibba013 bash[30381]: cluster 2021-03-10T15:55:25.749413+0000 mgr.gibba020.yqfnwy (mgr.34427) 6472 : cluster [DBG] pgmap v3682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:27.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:26 gibba020 bash[25448]: cluster 2021-03-10T15:55:25.749413+0000 mgr.gibba020.yqfnwy (mgr.34427) 6472 : cluster [DBG] pgmap v3682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:29.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:28 gibba013 bash[29418]: cluster 2021-03-10T15:55:27.750809+0000 mgr.gibba020.yqfnwy (mgr.34427) 6473 : cluster [DBG] pgmap v3683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:29.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:28 gibba013 bash[30381]: cluster 2021-03-10T15:55:27.750809+0000 mgr.gibba020.yqfnwy (mgr.34427) 6473 : cluster [DBG] pgmap v3683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:29.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:28 gibba020 bash[25448]: cluster 2021-03-10T15:55:27.750809+0000 mgr.gibba020.yqfnwy (mgr.34427) 6473 : cluster [DBG] pgmap v3683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:31.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:30 gibba013 bash[29418]: cluster 2021-03-10T15:55:29.752585+0000 mgr.gibba020.yqfnwy (mgr.34427) 6474 : cluster [DBG] pgmap v3684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:31.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:30 gibba013 bash[30381]: cluster 2021-03-10T15:55:29.752585+0000 mgr.gibba020.yqfnwy (mgr.34427) 6474 : cluster [DBG] pgmap v3684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:31.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:30 gibba020 bash[25448]: cluster 2021-03-10T15:55:29.752585+0000 mgr.gibba020.yqfnwy (mgr.34427) 6474 : cluster [DBG] pgmap v3684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:33.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:32 gibba013 bash[29418]: cluster 2021-03-10T15:55:31.753930+0000 mgr.gibba020.yqfnwy (mgr.34427) 6475 : cluster [DBG] pgmap v3685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:33.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:32 gibba013 bash[30381]: cluster 2021-03-10T15:55:31.753930+0000 mgr.gibba020.yqfnwy (mgr.34427) 6475 : cluster [DBG] pgmap v3685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:33.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:32 gibba020 bash[25448]: cluster 2021-03-10T15:55:31.753930+0000 mgr.gibba020.yqfnwy (mgr.34427) 6475 : cluster [DBG] pgmap v3685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:34.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:34 gibba013 bash[29418]: cluster 2021-03-10T15:55:33.755746+0000 mgr.gibba020.yqfnwy (mgr.34427) 6476 : cluster [DBG] pgmap v3686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:34.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:34 gibba013 bash[30381]: cluster 2021-03-10T15:55:33.755746+0000 mgr.gibba020.yqfnwy (mgr.34427) 6476 : cluster [DBG] pgmap v3686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:34.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:34 gibba020 bash[25448]: cluster 2021-03-10T15:55:33.755746+0000 mgr.gibba020.yqfnwy (mgr.34427) 6476 : cluster [DBG] pgmap v3686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:37.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:36 gibba013 bash[29418]: cluster 2021-03-10T15:55:35.757709+0000 mgr.gibba020.yqfnwy (mgr.34427) 6477 : cluster [DBG] pgmap v3687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:37.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:36 gibba013 bash[30381]: cluster 2021-03-10T15:55:35.757709+0000 mgr.gibba020.yqfnwy (mgr.34427) 6477 : cluster [DBG] pgmap v3687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:37.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:36 gibba020 bash[25448]: cluster 2021-03-10T15:55:35.757709+0000 mgr.gibba020.yqfnwy (mgr.34427) 6477 : cluster [DBG] pgmap v3687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:39.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:38 gibba013 bash[29418]: cluster 2021-03-10T15:55:37.759286+0000 mgr.gibba020.yqfnwy (mgr.34427) 6478 : cluster [DBG] pgmap v3688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:39.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:38 gibba013 bash[30381]: cluster 2021-03-10T15:55:37.759286+0000 mgr.gibba020.yqfnwy (mgr.34427) 6478 : cluster [DBG] pgmap v3688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:39.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:38 gibba020 bash[25448]: cluster 2021-03-10T15:55:37.759286+0000 mgr.gibba020.yqfnwy (mgr.34427) 6478 : cluster [DBG] pgmap v3688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:40.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:39 gibba013 bash[29418]: cephadm 2021-03-10T15:55:37.931787+0000 mgr.gibba020.yqfnwy (mgr.34427) 6479 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:55:40.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:39 gibba013 bash[30381]: cephadm 2021-03-10T15:55:37.931787+0000 mgr.gibba020.yqfnwy (mgr.34427) 6479 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:55:40.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:39 gibba020 bash[25448]: cephadm 2021-03-10T15:55:37.931787+0000 mgr.gibba020.yqfnwy (mgr.34427) 6479 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:55:41.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:40 gibba013 bash[29418]: cluster 2021-03-10T15:55:39.760976+0000 mgr.gibba020.yqfnwy (mgr.34427) 6480 : cluster [DBG] pgmap v3689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:41.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:40 gibba013 bash[30381]: cluster 2021-03-10T15:55:39.760976+0000 mgr.gibba020.yqfnwy (mgr.34427) 6480 : cluster [DBG] pgmap v3689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:41.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:40 gibba020 bash[25448]: cluster 2021-03-10T15:55:39.760976+0000 mgr.gibba020.yqfnwy (mgr.34427) 6480 : cluster [DBG] pgmap v3689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:43.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:42 gibba013 bash[29418]: cluster 2021-03-10T15:55:41.762599+0000 mgr.gibba020.yqfnwy (mgr.34427) 6481 : cluster [DBG] pgmap v3690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:43.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:42 gibba013 bash[30381]: cluster 2021-03-10T15:55:41.762599+0000 mgr.gibba020.yqfnwy (mgr.34427) 6481 : cluster [DBG] pgmap v3690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:43.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:42 gibba020 bash[25448]: cluster 2021-03-10T15:55:41.762599+0000 mgr.gibba020.yqfnwy (mgr.34427) 6481 : cluster [DBG] pgmap v3690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:44.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:44 gibba013 bash[29418]: cluster 2021-03-10T15:55:43.764139+0000 mgr.gibba020.yqfnwy (mgr.34427) 6482 : cluster [DBG] pgmap v3691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:44.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:44 gibba013 bash[30381]: cluster 2021-03-10T15:55:43.764139+0000 mgr.gibba020.yqfnwy (mgr.34427) 6482 : cluster [DBG] pgmap v3691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:44.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:44 gibba020 bash[25448]: cluster 2021-03-10T15:55:43.764139+0000 mgr.gibba020.yqfnwy (mgr.34427) 6482 : cluster [DBG] pgmap v3691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:44.942 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:55:45.171 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:55:45.172 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 6m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:55:45.172 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 4m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:55:45.172 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:55:45.172 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:55:45.173 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:55:45.173 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:55:45.173 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:55:45.173 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:55:45.174 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:55:45.174 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:55:45.174 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:55:45.174 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:55:45.175 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (119m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:55:45.175 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (119m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:55:45.175 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (118m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:55:45.175 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (118m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:55:45.176 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (117m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:55:45.176 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (117m) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:55:45.176 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 4m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:55:45.176 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 4m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:55:45.424 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:55:45.424 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:55:45.425 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:55:45.425 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:55:45.425 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:55:45.425 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:55:45.426 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:55:45.426 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:55:45.426 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:55:45.426 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:55:45.426 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:55:45.427 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:55:45.427 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:55:45.427 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:55:45.427 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:55:45.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:45 gibba013 bash[29418]: audit 2021-03-10T15:55:45.423676+0000 mon.a (mon.0) 2511 : audit [DBG] from='client.? 172.21.2.113:0/232420313' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:45.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:45 gibba013 bash[30381]: audit 2021-03-10T15:55:45.423676+0000 mon.a (mon.0) 2511 : audit [DBG] from='client.? 172.21.2.113:0/232420313' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:45.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:45 gibba020 bash[25448]: audit 2021-03-10T15:55:45.423676+0000 mon.a (mon.0) 2511 : audit [DBG] from='client.? 172.21.2.113:0/232420313' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:46.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:46 gibba013 bash[29418]: audit 2021-03-10T15:55:44.931457+0000 mgr.gibba020.yqfnwy (mgr.34427) 6483 : audit [DBG] from='client.48408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:55:46.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:46 gibba013 bash[29418]: audit 2021-03-10T15:55:45.156850+0000 mgr.gibba020.yqfnwy (mgr.34427) 6484 : audit [DBG] from='client.58399 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:55:46.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:46 gibba013 bash[29418]: cluster 2021-03-10T15:55:45.765879+0000 mgr.gibba020.yqfnwy (mgr.34427) 6485 : cluster [DBG] pgmap v3692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:46.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:46 gibba013 bash[30381]: audit 2021-03-10T15:55:44.931457+0000 mgr.gibba020.yqfnwy (mgr.34427) 6483 : audit [DBG] from='client.48408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:55:46.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:46 gibba013 bash[30381]: audit 2021-03-10T15:55:45.156850+0000 mgr.gibba020.yqfnwy (mgr.34427) 6484 : audit [DBG] from='client.58399 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:55:46.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:46 gibba013 bash[30381]: cluster 2021-03-10T15:55:45.765879+0000 mgr.gibba020.yqfnwy (mgr.34427) 6485 : cluster [DBG] pgmap v3692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:46.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:46 gibba020 bash[25448]: audit 2021-03-10T15:55:44.931457+0000 mgr.gibba020.yqfnwy (mgr.34427) 6483 : audit [DBG] from='client.48408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:55:46.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:46 gibba020 bash[25448]: audit 2021-03-10T15:55:45.156850+0000 mgr.gibba020.yqfnwy (mgr.34427) 6484 : audit [DBG] from='client.58399 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:55:46.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:46 gibba020 bash[25448]: cluster 2021-03-10T15:55:45.765879+0000 mgr.gibba020.yqfnwy (mgr.34427) 6485 : cluster [DBG] pgmap v3692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:49.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:48 gibba013 bash[29418]: cluster 2021-03-10T15:55:47.767158+0000 mgr.gibba020.yqfnwy (mgr.34427) 6486 : cluster [DBG] pgmap v3693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:49.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:48 gibba013 bash[30381]: cluster 2021-03-10T15:55:47.767158+0000 mgr.gibba020.yqfnwy (mgr.34427) 6486 : cluster [DBG] pgmap v3693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:49.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:48 gibba020 bash[25448]: cluster 2021-03-10T15:55:47.767158+0000 mgr.gibba020.yqfnwy (mgr.34427) 6486 : cluster [DBG] pgmap v3693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:51.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:50 gibba013 bash[29418]: cluster 2021-03-10T15:55:49.768661+0000 mgr.gibba020.yqfnwy (mgr.34427) 6487 : cluster [DBG] pgmap v3694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:51.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:50 gibba013 bash[30381]: cluster 2021-03-10T15:55:49.768661+0000 mgr.gibba020.yqfnwy (mgr.34427) 6487 : cluster [DBG] pgmap v3694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:51.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:50 gibba020 bash[25448]: cluster 2021-03-10T15:55:49.768661+0000 mgr.gibba020.yqfnwy (mgr.34427) 6487 : cluster [DBG] pgmap v3694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:53.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:52 gibba013 bash[29418]: cluster 2021-03-10T15:55:51.770402+0000 mgr.gibba020.yqfnwy (mgr.34427) 6488 : cluster [DBG] pgmap v3695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:53.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:52 gibba013 bash[30381]: cluster 2021-03-10T15:55:51.770402+0000 mgr.gibba020.yqfnwy (mgr.34427) 6488 : cluster [DBG] pgmap v3695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:53.156 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:52 gibba020 bash[25448]: cluster 2021-03-10T15:55:51.770402+0000 mgr.gibba020.yqfnwy (mgr.34427) 6488 : cluster [DBG] pgmap v3695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:54.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:53 gibba013 bash[29418]: audit 2021-03-10T15:55:52.935050+0000 mon.a (mon.0) 2512 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:55:54.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:53 gibba013 bash[29418]: audit 2021-03-10T15:55:53.145735+0000 mon.a (mon.0) 2513 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:55:54.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:53 gibba013 bash[29418]: audit 2021-03-10T15:55:53.148764+0000 mon.a (mon.0) 2514 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:55:54.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:53 gibba013 bash[29418]: audit 2021-03-10T15:55:53.150281+0000 mon.a (mon.0) 2515 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:54.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:53 gibba013 bash[29418]: audit 2021-03-10T15:55:53.151229+0000 mon.a (mon.0) 2516 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:54.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:53 gibba013 bash[29418]: audit 2021-03-10T15:55:53.152029+0000 mon.a (mon.0) 2517 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:54.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:53 gibba013 bash[29418]: audit 2021-03-10T15:55:53.153776+0000 mon.a (mon.0) 2518 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:54.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:53 gibba013 bash[29418]: audit 2021-03-10T15:55:53.155010+0000 mon.a (mon.0) 2519 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:54.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:53 gibba013 bash[30381]: audit 2021-03-10T15:55:52.935050+0000 mon.a (mon.0) 2512 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:55:54.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:53 gibba013 bash[30381]: audit 2021-03-10T15:55:53.145735+0000 mon.a (mon.0) 2513 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:55:54.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:53 gibba013 bash[30381]: audit 2021-03-10T15:55:53.148764+0000 mon.a (mon.0) 2514 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:55:54.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:53 gibba013 bash[30381]: audit 2021-03-10T15:55:53.150281+0000 mon.a (mon.0) 2515 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:54.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:53 gibba013 bash[30381]: audit 2021-03-10T15:55:53.151229+0000 mon.a (mon.0) 2516 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:54.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:53 gibba013 bash[30381]: audit 2021-03-10T15:55:53.152029+0000 mon.a (mon.0) 2517 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:54.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:53 gibba013 bash[30381]: audit 2021-03-10T15:55:53.153776+0000 mon.a (mon.0) 2518 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:54.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:53 gibba013 bash[30381]: audit 2021-03-10T15:55:53.155010+0000 mon.a (mon.0) 2519 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:54.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:53 gibba020 bash[25448]: audit 2021-03-10T15:55:52.935050+0000 mon.a (mon.0) 2512 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:55:54.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:53 gibba020 bash[25448]: audit 2021-03-10T15:55:53.145735+0000 mon.a (mon.0) 2513 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:55:54.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:53 gibba020 bash[25448]: audit 2021-03-10T15:55:53.148764+0000 mon.a (mon.0) 2514 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:55:54.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:53 gibba020 bash[25448]: audit 2021-03-10T15:55:53.150281+0000 mon.a (mon.0) 2515 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:54.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:53 gibba020 bash[25448]: audit 2021-03-10T15:55:53.151229+0000 mon.a (mon.0) 2516 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:54.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:53 gibba020 bash[25448]: audit 2021-03-10T15:55:53.152029+0000 mon.a (mon.0) 2517 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:54.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:53 gibba020 bash[25448]: audit 2021-03-10T15:55:53.153776+0000 mon.a (mon.0) 2518 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:54.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:53 gibba020 bash[25448]: audit 2021-03-10T15:55:53.155010+0000 mon.a (mon.0) 2519 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:55:55.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:54 gibba013 bash[29418]: cephadm 2021-03-10T15:55:52.938016+0000 mgr.gibba020.yqfnwy (mgr.34427) 6489 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:55:55.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:54 gibba013 bash[29418]: cephadm 2021-03-10T15:55:52.940134+0000 mgr.gibba020.yqfnwy (mgr.34427) 6490 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:55:55.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:54 gibba013 bash[29418]: cephadm 2021-03-10T15:55:53.146692+0000 mgr.gibba020.yqfnwy (mgr.34427) 6491 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:55:55.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:54 gibba013 bash[29418]: cephadm 2021-03-10T15:55:53.148585+0000 mgr.gibba020.yqfnwy (mgr.34427) 6492 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:55:55.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:54 gibba013 bash[29418]: cephadm 2021-03-10T15:55:53.149494+0000 mgr.gibba020.yqfnwy (mgr.34427) 6493 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:55:55.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:54 gibba013 bash[29418]: cephadm 2021-03-10T15:55:53.149535+0000 mgr.gibba020.yqfnwy (mgr.34427) 6494 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:55:55.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:54 gibba013 bash[29418]: cephadm 2021-03-10T15:55:53.150383+0000 mgr.gibba020.yqfnwy (mgr.34427) 6495 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:55:55.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:54 gibba013 bash[29418]: cephadm 2021-03-10T15:55:53.150424+0000 mgr.gibba020.yqfnwy (mgr.34427) 6496 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:55:55.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:54 gibba013 bash[29418]: cephadm 2021-03-10T15:55:53.151236+0000 mgr.gibba020.yqfnwy (mgr.34427) 6497 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:55:55.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:54 gibba013 bash[29418]: cephadm 2021-03-10T15:55:53.151973+0000 mgr.gibba020.yqfnwy (mgr.34427) 6498 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:55:55.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:54 gibba013 bash[29418]: cephadm 2021-03-10T15:55:53.152010+0000 mgr.gibba020.yqfnwy (mgr.34427) 6499 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:55:55.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:54 gibba013 bash[29418]: cephadm 2021-03-10T15:55:53.153039+0000 mgr.gibba020.yqfnwy (mgr.34427) 6500 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:55:55.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:54 gibba013 bash[29418]: cephadm 2021-03-10T15:55:53.153391+0000 mgr.gibba020.yqfnwy (mgr.34427) 6501 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:55:55.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:54 gibba013 bash[29418]: cephadm 2021-03-10T15:55:53.154157+0000 mgr.gibba020.yqfnwy (mgr.34427) 6502 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:55:55.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:54 gibba013 bash[29418]: cephadm 2021-03-10T15:55:53.154196+0000 mgr.gibba020.yqfnwy (mgr.34427) 6503 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:55:55.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:54 gibba013 bash[29418]: cephadm 2021-03-10T15:55:53.154304+0000 mgr.gibba020.yqfnwy (mgr.34427) 6504 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:55:55.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:54 gibba013 bash[29418]: cluster 2021-03-10T15:55:53.771773+0000 mgr.gibba020.yqfnwy (mgr.34427) 6505 : cluster [DBG] pgmap v3696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:55.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:54 gibba013 bash[30381]: cephadm 2021-03-10T15:55:52.938016+0000 mgr.gibba020.yqfnwy (mgr.34427) 6489 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:55:55.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:54 gibba013 bash[30381]: cephadm 2021-03-10T15:55:52.940134+0000 mgr.gibba020.yqfnwy (mgr.34427) 6490 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:55:55.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:54 gibba013 bash[30381]: cephadm 2021-03-10T15:55:53.146692+0000 mgr.gibba020.yqfnwy (mgr.34427) 6491 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:55:55.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:54 gibba013 bash[30381]: cephadm 2021-03-10T15:55:53.148585+0000 mgr.gibba020.yqfnwy (mgr.34427) 6492 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:55:55.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:54 gibba013 bash[30381]: cephadm 2021-03-10T15:55:53.149494+0000 mgr.gibba020.yqfnwy (mgr.34427) 6493 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:55:55.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:54 gibba013 bash[30381]: cephadm 2021-03-10T15:55:53.149535+0000 mgr.gibba020.yqfnwy (mgr.34427) 6494 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:55:55.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:54 gibba013 bash[30381]: cephadm 2021-03-10T15:55:53.150383+0000 mgr.gibba020.yqfnwy (mgr.34427) 6495 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:55:55.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:54 gibba013 bash[30381]: cephadm 2021-03-10T15:55:53.150424+0000 mgr.gibba020.yqfnwy (mgr.34427) 6496 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:55:55.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:54 gibba013 bash[30381]: cephadm 2021-03-10T15:55:53.151236+0000 mgr.gibba020.yqfnwy (mgr.34427) 6497 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:55:55.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:54 gibba013 bash[30381]: cephadm 2021-03-10T15:55:53.151973+0000 mgr.gibba020.yqfnwy (mgr.34427) 6498 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:55:55.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:54 gibba013 bash[30381]: cephadm 2021-03-10T15:55:53.152010+0000 mgr.gibba020.yqfnwy (mgr.34427) 6499 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:55:55.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:54 gibba013 bash[30381]: cephadm 2021-03-10T15:55:53.153039+0000 mgr.gibba020.yqfnwy (mgr.34427) 6500 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:55:55.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:54 gibba013 bash[30381]: cephadm 2021-03-10T15:55:53.153391+0000 mgr.gibba020.yqfnwy (mgr.34427) 6501 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:55:55.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:54 gibba013 bash[30381]: cephadm 2021-03-10T15:55:53.154157+0000 mgr.gibba020.yqfnwy (mgr.34427) 6502 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:55:55.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:54 gibba013 bash[30381]: cephadm 2021-03-10T15:55:53.154196+0000 mgr.gibba020.yqfnwy (mgr.34427) 6503 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:55:55.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:54 gibba013 bash[30381]: cephadm 2021-03-10T15:55:53.154304+0000 mgr.gibba020.yqfnwy (mgr.34427) 6504 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:55:55.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:54 gibba013 bash[30381]: cluster 2021-03-10T15:55:53.771773+0000 mgr.gibba020.yqfnwy (mgr.34427) 6505 : cluster [DBG] pgmap v3696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:55.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:54 gibba020 bash[25448]: cephadm 2021-03-10T15:55:52.938016+0000 mgr.gibba020.yqfnwy (mgr.34427) 6489 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:55:55.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:54 gibba020 bash[25448]: cephadm 2021-03-10T15:55:52.940134+0000 mgr.gibba020.yqfnwy (mgr.34427) 6490 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:55:55.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:54 gibba020 bash[25448]: cephadm 2021-03-10T15:55:53.146692+0000 mgr.gibba020.yqfnwy (mgr.34427) 6491 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:55:55.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:54 gibba020 bash[25448]: cephadm 2021-03-10T15:55:53.148585+0000 mgr.gibba020.yqfnwy (mgr.34427) 6492 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:55:55.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:54 gibba020 bash[25448]: cephadm 2021-03-10T15:55:53.149494+0000 mgr.gibba020.yqfnwy (mgr.34427) 6493 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:55:55.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:54 gibba020 bash[25448]: cephadm 2021-03-10T15:55:53.149535+0000 mgr.gibba020.yqfnwy (mgr.34427) 6494 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:55:55.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:54 gibba020 bash[25448]: cephadm 2021-03-10T15:55:53.150383+0000 mgr.gibba020.yqfnwy (mgr.34427) 6495 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:55:55.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:54 gibba020 bash[25448]: cephadm 2021-03-10T15:55:53.150424+0000 mgr.gibba020.yqfnwy (mgr.34427) 6496 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:55:55.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:54 gibba020 bash[25448]: cephadm 2021-03-10T15:55:53.151236+0000 mgr.gibba020.yqfnwy (mgr.34427) 6497 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:55:55.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:54 gibba020 bash[25448]: cephadm 2021-03-10T15:55:53.151973+0000 mgr.gibba020.yqfnwy (mgr.34427) 6498 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:55:55.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:54 gibba020 bash[25448]: cephadm 2021-03-10T15:55:53.152010+0000 mgr.gibba020.yqfnwy (mgr.34427) 6499 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:55:55.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:54 gibba020 bash[25448]: cephadm 2021-03-10T15:55:53.153039+0000 mgr.gibba020.yqfnwy (mgr.34427) 6500 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:55:55.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:54 gibba020 bash[25448]: cephadm 2021-03-10T15:55:53.153391+0000 mgr.gibba020.yqfnwy (mgr.34427) 6501 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:55:55.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:54 gibba020 bash[25448]: cephadm 2021-03-10T15:55:53.154157+0000 mgr.gibba020.yqfnwy (mgr.34427) 6502 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:55:55.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:54 gibba020 bash[25448]: cephadm 2021-03-10T15:55:53.154196+0000 mgr.gibba020.yqfnwy (mgr.34427) 6503 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:55:55.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:54 gibba020 bash[25448]: cephadm 2021-03-10T15:55:53.154304+0000 mgr.gibba020.yqfnwy (mgr.34427) 6504 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:55:55.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:54 gibba020 bash[25448]: cluster 2021-03-10T15:55:53.771773+0000 mgr.gibba020.yqfnwy (mgr.34427) 6505 : cluster [DBG] pgmap v3696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:57.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:56 gibba013 bash[29418]: cluster 2021-03-10T15:55:55.773362+0000 mgr.gibba020.yqfnwy (mgr.34427) 6506 : cluster [DBG] pgmap v3697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:57.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:56 gibba013 bash[30381]: cluster 2021-03-10T15:55:55.773362+0000 mgr.gibba020.yqfnwy (mgr.34427) 6506 : cluster [DBG] pgmap v3697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:57.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:56 gibba020 bash[25448]: cluster 2021-03-10T15:55:55.773362+0000 mgr.gibba020.yqfnwy (mgr.34427) 6506 : cluster [DBG] pgmap v3697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:59.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:55:58 gibba013 bash[29418]: cluster 2021-03-10T15:55:57.774788+0000 mgr.gibba020.yqfnwy (mgr.34427) 6507 : cluster [DBG] pgmap v3698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:59.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:55:58 gibba013 bash[30381]: cluster 2021-03-10T15:55:57.774788+0000 mgr.gibba020.yqfnwy (mgr.34427) 6507 : cluster [DBG] pgmap v3698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:55:59.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:55:58 gibba020 bash[25448]: cluster 2021-03-10T15:55:57.774788+0000 mgr.gibba020.yqfnwy (mgr.34427) 6507 : cluster [DBG] pgmap v3698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:01.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:00 gibba020 bash[25448]: cluster 2021-03-10T15:55:59.776301+0000 mgr.gibba020.yqfnwy (mgr.34427) 6508 : cluster [DBG] pgmap v3699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:01.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:00 gibba013 bash[29418]: cluster 2021-03-10T15:55:59.776301+0000 mgr.gibba020.yqfnwy (mgr.34427) 6508 : cluster [DBG] pgmap v3699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:01.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:00 gibba013 bash[30381]: cluster 2021-03-10T15:55:59.776301+0000 mgr.gibba020.yqfnwy (mgr.34427) 6508 : cluster [DBG] pgmap v3699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:03.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:02 gibba020 bash[25448]: cluster 2021-03-10T15:56:01.777813+0000 mgr.gibba020.yqfnwy (mgr.34427) 6509 : cluster [DBG] pgmap v3700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:03.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:02 gibba013 bash[29418]: cluster 2021-03-10T15:56:01.777813+0000 mgr.gibba020.yqfnwy (mgr.34427) 6509 : cluster [DBG] pgmap v3700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:03.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:02 gibba013 bash[30381]: cluster 2021-03-10T15:56:01.777813+0000 mgr.gibba020.yqfnwy (mgr.34427) 6509 : cluster [DBG] pgmap v3700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:04.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:04 gibba013 bash[29418]: cluster 2021-03-10T15:56:03.779334+0000 mgr.gibba020.yqfnwy (mgr.34427) 6510 : cluster [DBG] pgmap v3701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:04.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:04 gibba013 bash[30381]: cluster 2021-03-10T15:56:03.779334+0000 mgr.gibba020.yqfnwy (mgr.34427) 6510 : cluster [DBG] pgmap v3701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:04.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:04 gibba020 bash[25448]: cluster 2021-03-10T15:56:03.779334+0000 mgr.gibba020.yqfnwy (mgr.34427) 6510 : cluster [DBG] pgmap v3701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:07.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:06 gibba013 bash[29418]: cluster 2021-03-10T15:56:05.781124+0000 mgr.gibba020.yqfnwy (mgr.34427) 6511 : cluster [DBG] pgmap v3702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:07.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:06 gibba013 bash[29418]: audit 2021-03-10T15:56:06.591371+0000 mon.a (mon.0) 2520 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:56:07.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:06 gibba013 bash[29418]: audit 2021-03-10T15:56:06.665151+0000 mon.a (mon.0) 2521 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:56:07.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:06 gibba013 bash[29418]: audit 2021-03-10T15:56:06.828750+0000 mon.a (mon.0) 2522 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T15:56:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:06 gibba013 bash[29418]: audit 2021-03-10T15:56:06.829613+0000 mon.a (mon.0) 2523 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:56:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:06 gibba013 bash[29418]: audit 2021-03-10T15:56:06.830451+0000 mon.a (mon.0) 2524 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:56:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:06 gibba013 bash[29418]: audit 2021-03-10T15:56:06.831244+0000 mon.a (mon.0) 2525 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T15:56:07.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:06 gibba013 bash[30381]: cluster 2021-03-10T15:56:05.781124+0000 mgr.gibba020.yqfnwy (mgr.34427) 6511 : cluster [DBG] pgmap v3702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:07.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:06 gibba013 bash[30381]: audit 2021-03-10T15:56:06.591371+0000 mon.a (mon.0) 2520 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:56:07.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:06 gibba013 bash[30381]: audit 2021-03-10T15:56:06.665151+0000 mon.a (mon.0) 2521 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:56:07.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:06 gibba013 bash[30381]: audit 2021-03-10T15:56:06.828750+0000 mon.a (mon.0) 2522 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T15:56:07.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:06 gibba013 bash[30381]: audit 2021-03-10T15:56:06.829613+0000 mon.a (mon.0) 2523 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:56:07.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:06 gibba013 bash[30381]: audit 2021-03-10T15:56:06.830451+0000 mon.a (mon.0) 2524 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:56:07.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:06 gibba013 bash[30381]: audit 2021-03-10T15:56:06.831244+0000 mon.a (mon.0) 2525 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T15:56:07.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:06 gibba020 bash[25448]: cluster 2021-03-10T15:56:05.781124+0000 mgr.gibba020.yqfnwy (mgr.34427) 6511 : cluster [DBG] pgmap v3702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:07.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:06 gibba020 bash[25448]: audit 2021-03-10T15:56:06.591371+0000 mon.a (mon.0) 2520 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:56:07.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:06 gibba020 bash[25448]: audit 2021-03-10T15:56:06.665151+0000 mon.a (mon.0) 2521 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:56:07.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:06 gibba020 bash[25448]: audit 2021-03-10T15:56:06.828750+0000 mon.a (mon.0) 2522 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T15:56:07.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:06 gibba020 bash[25448]: audit 2021-03-10T15:56:06.829613+0000 mon.a (mon.0) 2523 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T15:56:07.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:06 gibba020 bash[25448]: audit 2021-03-10T15:56:06.830451+0000 mon.a (mon.0) 2524 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T15:56:07.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:06 gibba020 bash[25448]: audit 2021-03-10T15:56:06.831244+0000 mon.a (mon.0) 2525 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T15:56:09.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:08 gibba013 bash[29418]: cluster 2021-03-10T15:56:07.782546+0000 mgr.gibba020.yqfnwy (mgr.34427) 6512 : cluster [DBG] pgmap v3703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:09.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:08 gibba013 bash[30381]: cluster 2021-03-10T15:56:07.782546+0000 mgr.gibba020.yqfnwy (mgr.34427) 6512 : cluster [DBG] pgmap v3703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:09.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:08 gibba020 bash[25448]: cluster 2021-03-10T15:56:07.782546+0000 mgr.gibba020.yqfnwy (mgr.34427) 6512 : cluster [DBG] pgmap v3703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:10.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:09 gibba013 bash[29418]: cephadm 2021-03-10T15:56:08.168155+0000 mgr.gibba020.yqfnwy (mgr.34427) 6513 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:56:10.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:09 gibba013 bash[30381]: cephadm 2021-03-10T15:56:08.168155+0000 mgr.gibba020.yqfnwy (mgr.34427) 6513 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:56:10.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:09 gibba020 bash[25448]: cephadm 2021-03-10T15:56:08.168155+0000 mgr.gibba020.yqfnwy (mgr.34427) 6513 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:56:11.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:10 gibba013 bash[29418]: cluster 2021-03-10T15:56:09.784098+0000 mgr.gibba020.yqfnwy (mgr.34427) 6514 : cluster [DBG] pgmap v3704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:11.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:10 gibba013 bash[30381]: cluster 2021-03-10T15:56:09.784098+0000 mgr.gibba020.yqfnwy (mgr.34427) 6514 : cluster [DBG] pgmap v3704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:11.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:10 gibba020 bash[25448]: cluster 2021-03-10T15:56:09.784098+0000 mgr.gibba020.yqfnwy (mgr.34427) 6514 : cluster [DBG] pgmap v3704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:13.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:12 gibba020 bash[25448]: cluster 2021-03-10T15:56:11.785594+0000 mgr.gibba020.yqfnwy (mgr.34427) 6515 : cluster [DBG] pgmap v3705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:13.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:12 gibba013 bash[29418]: cluster 2021-03-10T15:56:11.785594+0000 mgr.gibba020.yqfnwy (mgr.34427) 6515 : cluster [DBG] pgmap v3705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:13.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:12 gibba013 bash[30381]: cluster 2021-03-10T15:56:11.785594+0000 mgr.gibba020.yqfnwy (mgr.34427) 6515 : cluster [DBG] pgmap v3705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:14.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:14 gibba013 bash[29418]: cluster 2021-03-10T15:56:13.787209+0000 mgr.gibba020.yqfnwy (mgr.34427) 6516 : cluster [DBG] pgmap v3706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:14.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:14 gibba013 bash[30381]: cluster 2021-03-10T15:56:13.787209+0000 mgr.gibba020.yqfnwy (mgr.34427) 6516 : cluster [DBG] pgmap v3706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:14.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:14 gibba020 bash[25448]: cluster 2021-03-10T15:56:13.787209+0000 mgr.gibba020.yqfnwy (mgr.34427) 6516 : cluster [DBG] pgmap v3706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:15.667 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:56:15.886 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:56:15.887 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 6m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:56:15.887 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 5m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:56:15.887 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:56:15.887 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:56:15.888 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:56:15.888 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:56:15.888 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:56:15.888 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:56:15.889 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:56:15.889 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:56:15.889 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:56:15.889 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:56:15.890 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:56:15.890 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (119m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:56:15.890 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (119m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:56:15.890 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (118m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:56:15.891 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (118m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:56:15.891 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (118m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:56:15.891 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 5m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:56:15.891 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 5m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:56:16.134 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:56:16.134 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:56:16.134 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:56:16.135 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:56:16.135 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:56:16.135 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:56:16.135 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:56:16.136 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:56:16.136 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:56:16.136 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:56:16.136 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:56:16.136 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:56:16.137 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:56:16.137 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:56:16.137 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:56:17.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:16 gibba013 bash[29418]: audit 2021-03-10T15:56:15.655209+0000 mgr.gibba020.yqfnwy (mgr.34427) 6517 : audit [DBG] from='client.48426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:56:17.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:16 gibba013 bash[29418]: cluster 2021-03-10T15:56:15.788941+0000 mgr.gibba020.yqfnwy (mgr.34427) 6518 : cluster [DBG] pgmap v3707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:17.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:16 gibba013 bash[29418]: audit 2021-03-10T15:56:15.875019+0000 mgr.gibba020.yqfnwy (mgr.34427) 6519 : audit [DBG] from='client.48432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:56:17.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:16 gibba013 bash[29418]: audit 2021-03-10T15:56:16.133069+0000 mon.a (mon.0) 2526 : audit [DBG] from='client.? 172.21.2.113:0/2819339635' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:17.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:16 gibba013 bash[30381]: audit 2021-03-10T15:56:15.655209+0000 mgr.gibba020.yqfnwy (mgr.34427) 6517 : audit [DBG] from='client.48426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:56:17.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:16 gibba013 bash[30381]: cluster 2021-03-10T15:56:15.788941+0000 mgr.gibba020.yqfnwy (mgr.34427) 6518 : cluster [DBG] pgmap v3707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:17.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:16 gibba013 bash[30381]: audit 2021-03-10T15:56:15.875019+0000 mgr.gibba020.yqfnwy (mgr.34427) 6519 : audit [DBG] from='client.48432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:56:17.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:16 gibba013 bash[30381]: audit 2021-03-10T15:56:16.133069+0000 mon.a (mon.0) 2526 : audit [DBG] from='client.? 172.21.2.113:0/2819339635' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:17.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:16 gibba020 bash[25448]: audit 2021-03-10T15:56:15.655209+0000 mgr.gibba020.yqfnwy (mgr.34427) 6517 : audit [DBG] from='client.48426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:56:17.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:16 gibba020 bash[25448]: cluster 2021-03-10T15:56:15.788941+0000 mgr.gibba020.yqfnwy (mgr.34427) 6518 : cluster [DBG] pgmap v3707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:17.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:16 gibba020 bash[25448]: audit 2021-03-10T15:56:15.875019+0000 mgr.gibba020.yqfnwy (mgr.34427) 6519 : audit [DBG] from='client.48432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:56:17.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:16 gibba020 bash[25448]: audit 2021-03-10T15:56:16.133069+0000 mon.a (mon.0) 2526 : audit [DBG] from='client.? 172.21.2.113:0/2819339635' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:19.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:18 gibba013 bash[29418]: cluster 2021-03-10T15:56:17.790233+0000 mgr.gibba020.yqfnwy (mgr.34427) 6520 : cluster [DBG] pgmap v3708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:19.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:18 gibba013 bash[30381]: cluster 2021-03-10T15:56:17.790233+0000 mgr.gibba020.yqfnwy (mgr.34427) 6520 : cluster [DBG] pgmap v3708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:19.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:18 gibba020 bash[25448]: cluster 2021-03-10T15:56:17.790233+0000 mgr.gibba020.yqfnwy (mgr.34427) 6520 : cluster [DBG] pgmap v3708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:21.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:20 gibba013 bash[29418]: cluster 2021-03-10T15:56:19.791883+0000 mgr.gibba020.yqfnwy (mgr.34427) 6521 : cluster [DBG] pgmap v3709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:21.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:20 gibba013 bash[30381]: cluster 2021-03-10T15:56:19.791883+0000 mgr.gibba020.yqfnwy (mgr.34427) 6521 : cluster [DBG] pgmap v3709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:21.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:20 gibba020 bash[25448]: cluster 2021-03-10T15:56:19.791883+0000 mgr.gibba020.yqfnwy (mgr.34427) 6521 : cluster [DBG] pgmap v3709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:23.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:22 gibba013 bash[29418]: cluster 2021-03-10T15:56:21.793648+0000 mgr.gibba020.yqfnwy (mgr.34427) 6522 : cluster [DBG] pgmap v3710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:23.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:22 gibba013 bash[30381]: cluster 2021-03-10T15:56:21.793648+0000 mgr.gibba020.yqfnwy (mgr.34427) 6522 : cluster [DBG] pgmap v3710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:23.185 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:22 gibba020 bash[25448]: cluster 2021-03-10T15:56:21.793648+0000 mgr.gibba020.yqfnwy (mgr.34427) 6522 : cluster [DBG] pgmap v3710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:24.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:24 gibba013 bash[29418]: cephadm 2021-03-10T15:56:23.183410+0000 mgr.gibba020.yqfnwy (mgr.34427) 6523 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:56:24.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:24 gibba013 bash[29418]: cluster 2021-03-10T15:56:23.795287+0000 mgr.gibba020.yqfnwy (mgr.34427) 6524 : cluster [DBG] pgmap v3711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:24.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:24 gibba013 bash[30381]: cephadm 2021-03-10T15:56:23.183410+0000 mgr.gibba020.yqfnwy (mgr.34427) 6523 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:56:24.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:24 gibba013 bash[30381]: cluster 2021-03-10T15:56:23.795287+0000 mgr.gibba020.yqfnwy (mgr.34427) 6524 : cluster [DBG] pgmap v3711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:24.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:24 gibba020 bash[25448]: cephadm 2021-03-10T15:56:23.183410+0000 mgr.gibba020.yqfnwy (mgr.34427) 6523 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:56:24.864 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:24 gibba020 bash[25448]: cluster 2021-03-10T15:56:23.795287+0000 mgr.gibba020.yqfnwy (mgr.34427) 6524 : cluster [DBG] pgmap v3711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:27.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:26 gibba013 bash[29418]: cluster 2021-03-10T15:56:25.797064+0000 mgr.gibba020.yqfnwy (mgr.34427) 6525 : cluster [DBG] pgmap v3712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:27.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:26 gibba013 bash[30381]: cluster 2021-03-10T15:56:25.797064+0000 mgr.gibba020.yqfnwy (mgr.34427) 6525 : cluster [DBG] pgmap v3712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:27.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:26 gibba020 bash[25448]: cluster 2021-03-10T15:56:25.797064+0000 mgr.gibba020.yqfnwy (mgr.34427) 6525 : cluster [DBG] pgmap v3712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:29.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:28 gibba013 bash[29418]: cluster 2021-03-10T15:56:27.798573+0000 mgr.gibba020.yqfnwy (mgr.34427) 6526 : cluster [DBG] pgmap v3713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:29.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:28 gibba013 bash[30381]: cluster 2021-03-10T15:56:27.798573+0000 mgr.gibba020.yqfnwy (mgr.34427) 6526 : cluster [DBG] pgmap v3713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:29.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:28 gibba020 bash[25448]: cluster 2021-03-10T15:56:27.798573+0000 mgr.gibba020.yqfnwy (mgr.34427) 6526 : cluster [DBG] pgmap v3713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:31.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:30 gibba013 bash[29418]: cluster 2021-03-10T15:56:29.800022+0000 mgr.gibba020.yqfnwy (mgr.34427) 6527 : cluster [DBG] pgmap v3714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:31.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:30 gibba013 bash[30381]: cluster 2021-03-10T15:56:29.800022+0000 mgr.gibba020.yqfnwy (mgr.34427) 6527 : cluster [DBG] pgmap v3714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:31.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:30 gibba020 bash[25448]: cluster 2021-03-10T15:56:29.800022+0000 mgr.gibba020.yqfnwy (mgr.34427) 6527 : cluster [DBG] pgmap v3714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:33.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:32 gibba020 bash[25448]: cluster 2021-03-10T15:56:31.801607+0000 mgr.gibba020.yqfnwy (mgr.34427) 6528 : cluster [DBG] pgmap v3715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:33.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:32 gibba013 bash[29418]: cluster 2021-03-10T15:56:31.801607+0000 mgr.gibba020.yqfnwy (mgr.34427) 6528 : cluster [DBG] pgmap v3715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:33.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:32 gibba013 bash[30381]: cluster 2021-03-10T15:56:31.801607+0000 mgr.gibba020.yqfnwy (mgr.34427) 6528 : cluster [DBG] pgmap v3715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:34.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:34 gibba013 bash[29418]: cluster 2021-03-10T15:56:33.802987+0000 mgr.gibba020.yqfnwy (mgr.34427) 6529 : cluster [DBG] pgmap v3716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:34.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:34 gibba013 bash[30381]: cluster 2021-03-10T15:56:33.802987+0000 mgr.gibba020.yqfnwy (mgr.34427) 6529 : cluster [DBG] pgmap v3716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:34.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:34 gibba020 bash[25448]: cluster 2021-03-10T15:56:33.802987+0000 mgr.gibba020.yqfnwy (mgr.34427) 6529 : cluster [DBG] pgmap v3716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:37.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:36 gibba013 bash[29418]: cluster 2021-03-10T15:56:35.804706+0000 mgr.gibba020.yqfnwy (mgr.34427) 6530 : cluster [DBG] pgmap v3717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:37.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:36 gibba013 bash[30381]: cluster 2021-03-10T15:56:35.804706+0000 mgr.gibba020.yqfnwy (mgr.34427) 6530 : cluster [DBG] pgmap v3717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:37.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:36 gibba020 bash[25448]: cluster 2021-03-10T15:56:35.804706+0000 mgr.gibba020.yqfnwy (mgr.34427) 6530 : cluster [DBG] pgmap v3717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:39.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:38 gibba013 bash[29418]: cluster 2021-03-10T15:56:37.806019+0000 mgr.gibba020.yqfnwy (mgr.34427) 6531 : cluster [DBG] pgmap v3718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:39.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:38 gibba013 bash[30381]: cluster 2021-03-10T15:56:37.806019+0000 mgr.gibba020.yqfnwy (mgr.34427) 6531 : cluster [DBG] pgmap v3718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:39.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:38 gibba020 bash[25448]: cluster 2021-03-10T15:56:37.806019+0000 mgr.gibba020.yqfnwy (mgr.34427) 6531 : cluster [DBG] pgmap v3718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:40.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:39 gibba020 bash[25448]: cephadm 2021-03-10T15:56:38.197371+0000 mgr.gibba020.yqfnwy (mgr.34427) 6532 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:56:40.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:39 gibba013 bash[29418]: cephadm 2021-03-10T15:56:38.197371+0000 mgr.gibba020.yqfnwy (mgr.34427) 6532 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:56:40.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:39 gibba013 bash[30381]: cephadm 2021-03-10T15:56:38.197371+0000 mgr.gibba020.yqfnwy (mgr.34427) 6532 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:56:41.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:40 gibba020 bash[25448]: cluster 2021-03-10T15:56:39.807819+0000 mgr.gibba020.yqfnwy (mgr.34427) 6533 : cluster [DBG] pgmap v3719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:41.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:40 gibba013 bash[29418]: cluster 2021-03-10T15:56:39.807819+0000 mgr.gibba020.yqfnwy (mgr.34427) 6533 : cluster [DBG] pgmap v3719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:41.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:40 gibba013 bash[30381]: cluster 2021-03-10T15:56:39.807819+0000 mgr.gibba020.yqfnwy (mgr.34427) 6533 : cluster [DBG] pgmap v3719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:43.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:42 gibba020 bash[25448]: cluster 2021-03-10T15:56:41.809373+0000 mgr.gibba020.yqfnwy (mgr.34427) 6534 : cluster [DBG] pgmap v3720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:43.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:42 gibba013 bash[29418]: cluster 2021-03-10T15:56:41.809373+0000 mgr.gibba020.yqfnwy (mgr.34427) 6534 : cluster [DBG] pgmap v3720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:43.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:42 gibba013 bash[30381]: cluster 2021-03-10T15:56:41.809373+0000 mgr.gibba020.yqfnwy (mgr.34427) 6534 : cluster [DBG] pgmap v3720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:44.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:44 gibba013 bash[29418]: cluster 2021-03-10T15:56:43.811052+0000 mgr.gibba020.yqfnwy (mgr.34427) 6535 : cluster [DBG] pgmap v3721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:44.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:44 gibba013 bash[30381]: cluster 2021-03-10T15:56:43.811052+0000 mgr.gibba020.yqfnwy (mgr.34427) 6535 : cluster [DBG] pgmap v3721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:44.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:44 gibba020 bash[25448]: cluster 2021-03-10T15:56:43.811052+0000 mgr.gibba020.yqfnwy (mgr.34427) 6535 : cluster [DBG] pgmap v3721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:46.380 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:56:46.640 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:56:46.640 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 7m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:56:46.640 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 5m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:56:46.641 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:56:46.641 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:56:46.641 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:56:46.641 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:56:46.642 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:56:46.642 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:56:46.642 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:56:46.643 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:56:46.643 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:56:46.643 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:56:46.644 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:56:46.644 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:56:46.644 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (119m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:56:46.644 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (119m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:56:46.645 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (118m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:56:46.645 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (118m) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:56:46.645 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 5m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:56:46.645 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 5m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:56:46.894 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:56:46.895 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:56:46.895 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:56:46.895 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:56:46.895 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:56:46.896 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:56:46.896 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:56:46.896 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:56:46.896 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:56:46.897 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:56:46.897 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:56:46.897 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:56:46.897 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:56:46.898 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:56:46.898 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:56:47.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:46 gibba013 bash[29418]: cluster 2021-03-10T15:56:45.812652+0000 mgr.gibba020.yqfnwy (mgr.34427) 6536 : cluster [DBG] pgmap v3722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:47.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:46 gibba013 bash[30381]: cluster 2021-03-10T15:56:45.812652+0000 mgr.gibba020.yqfnwy (mgr.34427) 6536 : cluster [DBG] pgmap v3722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:47.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:46 gibba020 bash[25448]: cluster 2021-03-10T15:56:45.812652+0000 mgr.gibba020.yqfnwy (mgr.34427) 6536 : cluster [DBG] pgmap v3722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:48.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:47 gibba020 bash[25448]: audit 2021-03-10T15:56:46.369951+0000 mgr.gibba020.yqfnwy (mgr.34427) 6537 : audit [DBG] from='client.48444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:56:48.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:47 gibba020 bash[25448]: audit 2021-03-10T15:56:46.598048+0000 mgr.gibba020.yqfnwy (mgr.34427) 6538 : audit [DBG] from='client.48450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:56:48.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:47 gibba020 bash[25448]: audit 2021-03-10T15:56:46.893794+0000 mon.c (mon.1) 106 : audit [DBG] from='client.? 172.21.2.113:0/3645709012' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:48.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:47 gibba013 bash[29418]: audit 2021-03-10T15:56:46.369951+0000 mgr.gibba020.yqfnwy (mgr.34427) 6537 : audit [DBG] from='client.48444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:56:48.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:47 gibba013 bash[29418]: audit 2021-03-10T15:56:46.598048+0000 mgr.gibba020.yqfnwy (mgr.34427) 6538 : audit [DBG] from='client.48450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:56:48.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:47 gibba013 bash[29418]: audit 2021-03-10T15:56:46.893794+0000 mon.c (mon.1) 106 : audit [DBG] from='client.? 172.21.2.113:0/3645709012' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:48.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:47 gibba013 bash[30381]: audit 2021-03-10T15:56:46.369951+0000 mgr.gibba020.yqfnwy (mgr.34427) 6537 : audit [DBG] from='client.48444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:56:48.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:47 gibba013 bash[30381]: audit 2021-03-10T15:56:46.598048+0000 mgr.gibba020.yqfnwy (mgr.34427) 6538 : audit [DBG] from='client.48450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:56:48.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:47 gibba013 bash[30381]: audit 2021-03-10T15:56:46.893794+0000 mon.c (mon.1) 106 : audit [DBG] from='client.? 172.21.2.113:0/3645709012' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:49.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:48 gibba020 bash[25448]: cluster 2021-03-10T15:56:47.813965+0000 mgr.gibba020.yqfnwy (mgr.34427) 6539 : cluster [DBG] pgmap v3723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:49.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:48 gibba013 bash[29418]: cluster 2021-03-10T15:56:47.813965+0000 mgr.gibba020.yqfnwy (mgr.34427) 6539 : cluster [DBG] pgmap v3723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:49.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:48 gibba013 bash[30381]: cluster 2021-03-10T15:56:47.813965+0000 mgr.gibba020.yqfnwy (mgr.34427) 6539 : cluster [DBG] pgmap v3723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:51.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:50 gibba020 bash[25448]: cluster 2021-03-10T15:56:49.815544+0000 mgr.gibba020.yqfnwy (mgr.34427) 6540 : cluster [DBG] pgmap v3724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:51.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:50 gibba013 bash[29418]: cluster 2021-03-10T15:56:49.815544+0000 mgr.gibba020.yqfnwy (mgr.34427) 6540 : cluster [DBG] pgmap v3724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:51.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:50 gibba013 bash[30381]: cluster 2021-03-10T15:56:49.815544+0000 mgr.gibba020.yqfnwy (mgr.34427) 6540 : cluster [DBG] pgmap v3724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:53.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:52 gibba020 bash[25448]: cluster 2021-03-10T15:56:51.817170+0000 mgr.gibba020.yqfnwy (mgr.34427) 6541 : cluster [DBG] pgmap v3725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:53.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:52 gibba013 bash[29418]: cluster 2021-03-10T15:56:51.817170+0000 mgr.gibba020.yqfnwy (mgr.34427) 6541 : cluster [DBG] pgmap v3725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:53.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:52 gibba013 bash[30381]: cluster 2021-03-10T15:56:51.817170+0000 mgr.gibba020.yqfnwy (mgr.34427) 6541 : cluster [DBG] pgmap v3725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:54.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:53 gibba020 bash[25448]: audit 2021-03-10T15:56:53.206842+0000 mon.a (mon.0) 2527 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:56:54.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:53 gibba020 bash[25448]: audit 2021-03-10T15:56:53.406649+0000 mon.a (mon.0) 2528 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:56:54.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:53 gibba020 bash[25448]: audit 2021-03-10T15:56:53.409662+0000 mon.a (mon.0) 2529 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:56:54.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:53 gibba020 bash[25448]: audit 2021-03-10T15:56:53.592269+0000 mon.a (mon.0) 2530 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:56:54.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:53 gibba020 bash[25448]: audit 2021-03-10T15:56:53.595834+0000 mon.a (mon.0) 2531 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:56:54.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:53 gibba020 bash[25448]: audit 2021-03-10T15:56:53.597277+0000 mon.a (mon.0) 2532 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:54.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:53 gibba020 bash[25448]: audit 2021-03-10T15:56:53.598554+0000 mon.a (mon.0) 2533 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:54.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:53 gibba020 bash[25448]: audit 2021-03-10T15:56:53.599931+0000 mon.a (mon.0) 2534 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:54.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:53 gibba020 bash[25448]: audit 2021-03-10T15:56:53.602878+0000 mon.a (mon.0) 2535 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:54.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:53 gibba020 bash[25448]: audit 2021-03-10T15:56:53.604744+0000 mon.a (mon.0) 2536 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:54.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:53 gibba013 bash[29418]: audit 2021-03-10T15:56:53.206842+0000 mon.a (mon.0) 2527 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:56:54.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:53 gibba013 bash[29418]: audit 2021-03-10T15:56:53.406649+0000 mon.a (mon.0) 2528 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:56:54.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:53 gibba013 bash[29418]: audit 2021-03-10T15:56:53.409662+0000 mon.a (mon.0) 2529 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:56:54.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:53 gibba013 bash[29418]: audit 2021-03-10T15:56:53.592269+0000 mon.a (mon.0) 2530 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:56:54.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:53 gibba013 bash[29418]: audit 2021-03-10T15:56:53.595834+0000 mon.a (mon.0) 2531 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:56:54.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:53 gibba013 bash[29418]: audit 2021-03-10T15:56:53.597277+0000 mon.a (mon.0) 2532 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:54.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:53 gibba013 bash[29418]: audit 2021-03-10T15:56:53.598554+0000 mon.a (mon.0) 2533 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:54.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:53 gibba013 bash[29418]: audit 2021-03-10T15:56:53.599931+0000 mon.a (mon.0) 2534 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:54.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:53 gibba013 bash[29418]: audit 2021-03-10T15:56:53.602878+0000 mon.a (mon.0) 2535 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:54.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:53 gibba013 bash[29418]: audit 2021-03-10T15:56:53.604744+0000 mon.a (mon.0) 2536 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:54.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:53 gibba013 bash[30381]: audit 2021-03-10T15:56:53.206842+0000 mon.a (mon.0) 2527 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:56:54.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:53 gibba013 bash[30381]: audit 2021-03-10T15:56:53.406649+0000 mon.a (mon.0) 2528 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:56:54.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:53 gibba013 bash[30381]: audit 2021-03-10T15:56:53.409662+0000 mon.a (mon.0) 2529 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:56:54.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:53 gibba013 bash[30381]: audit 2021-03-10T15:56:53.592269+0000 mon.a (mon.0) 2530 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:56:54.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:53 gibba013 bash[30381]: audit 2021-03-10T15:56:53.595834+0000 mon.a (mon.0) 2531 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:56:54.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:53 gibba013 bash[30381]: audit 2021-03-10T15:56:53.597277+0000 mon.a (mon.0) 2532 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:54.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:53 gibba013 bash[30381]: audit 2021-03-10T15:56:53.598554+0000 mon.a (mon.0) 2533 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:54.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:53 gibba013 bash[30381]: audit 2021-03-10T15:56:53.599931+0000 mon.a (mon.0) 2534 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:54.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:53 gibba013 bash[30381]: audit 2021-03-10T15:56:53.602878+0000 mon.a (mon.0) 2535 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:54.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:53 gibba013 bash[30381]: audit 2021-03-10T15:56:53.604744+0000 mon.a (mon.0) 2536 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:56:55.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:54 gibba020 bash[25448]: cephadm 2021-03-10T15:56:53.405683+0000 mgr.gibba020.yqfnwy (mgr.34427) 6542 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:56:55.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:54 gibba020 bash[25448]: cephadm 2021-03-10T15:56:53.408970+0000 mgr.gibba020.yqfnwy (mgr.34427) 6543 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:56:55.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:54 gibba020 bash[25448]: cephadm 2021-03-10T15:56:53.593498+0000 mgr.gibba020.yqfnwy (mgr.34427) 6544 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:56:55.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:54 gibba020 bash[25448]: cephadm 2021-03-10T15:56:53.595317+0000 mgr.gibba020.yqfnwy (mgr.34427) 6545 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:56:55.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:54 gibba020 bash[25448]: cephadm 2021-03-10T15:56:53.596749+0000 mgr.gibba020.yqfnwy (mgr.34427) 6546 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:56:55.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:54 gibba020 bash[25448]: cephadm 2021-03-10T15:56:53.596787+0000 mgr.gibba020.yqfnwy (mgr.34427) 6547 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:56:55.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:54 gibba020 bash[25448]: cephadm 2021-03-10T15:56:53.598014+0000 mgr.gibba020.yqfnwy (mgr.34427) 6548 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:56:55.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:54 gibba020 bash[25448]: cephadm 2021-03-10T15:56:53.598053+0000 mgr.gibba020.yqfnwy (mgr.34427) 6549 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:56:55.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:54 gibba020 bash[25448]: cephadm 2021-03-10T15:56:53.599604+0000 mgr.gibba020.yqfnwy (mgr.34427) 6550 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:56:55.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:54 gibba020 bash[25448]: cephadm 2021-03-10T15:56:53.600950+0000 mgr.gibba020.yqfnwy (mgr.34427) 6551 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:56:55.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:54 gibba020 bash[25448]: cephadm 2021-03-10T15:56:53.600986+0000 mgr.gibba020.yqfnwy (mgr.34427) 6552 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:56:55.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:54 gibba020 bash[25448]: cephadm 2021-03-10T15:56:53.602494+0000 mgr.gibba020.yqfnwy (mgr.34427) 6553 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:56:55.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:54 gibba020 bash[25448]: cephadm 2021-03-10T15:56:53.602809+0000 mgr.gibba020.yqfnwy (mgr.34427) 6554 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:56:55.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:54 gibba020 bash[25448]: cephadm 2021-03-10T15:56:53.604194+0000 mgr.gibba020.yqfnwy (mgr.34427) 6555 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:56:55.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:54 gibba020 bash[25448]: cephadm 2021-03-10T15:56:53.604232+0000 mgr.gibba020.yqfnwy (mgr.34427) 6556 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:56:55.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:54 gibba020 bash[25448]: cephadm 2021-03-10T15:56:53.604337+0000 mgr.gibba020.yqfnwy (mgr.34427) 6557 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:56:55.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:54 gibba020 bash[25448]: cluster 2021-03-10T15:56:53.818864+0000 mgr.gibba020.yqfnwy (mgr.34427) 6558 : cluster [DBG] pgmap v3726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:55.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:54 gibba013 bash[29418]: cephadm 2021-03-10T15:56:53.405683+0000 mgr.gibba020.yqfnwy (mgr.34427) 6542 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:56:55.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:54 gibba013 bash[29418]: cephadm 2021-03-10T15:56:53.408970+0000 mgr.gibba020.yqfnwy (mgr.34427) 6543 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:56:55.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:54 gibba013 bash[29418]: cephadm 2021-03-10T15:56:53.593498+0000 mgr.gibba020.yqfnwy (mgr.34427) 6544 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:56:55.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:54 gibba013 bash[29418]: cephadm 2021-03-10T15:56:53.595317+0000 mgr.gibba020.yqfnwy (mgr.34427) 6545 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:56:55.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:54 gibba013 bash[29418]: cephadm 2021-03-10T15:56:53.596749+0000 mgr.gibba020.yqfnwy (mgr.34427) 6546 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:56:55.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:54 gibba013 bash[29418]: cephadm 2021-03-10T15:56:53.596787+0000 mgr.gibba020.yqfnwy (mgr.34427) 6547 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:56:55.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:54 gibba013 bash[29418]: cephadm 2021-03-10T15:56:53.598014+0000 mgr.gibba020.yqfnwy (mgr.34427) 6548 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:56:55.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:54 gibba013 bash[29418]: cephadm 2021-03-10T15:56:53.598053+0000 mgr.gibba020.yqfnwy (mgr.34427) 6549 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:56:55.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:54 gibba013 bash[29418]: cephadm 2021-03-10T15:56:53.599604+0000 mgr.gibba020.yqfnwy (mgr.34427) 6550 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:56:55.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:54 gibba013 bash[29418]: cephadm 2021-03-10T15:56:53.600950+0000 mgr.gibba020.yqfnwy (mgr.34427) 6551 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:56:55.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:54 gibba013 bash[29418]: cephadm 2021-03-10T15:56:53.600986+0000 mgr.gibba020.yqfnwy (mgr.34427) 6552 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:56:55.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:54 gibba013 bash[29418]: cephadm 2021-03-10T15:56:53.602494+0000 mgr.gibba020.yqfnwy (mgr.34427) 6553 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:56:55.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:54 gibba013 bash[29418]: cephadm 2021-03-10T15:56:53.602809+0000 mgr.gibba020.yqfnwy (mgr.34427) 6554 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:56:55.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:54 gibba013 bash[29418]: cephadm 2021-03-10T15:56:53.604194+0000 mgr.gibba020.yqfnwy (mgr.34427) 6555 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:56:55.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:54 gibba013 bash[29418]: cephadm 2021-03-10T15:56:53.604232+0000 mgr.gibba020.yqfnwy (mgr.34427) 6556 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:56:55.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:54 gibba013 bash[29418]: cephadm 2021-03-10T15:56:53.604337+0000 mgr.gibba020.yqfnwy (mgr.34427) 6557 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:56:55.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:54 gibba013 bash[29418]: cluster 2021-03-10T15:56:53.818864+0000 mgr.gibba020.yqfnwy (mgr.34427) 6558 : cluster [DBG] pgmap v3726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:55.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:54 gibba013 bash[30381]: cephadm 2021-03-10T15:56:53.405683+0000 mgr.gibba020.yqfnwy (mgr.34427) 6542 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:56:55.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:54 gibba013 bash[30381]: cephadm 2021-03-10T15:56:53.408970+0000 mgr.gibba020.yqfnwy (mgr.34427) 6543 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:56:55.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:54 gibba013 bash[30381]: cephadm 2021-03-10T15:56:53.593498+0000 mgr.gibba020.yqfnwy (mgr.34427) 6544 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:56:55.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:54 gibba013 bash[30381]: cephadm 2021-03-10T15:56:53.595317+0000 mgr.gibba020.yqfnwy (mgr.34427) 6545 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:56:55.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:54 gibba013 bash[30381]: cephadm 2021-03-10T15:56:53.596749+0000 mgr.gibba020.yqfnwy (mgr.34427) 6546 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:56:55.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:54 gibba013 bash[30381]: cephadm 2021-03-10T15:56:53.596787+0000 mgr.gibba020.yqfnwy (mgr.34427) 6547 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:56:55.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:54 gibba013 bash[30381]: cephadm 2021-03-10T15:56:53.598014+0000 mgr.gibba020.yqfnwy (mgr.34427) 6548 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:56:55.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:54 gibba013 bash[30381]: cephadm 2021-03-10T15:56:53.598053+0000 mgr.gibba020.yqfnwy (mgr.34427) 6549 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:56:55.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:54 gibba013 bash[30381]: cephadm 2021-03-10T15:56:53.599604+0000 mgr.gibba020.yqfnwy (mgr.34427) 6550 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:56:55.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:54 gibba013 bash[30381]: cephadm 2021-03-10T15:56:53.600950+0000 mgr.gibba020.yqfnwy (mgr.34427) 6551 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:56:55.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:54 gibba013 bash[30381]: cephadm 2021-03-10T15:56:53.600986+0000 mgr.gibba020.yqfnwy (mgr.34427) 6552 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:56:55.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:54 gibba013 bash[30381]: cephadm 2021-03-10T15:56:53.602494+0000 mgr.gibba020.yqfnwy (mgr.34427) 6553 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:56:55.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:54 gibba013 bash[30381]: cephadm 2021-03-10T15:56:53.602809+0000 mgr.gibba020.yqfnwy (mgr.34427) 6554 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:56:55.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:54 gibba013 bash[30381]: cephadm 2021-03-10T15:56:53.604194+0000 mgr.gibba020.yqfnwy (mgr.34427) 6555 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:56:55.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:54 gibba013 bash[30381]: cephadm 2021-03-10T15:56:53.604232+0000 mgr.gibba020.yqfnwy (mgr.34427) 6556 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:56:55.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:54 gibba013 bash[30381]: cephadm 2021-03-10T15:56:53.604337+0000 mgr.gibba020.yqfnwy (mgr.34427) 6557 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:56:55.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:54 gibba013 bash[30381]: cluster 2021-03-10T15:56:53.818864+0000 mgr.gibba020.yqfnwy (mgr.34427) 6558 : cluster [DBG] pgmap v3726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:56.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:55 gibba020 bash[25448]: cluster 2021-03-10T15:56:55.820636+0000 mgr.gibba020.yqfnwy (mgr.34427) 6559 : cluster [DBG] pgmap v3727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:56.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:55 gibba013 bash[29418]: cluster 2021-03-10T15:56:55.820636+0000 mgr.gibba020.yqfnwy (mgr.34427) 6559 : cluster [DBG] pgmap v3727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:56.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:55 gibba013 bash[30381]: cluster 2021-03-10T15:56:55.820636+0000 mgr.gibba020.yqfnwy (mgr.34427) 6559 : cluster [DBG] pgmap v3727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:59.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:56:58 gibba020 bash[25448]: cluster 2021-03-10T15:56:57.821929+0000 mgr.gibba020.yqfnwy (mgr.34427) 6560 : cluster [DBG] pgmap v3728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:59.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:56:58 gibba013 bash[29418]: cluster 2021-03-10T15:56:57.821929+0000 mgr.gibba020.yqfnwy (mgr.34427) 6560 : cluster [DBG] pgmap v3728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:56:59.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:56:58 gibba013 bash[30381]: cluster 2021-03-10T15:56:57.821929+0000 mgr.gibba020.yqfnwy (mgr.34427) 6560 : cluster [DBG] pgmap v3728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:01.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:00 gibba020 bash[25448]: cluster 2021-03-10T15:56:59.823632+0000 mgr.gibba020.yqfnwy (mgr.34427) 6561 : cluster [DBG] pgmap v3729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:01.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:00 gibba013 bash[29418]: cluster 2021-03-10T15:56:59.823632+0000 mgr.gibba020.yqfnwy (mgr.34427) 6561 : cluster [DBG] pgmap v3729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:01.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:00 gibba013 bash[30381]: cluster 2021-03-10T15:56:59.823632+0000 mgr.gibba020.yqfnwy (mgr.34427) 6561 : cluster [DBG] pgmap v3729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:03.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:02 gibba020 bash[25448]: cluster 2021-03-10T15:57:01.825288+0000 mgr.gibba020.yqfnwy (mgr.34427) 6562 : cluster [DBG] pgmap v3730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:03.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:02 gibba013 bash[29418]: cluster 2021-03-10T15:57:01.825288+0000 mgr.gibba020.yqfnwy (mgr.34427) 6562 : cluster [DBG] pgmap v3730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:03.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:02 gibba013 bash[30381]: cluster 2021-03-10T15:57:01.825288+0000 mgr.gibba020.yqfnwy (mgr.34427) 6562 : cluster [DBG] pgmap v3730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:04.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:04 gibba013 bash[29418]: cluster 2021-03-10T15:57:03.826975+0000 mgr.gibba020.yqfnwy (mgr.34427) 6563 : cluster [DBG] pgmap v3731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:04.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:04 gibba013 bash[30381]: cluster 2021-03-10T15:57:03.826975+0000 mgr.gibba020.yqfnwy (mgr.34427) 6563 : cluster [DBG] pgmap v3731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:04.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:04 gibba020 bash[25448]: cluster 2021-03-10T15:57:03.826975+0000 mgr.gibba020.yqfnwy (mgr.34427) 6563 : cluster [DBG] pgmap v3731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:07.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:06 gibba020 bash[25448]: cluster 2021-03-10T15:57:05.828680+0000 mgr.gibba020.yqfnwy (mgr.34427) 6564 : cluster [DBG] pgmap v3732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:07.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:06 gibba020 bash[25448]: audit 2021-03-10T15:57:06.596892+0000 mon.a (mon.0) 2537 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:57:07.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:06 gibba020 bash[25448]: audit 2021-03-10T15:57:06.671457+0000 mon.a (mon.0) 2538 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:57:07.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:06 gibba020 bash[25448]: audit 2021-03-10T15:57:06.839155+0000 mon.a (mon.0) 2539 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:57:07.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:06 gibba020 bash[25448]: audit 2021-03-10T15:57:06.839891+0000 mon.a (mon.0) 2540 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T15:57:07.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:06 gibba020 bash[25448]: audit 2021-03-10T15:57:06.840522+0000 mon.a (mon.0) 2541 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:57:07.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:06 gibba020 bash[25448]: audit 2021-03-10T15:57:06.841169+0000 mon.a (mon.0) 2542 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:57:07.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:06 gibba013 bash[29418]: cluster 2021-03-10T15:57:05.828680+0000 mgr.gibba020.yqfnwy (mgr.34427) 6564 : cluster [DBG] pgmap v3732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:07.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:06 gibba013 bash[29418]: audit 2021-03-10T15:57:06.596892+0000 mon.a (mon.0) 2537 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:57:07.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:06 gibba013 bash[29418]: audit 2021-03-10T15:57:06.671457+0000 mon.a (mon.0) 2538 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:57:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:06 gibba013 bash[29418]: audit 2021-03-10T15:57:06.839155+0000 mon.a (mon.0) 2539 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:57:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:06 gibba013 bash[29418]: audit 2021-03-10T15:57:06.839891+0000 mon.a (mon.0) 2540 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T15:57:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:06 gibba013 bash[29418]: audit 2021-03-10T15:57:06.840522+0000 mon.a (mon.0) 2541 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:57:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:06 gibba013 bash[29418]: audit 2021-03-10T15:57:06.841169+0000 mon.a (mon.0) 2542 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:57:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:06 gibba013 bash[30381]: cluster 2021-03-10T15:57:05.828680+0000 mgr.gibba020.yqfnwy (mgr.34427) 6564 : cluster [DBG] pgmap v3732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:06 gibba013 bash[30381]: audit 2021-03-10T15:57:06.596892+0000 mon.a (mon.0) 2537 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:57:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:06 gibba013 bash[30381]: audit 2021-03-10T15:57:06.671457+0000 mon.a (mon.0) 2538 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:57:07.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:06 gibba013 bash[30381]: audit 2021-03-10T15:57:06.839155+0000 mon.a (mon.0) 2539 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T15:57:07.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:06 gibba013 bash[30381]: audit 2021-03-10T15:57:06.839891+0000 mon.a (mon.0) 2540 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T15:57:07.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:06 gibba013 bash[30381]: audit 2021-03-10T15:57:06.840522+0000 mon.a (mon.0) 2541 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T15:57:07.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:06 gibba013 bash[30381]: audit 2021-03-10T15:57:06.841169+0000 mon.a (mon.0) 2542 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:57:09.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:08 gibba020 bash[25448]: cluster 2021-03-10T15:57:07.829983+0000 mgr.gibba020.yqfnwy (mgr.34427) 6565 : cluster [DBG] pgmap v3733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:09.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:08 gibba013 bash[29418]: cluster 2021-03-10T15:57:07.829983+0000 mgr.gibba020.yqfnwy (mgr.34427) 6565 : cluster [DBG] pgmap v3733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:09.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:08 gibba013 bash[30381]: cluster 2021-03-10T15:57:07.829983+0000 mgr.gibba020.yqfnwy (mgr.34427) 6565 : cluster [DBG] pgmap v3733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:10.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:09 gibba020 bash[25448]: cephadm 2021-03-10T15:57:08.608877+0000 mgr.gibba020.yqfnwy (mgr.34427) 6566 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:57:10.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:09 gibba013 bash[29418]: cephadm 2021-03-10T15:57:08.608877+0000 mgr.gibba020.yqfnwy (mgr.34427) 6566 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:57:10.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:09 gibba013 bash[30381]: cephadm 2021-03-10T15:57:08.608877+0000 mgr.gibba020.yqfnwy (mgr.34427) 6566 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:57:11.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:10 gibba020 bash[25448]: cluster 2021-03-10T15:57:09.831740+0000 mgr.gibba020.yqfnwy (mgr.34427) 6567 : cluster [DBG] pgmap v3734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:11.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:10 gibba013 bash[29418]: cluster 2021-03-10T15:57:09.831740+0000 mgr.gibba020.yqfnwy (mgr.34427) 6567 : cluster [DBG] pgmap v3734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:11.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:10 gibba013 bash[30381]: cluster 2021-03-10T15:57:09.831740+0000 mgr.gibba020.yqfnwy (mgr.34427) 6567 : cluster [DBG] pgmap v3734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:12.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:11 gibba013 bash[29418]: cluster 2021-03-10T15:57:11.833356+0000 mgr.gibba020.yqfnwy (mgr.34427) 6568 : cluster [DBG] pgmap v3735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:12.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:11 gibba013 bash[30381]: cluster 2021-03-10T15:57:11.833356+0000 mgr.gibba020.yqfnwy (mgr.34427) 6568 : cluster [DBG] pgmap v3735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:12.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:11 gibba020 bash[25448]: cluster 2021-03-10T15:57:11.833356+0000 mgr.gibba020.yqfnwy (mgr.34427) 6568 : cluster [DBG] pgmap v3735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:14.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:14 gibba013 bash[29418]: cluster 2021-03-10T15:57:13.834934+0000 mgr.gibba020.yqfnwy (mgr.34427) 6569 : cluster [DBG] pgmap v3736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:14.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:14 gibba013 bash[30381]: cluster 2021-03-10T15:57:13.834934+0000 mgr.gibba020.yqfnwy (mgr.34427) 6569 : cluster [DBG] pgmap v3736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:14.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:14 gibba020 bash[25448]: cluster 2021-03-10T15:57:13.834934+0000 mgr.gibba020.yqfnwy (mgr.34427) 6569 : cluster [DBG] pgmap v3736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:17.139 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:57:17.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:16 gibba020 bash[25448]: cluster 2021-03-10T15:57:15.836706+0000 mgr.gibba020.yqfnwy (mgr.34427) 6570 : cluster [DBG] pgmap v3737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:17.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:16 gibba013 bash[29418]: cluster 2021-03-10T15:57:15.836706+0000 mgr.gibba020.yqfnwy (mgr.34427) 6570 : cluster [DBG] pgmap v3737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:17.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:16 gibba013 bash[30381]: cluster 2021-03-10T15:57:15.836706+0000 mgr.gibba020.yqfnwy (mgr.34427) 6570 : cluster [DBG] pgmap v3737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:17.400 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:57:17.401 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 7m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:57:17.401 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 6m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:57:17.401 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:57:17.401 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:57:17.402 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:57:17.402 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:57:17.402 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:57:17.402 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:57:17.402 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:57:17.403 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:57:17.403 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:57:17.403 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:57:17.403 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:57:17.403 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:57:17.404 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:57:17.404 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (119m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:57:17.404 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (119m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:57:17.404 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (119m) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:57:17.405 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 6m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:57:17.405 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 6m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:57:17.658 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:57:17.659 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:57:17.659 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:57:17.659 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:57:17.660 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:57:17.660 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:57:17.660 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:57:17.660 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:57:17.661 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:57:17.661 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:57:17.661 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:57:17.661 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:57:17.662 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:57:17.662 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:57:17.662 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:57:18.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:17 gibba020 bash[25448]: audit 2021-03-10T15:57:17.658160+0000 mon.a (mon.0) 2543 : audit [DBG] from='client.? 172.21.2.113:0/1032378800' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:18.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:17 gibba013 bash[29418]: audit 2021-03-10T15:57:17.658160+0000 mon.a (mon.0) 2543 : audit [DBG] from='client.? 172.21.2.113:0/1032378800' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:18.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:17 gibba013 bash[30381]: audit 2021-03-10T15:57:17.658160+0000 mon.a (mon.0) 2543 : audit [DBG] from='client.? 172.21.2.113:0/1032378800' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:19.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:18 gibba020 bash[25448]: audit 2021-03-10T15:57:17.128552+0000 mgr.gibba020.yqfnwy (mgr.34427) 6571 : audit [DBG] from='client.48462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:57:19.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:18 gibba020 bash[25448]: audit 2021-03-10T15:57:17.357153+0000 mgr.gibba020.yqfnwy (mgr.34427) 6572 : audit [DBG] from='client.48468 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:57:19.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:18 gibba020 bash[25448]: cluster 2021-03-10T15:57:17.837935+0000 mgr.gibba020.yqfnwy (mgr.34427) 6573 : cluster [DBG] pgmap v3738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:19.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:18 gibba013 bash[29418]: audit 2021-03-10T15:57:17.128552+0000 mgr.gibba020.yqfnwy (mgr.34427) 6571 : audit [DBG] from='client.48462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:57:19.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:18 gibba013 bash[29418]: audit 2021-03-10T15:57:17.357153+0000 mgr.gibba020.yqfnwy (mgr.34427) 6572 : audit [DBG] from='client.48468 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:57:19.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:18 gibba013 bash[29418]: cluster 2021-03-10T15:57:17.837935+0000 mgr.gibba020.yqfnwy (mgr.34427) 6573 : cluster [DBG] pgmap v3738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:19.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:18 gibba013 bash[30381]: audit 2021-03-10T15:57:17.128552+0000 mgr.gibba020.yqfnwy (mgr.34427) 6571 : audit [DBG] from='client.48462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:57:19.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:18 gibba013 bash[30381]: audit 2021-03-10T15:57:17.357153+0000 mgr.gibba020.yqfnwy (mgr.34427) 6572 : audit [DBG] from='client.48468 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:57:19.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:18 gibba013 bash[30381]: cluster 2021-03-10T15:57:17.837935+0000 mgr.gibba020.yqfnwy (mgr.34427) 6573 : cluster [DBG] pgmap v3738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:20.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:19 gibba013 bash[29418]: cluster 2021-03-10T15:57:19.839689+0000 mgr.gibba020.yqfnwy (mgr.34427) 6574 : cluster [DBG] pgmap v3739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:20.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:19 gibba013 bash[30381]: cluster 2021-03-10T15:57:19.839689+0000 mgr.gibba020.yqfnwy (mgr.34427) 6574 : cluster [DBG] pgmap v3739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:20.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:19 gibba020 bash[25448]: cluster 2021-03-10T15:57:19.839689+0000 mgr.gibba020.yqfnwy (mgr.34427) 6574 : cluster [DBG] pgmap v3739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:23.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:22 gibba020 bash[25448]: cluster 2021-03-10T15:57:21.841304+0000 mgr.gibba020.yqfnwy (mgr.34427) 6575 : cluster [DBG] pgmap v3740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:23.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:22 gibba013 bash[29418]: cluster 2021-03-10T15:57:21.841304+0000 mgr.gibba020.yqfnwy (mgr.34427) 6575 : cluster [DBG] pgmap v3740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:23.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:22 gibba013 bash[30381]: cluster 2021-03-10T15:57:21.841304+0000 mgr.gibba020.yqfnwy (mgr.34427) 6575 : cluster [DBG] pgmap v3740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:24.333 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:24 gibba013 bash[29418]: cephadm 2021-03-10T15:57:23.615336+0000 mgr.gibba020.yqfnwy (mgr.34427) 6576 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:57:24.333 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:24 gibba013 bash[29418]: cluster 2021-03-10T15:57:23.842922+0000 mgr.gibba020.yqfnwy (mgr.34427) 6577 : cluster [DBG] pgmap v3741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:24.334 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:24 gibba013 bash[30381]: cephadm 2021-03-10T15:57:23.615336+0000 mgr.gibba020.yqfnwy (mgr.34427) 6576 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:57:24.334 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:24 gibba013 bash[30381]: cluster 2021-03-10T15:57:23.842922+0000 mgr.gibba020.yqfnwy (mgr.34427) 6577 : cluster [DBG] pgmap v3741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:24.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:24 gibba020 bash[25448]: cephadm 2021-03-10T15:57:23.615336+0000 mgr.gibba020.yqfnwy (mgr.34427) 6576 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:57:24.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:24 gibba020 bash[25448]: cluster 2021-03-10T15:57:23.842922+0000 mgr.gibba020.yqfnwy (mgr.34427) 6577 : cluster [DBG] pgmap v3741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:27.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:26 gibba020 bash[25448]: cluster 2021-03-10T15:57:25.844606+0000 mgr.gibba020.yqfnwy (mgr.34427) 6578 : cluster [DBG] pgmap v3742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:27.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:26 gibba013 bash[29418]: cluster 2021-03-10T15:57:25.844606+0000 mgr.gibba020.yqfnwy (mgr.34427) 6578 : cluster [DBG] pgmap v3742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:27.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:26 gibba013 bash[30381]: cluster 2021-03-10T15:57:25.844606+0000 mgr.gibba020.yqfnwy (mgr.34427) 6578 : cluster [DBG] pgmap v3742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:29.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:28 gibba020 bash[25448]: cluster 2021-03-10T15:57:27.846134+0000 mgr.gibba020.yqfnwy (mgr.34427) 6579 : cluster [DBG] pgmap v3743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:29.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:28 gibba013 bash[29418]: cluster 2021-03-10T15:57:27.846134+0000 mgr.gibba020.yqfnwy (mgr.34427) 6579 : cluster [DBG] pgmap v3743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:29.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:28 gibba013 bash[30381]: cluster 2021-03-10T15:57:27.846134+0000 mgr.gibba020.yqfnwy (mgr.34427) 6579 : cluster [DBG] pgmap v3743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:31.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:30 gibba020 bash[25448]: cluster 2021-03-10T15:57:29.847868+0000 mgr.gibba020.yqfnwy (mgr.34427) 6580 : cluster [DBG] pgmap v3744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:31.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:30 gibba013 bash[29418]: cluster 2021-03-10T15:57:29.847868+0000 mgr.gibba020.yqfnwy (mgr.34427) 6580 : cluster [DBG] pgmap v3744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:31.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:30 gibba013 bash[30381]: cluster 2021-03-10T15:57:29.847868+0000 mgr.gibba020.yqfnwy (mgr.34427) 6580 : cluster [DBG] pgmap v3744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:32.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:31 gibba013 bash[29418]: cluster 2021-03-10T15:57:31.849547+0000 mgr.gibba020.yqfnwy (mgr.34427) 6581 : cluster [DBG] pgmap v3745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:32.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:31 gibba013 bash[30381]: cluster 2021-03-10T15:57:31.849547+0000 mgr.gibba020.yqfnwy (mgr.34427) 6581 : cluster [DBG] pgmap v3745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:32.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:31 gibba020 bash[25448]: cluster 2021-03-10T15:57:31.849547+0000 mgr.gibba020.yqfnwy (mgr.34427) 6581 : cluster [DBG] pgmap v3745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:34.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:34 gibba013 bash[29418]: cluster 2021-03-10T15:57:33.851056+0000 mgr.gibba020.yqfnwy (mgr.34427) 6582 : cluster [DBG] pgmap v3746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:34.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:34 gibba013 bash[30381]: cluster 2021-03-10T15:57:33.851056+0000 mgr.gibba020.yqfnwy (mgr.34427) 6582 : cluster [DBG] pgmap v3746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:34.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:34 gibba020 bash[25448]: cluster 2021-03-10T15:57:33.851056+0000 mgr.gibba020.yqfnwy (mgr.34427) 6582 : cluster [DBG] pgmap v3746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:37.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:36 gibba020 bash[25448]: cluster 2021-03-10T15:57:35.852797+0000 mgr.gibba020.yqfnwy (mgr.34427) 6583 : cluster [DBG] pgmap v3747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:37.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:36 gibba013 bash[29418]: cluster 2021-03-10T15:57:35.852797+0000 mgr.gibba020.yqfnwy (mgr.34427) 6583 : cluster [DBG] pgmap v3747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:37.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:36 gibba013 bash[30381]: cluster 2021-03-10T15:57:35.852797+0000 mgr.gibba020.yqfnwy (mgr.34427) 6583 : cluster [DBG] pgmap v3747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:39.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:38 gibba020 bash[25448]: cluster 2021-03-10T15:57:37.854193+0000 mgr.gibba020.yqfnwy (mgr.34427) 6584 : cluster [DBG] pgmap v3748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:39.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:38 gibba013 bash[29418]: cluster 2021-03-10T15:57:37.854193+0000 mgr.gibba020.yqfnwy (mgr.34427) 6584 : cluster [DBG] pgmap v3748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:39.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:38 gibba013 bash[30381]: cluster 2021-03-10T15:57:37.854193+0000 mgr.gibba020.yqfnwy (mgr.34427) 6584 : cluster [DBG] pgmap v3748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:40.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:39 gibba020 bash[25448]: cephadm 2021-03-10T15:57:38.631423+0000 mgr.gibba020.yqfnwy (mgr.34427) 6585 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:57:40.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:39 gibba013 bash[29418]: cephadm 2021-03-10T15:57:38.631423+0000 mgr.gibba020.yqfnwy (mgr.34427) 6585 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:57:40.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:39 gibba013 bash[30381]: cephadm 2021-03-10T15:57:38.631423+0000 mgr.gibba020.yqfnwy (mgr.34427) 6585 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:57:41.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:40 gibba020 bash[25448]: cluster 2021-03-10T15:57:39.855980+0000 mgr.gibba020.yqfnwy (mgr.34427) 6586 : cluster [DBG] pgmap v3749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:41.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:40 gibba013 bash[29418]: cluster 2021-03-10T15:57:39.855980+0000 mgr.gibba020.yqfnwy (mgr.34427) 6586 : cluster [DBG] pgmap v3749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:41.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:40 gibba013 bash[30381]: cluster 2021-03-10T15:57:39.855980+0000 mgr.gibba020.yqfnwy (mgr.34427) 6586 : cluster [DBG] pgmap v3749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:42.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:41 gibba013 bash[29418]: cluster 2021-03-10T15:57:41.857288+0000 mgr.gibba020.yqfnwy (mgr.34427) 6587 : cluster [DBG] pgmap v3750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:42.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:41 gibba013 bash[30381]: cluster 2021-03-10T15:57:41.857288+0000 mgr.gibba020.yqfnwy (mgr.34427) 6587 : cluster [DBG] pgmap v3750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:42.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:41 gibba020 bash[25448]: cluster 2021-03-10T15:57:41.857288+0000 mgr.gibba020.yqfnwy (mgr.34427) 6587 : cluster [DBG] pgmap v3750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:44.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:44 gibba013 bash[29418]: cluster 2021-03-10T15:57:43.858924+0000 mgr.gibba020.yqfnwy (mgr.34427) 6588 : cluster [DBG] pgmap v3751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:44.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:44 gibba013 bash[30381]: cluster 2021-03-10T15:57:43.858924+0000 mgr.gibba020.yqfnwy (mgr.34427) 6588 : cluster [DBG] pgmap v3751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:44.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:44 gibba020 bash[25448]: cluster 2021-03-10T15:57:43.858924+0000 mgr.gibba020.yqfnwy (mgr.34427) 6588 : cluster [DBG] pgmap v3751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:47.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:46 gibba020 bash[25448]: cluster 2021-03-10T15:57:45.860652+0000 mgr.gibba020.yqfnwy (mgr.34427) 6589 : cluster [DBG] pgmap v3752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:47.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:46 gibba013 bash[29418]: cluster 2021-03-10T15:57:45.860652+0000 mgr.gibba020.yqfnwy (mgr.34427) 6589 : cluster [DBG] pgmap v3752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:47.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:46 gibba013 bash[30381]: cluster 2021-03-10T15:57:45.860652+0000 mgr.gibba020.yqfnwy (mgr.34427) 6589 : cluster [DBG] pgmap v3752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:47.902 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:57:48.130 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:57:48.131 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 8m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:57:48.131 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 7m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:57:48.131 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:57:48.131 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:57:48.132 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:57:48.132 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:57:48.132 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:57:48.132 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:57:48.133 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:57:48.133 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:57:48.133 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:57:48.133 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:57:48.134 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:57:48.134 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:57:48.134 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:57:48.134 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:57:48.134 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (119m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:57:48.135 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (119m) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:57:48.135 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 7m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:57:48.135 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 7m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:57:48.384 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:57:48.385 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:57:48.385 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:57:48.385 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:57:48.385 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:57:48.386 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:57:48.386 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:57:48.386 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:57:48.386 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:57:48.387 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:57:48.387 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:57:48.387 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:57:48.387 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:57:48.387 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:57:48.388 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:57:49.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:48 gibba020 bash[25448]: cluster 2021-03-10T15:57:47.861964+0000 mgr.gibba020.yqfnwy (mgr.34427) 6590 : cluster [DBG] pgmap v3753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:49.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:48 gibba020 bash[25448]: audit 2021-03-10T15:57:47.891354+0000 mgr.gibba020.yqfnwy (mgr.34427) 6591 : audit [DBG] from='client.58465 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:57:49.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:48 gibba020 bash[25448]: audit 2021-03-10T15:57:48.384280+0000 mon.a (mon.0) 2544 : audit [DBG] from='client.? 172.21.2.113:0/1023109852' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:49.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:48 gibba013 bash[29418]: cluster 2021-03-10T15:57:47.861964+0000 mgr.gibba020.yqfnwy (mgr.34427) 6590 : cluster [DBG] pgmap v3753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:49.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:48 gibba013 bash[29418]: audit 2021-03-10T15:57:47.891354+0000 mgr.gibba020.yqfnwy (mgr.34427) 6591 : audit [DBG] from='client.58465 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:57:49.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:48 gibba013 bash[29418]: audit 2021-03-10T15:57:48.384280+0000 mon.a (mon.0) 2544 : audit [DBG] from='client.? 172.21.2.113:0/1023109852' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:49.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:48 gibba013 bash[30381]: cluster 2021-03-10T15:57:47.861964+0000 mgr.gibba020.yqfnwy (mgr.34427) 6590 : cluster [DBG] pgmap v3753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:49.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:48 gibba013 bash[30381]: audit 2021-03-10T15:57:47.891354+0000 mgr.gibba020.yqfnwy (mgr.34427) 6591 : audit [DBG] from='client.58465 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:57:49.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:48 gibba013 bash[30381]: audit 2021-03-10T15:57:48.384280+0000 mon.a (mon.0) 2544 : audit [DBG] from='client.? 172.21.2.113:0/1023109852' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:50.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:49 gibba020 bash[25448]: audit 2021-03-10T15:57:48.115385+0000 mgr.gibba020.yqfnwy (mgr.34427) 6592 : audit [DBG] from='client.48486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:57:50.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:49 gibba013 bash[29418]: audit 2021-03-10T15:57:48.115385+0000 mgr.gibba020.yqfnwy (mgr.34427) 6592 : audit [DBG] from='client.48486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:57:50.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:49 gibba013 bash[30381]: audit 2021-03-10T15:57:48.115385+0000 mgr.gibba020.yqfnwy (mgr.34427) 6592 : audit [DBG] from='client.48486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:57:51.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:50 gibba020 bash[25448]: cluster 2021-03-10T15:57:49.863681+0000 mgr.gibba020.yqfnwy (mgr.34427) 6593 : cluster [DBG] pgmap v3754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:51.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:50 gibba013 bash[29418]: cluster 2021-03-10T15:57:49.863681+0000 mgr.gibba020.yqfnwy (mgr.34427) 6593 : cluster [DBG] pgmap v3754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:51.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:50 gibba013 bash[30381]: cluster 2021-03-10T15:57:49.863681+0000 mgr.gibba020.yqfnwy (mgr.34427) 6593 : cluster [DBG] pgmap v3754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:52.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:51 gibba013 bash[29418]: cluster 2021-03-10T15:57:51.865290+0000 mgr.gibba020.yqfnwy (mgr.34427) 6594 : cluster [DBG] pgmap v3755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:52.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:51 gibba013 bash[30381]: cluster 2021-03-10T15:57:51.865290+0000 mgr.gibba020.yqfnwy (mgr.34427) 6594 : cluster [DBG] pgmap v3755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:52.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:51 gibba020 bash[25448]: cluster 2021-03-10T15:57:51.865290+0000 mgr.gibba020.yqfnwy (mgr.34427) 6594 : cluster [DBG] pgmap v3755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:54.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[29418]: audit 2021-03-10T15:57:53.649933+0000 mon.a (mon.0) 2545 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:57:54.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[29418]: cephadm 2021-03-10T15:57:53.653475+0000 mgr.gibba020.yqfnwy (mgr.34427) 6595 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:57:54.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[29418]: cephadm 2021-03-10T15:57:53.655214+0000 mgr.gibba020.yqfnwy (mgr.34427) 6596 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:57:54.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[29418]: audit 2021-03-10T15:57:53.862550+0000 mon.a (mon.0) 2546 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:57:54.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[29418]: cephadm 2021-03-10T15:57:53.863628+0000 mgr.gibba020.yqfnwy (mgr.34427) 6597 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:57:54.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[29418]: cluster 2021-03-10T15:57:53.866003+0000 mgr.gibba020.yqfnwy (mgr.34427) 6598 : cluster [DBG] pgmap v3756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:54.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[29418]: audit 2021-03-10T15:57:53.866091+0000 mon.a (mon.0) 2547 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:57:54.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[29418]: cephadm 2021-03-10T15:57:53.866954+0000 mgr.gibba020.yqfnwy (mgr.34427) 6599 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:57:54.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[29418]: audit 2021-03-10T15:57:53.869738+0000 mon.a (mon.0) 2548 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:54.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[29418]: cephadm 2021-03-10T15:57:53.870448+0000 mgr.gibba020.yqfnwy (mgr.34427) 6600 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:57:54.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[29418]: cephadm 2021-03-10T15:57:53.870487+0000 mgr.gibba020.yqfnwy (mgr.34427) 6601 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:57:54.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[29418]: audit 2021-03-10T15:57:53.872581+0000 mon.a (mon.0) 2549 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:54.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[29418]: cephadm 2021-03-10T15:57:53.872790+0000 mgr.gibba020.yqfnwy (mgr.34427) 6602 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:57:54.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[29418]: cephadm 2021-03-10T15:57:53.872827+0000 mgr.gibba020.yqfnwy (mgr.34427) 6603 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:57:54.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[29418]: audit 2021-03-10T15:57:53.874823+0000 mon.a (mon.0) 2550 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:54.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[29418]: cephadm 2021-03-10T15:57:53.874970+0000 mgr.gibba020.yqfnwy (mgr.34427) 6604 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:57:54.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[29418]: cephadm 2021-03-10T15:57:53.878076+0000 mgr.gibba020.yqfnwy (mgr.34427) 6605 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:57:54.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[29418]: cephadm 2021-03-10T15:57:53.878113+0000 mgr.gibba020.yqfnwy (mgr.34427) 6606 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:57:54.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[29418]: audit 2021-03-10T15:57:53.880529+0000 mon.a (mon.0) 2551 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:54.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[29418]: cephadm 2021-03-10T15:57:53.880809+0000 mgr.gibba020.yqfnwy (mgr.34427) 6607 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:57:54.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[30381]: audit 2021-03-10T15:57:53.649933+0000 mon.a (mon.0) 2545 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:57:54.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[30381]: cephadm 2021-03-10T15:57:53.653475+0000 mgr.gibba020.yqfnwy (mgr.34427) 6595 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:57:54.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[30381]: cephadm 2021-03-10T15:57:53.655214+0000 mgr.gibba020.yqfnwy (mgr.34427) 6596 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:57:54.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[30381]: audit 2021-03-10T15:57:53.862550+0000 mon.a (mon.0) 2546 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:57:54.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[30381]: cephadm 2021-03-10T15:57:53.863628+0000 mgr.gibba020.yqfnwy (mgr.34427) 6597 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:57:54.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[30381]: cluster 2021-03-10T15:57:53.866003+0000 mgr.gibba020.yqfnwy (mgr.34427) 6598 : cluster [DBG] pgmap v3756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:54.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[30381]: audit 2021-03-10T15:57:53.866091+0000 mon.a (mon.0) 2547 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:57:54.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[30381]: cephadm 2021-03-10T15:57:53.866954+0000 mgr.gibba020.yqfnwy (mgr.34427) 6599 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:57:54.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[30381]: audit 2021-03-10T15:57:53.869738+0000 mon.a (mon.0) 2548 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:54.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[30381]: cephadm 2021-03-10T15:57:53.870448+0000 mgr.gibba020.yqfnwy (mgr.34427) 6600 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:57:54.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[30381]: cephadm 2021-03-10T15:57:53.870487+0000 mgr.gibba020.yqfnwy (mgr.34427) 6601 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:57:54.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[30381]: audit 2021-03-10T15:57:53.872581+0000 mon.a (mon.0) 2549 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:54.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[30381]: cephadm 2021-03-10T15:57:53.872790+0000 mgr.gibba020.yqfnwy (mgr.34427) 6602 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:57:54.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[30381]: cephadm 2021-03-10T15:57:53.872827+0000 mgr.gibba020.yqfnwy (mgr.34427) 6603 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:57:54.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[30381]: audit 2021-03-10T15:57:53.874823+0000 mon.a (mon.0) 2550 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:54.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[30381]: cephadm 2021-03-10T15:57:53.874970+0000 mgr.gibba020.yqfnwy (mgr.34427) 6604 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:57:54.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[30381]: cephadm 2021-03-10T15:57:53.878076+0000 mgr.gibba020.yqfnwy (mgr.34427) 6605 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:57:54.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[30381]: cephadm 2021-03-10T15:57:53.878113+0000 mgr.gibba020.yqfnwy (mgr.34427) 6606 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:57:54.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[30381]: audit 2021-03-10T15:57:53.880529+0000 mon.a (mon.0) 2551 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:54.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[30381]: cephadm 2021-03-10T15:57:53.880809+0000 mgr.gibba020.yqfnwy (mgr.34427) 6607 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:57:54.640 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[29418]: cephadm 2021-03-10T15:57:53.881227+0000 mgr.gibba020.yqfnwy (mgr.34427) 6608 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:57:54.640 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[29418]: audit 2021-03-10T15:57:53.883289+0000 mon.a (mon.0) 2552 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:54.640 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[29418]: cephadm 2021-03-10T15:57:53.883892+0000 mgr.gibba020.yqfnwy (mgr.34427) 6609 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:57:54.640 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[29418]: cephadm 2021-03-10T15:57:53.883976+0000 mgr.gibba020.yqfnwy (mgr.34427) 6610 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:57:54.640 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[29418]: cephadm 2021-03-10T15:57:53.884127+0000 mgr.gibba020.yqfnwy (mgr.34427) 6611 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:57:54.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[30381]: cephadm 2021-03-10T15:57:53.881227+0000 mgr.gibba020.yqfnwy (mgr.34427) 6608 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:57:54.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[30381]: audit 2021-03-10T15:57:53.883289+0000 mon.a (mon.0) 2552 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:54.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[30381]: cephadm 2021-03-10T15:57:53.883892+0000 mgr.gibba020.yqfnwy (mgr.34427) 6609 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:57:54.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[30381]: cephadm 2021-03-10T15:57:53.883976+0000 mgr.gibba020.yqfnwy (mgr.34427) 6610 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:57:54.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:54 gibba013 bash[30381]: cephadm 2021-03-10T15:57:53.884127+0000 mgr.gibba020.yqfnwy (mgr.34427) 6611 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:57:54.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:54 gibba020 bash[25448]: audit 2021-03-10T15:57:53.649933+0000 mon.a (mon.0) 2545 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:57:54.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:54 gibba020 bash[25448]: cephadm 2021-03-10T15:57:53.653475+0000 mgr.gibba020.yqfnwy (mgr.34427) 6595 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:57:54.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:54 gibba020 bash[25448]: cephadm 2021-03-10T15:57:53.655214+0000 mgr.gibba020.yqfnwy (mgr.34427) 6596 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:57:54.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:54 gibba020 bash[25448]: audit 2021-03-10T15:57:53.862550+0000 mon.a (mon.0) 2546 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:57:54.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:54 gibba020 bash[25448]: cephadm 2021-03-10T15:57:53.863628+0000 mgr.gibba020.yqfnwy (mgr.34427) 6597 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:57:54.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:54 gibba020 bash[25448]: cluster 2021-03-10T15:57:53.866003+0000 mgr.gibba020.yqfnwy (mgr.34427) 6598 : cluster [DBG] pgmap v3756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:54.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:54 gibba020 bash[25448]: audit 2021-03-10T15:57:53.866091+0000 mon.a (mon.0) 2547 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:57:54.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:54 gibba020 bash[25448]: cephadm 2021-03-10T15:57:53.866954+0000 mgr.gibba020.yqfnwy (mgr.34427) 6599 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:57:54.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:54 gibba020 bash[25448]: audit 2021-03-10T15:57:53.869738+0000 mon.a (mon.0) 2548 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:54.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:54 gibba020 bash[25448]: cephadm 2021-03-10T15:57:53.870448+0000 mgr.gibba020.yqfnwy (mgr.34427) 6600 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:57:54.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:54 gibba020 bash[25448]: cephadm 2021-03-10T15:57:53.870487+0000 mgr.gibba020.yqfnwy (mgr.34427) 6601 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:57:54.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:54 gibba020 bash[25448]: audit 2021-03-10T15:57:53.872581+0000 mon.a (mon.0) 2549 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:54.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:54 gibba020 bash[25448]: cephadm 2021-03-10T15:57:53.872790+0000 mgr.gibba020.yqfnwy (mgr.34427) 6602 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:57:54.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:54 gibba020 bash[25448]: cephadm 2021-03-10T15:57:53.872827+0000 mgr.gibba020.yqfnwy (mgr.34427) 6603 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:57:54.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:54 gibba020 bash[25448]: audit 2021-03-10T15:57:53.874823+0000 mon.a (mon.0) 2550 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:54.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:54 gibba020 bash[25448]: cephadm 2021-03-10T15:57:53.874970+0000 mgr.gibba020.yqfnwy (mgr.34427) 6604 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:57:54.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:54 gibba020 bash[25448]: cephadm 2021-03-10T15:57:53.878076+0000 mgr.gibba020.yqfnwy (mgr.34427) 6605 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:57:54.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:54 gibba020 bash[25448]: cephadm 2021-03-10T15:57:53.878113+0000 mgr.gibba020.yqfnwy (mgr.34427) 6606 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:57:54.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:54 gibba020 bash[25448]: audit 2021-03-10T15:57:53.880529+0000 mon.a (mon.0) 2551 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:54.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:54 gibba020 bash[25448]: cephadm 2021-03-10T15:57:53.880809+0000 mgr.gibba020.yqfnwy (mgr.34427) 6607 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:57:54.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:54 gibba020 bash[25448]: cephadm 2021-03-10T15:57:53.881227+0000 mgr.gibba020.yqfnwy (mgr.34427) 6608 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:57:54.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:54 gibba020 bash[25448]: audit 2021-03-10T15:57:53.883289+0000 mon.a (mon.0) 2552 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:57:54.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:54 gibba020 bash[25448]: cephadm 2021-03-10T15:57:53.883892+0000 mgr.gibba020.yqfnwy (mgr.34427) 6609 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:57:54.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:54 gibba020 bash[25448]: cephadm 2021-03-10T15:57:53.883976+0000 mgr.gibba020.yqfnwy (mgr.34427) 6610 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:57:54.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:54 gibba020 bash[25448]: cephadm 2021-03-10T15:57:53.884127+0000 mgr.gibba020.yqfnwy (mgr.34427) 6611 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:57:57.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:56 gibba020 bash[25448]: cluster 2021-03-10T15:57:55.867561+0000 mgr.gibba020.yqfnwy (mgr.34427) 6612 : cluster [DBG] pgmap v3757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:57.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:56 gibba013 bash[29418]: cluster 2021-03-10T15:57:55.867561+0000 mgr.gibba020.yqfnwy (mgr.34427) 6612 : cluster [DBG] pgmap v3757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:57.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:56 gibba013 bash[30381]: cluster 2021-03-10T15:57:55.867561+0000 mgr.gibba020.yqfnwy (mgr.34427) 6612 : cluster [DBG] pgmap v3757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:58.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:57:57 gibba013 bash[29418]: cluster 2021-03-10T15:57:57.869001+0000 mgr.gibba020.yqfnwy (mgr.34427) 6613 : cluster [DBG] pgmap v3758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:58.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:57:57 gibba013 bash[30381]: cluster 2021-03-10T15:57:57.869001+0000 mgr.gibba020.yqfnwy (mgr.34427) 6613 : cluster [DBG] pgmap v3758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:57:58.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:57:57 gibba020 bash[25448]: cluster 2021-03-10T15:57:57.869001+0000 mgr.gibba020.yqfnwy (mgr.34427) 6613 : cluster [DBG] pgmap v3758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:01.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:00 gibba020 bash[25448]: cluster 2021-03-10T15:57:59.870826+0000 mgr.gibba020.yqfnwy (mgr.34427) 6614 : cluster [DBG] pgmap v3759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:01.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:00 gibba013 bash[29418]: cluster 2021-03-10T15:57:59.870826+0000 mgr.gibba020.yqfnwy (mgr.34427) 6614 : cluster [DBG] pgmap v3759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:01.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:00 gibba013 bash[30381]: cluster 2021-03-10T15:57:59.870826+0000 mgr.gibba020.yqfnwy (mgr.34427) 6614 : cluster [DBG] pgmap v3759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:02.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:01 gibba013 bash[29418]: cluster 2021-03-10T15:58:01.872388+0000 mgr.gibba020.yqfnwy (mgr.34427) 6615 : cluster [DBG] pgmap v3760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:02.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:01 gibba013 bash[30381]: cluster 2021-03-10T15:58:01.872388+0000 mgr.gibba020.yqfnwy (mgr.34427) 6615 : cluster [DBG] pgmap v3760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:02.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:01 gibba020 bash[25448]: cluster 2021-03-10T15:58:01.872388+0000 mgr.gibba020.yqfnwy (mgr.34427) 6615 : cluster [DBG] pgmap v3760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:04.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:04 gibba013 bash[29418]: cluster 2021-03-10T15:58:03.874120+0000 mgr.gibba020.yqfnwy (mgr.34427) 6616 : cluster [DBG] pgmap v3761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:04.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:04 gibba013 bash[30381]: cluster 2021-03-10T15:58:03.874120+0000 mgr.gibba020.yqfnwy (mgr.34427) 6616 : cluster [DBG] pgmap v3761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:04.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:04 gibba020 bash[25448]: cluster 2021-03-10T15:58:03.874120+0000 mgr.gibba020.yqfnwy (mgr.34427) 6616 : cluster [DBG] pgmap v3761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:07.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:06 gibba020 bash[25448]: cluster 2021-03-10T15:58:05.875707+0000 mgr.gibba020.yqfnwy (mgr.34427) 6617 : cluster [DBG] pgmap v3762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:07.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:06 gibba020 bash[25448]: audit 2021-03-10T15:58:06.602226+0000 mon.a (mon.0) 2553 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:58:07.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:06 gibba020 bash[25448]: audit 2021-03-10T15:58:06.678319+0000 mon.a (mon.0) 2554 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:58:07.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:06 gibba020 bash[25448]: audit 2021-03-10T15:58:06.848072+0000 mon.a (mon.0) 2555 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T15:58:07.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:06 gibba020 bash[25448]: audit 2021-03-10T15:58:06.848884+0000 mon.a (mon.0) 2556 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:58:07.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:06 gibba020 bash[25448]: audit 2021-03-10T15:58:06.849588+0000 mon.a (mon.0) 2557 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:58:07.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:06 gibba020 bash[25448]: audit 2021-03-10T15:58:06.850311+0000 mon.a (mon.0) 2558 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:58:07.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:06 gibba013 bash[29418]: cluster 2021-03-10T15:58:05.875707+0000 mgr.gibba020.yqfnwy (mgr.34427) 6617 : cluster [DBG] pgmap v3762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:07.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:06 gibba013 bash[29418]: audit 2021-03-10T15:58:06.602226+0000 mon.a (mon.0) 2553 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:58:07.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:06 gibba013 bash[29418]: audit 2021-03-10T15:58:06.678319+0000 mon.a (mon.0) 2554 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:58:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:06 gibba013 bash[29418]: audit 2021-03-10T15:58:06.848072+0000 mon.a (mon.0) 2555 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T15:58:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:06 gibba013 bash[29418]: audit 2021-03-10T15:58:06.848884+0000 mon.a (mon.0) 2556 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:58:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:06 gibba013 bash[29418]: audit 2021-03-10T15:58:06.849588+0000 mon.a (mon.0) 2557 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:58:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:06 gibba013 bash[29418]: audit 2021-03-10T15:58:06.850311+0000 mon.a (mon.0) 2558 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:58:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:06 gibba013 bash[30381]: cluster 2021-03-10T15:58:05.875707+0000 mgr.gibba020.yqfnwy (mgr.34427) 6617 : cluster [DBG] pgmap v3762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:06 gibba013 bash[30381]: audit 2021-03-10T15:58:06.602226+0000 mon.a (mon.0) 2553 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:58:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:06 gibba013 bash[30381]: audit 2021-03-10T15:58:06.678319+0000 mon.a (mon.0) 2554 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:58:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:06 gibba013 bash[30381]: audit 2021-03-10T15:58:06.848072+0000 mon.a (mon.0) 2555 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T15:58:07.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:06 gibba013 bash[30381]: audit 2021-03-10T15:58:06.848884+0000 mon.a (mon.0) 2556 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T15:58:07.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:06 gibba013 bash[30381]: audit 2021-03-10T15:58:06.849588+0000 mon.a (mon.0) 2557 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T15:58:07.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:06 gibba013 bash[30381]: audit 2021-03-10T15:58:06.850311+0000 mon.a (mon.0) 2558 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:58:08.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:07 gibba013 bash[29418]: cluster 2021-03-10T15:58:07.877234+0000 mgr.gibba020.yqfnwy (mgr.34427) 6618 : cluster [DBG] pgmap v3763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:08.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:07 gibba013 bash[30381]: cluster 2021-03-10T15:58:07.877234+0000 mgr.gibba020.yqfnwy (mgr.34427) 6618 : cluster [DBG] pgmap v3763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:08.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:07 gibba020 bash[25448]: cluster 2021-03-10T15:58:07.877234+0000 mgr.gibba020.yqfnwy (mgr.34427) 6618 : cluster [DBG] pgmap v3763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:09.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:09 gibba013 bash[29418]: cephadm 2021-03-10T15:58:08.899748+0000 mgr.gibba020.yqfnwy (mgr.34427) 6619 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:58:09.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:09 gibba013 bash[30381]: cephadm 2021-03-10T15:58:08.899748+0000 mgr.gibba020.yqfnwy (mgr.34427) 6619 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:58:09.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:09 gibba020 bash[25448]: cephadm 2021-03-10T15:58:08.899748+0000 mgr.gibba020.yqfnwy (mgr.34427) 6619 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:58:10.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:10 gibba013 bash[29418]: cluster 2021-03-10T15:58:09.878800+0000 mgr.gibba020.yqfnwy (mgr.34427) 6620 : cluster [DBG] pgmap v3764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:10.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:10 gibba013 bash[30381]: cluster 2021-03-10T15:58:09.878800+0000 mgr.gibba020.yqfnwy (mgr.34427) 6620 : cluster [DBG] pgmap v3764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:10.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:10 gibba020 bash[25448]: cluster 2021-03-10T15:58:09.878800+0000 mgr.gibba020.yqfnwy (mgr.34427) 6620 : cluster [DBG] pgmap v3764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:13.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:12 gibba020 bash[25448]: cluster 2021-03-10T15:58:11.880248+0000 mgr.gibba020.yqfnwy (mgr.34427) 6621 : cluster [DBG] pgmap v3765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:13.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:12 gibba013 bash[29418]: cluster 2021-03-10T15:58:11.880248+0000 mgr.gibba020.yqfnwy (mgr.34427) 6621 : cluster [DBG] pgmap v3765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:13.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:12 gibba013 bash[30381]: cluster 2021-03-10T15:58:11.880248+0000 mgr.gibba020.yqfnwy (mgr.34427) 6621 : cluster [DBG] pgmap v3765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:14.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:14 gibba013 bash[29418]: cluster 2021-03-10T15:58:13.881937+0000 mgr.gibba020.yqfnwy (mgr.34427) 6622 : cluster [DBG] pgmap v3766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:14.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:14 gibba013 bash[30381]: cluster 2021-03-10T15:58:13.881937+0000 mgr.gibba020.yqfnwy (mgr.34427) 6622 : cluster [DBG] pgmap v3766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:14.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:14 gibba020 bash[25448]: cluster 2021-03-10T15:58:13.881937+0000 mgr.gibba020.yqfnwy (mgr.34427) 6622 : cluster [DBG] pgmap v3766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:16.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:15 gibba013 bash[29418]: cluster 2021-03-10T15:58:15.883671+0000 mgr.gibba020.yqfnwy (mgr.34427) 6623 : cluster [DBG] pgmap v3767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:16.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:15 gibba013 bash[30381]: cluster 2021-03-10T15:58:15.883671+0000 mgr.gibba020.yqfnwy (mgr.34427) 6623 : cluster [DBG] pgmap v3767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:16.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:15 gibba020 bash[25448]: cluster 2021-03-10T15:58:15.883671+0000 mgr.gibba020.yqfnwy (mgr.34427) 6623 : cluster [DBG] pgmap v3767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:18.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:17 gibba013 bash[29418]: cluster 2021-03-10T15:58:17.885183+0000 mgr.gibba020.yqfnwy (mgr.34427) 6624 : cluster [DBG] pgmap v3768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:18.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:17 gibba013 bash[30381]: cluster 2021-03-10T15:58:17.885183+0000 mgr.gibba020.yqfnwy (mgr.34427) 6624 : cluster [DBG] pgmap v3768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:18.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:17 gibba020 bash[25448]: cluster 2021-03-10T15:58:17.885183+0000 mgr.gibba020.yqfnwy (mgr.34427) 6624 : cluster [DBG] pgmap v3768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:18.626 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:58:18.856 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:58:18.856 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 8m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:58:18.856 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 7m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:58:18.856 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:58:18.857 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:58:18.857 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:58:18.857 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:58:18.857 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:58:18.858 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:58:18.858 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:58:18.858 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:58:18.858 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:58:18.858 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:58:18.859 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:58:18.859 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:58:18.859 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:58:18.859 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:58:18.860 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:58:18.860 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:58:18.860 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 7m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:58:18.860 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 7m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:58:19.105 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:58:19.105 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:58:19.106 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:58:19.106 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:58:19.106 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:58:19.106 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:58:19.107 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:58:19.107 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:58:19.107 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:58:19.107 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:58:19.107 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:58:19.108 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:58:19.108 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:58:19.108 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:58:19.108 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:58:19.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:19 gibba013 bash[29418]: audit 2021-03-10T15:58:18.615607+0000 mgr.gibba020.yqfnwy (mgr.34427) 6625 : audit [DBG] from='client.58483 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:58:19.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:19 gibba013 bash[29418]: audit 2021-03-10T15:58:18.841214+0000 mgr.gibba020.yqfnwy (mgr.34427) 6626 : audit [DBG] from='client.58489 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:58:19.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:19 gibba013 bash[29418]: audit 2021-03-10T15:58:19.104738+0000 mon.a (mon.0) 2559 : audit [DBG] from='client.? 172.21.2.113:0/3679992951' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:19.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:19 gibba013 bash[30381]: audit 2021-03-10T15:58:18.615607+0000 mgr.gibba020.yqfnwy (mgr.34427) 6625 : audit [DBG] from='client.58483 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:58:19.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:19 gibba013 bash[30381]: audit 2021-03-10T15:58:18.841214+0000 mgr.gibba020.yqfnwy (mgr.34427) 6626 : audit [DBG] from='client.58489 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:58:19.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:19 gibba013 bash[30381]: audit 2021-03-10T15:58:19.104738+0000 mon.a (mon.0) 2559 : audit [DBG] from='client.? 172.21.2.113:0/3679992951' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:19.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:19 gibba020 bash[25448]: audit 2021-03-10T15:58:18.615607+0000 mgr.gibba020.yqfnwy (mgr.34427) 6625 : audit [DBG] from='client.58483 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:58:19.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:19 gibba020 bash[25448]: audit 2021-03-10T15:58:18.841214+0000 mgr.gibba020.yqfnwy (mgr.34427) 6626 : audit [DBG] from='client.58489 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:58:19.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:19 gibba020 bash[25448]: audit 2021-03-10T15:58:19.104738+0000 mon.a (mon.0) 2559 : audit [DBG] from='client.? 172.21.2.113:0/3679992951' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:20.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:20 gibba013 bash[29418]: cluster 2021-03-10T15:58:19.886873+0000 mgr.gibba020.yqfnwy (mgr.34427) 6627 : cluster [DBG] pgmap v3769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:20.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:20 gibba013 bash[30381]: cluster 2021-03-10T15:58:19.886873+0000 mgr.gibba020.yqfnwy (mgr.34427) 6627 : cluster [DBG] pgmap v3769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:20.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:20 gibba020 bash[25448]: cluster 2021-03-10T15:58:19.886873+0000 mgr.gibba020.yqfnwy (mgr.34427) 6627 : cluster [DBG] pgmap v3769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:22.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:21 gibba013 bash[29418]: cluster 2021-03-10T15:58:21.888437+0000 mgr.gibba020.yqfnwy (mgr.34427) 6628 : cluster [DBG] pgmap v3770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:22.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:21 gibba013 bash[30381]: cluster 2021-03-10T15:58:21.888437+0000 mgr.gibba020.yqfnwy (mgr.34427) 6628 : cluster [DBG] pgmap v3770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:22.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:21 gibba020 bash[25448]: cluster 2021-03-10T15:58:21.888437+0000 mgr.gibba020.yqfnwy (mgr.34427) 6628 : cluster [DBG] pgmap v3770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:24.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:24 gibba013 bash[29418]: cluster 2021-03-10T15:58:23.890004+0000 mgr.gibba020.yqfnwy (mgr.34427) 6629 : cluster [DBG] pgmap v3771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:24.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:24 gibba013 bash[29418]: cephadm 2021-03-10T15:58:23.915781+0000 mgr.gibba020.yqfnwy (mgr.34427) 6630 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:58:24.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:24 gibba013 bash[30381]: cluster 2021-03-10T15:58:23.890004+0000 mgr.gibba020.yqfnwy (mgr.34427) 6629 : cluster [DBG] pgmap v3771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:24.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:24 gibba013 bash[30381]: cephadm 2021-03-10T15:58:23.915781+0000 mgr.gibba020.yqfnwy (mgr.34427) 6630 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:58:24.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:24 gibba020 bash[25448]: cluster 2021-03-10T15:58:23.890004+0000 mgr.gibba020.yqfnwy (mgr.34427) 6629 : cluster [DBG] pgmap v3771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:24.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:24 gibba020 bash[25448]: cephadm 2021-03-10T15:58:23.915781+0000 mgr.gibba020.yqfnwy (mgr.34427) 6630 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:58:26.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:26 gibba013 bash[29418]: cluster 2021-03-10T15:58:25.891583+0000 mgr.gibba020.yqfnwy (mgr.34427) 6631 : cluster [DBG] pgmap v3772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:26.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:26 gibba013 bash[30381]: cluster 2021-03-10T15:58:25.891583+0000 mgr.gibba020.yqfnwy (mgr.34427) 6631 : cluster [DBG] pgmap v3772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:26.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:25 gibba020 bash[25448]: cluster 2021-03-10T15:58:25.891583+0000 mgr.gibba020.yqfnwy (mgr.34427) 6631 : cluster [DBG] pgmap v3772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:28.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:27 gibba013 bash[29418]: cluster 2021-03-10T15:58:27.893195+0000 mgr.gibba020.yqfnwy (mgr.34427) 6632 : cluster [DBG] pgmap v3773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:28.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:28 gibba013 bash[30381]: cluster 2021-03-10T15:58:27.893195+0000 mgr.gibba020.yqfnwy (mgr.34427) 6632 : cluster [DBG] pgmap v3773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:28.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:27 gibba020 bash[25448]: cluster 2021-03-10T15:58:27.893195+0000 mgr.gibba020.yqfnwy (mgr.34427) 6632 : cluster [DBG] pgmap v3773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:30.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:30 gibba013 bash[29418]: cluster 2021-03-10T15:58:29.894780+0000 mgr.gibba020.yqfnwy (mgr.34427) 6633 : cluster [DBG] pgmap v3774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:30.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:30 gibba013 bash[30381]: cluster 2021-03-10T15:58:29.894780+0000 mgr.gibba020.yqfnwy (mgr.34427) 6633 : cluster [DBG] pgmap v3774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:30.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:30 gibba020 bash[25448]: cluster 2021-03-10T15:58:29.894780+0000 mgr.gibba020.yqfnwy (mgr.34427) 6633 : cluster [DBG] pgmap v3774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:32.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:32 gibba013 bash[29418]: cluster 2021-03-10T15:58:31.896358+0000 mgr.gibba020.yqfnwy (mgr.34427) 6634 : cluster [DBG] pgmap v3775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:32.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:32 gibba013 bash[30381]: cluster 2021-03-10T15:58:31.896358+0000 mgr.gibba020.yqfnwy (mgr.34427) 6634 : cluster [DBG] pgmap v3775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:32.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:32 gibba020 bash[25448]: cluster 2021-03-10T15:58:31.896358+0000 mgr.gibba020.yqfnwy (mgr.34427) 6634 : cluster [DBG] pgmap v3775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:34.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:34 gibba013 bash[29418]: cluster 2021-03-10T15:58:33.897758+0000 mgr.gibba020.yqfnwy (mgr.34427) 6635 : cluster [DBG] pgmap v3776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:34.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:34 gibba013 bash[30381]: cluster 2021-03-10T15:58:33.897758+0000 mgr.gibba020.yqfnwy (mgr.34427) 6635 : cluster [DBG] pgmap v3776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:34.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:34 gibba020 bash[25448]: cluster 2021-03-10T15:58:33.897758+0000 mgr.gibba020.yqfnwy (mgr.34427) 6635 : cluster [DBG] pgmap v3776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:36.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:36 gibba013 bash[29418]: cluster 2021-03-10T15:58:35.899435+0000 mgr.gibba020.yqfnwy (mgr.34427) 6636 : cluster [DBG] pgmap v3777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:36.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:36 gibba013 bash[30381]: cluster 2021-03-10T15:58:35.899435+0000 mgr.gibba020.yqfnwy (mgr.34427) 6636 : cluster [DBG] pgmap v3777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:36.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:36 gibba020 bash[25448]: cluster 2021-03-10T15:58:35.899435+0000 mgr.gibba020.yqfnwy (mgr.34427) 6636 : cluster [DBG] pgmap v3777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:38.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:38 gibba013 bash[29418]: cluster 2021-03-10T15:58:37.900960+0000 mgr.gibba020.yqfnwy (mgr.34427) 6637 : cluster [DBG] pgmap v3778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:38.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:38 gibba013 bash[30381]: cluster 2021-03-10T15:58:37.900960+0000 mgr.gibba020.yqfnwy (mgr.34427) 6637 : cluster [DBG] pgmap v3778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:38.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:38 gibba020 bash[25448]: cluster 2021-03-10T15:58:37.900960+0000 mgr.gibba020.yqfnwy (mgr.34427) 6637 : cluster [DBG] pgmap v3778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:39.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:39 gibba013 bash[29418]: cephadm 2021-03-10T15:58:38.931871+0000 mgr.gibba020.yqfnwy (mgr.34427) 6638 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:58:39.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:39 gibba013 bash[30381]: cephadm 2021-03-10T15:58:38.931871+0000 mgr.gibba020.yqfnwy (mgr.34427) 6638 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:58:39.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:39 gibba020 bash[25448]: cephadm 2021-03-10T15:58:38.931871+0000 mgr.gibba020.yqfnwy (mgr.34427) 6638 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:58:40.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:40 gibba020 bash[25448]: cluster 2021-03-10T15:58:39.902744+0000 mgr.gibba020.yqfnwy (mgr.34427) 6639 : cluster [DBG] pgmap v3779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:40.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:40 gibba013 bash[29418]: cluster 2021-03-10T15:58:39.902744+0000 mgr.gibba020.yqfnwy (mgr.34427) 6639 : cluster [DBG] pgmap v3779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:40.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:40 gibba013 bash[30381]: cluster 2021-03-10T15:58:39.902744+0000 mgr.gibba020.yqfnwy (mgr.34427) 6639 : cluster [DBG] pgmap v3779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:42.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:42 gibba013 bash[29418]: cluster 2021-03-10T15:58:41.904075+0000 mgr.gibba020.yqfnwy (mgr.34427) 6640 : cluster [DBG] pgmap v3780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:42.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:42 gibba013 bash[30381]: cluster 2021-03-10T15:58:41.904075+0000 mgr.gibba020.yqfnwy (mgr.34427) 6640 : cluster [DBG] pgmap v3780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:42.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:42 gibba020 bash[25448]: cluster 2021-03-10T15:58:41.904075+0000 mgr.gibba020.yqfnwy (mgr.34427) 6640 : cluster [DBG] pgmap v3780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:44.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:44 gibba013 bash[29418]: cluster 2021-03-10T15:58:43.905395+0000 mgr.gibba020.yqfnwy (mgr.34427) 6641 : cluster [DBG] pgmap v3781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:44.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:44 gibba013 bash[30381]: cluster 2021-03-10T15:58:43.905395+0000 mgr.gibba020.yqfnwy (mgr.34427) 6641 : cluster [DBG] pgmap v3781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:44.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:44 gibba020 bash[25448]: cluster 2021-03-10T15:58:43.905395+0000 mgr.gibba020.yqfnwy (mgr.34427) 6641 : cluster [DBG] pgmap v3781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:46.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:46 gibba013 bash[29418]: cluster 2021-03-10T15:58:45.907144+0000 mgr.gibba020.yqfnwy (mgr.34427) 6642 : cluster [DBG] pgmap v3782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:46.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:46 gibba013 bash[30381]: cluster 2021-03-10T15:58:45.907144+0000 mgr.gibba020.yqfnwy (mgr.34427) 6642 : cluster [DBG] pgmap v3782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:46.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:46 gibba020 bash[25448]: cluster 2021-03-10T15:58:45.907144+0000 mgr.gibba020.yqfnwy (mgr.34427) 6642 : cluster [DBG] pgmap v3782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:48.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:48 gibba013 bash[29418]: cluster 2021-03-10T15:58:47.908710+0000 mgr.gibba020.yqfnwy (mgr.34427) 6643 : cluster [DBG] pgmap v3783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:48.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:48 gibba013 bash[30381]: cluster 2021-03-10T15:58:47.908710+0000 mgr.gibba020.yqfnwy (mgr.34427) 6643 : cluster [DBG] pgmap v3783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:48.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:48 gibba020 bash[25448]: cluster 2021-03-10T15:58:47.908710+0000 mgr.gibba020.yqfnwy (mgr.34427) 6643 : cluster [DBG] pgmap v3783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:49.346 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:58:49.572 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:58:49.572 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 9m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:58:49.572 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 8m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:58:49.573 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:58:49.573 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:58:49.573 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:58:49.573 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:58:49.573 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:58:49.574 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:58:49.574 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:58:49.574 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:58:49.574 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:58:49.575 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:58:49.575 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:58:49.575 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:58:49.575 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:58:49.576 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:58:49.576 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:58:49.576 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:58:49.576 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 8m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:58:49.577 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 8m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:58:49.819 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:58:49.820 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:58:49.820 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:58:49.820 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:58:49.820 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:58:49.820 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:58:49.821 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:58:49.821 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:58:49.821 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:58:49.821 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:58:49.821 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:58:49.822 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:58:49.822 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:58:49.822 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:58:49.822 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:58:50.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:49 gibba013 bash[29418]: audit 2021-03-10T15:58:49.819117+0000 mon.c (mon.1) 107 : audit [DBG] from='client.? 172.21.2.113:0/3102672520' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:50.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:49 gibba013 bash[30381]: audit 2021-03-10T15:58:49.819117+0000 mon.c (mon.1) 107 : audit [DBG] from='client.? 172.21.2.113:0/3102672520' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:50.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:49 gibba020 bash[25448]: audit 2021-03-10T15:58:49.819117+0000 mon.c (mon.1) 107 : audit [DBG] from='client.? 172.21.2.113:0/3102672520' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:51.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:50 gibba020 bash[25448]: audit 2021-03-10T15:58:49.335488+0000 mgr.gibba020.yqfnwy (mgr.34427) 6644 : audit [DBG] from='client.58501 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:58:51.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:50 gibba020 bash[25448]: audit 2021-03-10T15:58:49.558015+0000 mgr.gibba020.yqfnwy (mgr.34427) 6645 : audit [DBG] from='client.48522 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:58:51.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:50 gibba020 bash[25448]: cluster 2021-03-10T15:58:49.910490+0000 mgr.gibba020.yqfnwy (mgr.34427) 6646 : cluster [DBG] pgmap v3784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:51.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:50 gibba013 bash[29418]: audit 2021-03-10T15:58:49.335488+0000 mgr.gibba020.yqfnwy (mgr.34427) 6644 : audit [DBG] from='client.58501 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:58:51.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:50 gibba013 bash[29418]: audit 2021-03-10T15:58:49.558015+0000 mgr.gibba020.yqfnwy (mgr.34427) 6645 : audit [DBG] from='client.48522 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:58:51.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:50 gibba013 bash[29418]: cluster 2021-03-10T15:58:49.910490+0000 mgr.gibba020.yqfnwy (mgr.34427) 6646 : cluster [DBG] pgmap v3784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:51.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:50 gibba013 bash[30381]: audit 2021-03-10T15:58:49.335488+0000 mgr.gibba020.yqfnwy (mgr.34427) 6644 : audit [DBG] from='client.58501 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:58:51.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:50 gibba013 bash[30381]: audit 2021-03-10T15:58:49.558015+0000 mgr.gibba020.yqfnwy (mgr.34427) 6645 : audit [DBG] from='client.48522 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:58:51.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:50 gibba013 bash[30381]: cluster 2021-03-10T15:58:49.910490+0000 mgr.gibba020.yqfnwy (mgr.34427) 6646 : cluster [DBG] pgmap v3784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:52.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:52 gibba013 bash[29418]: cluster 2021-03-10T15:58:51.912078+0000 mgr.gibba020.yqfnwy (mgr.34427) 6647 : cluster [DBG] pgmap v3785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:52.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:52 gibba013 bash[30381]: cluster 2021-03-10T15:58:51.912078+0000 mgr.gibba020.yqfnwy (mgr.34427) 6647 : cluster [DBG] pgmap v3785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:52.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:52 gibba020 bash[25448]: cluster 2021-03-10T15:58:51.912078+0000 mgr.gibba020.yqfnwy (mgr.34427) 6647 : cluster [DBG] pgmap v3785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:54.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:54 gibba020 bash[25448]: cluster 2021-03-10T15:58:53.913650+0000 mgr.gibba020.yqfnwy (mgr.34427) 6648 : cluster [DBG] pgmap v3786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:54.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:54 gibba020 bash[25448]: audit 2021-03-10T15:58:53.950253+0000 mon.a (mon.0) 2560 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:58:54.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:54 gibba020 bash[25448]: cephadm 2021-03-10T15:58:53.954137+0000 mgr.gibba020.yqfnwy (mgr.34427) 6649 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:58:54.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:54 gibba020 bash[25448]: cephadm 2021-03-10T15:58:53.956074+0000 mgr.gibba020.yqfnwy (mgr.34427) 6650 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:58:54.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:54 gibba020 bash[25448]: audit 2021-03-10T15:58:54.154858+0000 mon.a (mon.0) 2561 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:58:54.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:54 gibba020 bash[25448]: audit 2021-03-10T15:58:54.158366+0000 mon.a (mon.0) 2562 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:58:54.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:54 gibba020 bash[25448]: audit 2021-03-10T15:58:54.160328+0000 mon.a (mon.0) 2563 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:54.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:54 gibba020 bash[25448]: audit 2021-03-10T15:58:54.162041+0000 mon.a (mon.0) 2564 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:54.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:54 gibba020 bash[25448]: audit 2021-03-10T15:58:54.163698+0000 mon.a (mon.0) 2565 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:54.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:54 gibba020 bash[25448]: audit 2021-03-10T15:58:54.167834+0000 mon.a (mon.0) 2566 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:54.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:54 gibba020 bash[25448]: audit 2021-03-10T15:58:54.169666+0000 mon.a (mon.0) 2567 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:54.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:54 gibba013 bash[29418]: cluster 2021-03-10T15:58:53.913650+0000 mgr.gibba020.yqfnwy (mgr.34427) 6648 : cluster [DBG] pgmap v3786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:54.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:54 gibba013 bash[29418]: audit 2021-03-10T15:58:53.950253+0000 mon.a (mon.0) 2560 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:58:54.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:54 gibba013 bash[29418]: cephadm 2021-03-10T15:58:53.954137+0000 mgr.gibba020.yqfnwy (mgr.34427) 6649 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:58:54.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:54 gibba013 bash[29418]: cephadm 2021-03-10T15:58:53.956074+0000 mgr.gibba020.yqfnwy (mgr.34427) 6650 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:58:54.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:54 gibba013 bash[29418]: audit 2021-03-10T15:58:54.154858+0000 mon.a (mon.0) 2561 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:58:54.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:54 gibba013 bash[29418]: audit 2021-03-10T15:58:54.158366+0000 mon.a (mon.0) 2562 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:58:54.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:54 gibba013 bash[29418]: audit 2021-03-10T15:58:54.160328+0000 mon.a (mon.0) 2563 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:54.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:54 gibba013 bash[29418]: audit 2021-03-10T15:58:54.162041+0000 mon.a (mon.0) 2564 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:54.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:54 gibba013 bash[29418]: audit 2021-03-10T15:58:54.163698+0000 mon.a (mon.0) 2565 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:54.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:54 gibba013 bash[29418]: audit 2021-03-10T15:58:54.167834+0000 mon.a (mon.0) 2566 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:54.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:54 gibba013 bash[29418]: audit 2021-03-10T15:58:54.169666+0000 mon.a (mon.0) 2567 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:54.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:54 gibba013 bash[30381]: cluster 2021-03-10T15:58:53.913650+0000 mgr.gibba020.yqfnwy (mgr.34427) 6648 : cluster [DBG] pgmap v3786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:54.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:54 gibba013 bash[30381]: audit 2021-03-10T15:58:53.950253+0000 mon.a (mon.0) 2560 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:58:54.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:54 gibba013 bash[30381]: cephadm 2021-03-10T15:58:53.954137+0000 mgr.gibba020.yqfnwy (mgr.34427) 6649 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:58:54.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:54 gibba013 bash[30381]: cephadm 2021-03-10T15:58:53.956074+0000 mgr.gibba020.yqfnwy (mgr.34427) 6650 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:58:54.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:54 gibba013 bash[30381]: audit 2021-03-10T15:58:54.154858+0000 mon.a (mon.0) 2561 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:58:54.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:54 gibba013 bash[30381]: audit 2021-03-10T15:58:54.158366+0000 mon.a (mon.0) 2562 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:58:54.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:54 gibba013 bash[30381]: audit 2021-03-10T15:58:54.160328+0000 mon.a (mon.0) 2563 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:54.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:54 gibba013 bash[30381]: audit 2021-03-10T15:58:54.162041+0000 mon.a (mon.0) 2564 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:54.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:54 gibba013 bash[30381]: audit 2021-03-10T15:58:54.163698+0000 mon.a (mon.0) 2565 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:54.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:54 gibba013 bash[30381]: audit 2021-03-10T15:58:54.167834+0000 mon.a (mon.0) 2566 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:54.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:54 gibba013 bash[30381]: audit 2021-03-10T15:58:54.169666+0000 mon.a (mon.0) 2567 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:58:55.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:55 gibba020 bash[25448]: cephadm 2021-03-10T15:58:54.155952+0000 mgr.gibba020.yqfnwy (mgr.34427) 6651 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:58:55.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:55 gibba020 bash[25448]: cephadm 2021-03-10T15:58:54.158356+0000 mgr.gibba020.yqfnwy (mgr.34427) 6652 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:58:55.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:55 gibba020 bash[25448]: cephadm 2021-03-10T15:58:54.160010+0000 mgr.gibba020.yqfnwy (mgr.34427) 6653 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:58:55.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:55 gibba020 bash[25448]: cephadm 2021-03-10T15:58:54.160070+0000 mgr.gibba020.yqfnwy (mgr.34427) 6654 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:58:55.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:55 gibba020 bash[25448]: cephadm 2021-03-10T15:58:54.161813+0000 mgr.gibba020.yqfnwy (mgr.34427) 6655 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:58:55.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:55 gibba020 bash[25448]: cephadm 2021-03-10T15:58:54.161849+0000 mgr.gibba020.yqfnwy (mgr.34427) 6656 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:58:55.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:55 gibba020 bash[25448]: cephadm 2021-03-10T15:58:54.163637+0000 mgr.gibba020.yqfnwy (mgr.34427) 6657 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:58:55.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:55 gibba020 bash[25448]: cephadm 2021-03-10T15:58:54.165636+0000 mgr.gibba020.yqfnwy (mgr.34427) 6658 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:58:55.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:55 gibba020 bash[25448]: cephadm 2021-03-10T15:58:54.165763+0000 mgr.gibba020.yqfnwy (mgr.34427) 6659 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:58:55.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:55 gibba020 bash[25448]: cephadm 2021-03-10T15:58:54.167441+0000 mgr.gibba020.yqfnwy (mgr.34427) 6660 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:58:55.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:55 gibba020 bash[25448]: cephadm 2021-03-10T15:58:54.167860+0000 mgr.gibba020.yqfnwy (mgr.34427) 6661 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:58:55.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:55 gibba020 bash[25448]: cephadm 2021-03-10T15:58:54.169027+0000 mgr.gibba020.yqfnwy (mgr.34427) 6662 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:58:55.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:55 gibba020 bash[25448]: cephadm 2021-03-10T15:58:54.169062+0000 mgr.gibba020.yqfnwy (mgr.34427) 6663 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:58:55.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:55 gibba020 bash[25448]: cephadm 2021-03-10T15:58:54.169192+0000 mgr.gibba020.yqfnwy (mgr.34427) 6664 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:58:55.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:55 gibba013 bash[29418]: cephadm 2021-03-10T15:58:54.155952+0000 mgr.gibba020.yqfnwy (mgr.34427) 6651 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:58:55.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:55 gibba013 bash[29418]: cephadm 2021-03-10T15:58:54.158356+0000 mgr.gibba020.yqfnwy (mgr.34427) 6652 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:58:55.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:55 gibba013 bash[29418]: cephadm 2021-03-10T15:58:54.160010+0000 mgr.gibba020.yqfnwy (mgr.34427) 6653 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:58:55.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:55 gibba013 bash[29418]: cephadm 2021-03-10T15:58:54.160070+0000 mgr.gibba020.yqfnwy (mgr.34427) 6654 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:58:55.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:55 gibba013 bash[29418]: cephadm 2021-03-10T15:58:54.161813+0000 mgr.gibba020.yqfnwy (mgr.34427) 6655 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:58:55.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:55 gibba013 bash[29418]: cephadm 2021-03-10T15:58:54.161849+0000 mgr.gibba020.yqfnwy (mgr.34427) 6656 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:58:55.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:55 gibba013 bash[29418]: cephadm 2021-03-10T15:58:54.163637+0000 mgr.gibba020.yqfnwy (mgr.34427) 6657 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:58:55.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:55 gibba013 bash[29418]: cephadm 2021-03-10T15:58:54.165636+0000 mgr.gibba020.yqfnwy (mgr.34427) 6658 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:58:55.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:55 gibba013 bash[29418]: cephadm 2021-03-10T15:58:54.165763+0000 mgr.gibba020.yqfnwy (mgr.34427) 6659 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:58:55.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:55 gibba013 bash[29418]: cephadm 2021-03-10T15:58:54.167441+0000 mgr.gibba020.yqfnwy (mgr.34427) 6660 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:58:55.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:55 gibba013 bash[29418]: cephadm 2021-03-10T15:58:54.167860+0000 mgr.gibba020.yqfnwy (mgr.34427) 6661 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:58:55.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:55 gibba013 bash[29418]: cephadm 2021-03-10T15:58:54.169027+0000 mgr.gibba020.yqfnwy (mgr.34427) 6662 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:58:55.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:55 gibba013 bash[29418]: cephadm 2021-03-10T15:58:54.169062+0000 mgr.gibba020.yqfnwy (mgr.34427) 6663 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:58:55.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:55 gibba013 bash[29418]: cephadm 2021-03-10T15:58:54.169192+0000 mgr.gibba020.yqfnwy (mgr.34427) 6664 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:58:55.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:55 gibba013 bash[30381]: cephadm 2021-03-10T15:58:54.155952+0000 mgr.gibba020.yqfnwy (mgr.34427) 6651 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:58:55.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:55 gibba013 bash[30381]: cephadm 2021-03-10T15:58:54.158356+0000 mgr.gibba020.yqfnwy (mgr.34427) 6652 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:58:55.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:55 gibba013 bash[30381]: cephadm 2021-03-10T15:58:54.160010+0000 mgr.gibba020.yqfnwy (mgr.34427) 6653 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:58:55.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:55 gibba013 bash[30381]: cephadm 2021-03-10T15:58:54.160070+0000 mgr.gibba020.yqfnwy (mgr.34427) 6654 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:58:55.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:55 gibba013 bash[30381]: cephadm 2021-03-10T15:58:54.161813+0000 mgr.gibba020.yqfnwy (mgr.34427) 6655 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:58:55.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:55 gibba013 bash[30381]: cephadm 2021-03-10T15:58:54.161849+0000 mgr.gibba020.yqfnwy (mgr.34427) 6656 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:58:55.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:55 gibba013 bash[30381]: cephadm 2021-03-10T15:58:54.163637+0000 mgr.gibba020.yqfnwy (mgr.34427) 6657 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:58:55.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:55 gibba013 bash[30381]: cephadm 2021-03-10T15:58:54.165636+0000 mgr.gibba020.yqfnwy (mgr.34427) 6658 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:58:55.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:55 gibba013 bash[30381]: cephadm 2021-03-10T15:58:54.165763+0000 mgr.gibba020.yqfnwy (mgr.34427) 6659 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:58:55.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:55 gibba013 bash[30381]: cephadm 2021-03-10T15:58:54.167441+0000 mgr.gibba020.yqfnwy (mgr.34427) 6660 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:58:55.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:55 gibba013 bash[30381]: cephadm 2021-03-10T15:58:54.167860+0000 mgr.gibba020.yqfnwy (mgr.34427) 6661 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:58:55.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:55 gibba013 bash[30381]: cephadm 2021-03-10T15:58:54.169027+0000 mgr.gibba020.yqfnwy (mgr.34427) 6662 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:58:55.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:55 gibba013 bash[30381]: cephadm 2021-03-10T15:58:54.169062+0000 mgr.gibba020.yqfnwy (mgr.34427) 6663 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:58:55.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:55 gibba013 bash[30381]: cephadm 2021-03-10T15:58:54.169192+0000 mgr.gibba020.yqfnwy (mgr.34427) 6664 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:58:56.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:56 gibba020 bash[25448]: cluster 2021-03-10T15:58:55.915438+0000 mgr.gibba020.yqfnwy (mgr.34427) 6665 : cluster [DBG] pgmap v3787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:56.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:56 gibba013 bash[29418]: cluster 2021-03-10T15:58:55.915438+0000 mgr.gibba020.yqfnwy (mgr.34427) 6665 : cluster [DBG] pgmap v3787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:56.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:56 gibba013 bash[30381]: cluster 2021-03-10T15:58:55.915438+0000 mgr.gibba020.yqfnwy (mgr.34427) 6665 : cluster [DBG] pgmap v3787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:58.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:58:58 gibba013 bash[29418]: cluster 2021-03-10T15:58:57.916897+0000 mgr.gibba020.yqfnwy (mgr.34427) 6666 : cluster [DBG] pgmap v3788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:58.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:58:58 gibba013 bash[30381]: cluster 2021-03-10T15:58:57.916897+0000 mgr.gibba020.yqfnwy (mgr.34427) 6666 : cluster [DBG] pgmap v3788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:58:58.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:58:58 gibba020 bash[25448]: cluster 2021-03-10T15:58:57.916897+0000 mgr.gibba020.yqfnwy (mgr.34427) 6666 : cluster [DBG] pgmap v3788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:00.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:00 gibba013 bash[29418]: cluster 2021-03-10T15:58:59.918751+0000 mgr.gibba020.yqfnwy (mgr.34427) 6667 : cluster [DBG] pgmap v3789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:00.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:00 gibba013 bash[30381]: cluster 2021-03-10T15:58:59.918751+0000 mgr.gibba020.yqfnwy (mgr.34427) 6667 : cluster [DBG] pgmap v3789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:00.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:00 gibba020 bash[25448]: cluster 2021-03-10T15:58:59.918751+0000 mgr.gibba020.yqfnwy (mgr.34427) 6667 : cluster [DBG] pgmap v3789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:02.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:02 gibba013 bash[29418]: cluster 2021-03-10T15:59:01.920306+0000 mgr.gibba020.yqfnwy (mgr.34427) 6668 : cluster [DBG] pgmap v3790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:02.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:02 gibba013 bash[30381]: cluster 2021-03-10T15:59:01.920306+0000 mgr.gibba020.yqfnwy (mgr.34427) 6668 : cluster [DBG] pgmap v3790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:02.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:02 gibba020 bash[25448]: cluster 2021-03-10T15:59:01.920306+0000 mgr.gibba020.yqfnwy (mgr.34427) 6668 : cluster [DBG] pgmap v3790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:04.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:04 gibba020 bash[25448]: cluster 2021-03-10T15:59:03.921993+0000 mgr.gibba020.yqfnwy (mgr.34427) 6669 : cluster [DBG] pgmap v3791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:04.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:04 gibba013 bash[29418]: cluster 2021-03-10T15:59:03.921993+0000 mgr.gibba020.yqfnwy (mgr.34427) 6669 : cluster [DBG] pgmap v3791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:04.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:04 gibba013 bash[30381]: cluster 2021-03-10T15:59:03.921993+0000 mgr.gibba020.yqfnwy (mgr.34427) 6669 : cluster [DBG] pgmap v3791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:06.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:06 gibba013 bash[29418]: cluster 2021-03-10T15:59:05.923598+0000 mgr.gibba020.yqfnwy (mgr.34427) 6670 : cluster [DBG] pgmap v3792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:06.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:06 gibba013 bash[30381]: cluster 2021-03-10T15:59:05.923598+0000 mgr.gibba020.yqfnwy (mgr.34427) 6670 : cluster [DBG] pgmap v3792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:06.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:06 gibba020 bash[25448]: cluster 2021-03-10T15:59:05.923598+0000 mgr.gibba020.yqfnwy (mgr.34427) 6670 : cluster [DBG] pgmap v3792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:07.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:07 gibba013 bash[29418]: audit 2021-03-10T15:59:06.607102+0000 mon.a (mon.0) 2568 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:59:07.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:07 gibba013 bash[29418]: audit 2021-03-10T15:59:06.681314+0000 mon.a (mon.0) 2569 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:59:07.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:07 gibba013 bash[29418]: audit 2021-03-10T15:59:06.856895+0000 mon.a (mon.0) 2570 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T15:59:07.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:07 gibba013 bash[29418]: audit 2021-03-10T15:59:06.857645+0000 mon.a (mon.0) 2571 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:59:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:07 gibba013 bash[29418]: audit 2021-03-10T15:59:06.858455+0000 mon.a (mon.0) 2572 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:59:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:07 gibba013 bash[29418]: audit 2021-03-10T15:59:06.859172+0000 mon.a (mon.0) 2573 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:59:07.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:07 gibba013 bash[30381]: audit 2021-03-10T15:59:06.607102+0000 mon.a (mon.0) 2568 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:59:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:07 gibba013 bash[30381]: audit 2021-03-10T15:59:06.681314+0000 mon.a (mon.0) 2569 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:59:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:07 gibba013 bash[30381]: audit 2021-03-10T15:59:06.856895+0000 mon.a (mon.0) 2570 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T15:59:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:07 gibba013 bash[30381]: audit 2021-03-10T15:59:06.857645+0000 mon.a (mon.0) 2571 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:59:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:07 gibba013 bash[30381]: audit 2021-03-10T15:59:06.858455+0000 mon.a (mon.0) 2572 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:59:07.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:07 gibba013 bash[30381]: audit 2021-03-10T15:59:06.859172+0000 mon.a (mon.0) 2573 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:59:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:07 gibba020 bash[25448]: audit 2021-03-10T15:59:06.607102+0000 mon.a (mon.0) 2568 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T15:59:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:07 gibba020 bash[25448]: audit 2021-03-10T15:59:06.681314+0000 mon.a (mon.0) 2569 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T15:59:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:07 gibba020 bash[25448]: audit 2021-03-10T15:59:06.856895+0000 mon.a (mon.0) 2570 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T15:59:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:07 gibba020 bash[25448]: audit 2021-03-10T15:59:06.857645+0000 mon.a (mon.0) 2571 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T15:59:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:07 gibba020 bash[25448]: audit 2021-03-10T15:59:06.858455+0000 mon.a (mon.0) 2572 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T15:59:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:07 gibba020 bash[25448]: audit 2021-03-10T15:59:06.859172+0000 mon.a (mon.0) 2573 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T15:59:08.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:08 gibba013 bash[29418]: cluster 2021-03-10T15:59:07.925081+0000 mgr.gibba020.yqfnwy (mgr.34427) 6671 : cluster [DBG] pgmap v3793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:08.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:08 gibba013 bash[30381]: cluster 2021-03-10T15:59:07.925081+0000 mgr.gibba020.yqfnwy (mgr.34427) 6671 : cluster [DBG] pgmap v3793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:08.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:08 gibba020 bash[25448]: cluster 2021-03-10T15:59:07.925081+0000 mgr.gibba020.yqfnwy (mgr.34427) 6671 : cluster [DBG] pgmap v3793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:10.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:10 gibba013 bash[29418]: cephadm 2021-03-10T15:59:09.171872+0000 mgr.gibba020.yqfnwy (mgr.34427) 6672 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:59:10.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:10 gibba013 bash[29418]: cluster 2021-03-10T15:59:09.926893+0000 mgr.gibba020.yqfnwy (mgr.34427) 6673 : cluster [DBG] pgmap v3794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:10.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:10 gibba013 bash[30381]: cephadm 2021-03-10T15:59:09.171872+0000 mgr.gibba020.yqfnwy (mgr.34427) 6672 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:59:10.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:10 gibba013 bash[30381]: cluster 2021-03-10T15:59:09.926893+0000 mgr.gibba020.yqfnwy (mgr.34427) 6673 : cluster [DBG] pgmap v3794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:10.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:10 gibba020 bash[25448]: cephadm 2021-03-10T15:59:09.171872+0000 mgr.gibba020.yqfnwy (mgr.34427) 6672 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:59:10.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:10 gibba020 bash[25448]: cluster 2021-03-10T15:59:09.926893+0000 mgr.gibba020.yqfnwy (mgr.34427) 6673 : cluster [DBG] pgmap v3794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:12.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:12 gibba013 bash[29418]: cluster 2021-03-10T15:59:11.928487+0000 mgr.gibba020.yqfnwy (mgr.34427) 6674 : cluster [DBG] pgmap v3795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:12.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:12 gibba013 bash[30381]: cluster 2021-03-10T15:59:11.928487+0000 mgr.gibba020.yqfnwy (mgr.34427) 6674 : cluster [DBG] pgmap v3795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:12.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:12 gibba020 bash[25448]: cluster 2021-03-10T15:59:11.928487+0000 mgr.gibba020.yqfnwy (mgr.34427) 6674 : cluster [DBG] pgmap v3795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:14.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:14 gibba020 bash[25448]: cluster 2021-03-10T15:59:13.929819+0000 mgr.gibba020.yqfnwy (mgr.34427) 6675 : cluster [DBG] pgmap v3796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:14.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:14 gibba013 bash[29418]: cluster 2021-03-10T15:59:13.929819+0000 mgr.gibba020.yqfnwy (mgr.34427) 6675 : cluster [DBG] pgmap v3796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:14.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:14 gibba013 bash[30381]: cluster 2021-03-10T15:59:13.929819+0000 mgr.gibba020.yqfnwy (mgr.34427) 6675 : cluster [DBG] pgmap v3796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:16.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:16 gibba013 bash[29418]: cluster 2021-03-10T15:59:15.931488+0000 mgr.gibba020.yqfnwy (mgr.34427) 6676 : cluster [DBG] pgmap v3797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:16.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:16 gibba013 bash[30381]: cluster 2021-03-10T15:59:15.931488+0000 mgr.gibba020.yqfnwy (mgr.34427) 6676 : cluster [DBG] pgmap v3797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:16.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:16 gibba020 bash[25448]: cluster 2021-03-10T15:59:15.931488+0000 mgr.gibba020.yqfnwy (mgr.34427) 6676 : cluster [DBG] pgmap v3797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:18.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:18 gibba013 bash[29418]: cluster 2021-03-10T15:59:17.933081+0000 mgr.gibba020.yqfnwy (mgr.34427) 6677 : cluster [DBG] pgmap v3798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:18.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:18 gibba013 bash[30381]: cluster 2021-03-10T15:59:17.933081+0000 mgr.gibba020.yqfnwy (mgr.34427) 6677 : cluster [DBG] pgmap v3798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:18.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:18 gibba020 bash[25448]: cluster 2021-03-10T15:59:17.933081+0000 mgr.gibba020.yqfnwy (mgr.34427) 6677 : cluster [DBG] pgmap v3798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:20.062 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:59:20.287 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:59:20.287 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 9m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:59:20.288 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 8m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:59:20.288 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:59:20.288 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:59:20.288 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:59:20.288 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:59:20.289 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:59:20.289 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:59:20.289 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:59:20.289 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:59:20.290 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:59:20.290 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:59:20.290 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:59:20.290 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:59:20.291 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:59:20.291 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:59:20.291 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:59:20.291 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:59:20.291 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 8m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:59:20.292 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 8m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:59:20.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:20 gibba013 bash[29418]: cluster 2021-03-10T15:59:19.934783+0000 mgr.gibba020.yqfnwy (mgr.34427) 6678 : cluster [DBG] pgmap v3799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:20.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:20 gibba013 bash[30381]: cluster 2021-03-10T15:59:19.934783+0000 mgr.gibba020.yqfnwy (mgr.34427) 6678 : cluster [DBG] pgmap v3799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:20.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:20 gibba020 bash[25448]: cluster 2021-03-10T15:59:19.934783+0000 mgr.gibba020.yqfnwy (mgr.34427) 6678 : cluster [DBG] pgmap v3799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:20.535 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:59:20.536 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:59:20.536 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:59:20.536 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:59:20.537 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:59:20.537 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:59:20.537 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:59:20.537 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:59:20.538 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:59:20.538 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:59:20.538 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:59:20.538 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:59:20.539 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:59:20.539 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:59:20.539 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:59:21.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:21 gibba013 bash[29418]: audit 2021-03-10T15:59:20.051641+0000 mgr.gibba020.yqfnwy (mgr.34427) 6679 : audit [DBG] from='client.48534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:59:21.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:21 gibba013 bash[29418]: audit 2021-03-10T15:59:20.273611+0000 mgr.gibba020.yqfnwy (mgr.34427) 6680 : audit [DBG] from='client.58525 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:59:21.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:21 gibba013 bash[29418]: audit 2021-03-10T15:59:20.535402+0000 mon.c (mon.1) 108 : audit [DBG] from='client.? 172.21.2.113:0/4147739731' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:21.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:21 gibba013 bash[30381]: audit 2021-03-10T15:59:20.051641+0000 mgr.gibba020.yqfnwy (mgr.34427) 6679 : audit [DBG] from='client.48534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:59:21.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:21 gibba013 bash[30381]: audit 2021-03-10T15:59:20.273611+0000 mgr.gibba020.yqfnwy (mgr.34427) 6680 : audit [DBG] from='client.58525 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:59:21.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:21 gibba013 bash[30381]: audit 2021-03-10T15:59:20.535402+0000 mon.c (mon.1) 108 : audit [DBG] from='client.? 172.21.2.113:0/4147739731' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:21.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:21 gibba020 bash[25448]: audit 2021-03-10T15:59:20.051641+0000 mgr.gibba020.yqfnwy (mgr.34427) 6679 : audit [DBG] from='client.48534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:59:21.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:21 gibba020 bash[25448]: audit 2021-03-10T15:59:20.273611+0000 mgr.gibba020.yqfnwy (mgr.34427) 6680 : audit [DBG] from='client.58525 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:59:21.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:21 gibba020 bash[25448]: audit 2021-03-10T15:59:20.535402+0000 mon.c (mon.1) 108 : audit [DBG] from='client.? 172.21.2.113:0/4147739731' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:22.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:22 gibba013 bash[29418]: cluster 2021-03-10T15:59:21.936235+0000 mgr.gibba020.yqfnwy (mgr.34427) 6681 : cluster [DBG] pgmap v3800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:22.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:22 gibba013 bash[30381]: cluster 2021-03-10T15:59:21.936235+0000 mgr.gibba020.yqfnwy (mgr.34427) 6681 : cluster [DBG] pgmap v3800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:22.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:22 gibba020 bash[25448]: cluster 2021-03-10T15:59:21.936235+0000 mgr.gibba020.yqfnwy (mgr.34427) 6681 : cluster [DBG] pgmap v3800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:24.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:24 gibba020 bash[25448]: cluster 2021-03-10T15:59:23.937886+0000 mgr.gibba020.yqfnwy (mgr.34427) 6682 : cluster [DBG] pgmap v3801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:24.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:24 gibba013 bash[29418]: cluster 2021-03-10T15:59:23.937886+0000 mgr.gibba020.yqfnwy (mgr.34427) 6682 : cluster [DBG] pgmap v3801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:24.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:24 gibba013 bash[30381]: cluster 2021-03-10T15:59:23.937886+0000 mgr.gibba020.yqfnwy (mgr.34427) 6682 : cluster [DBG] pgmap v3801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:25.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:25 gibba020 bash[25448]: cephadm 2021-03-10T15:59:24.187804+0000 mgr.gibba020.yqfnwy (mgr.34427) 6683 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:59:25.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:25 gibba013 bash[29418]: cephadm 2021-03-10T15:59:24.187804+0000 mgr.gibba020.yqfnwy (mgr.34427) 6683 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:59:25.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:25 gibba013 bash[30381]: cephadm 2021-03-10T15:59:24.187804+0000 mgr.gibba020.yqfnwy (mgr.34427) 6683 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:59:26.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:26 gibba020 bash[25448]: cluster 2021-03-10T15:59:25.939515+0000 mgr.gibba020.yqfnwy (mgr.34427) 6684 : cluster [DBG] pgmap v3802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:26.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:26 gibba013 bash[29418]: cluster 2021-03-10T15:59:25.939515+0000 mgr.gibba020.yqfnwy (mgr.34427) 6684 : cluster [DBG] pgmap v3802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:26.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:26 gibba013 bash[30381]: cluster 2021-03-10T15:59:25.939515+0000 mgr.gibba020.yqfnwy (mgr.34427) 6684 : cluster [DBG] pgmap v3802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:28.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:28 gibba013 bash[29418]: cluster 2021-03-10T15:59:27.941092+0000 mgr.gibba020.yqfnwy (mgr.34427) 6685 : cluster [DBG] pgmap v3803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:28.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:28 gibba013 bash[30381]: cluster 2021-03-10T15:59:27.941092+0000 mgr.gibba020.yqfnwy (mgr.34427) 6685 : cluster [DBG] pgmap v3803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:28.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:28 gibba020 bash[25448]: cluster 2021-03-10T15:59:27.941092+0000 mgr.gibba020.yqfnwy (mgr.34427) 6685 : cluster [DBG] pgmap v3803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:30.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:30 gibba013 bash[29418]: cluster 2021-03-10T15:59:29.942870+0000 mgr.gibba020.yqfnwy (mgr.34427) 6686 : cluster [DBG] pgmap v3804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:30.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:30 gibba013 bash[30381]: cluster 2021-03-10T15:59:29.942870+0000 mgr.gibba020.yqfnwy (mgr.34427) 6686 : cluster [DBG] pgmap v3804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:30.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:30 gibba020 bash[25448]: cluster 2021-03-10T15:59:29.942870+0000 mgr.gibba020.yqfnwy (mgr.34427) 6686 : cluster [DBG] pgmap v3804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:32.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:32 gibba013 bash[29418]: cluster 2021-03-10T15:59:31.944332+0000 mgr.gibba020.yqfnwy (mgr.34427) 6687 : cluster [DBG] pgmap v3805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:32.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:32 gibba013 bash[30381]: cluster 2021-03-10T15:59:31.944332+0000 mgr.gibba020.yqfnwy (mgr.34427) 6687 : cluster [DBG] pgmap v3805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:32.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:32 gibba020 bash[25448]: cluster 2021-03-10T15:59:31.944332+0000 mgr.gibba020.yqfnwy (mgr.34427) 6687 : cluster [DBG] pgmap v3805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:34.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:34 gibba020 bash[25448]: cluster 2021-03-10T15:59:33.945681+0000 mgr.gibba020.yqfnwy (mgr.34427) 6688 : cluster [DBG] pgmap v3806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:34.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:34 gibba013 bash[29418]: cluster 2021-03-10T15:59:33.945681+0000 mgr.gibba020.yqfnwy (mgr.34427) 6688 : cluster [DBG] pgmap v3806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:34.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:34 gibba013 bash[30381]: cluster 2021-03-10T15:59:33.945681+0000 mgr.gibba020.yqfnwy (mgr.34427) 6688 : cluster [DBG] pgmap v3806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:36.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:36 gibba013 bash[29418]: cluster 2021-03-10T15:59:35.947360+0000 mgr.gibba020.yqfnwy (mgr.34427) 6689 : cluster [DBG] pgmap v3807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:36.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:36 gibba013 bash[30381]: cluster 2021-03-10T15:59:35.947360+0000 mgr.gibba020.yqfnwy (mgr.34427) 6689 : cluster [DBG] pgmap v3807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:36.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:36 gibba020 bash[25448]: cluster 2021-03-10T15:59:35.947360+0000 mgr.gibba020.yqfnwy (mgr.34427) 6689 : cluster [DBG] pgmap v3807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:38.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:38 gibba013 bash[29418]: cluster 2021-03-10T15:59:37.948850+0000 mgr.gibba020.yqfnwy (mgr.34427) 6690 : cluster [DBG] pgmap v3808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:38.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:38 gibba013 bash[30381]: cluster 2021-03-10T15:59:37.948850+0000 mgr.gibba020.yqfnwy (mgr.34427) 6690 : cluster [DBG] pgmap v3808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:38.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:38 gibba020 bash[25448]: cluster 2021-03-10T15:59:37.948850+0000 mgr.gibba020.yqfnwy (mgr.34427) 6690 : cluster [DBG] pgmap v3808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:40.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:40 gibba013 bash[29418]: cephadm 2021-03-10T15:59:39.194947+0000 mgr.gibba020.yqfnwy (mgr.34427) 6691 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:59:40.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:40 gibba013 bash[29418]: cluster 2021-03-10T15:59:39.950718+0000 mgr.gibba020.yqfnwy (mgr.34427) 6692 : cluster [DBG] pgmap v3809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:40.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:40 gibba013 bash[30381]: cephadm 2021-03-10T15:59:39.194947+0000 mgr.gibba020.yqfnwy (mgr.34427) 6691 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:59:40.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:40 gibba013 bash[30381]: cluster 2021-03-10T15:59:39.950718+0000 mgr.gibba020.yqfnwy (mgr.34427) 6692 : cluster [DBG] pgmap v3809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:40.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:40 gibba020 bash[25448]: cephadm 2021-03-10T15:59:39.194947+0000 mgr.gibba020.yqfnwy (mgr.34427) 6691 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:59:40.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:40 gibba020 bash[25448]: cluster 2021-03-10T15:59:39.950718+0000 mgr.gibba020.yqfnwy (mgr.34427) 6692 : cluster [DBG] pgmap v3809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:42.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:42 gibba013 bash[29418]: cluster 2021-03-10T15:59:41.952327+0000 mgr.gibba020.yqfnwy (mgr.34427) 6693 : cluster [DBG] pgmap v3810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:42.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:42 gibba013 bash[30381]: cluster 2021-03-10T15:59:41.952327+0000 mgr.gibba020.yqfnwy (mgr.34427) 6693 : cluster [DBG] pgmap v3810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:42.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:42 gibba020 bash[25448]: cluster 2021-03-10T15:59:41.952327+0000 mgr.gibba020.yqfnwy (mgr.34427) 6693 : cluster [DBG] pgmap v3810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:44.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:44 gibba020 bash[25448]: cluster 2021-03-10T15:59:43.954018+0000 mgr.gibba020.yqfnwy (mgr.34427) 6694 : cluster [DBG] pgmap v3811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:44.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:44 gibba013 bash[29418]: cluster 2021-03-10T15:59:43.954018+0000 mgr.gibba020.yqfnwy (mgr.34427) 6694 : cluster [DBG] pgmap v3811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:44.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:44 gibba013 bash[30381]: cluster 2021-03-10T15:59:43.954018+0000 mgr.gibba020.yqfnwy (mgr.34427) 6694 : cluster [DBG] pgmap v3811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:46.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:46 gibba013 bash[29418]: cluster 2021-03-10T15:59:45.955616+0000 mgr.gibba020.yqfnwy (mgr.34427) 6695 : cluster [DBG] pgmap v3812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:46.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:46 gibba013 bash[30381]: cluster 2021-03-10T15:59:45.955616+0000 mgr.gibba020.yqfnwy (mgr.34427) 6695 : cluster [DBG] pgmap v3812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:46.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:46 gibba020 bash[25448]: cluster 2021-03-10T15:59:45.955616+0000 mgr.gibba020.yqfnwy (mgr.34427) 6695 : cluster [DBG] pgmap v3812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:48.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:48 gibba013 bash[29418]: cluster 2021-03-10T15:59:47.957155+0000 mgr.gibba020.yqfnwy (mgr.34427) 6696 : cluster [DBG] pgmap v3813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:48.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:48 gibba013 bash[30381]: cluster 2021-03-10T15:59:47.957155+0000 mgr.gibba020.yqfnwy (mgr.34427) 6696 : cluster [DBG] pgmap v3813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:48.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:48 gibba020 bash[25448]: cluster 2021-03-10T15:59:47.957155+0000 mgr.gibba020.yqfnwy (mgr.34427) 6696 : cluster [DBG] pgmap v3813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:50.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:50 gibba013 bash[29418]: cluster 2021-03-10T15:59:49.959005+0000 mgr.gibba020.yqfnwy (mgr.34427) 6697 : cluster [DBG] pgmap v3814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:50.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:50 gibba013 bash[30381]: cluster 2021-03-10T15:59:49.959005+0000 mgr.gibba020.yqfnwy (mgr.34427) 6697 : cluster [DBG] pgmap v3814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:50.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:50 gibba020 bash[25448]: cluster 2021-03-10T15:59:49.959005+0000 mgr.gibba020.yqfnwy (mgr.34427) 6697 : cluster [DBG] pgmap v3814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:50.779 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T15:59:51.011 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T15:59:51.012 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 10m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T15:59:51.012 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 9m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T15:59:51.012 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T15:59:51.012 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T15:59:51.013 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T15:59:51.013 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T15:59:51.013 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T15:59:51.013 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T15:59:51.014 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 10m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T15:59:51.014 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T15:59:51.014 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T15:59:51.014 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T15:59:51.014 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T15:59:51.015 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T15:59:51.015 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T15:59:51.015 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T15:59:51.015 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T15:59:51.016 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T15:59:51.016 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 9m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T15:59:51.016 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 9m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T15:59:51.261 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T15:59:51.262 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T15:59:51.262 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:59:51.262 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:59:51.263 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T15:59:51.263 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T15:59:51.263 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:59:51.263 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T15:59:51.263 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T15:59:51.264 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T15:59:51.264 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T15:59:51.264 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T15:59:51.264 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T15:59:51.265 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T15:59:51.265 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T15:59:51.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:51 gibba013 bash[29418]: audit 2021-03-10T15:59:50.768985+0000 mgr.gibba020.yqfnwy (mgr.34427) 6698 : audit [DBG] from='client.48552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:59:51.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:51 gibba013 bash[30381]: audit 2021-03-10T15:59:50.768985+0000 mgr.gibba020.yqfnwy (mgr.34427) 6698 : audit [DBG] from='client.48552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:59:51.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:51 gibba020 bash[25448]: audit 2021-03-10T15:59:50.768985+0000 mgr.gibba020.yqfnwy (mgr.34427) 6698 : audit [DBG] from='client.48552 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:59:52.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:52 gibba013 bash[29418]: audit 2021-03-10T15:59:50.997617+0000 mgr.gibba020.yqfnwy (mgr.34427) 6699 : audit [DBG] from='client.58543 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:59:52.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:52 gibba013 bash[29418]: audit 2021-03-10T15:59:51.261586+0000 mon.c (mon.1) 109 : audit [DBG] from='client.? 172.21.2.113:0/2523837502' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:52.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:52 gibba013 bash[29418]: cluster 2021-03-10T15:59:51.960636+0000 mgr.gibba020.yqfnwy (mgr.34427) 6700 : cluster [DBG] pgmap v3815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:52.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:52 gibba013 bash[30381]: audit 2021-03-10T15:59:50.997617+0000 mgr.gibba020.yqfnwy (mgr.34427) 6699 : audit [DBG] from='client.58543 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:59:52.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:52 gibba013 bash[30381]: audit 2021-03-10T15:59:51.261586+0000 mon.c (mon.1) 109 : audit [DBG] from='client.? 172.21.2.113:0/2523837502' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:52.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:52 gibba013 bash[30381]: cluster 2021-03-10T15:59:51.960636+0000 mgr.gibba020.yqfnwy (mgr.34427) 6700 : cluster [DBG] pgmap v3815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:52.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:52 gibba020 bash[25448]: audit 2021-03-10T15:59:50.997617+0000 mgr.gibba020.yqfnwy (mgr.34427) 6699 : audit [DBG] from='client.58543 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T15:59:52.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:52 gibba020 bash[25448]: audit 2021-03-10T15:59:51.261586+0000 mon.c (mon.1) 109 : audit [DBG] from='client.? 172.21.2.113:0/2523837502' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:52.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:52 gibba020 bash[25448]: cluster 2021-03-10T15:59:51.960636+0000 mgr.gibba020.yqfnwy (mgr.34427) 6700 : cluster [DBG] pgmap v3815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:54.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:54 gibba020 bash[25448]: cluster 2021-03-10T15:59:53.962044+0000 mgr.gibba020.yqfnwy (mgr.34427) 6701 : cluster [DBG] pgmap v3816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:54.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:54 gibba020 bash[25448]: audit 2021-03-10T15:59:54.213275+0000 mon.a (mon.0) 2574 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:59:54.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:54 gibba020 bash[25448]: audit 2021-03-10T15:59:54.220297+0000 mon.a (mon.0) 2575 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:59:54.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:54 gibba013 bash[29418]: cluster 2021-03-10T15:59:53.962044+0000 mgr.gibba020.yqfnwy (mgr.34427) 6701 : cluster [DBG] pgmap v3816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:54.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:54 gibba013 bash[29418]: audit 2021-03-10T15:59:54.213275+0000 mon.a (mon.0) 2574 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:59:54.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:54 gibba013 bash[29418]: audit 2021-03-10T15:59:54.220297+0000 mon.a (mon.0) 2575 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:59:54.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:54 gibba013 bash[30381]: cluster 2021-03-10T15:59:53.962044+0000 mgr.gibba020.yqfnwy (mgr.34427) 6701 : cluster [DBG] pgmap v3816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:54.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:54 gibba013 bash[30381]: audit 2021-03-10T15:59:54.213275+0000 mon.a (mon.0) 2574 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:59:54.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:54 gibba013 bash[30381]: audit 2021-03-10T15:59:54.220297+0000 mon.a (mon.0) 2575 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T15:59:55.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:55 gibba020 bash[25448]: cephadm 2021-03-10T15:59:54.218237+0000 mgr.gibba020.yqfnwy (mgr.34427) 6702 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:59:55.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:55 gibba013 bash[29418]: cephadm 2021-03-10T15:59:54.218237+0000 mgr.gibba020.yqfnwy (mgr.34427) 6702 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:59:55.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:55 gibba013 bash[30381]: cephadm 2021-03-10T15:59:54.218237+0000 mgr.gibba020.yqfnwy (mgr.34427) 6702 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T15:59:56.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:56 gibba020 bash[25448]: cluster 2021-03-10T15:59:55.963646+0000 mgr.gibba020.yqfnwy (mgr.34427) 6703 : cluster [DBG] pgmap v3817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:56.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:56 gibba013 bash[29418]: cluster 2021-03-10T15:59:55.963646+0000 mgr.gibba020.yqfnwy (mgr.34427) 6703 : cluster [DBG] pgmap v3817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:56.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:56 gibba013 bash[30381]: cluster 2021-03-10T15:59:55.963646+0000 mgr.gibba020.yqfnwy (mgr.34427) 6703 : cluster [DBG] pgmap v3817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:59.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[29418]: cephadm 2021-03-10T15:59:57.708689+0000 mgr.gibba020.yqfnwy (mgr.34427) 6704 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:59:59.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[29418]: audit 2021-03-10T15:59:57.709462+0000 mon.a (mon.0) 2576 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:59:59.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[29418]: audit 2021-03-10T15:59:57.963135+0000 mon.a (mon.0) 2577 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:59:59.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[29418]: cluster 2021-03-10T15:59:57.964905+0000 mgr.gibba020.yqfnwy (mgr.34427) 6705 : cluster [DBG] pgmap v3818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:59.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[29418]: cephadm 2021-03-10T15:59:57.969658+0000 mgr.gibba020.yqfnwy (mgr.34427) 6706 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:59:59.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[29418]: cephadm 2021-03-10T15:59:57.971131+0000 mgr.gibba020.yqfnwy (mgr.34427) 6707 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:59:59.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[29418]: audit 2021-03-10T15:59:57.971712+0000 mon.a (mon.0) 2578 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:59:59.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[29418]: cephadm 2021-03-10T15:59:57.972181+0000 mgr.gibba020.yqfnwy (mgr.34427) 6708 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:59:59.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[29418]: cephadm 2021-03-10T15:59:57.972218+0000 mgr.gibba020.yqfnwy (mgr.34427) 6709 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:59:59.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[29418]: audit 2021-03-10T15:59:57.972837+0000 mon.a (mon.0) 2579 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:59.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[29418]: cephadm 2021-03-10T15:59:57.973418+0000 mgr.gibba020.yqfnwy (mgr.34427) 6710 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:59:59.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[29418]: cephadm 2021-03-10T15:59:57.973455+0000 mgr.gibba020.yqfnwy (mgr.34427) 6711 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:59:59.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[29418]: audit 2021-03-10T15:59:57.973897+0000 mon.a (mon.0) 2580 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:59.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[29418]: cephadm 2021-03-10T15:59:57.974302+0000 mgr.gibba020.yqfnwy (mgr.34427) 6712 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:59:59.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[29418]: cephadm 2021-03-10T15:59:57.975038+0000 mgr.gibba020.yqfnwy (mgr.34427) 6713 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:59:59.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[29418]: cephadm 2021-03-10T15:59:57.975077+0000 mgr.gibba020.yqfnwy (mgr.34427) 6714 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:59:59.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[29418]: audit 2021-03-10T15:59:57.975097+0000 mon.a (mon.0) 2581 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:59.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[29418]: cephadm 2021-03-10T15:59:57.975992+0000 mgr.gibba020.yqfnwy (mgr.34427) 6715 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:59:59.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[29418]: cephadm 2021-03-10T15:59:57.976335+0000 mgr.gibba020.yqfnwy (mgr.34427) 6716 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:59:59.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[29418]: audit 2021-03-10T15:59:57.976762+0000 mon.a (mon.0) 2582 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:59.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[30381]: cephadm 2021-03-10T15:59:57.708689+0000 mgr.gibba020.yqfnwy (mgr.34427) 6704 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:59:59.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[30381]: audit 2021-03-10T15:59:57.709462+0000 mon.a (mon.0) 2576 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:59:59.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[30381]: audit 2021-03-10T15:59:57.963135+0000 mon.a (mon.0) 2577 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:59:59.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[30381]: cluster 2021-03-10T15:59:57.964905+0000 mgr.gibba020.yqfnwy (mgr.34427) 6705 : cluster [DBG] pgmap v3818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:59.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[30381]: cephadm 2021-03-10T15:59:57.969658+0000 mgr.gibba020.yqfnwy (mgr.34427) 6706 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:59:59.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[30381]: cephadm 2021-03-10T15:59:57.971131+0000 mgr.gibba020.yqfnwy (mgr.34427) 6707 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:59:59.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[30381]: audit 2021-03-10T15:59:57.971712+0000 mon.a (mon.0) 2578 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:59:59.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[30381]: cephadm 2021-03-10T15:59:57.972181+0000 mgr.gibba020.yqfnwy (mgr.34427) 6708 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:59:59.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[30381]: cephadm 2021-03-10T15:59:57.972218+0000 mgr.gibba020.yqfnwy (mgr.34427) 6709 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:59:59.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[30381]: audit 2021-03-10T15:59:57.972837+0000 mon.a (mon.0) 2579 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:59.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[30381]: cephadm 2021-03-10T15:59:57.973418+0000 mgr.gibba020.yqfnwy (mgr.34427) 6710 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:59:59.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[30381]: cephadm 2021-03-10T15:59:57.973455+0000 mgr.gibba020.yqfnwy (mgr.34427) 6711 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:59:59.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[30381]: audit 2021-03-10T15:59:57.973897+0000 mon.a (mon.0) 2580 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:59.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[30381]: cephadm 2021-03-10T15:59:57.974302+0000 mgr.gibba020.yqfnwy (mgr.34427) 6712 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:59:59.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[30381]: cephadm 2021-03-10T15:59:57.975038+0000 mgr.gibba020.yqfnwy (mgr.34427) 6713 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:59:59.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[30381]: cephadm 2021-03-10T15:59:57.975077+0000 mgr.gibba020.yqfnwy (mgr.34427) 6714 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:59:59.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[30381]: audit 2021-03-10T15:59:57.975097+0000 mon.a (mon.0) 2581 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:59.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[30381]: cephadm 2021-03-10T15:59:57.975992+0000 mgr.gibba020.yqfnwy (mgr.34427) 6715 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:59:59.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[30381]: cephadm 2021-03-10T15:59:57.976335+0000 mgr.gibba020.yqfnwy (mgr.34427) 6716 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:59:59.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[30381]: audit 2021-03-10T15:59:57.976762+0000 mon.a (mon.0) 2582 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:59.140 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[29418]: cephadm 2021-03-10T15:59:57.977494+0000 mgr.gibba020.yqfnwy (mgr.34427) 6717 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:59:59.140 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[29418]: cephadm 2021-03-10T15:59:57.977535+0000 mgr.gibba020.yqfnwy (mgr.34427) 6718 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:59:59.140 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[29418]: cephadm 2021-03-10T15:59:57.977693+0000 mgr.gibba020.yqfnwy (mgr.34427) 6719 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:59:59.141 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[29418]: audit 2021-03-10T15:59:57.977961+0000 mon.a (mon.0) 2583 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:59.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[30381]: cephadm 2021-03-10T15:59:57.977494+0000 mgr.gibba020.yqfnwy (mgr.34427) 6717 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:59:59.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[30381]: cephadm 2021-03-10T15:59:57.977535+0000 mgr.gibba020.yqfnwy (mgr.34427) 6718 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:59:59.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[30381]: cephadm 2021-03-10T15:59:57.977693+0000 mgr.gibba020.yqfnwy (mgr.34427) 6719 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:59:59.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 15:59:58 gibba013 bash[30381]: audit 2021-03-10T15:59:57.977961+0000 mon.a (mon.0) 2583 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:59.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:58 gibba020 bash[25448]: cephadm 2021-03-10T15:59:57.708689+0000 mgr.gibba020.yqfnwy (mgr.34427) 6704 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T15:59:59.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:58 gibba020 bash[25448]: audit 2021-03-10T15:59:57.709462+0000 mon.a (mon.0) 2576 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:59:59.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:58 gibba020 bash[25448]: audit 2021-03-10T15:59:57.963135+0000 mon.a (mon.0) 2577 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T15:59:59.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:58 gibba020 bash[25448]: cluster 2021-03-10T15:59:57.964905+0000 mgr.gibba020.yqfnwy (mgr.34427) 6705 : cluster [DBG] pgmap v3818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T15:59:59.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:58 gibba020 bash[25448]: cephadm 2021-03-10T15:59:57.969658+0000 mgr.gibba020.yqfnwy (mgr.34427) 6706 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T15:59:59.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:58 gibba020 bash[25448]: cephadm 2021-03-10T15:59:57.971131+0000 mgr.gibba020.yqfnwy (mgr.34427) 6707 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T15:59:59.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:58 gibba020 bash[25448]: audit 2021-03-10T15:59:57.971712+0000 mon.a (mon.0) 2578 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T15:59:59.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:58 gibba020 bash[25448]: cephadm 2021-03-10T15:59:57.972181+0000 mgr.gibba020.yqfnwy (mgr.34427) 6708 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T15:59:59.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:58 gibba020 bash[25448]: cephadm 2021-03-10T15:59:57.972218+0000 mgr.gibba020.yqfnwy (mgr.34427) 6709 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T15:59:59.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:58 gibba020 bash[25448]: audit 2021-03-10T15:59:57.972837+0000 mon.a (mon.0) 2579 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:59.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:58 gibba020 bash[25448]: cephadm 2021-03-10T15:59:57.973418+0000 mgr.gibba020.yqfnwy (mgr.34427) 6710 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T15:59:59.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:58 gibba020 bash[25448]: cephadm 2021-03-10T15:59:57.973455+0000 mgr.gibba020.yqfnwy (mgr.34427) 6711 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T15:59:59.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:58 gibba020 bash[25448]: audit 2021-03-10T15:59:57.973897+0000 mon.a (mon.0) 2580 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:59.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:58 gibba020 bash[25448]: cephadm 2021-03-10T15:59:57.974302+0000 mgr.gibba020.yqfnwy (mgr.34427) 6712 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T15:59:59.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:58 gibba020 bash[25448]: cephadm 2021-03-10T15:59:57.975038+0000 mgr.gibba020.yqfnwy (mgr.34427) 6713 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T15:59:59.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:58 gibba020 bash[25448]: cephadm 2021-03-10T15:59:57.975077+0000 mgr.gibba020.yqfnwy (mgr.34427) 6714 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T15:59:59.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:58 gibba020 bash[25448]: audit 2021-03-10T15:59:57.975097+0000 mon.a (mon.0) 2581 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:59.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:58 gibba020 bash[25448]: cephadm 2021-03-10T15:59:57.975992+0000 mgr.gibba020.yqfnwy (mgr.34427) 6715 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T15:59:59.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:58 gibba020 bash[25448]: cephadm 2021-03-10T15:59:57.976335+0000 mgr.gibba020.yqfnwy (mgr.34427) 6716 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T15:59:59.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:58 gibba020 bash[25448]: audit 2021-03-10T15:59:57.976762+0000 mon.a (mon.0) 2582 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T15:59:59.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:58 gibba020 bash[25448]: cephadm 2021-03-10T15:59:57.977494+0000 mgr.gibba020.yqfnwy (mgr.34427) 6717 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T15:59:59.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:58 gibba020 bash[25448]: cephadm 2021-03-10T15:59:57.977535+0000 mgr.gibba020.yqfnwy (mgr.34427) 6718 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T15:59:59.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:58 gibba020 bash[25448]: cephadm 2021-03-10T15:59:57.977693+0000 mgr.gibba020.yqfnwy (mgr.34427) 6719 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T15:59:59.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 15:59:58 gibba020 bash[25448]: audit 2021-03-10T15:59:57.977961+0000 mon.a (mon.0) 2583 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:00.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:00 gibba013 bash[29418]: debug 2021-03-10T15:59:59.997+0000 7fd718a82700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:00:00.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:00 gibba013 bash[29418]: cluster 2021-03-10T15:59:59.966579+0000 mgr.gibba020.yqfnwy (mgr.34427) 6720 : cluster [DBG] pgmap v3819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:00.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:00 gibba013 bash[29418]: cluster 2021-03-10T16:00:00.000285+0000 mon.a (mon.0) 2584 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:00:00.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:00 gibba013 bash[30381]: cluster 2021-03-10T15:59:59.966579+0000 mgr.gibba020.yqfnwy (mgr.34427) 6720 : cluster [DBG] pgmap v3819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:00.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:00 gibba013 bash[30381]: cluster 2021-03-10T16:00:00.000285+0000 mon.a (mon.0) 2584 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:00:00.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:00 gibba020 bash[25448]: cluster 2021-03-10T15:59:59.966579+0000 mgr.gibba020.yqfnwy (mgr.34427) 6720 : cluster [DBG] pgmap v3819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:00.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:00 gibba020 bash[25448]: cluster 2021-03-10T16:00:00.000285+0000 mon.a (mon.0) 2584 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:00:02.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:02 gibba013 bash[29418]: cluster 2021-03-10T16:00:01.968010+0000 mgr.gibba020.yqfnwy (mgr.34427) 6721 : cluster [DBG] pgmap v3820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:02.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:02 gibba013 bash[30381]: cluster 2021-03-10T16:00:01.968010+0000 mgr.gibba020.yqfnwy (mgr.34427) 6721 : cluster [DBG] pgmap v3820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:02.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:02 gibba020 bash[25448]: cluster 2021-03-10T16:00:01.968010+0000 mgr.gibba020.yqfnwy (mgr.34427) 6721 : cluster [DBG] pgmap v3820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:04.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:04 gibba020 bash[25448]: cluster 2021-03-10T16:00:03.969387+0000 mgr.gibba020.yqfnwy (mgr.34427) 6722 : cluster [DBG] pgmap v3821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:04.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:04 gibba013 bash[29418]: cluster 2021-03-10T16:00:03.969387+0000 mgr.gibba020.yqfnwy (mgr.34427) 6722 : cluster [DBG] pgmap v3821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:04.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:04 gibba013 bash[30381]: cluster 2021-03-10T16:00:03.969387+0000 mgr.gibba020.yqfnwy (mgr.34427) 6722 : cluster [DBG] pgmap v3821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:06.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:06 gibba013 bash[29418]: cluster 2021-03-10T16:00:05.971099+0000 mgr.gibba020.yqfnwy (mgr.34427) 6723 : cluster [DBG] pgmap v3822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:06.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:06 gibba013 bash[30381]: cluster 2021-03-10T16:00:05.971099+0000 mgr.gibba020.yqfnwy (mgr.34427) 6723 : cluster [DBG] pgmap v3822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:06.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:06 gibba020 bash[25448]: cluster 2021-03-10T16:00:05.971099+0000 mgr.gibba020.yqfnwy (mgr.34427) 6723 : cluster [DBG] pgmap v3822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:07.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:07 gibba013 bash[29418]: audit 2021-03-10T16:00:06.611709+0000 mon.a (mon.0) 2585 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:00:07.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:07 gibba013 bash[29418]: audit 2021-03-10T16:00:06.684677+0000 mon.a (mon.0) 2586 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:00:07.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:07 gibba013 bash[29418]: audit 2021-03-10T16:00:06.864477+0000 mon.a (mon.0) 2587 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:00:07.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:07 gibba013 bash[29418]: audit 2021-03-10T16:00:06.865222+0000 mon.a (mon.0) 2588 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:00:07.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:07 gibba013 bash[29418]: audit 2021-03-10T16:00:06.865867+0000 mon.a (mon.0) 2589 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:00:07.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:07 gibba013 bash[29418]: audit 2021-03-10T16:00:06.866571+0000 mon.a (mon.0) 2590 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:00:07.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:07 gibba013 bash[30381]: audit 2021-03-10T16:00:06.611709+0000 mon.a (mon.0) 2585 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:00:07.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:07 gibba013 bash[30381]: audit 2021-03-10T16:00:06.684677+0000 mon.a (mon.0) 2586 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:00:07.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:07 gibba013 bash[30381]: audit 2021-03-10T16:00:06.864477+0000 mon.a (mon.0) 2587 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:00:07.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:07 gibba013 bash[30381]: audit 2021-03-10T16:00:06.865222+0000 mon.a (mon.0) 2588 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:00:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:07 gibba013 bash[30381]: audit 2021-03-10T16:00:06.865867+0000 mon.a (mon.0) 2589 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:00:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:07 gibba013 bash[30381]: audit 2021-03-10T16:00:06.866571+0000 mon.a (mon.0) 2590 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:00:07.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:07 gibba020 bash[25448]: audit 2021-03-10T16:00:06.611709+0000 mon.a (mon.0) 2585 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:00:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:07 gibba020 bash[25448]: audit 2021-03-10T16:00:06.684677+0000 mon.a (mon.0) 2586 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:00:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:07 gibba020 bash[25448]: audit 2021-03-10T16:00:06.864477+0000 mon.a (mon.0) 2587 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:00:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:07 gibba020 bash[25448]: audit 2021-03-10T16:00:06.865222+0000 mon.a (mon.0) 2588 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:00:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:07 gibba020 bash[25448]: audit 2021-03-10T16:00:06.865867+0000 mon.a (mon.0) 2589 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:00:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:07 gibba020 bash[25448]: audit 2021-03-10T16:00:06.866571+0000 mon.a (mon.0) 2590 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:00:08.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:08 gibba013 bash[29418]: cluster 2021-03-10T16:00:07.972581+0000 mgr.gibba020.yqfnwy (mgr.34427) 6724 : cluster [DBG] pgmap v3823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:08.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:08 gibba013 bash[30381]: cluster 2021-03-10T16:00:07.972581+0000 mgr.gibba020.yqfnwy (mgr.34427) 6724 : cluster [DBG] pgmap v3823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:08.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:08 gibba020 bash[25448]: cluster 2021-03-10T16:00:07.972581+0000 mgr.gibba020.yqfnwy (mgr.34427) 6724 : cluster [DBG] pgmap v3823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:10.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:10 gibba013 bash[29418]: cluster 2021-03-10T16:00:09.974356+0000 mgr.gibba020.yqfnwy (mgr.34427) 6725 : cluster [DBG] pgmap v3824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:10.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:10 gibba013 bash[30381]: cluster 2021-03-10T16:00:09.974356+0000 mgr.gibba020.yqfnwy (mgr.34427) 6725 : cluster [DBG] pgmap v3824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:10.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:10 gibba020 bash[25448]: cluster 2021-03-10T16:00:09.974356+0000 mgr.gibba020.yqfnwy (mgr.34427) 6725 : cluster [DBG] pgmap v3824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:12.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:12 gibba013 bash[29418]: cluster 2021-03-10T16:00:11.975865+0000 mgr.gibba020.yqfnwy (mgr.34427) 6726 : cluster [DBG] pgmap v3825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:12.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:12 gibba013 bash[30381]: cluster 2021-03-10T16:00:11.975865+0000 mgr.gibba020.yqfnwy (mgr.34427) 6726 : cluster [DBG] pgmap v3825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:12.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:12 gibba020 bash[25448]: cluster 2021-03-10T16:00:11.975865+0000 mgr.gibba020.yqfnwy (mgr.34427) 6726 : cluster [DBG] pgmap v3825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:14.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:14 gibba020 bash[25448]: cephadm 2021-03-10T16:00:12.993661+0000 mgr.gibba020.yqfnwy (mgr.34427) 6727 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:00:14.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:14 gibba020 bash[25448]: cluster 2021-03-10T16:00:13.977287+0000 mgr.gibba020.yqfnwy (mgr.34427) 6728 : cluster [DBG] pgmap v3826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:14.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:14 gibba013 bash[29418]: cephadm 2021-03-10T16:00:12.993661+0000 mgr.gibba020.yqfnwy (mgr.34427) 6727 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:00:14.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:14 gibba013 bash[29418]: cluster 2021-03-10T16:00:13.977287+0000 mgr.gibba020.yqfnwy (mgr.34427) 6728 : cluster [DBG] pgmap v3826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:14.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:14 gibba013 bash[30381]: cephadm 2021-03-10T16:00:12.993661+0000 mgr.gibba020.yqfnwy (mgr.34427) 6727 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:00:14.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:14 gibba013 bash[30381]: cluster 2021-03-10T16:00:13.977287+0000 mgr.gibba020.yqfnwy (mgr.34427) 6728 : cluster [DBG] pgmap v3826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:16.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:16 gibba013 bash[29418]: cluster 2021-03-10T16:00:15.978883+0000 mgr.gibba020.yqfnwy (mgr.34427) 6729 : cluster [DBG] pgmap v3827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:16.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:16 gibba013 bash[30381]: cluster 2021-03-10T16:00:15.978883+0000 mgr.gibba020.yqfnwy (mgr.34427) 6729 : cluster [DBG] pgmap v3827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:16.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:16 gibba020 bash[25448]: cluster 2021-03-10T16:00:15.978883+0000 mgr.gibba020.yqfnwy (mgr.34427) 6729 : cluster [DBG] pgmap v3827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:18.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:18 gibba013 bash[29418]: cluster 2021-03-10T16:00:17.980497+0000 mgr.gibba020.yqfnwy (mgr.34427) 6730 : cluster [DBG] pgmap v3828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:18.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:18 gibba013 bash[30381]: cluster 2021-03-10T16:00:17.980497+0000 mgr.gibba020.yqfnwy (mgr.34427) 6730 : cluster [DBG] pgmap v3828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:18.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:18 gibba020 bash[25448]: cluster 2021-03-10T16:00:17.980497+0000 mgr.gibba020.yqfnwy (mgr.34427) 6730 : cluster [DBG] pgmap v3828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:20.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:20 gibba013 bash[29418]: cluster 2021-03-10T16:00:19.982316+0000 mgr.gibba020.yqfnwy (mgr.34427) 6731 : cluster [DBG] pgmap v3829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:20.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:20 gibba013 bash[30381]: cluster 2021-03-10T16:00:19.982316+0000 mgr.gibba020.yqfnwy (mgr.34427) 6731 : cluster [DBG] pgmap v3829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:20.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:20 gibba020 bash[25448]: cluster 2021-03-10T16:00:19.982316+0000 mgr.gibba020.yqfnwy (mgr.34427) 6731 : cluster [DBG] pgmap v3829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:21.505 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:00:21.771 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:00:21.771 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 24s ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:00:21.771 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 9m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:00:21.772 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:00:21.772 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:00:21.772 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 24s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:00:21.772 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 24s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:00:21.773 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:00:21.773 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 24s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:00:21.773 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 24s ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:00:21.773 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:00:21.774 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 24s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:00:21.774 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 24s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:00:21.774 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 24s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:00:21.774 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 24s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:00:21.774 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:00:21.775 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:00:21.775 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:00:21.775 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:00:21.775 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 9m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:00:21.775 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 9m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:00:22.051 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:00:22.051 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:00:22.051 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:00:22.052 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:00:22.052 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:00:22.052 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:00:22.052 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:00:22.053 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:00:22.053 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:00:22.053 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:00:22.053 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:00:22.054 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:00:22.054 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:00:22.054 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:00:22.054 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:00:22.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:22 gibba013 bash[29418]: audit 2021-03-10T16:00:21.494285+0000 mgr.gibba020.yqfnwy (mgr.34427) 6732 : audit [DBG] from='client.48570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:00:22.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:22 gibba013 bash[29418]: audit 2021-03-10T16:00:21.728261+0000 mgr.gibba020.yqfnwy (mgr.34427) 6733 : audit [DBG] from='client.48576 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:00:22.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:22 gibba013 bash[29418]: cluster 2021-03-10T16:00:21.983844+0000 mgr.gibba020.yqfnwy (mgr.34427) 6734 : cluster [DBG] pgmap v3830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:22.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:22 gibba013 bash[30381]: audit 2021-03-10T16:00:21.494285+0000 mgr.gibba020.yqfnwy (mgr.34427) 6732 : audit [DBG] from='client.48570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:00:22.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:22 gibba013 bash[30381]: audit 2021-03-10T16:00:21.728261+0000 mgr.gibba020.yqfnwy (mgr.34427) 6733 : audit [DBG] from='client.48576 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:00:22.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:22 gibba013 bash[30381]: cluster 2021-03-10T16:00:21.983844+0000 mgr.gibba020.yqfnwy (mgr.34427) 6734 : cluster [DBG] pgmap v3830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:22.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:22 gibba020 bash[25448]: audit 2021-03-10T16:00:21.494285+0000 mgr.gibba020.yqfnwy (mgr.34427) 6732 : audit [DBG] from='client.48570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:00:22.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:22 gibba020 bash[25448]: audit 2021-03-10T16:00:21.728261+0000 mgr.gibba020.yqfnwy (mgr.34427) 6733 : audit [DBG] from='client.48576 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:00:22.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:22 gibba020 bash[25448]: cluster 2021-03-10T16:00:21.983844+0000 mgr.gibba020.yqfnwy (mgr.34427) 6734 : cluster [DBG] pgmap v3830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:23.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:23 gibba013 bash[29418]: audit 2021-03-10T16:00:22.050646+0000 mon.c (mon.1) 110 : audit [DBG] from='client.? 172.21.2.113:0/2436297219' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:23.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:23 gibba013 bash[30381]: audit 2021-03-10T16:00:22.050646+0000 mon.c (mon.1) 110 : audit [DBG] from='client.? 172.21.2.113:0/2436297219' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:23.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:23 gibba020 bash[25448]: audit 2021-03-10T16:00:22.050646+0000 mon.c (mon.1) 110 : audit [DBG] from='client.? 172.21.2.113:0/2436297219' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:24.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:24 gibba020 bash[25448]: cluster 2021-03-10T16:00:23.985283+0000 mgr.gibba020.yqfnwy (mgr.34427) 6735 : cluster [DBG] pgmap v3831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:24.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:24 gibba013 bash[29418]: cluster 2021-03-10T16:00:23.985283+0000 mgr.gibba020.yqfnwy (mgr.34427) 6735 : cluster [DBG] pgmap v3831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:24.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:24 gibba013 bash[30381]: cluster 2021-03-10T16:00:23.985283+0000 mgr.gibba020.yqfnwy (mgr.34427) 6735 : cluster [DBG] pgmap v3831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:26.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:26 gibba013 bash[29418]: cluster 2021-03-10T16:00:25.986730+0000 mgr.gibba020.yqfnwy (mgr.34427) 6736 : cluster [DBG] pgmap v3832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:26.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:26 gibba013 bash[30381]: cluster 2021-03-10T16:00:25.986730+0000 mgr.gibba020.yqfnwy (mgr.34427) 6736 : cluster [DBG] pgmap v3832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:26.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:26 gibba020 bash[25448]: cluster 2021-03-10T16:00:25.986730+0000 mgr.gibba020.yqfnwy (mgr.34427) 6736 : cluster [DBG] pgmap v3832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:28.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:28 gibba013 bash[29418]: cluster 2021-03-10T16:00:27.988347+0000 mgr.gibba020.yqfnwy (mgr.34427) 6737 : cluster [DBG] pgmap v3833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:28.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:28 gibba013 bash[30381]: cluster 2021-03-10T16:00:27.988347+0000 mgr.gibba020.yqfnwy (mgr.34427) 6737 : cluster [DBG] pgmap v3833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:28.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:28 gibba020 bash[25448]: cluster 2021-03-10T16:00:27.988347+0000 mgr.gibba020.yqfnwy (mgr.34427) 6737 : cluster [DBG] pgmap v3833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:29.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:29 gibba020 bash[25448]: cephadm 2021-03-10T16:00:28.009583+0000 mgr.gibba020.yqfnwy (mgr.34427) 6738 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:00:29.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:29 gibba013 bash[29418]: cephadm 2021-03-10T16:00:28.009583+0000 mgr.gibba020.yqfnwy (mgr.34427) 6738 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:00:29.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:29 gibba013 bash[30381]: cephadm 2021-03-10T16:00:28.009583+0000 mgr.gibba020.yqfnwy (mgr.34427) 6738 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:00:30.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:30 gibba020 bash[25448]: cluster 2021-03-10T16:00:29.989997+0000 mgr.gibba020.yqfnwy (mgr.34427) 6739 : cluster [DBG] pgmap v3834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:30.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:30 gibba013 bash[29418]: cluster 2021-03-10T16:00:29.989997+0000 mgr.gibba020.yqfnwy (mgr.34427) 6739 : cluster [DBG] pgmap v3834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:30.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:30 gibba013 bash[30381]: cluster 2021-03-10T16:00:29.989997+0000 mgr.gibba020.yqfnwy (mgr.34427) 6739 : cluster [DBG] pgmap v3834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:32.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:32 gibba013 bash[29418]: cluster 2021-03-10T16:00:31.991542+0000 mgr.gibba020.yqfnwy (mgr.34427) 6740 : cluster [DBG] pgmap v3835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:32.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:32 gibba013 bash[30381]: cluster 2021-03-10T16:00:31.991542+0000 mgr.gibba020.yqfnwy (mgr.34427) 6740 : cluster [DBG] pgmap v3835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:32.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:32 gibba020 bash[25448]: cluster 2021-03-10T16:00:31.991542+0000 mgr.gibba020.yqfnwy (mgr.34427) 6740 : cluster [DBG] pgmap v3835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:34.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:34 gibba020 bash[25448]: cluster 2021-03-10T16:00:33.993243+0000 mgr.gibba020.yqfnwy (mgr.34427) 6741 : cluster [DBG] pgmap v3836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:34.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:34 gibba013 bash[29418]: cluster 2021-03-10T16:00:33.993243+0000 mgr.gibba020.yqfnwy (mgr.34427) 6741 : cluster [DBG] pgmap v3836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:34.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:34 gibba013 bash[30381]: cluster 2021-03-10T16:00:33.993243+0000 mgr.gibba020.yqfnwy (mgr.34427) 6741 : cluster [DBG] pgmap v3836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:36.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:36 gibba013 bash[29418]: cluster 2021-03-10T16:00:35.994802+0000 mgr.gibba020.yqfnwy (mgr.34427) 6742 : cluster [DBG] pgmap v3837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:36.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:36 gibba013 bash[30381]: cluster 2021-03-10T16:00:35.994802+0000 mgr.gibba020.yqfnwy (mgr.34427) 6742 : cluster [DBG] pgmap v3837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:36.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:36 gibba020 bash[25448]: cluster 2021-03-10T16:00:35.994802+0000 mgr.gibba020.yqfnwy (mgr.34427) 6742 : cluster [DBG] pgmap v3837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:38.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:38 gibba013 bash[29418]: cluster 2021-03-10T16:00:37.996104+0000 mgr.gibba020.yqfnwy (mgr.34427) 6743 : cluster [DBG] pgmap v3838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:38.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:38 gibba013 bash[30381]: cluster 2021-03-10T16:00:37.996104+0000 mgr.gibba020.yqfnwy (mgr.34427) 6743 : cluster [DBG] pgmap v3838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:38.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:38 gibba020 bash[25448]: cluster 2021-03-10T16:00:37.996104+0000 mgr.gibba020.yqfnwy (mgr.34427) 6743 : cluster [DBG] pgmap v3838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:40.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:40 gibba013 bash[29418]: cluster 2021-03-10T16:00:39.997985+0000 mgr.gibba020.yqfnwy (mgr.34427) 6744 : cluster [DBG] pgmap v3839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:40.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:40 gibba013 bash[30381]: cluster 2021-03-10T16:00:39.997985+0000 mgr.gibba020.yqfnwy (mgr.34427) 6744 : cluster [DBG] pgmap v3839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:40.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:40 gibba020 bash[25448]: cluster 2021-03-10T16:00:39.997985+0000 mgr.gibba020.yqfnwy (mgr.34427) 6744 : cluster [DBG] pgmap v3839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:42.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:42 gibba013 bash[29418]: cluster 2021-03-10T16:00:41.999373+0000 mgr.gibba020.yqfnwy (mgr.34427) 6745 : cluster [DBG] pgmap v3840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:42.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:42 gibba013 bash[30381]: cluster 2021-03-10T16:00:41.999373+0000 mgr.gibba020.yqfnwy (mgr.34427) 6745 : cluster [DBG] pgmap v3840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:42.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:42 gibba020 bash[25448]: cluster 2021-03-10T16:00:41.999373+0000 mgr.gibba020.yqfnwy (mgr.34427) 6745 : cluster [DBG] pgmap v3840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:44.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:44 gibba020 bash[25448]: cephadm 2021-03-10T16:00:43.025481+0000 mgr.gibba020.yqfnwy (mgr.34427) 6746 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:00:44.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:44 gibba020 bash[25448]: cluster 2021-03-10T16:00:44.000950+0000 mgr.gibba020.yqfnwy (mgr.34427) 6747 : cluster [DBG] pgmap v3841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:44.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:44 gibba013 bash[29418]: cephadm 2021-03-10T16:00:43.025481+0000 mgr.gibba020.yqfnwy (mgr.34427) 6746 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:00:44.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:44 gibba013 bash[29418]: cluster 2021-03-10T16:00:44.000950+0000 mgr.gibba020.yqfnwy (mgr.34427) 6747 : cluster [DBG] pgmap v3841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:44.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:44 gibba013 bash[30381]: cephadm 2021-03-10T16:00:43.025481+0000 mgr.gibba020.yqfnwy (mgr.34427) 6746 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:00:44.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:44 gibba013 bash[30381]: cluster 2021-03-10T16:00:44.000950+0000 mgr.gibba020.yqfnwy (mgr.34427) 6747 : cluster [DBG] pgmap v3841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:46.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:46 gibba013 bash[29418]: cluster 2021-03-10T16:00:46.002617+0000 mgr.gibba020.yqfnwy (mgr.34427) 6748 : cluster [DBG] pgmap v3842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:46.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:46 gibba013 bash[30381]: cluster 2021-03-10T16:00:46.002617+0000 mgr.gibba020.yqfnwy (mgr.34427) 6748 : cluster [DBG] pgmap v3842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:46.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:46 gibba020 bash[25448]: cluster 2021-03-10T16:00:46.002617+0000 mgr.gibba020.yqfnwy (mgr.34427) 6748 : cluster [DBG] pgmap v3842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:48.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:48 gibba013 bash[29418]: cluster 2021-03-10T16:00:48.004071+0000 mgr.gibba020.yqfnwy (mgr.34427) 6749 : cluster [DBG] pgmap v3843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:48.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:48 gibba013 bash[30381]: cluster 2021-03-10T16:00:48.004071+0000 mgr.gibba020.yqfnwy (mgr.34427) 6749 : cluster [DBG] pgmap v3843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:48.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:48 gibba020 bash[25448]: cluster 2021-03-10T16:00:48.004071+0000 mgr.gibba020.yqfnwy (mgr.34427) 6749 : cluster [DBG] pgmap v3843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:50.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:50 gibba013 bash[29418]: cluster 2021-03-10T16:00:50.005619+0000 mgr.gibba020.yqfnwy (mgr.34427) 6750 : cluster [DBG] pgmap v3844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:50.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:50 gibba013 bash[30381]: cluster 2021-03-10T16:00:50.005619+0000 mgr.gibba020.yqfnwy (mgr.34427) 6750 : cluster [DBG] pgmap v3844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:50.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:50 gibba020 bash[25448]: cluster 2021-03-10T16:00:50.005619+0000 mgr.gibba020.yqfnwy (mgr.34427) 6750 : cluster [DBG] pgmap v3844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:52.298 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:00:52.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:52 gibba013 bash[30381]: cluster 2021-03-10T16:00:52.007137+0000 mgr.gibba020.yqfnwy (mgr.34427) 6751 : cluster [DBG] pgmap v3845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:52.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:52 gibba013 bash[29418]: cluster 2021-03-10T16:00:52.007137+0000 mgr.gibba020.yqfnwy (mgr.34427) 6751 : cluster [DBG] pgmap v3845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:52.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:52 gibba020 bash[25448]: cluster 2021-03-10T16:00:52.007137+0000 mgr.gibba020.yqfnwy (mgr.34427) 6751 : cluster [DBG] pgmap v3845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:52.526 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:00:52.526 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 54s ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:00:52.527 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 10m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:00:52.527 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:00:52.527 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:00:52.527 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 54s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:00:52.527 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 54s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:00:52.528 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:00:52.528 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 54s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:00:52.528 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 54s ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:00:52.528 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 10m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:00:52.529 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 54s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:00:52.529 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 54s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:00:52.529 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 54s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:00:52.529 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 54s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:00:52.529 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:00:52.533 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:00:52.533 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:00:52.533 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:00:52.533 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 10m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:00:52.533 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 10m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:00:52.776 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:00:52.776 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:00:52.777 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:00:52.777 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:00:52.777 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:00:52.777 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:00:52.778 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:00:52.778 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:00:52.778 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:00:52.778 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:00:52.778 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:00:52.779 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:00:52.779 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:00:52.779 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:00:52.779 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:00:53.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:53 gibba013 bash[29418]: audit 2021-03-10T16:00:52.287924+0000 mgr.gibba020.yqfnwy (mgr.34427) 6752 : audit [DBG] from='client.48588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:00:53.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:53 gibba013 bash[29418]: audit 2021-03-10T16:00:52.512199+0000 mgr.gibba020.yqfnwy (mgr.34427) 6753 : audit [DBG] from='client.48594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:00:53.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:53 gibba013 bash[29418]: audit 2021-03-10T16:00:52.776107+0000 mon.a (mon.0) 2591 : audit [DBG] from='client.? 172.21.2.113:0/165216033' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:53.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:53 gibba013 bash[30381]: audit 2021-03-10T16:00:52.287924+0000 mgr.gibba020.yqfnwy (mgr.34427) 6752 : audit [DBG] from='client.48588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:00:53.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:53 gibba013 bash[30381]: audit 2021-03-10T16:00:52.512199+0000 mgr.gibba020.yqfnwy (mgr.34427) 6753 : audit [DBG] from='client.48594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:00:53.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:53 gibba013 bash[30381]: audit 2021-03-10T16:00:52.776107+0000 mon.a (mon.0) 2591 : audit [DBG] from='client.? 172.21.2.113:0/165216033' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:53.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:53 gibba020 bash[25448]: audit 2021-03-10T16:00:52.287924+0000 mgr.gibba020.yqfnwy (mgr.34427) 6752 : audit [DBG] from='client.48588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:00:53.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:53 gibba020 bash[25448]: audit 2021-03-10T16:00:52.512199+0000 mgr.gibba020.yqfnwy (mgr.34427) 6753 : audit [DBG] from='client.48594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:00:53.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:53 gibba020 bash[25448]: audit 2021-03-10T16:00:52.776107+0000 mon.a (mon.0) 2591 : audit [DBG] from='client.? 172.21.2.113:0/165216033' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:00:54.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:54 gibba020 bash[25448]: cluster 2021-03-10T16:00:54.008807+0000 mgr.gibba020.yqfnwy (mgr.34427) 6754 : cluster [DBG] pgmap v3846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:54.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:54 gibba013 bash[29418]: cluster 2021-03-10T16:00:54.008807+0000 mgr.gibba020.yqfnwy (mgr.34427) 6754 : cluster [DBG] pgmap v3846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:54.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:54 gibba013 bash[30381]: cluster 2021-03-10T16:00:54.008807+0000 mgr.gibba020.yqfnwy (mgr.34427) 6754 : cluster [DBG] pgmap v3846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:56.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:56 gibba013 bash[29418]: cluster 2021-03-10T16:00:56.010482+0000 mgr.gibba020.yqfnwy (mgr.34427) 6755 : cluster [DBG] pgmap v3847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:56.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:56 gibba013 bash[30381]: cluster 2021-03-10T16:00:56.010482+0000 mgr.gibba020.yqfnwy (mgr.34427) 6755 : cluster [DBG] pgmap v3847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:56.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:56 gibba020 bash[25448]: cluster 2021-03-10T16:00:56.010482+0000 mgr.gibba020.yqfnwy (mgr.34427) 6755 : cluster [DBG] pgmap v3847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:58.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:58 gibba013 bash[29418]: cluster 2021-03-10T16:00:58.012046+0000 mgr.gibba020.yqfnwy (mgr.34427) 6756 : cluster [DBG] pgmap v3848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:58.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:58 gibba013 bash[29418]: audit 2021-03-10T16:00:58.043455+0000 mon.a (mon.0) 2592 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:00:58.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:58 gibba013 bash[29418]: audit 2021-03-10T16:00:58.046798+0000 mon.a (mon.0) 2593 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:00:58.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:58 gibba013 bash[30381]: cluster 2021-03-10T16:00:58.012046+0000 mgr.gibba020.yqfnwy (mgr.34427) 6756 : cluster [DBG] pgmap v3848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:58.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:58 gibba013 bash[30381]: audit 2021-03-10T16:00:58.043455+0000 mon.a (mon.0) 2592 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:00:58.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:58 gibba013 bash[30381]: audit 2021-03-10T16:00:58.046798+0000 mon.a (mon.0) 2593 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:00:58.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:58 gibba020 bash[25448]: cluster 2021-03-10T16:00:58.012046+0000 mgr.gibba020.yqfnwy (mgr.34427) 6756 : cluster [DBG] pgmap v3848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:00:58.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:58 gibba020 bash[25448]: audit 2021-03-10T16:00:58.043455+0000 mon.a (mon.0) 2592 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:00:58.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:58 gibba020 bash[25448]: audit 2021-03-10T16:00:58.046798+0000 mon.a (mon.0) 2593 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:00:59.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:00:59 gibba020 bash[25448]: cephadm 2021-03-10T16:00:58.044512+0000 mgr.gibba020.yqfnwy (mgr.34427) 6757 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:00:59.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:00:59 gibba013 bash[29418]: cephadm 2021-03-10T16:00:58.044512+0000 mgr.gibba020.yqfnwy (mgr.34427) 6757 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:00:59.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:00:59 gibba013 bash[30381]: cephadm 2021-03-10T16:00:58.044512+0000 mgr.gibba020.yqfnwy (mgr.34427) 6757 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:01:00.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:00 gibba013 bash[29418]: cluster 2021-03-10T16:01:00.012564+0000 mgr.gibba020.yqfnwy (mgr.34427) 6758 : cluster [DBG] pgmap v3849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:00.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:00 gibba013 bash[30381]: cluster 2021-03-10T16:01:00.012564+0000 mgr.gibba020.yqfnwy (mgr.34427) 6758 : cluster [DBG] pgmap v3849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:00.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:00 gibba020 bash[25448]: cluster 2021-03-10T16:01:00.012564+0000 mgr.gibba020.yqfnwy (mgr.34427) 6758 : cluster [DBG] pgmap v3849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:03.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[29418]: cephadm 2021-03-10T16:01:01.711588+0000 mgr.gibba020.yqfnwy (mgr.34427) 6759 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:01:03.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[29418]: audit 2021-03-10T16:01:01.712432+0000 mon.a (mon.0) 2594 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:01:03.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[29418]: audit 2021-03-10T16:01:01.904259+0000 mon.a (mon.0) 2595 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:01:03.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[29418]: cephadm 2021-03-10T16:01:01.905632+0000 mgr.gibba020.yqfnwy (mgr.34427) 6760 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:01:03.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[29418]: cephadm 2021-03-10T16:01:01.907510+0000 mgr.gibba020.yqfnwy (mgr.34427) 6761 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:01:03.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[29418]: audit 2021-03-10T16:01:01.907728+0000 mon.a (mon.0) 2596 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:01:03.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[29418]: audit 2021-03-10T16:01:01.909404+0000 mon.a (mon.0) 2597 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:03.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[29418]: cephadm 2021-03-10T16:01:01.909494+0000 mgr.gibba020.yqfnwy (mgr.34427) 6762 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:01:03.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[29418]: cephadm 2021-03-10T16:01:01.909603+0000 mgr.gibba020.yqfnwy (mgr.34427) 6763 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:01:03.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[29418]: cephadm 2021-03-10T16:01:01.911097+0000 mgr.gibba020.yqfnwy (mgr.34427) 6764 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:01:03.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[29418]: cephadm 2021-03-10T16:01:01.911159+0000 mgr.gibba020.yqfnwy (mgr.34427) 6765 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:01:03.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[29418]: audit 2021-03-10T16:01:01.911439+0000 mon.a (mon.0) 2598 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:03.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[29418]: cephadm 2021-03-10T16:01:01.912557+0000 mgr.gibba020.yqfnwy (mgr.34427) 6766 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:01:03.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[29418]: audit 2021-03-10T16:01:01.912969+0000 mon.a (mon.0) 2599 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:03.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[29418]: cephadm 2021-03-10T16:01:01.913741+0000 mgr.gibba020.yqfnwy (mgr.34427) 6767 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:01:03.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[29418]: cephadm 2021-03-10T16:01:01.913798+0000 mgr.gibba020.yqfnwy (mgr.34427) 6768 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:01:03.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[29418]: cephadm 2021-03-10T16:01:01.915304+0000 mgr.gibba020.yqfnwy (mgr.34427) 6769 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:01:03.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[29418]: audit 2021-03-10T16:01:01.915629+0000 mon.a (mon.0) 2600 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:03.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[29418]: cephadm 2021-03-10T16:01:01.915724+0000 mgr.gibba020.yqfnwy (mgr.34427) 6770 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:01:03.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[29418]: cephadm 2021-03-10T16:01:01.916997+0000 mgr.gibba020.yqfnwy (mgr.34427) 6771 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:01:03.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[29418]: cephadm 2021-03-10T16:01:01.917056+0000 mgr.gibba020.yqfnwy (mgr.34427) 6772 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:01:03.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[30381]: cephadm 2021-03-10T16:01:01.711588+0000 mgr.gibba020.yqfnwy (mgr.34427) 6759 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:01:03.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[30381]: audit 2021-03-10T16:01:01.712432+0000 mon.a (mon.0) 2594 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:01:03.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[30381]: audit 2021-03-10T16:01:01.904259+0000 mon.a (mon.0) 2595 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:01:03.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[30381]: cephadm 2021-03-10T16:01:01.905632+0000 mgr.gibba020.yqfnwy (mgr.34427) 6760 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:01:03.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[30381]: cephadm 2021-03-10T16:01:01.907510+0000 mgr.gibba020.yqfnwy (mgr.34427) 6761 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:01:03.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[30381]: audit 2021-03-10T16:01:01.907728+0000 mon.a (mon.0) 2596 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:01:03.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[30381]: audit 2021-03-10T16:01:01.909404+0000 mon.a (mon.0) 2597 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:03.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[30381]: cephadm 2021-03-10T16:01:01.909494+0000 mgr.gibba020.yqfnwy (mgr.34427) 6762 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:01:03.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[30381]: cephadm 2021-03-10T16:01:01.909603+0000 mgr.gibba020.yqfnwy (mgr.34427) 6763 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:01:03.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[30381]: cephadm 2021-03-10T16:01:01.911097+0000 mgr.gibba020.yqfnwy (mgr.34427) 6764 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:01:03.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[30381]: cephadm 2021-03-10T16:01:01.911159+0000 mgr.gibba020.yqfnwy (mgr.34427) 6765 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:01:03.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[30381]: audit 2021-03-10T16:01:01.911439+0000 mon.a (mon.0) 2598 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:03.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[30381]: cephadm 2021-03-10T16:01:01.912557+0000 mgr.gibba020.yqfnwy (mgr.34427) 6766 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:01:03.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[30381]: audit 2021-03-10T16:01:01.912969+0000 mon.a (mon.0) 2599 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:03.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[30381]: cephadm 2021-03-10T16:01:01.913741+0000 mgr.gibba020.yqfnwy (mgr.34427) 6767 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:01:03.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[30381]: cephadm 2021-03-10T16:01:01.913798+0000 mgr.gibba020.yqfnwy (mgr.34427) 6768 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:01:03.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[30381]: cephadm 2021-03-10T16:01:01.915304+0000 mgr.gibba020.yqfnwy (mgr.34427) 6769 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:01:03.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[30381]: audit 2021-03-10T16:01:01.915629+0000 mon.a (mon.0) 2600 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:03.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[30381]: cephadm 2021-03-10T16:01:01.915724+0000 mgr.gibba020.yqfnwy (mgr.34427) 6770 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:01:03.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[30381]: cephadm 2021-03-10T16:01:01.916997+0000 mgr.gibba020.yqfnwy (mgr.34427) 6771 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:01:03.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[30381]: cephadm 2021-03-10T16:01:01.917056+0000 mgr.gibba020.yqfnwy (mgr.34427) 6772 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:01:03.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[30381]: cephadm 2021-03-10T16:01:01.917197+0000 mgr.gibba020.yqfnwy (mgr.34427) 6773 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:01:03.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[30381]: audit 2021-03-10T16:01:01.917517+0000 mon.a (mon.0) 2601 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:03.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[30381]: cluster 2021-03-10T16:01:02.013856+0000 mgr.gibba020.yqfnwy (mgr.34427) 6774 : cluster [DBG] pgmap v3850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:03.141 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[29418]: cephadm 2021-03-10T16:01:01.917197+0000 mgr.gibba020.yqfnwy (mgr.34427) 6773 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:01:03.141 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[29418]: audit 2021-03-10T16:01:01.917517+0000 mon.a (mon.0) 2601 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:03.141 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:02 gibba013 bash[29418]: cluster 2021-03-10T16:01:02.013856+0000 mgr.gibba020.yqfnwy (mgr.34427) 6774 : cluster [DBG] pgmap v3850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:03.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:02 gibba020 bash[25448]: cephadm 2021-03-10T16:01:01.711588+0000 mgr.gibba020.yqfnwy (mgr.34427) 6759 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:01:03.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:02 gibba020 bash[25448]: audit 2021-03-10T16:01:01.712432+0000 mon.a (mon.0) 2594 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:01:03.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:02 gibba020 bash[25448]: audit 2021-03-10T16:01:01.904259+0000 mon.a (mon.0) 2595 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:01:03.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:02 gibba020 bash[25448]: cephadm 2021-03-10T16:01:01.905632+0000 mgr.gibba020.yqfnwy (mgr.34427) 6760 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:01:03.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:02 gibba020 bash[25448]: cephadm 2021-03-10T16:01:01.907510+0000 mgr.gibba020.yqfnwy (mgr.34427) 6761 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:01:03.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:02 gibba020 bash[25448]: audit 2021-03-10T16:01:01.907728+0000 mon.a (mon.0) 2596 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:01:03.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:02 gibba020 bash[25448]: audit 2021-03-10T16:01:01.909404+0000 mon.a (mon.0) 2597 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:03.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:02 gibba020 bash[25448]: cephadm 2021-03-10T16:01:01.909494+0000 mgr.gibba020.yqfnwy (mgr.34427) 6762 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:01:03.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:02 gibba020 bash[25448]: cephadm 2021-03-10T16:01:01.909603+0000 mgr.gibba020.yqfnwy (mgr.34427) 6763 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:01:03.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:02 gibba020 bash[25448]: cephadm 2021-03-10T16:01:01.911097+0000 mgr.gibba020.yqfnwy (mgr.34427) 6764 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:01:03.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:02 gibba020 bash[25448]: cephadm 2021-03-10T16:01:01.911159+0000 mgr.gibba020.yqfnwy (mgr.34427) 6765 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:01:03.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:02 gibba020 bash[25448]: audit 2021-03-10T16:01:01.911439+0000 mon.a (mon.0) 2598 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:03.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:02 gibba020 bash[25448]: cephadm 2021-03-10T16:01:01.912557+0000 mgr.gibba020.yqfnwy (mgr.34427) 6766 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:01:03.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:02 gibba020 bash[25448]: audit 2021-03-10T16:01:01.912969+0000 mon.a (mon.0) 2599 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:03.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:02 gibba020 bash[25448]: cephadm 2021-03-10T16:01:01.913741+0000 mgr.gibba020.yqfnwy (mgr.34427) 6767 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:01:03.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:02 gibba020 bash[25448]: cephadm 2021-03-10T16:01:01.913798+0000 mgr.gibba020.yqfnwy (mgr.34427) 6768 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:01:03.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:02 gibba020 bash[25448]: cephadm 2021-03-10T16:01:01.915304+0000 mgr.gibba020.yqfnwy (mgr.34427) 6769 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:01:03.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:02 gibba020 bash[25448]: audit 2021-03-10T16:01:01.915629+0000 mon.a (mon.0) 2600 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:03.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:02 gibba020 bash[25448]: cephadm 2021-03-10T16:01:01.915724+0000 mgr.gibba020.yqfnwy (mgr.34427) 6770 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:01:03.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:02 gibba020 bash[25448]: cephadm 2021-03-10T16:01:01.916997+0000 mgr.gibba020.yqfnwy (mgr.34427) 6771 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:01:03.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:02 gibba020 bash[25448]: cephadm 2021-03-10T16:01:01.917056+0000 mgr.gibba020.yqfnwy (mgr.34427) 6772 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:01:03.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:02 gibba020 bash[25448]: cephadm 2021-03-10T16:01:01.917197+0000 mgr.gibba020.yqfnwy (mgr.34427) 6773 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:01:03.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:02 gibba020 bash[25448]: audit 2021-03-10T16:01:01.917517+0000 mon.a (mon.0) 2601 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:03.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:02 gibba020 bash[25448]: cluster 2021-03-10T16:01:02.013856+0000 mgr.gibba020.yqfnwy (mgr.34427) 6774 : cluster [DBG] pgmap v3850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:05.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:05 gibba020 bash[25448]: cluster 2021-03-10T16:01:04.015475+0000 mgr.gibba020.yqfnwy (mgr.34427) 6775 : cluster [DBG] pgmap v3851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:05.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:05 gibba013 bash[29418]: cluster 2021-03-10T16:01:04.015475+0000 mgr.gibba020.yqfnwy (mgr.34427) 6775 : cluster [DBG] pgmap v3851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:05.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:05 gibba013 bash[30381]: cluster 2021-03-10T16:01:04.015475+0000 mgr.gibba020.yqfnwy (mgr.34427) 6775 : cluster [DBG] pgmap v3851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:07.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:07 gibba013 bash[29418]: cluster 2021-03-10T16:01:06.017109+0000 mgr.gibba020.yqfnwy (mgr.34427) 6776 : cluster [DBG] pgmap v3852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:07.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:07 gibba013 bash[29418]: audit 2021-03-10T16:01:06.616692+0000 mon.a (mon.0) 2602 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:01:07.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:07 gibba013 bash[29418]: audit 2021-03-10T16:01:06.687892+0000 mon.a (mon.0) 2603 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:01:07.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:07 gibba013 bash[29418]: audit 2021-03-10T16:01:06.875293+0000 mon.a (mon.0) 2604 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:01:07.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:07 gibba013 bash[29418]: audit 2021-03-10T16:01:06.876084+0000 mon.a (mon.0) 2605 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:01:07.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:07 gibba013 bash[29418]: audit 2021-03-10T16:01:06.876751+0000 mon.a (mon.0) 2606 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:01:07.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:07 gibba013 bash[29418]: audit 2021-03-10T16:01:06.877421+0000 mon.a (mon.0) 2607 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:01:07.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:07 gibba013 bash[30381]: cluster 2021-03-10T16:01:06.017109+0000 mgr.gibba020.yqfnwy (mgr.34427) 6776 : cluster [DBG] pgmap v3852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:07.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:07 gibba013 bash[30381]: audit 2021-03-10T16:01:06.616692+0000 mon.a (mon.0) 2602 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:01:07.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:07 gibba013 bash[30381]: audit 2021-03-10T16:01:06.687892+0000 mon.a (mon.0) 2603 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:01:07.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:07 gibba013 bash[30381]: audit 2021-03-10T16:01:06.875293+0000 mon.a (mon.0) 2604 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:01:07.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:07 gibba013 bash[30381]: audit 2021-03-10T16:01:06.876084+0000 mon.a (mon.0) 2605 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:01:07.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:07 gibba013 bash[30381]: audit 2021-03-10T16:01:06.876751+0000 mon.a (mon.0) 2606 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:01:07.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:07 gibba013 bash[30381]: audit 2021-03-10T16:01:06.877421+0000 mon.a (mon.0) 2607 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:01:07.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:07 gibba020 bash[25448]: cluster 2021-03-10T16:01:06.017109+0000 mgr.gibba020.yqfnwy (mgr.34427) 6776 : cluster [DBG] pgmap v3852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:07.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:07 gibba020 bash[25448]: audit 2021-03-10T16:01:06.616692+0000 mon.a (mon.0) 2602 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:01:07.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:07 gibba020 bash[25448]: audit 2021-03-10T16:01:06.687892+0000 mon.a (mon.0) 2603 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:01:07.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:07 gibba020 bash[25448]: audit 2021-03-10T16:01:06.875293+0000 mon.a (mon.0) 2604 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:01:07.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:07 gibba020 bash[25448]: audit 2021-03-10T16:01:06.876084+0000 mon.a (mon.0) 2605 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:01:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:07 gibba020 bash[25448]: audit 2021-03-10T16:01:06.876751+0000 mon.a (mon.0) 2606 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:01:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:07 gibba020 bash[25448]: audit 2021-03-10T16:01:06.877421+0000 mon.a (mon.0) 2607 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:01:09.894 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:09 gibba013 bash[29418]: cluster 2021-03-10T16:01:08.018370+0000 mgr.gibba020.yqfnwy (mgr.34427) 6777 : cluster [DBG] pgmap v3853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:09.895 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:09 gibba013 bash[30381]: cluster 2021-03-10T16:01:08.018370+0000 mgr.gibba020.yqfnwy (mgr.34427) 6777 : cluster [DBG] pgmap v3853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:09.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:09 gibba020 bash[25448]: cluster 2021-03-10T16:01:08.018370+0000 mgr.gibba020.yqfnwy (mgr.34427) 6777 : cluster [DBG] pgmap v3853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:11.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:11 gibba013 bash[29418]: cluster 2021-03-10T16:01:10.019047+0000 mgr.gibba020.yqfnwy (mgr.34427) 6778 : cluster [DBG] pgmap v3854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:11.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:11 gibba013 bash[30381]: cluster 2021-03-10T16:01:10.019047+0000 mgr.gibba020.yqfnwy (mgr.34427) 6778 : cluster [DBG] pgmap v3854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:11.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:11 gibba020 bash[25448]: cluster 2021-03-10T16:01:10.019047+0000 mgr.gibba020.yqfnwy (mgr.34427) 6778 : cluster [DBG] pgmap v3854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:13.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:13 gibba013 bash[29418]: cluster 2021-03-10T16:01:12.020295+0000 mgr.gibba020.yqfnwy (mgr.34427) 6779 : cluster [DBG] pgmap v3855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:13.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:13 gibba013 bash[30381]: cluster 2021-03-10T16:01:12.020295+0000 mgr.gibba020.yqfnwy (mgr.34427) 6779 : cluster [DBG] pgmap v3855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:13.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:13 gibba020 bash[25448]: cluster 2021-03-10T16:01:12.020295+0000 mgr.gibba020.yqfnwy (mgr.34427) 6779 : cluster [DBG] pgmap v3855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:15.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:15 gibba013 bash[29418]: cluster 2021-03-10T16:01:14.022022+0000 mgr.gibba020.yqfnwy (mgr.34427) 6780 : cluster [DBG] pgmap v3856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:15.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:15 gibba013 bash[30381]: cluster 2021-03-10T16:01:14.022022+0000 mgr.gibba020.yqfnwy (mgr.34427) 6780 : cluster [DBG] pgmap v3856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:15.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:15 gibba020 bash[25448]: cluster 2021-03-10T16:01:14.022022+0000 mgr.gibba020.yqfnwy (mgr.34427) 6780 : cluster [DBG] pgmap v3856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:17.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:17 gibba013 bash[29418]: cluster 2021-03-10T16:01:16.023707+0000 mgr.gibba020.yqfnwy (mgr.34427) 6781 : cluster [DBG] pgmap v3857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:17.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:17 gibba013 bash[29418]: cephadm 2021-03-10T16:01:16.933290+0000 mgr.gibba020.yqfnwy (mgr.34427) 6782 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:01:17.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:17 gibba013 bash[30381]: cluster 2021-03-10T16:01:16.023707+0000 mgr.gibba020.yqfnwy (mgr.34427) 6781 : cluster [DBG] pgmap v3857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:17.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:17 gibba013 bash[30381]: cephadm 2021-03-10T16:01:16.933290+0000 mgr.gibba020.yqfnwy (mgr.34427) 6782 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:01:17.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:17 gibba020 bash[25448]: cluster 2021-03-10T16:01:16.023707+0000 mgr.gibba020.yqfnwy (mgr.34427) 6781 : cluster [DBG] pgmap v3857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:17.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:17 gibba020 bash[25448]: cephadm 2021-03-10T16:01:16.933290+0000 mgr.gibba020.yqfnwy (mgr.34427) 6782 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:01:19.928 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:19 gibba013 bash[29418]: cluster 2021-03-10T16:01:18.025026+0000 mgr.gibba020.yqfnwy (mgr.34427) 6783 : cluster [DBG] pgmap v3858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:19.928 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:19 gibba013 bash[30381]: cluster 2021-03-10T16:01:18.025026+0000 mgr.gibba020.yqfnwy (mgr.34427) 6783 : cluster [DBG] pgmap v3858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:19.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:19 gibba020 bash[25448]: cluster 2021-03-10T16:01:18.025026+0000 mgr.gibba020.yqfnwy (mgr.34427) 6783 : cluster [DBG] pgmap v3858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:21.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:21 gibba013 bash[29418]: cluster 2021-03-10T16:01:20.025578+0000 mgr.gibba020.yqfnwy (mgr.34427) 6784 : cluster [DBG] pgmap v3859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:21.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:21 gibba013 bash[30381]: cluster 2021-03-10T16:01:20.025578+0000 mgr.gibba020.yqfnwy (mgr.34427) 6784 : cluster [DBG] pgmap v3859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:21.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:21 gibba020 bash[25448]: cluster 2021-03-10T16:01:20.025578+0000 mgr.gibba020.yqfnwy (mgr.34427) 6784 : cluster [DBG] pgmap v3859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:23.022 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:01:23.264 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:01:23.264 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 85s ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:01:23.264 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 21s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:01:23.265 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 21s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:01:23.265 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 21s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:01:23.265 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 85s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:01:23.265 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 85s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:01:23.266 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 21s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:01:23.266 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 85s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:01:23.266 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 85s ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:01:23.266 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 21s ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:01:23.267 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 85s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:01:23.267 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 85s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:01:23.267 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 85s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:01:23.268 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 85s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:01:23.268 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 21s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:01:23.268 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 21s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:01:23.268 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 21s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:01:23.269 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 21s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:01:23.269 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 21s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:01:23.269 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 21s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:01:23.511 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:01:23.511 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:01:23.512 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:01:23.512 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:01:23.512 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:01:23.512 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:01:23.512 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:01:23.513 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:01:23.513 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:01:23.513 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:01:23.513 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:01:23.514 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:01:23.514 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:01:23.514 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:01:23.514 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:01:23.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:23 gibba013 bash[29418]: cluster 2021-03-10T16:01:22.026987+0000 mgr.gibba020.yqfnwy (mgr.34427) 6785 : cluster [DBG] pgmap v3860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:23.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:23 gibba013 bash[29418]: audit 2021-03-10T16:01:23.011833+0000 mgr.gibba020.yqfnwy (mgr.34427) 6786 : audit [DBG] from='client.48606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:01:23.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:23 gibba013 bash[29418]: audit 2021-03-10T16:01:23.511406+0000 mon.c (mon.1) 111 : audit [DBG] from='client.? 172.21.2.113:0/3582739869' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:23.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:23 gibba013 bash[30381]: cluster 2021-03-10T16:01:22.026987+0000 mgr.gibba020.yqfnwy (mgr.34427) 6785 : cluster [DBG] pgmap v3860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:23.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:23 gibba013 bash[30381]: audit 2021-03-10T16:01:23.011833+0000 mgr.gibba020.yqfnwy (mgr.34427) 6786 : audit [DBG] from='client.48606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:01:23.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:23 gibba013 bash[30381]: audit 2021-03-10T16:01:23.511406+0000 mon.c (mon.1) 111 : audit [DBG] from='client.? 172.21.2.113:0/3582739869' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:23.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:23 gibba020 bash[25448]: cluster 2021-03-10T16:01:22.026987+0000 mgr.gibba020.yqfnwy (mgr.34427) 6785 : cluster [DBG] pgmap v3860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:23.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:23 gibba020 bash[25448]: audit 2021-03-10T16:01:23.011833+0000 mgr.gibba020.yqfnwy (mgr.34427) 6786 : audit [DBG] from='client.48606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:01:23.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:23 gibba020 bash[25448]: audit 2021-03-10T16:01:23.511406+0000 mon.c (mon.1) 111 : audit [DBG] from='client.? 172.21.2.113:0/3582739869' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:24.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:24 gibba013 bash[29418]: audit 2021-03-10T16:01:23.234600+0000 mgr.gibba020.yqfnwy (mgr.34427) 6787 : audit [DBG] from='client.58597 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:01:24.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:24 gibba013 bash[30381]: audit 2021-03-10T16:01:23.234600+0000 mgr.gibba020.yqfnwy (mgr.34427) 6787 : audit [DBG] from='client.58597 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:01:24.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:24 gibba020 bash[25448]: audit 2021-03-10T16:01:23.234600+0000 mgr.gibba020.yqfnwy (mgr.34427) 6787 : audit [DBG] from='client.58597 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:01:25.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:25 gibba013 bash[29418]: cluster 2021-03-10T16:01:24.028653+0000 mgr.gibba020.yqfnwy (mgr.34427) 6788 : cluster [DBG] pgmap v3861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:25.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:25 gibba013 bash[30381]: cluster 2021-03-10T16:01:24.028653+0000 mgr.gibba020.yqfnwy (mgr.34427) 6788 : cluster [DBG] pgmap v3861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:25.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:25 gibba020 bash[25448]: cluster 2021-03-10T16:01:24.028653+0000 mgr.gibba020.yqfnwy (mgr.34427) 6788 : cluster [DBG] pgmap v3861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:27.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:27 gibba013 bash[29418]: cluster 2021-03-10T16:01:26.030448+0000 mgr.gibba020.yqfnwy (mgr.34427) 6789 : cluster [DBG] pgmap v3862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:27.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:27 gibba013 bash[30381]: cluster 2021-03-10T16:01:26.030448+0000 mgr.gibba020.yqfnwy (mgr.34427) 6789 : cluster [DBG] pgmap v3862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:27.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:27 gibba020 bash[25448]: cluster 2021-03-10T16:01:26.030448+0000 mgr.gibba020.yqfnwy (mgr.34427) 6789 : cluster [DBG] pgmap v3862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:29.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:29 gibba013 bash[29418]: cluster 2021-03-10T16:01:28.031848+0000 mgr.gibba020.yqfnwy (mgr.34427) 6790 : cluster [DBG] pgmap v3863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:29.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:29 gibba013 bash[30381]: cluster 2021-03-10T16:01:28.031848+0000 mgr.gibba020.yqfnwy (mgr.34427) 6790 : cluster [DBG] pgmap v3863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:29.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:29 gibba020 bash[25448]: cluster 2021-03-10T16:01:28.031848+0000 mgr.gibba020.yqfnwy (mgr.34427) 6790 : cluster [DBG] pgmap v3863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:31.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:31 gibba013 bash[29418]: cluster 2021-03-10T16:01:30.032806+0000 mgr.gibba020.yqfnwy (mgr.34427) 6791 : cluster [DBG] pgmap v3864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:31.984 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:31 gibba013 bash[30381]: cluster 2021-03-10T16:01:30.032806+0000 mgr.gibba020.yqfnwy (mgr.34427) 6791 : cluster [DBG] pgmap v3864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:31.985 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:31 gibba020 bash[25448]: cluster 2021-03-10T16:01:30.032806+0000 mgr.gibba020.yqfnwy (mgr.34427) 6791 : cluster [DBG] pgmap v3864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:32.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:32 gibba013 bash[29418]: cephadm 2021-03-10T16:01:31.934205+0000 mgr.gibba020.yqfnwy (mgr.34427) 6792 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:01:32.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:32 gibba013 bash[30381]: cephadm 2021-03-10T16:01:31.934205+0000 mgr.gibba020.yqfnwy (mgr.34427) 6792 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:01:32.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:32 gibba020 bash[25448]: cephadm 2021-03-10T16:01:31.934205+0000 mgr.gibba020.yqfnwy (mgr.34427) 6792 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:01:33.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:33 gibba013 bash[29418]: cluster 2021-03-10T16:01:32.034142+0000 mgr.gibba020.yqfnwy (mgr.34427) 6793 : cluster [DBG] pgmap v3865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:33.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:33 gibba013 bash[30381]: cluster 2021-03-10T16:01:32.034142+0000 mgr.gibba020.yqfnwy (mgr.34427) 6793 : cluster [DBG] pgmap v3865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:33.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:33 gibba020 bash[25448]: cluster 2021-03-10T16:01:32.034142+0000 mgr.gibba020.yqfnwy (mgr.34427) 6793 : cluster [DBG] pgmap v3865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:35.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:35 gibba013 bash[29418]: cluster 2021-03-10T16:01:34.035825+0000 mgr.gibba020.yqfnwy (mgr.34427) 6794 : cluster [DBG] pgmap v3866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:35.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:35 gibba013 bash[30381]: cluster 2021-03-10T16:01:34.035825+0000 mgr.gibba020.yqfnwy (mgr.34427) 6794 : cluster [DBG] pgmap v3866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:35.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:35 gibba020 bash[25448]: cluster 2021-03-10T16:01:34.035825+0000 mgr.gibba020.yqfnwy (mgr.34427) 6794 : cluster [DBG] pgmap v3866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:37.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:37 gibba013 bash[29418]: cluster 2021-03-10T16:01:36.037496+0000 mgr.gibba020.yqfnwy (mgr.34427) 6795 : cluster [DBG] pgmap v3867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:37.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:37 gibba013 bash[30381]: cluster 2021-03-10T16:01:36.037496+0000 mgr.gibba020.yqfnwy (mgr.34427) 6795 : cluster [DBG] pgmap v3867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:37.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:37 gibba020 bash[25448]: cluster 2021-03-10T16:01:36.037496+0000 mgr.gibba020.yqfnwy (mgr.34427) 6795 : cluster [DBG] pgmap v3867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:39.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:39 gibba013 bash[29418]: cluster 2021-03-10T16:01:38.038755+0000 mgr.gibba020.yqfnwy (mgr.34427) 6796 : cluster [DBG] pgmap v3868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:39.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:39 gibba013 bash[30381]: cluster 2021-03-10T16:01:38.038755+0000 mgr.gibba020.yqfnwy (mgr.34427) 6796 : cluster [DBG] pgmap v3868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:39.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:39 gibba020 bash[25448]: cluster 2021-03-10T16:01:38.038755+0000 mgr.gibba020.yqfnwy (mgr.34427) 6796 : cluster [DBG] pgmap v3868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:41.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:41 gibba013 bash[29418]: cluster 2021-03-10T16:01:40.039713+0000 mgr.gibba020.yqfnwy (mgr.34427) 6797 : cluster [DBG] pgmap v3869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:41.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:41 gibba013 bash[30381]: cluster 2021-03-10T16:01:40.039713+0000 mgr.gibba020.yqfnwy (mgr.34427) 6797 : cluster [DBG] pgmap v3869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:41.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:41 gibba020 bash[25448]: cluster 2021-03-10T16:01:40.039713+0000 mgr.gibba020.yqfnwy (mgr.34427) 6797 : cluster [DBG] pgmap v3869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:43.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:43 gibba013 bash[29418]: cluster 2021-03-10T16:01:42.041119+0000 mgr.gibba020.yqfnwy (mgr.34427) 6798 : cluster [DBG] pgmap v3870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:43.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:43 gibba013 bash[30381]: cluster 2021-03-10T16:01:42.041119+0000 mgr.gibba020.yqfnwy (mgr.34427) 6798 : cluster [DBG] pgmap v3870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:43.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:43 gibba020 bash[25448]: cluster 2021-03-10T16:01:42.041119+0000 mgr.gibba020.yqfnwy (mgr.34427) 6798 : cluster [DBG] pgmap v3870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:45.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:45 gibba020 bash[25448]: cluster 2021-03-10T16:01:44.042745+0000 mgr.gibba020.yqfnwy (mgr.34427) 6799 : cluster [DBG] pgmap v3871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:46.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:45 gibba013 bash[29418]: cluster 2021-03-10T16:01:44.042745+0000 mgr.gibba020.yqfnwy (mgr.34427) 6799 : cluster [DBG] pgmap v3871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:46.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:45 gibba013 bash[30381]: cluster 2021-03-10T16:01:44.042745+0000 mgr.gibba020.yqfnwy (mgr.34427) 6799 : cluster [DBG] pgmap v3871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:47.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:47 gibba020 bash[25448]: cluster 2021-03-10T16:01:46.044546+0000 mgr.gibba020.yqfnwy (mgr.34427) 6800 : cluster [DBG] pgmap v3872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:47.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:47 gibba020 bash[25448]: cephadm 2021-03-10T16:01:46.950223+0000 mgr.gibba020.yqfnwy (mgr.34427) 6801 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:01:48.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:47 gibba013 bash[29418]: cluster 2021-03-10T16:01:46.044546+0000 mgr.gibba020.yqfnwy (mgr.34427) 6800 : cluster [DBG] pgmap v3872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:48.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:47 gibba013 bash[29418]: cephadm 2021-03-10T16:01:46.950223+0000 mgr.gibba020.yqfnwy (mgr.34427) 6801 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:01:48.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:47 gibba013 bash[30381]: cluster 2021-03-10T16:01:46.044546+0000 mgr.gibba020.yqfnwy (mgr.34427) 6800 : cluster [DBG] pgmap v3872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:48.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:47 gibba013 bash[30381]: cephadm 2021-03-10T16:01:46.950223+0000 mgr.gibba020.yqfnwy (mgr.34427) 6801 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:01:49.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:49 gibba020 bash[25448]: cluster 2021-03-10T16:01:48.045007+0000 mgr.gibba020.yqfnwy (mgr.34427) 6802 : cluster [DBG] pgmap v3873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:50.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:49 gibba013 bash[29418]: cluster 2021-03-10T16:01:48.045007+0000 mgr.gibba020.yqfnwy (mgr.34427) 6802 : cluster [DBG] pgmap v3873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:50.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:49 gibba013 bash[30381]: cluster 2021-03-10T16:01:48.045007+0000 mgr.gibba020.yqfnwy (mgr.34427) 6802 : cluster [DBG] pgmap v3873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:51.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:51 gibba020 bash[25448]: cluster 2021-03-10T16:01:50.045742+0000 mgr.gibba020.yqfnwy (mgr.34427) 6803 : cluster [DBG] pgmap v3874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:52.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:51 gibba013 bash[29418]: cluster 2021-03-10T16:01:50.045742+0000 mgr.gibba020.yqfnwy (mgr.34427) 6803 : cluster [DBG] pgmap v3874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:52.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:51 gibba013 bash[30381]: cluster 2021-03-10T16:01:50.045742+0000 mgr.gibba020.yqfnwy (mgr.34427) 6803 : cluster [DBG] pgmap v3874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:53.755 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:01:53.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:53 gibba020 bash[25448]: cluster 2021-03-10T16:01:52.047026+0000 mgr.gibba020.yqfnwy (mgr.34427) 6804 : cluster [DBG] pgmap v3875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:53.983 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:01:53.984 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 116s ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:01:53.984 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 52s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:01:53.984 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 52s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:01:53.984 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 52s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:01:53.985 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 116s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:01:53.985 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 116s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:01:53.985 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 52s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:01:53.985 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 116s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:01:53.986 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 116s ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:01:53.986 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 52s ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:01:53.986 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 116s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:01:53.986 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 116s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:01:53.987 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 116s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:01:53.987 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 116s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:01:53.987 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 52s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:01:53.987 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 52s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:01:53.987 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 52s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:01:53.988 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 52s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:01:53.988 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 52s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:01:53.988 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 52s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:01:54.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:53 gibba013 bash[29418]: cluster 2021-03-10T16:01:52.047026+0000 mgr.gibba020.yqfnwy (mgr.34427) 6804 : cluster [DBG] pgmap v3875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:54.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:53 gibba013 bash[30381]: cluster 2021-03-10T16:01:52.047026+0000 mgr.gibba020.yqfnwy (mgr.34427) 6804 : cluster [DBG] pgmap v3875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:54.232 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:01:54.233 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:01:54.233 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:01:54.233 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:01:54.234 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:01:54.234 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:01:54.234 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:01:54.234 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:01:54.235 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:01:54.235 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:01:54.235 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:01:54.235 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:01:54.236 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:01:54.236 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:01:54.236 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:01:54.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:54 gibba020 bash[25448]: audit 2021-03-10T16:01:53.745318+0000 mgr.gibba020.yqfnwy (mgr.34427) 6805 : audit [DBG] from='client.58609 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:01:54.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:54 gibba020 bash[25448]: audit 2021-03-10T16:01:53.969548+0000 mgr.gibba020.yqfnwy (mgr.34427) 6806 : audit [DBG] from='client.48630 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:01:54.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:54 gibba020 bash[25448]: audit 2021-03-10T16:01:54.232832+0000 mon.a (mon.0) 2608 : audit [DBG] from='client.? 172.21.2.113:0/1912717619' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:55.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:54 gibba013 bash[29418]: audit 2021-03-10T16:01:53.745318+0000 mgr.gibba020.yqfnwy (mgr.34427) 6805 : audit [DBG] from='client.58609 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:01:55.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:54 gibba013 bash[29418]: audit 2021-03-10T16:01:53.969548+0000 mgr.gibba020.yqfnwy (mgr.34427) 6806 : audit [DBG] from='client.48630 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:01:55.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:54 gibba013 bash[29418]: audit 2021-03-10T16:01:54.232832+0000 mon.a (mon.0) 2608 : audit [DBG] from='client.? 172.21.2.113:0/1912717619' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:55.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:54 gibba013 bash[30381]: audit 2021-03-10T16:01:53.745318+0000 mgr.gibba020.yqfnwy (mgr.34427) 6805 : audit [DBG] from='client.58609 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:01:55.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:54 gibba013 bash[30381]: audit 2021-03-10T16:01:53.969548+0000 mgr.gibba020.yqfnwy (mgr.34427) 6806 : audit [DBG] from='client.48630 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:01:55.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:54 gibba013 bash[30381]: audit 2021-03-10T16:01:54.232832+0000 mon.a (mon.0) 2608 : audit [DBG] from='client.? 172.21.2.113:0/1912717619' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:01:55.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:55 gibba020 bash[25448]: cluster 2021-03-10T16:01:54.047995+0000 mgr.gibba020.yqfnwy (mgr.34427) 6807 : cluster [DBG] pgmap v3876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:56.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:55 gibba013 bash[29418]: cluster 2021-03-10T16:01:54.047995+0000 mgr.gibba020.yqfnwy (mgr.34427) 6807 : cluster [DBG] pgmap v3876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:56.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:55 gibba013 bash[30381]: cluster 2021-03-10T16:01:54.047995+0000 mgr.gibba020.yqfnwy (mgr.34427) 6807 : cluster [DBG] pgmap v3876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:57.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:57 gibba020 bash[25448]: cluster 2021-03-10T16:01:56.049754+0000 mgr.gibba020.yqfnwy (mgr.34427) 6808 : cluster [DBG] pgmap v3877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:58.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:57 gibba013 bash[29418]: cluster 2021-03-10T16:01:56.049754+0000 mgr.gibba020.yqfnwy (mgr.34427) 6808 : cluster [DBG] pgmap v3877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:01:58.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:57 gibba013 bash[30381]: cluster 2021-03-10T16:01:56.049754+0000 mgr.gibba020.yqfnwy (mgr.34427) 6808 : cluster [DBG] pgmap v3877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:00.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:01:59 gibba013 bash[29418]: cluster 2021-03-10T16:01:58.050178+0000 mgr.gibba020.yqfnwy (mgr.34427) 6809 : cluster [DBG] pgmap v3878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:00.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:01:59 gibba013 bash[30381]: cluster 2021-03-10T16:01:58.050178+0000 mgr.gibba020.yqfnwy (mgr.34427) 6809 : cluster [DBG] pgmap v3878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:00.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:01:59 gibba020 bash[25448]: cluster 2021-03-10T16:01:58.050178+0000 mgr.gibba020.yqfnwy (mgr.34427) 6809 : cluster [DBG] pgmap v3878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:02.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:01 gibba013 bash[29418]: cluster 2021-03-10T16:02:00.050581+0000 mgr.gibba020.yqfnwy (mgr.34427) 6810 : cluster [DBG] pgmap v3879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:02.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:01 gibba013 bash[30381]: cluster 2021-03-10T16:02:00.050581+0000 mgr.gibba020.yqfnwy (mgr.34427) 6810 : cluster [DBG] pgmap v3879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:02.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:01 gibba020 bash[25448]: cluster 2021-03-10T16:02:00.050581+0000 mgr.gibba020.yqfnwy (mgr.34427) 6810 : cluster [DBG] pgmap v3879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:03.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:02 gibba013 bash[29418]: audit 2021-03-10T16:02:01.962152+0000 mon.a (mon.0) 2609 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:02:03.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:02 gibba013 bash[29418]: cephadm 2021-03-10T16:02:01.966003+0000 mgr.gibba020.yqfnwy (mgr.34427) 6811 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:02:03.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:02 gibba013 bash[29418]: cephadm 2021-03-10T16:02:01.967867+0000 mgr.gibba020.yqfnwy (mgr.34427) 6812 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:02:03.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:02 gibba013 bash[29418]: audit 2021-03-10T16:02:02.185041+0000 mon.a (mon.0) 2610 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:02:03.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:02 gibba013 bash[29418]: audit 2021-03-10T16:02:02.188608+0000 mon.a (mon.0) 2611 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:02:03.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:02 gibba013 bash[29418]: audit 2021-03-10T16:02:02.190364+0000 mon.a (mon.0) 2612 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:03.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:02 gibba013 bash[29418]: audit 2021-03-10T16:02:02.191968+0000 mon.a (mon.0) 2613 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:03.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:02 gibba013 bash[29418]: audit 2021-03-10T16:02:02.193776+0000 mon.a (mon.0) 2614 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:03.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:02 gibba013 bash[29418]: audit 2021-03-10T16:02:02.196907+0000 mon.a (mon.0) 2615 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:03.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:02 gibba013 bash[29418]: audit 2021-03-10T16:02:02.198329+0000 mon.a (mon.0) 2616 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:03.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:02 gibba013 bash[30381]: audit 2021-03-10T16:02:01.962152+0000 mon.a (mon.0) 2609 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:02:03.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:02 gibba013 bash[30381]: cephadm 2021-03-10T16:02:01.966003+0000 mgr.gibba020.yqfnwy (mgr.34427) 6811 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:02:03.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:02 gibba013 bash[30381]: cephadm 2021-03-10T16:02:01.967867+0000 mgr.gibba020.yqfnwy (mgr.34427) 6812 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:02:03.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:02 gibba013 bash[30381]: audit 2021-03-10T16:02:02.185041+0000 mon.a (mon.0) 2610 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:02:03.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:02 gibba013 bash[30381]: audit 2021-03-10T16:02:02.188608+0000 mon.a (mon.0) 2611 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:02:03.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:02 gibba013 bash[30381]: audit 2021-03-10T16:02:02.190364+0000 mon.a (mon.0) 2612 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:03.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:02 gibba013 bash[30381]: audit 2021-03-10T16:02:02.191968+0000 mon.a (mon.0) 2613 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:03.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:02 gibba013 bash[30381]: audit 2021-03-10T16:02:02.193776+0000 mon.a (mon.0) 2614 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:03.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:02 gibba013 bash[30381]: audit 2021-03-10T16:02:02.196907+0000 mon.a (mon.0) 2615 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:03.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:02 gibba013 bash[30381]: audit 2021-03-10T16:02:02.198329+0000 mon.a (mon.0) 2616 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:03.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:02 gibba020 bash[25448]: audit 2021-03-10T16:02:01.962152+0000 mon.a (mon.0) 2609 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:02:03.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:02 gibba020 bash[25448]: cephadm 2021-03-10T16:02:01.966003+0000 mgr.gibba020.yqfnwy (mgr.34427) 6811 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:02:03.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:02 gibba020 bash[25448]: cephadm 2021-03-10T16:02:01.967867+0000 mgr.gibba020.yqfnwy (mgr.34427) 6812 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:02:03.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:02 gibba020 bash[25448]: audit 2021-03-10T16:02:02.185041+0000 mon.a (mon.0) 2610 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:02:03.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:02 gibba020 bash[25448]: audit 2021-03-10T16:02:02.188608+0000 mon.a (mon.0) 2611 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:02:03.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:02 gibba020 bash[25448]: audit 2021-03-10T16:02:02.190364+0000 mon.a (mon.0) 2612 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:03.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:02 gibba020 bash[25448]: audit 2021-03-10T16:02:02.191968+0000 mon.a (mon.0) 2613 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:03.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:02 gibba020 bash[25448]: audit 2021-03-10T16:02:02.193776+0000 mon.a (mon.0) 2614 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:03.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:02 gibba020 bash[25448]: audit 2021-03-10T16:02:02.196907+0000 mon.a (mon.0) 2615 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:03.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:02 gibba020 bash[25448]: audit 2021-03-10T16:02:02.198329+0000 mon.a (mon.0) 2616 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:04.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:03 gibba013 bash[29418]: cluster 2021-03-10T16:02:02.050952+0000 mgr.gibba020.yqfnwy (mgr.34427) 6813 : cluster [DBG] pgmap v3880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:04.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:03 gibba013 bash[29418]: cephadm 2021-03-10T16:02:02.186245+0000 mgr.gibba020.yqfnwy (mgr.34427) 6814 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:02:04.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:03 gibba013 bash[29418]: cephadm 2021-03-10T16:02:02.188577+0000 mgr.gibba020.yqfnwy (mgr.34427) 6815 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:02:04.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:03 gibba013 bash[29418]: cephadm 2021-03-10T16:02:02.189972+0000 mgr.gibba020.yqfnwy (mgr.34427) 6816 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:02:04.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:03 gibba013 bash[29418]: cephadm 2021-03-10T16:02:02.190010+0000 mgr.gibba020.yqfnwy (mgr.34427) 6817 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:02:04.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:03 gibba013 bash[29418]: cephadm 2021-03-10T16:02:02.191868+0000 mgr.gibba020.yqfnwy (mgr.34427) 6818 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:02:04.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:03 gibba013 bash[29418]: cephadm 2021-03-10T16:02:02.191936+0000 mgr.gibba020.yqfnwy (mgr.34427) 6819 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:02:04.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:03 gibba013 bash[29418]: cephadm 2021-03-10T16:02:02.193546+0000 mgr.gibba020.yqfnwy (mgr.34427) 6820 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:02:04.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:03 gibba013 bash[29418]: cephadm 2021-03-10T16:02:02.194949+0000 mgr.gibba020.yqfnwy (mgr.34427) 6821 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:02:04.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:03 gibba013 bash[29418]: cephadm 2021-03-10T16:02:02.194987+0000 mgr.gibba020.yqfnwy (mgr.34427) 6822 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:02:04.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:03 gibba013 bash[29418]: cephadm 2021-03-10T16:02:02.196382+0000 mgr.gibba020.yqfnwy (mgr.34427) 6823 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:02:04.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:03 gibba013 bash[29418]: cephadm 2021-03-10T16:02:02.196700+0000 mgr.gibba020.yqfnwy (mgr.34427) 6824 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:02:04.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:03 gibba013 bash[29418]: cephadm 2021-03-10T16:02:02.198023+0000 mgr.gibba020.yqfnwy (mgr.34427) 6825 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:02:04.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:03 gibba013 bash[29418]: cephadm 2021-03-10T16:02:02.198132+0000 mgr.gibba020.yqfnwy (mgr.34427) 6826 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:02:04.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:03 gibba013 bash[29418]: cephadm 2021-03-10T16:02:02.198248+0000 mgr.gibba020.yqfnwy (mgr.34427) 6827 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:02:04.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:03 gibba013 bash[30381]: cluster 2021-03-10T16:02:02.050952+0000 mgr.gibba020.yqfnwy (mgr.34427) 6813 : cluster [DBG] pgmap v3880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:04.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:03 gibba013 bash[30381]: cephadm 2021-03-10T16:02:02.186245+0000 mgr.gibba020.yqfnwy (mgr.34427) 6814 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:02:04.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:03 gibba013 bash[30381]: cephadm 2021-03-10T16:02:02.188577+0000 mgr.gibba020.yqfnwy (mgr.34427) 6815 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:02:04.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:03 gibba013 bash[30381]: cephadm 2021-03-10T16:02:02.189972+0000 mgr.gibba020.yqfnwy (mgr.34427) 6816 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:02:04.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:03 gibba013 bash[30381]: cephadm 2021-03-10T16:02:02.190010+0000 mgr.gibba020.yqfnwy (mgr.34427) 6817 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:02:04.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:03 gibba013 bash[30381]: cephadm 2021-03-10T16:02:02.191868+0000 mgr.gibba020.yqfnwy (mgr.34427) 6818 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:02:04.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:03 gibba013 bash[30381]: cephadm 2021-03-10T16:02:02.191936+0000 mgr.gibba020.yqfnwy (mgr.34427) 6819 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:02:04.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:03 gibba013 bash[30381]: cephadm 2021-03-10T16:02:02.193546+0000 mgr.gibba020.yqfnwy (mgr.34427) 6820 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:02:04.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:03 gibba013 bash[30381]: cephadm 2021-03-10T16:02:02.194949+0000 mgr.gibba020.yqfnwy (mgr.34427) 6821 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:02:04.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:03 gibba013 bash[30381]: cephadm 2021-03-10T16:02:02.194987+0000 mgr.gibba020.yqfnwy (mgr.34427) 6822 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:02:04.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:03 gibba013 bash[30381]: cephadm 2021-03-10T16:02:02.196382+0000 mgr.gibba020.yqfnwy (mgr.34427) 6823 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:02:04.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:03 gibba013 bash[30381]: cephadm 2021-03-10T16:02:02.196700+0000 mgr.gibba020.yqfnwy (mgr.34427) 6824 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:02:04.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:03 gibba013 bash[30381]: cephadm 2021-03-10T16:02:02.198023+0000 mgr.gibba020.yqfnwy (mgr.34427) 6825 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:02:04.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:03 gibba013 bash[30381]: cephadm 2021-03-10T16:02:02.198132+0000 mgr.gibba020.yqfnwy (mgr.34427) 6826 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:02:04.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:03 gibba013 bash[30381]: cephadm 2021-03-10T16:02:02.198248+0000 mgr.gibba020.yqfnwy (mgr.34427) 6827 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:02:04.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:03 gibba020 bash[25448]: cluster 2021-03-10T16:02:02.050952+0000 mgr.gibba020.yqfnwy (mgr.34427) 6813 : cluster [DBG] pgmap v3880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:04.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:03 gibba020 bash[25448]: cephadm 2021-03-10T16:02:02.186245+0000 mgr.gibba020.yqfnwy (mgr.34427) 6814 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:02:04.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:03 gibba020 bash[25448]: cephadm 2021-03-10T16:02:02.188577+0000 mgr.gibba020.yqfnwy (mgr.34427) 6815 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:02:04.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:03 gibba020 bash[25448]: cephadm 2021-03-10T16:02:02.189972+0000 mgr.gibba020.yqfnwy (mgr.34427) 6816 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:02:04.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:03 gibba020 bash[25448]: cephadm 2021-03-10T16:02:02.190010+0000 mgr.gibba020.yqfnwy (mgr.34427) 6817 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:02:04.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:03 gibba020 bash[25448]: cephadm 2021-03-10T16:02:02.191868+0000 mgr.gibba020.yqfnwy (mgr.34427) 6818 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:02:04.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:03 gibba020 bash[25448]: cephadm 2021-03-10T16:02:02.191936+0000 mgr.gibba020.yqfnwy (mgr.34427) 6819 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:02:04.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:03 gibba020 bash[25448]: cephadm 2021-03-10T16:02:02.193546+0000 mgr.gibba020.yqfnwy (mgr.34427) 6820 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:02:04.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:03 gibba020 bash[25448]: cephadm 2021-03-10T16:02:02.194949+0000 mgr.gibba020.yqfnwy (mgr.34427) 6821 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:02:04.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:03 gibba020 bash[25448]: cephadm 2021-03-10T16:02:02.194987+0000 mgr.gibba020.yqfnwy (mgr.34427) 6822 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:02:04.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:03 gibba020 bash[25448]: cephadm 2021-03-10T16:02:02.196382+0000 mgr.gibba020.yqfnwy (mgr.34427) 6823 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:02:04.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:03 gibba020 bash[25448]: cephadm 2021-03-10T16:02:02.196700+0000 mgr.gibba020.yqfnwy (mgr.34427) 6824 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:02:04.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:03 gibba020 bash[25448]: cephadm 2021-03-10T16:02:02.198023+0000 mgr.gibba020.yqfnwy (mgr.34427) 6825 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:02:04.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:03 gibba020 bash[25448]: cephadm 2021-03-10T16:02:02.198132+0000 mgr.gibba020.yqfnwy (mgr.34427) 6826 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:02:04.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:03 gibba020 bash[25448]: cephadm 2021-03-10T16:02:02.198248+0000 mgr.gibba020.yqfnwy (mgr.34427) 6827 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:02:06.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:05 gibba013 bash[29418]: cluster 2021-03-10T16:02:04.052281+0000 mgr.gibba020.yqfnwy (mgr.34427) 6828 : cluster [DBG] pgmap v3881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:06.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:05 gibba013 bash[30381]: cluster 2021-03-10T16:02:04.052281+0000 mgr.gibba020.yqfnwy (mgr.34427) 6828 : cluster [DBG] pgmap v3881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:06.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:05 gibba020 bash[25448]: cluster 2021-03-10T16:02:04.052281+0000 mgr.gibba020.yqfnwy (mgr.34427) 6828 : cluster [DBG] pgmap v3881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:07.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:06 gibba013 bash[29418]: audit 2021-03-10T16:02:06.621151+0000 mon.a (mon.0) 2617 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:02:07.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:06 gibba013 bash[29418]: audit 2021-03-10T16:02:06.691317+0000 mon.a (mon.0) 2618 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:02:07.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:06 gibba013 bash[30381]: audit 2021-03-10T16:02:06.621151+0000 mon.a (mon.0) 2617 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:02:07.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:06 gibba013 bash[30381]: audit 2021-03-10T16:02:06.691317+0000 mon.a (mon.0) 2618 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:02:07.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:06 gibba020 bash[25448]: audit 2021-03-10T16:02:06.621151+0000 mon.a (mon.0) 2617 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:02:07.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:06 gibba020 bash[25448]: audit 2021-03-10T16:02:06.691317+0000 mon.a (mon.0) 2618 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:02:08.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:07 gibba013 bash[29418]: cluster 2021-03-10T16:02:06.054128+0000 mgr.gibba020.yqfnwy (mgr.34427) 6829 : cluster [DBG] pgmap v3882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:08.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:07 gibba013 bash[29418]: audit 2021-03-10T16:02:06.885736+0000 mon.a (mon.0) 2619 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T16:02:08.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:07 gibba013 bash[29418]: audit 2021-03-10T16:02:06.886873+0000 mon.a (mon.0) 2620 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:02:08.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:07 gibba013 bash[29418]: audit 2021-03-10T16:02:06.887935+0000 mon.a (mon.0) 2621 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:02:08.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:07 gibba013 bash[29418]: audit 2021-03-10T16:02:06.888987+0000 mon.a (mon.0) 2622 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:02:08.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:07 gibba013 bash[30381]: cluster 2021-03-10T16:02:06.054128+0000 mgr.gibba020.yqfnwy (mgr.34427) 6829 : cluster [DBG] pgmap v3882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:08.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:07 gibba013 bash[30381]: audit 2021-03-10T16:02:06.885736+0000 mon.a (mon.0) 2619 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T16:02:08.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:07 gibba013 bash[30381]: audit 2021-03-10T16:02:06.886873+0000 mon.a (mon.0) 2620 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:02:08.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:07 gibba013 bash[30381]: audit 2021-03-10T16:02:06.887935+0000 mon.a (mon.0) 2621 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:02:08.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:07 gibba013 bash[30381]: audit 2021-03-10T16:02:06.888987+0000 mon.a (mon.0) 2622 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:02:08.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:07 gibba020 bash[25448]: cluster 2021-03-10T16:02:06.054128+0000 mgr.gibba020.yqfnwy (mgr.34427) 6829 : cluster [DBG] pgmap v3882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:08.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:07 gibba020 bash[25448]: audit 2021-03-10T16:02:06.885736+0000 mon.a (mon.0) 2619 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T16:02:08.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:07 gibba020 bash[25448]: audit 2021-03-10T16:02:06.886873+0000 mon.a (mon.0) 2620 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:02:08.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:07 gibba020 bash[25448]: audit 2021-03-10T16:02:06.887935+0000 mon.a (mon.0) 2621 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:02:08.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:07 gibba020 bash[25448]: audit 2021-03-10T16:02:06.888987+0000 mon.a (mon.0) 2622 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:02:10.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:09 gibba013 bash[29418]: cluster 2021-03-10T16:02:08.054530+0000 mgr.gibba020.yqfnwy (mgr.34427) 6830 : cluster [DBG] pgmap v3883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:10.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:09 gibba013 bash[30381]: cluster 2021-03-10T16:02:08.054530+0000 mgr.gibba020.yqfnwy (mgr.34427) 6830 : cluster [DBG] pgmap v3883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:10.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:09 gibba020 bash[25448]: cluster 2021-03-10T16:02:08.054530+0000 mgr.gibba020.yqfnwy (mgr.34427) 6830 : cluster [DBG] pgmap v3883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:12.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:11 gibba013 bash[29418]: cluster 2021-03-10T16:02:10.055373+0000 mgr.gibba020.yqfnwy (mgr.34427) 6831 : cluster [DBG] pgmap v3884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:12.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:11 gibba013 bash[30381]: cluster 2021-03-10T16:02:10.055373+0000 mgr.gibba020.yqfnwy (mgr.34427) 6831 : cluster [DBG] pgmap v3884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:12.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:11 gibba020 bash[25448]: cluster 2021-03-10T16:02:10.055373+0000 mgr.gibba020.yqfnwy (mgr.34427) 6831 : cluster [DBG] pgmap v3884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:14.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:13 gibba013 bash[29418]: cluster 2021-03-10T16:02:12.056840+0000 mgr.gibba020.yqfnwy (mgr.34427) 6832 : cluster [DBG] pgmap v3885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:14.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:13 gibba013 bash[30381]: cluster 2021-03-10T16:02:12.056840+0000 mgr.gibba020.yqfnwy (mgr.34427) 6832 : cluster [DBG] pgmap v3885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:14.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:13 gibba020 bash[25448]: cluster 2021-03-10T16:02:12.056840+0000 mgr.gibba020.yqfnwy (mgr.34427) 6832 : cluster [DBG] pgmap v3885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:16.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:15 gibba013 bash[29418]: cluster 2021-03-10T16:02:14.058389+0000 mgr.gibba020.yqfnwy (mgr.34427) 6833 : cluster [DBG] pgmap v3886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:16.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:15 gibba013 bash[30381]: cluster 2021-03-10T16:02:14.058389+0000 mgr.gibba020.yqfnwy (mgr.34427) 6833 : cluster [DBG] pgmap v3886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:16.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:15 gibba020 bash[25448]: cluster 2021-03-10T16:02:14.058389+0000 mgr.gibba020.yqfnwy (mgr.34427) 6833 : cluster [DBG] pgmap v3886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:18.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:17 gibba013 bash[29418]: cluster 2021-03-10T16:02:16.060292+0000 mgr.gibba020.yqfnwy (mgr.34427) 6834 : cluster [DBG] pgmap v3887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:18.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:17 gibba013 bash[30381]: cluster 2021-03-10T16:02:16.060292+0000 mgr.gibba020.yqfnwy (mgr.34427) 6834 : cluster [DBG] pgmap v3887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:18.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:17 gibba020 bash[25448]: cluster 2021-03-10T16:02:16.060292+0000 mgr.gibba020.yqfnwy (mgr.34427) 6834 : cluster [DBG] pgmap v3887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:19.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:18 gibba013 bash[29418]: cephadm 2021-03-10T16:02:17.213871+0000 mgr.gibba020.yqfnwy (mgr.34427) 6835 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:02:19.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:18 gibba013 bash[30381]: cephadm 2021-03-10T16:02:17.213871+0000 mgr.gibba020.yqfnwy (mgr.34427) 6835 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:02:19.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:18 gibba020 bash[25448]: cephadm 2021-03-10T16:02:17.213871+0000 mgr.gibba020.yqfnwy (mgr.34427) 6835 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:02:20.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:19 gibba013 bash[29418]: cluster 2021-03-10T16:02:18.060744+0000 mgr.gibba020.yqfnwy (mgr.34427) 6836 : cluster [DBG] pgmap v3888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:20.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:19 gibba013 bash[30381]: cluster 2021-03-10T16:02:18.060744+0000 mgr.gibba020.yqfnwy (mgr.34427) 6836 : cluster [DBG] pgmap v3888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:20.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:19 gibba020 bash[25448]: cluster 2021-03-10T16:02:18.060744+0000 mgr.gibba020.yqfnwy (mgr.34427) 6836 : cluster [DBG] pgmap v3888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:22.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:21 gibba013 bash[29418]: cluster 2021-03-10T16:02:20.061411+0000 mgr.gibba020.yqfnwy (mgr.34427) 6837 : cluster [DBG] pgmap v3889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:22.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:21 gibba013 bash[30381]: cluster 2021-03-10T16:02:20.061411+0000 mgr.gibba020.yqfnwy (mgr.34427) 6837 : cluster [DBG] pgmap v3889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:22.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:21 gibba020 bash[25448]: cluster 2021-03-10T16:02:20.061411+0000 mgr.gibba020.yqfnwy (mgr.34427) 6837 : cluster [DBG] pgmap v3889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:24.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:23 gibba013 bash[29418]: cluster 2021-03-10T16:02:22.062908+0000 mgr.gibba020.yqfnwy (mgr.34427) 6838 : cluster [DBG] pgmap v3890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:24.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:23 gibba013 bash[30381]: cluster 2021-03-10T16:02:22.062908+0000 mgr.gibba020.yqfnwy (mgr.34427) 6838 : cluster [DBG] pgmap v3890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:24.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:23 gibba020 bash[25448]: cluster 2021-03-10T16:02:22.062908+0000 mgr.gibba020.yqfnwy (mgr.34427) 6838 : cluster [DBG] pgmap v3890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:24.474 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:02:24.701 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:02:24.702 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 2m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:02:24.702 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 82s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:02:24.702 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 82s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:02:24.702 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 82s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:02:24.703 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:02:24.703 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:02:24.703 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 82s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:02:24.703 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:02:24.703 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:02:24.704 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 82s ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:02:24.704 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:02:24.704 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:02:24.704 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:02:24.705 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:02:24.705 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 82s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:02:24.705 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 82s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:02:24.705 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 82s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:02:24.705 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 82s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:02:24.706 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 82s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:02:24.706 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 82s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:02:24.950 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:02:24.950 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:02:24.951 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:02:24.951 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:02:24.951 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:02:24.951 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:02:24.951 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:02:24.952 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:02:24.952 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:02:24.952 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:02:24.952 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:02:24.953 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:02:24.953 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:02:24.953 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:02:24.953 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:02:26.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:25 gibba013 bash[29418]: cluster 2021-03-10T16:02:24.064634+0000 mgr.gibba020.yqfnwy (mgr.34427) 6839 : cluster [DBG] pgmap v3891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:26.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:25 gibba013 bash[29418]: audit 2021-03-10T16:02:24.464271+0000 mgr.gibba020.yqfnwy (mgr.34427) 6840 : audit [DBG] from='client.58627 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:02:26.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:25 gibba013 bash[29418]: audit 2021-03-10T16:02:24.687289+0000 mgr.gibba020.yqfnwy (mgr.34427) 6841 : audit [DBG] from='client.48648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:02:26.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:25 gibba013 bash[29418]: audit 2021-03-10T16:02:24.950160+0000 mon.c (mon.1) 112 : audit [DBG] from='client.? 172.21.2.113:0/3598582059' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:26.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:25 gibba013 bash[30381]: cluster 2021-03-10T16:02:24.064634+0000 mgr.gibba020.yqfnwy (mgr.34427) 6839 : cluster [DBG] pgmap v3891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:26.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:25 gibba013 bash[30381]: audit 2021-03-10T16:02:24.464271+0000 mgr.gibba020.yqfnwy (mgr.34427) 6840 : audit [DBG] from='client.58627 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:02:26.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:25 gibba013 bash[30381]: audit 2021-03-10T16:02:24.687289+0000 mgr.gibba020.yqfnwy (mgr.34427) 6841 : audit [DBG] from='client.48648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:02:26.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:25 gibba013 bash[30381]: audit 2021-03-10T16:02:24.950160+0000 mon.c (mon.1) 112 : audit [DBG] from='client.? 172.21.2.113:0/3598582059' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:26.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:25 gibba020 bash[25448]: cluster 2021-03-10T16:02:24.064634+0000 mgr.gibba020.yqfnwy (mgr.34427) 6839 : cluster [DBG] pgmap v3891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:26.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:25 gibba020 bash[25448]: audit 2021-03-10T16:02:24.464271+0000 mgr.gibba020.yqfnwy (mgr.34427) 6840 : audit [DBG] from='client.58627 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:02:26.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:25 gibba020 bash[25448]: audit 2021-03-10T16:02:24.687289+0000 mgr.gibba020.yqfnwy (mgr.34427) 6841 : audit [DBG] from='client.48648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:02:26.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:25 gibba020 bash[25448]: audit 2021-03-10T16:02:24.950160+0000 mon.c (mon.1) 112 : audit [DBG] from='client.? 172.21.2.113:0/3598582059' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:28.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:27 gibba013 bash[29418]: cluster 2021-03-10T16:02:26.066364+0000 mgr.gibba020.yqfnwy (mgr.34427) 6842 : cluster [DBG] pgmap v3892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:28.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:27 gibba013 bash[30381]: cluster 2021-03-10T16:02:26.066364+0000 mgr.gibba020.yqfnwy (mgr.34427) 6842 : cluster [DBG] pgmap v3892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:28.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:27 gibba020 bash[25448]: cluster 2021-03-10T16:02:26.066364+0000 mgr.gibba020.yqfnwy (mgr.34427) 6842 : cluster [DBG] pgmap v3892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:30.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:29 gibba013 bash[29418]: cluster 2021-03-10T16:02:28.067463+0000 mgr.gibba020.yqfnwy (mgr.34427) 6843 : cluster [DBG] pgmap v3893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:30.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:29 gibba013 bash[30381]: cluster 2021-03-10T16:02:28.067463+0000 mgr.gibba020.yqfnwy (mgr.34427) 6843 : cluster [DBG] pgmap v3893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:30.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:29 gibba020 bash[25448]: cluster 2021-03-10T16:02:28.067463+0000 mgr.gibba020.yqfnwy (mgr.34427) 6843 : cluster [DBG] pgmap v3893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:32.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:31 gibba013 bash[29418]: cluster 2021-03-10T16:02:30.069369+0000 mgr.gibba020.yqfnwy (mgr.34427) 6844 : cluster [DBG] pgmap v3894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:32.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:31 gibba013 bash[30381]: cluster 2021-03-10T16:02:30.069369+0000 mgr.gibba020.yqfnwy (mgr.34427) 6844 : cluster [DBG] pgmap v3894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:32.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:31 gibba020 bash[25448]: cluster 2021-03-10T16:02:30.069369+0000 mgr.gibba020.yqfnwy (mgr.34427) 6844 : cluster [DBG] pgmap v3894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:34.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:33 gibba013 bash[29418]: cluster 2021-03-10T16:02:32.070745+0000 mgr.gibba020.yqfnwy (mgr.34427) 6845 : cluster [DBG] pgmap v3895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:34.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:33 gibba013 bash[29418]: cephadm 2021-03-10T16:02:32.229681+0000 mgr.gibba020.yqfnwy (mgr.34427) 6846 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:02:34.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:33 gibba013 bash[30381]: cluster 2021-03-10T16:02:32.070745+0000 mgr.gibba020.yqfnwy (mgr.34427) 6845 : cluster [DBG] pgmap v3895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:34.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:33 gibba013 bash[30381]: cephadm 2021-03-10T16:02:32.229681+0000 mgr.gibba020.yqfnwy (mgr.34427) 6846 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:02:34.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:33 gibba020 bash[25448]: cluster 2021-03-10T16:02:32.070745+0000 mgr.gibba020.yqfnwy (mgr.34427) 6845 : cluster [DBG] pgmap v3895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:34.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:33 gibba020 bash[25448]: cephadm 2021-03-10T16:02:32.229681+0000 mgr.gibba020.yqfnwy (mgr.34427) 6846 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:02:36.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:35 gibba020 bash[25448]: cluster 2021-03-10T16:02:34.072386+0000 mgr.gibba020.yqfnwy (mgr.34427) 6847 : cluster [DBG] pgmap v3896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:36.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:35 gibba013 bash[29418]: cluster 2021-03-10T16:02:34.072386+0000 mgr.gibba020.yqfnwy (mgr.34427) 6847 : cluster [DBG] pgmap v3896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:36.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:35 gibba013 bash[30381]: cluster 2021-03-10T16:02:34.072386+0000 mgr.gibba020.yqfnwy (mgr.34427) 6847 : cluster [DBG] pgmap v3896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:38.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:37 gibba020 bash[25448]: cluster 2021-03-10T16:02:36.074296+0000 mgr.gibba020.yqfnwy (mgr.34427) 6848 : cluster [DBG] pgmap v3897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:38.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:37 gibba013 bash[29418]: cluster 2021-03-10T16:02:36.074296+0000 mgr.gibba020.yqfnwy (mgr.34427) 6848 : cluster [DBG] pgmap v3897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:38.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:37 gibba013 bash[30381]: cluster 2021-03-10T16:02:36.074296+0000 mgr.gibba020.yqfnwy (mgr.34427) 6848 : cluster [DBG] pgmap v3897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:40.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:39 gibba020 bash[25448]: cluster 2021-03-10T16:02:38.074821+0000 mgr.gibba020.yqfnwy (mgr.34427) 6849 : cluster [DBG] pgmap v3898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:40.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:39 gibba013 bash[29418]: cluster 2021-03-10T16:02:38.074821+0000 mgr.gibba020.yqfnwy (mgr.34427) 6849 : cluster [DBG] pgmap v3898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:40.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:39 gibba013 bash[30381]: cluster 2021-03-10T16:02:38.074821+0000 mgr.gibba020.yqfnwy (mgr.34427) 6849 : cluster [DBG] pgmap v3898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:42.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:41 gibba020 bash[25448]: cluster 2021-03-10T16:02:40.076353+0000 mgr.gibba020.yqfnwy (mgr.34427) 6850 : cluster [DBG] pgmap v3899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:42.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:41 gibba013 bash[29418]: cluster 2021-03-10T16:02:40.076353+0000 mgr.gibba020.yqfnwy (mgr.34427) 6850 : cluster [DBG] pgmap v3899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:42.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:41 gibba013 bash[30381]: cluster 2021-03-10T16:02:40.076353+0000 mgr.gibba020.yqfnwy (mgr.34427) 6850 : cluster [DBG] pgmap v3899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:44.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:43 gibba020 bash[25448]: cluster 2021-03-10T16:02:42.077680+0000 mgr.gibba020.yqfnwy (mgr.34427) 6851 : cluster [DBG] pgmap v3900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:44.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:43 gibba013 bash[29418]: cluster 2021-03-10T16:02:42.077680+0000 mgr.gibba020.yqfnwy (mgr.34427) 6851 : cluster [DBG] pgmap v3900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:44.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:43 gibba013 bash[30381]: cluster 2021-03-10T16:02:42.077680+0000 mgr.gibba020.yqfnwy (mgr.34427) 6851 : cluster [DBG] pgmap v3900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:46.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:45 gibba020 bash[25448]: cluster 2021-03-10T16:02:44.079372+0000 mgr.gibba020.yqfnwy (mgr.34427) 6852 : cluster [DBG] pgmap v3901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:46.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:45 gibba013 bash[29418]: cluster 2021-03-10T16:02:44.079372+0000 mgr.gibba020.yqfnwy (mgr.34427) 6852 : cluster [DBG] pgmap v3901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:46.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:45 gibba013 bash[30381]: cluster 2021-03-10T16:02:44.079372+0000 mgr.gibba020.yqfnwy (mgr.34427) 6852 : cluster [DBG] pgmap v3901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:48.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:47 gibba020 bash[25448]: cluster 2021-03-10T16:02:46.080999+0000 mgr.gibba020.yqfnwy (mgr.34427) 6853 : cluster [DBG] pgmap v3902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:48.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:47 gibba013 bash[29418]: cluster 2021-03-10T16:02:46.080999+0000 mgr.gibba020.yqfnwy (mgr.34427) 6853 : cluster [DBG] pgmap v3902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:48.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:47 gibba013 bash[30381]: cluster 2021-03-10T16:02:46.080999+0000 mgr.gibba020.yqfnwy (mgr.34427) 6853 : cluster [DBG] pgmap v3902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:49.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:48 gibba013 bash[29418]: cephadm 2021-03-10T16:02:47.245308+0000 mgr.gibba020.yqfnwy (mgr.34427) 6854 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:02:49.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:48 gibba013 bash[30381]: cephadm 2021-03-10T16:02:47.245308+0000 mgr.gibba020.yqfnwy (mgr.34427) 6854 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:02:49.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:48 gibba020 bash[25448]: cephadm 2021-03-10T16:02:47.245308+0000 mgr.gibba020.yqfnwy (mgr.34427) 6854 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:02:50.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:49 gibba013 bash[29418]: cluster 2021-03-10T16:02:48.081580+0000 mgr.gibba020.yqfnwy (mgr.34427) 6855 : cluster [DBG] pgmap v3903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:50.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:49 gibba013 bash[30381]: cluster 2021-03-10T16:02:48.081580+0000 mgr.gibba020.yqfnwy (mgr.34427) 6855 : cluster [DBG] pgmap v3903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:50.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:49 gibba020 bash[25448]: cluster 2021-03-10T16:02:48.081580+0000 mgr.gibba020.yqfnwy (mgr.34427) 6855 : cluster [DBG] pgmap v3903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:52.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:51 gibba013 bash[29418]: cluster 2021-03-10T16:02:50.083226+0000 mgr.gibba020.yqfnwy (mgr.34427) 6856 : cluster [DBG] pgmap v3904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:52.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:51 gibba013 bash[30381]: cluster 2021-03-10T16:02:50.083226+0000 mgr.gibba020.yqfnwy (mgr.34427) 6856 : cluster [DBG] pgmap v3904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:52.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:51 gibba020 bash[25448]: cluster 2021-03-10T16:02:50.083226+0000 mgr.gibba020.yqfnwy (mgr.34427) 6856 : cluster [DBG] pgmap v3904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:54.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:53 gibba013 bash[29418]: cluster 2021-03-10T16:02:52.084801+0000 mgr.gibba020.yqfnwy (mgr.34427) 6857 : cluster [DBG] pgmap v3905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:54.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:53 gibba013 bash[30381]: cluster 2021-03-10T16:02:52.084801+0000 mgr.gibba020.yqfnwy (mgr.34427) 6857 : cluster [DBG] pgmap v3905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:54.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:53 gibba020 bash[25448]: cluster 2021-03-10T16:02:52.084801+0000 mgr.gibba020.yqfnwy (mgr.34427) 6857 : cluster [DBG] pgmap v3905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:55.194 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:02:55.423 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:02:55.423 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 2m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:02:55.423 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 113s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:02:55.424 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 113s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:02:55.424 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 113s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:02:55.424 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:02:55.424 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:02:55.424 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 113s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:02:55.425 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:02:55.425 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:02:55.425 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 113s ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:02:55.425 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:02:55.426 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:02:55.426 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:02:55.426 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:02:55.426 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 113s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:02:55.426 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 113s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:02:55.427 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 113s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:02:55.427 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 113s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:02:55.427 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 113s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:02:55.427 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 113s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:02:55.671 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:02:55.672 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:02:55.672 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:02:55.672 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:02:55.672 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:02:55.673 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:02:55.673 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:02:55.673 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:02:55.673 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:02:55.674 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:02:55.674 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:02:55.674 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:02:55.674 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:02:55.674 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:02:55.675 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:02:56.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:55 gibba013 bash[29418]: cluster 2021-03-10T16:02:54.085972+0000 mgr.gibba020.yqfnwy (mgr.34427) 6858 : cluster [DBG] pgmap v3906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:56.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:55 gibba013 bash[29418]: audit 2021-03-10T16:02:55.671679+0000 mon.a (mon.0) 2623 : audit [DBG] from='client.? 172.21.2.113:0/319505403' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:56.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:55 gibba013 bash[30381]: cluster 2021-03-10T16:02:54.085972+0000 mgr.gibba020.yqfnwy (mgr.34427) 6858 : cluster [DBG] pgmap v3906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:56.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:55 gibba013 bash[30381]: audit 2021-03-10T16:02:55.671679+0000 mon.a (mon.0) 2623 : audit [DBG] from='client.? 172.21.2.113:0/319505403' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:56.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:55 gibba020 bash[25448]: cluster 2021-03-10T16:02:54.085972+0000 mgr.gibba020.yqfnwy (mgr.34427) 6858 : cluster [DBG] pgmap v3906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:56.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:55 gibba020 bash[25448]: audit 2021-03-10T16:02:55.671679+0000 mon.a (mon.0) 2623 : audit [DBG] from='client.? 172.21.2.113:0/319505403' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:02:57.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:56 gibba013 bash[29418]: audit 2021-03-10T16:02:55.184433+0000 mgr.gibba020.yqfnwy (mgr.34427) 6859 : audit [DBG] from='client.48660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:02:57.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:56 gibba013 bash[29418]: audit 2021-03-10T16:02:55.409075+0000 mgr.gibba020.yqfnwy (mgr.34427) 6860 : audit [DBG] from='client.48666 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:02:57.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:56 gibba013 bash[30381]: audit 2021-03-10T16:02:55.184433+0000 mgr.gibba020.yqfnwy (mgr.34427) 6859 : audit [DBG] from='client.48660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:02:57.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:56 gibba013 bash[30381]: audit 2021-03-10T16:02:55.409075+0000 mgr.gibba020.yqfnwy (mgr.34427) 6860 : audit [DBG] from='client.48666 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:02:57.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:56 gibba020 bash[25448]: audit 2021-03-10T16:02:55.184433+0000 mgr.gibba020.yqfnwy (mgr.34427) 6859 : audit [DBG] from='client.48660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:02:57.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:56 gibba020 bash[25448]: audit 2021-03-10T16:02:55.409075+0000 mgr.gibba020.yqfnwy (mgr.34427) 6860 : audit [DBG] from='client.48666 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:02:58.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:02:58 gibba013 bash[29418]: cluster 2021-03-10T16:02:56.087669+0000 mgr.gibba020.yqfnwy (mgr.34427) 6861 : cluster [DBG] pgmap v3907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:58.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:02:58 gibba013 bash[30381]: cluster 2021-03-10T16:02:56.087669+0000 mgr.gibba020.yqfnwy (mgr.34427) 6861 : cluster [DBG] pgmap v3907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:02:58.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:02:58 gibba020 bash[25448]: cluster 2021-03-10T16:02:56.087669+0000 mgr.gibba020.yqfnwy (mgr.34427) 6861 : cluster [DBG] pgmap v3907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:00.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:00 gibba013 bash[29418]: cluster 2021-03-10T16:02:58.088793+0000 mgr.gibba020.yqfnwy (mgr.34427) 6862 : cluster [DBG] pgmap v3908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:00.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:00 gibba013 bash[30381]: cluster 2021-03-10T16:02:58.088793+0000 mgr.gibba020.yqfnwy (mgr.34427) 6862 : cluster [DBG] pgmap v3908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:00.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:00 gibba020 bash[25448]: cluster 2021-03-10T16:02:58.088793+0000 mgr.gibba020.yqfnwy (mgr.34427) 6862 : cluster [DBG] pgmap v3908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:02.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:02 gibba013 bash[29418]: cluster 2021-03-10T16:03:00.089399+0000 mgr.gibba020.yqfnwy (mgr.34427) 6863 : cluster [DBG] pgmap v3909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:02.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:02 gibba013 bash[30381]: cluster 2021-03-10T16:03:00.089399+0000 mgr.gibba020.yqfnwy (mgr.34427) 6863 : cluster [DBG] pgmap v3909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:02.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:02 gibba020 bash[25448]: cluster 2021-03-10T16:03:00.089399+0000 mgr.gibba020.yqfnwy (mgr.34427) 6863 : cluster [DBG] pgmap v3909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:03.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:03 gibba013 bash[29418]: audit 2021-03-10T16:03:02.258756+0000 mon.a (mon.0) 2624 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:03:03.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:03 gibba013 bash[29418]: audit 2021-03-10T16:03:02.484510+0000 mon.a (mon.0) 2625 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:03:03.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:03 gibba013 bash[29418]: audit 2021-03-10T16:03:02.487854+0000 mon.a (mon.0) 2626 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:03:03.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:03 gibba013 bash[29418]: audit 2021-03-10T16:03:02.489524+0000 mon.a (mon.0) 2627 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:03.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:03 gibba013 bash[29418]: audit 2021-03-10T16:03:02.491111+0000 mon.a (mon.0) 2628 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:03.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:03 gibba013 bash[29418]: audit 2021-03-10T16:03:02.492509+0000 mon.a (mon.0) 2629 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:03.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:03 gibba013 bash[29418]: audit 2021-03-10T16:03:02.495752+0000 mon.a (mon.0) 2630 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:03.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:03 gibba013 bash[29418]: audit 2021-03-10T16:03:02.497467+0000 mon.a (mon.0) 2631 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:03.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:03 gibba013 bash[30381]: audit 2021-03-10T16:03:02.258756+0000 mon.a (mon.0) 2624 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:03:03.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:03 gibba013 bash[30381]: audit 2021-03-10T16:03:02.484510+0000 mon.a (mon.0) 2625 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:03:03.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:03 gibba013 bash[30381]: audit 2021-03-10T16:03:02.487854+0000 mon.a (mon.0) 2626 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:03:03.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:03 gibba013 bash[30381]: audit 2021-03-10T16:03:02.489524+0000 mon.a (mon.0) 2627 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:03.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:03 gibba013 bash[30381]: audit 2021-03-10T16:03:02.491111+0000 mon.a (mon.0) 2628 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:03.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:03 gibba013 bash[30381]: audit 2021-03-10T16:03:02.492509+0000 mon.a (mon.0) 2629 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:03.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:03 gibba013 bash[30381]: audit 2021-03-10T16:03:02.495752+0000 mon.a (mon.0) 2630 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:03.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:03 gibba013 bash[30381]: audit 2021-03-10T16:03:02.497467+0000 mon.a (mon.0) 2631 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:03.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:03 gibba020 bash[25448]: audit 2021-03-10T16:03:02.258756+0000 mon.a (mon.0) 2624 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:03:03.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:03 gibba020 bash[25448]: audit 2021-03-10T16:03:02.484510+0000 mon.a (mon.0) 2625 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:03:03.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:03 gibba020 bash[25448]: audit 2021-03-10T16:03:02.487854+0000 mon.a (mon.0) 2626 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:03:03.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:03 gibba020 bash[25448]: audit 2021-03-10T16:03:02.489524+0000 mon.a (mon.0) 2627 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:03.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:03 gibba020 bash[25448]: audit 2021-03-10T16:03:02.491111+0000 mon.a (mon.0) 2628 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:03.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:03 gibba020 bash[25448]: audit 2021-03-10T16:03:02.492509+0000 mon.a (mon.0) 2629 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:03.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:03 gibba020 bash[25448]: audit 2021-03-10T16:03:02.495752+0000 mon.a (mon.0) 2630 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:03.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:03 gibba020 bash[25448]: audit 2021-03-10T16:03:02.497467+0000 mon.a (mon.0) 2631 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:04.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:04 gibba013 bash[29418]: cluster 2021-03-10T16:03:02.090056+0000 mgr.gibba020.yqfnwy (mgr.34427) 6864 : cluster [DBG] pgmap v3910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:04.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:04 gibba013 bash[29418]: cephadm 2021-03-10T16:03:02.261938+0000 mgr.gibba020.yqfnwy (mgr.34427) 6865 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:03:04.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:04 gibba013 bash[29418]: cephadm 2021-03-10T16:03:02.263747+0000 mgr.gibba020.yqfnwy (mgr.34427) 6866 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:03:04.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:04 gibba013 bash[29418]: cephadm 2021-03-10T16:03:02.485637+0000 mgr.gibba020.yqfnwy (mgr.34427) 6867 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:03:04.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:04 gibba013 bash[29418]: cephadm 2021-03-10T16:03:02.487701+0000 mgr.gibba020.yqfnwy (mgr.34427) 6868 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:03:04.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:04 gibba013 bash[29418]: cephadm 2021-03-10T16:03:02.489260+0000 mgr.gibba020.yqfnwy (mgr.34427) 6869 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:03:04.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:04 gibba013 bash[29418]: cephadm 2021-03-10T16:03:02.489296+0000 mgr.gibba020.yqfnwy (mgr.34427) 6870 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:03:04.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:04 gibba013 bash[29418]: cephadm 2021-03-10T16:03:02.490702+0000 mgr.gibba020.yqfnwy (mgr.34427) 6871 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:03:04.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:04 gibba013 bash[29418]: cephadm 2021-03-10T16:03:02.490742+0000 mgr.gibba020.yqfnwy (mgr.34427) 6872 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:03:04.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:04 gibba013 bash[29418]: cephadm 2021-03-10T16:03:02.492218+0000 mgr.gibba020.yqfnwy (mgr.34427) 6873 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:03:04.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:04 gibba013 bash[29418]: cephadm 2021-03-10T16:03:02.493811+0000 mgr.gibba020.yqfnwy (mgr.34427) 6874 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:03:04.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:04 gibba013 bash[29418]: cephadm 2021-03-10T16:03:02.493849+0000 mgr.gibba020.yqfnwy (mgr.34427) 6875 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:03:04.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:04 gibba013 bash[29418]: cephadm 2021-03-10T16:03:02.495386+0000 mgr.gibba020.yqfnwy (mgr.34427) 6876 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:03:04.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:04 gibba013 bash[29418]: cephadm 2021-03-10T16:03:02.495703+0000 mgr.gibba020.yqfnwy (mgr.34427) 6877 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:03:04.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:04 gibba013 bash[29418]: cephadm 2021-03-10T16:03:02.497135+0000 mgr.gibba020.yqfnwy (mgr.34427) 6878 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:03:04.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:04 gibba013 bash[29418]: cephadm 2021-03-10T16:03:02.497171+0000 mgr.gibba020.yqfnwy (mgr.34427) 6879 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:03:04.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:04 gibba013 bash[29418]: cephadm 2021-03-10T16:03:02.497274+0000 mgr.gibba020.yqfnwy (mgr.34427) 6880 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:03:04.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:04 gibba013 bash[30381]: cluster 2021-03-10T16:03:02.090056+0000 mgr.gibba020.yqfnwy (mgr.34427) 6864 : cluster [DBG] pgmap v3910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:04.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:04 gibba013 bash[30381]: cephadm 2021-03-10T16:03:02.261938+0000 mgr.gibba020.yqfnwy (mgr.34427) 6865 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:03:04.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:04 gibba013 bash[30381]: cephadm 2021-03-10T16:03:02.263747+0000 mgr.gibba020.yqfnwy (mgr.34427) 6866 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:03:04.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:04 gibba013 bash[30381]: cephadm 2021-03-10T16:03:02.485637+0000 mgr.gibba020.yqfnwy (mgr.34427) 6867 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:03:04.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:04 gibba013 bash[30381]: cephadm 2021-03-10T16:03:02.487701+0000 mgr.gibba020.yqfnwy (mgr.34427) 6868 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:03:04.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:04 gibba013 bash[30381]: cephadm 2021-03-10T16:03:02.489260+0000 mgr.gibba020.yqfnwy (mgr.34427) 6869 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:03:04.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:04 gibba013 bash[30381]: cephadm 2021-03-10T16:03:02.489296+0000 mgr.gibba020.yqfnwy (mgr.34427) 6870 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:03:04.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:04 gibba013 bash[30381]: cephadm 2021-03-10T16:03:02.490702+0000 mgr.gibba020.yqfnwy (mgr.34427) 6871 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:03:04.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:04 gibba013 bash[30381]: cephadm 2021-03-10T16:03:02.490742+0000 mgr.gibba020.yqfnwy (mgr.34427) 6872 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:03:04.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:04 gibba013 bash[30381]: cephadm 2021-03-10T16:03:02.492218+0000 mgr.gibba020.yqfnwy (mgr.34427) 6873 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:03:04.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:04 gibba013 bash[30381]: cephadm 2021-03-10T16:03:02.493811+0000 mgr.gibba020.yqfnwy (mgr.34427) 6874 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:03:04.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:04 gibba013 bash[30381]: cephadm 2021-03-10T16:03:02.493849+0000 mgr.gibba020.yqfnwy (mgr.34427) 6875 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:03:04.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:04 gibba013 bash[30381]: cephadm 2021-03-10T16:03:02.495386+0000 mgr.gibba020.yqfnwy (mgr.34427) 6876 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:03:04.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:04 gibba013 bash[30381]: cephadm 2021-03-10T16:03:02.495703+0000 mgr.gibba020.yqfnwy (mgr.34427) 6877 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:03:04.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:04 gibba013 bash[30381]: cephadm 2021-03-10T16:03:02.497135+0000 mgr.gibba020.yqfnwy (mgr.34427) 6878 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:03:04.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:04 gibba013 bash[30381]: cephadm 2021-03-10T16:03:02.497171+0000 mgr.gibba020.yqfnwy (mgr.34427) 6879 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:03:04.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:04 gibba013 bash[30381]: cephadm 2021-03-10T16:03:02.497274+0000 mgr.gibba020.yqfnwy (mgr.34427) 6880 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:03:04.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:04 gibba020 bash[25448]: cluster 2021-03-10T16:03:02.090056+0000 mgr.gibba020.yqfnwy (mgr.34427) 6864 : cluster [DBG] pgmap v3910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:04.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:04 gibba020 bash[25448]: cephadm 2021-03-10T16:03:02.261938+0000 mgr.gibba020.yqfnwy (mgr.34427) 6865 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:03:04.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:04 gibba020 bash[25448]: cephadm 2021-03-10T16:03:02.263747+0000 mgr.gibba020.yqfnwy (mgr.34427) 6866 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:03:04.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:04 gibba020 bash[25448]: cephadm 2021-03-10T16:03:02.485637+0000 mgr.gibba020.yqfnwy (mgr.34427) 6867 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:03:04.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:04 gibba020 bash[25448]: cephadm 2021-03-10T16:03:02.487701+0000 mgr.gibba020.yqfnwy (mgr.34427) 6868 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:03:04.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:04 gibba020 bash[25448]: cephadm 2021-03-10T16:03:02.489260+0000 mgr.gibba020.yqfnwy (mgr.34427) 6869 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:03:04.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:04 gibba020 bash[25448]: cephadm 2021-03-10T16:03:02.489296+0000 mgr.gibba020.yqfnwy (mgr.34427) 6870 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:03:04.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:04 gibba020 bash[25448]: cephadm 2021-03-10T16:03:02.490702+0000 mgr.gibba020.yqfnwy (mgr.34427) 6871 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:03:04.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:04 gibba020 bash[25448]: cephadm 2021-03-10T16:03:02.490742+0000 mgr.gibba020.yqfnwy (mgr.34427) 6872 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:03:04.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:04 gibba020 bash[25448]: cephadm 2021-03-10T16:03:02.492218+0000 mgr.gibba020.yqfnwy (mgr.34427) 6873 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:03:04.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:04 gibba020 bash[25448]: cephadm 2021-03-10T16:03:02.493811+0000 mgr.gibba020.yqfnwy (mgr.34427) 6874 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:03:04.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:04 gibba020 bash[25448]: cephadm 2021-03-10T16:03:02.493849+0000 mgr.gibba020.yqfnwy (mgr.34427) 6875 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:03:04.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:04 gibba020 bash[25448]: cephadm 2021-03-10T16:03:02.495386+0000 mgr.gibba020.yqfnwy (mgr.34427) 6876 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:03:04.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:04 gibba020 bash[25448]: cephadm 2021-03-10T16:03:02.495703+0000 mgr.gibba020.yqfnwy (mgr.34427) 6877 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:03:04.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:04 gibba020 bash[25448]: cephadm 2021-03-10T16:03:02.497135+0000 mgr.gibba020.yqfnwy (mgr.34427) 6878 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:03:04.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:04 gibba020 bash[25448]: cephadm 2021-03-10T16:03:02.497171+0000 mgr.gibba020.yqfnwy (mgr.34427) 6879 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:03:04.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:04 gibba020 bash[25448]: cephadm 2021-03-10T16:03:02.497274+0000 mgr.gibba020.yqfnwy (mgr.34427) 6880 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:03:06.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:06 gibba013 bash[29418]: cluster 2021-03-10T16:03:04.090974+0000 mgr.gibba020.yqfnwy (mgr.34427) 6881 : cluster [DBG] pgmap v3911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:06.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:06 gibba013 bash[30381]: cluster 2021-03-10T16:03:04.090974+0000 mgr.gibba020.yqfnwy (mgr.34427) 6881 : cluster [DBG] pgmap v3911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:06.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:06 gibba020 bash[25448]: cluster 2021-03-10T16:03:04.090974+0000 mgr.gibba020.yqfnwy (mgr.34427) 6881 : cluster [DBG] pgmap v3911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:07.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:07 gibba013 bash[29418]: audit 2021-03-10T16:03:06.625400+0000 mon.a (mon.0) 2632 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:03:07.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:07 gibba013 bash[29418]: audit 2021-03-10T16:03:06.697816+0000 mon.a (mon.0) 2633 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:03:07.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:07 gibba013 bash[29418]: audit 2021-03-10T16:03:06.895581+0000 mon.a (mon.0) 2634 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:03:07.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:07 gibba013 bash[29418]: audit 2021-03-10T16:03:06.896304+0000 mon.a (mon.0) 2635 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:03:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:07 gibba013 bash[29418]: audit 2021-03-10T16:03:06.896991+0000 mon.a (mon.0) 2636 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:03:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:07 gibba013 bash[29418]: audit 2021-03-10T16:03:06.897713+0000 mon.a (mon.0) 2637 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:03:07.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:07 gibba013 bash[30381]: audit 2021-03-10T16:03:06.625400+0000 mon.a (mon.0) 2632 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:03:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:07 gibba013 bash[30381]: audit 2021-03-10T16:03:06.697816+0000 mon.a (mon.0) 2633 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:03:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:07 gibba013 bash[30381]: audit 2021-03-10T16:03:06.895581+0000 mon.a (mon.0) 2634 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:03:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:07 gibba013 bash[30381]: audit 2021-03-10T16:03:06.896304+0000 mon.a (mon.0) 2635 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:03:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:07 gibba013 bash[30381]: audit 2021-03-10T16:03:06.896991+0000 mon.a (mon.0) 2636 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:03:07.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:07 gibba013 bash[30381]: audit 2021-03-10T16:03:06.897713+0000 mon.a (mon.0) 2637 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:03:07.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:07 gibba020 bash[25448]: audit 2021-03-10T16:03:06.625400+0000 mon.a (mon.0) 2632 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:03:07.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:07 gibba020 bash[25448]: audit 2021-03-10T16:03:06.697816+0000 mon.a (mon.0) 2633 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:03:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:07 gibba020 bash[25448]: audit 2021-03-10T16:03:06.895581+0000 mon.a (mon.0) 2634 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:03:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:07 gibba020 bash[25448]: audit 2021-03-10T16:03:06.896304+0000 mon.a (mon.0) 2635 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:03:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:07 gibba020 bash[25448]: audit 2021-03-10T16:03:06.896991+0000 mon.a (mon.0) 2636 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:03:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:07 gibba020 bash[25448]: audit 2021-03-10T16:03:06.897713+0000 mon.a (mon.0) 2637 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:03:08.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:08 gibba013 bash[29418]: cluster 2021-03-10T16:03:06.091677+0000 mgr.gibba020.yqfnwy (mgr.34427) 6882 : cluster [DBG] pgmap v3912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:08.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:08 gibba013 bash[30381]: cluster 2021-03-10T16:03:06.091677+0000 mgr.gibba020.yqfnwy (mgr.34427) 6882 : cluster [DBG] pgmap v3912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:08.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:08 gibba020 bash[25448]: cluster 2021-03-10T16:03:06.091677+0000 mgr.gibba020.yqfnwy (mgr.34427) 6882 : cluster [DBG] pgmap v3912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:10.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:10 gibba013 bash[29418]: cluster 2021-03-10T16:03:08.092676+0000 mgr.gibba020.yqfnwy (mgr.34427) 6883 : cluster [DBG] pgmap v3913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:10.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:10 gibba013 bash[30381]: cluster 2021-03-10T16:03:08.092676+0000 mgr.gibba020.yqfnwy (mgr.34427) 6883 : cluster [DBG] pgmap v3913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:10.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:10 gibba020 bash[25448]: cluster 2021-03-10T16:03:08.092676+0000 mgr.gibba020.yqfnwy (mgr.34427) 6883 : cluster [DBG] pgmap v3913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:11.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:11 gibba013 bash[29418]: cluster 2021-03-10T16:03:10.094330+0000 mgr.gibba020.yqfnwy (mgr.34427) 6884 : cluster [DBG] pgmap v3914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:11.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:11 gibba013 bash[30381]: cluster 2021-03-10T16:03:10.094330+0000 mgr.gibba020.yqfnwy (mgr.34427) 6884 : cluster [DBG] pgmap v3914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:11.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:11 gibba020 bash[25448]: cluster 2021-03-10T16:03:10.094330+0000 mgr.gibba020.yqfnwy (mgr.34427) 6884 : cluster [DBG] pgmap v3914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:13.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:13 gibba020 bash[25448]: cluster 2021-03-10T16:03:12.095705+0000 mgr.gibba020.yqfnwy (mgr.34427) 6885 : cluster [DBG] pgmap v3915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:13.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:13 gibba013 bash[29418]: cluster 2021-03-10T16:03:12.095705+0000 mgr.gibba020.yqfnwy (mgr.34427) 6885 : cluster [DBG] pgmap v3915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:13.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:13 gibba013 bash[30381]: cluster 2021-03-10T16:03:12.095705+0000 mgr.gibba020.yqfnwy (mgr.34427) 6885 : cluster [DBG] pgmap v3915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:15.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:15 gibba013 bash[29418]: cluster 2021-03-10T16:03:14.097502+0000 mgr.gibba020.yqfnwy (mgr.34427) 6886 : cluster [DBG] pgmap v3916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:15.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:15 gibba013 bash[30381]: cluster 2021-03-10T16:03:14.097502+0000 mgr.gibba020.yqfnwy (mgr.34427) 6886 : cluster [DBG] pgmap v3916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:15.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:15 gibba020 bash[25448]: cluster 2021-03-10T16:03:14.097502+0000 mgr.gibba020.yqfnwy (mgr.34427) 6886 : cluster [DBG] pgmap v3916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:17.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:17 gibba013 bash[29418]: cluster 2021-03-10T16:03:16.099263+0000 mgr.gibba020.yqfnwy (mgr.34427) 6887 : cluster [DBG] pgmap v3917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:17.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:17 gibba013 bash[30381]: cluster 2021-03-10T16:03:16.099263+0000 mgr.gibba020.yqfnwy (mgr.34427) 6887 : cluster [DBG] pgmap v3917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:17.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:17 gibba020 bash[25448]: cluster 2021-03-10T16:03:16.099263+0000 mgr.gibba020.yqfnwy (mgr.34427) 6887 : cluster [DBG] pgmap v3917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:18.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:18 gibba013 bash[29418]: cephadm 2021-03-10T16:03:17.509974+0000 mgr.gibba020.yqfnwy (mgr.34427) 6888 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:03:18.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:18 gibba013 bash[30381]: cephadm 2021-03-10T16:03:17.509974+0000 mgr.gibba020.yqfnwy (mgr.34427) 6888 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:03:18.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:18 gibba020 bash[25448]: cephadm 2021-03-10T16:03:17.509974+0000 mgr.gibba020.yqfnwy (mgr.34427) 6888 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:03:19.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:19 gibba013 bash[29418]: cluster 2021-03-10T16:03:18.100064+0000 mgr.gibba020.yqfnwy (mgr.34427) 6889 : cluster [DBG] pgmap v3918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:19.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:19 gibba013 bash[30381]: cluster 2021-03-10T16:03:18.100064+0000 mgr.gibba020.yqfnwy (mgr.34427) 6889 : cluster [DBG] pgmap v3918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:19.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:19 gibba020 bash[25448]: cluster 2021-03-10T16:03:18.100064+0000 mgr.gibba020.yqfnwy (mgr.34427) 6889 : cluster [DBG] pgmap v3918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:21.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:21 gibba013 bash[29418]: cluster 2021-03-10T16:03:20.102021+0000 mgr.gibba020.yqfnwy (mgr.34427) 6890 : cluster [DBG] pgmap v3919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:21.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:21 gibba013 bash[30381]: cluster 2021-03-10T16:03:20.102021+0000 mgr.gibba020.yqfnwy (mgr.34427) 6890 : cluster [DBG] pgmap v3919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:21.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:21 gibba020 bash[25448]: cluster 2021-03-10T16:03:20.102021+0000 mgr.gibba020.yqfnwy (mgr.34427) 6890 : cluster [DBG] pgmap v3919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:23.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:23 gibba013 bash[29418]: cluster 2021-03-10T16:03:22.103317+0000 mgr.gibba020.yqfnwy (mgr.34427) 6891 : cluster [DBG] pgmap v3920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:23.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:23 gibba013 bash[30381]: cluster 2021-03-10T16:03:22.103317+0000 mgr.gibba020.yqfnwy (mgr.34427) 6891 : cluster [DBG] pgmap v3920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:23.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:23 gibba020 bash[25448]: cluster 2021-03-10T16:03:22.103317+0000 mgr.gibba020.yqfnwy (mgr.34427) 6891 : cluster [DBG] pgmap v3920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:25.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:25 gibba013 bash[29418]: cluster 2021-03-10T16:03:24.104874+0000 mgr.gibba020.yqfnwy (mgr.34427) 6892 : cluster [DBG] pgmap v3921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:25.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:25 gibba013 bash[30381]: cluster 2021-03-10T16:03:24.104874+0000 mgr.gibba020.yqfnwy (mgr.34427) 6892 : cluster [DBG] pgmap v3921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:25.914 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:03:25.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:25 gibba020 bash[25448]: cluster 2021-03-10T16:03:24.104874+0000 mgr.gibba020.yqfnwy (mgr.34427) 6892 : cluster [DBG] pgmap v3921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:26.142 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:03:26.142 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 3m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:03:26.142 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 2m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:03:26.143 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:03:26.143 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:03:26.143 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:03:26.143 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:03:26.143 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:03:26.144 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:03:26.144 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:03:26.144 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:03:26.144 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:03:26.145 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:03:26.145 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:03:26.145 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:03:26.145 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:03:26.145 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:03:26.146 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:03:26.146 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:03:26.146 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 2m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:03:26.146 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:03:26.393 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:03:26.393 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:03:26.394 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:03:26.394 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:03:26.394 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:03:26.394 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:03:26.394 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:03:26.395 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:03:26.395 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:03:26.395 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:03:26.395 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:03:26.396 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:03:26.396 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:03:26.396 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:03:26.396 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:03:26.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:26 gibba013 bash[29418]: audit 2021-03-10T16:03:25.903348+0000 mgr.gibba020.yqfnwy (mgr.34427) 6893 : audit [DBG] from='client.48678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:03:26.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:26 gibba013 bash[29418]: audit 2021-03-10T16:03:26.393013+0000 mon.a (mon.0) 2638 : audit [DBG] from='client.? 172.21.2.113:0/2961221867' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:26.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:26 gibba013 bash[30381]: audit 2021-03-10T16:03:25.903348+0000 mgr.gibba020.yqfnwy (mgr.34427) 6893 : audit [DBG] from='client.48678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:03:26.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:26 gibba013 bash[30381]: audit 2021-03-10T16:03:26.393013+0000 mon.a (mon.0) 2638 : audit [DBG] from='client.? 172.21.2.113:0/2961221867' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:26.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:26 gibba020 bash[25448]: audit 2021-03-10T16:03:25.903348+0000 mgr.gibba020.yqfnwy (mgr.34427) 6893 : audit [DBG] from='client.48678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:03:26.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:26 gibba020 bash[25448]: audit 2021-03-10T16:03:26.393013+0000 mon.a (mon.0) 2638 : audit [DBG] from='client.? 172.21.2.113:0/2961221867' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:27.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:27 gibba013 bash[29418]: cluster 2021-03-10T16:03:26.106615+0000 mgr.gibba020.yqfnwy (mgr.34427) 6894 : cluster [DBG] pgmap v3922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:27.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:27 gibba013 bash[29418]: audit 2021-03-10T16:03:26.128329+0000 mgr.gibba020.yqfnwy (mgr.34427) 6895 : audit [DBG] from='client.58669 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:03:27.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:27 gibba013 bash[30381]: cluster 2021-03-10T16:03:26.106615+0000 mgr.gibba020.yqfnwy (mgr.34427) 6894 : cluster [DBG] pgmap v3922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:27.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:27 gibba013 bash[30381]: audit 2021-03-10T16:03:26.128329+0000 mgr.gibba020.yqfnwy (mgr.34427) 6895 : audit [DBG] from='client.58669 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:03:27.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:27 gibba020 bash[25448]: cluster 2021-03-10T16:03:26.106615+0000 mgr.gibba020.yqfnwy (mgr.34427) 6894 : cluster [DBG] pgmap v3922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:27.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:27 gibba020 bash[25448]: audit 2021-03-10T16:03:26.128329+0000 mgr.gibba020.yqfnwy (mgr.34427) 6895 : audit [DBG] from='client.58669 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:03:29.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:29 gibba013 bash[29418]: cluster 2021-03-10T16:03:28.107767+0000 mgr.gibba020.yqfnwy (mgr.34427) 6896 : cluster [DBG] pgmap v3923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:29.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:29 gibba013 bash[30381]: cluster 2021-03-10T16:03:28.107767+0000 mgr.gibba020.yqfnwy (mgr.34427) 6896 : cluster [DBG] pgmap v3923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:29.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:29 gibba020 bash[25448]: cluster 2021-03-10T16:03:28.107767+0000 mgr.gibba020.yqfnwy (mgr.34427) 6896 : cluster [DBG] pgmap v3923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:31.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:31 gibba013 bash[29418]: cluster 2021-03-10T16:03:30.109337+0000 mgr.gibba020.yqfnwy (mgr.34427) 6897 : cluster [DBG] pgmap v3924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:31.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:31 gibba013 bash[30381]: cluster 2021-03-10T16:03:30.109337+0000 mgr.gibba020.yqfnwy (mgr.34427) 6897 : cluster [DBG] pgmap v3924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:31.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:31 gibba020 bash[25448]: cluster 2021-03-10T16:03:30.109337+0000 mgr.gibba020.yqfnwy (mgr.34427) 6897 : cluster [DBG] pgmap v3924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:33.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:33 gibba013 bash[29418]: cluster 2021-03-10T16:03:32.110773+0000 mgr.gibba020.yqfnwy (mgr.34427) 6898 : cluster [DBG] pgmap v3925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:33.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:33 gibba013 bash[29418]: cephadm 2021-03-10T16:03:32.526028+0000 mgr.gibba020.yqfnwy (mgr.34427) 6899 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:03:33.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:33 gibba013 bash[30381]: cluster 2021-03-10T16:03:32.110773+0000 mgr.gibba020.yqfnwy (mgr.34427) 6898 : cluster [DBG] pgmap v3925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:33.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:33 gibba013 bash[30381]: cephadm 2021-03-10T16:03:32.526028+0000 mgr.gibba020.yqfnwy (mgr.34427) 6899 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:03:33.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:33 gibba020 bash[25448]: cluster 2021-03-10T16:03:32.110773+0000 mgr.gibba020.yqfnwy (mgr.34427) 6898 : cluster [DBG] pgmap v3925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:33.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:33 gibba020 bash[25448]: cephadm 2021-03-10T16:03:32.526028+0000 mgr.gibba020.yqfnwy (mgr.34427) 6899 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:03:35.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:35 gibba013 bash[29418]: cluster 2021-03-10T16:03:34.112139+0000 mgr.gibba020.yqfnwy (mgr.34427) 6900 : cluster [DBG] pgmap v3926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:35.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:35 gibba013 bash[30381]: cluster 2021-03-10T16:03:34.112139+0000 mgr.gibba020.yqfnwy (mgr.34427) 6900 : cluster [DBG] pgmap v3926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:35.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:35 gibba020 bash[25448]: cluster 2021-03-10T16:03:34.112139+0000 mgr.gibba020.yqfnwy (mgr.34427) 6900 : cluster [DBG] pgmap v3926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:37.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:37 gibba013 bash[29418]: cluster 2021-03-10T16:03:36.114046+0000 mgr.gibba020.yqfnwy (mgr.34427) 6901 : cluster [DBG] pgmap v3927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:37.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:37 gibba013 bash[30381]: cluster 2021-03-10T16:03:36.114046+0000 mgr.gibba020.yqfnwy (mgr.34427) 6901 : cluster [DBG] pgmap v3927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:37.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:37 gibba020 bash[25448]: cluster 2021-03-10T16:03:36.114046+0000 mgr.gibba020.yqfnwy (mgr.34427) 6901 : cluster [DBG] pgmap v3927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:39.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:39 gibba013 bash[29418]: cluster 2021-03-10T16:03:38.115436+0000 mgr.gibba020.yqfnwy (mgr.34427) 6902 : cluster [DBG] pgmap v3928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:39.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:39 gibba013 bash[30381]: cluster 2021-03-10T16:03:38.115436+0000 mgr.gibba020.yqfnwy (mgr.34427) 6902 : cluster [DBG] pgmap v3928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:39.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:39 gibba020 bash[25448]: cluster 2021-03-10T16:03:38.115436+0000 mgr.gibba020.yqfnwy (mgr.34427) 6902 : cluster [DBG] pgmap v3928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:41.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:41 gibba020 bash[25448]: cluster 2021-03-10T16:03:40.117078+0000 mgr.gibba020.yqfnwy (mgr.34427) 6903 : cluster [DBG] pgmap v3929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:42.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:41 gibba013 bash[29418]: cluster 2021-03-10T16:03:40.117078+0000 mgr.gibba020.yqfnwy (mgr.34427) 6903 : cluster [DBG] pgmap v3929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:42.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:41 gibba013 bash[30381]: cluster 2021-03-10T16:03:40.117078+0000 mgr.gibba020.yqfnwy (mgr.34427) 6903 : cluster [DBG] pgmap v3929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:43.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:43 gibba020 bash[25448]: cluster 2021-03-10T16:03:42.118523+0000 mgr.gibba020.yqfnwy (mgr.34427) 6904 : cluster [DBG] pgmap v3930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:44.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:43 gibba013 bash[29418]: cluster 2021-03-10T16:03:42.118523+0000 mgr.gibba020.yqfnwy (mgr.34427) 6904 : cluster [DBG] pgmap v3930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:44.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:43 gibba013 bash[30381]: cluster 2021-03-10T16:03:42.118523+0000 mgr.gibba020.yqfnwy (mgr.34427) 6904 : cluster [DBG] pgmap v3930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:45.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:45 gibba020 bash[25448]: cluster 2021-03-10T16:03:44.120191+0000 mgr.gibba020.yqfnwy (mgr.34427) 6905 : cluster [DBG] pgmap v3931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:46.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:45 gibba013 bash[29418]: cluster 2021-03-10T16:03:44.120191+0000 mgr.gibba020.yqfnwy (mgr.34427) 6905 : cluster [DBG] pgmap v3931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:46.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:45 gibba013 bash[30381]: cluster 2021-03-10T16:03:44.120191+0000 mgr.gibba020.yqfnwy (mgr.34427) 6905 : cluster [DBG] pgmap v3931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:47.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:47 gibba020 bash[25448]: cluster 2021-03-10T16:03:46.121799+0000 mgr.gibba020.yqfnwy (mgr.34427) 6906 : cluster [DBG] pgmap v3932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:48.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:47 gibba013 bash[29418]: cluster 2021-03-10T16:03:46.121799+0000 mgr.gibba020.yqfnwy (mgr.34427) 6906 : cluster [DBG] pgmap v3932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:48.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:47 gibba013 bash[30381]: cluster 2021-03-10T16:03:46.121799+0000 mgr.gibba020.yqfnwy (mgr.34427) 6906 : cluster [DBG] pgmap v3932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:48.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:48 gibba020 bash[25448]: cephadm 2021-03-10T16:03:47.528647+0000 mgr.gibba020.yqfnwy (mgr.34427) 6907 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:03:49.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:48 gibba013 bash[29418]: cephadm 2021-03-10T16:03:47.528647+0000 mgr.gibba020.yqfnwy (mgr.34427) 6907 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:03:49.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:48 gibba013 bash[30381]: cephadm 2021-03-10T16:03:47.528647+0000 mgr.gibba020.yqfnwy (mgr.34427) 6907 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:03:49.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:49 gibba020 bash[25448]: cluster 2021-03-10T16:03:48.123001+0000 mgr.gibba020.yqfnwy (mgr.34427) 6908 : cluster [DBG] pgmap v3933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:50.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:49 gibba013 bash[29418]: cluster 2021-03-10T16:03:48.123001+0000 mgr.gibba020.yqfnwy (mgr.34427) 6908 : cluster [DBG] pgmap v3933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:50.254 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:49 gibba013 bash[30381]: cluster 2021-03-10T16:03:48.123001+0000 mgr.gibba020.yqfnwy (mgr.34427) 6908 : cluster [DBG] pgmap v3933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:51.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:51 gibba020 bash[25448]: cluster 2021-03-10T16:03:50.124950+0000 mgr.gibba020.yqfnwy (mgr.34427) 6909 : cluster [DBG] pgmap v3934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:52.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:51 gibba013 bash[29418]: cluster 2021-03-10T16:03:50.124950+0000 mgr.gibba020.yqfnwy (mgr.34427) 6909 : cluster [DBG] pgmap v3934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:52.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:51 gibba013 bash[30381]: cluster 2021-03-10T16:03:50.124950+0000 mgr.gibba020.yqfnwy (mgr.34427) 6909 : cluster [DBG] pgmap v3934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:53.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:53 gibba020 bash[25448]: cluster 2021-03-10T16:03:52.126192+0000 mgr.gibba020.yqfnwy (mgr.34427) 6910 : cluster [DBG] pgmap v3935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:54.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:53 gibba013 bash[29418]: cluster 2021-03-10T16:03:52.126192+0000 mgr.gibba020.yqfnwy (mgr.34427) 6910 : cluster [DBG] pgmap v3935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:54.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:53 gibba013 bash[30381]: cluster 2021-03-10T16:03:52.126192+0000 mgr.gibba020.yqfnwy (mgr.34427) 6910 : cluster [DBG] pgmap v3935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:56.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:55 gibba013 bash[29418]: cluster 2021-03-10T16:03:54.127669+0000 mgr.gibba020.yqfnwy (mgr.34427) 6911 : cluster [DBG] pgmap v3936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:56.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:55 gibba013 bash[30381]: cluster 2021-03-10T16:03:54.127669+0000 mgr.gibba020.yqfnwy (mgr.34427) 6911 : cluster [DBG] pgmap v3936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:56.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:55 gibba020 bash[25448]: cluster 2021-03-10T16:03:54.127669+0000 mgr.gibba020.yqfnwy (mgr.34427) 6911 : cluster [DBG] pgmap v3936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:56.636 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:03:56.899 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:03:56.899 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 3m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:03:56.899 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 2m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:03:56.900 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:03:56.900 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:03:56.900 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:03:56.900 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:03:56.901 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:03:56.901 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:03:56.901 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:03:56.901 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:03:56.901 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:03:56.902 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:03:56.902 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:03:56.902 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:03:56.902 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:03:56.903 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:03:56.903 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:03:56.903 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:03:56.903 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 2m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:03:56.903 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:03:57.149 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:03:57.150 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:03:57.150 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:03:57.150 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:03:57.150 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:03:57.151 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:03:57.151 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:03:57.151 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:03:57.151 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:03:57.151 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:03:57.152 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:03:57.152 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:03:57.152 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:03:57.152 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:03:57.153 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:03:58.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:57 gibba013 bash[29418]: cluster 2021-03-10T16:03:56.129522+0000 mgr.gibba020.yqfnwy (mgr.34427) 6912 : cluster [DBG] pgmap v3937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:58.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:57 gibba013 bash[29418]: audit 2021-03-10T16:03:56.626715+0000 mgr.gibba020.yqfnwy (mgr.34427) 6913 : audit [DBG] from='client.48696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:03:58.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:57 gibba013 bash[29418]: audit 2021-03-10T16:03:56.857433+0000 mgr.gibba020.yqfnwy (mgr.34427) 6914 : audit [DBG] from='client.48702 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:03:58.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:57 gibba013 bash[29418]: audit 2021-03-10T16:03:57.149524+0000 mon.c (mon.1) 113 : audit [DBG] from='client.? 172.21.2.113:0/2752029084' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:58.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:57 gibba013 bash[30381]: cluster 2021-03-10T16:03:56.129522+0000 mgr.gibba020.yqfnwy (mgr.34427) 6912 : cluster [DBG] pgmap v3937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:58.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:57 gibba013 bash[30381]: audit 2021-03-10T16:03:56.626715+0000 mgr.gibba020.yqfnwy (mgr.34427) 6913 : audit [DBG] from='client.48696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:03:58.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:57 gibba013 bash[30381]: audit 2021-03-10T16:03:56.857433+0000 mgr.gibba020.yqfnwy (mgr.34427) 6914 : audit [DBG] from='client.48702 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:03:58.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:57 gibba013 bash[30381]: audit 2021-03-10T16:03:57.149524+0000 mon.c (mon.1) 113 : audit [DBG] from='client.? 172.21.2.113:0/2752029084' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:03:58.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:57 gibba020 bash[25448]: cluster 2021-03-10T16:03:56.129522+0000 mgr.gibba020.yqfnwy (mgr.34427) 6912 : cluster [DBG] pgmap v3937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:03:58.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:57 gibba020 bash[25448]: audit 2021-03-10T16:03:56.626715+0000 mgr.gibba020.yqfnwy (mgr.34427) 6913 : audit [DBG] from='client.48696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:03:58.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:57 gibba020 bash[25448]: audit 2021-03-10T16:03:56.857433+0000 mgr.gibba020.yqfnwy (mgr.34427) 6914 : audit [DBG] from='client.48702 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:03:58.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:57 gibba020 bash[25448]: audit 2021-03-10T16:03:57.149524+0000 mon.c (mon.1) 113 : audit [DBG] from='client.? 172.21.2.113:0/2752029084' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:00.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:03:59 gibba013 bash[29418]: cluster 2021-03-10T16:03:58.130804+0000 mgr.gibba020.yqfnwy (mgr.34427) 6915 : cluster [DBG] pgmap v3938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:00.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:03:59 gibba013 bash[30381]: cluster 2021-03-10T16:03:58.130804+0000 mgr.gibba020.yqfnwy (mgr.34427) 6915 : cluster [DBG] pgmap v3938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:00.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:03:59 gibba020 bash[25448]: cluster 2021-03-10T16:03:58.130804+0000 mgr.gibba020.yqfnwy (mgr.34427) 6915 : cluster [DBG] pgmap v3938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:02.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:01 gibba013 bash[29418]: cluster 2021-03-10T16:04:00.131875+0000 mgr.gibba020.yqfnwy (mgr.34427) 6916 : cluster [DBG] pgmap v3939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:02.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:01 gibba013 bash[30381]: cluster 2021-03-10T16:04:00.131875+0000 mgr.gibba020.yqfnwy (mgr.34427) 6916 : cluster [DBG] pgmap v3939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:02.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:01 gibba020 bash[25448]: cluster 2021-03-10T16:04:00.131875+0000 mgr.gibba020.yqfnwy (mgr.34427) 6916 : cluster [DBG] pgmap v3939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:03.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:02 gibba013 bash[29418]: audit 2021-03-10T16:04:02.546589+0000 mon.a (mon.0) 2639 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:04:03.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:02 gibba013 bash[30381]: audit 2021-03-10T16:04:02.546589+0000 mon.a (mon.0) 2639 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:04:03.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:02 gibba020 bash[25448]: audit 2021-03-10T16:04:02.546589+0000 mon.a (mon.0) 2639 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:04:04.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[29418]: cluster 2021-03-10T16:04:02.133015+0000 mgr.gibba020.yqfnwy (mgr.34427) 6917 : cluster [DBG] pgmap v3940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:04.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[29418]: cephadm 2021-03-10T16:04:02.550584+0000 mgr.gibba020.yqfnwy (mgr.34427) 6918 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:04:04.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[29418]: cephadm 2021-03-10T16:04:02.552481+0000 mgr.gibba020.yqfnwy (mgr.34427) 6919 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:04:04.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[29418]: audit 2021-03-10T16:04:02.760838+0000 mon.a (mon.0) 2640 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:04:04.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[29418]: cephadm 2021-03-10T16:04:02.761957+0000 mgr.gibba020.yqfnwy (mgr.34427) 6920 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:04:04.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[29418]: cephadm 2021-03-10T16:04:02.763527+0000 mgr.gibba020.yqfnwy (mgr.34427) 6921 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:04:04.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[29418]: audit 2021-03-10T16:04:02.763983+0000 mon.a (mon.0) 2641 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:04:04.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[29418]: cephadm 2021-03-10T16:04:02.764567+0000 mgr.gibba020.yqfnwy (mgr.34427) 6922 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:04:04.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[29418]: cephadm 2021-03-10T16:04:02.764605+0000 mgr.gibba020.yqfnwy (mgr.34427) 6923 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:04:04.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[29418]: audit 2021-03-10T16:04:02.765162+0000 mon.a (mon.0) 2642 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:04.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[29418]: cephadm 2021-03-10T16:04:02.765668+0000 mgr.gibba020.yqfnwy (mgr.34427) 6924 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:04:04.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[29418]: cephadm 2021-03-10T16:04:02.765707+0000 mgr.gibba020.yqfnwy (mgr.34427) 6925 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:04:04.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[29418]: audit 2021-03-10T16:04:02.766322+0000 mon.a (mon.0) 2643 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:04.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[29418]: cephadm 2021-03-10T16:04:02.766605+0000 mgr.gibba020.yqfnwy (mgr.34427) 6926 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:04:04.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[29418]: audit 2021-03-10T16:04:02.767270+0000 mon.a (mon.0) 2644 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:04.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[29418]: cephadm 2021-03-10T16:04:02.767358+0000 mgr.gibba020.yqfnwy (mgr.34427) 6927 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:04:04.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[29418]: cephadm 2021-03-10T16:04:02.767396+0000 mgr.gibba020.yqfnwy (mgr.34427) 6928 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:04:04.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[29418]: cephadm 2021-03-10T16:04:02.768582+0000 mgr.gibba020.yqfnwy (mgr.34427) 6929 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:04:04.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[29418]: cephadm 2021-03-10T16:04:02.768908+0000 mgr.gibba020.yqfnwy (mgr.34427) 6930 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:04:04.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[29418]: audit 2021-03-10T16:04:02.769064+0000 mon.a (mon.0) 2645 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:04.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[29418]: cephadm 2021-03-10T16:04:02.769737+0000 mgr.gibba020.yqfnwy (mgr.34427) 6931 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:04:04.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[30381]: cluster 2021-03-10T16:04:02.133015+0000 mgr.gibba020.yqfnwy (mgr.34427) 6917 : cluster [DBG] pgmap v3940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:04.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[30381]: cephadm 2021-03-10T16:04:02.550584+0000 mgr.gibba020.yqfnwy (mgr.34427) 6918 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:04:04.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[30381]: cephadm 2021-03-10T16:04:02.552481+0000 mgr.gibba020.yqfnwy (mgr.34427) 6919 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:04:04.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[30381]: audit 2021-03-10T16:04:02.760838+0000 mon.a (mon.0) 2640 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:04:04.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[30381]: cephadm 2021-03-10T16:04:02.761957+0000 mgr.gibba020.yqfnwy (mgr.34427) 6920 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:04:04.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[30381]: cephadm 2021-03-10T16:04:02.763527+0000 mgr.gibba020.yqfnwy (mgr.34427) 6921 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:04:04.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[30381]: audit 2021-03-10T16:04:02.763983+0000 mon.a (mon.0) 2641 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:04:04.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[30381]: cephadm 2021-03-10T16:04:02.764567+0000 mgr.gibba020.yqfnwy (mgr.34427) 6922 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:04:04.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[30381]: cephadm 2021-03-10T16:04:02.764605+0000 mgr.gibba020.yqfnwy (mgr.34427) 6923 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:04:04.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[30381]: audit 2021-03-10T16:04:02.765162+0000 mon.a (mon.0) 2642 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:04.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[30381]: cephadm 2021-03-10T16:04:02.765668+0000 mgr.gibba020.yqfnwy (mgr.34427) 6924 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:04:04.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[30381]: cephadm 2021-03-10T16:04:02.765707+0000 mgr.gibba020.yqfnwy (mgr.34427) 6925 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:04:04.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[30381]: audit 2021-03-10T16:04:02.766322+0000 mon.a (mon.0) 2643 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:04.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[30381]: cephadm 2021-03-10T16:04:02.766605+0000 mgr.gibba020.yqfnwy (mgr.34427) 6926 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:04:04.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[30381]: audit 2021-03-10T16:04:02.767270+0000 mon.a (mon.0) 2644 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:04.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[30381]: cephadm 2021-03-10T16:04:02.767358+0000 mgr.gibba020.yqfnwy (mgr.34427) 6927 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:04:04.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[30381]: cephadm 2021-03-10T16:04:02.767396+0000 mgr.gibba020.yqfnwy (mgr.34427) 6928 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:04:04.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[30381]: cephadm 2021-03-10T16:04:02.768582+0000 mgr.gibba020.yqfnwy (mgr.34427) 6929 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:04:04.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[30381]: cephadm 2021-03-10T16:04:02.768908+0000 mgr.gibba020.yqfnwy (mgr.34427) 6930 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:04:04.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[30381]: audit 2021-03-10T16:04:02.769064+0000 mon.a (mon.0) 2645 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:04.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[30381]: cephadm 2021-03-10T16:04:02.769737+0000 mgr.gibba020.yqfnwy (mgr.34427) 6931 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:04:04.140 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[29418]: cephadm 2021-03-10T16:04:02.769775+0000 mgr.gibba020.yqfnwy (mgr.34427) 6932 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:04:04.141 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[29418]: cephadm 2021-03-10T16:04:02.769882+0000 mgr.gibba020.yqfnwy (mgr.34427) 6933 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:04:04.141 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[29418]: audit 2021-03-10T16:04:02.770506+0000 mon.a (mon.0) 2646 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:04.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[30381]: cephadm 2021-03-10T16:04:02.769775+0000 mgr.gibba020.yqfnwy (mgr.34427) 6932 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:04:04.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[30381]: cephadm 2021-03-10T16:04:02.769882+0000 mgr.gibba020.yqfnwy (mgr.34427) 6933 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:04:04.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:03 gibba013 bash[30381]: audit 2021-03-10T16:04:02.770506+0000 mon.a (mon.0) 2646 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:04.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:03 gibba020 bash[25448]: cluster 2021-03-10T16:04:02.133015+0000 mgr.gibba020.yqfnwy (mgr.34427) 6917 : cluster [DBG] pgmap v3940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:04.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:03 gibba020 bash[25448]: cephadm 2021-03-10T16:04:02.550584+0000 mgr.gibba020.yqfnwy (mgr.34427) 6918 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:04:04.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:03 gibba020 bash[25448]: cephadm 2021-03-10T16:04:02.552481+0000 mgr.gibba020.yqfnwy (mgr.34427) 6919 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:04:04.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:03 gibba020 bash[25448]: audit 2021-03-10T16:04:02.760838+0000 mon.a (mon.0) 2640 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:04:04.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:03 gibba020 bash[25448]: cephadm 2021-03-10T16:04:02.761957+0000 mgr.gibba020.yqfnwy (mgr.34427) 6920 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:04:04.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:03 gibba020 bash[25448]: cephadm 2021-03-10T16:04:02.763527+0000 mgr.gibba020.yqfnwy (mgr.34427) 6921 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:04:04.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:03 gibba020 bash[25448]: audit 2021-03-10T16:04:02.763983+0000 mon.a (mon.0) 2641 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:04:04.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:03 gibba020 bash[25448]: cephadm 2021-03-10T16:04:02.764567+0000 mgr.gibba020.yqfnwy (mgr.34427) 6922 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:04:04.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:03 gibba020 bash[25448]: cephadm 2021-03-10T16:04:02.764605+0000 mgr.gibba020.yqfnwy (mgr.34427) 6923 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:04:04.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:03 gibba020 bash[25448]: audit 2021-03-10T16:04:02.765162+0000 mon.a (mon.0) 2642 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:04.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:03 gibba020 bash[25448]: cephadm 2021-03-10T16:04:02.765668+0000 mgr.gibba020.yqfnwy (mgr.34427) 6924 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:04:04.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:03 gibba020 bash[25448]: cephadm 2021-03-10T16:04:02.765707+0000 mgr.gibba020.yqfnwy (mgr.34427) 6925 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:04:04.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:03 gibba020 bash[25448]: audit 2021-03-10T16:04:02.766322+0000 mon.a (mon.0) 2643 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:04.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:03 gibba020 bash[25448]: cephadm 2021-03-10T16:04:02.766605+0000 mgr.gibba020.yqfnwy (mgr.34427) 6926 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:04:04.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:03 gibba020 bash[25448]: audit 2021-03-10T16:04:02.767270+0000 mon.a (mon.0) 2644 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:04.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:03 gibba020 bash[25448]: cephadm 2021-03-10T16:04:02.767358+0000 mgr.gibba020.yqfnwy (mgr.34427) 6927 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:04:04.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:03 gibba020 bash[25448]: cephadm 2021-03-10T16:04:02.767396+0000 mgr.gibba020.yqfnwy (mgr.34427) 6928 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:04:04.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:03 gibba020 bash[25448]: cephadm 2021-03-10T16:04:02.768582+0000 mgr.gibba020.yqfnwy (mgr.34427) 6929 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:04:04.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:03 gibba020 bash[25448]: cephadm 2021-03-10T16:04:02.768908+0000 mgr.gibba020.yqfnwy (mgr.34427) 6930 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:04:04.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:03 gibba020 bash[25448]: audit 2021-03-10T16:04:02.769064+0000 mon.a (mon.0) 2645 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:04.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:03 gibba020 bash[25448]: cephadm 2021-03-10T16:04:02.769737+0000 mgr.gibba020.yqfnwy (mgr.34427) 6931 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:04:04.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:03 gibba020 bash[25448]: cephadm 2021-03-10T16:04:02.769775+0000 mgr.gibba020.yqfnwy (mgr.34427) 6932 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:04:04.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:03 gibba020 bash[25448]: cephadm 2021-03-10T16:04:02.769882+0000 mgr.gibba020.yqfnwy (mgr.34427) 6933 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:04:04.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:03 gibba020 bash[25448]: audit 2021-03-10T16:04:02.770506+0000 mon.a (mon.0) 2646 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:06.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:05 gibba013 bash[29418]: cluster 2021-03-10T16:04:04.134710+0000 mgr.gibba020.yqfnwy (mgr.34427) 6934 : cluster [DBG] pgmap v3941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:06.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:05 gibba013 bash[30381]: cluster 2021-03-10T16:04:04.134710+0000 mgr.gibba020.yqfnwy (mgr.34427) 6934 : cluster [DBG] pgmap v3941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:06.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:05 gibba020 bash[25448]: cluster 2021-03-10T16:04:04.134710+0000 mgr.gibba020.yqfnwy (mgr.34427) 6934 : cluster [DBG] pgmap v3941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:07.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:06 gibba013 bash[29418]: audit 2021-03-10T16:04:06.628483+0000 mon.a (mon.0) 2647 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:04:07.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:06 gibba013 bash[29418]: audit 2021-03-10T16:04:06.704524+0000 mon.a (mon.0) 2648 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:04:07.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:06 gibba013 bash[30381]: audit 2021-03-10T16:04:06.628483+0000 mon.a (mon.0) 2647 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:04:07.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:06 gibba013 bash[30381]: audit 2021-03-10T16:04:06.704524+0000 mon.a (mon.0) 2648 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:04:07.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:06 gibba020 bash[25448]: audit 2021-03-10T16:04:06.628483+0000 mon.a (mon.0) 2647 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:04:07.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:06 gibba020 bash[25448]: audit 2021-03-10T16:04:06.704524+0000 mon.a (mon.0) 2648 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:04:08.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:07 gibba013 bash[29418]: cluster 2021-03-10T16:04:06.136589+0000 mgr.gibba020.yqfnwy (mgr.34427) 6935 : cluster [DBG] pgmap v3942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:08.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:07 gibba013 bash[29418]: audit 2021-03-10T16:04:06.906465+0000 mon.a (mon.0) 2649 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:04:08.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:07 gibba013 bash[29418]: audit 2021-03-10T16:04:06.907326+0000 mon.a (mon.0) 2650 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:04:08.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:07 gibba013 bash[29418]: audit 2021-03-10T16:04:06.908002+0000 mon.a (mon.0) 2651 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:04:08.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:07 gibba013 bash[29418]: audit 2021-03-10T16:04:06.908689+0000 mon.a (mon.0) 2652 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:04:08.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:07 gibba013 bash[30381]: cluster 2021-03-10T16:04:06.136589+0000 mgr.gibba020.yqfnwy (mgr.34427) 6935 : cluster [DBG] pgmap v3942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:08.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:07 gibba013 bash[30381]: audit 2021-03-10T16:04:06.906465+0000 mon.a (mon.0) 2649 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:04:08.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:07 gibba013 bash[30381]: audit 2021-03-10T16:04:06.907326+0000 mon.a (mon.0) 2650 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:04:08.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:07 gibba013 bash[30381]: audit 2021-03-10T16:04:06.908002+0000 mon.a (mon.0) 2651 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:04:08.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:07 gibba013 bash[30381]: audit 2021-03-10T16:04:06.908689+0000 mon.a (mon.0) 2652 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:04:08.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:07 gibba020 bash[25448]: cluster 2021-03-10T16:04:06.136589+0000 mgr.gibba020.yqfnwy (mgr.34427) 6935 : cluster [DBG] pgmap v3942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:08.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:07 gibba020 bash[25448]: audit 2021-03-10T16:04:06.906465+0000 mon.a (mon.0) 2649 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:04:08.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:07 gibba020 bash[25448]: audit 2021-03-10T16:04:06.907326+0000 mon.a (mon.0) 2650 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:04:08.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:07 gibba020 bash[25448]: audit 2021-03-10T16:04:06.908002+0000 mon.a (mon.0) 2651 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:04:08.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:07 gibba020 bash[25448]: audit 2021-03-10T16:04:06.908689+0000 mon.a (mon.0) 2652 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:04:10.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:09 gibba013 bash[29418]: cluster 2021-03-10T16:04:08.137868+0000 mgr.gibba020.yqfnwy (mgr.34427) 6936 : cluster [DBG] pgmap v3943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:10.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:09 gibba013 bash[30381]: cluster 2021-03-10T16:04:08.137868+0000 mgr.gibba020.yqfnwy (mgr.34427) 6936 : cluster [DBG] pgmap v3943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:10.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:09 gibba020 bash[25448]: cluster 2021-03-10T16:04:08.137868+0000 mgr.gibba020.yqfnwy (mgr.34427) 6936 : cluster [DBG] pgmap v3943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:12.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:11 gibba013 bash[29418]: cluster 2021-03-10T16:04:10.139733+0000 mgr.gibba020.yqfnwy (mgr.34427) 6937 : cluster [DBG] pgmap v3944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:12.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:11 gibba013 bash[30381]: cluster 2021-03-10T16:04:10.139733+0000 mgr.gibba020.yqfnwy (mgr.34427) 6937 : cluster [DBG] pgmap v3944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:12.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:11 gibba020 bash[25448]: cluster 2021-03-10T16:04:10.139733+0000 mgr.gibba020.yqfnwy (mgr.34427) 6937 : cluster [DBG] pgmap v3944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:14.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:13 gibba013 bash[29418]: cluster 2021-03-10T16:04:12.141169+0000 mgr.gibba020.yqfnwy (mgr.34427) 6938 : cluster [DBG] pgmap v3945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:14.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:13 gibba013 bash[30381]: cluster 2021-03-10T16:04:12.141169+0000 mgr.gibba020.yqfnwy (mgr.34427) 6938 : cluster [DBG] pgmap v3945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:14.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:13 gibba020 bash[25448]: cluster 2021-03-10T16:04:12.141169+0000 mgr.gibba020.yqfnwy (mgr.34427) 6938 : cluster [DBG] pgmap v3945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:16.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:15 gibba013 bash[29418]: cluster 2021-03-10T16:04:14.142803+0000 mgr.gibba020.yqfnwy (mgr.34427) 6939 : cluster [DBG] pgmap v3946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:16.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:15 gibba013 bash[30381]: cluster 2021-03-10T16:04:14.142803+0000 mgr.gibba020.yqfnwy (mgr.34427) 6939 : cluster [DBG] pgmap v3946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:16.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:15 gibba020 bash[25448]: cluster 2021-03-10T16:04:14.142803+0000 mgr.gibba020.yqfnwy (mgr.34427) 6939 : cluster [DBG] pgmap v3946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:18.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:17 gibba013 bash[29418]: cluster 2021-03-10T16:04:16.144754+0000 mgr.gibba020.yqfnwy (mgr.34427) 6940 : cluster [DBG] pgmap v3947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:18.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:17 gibba013 bash[30381]: cluster 2021-03-10T16:04:16.144754+0000 mgr.gibba020.yqfnwy (mgr.34427) 6940 : cluster [DBG] pgmap v3947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:18.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:17 gibba020 bash[25448]: cluster 2021-03-10T16:04:16.144754+0000 mgr.gibba020.yqfnwy (mgr.34427) 6940 : cluster [DBG] pgmap v3947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:19.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:18 gibba013 bash[29418]: cephadm 2021-03-10T16:04:17.783252+0000 mgr.gibba020.yqfnwy (mgr.34427) 6941 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:04:19.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:18 gibba013 bash[30381]: cephadm 2021-03-10T16:04:17.783252+0000 mgr.gibba020.yqfnwy (mgr.34427) 6941 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:04:19.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:18 gibba020 bash[25448]: cephadm 2021-03-10T16:04:17.783252+0000 mgr.gibba020.yqfnwy (mgr.34427) 6941 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:04:20.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:19 gibba013 bash[29418]: cluster 2021-03-10T16:04:18.146048+0000 mgr.gibba020.yqfnwy (mgr.34427) 6942 : cluster [DBG] pgmap v3948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:20.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:19 gibba013 bash[30381]: cluster 2021-03-10T16:04:18.146048+0000 mgr.gibba020.yqfnwy (mgr.34427) 6942 : cluster [DBG] pgmap v3948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:20.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:19 gibba020 bash[25448]: cluster 2021-03-10T16:04:18.146048+0000 mgr.gibba020.yqfnwy (mgr.34427) 6942 : cluster [DBG] pgmap v3948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:22.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:21 gibba013 bash[29418]: cluster 2021-03-10T16:04:20.147658+0000 mgr.gibba020.yqfnwy (mgr.34427) 6943 : cluster [DBG] pgmap v3949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:22.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:21 gibba013 bash[30381]: cluster 2021-03-10T16:04:20.147658+0000 mgr.gibba020.yqfnwy (mgr.34427) 6943 : cluster [DBG] pgmap v3949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:22.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:21 gibba020 bash[25448]: cluster 2021-03-10T16:04:20.147658+0000 mgr.gibba020.yqfnwy (mgr.34427) 6943 : cluster [DBG] pgmap v3949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:24.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:23 gibba013 bash[29418]: cluster 2021-03-10T16:04:22.149032+0000 mgr.gibba020.yqfnwy (mgr.34427) 6944 : cluster [DBG] pgmap v3950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:24.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:23 gibba013 bash[30381]: cluster 2021-03-10T16:04:22.149032+0000 mgr.gibba020.yqfnwy (mgr.34427) 6944 : cluster [DBG] pgmap v3950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:24.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:23 gibba020 bash[25448]: cluster 2021-03-10T16:04:22.149032+0000 mgr.gibba020.yqfnwy (mgr.34427) 6944 : cluster [DBG] pgmap v3950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:26.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:25 gibba020 bash[25448]: cluster 2021-03-10T16:04:24.150419+0000 mgr.gibba020.yqfnwy (mgr.34427) 6945 : cluster [DBG] pgmap v3951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:26.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:25 gibba013 bash[29418]: cluster 2021-03-10T16:04:24.150419+0000 mgr.gibba020.yqfnwy (mgr.34427) 6945 : cluster [DBG] pgmap v3951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:26.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:25 gibba013 bash[30381]: cluster 2021-03-10T16:04:24.150419+0000 mgr.gibba020.yqfnwy (mgr.34427) 6945 : cluster [DBG] pgmap v3951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:27.393 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:04:27.623 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:04:27.623 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 4m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:04:27.623 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 3m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:04:27.623 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:04:27.624 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:04:27.624 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:04:27.624 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:04:27.624 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:04:27.625 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:04:27.625 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:04:27.625 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:04:27.625 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:04:27.626 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:04:27.626 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:04:27.626 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:04:27.626 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:04:27.627 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:04:27.627 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:04:27.627 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:04:27.627 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 3m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:04:27.628 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 3m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:04:27.873 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:04:27.873 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:04:27.873 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:04:27.874 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:04:27.874 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:04:27.874 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:04:27.874 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:04:27.875 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:04:27.875 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:04:27.875 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:04:27.875 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:04:27.875 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:04:27.876 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:04:27.876 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:04:27.876 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:04:28.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:27 gibba020 bash[25448]: cluster 2021-03-10T16:04:26.152629+0000 mgr.gibba020.yqfnwy (mgr.34427) 6946 : cluster [DBG] pgmap v3952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:28.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:27 gibba020 bash[25448]: audit 2021-03-10T16:04:27.872992+0000 mon.c (mon.1) 114 : audit [DBG] from='client.? 172.21.2.113:0/4079967945' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:28.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:27 gibba013 bash[29418]: cluster 2021-03-10T16:04:26.152629+0000 mgr.gibba020.yqfnwy (mgr.34427) 6946 : cluster [DBG] pgmap v3952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:28.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:27 gibba013 bash[29418]: audit 2021-03-10T16:04:27.872992+0000 mon.c (mon.1) 114 : audit [DBG] from='client.? 172.21.2.113:0/4079967945' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:28.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:27 gibba013 bash[30381]: cluster 2021-03-10T16:04:26.152629+0000 mgr.gibba020.yqfnwy (mgr.34427) 6946 : cluster [DBG] pgmap v3952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:28.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:27 gibba013 bash[30381]: audit 2021-03-10T16:04:27.872992+0000 mon.c (mon.1) 114 : audit [DBG] from='client.? 172.21.2.113:0/4079967945' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:29.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:28 gibba020 bash[25448]: audit 2021-03-10T16:04:27.383388+0000 mgr.gibba020.yqfnwy (mgr.34427) 6947 : audit [DBG] from='client.48714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:04:29.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:28 gibba020 bash[25448]: audit 2021-03-10T16:04:27.609172+0000 mgr.gibba020.yqfnwy (mgr.34427) 6948 : audit [DBG] from='client.48720 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:04:29.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:28 gibba013 bash[29418]: audit 2021-03-10T16:04:27.383388+0000 mgr.gibba020.yqfnwy (mgr.34427) 6947 : audit [DBG] from='client.48714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:04:29.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:28 gibba013 bash[29418]: audit 2021-03-10T16:04:27.609172+0000 mgr.gibba020.yqfnwy (mgr.34427) 6948 : audit [DBG] from='client.48720 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:04:29.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:28 gibba013 bash[30381]: audit 2021-03-10T16:04:27.383388+0000 mgr.gibba020.yqfnwy (mgr.34427) 6947 : audit [DBG] from='client.48714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:04:29.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:28 gibba013 bash[30381]: audit 2021-03-10T16:04:27.609172+0000 mgr.gibba020.yqfnwy (mgr.34427) 6948 : audit [DBG] from='client.48720 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:04:30.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:29 gibba020 bash[25448]: cluster 2021-03-10T16:04:28.154044+0000 mgr.gibba020.yqfnwy (mgr.34427) 6949 : cluster [DBG] pgmap v3953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:30.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:29 gibba013 bash[29418]: cluster 2021-03-10T16:04:28.154044+0000 mgr.gibba020.yqfnwy (mgr.34427) 6949 : cluster [DBG] pgmap v3953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:30.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:29 gibba013 bash[30381]: cluster 2021-03-10T16:04:28.154044+0000 mgr.gibba020.yqfnwy (mgr.34427) 6949 : cluster [DBG] pgmap v3953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:32.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:31 gibba020 bash[25448]: cluster 2021-03-10T16:04:30.155974+0000 mgr.gibba020.yqfnwy (mgr.34427) 6950 : cluster [DBG] pgmap v3954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:32.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:31 gibba013 bash[29418]: cluster 2021-03-10T16:04:30.155974+0000 mgr.gibba020.yqfnwy (mgr.34427) 6950 : cluster [DBG] pgmap v3954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:32.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:31 gibba013 bash[30381]: cluster 2021-03-10T16:04:30.155974+0000 mgr.gibba020.yqfnwy (mgr.34427) 6950 : cluster [DBG] pgmap v3954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:34.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:33 gibba020 bash[25448]: cluster 2021-03-10T16:04:32.156417+0000 mgr.gibba020.yqfnwy (mgr.34427) 6951 : cluster [DBG] pgmap v3955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:34.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:33 gibba020 bash[25448]: cephadm 2021-03-10T16:04:32.799266+0000 mgr.gibba020.yqfnwy (mgr.34427) 6952 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:04:34.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:33 gibba013 bash[29418]: cluster 2021-03-10T16:04:32.156417+0000 mgr.gibba020.yqfnwy (mgr.34427) 6951 : cluster [DBG] pgmap v3955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:34.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:33 gibba013 bash[29418]: cephadm 2021-03-10T16:04:32.799266+0000 mgr.gibba020.yqfnwy (mgr.34427) 6952 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:04:34.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:33 gibba013 bash[30381]: cluster 2021-03-10T16:04:32.156417+0000 mgr.gibba020.yqfnwy (mgr.34427) 6951 : cluster [DBG] pgmap v3955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:34.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:33 gibba013 bash[30381]: cephadm 2021-03-10T16:04:32.799266+0000 mgr.gibba020.yqfnwy (mgr.34427) 6952 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:04:36.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:35 gibba020 bash[25448]: cluster 2021-03-10T16:04:34.158098+0000 mgr.gibba020.yqfnwy (mgr.34427) 6953 : cluster [DBG] pgmap v3956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:36.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:35 gibba013 bash[29418]: cluster 2021-03-10T16:04:34.158098+0000 mgr.gibba020.yqfnwy (mgr.34427) 6953 : cluster [DBG] pgmap v3956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:36.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:35 gibba013 bash[30381]: cluster 2021-03-10T16:04:34.158098+0000 mgr.gibba020.yqfnwy (mgr.34427) 6953 : cluster [DBG] pgmap v3956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:38.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:37 gibba020 bash[25448]: cluster 2021-03-10T16:04:36.160070+0000 mgr.gibba020.yqfnwy (mgr.34427) 6954 : cluster [DBG] pgmap v3957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:38.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:37 gibba013 bash[29418]: cluster 2021-03-10T16:04:36.160070+0000 mgr.gibba020.yqfnwy (mgr.34427) 6954 : cluster [DBG] pgmap v3957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:38.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:37 gibba013 bash[30381]: cluster 2021-03-10T16:04:36.160070+0000 mgr.gibba020.yqfnwy (mgr.34427) 6954 : cluster [DBG] pgmap v3957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:40.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:39 gibba013 bash[29418]: cluster 2021-03-10T16:04:38.161536+0000 mgr.gibba020.yqfnwy (mgr.34427) 6955 : cluster [DBG] pgmap v3958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:40.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:39 gibba013 bash[30381]: cluster 2021-03-10T16:04:38.161536+0000 mgr.gibba020.yqfnwy (mgr.34427) 6955 : cluster [DBG] pgmap v3958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:40.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:39 gibba020 bash[25448]: cluster 2021-03-10T16:04:38.161536+0000 mgr.gibba020.yqfnwy (mgr.34427) 6955 : cluster [DBG] pgmap v3958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:42.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:41 gibba013 bash[29418]: cluster 2021-03-10T16:04:40.163237+0000 mgr.gibba020.yqfnwy (mgr.34427) 6956 : cluster [DBG] pgmap v3959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:42.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:41 gibba013 bash[30381]: cluster 2021-03-10T16:04:40.163237+0000 mgr.gibba020.yqfnwy (mgr.34427) 6956 : cluster [DBG] pgmap v3959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:42.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:41 gibba020 bash[25448]: cluster 2021-03-10T16:04:40.163237+0000 mgr.gibba020.yqfnwy (mgr.34427) 6956 : cluster [DBG] pgmap v3959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:44.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:43 gibba013 bash[29418]: cluster 2021-03-10T16:04:42.164784+0000 mgr.gibba020.yqfnwy (mgr.34427) 6957 : cluster [DBG] pgmap v3960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:44.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:43 gibba013 bash[30381]: cluster 2021-03-10T16:04:42.164784+0000 mgr.gibba020.yqfnwy (mgr.34427) 6957 : cluster [DBG] pgmap v3960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:44.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:43 gibba020 bash[25448]: cluster 2021-03-10T16:04:42.164784+0000 mgr.gibba020.yqfnwy (mgr.34427) 6957 : cluster [DBG] pgmap v3960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:46.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:45 gibba013 bash[29418]: cluster 2021-03-10T16:04:44.165468+0000 mgr.gibba020.yqfnwy (mgr.34427) 6958 : cluster [DBG] pgmap v3961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:46.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:45 gibba013 bash[30381]: cluster 2021-03-10T16:04:44.165468+0000 mgr.gibba020.yqfnwy (mgr.34427) 6958 : cluster [DBG] pgmap v3961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:46.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:45 gibba020 bash[25448]: cluster 2021-03-10T16:04:44.165468+0000 mgr.gibba020.yqfnwy (mgr.34427) 6958 : cluster [DBG] pgmap v3961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:48.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:47 gibba020 bash[25448]: cluster 2021-03-10T16:04:46.167361+0000 mgr.gibba020.yqfnwy (mgr.34427) 6959 : cluster [DBG] pgmap v3962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:48.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:47 gibba013 bash[29418]: cluster 2021-03-10T16:04:46.167361+0000 mgr.gibba020.yqfnwy (mgr.34427) 6959 : cluster [DBG] pgmap v3962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:48.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:47 gibba013 bash[30381]: cluster 2021-03-10T16:04:46.167361+0000 mgr.gibba020.yqfnwy (mgr.34427) 6959 : cluster [DBG] pgmap v3962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:49.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:48 gibba013 bash[29418]: cephadm 2021-03-10T16:04:47.812857+0000 mgr.gibba020.yqfnwy (mgr.34427) 6960 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:04:49.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:48 gibba013 bash[30381]: cephadm 2021-03-10T16:04:47.812857+0000 mgr.gibba020.yqfnwy (mgr.34427) 6960 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:04:49.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:48 gibba020 bash[25448]: cephadm 2021-03-10T16:04:47.812857+0000 mgr.gibba020.yqfnwy (mgr.34427) 6960 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:04:50.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:50 gibba013 bash[29418]: cluster 2021-03-10T16:04:48.168927+0000 mgr.gibba020.yqfnwy (mgr.34427) 6961 : cluster [DBG] pgmap v3963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:50.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:50 gibba013 bash[30381]: cluster 2021-03-10T16:04:48.168927+0000 mgr.gibba020.yqfnwy (mgr.34427) 6961 : cluster [DBG] pgmap v3963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:50.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:50 gibba020 bash[25448]: cluster 2021-03-10T16:04:48.168927+0000 mgr.gibba020.yqfnwy (mgr.34427) 6961 : cluster [DBG] pgmap v3963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:52.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:52 gibba013 bash[29418]: cluster 2021-03-10T16:04:50.169714+0000 mgr.gibba020.yqfnwy (mgr.34427) 6962 : cluster [DBG] pgmap v3964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:52.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:52 gibba013 bash[30381]: cluster 2021-03-10T16:04:50.169714+0000 mgr.gibba020.yqfnwy (mgr.34427) 6962 : cluster [DBG] pgmap v3964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:52.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:52 gibba020 bash[25448]: cluster 2021-03-10T16:04:50.169714+0000 mgr.gibba020.yqfnwy (mgr.34427) 6962 : cluster [DBG] pgmap v3964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:54.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:54 gibba013 bash[29418]: cluster 2021-03-10T16:04:52.170674+0000 mgr.gibba020.yqfnwy (mgr.34427) 6963 : cluster [DBG] pgmap v3965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:54.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:54 gibba013 bash[30381]: cluster 2021-03-10T16:04:52.170674+0000 mgr.gibba020.yqfnwy (mgr.34427) 6963 : cluster [DBG] pgmap v3965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:54.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:54 gibba020 bash[25448]: cluster 2021-03-10T16:04:52.170674+0000 mgr.gibba020.yqfnwy (mgr.34427) 6963 : cluster [DBG] pgmap v3965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:56.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:56 gibba013 bash[29418]: cluster 2021-03-10T16:04:54.172228+0000 mgr.gibba020.yqfnwy (mgr.34427) 6964 : cluster [DBG] pgmap v3966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:56.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:56 gibba013 bash[30381]: cluster 2021-03-10T16:04:54.172228+0000 mgr.gibba020.yqfnwy (mgr.34427) 6964 : cluster [DBG] pgmap v3966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:56.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:56 gibba020 bash[25448]: cluster 2021-03-10T16:04:54.172228+0000 mgr.gibba020.yqfnwy (mgr.34427) 6964 : cluster [DBG] pgmap v3966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:58.114 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:04:58.343 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:04:58.344 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 5m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:04:58.344 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 3m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:04:58.344 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:04:58.344 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:04:58.345 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:04:58.345 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:04:58.345 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:04:58.345 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:04:58.346 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:04:58.346 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:04:58.346 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:04:58.346 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:04:58.346 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:04:58.347 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:04:58.347 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:04:58.347 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:04:58.347 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:04:58.348 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:04:58.348 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 3m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:04:58.348 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 3m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:04:58.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:58 gibba013 bash[30381]: cluster 2021-03-10T16:04:56.172995+0000 mgr.gibba020.yqfnwy (mgr.34427) 6965 : cluster [DBG] pgmap v3967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:58.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:58 gibba013 bash[29418]: cluster 2021-03-10T16:04:56.172995+0000 mgr.gibba020.yqfnwy (mgr.34427) 6965 : cluster [DBG] pgmap v3967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:58.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:58 gibba020 bash[25448]: cluster 2021-03-10T16:04:56.172995+0000 mgr.gibba020.yqfnwy (mgr.34427) 6965 : cluster [DBG] pgmap v3967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:04:58.590 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:04:58.591 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:04:58.591 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:04:58.591 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:04:58.592 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:04:58.592 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:04:58.592 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:04:58.592 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:04:58.593 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:04:58.593 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:04:58.593 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:04:58.593 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:04:58.593 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:04:58.594 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:04:58.594 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:04:59.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:59 gibba013 bash[29418]: audit 2021-03-10T16:04:58.104256+0000 mgr.gibba020.yqfnwy (mgr.34427) 6966 : audit [DBG] from='client.48732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:04:59.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:04:59 gibba013 bash[29418]: audit 2021-03-10T16:04:58.590921+0000 mon.c (mon.1) 115 : audit [DBG] from='client.? 172.21.2.113:0/3549583913' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:59.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:59 gibba013 bash[30381]: audit 2021-03-10T16:04:58.104256+0000 mgr.gibba020.yqfnwy (mgr.34427) 6966 : audit [DBG] from='client.48732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:04:59.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:04:59 gibba013 bash[30381]: audit 2021-03-10T16:04:58.590921+0000 mon.c (mon.1) 115 : audit [DBG] from='client.? 172.21.2.113:0/3549583913' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:04:59.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:59 gibba020 bash[25448]: audit 2021-03-10T16:04:58.104256+0000 mgr.gibba020.yqfnwy (mgr.34427) 6966 : audit [DBG] from='client.48732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:04:59.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:04:59 gibba020 bash[25448]: audit 2021-03-10T16:04:58.590921+0000 mon.c (mon.1) 115 : audit [DBG] from='client.? 172.21.2.113:0/3549583913' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:00.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:00 gibba013 bash[29418]: cluster 2021-03-10T16:04:58.174283+0000 mgr.gibba020.yqfnwy (mgr.34427) 6967 : cluster [DBG] pgmap v3968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:00.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:00 gibba013 bash[29418]: audit 2021-03-10T16:04:58.329913+0000 mgr.gibba020.yqfnwy (mgr.34427) 6968 : audit [DBG] from='client.48738 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:05:00.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:00 gibba013 bash[30381]: cluster 2021-03-10T16:04:58.174283+0000 mgr.gibba020.yqfnwy (mgr.34427) 6967 : cluster [DBG] pgmap v3968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:00.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:00 gibba013 bash[30381]: audit 2021-03-10T16:04:58.329913+0000 mgr.gibba020.yqfnwy (mgr.34427) 6968 : audit [DBG] from='client.48738 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:05:00.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:00 gibba020 bash[25448]: cluster 2021-03-10T16:04:58.174283+0000 mgr.gibba020.yqfnwy (mgr.34427) 6967 : cluster [DBG] pgmap v3968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:00.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:00 gibba020 bash[25448]: audit 2021-03-10T16:04:58.329913+0000 mgr.gibba020.yqfnwy (mgr.34427) 6968 : audit [DBG] from='client.48738 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:05:02.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:02 gibba013 bash[29418]: cluster 2021-03-10T16:05:00.175425+0000 mgr.gibba020.yqfnwy (mgr.34427) 6969 : cluster [DBG] pgmap v3969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:02.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:02 gibba013 bash[30381]: cluster 2021-03-10T16:05:00.175425+0000 mgr.gibba020.yqfnwy (mgr.34427) 6969 : cluster [DBG] pgmap v3969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:02.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:02 gibba020 bash[25448]: cluster 2021-03-10T16:05:00.175425+0000 mgr.gibba020.yqfnwy (mgr.34427) 6969 : cluster [DBG] pgmap v3969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:03.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:03 gibba013 bash[29418]: audit 2021-03-10T16:05:02.830910+0000 mon.a (mon.0) 2653 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:05:03.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:03 gibba013 bash[29418]: audit 2021-03-10T16:05:03.030556+0000 mon.a (mon.0) 2654 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:05:03.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:03 gibba013 bash[29418]: audit 2021-03-10T16:05:03.033630+0000 mon.a (mon.0) 2655 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:05:03.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:03 gibba013 bash[29418]: audit 2021-03-10T16:05:03.035253+0000 mon.a (mon.0) 2656 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:03.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:03 gibba013 bash[29418]: audit 2021-03-10T16:05:03.037210+0000 mon.a (mon.0) 2657 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:03.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:03 gibba013 bash[29418]: audit 2021-03-10T16:05:03.039027+0000 mon.a (mon.0) 2658 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:03.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:03 gibba013 bash[29418]: audit 2021-03-10T16:05:03.041683+0000 mon.a (mon.0) 2659 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:03.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:03 gibba013 bash[29418]: audit 2021-03-10T16:05:03.043304+0000 mon.a (mon.0) 2660 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:03.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:03 gibba013 bash[30381]: audit 2021-03-10T16:05:02.830910+0000 mon.a (mon.0) 2653 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:05:03.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:03 gibba013 bash[30381]: audit 2021-03-10T16:05:03.030556+0000 mon.a (mon.0) 2654 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:05:03.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:03 gibba013 bash[30381]: audit 2021-03-10T16:05:03.033630+0000 mon.a (mon.0) 2655 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:05:03.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:03 gibba013 bash[30381]: audit 2021-03-10T16:05:03.035253+0000 mon.a (mon.0) 2656 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:03.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:03 gibba013 bash[30381]: audit 2021-03-10T16:05:03.037210+0000 mon.a (mon.0) 2657 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:03.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:03 gibba013 bash[30381]: audit 2021-03-10T16:05:03.039027+0000 mon.a (mon.0) 2658 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:03.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:03 gibba013 bash[30381]: audit 2021-03-10T16:05:03.041683+0000 mon.a (mon.0) 2659 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:03.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:03 gibba013 bash[30381]: audit 2021-03-10T16:05:03.043304+0000 mon.a (mon.0) 2660 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:03.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:03 gibba020 bash[25448]: audit 2021-03-10T16:05:02.830910+0000 mon.a (mon.0) 2653 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:05:03.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:03 gibba020 bash[25448]: audit 2021-03-10T16:05:03.030556+0000 mon.a (mon.0) 2654 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:05:03.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:03 gibba020 bash[25448]: audit 2021-03-10T16:05:03.033630+0000 mon.a (mon.0) 2655 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:05:03.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:03 gibba020 bash[25448]: audit 2021-03-10T16:05:03.035253+0000 mon.a (mon.0) 2656 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:03.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:03 gibba020 bash[25448]: audit 2021-03-10T16:05:03.037210+0000 mon.a (mon.0) 2657 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:03.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:03 gibba020 bash[25448]: audit 2021-03-10T16:05:03.039027+0000 mon.a (mon.0) 2658 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:03.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:03 gibba020 bash[25448]: audit 2021-03-10T16:05:03.041683+0000 mon.a (mon.0) 2659 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:03.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:03 gibba020 bash[25448]: audit 2021-03-10T16:05:03.043304+0000 mon.a (mon.0) 2660 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:04.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:04 gibba013 bash[29418]: cluster 2021-03-10T16:05:02.176088+0000 mgr.gibba020.yqfnwy (mgr.34427) 6970 : cluster [DBG] pgmap v3970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:04.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:04 gibba013 bash[29418]: cephadm 2021-03-10T16:05:02.835215+0000 mgr.gibba020.yqfnwy (mgr.34427) 6971 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:05:04.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:04 gibba013 bash[29418]: cephadm 2021-03-10T16:05:02.837261+0000 mgr.gibba020.yqfnwy (mgr.34427) 6972 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:05:04.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:04 gibba013 bash[29418]: cephadm 2021-03-10T16:05:03.031575+0000 mgr.gibba020.yqfnwy (mgr.34427) 6973 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:05:04.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:04 gibba013 bash[29418]: cephadm 2021-03-10T16:05:03.033434+0000 mgr.gibba020.yqfnwy (mgr.34427) 6974 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:05:04.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:04 gibba013 bash[29418]: cephadm 2021-03-10T16:05:03.035174+0000 mgr.gibba020.yqfnwy (mgr.34427) 6975 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:05:04.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:04 gibba013 bash[29418]: cephadm 2021-03-10T16:05:03.035255+0000 mgr.gibba020.yqfnwy (mgr.34427) 6976 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:05:04.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:04 gibba013 bash[29418]: cephadm 2021-03-10T16:05:03.036802+0000 mgr.gibba020.yqfnwy (mgr.34427) 6977 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:05:04.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:04 gibba013 bash[29418]: cephadm 2021-03-10T16:05:03.036986+0000 mgr.gibba020.yqfnwy (mgr.34427) 6978 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:05:04.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:04 gibba013 bash[29418]: cephadm 2021-03-10T16:05:03.038396+0000 mgr.gibba020.yqfnwy (mgr.34427) 6979 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:05:04.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:04 gibba013 bash[29418]: cephadm 2021-03-10T16:05:03.039627+0000 mgr.gibba020.yqfnwy (mgr.34427) 6980 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:05:04.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:04 gibba013 bash[29418]: cephadm 2021-03-10T16:05:03.039686+0000 mgr.gibba020.yqfnwy (mgr.34427) 6981 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:05:04.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:04 gibba013 bash[29418]: cephadm 2021-03-10T16:05:03.041031+0000 mgr.gibba020.yqfnwy (mgr.34427) 6982 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:05:04.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:04 gibba013 bash[29418]: cephadm 2021-03-10T16:05:03.041502+0000 mgr.gibba020.yqfnwy (mgr.34427) 6983 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:05:04.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:04 gibba013 bash[29418]: cephadm 2021-03-10T16:05:03.042895+0000 mgr.gibba020.yqfnwy (mgr.34427) 6984 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:05:04.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:04 gibba013 bash[29418]: cephadm 2021-03-10T16:05:03.042935+0000 mgr.gibba020.yqfnwy (mgr.34427) 6985 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:05:04.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:04 gibba013 bash[29418]: cephadm 2021-03-10T16:05:03.043050+0000 mgr.gibba020.yqfnwy (mgr.34427) 6986 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:05:04.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:04 gibba013 bash[30381]: cluster 2021-03-10T16:05:02.176088+0000 mgr.gibba020.yqfnwy (mgr.34427) 6970 : cluster [DBG] pgmap v3970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:04.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:04 gibba013 bash[30381]: cephadm 2021-03-10T16:05:02.835215+0000 mgr.gibba020.yqfnwy (mgr.34427) 6971 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:05:04.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:04 gibba013 bash[30381]: cephadm 2021-03-10T16:05:02.837261+0000 mgr.gibba020.yqfnwy (mgr.34427) 6972 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:05:04.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:04 gibba013 bash[30381]: cephadm 2021-03-10T16:05:03.031575+0000 mgr.gibba020.yqfnwy (mgr.34427) 6973 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:05:04.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:04 gibba013 bash[30381]: cephadm 2021-03-10T16:05:03.033434+0000 mgr.gibba020.yqfnwy (mgr.34427) 6974 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:05:04.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:04 gibba013 bash[30381]: cephadm 2021-03-10T16:05:03.035174+0000 mgr.gibba020.yqfnwy (mgr.34427) 6975 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:05:04.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:04 gibba013 bash[30381]: cephadm 2021-03-10T16:05:03.035255+0000 mgr.gibba020.yqfnwy (mgr.34427) 6976 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:05:04.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:04 gibba013 bash[30381]: cephadm 2021-03-10T16:05:03.036802+0000 mgr.gibba020.yqfnwy (mgr.34427) 6977 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:05:04.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:04 gibba013 bash[30381]: cephadm 2021-03-10T16:05:03.036986+0000 mgr.gibba020.yqfnwy (mgr.34427) 6978 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:05:04.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:04 gibba013 bash[30381]: cephadm 2021-03-10T16:05:03.038396+0000 mgr.gibba020.yqfnwy (mgr.34427) 6979 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:05:04.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:04 gibba013 bash[30381]: cephadm 2021-03-10T16:05:03.039627+0000 mgr.gibba020.yqfnwy (mgr.34427) 6980 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:05:04.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:04 gibba013 bash[30381]: cephadm 2021-03-10T16:05:03.039686+0000 mgr.gibba020.yqfnwy (mgr.34427) 6981 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:05:04.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:04 gibba013 bash[30381]: cephadm 2021-03-10T16:05:03.041031+0000 mgr.gibba020.yqfnwy (mgr.34427) 6982 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:05:04.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:04 gibba013 bash[30381]: cephadm 2021-03-10T16:05:03.041502+0000 mgr.gibba020.yqfnwy (mgr.34427) 6983 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:05:04.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:04 gibba013 bash[30381]: cephadm 2021-03-10T16:05:03.042895+0000 mgr.gibba020.yqfnwy (mgr.34427) 6984 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:05:04.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:04 gibba013 bash[30381]: cephadm 2021-03-10T16:05:03.042935+0000 mgr.gibba020.yqfnwy (mgr.34427) 6985 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:05:04.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:04 gibba013 bash[30381]: cephadm 2021-03-10T16:05:03.043050+0000 mgr.gibba020.yqfnwy (mgr.34427) 6986 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:05:04.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:04 gibba020 bash[25448]: cluster 2021-03-10T16:05:02.176088+0000 mgr.gibba020.yqfnwy (mgr.34427) 6970 : cluster [DBG] pgmap v3970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:04.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:04 gibba020 bash[25448]: cephadm 2021-03-10T16:05:02.835215+0000 mgr.gibba020.yqfnwy (mgr.34427) 6971 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:05:04.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:04 gibba020 bash[25448]: cephadm 2021-03-10T16:05:02.837261+0000 mgr.gibba020.yqfnwy (mgr.34427) 6972 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:05:04.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:04 gibba020 bash[25448]: cephadm 2021-03-10T16:05:03.031575+0000 mgr.gibba020.yqfnwy (mgr.34427) 6973 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:05:04.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:04 gibba020 bash[25448]: cephadm 2021-03-10T16:05:03.033434+0000 mgr.gibba020.yqfnwy (mgr.34427) 6974 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:05:04.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:04 gibba020 bash[25448]: cephadm 2021-03-10T16:05:03.035174+0000 mgr.gibba020.yqfnwy (mgr.34427) 6975 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:05:04.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:04 gibba020 bash[25448]: cephadm 2021-03-10T16:05:03.035255+0000 mgr.gibba020.yqfnwy (mgr.34427) 6976 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:05:04.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:04 gibba020 bash[25448]: cephadm 2021-03-10T16:05:03.036802+0000 mgr.gibba020.yqfnwy (mgr.34427) 6977 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:05:04.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:04 gibba020 bash[25448]: cephadm 2021-03-10T16:05:03.036986+0000 mgr.gibba020.yqfnwy (mgr.34427) 6978 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:05:04.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:04 gibba020 bash[25448]: cephadm 2021-03-10T16:05:03.038396+0000 mgr.gibba020.yqfnwy (mgr.34427) 6979 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:05:04.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:04 gibba020 bash[25448]: cephadm 2021-03-10T16:05:03.039627+0000 mgr.gibba020.yqfnwy (mgr.34427) 6980 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:05:04.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:04 gibba020 bash[25448]: cephadm 2021-03-10T16:05:03.039686+0000 mgr.gibba020.yqfnwy (mgr.34427) 6981 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:05:04.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:04 gibba020 bash[25448]: cephadm 2021-03-10T16:05:03.041031+0000 mgr.gibba020.yqfnwy (mgr.34427) 6982 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:05:04.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:04 gibba020 bash[25448]: cephadm 2021-03-10T16:05:03.041502+0000 mgr.gibba020.yqfnwy (mgr.34427) 6983 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:05:04.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:04 gibba020 bash[25448]: cephadm 2021-03-10T16:05:03.042895+0000 mgr.gibba020.yqfnwy (mgr.34427) 6984 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:05:04.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:04 gibba020 bash[25448]: cephadm 2021-03-10T16:05:03.042935+0000 mgr.gibba020.yqfnwy (mgr.34427) 6985 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:05:04.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:04 gibba020 bash[25448]: cephadm 2021-03-10T16:05:03.043050+0000 mgr.gibba020.yqfnwy (mgr.34427) 6986 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:05:06.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:06 gibba013 bash[29418]: cluster 2021-03-10T16:05:04.177357+0000 mgr.gibba020.yqfnwy (mgr.34427) 6987 : cluster [DBG] pgmap v3971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:06.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:06 gibba013 bash[30381]: cluster 2021-03-10T16:05:04.177357+0000 mgr.gibba020.yqfnwy (mgr.34427) 6987 : cluster [DBG] pgmap v3971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:06.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:06 gibba020 bash[25448]: cluster 2021-03-10T16:05:04.177357+0000 mgr.gibba020.yqfnwy (mgr.34427) 6987 : cluster [DBG] pgmap v3971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:07.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:07 gibba013 bash[29418]: audit 2021-03-10T16:05:06.630773+0000 mon.a (mon.0) 2661 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:05:07.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:07 gibba013 bash[29418]: audit 2021-03-10T16:05:06.710221+0000 mon.a (mon.0) 2662 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:05:07.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:07 gibba013 bash[29418]: audit 2021-03-10T16:05:06.918168+0000 mon.a (mon.0) 2663 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T16:05:07.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:07 gibba013 bash[29418]: audit 2021-03-10T16:05:06.919046+0000 mon.a (mon.0) 2664 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:05:07.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:07 gibba013 bash[29418]: audit 2021-03-10T16:05:06.919792+0000 mon.a (mon.0) 2665 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T16:05:07.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:07 gibba013 bash[29418]: audit 2021-03-10T16:05:06.920520+0000 mon.a (mon.0) 2666 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:05:07.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:07 gibba013 bash[30381]: audit 2021-03-10T16:05:06.630773+0000 mon.a (mon.0) 2661 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:05:07.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:07 gibba013 bash[30381]: audit 2021-03-10T16:05:06.710221+0000 mon.a (mon.0) 2662 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:05:07.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:07 gibba013 bash[30381]: audit 2021-03-10T16:05:06.918168+0000 mon.a (mon.0) 2663 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T16:05:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:07 gibba013 bash[30381]: audit 2021-03-10T16:05:06.919046+0000 mon.a (mon.0) 2664 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:05:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:07 gibba013 bash[30381]: audit 2021-03-10T16:05:06.919792+0000 mon.a (mon.0) 2665 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T16:05:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:07 gibba013 bash[30381]: audit 2021-03-10T16:05:06.920520+0000 mon.a (mon.0) 2666 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:05:07.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:07 gibba020 bash[25448]: audit 2021-03-10T16:05:06.630773+0000 mon.a (mon.0) 2661 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:05:07.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:07 gibba020 bash[25448]: audit 2021-03-10T16:05:06.710221+0000 mon.a (mon.0) 2662 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:05:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:07 gibba020 bash[25448]: audit 2021-03-10T16:05:06.918168+0000 mon.a (mon.0) 2663 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T16:05:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:07 gibba020 bash[25448]: audit 2021-03-10T16:05:06.919046+0000 mon.a (mon.0) 2664 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:05:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:07 gibba020 bash[25448]: audit 2021-03-10T16:05:06.919792+0000 mon.a (mon.0) 2665 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T16:05:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:07 gibba020 bash[25448]: audit 2021-03-10T16:05:06.920520+0000 mon.a (mon.0) 2666 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:05:08.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:08 gibba013 bash[29418]: cluster 2021-03-10T16:05:06.178810+0000 mgr.gibba020.yqfnwy (mgr.34427) 6988 : cluster [DBG] pgmap v3972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:08.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:08 gibba013 bash[30381]: cluster 2021-03-10T16:05:06.178810+0000 mgr.gibba020.yqfnwy (mgr.34427) 6988 : cluster [DBG] pgmap v3972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:08.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:08 gibba020 bash[25448]: cluster 2021-03-10T16:05:06.178810+0000 mgr.gibba020.yqfnwy (mgr.34427) 6988 : cluster [DBG] pgmap v3972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:10.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:10 gibba013 bash[29418]: cluster 2021-03-10T16:05:08.180247+0000 mgr.gibba020.yqfnwy (mgr.34427) 6989 : cluster [DBG] pgmap v3973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:10.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:10 gibba013 bash[30381]: cluster 2021-03-10T16:05:08.180247+0000 mgr.gibba020.yqfnwy (mgr.34427) 6989 : cluster [DBG] pgmap v3973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:10.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:10 gibba020 bash[25448]: cluster 2021-03-10T16:05:08.180247+0000 mgr.gibba020.yqfnwy (mgr.34427) 6989 : cluster [DBG] pgmap v3973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:12.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:12 gibba013 bash[29418]: cluster 2021-03-10T16:05:10.180947+0000 mgr.gibba020.yqfnwy (mgr.34427) 6990 : cluster [DBG] pgmap v3974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:12.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:12 gibba013 bash[30381]: cluster 2021-03-10T16:05:10.180947+0000 mgr.gibba020.yqfnwy (mgr.34427) 6990 : cluster [DBG] pgmap v3974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:12.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:12 gibba020 bash[25448]: cluster 2021-03-10T16:05:10.180947+0000 mgr.gibba020.yqfnwy (mgr.34427) 6990 : cluster [DBG] pgmap v3974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:13.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:13 gibba020 bash[25448]: cluster 2021-03-10T16:05:12.181843+0000 mgr.gibba020.yqfnwy (mgr.34427) 6991 : cluster [DBG] pgmap v3975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:13.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:13 gibba013 bash[29418]: cluster 2021-03-10T16:05:12.181843+0000 mgr.gibba020.yqfnwy (mgr.34427) 6991 : cluster [DBG] pgmap v3975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:13.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:13 gibba013 bash[30381]: cluster 2021-03-10T16:05:12.181843+0000 mgr.gibba020.yqfnwy (mgr.34427) 6991 : cluster [DBG] pgmap v3975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:15.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:15 gibba013 bash[29418]: cluster 2021-03-10T16:05:14.182540+0000 mgr.gibba020.yqfnwy (mgr.34427) 6992 : cluster [DBG] pgmap v3976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:15.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:15 gibba013 bash[30381]: cluster 2021-03-10T16:05:14.182540+0000 mgr.gibba020.yqfnwy (mgr.34427) 6992 : cluster [DBG] pgmap v3976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:15.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:15 gibba020 bash[25448]: cluster 2021-03-10T16:05:14.182540+0000 mgr.gibba020.yqfnwy (mgr.34427) 6992 : cluster [DBG] pgmap v3976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:17.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:17 gibba013 bash[29418]: cluster 2021-03-10T16:05:16.184373+0000 mgr.gibba020.yqfnwy (mgr.34427) 6993 : cluster [DBG] pgmap v3977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:17.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:17 gibba013 bash[30381]: cluster 2021-03-10T16:05:16.184373+0000 mgr.gibba020.yqfnwy (mgr.34427) 6993 : cluster [DBG] pgmap v3977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:17.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:17 gibba020 bash[25448]: cluster 2021-03-10T16:05:16.184373+0000 mgr.gibba020.yqfnwy (mgr.34427) 6993 : cluster [DBG] pgmap v3977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:18.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:18 gibba013 bash[29418]: cephadm 2021-03-10T16:05:18.056266+0000 mgr.gibba020.yqfnwy (mgr.34427) 6994 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:05:18.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:18 gibba013 bash[30381]: cephadm 2021-03-10T16:05:18.056266+0000 mgr.gibba020.yqfnwy (mgr.34427) 6994 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:05:18.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:18 gibba020 bash[25448]: cephadm 2021-03-10T16:05:18.056266+0000 mgr.gibba020.yqfnwy (mgr.34427) 6994 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:05:19.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:19 gibba013 bash[29418]: cluster 2021-03-10T16:05:18.185797+0000 mgr.gibba020.yqfnwy (mgr.34427) 6995 : cluster [DBG] pgmap v3978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:19.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:19 gibba013 bash[30381]: cluster 2021-03-10T16:05:18.185797+0000 mgr.gibba020.yqfnwy (mgr.34427) 6995 : cluster [DBG] pgmap v3978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:19.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:19 gibba020 bash[25448]: cluster 2021-03-10T16:05:18.185797+0000 mgr.gibba020.yqfnwy (mgr.34427) 6995 : cluster [DBG] pgmap v3978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:21.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:21 gibba013 bash[29418]: cluster 2021-03-10T16:05:20.186602+0000 mgr.gibba020.yqfnwy (mgr.34427) 6996 : cluster [DBG] pgmap v3979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:21.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:21 gibba013 bash[30381]: cluster 2021-03-10T16:05:20.186602+0000 mgr.gibba020.yqfnwy (mgr.34427) 6996 : cluster [DBG] pgmap v3979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:21.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:21 gibba020 bash[25448]: cluster 2021-03-10T16:05:20.186602+0000 mgr.gibba020.yqfnwy (mgr.34427) 6996 : cluster [DBG] pgmap v3979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:23.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:23 gibba013 bash[29418]: cluster 2021-03-10T16:05:22.187884+0000 mgr.gibba020.yqfnwy (mgr.34427) 6997 : cluster [DBG] pgmap v3980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:23.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:23 gibba013 bash[30381]: cluster 2021-03-10T16:05:22.187884+0000 mgr.gibba020.yqfnwy (mgr.34427) 6997 : cluster [DBG] pgmap v3980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:23.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:23 gibba020 bash[25448]: cluster 2021-03-10T16:05:22.187884+0000 mgr.gibba020.yqfnwy (mgr.34427) 6997 : cluster [DBG] pgmap v3980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:25.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:25 gibba013 bash[29418]: cluster 2021-03-10T16:05:24.189549+0000 mgr.gibba020.yqfnwy (mgr.34427) 6998 : cluster [DBG] pgmap v3981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:25.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:25 gibba013 bash[30381]: cluster 2021-03-10T16:05:24.189549+0000 mgr.gibba020.yqfnwy (mgr.34427) 6998 : cluster [DBG] pgmap v3981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:25.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:25 gibba020 bash[25448]: cluster 2021-03-10T16:05:24.189549+0000 mgr.gibba020.yqfnwy (mgr.34427) 6998 : cluster [DBG] pgmap v3981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:27.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:27 gibba013 bash[29418]: cluster 2021-03-10T16:05:26.190588+0000 mgr.gibba020.yqfnwy (mgr.34427) 6999 : cluster [DBG] pgmap v3982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:27.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:27 gibba013 bash[30381]: cluster 2021-03-10T16:05:26.190588+0000 mgr.gibba020.yqfnwy (mgr.34427) 6999 : cluster [DBG] pgmap v3982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:27.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:27 gibba020 bash[25448]: cluster 2021-03-10T16:05:26.190588+0000 mgr.gibba020.yqfnwy (mgr.34427) 6999 : cluster [DBG] pgmap v3982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:28.831 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:05:29.062 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:05:29.062 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 5m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:05:29.063 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 4m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:05:29.063 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:05:29.063 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:05:29.063 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:05:29.063 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:05:29.064 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:05:29.064 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:05:29.064 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:05:29.064 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:05:29.065 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:05:29.065 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:05:29.065 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:05:29.065 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:05:29.065 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:05:29.066 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:05:29.066 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:05:29.066 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:05:29.066 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 4m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:05:29.067 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 4m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:05:29.310 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:05:29.311 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:05:29.311 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:05:29.311 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:05:29.311 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:05:29.312 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:05:29.312 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:05:29.312 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:05:29.312 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:05:29.313 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:05:29.313 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:05:29.313 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:05:29.313 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:05:29.314 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:05:29.314 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:05:29.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:29 gibba020 bash[25448]: cluster 2021-03-10T16:05:28.191891+0000 mgr.gibba020.yqfnwy (mgr.34427) 7000 : cluster [DBG] pgmap v3983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:29.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:29 gibba020 bash[25448]: audit 2021-03-10T16:05:28.821137+0000 mgr.gibba020.yqfnwy (mgr.34427) 7001 : audit [DBG] from='client.48750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:05:29.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:29 gibba020 bash[25448]: audit 2021-03-10T16:05:29.048049+0000 mgr.gibba020.yqfnwy (mgr.34427) 7002 : audit [DBG] from='client.58738 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:05:29.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:29 gibba020 bash[25448]: audit 2021-03-10T16:05:29.310524+0000 mon.a (mon.0) 2667 : audit [DBG] from='client.? 172.21.2.113:0/450573315' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:30.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:29 gibba013 bash[29418]: cluster 2021-03-10T16:05:28.191891+0000 mgr.gibba020.yqfnwy (mgr.34427) 7000 : cluster [DBG] pgmap v3983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:30.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:29 gibba013 bash[29418]: audit 2021-03-10T16:05:28.821137+0000 mgr.gibba020.yqfnwy (mgr.34427) 7001 : audit [DBG] from='client.48750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:05:30.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:29 gibba013 bash[29418]: audit 2021-03-10T16:05:29.048049+0000 mgr.gibba020.yqfnwy (mgr.34427) 7002 : audit [DBG] from='client.58738 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:05:30.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:29 gibba013 bash[29418]: audit 2021-03-10T16:05:29.310524+0000 mon.a (mon.0) 2667 : audit [DBG] from='client.? 172.21.2.113:0/450573315' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:30.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:29 gibba013 bash[30381]: cluster 2021-03-10T16:05:28.191891+0000 mgr.gibba020.yqfnwy (mgr.34427) 7000 : cluster [DBG] pgmap v3983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:30.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:29 gibba013 bash[30381]: audit 2021-03-10T16:05:28.821137+0000 mgr.gibba020.yqfnwy (mgr.34427) 7001 : audit [DBG] from='client.48750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:05:30.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:29 gibba013 bash[30381]: audit 2021-03-10T16:05:29.048049+0000 mgr.gibba020.yqfnwy (mgr.34427) 7002 : audit [DBG] from='client.58738 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:05:30.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:29 gibba013 bash[30381]: audit 2021-03-10T16:05:29.310524+0000 mon.a (mon.0) 2667 : audit [DBG] from='client.? 172.21.2.113:0/450573315' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:05:31.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:31 gibba020 bash[25448]: cluster 2021-03-10T16:05:30.193642+0000 mgr.gibba020.yqfnwy (mgr.34427) 7003 : cluster [DBG] pgmap v3984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:32.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:31 gibba013 bash[29418]: cluster 2021-03-10T16:05:30.193642+0000 mgr.gibba020.yqfnwy (mgr.34427) 7003 : cluster [DBG] pgmap v3984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:32.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:31 gibba013 bash[30381]: cluster 2021-03-10T16:05:30.193642+0000 mgr.gibba020.yqfnwy (mgr.34427) 7003 : cluster [DBG] pgmap v3984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:33.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:33 gibba020 bash[25448]: cluster 2021-03-10T16:05:32.194550+0000 mgr.gibba020.yqfnwy (mgr.34427) 7004 : cluster [DBG] pgmap v3985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:33.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:33 gibba020 bash[25448]: cephadm 2021-03-10T16:05:33.068332+0000 mgr.gibba020.yqfnwy (mgr.34427) 7005 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:05:34.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:33 gibba013 bash[29418]: cluster 2021-03-10T16:05:32.194550+0000 mgr.gibba020.yqfnwy (mgr.34427) 7004 : cluster [DBG] pgmap v3985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:34.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:33 gibba013 bash[29418]: cephadm 2021-03-10T16:05:33.068332+0000 mgr.gibba020.yqfnwy (mgr.34427) 7005 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:05:34.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:33 gibba013 bash[30381]: cluster 2021-03-10T16:05:32.194550+0000 mgr.gibba020.yqfnwy (mgr.34427) 7004 : cluster [DBG] pgmap v3985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:34.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:33 gibba013 bash[30381]: cephadm 2021-03-10T16:05:33.068332+0000 mgr.gibba020.yqfnwy (mgr.34427) 7005 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:05:35.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:35 gibba020 bash[25448]: cluster 2021-03-10T16:05:34.196163+0000 mgr.gibba020.yqfnwy (mgr.34427) 7006 : cluster [DBG] pgmap v3986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:36.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:35 gibba013 bash[29418]: cluster 2021-03-10T16:05:34.196163+0000 mgr.gibba020.yqfnwy (mgr.34427) 7006 : cluster [DBG] pgmap v3986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:36.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:35 gibba013 bash[30381]: cluster 2021-03-10T16:05:34.196163+0000 mgr.gibba020.yqfnwy (mgr.34427) 7006 : cluster [DBG] pgmap v3986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:37.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:37 gibba020 bash[25448]: cluster 2021-03-10T16:05:36.197765+0000 mgr.gibba020.yqfnwy (mgr.34427) 7007 : cluster [DBG] pgmap v3987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:38.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:37 gibba013 bash[29418]: cluster 2021-03-10T16:05:36.197765+0000 mgr.gibba020.yqfnwy (mgr.34427) 7007 : cluster [DBG] pgmap v3987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:38.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:37 gibba013 bash[30381]: cluster 2021-03-10T16:05:36.197765+0000 mgr.gibba020.yqfnwy (mgr.34427) 7007 : cluster [DBG] pgmap v3987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:39.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:39 gibba020 bash[25448]: cluster 2021-03-10T16:05:38.199170+0000 mgr.gibba020.yqfnwy (mgr.34427) 7008 : cluster [DBG] pgmap v3988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:40.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:39 gibba013 bash[29418]: cluster 2021-03-10T16:05:38.199170+0000 mgr.gibba020.yqfnwy (mgr.34427) 7008 : cluster [DBG] pgmap v3988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:40.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:39 gibba013 bash[30381]: cluster 2021-03-10T16:05:38.199170+0000 mgr.gibba020.yqfnwy (mgr.34427) 7008 : cluster [DBG] pgmap v3988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:41.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:41 gibba020 bash[25448]: cluster 2021-03-10T16:05:40.200904+0000 mgr.gibba020.yqfnwy (mgr.34427) 7009 : cluster [DBG] pgmap v3989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:42.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:41 gibba013 bash[29418]: cluster 2021-03-10T16:05:40.200904+0000 mgr.gibba020.yqfnwy (mgr.34427) 7009 : cluster [DBG] pgmap v3989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:42.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:41 gibba013 bash[30381]: cluster 2021-03-10T16:05:40.200904+0000 mgr.gibba020.yqfnwy (mgr.34427) 7009 : cluster [DBG] pgmap v3989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:43.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:43 gibba020 bash[25448]: cluster 2021-03-10T16:05:42.202304+0000 mgr.gibba020.yqfnwy (mgr.34427) 7010 : cluster [DBG] pgmap v3990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:44.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:43 gibba013 bash[29418]: cluster 2021-03-10T16:05:42.202304+0000 mgr.gibba020.yqfnwy (mgr.34427) 7010 : cluster [DBG] pgmap v3990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:44.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:43 gibba013 bash[30381]: cluster 2021-03-10T16:05:42.202304+0000 mgr.gibba020.yqfnwy (mgr.34427) 7010 : cluster [DBG] pgmap v3990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:45.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:45 gibba020 bash[25448]: cluster 2021-03-10T16:05:44.203367+0000 mgr.gibba020.yqfnwy (mgr.34427) 7011 : cluster [DBG] pgmap v3991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:46.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:45 gibba013 bash[29418]: cluster 2021-03-10T16:05:44.203367+0000 mgr.gibba020.yqfnwy (mgr.34427) 7011 : cluster [DBG] pgmap v3991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:46.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:45 gibba013 bash[30381]: cluster 2021-03-10T16:05:44.203367+0000 mgr.gibba020.yqfnwy (mgr.34427) 7011 : cluster [DBG] pgmap v3991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:48.083 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:47 gibba020 bash[25448]: cluster 2021-03-10T16:05:46.205174+0000 mgr.gibba020.yqfnwy (mgr.34427) 7012 : cluster [DBG] pgmap v3992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:48.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:47 gibba013 bash[29418]: cluster 2021-03-10T16:05:46.205174+0000 mgr.gibba020.yqfnwy (mgr.34427) 7012 : cluster [DBG] pgmap v3992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:48.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:47 gibba013 bash[30381]: cluster 2021-03-10T16:05:46.205174+0000 mgr.gibba020.yqfnwy (mgr.34427) 7012 : cluster [DBG] pgmap v3992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:49.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:48 gibba013 bash[29418]: cephadm 2021-03-10T16:05:48.081996+0000 mgr.gibba020.yqfnwy (mgr.34427) 7013 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:05:49.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:48 gibba013 bash[30381]: cephadm 2021-03-10T16:05:48.081996+0000 mgr.gibba020.yqfnwy (mgr.34427) 7013 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:05:49.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:48 gibba020 bash[25448]: cephadm 2021-03-10T16:05:48.081996+0000 mgr.gibba020.yqfnwy (mgr.34427) 7013 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:05:50.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:49 gibba013 bash[29418]: cluster 2021-03-10T16:05:48.206573+0000 mgr.gibba020.yqfnwy (mgr.34427) 7014 : cluster [DBG] pgmap v3993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:50.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:49 gibba013 bash[30381]: cluster 2021-03-10T16:05:48.206573+0000 mgr.gibba020.yqfnwy (mgr.34427) 7014 : cluster [DBG] pgmap v3993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:50.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:49 gibba020 bash[25448]: cluster 2021-03-10T16:05:48.206573+0000 mgr.gibba020.yqfnwy (mgr.34427) 7014 : cluster [DBG] pgmap v3993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:52.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:51 gibba013 bash[29418]: cluster 2021-03-10T16:05:50.208193+0000 mgr.gibba020.yqfnwy (mgr.34427) 7015 : cluster [DBG] pgmap v3994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:52.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:51 gibba013 bash[30381]: cluster 2021-03-10T16:05:50.208193+0000 mgr.gibba020.yqfnwy (mgr.34427) 7015 : cluster [DBG] pgmap v3994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:52.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:51 gibba020 bash[25448]: cluster 2021-03-10T16:05:50.208193+0000 mgr.gibba020.yqfnwy (mgr.34427) 7015 : cluster [DBG] pgmap v3994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:54.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:53 gibba013 bash[29418]: cluster 2021-03-10T16:05:52.209341+0000 mgr.gibba020.yqfnwy (mgr.34427) 7016 : cluster [DBG] pgmap v3995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:54.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:53 gibba013 bash[30381]: cluster 2021-03-10T16:05:52.209341+0000 mgr.gibba020.yqfnwy (mgr.34427) 7016 : cluster [DBG] pgmap v3995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:54.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:53 gibba020 bash[25448]: cluster 2021-03-10T16:05:52.209341+0000 mgr.gibba020.yqfnwy (mgr.34427) 7016 : cluster [DBG] pgmap v3995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:56.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:55 gibba013 bash[29418]: cluster 2021-03-10T16:05:54.210861+0000 mgr.gibba020.yqfnwy (mgr.34427) 7017 : cluster [DBG] pgmap v3996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:56.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:55 gibba013 bash[30381]: cluster 2021-03-10T16:05:54.210861+0000 mgr.gibba020.yqfnwy (mgr.34427) 7017 : cluster [DBG] pgmap v3996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:56.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:55 gibba020 bash[25448]: cluster 2021-03-10T16:05:54.210861+0000 mgr.gibba020.yqfnwy (mgr.34427) 7017 : cluster [DBG] pgmap v3996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:58.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:57 gibba013 bash[29418]: cluster 2021-03-10T16:05:56.211853+0000 mgr.gibba020.yqfnwy (mgr.34427) 7018 : cluster [DBG] pgmap v3997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:58.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:57 gibba013 bash[30381]: cluster 2021-03-10T16:05:56.211853+0000 mgr.gibba020.yqfnwy (mgr.34427) 7018 : cluster [DBG] pgmap v3997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:58.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:57 gibba020 bash[25448]: cluster 2021-03-10T16:05:56.211853+0000 mgr.gibba020.yqfnwy (mgr.34427) 7018 : cluster [DBG] pgmap v3997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:05:59.551 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:05:59.781 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:05:59.781 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 6m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:05:59.781 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 4m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:05:59.781 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:05:59.782 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:05:59.782 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:05:59.782 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:05:59.783 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:05:59.783 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:05:59.783 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:05:59.783 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:05:59.783 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:05:59.784 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:05:59.784 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:05:59.784 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:05:59.784 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:05:59.785 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:05:59.785 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:05:59.785 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:05:59.785 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 4m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:05:59.785 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 4m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:06:00.056 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:06:00.056 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:06:00.057 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:06:00.057 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:06:00.057 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:06:00.057 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:06:00.058 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:06:00.058 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:06:00.058 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:06:00.058 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:06:00.059 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:06:00.059 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:06:00.059 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:06:00.059 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:06:00.059 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:06:00.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:05:59 gibba013 bash[29418]: cluster 2021-03-10T16:05:58.213141+0000 mgr.gibba020.yqfnwy (mgr.34427) 7019 : cluster [DBG] pgmap v3998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:00.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:05:59 gibba013 bash[30381]: cluster 2021-03-10T16:05:58.213141+0000 mgr.gibba020.yqfnwy (mgr.34427) 7019 : cluster [DBG] pgmap v3998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:00.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:05:59 gibba020 bash[25448]: cluster 2021-03-10T16:05:58.213141+0000 mgr.gibba020.yqfnwy (mgr.34427) 7019 : cluster [DBG] pgmap v3998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:01.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:00 gibba013 bash[29418]: audit 2021-03-10T16:05:59.541103+0000 mgr.gibba020.yqfnwy (mgr.34427) 7020 : audit [DBG] from='client.48768 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:06:01.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:00 gibba013 bash[29418]: audit 2021-03-10T16:05:59.767333+0000 mgr.gibba020.yqfnwy (mgr.34427) 7021 : audit [DBG] from='client.58756 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:06:01.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:00 gibba013 bash[29418]: audit 2021-03-10T16:06:00.056528+0000 mon.a (mon.0) 2668 : audit [DBG] from='client.? 172.21.2.113:0/2494253603' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:01.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:00 gibba013 bash[30381]: audit 2021-03-10T16:05:59.541103+0000 mgr.gibba020.yqfnwy (mgr.34427) 7020 : audit [DBG] from='client.48768 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:06:01.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:00 gibba013 bash[30381]: audit 2021-03-10T16:05:59.767333+0000 mgr.gibba020.yqfnwy (mgr.34427) 7021 : audit [DBG] from='client.58756 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:06:01.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:00 gibba013 bash[30381]: audit 2021-03-10T16:06:00.056528+0000 mon.a (mon.0) 2668 : audit [DBG] from='client.? 172.21.2.113:0/2494253603' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:01.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:00 gibba020 bash[25448]: audit 2021-03-10T16:05:59.541103+0000 mgr.gibba020.yqfnwy (mgr.34427) 7020 : audit [DBG] from='client.48768 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:06:01.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:00 gibba020 bash[25448]: audit 2021-03-10T16:05:59.767333+0000 mgr.gibba020.yqfnwy (mgr.34427) 7021 : audit [DBG] from='client.58756 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:06:01.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:00 gibba020 bash[25448]: audit 2021-03-10T16:06:00.056528+0000 mon.a (mon.0) 2668 : audit [DBG] from='client.? 172.21.2.113:0/2494253603' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:02.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:01 gibba013 bash[29418]: cluster 2021-03-10T16:06:00.214722+0000 mgr.gibba020.yqfnwy (mgr.34427) 7022 : cluster [DBG] pgmap v3999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:02.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:01 gibba013 bash[30381]: cluster 2021-03-10T16:06:00.214722+0000 mgr.gibba020.yqfnwy (mgr.34427) 7022 : cluster [DBG] pgmap v3999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:02.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:01 gibba020 bash[25448]: cluster 2021-03-10T16:06:00.214722+0000 mgr.gibba020.yqfnwy (mgr.34427) 7022 : cluster [DBG] pgmap v3999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:04.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:03 gibba013 bash[29418]: cluster 2021-03-10T16:06:02.215486+0000 mgr.gibba020.yqfnwy (mgr.34427) 7023 : cluster [DBG] pgmap v4000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:04.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:03 gibba013 bash[29418]: audit 2021-03-10T16:06:03.099923+0000 mon.a (mon.0) 2669 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:06:04.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:03 gibba013 bash[29418]: cephadm 2021-03-10T16:06:03.104015+0000 mgr.gibba020.yqfnwy (mgr.34427) 7024 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:06:04.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:03 gibba013 bash[29418]: cephadm 2021-03-10T16:06:03.105352+0000 mgr.gibba020.yqfnwy (mgr.34427) 7025 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:06:04.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:03 gibba013 bash[29418]: audit 2021-03-10T16:06:03.360233+0000 mon.a (mon.0) 2670 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:06:04.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:03 gibba013 bash[29418]: audit 2021-03-10T16:06:03.363765+0000 mon.a (mon.0) 2671 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:06:04.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:03 gibba013 bash[29418]: audit 2021-03-10T16:06:03.365487+0000 mon.a (mon.0) 2672 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:04.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:03 gibba013 bash[29418]: audit 2021-03-10T16:06:03.367368+0000 mon.a (mon.0) 2673 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:04.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:03 gibba013 bash[29418]: audit 2021-03-10T16:06:03.368882+0000 mon.a (mon.0) 2674 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:04.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:03 gibba013 bash[29418]: audit 2021-03-10T16:06:03.371942+0000 mon.a (mon.0) 2675 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:04.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:03 gibba013 bash[29418]: audit 2021-03-10T16:06:03.373835+0000 mon.a (mon.0) 2676 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:04.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:03 gibba013 bash[30381]: cluster 2021-03-10T16:06:02.215486+0000 mgr.gibba020.yqfnwy (mgr.34427) 7023 : cluster [DBG] pgmap v4000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:04.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:03 gibba013 bash[30381]: audit 2021-03-10T16:06:03.099923+0000 mon.a (mon.0) 2669 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:06:04.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:03 gibba013 bash[30381]: cephadm 2021-03-10T16:06:03.104015+0000 mgr.gibba020.yqfnwy (mgr.34427) 7024 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:06:04.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:03 gibba013 bash[30381]: cephadm 2021-03-10T16:06:03.105352+0000 mgr.gibba020.yqfnwy (mgr.34427) 7025 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:06:04.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:03 gibba013 bash[30381]: audit 2021-03-10T16:06:03.360233+0000 mon.a (mon.0) 2670 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:06:04.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:03 gibba013 bash[30381]: audit 2021-03-10T16:06:03.363765+0000 mon.a (mon.0) 2671 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:06:04.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:03 gibba013 bash[30381]: audit 2021-03-10T16:06:03.365487+0000 mon.a (mon.0) 2672 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:04.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:03 gibba013 bash[30381]: audit 2021-03-10T16:06:03.367368+0000 mon.a (mon.0) 2673 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:04.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:03 gibba013 bash[30381]: audit 2021-03-10T16:06:03.368882+0000 mon.a (mon.0) 2674 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:04.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:03 gibba013 bash[30381]: audit 2021-03-10T16:06:03.371942+0000 mon.a (mon.0) 2675 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:04.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:03 gibba013 bash[30381]: audit 2021-03-10T16:06:03.373835+0000 mon.a (mon.0) 2676 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:04.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:03 gibba020 bash[25448]: cluster 2021-03-10T16:06:02.215486+0000 mgr.gibba020.yqfnwy (mgr.34427) 7023 : cluster [DBG] pgmap v4000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:04.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:03 gibba020 bash[25448]: audit 2021-03-10T16:06:03.099923+0000 mon.a (mon.0) 2669 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:06:04.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:03 gibba020 bash[25448]: cephadm 2021-03-10T16:06:03.104015+0000 mgr.gibba020.yqfnwy (mgr.34427) 7024 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:06:04.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:03 gibba020 bash[25448]: cephadm 2021-03-10T16:06:03.105352+0000 mgr.gibba020.yqfnwy (mgr.34427) 7025 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:06:04.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:03 gibba020 bash[25448]: audit 2021-03-10T16:06:03.360233+0000 mon.a (mon.0) 2670 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:06:04.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:03 gibba020 bash[25448]: audit 2021-03-10T16:06:03.363765+0000 mon.a (mon.0) 2671 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:06:04.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:03 gibba020 bash[25448]: audit 2021-03-10T16:06:03.365487+0000 mon.a (mon.0) 2672 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:04.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:03 gibba020 bash[25448]: audit 2021-03-10T16:06:03.367368+0000 mon.a (mon.0) 2673 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:04.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:03 gibba020 bash[25448]: audit 2021-03-10T16:06:03.368882+0000 mon.a (mon.0) 2674 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:04.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:03 gibba020 bash[25448]: audit 2021-03-10T16:06:03.371942+0000 mon.a (mon.0) 2675 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:04.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:03 gibba020 bash[25448]: audit 2021-03-10T16:06:03.373835+0000 mon.a (mon.0) 2676 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:05.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:04 gibba013 bash[29418]: cephadm 2021-03-10T16:06:03.361566+0000 mgr.gibba020.yqfnwy (mgr.34427) 7026 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:06:05.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:04 gibba013 bash[29418]: cephadm 2021-03-10T16:06:03.363701+0000 mgr.gibba020.yqfnwy (mgr.34427) 7027 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:06:05.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:04 gibba013 bash[29418]: cephadm 2021-03-10T16:06:03.365472+0000 mgr.gibba020.yqfnwy (mgr.34427) 7028 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:06:05.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:04 gibba013 bash[29418]: cephadm 2021-03-10T16:06:03.365510+0000 mgr.gibba020.yqfnwy (mgr.34427) 7029 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:06:05.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:04 gibba013 bash[29418]: cephadm 2021-03-10T16:06:03.367193+0000 mgr.gibba020.yqfnwy (mgr.34427) 7030 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:06:05.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:04 gibba013 bash[29418]: cephadm 2021-03-10T16:06:03.367232+0000 mgr.gibba020.yqfnwy (mgr.34427) 7031 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:06:05.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:04 gibba013 bash[29418]: cephadm 2021-03-10T16:06:03.368616+0000 mgr.gibba020.yqfnwy (mgr.34427) 7032 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:06:05.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:04 gibba013 bash[29418]: cephadm 2021-03-10T16:06:03.370025+0000 mgr.gibba020.yqfnwy (mgr.34427) 7033 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:06:05.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:04 gibba013 bash[29418]: cephadm 2021-03-10T16:06:03.370063+0000 mgr.gibba020.yqfnwy (mgr.34427) 7034 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:06:05.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:04 gibba013 bash[29418]: cephadm 2021-03-10T16:06:03.371790+0000 mgr.gibba020.yqfnwy (mgr.34427) 7035 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:06:05.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:04 gibba013 bash[29418]: cephadm 2021-03-10T16:06:03.372129+0000 mgr.gibba020.yqfnwy (mgr.34427) 7036 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:06:05.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:04 gibba013 bash[29418]: cephadm 2021-03-10T16:06:03.373643+0000 mgr.gibba020.yqfnwy (mgr.34427) 7037 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:06:05.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:04 gibba013 bash[29418]: cephadm 2021-03-10T16:06:03.373683+0000 mgr.gibba020.yqfnwy (mgr.34427) 7038 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:06:05.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:04 gibba013 bash[29418]: cephadm 2021-03-10T16:06:03.373791+0000 mgr.gibba020.yqfnwy (mgr.34427) 7039 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:06:05.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:04 gibba013 bash[30381]: cephadm 2021-03-10T16:06:03.361566+0000 mgr.gibba020.yqfnwy (mgr.34427) 7026 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:06:05.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:04 gibba013 bash[30381]: cephadm 2021-03-10T16:06:03.363701+0000 mgr.gibba020.yqfnwy (mgr.34427) 7027 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:06:05.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:04 gibba013 bash[30381]: cephadm 2021-03-10T16:06:03.365472+0000 mgr.gibba020.yqfnwy (mgr.34427) 7028 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:06:05.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:04 gibba013 bash[30381]: cephadm 2021-03-10T16:06:03.365510+0000 mgr.gibba020.yqfnwy (mgr.34427) 7029 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:06:05.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:04 gibba013 bash[30381]: cephadm 2021-03-10T16:06:03.367193+0000 mgr.gibba020.yqfnwy (mgr.34427) 7030 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:06:05.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:04 gibba013 bash[30381]: cephadm 2021-03-10T16:06:03.367232+0000 mgr.gibba020.yqfnwy (mgr.34427) 7031 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:06:05.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:04 gibba013 bash[30381]: cephadm 2021-03-10T16:06:03.368616+0000 mgr.gibba020.yqfnwy (mgr.34427) 7032 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:06:05.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:04 gibba013 bash[30381]: cephadm 2021-03-10T16:06:03.370025+0000 mgr.gibba020.yqfnwy (mgr.34427) 7033 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:06:05.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:04 gibba013 bash[30381]: cephadm 2021-03-10T16:06:03.370063+0000 mgr.gibba020.yqfnwy (mgr.34427) 7034 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:06:05.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:04 gibba013 bash[30381]: cephadm 2021-03-10T16:06:03.371790+0000 mgr.gibba020.yqfnwy (mgr.34427) 7035 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:06:05.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:04 gibba013 bash[30381]: cephadm 2021-03-10T16:06:03.372129+0000 mgr.gibba020.yqfnwy (mgr.34427) 7036 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:06:05.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:04 gibba013 bash[30381]: cephadm 2021-03-10T16:06:03.373643+0000 mgr.gibba020.yqfnwy (mgr.34427) 7037 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:06:05.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:04 gibba013 bash[30381]: cephadm 2021-03-10T16:06:03.373683+0000 mgr.gibba020.yqfnwy (mgr.34427) 7038 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:06:05.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:04 gibba013 bash[30381]: cephadm 2021-03-10T16:06:03.373791+0000 mgr.gibba020.yqfnwy (mgr.34427) 7039 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:06:05.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:04 gibba020 bash[25448]: cephadm 2021-03-10T16:06:03.361566+0000 mgr.gibba020.yqfnwy (mgr.34427) 7026 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:06:05.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:04 gibba020 bash[25448]: cephadm 2021-03-10T16:06:03.363701+0000 mgr.gibba020.yqfnwy (mgr.34427) 7027 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:06:05.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:04 gibba020 bash[25448]: cephadm 2021-03-10T16:06:03.365472+0000 mgr.gibba020.yqfnwy (mgr.34427) 7028 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:06:05.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:04 gibba020 bash[25448]: cephadm 2021-03-10T16:06:03.365510+0000 mgr.gibba020.yqfnwy (mgr.34427) 7029 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:06:05.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:04 gibba020 bash[25448]: cephadm 2021-03-10T16:06:03.367193+0000 mgr.gibba020.yqfnwy (mgr.34427) 7030 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:06:05.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:04 gibba020 bash[25448]: cephadm 2021-03-10T16:06:03.367232+0000 mgr.gibba020.yqfnwy (mgr.34427) 7031 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:06:05.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:04 gibba020 bash[25448]: cephadm 2021-03-10T16:06:03.368616+0000 mgr.gibba020.yqfnwy (mgr.34427) 7032 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:06:05.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:04 gibba020 bash[25448]: cephadm 2021-03-10T16:06:03.370025+0000 mgr.gibba020.yqfnwy (mgr.34427) 7033 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:06:05.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:04 gibba020 bash[25448]: cephadm 2021-03-10T16:06:03.370063+0000 mgr.gibba020.yqfnwy (mgr.34427) 7034 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:06:05.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:04 gibba020 bash[25448]: cephadm 2021-03-10T16:06:03.371790+0000 mgr.gibba020.yqfnwy (mgr.34427) 7035 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:06:05.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:04 gibba020 bash[25448]: cephadm 2021-03-10T16:06:03.372129+0000 mgr.gibba020.yqfnwy (mgr.34427) 7036 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:06:05.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:04 gibba020 bash[25448]: cephadm 2021-03-10T16:06:03.373643+0000 mgr.gibba020.yqfnwy (mgr.34427) 7037 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:06:05.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:04 gibba020 bash[25448]: cephadm 2021-03-10T16:06:03.373683+0000 mgr.gibba020.yqfnwy (mgr.34427) 7038 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:06:05.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:04 gibba020 bash[25448]: cephadm 2021-03-10T16:06:03.373791+0000 mgr.gibba020.yqfnwy (mgr.34427) 7039 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:06:06.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:05 gibba013 bash[29418]: cluster 2021-03-10T16:06:04.216973+0000 mgr.gibba020.yqfnwy (mgr.34427) 7040 : cluster [DBG] pgmap v4001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:06.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:05 gibba013 bash[30381]: cluster 2021-03-10T16:06:04.216973+0000 mgr.gibba020.yqfnwy (mgr.34427) 7040 : cluster [DBG] pgmap v4001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:06.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:05 gibba020 bash[25448]: cluster 2021-03-10T16:06:04.216973+0000 mgr.gibba020.yqfnwy (mgr.34427) 7040 : cluster [DBG] pgmap v4001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:07.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:06 gibba013 bash[29418]: audit 2021-03-10T16:06:06.635432+0000 mon.a (mon.0) 2677 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:06:07.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:06 gibba013 bash[29418]: audit 2021-03-10T16:06:06.713834+0000 mon.a (mon.0) 2678 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:06:07.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:06 gibba013 bash[30381]: audit 2021-03-10T16:06:06.635432+0000 mon.a (mon.0) 2677 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:06:07.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:06 gibba013 bash[30381]: audit 2021-03-10T16:06:06.713834+0000 mon.a (mon.0) 2678 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:06:07.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:06 gibba020 bash[25448]: audit 2021-03-10T16:06:06.635432+0000 mon.a (mon.0) 2677 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:06:07.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:06 gibba020 bash[25448]: audit 2021-03-10T16:06:06.713834+0000 mon.a (mon.0) 2678 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:06:08.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:07 gibba013 bash[29418]: cluster 2021-03-10T16:06:06.218715+0000 mgr.gibba020.yqfnwy (mgr.34427) 7041 : cluster [DBG] pgmap v4002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:08.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:07 gibba013 bash[29418]: audit 2021-03-10T16:06:06.926584+0000 mon.a (mon.0) 2679 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T16:06:08.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:07 gibba013 bash[29418]: audit 2021-03-10T16:06:06.927387+0000 mon.a (mon.0) 2680 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:06:08.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:07 gibba013 bash[29418]: audit 2021-03-10T16:06:06.928099+0000 mon.a (mon.0) 2681 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:06:08.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:07 gibba013 bash[29418]: audit 2021-03-10T16:06:06.928789+0000 mon.a (mon.0) 2682 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:06:08.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:07 gibba013 bash[30381]: cluster 2021-03-10T16:06:06.218715+0000 mgr.gibba020.yqfnwy (mgr.34427) 7041 : cluster [DBG] pgmap v4002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:08.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:07 gibba013 bash[30381]: audit 2021-03-10T16:06:06.926584+0000 mon.a (mon.0) 2679 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T16:06:08.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:07 gibba013 bash[30381]: audit 2021-03-10T16:06:06.927387+0000 mon.a (mon.0) 2680 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:06:08.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:07 gibba013 bash[30381]: audit 2021-03-10T16:06:06.928099+0000 mon.a (mon.0) 2681 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:06:08.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:07 gibba013 bash[30381]: audit 2021-03-10T16:06:06.928789+0000 mon.a (mon.0) 2682 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:06:08.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:07 gibba020 bash[25448]: cluster 2021-03-10T16:06:06.218715+0000 mgr.gibba020.yqfnwy (mgr.34427) 7041 : cluster [DBG] pgmap v4002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:08.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:07 gibba020 bash[25448]: audit 2021-03-10T16:06:06.926584+0000 mon.a (mon.0) 2679 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T16:06:08.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:07 gibba020 bash[25448]: audit 2021-03-10T16:06:06.927387+0000 mon.a (mon.0) 2680 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:06:08.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:07 gibba020 bash[25448]: audit 2021-03-10T16:06:06.928099+0000 mon.a (mon.0) 2681 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:06:08.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:07 gibba020 bash[25448]: audit 2021-03-10T16:06:06.928789+0000 mon.a (mon.0) 2682 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:06:10.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:09 gibba013 bash[29418]: cluster 2021-03-10T16:06:08.220096+0000 mgr.gibba020.yqfnwy (mgr.34427) 7042 : cluster [DBG] pgmap v4003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:10.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:09 gibba013 bash[30381]: cluster 2021-03-10T16:06:08.220096+0000 mgr.gibba020.yqfnwy (mgr.34427) 7042 : cluster [DBG] pgmap v4003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:10.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:09 gibba020 bash[25448]: cluster 2021-03-10T16:06:08.220096+0000 mgr.gibba020.yqfnwy (mgr.34427) 7042 : cluster [DBG] pgmap v4003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:12.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:11 gibba013 bash[29418]: cluster 2021-03-10T16:06:10.221493+0000 mgr.gibba020.yqfnwy (mgr.34427) 7043 : cluster [DBG] pgmap v4004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:12.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:11 gibba013 bash[30381]: cluster 2021-03-10T16:06:10.221493+0000 mgr.gibba020.yqfnwy (mgr.34427) 7043 : cluster [DBG] pgmap v4004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:12.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:11 gibba020 bash[25448]: cluster 2021-03-10T16:06:10.221493+0000 mgr.gibba020.yqfnwy (mgr.34427) 7043 : cluster [DBG] pgmap v4004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:14.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:13 gibba013 bash[29418]: cluster 2021-03-10T16:06:12.222770+0000 mgr.gibba020.yqfnwy (mgr.34427) 7044 : cluster [DBG] pgmap v4005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:14.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:13 gibba013 bash[30381]: cluster 2021-03-10T16:06:12.222770+0000 mgr.gibba020.yqfnwy (mgr.34427) 7044 : cluster [DBG] pgmap v4005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:14.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:13 gibba020 bash[25448]: cluster 2021-03-10T16:06:12.222770+0000 mgr.gibba020.yqfnwy (mgr.34427) 7044 : cluster [DBG] pgmap v4005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:16.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:15 gibba013 bash[29418]: cluster 2021-03-10T16:06:14.223774+0000 mgr.gibba020.yqfnwy (mgr.34427) 7045 : cluster [DBG] pgmap v4006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:16.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:15 gibba013 bash[30381]: cluster 2021-03-10T16:06:14.223774+0000 mgr.gibba020.yqfnwy (mgr.34427) 7045 : cluster [DBG] pgmap v4006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:16.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:15 gibba020 bash[25448]: cluster 2021-03-10T16:06:14.223774+0000 mgr.gibba020.yqfnwy (mgr.34427) 7045 : cluster [DBG] pgmap v4006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:18.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:17 gibba013 bash[29418]: cluster 2021-03-10T16:06:16.225491+0000 mgr.gibba020.yqfnwy (mgr.34427) 7046 : cluster [DBG] pgmap v4007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:18.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:17 gibba013 bash[30381]: cluster 2021-03-10T16:06:16.225491+0000 mgr.gibba020.yqfnwy (mgr.34427) 7046 : cluster [DBG] pgmap v4007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:18.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:17 gibba020 bash[25448]: cluster 2021-03-10T16:06:16.225491+0000 mgr.gibba020.yqfnwy (mgr.34427) 7046 : cluster [DBG] pgmap v4007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:20.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:19 gibba020 bash[25448]: cluster 2021-03-10T16:06:18.226888+0000 mgr.gibba020.yqfnwy (mgr.34427) 7047 : cluster [DBG] pgmap v4008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:20.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:19 gibba020 bash[25448]: cephadm 2021-03-10T16:06:18.389550+0000 mgr.gibba020.yqfnwy (mgr.34427) 7048 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:06:20.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:19 gibba013 bash[29418]: cluster 2021-03-10T16:06:18.226888+0000 mgr.gibba020.yqfnwy (mgr.34427) 7047 : cluster [DBG] pgmap v4008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:20.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:19 gibba013 bash[29418]: cephadm 2021-03-10T16:06:18.389550+0000 mgr.gibba020.yqfnwy (mgr.34427) 7048 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:06:20.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:19 gibba013 bash[30381]: cluster 2021-03-10T16:06:18.226888+0000 mgr.gibba020.yqfnwy (mgr.34427) 7047 : cluster [DBG] pgmap v4008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:20.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:19 gibba013 bash[30381]: cephadm 2021-03-10T16:06:18.389550+0000 mgr.gibba020.yqfnwy (mgr.34427) 7048 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:06:22.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:21 gibba020 bash[25448]: cluster 2021-03-10T16:06:20.228085+0000 mgr.gibba020.yqfnwy (mgr.34427) 7049 : cluster [DBG] pgmap v4009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:22.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:21 gibba013 bash[29418]: cluster 2021-03-10T16:06:20.228085+0000 mgr.gibba020.yqfnwy (mgr.34427) 7049 : cluster [DBG] pgmap v4009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:22.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:21 gibba013 bash[30381]: cluster 2021-03-10T16:06:20.228085+0000 mgr.gibba020.yqfnwy (mgr.34427) 7049 : cluster [DBG] pgmap v4009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:24.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:23 gibba020 bash[25448]: cluster 2021-03-10T16:06:22.229097+0000 mgr.gibba020.yqfnwy (mgr.34427) 7050 : cluster [DBG] pgmap v4010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:24.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:23 gibba013 bash[29418]: cluster 2021-03-10T16:06:22.229097+0000 mgr.gibba020.yqfnwy (mgr.34427) 7050 : cluster [DBG] pgmap v4010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:24.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:23 gibba013 bash[30381]: cluster 2021-03-10T16:06:22.229097+0000 mgr.gibba020.yqfnwy (mgr.34427) 7050 : cluster [DBG] pgmap v4010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:26.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:25 gibba020 bash[25448]: cluster 2021-03-10T16:06:24.230613+0000 mgr.gibba020.yqfnwy (mgr.34427) 7051 : cluster [DBG] pgmap v4011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:26.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:25 gibba013 bash[29418]: cluster 2021-03-10T16:06:24.230613+0000 mgr.gibba020.yqfnwy (mgr.34427) 7051 : cluster [DBG] pgmap v4011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:26.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:25 gibba013 bash[30381]: cluster 2021-03-10T16:06:24.230613+0000 mgr.gibba020.yqfnwy (mgr.34427) 7051 : cluster [DBG] pgmap v4011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:28.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:27 gibba020 bash[25448]: cluster 2021-03-10T16:06:26.232139+0000 mgr.gibba020.yqfnwy (mgr.34427) 7052 : cluster [DBG] pgmap v4012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:28.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:27 gibba013 bash[29418]: cluster 2021-03-10T16:06:26.232139+0000 mgr.gibba020.yqfnwy (mgr.34427) 7052 : cluster [DBG] pgmap v4012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:28.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:27 gibba013 bash[30381]: cluster 2021-03-10T16:06:26.232139+0000 mgr.gibba020.yqfnwy (mgr.34427) 7052 : cluster [DBG] pgmap v4012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:30.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:29 gibba020 bash[25448]: cluster 2021-03-10T16:06:28.233502+0000 mgr.gibba020.yqfnwy (mgr.34427) 7053 : cluster [DBG] pgmap v4013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:30.295 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:06:30.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:29 gibba013 bash[29418]: cluster 2021-03-10T16:06:28.233502+0000 mgr.gibba020.yqfnwy (mgr.34427) 7053 : cluster [DBG] pgmap v4013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:30.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:29 gibba013 bash[30381]: cluster 2021-03-10T16:06:28.233502+0000 mgr.gibba020.yqfnwy (mgr.34427) 7053 : cluster [DBG] pgmap v4013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:30.527 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:06:30.527 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 6m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:06:30.528 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 5m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:06:30.528 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:06:30.528 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:06:30.528 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:06:30.529 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:06:30.529 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:06:30.529 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:06:30.529 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:06:30.529 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:06:30.530 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:06:30.530 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:06:30.530 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:06:30.530 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:06:30.531 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:06:30.531 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:06:30.531 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:06:30.531 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:06:30.531 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 5m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:06:30.532 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 5m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:06:30.778 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:06:30.779 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:06:30.779 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:06:30.779 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:06:30.780 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:06:30.780 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:06:30.780 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:06:30.780 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:06:30.781 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:06:30.781 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:06:30.781 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:06:30.781 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:06:30.781 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:06:30.782 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:06:30.782 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:06:31.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:30 gibba020 bash[25448]: audit 2021-03-10T16:06:30.778949+0000 mon.a (mon.0) 2683 : audit [DBG] from='client.? 172.21.2.113:0/1539400071' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:31.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:30 gibba013 bash[29418]: audit 2021-03-10T16:06:30.778949+0000 mon.a (mon.0) 2683 : audit [DBG] from='client.? 172.21.2.113:0/1539400071' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:31.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:30 gibba013 bash[30381]: audit 2021-03-10T16:06:30.778949+0000 mon.a (mon.0) 2683 : audit [DBG] from='client.? 172.21.2.113:0/1539400071' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:06:32.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:31 gibba013 bash[29418]: cluster 2021-03-10T16:06:30.235087+0000 mgr.gibba020.yqfnwy (mgr.34427) 7054 : cluster [DBG] pgmap v4014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:32.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:31 gibba013 bash[29418]: audit 2021-03-10T16:06:30.285181+0000 mgr.gibba020.yqfnwy (mgr.34427) 7055 : audit [DBG] from='client.48786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:06:32.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:31 gibba013 bash[29418]: audit 2021-03-10T16:06:30.513762+0000 mgr.gibba020.yqfnwy (mgr.34427) 7056 : audit [DBG] from='client.48792 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:06:32.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:31 gibba013 bash[30381]: cluster 2021-03-10T16:06:30.235087+0000 mgr.gibba020.yqfnwy (mgr.34427) 7054 : cluster [DBG] pgmap v4014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:32.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:31 gibba013 bash[30381]: audit 2021-03-10T16:06:30.285181+0000 mgr.gibba020.yqfnwy (mgr.34427) 7055 : audit [DBG] from='client.48786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:06:32.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:31 gibba013 bash[30381]: audit 2021-03-10T16:06:30.513762+0000 mgr.gibba020.yqfnwy (mgr.34427) 7056 : audit [DBG] from='client.48792 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:06:32.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:31 gibba020 bash[25448]: cluster 2021-03-10T16:06:30.235087+0000 mgr.gibba020.yqfnwy (mgr.34427) 7054 : cluster [DBG] pgmap v4014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:32.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:31 gibba020 bash[25448]: audit 2021-03-10T16:06:30.285181+0000 mgr.gibba020.yqfnwy (mgr.34427) 7055 : audit [DBG] from='client.48786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:06:32.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:31 gibba020 bash[25448]: audit 2021-03-10T16:06:30.513762+0000 mgr.gibba020.yqfnwy (mgr.34427) 7056 : audit [DBG] from='client.48792 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:06:34.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:33 gibba013 bash[29418]: cluster 2021-03-10T16:06:32.236230+0000 mgr.gibba020.yqfnwy (mgr.34427) 7057 : cluster [DBG] pgmap v4015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:34.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:33 gibba013 bash[30381]: cluster 2021-03-10T16:06:32.236230+0000 mgr.gibba020.yqfnwy (mgr.34427) 7057 : cluster [DBG] pgmap v4015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:34.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:33 gibba020 bash[25448]: cluster 2021-03-10T16:06:32.236230+0000 mgr.gibba020.yqfnwy (mgr.34427) 7057 : cluster [DBG] pgmap v4015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:35.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:34 gibba013 bash[29418]: cephadm 2021-03-10T16:06:33.404890+0000 mgr.gibba020.yqfnwy (mgr.34427) 7058 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:06:35.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:34 gibba013 bash[30381]: cephadm 2021-03-10T16:06:33.404890+0000 mgr.gibba020.yqfnwy (mgr.34427) 7058 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:06:35.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:34 gibba020 bash[25448]: cephadm 2021-03-10T16:06:33.404890+0000 mgr.gibba020.yqfnwy (mgr.34427) 7058 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:06:36.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:35 gibba013 bash[29418]: cluster 2021-03-10T16:06:34.237915+0000 mgr.gibba020.yqfnwy (mgr.34427) 7059 : cluster [DBG] pgmap v4016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:36.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:35 gibba013 bash[30381]: cluster 2021-03-10T16:06:34.237915+0000 mgr.gibba020.yqfnwy (mgr.34427) 7059 : cluster [DBG] pgmap v4016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:36.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:35 gibba020 bash[25448]: cluster 2021-03-10T16:06:34.237915+0000 mgr.gibba020.yqfnwy (mgr.34427) 7059 : cluster [DBG] pgmap v4016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:38.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:37 gibba013 bash[29418]: cluster 2021-03-10T16:06:36.239762+0000 mgr.gibba020.yqfnwy (mgr.34427) 7060 : cluster [DBG] pgmap v4017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:38.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:37 gibba013 bash[30381]: cluster 2021-03-10T16:06:36.239762+0000 mgr.gibba020.yqfnwy (mgr.34427) 7060 : cluster [DBG] pgmap v4017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:38.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:37 gibba020 bash[25448]: cluster 2021-03-10T16:06:36.239762+0000 mgr.gibba020.yqfnwy (mgr.34427) 7060 : cluster [DBG] pgmap v4017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:40.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:39 gibba013 bash[29418]: cluster 2021-03-10T16:06:38.241184+0000 mgr.gibba020.yqfnwy (mgr.34427) 7061 : cluster [DBG] pgmap v4018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:40.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:39 gibba013 bash[30381]: cluster 2021-03-10T16:06:38.241184+0000 mgr.gibba020.yqfnwy (mgr.34427) 7061 : cluster [DBG] pgmap v4018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:40.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:39 gibba020 bash[25448]: cluster 2021-03-10T16:06:38.241184+0000 mgr.gibba020.yqfnwy (mgr.34427) 7061 : cluster [DBG] pgmap v4018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:42.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:41 gibba013 bash[29418]: cluster 2021-03-10T16:06:40.242744+0000 mgr.gibba020.yqfnwy (mgr.34427) 7062 : cluster [DBG] pgmap v4019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:42.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:41 gibba013 bash[30381]: cluster 2021-03-10T16:06:40.242744+0000 mgr.gibba020.yqfnwy (mgr.34427) 7062 : cluster [DBG] pgmap v4019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:42.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:41 gibba020 bash[25448]: cluster 2021-03-10T16:06:40.242744+0000 mgr.gibba020.yqfnwy (mgr.34427) 7062 : cluster [DBG] pgmap v4019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:44.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:44 gibba013 bash[29418]: cluster 2021-03-10T16:06:42.244216+0000 mgr.gibba020.yqfnwy (mgr.34427) 7063 : cluster [DBG] pgmap v4020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:44.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:44 gibba013 bash[30381]: cluster 2021-03-10T16:06:42.244216+0000 mgr.gibba020.yqfnwy (mgr.34427) 7063 : cluster [DBG] pgmap v4020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:44.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:44 gibba020 bash[25448]: cluster 2021-03-10T16:06:42.244216+0000 mgr.gibba020.yqfnwy (mgr.34427) 7063 : cluster [DBG] pgmap v4020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:46.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:46 gibba013 bash[29418]: cluster 2021-03-10T16:06:44.245376+0000 mgr.gibba020.yqfnwy (mgr.34427) 7064 : cluster [DBG] pgmap v4021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:46.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:46 gibba013 bash[30381]: cluster 2021-03-10T16:06:44.245376+0000 mgr.gibba020.yqfnwy (mgr.34427) 7064 : cluster [DBG] pgmap v4021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:46.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:46 gibba020 bash[25448]: cluster 2021-03-10T16:06:44.245376+0000 mgr.gibba020.yqfnwy (mgr.34427) 7064 : cluster [DBG] pgmap v4021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:48.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:48 gibba013 bash[29418]: cluster 2021-03-10T16:06:46.247248+0000 mgr.gibba020.yqfnwy (mgr.34427) 7065 : cluster [DBG] pgmap v4022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:48.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:48 gibba013 bash[30381]: cluster 2021-03-10T16:06:46.247248+0000 mgr.gibba020.yqfnwy (mgr.34427) 7065 : cluster [DBG] pgmap v4022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:48.421 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:48 gibba020 bash[25448]: cluster 2021-03-10T16:06:46.247248+0000 mgr.gibba020.yqfnwy (mgr.34427) 7065 : cluster [DBG] pgmap v4022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:50.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:50 gibba013 bash[29418]: cluster 2021-03-10T16:06:48.248649+0000 mgr.gibba020.yqfnwy (mgr.34427) 7066 : cluster [DBG] pgmap v4023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:50.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:50 gibba013 bash[29418]: cephadm 2021-03-10T16:06:48.420651+0000 mgr.gibba020.yqfnwy (mgr.34427) 7067 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:06:50.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:50 gibba013 bash[30381]: cluster 2021-03-10T16:06:48.248649+0000 mgr.gibba020.yqfnwy (mgr.34427) 7066 : cluster [DBG] pgmap v4023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:50.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:50 gibba013 bash[30381]: cephadm 2021-03-10T16:06:48.420651+0000 mgr.gibba020.yqfnwy (mgr.34427) 7067 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:06:50.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:50 gibba020 bash[25448]: cluster 2021-03-10T16:06:48.248649+0000 mgr.gibba020.yqfnwy (mgr.34427) 7066 : cluster [DBG] pgmap v4023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:50.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:50 gibba020 bash[25448]: cephadm 2021-03-10T16:06:48.420651+0000 mgr.gibba020.yqfnwy (mgr.34427) 7067 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:06:52.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:52 gibba013 bash[29418]: cluster 2021-03-10T16:06:50.249964+0000 mgr.gibba020.yqfnwy (mgr.34427) 7068 : cluster [DBG] pgmap v4024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:52.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:52 gibba013 bash[30381]: cluster 2021-03-10T16:06:50.249964+0000 mgr.gibba020.yqfnwy (mgr.34427) 7068 : cluster [DBG] pgmap v4024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:52.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:52 gibba020 bash[25448]: cluster 2021-03-10T16:06:50.249964+0000 mgr.gibba020.yqfnwy (mgr.34427) 7068 : cluster [DBG] pgmap v4024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:54.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:54 gibba013 bash[29418]: cluster 2021-03-10T16:06:52.251291+0000 mgr.gibba020.yqfnwy (mgr.34427) 7069 : cluster [DBG] pgmap v4025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:54.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:54 gibba013 bash[30381]: cluster 2021-03-10T16:06:52.251291+0000 mgr.gibba020.yqfnwy (mgr.34427) 7069 : cluster [DBG] pgmap v4025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:54.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:54 gibba020 bash[25448]: cluster 2021-03-10T16:06:52.251291+0000 mgr.gibba020.yqfnwy (mgr.34427) 7069 : cluster [DBG] pgmap v4025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:56.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:56 gibba013 bash[29418]: cluster 2021-03-10T16:06:54.252992+0000 mgr.gibba020.yqfnwy (mgr.34427) 7070 : cluster [DBG] pgmap v4026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:56.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:56 gibba013 bash[30381]: cluster 2021-03-10T16:06:54.252992+0000 mgr.gibba020.yqfnwy (mgr.34427) 7070 : cluster [DBG] pgmap v4026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:56.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:56 gibba020 bash[25448]: cluster 2021-03-10T16:06:54.252992+0000 mgr.gibba020.yqfnwy (mgr.34427) 7070 : cluster [DBG] pgmap v4026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:58.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:06:58 gibba013 bash[29418]: cluster 2021-03-10T16:06:56.254732+0000 mgr.gibba020.yqfnwy (mgr.34427) 7071 : cluster [DBG] pgmap v4027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:58.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:06:58 gibba013 bash[30381]: cluster 2021-03-10T16:06:56.254732+0000 mgr.gibba020.yqfnwy (mgr.34427) 7071 : cluster [DBG] pgmap v4027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:06:58.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:06:58 gibba020 bash[25448]: cluster 2021-03-10T16:06:56.254732+0000 mgr.gibba020.yqfnwy (mgr.34427) 7071 : cluster [DBG] pgmap v4027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:00.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:00 gibba013 bash[29418]: cluster 2021-03-10T16:06:58.256301+0000 mgr.gibba020.yqfnwy (mgr.34427) 7072 : cluster [DBG] pgmap v4028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:00.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:00 gibba013 bash[30381]: cluster 2021-03-10T16:06:58.256301+0000 mgr.gibba020.yqfnwy (mgr.34427) 7072 : cluster [DBG] pgmap v4028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:00.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:00 gibba020 bash[25448]: cluster 2021-03-10T16:06:58.256301+0000 mgr.gibba020.yqfnwy (mgr.34427) 7072 : cluster [DBG] pgmap v4028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:01.020 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:07:01.250 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:07:01.250 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 7m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:07:01.250 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 5m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:07:01.251 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:07:01.251 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:07:01.251 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:07:01.251 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:07:01.252 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:07:01.252 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:07:01.252 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:07:01.252 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:07:01.252 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:07:01.253 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:07:01.253 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:07:01.253 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:07:01.253 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:07:01.254 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:07:01.254 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:07:01.254 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:07:01.255 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 5m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:07:01.255 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 5m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:07:01.497 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:07:01.497 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:07:01.498 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:07:01.498 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:07:01.498 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:07:01.499 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:07:01.499 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:07:01.499 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:07:01.499 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:07:01.499 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:07:01.500 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:07:01.500 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:07:01.500 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:07:01.500 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:07:01.500 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:07:02.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:02 gibba013 bash[29418]: cluster 2021-03-10T16:07:00.257746+0000 mgr.gibba020.yqfnwy (mgr.34427) 7073 : cluster [DBG] pgmap v4029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:02.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:02 gibba013 bash[29418]: audit 2021-03-10T16:07:01.010803+0000 mgr.gibba020.yqfnwy (mgr.34427) 7074 : audit [DBG] from='client.48804 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:07:02.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:02 gibba013 bash[29418]: audit 2021-03-10T16:07:01.497793+0000 mon.a (mon.0) 2684 : audit [DBG] from='client.? 172.21.2.113:0/1165305465' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:02.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:02 gibba013 bash[30381]: cluster 2021-03-10T16:07:00.257746+0000 mgr.gibba020.yqfnwy (mgr.34427) 7073 : cluster [DBG] pgmap v4029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:02.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:02 gibba013 bash[30381]: audit 2021-03-10T16:07:01.010803+0000 mgr.gibba020.yqfnwy (mgr.34427) 7074 : audit [DBG] from='client.48804 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:07:02.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:02 gibba013 bash[30381]: audit 2021-03-10T16:07:01.497793+0000 mon.a (mon.0) 2684 : audit [DBG] from='client.? 172.21.2.113:0/1165305465' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:02.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:02 gibba020 bash[25448]: cluster 2021-03-10T16:07:00.257746+0000 mgr.gibba020.yqfnwy (mgr.34427) 7073 : cluster [DBG] pgmap v4029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:02.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:02 gibba020 bash[25448]: audit 2021-03-10T16:07:01.010803+0000 mgr.gibba020.yqfnwy (mgr.34427) 7074 : audit [DBG] from='client.48804 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:07:02.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:02 gibba020 bash[25448]: audit 2021-03-10T16:07:01.497793+0000 mon.a (mon.0) 2684 : audit [DBG] from='client.? 172.21.2.113:0/1165305465' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:03.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:03 gibba013 bash[29418]: audit 2021-03-10T16:07:01.235692+0000 mgr.gibba020.yqfnwy (mgr.34427) 7075 : audit [DBG] from='client.48810 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:07:03.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:03 gibba013 bash[30381]: audit 2021-03-10T16:07:01.235692+0000 mgr.gibba020.yqfnwy (mgr.34427) 7075 : audit [DBG] from='client.48810 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:07:03.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:03 gibba020 bash[25448]: audit 2021-03-10T16:07:01.235692+0000 mgr.gibba020.yqfnwy (mgr.34427) 7075 : audit [DBG] from='client.48810 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:07:04.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:04 gibba020 bash[25448]: cluster 2021-03-10T16:07:02.259189+0000 mgr.gibba020.yqfnwy (mgr.34427) 7076 : cluster [DBG] pgmap v4030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:04.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:04 gibba020 bash[25448]: audit 2021-03-10T16:07:03.438659+0000 mon.a (mon.0) 2685 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:07:04.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:04 gibba020 bash[25448]: audit 2021-03-10T16:07:03.642778+0000 mon.a (mon.0) 2686 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:07:04.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:04 gibba020 bash[25448]: audit 2021-03-10T16:07:03.648919+0000 mon.a (mon.0) 2687 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:07:04.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:04 gibba020 bash[25448]: audit 2021-03-10T16:07:03.856626+0000 mon.a (mon.0) 2688 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:07:04.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:04 gibba020 bash[25448]: audit 2021-03-10T16:07:03.860357+0000 mon.a (mon.0) 2689 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:07:04.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:04 gibba020 bash[25448]: audit 2021-03-10T16:07:03.861751+0000 mon.a (mon.0) 2690 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:04.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:04 gibba020 bash[25448]: audit 2021-03-10T16:07:03.863223+0000 mon.a (mon.0) 2691 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:04.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:04 gibba020 bash[25448]: audit 2021-03-10T16:07:03.864679+0000 mon.a (mon.0) 2692 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:04.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:04 gibba020 bash[25448]: audit 2021-03-10T16:07:03.867974+0000 mon.a (mon.0) 2693 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:04.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:04 gibba020 bash[25448]: audit 2021-03-10T16:07:03.869764+0000 mon.a (mon.0) 2694 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:04.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:04 gibba013 bash[29418]: cluster 2021-03-10T16:07:02.259189+0000 mgr.gibba020.yqfnwy (mgr.34427) 7076 : cluster [DBG] pgmap v4030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:04.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:04 gibba013 bash[29418]: audit 2021-03-10T16:07:03.438659+0000 mon.a (mon.0) 2685 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:07:04.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:04 gibba013 bash[29418]: audit 2021-03-10T16:07:03.642778+0000 mon.a (mon.0) 2686 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:07:04.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:04 gibba013 bash[29418]: audit 2021-03-10T16:07:03.648919+0000 mon.a (mon.0) 2687 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:07:04.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:04 gibba013 bash[29418]: audit 2021-03-10T16:07:03.856626+0000 mon.a (mon.0) 2688 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:07:04.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:04 gibba013 bash[29418]: audit 2021-03-10T16:07:03.860357+0000 mon.a (mon.0) 2689 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:07:04.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:04 gibba013 bash[29418]: audit 2021-03-10T16:07:03.861751+0000 mon.a (mon.0) 2690 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:04.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:04 gibba013 bash[29418]: audit 2021-03-10T16:07:03.863223+0000 mon.a (mon.0) 2691 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:04.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:04 gibba013 bash[29418]: audit 2021-03-10T16:07:03.864679+0000 mon.a (mon.0) 2692 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:04.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:04 gibba013 bash[29418]: audit 2021-03-10T16:07:03.867974+0000 mon.a (mon.0) 2693 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:04.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:04 gibba013 bash[29418]: audit 2021-03-10T16:07:03.869764+0000 mon.a (mon.0) 2694 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:04.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:04 gibba013 bash[30381]: cluster 2021-03-10T16:07:02.259189+0000 mgr.gibba020.yqfnwy (mgr.34427) 7076 : cluster [DBG] pgmap v4030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:04.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:04 gibba013 bash[30381]: audit 2021-03-10T16:07:03.438659+0000 mon.a (mon.0) 2685 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:07:04.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:04 gibba013 bash[30381]: audit 2021-03-10T16:07:03.642778+0000 mon.a (mon.0) 2686 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:07:04.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:04 gibba013 bash[30381]: audit 2021-03-10T16:07:03.648919+0000 mon.a (mon.0) 2687 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:07:04.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:04 gibba013 bash[30381]: audit 2021-03-10T16:07:03.856626+0000 mon.a (mon.0) 2688 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:07:04.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:04 gibba013 bash[30381]: audit 2021-03-10T16:07:03.860357+0000 mon.a (mon.0) 2689 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:07:04.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:04 gibba013 bash[30381]: audit 2021-03-10T16:07:03.861751+0000 mon.a (mon.0) 2690 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:04.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:04 gibba013 bash[30381]: audit 2021-03-10T16:07:03.863223+0000 mon.a (mon.0) 2691 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:04.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:04 gibba013 bash[30381]: audit 2021-03-10T16:07:03.864679+0000 mon.a (mon.0) 2692 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:04.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:04 gibba013 bash[30381]: audit 2021-03-10T16:07:03.867974+0000 mon.a (mon.0) 2693 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:04.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:04 gibba013 bash[30381]: audit 2021-03-10T16:07:03.869764+0000 mon.a (mon.0) 2694 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:05.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:05 gibba013 bash[29418]: cephadm 2021-03-10T16:07:03.642157+0000 mgr.gibba020.yqfnwy (mgr.34427) 7077 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:07:05.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:05 gibba013 bash[29418]: cephadm 2021-03-10T16:07:03.648161+0000 mgr.gibba020.yqfnwy (mgr.34427) 7078 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:07:05.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:05 gibba013 bash[29418]: cephadm 2021-03-10T16:07:03.858163+0000 mgr.gibba020.yqfnwy (mgr.34427) 7079 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:07:05.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:05 gibba013 bash[29418]: cephadm 2021-03-10T16:07:03.860003+0000 mgr.gibba020.yqfnwy (mgr.34427) 7080 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:07:05.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:05 gibba013 bash[29418]: cephadm 2021-03-10T16:07:03.861351+0000 mgr.gibba020.yqfnwy (mgr.34427) 7081 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:07:05.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:05 gibba013 bash[29418]: cephadm 2021-03-10T16:07:03.861397+0000 mgr.gibba020.yqfnwy (mgr.34427) 7082 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:07:05.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:05 gibba013 bash[29418]: cephadm 2021-03-10T16:07:03.862955+0000 mgr.gibba020.yqfnwy (mgr.34427) 7083 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:07:05.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:05 gibba013 bash[29418]: cephadm 2021-03-10T16:07:03.862999+0000 mgr.gibba020.yqfnwy (mgr.34427) 7084 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:07:05.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:05 gibba013 bash[29418]: cephadm 2021-03-10T16:07:03.864573+0000 mgr.gibba020.yqfnwy (mgr.34427) 7085 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:07:05.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:05 gibba013 bash[29418]: cephadm 2021-03-10T16:07:03.866042+0000 mgr.gibba020.yqfnwy (mgr.34427) 7086 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:07:05.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:05 gibba013 bash[29418]: cephadm 2021-03-10T16:07:03.866089+0000 mgr.gibba020.yqfnwy (mgr.34427) 7087 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:07:05.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:05 gibba013 bash[29418]: cephadm 2021-03-10T16:07:03.867725+0000 mgr.gibba020.yqfnwy (mgr.34427) 7088 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:07:05.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:05 gibba013 bash[29418]: cephadm 2021-03-10T16:07:03.868251+0000 mgr.gibba020.yqfnwy (mgr.34427) 7089 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:07:05.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:05 gibba013 bash[29418]: cephadm 2021-03-10T16:07:03.869749+0000 mgr.gibba020.yqfnwy (mgr.34427) 7090 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:07:05.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:05 gibba013 bash[29418]: cephadm 2021-03-10T16:07:03.869799+0000 mgr.gibba020.yqfnwy (mgr.34427) 7091 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:07:05.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:05 gibba013 bash[29418]: cephadm 2021-03-10T16:07:03.869939+0000 mgr.gibba020.yqfnwy (mgr.34427) 7092 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:07:05.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:05 gibba013 bash[30381]: cephadm 2021-03-10T16:07:03.642157+0000 mgr.gibba020.yqfnwy (mgr.34427) 7077 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:07:05.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:05 gibba013 bash[30381]: cephadm 2021-03-10T16:07:03.648161+0000 mgr.gibba020.yqfnwy (mgr.34427) 7078 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:07:05.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:05 gibba013 bash[30381]: cephadm 2021-03-10T16:07:03.858163+0000 mgr.gibba020.yqfnwy (mgr.34427) 7079 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:07:05.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:05 gibba013 bash[30381]: cephadm 2021-03-10T16:07:03.860003+0000 mgr.gibba020.yqfnwy (mgr.34427) 7080 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:07:05.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:05 gibba013 bash[30381]: cephadm 2021-03-10T16:07:03.861351+0000 mgr.gibba020.yqfnwy (mgr.34427) 7081 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:07:05.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:05 gibba013 bash[30381]: cephadm 2021-03-10T16:07:03.861397+0000 mgr.gibba020.yqfnwy (mgr.34427) 7082 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:07:05.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:05 gibba013 bash[30381]: cephadm 2021-03-10T16:07:03.862955+0000 mgr.gibba020.yqfnwy (mgr.34427) 7083 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:07:05.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:05 gibba013 bash[30381]: cephadm 2021-03-10T16:07:03.862999+0000 mgr.gibba020.yqfnwy (mgr.34427) 7084 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:07:05.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:05 gibba013 bash[30381]: cephadm 2021-03-10T16:07:03.864573+0000 mgr.gibba020.yqfnwy (mgr.34427) 7085 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:07:05.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:05 gibba013 bash[30381]: cephadm 2021-03-10T16:07:03.866042+0000 mgr.gibba020.yqfnwy (mgr.34427) 7086 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:07:05.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:05 gibba013 bash[30381]: cephadm 2021-03-10T16:07:03.866089+0000 mgr.gibba020.yqfnwy (mgr.34427) 7087 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:07:05.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:05 gibba013 bash[30381]: cephadm 2021-03-10T16:07:03.867725+0000 mgr.gibba020.yqfnwy (mgr.34427) 7088 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:07:05.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:05 gibba013 bash[30381]: cephadm 2021-03-10T16:07:03.868251+0000 mgr.gibba020.yqfnwy (mgr.34427) 7089 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:07:05.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:05 gibba013 bash[30381]: cephadm 2021-03-10T16:07:03.869749+0000 mgr.gibba020.yqfnwy (mgr.34427) 7090 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:07:05.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:05 gibba013 bash[30381]: cephadm 2021-03-10T16:07:03.869799+0000 mgr.gibba020.yqfnwy (mgr.34427) 7091 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:07:05.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:05 gibba013 bash[30381]: cephadm 2021-03-10T16:07:03.869939+0000 mgr.gibba020.yqfnwy (mgr.34427) 7092 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:07:05.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:05 gibba020 bash[25448]: cephadm 2021-03-10T16:07:03.642157+0000 mgr.gibba020.yqfnwy (mgr.34427) 7077 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:07:05.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:05 gibba020 bash[25448]: cephadm 2021-03-10T16:07:03.648161+0000 mgr.gibba020.yqfnwy (mgr.34427) 7078 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:07:05.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:05 gibba020 bash[25448]: cephadm 2021-03-10T16:07:03.858163+0000 mgr.gibba020.yqfnwy (mgr.34427) 7079 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:07:05.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:05 gibba020 bash[25448]: cephadm 2021-03-10T16:07:03.860003+0000 mgr.gibba020.yqfnwy (mgr.34427) 7080 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:07:05.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:05 gibba020 bash[25448]: cephadm 2021-03-10T16:07:03.861351+0000 mgr.gibba020.yqfnwy (mgr.34427) 7081 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:07:05.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:05 gibba020 bash[25448]: cephadm 2021-03-10T16:07:03.861397+0000 mgr.gibba020.yqfnwy (mgr.34427) 7082 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:07:05.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:05 gibba020 bash[25448]: cephadm 2021-03-10T16:07:03.862955+0000 mgr.gibba020.yqfnwy (mgr.34427) 7083 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:07:05.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:05 gibba020 bash[25448]: cephadm 2021-03-10T16:07:03.862999+0000 mgr.gibba020.yqfnwy (mgr.34427) 7084 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:07:05.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:05 gibba020 bash[25448]: cephadm 2021-03-10T16:07:03.864573+0000 mgr.gibba020.yqfnwy (mgr.34427) 7085 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:07:05.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:05 gibba020 bash[25448]: cephadm 2021-03-10T16:07:03.866042+0000 mgr.gibba020.yqfnwy (mgr.34427) 7086 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:07:05.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:05 gibba020 bash[25448]: cephadm 2021-03-10T16:07:03.866089+0000 mgr.gibba020.yqfnwy (mgr.34427) 7087 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:07:05.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:05 gibba020 bash[25448]: cephadm 2021-03-10T16:07:03.867725+0000 mgr.gibba020.yqfnwy (mgr.34427) 7088 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:07:05.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:05 gibba020 bash[25448]: cephadm 2021-03-10T16:07:03.868251+0000 mgr.gibba020.yqfnwy (mgr.34427) 7089 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:07:05.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:05 gibba020 bash[25448]: cephadm 2021-03-10T16:07:03.869749+0000 mgr.gibba020.yqfnwy (mgr.34427) 7090 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:07:05.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:05 gibba020 bash[25448]: cephadm 2021-03-10T16:07:03.869799+0000 mgr.gibba020.yqfnwy (mgr.34427) 7091 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:07:05.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:05 gibba020 bash[25448]: cephadm 2021-03-10T16:07:03.869939+0000 mgr.gibba020.yqfnwy (mgr.34427) 7092 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:07:06.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:06 gibba013 bash[29418]: cluster 2021-03-10T16:07:04.260909+0000 mgr.gibba020.yqfnwy (mgr.34427) 7093 : cluster [DBG] pgmap v4031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:06.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:06 gibba013 bash[30381]: cluster 2021-03-10T16:07:04.260909+0000 mgr.gibba020.yqfnwy (mgr.34427) 7093 : cluster [DBG] pgmap v4031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:06.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:06 gibba020 bash[25448]: cluster 2021-03-10T16:07:04.260909+0000 mgr.gibba020.yqfnwy (mgr.34427) 7093 : cluster [DBG] pgmap v4031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:07.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:07 gibba013 bash[29418]: audit 2021-03-10T16:07:06.639041+0000 mon.a (mon.0) 2695 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:07:07.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:07 gibba013 bash[29418]: audit 2021-03-10T16:07:06.718245+0000 mon.a (mon.0) 2696 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:07:07.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:07 gibba013 bash[29418]: audit 2021-03-10T16:07:06.937056+0000 mon.a (mon.0) 2697 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:07:07.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:07 gibba013 bash[29418]: audit 2021-03-10T16:07:06.938177+0000 mon.a (mon.0) 2698 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:07:07.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:07 gibba013 bash[29418]: audit 2021-03-10T16:07:06.939197+0000 mon.a (mon.0) 2699 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:07:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:07 gibba013 bash[29418]: audit 2021-03-10T16:07:06.940235+0000 mon.a (mon.0) 2700 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T16:07:07.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:07 gibba013 bash[30381]: audit 2021-03-10T16:07:06.639041+0000 mon.a (mon.0) 2695 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:07:07.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:07 gibba013 bash[30381]: audit 2021-03-10T16:07:06.718245+0000 mon.a (mon.0) 2696 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:07:07.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:07 gibba013 bash[30381]: audit 2021-03-10T16:07:06.937056+0000 mon.a (mon.0) 2697 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:07:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:07 gibba013 bash[30381]: audit 2021-03-10T16:07:06.938177+0000 mon.a (mon.0) 2698 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:07:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:07 gibba013 bash[30381]: audit 2021-03-10T16:07:06.939197+0000 mon.a (mon.0) 2699 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:07:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:07 gibba013 bash[30381]: audit 2021-03-10T16:07:06.940235+0000 mon.a (mon.0) 2700 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T16:07:07.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:07 gibba020 bash[25448]: audit 2021-03-10T16:07:06.639041+0000 mon.a (mon.0) 2695 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:07:07.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:07 gibba020 bash[25448]: audit 2021-03-10T16:07:06.718245+0000 mon.a (mon.0) 2696 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:07:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:07 gibba020 bash[25448]: audit 2021-03-10T16:07:06.937056+0000 mon.a (mon.0) 2697 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:07:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:07 gibba020 bash[25448]: audit 2021-03-10T16:07:06.938177+0000 mon.a (mon.0) 2698 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:07:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:07 gibba020 bash[25448]: audit 2021-03-10T16:07:06.939197+0000 mon.a (mon.0) 2699 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:07:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:07 gibba020 bash[25448]: audit 2021-03-10T16:07:06.940235+0000 mon.a (mon.0) 2700 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T16:07:08.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:08 gibba020 bash[25448]: cluster 2021-03-10T16:07:06.262731+0000 mgr.gibba020.yqfnwy (mgr.34427) 7094 : cluster [DBG] pgmap v4032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:08.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:08 gibba013 bash[29418]: cluster 2021-03-10T16:07:06.262731+0000 mgr.gibba020.yqfnwy (mgr.34427) 7094 : cluster [DBG] pgmap v4032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:08.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:08 gibba013 bash[30381]: cluster 2021-03-10T16:07:06.262731+0000 mgr.gibba020.yqfnwy (mgr.34427) 7094 : cluster [DBG] pgmap v4032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:10.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:10 gibba020 bash[25448]: cluster 2021-03-10T16:07:08.264165+0000 mgr.gibba020.yqfnwy (mgr.34427) 7095 : cluster [DBG] pgmap v4033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:10.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:10 gibba013 bash[29418]: cluster 2021-03-10T16:07:08.264165+0000 mgr.gibba020.yqfnwy (mgr.34427) 7095 : cluster [DBG] pgmap v4033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:10.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:10 gibba013 bash[30381]: cluster 2021-03-10T16:07:08.264165+0000 mgr.gibba020.yqfnwy (mgr.34427) 7095 : cluster [DBG] pgmap v4033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:12.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:12 gibba020 bash[25448]: cluster 2021-03-10T16:07:10.265930+0000 mgr.gibba020.yqfnwy (mgr.34427) 7096 : cluster [DBG] pgmap v4034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:12.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:12 gibba013 bash[29418]: cluster 2021-03-10T16:07:10.265930+0000 mgr.gibba020.yqfnwy (mgr.34427) 7096 : cluster [DBG] pgmap v4034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:12.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:12 gibba013 bash[30381]: cluster 2021-03-10T16:07:10.265930+0000 mgr.gibba020.yqfnwy (mgr.34427) 7096 : cluster [DBG] pgmap v4034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:14.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:14 gibba020 bash[25448]: cluster 2021-03-10T16:07:12.267297+0000 mgr.gibba020.yqfnwy (mgr.34427) 7097 : cluster [DBG] pgmap v4035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:14.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:14 gibba013 bash[29418]: cluster 2021-03-10T16:07:12.267297+0000 mgr.gibba020.yqfnwy (mgr.34427) 7097 : cluster [DBG] pgmap v4035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:14.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:14 gibba013 bash[30381]: cluster 2021-03-10T16:07:12.267297+0000 mgr.gibba020.yqfnwy (mgr.34427) 7097 : cluster [DBG] pgmap v4035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:16.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:16 gibba020 bash[25448]: cluster 2021-03-10T16:07:14.269040+0000 mgr.gibba020.yqfnwy (mgr.34427) 7098 : cluster [DBG] pgmap v4036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:16.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:16 gibba013 bash[29418]: cluster 2021-03-10T16:07:14.269040+0000 mgr.gibba020.yqfnwy (mgr.34427) 7098 : cluster [DBG] pgmap v4036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:16.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:16 gibba013 bash[30381]: cluster 2021-03-10T16:07:14.269040+0000 mgr.gibba020.yqfnwy (mgr.34427) 7098 : cluster [DBG] pgmap v4036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:17.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:17 gibba013 bash[29418]: cluster 2021-03-10T16:07:16.270378+0000 mgr.gibba020.yqfnwy (mgr.34427) 7099 : cluster [DBG] pgmap v4037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:17.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:17 gibba013 bash[30381]: cluster 2021-03-10T16:07:16.270378+0000 mgr.gibba020.yqfnwy (mgr.34427) 7099 : cluster [DBG] pgmap v4037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:17.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:17 gibba020 bash[25448]: cluster 2021-03-10T16:07:16.270378+0000 mgr.gibba020.yqfnwy (mgr.34427) 7099 : cluster [DBG] pgmap v4037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:19.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:19 gibba020 bash[25448]: cluster 2021-03-10T16:07:18.271798+0000 mgr.gibba020.yqfnwy (mgr.34427) 7100 : cluster [DBG] pgmap v4038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:19.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:19 gibba020 bash[25448]: cephadm 2021-03-10T16:07:18.885994+0000 mgr.gibba020.yqfnwy (mgr.34427) 7101 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:07:20.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:19 gibba013 bash[29418]: cluster 2021-03-10T16:07:18.271798+0000 mgr.gibba020.yqfnwy (mgr.34427) 7100 : cluster [DBG] pgmap v4038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:20.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:19 gibba013 bash[29418]: cephadm 2021-03-10T16:07:18.885994+0000 mgr.gibba020.yqfnwy (mgr.34427) 7101 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:07:20.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:19 gibba013 bash[30381]: cluster 2021-03-10T16:07:18.271798+0000 mgr.gibba020.yqfnwy (mgr.34427) 7100 : cluster [DBG] pgmap v4038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:20.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:19 gibba013 bash[30381]: cephadm 2021-03-10T16:07:18.885994+0000 mgr.gibba020.yqfnwy (mgr.34427) 7101 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:07:21.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:21 gibba020 bash[25448]: cluster 2021-03-10T16:07:20.273548+0000 mgr.gibba020.yqfnwy (mgr.34427) 7102 : cluster [DBG] pgmap v4039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:22.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:21 gibba013 bash[29418]: cluster 2021-03-10T16:07:20.273548+0000 mgr.gibba020.yqfnwy (mgr.34427) 7102 : cluster [DBG] pgmap v4039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:22.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:21 gibba013 bash[30381]: cluster 2021-03-10T16:07:20.273548+0000 mgr.gibba020.yqfnwy (mgr.34427) 7102 : cluster [DBG] pgmap v4039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:23.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:23 gibba020 bash[25448]: cluster 2021-03-10T16:07:22.274947+0000 mgr.gibba020.yqfnwy (mgr.34427) 7103 : cluster [DBG] pgmap v4040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:24.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:23 gibba013 bash[29418]: cluster 2021-03-10T16:07:22.274947+0000 mgr.gibba020.yqfnwy (mgr.34427) 7103 : cluster [DBG] pgmap v4040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:24.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:23 gibba013 bash[30381]: cluster 2021-03-10T16:07:22.274947+0000 mgr.gibba020.yqfnwy (mgr.34427) 7103 : cluster [DBG] pgmap v4040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:25.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:25 gibba020 bash[25448]: cluster 2021-03-10T16:07:24.276712+0000 mgr.gibba020.yqfnwy (mgr.34427) 7104 : cluster [DBG] pgmap v4041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:26.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:25 gibba013 bash[29418]: cluster 2021-03-10T16:07:24.276712+0000 mgr.gibba020.yqfnwy (mgr.34427) 7104 : cluster [DBG] pgmap v4041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:26.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:25 gibba013 bash[30381]: cluster 2021-03-10T16:07:24.276712+0000 mgr.gibba020.yqfnwy (mgr.34427) 7104 : cluster [DBG] pgmap v4041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:27.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:27 gibba020 bash[25448]: cluster 2021-03-10T16:07:26.278619+0000 mgr.gibba020.yqfnwy (mgr.34427) 7105 : cluster [DBG] pgmap v4042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:28.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:27 gibba013 bash[29418]: cluster 2021-03-10T16:07:26.278619+0000 mgr.gibba020.yqfnwy (mgr.34427) 7105 : cluster [DBG] pgmap v4042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:28.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:27 gibba013 bash[30381]: cluster 2021-03-10T16:07:26.278619+0000 mgr.gibba020.yqfnwy (mgr.34427) 7105 : cluster [DBG] pgmap v4042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:29.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:29 gibba020 bash[25448]: cluster 2021-03-10T16:07:28.280035+0000 mgr.gibba020.yqfnwy (mgr.34427) 7106 : cluster [DBG] pgmap v4043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:30.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:29 gibba013 bash[29418]: cluster 2021-03-10T16:07:28.280035+0000 mgr.gibba020.yqfnwy (mgr.34427) 7106 : cluster [DBG] pgmap v4043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:30.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:29 gibba013 bash[30381]: cluster 2021-03-10T16:07:28.280035+0000 mgr.gibba020.yqfnwy (mgr.34427) 7106 : cluster [DBG] pgmap v4043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:31.742 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:07:31.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:31 gibba020 bash[25448]: cluster 2021-03-10T16:07:30.281795+0000 mgr.gibba020.yqfnwy (mgr.34427) 7107 : cluster [DBG] pgmap v4044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:32.000 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:07:32.000 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 7m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:07:32.001 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 6m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:07:32.001 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:07:32.001 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:07:32.001 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:07:32.002 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:07:32.002 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:07:32.002 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:07:32.003 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:07:32.003 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:07:32.003 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:07:32.003 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:07:32.003 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:07:32.004 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:07:32.004 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:07:32.004 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:07:32.004 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:07:32.005 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:07:32.005 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 6m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:07:32.005 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 6m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:07:32.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:31 gibba013 bash[29418]: cluster 2021-03-10T16:07:30.281795+0000 mgr.gibba020.yqfnwy (mgr.34427) 7107 : cluster [DBG] pgmap v4044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:32.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:31 gibba013 bash[30381]: cluster 2021-03-10T16:07:30.281795+0000 mgr.gibba020.yqfnwy (mgr.34427) 7107 : cluster [DBG] pgmap v4044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:32.256 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:07:32.257 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:07:32.257 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:07:32.257 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:07:32.257 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:07:32.258 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:07:32.258 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:07:32.258 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:07:32.258 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:07:32.259 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:07:32.259 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:07:32.259 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:07:32.259 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:07:32.260 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:07:32.260 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:07:32.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:32 gibba020 bash[25448]: audit 2021-03-10T16:07:31.733041+0000 mgr.gibba020.yqfnwy (mgr.34427) 7108 : audit [DBG] from='client.58804 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:07:32.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:32 gibba020 bash[25448]: audit 2021-03-10T16:07:31.958094+0000 mgr.gibba020.yqfnwy (mgr.34427) 7109 : audit [DBG] from='client.58810 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:07:32.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:32 gibba020 bash[25448]: audit 2021-03-10T16:07:32.256685+0000 mon.c (mon.1) 116 : audit [DBG] from='client.? 172.21.2.113:0/2516531640' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:33.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:32 gibba013 bash[29418]: audit 2021-03-10T16:07:31.733041+0000 mgr.gibba020.yqfnwy (mgr.34427) 7108 : audit [DBG] from='client.58804 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:07:33.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:32 gibba013 bash[29418]: audit 2021-03-10T16:07:31.958094+0000 mgr.gibba020.yqfnwy (mgr.34427) 7109 : audit [DBG] from='client.58810 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:07:33.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:32 gibba013 bash[29418]: audit 2021-03-10T16:07:32.256685+0000 mon.c (mon.1) 116 : audit [DBG] from='client.? 172.21.2.113:0/2516531640' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:33.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:32 gibba013 bash[30381]: audit 2021-03-10T16:07:31.733041+0000 mgr.gibba020.yqfnwy (mgr.34427) 7108 : audit [DBG] from='client.58804 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:07:33.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:32 gibba013 bash[30381]: audit 2021-03-10T16:07:31.958094+0000 mgr.gibba020.yqfnwy (mgr.34427) 7109 : audit [DBG] from='client.58810 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:07:33.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:32 gibba013 bash[30381]: audit 2021-03-10T16:07:32.256685+0000 mon.c (mon.1) 116 : audit [DBG] from='client.? 172.21.2.113:0/2516531640' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:07:33.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:33 gibba020 bash[25448]: cluster 2021-03-10T16:07:32.283069+0000 mgr.gibba020.yqfnwy (mgr.34427) 7110 : cluster [DBG] pgmap v4045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:34.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:33 gibba013 bash[29418]: cluster 2021-03-10T16:07:32.283069+0000 mgr.gibba020.yqfnwy (mgr.34427) 7110 : cluster [DBG] pgmap v4045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:34.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:33 gibba013 bash[30381]: cluster 2021-03-10T16:07:32.283069+0000 mgr.gibba020.yqfnwy (mgr.34427) 7110 : cluster [DBG] pgmap v4045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:35.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:34 gibba013 bash[29418]: cephadm 2021-03-10T16:07:33.901948+0000 mgr.gibba020.yqfnwy (mgr.34427) 7111 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:07:35.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:34 gibba013 bash[30381]: cephadm 2021-03-10T16:07:33.901948+0000 mgr.gibba020.yqfnwy (mgr.34427) 7111 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:07:35.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:34 gibba020 bash[25448]: cephadm 2021-03-10T16:07:33.901948+0000 mgr.gibba020.yqfnwy (mgr.34427) 7111 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:07:36.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:35 gibba013 bash[29418]: cluster 2021-03-10T16:07:34.284779+0000 mgr.gibba020.yqfnwy (mgr.34427) 7112 : cluster [DBG] pgmap v4046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:36.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:35 gibba013 bash[30381]: cluster 2021-03-10T16:07:34.284779+0000 mgr.gibba020.yqfnwy (mgr.34427) 7112 : cluster [DBG] pgmap v4046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:36.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:35 gibba020 bash[25448]: cluster 2021-03-10T16:07:34.284779+0000 mgr.gibba020.yqfnwy (mgr.34427) 7112 : cluster [DBG] pgmap v4046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:38.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:37 gibba013 bash[29418]: cluster 2021-03-10T16:07:36.286590+0000 mgr.gibba020.yqfnwy (mgr.34427) 7113 : cluster [DBG] pgmap v4047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:38.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:37 gibba013 bash[30381]: cluster 2021-03-10T16:07:36.286590+0000 mgr.gibba020.yqfnwy (mgr.34427) 7113 : cluster [DBG] pgmap v4047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:38.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:37 gibba020 bash[25448]: cluster 2021-03-10T16:07:36.286590+0000 mgr.gibba020.yqfnwy (mgr.34427) 7113 : cluster [DBG] pgmap v4047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:40.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:39 gibba013 bash[29418]: cluster 2021-03-10T16:07:38.288158+0000 mgr.gibba020.yqfnwy (mgr.34427) 7114 : cluster [DBG] pgmap v4048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:40.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:39 gibba013 bash[30381]: cluster 2021-03-10T16:07:38.288158+0000 mgr.gibba020.yqfnwy (mgr.34427) 7114 : cluster [DBG] pgmap v4048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:40.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:39 gibba020 bash[25448]: cluster 2021-03-10T16:07:38.288158+0000 mgr.gibba020.yqfnwy (mgr.34427) 7114 : cluster [DBG] pgmap v4048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:42.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:41 gibba013 bash[29418]: cluster 2021-03-10T16:07:40.289919+0000 mgr.gibba020.yqfnwy (mgr.34427) 7115 : cluster [DBG] pgmap v4049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:42.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:41 gibba013 bash[30381]: cluster 2021-03-10T16:07:40.289919+0000 mgr.gibba020.yqfnwy (mgr.34427) 7115 : cluster [DBG] pgmap v4049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:42.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:41 gibba020 bash[25448]: cluster 2021-03-10T16:07:40.289919+0000 mgr.gibba020.yqfnwy (mgr.34427) 7115 : cluster [DBG] pgmap v4049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:44.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:43 gibba013 bash[29418]: cluster 2021-03-10T16:07:42.291364+0000 mgr.gibba020.yqfnwy (mgr.34427) 7116 : cluster [DBG] pgmap v4050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:44.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:43 gibba013 bash[30381]: cluster 2021-03-10T16:07:42.291364+0000 mgr.gibba020.yqfnwy (mgr.34427) 7116 : cluster [DBG] pgmap v4050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:44.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:43 gibba020 bash[25448]: cluster 2021-03-10T16:07:42.291364+0000 mgr.gibba020.yqfnwy (mgr.34427) 7116 : cluster [DBG] pgmap v4050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:46.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:45 gibba013 bash[29418]: cluster 2021-03-10T16:07:44.293074+0000 mgr.gibba020.yqfnwy (mgr.34427) 7117 : cluster [DBG] pgmap v4051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:46.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:45 gibba013 bash[30381]: cluster 2021-03-10T16:07:44.293074+0000 mgr.gibba020.yqfnwy (mgr.34427) 7117 : cluster [DBG] pgmap v4051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:46.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:45 gibba020 bash[25448]: cluster 2021-03-10T16:07:44.293074+0000 mgr.gibba020.yqfnwy (mgr.34427) 7117 : cluster [DBG] pgmap v4051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:48.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:47 gibba013 bash[29418]: cluster 2021-03-10T16:07:46.294917+0000 mgr.gibba020.yqfnwy (mgr.34427) 7118 : cluster [DBG] pgmap v4052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:48.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:47 gibba013 bash[30381]: cluster 2021-03-10T16:07:46.294917+0000 mgr.gibba020.yqfnwy (mgr.34427) 7118 : cluster [DBG] pgmap v4052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:48.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:47 gibba020 bash[25448]: cluster 2021-03-10T16:07:46.294917+0000 mgr.gibba020.yqfnwy (mgr.34427) 7118 : cluster [DBG] pgmap v4052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:50.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:49 gibba013 bash[29418]: cluster 2021-03-10T16:07:48.296337+0000 mgr.gibba020.yqfnwy (mgr.34427) 7119 : cluster [DBG] pgmap v4053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:50.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:49 gibba013 bash[29418]: cephadm 2021-03-10T16:07:48.917948+0000 mgr.gibba020.yqfnwy (mgr.34427) 7120 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:07:50.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:49 gibba013 bash[30381]: cluster 2021-03-10T16:07:48.296337+0000 mgr.gibba020.yqfnwy (mgr.34427) 7119 : cluster [DBG] pgmap v4053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:50.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:49 gibba013 bash[30381]: cephadm 2021-03-10T16:07:48.917948+0000 mgr.gibba020.yqfnwy (mgr.34427) 7120 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:07:50.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:49 gibba020 bash[25448]: cluster 2021-03-10T16:07:48.296337+0000 mgr.gibba020.yqfnwy (mgr.34427) 7119 : cluster [DBG] pgmap v4053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:50.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:49 gibba020 bash[25448]: cephadm 2021-03-10T16:07:48.917948+0000 mgr.gibba020.yqfnwy (mgr.34427) 7120 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:07:52.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:51 gibba013 bash[29418]: cluster 2021-03-10T16:07:50.297904+0000 mgr.gibba020.yqfnwy (mgr.34427) 7121 : cluster [DBG] pgmap v4054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:52.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:51 gibba013 bash[30381]: cluster 2021-03-10T16:07:50.297904+0000 mgr.gibba020.yqfnwy (mgr.34427) 7121 : cluster [DBG] pgmap v4054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:52.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:51 gibba020 bash[25448]: cluster 2021-03-10T16:07:50.297904+0000 mgr.gibba020.yqfnwy (mgr.34427) 7121 : cluster [DBG] pgmap v4054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:54.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:53 gibba013 bash[29418]: cluster 2021-03-10T16:07:52.299064+0000 mgr.gibba020.yqfnwy (mgr.34427) 7122 : cluster [DBG] pgmap v4055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:54.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:53 gibba013 bash[30381]: cluster 2021-03-10T16:07:52.299064+0000 mgr.gibba020.yqfnwy (mgr.34427) 7122 : cluster [DBG] pgmap v4055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:54.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:53 gibba020 bash[25448]: cluster 2021-03-10T16:07:52.299064+0000 mgr.gibba020.yqfnwy (mgr.34427) 7122 : cluster [DBG] pgmap v4055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:56.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:55 gibba013 bash[29418]: cluster 2021-03-10T16:07:54.300707+0000 mgr.gibba020.yqfnwy (mgr.34427) 7123 : cluster [DBG] pgmap v4056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:56.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:55 gibba013 bash[30381]: cluster 2021-03-10T16:07:54.300707+0000 mgr.gibba020.yqfnwy (mgr.34427) 7123 : cluster [DBG] pgmap v4056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:56.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:55 gibba020 bash[25448]: cluster 2021-03-10T16:07:54.300707+0000 mgr.gibba020.yqfnwy (mgr.34427) 7123 : cluster [DBG] pgmap v4056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:58.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:57 gibba013 bash[29418]: cluster 2021-03-10T16:07:56.302335+0000 mgr.gibba020.yqfnwy (mgr.34427) 7124 : cluster [DBG] pgmap v4057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:58.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:57 gibba013 bash[30381]: cluster 2021-03-10T16:07:56.302335+0000 mgr.gibba020.yqfnwy (mgr.34427) 7124 : cluster [DBG] pgmap v4057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:07:58.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:57 gibba020 bash[25448]: cluster 2021-03-10T16:07:56.302335+0000 mgr.gibba020.yqfnwy (mgr.34427) 7124 : cluster [DBG] pgmap v4057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:00.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:07:59 gibba013 bash[29418]: cluster 2021-03-10T16:07:58.303726+0000 mgr.gibba020.yqfnwy (mgr.34427) 7125 : cluster [DBG] pgmap v4058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:00.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:07:59 gibba013 bash[30381]: cluster 2021-03-10T16:07:58.303726+0000 mgr.gibba020.yqfnwy (mgr.34427) 7125 : cluster [DBG] pgmap v4058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:00.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:07:59 gibba020 bash[25448]: cluster 2021-03-10T16:07:58.303726+0000 mgr.gibba020.yqfnwy (mgr.34427) 7125 : cluster [DBG] pgmap v4058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:02.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:01 gibba013 bash[29418]: cluster 2021-03-10T16:08:00.305498+0000 mgr.gibba020.yqfnwy (mgr.34427) 7126 : cluster [DBG] pgmap v4059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:02.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:01 gibba013 bash[30381]: cluster 2021-03-10T16:08:00.305498+0000 mgr.gibba020.yqfnwy (mgr.34427) 7126 : cluster [DBG] pgmap v4059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:02.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:01 gibba020 bash[25448]: cluster 2021-03-10T16:08:00.305498+0000 mgr.gibba020.yqfnwy (mgr.34427) 7126 : cluster [DBG] pgmap v4059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:02.498 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:08:02.726 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:08:02.726 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 8m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:08:02.726 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 7m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:08:02.727 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:08:02.727 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:08:02.727 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:08:02.727 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:08:02.728 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:08:02.728 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:08:02.728 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:08:02.728 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:08:02.729 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:08:02.729 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:08:02.729 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:08:02.729 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:08:02.730 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:08:02.730 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:08:02.730 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:08:02.731 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:08:02.731 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 7m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:08:02.731 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 7m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:08:02.980 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:08:02.981 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:08:02.981 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:08:02.981 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:08:02.981 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:08:02.982 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:08:02.982 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:08:02.982 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:08:02.982 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:08:02.983 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:08:02.983 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:08:02.983 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:08:02.983 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:08:02.983 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:08:02.984 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:08:04.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:03 gibba013 bash[29418]: cluster 2021-03-10T16:08:02.306628+0000 mgr.gibba020.yqfnwy (mgr.34427) 7127 : cluster [DBG] pgmap v4060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:04.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:03 gibba013 bash[29418]: audit 2021-03-10T16:08:02.488783+0000 mgr.gibba020.yqfnwy (mgr.34427) 7128 : audit [DBG] from='client.48840 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:08:04.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:03 gibba013 bash[29418]: audit 2021-03-10T16:08:02.712690+0000 mgr.gibba020.yqfnwy (mgr.34427) 7129 : audit [DBG] from='client.48846 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:08:04.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:03 gibba013 bash[29418]: audit 2021-03-10T16:08:02.980871+0000 mon.a (mon.0) 2701 : audit [DBG] from='client.? 172.21.2.113:0/3837296647' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:04.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:03 gibba013 bash[30381]: cluster 2021-03-10T16:08:02.306628+0000 mgr.gibba020.yqfnwy (mgr.34427) 7127 : cluster [DBG] pgmap v4060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:04.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:03 gibba013 bash[30381]: audit 2021-03-10T16:08:02.488783+0000 mgr.gibba020.yqfnwy (mgr.34427) 7128 : audit [DBG] from='client.48840 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:08:04.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:03 gibba013 bash[30381]: audit 2021-03-10T16:08:02.712690+0000 mgr.gibba020.yqfnwy (mgr.34427) 7129 : audit [DBG] from='client.48846 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:08:04.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:03 gibba013 bash[30381]: audit 2021-03-10T16:08:02.980871+0000 mon.a (mon.0) 2701 : audit [DBG] from='client.? 172.21.2.113:0/3837296647' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:04.184 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:03 gibba020 bash[25448]: cluster 2021-03-10T16:08:02.306628+0000 mgr.gibba020.yqfnwy (mgr.34427) 7127 : cluster [DBG] pgmap v4060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:04.184 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:03 gibba020 bash[25448]: audit 2021-03-10T16:08:02.488783+0000 mgr.gibba020.yqfnwy (mgr.34427) 7128 : audit [DBG] from='client.48840 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:08:04.184 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:03 gibba020 bash[25448]: audit 2021-03-10T16:08:02.712690+0000 mgr.gibba020.yqfnwy (mgr.34427) 7129 : audit [DBG] from='client.48846 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:08:04.184 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:03 gibba020 bash[25448]: audit 2021-03-10T16:08:02.980871+0000 mon.a (mon.0) 2701 : audit [DBG] from='client.? 172.21.2.113:0/3837296647' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:05.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:04 gibba013 bash[29418]: audit 2021-03-10T16:08:03.935930+0000 mon.a (mon.0) 2702 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:08:05.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:04 gibba013 bash[29418]: cephadm 2021-03-10T16:08:03.940800+0000 mgr.gibba020.yqfnwy (mgr.34427) 7130 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:08:05.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:04 gibba013 bash[29418]: cephadm 2021-03-10T16:08:03.942485+0000 mgr.gibba020.yqfnwy (mgr.34427) 7131 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:08:05.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:04 gibba013 bash[29418]: audit 2021-03-10T16:08:04.170114+0000 mon.a (mon.0) 2703 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:08:05.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:04 gibba013 bash[29418]: cephadm 2021-03-10T16:08:04.171439+0000 mgr.gibba020.yqfnwy (mgr.34427) 7132 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:08:05.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:04 gibba013 bash[29418]: cephadm 2021-03-10T16:08:04.173108+0000 mgr.gibba020.yqfnwy (mgr.34427) 7133 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:08:05.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:04 gibba013 bash[29418]: audit 2021-03-10T16:08:04.173291+0000 mon.a (mon.0) 2704 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:08:05.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:04 gibba013 bash[29418]: cephadm 2021-03-10T16:08:04.174772+0000 mgr.gibba020.yqfnwy (mgr.34427) 7134 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:08:05.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:04 gibba013 bash[29418]: cephadm 2021-03-10T16:08:04.174808+0000 mgr.gibba020.yqfnwy (mgr.34427) 7135 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:08:05.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:04 gibba013 bash[29418]: audit 2021-03-10T16:08:04.174935+0000 mon.a (mon.0) 2705 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:05.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:04 gibba013 bash[29418]: cephadm 2021-03-10T16:08:04.176488+0000 mgr.gibba020.yqfnwy (mgr.34427) 7136 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:08:05.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:04 gibba013 bash[29418]: cephadm 2021-03-10T16:08:04.176524+0000 mgr.gibba020.yqfnwy (mgr.34427) 7137 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:08:05.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:04 gibba013 bash[29418]: audit 2021-03-10T16:08:04.176615+0000 mon.a (mon.0) 2706 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:05.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:04 gibba013 bash[29418]: cephadm 2021-03-10T16:08:04.177939+0000 mgr.gibba020.yqfnwy (mgr.34427) 7138 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:08:05.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:04 gibba013 bash[29418]: audit 2021-03-10T16:08:04.178248+0000 mon.a (mon.0) 2707 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:05.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:04 gibba013 bash[29418]: audit 2021-03-10T16:08:04.181384+0000 mon.a (mon.0) 2708 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:05.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:04 gibba013 bash[29418]: audit 2021-03-10T16:08:04.183266+0000 mon.a (mon.0) 2709 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:05.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:04 gibba013 bash[30381]: audit 2021-03-10T16:08:03.935930+0000 mon.a (mon.0) 2702 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:08:05.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:04 gibba013 bash[30381]: cephadm 2021-03-10T16:08:03.940800+0000 mgr.gibba020.yqfnwy (mgr.34427) 7130 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:08:05.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:04 gibba013 bash[30381]: cephadm 2021-03-10T16:08:03.942485+0000 mgr.gibba020.yqfnwy (mgr.34427) 7131 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:08:05.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:04 gibba013 bash[30381]: audit 2021-03-10T16:08:04.170114+0000 mon.a (mon.0) 2703 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:08:05.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:04 gibba013 bash[30381]: cephadm 2021-03-10T16:08:04.171439+0000 mgr.gibba020.yqfnwy (mgr.34427) 7132 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:08:05.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:04 gibba013 bash[30381]: cephadm 2021-03-10T16:08:04.173108+0000 mgr.gibba020.yqfnwy (mgr.34427) 7133 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:08:05.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:04 gibba013 bash[30381]: audit 2021-03-10T16:08:04.173291+0000 mon.a (mon.0) 2704 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:08:05.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:04 gibba013 bash[30381]: cephadm 2021-03-10T16:08:04.174772+0000 mgr.gibba020.yqfnwy (mgr.34427) 7134 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:08:05.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:04 gibba013 bash[30381]: cephadm 2021-03-10T16:08:04.174808+0000 mgr.gibba020.yqfnwy (mgr.34427) 7135 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:08:05.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:04 gibba013 bash[30381]: audit 2021-03-10T16:08:04.174935+0000 mon.a (mon.0) 2705 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:05.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:04 gibba013 bash[30381]: cephadm 2021-03-10T16:08:04.176488+0000 mgr.gibba020.yqfnwy (mgr.34427) 7136 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:08:05.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:04 gibba013 bash[30381]: cephadm 2021-03-10T16:08:04.176524+0000 mgr.gibba020.yqfnwy (mgr.34427) 7137 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:08:05.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:04 gibba013 bash[30381]: audit 2021-03-10T16:08:04.176615+0000 mon.a (mon.0) 2706 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:05.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:04 gibba013 bash[30381]: cephadm 2021-03-10T16:08:04.177939+0000 mgr.gibba020.yqfnwy (mgr.34427) 7138 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:08:05.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:04 gibba013 bash[30381]: audit 2021-03-10T16:08:04.178248+0000 mon.a (mon.0) 2707 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:05.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:04 gibba013 bash[30381]: audit 2021-03-10T16:08:04.181384+0000 mon.a (mon.0) 2708 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:05.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:04 gibba013 bash[30381]: audit 2021-03-10T16:08:04.183266+0000 mon.a (mon.0) 2709 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:05.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:04 gibba020 bash[25448]: audit 2021-03-10T16:08:03.935930+0000 mon.a (mon.0) 2702 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:08:05.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:04 gibba020 bash[25448]: cephadm 2021-03-10T16:08:03.940800+0000 mgr.gibba020.yqfnwy (mgr.34427) 7130 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:08:05.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:04 gibba020 bash[25448]: cephadm 2021-03-10T16:08:03.942485+0000 mgr.gibba020.yqfnwy (mgr.34427) 7131 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:08:05.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:04 gibba020 bash[25448]: audit 2021-03-10T16:08:04.170114+0000 mon.a (mon.0) 2703 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:08:05.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:04 gibba020 bash[25448]: cephadm 2021-03-10T16:08:04.171439+0000 mgr.gibba020.yqfnwy (mgr.34427) 7132 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:08:05.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:04 gibba020 bash[25448]: cephadm 2021-03-10T16:08:04.173108+0000 mgr.gibba020.yqfnwy (mgr.34427) 7133 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:08:05.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:04 gibba020 bash[25448]: audit 2021-03-10T16:08:04.173291+0000 mon.a (mon.0) 2704 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:08:05.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:04 gibba020 bash[25448]: cephadm 2021-03-10T16:08:04.174772+0000 mgr.gibba020.yqfnwy (mgr.34427) 7134 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:08:05.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:04 gibba020 bash[25448]: cephadm 2021-03-10T16:08:04.174808+0000 mgr.gibba020.yqfnwy (mgr.34427) 7135 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:08:05.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:04 gibba020 bash[25448]: audit 2021-03-10T16:08:04.174935+0000 mon.a (mon.0) 2705 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:05.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:04 gibba020 bash[25448]: cephadm 2021-03-10T16:08:04.176488+0000 mgr.gibba020.yqfnwy (mgr.34427) 7136 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:08:05.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:04 gibba020 bash[25448]: cephadm 2021-03-10T16:08:04.176524+0000 mgr.gibba020.yqfnwy (mgr.34427) 7137 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:08:05.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:04 gibba020 bash[25448]: audit 2021-03-10T16:08:04.176615+0000 mon.a (mon.0) 2706 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:05.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:04 gibba020 bash[25448]: cephadm 2021-03-10T16:08:04.177939+0000 mgr.gibba020.yqfnwy (mgr.34427) 7138 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:08:05.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:04 gibba020 bash[25448]: audit 2021-03-10T16:08:04.178248+0000 mon.a (mon.0) 2707 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:05.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:04 gibba020 bash[25448]: audit 2021-03-10T16:08:04.181384+0000 mon.a (mon.0) 2708 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:05.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:04 gibba020 bash[25448]: audit 2021-03-10T16:08:04.183266+0000 mon.a (mon.0) 2709 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:06.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:06 gibba020 bash[25448]: cephadm 2021-03-10T16:08:04.179715+0000 mgr.gibba020.yqfnwy (mgr.34427) 7139 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:08:06.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:06 gibba020 bash[25448]: cephadm 2021-03-10T16:08:04.179754+0000 mgr.gibba020.yqfnwy (mgr.34427) 7140 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:08:06.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:06 gibba020 bash[25448]: cephadm 2021-03-10T16:08:04.181230+0000 mgr.gibba020.yqfnwy (mgr.34427) 7141 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:08:06.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:06 gibba020 bash[25448]: cephadm 2021-03-10T16:08:04.181648+0000 mgr.gibba020.yqfnwy (mgr.34427) 7142 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:08:06.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:06 gibba020 bash[25448]: cephadm 2021-03-10T16:08:04.183266+0000 mgr.gibba020.yqfnwy (mgr.34427) 7143 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:08:06.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:06 gibba020 bash[25448]: cephadm 2021-03-10T16:08:04.183308+0000 mgr.gibba020.yqfnwy (mgr.34427) 7144 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:08:06.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:06 gibba020 bash[25448]: cephadm 2021-03-10T16:08:04.183510+0000 mgr.gibba020.yqfnwy (mgr.34427) 7145 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:08:06.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:06 gibba020 bash[25448]: cluster 2021-03-10T16:08:04.308197+0000 mgr.gibba020.yqfnwy (mgr.34427) 7146 : cluster [DBG] pgmap v4061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:06.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:06 gibba013 bash[29418]: cephadm 2021-03-10T16:08:04.179715+0000 mgr.gibba020.yqfnwy (mgr.34427) 7139 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:08:06.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:06 gibba013 bash[29418]: cephadm 2021-03-10T16:08:04.179754+0000 mgr.gibba020.yqfnwy (mgr.34427) 7140 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:08:06.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:06 gibba013 bash[29418]: cephadm 2021-03-10T16:08:04.181230+0000 mgr.gibba020.yqfnwy (mgr.34427) 7141 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:08:06.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:06 gibba013 bash[29418]: cephadm 2021-03-10T16:08:04.181648+0000 mgr.gibba020.yqfnwy (mgr.34427) 7142 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:08:06.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:06 gibba013 bash[29418]: cephadm 2021-03-10T16:08:04.183266+0000 mgr.gibba020.yqfnwy (mgr.34427) 7143 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:08:06.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:06 gibba013 bash[29418]: cephadm 2021-03-10T16:08:04.183308+0000 mgr.gibba020.yqfnwy (mgr.34427) 7144 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:08:06.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:06 gibba013 bash[29418]: cephadm 2021-03-10T16:08:04.183510+0000 mgr.gibba020.yqfnwy (mgr.34427) 7145 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:08:06.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:06 gibba013 bash[29418]: cluster 2021-03-10T16:08:04.308197+0000 mgr.gibba020.yqfnwy (mgr.34427) 7146 : cluster [DBG] pgmap v4061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:06.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:06 gibba013 bash[30381]: cephadm 2021-03-10T16:08:04.179715+0000 mgr.gibba020.yqfnwy (mgr.34427) 7139 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:08:06.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:06 gibba013 bash[30381]: cephadm 2021-03-10T16:08:04.179754+0000 mgr.gibba020.yqfnwy (mgr.34427) 7140 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:08:06.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:06 gibba013 bash[30381]: cephadm 2021-03-10T16:08:04.181230+0000 mgr.gibba020.yqfnwy (mgr.34427) 7141 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:08:06.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:06 gibba013 bash[30381]: cephadm 2021-03-10T16:08:04.181648+0000 mgr.gibba020.yqfnwy (mgr.34427) 7142 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:08:06.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:06 gibba013 bash[30381]: cephadm 2021-03-10T16:08:04.183266+0000 mgr.gibba020.yqfnwy (mgr.34427) 7143 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:08:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:06 gibba013 bash[30381]: cephadm 2021-03-10T16:08:04.183308+0000 mgr.gibba020.yqfnwy (mgr.34427) 7144 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:08:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:06 gibba013 bash[30381]: cephadm 2021-03-10T16:08:04.183510+0000 mgr.gibba020.yqfnwy (mgr.34427) 7145 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:08:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:06 gibba013 bash[30381]: cluster 2021-03-10T16:08:04.308197+0000 mgr.gibba020.yqfnwy (mgr.34427) 7146 : cluster [DBG] pgmap v4061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:07.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:07 gibba020 bash[25448]: audit 2021-03-10T16:08:06.641025+0000 mon.a (mon.0) 2710 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:08:07.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:07 gibba020 bash[25448]: audit 2021-03-10T16:08:06.725580+0000 mon.a (mon.0) 2711 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:08:07.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:07 gibba020 bash[25448]: audit 2021-03-10T16:08:06.948724+0000 mon.a (mon.0) 2712 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:08:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:07 gibba020 bash[25448]: audit 2021-03-10T16:08:06.949513+0000 mon.a (mon.0) 2713 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:08:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:07 gibba020 bash[25448]: audit 2021-03-10T16:08:06.950241+0000 mon.a (mon.0) 2714 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:08:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:07 gibba020 bash[25448]: audit 2021-03-10T16:08:06.950922+0000 mon.a (mon.0) 2715 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:08:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:07 gibba013 bash[29418]: audit 2021-03-10T16:08:06.641025+0000 mon.a (mon.0) 2710 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:08:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:07 gibba013 bash[29418]: audit 2021-03-10T16:08:06.725580+0000 mon.a (mon.0) 2711 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:08:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:07 gibba013 bash[29418]: audit 2021-03-10T16:08:06.948724+0000 mon.a (mon.0) 2712 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:08:07.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:07 gibba013 bash[29418]: audit 2021-03-10T16:08:06.949513+0000 mon.a (mon.0) 2713 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:08:07.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:07 gibba013 bash[29418]: audit 2021-03-10T16:08:06.950241+0000 mon.a (mon.0) 2714 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:08:07.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:07 gibba013 bash[29418]: audit 2021-03-10T16:08:06.950922+0000 mon.a (mon.0) 2715 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:08:07.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:07 gibba013 bash[30381]: audit 2021-03-10T16:08:06.641025+0000 mon.a (mon.0) 2710 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:08:07.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:07 gibba013 bash[30381]: audit 2021-03-10T16:08:06.725580+0000 mon.a (mon.0) 2711 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:08:07.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:07 gibba013 bash[30381]: audit 2021-03-10T16:08:06.948724+0000 mon.a (mon.0) 2712 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:08:07.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:07 gibba013 bash[30381]: audit 2021-03-10T16:08:06.949513+0000 mon.a (mon.0) 2713 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:08:07.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:07 gibba013 bash[30381]: audit 2021-03-10T16:08:06.950241+0000 mon.a (mon.0) 2714 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:08:07.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:07 gibba013 bash[30381]: audit 2021-03-10T16:08:06.950922+0000 mon.a (mon.0) 2715 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:08:08.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:08 gibba020 bash[25448]: cluster 2021-03-10T16:08:06.309903+0000 mgr.gibba020.yqfnwy (mgr.34427) 7147 : cluster [DBG] pgmap v4062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:08.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:08 gibba013 bash[29418]: cluster 2021-03-10T16:08:06.309903+0000 mgr.gibba020.yqfnwy (mgr.34427) 7147 : cluster [DBG] pgmap v4062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:08.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:08 gibba013 bash[30381]: cluster 2021-03-10T16:08:06.309903+0000 mgr.gibba020.yqfnwy (mgr.34427) 7147 : cluster [DBG] pgmap v4062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:09.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:09 gibba020 bash[25448]: cluster 2021-03-10T16:08:08.311433+0000 mgr.gibba020.yqfnwy (mgr.34427) 7148 : cluster [DBG] pgmap v4063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:10.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:09 gibba013 bash[29418]: cluster 2021-03-10T16:08:08.311433+0000 mgr.gibba020.yqfnwy (mgr.34427) 7148 : cluster [DBG] pgmap v4063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:10.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:09 gibba013 bash[30381]: cluster 2021-03-10T16:08:08.311433+0000 mgr.gibba020.yqfnwy (mgr.34427) 7148 : cluster [DBG] pgmap v4063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:11.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:11 gibba020 bash[25448]: cluster 2021-03-10T16:08:10.313167+0000 mgr.gibba020.yqfnwy (mgr.34427) 7149 : cluster [DBG] pgmap v4064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:12.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:11 gibba013 bash[29418]: cluster 2021-03-10T16:08:10.313167+0000 mgr.gibba020.yqfnwy (mgr.34427) 7149 : cluster [DBG] pgmap v4064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:12.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:11 gibba013 bash[30381]: cluster 2021-03-10T16:08:10.313167+0000 mgr.gibba020.yqfnwy (mgr.34427) 7149 : cluster [DBG] pgmap v4064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:13.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:13 gibba020 bash[25448]: cluster 2021-03-10T16:08:12.314520+0000 mgr.gibba020.yqfnwy (mgr.34427) 7150 : cluster [DBG] pgmap v4065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:14.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:13 gibba013 bash[29418]: cluster 2021-03-10T16:08:12.314520+0000 mgr.gibba020.yqfnwy (mgr.34427) 7150 : cluster [DBG] pgmap v4065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:14.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:13 gibba013 bash[30381]: cluster 2021-03-10T16:08:12.314520+0000 mgr.gibba020.yqfnwy (mgr.34427) 7150 : cluster [DBG] pgmap v4065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:15.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:15 gibba020 bash[25448]: cluster 2021-03-10T16:08:14.314998+0000 mgr.gibba020.yqfnwy (mgr.34427) 7151 : cluster [DBG] pgmap v4066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:16.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:15 gibba013 bash[29418]: cluster 2021-03-10T16:08:14.314998+0000 mgr.gibba020.yqfnwy (mgr.34427) 7151 : cluster [DBG] pgmap v4066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:16.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:15 gibba013 bash[30381]: cluster 2021-03-10T16:08:14.314998+0000 mgr.gibba020.yqfnwy (mgr.34427) 7151 : cluster [DBG] pgmap v4066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:17.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:17 gibba020 bash[25448]: cluster 2021-03-10T16:08:16.316772+0000 mgr.gibba020.yqfnwy (mgr.34427) 7152 : cluster [DBG] pgmap v4067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:18.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:17 gibba013 bash[29418]: cluster 2021-03-10T16:08:16.316772+0000 mgr.gibba020.yqfnwy (mgr.34427) 7152 : cluster [DBG] pgmap v4067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:18.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:17 gibba013 bash[30381]: cluster 2021-03-10T16:08:16.316772+0000 mgr.gibba020.yqfnwy (mgr.34427) 7152 : cluster [DBG] pgmap v4067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:20.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:19 gibba013 bash[29418]: cluster 2021-03-10T16:08:18.318213+0000 mgr.gibba020.yqfnwy (mgr.34427) 7153 : cluster [DBG] pgmap v4068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:20.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:19 gibba013 bash[30381]: cluster 2021-03-10T16:08:18.318213+0000 mgr.gibba020.yqfnwy (mgr.34427) 7153 : cluster [DBG] pgmap v4068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:20.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:19 gibba020 bash[25448]: cluster 2021-03-10T16:08:18.318213+0000 mgr.gibba020.yqfnwy (mgr.34427) 7153 : cluster [DBG] pgmap v4068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:21.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:20 gibba013 bash[29418]: cephadm 2021-03-10T16:08:19.199498+0000 mgr.gibba020.yqfnwy (mgr.34427) 7154 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:08:21.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:20 gibba013 bash[30381]: cephadm 2021-03-10T16:08:19.199498+0000 mgr.gibba020.yqfnwy (mgr.34427) 7154 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:08:21.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:20 gibba020 bash[25448]: cephadm 2021-03-10T16:08:19.199498+0000 mgr.gibba020.yqfnwy (mgr.34427) 7154 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:08:22.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:21 gibba013 bash[29418]: cluster 2021-03-10T16:08:20.320028+0000 mgr.gibba020.yqfnwy (mgr.34427) 7155 : cluster [DBG] pgmap v4069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:22.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:21 gibba013 bash[30381]: cluster 2021-03-10T16:08:20.320028+0000 mgr.gibba020.yqfnwy (mgr.34427) 7155 : cluster [DBG] pgmap v4069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:22.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:21 gibba020 bash[25448]: cluster 2021-03-10T16:08:20.320028+0000 mgr.gibba020.yqfnwy (mgr.34427) 7155 : cluster [DBG] pgmap v4069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:24.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:23 gibba013 bash[29418]: cluster 2021-03-10T16:08:22.320624+0000 mgr.gibba020.yqfnwy (mgr.34427) 7156 : cluster [DBG] pgmap v4070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:24.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:23 gibba013 bash[30381]: cluster 2021-03-10T16:08:22.320624+0000 mgr.gibba020.yqfnwy (mgr.34427) 7156 : cluster [DBG] pgmap v4070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:24.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:23 gibba020 bash[25448]: cluster 2021-03-10T16:08:22.320624+0000 mgr.gibba020.yqfnwy (mgr.34427) 7156 : cluster [DBG] pgmap v4070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:26.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:25 gibba013 bash[29418]: cluster 2021-03-10T16:08:24.322152+0000 mgr.gibba020.yqfnwy (mgr.34427) 7157 : cluster [DBG] pgmap v4071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:26.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:25 gibba013 bash[30381]: cluster 2021-03-10T16:08:24.322152+0000 mgr.gibba020.yqfnwy (mgr.34427) 7157 : cluster [DBG] pgmap v4071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:26.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:25 gibba020 bash[25448]: cluster 2021-03-10T16:08:24.322152+0000 mgr.gibba020.yqfnwy (mgr.34427) 7157 : cluster [DBG] pgmap v4071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:28.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:27 gibba013 bash[29418]: cluster 2021-03-10T16:08:26.324063+0000 mgr.gibba020.yqfnwy (mgr.34427) 7158 : cluster [DBG] pgmap v4072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:28.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:27 gibba013 bash[30381]: cluster 2021-03-10T16:08:26.324063+0000 mgr.gibba020.yqfnwy (mgr.34427) 7158 : cluster [DBG] pgmap v4072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:28.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:27 gibba020 bash[25448]: cluster 2021-03-10T16:08:26.324063+0000 mgr.gibba020.yqfnwy (mgr.34427) 7158 : cluster [DBG] pgmap v4072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:30.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:29 gibba013 bash[29418]: cluster 2021-03-10T16:08:28.325659+0000 mgr.gibba020.yqfnwy (mgr.34427) 7159 : cluster [DBG] pgmap v4073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:30.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:29 gibba013 bash[30381]: cluster 2021-03-10T16:08:28.325659+0000 mgr.gibba020.yqfnwy (mgr.34427) 7159 : cluster [DBG] pgmap v4073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:30.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:29 gibba020 bash[25448]: cluster 2021-03-10T16:08:28.325659+0000 mgr.gibba020.yqfnwy (mgr.34427) 7159 : cluster [DBG] pgmap v4073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:32.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:31 gibba013 bash[29418]: cluster 2021-03-10T16:08:30.326487+0000 mgr.gibba020.yqfnwy (mgr.34427) 7160 : cluster [DBG] pgmap v4074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:32.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:31 gibba013 bash[30381]: cluster 2021-03-10T16:08:30.326487+0000 mgr.gibba020.yqfnwy (mgr.34427) 7160 : cluster [DBG] pgmap v4074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:32.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:31 gibba020 bash[25448]: cluster 2021-03-10T16:08:30.326487+0000 mgr.gibba020.yqfnwy (mgr.34427) 7160 : cluster [DBG] pgmap v4074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:33.227 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:08:33.452 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:08:33.453 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 8m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:08:33.453 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 7m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:08:33.454 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:08:33.454 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:08:33.454 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:08:33.455 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:08:33.455 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:08:33.455 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:08:33.456 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:08:33.456 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:08:33.456 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:08:33.456 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:08:33.456 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:08:33.457 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:08:33.457 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:08:33.457 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:08:33.457 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:08:33.458 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:08:33.458 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 7m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:08:33.458 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 7m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:08:33.736 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:08:33.736 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:08:33.737 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:08:33.737 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:08:33.737 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:08:33.737 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:08:33.738 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:08:33.738 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:08:33.738 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:08:33.738 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:08:33.738 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:08:33.739 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:08:33.739 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:08:33.739 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:08:33.739 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:08:34.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:33 gibba013 bash[29418]: cluster 2021-03-10T16:08:32.327900+0000 mgr.gibba020.yqfnwy (mgr.34427) 7161 : cluster [DBG] pgmap v4075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:34.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:33 gibba013 bash[29418]: audit 2021-03-10T16:08:33.736685+0000 mon.a (mon.0) 2716 : audit [DBG] from='client.? 172.21.2.113:0/1493608573' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:34.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:33 gibba013 bash[30381]: cluster 2021-03-10T16:08:32.327900+0000 mgr.gibba020.yqfnwy (mgr.34427) 7161 : cluster [DBG] pgmap v4075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:34.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:33 gibba013 bash[30381]: audit 2021-03-10T16:08:33.736685+0000 mon.a (mon.0) 2716 : audit [DBG] from='client.? 172.21.2.113:0/1493608573' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:34.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:33 gibba020 bash[25448]: cluster 2021-03-10T16:08:32.327900+0000 mgr.gibba020.yqfnwy (mgr.34427) 7161 : cluster [DBG] pgmap v4075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:34.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:33 gibba020 bash[25448]: audit 2021-03-10T16:08:33.736685+0000 mon.a (mon.0) 2716 : audit [DBG] from='client.? 172.21.2.113:0/1493608573' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:08:35.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:34 gibba013 bash[29418]: audit 2021-03-10T16:08:33.217492+0000 mgr.gibba020.yqfnwy (mgr.34427) 7162 : audit [DBG] from='client.48858 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:08:35.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:34 gibba013 bash[29418]: audit 2021-03-10T16:08:33.438584+0000 mgr.gibba020.yqfnwy (mgr.34427) 7163 : audit [DBG] from='client.48864 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:08:35.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:34 gibba013 bash[30381]: audit 2021-03-10T16:08:33.217492+0000 mgr.gibba020.yqfnwy (mgr.34427) 7162 : audit [DBG] from='client.48858 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:08:35.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:34 gibba013 bash[30381]: audit 2021-03-10T16:08:33.438584+0000 mgr.gibba020.yqfnwy (mgr.34427) 7163 : audit [DBG] from='client.48864 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:08:35.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:34 gibba020 bash[25448]: audit 2021-03-10T16:08:33.217492+0000 mgr.gibba020.yqfnwy (mgr.34427) 7162 : audit [DBG] from='client.48858 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:08:35.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:34 gibba020 bash[25448]: audit 2021-03-10T16:08:33.438584+0000 mgr.gibba020.yqfnwy (mgr.34427) 7163 : audit [DBG] from='client.48864 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:08:36.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:35 gibba013 bash[29418]: cephadm 2021-03-10T16:08:34.215438+0000 mgr.gibba020.yqfnwy (mgr.34427) 7164 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:08:36.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:35 gibba013 bash[29418]: cluster 2021-03-10T16:08:34.329602+0000 mgr.gibba020.yqfnwy (mgr.34427) 7165 : cluster [DBG] pgmap v4076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:36.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:35 gibba013 bash[30381]: cephadm 2021-03-10T16:08:34.215438+0000 mgr.gibba020.yqfnwy (mgr.34427) 7164 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:08:36.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:35 gibba013 bash[30381]: cluster 2021-03-10T16:08:34.329602+0000 mgr.gibba020.yqfnwy (mgr.34427) 7165 : cluster [DBG] pgmap v4076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:36.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:35 gibba020 bash[25448]: cephadm 2021-03-10T16:08:34.215438+0000 mgr.gibba020.yqfnwy (mgr.34427) 7164 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:08:36.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:35 gibba020 bash[25448]: cluster 2021-03-10T16:08:34.329602+0000 mgr.gibba020.yqfnwy (mgr.34427) 7165 : cluster [DBG] pgmap v4076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:38.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:37 gibba013 bash[29418]: cluster 2021-03-10T16:08:36.331424+0000 mgr.gibba020.yqfnwy (mgr.34427) 7166 : cluster [DBG] pgmap v4077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:38.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:37 gibba013 bash[30381]: cluster 2021-03-10T16:08:36.331424+0000 mgr.gibba020.yqfnwy (mgr.34427) 7166 : cluster [DBG] pgmap v4077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:38.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:37 gibba020 bash[25448]: cluster 2021-03-10T16:08:36.331424+0000 mgr.gibba020.yqfnwy (mgr.34427) 7166 : cluster [DBG] pgmap v4077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:40.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:39 gibba013 bash[29418]: cluster 2021-03-10T16:08:38.332015+0000 mgr.gibba020.yqfnwy (mgr.34427) 7167 : cluster [DBG] pgmap v4078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:40.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:39 gibba013 bash[30381]: cluster 2021-03-10T16:08:38.332015+0000 mgr.gibba020.yqfnwy (mgr.34427) 7167 : cluster [DBG] pgmap v4078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:40.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:39 gibba020 bash[25448]: cluster 2021-03-10T16:08:38.332015+0000 mgr.gibba020.yqfnwy (mgr.34427) 7167 : cluster [DBG] pgmap v4078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:42.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:41 gibba013 bash[29418]: cluster 2021-03-10T16:08:40.333674+0000 mgr.gibba020.yqfnwy (mgr.34427) 7168 : cluster [DBG] pgmap v4079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:42.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:41 gibba013 bash[30381]: cluster 2021-03-10T16:08:40.333674+0000 mgr.gibba020.yqfnwy (mgr.34427) 7168 : cluster [DBG] pgmap v4079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:42.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:41 gibba020 bash[25448]: cluster 2021-03-10T16:08:40.333674+0000 mgr.gibba020.yqfnwy (mgr.34427) 7168 : cluster [DBG] pgmap v4079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:44.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:43 gibba013 bash[29418]: cluster 2021-03-10T16:08:42.334793+0000 mgr.gibba020.yqfnwy (mgr.34427) 7169 : cluster [DBG] pgmap v4080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:44.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:43 gibba013 bash[30381]: cluster 2021-03-10T16:08:42.334793+0000 mgr.gibba020.yqfnwy (mgr.34427) 7169 : cluster [DBG] pgmap v4080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:44.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:43 gibba020 bash[25448]: cluster 2021-03-10T16:08:42.334793+0000 mgr.gibba020.yqfnwy (mgr.34427) 7169 : cluster [DBG] pgmap v4080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:46.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:45 gibba013 bash[29418]: cluster 2021-03-10T16:08:44.336348+0000 mgr.gibba020.yqfnwy (mgr.34427) 7170 : cluster [DBG] pgmap v4081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:46.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:45 gibba013 bash[30381]: cluster 2021-03-10T16:08:44.336348+0000 mgr.gibba020.yqfnwy (mgr.34427) 7170 : cluster [DBG] pgmap v4081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:46.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:45 gibba020 bash[25448]: cluster 2021-03-10T16:08:44.336348+0000 mgr.gibba020.yqfnwy (mgr.34427) 7170 : cluster [DBG] pgmap v4081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:48.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:47 gibba013 bash[29418]: cluster 2021-03-10T16:08:46.337077+0000 mgr.gibba020.yqfnwy (mgr.34427) 7171 : cluster [DBG] pgmap v4082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:48.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:47 gibba013 bash[30381]: cluster 2021-03-10T16:08:46.337077+0000 mgr.gibba020.yqfnwy (mgr.34427) 7171 : cluster [DBG] pgmap v4082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:48.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:47 gibba020 bash[25448]: cluster 2021-03-10T16:08:46.337077+0000 mgr.gibba020.yqfnwy (mgr.34427) 7171 : cluster [DBG] pgmap v4082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:50.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:49 gibba013 bash[29418]: cluster 2021-03-10T16:08:48.338379+0000 mgr.gibba020.yqfnwy (mgr.34427) 7172 : cluster [DBG] pgmap v4083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:50.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:49 gibba013 bash[30381]: cluster 2021-03-10T16:08:48.338379+0000 mgr.gibba020.yqfnwy (mgr.34427) 7172 : cluster [DBG] pgmap v4083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:50.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:49 gibba020 bash[25448]: cluster 2021-03-10T16:08:48.338379+0000 mgr.gibba020.yqfnwy (mgr.34427) 7172 : cluster [DBG] pgmap v4083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:51.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:50 gibba013 bash[29418]: cephadm 2021-03-10T16:08:49.231534+0000 mgr.gibba020.yqfnwy (mgr.34427) 7173 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:08:51.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:50 gibba013 bash[30381]: cephadm 2021-03-10T16:08:49.231534+0000 mgr.gibba020.yqfnwy (mgr.34427) 7173 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:08:51.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:50 gibba020 bash[25448]: cephadm 2021-03-10T16:08:49.231534+0000 mgr.gibba020.yqfnwy (mgr.34427) 7173 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:08:52.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:51 gibba013 bash[29418]: cluster 2021-03-10T16:08:50.340115+0000 mgr.gibba020.yqfnwy (mgr.34427) 7174 : cluster [DBG] pgmap v4084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:52.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:51 gibba013 bash[30381]: cluster 2021-03-10T16:08:50.340115+0000 mgr.gibba020.yqfnwy (mgr.34427) 7174 : cluster [DBG] pgmap v4084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:52.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:51 gibba020 bash[25448]: cluster 2021-03-10T16:08:50.340115+0000 mgr.gibba020.yqfnwy (mgr.34427) 7174 : cluster [DBG] pgmap v4084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:54.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:53 gibba013 bash[29418]: cluster 2021-03-10T16:08:52.341543+0000 mgr.gibba020.yqfnwy (mgr.34427) 7175 : cluster [DBG] pgmap v4085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:54.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:53 gibba013 bash[30381]: cluster 2021-03-10T16:08:52.341543+0000 mgr.gibba020.yqfnwy (mgr.34427) 7175 : cluster [DBG] pgmap v4085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:54.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:53 gibba020 bash[25448]: cluster 2021-03-10T16:08:52.341543+0000 mgr.gibba020.yqfnwy (mgr.34427) 7175 : cluster [DBG] pgmap v4085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:56.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:55 gibba020 bash[25448]: cluster 2021-03-10T16:08:54.342120+0000 mgr.gibba020.yqfnwy (mgr.34427) 7176 : cluster [DBG] pgmap v4086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:56.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:55 gibba013 bash[29418]: cluster 2021-03-10T16:08:54.342120+0000 mgr.gibba020.yqfnwy (mgr.34427) 7176 : cluster [DBG] pgmap v4086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:56.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:55 gibba013 bash[30381]: cluster 2021-03-10T16:08:54.342120+0000 mgr.gibba020.yqfnwy (mgr.34427) 7176 : cluster [DBG] pgmap v4086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:58.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:57 gibba020 bash[25448]: cluster 2021-03-10T16:08:56.343731+0000 mgr.gibba020.yqfnwy (mgr.34427) 7177 : cluster [DBG] pgmap v4087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:58.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:57 gibba013 bash[29418]: cluster 2021-03-10T16:08:56.343731+0000 mgr.gibba020.yqfnwy (mgr.34427) 7177 : cluster [DBG] pgmap v4087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:08:58.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:57 gibba013 bash[30381]: cluster 2021-03-10T16:08:56.343731+0000 mgr.gibba020.yqfnwy (mgr.34427) 7177 : cluster [DBG] pgmap v4087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:00.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:08:59 gibba020 bash[25448]: cluster 2021-03-10T16:08:58.345132+0000 mgr.gibba020.yqfnwy (mgr.34427) 7178 : cluster [DBG] pgmap v4088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:00.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:08:59 gibba013 bash[29418]: cluster 2021-03-10T16:08:58.345132+0000 mgr.gibba020.yqfnwy (mgr.34427) 7178 : cluster [DBG] pgmap v4088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:00.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:08:59 gibba013 bash[30381]: cluster 2021-03-10T16:08:58.345132+0000 mgr.gibba020.yqfnwy (mgr.34427) 7178 : cluster [DBG] pgmap v4088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:02.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:01 gibba020 bash[25448]: cluster 2021-03-10T16:09:00.346795+0000 mgr.gibba020.yqfnwy (mgr.34427) 7179 : cluster [DBG] pgmap v4089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:02.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:01 gibba013 bash[29418]: cluster 2021-03-10T16:09:00.346795+0000 mgr.gibba020.yqfnwy (mgr.34427) 7179 : cluster [DBG] pgmap v4089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:02.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:01 gibba013 bash[30381]: cluster 2021-03-10T16:09:00.346795+0000 mgr.gibba020.yqfnwy (mgr.34427) 7179 : cluster [DBG] pgmap v4089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:03.977 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:09:04.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:03 gibba020 bash[25448]: cluster 2021-03-10T16:09:02.348107+0000 mgr.gibba020.yqfnwy (mgr.34427) 7180 : cluster [DBG] pgmap v4090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:04.203 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:09:04.204 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 9m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:09:04.204 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 8m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:09:04.204 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:09:04.205 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:09:04.205 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:09:04.205 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:09:04.205 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:09:04.206 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:09:04.206 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:09:04.206 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:09:04.206 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:09:04.207 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:09:04.207 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:09:04.207 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:09:04.207 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:09:04.208 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:09:04.208 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:09:04.208 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:09:04.208 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 8m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:09:04.209 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 8m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:09:04.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:03 gibba013 bash[29418]: cluster 2021-03-10T16:09:02.348107+0000 mgr.gibba020.yqfnwy (mgr.34427) 7180 : cluster [DBG] pgmap v4090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:04.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:03 gibba013 bash[30381]: cluster 2021-03-10T16:09:02.348107+0000 mgr.gibba020.yqfnwy (mgr.34427) 7180 : cluster [DBG] pgmap v4090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:04.457 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:09:04.457 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:09:04.457 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:09:04.458 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:09:04.458 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:09:04.458 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:09:04.459 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:09:04.459 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:09:04.459 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:09:04.459 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:09:04.460 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:09:04.460 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:09:04.460 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:09:04.460 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:09:04.461 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:09:05.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:04 gibba020 bash[25448]: audit 2021-03-10T16:09:03.968585+0000 mgr.gibba020.yqfnwy (mgr.34427) 7181 : audit [DBG] from='client.58858 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:09:05.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:04 gibba020 bash[25448]: audit 2021-03-10T16:09:04.190791+0000 mgr.gibba020.yqfnwy (mgr.34427) 7182 : audit [DBG] from='client.58864 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:09:05.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:04 gibba020 bash[25448]: audit 2021-03-10T16:09:04.248715+0000 mon.a (mon.0) 2717 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:09:05.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:04 gibba020 bash[25448]: audit 2021-03-10T16:09:04.457806+0000 mon.a (mon.0) 2718 : audit [DBG] from='client.? 172.21.2.113:0/817869187' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:05.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:04 gibba020 bash[25448]: audit 2021-03-10T16:09:04.463994+0000 mon.a (mon.0) 2719 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:09:05.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:04 gibba020 bash[25448]: audit 2021-03-10T16:09:04.467259+0000 mon.a (mon.0) 2720 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:09:05.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:04 gibba020 bash[25448]: audit 2021-03-10T16:09:04.468586+0000 mon.a (mon.0) 2721 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:05.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:04 gibba020 bash[25448]: audit 2021-03-10T16:09:04.469635+0000 mon.a (mon.0) 2722 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:05.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:04 gibba020 bash[25448]: audit 2021-03-10T16:09:04.470742+0000 mon.a (mon.0) 2723 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:05.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:04 gibba020 bash[25448]: audit 2021-03-10T16:09:04.472660+0000 mon.a (mon.0) 2724 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:05.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:04 gibba020 bash[25448]: audit 2021-03-10T16:09:04.474331+0000 mon.a (mon.0) 2725 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:05.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:04 gibba013 bash[29418]: audit 2021-03-10T16:09:03.968585+0000 mgr.gibba020.yqfnwy (mgr.34427) 7181 : audit [DBG] from='client.58858 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:09:05.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:04 gibba013 bash[29418]: audit 2021-03-10T16:09:04.190791+0000 mgr.gibba020.yqfnwy (mgr.34427) 7182 : audit [DBG] from='client.58864 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:09:05.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:04 gibba013 bash[29418]: audit 2021-03-10T16:09:04.248715+0000 mon.a (mon.0) 2717 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:09:05.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:04 gibba013 bash[29418]: audit 2021-03-10T16:09:04.457806+0000 mon.a (mon.0) 2718 : audit [DBG] from='client.? 172.21.2.113:0/817869187' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:05.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:04 gibba013 bash[29418]: audit 2021-03-10T16:09:04.463994+0000 mon.a (mon.0) 2719 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:09:05.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:04 gibba013 bash[29418]: audit 2021-03-10T16:09:04.467259+0000 mon.a (mon.0) 2720 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:09:05.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:04 gibba013 bash[29418]: audit 2021-03-10T16:09:04.468586+0000 mon.a (mon.0) 2721 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:05.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:04 gibba013 bash[29418]: audit 2021-03-10T16:09:04.469635+0000 mon.a (mon.0) 2722 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:05.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:04 gibba013 bash[29418]: audit 2021-03-10T16:09:04.470742+0000 mon.a (mon.0) 2723 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:05.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:04 gibba013 bash[29418]: audit 2021-03-10T16:09:04.472660+0000 mon.a (mon.0) 2724 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:05.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:04 gibba013 bash[29418]: audit 2021-03-10T16:09:04.474331+0000 mon.a (mon.0) 2725 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:05.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:04 gibba013 bash[30381]: audit 2021-03-10T16:09:03.968585+0000 mgr.gibba020.yqfnwy (mgr.34427) 7181 : audit [DBG] from='client.58858 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:09:05.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:04 gibba013 bash[30381]: audit 2021-03-10T16:09:04.190791+0000 mgr.gibba020.yqfnwy (mgr.34427) 7182 : audit [DBG] from='client.58864 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:09:05.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:04 gibba013 bash[30381]: audit 2021-03-10T16:09:04.248715+0000 mon.a (mon.0) 2717 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:09:05.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:04 gibba013 bash[30381]: audit 2021-03-10T16:09:04.457806+0000 mon.a (mon.0) 2718 : audit [DBG] from='client.? 172.21.2.113:0/817869187' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:05.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:04 gibba013 bash[30381]: audit 2021-03-10T16:09:04.463994+0000 mon.a (mon.0) 2719 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:09:05.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:04 gibba013 bash[30381]: audit 2021-03-10T16:09:04.467259+0000 mon.a (mon.0) 2720 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:09:05.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:04 gibba013 bash[30381]: audit 2021-03-10T16:09:04.468586+0000 mon.a (mon.0) 2721 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:05.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:04 gibba013 bash[30381]: audit 2021-03-10T16:09:04.469635+0000 mon.a (mon.0) 2722 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:05.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:04 gibba013 bash[30381]: audit 2021-03-10T16:09:04.470742+0000 mon.a (mon.0) 2723 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:05.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:04 gibba013 bash[30381]: audit 2021-03-10T16:09:04.472660+0000 mon.a (mon.0) 2724 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:05.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:04 gibba013 bash[30381]: audit 2021-03-10T16:09:04.474331+0000 mon.a (mon.0) 2725 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:06.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:05 gibba020 bash[25448]: cephadm 2021-03-10T16:09:04.249719+0000 mgr.gibba020.yqfnwy (mgr.34427) 7183 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:09:06.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:05 gibba020 bash[25448]: cephadm 2021-03-10T16:09:04.250551+0000 mgr.gibba020.yqfnwy (mgr.34427) 7184 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:09:06.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:05 gibba020 bash[25448]: cluster 2021-03-10T16:09:04.348632+0000 mgr.gibba020.yqfnwy (mgr.34427) 7185 : cluster [DBG] pgmap v4091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:06.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:05 gibba020 bash[25448]: cephadm 2021-03-10T16:09:04.465386+0000 mgr.gibba020.yqfnwy (mgr.34427) 7186 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:09:06.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:05 gibba020 bash[25448]: cephadm 2021-03-10T16:09:04.467164+0000 mgr.gibba020.yqfnwy (mgr.34427) 7187 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:09:06.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:05 gibba020 bash[25448]: cephadm 2021-03-10T16:09:04.468145+0000 mgr.gibba020.yqfnwy (mgr.34427) 7188 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:09:06.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:05 gibba020 bash[25448]: cephadm 2021-03-10T16:09:04.468184+0000 mgr.gibba020.yqfnwy (mgr.34427) 7189 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:09:06.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:05 gibba020 bash[25448]: cephadm 2021-03-10T16:09:04.469245+0000 mgr.gibba020.yqfnwy (mgr.34427) 7190 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:09:06.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:05 gibba020 bash[25448]: cephadm 2021-03-10T16:09:04.469282+0000 mgr.gibba020.yqfnwy (mgr.34427) 7191 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:09:06.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:05 gibba020 bash[25448]: cephadm 2021-03-10T16:09:04.470249+0000 mgr.gibba020.yqfnwy (mgr.34427) 7192 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:09:06.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:05 gibba020 bash[25448]: cephadm 2021-03-10T16:09:04.471111+0000 mgr.gibba020.yqfnwy (mgr.34427) 7193 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:09:06.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:05 gibba020 bash[25448]: cephadm 2021-03-10T16:09:04.471150+0000 mgr.gibba020.yqfnwy (mgr.34427) 7194 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:09:06.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:05 gibba020 bash[25448]: cephadm 2021-03-10T16:09:04.472590+0000 mgr.gibba020.yqfnwy (mgr.34427) 7195 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:09:06.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:05 gibba020 bash[25448]: cephadm 2021-03-10T16:09:04.472921+0000 mgr.gibba020.yqfnwy (mgr.34427) 7196 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:09:06.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:05 gibba020 bash[25448]: cephadm 2021-03-10T16:09:04.474355+0000 mgr.gibba020.yqfnwy (mgr.34427) 7197 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:09:06.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:05 gibba020 bash[25448]: cephadm 2021-03-10T16:09:04.474395+0000 mgr.gibba020.yqfnwy (mgr.34427) 7198 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:09:06.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:05 gibba020 bash[25448]: cephadm 2021-03-10T16:09:04.474554+0000 mgr.gibba020.yqfnwy (mgr.34427) 7199 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:09:06.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:05 gibba013 bash[29418]: cephadm 2021-03-10T16:09:04.249719+0000 mgr.gibba020.yqfnwy (mgr.34427) 7183 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:09:06.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:05 gibba013 bash[29418]: cephadm 2021-03-10T16:09:04.250551+0000 mgr.gibba020.yqfnwy (mgr.34427) 7184 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:09:06.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:05 gibba013 bash[29418]: cluster 2021-03-10T16:09:04.348632+0000 mgr.gibba020.yqfnwy (mgr.34427) 7185 : cluster [DBG] pgmap v4091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:06.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:05 gibba013 bash[29418]: cephadm 2021-03-10T16:09:04.465386+0000 mgr.gibba020.yqfnwy (mgr.34427) 7186 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:09:06.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:05 gibba013 bash[29418]: cephadm 2021-03-10T16:09:04.467164+0000 mgr.gibba020.yqfnwy (mgr.34427) 7187 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:09:06.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:05 gibba013 bash[29418]: cephadm 2021-03-10T16:09:04.468145+0000 mgr.gibba020.yqfnwy (mgr.34427) 7188 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:09:06.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:05 gibba013 bash[29418]: cephadm 2021-03-10T16:09:04.468184+0000 mgr.gibba020.yqfnwy (mgr.34427) 7189 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:09:06.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:05 gibba013 bash[29418]: cephadm 2021-03-10T16:09:04.469245+0000 mgr.gibba020.yqfnwy (mgr.34427) 7190 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:09:06.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:05 gibba013 bash[29418]: cephadm 2021-03-10T16:09:04.469282+0000 mgr.gibba020.yqfnwy (mgr.34427) 7191 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:09:06.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:05 gibba013 bash[29418]: cephadm 2021-03-10T16:09:04.470249+0000 mgr.gibba020.yqfnwy (mgr.34427) 7192 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:09:06.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:05 gibba013 bash[29418]: cephadm 2021-03-10T16:09:04.471111+0000 mgr.gibba020.yqfnwy (mgr.34427) 7193 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:09:06.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:05 gibba013 bash[29418]: cephadm 2021-03-10T16:09:04.471150+0000 mgr.gibba020.yqfnwy (mgr.34427) 7194 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:09:06.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:05 gibba013 bash[29418]: cephadm 2021-03-10T16:09:04.472590+0000 mgr.gibba020.yqfnwy (mgr.34427) 7195 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:09:06.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:05 gibba013 bash[29418]: cephadm 2021-03-10T16:09:04.472921+0000 mgr.gibba020.yqfnwy (mgr.34427) 7196 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:09:06.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:05 gibba013 bash[29418]: cephadm 2021-03-10T16:09:04.474355+0000 mgr.gibba020.yqfnwy (mgr.34427) 7197 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:09:06.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:05 gibba013 bash[29418]: cephadm 2021-03-10T16:09:04.474395+0000 mgr.gibba020.yqfnwy (mgr.34427) 7198 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:09:06.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:05 gibba013 bash[29418]: cephadm 2021-03-10T16:09:04.474554+0000 mgr.gibba020.yqfnwy (mgr.34427) 7199 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:09:06.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:05 gibba013 bash[30381]: cephadm 2021-03-10T16:09:04.249719+0000 mgr.gibba020.yqfnwy (mgr.34427) 7183 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:09:06.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:05 gibba013 bash[30381]: cephadm 2021-03-10T16:09:04.250551+0000 mgr.gibba020.yqfnwy (mgr.34427) 7184 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:09:06.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:05 gibba013 bash[30381]: cluster 2021-03-10T16:09:04.348632+0000 mgr.gibba020.yqfnwy (mgr.34427) 7185 : cluster [DBG] pgmap v4091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:06.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:05 gibba013 bash[30381]: cephadm 2021-03-10T16:09:04.465386+0000 mgr.gibba020.yqfnwy (mgr.34427) 7186 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:09:06.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:05 gibba013 bash[30381]: cephadm 2021-03-10T16:09:04.467164+0000 mgr.gibba020.yqfnwy (mgr.34427) 7187 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:09:06.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:05 gibba013 bash[30381]: cephadm 2021-03-10T16:09:04.468145+0000 mgr.gibba020.yqfnwy (mgr.34427) 7188 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:09:06.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:05 gibba013 bash[30381]: cephadm 2021-03-10T16:09:04.468184+0000 mgr.gibba020.yqfnwy (mgr.34427) 7189 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:09:06.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:05 gibba013 bash[30381]: cephadm 2021-03-10T16:09:04.469245+0000 mgr.gibba020.yqfnwy (mgr.34427) 7190 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:09:06.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:05 gibba013 bash[30381]: cephadm 2021-03-10T16:09:04.469282+0000 mgr.gibba020.yqfnwy (mgr.34427) 7191 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:09:06.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:05 gibba013 bash[30381]: cephadm 2021-03-10T16:09:04.470249+0000 mgr.gibba020.yqfnwy (mgr.34427) 7192 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:09:06.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:05 gibba013 bash[30381]: cephadm 2021-03-10T16:09:04.471111+0000 mgr.gibba020.yqfnwy (mgr.34427) 7193 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:09:06.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:05 gibba013 bash[30381]: cephadm 2021-03-10T16:09:04.471150+0000 mgr.gibba020.yqfnwy (mgr.34427) 7194 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:09:06.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:05 gibba013 bash[30381]: cephadm 2021-03-10T16:09:04.472590+0000 mgr.gibba020.yqfnwy (mgr.34427) 7195 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:09:06.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:05 gibba013 bash[30381]: cephadm 2021-03-10T16:09:04.472921+0000 mgr.gibba020.yqfnwy (mgr.34427) 7196 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:09:06.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:05 gibba013 bash[30381]: cephadm 2021-03-10T16:09:04.474355+0000 mgr.gibba020.yqfnwy (mgr.34427) 7197 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:09:06.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:05 gibba013 bash[30381]: cephadm 2021-03-10T16:09:04.474395+0000 mgr.gibba020.yqfnwy (mgr.34427) 7198 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:09:06.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:05 gibba013 bash[30381]: cephadm 2021-03-10T16:09:04.474554+0000 mgr.gibba020.yqfnwy (mgr.34427) 7199 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:09:07.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:06 gibba020 bash[25448]: audit 2021-03-10T16:09:06.643550+0000 mon.a (mon.0) 2726 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:09:07.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:06 gibba020 bash[25448]: audit 2021-03-10T16:09:06.732212+0000 mon.a (mon.0) 2727 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:09:07.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:06 gibba013 bash[29418]: audit 2021-03-10T16:09:06.643550+0000 mon.a (mon.0) 2726 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:09:07.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:06 gibba013 bash[29418]: audit 2021-03-10T16:09:06.732212+0000 mon.a (mon.0) 2727 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:09:07.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:06 gibba013 bash[30381]: audit 2021-03-10T16:09:06.643550+0000 mon.a (mon.0) 2726 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:09:07.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:06 gibba013 bash[30381]: audit 2021-03-10T16:09:06.732212+0000 mon.a (mon.0) 2727 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:09:08.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:07 gibba013 bash[29418]: cluster 2021-03-10T16:09:06.350148+0000 mgr.gibba020.yqfnwy (mgr.34427) 7200 : cluster [DBG] pgmap v4092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:08.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:07 gibba013 bash[29418]: audit 2021-03-10T16:09:06.953619+0000 mon.a (mon.0) 2728 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:09:08.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:07 gibba013 bash[29418]: audit 2021-03-10T16:09:06.953761+0000 mon.a (mon.0) 2729 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:09:08.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:07 gibba013 bash[29418]: audit 2021-03-10T16:09:06.953883+0000 mon.a (mon.0) 2730 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:09:08.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:07 gibba013 bash[29418]: audit 2021-03-10T16:09:06.954013+0000 mon.a (mon.0) 2731 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:09:08.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:07 gibba013 bash[30381]: cluster 2021-03-10T16:09:06.350148+0000 mgr.gibba020.yqfnwy (mgr.34427) 7200 : cluster [DBG] pgmap v4092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:08.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:07 gibba013 bash[30381]: audit 2021-03-10T16:09:06.953619+0000 mon.a (mon.0) 2728 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:09:08.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:07 gibba013 bash[30381]: audit 2021-03-10T16:09:06.953761+0000 mon.a (mon.0) 2729 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:09:08.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:07 gibba013 bash[30381]: audit 2021-03-10T16:09:06.953883+0000 mon.a (mon.0) 2730 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:09:08.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:07 gibba013 bash[30381]: audit 2021-03-10T16:09:06.954013+0000 mon.a (mon.0) 2731 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:09:08.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:07 gibba020 bash[25448]: cluster 2021-03-10T16:09:06.350148+0000 mgr.gibba020.yqfnwy (mgr.34427) 7200 : cluster [DBG] pgmap v4092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:08.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:07 gibba020 bash[25448]: audit 2021-03-10T16:09:06.953619+0000 mon.a (mon.0) 2728 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:09:08.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:07 gibba020 bash[25448]: audit 2021-03-10T16:09:06.953761+0000 mon.a (mon.0) 2729 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:09:08.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:07 gibba020 bash[25448]: audit 2021-03-10T16:09:06.953883+0000 mon.a (mon.0) 2730 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:09:08.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:07 gibba020 bash[25448]: audit 2021-03-10T16:09:06.954013+0000 mon.a (mon.0) 2731 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:09:10.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:09 gibba013 bash[29418]: cluster 2021-03-10T16:09:08.351575+0000 mgr.gibba020.yqfnwy (mgr.34427) 7201 : cluster [DBG] pgmap v4093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:10.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:09 gibba013 bash[30381]: cluster 2021-03-10T16:09:08.351575+0000 mgr.gibba020.yqfnwy (mgr.34427) 7201 : cluster [DBG] pgmap v4093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:10.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:09 gibba020 bash[25448]: cluster 2021-03-10T16:09:08.351575+0000 mgr.gibba020.yqfnwy (mgr.34427) 7201 : cluster [DBG] pgmap v4093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:12.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:11 gibba013 bash[29418]: cluster 2021-03-10T16:09:10.352425+0000 mgr.gibba020.yqfnwy (mgr.34427) 7202 : cluster [DBG] pgmap v4094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:12.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:11 gibba013 bash[30381]: cluster 2021-03-10T16:09:10.352425+0000 mgr.gibba020.yqfnwy (mgr.34427) 7202 : cluster [DBG] pgmap v4094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:12.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:11 gibba020 bash[25448]: cluster 2021-03-10T16:09:10.352425+0000 mgr.gibba020.yqfnwy (mgr.34427) 7202 : cluster [DBG] pgmap v4094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:14.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:13 gibba013 bash[29418]: cluster 2021-03-10T16:09:12.353760+0000 mgr.gibba020.yqfnwy (mgr.34427) 7203 : cluster [DBG] pgmap v4095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:14.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:13 gibba013 bash[30381]: cluster 2021-03-10T16:09:12.353760+0000 mgr.gibba020.yqfnwy (mgr.34427) 7203 : cluster [DBG] pgmap v4095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:14.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:13 gibba020 bash[25448]: cluster 2021-03-10T16:09:12.353760+0000 mgr.gibba020.yqfnwy (mgr.34427) 7203 : cluster [DBG] pgmap v4095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:16.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:15 gibba013 bash[29418]: cluster 2021-03-10T16:09:14.355388+0000 mgr.gibba020.yqfnwy (mgr.34427) 7204 : cluster [DBG] pgmap v4096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:16.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:15 gibba013 bash[30381]: cluster 2021-03-10T16:09:14.355388+0000 mgr.gibba020.yqfnwy (mgr.34427) 7204 : cluster [DBG] pgmap v4096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:16.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:15 gibba020 bash[25448]: cluster 2021-03-10T16:09:14.355388+0000 mgr.gibba020.yqfnwy (mgr.34427) 7204 : cluster [DBG] pgmap v4096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:18.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:17 gibba013 bash[29418]: cluster 2021-03-10T16:09:16.357290+0000 mgr.gibba020.yqfnwy (mgr.34427) 7205 : cluster [DBG] pgmap v4097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:18.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:18 gibba013 bash[30381]: cluster 2021-03-10T16:09:16.357290+0000 mgr.gibba020.yqfnwy (mgr.34427) 7205 : cluster [DBG] pgmap v4097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:18.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:18 gibba020 bash[25448]: cluster 2021-03-10T16:09:16.357290+0000 mgr.gibba020.yqfnwy (mgr.34427) 7205 : cluster [DBG] pgmap v4097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:20.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:20 gibba013 bash[29418]: cluster 2021-03-10T16:09:18.357928+0000 mgr.gibba020.yqfnwy (mgr.34427) 7206 : cluster [DBG] pgmap v4098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:20.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:20 gibba013 bash[30381]: cluster 2021-03-10T16:09:18.357928+0000 mgr.gibba020.yqfnwy (mgr.34427) 7206 : cluster [DBG] pgmap v4098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:20.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:20 gibba020 bash[25448]: cluster 2021-03-10T16:09:18.357928+0000 mgr.gibba020.yqfnwy (mgr.34427) 7206 : cluster [DBG] pgmap v4098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:21.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:21 gibba013 bash[29418]: cephadm 2021-03-10T16:09:19.490680+0000 mgr.gibba020.yqfnwy (mgr.34427) 7207 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:09:21.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:21 gibba013 bash[30381]: cephadm 2021-03-10T16:09:19.490680+0000 mgr.gibba020.yqfnwy (mgr.34427) 7207 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:09:21.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:21 gibba020 bash[25448]: cephadm 2021-03-10T16:09:19.490680+0000 mgr.gibba020.yqfnwy (mgr.34427) 7207 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:09:22.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:22 gibba013 bash[29418]: cluster 2021-03-10T16:09:20.359558+0000 mgr.gibba020.yqfnwy (mgr.34427) 7208 : cluster [DBG] pgmap v4099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:22.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:22 gibba013 bash[30381]: cluster 2021-03-10T16:09:20.359558+0000 mgr.gibba020.yqfnwy (mgr.34427) 7208 : cluster [DBG] pgmap v4099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:22.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:22 gibba020 bash[25448]: cluster 2021-03-10T16:09:20.359558+0000 mgr.gibba020.yqfnwy (mgr.34427) 7208 : cluster [DBG] pgmap v4099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:24.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:24 gibba013 bash[29418]: cluster 2021-03-10T16:09:22.360923+0000 mgr.gibba020.yqfnwy (mgr.34427) 7209 : cluster [DBG] pgmap v4100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:24.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:24 gibba013 bash[30381]: cluster 2021-03-10T16:09:22.360923+0000 mgr.gibba020.yqfnwy (mgr.34427) 7209 : cluster [DBG] pgmap v4100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:24.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:24 gibba020 bash[25448]: cluster 2021-03-10T16:09:22.360923+0000 mgr.gibba020.yqfnwy (mgr.34427) 7209 : cluster [DBG] pgmap v4100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:26.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:26 gibba013 bash[29418]: cluster 2021-03-10T16:09:24.362443+0000 mgr.gibba020.yqfnwy (mgr.34427) 7210 : cluster [DBG] pgmap v4101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:26.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:26 gibba013 bash[30381]: cluster 2021-03-10T16:09:24.362443+0000 mgr.gibba020.yqfnwy (mgr.34427) 7210 : cluster [DBG] pgmap v4101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:26.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:26 gibba020 bash[25448]: cluster 2021-03-10T16:09:24.362443+0000 mgr.gibba020.yqfnwy (mgr.34427) 7210 : cluster [DBG] pgmap v4101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:28.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:28 gibba013 bash[29418]: cluster 2021-03-10T16:09:26.363381+0000 mgr.gibba020.yqfnwy (mgr.34427) 7211 : cluster [DBG] pgmap v4102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:28.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:28 gibba013 bash[30381]: cluster 2021-03-10T16:09:26.363381+0000 mgr.gibba020.yqfnwy (mgr.34427) 7211 : cluster [DBG] pgmap v4102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:28.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:28 gibba020 bash[25448]: cluster 2021-03-10T16:09:26.363381+0000 mgr.gibba020.yqfnwy (mgr.34427) 7211 : cluster [DBG] pgmap v4102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:30.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:30 gibba013 bash[29418]: cluster 2021-03-10T16:09:28.364723+0000 mgr.gibba020.yqfnwy (mgr.34427) 7212 : cluster [DBG] pgmap v4103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:30.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:30 gibba013 bash[30381]: cluster 2021-03-10T16:09:28.364723+0000 mgr.gibba020.yqfnwy (mgr.34427) 7212 : cluster [DBG] pgmap v4103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:30.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:30 gibba020 bash[25448]: cluster 2021-03-10T16:09:28.364723+0000 mgr.gibba020.yqfnwy (mgr.34427) 7212 : cluster [DBG] pgmap v4103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:32.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:32 gibba013 bash[29418]: cluster 2021-03-10T16:09:30.366457+0000 mgr.gibba020.yqfnwy (mgr.34427) 7213 : cluster [DBG] pgmap v4104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:32.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:32 gibba013 bash[30381]: cluster 2021-03-10T16:09:30.366457+0000 mgr.gibba020.yqfnwy (mgr.34427) 7213 : cluster [DBG] pgmap v4104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:32.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:32 gibba020 bash[25448]: cluster 2021-03-10T16:09:30.366457+0000 mgr.gibba020.yqfnwy (mgr.34427) 7213 : cluster [DBG] pgmap v4104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:34.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:34 gibba013 bash[29418]: cluster 2021-03-10T16:09:32.367847+0000 mgr.gibba020.yqfnwy (mgr.34427) 7214 : cluster [DBG] pgmap v4105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:34.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:34 gibba013 bash[30381]: cluster 2021-03-10T16:09:32.367847+0000 mgr.gibba020.yqfnwy (mgr.34427) 7214 : cluster [DBG] pgmap v4105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:34.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:34 gibba020 bash[25448]: cluster 2021-03-10T16:09:32.367847+0000 mgr.gibba020.yqfnwy (mgr.34427) 7214 : cluster [DBG] pgmap v4105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:34.703 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:09:34.932 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:09:34.932 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 9m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:09:34.933 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 8m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:09:34.933 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:09:34.933 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:09:34.934 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:09:34.934 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:09:34.935 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:09:34.935 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:09:34.936 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:09:34.936 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:09:34.936 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:09:34.937 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:09:34.937 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:09:34.938 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:09:34.938 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:09:34.939 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:09:34.939 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:09:34.939 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:09:34.940 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 8m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:09:34.940 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 8m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:09:35.182 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:09:35.182 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:09:35.182 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:09:35.183 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:09:35.183 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:09:35.183 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:09:35.183 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:09:35.184 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:09:35.184 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:09:35.184 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:09:35.184 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:09:35.184 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:09:35.185 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:09:35.185 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:09:35.185 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:09:36.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:36 gibba013 bash[29418]: cluster 2021-03-10T16:09:34.368914+0000 mgr.gibba020.yqfnwy (mgr.34427) 7215 : cluster [DBG] pgmap v4106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:36.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:36 gibba013 bash[29418]: cephadm 2021-03-10T16:09:34.504923+0000 mgr.gibba020.yqfnwy (mgr.34427) 7216 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:09:36.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:36 gibba013 bash[29418]: audit 2021-03-10T16:09:34.693122+0000 mgr.gibba020.yqfnwy (mgr.34427) 7217 : audit [DBG] from='client.48894 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:09:36.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:36 gibba013 bash[29418]: audit 2021-03-10T16:09:34.918375+0000 mgr.gibba020.yqfnwy (mgr.34427) 7218 : audit [DBG] from='client.58882 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:09:36.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:36 gibba013 bash[29418]: audit 2021-03-10T16:09:35.182515+0000 mon.a (mon.0) 2732 : audit [DBG] from='client.? 172.21.2.113:0/3525252728' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:36.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:36 gibba013 bash[30381]: cluster 2021-03-10T16:09:34.368914+0000 mgr.gibba020.yqfnwy (mgr.34427) 7215 : cluster [DBG] pgmap v4106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:36.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:36 gibba013 bash[30381]: cephadm 2021-03-10T16:09:34.504923+0000 mgr.gibba020.yqfnwy (mgr.34427) 7216 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:09:36.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:36 gibba013 bash[30381]: audit 2021-03-10T16:09:34.693122+0000 mgr.gibba020.yqfnwy (mgr.34427) 7217 : audit [DBG] from='client.48894 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:09:36.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:36 gibba013 bash[30381]: audit 2021-03-10T16:09:34.918375+0000 mgr.gibba020.yqfnwy (mgr.34427) 7218 : audit [DBG] from='client.58882 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:09:36.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:36 gibba013 bash[30381]: audit 2021-03-10T16:09:35.182515+0000 mon.a (mon.0) 2732 : audit [DBG] from='client.? 172.21.2.113:0/3525252728' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:36.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:36 gibba020 bash[25448]: cluster 2021-03-10T16:09:34.368914+0000 mgr.gibba020.yqfnwy (mgr.34427) 7215 : cluster [DBG] pgmap v4106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:36.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:36 gibba020 bash[25448]: cephadm 2021-03-10T16:09:34.504923+0000 mgr.gibba020.yqfnwy (mgr.34427) 7216 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:09:36.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:36 gibba020 bash[25448]: audit 2021-03-10T16:09:34.693122+0000 mgr.gibba020.yqfnwy (mgr.34427) 7217 : audit [DBG] from='client.48894 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:09:36.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:36 gibba020 bash[25448]: audit 2021-03-10T16:09:34.918375+0000 mgr.gibba020.yqfnwy (mgr.34427) 7218 : audit [DBG] from='client.58882 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:09:36.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:36 gibba020 bash[25448]: audit 2021-03-10T16:09:35.182515+0000 mon.a (mon.0) 2732 : audit [DBG] from='client.? 172.21.2.113:0/3525252728' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:09:38.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:38 gibba013 bash[29418]: cluster 2021-03-10T16:09:36.370425+0000 mgr.gibba020.yqfnwy (mgr.34427) 7219 : cluster [DBG] pgmap v4107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:38.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:38 gibba013 bash[30381]: cluster 2021-03-10T16:09:36.370425+0000 mgr.gibba020.yqfnwy (mgr.34427) 7219 : cluster [DBG] pgmap v4107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:38.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:38 gibba020 bash[25448]: cluster 2021-03-10T16:09:36.370425+0000 mgr.gibba020.yqfnwy (mgr.34427) 7219 : cluster [DBG] pgmap v4107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:40.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:40 gibba013 bash[29418]: cluster 2021-03-10T16:09:38.371931+0000 mgr.gibba020.yqfnwy (mgr.34427) 7220 : cluster [DBG] pgmap v4108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:40.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:40 gibba013 bash[30381]: cluster 2021-03-10T16:09:38.371931+0000 mgr.gibba020.yqfnwy (mgr.34427) 7220 : cluster [DBG] pgmap v4108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:40.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:40 gibba020 bash[25448]: cluster 2021-03-10T16:09:38.371931+0000 mgr.gibba020.yqfnwy (mgr.34427) 7220 : cluster [DBG] pgmap v4108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:42.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:42 gibba013 bash[29418]: cluster 2021-03-10T16:09:40.373746+0000 mgr.gibba020.yqfnwy (mgr.34427) 7221 : cluster [DBG] pgmap v4109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:42.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:42 gibba013 bash[30381]: cluster 2021-03-10T16:09:40.373746+0000 mgr.gibba020.yqfnwy (mgr.34427) 7221 : cluster [DBG] pgmap v4109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:42.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:42 gibba020 bash[25448]: cluster 2021-03-10T16:09:40.373746+0000 mgr.gibba020.yqfnwy (mgr.34427) 7221 : cluster [DBG] pgmap v4109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:44.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:44 gibba013 bash[29418]: cluster 2021-03-10T16:09:42.375102+0000 mgr.gibba020.yqfnwy (mgr.34427) 7222 : cluster [DBG] pgmap v4110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:44.514 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:44 gibba013 bash[30381]: cluster 2021-03-10T16:09:42.375102+0000 mgr.gibba020.yqfnwy (mgr.34427) 7222 : cluster [DBG] pgmap v4110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:44.514 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:44 gibba020 bash[25448]: cluster 2021-03-10T16:09:42.375102+0000 mgr.gibba020.yqfnwy (mgr.34427) 7222 : cluster [DBG] pgmap v4110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:46.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:46 gibba013 bash[29418]: cluster 2021-03-10T16:09:44.376687+0000 mgr.gibba020.yqfnwy (mgr.34427) 7223 : cluster [DBG] pgmap v4111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:46.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:46 gibba013 bash[30381]: cluster 2021-03-10T16:09:44.376687+0000 mgr.gibba020.yqfnwy (mgr.34427) 7223 : cluster [DBG] pgmap v4111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:46.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:46 gibba020 bash[25448]: cluster 2021-03-10T16:09:44.376687+0000 mgr.gibba020.yqfnwy (mgr.34427) 7223 : cluster [DBG] pgmap v4111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:48.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:48 gibba020 bash[25448]: cluster 2021-03-10T16:09:46.378510+0000 mgr.gibba020.yqfnwy (mgr.34427) 7224 : cluster [DBG] pgmap v4112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:48.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:48 gibba013 bash[29418]: cluster 2021-03-10T16:09:46.378510+0000 mgr.gibba020.yqfnwy (mgr.34427) 7224 : cluster [DBG] pgmap v4112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:48.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:48 gibba013 bash[30381]: cluster 2021-03-10T16:09:46.378510+0000 mgr.gibba020.yqfnwy (mgr.34427) 7224 : cluster [DBG] pgmap v4112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:50.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:50 gibba020 bash[25448]: cluster 2021-03-10T16:09:48.380044+0000 mgr.gibba020.yqfnwy (mgr.34427) 7225 : cluster [DBG] pgmap v4113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:50.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:50 gibba013 bash[29418]: cluster 2021-03-10T16:09:48.380044+0000 mgr.gibba020.yqfnwy (mgr.34427) 7225 : cluster [DBG] pgmap v4113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:50.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:50 gibba013 bash[30381]: cluster 2021-03-10T16:09:48.380044+0000 mgr.gibba020.yqfnwy (mgr.34427) 7225 : cluster [DBG] pgmap v4113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:51.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:51 gibba020 bash[25448]: cephadm 2021-03-10T16:09:49.521090+0000 mgr.gibba020.yqfnwy (mgr.34427) 7226 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:09:51.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:51 gibba013 bash[30381]: cephadm 2021-03-10T16:09:49.521090+0000 mgr.gibba020.yqfnwy (mgr.34427) 7226 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:09:51.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:51 gibba013 bash[29418]: cephadm 2021-03-10T16:09:49.521090+0000 mgr.gibba020.yqfnwy (mgr.34427) 7226 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:09:52.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:52 gibba020 bash[25448]: cluster 2021-03-10T16:09:50.381393+0000 mgr.gibba020.yqfnwy (mgr.34427) 7227 : cluster [DBG] pgmap v4114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:52.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:52 gibba013 bash[29418]: cluster 2021-03-10T16:09:50.381393+0000 mgr.gibba020.yqfnwy (mgr.34427) 7227 : cluster [DBG] pgmap v4114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:52.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:52 gibba013 bash[30381]: cluster 2021-03-10T16:09:50.381393+0000 mgr.gibba020.yqfnwy (mgr.34427) 7227 : cluster [DBG] pgmap v4114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:54.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:54 gibba020 bash[25448]: cluster 2021-03-10T16:09:52.382464+0000 mgr.gibba020.yqfnwy (mgr.34427) 7228 : cluster [DBG] pgmap v4115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:54.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:54 gibba013 bash[29418]: cluster 2021-03-10T16:09:52.382464+0000 mgr.gibba020.yqfnwy (mgr.34427) 7228 : cluster [DBG] pgmap v4115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:54.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:54 gibba013 bash[30381]: cluster 2021-03-10T16:09:52.382464+0000 mgr.gibba020.yqfnwy (mgr.34427) 7228 : cluster [DBG] pgmap v4115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:56.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:56 gibba020 bash[25448]: cluster 2021-03-10T16:09:54.384003+0000 mgr.gibba020.yqfnwy (mgr.34427) 7229 : cluster [DBG] pgmap v4116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:56.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:56 gibba013 bash[29418]: cluster 2021-03-10T16:09:54.384003+0000 mgr.gibba020.yqfnwy (mgr.34427) 7229 : cluster [DBG] pgmap v4116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:56.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:56 gibba013 bash[30381]: cluster 2021-03-10T16:09:54.384003+0000 mgr.gibba020.yqfnwy (mgr.34427) 7229 : cluster [DBG] pgmap v4116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:58.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:09:58 gibba020 bash[25448]: cluster 2021-03-10T16:09:56.385915+0000 mgr.gibba020.yqfnwy (mgr.34427) 7230 : cluster [DBG] pgmap v4117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:58.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:09:58 gibba013 bash[29418]: cluster 2021-03-10T16:09:56.385915+0000 mgr.gibba020.yqfnwy (mgr.34427) 7230 : cluster [DBG] pgmap v4117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:09:58.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:09:58 gibba013 bash[30381]: cluster 2021-03-10T16:09:56.385915+0000 mgr.gibba020.yqfnwy (mgr.34427) 7230 : cluster [DBG] pgmap v4117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:00.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:00 gibba013 bash[29418]: debug 2021-03-10T16:09:59.997+0000 7fd718a82700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:10:00.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:00 gibba013 bash[29418]: cluster 2021-03-10T16:09:58.387378+0000 mgr.gibba020.yqfnwy (mgr.34427) 7231 : cluster [DBG] pgmap v4118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:00.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:00 gibba013 bash[29418]: cluster 2021-03-10T16:10:00.000299+0000 mon.a (mon.0) 2733 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:10:00.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:00 gibba013 bash[30381]: cluster 2021-03-10T16:09:58.387378+0000 mgr.gibba020.yqfnwy (mgr.34427) 7231 : cluster [DBG] pgmap v4118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:00.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:00 gibba013 bash[30381]: cluster 2021-03-10T16:10:00.000299+0000 mon.a (mon.0) 2733 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:10:00.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:00 gibba020 bash[25448]: cluster 2021-03-10T16:09:58.387378+0000 mgr.gibba020.yqfnwy (mgr.34427) 7231 : cluster [DBG] pgmap v4118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:00.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:00 gibba020 bash[25448]: cluster 2021-03-10T16:10:00.000299+0000 mon.a (mon.0) 2733 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:10:02.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:02 gibba013 bash[29418]: cluster 2021-03-10T16:10:00.389145+0000 mgr.gibba020.yqfnwy (mgr.34427) 7232 : cluster [DBG] pgmap v4119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:02.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:02 gibba013 bash[30381]: cluster 2021-03-10T16:10:00.389145+0000 mgr.gibba020.yqfnwy (mgr.34427) 7232 : cluster [DBG] pgmap v4119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:02.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:02 gibba020 bash[25448]: cluster 2021-03-10T16:10:00.389145+0000 mgr.gibba020.yqfnwy (mgr.34427) 7232 : cluster [DBG] pgmap v4119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:04.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:04 gibba013 bash[29418]: cluster 2021-03-10T16:10:02.390708+0000 mgr.gibba020.yqfnwy (mgr.34427) 7233 : cluster [DBG] pgmap v4120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:04.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:04 gibba013 bash[30381]: cluster 2021-03-10T16:10:02.390708+0000 mgr.gibba020.yqfnwy (mgr.34427) 7233 : cluster [DBG] pgmap v4120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:04.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:04 gibba020 bash[25448]: cluster 2021-03-10T16:10:02.390708+0000 mgr.gibba020.yqfnwy (mgr.34427) 7233 : cluster [DBG] pgmap v4120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:05.432 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:10:05.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:05 gibba013 bash[29418]: audit 2021-03-10T16:10:04.539175+0000 mon.a (mon.0) 2734 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:10:05.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:05 gibba013 bash[29418]: audit 2021-03-10T16:10:04.546227+0000 mon.a (mon.0) 2735 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:10:05.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:05 gibba013 bash[30381]: audit 2021-03-10T16:10:04.539175+0000 mon.a (mon.0) 2734 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:10:05.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:05 gibba013 bash[30381]: audit 2021-03-10T16:10:04.546227+0000 mon.a (mon.0) 2735 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:10:05.661 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:10:05.661 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 10m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:10:05.661 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 9m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:10:05.662 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:10:05.662 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:10:05.662 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:10:05.662 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:10:05.663 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:10:05.663 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:10:05.663 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 10m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:10:05.663 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:10:05.663 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:10:05.664 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:10:05.664 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:10:05.664 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:10:05.664 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:10:05.665 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:10:05.665 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:10:05.665 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:10:05.665 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 9m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:10:05.665 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 9m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:10:05.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:05 gibba020 bash[25448]: audit 2021-03-10T16:10:04.539175+0000 mon.a (mon.0) 2734 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:10:05.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:05 gibba020 bash[25448]: audit 2021-03-10T16:10:04.546227+0000 mon.a (mon.0) 2735 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:10:05.912 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:10:05.912 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:10:05.912 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:10:05.912 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:10:05.913 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:10:05.913 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:10:05.913 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:10:05.913 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:10:05.914 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:10:05.914 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:10:05.914 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:10:05.914 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:10:05.915 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:10:05.915 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:10:05.915 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:10:06.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:06 gibba013 bash[29418]: cluster 2021-03-10T16:10:04.392249+0000 mgr.gibba020.yqfnwy (mgr.34427) 7234 : cluster [DBG] pgmap v4121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:06.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:06 gibba013 bash[29418]: cephadm 2021-03-10T16:10:04.544458+0000 mgr.gibba020.yqfnwy (mgr.34427) 7235 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:10:06.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:06 gibba013 bash[29418]: audit 2021-03-10T16:10:05.912176+0000 mon.a (mon.0) 2736 : audit [DBG] from='client.? 172.21.2.113:0/1337159996' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:06.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:06 gibba013 bash[30381]: cluster 2021-03-10T16:10:04.392249+0000 mgr.gibba020.yqfnwy (mgr.34427) 7234 : cluster [DBG] pgmap v4121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:06.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:06 gibba013 bash[30381]: cephadm 2021-03-10T16:10:04.544458+0000 mgr.gibba020.yqfnwy (mgr.34427) 7235 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:10:06.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:06 gibba013 bash[30381]: audit 2021-03-10T16:10:05.912176+0000 mon.a (mon.0) 2736 : audit [DBG] from='client.? 172.21.2.113:0/1337159996' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:06.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:06 gibba020 bash[25448]: cluster 2021-03-10T16:10:04.392249+0000 mgr.gibba020.yqfnwy (mgr.34427) 7234 : cluster [DBG] pgmap v4121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:06.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:06 gibba020 bash[25448]: cephadm 2021-03-10T16:10:04.544458+0000 mgr.gibba020.yqfnwy (mgr.34427) 7235 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:10:06.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:06 gibba020 bash[25448]: audit 2021-03-10T16:10:05.912176+0000 mon.a (mon.0) 2736 : audit [DBG] from='client.? 172.21.2.113:0/1337159996' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:07.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:07 gibba013 bash[29418]: audit 2021-03-10T16:10:05.422592+0000 mgr.gibba020.yqfnwy (mgr.34427) 7236 : audit [DBG] from='client.48912 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:10:07.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:07 gibba013 bash[29418]: audit 2021-03-10T16:10:05.648409+0000 mgr.gibba020.yqfnwy (mgr.34427) 7237 : audit [DBG] from='client.48918 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:10:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:07 gibba013 bash[29418]: audit 2021-03-10T16:10:06.645905+0000 mon.a (mon.0) 2737 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:10:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:07 gibba013 bash[29418]: audit 2021-03-10T16:10:06.738087+0000 mon.a (mon.0) 2738 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:10:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:07 gibba013 bash[29418]: audit 2021-03-10T16:10:06.957806+0000 mon.a (mon.0) 2739 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:10:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:07 gibba013 bash[29418]: audit 2021-03-10T16:10:06.958615+0000 mon.a (mon.0) 2740 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:10:07.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:07 gibba013 bash[29418]: audit 2021-03-10T16:10:06.959389+0000 mon.a (mon.0) 2741 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:10:07.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:07 gibba013 bash[29418]: audit 2021-03-10T16:10:06.960120+0000 mon.a (mon.0) 2742 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:10:07.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:07 gibba013 bash[30381]: audit 2021-03-10T16:10:05.422592+0000 mgr.gibba020.yqfnwy (mgr.34427) 7236 : audit [DBG] from='client.48912 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:10:07.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:07 gibba013 bash[30381]: audit 2021-03-10T16:10:05.648409+0000 mgr.gibba020.yqfnwy (mgr.34427) 7237 : audit [DBG] from='client.48918 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:10:07.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:07 gibba013 bash[30381]: audit 2021-03-10T16:10:06.645905+0000 mon.a (mon.0) 2737 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:10:07.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:07 gibba013 bash[30381]: audit 2021-03-10T16:10:06.738087+0000 mon.a (mon.0) 2738 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:10:07.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:07 gibba013 bash[30381]: audit 2021-03-10T16:10:06.957806+0000 mon.a (mon.0) 2739 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:10:07.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:07 gibba013 bash[30381]: audit 2021-03-10T16:10:06.958615+0000 mon.a (mon.0) 2740 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:10:07.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:07 gibba013 bash[30381]: audit 2021-03-10T16:10:06.959389+0000 mon.a (mon.0) 2741 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:10:07.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:07 gibba013 bash[30381]: audit 2021-03-10T16:10:06.960120+0000 mon.a (mon.0) 2742 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:10:07.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:07 gibba020 bash[25448]: audit 2021-03-10T16:10:05.422592+0000 mgr.gibba020.yqfnwy (mgr.34427) 7236 : audit [DBG] from='client.48912 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:10:07.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:07 gibba020 bash[25448]: audit 2021-03-10T16:10:05.648409+0000 mgr.gibba020.yqfnwy (mgr.34427) 7237 : audit [DBG] from='client.48918 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:10:07.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:07 gibba020 bash[25448]: audit 2021-03-10T16:10:06.645905+0000 mon.a (mon.0) 2737 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:10:07.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:07 gibba020 bash[25448]: audit 2021-03-10T16:10:06.738087+0000 mon.a (mon.0) 2738 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:10:07.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:07 gibba020 bash[25448]: audit 2021-03-10T16:10:06.957806+0000 mon.a (mon.0) 2739 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T16:10:07.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:07 gibba020 bash[25448]: audit 2021-03-10T16:10:06.958615+0000 mon.a (mon.0) 2740 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:10:07.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:07 gibba020 bash[25448]: audit 2021-03-10T16:10:06.959389+0000 mon.a (mon.0) 2741 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:10:07.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:07 gibba020 bash[25448]: audit 2021-03-10T16:10:06.960120+0000 mon.a (mon.0) 2742 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:10:08.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:08 gibba013 bash[29418]: cluster 2021-03-10T16:10:06.394058+0000 mgr.gibba020.yqfnwy (mgr.34427) 7238 : cluster [DBG] pgmap v4122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:08.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:08 gibba013 bash[29418]: audit 2021-03-10T16:10:08.042728+0000 mon.a (mon.0) 2743 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:10:08.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:08 gibba013 bash[30381]: cluster 2021-03-10T16:10:06.394058+0000 mgr.gibba020.yqfnwy (mgr.34427) 7238 : cluster [DBG] pgmap v4122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:08.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:08 gibba013 bash[30381]: audit 2021-03-10T16:10:08.042728+0000 mon.a (mon.0) 2743 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:10:08.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:08 gibba020 bash[25448]: cluster 2021-03-10T16:10:06.394058+0000 mgr.gibba020.yqfnwy (mgr.34427) 7238 : cluster [DBG] pgmap v4122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:08.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:08 gibba020 bash[25448]: audit 2021-03-10T16:10:08.042728+0000 mon.a (mon.0) 2743 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:10:09.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:09 gibba013 bash[29418]: cephadm 2021-03-10T16:10:08.042056+0000 mgr.gibba020.yqfnwy (mgr.34427) 7239 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:10:09.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:09 gibba013 bash[29418]: audit 2021-03-10T16:10:08.256092+0000 mon.a (mon.0) 2744 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:10:09.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:09 gibba013 bash[29418]: audit 2021-03-10T16:10:08.260563+0000 mon.a (mon.0) 2745 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:10:09.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:09 gibba013 bash[29418]: audit 2021-03-10T16:10:08.262104+0000 mon.a (mon.0) 2746 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:09.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:09 gibba013 bash[29418]: audit 2021-03-10T16:10:08.263974+0000 mon.a (mon.0) 2747 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:09.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:09 gibba013 bash[29418]: audit 2021-03-10T16:10:08.265671+0000 mon.a (mon.0) 2748 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:09.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:09 gibba013 bash[29418]: audit 2021-03-10T16:10:08.269087+0000 mon.a (mon.0) 2749 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:09.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:09 gibba013 bash[29418]: audit 2021-03-10T16:10:08.271591+0000 mon.a (mon.0) 2750 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:09.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:09 gibba013 bash[30381]: cephadm 2021-03-10T16:10:08.042056+0000 mgr.gibba020.yqfnwy (mgr.34427) 7239 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:10:09.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:09 gibba013 bash[30381]: audit 2021-03-10T16:10:08.256092+0000 mon.a (mon.0) 2744 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:10:09.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:09 gibba013 bash[30381]: audit 2021-03-10T16:10:08.260563+0000 mon.a (mon.0) 2745 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:10:09.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:09 gibba013 bash[30381]: audit 2021-03-10T16:10:08.262104+0000 mon.a (mon.0) 2746 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:09.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:09 gibba013 bash[30381]: audit 2021-03-10T16:10:08.263974+0000 mon.a (mon.0) 2747 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:09.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:09 gibba013 bash[30381]: audit 2021-03-10T16:10:08.265671+0000 mon.a (mon.0) 2748 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:09.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:09 gibba013 bash[30381]: audit 2021-03-10T16:10:08.269087+0000 mon.a (mon.0) 2749 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:09.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:09 gibba013 bash[30381]: audit 2021-03-10T16:10:08.271591+0000 mon.a (mon.0) 2750 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:09.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:09 gibba020 bash[25448]: cephadm 2021-03-10T16:10:08.042056+0000 mgr.gibba020.yqfnwy (mgr.34427) 7239 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:10:09.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:09 gibba020 bash[25448]: audit 2021-03-10T16:10:08.256092+0000 mon.a (mon.0) 2744 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:10:09.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:09 gibba020 bash[25448]: audit 2021-03-10T16:10:08.260563+0000 mon.a (mon.0) 2745 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:10:09.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:09 gibba020 bash[25448]: audit 2021-03-10T16:10:08.262104+0000 mon.a (mon.0) 2746 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:09.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:09 gibba020 bash[25448]: audit 2021-03-10T16:10:08.263974+0000 mon.a (mon.0) 2747 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:09.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:09 gibba020 bash[25448]: audit 2021-03-10T16:10:08.265671+0000 mon.a (mon.0) 2748 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:09.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:09 gibba020 bash[25448]: audit 2021-03-10T16:10:08.269087+0000 mon.a (mon.0) 2749 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:09.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:09 gibba020 bash[25448]: audit 2021-03-10T16:10:08.271591+0000 mon.a (mon.0) 2750 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:10.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:10 gibba013 bash[29418]: cephadm 2021-03-10T16:10:08.258565+0000 mgr.gibba020.yqfnwy (mgr.34427) 7240 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:10:10.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:10 gibba013 bash[29418]: cephadm 2021-03-10T16:10:08.260541+0000 mgr.gibba020.yqfnwy (mgr.34427) 7241 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:10:10.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:10 gibba013 bash[29418]: cephadm 2021-03-10T16:10:08.262062+0000 mgr.gibba020.yqfnwy (mgr.34427) 7242 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:10:10.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:10 gibba013 bash[29418]: cephadm 2021-03-10T16:10:08.262126+0000 mgr.gibba020.yqfnwy (mgr.34427) 7243 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:10:10.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:10 gibba013 bash[29418]: cephadm 2021-03-10T16:10:08.263993+0000 mgr.gibba020.yqfnwy (mgr.34427) 7244 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:10:10.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:10 gibba013 bash[29418]: cephadm 2021-03-10T16:10:08.264100+0000 mgr.gibba020.yqfnwy (mgr.34427) 7245 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:10:10.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:10 gibba013 bash[29418]: cephadm 2021-03-10T16:10:08.265522+0000 mgr.gibba020.yqfnwy (mgr.34427) 7246 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:10:10.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:10 gibba013 bash[29418]: cephadm 2021-03-10T16:10:08.267127+0000 mgr.gibba020.yqfnwy (mgr.34427) 7247 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:10:10.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:10 gibba013 bash[29418]: cephadm 2021-03-10T16:10:08.267199+0000 mgr.gibba020.yqfnwy (mgr.34427) 7248 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:10:10.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:10 gibba013 bash[29418]: cephadm 2021-03-10T16:10:08.269165+0000 mgr.gibba020.yqfnwy (mgr.34427) 7249 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:10:10.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:10 gibba013 bash[29418]: cephadm 2021-03-10T16:10:08.269839+0000 mgr.gibba020.yqfnwy (mgr.34427) 7250 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:10:10.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:10 gibba013 bash[29418]: cephadm 2021-03-10T16:10:08.271661+0000 mgr.gibba020.yqfnwy (mgr.34427) 7251 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:10:10.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:10 gibba013 bash[29418]: cephadm 2021-03-10T16:10:08.271901+0000 mgr.gibba020.yqfnwy (mgr.34427) 7252 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:10:10.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:10 gibba013 bash[29418]: cephadm 2021-03-10T16:10:08.272144+0000 mgr.gibba020.yqfnwy (mgr.34427) 7253 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:10:10.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:10 gibba013 bash[29418]: cluster 2021-03-10T16:10:08.395764+0000 mgr.gibba020.yqfnwy (mgr.34427) 7254 : cluster [DBG] pgmap v4123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:10.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:10 gibba013 bash[30381]: cephadm 2021-03-10T16:10:08.258565+0000 mgr.gibba020.yqfnwy (mgr.34427) 7240 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:10:10.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:10 gibba013 bash[30381]: cephadm 2021-03-10T16:10:08.260541+0000 mgr.gibba020.yqfnwy (mgr.34427) 7241 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:10:10.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:10 gibba013 bash[30381]: cephadm 2021-03-10T16:10:08.262062+0000 mgr.gibba020.yqfnwy (mgr.34427) 7242 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:10:10.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:10 gibba013 bash[30381]: cephadm 2021-03-10T16:10:08.262126+0000 mgr.gibba020.yqfnwy (mgr.34427) 7243 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:10:10.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:10 gibba013 bash[30381]: cephadm 2021-03-10T16:10:08.263993+0000 mgr.gibba020.yqfnwy (mgr.34427) 7244 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:10:10.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:10 gibba013 bash[30381]: cephadm 2021-03-10T16:10:08.264100+0000 mgr.gibba020.yqfnwy (mgr.34427) 7245 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:10:10.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:10 gibba013 bash[30381]: cephadm 2021-03-10T16:10:08.265522+0000 mgr.gibba020.yqfnwy (mgr.34427) 7246 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:10:10.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:10 gibba013 bash[30381]: cephadm 2021-03-10T16:10:08.267127+0000 mgr.gibba020.yqfnwy (mgr.34427) 7247 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:10:10.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:10 gibba013 bash[30381]: cephadm 2021-03-10T16:10:08.267199+0000 mgr.gibba020.yqfnwy (mgr.34427) 7248 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:10:10.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:10 gibba013 bash[30381]: cephadm 2021-03-10T16:10:08.269165+0000 mgr.gibba020.yqfnwy (mgr.34427) 7249 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:10:10.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:10 gibba013 bash[30381]: cephadm 2021-03-10T16:10:08.269839+0000 mgr.gibba020.yqfnwy (mgr.34427) 7250 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:10:10.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:10 gibba013 bash[30381]: cephadm 2021-03-10T16:10:08.271661+0000 mgr.gibba020.yqfnwy (mgr.34427) 7251 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:10:10.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:10 gibba013 bash[30381]: cephadm 2021-03-10T16:10:08.271901+0000 mgr.gibba020.yqfnwy (mgr.34427) 7252 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:10:10.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:10 gibba013 bash[30381]: cephadm 2021-03-10T16:10:08.272144+0000 mgr.gibba020.yqfnwy (mgr.34427) 7253 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:10:10.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:10 gibba013 bash[30381]: cluster 2021-03-10T16:10:08.395764+0000 mgr.gibba020.yqfnwy (mgr.34427) 7254 : cluster [DBG] pgmap v4123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:10.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:10 gibba020 bash[25448]: cephadm 2021-03-10T16:10:08.258565+0000 mgr.gibba020.yqfnwy (mgr.34427) 7240 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:10:10.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:10 gibba020 bash[25448]: cephadm 2021-03-10T16:10:08.260541+0000 mgr.gibba020.yqfnwy (mgr.34427) 7241 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:10:10.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:10 gibba020 bash[25448]: cephadm 2021-03-10T16:10:08.262062+0000 mgr.gibba020.yqfnwy (mgr.34427) 7242 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:10:10.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:10 gibba020 bash[25448]: cephadm 2021-03-10T16:10:08.262126+0000 mgr.gibba020.yqfnwy (mgr.34427) 7243 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:10:10.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:10 gibba020 bash[25448]: cephadm 2021-03-10T16:10:08.263993+0000 mgr.gibba020.yqfnwy (mgr.34427) 7244 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:10:10.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:10 gibba020 bash[25448]: cephadm 2021-03-10T16:10:08.264100+0000 mgr.gibba020.yqfnwy (mgr.34427) 7245 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:10:10.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:10 gibba020 bash[25448]: cephadm 2021-03-10T16:10:08.265522+0000 mgr.gibba020.yqfnwy (mgr.34427) 7246 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:10:10.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:10 gibba020 bash[25448]: cephadm 2021-03-10T16:10:08.267127+0000 mgr.gibba020.yqfnwy (mgr.34427) 7247 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:10:10.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:10 gibba020 bash[25448]: cephadm 2021-03-10T16:10:08.267199+0000 mgr.gibba020.yqfnwy (mgr.34427) 7248 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:10:10.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:10 gibba020 bash[25448]: cephadm 2021-03-10T16:10:08.269165+0000 mgr.gibba020.yqfnwy (mgr.34427) 7249 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:10:10.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:10 gibba020 bash[25448]: cephadm 2021-03-10T16:10:08.269839+0000 mgr.gibba020.yqfnwy (mgr.34427) 7250 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:10:10.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:10 gibba020 bash[25448]: cephadm 2021-03-10T16:10:08.271661+0000 mgr.gibba020.yqfnwy (mgr.34427) 7251 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:10:10.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:10 gibba020 bash[25448]: cephadm 2021-03-10T16:10:08.271901+0000 mgr.gibba020.yqfnwy (mgr.34427) 7252 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:10:10.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:10 gibba020 bash[25448]: cephadm 2021-03-10T16:10:08.272144+0000 mgr.gibba020.yqfnwy (mgr.34427) 7253 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:10:10.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:10 gibba020 bash[25448]: cluster 2021-03-10T16:10:08.395764+0000 mgr.gibba020.yqfnwy (mgr.34427) 7254 : cluster [DBG] pgmap v4123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:11.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:11 gibba013 bash[29418]: cluster 2021-03-10T16:10:10.397402+0000 mgr.gibba020.yqfnwy (mgr.34427) 7255 : cluster [DBG] pgmap v4124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:11.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:11 gibba013 bash[30381]: cluster 2021-03-10T16:10:10.397402+0000 mgr.gibba020.yqfnwy (mgr.34427) 7255 : cluster [DBG] pgmap v4124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:11.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:11 gibba020 bash[25448]: cluster 2021-03-10T16:10:10.397402+0000 mgr.gibba020.yqfnwy (mgr.34427) 7255 : cluster [DBG] pgmap v4124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:13.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:13 gibba013 bash[29418]: cluster 2021-03-10T16:10:12.398827+0000 mgr.gibba020.yqfnwy (mgr.34427) 7256 : cluster [DBG] pgmap v4125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:13.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:13 gibba013 bash[30381]: cluster 2021-03-10T16:10:12.398827+0000 mgr.gibba020.yqfnwy (mgr.34427) 7256 : cluster [DBG] pgmap v4125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:13.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:13 gibba020 bash[25448]: cluster 2021-03-10T16:10:12.398827+0000 mgr.gibba020.yqfnwy (mgr.34427) 7256 : cluster [DBG] pgmap v4125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:16.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:15 gibba013 bash[29418]: cluster 2021-03-10T16:10:14.400185+0000 mgr.gibba020.yqfnwy (mgr.34427) 7257 : cluster [DBG] pgmap v4126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:16.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:15 gibba013 bash[30381]: cluster 2021-03-10T16:10:14.400185+0000 mgr.gibba020.yqfnwy (mgr.34427) 7257 : cluster [DBG] pgmap v4126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:16.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:15 gibba020 bash[25448]: cluster 2021-03-10T16:10:14.400185+0000 mgr.gibba020.yqfnwy (mgr.34427) 7257 : cluster [DBG] pgmap v4126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:18.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:17 gibba013 bash[29418]: cluster 2021-03-10T16:10:16.401852+0000 mgr.gibba020.yqfnwy (mgr.34427) 7258 : cluster [DBG] pgmap v4127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:18.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:17 gibba013 bash[30381]: cluster 2021-03-10T16:10:16.401852+0000 mgr.gibba020.yqfnwy (mgr.34427) 7258 : cluster [DBG] pgmap v4127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:18.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:17 gibba020 bash[25448]: cluster 2021-03-10T16:10:16.401852+0000 mgr.gibba020.yqfnwy (mgr.34427) 7258 : cluster [DBG] pgmap v4127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:20.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:19 gibba013 bash[29418]: cluster 2021-03-10T16:10:18.403635+0000 mgr.gibba020.yqfnwy (mgr.34427) 7259 : cluster [DBG] pgmap v4128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:20.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:19 gibba013 bash[30381]: cluster 2021-03-10T16:10:18.403635+0000 mgr.gibba020.yqfnwy (mgr.34427) 7259 : cluster [DBG] pgmap v4128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:20.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:19 gibba020 bash[25448]: cluster 2021-03-10T16:10:18.403635+0000 mgr.gibba020.yqfnwy (mgr.34427) 7259 : cluster [DBG] pgmap v4128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:22.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:21 gibba013 bash[29418]: cluster 2021-03-10T16:10:20.405414+0000 mgr.gibba020.yqfnwy (mgr.34427) 7260 : cluster [DBG] pgmap v4129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:22.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:21 gibba013 bash[30381]: cluster 2021-03-10T16:10:20.405414+0000 mgr.gibba020.yqfnwy (mgr.34427) 7260 : cluster [DBG] pgmap v4129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:22.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:21 gibba020 bash[25448]: cluster 2021-03-10T16:10:20.405414+0000 mgr.gibba020.yqfnwy (mgr.34427) 7260 : cluster [DBG] pgmap v4129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:24.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:23 gibba013 bash[29418]: cluster 2021-03-10T16:10:22.406789+0000 mgr.gibba020.yqfnwy (mgr.34427) 7261 : cluster [DBG] pgmap v4130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:24.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:23 gibba013 bash[30381]: cluster 2021-03-10T16:10:22.406789+0000 mgr.gibba020.yqfnwy (mgr.34427) 7261 : cluster [DBG] pgmap v4130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:24.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:23 gibba020 bash[25448]: cluster 2021-03-10T16:10:22.406789+0000 mgr.gibba020.yqfnwy (mgr.34427) 7261 : cluster [DBG] pgmap v4130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:25.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:24 gibba013 bash[29418]: cephadm 2021-03-10T16:10:23.286766+0000 mgr.gibba020.yqfnwy (mgr.34427) 7262 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:10:25.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:24 gibba013 bash[30381]: cephadm 2021-03-10T16:10:23.286766+0000 mgr.gibba020.yqfnwy (mgr.34427) 7262 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:10:25.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:24 gibba020 bash[25448]: cephadm 2021-03-10T16:10:23.286766+0000 mgr.gibba020.yqfnwy (mgr.34427) 7262 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:10:26.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:25 gibba013 bash[30381]: cluster 2021-03-10T16:10:24.408365+0000 mgr.gibba020.yqfnwy (mgr.34427) 7263 : cluster [DBG] pgmap v4131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:26.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:25 gibba013 bash[29418]: cluster 2021-03-10T16:10:24.408365+0000 mgr.gibba020.yqfnwy (mgr.34427) 7263 : cluster [DBG] pgmap v4131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:26.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:25 gibba020 bash[25448]: cluster 2021-03-10T16:10:24.408365+0000 mgr.gibba020.yqfnwy (mgr.34427) 7263 : cluster [DBG] pgmap v4131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:28.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:27 gibba013 bash[29418]: cluster 2021-03-10T16:10:26.409972+0000 mgr.gibba020.yqfnwy (mgr.34427) 7264 : cluster [DBG] pgmap v4132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:28.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:27 gibba013 bash[30381]: cluster 2021-03-10T16:10:26.409972+0000 mgr.gibba020.yqfnwy (mgr.34427) 7264 : cluster [DBG] pgmap v4132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:28.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:27 gibba020 bash[25448]: cluster 2021-03-10T16:10:26.409972+0000 mgr.gibba020.yqfnwy (mgr.34427) 7264 : cluster [DBG] pgmap v4132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:30.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:29 gibba013 bash[29418]: cluster 2021-03-10T16:10:28.411419+0000 mgr.gibba020.yqfnwy (mgr.34427) 7265 : cluster [DBG] pgmap v4133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:30.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:29 gibba013 bash[30381]: cluster 2021-03-10T16:10:28.411419+0000 mgr.gibba020.yqfnwy (mgr.34427) 7265 : cluster [DBG] pgmap v4133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:30.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:29 gibba020 bash[25448]: cluster 2021-03-10T16:10:28.411419+0000 mgr.gibba020.yqfnwy (mgr.34427) 7265 : cluster [DBG] pgmap v4133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:32.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:31 gibba013 bash[29418]: cluster 2021-03-10T16:10:30.413145+0000 mgr.gibba020.yqfnwy (mgr.34427) 7266 : cluster [DBG] pgmap v4134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:32.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:31 gibba013 bash[30381]: cluster 2021-03-10T16:10:30.413145+0000 mgr.gibba020.yqfnwy (mgr.34427) 7266 : cluster [DBG] pgmap v4134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:32.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:31 gibba020 bash[25448]: cluster 2021-03-10T16:10:30.413145+0000 mgr.gibba020.yqfnwy (mgr.34427) 7266 : cluster [DBG] pgmap v4134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:34.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:33 gibba013 bash[29418]: cluster 2021-03-10T16:10:32.414457+0000 mgr.gibba020.yqfnwy (mgr.34427) 7267 : cluster [DBG] pgmap v4135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:34.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:33 gibba013 bash[30381]: cluster 2021-03-10T16:10:32.414457+0000 mgr.gibba020.yqfnwy (mgr.34427) 7267 : cluster [DBG] pgmap v4135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:34.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:33 gibba020 bash[25448]: cluster 2021-03-10T16:10:32.414457+0000 mgr.gibba020.yqfnwy (mgr.34427) 7267 : cluster [DBG] pgmap v4135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:36.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:35 gibba013 bash[30381]: cluster 2021-03-10T16:10:34.415916+0000 mgr.gibba020.yqfnwy (mgr.34427) 7268 : cluster [DBG] pgmap v4136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:36.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:35 gibba013 bash[29418]: cluster 2021-03-10T16:10:34.415916+0000 mgr.gibba020.yqfnwy (mgr.34427) 7268 : cluster [DBG] pgmap v4136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:36.153 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:10:36.236 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:35 gibba020 bash[25448]: cluster 2021-03-10T16:10:34.415916+0000 mgr.gibba020.yqfnwy (mgr.34427) 7268 : cluster [DBG] pgmap v4136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:36.379 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:10:36.380 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 28s ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:10:36.380 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 9m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:10:36.380 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:10:36.380 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:10:36.381 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 28s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:10:36.381 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 28s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:10:36.381 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:10:36.381 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 28s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:10:36.382 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 28s ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:10:36.382 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:10:36.382 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 28s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:10:36.382 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 28s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:10:36.382 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 28s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:10:36.383 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 28s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:10:36.383 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:10:36.383 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:10:36.383 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:10:36.384 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:10:36.384 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 9m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:10:36.384 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 9m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:10:36.630 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:10:36.631 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:10:36.631 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:10:36.631 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:10:36.632 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:10:36.632 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:10:36.632 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:10:36.633 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:10:36.633 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:10:36.633 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:10:36.633 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:10:36.633 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:10:36.634 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:10:36.634 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:10:36.634 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:10:37.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:36 gibba013 bash[29418]: audit 2021-03-10T16:10:36.144359+0000 mgr.gibba020.yqfnwy (mgr.34427) 7269 : audit [DBG] from='client.48930 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:10:37.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:36 gibba013 bash[29418]: audit 2021-03-10T16:10:36.631202+0000 mon.a (mon.0) 2751 : audit [DBG] from='client.? 172.21.2.113:0/842703609' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:37.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:36 gibba013 bash[30381]: audit 2021-03-10T16:10:36.144359+0000 mgr.gibba020.yqfnwy (mgr.34427) 7269 : audit [DBG] from='client.48930 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:10:37.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:36 gibba013 bash[30381]: audit 2021-03-10T16:10:36.631202+0000 mon.a (mon.0) 2751 : audit [DBG] from='client.? 172.21.2.113:0/842703609' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:37.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:36 gibba020 bash[25448]: audit 2021-03-10T16:10:36.144359+0000 mgr.gibba020.yqfnwy (mgr.34427) 7269 : audit [DBG] from='client.48930 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:10:37.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:36 gibba020 bash[25448]: audit 2021-03-10T16:10:36.631202+0000 mon.a (mon.0) 2751 : audit [DBG] from='client.? 172.21.2.113:0/842703609' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:10:38.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:37 gibba013 bash[29418]: audit 2021-03-10T16:10:36.365491+0000 mgr.gibba020.yqfnwy (mgr.34427) 7270 : audit [DBG] from='client.58918 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:10:38.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:37 gibba013 bash[29418]: cluster 2021-03-10T16:10:36.416678+0000 mgr.gibba020.yqfnwy (mgr.34427) 7271 : cluster [DBG] pgmap v4137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:38.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:37 gibba013 bash[30381]: audit 2021-03-10T16:10:36.365491+0000 mgr.gibba020.yqfnwy (mgr.34427) 7270 : audit [DBG] from='client.58918 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:10:38.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:37 gibba013 bash[30381]: cluster 2021-03-10T16:10:36.416678+0000 mgr.gibba020.yqfnwy (mgr.34427) 7271 : cluster [DBG] pgmap v4137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:38.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:37 gibba020 bash[25448]: audit 2021-03-10T16:10:36.365491+0000 mgr.gibba020.yqfnwy (mgr.34427) 7270 : audit [DBG] from='client.58918 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:10:38.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:37 gibba020 bash[25448]: cluster 2021-03-10T16:10:36.416678+0000 mgr.gibba020.yqfnwy (mgr.34427) 7271 : cluster [DBG] pgmap v4137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:40.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:39 gibba013 bash[29418]: cephadm 2021-03-10T16:10:38.302527+0000 mgr.gibba020.yqfnwy (mgr.34427) 7272 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:10:40.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:39 gibba013 bash[29418]: cluster 2021-03-10T16:10:38.417962+0000 mgr.gibba020.yqfnwy (mgr.34427) 7273 : cluster [DBG] pgmap v4138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:40.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:39 gibba013 bash[30381]: cephadm 2021-03-10T16:10:38.302527+0000 mgr.gibba020.yqfnwy (mgr.34427) 7272 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:10:40.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:39 gibba013 bash[30381]: cluster 2021-03-10T16:10:38.417962+0000 mgr.gibba020.yqfnwy (mgr.34427) 7273 : cluster [DBG] pgmap v4138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:40.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:39 gibba020 bash[25448]: cephadm 2021-03-10T16:10:38.302527+0000 mgr.gibba020.yqfnwy (mgr.34427) 7272 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:10:40.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:39 gibba020 bash[25448]: cluster 2021-03-10T16:10:38.417962+0000 mgr.gibba020.yqfnwy (mgr.34427) 7273 : cluster [DBG] pgmap v4138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:42.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:41 gibba013 bash[29418]: cluster 2021-03-10T16:10:40.419560+0000 mgr.gibba020.yqfnwy (mgr.34427) 7274 : cluster [DBG] pgmap v4139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:42.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:41 gibba013 bash[30381]: cluster 2021-03-10T16:10:40.419560+0000 mgr.gibba020.yqfnwy (mgr.34427) 7274 : cluster [DBG] pgmap v4139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:42.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:41 gibba020 bash[25448]: cluster 2021-03-10T16:10:40.419560+0000 mgr.gibba020.yqfnwy (mgr.34427) 7274 : cluster [DBG] pgmap v4139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:44.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:43 gibba013 bash[29418]: cluster 2021-03-10T16:10:42.421014+0000 mgr.gibba020.yqfnwy (mgr.34427) 7275 : cluster [DBG] pgmap v4140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:44.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:43 gibba013 bash[30381]: cluster 2021-03-10T16:10:42.421014+0000 mgr.gibba020.yqfnwy (mgr.34427) 7275 : cluster [DBG] pgmap v4140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:44.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:43 gibba020 bash[25448]: cluster 2021-03-10T16:10:42.421014+0000 mgr.gibba020.yqfnwy (mgr.34427) 7275 : cluster [DBG] pgmap v4140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:46.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:45 gibba013 bash[29418]: cluster 2021-03-10T16:10:44.422417+0000 mgr.gibba020.yqfnwy (mgr.34427) 7276 : cluster [DBG] pgmap v4141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:46.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:45 gibba013 bash[30381]: cluster 2021-03-10T16:10:44.422417+0000 mgr.gibba020.yqfnwy (mgr.34427) 7276 : cluster [DBG] pgmap v4141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:46.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:45 gibba020 bash[25448]: cluster 2021-03-10T16:10:44.422417+0000 mgr.gibba020.yqfnwy (mgr.34427) 7276 : cluster [DBG] pgmap v4141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:48.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:47 gibba020 bash[25448]: cluster 2021-03-10T16:10:46.424190+0000 mgr.gibba020.yqfnwy (mgr.34427) 7277 : cluster [DBG] pgmap v4142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:48.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:47 gibba013 bash[29418]: cluster 2021-03-10T16:10:46.424190+0000 mgr.gibba020.yqfnwy (mgr.34427) 7277 : cluster [DBG] pgmap v4142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:48.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:47 gibba013 bash[30381]: cluster 2021-03-10T16:10:46.424190+0000 mgr.gibba020.yqfnwy (mgr.34427) 7277 : cluster [DBG] pgmap v4142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:50.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:49 gibba020 bash[25448]: cluster 2021-03-10T16:10:48.425597+0000 mgr.gibba020.yqfnwy (mgr.34427) 7278 : cluster [DBG] pgmap v4143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:50.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:49 gibba013 bash[29418]: cluster 2021-03-10T16:10:48.425597+0000 mgr.gibba020.yqfnwy (mgr.34427) 7278 : cluster [DBG] pgmap v4143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:50.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:49 gibba013 bash[30381]: cluster 2021-03-10T16:10:48.425597+0000 mgr.gibba020.yqfnwy (mgr.34427) 7278 : cluster [DBG] pgmap v4143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:52.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:51 gibba020 bash[25448]: cluster 2021-03-10T16:10:50.427058+0000 mgr.gibba020.yqfnwy (mgr.34427) 7279 : cluster [DBG] pgmap v4144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:52.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:51 gibba013 bash[29418]: cluster 2021-03-10T16:10:50.427058+0000 mgr.gibba020.yqfnwy (mgr.34427) 7279 : cluster [DBG] pgmap v4144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:52.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:51 gibba013 bash[30381]: cluster 2021-03-10T16:10:50.427058+0000 mgr.gibba020.yqfnwy (mgr.34427) 7279 : cluster [DBG] pgmap v4144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:54.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:53 gibba020 bash[25448]: cluster 2021-03-10T16:10:52.428603+0000 mgr.gibba020.yqfnwy (mgr.34427) 7280 : cluster [DBG] pgmap v4145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:54.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:53 gibba013 bash[29418]: cluster 2021-03-10T16:10:52.428603+0000 mgr.gibba020.yqfnwy (mgr.34427) 7280 : cluster [DBG] pgmap v4145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:54.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:53 gibba013 bash[30381]: cluster 2021-03-10T16:10:52.428603+0000 mgr.gibba020.yqfnwy (mgr.34427) 7280 : cluster [DBG] pgmap v4145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:55.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:54 gibba020 bash[25448]: cephadm 2021-03-10T16:10:53.316729+0000 mgr.gibba020.yqfnwy (mgr.34427) 7281 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:10:55.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:54 gibba013 bash[29418]: cephadm 2021-03-10T16:10:53.316729+0000 mgr.gibba020.yqfnwy (mgr.34427) 7281 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:10:55.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:54 gibba013 bash[30381]: cephadm 2021-03-10T16:10:53.316729+0000 mgr.gibba020.yqfnwy (mgr.34427) 7281 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:10:56.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:55 gibba020 bash[25448]: cluster 2021-03-10T16:10:54.430131+0000 mgr.gibba020.yqfnwy (mgr.34427) 7282 : cluster [DBG] pgmap v4146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:56.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:55 gibba013 bash[29418]: cluster 2021-03-10T16:10:54.430131+0000 mgr.gibba020.yqfnwy (mgr.34427) 7282 : cluster [DBG] pgmap v4146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:56.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:55 gibba013 bash[30381]: cluster 2021-03-10T16:10:54.430131+0000 mgr.gibba020.yqfnwy (mgr.34427) 7282 : cluster [DBG] pgmap v4146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:58.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:57 gibba020 bash[25448]: cluster 2021-03-10T16:10:56.431987+0000 mgr.gibba020.yqfnwy (mgr.34427) 7283 : cluster [DBG] pgmap v4147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:58.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:57 gibba013 bash[29418]: cluster 2021-03-10T16:10:56.431987+0000 mgr.gibba020.yqfnwy (mgr.34427) 7283 : cluster [DBG] pgmap v4147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:10:58.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:57 gibba013 bash[30381]: cluster 2021-03-10T16:10:56.431987+0000 mgr.gibba020.yqfnwy (mgr.34427) 7283 : cluster [DBG] pgmap v4147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:00.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:10:59 gibba020 bash[25448]: cluster 2021-03-10T16:10:58.433414+0000 mgr.gibba020.yqfnwy (mgr.34427) 7284 : cluster [DBG] pgmap v4148: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:00.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:10:59 gibba013 bash[29418]: cluster 2021-03-10T16:10:58.433414+0000 mgr.gibba020.yqfnwy (mgr.34427) 7284 : cluster [DBG] pgmap v4148: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:00.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:10:59 gibba013 bash[30381]: cluster 2021-03-10T16:10:58.433414+0000 mgr.gibba020.yqfnwy (mgr.34427) 7284 : cluster [DBG] pgmap v4148: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:02.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:01 gibba013 bash[29418]: cluster 2021-03-10T16:11:00.435183+0000 mgr.gibba020.yqfnwy (mgr.34427) 7285 : cluster [DBG] pgmap v4149: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:02.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:01 gibba013 bash[30381]: cluster 2021-03-10T16:11:00.435183+0000 mgr.gibba020.yqfnwy (mgr.34427) 7285 : cluster [DBG] pgmap v4149: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:02.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:01 gibba020 bash[25448]: cluster 2021-03-10T16:11:00.435183+0000 mgr.gibba020.yqfnwy (mgr.34427) 7285 : cluster [DBG] pgmap v4149: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:04.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:03 gibba013 bash[29418]: cluster 2021-03-10T16:11:02.436675+0000 mgr.gibba020.yqfnwy (mgr.34427) 7286 : cluster [DBG] pgmap v4150: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:04.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:03 gibba013 bash[30381]: cluster 2021-03-10T16:11:02.436675+0000 mgr.gibba020.yqfnwy (mgr.34427) 7286 : cluster [DBG] pgmap v4150: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:04.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:03 gibba020 bash[25448]: cluster 2021-03-10T16:11:02.436675+0000 mgr.gibba020.yqfnwy (mgr.34427) 7286 : cluster [DBG] pgmap v4150: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:06.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:05 gibba013 bash[29418]: cluster 2021-03-10T16:11:04.438209+0000 mgr.gibba020.yqfnwy (mgr.34427) 7287 : cluster [DBG] pgmap v4151: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:06.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:05 gibba013 bash[30381]: cluster 2021-03-10T16:11:04.438209+0000 mgr.gibba020.yqfnwy (mgr.34427) 7287 : cluster [DBG] pgmap v4151: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:06.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:05 gibba020 bash[25448]: cluster 2021-03-10T16:11:04.438209+0000 mgr.gibba020.yqfnwy (mgr.34427) 7287 : cluster [DBG] pgmap v4151: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:06.881 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:11:07.140 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:11:07.141 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 59s ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:11:07.141 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 10m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:11:07.141 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:11:07.142 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:11:07.142 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 59s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:11:07.142 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 59s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:11:07.142 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:11:07.143 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 59s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:11:07.143 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 59s ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:11:07.143 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 10m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:11:07.143 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 59s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:11:07.144 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 59s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:11:07.144 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 59s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:11:07.144 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 59s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:11:07.144 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:11:07.145 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:11:07.145 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:11:07.145 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:11:07.145 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 10m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:11:07.146 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 10m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:11:07.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:06 gibba013 bash[29418]: audit 2021-03-10T16:11:06.647758+0000 mon.a (mon.0) 2752 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:11:07.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:06 gibba013 bash[29418]: audit 2021-03-10T16:11:06.743992+0000 mon.a (mon.0) 2753 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:11:07.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:06 gibba013 bash[29418]: audit 2021-03-10T16:11:06.968063+0000 mon.a (mon.0) 2754 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:11:07.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:06 gibba013 bash[29418]: audit 2021-03-10T16:11:06.968310+0000 mon.a (mon.0) 2755 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:11:07.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:06 gibba013 bash[29418]: audit 2021-03-10T16:11:06.968487+0000 mon.a (mon.0) 2756 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:11:07.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:06 gibba013 bash[29418]: audit 2021-03-10T16:11:06.968638+0000 mon.a (mon.0) 2757 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:11:07.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:06 gibba013 bash[30381]: audit 2021-03-10T16:11:06.647758+0000 mon.a (mon.0) 2752 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:11:07.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:06 gibba013 bash[30381]: audit 2021-03-10T16:11:06.743992+0000 mon.a (mon.0) 2753 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:11:07.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:06 gibba013 bash[30381]: audit 2021-03-10T16:11:06.968063+0000 mon.a (mon.0) 2754 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:11:07.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:06 gibba013 bash[30381]: audit 2021-03-10T16:11:06.968310+0000 mon.a (mon.0) 2755 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:11:07.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:06 gibba013 bash[30381]: audit 2021-03-10T16:11:06.968487+0000 mon.a (mon.0) 2756 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:11:07.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:06 gibba013 bash[30381]: audit 2021-03-10T16:11:06.968638+0000 mon.a (mon.0) 2757 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:11:07.401 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:11:07.401 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:11:07.401 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:11:07.401 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:11:07.402 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:11:07.402 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:11:07.402 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:11:07.402 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:11:07.403 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:11:07.403 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:11:07.403 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:11:07.403 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:11:07.404 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:11:07.404 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:11:07.404 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:11:07.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:06 gibba020 bash[25448]: audit 2021-03-10T16:11:06.647758+0000 mon.a (mon.0) 2752 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:11:07.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:06 gibba020 bash[25448]: audit 2021-03-10T16:11:06.743992+0000 mon.a (mon.0) 2753 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:11:07.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:06 gibba020 bash[25448]: audit 2021-03-10T16:11:06.968063+0000 mon.a (mon.0) 2754 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:11:07.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:06 gibba020 bash[25448]: audit 2021-03-10T16:11:06.968310+0000 mon.a (mon.0) 2755 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:11:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:06 gibba020 bash[25448]: audit 2021-03-10T16:11:06.968487+0000 mon.a (mon.0) 2756 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:11:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:06 gibba020 bash[25448]: audit 2021-03-10T16:11:06.968638+0000 mon.a (mon.0) 2757 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:11:08.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:07 gibba013 bash[29418]: cluster 2021-03-10T16:11:06.440159+0000 mgr.gibba020.yqfnwy (mgr.34427) 7288 : cluster [DBG] pgmap v4152: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:08.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:07 gibba013 bash[29418]: audit 2021-03-10T16:11:06.871845+0000 mgr.gibba020.yqfnwy (mgr.34427) 7289 : audit [DBG] from='client.58930 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:11:08.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:07 gibba013 bash[29418]: audit 2021-03-10T16:11:07.099472+0000 mgr.gibba020.yqfnwy (mgr.34427) 7290 : audit [DBG] from='client.58936 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:11:08.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:07 gibba013 bash[29418]: audit 2021-03-10T16:11:07.401429+0000 mon.a (mon.0) 2758 : audit [DBG] from='client.? 172.21.2.113:0/4243598895' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:08.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:07 gibba013 bash[30381]: cluster 2021-03-10T16:11:06.440159+0000 mgr.gibba020.yqfnwy (mgr.34427) 7288 : cluster [DBG] pgmap v4152: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:08.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:07 gibba013 bash[30381]: audit 2021-03-10T16:11:06.871845+0000 mgr.gibba020.yqfnwy (mgr.34427) 7289 : audit [DBG] from='client.58930 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:11:08.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:07 gibba013 bash[30381]: audit 2021-03-10T16:11:07.099472+0000 mgr.gibba020.yqfnwy (mgr.34427) 7290 : audit [DBG] from='client.58936 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:11:08.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:07 gibba013 bash[30381]: audit 2021-03-10T16:11:07.401429+0000 mon.a (mon.0) 2758 : audit [DBG] from='client.? 172.21.2.113:0/4243598895' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:08.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:07 gibba020 bash[25448]: cluster 2021-03-10T16:11:06.440159+0000 mgr.gibba020.yqfnwy (mgr.34427) 7288 : cluster [DBG] pgmap v4152: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:08.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:07 gibba020 bash[25448]: audit 2021-03-10T16:11:06.871845+0000 mgr.gibba020.yqfnwy (mgr.34427) 7289 : audit [DBG] from='client.58930 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:11:08.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:07 gibba020 bash[25448]: audit 2021-03-10T16:11:07.099472+0000 mgr.gibba020.yqfnwy (mgr.34427) 7290 : audit [DBG] from='client.58936 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:11:08.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:07 gibba020 bash[25448]: audit 2021-03-10T16:11:07.401429+0000 mon.a (mon.0) 2758 : audit [DBG] from='client.? 172.21.2.113:0/4243598895' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:09.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:08 gibba013 bash[29418]: audit 2021-03-10T16:11:08.323086+0000 mon.a (mon.0) 2759 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:11:09.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:08 gibba013 bash[29418]: audit 2021-03-10T16:11:08.329792+0000 mon.a (mon.0) 2760 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:11:09.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:08 gibba013 bash[30381]: audit 2021-03-10T16:11:08.323086+0000 mon.a (mon.0) 2759 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:11:09.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:08 gibba013 bash[30381]: audit 2021-03-10T16:11:08.329792+0000 mon.a (mon.0) 2760 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:11:09.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:08 gibba020 bash[25448]: audit 2021-03-10T16:11:08.323086+0000 mon.a (mon.0) 2759 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:11:09.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:08 gibba020 bash[25448]: audit 2021-03-10T16:11:08.329792+0000 mon.a (mon.0) 2760 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:11:10.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:09 gibba013 bash[29418]: cephadm 2021-03-10T16:11:08.326739+0000 mgr.gibba020.yqfnwy (mgr.34427) 7291 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:11:10.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:09 gibba013 bash[29418]: cluster 2021-03-10T16:11:08.440669+0000 mgr.gibba020.yqfnwy (mgr.34427) 7292 : cluster [DBG] pgmap v4153: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:10.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:09 gibba013 bash[30381]: cephadm 2021-03-10T16:11:08.326739+0000 mgr.gibba020.yqfnwy (mgr.34427) 7291 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:11:10.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:09 gibba013 bash[30381]: cluster 2021-03-10T16:11:08.440669+0000 mgr.gibba020.yqfnwy (mgr.34427) 7292 : cluster [DBG] pgmap v4153: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:10.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:09 gibba020 bash[25448]: cephadm 2021-03-10T16:11:08.326739+0000 mgr.gibba020.yqfnwy (mgr.34427) 7291 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:11:10.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:09 gibba020 bash[25448]: cluster 2021-03-10T16:11:08.440669+0000 mgr.gibba020.yqfnwy (mgr.34427) 7292 : cluster [DBG] pgmap v4153: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:12.275 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:12 gibba020 bash[25448]: cluster 2021-03-10T16:11:10.442224+0000 mgr.gibba020.yqfnwy (mgr.34427) 7293 : cluster [DBG] pgmap v4154: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:12.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:12 gibba013 bash[29418]: cluster 2021-03-10T16:11:10.442224+0000 mgr.gibba020.yqfnwy (mgr.34427) 7293 : cluster [DBG] pgmap v4154: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:12.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:12 gibba013 bash[30381]: cluster 2021-03-10T16:11:10.442224+0000 mgr.gibba020.yqfnwy (mgr.34427) 7293 : cluster [DBG] pgmap v4154: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:13.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:13 gibba013 bash[29418]: cephadm 2021-03-10T16:11:12.054060+0000 mgr.gibba020.yqfnwy (mgr.34427) 7294 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:11:13.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:13 gibba013 bash[29418]: audit 2021-03-10T16:11:12.054418+0000 mon.a (mon.0) 2761 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:11:13.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:13 gibba013 bash[29418]: audit 2021-03-10T16:11:12.251855+0000 mon.a (mon.0) 2762 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:11:13.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:13 gibba013 bash[29418]: audit 2021-03-10T16:11:12.255463+0000 mon.a (mon.0) 2763 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:11:13.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:13 gibba013 bash[29418]: audit 2021-03-10T16:11:12.258365+0000 mon.a (mon.0) 2764 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:13.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:13 gibba013 bash[29418]: audit 2021-03-10T16:11:12.261047+0000 mon.a (mon.0) 2765 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:13.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:13 gibba013 bash[29418]: audit 2021-03-10T16:11:12.263565+0000 mon.a (mon.0) 2766 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:13.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:13 gibba013 bash[29418]: audit 2021-03-10T16:11:12.270180+0000 mon.a (mon.0) 2767 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:13.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:13 gibba013 bash[29418]: audit 2021-03-10T16:11:12.273330+0000 mon.a (mon.0) 2768 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:13.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:13 gibba013 bash[30381]: cephadm 2021-03-10T16:11:12.054060+0000 mgr.gibba020.yqfnwy (mgr.34427) 7294 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:11:13.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:13 gibba013 bash[30381]: audit 2021-03-10T16:11:12.054418+0000 mon.a (mon.0) 2761 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:11:13.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:13 gibba013 bash[30381]: audit 2021-03-10T16:11:12.251855+0000 mon.a (mon.0) 2762 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:11:13.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:13 gibba013 bash[30381]: audit 2021-03-10T16:11:12.255463+0000 mon.a (mon.0) 2763 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:11:13.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:13 gibba013 bash[30381]: audit 2021-03-10T16:11:12.258365+0000 mon.a (mon.0) 2764 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:13.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:13 gibba013 bash[30381]: audit 2021-03-10T16:11:12.261047+0000 mon.a (mon.0) 2765 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:13.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:13 gibba013 bash[30381]: audit 2021-03-10T16:11:12.263565+0000 mon.a (mon.0) 2766 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:13.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:13 gibba013 bash[30381]: audit 2021-03-10T16:11:12.270180+0000 mon.a (mon.0) 2767 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:13.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:13 gibba013 bash[30381]: audit 2021-03-10T16:11:12.273330+0000 mon.a (mon.0) 2768 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:13.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:13 gibba020 bash[25448]: cephadm 2021-03-10T16:11:12.054060+0000 mgr.gibba020.yqfnwy (mgr.34427) 7294 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:11:13.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:13 gibba020 bash[25448]: audit 2021-03-10T16:11:12.054418+0000 mon.a (mon.0) 2761 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:11:13.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:13 gibba020 bash[25448]: audit 2021-03-10T16:11:12.251855+0000 mon.a (mon.0) 2762 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:11:13.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:13 gibba020 bash[25448]: audit 2021-03-10T16:11:12.255463+0000 mon.a (mon.0) 2763 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:11:13.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:13 gibba020 bash[25448]: audit 2021-03-10T16:11:12.258365+0000 mon.a (mon.0) 2764 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:13.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:13 gibba020 bash[25448]: audit 2021-03-10T16:11:12.261047+0000 mon.a (mon.0) 2765 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:13.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:13 gibba020 bash[25448]: audit 2021-03-10T16:11:12.263565+0000 mon.a (mon.0) 2766 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:13.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:13 gibba020 bash[25448]: audit 2021-03-10T16:11:12.270180+0000 mon.a (mon.0) 2767 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:13.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:13 gibba020 bash[25448]: audit 2021-03-10T16:11:12.273330+0000 mon.a (mon.0) 2768 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:14.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:14 gibba013 bash[29418]: cephadm 2021-03-10T16:11:12.253374+0000 mgr.gibba020.yqfnwy (mgr.34427) 7295 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:11:14.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:14 gibba013 bash[29418]: cephadm 2021-03-10T16:11:12.256641+0000 mgr.gibba020.yqfnwy (mgr.34427) 7296 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:11:14.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:14 gibba013 bash[29418]: cephadm 2021-03-10T16:11:12.259044+0000 mgr.gibba020.yqfnwy (mgr.34427) 7297 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:11:14.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:14 gibba013 bash[29418]: cephadm 2021-03-10T16:11:12.259080+0000 mgr.gibba020.yqfnwy (mgr.34427) 7298 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:11:14.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:14 gibba013 bash[29418]: cephadm 2021-03-10T16:11:12.261923+0000 mgr.gibba020.yqfnwy (mgr.34427) 7299 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:11:14.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:14 gibba013 bash[29418]: cephadm 2021-03-10T16:11:12.261958+0000 mgr.gibba020.yqfnwy (mgr.34427) 7300 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:11:14.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:14 gibba013 bash[29418]: cephadm 2021-03-10T16:11:12.264928+0000 mgr.gibba020.yqfnwy (mgr.34427) 7301 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:11:14.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:14 gibba013 bash[29418]: cephadm 2021-03-10T16:11:12.268054+0000 mgr.gibba020.yqfnwy (mgr.34427) 7302 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:11:14.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:14 gibba013 bash[29418]: cephadm 2021-03-10T16:11:12.268091+0000 mgr.gibba020.yqfnwy (mgr.34427) 7303 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:11:14.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:14 gibba013 bash[29418]: cephadm 2021-03-10T16:11:12.271074+0000 mgr.gibba020.yqfnwy (mgr.34427) 7304 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:11:14.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:14 gibba013 bash[29418]: cephadm 2021-03-10T16:11:12.271487+0000 mgr.gibba020.yqfnwy (mgr.34427) 7305 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:11:14.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:14 gibba013 bash[29418]: cephadm 2021-03-10T16:11:12.274860+0000 mgr.gibba020.yqfnwy (mgr.34427) 7306 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:11:14.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:14 gibba013 bash[29418]: cephadm 2021-03-10T16:11:12.274900+0000 mgr.gibba020.yqfnwy (mgr.34427) 7307 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:11:14.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:14 gibba013 bash[29418]: cephadm 2021-03-10T16:11:12.275024+0000 mgr.gibba020.yqfnwy (mgr.34427) 7308 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:11:14.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:14 gibba013 bash[29418]: cluster 2021-03-10T16:11:12.443576+0000 mgr.gibba020.yqfnwy (mgr.34427) 7309 : cluster [DBG] pgmap v4155: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:14.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:14 gibba013 bash[30381]: cephadm 2021-03-10T16:11:12.253374+0000 mgr.gibba020.yqfnwy (mgr.34427) 7295 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:11:14.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:14 gibba013 bash[30381]: cephadm 2021-03-10T16:11:12.256641+0000 mgr.gibba020.yqfnwy (mgr.34427) 7296 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:11:14.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:14 gibba013 bash[30381]: cephadm 2021-03-10T16:11:12.259044+0000 mgr.gibba020.yqfnwy (mgr.34427) 7297 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:11:14.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:14 gibba013 bash[30381]: cephadm 2021-03-10T16:11:12.259080+0000 mgr.gibba020.yqfnwy (mgr.34427) 7298 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:11:14.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:14 gibba013 bash[30381]: cephadm 2021-03-10T16:11:12.261923+0000 mgr.gibba020.yqfnwy (mgr.34427) 7299 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:11:14.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:14 gibba013 bash[30381]: cephadm 2021-03-10T16:11:12.261958+0000 mgr.gibba020.yqfnwy (mgr.34427) 7300 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:11:14.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:14 gibba013 bash[30381]: cephadm 2021-03-10T16:11:12.264928+0000 mgr.gibba020.yqfnwy (mgr.34427) 7301 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:11:14.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:14 gibba013 bash[30381]: cephadm 2021-03-10T16:11:12.268054+0000 mgr.gibba020.yqfnwy (mgr.34427) 7302 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:11:14.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:14 gibba013 bash[30381]: cephadm 2021-03-10T16:11:12.268091+0000 mgr.gibba020.yqfnwy (mgr.34427) 7303 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:11:14.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:14 gibba013 bash[30381]: cephadm 2021-03-10T16:11:12.271074+0000 mgr.gibba020.yqfnwy (mgr.34427) 7304 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:11:14.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:14 gibba013 bash[30381]: cephadm 2021-03-10T16:11:12.271487+0000 mgr.gibba020.yqfnwy (mgr.34427) 7305 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:11:14.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:14 gibba013 bash[30381]: cephadm 2021-03-10T16:11:12.274860+0000 mgr.gibba020.yqfnwy (mgr.34427) 7306 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:11:14.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:14 gibba013 bash[30381]: cephadm 2021-03-10T16:11:12.274900+0000 mgr.gibba020.yqfnwy (mgr.34427) 7307 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:11:14.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:14 gibba013 bash[30381]: cephadm 2021-03-10T16:11:12.275024+0000 mgr.gibba020.yqfnwy (mgr.34427) 7308 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:11:14.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:14 gibba013 bash[30381]: cluster 2021-03-10T16:11:12.443576+0000 mgr.gibba020.yqfnwy (mgr.34427) 7309 : cluster [DBG] pgmap v4155: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:14.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:14 gibba020 bash[25448]: cephadm 2021-03-10T16:11:12.253374+0000 mgr.gibba020.yqfnwy (mgr.34427) 7295 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:11:14.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:14 gibba020 bash[25448]: cephadm 2021-03-10T16:11:12.256641+0000 mgr.gibba020.yqfnwy (mgr.34427) 7296 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:11:14.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:14 gibba020 bash[25448]: cephadm 2021-03-10T16:11:12.259044+0000 mgr.gibba020.yqfnwy (mgr.34427) 7297 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:11:14.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:14 gibba020 bash[25448]: cephadm 2021-03-10T16:11:12.259080+0000 mgr.gibba020.yqfnwy (mgr.34427) 7298 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:11:14.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:14 gibba020 bash[25448]: cephadm 2021-03-10T16:11:12.261923+0000 mgr.gibba020.yqfnwy (mgr.34427) 7299 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:11:14.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:14 gibba020 bash[25448]: cephadm 2021-03-10T16:11:12.261958+0000 mgr.gibba020.yqfnwy (mgr.34427) 7300 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:11:14.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:14 gibba020 bash[25448]: cephadm 2021-03-10T16:11:12.264928+0000 mgr.gibba020.yqfnwy (mgr.34427) 7301 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:11:14.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:14 gibba020 bash[25448]: cephadm 2021-03-10T16:11:12.268054+0000 mgr.gibba020.yqfnwy (mgr.34427) 7302 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:11:14.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:14 gibba020 bash[25448]: cephadm 2021-03-10T16:11:12.268091+0000 mgr.gibba020.yqfnwy (mgr.34427) 7303 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:11:14.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:14 gibba020 bash[25448]: cephadm 2021-03-10T16:11:12.271074+0000 mgr.gibba020.yqfnwy (mgr.34427) 7304 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:11:14.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:14 gibba020 bash[25448]: cephadm 2021-03-10T16:11:12.271487+0000 mgr.gibba020.yqfnwy (mgr.34427) 7305 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:11:14.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:14 gibba020 bash[25448]: cephadm 2021-03-10T16:11:12.274860+0000 mgr.gibba020.yqfnwy (mgr.34427) 7306 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:11:14.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:14 gibba020 bash[25448]: cephadm 2021-03-10T16:11:12.274900+0000 mgr.gibba020.yqfnwy (mgr.34427) 7307 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:11:14.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:14 gibba020 bash[25448]: cephadm 2021-03-10T16:11:12.275024+0000 mgr.gibba020.yqfnwy (mgr.34427) 7308 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:11:14.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:14 gibba020 bash[25448]: cluster 2021-03-10T16:11:12.443576+0000 mgr.gibba020.yqfnwy (mgr.34427) 7309 : cluster [DBG] pgmap v4155: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:15.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:15 gibba013 bash[29418]: cluster 2021-03-10T16:11:14.445023+0000 mgr.gibba020.yqfnwy (mgr.34427) 7310 : cluster [DBG] pgmap v4156: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:15.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:15 gibba013 bash[30381]: cluster 2021-03-10T16:11:14.445023+0000 mgr.gibba020.yqfnwy (mgr.34427) 7310 : cluster [DBG] pgmap v4156: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:15.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:15 gibba020 bash[25448]: cluster 2021-03-10T16:11:14.445023+0000 mgr.gibba020.yqfnwy (mgr.34427) 7310 : cluster [DBG] pgmap v4156: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:17.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:17 gibba013 bash[29418]: cluster 2021-03-10T16:11:16.446866+0000 mgr.gibba020.yqfnwy (mgr.34427) 7311 : cluster [DBG] pgmap v4157: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:17.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:17 gibba013 bash[30381]: cluster 2021-03-10T16:11:16.446866+0000 mgr.gibba020.yqfnwy (mgr.34427) 7311 : cluster [DBG] pgmap v4157: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:17.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:17 gibba020 bash[25448]: cluster 2021-03-10T16:11:16.446866+0000 mgr.gibba020.yqfnwy (mgr.34427) 7311 : cluster [DBG] pgmap v4157: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:20.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:19 gibba013 bash[29418]: cluster 2021-03-10T16:11:18.448457+0000 mgr.gibba020.yqfnwy (mgr.34427) 7312 : cluster [DBG] pgmap v4158: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:20.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:19 gibba013 bash[30381]: cluster 2021-03-10T16:11:18.448457+0000 mgr.gibba020.yqfnwy (mgr.34427) 7312 : cluster [DBG] pgmap v4158: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:20.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:19 gibba020 bash[25448]: cluster 2021-03-10T16:11:18.448457+0000 mgr.gibba020.yqfnwy (mgr.34427) 7312 : cluster [DBG] pgmap v4158: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:22.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:21 gibba013 bash[29418]: cluster 2021-03-10T16:11:20.450171+0000 mgr.gibba020.yqfnwy (mgr.34427) 7313 : cluster [DBG] pgmap v4159: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:22.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:21 gibba013 bash[30381]: cluster 2021-03-10T16:11:20.450171+0000 mgr.gibba020.yqfnwy (mgr.34427) 7313 : cluster [DBG] pgmap v4159: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:22.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:21 gibba020 bash[25448]: cluster 2021-03-10T16:11:20.450171+0000 mgr.gibba020.yqfnwy (mgr.34427) 7313 : cluster [DBG] pgmap v4159: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:24.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:23 gibba013 bash[29418]: cluster 2021-03-10T16:11:22.451687+0000 mgr.gibba020.yqfnwy (mgr.34427) 7314 : cluster [DBG] pgmap v4160: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:24.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:23 gibba013 bash[30381]: cluster 2021-03-10T16:11:22.451687+0000 mgr.gibba020.yqfnwy (mgr.34427) 7314 : cluster [DBG] pgmap v4160: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:24.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:23 gibba020 bash[25448]: cluster 2021-03-10T16:11:22.451687+0000 mgr.gibba020.yqfnwy (mgr.34427) 7314 : cluster [DBG] pgmap v4160: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:26.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:25 gibba013 bash[29418]: cluster 2021-03-10T16:11:24.452973+0000 mgr.gibba020.yqfnwy (mgr.34427) 7315 : cluster [DBG] pgmap v4161: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:26.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:25 gibba013 bash[30381]: cluster 2021-03-10T16:11:24.452973+0000 mgr.gibba020.yqfnwy (mgr.34427) 7315 : cluster [DBG] pgmap v4161: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:26.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:25 gibba020 bash[25448]: cluster 2021-03-10T16:11:24.452973+0000 mgr.gibba020.yqfnwy (mgr.34427) 7315 : cluster [DBG] pgmap v4161: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:28.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:27 gibba013 bash[29418]: cluster 2021-03-10T16:11:26.454782+0000 mgr.gibba020.yqfnwy (mgr.34427) 7316 : cluster [DBG] pgmap v4162: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:28.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:27 gibba013 bash[30381]: cluster 2021-03-10T16:11:26.454782+0000 mgr.gibba020.yqfnwy (mgr.34427) 7316 : cluster [DBG] pgmap v4162: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:28.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:27 gibba020 bash[25448]: cluster 2021-03-10T16:11:26.454782+0000 mgr.gibba020.yqfnwy (mgr.34427) 7316 : cluster [DBG] pgmap v4162: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:29.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:28 gibba013 bash[29418]: cephadm 2021-03-10T16:11:27.290797+0000 mgr.gibba020.yqfnwy (mgr.34427) 7317 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:11:29.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:28 gibba013 bash[30381]: cephadm 2021-03-10T16:11:27.290797+0000 mgr.gibba020.yqfnwy (mgr.34427) 7317 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:11:29.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:28 gibba020 bash[25448]: cephadm 2021-03-10T16:11:27.290797+0000 mgr.gibba020.yqfnwy (mgr.34427) 7317 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:11:30.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:29 gibba013 bash[29418]: cluster 2021-03-10T16:11:28.456239+0000 mgr.gibba020.yqfnwy (mgr.34427) 7318 : cluster [DBG] pgmap v4163: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:30.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:29 gibba013 bash[30381]: cluster 2021-03-10T16:11:28.456239+0000 mgr.gibba020.yqfnwy (mgr.34427) 7318 : cluster [DBG] pgmap v4163: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:30.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:29 gibba020 bash[25448]: cluster 2021-03-10T16:11:28.456239+0000 mgr.gibba020.yqfnwy (mgr.34427) 7318 : cluster [DBG] pgmap v4163: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:32.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:31 gibba013 bash[29418]: cluster 2021-03-10T16:11:30.458111+0000 mgr.gibba020.yqfnwy (mgr.34427) 7319 : cluster [DBG] pgmap v4164: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:32.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:31 gibba013 bash[30381]: cluster 2021-03-10T16:11:30.458111+0000 mgr.gibba020.yqfnwy (mgr.34427) 7319 : cluster [DBG] pgmap v4164: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:32.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:31 gibba020 bash[25448]: cluster 2021-03-10T16:11:30.458111+0000 mgr.gibba020.yqfnwy (mgr.34427) 7319 : cluster [DBG] pgmap v4164: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:34.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:33 gibba013 bash[29418]: cluster 2021-03-10T16:11:32.459653+0000 mgr.gibba020.yqfnwy (mgr.34427) 7320 : cluster [DBG] pgmap v4165: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:34.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:33 gibba013 bash[30381]: cluster 2021-03-10T16:11:32.459653+0000 mgr.gibba020.yqfnwy (mgr.34427) 7320 : cluster [DBG] pgmap v4165: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:34.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:33 gibba020 bash[25448]: cluster 2021-03-10T16:11:32.459653+0000 mgr.gibba020.yqfnwy (mgr.34427) 7320 : cluster [DBG] pgmap v4165: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:36.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:35 gibba013 bash[29418]: cluster 2021-03-10T16:11:34.461037+0000 mgr.gibba020.yqfnwy (mgr.34427) 7321 : cluster [DBG] pgmap v4166: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:36.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:35 gibba013 bash[30381]: cluster 2021-03-10T16:11:34.461037+0000 mgr.gibba020.yqfnwy (mgr.34427) 7321 : cluster [DBG] pgmap v4166: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:36.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:35 gibba020 bash[25448]: cluster 2021-03-10T16:11:34.461037+0000 mgr.gibba020.yqfnwy (mgr.34427) 7321 : cluster [DBG] pgmap v4166: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:37.643 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:11:37.865 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:11:37.865 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 89s ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:11:37.866 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 25s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:11:37.866 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 25s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:11:37.866 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 25s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:11:37.866 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 89s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:11:37.867 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 89s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:11:37.867 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 25s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:11:37.867 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 89s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:11:37.867 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 89s ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:11:37.868 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 25s ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:11:37.868 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 89s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:11:37.868 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 89s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:11:37.868 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 89s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:11:37.869 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 89s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:11:37.869 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 25s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:11:37.869 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 25s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:11:37.869 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 25s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:11:37.870 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 25s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:11:37.870 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 25s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:11:37.870 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 25s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:11:38.118 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:11:38.118 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:11:38.118 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:11:38.118 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:11:38.119 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:11:38.119 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:11:38.119 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:11:38.119 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:11:38.120 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:11:38.120 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:11:38.120 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:11:38.120 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:11:38.120 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:11:38.121 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:11:38.121 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:11:38.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:37 gibba013 bash[29418]: cluster 2021-03-10T16:11:36.462863+0000 mgr.gibba020.yqfnwy (mgr.34427) 7322 : cluster [DBG] pgmap v4167: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:38.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:37 gibba013 bash[30381]: cluster 2021-03-10T16:11:36.462863+0000 mgr.gibba020.yqfnwy (mgr.34427) 7322 : cluster [DBG] pgmap v4167: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:38.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:37 gibba020 bash[25448]: cluster 2021-03-10T16:11:36.462863+0000 mgr.gibba020.yqfnwy (mgr.34427) 7322 : cluster [DBG] pgmap v4167: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:39.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:38 gibba013 bash[29418]: audit 2021-03-10T16:11:37.633669+0000 mgr.gibba020.yqfnwy (mgr.34427) 7323 : audit [DBG] from='client.48966 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:11:39.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:38 gibba013 bash[29418]: audit 2021-03-10T16:11:37.855614+0000 mgr.gibba020.yqfnwy (mgr.34427) 7324 : audit [DBG] from='client.58954 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:11:39.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:38 gibba013 bash[29418]: audit 2021-03-10T16:11:38.118401+0000 mon.c (mon.1) 117 : audit [DBG] from='client.? 172.21.2.113:0/1894843859' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:39.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:38 gibba013 bash[30381]: audit 2021-03-10T16:11:37.633669+0000 mgr.gibba020.yqfnwy (mgr.34427) 7323 : audit [DBG] from='client.48966 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:11:39.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:38 gibba013 bash[30381]: audit 2021-03-10T16:11:37.855614+0000 mgr.gibba020.yqfnwy (mgr.34427) 7324 : audit [DBG] from='client.58954 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:11:39.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:38 gibba013 bash[30381]: audit 2021-03-10T16:11:38.118401+0000 mon.c (mon.1) 117 : audit [DBG] from='client.? 172.21.2.113:0/1894843859' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:39.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:38 gibba020 bash[25448]: audit 2021-03-10T16:11:37.633669+0000 mgr.gibba020.yqfnwy (mgr.34427) 7323 : audit [DBG] from='client.48966 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:11:39.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:38 gibba020 bash[25448]: audit 2021-03-10T16:11:37.855614+0000 mgr.gibba020.yqfnwy (mgr.34427) 7324 : audit [DBG] from='client.58954 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:11:39.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:38 gibba020 bash[25448]: audit 2021-03-10T16:11:38.118401+0000 mon.c (mon.1) 117 : audit [DBG] from='client.? 172.21.2.113:0/1894843859' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:11:40.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:39 gibba013 bash[29418]: cluster 2021-03-10T16:11:38.464373+0000 mgr.gibba020.yqfnwy (mgr.34427) 7325 : cluster [DBG] pgmap v4168: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:40.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:39 gibba013 bash[30381]: cluster 2021-03-10T16:11:38.464373+0000 mgr.gibba020.yqfnwy (mgr.34427) 7325 : cluster [DBG] pgmap v4168: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:40.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:39 gibba020 bash[25448]: cluster 2021-03-10T16:11:38.464373+0000 mgr.gibba020.yqfnwy (mgr.34427) 7325 : cluster [DBG] pgmap v4168: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:42.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:41 gibba013 bash[29418]: cluster 2021-03-10T16:11:40.466095+0000 mgr.gibba020.yqfnwy (mgr.34427) 7326 : cluster [DBG] pgmap v4169: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:42.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:41 gibba013 bash[30381]: cluster 2021-03-10T16:11:40.466095+0000 mgr.gibba020.yqfnwy (mgr.34427) 7326 : cluster [DBG] pgmap v4169: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:42.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:41 gibba020 bash[25448]: cluster 2021-03-10T16:11:40.466095+0000 mgr.gibba020.yqfnwy (mgr.34427) 7326 : cluster [DBG] pgmap v4169: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:44.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:43 gibba013 bash[30381]: cephadm 2021-03-10T16:11:42.306895+0000 mgr.gibba020.yqfnwy (mgr.34427) 7327 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:11:44.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:43 gibba013 bash[30381]: cluster 2021-03-10T16:11:42.467345+0000 mgr.gibba020.yqfnwy (mgr.34427) 7328 : cluster [DBG] pgmap v4170: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:44.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:43 gibba013 bash[29418]: cephadm 2021-03-10T16:11:42.306895+0000 mgr.gibba020.yqfnwy (mgr.34427) 7327 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:11:44.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:43 gibba013 bash[29418]: cluster 2021-03-10T16:11:42.467345+0000 mgr.gibba020.yqfnwy (mgr.34427) 7328 : cluster [DBG] pgmap v4170: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:44.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:43 gibba020 bash[25448]: cephadm 2021-03-10T16:11:42.306895+0000 mgr.gibba020.yqfnwy (mgr.34427) 7327 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:11:44.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:43 gibba020 bash[25448]: cluster 2021-03-10T16:11:42.467345+0000 mgr.gibba020.yqfnwy (mgr.34427) 7328 : cluster [DBG] pgmap v4170: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:46.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:45 gibba013 bash[29418]: cluster 2021-03-10T16:11:44.468612+0000 mgr.gibba020.yqfnwy (mgr.34427) 7329 : cluster [DBG] pgmap v4171: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:46.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:45 gibba013 bash[30381]: cluster 2021-03-10T16:11:44.468612+0000 mgr.gibba020.yqfnwy (mgr.34427) 7329 : cluster [DBG] pgmap v4171: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:46.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:45 gibba020 bash[25448]: cluster 2021-03-10T16:11:44.468612+0000 mgr.gibba020.yqfnwy (mgr.34427) 7329 : cluster [DBG] pgmap v4171: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:48.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:47 gibba020 bash[25448]: cluster 2021-03-10T16:11:46.470342+0000 mgr.gibba020.yqfnwy (mgr.34427) 7330 : cluster [DBG] pgmap v4172: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:48.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:47 gibba013 bash[29418]: cluster 2021-03-10T16:11:46.470342+0000 mgr.gibba020.yqfnwy (mgr.34427) 7330 : cluster [DBG] pgmap v4172: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:48.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:47 gibba013 bash[30381]: cluster 2021-03-10T16:11:46.470342+0000 mgr.gibba020.yqfnwy (mgr.34427) 7330 : cluster [DBG] pgmap v4172: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:50.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:49 gibba020 bash[25448]: cluster 2021-03-10T16:11:48.471857+0000 mgr.gibba020.yqfnwy (mgr.34427) 7331 : cluster [DBG] pgmap v4173: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:50.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:49 gibba013 bash[30381]: cluster 2021-03-10T16:11:48.471857+0000 mgr.gibba020.yqfnwy (mgr.34427) 7331 : cluster [DBG] pgmap v4173: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:50.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:49 gibba013 bash[29418]: cluster 2021-03-10T16:11:48.471857+0000 mgr.gibba020.yqfnwy (mgr.34427) 7331 : cluster [DBG] pgmap v4173: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:52.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:51 gibba020 bash[25448]: cluster 2021-03-10T16:11:50.473386+0000 mgr.gibba020.yqfnwy (mgr.34427) 7332 : cluster [DBG] pgmap v4174: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:52.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:51 gibba013 bash[29418]: cluster 2021-03-10T16:11:50.473386+0000 mgr.gibba020.yqfnwy (mgr.34427) 7332 : cluster [DBG] pgmap v4174: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:52.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:51 gibba013 bash[30381]: cluster 2021-03-10T16:11:50.473386+0000 mgr.gibba020.yqfnwy (mgr.34427) 7332 : cluster [DBG] pgmap v4174: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:54.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:53 gibba020 bash[25448]: cluster 2021-03-10T16:11:52.474748+0000 mgr.gibba020.yqfnwy (mgr.34427) 7333 : cluster [DBG] pgmap v4175: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:54.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:53 gibba013 bash[29418]: cluster 2021-03-10T16:11:52.474748+0000 mgr.gibba020.yqfnwy (mgr.34427) 7333 : cluster [DBG] pgmap v4175: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:54.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:53 gibba013 bash[30381]: cluster 2021-03-10T16:11:52.474748+0000 mgr.gibba020.yqfnwy (mgr.34427) 7333 : cluster [DBG] pgmap v4175: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:56.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:55 gibba020 bash[25448]: cluster 2021-03-10T16:11:54.476204+0000 mgr.gibba020.yqfnwy (mgr.34427) 7334 : cluster [DBG] pgmap v4176: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:56.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:55 gibba013 bash[29418]: cluster 2021-03-10T16:11:54.476204+0000 mgr.gibba020.yqfnwy (mgr.34427) 7334 : cluster [DBG] pgmap v4176: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:56.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:55 gibba013 bash[30381]: cluster 2021-03-10T16:11:54.476204+0000 mgr.gibba020.yqfnwy (mgr.34427) 7334 : cluster [DBG] pgmap v4176: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:58.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:57 gibba020 bash[25448]: cluster 2021-03-10T16:11:56.477926+0000 mgr.gibba020.yqfnwy (mgr.34427) 7335 : cluster [DBG] pgmap v4177: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:58.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:57 gibba013 bash[29418]: cluster 2021-03-10T16:11:56.477926+0000 mgr.gibba020.yqfnwy (mgr.34427) 7335 : cluster [DBG] pgmap v4177: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:58.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:57 gibba013 bash[30381]: cluster 2021-03-10T16:11:56.477926+0000 mgr.gibba020.yqfnwy (mgr.34427) 7335 : cluster [DBG] pgmap v4177: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:11:59.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:58 gibba020 bash[25448]: cephadm 2021-03-10T16:11:57.322985+0000 mgr.gibba020.yqfnwy (mgr.34427) 7336 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:11:59.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:58 gibba013 bash[29418]: cephadm 2021-03-10T16:11:57.322985+0000 mgr.gibba020.yqfnwy (mgr.34427) 7336 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:11:59.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:58 gibba013 bash[30381]: cephadm 2021-03-10T16:11:57.322985+0000 mgr.gibba020.yqfnwy (mgr.34427) 7336 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:12:00.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:11:59 gibba020 bash[25448]: cluster 2021-03-10T16:11:58.479326+0000 mgr.gibba020.yqfnwy (mgr.34427) 7337 : cluster [DBG] pgmap v4178: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:00.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:11:59 gibba013 bash[29418]: cluster 2021-03-10T16:11:58.479326+0000 mgr.gibba020.yqfnwy (mgr.34427) 7337 : cluster [DBG] pgmap v4178: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:00.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:11:59 gibba013 bash[30381]: cluster 2021-03-10T16:11:58.479326+0000 mgr.gibba020.yqfnwy (mgr.34427) 7337 : cluster [DBG] pgmap v4178: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:02.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:01 gibba013 bash[29418]: cluster 2021-03-10T16:12:00.481070+0000 mgr.gibba020.yqfnwy (mgr.34427) 7338 : cluster [DBG] pgmap v4179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:02.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:01 gibba013 bash[30381]: cluster 2021-03-10T16:12:00.481070+0000 mgr.gibba020.yqfnwy (mgr.34427) 7338 : cluster [DBG] pgmap v4179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:02.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:01 gibba020 bash[25448]: cluster 2021-03-10T16:12:00.481070+0000 mgr.gibba020.yqfnwy (mgr.34427) 7338 : cluster [DBG] pgmap v4179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:04.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:03 gibba013 bash[29418]: cluster 2021-03-10T16:12:02.482442+0000 mgr.gibba020.yqfnwy (mgr.34427) 7339 : cluster [DBG] pgmap v4180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:04.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:03 gibba013 bash[30381]: cluster 2021-03-10T16:12:02.482442+0000 mgr.gibba020.yqfnwy (mgr.34427) 7339 : cluster [DBG] pgmap v4180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:04.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:03 gibba020 bash[25448]: cluster 2021-03-10T16:12:02.482442+0000 mgr.gibba020.yqfnwy (mgr.34427) 7339 : cluster [DBG] pgmap v4180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:06.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:05 gibba013 bash[29418]: cluster 2021-03-10T16:12:04.483821+0000 mgr.gibba020.yqfnwy (mgr.34427) 7340 : cluster [DBG] pgmap v4181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:06.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:05 gibba013 bash[30381]: cluster 2021-03-10T16:12:04.483821+0000 mgr.gibba020.yqfnwy (mgr.34427) 7340 : cluster [DBG] pgmap v4181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:06.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:05 gibba020 bash[25448]: cluster 2021-03-10T16:12:04.483821+0000 mgr.gibba020.yqfnwy (mgr.34427) 7340 : cluster [DBG] pgmap v4181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:07.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:06 gibba013 bash[29418]: audit 2021-03-10T16:12:06.650182+0000 mon.a (mon.0) 2769 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:12:07.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:06 gibba013 bash[29418]: audit 2021-03-10T16:12:06.750187+0000 mon.a (mon.0) 2770 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:12:07.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:06 gibba013 bash[30381]: audit 2021-03-10T16:12:06.650182+0000 mon.a (mon.0) 2769 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:12:07.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:06 gibba013 bash[30381]: audit 2021-03-10T16:12:06.750187+0000 mon.a (mon.0) 2770 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:12:07.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:06 gibba020 bash[25448]: audit 2021-03-10T16:12:06.650182+0000 mon.a (mon.0) 2769 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:12:07.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:06 gibba020 bash[25448]: audit 2021-03-10T16:12:06.750187+0000 mon.a (mon.0) 2770 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:12:08.362 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:12:08.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:07 gibba013 bash[29418]: cluster 2021-03-10T16:12:06.485401+0000 mgr.gibba020.yqfnwy (mgr.34427) 7341 : cluster [DBG] pgmap v4182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:08.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:07 gibba013 bash[29418]: audit 2021-03-10T16:12:06.977617+0000 mon.a (mon.0) 2771 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T16:12:08.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:07 gibba013 bash[29418]: audit 2021-03-10T16:12:06.977855+0000 mon.a (mon.0) 2772 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:12:08.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:07 gibba013 bash[29418]: audit 2021-03-10T16:12:06.978007+0000 mon.a (mon.0) 2773 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:12:08.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:07 gibba013 bash[29418]: audit 2021-03-10T16:12:06.978134+0000 mon.a (mon.0) 2774 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:12:08.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:07 gibba013 bash[30381]: cluster 2021-03-10T16:12:06.485401+0000 mgr.gibba020.yqfnwy (mgr.34427) 7341 : cluster [DBG] pgmap v4182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:08.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:07 gibba013 bash[30381]: audit 2021-03-10T16:12:06.977617+0000 mon.a (mon.0) 2771 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T16:12:08.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:07 gibba013 bash[30381]: audit 2021-03-10T16:12:06.977855+0000 mon.a (mon.0) 2772 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:12:08.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:07 gibba013 bash[30381]: audit 2021-03-10T16:12:06.978007+0000 mon.a (mon.0) 2773 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:12:08.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:07 gibba013 bash[30381]: audit 2021-03-10T16:12:06.978134+0000 mon.a (mon.0) 2774 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:12:08.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:07 gibba020 bash[25448]: cluster 2021-03-10T16:12:06.485401+0000 mgr.gibba020.yqfnwy (mgr.34427) 7341 : cluster [DBG] pgmap v4182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:08.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:07 gibba020 bash[25448]: audit 2021-03-10T16:12:06.977617+0000 mon.a (mon.0) 2771 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T16:12:08.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:07 gibba020 bash[25448]: audit 2021-03-10T16:12:06.977855+0000 mon.a (mon.0) 2772 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:12:08.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:07 gibba020 bash[25448]: audit 2021-03-10T16:12:06.978007+0000 mon.a (mon.0) 2773 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:12:08.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:07 gibba020 bash[25448]: audit 2021-03-10T16:12:06.978134+0000 mon.a (mon.0) 2774 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:12:08.615 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:12:08.615 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 2m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:12:08.615 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 56s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:12:08.616 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 56s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:12:08.616 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 56s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:12:08.616 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:12:08.616 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:12:08.617 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 56s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:12:08.617 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:12:08.617 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:12:08.617 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 56s ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:12:08.617 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:12:08.618 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:12:08.618 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:12:08.618 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:12:08.618 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 56s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:12:08.619 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 56s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:12:08.619 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 56s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:12:08.619 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 56s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:12:08.619 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 56s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:12:08.619 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 56s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:12:08.868 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:12:08.868 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:12:08.868 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:12:08.868 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:12:08.869 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:12:08.869 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:12:08.869 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:12:08.869 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:12:08.870 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:12:08.870 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:12:08.870 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:12:08.870 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:12:08.871 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:12:08.871 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:12:08.871 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:12:10.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:09 gibba013 bash[29418]: audit 2021-03-10T16:12:08.352899+0000 mgr.gibba020.yqfnwy (mgr.34427) 7342 : audit [DBG] from='client.48984 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:12:10.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:09 gibba013 bash[29418]: cluster 2021-03-10T16:12:08.486911+0000 mgr.gibba020.yqfnwy (mgr.34427) 7343 : cluster [DBG] pgmap v4183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:10.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:09 gibba013 bash[29418]: audit 2021-03-10T16:12:08.574817+0000 mgr.gibba020.yqfnwy (mgr.34427) 7344 : audit [DBG] from='client.48990 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:12:10.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:09 gibba013 bash[29418]: audit 2021-03-10T16:12:08.868388+0000 mon.c (mon.1) 118 : audit [DBG] from='client.? 172.21.2.113:0/2643600532' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:10.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:09 gibba013 bash[30381]: audit 2021-03-10T16:12:08.352899+0000 mgr.gibba020.yqfnwy (mgr.34427) 7342 : audit [DBG] from='client.48984 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:12:10.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:09 gibba013 bash[30381]: cluster 2021-03-10T16:12:08.486911+0000 mgr.gibba020.yqfnwy (mgr.34427) 7343 : cluster [DBG] pgmap v4183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:10.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:09 gibba013 bash[30381]: audit 2021-03-10T16:12:08.574817+0000 mgr.gibba020.yqfnwy (mgr.34427) 7344 : audit [DBG] from='client.48990 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:12:10.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:09 gibba013 bash[30381]: audit 2021-03-10T16:12:08.868388+0000 mon.c (mon.1) 118 : audit [DBG] from='client.? 172.21.2.113:0/2643600532' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:10.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:09 gibba020 bash[25448]: audit 2021-03-10T16:12:08.352899+0000 mgr.gibba020.yqfnwy (mgr.34427) 7342 : audit [DBG] from='client.48984 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:12:10.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:09 gibba020 bash[25448]: cluster 2021-03-10T16:12:08.486911+0000 mgr.gibba020.yqfnwy (mgr.34427) 7343 : cluster [DBG] pgmap v4183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:10.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:09 gibba020 bash[25448]: audit 2021-03-10T16:12:08.574817+0000 mgr.gibba020.yqfnwy (mgr.34427) 7344 : audit [DBG] from='client.48990 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:12:10.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:09 gibba020 bash[25448]: audit 2021-03-10T16:12:08.868388+0000 mon.c (mon.1) 118 : audit [DBG] from='client.? 172.21.2.113:0/2643600532' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:12.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:11 gibba013 bash[29418]: cluster 2021-03-10T16:12:10.488761+0000 mgr.gibba020.yqfnwy (mgr.34427) 7345 : cluster [DBG] pgmap v4184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:12.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:11 gibba013 bash[30381]: cluster 2021-03-10T16:12:10.488761+0000 mgr.gibba020.yqfnwy (mgr.34427) 7345 : cluster [DBG] pgmap v4184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:12.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:11 gibba020 bash[25448]: cluster 2021-03-10T16:12:10.488761+0000 mgr.gibba020.yqfnwy (mgr.34427) 7345 : cluster [DBG] pgmap v4184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:12.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:12 gibba020 bash[25448]: audit 2021-03-10T16:12:12.334166+0000 mon.a (mon.0) 2775 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:12:12.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:12 gibba020 bash[25448]: audit 2021-03-10T16:12:12.559965+0000 mon.a (mon.0) 2776 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:12:12.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:12 gibba020 bash[25448]: audit 2021-03-10T16:12:12.563537+0000 mon.a (mon.0) 2777 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:12:12.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:12 gibba020 bash[25448]: audit 2021-03-10T16:12:12.565328+0000 mon.a (mon.0) 2778 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:12.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:12 gibba020 bash[25448]: audit 2021-03-10T16:12:12.566909+0000 mon.a (mon.0) 2779 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:12.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:12 gibba020 bash[25448]: audit 2021-03-10T16:12:12.568304+0000 mon.a (mon.0) 2780 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:12.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:12 gibba020 bash[25448]: audit 2021-03-10T16:12:12.570783+0000 mon.a (mon.0) 2781 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:12.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:12 gibba020 bash[25448]: audit 2021-03-10T16:12:12.572720+0000 mon.a (mon.0) 2782 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:13.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:12 gibba013 bash[29418]: audit 2021-03-10T16:12:12.334166+0000 mon.a (mon.0) 2775 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:12:13.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:12 gibba013 bash[29418]: audit 2021-03-10T16:12:12.559965+0000 mon.a (mon.0) 2776 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:12:13.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:12 gibba013 bash[29418]: audit 2021-03-10T16:12:12.563537+0000 mon.a (mon.0) 2777 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:12:13.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:12 gibba013 bash[29418]: audit 2021-03-10T16:12:12.565328+0000 mon.a (mon.0) 2778 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:13.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:12 gibba013 bash[29418]: audit 2021-03-10T16:12:12.566909+0000 mon.a (mon.0) 2779 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:13.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:12 gibba013 bash[29418]: audit 2021-03-10T16:12:12.568304+0000 mon.a (mon.0) 2780 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:13.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:12 gibba013 bash[29418]: audit 2021-03-10T16:12:12.570783+0000 mon.a (mon.0) 2781 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:13.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:12 gibba013 bash[29418]: audit 2021-03-10T16:12:12.572720+0000 mon.a (mon.0) 2782 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:13.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:12 gibba013 bash[30381]: audit 2021-03-10T16:12:12.334166+0000 mon.a (mon.0) 2775 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:12:13.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:12 gibba013 bash[30381]: audit 2021-03-10T16:12:12.559965+0000 mon.a (mon.0) 2776 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:12:13.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:12 gibba013 bash[30381]: audit 2021-03-10T16:12:12.563537+0000 mon.a (mon.0) 2777 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:12:13.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:12 gibba013 bash[30381]: audit 2021-03-10T16:12:12.565328+0000 mon.a (mon.0) 2778 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:13.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:12 gibba013 bash[30381]: audit 2021-03-10T16:12:12.566909+0000 mon.a (mon.0) 2779 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:13.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:12 gibba013 bash[30381]: audit 2021-03-10T16:12:12.568304+0000 mon.a (mon.0) 2780 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:13.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:12 gibba013 bash[30381]: audit 2021-03-10T16:12:12.570783+0000 mon.a (mon.0) 2781 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:13.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:12 gibba013 bash[30381]: audit 2021-03-10T16:12:12.572720+0000 mon.a (mon.0) 2782 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:14.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:13 gibba013 bash[29418]: cephadm 2021-03-10T16:12:12.338432+0000 mgr.gibba020.yqfnwy (mgr.34427) 7346 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:12:14.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:13 gibba013 bash[29418]: cephadm 2021-03-10T16:12:12.340277+0000 mgr.gibba020.yqfnwy (mgr.34427) 7347 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:12:14.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:13 gibba013 bash[29418]: cluster 2021-03-10T16:12:12.489221+0000 mgr.gibba020.yqfnwy (mgr.34427) 7348 : cluster [DBG] pgmap v4185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:14.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:13 gibba013 bash[29418]: cephadm 2021-03-10T16:12:12.561597+0000 mgr.gibba020.yqfnwy (mgr.34427) 7349 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:12:14.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:13 gibba013 bash[29418]: cephadm 2021-03-10T16:12:12.563643+0000 mgr.gibba020.yqfnwy (mgr.34427) 7350 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:12:14.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:13 gibba013 bash[29418]: cephadm 2021-03-10T16:12:12.565148+0000 mgr.gibba020.yqfnwy (mgr.34427) 7351 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:12:14.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:13 gibba013 bash[29418]: cephadm 2021-03-10T16:12:12.565216+0000 mgr.gibba020.yqfnwy (mgr.34427) 7352 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:12:14.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:13 gibba013 bash[29418]: cephadm 2021-03-10T16:12:12.566627+0000 mgr.gibba020.yqfnwy (mgr.34427) 7353 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:12:14.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:13 gibba013 bash[29418]: cephadm 2021-03-10T16:12:12.566682+0000 mgr.gibba020.yqfnwy (mgr.34427) 7354 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:12:14.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:13 gibba013 bash[29418]: cephadm 2021-03-10T16:12:12.568024+0000 mgr.gibba020.yqfnwy (mgr.34427) 7355 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:12:14.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:13 gibba013 bash[29418]: cephadm 2021-03-10T16:12:12.569135+0000 mgr.gibba020.yqfnwy (mgr.34427) 7356 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:12:14.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:13 gibba013 bash[29418]: cephadm 2021-03-10T16:12:12.569171+0000 mgr.gibba020.yqfnwy (mgr.34427) 7357 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:12:14.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:13 gibba013 bash[29418]: cephadm 2021-03-10T16:12:12.570850+0000 mgr.gibba020.yqfnwy (mgr.34427) 7358 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:12:14.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:13 gibba013 bash[29418]: cephadm 2021-03-10T16:12:12.571163+0000 mgr.gibba020.yqfnwy (mgr.34427) 7359 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:12:14.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:13 gibba013 bash[29418]: cephadm 2021-03-10T16:12:12.573753+0000 mgr.gibba020.yqfnwy (mgr.34427) 7360 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:12:14.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:13 gibba013 bash[29418]: cephadm 2021-03-10T16:12:12.573789+0000 mgr.gibba020.yqfnwy (mgr.34427) 7361 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:12:14.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:13 gibba013 bash[29418]: cephadm 2021-03-10T16:12:12.573891+0000 mgr.gibba020.yqfnwy (mgr.34427) 7362 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:12:14.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:13 gibba013 bash[30381]: cephadm 2021-03-10T16:12:12.338432+0000 mgr.gibba020.yqfnwy (mgr.34427) 7346 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:12:14.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:13 gibba013 bash[30381]: cephadm 2021-03-10T16:12:12.340277+0000 mgr.gibba020.yqfnwy (mgr.34427) 7347 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:12:14.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:13 gibba013 bash[30381]: cluster 2021-03-10T16:12:12.489221+0000 mgr.gibba020.yqfnwy (mgr.34427) 7348 : cluster [DBG] pgmap v4185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:14.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:13 gibba013 bash[30381]: cephadm 2021-03-10T16:12:12.561597+0000 mgr.gibba020.yqfnwy (mgr.34427) 7349 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:12:14.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:13 gibba013 bash[30381]: cephadm 2021-03-10T16:12:12.563643+0000 mgr.gibba020.yqfnwy (mgr.34427) 7350 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:12:14.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:13 gibba013 bash[30381]: cephadm 2021-03-10T16:12:12.565148+0000 mgr.gibba020.yqfnwy (mgr.34427) 7351 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:12:14.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:13 gibba013 bash[30381]: cephadm 2021-03-10T16:12:12.565216+0000 mgr.gibba020.yqfnwy (mgr.34427) 7352 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:12:14.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:13 gibba013 bash[30381]: cephadm 2021-03-10T16:12:12.566627+0000 mgr.gibba020.yqfnwy (mgr.34427) 7353 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:12:14.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:13 gibba013 bash[30381]: cephadm 2021-03-10T16:12:12.566682+0000 mgr.gibba020.yqfnwy (mgr.34427) 7354 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:12:14.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:13 gibba013 bash[30381]: cephadm 2021-03-10T16:12:12.568024+0000 mgr.gibba020.yqfnwy (mgr.34427) 7355 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:12:14.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:13 gibba013 bash[30381]: cephadm 2021-03-10T16:12:12.569135+0000 mgr.gibba020.yqfnwy (mgr.34427) 7356 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:12:14.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:13 gibba013 bash[30381]: cephadm 2021-03-10T16:12:12.569171+0000 mgr.gibba020.yqfnwy (mgr.34427) 7357 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:12:14.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:13 gibba013 bash[30381]: cephadm 2021-03-10T16:12:12.570850+0000 mgr.gibba020.yqfnwy (mgr.34427) 7358 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:12:14.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:13 gibba013 bash[30381]: cephadm 2021-03-10T16:12:12.571163+0000 mgr.gibba020.yqfnwy (mgr.34427) 7359 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:12:14.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:13 gibba013 bash[30381]: cephadm 2021-03-10T16:12:12.573753+0000 mgr.gibba020.yqfnwy (mgr.34427) 7360 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:12:14.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:13 gibba013 bash[30381]: cephadm 2021-03-10T16:12:12.573789+0000 mgr.gibba020.yqfnwy (mgr.34427) 7361 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:12:14.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:13 gibba013 bash[30381]: cephadm 2021-03-10T16:12:12.573891+0000 mgr.gibba020.yqfnwy (mgr.34427) 7362 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:12:14.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:13 gibba020 bash[25448]: cephadm 2021-03-10T16:12:12.338432+0000 mgr.gibba020.yqfnwy (mgr.34427) 7346 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:12:14.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:13 gibba020 bash[25448]: cephadm 2021-03-10T16:12:12.340277+0000 mgr.gibba020.yqfnwy (mgr.34427) 7347 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:12:14.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:13 gibba020 bash[25448]: cluster 2021-03-10T16:12:12.489221+0000 mgr.gibba020.yqfnwy (mgr.34427) 7348 : cluster [DBG] pgmap v4185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:14.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:13 gibba020 bash[25448]: cephadm 2021-03-10T16:12:12.561597+0000 mgr.gibba020.yqfnwy (mgr.34427) 7349 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:12:14.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:13 gibba020 bash[25448]: cephadm 2021-03-10T16:12:12.563643+0000 mgr.gibba020.yqfnwy (mgr.34427) 7350 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:12:14.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:13 gibba020 bash[25448]: cephadm 2021-03-10T16:12:12.565148+0000 mgr.gibba020.yqfnwy (mgr.34427) 7351 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:12:14.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:13 gibba020 bash[25448]: cephadm 2021-03-10T16:12:12.565216+0000 mgr.gibba020.yqfnwy (mgr.34427) 7352 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:12:14.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:13 gibba020 bash[25448]: cephadm 2021-03-10T16:12:12.566627+0000 mgr.gibba020.yqfnwy (mgr.34427) 7353 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:12:14.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:13 gibba020 bash[25448]: cephadm 2021-03-10T16:12:12.566682+0000 mgr.gibba020.yqfnwy (mgr.34427) 7354 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:12:14.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:13 gibba020 bash[25448]: cephadm 2021-03-10T16:12:12.568024+0000 mgr.gibba020.yqfnwy (mgr.34427) 7355 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:12:14.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:13 gibba020 bash[25448]: cephadm 2021-03-10T16:12:12.569135+0000 mgr.gibba020.yqfnwy (mgr.34427) 7356 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:12:14.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:13 gibba020 bash[25448]: cephadm 2021-03-10T16:12:12.569171+0000 mgr.gibba020.yqfnwy (mgr.34427) 7357 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:12:14.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:13 gibba020 bash[25448]: cephadm 2021-03-10T16:12:12.570850+0000 mgr.gibba020.yqfnwy (mgr.34427) 7358 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:12:14.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:13 gibba020 bash[25448]: cephadm 2021-03-10T16:12:12.571163+0000 mgr.gibba020.yqfnwy (mgr.34427) 7359 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:12:14.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:13 gibba020 bash[25448]: cephadm 2021-03-10T16:12:12.573753+0000 mgr.gibba020.yqfnwy (mgr.34427) 7360 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:12:14.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:13 gibba020 bash[25448]: cephadm 2021-03-10T16:12:12.573789+0000 mgr.gibba020.yqfnwy (mgr.34427) 7361 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:12:14.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:13 gibba020 bash[25448]: cephadm 2021-03-10T16:12:12.573891+0000 mgr.gibba020.yqfnwy (mgr.34427) 7362 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:12:16.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:15 gibba013 bash[29418]: cluster 2021-03-10T16:12:14.490594+0000 mgr.gibba020.yqfnwy (mgr.34427) 7363 : cluster [DBG] pgmap v4186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:16.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:15 gibba013 bash[30381]: cluster 2021-03-10T16:12:14.490594+0000 mgr.gibba020.yqfnwy (mgr.34427) 7363 : cluster [DBG] pgmap v4186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:16.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:15 gibba020 bash[25448]: cluster 2021-03-10T16:12:14.490594+0000 mgr.gibba020.yqfnwy (mgr.34427) 7363 : cluster [DBG] pgmap v4186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:18.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:17 gibba013 bash[29418]: cluster 2021-03-10T16:12:16.492478+0000 mgr.gibba020.yqfnwy (mgr.34427) 7364 : cluster [DBG] pgmap v4187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:18.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:17 gibba013 bash[30381]: cluster 2021-03-10T16:12:16.492478+0000 mgr.gibba020.yqfnwy (mgr.34427) 7364 : cluster [DBG] pgmap v4187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:18.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:17 gibba020 bash[25448]: cluster 2021-03-10T16:12:16.492478+0000 mgr.gibba020.yqfnwy (mgr.34427) 7364 : cluster [DBG] pgmap v4187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:20.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:19 gibba013 bash[29418]: cluster 2021-03-10T16:12:18.493823+0000 mgr.gibba020.yqfnwy (mgr.34427) 7365 : cluster [DBG] pgmap v4188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:20.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:19 gibba013 bash[30381]: cluster 2021-03-10T16:12:18.493823+0000 mgr.gibba020.yqfnwy (mgr.34427) 7365 : cluster [DBG] pgmap v4188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:20.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:19 gibba020 bash[25448]: cluster 2021-03-10T16:12:18.493823+0000 mgr.gibba020.yqfnwy (mgr.34427) 7365 : cluster [DBG] pgmap v4188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:22.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:21 gibba013 bash[29418]: cluster 2021-03-10T16:12:20.495583+0000 mgr.gibba020.yqfnwy (mgr.34427) 7366 : cluster [DBG] pgmap v4189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:22.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:21 gibba013 bash[30381]: cluster 2021-03-10T16:12:20.495583+0000 mgr.gibba020.yqfnwy (mgr.34427) 7366 : cluster [DBG] pgmap v4189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:22.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:21 gibba020 bash[25448]: cluster 2021-03-10T16:12:20.495583+0000 mgr.gibba020.yqfnwy (mgr.34427) 7366 : cluster [DBG] pgmap v4189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:24.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:23 gibba013 bash[29418]: cluster 2021-03-10T16:12:22.497027+0000 mgr.gibba020.yqfnwy (mgr.34427) 7367 : cluster [DBG] pgmap v4190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:24.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:23 gibba013 bash[30381]: cluster 2021-03-10T16:12:22.497027+0000 mgr.gibba020.yqfnwy (mgr.34427) 7367 : cluster [DBG] pgmap v4190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:24.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:23 gibba020 bash[25448]: cluster 2021-03-10T16:12:22.497027+0000 mgr.gibba020.yqfnwy (mgr.34427) 7367 : cluster [DBG] pgmap v4190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:26.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:25 gibba013 bash[29418]: cluster 2021-03-10T16:12:24.498271+0000 mgr.gibba020.yqfnwy (mgr.34427) 7368 : cluster [DBG] pgmap v4191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:26.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:25 gibba013 bash[30381]: cluster 2021-03-10T16:12:24.498271+0000 mgr.gibba020.yqfnwy (mgr.34427) 7368 : cluster [DBG] pgmap v4191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:26.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:25 gibba020 bash[25448]: cluster 2021-03-10T16:12:24.498271+0000 mgr.gibba020.yqfnwy (mgr.34427) 7368 : cluster [DBG] pgmap v4191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:28.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:27 gibba013 bash[29418]: cluster 2021-03-10T16:12:26.500212+0000 mgr.gibba020.yqfnwy (mgr.34427) 7369 : cluster [DBG] pgmap v4192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:28.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:27 gibba013 bash[30381]: cluster 2021-03-10T16:12:26.500212+0000 mgr.gibba020.yqfnwy (mgr.34427) 7369 : cluster [DBG] pgmap v4192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:28.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:27 gibba020 bash[25448]: cluster 2021-03-10T16:12:26.500212+0000 mgr.gibba020.yqfnwy (mgr.34427) 7369 : cluster [DBG] pgmap v4192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:29.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:28 gibba013 bash[29418]: cephadm 2021-03-10T16:12:27.589944+0000 mgr.gibba020.yqfnwy (mgr.34427) 7370 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:12:29.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:28 gibba013 bash[30381]: cephadm 2021-03-10T16:12:27.589944+0000 mgr.gibba020.yqfnwy (mgr.34427) 7370 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:12:29.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:28 gibba020 bash[25448]: cephadm 2021-03-10T16:12:27.589944+0000 mgr.gibba020.yqfnwy (mgr.34427) 7370 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:12:30.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:29 gibba020 bash[25448]: cluster 2021-03-10T16:12:28.501528+0000 mgr.gibba020.yqfnwy (mgr.34427) 7371 : cluster [DBG] pgmap v4193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:30.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:29 gibba013 bash[29418]: cluster 2021-03-10T16:12:28.501528+0000 mgr.gibba020.yqfnwy (mgr.34427) 7371 : cluster [DBG] pgmap v4193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:30.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:29 gibba013 bash[30381]: cluster 2021-03-10T16:12:28.501528+0000 mgr.gibba020.yqfnwy (mgr.34427) 7371 : cluster [DBG] pgmap v4193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:32.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:31 gibba020 bash[25448]: cluster 2021-03-10T16:12:30.503193+0000 mgr.gibba020.yqfnwy (mgr.34427) 7372 : cluster [DBG] pgmap v4194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:32.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:31 gibba013 bash[29418]: cluster 2021-03-10T16:12:30.503193+0000 mgr.gibba020.yqfnwy (mgr.34427) 7372 : cluster [DBG] pgmap v4194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:32.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:31 gibba013 bash[30381]: cluster 2021-03-10T16:12:30.503193+0000 mgr.gibba020.yqfnwy (mgr.34427) 7372 : cluster [DBG] pgmap v4194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:34.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:33 gibba020 bash[25448]: cluster 2021-03-10T16:12:32.504483+0000 mgr.gibba020.yqfnwy (mgr.34427) 7373 : cluster [DBG] pgmap v4195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:34.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:33 gibba013 bash[29418]: cluster 2021-03-10T16:12:32.504483+0000 mgr.gibba020.yqfnwy (mgr.34427) 7373 : cluster [DBG] pgmap v4195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:34.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:33 gibba013 bash[30381]: cluster 2021-03-10T16:12:32.504483+0000 mgr.gibba020.yqfnwy (mgr.34427) 7373 : cluster [DBG] pgmap v4195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:36.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:35 gibba020 bash[25448]: cluster 2021-03-10T16:12:34.505879+0000 mgr.gibba020.yqfnwy (mgr.34427) 7374 : cluster [DBG] pgmap v4196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:36.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:35 gibba013 bash[29418]: cluster 2021-03-10T16:12:34.505879+0000 mgr.gibba020.yqfnwy (mgr.34427) 7374 : cluster [DBG] pgmap v4196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:36.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:35 gibba013 bash[30381]: cluster 2021-03-10T16:12:34.505879+0000 mgr.gibba020.yqfnwy (mgr.34427) 7374 : cluster [DBG] pgmap v4196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:38.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:37 gibba020 bash[25448]: cluster 2021-03-10T16:12:36.507616+0000 mgr.gibba020.yqfnwy (mgr.34427) 7375 : cluster [DBG] pgmap v4197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:38.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:37 gibba013 bash[29418]: cluster 2021-03-10T16:12:36.507616+0000 mgr.gibba020.yqfnwy (mgr.34427) 7375 : cluster [DBG] pgmap v4197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:38.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:37 gibba013 bash[30381]: cluster 2021-03-10T16:12:36.507616+0000 mgr.gibba020.yqfnwy (mgr.34427) 7375 : cluster [DBG] pgmap v4197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:39.115 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:12:39.342 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:12:39.342 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 2m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:12:39.343 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 87s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:12:39.343 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 87s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:12:39.343 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 87s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:12:39.343 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:12:39.343 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:12:39.344 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 87s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:12:39.344 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:12:39.344 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:12:39.344 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 87s ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:12:39.344 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:12:39.345 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:12:39.345 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:12:39.345 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:12:39.345 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 87s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:12:39.346 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 87s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:12:39.346 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 87s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:12:39.346 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 87s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:12:39.346 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 87s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:12:39.346 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 87s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:12:39.590 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:12:39.590 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:12:39.591 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:12:39.591 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:12:39.591 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:12:39.591 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:12:39.592 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:12:39.592 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:12:39.593 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:12:39.593 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:12:39.593 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:12:39.594 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:12:39.594 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:12:39.594 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:12:39.594 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:12:40.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:39 gibba020 bash[25448]: cluster 2021-03-10T16:12:38.509270+0000 mgr.gibba020.yqfnwy (mgr.34427) 7376 : cluster [DBG] pgmap v4198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:40.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:39 gibba020 bash[25448]: audit 2021-03-10T16:12:39.105704+0000 mgr.gibba020.yqfnwy (mgr.34427) 7377 : audit [DBG] from='client.58984 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:12:40.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:39 gibba020 bash[25448]: audit 2021-03-10T16:12:39.590560+0000 mon.a (mon.0) 2783 : audit [DBG] from='client.? 172.21.2.113:0/3674269927' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:40.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:39 gibba013 bash[29418]: cluster 2021-03-10T16:12:38.509270+0000 mgr.gibba020.yqfnwy (mgr.34427) 7376 : cluster [DBG] pgmap v4198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:40.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:39 gibba013 bash[29418]: audit 2021-03-10T16:12:39.105704+0000 mgr.gibba020.yqfnwy (mgr.34427) 7377 : audit [DBG] from='client.58984 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:12:40.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:39 gibba013 bash[29418]: audit 2021-03-10T16:12:39.590560+0000 mon.a (mon.0) 2783 : audit [DBG] from='client.? 172.21.2.113:0/3674269927' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:40.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:39 gibba013 bash[30381]: cluster 2021-03-10T16:12:38.509270+0000 mgr.gibba020.yqfnwy (mgr.34427) 7376 : cluster [DBG] pgmap v4198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:40.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:39 gibba013 bash[30381]: audit 2021-03-10T16:12:39.105704+0000 mgr.gibba020.yqfnwy (mgr.34427) 7377 : audit [DBG] from='client.58984 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:12:40.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:39 gibba013 bash[30381]: audit 2021-03-10T16:12:39.590560+0000 mon.a (mon.0) 2783 : audit [DBG] from='client.? 172.21.2.113:0/3674269927' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:12:41.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:40 gibba020 bash[25448]: audit 2021-03-10T16:12:39.329313+0000 mgr.gibba020.yqfnwy (mgr.34427) 7378 : audit [DBG] from='client.49008 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:12:41.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:40 gibba013 bash[29418]: audit 2021-03-10T16:12:39.329313+0000 mgr.gibba020.yqfnwy (mgr.34427) 7378 : audit [DBG] from='client.49008 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:12:41.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:40 gibba013 bash[30381]: audit 2021-03-10T16:12:39.329313+0000 mgr.gibba020.yqfnwy (mgr.34427) 7378 : audit [DBG] from='client.49008 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:12:42.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:41 gibba020 bash[25448]: cluster 2021-03-10T16:12:40.510903+0000 mgr.gibba020.yqfnwy (mgr.34427) 7379 : cluster [DBG] pgmap v4199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:42.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:41 gibba013 bash[29418]: cluster 2021-03-10T16:12:40.510903+0000 mgr.gibba020.yqfnwy (mgr.34427) 7379 : cluster [DBG] pgmap v4199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:42.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:41 gibba013 bash[30381]: cluster 2021-03-10T16:12:40.510903+0000 mgr.gibba020.yqfnwy (mgr.34427) 7379 : cluster [DBG] pgmap v4199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:44.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:43 gibba020 bash[25448]: cluster 2021-03-10T16:12:42.512266+0000 mgr.gibba020.yqfnwy (mgr.34427) 7380 : cluster [DBG] pgmap v4200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:44.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:43 gibba020 bash[25448]: cephadm 2021-03-10T16:12:42.605845+0000 mgr.gibba020.yqfnwy (mgr.34427) 7381 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:12:44.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:43 gibba013 bash[29418]: cluster 2021-03-10T16:12:42.512266+0000 mgr.gibba020.yqfnwy (mgr.34427) 7380 : cluster [DBG] pgmap v4200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:44.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:43 gibba013 bash[29418]: cephadm 2021-03-10T16:12:42.605845+0000 mgr.gibba020.yqfnwy (mgr.34427) 7381 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:12:44.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:43 gibba013 bash[30381]: cluster 2021-03-10T16:12:42.512266+0000 mgr.gibba020.yqfnwy (mgr.34427) 7380 : cluster [DBG] pgmap v4200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:44.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:43 gibba013 bash[30381]: cephadm 2021-03-10T16:12:42.605845+0000 mgr.gibba020.yqfnwy (mgr.34427) 7381 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:12:46.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:45 gibba013 bash[29418]: cluster 2021-03-10T16:12:44.513606+0000 mgr.gibba020.yqfnwy (mgr.34427) 7382 : cluster [DBG] pgmap v4201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:46.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:45 gibba013 bash[30381]: cluster 2021-03-10T16:12:44.513606+0000 mgr.gibba020.yqfnwy (mgr.34427) 7382 : cluster [DBG] pgmap v4201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:46.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:45 gibba020 bash[25448]: cluster 2021-03-10T16:12:44.513606+0000 mgr.gibba020.yqfnwy (mgr.34427) 7382 : cluster [DBG] pgmap v4201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:48.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:47 gibba013 bash[29418]: cluster 2021-03-10T16:12:46.515525+0000 mgr.gibba020.yqfnwy (mgr.34427) 7383 : cluster [DBG] pgmap v4202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:48.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:47 gibba013 bash[30381]: cluster 2021-03-10T16:12:46.515525+0000 mgr.gibba020.yqfnwy (mgr.34427) 7383 : cluster [DBG] pgmap v4202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:48.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:47 gibba020 bash[25448]: cluster 2021-03-10T16:12:46.515525+0000 mgr.gibba020.yqfnwy (mgr.34427) 7383 : cluster [DBG] pgmap v4202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:50.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:49 gibba013 bash[29418]: cluster 2021-03-10T16:12:48.517006+0000 mgr.gibba020.yqfnwy (mgr.34427) 7384 : cluster [DBG] pgmap v4203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:50.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:49 gibba013 bash[30381]: cluster 2021-03-10T16:12:48.517006+0000 mgr.gibba020.yqfnwy (mgr.34427) 7384 : cluster [DBG] pgmap v4203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:50.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:49 gibba020 bash[25448]: cluster 2021-03-10T16:12:48.517006+0000 mgr.gibba020.yqfnwy (mgr.34427) 7384 : cluster [DBG] pgmap v4203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:52.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:51 gibba013 bash[29418]: cluster 2021-03-10T16:12:50.518604+0000 mgr.gibba020.yqfnwy (mgr.34427) 7385 : cluster [DBG] pgmap v4204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:52.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:51 gibba013 bash[30381]: cluster 2021-03-10T16:12:50.518604+0000 mgr.gibba020.yqfnwy (mgr.34427) 7385 : cluster [DBG] pgmap v4204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:52.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:51 gibba020 bash[25448]: cluster 2021-03-10T16:12:50.518604+0000 mgr.gibba020.yqfnwy (mgr.34427) 7385 : cluster [DBG] pgmap v4204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:54.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:53 gibba013 bash[29418]: cluster 2021-03-10T16:12:52.519891+0000 mgr.gibba020.yqfnwy (mgr.34427) 7386 : cluster [DBG] pgmap v4205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:54.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:53 gibba013 bash[30381]: cluster 2021-03-10T16:12:52.519891+0000 mgr.gibba020.yqfnwy (mgr.34427) 7386 : cluster [DBG] pgmap v4205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:54.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:53 gibba020 bash[25448]: cluster 2021-03-10T16:12:52.519891+0000 mgr.gibba020.yqfnwy (mgr.34427) 7386 : cluster [DBG] pgmap v4205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:56.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:55 gibba013 bash[29418]: cluster 2021-03-10T16:12:54.521350+0000 mgr.gibba020.yqfnwy (mgr.34427) 7387 : cluster [DBG] pgmap v4206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:56.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:55 gibba013 bash[30381]: cluster 2021-03-10T16:12:54.521350+0000 mgr.gibba020.yqfnwy (mgr.34427) 7387 : cluster [DBG] pgmap v4206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:56.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:55 gibba020 bash[25448]: cluster 2021-03-10T16:12:54.521350+0000 mgr.gibba020.yqfnwy (mgr.34427) 7387 : cluster [DBG] pgmap v4206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:58.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:58 gibba013 bash[29418]: cluster 2021-03-10T16:12:56.523101+0000 mgr.gibba020.yqfnwy (mgr.34427) 7388 : cluster [DBG] pgmap v4207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:58.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:58 gibba013 bash[30381]: cluster 2021-03-10T16:12:56.523101+0000 mgr.gibba020.yqfnwy (mgr.34427) 7388 : cluster [DBG] pgmap v4207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:58.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:58 gibba020 bash[25448]: cluster 2021-03-10T16:12:56.523101+0000 mgr.gibba020.yqfnwy (mgr.34427) 7388 : cluster [DBG] pgmap v4207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:12:59.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:12:59 gibba013 bash[29418]: cephadm 2021-03-10T16:12:57.621881+0000 mgr.gibba020.yqfnwy (mgr.34427) 7389 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:12:59.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:12:59 gibba013 bash[30381]: cephadm 2021-03-10T16:12:57.621881+0000 mgr.gibba020.yqfnwy (mgr.34427) 7389 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:12:59.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:12:59 gibba020 bash[25448]: cephadm 2021-03-10T16:12:57.621881+0000 mgr.gibba020.yqfnwy (mgr.34427) 7389 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:13:00.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:00 gibba013 bash[29418]: cluster 2021-03-10T16:12:58.524649+0000 mgr.gibba020.yqfnwy (mgr.34427) 7390 : cluster [DBG] pgmap v4208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:00.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:00 gibba013 bash[30381]: cluster 2021-03-10T16:12:58.524649+0000 mgr.gibba020.yqfnwy (mgr.34427) 7390 : cluster [DBG] pgmap v4208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:00.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:00 gibba020 bash[25448]: cluster 2021-03-10T16:12:58.524649+0000 mgr.gibba020.yqfnwy (mgr.34427) 7390 : cluster [DBG] pgmap v4208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:02.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:02 gibba013 bash[29418]: cluster 2021-03-10T16:13:00.526335+0000 mgr.gibba020.yqfnwy (mgr.34427) 7391 : cluster [DBG] pgmap v4209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:02.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:02 gibba013 bash[30381]: cluster 2021-03-10T16:13:00.526335+0000 mgr.gibba020.yqfnwy (mgr.34427) 7391 : cluster [DBG] pgmap v4209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:02.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:02 gibba020 bash[25448]: cluster 2021-03-10T16:13:00.526335+0000 mgr.gibba020.yqfnwy (mgr.34427) 7391 : cluster [DBG] pgmap v4209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:04.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:04 gibba013 bash[29418]: cluster 2021-03-10T16:13:02.527857+0000 mgr.gibba020.yqfnwy (mgr.34427) 7392 : cluster [DBG] pgmap v4210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:04.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:04 gibba013 bash[30381]: cluster 2021-03-10T16:13:02.527857+0000 mgr.gibba020.yqfnwy (mgr.34427) 7392 : cluster [DBG] pgmap v4210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:04.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:04 gibba020 bash[25448]: cluster 2021-03-10T16:13:02.527857+0000 mgr.gibba020.yqfnwy (mgr.34427) 7392 : cluster [DBG] pgmap v4210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:06.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:06 gibba013 bash[29418]: cluster 2021-03-10T16:13:04.529338+0000 mgr.gibba020.yqfnwy (mgr.34427) 7393 : cluster [DBG] pgmap v4211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:06.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:06 gibba013 bash[30381]: cluster 2021-03-10T16:13:04.529338+0000 mgr.gibba020.yqfnwy (mgr.34427) 7393 : cluster [DBG] pgmap v4211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:06.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:06 gibba020 bash[25448]: cluster 2021-03-10T16:13:04.529338+0000 mgr.gibba020.yqfnwy (mgr.34427) 7393 : cluster [DBG] pgmap v4211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:07.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:07 gibba013 bash[29418]: audit 2021-03-10T16:13:06.652243+0000 mon.a (mon.0) 2784 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:13:07.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:07 gibba013 bash[29418]: audit 2021-03-10T16:13:06.756285+0000 mon.a (mon.0) 2785 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:13:07.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:07 gibba013 bash[29418]: audit 2021-03-10T16:13:06.984939+0000 mon.a (mon.0) 2786 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:13:07.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:07 gibba013 bash[29418]: audit 2021-03-10T16:13:06.985718+0000 mon.a (mon.0) 2787 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:13:07.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:07 gibba013 bash[29418]: audit 2021-03-10T16:13:06.986430+0000 mon.a (mon.0) 2788 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:13:07.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:07 gibba013 bash[29418]: audit 2021-03-10T16:13:06.987099+0000 mon.a (mon.0) 2789 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:13:07.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:07 gibba013 bash[30381]: audit 2021-03-10T16:13:06.652243+0000 mon.a (mon.0) 2784 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:13:07.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:07 gibba013 bash[30381]: audit 2021-03-10T16:13:06.756285+0000 mon.a (mon.0) 2785 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:13:07.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:07 gibba013 bash[30381]: audit 2021-03-10T16:13:06.984939+0000 mon.a (mon.0) 2786 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:13:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:07 gibba013 bash[30381]: audit 2021-03-10T16:13:06.985718+0000 mon.a (mon.0) 2787 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:13:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:07 gibba013 bash[30381]: audit 2021-03-10T16:13:06.986430+0000 mon.a (mon.0) 2788 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:13:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:07 gibba013 bash[30381]: audit 2021-03-10T16:13:06.987099+0000 mon.a (mon.0) 2789 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:13:07.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:07 gibba020 bash[25448]: audit 2021-03-10T16:13:06.652243+0000 mon.a (mon.0) 2784 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:13:07.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:07 gibba020 bash[25448]: audit 2021-03-10T16:13:06.756285+0000 mon.a (mon.0) 2785 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:13:07.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:07 gibba020 bash[25448]: audit 2021-03-10T16:13:06.984939+0000 mon.a (mon.0) 2786 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:13:07.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:07 gibba020 bash[25448]: audit 2021-03-10T16:13:06.985718+0000 mon.a (mon.0) 2787 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:13:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:07 gibba020 bash[25448]: audit 2021-03-10T16:13:06.986430+0000 mon.a (mon.0) 2788 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:13:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:07 gibba020 bash[25448]: audit 2021-03-10T16:13:06.987099+0000 mon.a (mon.0) 2789 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:13:08.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:08 gibba013 bash[29418]: cluster 2021-03-10T16:13:06.530978+0000 mgr.gibba020.yqfnwy (mgr.34427) 7394 : cluster [DBG] pgmap v4212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:08.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:08 gibba013 bash[30381]: cluster 2021-03-10T16:13:06.530978+0000 mgr.gibba020.yqfnwy (mgr.34427) 7394 : cluster [DBG] pgmap v4212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:08.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:08 gibba020 bash[25448]: cluster 2021-03-10T16:13:06.530978+0000 mgr.gibba020.yqfnwy (mgr.34427) 7394 : cluster [DBG] pgmap v4212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:09.834 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:13:10.057 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:13:10.058 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 3m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:13:10.058 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 118s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:13:10.058 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 118s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:13:10.059 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 118s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:13:10.059 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:13:10.059 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:13:10.059 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 118s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:13:10.060 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:13:10.060 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:13:10.060 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 118s ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:13:10.060 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:13:10.060 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:13:10.061 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:13:10.061 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:13:10.061 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 118s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:13:10.061 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 118s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:13:10.062 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 118s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:13:10.062 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 118s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:13:10.062 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 118s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:13:10.062 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 118s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:13:10.310 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:13:10.311 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:13:10.311 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:13:10.311 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:13:10.311 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:13:10.312 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:13:10.312 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:13:10.312 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:13:10.312 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:13:10.313 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:13:10.313 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:13:10.313 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:13:10.313 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:13:10.313 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:13:10.314 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:13:10.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:10 gibba013 bash[29418]: cluster 2021-03-10T16:13:08.532394+0000 mgr.gibba020.yqfnwy (mgr.34427) 7395 : cluster [DBG] pgmap v4213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:10.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:10 gibba013 bash[30381]: cluster 2021-03-10T16:13:08.532394+0000 mgr.gibba020.yqfnwy (mgr.34427) 7395 : cluster [DBG] pgmap v4213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:10.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:10 gibba020 bash[25448]: cluster 2021-03-10T16:13:08.532394+0000 mgr.gibba020.yqfnwy (mgr.34427) 7395 : cluster [DBG] pgmap v4213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:11.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:11 gibba013 bash[29418]: audit 2021-03-10T16:13:09.823849+0000 mgr.gibba020.yqfnwy (mgr.34427) 7396 : audit [DBG] from='client.59002 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:13:11.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:11 gibba013 bash[29418]: audit 2021-03-10T16:13:10.047232+0000 mgr.gibba020.yqfnwy (mgr.34427) 7397 : audit [DBG] from='client.49026 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:13:11.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:11 gibba013 bash[29418]: audit 2021-03-10T16:13:10.310880+0000 mon.a (mon.0) 2790 : audit [DBG] from='client.? 172.21.2.113:0/1401363770' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:11.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:11 gibba013 bash[30381]: audit 2021-03-10T16:13:09.823849+0000 mgr.gibba020.yqfnwy (mgr.34427) 7396 : audit [DBG] from='client.59002 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:13:11.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:11 gibba013 bash[30381]: audit 2021-03-10T16:13:10.047232+0000 mgr.gibba020.yqfnwy (mgr.34427) 7397 : audit [DBG] from='client.49026 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:13:11.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:11 gibba013 bash[30381]: audit 2021-03-10T16:13:10.310880+0000 mon.a (mon.0) 2790 : audit [DBG] from='client.? 172.21.2.113:0/1401363770' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:11.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:11 gibba020 bash[25448]: audit 2021-03-10T16:13:09.823849+0000 mgr.gibba020.yqfnwy (mgr.34427) 7396 : audit [DBG] from='client.59002 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:13:11.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:11 gibba020 bash[25448]: audit 2021-03-10T16:13:10.047232+0000 mgr.gibba020.yqfnwy (mgr.34427) 7397 : audit [DBG] from='client.49026 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:13:11.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:11 gibba020 bash[25448]: audit 2021-03-10T16:13:10.310880+0000 mon.a (mon.0) 2790 : audit [DBG] from='client.? 172.21.2.113:0/1401363770' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:12.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:12 gibba013 bash[29418]: cluster 2021-03-10T16:13:10.533941+0000 mgr.gibba020.yqfnwy (mgr.34427) 7398 : cluster [DBG] pgmap v4214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:12.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:12 gibba013 bash[30381]: cluster 2021-03-10T16:13:10.533941+0000 mgr.gibba020.yqfnwy (mgr.34427) 7398 : cluster [DBG] pgmap v4214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:12.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:12 gibba020 bash[25448]: cluster 2021-03-10T16:13:10.533941+0000 mgr.gibba020.yqfnwy (mgr.34427) 7398 : cluster [DBG] pgmap v4214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:13.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:13 gibba020 bash[25448]: audit 2021-03-10T16:13:12.639812+0000 mon.a (mon.0) 2791 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:13:13.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:13 gibba020 bash[25448]: audit 2021-03-10T16:13:12.861294+0000 mon.a (mon.0) 2792 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:13:13.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:13 gibba020 bash[25448]: audit 2021-03-10T16:13:12.864653+0000 mon.a (mon.0) 2793 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:13:13.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:13 gibba020 bash[25448]: audit 2021-03-10T16:13:12.866301+0000 mon.a (mon.0) 2794 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:13.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:13 gibba020 bash[25448]: audit 2021-03-10T16:13:12.867949+0000 mon.a (mon.0) 2795 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:13.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:13 gibba020 bash[25448]: audit 2021-03-10T16:13:12.869472+0000 mon.a (mon.0) 2796 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:13.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:13 gibba020 bash[25448]: audit 2021-03-10T16:13:12.872893+0000 mon.a (mon.0) 2797 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:13.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:13 gibba020 bash[25448]: audit 2021-03-10T16:13:12.874950+0000 mon.a (mon.0) 2798 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:13.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:13 gibba013 bash[29418]: audit 2021-03-10T16:13:12.639812+0000 mon.a (mon.0) 2791 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:13:13.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:13 gibba013 bash[29418]: audit 2021-03-10T16:13:12.861294+0000 mon.a (mon.0) 2792 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:13:13.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:13 gibba013 bash[29418]: audit 2021-03-10T16:13:12.864653+0000 mon.a (mon.0) 2793 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:13:13.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:13 gibba013 bash[29418]: audit 2021-03-10T16:13:12.866301+0000 mon.a (mon.0) 2794 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:13.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:13 gibba013 bash[29418]: audit 2021-03-10T16:13:12.867949+0000 mon.a (mon.0) 2795 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:13.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:13 gibba013 bash[29418]: audit 2021-03-10T16:13:12.869472+0000 mon.a (mon.0) 2796 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:13.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:13 gibba013 bash[29418]: audit 2021-03-10T16:13:12.872893+0000 mon.a (mon.0) 2797 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:13.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:13 gibba013 bash[29418]: audit 2021-03-10T16:13:12.874950+0000 mon.a (mon.0) 2798 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:13.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:13 gibba013 bash[30381]: audit 2021-03-10T16:13:12.639812+0000 mon.a (mon.0) 2791 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:13:13.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:13 gibba013 bash[30381]: audit 2021-03-10T16:13:12.861294+0000 mon.a (mon.0) 2792 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:13:13.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:13 gibba013 bash[30381]: audit 2021-03-10T16:13:12.864653+0000 mon.a (mon.0) 2793 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:13:13.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:13 gibba013 bash[30381]: audit 2021-03-10T16:13:12.866301+0000 mon.a (mon.0) 2794 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:13.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:13 gibba013 bash[30381]: audit 2021-03-10T16:13:12.867949+0000 mon.a (mon.0) 2795 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:13.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:13 gibba013 bash[30381]: audit 2021-03-10T16:13:12.869472+0000 mon.a (mon.0) 2796 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:13.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:13 gibba013 bash[30381]: audit 2021-03-10T16:13:12.872893+0000 mon.a (mon.0) 2797 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:13.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:13 gibba013 bash[30381]: audit 2021-03-10T16:13:12.874950+0000 mon.a (mon.0) 2798 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:14.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:14 gibba013 bash[29418]: cluster 2021-03-10T16:13:12.535350+0000 mgr.gibba020.yqfnwy (mgr.34427) 7399 : cluster [DBG] pgmap v4215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:14.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:14 gibba013 bash[29418]: cephadm 2021-03-10T16:13:12.644403+0000 mgr.gibba020.yqfnwy (mgr.34427) 7400 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:13:14.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:14 gibba013 bash[29418]: cephadm 2021-03-10T16:13:12.646272+0000 mgr.gibba020.yqfnwy (mgr.34427) 7401 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:13:14.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:14 gibba013 bash[29418]: cephadm 2021-03-10T16:13:12.862625+0000 mgr.gibba020.yqfnwy (mgr.34427) 7402 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:13:14.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:14 gibba013 bash[29418]: cephadm 2021-03-10T16:13:12.864868+0000 mgr.gibba020.yqfnwy (mgr.34427) 7403 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:13:14.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:14 gibba013 bash[29418]: cephadm 2021-03-10T16:13:12.866320+0000 mgr.gibba020.yqfnwy (mgr.34427) 7404 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:13:14.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:14 gibba013 bash[29418]: cephadm 2021-03-10T16:13:12.866359+0000 mgr.gibba020.yqfnwy (mgr.34427) 7405 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:13:14.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:14 gibba013 bash[29418]: cephadm 2021-03-10T16:13:12.867901+0000 mgr.gibba020.yqfnwy (mgr.34427) 7406 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:13:14.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:14 gibba013 bash[29418]: cephadm 2021-03-10T16:13:12.867984+0000 mgr.gibba020.yqfnwy (mgr.34427) 7407 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:13:14.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:14 gibba013 bash[29418]: cephadm 2021-03-10T16:13:12.869678+0000 mgr.gibba020.yqfnwy (mgr.34427) 7408 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:13:14.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:14 gibba013 bash[29418]: cephadm 2021-03-10T16:13:12.871471+0000 mgr.gibba020.yqfnwy (mgr.34427) 7409 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:13:14.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:14 gibba013 bash[29418]: cephadm 2021-03-10T16:13:12.871509+0000 mgr.gibba020.yqfnwy (mgr.34427) 7410 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:13:14.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:14 gibba013 bash[29418]: cephadm 2021-03-10T16:13:12.873124+0000 mgr.gibba020.yqfnwy (mgr.34427) 7411 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:13:14.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:14 gibba013 bash[29418]: cephadm 2021-03-10T16:13:12.873444+0000 mgr.gibba020.yqfnwy (mgr.34427) 7412 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:13:14.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:14 gibba013 bash[29418]: cephadm 2021-03-10T16:13:12.875239+0000 mgr.gibba020.yqfnwy (mgr.34427) 7413 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:13:14.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:14 gibba013 bash[29418]: cephadm 2021-03-10T16:13:12.875277+0000 mgr.gibba020.yqfnwy (mgr.34427) 7414 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:13:14.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:14 gibba013 bash[29418]: cephadm 2021-03-10T16:13:12.875452+0000 mgr.gibba020.yqfnwy (mgr.34427) 7415 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:13:14.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:14 gibba013 bash[30381]: cluster 2021-03-10T16:13:12.535350+0000 mgr.gibba020.yqfnwy (mgr.34427) 7399 : cluster [DBG] pgmap v4215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:14.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:14 gibba013 bash[30381]: cephadm 2021-03-10T16:13:12.644403+0000 mgr.gibba020.yqfnwy (mgr.34427) 7400 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:13:14.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:14 gibba013 bash[30381]: cephadm 2021-03-10T16:13:12.646272+0000 mgr.gibba020.yqfnwy (mgr.34427) 7401 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:13:14.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:14 gibba013 bash[30381]: cephadm 2021-03-10T16:13:12.862625+0000 mgr.gibba020.yqfnwy (mgr.34427) 7402 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:13:14.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:14 gibba013 bash[30381]: cephadm 2021-03-10T16:13:12.864868+0000 mgr.gibba020.yqfnwy (mgr.34427) 7403 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:13:14.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:14 gibba013 bash[30381]: cephadm 2021-03-10T16:13:12.866320+0000 mgr.gibba020.yqfnwy (mgr.34427) 7404 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:13:14.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:14 gibba013 bash[30381]: cephadm 2021-03-10T16:13:12.866359+0000 mgr.gibba020.yqfnwy (mgr.34427) 7405 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:13:14.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:14 gibba013 bash[30381]: cephadm 2021-03-10T16:13:12.867901+0000 mgr.gibba020.yqfnwy (mgr.34427) 7406 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:13:14.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:14 gibba013 bash[30381]: cephadm 2021-03-10T16:13:12.867984+0000 mgr.gibba020.yqfnwy (mgr.34427) 7407 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:13:14.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:14 gibba013 bash[30381]: cephadm 2021-03-10T16:13:12.869678+0000 mgr.gibba020.yqfnwy (mgr.34427) 7408 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:13:14.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:14 gibba013 bash[30381]: cephadm 2021-03-10T16:13:12.871471+0000 mgr.gibba020.yqfnwy (mgr.34427) 7409 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:13:14.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:14 gibba013 bash[30381]: cephadm 2021-03-10T16:13:12.871509+0000 mgr.gibba020.yqfnwy (mgr.34427) 7410 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:13:14.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:14 gibba013 bash[30381]: cephadm 2021-03-10T16:13:12.873124+0000 mgr.gibba020.yqfnwy (mgr.34427) 7411 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:13:14.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:14 gibba013 bash[30381]: cephadm 2021-03-10T16:13:12.873444+0000 mgr.gibba020.yqfnwy (mgr.34427) 7412 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:13:14.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:14 gibba013 bash[30381]: cephadm 2021-03-10T16:13:12.875239+0000 mgr.gibba020.yqfnwy (mgr.34427) 7413 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:13:14.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:14 gibba013 bash[30381]: cephadm 2021-03-10T16:13:12.875277+0000 mgr.gibba020.yqfnwy (mgr.34427) 7414 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:13:14.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:14 gibba013 bash[30381]: cephadm 2021-03-10T16:13:12.875452+0000 mgr.gibba020.yqfnwy (mgr.34427) 7415 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:13:14.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:14 gibba020 bash[25448]: cluster 2021-03-10T16:13:12.535350+0000 mgr.gibba020.yqfnwy (mgr.34427) 7399 : cluster [DBG] pgmap v4215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:14.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:14 gibba020 bash[25448]: cephadm 2021-03-10T16:13:12.644403+0000 mgr.gibba020.yqfnwy (mgr.34427) 7400 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:13:14.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:14 gibba020 bash[25448]: cephadm 2021-03-10T16:13:12.646272+0000 mgr.gibba020.yqfnwy (mgr.34427) 7401 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:13:14.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:14 gibba020 bash[25448]: cephadm 2021-03-10T16:13:12.862625+0000 mgr.gibba020.yqfnwy (mgr.34427) 7402 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:13:14.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:14 gibba020 bash[25448]: cephadm 2021-03-10T16:13:12.864868+0000 mgr.gibba020.yqfnwy (mgr.34427) 7403 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:13:14.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:14 gibba020 bash[25448]: cephadm 2021-03-10T16:13:12.866320+0000 mgr.gibba020.yqfnwy (mgr.34427) 7404 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:13:14.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:14 gibba020 bash[25448]: cephadm 2021-03-10T16:13:12.866359+0000 mgr.gibba020.yqfnwy (mgr.34427) 7405 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:13:14.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:14 gibba020 bash[25448]: cephadm 2021-03-10T16:13:12.867901+0000 mgr.gibba020.yqfnwy (mgr.34427) 7406 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:13:14.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:14 gibba020 bash[25448]: cephadm 2021-03-10T16:13:12.867984+0000 mgr.gibba020.yqfnwy (mgr.34427) 7407 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:13:14.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:14 gibba020 bash[25448]: cephadm 2021-03-10T16:13:12.869678+0000 mgr.gibba020.yqfnwy (mgr.34427) 7408 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:13:14.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:14 gibba020 bash[25448]: cephadm 2021-03-10T16:13:12.871471+0000 mgr.gibba020.yqfnwy (mgr.34427) 7409 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:13:14.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:14 gibba020 bash[25448]: cephadm 2021-03-10T16:13:12.871509+0000 mgr.gibba020.yqfnwy (mgr.34427) 7410 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:13:14.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:14 gibba020 bash[25448]: cephadm 2021-03-10T16:13:12.873124+0000 mgr.gibba020.yqfnwy (mgr.34427) 7411 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:13:14.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:14 gibba020 bash[25448]: cephadm 2021-03-10T16:13:12.873444+0000 mgr.gibba020.yqfnwy (mgr.34427) 7412 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:13:14.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:14 gibba020 bash[25448]: cephadm 2021-03-10T16:13:12.875239+0000 mgr.gibba020.yqfnwy (mgr.34427) 7413 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:13:14.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:14 gibba020 bash[25448]: cephadm 2021-03-10T16:13:12.875277+0000 mgr.gibba020.yqfnwy (mgr.34427) 7414 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:13:14.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:14 gibba020 bash[25448]: cephadm 2021-03-10T16:13:12.875452+0000 mgr.gibba020.yqfnwy (mgr.34427) 7415 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:13:16.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:16 gibba013 bash[29418]: cluster 2021-03-10T16:13:14.536816+0000 mgr.gibba020.yqfnwy (mgr.34427) 7416 : cluster [DBG] pgmap v4216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:16.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:16 gibba013 bash[30381]: cluster 2021-03-10T16:13:14.536816+0000 mgr.gibba020.yqfnwy (mgr.34427) 7416 : cluster [DBG] pgmap v4216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:16.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:16 gibba020 bash[25448]: cluster 2021-03-10T16:13:14.536816+0000 mgr.gibba020.yqfnwy (mgr.34427) 7416 : cluster [DBG] pgmap v4216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:18.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:18 gibba013 bash[29418]: cluster 2021-03-10T16:13:16.538664+0000 mgr.gibba020.yqfnwy (mgr.34427) 7417 : cluster [DBG] pgmap v4217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:18.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:18 gibba013 bash[30381]: cluster 2021-03-10T16:13:16.538664+0000 mgr.gibba020.yqfnwy (mgr.34427) 7417 : cluster [DBG] pgmap v4217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:18.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:18 gibba020 bash[25448]: cluster 2021-03-10T16:13:16.538664+0000 mgr.gibba020.yqfnwy (mgr.34427) 7417 : cluster [DBG] pgmap v4217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:20.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:20 gibba013 bash[29418]: cluster 2021-03-10T16:13:18.540095+0000 mgr.gibba020.yqfnwy (mgr.34427) 7418 : cluster [DBG] pgmap v4218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:20.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:20 gibba013 bash[30381]: cluster 2021-03-10T16:13:18.540095+0000 mgr.gibba020.yqfnwy (mgr.34427) 7418 : cluster [DBG] pgmap v4218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:20.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:20 gibba020 bash[25448]: cluster 2021-03-10T16:13:18.540095+0000 mgr.gibba020.yqfnwy (mgr.34427) 7418 : cluster [DBG] pgmap v4218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:22.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:22 gibba020 bash[25448]: cluster 2021-03-10T16:13:20.541538+0000 mgr.gibba020.yqfnwy (mgr.34427) 7419 : cluster [DBG] pgmap v4219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:22.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:22 gibba013 bash[29418]: cluster 2021-03-10T16:13:20.541538+0000 mgr.gibba020.yqfnwy (mgr.34427) 7419 : cluster [DBG] pgmap v4219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:22.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:22 gibba013 bash[30381]: cluster 2021-03-10T16:13:20.541538+0000 mgr.gibba020.yqfnwy (mgr.34427) 7419 : cluster [DBG] pgmap v4219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:24.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:24 gibba020 bash[25448]: cluster 2021-03-10T16:13:22.543027+0000 mgr.gibba020.yqfnwy (mgr.34427) 7420 : cluster [DBG] pgmap v4220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:24.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:24 gibba013 bash[29418]: cluster 2021-03-10T16:13:22.543027+0000 mgr.gibba020.yqfnwy (mgr.34427) 7420 : cluster [DBG] pgmap v4220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:24.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:24 gibba013 bash[30381]: cluster 2021-03-10T16:13:22.543027+0000 mgr.gibba020.yqfnwy (mgr.34427) 7420 : cluster [DBG] pgmap v4220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:26.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:26 gibba020 bash[25448]: cluster 2021-03-10T16:13:24.544320+0000 mgr.gibba020.yqfnwy (mgr.34427) 7421 : cluster [DBG] pgmap v4221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:26.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:26 gibba013 bash[30381]: cluster 2021-03-10T16:13:24.544320+0000 mgr.gibba020.yqfnwy (mgr.34427) 7421 : cluster [DBG] pgmap v4221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:26.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:26 gibba013 bash[29418]: cluster 2021-03-10T16:13:24.544320+0000 mgr.gibba020.yqfnwy (mgr.34427) 7421 : cluster [DBG] pgmap v4221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:28.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:28 gibba020 bash[25448]: cluster 2021-03-10T16:13:26.546004+0000 mgr.gibba020.yqfnwy (mgr.34427) 7422 : cluster [DBG] pgmap v4222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:28.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:28 gibba013 bash[29418]: cluster 2021-03-10T16:13:26.546004+0000 mgr.gibba020.yqfnwy (mgr.34427) 7422 : cluster [DBG] pgmap v4222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:28.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:28 gibba013 bash[30381]: cluster 2021-03-10T16:13:26.546004+0000 mgr.gibba020.yqfnwy (mgr.34427) 7422 : cluster [DBG] pgmap v4222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:29.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:29 gibba020 bash[25448]: cephadm 2021-03-10T16:13:27.888937+0000 mgr.gibba020.yqfnwy (mgr.34427) 7423 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:13:29.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:29 gibba013 bash[29418]: cephadm 2021-03-10T16:13:27.888937+0000 mgr.gibba020.yqfnwy (mgr.34427) 7423 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:13:29.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:29 gibba013 bash[30381]: cephadm 2021-03-10T16:13:27.888937+0000 mgr.gibba020.yqfnwy (mgr.34427) 7423 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:13:30.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:30 gibba020 bash[25448]: cluster 2021-03-10T16:13:28.547679+0000 mgr.gibba020.yqfnwy (mgr.34427) 7424 : cluster [DBG] pgmap v4223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:30.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:30 gibba013 bash[29418]: cluster 2021-03-10T16:13:28.547679+0000 mgr.gibba020.yqfnwy (mgr.34427) 7424 : cluster [DBG] pgmap v4223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:30.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:30 gibba013 bash[30381]: cluster 2021-03-10T16:13:28.547679+0000 mgr.gibba020.yqfnwy (mgr.34427) 7424 : cluster [DBG] pgmap v4223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:32.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:32 gibba020 bash[25448]: cluster 2021-03-10T16:13:30.549462+0000 mgr.gibba020.yqfnwy (mgr.34427) 7425 : cluster [DBG] pgmap v4224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:32.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:32 gibba013 bash[29418]: cluster 2021-03-10T16:13:30.549462+0000 mgr.gibba020.yqfnwy (mgr.34427) 7425 : cluster [DBG] pgmap v4224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:32.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:32 gibba013 bash[30381]: cluster 2021-03-10T16:13:30.549462+0000 mgr.gibba020.yqfnwy (mgr.34427) 7425 : cluster [DBG] pgmap v4224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:34.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:34 gibba020 bash[25448]: cluster 2021-03-10T16:13:32.551012+0000 mgr.gibba020.yqfnwy (mgr.34427) 7426 : cluster [DBG] pgmap v4225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:34.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:34 gibba013 bash[29418]: cluster 2021-03-10T16:13:32.551012+0000 mgr.gibba020.yqfnwy (mgr.34427) 7426 : cluster [DBG] pgmap v4225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:34.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:34 gibba013 bash[30381]: cluster 2021-03-10T16:13:32.551012+0000 mgr.gibba020.yqfnwy (mgr.34427) 7426 : cluster [DBG] pgmap v4225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:36.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:36 gibba013 bash[29418]: cluster 2021-03-10T16:13:34.552485+0000 mgr.gibba020.yqfnwy (mgr.34427) 7427 : cluster [DBG] pgmap v4226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:36.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:36 gibba013 bash[30381]: cluster 2021-03-10T16:13:34.552485+0000 mgr.gibba020.yqfnwy (mgr.34427) 7427 : cluster [DBG] pgmap v4226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:36.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:36 gibba020 bash[25448]: cluster 2021-03-10T16:13:34.552485+0000 mgr.gibba020.yqfnwy (mgr.34427) 7427 : cluster [DBG] pgmap v4226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:38.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:38 gibba013 bash[29418]: cluster 2021-03-10T16:13:36.554093+0000 mgr.gibba020.yqfnwy (mgr.34427) 7428 : cluster [DBG] pgmap v4227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:38.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:38 gibba013 bash[30381]: cluster 2021-03-10T16:13:36.554093+0000 mgr.gibba020.yqfnwy (mgr.34427) 7428 : cluster [DBG] pgmap v4227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:38.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:38 gibba020 bash[25448]: cluster 2021-03-10T16:13:36.554093+0000 mgr.gibba020.yqfnwy (mgr.34427) 7428 : cluster [DBG] pgmap v4227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:40.556 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:13:40.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:40 gibba013 bash[29418]: cluster 2021-03-10T16:13:38.555775+0000 mgr.gibba020.yqfnwy (mgr.34427) 7429 : cluster [DBG] pgmap v4228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:40.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:40 gibba013 bash[30381]: cluster 2021-03-10T16:13:38.555775+0000 mgr.gibba020.yqfnwy (mgr.34427) 7429 : cluster [DBG] pgmap v4228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:40.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:40 gibba020 bash[25448]: cluster 2021-03-10T16:13:38.555775+0000 mgr.gibba020.yqfnwy (mgr.34427) 7429 : cluster [DBG] pgmap v4228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:40.783 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:13:40.784 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 3m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:13:40.784 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 2m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:13:40.784 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:13:40.784 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:13:40.785 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:13:40.785 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:13:40.785 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:13:40.785 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:13:40.786 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:13:40.786 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:13:40.786 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:13:40.786 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:13:40.787 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:13:40.787 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:13:40.787 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:13:40.787 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:13:40.788 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:13:40.788 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:13:40.788 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 2m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:13:40.788 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:13:41.030 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:13:41.030 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:13:41.030 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:13:41.031 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:13:41.031 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:13:41.031 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:13:41.031 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:13:41.032 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:13:41.032 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:13:41.032 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:13:41.032 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:13:41.032 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:13:41.033 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:13:41.033 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:13:41.033 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:13:41.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:41 gibba013 bash[29418]: audit 2021-03-10T16:13:41.030689+0000 mon.a (mon.0) 2799 : audit [DBG] from='client.? 172.21.2.113:0/3202716562' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:41.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:41 gibba013 bash[30381]: audit 2021-03-10T16:13:41.030689+0000 mon.a (mon.0) 2799 : audit [DBG] from='client.? 172.21.2.113:0/3202716562' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:41.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:41 gibba020 bash[25448]: audit 2021-03-10T16:13:41.030689+0000 mon.a (mon.0) 2799 : audit [DBG] from='client.? 172.21.2.113:0/3202716562' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:13:42.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:42 gibba013 bash[29418]: audit 2021-03-10T16:13:40.545855+0000 mgr.gibba020.yqfnwy (mgr.34427) 7430 : audit [DBG] from='client.59020 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:13:42.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:42 gibba013 bash[29418]: cluster 2021-03-10T16:13:40.557367+0000 mgr.gibba020.yqfnwy (mgr.34427) 7431 : cluster [DBG] pgmap v4229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:42.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:42 gibba013 bash[29418]: audit 2021-03-10T16:13:40.770829+0000 mgr.gibba020.yqfnwy (mgr.34427) 7432 : audit [DBG] from='client.59026 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:13:42.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:42 gibba013 bash[30381]: audit 2021-03-10T16:13:40.545855+0000 mgr.gibba020.yqfnwy (mgr.34427) 7430 : audit [DBG] from='client.59020 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:13:42.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:42 gibba013 bash[30381]: cluster 2021-03-10T16:13:40.557367+0000 mgr.gibba020.yqfnwy (mgr.34427) 7431 : cluster [DBG] pgmap v4229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:42.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:42 gibba013 bash[30381]: audit 2021-03-10T16:13:40.770829+0000 mgr.gibba020.yqfnwy (mgr.34427) 7432 : audit [DBG] from='client.59026 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:13:42.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:42 gibba020 bash[25448]: audit 2021-03-10T16:13:40.545855+0000 mgr.gibba020.yqfnwy (mgr.34427) 7430 : audit [DBG] from='client.59020 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:13:42.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:42 gibba020 bash[25448]: cluster 2021-03-10T16:13:40.557367+0000 mgr.gibba020.yqfnwy (mgr.34427) 7431 : cluster [DBG] pgmap v4229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:42.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:42 gibba020 bash[25448]: audit 2021-03-10T16:13:40.770829+0000 mgr.gibba020.yqfnwy (mgr.34427) 7432 : audit [DBG] from='client.59026 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:13:44.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:44 gibba013 bash[29418]: cluster 2021-03-10T16:13:42.558665+0000 mgr.gibba020.yqfnwy (mgr.34427) 7433 : cluster [DBG] pgmap v4230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:44.691 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:44 gibba013 bash[29418]: cephadm 2021-03-10T16:13:42.904869+0000 mgr.gibba020.yqfnwy (mgr.34427) 7434 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:13:44.692 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:44 gibba013 bash[30381]: cluster 2021-03-10T16:13:42.558665+0000 mgr.gibba020.yqfnwy (mgr.34427) 7433 : cluster [DBG] pgmap v4230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:44.692 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:44 gibba013 bash[30381]: cephadm 2021-03-10T16:13:42.904869+0000 mgr.gibba020.yqfnwy (mgr.34427) 7434 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:13:44.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:44 gibba020 bash[25448]: cluster 2021-03-10T16:13:42.558665+0000 mgr.gibba020.yqfnwy (mgr.34427) 7433 : cluster [DBG] pgmap v4230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:44.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:44 gibba020 bash[25448]: cephadm 2021-03-10T16:13:42.904869+0000 mgr.gibba020.yqfnwy (mgr.34427) 7434 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:13:46.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:46 gibba013 bash[29418]: cluster 2021-03-10T16:13:44.560234+0000 mgr.gibba020.yqfnwy (mgr.34427) 7435 : cluster [DBG] pgmap v4231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:46.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:46 gibba013 bash[30381]: cluster 2021-03-10T16:13:44.560234+0000 mgr.gibba020.yqfnwy (mgr.34427) 7435 : cluster [DBG] pgmap v4231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:46.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:46 gibba020 bash[25448]: cluster 2021-03-10T16:13:44.560234+0000 mgr.gibba020.yqfnwy (mgr.34427) 7435 : cluster [DBG] pgmap v4231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:48.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:48 gibba013 bash[29418]: cluster 2021-03-10T16:13:46.561921+0000 mgr.gibba020.yqfnwy (mgr.34427) 7436 : cluster [DBG] pgmap v4232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:48.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:48 gibba013 bash[30381]: cluster 2021-03-10T16:13:46.561921+0000 mgr.gibba020.yqfnwy (mgr.34427) 7436 : cluster [DBG] pgmap v4232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:48.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:48 gibba020 bash[25448]: cluster 2021-03-10T16:13:46.561921+0000 mgr.gibba020.yqfnwy (mgr.34427) 7436 : cluster [DBG] pgmap v4232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:50.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:50 gibba013 bash[29418]: cluster 2021-03-10T16:13:48.563314+0000 mgr.gibba020.yqfnwy (mgr.34427) 7437 : cluster [DBG] pgmap v4233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:50.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:50 gibba013 bash[30381]: cluster 2021-03-10T16:13:48.563314+0000 mgr.gibba020.yqfnwy (mgr.34427) 7437 : cluster [DBG] pgmap v4233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:50.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:50 gibba020 bash[25448]: cluster 2021-03-10T16:13:48.563314+0000 mgr.gibba020.yqfnwy (mgr.34427) 7437 : cluster [DBG] pgmap v4233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:52.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:52 gibba013 bash[29418]: cluster 2021-03-10T16:13:50.565091+0000 mgr.gibba020.yqfnwy (mgr.34427) 7438 : cluster [DBG] pgmap v4234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:52.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:52 gibba013 bash[30381]: cluster 2021-03-10T16:13:50.565091+0000 mgr.gibba020.yqfnwy (mgr.34427) 7438 : cluster [DBG] pgmap v4234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:52.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:52 gibba020 bash[25448]: cluster 2021-03-10T16:13:50.565091+0000 mgr.gibba020.yqfnwy (mgr.34427) 7438 : cluster [DBG] pgmap v4234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:54.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:54 gibba013 bash[29418]: cluster 2021-03-10T16:13:52.566689+0000 mgr.gibba020.yqfnwy (mgr.34427) 7439 : cluster [DBG] pgmap v4235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:54.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:54 gibba013 bash[30381]: cluster 2021-03-10T16:13:52.566689+0000 mgr.gibba020.yqfnwy (mgr.34427) 7439 : cluster [DBG] pgmap v4235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:54.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:54 gibba020 bash[25448]: cluster 2021-03-10T16:13:52.566689+0000 mgr.gibba020.yqfnwy (mgr.34427) 7439 : cluster [DBG] pgmap v4235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:56.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:56 gibba013 bash[29418]: cluster 2021-03-10T16:13:54.568412+0000 mgr.gibba020.yqfnwy (mgr.34427) 7440 : cluster [DBG] pgmap v4236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:56.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:56 gibba013 bash[30381]: cluster 2021-03-10T16:13:54.568412+0000 mgr.gibba020.yqfnwy (mgr.34427) 7440 : cluster [DBG] pgmap v4236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:56.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:56 gibba020 bash[25448]: cluster 2021-03-10T16:13:54.568412+0000 mgr.gibba020.yqfnwy (mgr.34427) 7440 : cluster [DBG] pgmap v4236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:58.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:58 gibba013 bash[29418]: cluster 2021-03-10T16:13:56.569922+0000 mgr.gibba020.yqfnwy (mgr.34427) 7441 : cluster [DBG] pgmap v4237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:58.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:58 gibba013 bash[30381]: cluster 2021-03-10T16:13:56.569922+0000 mgr.gibba020.yqfnwy (mgr.34427) 7441 : cluster [DBG] pgmap v4237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:58.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:58 gibba020 bash[25448]: cluster 2021-03-10T16:13:56.569922+0000 mgr.gibba020.yqfnwy (mgr.34427) 7441 : cluster [DBG] pgmap v4237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:13:59.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:13:59 gibba013 bash[29418]: cephadm 2021-03-10T16:13:57.920974+0000 mgr.gibba020.yqfnwy (mgr.34427) 7442 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:13:59.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:13:59 gibba013 bash[30381]: cephadm 2021-03-10T16:13:57.920974+0000 mgr.gibba020.yqfnwy (mgr.34427) 7442 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:13:59.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:13:59 gibba020 bash[25448]: cephadm 2021-03-10T16:13:57.920974+0000 mgr.gibba020.yqfnwy (mgr.34427) 7442 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:14:00.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:00 gibba013 bash[29418]: cluster 2021-03-10T16:13:58.571307+0000 mgr.gibba020.yqfnwy (mgr.34427) 7443 : cluster [DBG] pgmap v4238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:00.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:00 gibba013 bash[30381]: cluster 2021-03-10T16:13:58.571307+0000 mgr.gibba020.yqfnwy (mgr.34427) 7443 : cluster [DBG] pgmap v4238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:00.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:00 gibba020 bash[25448]: cluster 2021-03-10T16:13:58.571307+0000 mgr.gibba020.yqfnwy (mgr.34427) 7443 : cluster [DBG] pgmap v4238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:01.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:01 gibba013 bash[29418]: cluster 2021-03-10T16:14:00.573047+0000 mgr.gibba020.yqfnwy (mgr.34427) 7444 : cluster [DBG] pgmap v4239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:01.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:01 gibba013 bash[30381]: cluster 2021-03-10T16:14:00.573047+0000 mgr.gibba020.yqfnwy (mgr.34427) 7444 : cluster [DBG] pgmap v4239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:01.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:01 gibba020 bash[25448]: cluster 2021-03-10T16:14:00.573047+0000 mgr.gibba020.yqfnwy (mgr.34427) 7444 : cluster [DBG] pgmap v4239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:03.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:03 gibba020 bash[25448]: cluster 2021-03-10T16:14:02.574273+0000 mgr.gibba020.yqfnwy (mgr.34427) 7445 : cluster [DBG] pgmap v4240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:04.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:03 gibba013 bash[29418]: cluster 2021-03-10T16:14:02.574273+0000 mgr.gibba020.yqfnwy (mgr.34427) 7445 : cluster [DBG] pgmap v4240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:04.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:03 gibba013 bash[30381]: cluster 2021-03-10T16:14:02.574273+0000 mgr.gibba020.yqfnwy (mgr.34427) 7445 : cluster [DBG] pgmap v4240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:06.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:05 gibba013 bash[29418]: cluster 2021-03-10T16:14:04.575886+0000 mgr.gibba020.yqfnwy (mgr.34427) 7446 : cluster [DBG] pgmap v4241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:06.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:05 gibba013 bash[30381]: cluster 2021-03-10T16:14:04.575886+0000 mgr.gibba020.yqfnwy (mgr.34427) 7446 : cluster [DBG] pgmap v4241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:06.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:05 gibba020 bash[25448]: cluster 2021-03-10T16:14:04.575886+0000 mgr.gibba020.yqfnwy (mgr.34427) 7446 : cluster [DBG] pgmap v4241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:07.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:06 gibba013 bash[29418]: audit 2021-03-10T16:14:06.656274+0000 mon.a (mon.0) 2800 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:14:07.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:06 gibba013 bash[29418]: audit 2021-03-10T16:14:06.762343+0000 mon.a (mon.0) 2801 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:14:07.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:06 gibba013 bash[30381]: audit 2021-03-10T16:14:06.656274+0000 mon.a (mon.0) 2800 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:14:07.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:06 gibba013 bash[30381]: audit 2021-03-10T16:14:06.762343+0000 mon.a (mon.0) 2801 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:14:07.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:06 gibba020 bash[25448]: audit 2021-03-10T16:14:06.656274+0000 mon.a (mon.0) 2800 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:14:07.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:06 gibba020 bash[25448]: audit 2021-03-10T16:14:06.762343+0000 mon.a (mon.0) 2801 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:14:08.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:07 gibba013 bash[29418]: cluster 2021-03-10T16:14:06.577392+0000 mgr.gibba020.yqfnwy (mgr.34427) 7447 : cluster [DBG] pgmap v4242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:08.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:07 gibba013 bash[29418]: audit 2021-03-10T16:14:06.994404+0000 mon.a (mon.0) 2802 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:14:08.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:07 gibba013 bash[29418]: audit 2021-03-10T16:14:06.995201+0000 mon.a (mon.0) 2803 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:14:08.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:07 gibba013 bash[29418]: audit 2021-03-10T16:14:06.995863+0000 mon.a (mon.0) 2804 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:14:08.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:07 gibba013 bash[29418]: audit 2021-03-10T16:14:06.996520+0000 mon.a (mon.0) 2805 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:14:08.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:07 gibba013 bash[30381]: cluster 2021-03-10T16:14:06.577392+0000 mgr.gibba020.yqfnwy (mgr.34427) 7447 : cluster [DBG] pgmap v4242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:08.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:07 gibba013 bash[30381]: audit 2021-03-10T16:14:06.994404+0000 mon.a (mon.0) 2802 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:14:08.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:07 gibba013 bash[30381]: audit 2021-03-10T16:14:06.995201+0000 mon.a (mon.0) 2803 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:14:08.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:07 gibba013 bash[30381]: audit 2021-03-10T16:14:06.995863+0000 mon.a (mon.0) 2804 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:14:08.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:07 gibba013 bash[30381]: audit 2021-03-10T16:14:06.996520+0000 mon.a (mon.0) 2805 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:14:08.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:07 gibba020 bash[25448]: cluster 2021-03-10T16:14:06.577392+0000 mgr.gibba020.yqfnwy (mgr.34427) 7447 : cluster [DBG] pgmap v4242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:08.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:07 gibba020 bash[25448]: audit 2021-03-10T16:14:06.994404+0000 mon.a (mon.0) 2802 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:14:08.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:07 gibba020 bash[25448]: audit 2021-03-10T16:14:06.995201+0000 mon.a (mon.0) 2803 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:14:08.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:07 gibba020 bash[25448]: audit 2021-03-10T16:14:06.995863+0000 mon.a (mon.0) 2804 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:14:08.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:07 gibba020 bash[25448]: audit 2021-03-10T16:14:06.996520+0000 mon.a (mon.0) 2805 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:14:10.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:09 gibba013 bash[29418]: cluster 2021-03-10T16:14:08.579199+0000 mgr.gibba020.yqfnwy (mgr.34427) 7448 : cluster [DBG] pgmap v4243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:10.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:09 gibba013 bash[30381]: cluster 2021-03-10T16:14:08.579199+0000 mgr.gibba020.yqfnwy (mgr.34427) 7448 : cluster [DBG] pgmap v4243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:10.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:09 gibba020 bash[25448]: cluster 2021-03-10T16:14:08.579199+0000 mgr.gibba020.yqfnwy (mgr.34427) 7448 : cluster [DBG] pgmap v4243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:11.274 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:14:11.501 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:14:11.501 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 4m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:14:11.502 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 2m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:14:11.502 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:14:11.502 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:14:11.502 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:14:11.503 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:14:11.503 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:14:11.503 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:14:11.503 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:14:11.504 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:14:11.504 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:14:11.504 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:14:11.504 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:14:11.504 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:14:11.505 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:14:11.505 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:14:11.505 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:14:11.505 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:14:11.505 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 2m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:14:11.506 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:14:11.753 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:14:11.753 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:14:11.753 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:14:11.753 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:14:11.754 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:14:11.754 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:14:11.754 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:14:11.754 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:14:11.755 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:14:11.755 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:14:11.755 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:14:11.755 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:14:11.755 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:14:11.756 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:14:11.756 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:14:12.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:11 gibba020 bash[25448]: cluster 2021-03-10T16:14:10.580910+0000 mgr.gibba020.yqfnwy (mgr.34427) 7449 : cluster [DBG] pgmap v4244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:12.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:11 gibba020 bash[25448]: audit 2021-03-10T16:14:11.264867+0000 mgr.gibba020.yqfnwy (mgr.34427) 7450 : audit [DBG] from='client.49056 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:14:12.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:11 gibba020 bash[25448]: audit 2021-03-10T16:14:11.753570+0000 mon.a (mon.0) 2806 : audit [DBG] from='client.? 172.21.2.113:0/1871855916' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:12.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:11 gibba013 bash[29418]: cluster 2021-03-10T16:14:10.580910+0000 mgr.gibba020.yqfnwy (mgr.34427) 7449 : cluster [DBG] pgmap v4244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:12.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:11 gibba013 bash[29418]: audit 2021-03-10T16:14:11.264867+0000 mgr.gibba020.yqfnwy (mgr.34427) 7450 : audit [DBG] from='client.49056 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:14:12.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:11 gibba013 bash[29418]: audit 2021-03-10T16:14:11.753570+0000 mon.a (mon.0) 2806 : audit [DBG] from='client.? 172.21.2.113:0/1871855916' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:12.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:11 gibba013 bash[30381]: cluster 2021-03-10T16:14:10.580910+0000 mgr.gibba020.yqfnwy (mgr.34427) 7449 : cluster [DBG] pgmap v4244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:12.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:11 gibba013 bash[30381]: audit 2021-03-10T16:14:11.264867+0000 mgr.gibba020.yqfnwy (mgr.34427) 7450 : audit [DBG] from='client.49056 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:14:12.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:11 gibba013 bash[30381]: audit 2021-03-10T16:14:11.753570+0000 mon.a (mon.0) 2806 : audit [DBG] from='client.? 172.21.2.113:0/1871855916' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:13.167 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:12 gibba020 bash[25448]: audit 2021-03-10T16:14:11.488271+0000 mgr.gibba020.yqfnwy (mgr.34427) 7451 : audit [DBG] from='client.49062 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:14:13.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:12 gibba013 bash[29418]: audit 2021-03-10T16:14:11.488271+0000 mgr.gibba020.yqfnwy (mgr.34427) 7451 : audit [DBG] from='client.49062 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:14:13.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:12 gibba013 bash[30381]: audit 2021-03-10T16:14:11.488271+0000 mgr.gibba020.yqfnwy (mgr.34427) 7451 : audit [DBG] from='client.49062 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:14:14.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:13 gibba020 bash[25448]: cluster 2021-03-10T16:14:12.582576+0000 mgr.gibba020.yqfnwy (mgr.34427) 7452 : cluster [DBG] pgmap v4245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:14.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:13 gibba020 bash[25448]: audit 2021-03-10T16:14:12.937875+0000 mon.a (mon.0) 2807 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:14:14.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:13 gibba020 bash[25448]: cephadm 2021-03-10T16:14:12.939126+0000 mgr.gibba020.yqfnwy (mgr.34427) 7453 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:14:14.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:13 gibba020 bash[25448]: cephadm 2021-03-10T16:14:12.939815+0000 mgr.gibba020.yqfnwy (mgr.34427) 7454 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:14:14.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:13 gibba020 bash[25448]: audit 2021-03-10T16:14:13.155676+0000 mon.a (mon.0) 2808 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:14:14.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:13 gibba020 bash[25448]: cephadm 2021-03-10T16:14:13.157301+0000 mgr.gibba020.yqfnwy (mgr.34427) 7455 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:14:14.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:13 gibba020 bash[25448]: audit 2021-03-10T16:14:13.159199+0000 mon.a (mon.0) 2809 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:14:14.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:13 gibba020 bash[25448]: cephadm 2021-03-10T16:14:13.159216+0000 mgr.gibba020.yqfnwy (mgr.34427) 7456 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:14:14.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:13 gibba020 bash[25448]: cephadm 2021-03-10T16:14:13.160473+0000 mgr.gibba020.yqfnwy (mgr.34427) 7457 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:14:14.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:13 gibba020 bash[25448]: cephadm 2021-03-10T16:14:13.160514+0000 mgr.gibba020.yqfnwy (mgr.34427) 7458 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:14:14.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:13 gibba020 bash[25448]: audit 2021-03-10T16:14:13.160683+0000 mon.a (mon.0) 2810 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:14.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:13 gibba020 bash[25448]: audit 2021-03-10T16:14:13.161975+0000 mon.a (mon.0) 2811 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:14.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:13 gibba020 bash[25448]: cephadm 2021-03-10T16:14:13.162035+0000 mgr.gibba020.yqfnwy (mgr.34427) 7459 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:14:14.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:13 gibba020 bash[25448]: cephadm 2021-03-10T16:14:13.162076+0000 mgr.gibba020.yqfnwy (mgr.34427) 7460 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:14:14.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:13 gibba020 bash[25448]: cephadm 2021-03-10T16:14:13.163318+0000 mgr.gibba020.yqfnwy (mgr.34427) 7461 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:14:14.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:13 gibba020 bash[25448]: audit 2021-03-10T16:14:13.163479+0000 mon.a (mon.0) 2812 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:14.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:13 gibba020 bash[25448]: cephadm 2021-03-10T16:14:13.164578+0000 mgr.gibba020.yqfnwy (mgr.34427) 7462 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:14:14.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:13 gibba020 bash[25448]: cephadm 2021-03-10T16:14:13.164619+0000 mgr.gibba020.yqfnwy (mgr.34427) 7463 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:14:14.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:13 gibba020 bash[25448]: cephadm 2021-03-10T16:14:13.166067+0000 mgr.gibba020.yqfnwy (mgr.34427) 7464 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:14:14.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:13 gibba020 bash[25448]: audit 2021-03-10T16:14:13.166218+0000 mon.a (mon.0) 2813 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:14.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:13 gibba020 bash[25448]: cephadm 2021-03-10T16:14:13.166436+0000 mgr.gibba020.yqfnwy (mgr.34427) 7465 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:14:14.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:13 gibba020 bash[25448]: cephadm 2021-03-10T16:14:13.167589+0000 mgr.gibba020.yqfnwy (mgr.34427) 7466 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:14:14.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:13 gibba020 bash[25448]: cephadm 2021-03-10T16:14:13.167635+0000 mgr.gibba020.yqfnwy (mgr.34427) 7467 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:14:14.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:13 gibba020 bash[25448]: cephadm 2021-03-10T16:14:13.167755+0000 mgr.gibba020.yqfnwy (mgr.34427) 7468 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:14:14.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:13 gibba020 bash[25448]: audit 2021-03-10T16:14:13.167829+0000 mon.a (mon.0) 2814 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:14.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[29418]: cluster 2021-03-10T16:14:12.582576+0000 mgr.gibba020.yqfnwy (mgr.34427) 7452 : cluster [DBG] pgmap v4245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:14.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[29418]: audit 2021-03-10T16:14:12.937875+0000 mon.a (mon.0) 2807 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:14:14.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[29418]: cephadm 2021-03-10T16:14:12.939126+0000 mgr.gibba020.yqfnwy (mgr.34427) 7453 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:14:14.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[29418]: cephadm 2021-03-10T16:14:12.939815+0000 mgr.gibba020.yqfnwy (mgr.34427) 7454 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:14:14.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[29418]: audit 2021-03-10T16:14:13.155676+0000 mon.a (mon.0) 2808 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:14:14.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[29418]: cephadm 2021-03-10T16:14:13.157301+0000 mgr.gibba020.yqfnwy (mgr.34427) 7455 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:14:14.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[29418]: audit 2021-03-10T16:14:13.159199+0000 mon.a (mon.0) 2809 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:14:14.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[29418]: cephadm 2021-03-10T16:14:13.159216+0000 mgr.gibba020.yqfnwy (mgr.34427) 7456 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:14:14.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[29418]: cephadm 2021-03-10T16:14:13.160473+0000 mgr.gibba020.yqfnwy (mgr.34427) 7457 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:14:14.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[29418]: cephadm 2021-03-10T16:14:13.160514+0000 mgr.gibba020.yqfnwy (mgr.34427) 7458 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:14:14.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[29418]: audit 2021-03-10T16:14:13.160683+0000 mon.a (mon.0) 2810 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:14.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[29418]: audit 2021-03-10T16:14:13.161975+0000 mon.a (mon.0) 2811 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:14.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[29418]: cephadm 2021-03-10T16:14:13.162035+0000 mgr.gibba020.yqfnwy (mgr.34427) 7459 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:14:14.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[29418]: cephadm 2021-03-10T16:14:13.162076+0000 mgr.gibba020.yqfnwy (mgr.34427) 7460 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:14:14.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[29418]: cephadm 2021-03-10T16:14:13.163318+0000 mgr.gibba020.yqfnwy (mgr.34427) 7461 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:14:14.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[29418]: audit 2021-03-10T16:14:13.163479+0000 mon.a (mon.0) 2812 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:14.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[29418]: cephadm 2021-03-10T16:14:13.164578+0000 mgr.gibba020.yqfnwy (mgr.34427) 7462 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:14:14.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[29418]: cephadm 2021-03-10T16:14:13.164619+0000 mgr.gibba020.yqfnwy (mgr.34427) 7463 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:14:14.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[29418]: cephadm 2021-03-10T16:14:13.166067+0000 mgr.gibba020.yqfnwy (mgr.34427) 7464 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:14:14.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[29418]: audit 2021-03-10T16:14:13.166218+0000 mon.a (mon.0) 2813 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:14.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[29418]: cephadm 2021-03-10T16:14:13.166436+0000 mgr.gibba020.yqfnwy (mgr.34427) 7465 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:14:14.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[29418]: cephadm 2021-03-10T16:14:13.167589+0000 mgr.gibba020.yqfnwy (mgr.34427) 7466 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:14:14.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[29418]: cephadm 2021-03-10T16:14:13.167635+0000 mgr.gibba020.yqfnwy (mgr.34427) 7467 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:14:14.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[29418]: cephadm 2021-03-10T16:14:13.167755+0000 mgr.gibba020.yqfnwy (mgr.34427) 7468 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:14:14.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[29418]: audit 2021-03-10T16:14:13.167829+0000 mon.a (mon.0) 2814 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:14.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[30381]: cluster 2021-03-10T16:14:12.582576+0000 mgr.gibba020.yqfnwy (mgr.34427) 7452 : cluster [DBG] pgmap v4245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:14.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[30381]: audit 2021-03-10T16:14:12.937875+0000 mon.a (mon.0) 2807 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:14:14.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[30381]: cephadm 2021-03-10T16:14:12.939126+0000 mgr.gibba020.yqfnwy (mgr.34427) 7453 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:14:14.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[30381]: cephadm 2021-03-10T16:14:12.939815+0000 mgr.gibba020.yqfnwy (mgr.34427) 7454 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:14:14.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[30381]: audit 2021-03-10T16:14:13.155676+0000 mon.a (mon.0) 2808 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:14:14.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[30381]: cephadm 2021-03-10T16:14:13.157301+0000 mgr.gibba020.yqfnwy (mgr.34427) 7455 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:14:14.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[30381]: audit 2021-03-10T16:14:13.159199+0000 mon.a (mon.0) 2809 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:14:14.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[30381]: cephadm 2021-03-10T16:14:13.159216+0000 mgr.gibba020.yqfnwy (mgr.34427) 7456 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:14:14.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[30381]: cephadm 2021-03-10T16:14:13.160473+0000 mgr.gibba020.yqfnwy (mgr.34427) 7457 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:14:14.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[30381]: cephadm 2021-03-10T16:14:13.160514+0000 mgr.gibba020.yqfnwy (mgr.34427) 7458 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:14:14.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[30381]: audit 2021-03-10T16:14:13.160683+0000 mon.a (mon.0) 2810 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:14.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[30381]: audit 2021-03-10T16:14:13.161975+0000 mon.a (mon.0) 2811 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:14.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[30381]: cephadm 2021-03-10T16:14:13.162035+0000 mgr.gibba020.yqfnwy (mgr.34427) 7459 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:14:14.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[30381]: cephadm 2021-03-10T16:14:13.162076+0000 mgr.gibba020.yqfnwy (mgr.34427) 7460 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:14:14.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[30381]: cephadm 2021-03-10T16:14:13.163318+0000 mgr.gibba020.yqfnwy (mgr.34427) 7461 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:14:14.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[30381]: audit 2021-03-10T16:14:13.163479+0000 mon.a (mon.0) 2812 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:14.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[30381]: cephadm 2021-03-10T16:14:13.164578+0000 mgr.gibba020.yqfnwy (mgr.34427) 7462 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:14:14.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[30381]: cephadm 2021-03-10T16:14:13.164619+0000 mgr.gibba020.yqfnwy (mgr.34427) 7463 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:14:14.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[30381]: cephadm 2021-03-10T16:14:13.166067+0000 mgr.gibba020.yqfnwy (mgr.34427) 7464 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:14:14.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[30381]: audit 2021-03-10T16:14:13.166218+0000 mon.a (mon.0) 2813 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:14.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[30381]: cephadm 2021-03-10T16:14:13.166436+0000 mgr.gibba020.yqfnwy (mgr.34427) 7465 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:14:14.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[30381]: cephadm 2021-03-10T16:14:13.167589+0000 mgr.gibba020.yqfnwy (mgr.34427) 7466 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:14:14.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[30381]: cephadm 2021-03-10T16:14:13.167635+0000 mgr.gibba020.yqfnwy (mgr.34427) 7467 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:14:14.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[30381]: cephadm 2021-03-10T16:14:13.167755+0000 mgr.gibba020.yqfnwy (mgr.34427) 7468 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:14:14.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:13 gibba013 bash[30381]: audit 2021-03-10T16:14:13.167829+0000 mon.a (mon.0) 2814 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:16.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:15 gibba020 bash[25448]: cluster 2021-03-10T16:14:14.584414+0000 mgr.gibba020.yqfnwy (mgr.34427) 7469 : cluster [DBG] pgmap v4246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:16.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:15 gibba013 bash[29418]: cluster 2021-03-10T16:14:14.584414+0000 mgr.gibba020.yqfnwy (mgr.34427) 7469 : cluster [DBG] pgmap v4246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:16.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:15 gibba013 bash[30381]: cluster 2021-03-10T16:14:14.584414+0000 mgr.gibba020.yqfnwy (mgr.34427) 7469 : cluster [DBG] pgmap v4246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:18.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:17 gibba020 bash[25448]: cluster 2021-03-10T16:14:16.586156+0000 mgr.gibba020.yqfnwy (mgr.34427) 7470 : cluster [DBG] pgmap v4247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:18.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:17 gibba013 bash[29418]: cluster 2021-03-10T16:14:16.586156+0000 mgr.gibba020.yqfnwy (mgr.34427) 7470 : cluster [DBG] pgmap v4247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:18.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:17 gibba013 bash[30381]: cluster 2021-03-10T16:14:16.586156+0000 mgr.gibba020.yqfnwy (mgr.34427) 7470 : cluster [DBG] pgmap v4247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:20.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:19 gibba020 bash[25448]: cluster 2021-03-10T16:14:18.587685+0000 mgr.gibba020.yqfnwy (mgr.34427) 7471 : cluster [DBG] pgmap v4248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:20.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:19 gibba013 bash[29418]: cluster 2021-03-10T16:14:18.587685+0000 mgr.gibba020.yqfnwy (mgr.34427) 7471 : cluster [DBG] pgmap v4248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:20.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:19 gibba013 bash[30381]: cluster 2021-03-10T16:14:18.587685+0000 mgr.gibba020.yqfnwy (mgr.34427) 7471 : cluster [DBG] pgmap v4248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:22.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:21 gibba020 bash[25448]: cluster 2021-03-10T16:14:20.589406+0000 mgr.gibba020.yqfnwy (mgr.34427) 7472 : cluster [DBG] pgmap v4249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:22.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:21 gibba013 bash[29418]: cluster 2021-03-10T16:14:20.589406+0000 mgr.gibba020.yqfnwy (mgr.34427) 7472 : cluster [DBG] pgmap v4249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:22.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:21 gibba013 bash[30381]: cluster 2021-03-10T16:14:20.589406+0000 mgr.gibba020.yqfnwy (mgr.34427) 7472 : cluster [DBG] pgmap v4249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:24.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:23 gibba020 bash[25448]: cluster 2021-03-10T16:14:22.590692+0000 mgr.gibba020.yqfnwy (mgr.34427) 7473 : cluster [DBG] pgmap v4250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:24.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:23 gibba013 bash[29418]: cluster 2021-03-10T16:14:22.590692+0000 mgr.gibba020.yqfnwy (mgr.34427) 7473 : cluster [DBG] pgmap v4250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:24.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:23 gibba013 bash[30381]: cluster 2021-03-10T16:14:22.590692+0000 mgr.gibba020.yqfnwy (mgr.34427) 7473 : cluster [DBG] pgmap v4250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:26.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:25 gibba013 bash[29418]: cluster 2021-03-10T16:14:24.592377+0000 mgr.gibba020.yqfnwy (mgr.34427) 7474 : cluster [DBG] pgmap v4251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:26.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:25 gibba013 bash[30381]: cluster 2021-03-10T16:14:24.592377+0000 mgr.gibba020.yqfnwy (mgr.34427) 7474 : cluster [DBG] pgmap v4251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:26.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:25 gibba020 bash[25448]: cluster 2021-03-10T16:14:24.592377+0000 mgr.gibba020.yqfnwy (mgr.34427) 7474 : cluster [DBG] pgmap v4251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:28.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:27 gibba013 bash[29418]: cluster 2021-03-10T16:14:26.594093+0000 mgr.gibba020.yqfnwy (mgr.34427) 7475 : cluster [DBG] pgmap v4252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:28.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:27 gibba013 bash[30381]: cluster 2021-03-10T16:14:26.594093+0000 mgr.gibba020.yqfnwy (mgr.34427) 7475 : cluster [DBG] pgmap v4252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:28.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:27 gibba020 bash[25448]: cluster 2021-03-10T16:14:26.594093+0000 mgr.gibba020.yqfnwy (mgr.34427) 7475 : cluster [DBG] pgmap v4252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:29.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:28 gibba013 bash[29418]: cephadm 2021-03-10T16:14:28.180734+0000 mgr.gibba020.yqfnwy (mgr.34427) 7476 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:14:29.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:28 gibba013 bash[30381]: cephadm 2021-03-10T16:14:28.180734+0000 mgr.gibba020.yqfnwy (mgr.34427) 7476 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:14:29.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:28 gibba020 bash[25448]: cephadm 2021-03-10T16:14:28.180734+0000 mgr.gibba020.yqfnwy (mgr.34427) 7476 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:14:30.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:29 gibba013 bash[29418]: cluster 2021-03-10T16:14:28.595475+0000 mgr.gibba020.yqfnwy (mgr.34427) 7477 : cluster [DBG] pgmap v4253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:30.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:29 gibba013 bash[30381]: cluster 2021-03-10T16:14:28.595475+0000 mgr.gibba020.yqfnwy (mgr.34427) 7477 : cluster [DBG] pgmap v4253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:30.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:29 gibba020 bash[25448]: cluster 2021-03-10T16:14:28.595475+0000 mgr.gibba020.yqfnwy (mgr.34427) 7477 : cluster [DBG] pgmap v4253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:32.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:31 gibba013 bash[29418]: cluster 2021-03-10T16:14:30.597115+0000 mgr.gibba020.yqfnwy (mgr.34427) 7478 : cluster [DBG] pgmap v4254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:32.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:31 gibba013 bash[30381]: cluster 2021-03-10T16:14:30.597115+0000 mgr.gibba020.yqfnwy (mgr.34427) 7478 : cluster [DBG] pgmap v4254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:32.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:31 gibba020 bash[25448]: cluster 2021-03-10T16:14:30.597115+0000 mgr.gibba020.yqfnwy (mgr.34427) 7478 : cluster [DBG] pgmap v4254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:34.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:33 gibba013 bash[29418]: cluster 2021-03-10T16:14:32.598719+0000 mgr.gibba020.yqfnwy (mgr.34427) 7479 : cluster [DBG] pgmap v4255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:34.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:33 gibba013 bash[30381]: cluster 2021-03-10T16:14:32.598719+0000 mgr.gibba020.yqfnwy (mgr.34427) 7479 : cluster [DBG] pgmap v4255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:34.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:33 gibba020 bash[25448]: cluster 2021-03-10T16:14:32.598719+0000 mgr.gibba020.yqfnwy (mgr.34427) 7479 : cluster [DBG] pgmap v4255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:36.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:36 gibba013 bash[29418]: cluster 2021-03-10T16:14:34.600437+0000 mgr.gibba020.yqfnwy (mgr.34427) 7480 : cluster [DBG] pgmap v4256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:36.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:36 gibba013 bash[30381]: cluster 2021-03-10T16:14:34.600437+0000 mgr.gibba020.yqfnwy (mgr.34427) 7480 : cluster [DBG] pgmap v4256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:36.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:36 gibba020 bash[25448]: cluster 2021-03-10T16:14:34.600437+0000 mgr.gibba020.yqfnwy (mgr.34427) 7480 : cluster [DBG] pgmap v4256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:38.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:38 gibba013 bash[29418]: cluster 2021-03-10T16:14:36.602222+0000 mgr.gibba020.yqfnwy (mgr.34427) 7481 : cluster [DBG] pgmap v4257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:38.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:38 gibba013 bash[30381]: cluster 2021-03-10T16:14:36.602222+0000 mgr.gibba020.yqfnwy (mgr.34427) 7481 : cluster [DBG] pgmap v4257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:38.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:38 gibba020 bash[25448]: cluster 2021-03-10T16:14:36.602222+0000 mgr.gibba020.yqfnwy (mgr.34427) 7481 : cluster [DBG] pgmap v4257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:40.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:40 gibba013 bash[29418]: cluster 2021-03-10T16:14:38.603853+0000 mgr.gibba020.yqfnwy (mgr.34427) 7482 : cluster [DBG] pgmap v4258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:40.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:40 gibba013 bash[30381]: cluster 2021-03-10T16:14:38.603853+0000 mgr.gibba020.yqfnwy (mgr.34427) 7482 : cluster [DBG] pgmap v4258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:40.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:40 gibba020 bash[25448]: cluster 2021-03-10T16:14:38.603853+0000 mgr.gibba020.yqfnwy (mgr.34427) 7482 : cluster [DBG] pgmap v4258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:42.000 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:14:42.230 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:14:42.231 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 4m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:14:42.231 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 3m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:14:42.231 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:14:42.231 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:14:42.232 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:14:42.232 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:14:42.232 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:14:42.232 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:14:42.233 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:14:42.233 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:14:42.233 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:14:42.233 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:14:42.233 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:14:42.234 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:14:42.234 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:14:42.234 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:14:42.234 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:14:42.235 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:14:42.235 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 3m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:14:42.235 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 3m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:14:42.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:42 gibba013 bash[29418]: cluster 2021-03-10T16:14:40.605559+0000 mgr.gibba020.yqfnwy (mgr.34427) 7483 : cluster [DBG] pgmap v4259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:42.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:42 gibba013 bash[30381]: cluster 2021-03-10T16:14:40.605559+0000 mgr.gibba020.yqfnwy (mgr.34427) 7483 : cluster [DBG] pgmap v4259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:42.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:42 gibba020 bash[25448]: cluster 2021-03-10T16:14:40.605559+0000 mgr.gibba020.yqfnwy (mgr.34427) 7483 : cluster [DBG] pgmap v4259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:42.479 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:14:42.479 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:14:42.479 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:14:42.479 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:14:42.480 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:14:42.480 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:14:42.480 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:14:42.480 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:14:42.481 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:14:42.481 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:14:42.481 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:14:42.481 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:14:42.481 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:14:42.482 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:14:42.482 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:14:43.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:43 gibba013 bash[29418]: audit 2021-03-10T16:14:41.991852+0000 mgr.gibba020.yqfnwy (mgr.34427) 7484 : audit [DBG] from='client.49074 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:14:43.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:43 gibba013 bash[29418]: audit 2021-03-10T16:14:42.218294+0000 mgr.gibba020.yqfnwy (mgr.34427) 7485 : audit [DBG] from='client.49080 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:14:43.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:43 gibba013 bash[29418]: audit 2021-03-10T16:14:42.479357+0000 mon.c (mon.1) 119 : audit [DBG] from='client.? 172.21.2.113:0/413560276' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:43.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:43 gibba013 bash[30381]: audit 2021-03-10T16:14:41.991852+0000 mgr.gibba020.yqfnwy (mgr.34427) 7484 : audit [DBG] from='client.49074 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:14:43.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:43 gibba013 bash[30381]: audit 2021-03-10T16:14:42.218294+0000 mgr.gibba020.yqfnwy (mgr.34427) 7485 : audit [DBG] from='client.49080 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:14:43.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:43 gibba013 bash[30381]: audit 2021-03-10T16:14:42.479357+0000 mon.c (mon.1) 119 : audit [DBG] from='client.? 172.21.2.113:0/413560276' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:43.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:43 gibba020 bash[25448]: audit 2021-03-10T16:14:41.991852+0000 mgr.gibba020.yqfnwy (mgr.34427) 7484 : audit [DBG] from='client.49074 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:14:43.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:43 gibba020 bash[25448]: audit 2021-03-10T16:14:42.218294+0000 mgr.gibba020.yqfnwy (mgr.34427) 7485 : audit [DBG] from='client.49080 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:14:43.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:43 gibba020 bash[25448]: audit 2021-03-10T16:14:42.479357+0000 mon.c (mon.1) 119 : audit [DBG] from='client.? 172.21.2.113:0/413560276' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:14:44.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:44 gibba013 bash[29418]: cluster 2021-03-10T16:14:42.606963+0000 mgr.gibba020.yqfnwy (mgr.34427) 7486 : cluster [DBG] pgmap v4260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:44.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:44 gibba013 bash[29418]: cephadm 2021-03-10T16:14:43.183401+0000 mgr.gibba020.yqfnwy (mgr.34427) 7487 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:14:44.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:44 gibba013 bash[30381]: cluster 2021-03-10T16:14:42.606963+0000 mgr.gibba020.yqfnwy (mgr.34427) 7486 : cluster [DBG] pgmap v4260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:44.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:44 gibba013 bash[30381]: cephadm 2021-03-10T16:14:43.183401+0000 mgr.gibba020.yqfnwy (mgr.34427) 7487 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:14:44.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:44 gibba020 bash[25448]: cluster 2021-03-10T16:14:42.606963+0000 mgr.gibba020.yqfnwy (mgr.34427) 7486 : cluster [DBG] pgmap v4260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:44.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:44 gibba020 bash[25448]: cephadm 2021-03-10T16:14:43.183401+0000 mgr.gibba020.yqfnwy (mgr.34427) 7487 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:14:46.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:46 gibba013 bash[29418]: cluster 2021-03-10T16:14:44.608602+0000 mgr.gibba020.yqfnwy (mgr.34427) 7488 : cluster [DBG] pgmap v4261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:46.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:46 gibba013 bash[30381]: cluster 2021-03-10T16:14:44.608602+0000 mgr.gibba020.yqfnwy (mgr.34427) 7488 : cluster [DBG] pgmap v4261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:46.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:46 gibba020 bash[25448]: cluster 2021-03-10T16:14:44.608602+0000 mgr.gibba020.yqfnwy (mgr.34427) 7488 : cluster [DBG] pgmap v4261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:48.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:48 gibba013 bash[29418]: cluster 2021-03-10T16:14:46.610322+0000 mgr.gibba020.yqfnwy (mgr.34427) 7489 : cluster [DBG] pgmap v4262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:48.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:48 gibba013 bash[30381]: cluster 2021-03-10T16:14:46.610322+0000 mgr.gibba020.yqfnwy (mgr.34427) 7489 : cluster [DBG] pgmap v4262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:48.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:48 gibba020 bash[25448]: cluster 2021-03-10T16:14:46.610322+0000 mgr.gibba020.yqfnwy (mgr.34427) 7489 : cluster [DBG] pgmap v4262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:50.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:50 gibba013 bash[29418]: cluster 2021-03-10T16:14:48.611813+0000 mgr.gibba020.yqfnwy (mgr.34427) 7490 : cluster [DBG] pgmap v4263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:50.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:50 gibba013 bash[30381]: cluster 2021-03-10T16:14:48.611813+0000 mgr.gibba020.yqfnwy (mgr.34427) 7490 : cluster [DBG] pgmap v4263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:50.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:50 gibba020 bash[25448]: cluster 2021-03-10T16:14:48.611813+0000 mgr.gibba020.yqfnwy (mgr.34427) 7490 : cluster [DBG] pgmap v4263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:52.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:52 gibba013 bash[29418]: cluster 2021-03-10T16:14:50.613549+0000 mgr.gibba020.yqfnwy (mgr.34427) 7491 : cluster [DBG] pgmap v4264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:52.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:52 gibba013 bash[30381]: cluster 2021-03-10T16:14:50.613549+0000 mgr.gibba020.yqfnwy (mgr.34427) 7491 : cluster [DBG] pgmap v4264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:52.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:52 gibba020 bash[25448]: cluster 2021-03-10T16:14:50.613549+0000 mgr.gibba020.yqfnwy (mgr.34427) 7491 : cluster [DBG] pgmap v4264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:54.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:54 gibba013 bash[29418]: cluster 2021-03-10T16:14:52.615063+0000 mgr.gibba020.yqfnwy (mgr.34427) 7492 : cluster [DBG] pgmap v4265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:54.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:54 gibba013 bash[30381]: cluster 2021-03-10T16:14:52.615063+0000 mgr.gibba020.yqfnwy (mgr.34427) 7492 : cluster [DBG] pgmap v4265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:54.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:54 gibba020 bash[25448]: cluster 2021-03-10T16:14:52.615063+0000 mgr.gibba020.yqfnwy (mgr.34427) 7492 : cluster [DBG] pgmap v4265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:56.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:56 gibba013 bash[29418]: cluster 2021-03-10T16:14:54.616550+0000 mgr.gibba020.yqfnwy (mgr.34427) 7493 : cluster [DBG] pgmap v4266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:56.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:56 gibba013 bash[30381]: cluster 2021-03-10T16:14:54.616550+0000 mgr.gibba020.yqfnwy (mgr.34427) 7493 : cluster [DBG] pgmap v4266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:56.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:56 gibba020 bash[25448]: cluster 2021-03-10T16:14:54.616550+0000 mgr.gibba020.yqfnwy (mgr.34427) 7493 : cluster [DBG] pgmap v4266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:58.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:58 gibba013 bash[29418]: cluster 2021-03-10T16:14:56.618272+0000 mgr.gibba020.yqfnwy (mgr.34427) 7494 : cluster [DBG] pgmap v4267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:58.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:58 gibba013 bash[30381]: cluster 2021-03-10T16:14:56.618272+0000 mgr.gibba020.yqfnwy (mgr.34427) 7494 : cluster [DBG] pgmap v4267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:58.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:58 gibba020 bash[25448]: cluster 2021-03-10T16:14:56.618272+0000 mgr.gibba020.yqfnwy (mgr.34427) 7494 : cluster [DBG] pgmap v4267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:14:59.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:14:59 gibba013 bash[29418]: cephadm 2021-03-10T16:14:58.191316+0000 mgr.gibba020.yqfnwy (mgr.34427) 7495 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:14:59.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:14:59 gibba013 bash[30381]: cephadm 2021-03-10T16:14:58.191316+0000 mgr.gibba020.yqfnwy (mgr.34427) 7495 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:14:59.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:14:59 gibba020 bash[25448]: cephadm 2021-03-10T16:14:58.191316+0000 mgr.gibba020.yqfnwy (mgr.34427) 7495 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:15:00.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:00 gibba013 bash[29418]: cluster 2021-03-10T16:14:58.619666+0000 mgr.gibba020.yqfnwy (mgr.34427) 7496 : cluster [DBG] pgmap v4268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:00.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:00 gibba013 bash[30381]: cluster 2021-03-10T16:14:58.619666+0000 mgr.gibba020.yqfnwy (mgr.34427) 7496 : cluster [DBG] pgmap v4268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:00.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:00 gibba020 bash[25448]: cluster 2021-03-10T16:14:58.619666+0000 mgr.gibba020.yqfnwy (mgr.34427) 7496 : cluster [DBG] pgmap v4268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:02.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:02 gibba020 bash[25448]: cluster 2021-03-10T16:15:00.621527+0000 mgr.gibba020.yqfnwy (mgr.34427) 7497 : cluster [DBG] pgmap v4269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:02.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:02 gibba013 bash[29418]: cluster 2021-03-10T16:15:00.621527+0000 mgr.gibba020.yqfnwy (mgr.34427) 7497 : cluster [DBG] pgmap v4269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:02.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:02 gibba013 bash[30381]: cluster 2021-03-10T16:15:00.621527+0000 mgr.gibba020.yqfnwy (mgr.34427) 7497 : cluster [DBG] pgmap v4269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:04.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:04 gibba020 bash[25448]: cluster 2021-03-10T16:15:02.623126+0000 mgr.gibba020.yqfnwy (mgr.34427) 7498 : cluster [DBG] pgmap v4270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:04.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:04 gibba013 bash[29418]: cluster 2021-03-10T16:15:02.623126+0000 mgr.gibba020.yqfnwy (mgr.34427) 7498 : cluster [DBG] pgmap v4270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:04.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:04 gibba013 bash[30381]: cluster 2021-03-10T16:15:02.623126+0000 mgr.gibba020.yqfnwy (mgr.34427) 7498 : cluster [DBG] pgmap v4270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:06.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:06 gibba020 bash[25448]: cluster 2021-03-10T16:15:04.624754+0000 mgr.gibba020.yqfnwy (mgr.34427) 7499 : cluster [DBG] pgmap v4271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:06.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:06 gibba013 bash[29418]: cluster 2021-03-10T16:15:04.624754+0000 mgr.gibba020.yqfnwy (mgr.34427) 7499 : cluster [DBG] pgmap v4271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:06.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:06 gibba013 bash[30381]: cluster 2021-03-10T16:15:04.624754+0000 mgr.gibba020.yqfnwy (mgr.34427) 7499 : cluster [DBG] pgmap v4271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:07.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:07 gibba020 bash[25448]: audit 2021-03-10T16:15:06.659911+0000 mon.a (mon.0) 2815 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:15:07.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:07 gibba020 bash[25448]: audit 2021-03-10T16:15:06.768461+0000 mon.a (mon.0) 2816 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:15:07.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:07 gibba020 bash[25448]: audit 2021-03-10T16:15:07.003573+0000 mon.a (mon.0) 2817 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:15:07.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:07 gibba020 bash[25448]: audit 2021-03-10T16:15:07.004329+0000 mon.a (mon.0) 2818 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:15:07.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:07 gibba020 bash[25448]: audit 2021-03-10T16:15:07.004995+0000 mon.a (mon.0) 2819 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:15:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:07 gibba020 bash[25448]: audit 2021-03-10T16:15:07.005734+0000 mon.a (mon.0) 2820 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:15:07.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:07 gibba013 bash[29418]: audit 2021-03-10T16:15:06.659911+0000 mon.a (mon.0) 2815 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:15:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:07 gibba013 bash[29418]: audit 2021-03-10T16:15:06.768461+0000 mon.a (mon.0) 2816 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:15:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:07 gibba013 bash[29418]: audit 2021-03-10T16:15:07.003573+0000 mon.a (mon.0) 2817 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:15:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:07 gibba013 bash[29418]: audit 2021-03-10T16:15:07.004329+0000 mon.a (mon.0) 2818 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:15:07.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:07 gibba013 bash[29418]: audit 2021-03-10T16:15:07.004995+0000 mon.a (mon.0) 2819 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:15:07.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:07 gibba013 bash[29418]: audit 2021-03-10T16:15:07.005734+0000 mon.a (mon.0) 2820 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:15:07.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:07 gibba013 bash[30381]: audit 2021-03-10T16:15:06.659911+0000 mon.a (mon.0) 2815 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:15:07.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:07 gibba013 bash[30381]: audit 2021-03-10T16:15:06.768461+0000 mon.a (mon.0) 2816 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:15:07.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:07 gibba013 bash[30381]: audit 2021-03-10T16:15:07.003573+0000 mon.a (mon.0) 2817 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:15:07.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:07 gibba013 bash[30381]: audit 2021-03-10T16:15:07.004329+0000 mon.a (mon.0) 2818 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:15:07.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:07 gibba013 bash[30381]: audit 2021-03-10T16:15:07.004995+0000 mon.a (mon.0) 2819 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:15:07.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:07 gibba013 bash[30381]: audit 2021-03-10T16:15:07.005734+0000 mon.a (mon.0) 2820 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:15:08.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:08 gibba020 bash[25448]: cluster 2021-03-10T16:15:06.626252+0000 mgr.gibba020.yqfnwy (mgr.34427) 7500 : cluster [DBG] pgmap v4272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:08.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:08 gibba013 bash[29418]: cluster 2021-03-10T16:15:06.626252+0000 mgr.gibba020.yqfnwy (mgr.34427) 7500 : cluster [DBG] pgmap v4272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:08.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:08 gibba013 bash[30381]: cluster 2021-03-10T16:15:06.626252+0000 mgr.gibba020.yqfnwy (mgr.34427) 7500 : cluster [DBG] pgmap v4272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:10.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:10 gibba020 bash[25448]: cluster 2021-03-10T16:15:08.627775+0000 mgr.gibba020.yqfnwy (mgr.34427) 7501 : cluster [DBG] pgmap v4273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:10.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:10 gibba013 bash[29418]: cluster 2021-03-10T16:15:08.627775+0000 mgr.gibba020.yqfnwy (mgr.34427) 7501 : cluster [DBG] pgmap v4273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:10.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:10 gibba013 bash[30381]: cluster 2021-03-10T16:15:08.627775+0000 mgr.gibba020.yqfnwy (mgr.34427) 7501 : cluster [DBG] pgmap v4273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:12.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:12 gibba020 bash[25448]: cluster 2021-03-10T16:15:10.629323+0000 mgr.gibba020.yqfnwy (mgr.34427) 7502 : cluster [DBG] pgmap v4274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:12.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:12 gibba013 bash[29418]: cluster 2021-03-10T16:15:10.629323+0000 mgr.gibba020.yqfnwy (mgr.34427) 7502 : cluster [DBG] pgmap v4274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:12.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:12 gibba013 bash[30381]: cluster 2021-03-10T16:15:10.629323+0000 mgr.gibba020.yqfnwy (mgr.34427) 7502 : cluster [DBG] pgmap v4274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:12.721 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:15:12.944 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:15:12.944 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 5m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:15:12.945 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 4m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:15:12.945 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:15:12.945 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:15:12.945 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:15:12.946 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:15:12.946 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:15:12.946 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:15:12.946 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:15:12.947 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:15:12.947 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:15:12.947 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:15:12.947 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:15:12.948 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:15:12.948 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:15:12.948 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:15:12.948 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:15:12.949 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:15:12.949 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 4m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:15:12.949 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 4m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:15:13.195 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:15:13.195 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:15:13.196 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:15:13.196 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:15:13.196 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:15:13.196 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:15:13.196 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:15:13.197 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:15:13.197 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:15:13.197 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:15:13.197 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:15:13.198 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:15:13.198 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:15:13.198 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:15:13.198 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:15:14.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:14 gibba020 bash[25448]: cluster 2021-03-10T16:15:12.630771+0000 mgr.gibba020.yqfnwy (mgr.34427) 7503 : cluster [DBG] pgmap v4275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:14.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:14 gibba020 bash[25448]: audit 2021-03-10T16:15:12.711804+0000 mgr.gibba020.yqfnwy (mgr.34427) 7504 : audit [DBG] from='client.49092 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:15:14.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:14 gibba020 bash[25448]: audit 2021-03-10T16:15:12.935932+0000 mgr.gibba020.yqfnwy (mgr.34427) 7505 : audit [DBG] from='client.59080 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:15:14.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:14 gibba020 bash[25448]: audit 2021-03-10T16:15:13.196033+0000 mon.c (mon.1) 120 : audit [DBG] from='client.? 172.21.2.113:0/2805856381' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:14.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:14 gibba020 bash[25448]: audit 2021-03-10T16:15:13.197895+0000 mon.a (mon.0) 2821 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:15:14.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:14 gibba020 bash[25448]: cephadm 2021-03-10T16:15:13.200501+0000 mgr.gibba020.yqfnwy (mgr.34427) 7506 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:15:14.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:14 gibba020 bash[25448]: cephadm 2021-03-10T16:15:13.202398+0000 mgr.gibba020.yqfnwy (mgr.34427) 7507 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:15:14.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:14 gibba020 bash[25448]: audit 2021-03-10T16:15:13.428796+0000 mon.a (mon.0) 2822 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:15:14.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:14 gibba020 bash[25448]: audit 2021-03-10T16:15:13.432345+0000 mon.a (mon.0) 2823 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:15:14.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:14 gibba020 bash[25448]: audit 2021-03-10T16:15:13.434310+0000 mon.a (mon.0) 2824 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:14.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:14 gibba020 bash[25448]: audit 2021-03-10T16:15:13.435952+0000 mon.a (mon.0) 2825 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:14.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:14 gibba020 bash[25448]: audit 2021-03-10T16:15:13.437387+0000 mon.a (mon.0) 2826 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:14.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:14 gibba020 bash[25448]: audit 2021-03-10T16:15:13.440501+0000 mon.a (mon.0) 2827 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:14.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:14 gibba020 bash[25448]: audit 2021-03-10T16:15:13.442318+0000 mon.a (mon.0) 2828 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:14.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:14 gibba013 bash[29418]: cluster 2021-03-10T16:15:12.630771+0000 mgr.gibba020.yqfnwy (mgr.34427) 7503 : cluster [DBG] pgmap v4275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:14.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:14 gibba013 bash[29418]: audit 2021-03-10T16:15:12.711804+0000 mgr.gibba020.yqfnwy (mgr.34427) 7504 : audit [DBG] from='client.49092 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:15:14.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:14 gibba013 bash[29418]: audit 2021-03-10T16:15:12.935932+0000 mgr.gibba020.yqfnwy (mgr.34427) 7505 : audit [DBG] from='client.59080 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:15:14.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:14 gibba013 bash[29418]: audit 2021-03-10T16:15:13.196033+0000 mon.c (mon.1) 120 : audit [DBG] from='client.? 172.21.2.113:0/2805856381' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:14.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:14 gibba013 bash[29418]: audit 2021-03-10T16:15:13.197895+0000 mon.a (mon.0) 2821 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:15:14.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:14 gibba013 bash[29418]: cephadm 2021-03-10T16:15:13.200501+0000 mgr.gibba020.yqfnwy (mgr.34427) 7506 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:15:14.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:14 gibba013 bash[29418]: cephadm 2021-03-10T16:15:13.202398+0000 mgr.gibba020.yqfnwy (mgr.34427) 7507 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:15:14.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:14 gibba013 bash[29418]: audit 2021-03-10T16:15:13.428796+0000 mon.a (mon.0) 2822 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:15:14.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:14 gibba013 bash[29418]: audit 2021-03-10T16:15:13.432345+0000 mon.a (mon.0) 2823 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:15:14.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:14 gibba013 bash[29418]: audit 2021-03-10T16:15:13.434310+0000 mon.a (mon.0) 2824 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:14.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:14 gibba013 bash[29418]: audit 2021-03-10T16:15:13.435952+0000 mon.a (mon.0) 2825 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:14.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:14 gibba013 bash[29418]: audit 2021-03-10T16:15:13.437387+0000 mon.a (mon.0) 2826 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:14.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:14 gibba013 bash[29418]: audit 2021-03-10T16:15:13.440501+0000 mon.a (mon.0) 2827 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:14.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:14 gibba013 bash[29418]: audit 2021-03-10T16:15:13.442318+0000 mon.a (mon.0) 2828 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:14.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:14 gibba013 bash[30381]: cluster 2021-03-10T16:15:12.630771+0000 mgr.gibba020.yqfnwy (mgr.34427) 7503 : cluster [DBG] pgmap v4275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:14.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:14 gibba013 bash[30381]: audit 2021-03-10T16:15:12.711804+0000 mgr.gibba020.yqfnwy (mgr.34427) 7504 : audit [DBG] from='client.49092 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:15:14.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:14 gibba013 bash[30381]: audit 2021-03-10T16:15:12.935932+0000 mgr.gibba020.yqfnwy (mgr.34427) 7505 : audit [DBG] from='client.59080 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:15:14.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:14 gibba013 bash[30381]: audit 2021-03-10T16:15:13.196033+0000 mon.c (mon.1) 120 : audit [DBG] from='client.? 172.21.2.113:0/2805856381' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:14.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:14 gibba013 bash[30381]: audit 2021-03-10T16:15:13.197895+0000 mon.a (mon.0) 2821 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:15:14.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:14 gibba013 bash[30381]: cephadm 2021-03-10T16:15:13.200501+0000 mgr.gibba020.yqfnwy (mgr.34427) 7506 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:15:14.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:14 gibba013 bash[30381]: cephadm 2021-03-10T16:15:13.202398+0000 mgr.gibba020.yqfnwy (mgr.34427) 7507 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:15:14.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:14 gibba013 bash[30381]: audit 2021-03-10T16:15:13.428796+0000 mon.a (mon.0) 2822 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:15:14.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:14 gibba013 bash[30381]: audit 2021-03-10T16:15:13.432345+0000 mon.a (mon.0) 2823 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:15:14.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:14 gibba013 bash[30381]: audit 2021-03-10T16:15:13.434310+0000 mon.a (mon.0) 2824 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:14.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:14 gibba013 bash[30381]: audit 2021-03-10T16:15:13.435952+0000 mon.a (mon.0) 2825 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:14.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:14 gibba013 bash[30381]: audit 2021-03-10T16:15:13.437387+0000 mon.a (mon.0) 2826 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:14.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:14 gibba013 bash[30381]: audit 2021-03-10T16:15:13.440501+0000 mon.a (mon.0) 2827 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:14.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:14 gibba013 bash[30381]: audit 2021-03-10T16:15:13.442318+0000 mon.a (mon.0) 2828 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:15.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:15 gibba020 bash[25448]: cephadm 2021-03-10T16:15:13.430329+0000 mgr.gibba020.yqfnwy (mgr.34427) 7508 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:15:15.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:15 gibba020 bash[25448]: cephadm 2021-03-10T16:15:13.432802+0000 mgr.gibba020.yqfnwy (mgr.34427) 7509 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:15:15.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:15 gibba020 bash[25448]: cephadm 2021-03-10T16:15:13.434416+0000 mgr.gibba020.yqfnwy (mgr.34427) 7510 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:15:15.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:15 gibba020 bash[25448]: cephadm 2021-03-10T16:15:13.434451+0000 mgr.gibba020.yqfnwy (mgr.34427) 7511 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:15:15.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:15 gibba020 bash[25448]: cephadm 2021-03-10T16:15:13.435946+0000 mgr.gibba020.yqfnwy (mgr.34427) 7512 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:15:15.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:15 gibba020 bash[25448]: cephadm 2021-03-10T16:15:13.436028+0000 mgr.gibba020.yqfnwy (mgr.34427) 7513 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:15:15.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:15 gibba020 bash[25448]: cephadm 2021-03-10T16:15:13.437625+0000 mgr.gibba020.yqfnwy (mgr.34427) 7514 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:15:15.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:15 gibba020 bash[25448]: cephadm 2021-03-10T16:15:13.438953+0000 mgr.gibba020.yqfnwy (mgr.34427) 7515 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:15:15.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:15 gibba020 bash[25448]: cephadm 2021-03-10T16:15:13.438992+0000 mgr.gibba020.yqfnwy (mgr.34427) 7516 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:15:15.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:15 gibba020 bash[25448]: cephadm 2021-03-10T16:15:13.440658+0000 mgr.gibba020.yqfnwy (mgr.34427) 7517 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:15:15.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:15 gibba020 bash[25448]: cephadm 2021-03-10T16:15:13.441087+0000 mgr.gibba020.yqfnwy (mgr.34427) 7518 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:15:15.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:15 gibba020 bash[25448]: cephadm 2021-03-10T16:15:13.442296+0000 mgr.gibba020.yqfnwy (mgr.34427) 7519 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:15:15.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:15 gibba020 bash[25448]: cephadm 2021-03-10T16:15:13.442340+0000 mgr.gibba020.yqfnwy (mgr.34427) 7520 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:15:15.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:15 gibba020 bash[25448]: cephadm 2021-03-10T16:15:13.442463+0000 mgr.gibba020.yqfnwy (mgr.34427) 7521 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:15:15.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:15 gibba013 bash[29418]: cephadm 2021-03-10T16:15:13.430329+0000 mgr.gibba020.yqfnwy (mgr.34427) 7508 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:15:15.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:15 gibba013 bash[29418]: cephadm 2021-03-10T16:15:13.432802+0000 mgr.gibba020.yqfnwy (mgr.34427) 7509 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:15:15.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:15 gibba013 bash[29418]: cephadm 2021-03-10T16:15:13.434416+0000 mgr.gibba020.yqfnwy (mgr.34427) 7510 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:15:15.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:15 gibba013 bash[29418]: cephadm 2021-03-10T16:15:13.434451+0000 mgr.gibba020.yqfnwy (mgr.34427) 7511 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:15:15.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:15 gibba013 bash[29418]: cephadm 2021-03-10T16:15:13.435946+0000 mgr.gibba020.yqfnwy (mgr.34427) 7512 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:15:15.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:15 gibba013 bash[29418]: cephadm 2021-03-10T16:15:13.436028+0000 mgr.gibba020.yqfnwy (mgr.34427) 7513 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:15:15.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:15 gibba013 bash[29418]: cephadm 2021-03-10T16:15:13.437625+0000 mgr.gibba020.yqfnwy (mgr.34427) 7514 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:15:15.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:15 gibba013 bash[29418]: cephadm 2021-03-10T16:15:13.438953+0000 mgr.gibba020.yqfnwy (mgr.34427) 7515 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:15:15.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:15 gibba013 bash[29418]: cephadm 2021-03-10T16:15:13.438992+0000 mgr.gibba020.yqfnwy (mgr.34427) 7516 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:15:15.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:15 gibba013 bash[29418]: cephadm 2021-03-10T16:15:13.440658+0000 mgr.gibba020.yqfnwy (mgr.34427) 7517 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:15:15.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:15 gibba013 bash[29418]: cephadm 2021-03-10T16:15:13.441087+0000 mgr.gibba020.yqfnwy (mgr.34427) 7518 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:15:15.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:15 gibba013 bash[29418]: cephadm 2021-03-10T16:15:13.442296+0000 mgr.gibba020.yqfnwy (mgr.34427) 7519 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:15:15.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:15 gibba013 bash[29418]: cephadm 2021-03-10T16:15:13.442340+0000 mgr.gibba020.yqfnwy (mgr.34427) 7520 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:15:15.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:15 gibba013 bash[29418]: cephadm 2021-03-10T16:15:13.442463+0000 mgr.gibba020.yqfnwy (mgr.34427) 7521 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:15:15.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:15 gibba013 bash[30381]: cephadm 2021-03-10T16:15:13.430329+0000 mgr.gibba020.yqfnwy (mgr.34427) 7508 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:15:15.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:15 gibba013 bash[30381]: cephadm 2021-03-10T16:15:13.432802+0000 mgr.gibba020.yqfnwy (mgr.34427) 7509 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:15:15.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:15 gibba013 bash[30381]: cephadm 2021-03-10T16:15:13.434416+0000 mgr.gibba020.yqfnwy (mgr.34427) 7510 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:15:15.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:15 gibba013 bash[30381]: cephadm 2021-03-10T16:15:13.434451+0000 mgr.gibba020.yqfnwy (mgr.34427) 7511 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:15:15.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:15 gibba013 bash[30381]: cephadm 2021-03-10T16:15:13.435946+0000 mgr.gibba020.yqfnwy (mgr.34427) 7512 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:15:15.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:15 gibba013 bash[30381]: cephadm 2021-03-10T16:15:13.436028+0000 mgr.gibba020.yqfnwy (mgr.34427) 7513 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:15:15.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:15 gibba013 bash[30381]: cephadm 2021-03-10T16:15:13.437625+0000 mgr.gibba020.yqfnwy (mgr.34427) 7514 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:15:15.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:15 gibba013 bash[30381]: cephadm 2021-03-10T16:15:13.438953+0000 mgr.gibba020.yqfnwy (mgr.34427) 7515 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:15:15.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:15 gibba013 bash[30381]: cephadm 2021-03-10T16:15:13.438992+0000 mgr.gibba020.yqfnwy (mgr.34427) 7516 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:15:15.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:15 gibba013 bash[30381]: cephadm 2021-03-10T16:15:13.440658+0000 mgr.gibba020.yqfnwy (mgr.34427) 7517 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:15:15.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:15 gibba013 bash[30381]: cephadm 2021-03-10T16:15:13.441087+0000 mgr.gibba020.yqfnwy (mgr.34427) 7518 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:15:15.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:15 gibba013 bash[30381]: cephadm 2021-03-10T16:15:13.442296+0000 mgr.gibba020.yqfnwy (mgr.34427) 7519 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:15:15.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:15 gibba013 bash[30381]: cephadm 2021-03-10T16:15:13.442340+0000 mgr.gibba020.yqfnwy (mgr.34427) 7520 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:15:15.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:15 gibba013 bash[30381]: cephadm 2021-03-10T16:15:13.442463+0000 mgr.gibba020.yqfnwy (mgr.34427) 7521 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:15:16.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:16 gibba013 bash[29418]: cluster 2021-03-10T16:15:14.632405+0000 mgr.gibba020.yqfnwy (mgr.34427) 7522 : cluster [DBG] pgmap v4276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:16.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:16 gibba013 bash[30381]: cluster 2021-03-10T16:15:14.632405+0000 mgr.gibba020.yqfnwy (mgr.34427) 7522 : cluster [DBG] pgmap v4276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:16.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:16 gibba020 bash[25448]: cluster 2021-03-10T16:15:14.632405+0000 mgr.gibba020.yqfnwy (mgr.34427) 7522 : cluster [DBG] pgmap v4276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:18.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:18 gibba013 bash[29418]: cluster 2021-03-10T16:15:16.633155+0000 mgr.gibba020.yqfnwy (mgr.34427) 7523 : cluster [DBG] pgmap v4277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:18.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:18 gibba013 bash[30381]: cluster 2021-03-10T16:15:16.633155+0000 mgr.gibba020.yqfnwy (mgr.34427) 7523 : cluster [DBG] pgmap v4277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:18.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:18 gibba020 bash[25448]: cluster 2021-03-10T16:15:16.633155+0000 mgr.gibba020.yqfnwy (mgr.34427) 7523 : cluster [DBG] pgmap v4277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:20.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:20 gibba013 bash[29418]: cluster 2021-03-10T16:15:18.634684+0000 mgr.gibba020.yqfnwy (mgr.34427) 7524 : cluster [DBG] pgmap v4278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:20.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:20 gibba013 bash[30381]: cluster 2021-03-10T16:15:18.634684+0000 mgr.gibba020.yqfnwy (mgr.34427) 7524 : cluster [DBG] pgmap v4278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:20.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:20 gibba020 bash[25448]: cluster 2021-03-10T16:15:18.634684+0000 mgr.gibba020.yqfnwy (mgr.34427) 7524 : cluster [DBG] pgmap v4278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:22.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:22 gibba013 bash[29418]: cluster 2021-03-10T16:15:20.636290+0000 mgr.gibba020.yqfnwy (mgr.34427) 7525 : cluster [DBG] pgmap v4279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:22.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:22 gibba013 bash[30381]: cluster 2021-03-10T16:15:20.636290+0000 mgr.gibba020.yqfnwy (mgr.34427) 7525 : cluster [DBG] pgmap v4279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:22.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:22 gibba020 bash[25448]: cluster 2021-03-10T16:15:20.636290+0000 mgr.gibba020.yqfnwy (mgr.34427) 7525 : cluster [DBG] pgmap v4279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:24.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:24 gibba013 bash[29418]: cluster 2021-03-10T16:15:22.637579+0000 mgr.gibba020.yqfnwy (mgr.34427) 7526 : cluster [DBG] pgmap v4280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:24.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:24 gibba013 bash[30381]: cluster 2021-03-10T16:15:22.637579+0000 mgr.gibba020.yqfnwy (mgr.34427) 7526 : cluster [DBG] pgmap v4280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:24.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:24 gibba020 bash[25448]: cluster 2021-03-10T16:15:22.637579+0000 mgr.gibba020.yqfnwy (mgr.34427) 7526 : cluster [DBG] pgmap v4280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:26.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:26 gibba013 bash[29418]: cluster 2021-03-10T16:15:24.639169+0000 mgr.gibba020.yqfnwy (mgr.34427) 7527 : cluster [DBG] pgmap v4281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:26.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:26 gibba013 bash[30381]: cluster 2021-03-10T16:15:24.639169+0000 mgr.gibba020.yqfnwy (mgr.34427) 7527 : cluster [DBG] pgmap v4281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:26.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:26 gibba020 bash[25448]: cluster 2021-03-10T16:15:24.639169+0000 mgr.gibba020.yqfnwy (mgr.34427) 7527 : cluster [DBG] pgmap v4281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:28.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:28 gibba013 bash[29418]: cluster 2021-03-10T16:15:26.640819+0000 mgr.gibba020.yqfnwy (mgr.34427) 7528 : cluster [DBG] pgmap v4282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:28.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:28 gibba013 bash[30381]: cluster 2021-03-10T16:15:26.640819+0000 mgr.gibba020.yqfnwy (mgr.34427) 7528 : cluster [DBG] pgmap v4282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:28.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:28 gibba020 bash[25448]: cluster 2021-03-10T16:15:26.640819+0000 mgr.gibba020.yqfnwy (mgr.34427) 7528 : cluster [DBG] pgmap v4282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:30.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:30 gibba013 bash[29418]: cephadm 2021-03-10T16:15:28.458352+0000 mgr.gibba020.yqfnwy (mgr.34427) 7529 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:15:30.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:30 gibba013 bash[29418]: cluster 2021-03-10T16:15:28.642318+0000 mgr.gibba020.yqfnwy (mgr.34427) 7530 : cluster [DBG] pgmap v4283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:30.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:30 gibba013 bash[30381]: cephadm 2021-03-10T16:15:28.458352+0000 mgr.gibba020.yqfnwy (mgr.34427) 7529 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:15:30.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:30 gibba013 bash[30381]: cluster 2021-03-10T16:15:28.642318+0000 mgr.gibba020.yqfnwy (mgr.34427) 7530 : cluster [DBG] pgmap v4283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:30.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:30 gibba020 bash[25448]: cephadm 2021-03-10T16:15:28.458352+0000 mgr.gibba020.yqfnwy (mgr.34427) 7529 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:15:30.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:30 gibba020 bash[25448]: cluster 2021-03-10T16:15:28.642318+0000 mgr.gibba020.yqfnwy (mgr.34427) 7530 : cluster [DBG] pgmap v4283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:32.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:32 gibba013 bash[29418]: cluster 2021-03-10T16:15:30.643872+0000 mgr.gibba020.yqfnwy (mgr.34427) 7531 : cluster [DBG] pgmap v4284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:32.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:32 gibba013 bash[30381]: cluster 2021-03-10T16:15:30.643872+0000 mgr.gibba020.yqfnwy (mgr.34427) 7531 : cluster [DBG] pgmap v4284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:32.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:32 gibba020 bash[25448]: cluster 2021-03-10T16:15:30.643872+0000 mgr.gibba020.yqfnwy (mgr.34427) 7531 : cluster [DBG] pgmap v4284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:34.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:34 gibba013 bash[29418]: cluster 2021-03-10T16:15:32.645432+0000 mgr.gibba020.yqfnwy (mgr.34427) 7532 : cluster [DBG] pgmap v4285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:34.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:34 gibba013 bash[30381]: cluster 2021-03-10T16:15:32.645432+0000 mgr.gibba020.yqfnwy (mgr.34427) 7532 : cluster [DBG] pgmap v4285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:34.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:34 gibba020 bash[25448]: cluster 2021-03-10T16:15:32.645432+0000 mgr.gibba020.yqfnwy (mgr.34427) 7532 : cluster [DBG] pgmap v4285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:36.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:36 gibba013 bash[29418]: cluster 2021-03-10T16:15:34.647053+0000 mgr.gibba020.yqfnwy (mgr.34427) 7533 : cluster [DBG] pgmap v4286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:36.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:36 gibba013 bash[30381]: cluster 2021-03-10T16:15:34.647053+0000 mgr.gibba020.yqfnwy (mgr.34427) 7533 : cluster [DBG] pgmap v4286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:36.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:36 gibba020 bash[25448]: cluster 2021-03-10T16:15:34.647053+0000 mgr.gibba020.yqfnwy (mgr.34427) 7533 : cluster [DBG] pgmap v4286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:38.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:38 gibba013 bash[29418]: cluster 2021-03-10T16:15:36.648582+0000 mgr.gibba020.yqfnwy (mgr.34427) 7534 : cluster [DBG] pgmap v4287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:38.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:38 gibba013 bash[30381]: cluster 2021-03-10T16:15:36.648582+0000 mgr.gibba020.yqfnwy (mgr.34427) 7534 : cluster [DBG] pgmap v4287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:38.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:38 gibba020 bash[25448]: cluster 2021-03-10T16:15:36.648582+0000 mgr.gibba020.yqfnwy (mgr.34427) 7534 : cluster [DBG] pgmap v4287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:40.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:40 gibba013 bash[29418]: cluster 2021-03-10T16:15:38.649977+0000 mgr.gibba020.yqfnwy (mgr.34427) 7535 : cluster [DBG] pgmap v4288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:40.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:40 gibba013 bash[30381]: cluster 2021-03-10T16:15:38.649977+0000 mgr.gibba020.yqfnwy (mgr.34427) 7535 : cluster [DBG] pgmap v4288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:40.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:40 gibba020 bash[25448]: cluster 2021-03-10T16:15:38.649977+0000 mgr.gibba020.yqfnwy (mgr.34427) 7535 : cluster [DBG] pgmap v4288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:42.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:42 gibba013 bash[29418]: cluster 2021-03-10T16:15:40.651548+0000 mgr.gibba020.yqfnwy (mgr.34427) 7536 : cluster [DBG] pgmap v4289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:42.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:42 gibba013 bash[30381]: cluster 2021-03-10T16:15:40.651548+0000 mgr.gibba020.yqfnwy (mgr.34427) 7536 : cluster [DBG] pgmap v4289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:42.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:42 gibba020 bash[25448]: cluster 2021-03-10T16:15:40.651548+0000 mgr.gibba020.yqfnwy (mgr.34427) 7536 : cluster [DBG] pgmap v4289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:43.436 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:15:43.665 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:15:43.665 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 5m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:15:43.666 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 4m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:15:43.666 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:15:43.666 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:15:43.667 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:15:43.667 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:15:43.667 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:15:43.667 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:15:43.667 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:15:43.668 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:15:43.668 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:15:43.668 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:15:43.668 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:15:43.669 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:15:43.669 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:15:43.669 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:15:43.669 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:15:43.670 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:15:43.670 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 4m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:15:43.670 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 4m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:15:43.912 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:15:43.913 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:15:43.913 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:15:43.913 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:15:43.914 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:15:43.914 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:15:43.914 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:15:43.914 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:15:43.915 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:15:43.915 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:15:43.915 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:15:43.915 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:15:43.916 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:15:43.916 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:15:43.916 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:15:44.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:44 gibba013 bash[29418]: cluster 2021-03-10T16:15:42.653068+0000 mgr.gibba020.yqfnwy (mgr.34427) 7537 : cluster [DBG] pgmap v4290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:44.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:44 gibba013 bash[29418]: audit 2021-03-10T16:15:43.913535+0000 mon.a (mon.0) 2829 : audit [DBG] from='client.? 172.21.2.113:0/3245607845' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:44.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:44 gibba013 bash[30381]: cluster 2021-03-10T16:15:42.653068+0000 mgr.gibba020.yqfnwy (mgr.34427) 7537 : cluster [DBG] pgmap v4290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:44.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:44 gibba013 bash[30381]: audit 2021-03-10T16:15:43.913535+0000 mon.a (mon.0) 2829 : audit [DBG] from='client.? 172.21.2.113:0/3245607845' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:44.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:44 gibba020 bash[25448]: cluster 2021-03-10T16:15:42.653068+0000 mgr.gibba020.yqfnwy (mgr.34427) 7537 : cluster [DBG] pgmap v4290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:44.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:44 gibba020 bash[25448]: audit 2021-03-10T16:15:43.913535+0000 mon.a (mon.0) 2829 : audit [DBG] from='client.? 172.21.2.113:0/3245607845' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:15:45.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:45 gibba013 bash[29418]: audit 2021-03-10T16:15:43.427113+0000 mgr.gibba020.yqfnwy (mgr.34427) 7538 : audit [DBG] from='client.49110 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:15:45.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:45 gibba013 bash[29418]: cephadm 2021-03-10T16:15:43.474144+0000 mgr.gibba020.yqfnwy (mgr.34427) 7539 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:15:45.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:45 gibba013 bash[29418]: audit 2021-03-10T16:15:43.652394+0000 mgr.gibba020.yqfnwy (mgr.34427) 7540 : audit [DBG] from='client.59098 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:15:45.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:45 gibba013 bash[30381]: audit 2021-03-10T16:15:43.427113+0000 mgr.gibba020.yqfnwy (mgr.34427) 7538 : audit [DBG] from='client.49110 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:15:45.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:45 gibba013 bash[30381]: cephadm 2021-03-10T16:15:43.474144+0000 mgr.gibba020.yqfnwy (mgr.34427) 7539 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:15:45.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:45 gibba013 bash[30381]: audit 2021-03-10T16:15:43.652394+0000 mgr.gibba020.yqfnwy (mgr.34427) 7540 : audit [DBG] from='client.59098 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:15:45.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:45 gibba020 bash[25448]: audit 2021-03-10T16:15:43.427113+0000 mgr.gibba020.yqfnwy (mgr.34427) 7538 : audit [DBG] from='client.49110 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:15:45.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:45 gibba020 bash[25448]: cephadm 2021-03-10T16:15:43.474144+0000 mgr.gibba020.yqfnwy (mgr.34427) 7539 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:15:45.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:45 gibba020 bash[25448]: audit 2021-03-10T16:15:43.652394+0000 mgr.gibba020.yqfnwy (mgr.34427) 7540 : audit [DBG] from='client.59098 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:15:46.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:46 gibba013 bash[29418]: cluster 2021-03-10T16:15:44.654435+0000 mgr.gibba020.yqfnwy (mgr.34427) 7541 : cluster [DBG] pgmap v4291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:46.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:46 gibba013 bash[30381]: cluster 2021-03-10T16:15:44.654435+0000 mgr.gibba020.yqfnwy (mgr.34427) 7541 : cluster [DBG] pgmap v4291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:46.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:46 gibba020 bash[25448]: cluster 2021-03-10T16:15:44.654435+0000 mgr.gibba020.yqfnwy (mgr.34427) 7541 : cluster [DBG] pgmap v4291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:48.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:48 gibba013 bash[29418]: cluster 2021-03-10T16:15:46.655255+0000 mgr.gibba020.yqfnwy (mgr.34427) 7542 : cluster [DBG] pgmap v4292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:48.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:48 gibba013 bash[30381]: cluster 2021-03-10T16:15:46.655255+0000 mgr.gibba020.yqfnwy (mgr.34427) 7542 : cluster [DBG] pgmap v4292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:48.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:48 gibba020 bash[25448]: cluster 2021-03-10T16:15:46.655255+0000 mgr.gibba020.yqfnwy (mgr.34427) 7542 : cluster [DBG] pgmap v4292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:50.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:50 gibba013 bash[29418]: cluster 2021-03-10T16:15:48.656597+0000 mgr.gibba020.yqfnwy (mgr.34427) 7543 : cluster [DBG] pgmap v4293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:50.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:50 gibba013 bash[30381]: cluster 2021-03-10T16:15:48.656597+0000 mgr.gibba020.yqfnwy (mgr.34427) 7543 : cluster [DBG] pgmap v4293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:50.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:50 gibba020 bash[25448]: cluster 2021-03-10T16:15:48.656597+0000 mgr.gibba020.yqfnwy (mgr.34427) 7543 : cluster [DBG] pgmap v4293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:52.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:52 gibba013 bash[29418]: cluster 2021-03-10T16:15:50.658138+0000 mgr.gibba020.yqfnwy (mgr.34427) 7544 : cluster [DBG] pgmap v4294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:52.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:52 gibba013 bash[30381]: cluster 2021-03-10T16:15:50.658138+0000 mgr.gibba020.yqfnwy (mgr.34427) 7544 : cluster [DBG] pgmap v4294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:52.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:52 gibba020 bash[25448]: cluster 2021-03-10T16:15:50.658138+0000 mgr.gibba020.yqfnwy (mgr.34427) 7544 : cluster [DBG] pgmap v4294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:53.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:53 gibba020 bash[25448]: cluster 2021-03-10T16:15:52.659545+0000 mgr.gibba020.yqfnwy (mgr.34427) 7545 : cluster [DBG] pgmap v4295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:53.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:53 gibba013 bash[29418]: cluster 2021-03-10T16:15:52.659545+0000 mgr.gibba020.yqfnwy (mgr.34427) 7545 : cluster [DBG] pgmap v4295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:53.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:53 gibba013 bash[30381]: cluster 2021-03-10T16:15:52.659545+0000 mgr.gibba020.yqfnwy (mgr.34427) 7545 : cluster [DBG] pgmap v4295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:56.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:55 gibba020 bash[25448]: cluster 2021-03-10T16:15:54.661034+0000 mgr.gibba020.yqfnwy (mgr.34427) 7546 : cluster [DBG] pgmap v4296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:56.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:55 gibba013 bash[29418]: cluster 2021-03-10T16:15:54.661034+0000 mgr.gibba020.yqfnwy (mgr.34427) 7546 : cluster [DBG] pgmap v4296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:56.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:55 gibba013 bash[30381]: cluster 2021-03-10T16:15:54.661034+0000 mgr.gibba020.yqfnwy (mgr.34427) 7546 : cluster [DBG] pgmap v4296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:58.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:57 gibba020 bash[25448]: cluster 2021-03-10T16:15:56.661854+0000 mgr.gibba020.yqfnwy (mgr.34427) 7547 : cluster [DBG] pgmap v4297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:58.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:57 gibba013 bash[29418]: cluster 2021-03-10T16:15:56.661854+0000 mgr.gibba020.yqfnwy (mgr.34427) 7547 : cluster [DBG] pgmap v4297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:15:58.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:57 gibba013 bash[30381]: cluster 2021-03-10T16:15:56.661854+0000 mgr.gibba020.yqfnwy (mgr.34427) 7547 : cluster [DBG] pgmap v4297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:00.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:59 gibba020 bash[25448]: cephadm 2021-03-10T16:15:58.488678+0000 mgr.gibba020.yqfnwy (mgr.34427) 7548 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:16:00.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:15:59 gibba020 bash[25448]: cluster 2021-03-10T16:15:58.663226+0000 mgr.gibba020.yqfnwy (mgr.34427) 7549 : cluster [DBG] pgmap v4298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:00.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:59 gibba013 bash[29418]: cephadm 2021-03-10T16:15:58.488678+0000 mgr.gibba020.yqfnwy (mgr.34427) 7548 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:16:00.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:15:59 gibba013 bash[29418]: cluster 2021-03-10T16:15:58.663226+0000 mgr.gibba020.yqfnwy (mgr.34427) 7549 : cluster [DBG] pgmap v4298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:00.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:59 gibba013 bash[30381]: cephadm 2021-03-10T16:15:58.488678+0000 mgr.gibba020.yqfnwy (mgr.34427) 7548 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:16:00.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:15:59 gibba013 bash[30381]: cluster 2021-03-10T16:15:58.663226+0000 mgr.gibba020.yqfnwy (mgr.34427) 7549 : cluster [DBG] pgmap v4298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:02.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:01 gibba020 bash[25448]: cluster 2021-03-10T16:16:00.664817+0000 mgr.gibba020.yqfnwy (mgr.34427) 7550 : cluster [DBG] pgmap v4299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:02.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:01 gibba013 bash[29418]: cluster 2021-03-10T16:16:00.664817+0000 mgr.gibba020.yqfnwy (mgr.34427) 7550 : cluster [DBG] pgmap v4299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:02.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:01 gibba013 bash[30381]: cluster 2021-03-10T16:16:00.664817+0000 mgr.gibba020.yqfnwy (mgr.34427) 7550 : cluster [DBG] pgmap v4299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:04.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:03 gibba020 bash[25448]: cluster 2021-03-10T16:16:02.666195+0000 mgr.gibba020.yqfnwy (mgr.34427) 7551 : cluster [DBG] pgmap v4300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:04.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:03 gibba013 bash[29418]: cluster 2021-03-10T16:16:02.666195+0000 mgr.gibba020.yqfnwy (mgr.34427) 7551 : cluster [DBG] pgmap v4300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:04.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:03 gibba013 bash[30381]: cluster 2021-03-10T16:16:02.666195+0000 mgr.gibba020.yqfnwy (mgr.34427) 7551 : cluster [DBG] pgmap v4300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:06.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:05 gibba020 bash[25448]: cluster 2021-03-10T16:16:04.667769+0000 mgr.gibba020.yqfnwy (mgr.34427) 7552 : cluster [DBG] pgmap v4301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:06.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:05 gibba013 bash[29418]: cluster 2021-03-10T16:16:04.667769+0000 mgr.gibba020.yqfnwy (mgr.34427) 7552 : cluster [DBG] pgmap v4301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:06.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:05 gibba013 bash[30381]: cluster 2021-03-10T16:16:04.667769+0000 mgr.gibba020.yqfnwy (mgr.34427) 7552 : cluster [DBG] pgmap v4301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:07.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:06 gibba013 bash[29418]: audit 2021-03-10T16:16:06.662576+0000 mon.a (mon.0) 2830 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:16:07.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:06 gibba013 bash[29418]: audit 2021-03-10T16:16:06.774603+0000 mon.a (mon.0) 2831 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:16:07.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:06 gibba013 bash[30381]: audit 2021-03-10T16:16:06.662576+0000 mon.a (mon.0) 2830 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:16:07.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:06 gibba013 bash[30381]: audit 2021-03-10T16:16:06.774603+0000 mon.a (mon.0) 2831 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:16:07.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:06 gibba020 bash[25448]: audit 2021-03-10T16:16:06.662576+0000 mon.a (mon.0) 2830 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:16:07.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:06 gibba020 bash[25448]: audit 2021-03-10T16:16:06.774603+0000 mon.a (mon.0) 2831 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:16:08.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:07 gibba013 bash[29418]: cluster 2021-03-10T16:16:06.669361+0000 mgr.gibba020.yqfnwy (mgr.34427) 7553 : cluster [DBG] pgmap v4302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:08.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:07 gibba013 bash[29418]: audit 2021-03-10T16:16:07.010143+0000 mon.a (mon.0) 2832 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:16:08.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:07 gibba013 bash[29418]: audit 2021-03-10T16:16:07.010392+0000 mon.a (mon.0) 2833 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:16:08.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:07 gibba013 bash[29418]: audit 2021-03-10T16:16:07.010621+0000 mon.a (mon.0) 2834 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:16:08.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:07 gibba013 bash[29418]: audit 2021-03-10T16:16:07.010849+0000 mon.a (mon.0) 2835 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:16:08.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:07 gibba013 bash[30381]: cluster 2021-03-10T16:16:06.669361+0000 mgr.gibba020.yqfnwy (mgr.34427) 7553 : cluster [DBG] pgmap v4302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:08.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:07 gibba013 bash[30381]: audit 2021-03-10T16:16:07.010143+0000 mon.a (mon.0) 2832 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:16:08.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:07 gibba013 bash[30381]: audit 2021-03-10T16:16:07.010392+0000 mon.a (mon.0) 2833 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:16:08.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:07 gibba013 bash[30381]: audit 2021-03-10T16:16:07.010621+0000 mon.a (mon.0) 2834 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:16:08.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:07 gibba013 bash[30381]: audit 2021-03-10T16:16:07.010849+0000 mon.a (mon.0) 2835 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:16:08.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:07 gibba020 bash[25448]: cluster 2021-03-10T16:16:06.669361+0000 mgr.gibba020.yqfnwy (mgr.34427) 7553 : cluster [DBG] pgmap v4302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:08.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:07 gibba020 bash[25448]: audit 2021-03-10T16:16:07.010143+0000 mon.a (mon.0) 2832 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:16:08.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:07 gibba020 bash[25448]: audit 2021-03-10T16:16:07.010392+0000 mon.a (mon.0) 2833 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:16:08.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:07 gibba020 bash[25448]: audit 2021-03-10T16:16:07.010621+0000 mon.a (mon.0) 2834 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:16:08.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:07 gibba020 bash[25448]: audit 2021-03-10T16:16:07.010849+0000 mon.a (mon.0) 2835 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:16:10.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:09 gibba013 bash[29418]: cluster 2021-03-10T16:16:08.671042+0000 mgr.gibba020.yqfnwy (mgr.34427) 7554 : cluster [DBG] pgmap v4303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:10.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:09 gibba013 bash[30381]: cluster 2021-03-10T16:16:08.671042+0000 mgr.gibba020.yqfnwy (mgr.34427) 7554 : cluster [DBG] pgmap v4303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:10.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:09 gibba020 bash[25448]: cluster 2021-03-10T16:16:08.671042+0000 mgr.gibba020.yqfnwy (mgr.34427) 7554 : cluster [DBG] pgmap v4303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:12.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:11 gibba013 bash[29418]: cluster 2021-03-10T16:16:10.672758+0000 mgr.gibba020.yqfnwy (mgr.34427) 7555 : cluster [DBG] pgmap v4304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:12.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:11 gibba013 bash[30381]: cluster 2021-03-10T16:16:10.672758+0000 mgr.gibba020.yqfnwy (mgr.34427) 7555 : cluster [DBG] pgmap v4304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:12.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:11 gibba020 bash[25448]: cluster 2021-03-10T16:16:10.672758+0000 mgr.gibba020.yqfnwy (mgr.34427) 7555 : cluster [DBG] pgmap v4304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:14.164 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:16:14.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:13 gibba020 bash[25448]: cluster 2021-03-10T16:16:12.674268+0000 mgr.gibba020.yqfnwy (mgr.34427) 7556 : cluster [DBG] pgmap v4305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:14.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:13 gibba020 bash[25448]: audit 2021-03-10T16:16:13.506611+0000 mon.a (mon.0) 2836 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:16:14.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:13 gibba020 bash[25448]: audit 2021-03-10T16:16:13.732375+0000 mon.a (mon.0) 2837 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:16:14.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:13 gibba020 bash[25448]: audit 2021-03-10T16:16:13.735786+0000 mon.a (mon.0) 2838 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:16:14.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:13 gibba020 bash[25448]: audit 2021-03-10T16:16:13.737416+0000 mon.a (mon.0) 2839 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:14.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:13 gibba020 bash[25448]: audit 2021-03-10T16:16:13.739249+0000 mon.a (mon.0) 2840 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:14.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:13 gibba020 bash[25448]: audit 2021-03-10T16:16:13.740810+0000 mon.a (mon.0) 2841 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:14.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:13 gibba020 bash[25448]: audit 2021-03-10T16:16:13.743761+0000 mon.a (mon.0) 2842 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:14.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:13 gibba020 bash[25448]: audit 2021-03-10T16:16:13.745494+0000 mon.a (mon.0) 2843 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:14.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:13 gibba013 bash[29418]: cluster 2021-03-10T16:16:12.674268+0000 mgr.gibba020.yqfnwy (mgr.34427) 7556 : cluster [DBG] pgmap v4305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:14.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:13 gibba013 bash[29418]: audit 2021-03-10T16:16:13.506611+0000 mon.a (mon.0) 2836 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:16:14.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:13 gibba013 bash[29418]: audit 2021-03-10T16:16:13.732375+0000 mon.a (mon.0) 2837 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:16:14.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:13 gibba013 bash[29418]: audit 2021-03-10T16:16:13.735786+0000 mon.a (mon.0) 2838 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:16:14.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:13 gibba013 bash[29418]: audit 2021-03-10T16:16:13.737416+0000 mon.a (mon.0) 2839 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:14.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:13 gibba013 bash[29418]: audit 2021-03-10T16:16:13.739249+0000 mon.a (mon.0) 2840 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:14.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:13 gibba013 bash[29418]: audit 2021-03-10T16:16:13.740810+0000 mon.a (mon.0) 2841 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:14.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:13 gibba013 bash[29418]: audit 2021-03-10T16:16:13.743761+0000 mon.a (mon.0) 2842 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:14.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:13 gibba013 bash[29418]: audit 2021-03-10T16:16:13.745494+0000 mon.a (mon.0) 2843 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:14.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:13 gibba013 bash[30381]: cluster 2021-03-10T16:16:12.674268+0000 mgr.gibba020.yqfnwy (mgr.34427) 7556 : cluster [DBG] pgmap v4305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:14.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:13 gibba013 bash[30381]: audit 2021-03-10T16:16:13.506611+0000 mon.a (mon.0) 2836 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:16:14.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:13 gibba013 bash[30381]: audit 2021-03-10T16:16:13.732375+0000 mon.a (mon.0) 2837 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:16:14.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:13 gibba013 bash[30381]: audit 2021-03-10T16:16:13.735786+0000 mon.a (mon.0) 2838 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:16:14.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:13 gibba013 bash[30381]: audit 2021-03-10T16:16:13.737416+0000 mon.a (mon.0) 2839 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:14.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:13 gibba013 bash[30381]: audit 2021-03-10T16:16:13.739249+0000 mon.a (mon.0) 2840 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:14.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:13 gibba013 bash[30381]: audit 2021-03-10T16:16:13.740810+0000 mon.a (mon.0) 2841 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:14.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:13 gibba013 bash[30381]: audit 2021-03-10T16:16:13.743761+0000 mon.a (mon.0) 2842 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:14.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:13 gibba013 bash[30381]: audit 2021-03-10T16:16:13.745494+0000 mon.a (mon.0) 2843 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:14.390 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:16:14.391 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 6m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:16:14.391 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 5m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:16:14.391 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:16:14.391 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:16:14.392 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:16:14.392 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:16:14.392 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:16:14.392 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:16:14.392 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:16:14.393 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:16:14.393 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:16:14.393 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:16:14.393 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:16:14.393 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:16:14.394 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:16:14.394 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:16:14.394 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:16:14.394 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:16:14.395 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 5m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:16:14.395 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 5m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:16:14.640 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:16:14.641 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:16:14.641 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:16:14.641 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:16:14.642 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:16:14.642 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:16:14.642 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:16:14.642 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:16:14.643 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:16:14.643 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:16:14.643 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:16:14.643 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:16:14.643 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:16:14.644 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:16:14.644 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:16:15.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:14 gibba013 bash[29418]: cephadm 2021-03-10T16:16:13.511393+0000 mgr.gibba020.yqfnwy (mgr.34427) 7557 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:16:15.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:14 gibba013 bash[29418]: cephadm 2021-03-10T16:16:13.513235+0000 mgr.gibba020.yqfnwy (mgr.34427) 7558 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:16:15.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:14 gibba013 bash[29418]: cephadm 2021-03-10T16:16:13.733854+0000 mgr.gibba020.yqfnwy (mgr.34427) 7559 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:16:15.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:14 gibba013 bash[29418]: cephadm 2021-03-10T16:16:13.736040+0000 mgr.gibba020.yqfnwy (mgr.34427) 7560 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:16:15.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:14 gibba013 bash[29418]: cephadm 2021-03-10T16:16:13.737614+0000 mgr.gibba020.yqfnwy (mgr.34427) 7561 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:16:15.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:14 gibba013 bash[29418]: cephadm 2021-03-10T16:16:13.737699+0000 mgr.gibba020.yqfnwy (mgr.34427) 7562 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:16:15.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:14 gibba013 bash[29418]: cephadm 2021-03-10T16:16:13.739391+0000 mgr.gibba020.yqfnwy (mgr.34427) 7563 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:16:15.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:14 gibba013 bash[29418]: cephadm 2021-03-10T16:16:13.739485+0000 mgr.gibba020.yqfnwy (mgr.34427) 7564 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:16:15.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:14 gibba013 bash[29418]: cephadm 2021-03-10T16:16:13.740798+0000 mgr.gibba020.yqfnwy (mgr.34427) 7565 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:16:15.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:14 gibba013 bash[29418]: cephadm 2021-03-10T16:16:13.742174+0000 mgr.gibba020.yqfnwy (mgr.34427) 7566 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:16:15.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:14 gibba013 bash[29418]: cephadm 2021-03-10T16:16:13.742254+0000 mgr.gibba020.yqfnwy (mgr.34427) 7567 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:16:15.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:14 gibba013 bash[29418]: cephadm 2021-03-10T16:16:13.743778+0000 mgr.gibba020.yqfnwy (mgr.34427) 7568 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:16:15.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:14 gibba013 bash[29418]: cephadm 2021-03-10T16:16:13.744173+0000 mgr.gibba020.yqfnwy (mgr.34427) 7569 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:16:15.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:14 gibba013 bash[29418]: cephadm 2021-03-10T16:16:13.745578+0000 mgr.gibba020.yqfnwy (mgr.34427) 7570 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:16:15.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:14 gibba013 bash[29418]: cephadm 2021-03-10T16:16:13.745648+0000 mgr.gibba020.yqfnwy (mgr.34427) 7571 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:16:15.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:14 gibba013 bash[29418]: cephadm 2021-03-10T16:16:13.745783+0000 mgr.gibba020.yqfnwy (mgr.34427) 7572 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:16:15.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:14 gibba013 bash[29418]: audit 2021-03-10T16:16:14.154972+0000 mgr.gibba020.yqfnwy (mgr.34427) 7573 : audit [DBG] from='client.49128 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:16:15.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:14 gibba013 bash[29418]: audit 2021-03-10T16:16:14.641462+0000 mon.c (mon.1) 121 : audit [DBG] from='client.? 172.21.2.113:0/4198882923' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:15.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:14 gibba013 bash[30381]: cephadm 2021-03-10T16:16:13.511393+0000 mgr.gibba020.yqfnwy (mgr.34427) 7557 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:16:15.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:14 gibba013 bash[30381]: cephadm 2021-03-10T16:16:13.513235+0000 mgr.gibba020.yqfnwy (mgr.34427) 7558 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:16:15.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:14 gibba013 bash[30381]: cephadm 2021-03-10T16:16:13.733854+0000 mgr.gibba020.yqfnwy (mgr.34427) 7559 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:16:15.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:14 gibba013 bash[30381]: cephadm 2021-03-10T16:16:13.736040+0000 mgr.gibba020.yqfnwy (mgr.34427) 7560 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:16:15.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:14 gibba013 bash[30381]: cephadm 2021-03-10T16:16:13.737614+0000 mgr.gibba020.yqfnwy (mgr.34427) 7561 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:16:15.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:14 gibba013 bash[30381]: cephadm 2021-03-10T16:16:13.737699+0000 mgr.gibba020.yqfnwy (mgr.34427) 7562 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:16:15.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:14 gibba013 bash[30381]: cephadm 2021-03-10T16:16:13.739391+0000 mgr.gibba020.yqfnwy (mgr.34427) 7563 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:16:15.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:14 gibba013 bash[30381]: cephadm 2021-03-10T16:16:13.739485+0000 mgr.gibba020.yqfnwy (mgr.34427) 7564 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:16:15.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:14 gibba013 bash[30381]: cephadm 2021-03-10T16:16:13.740798+0000 mgr.gibba020.yqfnwy (mgr.34427) 7565 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:16:15.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:14 gibba013 bash[30381]: cephadm 2021-03-10T16:16:13.742174+0000 mgr.gibba020.yqfnwy (mgr.34427) 7566 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:16:15.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:14 gibba013 bash[30381]: cephadm 2021-03-10T16:16:13.742254+0000 mgr.gibba020.yqfnwy (mgr.34427) 7567 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:16:15.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:14 gibba013 bash[30381]: cephadm 2021-03-10T16:16:13.743778+0000 mgr.gibba020.yqfnwy (mgr.34427) 7568 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:16:15.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:14 gibba013 bash[30381]: cephadm 2021-03-10T16:16:13.744173+0000 mgr.gibba020.yqfnwy (mgr.34427) 7569 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:16:15.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:14 gibba013 bash[30381]: cephadm 2021-03-10T16:16:13.745578+0000 mgr.gibba020.yqfnwy (mgr.34427) 7570 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:16:15.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:14 gibba013 bash[30381]: cephadm 2021-03-10T16:16:13.745648+0000 mgr.gibba020.yqfnwy (mgr.34427) 7571 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:16:15.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:14 gibba013 bash[30381]: cephadm 2021-03-10T16:16:13.745783+0000 mgr.gibba020.yqfnwy (mgr.34427) 7572 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:16:15.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:14 gibba013 bash[30381]: audit 2021-03-10T16:16:14.154972+0000 mgr.gibba020.yqfnwy (mgr.34427) 7573 : audit [DBG] from='client.49128 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:16:15.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:14 gibba013 bash[30381]: audit 2021-03-10T16:16:14.641462+0000 mon.c (mon.1) 121 : audit [DBG] from='client.? 172.21.2.113:0/4198882923' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:15.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:14 gibba020 bash[25448]: cephadm 2021-03-10T16:16:13.511393+0000 mgr.gibba020.yqfnwy (mgr.34427) 7557 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:16:15.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:14 gibba020 bash[25448]: cephadm 2021-03-10T16:16:13.513235+0000 mgr.gibba020.yqfnwy (mgr.34427) 7558 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:16:15.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:14 gibba020 bash[25448]: cephadm 2021-03-10T16:16:13.733854+0000 mgr.gibba020.yqfnwy (mgr.34427) 7559 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:16:15.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:14 gibba020 bash[25448]: cephadm 2021-03-10T16:16:13.736040+0000 mgr.gibba020.yqfnwy (mgr.34427) 7560 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:16:15.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:14 gibba020 bash[25448]: cephadm 2021-03-10T16:16:13.737614+0000 mgr.gibba020.yqfnwy (mgr.34427) 7561 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:16:15.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:14 gibba020 bash[25448]: cephadm 2021-03-10T16:16:13.737699+0000 mgr.gibba020.yqfnwy (mgr.34427) 7562 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:16:15.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:14 gibba020 bash[25448]: cephadm 2021-03-10T16:16:13.739391+0000 mgr.gibba020.yqfnwy (mgr.34427) 7563 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:16:15.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:14 gibba020 bash[25448]: cephadm 2021-03-10T16:16:13.739485+0000 mgr.gibba020.yqfnwy (mgr.34427) 7564 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:16:15.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:14 gibba020 bash[25448]: cephadm 2021-03-10T16:16:13.740798+0000 mgr.gibba020.yqfnwy (mgr.34427) 7565 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:16:15.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:14 gibba020 bash[25448]: cephadm 2021-03-10T16:16:13.742174+0000 mgr.gibba020.yqfnwy (mgr.34427) 7566 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:16:15.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:14 gibba020 bash[25448]: cephadm 2021-03-10T16:16:13.742254+0000 mgr.gibba020.yqfnwy (mgr.34427) 7567 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:16:15.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:14 gibba020 bash[25448]: cephadm 2021-03-10T16:16:13.743778+0000 mgr.gibba020.yqfnwy (mgr.34427) 7568 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:16:15.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:14 gibba020 bash[25448]: cephadm 2021-03-10T16:16:13.744173+0000 mgr.gibba020.yqfnwy (mgr.34427) 7569 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:16:15.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:14 gibba020 bash[25448]: cephadm 2021-03-10T16:16:13.745578+0000 mgr.gibba020.yqfnwy (mgr.34427) 7570 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:16:15.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:14 gibba020 bash[25448]: cephadm 2021-03-10T16:16:13.745648+0000 mgr.gibba020.yqfnwy (mgr.34427) 7571 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:16:15.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:14 gibba020 bash[25448]: cephadm 2021-03-10T16:16:13.745783+0000 mgr.gibba020.yqfnwy (mgr.34427) 7572 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:16:15.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:14 gibba020 bash[25448]: audit 2021-03-10T16:16:14.154972+0000 mgr.gibba020.yqfnwy (mgr.34427) 7573 : audit [DBG] from='client.49128 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:16:15.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:14 gibba020 bash[25448]: audit 2021-03-10T16:16:14.641462+0000 mon.c (mon.1) 121 : audit [DBG] from='client.? 172.21.2.113:0/4198882923' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:16.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:16 gibba013 bash[29418]: audit 2021-03-10T16:16:14.378746+0000 mgr.gibba020.yqfnwy (mgr.34427) 7574 : audit [DBG] from='client.59116 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:16:16.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:16 gibba013 bash[29418]: cluster 2021-03-10T16:16:14.675937+0000 mgr.gibba020.yqfnwy (mgr.34427) 7575 : cluster [DBG] pgmap v4306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:16.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:16 gibba013 bash[30381]: audit 2021-03-10T16:16:14.378746+0000 mgr.gibba020.yqfnwy (mgr.34427) 7574 : audit [DBG] from='client.59116 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:16:16.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:16 gibba013 bash[30381]: cluster 2021-03-10T16:16:14.675937+0000 mgr.gibba020.yqfnwy (mgr.34427) 7575 : cluster [DBG] pgmap v4306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:16.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:16 gibba020 bash[25448]: audit 2021-03-10T16:16:14.378746+0000 mgr.gibba020.yqfnwy (mgr.34427) 7574 : audit [DBG] from='client.59116 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:16:16.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:16 gibba020 bash[25448]: cluster 2021-03-10T16:16:14.675937+0000 mgr.gibba020.yqfnwy (mgr.34427) 7575 : cluster [DBG] pgmap v4306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:18.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:18 gibba013 bash[29418]: cluster 2021-03-10T16:16:16.676969+0000 mgr.gibba020.yqfnwy (mgr.34427) 7576 : cluster [DBG] pgmap v4307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:18.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:18 gibba013 bash[30381]: cluster 2021-03-10T16:16:16.676969+0000 mgr.gibba020.yqfnwy (mgr.34427) 7576 : cluster [DBG] pgmap v4307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:18.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:18 gibba020 bash[25448]: cluster 2021-03-10T16:16:16.676969+0000 mgr.gibba020.yqfnwy (mgr.34427) 7576 : cluster [DBG] pgmap v4307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:20.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:20 gibba013 bash[29418]: cluster 2021-03-10T16:16:18.678239+0000 mgr.gibba020.yqfnwy (mgr.34427) 7577 : cluster [DBG] pgmap v4308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:20.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:20 gibba013 bash[30381]: cluster 2021-03-10T16:16:18.678239+0000 mgr.gibba020.yqfnwy (mgr.34427) 7577 : cluster [DBG] pgmap v4308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:20.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:20 gibba020 bash[25448]: cluster 2021-03-10T16:16:18.678239+0000 mgr.gibba020.yqfnwy (mgr.34427) 7577 : cluster [DBG] pgmap v4308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:22.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:22 gibba013 bash[29418]: cluster 2021-03-10T16:16:20.679992+0000 mgr.gibba020.yqfnwy (mgr.34427) 7578 : cluster [DBG] pgmap v4309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:22.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:22 gibba013 bash[30381]: cluster 2021-03-10T16:16:20.679992+0000 mgr.gibba020.yqfnwy (mgr.34427) 7578 : cluster [DBG] pgmap v4309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:22.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:22 gibba020 bash[25448]: cluster 2021-03-10T16:16:20.679992+0000 mgr.gibba020.yqfnwy (mgr.34427) 7578 : cluster [DBG] pgmap v4309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:24.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:24 gibba013 bash[29418]: cluster 2021-03-10T16:16:22.681561+0000 mgr.gibba020.yqfnwy (mgr.34427) 7579 : cluster [DBG] pgmap v4310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:24.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:24 gibba013 bash[30381]: cluster 2021-03-10T16:16:22.681561+0000 mgr.gibba020.yqfnwy (mgr.34427) 7579 : cluster [DBG] pgmap v4310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:24.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:24 gibba020 bash[25448]: cluster 2021-03-10T16:16:22.681561+0000 mgr.gibba020.yqfnwy (mgr.34427) 7579 : cluster [DBG] pgmap v4310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:26.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:26 gibba013 bash[29418]: cluster 2021-03-10T16:16:24.683043+0000 mgr.gibba020.yqfnwy (mgr.34427) 7580 : cluster [DBG] pgmap v4311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:26.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:26 gibba013 bash[30381]: cluster 2021-03-10T16:16:24.683043+0000 mgr.gibba020.yqfnwy (mgr.34427) 7580 : cluster [DBG] pgmap v4311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:26.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:26 gibba020 bash[25448]: cluster 2021-03-10T16:16:24.683043+0000 mgr.gibba020.yqfnwy (mgr.34427) 7580 : cluster [DBG] pgmap v4311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:28.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:28 gibba013 bash[29418]: cluster 2021-03-10T16:16:26.684184+0000 mgr.gibba020.yqfnwy (mgr.34427) 7581 : cluster [DBG] pgmap v4312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:28.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:28 gibba013 bash[30381]: cluster 2021-03-10T16:16:26.684184+0000 mgr.gibba020.yqfnwy (mgr.34427) 7581 : cluster [DBG] pgmap v4312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:28.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:28 gibba020 bash[25448]: cluster 2021-03-10T16:16:26.684184+0000 mgr.gibba020.yqfnwy (mgr.34427) 7581 : cluster [DBG] pgmap v4312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:30.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:30 gibba013 bash[29418]: cluster 2021-03-10T16:16:28.685576+0000 mgr.gibba020.yqfnwy (mgr.34427) 7582 : cluster [DBG] pgmap v4313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:30.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:30 gibba013 bash[29418]: cephadm 2021-03-10T16:16:28.761575+0000 mgr.gibba020.yqfnwy (mgr.34427) 7583 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:16:30.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:30 gibba013 bash[30381]: cluster 2021-03-10T16:16:28.685576+0000 mgr.gibba020.yqfnwy (mgr.34427) 7582 : cluster [DBG] pgmap v4313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:30.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:30 gibba013 bash[30381]: cephadm 2021-03-10T16:16:28.761575+0000 mgr.gibba020.yqfnwy (mgr.34427) 7583 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:16:30.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:30 gibba020 bash[25448]: cluster 2021-03-10T16:16:28.685576+0000 mgr.gibba020.yqfnwy (mgr.34427) 7582 : cluster [DBG] pgmap v4313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:30.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:30 gibba020 bash[25448]: cephadm 2021-03-10T16:16:28.761575+0000 mgr.gibba020.yqfnwy (mgr.34427) 7583 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:16:32.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:32 gibba013 bash[29418]: cluster 2021-03-10T16:16:30.687041+0000 mgr.gibba020.yqfnwy (mgr.34427) 7584 : cluster [DBG] pgmap v4314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:32.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:32 gibba013 bash[30381]: cluster 2021-03-10T16:16:30.687041+0000 mgr.gibba020.yqfnwy (mgr.34427) 7584 : cluster [DBG] pgmap v4314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:32.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:32 gibba020 bash[25448]: cluster 2021-03-10T16:16:30.687041+0000 mgr.gibba020.yqfnwy (mgr.34427) 7584 : cluster [DBG] pgmap v4314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:34.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:34 gibba013 bash[29418]: cluster 2021-03-10T16:16:32.688630+0000 mgr.gibba020.yqfnwy (mgr.34427) 7585 : cluster [DBG] pgmap v4315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:34.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:34 gibba013 bash[30381]: cluster 2021-03-10T16:16:32.688630+0000 mgr.gibba020.yqfnwy (mgr.34427) 7585 : cluster [DBG] pgmap v4315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:34.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:34 gibba020 bash[25448]: cluster 2021-03-10T16:16:32.688630+0000 mgr.gibba020.yqfnwy (mgr.34427) 7585 : cluster [DBG] pgmap v4315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:36.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:36 gibba013 bash[29418]: cluster 2021-03-10T16:16:34.690279+0000 mgr.gibba020.yqfnwy (mgr.34427) 7586 : cluster [DBG] pgmap v4316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:36.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:36 gibba013 bash[30381]: cluster 2021-03-10T16:16:34.690279+0000 mgr.gibba020.yqfnwy (mgr.34427) 7586 : cluster [DBG] pgmap v4316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:36.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:36 gibba020 bash[25448]: cluster 2021-03-10T16:16:34.690279+0000 mgr.gibba020.yqfnwy (mgr.34427) 7586 : cluster [DBG] pgmap v4316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:38.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:38 gibba013 bash[29418]: cluster 2021-03-10T16:16:36.691306+0000 mgr.gibba020.yqfnwy (mgr.34427) 7587 : cluster [DBG] pgmap v4317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:38.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:38 gibba013 bash[30381]: cluster 2021-03-10T16:16:36.691306+0000 mgr.gibba020.yqfnwy (mgr.34427) 7587 : cluster [DBG] pgmap v4317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:38.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:38 gibba020 bash[25448]: cluster 2021-03-10T16:16:36.691306+0000 mgr.gibba020.yqfnwy (mgr.34427) 7587 : cluster [DBG] pgmap v4317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:40.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:40 gibba013 bash[29418]: cluster 2021-03-10T16:16:38.692906+0000 mgr.gibba020.yqfnwy (mgr.34427) 7588 : cluster [DBG] pgmap v4318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:40.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:40 gibba013 bash[30381]: cluster 2021-03-10T16:16:38.692906+0000 mgr.gibba020.yqfnwy (mgr.34427) 7588 : cluster [DBG] pgmap v4318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:40.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:40 gibba020 bash[25448]: cluster 2021-03-10T16:16:38.692906+0000 mgr.gibba020.yqfnwy (mgr.34427) 7588 : cluster [DBG] pgmap v4318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:42.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:42 gibba013 bash[29418]: cluster 2021-03-10T16:16:40.694601+0000 mgr.gibba020.yqfnwy (mgr.34427) 7589 : cluster [DBG] pgmap v4319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:42.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:42 gibba013 bash[30381]: cluster 2021-03-10T16:16:40.694601+0000 mgr.gibba020.yqfnwy (mgr.34427) 7589 : cluster [DBG] pgmap v4319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:42.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:42 gibba020 bash[25448]: cluster 2021-03-10T16:16:40.694601+0000 mgr.gibba020.yqfnwy (mgr.34427) 7589 : cluster [DBG] pgmap v4319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:44.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:44 gibba013 bash[29418]: cluster 2021-03-10T16:16:42.696208+0000 mgr.gibba020.yqfnwy (mgr.34427) 7590 : cluster [DBG] pgmap v4320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:44.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:44 gibba013 bash[30381]: cluster 2021-03-10T16:16:42.696208+0000 mgr.gibba020.yqfnwy (mgr.34427) 7590 : cluster [DBG] pgmap v4320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:44.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:44 gibba020 bash[25448]: cluster 2021-03-10T16:16:42.696208+0000 mgr.gibba020.yqfnwy (mgr.34427) 7590 : cluster [DBG] pgmap v4320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:44.882 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:16:45.110 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:16:45.111 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 6m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:16:45.111 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 5m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:16:45.111 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:16:45.111 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:16:45.112 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:16:45.112 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:16:45.112 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:16:45.113 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:16:45.113 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:16:45.113 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:16:45.113 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:16:45.114 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:16:45.114 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:16:45.114 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:16:45.114 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:16:45.115 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:16:45.115 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:16:45.115 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:16:45.115 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 5m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:16:45.116 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 5m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:16:45.364 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:16:45.364 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:16:45.364 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:16:45.365 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:16:45.365 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:16:45.365 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:16:45.365 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:16:45.365 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:16:45.366 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:16:45.366 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:16:45.366 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:16:45.366 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:16:45.367 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:16:45.367 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:16:45.367 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:16:45.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:45 gibba013 bash[29418]: cephadm 2021-03-10T16:16:43.777632+0000 mgr.gibba020.yqfnwy (mgr.34427) 7591 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:16:45.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:45 gibba013 bash[30381]: cephadm 2021-03-10T16:16:43.777632+0000 mgr.gibba020.yqfnwy (mgr.34427) 7591 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:16:45.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:45 gibba020 bash[25448]: cephadm 2021-03-10T16:16:43.777632+0000 mgr.gibba020.yqfnwy (mgr.34427) 7591 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:16:46.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:46 gibba013 bash[29418]: cluster 2021-03-10T16:16:44.697608+0000 mgr.gibba020.yqfnwy (mgr.34427) 7592 : cluster [DBG] pgmap v4321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:46.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:46 gibba013 bash[29418]: audit 2021-03-10T16:16:44.873210+0000 mgr.gibba020.yqfnwy (mgr.34427) 7593 : audit [DBG] from='client.59128 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:16:46.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:46 gibba013 bash[29418]: audit 2021-03-10T16:16:45.098085+0000 mgr.gibba020.yqfnwy (mgr.34427) 7594 : audit [DBG] from='client.59134 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:16:46.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:46 gibba013 bash[29418]: audit 2021-03-10T16:16:45.364949+0000 mon.a (mon.0) 2844 : audit [DBG] from='client.? 172.21.2.113:0/162409713' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:46.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:46 gibba013 bash[30381]: cluster 2021-03-10T16:16:44.697608+0000 mgr.gibba020.yqfnwy (mgr.34427) 7592 : cluster [DBG] pgmap v4321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:46.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:46 gibba013 bash[30381]: audit 2021-03-10T16:16:44.873210+0000 mgr.gibba020.yqfnwy (mgr.34427) 7593 : audit [DBG] from='client.59128 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:16:46.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:46 gibba013 bash[30381]: audit 2021-03-10T16:16:45.098085+0000 mgr.gibba020.yqfnwy (mgr.34427) 7594 : audit [DBG] from='client.59134 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:16:46.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:46 gibba013 bash[30381]: audit 2021-03-10T16:16:45.364949+0000 mon.a (mon.0) 2844 : audit [DBG] from='client.? 172.21.2.113:0/162409713' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:46.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:46 gibba020 bash[25448]: cluster 2021-03-10T16:16:44.697608+0000 mgr.gibba020.yqfnwy (mgr.34427) 7592 : cluster [DBG] pgmap v4321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:46.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:46 gibba020 bash[25448]: audit 2021-03-10T16:16:44.873210+0000 mgr.gibba020.yqfnwy (mgr.34427) 7593 : audit [DBG] from='client.59128 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:16:46.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:46 gibba020 bash[25448]: audit 2021-03-10T16:16:45.098085+0000 mgr.gibba020.yqfnwy (mgr.34427) 7594 : audit [DBG] from='client.59134 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:16:46.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:46 gibba020 bash[25448]: audit 2021-03-10T16:16:45.364949+0000 mon.a (mon.0) 2844 : audit [DBG] from='client.? 172.21.2.113:0/162409713' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:16:48.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:48 gibba020 bash[25448]: cluster 2021-03-10T16:16:46.698646+0000 mgr.gibba020.yqfnwy (mgr.34427) 7595 : cluster [DBG] pgmap v4322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:48.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:48 gibba013 bash[29418]: cluster 2021-03-10T16:16:46.698646+0000 mgr.gibba020.yqfnwy (mgr.34427) 7595 : cluster [DBG] pgmap v4322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:48.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:48 gibba013 bash[30381]: cluster 2021-03-10T16:16:46.698646+0000 mgr.gibba020.yqfnwy (mgr.34427) 7595 : cluster [DBG] pgmap v4322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:50.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:50 gibba020 bash[25448]: cluster 2021-03-10T16:16:48.699862+0000 mgr.gibba020.yqfnwy (mgr.34427) 7596 : cluster [DBG] pgmap v4323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:50.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:50 gibba013 bash[29418]: cluster 2021-03-10T16:16:48.699862+0000 mgr.gibba020.yqfnwy (mgr.34427) 7596 : cluster [DBG] pgmap v4323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:50.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:50 gibba013 bash[30381]: cluster 2021-03-10T16:16:48.699862+0000 mgr.gibba020.yqfnwy (mgr.34427) 7596 : cluster [DBG] pgmap v4323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:52.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:52 gibba020 bash[25448]: cluster 2021-03-10T16:16:50.701653+0000 mgr.gibba020.yqfnwy (mgr.34427) 7597 : cluster [DBG] pgmap v4324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:52.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:52 gibba013 bash[29418]: cluster 2021-03-10T16:16:50.701653+0000 mgr.gibba020.yqfnwy (mgr.34427) 7597 : cluster [DBG] pgmap v4324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:52.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:52 gibba013 bash[30381]: cluster 2021-03-10T16:16:50.701653+0000 mgr.gibba020.yqfnwy (mgr.34427) 7597 : cluster [DBG] pgmap v4324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:54.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:54 gibba020 bash[25448]: cluster 2021-03-10T16:16:52.703065+0000 mgr.gibba020.yqfnwy (mgr.34427) 7598 : cluster [DBG] pgmap v4325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:54.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:54 gibba013 bash[29418]: cluster 2021-03-10T16:16:52.703065+0000 mgr.gibba020.yqfnwy (mgr.34427) 7598 : cluster [DBG] pgmap v4325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:54.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:54 gibba013 bash[30381]: cluster 2021-03-10T16:16:52.703065+0000 mgr.gibba020.yqfnwy (mgr.34427) 7598 : cluster [DBG] pgmap v4325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:56.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:56 gibba020 bash[25448]: cluster 2021-03-10T16:16:54.704590+0000 mgr.gibba020.yqfnwy (mgr.34427) 7599 : cluster [DBG] pgmap v4326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:56.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:56 gibba013 bash[29418]: cluster 2021-03-10T16:16:54.704590+0000 mgr.gibba020.yqfnwy (mgr.34427) 7599 : cluster [DBG] pgmap v4326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:56.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:56 gibba013 bash[30381]: cluster 2021-03-10T16:16:54.704590+0000 mgr.gibba020.yqfnwy (mgr.34427) 7599 : cluster [DBG] pgmap v4326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:58.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:16:58 gibba020 bash[25448]: cluster 2021-03-10T16:16:56.705676+0000 mgr.gibba020.yqfnwy (mgr.34427) 7600 : cluster [DBG] pgmap v4327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:58.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:16:58 gibba013 bash[29418]: cluster 2021-03-10T16:16:56.705676+0000 mgr.gibba020.yqfnwy (mgr.34427) 7600 : cluster [DBG] pgmap v4327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:16:58.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:16:58 gibba013 bash[30381]: cluster 2021-03-10T16:16:56.705676+0000 mgr.gibba020.yqfnwy (mgr.34427) 7600 : cluster [DBG] pgmap v4327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:00.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:00 gibba020 bash[25448]: cluster 2021-03-10T16:16:58.707249+0000 mgr.gibba020.yqfnwy (mgr.34427) 7601 : cluster [DBG] pgmap v4328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:00.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:00 gibba020 bash[25448]: cephadm 2021-03-10T16:16:58.793551+0000 mgr.gibba020.yqfnwy (mgr.34427) 7602 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:17:00.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:00 gibba013 bash[29418]: cluster 2021-03-10T16:16:58.707249+0000 mgr.gibba020.yqfnwy (mgr.34427) 7601 : cluster [DBG] pgmap v4328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:00.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:00 gibba013 bash[29418]: cephadm 2021-03-10T16:16:58.793551+0000 mgr.gibba020.yqfnwy (mgr.34427) 7602 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:17:00.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:00 gibba013 bash[30381]: cluster 2021-03-10T16:16:58.707249+0000 mgr.gibba020.yqfnwy (mgr.34427) 7601 : cluster [DBG] pgmap v4328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:00.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:00 gibba013 bash[30381]: cephadm 2021-03-10T16:16:58.793551+0000 mgr.gibba020.yqfnwy (mgr.34427) 7602 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:17:02.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:02 gibba020 bash[25448]: cluster 2021-03-10T16:17:00.709044+0000 mgr.gibba020.yqfnwy (mgr.34427) 7603 : cluster [DBG] pgmap v4329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:02.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:02 gibba013 bash[29418]: cluster 2021-03-10T16:17:00.709044+0000 mgr.gibba020.yqfnwy (mgr.34427) 7603 : cluster [DBG] pgmap v4329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:02.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:02 gibba013 bash[30381]: cluster 2021-03-10T16:17:00.709044+0000 mgr.gibba020.yqfnwy (mgr.34427) 7603 : cluster [DBG] pgmap v4329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:04.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:04 gibba013 bash[29418]: cluster 2021-03-10T16:17:02.710545+0000 mgr.gibba020.yqfnwy (mgr.34427) 7604 : cluster [DBG] pgmap v4330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:04.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:04 gibba013 bash[30381]: cluster 2021-03-10T16:17:02.710545+0000 mgr.gibba020.yqfnwy (mgr.34427) 7604 : cluster [DBG] pgmap v4330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:04.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:04 gibba020 bash[25448]: cluster 2021-03-10T16:17:02.710545+0000 mgr.gibba020.yqfnwy (mgr.34427) 7604 : cluster [DBG] pgmap v4330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:06.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:06 gibba013 bash[29418]: cluster 2021-03-10T16:17:04.712236+0000 mgr.gibba020.yqfnwy (mgr.34427) 7605 : cluster [DBG] pgmap v4331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:06.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:06 gibba013 bash[30381]: cluster 2021-03-10T16:17:04.712236+0000 mgr.gibba020.yqfnwy (mgr.34427) 7605 : cluster [DBG] pgmap v4331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:06.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:06 gibba020 bash[25448]: cluster 2021-03-10T16:17:04.712236+0000 mgr.gibba020.yqfnwy (mgr.34427) 7605 : cluster [DBG] pgmap v4331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:07 gibba013 bash[29418]: audit 2021-03-10T16:17:06.666178+0000 mon.a (mon.0) 2845 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:17:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:07 gibba013 bash[29418]: audit 2021-03-10T16:17:06.780860+0000 mon.a (mon.0) 2846 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:17:07.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:07 gibba013 bash[29418]: audit 2021-03-10T16:17:07.017566+0000 mon.a (mon.0) 2847 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T16:17:07.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:07 gibba013 bash[29418]: audit 2021-03-10T16:17:07.018400+0000 mon.a (mon.0) 2848 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:17:07.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:07 gibba013 bash[29418]: audit 2021-03-10T16:17:07.019063+0000 mon.a (mon.0) 2849 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:17:07.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:07 gibba013 bash[29418]: audit 2021-03-10T16:17:07.019708+0000 mon.a (mon.0) 2850 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:17:07.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:07 gibba013 bash[30381]: audit 2021-03-10T16:17:06.666178+0000 mon.a (mon.0) 2845 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:17:07.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:07 gibba013 bash[30381]: audit 2021-03-10T16:17:06.780860+0000 mon.a (mon.0) 2846 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:17:07.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:07 gibba013 bash[30381]: audit 2021-03-10T16:17:07.017566+0000 mon.a (mon.0) 2847 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T16:17:07.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:07 gibba013 bash[30381]: audit 2021-03-10T16:17:07.018400+0000 mon.a (mon.0) 2848 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:17:07.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:07 gibba013 bash[30381]: audit 2021-03-10T16:17:07.019063+0000 mon.a (mon.0) 2849 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:17:07.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:07 gibba013 bash[30381]: audit 2021-03-10T16:17:07.019708+0000 mon.a (mon.0) 2850 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:17:07.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:07 gibba020 bash[25448]: audit 2021-03-10T16:17:06.666178+0000 mon.a (mon.0) 2845 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:17:07.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:07 gibba020 bash[25448]: audit 2021-03-10T16:17:06.780860+0000 mon.a (mon.0) 2846 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:17:07.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:07 gibba020 bash[25448]: audit 2021-03-10T16:17:07.017566+0000 mon.a (mon.0) 2847 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T16:17:07.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:07 gibba020 bash[25448]: audit 2021-03-10T16:17:07.018400+0000 mon.a (mon.0) 2848 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:17:07.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:07 gibba020 bash[25448]: audit 2021-03-10T16:17:07.019063+0000 mon.a (mon.0) 2849 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:17:07.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:07 gibba020 bash[25448]: audit 2021-03-10T16:17:07.019708+0000 mon.a (mon.0) 2850 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:17:08.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:08 gibba013 bash[29418]: cluster 2021-03-10T16:17:06.713064+0000 mgr.gibba020.yqfnwy (mgr.34427) 7606 : cluster [DBG] pgmap v4332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:08.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:08 gibba013 bash[30381]: cluster 2021-03-10T16:17:06.713064+0000 mgr.gibba020.yqfnwy (mgr.34427) 7606 : cluster [DBG] pgmap v4332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:08.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:08 gibba020 bash[25448]: cluster 2021-03-10T16:17:06.713064+0000 mgr.gibba020.yqfnwy (mgr.34427) 7606 : cluster [DBG] pgmap v4332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:10.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:10 gibba013 bash[29418]: cluster 2021-03-10T16:17:08.714367+0000 mgr.gibba020.yqfnwy (mgr.34427) 7607 : cluster [DBG] pgmap v4333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:10.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:10 gibba013 bash[30381]: cluster 2021-03-10T16:17:08.714367+0000 mgr.gibba020.yqfnwy (mgr.34427) 7607 : cluster [DBG] pgmap v4333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:10.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:10 gibba020 bash[25448]: cluster 2021-03-10T16:17:08.714367+0000 mgr.gibba020.yqfnwy (mgr.34427) 7607 : cluster [DBG] pgmap v4333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:12.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:12 gibba013 bash[29418]: cluster 2021-03-10T16:17:10.716124+0000 mgr.gibba020.yqfnwy (mgr.34427) 7608 : cluster [DBG] pgmap v4334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:12.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:12 gibba013 bash[30381]: cluster 2021-03-10T16:17:10.716124+0000 mgr.gibba020.yqfnwy (mgr.34427) 7608 : cluster [DBG] pgmap v4334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:12.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:12 gibba020 bash[25448]: cluster 2021-03-10T16:17:10.716124+0000 mgr.gibba020.yqfnwy (mgr.34427) 7608 : cluster [DBG] pgmap v4334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:14.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:14 gibba013 bash[29418]: cluster 2021-03-10T16:17:12.717640+0000 mgr.gibba020.yqfnwy (mgr.34427) 7609 : cluster [DBG] pgmap v4335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:14.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:14 gibba013 bash[29418]: audit 2021-03-10T16:17:13.811417+0000 mon.a (mon.0) 2851 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:17:14.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:14 gibba013 bash[29418]: audit 2021-03-10T16:17:14.019534+0000 mon.a (mon.0) 2852 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:17:14.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:14 gibba013 bash[29418]: audit 2021-03-10T16:17:14.022197+0000 mon.a (mon.0) 2853 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:17:14.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:14 gibba013 bash[29418]: audit 2021-03-10T16:17:14.224425+0000 mon.a (mon.0) 2854 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:17:14.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:14 gibba013 bash[29418]: audit 2021-03-10T16:17:14.227819+0000 mon.a (mon.0) 2855 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:17:14.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:14 gibba013 bash[29418]: audit 2021-03-10T16:17:14.229753+0000 mon.a (mon.0) 2856 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:14.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:14 gibba013 bash[29418]: audit 2021-03-10T16:17:14.231067+0000 mon.a (mon.0) 2857 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:14.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:14 gibba013 bash[29418]: audit 2021-03-10T16:17:14.232222+0000 mon.a (mon.0) 2858 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:14.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:14 gibba013 bash[29418]: audit 2021-03-10T16:17:14.235276+0000 mon.a (mon.0) 2859 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:14.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:14 gibba013 bash[29418]: audit 2021-03-10T16:17:14.236914+0000 mon.a (mon.0) 2860 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:14.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:14 gibba013 bash[30381]: cluster 2021-03-10T16:17:12.717640+0000 mgr.gibba020.yqfnwy (mgr.34427) 7609 : cluster [DBG] pgmap v4335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:14.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:14 gibba013 bash[30381]: audit 2021-03-10T16:17:13.811417+0000 mon.a (mon.0) 2851 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:17:14.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:14 gibba013 bash[30381]: audit 2021-03-10T16:17:14.019534+0000 mon.a (mon.0) 2852 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:17:14.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:14 gibba013 bash[30381]: audit 2021-03-10T16:17:14.022197+0000 mon.a (mon.0) 2853 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:17:14.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:14 gibba013 bash[30381]: audit 2021-03-10T16:17:14.224425+0000 mon.a (mon.0) 2854 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:17:14.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:14 gibba013 bash[30381]: audit 2021-03-10T16:17:14.227819+0000 mon.a (mon.0) 2855 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:17:14.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:14 gibba013 bash[30381]: audit 2021-03-10T16:17:14.229753+0000 mon.a (mon.0) 2856 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:14.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:14 gibba013 bash[30381]: audit 2021-03-10T16:17:14.231067+0000 mon.a (mon.0) 2857 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:14.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:14 gibba013 bash[30381]: audit 2021-03-10T16:17:14.232222+0000 mon.a (mon.0) 2858 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:14.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:14 gibba013 bash[30381]: audit 2021-03-10T16:17:14.235276+0000 mon.a (mon.0) 2859 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:14.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:14 gibba013 bash[30381]: audit 2021-03-10T16:17:14.236914+0000 mon.a (mon.0) 2860 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:14.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:14 gibba020 bash[25448]: cluster 2021-03-10T16:17:12.717640+0000 mgr.gibba020.yqfnwy (mgr.34427) 7609 : cluster [DBG] pgmap v4335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:14.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:14 gibba020 bash[25448]: audit 2021-03-10T16:17:13.811417+0000 mon.a (mon.0) 2851 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:17:14.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:14 gibba020 bash[25448]: audit 2021-03-10T16:17:14.019534+0000 mon.a (mon.0) 2852 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:17:14.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:14 gibba020 bash[25448]: audit 2021-03-10T16:17:14.022197+0000 mon.a (mon.0) 2853 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:17:14.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:14 gibba020 bash[25448]: audit 2021-03-10T16:17:14.224425+0000 mon.a (mon.0) 2854 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:17:14.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:14 gibba020 bash[25448]: audit 2021-03-10T16:17:14.227819+0000 mon.a (mon.0) 2855 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:17:14.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:14 gibba020 bash[25448]: audit 2021-03-10T16:17:14.229753+0000 mon.a (mon.0) 2856 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:14.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:14 gibba020 bash[25448]: audit 2021-03-10T16:17:14.231067+0000 mon.a (mon.0) 2857 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:14.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:14 gibba020 bash[25448]: audit 2021-03-10T16:17:14.232222+0000 mon.a (mon.0) 2858 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:14.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:14 gibba020 bash[25448]: audit 2021-03-10T16:17:14.235276+0000 mon.a (mon.0) 2859 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:14.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:14 gibba020 bash[25448]: audit 2021-03-10T16:17:14.236914+0000 mon.a (mon.0) 2860 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:15.607 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:17:15.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:15 gibba013 bash[30381]: cephadm 2021-03-10T16:17:14.019246+0000 mgr.gibba020.yqfnwy (mgr.34427) 7610 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:17:15.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:15 gibba013 bash[30381]: cephadm 2021-03-10T16:17:14.022333+0000 mgr.gibba020.yqfnwy (mgr.34427) 7611 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:17:15.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:15 gibba013 bash[30381]: cephadm 2021-03-10T16:17:14.226113+0000 mgr.gibba020.yqfnwy (mgr.34427) 7612 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:17:15.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:15 gibba013 bash[30381]: cephadm 2021-03-10T16:17:14.228389+0000 mgr.gibba020.yqfnwy (mgr.34427) 7613 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:17:15.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:15 gibba013 bash[30381]: cephadm 2021-03-10T16:17:14.229868+0000 mgr.gibba020.yqfnwy (mgr.34427) 7614 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:17:15.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:15 gibba013 bash[30381]: cephadm 2021-03-10T16:17:14.229903+0000 mgr.gibba020.yqfnwy (mgr.34427) 7615 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:17:15.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:15 gibba013 bash[30381]: cephadm 2021-03-10T16:17:14.231101+0000 mgr.gibba020.yqfnwy (mgr.34427) 7616 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:17:15.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:15 gibba013 bash[30381]: cephadm 2021-03-10T16:17:14.231152+0000 mgr.gibba020.yqfnwy (mgr.34427) 7617 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:17:15.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:15 gibba013 bash[30381]: cephadm 2021-03-10T16:17:14.232274+0000 mgr.gibba020.yqfnwy (mgr.34427) 7618 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:17:15.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:15 gibba013 bash[30381]: cephadm 2021-03-10T16:17:14.233848+0000 mgr.gibba020.yqfnwy (mgr.34427) 7619 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:17:15.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:15 gibba013 bash[30381]: cephadm 2021-03-10T16:17:14.233885+0000 mgr.gibba020.yqfnwy (mgr.34427) 7620 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:17:15.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:15 gibba013 bash[30381]: cephadm 2021-03-10T16:17:14.235358+0000 mgr.gibba020.yqfnwy (mgr.34427) 7621 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:17:15.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:15 gibba013 bash[30381]: cephadm 2021-03-10T16:17:14.235674+0000 mgr.gibba020.yqfnwy (mgr.34427) 7622 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:17:15.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:15 gibba013 bash[30381]: cephadm 2021-03-10T16:17:14.237017+0000 mgr.gibba020.yqfnwy (mgr.34427) 7623 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:17:15.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:15 gibba013 bash[30381]: cephadm 2021-03-10T16:17:14.237054+0000 mgr.gibba020.yqfnwy (mgr.34427) 7624 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:17:15.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:15 gibba013 bash[30381]: cephadm 2021-03-10T16:17:14.237157+0000 mgr.gibba020.yqfnwy (mgr.34427) 7625 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:17:15.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:15 gibba013 bash[29418]: cephadm 2021-03-10T16:17:14.019246+0000 mgr.gibba020.yqfnwy (mgr.34427) 7610 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:17:15.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:15 gibba013 bash[29418]: cephadm 2021-03-10T16:17:14.022333+0000 mgr.gibba020.yqfnwy (mgr.34427) 7611 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:17:15.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:15 gibba013 bash[29418]: cephadm 2021-03-10T16:17:14.226113+0000 mgr.gibba020.yqfnwy (mgr.34427) 7612 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:17:15.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:15 gibba013 bash[29418]: cephadm 2021-03-10T16:17:14.228389+0000 mgr.gibba020.yqfnwy (mgr.34427) 7613 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:17:15.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:15 gibba013 bash[29418]: cephadm 2021-03-10T16:17:14.229868+0000 mgr.gibba020.yqfnwy (mgr.34427) 7614 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:17:15.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:15 gibba013 bash[29418]: cephadm 2021-03-10T16:17:14.229903+0000 mgr.gibba020.yqfnwy (mgr.34427) 7615 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:17:15.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:15 gibba013 bash[29418]: cephadm 2021-03-10T16:17:14.231101+0000 mgr.gibba020.yqfnwy (mgr.34427) 7616 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:17:15.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:15 gibba013 bash[29418]: cephadm 2021-03-10T16:17:14.231152+0000 mgr.gibba020.yqfnwy (mgr.34427) 7617 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:17:15.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:15 gibba013 bash[29418]: cephadm 2021-03-10T16:17:14.232274+0000 mgr.gibba020.yqfnwy (mgr.34427) 7618 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:17:15.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:15 gibba013 bash[29418]: cephadm 2021-03-10T16:17:14.233848+0000 mgr.gibba020.yqfnwy (mgr.34427) 7619 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:17:15.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:15 gibba013 bash[29418]: cephadm 2021-03-10T16:17:14.233885+0000 mgr.gibba020.yqfnwy (mgr.34427) 7620 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:17:15.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:15 gibba013 bash[29418]: cephadm 2021-03-10T16:17:14.235358+0000 mgr.gibba020.yqfnwy (mgr.34427) 7621 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:17:15.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:15 gibba013 bash[29418]: cephadm 2021-03-10T16:17:14.235674+0000 mgr.gibba020.yqfnwy (mgr.34427) 7622 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:17:15.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:15 gibba013 bash[29418]: cephadm 2021-03-10T16:17:14.237017+0000 mgr.gibba020.yqfnwy (mgr.34427) 7623 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:17:15.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:15 gibba013 bash[29418]: cephadm 2021-03-10T16:17:14.237054+0000 mgr.gibba020.yqfnwy (mgr.34427) 7624 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:17:15.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:15 gibba013 bash[29418]: cephadm 2021-03-10T16:17:14.237157+0000 mgr.gibba020.yqfnwy (mgr.34427) 7625 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:17:15.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:15 gibba020 bash[25448]: cephadm 2021-03-10T16:17:14.019246+0000 mgr.gibba020.yqfnwy (mgr.34427) 7610 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:17:15.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:15 gibba020 bash[25448]: cephadm 2021-03-10T16:17:14.022333+0000 mgr.gibba020.yqfnwy (mgr.34427) 7611 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:17:15.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:15 gibba020 bash[25448]: cephadm 2021-03-10T16:17:14.226113+0000 mgr.gibba020.yqfnwy (mgr.34427) 7612 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:17:15.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:15 gibba020 bash[25448]: cephadm 2021-03-10T16:17:14.228389+0000 mgr.gibba020.yqfnwy (mgr.34427) 7613 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:17:15.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:15 gibba020 bash[25448]: cephadm 2021-03-10T16:17:14.229868+0000 mgr.gibba020.yqfnwy (mgr.34427) 7614 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:17:15.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:15 gibba020 bash[25448]: cephadm 2021-03-10T16:17:14.229903+0000 mgr.gibba020.yqfnwy (mgr.34427) 7615 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:17:15.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:15 gibba020 bash[25448]: cephadm 2021-03-10T16:17:14.231101+0000 mgr.gibba020.yqfnwy (mgr.34427) 7616 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:17:15.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:15 gibba020 bash[25448]: cephadm 2021-03-10T16:17:14.231152+0000 mgr.gibba020.yqfnwy (mgr.34427) 7617 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:17:15.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:15 gibba020 bash[25448]: cephadm 2021-03-10T16:17:14.232274+0000 mgr.gibba020.yqfnwy (mgr.34427) 7618 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:17:15.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:15 gibba020 bash[25448]: cephadm 2021-03-10T16:17:14.233848+0000 mgr.gibba020.yqfnwy (mgr.34427) 7619 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:17:15.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:15 gibba020 bash[25448]: cephadm 2021-03-10T16:17:14.233885+0000 mgr.gibba020.yqfnwy (mgr.34427) 7620 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:17:15.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:15 gibba020 bash[25448]: cephadm 2021-03-10T16:17:14.235358+0000 mgr.gibba020.yqfnwy (mgr.34427) 7621 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:17:15.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:15 gibba020 bash[25448]: cephadm 2021-03-10T16:17:14.235674+0000 mgr.gibba020.yqfnwy (mgr.34427) 7622 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:17:15.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:15 gibba020 bash[25448]: cephadm 2021-03-10T16:17:14.237017+0000 mgr.gibba020.yqfnwy (mgr.34427) 7623 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:17:15.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:15 gibba020 bash[25448]: cephadm 2021-03-10T16:17:14.237054+0000 mgr.gibba020.yqfnwy (mgr.34427) 7624 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:17:15.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:15 gibba020 bash[25448]: cephadm 2021-03-10T16:17:14.237157+0000 mgr.gibba020.yqfnwy (mgr.34427) 7625 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:17:15.833 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:17:15.833 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 7m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:17:15.834 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 6m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:17:15.834 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:17:15.834 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:17:15.834 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:17:15.835 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:17:15.835 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:17:15.835 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:17:15.835 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:17:15.835 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:17:15.836 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:17:15.836 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:17:15.836 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:17:15.836 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:17:15.837 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:17:15.837 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:17:15.838 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:17:15.838 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:17:15.838 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 6m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:17:15.838 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 6m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:17:16.080 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:17:16.081 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:17:16.081 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:17:16.081 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:17:16.081 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:17:16.082 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:17:16.082 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:17:16.082 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:17:16.082 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:17:16.082 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:17:16.083 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:17:16.083 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:17:16.083 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:17:16.083 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:17:16.084 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:17:16.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:16 gibba013 bash[29418]: cluster 2021-03-10T16:17:14.719256+0000 mgr.gibba020.yqfnwy (mgr.34427) 7626 : cluster [DBG] pgmap v4336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:16.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:16 gibba013 bash[29418]: audit 2021-03-10T16:17:16.081234+0000 mon.a (mon.0) 2861 : audit [DBG] from='client.? 172.21.2.113:0/2422784058' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:16.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:16 gibba013 bash[30381]: cluster 2021-03-10T16:17:14.719256+0000 mgr.gibba020.yqfnwy (mgr.34427) 7626 : cluster [DBG] pgmap v4336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:16.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:16 gibba013 bash[30381]: audit 2021-03-10T16:17:16.081234+0000 mon.a (mon.0) 2861 : audit [DBG] from='client.? 172.21.2.113:0/2422784058' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:16.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:16 gibba020 bash[25448]: cluster 2021-03-10T16:17:14.719256+0000 mgr.gibba020.yqfnwy (mgr.34427) 7626 : cluster [DBG] pgmap v4336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:16.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:16 gibba020 bash[25448]: audit 2021-03-10T16:17:16.081234+0000 mon.a (mon.0) 2861 : audit [DBG] from='client.? 172.21.2.113:0/2422784058' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:17.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:17 gibba013 bash[29418]: audit 2021-03-10T16:17:15.597697+0000 mgr.gibba020.yqfnwy (mgr.34427) 7627 : audit [DBG] from='client.49164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:17:17.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:17 gibba013 bash[29418]: audit 2021-03-10T16:17:15.820347+0000 mgr.gibba020.yqfnwy (mgr.34427) 7628 : audit [DBG] from='client.49170 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:17:17.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:17 gibba013 bash[30381]: audit 2021-03-10T16:17:15.597697+0000 mgr.gibba020.yqfnwy (mgr.34427) 7627 : audit [DBG] from='client.49164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:17:17.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:17 gibba013 bash[30381]: audit 2021-03-10T16:17:15.820347+0000 mgr.gibba020.yqfnwy (mgr.34427) 7628 : audit [DBG] from='client.49170 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:17:17.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:17 gibba020 bash[25448]: audit 2021-03-10T16:17:15.597697+0000 mgr.gibba020.yqfnwy (mgr.34427) 7627 : audit [DBG] from='client.49164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:17:17.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:17 gibba020 bash[25448]: audit 2021-03-10T16:17:15.820347+0000 mgr.gibba020.yqfnwy (mgr.34427) 7628 : audit [DBG] from='client.49170 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:17:18.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:18 gibba013 bash[29418]: cluster 2021-03-10T16:17:16.720217+0000 mgr.gibba020.yqfnwy (mgr.34427) 7629 : cluster [DBG] pgmap v4337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:18.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:18 gibba013 bash[30381]: cluster 2021-03-10T16:17:16.720217+0000 mgr.gibba020.yqfnwy (mgr.34427) 7629 : cluster [DBG] pgmap v4337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:18.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:18 gibba020 bash[25448]: cluster 2021-03-10T16:17:16.720217+0000 mgr.gibba020.yqfnwy (mgr.34427) 7629 : cluster [DBG] pgmap v4337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:20.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:20 gibba013 bash[29418]: cluster 2021-03-10T16:17:18.721475+0000 mgr.gibba020.yqfnwy (mgr.34427) 7630 : cluster [DBG] pgmap v4338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:20.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:20 gibba013 bash[30381]: cluster 2021-03-10T16:17:18.721475+0000 mgr.gibba020.yqfnwy (mgr.34427) 7630 : cluster [DBG] pgmap v4338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:20.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:20 gibba020 bash[25448]: cluster 2021-03-10T16:17:18.721475+0000 mgr.gibba020.yqfnwy (mgr.34427) 7630 : cluster [DBG] pgmap v4338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:22.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:22 gibba013 bash[29418]: cluster 2021-03-10T16:17:20.723058+0000 mgr.gibba020.yqfnwy (mgr.34427) 7631 : cluster [DBG] pgmap v4339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:22.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:22 gibba013 bash[30381]: cluster 2021-03-10T16:17:20.723058+0000 mgr.gibba020.yqfnwy (mgr.34427) 7631 : cluster [DBG] pgmap v4339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:22.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:22 gibba020 bash[25448]: cluster 2021-03-10T16:17:20.723058+0000 mgr.gibba020.yqfnwy (mgr.34427) 7631 : cluster [DBG] pgmap v4339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:24.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:24 gibba013 bash[29418]: cluster 2021-03-10T16:17:22.724510+0000 mgr.gibba020.yqfnwy (mgr.34427) 7632 : cluster [DBG] pgmap v4340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:24.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:24 gibba013 bash[30381]: cluster 2021-03-10T16:17:22.724510+0000 mgr.gibba020.yqfnwy (mgr.34427) 7632 : cluster [DBG] pgmap v4340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:24.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:24 gibba020 bash[25448]: cluster 2021-03-10T16:17:22.724510+0000 mgr.gibba020.yqfnwy (mgr.34427) 7632 : cluster [DBG] pgmap v4340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:26.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:26 gibba013 bash[29418]: cluster 2021-03-10T16:17:24.726137+0000 mgr.gibba020.yqfnwy (mgr.34427) 7633 : cluster [DBG] pgmap v4341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:26.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:26 gibba013 bash[30381]: cluster 2021-03-10T16:17:24.726137+0000 mgr.gibba020.yqfnwy (mgr.34427) 7633 : cluster [DBG] pgmap v4341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:26.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:26 gibba020 bash[25448]: cluster 2021-03-10T16:17:24.726137+0000 mgr.gibba020.yqfnwy (mgr.34427) 7633 : cluster [DBG] pgmap v4341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:28.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:28 gibba013 bash[29418]: cluster 2021-03-10T16:17:26.727067+0000 mgr.gibba020.yqfnwy (mgr.34427) 7634 : cluster [DBG] pgmap v4342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:28.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:28 gibba013 bash[30381]: cluster 2021-03-10T16:17:26.727067+0000 mgr.gibba020.yqfnwy (mgr.34427) 7634 : cluster [DBG] pgmap v4342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:28.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:28 gibba020 bash[25448]: cluster 2021-03-10T16:17:26.727067+0000 mgr.gibba020.yqfnwy (mgr.34427) 7634 : cluster [DBG] pgmap v4342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:30.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:30 gibba013 bash[29418]: cluster 2021-03-10T16:17:28.728533+0000 mgr.gibba020.yqfnwy (mgr.34427) 7635 : cluster [DBG] pgmap v4343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:30.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:30 gibba013 bash[29418]: cephadm 2021-03-10T16:17:29.253294+0000 mgr.gibba020.yqfnwy (mgr.34427) 7636 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:17:30.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:30 gibba013 bash[30381]: cluster 2021-03-10T16:17:28.728533+0000 mgr.gibba020.yqfnwy (mgr.34427) 7635 : cluster [DBG] pgmap v4343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:30.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:30 gibba013 bash[30381]: cephadm 2021-03-10T16:17:29.253294+0000 mgr.gibba020.yqfnwy (mgr.34427) 7636 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:17:30.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:30 gibba020 bash[25448]: cluster 2021-03-10T16:17:28.728533+0000 mgr.gibba020.yqfnwy (mgr.34427) 7635 : cluster [DBG] pgmap v4343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:30.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:30 gibba020 bash[25448]: cephadm 2021-03-10T16:17:29.253294+0000 mgr.gibba020.yqfnwy (mgr.34427) 7636 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:17:32.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:32 gibba013 bash[29418]: cluster 2021-03-10T16:17:30.729992+0000 mgr.gibba020.yqfnwy (mgr.34427) 7637 : cluster [DBG] pgmap v4344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:32.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:32 gibba013 bash[30381]: cluster 2021-03-10T16:17:30.729992+0000 mgr.gibba020.yqfnwy (mgr.34427) 7637 : cluster [DBG] pgmap v4344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:32.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:32 gibba020 bash[25448]: cluster 2021-03-10T16:17:30.729992+0000 mgr.gibba020.yqfnwy (mgr.34427) 7637 : cluster [DBG] pgmap v4344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:34.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:34 gibba013 bash[29418]: cluster 2021-03-10T16:17:32.731397+0000 mgr.gibba020.yqfnwy (mgr.34427) 7638 : cluster [DBG] pgmap v4345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:34.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:34 gibba013 bash[30381]: cluster 2021-03-10T16:17:32.731397+0000 mgr.gibba020.yqfnwy (mgr.34427) 7638 : cluster [DBG] pgmap v4345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:34.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:34 gibba020 bash[25448]: cluster 2021-03-10T16:17:32.731397+0000 mgr.gibba020.yqfnwy (mgr.34427) 7638 : cluster [DBG] pgmap v4345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:36.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:36 gibba013 bash[29418]: cluster 2021-03-10T16:17:34.732906+0000 mgr.gibba020.yqfnwy (mgr.34427) 7639 : cluster [DBG] pgmap v4346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:36.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:36 gibba013 bash[30381]: cluster 2021-03-10T16:17:34.732906+0000 mgr.gibba020.yqfnwy (mgr.34427) 7639 : cluster [DBG] pgmap v4346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:36.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:36 gibba020 bash[25448]: cluster 2021-03-10T16:17:34.732906+0000 mgr.gibba020.yqfnwy (mgr.34427) 7639 : cluster [DBG] pgmap v4346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:38.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:38 gibba020 bash[25448]: cluster 2021-03-10T16:17:36.734273+0000 mgr.gibba020.yqfnwy (mgr.34427) 7640 : cluster [DBG] pgmap v4347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:38.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:38 gibba013 bash[29418]: cluster 2021-03-10T16:17:36.734273+0000 mgr.gibba020.yqfnwy (mgr.34427) 7640 : cluster [DBG] pgmap v4347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:38.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:38 gibba013 bash[30381]: cluster 2021-03-10T16:17:36.734273+0000 mgr.gibba020.yqfnwy (mgr.34427) 7640 : cluster [DBG] pgmap v4347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:40.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:40 gibba020 bash[25448]: cluster 2021-03-10T16:17:38.735758+0000 mgr.gibba020.yqfnwy (mgr.34427) 7641 : cluster [DBG] pgmap v4348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:40.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:40 gibba013 bash[29418]: cluster 2021-03-10T16:17:38.735758+0000 mgr.gibba020.yqfnwy (mgr.34427) 7641 : cluster [DBG] pgmap v4348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:40.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:40 gibba013 bash[30381]: cluster 2021-03-10T16:17:38.735758+0000 mgr.gibba020.yqfnwy (mgr.34427) 7641 : cluster [DBG] pgmap v4348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:42.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:42 gibba020 bash[25448]: cluster 2021-03-10T16:17:40.737131+0000 mgr.gibba020.yqfnwy (mgr.34427) 7642 : cluster [DBG] pgmap v4349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:42.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:42 gibba013 bash[29418]: cluster 2021-03-10T16:17:40.737131+0000 mgr.gibba020.yqfnwy (mgr.34427) 7642 : cluster [DBG] pgmap v4349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:42.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:42 gibba013 bash[30381]: cluster 2021-03-10T16:17:40.737131+0000 mgr.gibba020.yqfnwy (mgr.34427) 7642 : cluster [DBG] pgmap v4349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:44.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:44 gibba020 bash[25448]: cluster 2021-03-10T16:17:42.738498+0000 mgr.gibba020.yqfnwy (mgr.34427) 7643 : cluster [DBG] pgmap v4350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:44.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:44 gibba013 bash[29418]: cluster 2021-03-10T16:17:42.738498+0000 mgr.gibba020.yqfnwy (mgr.34427) 7643 : cluster [DBG] pgmap v4350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:44.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:44 gibba013 bash[30381]: cluster 2021-03-10T16:17:42.738498+0000 mgr.gibba020.yqfnwy (mgr.34427) 7643 : cluster [DBG] pgmap v4350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:45.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:45 gibba020 bash[25448]: cephadm 2021-03-10T16:17:44.269401+0000 mgr.gibba020.yqfnwy (mgr.34427) 7644 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:17:45.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:45 gibba013 bash[29418]: cephadm 2021-03-10T16:17:44.269401+0000 mgr.gibba020.yqfnwy (mgr.34427) 7644 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:17:45.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:45 gibba013 bash[30381]: cephadm 2021-03-10T16:17:44.269401+0000 mgr.gibba020.yqfnwy (mgr.34427) 7644 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:17:46.321 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:17:46.551 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:17:46.551 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 7m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:17:46.552 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 6m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:17:46.552 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:17:46.552 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:17:46.552 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:17:46.553 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:17:46.553 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:17:46.553 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:17:46.553 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:17:46.553 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:17:46.554 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:17:46.554 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:17:46.554 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:17:46.554 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:17:46.555 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:17:46.555 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:17:46.555 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:17:46.556 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:17:46.556 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 6m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:17:46.556 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 6m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:17:46.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:46 gibba020 bash[25448]: cluster 2021-03-10T16:17:44.740144+0000 mgr.gibba020.yqfnwy (mgr.34427) 7645 : cluster [DBG] pgmap v4351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:46.807 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:17:46.808 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:17:46.808 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:17:46.808 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:17:46.808 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:17:46.809 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:17:46.809 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:17:46.809 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:17:46.809 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:17:46.810 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:17:46.810 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:17:46.810 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:17:46.810 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:17:46.811 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:17:46.811 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:17:46.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:46 gibba013 bash[29418]: cluster 2021-03-10T16:17:44.740144+0000 mgr.gibba020.yqfnwy (mgr.34427) 7645 : cluster [DBG] pgmap v4351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:46.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:46 gibba013 bash[30381]: cluster 2021-03-10T16:17:44.740144+0000 mgr.gibba020.yqfnwy (mgr.34427) 7645 : cluster [DBG] pgmap v4351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:47.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:47 gibba020 bash[25448]: audit 2021-03-10T16:17:46.312374+0000 mgr.gibba020.yqfnwy (mgr.34427) 7646 : audit [DBG] from='client.49182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:17:47.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:47 gibba020 bash[25448]: audit 2021-03-10T16:17:46.808407+0000 mon.a (mon.0) 2862 : audit [DBG] from='client.? 172.21.2.113:0/186785648' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:47.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:47 gibba013 bash[29418]: audit 2021-03-10T16:17:46.312374+0000 mgr.gibba020.yqfnwy (mgr.34427) 7646 : audit [DBG] from='client.49182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:17:47.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:47 gibba013 bash[29418]: audit 2021-03-10T16:17:46.808407+0000 mon.a (mon.0) 2862 : audit [DBG] from='client.? 172.21.2.113:0/186785648' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:47.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:47 gibba013 bash[30381]: audit 2021-03-10T16:17:46.312374+0000 mgr.gibba020.yqfnwy (mgr.34427) 7646 : audit [DBG] from='client.49182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:17:47.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:47 gibba013 bash[30381]: audit 2021-03-10T16:17:46.808407+0000 mon.a (mon.0) 2862 : audit [DBG] from='client.? 172.21.2.113:0/186785648' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:17:48.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:48 gibba020 bash[25448]: audit 2021-03-10T16:17:46.538462+0000 mgr.gibba020.yqfnwy (mgr.34427) 7647 : audit [DBG] from='client.49188 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:17:48.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:48 gibba020 bash[25448]: cluster 2021-03-10T16:17:46.741560+0000 mgr.gibba020.yqfnwy (mgr.34427) 7648 : cluster [DBG] pgmap v4352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:48.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:48 gibba013 bash[29418]: audit 2021-03-10T16:17:46.538462+0000 mgr.gibba020.yqfnwy (mgr.34427) 7647 : audit [DBG] from='client.49188 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:17:48.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:48 gibba013 bash[29418]: cluster 2021-03-10T16:17:46.741560+0000 mgr.gibba020.yqfnwy (mgr.34427) 7648 : cluster [DBG] pgmap v4352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:48.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:48 gibba013 bash[30381]: audit 2021-03-10T16:17:46.538462+0000 mgr.gibba020.yqfnwy (mgr.34427) 7647 : audit [DBG] from='client.49188 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:17:48.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:48 gibba013 bash[30381]: cluster 2021-03-10T16:17:46.741560+0000 mgr.gibba020.yqfnwy (mgr.34427) 7648 : cluster [DBG] pgmap v4352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:50.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:49 gibba013 bash[29418]: cluster 2021-03-10T16:17:48.743088+0000 mgr.gibba020.yqfnwy (mgr.34427) 7649 : cluster [DBG] pgmap v4353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:50.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:49 gibba013 bash[30381]: cluster 2021-03-10T16:17:48.743088+0000 mgr.gibba020.yqfnwy (mgr.34427) 7649 : cluster [DBG] pgmap v4353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:50.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:49 gibba020 bash[25448]: cluster 2021-03-10T16:17:48.743088+0000 mgr.gibba020.yqfnwy (mgr.34427) 7649 : cluster [DBG] pgmap v4353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:52.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:51 gibba013 bash[29418]: cluster 2021-03-10T16:17:50.744820+0000 mgr.gibba020.yqfnwy (mgr.34427) 7650 : cluster [DBG] pgmap v4354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:52.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:51 gibba013 bash[30381]: cluster 2021-03-10T16:17:50.744820+0000 mgr.gibba020.yqfnwy (mgr.34427) 7650 : cluster [DBG] pgmap v4354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:52.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:51 gibba020 bash[25448]: cluster 2021-03-10T16:17:50.744820+0000 mgr.gibba020.yqfnwy (mgr.34427) 7650 : cluster [DBG] pgmap v4354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:54.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:53 gibba013 bash[29418]: cluster 2021-03-10T16:17:52.746345+0000 mgr.gibba020.yqfnwy (mgr.34427) 7651 : cluster [DBG] pgmap v4355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:54.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:53 gibba013 bash[30381]: cluster 2021-03-10T16:17:52.746345+0000 mgr.gibba020.yqfnwy (mgr.34427) 7651 : cluster [DBG] pgmap v4355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:54.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:53 gibba020 bash[25448]: cluster 2021-03-10T16:17:52.746345+0000 mgr.gibba020.yqfnwy (mgr.34427) 7651 : cluster [DBG] pgmap v4355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:56.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:55 gibba013 bash[29418]: cluster 2021-03-10T16:17:54.747850+0000 mgr.gibba020.yqfnwy (mgr.34427) 7652 : cluster [DBG] pgmap v4356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:56.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:55 gibba013 bash[30381]: cluster 2021-03-10T16:17:54.747850+0000 mgr.gibba020.yqfnwy (mgr.34427) 7652 : cluster [DBG] pgmap v4356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:56.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:55 gibba020 bash[25448]: cluster 2021-03-10T16:17:54.747850+0000 mgr.gibba020.yqfnwy (mgr.34427) 7652 : cluster [DBG] pgmap v4356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:58.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:57 gibba013 bash[29418]: cluster 2021-03-10T16:17:56.749191+0000 mgr.gibba020.yqfnwy (mgr.34427) 7653 : cluster [DBG] pgmap v4357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:58.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:57 gibba013 bash[30381]: cluster 2021-03-10T16:17:56.749191+0000 mgr.gibba020.yqfnwy (mgr.34427) 7653 : cluster [DBG] pgmap v4357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:17:58.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:57 gibba020 bash[25448]: cluster 2021-03-10T16:17:56.749191+0000 mgr.gibba020.yqfnwy (mgr.34427) 7653 : cluster [DBG] pgmap v4357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:00.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:59 gibba013 bash[29418]: cluster 2021-03-10T16:17:58.750748+0000 mgr.gibba020.yqfnwy (mgr.34427) 7654 : cluster [DBG] pgmap v4358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:00.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:17:59 gibba013 bash[29418]: cephadm 2021-03-10T16:17:59.285217+0000 mgr.gibba020.yqfnwy (mgr.34427) 7655 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:18:00.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:59 gibba013 bash[30381]: cluster 2021-03-10T16:17:58.750748+0000 mgr.gibba020.yqfnwy (mgr.34427) 7654 : cluster [DBG] pgmap v4358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:00.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:17:59 gibba013 bash[30381]: cephadm 2021-03-10T16:17:59.285217+0000 mgr.gibba020.yqfnwy (mgr.34427) 7655 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:18:00.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:59 gibba020 bash[25448]: cluster 2021-03-10T16:17:58.750748+0000 mgr.gibba020.yqfnwy (mgr.34427) 7654 : cluster [DBG] pgmap v4358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:00.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:17:59 gibba020 bash[25448]: cephadm 2021-03-10T16:17:59.285217+0000 mgr.gibba020.yqfnwy (mgr.34427) 7655 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:18:02.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:02 gibba013 bash[29418]: cluster 2021-03-10T16:18:00.752330+0000 mgr.gibba020.yqfnwy (mgr.34427) 7656 : cluster [DBG] pgmap v4359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:02.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:02 gibba013 bash[30381]: cluster 2021-03-10T16:18:00.752330+0000 mgr.gibba020.yqfnwy (mgr.34427) 7656 : cluster [DBG] pgmap v4359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:02.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:02 gibba020 bash[25448]: cluster 2021-03-10T16:18:00.752330+0000 mgr.gibba020.yqfnwy (mgr.34427) 7656 : cluster [DBG] pgmap v4359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:04.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:04 gibba013 bash[29418]: cluster 2021-03-10T16:18:02.753610+0000 mgr.gibba020.yqfnwy (mgr.34427) 7657 : cluster [DBG] pgmap v4360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:04.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:04 gibba013 bash[30381]: cluster 2021-03-10T16:18:02.753610+0000 mgr.gibba020.yqfnwy (mgr.34427) 7657 : cluster [DBG] pgmap v4360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:04.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:04 gibba020 bash[25448]: cluster 2021-03-10T16:18:02.753610+0000 mgr.gibba020.yqfnwy (mgr.34427) 7657 : cluster [DBG] pgmap v4360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:06.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:06 gibba013 bash[29418]: cluster 2021-03-10T16:18:04.755217+0000 mgr.gibba020.yqfnwy (mgr.34427) 7658 : cluster [DBG] pgmap v4361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:06.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:06 gibba013 bash[30381]: cluster 2021-03-10T16:18:04.755217+0000 mgr.gibba020.yqfnwy (mgr.34427) 7658 : cluster [DBG] pgmap v4361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:06.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:06 gibba020 bash[25448]: cluster 2021-03-10T16:18:04.755217+0000 mgr.gibba020.yqfnwy (mgr.34427) 7658 : cluster [DBG] pgmap v4361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:07.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:07 gibba013 bash[29418]: audit 2021-03-10T16:18:06.668650+0000 mon.a (mon.0) 2863 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:18:07.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:07 gibba013 bash[29418]: audit 2021-03-10T16:18:06.787376+0000 mon.a (mon.0) 2864 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:18:07.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:07 gibba013 bash[30381]: audit 2021-03-10T16:18:06.668650+0000 mon.a (mon.0) 2863 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:18:07.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:07 gibba013 bash[30381]: audit 2021-03-10T16:18:06.787376+0000 mon.a (mon.0) 2864 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:18:07.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:07 gibba020 bash[25448]: audit 2021-03-10T16:18:06.668650+0000 mon.a (mon.0) 2863 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:18:07.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:07 gibba020 bash[25448]: audit 2021-03-10T16:18:06.787376+0000 mon.a (mon.0) 2864 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:18:08.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:08 gibba013 bash[29418]: cluster 2021-03-10T16:18:06.756701+0000 mgr.gibba020.yqfnwy (mgr.34427) 7659 : cluster [DBG] pgmap v4362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:08.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:08 gibba013 bash[29418]: audit 2021-03-10T16:18:07.030035+0000 mon.a (mon.0) 2865 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:18:08.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:08 gibba013 bash[29418]: audit 2021-03-10T16:18:07.030311+0000 mon.a (mon.0) 2866 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:18:08.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:08 gibba013 bash[29418]: audit 2021-03-10T16:18:07.030502+0000 mon.a (mon.0) 2867 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T16:18:08.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:08 gibba013 bash[29418]: audit 2021-03-10T16:18:07.030706+0000 mon.a (mon.0) 2868 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:18:08.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:08 gibba013 bash[30381]: cluster 2021-03-10T16:18:06.756701+0000 mgr.gibba020.yqfnwy (mgr.34427) 7659 : cluster [DBG] pgmap v4362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:08.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:08 gibba013 bash[30381]: audit 2021-03-10T16:18:07.030035+0000 mon.a (mon.0) 2865 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:18:08.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:08 gibba013 bash[30381]: audit 2021-03-10T16:18:07.030311+0000 mon.a (mon.0) 2866 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:18:08.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:08 gibba013 bash[30381]: audit 2021-03-10T16:18:07.030502+0000 mon.a (mon.0) 2867 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T16:18:08.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:08 gibba013 bash[30381]: audit 2021-03-10T16:18:07.030706+0000 mon.a (mon.0) 2868 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:18:08.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:08 gibba020 bash[25448]: cluster 2021-03-10T16:18:06.756701+0000 mgr.gibba020.yqfnwy (mgr.34427) 7659 : cluster [DBG] pgmap v4362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:08.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:08 gibba020 bash[25448]: audit 2021-03-10T16:18:07.030035+0000 mon.a (mon.0) 2865 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:18:08.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:08 gibba020 bash[25448]: audit 2021-03-10T16:18:07.030311+0000 mon.a (mon.0) 2866 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:18:08.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:08 gibba020 bash[25448]: audit 2021-03-10T16:18:07.030502+0000 mon.a (mon.0) 2867 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T16:18:08.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:08 gibba020 bash[25448]: audit 2021-03-10T16:18:07.030706+0000 mon.a (mon.0) 2868 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:18:10.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:10 gibba013 bash[29418]: cluster 2021-03-10T16:18:08.758277+0000 mgr.gibba020.yqfnwy (mgr.34427) 7660 : cluster [DBG] pgmap v4363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:10.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:10 gibba013 bash[30381]: cluster 2021-03-10T16:18:08.758277+0000 mgr.gibba020.yqfnwy (mgr.34427) 7660 : cluster [DBG] pgmap v4363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:10.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:10 gibba020 bash[25448]: cluster 2021-03-10T16:18:08.758277+0000 mgr.gibba020.yqfnwy (mgr.34427) 7660 : cluster [DBG] pgmap v4363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:12.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:12 gibba013 bash[29418]: cluster 2021-03-10T16:18:10.760013+0000 mgr.gibba020.yqfnwy (mgr.34427) 7661 : cluster [DBG] pgmap v4364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:12.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:12 gibba013 bash[30381]: cluster 2021-03-10T16:18:10.760013+0000 mgr.gibba020.yqfnwy (mgr.34427) 7661 : cluster [DBG] pgmap v4364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:12.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:12 gibba020 bash[25448]: cluster 2021-03-10T16:18:10.760013+0000 mgr.gibba020.yqfnwy (mgr.34427) 7661 : cluster [DBG] pgmap v4364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:14.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:14 gibba013 bash[29418]: cluster 2021-03-10T16:18:12.761268+0000 mgr.gibba020.yqfnwy (mgr.34427) 7662 : cluster [DBG] pgmap v4365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:14.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:14 gibba013 bash[30381]: cluster 2021-03-10T16:18:12.761268+0000 mgr.gibba020.yqfnwy (mgr.34427) 7662 : cluster [DBG] pgmap v4365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:14.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:14 gibba020 bash[25448]: cluster 2021-03-10T16:18:12.761268+0000 mgr.gibba020.yqfnwy (mgr.34427) 7662 : cluster [DBG] pgmap v4365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:15.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:15 gibba013 bash[29418]: audit 2021-03-10T16:18:14.302771+0000 mon.a (mon.0) 2869 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:18:15.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:15 gibba013 bash[29418]: cephadm 2021-03-10T16:18:14.307271+0000 mgr.gibba020.yqfnwy (mgr.34427) 7663 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:18:15.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:15 gibba013 bash[29418]: cephadm 2021-03-10T16:18:14.309423+0000 mgr.gibba020.yqfnwy (mgr.34427) 7664 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:18:15.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:15 gibba013 bash[29418]: audit 2021-03-10T16:18:14.541452+0000 mon.a (mon.0) 2870 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:18:15.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:15 gibba013 bash[29418]: audit 2021-03-10T16:18:14.549119+0000 mon.a (mon.0) 2871 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:18:15.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:15 gibba013 bash[29418]: audit 2021-03-10T16:18:14.551218+0000 mon.a (mon.0) 2872 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:15.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:15 gibba013 bash[29418]: audit 2021-03-10T16:18:14.552982+0000 mon.a (mon.0) 2873 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:15.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:15 gibba013 bash[29418]: audit 2021-03-10T16:18:14.555100+0000 mon.a (mon.0) 2874 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:15.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:15 gibba013 bash[29418]: audit 2021-03-10T16:18:14.558098+0000 mon.a (mon.0) 2875 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:15.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:15 gibba013 bash[29418]: audit 2021-03-10T16:18:14.559716+0000 mon.a (mon.0) 2876 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:15.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:15 gibba013 bash[30381]: audit 2021-03-10T16:18:14.302771+0000 mon.a (mon.0) 2869 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:18:15.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:15 gibba013 bash[30381]: cephadm 2021-03-10T16:18:14.307271+0000 mgr.gibba020.yqfnwy (mgr.34427) 7663 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:18:15.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:15 gibba013 bash[30381]: cephadm 2021-03-10T16:18:14.309423+0000 mgr.gibba020.yqfnwy (mgr.34427) 7664 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:18:15.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:15 gibba013 bash[30381]: audit 2021-03-10T16:18:14.541452+0000 mon.a (mon.0) 2870 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:18:15.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:15 gibba013 bash[30381]: audit 2021-03-10T16:18:14.549119+0000 mon.a (mon.0) 2871 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:18:15.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:15 gibba013 bash[30381]: audit 2021-03-10T16:18:14.551218+0000 mon.a (mon.0) 2872 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:15.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:15 gibba013 bash[30381]: audit 2021-03-10T16:18:14.552982+0000 mon.a (mon.0) 2873 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:15.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:15 gibba013 bash[30381]: audit 2021-03-10T16:18:14.555100+0000 mon.a (mon.0) 2874 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:15.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:15 gibba013 bash[30381]: audit 2021-03-10T16:18:14.558098+0000 mon.a (mon.0) 2875 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:15.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:15 gibba013 bash[30381]: audit 2021-03-10T16:18:14.559716+0000 mon.a (mon.0) 2876 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:15.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:15 gibba020 bash[25448]: audit 2021-03-10T16:18:14.302771+0000 mon.a (mon.0) 2869 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:18:15.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:15 gibba020 bash[25448]: cephadm 2021-03-10T16:18:14.307271+0000 mgr.gibba020.yqfnwy (mgr.34427) 7663 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:18:15.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:15 gibba020 bash[25448]: cephadm 2021-03-10T16:18:14.309423+0000 mgr.gibba020.yqfnwy (mgr.34427) 7664 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:18:15.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:15 gibba020 bash[25448]: audit 2021-03-10T16:18:14.541452+0000 mon.a (mon.0) 2870 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:18:15.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:15 gibba020 bash[25448]: audit 2021-03-10T16:18:14.549119+0000 mon.a (mon.0) 2871 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:18:15.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:15 gibba020 bash[25448]: audit 2021-03-10T16:18:14.551218+0000 mon.a (mon.0) 2872 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:15.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:15 gibba020 bash[25448]: audit 2021-03-10T16:18:14.552982+0000 mon.a (mon.0) 2873 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:15.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:15 gibba020 bash[25448]: audit 2021-03-10T16:18:14.555100+0000 mon.a (mon.0) 2874 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:15.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:15 gibba020 bash[25448]: audit 2021-03-10T16:18:14.558098+0000 mon.a (mon.0) 2875 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:15.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:15 gibba020 bash[25448]: audit 2021-03-10T16:18:14.559716+0000 mon.a (mon.0) 2876 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:16.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:16 gibba013 bash[29418]: cephadm 2021-03-10T16:18:14.547650+0000 mgr.gibba020.yqfnwy (mgr.34427) 7665 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:18:16.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:16 gibba013 bash[29418]: cephadm 2021-03-10T16:18:14.549754+0000 mgr.gibba020.yqfnwy (mgr.34427) 7666 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:18:16.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:16 gibba013 bash[29418]: cephadm 2021-03-10T16:18:14.551526+0000 mgr.gibba020.yqfnwy (mgr.34427) 7667 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:18:16.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:16 gibba013 bash[29418]: cephadm 2021-03-10T16:18:14.551563+0000 mgr.gibba020.yqfnwy (mgr.34427) 7668 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:18:16.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:16 gibba013 bash[29418]: cephadm 2021-03-10T16:18:14.553675+0000 mgr.gibba020.yqfnwy (mgr.34427) 7669 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:18:16.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:16 gibba013 bash[29418]: cephadm 2021-03-10T16:18:14.553714+0000 mgr.gibba020.yqfnwy (mgr.34427) 7670 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:18:16.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:16 gibba013 bash[29418]: cephadm 2021-03-10T16:18:14.555374+0000 mgr.gibba020.yqfnwy (mgr.34427) 7671 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:18:16.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:16 gibba013 bash[29418]: cephadm 2021-03-10T16:18:14.556695+0000 mgr.gibba020.yqfnwy (mgr.34427) 7672 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:18:16.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:16 gibba013 bash[29418]: cephadm 2021-03-10T16:18:14.556738+0000 mgr.gibba020.yqfnwy (mgr.34427) 7673 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:18:16.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:16 gibba013 bash[29418]: cephadm 2021-03-10T16:18:14.558202+0000 mgr.gibba020.yqfnwy (mgr.34427) 7674 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:18:16.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:16 gibba013 bash[29418]: cephadm 2021-03-10T16:18:14.558646+0000 mgr.gibba020.yqfnwy (mgr.34427) 7675 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:18:16.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:16 gibba013 bash[29418]: cephadm 2021-03-10T16:18:14.559790+0000 mgr.gibba020.yqfnwy (mgr.34427) 7676 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:18:16.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:16 gibba013 bash[29418]: cephadm 2021-03-10T16:18:14.559833+0000 mgr.gibba020.yqfnwy (mgr.34427) 7677 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:18:16.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:16 gibba013 bash[29418]: cephadm 2021-03-10T16:18:14.559998+0000 mgr.gibba020.yqfnwy (mgr.34427) 7678 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:18:16.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:16 gibba013 bash[29418]: cluster 2021-03-10T16:18:14.762884+0000 mgr.gibba020.yqfnwy (mgr.34427) 7679 : cluster [DBG] pgmap v4366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:16.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:16 gibba013 bash[30381]: cephadm 2021-03-10T16:18:14.547650+0000 mgr.gibba020.yqfnwy (mgr.34427) 7665 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:18:16.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:16 gibba013 bash[30381]: cephadm 2021-03-10T16:18:14.549754+0000 mgr.gibba020.yqfnwy (mgr.34427) 7666 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:18:16.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:16 gibba013 bash[30381]: cephadm 2021-03-10T16:18:14.551526+0000 mgr.gibba020.yqfnwy (mgr.34427) 7667 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:18:16.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:16 gibba013 bash[30381]: cephadm 2021-03-10T16:18:14.551563+0000 mgr.gibba020.yqfnwy (mgr.34427) 7668 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:18:16.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:16 gibba013 bash[30381]: cephadm 2021-03-10T16:18:14.553675+0000 mgr.gibba020.yqfnwy (mgr.34427) 7669 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:18:16.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:16 gibba013 bash[30381]: cephadm 2021-03-10T16:18:14.553714+0000 mgr.gibba020.yqfnwy (mgr.34427) 7670 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:18:16.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:16 gibba013 bash[30381]: cephadm 2021-03-10T16:18:14.555374+0000 mgr.gibba020.yqfnwy (mgr.34427) 7671 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:18:16.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:16 gibba013 bash[30381]: cephadm 2021-03-10T16:18:14.556695+0000 mgr.gibba020.yqfnwy (mgr.34427) 7672 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:18:16.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:16 gibba013 bash[30381]: cephadm 2021-03-10T16:18:14.556738+0000 mgr.gibba020.yqfnwy (mgr.34427) 7673 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:18:16.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:16 gibba013 bash[30381]: cephadm 2021-03-10T16:18:14.558202+0000 mgr.gibba020.yqfnwy (mgr.34427) 7674 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:18:16.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:16 gibba013 bash[30381]: cephadm 2021-03-10T16:18:14.558646+0000 mgr.gibba020.yqfnwy (mgr.34427) 7675 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:18:16.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:16 gibba013 bash[30381]: cephadm 2021-03-10T16:18:14.559790+0000 mgr.gibba020.yqfnwy (mgr.34427) 7676 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:18:16.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:16 gibba013 bash[30381]: cephadm 2021-03-10T16:18:14.559833+0000 mgr.gibba020.yqfnwy (mgr.34427) 7677 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:18:16.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:16 gibba013 bash[30381]: cephadm 2021-03-10T16:18:14.559998+0000 mgr.gibba020.yqfnwy (mgr.34427) 7678 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:18:16.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:16 gibba013 bash[30381]: cluster 2021-03-10T16:18:14.762884+0000 mgr.gibba020.yqfnwy (mgr.34427) 7679 : cluster [DBG] pgmap v4366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:16.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:16 gibba020 bash[25448]: cephadm 2021-03-10T16:18:14.547650+0000 mgr.gibba020.yqfnwy (mgr.34427) 7665 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:18:16.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:16 gibba020 bash[25448]: cephadm 2021-03-10T16:18:14.549754+0000 mgr.gibba020.yqfnwy (mgr.34427) 7666 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:18:16.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:16 gibba020 bash[25448]: cephadm 2021-03-10T16:18:14.551526+0000 mgr.gibba020.yqfnwy (mgr.34427) 7667 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:18:16.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:16 gibba020 bash[25448]: cephadm 2021-03-10T16:18:14.551563+0000 mgr.gibba020.yqfnwy (mgr.34427) 7668 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:18:16.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:16 gibba020 bash[25448]: cephadm 2021-03-10T16:18:14.553675+0000 mgr.gibba020.yqfnwy (mgr.34427) 7669 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:18:16.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:16 gibba020 bash[25448]: cephadm 2021-03-10T16:18:14.553714+0000 mgr.gibba020.yqfnwy (mgr.34427) 7670 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:18:16.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:16 gibba020 bash[25448]: cephadm 2021-03-10T16:18:14.555374+0000 mgr.gibba020.yqfnwy (mgr.34427) 7671 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:18:16.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:16 gibba020 bash[25448]: cephadm 2021-03-10T16:18:14.556695+0000 mgr.gibba020.yqfnwy (mgr.34427) 7672 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:18:16.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:16 gibba020 bash[25448]: cephadm 2021-03-10T16:18:14.556738+0000 mgr.gibba020.yqfnwy (mgr.34427) 7673 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:18:16.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:16 gibba020 bash[25448]: cephadm 2021-03-10T16:18:14.558202+0000 mgr.gibba020.yqfnwy (mgr.34427) 7674 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:18:16.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:16 gibba020 bash[25448]: cephadm 2021-03-10T16:18:14.558646+0000 mgr.gibba020.yqfnwy (mgr.34427) 7675 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:18:16.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:16 gibba020 bash[25448]: cephadm 2021-03-10T16:18:14.559790+0000 mgr.gibba020.yqfnwy (mgr.34427) 7676 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:18:16.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:16 gibba020 bash[25448]: cephadm 2021-03-10T16:18:14.559833+0000 mgr.gibba020.yqfnwy (mgr.34427) 7677 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:18:16.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:16 gibba020 bash[25448]: cephadm 2021-03-10T16:18:14.559998+0000 mgr.gibba020.yqfnwy (mgr.34427) 7678 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:18:16.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:16 gibba020 bash[25448]: cluster 2021-03-10T16:18:14.762884+0000 mgr.gibba020.yqfnwy (mgr.34427) 7679 : cluster [DBG] pgmap v4366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:17.056 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:18:17.310 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:18:17.311 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 8m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:18:17.311 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 7m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:18:17.311 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:18:17.311 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:18:17.312 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:18:17.312 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:18:17.312 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:18:17.312 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:18:17.312 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:18:17.313 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:18:17.313 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:18:17.313 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:18:17.313 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:18:17.314 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:18:17.314 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:18:17.314 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:18:17.314 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:18:17.315 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:18:17.315 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 7m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:18:17.315 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 7m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:18:17.563 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:18:17.563 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:18:17.564 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:18:17.564 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:18:17.564 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:18:17.564 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:18:17.565 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:18:17.565 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:18:17.565 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:18:17.565 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:18:17.565 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:18:17.566 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:18:17.566 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:18:17.566 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:18:17.566 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:18:18.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:18 gibba013 bash[29418]: cluster 2021-03-10T16:18:16.764529+0000 mgr.gibba020.yqfnwy (mgr.34427) 7680 : cluster [DBG] pgmap v4367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:18.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:18 gibba013 bash[29418]: audit 2021-03-10T16:18:17.047618+0000 mgr.gibba020.yqfnwy (mgr.34427) 7681 : audit [DBG] from='client.49200 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:18:18.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:18 gibba013 bash[29418]: audit 2021-03-10T16:18:17.270404+0000 mgr.gibba020.yqfnwy (mgr.34427) 7682 : audit [DBG] from='client.49206 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:18:18.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:18 gibba013 bash[29418]: audit 2021-03-10T16:18:17.564148+0000 mon.c (mon.1) 122 : audit [DBG] from='client.? 172.21.2.113:0/2109871264' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:18.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:18 gibba013 bash[30381]: cluster 2021-03-10T16:18:16.764529+0000 mgr.gibba020.yqfnwy (mgr.34427) 7680 : cluster [DBG] pgmap v4367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:18.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:18 gibba013 bash[30381]: audit 2021-03-10T16:18:17.047618+0000 mgr.gibba020.yqfnwy (mgr.34427) 7681 : audit [DBG] from='client.49200 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:18:18.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:18 gibba013 bash[30381]: audit 2021-03-10T16:18:17.270404+0000 mgr.gibba020.yqfnwy (mgr.34427) 7682 : audit [DBG] from='client.49206 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:18:18.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:18 gibba013 bash[30381]: audit 2021-03-10T16:18:17.564148+0000 mon.c (mon.1) 122 : audit [DBG] from='client.? 172.21.2.113:0/2109871264' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:18.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:18 gibba020 bash[25448]: cluster 2021-03-10T16:18:16.764529+0000 mgr.gibba020.yqfnwy (mgr.34427) 7680 : cluster [DBG] pgmap v4367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:18.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:18 gibba020 bash[25448]: audit 2021-03-10T16:18:17.047618+0000 mgr.gibba020.yqfnwy (mgr.34427) 7681 : audit [DBG] from='client.49200 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:18:18.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:18 gibba020 bash[25448]: audit 2021-03-10T16:18:17.270404+0000 mgr.gibba020.yqfnwy (mgr.34427) 7682 : audit [DBG] from='client.49206 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:18:18.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:18 gibba020 bash[25448]: audit 2021-03-10T16:18:17.564148+0000 mon.c (mon.1) 122 : audit [DBG] from='client.? 172.21.2.113:0/2109871264' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:20.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:20 gibba013 bash[29418]: cluster 2021-03-10T16:18:18.765902+0000 mgr.gibba020.yqfnwy (mgr.34427) 7683 : cluster [DBG] pgmap v4368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:20.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:20 gibba013 bash[30381]: cluster 2021-03-10T16:18:18.765902+0000 mgr.gibba020.yqfnwy (mgr.34427) 7683 : cluster [DBG] pgmap v4368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:20.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:20 gibba020 bash[25448]: cluster 2021-03-10T16:18:18.765902+0000 mgr.gibba020.yqfnwy (mgr.34427) 7683 : cluster [DBG] pgmap v4368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:22.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:22 gibba013 bash[29418]: cluster 2021-03-10T16:18:20.767336+0000 mgr.gibba020.yqfnwy (mgr.34427) 7684 : cluster [DBG] pgmap v4369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:22.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:22 gibba013 bash[30381]: cluster 2021-03-10T16:18:20.767336+0000 mgr.gibba020.yqfnwy (mgr.34427) 7684 : cluster [DBG] pgmap v4369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:22.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:22 gibba020 bash[25448]: cluster 2021-03-10T16:18:20.767336+0000 mgr.gibba020.yqfnwy (mgr.34427) 7684 : cluster [DBG] pgmap v4369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:24.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:24 gibba013 bash[29418]: cluster 2021-03-10T16:18:22.768755+0000 mgr.gibba020.yqfnwy (mgr.34427) 7685 : cluster [DBG] pgmap v4370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:24.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:24 gibba013 bash[30381]: cluster 2021-03-10T16:18:22.768755+0000 mgr.gibba020.yqfnwy (mgr.34427) 7685 : cluster [DBG] pgmap v4370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:24.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:24 gibba020 bash[25448]: cluster 2021-03-10T16:18:22.768755+0000 mgr.gibba020.yqfnwy (mgr.34427) 7685 : cluster [DBG] pgmap v4370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:26.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:26 gibba013 bash[29418]: cluster 2021-03-10T16:18:24.770231+0000 mgr.gibba020.yqfnwy (mgr.34427) 7686 : cluster [DBG] pgmap v4371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:26.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:26 gibba013 bash[30381]: cluster 2021-03-10T16:18:24.770231+0000 mgr.gibba020.yqfnwy (mgr.34427) 7686 : cluster [DBG] pgmap v4371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:26.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:26 gibba020 bash[25448]: cluster 2021-03-10T16:18:24.770231+0000 mgr.gibba020.yqfnwy (mgr.34427) 7686 : cluster [DBG] pgmap v4371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:28.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:28 gibba013 bash[29418]: cluster 2021-03-10T16:18:26.771728+0000 mgr.gibba020.yqfnwy (mgr.34427) 7687 : cluster [DBG] pgmap v4372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:28.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:28 gibba013 bash[30381]: cluster 2021-03-10T16:18:26.771728+0000 mgr.gibba020.yqfnwy (mgr.34427) 7687 : cluster [DBG] pgmap v4372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:28.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:28 gibba020 bash[25448]: cluster 2021-03-10T16:18:26.771728+0000 mgr.gibba020.yqfnwy (mgr.34427) 7687 : cluster [DBG] pgmap v4372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:30.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:30 gibba020 bash[25448]: cluster 2021-03-10T16:18:28.773282+0000 mgr.gibba020.yqfnwy (mgr.34427) 7688 : cluster [DBG] pgmap v4373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:30.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:30 gibba013 bash[29418]: cluster 2021-03-10T16:18:28.773282+0000 mgr.gibba020.yqfnwy (mgr.34427) 7688 : cluster [DBG] pgmap v4373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:30.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:30 gibba013 bash[30381]: cluster 2021-03-10T16:18:28.773282+0000 mgr.gibba020.yqfnwy (mgr.34427) 7688 : cluster [DBG] pgmap v4373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:31.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:31 gibba020 bash[25448]: cephadm 2021-03-10T16:18:29.565644+0000 mgr.gibba020.yqfnwy (mgr.34427) 7689 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:18:31.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:31 gibba013 bash[29418]: cephadm 2021-03-10T16:18:29.565644+0000 mgr.gibba020.yqfnwy (mgr.34427) 7689 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:18:31.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:31 gibba013 bash[30381]: cephadm 2021-03-10T16:18:29.565644+0000 mgr.gibba020.yqfnwy (mgr.34427) 7689 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:18:32.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:32 gibba020 bash[25448]: cluster 2021-03-10T16:18:30.775113+0000 mgr.gibba020.yqfnwy (mgr.34427) 7690 : cluster [DBG] pgmap v4374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:32.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:32 gibba013 bash[29418]: cluster 2021-03-10T16:18:30.775113+0000 mgr.gibba020.yqfnwy (mgr.34427) 7690 : cluster [DBG] pgmap v4374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:32.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:32 gibba013 bash[30381]: cluster 2021-03-10T16:18:30.775113+0000 mgr.gibba020.yqfnwy (mgr.34427) 7690 : cluster [DBG] pgmap v4374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:34.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:34 gibba020 bash[25448]: cluster 2021-03-10T16:18:32.776625+0000 mgr.gibba020.yqfnwy (mgr.34427) 7691 : cluster [DBG] pgmap v4375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:34.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:34 gibba013 bash[29418]: cluster 2021-03-10T16:18:32.776625+0000 mgr.gibba020.yqfnwy (mgr.34427) 7691 : cluster [DBG] pgmap v4375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:34.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:34 gibba013 bash[30381]: cluster 2021-03-10T16:18:32.776625+0000 mgr.gibba020.yqfnwy (mgr.34427) 7691 : cluster [DBG] pgmap v4375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:36.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:36 gibba020 bash[25448]: cluster 2021-03-10T16:18:34.778543+0000 mgr.gibba020.yqfnwy (mgr.34427) 7692 : cluster [DBG] pgmap v4376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:36.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:36 gibba013 bash[29418]: cluster 2021-03-10T16:18:34.778543+0000 mgr.gibba020.yqfnwy (mgr.34427) 7692 : cluster [DBG] pgmap v4376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:36.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:36 gibba013 bash[30381]: cluster 2021-03-10T16:18:34.778543+0000 mgr.gibba020.yqfnwy (mgr.34427) 7692 : cluster [DBG] pgmap v4376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:38.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:38 gibba020 bash[25448]: cluster 2021-03-10T16:18:36.780231+0000 mgr.gibba020.yqfnwy (mgr.34427) 7693 : cluster [DBG] pgmap v4377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:38.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:38 gibba013 bash[29418]: cluster 2021-03-10T16:18:36.780231+0000 mgr.gibba020.yqfnwy (mgr.34427) 7693 : cluster [DBG] pgmap v4377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:38.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:38 gibba013 bash[30381]: cluster 2021-03-10T16:18:36.780231+0000 mgr.gibba020.yqfnwy (mgr.34427) 7693 : cluster [DBG] pgmap v4377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:40.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:40 gibba020 bash[25448]: cluster 2021-03-10T16:18:38.781710+0000 mgr.gibba020.yqfnwy (mgr.34427) 7694 : cluster [DBG] pgmap v4378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:40.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:40 gibba013 bash[29418]: cluster 2021-03-10T16:18:38.781710+0000 mgr.gibba020.yqfnwy (mgr.34427) 7694 : cluster [DBG] pgmap v4378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:40.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:40 gibba013 bash[30381]: cluster 2021-03-10T16:18:38.781710+0000 mgr.gibba020.yqfnwy (mgr.34427) 7694 : cluster [DBG] pgmap v4378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:42.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:42 gibba013 bash[29418]: cluster 2021-03-10T16:18:40.783408+0000 mgr.gibba020.yqfnwy (mgr.34427) 7695 : cluster [DBG] pgmap v4379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:42.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:42 gibba013 bash[30381]: cluster 2021-03-10T16:18:40.783408+0000 mgr.gibba020.yqfnwy (mgr.34427) 7695 : cluster [DBG] pgmap v4379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:42.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:42 gibba020 bash[25448]: cluster 2021-03-10T16:18:40.783408+0000 mgr.gibba020.yqfnwy (mgr.34427) 7695 : cluster [DBG] pgmap v4379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:44.581 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:44 gibba020 bash[25448]: cluster 2021-03-10T16:18:42.784682+0000 mgr.gibba020.yqfnwy (mgr.34427) 7696 : cluster [DBG] pgmap v4380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:44.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:44 gibba013 bash[29418]: cluster 2021-03-10T16:18:42.784682+0000 mgr.gibba020.yqfnwy (mgr.34427) 7696 : cluster [DBG] pgmap v4380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:44.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:44 gibba013 bash[30381]: cluster 2021-03-10T16:18:42.784682+0000 mgr.gibba020.yqfnwy (mgr.34427) 7696 : cluster [DBG] pgmap v4380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:46.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:46 gibba013 bash[29418]: cephadm 2021-03-10T16:18:44.580735+0000 mgr.gibba020.yqfnwy (mgr.34427) 7697 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:18:46.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:46 gibba013 bash[29418]: cluster 2021-03-10T16:18:44.786299+0000 mgr.gibba020.yqfnwy (mgr.34427) 7698 : cluster [DBG] pgmap v4381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:46.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:46 gibba013 bash[30381]: cephadm 2021-03-10T16:18:44.580735+0000 mgr.gibba020.yqfnwy (mgr.34427) 7697 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:18:46.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:46 gibba013 bash[30381]: cluster 2021-03-10T16:18:44.786299+0000 mgr.gibba020.yqfnwy (mgr.34427) 7698 : cluster [DBG] pgmap v4381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:46.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:46 gibba020 bash[25448]: cephadm 2021-03-10T16:18:44.580735+0000 mgr.gibba020.yqfnwy (mgr.34427) 7697 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:18:46.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:46 gibba020 bash[25448]: cluster 2021-03-10T16:18:44.786299+0000 mgr.gibba020.yqfnwy (mgr.34427) 7698 : cluster [DBG] pgmap v4381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:47.805 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:18:48.034 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:18:48.034 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 8m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:18:48.035 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 7m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:18:48.035 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:18:48.035 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:18:48.035 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:18:48.035 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:18:48.036 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:18:48.036 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:18:48.036 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:18:48.036 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:18:48.037 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:18:48.037 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:18:48.037 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:18:48.037 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:18:48.037 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:18:48.038 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:18:48.038 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:18:48.038 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:18:48.038 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 7m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:18:48.039 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 7m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:18:48.285 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:18:48.286 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:18:48.286 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:18:48.286 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:18:48.286 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:18:48.287 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:18:48.287 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:18:48.287 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:18:48.287 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:18:48.288 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:18:48.288 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:18:48.288 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:18:48.288 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:18:48.288 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:18:48.289 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:18:48.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:48 gibba013 bash[29418]: cluster 2021-03-10T16:18:46.787918+0000 mgr.gibba020.yqfnwy (mgr.34427) 7699 : cluster [DBG] pgmap v4382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:48.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:48 gibba013 bash[30381]: cluster 2021-03-10T16:18:46.787918+0000 mgr.gibba020.yqfnwy (mgr.34427) 7699 : cluster [DBG] pgmap v4382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:48.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:48 gibba020 bash[25448]: cluster 2021-03-10T16:18:46.787918+0000 mgr.gibba020.yqfnwy (mgr.34427) 7699 : cluster [DBG] pgmap v4382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:49.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:49 gibba013 bash[29418]: audit 2021-03-10T16:18:47.796102+0000 mgr.gibba020.yqfnwy (mgr.34427) 7700 : audit [DBG] from='client.49218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:18:49.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:49 gibba013 bash[29418]: audit 2021-03-10T16:18:48.021735+0000 mgr.gibba020.yqfnwy (mgr.34427) 7701 : audit [DBG] from='client.49224 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:18:49.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:49 gibba013 bash[29418]: audit 2021-03-10T16:18:48.286371+0000 mon.c (mon.1) 123 : audit [DBG] from='client.? 172.21.2.113:0/2387910291' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:49.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:49 gibba013 bash[30381]: audit 2021-03-10T16:18:47.796102+0000 mgr.gibba020.yqfnwy (mgr.34427) 7700 : audit [DBG] from='client.49218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:18:49.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:49 gibba013 bash[30381]: audit 2021-03-10T16:18:48.021735+0000 mgr.gibba020.yqfnwy (mgr.34427) 7701 : audit [DBG] from='client.49224 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:18:49.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:49 gibba013 bash[30381]: audit 2021-03-10T16:18:48.286371+0000 mon.c (mon.1) 123 : audit [DBG] from='client.? 172.21.2.113:0/2387910291' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:49.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:49 gibba020 bash[25448]: audit 2021-03-10T16:18:47.796102+0000 mgr.gibba020.yqfnwy (mgr.34427) 7700 : audit [DBG] from='client.49218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:18:49.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:49 gibba020 bash[25448]: audit 2021-03-10T16:18:48.021735+0000 mgr.gibba020.yqfnwy (mgr.34427) 7701 : audit [DBG] from='client.49224 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:18:49.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:49 gibba020 bash[25448]: audit 2021-03-10T16:18:48.286371+0000 mon.c (mon.1) 123 : audit [DBG] from='client.? 172.21.2.113:0/2387910291' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:18:50.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:50 gibba013 bash[29418]: cluster 2021-03-10T16:18:48.789654+0000 mgr.gibba020.yqfnwy (mgr.34427) 7702 : cluster [DBG] pgmap v4383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:50.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:50 gibba013 bash[30381]: cluster 2021-03-10T16:18:48.789654+0000 mgr.gibba020.yqfnwy (mgr.34427) 7702 : cluster [DBG] pgmap v4383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:50.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:50 gibba020 bash[25448]: cluster 2021-03-10T16:18:48.789654+0000 mgr.gibba020.yqfnwy (mgr.34427) 7702 : cluster [DBG] pgmap v4383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:52.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:52 gibba013 bash[29418]: cluster 2021-03-10T16:18:50.791238+0000 mgr.gibba020.yqfnwy (mgr.34427) 7703 : cluster [DBG] pgmap v4384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:52.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:52 gibba013 bash[30381]: cluster 2021-03-10T16:18:50.791238+0000 mgr.gibba020.yqfnwy (mgr.34427) 7703 : cluster [DBG] pgmap v4384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:52.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:52 gibba020 bash[25448]: cluster 2021-03-10T16:18:50.791238+0000 mgr.gibba020.yqfnwy (mgr.34427) 7703 : cluster [DBG] pgmap v4384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:54.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:54 gibba013 bash[29418]: cluster 2021-03-10T16:18:52.792687+0000 mgr.gibba020.yqfnwy (mgr.34427) 7704 : cluster [DBG] pgmap v4385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:54.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:54 gibba013 bash[30381]: cluster 2021-03-10T16:18:52.792687+0000 mgr.gibba020.yqfnwy (mgr.34427) 7704 : cluster [DBG] pgmap v4385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:54.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:54 gibba020 bash[25448]: cluster 2021-03-10T16:18:52.792687+0000 mgr.gibba020.yqfnwy (mgr.34427) 7704 : cluster [DBG] pgmap v4385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:56.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:56 gibba013 bash[29418]: cluster 2021-03-10T16:18:54.794159+0000 mgr.gibba020.yqfnwy (mgr.34427) 7705 : cluster [DBG] pgmap v4386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:56.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:56 gibba013 bash[30381]: cluster 2021-03-10T16:18:54.794159+0000 mgr.gibba020.yqfnwy (mgr.34427) 7705 : cluster [DBG] pgmap v4386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:56.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:56 gibba020 bash[25448]: cluster 2021-03-10T16:18:54.794159+0000 mgr.gibba020.yqfnwy (mgr.34427) 7705 : cluster [DBG] pgmap v4386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:58.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:18:58 gibba013 bash[29418]: cluster 2021-03-10T16:18:56.795516+0000 mgr.gibba020.yqfnwy (mgr.34427) 7706 : cluster [DBG] pgmap v4387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:58.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:18:58 gibba013 bash[30381]: cluster 2021-03-10T16:18:56.795516+0000 mgr.gibba020.yqfnwy (mgr.34427) 7706 : cluster [DBG] pgmap v4387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:18:58.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:18:58 gibba020 bash[25448]: cluster 2021-03-10T16:18:56.795516+0000 mgr.gibba020.yqfnwy (mgr.34427) 7706 : cluster [DBG] pgmap v4387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:00.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:00 gibba013 bash[29418]: cluster 2021-03-10T16:18:58.796904+0000 mgr.gibba020.yqfnwy (mgr.34427) 7707 : cluster [DBG] pgmap v4388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:00.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:00 gibba013 bash[30381]: cluster 2021-03-10T16:18:58.796904+0000 mgr.gibba020.yqfnwy (mgr.34427) 7707 : cluster [DBG] pgmap v4388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:00.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:00 gibba020 bash[25448]: cluster 2021-03-10T16:18:58.796904+0000 mgr.gibba020.yqfnwy (mgr.34427) 7707 : cluster [DBG] pgmap v4388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:01.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:01 gibba013 bash[29418]: cephadm 2021-03-10T16:18:59.596112+0000 mgr.gibba020.yqfnwy (mgr.34427) 7708 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:19:01.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:01 gibba013 bash[30381]: cephadm 2021-03-10T16:18:59.596112+0000 mgr.gibba020.yqfnwy (mgr.34427) 7708 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:19:01.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:01 gibba020 bash[25448]: cephadm 2021-03-10T16:18:59.596112+0000 mgr.gibba020.yqfnwy (mgr.34427) 7708 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:19:02.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:02 gibba013 bash[29418]: cluster 2021-03-10T16:19:00.798597+0000 mgr.gibba020.yqfnwy (mgr.34427) 7709 : cluster [DBG] pgmap v4389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:02.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:02 gibba013 bash[30381]: cluster 2021-03-10T16:19:00.798597+0000 mgr.gibba020.yqfnwy (mgr.34427) 7709 : cluster [DBG] pgmap v4389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:02.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:02 gibba020 bash[25448]: cluster 2021-03-10T16:19:00.798597+0000 mgr.gibba020.yqfnwy (mgr.34427) 7709 : cluster [DBG] pgmap v4389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:04.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:04 gibba013 bash[29418]: cluster 2021-03-10T16:19:02.800019+0000 mgr.gibba020.yqfnwy (mgr.34427) 7710 : cluster [DBG] pgmap v4390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:04.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:04 gibba013 bash[30381]: cluster 2021-03-10T16:19:02.800019+0000 mgr.gibba020.yqfnwy (mgr.34427) 7710 : cluster [DBG] pgmap v4390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:04.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:04 gibba020 bash[25448]: cluster 2021-03-10T16:19:02.800019+0000 mgr.gibba020.yqfnwy (mgr.34427) 7710 : cluster [DBG] pgmap v4390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:06.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:06 gibba013 bash[29418]: cluster 2021-03-10T16:19:04.801432+0000 mgr.gibba020.yqfnwy (mgr.34427) 7711 : cluster [DBG] pgmap v4391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:06.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:06 gibba013 bash[30381]: cluster 2021-03-10T16:19:04.801432+0000 mgr.gibba020.yqfnwy (mgr.34427) 7711 : cluster [DBG] pgmap v4391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:06.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:06 gibba020 bash[25448]: cluster 2021-03-10T16:19:04.801432+0000 mgr.gibba020.yqfnwy (mgr.34427) 7711 : cluster [DBG] pgmap v4391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:07.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:07 gibba013 bash[29418]: audit 2021-03-10T16:19:06.671272+0000 mon.a (mon.0) 2877 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:19:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:07 gibba013 bash[29418]: audit 2021-03-10T16:19:06.793479+0000 mon.a (mon.0) 2878 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:19:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:07 gibba013 bash[29418]: audit 2021-03-10T16:19:07.037135+0000 mon.a (mon.0) 2879 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:19:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:07 gibba013 bash[29418]: audit 2021-03-10T16:19:07.037849+0000 mon.a (mon.0) 2880 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:19:07.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:07 gibba013 bash[29418]: audit 2021-03-10T16:19:07.038566+0000 mon.a (mon.0) 2881 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T16:19:07.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:07 gibba013 bash[29418]: audit 2021-03-10T16:19:07.039341+0000 mon.a (mon.0) 2882 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:19:07.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:07 gibba013 bash[30381]: audit 2021-03-10T16:19:06.671272+0000 mon.a (mon.0) 2877 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:19:07.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:07 gibba013 bash[30381]: audit 2021-03-10T16:19:06.793479+0000 mon.a (mon.0) 2878 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:19:07.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:07 gibba013 bash[30381]: audit 2021-03-10T16:19:07.037135+0000 mon.a (mon.0) 2879 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:19:07.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:07 gibba013 bash[30381]: audit 2021-03-10T16:19:07.037849+0000 mon.a (mon.0) 2880 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:19:07.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:07 gibba013 bash[30381]: audit 2021-03-10T16:19:07.038566+0000 mon.a (mon.0) 2881 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T16:19:07.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:07 gibba013 bash[30381]: audit 2021-03-10T16:19:07.039341+0000 mon.a (mon.0) 2882 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:19:07.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:07 gibba020 bash[25448]: audit 2021-03-10T16:19:06.671272+0000 mon.a (mon.0) 2877 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:19:07.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:07 gibba020 bash[25448]: audit 2021-03-10T16:19:06.793479+0000 mon.a (mon.0) 2878 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:19:07.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:07 gibba020 bash[25448]: audit 2021-03-10T16:19:07.037135+0000 mon.a (mon.0) 2879 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:19:07.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:07 gibba020 bash[25448]: audit 2021-03-10T16:19:07.037849+0000 mon.a (mon.0) 2880 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:19:07.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:07 gibba020 bash[25448]: audit 2021-03-10T16:19:07.038566+0000 mon.a (mon.0) 2881 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T16:19:07.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:07 gibba020 bash[25448]: audit 2021-03-10T16:19:07.039341+0000 mon.a (mon.0) 2882 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:19:08.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:08 gibba013 bash[29418]: cluster 2021-03-10T16:19:06.802906+0000 mgr.gibba020.yqfnwy (mgr.34427) 7712 : cluster [DBG] pgmap v4392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:08.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:08 gibba013 bash[30381]: cluster 2021-03-10T16:19:06.802906+0000 mgr.gibba020.yqfnwy (mgr.34427) 7712 : cluster [DBG] pgmap v4392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:08.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:08 gibba020 bash[25448]: cluster 2021-03-10T16:19:06.802906+0000 mgr.gibba020.yqfnwy (mgr.34427) 7712 : cluster [DBG] pgmap v4392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:10.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:10 gibba013 bash[29418]: cluster 2021-03-10T16:19:08.804584+0000 mgr.gibba020.yqfnwy (mgr.34427) 7713 : cluster [DBG] pgmap v4393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:10.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:10 gibba013 bash[30381]: cluster 2021-03-10T16:19:08.804584+0000 mgr.gibba020.yqfnwy (mgr.34427) 7713 : cluster [DBG] pgmap v4393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:10.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:10 gibba020 bash[25448]: cluster 2021-03-10T16:19:08.804584+0000 mgr.gibba020.yqfnwy (mgr.34427) 7713 : cluster [DBG] pgmap v4393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:12.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:12 gibba013 bash[29418]: cluster 2021-03-10T16:19:10.806224+0000 mgr.gibba020.yqfnwy (mgr.34427) 7714 : cluster [DBG] pgmap v4394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:12.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:12 gibba013 bash[30381]: cluster 2021-03-10T16:19:10.806224+0000 mgr.gibba020.yqfnwy (mgr.34427) 7714 : cluster [DBG] pgmap v4394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:12.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:12 gibba020 bash[25448]: cluster 2021-03-10T16:19:10.806224+0000 mgr.gibba020.yqfnwy (mgr.34427) 7714 : cluster [DBG] pgmap v4394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:14.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:14 gibba013 bash[29418]: cluster 2021-03-10T16:19:12.807730+0000 mgr.gibba020.yqfnwy (mgr.34427) 7715 : cluster [DBG] pgmap v4395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:14.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:14 gibba013 bash[30381]: cluster 2021-03-10T16:19:12.807730+0000 mgr.gibba020.yqfnwy (mgr.34427) 7715 : cluster [DBG] pgmap v4395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:14.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:14 gibba020 bash[25448]: cluster 2021-03-10T16:19:12.807730+0000 mgr.gibba020.yqfnwy (mgr.34427) 7715 : cluster [DBG] pgmap v4395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:15.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:15 gibba013 bash[29418]: audit 2021-03-10T16:19:14.613562+0000 mon.a (mon.0) 2883 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:19:15.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:15 gibba013 bash[29418]: audit 2021-03-10T16:19:14.620698+0000 mon.a (mon.0) 2884 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T16:19:15.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:15 gibba013 bash[30381]: audit 2021-03-10T16:19:14.613562+0000 mon.a (mon.0) 2883 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:19:15.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:15 gibba013 bash[30381]: audit 2021-03-10T16:19:14.620698+0000 mon.a (mon.0) 2884 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T16:19:15.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:15 gibba020 bash[25448]: audit 2021-03-10T16:19:14.613562+0000 mon.a (mon.0) 2883 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:19:15.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:15 gibba020 bash[25448]: audit 2021-03-10T16:19:14.620698+0000 mon.a (mon.0) 2884 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T16:19:16.627 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:16 gibba013 bash[30381]: cephadm 2021-03-10T16:19:14.619217+0000 mgr.gibba020.yqfnwy (mgr.34427) 7716 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:19:16.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:16 gibba013 bash[30381]: cluster 2021-03-10T16:19:14.808324+0000 mgr.gibba020.yqfnwy (mgr.34427) 7717 : cluster [DBG] pgmap v4396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:16.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:16 gibba013 bash[29418]: cephadm 2021-03-10T16:19:14.619217+0000 mgr.gibba020.yqfnwy (mgr.34427) 7716 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:19:16.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:16 gibba013 bash[29418]: cluster 2021-03-10T16:19:14.808324+0000 mgr.gibba020.yqfnwy (mgr.34427) 7717 : cluster [DBG] pgmap v4396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:16.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:16 gibba020 bash[25448]: cephadm 2021-03-10T16:19:14.619217+0000 mgr.gibba020.yqfnwy (mgr.34427) 7716 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:19:16.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:16 gibba020 bash[25448]: cluster 2021-03-10T16:19:14.808324+0000 mgr.gibba020.yqfnwy (mgr.34427) 7717 : cluster [DBG] pgmap v4396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:18.541 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:19:18.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:18 gibba020 bash[25448]: cluster 2021-03-10T16:19:16.809552+0000 mgr.gibba020.yqfnwy (mgr.34427) 7718 : cluster [DBG] pgmap v4397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:18.723 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:18 gibba013 bash[29418]: cluster 2021-03-10T16:19:16.809552+0000 mgr.gibba020.yqfnwy (mgr.34427) 7718 : cluster [DBG] pgmap v4397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:18.723 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:18 gibba013 bash[30381]: cluster 2021-03-10T16:19:16.809552+0000 mgr.gibba020.yqfnwy (mgr.34427) 7718 : cluster [DBG] pgmap v4397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:18.775 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:19:18.776 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 9m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:19:18.776 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 8m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:19:18.776 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:19:18.776 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:19:18.777 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:19:18.777 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:19:18.777 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:19:18.777 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:19:18.777 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:19:18.778 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:19:18.778 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:19:18.778 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:19:18.778 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:19:18.779 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:19:18.779 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:19:18.779 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:19:18.779 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:19:18.779 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:19:18.780 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 8m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:19:18.780 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 8m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:19:19.026 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:19:19.027 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:19:19.027 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:19:19.027 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:19:19.028 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:19:19.028 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:19:19.028 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:19:19.028 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:19:19.029 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:19:19.029 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:19:19.029 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:19:19.029 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:19:19.030 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:19:19.030 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:19:19.030 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:19:20.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:19 gibba013 bash[29418]: audit 2021-03-10T16:19:18.532198+0000 mgr.gibba020.yqfnwy (mgr.34427) 7719 : audit [DBG] from='client.49236 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:19:20.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:19 gibba013 bash[29418]: audit 2021-03-10T16:19:18.763488+0000 mgr.gibba020.yqfnwy (mgr.34427) 7720 : audit [DBG] from='client.49242 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:19:20.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:19 gibba013 bash[29418]: cluster 2021-03-10T16:19:18.810356+0000 mgr.gibba020.yqfnwy (mgr.34427) 7721 : cluster [DBG] pgmap v4398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:20.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:19 gibba013 bash[29418]: audit 2021-03-10T16:19:19.027483+0000 mon.a (mon.0) 2885 : audit [DBG] from='client.? 172.21.2.113:0/535829827' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:20.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:19 gibba013 bash[29418]: audit 2021-03-10T16:19:19.174227+0000 mon.a (mon.0) 2886 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:19:20.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:19 gibba013 bash[29418]: audit 2021-03-10T16:19:19.352352+0000 mon.a (mon.0) 2887 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:19:20.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:19 gibba013 bash[29418]: cephadm 2021-03-10T16:19:19.353282+0000 mgr.gibba020.yqfnwy (mgr.34427) 7722 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:19:20.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:19 gibba013 bash[29418]: audit 2021-03-10T16:19:19.586671+0000 mon.a (mon.0) 2888 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:19:20.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:19 gibba013 bash[29418]: audit 2021-03-10T16:19:19.593743+0000 mon.a (mon.0) 2889 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:19:20.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:19 gibba013 bash[29418]: audit 2021-03-10T16:19:19.595758+0000 mon.a (mon.0) 2890 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:20.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:19 gibba013 bash[29418]: audit 2021-03-10T16:19:19.597361+0000 mon.a (mon.0) 2891 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:20.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:19 gibba013 bash[29418]: audit 2021-03-10T16:19:19.598905+0000 mon.a (mon.0) 2892 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:20.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:19 gibba013 bash[29418]: audit 2021-03-10T16:19:19.601814+0000 mon.a (mon.0) 2893 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:20.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:19 gibba013 bash[29418]: audit 2021-03-10T16:19:19.603270+0000 mon.a (mon.0) 2894 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:20.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:19 gibba013 bash[30381]: audit 2021-03-10T16:19:18.532198+0000 mgr.gibba020.yqfnwy (mgr.34427) 7719 : audit [DBG] from='client.49236 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:19:20.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:19 gibba013 bash[30381]: audit 2021-03-10T16:19:18.763488+0000 mgr.gibba020.yqfnwy (mgr.34427) 7720 : audit [DBG] from='client.49242 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:19:20.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:19 gibba013 bash[30381]: cluster 2021-03-10T16:19:18.810356+0000 mgr.gibba020.yqfnwy (mgr.34427) 7721 : cluster [DBG] pgmap v4398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:20.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:19 gibba013 bash[30381]: audit 2021-03-10T16:19:19.027483+0000 mon.a (mon.0) 2885 : audit [DBG] from='client.? 172.21.2.113:0/535829827' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:20.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:19 gibba013 bash[30381]: audit 2021-03-10T16:19:19.174227+0000 mon.a (mon.0) 2886 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:19:20.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:19 gibba013 bash[30381]: audit 2021-03-10T16:19:19.352352+0000 mon.a (mon.0) 2887 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:19:20.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:19 gibba013 bash[30381]: cephadm 2021-03-10T16:19:19.353282+0000 mgr.gibba020.yqfnwy (mgr.34427) 7722 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:19:20.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:19 gibba013 bash[30381]: audit 2021-03-10T16:19:19.586671+0000 mon.a (mon.0) 2888 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:19:20.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:19 gibba013 bash[30381]: audit 2021-03-10T16:19:19.593743+0000 mon.a (mon.0) 2889 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:19:20.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:19 gibba013 bash[30381]: audit 2021-03-10T16:19:19.595758+0000 mon.a (mon.0) 2890 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:20.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:19 gibba013 bash[30381]: audit 2021-03-10T16:19:19.597361+0000 mon.a (mon.0) 2891 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:20.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:19 gibba013 bash[30381]: audit 2021-03-10T16:19:19.598905+0000 mon.a (mon.0) 2892 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:20.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:19 gibba013 bash[30381]: audit 2021-03-10T16:19:19.601814+0000 mon.a (mon.0) 2893 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:20.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:19 gibba013 bash[30381]: audit 2021-03-10T16:19:19.603270+0000 mon.a (mon.0) 2894 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:20.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:19 gibba020 bash[25448]: audit 2021-03-10T16:19:18.532198+0000 mgr.gibba020.yqfnwy (mgr.34427) 7719 : audit [DBG] from='client.49236 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:19:20.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:19 gibba020 bash[25448]: audit 2021-03-10T16:19:18.763488+0000 mgr.gibba020.yqfnwy (mgr.34427) 7720 : audit [DBG] from='client.49242 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:19:20.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:19 gibba020 bash[25448]: cluster 2021-03-10T16:19:18.810356+0000 mgr.gibba020.yqfnwy (mgr.34427) 7721 : cluster [DBG] pgmap v4398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:20.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:19 gibba020 bash[25448]: audit 2021-03-10T16:19:19.027483+0000 mon.a (mon.0) 2885 : audit [DBG] from='client.? 172.21.2.113:0/535829827' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:20.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:19 gibba020 bash[25448]: audit 2021-03-10T16:19:19.174227+0000 mon.a (mon.0) 2886 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:19:20.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:19 gibba020 bash[25448]: audit 2021-03-10T16:19:19.352352+0000 mon.a (mon.0) 2887 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:19:20.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:19 gibba020 bash[25448]: cephadm 2021-03-10T16:19:19.353282+0000 mgr.gibba020.yqfnwy (mgr.34427) 7722 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:19:20.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:19 gibba020 bash[25448]: audit 2021-03-10T16:19:19.586671+0000 mon.a (mon.0) 2888 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:19:20.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:19 gibba020 bash[25448]: audit 2021-03-10T16:19:19.593743+0000 mon.a (mon.0) 2889 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:19:20.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:19 gibba020 bash[25448]: audit 2021-03-10T16:19:19.595758+0000 mon.a (mon.0) 2890 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:20.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:19 gibba020 bash[25448]: audit 2021-03-10T16:19:19.597361+0000 mon.a (mon.0) 2891 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:20.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:19 gibba020 bash[25448]: audit 2021-03-10T16:19:19.598905+0000 mon.a (mon.0) 2892 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:20.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:19 gibba020 bash[25448]: audit 2021-03-10T16:19:19.601814+0000 mon.a (mon.0) 2893 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:20.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:19 gibba020 bash[25448]: audit 2021-03-10T16:19:19.603270+0000 mon.a (mon.0) 2894 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:21.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:21 gibba013 bash[29418]: cephadm 2021-03-10T16:19:19.592103+0000 mgr.gibba020.yqfnwy (mgr.34427) 7723 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:19:21.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:21 gibba013 bash[29418]: cephadm 2021-03-10T16:19:19.594306+0000 mgr.gibba020.yqfnwy (mgr.34427) 7724 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:19:21.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:21 gibba013 bash[29418]: cephadm 2021-03-10T16:19:19.595982+0000 mgr.gibba020.yqfnwy (mgr.34427) 7725 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:19:21.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:21 gibba013 bash[29418]: cephadm 2021-03-10T16:19:19.596023+0000 mgr.gibba020.yqfnwy (mgr.34427) 7726 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:19:21.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:21 gibba013 bash[29418]: cephadm 2021-03-10T16:19:19.597539+0000 mgr.gibba020.yqfnwy (mgr.34427) 7727 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:19:21.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:21 gibba013 bash[29418]: cephadm 2021-03-10T16:19:19.597577+0000 mgr.gibba020.yqfnwy (mgr.34427) 7728 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:19:21.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:21 gibba013 bash[29418]: cephadm 2021-03-10T16:19:19.599181+0000 mgr.gibba020.yqfnwy (mgr.34427) 7729 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:19:21.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:21 gibba013 bash[29418]: cephadm 2021-03-10T16:19:19.600439+0000 mgr.gibba020.yqfnwy (mgr.34427) 7730 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:19:21.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:21 gibba013 bash[29418]: cephadm 2021-03-10T16:19:19.600477+0000 mgr.gibba020.yqfnwy (mgr.34427) 7731 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:19:21.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:21 gibba013 bash[29418]: cephadm 2021-03-10T16:19:19.601937+0000 mgr.gibba020.yqfnwy (mgr.34427) 7732 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:19:21.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:21 gibba013 bash[29418]: cephadm 2021-03-10T16:19:19.602256+0000 mgr.gibba020.yqfnwy (mgr.34427) 7733 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:19:21.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:21 gibba013 bash[29418]: cephadm 2021-03-10T16:19:19.603336+0000 mgr.gibba020.yqfnwy (mgr.34427) 7734 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:19:21.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:21 gibba013 bash[29418]: cephadm 2021-03-10T16:19:19.603373+0000 mgr.gibba020.yqfnwy (mgr.34427) 7735 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:19:21.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:21 gibba013 bash[29418]: cephadm 2021-03-10T16:19:19.603475+0000 mgr.gibba020.yqfnwy (mgr.34427) 7736 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:19:21.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:21 gibba013 bash[30381]: cephadm 2021-03-10T16:19:19.592103+0000 mgr.gibba020.yqfnwy (mgr.34427) 7723 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:19:21.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:21 gibba013 bash[30381]: cephadm 2021-03-10T16:19:19.594306+0000 mgr.gibba020.yqfnwy (mgr.34427) 7724 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:19:21.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:21 gibba013 bash[30381]: cephadm 2021-03-10T16:19:19.595982+0000 mgr.gibba020.yqfnwy (mgr.34427) 7725 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:19:21.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:21 gibba013 bash[30381]: cephadm 2021-03-10T16:19:19.596023+0000 mgr.gibba020.yqfnwy (mgr.34427) 7726 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:19:21.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:21 gibba013 bash[30381]: cephadm 2021-03-10T16:19:19.597539+0000 mgr.gibba020.yqfnwy (mgr.34427) 7727 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:19:21.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:21 gibba013 bash[30381]: cephadm 2021-03-10T16:19:19.597577+0000 mgr.gibba020.yqfnwy (mgr.34427) 7728 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:19:21.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:21 gibba013 bash[30381]: cephadm 2021-03-10T16:19:19.599181+0000 mgr.gibba020.yqfnwy (mgr.34427) 7729 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:19:21.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:21 gibba013 bash[30381]: cephadm 2021-03-10T16:19:19.600439+0000 mgr.gibba020.yqfnwy (mgr.34427) 7730 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:19:21.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:21 gibba013 bash[30381]: cephadm 2021-03-10T16:19:19.600477+0000 mgr.gibba020.yqfnwy (mgr.34427) 7731 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:19:21.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:21 gibba013 bash[30381]: cephadm 2021-03-10T16:19:19.601937+0000 mgr.gibba020.yqfnwy (mgr.34427) 7732 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:19:21.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:21 gibba013 bash[30381]: cephadm 2021-03-10T16:19:19.602256+0000 mgr.gibba020.yqfnwy (mgr.34427) 7733 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:19:21.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:21 gibba013 bash[30381]: cephadm 2021-03-10T16:19:19.603336+0000 mgr.gibba020.yqfnwy (mgr.34427) 7734 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:19:21.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:21 gibba013 bash[30381]: cephadm 2021-03-10T16:19:19.603373+0000 mgr.gibba020.yqfnwy (mgr.34427) 7735 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:19:21.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:21 gibba013 bash[30381]: cephadm 2021-03-10T16:19:19.603475+0000 mgr.gibba020.yqfnwy (mgr.34427) 7736 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:19:21.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:21 gibba020 bash[25448]: cephadm 2021-03-10T16:19:19.592103+0000 mgr.gibba020.yqfnwy (mgr.34427) 7723 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:19:21.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:21 gibba020 bash[25448]: cephadm 2021-03-10T16:19:19.594306+0000 mgr.gibba020.yqfnwy (mgr.34427) 7724 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:19:21.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:21 gibba020 bash[25448]: cephadm 2021-03-10T16:19:19.595982+0000 mgr.gibba020.yqfnwy (mgr.34427) 7725 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:19:21.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:21 gibba020 bash[25448]: cephadm 2021-03-10T16:19:19.596023+0000 mgr.gibba020.yqfnwy (mgr.34427) 7726 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:19:21.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:21 gibba020 bash[25448]: cephadm 2021-03-10T16:19:19.597539+0000 mgr.gibba020.yqfnwy (mgr.34427) 7727 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:19:21.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:21 gibba020 bash[25448]: cephadm 2021-03-10T16:19:19.597577+0000 mgr.gibba020.yqfnwy (mgr.34427) 7728 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:19:21.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:21 gibba020 bash[25448]: cephadm 2021-03-10T16:19:19.599181+0000 mgr.gibba020.yqfnwy (mgr.34427) 7729 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:19:21.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:21 gibba020 bash[25448]: cephadm 2021-03-10T16:19:19.600439+0000 mgr.gibba020.yqfnwy (mgr.34427) 7730 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:19:21.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:21 gibba020 bash[25448]: cephadm 2021-03-10T16:19:19.600477+0000 mgr.gibba020.yqfnwy (mgr.34427) 7731 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:19:21.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:21 gibba020 bash[25448]: cephadm 2021-03-10T16:19:19.601937+0000 mgr.gibba020.yqfnwy (mgr.34427) 7732 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:19:21.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:21 gibba020 bash[25448]: cephadm 2021-03-10T16:19:19.602256+0000 mgr.gibba020.yqfnwy (mgr.34427) 7733 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:19:21.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:21 gibba020 bash[25448]: cephadm 2021-03-10T16:19:19.603336+0000 mgr.gibba020.yqfnwy (mgr.34427) 7734 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:19:21.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:21 gibba020 bash[25448]: cephadm 2021-03-10T16:19:19.603373+0000 mgr.gibba020.yqfnwy (mgr.34427) 7735 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:19:21.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:21 gibba020 bash[25448]: cephadm 2021-03-10T16:19:19.603475+0000 mgr.gibba020.yqfnwy (mgr.34427) 7736 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:19:22.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:22 gibba013 bash[29418]: cluster 2021-03-10T16:19:20.811859+0000 mgr.gibba020.yqfnwy (mgr.34427) 7737 : cluster [DBG] pgmap v4399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:22.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:22 gibba013 bash[30381]: cluster 2021-03-10T16:19:20.811859+0000 mgr.gibba020.yqfnwy (mgr.34427) 7737 : cluster [DBG] pgmap v4399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:22.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:22 gibba020 bash[25448]: cluster 2021-03-10T16:19:20.811859+0000 mgr.gibba020.yqfnwy (mgr.34427) 7737 : cluster [DBG] pgmap v4399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:24.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:24 gibba013 bash[29418]: cluster 2021-03-10T16:19:22.813404+0000 mgr.gibba020.yqfnwy (mgr.34427) 7738 : cluster [DBG] pgmap v4400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:24.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:24 gibba013 bash[30381]: cluster 2021-03-10T16:19:22.813404+0000 mgr.gibba020.yqfnwy (mgr.34427) 7738 : cluster [DBG] pgmap v4400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:24.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:24 gibba020 bash[25448]: cluster 2021-03-10T16:19:22.813404+0000 mgr.gibba020.yqfnwy (mgr.34427) 7738 : cluster [DBG] pgmap v4400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:26.377 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:26 gibba013 bash[30381]: cluster 2021-03-10T16:19:24.815165+0000 mgr.gibba020.yqfnwy (mgr.34427) 7739 : cluster [DBG] pgmap v4401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:26.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:26 gibba013 bash[29418]: cluster 2021-03-10T16:19:24.815165+0000 mgr.gibba020.yqfnwy (mgr.34427) 7739 : cluster [DBG] pgmap v4401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:26.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:26 gibba020 bash[25448]: cluster 2021-03-10T16:19:24.815165+0000 mgr.gibba020.yqfnwy (mgr.34427) 7739 : cluster [DBG] pgmap v4401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:28.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:28 gibba013 bash[29418]: cluster 2021-03-10T16:19:26.816650+0000 mgr.gibba020.yqfnwy (mgr.34427) 7740 : cluster [DBG] pgmap v4402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:28.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:28 gibba013 bash[30381]: cluster 2021-03-10T16:19:26.816650+0000 mgr.gibba020.yqfnwy (mgr.34427) 7740 : cluster [DBG] pgmap v4402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:28.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:28 gibba020 bash[25448]: cluster 2021-03-10T16:19:26.816650+0000 mgr.gibba020.yqfnwy (mgr.34427) 7740 : cluster [DBG] pgmap v4402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:30.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:30 gibba013 bash[29418]: cluster 2021-03-10T16:19:28.818133+0000 mgr.gibba020.yqfnwy (mgr.34427) 7741 : cluster [DBG] pgmap v4403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:30.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:30 gibba013 bash[30381]: cluster 2021-03-10T16:19:28.818133+0000 mgr.gibba020.yqfnwy (mgr.34427) 7741 : cluster [DBG] pgmap v4403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:30.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:30 gibba020 bash[25448]: cluster 2021-03-10T16:19:28.818133+0000 mgr.gibba020.yqfnwy (mgr.34427) 7741 : cluster [DBG] pgmap v4403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:32.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:32 gibba013 bash[29418]: cluster 2021-03-10T16:19:30.819897+0000 mgr.gibba020.yqfnwy (mgr.34427) 7742 : cluster [DBG] pgmap v4404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:32.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:32 gibba013 bash[30381]: cluster 2021-03-10T16:19:30.819897+0000 mgr.gibba020.yqfnwy (mgr.34427) 7742 : cluster [DBG] pgmap v4404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:32.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:32 gibba020 bash[25448]: cluster 2021-03-10T16:19:30.819897+0000 mgr.gibba020.yqfnwy (mgr.34427) 7742 : cluster [DBG] pgmap v4404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:34.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:34 gibba013 bash[29418]: cluster 2021-03-10T16:19:32.821453+0000 mgr.gibba020.yqfnwy (mgr.34427) 7743 : cluster [DBG] pgmap v4405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:34.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:34 gibba013 bash[30381]: cluster 2021-03-10T16:19:32.821453+0000 mgr.gibba020.yqfnwy (mgr.34427) 7743 : cluster [DBG] pgmap v4405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:34.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:34 gibba020 bash[25448]: cluster 2021-03-10T16:19:32.821453+0000 mgr.gibba020.yqfnwy (mgr.34427) 7743 : cluster [DBG] pgmap v4405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:36.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:36 gibba013 bash[29418]: cephadm 2021-03-10T16:19:34.619557+0000 mgr.gibba020.yqfnwy (mgr.34427) 7744 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:19:36.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:36 gibba013 bash[29418]: cluster 2021-03-10T16:19:34.823055+0000 mgr.gibba020.yqfnwy (mgr.34427) 7745 : cluster [DBG] pgmap v4406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:36.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:36 gibba013 bash[30381]: cephadm 2021-03-10T16:19:34.619557+0000 mgr.gibba020.yqfnwy (mgr.34427) 7744 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:19:36.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:36 gibba013 bash[30381]: cluster 2021-03-10T16:19:34.823055+0000 mgr.gibba020.yqfnwy (mgr.34427) 7745 : cluster [DBG] pgmap v4406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:36.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:36 gibba020 bash[25448]: cephadm 2021-03-10T16:19:34.619557+0000 mgr.gibba020.yqfnwy (mgr.34427) 7744 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:19:36.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:36 gibba020 bash[25448]: cluster 2021-03-10T16:19:34.823055+0000 mgr.gibba020.yqfnwy (mgr.34427) 7745 : cluster [DBG] pgmap v4406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:38.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:38 gibba013 bash[29418]: cluster 2021-03-10T16:19:36.824727+0000 mgr.gibba020.yqfnwy (mgr.34427) 7746 : cluster [DBG] pgmap v4407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:38.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:38 gibba013 bash[30381]: cluster 2021-03-10T16:19:36.824727+0000 mgr.gibba020.yqfnwy (mgr.34427) 7746 : cluster [DBG] pgmap v4407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:38.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:38 gibba020 bash[25448]: cluster 2021-03-10T16:19:36.824727+0000 mgr.gibba020.yqfnwy (mgr.34427) 7746 : cluster [DBG] pgmap v4407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:40.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:40 gibba013 bash[29418]: cluster 2021-03-10T16:19:38.826380+0000 mgr.gibba020.yqfnwy (mgr.34427) 7747 : cluster [DBG] pgmap v4408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:40.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:40 gibba013 bash[30381]: cluster 2021-03-10T16:19:38.826380+0000 mgr.gibba020.yqfnwy (mgr.34427) 7747 : cluster [DBG] pgmap v4408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:40.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:40 gibba020 bash[25448]: cluster 2021-03-10T16:19:38.826380+0000 mgr.gibba020.yqfnwy (mgr.34427) 7747 : cluster [DBG] pgmap v4408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:42.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:42 gibba013 bash[29418]: cluster 2021-03-10T16:19:40.828007+0000 mgr.gibba020.yqfnwy (mgr.34427) 7748 : cluster [DBG] pgmap v4409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:42.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:42 gibba013 bash[30381]: cluster 2021-03-10T16:19:40.828007+0000 mgr.gibba020.yqfnwy (mgr.34427) 7748 : cluster [DBG] pgmap v4409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:42.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:42 gibba020 bash[25448]: cluster 2021-03-10T16:19:40.828007+0000 mgr.gibba020.yqfnwy (mgr.34427) 7748 : cluster [DBG] pgmap v4409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:44.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:44 gibba013 bash[29418]: cluster 2021-03-10T16:19:42.829587+0000 mgr.gibba020.yqfnwy (mgr.34427) 7749 : cluster [DBG] pgmap v4410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:44.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:44 gibba013 bash[30381]: cluster 2021-03-10T16:19:42.829587+0000 mgr.gibba020.yqfnwy (mgr.34427) 7749 : cluster [DBG] pgmap v4410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:44.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:44 gibba020 bash[25448]: cluster 2021-03-10T16:19:42.829587+0000 mgr.gibba020.yqfnwy (mgr.34427) 7749 : cluster [DBG] pgmap v4410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:46.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:46 gibba013 bash[29418]: cluster 2021-03-10T16:19:44.831136+0000 mgr.gibba020.yqfnwy (mgr.34427) 7750 : cluster [DBG] pgmap v4411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:46.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:46 gibba013 bash[30381]: cluster 2021-03-10T16:19:44.831136+0000 mgr.gibba020.yqfnwy (mgr.34427) 7750 : cluster [DBG] pgmap v4411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:46.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:46 gibba020 bash[25448]: cluster 2021-03-10T16:19:44.831136+0000 mgr.gibba020.yqfnwy (mgr.34427) 7750 : cluster [DBG] pgmap v4411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:48.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:48 gibba013 bash[29418]: cluster 2021-03-10T16:19:46.832101+0000 mgr.gibba020.yqfnwy (mgr.34427) 7751 : cluster [DBG] pgmap v4412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:48.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:48 gibba013 bash[30381]: cluster 2021-03-10T16:19:46.832101+0000 mgr.gibba020.yqfnwy (mgr.34427) 7751 : cluster [DBG] pgmap v4412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:48.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:48 gibba020 bash[25448]: cluster 2021-03-10T16:19:46.832101+0000 mgr.gibba020.yqfnwy (mgr.34427) 7751 : cluster [DBG] pgmap v4412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:49.268 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:19:49.497 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:19:49.498 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 9m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:19:49.498 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 8m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:19:49.498 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:19:49.498 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:19:49.499 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:19:49.499 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:19:49.499 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:19:49.499 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:19:49.499 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:19:49.500 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:19:49.500 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:19:49.500 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:19:49.500 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:19:49.501 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:19:49.501 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:19:49.501 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:19:49.501 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:19:49.501 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:19:49.502 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 8m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:19:49.502 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 8m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:19:49.744 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:19:49.744 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:19:49.744 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:19:49.744 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:19:49.745 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:19:49.745 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:19:49.745 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:19:49.745 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:19:49.746 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:19:49.746 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:19:49.746 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:19:49.746 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:19:49.747 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:19:49.747 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:19:49.747 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:19:50.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:50 gibba013 bash[29418]: cluster 2021-03-10T16:19:48.833627+0000 mgr.gibba020.yqfnwy (mgr.34427) 7752 : cluster [DBG] pgmap v4413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:50.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:50 gibba013 bash[29418]: audit 2021-03-10T16:19:49.258769+0000 mgr.gibba020.yqfnwy (mgr.34427) 7753 : audit [DBG] from='client.49254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:19:50.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:50 gibba013 bash[29418]: audit 2021-03-10T16:19:49.744632+0000 mon.c (mon.1) 124 : audit [DBG] from='client.? 172.21.2.113:0/573188699' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:50.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:50 gibba013 bash[30381]: cluster 2021-03-10T16:19:48.833627+0000 mgr.gibba020.yqfnwy (mgr.34427) 7752 : cluster [DBG] pgmap v4413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:50.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:50 gibba013 bash[30381]: audit 2021-03-10T16:19:49.258769+0000 mgr.gibba020.yqfnwy (mgr.34427) 7753 : audit [DBG] from='client.49254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:19:50.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:50 gibba013 bash[30381]: audit 2021-03-10T16:19:49.744632+0000 mon.c (mon.1) 124 : audit [DBG] from='client.? 172.21.2.113:0/573188699' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:50.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:50 gibba020 bash[25448]: cluster 2021-03-10T16:19:48.833627+0000 mgr.gibba020.yqfnwy (mgr.34427) 7752 : cluster [DBG] pgmap v4413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:50.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:50 gibba020 bash[25448]: audit 2021-03-10T16:19:49.258769+0000 mgr.gibba020.yqfnwy (mgr.34427) 7753 : audit [DBG] from='client.49254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:19:50.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:50 gibba020 bash[25448]: audit 2021-03-10T16:19:49.744632+0000 mon.c (mon.1) 124 : audit [DBG] from='client.? 172.21.2.113:0/573188699' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:19:51.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:51 gibba020 bash[25448]: audit 2021-03-10T16:19:49.485456+0000 mgr.gibba020.yqfnwy (mgr.34427) 7754 : audit [DBG] from='client.49260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:19:51.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:51 gibba020 bash[25448]: cephadm 2021-03-10T16:19:49.628890+0000 mgr.gibba020.yqfnwy (mgr.34427) 7755 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:19:51.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:51 gibba013 bash[29418]: audit 2021-03-10T16:19:49.485456+0000 mgr.gibba020.yqfnwy (mgr.34427) 7754 : audit [DBG] from='client.49260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:19:51.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:51 gibba013 bash[29418]: cephadm 2021-03-10T16:19:49.628890+0000 mgr.gibba020.yqfnwy (mgr.34427) 7755 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:19:51.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:51 gibba013 bash[30381]: audit 2021-03-10T16:19:49.485456+0000 mgr.gibba020.yqfnwy (mgr.34427) 7754 : audit [DBG] from='client.49260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:19:51.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:51 gibba013 bash[30381]: cephadm 2021-03-10T16:19:49.628890+0000 mgr.gibba020.yqfnwy (mgr.34427) 7755 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:19:52.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:52 gibba020 bash[25448]: cluster 2021-03-10T16:19:50.835204+0000 mgr.gibba020.yqfnwy (mgr.34427) 7756 : cluster [DBG] pgmap v4414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:52.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:52 gibba013 bash[29418]: cluster 2021-03-10T16:19:50.835204+0000 mgr.gibba020.yqfnwy (mgr.34427) 7756 : cluster [DBG] pgmap v4414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:52.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:52 gibba013 bash[30381]: cluster 2021-03-10T16:19:50.835204+0000 mgr.gibba020.yqfnwy (mgr.34427) 7756 : cluster [DBG] pgmap v4414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:54.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:54 gibba020 bash[25448]: cluster 2021-03-10T16:19:52.836643+0000 mgr.gibba020.yqfnwy (mgr.34427) 7757 : cluster [DBG] pgmap v4415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:54.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:54 gibba013 bash[29418]: cluster 2021-03-10T16:19:52.836643+0000 mgr.gibba020.yqfnwy (mgr.34427) 7757 : cluster [DBG] pgmap v4415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:54.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:54 gibba013 bash[30381]: cluster 2021-03-10T16:19:52.836643+0000 mgr.gibba020.yqfnwy (mgr.34427) 7757 : cluster [DBG] pgmap v4415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:56.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:56 gibba020 bash[25448]: cluster 2021-03-10T16:19:54.838423+0000 mgr.gibba020.yqfnwy (mgr.34427) 7758 : cluster [DBG] pgmap v4416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:56.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:56 gibba013 bash[29418]: cluster 2021-03-10T16:19:54.838423+0000 mgr.gibba020.yqfnwy (mgr.34427) 7758 : cluster [DBG] pgmap v4416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:56.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:56 gibba013 bash[30381]: cluster 2021-03-10T16:19:54.838423+0000 mgr.gibba020.yqfnwy (mgr.34427) 7758 : cluster [DBG] pgmap v4416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:58.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:19:58 gibba020 bash[25448]: cluster 2021-03-10T16:19:56.840028+0000 mgr.gibba020.yqfnwy (mgr.34427) 7759 : cluster [DBG] pgmap v4417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:58.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:19:58 gibba013 bash[29418]: cluster 2021-03-10T16:19:56.840028+0000 mgr.gibba020.yqfnwy (mgr.34427) 7759 : cluster [DBG] pgmap v4417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:19:58.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:19:58 gibba013 bash[30381]: cluster 2021-03-10T16:19:56.840028+0000 mgr.gibba020.yqfnwy (mgr.34427) 7759 : cluster [DBG] pgmap v4417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:00.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:00 gibba013 bash[29418]: debug 2021-03-10T16:19:59.997+0000 7fd718a82700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:20:00.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:00 gibba013 bash[29418]: cluster 2021-03-10T16:19:58.841748+0000 mgr.gibba020.yqfnwy (mgr.34427) 7760 : cluster [DBG] pgmap v4418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:00.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:00 gibba013 bash[29418]: cluster 2021-03-10T16:20:00.000302+0000 mon.a (mon.0) 2895 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:20:00.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:00 gibba013 bash[30381]: cluster 2021-03-10T16:19:58.841748+0000 mgr.gibba020.yqfnwy (mgr.34427) 7760 : cluster [DBG] pgmap v4418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:00.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:00 gibba013 bash[30381]: cluster 2021-03-10T16:20:00.000302+0000 mon.a (mon.0) 2895 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:20:00.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:00 gibba020 bash[25448]: cluster 2021-03-10T16:19:58.841748+0000 mgr.gibba020.yqfnwy (mgr.34427) 7760 : cluster [DBG] pgmap v4418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:00.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:00 gibba020 bash[25448]: cluster 2021-03-10T16:20:00.000302+0000 mon.a (mon.0) 2895 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:20:02.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:02 gibba020 bash[25448]: cluster 2021-03-10T16:20:00.843482+0000 mgr.gibba020.yqfnwy (mgr.34427) 7761 : cluster [DBG] pgmap v4419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:02.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:02 gibba013 bash[29418]: cluster 2021-03-10T16:20:00.843482+0000 mgr.gibba020.yqfnwy (mgr.34427) 7761 : cluster [DBG] pgmap v4419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:02.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:02 gibba013 bash[30381]: cluster 2021-03-10T16:20:00.843482+0000 mgr.gibba020.yqfnwy (mgr.34427) 7761 : cluster [DBG] pgmap v4419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:04.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:04 gibba020 bash[25448]: cluster 2021-03-10T16:20:02.844955+0000 mgr.gibba020.yqfnwy (mgr.34427) 7762 : cluster [DBG] pgmap v4420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:04.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:04 gibba013 bash[29418]: cluster 2021-03-10T16:20:02.844955+0000 mgr.gibba020.yqfnwy (mgr.34427) 7762 : cluster [DBG] pgmap v4420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:04.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:04 gibba013 bash[30381]: cluster 2021-03-10T16:20:02.844955+0000 mgr.gibba020.yqfnwy (mgr.34427) 7762 : cluster [DBG] pgmap v4420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:06.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:06 gibba013 bash[29418]: cephadm 2021-03-10T16:20:04.644616+0000 mgr.gibba020.yqfnwy (mgr.34427) 7763 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:20:06.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:06 gibba013 bash[29418]: cluster 2021-03-10T16:20:04.846535+0000 mgr.gibba020.yqfnwy (mgr.34427) 7764 : cluster [DBG] pgmap v4421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:06.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:06 gibba013 bash[30381]: cephadm 2021-03-10T16:20:04.644616+0000 mgr.gibba020.yqfnwy (mgr.34427) 7763 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:20:06.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:06 gibba013 bash[30381]: cluster 2021-03-10T16:20:04.846535+0000 mgr.gibba020.yqfnwy (mgr.34427) 7764 : cluster [DBG] pgmap v4421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:06.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:06 gibba020 bash[25448]: cephadm 2021-03-10T16:20:04.644616+0000 mgr.gibba020.yqfnwy (mgr.34427) 7763 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:20:06.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:06 gibba020 bash[25448]: cluster 2021-03-10T16:20:04.846535+0000 mgr.gibba020.yqfnwy (mgr.34427) 7764 : cluster [DBG] pgmap v4421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:07.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:07 gibba013 bash[29418]: audit 2021-03-10T16:20:06.674656+0000 mon.a (mon.0) 2896 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:20:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:07 gibba013 bash[29418]: audit 2021-03-10T16:20:06.799969+0000 mon.a (mon.0) 2897 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:20:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:07 gibba013 bash[29418]: audit 2021-03-10T16:20:07.045022+0000 mon.a (mon.0) 2898 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:20:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:07 gibba013 bash[29418]: audit 2021-03-10T16:20:07.045743+0000 mon.a (mon.0) 2899 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T16:20:07.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:07 gibba013 bash[29418]: audit 2021-03-10T16:20:07.046501+0000 mon.a (mon.0) 2900 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:20:07.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:07 gibba013 bash[29418]: audit 2021-03-10T16:20:07.047209+0000 mon.a (mon.0) 2901 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:20:07.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:07 gibba013 bash[30381]: audit 2021-03-10T16:20:06.674656+0000 mon.a (mon.0) 2896 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:20:07.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:07 gibba013 bash[30381]: audit 2021-03-10T16:20:06.799969+0000 mon.a (mon.0) 2897 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:20:07.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:07 gibba013 bash[30381]: audit 2021-03-10T16:20:07.045022+0000 mon.a (mon.0) 2898 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:20:07.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:07 gibba013 bash[30381]: audit 2021-03-10T16:20:07.045743+0000 mon.a (mon.0) 2899 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T16:20:07.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:07 gibba013 bash[30381]: audit 2021-03-10T16:20:07.046501+0000 mon.a (mon.0) 2900 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:20:07.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:07 gibba013 bash[30381]: audit 2021-03-10T16:20:07.047209+0000 mon.a (mon.0) 2901 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:20:07.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:07 gibba020 bash[25448]: audit 2021-03-10T16:20:06.674656+0000 mon.a (mon.0) 2896 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:20:07.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:07 gibba020 bash[25448]: audit 2021-03-10T16:20:06.799969+0000 mon.a (mon.0) 2897 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:20:07.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:07 gibba020 bash[25448]: audit 2021-03-10T16:20:07.045022+0000 mon.a (mon.0) 2898 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:20:07.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:07 gibba020 bash[25448]: audit 2021-03-10T16:20:07.045743+0000 mon.a (mon.0) 2899 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T16:20:07.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:07 gibba020 bash[25448]: audit 2021-03-10T16:20:07.046501+0000 mon.a (mon.0) 2900 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:20:07.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:07 gibba020 bash[25448]: audit 2021-03-10T16:20:07.047209+0000 mon.a (mon.0) 2901 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:20:08.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:08 gibba013 bash[29418]: cluster 2021-03-10T16:20:06.848244+0000 mgr.gibba020.yqfnwy (mgr.34427) 7765 : cluster [DBG] pgmap v4422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:08.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:08 gibba013 bash[30381]: cluster 2021-03-10T16:20:06.848244+0000 mgr.gibba020.yqfnwy (mgr.34427) 7765 : cluster [DBG] pgmap v4422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:08.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:08 gibba020 bash[25448]: cluster 2021-03-10T16:20:06.848244+0000 mgr.gibba020.yqfnwy (mgr.34427) 7765 : cluster [DBG] pgmap v4422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:10.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:10 gibba013 bash[29418]: cluster 2021-03-10T16:20:08.849640+0000 mgr.gibba020.yqfnwy (mgr.34427) 7766 : cluster [DBG] pgmap v4423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:10.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:10 gibba013 bash[30381]: cluster 2021-03-10T16:20:08.849640+0000 mgr.gibba020.yqfnwy (mgr.34427) 7766 : cluster [DBG] pgmap v4423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:10.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:10 gibba020 bash[25448]: cluster 2021-03-10T16:20:08.849640+0000 mgr.gibba020.yqfnwy (mgr.34427) 7766 : cluster [DBG] pgmap v4423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:12.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:12 gibba013 bash[29418]: cluster 2021-03-10T16:20:10.851089+0000 mgr.gibba020.yqfnwy (mgr.34427) 7767 : cluster [DBG] pgmap v4424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:12.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:12 gibba013 bash[30381]: cluster 2021-03-10T16:20:10.851089+0000 mgr.gibba020.yqfnwy (mgr.34427) 7767 : cluster [DBG] pgmap v4424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:12.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:12 gibba020 bash[25448]: cluster 2021-03-10T16:20:10.851089+0000 mgr.gibba020.yqfnwy (mgr.34427) 7767 : cluster [DBG] pgmap v4424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:14.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:14 gibba013 bash[29418]: cluster 2021-03-10T16:20:12.852559+0000 mgr.gibba020.yqfnwy (mgr.34427) 7768 : cluster [DBG] pgmap v4425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:14.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:14 gibba013 bash[30381]: cluster 2021-03-10T16:20:12.852559+0000 mgr.gibba020.yqfnwy (mgr.34427) 7768 : cluster [DBG] pgmap v4425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:14.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:14 gibba020 bash[25448]: cluster 2021-03-10T16:20:12.852559+0000 mgr.gibba020.yqfnwy (mgr.34427) 7768 : cluster [DBG] pgmap v4425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:16.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:16 gibba013 bash[29418]: cluster 2021-03-10T16:20:14.854020+0000 mgr.gibba020.yqfnwy (mgr.34427) 7769 : cluster [DBG] pgmap v4426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:16.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:16 gibba013 bash[30381]: cluster 2021-03-10T16:20:14.854020+0000 mgr.gibba020.yqfnwy (mgr.34427) 7769 : cluster [DBG] pgmap v4426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:16.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:16 gibba020 bash[25448]: cluster 2021-03-10T16:20:14.854020+0000 mgr.gibba020.yqfnwy (mgr.34427) 7769 : cluster [DBG] pgmap v4426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:18.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:18 gibba013 bash[29418]: cluster 2021-03-10T16:20:16.855504+0000 mgr.gibba020.yqfnwy (mgr.34427) 7770 : cluster [DBG] pgmap v4427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:18.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:18 gibba013 bash[30381]: cluster 2021-03-10T16:20:16.855504+0000 mgr.gibba020.yqfnwy (mgr.34427) 7770 : cluster [DBG] pgmap v4427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:18.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:18 gibba020 bash[25448]: cluster 2021-03-10T16:20:16.855504+0000 mgr.gibba020.yqfnwy (mgr.34427) 7770 : cluster [DBG] pgmap v4427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:19.992 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:20:20.217 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:20:20.218 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 10m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:20:20.218 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 9m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:20:20.218 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:20:20.218 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:20:20.219 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:20:20.219 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:20:20.219 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:20:20.219 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:20:20.219 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 10m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:20:20.220 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:20:20.220 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:20:20.220 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:20:20.220 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:20:20.221 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:20:20.221 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:20:20.221 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:20:20.221 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:20:20.222 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:20:20.222 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 9m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:20:20.222 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 9m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:20:20.468 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:20:20.468 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:20:20.468 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:20:20.468 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:20:20.469 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:20:20.469 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:20:20.469 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:20:20.469 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:20:20.470 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:20:20.470 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:20:20.470 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:20:20.470 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:20:20.471 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:20:20.471 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:20:20.471 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:20:20.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:20 gibba013 bash[29418]: cluster 2021-03-10T16:20:18.857126+0000 mgr.gibba020.yqfnwy (mgr.34427) 7771 : cluster [DBG] pgmap v4428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:20.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:20 gibba013 bash[29418]: audit 2021-03-10T16:20:19.662322+0000 mon.a (mon.0) 2902 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:20:20.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:20 gibba013 bash[29418]: audit 2021-03-10T16:20:19.670313+0000 mon.a (mon.0) 2903 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:20:20.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:20 gibba013 bash[30381]: cluster 2021-03-10T16:20:18.857126+0000 mgr.gibba020.yqfnwy (mgr.34427) 7771 : cluster [DBG] pgmap v4428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:20.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:20 gibba013 bash[30381]: audit 2021-03-10T16:20:19.662322+0000 mon.a (mon.0) 2902 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:20:20.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:20 gibba013 bash[30381]: audit 2021-03-10T16:20:19.670313+0000 mon.a (mon.0) 2903 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:20:20.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:20 gibba020 bash[25448]: cluster 2021-03-10T16:20:18.857126+0000 mgr.gibba020.yqfnwy (mgr.34427) 7771 : cluster [DBG] pgmap v4428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:20.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:20 gibba020 bash[25448]: audit 2021-03-10T16:20:19.662322+0000 mon.a (mon.0) 2902 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:20:20.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:20 gibba020 bash[25448]: audit 2021-03-10T16:20:19.670313+0000 mon.a (mon.0) 2903 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:20:21.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:21 gibba013 bash[29418]: cephadm 2021-03-10T16:20:19.668887+0000 mgr.gibba020.yqfnwy (mgr.34427) 7772 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:20:21.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:21 gibba013 bash[29418]: audit 2021-03-10T16:20:19.983131+0000 mgr.gibba020.yqfnwy (mgr.34427) 7773 : audit [DBG] from='client.49272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:20:21.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:21 gibba013 bash[29418]: audit 2021-03-10T16:20:20.206977+0000 mgr.gibba020.yqfnwy (mgr.34427) 7774 : audit [DBG] from='client.49278 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:20:21.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:21 gibba013 bash[29418]: audit 2021-03-10T16:20:20.468503+0000 mon.c (mon.1) 125 : audit [DBG] from='client.? 172.21.2.113:0/1371563489' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:21.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:21 gibba013 bash[30381]: cephadm 2021-03-10T16:20:19.668887+0000 mgr.gibba020.yqfnwy (mgr.34427) 7772 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:20:21.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:21 gibba013 bash[30381]: audit 2021-03-10T16:20:19.983131+0000 mgr.gibba020.yqfnwy (mgr.34427) 7773 : audit [DBG] from='client.49272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:20:21.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:21 gibba013 bash[30381]: audit 2021-03-10T16:20:20.206977+0000 mgr.gibba020.yqfnwy (mgr.34427) 7774 : audit [DBG] from='client.49278 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:20:21.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:21 gibba013 bash[30381]: audit 2021-03-10T16:20:20.468503+0000 mon.c (mon.1) 125 : audit [DBG] from='client.? 172.21.2.113:0/1371563489' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:21.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:21 gibba020 bash[25448]: cephadm 2021-03-10T16:20:19.668887+0000 mgr.gibba020.yqfnwy (mgr.34427) 7772 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:20:21.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:21 gibba020 bash[25448]: audit 2021-03-10T16:20:19.983131+0000 mgr.gibba020.yqfnwy (mgr.34427) 7773 : audit [DBG] from='client.49272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:20:21.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:21 gibba020 bash[25448]: audit 2021-03-10T16:20:20.206977+0000 mgr.gibba020.yqfnwy (mgr.34427) 7774 : audit [DBG] from='client.49278 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:20:21.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:21 gibba020 bash[25448]: audit 2021-03-10T16:20:20.468503+0000 mon.c (mon.1) 125 : audit [DBG] from='client.? 172.21.2.113:0/1371563489' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:22.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:22 gibba013 bash[29418]: cluster 2021-03-10T16:20:20.858680+0000 mgr.gibba020.yqfnwy (mgr.34427) 7775 : cluster [DBG] pgmap v4429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:22.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:22 gibba013 bash[30381]: cluster 2021-03-10T16:20:20.858680+0000 mgr.gibba020.yqfnwy (mgr.34427) 7775 : cluster [DBG] pgmap v4429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:22.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:22 gibba020 bash[25448]: cluster 2021-03-10T16:20:20.858680+0000 mgr.gibba020.yqfnwy (mgr.34427) 7775 : cluster [DBG] pgmap v4429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:24.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:24 gibba020 bash[25448]: cluster 2021-03-10T16:20:22.860286+0000 mgr.gibba020.yqfnwy (mgr.34427) 7776 : cluster [DBG] pgmap v4430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:24.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:24 gibba020 bash[25448]: audit 2021-03-10T16:20:23.184717+0000 mon.a (mon.0) 2904 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:20:24.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:24 gibba020 bash[25448]: cephadm 2021-03-10T16:20:23.185390+0000 mgr.gibba020.yqfnwy (mgr.34427) 7777 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:20:24.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:24 gibba020 bash[25448]: audit 2021-03-10T16:20:23.403495+0000 mon.a (mon.0) 2905 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:20:24.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:24 gibba020 bash[25448]: cephadm 2021-03-10T16:20:23.409422+0000 mgr.gibba020.yqfnwy (mgr.34427) 7778 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:20:24.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:24 gibba020 bash[25448]: audit 2021-03-10T16:20:23.411185+0000 mon.a (mon.0) 2906 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:20:24.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:24 gibba020 bash[25448]: cephadm 2021-03-10T16:20:23.411649+0000 mgr.gibba020.yqfnwy (mgr.34427) 7779 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:20:24.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:24 gibba020 bash[25448]: audit 2021-03-10T16:20:23.412855+0000 mon.a (mon.0) 2907 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:24.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:24 gibba020 bash[25448]: cephadm 2021-03-10T16:20:23.413269+0000 mgr.gibba020.yqfnwy (mgr.34427) 7780 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:20:24.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:24 gibba020 bash[25448]: cephadm 2021-03-10T16:20:23.413318+0000 mgr.gibba020.yqfnwy (mgr.34427) 7781 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:20:24.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:24 gibba020 bash[25448]: audit 2021-03-10T16:20:23.414685+0000 mon.a (mon.0) 2908 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:24.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:24 gibba020 bash[25448]: cephadm 2021-03-10T16:20:23.415027+0000 mgr.gibba020.yqfnwy (mgr.34427) 7782 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:20:24.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:24 gibba020 bash[25448]: cephadm 2021-03-10T16:20:23.415080+0000 mgr.gibba020.yqfnwy (mgr.34427) 7783 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:20:24.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:24 gibba020 bash[25448]: audit 2021-03-10T16:20:23.416204+0000 mon.a (mon.0) 2909 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:24.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:24 gibba020 bash[25448]: cephadm 2021-03-10T16:20:23.416331+0000 mgr.gibba020.yqfnwy (mgr.34427) 7784 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:20:24.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:24 gibba020 bash[25448]: cephadm 2021-03-10T16:20:23.417490+0000 mgr.gibba020.yqfnwy (mgr.34427) 7785 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:20:24.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:24 gibba020 bash[25448]: cephadm 2021-03-10T16:20:23.417542+0000 mgr.gibba020.yqfnwy (mgr.34427) 7786 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:20:24.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:24 gibba020 bash[25448]: audit 2021-03-10T16:20:23.418855+0000 mon.a (mon.0) 2910 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:24.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:24 gibba020 bash[25448]: cephadm 2021-03-10T16:20:23.418989+0000 mgr.gibba020.yqfnwy (mgr.34427) 7787 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:20:24.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:24 gibba020 bash[25448]: cephadm 2021-03-10T16:20:23.419380+0000 mgr.gibba020.yqfnwy (mgr.34427) 7788 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:20:24.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:24 gibba020 bash[25448]: audit 2021-03-10T16:20:23.420514+0000 mon.a (mon.0) 2911 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:24.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:24 gibba020 bash[25448]: cephadm 2021-03-10T16:20:23.420832+0000 mgr.gibba020.yqfnwy (mgr.34427) 7789 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:20:24.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:24 gibba020 bash[25448]: cephadm 2021-03-10T16:20:23.420888+0000 mgr.gibba020.yqfnwy (mgr.34427) 7790 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:20:24.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:24 gibba020 bash[25448]: cephadm 2021-03-10T16:20:23.421026+0000 mgr.gibba020.yqfnwy (mgr.34427) 7791 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:20:24.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[30381]: cluster 2021-03-10T16:20:22.860286+0000 mgr.gibba020.yqfnwy (mgr.34427) 7776 : cluster [DBG] pgmap v4430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:24.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[30381]: audit 2021-03-10T16:20:23.184717+0000 mon.a (mon.0) 2904 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:20:24.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[30381]: cephadm 2021-03-10T16:20:23.185390+0000 mgr.gibba020.yqfnwy (mgr.34427) 7777 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:20:24.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[30381]: audit 2021-03-10T16:20:23.403495+0000 mon.a (mon.0) 2905 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:20:24.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[30381]: cephadm 2021-03-10T16:20:23.409422+0000 mgr.gibba020.yqfnwy (mgr.34427) 7778 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:20:24.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[30381]: audit 2021-03-10T16:20:23.411185+0000 mon.a (mon.0) 2906 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:20:24.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[30381]: cephadm 2021-03-10T16:20:23.411649+0000 mgr.gibba020.yqfnwy (mgr.34427) 7779 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:20:24.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[30381]: audit 2021-03-10T16:20:23.412855+0000 mon.a (mon.0) 2907 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:24.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[30381]: cephadm 2021-03-10T16:20:23.413269+0000 mgr.gibba020.yqfnwy (mgr.34427) 7780 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:20:24.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[30381]: cephadm 2021-03-10T16:20:23.413318+0000 mgr.gibba020.yqfnwy (mgr.34427) 7781 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:20:24.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[30381]: audit 2021-03-10T16:20:23.414685+0000 mon.a (mon.0) 2908 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:24.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[30381]: cephadm 2021-03-10T16:20:23.415027+0000 mgr.gibba020.yqfnwy (mgr.34427) 7782 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:20:24.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[30381]: cephadm 2021-03-10T16:20:23.415080+0000 mgr.gibba020.yqfnwy (mgr.34427) 7783 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:20:24.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[30381]: audit 2021-03-10T16:20:23.416204+0000 mon.a (mon.0) 2909 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:24.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[30381]: cephadm 2021-03-10T16:20:23.416331+0000 mgr.gibba020.yqfnwy (mgr.34427) 7784 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:20:24.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[30381]: cephadm 2021-03-10T16:20:23.417490+0000 mgr.gibba020.yqfnwy (mgr.34427) 7785 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:20:24.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[30381]: cephadm 2021-03-10T16:20:23.417542+0000 mgr.gibba020.yqfnwy (mgr.34427) 7786 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:20:24.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[30381]: audit 2021-03-10T16:20:23.418855+0000 mon.a (mon.0) 2910 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:24.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[30381]: cephadm 2021-03-10T16:20:23.418989+0000 mgr.gibba020.yqfnwy (mgr.34427) 7787 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:20:24.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[30381]: cephadm 2021-03-10T16:20:23.419380+0000 mgr.gibba020.yqfnwy (mgr.34427) 7788 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:20:24.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[29418]: cluster 2021-03-10T16:20:22.860286+0000 mgr.gibba020.yqfnwy (mgr.34427) 7776 : cluster [DBG] pgmap v4430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:24.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[29418]: audit 2021-03-10T16:20:23.184717+0000 mon.a (mon.0) 2904 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:20:24.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[29418]: cephadm 2021-03-10T16:20:23.185390+0000 mgr.gibba020.yqfnwy (mgr.34427) 7777 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:20:24.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[29418]: audit 2021-03-10T16:20:23.403495+0000 mon.a (mon.0) 2905 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:20:24.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[29418]: cephadm 2021-03-10T16:20:23.409422+0000 mgr.gibba020.yqfnwy (mgr.34427) 7778 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:20:24.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[29418]: audit 2021-03-10T16:20:23.411185+0000 mon.a (mon.0) 2906 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:20:24.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[29418]: cephadm 2021-03-10T16:20:23.411649+0000 mgr.gibba020.yqfnwy (mgr.34427) 7779 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:20:24.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[29418]: audit 2021-03-10T16:20:23.412855+0000 mon.a (mon.0) 2907 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:24.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[29418]: cephadm 2021-03-10T16:20:23.413269+0000 mgr.gibba020.yqfnwy (mgr.34427) 7780 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:20:24.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[29418]: cephadm 2021-03-10T16:20:23.413318+0000 mgr.gibba020.yqfnwy (mgr.34427) 7781 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:20:24.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[29418]: audit 2021-03-10T16:20:23.414685+0000 mon.a (mon.0) 2908 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:24.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[29418]: cephadm 2021-03-10T16:20:23.415027+0000 mgr.gibba020.yqfnwy (mgr.34427) 7782 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:20:24.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[29418]: cephadm 2021-03-10T16:20:23.415080+0000 mgr.gibba020.yqfnwy (mgr.34427) 7783 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:20:24.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[29418]: audit 2021-03-10T16:20:23.416204+0000 mon.a (mon.0) 2909 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:24.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[29418]: cephadm 2021-03-10T16:20:23.416331+0000 mgr.gibba020.yqfnwy (mgr.34427) 7784 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:20:24.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[29418]: cephadm 2021-03-10T16:20:23.417490+0000 mgr.gibba020.yqfnwy (mgr.34427) 7785 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:20:24.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[29418]: cephadm 2021-03-10T16:20:23.417542+0000 mgr.gibba020.yqfnwy (mgr.34427) 7786 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:20:24.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[29418]: audit 2021-03-10T16:20:23.418855+0000 mon.a (mon.0) 2910 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:24.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[29418]: cephadm 2021-03-10T16:20:23.418989+0000 mgr.gibba020.yqfnwy (mgr.34427) 7787 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:20:24.639 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[29418]: cephadm 2021-03-10T16:20:23.419380+0000 mgr.gibba020.yqfnwy (mgr.34427) 7788 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:20:24.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[30381]: audit 2021-03-10T16:20:23.420514+0000 mon.a (mon.0) 2911 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:24.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[30381]: cephadm 2021-03-10T16:20:23.420832+0000 mgr.gibba020.yqfnwy (mgr.34427) 7789 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:20:24.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[30381]: cephadm 2021-03-10T16:20:23.420888+0000 mgr.gibba020.yqfnwy (mgr.34427) 7790 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:20:24.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[30381]: cephadm 2021-03-10T16:20:23.421026+0000 mgr.gibba020.yqfnwy (mgr.34427) 7791 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:20:24.640 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[29418]: audit 2021-03-10T16:20:23.420514+0000 mon.a (mon.0) 2911 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:24.640 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[29418]: cephadm 2021-03-10T16:20:23.420832+0000 mgr.gibba020.yqfnwy (mgr.34427) 7789 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:20:24.641 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[29418]: cephadm 2021-03-10T16:20:23.420888+0000 mgr.gibba020.yqfnwy (mgr.34427) 7790 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:20:24.641 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:24 gibba013 bash[29418]: cephadm 2021-03-10T16:20:23.421026+0000 mgr.gibba020.yqfnwy (mgr.34427) 7791 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:20:26.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:26 gibba013 bash[29418]: cluster 2021-03-10T16:20:24.861710+0000 mgr.gibba020.yqfnwy (mgr.34427) 7792 : cluster [DBG] pgmap v4431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:26.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:26 gibba013 bash[30381]: cluster 2021-03-10T16:20:24.861710+0000 mgr.gibba020.yqfnwy (mgr.34427) 7792 : cluster [DBG] pgmap v4431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:26.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:26 gibba020 bash[25448]: cluster 2021-03-10T16:20:24.861710+0000 mgr.gibba020.yqfnwy (mgr.34427) 7792 : cluster [DBG] pgmap v4431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:28.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:28 gibba013 bash[29418]: cluster 2021-03-10T16:20:26.863356+0000 mgr.gibba020.yqfnwy (mgr.34427) 7793 : cluster [DBG] pgmap v4432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:28.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:28 gibba013 bash[30381]: cluster 2021-03-10T16:20:26.863356+0000 mgr.gibba020.yqfnwy (mgr.34427) 7793 : cluster [DBG] pgmap v4432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:28.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:28 gibba020 bash[25448]: cluster 2021-03-10T16:20:26.863356+0000 mgr.gibba020.yqfnwy (mgr.34427) 7793 : cluster [DBG] pgmap v4432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:30.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:30 gibba013 bash[29418]: cluster 2021-03-10T16:20:28.865021+0000 mgr.gibba020.yqfnwy (mgr.34427) 7794 : cluster [DBG] pgmap v4433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:30.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:30 gibba013 bash[30381]: cluster 2021-03-10T16:20:28.865021+0000 mgr.gibba020.yqfnwy (mgr.34427) 7794 : cluster [DBG] pgmap v4433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:30.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:30 gibba020 bash[25448]: cluster 2021-03-10T16:20:28.865021+0000 mgr.gibba020.yqfnwy (mgr.34427) 7794 : cluster [DBG] pgmap v4433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:32.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:32 gibba013 bash[29418]: cluster 2021-03-10T16:20:30.866584+0000 mgr.gibba020.yqfnwy (mgr.34427) 7795 : cluster [DBG] pgmap v4434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:32.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:32 gibba013 bash[30381]: cluster 2021-03-10T16:20:30.866584+0000 mgr.gibba020.yqfnwy (mgr.34427) 7795 : cluster [DBG] pgmap v4434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:32.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:32 gibba020 bash[25448]: cluster 2021-03-10T16:20:30.866584+0000 mgr.gibba020.yqfnwy (mgr.34427) 7795 : cluster [DBG] pgmap v4434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:34.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:34 gibba013 bash[29418]: cluster 2021-03-10T16:20:32.868132+0000 mgr.gibba020.yqfnwy (mgr.34427) 7796 : cluster [DBG] pgmap v4435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:34.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:34 gibba013 bash[30381]: cluster 2021-03-10T16:20:32.868132+0000 mgr.gibba020.yqfnwy (mgr.34427) 7796 : cluster [DBG] pgmap v4435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:34.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:34 gibba020 bash[25448]: cluster 2021-03-10T16:20:32.868132+0000 mgr.gibba020.yqfnwy (mgr.34427) 7796 : cluster [DBG] pgmap v4435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:36.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:36 gibba013 bash[29418]: cluster 2021-03-10T16:20:34.869913+0000 mgr.gibba020.yqfnwy (mgr.34427) 7797 : cluster [DBG] pgmap v4436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:36.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:36 gibba013 bash[30381]: cluster 2021-03-10T16:20:34.869913+0000 mgr.gibba020.yqfnwy (mgr.34427) 7797 : cluster [DBG] pgmap v4436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:36.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:36 gibba020 bash[25448]: cluster 2021-03-10T16:20:34.869913+0000 mgr.gibba020.yqfnwy (mgr.34427) 7797 : cluster [DBG] pgmap v4436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:38.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:38 gibba013 bash[29418]: cluster 2021-03-10T16:20:36.871506+0000 mgr.gibba020.yqfnwy (mgr.34427) 7798 : cluster [DBG] pgmap v4437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:38.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:38 gibba013 bash[30381]: cluster 2021-03-10T16:20:36.871506+0000 mgr.gibba020.yqfnwy (mgr.34427) 7798 : cluster [DBG] pgmap v4437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:38.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:38 gibba020 bash[25448]: cluster 2021-03-10T16:20:36.871506+0000 mgr.gibba020.yqfnwy (mgr.34427) 7798 : cluster [DBG] pgmap v4437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:39.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:39 gibba013 bash[29418]: cephadm 2021-03-10T16:20:38.433155+0000 mgr.gibba020.yqfnwy (mgr.34427) 7799 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:20:39.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:39 gibba013 bash[30381]: cephadm 2021-03-10T16:20:38.433155+0000 mgr.gibba020.yqfnwy (mgr.34427) 7799 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:20:39.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:39 gibba020 bash[25448]: cephadm 2021-03-10T16:20:38.433155+0000 mgr.gibba020.yqfnwy (mgr.34427) 7799 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:20:40.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:40 gibba013 bash[29418]: cluster 2021-03-10T16:20:38.873116+0000 mgr.gibba020.yqfnwy (mgr.34427) 7800 : cluster [DBG] pgmap v4438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:40.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:40 gibba013 bash[30381]: cluster 2021-03-10T16:20:38.873116+0000 mgr.gibba020.yqfnwy (mgr.34427) 7800 : cluster [DBG] pgmap v4438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:40.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:40 gibba020 bash[25448]: cluster 2021-03-10T16:20:38.873116+0000 mgr.gibba020.yqfnwy (mgr.34427) 7800 : cluster [DBG] pgmap v4438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:42.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:42 gibba013 bash[29418]: cluster 2021-03-10T16:20:40.874666+0000 mgr.gibba020.yqfnwy (mgr.34427) 7801 : cluster [DBG] pgmap v4439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:42.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:42 gibba013 bash[30381]: cluster 2021-03-10T16:20:40.874666+0000 mgr.gibba020.yqfnwy (mgr.34427) 7801 : cluster [DBG] pgmap v4439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:42.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:42 gibba020 bash[25448]: cluster 2021-03-10T16:20:40.874666+0000 mgr.gibba020.yqfnwy (mgr.34427) 7801 : cluster [DBG] pgmap v4439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:44.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:44 gibba013 bash[29418]: cluster 2021-03-10T16:20:42.876273+0000 mgr.gibba020.yqfnwy (mgr.34427) 7802 : cluster [DBG] pgmap v4440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:44.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:44 gibba013 bash[30381]: cluster 2021-03-10T16:20:42.876273+0000 mgr.gibba020.yqfnwy (mgr.34427) 7802 : cluster [DBG] pgmap v4440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:44.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:44 gibba020 bash[25448]: cluster 2021-03-10T16:20:42.876273+0000 mgr.gibba020.yqfnwy (mgr.34427) 7802 : cluster [DBG] pgmap v4440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:46.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:46 gibba013 bash[29418]: cluster 2021-03-10T16:20:44.877752+0000 mgr.gibba020.yqfnwy (mgr.34427) 7803 : cluster [DBG] pgmap v4441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:46.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:46 gibba013 bash[30381]: cluster 2021-03-10T16:20:44.877752+0000 mgr.gibba020.yqfnwy (mgr.34427) 7803 : cluster [DBG] pgmap v4441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:46.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:46 gibba020 bash[25448]: cluster 2021-03-10T16:20:44.877752+0000 mgr.gibba020.yqfnwy (mgr.34427) 7803 : cluster [DBG] pgmap v4441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:48.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:48 gibba013 bash[29418]: cluster 2021-03-10T16:20:46.879347+0000 mgr.gibba020.yqfnwy (mgr.34427) 7804 : cluster [DBG] pgmap v4442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:48.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:48 gibba013 bash[30381]: cluster 2021-03-10T16:20:46.879347+0000 mgr.gibba020.yqfnwy (mgr.34427) 7804 : cluster [DBG] pgmap v4442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:48.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:48 gibba020 bash[25448]: cluster 2021-03-10T16:20:46.879347+0000 mgr.gibba020.yqfnwy (mgr.34427) 7804 : cluster [DBG] pgmap v4442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:50.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:50 gibba013 bash[29418]: cluster 2021-03-10T16:20:48.880768+0000 mgr.gibba020.yqfnwy (mgr.34427) 7805 : cluster [DBG] pgmap v4443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:50.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:50 gibba013 bash[30381]: cluster 2021-03-10T16:20:48.880768+0000 mgr.gibba020.yqfnwy (mgr.34427) 7805 : cluster [DBG] pgmap v4443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:50.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:50 gibba020 bash[25448]: cluster 2021-03-10T16:20:48.880768+0000 mgr.gibba020.yqfnwy (mgr.34427) 7805 : cluster [DBG] pgmap v4443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:50.715 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:20:50.948 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:20:50.948 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 27s ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:20:50.949 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 9m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:20:50.949 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:20:50.949 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:20:50.949 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 27s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:20:50.950 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 27s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:20:50.950 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:20:50.950 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 27s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:20:50.950 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 27s ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:20:50.951 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:20:50.951 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 27s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:20:50.951 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 27s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:20:50.951 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 27s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:20:50.952 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 27s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:20:50.952 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:20:50.952 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:20:50.952 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:20:50.953 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:20:50.953 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 9m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:20:50.953 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 9m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:20:51.197 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:20:51.197 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:20:51.198 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:20:51.198 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:20:51.198 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:20:51.198 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:20:51.199 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:20:51.199 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:20:51.199 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:20:51.200 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:20:51.200 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:20:51.200 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:20:51.200 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:20:51.201 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:20:51.201 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:20:51.627 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:51 gibba013 bash[30381]: audit 2021-03-10T16:20:51.197963+0000 mon.a (mon.0) 2912 : audit [DBG] from='client.? 172.21.2.113:0/1514207838' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:51.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:51 gibba013 bash[29418]: audit 2021-03-10T16:20:51.197963+0000 mon.a (mon.0) 2912 : audit [DBG] from='client.? 172.21.2.113:0/1514207838' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:51.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:51 gibba020 bash[25448]: audit 2021-03-10T16:20:51.197963+0000 mon.a (mon.0) 2912 : audit [DBG] from='client.? 172.21.2.113:0/1514207838' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:20:52.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:52 gibba013 bash[29418]: audit 2021-03-10T16:20:50.706192+0000 mgr.gibba020.yqfnwy (mgr.34427) 7806 : audit [DBG] from='client.49290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:20:52.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:52 gibba013 bash[29418]: cluster 2021-03-10T16:20:50.882210+0000 mgr.gibba020.yqfnwy (mgr.34427) 7807 : cluster [DBG] pgmap v4444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:52.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:52 gibba013 bash[29418]: audit 2021-03-10T16:20:50.936248+0000 mgr.gibba020.yqfnwy (mgr.34427) 7808 : audit [DBG] from='client.59278 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:20:52.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:52 gibba013 bash[30381]: audit 2021-03-10T16:20:50.706192+0000 mgr.gibba020.yqfnwy (mgr.34427) 7806 : audit [DBG] from='client.49290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:20:52.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:52 gibba013 bash[30381]: cluster 2021-03-10T16:20:50.882210+0000 mgr.gibba020.yqfnwy (mgr.34427) 7807 : cluster [DBG] pgmap v4444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:52.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:52 gibba013 bash[30381]: audit 2021-03-10T16:20:50.936248+0000 mgr.gibba020.yqfnwy (mgr.34427) 7808 : audit [DBG] from='client.59278 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:20:52.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:52 gibba020 bash[25448]: audit 2021-03-10T16:20:50.706192+0000 mgr.gibba020.yqfnwy (mgr.34427) 7806 : audit [DBG] from='client.49290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:20:52.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:52 gibba020 bash[25448]: cluster 2021-03-10T16:20:50.882210+0000 mgr.gibba020.yqfnwy (mgr.34427) 7807 : cluster [DBG] pgmap v4444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:52.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:52 gibba020 bash[25448]: audit 2021-03-10T16:20:50.936248+0000 mgr.gibba020.yqfnwy (mgr.34427) 7808 : audit [DBG] from='client.59278 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:20:54.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:54 gibba013 bash[29418]: cluster 2021-03-10T16:20:52.883749+0000 mgr.gibba020.yqfnwy (mgr.34427) 7809 : cluster [DBG] pgmap v4445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:54.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:54 gibba013 bash[29418]: cephadm 2021-03-10T16:20:53.444971+0000 mgr.gibba020.yqfnwy (mgr.34427) 7810 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:20:54.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:54 gibba013 bash[30381]: cluster 2021-03-10T16:20:52.883749+0000 mgr.gibba020.yqfnwy (mgr.34427) 7809 : cluster [DBG] pgmap v4445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:54.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:54 gibba013 bash[30381]: cephadm 2021-03-10T16:20:53.444971+0000 mgr.gibba020.yqfnwy (mgr.34427) 7810 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:20:54.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:54 gibba020 bash[25448]: cluster 2021-03-10T16:20:52.883749+0000 mgr.gibba020.yqfnwy (mgr.34427) 7809 : cluster [DBG] pgmap v4445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:54.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:54 gibba020 bash[25448]: cephadm 2021-03-10T16:20:53.444971+0000 mgr.gibba020.yqfnwy (mgr.34427) 7810 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:20:56.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:56 gibba013 bash[29418]: cluster 2021-03-10T16:20:54.885478+0000 mgr.gibba020.yqfnwy (mgr.34427) 7811 : cluster [DBG] pgmap v4446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:56.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:56 gibba013 bash[30381]: cluster 2021-03-10T16:20:54.885478+0000 mgr.gibba020.yqfnwy (mgr.34427) 7811 : cluster [DBG] pgmap v4446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:56.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:56 gibba020 bash[25448]: cluster 2021-03-10T16:20:54.885478+0000 mgr.gibba020.yqfnwy (mgr.34427) 7811 : cluster [DBG] pgmap v4446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:58.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:20:58 gibba013 bash[29418]: cluster 2021-03-10T16:20:56.887040+0000 mgr.gibba020.yqfnwy (mgr.34427) 7812 : cluster [DBG] pgmap v4447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:58.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:20:58 gibba013 bash[30381]: cluster 2021-03-10T16:20:56.887040+0000 mgr.gibba020.yqfnwy (mgr.34427) 7812 : cluster [DBG] pgmap v4447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:20:58.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:20:58 gibba020 bash[25448]: cluster 2021-03-10T16:20:56.887040+0000 mgr.gibba020.yqfnwy (mgr.34427) 7812 : cluster [DBG] pgmap v4447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:00.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:00 gibba013 bash[29418]: cluster 2021-03-10T16:20:58.888589+0000 mgr.gibba020.yqfnwy (mgr.34427) 7813 : cluster [DBG] pgmap v4448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:00.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:00 gibba013 bash[30381]: cluster 2021-03-10T16:20:58.888589+0000 mgr.gibba020.yqfnwy (mgr.34427) 7813 : cluster [DBG] pgmap v4448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:00.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:00 gibba020 bash[25448]: cluster 2021-03-10T16:20:58.888589+0000 mgr.gibba020.yqfnwy (mgr.34427) 7813 : cluster [DBG] pgmap v4448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:02.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:02 gibba013 bash[29418]: cluster 2021-03-10T16:21:00.890308+0000 mgr.gibba020.yqfnwy (mgr.34427) 7814 : cluster [DBG] pgmap v4449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:02.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:02 gibba013 bash[30381]: cluster 2021-03-10T16:21:00.890308+0000 mgr.gibba020.yqfnwy (mgr.34427) 7814 : cluster [DBG] pgmap v4449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:02.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:02 gibba020 bash[25448]: cluster 2021-03-10T16:21:00.890308+0000 mgr.gibba020.yqfnwy (mgr.34427) 7814 : cluster [DBG] pgmap v4449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:04.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:04 gibba013 bash[29418]: cluster 2021-03-10T16:21:02.891878+0000 mgr.gibba020.yqfnwy (mgr.34427) 7815 : cluster [DBG] pgmap v4450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:04.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:04 gibba013 bash[30381]: cluster 2021-03-10T16:21:02.891878+0000 mgr.gibba020.yqfnwy (mgr.34427) 7815 : cluster [DBG] pgmap v4450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:04.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:04 gibba020 bash[25448]: cluster 2021-03-10T16:21:02.891878+0000 mgr.gibba020.yqfnwy (mgr.34427) 7815 : cluster [DBG] pgmap v4450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:06.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:06 gibba020 bash[25448]: cluster 2021-03-10T16:21:04.893701+0000 mgr.gibba020.yqfnwy (mgr.34427) 7816 : cluster [DBG] pgmap v4451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:06.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:06 gibba013 bash[29418]: cluster 2021-03-10T16:21:04.893701+0000 mgr.gibba020.yqfnwy (mgr.34427) 7816 : cluster [DBG] pgmap v4451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:06.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:06 gibba013 bash[30381]: cluster 2021-03-10T16:21:04.893701+0000 mgr.gibba020.yqfnwy (mgr.34427) 7816 : cluster [DBG] pgmap v4451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:07.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:07 gibba020 bash[25448]: audit 2021-03-10T16:21:06.678563+0000 mon.a (mon.0) 2913 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:21:07.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:07 gibba020 bash[25448]: audit 2021-03-10T16:21:06.806386+0000 mon.a (mon.0) 2914 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:21:07.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:07 gibba020 bash[25448]: audit 2021-03-10T16:21:07.054676+0000 mon.a (mon.0) 2915 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T16:21:07.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:07 gibba020 bash[25448]: audit 2021-03-10T16:21:07.055781+0000 mon.a (mon.0) 2916 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:21:07.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:07 gibba020 bash[25448]: audit 2021-03-10T16:21:07.056781+0000 mon.a (mon.0) 2917 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:21:07.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:07 gibba020 bash[25448]: audit 2021-03-10T16:21:07.057812+0000 mon.a (mon.0) 2918 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:21:07.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:07 gibba013 bash[29418]: audit 2021-03-10T16:21:06.678563+0000 mon.a (mon.0) 2913 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:21:07.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:07 gibba013 bash[29418]: audit 2021-03-10T16:21:06.806386+0000 mon.a (mon.0) 2914 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:21:07.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:07 gibba013 bash[29418]: audit 2021-03-10T16:21:07.054676+0000 mon.a (mon.0) 2915 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T16:21:07.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:07 gibba013 bash[29418]: audit 2021-03-10T16:21:07.055781+0000 mon.a (mon.0) 2916 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:21:07.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:07 gibba013 bash[29418]: audit 2021-03-10T16:21:07.056781+0000 mon.a (mon.0) 2917 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:21:07.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:07 gibba013 bash[29418]: audit 2021-03-10T16:21:07.057812+0000 mon.a (mon.0) 2918 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:21:07.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:07 gibba013 bash[30381]: audit 2021-03-10T16:21:06.678563+0000 mon.a (mon.0) 2913 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:21:07.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:07 gibba013 bash[30381]: audit 2021-03-10T16:21:06.806386+0000 mon.a (mon.0) 2914 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:21:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:07 gibba013 bash[30381]: audit 2021-03-10T16:21:07.054676+0000 mon.a (mon.0) 2915 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T16:21:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:07 gibba013 bash[30381]: audit 2021-03-10T16:21:07.055781+0000 mon.a (mon.0) 2916 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:21:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:07 gibba013 bash[30381]: audit 2021-03-10T16:21:07.056781+0000 mon.a (mon.0) 2917 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:21:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:07 gibba013 bash[30381]: audit 2021-03-10T16:21:07.057812+0000 mon.a (mon.0) 2918 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:21:08.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:08 gibba020 bash[25448]: cluster 2021-03-10T16:21:06.895266+0000 mgr.gibba020.yqfnwy (mgr.34427) 7817 : cluster [DBG] pgmap v4452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:08.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:08 gibba013 bash[29418]: cluster 2021-03-10T16:21:06.895266+0000 mgr.gibba020.yqfnwy (mgr.34427) 7817 : cluster [DBG] pgmap v4452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:08.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:08 gibba013 bash[30381]: cluster 2021-03-10T16:21:06.895266+0000 mgr.gibba020.yqfnwy (mgr.34427) 7817 : cluster [DBG] pgmap v4452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:09.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:09 gibba020 bash[25448]: cephadm 2021-03-10T16:21:08.460336+0000 mgr.gibba020.yqfnwy (mgr.34427) 7818 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:21:09.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:09 gibba013 bash[29418]: cephadm 2021-03-10T16:21:08.460336+0000 mgr.gibba020.yqfnwy (mgr.34427) 7818 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:21:09.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:09 gibba013 bash[30381]: cephadm 2021-03-10T16:21:08.460336+0000 mgr.gibba020.yqfnwy (mgr.34427) 7818 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:21:10.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:10 gibba020 bash[25448]: cluster 2021-03-10T16:21:08.896783+0000 mgr.gibba020.yqfnwy (mgr.34427) 7819 : cluster [DBG] pgmap v4453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:10.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:10 gibba013 bash[29418]: cluster 2021-03-10T16:21:08.896783+0000 mgr.gibba020.yqfnwy (mgr.34427) 7819 : cluster [DBG] pgmap v4453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:10.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:10 gibba013 bash[30381]: cluster 2021-03-10T16:21:08.896783+0000 mgr.gibba020.yqfnwy (mgr.34427) 7819 : cluster [DBG] pgmap v4453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:12.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:12 gibba020 bash[25448]: cluster 2021-03-10T16:21:10.898479+0000 mgr.gibba020.yqfnwy (mgr.34427) 7820 : cluster [DBG] pgmap v4454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:12.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:12 gibba013 bash[29418]: cluster 2021-03-10T16:21:10.898479+0000 mgr.gibba020.yqfnwy (mgr.34427) 7820 : cluster [DBG] pgmap v4454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:12.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:12 gibba013 bash[30381]: cluster 2021-03-10T16:21:10.898479+0000 mgr.gibba020.yqfnwy (mgr.34427) 7820 : cluster [DBG] pgmap v4454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:14.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:14 gibba020 bash[25448]: cluster 2021-03-10T16:21:12.900104+0000 mgr.gibba020.yqfnwy (mgr.34427) 7821 : cluster [DBG] pgmap v4455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:14.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:14 gibba013 bash[29418]: cluster 2021-03-10T16:21:12.900104+0000 mgr.gibba020.yqfnwy (mgr.34427) 7821 : cluster [DBG] pgmap v4455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:14.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:14 gibba013 bash[30381]: cluster 2021-03-10T16:21:12.900104+0000 mgr.gibba020.yqfnwy (mgr.34427) 7821 : cluster [DBG] pgmap v4455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:16.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:16 gibba020 bash[25448]: cluster 2021-03-10T16:21:14.901567+0000 mgr.gibba020.yqfnwy (mgr.34427) 7822 : cluster [DBG] pgmap v4456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:16.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:16 gibba013 bash[29418]: cluster 2021-03-10T16:21:14.901567+0000 mgr.gibba020.yqfnwy (mgr.34427) 7822 : cluster [DBG] pgmap v4456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:16.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:16 gibba013 bash[30381]: cluster 2021-03-10T16:21:14.901567+0000 mgr.gibba020.yqfnwy (mgr.34427) 7822 : cluster [DBG] pgmap v4456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:18.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:18 gibba013 bash[29418]: cluster 2021-03-10T16:21:16.903224+0000 mgr.gibba020.yqfnwy (mgr.34427) 7823 : cluster [DBG] pgmap v4457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:18.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:18 gibba013 bash[30381]: cluster 2021-03-10T16:21:16.903224+0000 mgr.gibba020.yqfnwy (mgr.34427) 7823 : cluster [DBG] pgmap v4457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:18.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:18 gibba020 bash[25448]: cluster 2021-03-10T16:21:16.903224+0000 mgr.gibba020.yqfnwy (mgr.34427) 7823 : cluster [DBG] pgmap v4457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:20.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:20 gibba013 bash[29418]: cluster 2021-03-10T16:21:18.904753+0000 mgr.gibba020.yqfnwy (mgr.34427) 7824 : cluster [DBG] pgmap v4458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:20.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:20 gibba013 bash[30381]: cluster 2021-03-10T16:21:18.904753+0000 mgr.gibba020.yqfnwy (mgr.34427) 7824 : cluster [DBG] pgmap v4458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:20.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:20 gibba020 bash[25448]: cluster 2021-03-10T16:21:18.904753+0000 mgr.gibba020.yqfnwy (mgr.34427) 7824 : cluster [DBG] pgmap v4458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:21.438 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:21:21.668 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:21:21.668 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 58s ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:21:21.668 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 10m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:21:21.669 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:21:21.669 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:21:21.669 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 58s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:21:21.669 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 58s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:21:21.670 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:21:21.670 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 58s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:21:21.670 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 58s ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:21:21.670 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 10m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:21:21.671 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 58s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:21:21.671 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 58s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:21:21.671 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 58s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:21:21.671 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 58s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:21:21.672 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:21:21.672 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:21:21.672 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:21:21.672 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:21:21.672 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 10m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:21:21.673 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 10m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:21:21.917 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:21:21.917 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:21:21.918 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:21:21.918 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:21:21.918 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:21:21.918 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:21:21.919 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:21:21.919 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:21:21.919 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:21:21.919 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:21:21.920 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:21:21.920 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:21:21.920 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:21:21.920 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:21:21.920 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:21:22.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:22 gibba013 bash[29418]: cluster 2021-03-10T16:21:20.906394+0000 mgr.gibba020.yqfnwy (mgr.34427) 7825 : cluster [DBG] pgmap v4459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:22.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:22 gibba013 bash[29418]: audit 2021-03-10T16:21:21.429546+0000 mgr.gibba020.yqfnwy (mgr.34427) 7826 : audit [DBG] from='client.49308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:21:22.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:22 gibba013 bash[29418]: audit 2021-03-10T16:21:21.918199+0000 mon.c (mon.1) 126 : audit [DBG] from='client.? 172.21.2.113:0/1417885019' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:22.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:22 gibba013 bash[30381]: cluster 2021-03-10T16:21:20.906394+0000 mgr.gibba020.yqfnwy (mgr.34427) 7825 : cluster [DBG] pgmap v4459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:22.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:22 gibba013 bash[30381]: audit 2021-03-10T16:21:21.429546+0000 mgr.gibba020.yqfnwy (mgr.34427) 7826 : audit [DBG] from='client.49308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:21:22.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:22 gibba013 bash[30381]: audit 2021-03-10T16:21:21.918199+0000 mon.c (mon.1) 126 : audit [DBG] from='client.? 172.21.2.113:0/1417885019' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:22.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:22 gibba020 bash[25448]: cluster 2021-03-10T16:21:20.906394+0000 mgr.gibba020.yqfnwy (mgr.34427) 7825 : cluster [DBG] pgmap v4459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:22.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:22 gibba020 bash[25448]: audit 2021-03-10T16:21:21.429546+0000 mgr.gibba020.yqfnwy (mgr.34427) 7826 : audit [DBG] from='client.49308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:21:22.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:22 gibba020 bash[25448]: audit 2021-03-10T16:21:21.918199+0000 mon.c (mon.1) 126 : audit [DBG] from='client.? 172.21.2.113:0/1417885019' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:23.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:23 gibba013 bash[29418]: audit 2021-03-10T16:21:21.656309+0000 mgr.gibba020.yqfnwy (mgr.34427) 7827 : audit [DBG] from='client.49314 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:21:23.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:23 gibba013 bash[29418]: audit 2021-03-10T16:21:23.464866+0000 mon.a (mon.0) 2919 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:21:23.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:23 gibba013 bash[30381]: audit 2021-03-10T16:21:21.656309+0000 mgr.gibba020.yqfnwy (mgr.34427) 7827 : audit [DBG] from='client.49314 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:21:23.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:23 gibba013 bash[30381]: audit 2021-03-10T16:21:23.464866+0000 mon.a (mon.0) 2919 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:21:23.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:23 gibba020 bash[25448]: audit 2021-03-10T16:21:21.656309+0000 mgr.gibba020.yqfnwy (mgr.34427) 7827 : audit [DBG] from='client.49314 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:21:23.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:23 gibba020 bash[25448]: audit 2021-03-10T16:21:23.464866+0000 mon.a (mon.0) 2919 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:21:24.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:24 gibba013 bash[29418]: cluster 2021-03-10T16:21:22.907798+0000 mgr.gibba020.yqfnwy (mgr.34427) 7828 : cluster [DBG] pgmap v4460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:24.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:24 gibba013 bash[29418]: cephadm 2021-03-10T16:21:23.470652+0000 mgr.gibba020.yqfnwy (mgr.34427) 7829 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:21:24.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:24 gibba013 bash[29418]: audit 2021-03-10T16:21:23.477135+0000 mon.a (mon.0) 2920 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:21:24.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:24 gibba013 bash[30381]: cluster 2021-03-10T16:21:22.907798+0000 mgr.gibba020.yqfnwy (mgr.34427) 7828 : cluster [DBG] pgmap v4460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:24.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:24 gibba013 bash[30381]: cephadm 2021-03-10T16:21:23.470652+0000 mgr.gibba020.yqfnwy (mgr.34427) 7829 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:21:24.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:24 gibba013 bash[30381]: audit 2021-03-10T16:21:23.477135+0000 mon.a (mon.0) 2920 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:21:24.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:24 gibba020 bash[25448]: cluster 2021-03-10T16:21:22.907798+0000 mgr.gibba020.yqfnwy (mgr.34427) 7828 : cluster [DBG] pgmap v4460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:24.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:24 gibba020 bash[25448]: cephadm 2021-03-10T16:21:23.470652+0000 mgr.gibba020.yqfnwy (mgr.34427) 7829 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:21:24.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:24 gibba020 bash[25448]: audit 2021-03-10T16:21:23.477135+0000 mon.a (mon.0) 2920 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:21:26.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:26 gibba013 bash[29418]: cluster 2021-03-10T16:21:24.909561+0000 mgr.gibba020.yqfnwy (mgr.34427) 7830 : cluster [DBG] pgmap v4461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:26.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:26 gibba013 bash[30381]: cluster 2021-03-10T16:21:24.909561+0000 mgr.gibba020.yqfnwy (mgr.34427) 7830 : cluster [DBG] pgmap v4461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:26.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:26 gibba020 bash[25448]: cluster 2021-03-10T16:21:24.909561+0000 mgr.gibba020.yqfnwy (mgr.34427) 7830 : cluster [DBG] pgmap v4461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:28.506 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:28 gibba020 bash[25448]: cluster 2021-03-10T16:21:26.910016+0000 mgr.gibba020.yqfnwy (mgr.34427) 7831 : cluster [DBG] pgmap v4462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:28.506 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:28 gibba020 bash[25448]: audit 2021-03-10T16:21:27.256342+0000 mon.a (mon.0) 2921 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:21:28.506 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:28 gibba020 bash[25448]: audit 2021-03-10T16:21:27.257301+0000 mon.a (mon.0) 2922 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T16:21:28.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:28 gibba013 bash[29418]: cluster 2021-03-10T16:21:26.910016+0000 mgr.gibba020.yqfnwy (mgr.34427) 7831 : cluster [DBG] pgmap v4462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:28.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:28 gibba013 bash[29418]: audit 2021-03-10T16:21:27.256342+0000 mon.a (mon.0) 2921 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:21:28.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:28 gibba013 bash[29418]: audit 2021-03-10T16:21:27.257301+0000 mon.a (mon.0) 2922 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T16:21:28.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:28 gibba013 bash[30381]: cluster 2021-03-10T16:21:26.910016+0000 mgr.gibba020.yqfnwy (mgr.34427) 7831 : cluster [DBG] pgmap v4462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:28.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:28 gibba013 bash[30381]: audit 2021-03-10T16:21:27.256342+0000 mon.a (mon.0) 2921 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:21:28.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:28 gibba013 bash[30381]: audit 2021-03-10T16:21:27.257301+0000 mon.a (mon.0) 2922 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T16:21:30.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:30 gibba020 bash[25448]: cluster 2021-03-10T16:21:28.911268+0000 mgr.gibba020.yqfnwy (mgr.34427) 7832 : cluster [DBG] pgmap v4463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:30.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:30 gibba013 bash[29418]: cluster 2021-03-10T16:21:28.911268+0000 mgr.gibba020.yqfnwy (mgr.34427) 7832 : cluster [DBG] pgmap v4463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:30.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:30 gibba013 bash[30381]: cluster 2021-03-10T16:21:28.911268+0000 mgr.gibba020.yqfnwy (mgr.34427) 7832 : cluster [DBG] pgmap v4463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:32.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:32 gibba013 bash[29418]: cluster 2021-03-10T16:21:30.912178+0000 mgr.gibba020.yqfnwy (mgr.34427) 7833 : cluster [DBG] pgmap v4464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:32.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:32 gibba013 bash[29418]: audit 2021-03-10T16:21:31.953592+0000 mon.a (mon.0) 2923 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:21:32.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:32 gibba013 bash[29418]: audit 2021-03-10T16:21:32.124248+0000 mon.a (mon.0) 2924 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:21:32.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:32 gibba013 bash[30381]: cluster 2021-03-10T16:21:30.912178+0000 mgr.gibba020.yqfnwy (mgr.34427) 7833 : cluster [DBG] pgmap v4464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:32.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:32 gibba013 bash[30381]: audit 2021-03-10T16:21:31.953592+0000 mon.a (mon.0) 2923 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:21:32.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:32 gibba013 bash[30381]: audit 2021-03-10T16:21:32.124248+0000 mon.a (mon.0) 2924 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:21:32.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:32 gibba020 bash[25448]: cluster 2021-03-10T16:21:30.912178+0000 mgr.gibba020.yqfnwy (mgr.34427) 7833 : cluster [DBG] pgmap v4464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:32.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:32 gibba020 bash[25448]: audit 2021-03-10T16:21:31.953592+0000 mon.a (mon.0) 2923 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:21:32.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:32 gibba020 bash[25448]: audit 2021-03-10T16:21:32.124248+0000 mon.a (mon.0) 2924 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:21:33.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:33 gibba013 bash[29418]: cephadm 2021-03-10T16:21:32.124149+0000 mgr.gibba020.yqfnwy (mgr.34427) 7834 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:21:33.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:33 gibba013 bash[29418]: audit 2021-03-10T16:21:32.309976+0000 mon.a (mon.0) 2925 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:21:33.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:33 gibba013 bash[29418]: cephadm 2021-03-10T16:21:32.311729+0000 mgr.gibba020.yqfnwy (mgr.34427) 7835 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:21:33.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:33 gibba013 bash[29418]: audit 2021-03-10T16:21:32.313212+0000 mon.a (mon.0) 2926 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:21:33.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:33 gibba013 bash[29418]: cephadm 2021-03-10T16:21:32.313860+0000 mgr.gibba020.yqfnwy (mgr.34427) 7836 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:21:33.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:33 gibba013 bash[29418]: audit 2021-03-10T16:21:32.314919+0000 mon.a (mon.0) 2927 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:33.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:33 gibba013 bash[29418]: cephadm 2021-03-10T16:21:32.315298+0000 mgr.gibba020.yqfnwy (mgr.34427) 7837 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:21:33.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:33 gibba013 bash[29418]: cephadm 2021-03-10T16:21:32.315341+0000 mgr.gibba020.yqfnwy (mgr.34427) 7838 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:21:33.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:33 gibba013 bash[29418]: audit 2021-03-10T16:21:32.316458+0000 mon.a (mon.0) 2928 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:33.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:33 gibba013 bash[29418]: cephadm 2021-03-10T16:21:32.316985+0000 mgr.gibba020.yqfnwy (mgr.34427) 7839 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:21:33.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:33 gibba013 bash[29418]: cephadm 2021-03-10T16:21:32.317021+0000 mgr.gibba020.yqfnwy (mgr.34427) 7840 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:21:33.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:33 gibba013 bash[29418]: audit 2021-03-10T16:21:32.318048+0000 mon.a (mon.0) 2929 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:33.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:33 gibba013 bash[29418]: cephadm 2021-03-10T16:21:32.318375+0000 mgr.gibba020.yqfnwy (mgr.34427) 7841 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:21:33.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:33 gibba013 bash[29418]: cephadm 2021-03-10T16:21:32.319873+0000 mgr.gibba020.yqfnwy (mgr.34427) 7842 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:21:33.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:33 gibba013 bash[29418]: cephadm 2021-03-10T16:21:32.319910+0000 mgr.gibba020.yqfnwy (mgr.34427) 7843 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:21:33.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:33 gibba013 bash[29418]: audit 2021-03-10T16:21:32.321106+0000 mon.a (mon.0) 2930 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:33.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:33 gibba013 bash[29418]: cephadm 2021-03-10T16:21:32.321490+0000 mgr.gibba020.yqfnwy (mgr.34427) 7844 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:21:33.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:33 gibba013 bash[29418]: cephadm 2021-03-10T16:21:32.321851+0000 mgr.gibba020.yqfnwy (mgr.34427) 7845 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:21:33.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:33 gibba013 bash[29418]: audit 2021-03-10T16:21:32.322860+0000 mon.a (mon.0) 2931 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:33.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:33 gibba013 bash[29418]: cephadm 2021-03-10T16:21:32.323357+0000 mgr.gibba020.yqfnwy (mgr.34427) 7846 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:21:33.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:33 gibba013 bash[29418]: cephadm 2021-03-10T16:21:32.323394+0000 mgr.gibba020.yqfnwy (mgr.34427) 7847 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:21:33.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:33 gibba013 bash[29418]: cephadm 2021-03-10T16:21:32.323503+0000 mgr.gibba020.yqfnwy (mgr.34427) 7848 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:21:33.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:33 gibba013 bash[30381]: cephadm 2021-03-10T16:21:32.124149+0000 mgr.gibba020.yqfnwy (mgr.34427) 7834 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:21:33.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:33 gibba013 bash[30381]: audit 2021-03-10T16:21:32.309976+0000 mon.a (mon.0) 2925 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:21:33.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:33 gibba013 bash[30381]: cephadm 2021-03-10T16:21:32.311729+0000 mgr.gibba020.yqfnwy (mgr.34427) 7835 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:21:33.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:33 gibba013 bash[30381]: audit 2021-03-10T16:21:32.313212+0000 mon.a (mon.0) 2926 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:21:33.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:33 gibba013 bash[30381]: cephadm 2021-03-10T16:21:32.313860+0000 mgr.gibba020.yqfnwy (mgr.34427) 7836 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:21:33.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:33 gibba013 bash[30381]: audit 2021-03-10T16:21:32.314919+0000 mon.a (mon.0) 2927 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:33.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:33 gibba013 bash[30381]: cephadm 2021-03-10T16:21:32.315298+0000 mgr.gibba020.yqfnwy (mgr.34427) 7837 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:21:33.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:33 gibba013 bash[30381]: cephadm 2021-03-10T16:21:32.315341+0000 mgr.gibba020.yqfnwy (mgr.34427) 7838 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:21:33.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:33 gibba013 bash[30381]: audit 2021-03-10T16:21:32.316458+0000 mon.a (mon.0) 2928 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:33.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:33 gibba013 bash[30381]: cephadm 2021-03-10T16:21:32.316985+0000 mgr.gibba020.yqfnwy (mgr.34427) 7839 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:21:33.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:33 gibba013 bash[30381]: cephadm 2021-03-10T16:21:32.317021+0000 mgr.gibba020.yqfnwy (mgr.34427) 7840 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:21:33.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:33 gibba013 bash[30381]: audit 2021-03-10T16:21:32.318048+0000 mon.a (mon.0) 2929 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:33.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:33 gibba013 bash[30381]: cephadm 2021-03-10T16:21:32.318375+0000 mgr.gibba020.yqfnwy (mgr.34427) 7841 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:21:33.644 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:33 gibba013 bash[30381]: cephadm 2021-03-10T16:21:32.319873+0000 mgr.gibba020.yqfnwy (mgr.34427) 7842 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:21:33.644 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:33 gibba013 bash[30381]: cephadm 2021-03-10T16:21:32.319910+0000 mgr.gibba020.yqfnwy (mgr.34427) 7843 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:21:33.645 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:33 gibba013 bash[30381]: audit 2021-03-10T16:21:32.321106+0000 mon.a (mon.0) 2930 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:33.645 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:33 gibba013 bash[30381]: cephadm 2021-03-10T16:21:32.321490+0000 mgr.gibba020.yqfnwy (mgr.34427) 7844 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:21:33.645 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:33 gibba013 bash[30381]: cephadm 2021-03-10T16:21:32.321851+0000 mgr.gibba020.yqfnwy (mgr.34427) 7845 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:21:33.646 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:33 gibba013 bash[30381]: audit 2021-03-10T16:21:32.322860+0000 mon.a (mon.0) 2931 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:33.646 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:33 gibba013 bash[30381]: cephadm 2021-03-10T16:21:32.323357+0000 mgr.gibba020.yqfnwy (mgr.34427) 7846 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:21:33.647 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:33 gibba013 bash[30381]: cephadm 2021-03-10T16:21:32.323394+0000 mgr.gibba020.yqfnwy (mgr.34427) 7847 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:21:33.647 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:33 gibba013 bash[30381]: cephadm 2021-03-10T16:21:32.323503+0000 mgr.gibba020.yqfnwy (mgr.34427) 7848 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:21:33.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:33 gibba020 bash[25448]: cephadm 2021-03-10T16:21:32.124149+0000 mgr.gibba020.yqfnwy (mgr.34427) 7834 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:21:33.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:33 gibba020 bash[25448]: audit 2021-03-10T16:21:32.309976+0000 mon.a (mon.0) 2925 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:21:33.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:33 gibba020 bash[25448]: cephadm 2021-03-10T16:21:32.311729+0000 mgr.gibba020.yqfnwy (mgr.34427) 7835 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:21:33.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:33 gibba020 bash[25448]: audit 2021-03-10T16:21:32.313212+0000 mon.a (mon.0) 2926 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:21:33.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:33 gibba020 bash[25448]: cephadm 2021-03-10T16:21:32.313860+0000 mgr.gibba020.yqfnwy (mgr.34427) 7836 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:21:33.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:33 gibba020 bash[25448]: audit 2021-03-10T16:21:32.314919+0000 mon.a (mon.0) 2927 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:33.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:33 gibba020 bash[25448]: cephadm 2021-03-10T16:21:32.315298+0000 mgr.gibba020.yqfnwy (mgr.34427) 7837 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:21:33.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:33 gibba020 bash[25448]: cephadm 2021-03-10T16:21:32.315341+0000 mgr.gibba020.yqfnwy (mgr.34427) 7838 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:21:33.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:33 gibba020 bash[25448]: audit 2021-03-10T16:21:32.316458+0000 mon.a (mon.0) 2928 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:33.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:33 gibba020 bash[25448]: cephadm 2021-03-10T16:21:32.316985+0000 mgr.gibba020.yqfnwy (mgr.34427) 7839 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:21:33.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:33 gibba020 bash[25448]: cephadm 2021-03-10T16:21:32.317021+0000 mgr.gibba020.yqfnwy (mgr.34427) 7840 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:21:33.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:33 gibba020 bash[25448]: audit 2021-03-10T16:21:32.318048+0000 mon.a (mon.0) 2929 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:33.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:33 gibba020 bash[25448]: cephadm 2021-03-10T16:21:32.318375+0000 mgr.gibba020.yqfnwy (mgr.34427) 7841 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:21:33.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:33 gibba020 bash[25448]: cephadm 2021-03-10T16:21:32.319873+0000 mgr.gibba020.yqfnwy (mgr.34427) 7842 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:21:33.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:33 gibba020 bash[25448]: cephadm 2021-03-10T16:21:32.319910+0000 mgr.gibba020.yqfnwy (mgr.34427) 7843 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:21:33.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:33 gibba020 bash[25448]: audit 2021-03-10T16:21:32.321106+0000 mon.a (mon.0) 2930 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:33.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:33 gibba020 bash[25448]: cephadm 2021-03-10T16:21:32.321490+0000 mgr.gibba020.yqfnwy (mgr.34427) 7844 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:21:33.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:33 gibba020 bash[25448]: cephadm 2021-03-10T16:21:32.321851+0000 mgr.gibba020.yqfnwy (mgr.34427) 7845 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:21:33.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:33 gibba020 bash[25448]: audit 2021-03-10T16:21:32.322860+0000 mon.a (mon.0) 2931 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:33.706 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:33 gibba020 bash[25448]: cephadm 2021-03-10T16:21:32.323357+0000 mgr.gibba020.yqfnwy (mgr.34427) 7846 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:21:33.706 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:33 gibba020 bash[25448]: cephadm 2021-03-10T16:21:32.323394+0000 mgr.gibba020.yqfnwy (mgr.34427) 7847 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:21:33.707 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:33 gibba020 bash[25448]: cephadm 2021-03-10T16:21:32.323503+0000 mgr.gibba020.yqfnwy (mgr.34427) 7848 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:21:34.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:34 gibba013 bash[29418]: cluster 2021-03-10T16:21:32.913376+0000 mgr.gibba020.yqfnwy (mgr.34427) 7849 : cluster [DBG] pgmap v4465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:34.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:34 gibba013 bash[30381]: cluster 2021-03-10T16:21:32.913376+0000 mgr.gibba020.yqfnwy (mgr.34427) 7849 : cluster [DBG] pgmap v4465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:34.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:34 gibba020 bash[25448]: cluster 2021-03-10T16:21:32.913376+0000 mgr.gibba020.yqfnwy (mgr.34427) 7849 : cluster [DBG] pgmap v4465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:36.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:36 gibba013 bash[29418]: cluster 2021-03-10T16:21:34.914994+0000 mgr.gibba020.yqfnwy (mgr.34427) 7850 : cluster [DBG] pgmap v4466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:36.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:36 gibba013 bash[30381]: cluster 2021-03-10T16:21:34.914994+0000 mgr.gibba020.yqfnwy (mgr.34427) 7850 : cluster [DBG] pgmap v4466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:36.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:36 gibba020 bash[25448]: cluster 2021-03-10T16:21:34.914994+0000 mgr.gibba020.yqfnwy (mgr.34427) 7850 : cluster [DBG] pgmap v4466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:38.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:38 gibba013 bash[29418]: cluster 2021-03-10T16:21:36.916660+0000 mgr.gibba020.yqfnwy (mgr.34427) 7851 : cluster [DBG] pgmap v4467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:38.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:38 gibba013 bash[30381]: cluster 2021-03-10T16:21:36.916660+0000 mgr.gibba020.yqfnwy (mgr.34427) 7851 : cluster [DBG] pgmap v4467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:38.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:38 gibba020 bash[25448]: cluster 2021-03-10T16:21:36.916660+0000 mgr.gibba020.yqfnwy (mgr.34427) 7851 : cluster [DBG] pgmap v4467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:40.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:40 gibba013 bash[29418]: cluster 2021-03-10T16:21:38.918340+0000 mgr.gibba020.yqfnwy (mgr.34427) 7852 : cluster [DBG] pgmap v4468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:40.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:40 gibba013 bash[30381]: cluster 2021-03-10T16:21:38.918340+0000 mgr.gibba020.yqfnwy (mgr.34427) 7852 : cluster [DBG] pgmap v4468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:40.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:40 gibba020 bash[25448]: cluster 2021-03-10T16:21:38.918340+0000 mgr.gibba020.yqfnwy (mgr.34427) 7852 : cluster [DBG] pgmap v4468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:42.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:42 gibba013 bash[29418]: cluster 2021-03-10T16:21:40.919798+0000 mgr.gibba020.yqfnwy (mgr.34427) 7853 : cluster [DBG] pgmap v4469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:42.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:42 gibba013 bash[30381]: cluster 2021-03-10T16:21:40.919798+0000 mgr.gibba020.yqfnwy (mgr.34427) 7853 : cluster [DBG] pgmap v4469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:42.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:42 gibba020 bash[25448]: cluster 2021-03-10T16:21:40.919798+0000 mgr.gibba020.yqfnwy (mgr.34427) 7853 : cluster [DBG] pgmap v4469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:44.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:44 gibba013 bash[29418]: cluster 2021-03-10T16:21:42.921359+0000 mgr.gibba020.yqfnwy (mgr.34427) 7854 : cluster [DBG] pgmap v4470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:44.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:44 gibba013 bash[30381]: cluster 2021-03-10T16:21:42.921359+0000 mgr.gibba020.yqfnwy (mgr.34427) 7854 : cluster [DBG] pgmap v4470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:44.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:44 gibba020 bash[25448]: cluster 2021-03-10T16:21:42.921359+0000 mgr.gibba020.yqfnwy (mgr.34427) 7854 : cluster [DBG] pgmap v4470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:46.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:46 gibba020 bash[25448]: cluster 2021-03-10T16:21:44.923052+0000 mgr.gibba020.yqfnwy (mgr.34427) 7855 : cluster [DBG] pgmap v4471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:46.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:46 gibba013 bash[29418]: cluster 2021-03-10T16:21:44.923052+0000 mgr.gibba020.yqfnwy (mgr.34427) 7855 : cluster [DBG] pgmap v4471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:46.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:46 gibba013 bash[30381]: cluster 2021-03-10T16:21:44.923052+0000 mgr.gibba020.yqfnwy (mgr.34427) 7855 : cluster [DBG] pgmap v4471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:48.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:48 gibba020 bash[25448]: cluster 2021-03-10T16:21:46.924566+0000 mgr.gibba020.yqfnwy (mgr.34427) 7856 : cluster [DBG] pgmap v4472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:48.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:48 gibba020 bash[25448]: cephadm 2021-03-10T16:21:47.339493+0000 mgr.gibba020.yqfnwy (mgr.34427) 7857 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:21:48.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:48 gibba013 bash[29418]: cluster 2021-03-10T16:21:46.924566+0000 mgr.gibba020.yqfnwy (mgr.34427) 7856 : cluster [DBG] pgmap v4472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:48.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:48 gibba013 bash[29418]: cephadm 2021-03-10T16:21:47.339493+0000 mgr.gibba020.yqfnwy (mgr.34427) 7857 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:21:48.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:48 gibba013 bash[30381]: cluster 2021-03-10T16:21:46.924566+0000 mgr.gibba020.yqfnwy (mgr.34427) 7856 : cluster [DBG] pgmap v4472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:48.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:48 gibba013 bash[30381]: cephadm 2021-03-10T16:21:47.339493+0000 mgr.gibba020.yqfnwy (mgr.34427) 7857 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:21:50.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:50 gibba020 bash[25448]: cluster 2021-03-10T16:21:48.926200+0000 mgr.gibba020.yqfnwy (mgr.34427) 7858 : cluster [DBG] pgmap v4473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:50.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:50 gibba013 bash[29418]: cluster 2021-03-10T16:21:48.926200+0000 mgr.gibba020.yqfnwy (mgr.34427) 7858 : cluster [DBG] pgmap v4473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:50.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:50 gibba013 bash[30381]: cluster 2021-03-10T16:21:48.926200+0000 mgr.gibba020.yqfnwy (mgr.34427) 7858 : cluster [DBG] pgmap v4473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:52.160 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:21:52.386 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:21:52.387 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 89s ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:21:52.387 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 25s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:21:52.387 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 25s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:21:52.388 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 25s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:21:52.388 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 89s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:21:52.388 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 89s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:21:52.388 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 25s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:21:52.389 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 89s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:21:52.389 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 89s ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:21:52.389 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 25s ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:21:52.390 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 89s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:21:52.390 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 89s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:21:52.390 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 89s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:21:52.390 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 89s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:21:52.391 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 25s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:21:52.391 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 25s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:21:52.391 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 25s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:21:52.391 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 25s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:21:52.392 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 25s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:21:52.392 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 25s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:21:52.637 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:21:52.637 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:21:52.637 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:21:52.638 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:21:52.638 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:21:52.638 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:21:52.638 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:21:52.639 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:21:52.639 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:21:52.639 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:21:52.639 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:21:52.640 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:21:52.640 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:21:52.640 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:21:52.640 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:21:52.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:52 gibba020 bash[25448]: cluster 2021-03-10T16:21:50.927774+0000 mgr.gibba020.yqfnwy (mgr.34427) 7859 : cluster [DBG] pgmap v4474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:52.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:52 gibba013 bash[29418]: cluster 2021-03-10T16:21:50.927774+0000 mgr.gibba020.yqfnwy (mgr.34427) 7859 : cluster [DBG] pgmap v4474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:52.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:52 gibba013 bash[30381]: cluster 2021-03-10T16:21:50.927774+0000 mgr.gibba020.yqfnwy (mgr.34427) 7859 : cluster [DBG] pgmap v4474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:53.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:53 gibba020 bash[25448]: audit 2021-03-10T16:21:52.151350+0000 mgr.gibba020.yqfnwy (mgr.34427) 7860 : audit [DBG] from='client.59308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:21:53.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:53 gibba020 bash[25448]: audit 2021-03-10T16:21:52.374373+0000 mgr.gibba020.yqfnwy (mgr.34427) 7861 : audit [DBG] from='client.49332 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:21:53.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:53 gibba020 bash[25448]: audit 2021-03-10T16:21:52.637856+0000 mon.a (mon.0) 2932 : audit [DBG] from='client.? 172.21.2.113:0/1073164258' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:53.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:53 gibba013 bash[29418]: audit 2021-03-10T16:21:52.151350+0000 mgr.gibba020.yqfnwy (mgr.34427) 7860 : audit [DBG] from='client.59308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:21:53.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:53 gibba013 bash[29418]: audit 2021-03-10T16:21:52.374373+0000 mgr.gibba020.yqfnwy (mgr.34427) 7861 : audit [DBG] from='client.49332 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:21:53.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:53 gibba013 bash[29418]: audit 2021-03-10T16:21:52.637856+0000 mon.a (mon.0) 2932 : audit [DBG] from='client.? 172.21.2.113:0/1073164258' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:53.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:53 gibba013 bash[30381]: audit 2021-03-10T16:21:52.151350+0000 mgr.gibba020.yqfnwy (mgr.34427) 7860 : audit [DBG] from='client.59308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:21:53.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:53 gibba013 bash[30381]: audit 2021-03-10T16:21:52.374373+0000 mgr.gibba020.yqfnwy (mgr.34427) 7861 : audit [DBG] from='client.49332 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:21:53.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:53 gibba013 bash[30381]: audit 2021-03-10T16:21:52.637856+0000 mon.a (mon.0) 2932 : audit [DBG] from='client.? 172.21.2.113:0/1073164258' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:21:54.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:54 gibba020 bash[25448]: cluster 2021-03-10T16:21:52.929115+0000 mgr.gibba020.yqfnwy (mgr.34427) 7862 : cluster [DBG] pgmap v4475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:54.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:54 gibba013 bash[29418]: cluster 2021-03-10T16:21:52.929115+0000 mgr.gibba020.yqfnwy (mgr.34427) 7862 : cluster [DBG] pgmap v4475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:54.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:54 gibba013 bash[30381]: cluster 2021-03-10T16:21:52.929115+0000 mgr.gibba020.yqfnwy (mgr.34427) 7862 : cluster [DBG] pgmap v4475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:56.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:56 gibba020 bash[25448]: cluster 2021-03-10T16:21:54.930707+0000 mgr.gibba020.yqfnwy (mgr.34427) 7863 : cluster [DBG] pgmap v4476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:56.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:56 gibba013 bash[29418]: cluster 2021-03-10T16:21:54.930707+0000 mgr.gibba020.yqfnwy (mgr.34427) 7863 : cluster [DBG] pgmap v4476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:56.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:56 gibba013 bash[30381]: cluster 2021-03-10T16:21:54.930707+0000 mgr.gibba020.yqfnwy (mgr.34427) 7863 : cluster [DBG] pgmap v4476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:58.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:21:58 gibba020 bash[25448]: cluster 2021-03-10T16:21:56.932362+0000 mgr.gibba020.yqfnwy (mgr.34427) 7864 : cluster [DBG] pgmap v4477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:58.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:21:58 gibba013 bash[29418]: cluster 2021-03-10T16:21:56.932362+0000 mgr.gibba020.yqfnwy (mgr.34427) 7864 : cluster [DBG] pgmap v4477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:21:58.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:21:58 gibba013 bash[30381]: cluster 2021-03-10T16:21:56.932362+0000 mgr.gibba020.yqfnwy (mgr.34427) 7864 : cluster [DBG] pgmap v4477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:00.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:00 gibba013 bash[29418]: cluster 2021-03-10T16:21:58.933910+0000 mgr.gibba020.yqfnwy (mgr.34427) 7865 : cluster [DBG] pgmap v4478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:00.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:00 gibba013 bash[30381]: cluster 2021-03-10T16:21:58.933910+0000 mgr.gibba020.yqfnwy (mgr.34427) 7865 : cluster [DBG] pgmap v4478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:00.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:00 gibba020 bash[25448]: cluster 2021-03-10T16:21:58.933910+0000 mgr.gibba020.yqfnwy (mgr.34427) 7865 : cluster [DBG] pgmap v4478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:02.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:02 gibba020 bash[25448]: cluster 2021-03-10T16:22:00.935505+0000 mgr.gibba020.yqfnwy (mgr.34427) 7866 : cluster [DBG] pgmap v4479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:02.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:02 gibba013 bash[29418]: cluster 2021-03-10T16:22:00.935505+0000 mgr.gibba020.yqfnwy (mgr.34427) 7866 : cluster [DBG] pgmap v4479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:02.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:02 gibba013 bash[30381]: cluster 2021-03-10T16:22:00.935505+0000 mgr.gibba020.yqfnwy (mgr.34427) 7866 : cluster [DBG] pgmap v4479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:03.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:03 gibba013 bash[29418]: cephadm 2021-03-10T16:22:02.355415+0000 mgr.gibba020.yqfnwy (mgr.34427) 7867 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:22:03.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:03 gibba013 bash[30381]: cephadm 2021-03-10T16:22:02.355415+0000 mgr.gibba020.yqfnwy (mgr.34427) 7867 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:22:03.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:03 gibba020 bash[25448]: cephadm 2021-03-10T16:22:02.355415+0000 mgr.gibba020.yqfnwy (mgr.34427) 7867 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:22:04.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:04 gibba013 bash[29418]: cluster 2021-03-10T16:22:02.936952+0000 mgr.gibba020.yqfnwy (mgr.34427) 7868 : cluster [DBG] pgmap v4480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:04.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:04 gibba013 bash[30381]: cluster 2021-03-10T16:22:02.936952+0000 mgr.gibba020.yqfnwy (mgr.34427) 7868 : cluster [DBG] pgmap v4480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:04.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:04 gibba020 bash[25448]: cluster 2021-03-10T16:22:02.936952+0000 mgr.gibba020.yqfnwy (mgr.34427) 7868 : cluster [DBG] pgmap v4480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:06.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:06 gibba013 bash[29418]: cluster 2021-03-10T16:22:04.938625+0000 mgr.gibba020.yqfnwy (mgr.34427) 7869 : cluster [DBG] pgmap v4481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:06.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:06 gibba013 bash[30381]: cluster 2021-03-10T16:22:04.938625+0000 mgr.gibba020.yqfnwy (mgr.34427) 7869 : cluster [DBG] pgmap v4481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:06.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:06 gibba020 bash[25448]: cluster 2021-03-10T16:22:04.938625+0000 mgr.gibba020.yqfnwy (mgr.34427) 7869 : cluster [DBG] pgmap v4481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:07.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:07 gibba013 bash[29418]: audit 2021-03-10T16:22:06.682034+0000 mon.a (mon.0) 2933 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:22:07.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:07 gibba013 bash[29418]: audit 2021-03-10T16:22:06.813150+0000 mon.a (mon.0) 2934 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:22:07.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:07 gibba013 bash[29418]: audit 2021-03-10T16:22:07.064410+0000 mon.a (mon.0) 2935 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:22:07.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:07 gibba013 bash[29418]: audit 2021-03-10T16:22:07.065133+0000 mon.a (mon.0) 2936 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:22:07.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:07 gibba013 bash[29418]: audit 2021-03-10T16:22:07.065773+0000 mon.a (mon.0) 2937 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T16:22:07.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:07 gibba013 bash[29418]: audit 2021-03-10T16:22:07.066469+0000 mon.a (mon.0) 2938 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:22:07.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:07 gibba013 bash[30381]: audit 2021-03-10T16:22:06.682034+0000 mon.a (mon.0) 2933 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:22:07.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:07 gibba013 bash[30381]: audit 2021-03-10T16:22:06.813150+0000 mon.a (mon.0) 2934 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:22:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:07 gibba013 bash[30381]: audit 2021-03-10T16:22:07.064410+0000 mon.a (mon.0) 2935 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:22:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:07 gibba013 bash[30381]: audit 2021-03-10T16:22:07.065133+0000 mon.a (mon.0) 2936 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:22:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:07 gibba013 bash[30381]: audit 2021-03-10T16:22:07.065773+0000 mon.a (mon.0) 2937 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T16:22:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:07 gibba013 bash[30381]: audit 2021-03-10T16:22:07.066469+0000 mon.a (mon.0) 2938 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:22:07.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:07 gibba020 bash[25448]: audit 2021-03-10T16:22:06.682034+0000 mon.a (mon.0) 2933 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:22:07.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:07 gibba020 bash[25448]: audit 2021-03-10T16:22:06.813150+0000 mon.a (mon.0) 2934 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:22:07.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:07 gibba020 bash[25448]: audit 2021-03-10T16:22:07.064410+0000 mon.a (mon.0) 2935 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:22:07.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:07 gibba020 bash[25448]: audit 2021-03-10T16:22:07.065133+0000 mon.a (mon.0) 2936 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:22:07.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:07 gibba020 bash[25448]: audit 2021-03-10T16:22:07.065773+0000 mon.a (mon.0) 2937 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T16:22:07.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:07 gibba020 bash[25448]: audit 2021-03-10T16:22:07.066469+0000 mon.a (mon.0) 2938 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:22:08.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:08 gibba013 bash[29418]: cluster 2021-03-10T16:22:06.940206+0000 mgr.gibba020.yqfnwy (mgr.34427) 7870 : cluster [DBG] pgmap v4482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:08.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:08 gibba013 bash[30381]: cluster 2021-03-10T16:22:06.940206+0000 mgr.gibba020.yqfnwy (mgr.34427) 7870 : cluster [DBG] pgmap v4482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:08.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:08 gibba020 bash[25448]: cluster 2021-03-10T16:22:06.940206+0000 mgr.gibba020.yqfnwy (mgr.34427) 7870 : cluster [DBG] pgmap v4482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:10.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:10 gibba013 bash[29418]: cluster 2021-03-10T16:22:08.941903+0000 mgr.gibba020.yqfnwy (mgr.34427) 7871 : cluster [DBG] pgmap v4483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:10.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:10 gibba013 bash[30381]: cluster 2021-03-10T16:22:08.941903+0000 mgr.gibba020.yqfnwy (mgr.34427) 7871 : cluster [DBG] pgmap v4483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:10.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:10 gibba020 bash[25448]: cluster 2021-03-10T16:22:08.941903+0000 mgr.gibba020.yqfnwy (mgr.34427) 7871 : cluster [DBG] pgmap v4483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:11.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:11 gibba013 bash[29418]: cluster 2021-03-10T16:22:10.943641+0000 mgr.gibba020.yqfnwy (mgr.34427) 7872 : cluster [DBG] pgmap v4484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:11.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:11 gibba013 bash[30381]: cluster 2021-03-10T16:22:10.943641+0000 mgr.gibba020.yqfnwy (mgr.34427) 7872 : cluster [DBG] pgmap v4484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:11.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:11 gibba020 bash[25448]: cluster 2021-03-10T16:22:10.943641+0000 mgr.gibba020.yqfnwy (mgr.34427) 7872 : cluster [DBG] pgmap v4484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:14.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:14 gibba013 bash[29418]: cluster 2021-03-10T16:22:12.945224+0000 mgr.gibba020.yqfnwy (mgr.34427) 7873 : cluster [DBG] pgmap v4485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:14.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:14 gibba013 bash[30381]: cluster 2021-03-10T16:22:12.945224+0000 mgr.gibba020.yqfnwy (mgr.34427) 7873 : cluster [DBG] pgmap v4485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:14.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:14 gibba020 bash[25448]: cluster 2021-03-10T16:22:12.945224+0000 mgr.gibba020.yqfnwy (mgr.34427) 7873 : cluster [DBG] pgmap v4485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:16.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:16 gibba013 bash[29418]: cluster 2021-03-10T16:22:14.947050+0000 mgr.gibba020.yqfnwy (mgr.34427) 7874 : cluster [DBG] pgmap v4486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:16.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:16 gibba013 bash[30381]: cluster 2021-03-10T16:22:14.947050+0000 mgr.gibba020.yqfnwy (mgr.34427) 7874 : cluster [DBG] pgmap v4486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:16.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:16 gibba020 bash[25448]: cluster 2021-03-10T16:22:14.947050+0000 mgr.gibba020.yqfnwy (mgr.34427) 7874 : cluster [DBG] pgmap v4486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:18.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:18 gibba013 bash[29418]: cluster 2021-03-10T16:22:16.948555+0000 mgr.gibba020.yqfnwy (mgr.34427) 7875 : cluster [DBG] pgmap v4487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:18.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:18 gibba013 bash[29418]: cephadm 2021-03-10T16:22:17.371438+0000 mgr.gibba020.yqfnwy (mgr.34427) 7876 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:22:18.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:18 gibba013 bash[30381]: cluster 2021-03-10T16:22:16.948555+0000 mgr.gibba020.yqfnwy (mgr.34427) 7875 : cluster [DBG] pgmap v4487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:18.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:18 gibba013 bash[30381]: cephadm 2021-03-10T16:22:17.371438+0000 mgr.gibba020.yqfnwy (mgr.34427) 7876 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:22:18.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:18 gibba020 bash[25448]: cluster 2021-03-10T16:22:16.948555+0000 mgr.gibba020.yqfnwy (mgr.34427) 7875 : cluster [DBG] pgmap v4487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:18.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:18 gibba020 bash[25448]: cephadm 2021-03-10T16:22:17.371438+0000 mgr.gibba020.yqfnwy (mgr.34427) 7876 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:22:20.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:20 gibba013 bash[29418]: cluster 2021-03-10T16:22:18.950235+0000 mgr.gibba020.yqfnwy (mgr.34427) 7877 : cluster [DBG] pgmap v4488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:20.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:20 gibba013 bash[30381]: cluster 2021-03-10T16:22:18.950235+0000 mgr.gibba020.yqfnwy (mgr.34427) 7877 : cluster [DBG] pgmap v4488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:20.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:20 gibba020 bash[25448]: cluster 2021-03-10T16:22:18.950235+0000 mgr.gibba020.yqfnwy (mgr.34427) 7877 : cluster [DBG] pgmap v4488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:22.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:22 gibba013 bash[29418]: cluster 2021-03-10T16:22:20.952104+0000 mgr.gibba020.yqfnwy (mgr.34427) 7878 : cluster [DBG] pgmap v4489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:22.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:22 gibba013 bash[30381]: cluster 2021-03-10T16:22:20.952104+0000 mgr.gibba020.yqfnwy (mgr.34427) 7878 : cluster [DBG] pgmap v4489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:22.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:22 gibba020 bash[25448]: cluster 2021-03-10T16:22:20.952104+0000 mgr.gibba020.yqfnwy (mgr.34427) 7878 : cluster [DBG] pgmap v4489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:22.880 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:22:23.107 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:22:23.107 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 119s ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:22:23.108 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 55s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:22:23.108 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 55s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:22:23.108 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 55s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:22:23.108 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 119s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:22:23.109 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 119s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:22:23.109 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 55s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:22:23.109 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 119s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:22:23.109 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 119s ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:22:23.110 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 55s ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:22:23.110 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 119s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:22:23.110 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 119s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:22:23.110 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 119s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:22:23.111 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 119s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:22:23.111 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 55s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:22:23.111 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 55s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:22:23.111 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 55s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:22:23.111 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 55s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:22:23.112 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 55s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:22:23.112 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 55s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:22:23.359 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:22:23.359 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:22:23.360 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:22:23.360 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:22:23.360 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:22:23.360 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:22:23.360 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:22:23.361 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:22:23.361 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:22:23.361 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:22:23.361 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:22:23.362 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:22:23.362 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:22:23.363 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:22:23.363 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:22:24.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:24 gibba013 bash[29418]: audit 2021-03-10T16:22:22.871228+0000 mgr.gibba020.yqfnwy (mgr.34427) 7879 : audit [DBG] from='client.49344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:22:24.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:24 gibba013 bash[29418]: cluster 2021-03-10T16:22:22.953330+0000 mgr.gibba020.yqfnwy (mgr.34427) 7880 : cluster [DBG] pgmap v4490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:24.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:24 gibba013 bash[29418]: audit 2021-03-10T16:22:23.095614+0000 mgr.gibba020.yqfnwy (mgr.34427) 7881 : audit [DBG] from='client.59332 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:22:24.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:24 gibba013 bash[29418]: audit 2021-03-10T16:22:23.360027+0000 mon.a (mon.0) 2939 : audit [DBG] from='client.? 172.21.2.113:0/3213228627' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:24.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:24 gibba013 bash[30381]: audit 2021-03-10T16:22:22.871228+0000 mgr.gibba020.yqfnwy (mgr.34427) 7879 : audit [DBG] from='client.49344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:22:24.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:24 gibba013 bash[30381]: cluster 2021-03-10T16:22:22.953330+0000 mgr.gibba020.yqfnwy (mgr.34427) 7880 : cluster [DBG] pgmap v4490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:24.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:24 gibba013 bash[30381]: audit 2021-03-10T16:22:23.095614+0000 mgr.gibba020.yqfnwy (mgr.34427) 7881 : audit [DBG] from='client.59332 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:22:24.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:24 gibba013 bash[30381]: audit 2021-03-10T16:22:23.360027+0000 mon.a (mon.0) 2939 : audit [DBG] from='client.? 172.21.2.113:0/3213228627' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:24.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:24 gibba020 bash[25448]: audit 2021-03-10T16:22:22.871228+0000 mgr.gibba020.yqfnwy (mgr.34427) 7879 : audit [DBG] from='client.49344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:22:24.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:24 gibba020 bash[25448]: cluster 2021-03-10T16:22:22.953330+0000 mgr.gibba020.yqfnwy (mgr.34427) 7880 : cluster [DBG] pgmap v4490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:24.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:24 gibba020 bash[25448]: audit 2021-03-10T16:22:23.095614+0000 mgr.gibba020.yqfnwy (mgr.34427) 7881 : audit [DBG] from='client.59332 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:22:24.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:24 gibba020 bash[25448]: audit 2021-03-10T16:22:23.360027+0000 mon.a (mon.0) 2939 : audit [DBG] from='client.? 172.21.2.113:0/3213228627' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:26.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:26 gibba013 bash[29418]: cluster 2021-03-10T16:22:24.954984+0000 mgr.gibba020.yqfnwy (mgr.34427) 7882 : cluster [DBG] pgmap v4491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:26.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:26 gibba013 bash[30381]: cluster 2021-03-10T16:22:24.954984+0000 mgr.gibba020.yqfnwy (mgr.34427) 7882 : cluster [DBG] pgmap v4491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:26.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:26 gibba020 bash[25448]: cluster 2021-03-10T16:22:24.954984+0000 mgr.gibba020.yqfnwy (mgr.34427) 7882 : cluster [DBG] pgmap v4491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:28.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:28 gibba020 bash[25448]: cluster 2021-03-10T16:22:26.956585+0000 mgr.gibba020.yqfnwy (mgr.34427) 7883 : cluster [DBG] pgmap v4492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:28.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:28 gibba013 bash[29418]: cluster 2021-03-10T16:22:26.956585+0000 mgr.gibba020.yqfnwy (mgr.34427) 7883 : cluster [DBG] pgmap v4492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:28.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:28 gibba013 bash[30381]: cluster 2021-03-10T16:22:26.956585+0000 mgr.gibba020.yqfnwy (mgr.34427) 7883 : cluster [DBG] pgmap v4492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:30.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:30 gibba020 bash[25448]: cluster 2021-03-10T16:22:28.958255+0000 mgr.gibba020.yqfnwy (mgr.34427) 7884 : cluster [DBG] pgmap v4493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:30.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:30 gibba013 bash[29418]: cluster 2021-03-10T16:22:28.958255+0000 mgr.gibba020.yqfnwy (mgr.34427) 7884 : cluster [DBG] pgmap v4493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:30.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:30 gibba013 bash[30381]: cluster 2021-03-10T16:22:28.958255+0000 mgr.gibba020.yqfnwy (mgr.34427) 7884 : cluster [DBG] pgmap v4493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:32.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:32 gibba020 bash[25448]: cluster 2021-03-10T16:22:30.960074+0000 mgr.gibba020.yqfnwy (mgr.34427) 7885 : cluster [DBG] pgmap v4494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:32.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:32 gibba013 bash[29418]: cluster 2021-03-10T16:22:30.960074+0000 mgr.gibba020.yqfnwy (mgr.34427) 7885 : cluster [DBG] pgmap v4494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:32.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:32 gibba013 bash[30381]: cluster 2021-03-10T16:22:30.960074+0000 mgr.gibba020.yqfnwy (mgr.34427) 7885 : cluster [DBG] pgmap v4494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:33.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:33 gibba020 bash[25448]: audit 2021-03-10T16:22:32.381807+0000 mon.a (mon.0) 2940 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:22:33.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:33 gibba020 bash[25448]: cephadm 2021-03-10T16:22:32.386756+0000 mgr.gibba020.yqfnwy (mgr.34427) 7886 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:22:33.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:33 gibba020 bash[25448]: cephadm 2021-03-10T16:22:32.388697+0000 mgr.gibba020.yqfnwy (mgr.34427) 7887 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:22:33.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:33 gibba020 bash[25448]: audit 2021-03-10T16:22:32.625814+0000 mon.a (mon.0) 2941 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:22:33.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:33 gibba020 bash[25448]: audit 2021-03-10T16:22:32.629173+0000 mon.a (mon.0) 2942 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:22:33.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:33 gibba020 bash[25448]: audit 2021-03-10T16:22:32.631245+0000 mon.a (mon.0) 2943 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:33.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:33 gibba020 bash[25448]: audit 2021-03-10T16:22:32.632659+0000 mon.a (mon.0) 2944 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:33.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:33 gibba020 bash[25448]: audit 2021-03-10T16:22:32.633911+0000 mon.a (mon.0) 2945 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:33.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:33 gibba020 bash[25448]: audit 2021-03-10T16:22:32.636650+0000 mon.a (mon.0) 2946 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:33.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:33 gibba020 bash[25448]: audit 2021-03-10T16:22:32.638286+0000 mon.a (mon.0) 2947 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:33.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:33 gibba013 bash[30381]: audit 2021-03-10T16:22:32.381807+0000 mon.a (mon.0) 2940 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:22:33.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:33 gibba013 bash[30381]: cephadm 2021-03-10T16:22:32.386756+0000 mgr.gibba020.yqfnwy (mgr.34427) 7886 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:22:33.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:33 gibba013 bash[30381]: cephadm 2021-03-10T16:22:32.388697+0000 mgr.gibba020.yqfnwy (mgr.34427) 7887 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:22:33.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:33 gibba013 bash[30381]: audit 2021-03-10T16:22:32.625814+0000 mon.a (mon.0) 2941 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:22:33.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:33 gibba013 bash[30381]: audit 2021-03-10T16:22:32.629173+0000 mon.a (mon.0) 2942 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:22:33.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:33 gibba013 bash[30381]: audit 2021-03-10T16:22:32.631245+0000 mon.a (mon.0) 2943 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:33.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:33 gibba013 bash[30381]: audit 2021-03-10T16:22:32.632659+0000 mon.a (mon.0) 2944 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:33.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:33 gibba013 bash[30381]: audit 2021-03-10T16:22:32.633911+0000 mon.a (mon.0) 2945 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:33.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:33 gibba013 bash[30381]: audit 2021-03-10T16:22:32.636650+0000 mon.a (mon.0) 2946 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:33.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:33 gibba013 bash[30381]: audit 2021-03-10T16:22:32.638286+0000 mon.a (mon.0) 2947 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:33.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:33 gibba013 bash[29418]: audit 2021-03-10T16:22:32.381807+0000 mon.a (mon.0) 2940 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:22:33.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:33 gibba013 bash[29418]: cephadm 2021-03-10T16:22:32.386756+0000 mgr.gibba020.yqfnwy (mgr.34427) 7886 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:22:33.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:33 gibba013 bash[29418]: cephadm 2021-03-10T16:22:32.388697+0000 mgr.gibba020.yqfnwy (mgr.34427) 7887 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:22:33.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:33 gibba013 bash[29418]: audit 2021-03-10T16:22:32.625814+0000 mon.a (mon.0) 2941 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:22:33.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:33 gibba013 bash[29418]: audit 2021-03-10T16:22:32.629173+0000 mon.a (mon.0) 2942 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:22:33.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:33 gibba013 bash[29418]: audit 2021-03-10T16:22:32.631245+0000 mon.a (mon.0) 2943 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:33.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:33 gibba013 bash[29418]: audit 2021-03-10T16:22:32.632659+0000 mon.a (mon.0) 2944 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:33.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:33 gibba013 bash[29418]: audit 2021-03-10T16:22:32.633911+0000 mon.a (mon.0) 2945 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:33.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:33 gibba013 bash[29418]: audit 2021-03-10T16:22:32.636650+0000 mon.a (mon.0) 2946 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:33.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:33 gibba013 bash[29418]: audit 2021-03-10T16:22:32.638286+0000 mon.a (mon.0) 2947 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:34.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:34 gibba020 bash[25448]: cephadm 2021-03-10T16:22:32.627794+0000 mgr.gibba020.yqfnwy (mgr.34427) 7888 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:22:34.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:34 gibba020 bash[25448]: cephadm 2021-03-10T16:22:32.629935+0000 mgr.gibba020.yqfnwy (mgr.34427) 7889 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:22:34.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:34 gibba020 bash[25448]: cephadm 2021-03-10T16:22:32.631498+0000 mgr.gibba020.yqfnwy (mgr.34427) 7890 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:22:34.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:34 gibba020 bash[25448]: cephadm 2021-03-10T16:22:32.631535+0000 mgr.gibba020.yqfnwy (mgr.34427) 7891 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:22:34.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:34 gibba020 bash[25448]: cephadm 2021-03-10T16:22:32.632831+0000 mgr.gibba020.yqfnwy (mgr.34427) 7892 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:22:34.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:34 gibba020 bash[25448]: cephadm 2021-03-10T16:22:32.632867+0000 mgr.gibba020.yqfnwy (mgr.34427) 7893 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:22:34.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:34 gibba020 bash[25448]: cephadm 2021-03-10T16:22:32.634210+0000 mgr.gibba020.yqfnwy (mgr.34427) 7894 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:22:34.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:34 gibba020 bash[25448]: cephadm 2021-03-10T16:22:32.635461+0000 mgr.gibba020.yqfnwy (mgr.34427) 7895 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:22:34.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:34 gibba020 bash[25448]: cephadm 2021-03-10T16:22:32.635498+0000 mgr.gibba020.yqfnwy (mgr.34427) 7896 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:22:34.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:34 gibba020 bash[25448]: cephadm 2021-03-10T16:22:32.636980+0000 mgr.gibba020.yqfnwy (mgr.34427) 7897 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:22:34.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:34 gibba020 bash[25448]: cephadm 2021-03-10T16:22:32.637308+0000 mgr.gibba020.yqfnwy (mgr.34427) 7898 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:22:34.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:34 gibba020 bash[25448]: cephadm 2021-03-10T16:22:32.638687+0000 mgr.gibba020.yqfnwy (mgr.34427) 7899 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:22:34.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:34 gibba020 bash[25448]: cephadm 2021-03-10T16:22:32.638723+0000 mgr.gibba020.yqfnwy (mgr.34427) 7900 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:22:34.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:34 gibba020 bash[25448]: cephadm 2021-03-10T16:22:32.638829+0000 mgr.gibba020.yqfnwy (mgr.34427) 7901 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:22:34.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:34 gibba020 bash[25448]: cluster 2021-03-10T16:22:32.961123+0000 mgr.gibba020.yqfnwy (mgr.34427) 7902 : cluster [DBG] pgmap v4495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:34.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:34 gibba013 bash[29418]: cephadm 2021-03-10T16:22:32.627794+0000 mgr.gibba020.yqfnwy (mgr.34427) 7888 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:22:34.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:34 gibba013 bash[29418]: cephadm 2021-03-10T16:22:32.629935+0000 mgr.gibba020.yqfnwy (mgr.34427) 7889 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:22:34.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:34 gibba013 bash[29418]: cephadm 2021-03-10T16:22:32.631498+0000 mgr.gibba020.yqfnwy (mgr.34427) 7890 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:22:34.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:34 gibba013 bash[29418]: cephadm 2021-03-10T16:22:32.631535+0000 mgr.gibba020.yqfnwy (mgr.34427) 7891 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:22:34.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:34 gibba013 bash[29418]: cephadm 2021-03-10T16:22:32.632831+0000 mgr.gibba020.yqfnwy (mgr.34427) 7892 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:22:34.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:34 gibba013 bash[29418]: cephadm 2021-03-10T16:22:32.632867+0000 mgr.gibba020.yqfnwy (mgr.34427) 7893 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:22:34.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:34 gibba013 bash[29418]: cephadm 2021-03-10T16:22:32.634210+0000 mgr.gibba020.yqfnwy (mgr.34427) 7894 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:22:34.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:34 gibba013 bash[29418]: cephadm 2021-03-10T16:22:32.635461+0000 mgr.gibba020.yqfnwy (mgr.34427) 7895 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:22:34.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:34 gibba013 bash[29418]: cephadm 2021-03-10T16:22:32.635498+0000 mgr.gibba020.yqfnwy (mgr.34427) 7896 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:22:34.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:34 gibba013 bash[29418]: cephadm 2021-03-10T16:22:32.636980+0000 mgr.gibba020.yqfnwy (mgr.34427) 7897 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:22:34.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:34 gibba013 bash[29418]: cephadm 2021-03-10T16:22:32.637308+0000 mgr.gibba020.yqfnwy (mgr.34427) 7898 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:22:34.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:34 gibba013 bash[29418]: cephadm 2021-03-10T16:22:32.638687+0000 mgr.gibba020.yqfnwy (mgr.34427) 7899 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:22:34.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:34 gibba013 bash[29418]: cephadm 2021-03-10T16:22:32.638723+0000 mgr.gibba020.yqfnwy (mgr.34427) 7900 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:22:34.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:34 gibba013 bash[29418]: cephadm 2021-03-10T16:22:32.638829+0000 mgr.gibba020.yqfnwy (mgr.34427) 7901 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:22:34.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:34 gibba013 bash[29418]: cluster 2021-03-10T16:22:32.961123+0000 mgr.gibba020.yqfnwy (mgr.34427) 7902 : cluster [DBG] pgmap v4495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:34.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:34 gibba013 bash[30381]: cephadm 2021-03-10T16:22:32.627794+0000 mgr.gibba020.yqfnwy (mgr.34427) 7888 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:22:34.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:34 gibba013 bash[30381]: cephadm 2021-03-10T16:22:32.629935+0000 mgr.gibba020.yqfnwy (mgr.34427) 7889 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:22:34.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:34 gibba013 bash[30381]: cephadm 2021-03-10T16:22:32.631498+0000 mgr.gibba020.yqfnwy (mgr.34427) 7890 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:22:34.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:34 gibba013 bash[30381]: cephadm 2021-03-10T16:22:32.631535+0000 mgr.gibba020.yqfnwy (mgr.34427) 7891 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:22:34.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:34 gibba013 bash[30381]: cephadm 2021-03-10T16:22:32.632831+0000 mgr.gibba020.yqfnwy (mgr.34427) 7892 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:22:34.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:34 gibba013 bash[30381]: cephadm 2021-03-10T16:22:32.632867+0000 mgr.gibba020.yqfnwy (mgr.34427) 7893 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:22:34.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:34 gibba013 bash[30381]: cephadm 2021-03-10T16:22:32.634210+0000 mgr.gibba020.yqfnwy (mgr.34427) 7894 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:22:34.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:34 gibba013 bash[30381]: cephadm 2021-03-10T16:22:32.635461+0000 mgr.gibba020.yqfnwy (mgr.34427) 7895 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:22:34.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:34 gibba013 bash[30381]: cephadm 2021-03-10T16:22:32.635498+0000 mgr.gibba020.yqfnwy (mgr.34427) 7896 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:22:34.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:34 gibba013 bash[30381]: cephadm 2021-03-10T16:22:32.636980+0000 mgr.gibba020.yqfnwy (mgr.34427) 7897 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:22:34.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:34 gibba013 bash[30381]: cephadm 2021-03-10T16:22:32.637308+0000 mgr.gibba020.yqfnwy (mgr.34427) 7898 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:22:34.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:34 gibba013 bash[30381]: cephadm 2021-03-10T16:22:32.638687+0000 mgr.gibba020.yqfnwy (mgr.34427) 7899 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:22:34.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:34 gibba013 bash[30381]: cephadm 2021-03-10T16:22:32.638723+0000 mgr.gibba020.yqfnwy (mgr.34427) 7900 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:22:34.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:34 gibba013 bash[30381]: cephadm 2021-03-10T16:22:32.638829+0000 mgr.gibba020.yqfnwy (mgr.34427) 7901 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:22:34.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:34 gibba013 bash[30381]: cluster 2021-03-10T16:22:32.961123+0000 mgr.gibba020.yqfnwy (mgr.34427) 7902 : cluster [DBG] pgmap v4495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:36.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:36 gibba020 bash[25448]: cluster 2021-03-10T16:22:34.962707+0000 mgr.gibba020.yqfnwy (mgr.34427) 7903 : cluster [DBG] pgmap v4496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:36.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:36 gibba013 bash[29418]: cluster 2021-03-10T16:22:34.962707+0000 mgr.gibba020.yqfnwy (mgr.34427) 7903 : cluster [DBG] pgmap v4496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:36.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:36 gibba013 bash[30381]: cluster 2021-03-10T16:22:34.962707+0000 mgr.gibba020.yqfnwy (mgr.34427) 7903 : cluster [DBG] pgmap v4496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:38.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:38 gibba020 bash[25448]: cluster 2021-03-10T16:22:36.964405+0000 mgr.gibba020.yqfnwy (mgr.34427) 7904 : cluster [DBG] pgmap v4497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:38.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:38 gibba013 bash[29418]: cluster 2021-03-10T16:22:36.964405+0000 mgr.gibba020.yqfnwy (mgr.34427) 7904 : cluster [DBG] pgmap v4497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:38.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:38 gibba013 bash[30381]: cluster 2021-03-10T16:22:36.964405+0000 mgr.gibba020.yqfnwy (mgr.34427) 7904 : cluster [DBG] pgmap v4497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:40.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:40 gibba020 bash[25448]: cluster 2021-03-10T16:22:38.965803+0000 mgr.gibba020.yqfnwy (mgr.34427) 7905 : cluster [DBG] pgmap v4498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:40.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:40 gibba013 bash[29418]: cluster 2021-03-10T16:22:38.965803+0000 mgr.gibba020.yqfnwy (mgr.34427) 7905 : cluster [DBG] pgmap v4498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:40.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:40 gibba013 bash[30381]: cluster 2021-03-10T16:22:38.965803+0000 mgr.gibba020.yqfnwy (mgr.34427) 7905 : cluster [DBG] pgmap v4498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:42.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:42 gibba020 bash[25448]: cluster 2021-03-10T16:22:40.967394+0000 mgr.gibba020.yqfnwy (mgr.34427) 7906 : cluster [DBG] pgmap v4499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:42.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:42 gibba013 bash[29418]: cluster 2021-03-10T16:22:40.967394+0000 mgr.gibba020.yqfnwy (mgr.34427) 7906 : cluster [DBG] pgmap v4499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:42.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:42 gibba013 bash[30381]: cluster 2021-03-10T16:22:40.967394+0000 mgr.gibba020.yqfnwy (mgr.34427) 7906 : cluster [DBG] pgmap v4499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:44.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:44 gibba013 bash[29418]: cluster 2021-03-10T16:22:42.968698+0000 mgr.gibba020.yqfnwy (mgr.34427) 7907 : cluster [DBG] pgmap v4500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:44.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:44 gibba013 bash[30381]: cluster 2021-03-10T16:22:42.968698+0000 mgr.gibba020.yqfnwy (mgr.34427) 7907 : cluster [DBG] pgmap v4500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:44.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:44 gibba020 bash[25448]: cluster 2021-03-10T16:22:42.968698+0000 mgr.gibba020.yqfnwy (mgr.34427) 7907 : cluster [DBG] pgmap v4500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:46.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:46 gibba013 bash[29418]: cluster 2021-03-10T16:22:44.970232+0000 mgr.gibba020.yqfnwy (mgr.34427) 7908 : cluster [DBG] pgmap v4501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:46.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:46 gibba013 bash[30381]: cluster 2021-03-10T16:22:44.970232+0000 mgr.gibba020.yqfnwy (mgr.34427) 7908 : cluster [DBG] pgmap v4501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:46.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:46 gibba020 bash[25448]: cluster 2021-03-10T16:22:44.970232+0000 mgr.gibba020.yqfnwy (mgr.34427) 7908 : cluster [DBG] pgmap v4501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:48.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:48 gibba013 bash[29418]: cluster 2021-03-10T16:22:46.971843+0000 mgr.gibba020.yqfnwy (mgr.34427) 7909 : cluster [DBG] pgmap v4502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:48.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:48 gibba013 bash[30381]: cluster 2021-03-10T16:22:46.971843+0000 mgr.gibba020.yqfnwy (mgr.34427) 7909 : cluster [DBG] pgmap v4502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:48.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:48 gibba020 bash[25448]: cluster 2021-03-10T16:22:46.971843+0000 mgr.gibba020.yqfnwy (mgr.34427) 7909 : cluster [DBG] pgmap v4502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:49.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:49 gibba013 bash[29418]: cephadm 2021-03-10T16:22:47.654883+0000 mgr.gibba020.yqfnwy (mgr.34427) 7910 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:22:49.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:49 gibba013 bash[30381]: cephadm 2021-03-10T16:22:47.654883+0000 mgr.gibba020.yqfnwy (mgr.34427) 7910 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:22:49.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:49 gibba020 bash[25448]: cephadm 2021-03-10T16:22:47.654883+0000 mgr.gibba020.yqfnwy (mgr.34427) 7910 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:22:50.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:50 gibba013 bash[29418]: cluster 2021-03-10T16:22:48.973349+0000 mgr.gibba020.yqfnwy (mgr.34427) 7911 : cluster [DBG] pgmap v4503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:50.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:50 gibba013 bash[30381]: cluster 2021-03-10T16:22:48.973349+0000 mgr.gibba020.yqfnwy (mgr.34427) 7911 : cluster [DBG] pgmap v4503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:50.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:50 gibba020 bash[25448]: cluster 2021-03-10T16:22:48.973349+0000 mgr.gibba020.yqfnwy (mgr.34427) 7911 : cluster [DBG] pgmap v4503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:52.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:52 gibba013 bash[29418]: cluster 2021-03-10T16:22:50.974930+0000 mgr.gibba020.yqfnwy (mgr.34427) 7912 : cluster [DBG] pgmap v4504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:52.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:52 gibba013 bash[30381]: cluster 2021-03-10T16:22:50.974930+0000 mgr.gibba020.yqfnwy (mgr.34427) 7912 : cluster [DBG] pgmap v4504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:52.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:52 gibba020 bash[25448]: cluster 2021-03-10T16:22:50.974930+0000 mgr.gibba020.yqfnwy (mgr.34427) 7912 : cluster [DBG] pgmap v4504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:53.602 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:22:53.829 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:22:53.829 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 2m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:22:53.830 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 86s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:22:53.830 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 86s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:22:53.830 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 86s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:22:53.831 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:22:53.831 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:22:53.831 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 86s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:22:53.831 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:22:53.831 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:22:53.832 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 86s ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:22:53.832 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:22:53.832 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:22:53.832 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:22:53.833 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:22:53.833 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 86s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:22:53.833 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 86s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:22:53.833 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 86s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:22:53.834 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 86s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:22:53.834 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 86s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:22:53.834 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 86s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:22:54.079 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:22:54.080 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:22:54.080 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:22:54.080 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:22:54.080 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:22:54.081 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:22:54.081 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:22:54.081 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:22:54.081 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:22:54.081 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:22:54.082 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:22:54.082 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:22:54.082 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:22:54.082 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:22:54.083 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:22:54.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:54 gibba013 bash[29418]: cluster 2021-03-10T16:22:52.976403+0000 mgr.gibba020.yqfnwy (mgr.34427) 7913 : cluster [DBG] pgmap v4505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:54.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:54 gibba013 bash[29418]: audit 2021-03-10T16:22:54.080441+0000 mon.a (mon.0) 2948 : audit [DBG] from='client.? 172.21.2.113:0/3627939001' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:54.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:54 gibba013 bash[30381]: cluster 2021-03-10T16:22:52.976403+0000 mgr.gibba020.yqfnwy (mgr.34427) 7913 : cluster [DBG] pgmap v4505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:54.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:54 gibba013 bash[30381]: audit 2021-03-10T16:22:54.080441+0000 mon.a (mon.0) 2948 : audit [DBG] from='client.? 172.21.2.113:0/3627939001' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:54.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:54 gibba020 bash[25448]: cluster 2021-03-10T16:22:52.976403+0000 mgr.gibba020.yqfnwy (mgr.34427) 7913 : cluster [DBG] pgmap v4505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:54.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:54 gibba020 bash[25448]: audit 2021-03-10T16:22:54.080441+0000 mon.a (mon.0) 2948 : audit [DBG] from='client.? 172.21.2.113:0/3627939001' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:22:55.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:55 gibba013 bash[29418]: audit 2021-03-10T16:22:53.593387+0000 mgr.gibba020.yqfnwy (mgr.34427) 7914 : audit [DBG] from='client.59344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:22:55.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:55 gibba013 bash[29418]: audit 2021-03-10T16:22:53.816391+0000 mgr.gibba020.yqfnwy (mgr.34427) 7915 : audit [DBG] from='client.49368 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:22:55.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:55 gibba013 bash[30381]: audit 2021-03-10T16:22:53.593387+0000 mgr.gibba020.yqfnwy (mgr.34427) 7914 : audit [DBG] from='client.59344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:22:55.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:55 gibba013 bash[30381]: audit 2021-03-10T16:22:53.816391+0000 mgr.gibba020.yqfnwy (mgr.34427) 7915 : audit [DBG] from='client.49368 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:22:55.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:55 gibba020 bash[25448]: audit 2021-03-10T16:22:53.593387+0000 mgr.gibba020.yqfnwy (mgr.34427) 7914 : audit [DBG] from='client.59344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:22:55.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:55 gibba020 bash[25448]: audit 2021-03-10T16:22:53.816391+0000 mgr.gibba020.yqfnwy (mgr.34427) 7915 : audit [DBG] from='client.49368 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:22:56.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:56 gibba013 bash[29418]: cluster 2021-03-10T16:22:54.978059+0000 mgr.gibba020.yqfnwy (mgr.34427) 7916 : cluster [DBG] pgmap v4506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:56.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:56 gibba013 bash[30381]: cluster 2021-03-10T16:22:54.978059+0000 mgr.gibba020.yqfnwy (mgr.34427) 7916 : cluster [DBG] pgmap v4506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:56.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:56 gibba020 bash[25448]: cluster 2021-03-10T16:22:54.978059+0000 mgr.gibba020.yqfnwy (mgr.34427) 7916 : cluster [DBG] pgmap v4506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:58.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:22:58 gibba013 bash[29418]: cluster 2021-03-10T16:22:56.979376+0000 mgr.gibba020.yqfnwy (mgr.34427) 7917 : cluster [DBG] pgmap v4507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:58.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:22:58 gibba013 bash[30381]: cluster 2021-03-10T16:22:56.979376+0000 mgr.gibba020.yqfnwy (mgr.34427) 7917 : cluster [DBG] pgmap v4507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:22:58.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:22:58 gibba020 bash[25448]: cluster 2021-03-10T16:22:56.979376+0000 mgr.gibba020.yqfnwy (mgr.34427) 7917 : cluster [DBG] pgmap v4507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:00.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:00 gibba013 bash[29418]: cluster 2021-03-10T16:22:58.981073+0000 mgr.gibba020.yqfnwy (mgr.34427) 7918 : cluster [DBG] pgmap v4508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:00.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:00 gibba013 bash[30381]: cluster 2021-03-10T16:22:58.981073+0000 mgr.gibba020.yqfnwy (mgr.34427) 7918 : cluster [DBG] pgmap v4508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:00.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:00 gibba020 bash[25448]: cluster 2021-03-10T16:22:58.981073+0000 mgr.gibba020.yqfnwy (mgr.34427) 7918 : cluster [DBG] pgmap v4508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:02.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:02 gibba013 bash[29418]: cluster 2021-03-10T16:23:00.982651+0000 mgr.gibba020.yqfnwy (mgr.34427) 7919 : cluster [DBG] pgmap v4509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:02.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:02 gibba013 bash[30381]: cluster 2021-03-10T16:23:00.982651+0000 mgr.gibba020.yqfnwy (mgr.34427) 7919 : cluster [DBG] pgmap v4509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:02.671 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:02 gibba020 bash[25448]: cluster 2021-03-10T16:23:00.982651+0000 mgr.gibba020.yqfnwy (mgr.34427) 7919 : cluster [DBG] pgmap v4509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:04.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:04 gibba013 bash[29418]: cephadm 2021-03-10T16:23:02.670893+0000 mgr.gibba020.yqfnwy (mgr.34427) 7920 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:23:04.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:04 gibba013 bash[29418]: cluster 2021-03-10T16:23:02.983900+0000 mgr.gibba020.yqfnwy (mgr.34427) 7921 : cluster [DBG] pgmap v4510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:04.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:04 gibba013 bash[30381]: cephadm 2021-03-10T16:23:02.670893+0000 mgr.gibba020.yqfnwy (mgr.34427) 7920 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:23:04.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:04 gibba013 bash[30381]: cluster 2021-03-10T16:23:02.983900+0000 mgr.gibba020.yqfnwy (mgr.34427) 7921 : cluster [DBG] pgmap v4510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:04.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:04 gibba020 bash[25448]: cephadm 2021-03-10T16:23:02.670893+0000 mgr.gibba020.yqfnwy (mgr.34427) 7920 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:23:04.738 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:04 gibba020 bash[25448]: cluster 2021-03-10T16:23:02.983900+0000 mgr.gibba020.yqfnwy (mgr.34427) 7921 : cluster [DBG] pgmap v4510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:06.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:06 gibba013 bash[29418]: cluster 2021-03-10T16:23:04.985362+0000 mgr.gibba020.yqfnwy (mgr.34427) 7922 : cluster [DBG] pgmap v4511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:06.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:06 gibba013 bash[30381]: cluster 2021-03-10T16:23:04.985362+0000 mgr.gibba020.yqfnwy (mgr.34427) 7922 : cluster [DBG] pgmap v4511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:06.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:06 gibba020 bash[25448]: cluster 2021-03-10T16:23:04.985362+0000 mgr.gibba020.yqfnwy (mgr.34427) 7922 : cluster [DBG] pgmap v4511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:07 gibba013 bash[29418]: audit 2021-03-10T16:23:06.685962+0000 mon.a (mon.0) 2949 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:23:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:07 gibba013 bash[29418]: audit 2021-03-10T16:23:06.819660+0000 mon.a (mon.0) 2950 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:23:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:07 gibba013 bash[29418]: audit 2021-03-10T16:23:07.074211+0000 mon.a (mon.0) 2951 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:23:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:07 gibba013 bash[29418]: audit 2021-03-10T16:23:07.074973+0000 mon.a (mon.0) 2952 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:23:07.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:07 gibba013 bash[29418]: audit 2021-03-10T16:23:07.075688+0000 mon.a (mon.0) 2953 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:23:07.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:07 gibba013 bash[29418]: audit 2021-03-10T16:23:07.076381+0000 mon.a (mon.0) 2954 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:23:07.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:07 gibba013 bash[30381]: audit 2021-03-10T16:23:06.685962+0000 mon.a (mon.0) 2949 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:23:07.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:07 gibba013 bash[30381]: audit 2021-03-10T16:23:06.819660+0000 mon.a (mon.0) 2950 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:23:07.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:07 gibba013 bash[30381]: audit 2021-03-10T16:23:07.074211+0000 mon.a (mon.0) 2951 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:23:07.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:07 gibba013 bash[30381]: audit 2021-03-10T16:23:07.074973+0000 mon.a (mon.0) 2952 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:23:07.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:07 gibba013 bash[30381]: audit 2021-03-10T16:23:07.075688+0000 mon.a (mon.0) 2953 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:23:07.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:07 gibba013 bash[30381]: audit 2021-03-10T16:23:07.076381+0000 mon.a (mon.0) 2954 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:23:07.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:07 gibba020 bash[25448]: audit 2021-03-10T16:23:06.685962+0000 mon.a (mon.0) 2949 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:23:07.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:07 gibba020 bash[25448]: audit 2021-03-10T16:23:06.819660+0000 mon.a (mon.0) 2950 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:23:07.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:07 gibba020 bash[25448]: audit 2021-03-10T16:23:07.074211+0000 mon.a (mon.0) 2951 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:23:07.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:07 gibba020 bash[25448]: audit 2021-03-10T16:23:07.074973+0000 mon.a (mon.0) 2952 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:23:07.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:07 gibba020 bash[25448]: audit 2021-03-10T16:23:07.075688+0000 mon.a (mon.0) 2953 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:23:07.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:07 gibba020 bash[25448]: audit 2021-03-10T16:23:07.076381+0000 mon.a (mon.0) 2954 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:23:08.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:08 gibba013 bash[29418]: cluster 2021-03-10T16:23:06.986936+0000 mgr.gibba020.yqfnwy (mgr.34427) 7923 : cluster [DBG] pgmap v4512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:08.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:08 gibba013 bash[30381]: cluster 2021-03-10T16:23:06.986936+0000 mgr.gibba020.yqfnwy (mgr.34427) 7923 : cluster [DBG] pgmap v4512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:08.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:08 gibba020 bash[25448]: cluster 2021-03-10T16:23:06.986936+0000 mgr.gibba020.yqfnwy (mgr.34427) 7923 : cluster [DBG] pgmap v4512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:10.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:10 gibba013 bash[29418]: cluster 2021-03-10T16:23:08.988376+0000 mgr.gibba020.yqfnwy (mgr.34427) 7924 : cluster [DBG] pgmap v4513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:10.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:10 gibba013 bash[30381]: cluster 2021-03-10T16:23:08.988376+0000 mgr.gibba020.yqfnwy (mgr.34427) 7924 : cluster [DBG] pgmap v4513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:10.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:10 gibba020 bash[25448]: cluster 2021-03-10T16:23:08.988376+0000 mgr.gibba020.yqfnwy (mgr.34427) 7924 : cluster [DBG] pgmap v4513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:12.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:12 gibba013 bash[29418]: cluster 2021-03-10T16:23:10.989936+0000 mgr.gibba020.yqfnwy (mgr.34427) 7925 : cluster [DBG] pgmap v4514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:12.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:12 gibba013 bash[30381]: cluster 2021-03-10T16:23:10.989936+0000 mgr.gibba020.yqfnwy (mgr.34427) 7925 : cluster [DBG] pgmap v4514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:12.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:12 gibba020 bash[25448]: cluster 2021-03-10T16:23:10.989936+0000 mgr.gibba020.yqfnwy (mgr.34427) 7925 : cluster [DBG] pgmap v4514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:14.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:14 gibba013 bash[29418]: cluster 2021-03-10T16:23:12.991315+0000 mgr.gibba020.yqfnwy (mgr.34427) 7926 : cluster [DBG] pgmap v4515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:14.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:14 gibba013 bash[30381]: cluster 2021-03-10T16:23:12.991315+0000 mgr.gibba020.yqfnwy (mgr.34427) 7926 : cluster [DBG] pgmap v4515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:14.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:14 gibba020 bash[25448]: cluster 2021-03-10T16:23:12.991315+0000 mgr.gibba020.yqfnwy (mgr.34427) 7926 : cluster [DBG] pgmap v4515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:16.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:16 gibba013 bash[29418]: cluster 2021-03-10T16:23:14.993102+0000 mgr.gibba020.yqfnwy (mgr.34427) 7927 : cluster [DBG] pgmap v4516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:16.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:16 gibba013 bash[30381]: cluster 2021-03-10T16:23:14.993102+0000 mgr.gibba020.yqfnwy (mgr.34427) 7927 : cluster [DBG] pgmap v4516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:16.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:16 gibba020 bash[25448]: cluster 2021-03-10T16:23:14.993102+0000 mgr.gibba020.yqfnwy (mgr.34427) 7927 : cluster [DBG] pgmap v4516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:18.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:18 gibba013 bash[29418]: cluster 2021-03-10T16:23:16.994664+0000 mgr.gibba020.yqfnwy (mgr.34427) 7928 : cluster [DBG] pgmap v4517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:18.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:18 gibba013 bash[30381]: cluster 2021-03-10T16:23:16.994664+0000 mgr.gibba020.yqfnwy (mgr.34427) 7928 : cluster [DBG] pgmap v4517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:18.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:18 gibba020 bash[25448]: cluster 2021-03-10T16:23:16.994664+0000 mgr.gibba020.yqfnwy (mgr.34427) 7928 : cluster [DBG] pgmap v4517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:19.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:19 gibba020 bash[25448]: cephadm 2021-03-10T16:23:17.686703+0000 mgr.gibba020.yqfnwy (mgr.34427) 7929 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:23:19.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:19 gibba013 bash[29418]: cephadm 2021-03-10T16:23:17.686703+0000 mgr.gibba020.yqfnwy (mgr.34427) 7929 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:23:19.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:19 gibba013 bash[30381]: cephadm 2021-03-10T16:23:17.686703+0000 mgr.gibba020.yqfnwy (mgr.34427) 7929 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:23:20.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:20 gibba020 bash[25448]: cluster 2021-03-10T16:23:18.996430+0000 mgr.gibba020.yqfnwy (mgr.34427) 7930 : cluster [DBG] pgmap v4518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:20.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:20 gibba013 bash[29418]: cluster 2021-03-10T16:23:18.996430+0000 mgr.gibba020.yqfnwy (mgr.34427) 7930 : cluster [DBG] pgmap v4518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:20.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:20 gibba013 bash[30381]: cluster 2021-03-10T16:23:18.996430+0000 mgr.gibba020.yqfnwy (mgr.34427) 7930 : cluster [DBG] pgmap v4518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:22.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:22 gibba020 bash[25448]: cluster 2021-03-10T16:23:20.998092+0000 mgr.gibba020.yqfnwy (mgr.34427) 7931 : cluster [DBG] pgmap v4519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:22.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:22 gibba013 bash[29418]: cluster 2021-03-10T16:23:20.998092+0000 mgr.gibba020.yqfnwy (mgr.34427) 7931 : cluster [DBG] pgmap v4519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:22.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:22 gibba013 bash[30381]: cluster 2021-03-10T16:23:20.998092+0000 mgr.gibba020.yqfnwy (mgr.34427) 7931 : cluster [DBG] pgmap v4519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:24.324 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:23:24.552 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:23:24.552 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 3m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:23:24.553 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 117s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:23:24.553 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 117s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:23:24.553 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 117s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:23:24.553 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:23:24.554 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:23:24.554 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 117s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:23:24.554 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:23:24.554 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:23:24.554 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 117s ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:23:24.555 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:23:24.555 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:23:24.555 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:23:24.555 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:23:24.556 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 117s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:23:24.556 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 117s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:23:24.556 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 117s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:23:24.556 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 117s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:23:24.556 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 117s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:23:24.557 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 117s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:23:24.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:24 gibba020 bash[25448]: cluster 2021-03-10T16:23:22.999499+0000 mgr.gibba020.yqfnwy (mgr.34427) 7932 : cluster [DBG] pgmap v4520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:24.802 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:23:24.802 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:23:24.803 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:23:24.803 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:23:24.803 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:23:24.803 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:23:24.803 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:23:24.804 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:23:24.804 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:23:24.804 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:23:24.804 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:23:24.805 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:23:24.805 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:23:24.805 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:23:24.805 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:23:24.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:24 gibba013 bash[29418]: cluster 2021-03-10T16:23:22.999499+0000 mgr.gibba020.yqfnwy (mgr.34427) 7932 : cluster [DBG] pgmap v4520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:24.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:24 gibba013 bash[30381]: cluster 2021-03-10T16:23:22.999499+0000 mgr.gibba020.yqfnwy (mgr.34427) 7932 : cluster [DBG] pgmap v4520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:25.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:25 gibba020 bash[25448]: audit 2021-03-10T16:23:24.315153+0000 mgr.gibba020.yqfnwy (mgr.34427) 7933 : audit [DBG] from='client.49380 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:23:25.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:25 gibba020 bash[25448]: audit 2021-03-10T16:23:24.540352+0000 mgr.gibba020.yqfnwy (mgr.34427) 7934 : audit [DBG] from='client.59368 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:23:25.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:25 gibba020 bash[25448]: audit 2021-03-10T16:23:24.803065+0000 mon.a (mon.0) 2955 : audit [DBG] from='client.? 172.21.2.113:0/3270066817' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:25.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:25 gibba013 bash[29418]: audit 2021-03-10T16:23:24.315153+0000 mgr.gibba020.yqfnwy (mgr.34427) 7933 : audit [DBG] from='client.49380 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:23:25.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:25 gibba013 bash[29418]: audit 2021-03-10T16:23:24.540352+0000 mgr.gibba020.yqfnwy (mgr.34427) 7934 : audit [DBG] from='client.59368 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:23:25.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:25 gibba013 bash[29418]: audit 2021-03-10T16:23:24.803065+0000 mon.a (mon.0) 2955 : audit [DBG] from='client.? 172.21.2.113:0/3270066817' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:25.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:25 gibba013 bash[30381]: audit 2021-03-10T16:23:24.315153+0000 mgr.gibba020.yqfnwy (mgr.34427) 7933 : audit [DBG] from='client.49380 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:23:25.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:25 gibba013 bash[30381]: audit 2021-03-10T16:23:24.540352+0000 mgr.gibba020.yqfnwy (mgr.34427) 7934 : audit [DBG] from='client.59368 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:23:25.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:25 gibba013 bash[30381]: audit 2021-03-10T16:23:24.803065+0000 mon.a (mon.0) 2955 : audit [DBG] from='client.? 172.21.2.113:0/3270066817' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:26.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:26 gibba020 bash[25448]: cluster 2021-03-10T16:23:25.001246+0000 mgr.gibba020.yqfnwy (mgr.34427) 7935 : cluster [DBG] pgmap v4521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:26.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:26 gibba013 bash[29418]: cluster 2021-03-10T16:23:25.001246+0000 mgr.gibba020.yqfnwy (mgr.34427) 7935 : cluster [DBG] pgmap v4521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:26.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:26 gibba013 bash[30381]: cluster 2021-03-10T16:23:25.001246+0000 mgr.gibba020.yqfnwy (mgr.34427) 7935 : cluster [DBG] pgmap v4521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:28.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:28 gibba020 bash[25448]: cluster 2021-03-10T16:23:27.002825+0000 mgr.gibba020.yqfnwy (mgr.34427) 7936 : cluster [DBG] pgmap v4522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:28.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:28 gibba013 bash[29418]: cluster 2021-03-10T16:23:27.002825+0000 mgr.gibba020.yqfnwy (mgr.34427) 7936 : cluster [DBG] pgmap v4522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:28.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:28 gibba013 bash[30381]: cluster 2021-03-10T16:23:27.002825+0000 mgr.gibba020.yqfnwy (mgr.34427) 7936 : cluster [DBG] pgmap v4522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:30.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:30 gibba020 bash[25448]: cluster 2021-03-10T16:23:29.004517+0000 mgr.gibba020.yqfnwy (mgr.34427) 7937 : cluster [DBG] pgmap v4523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:30.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:30 gibba013 bash[29418]: cluster 2021-03-10T16:23:29.004517+0000 mgr.gibba020.yqfnwy (mgr.34427) 7937 : cluster [DBG] pgmap v4523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:30.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:30 gibba013 bash[30381]: cluster 2021-03-10T16:23:29.004517+0000 mgr.gibba020.yqfnwy (mgr.34427) 7937 : cluster [DBG] pgmap v4523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:32.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:32 gibba013 bash[29418]: cluster 2021-03-10T16:23:31.006388+0000 mgr.gibba020.yqfnwy (mgr.34427) 7938 : cluster [DBG] pgmap v4524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:32.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:32 gibba013 bash[30381]: cluster 2021-03-10T16:23:31.006388+0000 mgr.gibba020.yqfnwy (mgr.34427) 7938 : cluster [DBG] pgmap v4524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:32.936 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:32 gibba020 bash[25448]: cluster 2021-03-10T16:23:31.006388+0000 mgr.gibba020.yqfnwy (mgr.34427) 7938 : cluster [DBG] pgmap v4524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:33.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:33 gibba013 bash[29418]: audit 2021-03-10T16:23:32.704341+0000 mon.a (mon.0) 2956 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:23:33.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:33 gibba013 bash[29418]: audit 2021-03-10T16:23:32.926732+0000 mon.a (mon.0) 2957 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:23:33.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:33 gibba013 bash[29418]: audit 2021-03-10T16:23:32.929935+0000 mon.a (mon.0) 2958 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:23:33.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:33 gibba013 bash[29418]: audit 2021-03-10T16:23:32.931229+0000 mon.a (mon.0) 2959 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:33.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:33 gibba013 bash[29418]: audit 2021-03-10T16:23:32.932570+0000 mon.a (mon.0) 2960 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:33.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:33 gibba013 bash[29418]: audit 2021-03-10T16:23:32.933532+0000 mon.a (mon.0) 2961 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:33.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:33 gibba013 bash[29418]: audit 2021-03-10T16:23:32.935402+0000 mon.a (mon.0) 2962 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:33.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:33 gibba013 bash[29418]: audit 2021-03-10T16:23:32.936668+0000 mon.a (mon.0) 2963 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:33.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:33 gibba013 bash[30381]: audit 2021-03-10T16:23:32.704341+0000 mon.a (mon.0) 2956 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:23:33.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:33 gibba013 bash[30381]: audit 2021-03-10T16:23:32.926732+0000 mon.a (mon.0) 2957 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:23:33.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:33 gibba013 bash[30381]: audit 2021-03-10T16:23:32.929935+0000 mon.a (mon.0) 2958 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:23:33.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:33 gibba013 bash[30381]: audit 2021-03-10T16:23:32.931229+0000 mon.a (mon.0) 2959 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:33.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:33 gibba013 bash[30381]: audit 2021-03-10T16:23:32.932570+0000 mon.a (mon.0) 2960 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:33.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:33 gibba013 bash[30381]: audit 2021-03-10T16:23:32.933532+0000 mon.a (mon.0) 2961 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:33.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:33 gibba013 bash[30381]: audit 2021-03-10T16:23:32.935402+0000 mon.a (mon.0) 2962 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:33.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:33 gibba013 bash[30381]: audit 2021-03-10T16:23:32.936668+0000 mon.a (mon.0) 2963 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:33.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:33 gibba020 bash[25448]: audit 2021-03-10T16:23:32.704341+0000 mon.a (mon.0) 2956 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:23:33.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:33 gibba020 bash[25448]: audit 2021-03-10T16:23:32.926732+0000 mon.a (mon.0) 2957 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:23:33.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:33 gibba020 bash[25448]: audit 2021-03-10T16:23:32.929935+0000 mon.a (mon.0) 2958 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:23:33.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:33 gibba020 bash[25448]: audit 2021-03-10T16:23:32.931229+0000 mon.a (mon.0) 2959 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:33.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:33 gibba020 bash[25448]: audit 2021-03-10T16:23:32.932570+0000 mon.a (mon.0) 2960 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:33.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:33 gibba020 bash[25448]: audit 2021-03-10T16:23:32.933532+0000 mon.a (mon.0) 2961 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:33.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:33 gibba020 bash[25448]: audit 2021-03-10T16:23:32.935402+0000 mon.a (mon.0) 2962 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:33.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:33 gibba020 bash[25448]: audit 2021-03-10T16:23:32.936668+0000 mon.a (mon.0) 2963 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:34.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:34 gibba013 bash[29418]: cephadm 2021-03-10T16:23:32.709011+0000 mgr.gibba020.yqfnwy (mgr.34427) 7939 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:23:34.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:34 gibba013 bash[29418]: cephadm 2021-03-10T16:23:32.710641+0000 mgr.gibba020.yqfnwy (mgr.34427) 7940 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:23:34.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:34 gibba013 bash[29418]: cephadm 2021-03-10T16:23:32.928637+0000 mgr.gibba020.yqfnwy (mgr.34427) 7941 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:23:34.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:34 gibba013 bash[29418]: cephadm 2021-03-10T16:23:32.930292+0000 mgr.gibba020.yqfnwy (mgr.34427) 7942 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:23:34.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:34 gibba013 bash[29418]: cephadm 2021-03-10T16:23:32.931601+0000 mgr.gibba020.yqfnwy (mgr.34427) 7943 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:23:34.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:34 gibba013 bash[29418]: cephadm 2021-03-10T16:23:32.931640+0000 mgr.gibba020.yqfnwy (mgr.34427) 7944 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:23:34.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:34 gibba013 bash[29418]: cephadm 2021-03-10T16:23:32.932669+0000 mgr.gibba020.yqfnwy (mgr.34427) 7945 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:23:34.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:34 gibba013 bash[29418]: cephadm 2021-03-10T16:23:32.932707+0000 mgr.gibba020.yqfnwy (mgr.34427) 7946 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:23:34.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:34 gibba013 bash[29418]: cephadm 2021-03-10T16:23:32.933597+0000 mgr.gibba020.yqfnwy (mgr.34427) 7947 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:23:34.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:34 gibba013 bash[29418]: cephadm 2021-03-10T16:23:32.934406+0000 mgr.gibba020.yqfnwy (mgr.34427) 7948 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:23:34.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:34 gibba013 bash[29418]: cephadm 2021-03-10T16:23:32.934442+0000 mgr.gibba020.yqfnwy (mgr.34427) 7949 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:23:34.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:34 gibba013 bash[29418]: cephadm 2021-03-10T16:23:32.935490+0000 mgr.gibba020.yqfnwy (mgr.34427) 7950 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:23:34.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:34 gibba013 bash[29418]: cephadm 2021-03-10T16:23:32.935813+0000 mgr.gibba020.yqfnwy (mgr.34427) 7951 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:23:34.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:34 gibba013 bash[29418]: cephadm 2021-03-10T16:23:32.936922+0000 mgr.gibba020.yqfnwy (mgr.34427) 7952 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:23:34.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:34 gibba013 bash[29418]: cephadm 2021-03-10T16:23:32.936960+0000 mgr.gibba020.yqfnwy (mgr.34427) 7953 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:23:34.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:34 gibba013 bash[29418]: cephadm 2021-03-10T16:23:32.937063+0000 mgr.gibba020.yqfnwy (mgr.34427) 7954 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:23:34.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:34 gibba013 bash[29418]: cluster 2021-03-10T16:23:33.007443+0000 mgr.gibba020.yqfnwy (mgr.34427) 7955 : cluster [DBG] pgmap v4525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:34.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:34 gibba013 bash[30381]: cephadm 2021-03-10T16:23:32.709011+0000 mgr.gibba020.yqfnwy (mgr.34427) 7939 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:23:34.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:34 gibba013 bash[30381]: cephadm 2021-03-10T16:23:32.710641+0000 mgr.gibba020.yqfnwy (mgr.34427) 7940 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:23:34.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:34 gibba013 bash[30381]: cephadm 2021-03-10T16:23:32.928637+0000 mgr.gibba020.yqfnwy (mgr.34427) 7941 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:23:34.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:34 gibba013 bash[30381]: cephadm 2021-03-10T16:23:32.930292+0000 mgr.gibba020.yqfnwy (mgr.34427) 7942 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:23:34.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:34 gibba013 bash[30381]: cephadm 2021-03-10T16:23:32.931601+0000 mgr.gibba020.yqfnwy (mgr.34427) 7943 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:23:34.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:34 gibba013 bash[30381]: cephadm 2021-03-10T16:23:32.931640+0000 mgr.gibba020.yqfnwy (mgr.34427) 7944 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:23:34.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:34 gibba013 bash[30381]: cephadm 2021-03-10T16:23:32.932669+0000 mgr.gibba020.yqfnwy (mgr.34427) 7945 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:23:34.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:34 gibba013 bash[30381]: cephadm 2021-03-10T16:23:32.932707+0000 mgr.gibba020.yqfnwy (mgr.34427) 7946 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:23:34.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:34 gibba013 bash[30381]: cephadm 2021-03-10T16:23:32.933597+0000 mgr.gibba020.yqfnwy (mgr.34427) 7947 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:23:34.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:34 gibba013 bash[30381]: cephadm 2021-03-10T16:23:32.934406+0000 mgr.gibba020.yqfnwy (mgr.34427) 7948 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:23:34.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:34 gibba013 bash[30381]: cephadm 2021-03-10T16:23:32.934442+0000 mgr.gibba020.yqfnwy (mgr.34427) 7949 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:23:34.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:34 gibba013 bash[30381]: cephadm 2021-03-10T16:23:32.935490+0000 mgr.gibba020.yqfnwy (mgr.34427) 7950 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:23:34.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:34 gibba013 bash[30381]: cephadm 2021-03-10T16:23:32.935813+0000 mgr.gibba020.yqfnwy (mgr.34427) 7951 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:23:34.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:34 gibba013 bash[30381]: cephadm 2021-03-10T16:23:32.936922+0000 mgr.gibba020.yqfnwy (mgr.34427) 7952 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:23:34.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:34 gibba013 bash[30381]: cephadm 2021-03-10T16:23:32.936960+0000 mgr.gibba020.yqfnwy (mgr.34427) 7953 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:23:34.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:34 gibba013 bash[30381]: cephadm 2021-03-10T16:23:32.937063+0000 mgr.gibba020.yqfnwy (mgr.34427) 7954 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:23:34.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:34 gibba013 bash[30381]: cluster 2021-03-10T16:23:33.007443+0000 mgr.gibba020.yqfnwy (mgr.34427) 7955 : cluster [DBG] pgmap v4525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:34.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:34 gibba020 bash[25448]: cephadm 2021-03-10T16:23:32.709011+0000 mgr.gibba020.yqfnwy (mgr.34427) 7939 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:23:34.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:34 gibba020 bash[25448]: cephadm 2021-03-10T16:23:32.710641+0000 mgr.gibba020.yqfnwy (mgr.34427) 7940 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:23:34.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:34 gibba020 bash[25448]: cephadm 2021-03-10T16:23:32.928637+0000 mgr.gibba020.yqfnwy (mgr.34427) 7941 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:23:34.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:34 gibba020 bash[25448]: cephadm 2021-03-10T16:23:32.930292+0000 mgr.gibba020.yqfnwy (mgr.34427) 7942 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:23:34.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:34 gibba020 bash[25448]: cephadm 2021-03-10T16:23:32.931601+0000 mgr.gibba020.yqfnwy (mgr.34427) 7943 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:23:34.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:34 gibba020 bash[25448]: cephadm 2021-03-10T16:23:32.931640+0000 mgr.gibba020.yqfnwy (mgr.34427) 7944 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:23:34.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:34 gibba020 bash[25448]: cephadm 2021-03-10T16:23:32.932669+0000 mgr.gibba020.yqfnwy (mgr.34427) 7945 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:23:34.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:34 gibba020 bash[25448]: cephadm 2021-03-10T16:23:32.932707+0000 mgr.gibba020.yqfnwy (mgr.34427) 7946 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:23:34.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:34 gibba020 bash[25448]: cephadm 2021-03-10T16:23:32.933597+0000 mgr.gibba020.yqfnwy (mgr.34427) 7947 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:23:34.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:34 gibba020 bash[25448]: cephadm 2021-03-10T16:23:32.934406+0000 mgr.gibba020.yqfnwy (mgr.34427) 7948 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:23:34.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:34 gibba020 bash[25448]: cephadm 2021-03-10T16:23:32.934442+0000 mgr.gibba020.yqfnwy (mgr.34427) 7949 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:23:34.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:34 gibba020 bash[25448]: cephadm 2021-03-10T16:23:32.935490+0000 mgr.gibba020.yqfnwy (mgr.34427) 7950 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:23:34.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:34 gibba020 bash[25448]: cephadm 2021-03-10T16:23:32.935813+0000 mgr.gibba020.yqfnwy (mgr.34427) 7951 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:23:34.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:34 gibba020 bash[25448]: cephadm 2021-03-10T16:23:32.936922+0000 mgr.gibba020.yqfnwy (mgr.34427) 7952 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:23:34.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:34 gibba020 bash[25448]: cephadm 2021-03-10T16:23:32.936960+0000 mgr.gibba020.yqfnwy (mgr.34427) 7953 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:23:34.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:34 gibba020 bash[25448]: cephadm 2021-03-10T16:23:32.937063+0000 mgr.gibba020.yqfnwy (mgr.34427) 7954 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:23:34.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:34 gibba020 bash[25448]: cluster 2021-03-10T16:23:33.007443+0000 mgr.gibba020.yqfnwy (mgr.34427) 7955 : cluster [DBG] pgmap v4525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:36.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:36 gibba013 bash[29418]: cluster 2021-03-10T16:23:35.009283+0000 mgr.gibba020.yqfnwy (mgr.34427) 7956 : cluster [DBG] pgmap v4526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:36.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:36 gibba013 bash[30381]: cluster 2021-03-10T16:23:35.009283+0000 mgr.gibba020.yqfnwy (mgr.34427) 7956 : cluster [DBG] pgmap v4526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:36.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:36 gibba020 bash[25448]: cluster 2021-03-10T16:23:35.009283+0000 mgr.gibba020.yqfnwy (mgr.34427) 7956 : cluster [DBG] pgmap v4526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:38.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:38 gibba013 bash[29418]: cluster 2021-03-10T16:23:37.010700+0000 mgr.gibba020.yqfnwy (mgr.34427) 7957 : cluster [DBG] pgmap v4527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:38.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:38 gibba013 bash[30381]: cluster 2021-03-10T16:23:37.010700+0000 mgr.gibba020.yqfnwy (mgr.34427) 7957 : cluster [DBG] pgmap v4527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:38.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:38 gibba020 bash[25448]: cluster 2021-03-10T16:23:37.010700+0000 mgr.gibba020.yqfnwy (mgr.34427) 7957 : cluster [DBG] pgmap v4527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:40.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:40 gibba013 bash[29418]: cluster 2021-03-10T16:23:39.012422+0000 mgr.gibba020.yqfnwy (mgr.34427) 7958 : cluster [DBG] pgmap v4528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:40.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:40 gibba013 bash[30381]: cluster 2021-03-10T16:23:39.012422+0000 mgr.gibba020.yqfnwy (mgr.34427) 7958 : cluster [DBG] pgmap v4528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:40.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:40 gibba020 bash[25448]: cluster 2021-03-10T16:23:39.012422+0000 mgr.gibba020.yqfnwy (mgr.34427) 7958 : cluster [DBG] pgmap v4528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:42.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:42 gibba013 bash[29418]: cluster 2021-03-10T16:23:41.014188+0000 mgr.gibba020.yqfnwy (mgr.34427) 7959 : cluster [DBG] pgmap v4529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:42.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:42 gibba013 bash[30381]: cluster 2021-03-10T16:23:41.014188+0000 mgr.gibba020.yqfnwy (mgr.34427) 7959 : cluster [DBG] pgmap v4529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:42.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:42 gibba020 bash[25448]: cluster 2021-03-10T16:23:41.014188+0000 mgr.gibba020.yqfnwy (mgr.34427) 7959 : cluster [DBG] pgmap v4529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:44.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:44 gibba013 bash[29418]: cluster 2021-03-10T16:23:43.015609+0000 mgr.gibba020.yqfnwy (mgr.34427) 7960 : cluster [DBG] pgmap v4530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:44.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:44 gibba013 bash[30381]: cluster 2021-03-10T16:23:43.015609+0000 mgr.gibba020.yqfnwy (mgr.34427) 7960 : cluster [DBG] pgmap v4530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:44.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:44 gibba020 bash[25448]: cluster 2021-03-10T16:23:43.015609+0000 mgr.gibba020.yqfnwy (mgr.34427) 7960 : cluster [DBG] pgmap v4530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:46.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:46 gibba013 bash[29418]: cluster 2021-03-10T16:23:45.017419+0000 mgr.gibba020.yqfnwy (mgr.34427) 7961 : cluster [DBG] pgmap v4531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:46.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:46 gibba013 bash[30381]: cluster 2021-03-10T16:23:45.017419+0000 mgr.gibba020.yqfnwy (mgr.34427) 7961 : cluster [DBG] pgmap v4531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:46.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:46 gibba020 bash[25448]: cluster 2021-03-10T16:23:45.017419+0000 mgr.gibba020.yqfnwy (mgr.34427) 7961 : cluster [DBG] pgmap v4531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:48.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:48 gibba013 bash[29418]: cluster 2021-03-10T16:23:47.018762+0000 mgr.gibba020.yqfnwy (mgr.34427) 7962 : cluster [DBG] pgmap v4532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:48.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:48 gibba013 bash[30381]: cluster 2021-03-10T16:23:47.018762+0000 mgr.gibba020.yqfnwy (mgr.34427) 7962 : cluster [DBG] pgmap v4532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:48.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:48 gibba020 bash[25448]: cluster 2021-03-10T16:23:47.018762+0000 mgr.gibba020.yqfnwy (mgr.34427) 7962 : cluster [DBG] pgmap v4532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:49.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:49 gibba013 bash[29418]: cephadm 2021-03-10T16:23:47.953057+0000 mgr.gibba020.yqfnwy (mgr.34427) 7963 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:23:49.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:49 gibba013 bash[30381]: cephadm 2021-03-10T16:23:47.953057+0000 mgr.gibba020.yqfnwy (mgr.34427) 7963 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:23:49.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:49 gibba020 bash[25448]: cephadm 2021-03-10T16:23:47.953057+0000 mgr.gibba020.yqfnwy (mgr.34427) 7963 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:23:50.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:50 gibba013 bash[29418]: cluster 2021-03-10T16:23:49.020503+0000 mgr.gibba020.yqfnwy (mgr.34427) 7964 : cluster [DBG] pgmap v4533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:50.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:50 gibba013 bash[30381]: cluster 2021-03-10T16:23:49.020503+0000 mgr.gibba020.yqfnwy (mgr.34427) 7964 : cluster [DBG] pgmap v4533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:50.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:50 gibba020 bash[25448]: cluster 2021-03-10T16:23:49.020503+0000 mgr.gibba020.yqfnwy (mgr.34427) 7964 : cluster [DBG] pgmap v4533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:52.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:52 gibba013 bash[29418]: cluster 2021-03-10T16:23:51.022036+0000 mgr.gibba020.yqfnwy (mgr.34427) 7965 : cluster [DBG] pgmap v4534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:52.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:52 gibba013 bash[30381]: cluster 2021-03-10T16:23:51.022036+0000 mgr.gibba020.yqfnwy (mgr.34427) 7965 : cluster [DBG] pgmap v4534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:52.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:52 gibba020 bash[25448]: cluster 2021-03-10T16:23:51.022036+0000 mgr.gibba020.yqfnwy (mgr.34427) 7965 : cluster [DBG] pgmap v4534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:54.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:54 gibba013 bash[29418]: cluster 2021-03-10T16:23:53.023280+0000 mgr.gibba020.yqfnwy (mgr.34427) 7966 : cluster [DBG] pgmap v4535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:54.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:54 gibba013 bash[30381]: cluster 2021-03-10T16:23:53.023280+0000 mgr.gibba020.yqfnwy (mgr.34427) 7966 : cluster [DBG] pgmap v4535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:54.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:54 gibba020 bash[25448]: cluster 2021-03-10T16:23:53.023280+0000 mgr.gibba020.yqfnwy (mgr.34427) 7966 : cluster [DBG] pgmap v4535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:55.047 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:23:55.273 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:23:55.273 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 3m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:23:55.273 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 2m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:23:55.273 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:23:55.274 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:23:55.274 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:23:55.274 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:23:55.274 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:23:55.275 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:23:55.275 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:23:55.275 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:23:55.275 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:23:55.276 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:23:55.276 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:23:55.276 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:23:55.276 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:23:55.277 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:23:55.277 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:23:55.277 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:23:55.277 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 2m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:23:55.277 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:23:55.522 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:23:55.523 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:23:55.523 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:23:55.523 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:23:55.523 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:23:55.524 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:23:55.524 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:23:55.524 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:23:55.524 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:23:55.525 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:23:55.525 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:23:55.525 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:23:55.525 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:23:55.525 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:23:55.526 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:23:55.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:55 gibba013 bash[29418]: audit 2021-03-10T16:23:55.523437+0000 mon.c (mon.1) 127 : audit [DBG] from='client.? 172.21.2.113:0/2919723160' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:55.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:55 gibba013 bash[30381]: audit 2021-03-10T16:23:55.523437+0000 mon.c (mon.1) 127 : audit [DBG] from='client.? 172.21.2.113:0/2919723160' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:55.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:55 gibba020 bash[25448]: audit 2021-03-10T16:23:55.523437+0000 mon.c (mon.1) 127 : audit [DBG] from='client.? 172.21.2.113:0/2919723160' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:23:56.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:56 gibba013 bash[29418]: cluster 2021-03-10T16:23:55.025211+0000 mgr.gibba020.yqfnwy (mgr.34427) 7967 : cluster [DBG] pgmap v4536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:56.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:56 gibba013 bash[29418]: audit 2021-03-10T16:23:55.038233+0000 mgr.gibba020.yqfnwy (mgr.34427) 7968 : audit [DBG] from='client.49398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:23:56.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:56 gibba013 bash[29418]: audit 2021-03-10T16:23:55.260386+0000 mgr.gibba020.yqfnwy (mgr.34427) 7969 : audit [DBG] from='client.59386 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:23:56.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:56 gibba013 bash[30381]: cluster 2021-03-10T16:23:55.025211+0000 mgr.gibba020.yqfnwy (mgr.34427) 7967 : cluster [DBG] pgmap v4536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:56.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:56 gibba013 bash[30381]: audit 2021-03-10T16:23:55.038233+0000 mgr.gibba020.yqfnwy (mgr.34427) 7968 : audit [DBG] from='client.49398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:23:56.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:56 gibba013 bash[30381]: audit 2021-03-10T16:23:55.260386+0000 mgr.gibba020.yqfnwy (mgr.34427) 7969 : audit [DBG] from='client.59386 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:23:56.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:56 gibba020 bash[25448]: cluster 2021-03-10T16:23:55.025211+0000 mgr.gibba020.yqfnwy (mgr.34427) 7967 : cluster [DBG] pgmap v4536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:56.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:56 gibba020 bash[25448]: audit 2021-03-10T16:23:55.038233+0000 mgr.gibba020.yqfnwy (mgr.34427) 7968 : audit [DBG] from='client.49398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:23:56.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:56 gibba020 bash[25448]: audit 2021-03-10T16:23:55.260386+0000 mgr.gibba020.yqfnwy (mgr.34427) 7969 : audit [DBG] from='client.59386 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:23:57.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:23:57 gibba013 bash[29418]: cluster 2021-03-10T16:23:57.026629+0000 mgr.gibba020.yqfnwy (mgr.34427) 7970 : cluster [DBG] pgmap v4537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:57.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:23:57 gibba013 bash[30381]: cluster 2021-03-10T16:23:57.026629+0000 mgr.gibba020.yqfnwy (mgr.34427) 7970 : cluster [DBG] pgmap v4537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:23:57.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:23:57 gibba020 bash[25448]: cluster 2021-03-10T16:23:57.026629+0000 mgr.gibba020.yqfnwy (mgr.34427) 7970 : cluster [DBG] pgmap v4537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:00.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:00 gibba020 bash[25448]: cluster 2021-03-10T16:23:59.028304+0000 mgr.gibba020.yqfnwy (mgr.34427) 7971 : cluster [DBG] pgmap v4538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:00.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:00 gibba013 bash[29418]: cluster 2021-03-10T16:23:59.028304+0000 mgr.gibba020.yqfnwy (mgr.34427) 7971 : cluster [DBG] pgmap v4538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:00.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:00 gibba013 bash[30381]: cluster 2021-03-10T16:23:59.028304+0000 mgr.gibba020.yqfnwy (mgr.34427) 7971 : cluster [DBG] pgmap v4538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:02.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:02 gibba020 bash[25448]: cluster 2021-03-10T16:24:01.029894+0000 mgr.gibba020.yqfnwy (mgr.34427) 7972 : cluster [DBG] pgmap v4539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:02.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:02 gibba013 bash[29418]: cluster 2021-03-10T16:24:01.029894+0000 mgr.gibba020.yqfnwy (mgr.34427) 7972 : cluster [DBG] pgmap v4539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:02.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:02 gibba013 bash[30381]: cluster 2021-03-10T16:24:01.029894+0000 mgr.gibba020.yqfnwy (mgr.34427) 7972 : cluster [DBG] pgmap v4539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:04.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:04 gibba020 bash[25448]: cephadm 2021-03-10T16:24:02.968873+0000 mgr.gibba020.yqfnwy (mgr.34427) 7973 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:24:04.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:04 gibba020 bash[25448]: cluster 2021-03-10T16:24:03.031303+0000 mgr.gibba020.yqfnwy (mgr.34427) 7974 : cluster [DBG] pgmap v4540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:04.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:04 gibba013 bash[29418]: cephadm 2021-03-10T16:24:02.968873+0000 mgr.gibba020.yqfnwy (mgr.34427) 7973 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:24:04.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:04 gibba013 bash[29418]: cluster 2021-03-10T16:24:03.031303+0000 mgr.gibba020.yqfnwy (mgr.34427) 7974 : cluster [DBG] pgmap v4540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:04.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:04 gibba013 bash[30381]: cephadm 2021-03-10T16:24:02.968873+0000 mgr.gibba020.yqfnwy (mgr.34427) 7973 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:24:04.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:04 gibba013 bash[30381]: cluster 2021-03-10T16:24:03.031303+0000 mgr.gibba020.yqfnwy (mgr.34427) 7974 : cluster [DBG] pgmap v4540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:06.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:06 gibba020 bash[25448]: cluster 2021-03-10T16:24:05.033142+0000 mgr.gibba020.yqfnwy (mgr.34427) 7975 : cluster [DBG] pgmap v4541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:06.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:06 gibba013 bash[29418]: cluster 2021-03-10T16:24:05.033142+0000 mgr.gibba020.yqfnwy (mgr.34427) 7975 : cluster [DBG] pgmap v4541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:06.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:06 gibba013 bash[30381]: cluster 2021-03-10T16:24:05.033142+0000 mgr.gibba020.yqfnwy (mgr.34427) 7975 : cluster [DBG] pgmap v4541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:07.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:07 gibba020 bash[25448]: audit 2021-03-10T16:24:06.689264+0000 mon.a (mon.0) 2964 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:24:07.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:07 gibba020 bash[25448]: audit 2021-03-10T16:24:06.826214+0000 mon.a (mon.0) 2965 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:24:07.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:07 gibba020 bash[25448]: audit 2021-03-10T16:24:07.082584+0000 mon.a (mon.0) 2966 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:24:07.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:07 gibba020 bash[25448]: audit 2021-03-10T16:24:07.083667+0000 mon.a (mon.0) 2967 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:24:07.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:07 gibba020 bash[25448]: audit 2021-03-10T16:24:07.084744+0000 mon.a (mon.0) 2968 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:24:07.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:07 gibba020 bash[25448]: audit 2021-03-10T16:24:07.085690+0000 mon.a (mon.0) 2969 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:24:07.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:07 gibba013 bash[29418]: audit 2021-03-10T16:24:06.689264+0000 mon.a (mon.0) 2964 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:24:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:07 gibba013 bash[29418]: audit 2021-03-10T16:24:06.826214+0000 mon.a (mon.0) 2965 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:24:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:07 gibba013 bash[29418]: audit 2021-03-10T16:24:07.082584+0000 mon.a (mon.0) 2966 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:24:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:07 gibba013 bash[29418]: audit 2021-03-10T16:24:07.083667+0000 mon.a (mon.0) 2967 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:24:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:07 gibba013 bash[29418]: audit 2021-03-10T16:24:07.084744+0000 mon.a (mon.0) 2968 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:24:07.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:07 gibba013 bash[29418]: audit 2021-03-10T16:24:07.085690+0000 mon.a (mon.0) 2969 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:24:07.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:07 gibba013 bash[30381]: audit 2021-03-10T16:24:06.689264+0000 mon.a (mon.0) 2964 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:24:07.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:07 gibba013 bash[30381]: audit 2021-03-10T16:24:06.826214+0000 mon.a (mon.0) 2965 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:24:07.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:07 gibba013 bash[30381]: audit 2021-03-10T16:24:07.082584+0000 mon.a (mon.0) 2966 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:24:07.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:07 gibba013 bash[30381]: audit 2021-03-10T16:24:07.083667+0000 mon.a (mon.0) 2967 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:24:07.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:07 gibba013 bash[30381]: audit 2021-03-10T16:24:07.084744+0000 mon.a (mon.0) 2968 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:24:07.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:07 gibba013 bash[30381]: audit 2021-03-10T16:24:07.085690+0000 mon.a (mon.0) 2969 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:24:08.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:08 gibba020 bash[25448]: cluster 2021-03-10T16:24:07.034505+0000 mgr.gibba020.yqfnwy (mgr.34427) 7976 : cluster [DBG] pgmap v4542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:08.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:08 gibba013 bash[29418]: cluster 2021-03-10T16:24:07.034505+0000 mgr.gibba020.yqfnwy (mgr.34427) 7976 : cluster [DBG] pgmap v4542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:08.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:08 gibba013 bash[30381]: cluster 2021-03-10T16:24:07.034505+0000 mgr.gibba020.yqfnwy (mgr.34427) 7976 : cluster [DBG] pgmap v4542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:10.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:10 gibba020 bash[25448]: cluster 2021-03-10T16:24:09.036082+0000 mgr.gibba020.yqfnwy (mgr.34427) 7977 : cluster [DBG] pgmap v4543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:10.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:10 gibba013 bash[29418]: cluster 2021-03-10T16:24:09.036082+0000 mgr.gibba020.yqfnwy (mgr.34427) 7977 : cluster [DBG] pgmap v4543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:10.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:10 gibba013 bash[30381]: cluster 2021-03-10T16:24:09.036082+0000 mgr.gibba020.yqfnwy (mgr.34427) 7977 : cluster [DBG] pgmap v4543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:12.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:12 gibba020 bash[25448]: cluster 2021-03-10T16:24:11.037705+0000 mgr.gibba020.yqfnwy (mgr.34427) 7978 : cluster [DBG] pgmap v4544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:12.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:12 gibba013 bash[29418]: cluster 2021-03-10T16:24:11.037705+0000 mgr.gibba020.yqfnwy (mgr.34427) 7978 : cluster [DBG] pgmap v4544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:12.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:12 gibba013 bash[30381]: cluster 2021-03-10T16:24:11.037705+0000 mgr.gibba020.yqfnwy (mgr.34427) 7978 : cluster [DBG] pgmap v4544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:14.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:14 gibba013 bash[29418]: cluster 2021-03-10T16:24:13.039054+0000 mgr.gibba020.yqfnwy (mgr.34427) 7979 : cluster [DBG] pgmap v4545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:14.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:14 gibba013 bash[30381]: cluster 2021-03-10T16:24:13.039054+0000 mgr.gibba020.yqfnwy (mgr.34427) 7979 : cluster [DBG] pgmap v4545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:14.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:14 gibba020 bash[25448]: cluster 2021-03-10T16:24:13.039054+0000 mgr.gibba020.yqfnwy (mgr.34427) 7979 : cluster [DBG] pgmap v4545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:16.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:16 gibba013 bash[29418]: cluster 2021-03-10T16:24:15.041055+0000 mgr.gibba020.yqfnwy (mgr.34427) 7980 : cluster [DBG] pgmap v4546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:16.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:16 gibba013 bash[30381]: cluster 2021-03-10T16:24:15.041055+0000 mgr.gibba020.yqfnwy (mgr.34427) 7980 : cluster [DBG] pgmap v4546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:16.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:16 gibba020 bash[25448]: cluster 2021-03-10T16:24:15.041055+0000 mgr.gibba020.yqfnwy (mgr.34427) 7980 : cluster [DBG] pgmap v4546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:18.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:18 gibba020 bash[25448]: cluster 2021-03-10T16:24:17.042287+0000 mgr.gibba020.yqfnwy (mgr.34427) 7981 : cluster [DBG] pgmap v4547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:18.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:18 gibba013 bash[29418]: cluster 2021-03-10T16:24:17.042287+0000 mgr.gibba020.yqfnwy (mgr.34427) 7981 : cluster [DBG] pgmap v4547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:18.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:18 gibba013 bash[30381]: cluster 2021-03-10T16:24:17.042287+0000 mgr.gibba020.yqfnwy (mgr.34427) 7981 : cluster [DBG] pgmap v4547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:19.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:19 gibba013 bash[29418]: cephadm 2021-03-10T16:24:17.972421+0000 mgr.gibba020.yqfnwy (mgr.34427) 7982 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:24:19.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:19 gibba013 bash[30381]: cephadm 2021-03-10T16:24:17.972421+0000 mgr.gibba020.yqfnwy (mgr.34427) 7982 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:24:19.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:19 gibba020 bash[25448]: cephadm 2021-03-10T16:24:17.972421+0000 mgr.gibba020.yqfnwy (mgr.34427) 7982 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:24:20.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:20 gibba013 bash[29418]: cluster 2021-03-10T16:24:19.043661+0000 mgr.gibba020.yqfnwy (mgr.34427) 7983 : cluster [DBG] pgmap v4548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:20.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:20 gibba013 bash[30381]: cluster 2021-03-10T16:24:19.043661+0000 mgr.gibba020.yqfnwy (mgr.34427) 7983 : cluster [DBG] pgmap v4548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:20.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:20 gibba020 bash[25448]: cluster 2021-03-10T16:24:19.043661+0000 mgr.gibba020.yqfnwy (mgr.34427) 7983 : cluster [DBG] pgmap v4548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:22.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:22 gibba013 bash[29418]: cluster 2021-03-10T16:24:21.045548+0000 mgr.gibba020.yqfnwy (mgr.34427) 7984 : cluster [DBG] pgmap v4549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:22.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:22 gibba013 bash[30381]: cluster 2021-03-10T16:24:21.045548+0000 mgr.gibba020.yqfnwy (mgr.34427) 7984 : cluster [DBG] pgmap v4549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:22.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:22 gibba020 bash[25448]: cluster 2021-03-10T16:24:21.045548+0000 mgr.gibba020.yqfnwy (mgr.34427) 7984 : cluster [DBG] pgmap v4549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:24.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:24 gibba013 bash[29418]: cluster 2021-03-10T16:24:23.045986+0000 mgr.gibba020.yqfnwy (mgr.34427) 7985 : cluster [DBG] pgmap v4550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:24.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:24 gibba013 bash[30381]: cluster 2021-03-10T16:24:23.045986+0000 mgr.gibba020.yqfnwy (mgr.34427) 7985 : cluster [DBG] pgmap v4550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:24.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:24 gibba020 bash[25448]: cluster 2021-03-10T16:24:23.045986+0000 mgr.gibba020.yqfnwy (mgr.34427) 7985 : cluster [DBG] pgmap v4550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:25.764 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:24:25.993 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:24:25.993 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 4m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:24:25.993 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 2m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:24:25.993 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:24:25.994 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:24:25.994 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:24:25.994 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:24:25.994 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:24:25.995 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:24:25.995 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:24:25.995 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:24:25.995 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:24:25.996 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:24:25.996 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:24:25.996 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:24:25.996 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:24:25.997 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:24:25.997 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:24:25.997 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:24:25.997 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 2m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:24:25.997 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:24:26.245 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:24:26.246 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:24:26.246 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:24:26.246 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:24:26.246 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:24:26.247 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:24:26.247 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:24:26.247 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:24:26.247 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:24:26.248 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:24:26.248 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:24:26.248 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:24:26.248 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:24:26.249 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:24:26.249 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:24:26.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:26 gibba013 bash[29418]: cluster 2021-03-10T16:24:25.047653+0000 mgr.gibba020.yqfnwy (mgr.34427) 7986 : cluster [DBG] pgmap v4551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:26.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:26 gibba013 bash[29418]: audit 2021-03-10T16:24:26.246646+0000 mon.c (mon.1) 128 : audit [DBG] from='client.? 172.21.2.113:0/3258555182' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:26.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:26 gibba013 bash[30381]: cluster 2021-03-10T16:24:25.047653+0000 mgr.gibba020.yqfnwy (mgr.34427) 7986 : cluster [DBG] pgmap v4551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:26.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:26 gibba013 bash[30381]: audit 2021-03-10T16:24:26.246646+0000 mon.c (mon.1) 128 : audit [DBG] from='client.? 172.21.2.113:0/3258555182' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:26.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:26 gibba020 bash[25448]: cluster 2021-03-10T16:24:25.047653+0000 mgr.gibba020.yqfnwy (mgr.34427) 7986 : cluster [DBG] pgmap v4551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:26.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:26 gibba020 bash[25448]: audit 2021-03-10T16:24:26.246646+0000 mon.c (mon.1) 128 : audit [DBG] from='client.? 172.21.2.113:0/3258555182' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:27.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:27 gibba013 bash[29418]: audit 2021-03-10T16:24:25.755632+0000 mgr.gibba020.yqfnwy (mgr.34427) 7987 : audit [DBG] from='client.59398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:24:27.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:27 gibba013 bash[29418]: audit 2021-03-10T16:24:25.981268+0000 mgr.gibba020.yqfnwy (mgr.34427) 7988 : audit [DBG] from='client.49422 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:24:27.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:27 gibba013 bash[30381]: audit 2021-03-10T16:24:25.755632+0000 mgr.gibba020.yqfnwy (mgr.34427) 7987 : audit [DBG] from='client.59398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:24:27.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:27 gibba013 bash[30381]: audit 2021-03-10T16:24:25.981268+0000 mgr.gibba020.yqfnwy (mgr.34427) 7988 : audit [DBG] from='client.49422 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:24:27.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:27 gibba020 bash[25448]: audit 2021-03-10T16:24:25.755632+0000 mgr.gibba020.yqfnwy (mgr.34427) 7987 : audit [DBG] from='client.59398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:24:27.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:27 gibba020 bash[25448]: audit 2021-03-10T16:24:25.981268+0000 mgr.gibba020.yqfnwy (mgr.34427) 7988 : audit [DBG] from='client.49422 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:24:28.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:28 gibba013 bash[30381]: cluster 2021-03-10T16:24:27.049157+0000 mgr.gibba020.yqfnwy (mgr.34427) 7989 : cluster [DBG] pgmap v4552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:28.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:28 gibba013 bash[29418]: cluster 2021-03-10T16:24:27.049157+0000 mgr.gibba020.yqfnwy (mgr.34427) 7989 : cluster [DBG] pgmap v4552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:28.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:28 gibba020 bash[25448]: cluster 2021-03-10T16:24:27.049157+0000 mgr.gibba020.yqfnwy (mgr.34427) 7989 : cluster [DBG] pgmap v4552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:30.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:30 gibba013 bash[29418]: cluster 2021-03-10T16:24:29.050936+0000 mgr.gibba020.yqfnwy (mgr.34427) 7990 : cluster [DBG] pgmap v4553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:30.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:30 gibba013 bash[30381]: cluster 2021-03-10T16:24:29.050936+0000 mgr.gibba020.yqfnwy (mgr.34427) 7990 : cluster [DBG] pgmap v4553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:30.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:30 gibba020 bash[25448]: cluster 2021-03-10T16:24:29.050936+0000 mgr.gibba020.yqfnwy (mgr.34427) 7990 : cluster [DBG] pgmap v4553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:32.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:32 gibba013 bash[29418]: cluster 2021-03-10T16:24:31.052923+0000 mgr.gibba020.yqfnwy (mgr.34427) 7991 : cluster [DBG] pgmap v4554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:32.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:32 gibba013 bash[30381]: cluster 2021-03-10T16:24:31.052923+0000 mgr.gibba020.yqfnwy (mgr.34427) 7991 : cluster [DBG] pgmap v4554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:32.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:32 gibba020 bash[25448]: cluster 2021-03-10T16:24:31.052923+0000 mgr.gibba020.yqfnwy (mgr.34427) 7991 : cluster [DBG] pgmap v4554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:33.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:33 gibba013 bash[29418]: audit 2021-03-10T16:24:32.986248+0000 mon.a (mon.0) 2970 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:24:33.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:33 gibba013 bash[29418]: audit 2021-03-10T16:24:33.197143+0000 mon.a (mon.0) 2971 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:24:33.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:33 gibba013 bash[29418]: audit 2021-03-10T16:24:33.200331+0000 mon.a (mon.0) 2972 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:24:33.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:33 gibba013 bash[29418]: audit 2021-03-10T16:24:33.202498+0000 mon.a (mon.0) 2973 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:33.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:33 gibba013 bash[29418]: audit 2021-03-10T16:24:33.204550+0000 mon.a (mon.0) 2974 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:33.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:33 gibba013 bash[29418]: audit 2021-03-10T16:24:33.206822+0000 mon.a (mon.0) 2975 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:33.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:33 gibba013 bash[29418]: audit 2021-03-10T16:24:33.210704+0000 mon.a (mon.0) 2976 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:33.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:33 gibba013 bash[29418]: audit 2021-03-10T16:24:33.213244+0000 mon.a (mon.0) 2977 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:33.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:33 gibba013 bash[30381]: audit 2021-03-10T16:24:32.986248+0000 mon.a (mon.0) 2970 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:24:33.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:33 gibba013 bash[30381]: audit 2021-03-10T16:24:33.197143+0000 mon.a (mon.0) 2971 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:24:33.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:33 gibba013 bash[30381]: audit 2021-03-10T16:24:33.200331+0000 mon.a (mon.0) 2972 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:24:33.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:33 gibba013 bash[30381]: audit 2021-03-10T16:24:33.202498+0000 mon.a (mon.0) 2973 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:33.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:33 gibba013 bash[30381]: audit 2021-03-10T16:24:33.204550+0000 mon.a (mon.0) 2974 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:33.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:33 gibba013 bash[30381]: audit 2021-03-10T16:24:33.206822+0000 mon.a (mon.0) 2975 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:33.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:33 gibba013 bash[30381]: audit 2021-03-10T16:24:33.210704+0000 mon.a (mon.0) 2976 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:33.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:33 gibba013 bash[30381]: audit 2021-03-10T16:24:33.213244+0000 mon.a (mon.0) 2977 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:33.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:33 gibba020 bash[25448]: audit 2021-03-10T16:24:32.986248+0000 mon.a (mon.0) 2970 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:24:33.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:33 gibba020 bash[25448]: audit 2021-03-10T16:24:33.197143+0000 mon.a (mon.0) 2971 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:24:33.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:33 gibba020 bash[25448]: audit 2021-03-10T16:24:33.200331+0000 mon.a (mon.0) 2972 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:24:33.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:33 gibba020 bash[25448]: audit 2021-03-10T16:24:33.202498+0000 mon.a (mon.0) 2973 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:33.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:33 gibba020 bash[25448]: audit 2021-03-10T16:24:33.204550+0000 mon.a (mon.0) 2974 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:33.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:33 gibba020 bash[25448]: audit 2021-03-10T16:24:33.206822+0000 mon.a (mon.0) 2975 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:33.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:33 gibba020 bash[25448]: audit 2021-03-10T16:24:33.210704+0000 mon.a (mon.0) 2976 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:33.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:33 gibba020 bash[25448]: audit 2021-03-10T16:24:33.213244+0000 mon.a (mon.0) 2977 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:34.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:34 gibba013 bash[29418]: cephadm 2021-03-10T16:24:32.990434+0000 mgr.gibba020.yqfnwy (mgr.34427) 7992 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:24:34.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:34 gibba013 bash[29418]: cephadm 2021-03-10T16:24:32.992287+0000 mgr.gibba020.yqfnwy (mgr.34427) 7993 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:24:34.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:34 gibba013 bash[29418]: cluster 2021-03-10T16:24:33.053398+0000 mgr.gibba020.yqfnwy (mgr.34427) 7994 : cluster [DBG] pgmap v4555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:34.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:34 gibba013 bash[29418]: cephadm 2021-03-10T16:24:33.198923+0000 mgr.gibba020.yqfnwy (mgr.34427) 7995 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:24:34.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:34 gibba013 bash[29418]: cephadm 2021-03-10T16:24:33.201384+0000 mgr.gibba020.yqfnwy (mgr.34427) 7996 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:24:34.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:34 gibba013 bash[29418]: cephadm 2021-03-10T16:24:33.203452+0000 mgr.gibba020.yqfnwy (mgr.34427) 7997 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:24:34.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:34 gibba013 bash[29418]: cephadm 2021-03-10T16:24:33.203491+0000 mgr.gibba020.yqfnwy (mgr.34427) 7998 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:24:34.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:34 gibba013 bash[29418]: cephadm 2021-03-10T16:24:33.205506+0000 mgr.gibba020.yqfnwy (mgr.34427) 7999 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:24:34.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:34 gibba013 bash[29418]: cephadm 2021-03-10T16:24:33.205546+0000 mgr.gibba020.yqfnwy (mgr.34427) 8000 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:24:34.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:34 gibba013 bash[29418]: cephadm 2021-03-10T16:24:33.207672+0000 mgr.gibba020.yqfnwy (mgr.34427) 8001 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:24:34.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:34 gibba013 bash[29418]: cephadm 2021-03-10T16:24:33.209443+0000 mgr.gibba020.yqfnwy (mgr.34427) 8002 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:24:34.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:34 gibba013 bash[29418]: cephadm 2021-03-10T16:24:33.209481+0000 mgr.gibba020.yqfnwy (mgr.34427) 8003 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:24:34.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:34 gibba013 bash[29418]: cephadm 2021-03-10T16:24:33.211621+0000 mgr.gibba020.yqfnwy (mgr.34427) 8004 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:24:34.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:34 gibba013 bash[29418]: cephadm 2021-03-10T16:24:33.212080+0000 mgr.gibba020.yqfnwy (mgr.34427) 8005 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:24:34.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:34 gibba013 bash[29418]: cephadm 2021-03-10T16:24:33.213978+0000 mgr.gibba020.yqfnwy (mgr.34427) 8006 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:24:34.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:34 gibba013 bash[29418]: cephadm 2021-03-10T16:24:33.214022+0000 mgr.gibba020.yqfnwy (mgr.34427) 8007 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:24:34.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:34 gibba013 bash[29418]: cephadm 2021-03-10T16:24:33.214147+0000 mgr.gibba020.yqfnwy (mgr.34427) 8008 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:24:34.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:34 gibba013 bash[30381]: cephadm 2021-03-10T16:24:32.990434+0000 mgr.gibba020.yqfnwy (mgr.34427) 7992 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:24:34.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:34 gibba013 bash[30381]: cephadm 2021-03-10T16:24:32.992287+0000 mgr.gibba020.yqfnwy (mgr.34427) 7993 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:24:34.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:34 gibba013 bash[30381]: cluster 2021-03-10T16:24:33.053398+0000 mgr.gibba020.yqfnwy (mgr.34427) 7994 : cluster [DBG] pgmap v4555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:34.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:34 gibba013 bash[30381]: cephadm 2021-03-10T16:24:33.198923+0000 mgr.gibba020.yqfnwy (mgr.34427) 7995 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:24:34.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:34 gibba013 bash[30381]: cephadm 2021-03-10T16:24:33.201384+0000 mgr.gibba020.yqfnwy (mgr.34427) 7996 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:24:34.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:34 gibba013 bash[30381]: cephadm 2021-03-10T16:24:33.203452+0000 mgr.gibba020.yqfnwy (mgr.34427) 7997 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:24:34.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:34 gibba013 bash[30381]: cephadm 2021-03-10T16:24:33.203491+0000 mgr.gibba020.yqfnwy (mgr.34427) 7998 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:24:34.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:34 gibba013 bash[30381]: cephadm 2021-03-10T16:24:33.205506+0000 mgr.gibba020.yqfnwy (mgr.34427) 7999 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:24:34.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:34 gibba013 bash[30381]: cephadm 2021-03-10T16:24:33.205546+0000 mgr.gibba020.yqfnwy (mgr.34427) 8000 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:24:34.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:34 gibba013 bash[30381]: cephadm 2021-03-10T16:24:33.207672+0000 mgr.gibba020.yqfnwy (mgr.34427) 8001 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:24:34.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:34 gibba013 bash[30381]: cephadm 2021-03-10T16:24:33.209443+0000 mgr.gibba020.yqfnwy (mgr.34427) 8002 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:24:34.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:34 gibba013 bash[30381]: cephadm 2021-03-10T16:24:33.209481+0000 mgr.gibba020.yqfnwy (mgr.34427) 8003 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:24:34.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:34 gibba013 bash[30381]: cephadm 2021-03-10T16:24:33.211621+0000 mgr.gibba020.yqfnwy (mgr.34427) 8004 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:24:34.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:34 gibba013 bash[30381]: cephadm 2021-03-10T16:24:33.212080+0000 mgr.gibba020.yqfnwy (mgr.34427) 8005 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:24:34.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:34 gibba013 bash[30381]: cephadm 2021-03-10T16:24:33.213978+0000 mgr.gibba020.yqfnwy (mgr.34427) 8006 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:24:34.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:34 gibba013 bash[30381]: cephadm 2021-03-10T16:24:33.214022+0000 mgr.gibba020.yqfnwy (mgr.34427) 8007 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:24:34.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:34 gibba013 bash[30381]: cephadm 2021-03-10T16:24:33.214147+0000 mgr.gibba020.yqfnwy (mgr.34427) 8008 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:24:34.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:34 gibba020 bash[25448]: cephadm 2021-03-10T16:24:32.990434+0000 mgr.gibba020.yqfnwy (mgr.34427) 7992 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:24:34.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:34 gibba020 bash[25448]: cephadm 2021-03-10T16:24:32.992287+0000 mgr.gibba020.yqfnwy (mgr.34427) 7993 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:24:34.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:34 gibba020 bash[25448]: cluster 2021-03-10T16:24:33.053398+0000 mgr.gibba020.yqfnwy (mgr.34427) 7994 : cluster [DBG] pgmap v4555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:34.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:34 gibba020 bash[25448]: cephadm 2021-03-10T16:24:33.198923+0000 mgr.gibba020.yqfnwy (mgr.34427) 7995 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:24:34.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:34 gibba020 bash[25448]: cephadm 2021-03-10T16:24:33.201384+0000 mgr.gibba020.yqfnwy (mgr.34427) 7996 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:24:34.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:34 gibba020 bash[25448]: cephadm 2021-03-10T16:24:33.203452+0000 mgr.gibba020.yqfnwy (mgr.34427) 7997 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:24:34.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:34 gibba020 bash[25448]: cephadm 2021-03-10T16:24:33.203491+0000 mgr.gibba020.yqfnwy (mgr.34427) 7998 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:24:34.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:34 gibba020 bash[25448]: cephadm 2021-03-10T16:24:33.205506+0000 mgr.gibba020.yqfnwy (mgr.34427) 7999 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:24:34.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:34 gibba020 bash[25448]: cephadm 2021-03-10T16:24:33.205546+0000 mgr.gibba020.yqfnwy (mgr.34427) 8000 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:24:34.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:34 gibba020 bash[25448]: cephadm 2021-03-10T16:24:33.207672+0000 mgr.gibba020.yqfnwy (mgr.34427) 8001 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:24:34.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:34 gibba020 bash[25448]: cephadm 2021-03-10T16:24:33.209443+0000 mgr.gibba020.yqfnwy (mgr.34427) 8002 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:24:34.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:34 gibba020 bash[25448]: cephadm 2021-03-10T16:24:33.209481+0000 mgr.gibba020.yqfnwy (mgr.34427) 8003 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:24:34.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:34 gibba020 bash[25448]: cephadm 2021-03-10T16:24:33.211621+0000 mgr.gibba020.yqfnwy (mgr.34427) 8004 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:24:34.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:34 gibba020 bash[25448]: cephadm 2021-03-10T16:24:33.212080+0000 mgr.gibba020.yqfnwy (mgr.34427) 8005 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:24:34.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:34 gibba020 bash[25448]: cephadm 2021-03-10T16:24:33.213978+0000 mgr.gibba020.yqfnwy (mgr.34427) 8006 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:24:34.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:34 gibba020 bash[25448]: cephadm 2021-03-10T16:24:33.214022+0000 mgr.gibba020.yqfnwy (mgr.34427) 8007 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:24:34.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:34 gibba020 bash[25448]: cephadm 2021-03-10T16:24:33.214147+0000 mgr.gibba020.yqfnwy (mgr.34427) 8008 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:24:36.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:36 gibba013 bash[29418]: cluster 2021-03-10T16:24:35.055164+0000 mgr.gibba020.yqfnwy (mgr.34427) 8009 : cluster [DBG] pgmap v4556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:36.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:36 gibba013 bash[30381]: cluster 2021-03-10T16:24:35.055164+0000 mgr.gibba020.yqfnwy (mgr.34427) 8009 : cluster [DBG] pgmap v4556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:36.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:36 gibba020 bash[25448]: cluster 2021-03-10T16:24:35.055164+0000 mgr.gibba020.yqfnwy (mgr.34427) 8009 : cluster [DBG] pgmap v4556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:38.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:38 gibba013 bash[29418]: cluster 2021-03-10T16:24:37.056565+0000 mgr.gibba020.yqfnwy (mgr.34427) 8010 : cluster [DBG] pgmap v4557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:38.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:38 gibba013 bash[30381]: cluster 2021-03-10T16:24:37.056565+0000 mgr.gibba020.yqfnwy (mgr.34427) 8010 : cluster [DBG] pgmap v4557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:38.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:38 gibba020 bash[25448]: cluster 2021-03-10T16:24:37.056565+0000 mgr.gibba020.yqfnwy (mgr.34427) 8010 : cluster [DBG] pgmap v4557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:40.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:40 gibba013 bash[29418]: cluster 2021-03-10T16:24:39.058344+0000 mgr.gibba020.yqfnwy (mgr.34427) 8011 : cluster [DBG] pgmap v4558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:40.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:40 gibba013 bash[30381]: cluster 2021-03-10T16:24:39.058344+0000 mgr.gibba020.yqfnwy (mgr.34427) 8011 : cluster [DBG] pgmap v4558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:40.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:40 gibba020 bash[25448]: cluster 2021-03-10T16:24:39.058344+0000 mgr.gibba020.yqfnwy (mgr.34427) 8011 : cluster [DBG] pgmap v4558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:42.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:42 gibba013 bash[29418]: cluster 2021-03-10T16:24:41.060256+0000 mgr.gibba020.yqfnwy (mgr.34427) 8012 : cluster [DBG] pgmap v4559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:42.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:42 gibba013 bash[30381]: cluster 2021-03-10T16:24:41.060256+0000 mgr.gibba020.yqfnwy (mgr.34427) 8012 : cluster [DBG] pgmap v4559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:42.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:42 gibba020 bash[25448]: cluster 2021-03-10T16:24:41.060256+0000 mgr.gibba020.yqfnwy (mgr.34427) 8012 : cluster [DBG] pgmap v4559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:44.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:44 gibba013 bash[29418]: cluster 2021-03-10T16:24:43.060743+0000 mgr.gibba020.yqfnwy (mgr.34427) 8013 : cluster [DBG] pgmap v4560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:44.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:44 gibba013 bash[30381]: cluster 2021-03-10T16:24:43.060743+0000 mgr.gibba020.yqfnwy (mgr.34427) 8013 : cluster [DBG] pgmap v4560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:44.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:44 gibba020 bash[25448]: cluster 2021-03-10T16:24:43.060743+0000 mgr.gibba020.yqfnwy (mgr.34427) 8013 : cluster [DBG] pgmap v4560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:46.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:46 gibba013 bash[29418]: cluster 2021-03-10T16:24:45.062538+0000 mgr.gibba020.yqfnwy (mgr.34427) 8014 : cluster [DBG] pgmap v4561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:46.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:46 gibba013 bash[30381]: cluster 2021-03-10T16:24:45.062538+0000 mgr.gibba020.yqfnwy (mgr.34427) 8014 : cluster [DBG] pgmap v4561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:46.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:46 gibba020 bash[25448]: cluster 2021-03-10T16:24:45.062538+0000 mgr.gibba020.yqfnwy (mgr.34427) 8014 : cluster [DBG] pgmap v4561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:48.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:48 gibba013 bash[29418]: cluster 2021-03-10T16:24:47.064133+0000 mgr.gibba020.yqfnwy (mgr.34427) 8015 : cluster [DBG] pgmap v4562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:48.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:48 gibba013 bash[30381]: cluster 2021-03-10T16:24:47.064133+0000 mgr.gibba020.yqfnwy (mgr.34427) 8015 : cluster [DBG] pgmap v4562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:48.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:48 gibba020 bash[25448]: cluster 2021-03-10T16:24:47.064133+0000 mgr.gibba020.yqfnwy (mgr.34427) 8015 : cluster [DBG] pgmap v4562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:49.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:49 gibba020 bash[25448]: cephadm 2021-03-10T16:24:48.228862+0000 mgr.gibba020.yqfnwy (mgr.34427) 8016 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:24:49.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:49 gibba013 bash[29418]: cephadm 2021-03-10T16:24:48.228862+0000 mgr.gibba020.yqfnwy (mgr.34427) 8016 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:24:49.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:49 gibba013 bash[30381]: cephadm 2021-03-10T16:24:48.228862+0000 mgr.gibba020.yqfnwy (mgr.34427) 8016 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:24:50.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:50 gibba020 bash[25448]: cluster 2021-03-10T16:24:49.065592+0000 mgr.gibba020.yqfnwy (mgr.34427) 8017 : cluster [DBG] pgmap v4563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:50.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:50 gibba013 bash[29418]: cluster 2021-03-10T16:24:49.065592+0000 mgr.gibba020.yqfnwy (mgr.34427) 8017 : cluster [DBG] pgmap v4563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:50.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:50 gibba013 bash[30381]: cluster 2021-03-10T16:24:49.065592+0000 mgr.gibba020.yqfnwy (mgr.34427) 8017 : cluster [DBG] pgmap v4563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:52.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:52 gibba020 bash[25448]: cluster 2021-03-10T16:24:51.067434+0000 mgr.gibba020.yqfnwy (mgr.34427) 8018 : cluster [DBG] pgmap v4564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:52.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:52 gibba013 bash[29418]: cluster 2021-03-10T16:24:51.067434+0000 mgr.gibba020.yqfnwy (mgr.34427) 8018 : cluster [DBG] pgmap v4564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:52.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:52 gibba013 bash[30381]: cluster 2021-03-10T16:24:51.067434+0000 mgr.gibba020.yqfnwy (mgr.34427) 8018 : cluster [DBG] pgmap v4564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:54.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:54 gibba020 bash[25448]: cluster 2021-03-10T16:24:53.067935+0000 mgr.gibba020.yqfnwy (mgr.34427) 8019 : cluster [DBG] pgmap v4565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:54.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:54 gibba013 bash[29418]: cluster 2021-03-10T16:24:53.067935+0000 mgr.gibba020.yqfnwy (mgr.34427) 8019 : cluster [DBG] pgmap v4565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:54.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:54 gibba013 bash[30381]: cluster 2021-03-10T16:24:53.067935+0000 mgr.gibba020.yqfnwy (mgr.34427) 8019 : cluster [DBG] pgmap v4565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:56.488 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:24:56.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:56 gibba020 bash[25448]: cluster 2021-03-10T16:24:55.069593+0000 mgr.gibba020.yqfnwy (mgr.34427) 8020 : cluster [DBG] pgmap v4566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:56.719 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:24:56.719 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 4m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:24:56.720 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 3m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:24:56.720 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:24:56.720 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:24:56.720 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:24:56.721 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:24:56.721 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:24:56.721 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:24:56.721 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:24:56.721 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:24:56.722 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:24:56.722 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:24:56.722 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:24:56.722 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:24:56.723 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:24:56.723 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:24:56.723 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:24:56.723 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:24:56.724 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 3m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:24:56.724 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 3m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:24:56.877 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:56 gibba013 bash[30381]: cluster 2021-03-10T16:24:55.069593+0000 mgr.gibba020.yqfnwy (mgr.34427) 8020 : cluster [DBG] pgmap v4566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:56.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:56 gibba013 bash[29418]: cluster 2021-03-10T16:24:55.069593+0000 mgr.gibba020.yqfnwy (mgr.34427) 8020 : cluster [DBG] pgmap v4566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:56.972 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:24:56.972 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:24:56.973 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:24:56.973 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:24:56.973 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:24:56.973 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:24:56.974 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:24:56.974 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:24:56.974 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:24:56.975 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:24:56.975 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:24:56.975 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:24:56.975 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:24:56.975 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:24:56.976 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:24:57.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:57 gibba020 bash[25448]: audit 2021-03-10T16:24:56.479953+0000 mgr.gibba020.yqfnwy (mgr.34427) 8021 : audit [DBG] from='client.59416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:24:57.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:57 gibba020 bash[25448]: audit 2021-03-10T16:24:56.973595+0000 mon.a (mon.0) 2978 : audit [DBG] from='client.? 172.21.2.113:0/3416869342' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:57.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:57 gibba013 bash[29418]: audit 2021-03-10T16:24:56.479953+0000 mgr.gibba020.yqfnwy (mgr.34427) 8021 : audit [DBG] from='client.59416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:24:57.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:57 gibba013 bash[29418]: audit 2021-03-10T16:24:56.973595+0000 mon.a (mon.0) 2978 : audit [DBG] from='client.? 172.21.2.113:0/3416869342' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:57.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:57 gibba013 bash[30381]: audit 2021-03-10T16:24:56.479953+0000 mgr.gibba020.yqfnwy (mgr.34427) 8021 : audit [DBG] from='client.59416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:24:57.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:57 gibba013 bash[30381]: audit 2021-03-10T16:24:56.973595+0000 mon.a (mon.0) 2978 : audit [DBG] from='client.? 172.21.2.113:0/3416869342' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:24:58.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:58 gibba020 bash[25448]: audit 2021-03-10T16:24:56.708503+0000 mgr.gibba020.yqfnwy (mgr.34427) 8022 : audit [DBG] from='client.49440 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:24:58.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:24:58 gibba020 bash[25448]: cluster 2021-03-10T16:24:57.071298+0000 mgr.gibba020.yqfnwy (mgr.34427) 8023 : cluster [DBG] pgmap v4567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:58.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:58 gibba013 bash[29418]: audit 2021-03-10T16:24:56.708503+0000 mgr.gibba020.yqfnwy (mgr.34427) 8022 : audit [DBG] from='client.49440 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:24:58.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:24:58 gibba013 bash[29418]: cluster 2021-03-10T16:24:57.071298+0000 mgr.gibba020.yqfnwy (mgr.34427) 8023 : cluster [DBG] pgmap v4567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:24:58.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:58 gibba013 bash[30381]: audit 2021-03-10T16:24:56.708503+0000 mgr.gibba020.yqfnwy (mgr.34427) 8022 : audit [DBG] from='client.49440 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:24:58.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:24:58 gibba013 bash[30381]: cluster 2021-03-10T16:24:57.071298+0000 mgr.gibba020.yqfnwy (mgr.34427) 8023 : cluster [DBG] pgmap v4567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:00.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:00 gibba020 bash[25448]: cluster 2021-03-10T16:24:59.073046+0000 mgr.gibba020.yqfnwy (mgr.34427) 8024 : cluster [DBG] pgmap v4568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:00.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:00 gibba013 bash[29418]: cluster 2021-03-10T16:24:59.073046+0000 mgr.gibba020.yqfnwy (mgr.34427) 8024 : cluster [DBG] pgmap v4568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:00.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:00 gibba013 bash[30381]: cluster 2021-03-10T16:24:59.073046+0000 mgr.gibba020.yqfnwy (mgr.34427) 8024 : cluster [DBG] pgmap v4568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:02.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:02 gibba013 bash[29418]: cluster 2021-03-10T16:25:01.074946+0000 mgr.gibba020.yqfnwy (mgr.34427) 8025 : cluster [DBG] pgmap v4569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:02.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:02 gibba013 bash[30381]: cluster 2021-03-10T16:25:01.074946+0000 mgr.gibba020.yqfnwy (mgr.34427) 8025 : cluster [DBG] pgmap v4569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:02.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:02 gibba020 bash[25448]: cluster 2021-03-10T16:25:01.074946+0000 mgr.gibba020.yqfnwy (mgr.34427) 8025 : cluster [DBG] pgmap v4569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:04.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:04 gibba013 bash[29418]: cluster 2021-03-10T16:25:03.076085+0000 mgr.gibba020.yqfnwy (mgr.34427) 8026 : cluster [DBG] pgmap v4570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:04.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:04 gibba013 bash[29418]: cephadm 2021-03-10T16:25:03.241833+0000 mgr.gibba020.yqfnwy (mgr.34427) 8027 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:25:04.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:04 gibba013 bash[30381]: cluster 2021-03-10T16:25:03.076085+0000 mgr.gibba020.yqfnwy (mgr.34427) 8026 : cluster [DBG] pgmap v4570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:04.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:04 gibba013 bash[30381]: cephadm 2021-03-10T16:25:03.241833+0000 mgr.gibba020.yqfnwy (mgr.34427) 8027 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:25:04.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:04 gibba020 bash[25448]: cluster 2021-03-10T16:25:03.076085+0000 mgr.gibba020.yqfnwy (mgr.34427) 8026 : cluster [DBG] pgmap v4570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:04.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:04 gibba020 bash[25448]: cephadm 2021-03-10T16:25:03.241833+0000 mgr.gibba020.yqfnwy (mgr.34427) 8027 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:25:06.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:06 gibba013 bash[29418]: cluster 2021-03-10T16:25:05.077923+0000 mgr.gibba020.yqfnwy (mgr.34427) 8028 : cluster [DBG] pgmap v4571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:06.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:06 gibba013 bash[30381]: cluster 2021-03-10T16:25:05.077923+0000 mgr.gibba020.yqfnwy (mgr.34427) 8028 : cluster [DBG] pgmap v4571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:06.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:06 gibba020 bash[25448]: cluster 2021-03-10T16:25:05.077923+0000 mgr.gibba020.yqfnwy (mgr.34427) 8028 : cluster [DBG] pgmap v4571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:07.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:07 gibba013 bash[29418]: audit 2021-03-10T16:25:06.693866+0000 mon.a (mon.0) 2979 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:25:07.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:07 gibba013 bash[29418]: audit 2021-03-10T16:25:06.833063+0000 mon.a (mon.0) 2980 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:25:07.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:07 gibba013 bash[29418]: audit 2021-03-10T16:25:07.093394+0000 mon.a (mon.0) 2981 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T16:25:07.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:07 gibba013 bash[29418]: audit 2021-03-10T16:25:07.094200+0000 mon.a (mon.0) 2982 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:25:07.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:07 gibba013 bash[29418]: audit 2021-03-10T16:25:07.094933+0000 mon.a (mon.0) 2983 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:25:07.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:07 gibba013 bash[29418]: audit 2021-03-10T16:25:07.095599+0000 mon.a (mon.0) 2984 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:25:07.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:07 gibba013 bash[30381]: audit 2021-03-10T16:25:06.693866+0000 mon.a (mon.0) 2979 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:25:07.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:07 gibba013 bash[30381]: audit 2021-03-10T16:25:06.833063+0000 mon.a (mon.0) 2980 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:25:07.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:07 gibba013 bash[30381]: audit 2021-03-10T16:25:07.093394+0000 mon.a (mon.0) 2981 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T16:25:07.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:07 gibba013 bash[30381]: audit 2021-03-10T16:25:07.094200+0000 mon.a (mon.0) 2982 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:25:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:07 gibba013 bash[30381]: audit 2021-03-10T16:25:07.094933+0000 mon.a (mon.0) 2983 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:25:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:07 gibba013 bash[30381]: audit 2021-03-10T16:25:07.095599+0000 mon.a (mon.0) 2984 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:25:07.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:07 gibba020 bash[25448]: audit 2021-03-10T16:25:06.693866+0000 mon.a (mon.0) 2979 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:25:07.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:07 gibba020 bash[25448]: audit 2021-03-10T16:25:06.833063+0000 mon.a (mon.0) 2980 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:25:07.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:07 gibba020 bash[25448]: audit 2021-03-10T16:25:07.093394+0000 mon.a (mon.0) 2981 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T16:25:07.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:07 gibba020 bash[25448]: audit 2021-03-10T16:25:07.094200+0000 mon.a (mon.0) 2982 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:25:07.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:07 gibba020 bash[25448]: audit 2021-03-10T16:25:07.094933+0000 mon.a (mon.0) 2983 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:25:07.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:07 gibba020 bash[25448]: audit 2021-03-10T16:25:07.095599+0000 mon.a (mon.0) 2984 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:25:08.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:08 gibba013 bash[29418]: cluster 2021-03-10T16:25:07.079512+0000 mgr.gibba020.yqfnwy (mgr.34427) 8029 : cluster [DBG] pgmap v4572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:08.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:08 gibba013 bash[30381]: cluster 2021-03-10T16:25:07.079512+0000 mgr.gibba020.yqfnwy (mgr.34427) 8029 : cluster [DBG] pgmap v4572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:08.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:08 gibba020 bash[25448]: cluster 2021-03-10T16:25:07.079512+0000 mgr.gibba020.yqfnwy (mgr.34427) 8029 : cluster [DBG] pgmap v4572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:10.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:10 gibba013 bash[29418]: cluster 2021-03-10T16:25:09.080905+0000 mgr.gibba020.yqfnwy (mgr.34427) 8030 : cluster [DBG] pgmap v4573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:10.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:10 gibba013 bash[30381]: cluster 2021-03-10T16:25:09.080905+0000 mgr.gibba020.yqfnwy (mgr.34427) 8030 : cluster [DBG] pgmap v4573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:10.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:10 gibba020 bash[25448]: cluster 2021-03-10T16:25:09.080905+0000 mgr.gibba020.yqfnwy (mgr.34427) 8030 : cluster [DBG] pgmap v4573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:12.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:12 gibba013 bash[29418]: cluster 2021-03-10T16:25:11.082629+0000 mgr.gibba020.yqfnwy (mgr.34427) 8031 : cluster [DBG] pgmap v4574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:12.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:12 gibba013 bash[30381]: cluster 2021-03-10T16:25:11.082629+0000 mgr.gibba020.yqfnwy (mgr.34427) 8031 : cluster [DBG] pgmap v4574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:12.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:12 gibba020 bash[25448]: cluster 2021-03-10T16:25:11.082629+0000 mgr.gibba020.yqfnwy (mgr.34427) 8031 : cluster [DBG] pgmap v4574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:14.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:14 gibba013 bash[29418]: cluster 2021-03-10T16:25:13.083764+0000 mgr.gibba020.yqfnwy (mgr.34427) 8032 : cluster [DBG] pgmap v4575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:14.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:14 gibba013 bash[30381]: cluster 2021-03-10T16:25:13.083764+0000 mgr.gibba020.yqfnwy (mgr.34427) 8032 : cluster [DBG] pgmap v4575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:14.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:14 gibba020 bash[25448]: cluster 2021-03-10T16:25:13.083764+0000 mgr.gibba020.yqfnwy (mgr.34427) 8032 : cluster [DBG] pgmap v4575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:16.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:16 gibba013 bash[29418]: cluster 2021-03-10T16:25:15.085604+0000 mgr.gibba020.yqfnwy (mgr.34427) 8033 : cluster [DBG] pgmap v4576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:16.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:16 gibba013 bash[30381]: cluster 2021-03-10T16:25:15.085604+0000 mgr.gibba020.yqfnwy (mgr.34427) 8033 : cluster [DBG] pgmap v4576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:16.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:16 gibba020 bash[25448]: cluster 2021-03-10T16:25:15.085604+0000 mgr.gibba020.yqfnwy (mgr.34427) 8033 : cluster [DBG] pgmap v4576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:18.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:18 gibba013 bash[29418]: cluster 2021-03-10T16:25:17.087053+0000 mgr.gibba020.yqfnwy (mgr.34427) 8034 : cluster [DBG] pgmap v4577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:18.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:18 gibba013 bash[30381]: cluster 2021-03-10T16:25:17.087053+0000 mgr.gibba020.yqfnwy (mgr.34427) 8034 : cluster [DBG] pgmap v4577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:18.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:18 gibba020 bash[25448]: cluster 2021-03-10T16:25:17.087053+0000 mgr.gibba020.yqfnwy (mgr.34427) 8034 : cluster [DBG] pgmap v4577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:19.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:19 gibba013 bash[29418]: cephadm 2021-03-10T16:25:18.256873+0000 mgr.gibba020.yqfnwy (mgr.34427) 8035 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:25:19.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:19 gibba013 bash[30381]: cephadm 2021-03-10T16:25:18.256873+0000 mgr.gibba020.yqfnwy (mgr.34427) 8035 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:25:19.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:19 gibba020 bash[25448]: cephadm 2021-03-10T16:25:18.256873+0000 mgr.gibba020.yqfnwy (mgr.34427) 8035 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:25:20.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:20 gibba013 bash[29418]: cluster 2021-03-10T16:25:19.088506+0000 mgr.gibba020.yqfnwy (mgr.34427) 8036 : cluster [DBG] pgmap v4578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:20.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:20 gibba013 bash[30381]: cluster 2021-03-10T16:25:19.088506+0000 mgr.gibba020.yqfnwy (mgr.34427) 8036 : cluster [DBG] pgmap v4578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:20.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:20 gibba020 bash[25448]: cluster 2021-03-10T16:25:19.088506+0000 mgr.gibba020.yqfnwy (mgr.34427) 8036 : cluster [DBG] pgmap v4578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:22.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:22 gibba013 bash[29418]: cluster 2021-03-10T16:25:21.090194+0000 mgr.gibba020.yqfnwy (mgr.34427) 8037 : cluster [DBG] pgmap v4579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:22.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:22 gibba013 bash[30381]: cluster 2021-03-10T16:25:21.090194+0000 mgr.gibba020.yqfnwy (mgr.34427) 8037 : cluster [DBG] pgmap v4579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:22.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:22 gibba020 bash[25448]: cluster 2021-03-10T16:25:21.090194+0000 mgr.gibba020.yqfnwy (mgr.34427) 8037 : cluster [DBG] pgmap v4579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:24.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:24 gibba013 bash[29418]: cluster 2021-03-10T16:25:23.090913+0000 mgr.gibba020.yqfnwy (mgr.34427) 8038 : cluster [DBG] pgmap v4580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:24.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:24 gibba013 bash[30381]: cluster 2021-03-10T16:25:23.090913+0000 mgr.gibba020.yqfnwy (mgr.34427) 8038 : cluster [DBG] pgmap v4580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:24.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:24 gibba020 bash[25448]: cluster 2021-03-10T16:25:23.090913+0000 mgr.gibba020.yqfnwy (mgr.34427) 8038 : cluster [DBG] pgmap v4580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:26.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:26 gibba013 bash[29418]: cluster 2021-03-10T16:25:25.092625+0000 mgr.gibba020.yqfnwy (mgr.34427) 8039 : cluster [DBG] pgmap v4581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:26.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:26 gibba013 bash[30381]: cluster 2021-03-10T16:25:25.092625+0000 mgr.gibba020.yqfnwy (mgr.34427) 8039 : cluster [DBG] pgmap v4581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:26.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:26 gibba020 bash[25448]: cluster 2021-03-10T16:25:25.092625+0000 mgr.gibba020.yqfnwy (mgr.34427) 8039 : cluster [DBG] pgmap v4581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:27.220 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:25:27.448 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:25:27.449 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 5m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:25:27.449 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 4m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:25:27.449 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:25:27.449 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:25:27.450 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:25:27.450 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:25:27.450 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:25:27.450 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:25:27.451 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:25:27.451 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:25:27.451 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:25:27.451 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:25:27.452 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:25:27.452 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:25:27.452 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:25:27.452 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:25:27.452 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:25:27.453 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:25:27.453 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 4m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:25:27.453 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 4m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:25:27.703 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:25:27.704 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:25:27.704 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:25:27.704 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:25:27.705 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:25:27.705 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:25:27.705 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:25:27.706 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:25:27.706 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:25:27.706 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:25:27.706 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:25:27.707 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:25:27.707 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:25:27.707 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:25:27.707 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:25:28.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:28 gibba013 bash[29418]: cluster 2021-03-10T16:25:27.094004+0000 mgr.gibba020.yqfnwy (mgr.34427) 8040 : cluster [DBG] pgmap v4582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:28.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:28 gibba013 bash[29418]: audit 2021-03-10T16:25:27.211829+0000 mgr.gibba020.yqfnwy (mgr.34427) 8041 : audit [DBG] from='client.49452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:25:28.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:28 gibba013 bash[29418]: audit 2021-03-10T16:25:27.436351+0000 mgr.gibba020.yqfnwy (mgr.34427) 8042 : audit [DBG] from='client.59440 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:25:28.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:28 gibba013 bash[29418]: audit 2021-03-10T16:25:27.704551+0000 mon.c (mon.1) 129 : audit [DBG] from='client.? 172.21.2.113:0/638894814' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:28.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:28 gibba013 bash[30381]: cluster 2021-03-10T16:25:27.094004+0000 mgr.gibba020.yqfnwy (mgr.34427) 8040 : cluster [DBG] pgmap v4582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:28.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:28 gibba013 bash[30381]: audit 2021-03-10T16:25:27.211829+0000 mgr.gibba020.yqfnwy (mgr.34427) 8041 : audit [DBG] from='client.49452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:25:28.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:28 gibba013 bash[30381]: audit 2021-03-10T16:25:27.436351+0000 mgr.gibba020.yqfnwy (mgr.34427) 8042 : audit [DBG] from='client.59440 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:25:28.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:28 gibba013 bash[30381]: audit 2021-03-10T16:25:27.704551+0000 mon.c (mon.1) 129 : audit [DBG] from='client.? 172.21.2.113:0/638894814' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:28.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:28 gibba020 bash[25448]: cluster 2021-03-10T16:25:27.094004+0000 mgr.gibba020.yqfnwy (mgr.34427) 8040 : cluster [DBG] pgmap v4582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:28.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:28 gibba020 bash[25448]: audit 2021-03-10T16:25:27.211829+0000 mgr.gibba020.yqfnwy (mgr.34427) 8041 : audit [DBG] from='client.49452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:25:28.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:28 gibba020 bash[25448]: audit 2021-03-10T16:25:27.436351+0000 mgr.gibba020.yqfnwy (mgr.34427) 8042 : audit [DBG] from='client.59440 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:25:28.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:28 gibba020 bash[25448]: audit 2021-03-10T16:25:27.704551+0000 mon.c (mon.1) 129 : audit [DBG] from='client.? 172.21.2.113:0/638894814' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:30.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:30 gibba013 bash[29418]: cluster 2021-03-10T16:25:29.095451+0000 mgr.gibba020.yqfnwy (mgr.34427) 8043 : cluster [DBG] pgmap v4583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:30.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:30 gibba013 bash[30381]: cluster 2021-03-10T16:25:29.095451+0000 mgr.gibba020.yqfnwy (mgr.34427) 8043 : cluster [DBG] pgmap v4583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:30.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:30 gibba020 bash[25448]: cluster 2021-03-10T16:25:29.095451+0000 mgr.gibba020.yqfnwy (mgr.34427) 8043 : cluster [DBG] pgmap v4583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:32.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:32 gibba013 bash[29418]: cluster 2021-03-10T16:25:31.097075+0000 mgr.gibba020.yqfnwy (mgr.34427) 8044 : cluster [DBG] pgmap v4584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:32.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:32 gibba013 bash[30381]: cluster 2021-03-10T16:25:31.097075+0000 mgr.gibba020.yqfnwy (mgr.34427) 8044 : cluster [DBG] pgmap v4584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:32.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:32 gibba020 bash[25448]: cluster 2021-03-10T16:25:31.097075+0000 mgr.gibba020.yqfnwy (mgr.34427) 8044 : cluster [DBG] pgmap v4584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:33.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:33 gibba013 bash[29418]: audit 2021-03-10T16:25:33.270390+0000 mon.a (mon.0) 2985 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:25:33.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:33 gibba013 bash[29418]: audit 2021-03-10T16:25:33.478276+0000 mon.a (mon.0) 2986 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:25:33.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:33 gibba013 bash[29418]: audit 2021-03-10T16:25:33.481630+0000 mon.a (mon.0) 2987 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:25:33.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:33 gibba013 bash[29418]: audit 2021-03-10T16:25:33.482981+0000 mon.a (mon.0) 2988 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:33.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:33 gibba013 bash[29418]: audit 2021-03-10T16:25:33.484283+0000 mon.a (mon.0) 2989 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:33.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:33 gibba013 bash[29418]: audit 2021-03-10T16:25:33.486048+0000 mon.a (mon.0) 2990 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:33.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:33 gibba013 bash[29418]: audit 2021-03-10T16:25:33.489226+0000 mon.a (mon.0) 2991 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:33.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:33 gibba013 bash[29418]: audit 2021-03-10T16:25:33.491019+0000 mon.a (mon.0) 2992 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:33.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:33 gibba013 bash[30381]: audit 2021-03-10T16:25:33.270390+0000 mon.a (mon.0) 2985 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:25:33.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:33 gibba013 bash[30381]: audit 2021-03-10T16:25:33.478276+0000 mon.a (mon.0) 2986 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:25:33.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:33 gibba013 bash[30381]: audit 2021-03-10T16:25:33.481630+0000 mon.a (mon.0) 2987 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:25:33.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:33 gibba013 bash[30381]: audit 2021-03-10T16:25:33.482981+0000 mon.a (mon.0) 2988 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:33.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:33 gibba013 bash[30381]: audit 2021-03-10T16:25:33.484283+0000 mon.a (mon.0) 2989 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:33.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:33 gibba013 bash[30381]: audit 2021-03-10T16:25:33.486048+0000 mon.a (mon.0) 2990 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:33.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:33 gibba013 bash[30381]: audit 2021-03-10T16:25:33.489226+0000 mon.a (mon.0) 2991 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:33.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:33 gibba013 bash[30381]: audit 2021-03-10T16:25:33.491019+0000 mon.a (mon.0) 2992 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:33.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:33 gibba020 bash[25448]: audit 2021-03-10T16:25:33.270390+0000 mon.a (mon.0) 2985 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:25:33.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:33 gibba020 bash[25448]: audit 2021-03-10T16:25:33.478276+0000 mon.a (mon.0) 2986 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:25:33.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:33 gibba020 bash[25448]: audit 2021-03-10T16:25:33.481630+0000 mon.a (mon.0) 2987 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:25:33.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:33 gibba020 bash[25448]: audit 2021-03-10T16:25:33.482981+0000 mon.a (mon.0) 2988 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:33.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:33 gibba020 bash[25448]: audit 2021-03-10T16:25:33.484283+0000 mon.a (mon.0) 2989 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:33.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:33 gibba020 bash[25448]: audit 2021-03-10T16:25:33.486048+0000 mon.a (mon.0) 2990 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:33.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:33 gibba020 bash[25448]: audit 2021-03-10T16:25:33.489226+0000 mon.a (mon.0) 2991 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:33.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:33 gibba020 bash[25448]: audit 2021-03-10T16:25:33.491019+0000 mon.a (mon.0) 2992 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:34.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:34 gibba013 bash[29418]: cluster 2021-03-10T16:25:33.097594+0000 mgr.gibba020.yqfnwy (mgr.34427) 8045 : cluster [DBG] pgmap v4585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:34.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:34 gibba013 bash[29418]: cephadm 2021-03-10T16:25:33.274634+0000 mgr.gibba020.yqfnwy (mgr.34427) 8046 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:25:34.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:34 gibba013 bash[29418]: cephadm 2021-03-10T16:25:33.276560+0000 mgr.gibba020.yqfnwy (mgr.34427) 8047 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:25:34.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:34 gibba013 bash[29418]: cephadm 2021-03-10T16:25:33.480212+0000 mgr.gibba020.yqfnwy (mgr.34427) 8048 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:25:34.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:34 gibba013 bash[29418]: cephadm 2021-03-10T16:25:33.481908+0000 mgr.gibba020.yqfnwy (mgr.34427) 8049 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:25:34.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:34 gibba013 bash[29418]: cephadm 2021-03-10T16:25:33.483173+0000 mgr.gibba020.yqfnwy (mgr.34427) 8050 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:25:34.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:34 gibba013 bash[29418]: cephadm 2021-03-10T16:25:33.483210+0000 mgr.gibba020.yqfnwy (mgr.34427) 8051 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:25:34.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:34 gibba013 bash[29418]: cephadm 2021-03-10T16:25:33.484888+0000 mgr.gibba020.yqfnwy (mgr.34427) 8052 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:25:34.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:34 gibba013 bash[29418]: cephadm 2021-03-10T16:25:33.484926+0000 mgr.gibba020.yqfnwy (mgr.34427) 8053 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:25:34.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:34 gibba013 bash[29418]: cephadm 2021-03-10T16:25:33.486696+0000 mgr.gibba020.yqfnwy (mgr.34427) 8054 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:25:34.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:34 gibba013 bash[29418]: cephadm 2021-03-10T16:25:33.488056+0000 mgr.gibba020.yqfnwy (mgr.34427) 8055 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:25:34.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:34 gibba013 bash[29418]: cephadm 2021-03-10T16:25:33.488092+0000 mgr.gibba020.yqfnwy (mgr.34427) 8056 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:25:34.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:34 gibba013 bash[29418]: cephadm 2021-03-10T16:25:33.489893+0000 mgr.gibba020.yqfnwy (mgr.34427) 8057 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:25:34.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:34 gibba013 bash[29418]: cephadm 2021-03-10T16:25:33.490220+0000 mgr.gibba020.yqfnwy (mgr.34427) 8058 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:25:34.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:34 gibba013 bash[29418]: cephadm 2021-03-10T16:25:33.491411+0000 mgr.gibba020.yqfnwy (mgr.34427) 8059 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:25:34.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:34 gibba013 bash[29418]: cephadm 2021-03-10T16:25:33.491447+0000 mgr.gibba020.yqfnwy (mgr.34427) 8060 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:25:34.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:34 gibba013 bash[29418]: cephadm 2021-03-10T16:25:33.491551+0000 mgr.gibba020.yqfnwy (mgr.34427) 8061 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:25:34.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:34 gibba013 bash[30381]: cluster 2021-03-10T16:25:33.097594+0000 mgr.gibba020.yqfnwy (mgr.34427) 8045 : cluster [DBG] pgmap v4585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:34.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:34 gibba013 bash[30381]: cephadm 2021-03-10T16:25:33.274634+0000 mgr.gibba020.yqfnwy (mgr.34427) 8046 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:25:34.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:34 gibba013 bash[30381]: cephadm 2021-03-10T16:25:33.276560+0000 mgr.gibba020.yqfnwy (mgr.34427) 8047 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:25:34.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:34 gibba013 bash[30381]: cephadm 2021-03-10T16:25:33.480212+0000 mgr.gibba020.yqfnwy (mgr.34427) 8048 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:25:34.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:34 gibba013 bash[30381]: cephadm 2021-03-10T16:25:33.481908+0000 mgr.gibba020.yqfnwy (mgr.34427) 8049 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:25:34.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:34 gibba013 bash[30381]: cephadm 2021-03-10T16:25:33.483173+0000 mgr.gibba020.yqfnwy (mgr.34427) 8050 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:25:34.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:34 gibba013 bash[30381]: cephadm 2021-03-10T16:25:33.483210+0000 mgr.gibba020.yqfnwy (mgr.34427) 8051 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:25:34.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:34 gibba013 bash[30381]: cephadm 2021-03-10T16:25:33.484888+0000 mgr.gibba020.yqfnwy (mgr.34427) 8052 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:25:34.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:34 gibba013 bash[30381]: cephadm 2021-03-10T16:25:33.484926+0000 mgr.gibba020.yqfnwy (mgr.34427) 8053 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:25:34.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:34 gibba013 bash[30381]: cephadm 2021-03-10T16:25:33.486696+0000 mgr.gibba020.yqfnwy (mgr.34427) 8054 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:25:34.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:34 gibba013 bash[30381]: cephadm 2021-03-10T16:25:33.488056+0000 mgr.gibba020.yqfnwy (mgr.34427) 8055 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:25:34.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:34 gibba013 bash[30381]: cephadm 2021-03-10T16:25:33.488092+0000 mgr.gibba020.yqfnwy (mgr.34427) 8056 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:25:34.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:34 gibba013 bash[30381]: cephadm 2021-03-10T16:25:33.489893+0000 mgr.gibba020.yqfnwy (mgr.34427) 8057 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:25:34.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:34 gibba013 bash[30381]: cephadm 2021-03-10T16:25:33.490220+0000 mgr.gibba020.yqfnwy (mgr.34427) 8058 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:25:34.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:34 gibba013 bash[30381]: cephadm 2021-03-10T16:25:33.491411+0000 mgr.gibba020.yqfnwy (mgr.34427) 8059 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:25:34.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:34 gibba013 bash[30381]: cephadm 2021-03-10T16:25:33.491447+0000 mgr.gibba020.yqfnwy (mgr.34427) 8060 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:25:34.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:34 gibba013 bash[30381]: cephadm 2021-03-10T16:25:33.491551+0000 mgr.gibba020.yqfnwy (mgr.34427) 8061 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:25:34.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:34 gibba020 bash[25448]: cluster 2021-03-10T16:25:33.097594+0000 mgr.gibba020.yqfnwy (mgr.34427) 8045 : cluster [DBG] pgmap v4585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:34.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:34 gibba020 bash[25448]: cephadm 2021-03-10T16:25:33.274634+0000 mgr.gibba020.yqfnwy (mgr.34427) 8046 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:25:34.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:34 gibba020 bash[25448]: cephadm 2021-03-10T16:25:33.276560+0000 mgr.gibba020.yqfnwy (mgr.34427) 8047 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:25:34.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:34 gibba020 bash[25448]: cephadm 2021-03-10T16:25:33.480212+0000 mgr.gibba020.yqfnwy (mgr.34427) 8048 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:25:34.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:34 gibba020 bash[25448]: cephadm 2021-03-10T16:25:33.481908+0000 mgr.gibba020.yqfnwy (mgr.34427) 8049 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:25:34.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:34 gibba020 bash[25448]: cephadm 2021-03-10T16:25:33.483173+0000 mgr.gibba020.yqfnwy (mgr.34427) 8050 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:25:34.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:34 gibba020 bash[25448]: cephadm 2021-03-10T16:25:33.483210+0000 mgr.gibba020.yqfnwy (mgr.34427) 8051 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:25:34.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:34 gibba020 bash[25448]: cephadm 2021-03-10T16:25:33.484888+0000 mgr.gibba020.yqfnwy (mgr.34427) 8052 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:25:34.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:34 gibba020 bash[25448]: cephadm 2021-03-10T16:25:33.484926+0000 mgr.gibba020.yqfnwy (mgr.34427) 8053 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:25:34.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:34 gibba020 bash[25448]: cephadm 2021-03-10T16:25:33.486696+0000 mgr.gibba020.yqfnwy (mgr.34427) 8054 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:25:34.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:34 gibba020 bash[25448]: cephadm 2021-03-10T16:25:33.488056+0000 mgr.gibba020.yqfnwy (mgr.34427) 8055 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:25:34.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:34 gibba020 bash[25448]: cephadm 2021-03-10T16:25:33.488092+0000 mgr.gibba020.yqfnwy (mgr.34427) 8056 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:25:34.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:34 gibba020 bash[25448]: cephadm 2021-03-10T16:25:33.489893+0000 mgr.gibba020.yqfnwy (mgr.34427) 8057 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:25:34.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:34 gibba020 bash[25448]: cephadm 2021-03-10T16:25:33.490220+0000 mgr.gibba020.yqfnwy (mgr.34427) 8058 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:25:34.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:34 gibba020 bash[25448]: cephadm 2021-03-10T16:25:33.491411+0000 mgr.gibba020.yqfnwy (mgr.34427) 8059 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:25:34.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:34 gibba020 bash[25448]: cephadm 2021-03-10T16:25:33.491447+0000 mgr.gibba020.yqfnwy (mgr.34427) 8060 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:25:34.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:34 gibba020 bash[25448]: cephadm 2021-03-10T16:25:33.491551+0000 mgr.gibba020.yqfnwy (mgr.34427) 8061 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:25:35.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:35 gibba013 bash[29418]: cluster 2021-03-10T16:25:35.099356+0000 mgr.gibba020.yqfnwy (mgr.34427) 8062 : cluster [DBG] pgmap v4586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:35.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:35 gibba013 bash[30381]: cluster 2021-03-10T16:25:35.099356+0000 mgr.gibba020.yqfnwy (mgr.34427) 8062 : cluster [DBG] pgmap v4586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:35.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:35 gibba020 bash[25448]: cluster 2021-03-10T16:25:35.099356+0000 mgr.gibba020.yqfnwy (mgr.34427) 8062 : cluster [DBG] pgmap v4586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:38.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:38 gibba020 bash[25448]: cluster 2021-03-10T16:25:37.100830+0000 mgr.gibba020.yqfnwy (mgr.34427) 8063 : cluster [DBG] pgmap v4587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:38.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:38 gibba013 bash[29418]: cluster 2021-03-10T16:25:37.100830+0000 mgr.gibba020.yqfnwy (mgr.34427) 8063 : cluster [DBG] pgmap v4587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:38.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:38 gibba013 bash[30381]: cluster 2021-03-10T16:25:37.100830+0000 mgr.gibba020.yqfnwy (mgr.34427) 8063 : cluster [DBG] pgmap v4587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:40.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:40 gibba020 bash[25448]: cluster 2021-03-10T16:25:39.102227+0000 mgr.gibba020.yqfnwy (mgr.34427) 8064 : cluster [DBG] pgmap v4588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:40.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:40 gibba013 bash[29418]: cluster 2021-03-10T16:25:39.102227+0000 mgr.gibba020.yqfnwy (mgr.34427) 8064 : cluster [DBG] pgmap v4588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:40.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:40 gibba013 bash[30381]: cluster 2021-03-10T16:25:39.102227+0000 mgr.gibba020.yqfnwy (mgr.34427) 8064 : cluster [DBG] pgmap v4588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:42.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:42 gibba020 bash[25448]: cluster 2021-03-10T16:25:41.104161+0000 mgr.gibba020.yqfnwy (mgr.34427) 8065 : cluster [DBG] pgmap v4589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:42.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:42 gibba013 bash[29418]: cluster 2021-03-10T16:25:41.104161+0000 mgr.gibba020.yqfnwy (mgr.34427) 8065 : cluster [DBG] pgmap v4589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:42.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:42 gibba013 bash[30381]: cluster 2021-03-10T16:25:41.104161+0000 mgr.gibba020.yqfnwy (mgr.34427) 8065 : cluster [DBG] pgmap v4589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:44.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:44 gibba013 bash[29418]: cluster 2021-03-10T16:25:43.105218+0000 mgr.gibba020.yqfnwy (mgr.34427) 8066 : cluster [DBG] pgmap v4590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:44.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:44 gibba013 bash[30381]: cluster 2021-03-10T16:25:43.105218+0000 mgr.gibba020.yqfnwy (mgr.34427) 8066 : cluster [DBG] pgmap v4590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:44.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:44 gibba020 bash[25448]: cluster 2021-03-10T16:25:43.105218+0000 mgr.gibba020.yqfnwy (mgr.34427) 8066 : cluster [DBG] pgmap v4590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:46.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:46 gibba013 bash[29418]: cluster 2021-03-10T16:25:45.106852+0000 mgr.gibba020.yqfnwy (mgr.34427) 8067 : cluster [DBG] pgmap v4591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:46.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:46 gibba013 bash[30381]: cluster 2021-03-10T16:25:45.106852+0000 mgr.gibba020.yqfnwy (mgr.34427) 8067 : cluster [DBG] pgmap v4591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:46.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:46 gibba020 bash[25448]: cluster 2021-03-10T16:25:45.106852+0000 mgr.gibba020.yqfnwy (mgr.34427) 8067 : cluster [DBG] pgmap v4591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:48.507 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:48 gibba020 bash[25448]: cluster 2021-03-10T16:25:47.108397+0000 mgr.gibba020.yqfnwy (mgr.34427) 8068 : cluster [DBG] pgmap v4592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:48.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:48 gibba013 bash[29418]: cluster 2021-03-10T16:25:47.108397+0000 mgr.gibba020.yqfnwy (mgr.34427) 8068 : cluster [DBG] pgmap v4592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:48.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:48 gibba013 bash[30381]: cluster 2021-03-10T16:25:47.108397+0000 mgr.gibba020.yqfnwy (mgr.34427) 8068 : cluster [DBG] pgmap v4592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:49.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:49 gibba013 bash[29418]: cephadm 2021-03-10T16:25:48.507227+0000 mgr.gibba020.yqfnwy (mgr.34427) 8069 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:25:49.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:49 gibba013 bash[30381]: cephadm 2021-03-10T16:25:48.507227+0000 mgr.gibba020.yqfnwy (mgr.34427) 8069 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:25:49.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:49 gibba020 bash[25448]: cephadm 2021-03-10T16:25:48.507227+0000 mgr.gibba020.yqfnwy (mgr.34427) 8069 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:25:50.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:50 gibba013 bash[29418]: cluster 2021-03-10T16:25:49.109747+0000 mgr.gibba020.yqfnwy (mgr.34427) 8070 : cluster [DBG] pgmap v4593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:50.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:50 gibba013 bash[30381]: cluster 2021-03-10T16:25:49.109747+0000 mgr.gibba020.yqfnwy (mgr.34427) 8070 : cluster [DBG] pgmap v4593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:50.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:50 gibba020 bash[25448]: cluster 2021-03-10T16:25:49.109747+0000 mgr.gibba020.yqfnwy (mgr.34427) 8070 : cluster [DBG] pgmap v4593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:52.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:52 gibba013 bash[29418]: cluster 2021-03-10T16:25:51.111354+0000 mgr.gibba020.yqfnwy (mgr.34427) 8071 : cluster [DBG] pgmap v4594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:52.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:52 gibba013 bash[30381]: cluster 2021-03-10T16:25:51.111354+0000 mgr.gibba020.yqfnwy (mgr.34427) 8071 : cluster [DBG] pgmap v4594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:52.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:52 gibba020 bash[25448]: cluster 2021-03-10T16:25:51.111354+0000 mgr.gibba020.yqfnwy (mgr.34427) 8071 : cluster [DBG] pgmap v4594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:54.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:54 gibba013 bash[29418]: cluster 2021-03-10T16:25:53.112536+0000 mgr.gibba020.yqfnwy (mgr.34427) 8072 : cluster [DBG] pgmap v4595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:54.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:54 gibba013 bash[30381]: cluster 2021-03-10T16:25:53.112536+0000 mgr.gibba020.yqfnwy (mgr.34427) 8072 : cluster [DBG] pgmap v4595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:54.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:54 gibba020 bash[25448]: cluster 2021-03-10T16:25:53.112536+0000 mgr.gibba020.yqfnwy (mgr.34427) 8072 : cluster [DBG] pgmap v4595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:56.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:56 gibba013 bash[29418]: cluster 2021-03-10T16:25:55.114447+0000 mgr.gibba020.yqfnwy (mgr.34427) 8073 : cluster [DBG] pgmap v4596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:56.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:56 gibba013 bash[30381]: cluster 2021-03-10T16:25:55.114447+0000 mgr.gibba020.yqfnwy (mgr.34427) 8073 : cluster [DBG] pgmap v4596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:56.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:56 gibba020 bash[25448]: cluster 2021-03-10T16:25:55.114447+0000 mgr.gibba020.yqfnwy (mgr.34427) 8073 : cluster [DBG] pgmap v4596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:57.946 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:25:58.175 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:25:58.175 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 5m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:25:58.175 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 4m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:25:58.175 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:25:58.176 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:25:58.176 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:25:58.176 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:25:58.176 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:25:58.177 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:25:58.177 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:25:58.177 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:25:58.177 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:25:58.177 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:25:58.178 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:25:58.178 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:25:58.178 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:25:58.178 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:25:58.179 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:25:58.179 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:25:58.179 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 4m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:25:58.179 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 4m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:25:58.431 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:25:58.431 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:25:58.432 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:25:58.432 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:25:58.432 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:25:58.432 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:25:58.433 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:25:58.433 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:25:58.433 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:25:58.433 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:25:58.433 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:25:58.434 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:25:58.434 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:25:58.434 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:25:58.434 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:25:58.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:58 gibba013 bash[29418]: cluster 2021-03-10T16:25:57.115977+0000 mgr.gibba020.yqfnwy (mgr.34427) 8074 : cluster [DBG] pgmap v4597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:58.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:58 gibba013 bash[30381]: cluster 2021-03-10T16:25:57.115977+0000 mgr.gibba020.yqfnwy (mgr.34427) 8074 : cluster [DBG] pgmap v4597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:58.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:58 gibba020 bash[25448]: cluster 2021-03-10T16:25:57.115977+0000 mgr.gibba020.yqfnwy (mgr.34427) 8074 : cluster [DBG] pgmap v4597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:25:59.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:59 gibba013 bash[29418]: audit 2021-03-10T16:25:57.937718+0000 mgr.gibba020.yqfnwy (mgr.34427) 8075 : audit [DBG] from='client.49470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:25:59.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:59 gibba013 bash[29418]: audit 2021-03-10T16:25:58.163007+0000 mgr.gibba020.yqfnwy (mgr.34427) 8076 : audit [DBG] from='client.49476 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:25:59.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:25:59 gibba013 bash[29418]: audit 2021-03-10T16:25:58.432382+0000 mon.a (mon.0) 2993 : audit [DBG] from='client.? 172.21.2.113:0/3775880809' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:59.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:59 gibba013 bash[30381]: audit 2021-03-10T16:25:57.937718+0000 mgr.gibba020.yqfnwy (mgr.34427) 8075 : audit [DBG] from='client.49470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:25:59.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:59 gibba013 bash[30381]: audit 2021-03-10T16:25:58.163007+0000 mgr.gibba020.yqfnwy (mgr.34427) 8076 : audit [DBG] from='client.49476 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:25:59.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:25:59 gibba013 bash[30381]: audit 2021-03-10T16:25:58.432382+0000 mon.a (mon.0) 2993 : audit [DBG] from='client.? 172.21.2.113:0/3775880809' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:25:59.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:59 gibba020 bash[25448]: audit 2021-03-10T16:25:57.937718+0000 mgr.gibba020.yqfnwy (mgr.34427) 8075 : audit [DBG] from='client.49470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:25:59.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:59 gibba020 bash[25448]: audit 2021-03-10T16:25:58.163007+0000 mgr.gibba020.yqfnwy (mgr.34427) 8076 : audit [DBG] from='client.49476 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:25:59.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:25:59 gibba020 bash[25448]: audit 2021-03-10T16:25:58.432382+0000 mon.a (mon.0) 2993 : audit [DBG] from='client.? 172.21.2.113:0/3775880809' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:00.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:00 gibba013 bash[29418]: cluster 2021-03-10T16:25:59.117374+0000 mgr.gibba020.yqfnwy (mgr.34427) 8077 : cluster [DBG] pgmap v4598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:00.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:00 gibba013 bash[30381]: cluster 2021-03-10T16:25:59.117374+0000 mgr.gibba020.yqfnwy (mgr.34427) 8077 : cluster [DBG] pgmap v4598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:00.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:00 gibba020 bash[25448]: cluster 2021-03-10T16:25:59.117374+0000 mgr.gibba020.yqfnwy (mgr.34427) 8077 : cluster [DBG] pgmap v4598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:02.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:02 gibba013 bash[29418]: cluster 2021-03-10T16:26:01.119093+0000 mgr.gibba020.yqfnwy (mgr.34427) 8078 : cluster [DBG] pgmap v4599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:02.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:02 gibba013 bash[30381]: cluster 2021-03-10T16:26:01.119093+0000 mgr.gibba020.yqfnwy (mgr.34427) 8078 : cluster [DBG] pgmap v4599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:02.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:02 gibba020 bash[25448]: cluster 2021-03-10T16:26:01.119093+0000 mgr.gibba020.yqfnwy (mgr.34427) 8078 : cluster [DBG] pgmap v4599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:04.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:04 gibba013 bash[29418]: cluster 2021-03-10T16:26:03.120250+0000 mgr.gibba020.yqfnwy (mgr.34427) 8079 : cluster [DBG] pgmap v4600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:04.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:04 gibba013 bash[29418]: cephadm 2021-03-10T16:26:03.520697+0000 mgr.gibba020.yqfnwy (mgr.34427) 8080 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:26:04.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:04 gibba013 bash[30381]: cluster 2021-03-10T16:26:03.120250+0000 mgr.gibba020.yqfnwy (mgr.34427) 8079 : cluster [DBG] pgmap v4600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:04.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:04 gibba013 bash[30381]: cephadm 2021-03-10T16:26:03.520697+0000 mgr.gibba020.yqfnwy (mgr.34427) 8080 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:26:04.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:04 gibba020 bash[25448]: cluster 2021-03-10T16:26:03.120250+0000 mgr.gibba020.yqfnwy (mgr.34427) 8079 : cluster [DBG] pgmap v4600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:04.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:04 gibba020 bash[25448]: cephadm 2021-03-10T16:26:03.520697+0000 mgr.gibba020.yqfnwy (mgr.34427) 8080 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:26:06.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:06 gibba013 bash[29418]: cluster 2021-03-10T16:26:05.122119+0000 mgr.gibba020.yqfnwy (mgr.34427) 8081 : cluster [DBG] pgmap v4601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:06.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:06 gibba013 bash[30381]: cluster 2021-03-10T16:26:05.122119+0000 mgr.gibba020.yqfnwy (mgr.34427) 8081 : cluster [DBG] pgmap v4601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:06.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:06 gibba020 bash[25448]: cluster 2021-03-10T16:26:05.122119+0000 mgr.gibba020.yqfnwy (mgr.34427) 8081 : cluster [DBG] pgmap v4601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:07.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:07 gibba013 bash[29418]: audit 2021-03-10T16:26:06.697595+0000 mon.a (mon.0) 2994 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:26:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:07 gibba013 bash[29418]: audit 2021-03-10T16:26:06.839699+0000 mon.a (mon.0) 2995 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:26:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:07 gibba013 bash[29418]: audit 2021-03-10T16:26:07.102739+0000 mon.a (mon.0) 2996 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:26:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:07 gibba013 bash[29418]: audit 2021-03-10T16:26:07.103474+0000 mon.a (mon.0) 2997 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:26:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:07 gibba013 bash[29418]: audit 2021-03-10T16:26:07.104234+0000 mon.a (mon.0) 2998 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:26:07.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:07 gibba013 bash[29418]: audit 2021-03-10T16:26:07.104931+0000 mon.a (mon.0) 2999 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:26:07.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:07 gibba013 bash[30381]: audit 2021-03-10T16:26:06.697595+0000 mon.a (mon.0) 2994 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:26:07.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:07 gibba013 bash[30381]: audit 2021-03-10T16:26:06.839699+0000 mon.a (mon.0) 2995 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:26:07.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:07 gibba013 bash[30381]: audit 2021-03-10T16:26:07.102739+0000 mon.a (mon.0) 2996 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:26:07.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:07 gibba013 bash[30381]: audit 2021-03-10T16:26:07.103474+0000 mon.a (mon.0) 2997 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:26:07.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:07 gibba013 bash[30381]: audit 2021-03-10T16:26:07.104234+0000 mon.a (mon.0) 2998 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:26:07.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:07 gibba013 bash[30381]: audit 2021-03-10T16:26:07.104931+0000 mon.a (mon.0) 2999 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:26:07.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:07 gibba020 bash[25448]: audit 2021-03-10T16:26:06.697595+0000 mon.a (mon.0) 2994 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:26:07.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:07 gibba020 bash[25448]: audit 2021-03-10T16:26:06.839699+0000 mon.a (mon.0) 2995 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:26:07.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:07 gibba020 bash[25448]: audit 2021-03-10T16:26:07.102739+0000 mon.a (mon.0) 2996 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T16:26:07.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:07 gibba020 bash[25448]: audit 2021-03-10T16:26:07.103474+0000 mon.a (mon.0) 2997 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:26:07.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:07 gibba020 bash[25448]: audit 2021-03-10T16:26:07.104234+0000 mon.a (mon.0) 2998 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:26:07.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:07 gibba020 bash[25448]: audit 2021-03-10T16:26:07.104931+0000 mon.a (mon.0) 2999 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:26:08.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:08 gibba013 bash[29418]: cluster 2021-03-10T16:26:07.122842+0000 mgr.gibba020.yqfnwy (mgr.34427) 8082 : cluster [DBG] pgmap v4602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:08.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:08 gibba013 bash[30381]: cluster 2021-03-10T16:26:07.122842+0000 mgr.gibba020.yqfnwy (mgr.34427) 8082 : cluster [DBG] pgmap v4602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:08.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:08 gibba020 bash[25448]: cluster 2021-03-10T16:26:07.122842+0000 mgr.gibba020.yqfnwy (mgr.34427) 8082 : cluster [DBG] pgmap v4602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:10.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:10 gibba013 bash[29418]: cluster 2021-03-10T16:26:09.124247+0000 mgr.gibba020.yqfnwy (mgr.34427) 8083 : cluster [DBG] pgmap v4603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:10.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:10 gibba013 bash[30381]: cluster 2021-03-10T16:26:09.124247+0000 mgr.gibba020.yqfnwy (mgr.34427) 8083 : cluster [DBG] pgmap v4603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:10.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:10 gibba020 bash[25448]: cluster 2021-03-10T16:26:09.124247+0000 mgr.gibba020.yqfnwy (mgr.34427) 8083 : cluster [DBG] pgmap v4603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:12.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:12 gibba013 bash[29418]: cluster 2021-03-10T16:26:11.126062+0000 mgr.gibba020.yqfnwy (mgr.34427) 8084 : cluster [DBG] pgmap v4604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:12.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:12 gibba013 bash[30381]: cluster 2021-03-10T16:26:11.126062+0000 mgr.gibba020.yqfnwy (mgr.34427) 8084 : cluster [DBG] pgmap v4604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:12.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:12 gibba020 bash[25448]: cluster 2021-03-10T16:26:11.126062+0000 mgr.gibba020.yqfnwy (mgr.34427) 8084 : cluster [DBG] pgmap v4604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:14.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:14 gibba013 bash[29418]: cluster 2021-03-10T16:26:13.127208+0000 mgr.gibba020.yqfnwy (mgr.34427) 8085 : cluster [DBG] pgmap v4605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:14.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:14 gibba013 bash[30381]: cluster 2021-03-10T16:26:13.127208+0000 mgr.gibba020.yqfnwy (mgr.34427) 8085 : cluster [DBG] pgmap v4605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:14.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:14 gibba020 bash[25448]: cluster 2021-03-10T16:26:13.127208+0000 mgr.gibba020.yqfnwy (mgr.34427) 8085 : cluster [DBG] pgmap v4605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:16.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:16 gibba013 bash[29418]: cluster 2021-03-10T16:26:15.129198+0000 mgr.gibba020.yqfnwy (mgr.34427) 8086 : cluster [DBG] pgmap v4606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:16.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:16 gibba013 bash[30381]: cluster 2021-03-10T16:26:15.129198+0000 mgr.gibba020.yqfnwy (mgr.34427) 8086 : cluster [DBG] pgmap v4606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:16.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:16 gibba020 bash[25448]: cluster 2021-03-10T16:26:15.129198+0000 mgr.gibba020.yqfnwy (mgr.34427) 8086 : cluster [DBG] pgmap v4606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:18.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:18 gibba013 bash[29418]: cluster 2021-03-10T16:26:17.130621+0000 mgr.gibba020.yqfnwy (mgr.34427) 8087 : cluster [DBG] pgmap v4607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:18.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:18 gibba013 bash[30381]: cluster 2021-03-10T16:26:17.130621+0000 mgr.gibba020.yqfnwy (mgr.34427) 8087 : cluster [DBG] pgmap v4607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:18.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:18 gibba020 bash[25448]: cluster 2021-03-10T16:26:17.130621+0000 mgr.gibba020.yqfnwy (mgr.34427) 8087 : cluster [DBG] pgmap v4607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:19.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:19 gibba013 bash[29418]: cephadm 2021-03-10T16:26:18.528513+0000 mgr.gibba020.yqfnwy (mgr.34427) 8088 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:26:19.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:19 gibba013 bash[30381]: cephadm 2021-03-10T16:26:18.528513+0000 mgr.gibba020.yqfnwy (mgr.34427) 8088 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:26:19.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:19 gibba020 bash[25448]: cephadm 2021-03-10T16:26:18.528513+0000 mgr.gibba020.yqfnwy (mgr.34427) 8088 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:26:20.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:20 gibba013 bash[29418]: cluster 2021-03-10T16:26:19.132197+0000 mgr.gibba020.yqfnwy (mgr.34427) 8089 : cluster [DBG] pgmap v4608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:20.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:20 gibba013 bash[30381]: cluster 2021-03-10T16:26:19.132197+0000 mgr.gibba020.yqfnwy (mgr.34427) 8089 : cluster [DBG] pgmap v4608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:20.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:20 gibba020 bash[25448]: cluster 2021-03-10T16:26:19.132197+0000 mgr.gibba020.yqfnwy (mgr.34427) 8089 : cluster [DBG] pgmap v4608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:22.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:22 gibba020 bash[25448]: cluster 2021-03-10T16:26:21.134099+0000 mgr.gibba020.yqfnwy (mgr.34427) 8090 : cluster [DBG] pgmap v4609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:22.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:22 gibba013 bash[29418]: cluster 2021-03-10T16:26:21.134099+0000 mgr.gibba020.yqfnwy (mgr.34427) 8090 : cluster [DBG] pgmap v4609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:22.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:22 gibba013 bash[30381]: cluster 2021-03-10T16:26:21.134099+0000 mgr.gibba020.yqfnwy (mgr.34427) 8090 : cluster [DBG] pgmap v4609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:24.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:24 gibba020 bash[25448]: cluster 2021-03-10T16:26:23.135205+0000 mgr.gibba020.yqfnwy (mgr.34427) 8091 : cluster [DBG] pgmap v4610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:24.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:24 gibba013 bash[29418]: cluster 2021-03-10T16:26:23.135205+0000 mgr.gibba020.yqfnwy (mgr.34427) 8091 : cluster [DBG] pgmap v4610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:24.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:24 gibba013 bash[30381]: cluster 2021-03-10T16:26:23.135205+0000 mgr.gibba020.yqfnwy (mgr.34427) 8091 : cluster [DBG] pgmap v4610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:26.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:26 gibba020 bash[25448]: cluster 2021-03-10T16:26:25.137032+0000 mgr.gibba020.yqfnwy (mgr.34427) 8092 : cluster [DBG] pgmap v4611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:26.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:26 gibba013 bash[29418]: cluster 2021-03-10T16:26:25.137032+0000 mgr.gibba020.yqfnwy (mgr.34427) 8092 : cluster [DBG] pgmap v4611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:26.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:26 gibba013 bash[30381]: cluster 2021-03-10T16:26:25.137032+0000 mgr.gibba020.yqfnwy (mgr.34427) 8092 : cluster [DBG] pgmap v4611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:28.668 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:26:28.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:28 gibba020 bash[25448]: cluster 2021-03-10T16:26:27.138191+0000 mgr.gibba020.yqfnwy (mgr.34427) 8093 : cluster [DBG] pgmap v4612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:28.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:28 gibba013 bash[29418]: cluster 2021-03-10T16:26:27.138191+0000 mgr.gibba020.yqfnwy (mgr.34427) 8093 : cluster [DBG] pgmap v4612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:28.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:28 gibba013 bash[30381]: cluster 2021-03-10T16:26:27.138191+0000 mgr.gibba020.yqfnwy (mgr.34427) 8093 : cluster [DBG] pgmap v4612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:28.894 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:26:28.895 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 6m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:26:28.895 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 5m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:26:28.895 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:26:28.895 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:26:28.896 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:26:28.896 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:26:28.896 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:26:28.897 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:26:28.897 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:26:28.897 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:26:28.897 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:26:28.898 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:26:28.898 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:26:28.898 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:26:28.898 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:26:28.899 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:26:28.899 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:26:28.899 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:26:28.899 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 5m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:26:28.900 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 5m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:26:29.144 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:26:29.145 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:26:29.145 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:26:29.145 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:26:29.145 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:26:29.146 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:26:29.146 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:26:29.146 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:26:29.147 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:26:29.147 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:26:29.147 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:26:29.147 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:26:29.148 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:26:29.148 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:26:29.148 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:26:29.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:29 gibba020 bash[25448]: audit 2021-03-10T16:26:29.145444+0000 mon.c (mon.1) 130 : audit [DBG] from='client.? 172.21.2.113:0/1951005191' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:29.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:29 gibba013 bash[29418]: audit 2021-03-10T16:26:29.145444+0000 mon.c (mon.1) 130 : audit [DBG] from='client.? 172.21.2.113:0/1951005191' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:29.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:29 gibba013 bash[30381]: audit 2021-03-10T16:26:29.145444+0000 mon.c (mon.1) 130 : audit [DBG] from='client.? 172.21.2.113:0/1951005191' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:30.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:30 gibba020 bash[25448]: audit 2021-03-10T16:26:28.660327+0000 mgr.gibba020.yqfnwy (mgr.34427) 8094 : audit [DBG] from='client.49488 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:26:30.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:30 gibba020 bash[25448]: audit 2021-03-10T16:26:28.883407+0000 mgr.gibba020.yqfnwy (mgr.34427) 8095 : audit [DBG] from='client.49494 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:26:30.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:30 gibba020 bash[25448]: cluster 2021-03-10T16:26:29.139864+0000 mgr.gibba020.yqfnwy (mgr.34427) 8096 : cluster [DBG] pgmap v4613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:30.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:30 gibba013 bash[29418]: audit 2021-03-10T16:26:28.660327+0000 mgr.gibba020.yqfnwy (mgr.34427) 8094 : audit [DBG] from='client.49488 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:26:30.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:30 gibba013 bash[29418]: audit 2021-03-10T16:26:28.883407+0000 mgr.gibba020.yqfnwy (mgr.34427) 8095 : audit [DBG] from='client.49494 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:26:30.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:30 gibba013 bash[29418]: cluster 2021-03-10T16:26:29.139864+0000 mgr.gibba020.yqfnwy (mgr.34427) 8096 : cluster [DBG] pgmap v4613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:30.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:30 gibba013 bash[30381]: audit 2021-03-10T16:26:28.660327+0000 mgr.gibba020.yqfnwy (mgr.34427) 8094 : audit [DBG] from='client.49488 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:26:30.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:30 gibba013 bash[30381]: audit 2021-03-10T16:26:28.883407+0000 mgr.gibba020.yqfnwy (mgr.34427) 8095 : audit [DBG] from='client.49494 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:26:30.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:30 gibba013 bash[30381]: cluster 2021-03-10T16:26:29.139864+0000 mgr.gibba020.yqfnwy (mgr.34427) 8096 : cluster [DBG] pgmap v4613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:32.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:32 gibba020 bash[25448]: cluster 2021-03-10T16:26:31.141867+0000 mgr.gibba020.yqfnwy (mgr.34427) 8097 : cluster [DBG] pgmap v4614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:32.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:32 gibba013 bash[29418]: cluster 2021-03-10T16:26:31.141867+0000 mgr.gibba020.yqfnwy (mgr.34427) 8097 : cluster [DBG] pgmap v4614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:32.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:32 gibba013 bash[30381]: cluster 2021-03-10T16:26:31.141867+0000 mgr.gibba020.yqfnwy (mgr.34427) 8097 : cluster [DBG] pgmap v4614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:34.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:34 gibba020 bash[25448]: cluster 2021-03-10T16:26:33.142991+0000 mgr.gibba020.yqfnwy (mgr.34427) 8098 : cluster [DBG] pgmap v4615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:34.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:34 gibba020 bash[25448]: audit 2021-03-10T16:26:33.546147+0000 mon.a (mon.0) 3000 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:26:34.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:34 gibba020 bash[25448]: cephadm 2021-03-10T16:26:33.551600+0000 mgr.gibba020.yqfnwy (mgr.34427) 8099 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:26:34.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:34 gibba020 bash[25448]: cephadm 2021-03-10T16:26:33.553422+0000 mgr.gibba020.yqfnwy (mgr.34427) 8100 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:26:34.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:34 gibba020 bash[25448]: audit 2021-03-10T16:26:33.763492+0000 mon.a (mon.0) 3001 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:26:34.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:34 gibba020 bash[25448]: audit 2021-03-10T16:26:33.767023+0000 mon.a (mon.0) 3002 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:26:34.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:34 gibba020 bash[25448]: audit 2021-03-10T16:26:33.768554+0000 mon.a (mon.0) 3003 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:34.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:34 gibba020 bash[25448]: audit 2021-03-10T16:26:33.769855+0000 mon.a (mon.0) 3004 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:34.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:34 gibba020 bash[25448]: audit 2021-03-10T16:26:33.771305+0000 mon.a (mon.0) 3005 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:34.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:34 gibba020 bash[25448]: audit 2021-03-10T16:26:33.774160+0000 mon.a (mon.0) 3006 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:34.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:34 gibba020 bash[25448]: audit 2021-03-10T16:26:33.775676+0000 mon.a (mon.0) 3007 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:34.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:34 gibba013 bash[29418]: cluster 2021-03-10T16:26:33.142991+0000 mgr.gibba020.yqfnwy (mgr.34427) 8098 : cluster [DBG] pgmap v4615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:34.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:34 gibba013 bash[29418]: audit 2021-03-10T16:26:33.546147+0000 mon.a (mon.0) 3000 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:26:34.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:34 gibba013 bash[29418]: cephadm 2021-03-10T16:26:33.551600+0000 mgr.gibba020.yqfnwy (mgr.34427) 8099 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:26:34.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:34 gibba013 bash[29418]: cephadm 2021-03-10T16:26:33.553422+0000 mgr.gibba020.yqfnwy (mgr.34427) 8100 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:26:34.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:34 gibba013 bash[29418]: audit 2021-03-10T16:26:33.763492+0000 mon.a (mon.0) 3001 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:26:34.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:34 gibba013 bash[29418]: audit 2021-03-10T16:26:33.767023+0000 mon.a (mon.0) 3002 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:26:34.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:34 gibba013 bash[29418]: audit 2021-03-10T16:26:33.768554+0000 mon.a (mon.0) 3003 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:34.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:34 gibba013 bash[29418]: audit 2021-03-10T16:26:33.769855+0000 mon.a (mon.0) 3004 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:34.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:34 gibba013 bash[29418]: audit 2021-03-10T16:26:33.771305+0000 mon.a (mon.0) 3005 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:34.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:34 gibba013 bash[29418]: audit 2021-03-10T16:26:33.774160+0000 mon.a (mon.0) 3006 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:34.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:34 gibba013 bash[29418]: audit 2021-03-10T16:26:33.775676+0000 mon.a (mon.0) 3007 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:34.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:34 gibba013 bash[30381]: cluster 2021-03-10T16:26:33.142991+0000 mgr.gibba020.yqfnwy (mgr.34427) 8098 : cluster [DBG] pgmap v4615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:34.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:34 gibba013 bash[30381]: audit 2021-03-10T16:26:33.546147+0000 mon.a (mon.0) 3000 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:26:34.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:34 gibba013 bash[30381]: cephadm 2021-03-10T16:26:33.551600+0000 mgr.gibba020.yqfnwy (mgr.34427) 8099 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:26:34.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:34 gibba013 bash[30381]: cephadm 2021-03-10T16:26:33.553422+0000 mgr.gibba020.yqfnwy (mgr.34427) 8100 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:26:34.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:34 gibba013 bash[30381]: audit 2021-03-10T16:26:33.763492+0000 mon.a (mon.0) 3001 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:26:34.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:34 gibba013 bash[30381]: audit 2021-03-10T16:26:33.767023+0000 mon.a (mon.0) 3002 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:26:34.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:34 gibba013 bash[30381]: audit 2021-03-10T16:26:33.768554+0000 mon.a (mon.0) 3003 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:34.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:34 gibba013 bash[30381]: audit 2021-03-10T16:26:33.769855+0000 mon.a (mon.0) 3004 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:34.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:34 gibba013 bash[30381]: audit 2021-03-10T16:26:33.771305+0000 mon.a (mon.0) 3005 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:34.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:34 gibba013 bash[30381]: audit 2021-03-10T16:26:33.774160+0000 mon.a (mon.0) 3006 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:34.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:34 gibba013 bash[30381]: audit 2021-03-10T16:26:33.775676+0000 mon.a (mon.0) 3007 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:26:35.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:35 gibba013 bash[29418]: cephadm 2021-03-10T16:26:33.765633+0000 mgr.gibba020.yqfnwy (mgr.34427) 8101 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:26:35.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:35 gibba013 bash[29418]: cephadm 2021-03-10T16:26:33.767561+0000 mgr.gibba020.yqfnwy (mgr.34427) 8102 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:26:35.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:35 gibba013 bash[29418]: cephadm 2021-03-10T16:26:33.768846+0000 mgr.gibba020.yqfnwy (mgr.34427) 8103 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:26:35.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:35 gibba013 bash[29418]: cephadm 2021-03-10T16:26:33.768882+0000 mgr.gibba020.yqfnwy (mgr.34427) 8104 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:26:35.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:35 gibba013 bash[29418]: cephadm 2021-03-10T16:26:33.770279+0000 mgr.gibba020.yqfnwy (mgr.34427) 8105 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:26:35.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:35 gibba013 bash[29418]: cephadm 2021-03-10T16:26:33.770314+0000 mgr.gibba020.yqfnwy (mgr.34427) 8106 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:26:35.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:35 gibba013 bash[29418]: cephadm 2021-03-10T16:26:33.771965+0000 mgr.gibba020.yqfnwy (mgr.34427) 8107 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:26:35.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:35 gibba013 bash[29418]: cephadm 2021-03-10T16:26:33.773165+0000 mgr.gibba020.yqfnwy (mgr.34427) 8108 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:26:35.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:35 gibba013 bash[29418]: cephadm 2021-03-10T16:26:33.773200+0000 mgr.gibba020.yqfnwy (mgr.34427) 8109 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:26:35.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:35 gibba013 bash[29418]: cephadm 2021-03-10T16:26:33.774441+0000 mgr.gibba020.yqfnwy (mgr.34427) 8110 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:26:35.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:35 gibba013 bash[29418]: cephadm 2021-03-10T16:26:33.774760+0000 mgr.gibba020.yqfnwy (mgr.34427) 8111 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:26:35.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:35 gibba013 bash[29418]: cephadm 2021-03-10T16:26:33.775860+0000 mgr.gibba020.yqfnwy (mgr.34427) 8112 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:26:35.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:35 gibba013 bash[29418]: cephadm 2021-03-10T16:26:33.775898+0000 mgr.gibba020.yqfnwy (mgr.34427) 8113 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:26:35.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:35 gibba013 bash[29418]: cephadm 2021-03-10T16:26:33.776093+0000 mgr.gibba020.yqfnwy (mgr.34427) 8114 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:26:35.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:35 gibba013 bash[30381]: cephadm 2021-03-10T16:26:33.765633+0000 mgr.gibba020.yqfnwy (mgr.34427) 8101 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:26:35.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:35 gibba013 bash[30381]: cephadm 2021-03-10T16:26:33.767561+0000 mgr.gibba020.yqfnwy (mgr.34427) 8102 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:26:35.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:35 gibba013 bash[30381]: cephadm 2021-03-10T16:26:33.768846+0000 mgr.gibba020.yqfnwy (mgr.34427) 8103 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:26:35.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:35 gibba013 bash[30381]: cephadm 2021-03-10T16:26:33.768882+0000 mgr.gibba020.yqfnwy (mgr.34427) 8104 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:26:35.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:35 gibba013 bash[30381]: cephadm 2021-03-10T16:26:33.770279+0000 mgr.gibba020.yqfnwy (mgr.34427) 8105 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:26:35.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:35 gibba013 bash[30381]: cephadm 2021-03-10T16:26:33.770314+0000 mgr.gibba020.yqfnwy (mgr.34427) 8106 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:26:35.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:35 gibba013 bash[30381]: cephadm 2021-03-10T16:26:33.771965+0000 mgr.gibba020.yqfnwy (mgr.34427) 8107 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:26:35.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:35 gibba013 bash[30381]: cephadm 2021-03-10T16:26:33.773165+0000 mgr.gibba020.yqfnwy (mgr.34427) 8108 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:26:35.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:35 gibba013 bash[30381]: cephadm 2021-03-10T16:26:33.773200+0000 mgr.gibba020.yqfnwy (mgr.34427) 8109 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:26:35.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:35 gibba013 bash[30381]: cephadm 2021-03-10T16:26:33.774441+0000 mgr.gibba020.yqfnwy (mgr.34427) 8110 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:26:35.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:35 gibba013 bash[30381]: cephadm 2021-03-10T16:26:33.774760+0000 mgr.gibba020.yqfnwy (mgr.34427) 8111 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:26:35.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:35 gibba013 bash[30381]: cephadm 2021-03-10T16:26:33.775860+0000 mgr.gibba020.yqfnwy (mgr.34427) 8112 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:26:35.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:35 gibba013 bash[30381]: cephadm 2021-03-10T16:26:33.775898+0000 mgr.gibba020.yqfnwy (mgr.34427) 8113 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:26:35.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:35 gibba013 bash[30381]: cephadm 2021-03-10T16:26:33.776093+0000 mgr.gibba020.yqfnwy (mgr.34427) 8114 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:26:35.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:35 gibba020 bash[25448]: cephadm 2021-03-10T16:26:33.765633+0000 mgr.gibba020.yqfnwy (mgr.34427) 8101 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:26:35.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:35 gibba020 bash[25448]: cephadm 2021-03-10T16:26:33.767561+0000 mgr.gibba020.yqfnwy (mgr.34427) 8102 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:26:35.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:35 gibba020 bash[25448]: cephadm 2021-03-10T16:26:33.768846+0000 mgr.gibba020.yqfnwy (mgr.34427) 8103 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:26:35.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:35 gibba020 bash[25448]: cephadm 2021-03-10T16:26:33.768882+0000 mgr.gibba020.yqfnwy (mgr.34427) 8104 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:26:35.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:35 gibba020 bash[25448]: cephadm 2021-03-10T16:26:33.770279+0000 mgr.gibba020.yqfnwy (mgr.34427) 8105 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:26:35.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:35 gibba020 bash[25448]: cephadm 2021-03-10T16:26:33.770314+0000 mgr.gibba020.yqfnwy (mgr.34427) 8106 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:26:35.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:35 gibba020 bash[25448]: cephadm 2021-03-10T16:26:33.771965+0000 mgr.gibba020.yqfnwy (mgr.34427) 8107 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:26:35.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:35 gibba020 bash[25448]: cephadm 2021-03-10T16:26:33.773165+0000 mgr.gibba020.yqfnwy (mgr.34427) 8108 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:26:35.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:35 gibba020 bash[25448]: cephadm 2021-03-10T16:26:33.773200+0000 mgr.gibba020.yqfnwy (mgr.34427) 8109 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:26:35.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:35 gibba020 bash[25448]: cephadm 2021-03-10T16:26:33.774441+0000 mgr.gibba020.yqfnwy (mgr.34427) 8110 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:26:35.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:35 gibba020 bash[25448]: cephadm 2021-03-10T16:26:33.774760+0000 mgr.gibba020.yqfnwy (mgr.34427) 8111 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:26:35.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:35 gibba020 bash[25448]: cephadm 2021-03-10T16:26:33.775860+0000 mgr.gibba020.yqfnwy (mgr.34427) 8112 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:26:35.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:35 gibba020 bash[25448]: cephadm 2021-03-10T16:26:33.775898+0000 mgr.gibba020.yqfnwy (mgr.34427) 8113 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:26:35.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:35 gibba020 bash[25448]: cephadm 2021-03-10T16:26:33.776093+0000 mgr.gibba020.yqfnwy (mgr.34427) 8114 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:26:36.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:36 gibba013 bash[29418]: cluster 2021-03-10T16:26:35.145111+0000 mgr.gibba020.yqfnwy (mgr.34427) 8115 : cluster [DBG] pgmap v4616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:36.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:36 gibba013 bash[30381]: cluster 2021-03-10T16:26:35.145111+0000 mgr.gibba020.yqfnwy (mgr.34427) 8115 : cluster [DBG] pgmap v4616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:36.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:36 gibba020 bash[25448]: cluster 2021-03-10T16:26:35.145111+0000 mgr.gibba020.yqfnwy (mgr.34427) 8115 : cluster [DBG] pgmap v4616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:38.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:38 gibba013 bash[29418]: cluster 2021-03-10T16:26:37.146550+0000 mgr.gibba020.yqfnwy (mgr.34427) 8116 : cluster [DBG] pgmap v4617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:38.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:38 gibba013 bash[30381]: cluster 2021-03-10T16:26:37.146550+0000 mgr.gibba020.yqfnwy (mgr.34427) 8116 : cluster [DBG] pgmap v4617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:38.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:38 gibba020 bash[25448]: cluster 2021-03-10T16:26:37.146550+0000 mgr.gibba020.yqfnwy (mgr.34427) 8116 : cluster [DBG] pgmap v4617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:40.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:40 gibba013 bash[29418]: cluster 2021-03-10T16:26:39.148396+0000 mgr.gibba020.yqfnwy (mgr.34427) 8117 : cluster [DBG] pgmap v4618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:40.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:40 gibba013 bash[30381]: cluster 2021-03-10T16:26:39.148396+0000 mgr.gibba020.yqfnwy (mgr.34427) 8117 : cluster [DBG] pgmap v4618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:40.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:40 gibba020 bash[25448]: cluster 2021-03-10T16:26:39.148396+0000 mgr.gibba020.yqfnwy (mgr.34427) 8117 : cluster [DBG] pgmap v4618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:42.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:42 gibba013 bash[29418]: cluster 2021-03-10T16:26:41.150163+0000 mgr.gibba020.yqfnwy (mgr.34427) 8118 : cluster [DBG] pgmap v4619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:42.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:42 gibba013 bash[30381]: cluster 2021-03-10T16:26:41.150163+0000 mgr.gibba020.yqfnwy (mgr.34427) 8118 : cluster [DBG] pgmap v4619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:42.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:42 gibba020 bash[25448]: cluster 2021-03-10T16:26:41.150163+0000 mgr.gibba020.yqfnwy (mgr.34427) 8118 : cluster [DBG] pgmap v4619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:44.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:44 gibba013 bash[29418]: cluster 2021-03-10T16:26:43.151432+0000 mgr.gibba020.yqfnwy (mgr.34427) 8119 : cluster [DBG] pgmap v4620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:44.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:44 gibba013 bash[30381]: cluster 2021-03-10T16:26:43.151432+0000 mgr.gibba020.yqfnwy (mgr.34427) 8119 : cluster [DBG] pgmap v4620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:44.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:44 gibba020 bash[25448]: cluster 2021-03-10T16:26:43.151432+0000 mgr.gibba020.yqfnwy (mgr.34427) 8119 : cluster [DBG] pgmap v4620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:46.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:46 gibba013 bash[29418]: cluster 2021-03-10T16:26:45.153405+0000 mgr.gibba020.yqfnwy (mgr.34427) 8120 : cluster [DBG] pgmap v4621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:46.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:46 gibba013 bash[30381]: cluster 2021-03-10T16:26:45.153405+0000 mgr.gibba020.yqfnwy (mgr.34427) 8120 : cluster [DBG] pgmap v4621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:46.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:46 gibba020 bash[25448]: cluster 2021-03-10T16:26:45.153405+0000 mgr.gibba020.yqfnwy (mgr.34427) 8120 : cluster [DBG] pgmap v4621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:48.792 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:48 gibba020 bash[25448]: cluster 2021-03-10T16:26:47.153860+0000 mgr.gibba020.yqfnwy (mgr.34427) 8121 : cluster [DBG] pgmap v4622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:48.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:48 gibba013 bash[29418]: cluster 2021-03-10T16:26:47.153860+0000 mgr.gibba020.yqfnwy (mgr.34427) 8121 : cluster [DBG] pgmap v4622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:48.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:48 gibba013 bash[30381]: cluster 2021-03-10T16:26:47.153860+0000 mgr.gibba020.yqfnwy (mgr.34427) 8121 : cluster [DBG] pgmap v4622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:50.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:50 gibba013 bash[29418]: cephadm 2021-03-10T16:26:48.792208+0000 mgr.gibba020.yqfnwy (mgr.34427) 8122 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:26:50.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:50 gibba013 bash[29418]: cluster 2021-03-10T16:26:49.155326+0000 mgr.gibba020.yqfnwy (mgr.34427) 8123 : cluster [DBG] pgmap v4623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:50.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:50 gibba013 bash[30381]: cephadm 2021-03-10T16:26:48.792208+0000 mgr.gibba020.yqfnwy (mgr.34427) 8122 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:26:50.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:50 gibba013 bash[30381]: cluster 2021-03-10T16:26:49.155326+0000 mgr.gibba020.yqfnwy (mgr.34427) 8123 : cluster [DBG] pgmap v4623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:50.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:50 gibba020 bash[25448]: cephadm 2021-03-10T16:26:48.792208+0000 mgr.gibba020.yqfnwy (mgr.34427) 8122 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:26:50.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:50 gibba020 bash[25448]: cluster 2021-03-10T16:26:49.155326+0000 mgr.gibba020.yqfnwy (mgr.34427) 8123 : cluster [DBG] pgmap v4623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:52.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:52 gibba013 bash[29418]: cluster 2021-03-10T16:26:51.157188+0000 mgr.gibba020.yqfnwy (mgr.34427) 8124 : cluster [DBG] pgmap v4624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:52.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:52 gibba013 bash[30381]: cluster 2021-03-10T16:26:51.157188+0000 mgr.gibba020.yqfnwy (mgr.34427) 8124 : cluster [DBG] pgmap v4624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:52.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:52 gibba020 bash[25448]: cluster 2021-03-10T16:26:51.157188+0000 mgr.gibba020.yqfnwy (mgr.34427) 8124 : cluster [DBG] pgmap v4624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:54.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:54 gibba013 bash[29418]: cluster 2021-03-10T16:26:53.157613+0000 mgr.gibba020.yqfnwy (mgr.34427) 8125 : cluster [DBG] pgmap v4625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:54.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:54 gibba013 bash[30381]: cluster 2021-03-10T16:26:53.157613+0000 mgr.gibba020.yqfnwy (mgr.34427) 8125 : cluster [DBG] pgmap v4625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:54.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:54 gibba020 bash[25448]: cluster 2021-03-10T16:26:53.157613+0000 mgr.gibba020.yqfnwy (mgr.34427) 8125 : cluster [DBG] pgmap v4625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:56.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:56 gibba013 bash[29418]: cluster 2021-03-10T16:26:55.159440+0000 mgr.gibba020.yqfnwy (mgr.34427) 8126 : cluster [DBG] pgmap v4626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:56.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:56 gibba013 bash[30381]: cluster 2021-03-10T16:26:55.159440+0000 mgr.gibba020.yqfnwy (mgr.34427) 8126 : cluster [DBG] pgmap v4626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:56.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:56 gibba020 bash[25448]: cluster 2021-03-10T16:26:55.159440+0000 mgr.gibba020.yqfnwy (mgr.34427) 8126 : cluster [DBG] pgmap v4626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:58.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:26:58 gibba013 bash[29418]: cluster 2021-03-10T16:26:57.160792+0000 mgr.gibba020.yqfnwy (mgr.34427) 8127 : cluster [DBG] pgmap v4627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:58.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:26:58 gibba013 bash[30381]: cluster 2021-03-10T16:26:57.160792+0000 mgr.gibba020.yqfnwy (mgr.34427) 8127 : cluster [DBG] pgmap v4627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:58.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:26:58 gibba020 bash[25448]: cluster 2021-03-10T16:26:57.160792+0000 mgr.gibba020.yqfnwy (mgr.34427) 8127 : cluster [DBG] pgmap v4627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:26:59.390 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:26:59.616 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:26:59.616 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 6m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:26:59.616 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 5m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:26:59.617 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:26:59.617 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:26:59.617 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:26:59.618 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:26:59.618 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:26:59.618 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:26:59.618 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:26:59.619 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:26:59.619 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:26:59.619 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:26:59.620 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:26:59.620 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:26:59.620 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:26:59.620 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:26:59.621 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:26:59.621 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:26:59.621 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 5m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:26:59.622 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 5m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:26:59.863 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:26:59.863 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:26:59.863 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:26:59.864 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:26:59.864 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:26:59.864 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:26:59.864 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:26:59.865 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:26:59.865 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:26:59.865 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:26:59.865 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:26:59.866 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:26:59.866 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:26:59.866 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:26:59.866 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:27:00.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:00 gibba013 bash[29418]: cluster 2021-03-10T16:26:59.161437+0000 mgr.gibba020.yqfnwy (mgr.34427) 8128 : cluster [DBG] pgmap v4628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:00.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:00 gibba013 bash[29418]: audit 2021-03-10T16:26:59.381863+0000 mgr.gibba020.yqfnwy (mgr.34427) 8129 : audit [DBG] from='client.59488 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:27:00.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:00 gibba013 bash[29418]: audit 2021-03-10T16:26:59.606807+0000 mgr.gibba020.yqfnwy (mgr.34427) 8130 : audit [DBG] from='client.49512 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:27:00.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:00 gibba013 bash[29418]: audit 2021-03-10T16:26:59.864031+0000 mon.a (mon.0) 3008 : audit [DBG] from='client.? 172.21.2.113:0/3650027865' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:00.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:00 gibba013 bash[30381]: cluster 2021-03-10T16:26:59.161437+0000 mgr.gibba020.yqfnwy (mgr.34427) 8128 : cluster [DBG] pgmap v4628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:00.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:00 gibba013 bash[30381]: audit 2021-03-10T16:26:59.381863+0000 mgr.gibba020.yqfnwy (mgr.34427) 8129 : audit [DBG] from='client.59488 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:27:00.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:00 gibba013 bash[30381]: audit 2021-03-10T16:26:59.606807+0000 mgr.gibba020.yqfnwy (mgr.34427) 8130 : audit [DBG] from='client.49512 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:27:00.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:00 gibba013 bash[30381]: audit 2021-03-10T16:26:59.864031+0000 mon.a (mon.0) 3008 : audit [DBG] from='client.? 172.21.2.113:0/3650027865' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:00.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:00 gibba020 bash[25448]: cluster 2021-03-10T16:26:59.161437+0000 mgr.gibba020.yqfnwy (mgr.34427) 8128 : cluster [DBG] pgmap v4628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:00.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:00 gibba020 bash[25448]: audit 2021-03-10T16:26:59.381863+0000 mgr.gibba020.yqfnwy (mgr.34427) 8129 : audit [DBG] from='client.59488 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:27:00.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:00 gibba020 bash[25448]: audit 2021-03-10T16:26:59.606807+0000 mgr.gibba020.yqfnwy (mgr.34427) 8130 : audit [DBG] from='client.49512 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:27:00.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:00 gibba020 bash[25448]: audit 2021-03-10T16:26:59.864031+0000 mon.a (mon.0) 3008 : audit [DBG] from='client.? 172.21.2.113:0/3650027865' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:02.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:02 gibba013 bash[29418]: cluster 2021-03-10T16:27:01.163166+0000 mgr.gibba020.yqfnwy (mgr.34427) 8131 : cluster [DBG] pgmap v4629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:02.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:02 gibba013 bash[30381]: cluster 2021-03-10T16:27:01.163166+0000 mgr.gibba020.yqfnwy (mgr.34427) 8131 : cluster [DBG] pgmap v4629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:02.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:02 gibba020 bash[25448]: cluster 2021-03-10T16:27:01.163166+0000 mgr.gibba020.yqfnwy (mgr.34427) 8131 : cluster [DBG] pgmap v4629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:04.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:04 gibba013 bash[29418]: cluster 2021-03-10T16:27:03.164299+0000 mgr.gibba020.yqfnwy (mgr.34427) 8132 : cluster [DBG] pgmap v4630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:04.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:04 gibba013 bash[30381]: cluster 2021-03-10T16:27:03.164299+0000 mgr.gibba020.yqfnwy (mgr.34427) 8132 : cluster [DBG] pgmap v4630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:04.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:04 gibba020 bash[25448]: cluster 2021-03-10T16:27:03.164299+0000 mgr.gibba020.yqfnwy (mgr.34427) 8132 : cluster [DBG] pgmap v4630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:05.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:05 gibba013 bash[29418]: cephadm 2021-03-10T16:27:03.808309+0000 mgr.gibba020.yqfnwy (mgr.34427) 8133 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:27:05.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:05 gibba013 bash[30381]: cephadm 2021-03-10T16:27:03.808309+0000 mgr.gibba020.yqfnwy (mgr.34427) 8133 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:27:05.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:05 gibba020 bash[25448]: cephadm 2021-03-10T16:27:03.808309+0000 mgr.gibba020.yqfnwy (mgr.34427) 8133 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:27:06.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:06 gibba013 bash[29418]: cluster 2021-03-10T16:27:05.165079+0000 mgr.gibba020.yqfnwy (mgr.34427) 8134 : cluster [DBG] pgmap v4631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:06.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:06 gibba013 bash[30381]: cluster 2021-03-10T16:27:05.165079+0000 mgr.gibba020.yqfnwy (mgr.34427) 8134 : cluster [DBG] pgmap v4631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:06.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:06 gibba020 bash[25448]: cluster 2021-03-10T16:27:05.165079+0000 mgr.gibba020.yqfnwy (mgr.34427) 8134 : cluster [DBG] pgmap v4631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:07.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:07 gibba013 bash[29418]: audit 2021-03-10T16:27:06.701940+0000 mon.a (mon.0) 3009 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:27:07.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:07 gibba013 bash[29418]: audit 2021-03-10T16:27:06.846236+0000 mon.a (mon.0) 3010 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:27:07.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:07 gibba013 bash[29418]: audit 2021-03-10T16:27:07.111422+0000 mon.a (mon.0) 3011 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:27:07.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:07 gibba013 bash[29418]: audit 2021-03-10T16:27:07.112518+0000 mon.a (mon.0) 3012 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:27:07.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:07 gibba013 bash[29418]: audit 2021-03-10T16:27:07.113543+0000 mon.a (mon.0) 3013 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:27:07.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:07 gibba013 bash[29418]: audit 2021-03-10T16:27:07.114546+0000 mon.a (mon.0) 3014 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:27:07.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:07 gibba013 bash[30381]: audit 2021-03-10T16:27:06.701940+0000 mon.a (mon.0) 3009 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:27:07.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:07 gibba013 bash[30381]: audit 2021-03-10T16:27:06.846236+0000 mon.a (mon.0) 3010 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:27:07.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:07 gibba013 bash[30381]: audit 2021-03-10T16:27:07.111422+0000 mon.a (mon.0) 3011 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:27:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:07 gibba013 bash[30381]: audit 2021-03-10T16:27:07.112518+0000 mon.a (mon.0) 3012 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:27:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:07 gibba013 bash[30381]: audit 2021-03-10T16:27:07.113543+0000 mon.a (mon.0) 3013 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:27:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:07 gibba013 bash[30381]: audit 2021-03-10T16:27:07.114546+0000 mon.a (mon.0) 3014 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:27:07.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:07 gibba020 bash[25448]: audit 2021-03-10T16:27:06.701940+0000 mon.a (mon.0) 3009 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:27:07.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:07 gibba020 bash[25448]: audit 2021-03-10T16:27:06.846236+0000 mon.a (mon.0) 3010 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:27:07.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:07 gibba020 bash[25448]: audit 2021-03-10T16:27:07.111422+0000 mon.a (mon.0) 3011 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:27:07.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:07 gibba020 bash[25448]: audit 2021-03-10T16:27:07.112518+0000 mon.a (mon.0) 3012 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:27:07.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:07 gibba020 bash[25448]: audit 2021-03-10T16:27:07.113543+0000 mon.a (mon.0) 3013 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:27:07.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:07 gibba020 bash[25448]: audit 2021-03-10T16:27:07.114546+0000 mon.a (mon.0) 3014 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:27:08.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:08 gibba013 bash[29418]: cluster 2021-03-10T16:27:07.165916+0000 mgr.gibba020.yqfnwy (mgr.34427) 8135 : cluster [DBG] pgmap v4632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:08.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:08 gibba013 bash[30381]: cluster 2021-03-10T16:27:07.165916+0000 mgr.gibba020.yqfnwy (mgr.34427) 8135 : cluster [DBG] pgmap v4632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:08.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:08 gibba020 bash[25448]: cluster 2021-03-10T16:27:07.165916+0000 mgr.gibba020.yqfnwy (mgr.34427) 8135 : cluster [DBG] pgmap v4632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:10.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:10 gibba013 bash[29418]: cluster 2021-03-10T16:27:09.167605+0000 mgr.gibba020.yqfnwy (mgr.34427) 8136 : cluster [DBG] pgmap v4633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:10.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:10 gibba013 bash[30381]: cluster 2021-03-10T16:27:09.167605+0000 mgr.gibba020.yqfnwy (mgr.34427) 8136 : cluster [DBG] pgmap v4633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:10.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:10 gibba020 bash[25448]: cluster 2021-03-10T16:27:09.167605+0000 mgr.gibba020.yqfnwy (mgr.34427) 8136 : cluster [DBG] pgmap v4633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:12.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:12 gibba020 bash[25448]: cluster 2021-03-10T16:27:11.168436+0000 mgr.gibba020.yqfnwy (mgr.34427) 8137 : cluster [DBG] pgmap v4634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:13.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:12 gibba013 bash[29418]: cluster 2021-03-10T16:27:11.168436+0000 mgr.gibba020.yqfnwy (mgr.34427) 8137 : cluster [DBG] pgmap v4634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:13.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:12 gibba013 bash[30381]: cluster 2021-03-10T16:27:11.168436+0000 mgr.gibba020.yqfnwy (mgr.34427) 8137 : cluster [DBG] pgmap v4634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:14.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:14 gibba020 bash[25448]: cluster 2021-03-10T16:27:13.169528+0000 mgr.gibba020.yqfnwy (mgr.34427) 8138 : cluster [DBG] pgmap v4635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:15.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:14 gibba013 bash[29418]: cluster 2021-03-10T16:27:13.169528+0000 mgr.gibba020.yqfnwy (mgr.34427) 8138 : cluster [DBG] pgmap v4635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:15.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:14 gibba013 bash[30381]: cluster 2021-03-10T16:27:13.169528+0000 mgr.gibba020.yqfnwy (mgr.34427) 8138 : cluster [DBG] pgmap v4635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:16.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:15 gibba013 bash[29418]: cluster 2021-03-10T16:27:15.171447+0000 mgr.gibba020.yqfnwy (mgr.34427) 8139 : cluster [DBG] pgmap v4636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:16.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:15 gibba013 bash[30381]: cluster 2021-03-10T16:27:15.171447+0000 mgr.gibba020.yqfnwy (mgr.34427) 8139 : cluster [DBG] pgmap v4636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:16.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:15 gibba020 bash[25448]: cluster 2021-03-10T16:27:15.171447+0000 mgr.gibba020.yqfnwy (mgr.34427) 8139 : cluster [DBG] pgmap v4636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:18.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:18 gibba013 bash[29418]: cluster 2021-03-10T16:27:17.172194+0000 mgr.gibba020.yqfnwy (mgr.34427) 8140 : cluster [DBG] pgmap v4637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:18.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:18 gibba013 bash[30381]: cluster 2021-03-10T16:27:17.172194+0000 mgr.gibba020.yqfnwy (mgr.34427) 8140 : cluster [DBG] pgmap v4637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:18.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:18 gibba020 bash[25448]: cluster 2021-03-10T16:27:17.172194+0000 mgr.gibba020.yqfnwy (mgr.34427) 8140 : cluster [DBG] pgmap v4637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:20.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:20 gibba013 bash[29418]: cephadm 2021-03-10T16:27:18.822891+0000 mgr.gibba020.yqfnwy (mgr.34427) 8141 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:27:20.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:20 gibba013 bash[29418]: cluster 2021-03-10T16:27:19.173544+0000 mgr.gibba020.yqfnwy (mgr.34427) 8142 : cluster [DBG] pgmap v4638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:20.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:20 gibba013 bash[30381]: cephadm 2021-03-10T16:27:18.822891+0000 mgr.gibba020.yqfnwy (mgr.34427) 8141 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:27:20.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:20 gibba013 bash[30381]: cluster 2021-03-10T16:27:19.173544+0000 mgr.gibba020.yqfnwy (mgr.34427) 8142 : cluster [DBG] pgmap v4638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:20.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:20 gibba020 bash[25448]: cephadm 2021-03-10T16:27:18.822891+0000 mgr.gibba020.yqfnwy (mgr.34427) 8141 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:27:20.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:20 gibba020 bash[25448]: cluster 2021-03-10T16:27:19.173544+0000 mgr.gibba020.yqfnwy (mgr.34427) 8142 : cluster [DBG] pgmap v4638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:22.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:22 gibba013 bash[29418]: cluster 2021-03-10T16:27:21.175411+0000 mgr.gibba020.yqfnwy (mgr.34427) 8143 : cluster [DBG] pgmap v4639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:22.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:22 gibba013 bash[30381]: cluster 2021-03-10T16:27:21.175411+0000 mgr.gibba020.yqfnwy (mgr.34427) 8143 : cluster [DBG] pgmap v4639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:22.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:22 gibba020 bash[25448]: cluster 2021-03-10T16:27:21.175411+0000 mgr.gibba020.yqfnwy (mgr.34427) 8143 : cluster [DBG] pgmap v4639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:24.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:24 gibba013 bash[29418]: cluster 2021-03-10T16:27:23.175880+0000 mgr.gibba020.yqfnwy (mgr.34427) 8144 : cluster [DBG] pgmap v4640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:24.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:24 gibba013 bash[30381]: cluster 2021-03-10T16:27:23.175880+0000 mgr.gibba020.yqfnwy (mgr.34427) 8144 : cluster [DBG] pgmap v4640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:24.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:24 gibba020 bash[25448]: cluster 2021-03-10T16:27:23.175880+0000 mgr.gibba020.yqfnwy (mgr.34427) 8144 : cluster [DBG] pgmap v4640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:26.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:26 gibba013 bash[29418]: cluster 2021-03-10T16:27:25.177593+0000 mgr.gibba020.yqfnwy (mgr.34427) 8145 : cluster [DBG] pgmap v4641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:26.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:26 gibba013 bash[30381]: cluster 2021-03-10T16:27:25.177593+0000 mgr.gibba020.yqfnwy (mgr.34427) 8145 : cluster [DBG] pgmap v4641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:26.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:26 gibba020 bash[25448]: cluster 2021-03-10T16:27:25.177593+0000 mgr.gibba020.yqfnwy (mgr.34427) 8145 : cluster [DBG] pgmap v4641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:28.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:28 gibba013 bash[29418]: cluster 2021-03-10T16:27:27.178675+0000 mgr.gibba020.yqfnwy (mgr.34427) 8146 : cluster [DBG] pgmap v4642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:28.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:28 gibba013 bash[30381]: cluster 2021-03-10T16:27:27.178675+0000 mgr.gibba020.yqfnwy (mgr.34427) 8146 : cluster [DBG] pgmap v4642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:28.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:28 gibba020 bash[25448]: cluster 2021-03-10T16:27:27.178675+0000 mgr.gibba020.yqfnwy (mgr.34427) 8146 : cluster [DBG] pgmap v4642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:30.107 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:27:30.337 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:27:30.338 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 7m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:27:30.338 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 6m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:27:30.338 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:27:30.338 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:27:30.339 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:27:30.339 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:27:30.339 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:27:30.339 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:27:30.339 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:27:30.340 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:27:30.340 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:27:30.340 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:27:30.340 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:27:30.341 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:27:30.341 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:27:30.341 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:27:30.341 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:27:30.341 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:27:30.342 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 6m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:27:30.342 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 6m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:27:30.584 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:27:30.585 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:27:30.585 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:27:30.585 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:27:30.585 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:27:30.586 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:27:30.586 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:27:30.586 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:27:30.586 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:27:30.587 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:27:30.587 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:27:30.587 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:27:30.587 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:27:30.587 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:27:30.588 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:27:30.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:30 gibba013 bash[29418]: cluster 2021-03-10T16:27:29.179323+0000 mgr.gibba020.yqfnwy (mgr.34427) 8147 : cluster [DBG] pgmap v4643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:30.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:30 gibba013 bash[30381]: cluster 2021-03-10T16:27:29.179323+0000 mgr.gibba020.yqfnwy (mgr.34427) 8147 : cluster [DBG] pgmap v4643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:30.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:30 gibba020 bash[25448]: cluster 2021-03-10T16:27:29.179323+0000 mgr.gibba020.yqfnwy (mgr.34427) 8147 : cluster [DBG] pgmap v4643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:31.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:31 gibba013 bash[29418]: audit 2021-03-10T16:27:30.098425+0000 mgr.gibba020.yqfnwy (mgr.34427) 8148 : audit [DBG] from='client.49524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:27:31.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:31 gibba013 bash[29418]: audit 2021-03-10T16:27:30.325627+0000 mgr.gibba020.yqfnwy (mgr.34427) 8149 : audit [DBG] from='client.49530 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:27:31.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:31 gibba013 bash[29418]: audit 2021-03-10T16:27:30.585765+0000 mon.c (mon.1) 131 : audit [DBG] from='client.? 172.21.2.113:0/1629666802' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:31.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:31 gibba013 bash[30381]: audit 2021-03-10T16:27:30.098425+0000 mgr.gibba020.yqfnwy (mgr.34427) 8148 : audit [DBG] from='client.49524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:27:31.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:31 gibba013 bash[30381]: audit 2021-03-10T16:27:30.325627+0000 mgr.gibba020.yqfnwy (mgr.34427) 8149 : audit [DBG] from='client.49530 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:27:31.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:31 gibba013 bash[30381]: audit 2021-03-10T16:27:30.585765+0000 mon.c (mon.1) 131 : audit [DBG] from='client.? 172.21.2.113:0/1629666802' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:31.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:31 gibba020 bash[25448]: audit 2021-03-10T16:27:30.098425+0000 mgr.gibba020.yqfnwy (mgr.34427) 8148 : audit [DBG] from='client.49524 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:27:31.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:31 gibba020 bash[25448]: audit 2021-03-10T16:27:30.325627+0000 mgr.gibba020.yqfnwy (mgr.34427) 8149 : audit [DBG] from='client.49530 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:27:31.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:31 gibba020 bash[25448]: audit 2021-03-10T16:27:30.585765+0000 mon.c (mon.1) 131 : audit [DBG] from='client.? 172.21.2.113:0/1629666802' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:32.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:32 gibba013 bash[29418]: cluster 2021-03-10T16:27:31.180797+0000 mgr.gibba020.yqfnwy (mgr.34427) 8150 : cluster [DBG] pgmap v4644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:32.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:32 gibba013 bash[30381]: cluster 2021-03-10T16:27:31.180797+0000 mgr.gibba020.yqfnwy (mgr.34427) 8150 : cluster [DBG] pgmap v4644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:32.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:32 gibba020 bash[25448]: cluster 2021-03-10T16:27:31.180797+0000 mgr.gibba020.yqfnwy (mgr.34427) 8150 : cluster [DBG] pgmap v4644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:34.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:34 gibba013 bash[29418]: cluster 2021-03-10T16:27:33.181990+0000 mgr.gibba020.yqfnwy (mgr.34427) 8151 : cluster [DBG] pgmap v4645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:34.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:34 gibba013 bash[29418]: audit 2021-03-10T16:27:33.840550+0000 mon.a (mon.0) 3015 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:27:34.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:34 gibba013 bash[29418]: audit 2021-03-10T16:27:34.037830+0000 mon.a (mon.0) 3016 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:27:34.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:34 gibba013 bash[29418]: audit 2021-03-10T16:27:34.040812+0000 mon.a (mon.0) 3017 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:27:34.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:34 gibba013 bash[29418]: audit 2021-03-10T16:27:34.223964+0000 mon.a (mon.0) 3018 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:27:34.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:34 gibba013 bash[29418]: audit 2021-03-10T16:27:34.227193+0000 mon.a (mon.0) 3019 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:27:34.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:34 gibba013 bash[29418]: audit 2021-03-10T16:27:34.229118+0000 mon.a (mon.0) 3020 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:34.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:34 gibba013 bash[29418]: audit 2021-03-10T16:27:34.231032+0000 mon.a (mon.0) 3021 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:34.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:34 gibba013 bash[29418]: audit 2021-03-10T16:27:34.232526+0000 mon.a (mon.0) 3022 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:34.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:34 gibba013 bash[29418]: audit 2021-03-10T16:27:34.240487+0000 mon.a (mon.0) 3023 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:34.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:34 gibba013 bash[29418]: audit 2021-03-10T16:27:34.241903+0000 mon.a (mon.0) 3024 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:34.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:34 gibba013 bash[30381]: cluster 2021-03-10T16:27:33.181990+0000 mgr.gibba020.yqfnwy (mgr.34427) 8151 : cluster [DBG] pgmap v4645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:34.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:34 gibba013 bash[30381]: audit 2021-03-10T16:27:33.840550+0000 mon.a (mon.0) 3015 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:27:34.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:34 gibba013 bash[30381]: audit 2021-03-10T16:27:34.037830+0000 mon.a (mon.0) 3016 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:27:34.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:34 gibba013 bash[30381]: audit 2021-03-10T16:27:34.040812+0000 mon.a (mon.0) 3017 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:27:34.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:34 gibba013 bash[30381]: audit 2021-03-10T16:27:34.223964+0000 mon.a (mon.0) 3018 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:27:34.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:34 gibba013 bash[30381]: audit 2021-03-10T16:27:34.227193+0000 mon.a (mon.0) 3019 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:27:34.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:34 gibba013 bash[30381]: audit 2021-03-10T16:27:34.229118+0000 mon.a (mon.0) 3020 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:34.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:34 gibba013 bash[30381]: audit 2021-03-10T16:27:34.231032+0000 mon.a (mon.0) 3021 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:34.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:34 gibba013 bash[30381]: audit 2021-03-10T16:27:34.232526+0000 mon.a (mon.0) 3022 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:34.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:34 gibba013 bash[30381]: audit 2021-03-10T16:27:34.240487+0000 mon.a (mon.0) 3023 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:34.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:34 gibba013 bash[30381]: audit 2021-03-10T16:27:34.241903+0000 mon.a (mon.0) 3024 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:34.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:34 gibba020 bash[25448]: cluster 2021-03-10T16:27:33.181990+0000 mgr.gibba020.yqfnwy (mgr.34427) 8151 : cluster [DBG] pgmap v4645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:34.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:34 gibba020 bash[25448]: audit 2021-03-10T16:27:33.840550+0000 mon.a (mon.0) 3015 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:27:34.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:34 gibba020 bash[25448]: audit 2021-03-10T16:27:34.037830+0000 mon.a (mon.0) 3016 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:27:34.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:34 gibba020 bash[25448]: audit 2021-03-10T16:27:34.040812+0000 mon.a (mon.0) 3017 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:27:34.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:34 gibba020 bash[25448]: audit 2021-03-10T16:27:34.223964+0000 mon.a (mon.0) 3018 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:27:34.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:34 gibba020 bash[25448]: audit 2021-03-10T16:27:34.227193+0000 mon.a (mon.0) 3019 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:27:34.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:34 gibba020 bash[25448]: audit 2021-03-10T16:27:34.229118+0000 mon.a (mon.0) 3020 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:34.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:34 gibba020 bash[25448]: audit 2021-03-10T16:27:34.231032+0000 mon.a (mon.0) 3021 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:34.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:34 gibba020 bash[25448]: audit 2021-03-10T16:27:34.232526+0000 mon.a (mon.0) 3022 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:34.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:34 gibba020 bash[25448]: audit 2021-03-10T16:27:34.240487+0000 mon.a (mon.0) 3023 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:34.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:34 gibba020 bash[25448]: audit 2021-03-10T16:27:34.241903+0000 mon.a (mon.0) 3024 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:27:35.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:35 gibba013 bash[29418]: cephadm 2021-03-10T16:27:34.037818+0000 mgr.gibba020.yqfnwy (mgr.34427) 8152 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:27:35.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:35 gibba013 bash[29418]: cephadm 2021-03-10T16:27:34.040975+0000 mgr.gibba020.yqfnwy (mgr.34427) 8153 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:27:35.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:35 gibba013 bash[29418]: cephadm 2021-03-10T16:27:34.225971+0000 mgr.gibba020.yqfnwy (mgr.34427) 8154 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:27:35.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:35 gibba013 bash[29418]: cephadm 2021-03-10T16:27:34.228079+0000 mgr.gibba020.yqfnwy (mgr.34427) 8155 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:27:35.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:35 gibba013 bash[29418]: cephadm 2021-03-10T16:27:34.229738+0000 mgr.gibba020.yqfnwy (mgr.34427) 8156 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:27:35.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:35 gibba013 bash[29418]: cephadm 2021-03-10T16:27:34.229780+0000 mgr.gibba020.yqfnwy (mgr.34427) 8157 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:27:35.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:35 gibba013 bash[29418]: cephadm 2021-03-10T16:27:34.231527+0000 mgr.gibba020.yqfnwy (mgr.34427) 8158 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:27:35.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:35 gibba013 bash[29418]: cephadm 2021-03-10T16:27:34.231567+0000 mgr.gibba020.yqfnwy (mgr.34427) 8159 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:27:35.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:35 gibba013 bash[29418]: cephadm 2021-03-10T16:27:34.233074+0000 mgr.gibba020.yqfnwy (mgr.34427) 8160 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:27:35.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:35 gibba013 bash[29418]: cephadm 2021-03-10T16:27:34.239522+0000 mgr.gibba020.yqfnwy (mgr.34427) 8161 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:27:35.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:35 gibba013 bash[29418]: cephadm 2021-03-10T16:27:34.239561+0000 mgr.gibba020.yqfnwy (mgr.34427) 8162 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:27:35.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:35 gibba013 bash[29418]: cephadm 2021-03-10T16:27:34.240655+0000 mgr.gibba020.yqfnwy (mgr.34427) 8163 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:27:35.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:35 gibba013 bash[29418]: cephadm 2021-03-10T16:27:34.240991+0000 mgr.gibba020.yqfnwy (mgr.34427) 8164 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:27:35.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:35 gibba013 bash[29418]: cephadm 2021-03-10T16:27:34.242264+0000 mgr.gibba020.yqfnwy (mgr.34427) 8165 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:27:35.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:35 gibba013 bash[29418]: cephadm 2021-03-10T16:27:34.242303+0000 mgr.gibba020.yqfnwy (mgr.34427) 8166 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:27:35.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:35 gibba013 bash[29418]: cephadm 2021-03-10T16:27:34.242412+0000 mgr.gibba020.yqfnwy (mgr.34427) 8167 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:27:35.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:35 gibba013 bash[30381]: cephadm 2021-03-10T16:27:34.037818+0000 mgr.gibba020.yqfnwy (mgr.34427) 8152 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:27:35.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:35 gibba013 bash[30381]: cephadm 2021-03-10T16:27:34.040975+0000 mgr.gibba020.yqfnwy (mgr.34427) 8153 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:27:35.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:35 gibba013 bash[30381]: cephadm 2021-03-10T16:27:34.225971+0000 mgr.gibba020.yqfnwy (mgr.34427) 8154 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:27:35.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:35 gibba013 bash[30381]: cephadm 2021-03-10T16:27:34.228079+0000 mgr.gibba020.yqfnwy (mgr.34427) 8155 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:27:35.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:35 gibba013 bash[30381]: cephadm 2021-03-10T16:27:34.229738+0000 mgr.gibba020.yqfnwy (mgr.34427) 8156 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:27:35.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:35 gibba013 bash[30381]: cephadm 2021-03-10T16:27:34.229780+0000 mgr.gibba020.yqfnwy (mgr.34427) 8157 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:27:35.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:35 gibba013 bash[30381]: cephadm 2021-03-10T16:27:34.231527+0000 mgr.gibba020.yqfnwy (mgr.34427) 8158 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:27:35.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:35 gibba013 bash[30381]: cephadm 2021-03-10T16:27:34.231567+0000 mgr.gibba020.yqfnwy (mgr.34427) 8159 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:27:35.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:35 gibba013 bash[30381]: cephadm 2021-03-10T16:27:34.233074+0000 mgr.gibba020.yqfnwy (mgr.34427) 8160 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:27:35.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:35 gibba013 bash[30381]: cephadm 2021-03-10T16:27:34.239522+0000 mgr.gibba020.yqfnwy (mgr.34427) 8161 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:27:35.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:35 gibba013 bash[30381]: cephadm 2021-03-10T16:27:34.239561+0000 mgr.gibba020.yqfnwy (mgr.34427) 8162 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:27:35.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:35 gibba013 bash[30381]: cephadm 2021-03-10T16:27:34.240655+0000 mgr.gibba020.yqfnwy (mgr.34427) 8163 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:27:35.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:35 gibba013 bash[30381]: cephadm 2021-03-10T16:27:34.240991+0000 mgr.gibba020.yqfnwy (mgr.34427) 8164 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:27:35.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:35 gibba013 bash[30381]: cephadm 2021-03-10T16:27:34.242264+0000 mgr.gibba020.yqfnwy (mgr.34427) 8165 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:27:35.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:35 gibba013 bash[30381]: cephadm 2021-03-10T16:27:34.242303+0000 mgr.gibba020.yqfnwy (mgr.34427) 8166 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:27:35.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:35 gibba013 bash[30381]: cephadm 2021-03-10T16:27:34.242412+0000 mgr.gibba020.yqfnwy (mgr.34427) 8167 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:27:35.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:35 gibba020 bash[25448]: cephadm 2021-03-10T16:27:34.037818+0000 mgr.gibba020.yqfnwy (mgr.34427) 8152 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:27:35.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:35 gibba020 bash[25448]: cephadm 2021-03-10T16:27:34.040975+0000 mgr.gibba020.yqfnwy (mgr.34427) 8153 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:27:35.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:35 gibba020 bash[25448]: cephadm 2021-03-10T16:27:34.225971+0000 mgr.gibba020.yqfnwy (mgr.34427) 8154 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:27:35.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:35 gibba020 bash[25448]: cephadm 2021-03-10T16:27:34.228079+0000 mgr.gibba020.yqfnwy (mgr.34427) 8155 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:27:35.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:35 gibba020 bash[25448]: cephadm 2021-03-10T16:27:34.229738+0000 mgr.gibba020.yqfnwy (mgr.34427) 8156 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:27:35.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:35 gibba020 bash[25448]: cephadm 2021-03-10T16:27:34.229780+0000 mgr.gibba020.yqfnwy (mgr.34427) 8157 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:27:35.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:35 gibba020 bash[25448]: cephadm 2021-03-10T16:27:34.231527+0000 mgr.gibba020.yqfnwy (mgr.34427) 8158 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:27:35.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:35 gibba020 bash[25448]: cephadm 2021-03-10T16:27:34.231567+0000 mgr.gibba020.yqfnwy (mgr.34427) 8159 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:27:35.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:35 gibba020 bash[25448]: cephadm 2021-03-10T16:27:34.233074+0000 mgr.gibba020.yqfnwy (mgr.34427) 8160 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:27:35.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:35 gibba020 bash[25448]: cephadm 2021-03-10T16:27:34.239522+0000 mgr.gibba020.yqfnwy (mgr.34427) 8161 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:27:35.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:35 gibba020 bash[25448]: cephadm 2021-03-10T16:27:34.239561+0000 mgr.gibba020.yqfnwy (mgr.34427) 8162 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:27:35.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:35 gibba020 bash[25448]: cephadm 2021-03-10T16:27:34.240655+0000 mgr.gibba020.yqfnwy (mgr.34427) 8163 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:27:35.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:35 gibba020 bash[25448]: cephadm 2021-03-10T16:27:34.240991+0000 mgr.gibba020.yqfnwy (mgr.34427) 8164 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:27:35.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:35 gibba020 bash[25448]: cephadm 2021-03-10T16:27:34.242264+0000 mgr.gibba020.yqfnwy (mgr.34427) 8165 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:27:35.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:35 gibba020 bash[25448]: cephadm 2021-03-10T16:27:34.242303+0000 mgr.gibba020.yqfnwy (mgr.34427) 8166 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:27:35.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:35 gibba020 bash[25448]: cephadm 2021-03-10T16:27:34.242412+0000 mgr.gibba020.yqfnwy (mgr.34427) 8167 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:27:36.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:36 gibba013 bash[29418]: cluster 2021-03-10T16:27:35.182776+0000 mgr.gibba020.yqfnwy (mgr.34427) 8168 : cluster [DBG] pgmap v4646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:36.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:36 gibba013 bash[30381]: cluster 2021-03-10T16:27:35.182776+0000 mgr.gibba020.yqfnwy (mgr.34427) 8168 : cluster [DBG] pgmap v4646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:36.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:36 gibba020 bash[25448]: cluster 2021-03-10T16:27:35.182776+0000 mgr.gibba020.yqfnwy (mgr.34427) 8168 : cluster [DBG] pgmap v4646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:38.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:38 gibba013 bash[29418]: cluster 2021-03-10T16:27:37.183923+0000 mgr.gibba020.yqfnwy (mgr.34427) 8169 : cluster [DBG] pgmap v4647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:38.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:38 gibba013 bash[30381]: cluster 2021-03-10T16:27:37.183923+0000 mgr.gibba020.yqfnwy (mgr.34427) 8169 : cluster [DBG] pgmap v4647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:38.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:38 gibba020 bash[25448]: cluster 2021-03-10T16:27:37.183923+0000 mgr.gibba020.yqfnwy (mgr.34427) 8169 : cluster [DBG] pgmap v4647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:40.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:40 gibba013 bash[29418]: cluster 2021-03-10T16:27:39.185622+0000 mgr.gibba020.yqfnwy (mgr.34427) 8170 : cluster [DBG] pgmap v4648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:40.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:40 gibba013 bash[30381]: cluster 2021-03-10T16:27:39.185622+0000 mgr.gibba020.yqfnwy (mgr.34427) 8170 : cluster [DBG] pgmap v4648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:40.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:40 gibba020 bash[25448]: cluster 2021-03-10T16:27:39.185622+0000 mgr.gibba020.yqfnwy (mgr.34427) 8170 : cluster [DBG] pgmap v4648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:42.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:42 gibba013 bash[29418]: cluster 2021-03-10T16:27:41.186523+0000 mgr.gibba020.yqfnwy (mgr.34427) 8171 : cluster [DBG] pgmap v4649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:42.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:42 gibba013 bash[30381]: cluster 2021-03-10T16:27:41.186523+0000 mgr.gibba020.yqfnwy (mgr.34427) 8171 : cluster [DBG] pgmap v4649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:42.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:42 gibba020 bash[25448]: cluster 2021-03-10T16:27:41.186523+0000 mgr.gibba020.yqfnwy (mgr.34427) 8171 : cluster [DBG] pgmap v4649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:44.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:44 gibba013 bash[29418]: cluster 2021-03-10T16:27:43.187705+0000 mgr.gibba020.yqfnwy (mgr.34427) 8172 : cluster [DBG] pgmap v4650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:44.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:44 gibba013 bash[30381]: cluster 2021-03-10T16:27:43.187705+0000 mgr.gibba020.yqfnwy (mgr.34427) 8172 : cluster [DBG] pgmap v4650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:44.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:44 gibba020 bash[25448]: cluster 2021-03-10T16:27:43.187705+0000 mgr.gibba020.yqfnwy (mgr.34427) 8172 : cluster [DBG] pgmap v4650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:46.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:46 gibba013 bash[29418]: cluster 2021-03-10T16:27:45.189505+0000 mgr.gibba020.yqfnwy (mgr.34427) 8173 : cluster [DBG] pgmap v4651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:46.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:46 gibba013 bash[30381]: cluster 2021-03-10T16:27:45.189505+0000 mgr.gibba020.yqfnwy (mgr.34427) 8173 : cluster [DBG] pgmap v4651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:46.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:46 gibba020 bash[25448]: cluster 2021-03-10T16:27:45.189505+0000 mgr.gibba020.yqfnwy (mgr.34427) 8173 : cluster [DBG] pgmap v4651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:48.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:48 gibba020 bash[25448]: cluster 2021-03-10T16:27:47.190230+0000 mgr.gibba020.yqfnwy (mgr.34427) 8174 : cluster [DBG] pgmap v4652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:48.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:48 gibba013 bash[29418]: cluster 2021-03-10T16:27:47.190230+0000 mgr.gibba020.yqfnwy (mgr.34427) 8174 : cluster [DBG] pgmap v4652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:48.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:48 gibba013 bash[30381]: cluster 2021-03-10T16:27:47.190230+0000 mgr.gibba020.yqfnwy (mgr.34427) 8174 : cluster [DBG] pgmap v4652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:50.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:50 gibba020 bash[25448]: cluster 2021-03-10T16:27:49.191757+0000 mgr.gibba020.yqfnwy (mgr.34427) 8175 : cluster [DBG] pgmap v4653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:50.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:50 gibba020 bash[25448]: cephadm 2021-03-10T16:27:49.256458+0000 mgr.gibba020.yqfnwy (mgr.34427) 8176 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:27:50.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:50 gibba013 bash[29418]: cluster 2021-03-10T16:27:49.191757+0000 mgr.gibba020.yqfnwy (mgr.34427) 8175 : cluster [DBG] pgmap v4653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:50.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:50 gibba013 bash[29418]: cephadm 2021-03-10T16:27:49.256458+0000 mgr.gibba020.yqfnwy (mgr.34427) 8176 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:27:50.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:50 gibba013 bash[30381]: cluster 2021-03-10T16:27:49.191757+0000 mgr.gibba020.yqfnwy (mgr.34427) 8175 : cluster [DBG] pgmap v4653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:50.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:50 gibba013 bash[30381]: cephadm 2021-03-10T16:27:49.256458+0000 mgr.gibba020.yqfnwy (mgr.34427) 8176 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:27:52.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:52 gibba020 bash[25448]: cluster 2021-03-10T16:27:51.193301+0000 mgr.gibba020.yqfnwy (mgr.34427) 8177 : cluster [DBG] pgmap v4654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:52.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:52 gibba013 bash[29418]: cluster 2021-03-10T16:27:51.193301+0000 mgr.gibba020.yqfnwy (mgr.34427) 8177 : cluster [DBG] pgmap v4654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:52.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:52 gibba013 bash[30381]: cluster 2021-03-10T16:27:51.193301+0000 mgr.gibba020.yqfnwy (mgr.34427) 8177 : cluster [DBG] pgmap v4654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:54.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:54 gibba020 bash[25448]: cluster 2021-03-10T16:27:53.194554+0000 mgr.gibba020.yqfnwy (mgr.34427) 8178 : cluster [DBG] pgmap v4655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:54.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:54 gibba013 bash[29418]: cluster 2021-03-10T16:27:53.194554+0000 mgr.gibba020.yqfnwy (mgr.34427) 8178 : cluster [DBG] pgmap v4655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:54.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:54 gibba013 bash[30381]: cluster 2021-03-10T16:27:53.194554+0000 mgr.gibba020.yqfnwy (mgr.34427) 8178 : cluster [DBG] pgmap v4655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:56.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:56 gibba020 bash[25448]: cluster 2021-03-10T16:27:55.196442+0000 mgr.gibba020.yqfnwy (mgr.34427) 8179 : cluster [DBG] pgmap v4656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:56.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:56 gibba013 bash[29418]: cluster 2021-03-10T16:27:55.196442+0000 mgr.gibba020.yqfnwy (mgr.34427) 8179 : cluster [DBG] pgmap v4656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:56.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:56 gibba013 bash[30381]: cluster 2021-03-10T16:27:55.196442+0000 mgr.gibba020.yqfnwy (mgr.34427) 8179 : cluster [DBG] pgmap v4656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:58.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:27:58 gibba020 bash[25448]: cluster 2021-03-10T16:27:57.197819+0000 mgr.gibba020.yqfnwy (mgr.34427) 8180 : cluster [DBG] pgmap v4657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:58.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:27:58 gibba013 bash[29418]: cluster 2021-03-10T16:27:57.197819+0000 mgr.gibba020.yqfnwy (mgr.34427) 8180 : cluster [DBG] pgmap v4657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:27:58.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:27:58 gibba013 bash[30381]: cluster 2021-03-10T16:27:57.197819+0000 mgr.gibba020.yqfnwy (mgr.34427) 8180 : cluster [DBG] pgmap v4657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:00.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:00 gibba020 bash[25448]: cluster 2021-03-10T16:27:59.199465+0000 mgr.gibba020.yqfnwy (mgr.34427) 8181 : cluster [DBG] pgmap v4658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:00.829 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:28:00.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:00 gibba013 bash[29418]: cluster 2021-03-10T16:27:59.199465+0000 mgr.gibba020.yqfnwy (mgr.34427) 8181 : cluster [DBG] pgmap v4658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:00.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:00 gibba013 bash[30381]: cluster 2021-03-10T16:27:59.199465+0000 mgr.gibba020.yqfnwy (mgr.34427) 8181 : cluster [DBG] pgmap v4658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:01.058 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:28:01.059 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 7m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:28:01.059 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 6m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:28:01.059 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:28:01.059 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:28:01.060 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:28:01.060 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:28:01.060 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:28:01.060 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:28:01.061 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:28:01.061 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:28:01.061 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:28:01.061 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:28:01.061 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:28:01.062 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:28:01.062 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:28:01.062 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:28:01.062 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:28:01.063 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:28:01.063 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 6m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:28:01.063 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 6m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:28:01.308 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:28:01.308 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:28:01.309 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:28:01.309 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:28:01.309 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:28:01.309 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:28:01.310 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:28:01.310 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:28:01.310 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:28:01.310 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:28:01.311 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:28:01.311 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:28:01.311 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:28:01.311 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:28:01.312 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:28:01.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:01 gibba020 bash[25448]: audit 2021-03-10T16:28:01.309618+0000 mon.a (mon.0) 3025 : audit [DBG] from='client.? 172.21.2.113:0/468222526' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:01.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:01 gibba013 bash[29418]: audit 2021-03-10T16:28:01.309618+0000 mon.a (mon.0) 3025 : audit [DBG] from='client.? 172.21.2.113:0/468222526' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:01.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:01 gibba013 bash[30381]: audit 2021-03-10T16:28:01.309618+0000 mon.a (mon.0) 3025 : audit [DBG] from='client.? 172.21.2.113:0/468222526' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:02.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:02 gibba013 bash[29418]: audit 2021-03-10T16:28:00.820167+0000 mgr.gibba020.yqfnwy (mgr.34427) 8182 : audit [DBG] from='client.49542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:28:02.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:02 gibba013 bash[29418]: audit 2021-03-10T16:28:01.047352+0000 mgr.gibba020.yqfnwy (mgr.34427) 8183 : audit [DBG] from='client.49548 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:28:02.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:02 gibba013 bash[29418]: cluster 2021-03-10T16:28:01.201202+0000 mgr.gibba020.yqfnwy (mgr.34427) 8184 : cluster [DBG] pgmap v4659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:02.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:02 gibba013 bash[30381]: audit 2021-03-10T16:28:00.820167+0000 mgr.gibba020.yqfnwy (mgr.34427) 8182 : audit [DBG] from='client.49542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:28:02.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:02 gibba013 bash[30381]: audit 2021-03-10T16:28:01.047352+0000 mgr.gibba020.yqfnwy (mgr.34427) 8183 : audit [DBG] from='client.49548 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:28:02.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:02 gibba013 bash[30381]: cluster 2021-03-10T16:28:01.201202+0000 mgr.gibba020.yqfnwy (mgr.34427) 8184 : cluster [DBG] pgmap v4659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:02.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:02 gibba020 bash[25448]: audit 2021-03-10T16:28:00.820167+0000 mgr.gibba020.yqfnwy (mgr.34427) 8182 : audit [DBG] from='client.49542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:28:02.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:02 gibba020 bash[25448]: audit 2021-03-10T16:28:01.047352+0000 mgr.gibba020.yqfnwy (mgr.34427) 8183 : audit [DBG] from='client.49548 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:28:02.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:02 gibba020 bash[25448]: cluster 2021-03-10T16:28:01.201202+0000 mgr.gibba020.yqfnwy (mgr.34427) 8184 : cluster [DBG] pgmap v4659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:04.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:04 gibba020 bash[25448]: cluster 2021-03-10T16:28:03.202468+0000 mgr.gibba020.yqfnwy (mgr.34427) 8185 : cluster [DBG] pgmap v4660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:04.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:04 gibba013 bash[29418]: cluster 2021-03-10T16:28:03.202468+0000 mgr.gibba020.yqfnwy (mgr.34427) 8185 : cluster [DBG] pgmap v4660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:04.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:04 gibba013 bash[30381]: cluster 2021-03-10T16:28:03.202468+0000 mgr.gibba020.yqfnwy (mgr.34427) 8185 : cluster [DBG] pgmap v4660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:05.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:05 gibba013 bash[29418]: cephadm 2021-03-10T16:28:04.272072+0000 mgr.gibba020.yqfnwy (mgr.34427) 8186 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:28:05.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:05 gibba013 bash[30381]: cephadm 2021-03-10T16:28:04.272072+0000 mgr.gibba020.yqfnwy (mgr.34427) 8186 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:28:05.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:05 gibba020 bash[25448]: cephadm 2021-03-10T16:28:04.272072+0000 mgr.gibba020.yqfnwy (mgr.34427) 8186 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:28:06.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:06 gibba013 bash[29418]: cluster 2021-03-10T16:28:05.203495+0000 mgr.gibba020.yqfnwy (mgr.34427) 8187 : cluster [DBG] pgmap v4661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:06.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:06 gibba013 bash[30381]: cluster 2021-03-10T16:28:05.203495+0000 mgr.gibba020.yqfnwy (mgr.34427) 8187 : cluster [DBG] pgmap v4661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:06.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:06 gibba020 bash[25448]: cluster 2021-03-10T16:28:05.203495+0000 mgr.gibba020.yqfnwy (mgr.34427) 8187 : cluster [DBG] pgmap v4661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:07.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:07 gibba013 bash[29418]: audit 2021-03-10T16:28:06.705403+0000 mon.a (mon.0) 3026 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:28:07.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:07 gibba013 bash[29418]: audit 2021-03-10T16:28:06.852852+0000 mon.a (mon.0) 3027 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:28:07.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:07 gibba013 bash[29418]: audit 2021-03-10T16:28:07.122945+0000 mon.a (mon.0) 3028 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T16:28:07.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:07 gibba013 bash[29418]: audit 2021-03-10T16:28:07.123662+0000 mon.a (mon.0) 3029 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:28:07.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:07 gibba013 bash[29418]: audit 2021-03-10T16:28:07.124296+0000 mon.a (mon.0) 3030 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:28:07.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:07 gibba013 bash[29418]: audit 2021-03-10T16:28:07.125002+0000 mon.a (mon.0) 3031 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T16:28:07.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:07 gibba013 bash[30381]: audit 2021-03-10T16:28:06.705403+0000 mon.a (mon.0) 3026 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:28:07.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:07 gibba013 bash[30381]: audit 2021-03-10T16:28:06.852852+0000 mon.a (mon.0) 3027 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:28:07.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:07 gibba013 bash[30381]: audit 2021-03-10T16:28:07.122945+0000 mon.a (mon.0) 3028 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T16:28:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:07 gibba013 bash[30381]: audit 2021-03-10T16:28:07.123662+0000 mon.a (mon.0) 3029 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:28:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:07 gibba013 bash[30381]: audit 2021-03-10T16:28:07.124296+0000 mon.a (mon.0) 3030 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:28:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:07 gibba013 bash[30381]: audit 2021-03-10T16:28:07.125002+0000 mon.a (mon.0) 3031 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T16:28:07.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:07 gibba020 bash[25448]: audit 2021-03-10T16:28:06.705403+0000 mon.a (mon.0) 3026 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:28:07.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:07 gibba020 bash[25448]: audit 2021-03-10T16:28:06.852852+0000 mon.a (mon.0) 3027 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:28:07.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:07 gibba020 bash[25448]: audit 2021-03-10T16:28:07.122945+0000 mon.a (mon.0) 3028 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T16:28:07.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:07 gibba020 bash[25448]: audit 2021-03-10T16:28:07.123662+0000 mon.a (mon.0) 3029 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:28:07.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:07 gibba020 bash[25448]: audit 2021-03-10T16:28:07.124296+0000 mon.a (mon.0) 3030 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:28:07.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:07 gibba020 bash[25448]: audit 2021-03-10T16:28:07.125002+0000 mon.a (mon.0) 3031 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T16:28:08.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:08 gibba013 bash[29418]: cluster 2021-03-10T16:28:07.204814+0000 mgr.gibba020.yqfnwy (mgr.34427) 8188 : cluster [DBG] pgmap v4662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:08.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:08 gibba013 bash[30381]: cluster 2021-03-10T16:28:07.204814+0000 mgr.gibba020.yqfnwy (mgr.34427) 8188 : cluster [DBG] pgmap v4662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:08.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:08 gibba020 bash[25448]: cluster 2021-03-10T16:28:07.204814+0000 mgr.gibba020.yqfnwy (mgr.34427) 8188 : cluster [DBG] pgmap v4662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:10.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:10 gibba013 bash[29418]: cluster 2021-03-10T16:28:09.206419+0000 mgr.gibba020.yqfnwy (mgr.34427) 8189 : cluster [DBG] pgmap v4663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:10.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:10 gibba013 bash[30381]: cluster 2021-03-10T16:28:09.206419+0000 mgr.gibba020.yqfnwy (mgr.34427) 8189 : cluster [DBG] pgmap v4663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:10.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:10 gibba020 bash[25448]: cluster 2021-03-10T16:28:09.206419+0000 mgr.gibba020.yqfnwy (mgr.34427) 8189 : cluster [DBG] pgmap v4663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:12.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:12 gibba013 bash[29418]: cluster 2021-03-10T16:28:11.207519+0000 mgr.gibba020.yqfnwy (mgr.34427) 8190 : cluster [DBG] pgmap v4664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:12.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:12 gibba013 bash[30381]: cluster 2021-03-10T16:28:11.207519+0000 mgr.gibba020.yqfnwy (mgr.34427) 8190 : cluster [DBG] pgmap v4664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:12.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:12 gibba020 bash[25448]: cluster 2021-03-10T16:28:11.207519+0000 mgr.gibba020.yqfnwy (mgr.34427) 8190 : cluster [DBG] pgmap v4664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:14.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:14 gibba013 bash[29418]: cluster 2021-03-10T16:28:13.208872+0000 mgr.gibba020.yqfnwy (mgr.34427) 8191 : cluster [DBG] pgmap v4665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:14.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:14 gibba013 bash[30381]: cluster 2021-03-10T16:28:13.208872+0000 mgr.gibba020.yqfnwy (mgr.34427) 8191 : cluster [DBG] pgmap v4665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:14.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:14 gibba020 bash[25448]: cluster 2021-03-10T16:28:13.208872+0000 mgr.gibba020.yqfnwy (mgr.34427) 8191 : cluster [DBG] pgmap v4665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:16.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:16 gibba013 bash[29418]: cluster 2021-03-10T16:28:15.210468+0000 mgr.gibba020.yqfnwy (mgr.34427) 8192 : cluster [DBG] pgmap v4666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:16.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:16 gibba013 bash[30381]: cluster 2021-03-10T16:28:15.210468+0000 mgr.gibba020.yqfnwy (mgr.34427) 8192 : cluster [DBG] pgmap v4666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:16.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:16 gibba020 bash[25448]: cluster 2021-03-10T16:28:15.210468+0000 mgr.gibba020.yqfnwy (mgr.34427) 8192 : cluster [DBG] pgmap v4666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:18.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:18 gibba013 bash[29418]: cluster 2021-03-10T16:28:17.211055+0000 mgr.gibba020.yqfnwy (mgr.34427) 8193 : cluster [DBG] pgmap v4667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:18.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:18 gibba013 bash[30381]: cluster 2021-03-10T16:28:17.211055+0000 mgr.gibba020.yqfnwy (mgr.34427) 8193 : cluster [DBG] pgmap v4667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:18.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:18 gibba020 bash[25448]: cluster 2021-03-10T16:28:17.211055+0000 mgr.gibba020.yqfnwy (mgr.34427) 8193 : cluster [DBG] pgmap v4667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:20.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:20 gibba013 bash[29418]: cluster 2021-03-10T16:28:19.212372+0000 mgr.gibba020.yqfnwy (mgr.34427) 8194 : cluster [DBG] pgmap v4668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:20.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:20 gibba013 bash[29418]: cephadm 2021-03-10T16:28:19.287665+0000 mgr.gibba020.yqfnwy (mgr.34427) 8195 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:28:20.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:20 gibba013 bash[30381]: cluster 2021-03-10T16:28:19.212372+0000 mgr.gibba020.yqfnwy (mgr.34427) 8194 : cluster [DBG] pgmap v4668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:20.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:20 gibba013 bash[30381]: cephadm 2021-03-10T16:28:19.287665+0000 mgr.gibba020.yqfnwy (mgr.34427) 8195 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:28:20.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:20 gibba020 bash[25448]: cluster 2021-03-10T16:28:19.212372+0000 mgr.gibba020.yqfnwy (mgr.34427) 8194 : cluster [DBG] pgmap v4668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:20.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:20 gibba020 bash[25448]: cephadm 2021-03-10T16:28:19.287665+0000 mgr.gibba020.yqfnwy (mgr.34427) 8195 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:28:22.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:22 gibba013 bash[29418]: cluster 2021-03-10T16:28:21.213953+0000 mgr.gibba020.yqfnwy (mgr.34427) 8196 : cluster [DBG] pgmap v4669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:22.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:22 gibba013 bash[30381]: cluster 2021-03-10T16:28:21.213953+0000 mgr.gibba020.yqfnwy (mgr.34427) 8196 : cluster [DBG] pgmap v4669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:22.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:22 gibba020 bash[25448]: cluster 2021-03-10T16:28:21.213953+0000 mgr.gibba020.yqfnwy (mgr.34427) 8196 : cluster [DBG] pgmap v4669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:24.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:24 gibba013 bash[29418]: cluster 2021-03-10T16:28:23.215356+0000 mgr.gibba020.yqfnwy (mgr.34427) 8197 : cluster [DBG] pgmap v4670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:24.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:24 gibba013 bash[30381]: cluster 2021-03-10T16:28:23.215356+0000 mgr.gibba020.yqfnwy (mgr.34427) 8197 : cluster [DBG] pgmap v4670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:24.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:24 gibba020 bash[25448]: cluster 2021-03-10T16:28:23.215356+0000 mgr.gibba020.yqfnwy (mgr.34427) 8197 : cluster [DBG] pgmap v4670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:26.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:26 gibba013 bash[29418]: cluster 2021-03-10T16:28:25.216977+0000 mgr.gibba020.yqfnwy (mgr.34427) 8198 : cluster [DBG] pgmap v4671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:26.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:26 gibba013 bash[30381]: cluster 2021-03-10T16:28:25.216977+0000 mgr.gibba020.yqfnwy (mgr.34427) 8198 : cluster [DBG] pgmap v4671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:26.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:26 gibba020 bash[25448]: cluster 2021-03-10T16:28:25.216977+0000 mgr.gibba020.yqfnwy (mgr.34427) 8198 : cluster [DBG] pgmap v4671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:28.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:28 gibba013 bash[29418]: cluster 2021-03-10T16:28:27.218232+0000 mgr.gibba020.yqfnwy (mgr.34427) 8199 : cluster [DBG] pgmap v4672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:28.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:28 gibba013 bash[30381]: cluster 2021-03-10T16:28:27.218232+0000 mgr.gibba020.yqfnwy (mgr.34427) 8199 : cluster [DBG] pgmap v4672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:28.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:28 gibba020 bash[25448]: cluster 2021-03-10T16:28:27.218232+0000 mgr.gibba020.yqfnwy (mgr.34427) 8199 : cluster [DBG] pgmap v4672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:30.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:30 gibba013 bash[29418]: cluster 2021-03-10T16:28:29.219260+0000 mgr.gibba020.yqfnwy (mgr.34427) 8200 : cluster [DBG] pgmap v4673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:30.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:30 gibba013 bash[30381]: cluster 2021-03-10T16:28:29.219260+0000 mgr.gibba020.yqfnwy (mgr.34427) 8200 : cluster [DBG] pgmap v4673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:30.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:30 gibba020 bash[25448]: cluster 2021-03-10T16:28:29.219260+0000 mgr.gibba020.yqfnwy (mgr.34427) 8200 : cluster [DBG] pgmap v4673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:31.553 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:28:31.787 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:28:31.788 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 8m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:28:31.788 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 7m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:28:31.788 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:28:31.788 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:28:31.789 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:28:31.789 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:28:31.789 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:28:31.789 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:28:31.789 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:28:31.790 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:28:31.790 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:28:31.790 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:28:31.790 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:28:31.791 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:28:31.791 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:28:31.791 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:28:31.791 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:28:31.792 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:28:31.792 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 7m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:28:31.792 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 7m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:28:32.037 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:28:32.037 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:28:32.037 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:28:32.038 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:28:32.038 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:28:32.038 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:28:32.038 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:28:32.039 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:28:32.039 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:28:32.039 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:28:32.039 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:28:32.040 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:28:32.040 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:28:32.040 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:28:32.040 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:28:32.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:32 gibba013 bash[29418]: cluster 2021-03-10T16:28:31.220942+0000 mgr.gibba020.yqfnwy (mgr.34427) 8201 : cluster [DBG] pgmap v4674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:32.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:32 gibba013 bash[29418]: audit 2021-03-10T16:28:31.543824+0000 mgr.gibba020.yqfnwy (mgr.34427) 8202 : audit [DBG] from='client.59542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:28:32.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:32 gibba013 bash[29418]: audit 2021-03-10T16:28:32.037935+0000 mon.a (mon.0) 3032 : audit [DBG] from='client.? 172.21.2.113:0/523183161' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:32.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:32 gibba013 bash[30381]: cluster 2021-03-10T16:28:31.220942+0000 mgr.gibba020.yqfnwy (mgr.34427) 8201 : cluster [DBG] pgmap v4674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:32.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:32 gibba013 bash[30381]: audit 2021-03-10T16:28:31.543824+0000 mgr.gibba020.yqfnwy (mgr.34427) 8202 : audit [DBG] from='client.59542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:28:32.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:32 gibba013 bash[30381]: audit 2021-03-10T16:28:32.037935+0000 mon.a (mon.0) 3032 : audit [DBG] from='client.? 172.21.2.113:0/523183161' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:32.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:32 gibba020 bash[25448]: cluster 2021-03-10T16:28:31.220942+0000 mgr.gibba020.yqfnwy (mgr.34427) 8201 : cluster [DBG] pgmap v4674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:32.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:32 gibba020 bash[25448]: audit 2021-03-10T16:28:31.543824+0000 mgr.gibba020.yqfnwy (mgr.34427) 8202 : audit [DBG] from='client.59542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:28:32.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:32 gibba020 bash[25448]: audit 2021-03-10T16:28:32.037935+0000 mon.a (mon.0) 3032 : audit [DBG] from='client.? 172.21.2.113:0/523183161' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:33.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:33 gibba013 bash[29418]: audit 2021-03-10T16:28:31.776201+0000 mgr.gibba020.yqfnwy (mgr.34427) 8203 : audit [DBG] from='client.59548 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:28:33.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:33 gibba013 bash[30381]: audit 2021-03-10T16:28:31.776201+0000 mgr.gibba020.yqfnwy (mgr.34427) 8203 : audit [DBG] from='client.59548 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:28:33.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:33 gibba020 bash[25448]: audit 2021-03-10T16:28:31.776201+0000 mgr.gibba020.yqfnwy (mgr.34427) 8203 : audit [DBG] from='client.59548 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:28:34.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:34 gibba013 bash[29418]: cluster 2021-03-10T16:28:33.222455+0000 mgr.gibba020.yqfnwy (mgr.34427) 8204 : cluster [DBG] pgmap v4675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:34.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:34 gibba013 bash[29418]: audit 2021-03-10T16:28:34.304809+0000 mon.a (mon.0) 3033 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:28:34.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:34 gibba013 bash[29418]: audit 2021-03-10T16:28:34.512636+0000 mon.a (mon.0) 3034 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:28:34.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:34 gibba013 bash[29418]: audit 2021-03-10T16:28:34.516094+0000 mon.a (mon.0) 3035 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:28:34.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:34 gibba013 bash[29418]: audit 2021-03-10T16:28:34.518317+0000 mon.a (mon.0) 3036 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:34.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:34 gibba013 bash[29418]: audit 2021-03-10T16:28:34.520017+0000 mon.a (mon.0) 3037 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:34.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:34 gibba013 bash[29418]: audit 2021-03-10T16:28:34.521908+0000 mon.a (mon.0) 3038 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:34.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:34 gibba013 bash[29418]: audit 2021-03-10T16:28:34.524599+0000 mon.a (mon.0) 3039 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:34.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:34 gibba013 bash[29418]: audit 2021-03-10T16:28:34.526284+0000 mon.a (mon.0) 3040 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:34.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:34 gibba013 bash[30381]: cluster 2021-03-10T16:28:33.222455+0000 mgr.gibba020.yqfnwy (mgr.34427) 8204 : cluster [DBG] pgmap v4675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:34.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:34 gibba013 bash[30381]: audit 2021-03-10T16:28:34.304809+0000 mon.a (mon.0) 3033 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:28:34.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:34 gibba013 bash[30381]: audit 2021-03-10T16:28:34.512636+0000 mon.a (mon.0) 3034 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:28:34.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:34 gibba013 bash[30381]: audit 2021-03-10T16:28:34.516094+0000 mon.a (mon.0) 3035 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:28:34.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:34 gibba013 bash[30381]: audit 2021-03-10T16:28:34.518317+0000 mon.a (mon.0) 3036 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:34.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:34 gibba013 bash[30381]: audit 2021-03-10T16:28:34.520017+0000 mon.a (mon.0) 3037 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:34.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:34 gibba013 bash[30381]: audit 2021-03-10T16:28:34.521908+0000 mon.a (mon.0) 3038 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:34.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:34 gibba013 bash[30381]: audit 2021-03-10T16:28:34.524599+0000 mon.a (mon.0) 3039 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:34.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:34 gibba013 bash[30381]: audit 2021-03-10T16:28:34.526284+0000 mon.a (mon.0) 3040 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:34.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:34 gibba020 bash[25448]: cluster 2021-03-10T16:28:33.222455+0000 mgr.gibba020.yqfnwy (mgr.34427) 8204 : cluster [DBG] pgmap v4675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:34.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:34 gibba020 bash[25448]: audit 2021-03-10T16:28:34.304809+0000 mon.a (mon.0) 3033 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:28:34.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:34 gibba020 bash[25448]: audit 2021-03-10T16:28:34.512636+0000 mon.a (mon.0) 3034 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:28:34.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:34 gibba020 bash[25448]: audit 2021-03-10T16:28:34.516094+0000 mon.a (mon.0) 3035 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:28:34.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:34 gibba020 bash[25448]: audit 2021-03-10T16:28:34.518317+0000 mon.a (mon.0) 3036 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:34.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:34 gibba020 bash[25448]: audit 2021-03-10T16:28:34.520017+0000 mon.a (mon.0) 3037 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:34.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:34 gibba020 bash[25448]: audit 2021-03-10T16:28:34.521908+0000 mon.a (mon.0) 3038 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:34.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:34 gibba020 bash[25448]: audit 2021-03-10T16:28:34.524599+0000 mon.a (mon.0) 3039 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:34.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:34 gibba020 bash[25448]: audit 2021-03-10T16:28:34.526284+0000 mon.a (mon.0) 3040 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:28:35.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:35 gibba013 bash[29418]: cephadm 2021-03-10T16:28:34.308670+0000 mgr.gibba020.yqfnwy (mgr.34427) 8205 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:28:35.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:35 gibba013 bash[29418]: cephadm 2021-03-10T16:28:34.310747+0000 mgr.gibba020.yqfnwy (mgr.34427) 8206 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:28:35.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:35 gibba013 bash[29418]: cephadm 2021-03-10T16:28:34.514864+0000 mgr.gibba020.yqfnwy (mgr.34427) 8207 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:28:35.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:35 gibba013 bash[29418]: cephadm 2021-03-10T16:28:34.517142+0000 mgr.gibba020.yqfnwy (mgr.34427) 8208 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:28:35.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:35 gibba013 bash[29418]: cephadm 2021-03-10T16:28:34.518862+0000 mgr.gibba020.yqfnwy (mgr.34427) 8209 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:28:35.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:35 gibba013 bash[29418]: cephadm 2021-03-10T16:28:34.518899+0000 mgr.gibba020.yqfnwy (mgr.34427) 8210 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:28:35.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:35 gibba013 bash[29418]: cephadm 2021-03-10T16:28:34.520893+0000 mgr.gibba020.yqfnwy (mgr.34427) 8211 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:28:35.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:35 gibba013 bash[29418]: cephadm 2021-03-10T16:28:34.520934+0000 mgr.gibba020.yqfnwy (mgr.34427) 8212 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:28:35.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:35 gibba013 bash[29418]: cephadm 2021-03-10T16:28:34.522477+0000 mgr.gibba020.yqfnwy (mgr.34427) 8213 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:28:35.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:35 gibba013 bash[29418]: cephadm 2021-03-10T16:28:34.523490+0000 mgr.gibba020.yqfnwy (mgr.34427) 8214 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:28:35.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:35 gibba013 bash[29418]: cephadm 2021-03-10T16:28:34.523527+0000 mgr.gibba020.yqfnwy (mgr.34427) 8215 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:28:35.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:35 gibba013 bash[29418]: cephadm 2021-03-10T16:28:34.524958+0000 mgr.gibba020.yqfnwy (mgr.34427) 8216 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:28:35.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:35 gibba013 bash[29418]: cephadm 2021-03-10T16:28:34.525390+0000 mgr.gibba020.yqfnwy (mgr.34427) 8217 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:28:35.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:35 gibba013 bash[29418]: cephadm 2021-03-10T16:28:34.526598+0000 mgr.gibba020.yqfnwy (mgr.34427) 8218 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:28:35.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:35 gibba013 bash[29418]: cephadm 2021-03-10T16:28:34.526637+0000 mgr.gibba020.yqfnwy (mgr.34427) 8219 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:28:35.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:35 gibba013 bash[29418]: cephadm 2021-03-10T16:28:34.526750+0000 mgr.gibba020.yqfnwy (mgr.34427) 8220 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:28:35.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:35 gibba013 bash[30381]: cephadm 2021-03-10T16:28:34.308670+0000 mgr.gibba020.yqfnwy (mgr.34427) 8205 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:28:35.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:35 gibba013 bash[30381]: cephadm 2021-03-10T16:28:34.310747+0000 mgr.gibba020.yqfnwy (mgr.34427) 8206 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:28:35.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:35 gibba013 bash[30381]: cephadm 2021-03-10T16:28:34.514864+0000 mgr.gibba020.yqfnwy (mgr.34427) 8207 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:28:35.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:35 gibba013 bash[30381]: cephadm 2021-03-10T16:28:34.517142+0000 mgr.gibba020.yqfnwy (mgr.34427) 8208 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:28:35.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:35 gibba013 bash[30381]: cephadm 2021-03-10T16:28:34.518862+0000 mgr.gibba020.yqfnwy (mgr.34427) 8209 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:28:35.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:35 gibba013 bash[30381]: cephadm 2021-03-10T16:28:34.518899+0000 mgr.gibba020.yqfnwy (mgr.34427) 8210 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:28:35.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:35 gibba013 bash[30381]: cephadm 2021-03-10T16:28:34.520893+0000 mgr.gibba020.yqfnwy (mgr.34427) 8211 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:28:35.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:35 gibba013 bash[30381]: cephadm 2021-03-10T16:28:34.520934+0000 mgr.gibba020.yqfnwy (mgr.34427) 8212 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:28:35.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:35 gibba013 bash[30381]: cephadm 2021-03-10T16:28:34.522477+0000 mgr.gibba020.yqfnwy (mgr.34427) 8213 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:28:35.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:35 gibba013 bash[30381]: cephadm 2021-03-10T16:28:34.523490+0000 mgr.gibba020.yqfnwy (mgr.34427) 8214 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:28:35.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:35 gibba013 bash[30381]: cephadm 2021-03-10T16:28:34.523527+0000 mgr.gibba020.yqfnwy (mgr.34427) 8215 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:28:35.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:35 gibba013 bash[30381]: cephadm 2021-03-10T16:28:34.524958+0000 mgr.gibba020.yqfnwy (mgr.34427) 8216 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:28:35.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:35 gibba013 bash[30381]: cephadm 2021-03-10T16:28:34.525390+0000 mgr.gibba020.yqfnwy (mgr.34427) 8217 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:28:35.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:35 gibba013 bash[30381]: cephadm 2021-03-10T16:28:34.526598+0000 mgr.gibba020.yqfnwy (mgr.34427) 8218 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:28:35.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:35 gibba013 bash[30381]: cephadm 2021-03-10T16:28:34.526637+0000 mgr.gibba020.yqfnwy (mgr.34427) 8219 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:28:35.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:35 gibba013 bash[30381]: cephadm 2021-03-10T16:28:34.526750+0000 mgr.gibba020.yqfnwy (mgr.34427) 8220 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:28:35.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:35 gibba020 bash[25448]: cephadm 2021-03-10T16:28:34.308670+0000 mgr.gibba020.yqfnwy (mgr.34427) 8205 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:28:35.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:35 gibba020 bash[25448]: cephadm 2021-03-10T16:28:34.310747+0000 mgr.gibba020.yqfnwy (mgr.34427) 8206 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:28:35.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:35 gibba020 bash[25448]: cephadm 2021-03-10T16:28:34.514864+0000 mgr.gibba020.yqfnwy (mgr.34427) 8207 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:28:35.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:35 gibba020 bash[25448]: cephadm 2021-03-10T16:28:34.517142+0000 mgr.gibba020.yqfnwy (mgr.34427) 8208 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:28:35.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:35 gibba020 bash[25448]: cephadm 2021-03-10T16:28:34.518862+0000 mgr.gibba020.yqfnwy (mgr.34427) 8209 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:28:35.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:35 gibba020 bash[25448]: cephadm 2021-03-10T16:28:34.518899+0000 mgr.gibba020.yqfnwy (mgr.34427) 8210 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:28:35.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:35 gibba020 bash[25448]: cephadm 2021-03-10T16:28:34.520893+0000 mgr.gibba020.yqfnwy (mgr.34427) 8211 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:28:35.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:35 gibba020 bash[25448]: cephadm 2021-03-10T16:28:34.520934+0000 mgr.gibba020.yqfnwy (mgr.34427) 8212 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:28:35.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:35 gibba020 bash[25448]: cephadm 2021-03-10T16:28:34.522477+0000 mgr.gibba020.yqfnwy (mgr.34427) 8213 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:28:35.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:35 gibba020 bash[25448]: cephadm 2021-03-10T16:28:34.523490+0000 mgr.gibba020.yqfnwy (mgr.34427) 8214 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:28:35.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:35 gibba020 bash[25448]: cephadm 2021-03-10T16:28:34.523527+0000 mgr.gibba020.yqfnwy (mgr.34427) 8215 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:28:35.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:35 gibba020 bash[25448]: cephadm 2021-03-10T16:28:34.524958+0000 mgr.gibba020.yqfnwy (mgr.34427) 8216 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:28:35.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:35 gibba020 bash[25448]: cephadm 2021-03-10T16:28:34.525390+0000 mgr.gibba020.yqfnwy (mgr.34427) 8217 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:28:35.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:35 gibba020 bash[25448]: cephadm 2021-03-10T16:28:34.526598+0000 mgr.gibba020.yqfnwy (mgr.34427) 8218 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:28:35.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:35 gibba020 bash[25448]: cephadm 2021-03-10T16:28:34.526637+0000 mgr.gibba020.yqfnwy (mgr.34427) 8219 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:28:35.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:35 gibba020 bash[25448]: cephadm 2021-03-10T16:28:34.526750+0000 mgr.gibba020.yqfnwy (mgr.34427) 8220 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:28:36.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:36 gibba020 bash[25448]: cluster 2021-03-10T16:28:35.223380+0000 mgr.gibba020.yqfnwy (mgr.34427) 8221 : cluster [DBG] pgmap v4676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:37.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:36 gibba013 bash[29418]: cluster 2021-03-10T16:28:35.223380+0000 mgr.gibba020.yqfnwy (mgr.34427) 8221 : cluster [DBG] pgmap v4676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:37.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:36 gibba013 bash[30381]: cluster 2021-03-10T16:28:35.223380+0000 mgr.gibba020.yqfnwy (mgr.34427) 8221 : cluster [DBG] pgmap v4676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:38.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:38 gibba020 bash[25448]: cluster 2021-03-10T16:28:37.224431+0000 mgr.gibba020.yqfnwy (mgr.34427) 8222 : cluster [DBG] pgmap v4677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:39.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:38 gibba013 bash[29418]: cluster 2021-03-10T16:28:37.224431+0000 mgr.gibba020.yqfnwy (mgr.34427) 8222 : cluster [DBG] pgmap v4677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:39.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:38 gibba013 bash[30381]: cluster 2021-03-10T16:28:37.224431+0000 mgr.gibba020.yqfnwy (mgr.34427) 8222 : cluster [DBG] pgmap v4677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:40.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:40 gibba020 bash[25448]: cluster 2021-03-10T16:28:39.226085+0000 mgr.gibba020.yqfnwy (mgr.34427) 8223 : cluster [DBG] pgmap v4678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:41.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:40 gibba013 bash[29418]: cluster 2021-03-10T16:28:39.226085+0000 mgr.gibba020.yqfnwy (mgr.34427) 8223 : cluster [DBG] pgmap v4678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:41.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:40 gibba013 bash[30381]: cluster 2021-03-10T16:28:39.226085+0000 mgr.gibba020.yqfnwy (mgr.34427) 8223 : cluster [DBG] pgmap v4678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:42.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:42 gibba020 bash[25448]: cluster 2021-03-10T16:28:41.227389+0000 mgr.gibba020.yqfnwy (mgr.34427) 8224 : cluster [DBG] pgmap v4679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:43.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:42 gibba013 bash[29418]: cluster 2021-03-10T16:28:41.227389+0000 mgr.gibba020.yqfnwy (mgr.34427) 8224 : cluster [DBG] pgmap v4679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:43.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:42 gibba013 bash[30381]: cluster 2021-03-10T16:28:41.227389+0000 mgr.gibba020.yqfnwy (mgr.34427) 8224 : cluster [DBG] pgmap v4679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:44.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:44 gibba020 bash[25448]: cluster 2021-03-10T16:28:43.228706+0000 mgr.gibba020.yqfnwy (mgr.34427) 8225 : cluster [DBG] pgmap v4680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:45.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:44 gibba013 bash[29418]: cluster 2021-03-10T16:28:43.228706+0000 mgr.gibba020.yqfnwy (mgr.34427) 8225 : cluster [DBG] pgmap v4680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:45.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:44 gibba013 bash[30381]: cluster 2021-03-10T16:28:43.228706+0000 mgr.gibba020.yqfnwy (mgr.34427) 8225 : cluster [DBG] pgmap v4680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:46.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:46 gibba020 bash[25448]: cluster 2021-03-10T16:28:45.230160+0000 mgr.gibba020.yqfnwy (mgr.34427) 8226 : cluster [DBG] pgmap v4681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:47.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:46 gibba013 bash[29418]: cluster 2021-03-10T16:28:45.230160+0000 mgr.gibba020.yqfnwy (mgr.34427) 8226 : cluster [DBG] pgmap v4681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:47.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:46 gibba013 bash[30381]: cluster 2021-03-10T16:28:45.230160+0000 mgr.gibba020.yqfnwy (mgr.34427) 8226 : cluster [DBG] pgmap v4681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:48.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:48 gibba020 bash[25448]: cluster 2021-03-10T16:28:47.231237+0000 mgr.gibba020.yqfnwy (mgr.34427) 8227 : cluster [DBG] pgmap v4682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:49.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:48 gibba013 bash[29418]: cluster 2021-03-10T16:28:47.231237+0000 mgr.gibba020.yqfnwy (mgr.34427) 8227 : cluster [DBG] pgmap v4682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:49.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:48 gibba013 bash[30381]: cluster 2021-03-10T16:28:47.231237+0000 mgr.gibba020.yqfnwy (mgr.34427) 8227 : cluster [DBG] pgmap v4682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:50.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:50 gibba020 bash[25448]: cluster 2021-03-10T16:28:49.232869+0000 mgr.gibba020.yqfnwy (mgr.34427) 8228 : cluster [DBG] pgmap v4683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:50.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:50 gibba020 bash[25448]: cephadm 2021-03-10T16:28:49.542747+0000 mgr.gibba020.yqfnwy (mgr.34427) 8229 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:28:51.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:50 gibba013 bash[29418]: cluster 2021-03-10T16:28:49.232869+0000 mgr.gibba020.yqfnwy (mgr.34427) 8228 : cluster [DBG] pgmap v4683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:51.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:50 gibba013 bash[29418]: cephadm 2021-03-10T16:28:49.542747+0000 mgr.gibba020.yqfnwy (mgr.34427) 8229 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:28:51.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:50 gibba013 bash[30381]: cluster 2021-03-10T16:28:49.232869+0000 mgr.gibba020.yqfnwy (mgr.34427) 8228 : cluster [DBG] pgmap v4683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:51.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:50 gibba013 bash[30381]: cephadm 2021-03-10T16:28:49.542747+0000 mgr.gibba020.yqfnwy (mgr.34427) 8229 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:28:52.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:51 gibba013 bash[29418]: cluster 2021-03-10T16:28:51.234480+0000 mgr.gibba020.yqfnwy (mgr.34427) 8230 : cluster [DBG] pgmap v4684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:52.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:51 gibba013 bash[30381]: cluster 2021-03-10T16:28:51.234480+0000 mgr.gibba020.yqfnwy (mgr.34427) 8230 : cluster [DBG] pgmap v4684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:52.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:51 gibba020 bash[25448]: cluster 2021-03-10T16:28:51.234480+0000 mgr.gibba020.yqfnwy (mgr.34427) 8230 : cluster [DBG] pgmap v4684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:54.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:54 gibba013 bash[29418]: cluster 2021-03-10T16:28:53.235863+0000 mgr.gibba020.yqfnwy (mgr.34427) 8231 : cluster [DBG] pgmap v4685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:54.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:54 gibba013 bash[30381]: cluster 2021-03-10T16:28:53.235863+0000 mgr.gibba020.yqfnwy (mgr.34427) 8231 : cluster [DBG] pgmap v4685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:54.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:54 gibba020 bash[25448]: cluster 2021-03-10T16:28:53.235863+0000 mgr.gibba020.yqfnwy (mgr.34427) 8231 : cluster [DBG] pgmap v4685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:56.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:56 gibba013 bash[29418]: cluster 2021-03-10T16:28:55.237604+0000 mgr.gibba020.yqfnwy (mgr.34427) 8232 : cluster [DBG] pgmap v4686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:56.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:56 gibba013 bash[30381]: cluster 2021-03-10T16:28:55.237604+0000 mgr.gibba020.yqfnwy (mgr.34427) 8232 : cluster [DBG] pgmap v4686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:56.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:56 gibba020 bash[25448]: cluster 2021-03-10T16:28:55.237604+0000 mgr.gibba020.yqfnwy (mgr.34427) 8232 : cluster [DBG] pgmap v4686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:58.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:28:58 gibba013 bash[29418]: cluster 2021-03-10T16:28:57.239030+0000 mgr.gibba020.yqfnwy (mgr.34427) 8233 : cluster [DBG] pgmap v4687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:58.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:28:58 gibba013 bash[30381]: cluster 2021-03-10T16:28:57.239030+0000 mgr.gibba020.yqfnwy (mgr.34427) 8233 : cluster [DBG] pgmap v4687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:28:58.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:28:58 gibba020 bash[25448]: cluster 2021-03-10T16:28:57.239030+0000 mgr.gibba020.yqfnwy (mgr.34427) 8233 : cluster [DBG] pgmap v4687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:00.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:00 gibba013 bash[29418]: cluster 2021-03-10T16:28:59.240707+0000 mgr.gibba020.yqfnwy (mgr.34427) 8234 : cluster [DBG] pgmap v4688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:00.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:00 gibba013 bash[30381]: cluster 2021-03-10T16:28:59.240707+0000 mgr.gibba020.yqfnwy (mgr.34427) 8234 : cluster [DBG] pgmap v4688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:00.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:00 gibba020 bash[25448]: cluster 2021-03-10T16:28:59.240707+0000 mgr.gibba020.yqfnwy (mgr.34427) 8234 : cluster [DBG] pgmap v4688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:02.281 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:29:02.541 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:29:02.542 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 8m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:29:02.542 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 7m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:29:02.542 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:29:02.543 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:29:02.543 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:29:02.543 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:29:02.543 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:29:02.543 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:29:02.544 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:29:02.544 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:29:02.544 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:29:02.544 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:29:02.545 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:29:02.545 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:29:02.545 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:29:02.545 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:29:02.545 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:29:02.546 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:29:02.546 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 7m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:29:02.546 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 7m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:29:02.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:02 gibba013 bash[29418]: cluster 2021-03-10T16:29:01.242324+0000 mgr.gibba020.yqfnwy (mgr.34427) 8235 : cluster [DBG] pgmap v4689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:02.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:02 gibba013 bash[30381]: cluster 2021-03-10T16:29:01.242324+0000 mgr.gibba020.yqfnwy (mgr.34427) 8235 : cluster [DBG] pgmap v4689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:02.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:02 gibba020 bash[25448]: cluster 2021-03-10T16:29:01.242324+0000 mgr.gibba020.yqfnwy (mgr.34427) 8235 : cluster [DBG] pgmap v4689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:02.805 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:29:02.806 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:29:02.806 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:29:02.806 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:29:02.807 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:29:02.807 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:29:02.807 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:29:02.807 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:29:02.808 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:29:02.808 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:29:02.808 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:29:02.808 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:29:02.808 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:29:02.809 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:29:02.809 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:29:03.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:03 gibba013 bash[29418]: audit 2021-03-10T16:29:02.272569+0000 mgr.gibba020.yqfnwy (mgr.34427) 8236 : audit [DBG] from='client.49578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:29:03.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:03 gibba013 bash[29418]: audit 2021-03-10T16:29:02.501350+0000 mgr.gibba020.yqfnwy (mgr.34427) 8237 : audit [DBG] from='client.59566 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:29:03.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:03 gibba013 bash[29418]: audit 2021-03-10T16:29:02.807077+0000 mon.c (mon.1) 132 : audit [DBG] from='client.? 172.21.2.113:0/3842652241' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:03.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:03 gibba013 bash[30381]: audit 2021-03-10T16:29:02.272569+0000 mgr.gibba020.yqfnwy (mgr.34427) 8236 : audit [DBG] from='client.49578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:29:03.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:03 gibba013 bash[30381]: audit 2021-03-10T16:29:02.501350+0000 mgr.gibba020.yqfnwy (mgr.34427) 8237 : audit [DBG] from='client.59566 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:29:03.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:03 gibba013 bash[30381]: audit 2021-03-10T16:29:02.807077+0000 mon.c (mon.1) 132 : audit [DBG] from='client.? 172.21.2.113:0/3842652241' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:03.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:03 gibba020 bash[25448]: audit 2021-03-10T16:29:02.272569+0000 mgr.gibba020.yqfnwy (mgr.34427) 8236 : audit [DBG] from='client.49578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:29:03.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:03 gibba020 bash[25448]: audit 2021-03-10T16:29:02.501350+0000 mgr.gibba020.yqfnwy (mgr.34427) 8237 : audit [DBG] from='client.59566 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:29:03.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:03 gibba020 bash[25448]: audit 2021-03-10T16:29:02.807077+0000 mon.c (mon.1) 132 : audit [DBG] from='client.? 172.21.2.113:0/3842652241' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:04.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:04 gibba013 bash[29418]: cluster 2021-03-10T16:29:03.243708+0000 mgr.gibba020.yqfnwy (mgr.34427) 8238 : cluster [DBG] pgmap v4690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:04.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:04 gibba013 bash[30381]: cluster 2021-03-10T16:29:03.243708+0000 mgr.gibba020.yqfnwy (mgr.34427) 8238 : cluster [DBG] pgmap v4690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:04.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:04 gibba020 bash[25448]: cluster 2021-03-10T16:29:03.243708+0000 mgr.gibba020.yqfnwy (mgr.34427) 8238 : cluster [DBG] pgmap v4690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:05.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:05 gibba013 bash[29418]: cephadm 2021-03-10T16:29:04.558756+0000 mgr.gibba020.yqfnwy (mgr.34427) 8239 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:29:05.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:05 gibba013 bash[30381]: cephadm 2021-03-10T16:29:04.558756+0000 mgr.gibba020.yqfnwy (mgr.34427) 8239 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:29:05.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:05 gibba020 bash[25448]: cephadm 2021-03-10T16:29:04.558756+0000 mgr.gibba020.yqfnwy (mgr.34427) 8239 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:29:06.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:06 gibba013 bash[29418]: cluster 2021-03-10T16:29:05.244723+0000 mgr.gibba020.yqfnwy (mgr.34427) 8240 : cluster [DBG] pgmap v4691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:06.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:06 gibba013 bash[30381]: cluster 2021-03-10T16:29:05.244723+0000 mgr.gibba020.yqfnwy (mgr.34427) 8240 : cluster [DBG] pgmap v4691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:06.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:06 gibba020 bash[25448]: cluster 2021-03-10T16:29:05.244723+0000 mgr.gibba020.yqfnwy (mgr.34427) 8240 : cluster [DBG] pgmap v4691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:07.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:07 gibba013 bash[29418]: audit 2021-03-10T16:29:06.709841+0000 mon.a (mon.0) 3041 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:29:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:07 gibba013 bash[29418]: audit 2021-03-10T16:29:06.859204+0000 mon.a (mon.0) 3042 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:29:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:07 gibba013 bash[29418]: audit 2021-03-10T16:29:07.133947+0000 mon.a (mon.0) 3043 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:29:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:07 gibba013 bash[29418]: audit 2021-03-10T16:29:07.134832+0000 mon.a (mon.0) 3044 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:29:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:07 gibba013 bash[29418]: audit 2021-03-10T16:29:07.135515+0000 mon.a (mon.0) 3045 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:29:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:07 gibba013 bash[29418]: audit 2021-03-10T16:29:07.136185+0000 mon.a (mon.0) 3046 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:29:07.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:07 gibba013 bash[30381]: audit 2021-03-10T16:29:06.709841+0000 mon.a (mon.0) 3041 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:29:07.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:07 gibba013 bash[30381]: audit 2021-03-10T16:29:06.859204+0000 mon.a (mon.0) 3042 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:29:07.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:07 gibba013 bash[30381]: audit 2021-03-10T16:29:07.133947+0000 mon.a (mon.0) 3043 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:29:07.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:07 gibba013 bash[30381]: audit 2021-03-10T16:29:07.134832+0000 mon.a (mon.0) 3044 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:29:07.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:07 gibba013 bash[30381]: audit 2021-03-10T16:29:07.135515+0000 mon.a (mon.0) 3045 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:29:07.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:07 gibba013 bash[30381]: audit 2021-03-10T16:29:07.136185+0000 mon.a (mon.0) 3046 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:29:07.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:07 gibba020 bash[25448]: audit 2021-03-10T16:29:06.709841+0000 mon.a (mon.0) 3041 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:29:07.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:07 gibba020 bash[25448]: audit 2021-03-10T16:29:06.859204+0000 mon.a (mon.0) 3042 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:29:07.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:07 gibba020 bash[25448]: audit 2021-03-10T16:29:07.133947+0000 mon.a (mon.0) 3043 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:29:07.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:07 gibba020 bash[25448]: audit 2021-03-10T16:29:07.134832+0000 mon.a (mon.0) 3044 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:29:07.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:07 gibba020 bash[25448]: audit 2021-03-10T16:29:07.135515+0000 mon.a (mon.0) 3045 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:29:07.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:07 gibba020 bash[25448]: audit 2021-03-10T16:29:07.136185+0000 mon.a (mon.0) 3046 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:29:08.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:08 gibba013 bash[29418]: cluster 2021-03-10T16:29:07.245762+0000 mgr.gibba020.yqfnwy (mgr.34427) 8241 : cluster [DBG] pgmap v4692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:08.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:08 gibba013 bash[30381]: cluster 2021-03-10T16:29:07.245762+0000 mgr.gibba020.yqfnwy (mgr.34427) 8241 : cluster [DBG] pgmap v4692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:08.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:08 gibba020 bash[25448]: cluster 2021-03-10T16:29:07.245762+0000 mgr.gibba020.yqfnwy (mgr.34427) 8241 : cluster [DBG] pgmap v4692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:10.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:10 gibba020 bash[25448]: cluster 2021-03-10T16:29:09.247235+0000 mgr.gibba020.yqfnwy (mgr.34427) 8242 : cluster [DBG] pgmap v4693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:10.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:10 gibba013 bash[29418]: cluster 2021-03-10T16:29:09.247235+0000 mgr.gibba020.yqfnwy (mgr.34427) 8242 : cluster [DBG] pgmap v4693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:10.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:10 gibba013 bash[30381]: cluster 2021-03-10T16:29:09.247235+0000 mgr.gibba020.yqfnwy (mgr.34427) 8242 : cluster [DBG] pgmap v4693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:12.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:12 gibba020 bash[25448]: cluster 2021-03-10T16:29:11.248653+0000 mgr.gibba020.yqfnwy (mgr.34427) 8243 : cluster [DBG] pgmap v4694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:12.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:12 gibba013 bash[29418]: cluster 2021-03-10T16:29:11.248653+0000 mgr.gibba020.yqfnwy (mgr.34427) 8243 : cluster [DBG] pgmap v4694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:12.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:12 gibba013 bash[30381]: cluster 2021-03-10T16:29:11.248653+0000 mgr.gibba020.yqfnwy (mgr.34427) 8243 : cluster [DBG] pgmap v4694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:14.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:14 gibba020 bash[25448]: cluster 2021-03-10T16:29:13.250061+0000 mgr.gibba020.yqfnwy (mgr.34427) 8244 : cluster [DBG] pgmap v4695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:14.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:14 gibba013 bash[29418]: cluster 2021-03-10T16:29:13.250061+0000 mgr.gibba020.yqfnwy (mgr.34427) 8244 : cluster [DBG] pgmap v4695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:14.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:14 gibba013 bash[30381]: cluster 2021-03-10T16:29:13.250061+0000 mgr.gibba020.yqfnwy (mgr.34427) 8244 : cluster [DBG] pgmap v4695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:16.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:16 gibba020 bash[25448]: cluster 2021-03-10T16:29:15.251792+0000 mgr.gibba020.yqfnwy (mgr.34427) 8245 : cluster [DBG] pgmap v4696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:16.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:16 gibba013 bash[29418]: cluster 2021-03-10T16:29:15.251792+0000 mgr.gibba020.yqfnwy (mgr.34427) 8245 : cluster [DBG] pgmap v4696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:16.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:16 gibba013 bash[30381]: cluster 2021-03-10T16:29:15.251792+0000 mgr.gibba020.yqfnwy (mgr.34427) 8245 : cluster [DBG] pgmap v4696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:18.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:18 gibba020 bash[25448]: cluster 2021-03-10T16:29:17.253417+0000 mgr.gibba020.yqfnwy (mgr.34427) 8246 : cluster [DBG] pgmap v4697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:18.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:18 gibba013 bash[29418]: cluster 2021-03-10T16:29:17.253417+0000 mgr.gibba020.yqfnwy (mgr.34427) 8246 : cluster [DBG] pgmap v4697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:18.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:18 gibba013 bash[30381]: cluster 2021-03-10T16:29:17.253417+0000 mgr.gibba020.yqfnwy (mgr.34427) 8246 : cluster [DBG] pgmap v4697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:20.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:20 gibba020 bash[25448]: cluster 2021-03-10T16:29:19.255266+0000 mgr.gibba020.yqfnwy (mgr.34427) 8247 : cluster [DBG] pgmap v4698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:20.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:20 gibba020 bash[25448]: cephadm 2021-03-10T16:29:19.574868+0000 mgr.gibba020.yqfnwy (mgr.34427) 8248 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:29:20.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:20 gibba013 bash[29418]: cluster 2021-03-10T16:29:19.255266+0000 mgr.gibba020.yqfnwy (mgr.34427) 8247 : cluster [DBG] pgmap v4698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:20.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:20 gibba013 bash[29418]: cephadm 2021-03-10T16:29:19.574868+0000 mgr.gibba020.yqfnwy (mgr.34427) 8248 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:29:20.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:20 gibba013 bash[30381]: cluster 2021-03-10T16:29:19.255266+0000 mgr.gibba020.yqfnwy (mgr.34427) 8247 : cluster [DBG] pgmap v4698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:20.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:20 gibba013 bash[30381]: cephadm 2021-03-10T16:29:19.574868+0000 mgr.gibba020.yqfnwy (mgr.34427) 8248 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:29:22.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:22 gibba020 bash[25448]: cluster 2021-03-10T16:29:21.257248+0000 mgr.gibba020.yqfnwy (mgr.34427) 8249 : cluster [DBG] pgmap v4699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:22.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:22 gibba013 bash[29418]: cluster 2021-03-10T16:29:21.257248+0000 mgr.gibba020.yqfnwy (mgr.34427) 8249 : cluster [DBG] pgmap v4699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:22.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:22 gibba013 bash[30381]: cluster 2021-03-10T16:29:21.257248+0000 mgr.gibba020.yqfnwy (mgr.34427) 8249 : cluster [DBG] pgmap v4699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:24.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:24 gibba013 bash[29418]: cluster 2021-03-10T16:29:23.258867+0000 mgr.gibba020.yqfnwy (mgr.34427) 8250 : cluster [DBG] pgmap v4700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:24.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:24 gibba013 bash[30381]: cluster 2021-03-10T16:29:23.258867+0000 mgr.gibba020.yqfnwy (mgr.34427) 8250 : cluster [DBG] pgmap v4700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:24.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:24 gibba020 bash[25448]: cluster 2021-03-10T16:29:23.258867+0000 mgr.gibba020.yqfnwy (mgr.34427) 8250 : cluster [DBG] pgmap v4700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:26.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:26 gibba013 bash[29418]: cluster 2021-03-10T16:29:25.260798+0000 mgr.gibba020.yqfnwy (mgr.34427) 8251 : cluster [DBG] pgmap v4701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:26.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:26 gibba013 bash[30381]: cluster 2021-03-10T16:29:25.260798+0000 mgr.gibba020.yqfnwy (mgr.34427) 8251 : cluster [DBG] pgmap v4701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:26.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:26 gibba020 bash[25448]: cluster 2021-03-10T16:29:25.260798+0000 mgr.gibba020.yqfnwy (mgr.34427) 8251 : cluster [DBG] pgmap v4701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:28.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:28 gibba013 bash[29418]: cluster 2021-03-10T16:29:27.262343+0000 mgr.gibba020.yqfnwy (mgr.34427) 8252 : cluster [DBG] pgmap v4702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:28.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:28 gibba013 bash[30381]: cluster 2021-03-10T16:29:27.262343+0000 mgr.gibba020.yqfnwy (mgr.34427) 8252 : cluster [DBG] pgmap v4702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:28.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:28 gibba020 bash[25448]: cluster 2021-03-10T16:29:27.262343+0000 mgr.gibba020.yqfnwy (mgr.34427) 8252 : cluster [DBG] pgmap v4702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:30.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:30 gibba013 bash[29418]: cluster 2021-03-10T16:29:29.264086+0000 mgr.gibba020.yqfnwy (mgr.34427) 8253 : cluster [DBG] pgmap v4703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:30.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:30 gibba013 bash[30381]: cluster 2021-03-10T16:29:29.264086+0000 mgr.gibba020.yqfnwy (mgr.34427) 8253 : cluster [DBG] pgmap v4703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:30.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:30 gibba020 bash[25448]: cluster 2021-03-10T16:29:29.264086+0000 mgr.gibba020.yqfnwy (mgr.34427) 8253 : cluster [DBG] pgmap v4703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:32.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:32 gibba013 bash[29418]: cluster 2021-03-10T16:29:31.265934+0000 mgr.gibba020.yqfnwy (mgr.34427) 8254 : cluster [DBG] pgmap v4704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:32.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:32 gibba013 bash[30381]: cluster 2021-03-10T16:29:31.265934+0000 mgr.gibba020.yqfnwy (mgr.34427) 8254 : cluster [DBG] pgmap v4704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:32.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:32 gibba020 bash[25448]: cluster 2021-03-10T16:29:31.265934+0000 mgr.gibba020.yqfnwy (mgr.34427) 8254 : cluster [DBG] pgmap v4704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:33.050 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:29:33.306 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:29:33.306 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 9m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:29:33.307 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 8m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:29:33.307 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:29:33.307 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:29:33.307 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:29:33.308 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:29:33.308 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:29:33.308 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:29:33.308 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:29:33.309 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:29:33.309 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:29:33.309 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:29:33.309 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:29:33.310 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:29:33.310 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:29:33.310 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:29:33.310 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:29:33.311 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:29:33.311 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 8m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:29:33.311 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 8m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:29:33.576 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:29:33.576 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:29:33.576 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:29:33.577 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:29:33.577 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:29:33.577 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:29:33.577 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:29:33.578 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:29:33.578 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:29:33.578 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:29:33.578 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:29:33.579 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:29:33.579 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:29:33.579 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:29:33.579 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:29:34.870 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:34 gibba020 bash[25448]: audit 2021-03-10T16:29:33.041805+0000 mgr.gibba020.yqfnwy (mgr.34427) 8255 : audit [DBG] from='client.49596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:29:34.871 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:34 gibba020 bash[25448]: audit 2021-03-10T16:29:33.265717+0000 mgr.gibba020.yqfnwy (mgr.34427) 8256 : audit [DBG] from='client.59584 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:29:34.871 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:34 gibba020 bash[25448]: cluster 2021-03-10T16:29:33.267274+0000 mgr.gibba020.yqfnwy (mgr.34427) 8257 : cluster [DBG] pgmap v4705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:34.871 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:34 gibba020 bash[25448]: audit 2021-03-10T16:29:33.577373+0000 mon.c (mon.1) 133 : audit [DBG] from='client.? 172.21.2.113:0/1588978853' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:34.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:34 gibba013 bash[29418]: audit 2021-03-10T16:29:33.041805+0000 mgr.gibba020.yqfnwy (mgr.34427) 8255 : audit [DBG] from='client.49596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:29:34.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:34 gibba013 bash[29418]: audit 2021-03-10T16:29:33.265717+0000 mgr.gibba020.yqfnwy (mgr.34427) 8256 : audit [DBG] from='client.59584 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:29:34.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:34 gibba013 bash[29418]: cluster 2021-03-10T16:29:33.267274+0000 mgr.gibba020.yqfnwy (mgr.34427) 8257 : cluster [DBG] pgmap v4705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:34.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:34 gibba013 bash[29418]: audit 2021-03-10T16:29:33.577373+0000 mon.c (mon.1) 133 : audit [DBG] from='client.? 172.21.2.113:0/1588978853' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:34.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:34 gibba013 bash[30381]: audit 2021-03-10T16:29:33.041805+0000 mgr.gibba020.yqfnwy (mgr.34427) 8255 : audit [DBG] from='client.49596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:29:34.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:34 gibba013 bash[30381]: audit 2021-03-10T16:29:33.265717+0000 mgr.gibba020.yqfnwy (mgr.34427) 8256 : audit [DBG] from='client.59584 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:29:34.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:34 gibba013 bash[30381]: cluster 2021-03-10T16:29:33.267274+0000 mgr.gibba020.yqfnwy (mgr.34427) 8257 : cluster [DBG] pgmap v4705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:34.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:34 gibba013 bash[30381]: audit 2021-03-10T16:29:33.577373+0000 mon.c (mon.1) 133 : audit [DBG] from='client.? 172.21.2.113:0/1588978853' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:35.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:35 gibba013 bash[29418]: audit 2021-03-10T16:29:34.592024+0000 mon.a (mon.0) 3047 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:29:35.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:35 gibba013 bash[29418]: cephadm 2021-03-10T16:29:34.597080+0000 mgr.gibba020.yqfnwy (mgr.34427) 8258 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:29:35.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:35 gibba013 bash[29418]: cephadm 2021-03-10T16:29:34.599095+0000 mgr.gibba020.yqfnwy (mgr.34427) 8259 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:29:35.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:35 gibba013 bash[29418]: audit 2021-03-10T16:29:34.858380+0000 mon.a (mon.0) 3048 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:29:35.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:35 gibba013 bash[29418]: audit 2021-03-10T16:29:34.862341+0000 mon.a (mon.0) 3049 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:29:35.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:35 gibba013 bash[29418]: audit 2021-03-10T16:29:34.863976+0000 mon.a (mon.0) 3050 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:35.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:35 gibba013 bash[29418]: audit 2021-03-10T16:29:34.865449+0000 mon.a (mon.0) 3051 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:35.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:35 gibba013 bash[29418]: audit 2021-03-10T16:29:34.866807+0000 mon.a (mon.0) 3052 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:35.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:35 gibba013 bash[29418]: audit 2021-03-10T16:29:34.869102+0000 mon.a (mon.0) 3053 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:35.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:35 gibba013 bash[29418]: audit 2021-03-10T16:29:34.870476+0000 mon.a (mon.0) 3054 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:35.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:35 gibba013 bash[30381]: audit 2021-03-10T16:29:34.592024+0000 mon.a (mon.0) 3047 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:29:35.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:35 gibba013 bash[30381]: cephadm 2021-03-10T16:29:34.597080+0000 mgr.gibba020.yqfnwy (mgr.34427) 8258 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:29:35.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:35 gibba013 bash[30381]: cephadm 2021-03-10T16:29:34.599095+0000 mgr.gibba020.yqfnwy (mgr.34427) 8259 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:29:35.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:35 gibba013 bash[30381]: audit 2021-03-10T16:29:34.858380+0000 mon.a (mon.0) 3048 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:29:35.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:35 gibba013 bash[30381]: audit 2021-03-10T16:29:34.862341+0000 mon.a (mon.0) 3049 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:29:35.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:35 gibba013 bash[30381]: audit 2021-03-10T16:29:34.863976+0000 mon.a (mon.0) 3050 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:35.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:35 gibba013 bash[30381]: audit 2021-03-10T16:29:34.865449+0000 mon.a (mon.0) 3051 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:35.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:35 gibba013 bash[30381]: audit 2021-03-10T16:29:34.866807+0000 mon.a (mon.0) 3052 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:35.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:35 gibba013 bash[30381]: audit 2021-03-10T16:29:34.869102+0000 mon.a (mon.0) 3053 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:35.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:35 gibba013 bash[30381]: audit 2021-03-10T16:29:34.870476+0000 mon.a (mon.0) 3054 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:35.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:35 gibba020 bash[25448]: audit 2021-03-10T16:29:34.592024+0000 mon.a (mon.0) 3047 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:29:35.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:35 gibba020 bash[25448]: cephadm 2021-03-10T16:29:34.597080+0000 mgr.gibba020.yqfnwy (mgr.34427) 8258 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:29:35.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:35 gibba020 bash[25448]: cephadm 2021-03-10T16:29:34.599095+0000 mgr.gibba020.yqfnwy (mgr.34427) 8259 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:29:35.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:35 gibba020 bash[25448]: audit 2021-03-10T16:29:34.858380+0000 mon.a (mon.0) 3048 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:29:35.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:35 gibba020 bash[25448]: audit 2021-03-10T16:29:34.862341+0000 mon.a (mon.0) 3049 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:29:35.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:35 gibba020 bash[25448]: audit 2021-03-10T16:29:34.863976+0000 mon.a (mon.0) 3050 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:35.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:35 gibba020 bash[25448]: audit 2021-03-10T16:29:34.865449+0000 mon.a (mon.0) 3051 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:35.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:35 gibba020 bash[25448]: audit 2021-03-10T16:29:34.866807+0000 mon.a (mon.0) 3052 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:35.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:35 gibba020 bash[25448]: audit 2021-03-10T16:29:34.869102+0000 mon.a (mon.0) 3053 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:35.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:35 gibba020 bash[25448]: audit 2021-03-10T16:29:34.870476+0000 mon.a (mon.0) 3054 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:29:36.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:36 gibba013 bash[29418]: cephadm 2021-03-10T16:29:34.861055+0000 mgr.gibba020.yqfnwy (mgr.34427) 8260 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:29:36.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:36 gibba013 bash[29418]: cephadm 2021-03-10T16:29:34.863082+0000 mgr.gibba020.yqfnwy (mgr.34427) 8261 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:29:36.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:36 gibba013 bash[29418]: cephadm 2021-03-10T16:29:34.864503+0000 mgr.gibba020.yqfnwy (mgr.34427) 8262 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:29:36.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:36 gibba013 bash[29418]: cephadm 2021-03-10T16:29:34.864563+0000 mgr.gibba020.yqfnwy (mgr.34427) 8263 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:29:36.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:36 gibba013 bash[29418]: cephadm 2021-03-10T16:29:34.865980+0000 mgr.gibba020.yqfnwy (mgr.34427) 8264 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:29:36.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:36 gibba013 bash[29418]: cephadm 2021-03-10T16:29:34.866042+0000 mgr.gibba020.yqfnwy (mgr.34427) 8265 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:29:36.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:36 gibba013 bash[29418]: cephadm 2021-03-10T16:29:34.867180+0000 mgr.gibba020.yqfnwy (mgr.34427) 8266 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:29:36.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:36 gibba013 bash[29418]: cephadm 2021-03-10T16:29:34.868190+0000 mgr.gibba020.yqfnwy (mgr.34427) 8267 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:29:36.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:36 gibba013 bash[29418]: cephadm 2021-03-10T16:29:34.868227+0000 mgr.gibba020.yqfnwy (mgr.34427) 8268 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:29:36.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:36 gibba013 bash[29418]: cephadm 2021-03-10T16:29:34.869468+0000 mgr.gibba020.yqfnwy (mgr.34427) 8269 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:29:36.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:36 gibba013 bash[29418]: cephadm 2021-03-10T16:29:34.869787+0000 mgr.gibba020.yqfnwy (mgr.34427) 8270 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:29:36.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:36 gibba013 bash[29418]: cephadm 2021-03-10T16:29:34.870778+0000 mgr.gibba020.yqfnwy (mgr.34427) 8271 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:29:36.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:36 gibba013 bash[29418]: cephadm 2021-03-10T16:29:34.870824+0000 mgr.gibba020.yqfnwy (mgr.34427) 8272 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:29:36.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:36 gibba013 bash[29418]: cephadm 2021-03-10T16:29:34.870928+0000 mgr.gibba020.yqfnwy (mgr.34427) 8273 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:29:36.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:36 gibba013 bash[29418]: cluster 2021-03-10T16:29:35.268896+0000 mgr.gibba020.yqfnwy (mgr.34427) 8274 : cluster [DBG] pgmap v4706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:36.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:36 gibba013 bash[30381]: cephadm 2021-03-10T16:29:34.861055+0000 mgr.gibba020.yqfnwy (mgr.34427) 8260 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:29:36.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:36 gibba013 bash[30381]: cephadm 2021-03-10T16:29:34.863082+0000 mgr.gibba020.yqfnwy (mgr.34427) 8261 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:29:36.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:36 gibba013 bash[30381]: cephadm 2021-03-10T16:29:34.864503+0000 mgr.gibba020.yqfnwy (mgr.34427) 8262 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:29:36.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:36 gibba013 bash[30381]: cephadm 2021-03-10T16:29:34.864563+0000 mgr.gibba020.yqfnwy (mgr.34427) 8263 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:29:36.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:36 gibba013 bash[30381]: cephadm 2021-03-10T16:29:34.865980+0000 mgr.gibba020.yqfnwy (mgr.34427) 8264 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:29:36.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:36 gibba013 bash[30381]: cephadm 2021-03-10T16:29:34.866042+0000 mgr.gibba020.yqfnwy (mgr.34427) 8265 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:29:36.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:36 gibba013 bash[30381]: cephadm 2021-03-10T16:29:34.867180+0000 mgr.gibba020.yqfnwy (mgr.34427) 8266 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:29:36.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:36 gibba013 bash[30381]: cephadm 2021-03-10T16:29:34.868190+0000 mgr.gibba020.yqfnwy (mgr.34427) 8267 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:29:36.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:36 gibba013 bash[30381]: cephadm 2021-03-10T16:29:34.868227+0000 mgr.gibba020.yqfnwy (mgr.34427) 8268 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:29:36.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:36 gibba013 bash[30381]: cephadm 2021-03-10T16:29:34.869468+0000 mgr.gibba020.yqfnwy (mgr.34427) 8269 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:29:36.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:36 gibba013 bash[30381]: cephadm 2021-03-10T16:29:34.869787+0000 mgr.gibba020.yqfnwy (mgr.34427) 8270 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:29:36.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:36 gibba013 bash[30381]: cephadm 2021-03-10T16:29:34.870778+0000 mgr.gibba020.yqfnwy (mgr.34427) 8271 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:29:36.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:36 gibba013 bash[30381]: cephadm 2021-03-10T16:29:34.870824+0000 mgr.gibba020.yqfnwy (mgr.34427) 8272 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:29:36.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:36 gibba013 bash[30381]: cephadm 2021-03-10T16:29:34.870928+0000 mgr.gibba020.yqfnwy (mgr.34427) 8273 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:29:36.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:36 gibba013 bash[30381]: cluster 2021-03-10T16:29:35.268896+0000 mgr.gibba020.yqfnwy (mgr.34427) 8274 : cluster [DBG] pgmap v4706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:36.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:36 gibba020 bash[25448]: cephadm 2021-03-10T16:29:34.861055+0000 mgr.gibba020.yqfnwy (mgr.34427) 8260 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:29:36.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:36 gibba020 bash[25448]: cephadm 2021-03-10T16:29:34.863082+0000 mgr.gibba020.yqfnwy (mgr.34427) 8261 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:29:36.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:36 gibba020 bash[25448]: cephadm 2021-03-10T16:29:34.864503+0000 mgr.gibba020.yqfnwy (mgr.34427) 8262 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:29:36.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:36 gibba020 bash[25448]: cephadm 2021-03-10T16:29:34.864563+0000 mgr.gibba020.yqfnwy (mgr.34427) 8263 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:29:36.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:36 gibba020 bash[25448]: cephadm 2021-03-10T16:29:34.865980+0000 mgr.gibba020.yqfnwy (mgr.34427) 8264 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:29:36.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:36 gibba020 bash[25448]: cephadm 2021-03-10T16:29:34.866042+0000 mgr.gibba020.yqfnwy (mgr.34427) 8265 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:29:36.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:36 gibba020 bash[25448]: cephadm 2021-03-10T16:29:34.867180+0000 mgr.gibba020.yqfnwy (mgr.34427) 8266 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:29:36.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:36 gibba020 bash[25448]: cephadm 2021-03-10T16:29:34.868190+0000 mgr.gibba020.yqfnwy (mgr.34427) 8267 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:29:36.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:36 gibba020 bash[25448]: cephadm 2021-03-10T16:29:34.868227+0000 mgr.gibba020.yqfnwy (mgr.34427) 8268 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:29:36.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:36 gibba020 bash[25448]: cephadm 2021-03-10T16:29:34.869468+0000 mgr.gibba020.yqfnwy (mgr.34427) 8269 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:29:36.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:36 gibba020 bash[25448]: cephadm 2021-03-10T16:29:34.869787+0000 mgr.gibba020.yqfnwy (mgr.34427) 8270 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:29:36.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:36 gibba020 bash[25448]: cephadm 2021-03-10T16:29:34.870778+0000 mgr.gibba020.yqfnwy (mgr.34427) 8271 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:29:36.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:36 gibba020 bash[25448]: cephadm 2021-03-10T16:29:34.870824+0000 mgr.gibba020.yqfnwy (mgr.34427) 8272 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:29:36.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:36 gibba020 bash[25448]: cephadm 2021-03-10T16:29:34.870928+0000 mgr.gibba020.yqfnwy (mgr.34427) 8273 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:29:36.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:36 gibba020 bash[25448]: cluster 2021-03-10T16:29:35.268896+0000 mgr.gibba020.yqfnwy (mgr.34427) 8274 : cluster [DBG] pgmap v4706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:38.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:38 gibba013 bash[29418]: cluster 2021-03-10T16:29:37.270263+0000 mgr.gibba020.yqfnwy (mgr.34427) 8275 : cluster [DBG] pgmap v4707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:38.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:38 gibba013 bash[30381]: cluster 2021-03-10T16:29:37.270263+0000 mgr.gibba020.yqfnwy (mgr.34427) 8275 : cluster [DBG] pgmap v4707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:38.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:38 gibba020 bash[25448]: cluster 2021-03-10T16:29:37.270263+0000 mgr.gibba020.yqfnwy (mgr.34427) 8275 : cluster [DBG] pgmap v4707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:40.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:40 gibba013 bash[29418]: cluster 2021-03-10T16:29:39.272044+0000 mgr.gibba020.yqfnwy (mgr.34427) 8276 : cluster [DBG] pgmap v4708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:40.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:40 gibba013 bash[30381]: cluster 2021-03-10T16:29:39.272044+0000 mgr.gibba020.yqfnwy (mgr.34427) 8276 : cluster [DBG] pgmap v4708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:40.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:40 gibba020 bash[25448]: cluster 2021-03-10T16:29:39.272044+0000 mgr.gibba020.yqfnwy (mgr.34427) 8276 : cluster [DBG] pgmap v4708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:42.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:42 gibba013 bash[29418]: cluster 2021-03-10T16:29:41.274055+0000 mgr.gibba020.yqfnwy (mgr.34427) 8277 : cluster [DBG] pgmap v4709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:42.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:42 gibba013 bash[30381]: cluster 2021-03-10T16:29:41.274055+0000 mgr.gibba020.yqfnwy (mgr.34427) 8277 : cluster [DBG] pgmap v4709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:42.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:42 gibba020 bash[25448]: cluster 2021-03-10T16:29:41.274055+0000 mgr.gibba020.yqfnwy (mgr.34427) 8277 : cluster [DBG] pgmap v4709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:44.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:44 gibba013 bash[29418]: cluster 2021-03-10T16:29:43.275587+0000 mgr.gibba020.yqfnwy (mgr.34427) 8278 : cluster [DBG] pgmap v4710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:44.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:44 gibba013 bash[30381]: cluster 2021-03-10T16:29:43.275587+0000 mgr.gibba020.yqfnwy (mgr.34427) 8278 : cluster [DBG] pgmap v4710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:44.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:44 gibba020 bash[25448]: cluster 2021-03-10T16:29:43.275587+0000 mgr.gibba020.yqfnwy (mgr.34427) 8278 : cluster [DBG] pgmap v4710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:46.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:46 gibba013 bash[29418]: cluster 2021-03-10T16:29:45.277259+0000 mgr.gibba020.yqfnwy (mgr.34427) 8279 : cluster [DBG] pgmap v4711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:46.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:46 gibba013 bash[30381]: cluster 2021-03-10T16:29:45.277259+0000 mgr.gibba020.yqfnwy (mgr.34427) 8279 : cluster [DBG] pgmap v4711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:46.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:46 gibba020 bash[25448]: cluster 2021-03-10T16:29:45.277259+0000 mgr.gibba020.yqfnwy (mgr.34427) 8279 : cluster [DBG] pgmap v4711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:48.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:48 gibba013 bash[29418]: cluster 2021-03-10T16:29:47.278563+0000 mgr.gibba020.yqfnwy (mgr.34427) 8280 : cluster [DBG] pgmap v4712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:48.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:48 gibba013 bash[30381]: cluster 2021-03-10T16:29:47.278563+0000 mgr.gibba020.yqfnwy (mgr.34427) 8280 : cluster [DBG] pgmap v4712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:48.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:48 gibba020 bash[25448]: cluster 2021-03-10T16:29:47.278563+0000 mgr.gibba020.yqfnwy (mgr.34427) 8280 : cluster [DBG] pgmap v4712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:50.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:50 gibba013 bash[29418]: cluster 2021-03-10T16:29:49.280442+0000 mgr.gibba020.yqfnwy (mgr.34427) 8281 : cluster [DBG] pgmap v4713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:50.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:50 gibba013 bash[30381]: cluster 2021-03-10T16:29:49.280442+0000 mgr.gibba020.yqfnwy (mgr.34427) 8281 : cluster [DBG] pgmap v4713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:50.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:50 gibba020 bash[25448]: cluster 2021-03-10T16:29:49.280442+0000 mgr.gibba020.yqfnwy (mgr.34427) 8281 : cluster [DBG] pgmap v4713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:51.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:51 gibba013 bash[29418]: cephadm 2021-03-10T16:29:49.886939+0000 mgr.gibba020.yqfnwy (mgr.34427) 8282 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:29:51.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:51 gibba013 bash[30381]: cephadm 2021-03-10T16:29:49.886939+0000 mgr.gibba020.yqfnwy (mgr.34427) 8282 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:29:51.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:51 gibba020 bash[25448]: cephadm 2021-03-10T16:29:49.886939+0000 mgr.gibba020.yqfnwy (mgr.34427) 8282 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:29:52.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:52 gibba013 bash[29418]: cluster 2021-03-10T16:29:51.282305+0000 mgr.gibba020.yqfnwy (mgr.34427) 8283 : cluster [DBG] pgmap v4714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:52.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:52 gibba013 bash[30381]: cluster 2021-03-10T16:29:51.282305+0000 mgr.gibba020.yqfnwy (mgr.34427) 8283 : cluster [DBG] pgmap v4714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:52.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:52 gibba020 bash[25448]: cluster 2021-03-10T16:29:51.282305+0000 mgr.gibba020.yqfnwy (mgr.34427) 8283 : cluster [DBG] pgmap v4714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:54.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:54 gibba013 bash[29418]: cluster 2021-03-10T16:29:53.283861+0000 mgr.gibba020.yqfnwy (mgr.34427) 8284 : cluster [DBG] pgmap v4715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:54.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:54 gibba013 bash[30381]: cluster 2021-03-10T16:29:53.283861+0000 mgr.gibba020.yqfnwy (mgr.34427) 8284 : cluster [DBG] pgmap v4715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:54.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:54 gibba020 bash[25448]: cluster 2021-03-10T16:29:53.283861+0000 mgr.gibba020.yqfnwy (mgr.34427) 8284 : cluster [DBG] pgmap v4715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:56.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:56 gibba013 bash[29418]: cluster 2021-03-10T16:29:55.285364+0000 mgr.gibba020.yqfnwy (mgr.34427) 8285 : cluster [DBG] pgmap v4716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:56.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:56 gibba013 bash[30381]: cluster 2021-03-10T16:29:55.285364+0000 mgr.gibba020.yqfnwy (mgr.34427) 8285 : cluster [DBG] pgmap v4716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:56.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:56 gibba020 bash[25448]: cluster 2021-03-10T16:29:55.285364+0000 mgr.gibba020.yqfnwy (mgr.34427) 8285 : cluster [DBG] pgmap v4716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:58.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:29:58 gibba013 bash[29418]: cluster 2021-03-10T16:29:57.286722+0000 mgr.gibba020.yqfnwy (mgr.34427) 8286 : cluster [DBG] pgmap v4717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:58.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:29:58 gibba013 bash[30381]: cluster 2021-03-10T16:29:57.286722+0000 mgr.gibba020.yqfnwy (mgr.34427) 8286 : cluster [DBG] pgmap v4717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:29:58.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:29:58 gibba020 bash[25448]: cluster 2021-03-10T16:29:57.286722+0000 mgr.gibba020.yqfnwy (mgr.34427) 8286 : cluster [DBG] pgmap v4717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:00.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:00 gibba013 bash[29418]: debug 2021-03-10T16:29:59.997+0000 7fd718a82700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:30:00.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:00 gibba013 bash[29418]: cluster 2021-03-10T16:29:59.288138+0000 mgr.gibba020.yqfnwy (mgr.34427) 8287 : cluster [DBG] pgmap v4718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:00.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:00 gibba013 bash[29418]: cluster 2021-03-10T16:30:00.000257+0000 mon.a (mon.0) 3055 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:30:00.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:00 gibba013 bash[30381]: cluster 2021-03-10T16:29:59.288138+0000 mgr.gibba020.yqfnwy (mgr.34427) 8287 : cluster [DBG] pgmap v4718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:00.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:00 gibba013 bash[30381]: cluster 2021-03-10T16:30:00.000257+0000 mon.a (mon.0) 3055 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:30:00.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:00 gibba020 bash[25448]: cluster 2021-03-10T16:29:59.288138+0000 mgr.gibba020.yqfnwy (mgr.34427) 8287 : cluster [DBG] pgmap v4718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:00.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:00 gibba020 bash[25448]: cluster 2021-03-10T16:30:00.000257+0000 mon.a (mon.0) 3055 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:30:02.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:02 gibba013 bash[29418]: cluster 2021-03-10T16:30:01.289947+0000 mgr.gibba020.yqfnwy (mgr.34427) 8288 : cluster [DBG] pgmap v4719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:02.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:02 gibba013 bash[30381]: cluster 2021-03-10T16:30:01.289947+0000 mgr.gibba020.yqfnwy (mgr.34427) 8288 : cluster [DBG] pgmap v4719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:02.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:02 gibba020 bash[25448]: cluster 2021-03-10T16:30:01.289947+0000 mgr.gibba020.yqfnwy (mgr.34427) 8288 : cluster [DBG] pgmap v4719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:03.820 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:30:04.050 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:30:04.050 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 9m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:30:04.050 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 8m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:30:04.050 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:30:04.051 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:30:04.051 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:30:04.051 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:30:04.051 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:30:04.052 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:30:04.052 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:30:04.052 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:30:04.052 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:30:04.053 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:30:04.053 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:30:04.053 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:30:04.053 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:30:04.053 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:30:04.054 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:30:04.054 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:30:04.054 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 8m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:30:04.054 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 8m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:30:04.300 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:30:04.300 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:30:04.301 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:30:04.301 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:30:04.301 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:30:04.301 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:30:04.302 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:30:04.302 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:30:04.302 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:30:04.302 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:30:04.303 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:30:04.303 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:30:04.303 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:30:04.303 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:30:04.304 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:30:04.902 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:04 gibba020 bash[25448]: cluster 2021-03-10T16:30:03.291410+0000 mgr.gibba020.yqfnwy (mgr.34427) 8289 : cluster [DBG] pgmap v4720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:04.903 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:04 gibba020 bash[25448]: audit 2021-03-10T16:30:04.301329+0000 mon.c (mon.1) 134 : audit [DBG] from='client.? 172.21.2.113:0/729531013' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:05.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:04 gibba013 bash[29418]: cluster 2021-03-10T16:30:03.291410+0000 mgr.gibba020.yqfnwy (mgr.34427) 8289 : cluster [DBG] pgmap v4720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:05.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:04 gibba013 bash[29418]: audit 2021-03-10T16:30:04.301329+0000 mon.c (mon.1) 134 : audit [DBG] from='client.? 172.21.2.113:0/729531013' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:05.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:04 gibba013 bash[30381]: cluster 2021-03-10T16:30:03.291410+0000 mgr.gibba020.yqfnwy (mgr.34427) 8289 : cluster [DBG] pgmap v4720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:05.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:04 gibba013 bash[30381]: audit 2021-03-10T16:30:04.301329+0000 mon.c (mon.1) 134 : audit [DBG] from='client.? 172.21.2.113:0/729531013' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:05.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:05 gibba020 bash[25448]: audit 2021-03-10T16:30:03.811166+0000 mgr.gibba020.yqfnwy (mgr.34427) 8290 : audit [DBG] from='client.59596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:30:05.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:05 gibba020 bash[25448]: audit 2021-03-10T16:30:04.038166+0000 mgr.gibba020.yqfnwy (mgr.34427) 8291 : audit [DBG] from='client.59602 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:30:06.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:05 gibba013 bash[29418]: audit 2021-03-10T16:30:03.811166+0000 mgr.gibba020.yqfnwy (mgr.34427) 8290 : audit [DBG] from='client.59596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:30:06.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:05 gibba013 bash[29418]: audit 2021-03-10T16:30:04.038166+0000 mgr.gibba020.yqfnwy (mgr.34427) 8291 : audit [DBG] from='client.59602 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:30:06.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:05 gibba013 bash[30381]: audit 2021-03-10T16:30:03.811166+0000 mgr.gibba020.yqfnwy (mgr.34427) 8290 : audit [DBG] from='client.59596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:30:06.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:05 gibba013 bash[30381]: audit 2021-03-10T16:30:04.038166+0000 mgr.gibba020.yqfnwy (mgr.34427) 8291 : audit [DBG] from='client.59602 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:30:06.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:06 gibba020 bash[25448]: cephadm 2021-03-10T16:30:04.902963+0000 mgr.gibba020.yqfnwy (mgr.34427) 8292 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:30:06.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:06 gibba020 bash[25448]: cluster 2021-03-10T16:30:05.293228+0000 mgr.gibba020.yqfnwy (mgr.34427) 8293 : cluster [DBG] pgmap v4721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:07.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:06 gibba013 bash[29418]: cephadm 2021-03-10T16:30:04.902963+0000 mgr.gibba020.yqfnwy (mgr.34427) 8292 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:30:07.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:06 gibba013 bash[29418]: cluster 2021-03-10T16:30:05.293228+0000 mgr.gibba020.yqfnwy (mgr.34427) 8293 : cluster [DBG] pgmap v4721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:07.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:06 gibba013 bash[30381]: cephadm 2021-03-10T16:30:04.902963+0000 mgr.gibba020.yqfnwy (mgr.34427) 8292 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:30:07.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:06 gibba013 bash[30381]: cluster 2021-03-10T16:30:05.293228+0000 mgr.gibba020.yqfnwy (mgr.34427) 8293 : cluster [DBG] pgmap v4721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:07.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:07 gibba020 bash[25448]: audit 2021-03-10T16:30:06.713695+0000 mon.a (mon.0) 3056 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:30:07.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:07 gibba020 bash[25448]: audit 2021-03-10T16:30:06.865667+0000 mon.a (mon.0) 3057 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:30:07.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:07 gibba020 bash[25448]: audit 2021-03-10T16:30:07.145796+0000 mon.a (mon.0) 3058 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:30:07.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:07 gibba020 bash[25448]: audit 2021-03-10T16:30:07.146684+0000 mon.a (mon.0) 3059 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:30:07.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:07 gibba020 bash[25448]: audit 2021-03-10T16:30:07.147324+0000 mon.a (mon.0) 3060 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:30:07.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:07 gibba020 bash[25448]: audit 2021-03-10T16:30:07.147968+0000 mon.a (mon.0) 3061 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:30:08.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:07 gibba013 bash[29418]: audit 2021-03-10T16:30:06.713695+0000 mon.a (mon.0) 3056 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:30:08.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:07 gibba013 bash[29418]: audit 2021-03-10T16:30:06.865667+0000 mon.a (mon.0) 3057 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:30:08.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:07 gibba013 bash[29418]: audit 2021-03-10T16:30:07.145796+0000 mon.a (mon.0) 3058 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:30:08.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:07 gibba013 bash[29418]: audit 2021-03-10T16:30:07.146684+0000 mon.a (mon.0) 3059 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:30:08.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:07 gibba013 bash[29418]: audit 2021-03-10T16:30:07.147324+0000 mon.a (mon.0) 3060 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:30:08.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:07 gibba013 bash[29418]: audit 2021-03-10T16:30:07.147968+0000 mon.a (mon.0) 3061 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:30:08.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:07 gibba013 bash[30381]: audit 2021-03-10T16:30:06.713695+0000 mon.a (mon.0) 3056 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:30:08.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:07 gibba013 bash[30381]: audit 2021-03-10T16:30:06.865667+0000 mon.a (mon.0) 3057 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:30:08.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:07 gibba013 bash[30381]: audit 2021-03-10T16:30:07.145796+0000 mon.a (mon.0) 3058 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:30:08.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:07 gibba013 bash[30381]: audit 2021-03-10T16:30:07.146684+0000 mon.a (mon.0) 3059 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:30:08.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:07 gibba013 bash[30381]: audit 2021-03-10T16:30:07.147324+0000 mon.a (mon.0) 3060 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:30:08.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:07 gibba013 bash[30381]: audit 2021-03-10T16:30:07.147968+0000 mon.a (mon.0) 3061 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:30:08.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:08 gibba020 bash[25448]: cluster 2021-03-10T16:30:07.294692+0000 mgr.gibba020.yqfnwy (mgr.34427) 8294 : cluster [DBG] pgmap v4722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:09.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:08 gibba013 bash[29418]: cluster 2021-03-10T16:30:07.294692+0000 mgr.gibba020.yqfnwy (mgr.34427) 8294 : cluster [DBG] pgmap v4722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:09.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:08 gibba013 bash[30381]: cluster 2021-03-10T16:30:07.294692+0000 mgr.gibba020.yqfnwy (mgr.34427) 8294 : cluster [DBG] pgmap v4722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:10.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:10 gibba020 bash[25448]: cluster 2021-03-10T16:30:09.296376+0000 mgr.gibba020.yqfnwy (mgr.34427) 8295 : cluster [DBG] pgmap v4723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:11.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:10 gibba013 bash[29418]: cluster 2021-03-10T16:30:09.296376+0000 mgr.gibba020.yqfnwy (mgr.34427) 8295 : cluster [DBG] pgmap v4723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:11.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:10 gibba013 bash[30381]: cluster 2021-03-10T16:30:09.296376+0000 mgr.gibba020.yqfnwy (mgr.34427) 8295 : cluster [DBG] pgmap v4723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:12.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:12 gibba020 bash[25448]: cluster 2021-03-10T16:30:11.298084+0000 mgr.gibba020.yqfnwy (mgr.34427) 8296 : cluster [DBG] pgmap v4724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:13.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:12 gibba013 bash[29418]: cluster 2021-03-10T16:30:11.298084+0000 mgr.gibba020.yqfnwy (mgr.34427) 8296 : cluster [DBG] pgmap v4724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:13.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:12 gibba013 bash[30381]: cluster 2021-03-10T16:30:11.298084+0000 mgr.gibba020.yqfnwy (mgr.34427) 8296 : cluster [DBG] pgmap v4724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:14.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:14 gibba020 bash[25448]: cluster 2021-03-10T16:30:13.299450+0000 mgr.gibba020.yqfnwy (mgr.34427) 8297 : cluster [DBG] pgmap v4725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:15.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:14 gibba013 bash[29418]: cluster 2021-03-10T16:30:13.299450+0000 mgr.gibba020.yqfnwy (mgr.34427) 8297 : cluster [DBG] pgmap v4725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:15.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:14 gibba013 bash[30381]: cluster 2021-03-10T16:30:13.299450+0000 mgr.gibba020.yqfnwy (mgr.34427) 8297 : cluster [DBG] pgmap v4725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:17.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:16 gibba013 bash[29418]: cluster 2021-03-10T16:30:15.300947+0000 mgr.gibba020.yqfnwy (mgr.34427) 8298 : cluster [DBG] pgmap v4726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:17.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:16 gibba013 bash[30381]: cluster 2021-03-10T16:30:15.300947+0000 mgr.gibba020.yqfnwy (mgr.34427) 8298 : cluster [DBG] pgmap v4726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:17.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:16 gibba020 bash[25448]: cluster 2021-03-10T16:30:15.300947+0000 mgr.gibba020.yqfnwy (mgr.34427) 8298 : cluster [DBG] pgmap v4726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:19.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:18 gibba013 bash[29418]: cluster 2021-03-10T16:30:17.302325+0000 mgr.gibba020.yqfnwy (mgr.34427) 8299 : cluster [DBG] pgmap v4727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:19.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:18 gibba013 bash[30381]: cluster 2021-03-10T16:30:17.302325+0000 mgr.gibba020.yqfnwy (mgr.34427) 8299 : cluster [DBG] pgmap v4727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:19.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:18 gibba020 bash[25448]: cluster 2021-03-10T16:30:17.302325+0000 mgr.gibba020.yqfnwy (mgr.34427) 8299 : cluster [DBG] pgmap v4727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:21.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:20 gibba013 bash[29418]: cluster 2021-03-10T16:30:19.303684+0000 mgr.gibba020.yqfnwy (mgr.34427) 8300 : cluster [DBG] pgmap v4728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:21.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:20 gibba013 bash[30381]: cluster 2021-03-10T16:30:19.303684+0000 mgr.gibba020.yqfnwy (mgr.34427) 8300 : cluster [DBG] pgmap v4728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:21.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:20 gibba020 bash[25448]: cluster 2021-03-10T16:30:19.303684+0000 mgr.gibba020.yqfnwy (mgr.34427) 8300 : cluster [DBG] pgmap v4728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:22.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:21 gibba013 bash[29418]: cephadm 2021-03-10T16:30:19.919062+0000 mgr.gibba020.yqfnwy (mgr.34427) 8301 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:30:22.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:21 gibba013 bash[30381]: cephadm 2021-03-10T16:30:19.919062+0000 mgr.gibba020.yqfnwy (mgr.34427) 8301 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:30:22.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:21 gibba020 bash[25448]: cephadm 2021-03-10T16:30:19.919062+0000 mgr.gibba020.yqfnwy (mgr.34427) 8301 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:30:23.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:22 gibba013 bash[29418]: cluster 2021-03-10T16:30:21.305425+0000 mgr.gibba020.yqfnwy (mgr.34427) 8302 : cluster [DBG] pgmap v4729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:23.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:22 gibba013 bash[30381]: cluster 2021-03-10T16:30:21.305425+0000 mgr.gibba020.yqfnwy (mgr.34427) 8302 : cluster [DBG] pgmap v4729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:23.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:22 gibba020 bash[25448]: cluster 2021-03-10T16:30:21.305425+0000 mgr.gibba020.yqfnwy (mgr.34427) 8302 : cluster [DBG] pgmap v4729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:24.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:23 gibba013 bash[29418]: cluster 2021-03-10T16:30:23.306794+0000 mgr.gibba020.yqfnwy (mgr.34427) 8303 : cluster [DBG] pgmap v4730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:24.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:23 gibba013 bash[30381]: cluster 2021-03-10T16:30:23.306794+0000 mgr.gibba020.yqfnwy (mgr.34427) 8303 : cluster [DBG] pgmap v4730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:24.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:23 gibba020 bash[25448]: cluster 2021-03-10T16:30:23.306794+0000 mgr.gibba020.yqfnwy (mgr.34427) 8303 : cluster [DBG] pgmap v4730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:26.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:26 gibba013 bash[29418]: cluster 2021-03-10T16:30:25.308281+0000 mgr.gibba020.yqfnwy (mgr.34427) 8304 : cluster [DBG] pgmap v4731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:26.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:26 gibba013 bash[30381]: cluster 2021-03-10T16:30:25.308281+0000 mgr.gibba020.yqfnwy (mgr.34427) 8304 : cluster [DBG] pgmap v4731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:26.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:26 gibba020 bash[25448]: cluster 2021-03-10T16:30:25.308281+0000 mgr.gibba020.yqfnwy (mgr.34427) 8304 : cluster [DBG] pgmap v4731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:28.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:28 gibba013 bash[29418]: cluster 2021-03-10T16:30:27.309860+0000 mgr.gibba020.yqfnwy (mgr.34427) 8305 : cluster [DBG] pgmap v4732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:28.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:28 gibba013 bash[30381]: cluster 2021-03-10T16:30:27.309860+0000 mgr.gibba020.yqfnwy (mgr.34427) 8305 : cluster [DBG] pgmap v4732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:28.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:28 gibba020 bash[25448]: cluster 2021-03-10T16:30:27.309860+0000 mgr.gibba020.yqfnwy (mgr.34427) 8305 : cluster [DBG] pgmap v4732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:30.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:30 gibba013 bash[29418]: cluster 2021-03-10T16:30:29.311233+0000 mgr.gibba020.yqfnwy (mgr.34427) 8306 : cluster [DBG] pgmap v4733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:30.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:30 gibba013 bash[30381]: cluster 2021-03-10T16:30:29.311233+0000 mgr.gibba020.yqfnwy (mgr.34427) 8306 : cluster [DBG] pgmap v4733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:30.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:30 gibba020 bash[25448]: cluster 2021-03-10T16:30:29.311233+0000 mgr.gibba020.yqfnwy (mgr.34427) 8306 : cluster [DBG] pgmap v4733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:32.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:32 gibba013 bash[29418]: cluster 2021-03-10T16:30:31.312990+0000 mgr.gibba020.yqfnwy (mgr.34427) 8307 : cluster [DBG] pgmap v4734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:32.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:32 gibba013 bash[30381]: cluster 2021-03-10T16:30:31.312990+0000 mgr.gibba020.yqfnwy (mgr.34427) 8307 : cluster [DBG] pgmap v4734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:32.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:32 gibba020 bash[25448]: cluster 2021-03-10T16:30:31.312990+0000 mgr.gibba020.yqfnwy (mgr.34427) 8307 : cluster [DBG] pgmap v4734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:34.549 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:30:34.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:34 gibba013 bash[29418]: cluster 2021-03-10T16:30:33.314369+0000 mgr.gibba020.yqfnwy (mgr.34427) 8308 : cluster [DBG] pgmap v4735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:34.627 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:34 gibba013 bash[30381]: cluster 2021-03-10T16:30:33.314369+0000 mgr.gibba020.yqfnwy (mgr.34427) 8308 : cluster [DBG] pgmap v4735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:34.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:34 gibba020 bash[25448]: cluster 2021-03-10T16:30:33.314369+0000 mgr.gibba020.yqfnwy (mgr.34427) 8308 : cluster [DBG] pgmap v4735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:34.775 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:30:34.776 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 10m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:30:34.776 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 9m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:30:34.776 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:30:34.777 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:30:34.777 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:30:34.777 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:30:34.777 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:30:34.777 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:30:34.778 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 10m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:30:34.778 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:30:34.778 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:30:34.778 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:30:34.779 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:30:34.779 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:30:34.779 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:30:34.779 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:30:34.780 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:30:34.780 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:30:34.780 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 9m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:30:34.780 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 9m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:30:35.027 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:30:35.028 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:30:35.028 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:30:35.028 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:30:35.028 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:30:35.029 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:30:35.029 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:30:35.029 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:30:35.029 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:30:35.030 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:30:35.030 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:30:35.030 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:30:35.030 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:30:35.030 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:30:35.031 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:30:35.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:35 gibba013 bash[29418]: audit 2021-03-10T16:30:34.541038+0000 mgr.gibba020.yqfnwy (mgr.34427) 8309 : audit [DBG] from='client.59614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:30:35.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:35 gibba013 bash[29418]: audit 2021-03-10T16:30:34.935877+0000 mon.a (mon.0) 3062 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:30:35.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:35 gibba013 bash[29418]: audit 2021-03-10T16:30:34.940516+0000 mon.a (mon.0) 3063 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:30:35.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:35 gibba013 bash[29418]: audit 2021-03-10T16:30:35.028795+0000 mon.a (mon.0) 3064 : audit [DBG] from='client.? 172.21.2.113:0/464452076' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:35.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:35 gibba013 bash[30381]: audit 2021-03-10T16:30:34.541038+0000 mgr.gibba020.yqfnwy (mgr.34427) 8309 : audit [DBG] from='client.59614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:30:35.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:35 gibba013 bash[30381]: audit 2021-03-10T16:30:34.935877+0000 mon.a (mon.0) 3062 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:30:35.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:35 gibba013 bash[30381]: audit 2021-03-10T16:30:34.940516+0000 mon.a (mon.0) 3063 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:30:35.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:35 gibba013 bash[30381]: audit 2021-03-10T16:30:35.028795+0000 mon.a (mon.0) 3064 : audit [DBG] from='client.? 172.21.2.113:0/464452076' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:35.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:35 gibba020 bash[25448]: audit 2021-03-10T16:30:34.541038+0000 mgr.gibba020.yqfnwy (mgr.34427) 8309 : audit [DBG] from='client.59614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:30:35.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:35 gibba020 bash[25448]: audit 2021-03-10T16:30:34.935877+0000 mon.a (mon.0) 3062 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:30:35.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:35 gibba020 bash[25448]: audit 2021-03-10T16:30:34.940516+0000 mon.a (mon.0) 3063 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:30:35.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:35 gibba020 bash[25448]: audit 2021-03-10T16:30:35.028795+0000 mon.a (mon.0) 3064 : audit [DBG] from='client.? 172.21.2.113:0/464452076' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:36.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:36 gibba013 bash[29418]: audit 2021-03-10T16:30:34.763856+0000 mgr.gibba020.yqfnwy (mgr.34427) 8310 : audit [DBG] from='client.59620 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:30:36.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:36 gibba013 bash[29418]: cephadm 2021-03-10T16:30:34.940295+0000 mgr.gibba020.yqfnwy (mgr.34427) 8311 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:30:36.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:36 gibba013 bash[29418]: cluster 2021-03-10T16:30:35.316019+0000 mgr.gibba020.yqfnwy (mgr.34427) 8312 : cluster [DBG] pgmap v4736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:36.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:36 gibba013 bash[30381]: audit 2021-03-10T16:30:34.763856+0000 mgr.gibba020.yqfnwy (mgr.34427) 8310 : audit [DBG] from='client.59620 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:30:36.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:36 gibba013 bash[30381]: cephadm 2021-03-10T16:30:34.940295+0000 mgr.gibba020.yqfnwy (mgr.34427) 8311 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:30:36.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:36 gibba013 bash[30381]: cluster 2021-03-10T16:30:35.316019+0000 mgr.gibba020.yqfnwy (mgr.34427) 8312 : cluster [DBG] pgmap v4736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:36.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:36 gibba020 bash[25448]: audit 2021-03-10T16:30:34.763856+0000 mgr.gibba020.yqfnwy (mgr.34427) 8310 : audit [DBG] from='client.59620 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:30:36.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:36 gibba020 bash[25448]: cephadm 2021-03-10T16:30:34.940295+0000 mgr.gibba020.yqfnwy (mgr.34427) 8311 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:30:36.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:36 gibba020 bash[25448]: cluster 2021-03-10T16:30:35.316019+0000 mgr.gibba020.yqfnwy (mgr.34427) 8312 : cluster [DBG] pgmap v4736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:38.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:38 gibba020 bash[25448]: cluster 2021-03-10T16:30:37.317462+0000 mgr.gibba020.yqfnwy (mgr.34427) 8313 : cluster [DBG] pgmap v4737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:38.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:38 gibba013 bash[29418]: cluster 2021-03-10T16:30:37.317462+0000 mgr.gibba020.yqfnwy (mgr.34427) 8313 : cluster [DBG] pgmap v4737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:38.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:38 gibba013 bash[30381]: cluster 2021-03-10T16:30:37.317462+0000 mgr.gibba020.yqfnwy (mgr.34427) 8313 : cluster [DBG] pgmap v4737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:39.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:39 gibba013 bash[29418]: audit 2021-03-10T16:30:38.482822+0000 mon.a (mon.0) 3065 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:30:39.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:39 gibba013 bash[29418]: cephadm 2021-03-10T16:30:38.483153+0000 mgr.gibba020.yqfnwy (mgr.34427) 8314 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:30:39.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:39 gibba013 bash[29418]: audit 2021-03-10T16:30:38.763058+0000 mon.a (mon.0) 3066 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:30:39.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:39 gibba013 bash[29418]: audit 2021-03-10T16:30:38.770353+0000 mon.a (mon.0) 3067 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:30:39.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:39 gibba013 bash[29418]: audit 2021-03-10T16:30:38.772496+0000 mon.a (mon.0) 3068 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:39.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:39 gibba013 bash[29418]: audit 2021-03-10T16:30:38.774447+0000 mon.a (mon.0) 3069 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:39.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:39 gibba013 bash[29418]: audit 2021-03-10T16:30:38.776613+0000 mon.a (mon.0) 3070 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:39.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:39 gibba013 bash[29418]: audit 2021-03-10T16:30:38.780266+0000 mon.a (mon.0) 3071 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:39.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:39 gibba013 bash[29418]: audit 2021-03-10T16:30:38.782306+0000 mon.a (mon.0) 3072 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:39.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:39 gibba013 bash[30381]: audit 2021-03-10T16:30:38.482822+0000 mon.a (mon.0) 3065 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:30:39.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:39 gibba013 bash[30381]: cephadm 2021-03-10T16:30:38.483153+0000 mgr.gibba020.yqfnwy (mgr.34427) 8314 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:30:39.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:39 gibba013 bash[30381]: audit 2021-03-10T16:30:38.763058+0000 mon.a (mon.0) 3066 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:30:39.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:39 gibba013 bash[30381]: audit 2021-03-10T16:30:38.770353+0000 mon.a (mon.0) 3067 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:30:39.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:39 gibba013 bash[30381]: audit 2021-03-10T16:30:38.772496+0000 mon.a (mon.0) 3068 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:39.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:39 gibba013 bash[30381]: audit 2021-03-10T16:30:38.774447+0000 mon.a (mon.0) 3069 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:39.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:39 gibba013 bash[30381]: audit 2021-03-10T16:30:38.776613+0000 mon.a (mon.0) 3070 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:39.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:39 gibba013 bash[30381]: audit 2021-03-10T16:30:38.780266+0000 mon.a (mon.0) 3071 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:39.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:39 gibba013 bash[30381]: audit 2021-03-10T16:30:38.782306+0000 mon.a (mon.0) 3072 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:39.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:39 gibba020 bash[25448]: audit 2021-03-10T16:30:38.482822+0000 mon.a (mon.0) 3065 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:30:39.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:39 gibba020 bash[25448]: cephadm 2021-03-10T16:30:38.483153+0000 mgr.gibba020.yqfnwy (mgr.34427) 8314 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:30:39.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:39 gibba020 bash[25448]: audit 2021-03-10T16:30:38.763058+0000 mon.a (mon.0) 3066 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:30:39.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:39 gibba020 bash[25448]: audit 2021-03-10T16:30:38.770353+0000 mon.a (mon.0) 3067 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:30:39.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:39 gibba020 bash[25448]: audit 2021-03-10T16:30:38.772496+0000 mon.a (mon.0) 3068 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:39.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:39 gibba020 bash[25448]: audit 2021-03-10T16:30:38.774447+0000 mon.a (mon.0) 3069 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:39.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:39 gibba020 bash[25448]: audit 2021-03-10T16:30:38.776613+0000 mon.a (mon.0) 3070 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:39.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:39 gibba020 bash[25448]: audit 2021-03-10T16:30:38.780266+0000 mon.a (mon.0) 3071 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:39.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:39 gibba020 bash[25448]: audit 2021-03-10T16:30:38.782306+0000 mon.a (mon.0) 3072 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:30:40.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:40 gibba013 bash[29418]: cephadm 2021-03-10T16:30:38.769159+0000 mgr.gibba020.yqfnwy (mgr.34427) 8315 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:30:40.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:40 gibba013 bash[29418]: cephadm 2021-03-10T16:30:38.771357+0000 mgr.gibba020.yqfnwy (mgr.34427) 8316 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:30:40.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:40 gibba013 bash[29418]: cephadm 2021-03-10T16:30:38.773470+0000 mgr.gibba020.yqfnwy (mgr.34427) 8317 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:30:40.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:40 gibba013 bash[29418]: cephadm 2021-03-10T16:30:38.773513+0000 mgr.gibba020.yqfnwy (mgr.34427) 8318 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:30:40.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:40 gibba013 bash[29418]: cephadm 2021-03-10T16:30:38.775549+0000 mgr.gibba020.yqfnwy (mgr.34427) 8319 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:30:40.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:40 gibba013 bash[29418]: cephadm 2021-03-10T16:30:38.775589+0000 mgr.gibba020.yqfnwy (mgr.34427) 8320 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:30:40.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:40 gibba013 bash[29418]: cephadm 2021-03-10T16:30:38.777608+0000 mgr.gibba020.yqfnwy (mgr.34427) 8321 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:30:40.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:40 gibba013 bash[29418]: cephadm 2021-03-10T16:30:38.779138+0000 mgr.gibba020.yqfnwy (mgr.34427) 8322 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:30:40.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:40 gibba013 bash[29418]: cephadm 2021-03-10T16:30:38.779184+0000 mgr.gibba020.yqfnwy (mgr.34427) 8323 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:30:40.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:40 gibba013 bash[29418]: cephadm 2021-03-10T16:30:38.780944+0000 mgr.gibba020.yqfnwy (mgr.34427) 8324 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:30:40.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:40 gibba013 bash[29418]: cephadm 2021-03-10T16:30:38.781380+0000 mgr.gibba020.yqfnwy (mgr.34427) 8325 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:30:40.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:40 gibba013 bash[29418]: cephadm 2021-03-10T16:30:38.782952+0000 mgr.gibba020.yqfnwy (mgr.34427) 8326 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:30:40.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:40 gibba013 bash[29418]: cephadm 2021-03-10T16:30:38.782994+0000 mgr.gibba020.yqfnwy (mgr.34427) 8327 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:30:40.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:40 gibba013 bash[29418]: cephadm 2021-03-10T16:30:38.783112+0000 mgr.gibba020.yqfnwy (mgr.34427) 8328 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:30:40.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:40 gibba013 bash[29418]: cluster 2021-03-10T16:30:39.318679+0000 mgr.gibba020.yqfnwy (mgr.34427) 8329 : cluster [DBG] pgmap v4738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:40.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:40 gibba013 bash[30381]: cephadm 2021-03-10T16:30:38.769159+0000 mgr.gibba020.yqfnwy (mgr.34427) 8315 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:30:40.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:40 gibba013 bash[30381]: cephadm 2021-03-10T16:30:38.771357+0000 mgr.gibba020.yqfnwy (mgr.34427) 8316 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:30:40.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:40 gibba013 bash[30381]: cephadm 2021-03-10T16:30:38.773470+0000 mgr.gibba020.yqfnwy (mgr.34427) 8317 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:30:40.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:40 gibba013 bash[30381]: cephadm 2021-03-10T16:30:38.773513+0000 mgr.gibba020.yqfnwy (mgr.34427) 8318 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:30:40.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:40 gibba013 bash[30381]: cephadm 2021-03-10T16:30:38.775549+0000 mgr.gibba020.yqfnwy (mgr.34427) 8319 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:30:40.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:40 gibba013 bash[30381]: cephadm 2021-03-10T16:30:38.775589+0000 mgr.gibba020.yqfnwy (mgr.34427) 8320 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:30:40.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:40 gibba013 bash[30381]: cephadm 2021-03-10T16:30:38.777608+0000 mgr.gibba020.yqfnwy (mgr.34427) 8321 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:30:40.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:40 gibba013 bash[30381]: cephadm 2021-03-10T16:30:38.779138+0000 mgr.gibba020.yqfnwy (mgr.34427) 8322 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:30:40.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:40 gibba013 bash[30381]: cephadm 2021-03-10T16:30:38.779184+0000 mgr.gibba020.yqfnwy (mgr.34427) 8323 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:30:40.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:40 gibba013 bash[30381]: cephadm 2021-03-10T16:30:38.780944+0000 mgr.gibba020.yqfnwy (mgr.34427) 8324 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:30:40.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:40 gibba013 bash[30381]: cephadm 2021-03-10T16:30:38.781380+0000 mgr.gibba020.yqfnwy (mgr.34427) 8325 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:30:40.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:40 gibba013 bash[30381]: cephadm 2021-03-10T16:30:38.782952+0000 mgr.gibba020.yqfnwy (mgr.34427) 8326 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:30:40.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:40 gibba013 bash[30381]: cephadm 2021-03-10T16:30:38.782994+0000 mgr.gibba020.yqfnwy (mgr.34427) 8327 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:30:40.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:40 gibba013 bash[30381]: cephadm 2021-03-10T16:30:38.783112+0000 mgr.gibba020.yqfnwy (mgr.34427) 8328 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:30:40.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:40 gibba013 bash[30381]: cluster 2021-03-10T16:30:39.318679+0000 mgr.gibba020.yqfnwy (mgr.34427) 8329 : cluster [DBG] pgmap v4738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:40.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:40 gibba020 bash[25448]: cephadm 2021-03-10T16:30:38.769159+0000 mgr.gibba020.yqfnwy (mgr.34427) 8315 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:30:40.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:40 gibba020 bash[25448]: cephadm 2021-03-10T16:30:38.771357+0000 mgr.gibba020.yqfnwy (mgr.34427) 8316 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:30:40.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:40 gibba020 bash[25448]: cephadm 2021-03-10T16:30:38.773470+0000 mgr.gibba020.yqfnwy (mgr.34427) 8317 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:30:40.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:40 gibba020 bash[25448]: cephadm 2021-03-10T16:30:38.773513+0000 mgr.gibba020.yqfnwy (mgr.34427) 8318 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:30:40.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:40 gibba020 bash[25448]: cephadm 2021-03-10T16:30:38.775549+0000 mgr.gibba020.yqfnwy (mgr.34427) 8319 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:30:40.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:40 gibba020 bash[25448]: cephadm 2021-03-10T16:30:38.775589+0000 mgr.gibba020.yqfnwy (mgr.34427) 8320 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:30:40.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:40 gibba020 bash[25448]: cephadm 2021-03-10T16:30:38.777608+0000 mgr.gibba020.yqfnwy (mgr.34427) 8321 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:30:40.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:40 gibba020 bash[25448]: cephadm 2021-03-10T16:30:38.779138+0000 mgr.gibba020.yqfnwy (mgr.34427) 8322 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:30:40.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:40 gibba020 bash[25448]: cephadm 2021-03-10T16:30:38.779184+0000 mgr.gibba020.yqfnwy (mgr.34427) 8323 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:30:40.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:40 gibba020 bash[25448]: cephadm 2021-03-10T16:30:38.780944+0000 mgr.gibba020.yqfnwy (mgr.34427) 8324 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:30:40.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:40 gibba020 bash[25448]: cephadm 2021-03-10T16:30:38.781380+0000 mgr.gibba020.yqfnwy (mgr.34427) 8325 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:30:40.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:40 gibba020 bash[25448]: cephadm 2021-03-10T16:30:38.782952+0000 mgr.gibba020.yqfnwy (mgr.34427) 8326 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:30:40.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:40 gibba020 bash[25448]: cephadm 2021-03-10T16:30:38.782994+0000 mgr.gibba020.yqfnwy (mgr.34427) 8327 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:30:40.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:40 gibba020 bash[25448]: cephadm 2021-03-10T16:30:38.783112+0000 mgr.gibba020.yqfnwy (mgr.34427) 8328 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:30:40.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:40 gibba020 bash[25448]: cluster 2021-03-10T16:30:39.318679+0000 mgr.gibba020.yqfnwy (mgr.34427) 8329 : cluster [DBG] pgmap v4738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:42.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:42 gibba013 bash[29418]: cluster 2021-03-10T16:30:41.320590+0000 mgr.gibba020.yqfnwy (mgr.34427) 8330 : cluster [DBG] pgmap v4739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:42.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:42 gibba013 bash[30381]: cluster 2021-03-10T16:30:41.320590+0000 mgr.gibba020.yqfnwy (mgr.34427) 8330 : cluster [DBG] pgmap v4739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:42.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:42 gibba020 bash[25448]: cluster 2021-03-10T16:30:41.320590+0000 mgr.gibba020.yqfnwy (mgr.34427) 8330 : cluster [DBG] pgmap v4739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:44.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:44 gibba013 bash[29418]: cluster 2021-03-10T16:30:43.322035+0000 mgr.gibba020.yqfnwy (mgr.34427) 8331 : cluster [DBG] pgmap v4740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:44.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:44 gibba013 bash[30381]: cluster 2021-03-10T16:30:43.322035+0000 mgr.gibba020.yqfnwy (mgr.34427) 8331 : cluster [DBG] pgmap v4740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:44.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:44 gibba020 bash[25448]: cluster 2021-03-10T16:30:43.322035+0000 mgr.gibba020.yqfnwy (mgr.34427) 8331 : cluster [DBG] pgmap v4740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:46.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:46 gibba013 bash[29418]: cluster 2021-03-10T16:30:45.322544+0000 mgr.gibba020.yqfnwy (mgr.34427) 8332 : cluster [DBG] pgmap v4741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:46.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:46 gibba013 bash[30381]: cluster 2021-03-10T16:30:45.322544+0000 mgr.gibba020.yqfnwy (mgr.34427) 8332 : cluster [DBG] pgmap v4741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:46.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:46 gibba020 bash[25448]: cluster 2021-03-10T16:30:45.322544+0000 mgr.gibba020.yqfnwy (mgr.34427) 8332 : cluster [DBG] pgmap v4741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:48.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:48 gibba013 bash[29418]: cluster 2021-03-10T16:30:47.323875+0000 mgr.gibba020.yqfnwy (mgr.34427) 8333 : cluster [DBG] pgmap v4742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:48.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:48 gibba013 bash[30381]: cluster 2021-03-10T16:30:47.323875+0000 mgr.gibba020.yqfnwy (mgr.34427) 8333 : cluster [DBG] pgmap v4742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:48.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:48 gibba020 bash[25448]: cluster 2021-03-10T16:30:47.323875+0000 mgr.gibba020.yqfnwy (mgr.34427) 8333 : cluster [DBG] pgmap v4742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:50.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:50 gibba013 bash[29418]: cluster 2021-03-10T16:30:49.325464+0000 mgr.gibba020.yqfnwy (mgr.34427) 8334 : cluster [DBG] pgmap v4743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:50.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:50 gibba013 bash[30381]: cluster 2021-03-10T16:30:49.325464+0000 mgr.gibba020.yqfnwy (mgr.34427) 8334 : cluster [DBG] pgmap v4743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:50.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:50 gibba020 bash[25448]: cluster 2021-03-10T16:30:49.325464+0000 mgr.gibba020.yqfnwy (mgr.34427) 8334 : cluster [DBG] pgmap v4743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:52.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:52 gibba013 bash[29418]: cluster 2021-03-10T16:30:51.327263+0000 mgr.gibba020.yqfnwy (mgr.34427) 8335 : cluster [DBG] pgmap v4744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:52.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:52 gibba013 bash[30381]: cluster 2021-03-10T16:30:51.327263+0000 mgr.gibba020.yqfnwy (mgr.34427) 8335 : cluster [DBG] pgmap v4744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:52.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:52 gibba020 bash[25448]: cluster 2021-03-10T16:30:51.327263+0000 mgr.gibba020.yqfnwy (mgr.34427) 8335 : cluster [DBG] pgmap v4744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:54.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:54 gibba013 bash[29418]: cluster 2021-03-10T16:30:53.328832+0000 mgr.gibba020.yqfnwy (mgr.34427) 8336 : cluster [DBG] pgmap v4745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:54.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:54 gibba013 bash[30381]: cluster 2021-03-10T16:30:53.328832+0000 mgr.gibba020.yqfnwy (mgr.34427) 8336 : cluster [DBG] pgmap v4745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:54.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:54 gibba020 bash[25448]: cluster 2021-03-10T16:30:53.328832+0000 mgr.gibba020.yqfnwy (mgr.34427) 8336 : cluster [DBG] pgmap v4745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:55.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:55 gibba013 bash[29418]: cephadm 2021-03-10T16:30:53.798834+0000 mgr.gibba020.yqfnwy (mgr.34427) 8337 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:30:55.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:55 gibba013 bash[30381]: cephadm 2021-03-10T16:30:53.798834+0000 mgr.gibba020.yqfnwy (mgr.34427) 8337 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:30:55.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:55 gibba020 bash[25448]: cephadm 2021-03-10T16:30:53.798834+0000 mgr.gibba020.yqfnwy (mgr.34427) 8337 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:30:56.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:56 gibba013 bash[29418]: cluster 2021-03-10T16:30:55.330566+0000 mgr.gibba020.yqfnwy (mgr.34427) 8338 : cluster [DBG] pgmap v4746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:56.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:56 gibba013 bash[30381]: cluster 2021-03-10T16:30:55.330566+0000 mgr.gibba020.yqfnwy (mgr.34427) 8338 : cluster [DBG] pgmap v4746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:56.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:56 gibba020 bash[25448]: cluster 2021-03-10T16:30:55.330566+0000 mgr.gibba020.yqfnwy (mgr.34427) 8338 : cluster [DBG] pgmap v4746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:58.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:30:58 gibba013 bash[29418]: cluster 2021-03-10T16:30:57.332237+0000 mgr.gibba020.yqfnwy (mgr.34427) 8339 : cluster [DBG] pgmap v4747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:58.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:30:58 gibba013 bash[30381]: cluster 2021-03-10T16:30:57.332237+0000 mgr.gibba020.yqfnwy (mgr.34427) 8339 : cluster [DBG] pgmap v4747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:30:58.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:30:58 gibba020 bash[25448]: cluster 2021-03-10T16:30:57.332237+0000 mgr.gibba020.yqfnwy (mgr.34427) 8339 : cluster [DBG] pgmap v4747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:00.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:00 gibba013 bash[29418]: cluster 2021-03-10T16:30:59.333510+0000 mgr.gibba020.yqfnwy (mgr.34427) 8340 : cluster [DBG] pgmap v4748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:00.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:00 gibba013 bash[30381]: cluster 2021-03-10T16:30:59.333510+0000 mgr.gibba020.yqfnwy (mgr.34427) 8340 : cluster [DBG] pgmap v4748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:00.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:00 gibba020 bash[25448]: cluster 2021-03-10T16:30:59.333510+0000 mgr.gibba020.yqfnwy (mgr.34427) 8340 : cluster [DBG] pgmap v4748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:02.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:02 gibba013 bash[29418]: cluster 2021-03-10T16:31:01.334309+0000 mgr.gibba020.yqfnwy (mgr.34427) 8341 : cluster [DBG] pgmap v4749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:02.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:02 gibba013 bash[30381]: cluster 2021-03-10T16:31:01.334309+0000 mgr.gibba020.yqfnwy (mgr.34427) 8341 : cluster [DBG] pgmap v4749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:02.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:02 gibba020 bash[25448]: cluster 2021-03-10T16:31:01.334309+0000 mgr.gibba020.yqfnwy (mgr.34427) 8341 : cluster [DBG] pgmap v4749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:04.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:04 gibba013 bash[29418]: cluster 2021-03-10T16:31:03.335550+0000 mgr.gibba020.yqfnwy (mgr.34427) 8342 : cluster [DBG] pgmap v4750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:04.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:04 gibba013 bash[30381]: cluster 2021-03-10T16:31:03.335550+0000 mgr.gibba020.yqfnwy (mgr.34427) 8342 : cluster [DBG] pgmap v4750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:04.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:04 gibba020 bash[25448]: cluster 2021-03-10T16:31:03.335550+0000 mgr.gibba020.yqfnwy (mgr.34427) 8342 : cluster [DBG] pgmap v4750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:05.272 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:31:05.502 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:31:05.503 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 27s ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:31:05.503 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 9m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:31:05.503 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:31:05.503 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:31:05.504 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 27s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:31:05.504 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 27s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:31:05.504 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:31:05.504 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 27s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:31:05.505 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 27s ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:31:05.505 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:31:05.505 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 27s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:31:05.505 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 27s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:31:05.506 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 27s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:31:05.506 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 27s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:31:05.506 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:31:05.506 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:31:05.507 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:31:05.507 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:31:05.507 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 9m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:31:05.507 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 9m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:31:05.752 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:31:05.752 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:31:05.753 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:31:05.753 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:31:05.753 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:31:05.754 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:31:05.754 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:31:05.754 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:31:05.755 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:31:05.755 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:31:05.755 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:31:05.755 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:31:05.756 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:31:05.756 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:31:05.756 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:31:06.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:06 gibba013 bash[29418]: audit 2021-03-10T16:31:05.263983+0000 mgr.gibba020.yqfnwy (mgr.34427) 8343 : audit [DBG] from='client.49650 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:31:06.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:06 gibba013 bash[29418]: cluster 2021-03-10T16:31:05.337066+0000 mgr.gibba020.yqfnwy (mgr.34427) 8344 : cluster [DBG] pgmap v4751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:06.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:06 gibba013 bash[29418]: audit 2021-03-10T16:31:05.491989+0000 mgr.gibba020.yqfnwy (mgr.34427) 8345 : audit [DBG] from='client.49656 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:31:06.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:06 gibba013 bash[29418]: audit 2021-03-10T16:31:05.753439+0000 mon.c (mon.1) 135 : audit [DBG] from='client.? 172.21.2.113:0/2647590752' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:06.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:06 gibba013 bash[30381]: audit 2021-03-10T16:31:05.263983+0000 mgr.gibba020.yqfnwy (mgr.34427) 8343 : audit [DBG] from='client.49650 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:31:06.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:06 gibba013 bash[30381]: cluster 2021-03-10T16:31:05.337066+0000 mgr.gibba020.yqfnwy (mgr.34427) 8344 : cluster [DBG] pgmap v4751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:06.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:06 gibba013 bash[30381]: audit 2021-03-10T16:31:05.491989+0000 mgr.gibba020.yqfnwy (mgr.34427) 8345 : audit [DBG] from='client.49656 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:31:06.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:06 gibba013 bash[30381]: audit 2021-03-10T16:31:05.753439+0000 mon.c (mon.1) 135 : audit [DBG] from='client.? 172.21.2.113:0/2647590752' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:06.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:06 gibba020 bash[25448]: audit 2021-03-10T16:31:05.263983+0000 mgr.gibba020.yqfnwy (mgr.34427) 8343 : audit [DBG] from='client.49650 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:31:06.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:06 gibba020 bash[25448]: cluster 2021-03-10T16:31:05.337066+0000 mgr.gibba020.yqfnwy (mgr.34427) 8344 : cluster [DBG] pgmap v4751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:06.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:06 gibba020 bash[25448]: audit 2021-03-10T16:31:05.491989+0000 mgr.gibba020.yqfnwy (mgr.34427) 8345 : audit [DBG] from='client.49656 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:31:06.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:06 gibba020 bash[25448]: audit 2021-03-10T16:31:05.753439+0000 mon.c (mon.1) 135 : audit [DBG] from='client.? 172.21.2.113:0/2647590752' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:07.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:07 gibba013 bash[29418]: audit 2021-03-10T16:31:06.718511+0000 mon.a (mon.0) 3073 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:31:07.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:07 gibba013 bash[29418]: audit 2021-03-10T16:31:06.872152+0000 mon.a (mon.0) 3074 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:31:07.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:07 gibba013 bash[29418]: audit 2021-03-10T16:31:07.157585+0000 mon.a (mon.0) 3075 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:31:07.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:07 gibba013 bash[29418]: audit 2021-03-10T16:31:07.158695+0000 mon.a (mon.0) 3076 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:31:07.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:07 gibba013 bash[29418]: audit 2021-03-10T16:31:07.159696+0000 mon.a (mon.0) 3077 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:31:07.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:07 gibba013 bash[29418]: audit 2021-03-10T16:31:07.160713+0000 mon.a (mon.0) 3078 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:31:07.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:07 gibba013 bash[30381]: audit 2021-03-10T16:31:06.718511+0000 mon.a (mon.0) 3073 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:31:07.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:07 gibba013 bash[30381]: audit 2021-03-10T16:31:06.872152+0000 mon.a (mon.0) 3074 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:31:07.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:07 gibba013 bash[30381]: audit 2021-03-10T16:31:07.157585+0000 mon.a (mon.0) 3075 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:31:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:07 gibba013 bash[30381]: audit 2021-03-10T16:31:07.158695+0000 mon.a (mon.0) 3076 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:31:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:07 gibba013 bash[30381]: audit 2021-03-10T16:31:07.159696+0000 mon.a (mon.0) 3077 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:31:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:07 gibba013 bash[30381]: audit 2021-03-10T16:31:07.160713+0000 mon.a (mon.0) 3078 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:31:07.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:07 gibba020 bash[25448]: audit 2021-03-10T16:31:06.718511+0000 mon.a (mon.0) 3073 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:31:07.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:07 gibba020 bash[25448]: audit 2021-03-10T16:31:06.872152+0000 mon.a (mon.0) 3074 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:31:07.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:07 gibba020 bash[25448]: audit 2021-03-10T16:31:07.157585+0000 mon.a (mon.0) 3075 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:31:07.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:07 gibba020 bash[25448]: audit 2021-03-10T16:31:07.158695+0000 mon.a (mon.0) 3076 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:31:07.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:07 gibba020 bash[25448]: audit 2021-03-10T16:31:07.159696+0000 mon.a (mon.0) 3077 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:31:07.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:07 gibba020 bash[25448]: audit 2021-03-10T16:31:07.160713+0000 mon.a (mon.0) 3078 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:31:08.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:08 gibba013 bash[29418]: cluster 2021-03-10T16:31:07.338546+0000 mgr.gibba020.yqfnwy (mgr.34427) 8346 : cluster [DBG] pgmap v4752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:08.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:08 gibba013 bash[30381]: cluster 2021-03-10T16:31:07.338546+0000 mgr.gibba020.yqfnwy (mgr.34427) 8346 : cluster [DBG] pgmap v4752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:08.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:08 gibba020 bash[25448]: cluster 2021-03-10T16:31:07.338546+0000 mgr.gibba020.yqfnwy (mgr.34427) 8346 : cluster [DBG] pgmap v4752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:10.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:10 gibba020 bash[25448]: cephadm 2021-03-10T16:31:08.814766+0000 mgr.gibba020.yqfnwy (mgr.34427) 8347 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:31:10.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:10 gibba020 bash[25448]: cluster 2021-03-10T16:31:09.339098+0000 mgr.gibba020.yqfnwy (mgr.34427) 8348 : cluster [DBG] pgmap v4753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:11.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:10 gibba013 bash[29418]: cephadm 2021-03-10T16:31:08.814766+0000 mgr.gibba020.yqfnwy (mgr.34427) 8347 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:31:11.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:10 gibba013 bash[29418]: cluster 2021-03-10T16:31:09.339098+0000 mgr.gibba020.yqfnwy (mgr.34427) 8348 : cluster [DBG] pgmap v4753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:11.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:10 gibba013 bash[30381]: cephadm 2021-03-10T16:31:08.814766+0000 mgr.gibba020.yqfnwy (mgr.34427) 8347 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:31:11.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:10 gibba013 bash[30381]: cluster 2021-03-10T16:31:09.339098+0000 mgr.gibba020.yqfnwy (mgr.34427) 8348 : cluster [DBG] pgmap v4753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:12.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:12 gibba020 bash[25448]: cluster 2021-03-10T16:31:11.340838+0000 mgr.gibba020.yqfnwy (mgr.34427) 8349 : cluster [DBG] pgmap v4754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:13.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:12 gibba013 bash[29418]: cluster 2021-03-10T16:31:11.340838+0000 mgr.gibba020.yqfnwy (mgr.34427) 8349 : cluster [DBG] pgmap v4754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:13.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:12 gibba013 bash[30381]: cluster 2021-03-10T16:31:11.340838+0000 mgr.gibba020.yqfnwy (mgr.34427) 8349 : cluster [DBG] pgmap v4754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:14.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:14 gibba020 bash[25448]: cluster 2021-03-10T16:31:13.342213+0000 mgr.gibba020.yqfnwy (mgr.34427) 8350 : cluster [DBG] pgmap v4755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:15.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:14 gibba013 bash[29418]: cluster 2021-03-10T16:31:13.342213+0000 mgr.gibba020.yqfnwy (mgr.34427) 8350 : cluster [DBG] pgmap v4755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:15.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:14 gibba013 bash[30381]: cluster 2021-03-10T16:31:13.342213+0000 mgr.gibba020.yqfnwy (mgr.34427) 8350 : cluster [DBG] pgmap v4755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:16.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:16 gibba020 bash[25448]: cluster 2021-03-10T16:31:15.343784+0000 mgr.gibba020.yqfnwy (mgr.34427) 8351 : cluster [DBG] pgmap v4756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:17.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:16 gibba013 bash[29418]: cluster 2021-03-10T16:31:15.343784+0000 mgr.gibba020.yqfnwy (mgr.34427) 8351 : cluster [DBG] pgmap v4756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:17.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:16 gibba013 bash[30381]: cluster 2021-03-10T16:31:15.343784+0000 mgr.gibba020.yqfnwy (mgr.34427) 8351 : cluster [DBG] pgmap v4756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:18.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:18 gibba020 bash[25448]: cluster 2021-03-10T16:31:17.344699+0000 mgr.gibba020.yqfnwy (mgr.34427) 8352 : cluster [DBG] pgmap v4757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:19.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:18 gibba013 bash[29418]: cluster 2021-03-10T16:31:17.344699+0000 mgr.gibba020.yqfnwy (mgr.34427) 8352 : cluster [DBG] pgmap v4757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:19.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:18 gibba013 bash[30381]: cluster 2021-03-10T16:31:17.344699+0000 mgr.gibba020.yqfnwy (mgr.34427) 8352 : cluster [DBG] pgmap v4757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:20.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:20 gibba020 bash[25448]: cluster 2021-03-10T16:31:19.346068+0000 mgr.gibba020.yqfnwy (mgr.34427) 8353 : cluster [DBG] pgmap v4758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:21.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:20 gibba013 bash[29418]: cluster 2021-03-10T16:31:19.346068+0000 mgr.gibba020.yqfnwy (mgr.34427) 8353 : cluster [DBG] pgmap v4758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:21.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:20 gibba013 bash[30381]: cluster 2021-03-10T16:31:19.346068+0000 mgr.gibba020.yqfnwy (mgr.34427) 8353 : cluster [DBG] pgmap v4758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:22.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:22 gibba020 bash[25448]: cluster 2021-03-10T16:31:21.348094+0000 mgr.gibba020.yqfnwy (mgr.34427) 8354 : cluster [DBG] pgmap v4759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:23.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:22 gibba013 bash[29418]: cluster 2021-03-10T16:31:21.348094+0000 mgr.gibba020.yqfnwy (mgr.34427) 8354 : cluster [DBG] pgmap v4759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:23.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:22 gibba013 bash[30381]: cluster 2021-03-10T16:31:21.348094+0000 mgr.gibba020.yqfnwy (mgr.34427) 8354 : cluster [DBG] pgmap v4759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:25.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:24 gibba013 bash[29418]: cluster 2021-03-10T16:31:23.349471+0000 mgr.gibba020.yqfnwy (mgr.34427) 8355 : cluster [DBG] pgmap v4760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:25.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:24 gibba013 bash[30381]: cluster 2021-03-10T16:31:23.349471+0000 mgr.gibba020.yqfnwy (mgr.34427) 8355 : cluster [DBG] pgmap v4760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:25.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:24 gibba020 bash[25448]: cluster 2021-03-10T16:31:23.349471+0000 mgr.gibba020.yqfnwy (mgr.34427) 8355 : cluster [DBG] pgmap v4760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:26.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:25 gibba013 bash[29418]: cephadm 2021-03-10T16:31:23.830770+0000 mgr.gibba020.yqfnwy (mgr.34427) 8356 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:31:26.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:25 gibba013 bash[30381]: cephadm 2021-03-10T16:31:23.830770+0000 mgr.gibba020.yqfnwy (mgr.34427) 8356 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:31:26.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:25 gibba020 bash[25448]: cephadm 2021-03-10T16:31:23.830770+0000 mgr.gibba020.yqfnwy (mgr.34427) 8356 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:31:27.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:26 gibba013 bash[29418]: cluster 2021-03-10T16:31:25.350887+0000 mgr.gibba020.yqfnwy (mgr.34427) 8357 : cluster [DBG] pgmap v4761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:27.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:26 gibba013 bash[30381]: cluster 2021-03-10T16:31:25.350887+0000 mgr.gibba020.yqfnwy (mgr.34427) 8357 : cluster [DBG] pgmap v4761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:27.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:26 gibba020 bash[25448]: cluster 2021-03-10T16:31:25.350887+0000 mgr.gibba020.yqfnwy (mgr.34427) 8357 : cluster [DBG] pgmap v4761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:29.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:28 gibba013 bash[29418]: cluster 2021-03-10T16:31:27.352569+0000 mgr.gibba020.yqfnwy (mgr.34427) 8358 : cluster [DBG] pgmap v4762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:29.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:28 gibba013 bash[30381]: cluster 2021-03-10T16:31:27.352569+0000 mgr.gibba020.yqfnwy (mgr.34427) 8358 : cluster [DBG] pgmap v4762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:29.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:28 gibba020 bash[25448]: cluster 2021-03-10T16:31:27.352569+0000 mgr.gibba020.yqfnwy (mgr.34427) 8358 : cluster [DBG] pgmap v4762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:31.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:30 gibba013 bash[29418]: cluster 2021-03-10T16:31:29.353798+0000 mgr.gibba020.yqfnwy (mgr.34427) 8359 : cluster [DBG] pgmap v4763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:31.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:30 gibba013 bash[30381]: cluster 2021-03-10T16:31:29.353798+0000 mgr.gibba020.yqfnwy (mgr.34427) 8359 : cluster [DBG] pgmap v4763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:31.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:30 gibba020 bash[25448]: cluster 2021-03-10T16:31:29.353798+0000 mgr.gibba020.yqfnwy (mgr.34427) 8359 : cluster [DBG] pgmap v4763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:33.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:32 gibba013 bash[29418]: cluster 2021-03-10T16:31:31.355609+0000 mgr.gibba020.yqfnwy (mgr.34427) 8360 : cluster [DBG] pgmap v4764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:33.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:32 gibba013 bash[30381]: cluster 2021-03-10T16:31:31.355609+0000 mgr.gibba020.yqfnwy (mgr.34427) 8360 : cluster [DBG] pgmap v4764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:33.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:32 gibba020 bash[25448]: cluster 2021-03-10T16:31:31.355609+0000 mgr.gibba020.yqfnwy (mgr.34427) 8360 : cluster [DBG] pgmap v4764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:35.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:34 gibba013 bash[29418]: cluster 2021-03-10T16:31:33.356241+0000 mgr.gibba020.yqfnwy (mgr.34427) 8361 : cluster [DBG] pgmap v4765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:35.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:34 gibba013 bash[30381]: cluster 2021-03-10T16:31:33.356241+0000 mgr.gibba020.yqfnwy (mgr.34427) 8361 : cluster [DBG] pgmap v4765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:35.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:34 gibba020 bash[25448]: cluster 2021-03-10T16:31:33.356241+0000 mgr.gibba020.yqfnwy (mgr.34427) 8361 : cluster [DBG] pgmap v4765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:35.987 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:31:36.218 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:31:36.218 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 57s ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:31:36.218 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 10m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:31:36.219 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:31:36.219 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:31:36.219 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 57s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:31:36.219 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 57s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:31:36.220 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:31:36.220 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 57s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:31:36.220 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 57s ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:31:36.221 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 10m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:31:36.221 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 57s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:31:36.221 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 57s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:31:36.221 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 57s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:31:36.222 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 57s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:31:36.222 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:31:36.222 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:31:36.222 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:31:36.223 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:31:36.223 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 10m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:31:36.223 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 10m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:31:36.468 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:31:36.469 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:31:36.469 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:31:36.469 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:31:36.469 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:31:36.470 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:31:36.470 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:31:36.470 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:31:36.470 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:31:36.471 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:31:36.471 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:31:36.471 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:31:36.471 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:31:36.472 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:31:36.472 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:31:37.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:36 gibba013 bash[29418]: cluster 2021-03-10T16:31:35.357821+0000 mgr.gibba020.yqfnwy (mgr.34427) 8362 : cluster [DBG] pgmap v4766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:37.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:36 gibba013 bash[29418]: audit 2021-03-10T16:31:36.469744+0000 mon.c (mon.1) 136 : audit [DBG] from='client.? 172.21.2.113:0/1380009711' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:37.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:36 gibba013 bash[30381]: cluster 2021-03-10T16:31:35.357821+0000 mgr.gibba020.yqfnwy (mgr.34427) 8362 : cluster [DBG] pgmap v4766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:37.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:36 gibba013 bash[30381]: audit 2021-03-10T16:31:36.469744+0000 mon.c (mon.1) 136 : audit [DBG] from='client.? 172.21.2.113:0/1380009711' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:37.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:36 gibba020 bash[25448]: cluster 2021-03-10T16:31:35.357821+0000 mgr.gibba020.yqfnwy (mgr.34427) 8362 : cluster [DBG] pgmap v4766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:37.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:36 gibba020 bash[25448]: audit 2021-03-10T16:31:36.469744+0000 mon.c (mon.1) 136 : audit [DBG] from='client.? 172.21.2.113:0/1380009711' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:38.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:37 gibba013 bash[29418]: audit 2021-03-10T16:31:35.979911+0000 mgr.gibba020.yqfnwy (mgr.34427) 8363 : audit [DBG] from='client.49668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:31:38.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:37 gibba013 bash[29418]: audit 2021-03-10T16:31:36.206186+0000 mgr.gibba020.yqfnwy (mgr.34427) 8364 : audit [DBG] from='client.59656 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:31:38.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:37 gibba013 bash[30381]: audit 2021-03-10T16:31:35.979911+0000 mgr.gibba020.yqfnwy (mgr.34427) 8363 : audit [DBG] from='client.49668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:31:38.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:37 gibba013 bash[30381]: audit 2021-03-10T16:31:36.206186+0000 mgr.gibba020.yqfnwy (mgr.34427) 8364 : audit [DBG] from='client.59656 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:31:38.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:37 gibba020 bash[25448]: audit 2021-03-10T16:31:35.979911+0000 mgr.gibba020.yqfnwy (mgr.34427) 8363 : audit [DBG] from='client.49668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:31:38.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:37 gibba020 bash[25448]: audit 2021-03-10T16:31:36.206186+0000 mgr.gibba020.yqfnwy (mgr.34427) 8364 : audit [DBG] from='client.59656 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:31:39.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:38 gibba013 bash[29418]: cluster 2021-03-10T16:31:37.359187+0000 mgr.gibba020.yqfnwy (mgr.34427) 8365 : cluster [DBG] pgmap v4767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:39.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:38 gibba013 bash[30381]: cluster 2021-03-10T16:31:37.359187+0000 mgr.gibba020.yqfnwy (mgr.34427) 8365 : cluster [DBG] pgmap v4767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:39.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:38 gibba020 bash[25448]: cluster 2021-03-10T16:31:37.359187+0000 mgr.gibba020.yqfnwy (mgr.34427) 8365 : cluster [DBG] pgmap v4767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:40.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:39 gibba013 bash[29418]: audit 2021-03-10T16:31:38.847941+0000 mon.a (mon.0) 3079 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:31:40.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:39 gibba013 bash[29418]: cephadm 2021-03-10T16:31:38.852330+0000 mgr.gibba020.yqfnwy (mgr.34427) 8366 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:31:40.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:39 gibba013 bash[29418]: audit 2021-03-10T16:31:38.854154+0000 mon.a (mon.0) 3080 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:31:40.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:39 gibba013 bash[29418]: cluster 2021-03-10T16:31:39.360686+0000 mgr.gibba020.yqfnwy (mgr.34427) 8367 : cluster [DBG] pgmap v4768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:40.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:39 gibba013 bash[30381]: audit 2021-03-10T16:31:38.847941+0000 mon.a (mon.0) 3079 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:31:40.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:39 gibba013 bash[30381]: cephadm 2021-03-10T16:31:38.852330+0000 mgr.gibba020.yqfnwy (mgr.34427) 8366 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:31:40.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:39 gibba013 bash[30381]: audit 2021-03-10T16:31:38.854154+0000 mon.a (mon.0) 3080 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:31:40.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:39 gibba013 bash[30381]: cluster 2021-03-10T16:31:39.360686+0000 mgr.gibba020.yqfnwy (mgr.34427) 8367 : cluster [DBG] pgmap v4768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:40.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:39 gibba020 bash[25448]: audit 2021-03-10T16:31:38.847941+0000 mon.a (mon.0) 3079 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:31:40.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:39 gibba020 bash[25448]: cephadm 2021-03-10T16:31:38.852330+0000 mgr.gibba020.yqfnwy (mgr.34427) 8366 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:31:40.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:39 gibba020 bash[25448]: audit 2021-03-10T16:31:38.854154+0000 mon.a (mon.0) 3080 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:31:40.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:39 gibba020 bash[25448]: cluster 2021-03-10T16:31:39.360686+0000 mgr.gibba020.yqfnwy (mgr.34427) 8367 : cluster [DBG] pgmap v4768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:42.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:42 gibba020 bash[25448]: cluster 2021-03-10T16:31:41.361470+0000 mgr.gibba020.yqfnwy (mgr.34427) 8368 : cluster [DBG] pgmap v4769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:42.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:42 gibba013 bash[29418]: cluster 2021-03-10T16:31:41.361470+0000 mgr.gibba020.yqfnwy (mgr.34427) 8368 : cluster [DBG] pgmap v4769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:42.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:42 gibba013 bash[30381]: cluster 2021-03-10T16:31:41.361470+0000 mgr.gibba020.yqfnwy (mgr.34427) 8368 : cluster [DBG] pgmap v4769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:43.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[29418]: audit 2021-03-10T16:31:42.498135+0000 mon.a (mon.0) 3081 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:31:43.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[29418]: cephadm 2021-03-10T16:31:42.498884+0000 mgr.gibba020.yqfnwy (mgr.34427) 8369 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:31:43.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[29418]: audit 2021-03-10T16:31:42.693886+0000 mon.a (mon.0) 3082 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:31:43.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[29418]: cephadm 2021-03-10T16:31:42.696342+0000 mgr.gibba020.yqfnwy (mgr.34427) 8370 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:31:43.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[29418]: audit 2021-03-10T16:31:42.697870+0000 mon.a (mon.0) 3083 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:31:43.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[29418]: cephadm 2021-03-10T16:31:42.698732+0000 mgr.gibba020.yqfnwy (mgr.34427) 8371 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:31:43.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[29418]: audit 2021-03-10T16:31:42.699930+0000 mon.a (mon.0) 3084 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:43.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[29418]: cephadm 2021-03-10T16:31:42.700532+0000 mgr.gibba020.yqfnwy (mgr.34427) 8372 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:31:43.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[29418]: cephadm 2021-03-10T16:31:42.700608+0000 mgr.gibba020.yqfnwy (mgr.34427) 8373 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:31:43.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[29418]: audit 2021-03-10T16:31:42.701681+0000 mon.a (mon.0) 3085 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:43.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[29418]: cephadm 2021-03-10T16:31:42.702082+0000 mgr.gibba020.yqfnwy (mgr.34427) 8374 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:31:43.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[29418]: cephadm 2021-03-10T16:31:42.702171+0000 mgr.gibba020.yqfnwy (mgr.34427) 8375 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:31:43.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[29418]: audit 2021-03-10T16:31:42.702896+0000 mon.a (mon.0) 3086 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:43.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[29418]: cephadm 2021-03-10T16:31:42.703299+0000 mgr.gibba020.yqfnwy (mgr.34427) 8376 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:31:43.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[29418]: cephadm 2021-03-10T16:31:42.704406+0000 mgr.gibba020.yqfnwy (mgr.34427) 8377 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:31:43.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[29418]: cephadm 2021-03-10T16:31:42.704442+0000 mgr.gibba020.yqfnwy (mgr.34427) 8378 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:31:43.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[29418]: audit 2021-03-10T16:31:42.705540+0000 mon.a (mon.0) 3087 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:43.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[29418]: cephadm 2021-03-10T16:31:42.706026+0000 mgr.gibba020.yqfnwy (mgr.34427) 8379 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:31:43.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[29418]: cephadm 2021-03-10T16:31:42.706348+0000 mgr.gibba020.yqfnwy (mgr.34427) 8380 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:31:43.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[29418]: audit 2021-03-10T16:31:42.707232+0000 mon.a (mon.0) 3088 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:43.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[29418]: cephadm 2021-03-10T16:31:42.707681+0000 mgr.gibba020.yqfnwy (mgr.34427) 8381 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:31:43.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[29418]: cephadm 2021-03-10T16:31:42.707718+0000 mgr.gibba020.yqfnwy (mgr.34427) 8382 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:31:43.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[29418]: cephadm 2021-03-10T16:31:42.707875+0000 mgr.gibba020.yqfnwy (mgr.34427) 8383 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:31:43.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[30381]: audit 2021-03-10T16:31:42.498135+0000 mon.a (mon.0) 3081 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:31:43.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[30381]: cephadm 2021-03-10T16:31:42.498884+0000 mgr.gibba020.yqfnwy (mgr.34427) 8369 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:31:43.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[30381]: audit 2021-03-10T16:31:42.693886+0000 mon.a (mon.0) 3082 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:31:43.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[30381]: cephadm 2021-03-10T16:31:42.696342+0000 mgr.gibba020.yqfnwy (mgr.34427) 8370 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:31:43.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[30381]: audit 2021-03-10T16:31:42.697870+0000 mon.a (mon.0) 3083 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:31:43.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[30381]: cephadm 2021-03-10T16:31:42.698732+0000 mgr.gibba020.yqfnwy (mgr.34427) 8371 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:31:43.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[30381]: audit 2021-03-10T16:31:42.699930+0000 mon.a (mon.0) 3084 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:43.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[30381]: cephadm 2021-03-10T16:31:42.700532+0000 mgr.gibba020.yqfnwy (mgr.34427) 8372 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:31:43.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[30381]: cephadm 2021-03-10T16:31:42.700608+0000 mgr.gibba020.yqfnwy (mgr.34427) 8373 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:31:43.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[30381]: audit 2021-03-10T16:31:42.701681+0000 mon.a (mon.0) 3085 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:43.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[30381]: cephadm 2021-03-10T16:31:42.702082+0000 mgr.gibba020.yqfnwy (mgr.34427) 8374 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:31:43.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[30381]: cephadm 2021-03-10T16:31:42.702171+0000 mgr.gibba020.yqfnwy (mgr.34427) 8375 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:31:43.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[30381]: audit 2021-03-10T16:31:42.702896+0000 mon.a (mon.0) 3086 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:43.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[30381]: cephadm 2021-03-10T16:31:42.703299+0000 mgr.gibba020.yqfnwy (mgr.34427) 8376 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:31:43.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[30381]: cephadm 2021-03-10T16:31:42.704406+0000 mgr.gibba020.yqfnwy (mgr.34427) 8377 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:31:43.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[30381]: cephadm 2021-03-10T16:31:42.704442+0000 mgr.gibba020.yqfnwy (mgr.34427) 8378 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:31:43.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[30381]: audit 2021-03-10T16:31:42.705540+0000 mon.a (mon.0) 3087 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:43.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[30381]: cephadm 2021-03-10T16:31:42.706026+0000 mgr.gibba020.yqfnwy (mgr.34427) 8379 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:31:43.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[30381]: cephadm 2021-03-10T16:31:42.706348+0000 mgr.gibba020.yqfnwy (mgr.34427) 8380 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:31:43.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[30381]: audit 2021-03-10T16:31:42.707232+0000 mon.a (mon.0) 3088 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:43.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[30381]: cephadm 2021-03-10T16:31:42.707681+0000 mgr.gibba020.yqfnwy (mgr.34427) 8381 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:31:43.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[30381]: cephadm 2021-03-10T16:31:42.707718+0000 mgr.gibba020.yqfnwy (mgr.34427) 8382 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:31:43.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:43 gibba013 bash[30381]: cephadm 2021-03-10T16:31:42.707875+0000 mgr.gibba020.yqfnwy (mgr.34427) 8383 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:31:43.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:43 gibba020 bash[25448]: audit 2021-03-10T16:31:42.498135+0000 mon.a (mon.0) 3081 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:31:43.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:43 gibba020 bash[25448]: cephadm 2021-03-10T16:31:42.498884+0000 mgr.gibba020.yqfnwy (mgr.34427) 8369 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:31:43.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:43 gibba020 bash[25448]: audit 2021-03-10T16:31:42.693886+0000 mon.a (mon.0) 3082 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:31:43.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:43 gibba020 bash[25448]: cephadm 2021-03-10T16:31:42.696342+0000 mgr.gibba020.yqfnwy (mgr.34427) 8370 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:31:43.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:43 gibba020 bash[25448]: audit 2021-03-10T16:31:42.697870+0000 mon.a (mon.0) 3083 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:31:43.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:43 gibba020 bash[25448]: cephadm 2021-03-10T16:31:42.698732+0000 mgr.gibba020.yqfnwy (mgr.34427) 8371 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:31:43.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:43 gibba020 bash[25448]: audit 2021-03-10T16:31:42.699930+0000 mon.a (mon.0) 3084 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:43.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:43 gibba020 bash[25448]: cephadm 2021-03-10T16:31:42.700532+0000 mgr.gibba020.yqfnwy (mgr.34427) 8372 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:31:43.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:43 gibba020 bash[25448]: cephadm 2021-03-10T16:31:42.700608+0000 mgr.gibba020.yqfnwy (mgr.34427) 8373 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:31:43.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:43 gibba020 bash[25448]: audit 2021-03-10T16:31:42.701681+0000 mon.a (mon.0) 3085 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:43.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:43 gibba020 bash[25448]: cephadm 2021-03-10T16:31:42.702082+0000 mgr.gibba020.yqfnwy (mgr.34427) 8374 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:31:43.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:43 gibba020 bash[25448]: cephadm 2021-03-10T16:31:42.702171+0000 mgr.gibba020.yqfnwy (mgr.34427) 8375 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:31:43.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:43 gibba020 bash[25448]: audit 2021-03-10T16:31:42.702896+0000 mon.a (mon.0) 3086 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:43.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:43 gibba020 bash[25448]: cephadm 2021-03-10T16:31:42.703299+0000 mgr.gibba020.yqfnwy (mgr.34427) 8376 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:31:43.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:43 gibba020 bash[25448]: cephadm 2021-03-10T16:31:42.704406+0000 mgr.gibba020.yqfnwy (mgr.34427) 8377 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:31:43.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:43 gibba020 bash[25448]: cephadm 2021-03-10T16:31:42.704442+0000 mgr.gibba020.yqfnwy (mgr.34427) 8378 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:31:43.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:43 gibba020 bash[25448]: audit 2021-03-10T16:31:42.705540+0000 mon.a (mon.0) 3087 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:43.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:43 gibba020 bash[25448]: cephadm 2021-03-10T16:31:42.706026+0000 mgr.gibba020.yqfnwy (mgr.34427) 8379 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:31:43.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:43 gibba020 bash[25448]: cephadm 2021-03-10T16:31:42.706348+0000 mgr.gibba020.yqfnwy (mgr.34427) 8380 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:31:43.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:43 gibba020 bash[25448]: audit 2021-03-10T16:31:42.707232+0000 mon.a (mon.0) 3088 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:31:43.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:43 gibba020 bash[25448]: cephadm 2021-03-10T16:31:42.707681+0000 mgr.gibba020.yqfnwy (mgr.34427) 8381 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:31:43.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:43 gibba020 bash[25448]: cephadm 2021-03-10T16:31:42.707718+0000 mgr.gibba020.yqfnwy (mgr.34427) 8382 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:31:43.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:43 gibba020 bash[25448]: cephadm 2021-03-10T16:31:42.707875+0000 mgr.gibba020.yqfnwy (mgr.34427) 8383 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:31:45.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:44 gibba013 bash[29418]: cluster 2021-03-10T16:31:43.362752+0000 mgr.gibba020.yqfnwy (mgr.34427) 8384 : cluster [DBG] pgmap v4770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:45.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:44 gibba013 bash[30381]: cluster 2021-03-10T16:31:43.362752+0000 mgr.gibba020.yqfnwy (mgr.34427) 8384 : cluster [DBG] pgmap v4770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:45.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:44 gibba020 bash[25448]: cluster 2021-03-10T16:31:43.362752+0000 mgr.gibba020.yqfnwy (mgr.34427) 8384 : cluster [DBG] pgmap v4770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:47.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:46 gibba013 bash[29418]: cluster 2021-03-10T16:31:45.364542+0000 mgr.gibba020.yqfnwy (mgr.34427) 8385 : cluster [DBG] pgmap v4771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:47.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:46 gibba013 bash[30381]: cluster 2021-03-10T16:31:45.364542+0000 mgr.gibba020.yqfnwy (mgr.34427) 8385 : cluster [DBG] pgmap v4771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:47.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:46 gibba020 bash[25448]: cluster 2021-03-10T16:31:45.364542+0000 mgr.gibba020.yqfnwy (mgr.34427) 8385 : cluster [DBG] pgmap v4771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:49.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:48 gibba013 bash[29418]: cluster 2021-03-10T16:31:47.365889+0000 mgr.gibba020.yqfnwy (mgr.34427) 8386 : cluster [DBG] pgmap v4772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:49.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:48 gibba013 bash[30381]: cluster 2021-03-10T16:31:47.365889+0000 mgr.gibba020.yqfnwy (mgr.34427) 8386 : cluster [DBG] pgmap v4772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:49.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:48 gibba020 bash[25448]: cluster 2021-03-10T16:31:47.365889+0000 mgr.gibba020.yqfnwy (mgr.34427) 8386 : cluster [DBG] pgmap v4772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:51.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:50 gibba013 bash[29418]: cluster 2021-03-10T16:31:49.366621+0000 mgr.gibba020.yqfnwy (mgr.34427) 8387 : cluster [DBG] pgmap v4773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:51.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:50 gibba013 bash[30381]: cluster 2021-03-10T16:31:49.366621+0000 mgr.gibba020.yqfnwy (mgr.34427) 8387 : cluster [DBG] pgmap v4773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:51.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:50 gibba020 bash[25448]: cluster 2021-03-10T16:31:49.366621+0000 mgr.gibba020.yqfnwy (mgr.34427) 8387 : cluster [DBG] pgmap v4773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:53.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:52 gibba013 bash[29418]: cluster 2021-03-10T16:31:51.368369+0000 mgr.gibba020.yqfnwy (mgr.34427) 8388 : cluster [DBG] pgmap v4774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:53.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:52 gibba013 bash[30381]: cluster 2021-03-10T16:31:51.368369+0000 mgr.gibba020.yqfnwy (mgr.34427) 8388 : cluster [DBG] pgmap v4774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:53.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:52 gibba020 bash[25448]: cluster 2021-03-10T16:31:51.368369+0000 mgr.gibba020.yqfnwy (mgr.34427) 8388 : cluster [DBG] pgmap v4774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:55.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:54 gibba013 bash[29418]: cluster 2021-03-10T16:31:53.369755+0000 mgr.gibba020.yqfnwy (mgr.34427) 8389 : cluster [DBG] pgmap v4775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:55.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:54 gibba013 bash[30381]: cluster 2021-03-10T16:31:53.369755+0000 mgr.gibba020.yqfnwy (mgr.34427) 8389 : cluster [DBG] pgmap v4775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:55.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:54 gibba020 bash[25448]: cluster 2021-03-10T16:31:53.369755+0000 mgr.gibba020.yqfnwy (mgr.34427) 8389 : cluster [DBG] pgmap v4775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:57.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:56 gibba013 bash[29418]: cluster 2021-03-10T16:31:55.371323+0000 mgr.gibba020.yqfnwy (mgr.34427) 8390 : cluster [DBG] pgmap v4776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:57.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:56 gibba013 bash[30381]: cluster 2021-03-10T16:31:55.371323+0000 mgr.gibba020.yqfnwy (mgr.34427) 8390 : cluster [DBG] pgmap v4776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:57.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:56 gibba020 bash[25448]: cluster 2021-03-10T16:31:55.371323+0000 mgr.gibba020.yqfnwy (mgr.34427) 8390 : cluster [DBG] pgmap v4776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:59.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:58 gibba013 bash[29418]: cluster 2021-03-10T16:31:57.372144+0000 mgr.gibba020.yqfnwy (mgr.34427) 8391 : cluster [DBG] pgmap v4777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:59.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:31:58 gibba013 bash[29418]: cephadm 2021-03-10T16:31:57.723920+0000 mgr.gibba020.yqfnwy (mgr.34427) 8392 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:31:59.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:58 gibba013 bash[30381]: cluster 2021-03-10T16:31:57.372144+0000 mgr.gibba020.yqfnwy (mgr.34427) 8391 : cluster [DBG] pgmap v4777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:59.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:31:58 gibba013 bash[30381]: cephadm 2021-03-10T16:31:57.723920+0000 mgr.gibba020.yqfnwy (mgr.34427) 8392 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:31:59.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:58 gibba020 bash[25448]: cluster 2021-03-10T16:31:57.372144+0000 mgr.gibba020.yqfnwy (mgr.34427) 8391 : cluster [DBG] pgmap v4777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:31:59.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:31:58 gibba020 bash[25448]: cephadm 2021-03-10T16:31:57.723920+0000 mgr.gibba020.yqfnwy (mgr.34427) 8392 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:32:00.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:00 gibba020 bash[25448]: cluster 2021-03-10T16:31:59.373259+0000 mgr.gibba020.yqfnwy (mgr.34427) 8393 : cluster [DBG] pgmap v4778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:00.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:00 gibba013 bash[29418]: cluster 2021-03-10T16:31:59.373259+0000 mgr.gibba020.yqfnwy (mgr.34427) 8393 : cluster [DBG] pgmap v4778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:00.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:00 gibba013 bash[30381]: cluster 2021-03-10T16:31:59.373259+0000 mgr.gibba020.yqfnwy (mgr.34427) 8393 : cluster [DBG] pgmap v4778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:02.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:02 gibba020 bash[25448]: cluster 2021-03-10T16:32:01.375543+0000 mgr.gibba020.yqfnwy (mgr.34427) 8394 : cluster [DBG] pgmap v4779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:02.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:02 gibba013 bash[29418]: cluster 2021-03-10T16:32:01.375543+0000 mgr.gibba020.yqfnwy (mgr.34427) 8394 : cluster [DBG] pgmap v4779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:02.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:02 gibba013 bash[30381]: cluster 2021-03-10T16:32:01.375543+0000 mgr.gibba020.yqfnwy (mgr.34427) 8394 : cluster [DBG] pgmap v4779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:04.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:04 gibba020 bash[25448]: cluster 2021-03-10T16:32:03.376925+0000 mgr.gibba020.yqfnwy (mgr.34427) 8395 : cluster [DBG] pgmap v4780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:04.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:04 gibba013 bash[29418]: cluster 2021-03-10T16:32:03.376925+0000 mgr.gibba020.yqfnwy (mgr.34427) 8395 : cluster [DBG] pgmap v4780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:04.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:04 gibba013 bash[30381]: cluster 2021-03-10T16:32:03.376925+0000 mgr.gibba020.yqfnwy (mgr.34427) 8395 : cluster [DBG] pgmap v4780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:06.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:06 gibba020 bash[25448]: cluster 2021-03-10T16:32:05.377893+0000 mgr.gibba020.yqfnwy (mgr.34427) 8396 : cluster [DBG] pgmap v4781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:06.715 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:32:06.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:06 gibba013 bash[29418]: cluster 2021-03-10T16:32:05.377893+0000 mgr.gibba020.yqfnwy (mgr.34427) 8396 : cluster [DBG] pgmap v4781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:06.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:06 gibba013 bash[30381]: cluster 2021-03-10T16:32:05.377893+0000 mgr.gibba020.yqfnwy (mgr.34427) 8396 : cluster [DBG] pgmap v4781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:06.949 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:32:06.949 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 88s ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:32:06.950 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 24s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:32:06.950 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 24s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:32:06.950 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 24s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:32:06.950 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 88s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:32:06.951 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 88s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:32:06.951 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 24s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:32:06.951 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 88s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:32:06.951 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 88s ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:32:06.951 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 24s ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:32:06.952 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 88s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:32:06.952 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 88s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:32:06.952 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 88s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:32:06.952 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 88s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:32:06.952 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 24s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:32:06.953 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 24s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:32:06.953 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 24s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:32:06.953 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 24s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:32:06.953 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 24s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:32:06.954 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 24s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:32:07.199 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:32:07.200 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:32:07.200 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:32:07.200 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:32:07.201 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:32:07.201 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:32:07.201 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:32:07.201 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:32:07.201 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:32:07.202 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:32:07.202 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:32:07.202 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:32:07.202 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:32:07.203 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:32:07.203 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:32:07.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:07 gibba020 bash[25448]: audit 2021-03-10T16:32:06.707801+0000 mgr.gibba020.yqfnwy (mgr.34427) 8397 : audit [DBG] from='client.49686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:32:07.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:07 gibba020 bash[25448]: audit 2021-03-10T16:32:06.723057+0000 mon.a (mon.0) 3089 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:32:07.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:07 gibba020 bash[25448]: audit 2021-03-10T16:32:06.878215+0000 mon.a (mon.0) 3090 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:32:07.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:07 gibba020 bash[25448]: audit 2021-03-10T16:32:07.170249+0000 mon.a (mon.0) 3091 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:32:07.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:07 gibba020 bash[25448]: audit 2021-03-10T16:32:07.170518+0000 mon.a (mon.0) 3092 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:32:07.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:07 gibba020 bash[25448]: audit 2021-03-10T16:32:07.170797+0000 mon.a (mon.0) 3093 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:32:07.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:07 gibba020 bash[25448]: audit 2021-03-10T16:32:07.171300+0000 mon.a (mon.0) 3094 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:32:07.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:07 gibba020 bash[25448]: audit 2021-03-10T16:32:07.200848+0000 mon.a (mon.0) 3095 : audit [DBG] from='client.? 172.21.2.113:0/3104796563' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:07.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:07 gibba013 bash[29418]: audit 2021-03-10T16:32:06.707801+0000 mgr.gibba020.yqfnwy (mgr.34427) 8397 : audit [DBG] from='client.49686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:32:07.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:07 gibba013 bash[29418]: audit 2021-03-10T16:32:06.723057+0000 mon.a (mon.0) 3089 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:32:07.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:07 gibba013 bash[29418]: audit 2021-03-10T16:32:06.878215+0000 mon.a (mon.0) 3090 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:32:07.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:07 gibba013 bash[29418]: audit 2021-03-10T16:32:07.170249+0000 mon.a (mon.0) 3091 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:32:07.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:07 gibba013 bash[29418]: audit 2021-03-10T16:32:07.170518+0000 mon.a (mon.0) 3092 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:32:07.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:07 gibba013 bash[29418]: audit 2021-03-10T16:32:07.170797+0000 mon.a (mon.0) 3093 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:32:07.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:07 gibba013 bash[29418]: audit 2021-03-10T16:32:07.171300+0000 mon.a (mon.0) 3094 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:32:07.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:07 gibba013 bash[29418]: audit 2021-03-10T16:32:07.200848+0000 mon.a (mon.0) 3095 : audit [DBG] from='client.? 172.21.2.113:0/3104796563' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:07.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:07 gibba013 bash[30381]: audit 2021-03-10T16:32:06.707801+0000 mgr.gibba020.yqfnwy (mgr.34427) 8397 : audit [DBG] from='client.49686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:32:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:07 gibba013 bash[30381]: audit 2021-03-10T16:32:06.723057+0000 mon.a (mon.0) 3089 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:32:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:07 gibba013 bash[30381]: audit 2021-03-10T16:32:06.878215+0000 mon.a (mon.0) 3090 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:32:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:07 gibba013 bash[30381]: audit 2021-03-10T16:32:07.170249+0000 mon.a (mon.0) 3091 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:32:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:07 gibba013 bash[30381]: audit 2021-03-10T16:32:07.170518+0000 mon.a (mon.0) 3092 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:32:07.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:07 gibba013 bash[30381]: audit 2021-03-10T16:32:07.170797+0000 mon.a (mon.0) 3093 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:32:07.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:07 gibba013 bash[30381]: audit 2021-03-10T16:32:07.171300+0000 mon.a (mon.0) 3094 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:32:07.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:07 gibba013 bash[30381]: audit 2021-03-10T16:32:07.200848+0000 mon.a (mon.0) 3095 : audit [DBG] from='client.? 172.21.2.113:0/3104796563' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:08.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:08 gibba020 bash[25448]: audit 2021-03-10T16:32:06.936714+0000 mgr.gibba020.yqfnwy (mgr.34427) 8398 : audit [DBG] from='client.49692 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:32:08.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:08 gibba020 bash[25448]: cluster 2021-03-10T16:32:07.379302+0000 mgr.gibba020.yqfnwy (mgr.34427) 8399 : cluster [DBG] pgmap v4782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:08.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:08 gibba013 bash[29418]: audit 2021-03-10T16:32:06.936714+0000 mgr.gibba020.yqfnwy (mgr.34427) 8398 : audit [DBG] from='client.49692 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:32:08.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:08 gibba013 bash[29418]: cluster 2021-03-10T16:32:07.379302+0000 mgr.gibba020.yqfnwy (mgr.34427) 8399 : cluster [DBG] pgmap v4782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:08.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:08 gibba013 bash[30381]: audit 2021-03-10T16:32:06.936714+0000 mgr.gibba020.yqfnwy (mgr.34427) 8398 : audit [DBG] from='client.49692 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:32:08.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:08 gibba013 bash[30381]: cluster 2021-03-10T16:32:07.379302+0000 mgr.gibba020.yqfnwy (mgr.34427) 8399 : cluster [DBG] pgmap v4782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:10.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:10 gibba020 bash[25448]: cluster 2021-03-10T16:32:09.385565+0000 mgr.gibba020.yqfnwy (mgr.34427) 8400 : cluster [DBG] pgmap v4783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:10.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:10 gibba013 bash[29418]: cluster 2021-03-10T16:32:09.385565+0000 mgr.gibba020.yqfnwy (mgr.34427) 8400 : cluster [DBG] pgmap v4783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:10.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:10 gibba013 bash[30381]: cluster 2021-03-10T16:32:09.385565+0000 mgr.gibba020.yqfnwy (mgr.34427) 8400 : cluster [DBG] pgmap v4783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:12.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:12 gibba020 bash[25448]: cluster 2021-03-10T16:32:11.387269+0000 mgr.gibba020.yqfnwy (mgr.34427) 8401 : cluster [DBG] pgmap v4784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:12.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:12 gibba013 bash[29418]: cluster 2021-03-10T16:32:11.387269+0000 mgr.gibba020.yqfnwy (mgr.34427) 8401 : cluster [DBG] pgmap v4784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:12.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:12 gibba013 bash[30381]: cluster 2021-03-10T16:32:11.387269+0000 mgr.gibba020.yqfnwy (mgr.34427) 8401 : cluster [DBG] pgmap v4784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:13.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:13 gibba020 bash[25448]: cephadm 2021-03-10T16:32:12.739984+0000 mgr.gibba020.yqfnwy (mgr.34427) 8402 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:32:13.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:13 gibba013 bash[29418]: cephadm 2021-03-10T16:32:12.739984+0000 mgr.gibba020.yqfnwy (mgr.34427) 8402 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:32:13.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:13 gibba013 bash[30381]: cephadm 2021-03-10T16:32:12.739984+0000 mgr.gibba020.yqfnwy (mgr.34427) 8402 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:32:14.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:14 gibba020 bash[25448]: cluster 2021-03-10T16:32:13.388698+0000 mgr.gibba020.yqfnwy (mgr.34427) 8403 : cluster [DBG] pgmap v4785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:14.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:14 gibba013 bash[29418]: cluster 2021-03-10T16:32:13.388698+0000 mgr.gibba020.yqfnwy (mgr.34427) 8403 : cluster [DBG] pgmap v4785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:14.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:14 gibba013 bash[30381]: cluster 2021-03-10T16:32:13.388698+0000 mgr.gibba020.yqfnwy (mgr.34427) 8403 : cluster [DBG] pgmap v4785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:16.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:16 gibba020 bash[25448]: cluster 2021-03-10T16:32:15.390452+0000 mgr.gibba020.yqfnwy (mgr.34427) 8404 : cluster [DBG] pgmap v4786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:16.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:16 gibba013 bash[29418]: cluster 2021-03-10T16:32:15.390452+0000 mgr.gibba020.yqfnwy (mgr.34427) 8404 : cluster [DBG] pgmap v4786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:16.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:16 gibba013 bash[30381]: cluster 2021-03-10T16:32:15.390452+0000 mgr.gibba020.yqfnwy (mgr.34427) 8404 : cluster [DBG] pgmap v4786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:18.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:18 gibba020 bash[25448]: cluster 2021-03-10T16:32:17.391915+0000 mgr.gibba020.yqfnwy (mgr.34427) 8405 : cluster [DBG] pgmap v4787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:18.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:18 gibba013 bash[29418]: cluster 2021-03-10T16:32:17.391915+0000 mgr.gibba020.yqfnwy (mgr.34427) 8405 : cluster [DBG] pgmap v4787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:18.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:18 gibba013 bash[30381]: cluster 2021-03-10T16:32:17.391915+0000 mgr.gibba020.yqfnwy (mgr.34427) 8405 : cluster [DBG] pgmap v4787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:20.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:20 gibba020 bash[25448]: cluster 2021-03-10T16:32:19.392524+0000 mgr.gibba020.yqfnwy (mgr.34427) 8406 : cluster [DBG] pgmap v4788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:20.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:20 gibba013 bash[29418]: cluster 2021-03-10T16:32:19.392524+0000 mgr.gibba020.yqfnwy (mgr.34427) 8406 : cluster [DBG] pgmap v4788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:20.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:20 gibba013 bash[30381]: cluster 2021-03-10T16:32:19.392524+0000 mgr.gibba020.yqfnwy (mgr.34427) 8406 : cluster [DBG] pgmap v4788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:22.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:22 gibba013 bash[29418]: cluster 2021-03-10T16:32:21.394065+0000 mgr.gibba020.yqfnwy (mgr.34427) 8407 : cluster [DBG] pgmap v4789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:22.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:22 gibba013 bash[30381]: cluster 2021-03-10T16:32:21.394065+0000 mgr.gibba020.yqfnwy (mgr.34427) 8407 : cluster [DBG] pgmap v4789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:22.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:22 gibba020 bash[25448]: cluster 2021-03-10T16:32:21.394065+0000 mgr.gibba020.yqfnwy (mgr.34427) 8407 : cluster [DBG] pgmap v4789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:24.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:24 gibba013 bash[29418]: cluster 2021-03-10T16:32:23.395450+0000 mgr.gibba020.yqfnwy (mgr.34427) 8408 : cluster [DBG] pgmap v4790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:24.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:24 gibba013 bash[30381]: cluster 2021-03-10T16:32:23.395450+0000 mgr.gibba020.yqfnwy (mgr.34427) 8408 : cluster [DBG] pgmap v4790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:24.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:24 gibba020 bash[25448]: cluster 2021-03-10T16:32:23.395450+0000 mgr.gibba020.yqfnwy (mgr.34427) 8408 : cluster [DBG] pgmap v4790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:26.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:26 gibba013 bash[29418]: cluster 2021-03-10T16:32:25.396930+0000 mgr.gibba020.yqfnwy (mgr.34427) 8409 : cluster [DBG] pgmap v4791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:26.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:26 gibba013 bash[30381]: cluster 2021-03-10T16:32:25.396930+0000 mgr.gibba020.yqfnwy (mgr.34427) 8409 : cluster [DBG] pgmap v4791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:26.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:26 gibba020 bash[25448]: cluster 2021-03-10T16:32:25.396930+0000 mgr.gibba020.yqfnwy (mgr.34427) 8409 : cluster [DBG] pgmap v4791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:28.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:28 gibba013 bash[29418]: cluster 2021-03-10T16:32:27.398389+0000 mgr.gibba020.yqfnwy (mgr.34427) 8410 : cluster [DBG] pgmap v4792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:28.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:28 gibba013 bash[29418]: cephadm 2021-03-10T16:32:27.753041+0000 mgr.gibba020.yqfnwy (mgr.34427) 8411 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:32:28.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:28 gibba013 bash[30381]: cluster 2021-03-10T16:32:27.398389+0000 mgr.gibba020.yqfnwy (mgr.34427) 8410 : cluster [DBG] pgmap v4792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:28.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:28 gibba013 bash[30381]: cephadm 2021-03-10T16:32:27.753041+0000 mgr.gibba020.yqfnwy (mgr.34427) 8411 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:32:28.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:28 gibba020 bash[25448]: cluster 2021-03-10T16:32:27.398389+0000 mgr.gibba020.yqfnwy (mgr.34427) 8410 : cluster [DBG] pgmap v4792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:28.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:28 gibba020 bash[25448]: cephadm 2021-03-10T16:32:27.753041+0000 mgr.gibba020.yqfnwy (mgr.34427) 8411 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:32:30.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:30 gibba020 bash[25448]: cluster 2021-03-10T16:32:29.398867+0000 mgr.gibba020.yqfnwy (mgr.34427) 8412 : cluster [DBG] pgmap v4793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:30.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:30 gibba013 bash[29418]: cluster 2021-03-10T16:32:29.398867+0000 mgr.gibba020.yqfnwy (mgr.34427) 8412 : cluster [DBG] pgmap v4793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:30.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:30 gibba013 bash[30381]: cluster 2021-03-10T16:32:29.398867+0000 mgr.gibba020.yqfnwy (mgr.34427) 8412 : cluster [DBG] pgmap v4793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:32.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:32 gibba013 bash[29418]: cluster 2021-03-10T16:32:31.400491+0000 mgr.gibba020.yqfnwy (mgr.34427) 8413 : cluster [DBG] pgmap v4794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:32.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:32 gibba013 bash[30381]: cluster 2021-03-10T16:32:31.400491+0000 mgr.gibba020.yqfnwy (mgr.34427) 8413 : cluster [DBG] pgmap v4794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:32.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:32 gibba020 bash[25448]: cluster 2021-03-10T16:32:31.400491+0000 mgr.gibba020.yqfnwy (mgr.34427) 8413 : cluster [DBG] pgmap v4794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:34.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:34 gibba013 bash[29418]: cluster 2021-03-10T16:32:33.401820+0000 mgr.gibba020.yqfnwy (mgr.34427) 8414 : cluster [DBG] pgmap v4795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:34.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:34 gibba013 bash[30381]: cluster 2021-03-10T16:32:33.401820+0000 mgr.gibba020.yqfnwy (mgr.34427) 8414 : cluster [DBG] pgmap v4795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:34.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:34 gibba020 bash[25448]: cluster 2021-03-10T16:32:33.401820+0000 mgr.gibba020.yqfnwy (mgr.34427) 8414 : cluster [DBG] pgmap v4795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:36.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:36 gibba013 bash[29418]: cluster 2021-03-10T16:32:35.403253+0000 mgr.gibba020.yqfnwy (mgr.34427) 8415 : cluster [DBG] pgmap v4796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:36.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:36 gibba013 bash[30381]: cluster 2021-03-10T16:32:35.403253+0000 mgr.gibba020.yqfnwy (mgr.34427) 8415 : cluster [DBG] pgmap v4796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:36.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:36 gibba020 bash[25448]: cluster 2021-03-10T16:32:35.403253+0000 mgr.gibba020.yqfnwy (mgr.34427) 8415 : cluster [DBG] pgmap v4796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:37.446 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:32:37.675 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:32:37.675 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 119s ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:32:37.676 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 55s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:32:37.676 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 55s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:32:37.676 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 55s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:32:37.676 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 119s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:32:37.677 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 119s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:32:37.677 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 55s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:32:37.677 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 119s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:32:37.677 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 119s ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:32:37.677 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 55s ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:32:37.678 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 119s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:32:37.678 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 119s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:32:37.678 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 119s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:32:37.678 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 119s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:32:37.679 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 55s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:32:37.679 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 55s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:32:37.679 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 55s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:32:37.679 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 55s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:32:37.679 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 55s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:32:37.680 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 55s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:32:37.924 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:32:37.925 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:32:37.925 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:32:37.925 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:32:37.926 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:32:37.926 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:32:37.926 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:32:37.926 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:32:37.926 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:32:37.927 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:32:37.927 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:32:37.927 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:32:37.927 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:32:37.927 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:32:37.928 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:32:38.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:38 gibba013 bash[29418]: cluster 2021-03-10T16:32:37.404436+0000 mgr.gibba020.yqfnwy (mgr.34427) 8416 : cluster [DBG] pgmap v4797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:38.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:38 gibba013 bash[29418]: audit 2021-03-10T16:32:37.438018+0000 mgr.gibba020.yqfnwy (mgr.34427) 8417 : audit [DBG] from='client.49704 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:32:38.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:38 gibba013 bash[29418]: audit 2021-03-10T16:32:37.663364+0000 mgr.gibba020.yqfnwy (mgr.34427) 8418 : audit [DBG] from='client.49710 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:32:38.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:38 gibba013 bash[29418]: audit 2021-03-10T16:32:37.925958+0000 mon.a (mon.0) 3096 : audit [DBG] from='client.? 172.21.2.113:0/2469640680' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:38.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:38 gibba013 bash[30381]: cluster 2021-03-10T16:32:37.404436+0000 mgr.gibba020.yqfnwy (mgr.34427) 8416 : cluster [DBG] pgmap v4797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:38.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:38 gibba013 bash[30381]: audit 2021-03-10T16:32:37.438018+0000 mgr.gibba020.yqfnwy (mgr.34427) 8417 : audit [DBG] from='client.49704 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:32:38.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:38 gibba013 bash[30381]: audit 2021-03-10T16:32:37.663364+0000 mgr.gibba020.yqfnwy (mgr.34427) 8418 : audit [DBG] from='client.49710 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:32:38.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:38 gibba013 bash[30381]: audit 2021-03-10T16:32:37.925958+0000 mon.a (mon.0) 3096 : audit [DBG] from='client.? 172.21.2.113:0/2469640680' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:38.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:38 gibba020 bash[25448]: cluster 2021-03-10T16:32:37.404436+0000 mgr.gibba020.yqfnwy (mgr.34427) 8416 : cluster [DBG] pgmap v4797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:38.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:38 gibba020 bash[25448]: audit 2021-03-10T16:32:37.438018+0000 mgr.gibba020.yqfnwy (mgr.34427) 8417 : audit [DBG] from='client.49704 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:32:38.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:38 gibba020 bash[25448]: audit 2021-03-10T16:32:37.663364+0000 mgr.gibba020.yqfnwy (mgr.34427) 8418 : audit [DBG] from='client.49710 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:32:38.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:38 gibba020 bash[25448]: audit 2021-03-10T16:32:37.925958+0000 mon.a (mon.0) 3096 : audit [DBG] from='client.? 172.21.2.113:0/2469640680' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:40.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:40 gibba020 bash[25448]: cluster 2021-03-10T16:32:39.405184+0000 mgr.gibba020.yqfnwy (mgr.34427) 8419 : cluster [DBG] pgmap v4798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:40.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:40 gibba013 bash[29418]: cluster 2021-03-10T16:32:39.405184+0000 mgr.gibba020.yqfnwy (mgr.34427) 8419 : cluster [DBG] pgmap v4798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:40.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:40 gibba013 bash[30381]: cluster 2021-03-10T16:32:39.405184+0000 mgr.gibba020.yqfnwy (mgr.34427) 8419 : cluster [DBG] pgmap v4798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:42.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:42 gibba013 bash[29418]: cluster 2021-03-10T16:32:41.406660+0000 mgr.gibba020.yqfnwy (mgr.34427) 8420 : cluster [DBG] pgmap v4799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:42.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:42 gibba013 bash[30381]: cluster 2021-03-10T16:32:41.406660+0000 mgr.gibba020.yqfnwy (mgr.34427) 8420 : cluster [DBG] pgmap v4799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:42.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:42 gibba020 bash[25448]: cluster 2021-03-10T16:32:41.406660+0000 mgr.gibba020.yqfnwy (mgr.34427) 8420 : cluster [DBG] pgmap v4799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:43.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:43 gibba013 bash[29418]: audit 2021-03-10T16:32:42.770211+0000 mon.a (mon.0) 3097 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:32:43.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:43 gibba013 bash[29418]: cephadm 2021-03-10T16:32:42.775105+0000 mgr.gibba020.yqfnwy (mgr.34427) 8421 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:32:43.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:43 gibba013 bash[29418]: cephadm 2021-03-10T16:32:42.777098+0000 mgr.gibba020.yqfnwy (mgr.34427) 8422 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:32:43.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:43 gibba013 bash[29418]: audit 2021-03-10T16:32:42.990930+0000 mon.a (mon.0) 3098 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:32:43.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:43 gibba013 bash[29418]: audit 2021-03-10T16:32:42.994369+0000 mon.a (mon.0) 3099 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:32:43.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:43 gibba013 bash[29418]: audit 2021-03-10T16:32:42.996075+0000 mon.a (mon.0) 3100 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:43.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:43 gibba013 bash[29418]: audit 2021-03-10T16:32:42.997742+0000 mon.a (mon.0) 3101 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:43.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:43 gibba013 bash[29418]: audit 2021-03-10T16:32:42.999285+0000 mon.a (mon.0) 3102 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:43.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:43 gibba013 bash[29418]: audit 2021-03-10T16:32:43.001963+0000 mon.a (mon.0) 3103 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:43.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:43 gibba013 bash[29418]: audit 2021-03-10T16:32:43.003608+0000 mon.a (mon.0) 3104 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:43.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:43 gibba013 bash[30381]: audit 2021-03-10T16:32:42.770211+0000 mon.a (mon.0) 3097 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:32:43.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:43 gibba013 bash[30381]: cephadm 2021-03-10T16:32:42.775105+0000 mgr.gibba020.yqfnwy (mgr.34427) 8421 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:32:43.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:43 gibba013 bash[30381]: cephadm 2021-03-10T16:32:42.777098+0000 mgr.gibba020.yqfnwy (mgr.34427) 8422 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:32:43.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:43 gibba013 bash[30381]: audit 2021-03-10T16:32:42.990930+0000 mon.a (mon.0) 3098 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:32:43.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:43 gibba013 bash[30381]: audit 2021-03-10T16:32:42.994369+0000 mon.a (mon.0) 3099 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:32:43.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:43 gibba013 bash[30381]: audit 2021-03-10T16:32:42.996075+0000 mon.a (mon.0) 3100 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:43.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:43 gibba013 bash[30381]: audit 2021-03-10T16:32:42.997742+0000 mon.a (mon.0) 3101 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:43.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:43 gibba013 bash[30381]: audit 2021-03-10T16:32:42.999285+0000 mon.a (mon.0) 3102 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:43.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:43 gibba013 bash[30381]: audit 2021-03-10T16:32:43.001963+0000 mon.a (mon.0) 3103 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:43.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:43 gibba013 bash[30381]: audit 2021-03-10T16:32:43.003608+0000 mon.a (mon.0) 3104 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:43.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:43 gibba020 bash[25448]: audit 2021-03-10T16:32:42.770211+0000 mon.a (mon.0) 3097 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:32:43.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:43 gibba020 bash[25448]: cephadm 2021-03-10T16:32:42.775105+0000 mgr.gibba020.yqfnwy (mgr.34427) 8421 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:32:43.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:43 gibba020 bash[25448]: cephadm 2021-03-10T16:32:42.777098+0000 mgr.gibba020.yqfnwy (mgr.34427) 8422 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:32:43.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:43 gibba020 bash[25448]: audit 2021-03-10T16:32:42.990930+0000 mon.a (mon.0) 3098 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:32:43.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:43 gibba020 bash[25448]: audit 2021-03-10T16:32:42.994369+0000 mon.a (mon.0) 3099 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:32:43.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:43 gibba020 bash[25448]: audit 2021-03-10T16:32:42.996075+0000 mon.a (mon.0) 3100 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:43.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:43 gibba020 bash[25448]: audit 2021-03-10T16:32:42.997742+0000 mon.a (mon.0) 3101 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:43.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:43 gibba020 bash[25448]: audit 2021-03-10T16:32:42.999285+0000 mon.a (mon.0) 3102 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:43.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:43 gibba020 bash[25448]: audit 2021-03-10T16:32:43.001963+0000 mon.a (mon.0) 3103 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:43.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:43 gibba020 bash[25448]: audit 2021-03-10T16:32:43.003608+0000 mon.a (mon.0) 3104 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:32:44.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:44 gibba013 bash[29418]: cephadm 2021-03-10T16:32:42.992971+0000 mgr.gibba020.yqfnwy (mgr.34427) 8423 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:32:44.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:44 gibba013 bash[29418]: cephadm 2021-03-10T16:32:42.994949+0000 mgr.gibba020.yqfnwy (mgr.34427) 8424 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:32:44.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:44 gibba013 bash[29418]: cephadm 2021-03-10T16:32:42.996680+0000 mgr.gibba020.yqfnwy (mgr.34427) 8425 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:32:44.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:44 gibba013 bash[29418]: cephadm 2021-03-10T16:32:42.996720+0000 mgr.gibba020.yqfnwy (mgr.34427) 8426 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:32:44.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:44 gibba013 bash[29418]: cephadm 2021-03-10T16:32:42.998333+0000 mgr.gibba020.yqfnwy (mgr.34427) 8427 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:32:44.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:44 gibba013 bash[29418]: cephadm 2021-03-10T16:32:42.998370+0000 mgr.gibba020.yqfnwy (mgr.34427) 8428 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:32:44.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:44 gibba013 bash[29418]: cephadm 2021-03-10T16:32:42.999801+0000 mgr.gibba020.yqfnwy (mgr.34427) 8429 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:32:44.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:44 gibba013 bash[29418]: cephadm 2021-03-10T16:32:43.000971+0000 mgr.gibba020.yqfnwy (mgr.34427) 8430 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:32:44.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:44 gibba013 bash[29418]: cephadm 2021-03-10T16:32:43.001010+0000 mgr.gibba020.yqfnwy (mgr.34427) 8431 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:32:44.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:44 gibba013 bash[29418]: cephadm 2021-03-10T16:32:43.002406+0000 mgr.gibba020.yqfnwy (mgr.34427) 8432 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:32:44.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:44 gibba013 bash[29418]: cephadm 2021-03-10T16:32:43.002727+0000 mgr.gibba020.yqfnwy (mgr.34427) 8433 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:32:44.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:44 gibba013 bash[29418]: cephadm 2021-03-10T16:32:43.003916+0000 mgr.gibba020.yqfnwy (mgr.34427) 8434 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:32:44.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:44 gibba013 bash[29418]: cephadm 2021-03-10T16:32:43.004084+0000 mgr.gibba020.yqfnwy (mgr.34427) 8435 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:32:44.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:44 gibba013 bash[29418]: cephadm 2021-03-10T16:32:43.004195+0000 mgr.gibba020.yqfnwy (mgr.34427) 8436 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:32:44.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:44 gibba013 bash[29418]: cluster 2021-03-10T16:32:43.408091+0000 mgr.gibba020.yqfnwy (mgr.34427) 8437 : cluster [DBG] pgmap v4800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:44.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:44 gibba013 bash[30381]: cephadm 2021-03-10T16:32:42.992971+0000 mgr.gibba020.yqfnwy (mgr.34427) 8423 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:32:44.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:44 gibba013 bash[30381]: cephadm 2021-03-10T16:32:42.994949+0000 mgr.gibba020.yqfnwy (mgr.34427) 8424 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:32:44.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:44 gibba013 bash[30381]: cephadm 2021-03-10T16:32:42.996680+0000 mgr.gibba020.yqfnwy (mgr.34427) 8425 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:32:44.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:44 gibba013 bash[30381]: cephadm 2021-03-10T16:32:42.996720+0000 mgr.gibba020.yqfnwy (mgr.34427) 8426 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:32:44.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:44 gibba013 bash[30381]: cephadm 2021-03-10T16:32:42.998333+0000 mgr.gibba020.yqfnwy (mgr.34427) 8427 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:32:44.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:44 gibba013 bash[30381]: cephadm 2021-03-10T16:32:42.998370+0000 mgr.gibba020.yqfnwy (mgr.34427) 8428 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:32:44.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:44 gibba013 bash[30381]: cephadm 2021-03-10T16:32:42.999801+0000 mgr.gibba020.yqfnwy (mgr.34427) 8429 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:32:44.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:44 gibba013 bash[30381]: cephadm 2021-03-10T16:32:43.000971+0000 mgr.gibba020.yqfnwy (mgr.34427) 8430 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:32:44.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:44 gibba013 bash[30381]: cephadm 2021-03-10T16:32:43.001010+0000 mgr.gibba020.yqfnwy (mgr.34427) 8431 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:32:44.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:44 gibba013 bash[30381]: cephadm 2021-03-10T16:32:43.002406+0000 mgr.gibba020.yqfnwy (mgr.34427) 8432 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:32:44.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:44 gibba013 bash[30381]: cephadm 2021-03-10T16:32:43.002727+0000 mgr.gibba020.yqfnwy (mgr.34427) 8433 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:32:44.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:44 gibba013 bash[30381]: cephadm 2021-03-10T16:32:43.003916+0000 mgr.gibba020.yqfnwy (mgr.34427) 8434 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:32:44.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:44 gibba013 bash[30381]: cephadm 2021-03-10T16:32:43.004084+0000 mgr.gibba020.yqfnwy (mgr.34427) 8435 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:32:44.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:44 gibba013 bash[30381]: cephadm 2021-03-10T16:32:43.004195+0000 mgr.gibba020.yqfnwy (mgr.34427) 8436 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:32:44.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:44 gibba013 bash[30381]: cluster 2021-03-10T16:32:43.408091+0000 mgr.gibba020.yqfnwy (mgr.34427) 8437 : cluster [DBG] pgmap v4800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:44.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:44 gibba020 bash[25448]: cephadm 2021-03-10T16:32:42.992971+0000 mgr.gibba020.yqfnwy (mgr.34427) 8423 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:32:44.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:44 gibba020 bash[25448]: cephadm 2021-03-10T16:32:42.994949+0000 mgr.gibba020.yqfnwy (mgr.34427) 8424 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:32:44.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:44 gibba020 bash[25448]: cephadm 2021-03-10T16:32:42.996680+0000 mgr.gibba020.yqfnwy (mgr.34427) 8425 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:32:44.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:44 gibba020 bash[25448]: cephadm 2021-03-10T16:32:42.996720+0000 mgr.gibba020.yqfnwy (mgr.34427) 8426 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:32:44.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:44 gibba020 bash[25448]: cephadm 2021-03-10T16:32:42.998333+0000 mgr.gibba020.yqfnwy (mgr.34427) 8427 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:32:44.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:44 gibba020 bash[25448]: cephadm 2021-03-10T16:32:42.998370+0000 mgr.gibba020.yqfnwy (mgr.34427) 8428 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:32:44.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:44 gibba020 bash[25448]: cephadm 2021-03-10T16:32:42.999801+0000 mgr.gibba020.yqfnwy (mgr.34427) 8429 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:32:44.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:44 gibba020 bash[25448]: cephadm 2021-03-10T16:32:43.000971+0000 mgr.gibba020.yqfnwy (mgr.34427) 8430 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:32:44.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:44 gibba020 bash[25448]: cephadm 2021-03-10T16:32:43.001010+0000 mgr.gibba020.yqfnwy (mgr.34427) 8431 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:32:44.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:44 gibba020 bash[25448]: cephadm 2021-03-10T16:32:43.002406+0000 mgr.gibba020.yqfnwy (mgr.34427) 8432 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:32:44.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:44 gibba020 bash[25448]: cephadm 2021-03-10T16:32:43.002727+0000 mgr.gibba020.yqfnwy (mgr.34427) 8433 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:32:44.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:44 gibba020 bash[25448]: cephadm 2021-03-10T16:32:43.003916+0000 mgr.gibba020.yqfnwy (mgr.34427) 8434 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:32:44.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:44 gibba020 bash[25448]: cephadm 2021-03-10T16:32:43.004084+0000 mgr.gibba020.yqfnwy (mgr.34427) 8435 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:32:44.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:44 gibba020 bash[25448]: cephadm 2021-03-10T16:32:43.004195+0000 mgr.gibba020.yqfnwy (mgr.34427) 8436 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:32:44.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:44 gibba020 bash[25448]: cluster 2021-03-10T16:32:43.408091+0000 mgr.gibba020.yqfnwy (mgr.34427) 8437 : cluster [DBG] pgmap v4800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:46.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:46 gibba013 bash[29418]: cluster 2021-03-10T16:32:45.409670+0000 mgr.gibba020.yqfnwy (mgr.34427) 8438 : cluster [DBG] pgmap v4801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:46.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:46 gibba013 bash[30381]: cluster 2021-03-10T16:32:45.409670+0000 mgr.gibba020.yqfnwy (mgr.34427) 8438 : cluster [DBG] pgmap v4801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:46.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:46 gibba020 bash[25448]: cluster 2021-03-10T16:32:45.409670+0000 mgr.gibba020.yqfnwy (mgr.34427) 8438 : cluster [DBG] pgmap v4801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:48.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:48 gibba013 bash[29418]: cluster 2021-03-10T16:32:47.411105+0000 mgr.gibba020.yqfnwy (mgr.34427) 8439 : cluster [DBG] pgmap v4802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:48.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:48 gibba013 bash[30381]: cluster 2021-03-10T16:32:47.411105+0000 mgr.gibba020.yqfnwy (mgr.34427) 8439 : cluster [DBG] pgmap v4802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:48.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:48 gibba020 bash[25448]: cluster 2021-03-10T16:32:47.411105+0000 mgr.gibba020.yqfnwy (mgr.34427) 8439 : cluster [DBG] pgmap v4802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:50.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:50 gibba020 bash[25448]: cluster 2021-03-10T16:32:49.411598+0000 mgr.gibba020.yqfnwy (mgr.34427) 8440 : cluster [DBG] pgmap v4803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:50.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:50 gibba013 bash[29418]: cluster 2021-03-10T16:32:49.411598+0000 mgr.gibba020.yqfnwy (mgr.34427) 8440 : cluster [DBG] pgmap v4803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:50.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:50 gibba013 bash[30381]: cluster 2021-03-10T16:32:49.411598+0000 mgr.gibba020.yqfnwy (mgr.34427) 8440 : cluster [DBG] pgmap v4803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:52.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:52 gibba013 bash[29418]: cluster 2021-03-10T16:32:51.413308+0000 mgr.gibba020.yqfnwy (mgr.34427) 8441 : cluster [DBG] pgmap v4804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:52.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:52 gibba013 bash[30381]: cluster 2021-03-10T16:32:51.413308+0000 mgr.gibba020.yqfnwy (mgr.34427) 8441 : cluster [DBG] pgmap v4804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:52.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:52 gibba020 bash[25448]: cluster 2021-03-10T16:32:51.413308+0000 mgr.gibba020.yqfnwy (mgr.34427) 8441 : cluster [DBG] pgmap v4804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:54.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:54 gibba013 bash[29418]: cluster 2021-03-10T16:32:53.414832+0000 mgr.gibba020.yqfnwy (mgr.34427) 8442 : cluster [DBG] pgmap v4805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:54.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:54 gibba013 bash[30381]: cluster 2021-03-10T16:32:53.414832+0000 mgr.gibba020.yqfnwy (mgr.34427) 8442 : cluster [DBG] pgmap v4805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:54.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:54 gibba020 bash[25448]: cluster 2021-03-10T16:32:53.414832+0000 mgr.gibba020.yqfnwy (mgr.34427) 8442 : cluster [DBG] pgmap v4805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:56.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:56 gibba013 bash[29418]: cluster 2021-03-10T16:32:55.416445+0000 mgr.gibba020.yqfnwy (mgr.34427) 8443 : cluster [DBG] pgmap v4806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:56.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:56 gibba013 bash[30381]: cluster 2021-03-10T16:32:55.416445+0000 mgr.gibba020.yqfnwy (mgr.34427) 8443 : cluster [DBG] pgmap v4806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:56.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:56 gibba020 bash[25448]: cluster 2021-03-10T16:32:55.416445+0000 mgr.gibba020.yqfnwy (mgr.34427) 8443 : cluster [DBG] pgmap v4806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:58.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:58 gibba013 bash[29418]: cluster 2021-03-10T16:32:57.417745+0000 mgr.gibba020.yqfnwy (mgr.34427) 8444 : cluster [DBG] pgmap v4807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:58.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:58 gibba013 bash[30381]: cluster 2021-03-10T16:32:57.417745+0000 mgr.gibba020.yqfnwy (mgr.34427) 8444 : cluster [DBG] pgmap v4807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:58.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:58 gibba020 bash[25448]: cluster 2021-03-10T16:32:57.417745+0000 mgr.gibba020.yqfnwy (mgr.34427) 8444 : cluster [DBG] pgmap v4807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:32:59.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:32:59 gibba013 bash[29418]: cephadm 2021-03-10T16:32:58.020234+0000 mgr.gibba020.yqfnwy (mgr.34427) 8445 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:32:59.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:32:59 gibba013 bash[30381]: cephadm 2021-03-10T16:32:58.020234+0000 mgr.gibba020.yqfnwy (mgr.34427) 8445 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:32:59.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:32:59 gibba020 bash[25448]: cephadm 2021-03-10T16:32:58.020234+0000 mgr.gibba020.yqfnwy (mgr.34427) 8445 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:33:00.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:00 gibba013 bash[29418]: cluster 2021-03-10T16:32:59.418491+0000 mgr.gibba020.yqfnwy (mgr.34427) 8446 : cluster [DBG] pgmap v4808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:00.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:00 gibba013 bash[30381]: cluster 2021-03-10T16:32:59.418491+0000 mgr.gibba020.yqfnwy (mgr.34427) 8446 : cluster [DBG] pgmap v4808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:00.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:00 gibba020 bash[25448]: cluster 2021-03-10T16:32:59.418491+0000 mgr.gibba020.yqfnwy (mgr.34427) 8446 : cluster [DBG] pgmap v4808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:02.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:02 gibba013 bash[29418]: cluster 2021-03-10T16:33:01.420170+0000 mgr.gibba020.yqfnwy (mgr.34427) 8447 : cluster [DBG] pgmap v4809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:02.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:02 gibba013 bash[30381]: cluster 2021-03-10T16:33:01.420170+0000 mgr.gibba020.yqfnwy (mgr.34427) 8447 : cluster [DBG] pgmap v4809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:02.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:02 gibba020 bash[25448]: cluster 2021-03-10T16:33:01.420170+0000 mgr.gibba020.yqfnwy (mgr.34427) 8447 : cluster [DBG] pgmap v4809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:04.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:04 gibba013 bash[29418]: cluster 2021-03-10T16:33:03.421557+0000 mgr.gibba020.yqfnwy (mgr.34427) 8448 : cluster [DBG] pgmap v4810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:04.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:04 gibba013 bash[30381]: cluster 2021-03-10T16:33:03.421557+0000 mgr.gibba020.yqfnwy (mgr.34427) 8448 : cluster [DBG] pgmap v4810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:04.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:04 gibba020 bash[25448]: cluster 2021-03-10T16:33:03.421557+0000 mgr.gibba020.yqfnwy (mgr.34427) 8448 : cluster [DBG] pgmap v4810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:06.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:06 gibba013 bash[29418]: cluster 2021-03-10T16:33:05.423010+0000 mgr.gibba020.yqfnwy (mgr.34427) 8449 : cluster [DBG] pgmap v4811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:06.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:06 gibba013 bash[30381]: cluster 2021-03-10T16:33:05.423010+0000 mgr.gibba020.yqfnwy (mgr.34427) 8449 : cluster [DBG] pgmap v4811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:06.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:06 gibba020 bash[25448]: cluster 2021-03-10T16:33:05.423010+0000 mgr.gibba020.yqfnwy (mgr.34427) 8449 : cluster [DBG] pgmap v4811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:07.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:07 gibba013 bash[29418]: audit 2021-03-10T16:33:06.727596+0000 mon.a (mon.0) 3105 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:33:07.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:07 gibba013 bash[29418]: audit 2021-03-10T16:33:06.884144+0000 mon.a (mon.0) 3106 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:33:07.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:07 gibba013 bash[29418]: audit 2021-03-10T16:33:07.180370+0000 mon.a (mon.0) 3107 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:33:07.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:07 gibba013 bash[29418]: audit 2021-03-10T16:33:07.181125+0000 mon.a (mon.0) 3108 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:33:07.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:07 gibba013 bash[29418]: audit 2021-03-10T16:33:07.181810+0000 mon.a (mon.0) 3109 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:33:07.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:07 gibba013 bash[29418]: audit 2021-03-10T16:33:07.182589+0000 mon.a (mon.0) 3110 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:33:07.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:07 gibba013 bash[30381]: audit 2021-03-10T16:33:06.727596+0000 mon.a (mon.0) 3105 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:33:07.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:07 gibba013 bash[30381]: audit 2021-03-10T16:33:06.884144+0000 mon.a (mon.0) 3106 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:33:07.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:07 gibba013 bash[30381]: audit 2021-03-10T16:33:07.180370+0000 mon.a (mon.0) 3107 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:33:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:07 gibba013 bash[30381]: audit 2021-03-10T16:33:07.181125+0000 mon.a (mon.0) 3108 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:33:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:07 gibba013 bash[30381]: audit 2021-03-10T16:33:07.181810+0000 mon.a (mon.0) 3109 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:33:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:07 gibba013 bash[30381]: audit 2021-03-10T16:33:07.182589+0000 mon.a (mon.0) 3110 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:33:07.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:07 gibba020 bash[25448]: audit 2021-03-10T16:33:06.727596+0000 mon.a (mon.0) 3105 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:33:07.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:07 gibba020 bash[25448]: audit 2021-03-10T16:33:06.884144+0000 mon.a (mon.0) 3106 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:33:07.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:07 gibba020 bash[25448]: audit 2021-03-10T16:33:07.180370+0000 mon.a (mon.0) 3107 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:33:07.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:07 gibba020 bash[25448]: audit 2021-03-10T16:33:07.181125+0000 mon.a (mon.0) 3108 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:33:07.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:07 gibba020 bash[25448]: audit 2021-03-10T16:33:07.181810+0000 mon.a (mon.0) 3109 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:33:07.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:07 gibba020 bash[25448]: audit 2021-03-10T16:33:07.182589+0000 mon.a (mon.0) 3110 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:33:08.167 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:33:08.396 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:33:08.396 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 2m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:33:08.397 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 85s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:33:08.397 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 85s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:33:08.397 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 85s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:33:08.398 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:33:08.398 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:33:08.398 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 85s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:33:08.398 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:33:08.399 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:33:08.399 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 85s ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:33:08.399 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:33:08.399 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:33:08.399 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:33:08.400 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:33:08.400 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 85s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:33:08.400 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 85s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:33:08.400 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 85s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:33:08.400 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 85s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:33:08.401 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 85s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:33:08.401 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 85s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:33:08.647 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:33:08.647 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:33:08.648 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:33:08.648 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:33:08.648 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:33:08.648 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:33:08.649 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:33:08.649 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:33:08.649 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:33:08.649 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:33:08.650 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:33:08.650 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:33:08.650 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:33:08.650 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:33:08.651 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:33:08.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:08 gibba013 bash[29418]: cluster 2021-03-10T16:33:07.424496+0000 mgr.gibba020.yqfnwy (mgr.34427) 8450 : cluster [DBG] pgmap v4812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:08.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:08 gibba013 bash[30381]: cluster 2021-03-10T16:33:07.424496+0000 mgr.gibba020.yqfnwy (mgr.34427) 8450 : cluster [DBG] pgmap v4812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:08.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:08 gibba020 bash[25448]: cluster 2021-03-10T16:33:07.424496+0000 mgr.gibba020.yqfnwy (mgr.34427) 8450 : cluster [DBG] pgmap v4812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:09.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:09 gibba013 bash[29418]: audit 2021-03-10T16:33:08.160280+0000 mgr.gibba020.yqfnwy (mgr.34427) 8451 : audit [DBG] from='client.49722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:33:09.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:09 gibba013 bash[29418]: audit 2021-03-10T16:33:08.384836+0000 mgr.gibba020.yqfnwy (mgr.34427) 8452 : audit [DBG] from='client.49728 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:33:09.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:09 gibba013 bash[29418]: audit 2021-03-10T16:33:08.648690+0000 mon.a (mon.0) 3111 : audit [DBG] from='client.? 172.21.2.113:0/3861960935' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:09.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:09 gibba013 bash[30381]: audit 2021-03-10T16:33:08.160280+0000 mgr.gibba020.yqfnwy (mgr.34427) 8451 : audit [DBG] from='client.49722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:33:09.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:09 gibba013 bash[30381]: audit 2021-03-10T16:33:08.384836+0000 mgr.gibba020.yqfnwy (mgr.34427) 8452 : audit [DBG] from='client.49728 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:33:09.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:09 gibba013 bash[30381]: audit 2021-03-10T16:33:08.648690+0000 mon.a (mon.0) 3111 : audit [DBG] from='client.? 172.21.2.113:0/3861960935' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:09.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:09 gibba020 bash[25448]: audit 2021-03-10T16:33:08.160280+0000 mgr.gibba020.yqfnwy (mgr.34427) 8451 : audit [DBG] from='client.49722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:33:09.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:09 gibba020 bash[25448]: audit 2021-03-10T16:33:08.384836+0000 mgr.gibba020.yqfnwy (mgr.34427) 8452 : audit [DBG] from='client.49728 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:33:09.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:09 gibba020 bash[25448]: audit 2021-03-10T16:33:08.648690+0000 mon.a (mon.0) 3111 : audit [DBG] from='client.? 172.21.2.113:0/3861960935' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:10.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:10 gibba013 bash[29418]: cluster 2021-03-10T16:33:09.425114+0000 mgr.gibba020.yqfnwy (mgr.34427) 8453 : cluster [DBG] pgmap v4813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:10.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:10 gibba013 bash[30381]: cluster 2021-03-10T16:33:09.425114+0000 mgr.gibba020.yqfnwy (mgr.34427) 8453 : cluster [DBG] pgmap v4813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:10.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:10 gibba020 bash[25448]: cluster 2021-03-10T16:33:09.425114+0000 mgr.gibba020.yqfnwy (mgr.34427) 8453 : cluster [DBG] pgmap v4813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:12.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:12 gibba013 bash[29418]: cluster 2021-03-10T16:33:11.426830+0000 mgr.gibba020.yqfnwy (mgr.34427) 8454 : cluster [DBG] pgmap v4814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:12.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:12 gibba013 bash[30381]: cluster 2021-03-10T16:33:11.426830+0000 mgr.gibba020.yqfnwy (mgr.34427) 8454 : cluster [DBG] pgmap v4814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:12.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:12 gibba020 bash[25448]: cluster 2021-03-10T16:33:11.426830+0000 mgr.gibba020.yqfnwy (mgr.34427) 8454 : cluster [DBG] pgmap v4814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:14.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:14 gibba013 bash[29418]: cephadm 2021-03-10T16:33:13.032876+0000 mgr.gibba020.yqfnwy (mgr.34427) 8455 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:33:14.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:14 gibba013 bash[29418]: cluster 2021-03-10T16:33:13.428260+0000 mgr.gibba020.yqfnwy (mgr.34427) 8456 : cluster [DBG] pgmap v4815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:14.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:14 gibba013 bash[30381]: cephadm 2021-03-10T16:33:13.032876+0000 mgr.gibba020.yqfnwy (mgr.34427) 8455 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:33:14.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:14 gibba013 bash[30381]: cluster 2021-03-10T16:33:13.428260+0000 mgr.gibba020.yqfnwy (mgr.34427) 8456 : cluster [DBG] pgmap v4815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:14.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:14 gibba020 bash[25448]: cephadm 2021-03-10T16:33:13.032876+0000 mgr.gibba020.yqfnwy (mgr.34427) 8455 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:33:14.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:14 gibba020 bash[25448]: cluster 2021-03-10T16:33:13.428260+0000 mgr.gibba020.yqfnwy (mgr.34427) 8456 : cluster [DBG] pgmap v4815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:16.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:16 gibba013 bash[29418]: cluster 2021-03-10T16:33:15.429703+0000 mgr.gibba020.yqfnwy (mgr.34427) 8457 : cluster [DBG] pgmap v4816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:16.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:16 gibba013 bash[30381]: cluster 2021-03-10T16:33:15.429703+0000 mgr.gibba020.yqfnwy (mgr.34427) 8457 : cluster [DBG] pgmap v4816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:16.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:16 gibba020 bash[25448]: cluster 2021-03-10T16:33:15.429703+0000 mgr.gibba020.yqfnwy (mgr.34427) 8457 : cluster [DBG] pgmap v4816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:18.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:18 gibba013 bash[29418]: cluster 2021-03-10T16:33:17.430982+0000 mgr.gibba020.yqfnwy (mgr.34427) 8458 : cluster [DBG] pgmap v4817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:18.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:18 gibba013 bash[30381]: cluster 2021-03-10T16:33:17.430982+0000 mgr.gibba020.yqfnwy (mgr.34427) 8458 : cluster [DBG] pgmap v4817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:18.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:18 gibba020 bash[25448]: cluster 2021-03-10T16:33:17.430982+0000 mgr.gibba020.yqfnwy (mgr.34427) 8458 : cluster [DBG] pgmap v4817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:20.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:20 gibba020 bash[25448]: cluster 2021-03-10T16:33:19.431703+0000 mgr.gibba020.yqfnwy (mgr.34427) 8459 : cluster [DBG] pgmap v4818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:20.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:20 gibba013 bash[29418]: cluster 2021-03-10T16:33:19.431703+0000 mgr.gibba020.yqfnwy (mgr.34427) 8459 : cluster [DBG] pgmap v4818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:20.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:20 gibba013 bash[30381]: cluster 2021-03-10T16:33:19.431703+0000 mgr.gibba020.yqfnwy (mgr.34427) 8459 : cluster [DBG] pgmap v4818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:22.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:22 gibba013 bash[29418]: cluster 2021-03-10T16:33:21.433452+0000 mgr.gibba020.yqfnwy (mgr.34427) 8460 : cluster [DBG] pgmap v4819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:22.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:22 gibba013 bash[30381]: cluster 2021-03-10T16:33:21.433452+0000 mgr.gibba020.yqfnwy (mgr.34427) 8460 : cluster [DBG] pgmap v4819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:22.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:22 gibba020 bash[25448]: cluster 2021-03-10T16:33:21.433452+0000 mgr.gibba020.yqfnwy (mgr.34427) 8460 : cluster [DBG] pgmap v4819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:24.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:24 gibba013 bash[29418]: cluster 2021-03-10T16:33:23.434771+0000 mgr.gibba020.yqfnwy (mgr.34427) 8461 : cluster [DBG] pgmap v4820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:24.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:24 gibba013 bash[30381]: cluster 2021-03-10T16:33:23.434771+0000 mgr.gibba020.yqfnwy (mgr.34427) 8461 : cluster [DBG] pgmap v4820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:24.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:24 gibba020 bash[25448]: cluster 2021-03-10T16:33:23.434771+0000 mgr.gibba020.yqfnwy (mgr.34427) 8461 : cluster [DBG] pgmap v4820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:26.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:26 gibba013 bash[29418]: cluster 2021-03-10T16:33:25.436417+0000 mgr.gibba020.yqfnwy (mgr.34427) 8462 : cluster [DBG] pgmap v4821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:26.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:26 gibba013 bash[30381]: cluster 2021-03-10T16:33:25.436417+0000 mgr.gibba020.yqfnwy (mgr.34427) 8462 : cluster [DBG] pgmap v4821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:26.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:26 gibba020 bash[25448]: cluster 2021-03-10T16:33:25.436417+0000 mgr.gibba020.yqfnwy (mgr.34427) 8462 : cluster [DBG] pgmap v4821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:28.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:28 gibba013 bash[29418]: cluster 2021-03-10T16:33:27.437704+0000 mgr.gibba020.yqfnwy (mgr.34427) 8463 : cluster [DBG] pgmap v4822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:28.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:28 gibba013 bash[30381]: cluster 2021-03-10T16:33:27.437704+0000 mgr.gibba020.yqfnwy (mgr.34427) 8463 : cluster [DBG] pgmap v4822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:28.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:28 gibba020 bash[25448]: cluster 2021-03-10T16:33:27.437704+0000 mgr.gibba020.yqfnwy (mgr.34427) 8463 : cluster [DBG] pgmap v4822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:29.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:29 gibba013 bash[29418]: cephadm 2021-03-10T16:33:28.047374+0000 mgr.gibba020.yqfnwy (mgr.34427) 8464 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:33:29.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:29 gibba013 bash[30381]: cephadm 2021-03-10T16:33:28.047374+0000 mgr.gibba020.yqfnwy (mgr.34427) 8464 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:33:29.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:29 gibba020 bash[25448]: cephadm 2021-03-10T16:33:28.047374+0000 mgr.gibba020.yqfnwy (mgr.34427) 8464 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:33:30.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:30 gibba013 bash[29418]: cluster 2021-03-10T16:33:29.438568+0000 mgr.gibba020.yqfnwy (mgr.34427) 8465 : cluster [DBG] pgmap v4823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:30.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:30 gibba013 bash[30381]: cluster 2021-03-10T16:33:29.438568+0000 mgr.gibba020.yqfnwy (mgr.34427) 8465 : cluster [DBG] pgmap v4823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:30.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:30 gibba020 bash[25448]: cluster 2021-03-10T16:33:29.438568+0000 mgr.gibba020.yqfnwy (mgr.34427) 8465 : cluster [DBG] pgmap v4823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:32.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:32 gibba013 bash[29418]: cluster 2021-03-10T16:33:31.440245+0000 mgr.gibba020.yqfnwy (mgr.34427) 8466 : cluster [DBG] pgmap v4824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:32.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:32 gibba013 bash[30381]: cluster 2021-03-10T16:33:31.440245+0000 mgr.gibba020.yqfnwy (mgr.34427) 8466 : cluster [DBG] pgmap v4824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:32.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:32 gibba020 bash[25448]: cluster 2021-03-10T16:33:31.440245+0000 mgr.gibba020.yqfnwy (mgr.34427) 8466 : cluster [DBG] pgmap v4824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:34.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:34 gibba013 bash[29418]: cluster 2021-03-10T16:33:33.441569+0000 mgr.gibba020.yqfnwy (mgr.34427) 8467 : cluster [DBG] pgmap v4825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:34.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:34 gibba013 bash[30381]: cluster 2021-03-10T16:33:33.441569+0000 mgr.gibba020.yqfnwy (mgr.34427) 8467 : cluster [DBG] pgmap v4825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:34.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:34 gibba020 bash[25448]: cluster 2021-03-10T16:33:33.441569+0000 mgr.gibba020.yqfnwy (mgr.34427) 8467 : cluster [DBG] pgmap v4825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:36.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:36 gibba013 bash[29418]: cluster 2021-03-10T16:33:35.443198+0000 mgr.gibba020.yqfnwy (mgr.34427) 8468 : cluster [DBG] pgmap v4826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:36.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:36 gibba013 bash[30381]: cluster 2021-03-10T16:33:35.443198+0000 mgr.gibba020.yqfnwy (mgr.34427) 8468 : cluster [DBG] pgmap v4826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:36.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:36 gibba020 bash[25448]: cluster 2021-03-10T16:33:35.443198+0000 mgr.gibba020.yqfnwy (mgr.34427) 8468 : cluster [DBG] pgmap v4826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:38.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:38 gibba013 bash[29418]: cluster 2021-03-10T16:33:37.444659+0000 mgr.gibba020.yqfnwy (mgr.34427) 8469 : cluster [DBG] pgmap v4827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:38.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:38 gibba013 bash[30381]: cluster 2021-03-10T16:33:37.444659+0000 mgr.gibba020.yqfnwy (mgr.34427) 8469 : cluster [DBG] pgmap v4827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:38.889 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:33:38.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:38 gibba020 bash[25448]: cluster 2021-03-10T16:33:37.444659+0000 mgr.gibba020.yqfnwy (mgr.34427) 8469 : cluster [DBG] pgmap v4827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:39.120 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:33:39.120 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 3m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:33:39.120 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 116s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:33:39.121 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 116s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:33:39.121 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 116s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:33:39.121 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:33:39.121 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:33:39.121 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 116s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:33:39.122 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:33:39.122 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:33:39.122 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 116s ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:33:39.122 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:33:39.123 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:33:39.123 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:33:39.123 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:33:39.123 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 116s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:33:39.124 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 116s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:33:39.124 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 116s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:33:39.124 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 116s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:33:39.124 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 116s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:33:39.124 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 116s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:33:39.370 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:33:39.370 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:33:39.370 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:33:39.371 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:33:39.371 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:33:39.371 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:33:39.372 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:33:39.372 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:33:39.372 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:33:39.372 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:33:39.372 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:33:39.373 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:33:39.373 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:33:39.373 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:33:39.373 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:33:39.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:39 gibba013 bash[29418]: audit 2021-03-10T16:33:39.371569+0000 mon.c (mon.1) 137 : audit [DBG] from='client.? 172.21.2.113:0/3301046705' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:39.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:39 gibba013 bash[30381]: audit 2021-03-10T16:33:39.371569+0000 mon.c (mon.1) 137 : audit [DBG] from='client.? 172.21.2.113:0/3301046705' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:39.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:39 gibba020 bash[25448]: audit 2021-03-10T16:33:39.371569+0000 mon.c (mon.1) 137 : audit [DBG] from='client.? 172.21.2.113:0/3301046705' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:40.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:40 gibba013 bash[29418]: audit 2021-03-10T16:33:38.881713+0000 mgr.gibba020.yqfnwy (mgr.34427) 8470 : audit [DBG] from='client.49740 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:33:40.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:40 gibba013 bash[29418]: audit 2021-03-10T16:33:39.108694+0000 mgr.gibba020.yqfnwy (mgr.34427) 8471 : audit [DBG] from='client.59728 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:33:40.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:40 gibba013 bash[29418]: cluster 2021-03-10T16:33:39.445321+0000 mgr.gibba020.yqfnwy (mgr.34427) 8472 : cluster [DBG] pgmap v4828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:40.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:40 gibba013 bash[30381]: audit 2021-03-10T16:33:38.881713+0000 mgr.gibba020.yqfnwy (mgr.34427) 8470 : audit [DBG] from='client.49740 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:33:40.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:40 gibba013 bash[30381]: audit 2021-03-10T16:33:39.108694+0000 mgr.gibba020.yqfnwy (mgr.34427) 8471 : audit [DBG] from='client.59728 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:33:40.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:40 gibba013 bash[30381]: cluster 2021-03-10T16:33:39.445321+0000 mgr.gibba020.yqfnwy (mgr.34427) 8472 : cluster [DBG] pgmap v4828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:40.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:40 gibba020 bash[25448]: audit 2021-03-10T16:33:38.881713+0000 mgr.gibba020.yqfnwy (mgr.34427) 8470 : audit [DBG] from='client.49740 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:33:40.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:40 gibba020 bash[25448]: audit 2021-03-10T16:33:39.108694+0000 mgr.gibba020.yqfnwy (mgr.34427) 8471 : audit [DBG] from='client.59728 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:33:40.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:40 gibba020 bash[25448]: cluster 2021-03-10T16:33:39.445321+0000 mgr.gibba020.yqfnwy (mgr.34427) 8472 : cluster [DBG] pgmap v4828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:42.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:42 gibba013 bash[29418]: cluster 2021-03-10T16:33:41.447231+0000 mgr.gibba020.yqfnwy (mgr.34427) 8473 : cluster [DBG] pgmap v4829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:42.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:42 gibba013 bash[30381]: cluster 2021-03-10T16:33:41.447231+0000 mgr.gibba020.yqfnwy (mgr.34427) 8473 : cluster [DBG] pgmap v4829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:42.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:42 gibba020 bash[25448]: cluster 2021-03-10T16:33:41.447231+0000 mgr.gibba020.yqfnwy (mgr.34427) 8473 : cluster [DBG] pgmap v4829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:43.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:43 gibba013 bash[29418]: audit 2021-03-10T16:33:43.061653+0000 mon.a (mon.0) 3112 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:33:43.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:43 gibba013 bash[29418]: audit 2021-03-10T16:33:43.267748+0000 mon.a (mon.0) 3113 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:33:43.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:43 gibba013 bash[29418]: audit 2021-03-10T16:33:43.271050+0000 mon.a (mon.0) 3114 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:33:43.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:43 gibba013 bash[29418]: audit 2021-03-10T16:33:43.272285+0000 mon.a (mon.0) 3115 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:43.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:43 gibba013 bash[29418]: audit 2021-03-10T16:33:43.273634+0000 mon.a (mon.0) 3116 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:43.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:43 gibba013 bash[29418]: audit 2021-03-10T16:33:43.274828+0000 mon.a (mon.0) 3117 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:43.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:43 gibba013 bash[29418]: audit 2021-03-10T16:33:43.277208+0000 mon.a (mon.0) 3118 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:43.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:43 gibba013 bash[29418]: audit 2021-03-10T16:33:43.278695+0000 mon.a (mon.0) 3119 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:43.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:43 gibba013 bash[30381]: audit 2021-03-10T16:33:43.061653+0000 mon.a (mon.0) 3112 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:33:43.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:43 gibba013 bash[30381]: audit 2021-03-10T16:33:43.267748+0000 mon.a (mon.0) 3113 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:33:43.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:43 gibba013 bash[30381]: audit 2021-03-10T16:33:43.271050+0000 mon.a (mon.0) 3114 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:33:43.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:43 gibba013 bash[30381]: audit 2021-03-10T16:33:43.272285+0000 mon.a (mon.0) 3115 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:43.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:43 gibba013 bash[30381]: audit 2021-03-10T16:33:43.273634+0000 mon.a (mon.0) 3116 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:43.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:43 gibba013 bash[30381]: audit 2021-03-10T16:33:43.274828+0000 mon.a (mon.0) 3117 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:43.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:43 gibba013 bash[30381]: audit 2021-03-10T16:33:43.277208+0000 mon.a (mon.0) 3118 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:43.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:43 gibba013 bash[30381]: audit 2021-03-10T16:33:43.278695+0000 mon.a (mon.0) 3119 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:43.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:43 gibba020 bash[25448]: audit 2021-03-10T16:33:43.061653+0000 mon.a (mon.0) 3112 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:33:43.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:43 gibba020 bash[25448]: audit 2021-03-10T16:33:43.267748+0000 mon.a (mon.0) 3113 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:33:43.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:43 gibba020 bash[25448]: audit 2021-03-10T16:33:43.271050+0000 mon.a (mon.0) 3114 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:33:43.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:43 gibba020 bash[25448]: audit 2021-03-10T16:33:43.272285+0000 mon.a (mon.0) 3115 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:43.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:43 gibba020 bash[25448]: audit 2021-03-10T16:33:43.273634+0000 mon.a (mon.0) 3116 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:43.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:43 gibba020 bash[25448]: audit 2021-03-10T16:33:43.274828+0000 mon.a (mon.0) 3117 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:43.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:43 gibba020 bash[25448]: audit 2021-03-10T16:33:43.277208+0000 mon.a (mon.0) 3118 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:43.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:43 gibba020 bash[25448]: audit 2021-03-10T16:33:43.278695+0000 mon.a (mon.0) 3119 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:33:44.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:44 gibba013 bash[29418]: cephadm 2021-03-10T16:33:43.063545+0000 mgr.gibba020.yqfnwy (mgr.34427) 8474 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:33:44.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:44 gibba013 bash[29418]: cephadm 2021-03-10T16:33:43.063961+0000 mgr.gibba020.yqfnwy (mgr.34427) 8475 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:33:44.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:44 gibba013 bash[29418]: cephadm 2021-03-10T16:33:43.269684+0000 mgr.gibba020.yqfnwy (mgr.34427) 8476 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:33:44.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:44 gibba013 bash[29418]: cephadm 2021-03-10T16:33:43.271526+0000 mgr.gibba020.yqfnwy (mgr.34427) 8477 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:33:44.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:44 gibba013 bash[29418]: cephadm 2021-03-10T16:33:43.272825+0000 mgr.gibba020.yqfnwy (mgr.34427) 8478 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:33:44.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:44 gibba013 bash[29418]: cephadm 2021-03-10T16:33:43.272862+0000 mgr.gibba020.yqfnwy (mgr.34427) 8479 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:33:44.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:44 gibba013 bash[29418]: cephadm 2021-03-10T16:33:43.274131+0000 mgr.gibba020.yqfnwy (mgr.34427) 8480 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:33:44.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:44 gibba013 bash[29418]: cephadm 2021-03-10T16:33:43.274167+0000 mgr.gibba020.yqfnwy (mgr.34427) 8481 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:33:44.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:44 gibba013 bash[29418]: cephadm 2021-03-10T16:33:43.275408+0000 mgr.gibba020.yqfnwy (mgr.34427) 8482 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:33:44.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:44 gibba013 bash[29418]: cephadm 2021-03-10T16:33:43.276340+0000 mgr.gibba020.yqfnwy (mgr.34427) 8483 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:33:44.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:44 gibba013 bash[29418]: cephadm 2021-03-10T16:33:43.276376+0000 mgr.gibba020.yqfnwy (mgr.34427) 8484 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:33:44.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:44 gibba013 bash[29418]: cephadm 2021-03-10T16:33:43.277443+0000 mgr.gibba020.yqfnwy (mgr.34427) 8485 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:33:44.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:44 gibba013 bash[29418]: cephadm 2021-03-10T16:33:43.277769+0000 mgr.gibba020.yqfnwy (mgr.34427) 8486 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:33:44.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:44 gibba013 bash[29418]: cephadm 2021-03-10T16:33:43.279224+0000 mgr.gibba020.yqfnwy (mgr.34427) 8487 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:33:44.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:44 gibba013 bash[29418]: cephadm 2021-03-10T16:33:43.279263+0000 mgr.gibba020.yqfnwy (mgr.34427) 8488 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:33:44.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:44 gibba013 bash[29418]: cephadm 2021-03-10T16:33:43.279439+0000 mgr.gibba020.yqfnwy (mgr.34427) 8489 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:33:44.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:44 gibba013 bash[29418]: cluster 2021-03-10T16:33:43.448855+0000 mgr.gibba020.yqfnwy (mgr.34427) 8490 : cluster [DBG] pgmap v4830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:44.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:44 gibba013 bash[30381]: cephadm 2021-03-10T16:33:43.063545+0000 mgr.gibba020.yqfnwy (mgr.34427) 8474 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:33:44.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:44 gibba013 bash[30381]: cephadm 2021-03-10T16:33:43.063961+0000 mgr.gibba020.yqfnwy (mgr.34427) 8475 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:33:44.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:44 gibba013 bash[30381]: cephadm 2021-03-10T16:33:43.269684+0000 mgr.gibba020.yqfnwy (mgr.34427) 8476 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:33:44.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:44 gibba013 bash[30381]: cephadm 2021-03-10T16:33:43.271526+0000 mgr.gibba020.yqfnwy (mgr.34427) 8477 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:33:44.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:44 gibba013 bash[30381]: cephadm 2021-03-10T16:33:43.272825+0000 mgr.gibba020.yqfnwy (mgr.34427) 8478 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:33:44.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:44 gibba013 bash[30381]: cephadm 2021-03-10T16:33:43.272862+0000 mgr.gibba020.yqfnwy (mgr.34427) 8479 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:33:44.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:44 gibba013 bash[30381]: cephadm 2021-03-10T16:33:43.274131+0000 mgr.gibba020.yqfnwy (mgr.34427) 8480 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:33:44.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:44 gibba013 bash[30381]: cephadm 2021-03-10T16:33:43.274167+0000 mgr.gibba020.yqfnwy (mgr.34427) 8481 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:33:44.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:44 gibba013 bash[30381]: cephadm 2021-03-10T16:33:43.275408+0000 mgr.gibba020.yqfnwy (mgr.34427) 8482 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:33:44.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:44 gibba013 bash[30381]: cephadm 2021-03-10T16:33:43.276340+0000 mgr.gibba020.yqfnwy (mgr.34427) 8483 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:33:44.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:44 gibba013 bash[30381]: cephadm 2021-03-10T16:33:43.276376+0000 mgr.gibba020.yqfnwy (mgr.34427) 8484 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:33:44.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:44 gibba013 bash[30381]: cephadm 2021-03-10T16:33:43.277443+0000 mgr.gibba020.yqfnwy (mgr.34427) 8485 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:33:44.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:44 gibba013 bash[30381]: cephadm 2021-03-10T16:33:43.277769+0000 mgr.gibba020.yqfnwy (mgr.34427) 8486 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:33:44.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:44 gibba013 bash[30381]: cephadm 2021-03-10T16:33:43.279224+0000 mgr.gibba020.yqfnwy (mgr.34427) 8487 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:33:44.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:44 gibba013 bash[30381]: cephadm 2021-03-10T16:33:43.279263+0000 mgr.gibba020.yqfnwy (mgr.34427) 8488 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:33:44.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:44 gibba013 bash[30381]: cephadm 2021-03-10T16:33:43.279439+0000 mgr.gibba020.yqfnwy (mgr.34427) 8489 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:33:44.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:44 gibba013 bash[30381]: cluster 2021-03-10T16:33:43.448855+0000 mgr.gibba020.yqfnwy (mgr.34427) 8490 : cluster [DBG] pgmap v4830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:44.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:44 gibba020 bash[25448]: cephadm 2021-03-10T16:33:43.063545+0000 mgr.gibba020.yqfnwy (mgr.34427) 8474 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:33:44.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:44 gibba020 bash[25448]: cephadm 2021-03-10T16:33:43.063961+0000 mgr.gibba020.yqfnwy (mgr.34427) 8475 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:33:44.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:44 gibba020 bash[25448]: cephadm 2021-03-10T16:33:43.269684+0000 mgr.gibba020.yqfnwy (mgr.34427) 8476 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:33:44.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:44 gibba020 bash[25448]: cephadm 2021-03-10T16:33:43.271526+0000 mgr.gibba020.yqfnwy (mgr.34427) 8477 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:33:44.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:44 gibba020 bash[25448]: cephadm 2021-03-10T16:33:43.272825+0000 mgr.gibba020.yqfnwy (mgr.34427) 8478 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:33:44.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:44 gibba020 bash[25448]: cephadm 2021-03-10T16:33:43.272862+0000 mgr.gibba020.yqfnwy (mgr.34427) 8479 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:33:44.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:44 gibba020 bash[25448]: cephadm 2021-03-10T16:33:43.274131+0000 mgr.gibba020.yqfnwy (mgr.34427) 8480 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:33:44.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:44 gibba020 bash[25448]: cephadm 2021-03-10T16:33:43.274167+0000 mgr.gibba020.yqfnwy (mgr.34427) 8481 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:33:44.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:44 gibba020 bash[25448]: cephadm 2021-03-10T16:33:43.275408+0000 mgr.gibba020.yqfnwy (mgr.34427) 8482 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:33:44.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:44 gibba020 bash[25448]: cephadm 2021-03-10T16:33:43.276340+0000 mgr.gibba020.yqfnwy (mgr.34427) 8483 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:33:44.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:44 gibba020 bash[25448]: cephadm 2021-03-10T16:33:43.276376+0000 mgr.gibba020.yqfnwy (mgr.34427) 8484 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:33:44.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:44 gibba020 bash[25448]: cephadm 2021-03-10T16:33:43.277443+0000 mgr.gibba020.yqfnwy (mgr.34427) 8485 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:33:44.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:44 gibba020 bash[25448]: cephadm 2021-03-10T16:33:43.277769+0000 mgr.gibba020.yqfnwy (mgr.34427) 8486 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:33:44.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:44 gibba020 bash[25448]: cephadm 2021-03-10T16:33:43.279224+0000 mgr.gibba020.yqfnwy (mgr.34427) 8487 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:33:44.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:44 gibba020 bash[25448]: cephadm 2021-03-10T16:33:43.279263+0000 mgr.gibba020.yqfnwy (mgr.34427) 8488 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:33:44.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:44 gibba020 bash[25448]: cephadm 2021-03-10T16:33:43.279439+0000 mgr.gibba020.yqfnwy (mgr.34427) 8489 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:33:44.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:44 gibba020 bash[25448]: cluster 2021-03-10T16:33:43.448855+0000 mgr.gibba020.yqfnwy (mgr.34427) 8490 : cluster [DBG] pgmap v4830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:46.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:46 gibba013 bash[29418]: cluster 2021-03-10T16:33:45.450504+0000 mgr.gibba020.yqfnwy (mgr.34427) 8491 : cluster [DBG] pgmap v4831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:46.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:46 gibba013 bash[30381]: cluster 2021-03-10T16:33:45.450504+0000 mgr.gibba020.yqfnwy (mgr.34427) 8491 : cluster [DBG] pgmap v4831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:46.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:46 gibba020 bash[25448]: cluster 2021-03-10T16:33:45.450504+0000 mgr.gibba020.yqfnwy (mgr.34427) 8491 : cluster [DBG] pgmap v4831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:48.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:48 gibba013 bash[29418]: cluster 2021-03-10T16:33:47.451907+0000 mgr.gibba020.yqfnwy (mgr.34427) 8492 : cluster [DBG] pgmap v4832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:48.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:48 gibba013 bash[30381]: cluster 2021-03-10T16:33:47.451907+0000 mgr.gibba020.yqfnwy (mgr.34427) 8492 : cluster [DBG] pgmap v4832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:48.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:48 gibba020 bash[25448]: cluster 2021-03-10T16:33:47.451907+0000 mgr.gibba020.yqfnwy (mgr.34427) 8492 : cluster [DBG] pgmap v4832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:50.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:50 gibba020 bash[25448]: cluster 2021-03-10T16:33:49.452521+0000 mgr.gibba020.yqfnwy (mgr.34427) 8493 : cluster [DBG] pgmap v4833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:50.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:50 gibba013 bash[29418]: cluster 2021-03-10T16:33:49.452521+0000 mgr.gibba020.yqfnwy (mgr.34427) 8493 : cluster [DBG] pgmap v4833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:50.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:50 gibba013 bash[30381]: cluster 2021-03-10T16:33:49.452521+0000 mgr.gibba020.yqfnwy (mgr.34427) 8493 : cluster [DBG] pgmap v4833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:52.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:52 gibba013 bash[29418]: cluster 2021-03-10T16:33:51.454095+0000 mgr.gibba020.yqfnwy (mgr.34427) 8494 : cluster [DBG] pgmap v4834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:52.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:52 gibba013 bash[30381]: cluster 2021-03-10T16:33:51.454095+0000 mgr.gibba020.yqfnwy (mgr.34427) 8494 : cluster [DBG] pgmap v4834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:52.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:52 gibba020 bash[25448]: cluster 2021-03-10T16:33:51.454095+0000 mgr.gibba020.yqfnwy (mgr.34427) 8494 : cluster [DBG] pgmap v4834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:54.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:54 gibba013 bash[29418]: cluster 2021-03-10T16:33:53.455527+0000 mgr.gibba020.yqfnwy (mgr.34427) 8495 : cluster [DBG] pgmap v4835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:54.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:54 gibba013 bash[30381]: cluster 2021-03-10T16:33:53.455527+0000 mgr.gibba020.yqfnwy (mgr.34427) 8495 : cluster [DBG] pgmap v4835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:54.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:54 gibba020 bash[25448]: cluster 2021-03-10T16:33:53.455527+0000 mgr.gibba020.yqfnwy (mgr.34427) 8495 : cluster [DBG] pgmap v4835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:56.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:56 gibba013 bash[29418]: cluster 2021-03-10T16:33:55.457122+0000 mgr.gibba020.yqfnwy (mgr.34427) 8496 : cluster [DBG] pgmap v4836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:56.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:56 gibba013 bash[30381]: cluster 2021-03-10T16:33:55.457122+0000 mgr.gibba020.yqfnwy (mgr.34427) 8496 : cluster [DBG] pgmap v4836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:56.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:56 gibba020 bash[25448]: cluster 2021-03-10T16:33:55.457122+0000 mgr.gibba020.yqfnwy (mgr.34427) 8496 : cluster [DBG] pgmap v4836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:58.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:58 gibba020 bash[25448]: cluster 2021-03-10T16:33:57.458349+0000 mgr.gibba020.yqfnwy (mgr.34427) 8497 : cluster [DBG] pgmap v4837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:58.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:58 gibba013 bash[29418]: cluster 2021-03-10T16:33:57.458349+0000 mgr.gibba020.yqfnwy (mgr.34427) 8497 : cluster [DBG] pgmap v4837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:58.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:58 gibba013 bash[30381]: cluster 2021-03-10T16:33:57.458349+0000 mgr.gibba020.yqfnwy (mgr.34427) 8497 : cluster [DBG] pgmap v4837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:33:59.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:33:59 gibba013 bash[29418]: cephadm 2021-03-10T16:33:58.295190+0000 mgr.gibba020.yqfnwy (mgr.34427) 8498 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:33:59.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:33:59 gibba013 bash[30381]: cephadm 2021-03-10T16:33:58.295190+0000 mgr.gibba020.yqfnwy (mgr.34427) 8498 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:33:59.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:33:59 gibba020 bash[25448]: cephadm 2021-03-10T16:33:58.295190+0000 mgr.gibba020.yqfnwy (mgr.34427) 8498 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:34:00.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:00 gibba013 bash[29418]: cluster 2021-03-10T16:33:59.459085+0000 mgr.gibba020.yqfnwy (mgr.34427) 8499 : cluster [DBG] pgmap v4838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:00.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:00 gibba013 bash[30381]: cluster 2021-03-10T16:33:59.459085+0000 mgr.gibba020.yqfnwy (mgr.34427) 8499 : cluster [DBG] pgmap v4838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:00.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:00 gibba020 bash[25448]: cluster 2021-03-10T16:33:59.459085+0000 mgr.gibba020.yqfnwy (mgr.34427) 8499 : cluster [DBG] pgmap v4838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:02.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:02 gibba013 bash[29418]: cluster 2021-03-10T16:34:01.460776+0000 mgr.gibba020.yqfnwy (mgr.34427) 8500 : cluster [DBG] pgmap v4839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:02.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:02 gibba013 bash[30381]: cluster 2021-03-10T16:34:01.460776+0000 mgr.gibba020.yqfnwy (mgr.34427) 8500 : cluster [DBG] pgmap v4839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:02.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:02 gibba020 bash[25448]: cluster 2021-03-10T16:34:01.460776+0000 mgr.gibba020.yqfnwy (mgr.34427) 8500 : cluster [DBG] pgmap v4839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:04.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:04 gibba013 bash[29418]: cluster 2021-03-10T16:34:03.462195+0000 mgr.gibba020.yqfnwy (mgr.34427) 8501 : cluster [DBG] pgmap v4840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:04.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:04 gibba013 bash[30381]: cluster 2021-03-10T16:34:03.462195+0000 mgr.gibba020.yqfnwy (mgr.34427) 8501 : cluster [DBG] pgmap v4840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:04.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:04 gibba020 bash[25448]: cluster 2021-03-10T16:34:03.462195+0000 mgr.gibba020.yqfnwy (mgr.34427) 8501 : cluster [DBG] pgmap v4840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:06.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:06 gibba013 bash[29418]: cluster 2021-03-10T16:34:05.463755+0000 mgr.gibba020.yqfnwy (mgr.34427) 8502 : cluster [DBG] pgmap v4841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:06.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:06 gibba013 bash[30381]: cluster 2021-03-10T16:34:05.463755+0000 mgr.gibba020.yqfnwy (mgr.34427) 8502 : cluster [DBG] pgmap v4841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:06.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:06 gibba020 bash[25448]: cluster 2021-03-10T16:34:05.463755+0000 mgr.gibba020.yqfnwy (mgr.34427) 8502 : cluster [DBG] pgmap v4841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:07.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:07 gibba013 bash[29418]: audit 2021-03-10T16:34:06.732284+0000 mon.a (mon.0) 3120 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:34:07.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:07 gibba013 bash[29418]: audit 2021-03-10T16:34:06.890602+0000 mon.a (mon.0) 3121 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:34:07.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:07 gibba013 bash[29418]: audit 2021-03-10T16:34:07.193541+0000 mon.a (mon.0) 3122 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T16:34:07.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:07 gibba013 bash[29418]: audit 2021-03-10T16:34:07.194332+0000 mon.a (mon.0) 3123 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:34:07.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:07 gibba013 bash[29418]: audit 2021-03-10T16:34:07.195045+0000 mon.a (mon.0) 3124 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:34:07.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:07 gibba013 bash[29418]: audit 2021-03-10T16:34:07.195701+0000 mon.a (mon.0) 3125 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T16:34:07.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:07 gibba013 bash[30381]: audit 2021-03-10T16:34:06.732284+0000 mon.a (mon.0) 3120 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:34:07.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:07 gibba013 bash[30381]: audit 2021-03-10T16:34:06.890602+0000 mon.a (mon.0) 3121 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:34:07.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:07 gibba013 bash[30381]: audit 2021-03-10T16:34:07.193541+0000 mon.a (mon.0) 3122 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T16:34:07.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:07 gibba013 bash[30381]: audit 2021-03-10T16:34:07.194332+0000 mon.a (mon.0) 3123 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:34:07.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:07 gibba013 bash[30381]: audit 2021-03-10T16:34:07.195045+0000 mon.a (mon.0) 3124 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:34:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:07 gibba013 bash[30381]: audit 2021-03-10T16:34:07.195701+0000 mon.a (mon.0) 3125 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T16:34:07.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:07 gibba020 bash[25448]: audit 2021-03-10T16:34:06.732284+0000 mon.a (mon.0) 3120 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:34:07.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:07 gibba020 bash[25448]: audit 2021-03-10T16:34:06.890602+0000 mon.a (mon.0) 3121 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:34:07.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:07 gibba020 bash[25448]: audit 2021-03-10T16:34:07.193541+0000 mon.a (mon.0) 3122 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T16:34:07.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:07 gibba020 bash[25448]: audit 2021-03-10T16:34:07.194332+0000 mon.a (mon.0) 3123 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:34:07.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:07 gibba020 bash[25448]: audit 2021-03-10T16:34:07.195045+0000 mon.a (mon.0) 3124 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:34:07.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:07 gibba020 bash[25448]: audit 2021-03-10T16:34:07.195701+0000 mon.a (mon.0) 3125 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T16:34:08.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:08 gibba013 bash[29418]: cluster 2021-03-10T16:34:07.465329+0000 mgr.gibba020.yqfnwy (mgr.34427) 8503 : cluster [DBG] pgmap v4842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:08.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:08 gibba013 bash[30381]: cluster 2021-03-10T16:34:07.465329+0000 mgr.gibba020.yqfnwy (mgr.34427) 8503 : cluster [DBG] pgmap v4842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:08.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:08 gibba020 bash[25448]: cluster 2021-03-10T16:34:07.465329+0000 mgr.gibba020.yqfnwy (mgr.34427) 8503 : cluster [DBG] pgmap v4842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:09.613 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:34:09.869 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:34:09.869 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 3m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:34:09.869 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 2m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:34:09.870 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:34:09.870 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:34:09.870 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:34:09.870 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:34:09.870 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:34:09.871 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:34:09.871 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:34:09.871 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:34:09.871 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:34:09.871 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:34:09.872 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:34:09.872 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:34:09.872 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:34:09.872 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:34:09.873 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:34:09.873 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:34:09.873 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 2m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:34:09.873 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:34:10.131 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:34:10.131 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:34:10.132 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:34:10.132 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:34:10.132 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:34:10.132 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:34:10.132 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:34:10.133 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:34:10.133 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:34:10.133 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:34:10.133 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:34:10.133 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:34:10.134 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:34:10.134 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:34:10.134 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:34:10.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:10 gibba013 bash[29418]: cluster 2021-03-10T16:34:09.466069+0000 mgr.gibba020.yqfnwy (mgr.34427) 8504 : cluster [DBG] pgmap v4843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:10.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:10 gibba013 bash[29418]: audit 2021-03-10T16:34:09.605468+0000 mgr.gibba020.yqfnwy (mgr.34427) 8505 : audit [DBG] from='client.59740 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:34:10.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:10 gibba013 bash[29418]: audit 2021-03-10T16:34:10.132775+0000 mon.a (mon.0) 3126 : audit [DBG] from='client.? 172.21.2.113:0/2691419302' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:10.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:10 gibba013 bash[30381]: cluster 2021-03-10T16:34:09.466069+0000 mgr.gibba020.yqfnwy (mgr.34427) 8504 : cluster [DBG] pgmap v4843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:10.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:10 gibba013 bash[30381]: audit 2021-03-10T16:34:09.605468+0000 mgr.gibba020.yqfnwy (mgr.34427) 8505 : audit [DBG] from='client.59740 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:34:10.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:10 gibba013 bash[30381]: audit 2021-03-10T16:34:10.132775+0000 mon.a (mon.0) 3126 : audit [DBG] from='client.? 172.21.2.113:0/2691419302' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:10.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:10 gibba020 bash[25448]: cluster 2021-03-10T16:34:09.466069+0000 mgr.gibba020.yqfnwy (mgr.34427) 8504 : cluster [DBG] pgmap v4843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:10.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:10 gibba020 bash[25448]: audit 2021-03-10T16:34:09.605468+0000 mgr.gibba020.yqfnwy (mgr.34427) 8505 : audit [DBG] from='client.59740 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:34:10.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:10 gibba020 bash[25448]: audit 2021-03-10T16:34:10.132775+0000 mon.a (mon.0) 3126 : audit [DBG] from='client.? 172.21.2.113:0/2691419302' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:11.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:11 gibba013 bash[29418]: audit 2021-03-10T16:34:09.827988+0000 mgr.gibba020.yqfnwy (mgr.34427) 8506 : audit [DBG] from='client.49764 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:34:11.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:11 gibba013 bash[30381]: audit 2021-03-10T16:34:09.827988+0000 mgr.gibba020.yqfnwy (mgr.34427) 8506 : audit [DBG] from='client.49764 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:34:11.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:11 gibba020 bash[25448]: audit 2021-03-10T16:34:09.827988+0000 mgr.gibba020.yqfnwy (mgr.34427) 8506 : audit [DBG] from='client.49764 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:34:12.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:12 gibba013 bash[29418]: cluster 2021-03-10T16:34:11.466760+0000 mgr.gibba020.yqfnwy (mgr.34427) 8507 : cluster [DBG] pgmap v4844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:12.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:12 gibba013 bash[30381]: cluster 2021-03-10T16:34:11.466760+0000 mgr.gibba020.yqfnwy (mgr.34427) 8507 : cluster [DBG] pgmap v4844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:12.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:12 gibba020 bash[25448]: cluster 2021-03-10T16:34:11.466760+0000 mgr.gibba020.yqfnwy (mgr.34427) 8507 : cluster [DBG] pgmap v4844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:14.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:14 gibba013 bash[29418]: cephadm 2021-03-10T16:34:13.311009+0000 mgr.gibba020.yqfnwy (mgr.34427) 8508 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:34:14.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:14 gibba013 bash[29418]: cluster 2021-03-10T16:34:13.468041+0000 mgr.gibba020.yqfnwy (mgr.34427) 8509 : cluster [DBG] pgmap v4845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:14.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:14 gibba013 bash[30381]: cephadm 2021-03-10T16:34:13.311009+0000 mgr.gibba020.yqfnwy (mgr.34427) 8508 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:34:14.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:14 gibba013 bash[30381]: cluster 2021-03-10T16:34:13.468041+0000 mgr.gibba020.yqfnwy (mgr.34427) 8509 : cluster [DBG] pgmap v4845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:14.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:14 gibba020 bash[25448]: cephadm 2021-03-10T16:34:13.311009+0000 mgr.gibba020.yqfnwy (mgr.34427) 8508 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:34:14.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:14 gibba020 bash[25448]: cluster 2021-03-10T16:34:13.468041+0000 mgr.gibba020.yqfnwy (mgr.34427) 8509 : cluster [DBG] pgmap v4845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:16.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:16 gibba013 bash[29418]: cluster 2021-03-10T16:34:15.469779+0000 mgr.gibba020.yqfnwy (mgr.34427) 8510 : cluster [DBG] pgmap v4846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:16.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:16 gibba013 bash[30381]: cluster 2021-03-10T16:34:15.469779+0000 mgr.gibba020.yqfnwy (mgr.34427) 8510 : cluster [DBG] pgmap v4846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:16.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:16 gibba020 bash[25448]: cluster 2021-03-10T16:34:15.469779+0000 mgr.gibba020.yqfnwy (mgr.34427) 8510 : cluster [DBG] pgmap v4846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:18.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:18 gibba013 bash[29418]: cluster 2021-03-10T16:34:17.471132+0000 mgr.gibba020.yqfnwy (mgr.34427) 8511 : cluster [DBG] pgmap v4847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:18.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:18 gibba013 bash[30381]: cluster 2021-03-10T16:34:17.471132+0000 mgr.gibba020.yqfnwy (mgr.34427) 8511 : cluster [DBG] pgmap v4847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:18.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:18 gibba020 bash[25448]: cluster 2021-03-10T16:34:17.471132+0000 mgr.gibba020.yqfnwy (mgr.34427) 8511 : cluster [DBG] pgmap v4847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:20.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:20 gibba013 bash[29418]: cluster 2021-03-10T16:34:19.472091+0000 mgr.gibba020.yqfnwy (mgr.34427) 8512 : cluster [DBG] pgmap v4848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:20.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:20 gibba013 bash[30381]: cluster 2021-03-10T16:34:19.472091+0000 mgr.gibba020.yqfnwy (mgr.34427) 8512 : cluster [DBG] pgmap v4848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:20.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:20 gibba020 bash[25448]: cluster 2021-03-10T16:34:19.472091+0000 mgr.gibba020.yqfnwy (mgr.34427) 8512 : cluster [DBG] pgmap v4848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:22.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:22 gibba013 bash[29418]: cluster 2021-03-10T16:34:21.473530+0000 mgr.gibba020.yqfnwy (mgr.34427) 8513 : cluster [DBG] pgmap v4849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:22.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:22 gibba013 bash[30381]: cluster 2021-03-10T16:34:21.473530+0000 mgr.gibba020.yqfnwy (mgr.34427) 8513 : cluster [DBG] pgmap v4849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:22.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:22 gibba020 bash[25448]: cluster 2021-03-10T16:34:21.473530+0000 mgr.gibba020.yqfnwy (mgr.34427) 8513 : cluster [DBG] pgmap v4849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:24.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:24 gibba013 bash[29418]: cluster 2021-03-10T16:34:23.475038+0000 mgr.gibba020.yqfnwy (mgr.34427) 8514 : cluster [DBG] pgmap v4850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:24.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:24 gibba013 bash[30381]: cluster 2021-03-10T16:34:23.475038+0000 mgr.gibba020.yqfnwy (mgr.34427) 8514 : cluster [DBG] pgmap v4850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:24.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:24 gibba020 bash[25448]: cluster 2021-03-10T16:34:23.475038+0000 mgr.gibba020.yqfnwy (mgr.34427) 8514 : cluster [DBG] pgmap v4850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:26.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:26 gibba013 bash[29418]: cluster 2021-03-10T16:34:25.476701+0000 mgr.gibba020.yqfnwy (mgr.34427) 8515 : cluster [DBG] pgmap v4851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:26.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:26 gibba013 bash[30381]: cluster 2021-03-10T16:34:25.476701+0000 mgr.gibba020.yqfnwy (mgr.34427) 8515 : cluster [DBG] pgmap v4851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:26.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:26 gibba020 bash[25448]: cluster 2021-03-10T16:34:25.476701+0000 mgr.gibba020.yqfnwy (mgr.34427) 8515 : cluster [DBG] pgmap v4851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:28.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:28 gibba020 bash[25448]: cluster 2021-03-10T16:34:27.477920+0000 mgr.gibba020.yqfnwy (mgr.34427) 8516 : cluster [DBG] pgmap v4852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:28.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:28 gibba013 bash[29418]: cluster 2021-03-10T16:34:27.477920+0000 mgr.gibba020.yqfnwy (mgr.34427) 8516 : cluster [DBG] pgmap v4852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:28.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:28 gibba013 bash[30381]: cluster 2021-03-10T16:34:27.477920+0000 mgr.gibba020.yqfnwy (mgr.34427) 8516 : cluster [DBG] pgmap v4852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:29.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:29 gibba013 bash[29418]: cephadm 2021-03-10T16:34:28.326806+0000 mgr.gibba020.yqfnwy (mgr.34427) 8517 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:34:29.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:29 gibba013 bash[30381]: cephadm 2021-03-10T16:34:28.326806+0000 mgr.gibba020.yqfnwy (mgr.34427) 8517 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:34:29.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:29 gibba020 bash[25448]: cephadm 2021-03-10T16:34:28.326806+0000 mgr.gibba020.yqfnwy (mgr.34427) 8517 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:34:30.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:30 gibba013 bash[29418]: cluster 2021-03-10T16:34:29.478409+0000 mgr.gibba020.yqfnwy (mgr.34427) 8518 : cluster [DBG] pgmap v4853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:30.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:30 gibba013 bash[30381]: cluster 2021-03-10T16:34:29.478409+0000 mgr.gibba020.yqfnwy (mgr.34427) 8518 : cluster [DBG] pgmap v4853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:30.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:30 gibba020 bash[25448]: cluster 2021-03-10T16:34:29.478409+0000 mgr.gibba020.yqfnwy (mgr.34427) 8518 : cluster [DBG] pgmap v4853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:32.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:32 gibba013 bash[29418]: cluster 2021-03-10T16:34:31.480051+0000 mgr.gibba020.yqfnwy (mgr.34427) 8519 : cluster [DBG] pgmap v4854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:32.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:32 gibba013 bash[30381]: cluster 2021-03-10T16:34:31.480051+0000 mgr.gibba020.yqfnwy (mgr.34427) 8519 : cluster [DBG] pgmap v4854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:32.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:32 gibba020 bash[25448]: cluster 2021-03-10T16:34:31.480051+0000 mgr.gibba020.yqfnwy (mgr.34427) 8519 : cluster [DBG] pgmap v4854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:34.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:34 gibba013 bash[29418]: cluster 2021-03-10T16:34:33.481519+0000 mgr.gibba020.yqfnwy (mgr.34427) 8520 : cluster [DBG] pgmap v4855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:34.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:34 gibba013 bash[30381]: cluster 2021-03-10T16:34:33.481519+0000 mgr.gibba020.yqfnwy (mgr.34427) 8520 : cluster [DBG] pgmap v4855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:34.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:34 gibba020 bash[25448]: cluster 2021-03-10T16:34:33.481519+0000 mgr.gibba020.yqfnwy (mgr.34427) 8520 : cluster [DBG] pgmap v4855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:36.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:36 gibba013 bash[29418]: cluster 2021-03-10T16:34:35.482898+0000 mgr.gibba020.yqfnwy (mgr.34427) 8521 : cluster [DBG] pgmap v4856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:36.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:36 gibba013 bash[30381]: cluster 2021-03-10T16:34:35.482898+0000 mgr.gibba020.yqfnwy (mgr.34427) 8521 : cluster [DBG] pgmap v4856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:36.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:36 gibba020 bash[25448]: cluster 2021-03-10T16:34:35.482898+0000 mgr.gibba020.yqfnwy (mgr.34427) 8521 : cluster [DBG] pgmap v4856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:38.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:38 gibba013 bash[29418]: cluster 2021-03-10T16:34:37.484238+0000 mgr.gibba020.yqfnwy (mgr.34427) 8522 : cluster [DBG] pgmap v4857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:38.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:38 gibba013 bash[30381]: cluster 2021-03-10T16:34:37.484238+0000 mgr.gibba020.yqfnwy (mgr.34427) 8522 : cluster [DBG] pgmap v4857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:38.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:38 gibba020 bash[25448]: cluster 2021-03-10T16:34:37.484238+0000 mgr.gibba020.yqfnwy (mgr.34427) 8522 : cluster [DBG] pgmap v4857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:40.377 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:34:40.608 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:34:40.609 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 4m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:34:40.609 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 2m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:34:40.609 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:34:40.609 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:34:40.609 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:34:40.610 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:34:40.610 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:34:40.610 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:34:40.610 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:34:40.611 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:34:40.611 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:34:40.611 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:34:40.611 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:34:40.611 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:34:40.612 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:34:40.612 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:34:40.612 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:34:40.612 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:34:40.612 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 2m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:34:40.613 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:34:40.855 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:34:40.856 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:34:40.856 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:34:40.856 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:34:40.857 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:34:40.857 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:34:40.857 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:34:40.857 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:34:40.857 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:34:40.858 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:34:40.858 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:34:40.858 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:34:40.858 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:34:40.859 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:34:40.859 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:34:40.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:40 gibba013 bash[29418]: cluster 2021-03-10T16:34:39.484712+0000 mgr.gibba020.yqfnwy (mgr.34427) 8523 : cluster [DBG] pgmap v4858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:40.877 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:40 gibba013 bash[30381]: cluster 2021-03-10T16:34:39.484712+0000 mgr.gibba020.yqfnwy (mgr.34427) 8523 : cluster [DBG] pgmap v4858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:40.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:40 gibba020 bash[25448]: cluster 2021-03-10T16:34:39.484712+0000 mgr.gibba020.yqfnwy (mgr.34427) 8523 : cluster [DBG] pgmap v4858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:41.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:41 gibba013 bash[29418]: audit 2021-03-10T16:34:40.368989+0000 mgr.gibba020.yqfnwy (mgr.34427) 8524 : audit [DBG] from='client.49776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:34:41.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:41 gibba013 bash[29418]: audit 2021-03-10T16:34:40.597177+0000 mgr.gibba020.yqfnwy (mgr.34427) 8525 : audit [DBG] from='client.49782 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:34:41.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:41 gibba013 bash[29418]: audit 2021-03-10T16:34:40.857223+0000 mon.a (mon.0) 3127 : audit [DBG] from='client.? 172.21.2.113:0/3504827764' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:41.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:41 gibba013 bash[30381]: audit 2021-03-10T16:34:40.368989+0000 mgr.gibba020.yqfnwy (mgr.34427) 8524 : audit [DBG] from='client.49776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:34:41.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:41 gibba013 bash[30381]: audit 2021-03-10T16:34:40.597177+0000 mgr.gibba020.yqfnwy (mgr.34427) 8525 : audit [DBG] from='client.49782 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:34:41.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:41 gibba013 bash[30381]: audit 2021-03-10T16:34:40.857223+0000 mon.a (mon.0) 3127 : audit [DBG] from='client.? 172.21.2.113:0/3504827764' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:41.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:41 gibba020 bash[25448]: audit 2021-03-10T16:34:40.368989+0000 mgr.gibba020.yqfnwy (mgr.34427) 8524 : audit [DBG] from='client.49776 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:34:41.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:41 gibba020 bash[25448]: audit 2021-03-10T16:34:40.597177+0000 mgr.gibba020.yqfnwy (mgr.34427) 8525 : audit [DBG] from='client.49782 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:34:41.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:41 gibba020 bash[25448]: audit 2021-03-10T16:34:40.857223+0000 mon.a (mon.0) 3127 : audit [DBG] from='client.? 172.21.2.113:0/3504827764' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:42.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:42 gibba013 bash[29418]: cluster 2021-03-10T16:34:41.485995+0000 mgr.gibba020.yqfnwy (mgr.34427) 8526 : cluster [DBG] pgmap v4859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:42.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:42 gibba013 bash[30381]: cluster 2021-03-10T16:34:41.485995+0000 mgr.gibba020.yqfnwy (mgr.34427) 8526 : cluster [DBG] pgmap v4859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:42.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:42 gibba020 bash[25448]: cluster 2021-03-10T16:34:41.485995+0000 mgr.gibba020.yqfnwy (mgr.34427) 8526 : cluster [DBG] pgmap v4859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:43.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:43 gibba013 bash[29418]: audit 2021-03-10T16:34:43.344146+0000 mon.a (mon.0) 3128 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:34:43.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:43 gibba013 bash[30381]: audit 2021-03-10T16:34:43.344146+0000 mon.a (mon.0) 3128 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:34:43.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:43 gibba020 bash[25448]: audit 2021-03-10T16:34:43.344146+0000 mon.a (mon.0) 3128 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:34:44.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[29418]: cephadm 2021-03-10T16:34:43.348664+0000 mgr.gibba020.yqfnwy (mgr.34427) 8527 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:34:44.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[29418]: cephadm 2021-03-10T16:34:43.349959+0000 mgr.gibba020.yqfnwy (mgr.34427) 8528 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:34:44.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[29418]: cluster 2021-03-10T16:34:43.486400+0000 mgr.gibba020.yqfnwy (mgr.34427) 8529 : cluster [DBG] pgmap v4860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:44.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[29418]: audit 2021-03-10T16:34:43.560471+0000 mon.a (mon.0) 3129 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:34:44.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[29418]: cephadm 2021-03-10T16:34:43.562652+0000 mgr.gibba020.yqfnwy (mgr.34427) 8530 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:34:44.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[29418]: audit 2021-03-10T16:34:43.564118+0000 mon.a (mon.0) 3130 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:34:44.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[29418]: cephadm 2021-03-10T16:34:43.565169+0000 mgr.gibba020.yqfnwy (mgr.34427) 8531 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:34:44.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[29418]: audit 2021-03-10T16:34:43.566228+0000 mon.a (mon.0) 3131 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:44.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[29418]: cephadm 2021-03-10T16:34:43.566782+0000 mgr.gibba020.yqfnwy (mgr.34427) 8532 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:34:44.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[29418]: cephadm 2021-03-10T16:34:43.566820+0000 mgr.gibba020.yqfnwy (mgr.34427) 8533 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:34:44.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[29418]: audit 2021-03-10T16:34:43.567876+0000 mon.a (mon.0) 3132 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:44.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[29418]: cephadm 2021-03-10T16:34:43.568756+0000 mgr.gibba020.yqfnwy (mgr.34427) 8534 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:34:44.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[29418]: cephadm 2021-03-10T16:34:43.568794+0000 mgr.gibba020.yqfnwy (mgr.34427) 8535 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:34:44.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[29418]: audit 2021-03-10T16:34:43.569651+0000 mon.a (mon.0) 3133 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:44.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[29418]: cephadm 2021-03-10T16:34:43.569933+0000 mgr.gibba020.yqfnwy (mgr.34427) 8536 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:34:44.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[29418]: cephadm 2021-03-10T16:34:43.571147+0000 mgr.gibba020.yqfnwy (mgr.34427) 8537 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:34:44.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[29418]: cephadm 2021-03-10T16:34:43.571183+0000 mgr.gibba020.yqfnwy (mgr.34427) 8538 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:34:44.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[29418]: audit 2021-03-10T16:34:43.572319+0000 mon.a (mon.0) 3134 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:44.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[29418]: cephadm 2021-03-10T16:34:43.573049+0000 mgr.gibba020.yqfnwy (mgr.34427) 8539 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:34:44.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[29418]: cephadm 2021-03-10T16:34:43.573366+0000 mgr.gibba020.yqfnwy (mgr.34427) 8540 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:34:44.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[30381]: cephadm 2021-03-10T16:34:43.348664+0000 mgr.gibba020.yqfnwy (mgr.34427) 8527 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:34:44.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[30381]: cephadm 2021-03-10T16:34:43.349959+0000 mgr.gibba020.yqfnwy (mgr.34427) 8528 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:34:44.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[30381]: cluster 2021-03-10T16:34:43.486400+0000 mgr.gibba020.yqfnwy (mgr.34427) 8529 : cluster [DBG] pgmap v4860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:44.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[30381]: audit 2021-03-10T16:34:43.560471+0000 mon.a (mon.0) 3129 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:34:44.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[30381]: cephadm 2021-03-10T16:34:43.562652+0000 mgr.gibba020.yqfnwy (mgr.34427) 8530 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:34:44.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[30381]: audit 2021-03-10T16:34:43.564118+0000 mon.a (mon.0) 3130 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:34:44.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[30381]: cephadm 2021-03-10T16:34:43.565169+0000 mgr.gibba020.yqfnwy (mgr.34427) 8531 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:34:44.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[30381]: audit 2021-03-10T16:34:43.566228+0000 mon.a (mon.0) 3131 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:44.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[30381]: cephadm 2021-03-10T16:34:43.566782+0000 mgr.gibba020.yqfnwy (mgr.34427) 8532 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:34:44.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[30381]: cephadm 2021-03-10T16:34:43.566820+0000 mgr.gibba020.yqfnwy (mgr.34427) 8533 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:34:44.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[30381]: audit 2021-03-10T16:34:43.567876+0000 mon.a (mon.0) 3132 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:44.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[30381]: cephadm 2021-03-10T16:34:43.568756+0000 mgr.gibba020.yqfnwy (mgr.34427) 8534 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:34:44.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[30381]: cephadm 2021-03-10T16:34:43.568794+0000 mgr.gibba020.yqfnwy (mgr.34427) 8535 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:34:44.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[30381]: audit 2021-03-10T16:34:43.569651+0000 mon.a (mon.0) 3133 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:44.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[30381]: cephadm 2021-03-10T16:34:43.569933+0000 mgr.gibba020.yqfnwy (mgr.34427) 8536 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:34:44.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[30381]: cephadm 2021-03-10T16:34:43.571147+0000 mgr.gibba020.yqfnwy (mgr.34427) 8537 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:34:44.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[30381]: cephadm 2021-03-10T16:34:43.571183+0000 mgr.gibba020.yqfnwy (mgr.34427) 8538 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:34:44.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[30381]: audit 2021-03-10T16:34:43.572319+0000 mon.a (mon.0) 3134 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:44.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[30381]: cephadm 2021-03-10T16:34:43.573049+0000 mgr.gibba020.yqfnwy (mgr.34427) 8539 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:34:44.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[30381]: cephadm 2021-03-10T16:34:43.573366+0000 mgr.gibba020.yqfnwy (mgr.34427) 8540 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:34:44.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[29418]: audit 2021-03-10T16:34:43.574124+0000 mon.a (mon.0) 3135 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:44.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[29418]: cephadm 2021-03-10T16:34:43.574850+0000 mgr.gibba020.yqfnwy (mgr.34427) 8541 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:34:44.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[29418]: cephadm 2021-03-10T16:34:43.574889+0000 mgr.gibba020.yqfnwy (mgr.34427) 8542 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:34:44.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[29418]: cephadm 2021-03-10T16:34:43.574993+0000 mgr.gibba020.yqfnwy (mgr.34427) 8543 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:34:44.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[30381]: audit 2021-03-10T16:34:43.574124+0000 mon.a (mon.0) 3135 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:44.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[30381]: cephadm 2021-03-10T16:34:43.574850+0000 mgr.gibba020.yqfnwy (mgr.34427) 8541 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:34:44.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[30381]: cephadm 2021-03-10T16:34:43.574889+0000 mgr.gibba020.yqfnwy (mgr.34427) 8542 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:34:44.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:44 gibba013 bash[30381]: cephadm 2021-03-10T16:34:43.574993+0000 mgr.gibba020.yqfnwy (mgr.34427) 8543 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:34:44.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:44 gibba020 bash[25448]: cephadm 2021-03-10T16:34:43.348664+0000 mgr.gibba020.yqfnwy (mgr.34427) 8527 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:34:44.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:44 gibba020 bash[25448]: cephadm 2021-03-10T16:34:43.349959+0000 mgr.gibba020.yqfnwy (mgr.34427) 8528 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:34:44.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:44 gibba020 bash[25448]: cluster 2021-03-10T16:34:43.486400+0000 mgr.gibba020.yqfnwy (mgr.34427) 8529 : cluster [DBG] pgmap v4860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:44.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:44 gibba020 bash[25448]: audit 2021-03-10T16:34:43.560471+0000 mon.a (mon.0) 3129 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:34:44.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:44 gibba020 bash[25448]: cephadm 2021-03-10T16:34:43.562652+0000 mgr.gibba020.yqfnwy (mgr.34427) 8530 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:34:44.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:44 gibba020 bash[25448]: audit 2021-03-10T16:34:43.564118+0000 mon.a (mon.0) 3130 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:34:44.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:44 gibba020 bash[25448]: cephadm 2021-03-10T16:34:43.565169+0000 mgr.gibba020.yqfnwy (mgr.34427) 8531 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:34:44.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:44 gibba020 bash[25448]: audit 2021-03-10T16:34:43.566228+0000 mon.a (mon.0) 3131 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:44.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:44 gibba020 bash[25448]: cephadm 2021-03-10T16:34:43.566782+0000 mgr.gibba020.yqfnwy (mgr.34427) 8532 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:34:44.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:44 gibba020 bash[25448]: cephadm 2021-03-10T16:34:43.566820+0000 mgr.gibba020.yqfnwy (mgr.34427) 8533 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:34:44.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:44 gibba020 bash[25448]: audit 2021-03-10T16:34:43.567876+0000 mon.a (mon.0) 3132 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:44.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:44 gibba020 bash[25448]: cephadm 2021-03-10T16:34:43.568756+0000 mgr.gibba020.yqfnwy (mgr.34427) 8534 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:34:44.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:44 gibba020 bash[25448]: cephadm 2021-03-10T16:34:43.568794+0000 mgr.gibba020.yqfnwy (mgr.34427) 8535 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:34:44.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:44 gibba020 bash[25448]: audit 2021-03-10T16:34:43.569651+0000 mon.a (mon.0) 3133 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:44.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:44 gibba020 bash[25448]: cephadm 2021-03-10T16:34:43.569933+0000 mgr.gibba020.yqfnwy (mgr.34427) 8536 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:34:44.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:44 gibba020 bash[25448]: cephadm 2021-03-10T16:34:43.571147+0000 mgr.gibba020.yqfnwy (mgr.34427) 8537 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:34:44.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:44 gibba020 bash[25448]: cephadm 2021-03-10T16:34:43.571183+0000 mgr.gibba020.yqfnwy (mgr.34427) 8538 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:34:44.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:44 gibba020 bash[25448]: audit 2021-03-10T16:34:43.572319+0000 mon.a (mon.0) 3134 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:44.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:44 gibba020 bash[25448]: cephadm 2021-03-10T16:34:43.573049+0000 mgr.gibba020.yqfnwy (mgr.34427) 8539 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:34:44.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:44 gibba020 bash[25448]: cephadm 2021-03-10T16:34:43.573366+0000 mgr.gibba020.yqfnwy (mgr.34427) 8540 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:34:44.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:44 gibba020 bash[25448]: audit 2021-03-10T16:34:43.574124+0000 mon.a (mon.0) 3135 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:34:44.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:44 gibba020 bash[25448]: cephadm 2021-03-10T16:34:43.574850+0000 mgr.gibba020.yqfnwy (mgr.34427) 8541 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:34:44.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:44 gibba020 bash[25448]: cephadm 2021-03-10T16:34:43.574889+0000 mgr.gibba020.yqfnwy (mgr.34427) 8542 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:34:44.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:44 gibba020 bash[25448]: cephadm 2021-03-10T16:34:43.574993+0000 mgr.gibba020.yqfnwy (mgr.34427) 8543 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:34:46.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:46 gibba013 bash[29418]: cluster 2021-03-10T16:34:45.487790+0000 mgr.gibba020.yqfnwy (mgr.34427) 8544 : cluster [DBG] pgmap v4861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:46.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:46 gibba013 bash[30381]: cluster 2021-03-10T16:34:45.487790+0000 mgr.gibba020.yqfnwy (mgr.34427) 8544 : cluster [DBG] pgmap v4861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:46.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:46 gibba020 bash[25448]: cluster 2021-03-10T16:34:45.487790+0000 mgr.gibba020.yqfnwy (mgr.34427) 8544 : cluster [DBG] pgmap v4861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:48.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:48 gibba013 bash[29418]: cluster 2021-03-10T16:34:47.489138+0000 mgr.gibba020.yqfnwy (mgr.34427) 8545 : cluster [DBG] pgmap v4862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:48.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:48 gibba013 bash[30381]: cluster 2021-03-10T16:34:47.489138+0000 mgr.gibba020.yqfnwy (mgr.34427) 8545 : cluster [DBG] pgmap v4862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:48.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:48 gibba020 bash[25448]: cluster 2021-03-10T16:34:47.489138+0000 mgr.gibba020.yqfnwy (mgr.34427) 8545 : cluster [DBG] pgmap v4862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:50.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:50 gibba013 bash[29418]: cluster 2021-03-10T16:34:49.489774+0000 mgr.gibba020.yqfnwy (mgr.34427) 8546 : cluster [DBG] pgmap v4863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:50.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:50 gibba013 bash[30381]: cluster 2021-03-10T16:34:49.489774+0000 mgr.gibba020.yqfnwy (mgr.34427) 8546 : cluster [DBG] pgmap v4863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:50.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:50 gibba020 bash[25448]: cluster 2021-03-10T16:34:49.489774+0000 mgr.gibba020.yqfnwy (mgr.34427) 8546 : cluster [DBG] pgmap v4863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:52.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:52 gibba013 bash[29418]: cluster 2021-03-10T16:34:51.491490+0000 mgr.gibba020.yqfnwy (mgr.34427) 8547 : cluster [DBG] pgmap v4864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:52.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:52 gibba013 bash[30381]: cluster 2021-03-10T16:34:51.491490+0000 mgr.gibba020.yqfnwy (mgr.34427) 8547 : cluster [DBG] pgmap v4864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:52.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:52 gibba020 bash[25448]: cluster 2021-03-10T16:34:51.491490+0000 mgr.gibba020.yqfnwy (mgr.34427) 8547 : cluster [DBG] pgmap v4864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:54.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:54 gibba013 bash[29418]: cluster 2021-03-10T16:34:53.492888+0000 mgr.gibba020.yqfnwy (mgr.34427) 8548 : cluster [DBG] pgmap v4865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:54.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:54 gibba013 bash[30381]: cluster 2021-03-10T16:34:53.492888+0000 mgr.gibba020.yqfnwy (mgr.34427) 8548 : cluster [DBG] pgmap v4865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:54.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:54 gibba020 bash[25448]: cluster 2021-03-10T16:34:53.492888+0000 mgr.gibba020.yqfnwy (mgr.34427) 8548 : cluster [DBG] pgmap v4865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:56.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:56 gibba013 bash[29418]: cluster 2021-03-10T16:34:55.494567+0000 mgr.gibba020.yqfnwy (mgr.34427) 8549 : cluster [DBG] pgmap v4866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:56.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:56 gibba013 bash[30381]: cluster 2021-03-10T16:34:55.494567+0000 mgr.gibba020.yqfnwy (mgr.34427) 8549 : cluster [DBG] pgmap v4866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:56.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:56 gibba020 bash[25448]: cluster 2021-03-10T16:34:55.494567+0000 mgr.gibba020.yqfnwy (mgr.34427) 8549 : cluster [DBG] pgmap v4866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:58.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:58 gibba013 bash[29418]: cluster 2021-03-10T16:34:57.496002+0000 mgr.gibba020.yqfnwy (mgr.34427) 8550 : cluster [DBG] pgmap v4867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:58.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:58 gibba013 bash[30381]: cluster 2021-03-10T16:34:57.496002+0000 mgr.gibba020.yqfnwy (mgr.34427) 8550 : cluster [DBG] pgmap v4867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:58.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:58 gibba020 bash[25448]: cluster 2021-03-10T16:34:57.496002+0000 mgr.gibba020.yqfnwy (mgr.34427) 8550 : cluster [DBG] pgmap v4867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:34:59.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:34:59 gibba013 bash[29418]: cephadm 2021-03-10T16:34:58.588139+0000 mgr.gibba020.yqfnwy (mgr.34427) 8551 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:34:59.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:34:59 gibba013 bash[30381]: cephadm 2021-03-10T16:34:58.588139+0000 mgr.gibba020.yqfnwy (mgr.34427) 8551 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:34:59.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:34:59 gibba020 bash[25448]: cephadm 2021-03-10T16:34:58.588139+0000 mgr.gibba020.yqfnwy (mgr.34427) 8551 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:35:00.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:00 gibba013 bash[29418]: cluster 2021-03-10T16:34:59.497242+0000 mgr.gibba020.yqfnwy (mgr.34427) 8552 : cluster [DBG] pgmap v4868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:00.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:00 gibba013 bash[30381]: cluster 2021-03-10T16:34:59.497242+0000 mgr.gibba020.yqfnwy (mgr.34427) 8552 : cluster [DBG] pgmap v4868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:00.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:00 gibba020 bash[25448]: cluster 2021-03-10T16:34:59.497242+0000 mgr.gibba020.yqfnwy (mgr.34427) 8552 : cluster [DBG] pgmap v4868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:02.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:02 gibba013 bash[29418]: cluster 2021-03-10T16:35:01.498943+0000 mgr.gibba020.yqfnwy (mgr.34427) 8553 : cluster [DBG] pgmap v4869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:02.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:02 gibba013 bash[30381]: cluster 2021-03-10T16:35:01.498943+0000 mgr.gibba020.yqfnwy (mgr.34427) 8553 : cluster [DBG] pgmap v4869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:02.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:02 gibba020 bash[25448]: cluster 2021-03-10T16:35:01.498943+0000 mgr.gibba020.yqfnwy (mgr.34427) 8553 : cluster [DBG] pgmap v4869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:04.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:04 gibba013 bash[29418]: cluster 2021-03-10T16:35:03.500417+0000 mgr.gibba020.yqfnwy (mgr.34427) 8554 : cluster [DBG] pgmap v4870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:04.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:04 gibba013 bash[30381]: cluster 2021-03-10T16:35:03.500417+0000 mgr.gibba020.yqfnwy (mgr.34427) 8554 : cluster [DBG] pgmap v4870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:04.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:04 gibba020 bash[25448]: cluster 2021-03-10T16:35:03.500417+0000 mgr.gibba020.yqfnwy (mgr.34427) 8554 : cluster [DBG] pgmap v4870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:06.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:06 gibba013 bash[29418]: cluster 2021-03-10T16:35:05.501904+0000 mgr.gibba020.yqfnwy (mgr.34427) 8555 : cluster [DBG] pgmap v4871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:06.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:06 gibba013 bash[30381]: cluster 2021-03-10T16:35:05.501904+0000 mgr.gibba020.yqfnwy (mgr.34427) 8555 : cluster [DBG] pgmap v4871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:06.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:06 gibba020 bash[25448]: cluster 2021-03-10T16:35:05.501904+0000 mgr.gibba020.yqfnwy (mgr.34427) 8555 : cluster [DBG] pgmap v4871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:07.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:07 gibba020 bash[25448]: audit 2021-03-10T16:35:06.737021+0000 mon.a (mon.0) 3136 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:35:07.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:07 gibba020 bash[25448]: audit 2021-03-10T16:35:06.897112+0000 mon.a (mon.0) 3137 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:35:07.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:07 gibba020 bash[25448]: audit 2021-03-10T16:35:07.205905+0000 mon.a (mon.0) 3138 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:35:07.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:07 gibba020 bash[25448]: audit 2021-03-10T16:35:07.206669+0000 mon.a (mon.0) 3139 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:35:07.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:07 gibba020 bash[25448]: audit 2021-03-10T16:35:07.207339+0000 mon.a (mon.0) 3140 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:35:07.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:07 gibba020 bash[25448]: audit 2021-03-10T16:35:07.208012+0000 mon.a (mon.0) 3141 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:35:08.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:07 gibba013 bash[29418]: audit 2021-03-10T16:35:06.737021+0000 mon.a (mon.0) 3136 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:35:08.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:07 gibba013 bash[29418]: audit 2021-03-10T16:35:06.897112+0000 mon.a (mon.0) 3137 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:35:08.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:07 gibba013 bash[29418]: audit 2021-03-10T16:35:07.205905+0000 mon.a (mon.0) 3138 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:35:08.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:07 gibba013 bash[29418]: audit 2021-03-10T16:35:07.206669+0000 mon.a (mon.0) 3139 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:35:08.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:07 gibba013 bash[29418]: audit 2021-03-10T16:35:07.207339+0000 mon.a (mon.0) 3140 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:35:08.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:07 gibba013 bash[29418]: audit 2021-03-10T16:35:07.208012+0000 mon.a (mon.0) 3141 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:35:08.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:07 gibba013 bash[30381]: audit 2021-03-10T16:35:06.737021+0000 mon.a (mon.0) 3136 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:35:08.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:07 gibba013 bash[30381]: audit 2021-03-10T16:35:06.897112+0000 mon.a (mon.0) 3137 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:35:08.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:07 gibba013 bash[30381]: audit 2021-03-10T16:35:07.205905+0000 mon.a (mon.0) 3138 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T16:35:08.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:07 gibba013 bash[30381]: audit 2021-03-10T16:35:07.206669+0000 mon.a (mon.0) 3139 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:35:08.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:07 gibba013 bash[30381]: audit 2021-03-10T16:35:07.207339+0000 mon.a (mon.0) 3140 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:35:08.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:07 gibba013 bash[30381]: audit 2021-03-10T16:35:07.208012+0000 mon.a (mon.0) 3141 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:35:08.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:08 gibba020 bash[25448]: cluster 2021-03-10T16:35:07.503312+0000 mgr.gibba020.yqfnwy (mgr.34427) 8556 : cluster [DBG] pgmap v4872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:09.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:08 gibba013 bash[29418]: cluster 2021-03-10T16:35:07.503312+0000 mgr.gibba020.yqfnwy (mgr.34427) 8556 : cluster [DBG] pgmap v4872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:09.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:08 gibba013 bash[30381]: cluster 2021-03-10T16:35:07.503312+0000 mgr.gibba020.yqfnwy (mgr.34427) 8556 : cluster [DBG] pgmap v4872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:10.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:10 gibba013 bash[29418]: cluster 2021-03-10T16:35:09.504838+0000 mgr.gibba020.yqfnwy (mgr.34427) 8557 : cluster [DBG] pgmap v4873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:10.877 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:10 gibba013 bash[30381]: cluster 2021-03-10T16:35:09.504838+0000 mgr.gibba020.yqfnwy (mgr.34427) 8557 : cluster [DBG] pgmap v4873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:10.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:10 gibba020 bash[25448]: cluster 2021-03-10T16:35:09.504838+0000 mgr.gibba020.yqfnwy (mgr.34427) 8557 : cluster [DBG] pgmap v4873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:11.100 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:35:11.328 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:35:11.329 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 4m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:35:11.329 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 3m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:35:11.329 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:35:11.330 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:35:11.330 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:35:11.330 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:35:11.330 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:35:11.330 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:35:11.331 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:35:11.331 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:35:11.331 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:35:11.331 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:35:11.332 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:35:11.332 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:35:11.332 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:35:11.332 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:35:11.332 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:35:11.333 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:35:11.333 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 3m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:35:11.333 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 3m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:35:11.578 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:35:11.578 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:35:11.579 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:35:11.579 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:35:11.579 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:35:11.579 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:35:11.579 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:35:11.580 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:35:11.580 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:35:11.580 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:35:11.580 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:35:11.580 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:35:11.581 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:35:11.581 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:35:11.581 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:35:12.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:12 gibba013 bash[29418]: audit 2021-03-10T16:35:11.091386+0000 mgr.gibba020.yqfnwy (mgr.34427) 8558 : audit [DBG] from='client.49794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:35:12.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:12 gibba013 bash[29418]: audit 2021-03-10T16:35:11.316779+0000 mgr.gibba020.yqfnwy (mgr.34427) 8559 : audit [DBG] from='client.49800 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:35:12.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:12 gibba013 bash[29418]: cluster 2021-03-10T16:35:11.506618+0000 mgr.gibba020.yqfnwy (mgr.34427) 8560 : cluster [DBG] pgmap v4874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:12.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:12 gibba013 bash[29418]: audit 2021-03-10T16:35:11.579850+0000 mon.a (mon.0) 3142 : audit [DBG] from='client.? 172.21.2.113:0/1785213173' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:12.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:12 gibba013 bash[30381]: audit 2021-03-10T16:35:11.091386+0000 mgr.gibba020.yqfnwy (mgr.34427) 8558 : audit [DBG] from='client.49794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:35:12.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:12 gibba013 bash[30381]: audit 2021-03-10T16:35:11.316779+0000 mgr.gibba020.yqfnwy (mgr.34427) 8559 : audit [DBG] from='client.49800 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:35:12.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:12 gibba013 bash[30381]: cluster 2021-03-10T16:35:11.506618+0000 mgr.gibba020.yqfnwy (mgr.34427) 8560 : cluster [DBG] pgmap v4874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:12.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:12 gibba013 bash[30381]: audit 2021-03-10T16:35:11.579850+0000 mon.a (mon.0) 3142 : audit [DBG] from='client.? 172.21.2.113:0/1785213173' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:12.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:12 gibba020 bash[25448]: audit 2021-03-10T16:35:11.091386+0000 mgr.gibba020.yqfnwy (mgr.34427) 8558 : audit [DBG] from='client.49794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:35:12.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:12 gibba020 bash[25448]: audit 2021-03-10T16:35:11.316779+0000 mgr.gibba020.yqfnwy (mgr.34427) 8559 : audit [DBG] from='client.49800 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:35:12.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:12 gibba020 bash[25448]: cluster 2021-03-10T16:35:11.506618+0000 mgr.gibba020.yqfnwy (mgr.34427) 8560 : cluster [DBG] pgmap v4874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:12.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:12 gibba020 bash[25448]: audit 2021-03-10T16:35:11.579850+0000 mon.a (mon.0) 3142 : audit [DBG] from='client.? 172.21.2.113:0/1785213173' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:14.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:14 gibba013 bash[29418]: cluster 2021-03-10T16:35:13.507985+0000 mgr.gibba020.yqfnwy (mgr.34427) 8561 : cluster [DBG] pgmap v4875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:14.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:14 gibba013 bash[29418]: cephadm 2021-03-10T16:35:13.595699+0000 mgr.gibba020.yqfnwy (mgr.34427) 8562 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:35:14.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:14 gibba013 bash[30381]: cluster 2021-03-10T16:35:13.507985+0000 mgr.gibba020.yqfnwy (mgr.34427) 8561 : cluster [DBG] pgmap v4875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:14.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:14 gibba013 bash[30381]: cephadm 2021-03-10T16:35:13.595699+0000 mgr.gibba020.yqfnwy (mgr.34427) 8562 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:35:14.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:14 gibba020 bash[25448]: cluster 2021-03-10T16:35:13.507985+0000 mgr.gibba020.yqfnwy (mgr.34427) 8561 : cluster [DBG] pgmap v4875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:14.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:14 gibba020 bash[25448]: cephadm 2021-03-10T16:35:13.595699+0000 mgr.gibba020.yqfnwy (mgr.34427) 8562 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:35:16.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:16 gibba013 bash[29418]: cluster 2021-03-10T16:35:15.509478+0000 mgr.gibba020.yqfnwy (mgr.34427) 8563 : cluster [DBG] pgmap v4876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:16.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:16 gibba013 bash[30381]: cluster 2021-03-10T16:35:15.509478+0000 mgr.gibba020.yqfnwy (mgr.34427) 8563 : cluster [DBG] pgmap v4876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:16.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:16 gibba020 bash[25448]: cluster 2021-03-10T16:35:15.509478+0000 mgr.gibba020.yqfnwy (mgr.34427) 8563 : cluster [DBG] pgmap v4876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:18.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:18 gibba013 bash[29418]: cluster 2021-03-10T16:35:17.510972+0000 mgr.gibba020.yqfnwy (mgr.34427) 8564 : cluster [DBG] pgmap v4877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:18.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:18 gibba013 bash[30381]: cluster 2021-03-10T16:35:17.510972+0000 mgr.gibba020.yqfnwy (mgr.34427) 8564 : cluster [DBG] pgmap v4877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:18.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:18 gibba020 bash[25448]: cluster 2021-03-10T16:35:17.510972+0000 mgr.gibba020.yqfnwy (mgr.34427) 8564 : cluster [DBG] pgmap v4877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:20.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:20 gibba013 bash[29418]: cluster 2021-03-10T16:35:19.512391+0000 mgr.gibba020.yqfnwy (mgr.34427) 8565 : cluster [DBG] pgmap v4878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:20.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:20 gibba013 bash[30381]: cluster 2021-03-10T16:35:19.512391+0000 mgr.gibba020.yqfnwy (mgr.34427) 8565 : cluster [DBG] pgmap v4878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:20.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:20 gibba020 bash[25448]: cluster 2021-03-10T16:35:19.512391+0000 mgr.gibba020.yqfnwy (mgr.34427) 8565 : cluster [DBG] pgmap v4878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:22.877 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:22 gibba013 bash[30381]: cluster 2021-03-10T16:35:21.514252+0000 mgr.gibba020.yqfnwy (mgr.34427) 8566 : cluster [DBG] pgmap v4879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:22.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:22 gibba013 bash[29418]: cluster 2021-03-10T16:35:21.514252+0000 mgr.gibba020.yqfnwy (mgr.34427) 8566 : cluster [DBG] pgmap v4879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:22.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:22 gibba020 bash[25448]: cluster 2021-03-10T16:35:21.514252+0000 mgr.gibba020.yqfnwy (mgr.34427) 8566 : cluster [DBG] pgmap v4879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:24.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:24 gibba013 bash[29418]: cluster 2021-03-10T16:35:23.515777+0000 mgr.gibba020.yqfnwy (mgr.34427) 8567 : cluster [DBG] pgmap v4880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:24.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:24 gibba013 bash[30381]: cluster 2021-03-10T16:35:23.515777+0000 mgr.gibba020.yqfnwy (mgr.34427) 8567 : cluster [DBG] pgmap v4880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:24.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:24 gibba020 bash[25448]: cluster 2021-03-10T16:35:23.515777+0000 mgr.gibba020.yqfnwy (mgr.34427) 8567 : cluster [DBG] pgmap v4880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:26.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:26 gibba013 bash[29418]: cluster 2021-03-10T16:35:25.517543+0000 mgr.gibba020.yqfnwy (mgr.34427) 8568 : cluster [DBG] pgmap v4881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:26.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:26 gibba013 bash[30381]: cluster 2021-03-10T16:35:25.517543+0000 mgr.gibba020.yqfnwy (mgr.34427) 8568 : cluster [DBG] pgmap v4881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:26.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:26 gibba020 bash[25448]: cluster 2021-03-10T16:35:25.517543+0000 mgr.gibba020.yqfnwy (mgr.34427) 8568 : cluster [DBG] pgmap v4881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:28.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:28 gibba013 bash[29418]: cluster 2021-03-10T16:35:27.519137+0000 mgr.gibba020.yqfnwy (mgr.34427) 8569 : cluster [DBG] pgmap v4882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:28.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:28 gibba013 bash[30381]: cluster 2021-03-10T16:35:27.519137+0000 mgr.gibba020.yqfnwy (mgr.34427) 8569 : cluster [DBG] pgmap v4882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:28.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:28 gibba020 bash[25448]: cluster 2021-03-10T16:35:27.519137+0000 mgr.gibba020.yqfnwy (mgr.34427) 8569 : cluster [DBG] pgmap v4882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:29.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:29 gibba013 bash[29418]: cephadm 2021-03-10T16:35:28.608163+0000 mgr.gibba020.yqfnwy (mgr.34427) 8570 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:35:29.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:29 gibba013 bash[30381]: cephadm 2021-03-10T16:35:28.608163+0000 mgr.gibba020.yqfnwy (mgr.34427) 8570 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:35:29.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:29 gibba020 bash[25448]: cephadm 2021-03-10T16:35:28.608163+0000 mgr.gibba020.yqfnwy (mgr.34427) 8570 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:35:30.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:30 gibba013 bash[29418]: cluster 2021-03-10T16:35:29.519958+0000 mgr.gibba020.yqfnwy (mgr.34427) 8571 : cluster [DBG] pgmap v4883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:30.877 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:30 gibba013 bash[30381]: cluster 2021-03-10T16:35:29.519958+0000 mgr.gibba020.yqfnwy (mgr.34427) 8571 : cluster [DBG] pgmap v4883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:30.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:30 gibba020 bash[25448]: cluster 2021-03-10T16:35:29.519958+0000 mgr.gibba020.yqfnwy (mgr.34427) 8571 : cluster [DBG] pgmap v4883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:32.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:32 gibba013 bash[29418]: cluster 2021-03-10T16:35:31.521700+0000 mgr.gibba020.yqfnwy (mgr.34427) 8572 : cluster [DBG] pgmap v4884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:32.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:32 gibba013 bash[30381]: cluster 2021-03-10T16:35:31.521700+0000 mgr.gibba020.yqfnwy (mgr.34427) 8572 : cluster [DBG] pgmap v4884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:32.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:32 gibba020 bash[25448]: cluster 2021-03-10T16:35:31.521700+0000 mgr.gibba020.yqfnwy (mgr.34427) 8572 : cluster [DBG] pgmap v4884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:34.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:34 gibba020 bash[25448]: cluster 2021-03-10T16:35:33.523048+0000 mgr.gibba020.yqfnwy (mgr.34427) 8573 : cluster [DBG] pgmap v4885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:35.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:34 gibba013 bash[29418]: cluster 2021-03-10T16:35:33.523048+0000 mgr.gibba020.yqfnwy (mgr.34427) 8573 : cluster [DBG] pgmap v4885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:35.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:34 gibba013 bash[30381]: cluster 2021-03-10T16:35:33.523048+0000 mgr.gibba020.yqfnwy (mgr.34427) 8573 : cluster [DBG] pgmap v4885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:36.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:36 gibba020 bash[25448]: cluster 2021-03-10T16:35:35.524544+0000 mgr.gibba020.yqfnwy (mgr.34427) 8574 : cluster [DBG] pgmap v4886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:37.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:36 gibba013 bash[29418]: cluster 2021-03-10T16:35:35.524544+0000 mgr.gibba020.yqfnwy (mgr.34427) 8574 : cluster [DBG] pgmap v4886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:37.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:36 gibba013 bash[30381]: cluster 2021-03-10T16:35:35.524544+0000 mgr.gibba020.yqfnwy (mgr.34427) 8574 : cluster [DBG] pgmap v4886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:38.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:38 gibba020 bash[25448]: cluster 2021-03-10T16:35:37.525843+0000 mgr.gibba020.yqfnwy (mgr.34427) 8575 : cluster [DBG] pgmap v4887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:39.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:38 gibba013 bash[29418]: cluster 2021-03-10T16:35:37.525843+0000 mgr.gibba020.yqfnwy (mgr.34427) 8575 : cluster [DBG] pgmap v4887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:39.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:38 gibba013 bash[30381]: cluster 2021-03-10T16:35:37.525843+0000 mgr.gibba020.yqfnwy (mgr.34427) 8575 : cluster [DBG] pgmap v4887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:40.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:40 gibba013 bash[29418]: cluster 2021-03-10T16:35:39.527174+0000 mgr.gibba020.yqfnwy (mgr.34427) 8576 : cluster [DBG] pgmap v4888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:40.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:40 gibba013 bash[30381]: cluster 2021-03-10T16:35:39.527174+0000 mgr.gibba020.yqfnwy (mgr.34427) 8576 : cluster [DBG] pgmap v4888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:40.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:40 gibba020 bash[25448]: cluster 2021-03-10T16:35:39.527174+0000 mgr.gibba020.yqfnwy (mgr.34427) 8576 : cluster [DBG] pgmap v4888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:41.828 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:35:42.057 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:35:42.057 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 5m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:35:42.058 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 3m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:35:42.058 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:35:42.058 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:35:42.058 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:35:42.059 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:35:42.059 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:35:42.059 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:35:42.059 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:35:42.060 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:35:42.060 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:35:42.060 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:35:42.060 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:35:42.060 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:35:42.061 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:35:42.061 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:35:42.061 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:35:42.061 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:35:42.062 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 3m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:35:42.062 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 3m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:35:42.307 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:35:42.307 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:35:42.308 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:35:42.308 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:35:42.308 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:35:42.308 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:35:42.309 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:35:42.309 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:35:42.309 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:35:42.309 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:35:42.310 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:35:42.310 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:35:42.310 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:35:42.310 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:35:42.310 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:35:42.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:42 gibba013 bash[29418]: cluster 2021-03-10T16:35:41.528838+0000 mgr.gibba020.yqfnwy (mgr.34427) 8577 : cluster [DBG] pgmap v4889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:42.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:42 gibba013 bash[29418]: audit 2021-03-10T16:35:41.820210+0000 mgr.gibba020.yqfnwy (mgr.34427) 8578 : audit [DBG] from='client.59794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:35:42.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:42 gibba013 bash[29418]: audit 2021-03-10T16:35:42.308676+0000 mon.a (mon.0) 3143 : audit [DBG] from='client.? 172.21.2.113:0/110770628' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:42.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:42 gibba013 bash[30381]: cluster 2021-03-10T16:35:41.528838+0000 mgr.gibba020.yqfnwy (mgr.34427) 8577 : cluster [DBG] pgmap v4889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:42.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:42 gibba013 bash[30381]: audit 2021-03-10T16:35:41.820210+0000 mgr.gibba020.yqfnwy (mgr.34427) 8578 : audit [DBG] from='client.59794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:35:42.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:42 gibba013 bash[30381]: audit 2021-03-10T16:35:42.308676+0000 mon.a (mon.0) 3143 : audit [DBG] from='client.? 172.21.2.113:0/110770628' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:42.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:42 gibba020 bash[25448]: cluster 2021-03-10T16:35:41.528838+0000 mgr.gibba020.yqfnwy (mgr.34427) 8577 : cluster [DBG] pgmap v4889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:42.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:42 gibba020 bash[25448]: audit 2021-03-10T16:35:41.820210+0000 mgr.gibba020.yqfnwy (mgr.34427) 8578 : audit [DBG] from='client.59794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:35:42.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:42 gibba020 bash[25448]: audit 2021-03-10T16:35:42.308676+0000 mon.a (mon.0) 3143 : audit [DBG] from='client.? 172.21.2.113:0/110770628' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:43.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:43 gibba013 bash[29418]: audit 2021-03-10T16:35:42.045618+0000 mgr.gibba020.yqfnwy (mgr.34427) 8579 : audit [DBG] from='client.49818 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:35:43.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:43 gibba013 bash[30381]: audit 2021-03-10T16:35:42.045618+0000 mgr.gibba020.yqfnwy (mgr.34427) 8579 : audit [DBG] from='client.49818 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:35:43.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:43 gibba020 bash[25448]: audit 2021-03-10T16:35:42.045618+0000 mgr.gibba020.yqfnwy (mgr.34427) 8579 : audit [DBG] from='client.49818 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:35:44.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[29418]: cluster 2021-03-10T16:35:43.530268+0000 mgr.gibba020.yqfnwy (mgr.34427) 8580 : cluster [DBG] pgmap v4890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:44.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[29418]: audit 2021-03-10T16:35:43.621210+0000 mon.a (mon.0) 3144 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:35:44.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[29418]: cephadm 2021-03-10T16:35:43.622403+0000 mgr.gibba020.yqfnwy (mgr.34427) 8581 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:35:44.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[29418]: cephadm 2021-03-10T16:35:43.622766+0000 mgr.gibba020.yqfnwy (mgr.34427) 8582 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:35:44.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[29418]: audit 2021-03-10T16:35:43.812175+0000 mon.a (mon.0) 3145 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:35:44.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[29418]: cephadm 2021-03-10T16:35:43.814233+0000 mgr.gibba020.yqfnwy (mgr.34427) 8583 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:35:44.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[29418]: audit 2021-03-10T16:35:43.815533+0000 mon.a (mon.0) 3146 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:35:44.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[29418]: cephadm 2021-03-10T16:35:43.816017+0000 mgr.gibba020.yqfnwy (mgr.34427) 8584 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:35:44.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[29418]: audit 2021-03-10T16:35:43.816994+0000 mon.a (mon.0) 3147 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:44.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[29418]: cephadm 2021-03-10T16:35:43.817226+0000 mgr.gibba020.yqfnwy (mgr.34427) 8585 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:35:44.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[29418]: cephadm 2021-03-10T16:35:43.817289+0000 mgr.gibba020.yqfnwy (mgr.34427) 8586 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:35:44.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[29418]: audit 2021-03-10T16:35:43.818283+0000 mon.a (mon.0) 3148 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:44.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[29418]: cephadm 2021-03-10T16:35:43.818665+0000 mgr.gibba020.yqfnwy (mgr.34427) 8587 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:35:44.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[29418]: cephadm 2021-03-10T16:35:43.818755+0000 mgr.gibba020.yqfnwy (mgr.34427) 8588 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:35:44.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[29418]: audit 2021-03-10T16:35:43.819607+0000 mon.a (mon.0) 3149 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:44.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[29418]: cephadm 2021-03-10T16:35:43.820065+0000 mgr.gibba020.yqfnwy (mgr.34427) 8589 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:35:44.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[29418]: cephadm 2021-03-10T16:35:43.821430+0000 mgr.gibba020.yqfnwy (mgr.34427) 8590 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:35:44.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[29418]: cephadm 2021-03-10T16:35:43.821487+0000 mgr.gibba020.yqfnwy (mgr.34427) 8591 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:35:44.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[29418]: audit 2021-03-10T16:35:43.822507+0000 mon.a (mon.0) 3150 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:44.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[29418]: cephadm 2021-03-10T16:35:43.822887+0000 mgr.gibba020.yqfnwy (mgr.34427) 8592 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:35:44.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[30381]: cluster 2021-03-10T16:35:43.530268+0000 mgr.gibba020.yqfnwy (mgr.34427) 8580 : cluster [DBG] pgmap v4890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:44.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[30381]: audit 2021-03-10T16:35:43.621210+0000 mon.a (mon.0) 3144 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:35:44.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[30381]: cephadm 2021-03-10T16:35:43.622403+0000 mgr.gibba020.yqfnwy (mgr.34427) 8581 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:35:44.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[30381]: cephadm 2021-03-10T16:35:43.622766+0000 mgr.gibba020.yqfnwy (mgr.34427) 8582 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:35:44.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[30381]: audit 2021-03-10T16:35:43.812175+0000 mon.a (mon.0) 3145 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:35:44.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[30381]: cephadm 2021-03-10T16:35:43.814233+0000 mgr.gibba020.yqfnwy (mgr.34427) 8583 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:35:44.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[30381]: audit 2021-03-10T16:35:43.815533+0000 mon.a (mon.0) 3146 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:35:44.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[30381]: cephadm 2021-03-10T16:35:43.816017+0000 mgr.gibba020.yqfnwy (mgr.34427) 8584 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:35:44.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[30381]: audit 2021-03-10T16:35:43.816994+0000 mon.a (mon.0) 3147 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:44.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[30381]: cephadm 2021-03-10T16:35:43.817226+0000 mgr.gibba020.yqfnwy (mgr.34427) 8585 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:35:44.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[30381]: cephadm 2021-03-10T16:35:43.817289+0000 mgr.gibba020.yqfnwy (mgr.34427) 8586 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:35:44.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[30381]: audit 2021-03-10T16:35:43.818283+0000 mon.a (mon.0) 3148 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:44.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[30381]: cephadm 2021-03-10T16:35:43.818665+0000 mgr.gibba020.yqfnwy (mgr.34427) 8587 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:35:44.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[30381]: cephadm 2021-03-10T16:35:43.818755+0000 mgr.gibba020.yqfnwy (mgr.34427) 8588 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:35:44.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[30381]: audit 2021-03-10T16:35:43.819607+0000 mon.a (mon.0) 3149 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:44.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[30381]: cephadm 2021-03-10T16:35:43.820065+0000 mgr.gibba020.yqfnwy (mgr.34427) 8589 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:35:44.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[30381]: cephadm 2021-03-10T16:35:43.821430+0000 mgr.gibba020.yqfnwy (mgr.34427) 8590 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:35:44.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[30381]: cephadm 2021-03-10T16:35:43.821487+0000 mgr.gibba020.yqfnwy (mgr.34427) 8591 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:35:44.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[30381]: audit 2021-03-10T16:35:43.822507+0000 mon.a (mon.0) 3150 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:44.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[30381]: cephadm 2021-03-10T16:35:43.822887+0000 mgr.gibba020.yqfnwy (mgr.34427) 8592 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:35:44.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[29418]: cephadm 2021-03-10T16:35:43.823224+0000 mgr.gibba020.yqfnwy (mgr.34427) 8593 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:35:44.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[29418]: audit 2021-03-10T16:35:43.824108+0000 mon.a (mon.0) 3151 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:44.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[29418]: cephadm 2021-03-10T16:35:43.824491+0000 mgr.gibba020.yqfnwy (mgr.34427) 8594 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:35:44.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[29418]: cephadm 2021-03-10T16:35:43.824551+0000 mgr.gibba020.yqfnwy (mgr.34427) 8595 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:35:44.889 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[29418]: cephadm 2021-03-10T16:35:43.824674+0000 mgr.gibba020.yqfnwy (mgr.34427) 8596 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:35:44.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[30381]: cephadm 2021-03-10T16:35:43.823224+0000 mgr.gibba020.yqfnwy (mgr.34427) 8593 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:35:44.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[30381]: audit 2021-03-10T16:35:43.824108+0000 mon.a (mon.0) 3151 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:44.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[30381]: cephadm 2021-03-10T16:35:43.824491+0000 mgr.gibba020.yqfnwy (mgr.34427) 8594 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:35:44.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[30381]: cephadm 2021-03-10T16:35:43.824551+0000 mgr.gibba020.yqfnwy (mgr.34427) 8595 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:35:44.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:44 gibba013 bash[30381]: cephadm 2021-03-10T16:35:43.824674+0000 mgr.gibba020.yqfnwy (mgr.34427) 8596 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:35:44.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:44 gibba020 bash[25448]: cluster 2021-03-10T16:35:43.530268+0000 mgr.gibba020.yqfnwy (mgr.34427) 8580 : cluster [DBG] pgmap v4890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:44.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:44 gibba020 bash[25448]: audit 2021-03-10T16:35:43.621210+0000 mon.a (mon.0) 3144 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:35:44.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:44 gibba020 bash[25448]: cephadm 2021-03-10T16:35:43.622403+0000 mgr.gibba020.yqfnwy (mgr.34427) 8581 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:35:44.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:44 gibba020 bash[25448]: cephadm 2021-03-10T16:35:43.622766+0000 mgr.gibba020.yqfnwy (mgr.34427) 8582 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:35:44.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:44 gibba020 bash[25448]: audit 2021-03-10T16:35:43.812175+0000 mon.a (mon.0) 3145 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:35:44.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:44 gibba020 bash[25448]: cephadm 2021-03-10T16:35:43.814233+0000 mgr.gibba020.yqfnwy (mgr.34427) 8583 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:35:44.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:44 gibba020 bash[25448]: audit 2021-03-10T16:35:43.815533+0000 mon.a (mon.0) 3146 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:35:44.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:44 gibba020 bash[25448]: cephadm 2021-03-10T16:35:43.816017+0000 mgr.gibba020.yqfnwy (mgr.34427) 8584 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:35:44.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:44 gibba020 bash[25448]: audit 2021-03-10T16:35:43.816994+0000 mon.a (mon.0) 3147 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:44.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:44 gibba020 bash[25448]: cephadm 2021-03-10T16:35:43.817226+0000 mgr.gibba020.yqfnwy (mgr.34427) 8585 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:35:44.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:44 gibba020 bash[25448]: cephadm 2021-03-10T16:35:43.817289+0000 mgr.gibba020.yqfnwy (mgr.34427) 8586 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:35:44.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:44 gibba020 bash[25448]: audit 2021-03-10T16:35:43.818283+0000 mon.a (mon.0) 3148 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:44.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:44 gibba020 bash[25448]: cephadm 2021-03-10T16:35:43.818665+0000 mgr.gibba020.yqfnwy (mgr.34427) 8587 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:35:44.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:44 gibba020 bash[25448]: cephadm 2021-03-10T16:35:43.818755+0000 mgr.gibba020.yqfnwy (mgr.34427) 8588 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:35:44.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:44 gibba020 bash[25448]: audit 2021-03-10T16:35:43.819607+0000 mon.a (mon.0) 3149 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:44.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:44 gibba020 bash[25448]: cephadm 2021-03-10T16:35:43.820065+0000 mgr.gibba020.yqfnwy (mgr.34427) 8589 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:35:44.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:44 gibba020 bash[25448]: cephadm 2021-03-10T16:35:43.821430+0000 mgr.gibba020.yqfnwy (mgr.34427) 8590 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:35:44.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:44 gibba020 bash[25448]: cephadm 2021-03-10T16:35:43.821487+0000 mgr.gibba020.yqfnwy (mgr.34427) 8591 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:35:44.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:44 gibba020 bash[25448]: audit 2021-03-10T16:35:43.822507+0000 mon.a (mon.0) 3150 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:44.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:44 gibba020 bash[25448]: cephadm 2021-03-10T16:35:43.822887+0000 mgr.gibba020.yqfnwy (mgr.34427) 8592 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:35:44.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:44 gibba020 bash[25448]: cephadm 2021-03-10T16:35:43.823224+0000 mgr.gibba020.yqfnwy (mgr.34427) 8593 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:35:44.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:44 gibba020 bash[25448]: audit 2021-03-10T16:35:43.824108+0000 mon.a (mon.0) 3151 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:35:44.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:44 gibba020 bash[25448]: cephadm 2021-03-10T16:35:43.824491+0000 mgr.gibba020.yqfnwy (mgr.34427) 8594 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:35:44.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:44 gibba020 bash[25448]: cephadm 2021-03-10T16:35:43.824551+0000 mgr.gibba020.yqfnwy (mgr.34427) 8595 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:35:44.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:44 gibba020 bash[25448]: cephadm 2021-03-10T16:35:43.824674+0000 mgr.gibba020.yqfnwy (mgr.34427) 8596 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:35:46.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:46 gibba013 bash[29418]: cluster 2021-03-10T16:35:45.531892+0000 mgr.gibba020.yqfnwy (mgr.34427) 8597 : cluster [DBG] pgmap v4891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:46.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:46 gibba013 bash[30381]: cluster 2021-03-10T16:35:45.531892+0000 mgr.gibba020.yqfnwy (mgr.34427) 8597 : cluster [DBG] pgmap v4891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:46.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:46 gibba020 bash[25448]: cluster 2021-03-10T16:35:45.531892+0000 mgr.gibba020.yqfnwy (mgr.34427) 8597 : cluster [DBG] pgmap v4891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:48.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:48 gibba013 bash[29418]: cluster 2021-03-10T16:35:47.533299+0000 mgr.gibba020.yqfnwy (mgr.34427) 8598 : cluster [DBG] pgmap v4892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:48.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:48 gibba013 bash[30381]: cluster 2021-03-10T16:35:47.533299+0000 mgr.gibba020.yqfnwy (mgr.34427) 8598 : cluster [DBG] pgmap v4892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:48.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:48 gibba020 bash[25448]: cluster 2021-03-10T16:35:47.533299+0000 mgr.gibba020.yqfnwy (mgr.34427) 8598 : cluster [DBG] pgmap v4892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:50.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:50 gibba013 bash[29418]: cluster 2021-03-10T16:35:49.534215+0000 mgr.gibba020.yqfnwy (mgr.34427) 8599 : cluster [DBG] pgmap v4893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:50.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:50 gibba013 bash[30381]: cluster 2021-03-10T16:35:49.534215+0000 mgr.gibba020.yqfnwy (mgr.34427) 8599 : cluster [DBG] pgmap v4893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:50.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:50 gibba020 bash[25448]: cluster 2021-03-10T16:35:49.534215+0000 mgr.gibba020.yqfnwy (mgr.34427) 8599 : cluster [DBG] pgmap v4893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:52.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:52 gibba013 bash[29418]: cluster 2021-03-10T16:35:51.536047+0000 mgr.gibba020.yqfnwy (mgr.34427) 8600 : cluster [DBG] pgmap v4894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:52.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:52 gibba013 bash[30381]: cluster 2021-03-10T16:35:51.536047+0000 mgr.gibba020.yqfnwy (mgr.34427) 8600 : cluster [DBG] pgmap v4894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:52.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:52 gibba020 bash[25448]: cluster 2021-03-10T16:35:51.536047+0000 mgr.gibba020.yqfnwy (mgr.34427) 8600 : cluster [DBG] pgmap v4894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:54.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:54 gibba013 bash[29418]: cluster 2021-03-10T16:35:53.537594+0000 mgr.gibba020.yqfnwy (mgr.34427) 8601 : cluster [DBG] pgmap v4895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:54.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:54 gibba013 bash[30381]: cluster 2021-03-10T16:35:53.537594+0000 mgr.gibba020.yqfnwy (mgr.34427) 8601 : cluster [DBG] pgmap v4895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:54.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:54 gibba020 bash[25448]: cluster 2021-03-10T16:35:53.537594+0000 mgr.gibba020.yqfnwy (mgr.34427) 8601 : cluster [DBG] pgmap v4895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:56.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:56 gibba013 bash[29418]: cluster 2021-03-10T16:35:55.539386+0000 mgr.gibba020.yqfnwy (mgr.34427) 8602 : cluster [DBG] pgmap v4896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:56.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:56 gibba013 bash[30381]: cluster 2021-03-10T16:35:55.539386+0000 mgr.gibba020.yqfnwy (mgr.34427) 8602 : cluster [DBG] pgmap v4896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:56.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:56 gibba020 bash[25448]: cluster 2021-03-10T16:35:55.539386+0000 mgr.gibba020.yqfnwy (mgr.34427) 8602 : cluster [DBG] pgmap v4896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:58.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:58 gibba013 bash[29418]: cluster 2021-03-10T16:35:57.540991+0000 mgr.gibba020.yqfnwy (mgr.34427) 8603 : cluster [DBG] pgmap v4897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:58.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:58 gibba013 bash[30381]: cluster 2021-03-10T16:35:57.540991+0000 mgr.gibba020.yqfnwy (mgr.34427) 8603 : cluster [DBG] pgmap v4897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:58.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:58 gibba020 bash[25448]: cluster 2021-03-10T16:35:57.540991+0000 mgr.gibba020.yqfnwy (mgr.34427) 8603 : cluster [DBG] pgmap v4897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:35:59.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:35:59 gibba020 bash[25448]: cephadm 2021-03-10T16:35:58.828954+0000 mgr.gibba020.yqfnwy (mgr.34427) 8604 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:36:00.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:35:59 gibba013 bash[29418]: cephadm 2021-03-10T16:35:58.828954+0000 mgr.gibba020.yqfnwy (mgr.34427) 8604 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:36:00.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:35:59 gibba013 bash[30381]: cephadm 2021-03-10T16:35:58.828954+0000 mgr.gibba020.yqfnwy (mgr.34427) 8604 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:36:00.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:00 gibba020 bash[25448]: cluster 2021-03-10T16:35:59.542320+0000 mgr.gibba020.yqfnwy (mgr.34427) 8605 : cluster [DBG] pgmap v4898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:01.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:00 gibba013 bash[29418]: cluster 2021-03-10T16:35:59.542320+0000 mgr.gibba020.yqfnwy (mgr.34427) 8605 : cluster [DBG] pgmap v4898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:01.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:00 gibba013 bash[30381]: cluster 2021-03-10T16:35:59.542320+0000 mgr.gibba020.yqfnwy (mgr.34427) 8605 : cluster [DBG] pgmap v4898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:02.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:02 gibba020 bash[25448]: cluster 2021-03-10T16:36:01.543990+0000 mgr.gibba020.yqfnwy (mgr.34427) 8606 : cluster [DBG] pgmap v4899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:03.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:02 gibba013 bash[29418]: cluster 2021-03-10T16:36:01.543990+0000 mgr.gibba020.yqfnwy (mgr.34427) 8606 : cluster [DBG] pgmap v4899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:03.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:02 gibba013 bash[30381]: cluster 2021-03-10T16:36:01.543990+0000 mgr.gibba020.yqfnwy (mgr.34427) 8606 : cluster [DBG] pgmap v4899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:04.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:04 gibba020 bash[25448]: cluster 2021-03-10T16:36:03.545565+0000 mgr.gibba020.yqfnwy (mgr.34427) 8607 : cluster [DBG] pgmap v4900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:05.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:04 gibba013 bash[29418]: cluster 2021-03-10T16:36:03.545565+0000 mgr.gibba020.yqfnwy (mgr.34427) 8607 : cluster [DBG] pgmap v4900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:05.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:04 gibba013 bash[30381]: cluster 2021-03-10T16:36:03.545565+0000 mgr.gibba020.yqfnwy (mgr.34427) 8607 : cluster [DBG] pgmap v4900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:06.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:06 gibba020 bash[25448]: cluster 2021-03-10T16:36:05.547175+0000 mgr.gibba020.yqfnwy (mgr.34427) 8608 : cluster [DBG] pgmap v4901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:07.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:06 gibba013 bash[29418]: cluster 2021-03-10T16:36:05.547175+0000 mgr.gibba020.yqfnwy (mgr.34427) 8608 : cluster [DBG] pgmap v4901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:07.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:06 gibba013 bash[30381]: cluster 2021-03-10T16:36:05.547175+0000 mgr.gibba020.yqfnwy (mgr.34427) 8608 : cluster [DBG] pgmap v4901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:07.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:07 gibba020 bash[25448]: audit 2021-03-10T16:36:06.741730+0000 mon.a (mon.0) 3152 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:36:07.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:07 gibba020 bash[25448]: audit 2021-03-10T16:36:06.903587+0000 mon.a (mon.0) 3153 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:36:07.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:07 gibba020 bash[25448]: audit 2021-03-10T16:36:07.218141+0000 mon.a (mon.0) 3154 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T16:36:07.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:07 gibba020 bash[25448]: audit 2021-03-10T16:36:07.218954+0000 mon.a (mon.0) 3155 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:36:07.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:07 gibba020 bash[25448]: audit 2021-03-10T16:36:07.219667+0000 mon.a (mon.0) 3156 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:36:07.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:07 gibba020 bash[25448]: audit 2021-03-10T16:36:07.220387+0000 mon.a (mon.0) 3157 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:36:08.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:07 gibba013 bash[29418]: audit 2021-03-10T16:36:06.741730+0000 mon.a (mon.0) 3152 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:36:08.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:07 gibba013 bash[29418]: audit 2021-03-10T16:36:06.903587+0000 mon.a (mon.0) 3153 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:36:08.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:07 gibba013 bash[29418]: audit 2021-03-10T16:36:07.218141+0000 mon.a (mon.0) 3154 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T16:36:08.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:07 gibba013 bash[29418]: audit 2021-03-10T16:36:07.218954+0000 mon.a (mon.0) 3155 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:36:08.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:07 gibba013 bash[29418]: audit 2021-03-10T16:36:07.219667+0000 mon.a (mon.0) 3156 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:36:08.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:07 gibba013 bash[29418]: audit 2021-03-10T16:36:07.220387+0000 mon.a (mon.0) 3157 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:36:08.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:07 gibba013 bash[30381]: audit 2021-03-10T16:36:06.741730+0000 mon.a (mon.0) 3152 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:36:08.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:07 gibba013 bash[30381]: audit 2021-03-10T16:36:06.903587+0000 mon.a (mon.0) 3153 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:36:08.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:07 gibba013 bash[30381]: audit 2021-03-10T16:36:07.218141+0000 mon.a (mon.0) 3154 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T16:36:08.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:07 gibba013 bash[30381]: audit 2021-03-10T16:36:07.218954+0000 mon.a (mon.0) 3155 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:36:08.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:07 gibba013 bash[30381]: audit 2021-03-10T16:36:07.219667+0000 mon.a (mon.0) 3156 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:36:08.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:07 gibba013 bash[30381]: audit 2021-03-10T16:36:07.220387+0000 mon.a (mon.0) 3157 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:36:08.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:08 gibba020 bash[25448]: cluster 2021-03-10T16:36:07.548625+0000 mgr.gibba020.yqfnwy (mgr.34427) 8609 : cluster [DBG] pgmap v4902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:09.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:08 gibba013 bash[29418]: cluster 2021-03-10T16:36:07.548625+0000 mgr.gibba020.yqfnwy (mgr.34427) 8609 : cluster [DBG] pgmap v4902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:09.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:08 gibba013 bash[30381]: cluster 2021-03-10T16:36:07.548625+0000 mgr.gibba020.yqfnwy (mgr.34427) 8609 : cluster [DBG] pgmap v4902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:10.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:10 gibba013 bash[29418]: cluster 2021-03-10T16:36:09.549323+0000 mgr.gibba020.yqfnwy (mgr.34427) 8610 : cluster [DBG] pgmap v4903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:10.877 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:10 gibba013 bash[30381]: cluster 2021-03-10T16:36:09.549323+0000 mgr.gibba020.yqfnwy (mgr.34427) 8610 : cluster [DBG] pgmap v4903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:10.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:10 gibba020 bash[25448]: cluster 2021-03-10T16:36:09.549323+0000 mgr.gibba020.yqfnwy (mgr.34427) 8610 : cluster [DBG] pgmap v4903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:12.554 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:36:12.786 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:36:12.786 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 5m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:36:12.787 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 4m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:36:12.787 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:36:12.787 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:36:12.788 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:36:12.788 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:36:12.788 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:36:12.788 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:36:12.788 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:36:12.789 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:36:12.789 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:36:12.789 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:36:12.789 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:36:12.790 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:36:12.790 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:36:12.790 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:36:12.790 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:36:12.791 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:36:12.791 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 4m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:36:12.791 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 4m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:36:12.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:12 gibba013 bash[29418]: cluster 2021-03-10T16:36:11.551068+0000 mgr.gibba020.yqfnwy (mgr.34427) 8611 : cluster [DBG] pgmap v4904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:12.877 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:12 gibba013 bash[30381]: cluster 2021-03-10T16:36:11.551068+0000 mgr.gibba020.yqfnwy (mgr.34427) 8611 : cluster [DBG] pgmap v4904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:12.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:12 gibba020 bash[25448]: cluster 2021-03-10T16:36:11.551068+0000 mgr.gibba020.yqfnwy (mgr.34427) 8611 : cluster [DBG] pgmap v4904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:13.034 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:36:13.034 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:36:13.034 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:36:13.035 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:36:13.035 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:36:13.035 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:36:13.035 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:36:13.036 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:36:13.036 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:36:13.036 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:36:13.036 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:36:13.037 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:36:13.037 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:36:13.037 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:36:13.037 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:36:13.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:13 gibba013 bash[29418]: audit 2021-03-10T16:36:12.545684+0000 mgr.gibba020.yqfnwy (mgr.34427) 8612 : audit [DBG] from='client.59812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:36:13.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:13 gibba013 bash[29418]: audit 2021-03-10T16:36:12.774495+0000 mgr.gibba020.yqfnwy (mgr.34427) 8613 : audit [DBG] from='client.49836 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:36:13.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:13 gibba013 bash[29418]: audit 2021-03-10T16:36:13.035274+0000 mon.c (mon.1) 138 : audit [DBG] from='client.? 172.21.2.113:0/2627142225' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:13.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:13 gibba013 bash[30381]: audit 2021-03-10T16:36:12.545684+0000 mgr.gibba020.yqfnwy (mgr.34427) 8612 : audit [DBG] from='client.59812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:36:13.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:13 gibba013 bash[30381]: audit 2021-03-10T16:36:12.774495+0000 mgr.gibba020.yqfnwy (mgr.34427) 8613 : audit [DBG] from='client.49836 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:36:13.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:13 gibba013 bash[30381]: audit 2021-03-10T16:36:13.035274+0000 mon.c (mon.1) 138 : audit [DBG] from='client.? 172.21.2.113:0/2627142225' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:13.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:13 gibba020 bash[25448]: audit 2021-03-10T16:36:12.545684+0000 mgr.gibba020.yqfnwy (mgr.34427) 8612 : audit [DBG] from='client.59812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:36:13.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:13 gibba020 bash[25448]: audit 2021-03-10T16:36:12.774495+0000 mgr.gibba020.yqfnwy (mgr.34427) 8613 : audit [DBG] from='client.49836 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:36:13.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:13 gibba020 bash[25448]: audit 2021-03-10T16:36:13.035274+0000 mon.c (mon.1) 138 : audit [DBG] from='client.? 172.21.2.113:0/2627142225' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:14.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:14 gibba020 bash[25448]: cluster 2021-03-10T16:36:13.552633+0000 mgr.gibba020.yqfnwy (mgr.34427) 8614 : cluster [DBG] pgmap v4905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:14.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:14 gibba020 bash[25448]: cephadm 2021-03-10T16:36:13.845011+0000 mgr.gibba020.yqfnwy (mgr.34427) 8615 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:36:15.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:14 gibba013 bash[29418]: cluster 2021-03-10T16:36:13.552633+0000 mgr.gibba020.yqfnwy (mgr.34427) 8614 : cluster [DBG] pgmap v4905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:15.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:14 gibba013 bash[29418]: cephadm 2021-03-10T16:36:13.845011+0000 mgr.gibba020.yqfnwy (mgr.34427) 8615 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:36:15.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:14 gibba013 bash[30381]: cluster 2021-03-10T16:36:13.552633+0000 mgr.gibba020.yqfnwy (mgr.34427) 8614 : cluster [DBG] pgmap v4905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:15.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:14 gibba013 bash[30381]: cephadm 2021-03-10T16:36:13.845011+0000 mgr.gibba020.yqfnwy (mgr.34427) 8615 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:36:16.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:16 gibba020 bash[25448]: cluster 2021-03-10T16:36:15.554512+0000 mgr.gibba020.yqfnwy (mgr.34427) 8616 : cluster [DBG] pgmap v4906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:17.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:16 gibba013 bash[29418]: cluster 2021-03-10T16:36:15.554512+0000 mgr.gibba020.yqfnwy (mgr.34427) 8616 : cluster [DBG] pgmap v4906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:17.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:16 gibba013 bash[30381]: cluster 2021-03-10T16:36:15.554512+0000 mgr.gibba020.yqfnwy (mgr.34427) 8616 : cluster [DBG] pgmap v4906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:18.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:18 gibba020 bash[25448]: cluster 2021-03-10T16:36:17.556033+0000 mgr.gibba020.yqfnwy (mgr.34427) 8617 : cluster [DBG] pgmap v4907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:19.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:18 gibba013 bash[29418]: cluster 2021-03-10T16:36:17.556033+0000 mgr.gibba020.yqfnwy (mgr.34427) 8617 : cluster [DBG] pgmap v4907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:19.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:18 gibba013 bash[30381]: cluster 2021-03-10T16:36:17.556033+0000 mgr.gibba020.yqfnwy (mgr.34427) 8617 : cluster [DBG] pgmap v4907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:20.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:20 gibba013 bash[29418]: cluster 2021-03-10T16:36:19.557307+0000 mgr.gibba020.yqfnwy (mgr.34427) 8618 : cluster [DBG] pgmap v4908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:20.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:20 gibba013 bash[30381]: cluster 2021-03-10T16:36:19.557307+0000 mgr.gibba020.yqfnwy (mgr.34427) 8618 : cluster [DBG] pgmap v4908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:20.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:20 gibba020 bash[25448]: cluster 2021-03-10T16:36:19.557307+0000 mgr.gibba020.yqfnwy (mgr.34427) 8618 : cluster [DBG] pgmap v4908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:22.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:22 gibba013 bash[29418]: cluster 2021-03-10T16:36:21.559036+0000 mgr.gibba020.yqfnwy (mgr.34427) 8619 : cluster [DBG] pgmap v4909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:22.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:22 gibba013 bash[30381]: cluster 2021-03-10T16:36:21.559036+0000 mgr.gibba020.yqfnwy (mgr.34427) 8619 : cluster [DBG] pgmap v4909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:22.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:22 gibba020 bash[25448]: cluster 2021-03-10T16:36:21.559036+0000 mgr.gibba020.yqfnwy (mgr.34427) 8619 : cluster [DBG] pgmap v4909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:24.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:24 gibba020 bash[25448]: cluster 2021-03-10T16:36:23.560439+0000 mgr.gibba020.yqfnwy (mgr.34427) 8620 : cluster [DBG] pgmap v4910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:25.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:24 gibba013 bash[29418]: cluster 2021-03-10T16:36:23.560439+0000 mgr.gibba020.yqfnwy (mgr.34427) 8620 : cluster [DBG] pgmap v4910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:25.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:24 gibba013 bash[30381]: cluster 2021-03-10T16:36:23.560439+0000 mgr.gibba020.yqfnwy (mgr.34427) 8620 : cluster [DBG] pgmap v4910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:26.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:26 gibba020 bash[25448]: cluster 2021-03-10T16:36:25.562007+0000 mgr.gibba020.yqfnwy (mgr.34427) 8621 : cluster [DBG] pgmap v4911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:27.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:26 gibba013 bash[29418]: cluster 2021-03-10T16:36:25.562007+0000 mgr.gibba020.yqfnwy (mgr.34427) 8621 : cluster [DBG] pgmap v4911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:27.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:26 gibba013 bash[30381]: cluster 2021-03-10T16:36:25.562007+0000 mgr.gibba020.yqfnwy (mgr.34427) 8621 : cluster [DBG] pgmap v4911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:28.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:28 gibba020 bash[25448]: cluster 2021-03-10T16:36:27.563512+0000 mgr.gibba020.yqfnwy (mgr.34427) 8622 : cluster [DBG] pgmap v4912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:29.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:28 gibba013 bash[29418]: cluster 2021-03-10T16:36:27.563512+0000 mgr.gibba020.yqfnwy (mgr.34427) 8622 : cluster [DBG] pgmap v4912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:29.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:28 gibba013 bash[30381]: cluster 2021-03-10T16:36:27.563512+0000 mgr.gibba020.yqfnwy (mgr.34427) 8622 : cluster [DBG] pgmap v4912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:29.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:29 gibba020 bash[25448]: cephadm 2021-03-10T16:36:28.860919+0000 mgr.gibba020.yqfnwy (mgr.34427) 8623 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:36:30.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:29 gibba013 bash[29418]: cephadm 2021-03-10T16:36:28.860919+0000 mgr.gibba020.yqfnwy (mgr.34427) 8623 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:36:30.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:29 gibba013 bash[30381]: cephadm 2021-03-10T16:36:28.860919+0000 mgr.gibba020.yqfnwy (mgr.34427) 8623 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:36:30.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:30 gibba020 bash[25448]: cluster 2021-03-10T16:36:29.564963+0000 mgr.gibba020.yqfnwy (mgr.34427) 8624 : cluster [DBG] pgmap v4913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:31.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:30 gibba013 bash[29418]: cluster 2021-03-10T16:36:29.564963+0000 mgr.gibba020.yqfnwy (mgr.34427) 8624 : cluster [DBG] pgmap v4913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:31.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:30 gibba013 bash[30381]: cluster 2021-03-10T16:36:29.564963+0000 mgr.gibba020.yqfnwy (mgr.34427) 8624 : cluster [DBG] pgmap v4913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:32.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:32 gibba020 bash[25448]: cluster 2021-03-10T16:36:31.566711+0000 mgr.gibba020.yqfnwy (mgr.34427) 8625 : cluster [DBG] pgmap v4914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:33.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:32 gibba013 bash[29418]: cluster 2021-03-10T16:36:31.566711+0000 mgr.gibba020.yqfnwy (mgr.34427) 8625 : cluster [DBG] pgmap v4914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:33.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:32 gibba013 bash[30381]: cluster 2021-03-10T16:36:31.566711+0000 mgr.gibba020.yqfnwy (mgr.34427) 8625 : cluster [DBG] pgmap v4914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:34.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:34 gibba020 bash[25448]: cluster 2021-03-10T16:36:33.568163+0000 mgr.gibba020.yqfnwy (mgr.34427) 8626 : cluster [DBG] pgmap v4915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:35.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:34 gibba013 bash[29418]: cluster 2021-03-10T16:36:33.568163+0000 mgr.gibba020.yqfnwy (mgr.34427) 8626 : cluster [DBG] pgmap v4915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:35.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:34 gibba013 bash[30381]: cluster 2021-03-10T16:36:33.568163+0000 mgr.gibba020.yqfnwy (mgr.34427) 8626 : cluster [DBG] pgmap v4915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:36.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:36 gibba020 bash[25448]: cluster 2021-03-10T16:36:35.569916+0000 mgr.gibba020.yqfnwy (mgr.34427) 8627 : cluster [DBG] pgmap v4916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:37.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:36 gibba013 bash[29418]: cluster 2021-03-10T16:36:35.569916+0000 mgr.gibba020.yqfnwy (mgr.34427) 8627 : cluster [DBG] pgmap v4916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:37.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:36 gibba013 bash[30381]: cluster 2021-03-10T16:36:35.569916+0000 mgr.gibba020.yqfnwy (mgr.34427) 8627 : cluster [DBG] pgmap v4916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:38.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:38 gibba020 bash[25448]: cluster 2021-03-10T16:36:37.571442+0000 mgr.gibba020.yqfnwy (mgr.34427) 8628 : cluster [DBG] pgmap v4917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:39.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:38 gibba013 bash[29418]: cluster 2021-03-10T16:36:37.571442+0000 mgr.gibba020.yqfnwy (mgr.34427) 8628 : cluster [DBG] pgmap v4917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:39.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:38 gibba013 bash[30381]: cluster 2021-03-10T16:36:37.571442+0000 mgr.gibba020.yqfnwy (mgr.34427) 8628 : cluster [DBG] pgmap v4917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:40.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:40 gibba013 bash[29418]: cluster 2021-03-10T16:36:39.572879+0000 mgr.gibba020.yqfnwy (mgr.34427) 8629 : cluster [DBG] pgmap v4918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:40.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:40 gibba013 bash[30381]: cluster 2021-03-10T16:36:39.572879+0000 mgr.gibba020.yqfnwy (mgr.34427) 8629 : cluster [DBG] pgmap v4918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:40.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:40 gibba020 bash[25448]: cluster 2021-03-10T16:36:39.572879+0000 mgr.gibba020.yqfnwy (mgr.34427) 8629 : cluster [DBG] pgmap v4918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:42.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:42 gibba020 bash[25448]: cluster 2021-03-10T16:36:41.574585+0000 mgr.gibba020.yqfnwy (mgr.34427) 8630 : cluster [DBG] pgmap v4919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:43.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:42 gibba013 bash[29418]: cluster 2021-03-10T16:36:41.574585+0000 mgr.gibba020.yqfnwy (mgr.34427) 8630 : cluster [DBG] pgmap v4919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:43.127 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:42 gibba013 bash[30381]: cluster 2021-03-10T16:36:41.574585+0000 mgr.gibba020.yqfnwy (mgr.34427) 8630 : cluster [DBG] pgmap v4919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:43.277 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:36:43.533 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:36:43.533 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 6m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:36:43.533 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 5m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:36:43.534 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:36:43.534 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:36:43.534 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:36:43.535 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:36:43.535 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:36:43.536 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:36:43.536 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:36:43.536 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:36:43.536 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:36:43.537 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:36:43.537 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:36:43.537 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:36:43.537 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:36:43.538 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:36:43.538 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:36:43.538 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:36:43.538 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 5m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:36:43.539 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 5m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:36:43.789 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:36:43.789 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:36:43.789 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:36:43.790 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:36:43.790 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:36:43.790 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:36:43.791 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:36:43.791 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:36:43.791 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:36:43.792 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:36:43.792 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:36:43.792 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:36:43.792 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:36:43.793 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:36:43.793 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:36:44.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:44 gibba020 bash[25448]: audit 2021-03-10T16:36:43.269084+0000 mgr.gibba020.yqfnwy (mgr.34427) 8631 : audit [DBG] from='client.49848 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:36:44.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:44 gibba020 bash[25448]: audit 2021-03-10T16:36:43.493641+0000 mgr.gibba020.yqfnwy (mgr.34427) 8632 : audit [DBG] from='client.49854 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:36:44.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:44 gibba020 bash[25448]: cluster 2021-03-10T16:36:43.575757+0000 mgr.gibba020.yqfnwy (mgr.34427) 8633 : cluster [DBG] pgmap v4920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:44.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:44 gibba020 bash[25448]: audit 2021-03-10T16:36:43.790296+0000 mon.a (mon.0) 3158 : audit [DBG] from='client.? 172.21.2.113:0/2245351325' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:44.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:44 gibba020 bash[25448]: audit 2021-03-10T16:36:43.877732+0000 mon.a (mon.0) 3159 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:36:44.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:44 gibba020 bash[25448]: cephadm 2021-03-10T16:36:43.881685+0000 mgr.gibba020.yqfnwy (mgr.34427) 8634 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:36:44.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:44 gibba020 bash[25448]: cephadm 2021-03-10T16:36:43.883327+0000 mgr.gibba020.yqfnwy (mgr.34427) 8635 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:36:44.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:44 gibba020 bash[25448]: audit 2021-03-10T16:36:44.107020+0000 mon.a (mon.0) 3160 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:36:44.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:44 gibba020 bash[25448]: audit 2021-03-10T16:36:44.110231+0000 mon.a (mon.0) 3161 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:36:44.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:44 gibba020 bash[25448]: audit 2021-03-10T16:36:44.111511+0000 mon.a (mon.0) 3162 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:44.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:44 gibba020 bash[25448]: audit 2021-03-10T16:36:44.112629+0000 mon.a (mon.0) 3163 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:44.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:44 gibba020 bash[25448]: audit 2021-03-10T16:36:44.113572+0000 mon.a (mon.0) 3164 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:44.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:44 gibba020 bash[25448]: audit 2021-03-10T16:36:44.115405+0000 mon.a (mon.0) 3165 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:44.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:44 gibba020 bash[25448]: audit 2021-03-10T16:36:44.116506+0000 mon.a (mon.0) 3166 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:45.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:44 gibba013 bash[29418]: audit 2021-03-10T16:36:43.269084+0000 mgr.gibba020.yqfnwy (mgr.34427) 8631 : audit [DBG] from='client.49848 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:36:45.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:44 gibba013 bash[29418]: audit 2021-03-10T16:36:43.493641+0000 mgr.gibba020.yqfnwy (mgr.34427) 8632 : audit [DBG] from='client.49854 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:36:45.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:44 gibba013 bash[29418]: cluster 2021-03-10T16:36:43.575757+0000 mgr.gibba020.yqfnwy (mgr.34427) 8633 : cluster [DBG] pgmap v4920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:45.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:44 gibba013 bash[29418]: audit 2021-03-10T16:36:43.790296+0000 mon.a (mon.0) 3158 : audit [DBG] from='client.? 172.21.2.113:0/2245351325' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:45.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:44 gibba013 bash[29418]: audit 2021-03-10T16:36:43.877732+0000 mon.a (mon.0) 3159 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:36:45.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:44 gibba013 bash[29418]: cephadm 2021-03-10T16:36:43.881685+0000 mgr.gibba020.yqfnwy (mgr.34427) 8634 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:36:45.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:44 gibba013 bash[29418]: cephadm 2021-03-10T16:36:43.883327+0000 mgr.gibba020.yqfnwy (mgr.34427) 8635 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:36:45.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:44 gibba013 bash[29418]: audit 2021-03-10T16:36:44.107020+0000 mon.a (mon.0) 3160 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:36:45.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:44 gibba013 bash[29418]: audit 2021-03-10T16:36:44.110231+0000 mon.a (mon.0) 3161 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:36:45.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:44 gibba013 bash[29418]: audit 2021-03-10T16:36:44.111511+0000 mon.a (mon.0) 3162 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:45.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:44 gibba013 bash[29418]: audit 2021-03-10T16:36:44.112629+0000 mon.a (mon.0) 3163 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:45.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:44 gibba013 bash[29418]: audit 2021-03-10T16:36:44.113572+0000 mon.a (mon.0) 3164 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:45.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:44 gibba013 bash[29418]: audit 2021-03-10T16:36:44.115405+0000 mon.a (mon.0) 3165 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:45.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:44 gibba013 bash[29418]: audit 2021-03-10T16:36:44.116506+0000 mon.a (mon.0) 3166 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:45.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:44 gibba013 bash[30381]: audit 2021-03-10T16:36:43.269084+0000 mgr.gibba020.yqfnwy (mgr.34427) 8631 : audit [DBG] from='client.49848 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:36:45.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:44 gibba013 bash[30381]: audit 2021-03-10T16:36:43.493641+0000 mgr.gibba020.yqfnwy (mgr.34427) 8632 : audit [DBG] from='client.49854 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:36:45.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:44 gibba013 bash[30381]: cluster 2021-03-10T16:36:43.575757+0000 mgr.gibba020.yqfnwy (mgr.34427) 8633 : cluster [DBG] pgmap v4920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:45.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:44 gibba013 bash[30381]: audit 2021-03-10T16:36:43.790296+0000 mon.a (mon.0) 3158 : audit [DBG] from='client.? 172.21.2.113:0/2245351325' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:45.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:44 gibba013 bash[30381]: audit 2021-03-10T16:36:43.877732+0000 mon.a (mon.0) 3159 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:36:45.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:44 gibba013 bash[30381]: cephadm 2021-03-10T16:36:43.881685+0000 mgr.gibba020.yqfnwy (mgr.34427) 8634 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:36:45.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:44 gibba013 bash[30381]: cephadm 2021-03-10T16:36:43.883327+0000 mgr.gibba020.yqfnwy (mgr.34427) 8635 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:36:45.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:44 gibba013 bash[30381]: audit 2021-03-10T16:36:44.107020+0000 mon.a (mon.0) 3160 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:36:45.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:44 gibba013 bash[30381]: audit 2021-03-10T16:36:44.110231+0000 mon.a (mon.0) 3161 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:36:45.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:44 gibba013 bash[30381]: audit 2021-03-10T16:36:44.111511+0000 mon.a (mon.0) 3162 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:45.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:44 gibba013 bash[30381]: audit 2021-03-10T16:36:44.112629+0000 mon.a (mon.0) 3163 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:45.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:44 gibba013 bash[30381]: audit 2021-03-10T16:36:44.113572+0000 mon.a (mon.0) 3164 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:45.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:44 gibba013 bash[30381]: audit 2021-03-10T16:36:44.115405+0000 mon.a (mon.0) 3165 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:45.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:44 gibba013 bash[30381]: audit 2021-03-10T16:36:44.116506+0000 mon.a (mon.0) 3166 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:36:45.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:45 gibba020 bash[25448]: cephadm 2021-03-10T16:36:44.109050+0000 mgr.gibba020.yqfnwy (mgr.34427) 8636 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:36:45.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:45 gibba020 bash[25448]: cephadm 2021-03-10T16:36:44.110756+0000 mgr.gibba020.yqfnwy (mgr.34427) 8637 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:36:45.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:45 gibba020 bash[25448]: cephadm 2021-03-10T16:36:44.111806+0000 mgr.gibba020.yqfnwy (mgr.34427) 8638 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:36:45.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:45 gibba020 bash[25448]: cephadm 2021-03-10T16:36:44.111843+0000 mgr.gibba020.yqfnwy (mgr.34427) 8639 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:36:45.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:45 gibba020 bash[25448]: cephadm 2021-03-10T16:36:44.112857+0000 mgr.gibba020.yqfnwy (mgr.34427) 8640 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:36:45.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:45 gibba020 bash[25448]: cephadm 2021-03-10T16:36:44.112894+0000 mgr.gibba020.yqfnwy (mgr.34427) 8641 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:36:45.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:45 gibba020 bash[25448]: cephadm 2021-03-10T16:36:44.113814+0000 mgr.gibba020.yqfnwy (mgr.34427) 8642 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:36:45.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:45 gibba020 bash[25448]: cephadm 2021-03-10T16:36:44.114563+0000 mgr.gibba020.yqfnwy (mgr.34427) 8643 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:36:45.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:45 gibba020 bash[25448]: cephadm 2021-03-10T16:36:44.114599+0000 mgr.gibba020.yqfnwy (mgr.34427) 8644 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:36:45.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:45 gibba020 bash[25448]: cephadm 2021-03-10T16:36:44.115523+0000 mgr.gibba020.yqfnwy (mgr.34427) 8645 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:36:45.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:45 gibba020 bash[25448]: cephadm 2021-03-10T16:36:44.115839+0000 mgr.gibba020.yqfnwy (mgr.34427) 8646 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:36:45.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:45 gibba020 bash[25448]: cephadm 2021-03-10T16:36:44.116711+0000 mgr.gibba020.yqfnwy (mgr.34427) 8647 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:36:45.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:45 gibba020 bash[25448]: cephadm 2021-03-10T16:36:44.116782+0000 mgr.gibba020.yqfnwy (mgr.34427) 8648 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:36:45.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:45 gibba020 bash[25448]: cephadm 2021-03-10T16:36:44.116993+0000 mgr.gibba020.yqfnwy (mgr.34427) 8649 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:36:46.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:45 gibba013 bash[29418]: cephadm 2021-03-10T16:36:44.109050+0000 mgr.gibba020.yqfnwy (mgr.34427) 8636 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:36:46.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:45 gibba013 bash[29418]: cephadm 2021-03-10T16:36:44.110756+0000 mgr.gibba020.yqfnwy (mgr.34427) 8637 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:36:46.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:45 gibba013 bash[29418]: cephadm 2021-03-10T16:36:44.111806+0000 mgr.gibba020.yqfnwy (mgr.34427) 8638 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:36:46.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:45 gibba013 bash[29418]: cephadm 2021-03-10T16:36:44.111843+0000 mgr.gibba020.yqfnwy (mgr.34427) 8639 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:36:46.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:45 gibba013 bash[29418]: cephadm 2021-03-10T16:36:44.112857+0000 mgr.gibba020.yqfnwy (mgr.34427) 8640 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:36:46.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:45 gibba013 bash[29418]: cephadm 2021-03-10T16:36:44.112894+0000 mgr.gibba020.yqfnwy (mgr.34427) 8641 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:36:46.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:45 gibba013 bash[29418]: cephadm 2021-03-10T16:36:44.113814+0000 mgr.gibba020.yqfnwy (mgr.34427) 8642 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:36:46.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:45 gibba013 bash[29418]: cephadm 2021-03-10T16:36:44.114563+0000 mgr.gibba020.yqfnwy (mgr.34427) 8643 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:36:46.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:45 gibba013 bash[29418]: cephadm 2021-03-10T16:36:44.114599+0000 mgr.gibba020.yqfnwy (mgr.34427) 8644 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:36:46.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:45 gibba013 bash[29418]: cephadm 2021-03-10T16:36:44.115523+0000 mgr.gibba020.yqfnwy (mgr.34427) 8645 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:36:46.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:45 gibba013 bash[29418]: cephadm 2021-03-10T16:36:44.115839+0000 mgr.gibba020.yqfnwy (mgr.34427) 8646 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:36:46.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:45 gibba013 bash[29418]: cephadm 2021-03-10T16:36:44.116711+0000 mgr.gibba020.yqfnwy (mgr.34427) 8647 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:36:46.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:45 gibba013 bash[29418]: cephadm 2021-03-10T16:36:44.116782+0000 mgr.gibba020.yqfnwy (mgr.34427) 8648 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:36:46.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:45 gibba013 bash[29418]: cephadm 2021-03-10T16:36:44.116993+0000 mgr.gibba020.yqfnwy (mgr.34427) 8649 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:36:46.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:45 gibba013 bash[30381]: cephadm 2021-03-10T16:36:44.109050+0000 mgr.gibba020.yqfnwy (mgr.34427) 8636 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:36:46.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:45 gibba013 bash[30381]: cephadm 2021-03-10T16:36:44.110756+0000 mgr.gibba020.yqfnwy (mgr.34427) 8637 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:36:46.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:45 gibba013 bash[30381]: cephadm 2021-03-10T16:36:44.111806+0000 mgr.gibba020.yqfnwy (mgr.34427) 8638 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:36:46.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:45 gibba013 bash[30381]: cephadm 2021-03-10T16:36:44.111843+0000 mgr.gibba020.yqfnwy (mgr.34427) 8639 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:36:46.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:45 gibba013 bash[30381]: cephadm 2021-03-10T16:36:44.112857+0000 mgr.gibba020.yqfnwy (mgr.34427) 8640 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:36:46.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:45 gibba013 bash[30381]: cephadm 2021-03-10T16:36:44.112894+0000 mgr.gibba020.yqfnwy (mgr.34427) 8641 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:36:46.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:45 gibba013 bash[30381]: cephadm 2021-03-10T16:36:44.113814+0000 mgr.gibba020.yqfnwy (mgr.34427) 8642 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:36:46.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:45 gibba013 bash[30381]: cephadm 2021-03-10T16:36:44.114563+0000 mgr.gibba020.yqfnwy (mgr.34427) 8643 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:36:46.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:45 gibba013 bash[30381]: cephadm 2021-03-10T16:36:44.114599+0000 mgr.gibba020.yqfnwy (mgr.34427) 8644 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:36:46.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:45 gibba013 bash[30381]: cephadm 2021-03-10T16:36:44.115523+0000 mgr.gibba020.yqfnwy (mgr.34427) 8645 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:36:46.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:45 gibba013 bash[30381]: cephadm 2021-03-10T16:36:44.115839+0000 mgr.gibba020.yqfnwy (mgr.34427) 8646 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:36:46.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:45 gibba013 bash[30381]: cephadm 2021-03-10T16:36:44.116711+0000 mgr.gibba020.yqfnwy (mgr.34427) 8647 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:36:46.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:45 gibba013 bash[30381]: cephadm 2021-03-10T16:36:44.116782+0000 mgr.gibba020.yqfnwy (mgr.34427) 8648 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:36:46.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:45 gibba013 bash[30381]: cephadm 2021-03-10T16:36:44.116993+0000 mgr.gibba020.yqfnwy (mgr.34427) 8649 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:36:46.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:46 gibba020 bash[25448]: cluster 2021-03-10T16:36:45.577430+0000 mgr.gibba020.yqfnwy (mgr.34427) 8650 : cluster [DBG] pgmap v4921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:47.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:46 gibba013 bash[29418]: cluster 2021-03-10T16:36:45.577430+0000 mgr.gibba020.yqfnwy (mgr.34427) 8650 : cluster [DBG] pgmap v4921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:47.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:46 gibba013 bash[30381]: cluster 2021-03-10T16:36:45.577430+0000 mgr.gibba020.yqfnwy (mgr.34427) 8650 : cluster [DBG] pgmap v4921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:48.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:48 gibba020 bash[25448]: cluster 2021-03-10T16:36:47.578870+0000 mgr.gibba020.yqfnwy (mgr.34427) 8651 : cluster [DBG] pgmap v4922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:49.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:48 gibba013 bash[29418]: cluster 2021-03-10T16:36:47.578870+0000 mgr.gibba020.yqfnwy (mgr.34427) 8651 : cluster [DBG] pgmap v4922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:49.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:48 gibba013 bash[30381]: cluster 2021-03-10T16:36:47.578870+0000 mgr.gibba020.yqfnwy (mgr.34427) 8651 : cluster [DBG] pgmap v4922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:50.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:50 gibba013 bash[29418]: cluster 2021-03-10T16:36:49.580389+0000 mgr.gibba020.yqfnwy (mgr.34427) 8652 : cluster [DBG] pgmap v4923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:50.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:50 gibba013 bash[30381]: cluster 2021-03-10T16:36:49.580389+0000 mgr.gibba020.yqfnwy (mgr.34427) 8652 : cluster [DBG] pgmap v4923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:50.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:50 gibba020 bash[25448]: cluster 2021-03-10T16:36:49.580389+0000 mgr.gibba020.yqfnwy (mgr.34427) 8652 : cluster [DBG] pgmap v4923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:52.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:52 gibba020 bash[25448]: cluster 2021-03-10T16:36:51.582225+0000 mgr.gibba020.yqfnwy (mgr.34427) 8653 : cluster [DBG] pgmap v4924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:53.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:52 gibba013 bash[29418]: cluster 2021-03-10T16:36:51.582225+0000 mgr.gibba020.yqfnwy (mgr.34427) 8653 : cluster [DBG] pgmap v4924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:53.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:52 gibba013 bash[30381]: cluster 2021-03-10T16:36:51.582225+0000 mgr.gibba020.yqfnwy (mgr.34427) 8653 : cluster [DBG] pgmap v4924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:54.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:54 gibba020 bash[25448]: cluster 2021-03-10T16:36:53.583648+0000 mgr.gibba020.yqfnwy (mgr.34427) 8654 : cluster [DBG] pgmap v4925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:55.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:54 gibba013 bash[29418]: cluster 2021-03-10T16:36:53.583648+0000 mgr.gibba020.yqfnwy (mgr.34427) 8654 : cluster [DBG] pgmap v4925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:55.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:54 gibba013 bash[30381]: cluster 2021-03-10T16:36:53.583648+0000 mgr.gibba020.yqfnwy (mgr.34427) 8654 : cluster [DBG] pgmap v4925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:56.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:56 gibba020 bash[25448]: cluster 2021-03-10T16:36:55.585353+0000 mgr.gibba020.yqfnwy (mgr.34427) 8655 : cluster [DBG] pgmap v4926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:57.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:56 gibba013 bash[29418]: cluster 2021-03-10T16:36:55.585353+0000 mgr.gibba020.yqfnwy (mgr.34427) 8655 : cluster [DBG] pgmap v4926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:57.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:56 gibba013 bash[30381]: cluster 2021-03-10T16:36:55.585353+0000 mgr.gibba020.yqfnwy (mgr.34427) 8655 : cluster [DBG] pgmap v4926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:58.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:36:58 gibba020 bash[25448]: cluster 2021-03-10T16:36:57.586869+0000 mgr.gibba020.yqfnwy (mgr.34427) 8656 : cluster [DBG] pgmap v4927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:59.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:36:58 gibba013 bash[29418]: cluster 2021-03-10T16:36:57.586869+0000 mgr.gibba020.yqfnwy (mgr.34427) 8656 : cluster [DBG] pgmap v4927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:36:59.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:36:58 gibba013 bash[30381]: cluster 2021-03-10T16:36:57.586869+0000 mgr.gibba020.yqfnwy (mgr.34427) 8656 : cluster [DBG] pgmap v4927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:00.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:00 gibba013 bash[29418]: cephadm 2021-03-10T16:36:59.132857+0000 mgr.gibba020.yqfnwy (mgr.34427) 8657 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:37:00.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:00 gibba013 bash[29418]: cluster 2021-03-10T16:36:59.588472+0000 mgr.gibba020.yqfnwy (mgr.34427) 8658 : cluster [DBG] pgmap v4928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:00.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:00 gibba013 bash[30381]: cephadm 2021-03-10T16:36:59.132857+0000 mgr.gibba020.yqfnwy (mgr.34427) 8657 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:37:00.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:00 gibba013 bash[30381]: cluster 2021-03-10T16:36:59.588472+0000 mgr.gibba020.yqfnwy (mgr.34427) 8658 : cluster [DBG] pgmap v4928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:00.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:00 gibba020 bash[25448]: cephadm 2021-03-10T16:36:59.132857+0000 mgr.gibba020.yqfnwy (mgr.34427) 8657 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:37:00.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:00 gibba020 bash[25448]: cluster 2021-03-10T16:36:59.588472+0000 mgr.gibba020.yqfnwy (mgr.34427) 8658 : cluster [DBG] pgmap v4928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:02.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:02 gibba020 bash[25448]: cluster 2021-03-10T16:37:01.590210+0000 mgr.gibba020.yqfnwy (mgr.34427) 8659 : cluster [DBG] pgmap v4929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:03.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:02 gibba013 bash[29418]: cluster 2021-03-10T16:37:01.590210+0000 mgr.gibba020.yqfnwy (mgr.34427) 8659 : cluster [DBG] pgmap v4929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:03.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:02 gibba013 bash[30381]: cluster 2021-03-10T16:37:01.590210+0000 mgr.gibba020.yqfnwy (mgr.34427) 8659 : cluster [DBG] pgmap v4929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:04.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:04 gibba020 bash[25448]: cluster 2021-03-10T16:37:03.591930+0000 mgr.gibba020.yqfnwy (mgr.34427) 8660 : cluster [DBG] pgmap v4930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:05.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:04 gibba013 bash[29418]: cluster 2021-03-10T16:37:03.591930+0000 mgr.gibba020.yqfnwy (mgr.34427) 8660 : cluster [DBG] pgmap v4930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:05.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:04 gibba013 bash[30381]: cluster 2021-03-10T16:37:03.591930+0000 mgr.gibba020.yqfnwy (mgr.34427) 8660 : cluster [DBG] pgmap v4930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:06.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:06 gibba020 bash[25448]: cluster 2021-03-10T16:37:05.593694+0000 mgr.gibba020.yqfnwy (mgr.34427) 8661 : cluster [DBG] pgmap v4931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:07.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:06 gibba013 bash[29418]: cluster 2021-03-10T16:37:05.593694+0000 mgr.gibba020.yqfnwy (mgr.34427) 8661 : cluster [DBG] pgmap v4931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:07.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:06 gibba013 bash[30381]: cluster 2021-03-10T16:37:05.593694+0000 mgr.gibba020.yqfnwy (mgr.34427) 8661 : cluster [DBG] pgmap v4931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:07.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:07 gibba020 bash[25448]: audit 2021-03-10T16:37:06.746753+0000 mon.a (mon.0) 3167 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:37:07.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:07 gibba020 bash[25448]: audit 2021-03-10T16:37:06.910207+0000 mon.a (mon.0) 3168 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:37:07.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:07 gibba020 bash[25448]: audit 2021-03-10T16:37:07.230046+0000 mon.a (mon.0) 3169 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:37:07.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:07 gibba020 bash[25448]: audit 2021-03-10T16:37:07.230827+0000 mon.a (mon.0) 3170 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:37:07.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:07 gibba020 bash[25448]: audit 2021-03-10T16:37:07.231470+0000 mon.a (mon.0) 3171 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:37:07.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:07 gibba020 bash[25448]: audit 2021-03-10T16:37:07.232199+0000 mon.a (mon.0) 3172 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:37:08.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:07 gibba013 bash[29418]: audit 2021-03-10T16:37:06.746753+0000 mon.a (mon.0) 3167 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:37:08.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:07 gibba013 bash[29418]: audit 2021-03-10T16:37:06.910207+0000 mon.a (mon.0) 3168 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:37:08.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:07 gibba013 bash[29418]: audit 2021-03-10T16:37:07.230046+0000 mon.a (mon.0) 3169 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:37:08.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:07 gibba013 bash[29418]: audit 2021-03-10T16:37:07.230827+0000 mon.a (mon.0) 3170 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:37:08.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:07 gibba013 bash[29418]: audit 2021-03-10T16:37:07.231470+0000 mon.a (mon.0) 3171 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:37:08.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:07 gibba013 bash[29418]: audit 2021-03-10T16:37:07.232199+0000 mon.a (mon.0) 3172 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:37:08.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:07 gibba013 bash[30381]: audit 2021-03-10T16:37:06.746753+0000 mon.a (mon.0) 3167 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:37:08.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:07 gibba013 bash[30381]: audit 2021-03-10T16:37:06.910207+0000 mon.a (mon.0) 3168 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:37:08.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:07 gibba013 bash[30381]: audit 2021-03-10T16:37:07.230046+0000 mon.a (mon.0) 3169 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:37:08.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:07 gibba013 bash[30381]: audit 2021-03-10T16:37:07.230827+0000 mon.a (mon.0) 3170 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:37:08.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:07 gibba013 bash[30381]: audit 2021-03-10T16:37:07.231470+0000 mon.a (mon.0) 3171 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:37:08.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:07 gibba013 bash[30381]: audit 2021-03-10T16:37:07.232199+0000 mon.a (mon.0) 3172 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:37:08.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:08 gibba020 bash[25448]: cluster 2021-03-10T16:37:07.595243+0000 mgr.gibba020.yqfnwy (mgr.34427) 8662 : cluster [DBG] pgmap v4932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:09.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:08 gibba013 bash[29418]: cluster 2021-03-10T16:37:07.595243+0000 mgr.gibba020.yqfnwy (mgr.34427) 8662 : cluster [DBG] pgmap v4932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:09.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:08 gibba013 bash[30381]: cluster 2021-03-10T16:37:07.595243+0000 mgr.gibba020.yqfnwy (mgr.34427) 8662 : cluster [DBG] pgmap v4932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:10.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:10 gibba013 bash[29418]: cluster 2021-03-10T16:37:09.596603+0000 mgr.gibba020.yqfnwy (mgr.34427) 8663 : cluster [DBG] pgmap v4933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:10.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:10 gibba013 bash[30381]: cluster 2021-03-10T16:37:09.596603+0000 mgr.gibba020.yqfnwy (mgr.34427) 8663 : cluster [DBG] pgmap v4933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:10.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:10 gibba020 bash[25448]: cluster 2021-03-10T16:37:09.596603+0000 mgr.gibba020.yqfnwy (mgr.34427) 8663 : cluster [DBG] pgmap v4933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:12.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:12 gibba020 bash[25448]: cluster 2021-03-10T16:37:11.598211+0000 mgr.gibba020.yqfnwy (mgr.34427) 8664 : cluster [DBG] pgmap v4934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:13.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:12 gibba013 bash[29418]: cluster 2021-03-10T16:37:11.598211+0000 mgr.gibba020.yqfnwy (mgr.34427) 8664 : cluster [DBG] pgmap v4934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:13.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:12 gibba013 bash[30381]: cluster 2021-03-10T16:37:11.598211+0000 mgr.gibba020.yqfnwy (mgr.34427) 8664 : cluster [DBG] pgmap v4934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:14.029 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:37:14.257 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:37:14.258 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 6m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:37:14.258 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 5m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:37:14.258 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:37:14.258 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:37:14.258 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:37:14.259 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:37:14.259 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:37:14.259 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:37:14.259 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:37:14.260 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:37:14.260 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:37:14.260 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:37:14.260 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:37:14.261 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:37:14.261 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:37:14.261 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:37:14.261 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:37:14.261 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:37:14.262 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 5m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:37:14.262 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 5m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:37:14.512 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:37:14.512 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:37:14.513 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:37:14.513 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:37:14.513 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:37:14.513 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:37:14.514 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:37:14.514 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:37:14.514 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:37:14.514 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:37:14.514 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:37:14.515 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:37:14.515 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:37:14.515 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:37:14.515 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:37:14.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:14 gibba020 bash[25448]: cluster 2021-03-10T16:37:13.599823+0000 mgr.gibba020.yqfnwy (mgr.34427) 8665 : cluster [DBG] pgmap v4935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:14.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:14 gibba020 bash[25448]: audit 2021-03-10T16:37:14.513739+0000 mon.a (mon.0) 3173 : audit [DBG] from='client.? 172.21.2.113:0/3866350069' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:15.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:14 gibba013 bash[29418]: cluster 2021-03-10T16:37:13.599823+0000 mgr.gibba020.yqfnwy (mgr.34427) 8665 : cluster [DBG] pgmap v4935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:15.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:14 gibba013 bash[29418]: audit 2021-03-10T16:37:14.513739+0000 mon.a (mon.0) 3173 : audit [DBG] from='client.? 172.21.2.113:0/3866350069' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:15.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:14 gibba013 bash[30381]: cluster 2021-03-10T16:37:13.599823+0000 mgr.gibba020.yqfnwy (mgr.34427) 8665 : cluster [DBG] pgmap v4935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:15.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:14 gibba013 bash[30381]: audit 2021-03-10T16:37:14.513739+0000 mon.a (mon.0) 3173 : audit [DBG] from='client.? 172.21.2.113:0/3866350069' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:15.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:15 gibba020 bash[25448]: audit 2021-03-10T16:37:14.021601+0000 mgr.gibba020.yqfnwy (mgr.34427) 8666 : audit [DBG] from='client.59848 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:37:15.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:15 gibba020 bash[25448]: cephadm 2021-03-10T16:37:14.148682+0000 mgr.gibba020.yqfnwy (mgr.34427) 8667 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:37:15.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:15 gibba020 bash[25448]: audit 2021-03-10T16:37:14.246350+0000 mgr.gibba020.yqfnwy (mgr.34427) 8668 : audit [DBG] from='client.49872 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:37:16.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:15 gibba013 bash[29418]: audit 2021-03-10T16:37:14.021601+0000 mgr.gibba020.yqfnwy (mgr.34427) 8666 : audit [DBG] from='client.59848 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:37:16.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:15 gibba013 bash[29418]: cephadm 2021-03-10T16:37:14.148682+0000 mgr.gibba020.yqfnwy (mgr.34427) 8667 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:37:16.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:15 gibba013 bash[29418]: audit 2021-03-10T16:37:14.246350+0000 mgr.gibba020.yqfnwy (mgr.34427) 8668 : audit [DBG] from='client.49872 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:37:16.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:15 gibba013 bash[30381]: audit 2021-03-10T16:37:14.021601+0000 mgr.gibba020.yqfnwy (mgr.34427) 8666 : audit [DBG] from='client.59848 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:37:16.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:15 gibba013 bash[30381]: cephadm 2021-03-10T16:37:14.148682+0000 mgr.gibba020.yqfnwy (mgr.34427) 8667 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:37:16.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:15 gibba013 bash[30381]: audit 2021-03-10T16:37:14.246350+0000 mgr.gibba020.yqfnwy (mgr.34427) 8668 : audit [DBG] from='client.49872 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:37:16.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:16 gibba020 bash[25448]: cluster 2021-03-10T16:37:15.601330+0000 mgr.gibba020.yqfnwy (mgr.34427) 8669 : cluster [DBG] pgmap v4936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:17.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:16 gibba013 bash[29418]: cluster 2021-03-10T16:37:15.601330+0000 mgr.gibba020.yqfnwy (mgr.34427) 8669 : cluster [DBG] pgmap v4936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:17.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:16 gibba013 bash[30381]: cluster 2021-03-10T16:37:15.601330+0000 mgr.gibba020.yqfnwy (mgr.34427) 8669 : cluster [DBG] pgmap v4936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:18.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:18 gibba020 bash[25448]: cluster 2021-03-10T16:37:17.602858+0000 mgr.gibba020.yqfnwy (mgr.34427) 8670 : cluster [DBG] pgmap v4937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:19.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:18 gibba013 bash[29418]: cluster 2021-03-10T16:37:17.602858+0000 mgr.gibba020.yqfnwy (mgr.34427) 8670 : cluster [DBG] pgmap v4937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:19.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:18 gibba013 bash[30381]: cluster 2021-03-10T16:37:17.602858+0000 mgr.gibba020.yqfnwy (mgr.34427) 8670 : cluster [DBG] pgmap v4937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:20.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:20 gibba013 bash[29418]: cluster 2021-03-10T16:37:19.604326+0000 mgr.gibba020.yqfnwy (mgr.34427) 8671 : cluster [DBG] pgmap v4938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:20.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:20 gibba013 bash[30381]: cluster 2021-03-10T16:37:19.604326+0000 mgr.gibba020.yqfnwy (mgr.34427) 8671 : cluster [DBG] pgmap v4938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:20.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:20 gibba020 bash[25448]: cluster 2021-03-10T16:37:19.604326+0000 mgr.gibba020.yqfnwy (mgr.34427) 8671 : cluster [DBG] pgmap v4938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:22.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:22 gibba020 bash[25448]: cluster 2021-03-10T16:37:21.605946+0000 mgr.gibba020.yqfnwy (mgr.34427) 8672 : cluster [DBG] pgmap v4939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:23.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:22 gibba013 bash[29418]: cluster 2021-03-10T16:37:21.605946+0000 mgr.gibba020.yqfnwy (mgr.34427) 8672 : cluster [DBG] pgmap v4939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:23.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:22 gibba013 bash[30381]: cluster 2021-03-10T16:37:21.605946+0000 mgr.gibba020.yqfnwy (mgr.34427) 8672 : cluster [DBG] pgmap v4939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:24.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:24 gibba020 bash[25448]: cluster 2021-03-10T16:37:23.607571+0000 mgr.gibba020.yqfnwy (mgr.34427) 8673 : cluster [DBG] pgmap v4940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:25.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:24 gibba013 bash[29418]: cluster 2021-03-10T16:37:23.607571+0000 mgr.gibba020.yqfnwy (mgr.34427) 8673 : cluster [DBG] pgmap v4940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:25.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:24 gibba013 bash[30381]: cluster 2021-03-10T16:37:23.607571+0000 mgr.gibba020.yqfnwy (mgr.34427) 8673 : cluster [DBG] pgmap v4940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:26.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:26 gibba020 bash[25448]: cluster 2021-03-10T16:37:25.609187+0000 mgr.gibba020.yqfnwy (mgr.34427) 8674 : cluster [DBG] pgmap v4941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:27.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:26 gibba013 bash[29418]: cluster 2021-03-10T16:37:25.609187+0000 mgr.gibba020.yqfnwy (mgr.34427) 8674 : cluster [DBG] pgmap v4941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:27.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:26 gibba013 bash[30381]: cluster 2021-03-10T16:37:25.609187+0000 mgr.gibba020.yqfnwy (mgr.34427) 8674 : cluster [DBG] pgmap v4941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:28.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:28 gibba020 bash[25448]: cluster 2021-03-10T16:37:27.610799+0000 mgr.gibba020.yqfnwy (mgr.34427) 8675 : cluster [DBG] pgmap v4942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:29.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:28 gibba013 bash[29418]: cluster 2021-03-10T16:37:27.610799+0000 mgr.gibba020.yqfnwy (mgr.34427) 8675 : cluster [DBG] pgmap v4942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:29.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:28 gibba013 bash[30381]: cluster 2021-03-10T16:37:27.610799+0000 mgr.gibba020.yqfnwy (mgr.34427) 8675 : cluster [DBG] pgmap v4942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:30.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:30 gibba013 bash[29418]: cephadm 2021-03-10T16:37:29.164195+0000 mgr.gibba020.yqfnwy (mgr.34427) 8676 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:37:30.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:30 gibba013 bash[29418]: cluster 2021-03-10T16:37:29.612406+0000 mgr.gibba020.yqfnwy (mgr.34427) 8677 : cluster [DBG] pgmap v4943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:30.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:30 gibba013 bash[30381]: cephadm 2021-03-10T16:37:29.164195+0000 mgr.gibba020.yqfnwy (mgr.34427) 8676 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:37:30.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:30 gibba013 bash[30381]: cluster 2021-03-10T16:37:29.612406+0000 mgr.gibba020.yqfnwy (mgr.34427) 8677 : cluster [DBG] pgmap v4943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:30.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:30 gibba020 bash[25448]: cephadm 2021-03-10T16:37:29.164195+0000 mgr.gibba020.yqfnwy (mgr.34427) 8676 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:37:30.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:30 gibba020 bash[25448]: cluster 2021-03-10T16:37:29.612406+0000 mgr.gibba020.yqfnwy (mgr.34427) 8677 : cluster [DBG] pgmap v4943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:32.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:32 gibba020 bash[25448]: cluster 2021-03-10T16:37:31.614260+0000 mgr.gibba020.yqfnwy (mgr.34427) 8678 : cluster [DBG] pgmap v4944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:33.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:32 gibba013 bash[29418]: cluster 2021-03-10T16:37:31.614260+0000 mgr.gibba020.yqfnwy (mgr.34427) 8678 : cluster [DBG] pgmap v4944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:33.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:32 gibba013 bash[30381]: cluster 2021-03-10T16:37:31.614260+0000 mgr.gibba020.yqfnwy (mgr.34427) 8678 : cluster [DBG] pgmap v4944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:34.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:34 gibba020 bash[25448]: cluster 2021-03-10T16:37:33.615648+0000 mgr.gibba020.yqfnwy (mgr.34427) 8679 : cluster [DBG] pgmap v4945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:35.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:34 gibba013 bash[29418]: cluster 2021-03-10T16:37:33.615648+0000 mgr.gibba020.yqfnwy (mgr.34427) 8679 : cluster [DBG] pgmap v4945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:35.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:34 gibba013 bash[30381]: cluster 2021-03-10T16:37:33.615648+0000 mgr.gibba020.yqfnwy (mgr.34427) 8679 : cluster [DBG] pgmap v4945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:36.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:36 gibba020 bash[25448]: cluster 2021-03-10T16:37:35.617369+0000 mgr.gibba020.yqfnwy (mgr.34427) 8680 : cluster [DBG] pgmap v4946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:37.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:36 gibba013 bash[29418]: cluster 2021-03-10T16:37:35.617369+0000 mgr.gibba020.yqfnwy (mgr.34427) 8680 : cluster [DBG] pgmap v4946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:37.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:36 gibba013 bash[30381]: cluster 2021-03-10T16:37:35.617369+0000 mgr.gibba020.yqfnwy (mgr.34427) 8680 : cluster [DBG] pgmap v4946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:39.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:38 gibba013 bash[29418]: cluster 2021-03-10T16:37:37.618801+0000 mgr.gibba020.yqfnwy (mgr.34427) 8681 : cluster [DBG] pgmap v4947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:39.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:38 gibba013 bash[30381]: cluster 2021-03-10T16:37:37.618801+0000 mgr.gibba020.yqfnwy (mgr.34427) 8681 : cluster [DBG] pgmap v4947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:39.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:38 gibba020 bash[25448]: cluster 2021-03-10T16:37:37.618801+0000 mgr.gibba020.yqfnwy (mgr.34427) 8681 : cluster [DBG] pgmap v4947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:40.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:40 gibba013 bash[29418]: cluster 2021-03-10T16:37:39.620386+0000 mgr.gibba020.yqfnwy (mgr.34427) 8682 : cluster [DBG] pgmap v4948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:40.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:40 gibba013 bash[30381]: cluster 2021-03-10T16:37:39.620386+0000 mgr.gibba020.yqfnwy (mgr.34427) 8682 : cluster [DBG] pgmap v4948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:40.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:40 gibba020 bash[25448]: cluster 2021-03-10T16:37:39.620386+0000 mgr.gibba020.yqfnwy (mgr.34427) 8682 : cluster [DBG] pgmap v4948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:42.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:42 gibba020 bash[25448]: cluster 2021-03-10T16:37:41.622124+0000 mgr.gibba020.yqfnwy (mgr.34427) 8683 : cluster [DBG] pgmap v4949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:43.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:42 gibba013 bash[29418]: cluster 2021-03-10T16:37:41.622124+0000 mgr.gibba020.yqfnwy (mgr.34427) 8683 : cluster [DBG] pgmap v4949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:43.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:42 gibba013 bash[30381]: cluster 2021-03-10T16:37:41.622124+0000 mgr.gibba020.yqfnwy (mgr.34427) 8683 : cluster [DBG] pgmap v4949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:44.758 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:37:44.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:44 gibba020 bash[25448]: cluster 2021-03-10T16:37:43.623551+0000 mgr.gibba020.yqfnwy (mgr.34427) 8684 : cluster [DBG] pgmap v4950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:44.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:44 gibba020 bash[25448]: audit 2021-03-10T16:37:44.169909+0000 mon.a (mon.0) 3174 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:37:44.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:44 gibba020 bash[25448]: audit 2021-03-10T16:37:44.355229+0000 mon.a (mon.0) 3175 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:37:44.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:44 gibba020 bash[25448]: audit 2021-03-10T16:37:44.361408+0000 mon.a (mon.0) 3176 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:37:44.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:44 gibba020 bash[25448]: audit 2021-03-10T16:37:44.574135+0000 mon.a (mon.0) 3177 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:37:44.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:44 gibba020 bash[25448]: audit 2021-03-10T16:37:44.590671+0000 mon.a (mon.0) 3178 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:37:44.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:44 gibba020 bash[25448]: audit 2021-03-10T16:37:44.594442+0000 mon.a (mon.0) 3179 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:44.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:44 gibba020 bash[25448]: audit 2021-03-10T16:37:44.597995+0000 mon.a (mon.0) 3180 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:44.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:44 gibba020 bash[25448]: audit 2021-03-10T16:37:44.600743+0000 mon.a (mon.0) 3181 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:44.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:44 gibba020 bash[25448]: audit 2021-03-10T16:37:44.606996+0000 mon.a (mon.0) 3182 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:44.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:44 gibba020 bash[25448]: audit 2021-03-10T16:37:44.611576+0000 mon.a (mon.0) 3183 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:44.985 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:37:44.986 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 7m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:37:44.987 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 6m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:37:44.987 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:37:44.988 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:37:44.988 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:37:44.988 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:37:44.989 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:37:44.989 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:37:44.989 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:37:44.989 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:37:44.989 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:37:44.990 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:37:44.990 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:37:44.990 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:37:44.991 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:37:44.991 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:37:44.991 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:37:44.991 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:37:44.992 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 6m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:37:44.992 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 6m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:37:45.127 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:44 gibba013 bash[30381]: cluster 2021-03-10T16:37:43.623551+0000 mgr.gibba020.yqfnwy (mgr.34427) 8684 : cluster [DBG] pgmap v4950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:45.127 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:44 gibba013 bash[30381]: audit 2021-03-10T16:37:44.169909+0000 mon.a (mon.0) 3174 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:37:45.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:44 gibba013 bash[30381]: audit 2021-03-10T16:37:44.355229+0000 mon.a (mon.0) 3175 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:37:45.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:44 gibba013 bash[30381]: audit 2021-03-10T16:37:44.361408+0000 mon.a (mon.0) 3176 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:37:45.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:44 gibba013 bash[30381]: audit 2021-03-10T16:37:44.574135+0000 mon.a (mon.0) 3177 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:37:45.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:44 gibba013 bash[30381]: audit 2021-03-10T16:37:44.590671+0000 mon.a (mon.0) 3178 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:37:45.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:44 gibba013 bash[30381]: audit 2021-03-10T16:37:44.594442+0000 mon.a (mon.0) 3179 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:45.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:44 gibba013 bash[30381]: audit 2021-03-10T16:37:44.597995+0000 mon.a (mon.0) 3180 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:45.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:44 gibba013 bash[30381]: audit 2021-03-10T16:37:44.600743+0000 mon.a (mon.0) 3181 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:45.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:44 gibba013 bash[30381]: audit 2021-03-10T16:37:44.606996+0000 mon.a (mon.0) 3182 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:45.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:44 gibba013 bash[30381]: audit 2021-03-10T16:37:44.611576+0000 mon.a (mon.0) 3183 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:45.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:44 gibba013 bash[29418]: cluster 2021-03-10T16:37:43.623551+0000 mgr.gibba020.yqfnwy (mgr.34427) 8684 : cluster [DBG] pgmap v4950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:45.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:44 gibba013 bash[29418]: audit 2021-03-10T16:37:44.169909+0000 mon.a (mon.0) 3174 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:37:45.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:44 gibba013 bash[29418]: audit 2021-03-10T16:37:44.355229+0000 mon.a (mon.0) 3175 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:37:45.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:44 gibba013 bash[29418]: audit 2021-03-10T16:37:44.361408+0000 mon.a (mon.0) 3176 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:37:45.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:44 gibba013 bash[29418]: audit 2021-03-10T16:37:44.574135+0000 mon.a (mon.0) 3177 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:37:45.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:44 gibba013 bash[29418]: audit 2021-03-10T16:37:44.590671+0000 mon.a (mon.0) 3178 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:37:45.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:44 gibba013 bash[29418]: audit 2021-03-10T16:37:44.594442+0000 mon.a (mon.0) 3179 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:45.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:44 gibba013 bash[29418]: audit 2021-03-10T16:37:44.597995+0000 mon.a (mon.0) 3180 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:45.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:44 gibba013 bash[29418]: audit 2021-03-10T16:37:44.600743+0000 mon.a (mon.0) 3181 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:45.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:44 gibba013 bash[29418]: audit 2021-03-10T16:37:44.606996+0000 mon.a (mon.0) 3182 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:45.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:44 gibba013 bash[29418]: audit 2021-03-10T16:37:44.611576+0000 mon.a (mon.0) 3183 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:45.238 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:37:45.238 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:37:45.239 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:37:45.239 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:37:45.239 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:37:45.239 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:37:45.240 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:37:45.240 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:37:45.240 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:37:45.240 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:37:45.241 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:37:45.241 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:37:45.241 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:37:45.241 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:37:45.241 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:37:46.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:45 gibba013 bash[29418]: cephadm 2021-03-10T16:37:44.355491+0000 mgr.gibba020.yqfnwy (mgr.34427) 8685 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:37:46.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:45 gibba013 bash[29418]: cephadm 2021-03-10T16:37:44.361359+0000 mgr.gibba020.yqfnwy (mgr.34427) 8686 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:37:46.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:45 gibba013 bash[29418]: cephadm 2021-03-10T16:37:44.586666+0000 mgr.gibba020.yqfnwy (mgr.34427) 8687 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:37:46.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:45 gibba013 bash[29418]: cephadm 2021-03-10T16:37:44.592761+0000 mgr.gibba020.yqfnwy (mgr.34427) 8688 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:37:46.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:45 gibba013 bash[29418]: cephadm 2021-03-10T16:37:44.596047+0000 mgr.gibba020.yqfnwy (mgr.34427) 8689 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:37:46.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:45 gibba013 bash[29418]: cephadm 2021-03-10T16:37:44.596639+0000 mgr.gibba020.yqfnwy (mgr.34427) 8690 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:37:46.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:45 gibba013 bash[29418]: cephadm 2021-03-10T16:37:44.599464+0000 mgr.gibba020.yqfnwy (mgr.34427) 8691 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:37:46.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:45 gibba013 bash[29418]: cephadm 2021-03-10T16:37:44.599743+0000 mgr.gibba020.yqfnwy (mgr.34427) 8692 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:37:46.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:45 gibba013 bash[29418]: cephadm 2021-03-10T16:37:44.602181+0000 mgr.gibba020.yqfnwy (mgr.34427) 8693 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:37:46.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:45 gibba013 bash[29418]: cephadm 2021-03-10T16:37:44.604715+0000 mgr.gibba020.yqfnwy (mgr.34427) 8694 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:37:46.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:45 gibba013 bash[29418]: cephadm 2021-03-10T16:37:44.605181+0000 mgr.gibba020.yqfnwy (mgr.34427) 8695 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:37:46.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:45 gibba013 bash[29418]: cephadm 2021-03-10T16:37:44.608481+0000 mgr.gibba020.yqfnwy (mgr.34427) 8696 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:37:46.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:45 gibba013 bash[29418]: cephadm 2021-03-10T16:37:44.610457+0000 mgr.gibba020.yqfnwy (mgr.34427) 8697 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:37:46.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:45 gibba013 bash[29418]: cephadm 2021-03-10T16:37:44.613104+0000 mgr.gibba020.yqfnwy (mgr.34427) 8698 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:37:46.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:45 gibba013 bash[29418]: cephadm 2021-03-10T16:37:44.613474+0000 mgr.gibba020.yqfnwy (mgr.34427) 8699 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:37:46.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:45 gibba013 bash[29418]: cephadm 2021-03-10T16:37:44.614038+0000 mgr.gibba020.yqfnwy (mgr.34427) 8700 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:37:46.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:45 gibba013 bash[29418]: audit 2021-03-10T16:37:44.749747+0000 mgr.gibba020.yqfnwy (mgr.34427) 8701 : audit [DBG] from='client.49884 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:37:46.138 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:45 gibba013 bash[29418]: audit 2021-03-10T16:37:45.239835+0000 mon.a (mon.0) 3184 : audit [DBG] from='client.? 172.21.2.113:0/3015382871' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:46.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:45 gibba013 bash[30381]: cephadm 2021-03-10T16:37:44.355491+0000 mgr.gibba020.yqfnwy (mgr.34427) 8685 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:37:46.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:45 gibba013 bash[30381]: cephadm 2021-03-10T16:37:44.361359+0000 mgr.gibba020.yqfnwy (mgr.34427) 8686 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:37:46.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:45 gibba013 bash[30381]: cephadm 2021-03-10T16:37:44.586666+0000 mgr.gibba020.yqfnwy (mgr.34427) 8687 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:37:46.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:45 gibba013 bash[30381]: cephadm 2021-03-10T16:37:44.592761+0000 mgr.gibba020.yqfnwy (mgr.34427) 8688 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:37:46.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:45 gibba013 bash[30381]: cephadm 2021-03-10T16:37:44.596047+0000 mgr.gibba020.yqfnwy (mgr.34427) 8689 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:37:46.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:45 gibba013 bash[30381]: cephadm 2021-03-10T16:37:44.596639+0000 mgr.gibba020.yqfnwy (mgr.34427) 8690 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:37:46.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:45 gibba013 bash[30381]: cephadm 2021-03-10T16:37:44.599464+0000 mgr.gibba020.yqfnwy (mgr.34427) 8691 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:37:46.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:45 gibba013 bash[30381]: cephadm 2021-03-10T16:37:44.599743+0000 mgr.gibba020.yqfnwy (mgr.34427) 8692 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:37:46.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:45 gibba013 bash[30381]: cephadm 2021-03-10T16:37:44.602181+0000 mgr.gibba020.yqfnwy (mgr.34427) 8693 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:37:46.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:45 gibba013 bash[30381]: cephadm 2021-03-10T16:37:44.604715+0000 mgr.gibba020.yqfnwy (mgr.34427) 8694 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:37:46.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:45 gibba013 bash[30381]: cephadm 2021-03-10T16:37:44.605181+0000 mgr.gibba020.yqfnwy (mgr.34427) 8695 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:37:46.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:45 gibba013 bash[30381]: cephadm 2021-03-10T16:37:44.608481+0000 mgr.gibba020.yqfnwy (mgr.34427) 8696 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:37:46.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:45 gibba013 bash[30381]: cephadm 2021-03-10T16:37:44.610457+0000 mgr.gibba020.yqfnwy (mgr.34427) 8697 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:37:46.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:45 gibba013 bash[30381]: cephadm 2021-03-10T16:37:44.613104+0000 mgr.gibba020.yqfnwy (mgr.34427) 8698 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:37:46.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:45 gibba013 bash[30381]: cephadm 2021-03-10T16:37:44.613474+0000 mgr.gibba020.yqfnwy (mgr.34427) 8699 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:37:46.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:45 gibba013 bash[30381]: cephadm 2021-03-10T16:37:44.614038+0000 mgr.gibba020.yqfnwy (mgr.34427) 8700 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:37:46.143 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:45 gibba013 bash[30381]: audit 2021-03-10T16:37:44.749747+0000 mgr.gibba020.yqfnwy (mgr.34427) 8701 : audit [DBG] from='client.49884 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:37:46.143 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:45 gibba013 bash[30381]: audit 2021-03-10T16:37:45.239835+0000 mon.a (mon.0) 3184 : audit [DBG] from='client.? 172.21.2.113:0/3015382871' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:46.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:45 gibba020 bash[25448]: cephadm 2021-03-10T16:37:44.355491+0000 mgr.gibba020.yqfnwy (mgr.34427) 8685 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:37:46.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:45 gibba020 bash[25448]: cephadm 2021-03-10T16:37:44.361359+0000 mgr.gibba020.yqfnwy (mgr.34427) 8686 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:37:46.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:45 gibba020 bash[25448]: cephadm 2021-03-10T16:37:44.586666+0000 mgr.gibba020.yqfnwy (mgr.34427) 8687 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:37:46.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:45 gibba020 bash[25448]: cephadm 2021-03-10T16:37:44.592761+0000 mgr.gibba020.yqfnwy (mgr.34427) 8688 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:37:46.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:45 gibba020 bash[25448]: cephadm 2021-03-10T16:37:44.596047+0000 mgr.gibba020.yqfnwy (mgr.34427) 8689 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:37:46.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:45 gibba020 bash[25448]: cephadm 2021-03-10T16:37:44.596639+0000 mgr.gibba020.yqfnwy (mgr.34427) 8690 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:37:46.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:45 gibba020 bash[25448]: cephadm 2021-03-10T16:37:44.599464+0000 mgr.gibba020.yqfnwy (mgr.34427) 8691 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:37:46.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:45 gibba020 bash[25448]: cephadm 2021-03-10T16:37:44.599743+0000 mgr.gibba020.yqfnwy (mgr.34427) 8692 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:37:46.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:45 gibba020 bash[25448]: cephadm 2021-03-10T16:37:44.602181+0000 mgr.gibba020.yqfnwy (mgr.34427) 8693 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:37:46.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:45 gibba020 bash[25448]: cephadm 2021-03-10T16:37:44.604715+0000 mgr.gibba020.yqfnwy (mgr.34427) 8694 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:37:46.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:45 gibba020 bash[25448]: cephadm 2021-03-10T16:37:44.605181+0000 mgr.gibba020.yqfnwy (mgr.34427) 8695 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:37:46.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:45 gibba020 bash[25448]: cephadm 2021-03-10T16:37:44.608481+0000 mgr.gibba020.yqfnwy (mgr.34427) 8696 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:37:46.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:45 gibba020 bash[25448]: cephadm 2021-03-10T16:37:44.610457+0000 mgr.gibba020.yqfnwy (mgr.34427) 8697 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:37:46.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:45 gibba020 bash[25448]: cephadm 2021-03-10T16:37:44.613104+0000 mgr.gibba020.yqfnwy (mgr.34427) 8698 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:37:46.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:45 gibba020 bash[25448]: cephadm 2021-03-10T16:37:44.613474+0000 mgr.gibba020.yqfnwy (mgr.34427) 8699 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:37:46.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:45 gibba020 bash[25448]: cephadm 2021-03-10T16:37:44.614038+0000 mgr.gibba020.yqfnwy (mgr.34427) 8700 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:37:46.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:45 gibba020 bash[25448]: audit 2021-03-10T16:37:44.749747+0000 mgr.gibba020.yqfnwy (mgr.34427) 8701 : audit [DBG] from='client.49884 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:37:46.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:45 gibba020 bash[25448]: audit 2021-03-10T16:37:45.239835+0000 mon.a (mon.0) 3184 : audit [DBG] from='client.? 172.21.2.113:0/3015382871' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:37:47.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:46 gibba013 bash[29418]: audit 2021-03-10T16:37:44.973171+0000 mgr.gibba020.yqfnwy (mgr.34427) 8702 : audit [DBG] from='client.59872 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:37:47.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:46 gibba013 bash[29418]: cluster 2021-03-10T16:37:45.625064+0000 mgr.gibba020.yqfnwy (mgr.34427) 8703 : cluster [DBG] pgmap v4951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:47.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:46 gibba013 bash[30381]: audit 2021-03-10T16:37:44.973171+0000 mgr.gibba020.yqfnwy (mgr.34427) 8702 : audit [DBG] from='client.59872 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:37:47.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:46 gibba013 bash[30381]: cluster 2021-03-10T16:37:45.625064+0000 mgr.gibba020.yqfnwy (mgr.34427) 8703 : cluster [DBG] pgmap v4951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:47.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:46 gibba020 bash[25448]: audit 2021-03-10T16:37:44.973171+0000 mgr.gibba020.yqfnwy (mgr.34427) 8702 : audit [DBG] from='client.59872 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:37:47.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:46 gibba020 bash[25448]: cluster 2021-03-10T16:37:45.625064+0000 mgr.gibba020.yqfnwy (mgr.34427) 8703 : cluster [DBG] pgmap v4951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:49.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:48 gibba013 bash[29418]: cluster 2021-03-10T16:37:47.626665+0000 mgr.gibba020.yqfnwy (mgr.34427) 8704 : cluster [DBG] pgmap v4952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:49.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:48 gibba013 bash[30381]: cluster 2021-03-10T16:37:47.626665+0000 mgr.gibba020.yqfnwy (mgr.34427) 8704 : cluster [DBG] pgmap v4952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:49.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:48 gibba020 bash[25448]: cluster 2021-03-10T16:37:47.626665+0000 mgr.gibba020.yqfnwy (mgr.34427) 8704 : cluster [DBG] pgmap v4952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:50.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:50 gibba013 bash[29418]: cluster 2021-03-10T16:37:49.627927+0000 mgr.gibba020.yqfnwy (mgr.34427) 8705 : cluster [DBG] pgmap v4953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:50.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:50 gibba013 bash[30381]: cluster 2021-03-10T16:37:49.627927+0000 mgr.gibba020.yqfnwy (mgr.34427) 8705 : cluster [DBG] pgmap v4953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:50.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:50 gibba020 bash[25448]: cluster 2021-03-10T16:37:49.627927+0000 mgr.gibba020.yqfnwy (mgr.34427) 8705 : cluster [DBG] pgmap v4953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:52.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:52 gibba020 bash[25448]: cluster 2021-03-10T16:37:51.629623+0000 mgr.gibba020.yqfnwy (mgr.34427) 8706 : cluster [DBG] pgmap v4954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:53.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:52 gibba013 bash[29418]: cluster 2021-03-10T16:37:51.629623+0000 mgr.gibba020.yqfnwy (mgr.34427) 8706 : cluster [DBG] pgmap v4954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:53.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:52 gibba013 bash[30381]: cluster 2021-03-10T16:37:51.629623+0000 mgr.gibba020.yqfnwy (mgr.34427) 8706 : cluster [DBG] pgmap v4954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:55.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:54 gibba013 bash[29418]: cluster 2021-03-10T16:37:53.631265+0000 mgr.gibba020.yqfnwy (mgr.34427) 8707 : cluster [DBG] pgmap v4955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:55.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:54 gibba013 bash[30381]: cluster 2021-03-10T16:37:53.631265+0000 mgr.gibba020.yqfnwy (mgr.34427) 8707 : cluster [DBG] pgmap v4955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:55.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:54 gibba020 bash[25448]: cluster 2021-03-10T16:37:53.631265+0000 mgr.gibba020.yqfnwy (mgr.34427) 8707 : cluster [DBG] pgmap v4955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:57.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:56 gibba013 bash[29418]: cluster 2021-03-10T16:37:55.632918+0000 mgr.gibba020.yqfnwy (mgr.34427) 8708 : cluster [DBG] pgmap v4956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:57.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:56 gibba013 bash[30381]: cluster 2021-03-10T16:37:55.632918+0000 mgr.gibba020.yqfnwy (mgr.34427) 8708 : cluster [DBG] pgmap v4956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:57.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:56 gibba020 bash[25448]: cluster 2021-03-10T16:37:55.632918+0000 mgr.gibba020.yqfnwy (mgr.34427) 8708 : cluster [DBG] pgmap v4956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:59.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:37:58 gibba013 bash[29418]: cluster 2021-03-10T16:37:57.634337+0000 mgr.gibba020.yqfnwy (mgr.34427) 8709 : cluster [DBG] pgmap v4957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:59.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:37:58 gibba013 bash[30381]: cluster 2021-03-10T16:37:57.634337+0000 mgr.gibba020.yqfnwy (mgr.34427) 8709 : cluster [DBG] pgmap v4957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:37:59.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:37:58 gibba020 bash[25448]: cluster 2021-03-10T16:37:57.634337+0000 mgr.gibba020.yqfnwy (mgr.34427) 8709 : cluster [DBG] pgmap v4957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:00.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:00 gibba013 bash[29418]: cephadm 2021-03-10T16:37:59.630007+0000 mgr.gibba020.yqfnwy (mgr.34427) 8710 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:38:00.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:00 gibba013 bash[29418]: cluster 2021-03-10T16:37:59.635495+0000 mgr.gibba020.yqfnwy (mgr.34427) 8711 : cluster [DBG] pgmap v4958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:00.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:00 gibba013 bash[30381]: cephadm 2021-03-10T16:37:59.630007+0000 mgr.gibba020.yqfnwy (mgr.34427) 8710 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:38:00.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:00 gibba013 bash[30381]: cluster 2021-03-10T16:37:59.635495+0000 mgr.gibba020.yqfnwy (mgr.34427) 8711 : cluster [DBG] pgmap v4958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:00.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:00 gibba020 bash[25448]: cephadm 2021-03-10T16:37:59.630007+0000 mgr.gibba020.yqfnwy (mgr.34427) 8710 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:38:00.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:00 gibba020 bash[25448]: cluster 2021-03-10T16:37:59.635495+0000 mgr.gibba020.yqfnwy (mgr.34427) 8711 : cluster [DBG] pgmap v4958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:03.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:02 gibba013 bash[29418]: cluster 2021-03-10T16:38:01.636417+0000 mgr.gibba020.yqfnwy (mgr.34427) 8712 : cluster [DBG] pgmap v4959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:03.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:02 gibba013 bash[30381]: cluster 2021-03-10T16:38:01.636417+0000 mgr.gibba020.yqfnwy (mgr.34427) 8712 : cluster [DBG] pgmap v4959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:03.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:02 gibba020 bash[25448]: cluster 2021-03-10T16:38:01.636417+0000 mgr.gibba020.yqfnwy (mgr.34427) 8712 : cluster [DBG] pgmap v4959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:05.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:04 gibba013 bash[29418]: cluster 2021-03-10T16:38:03.637682+0000 mgr.gibba020.yqfnwy (mgr.34427) 8713 : cluster [DBG] pgmap v4960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:05.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:04 gibba013 bash[30381]: cluster 2021-03-10T16:38:03.637682+0000 mgr.gibba020.yqfnwy (mgr.34427) 8713 : cluster [DBG] pgmap v4960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:05.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:04 gibba020 bash[25448]: cluster 2021-03-10T16:38:03.637682+0000 mgr.gibba020.yqfnwy (mgr.34427) 8713 : cluster [DBG] pgmap v4960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:07.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:06 gibba013 bash[29418]: cluster 2021-03-10T16:38:05.639383+0000 mgr.gibba020.yqfnwy (mgr.34427) 8714 : cluster [DBG] pgmap v4961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:07.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:06 gibba013 bash[30381]: cluster 2021-03-10T16:38:05.639383+0000 mgr.gibba020.yqfnwy (mgr.34427) 8714 : cluster [DBG] pgmap v4961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:07.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:06 gibba020 bash[25448]: cluster 2021-03-10T16:38:05.639383+0000 mgr.gibba020.yqfnwy (mgr.34427) 8714 : cluster [DBG] pgmap v4961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:08.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:07 gibba013 bash[29418]: audit 2021-03-10T16:38:06.751414+0000 mon.a (mon.0) 3185 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:38:08.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:07 gibba013 bash[29418]: audit 2021-03-10T16:38:06.916739+0000 mon.a (mon.0) 3186 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:38:08.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:07 gibba013 bash[29418]: audit 2021-03-10T16:38:07.242186+0000 mon.a (mon.0) 3187 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T16:38:08.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:07 gibba013 bash[29418]: audit 2021-03-10T16:38:07.242958+0000 mon.a (mon.0) 3188 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:38:08.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:07 gibba013 bash[29418]: audit 2021-03-10T16:38:07.243606+0000 mon.a (mon.0) 3189 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:38:08.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:07 gibba013 bash[29418]: audit 2021-03-10T16:38:07.244244+0000 mon.a (mon.0) 3190 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:38:08.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:07 gibba013 bash[30381]: audit 2021-03-10T16:38:06.751414+0000 mon.a (mon.0) 3185 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:38:08.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:07 gibba013 bash[30381]: audit 2021-03-10T16:38:06.916739+0000 mon.a (mon.0) 3186 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:38:08.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:07 gibba013 bash[30381]: audit 2021-03-10T16:38:07.242186+0000 mon.a (mon.0) 3187 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T16:38:08.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:07 gibba013 bash[30381]: audit 2021-03-10T16:38:07.242958+0000 mon.a (mon.0) 3188 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:38:08.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:07 gibba013 bash[30381]: audit 2021-03-10T16:38:07.243606+0000 mon.a (mon.0) 3189 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:38:08.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:07 gibba013 bash[30381]: audit 2021-03-10T16:38:07.244244+0000 mon.a (mon.0) 3190 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:38:08.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:07 gibba020 bash[25448]: audit 2021-03-10T16:38:06.751414+0000 mon.a (mon.0) 3185 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:38:08.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:07 gibba020 bash[25448]: audit 2021-03-10T16:38:06.916739+0000 mon.a (mon.0) 3186 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:38:08.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:07 gibba020 bash[25448]: audit 2021-03-10T16:38:07.242186+0000 mon.a (mon.0) 3187 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T16:38:08.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:07 gibba020 bash[25448]: audit 2021-03-10T16:38:07.242958+0000 mon.a (mon.0) 3188 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:38:08.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:07 gibba020 bash[25448]: audit 2021-03-10T16:38:07.243606+0000 mon.a (mon.0) 3189 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:38:08.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:07 gibba020 bash[25448]: audit 2021-03-10T16:38:07.244244+0000 mon.a (mon.0) 3190 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:38:09.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:08 gibba013 bash[29418]: cluster 2021-03-10T16:38:07.640974+0000 mgr.gibba020.yqfnwy (mgr.34427) 8715 : cluster [DBG] pgmap v4962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:09.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:08 gibba013 bash[30381]: cluster 2021-03-10T16:38:07.640974+0000 mgr.gibba020.yqfnwy (mgr.34427) 8715 : cluster [DBG] pgmap v4962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:09.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:08 gibba020 bash[25448]: cluster 2021-03-10T16:38:07.640974+0000 mgr.gibba020.yqfnwy (mgr.34427) 8715 : cluster [DBG] pgmap v4962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:10.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:10 gibba013 bash[29418]: cluster 2021-03-10T16:38:09.642514+0000 mgr.gibba020.yqfnwy (mgr.34427) 8716 : cluster [DBG] pgmap v4963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:10.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:10 gibba013 bash[30381]: cluster 2021-03-10T16:38:09.642514+0000 mgr.gibba020.yqfnwy (mgr.34427) 8716 : cluster [DBG] pgmap v4963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:10.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:10 gibba020 bash[25448]: cluster 2021-03-10T16:38:09.642514+0000 mgr.gibba020.yqfnwy (mgr.34427) 8716 : cluster [DBG] pgmap v4963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:13.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:12 gibba013 bash[29418]: cluster 2021-03-10T16:38:11.643421+0000 mgr.gibba020.yqfnwy (mgr.34427) 8717 : cluster [DBG] pgmap v4964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:13.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:12 gibba013 bash[30381]: cluster 2021-03-10T16:38:11.643421+0000 mgr.gibba020.yqfnwy (mgr.34427) 8717 : cluster [DBG] pgmap v4964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:13.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:12 gibba020 bash[25448]: cluster 2021-03-10T16:38:11.643421+0000 mgr.gibba020.yqfnwy (mgr.34427) 8717 : cluster [DBG] pgmap v4964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:14.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:14 gibba020 bash[25448]: cluster 2021-03-10T16:38:13.644724+0000 mgr.gibba020.yqfnwy (mgr.34427) 8718 : cluster [DBG] pgmap v4965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:15.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:14 gibba013 bash[29418]: cluster 2021-03-10T16:38:13.644724+0000 mgr.gibba020.yqfnwy (mgr.34427) 8718 : cluster [DBG] pgmap v4965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:15.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:14 gibba013 bash[30381]: cluster 2021-03-10T16:38:13.644724+0000 mgr.gibba020.yqfnwy (mgr.34427) 8718 : cluster [DBG] pgmap v4965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:15.480 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:38:15.708 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:38:15.709 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 7m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:38:15.709 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 6m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:38:15.709 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:38:15.709 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:38:15.710 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:38:15.710 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:38:15.710 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:38:15.710 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:38:15.711 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:38:15.711 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:38:15.711 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:38:15.711 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:38:15.711 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:38:15.712 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:38:15.712 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:38:15.712 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:38:15.712 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:38:15.713 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 6m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:38:15.713 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 6m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:38:15.713 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 6m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:38:15.958 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:38:15.959 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:38:15.959 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:38:15.959 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:38:15.959 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:38:15.960 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:38:15.960 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:38:15.960 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:38:15.960 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:38:15.960 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:38:15.961 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:38:15.961 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:38:15.961 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:38:15.961 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:38:15.962 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:38:16.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:15 gibba013 bash[29418]: cephadm 2021-03-10T16:38:14.645931+0000 mgr.gibba020.yqfnwy (mgr.34427) 8719 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:38:16.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:15 gibba013 bash[30381]: cephadm 2021-03-10T16:38:14.645931+0000 mgr.gibba020.yqfnwy (mgr.34427) 8719 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:38:16.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:15 gibba020 bash[25448]: cephadm 2021-03-10T16:38:14.645931+0000 mgr.gibba020.yqfnwy (mgr.34427) 8719 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:38:17.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:16 gibba013 bash[29418]: audit 2021-03-10T16:38:15.472651+0000 mgr.gibba020.yqfnwy (mgr.34427) 8720 : audit [DBG] from='client.49902 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:38:17.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:16 gibba013 bash[29418]: cluster 2021-03-10T16:38:15.646384+0000 mgr.gibba020.yqfnwy (mgr.34427) 8721 : cluster [DBG] pgmap v4966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:17.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:16 gibba013 bash[29418]: audit 2021-03-10T16:38:15.697441+0000 mgr.gibba020.yqfnwy (mgr.34427) 8722 : audit [DBG] from='client.59890 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:38:17.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:16 gibba013 bash[29418]: audit 2021-03-10T16:38:15.960085+0000 mon.a (mon.0) 3191 : audit [DBG] from='client.? 172.21.2.113:0/7852083' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:17.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:16 gibba013 bash[30381]: audit 2021-03-10T16:38:15.472651+0000 mgr.gibba020.yqfnwy (mgr.34427) 8720 : audit [DBG] from='client.49902 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:38:17.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:16 gibba013 bash[30381]: cluster 2021-03-10T16:38:15.646384+0000 mgr.gibba020.yqfnwy (mgr.34427) 8721 : cluster [DBG] pgmap v4966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:17.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:16 gibba013 bash[30381]: audit 2021-03-10T16:38:15.697441+0000 mgr.gibba020.yqfnwy (mgr.34427) 8722 : audit [DBG] from='client.59890 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:38:17.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:16 gibba013 bash[30381]: audit 2021-03-10T16:38:15.960085+0000 mon.a (mon.0) 3191 : audit [DBG] from='client.? 172.21.2.113:0/7852083' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:17.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:16 gibba020 bash[25448]: audit 2021-03-10T16:38:15.472651+0000 mgr.gibba020.yqfnwy (mgr.34427) 8720 : audit [DBG] from='client.49902 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:38:17.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:16 gibba020 bash[25448]: cluster 2021-03-10T16:38:15.646384+0000 mgr.gibba020.yqfnwy (mgr.34427) 8721 : cluster [DBG] pgmap v4966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:17.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:16 gibba020 bash[25448]: audit 2021-03-10T16:38:15.697441+0000 mgr.gibba020.yqfnwy (mgr.34427) 8722 : audit [DBG] from='client.59890 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:38:17.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:16 gibba020 bash[25448]: audit 2021-03-10T16:38:15.960085+0000 mon.a (mon.0) 3191 : audit [DBG] from='client.? 172.21.2.113:0/7852083' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:19.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:18 gibba013 bash[29418]: cluster 2021-03-10T16:38:17.647860+0000 mgr.gibba020.yqfnwy (mgr.34427) 8723 : cluster [DBG] pgmap v4967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:19.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:18 gibba013 bash[30381]: cluster 2021-03-10T16:38:17.647860+0000 mgr.gibba020.yqfnwy (mgr.34427) 8723 : cluster [DBG] pgmap v4967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:19.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:18 gibba020 bash[25448]: cluster 2021-03-10T16:38:17.647860+0000 mgr.gibba020.yqfnwy (mgr.34427) 8723 : cluster [DBG] pgmap v4967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:20.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:20 gibba013 bash[29418]: cluster 2021-03-10T16:38:19.649198+0000 mgr.gibba020.yqfnwy (mgr.34427) 8724 : cluster [DBG] pgmap v4968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:20.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:20 gibba013 bash[30381]: cluster 2021-03-10T16:38:19.649198+0000 mgr.gibba020.yqfnwy (mgr.34427) 8724 : cluster [DBG] pgmap v4968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:20.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:20 gibba020 bash[25448]: cluster 2021-03-10T16:38:19.649198+0000 mgr.gibba020.yqfnwy (mgr.34427) 8724 : cluster [DBG] pgmap v4968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:23.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:22 gibba013 bash[29418]: cluster 2021-03-10T16:38:21.650030+0000 mgr.gibba020.yqfnwy (mgr.34427) 8725 : cluster [DBG] pgmap v4969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:23.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:22 gibba013 bash[30381]: cluster 2021-03-10T16:38:21.650030+0000 mgr.gibba020.yqfnwy (mgr.34427) 8725 : cluster [DBG] pgmap v4969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:23.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:22 gibba020 bash[25448]: cluster 2021-03-10T16:38:21.650030+0000 mgr.gibba020.yqfnwy (mgr.34427) 8725 : cluster [DBG] pgmap v4969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:25.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:24 gibba013 bash[29418]: cluster 2021-03-10T16:38:23.651282+0000 mgr.gibba020.yqfnwy (mgr.34427) 8726 : cluster [DBG] pgmap v4970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:25.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:24 gibba013 bash[30381]: cluster 2021-03-10T16:38:23.651282+0000 mgr.gibba020.yqfnwy (mgr.34427) 8726 : cluster [DBG] pgmap v4970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:25.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:24 gibba020 bash[25448]: cluster 2021-03-10T16:38:23.651282+0000 mgr.gibba020.yqfnwy (mgr.34427) 8726 : cluster [DBG] pgmap v4970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:27.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:26 gibba013 bash[29418]: cluster 2021-03-10T16:38:25.652812+0000 mgr.gibba020.yqfnwy (mgr.34427) 8727 : cluster [DBG] pgmap v4971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:27.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:26 gibba013 bash[30381]: cluster 2021-03-10T16:38:25.652812+0000 mgr.gibba020.yqfnwy (mgr.34427) 8727 : cluster [DBG] pgmap v4971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:27.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:26 gibba020 bash[25448]: cluster 2021-03-10T16:38:25.652812+0000 mgr.gibba020.yqfnwy (mgr.34427) 8727 : cluster [DBG] pgmap v4971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:29.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:28 gibba013 bash[29418]: cluster 2021-03-10T16:38:27.654405+0000 mgr.gibba020.yqfnwy (mgr.34427) 8728 : cluster [DBG] pgmap v4972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:29.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:28 gibba013 bash[30381]: cluster 2021-03-10T16:38:27.654405+0000 mgr.gibba020.yqfnwy (mgr.34427) 8728 : cluster [DBG] pgmap v4972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:29.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:28 gibba020 bash[25448]: cluster 2021-03-10T16:38:27.654405+0000 mgr.gibba020.yqfnwy (mgr.34427) 8728 : cluster [DBG] pgmap v4972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:30.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:30 gibba013 bash[29418]: cluster 2021-03-10T16:38:29.656163+0000 mgr.gibba020.yqfnwy (mgr.34427) 8729 : cluster [DBG] pgmap v4973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:30.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:30 gibba013 bash[29418]: cephadm 2021-03-10T16:38:29.661935+0000 mgr.gibba020.yqfnwy (mgr.34427) 8730 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:38:30.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:30 gibba013 bash[30381]: cluster 2021-03-10T16:38:29.656163+0000 mgr.gibba020.yqfnwy (mgr.34427) 8729 : cluster [DBG] pgmap v4973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:30.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:30 gibba013 bash[30381]: cephadm 2021-03-10T16:38:29.661935+0000 mgr.gibba020.yqfnwy (mgr.34427) 8730 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:38:30.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:30 gibba020 bash[25448]: cluster 2021-03-10T16:38:29.656163+0000 mgr.gibba020.yqfnwy (mgr.34427) 8729 : cluster [DBG] pgmap v4973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:30.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:30 gibba020 bash[25448]: cephadm 2021-03-10T16:38:29.661935+0000 mgr.gibba020.yqfnwy (mgr.34427) 8730 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:38:33.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:32 gibba013 bash[29418]: cluster 2021-03-10T16:38:31.657899+0000 mgr.gibba020.yqfnwy (mgr.34427) 8731 : cluster [DBG] pgmap v4974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:33.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:32 gibba013 bash[30381]: cluster 2021-03-10T16:38:31.657899+0000 mgr.gibba020.yqfnwy (mgr.34427) 8731 : cluster [DBG] pgmap v4974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:33.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:32 gibba020 bash[25448]: cluster 2021-03-10T16:38:31.657899+0000 mgr.gibba020.yqfnwy (mgr.34427) 8731 : cluster [DBG] pgmap v4974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:35.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:34 gibba013 bash[29418]: cluster 2021-03-10T16:38:33.659291+0000 mgr.gibba020.yqfnwy (mgr.34427) 8732 : cluster [DBG] pgmap v4975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:35.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:34 gibba013 bash[30381]: cluster 2021-03-10T16:38:33.659291+0000 mgr.gibba020.yqfnwy (mgr.34427) 8732 : cluster [DBG] pgmap v4975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:35.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:34 gibba020 bash[25448]: cluster 2021-03-10T16:38:33.659291+0000 mgr.gibba020.yqfnwy (mgr.34427) 8732 : cluster [DBG] pgmap v4975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:37.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:36 gibba013 bash[29418]: cluster 2021-03-10T16:38:35.661053+0000 mgr.gibba020.yqfnwy (mgr.34427) 8733 : cluster [DBG] pgmap v4976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:37.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:36 gibba013 bash[30381]: cluster 2021-03-10T16:38:35.661053+0000 mgr.gibba020.yqfnwy (mgr.34427) 8733 : cluster [DBG] pgmap v4976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:37.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:36 gibba020 bash[25448]: cluster 2021-03-10T16:38:35.661053+0000 mgr.gibba020.yqfnwy (mgr.34427) 8733 : cluster [DBG] pgmap v4976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:39.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:38 gibba013 bash[29418]: cluster 2021-03-10T16:38:37.662567+0000 mgr.gibba020.yqfnwy (mgr.34427) 8734 : cluster [DBG] pgmap v4977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:39.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:38 gibba013 bash[30381]: cluster 2021-03-10T16:38:37.662567+0000 mgr.gibba020.yqfnwy (mgr.34427) 8734 : cluster [DBG] pgmap v4977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:39.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:38 gibba020 bash[25448]: cluster 2021-03-10T16:38:37.662567+0000 mgr.gibba020.yqfnwy (mgr.34427) 8734 : cluster [DBG] pgmap v4977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:40.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:40 gibba013 bash[29418]: cluster 2021-03-10T16:38:39.664230+0000 mgr.gibba020.yqfnwy (mgr.34427) 8735 : cluster [DBG] pgmap v4978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:40.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:40 gibba013 bash[30381]: cluster 2021-03-10T16:38:39.664230+0000 mgr.gibba020.yqfnwy (mgr.34427) 8735 : cluster [DBG] pgmap v4978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:40.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:40 gibba020 bash[25448]: cluster 2021-03-10T16:38:39.664230+0000 mgr.gibba020.yqfnwy (mgr.34427) 8735 : cluster [DBG] pgmap v4978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:43.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:42 gibba013 bash[29418]: cluster 2021-03-10T16:38:41.665254+0000 mgr.gibba020.yqfnwy (mgr.34427) 8736 : cluster [DBG] pgmap v4979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:43.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:42 gibba013 bash[30381]: cluster 2021-03-10T16:38:41.665254+0000 mgr.gibba020.yqfnwy (mgr.34427) 8736 : cluster [DBG] pgmap v4979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:43.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:42 gibba020 bash[25448]: cluster 2021-03-10T16:38:41.665254+0000 mgr.gibba020.yqfnwy (mgr.34427) 8736 : cluster [DBG] pgmap v4979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:45.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:44 gibba013 bash[29418]: cluster 2021-03-10T16:38:43.666746+0000 mgr.gibba020.yqfnwy (mgr.34427) 8737 : cluster [DBG] pgmap v4980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:45.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:44 gibba013 bash[29418]: audit 2021-03-10T16:38:44.679172+0000 mon.a (mon.0) 3192 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:38:45.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:44 gibba013 bash[30381]: cluster 2021-03-10T16:38:43.666746+0000 mgr.gibba020.yqfnwy (mgr.34427) 8737 : cluster [DBG] pgmap v4980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:45.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:44 gibba013 bash[30381]: audit 2021-03-10T16:38:44.679172+0000 mon.a (mon.0) 3192 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:38:45.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:44 gibba020 bash[25448]: cluster 2021-03-10T16:38:43.666746+0000 mgr.gibba020.yqfnwy (mgr.34427) 8737 : cluster [DBG] pgmap v4980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:45.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:44 gibba020 bash[25448]: audit 2021-03-10T16:38:44.679172+0000 mon.a (mon.0) 3192 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:38:45.906 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[29418]: cephadm 2021-03-10T16:38:44.684444+0000 mgr.gibba020.yqfnwy (mgr.34427) 8738 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:38:45.906 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[29418]: cephadm 2021-03-10T16:38:44.686047+0000 mgr.gibba020.yqfnwy (mgr.34427) 8739 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:38:45.907 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[29418]: audit 2021-03-10T16:38:44.900126+0000 mon.a (mon.0) 3193 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:38:45.907 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[29418]: cephadm 2021-03-10T16:38:44.902329+0000 mgr.gibba020.yqfnwy (mgr.34427) 8740 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:38:45.907 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[29418]: audit 2021-03-10T16:38:44.903578+0000 mon.a (mon.0) 3194 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:38:45.907 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[29418]: cephadm 2021-03-10T16:38:44.904284+0000 mgr.gibba020.yqfnwy (mgr.34427) 8741 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:38:45.908 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[29418]: audit 2021-03-10T16:38:44.905169+0000 mon.a (mon.0) 3195 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:45.908 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[29418]: cephadm 2021-03-10T16:38:44.905589+0000 mgr.gibba020.yqfnwy (mgr.34427) 8742 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:38:45.908 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[29418]: cephadm 2021-03-10T16:38:44.905624+0000 mgr.gibba020.yqfnwy (mgr.34427) 8743 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:38:45.908 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[29418]: audit 2021-03-10T16:38:44.906355+0000 mon.a (mon.0) 3196 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:45.909 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[29418]: cephadm 2021-03-10T16:38:44.906722+0000 mgr.gibba020.yqfnwy (mgr.34427) 8744 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:38:45.909 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[29418]: cephadm 2021-03-10T16:38:44.906760+0000 mgr.gibba020.yqfnwy (mgr.34427) 8745 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:38:45.909 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[29418]: audit 2021-03-10T16:38:44.907575+0000 mon.a (mon.0) 3197 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:45.909 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[29418]: cephadm 2021-03-10T16:38:44.907919+0000 mgr.gibba020.yqfnwy (mgr.34427) 8746 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:38:45.910 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[29418]: cephadm 2021-03-10T16:38:44.909277+0000 mgr.gibba020.yqfnwy (mgr.34427) 8747 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:38:45.910 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[29418]: cephadm 2021-03-10T16:38:44.909312+0000 mgr.gibba020.yqfnwy (mgr.34427) 8748 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:38:45.910 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[29418]: audit 2021-03-10T16:38:44.910208+0000 mon.a (mon.0) 3198 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:45.910 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[29418]: cephadm 2021-03-10T16:38:44.910601+0000 mgr.gibba020.yqfnwy (mgr.34427) 8749 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:38:45.911 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[29418]: cephadm 2021-03-10T16:38:44.910911+0000 mgr.gibba020.yqfnwy (mgr.34427) 8750 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:38:46.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:45 gibba020 bash[25448]: cephadm 2021-03-10T16:38:44.684444+0000 mgr.gibba020.yqfnwy (mgr.34427) 8738 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:38:46.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:45 gibba020 bash[25448]: cephadm 2021-03-10T16:38:44.686047+0000 mgr.gibba020.yqfnwy (mgr.34427) 8739 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:38:46.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:45 gibba020 bash[25448]: audit 2021-03-10T16:38:44.900126+0000 mon.a (mon.0) 3193 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:38:46.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:45 gibba020 bash[25448]: cephadm 2021-03-10T16:38:44.902329+0000 mgr.gibba020.yqfnwy (mgr.34427) 8740 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:38:46.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:45 gibba020 bash[25448]: audit 2021-03-10T16:38:44.903578+0000 mon.a (mon.0) 3194 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:38:46.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:45 gibba020 bash[25448]: cephadm 2021-03-10T16:38:44.904284+0000 mgr.gibba020.yqfnwy (mgr.34427) 8741 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:38:46.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:45 gibba020 bash[25448]: audit 2021-03-10T16:38:44.905169+0000 mon.a (mon.0) 3195 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:46.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:45 gibba020 bash[25448]: cephadm 2021-03-10T16:38:44.905589+0000 mgr.gibba020.yqfnwy (mgr.34427) 8742 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:38:46.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:45 gibba020 bash[25448]: cephadm 2021-03-10T16:38:44.905624+0000 mgr.gibba020.yqfnwy (mgr.34427) 8743 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:38:46.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:45 gibba020 bash[25448]: audit 2021-03-10T16:38:44.906355+0000 mon.a (mon.0) 3196 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:46.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:45 gibba020 bash[25448]: cephadm 2021-03-10T16:38:44.906722+0000 mgr.gibba020.yqfnwy (mgr.34427) 8744 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:38:46.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:45 gibba020 bash[25448]: cephadm 2021-03-10T16:38:44.906760+0000 mgr.gibba020.yqfnwy (mgr.34427) 8745 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:38:46.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:45 gibba020 bash[25448]: audit 2021-03-10T16:38:44.907575+0000 mon.a (mon.0) 3197 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:46.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:45 gibba020 bash[25448]: cephadm 2021-03-10T16:38:44.907919+0000 mgr.gibba020.yqfnwy (mgr.34427) 8746 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:38:46.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:45 gibba020 bash[25448]: cephadm 2021-03-10T16:38:44.909277+0000 mgr.gibba020.yqfnwy (mgr.34427) 8747 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:38:46.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:45 gibba020 bash[25448]: cephadm 2021-03-10T16:38:44.909312+0000 mgr.gibba020.yqfnwy (mgr.34427) 8748 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:38:46.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:45 gibba020 bash[25448]: audit 2021-03-10T16:38:44.910208+0000 mon.a (mon.0) 3198 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:46.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:45 gibba020 bash[25448]: cephadm 2021-03-10T16:38:44.910601+0000 mgr.gibba020.yqfnwy (mgr.34427) 8749 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:38:46.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:45 gibba020 bash[25448]: cephadm 2021-03-10T16:38:44.910911+0000 mgr.gibba020.yqfnwy (mgr.34427) 8750 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:38:46.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:45 gibba020 bash[25448]: audit 2021-03-10T16:38:44.911732+0000 mon.a (mon.0) 3199 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:46.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:45 gibba020 bash[25448]: cephadm 2021-03-10T16:38:44.912686+0000 mgr.gibba020.yqfnwy (mgr.34427) 8751 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:38:46.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:45 gibba020 bash[25448]: cephadm 2021-03-10T16:38:44.912723+0000 mgr.gibba020.yqfnwy (mgr.34427) 8752 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:38:46.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:45 gibba020 bash[25448]: cephadm 2021-03-10T16:38:44.912825+0000 mgr.gibba020.yqfnwy (mgr.34427) 8753 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:38:46.202 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:38:46.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[29418]: audit 2021-03-10T16:38:44.911732+0000 mon.a (mon.0) 3199 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:46.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[29418]: cephadm 2021-03-10T16:38:44.912686+0000 mgr.gibba020.yqfnwy (mgr.34427) 8751 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:38:46.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[29418]: cephadm 2021-03-10T16:38:44.912723+0000 mgr.gibba020.yqfnwy (mgr.34427) 8752 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:38:46.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[29418]: cephadm 2021-03-10T16:38:44.912825+0000 mgr.gibba020.yqfnwy (mgr.34427) 8753 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:38:46.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[30381]: cephadm 2021-03-10T16:38:44.684444+0000 mgr.gibba020.yqfnwy (mgr.34427) 8738 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:38:46.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[30381]: cephadm 2021-03-10T16:38:44.686047+0000 mgr.gibba020.yqfnwy (mgr.34427) 8739 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:38:46.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[30381]: audit 2021-03-10T16:38:44.900126+0000 mon.a (mon.0) 3193 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:38:46.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[30381]: cephadm 2021-03-10T16:38:44.902329+0000 mgr.gibba020.yqfnwy (mgr.34427) 8740 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:38:46.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[30381]: audit 2021-03-10T16:38:44.903578+0000 mon.a (mon.0) 3194 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:38:46.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[30381]: cephadm 2021-03-10T16:38:44.904284+0000 mgr.gibba020.yqfnwy (mgr.34427) 8741 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:38:46.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[30381]: audit 2021-03-10T16:38:44.905169+0000 mon.a (mon.0) 3195 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:46.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[30381]: cephadm 2021-03-10T16:38:44.905589+0000 mgr.gibba020.yqfnwy (mgr.34427) 8742 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:38:46.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[30381]: cephadm 2021-03-10T16:38:44.905624+0000 mgr.gibba020.yqfnwy (mgr.34427) 8743 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:38:46.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[30381]: audit 2021-03-10T16:38:44.906355+0000 mon.a (mon.0) 3196 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:46.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[30381]: cephadm 2021-03-10T16:38:44.906722+0000 mgr.gibba020.yqfnwy (mgr.34427) 8744 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:38:46.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[30381]: cephadm 2021-03-10T16:38:44.906760+0000 mgr.gibba020.yqfnwy (mgr.34427) 8745 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:38:46.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[30381]: audit 2021-03-10T16:38:44.907575+0000 mon.a (mon.0) 3197 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:46.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[30381]: cephadm 2021-03-10T16:38:44.907919+0000 mgr.gibba020.yqfnwy (mgr.34427) 8746 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:38:46.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[30381]: cephadm 2021-03-10T16:38:44.909277+0000 mgr.gibba020.yqfnwy (mgr.34427) 8747 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:38:46.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[30381]: cephadm 2021-03-10T16:38:44.909312+0000 mgr.gibba020.yqfnwy (mgr.34427) 8748 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:38:46.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[30381]: audit 2021-03-10T16:38:44.910208+0000 mon.a (mon.0) 3198 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:46.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[30381]: cephadm 2021-03-10T16:38:44.910601+0000 mgr.gibba020.yqfnwy (mgr.34427) 8749 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:38:46.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[30381]: cephadm 2021-03-10T16:38:44.910911+0000 mgr.gibba020.yqfnwy (mgr.34427) 8750 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:38:46.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[30381]: audit 2021-03-10T16:38:44.911732+0000 mon.a (mon.0) 3199 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:46.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[30381]: cephadm 2021-03-10T16:38:44.912686+0000 mgr.gibba020.yqfnwy (mgr.34427) 8751 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:38:46.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[30381]: cephadm 2021-03-10T16:38:44.912723+0000 mgr.gibba020.yqfnwy (mgr.34427) 8752 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:38:46.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:45 gibba013 bash[30381]: cephadm 2021-03-10T16:38:44.912825+0000 mgr.gibba020.yqfnwy (mgr.34427) 8753 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:38:46.429 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:38:46.429 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 8m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:38:46.429 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 7m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:38:46.429 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:38:46.430 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:38:46.430 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:38:46.430 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:38:46.430 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:38:46.431 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:38:46.431 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:38:46.431 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:38:46.431 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:38:46.431 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:38:46.432 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:38:46.432 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:38:46.432 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:38:46.432 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:38:46.433 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:38:46.433 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:38:46.433 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 7m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:38:46.433 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 7m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:38:46.686 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:38:46.686 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:38:46.686 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:38:46.687 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:38:46.687 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:38:46.687 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:38:46.687 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:38:46.687 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:38:46.688 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:38:46.688 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:38:46.688 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:38:46.688 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:38:46.689 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:38:46.689 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:38:46.689 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:38:47.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:46 gibba020 bash[25448]: cluster 2021-03-10T16:38:45.668236+0000 mgr.gibba020.yqfnwy (mgr.34427) 8754 : cluster [DBG] pgmap v4981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:47.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:46 gibba020 bash[25448]: audit 2021-03-10T16:38:46.687580+0000 mon.a (mon.0) 3200 : audit [DBG] from='client.? 172.21.2.113:0/2079913246' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:47.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:46 gibba013 bash[29418]: cluster 2021-03-10T16:38:45.668236+0000 mgr.gibba020.yqfnwy (mgr.34427) 8754 : cluster [DBG] pgmap v4981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:47.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:46 gibba013 bash[29418]: audit 2021-03-10T16:38:46.687580+0000 mon.a (mon.0) 3200 : audit [DBG] from='client.? 172.21.2.113:0/2079913246' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:47.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:46 gibba013 bash[30381]: cluster 2021-03-10T16:38:45.668236+0000 mgr.gibba020.yqfnwy (mgr.34427) 8754 : cluster [DBG] pgmap v4981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:47.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:46 gibba013 bash[30381]: audit 2021-03-10T16:38:46.687580+0000 mon.a (mon.0) 3200 : audit [DBG] from='client.? 172.21.2.113:0/2079913246' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:38:48.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:47 gibba020 bash[25448]: audit 2021-03-10T16:38:46.193893+0000 mgr.gibba020.yqfnwy (mgr.34427) 8755 : audit [DBG] from='client.49920 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:38:48.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:47 gibba020 bash[25448]: audit 2021-03-10T16:38:46.419176+0000 mgr.gibba020.yqfnwy (mgr.34427) 8756 : audit [DBG] from='client.49926 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:38:48.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:47 gibba013 bash[29418]: audit 2021-03-10T16:38:46.193893+0000 mgr.gibba020.yqfnwy (mgr.34427) 8755 : audit [DBG] from='client.49920 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:38:48.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:47 gibba013 bash[29418]: audit 2021-03-10T16:38:46.419176+0000 mgr.gibba020.yqfnwy (mgr.34427) 8756 : audit [DBG] from='client.49926 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:38:48.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:47 gibba013 bash[30381]: audit 2021-03-10T16:38:46.193893+0000 mgr.gibba020.yqfnwy (mgr.34427) 8755 : audit [DBG] from='client.49920 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:38:48.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:47 gibba013 bash[30381]: audit 2021-03-10T16:38:46.419176+0000 mgr.gibba020.yqfnwy (mgr.34427) 8756 : audit [DBG] from='client.49926 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:38:49.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:48 gibba020 bash[25448]: cluster 2021-03-10T16:38:47.669549+0000 mgr.gibba020.yqfnwy (mgr.34427) 8757 : cluster [DBG] pgmap v4982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:49.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:48 gibba013 bash[29418]: cluster 2021-03-10T16:38:47.669549+0000 mgr.gibba020.yqfnwy (mgr.34427) 8757 : cluster [DBG] pgmap v4982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:49.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:48 gibba013 bash[30381]: cluster 2021-03-10T16:38:47.669549+0000 mgr.gibba020.yqfnwy (mgr.34427) 8757 : cluster [DBG] pgmap v4982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:50.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:50 gibba013 bash[29418]: cluster 2021-03-10T16:38:49.671101+0000 mgr.gibba020.yqfnwy (mgr.34427) 8758 : cluster [DBG] pgmap v4983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:50.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:50 gibba013 bash[30381]: cluster 2021-03-10T16:38:49.671101+0000 mgr.gibba020.yqfnwy (mgr.34427) 8758 : cluster [DBG] pgmap v4983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:50.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:50 gibba020 bash[25448]: cluster 2021-03-10T16:38:49.671101+0000 mgr.gibba020.yqfnwy (mgr.34427) 8758 : cluster [DBG] pgmap v4983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:53.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:52 gibba013 bash[29418]: cluster 2021-03-10T16:38:51.672638+0000 mgr.gibba020.yqfnwy (mgr.34427) 8759 : cluster [DBG] pgmap v4984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:53.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:52 gibba013 bash[30381]: cluster 2021-03-10T16:38:51.672638+0000 mgr.gibba020.yqfnwy (mgr.34427) 8759 : cluster [DBG] pgmap v4984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:53.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:52 gibba020 bash[25448]: cluster 2021-03-10T16:38:51.672638+0000 mgr.gibba020.yqfnwy (mgr.34427) 8759 : cluster [DBG] pgmap v4984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:55.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:54 gibba013 bash[29418]: cluster 2021-03-10T16:38:53.674046+0000 mgr.gibba020.yqfnwy (mgr.34427) 8760 : cluster [DBG] pgmap v4985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:55.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:54 gibba013 bash[30381]: cluster 2021-03-10T16:38:53.674046+0000 mgr.gibba020.yqfnwy (mgr.34427) 8760 : cluster [DBG] pgmap v4985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:55.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:54 gibba020 bash[25448]: cluster 2021-03-10T16:38:53.674046+0000 mgr.gibba020.yqfnwy (mgr.34427) 8760 : cluster [DBG] pgmap v4985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:57.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:56 gibba013 bash[29418]: cluster 2021-03-10T16:38:55.675644+0000 mgr.gibba020.yqfnwy (mgr.34427) 8761 : cluster [DBG] pgmap v4986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:57.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:56 gibba013 bash[30381]: cluster 2021-03-10T16:38:55.675644+0000 mgr.gibba020.yqfnwy (mgr.34427) 8761 : cluster [DBG] pgmap v4986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:57.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:56 gibba020 bash[25448]: cluster 2021-03-10T16:38:55.675644+0000 mgr.gibba020.yqfnwy (mgr.34427) 8761 : cluster [DBG] pgmap v4986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:59.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:38:58 gibba013 bash[29418]: cluster 2021-03-10T16:38:57.677062+0000 mgr.gibba020.yqfnwy (mgr.34427) 8762 : cluster [DBG] pgmap v4987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:59.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:38:58 gibba013 bash[30381]: cluster 2021-03-10T16:38:57.677062+0000 mgr.gibba020.yqfnwy (mgr.34427) 8762 : cluster [DBG] pgmap v4987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:38:59.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:38:58 gibba020 bash[25448]: cluster 2021-03-10T16:38:57.677062+0000 mgr.gibba020.yqfnwy (mgr.34427) 8762 : cluster [DBG] pgmap v4987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:00.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:00 gibba013 bash[29418]: cluster 2021-03-10T16:38:59.678426+0000 mgr.gibba020.yqfnwy (mgr.34427) 8763 : cluster [DBG] pgmap v4988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:00.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:00 gibba013 bash[29418]: cephadm 2021-03-10T16:38:59.928837+0000 mgr.gibba020.yqfnwy (mgr.34427) 8764 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:39:00.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:00 gibba013 bash[30381]: cluster 2021-03-10T16:38:59.678426+0000 mgr.gibba020.yqfnwy (mgr.34427) 8763 : cluster [DBG] pgmap v4988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:00.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:00 gibba013 bash[30381]: cephadm 2021-03-10T16:38:59.928837+0000 mgr.gibba020.yqfnwy (mgr.34427) 8764 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:39:00.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:00 gibba020 bash[25448]: cluster 2021-03-10T16:38:59.678426+0000 mgr.gibba020.yqfnwy (mgr.34427) 8763 : cluster [DBG] pgmap v4988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:00.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:00 gibba020 bash[25448]: cephadm 2021-03-10T16:38:59.928837+0000 mgr.gibba020.yqfnwy (mgr.34427) 8764 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:39:03.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:02 gibba013 bash[29418]: cluster 2021-03-10T16:39:01.680118+0000 mgr.gibba020.yqfnwy (mgr.34427) 8765 : cluster [DBG] pgmap v4989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:03.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:02 gibba013 bash[30381]: cluster 2021-03-10T16:39:01.680118+0000 mgr.gibba020.yqfnwy (mgr.34427) 8765 : cluster [DBG] pgmap v4989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:03.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:02 gibba020 bash[25448]: cluster 2021-03-10T16:39:01.680118+0000 mgr.gibba020.yqfnwy (mgr.34427) 8765 : cluster [DBG] pgmap v4989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:05.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:04 gibba013 bash[29418]: cluster 2021-03-10T16:39:03.681520+0000 mgr.gibba020.yqfnwy (mgr.34427) 8766 : cluster [DBG] pgmap v4990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:05.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:04 gibba013 bash[30381]: cluster 2021-03-10T16:39:03.681520+0000 mgr.gibba020.yqfnwy (mgr.34427) 8766 : cluster [DBG] pgmap v4990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:05.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:04 gibba020 bash[25448]: cluster 2021-03-10T16:39:03.681520+0000 mgr.gibba020.yqfnwy (mgr.34427) 8766 : cluster [DBG] pgmap v4990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:07.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:06 gibba013 bash[29418]: cluster 2021-03-10T16:39:05.683145+0000 mgr.gibba020.yqfnwy (mgr.34427) 8767 : cluster [DBG] pgmap v4991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:07.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:06 gibba013 bash[30381]: cluster 2021-03-10T16:39:05.683145+0000 mgr.gibba020.yqfnwy (mgr.34427) 8767 : cluster [DBG] pgmap v4991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:07.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:06 gibba020 bash[25448]: cluster 2021-03-10T16:39:05.683145+0000 mgr.gibba020.yqfnwy (mgr.34427) 8767 : cluster [DBG] pgmap v4991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:08.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:07 gibba013 bash[29418]: audit 2021-03-10T16:39:06.756852+0000 mon.a (mon.0) 3201 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:39:08.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:07 gibba013 bash[29418]: audit 2021-03-10T16:39:06.923361+0000 mon.a (mon.0) 3202 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:39:08.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:07 gibba013 bash[29418]: audit 2021-03-10T16:39:07.254084+0000 mon.a (mon.0) 3203 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:39:08.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:07 gibba013 bash[29418]: audit 2021-03-10T16:39:07.254878+0000 mon.a (mon.0) 3204 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:39:08.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:07 gibba013 bash[29418]: audit 2021-03-10T16:39:07.255618+0000 mon.a (mon.0) 3205 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:39:08.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:07 gibba013 bash[29418]: audit 2021-03-10T16:39:07.256310+0000 mon.a (mon.0) 3206 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:39:08.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:07 gibba013 bash[30381]: audit 2021-03-10T16:39:06.756852+0000 mon.a (mon.0) 3201 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:39:08.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:07 gibba013 bash[30381]: audit 2021-03-10T16:39:06.923361+0000 mon.a (mon.0) 3202 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:39:08.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:07 gibba013 bash[30381]: audit 2021-03-10T16:39:07.254084+0000 mon.a (mon.0) 3203 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:39:08.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:07 gibba013 bash[30381]: audit 2021-03-10T16:39:07.254878+0000 mon.a (mon.0) 3204 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:39:08.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:07 gibba013 bash[30381]: audit 2021-03-10T16:39:07.255618+0000 mon.a (mon.0) 3205 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:39:08.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:07 gibba013 bash[30381]: audit 2021-03-10T16:39:07.256310+0000 mon.a (mon.0) 3206 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:39:08.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:07 gibba020 bash[25448]: audit 2021-03-10T16:39:06.756852+0000 mon.a (mon.0) 3201 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:39:08.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:07 gibba020 bash[25448]: audit 2021-03-10T16:39:06.923361+0000 mon.a (mon.0) 3202 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:39:08.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:07 gibba020 bash[25448]: audit 2021-03-10T16:39:07.254084+0000 mon.a (mon.0) 3203 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T16:39:08.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:07 gibba020 bash[25448]: audit 2021-03-10T16:39:07.254878+0000 mon.a (mon.0) 3204 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:39:08.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:07 gibba020 bash[25448]: audit 2021-03-10T16:39:07.255618+0000 mon.a (mon.0) 3205 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:39:08.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:07 gibba020 bash[25448]: audit 2021-03-10T16:39:07.256310+0000 mon.a (mon.0) 3206 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:39:09.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:08 gibba013 bash[29418]: cluster 2021-03-10T16:39:07.684790+0000 mgr.gibba020.yqfnwy (mgr.34427) 8768 : cluster [DBG] pgmap v4992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:09.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:08 gibba013 bash[30381]: cluster 2021-03-10T16:39:07.684790+0000 mgr.gibba020.yqfnwy (mgr.34427) 8768 : cluster [DBG] pgmap v4992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:09.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:08 gibba020 bash[25448]: cluster 2021-03-10T16:39:07.684790+0000 mgr.gibba020.yqfnwy (mgr.34427) 8768 : cluster [DBG] pgmap v4992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:10.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:10 gibba013 bash[29418]: cluster 2021-03-10T16:39:09.686406+0000 mgr.gibba020.yqfnwy (mgr.34427) 8769 : cluster [DBG] pgmap v4993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:10.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:10 gibba013 bash[30381]: cluster 2021-03-10T16:39:09.686406+0000 mgr.gibba020.yqfnwy (mgr.34427) 8769 : cluster [DBG] pgmap v4993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:10.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:10 gibba020 bash[25448]: cluster 2021-03-10T16:39:09.686406+0000 mgr.gibba020.yqfnwy (mgr.34427) 8769 : cluster [DBG] pgmap v4993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:13.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:12 gibba013 bash[29418]: cluster 2021-03-10T16:39:11.687433+0000 mgr.gibba020.yqfnwy (mgr.34427) 8770 : cluster [DBG] pgmap v4994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:13.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:12 gibba013 bash[30381]: cluster 2021-03-10T16:39:11.687433+0000 mgr.gibba020.yqfnwy (mgr.34427) 8770 : cluster [DBG] pgmap v4994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:13.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:12 gibba020 bash[25448]: cluster 2021-03-10T16:39:11.687433+0000 mgr.gibba020.yqfnwy (mgr.34427) 8770 : cluster [DBG] pgmap v4994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:15.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:14 gibba013 bash[29418]: cluster 2021-03-10T16:39:13.688785+0000 mgr.gibba020.yqfnwy (mgr.34427) 8771 : cluster [DBG] pgmap v4995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:15.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:14 gibba013 bash[30381]: cluster 2021-03-10T16:39:13.688785+0000 mgr.gibba020.yqfnwy (mgr.34427) 8771 : cluster [DBG] pgmap v4995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:15.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:14 gibba020 bash[25448]: cluster 2021-03-10T16:39:13.688785+0000 mgr.gibba020.yqfnwy (mgr.34427) 8771 : cluster [DBG] pgmap v4995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:16.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:15 gibba013 bash[29418]: cephadm 2021-03-10T16:39:14.944776+0000 mgr.gibba020.yqfnwy (mgr.34427) 8772 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:39:16.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:15 gibba013 bash[30381]: cephadm 2021-03-10T16:39:14.944776+0000 mgr.gibba020.yqfnwy (mgr.34427) 8772 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:39:16.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:15 gibba020 bash[25448]: cephadm 2021-03-10T16:39:14.944776+0000 mgr.gibba020.yqfnwy (mgr.34427) 8772 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:39:16.933 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:39:17.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:16 gibba013 bash[29418]: cluster 2021-03-10T16:39:15.690217+0000 mgr.gibba020.yqfnwy (mgr.34427) 8773 : cluster [DBG] pgmap v4996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:17.127 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:16 gibba013 bash[30381]: cluster 2021-03-10T16:39:15.690217+0000 mgr.gibba020.yqfnwy (mgr.34427) 8773 : cluster [DBG] pgmap v4996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:17.158 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:39:17.158 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 8m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:39:17.158 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 7m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:39:17.159 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:39:17.159 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:39:17.159 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:39:17.159 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:39:17.160 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:39:17.160 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:39:17.160 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:39:17.160 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 7m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:39:17.161 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:39:17.161 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:39:17.161 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:39:17.161 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:39:17.161 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:39:17.162 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:39:17.162 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:39:17.162 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 7m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:39:17.162 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 7m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:39:17.163 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 7m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:39:17.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:16 gibba020 bash[25448]: cluster 2021-03-10T16:39:15.690217+0000 mgr.gibba020.yqfnwy (mgr.34427) 8773 : cluster [DBG] pgmap v4996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:17.407 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:39:17.408 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:39:17.408 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:39:17.408 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:39:17.408 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:39:17.409 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:39:17.409 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:39:17.409 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:39:17.409 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:39:17.410 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:39:17.410 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:39:17.410 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:39:17.410 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:39:17.411 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:39:17.411 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:39:18.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:17 gibba013 bash[29418]: audit 2021-03-10T16:39:16.926344+0000 mgr.gibba020.yqfnwy (mgr.34427) 8774 : audit [DBG] from='client.49938 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:39:18.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:17 gibba013 bash[29418]: audit 2021-03-10T16:39:17.409080+0000 mon.a (mon.0) 3207 : audit [DBG] from='client.? 172.21.2.113:0/2633872331' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:18.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:17 gibba013 bash[30381]: audit 2021-03-10T16:39:16.926344+0000 mgr.gibba020.yqfnwy (mgr.34427) 8774 : audit [DBG] from='client.49938 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:39:18.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:17 gibba013 bash[30381]: audit 2021-03-10T16:39:17.409080+0000 mon.a (mon.0) 3207 : audit [DBG] from='client.? 172.21.2.113:0/2633872331' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:18.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:17 gibba020 bash[25448]: audit 2021-03-10T16:39:16.926344+0000 mgr.gibba020.yqfnwy (mgr.34427) 8774 : audit [DBG] from='client.49938 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:39:18.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:17 gibba020 bash[25448]: audit 2021-03-10T16:39:17.409080+0000 mon.a (mon.0) 3207 : audit [DBG] from='client.? 172.21.2.113:0/2633872331' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:19.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:18 gibba013 bash[29418]: audit 2021-03-10T16:39:17.150650+0000 mgr.gibba020.yqfnwy (mgr.34427) 8775 : audit [DBG] from='client.49944 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:39:19.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:18 gibba013 bash[29418]: cluster 2021-03-10T16:39:17.691764+0000 mgr.gibba020.yqfnwy (mgr.34427) 8776 : cluster [DBG] pgmap v4997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:19.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:18 gibba013 bash[30381]: audit 2021-03-10T16:39:17.150650+0000 mgr.gibba020.yqfnwy (mgr.34427) 8775 : audit [DBG] from='client.49944 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:39:19.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:18 gibba013 bash[30381]: cluster 2021-03-10T16:39:17.691764+0000 mgr.gibba020.yqfnwy (mgr.34427) 8776 : cluster [DBG] pgmap v4997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:19.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:18 gibba020 bash[25448]: audit 2021-03-10T16:39:17.150650+0000 mgr.gibba020.yqfnwy (mgr.34427) 8775 : audit [DBG] from='client.49944 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:39:19.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:18 gibba020 bash[25448]: cluster 2021-03-10T16:39:17.691764+0000 mgr.gibba020.yqfnwy (mgr.34427) 8776 : cluster [DBG] pgmap v4997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:20.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:20 gibba013 bash[29418]: cluster 2021-03-10T16:39:19.693398+0000 mgr.gibba020.yqfnwy (mgr.34427) 8777 : cluster [DBG] pgmap v4998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:20.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:20 gibba013 bash[30381]: cluster 2021-03-10T16:39:19.693398+0000 mgr.gibba020.yqfnwy (mgr.34427) 8777 : cluster [DBG] pgmap v4998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:20.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:20 gibba020 bash[25448]: cluster 2021-03-10T16:39:19.693398+0000 mgr.gibba020.yqfnwy (mgr.34427) 8777 : cluster [DBG] pgmap v4998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:23.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:22 gibba013 bash[29418]: cluster 2021-03-10T16:39:21.694577+0000 mgr.gibba020.yqfnwy (mgr.34427) 8778 : cluster [DBG] pgmap v4999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:23.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:22 gibba013 bash[30381]: cluster 2021-03-10T16:39:21.694577+0000 mgr.gibba020.yqfnwy (mgr.34427) 8778 : cluster [DBG] pgmap v4999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:23.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:22 gibba020 bash[25448]: cluster 2021-03-10T16:39:21.694577+0000 mgr.gibba020.yqfnwy (mgr.34427) 8778 : cluster [DBG] pgmap v4999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:25.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:24 gibba013 bash[29418]: cluster 2021-03-10T16:39:23.696107+0000 mgr.gibba020.yqfnwy (mgr.34427) 8779 : cluster [DBG] pgmap v5000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:25.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:24 gibba013 bash[30381]: cluster 2021-03-10T16:39:23.696107+0000 mgr.gibba020.yqfnwy (mgr.34427) 8779 : cluster [DBG] pgmap v5000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:25.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:24 gibba020 bash[25448]: cluster 2021-03-10T16:39:23.696107+0000 mgr.gibba020.yqfnwy (mgr.34427) 8779 : cluster [DBG] pgmap v5000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:27.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:26 gibba013 bash[29418]: cluster 2021-03-10T16:39:25.697568+0000 mgr.gibba020.yqfnwy (mgr.34427) 8780 : cluster [DBG] pgmap v5001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:27.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:26 gibba013 bash[30381]: cluster 2021-03-10T16:39:25.697568+0000 mgr.gibba020.yqfnwy (mgr.34427) 8780 : cluster [DBG] pgmap v5001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:27.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:26 gibba020 bash[25448]: cluster 2021-03-10T16:39:25.697568+0000 mgr.gibba020.yqfnwy (mgr.34427) 8780 : cluster [DBG] pgmap v5001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:29.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:28 gibba013 bash[29418]: cluster 2021-03-10T16:39:27.699183+0000 mgr.gibba020.yqfnwy (mgr.34427) 8781 : cluster [DBG] pgmap v5002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:29.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:28 gibba013 bash[30381]: cluster 2021-03-10T16:39:27.699183+0000 mgr.gibba020.yqfnwy (mgr.34427) 8781 : cluster [DBG] pgmap v5002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:29.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:28 gibba020 bash[25448]: cluster 2021-03-10T16:39:27.699183+0000 mgr.gibba020.yqfnwy (mgr.34427) 8781 : cluster [DBG] pgmap v5002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:30.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:30 gibba013 bash[29418]: cluster 2021-03-10T16:39:29.700895+0000 mgr.gibba020.yqfnwy (mgr.34427) 8782 : cluster [DBG] pgmap v5003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:30.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:30 gibba013 bash[30381]: cluster 2021-03-10T16:39:29.700895+0000 mgr.gibba020.yqfnwy (mgr.34427) 8782 : cluster [DBG] pgmap v5003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:30.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:30 gibba020 bash[25448]: cluster 2021-03-10T16:39:29.700895+0000 mgr.gibba020.yqfnwy (mgr.34427) 8782 : cluster [DBG] pgmap v5003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:31.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:31 gibba013 bash[29418]: cephadm 2021-03-10T16:39:29.960605+0000 mgr.gibba020.yqfnwy (mgr.34427) 8783 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:39:31.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:31 gibba013 bash[30381]: cephadm 2021-03-10T16:39:29.960605+0000 mgr.gibba020.yqfnwy (mgr.34427) 8783 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:39:31.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:31 gibba020 bash[25448]: cephadm 2021-03-10T16:39:29.960605+0000 mgr.gibba020.yqfnwy (mgr.34427) 8783 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:39:32.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:32 gibba013 bash[29418]: cluster 2021-03-10T16:39:31.702452+0000 mgr.gibba020.yqfnwy (mgr.34427) 8784 : cluster [DBG] pgmap v5004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:32.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:32 gibba013 bash[30381]: cluster 2021-03-10T16:39:31.702452+0000 mgr.gibba020.yqfnwy (mgr.34427) 8784 : cluster [DBG] pgmap v5004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:32.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:32 gibba020 bash[25448]: cluster 2021-03-10T16:39:31.702452+0000 mgr.gibba020.yqfnwy (mgr.34427) 8784 : cluster [DBG] pgmap v5004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:35.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:34 gibba013 bash[29418]: cluster 2021-03-10T16:39:33.703885+0000 mgr.gibba020.yqfnwy (mgr.34427) 8785 : cluster [DBG] pgmap v5005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:35.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:34 gibba013 bash[30381]: cluster 2021-03-10T16:39:33.703885+0000 mgr.gibba020.yqfnwy (mgr.34427) 8785 : cluster [DBG] pgmap v5005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:35.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:34 gibba020 bash[25448]: cluster 2021-03-10T16:39:33.703885+0000 mgr.gibba020.yqfnwy (mgr.34427) 8785 : cluster [DBG] pgmap v5005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:37.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:36 gibba013 bash[29418]: cluster 2021-03-10T16:39:35.705362+0000 mgr.gibba020.yqfnwy (mgr.34427) 8786 : cluster [DBG] pgmap v5006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:37.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:36 gibba013 bash[30381]: cluster 2021-03-10T16:39:35.705362+0000 mgr.gibba020.yqfnwy (mgr.34427) 8786 : cluster [DBG] pgmap v5006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:37.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:36 gibba020 bash[25448]: cluster 2021-03-10T16:39:35.705362+0000 mgr.gibba020.yqfnwy (mgr.34427) 8786 : cluster [DBG] pgmap v5006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:39.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:38 gibba013 bash[29418]: cluster 2021-03-10T16:39:37.706970+0000 mgr.gibba020.yqfnwy (mgr.34427) 8787 : cluster [DBG] pgmap v5007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:39.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:38 gibba013 bash[30381]: cluster 2021-03-10T16:39:37.706970+0000 mgr.gibba020.yqfnwy (mgr.34427) 8787 : cluster [DBG] pgmap v5007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:39.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:38 gibba020 bash[25448]: cluster 2021-03-10T16:39:37.706970+0000 mgr.gibba020.yqfnwy (mgr.34427) 8787 : cluster [DBG] pgmap v5007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:40.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:40 gibba013 bash[29418]: cluster 2021-03-10T16:39:39.708523+0000 mgr.gibba020.yqfnwy (mgr.34427) 8788 : cluster [DBG] pgmap v5008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:40.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:40 gibba013 bash[30381]: cluster 2021-03-10T16:39:39.708523+0000 mgr.gibba020.yqfnwy (mgr.34427) 8788 : cluster [DBG] pgmap v5008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:40.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:40 gibba020 bash[25448]: cluster 2021-03-10T16:39:39.708523+0000 mgr.gibba020.yqfnwy (mgr.34427) 8788 : cluster [DBG] pgmap v5008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:43.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:42 gibba013 bash[29418]: cluster 2021-03-10T16:39:41.710053+0000 mgr.gibba020.yqfnwy (mgr.34427) 8789 : cluster [DBG] pgmap v5009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:43.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:42 gibba013 bash[30381]: cluster 2021-03-10T16:39:41.710053+0000 mgr.gibba020.yqfnwy (mgr.34427) 8789 : cluster [DBG] pgmap v5009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:43.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:42 gibba020 bash[25448]: cluster 2021-03-10T16:39:41.710053+0000 mgr.gibba020.yqfnwy (mgr.34427) 8789 : cluster [DBG] pgmap v5009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:45.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:44 gibba013 bash[29418]: cluster 2021-03-10T16:39:43.711553+0000 mgr.gibba020.yqfnwy (mgr.34427) 8790 : cluster [DBG] pgmap v5010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:45.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:44 gibba013 bash[30381]: cluster 2021-03-10T16:39:43.711553+0000 mgr.gibba020.yqfnwy (mgr.34427) 8790 : cluster [DBG] pgmap v5010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:45.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:44 gibba020 bash[25448]: cluster 2021-03-10T16:39:43.711553+0000 mgr.gibba020.yqfnwy (mgr.34427) 8790 : cluster [DBG] pgmap v5010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:46.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:45 gibba013 bash[29418]: audit 2021-03-10T16:39:44.977785+0000 mon.a (mon.0) 3208 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:39:46.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:45 gibba013 bash[29418]: audit 2021-03-10T16:39:45.199045+0000 mon.a (mon.0) 3209 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:39:46.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:45 gibba013 bash[29418]: audit 2021-03-10T16:39:45.202353+0000 mon.a (mon.0) 3210 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:39:46.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:45 gibba013 bash[29418]: audit 2021-03-10T16:39:45.203986+0000 mon.a (mon.0) 3211 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:46.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:45 gibba013 bash[29418]: audit 2021-03-10T16:39:45.205577+0000 mon.a (mon.0) 3212 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:46.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:45 gibba013 bash[29418]: audit 2021-03-10T16:39:45.206883+0000 mon.a (mon.0) 3213 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:46.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:45 gibba013 bash[29418]: audit 2021-03-10T16:39:45.209681+0000 mon.a (mon.0) 3214 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:46.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:45 gibba013 bash[29418]: audit 2021-03-10T16:39:45.211211+0000 mon.a (mon.0) 3215 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:46.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:45 gibba013 bash[30381]: audit 2021-03-10T16:39:44.977785+0000 mon.a (mon.0) 3208 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:39:46.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:45 gibba013 bash[30381]: audit 2021-03-10T16:39:45.199045+0000 mon.a (mon.0) 3209 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:39:46.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:45 gibba013 bash[30381]: audit 2021-03-10T16:39:45.202353+0000 mon.a (mon.0) 3210 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:39:46.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:45 gibba013 bash[30381]: audit 2021-03-10T16:39:45.203986+0000 mon.a (mon.0) 3211 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:46.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:45 gibba013 bash[30381]: audit 2021-03-10T16:39:45.205577+0000 mon.a (mon.0) 3212 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:46.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:45 gibba013 bash[30381]: audit 2021-03-10T16:39:45.206883+0000 mon.a (mon.0) 3213 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:46.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:45 gibba013 bash[30381]: audit 2021-03-10T16:39:45.209681+0000 mon.a (mon.0) 3214 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:46.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:45 gibba013 bash[30381]: audit 2021-03-10T16:39:45.211211+0000 mon.a (mon.0) 3215 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:46.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:45 gibba020 bash[25448]: audit 2021-03-10T16:39:44.977785+0000 mon.a (mon.0) 3208 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:39:46.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:45 gibba020 bash[25448]: audit 2021-03-10T16:39:45.199045+0000 mon.a (mon.0) 3209 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:39:46.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:45 gibba020 bash[25448]: audit 2021-03-10T16:39:45.202353+0000 mon.a (mon.0) 3210 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:39:46.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:45 gibba020 bash[25448]: audit 2021-03-10T16:39:45.203986+0000 mon.a (mon.0) 3211 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:46.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:45 gibba020 bash[25448]: audit 2021-03-10T16:39:45.205577+0000 mon.a (mon.0) 3212 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:46.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:45 gibba020 bash[25448]: audit 2021-03-10T16:39:45.206883+0000 mon.a (mon.0) 3213 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:46.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:45 gibba020 bash[25448]: audit 2021-03-10T16:39:45.209681+0000 mon.a (mon.0) 3214 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:46.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:45 gibba020 bash[25448]: audit 2021-03-10T16:39:45.211211+0000 mon.a (mon.0) 3215 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:47.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:46 gibba013 bash[29418]: cephadm 2021-03-10T16:39:44.982699+0000 mgr.gibba020.yqfnwy (mgr.34427) 8791 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:39:47.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:46 gibba013 bash[29418]: cephadm 2021-03-10T16:39:44.984505+0000 mgr.gibba020.yqfnwy (mgr.34427) 8792 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:39:47.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:46 gibba013 bash[29418]: cephadm 2021-03-10T16:39:45.201091+0000 mgr.gibba020.yqfnwy (mgr.34427) 8793 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:39:47.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:46 gibba013 bash[29418]: cephadm 2021-03-10T16:39:45.203025+0000 mgr.gibba020.yqfnwy (mgr.34427) 8794 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:39:47.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:46 gibba013 bash[29418]: cephadm 2021-03-10T16:39:45.204580+0000 mgr.gibba020.yqfnwy (mgr.34427) 8795 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:39:47.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:46 gibba013 bash[29418]: cephadm 2021-03-10T16:39:45.204617+0000 mgr.gibba020.yqfnwy (mgr.34427) 8796 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:39:47.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:46 gibba013 bash[29418]: cephadm 2021-03-10T16:39:45.205947+0000 mgr.gibba020.yqfnwy (mgr.34427) 8797 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:39:47.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:46 gibba013 bash[29418]: cephadm 2021-03-10T16:39:45.205984+0000 mgr.gibba020.yqfnwy (mgr.34427) 8798 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:39:47.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:46 gibba013 bash[29418]: cephadm 2021-03-10T16:39:45.207323+0000 mgr.gibba020.yqfnwy (mgr.34427) 8799 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:39:47.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:46 gibba013 bash[29418]: cephadm 2021-03-10T16:39:45.208627+0000 mgr.gibba020.yqfnwy (mgr.34427) 8800 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:39:47.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:46 gibba013 bash[29418]: cephadm 2021-03-10T16:39:45.208662+0000 mgr.gibba020.yqfnwy (mgr.34427) 8801 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:39:47.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:46 gibba013 bash[29418]: cephadm 2021-03-10T16:39:45.210004+0000 mgr.gibba020.yqfnwy (mgr.34427) 8802 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:39:47.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:46 gibba013 bash[29418]: cephadm 2021-03-10T16:39:45.210325+0000 mgr.gibba020.yqfnwy (mgr.34427) 8803 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:39:47.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:46 gibba013 bash[29418]: cephadm 2021-03-10T16:39:45.211711+0000 mgr.gibba020.yqfnwy (mgr.34427) 8804 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:39:47.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:46 gibba013 bash[29418]: cephadm 2021-03-10T16:39:45.211747+0000 mgr.gibba020.yqfnwy (mgr.34427) 8805 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:39:47.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:46 gibba013 bash[29418]: cephadm 2021-03-10T16:39:45.211850+0000 mgr.gibba020.yqfnwy (mgr.34427) 8806 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:39:47.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:46 gibba013 bash[29418]: cluster 2021-03-10T16:39:45.713204+0000 mgr.gibba020.yqfnwy (mgr.34427) 8807 : cluster [DBG] pgmap v5011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:47.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:46 gibba013 bash[30381]: cephadm 2021-03-10T16:39:44.982699+0000 mgr.gibba020.yqfnwy (mgr.34427) 8791 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:39:47.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:46 gibba013 bash[30381]: cephadm 2021-03-10T16:39:44.984505+0000 mgr.gibba020.yqfnwy (mgr.34427) 8792 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:39:47.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:46 gibba013 bash[30381]: cephadm 2021-03-10T16:39:45.201091+0000 mgr.gibba020.yqfnwy (mgr.34427) 8793 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:39:47.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:46 gibba013 bash[30381]: cephadm 2021-03-10T16:39:45.203025+0000 mgr.gibba020.yqfnwy (mgr.34427) 8794 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:39:47.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:46 gibba013 bash[30381]: cephadm 2021-03-10T16:39:45.204580+0000 mgr.gibba020.yqfnwy (mgr.34427) 8795 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:39:47.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:46 gibba013 bash[30381]: cephadm 2021-03-10T16:39:45.204617+0000 mgr.gibba020.yqfnwy (mgr.34427) 8796 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:39:47.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:46 gibba013 bash[30381]: cephadm 2021-03-10T16:39:45.205947+0000 mgr.gibba020.yqfnwy (mgr.34427) 8797 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:39:47.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:46 gibba013 bash[30381]: cephadm 2021-03-10T16:39:45.205984+0000 mgr.gibba020.yqfnwy (mgr.34427) 8798 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:39:47.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:46 gibba013 bash[30381]: cephadm 2021-03-10T16:39:45.207323+0000 mgr.gibba020.yqfnwy (mgr.34427) 8799 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:39:47.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:46 gibba013 bash[30381]: cephadm 2021-03-10T16:39:45.208627+0000 mgr.gibba020.yqfnwy (mgr.34427) 8800 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:39:47.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:46 gibba013 bash[30381]: cephadm 2021-03-10T16:39:45.208662+0000 mgr.gibba020.yqfnwy (mgr.34427) 8801 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:39:47.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:46 gibba013 bash[30381]: cephadm 2021-03-10T16:39:45.210004+0000 mgr.gibba020.yqfnwy (mgr.34427) 8802 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:39:47.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:46 gibba013 bash[30381]: cephadm 2021-03-10T16:39:45.210325+0000 mgr.gibba020.yqfnwy (mgr.34427) 8803 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:39:47.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:46 gibba013 bash[30381]: cephadm 2021-03-10T16:39:45.211711+0000 mgr.gibba020.yqfnwy (mgr.34427) 8804 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:39:47.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:46 gibba013 bash[30381]: cephadm 2021-03-10T16:39:45.211747+0000 mgr.gibba020.yqfnwy (mgr.34427) 8805 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:39:47.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:46 gibba013 bash[30381]: cephadm 2021-03-10T16:39:45.211850+0000 mgr.gibba020.yqfnwy (mgr.34427) 8806 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:39:47.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:46 gibba013 bash[30381]: cluster 2021-03-10T16:39:45.713204+0000 mgr.gibba020.yqfnwy (mgr.34427) 8807 : cluster [DBG] pgmap v5011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:47.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:46 gibba020 bash[25448]: cephadm 2021-03-10T16:39:44.982699+0000 mgr.gibba020.yqfnwy (mgr.34427) 8791 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:39:47.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:46 gibba020 bash[25448]: cephadm 2021-03-10T16:39:44.984505+0000 mgr.gibba020.yqfnwy (mgr.34427) 8792 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:39:47.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:46 gibba020 bash[25448]: cephadm 2021-03-10T16:39:45.201091+0000 mgr.gibba020.yqfnwy (mgr.34427) 8793 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:39:47.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:46 gibba020 bash[25448]: cephadm 2021-03-10T16:39:45.203025+0000 mgr.gibba020.yqfnwy (mgr.34427) 8794 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:39:47.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:46 gibba020 bash[25448]: cephadm 2021-03-10T16:39:45.204580+0000 mgr.gibba020.yqfnwy (mgr.34427) 8795 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:39:47.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:46 gibba020 bash[25448]: cephadm 2021-03-10T16:39:45.204617+0000 mgr.gibba020.yqfnwy (mgr.34427) 8796 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:39:47.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:46 gibba020 bash[25448]: cephadm 2021-03-10T16:39:45.205947+0000 mgr.gibba020.yqfnwy (mgr.34427) 8797 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:39:47.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:46 gibba020 bash[25448]: cephadm 2021-03-10T16:39:45.205984+0000 mgr.gibba020.yqfnwy (mgr.34427) 8798 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:39:47.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:46 gibba020 bash[25448]: cephadm 2021-03-10T16:39:45.207323+0000 mgr.gibba020.yqfnwy (mgr.34427) 8799 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:39:47.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:46 gibba020 bash[25448]: cephadm 2021-03-10T16:39:45.208627+0000 mgr.gibba020.yqfnwy (mgr.34427) 8800 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:39:47.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:46 gibba020 bash[25448]: cephadm 2021-03-10T16:39:45.208662+0000 mgr.gibba020.yqfnwy (mgr.34427) 8801 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:39:47.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:46 gibba020 bash[25448]: cephadm 2021-03-10T16:39:45.210004+0000 mgr.gibba020.yqfnwy (mgr.34427) 8802 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:39:47.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:46 gibba020 bash[25448]: cephadm 2021-03-10T16:39:45.210325+0000 mgr.gibba020.yqfnwy (mgr.34427) 8803 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:39:47.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:46 gibba020 bash[25448]: cephadm 2021-03-10T16:39:45.211711+0000 mgr.gibba020.yqfnwy (mgr.34427) 8804 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:39:47.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:46 gibba020 bash[25448]: cephadm 2021-03-10T16:39:45.211747+0000 mgr.gibba020.yqfnwy (mgr.34427) 8805 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:39:47.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:46 gibba020 bash[25448]: cephadm 2021-03-10T16:39:45.211850+0000 mgr.gibba020.yqfnwy (mgr.34427) 8806 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:39:47.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:46 gibba020 bash[25448]: cluster 2021-03-10T16:39:45.713204+0000 mgr.gibba020.yqfnwy (mgr.34427) 8807 : cluster [DBG] pgmap v5011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:47.651 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:39:47.878 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:39:47.878 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 9m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:39:47.879 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 8m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:39:47.879 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:39:47.879 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:39:47.879 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:39:47.880 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:39:47.880 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:39:47.880 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:39:47.880 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:39:47.880 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:39:47.881 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:39:47.881 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:39:47.881 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:39:47.881 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:39:47.882 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:39:47.882 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:39:47.882 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:39:47.882 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:39:47.883 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 8m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:39:47.883 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 8m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:39:48.128 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:39:48.128 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:39:48.129 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:39:48.129 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:39:48.130 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:39:48.130 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:39:48.131 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:39:48.131 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:39:48.131 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:39:48.132 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:39:48.132 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:39:48.132 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:39:48.133 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:39:48.133 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:39:48.133 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:39:49.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:48 gibba013 bash[29418]: audit 2021-03-10T16:39:47.642781+0000 mgr.gibba020.yqfnwy (mgr.34427) 8808 : audit [DBG] from='client.49956 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:39:49.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:48 gibba013 bash[29418]: cluster 2021-03-10T16:39:47.714785+0000 mgr.gibba020.yqfnwy (mgr.34427) 8809 : cluster [DBG] pgmap v5012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:49.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:48 gibba013 bash[29418]: audit 2021-03-10T16:39:47.867786+0000 mgr.gibba020.yqfnwy (mgr.34427) 8810 : audit [DBG] from='client.59944 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:39:49.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:48 gibba013 bash[29418]: audit 2021-03-10T16:39:48.129454+0000 mon.a (mon.0) 3216 : audit [DBG] from='client.? 172.21.2.113:0/33845292' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:49.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:48 gibba013 bash[30381]: audit 2021-03-10T16:39:47.642781+0000 mgr.gibba020.yqfnwy (mgr.34427) 8808 : audit [DBG] from='client.49956 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:39:49.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:48 gibba013 bash[30381]: cluster 2021-03-10T16:39:47.714785+0000 mgr.gibba020.yqfnwy (mgr.34427) 8809 : cluster [DBG] pgmap v5012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:49.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:48 gibba013 bash[30381]: audit 2021-03-10T16:39:47.867786+0000 mgr.gibba020.yqfnwy (mgr.34427) 8810 : audit [DBG] from='client.59944 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:39:49.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:48 gibba013 bash[30381]: audit 2021-03-10T16:39:48.129454+0000 mon.a (mon.0) 3216 : audit [DBG] from='client.? 172.21.2.113:0/33845292' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:49.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:48 gibba020 bash[25448]: audit 2021-03-10T16:39:47.642781+0000 mgr.gibba020.yqfnwy (mgr.34427) 8808 : audit [DBG] from='client.49956 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:39:49.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:48 gibba020 bash[25448]: cluster 2021-03-10T16:39:47.714785+0000 mgr.gibba020.yqfnwy (mgr.34427) 8809 : cluster [DBG] pgmap v5012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:49.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:48 gibba020 bash[25448]: audit 2021-03-10T16:39:47.867786+0000 mgr.gibba020.yqfnwy (mgr.34427) 8810 : audit [DBG] from='client.59944 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:39:49.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:48 gibba020 bash[25448]: audit 2021-03-10T16:39:48.129454+0000 mon.a (mon.0) 3216 : audit [DBG] from='client.? 172.21.2.113:0/33845292' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:39:50.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:50 gibba013 bash[29418]: cluster 2021-03-10T16:39:49.716373+0000 mgr.gibba020.yqfnwy (mgr.34427) 8811 : cluster [DBG] pgmap v5013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:50.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:50 gibba013 bash[30381]: cluster 2021-03-10T16:39:49.716373+0000 mgr.gibba020.yqfnwy (mgr.34427) 8811 : cluster [DBG] pgmap v5013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:50.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:50 gibba020 bash[25448]: cluster 2021-03-10T16:39:49.716373+0000 mgr.gibba020.yqfnwy (mgr.34427) 8811 : cluster [DBG] pgmap v5013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:53.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:52 gibba013 bash[29418]: cluster 2021-03-10T16:39:51.718130+0000 mgr.gibba020.yqfnwy (mgr.34427) 8812 : cluster [DBG] pgmap v5014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:53.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:52 gibba013 bash[30381]: cluster 2021-03-10T16:39:51.718130+0000 mgr.gibba020.yqfnwy (mgr.34427) 8812 : cluster [DBG] pgmap v5014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:53.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:52 gibba020 bash[25448]: cluster 2021-03-10T16:39:51.718130+0000 mgr.gibba020.yqfnwy (mgr.34427) 8812 : cluster [DBG] pgmap v5014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:55.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:54 gibba013 bash[29418]: cluster 2021-03-10T16:39:53.719534+0000 mgr.gibba020.yqfnwy (mgr.34427) 8813 : cluster [DBG] pgmap v5015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:55.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:54 gibba013 bash[30381]: cluster 2021-03-10T16:39:53.719534+0000 mgr.gibba020.yqfnwy (mgr.34427) 8813 : cluster [DBG] pgmap v5015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:55.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:54 gibba020 bash[25448]: cluster 2021-03-10T16:39:53.719534+0000 mgr.gibba020.yqfnwy (mgr.34427) 8813 : cluster [DBG] pgmap v5015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:57.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:56 gibba013 bash[29418]: cluster 2021-03-10T16:39:55.721266+0000 mgr.gibba020.yqfnwy (mgr.34427) 8814 : cluster [DBG] pgmap v5016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:57.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:56 gibba013 bash[30381]: cluster 2021-03-10T16:39:55.721266+0000 mgr.gibba020.yqfnwy (mgr.34427) 8814 : cluster [DBG] pgmap v5016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:57.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:56 gibba020 bash[25448]: cluster 2021-03-10T16:39:55.721266+0000 mgr.gibba020.yqfnwy (mgr.34427) 8814 : cluster [DBG] pgmap v5016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:59.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:39:58 gibba013 bash[29418]: cluster 2021-03-10T16:39:57.722879+0000 mgr.gibba020.yqfnwy (mgr.34427) 8815 : cluster [DBG] pgmap v5017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:59.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:39:58 gibba013 bash[30381]: cluster 2021-03-10T16:39:57.722879+0000 mgr.gibba020.yqfnwy (mgr.34427) 8815 : cluster [DBG] pgmap v5017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:39:59.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:39:58 gibba020 bash[25448]: cluster 2021-03-10T16:39:57.722879+0000 mgr.gibba020.yqfnwy (mgr.34427) 8815 : cluster [DBG] pgmap v5017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:00.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:00 gibba013 bash[29418]: debug 2021-03-10T16:39:59.998+0000 7fd718a82700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:40:00.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:00 gibba013 bash[29418]: cluster 2021-03-10T16:39:59.724444+0000 mgr.gibba020.yqfnwy (mgr.34427) 8816 : cluster [DBG] pgmap v5018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:00.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:00 gibba013 bash[29418]: cluster 2021-03-10T16:40:00.000347+0000 mon.a (mon.0) 3217 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:40:00.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:00 gibba013 bash[30381]: cluster 2021-03-10T16:39:59.724444+0000 mgr.gibba020.yqfnwy (mgr.34427) 8816 : cluster [DBG] pgmap v5018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:00.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:00 gibba013 bash[30381]: cluster 2021-03-10T16:40:00.000347+0000 mon.a (mon.0) 3217 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:40:00.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:00 gibba020 bash[25448]: cluster 2021-03-10T16:39:59.724444+0000 mgr.gibba020.yqfnwy (mgr.34427) 8816 : cluster [DBG] pgmap v5018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:00.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:00 gibba020 bash[25448]: cluster 2021-03-10T16:40:00.000347+0000 mon.a (mon.0) 3217 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:40:01.877 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:01 gibba013 bash[29418]: cephadm 2021-03-10T16:40:00.227924+0000 mgr.gibba020.yqfnwy (mgr.34427) 8817 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:40:01.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:01 gibba013 bash[30381]: cephadm 2021-03-10T16:40:00.227924+0000 mgr.gibba020.yqfnwy (mgr.34427) 8817 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:40:01.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:01 gibba020 bash[25448]: cephadm 2021-03-10T16:40:00.227924+0000 mgr.gibba020.yqfnwy (mgr.34427) 8817 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:40:02.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:02 gibba020 bash[25448]: cluster 2021-03-10T16:40:01.726201+0000 mgr.gibba020.yqfnwy (mgr.34427) 8818 : cluster [DBG] pgmap v5019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:03.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:02 gibba013 bash[29418]: cluster 2021-03-10T16:40:01.726201+0000 mgr.gibba020.yqfnwy (mgr.34427) 8818 : cluster [DBG] pgmap v5019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:03.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:02 gibba013 bash[30381]: cluster 2021-03-10T16:40:01.726201+0000 mgr.gibba020.yqfnwy (mgr.34427) 8818 : cluster [DBG] pgmap v5019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:05.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:04 gibba013 bash[29418]: cluster 2021-03-10T16:40:03.727851+0000 mgr.gibba020.yqfnwy (mgr.34427) 8819 : cluster [DBG] pgmap v5020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:05.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:04 gibba013 bash[30381]: cluster 2021-03-10T16:40:03.727851+0000 mgr.gibba020.yqfnwy (mgr.34427) 8819 : cluster [DBG] pgmap v5020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:05.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:04 gibba020 bash[25448]: cluster 2021-03-10T16:40:03.727851+0000 mgr.gibba020.yqfnwy (mgr.34427) 8819 : cluster [DBG] pgmap v5020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:07.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:06 gibba013 bash[29418]: cluster 2021-03-10T16:40:05.729662+0000 mgr.gibba020.yqfnwy (mgr.34427) 8820 : cluster [DBG] pgmap v5021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:07.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:06 gibba013 bash[29418]: audit 2021-03-10T16:40:06.761722+0000 mon.a (mon.0) 3218 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:40:07.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:06 gibba013 bash[30381]: cluster 2021-03-10T16:40:05.729662+0000 mgr.gibba020.yqfnwy (mgr.34427) 8820 : cluster [DBG] pgmap v5021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:07.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:06 gibba013 bash[30381]: audit 2021-03-10T16:40:06.761722+0000 mon.a (mon.0) 3218 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:40:07.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:06 gibba020 bash[25448]: cluster 2021-03-10T16:40:05.729662+0000 mgr.gibba020.yqfnwy (mgr.34427) 8820 : cluster [DBG] pgmap v5021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:07.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:06 gibba020 bash[25448]: audit 2021-03-10T16:40:06.761722+0000 mon.a (mon.0) 3218 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:40:08.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:07 gibba013 bash[29418]: audit 2021-03-10T16:40:06.929636+0000 mon.a (mon.0) 3219 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:40:08.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:07 gibba013 bash[29418]: audit 2021-03-10T16:40:07.265645+0000 mon.a (mon.0) 3220 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:40:08.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:07 gibba013 bash[29418]: audit 2021-03-10T16:40:07.266542+0000 mon.a (mon.0) 3221 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:40:08.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:07 gibba013 bash[29418]: audit 2021-03-10T16:40:07.267333+0000 mon.a (mon.0) 3222 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:40:08.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:07 gibba013 bash[29418]: audit 2021-03-10T16:40:07.268085+0000 mon.a (mon.0) 3223 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:40:08.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:07 gibba013 bash[30381]: audit 2021-03-10T16:40:06.929636+0000 mon.a (mon.0) 3219 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:40:08.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:07 gibba013 bash[30381]: audit 2021-03-10T16:40:07.265645+0000 mon.a (mon.0) 3220 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:40:08.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:07 gibba013 bash[30381]: audit 2021-03-10T16:40:07.266542+0000 mon.a (mon.0) 3221 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:40:08.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:07 gibba013 bash[30381]: audit 2021-03-10T16:40:07.267333+0000 mon.a (mon.0) 3222 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:40:08.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:07 gibba013 bash[30381]: audit 2021-03-10T16:40:07.268085+0000 mon.a (mon.0) 3223 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:40:08.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:07 gibba020 bash[25448]: audit 2021-03-10T16:40:06.929636+0000 mon.a (mon.0) 3219 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:40:08.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:07 gibba020 bash[25448]: audit 2021-03-10T16:40:07.265645+0000 mon.a (mon.0) 3220 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:40:08.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:07 gibba020 bash[25448]: audit 2021-03-10T16:40:07.266542+0000 mon.a (mon.0) 3221 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:40:08.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:07 gibba020 bash[25448]: audit 2021-03-10T16:40:07.267333+0000 mon.a (mon.0) 3222 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:40:08.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:07 gibba020 bash[25448]: audit 2021-03-10T16:40:07.268085+0000 mon.a (mon.0) 3223 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:40:09.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:08 gibba013 bash[29418]: cluster 2021-03-10T16:40:07.731205+0000 mgr.gibba020.yqfnwy (mgr.34427) 8821 : cluster [DBG] pgmap v5022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:09.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:08 gibba013 bash[30381]: cluster 2021-03-10T16:40:07.731205+0000 mgr.gibba020.yqfnwy (mgr.34427) 8821 : cluster [DBG] pgmap v5022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:09.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:08 gibba020 bash[25448]: cluster 2021-03-10T16:40:07.731205+0000 mgr.gibba020.yqfnwy (mgr.34427) 8821 : cluster [DBG] pgmap v5022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:10.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:10 gibba013 bash[29418]: cluster 2021-03-10T16:40:09.733054+0000 mgr.gibba020.yqfnwy (mgr.34427) 8822 : cluster [DBG] pgmap v5023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:10.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:10 gibba013 bash[30381]: cluster 2021-03-10T16:40:09.733054+0000 mgr.gibba020.yqfnwy (mgr.34427) 8822 : cluster [DBG] pgmap v5023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:10.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:10 gibba020 bash[25448]: cluster 2021-03-10T16:40:09.733054+0000 mgr.gibba020.yqfnwy (mgr.34427) 8822 : cluster [DBG] pgmap v5023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:13.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:12 gibba013 bash[29418]: cluster 2021-03-10T16:40:11.734282+0000 mgr.gibba020.yqfnwy (mgr.34427) 8823 : cluster [DBG] pgmap v5024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:13.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:12 gibba013 bash[30381]: cluster 2021-03-10T16:40:11.734282+0000 mgr.gibba020.yqfnwy (mgr.34427) 8823 : cluster [DBG] pgmap v5024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:13.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:12 gibba020 bash[25448]: cluster 2021-03-10T16:40:11.734282+0000 mgr.gibba020.yqfnwy (mgr.34427) 8823 : cluster [DBG] pgmap v5024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:15.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:14 gibba013 bash[29418]: cluster 2021-03-10T16:40:13.735663+0000 mgr.gibba020.yqfnwy (mgr.34427) 8824 : cluster [DBG] pgmap v5025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:15.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:14 gibba013 bash[30381]: cluster 2021-03-10T16:40:13.735663+0000 mgr.gibba020.yqfnwy (mgr.34427) 8824 : cluster [DBG] pgmap v5025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:15.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:14 gibba020 bash[25448]: cluster 2021-03-10T16:40:13.735663+0000 mgr.gibba020.yqfnwy (mgr.34427) 8824 : cluster [DBG] pgmap v5025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:17.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:16 gibba013 bash[29418]: cephadm 2021-03-10T16:40:15.243905+0000 mgr.gibba020.yqfnwy (mgr.34427) 8825 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:40:17.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:16 gibba013 bash[29418]: cluster 2021-03-10T16:40:15.737327+0000 mgr.gibba020.yqfnwy (mgr.34427) 8826 : cluster [DBG] pgmap v5026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:17.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:16 gibba013 bash[30381]: cephadm 2021-03-10T16:40:15.243905+0000 mgr.gibba020.yqfnwy (mgr.34427) 8825 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:40:17.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:16 gibba013 bash[30381]: cluster 2021-03-10T16:40:15.737327+0000 mgr.gibba020.yqfnwy (mgr.34427) 8826 : cluster [DBG] pgmap v5026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:17.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:16 gibba020 bash[25448]: cephadm 2021-03-10T16:40:15.243905+0000 mgr.gibba020.yqfnwy (mgr.34427) 8825 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:40:17.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:16 gibba020 bash[25448]: cluster 2021-03-10T16:40:15.737327+0000 mgr.gibba020.yqfnwy (mgr.34427) 8826 : cluster [DBG] pgmap v5026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:18.371 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:40:18.600 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:40:18.600 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 9m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:40:18.600 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 8m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:40:18.600 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:40:18.601 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:40:18.601 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:40:18.601 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:40:18.601 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:40:18.602 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:40:18.602 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:40:18.602 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 8m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:40:18.602 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:40:18.603 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:40:18.603 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:40:18.603 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:40:18.603 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:40:18.604 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:40:18.604 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:40:18.604 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 8m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:40:18.604 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 8m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:40:18.604 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 8m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:40:18.854 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:40:18.854 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:40:18.854 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:40:18.855 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:40:18.855 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:40:18.855 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:40:18.855 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:40:18.856 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:40:18.856 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:40:18.856 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:40:18.856 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:40:18.857 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:40:18.857 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:40:18.857 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:40:18.858 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:40:19.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:18 gibba013 bash[29418]: cluster 2021-03-10T16:40:17.738869+0000 mgr.gibba020.yqfnwy (mgr.34427) 8827 : cluster [DBG] pgmap v5027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:19.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:18 gibba013 bash[30381]: cluster 2021-03-10T16:40:17.738869+0000 mgr.gibba020.yqfnwy (mgr.34427) 8827 : cluster [DBG] pgmap v5027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:19.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:18 gibba020 bash[25448]: cluster 2021-03-10T16:40:17.738869+0000 mgr.gibba020.yqfnwy (mgr.34427) 8827 : cluster [DBG] pgmap v5027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:20.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:19 gibba013 bash[29418]: audit 2021-03-10T16:40:18.362966+0000 mgr.gibba020.yqfnwy (mgr.34427) 8828 : audit [DBG] from='client.49974 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:40:20.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:19 gibba013 bash[29418]: audit 2021-03-10T16:40:18.588031+0000 mgr.gibba020.yqfnwy (mgr.34427) 8829 : audit [DBG] from='client.59962 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:40:20.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:19 gibba013 bash[29418]: audit 2021-03-10T16:40:18.855511+0000 mon.c (mon.1) 139 : audit [DBG] from='client.? 172.21.2.113:0/4117351207' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:20.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:19 gibba013 bash[30381]: audit 2021-03-10T16:40:18.362966+0000 mgr.gibba020.yqfnwy (mgr.34427) 8828 : audit [DBG] from='client.49974 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:40:20.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:19 gibba013 bash[30381]: audit 2021-03-10T16:40:18.588031+0000 mgr.gibba020.yqfnwy (mgr.34427) 8829 : audit [DBG] from='client.59962 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:40:20.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:19 gibba013 bash[30381]: audit 2021-03-10T16:40:18.855511+0000 mon.c (mon.1) 139 : audit [DBG] from='client.? 172.21.2.113:0/4117351207' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:20.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:19 gibba020 bash[25448]: audit 2021-03-10T16:40:18.362966+0000 mgr.gibba020.yqfnwy (mgr.34427) 8828 : audit [DBG] from='client.49974 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:40:20.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:19 gibba020 bash[25448]: audit 2021-03-10T16:40:18.588031+0000 mgr.gibba020.yqfnwy (mgr.34427) 8829 : audit [DBG] from='client.59962 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:40:20.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:19 gibba020 bash[25448]: audit 2021-03-10T16:40:18.855511+0000 mon.c (mon.1) 139 : audit [DBG] from='client.? 172.21.2.113:0/4117351207' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:21.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:20 gibba013 bash[29418]: cluster 2021-03-10T16:40:19.740514+0000 mgr.gibba020.yqfnwy (mgr.34427) 8830 : cluster [DBG] pgmap v5028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:21.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:20 gibba013 bash[30381]: cluster 2021-03-10T16:40:19.740514+0000 mgr.gibba020.yqfnwy (mgr.34427) 8830 : cluster [DBG] pgmap v5028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:21.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:20 gibba020 bash[25448]: cluster 2021-03-10T16:40:19.740514+0000 mgr.gibba020.yqfnwy (mgr.34427) 8830 : cluster [DBG] pgmap v5028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:23.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:22 gibba013 bash[29418]: cluster 2021-03-10T16:40:21.742271+0000 mgr.gibba020.yqfnwy (mgr.34427) 8831 : cluster [DBG] pgmap v5029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:23.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:22 gibba013 bash[30381]: cluster 2021-03-10T16:40:21.742271+0000 mgr.gibba020.yqfnwy (mgr.34427) 8831 : cluster [DBG] pgmap v5029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:23.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:22 gibba020 bash[25448]: cluster 2021-03-10T16:40:21.742271+0000 mgr.gibba020.yqfnwy (mgr.34427) 8831 : cluster [DBG] pgmap v5029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:25.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:24 gibba013 bash[29418]: cluster 2021-03-10T16:40:23.743812+0000 mgr.gibba020.yqfnwy (mgr.34427) 8832 : cluster [DBG] pgmap v5030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:25.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:24 gibba013 bash[30381]: cluster 2021-03-10T16:40:23.743812+0000 mgr.gibba020.yqfnwy (mgr.34427) 8832 : cluster [DBG] pgmap v5030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:25.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:24 gibba020 bash[25448]: cluster 2021-03-10T16:40:23.743812+0000 mgr.gibba020.yqfnwy (mgr.34427) 8832 : cluster [DBG] pgmap v5030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:27.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:26 gibba013 bash[29418]: cluster 2021-03-10T16:40:25.745339+0000 mgr.gibba020.yqfnwy (mgr.34427) 8833 : cluster [DBG] pgmap v5031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:27.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:26 gibba013 bash[30381]: cluster 2021-03-10T16:40:25.745339+0000 mgr.gibba020.yqfnwy (mgr.34427) 8833 : cluster [DBG] pgmap v5031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:27.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:26 gibba020 bash[25448]: cluster 2021-03-10T16:40:25.745339+0000 mgr.gibba020.yqfnwy (mgr.34427) 8833 : cluster [DBG] pgmap v5031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:29.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:28 gibba013 bash[29418]: cluster 2021-03-10T16:40:27.746852+0000 mgr.gibba020.yqfnwy (mgr.34427) 8834 : cluster [DBG] pgmap v5032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:29.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:28 gibba013 bash[30381]: cluster 2021-03-10T16:40:27.746852+0000 mgr.gibba020.yqfnwy (mgr.34427) 8834 : cluster [DBG] pgmap v5032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:29.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:28 gibba020 bash[25448]: cluster 2021-03-10T16:40:27.746852+0000 mgr.gibba020.yqfnwy (mgr.34427) 8834 : cluster [DBG] pgmap v5032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:30.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:30 gibba020 bash[25448]: cluster 2021-03-10T16:40:29.748503+0000 mgr.gibba020.yqfnwy (mgr.34427) 8835 : cluster [DBG] pgmap v5033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:31.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:30 gibba013 bash[29418]: cluster 2021-03-10T16:40:29.748503+0000 mgr.gibba020.yqfnwy (mgr.34427) 8835 : cluster [DBG] pgmap v5033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:31.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:30 gibba013 bash[30381]: cluster 2021-03-10T16:40:29.748503+0000 mgr.gibba020.yqfnwy (mgr.34427) 8835 : cluster [DBG] pgmap v5033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:31.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:31 gibba020 bash[25448]: cephadm 2021-03-10T16:40:30.244957+0000 mgr.gibba020.yqfnwy (mgr.34427) 8836 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:40:32.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:31 gibba013 bash[29418]: cephadm 2021-03-10T16:40:30.244957+0000 mgr.gibba020.yqfnwy (mgr.34427) 8836 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:40:32.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:31 gibba013 bash[30381]: cephadm 2021-03-10T16:40:30.244957+0000 mgr.gibba020.yqfnwy (mgr.34427) 8836 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:40:32.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:32 gibba020 bash[25448]: cluster 2021-03-10T16:40:31.750053+0000 mgr.gibba020.yqfnwy (mgr.34427) 8837 : cluster [DBG] pgmap v5034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:33.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:32 gibba013 bash[29418]: cluster 2021-03-10T16:40:31.750053+0000 mgr.gibba020.yqfnwy (mgr.34427) 8837 : cluster [DBG] pgmap v5034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:33.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:32 gibba013 bash[30381]: cluster 2021-03-10T16:40:31.750053+0000 mgr.gibba020.yqfnwy (mgr.34427) 8837 : cluster [DBG] pgmap v5034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:35.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:34 gibba013 bash[29418]: cluster 2021-03-10T16:40:33.751454+0000 mgr.gibba020.yqfnwy (mgr.34427) 8838 : cluster [DBG] pgmap v5035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:35.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:34 gibba013 bash[30381]: cluster 2021-03-10T16:40:33.751454+0000 mgr.gibba020.yqfnwy (mgr.34427) 8838 : cluster [DBG] pgmap v5035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:35.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:34 gibba020 bash[25448]: cluster 2021-03-10T16:40:33.751454+0000 mgr.gibba020.yqfnwy (mgr.34427) 8838 : cluster [DBG] pgmap v5035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:37.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:36 gibba013 bash[29418]: cluster 2021-03-10T16:40:35.753118+0000 mgr.gibba020.yqfnwy (mgr.34427) 8839 : cluster [DBG] pgmap v5036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:37.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:36 gibba013 bash[30381]: cluster 2021-03-10T16:40:35.753118+0000 mgr.gibba020.yqfnwy (mgr.34427) 8839 : cluster [DBG] pgmap v5036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:37.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:36 gibba020 bash[25448]: cluster 2021-03-10T16:40:35.753118+0000 mgr.gibba020.yqfnwy (mgr.34427) 8839 : cluster [DBG] pgmap v5036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:39.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:38 gibba013 bash[29418]: cluster 2021-03-10T16:40:37.754521+0000 mgr.gibba020.yqfnwy (mgr.34427) 8840 : cluster [DBG] pgmap v5037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:39.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:38 gibba013 bash[30381]: cluster 2021-03-10T16:40:37.754521+0000 mgr.gibba020.yqfnwy (mgr.34427) 8840 : cluster [DBG] pgmap v5037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:39.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:38 gibba020 bash[25448]: cluster 2021-03-10T16:40:37.754521+0000 mgr.gibba020.yqfnwy (mgr.34427) 8840 : cluster [DBG] pgmap v5037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:40.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:40 gibba020 bash[25448]: cluster 2021-03-10T16:40:39.756188+0000 mgr.gibba020.yqfnwy (mgr.34427) 8841 : cluster [DBG] pgmap v5038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:41.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:40 gibba013 bash[29418]: cluster 2021-03-10T16:40:39.756188+0000 mgr.gibba020.yqfnwy (mgr.34427) 8841 : cluster [DBG] pgmap v5038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:41.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:40 gibba013 bash[30381]: cluster 2021-03-10T16:40:39.756188+0000 mgr.gibba020.yqfnwy (mgr.34427) 8841 : cluster [DBG] pgmap v5038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:43.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:42 gibba013 bash[29418]: cluster 2021-03-10T16:40:41.757967+0000 mgr.gibba020.yqfnwy (mgr.34427) 8842 : cluster [DBG] pgmap v5039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:43.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:42 gibba013 bash[30381]: cluster 2021-03-10T16:40:41.757967+0000 mgr.gibba020.yqfnwy (mgr.34427) 8842 : cluster [DBG] pgmap v5039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:43.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:42 gibba020 bash[25448]: cluster 2021-03-10T16:40:41.757967+0000 mgr.gibba020.yqfnwy (mgr.34427) 8842 : cluster [DBG] pgmap v5039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:45.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:44 gibba013 bash[29418]: cluster 2021-03-10T16:40:43.759535+0000 mgr.gibba020.yqfnwy (mgr.34427) 8843 : cluster [DBG] pgmap v5040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:45.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:44 gibba013 bash[30381]: cluster 2021-03-10T16:40:43.759535+0000 mgr.gibba020.yqfnwy (mgr.34427) 8843 : cluster [DBG] pgmap v5040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:45.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:44 gibba020 bash[25448]: cluster 2021-03-10T16:40:43.759535+0000 mgr.gibba020.yqfnwy (mgr.34427) 8843 : cluster [DBG] pgmap v5040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:46.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:45 gibba013 bash[29418]: audit 2021-03-10T16:40:45.262410+0000 mon.a (mon.0) 3224 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:40:46.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:45 gibba013 bash[29418]: audit 2021-03-10T16:40:45.268618+0000 mon.a (mon.0) 3225 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:40:46.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:45 gibba013 bash[30381]: audit 2021-03-10T16:40:45.262410+0000 mon.a (mon.0) 3224 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:40:46.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:45 gibba013 bash[30381]: audit 2021-03-10T16:40:45.268618+0000 mon.a (mon.0) 3225 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:40:46.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:45 gibba020 bash[25448]: audit 2021-03-10T16:40:45.262410+0000 mon.a (mon.0) 3224 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:40:46.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:45 gibba020 bash[25448]: audit 2021-03-10T16:40:45.268618+0000 mon.a (mon.0) 3225 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:40:47.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:46 gibba013 bash[29418]: cephadm 2021-03-10T16:40:45.268072+0000 mgr.gibba020.yqfnwy (mgr.34427) 8844 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:40:47.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:46 gibba013 bash[29418]: cluster 2021-03-10T16:40:45.761452+0000 mgr.gibba020.yqfnwy (mgr.34427) 8845 : cluster [DBG] pgmap v5041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:47.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:46 gibba013 bash[30381]: cephadm 2021-03-10T16:40:45.268072+0000 mgr.gibba020.yqfnwy (mgr.34427) 8844 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:40:47.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:46 gibba013 bash[30381]: cluster 2021-03-10T16:40:45.761452+0000 mgr.gibba020.yqfnwy (mgr.34427) 8845 : cluster [DBG] pgmap v5041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:47.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:46 gibba020 bash[25448]: cephadm 2021-03-10T16:40:45.268072+0000 mgr.gibba020.yqfnwy (mgr.34427) 8844 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:40:47.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:46 gibba020 bash[25448]: cluster 2021-03-10T16:40:45.761452+0000 mgr.gibba020.yqfnwy (mgr.34427) 8845 : cluster [DBG] pgmap v5041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:49.100 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:40:49.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:48 gibba013 bash[29418]: cluster 2021-03-10T16:40:47.763176+0000 mgr.gibba020.yqfnwy (mgr.34427) 8846 : cluster [DBG] pgmap v5042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:49.127 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:48 gibba013 bash[30381]: cluster 2021-03-10T16:40:47.763176+0000 mgr.gibba020.yqfnwy (mgr.34427) 8846 : cluster [DBG] pgmap v5042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:49.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:48 gibba020 bash[25448]: cluster 2021-03-10T16:40:47.763176+0000 mgr.gibba020.yqfnwy (mgr.34427) 8846 : cluster [DBG] pgmap v5042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:49.323 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:40:49.323 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 0s ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:40:49.324 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 9m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:40:49.324 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:40:49.324 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:40:49.324 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 0s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:40:49.325 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 0s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:40:49.325 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:40:49.325 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 0s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:40:49.325 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 0s ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:40:49.325 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:40:49.326 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 0s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:40:49.326 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 0s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:40:49.326 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 0s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:40:49.326 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 0s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:40:49.327 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:40:49.327 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:40:49.327 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:40:49.327 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:40:49.327 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 9m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:40:49.328 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 9m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:40:49.570 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:40:49.570 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:40:49.571 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:40:49.571 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:40:49.571 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:40:49.571 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:40:49.572 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:40:49.572 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:40:49.572 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:40:49.572 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:40:49.572 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:40:49.573 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:40:49.573 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:40:49.573 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:40:49.573 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:40:50.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:49 gibba020 bash[25448]: audit 2021-03-10T16:40:48.876033+0000 mon.a (mon.0) 3226 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:40:50.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:49 gibba020 bash[25448]: cephadm 2021-03-10T16:40:48.876160+0000 mgr.gibba020.yqfnwy (mgr.34427) 8847 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:40:50.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:49 gibba020 bash[25448]: audit 2021-03-10T16:40:49.071946+0000 mon.a (mon.0) 3227 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:40:50.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:49 gibba020 bash[25448]: audit 2021-03-10T16:40:49.078891+0000 mon.a (mon.0) 3228 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:40:50.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:49 gibba020 bash[25448]: audit 2021-03-10T16:40:49.080011+0000 mon.a (mon.0) 3229 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:50.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:49 gibba020 bash[25448]: audit 2021-03-10T16:40:49.081068+0000 mon.a (mon.0) 3230 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:50.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:49 gibba020 bash[25448]: audit 2021-03-10T16:40:49.081965+0000 mon.a (mon.0) 3231 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:50.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:49 gibba020 bash[25448]: audit 2021-03-10T16:40:49.084049+0000 mon.a (mon.0) 3232 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:50.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:49 gibba020 bash[25448]: audit 2021-03-10T16:40:49.085273+0000 mon.a (mon.0) 3233 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:50.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:49 gibba020 bash[25448]: audit 2021-03-10T16:40:49.572011+0000 mon.a (mon.0) 3234 : audit [DBG] from='client.? 172.21.2.113:0/2087635810' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:50.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:49 gibba013 bash[29418]: audit 2021-03-10T16:40:48.876033+0000 mon.a (mon.0) 3226 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:40:50.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:49 gibba013 bash[29418]: cephadm 2021-03-10T16:40:48.876160+0000 mgr.gibba020.yqfnwy (mgr.34427) 8847 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:40:50.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:49 gibba013 bash[29418]: audit 2021-03-10T16:40:49.071946+0000 mon.a (mon.0) 3227 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:40:50.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:49 gibba013 bash[29418]: audit 2021-03-10T16:40:49.078891+0000 mon.a (mon.0) 3228 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:40:50.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:49 gibba013 bash[29418]: audit 2021-03-10T16:40:49.080011+0000 mon.a (mon.0) 3229 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:50.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:49 gibba013 bash[29418]: audit 2021-03-10T16:40:49.081068+0000 mon.a (mon.0) 3230 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:50.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:49 gibba013 bash[29418]: audit 2021-03-10T16:40:49.081965+0000 mon.a (mon.0) 3231 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:50.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:49 gibba013 bash[29418]: audit 2021-03-10T16:40:49.084049+0000 mon.a (mon.0) 3232 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:50.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:49 gibba013 bash[29418]: audit 2021-03-10T16:40:49.085273+0000 mon.a (mon.0) 3233 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:50.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:49 gibba013 bash[29418]: audit 2021-03-10T16:40:49.572011+0000 mon.a (mon.0) 3234 : audit [DBG] from='client.? 172.21.2.113:0/2087635810' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:50.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:49 gibba013 bash[30381]: audit 2021-03-10T16:40:48.876033+0000 mon.a (mon.0) 3226 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:40:50.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:49 gibba013 bash[30381]: cephadm 2021-03-10T16:40:48.876160+0000 mgr.gibba020.yqfnwy (mgr.34427) 8847 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:40:50.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:49 gibba013 bash[30381]: audit 2021-03-10T16:40:49.071946+0000 mon.a (mon.0) 3227 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:40:50.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:49 gibba013 bash[30381]: audit 2021-03-10T16:40:49.078891+0000 mon.a (mon.0) 3228 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:40:50.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:49 gibba013 bash[30381]: audit 2021-03-10T16:40:49.080011+0000 mon.a (mon.0) 3229 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:50.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:49 gibba013 bash[30381]: audit 2021-03-10T16:40:49.081068+0000 mon.a (mon.0) 3230 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:50.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:49 gibba013 bash[30381]: audit 2021-03-10T16:40:49.081965+0000 mon.a (mon.0) 3231 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:50.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:49 gibba013 bash[30381]: audit 2021-03-10T16:40:49.084049+0000 mon.a (mon.0) 3232 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:50.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:49 gibba013 bash[30381]: audit 2021-03-10T16:40:49.085273+0000 mon.a (mon.0) 3233 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:50.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:49 gibba013 bash[30381]: audit 2021-03-10T16:40:49.572011+0000 mon.a (mon.0) 3234 : audit [DBG] from='client.? 172.21.2.113:0/2087635810' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:40:51.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:50 gibba020 bash[25448]: cephadm 2021-03-10T16:40:49.077676+0000 mgr.gibba020.yqfnwy (mgr.34427) 8848 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:40:51.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:50 gibba020 bash[25448]: cephadm 2021-03-10T16:40:49.079188+0000 mgr.gibba020.yqfnwy (mgr.34427) 8849 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:40:51.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:50 gibba020 bash[25448]: cephadm 2021-03-10T16:40:49.080257+0000 mgr.gibba020.yqfnwy (mgr.34427) 8850 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:40:51.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:50 gibba020 bash[25448]: cephadm 2021-03-10T16:40:49.080297+0000 mgr.gibba020.yqfnwy (mgr.34427) 8851 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:40:51.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:50 gibba020 bash[25448]: cephadm 2021-03-10T16:40:49.081266+0000 mgr.gibba020.yqfnwy (mgr.34427) 8852 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:40:51.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:50 gibba020 bash[25448]: cephadm 2021-03-10T16:40:49.081306+0000 mgr.gibba020.yqfnwy (mgr.34427) 8853 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:40:51.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:50 gibba020 bash[25448]: cephadm 2021-03-10T16:40:49.082281+0000 mgr.gibba020.yqfnwy (mgr.34427) 8854 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:40:51.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:50 gibba020 bash[25448]: cephadm 2021-03-10T16:40:49.083141+0000 mgr.gibba020.yqfnwy (mgr.34427) 8855 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:40:51.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:50 gibba020 bash[25448]: cephadm 2021-03-10T16:40:49.083181+0000 mgr.gibba020.yqfnwy (mgr.34427) 8856 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:40:51.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:50 gibba020 bash[25448]: cephadm 2021-03-10T16:40:49.084227+0000 mgr.gibba020.yqfnwy (mgr.34427) 8857 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:40:51.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:50 gibba020 bash[25448]: cephadm 2021-03-10T16:40:49.084585+0000 mgr.gibba020.yqfnwy (mgr.34427) 8858 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:40:51.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:50 gibba020 bash[25448]: cephadm 2021-03-10T16:40:49.085486+0000 mgr.gibba020.yqfnwy (mgr.34427) 8859 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:40:51.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:50 gibba020 bash[25448]: cephadm 2021-03-10T16:40:49.085531+0000 mgr.gibba020.yqfnwy (mgr.34427) 8860 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:40:51.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:50 gibba020 bash[25448]: cephadm 2021-03-10T16:40:49.085646+0000 mgr.gibba020.yqfnwy (mgr.34427) 8861 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:40:51.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:50 gibba020 bash[25448]: audit 2021-03-10T16:40:49.089999+0000 mgr.gibba020.yqfnwy (mgr.34427) 8862 : audit [DBG] from='client.59974 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:40:51.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:50 gibba020 bash[25448]: audit 2021-03-10T16:40:49.311284+0000 mgr.gibba020.yqfnwy (mgr.34427) 8863 : audit [DBG] from='client.59980 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:40:51.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:50 gibba020 bash[25448]: cluster 2021-03-10T16:40:49.764878+0000 mgr.gibba020.yqfnwy (mgr.34427) 8864 : cluster [DBG] pgmap v5043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:51.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:50 gibba013 bash[29418]: cephadm 2021-03-10T16:40:49.077676+0000 mgr.gibba020.yqfnwy (mgr.34427) 8848 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:40:51.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:50 gibba013 bash[29418]: cephadm 2021-03-10T16:40:49.079188+0000 mgr.gibba020.yqfnwy (mgr.34427) 8849 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:40:51.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:50 gibba013 bash[29418]: cephadm 2021-03-10T16:40:49.080257+0000 mgr.gibba020.yqfnwy (mgr.34427) 8850 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:40:51.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:50 gibba013 bash[29418]: cephadm 2021-03-10T16:40:49.080297+0000 mgr.gibba020.yqfnwy (mgr.34427) 8851 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:40:51.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:50 gibba013 bash[29418]: cephadm 2021-03-10T16:40:49.081266+0000 mgr.gibba020.yqfnwy (mgr.34427) 8852 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:40:51.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:50 gibba013 bash[29418]: cephadm 2021-03-10T16:40:49.081306+0000 mgr.gibba020.yqfnwy (mgr.34427) 8853 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:40:51.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:50 gibba013 bash[29418]: cephadm 2021-03-10T16:40:49.082281+0000 mgr.gibba020.yqfnwy (mgr.34427) 8854 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:40:51.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:50 gibba013 bash[29418]: cephadm 2021-03-10T16:40:49.083141+0000 mgr.gibba020.yqfnwy (mgr.34427) 8855 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:40:51.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:50 gibba013 bash[29418]: cephadm 2021-03-10T16:40:49.083181+0000 mgr.gibba020.yqfnwy (mgr.34427) 8856 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:40:51.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:50 gibba013 bash[29418]: cephadm 2021-03-10T16:40:49.084227+0000 mgr.gibba020.yqfnwy (mgr.34427) 8857 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:40:51.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:50 gibba013 bash[29418]: cephadm 2021-03-10T16:40:49.084585+0000 mgr.gibba020.yqfnwy (mgr.34427) 8858 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:40:51.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:50 gibba013 bash[29418]: cephadm 2021-03-10T16:40:49.085486+0000 mgr.gibba020.yqfnwy (mgr.34427) 8859 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:40:51.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:50 gibba013 bash[29418]: cephadm 2021-03-10T16:40:49.085531+0000 mgr.gibba020.yqfnwy (mgr.34427) 8860 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:40:51.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:50 gibba013 bash[29418]: cephadm 2021-03-10T16:40:49.085646+0000 mgr.gibba020.yqfnwy (mgr.34427) 8861 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:40:51.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:50 gibba013 bash[29418]: audit 2021-03-10T16:40:49.089999+0000 mgr.gibba020.yqfnwy (mgr.34427) 8862 : audit [DBG] from='client.59974 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:40:51.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:50 gibba013 bash[29418]: audit 2021-03-10T16:40:49.311284+0000 mgr.gibba020.yqfnwy (mgr.34427) 8863 : audit [DBG] from='client.59980 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:40:51.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:50 gibba013 bash[29418]: cluster 2021-03-10T16:40:49.764878+0000 mgr.gibba020.yqfnwy (mgr.34427) 8864 : cluster [DBG] pgmap v5043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:51.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:50 gibba013 bash[30381]: cephadm 2021-03-10T16:40:49.077676+0000 mgr.gibba020.yqfnwy (mgr.34427) 8848 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:40:51.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:50 gibba013 bash[30381]: cephadm 2021-03-10T16:40:49.079188+0000 mgr.gibba020.yqfnwy (mgr.34427) 8849 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:40:51.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:50 gibba013 bash[30381]: cephadm 2021-03-10T16:40:49.080257+0000 mgr.gibba020.yqfnwy (mgr.34427) 8850 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:40:51.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:50 gibba013 bash[30381]: cephadm 2021-03-10T16:40:49.080297+0000 mgr.gibba020.yqfnwy (mgr.34427) 8851 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:40:51.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:50 gibba013 bash[30381]: cephadm 2021-03-10T16:40:49.081266+0000 mgr.gibba020.yqfnwy (mgr.34427) 8852 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:40:51.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:50 gibba013 bash[30381]: cephadm 2021-03-10T16:40:49.081306+0000 mgr.gibba020.yqfnwy (mgr.34427) 8853 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:40:51.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:50 gibba013 bash[30381]: cephadm 2021-03-10T16:40:49.082281+0000 mgr.gibba020.yqfnwy (mgr.34427) 8854 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:40:51.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:50 gibba013 bash[30381]: cephadm 2021-03-10T16:40:49.083141+0000 mgr.gibba020.yqfnwy (mgr.34427) 8855 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:40:51.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:50 gibba013 bash[30381]: cephadm 2021-03-10T16:40:49.083181+0000 mgr.gibba020.yqfnwy (mgr.34427) 8856 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:40:51.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:50 gibba013 bash[30381]: cephadm 2021-03-10T16:40:49.084227+0000 mgr.gibba020.yqfnwy (mgr.34427) 8857 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:40:51.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:50 gibba013 bash[30381]: cephadm 2021-03-10T16:40:49.084585+0000 mgr.gibba020.yqfnwy (mgr.34427) 8858 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:40:51.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:50 gibba013 bash[30381]: cephadm 2021-03-10T16:40:49.085486+0000 mgr.gibba020.yqfnwy (mgr.34427) 8859 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:40:51.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:50 gibba013 bash[30381]: cephadm 2021-03-10T16:40:49.085531+0000 mgr.gibba020.yqfnwy (mgr.34427) 8860 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:40:51.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:50 gibba013 bash[30381]: cephadm 2021-03-10T16:40:49.085646+0000 mgr.gibba020.yqfnwy (mgr.34427) 8861 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:40:51.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:50 gibba013 bash[30381]: audit 2021-03-10T16:40:49.089999+0000 mgr.gibba020.yqfnwy (mgr.34427) 8862 : audit [DBG] from='client.59974 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:40:51.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:50 gibba013 bash[30381]: audit 2021-03-10T16:40:49.311284+0000 mgr.gibba020.yqfnwy (mgr.34427) 8863 : audit [DBG] from='client.59980 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:40:51.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:50 gibba013 bash[30381]: cluster 2021-03-10T16:40:49.764878+0000 mgr.gibba020.yqfnwy (mgr.34427) 8864 : cluster [DBG] pgmap v5043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:53.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:52 gibba020 bash[25448]: cluster 2021-03-10T16:40:51.766613+0000 mgr.gibba020.yqfnwy (mgr.34427) 8865 : cluster [DBG] pgmap v5044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:53.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:52 gibba013 bash[29418]: cluster 2021-03-10T16:40:51.766613+0000 mgr.gibba020.yqfnwy (mgr.34427) 8865 : cluster [DBG] pgmap v5044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:53.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:52 gibba013 bash[30381]: cluster 2021-03-10T16:40:51.766613+0000 mgr.gibba020.yqfnwy (mgr.34427) 8865 : cluster [DBG] pgmap v5044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:55.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:54 gibba020 bash[25448]: cluster 2021-03-10T16:40:53.768015+0000 mgr.gibba020.yqfnwy (mgr.34427) 8866 : cluster [DBG] pgmap v5045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:55.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:54 gibba013 bash[29418]: cluster 2021-03-10T16:40:53.768015+0000 mgr.gibba020.yqfnwy (mgr.34427) 8866 : cluster [DBG] pgmap v5045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:55.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:54 gibba013 bash[30381]: cluster 2021-03-10T16:40:53.768015+0000 mgr.gibba020.yqfnwy (mgr.34427) 8866 : cluster [DBG] pgmap v5045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:57.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:56 gibba020 bash[25448]: cluster 2021-03-10T16:40:55.769747+0000 mgr.gibba020.yqfnwy (mgr.34427) 8867 : cluster [DBG] pgmap v5046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:57.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:56 gibba013 bash[29418]: cluster 2021-03-10T16:40:55.769747+0000 mgr.gibba020.yqfnwy (mgr.34427) 8867 : cluster [DBG] pgmap v5046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:57.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:56 gibba013 bash[30381]: cluster 2021-03-10T16:40:55.769747+0000 mgr.gibba020.yqfnwy (mgr.34427) 8867 : cluster [DBG] pgmap v5046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:59.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:40:58 gibba020 bash[25448]: cluster 2021-03-10T16:40:57.771087+0000 mgr.gibba020.yqfnwy (mgr.34427) 8868 : cluster [DBG] pgmap v5047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:59.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:40:58 gibba013 bash[29418]: cluster 2021-03-10T16:40:57.771087+0000 mgr.gibba020.yqfnwy (mgr.34427) 8868 : cluster [DBG] pgmap v5047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:40:59.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:40:58 gibba013 bash[30381]: cluster 2021-03-10T16:40:57.771087+0000 mgr.gibba020.yqfnwy (mgr.34427) 8868 : cluster [DBG] pgmap v5047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:00.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:00 gibba020 bash[25448]: cluster 2021-03-10T16:40:59.772477+0000 mgr.gibba020.yqfnwy (mgr.34427) 8869 : cluster [DBG] pgmap v5048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:01.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:00 gibba013 bash[29418]: cluster 2021-03-10T16:40:59.772477+0000 mgr.gibba020.yqfnwy (mgr.34427) 8869 : cluster [DBG] pgmap v5048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:01.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:00 gibba013 bash[30381]: cluster 2021-03-10T16:40:59.772477+0000 mgr.gibba020.yqfnwy (mgr.34427) 8869 : cluster [DBG] pgmap v5048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:03.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:02 gibba013 bash[29418]: cluster 2021-03-10T16:41:01.774307+0000 mgr.gibba020.yqfnwy (mgr.34427) 8870 : cluster [DBG] pgmap v5049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:03.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:02 gibba013 bash[30381]: cluster 2021-03-10T16:41:01.774307+0000 mgr.gibba020.yqfnwy (mgr.34427) 8870 : cluster [DBG] pgmap v5049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:03.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:02 gibba020 bash[25448]: cluster 2021-03-10T16:41:01.774307+0000 mgr.gibba020.yqfnwy (mgr.34427) 8870 : cluster [DBG] pgmap v5049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:05.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:04 gibba013 bash[29418]: cluster 2021-03-10T16:41:03.775845+0000 mgr.gibba020.yqfnwy (mgr.34427) 8871 : cluster [DBG] pgmap v5050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:05.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:04 gibba013 bash[30381]: cluster 2021-03-10T16:41:03.775845+0000 mgr.gibba020.yqfnwy (mgr.34427) 8871 : cluster [DBG] pgmap v5050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:05.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:04 gibba020 bash[25448]: cluster 2021-03-10T16:41:03.775845+0000 mgr.gibba020.yqfnwy (mgr.34427) 8871 : cluster [DBG] pgmap v5050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:06.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:05 gibba013 bash[29418]: cephadm 2021-03-10T16:41:04.100278+0000 mgr.gibba020.yqfnwy (mgr.34427) 8872 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:41:06.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:05 gibba013 bash[30381]: cephadm 2021-03-10T16:41:04.100278+0000 mgr.gibba020.yqfnwy (mgr.34427) 8872 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:41:06.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:05 gibba020 bash[25448]: cephadm 2021-03-10T16:41:04.100278+0000 mgr.gibba020.yqfnwy (mgr.34427) 8872 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:41:07.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:06 gibba013 bash[29418]: cluster 2021-03-10T16:41:05.777606+0000 mgr.gibba020.yqfnwy (mgr.34427) 8873 : cluster [DBG] pgmap v5051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:07.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:06 gibba013 bash[29418]: audit 2021-03-10T16:41:06.766956+0000 mon.a (mon.0) 3235 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:41:07.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:06 gibba013 bash[30381]: cluster 2021-03-10T16:41:05.777606+0000 mgr.gibba020.yqfnwy (mgr.34427) 8873 : cluster [DBG] pgmap v5051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:07.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:06 gibba013 bash[30381]: audit 2021-03-10T16:41:06.766956+0000 mon.a (mon.0) 3235 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:41:07.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:06 gibba020 bash[25448]: cluster 2021-03-10T16:41:05.777606+0000 mgr.gibba020.yqfnwy (mgr.34427) 8873 : cluster [DBG] pgmap v5051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:07.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:06 gibba020 bash[25448]: audit 2021-03-10T16:41:06.766956+0000 mon.a (mon.0) 3235 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:41:08.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:07 gibba013 bash[29418]: audit 2021-03-10T16:41:06.935972+0000 mon.a (mon.0) 3236 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:41:08.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:07 gibba013 bash[29418]: audit 2021-03-10T16:41:07.277712+0000 mon.a (mon.0) 3237 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:41:08.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:07 gibba013 bash[29418]: audit 2021-03-10T16:41:07.278498+0000 mon.a (mon.0) 3238 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:41:08.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:07 gibba013 bash[29418]: audit 2021-03-10T16:41:07.279185+0000 mon.a (mon.0) 3239 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:41:08.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:07 gibba013 bash[29418]: audit 2021-03-10T16:41:07.279870+0000 mon.a (mon.0) 3240 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:41:08.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:07 gibba013 bash[30381]: audit 2021-03-10T16:41:06.935972+0000 mon.a (mon.0) 3236 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:41:08.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:07 gibba013 bash[30381]: audit 2021-03-10T16:41:07.277712+0000 mon.a (mon.0) 3237 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:41:08.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:07 gibba013 bash[30381]: audit 2021-03-10T16:41:07.278498+0000 mon.a (mon.0) 3238 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:41:08.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:07 gibba013 bash[30381]: audit 2021-03-10T16:41:07.279185+0000 mon.a (mon.0) 3239 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:41:08.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:07 gibba013 bash[30381]: audit 2021-03-10T16:41:07.279870+0000 mon.a (mon.0) 3240 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:41:08.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:07 gibba020 bash[25448]: audit 2021-03-10T16:41:06.935972+0000 mon.a (mon.0) 3236 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:41:08.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:07 gibba020 bash[25448]: audit 2021-03-10T16:41:07.277712+0000 mon.a (mon.0) 3237 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T16:41:08.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:07 gibba020 bash[25448]: audit 2021-03-10T16:41:07.278498+0000 mon.a (mon.0) 3238 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:41:08.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:07 gibba020 bash[25448]: audit 2021-03-10T16:41:07.279185+0000 mon.a (mon.0) 3239 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T16:41:08.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:07 gibba020 bash[25448]: audit 2021-03-10T16:41:07.279870+0000 mon.a (mon.0) 3240 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:41:09.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:08 gibba020 bash[25448]: cluster 2021-03-10T16:41:07.779149+0000 mgr.gibba020.yqfnwy (mgr.34427) 8874 : cluster [DBG] pgmap v5052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:09.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:08 gibba013 bash[29418]: cluster 2021-03-10T16:41:07.779149+0000 mgr.gibba020.yqfnwy (mgr.34427) 8874 : cluster [DBG] pgmap v5052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:09.377 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:08 gibba013 bash[30381]: cluster 2021-03-10T16:41:07.779149+0000 mgr.gibba020.yqfnwy (mgr.34427) 8874 : cluster [DBG] pgmap v5052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:10.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:10 gibba020 bash[25448]: cluster 2021-03-10T16:41:09.780858+0000 mgr.gibba020.yqfnwy (mgr.34427) 8875 : cluster [DBG] pgmap v5053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:11.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:10 gibba013 bash[29418]: cluster 2021-03-10T16:41:09.780858+0000 mgr.gibba020.yqfnwy (mgr.34427) 8875 : cluster [DBG] pgmap v5053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:11.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:10 gibba013 bash[30381]: cluster 2021-03-10T16:41:09.780858+0000 mgr.gibba020.yqfnwy (mgr.34427) 8875 : cluster [DBG] pgmap v5053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:13.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:12 gibba013 bash[29418]: cluster 2021-03-10T16:41:11.782399+0000 mgr.gibba020.yqfnwy (mgr.34427) 8876 : cluster [DBG] pgmap v5054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:13.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:12 gibba013 bash[30381]: cluster 2021-03-10T16:41:11.782399+0000 mgr.gibba020.yqfnwy (mgr.34427) 8876 : cluster [DBG] pgmap v5054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:13.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:12 gibba020 bash[25448]: cluster 2021-03-10T16:41:11.782399+0000 mgr.gibba020.yqfnwy (mgr.34427) 8876 : cluster [DBG] pgmap v5054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:15.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:14 gibba013 bash[29418]: cluster 2021-03-10T16:41:13.783796+0000 mgr.gibba020.yqfnwy (mgr.34427) 8877 : cluster [DBG] pgmap v5055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:15.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:14 gibba013 bash[30381]: cluster 2021-03-10T16:41:13.783796+0000 mgr.gibba020.yqfnwy (mgr.34427) 8877 : cluster [DBG] pgmap v5055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:15.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:14 gibba020 bash[25448]: cluster 2021-03-10T16:41:13.783796+0000 mgr.gibba020.yqfnwy (mgr.34427) 8877 : cluster [DBG] pgmap v5055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:17.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:16 gibba013 bash[29418]: cluster 2021-03-10T16:41:15.785557+0000 mgr.gibba020.yqfnwy (mgr.34427) 8878 : cluster [DBG] pgmap v5056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:17.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:16 gibba013 bash[30381]: cluster 2021-03-10T16:41:15.785557+0000 mgr.gibba020.yqfnwy (mgr.34427) 8878 : cluster [DBG] pgmap v5056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:17.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:16 gibba020 bash[25448]: cluster 2021-03-10T16:41:15.785557+0000 mgr.gibba020.yqfnwy (mgr.34427) 8878 : cluster [DBG] pgmap v5056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:19.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:18 gibba013 bash[29418]: cluster 2021-03-10T16:41:17.786988+0000 mgr.gibba020.yqfnwy (mgr.34427) 8879 : cluster [DBG] pgmap v5057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:19.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:18 gibba013 bash[30381]: cluster 2021-03-10T16:41:17.786988+0000 mgr.gibba020.yqfnwy (mgr.34427) 8879 : cluster [DBG] pgmap v5057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:19.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:18 gibba020 bash[25448]: cluster 2021-03-10T16:41:17.786988+0000 mgr.gibba020.yqfnwy (mgr.34427) 8879 : cluster [DBG] pgmap v5057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:19.820 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:41:20.046 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:41:20.046 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 31s ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:41:20.046 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 9m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:41:20.047 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:41:20.047 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:41:20.047 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 31s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:41:20.047 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 31s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:41:20.048 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:41:20.048 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 31s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:41:20.048 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 31s ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:41:20.048 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 9m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:41:20.049 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 31s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:41:20.049 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 31s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:41:20.049 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 31s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:41:20.049 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 31s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:41:20.050 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:41:20.050 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:41:20.050 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:41:20.051 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 9m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:41:20.051 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 9m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:41:20.051 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 9m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:41:20.295 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:41:20.296 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:41:20.296 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:41:20.296 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:41:20.296 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:41:20.297 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:41:20.297 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:41:20.297 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:41:20.298 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:41:20.298 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:41:20.299 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:41:20.299 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:41:20.299 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:41:20.300 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:41:20.300 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:41:20.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:20 gibba020 bash[25448]: cephadm 2021-03-10T16:41:19.116355+0000 mgr.gibba020.yqfnwy (mgr.34427) 8880 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:41:20.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:20 gibba020 bash[25448]: cluster 2021-03-10T16:41:19.788576+0000 mgr.gibba020.yqfnwy (mgr.34427) 8881 : cluster [DBG] pgmap v5058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:20.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:20 gibba020 bash[25448]: audit 2021-03-10T16:41:19.809337+0000 mgr.gibba020.yqfnwy (mgr.34427) 8882 : audit [DBG] from='client.59992 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:41:20.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:20 gibba020 bash[25448]: audit 2021-03-10T16:41:20.292888+0000 mon.a (mon.0) 3241 : audit [DBG] from='client.? 172.21.2.113:0/2523853560' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:21.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:20 gibba013 bash[29418]: cephadm 2021-03-10T16:41:19.116355+0000 mgr.gibba020.yqfnwy (mgr.34427) 8880 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:41:21.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:20 gibba013 bash[29418]: cluster 2021-03-10T16:41:19.788576+0000 mgr.gibba020.yqfnwy (mgr.34427) 8881 : cluster [DBG] pgmap v5058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:21.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:20 gibba013 bash[29418]: audit 2021-03-10T16:41:19.809337+0000 mgr.gibba020.yqfnwy (mgr.34427) 8882 : audit [DBG] from='client.59992 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:41:21.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:20 gibba013 bash[29418]: audit 2021-03-10T16:41:20.292888+0000 mon.a (mon.0) 3241 : audit [DBG] from='client.? 172.21.2.113:0/2523853560' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:21.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:20 gibba013 bash[30381]: cephadm 2021-03-10T16:41:19.116355+0000 mgr.gibba020.yqfnwy (mgr.34427) 8880 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:41:21.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:20 gibba013 bash[30381]: cluster 2021-03-10T16:41:19.788576+0000 mgr.gibba020.yqfnwy (mgr.34427) 8881 : cluster [DBG] pgmap v5058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:21.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:20 gibba013 bash[30381]: audit 2021-03-10T16:41:19.809337+0000 mgr.gibba020.yqfnwy (mgr.34427) 8882 : audit [DBG] from='client.59992 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:41:21.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:20 gibba013 bash[30381]: audit 2021-03-10T16:41:20.292888+0000 mon.a (mon.0) 3241 : audit [DBG] from='client.? 172.21.2.113:0/2523853560' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:21.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:21 gibba020 bash[25448]: audit 2021-03-10T16:41:20.037437+0000 mgr.gibba020.yqfnwy (mgr.34427) 8883 : audit [DBG] from='client.59998 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:41:22.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:21 gibba013 bash[29418]: audit 2021-03-10T16:41:20.037437+0000 mgr.gibba020.yqfnwy (mgr.34427) 8883 : audit [DBG] from='client.59998 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:41:22.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:21 gibba013 bash[30381]: audit 2021-03-10T16:41:20.037437+0000 mgr.gibba020.yqfnwy (mgr.34427) 8883 : audit [DBG] from='client.59998 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:41:22.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:22 gibba020 bash[25448]: cluster 2021-03-10T16:41:21.790393+0000 mgr.gibba020.yqfnwy (mgr.34427) 8884 : cluster [DBG] pgmap v5059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:23.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:22 gibba013 bash[29418]: cluster 2021-03-10T16:41:21.790393+0000 mgr.gibba020.yqfnwy (mgr.34427) 8884 : cluster [DBG] pgmap v5059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:23.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:22 gibba013 bash[30381]: cluster 2021-03-10T16:41:21.790393+0000 mgr.gibba020.yqfnwy (mgr.34427) 8884 : cluster [DBG] pgmap v5059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:25.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:24 gibba013 bash[29418]: cluster 2021-03-10T16:41:23.791768+0000 mgr.gibba020.yqfnwy (mgr.34427) 8885 : cluster [DBG] pgmap v5060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:25.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:24 gibba013 bash[30381]: cluster 2021-03-10T16:41:23.791768+0000 mgr.gibba020.yqfnwy (mgr.34427) 8885 : cluster [DBG] pgmap v5060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:25.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:24 gibba020 bash[25448]: cluster 2021-03-10T16:41:23.791768+0000 mgr.gibba020.yqfnwy (mgr.34427) 8885 : cluster [DBG] pgmap v5060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:27.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:26 gibba013 bash[29418]: cluster 2021-03-10T16:41:25.793552+0000 mgr.gibba020.yqfnwy (mgr.34427) 8886 : cluster [DBG] pgmap v5061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:27.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:26 gibba013 bash[30381]: cluster 2021-03-10T16:41:25.793552+0000 mgr.gibba020.yqfnwy (mgr.34427) 8886 : cluster [DBG] pgmap v5061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:27.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:26 gibba020 bash[25448]: cluster 2021-03-10T16:41:25.793552+0000 mgr.gibba020.yqfnwy (mgr.34427) 8886 : cluster [DBG] pgmap v5061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:29.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:28 gibba013 bash[29418]: cluster 2021-03-10T16:41:27.795120+0000 mgr.gibba020.yqfnwy (mgr.34427) 8887 : cluster [DBG] pgmap v5062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:29.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:28 gibba013 bash[30381]: cluster 2021-03-10T16:41:27.795120+0000 mgr.gibba020.yqfnwy (mgr.34427) 8887 : cluster [DBG] pgmap v5062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:29.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:28 gibba020 bash[25448]: cluster 2021-03-10T16:41:27.795120+0000 mgr.gibba020.yqfnwy (mgr.34427) 8887 : cluster [DBG] pgmap v5062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:30.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:30 gibba020 bash[25448]: cluster 2021-03-10T16:41:29.796797+0000 mgr.gibba020.yqfnwy (mgr.34427) 8888 : cluster [DBG] pgmap v5063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:31.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:30 gibba013 bash[29418]: cluster 2021-03-10T16:41:29.796797+0000 mgr.gibba020.yqfnwy (mgr.34427) 8888 : cluster [DBG] pgmap v5063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:31.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:30 gibba013 bash[30381]: cluster 2021-03-10T16:41:29.796797+0000 mgr.gibba020.yqfnwy (mgr.34427) 8888 : cluster [DBG] pgmap v5063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:33.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:32 gibba013 bash[29418]: cluster 2021-03-10T16:41:31.798451+0000 mgr.gibba020.yqfnwy (mgr.34427) 8889 : cluster [DBG] pgmap v5064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:33.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:32 gibba013 bash[30381]: cluster 2021-03-10T16:41:31.798451+0000 mgr.gibba020.yqfnwy (mgr.34427) 8889 : cluster [DBG] pgmap v5064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:33.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:32 gibba020 bash[25448]: cluster 2021-03-10T16:41:31.798451+0000 mgr.gibba020.yqfnwy (mgr.34427) 8889 : cluster [DBG] pgmap v5064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:35.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:34 gibba013 bash[29418]: cluster 2021-03-10T16:41:33.800000+0000 mgr.gibba020.yqfnwy (mgr.34427) 8890 : cluster [DBG] pgmap v5065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:35.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:34 gibba013 bash[30381]: cluster 2021-03-10T16:41:33.800000+0000 mgr.gibba020.yqfnwy (mgr.34427) 8890 : cluster [DBG] pgmap v5065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:35.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:34 gibba020 bash[25448]: cluster 2021-03-10T16:41:33.800000+0000 mgr.gibba020.yqfnwy (mgr.34427) 8890 : cluster [DBG] pgmap v5065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:36.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:35 gibba020 bash[25448]: cephadm 2021-03-10T16:41:34.129203+0000 mgr.gibba020.yqfnwy (mgr.34427) 8891 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:41:36.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:35 gibba013 bash[29418]: cephadm 2021-03-10T16:41:34.129203+0000 mgr.gibba020.yqfnwy (mgr.34427) 8891 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:41:36.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:35 gibba013 bash[30381]: cephadm 2021-03-10T16:41:34.129203+0000 mgr.gibba020.yqfnwy (mgr.34427) 8891 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:41:37.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:36 gibba020 bash[25448]: cluster 2021-03-10T16:41:35.801727+0000 mgr.gibba020.yqfnwy (mgr.34427) 8892 : cluster [DBG] pgmap v5066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:37.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:36 gibba013 bash[29418]: cluster 2021-03-10T16:41:35.801727+0000 mgr.gibba020.yqfnwy (mgr.34427) 8892 : cluster [DBG] pgmap v5066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:37.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:36 gibba013 bash[30381]: cluster 2021-03-10T16:41:35.801727+0000 mgr.gibba020.yqfnwy (mgr.34427) 8892 : cluster [DBG] pgmap v5066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:39.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:38 gibba020 bash[25448]: cluster 2021-03-10T16:41:37.803274+0000 mgr.gibba020.yqfnwy (mgr.34427) 8893 : cluster [DBG] pgmap v5067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:39.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:38 gibba013 bash[29418]: cluster 2021-03-10T16:41:37.803274+0000 mgr.gibba020.yqfnwy (mgr.34427) 8893 : cluster [DBG] pgmap v5067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:39.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:38 gibba013 bash[30381]: cluster 2021-03-10T16:41:37.803274+0000 mgr.gibba020.yqfnwy (mgr.34427) 8893 : cluster [DBG] pgmap v5067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:40.946 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:40 gibba020 bash[25448]: cluster 2021-03-10T16:41:39.804911+0000 mgr.gibba020.yqfnwy (mgr.34427) 8894 : cluster [DBG] pgmap v5068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:41.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:40 gibba013 bash[29418]: cluster 2021-03-10T16:41:39.804911+0000 mgr.gibba020.yqfnwy (mgr.34427) 8894 : cluster [DBG] pgmap v5068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:41.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:40 gibba013 bash[30381]: cluster 2021-03-10T16:41:39.804911+0000 mgr.gibba020.yqfnwy (mgr.34427) 8894 : cluster [DBG] pgmap v5068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:43.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:42 gibba013 bash[29418]: cluster 2021-03-10T16:41:41.806652+0000 mgr.gibba020.yqfnwy (mgr.34427) 8895 : cluster [DBG] pgmap v5069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:43.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:42 gibba013 bash[30381]: cluster 2021-03-10T16:41:41.806652+0000 mgr.gibba020.yqfnwy (mgr.34427) 8895 : cluster [DBG] pgmap v5069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:43.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:42 gibba020 bash[25448]: cluster 2021-03-10T16:41:41.806652+0000 mgr.gibba020.yqfnwy (mgr.34427) 8895 : cluster [DBG] pgmap v5069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:45.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:44 gibba013 bash[29418]: cluster 2021-03-10T16:41:43.808095+0000 mgr.gibba020.yqfnwy (mgr.34427) 8896 : cluster [DBG] pgmap v5070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:45.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:44 gibba013 bash[30381]: cluster 2021-03-10T16:41:43.808095+0000 mgr.gibba020.yqfnwy (mgr.34427) 8896 : cluster [DBG] pgmap v5070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:45.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:44 gibba020 bash[25448]: cluster 2021-03-10T16:41:43.808095+0000 mgr.gibba020.yqfnwy (mgr.34427) 8896 : cluster [DBG] pgmap v5070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:47.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:46 gibba020 bash[25448]: cluster 2021-03-10T16:41:45.809855+0000 mgr.gibba020.yqfnwy (mgr.34427) 8897 : cluster [DBG] pgmap v5071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:47.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:46 gibba013 bash[29418]: cluster 2021-03-10T16:41:45.809855+0000 mgr.gibba020.yqfnwy (mgr.34427) 8897 : cluster [DBG] pgmap v5071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:47.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:46 gibba013 bash[30381]: cluster 2021-03-10T16:41:45.809855+0000 mgr.gibba020.yqfnwy (mgr.34427) 8897 : cluster [DBG] pgmap v5071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:49.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:48 gibba020 bash[25448]: cluster 2021-03-10T16:41:47.811460+0000 mgr.gibba020.yqfnwy (mgr.34427) 8898 : cluster [DBG] pgmap v5072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:49.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:48 gibba013 bash[29418]: cluster 2021-03-10T16:41:47.811460+0000 mgr.gibba020.yqfnwy (mgr.34427) 8898 : cluster [DBG] pgmap v5072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:49.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:48 gibba013 bash[30381]: cluster 2021-03-10T16:41:47.811460+0000 mgr.gibba020.yqfnwy (mgr.34427) 8898 : cluster [DBG] pgmap v5072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:50.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:49 gibba020 bash[25448]: audit 2021-03-10T16:41:49.143714+0000 mon.a (mon.0) 3242 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:41:50.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:49 gibba020 bash[25448]: audit 2021-03-10T16:41:49.151071+0000 mon.a (mon.0) 3243 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:41:50.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:49 gibba013 bash[29418]: audit 2021-03-10T16:41:49.143714+0000 mon.a (mon.0) 3242 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:41:50.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:49 gibba013 bash[29418]: audit 2021-03-10T16:41:49.151071+0000 mon.a (mon.0) 3243 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:41:50.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:49 gibba013 bash[30381]: audit 2021-03-10T16:41:49.143714+0000 mon.a (mon.0) 3242 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:41:50.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:49 gibba013 bash[30381]: audit 2021-03-10T16:41:49.151071+0000 mon.a (mon.0) 3243 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:41:50.535 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:41:50.796 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:41:50.797 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 61s ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:41:50.797 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 10m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:41:50.798 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:41:50.798 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:41:50.799 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 61s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:41:50.799 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 61s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:41:50.799 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:41:50.800 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 61s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:41:50.800 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 61s ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:41:50.801 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 10m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:41:50.801 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 61s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:41:50.801 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 61s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:41:50.803 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 61s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:41:50.803 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 61s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:41:50.804 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:41:50.804 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:41:50.804 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:41:50.805 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 10m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:41:50.805 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 10m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:41:50.805 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 10m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:41:51.052 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:41:51.053 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:41:51.053 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:41:51.054 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:41:51.054 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:41:51.055 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:41:51.055 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:41:51.056 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:41:51.056 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:41:51.057 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:41:51.057 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:41:51.057 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:41:51.058 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:41:51.058 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:41:51.059 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:41:51.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:50 gibba020 bash[25448]: cephadm 2021-03-10T16:41:49.148883+0000 mgr.gibba020.yqfnwy (mgr.34427) 8899 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:41:51.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:50 gibba020 bash[25448]: cluster 2021-03-10T16:41:49.812841+0000 mgr.gibba020.yqfnwy (mgr.34427) 8900 : cluster [DBG] pgmap v5073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:51.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:50 gibba013 bash[29418]: cephadm 2021-03-10T16:41:49.148883+0000 mgr.gibba020.yqfnwy (mgr.34427) 8899 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:41:51.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:50 gibba013 bash[29418]: cluster 2021-03-10T16:41:49.812841+0000 mgr.gibba020.yqfnwy (mgr.34427) 8900 : cluster [DBG] pgmap v5073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:51.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:50 gibba013 bash[30381]: cephadm 2021-03-10T16:41:49.148883+0000 mgr.gibba020.yqfnwy (mgr.34427) 8899 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:41:51.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:50 gibba013 bash[30381]: cluster 2021-03-10T16:41:49.812841+0000 mgr.gibba020.yqfnwy (mgr.34427) 8900 : cluster [DBG] pgmap v5073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:52.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:51 gibba020 bash[25448]: audit 2021-03-10T16:41:50.527075+0000 mgr.gibba020.yqfnwy (mgr.34427) 8901 : audit [DBG] from='client.60010 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:41:52.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:51 gibba020 bash[25448]: audit 2021-03-10T16:41:50.756679+0000 mgr.gibba020.yqfnwy (mgr.34427) 8902 : audit [DBG] from='client.50034 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:41:52.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:51 gibba020 bash[25448]: audit 2021-03-10T16:41:51.054214+0000 mon.c (mon.1) 140 : audit [DBG] from='client.? 172.21.2.113:0/3625623961' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:52.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:51 gibba013 bash[29418]: audit 2021-03-10T16:41:50.527075+0000 mgr.gibba020.yqfnwy (mgr.34427) 8901 : audit [DBG] from='client.60010 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:41:52.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:51 gibba013 bash[29418]: audit 2021-03-10T16:41:50.756679+0000 mgr.gibba020.yqfnwy (mgr.34427) 8902 : audit [DBG] from='client.50034 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:41:52.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:51 gibba013 bash[29418]: audit 2021-03-10T16:41:51.054214+0000 mon.c (mon.1) 140 : audit [DBG] from='client.? 172.21.2.113:0/3625623961' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:52.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:51 gibba013 bash[30381]: audit 2021-03-10T16:41:50.527075+0000 mgr.gibba020.yqfnwy (mgr.34427) 8901 : audit [DBG] from='client.60010 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:41:52.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:51 gibba013 bash[30381]: audit 2021-03-10T16:41:50.756679+0000 mgr.gibba020.yqfnwy (mgr.34427) 8902 : audit [DBG] from='client.50034 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:41:52.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:51 gibba013 bash[30381]: audit 2021-03-10T16:41:51.054214+0000 mon.c (mon.1) 140 : audit [DBG] from='client.? 172.21.2.113:0/3625623961' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:53.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:52 gibba020 bash[25448]: cluster 2021-03-10T16:41:51.814539+0000 mgr.gibba020.yqfnwy (mgr.34427) 8903 : cluster [DBG] pgmap v5074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:53.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:52 gibba020 bash[25448]: audit 2021-03-10T16:41:52.893763+0000 mon.a (mon.0) 3244 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:41:53.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:52 gibba013 bash[29418]: cluster 2021-03-10T16:41:51.814539+0000 mgr.gibba020.yqfnwy (mgr.34427) 8903 : cluster [DBG] pgmap v5074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:53.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:52 gibba013 bash[29418]: audit 2021-03-10T16:41:52.893763+0000 mon.a (mon.0) 3244 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:41:53.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:52 gibba013 bash[30381]: cluster 2021-03-10T16:41:51.814539+0000 mgr.gibba020.yqfnwy (mgr.34427) 8903 : cluster [DBG] pgmap v5074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:53.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:52 gibba013 bash[30381]: audit 2021-03-10T16:41:52.893763+0000 mon.a (mon.0) 3244 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:41:54.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:53 gibba020 bash[25448]: cephadm 2021-03-10T16:41:52.893837+0000 mgr.gibba020.yqfnwy (mgr.34427) 8904 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:41:54.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:53 gibba020 bash[25448]: audit 2021-03-10T16:41:53.085142+0000 mon.a (mon.0) 3245 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:41:54.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:53 gibba020 bash[25448]: audit 2021-03-10T16:41:53.088802+0000 mon.a (mon.0) 3246 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:41:54.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:53 gibba020 bash[25448]: audit 2021-03-10T16:41:53.091093+0000 mon.a (mon.0) 3247 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:54.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:53 gibba020 bash[25448]: audit 2021-03-10T16:41:53.093442+0000 mon.a (mon.0) 3248 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:54.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:53 gibba020 bash[25448]: audit 2021-03-10T16:41:53.095210+0000 mon.a (mon.0) 3249 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:54.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:53 gibba020 bash[25448]: audit 2021-03-10T16:41:53.099224+0000 mon.a (mon.0) 3250 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:54.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:53 gibba020 bash[25448]: audit 2021-03-10T16:41:53.101236+0000 mon.a (mon.0) 3251 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:54.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:53 gibba013 bash[29418]: cephadm 2021-03-10T16:41:52.893837+0000 mgr.gibba020.yqfnwy (mgr.34427) 8904 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:41:54.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:53 gibba013 bash[29418]: audit 2021-03-10T16:41:53.085142+0000 mon.a (mon.0) 3245 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:41:54.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:53 gibba013 bash[29418]: audit 2021-03-10T16:41:53.088802+0000 mon.a (mon.0) 3246 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:41:54.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:53 gibba013 bash[29418]: audit 2021-03-10T16:41:53.091093+0000 mon.a (mon.0) 3247 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:54.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:53 gibba013 bash[29418]: audit 2021-03-10T16:41:53.093442+0000 mon.a (mon.0) 3248 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:54.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:53 gibba013 bash[29418]: audit 2021-03-10T16:41:53.095210+0000 mon.a (mon.0) 3249 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:54.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:53 gibba013 bash[29418]: audit 2021-03-10T16:41:53.099224+0000 mon.a (mon.0) 3250 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:54.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:53 gibba013 bash[29418]: audit 2021-03-10T16:41:53.101236+0000 mon.a (mon.0) 3251 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:54.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:53 gibba013 bash[30381]: cephadm 2021-03-10T16:41:52.893837+0000 mgr.gibba020.yqfnwy (mgr.34427) 8904 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:41:54.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:53 gibba013 bash[30381]: audit 2021-03-10T16:41:53.085142+0000 mon.a (mon.0) 3245 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:41:54.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:53 gibba013 bash[30381]: audit 2021-03-10T16:41:53.088802+0000 mon.a (mon.0) 3246 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:41:54.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:53 gibba013 bash[30381]: audit 2021-03-10T16:41:53.091093+0000 mon.a (mon.0) 3247 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:54.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:53 gibba013 bash[30381]: audit 2021-03-10T16:41:53.093442+0000 mon.a (mon.0) 3248 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:54.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:53 gibba013 bash[30381]: audit 2021-03-10T16:41:53.095210+0000 mon.a (mon.0) 3249 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:54.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:53 gibba013 bash[30381]: audit 2021-03-10T16:41:53.099224+0000 mon.a (mon.0) 3250 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:54.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:53 gibba013 bash[30381]: audit 2021-03-10T16:41:53.101236+0000 mon.a (mon.0) 3251 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:41:55.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:54 gibba020 bash[25448]: cephadm 2021-03-10T16:41:53.087502+0000 mgr.gibba020.yqfnwy (mgr.34427) 8905 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:41:55.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:54 gibba020 bash[25448]: cephadm 2021-03-10T16:41:53.089761+0000 mgr.gibba020.yqfnwy (mgr.34427) 8906 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:41:55.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:54 gibba020 bash[25448]: cephadm 2021-03-10T16:41:53.092220+0000 mgr.gibba020.yqfnwy (mgr.34427) 8907 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:41:55.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:54 gibba020 bash[25448]: cephadm 2021-03-10T16:41:53.092271+0000 mgr.gibba020.yqfnwy (mgr.34427) 8908 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:41:55.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:54 gibba020 bash[25448]: cephadm 2021-03-10T16:41:53.094043+0000 mgr.gibba020.yqfnwy (mgr.34427) 8909 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:41:55.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:54 gibba020 bash[25448]: cephadm 2021-03-10T16:41:53.094079+0000 mgr.gibba020.yqfnwy (mgr.34427) 8910 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:41:55.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:54 gibba020 bash[25448]: cephadm 2021-03-10T16:41:53.096260+0000 mgr.gibba020.yqfnwy (mgr.34427) 8911 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:41:55.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:54 gibba020 bash[25448]: cephadm 2021-03-10T16:41:53.097933+0000 mgr.gibba020.yqfnwy (mgr.34427) 8912 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:41:55.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:54 gibba020 bash[25448]: cephadm 2021-03-10T16:41:53.098109+0000 mgr.gibba020.yqfnwy (mgr.34427) 8913 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:41:55.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:54 gibba020 bash[25448]: cephadm 2021-03-10T16:41:53.099866+0000 mgr.gibba020.yqfnwy (mgr.34427) 8914 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:41:55.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:54 gibba020 bash[25448]: cephadm 2021-03-10T16:41:53.100301+0000 mgr.gibba020.yqfnwy (mgr.34427) 8915 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:41:55.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:54 gibba020 bash[25448]: cephadm 2021-03-10T16:41:53.101961+0000 mgr.gibba020.yqfnwy (mgr.34427) 8916 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:41:55.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:54 gibba020 bash[25448]: cephadm 2021-03-10T16:41:53.102000+0000 mgr.gibba020.yqfnwy (mgr.34427) 8917 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:41:55.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:54 gibba020 bash[25448]: cephadm 2021-03-10T16:41:53.102104+0000 mgr.gibba020.yqfnwy (mgr.34427) 8918 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:41:55.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:54 gibba020 bash[25448]: cluster 2021-03-10T16:41:53.815985+0000 mgr.gibba020.yqfnwy (mgr.34427) 8919 : cluster [DBG] pgmap v5075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:55.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:54 gibba013 bash[29418]: cephadm 2021-03-10T16:41:53.087502+0000 mgr.gibba020.yqfnwy (mgr.34427) 8905 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:41:55.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:54 gibba013 bash[29418]: cephadm 2021-03-10T16:41:53.089761+0000 mgr.gibba020.yqfnwy (mgr.34427) 8906 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:41:55.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:54 gibba013 bash[29418]: cephadm 2021-03-10T16:41:53.092220+0000 mgr.gibba020.yqfnwy (mgr.34427) 8907 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:41:55.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:54 gibba013 bash[29418]: cephadm 2021-03-10T16:41:53.092271+0000 mgr.gibba020.yqfnwy (mgr.34427) 8908 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:41:55.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:54 gibba013 bash[29418]: cephadm 2021-03-10T16:41:53.094043+0000 mgr.gibba020.yqfnwy (mgr.34427) 8909 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:41:55.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:54 gibba013 bash[29418]: cephadm 2021-03-10T16:41:53.094079+0000 mgr.gibba020.yqfnwy (mgr.34427) 8910 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:41:55.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:54 gibba013 bash[29418]: cephadm 2021-03-10T16:41:53.096260+0000 mgr.gibba020.yqfnwy (mgr.34427) 8911 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:41:55.398 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:54 gibba013 bash[29418]: cephadm 2021-03-10T16:41:53.097933+0000 mgr.gibba020.yqfnwy (mgr.34427) 8912 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:41:55.398 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:54 gibba013 bash[29418]: cephadm 2021-03-10T16:41:53.098109+0000 mgr.gibba020.yqfnwy (mgr.34427) 8913 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:41:55.399 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:54 gibba013 bash[29418]: cephadm 2021-03-10T16:41:53.099866+0000 mgr.gibba020.yqfnwy (mgr.34427) 8914 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:41:55.399 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:54 gibba013 bash[29418]: cephadm 2021-03-10T16:41:53.100301+0000 mgr.gibba020.yqfnwy (mgr.34427) 8915 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:41:55.399 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:54 gibba013 bash[29418]: cephadm 2021-03-10T16:41:53.101961+0000 mgr.gibba020.yqfnwy (mgr.34427) 8916 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:41:55.400 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:54 gibba013 bash[29418]: cephadm 2021-03-10T16:41:53.102000+0000 mgr.gibba020.yqfnwy (mgr.34427) 8917 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:41:55.400 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:54 gibba013 bash[29418]: cephadm 2021-03-10T16:41:53.102104+0000 mgr.gibba020.yqfnwy (mgr.34427) 8918 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:41:55.406 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:54 gibba013 bash[29418]: cluster 2021-03-10T16:41:53.815985+0000 mgr.gibba020.yqfnwy (mgr.34427) 8919 : cluster [DBG] pgmap v5075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:55.408 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:54 gibba013 bash[30381]: cephadm 2021-03-10T16:41:53.087502+0000 mgr.gibba020.yqfnwy (mgr.34427) 8905 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:41:55.409 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:54 gibba013 bash[30381]: cephadm 2021-03-10T16:41:53.089761+0000 mgr.gibba020.yqfnwy (mgr.34427) 8906 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:41:55.414 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:54 gibba013 bash[30381]: cephadm 2021-03-10T16:41:53.092220+0000 mgr.gibba020.yqfnwy (mgr.34427) 8907 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:41:55.415 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:54 gibba013 bash[30381]: cephadm 2021-03-10T16:41:53.092271+0000 mgr.gibba020.yqfnwy (mgr.34427) 8908 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:41:55.415 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:54 gibba013 bash[30381]: cephadm 2021-03-10T16:41:53.094043+0000 mgr.gibba020.yqfnwy (mgr.34427) 8909 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:41:55.415 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:54 gibba013 bash[30381]: cephadm 2021-03-10T16:41:53.094079+0000 mgr.gibba020.yqfnwy (mgr.34427) 8910 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:41:55.416 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:54 gibba013 bash[30381]: cephadm 2021-03-10T16:41:53.096260+0000 mgr.gibba020.yqfnwy (mgr.34427) 8911 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:41:55.416 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:54 gibba013 bash[30381]: cephadm 2021-03-10T16:41:53.097933+0000 mgr.gibba020.yqfnwy (mgr.34427) 8912 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:41:55.417 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:54 gibba013 bash[30381]: cephadm 2021-03-10T16:41:53.098109+0000 mgr.gibba020.yqfnwy (mgr.34427) 8913 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:41:55.417 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:54 gibba013 bash[30381]: cephadm 2021-03-10T16:41:53.099866+0000 mgr.gibba020.yqfnwy (mgr.34427) 8914 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:41:55.418 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:54 gibba013 bash[30381]: cephadm 2021-03-10T16:41:53.100301+0000 mgr.gibba020.yqfnwy (mgr.34427) 8915 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:41:55.418 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:54 gibba013 bash[30381]: cephadm 2021-03-10T16:41:53.101961+0000 mgr.gibba020.yqfnwy (mgr.34427) 8916 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:41:55.441 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:54 gibba013 bash[30381]: cephadm 2021-03-10T16:41:53.102000+0000 mgr.gibba020.yqfnwy (mgr.34427) 8917 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:41:55.441 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:54 gibba013 bash[30381]: cephadm 2021-03-10T16:41:53.102104+0000 mgr.gibba020.yqfnwy (mgr.34427) 8918 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:41:55.442 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:54 gibba013 bash[30381]: cluster 2021-03-10T16:41:53.815985+0000 mgr.gibba020.yqfnwy (mgr.34427) 8919 : cluster [DBG] pgmap v5075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:57.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:56 gibba020 bash[25448]: cluster 2021-03-10T16:41:55.817534+0000 mgr.gibba020.yqfnwy (mgr.34427) 8920 : cluster [DBG] pgmap v5076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:57.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:56 gibba013 bash[29418]: cluster 2021-03-10T16:41:55.817534+0000 mgr.gibba020.yqfnwy (mgr.34427) 8920 : cluster [DBG] pgmap v5076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:57.377 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:56 gibba013 bash[30381]: cluster 2021-03-10T16:41:55.817534+0000 mgr.gibba020.yqfnwy (mgr.34427) 8920 : cluster [DBG] pgmap v5076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:59.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:41:58 gibba013 bash[29418]: cluster 2021-03-10T16:41:57.819067+0000 mgr.gibba020.yqfnwy (mgr.34427) 8921 : cluster [DBG] pgmap v5077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:59.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:41:58 gibba013 bash[30381]: cluster 2021-03-10T16:41:57.819067+0000 mgr.gibba020.yqfnwy (mgr.34427) 8921 : cluster [DBG] pgmap v5077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:41:59.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:41:58 gibba020 bash[25448]: cluster 2021-03-10T16:41:57.819067+0000 mgr.gibba020.yqfnwy (mgr.34427) 8921 : cluster [DBG] pgmap v5077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:00.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:00 gibba020 bash[25448]: cluster 2021-03-10T16:41:59.820850+0000 mgr.gibba020.yqfnwy (mgr.34427) 8922 : cluster [DBG] pgmap v5078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:01.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:00 gibba013 bash[29418]: cluster 2021-03-10T16:41:59.820850+0000 mgr.gibba020.yqfnwy (mgr.34427) 8922 : cluster [DBG] pgmap v5078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:01.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:00 gibba013 bash[30381]: cluster 2021-03-10T16:41:59.820850+0000 mgr.gibba020.yqfnwy (mgr.34427) 8922 : cluster [DBG] pgmap v5078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:03.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:02 gibba020 bash[25448]: cluster 2021-03-10T16:42:01.822561+0000 mgr.gibba020.yqfnwy (mgr.34427) 8923 : cluster [DBG] pgmap v5079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:03.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:02 gibba013 bash[29418]: cluster 2021-03-10T16:42:01.822561+0000 mgr.gibba020.yqfnwy (mgr.34427) 8923 : cluster [DBG] pgmap v5079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:03.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:02 gibba013 bash[30381]: cluster 2021-03-10T16:42:01.822561+0000 mgr.gibba020.yqfnwy (mgr.34427) 8923 : cluster [DBG] pgmap v5079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:05.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:04 gibba020 bash[25448]: cluster 2021-03-10T16:42:03.823924+0000 mgr.gibba020.yqfnwy (mgr.34427) 8924 : cluster [DBG] pgmap v5080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:05.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:04 gibba013 bash[29418]: cluster 2021-03-10T16:42:03.823924+0000 mgr.gibba020.yqfnwy (mgr.34427) 8924 : cluster [DBG] pgmap v5080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:05.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:04 gibba013 bash[30381]: cluster 2021-03-10T16:42:03.823924+0000 mgr.gibba020.yqfnwy (mgr.34427) 8924 : cluster [DBG] pgmap v5080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:07.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:06 gibba020 bash[25448]: cluster 2021-03-10T16:42:05.825750+0000 mgr.gibba020.yqfnwy (mgr.34427) 8925 : cluster [DBG] pgmap v5081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:07.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:06 gibba020 bash[25448]: audit 2021-03-10T16:42:06.771987+0000 mon.a (mon.0) 3252 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:42:07.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:06 gibba013 bash[29418]: cluster 2021-03-10T16:42:05.825750+0000 mgr.gibba020.yqfnwy (mgr.34427) 8925 : cluster [DBG] pgmap v5081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:07.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:06 gibba013 bash[29418]: audit 2021-03-10T16:42:06.771987+0000 mon.a (mon.0) 3252 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:42:07.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:06 gibba013 bash[30381]: cluster 2021-03-10T16:42:05.825750+0000 mgr.gibba020.yqfnwy (mgr.34427) 8925 : cluster [DBG] pgmap v5081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:07.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:06 gibba013 bash[30381]: audit 2021-03-10T16:42:06.771987+0000 mon.a (mon.0) 3252 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:42:08.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:07 gibba020 bash[25448]: audit 2021-03-10T16:42:06.939475+0000 mon.a (mon.0) 3253 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:42:08.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:07 gibba020 bash[25448]: audit 2021-03-10T16:42:07.286066+0000 mon.a (mon.0) 3254 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:42:08.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:07 gibba020 bash[25448]: audit 2021-03-10T16:42:07.286871+0000 mon.a (mon.0) 3255 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:42:08.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:07 gibba020 bash[25448]: audit 2021-03-10T16:42:07.287535+0000 mon.a (mon.0) 3256 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:42:08.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:07 gibba020 bash[25448]: audit 2021-03-10T16:42:07.288189+0000 mon.a (mon.0) 3257 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:42:08.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:07 gibba013 bash[29418]: audit 2021-03-10T16:42:06.939475+0000 mon.a (mon.0) 3253 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:42:08.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:07 gibba013 bash[29418]: audit 2021-03-10T16:42:07.286066+0000 mon.a (mon.0) 3254 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:42:08.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:07 gibba013 bash[29418]: audit 2021-03-10T16:42:07.286871+0000 mon.a (mon.0) 3255 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:42:08.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:07 gibba013 bash[29418]: audit 2021-03-10T16:42:07.287535+0000 mon.a (mon.0) 3256 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:42:08.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:07 gibba013 bash[29418]: audit 2021-03-10T16:42:07.288189+0000 mon.a (mon.0) 3257 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:42:08.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:07 gibba013 bash[30381]: audit 2021-03-10T16:42:06.939475+0000 mon.a (mon.0) 3253 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:42:08.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:07 gibba013 bash[30381]: audit 2021-03-10T16:42:07.286066+0000 mon.a (mon.0) 3254 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:42:08.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:07 gibba013 bash[30381]: audit 2021-03-10T16:42:07.286871+0000 mon.a (mon.0) 3255 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:42:08.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:07 gibba013 bash[30381]: audit 2021-03-10T16:42:07.287535+0000 mon.a (mon.0) 3256 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T16:42:08.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:07 gibba013 bash[30381]: audit 2021-03-10T16:42:07.288189+0000 mon.a (mon.0) 3257 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:42:09.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:08 gibba020 bash[25448]: cluster 2021-03-10T16:42:07.827357+0000 mgr.gibba020.yqfnwy (mgr.34427) 8926 : cluster [DBG] pgmap v5082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:09.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:08 gibba013 bash[29418]: cluster 2021-03-10T16:42:07.827357+0000 mgr.gibba020.yqfnwy (mgr.34427) 8926 : cluster [DBG] pgmap v5082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:09.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:08 gibba013 bash[30381]: cluster 2021-03-10T16:42:07.827357+0000 mgr.gibba020.yqfnwy (mgr.34427) 8926 : cluster [DBG] pgmap v5082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:10.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:09 gibba020 bash[25448]: cephadm 2021-03-10T16:42:08.116778+0000 mgr.gibba020.yqfnwy (mgr.34427) 8927 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:42:10.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:09 gibba013 bash[29418]: cephadm 2021-03-10T16:42:08.116778+0000 mgr.gibba020.yqfnwy (mgr.34427) 8927 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:42:10.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:09 gibba013 bash[30381]: cephadm 2021-03-10T16:42:08.116778+0000 mgr.gibba020.yqfnwy (mgr.34427) 8927 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:42:11.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:10 gibba020 bash[25448]: cluster 2021-03-10T16:42:09.829088+0000 mgr.gibba020.yqfnwy (mgr.34427) 8928 : cluster [DBG] pgmap v5083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:11.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:10 gibba013 bash[29418]: cluster 2021-03-10T16:42:09.829088+0000 mgr.gibba020.yqfnwy (mgr.34427) 8928 : cluster [DBG] pgmap v5083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:11.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:10 gibba013 bash[30381]: cluster 2021-03-10T16:42:09.829088+0000 mgr.gibba020.yqfnwy (mgr.34427) 8928 : cluster [DBG] pgmap v5083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:13.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:12 gibba020 bash[25448]: cluster 2021-03-10T16:42:11.830493+0000 mgr.gibba020.yqfnwy (mgr.34427) 8929 : cluster [DBG] pgmap v5084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:13.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:12 gibba013 bash[29418]: cluster 2021-03-10T16:42:11.830493+0000 mgr.gibba020.yqfnwy (mgr.34427) 8929 : cluster [DBG] pgmap v5084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:13.377 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:12 gibba013 bash[30381]: cluster 2021-03-10T16:42:11.830493+0000 mgr.gibba020.yqfnwy (mgr.34427) 8929 : cluster [DBG] pgmap v5084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:15.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:14 gibba020 bash[25448]: cluster 2021-03-10T16:42:13.831879+0000 mgr.gibba020.yqfnwy (mgr.34427) 8930 : cluster [DBG] pgmap v5085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:15.377 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:14 gibba013 bash[30381]: cluster 2021-03-10T16:42:13.831879+0000 mgr.gibba020.yqfnwy (mgr.34427) 8930 : cluster [DBG] pgmap v5085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:15.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:14 gibba013 bash[29418]: cluster 2021-03-10T16:42:13.831879+0000 mgr.gibba020.yqfnwy (mgr.34427) 8930 : cluster [DBG] pgmap v5085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:17.377 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:16 gibba013 bash[30381]: cluster 2021-03-10T16:42:15.833323+0000 mgr.gibba020.yqfnwy (mgr.34427) 8931 : cluster [DBG] pgmap v5086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:17.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:16 gibba013 bash[29418]: cluster 2021-03-10T16:42:15.833323+0000 mgr.gibba020.yqfnwy (mgr.34427) 8931 : cluster [DBG] pgmap v5086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:17.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:16 gibba020 bash[25448]: cluster 2021-03-10T16:42:15.833323+0000 mgr.gibba020.yqfnwy (mgr.34427) 8931 : cluster [DBG] pgmap v5086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:19.377 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:18 gibba013 bash[30381]: cluster 2021-03-10T16:42:17.834886+0000 mgr.gibba020.yqfnwy (mgr.34427) 8932 : cluster [DBG] pgmap v5087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:19.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:18 gibba013 bash[29418]: cluster 2021-03-10T16:42:17.834886+0000 mgr.gibba020.yqfnwy (mgr.34427) 8932 : cluster [DBG] pgmap v5087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:19.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:18 gibba020 bash[25448]: cluster 2021-03-10T16:42:17.834886+0000 mgr.gibba020.yqfnwy (mgr.34427) 8932 : cluster [DBG] pgmap v5087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:20.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:20 gibba020 bash[25448]: cluster 2021-03-10T16:42:19.836648+0000 mgr.gibba020.yqfnwy (mgr.34427) 8933 : cluster [DBG] pgmap v5088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:21.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:20 gibba013 bash[29418]: cluster 2021-03-10T16:42:19.836648+0000 mgr.gibba020.yqfnwy (mgr.34427) 8933 : cluster [DBG] pgmap v5088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:21.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:20 gibba013 bash[30381]: cluster 2021-03-10T16:42:19.836648+0000 mgr.gibba020.yqfnwy (mgr.34427) 8933 : cluster [DBG] pgmap v5088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:21.295 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:42:21.555 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:42:21.556 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 92s ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:42:21.556 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 28s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:42:21.556 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 28s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:42:21.557 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 28s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:42:21.557 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 92s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:42:21.557 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 92s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:42:21.558 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 28s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:42:21.563 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 92s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:42:21.563 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 92s ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:42:21.563 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 28s ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:42:21.564 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 92s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:42:21.564 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 92s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:42:21.564 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 92s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:42:21.565 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 92s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:42:21.565 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 28s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:42:21.565 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 28s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:42:21.566 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 28s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:42:21.566 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 28s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:42:21.566 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 28s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:42:21.567 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 28s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:42:21.817 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:42:21.818 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:42:21.818 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:42:21.818 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:42:21.819 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:42:21.819 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:42:21.819 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:42:21.820 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:42:21.820 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:42:21.821 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:42:21.821 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:42:21.821 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:42:21.822 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:42:21.822 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:42:21.823 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:42:22.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:21 gibba013 bash[29418]: audit 2021-03-10T16:42:21.818848+0000 mon.a (mon.0) 3258 : audit [DBG] from='client.? 172.21.2.113:0/2278273088' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:22.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:21 gibba013 bash[30381]: audit 2021-03-10T16:42:21.818848+0000 mon.a (mon.0) 3258 : audit [DBG] from='client.? 172.21.2.113:0/2278273088' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:22.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:21 gibba020 bash[25448]: audit 2021-03-10T16:42:21.818848+0000 mon.a (mon.0) 3258 : audit [DBG] from='client.? 172.21.2.113:0/2278273088' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:23.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:22 gibba020 bash[25448]: audit 2021-03-10T16:42:21.287209+0000 mgr.gibba020.yqfnwy (mgr.34427) 8934 : audit [DBG] from='client.50046 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:42:23.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:22 gibba020 bash[25448]: audit 2021-03-10T16:42:21.515115+0000 mgr.gibba020.yqfnwy (mgr.34427) 8935 : audit [DBG] from='client.50052 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:42:23.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:22 gibba020 bash[25448]: cluster 2021-03-10T16:42:21.838221+0000 mgr.gibba020.yqfnwy (mgr.34427) 8936 : cluster [DBG] pgmap v5089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:23.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:22 gibba013 bash[29418]: audit 2021-03-10T16:42:21.287209+0000 mgr.gibba020.yqfnwy (mgr.34427) 8934 : audit [DBG] from='client.50046 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:42:23.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:22 gibba013 bash[29418]: audit 2021-03-10T16:42:21.515115+0000 mgr.gibba020.yqfnwy (mgr.34427) 8935 : audit [DBG] from='client.50052 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:42:23.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:22 gibba013 bash[29418]: cluster 2021-03-10T16:42:21.838221+0000 mgr.gibba020.yqfnwy (mgr.34427) 8936 : cluster [DBG] pgmap v5089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:23.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:22 gibba013 bash[30381]: audit 2021-03-10T16:42:21.287209+0000 mgr.gibba020.yqfnwy (mgr.34427) 8934 : audit [DBG] from='client.50046 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:42:23.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:22 gibba013 bash[30381]: audit 2021-03-10T16:42:21.515115+0000 mgr.gibba020.yqfnwy (mgr.34427) 8935 : audit [DBG] from='client.50052 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:42:23.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:22 gibba013 bash[30381]: cluster 2021-03-10T16:42:21.838221+0000 mgr.gibba020.yqfnwy (mgr.34427) 8936 : cluster [DBG] pgmap v5089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:25.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:24 gibba020 bash[25448]: cephadm 2021-03-10T16:42:23.132199+0000 mgr.gibba020.yqfnwy (mgr.34427) 8937 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:42:25.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:24 gibba020 bash[25448]: cluster 2021-03-10T16:42:23.839614+0000 mgr.gibba020.yqfnwy (mgr.34427) 8938 : cluster [DBG] pgmap v5090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:25.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:24 gibba013 bash[29418]: cephadm 2021-03-10T16:42:23.132199+0000 mgr.gibba020.yqfnwy (mgr.34427) 8937 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:42:25.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:24 gibba013 bash[29418]: cluster 2021-03-10T16:42:23.839614+0000 mgr.gibba020.yqfnwy (mgr.34427) 8938 : cluster [DBG] pgmap v5090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:25.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:24 gibba013 bash[30381]: cephadm 2021-03-10T16:42:23.132199+0000 mgr.gibba020.yqfnwy (mgr.34427) 8937 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:42:25.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:24 gibba013 bash[30381]: cluster 2021-03-10T16:42:23.839614+0000 mgr.gibba020.yqfnwy (mgr.34427) 8938 : cluster [DBG] pgmap v5090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:27.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:26 gibba020 bash[25448]: cluster 2021-03-10T16:42:25.841358+0000 mgr.gibba020.yqfnwy (mgr.34427) 8939 : cluster [DBG] pgmap v5091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:27.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:26 gibba013 bash[29418]: cluster 2021-03-10T16:42:25.841358+0000 mgr.gibba020.yqfnwy (mgr.34427) 8939 : cluster [DBG] pgmap v5091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:27.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:26 gibba013 bash[30381]: cluster 2021-03-10T16:42:25.841358+0000 mgr.gibba020.yqfnwy (mgr.34427) 8939 : cluster [DBG] pgmap v5091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:29.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:28 gibba020 bash[25448]: cluster 2021-03-10T16:42:27.843025+0000 mgr.gibba020.yqfnwy (mgr.34427) 8940 : cluster [DBG] pgmap v5092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:29.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:28 gibba013 bash[29418]: cluster 2021-03-10T16:42:27.843025+0000 mgr.gibba020.yqfnwy (mgr.34427) 8940 : cluster [DBG] pgmap v5092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:29.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:28 gibba013 bash[30381]: cluster 2021-03-10T16:42:27.843025+0000 mgr.gibba020.yqfnwy (mgr.34427) 8940 : cluster [DBG] pgmap v5092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:30.945 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:30 gibba020 bash[25448]: cluster 2021-03-10T16:42:29.845053+0000 mgr.gibba020.yqfnwy (mgr.34427) 8941 : cluster [DBG] pgmap v5093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:31.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:30 gibba013 bash[29418]: cluster 2021-03-10T16:42:29.845053+0000 mgr.gibba020.yqfnwy (mgr.34427) 8941 : cluster [DBG] pgmap v5093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:31.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:30 gibba013 bash[30381]: cluster 2021-03-10T16:42:29.845053+0000 mgr.gibba020.yqfnwy (mgr.34427) 8941 : cluster [DBG] pgmap v5093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:33.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:32 gibba020 bash[25448]: cluster 2021-03-10T16:42:31.846713+0000 mgr.gibba020.yqfnwy (mgr.34427) 8942 : cluster [DBG] pgmap v5094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:33.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:32 gibba013 bash[29418]: cluster 2021-03-10T16:42:31.846713+0000 mgr.gibba020.yqfnwy (mgr.34427) 8942 : cluster [DBG] pgmap v5094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:33.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:32 gibba013 bash[30381]: cluster 2021-03-10T16:42:31.846713+0000 mgr.gibba020.yqfnwy (mgr.34427) 8942 : cluster [DBG] pgmap v5094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:35.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:34 gibba020 bash[25448]: cluster 2021-03-10T16:42:33.848398+0000 mgr.gibba020.yqfnwy (mgr.34427) 8943 : cluster [DBG] pgmap v5095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:35.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:34 gibba013 bash[29418]: cluster 2021-03-10T16:42:33.848398+0000 mgr.gibba020.yqfnwy (mgr.34427) 8943 : cluster [DBG] pgmap v5095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:35.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:34 gibba013 bash[30381]: cluster 2021-03-10T16:42:33.848398+0000 mgr.gibba020.yqfnwy (mgr.34427) 8943 : cluster [DBG] pgmap v5095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:37.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:36 gibba020 bash[25448]: cluster 2021-03-10T16:42:35.850225+0000 mgr.gibba020.yqfnwy (mgr.34427) 8944 : cluster [DBG] pgmap v5096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:37.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:36 gibba013 bash[29418]: cluster 2021-03-10T16:42:35.850225+0000 mgr.gibba020.yqfnwy (mgr.34427) 8944 : cluster [DBG] pgmap v5096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:37.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:36 gibba013 bash[30381]: cluster 2021-03-10T16:42:35.850225+0000 mgr.gibba020.yqfnwy (mgr.34427) 8944 : cluster [DBG] pgmap v5096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:39.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:38 gibba020 bash[25448]: cluster 2021-03-10T16:42:37.851679+0000 mgr.gibba020.yqfnwy (mgr.34427) 8945 : cluster [DBG] pgmap v5097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:39.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:38 gibba013 bash[29418]: cluster 2021-03-10T16:42:37.851679+0000 mgr.gibba020.yqfnwy (mgr.34427) 8945 : cluster [DBG] pgmap v5097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:39.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:38 gibba013 bash[30381]: cluster 2021-03-10T16:42:37.851679+0000 mgr.gibba020.yqfnwy (mgr.34427) 8945 : cluster [DBG] pgmap v5097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:40.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:39 gibba020 bash[25448]: cephadm 2021-03-10T16:42:38.148031+0000 mgr.gibba020.yqfnwy (mgr.34427) 8946 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:42:40.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:39 gibba013 bash[29418]: cephadm 2021-03-10T16:42:38.148031+0000 mgr.gibba020.yqfnwy (mgr.34427) 8946 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:42:40.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:39 gibba013 bash[30381]: cephadm 2021-03-10T16:42:38.148031+0000 mgr.gibba020.yqfnwy (mgr.34427) 8946 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:42:41.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:40 gibba020 bash[25448]: cluster 2021-03-10T16:42:39.853514+0000 mgr.gibba020.yqfnwy (mgr.34427) 8947 : cluster [DBG] pgmap v5098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:41.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:40 gibba013 bash[29418]: cluster 2021-03-10T16:42:39.853514+0000 mgr.gibba020.yqfnwy (mgr.34427) 8947 : cluster [DBG] pgmap v5098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:41.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:40 gibba013 bash[30381]: cluster 2021-03-10T16:42:39.853514+0000 mgr.gibba020.yqfnwy (mgr.34427) 8947 : cluster [DBG] pgmap v5098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:43.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:42 gibba013 bash[29418]: cluster 2021-03-10T16:42:41.855098+0000 mgr.gibba020.yqfnwy (mgr.34427) 8948 : cluster [DBG] pgmap v5099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:43.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:42 gibba013 bash[30381]: cluster 2021-03-10T16:42:41.855098+0000 mgr.gibba020.yqfnwy (mgr.34427) 8948 : cluster [DBG] pgmap v5099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:43.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:42 gibba020 bash[25448]: cluster 2021-03-10T16:42:41.855098+0000 mgr.gibba020.yqfnwy (mgr.34427) 8948 : cluster [DBG] pgmap v5099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:45.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:44 gibba013 bash[29418]: cluster 2021-03-10T16:42:43.856503+0000 mgr.gibba020.yqfnwy (mgr.34427) 8949 : cluster [DBG] pgmap v5100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:45.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:44 gibba013 bash[30381]: cluster 2021-03-10T16:42:43.856503+0000 mgr.gibba020.yqfnwy (mgr.34427) 8949 : cluster [DBG] pgmap v5100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:45.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:44 gibba020 bash[25448]: cluster 2021-03-10T16:42:43.856503+0000 mgr.gibba020.yqfnwy (mgr.34427) 8949 : cluster [DBG] pgmap v5100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:47.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:46 gibba013 bash[29418]: cluster 2021-03-10T16:42:45.858382+0000 mgr.gibba020.yqfnwy (mgr.34427) 8950 : cluster [DBG] pgmap v5101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:47.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:46 gibba013 bash[30381]: cluster 2021-03-10T16:42:45.858382+0000 mgr.gibba020.yqfnwy (mgr.34427) 8950 : cluster [DBG] pgmap v5101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:47.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:46 gibba020 bash[25448]: cluster 2021-03-10T16:42:45.858382+0000 mgr.gibba020.yqfnwy (mgr.34427) 8950 : cluster [DBG] pgmap v5101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:49.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:48 gibba013 bash[29418]: cluster 2021-03-10T16:42:47.859719+0000 mgr.gibba020.yqfnwy (mgr.34427) 8951 : cluster [DBG] pgmap v5102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:49.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:48 gibba013 bash[30381]: cluster 2021-03-10T16:42:47.859719+0000 mgr.gibba020.yqfnwy (mgr.34427) 8951 : cluster [DBG] pgmap v5102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:49.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:48 gibba020 bash[25448]: cluster 2021-03-10T16:42:47.859719+0000 mgr.gibba020.yqfnwy (mgr.34427) 8951 : cluster [DBG] pgmap v5102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:51.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:50 gibba013 bash[29418]: cluster 2021-03-10T16:42:49.861634+0000 mgr.gibba020.yqfnwy (mgr.34427) 8952 : cluster [DBG] pgmap v5103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:51.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:50 gibba013 bash[30381]: cluster 2021-03-10T16:42:49.861634+0000 mgr.gibba020.yqfnwy (mgr.34427) 8952 : cluster [DBG] pgmap v5103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:51.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:50 gibba020 bash[25448]: cluster 2021-03-10T16:42:49.861634+0000 mgr.gibba020.yqfnwy (mgr.34427) 8952 : cluster [DBG] pgmap v5103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:52.061 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:42:52.291 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:42:52.291 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 2m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:42:52.291 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 59s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:42:52.292 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 59s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:42:52.292 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 59s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:42:52.293 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:42:52.293 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:42:52.294 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 59s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:42:52.294 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:42:52.295 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:42:52.295 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 59s ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:42:52.295 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:42:52.295 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:42:52.296 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:42:52.296 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:42:52.296 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 59s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:42:52.296 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 59s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:42:52.297 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 59s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:42:52.297 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 59s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:42:52.297 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 59s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:42:52.298 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 59s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:42:52.547 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:42:52.547 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:42:52.547 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:42:52.548 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:42:52.548 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:42:52.548 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:42:52.548 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:42:52.548 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:42:52.549 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:42:52.549 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:42:52.549 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:42:52.549 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:42:52.550 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:42:52.550 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:42:52.560 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:42:53.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:52 gibba020 bash[25448]: cluster 2021-03-10T16:42:51.863124+0000 mgr.gibba020.yqfnwy (mgr.34427) 8953 : cluster [DBG] pgmap v5104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:53.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:52 gibba020 bash[25448]: audit 2021-03-10T16:42:52.541907+0000 mon.a (mon.0) 3259 : audit [DBG] from='client.? 172.21.2.113:0/1258191438' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:53.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:52 gibba013 bash[29418]: cluster 2021-03-10T16:42:51.863124+0000 mgr.gibba020.yqfnwy (mgr.34427) 8953 : cluster [DBG] pgmap v5104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:53.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:52 gibba013 bash[29418]: audit 2021-03-10T16:42:52.541907+0000 mon.a (mon.0) 3259 : audit [DBG] from='client.? 172.21.2.113:0/1258191438' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:53.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:52 gibba013 bash[30381]: cluster 2021-03-10T16:42:51.863124+0000 mgr.gibba020.yqfnwy (mgr.34427) 8953 : cluster [DBG] pgmap v5104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:53.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:52 gibba013 bash[30381]: audit 2021-03-10T16:42:52.541907+0000 mon.a (mon.0) 3259 : audit [DBG] from='client.? 172.21.2.113:0/1258191438' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:54.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:53 gibba020 bash[25448]: audit 2021-03-10T16:42:52.053535+0000 mgr.gibba020.yqfnwy (mgr.34427) 8954 : audit [DBG] from='client.50064 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:42:54.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:53 gibba020 bash[25448]: audit 2021-03-10T16:42:52.279130+0000 mgr.gibba020.yqfnwy (mgr.34427) 8955 : audit [DBG] from='client.50070 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:42:54.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:53 gibba020 bash[25448]: audit 2021-03-10T16:42:53.161701+0000 mon.a (mon.0) 3260 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:42:54.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:53 gibba020 bash[25448]: audit 2021-03-10T16:42:53.353982+0000 mon.a (mon.0) 3261 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:42:54.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:53 gibba020 bash[25448]: audit 2021-03-10T16:42:53.357243+0000 mon.a (mon.0) 3262 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:42:54.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:53 gibba020 bash[25448]: audit 2021-03-10T16:42:53.358424+0000 mon.a (mon.0) 3263 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:54.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:53 gibba020 bash[25448]: audit 2021-03-10T16:42:53.359596+0000 mon.a (mon.0) 3264 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:54.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:53 gibba020 bash[25448]: audit 2021-03-10T16:42:53.360740+0000 mon.a (mon.0) 3265 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:54.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:53 gibba020 bash[25448]: audit 2021-03-10T16:42:53.362809+0000 mon.a (mon.0) 3266 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:54.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:53 gibba020 bash[25448]: audit 2021-03-10T16:42:53.364203+0000 mon.a (mon.0) 3267 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:54.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:53 gibba013 bash[29418]: audit 2021-03-10T16:42:52.053535+0000 mgr.gibba020.yqfnwy (mgr.34427) 8954 : audit [DBG] from='client.50064 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:42:54.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:53 gibba013 bash[29418]: audit 2021-03-10T16:42:52.279130+0000 mgr.gibba020.yqfnwy (mgr.34427) 8955 : audit [DBG] from='client.50070 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:42:54.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:53 gibba013 bash[29418]: audit 2021-03-10T16:42:53.161701+0000 mon.a (mon.0) 3260 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:42:54.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:53 gibba013 bash[29418]: audit 2021-03-10T16:42:53.353982+0000 mon.a (mon.0) 3261 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:42:54.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:53 gibba013 bash[29418]: audit 2021-03-10T16:42:53.357243+0000 mon.a (mon.0) 3262 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:42:54.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:53 gibba013 bash[29418]: audit 2021-03-10T16:42:53.358424+0000 mon.a (mon.0) 3263 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:54.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:53 gibba013 bash[29418]: audit 2021-03-10T16:42:53.359596+0000 mon.a (mon.0) 3264 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:54.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:53 gibba013 bash[29418]: audit 2021-03-10T16:42:53.360740+0000 mon.a (mon.0) 3265 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:54.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:53 gibba013 bash[29418]: audit 2021-03-10T16:42:53.362809+0000 mon.a (mon.0) 3266 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:54.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:53 gibba013 bash[29418]: audit 2021-03-10T16:42:53.364203+0000 mon.a (mon.0) 3267 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:54.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:53 gibba013 bash[30381]: audit 2021-03-10T16:42:52.053535+0000 mgr.gibba020.yqfnwy (mgr.34427) 8954 : audit [DBG] from='client.50064 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:42:54.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:53 gibba013 bash[30381]: audit 2021-03-10T16:42:52.279130+0000 mgr.gibba020.yqfnwy (mgr.34427) 8955 : audit [DBG] from='client.50070 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:42:54.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:53 gibba013 bash[30381]: audit 2021-03-10T16:42:53.161701+0000 mon.a (mon.0) 3260 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:42:54.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:53 gibba013 bash[30381]: audit 2021-03-10T16:42:53.353982+0000 mon.a (mon.0) 3261 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:42:54.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:53 gibba013 bash[30381]: audit 2021-03-10T16:42:53.357243+0000 mon.a (mon.0) 3262 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:42:54.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:53 gibba013 bash[30381]: audit 2021-03-10T16:42:53.358424+0000 mon.a (mon.0) 3263 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:54.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:53 gibba013 bash[30381]: audit 2021-03-10T16:42:53.359596+0000 mon.a (mon.0) 3264 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:54.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:53 gibba013 bash[30381]: audit 2021-03-10T16:42:53.360740+0000 mon.a (mon.0) 3265 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:54.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:53 gibba013 bash[30381]: audit 2021-03-10T16:42:53.362809+0000 mon.a (mon.0) 3266 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:54.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:53 gibba013 bash[30381]: audit 2021-03-10T16:42:53.364203+0000 mon.a (mon.0) 3267 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:42:55.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:54 gibba020 bash[25448]: cephadm 2021-03-10T16:42:53.164191+0000 mgr.gibba020.yqfnwy (mgr.34427) 8956 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:42:55.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:54 gibba020 bash[25448]: cephadm 2021-03-10T16:42:53.164577+0000 mgr.gibba020.yqfnwy (mgr.34427) 8957 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:42:55.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:54 gibba020 bash[25448]: cephadm 2021-03-10T16:42:53.356091+0000 mgr.gibba020.yqfnwy (mgr.34427) 8958 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:42:55.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:54 gibba020 bash[25448]: cephadm 2021-03-10T16:42:53.357662+0000 mgr.gibba020.yqfnwy (mgr.34427) 8959 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:42:55.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:54 gibba020 bash[25448]: cephadm 2021-03-10T16:42:53.358775+0000 mgr.gibba020.yqfnwy (mgr.34427) 8960 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:42:55.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:54 gibba020 bash[25448]: cephadm 2021-03-10T16:42:53.358810+0000 mgr.gibba020.yqfnwy (mgr.34427) 8961 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:42:55.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:54 gibba020 bash[25448]: cephadm 2021-03-10T16:42:53.359926+0000 mgr.gibba020.yqfnwy (mgr.34427) 8962 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:42:55.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:54 gibba020 bash[25448]: cephadm 2021-03-10T16:42:53.360018+0000 mgr.gibba020.yqfnwy (mgr.34427) 8963 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:42:55.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:54 gibba020 bash[25448]: cephadm 2021-03-10T16:42:53.361010+0000 mgr.gibba020.yqfnwy (mgr.34427) 8964 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:42:55.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:54 gibba020 bash[25448]: cephadm 2021-03-10T16:42:53.361957+0000 mgr.gibba020.yqfnwy (mgr.34427) 8965 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:42:55.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:54 gibba020 bash[25448]: cephadm 2021-03-10T16:42:53.361989+0000 mgr.gibba020.yqfnwy (mgr.34427) 8966 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:42:55.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:54 gibba020 bash[25448]: cephadm 2021-03-10T16:42:53.363104+0000 mgr.gibba020.yqfnwy (mgr.34427) 8967 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:42:55.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:54 gibba020 bash[25448]: cephadm 2021-03-10T16:42:53.363414+0000 mgr.gibba020.yqfnwy (mgr.34427) 8968 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:42:55.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:54 gibba020 bash[25448]: cephadm 2021-03-10T16:42:53.364545+0000 mgr.gibba020.yqfnwy (mgr.34427) 8969 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:42:55.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:54 gibba020 bash[25448]: cephadm 2021-03-10T16:42:53.364581+0000 mgr.gibba020.yqfnwy (mgr.34427) 8970 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:42:55.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:54 gibba020 bash[25448]: cephadm 2021-03-10T16:42:53.364685+0000 mgr.gibba020.yqfnwy (mgr.34427) 8971 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:42:55.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:54 gibba020 bash[25448]: cluster 2021-03-10T16:42:53.864528+0000 mgr.gibba020.yqfnwy (mgr.34427) 8972 : cluster [DBG] pgmap v5105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:55.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:54 gibba013 bash[29418]: cephadm 2021-03-10T16:42:53.164191+0000 mgr.gibba020.yqfnwy (mgr.34427) 8956 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:42:55.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:54 gibba013 bash[29418]: cephadm 2021-03-10T16:42:53.164577+0000 mgr.gibba020.yqfnwy (mgr.34427) 8957 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:42:55.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:54 gibba013 bash[29418]: cephadm 2021-03-10T16:42:53.356091+0000 mgr.gibba020.yqfnwy (mgr.34427) 8958 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:42:55.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:54 gibba013 bash[29418]: cephadm 2021-03-10T16:42:53.357662+0000 mgr.gibba020.yqfnwy (mgr.34427) 8959 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:42:55.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:54 gibba013 bash[29418]: cephadm 2021-03-10T16:42:53.358775+0000 mgr.gibba020.yqfnwy (mgr.34427) 8960 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:42:55.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:54 gibba013 bash[29418]: cephadm 2021-03-10T16:42:53.358810+0000 mgr.gibba020.yqfnwy (mgr.34427) 8961 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:42:55.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:54 gibba013 bash[29418]: cephadm 2021-03-10T16:42:53.359926+0000 mgr.gibba020.yqfnwy (mgr.34427) 8962 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:42:55.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:54 gibba013 bash[29418]: cephadm 2021-03-10T16:42:53.360018+0000 mgr.gibba020.yqfnwy (mgr.34427) 8963 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:42:55.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:54 gibba013 bash[29418]: cephadm 2021-03-10T16:42:53.361010+0000 mgr.gibba020.yqfnwy (mgr.34427) 8964 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:42:55.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:54 gibba013 bash[29418]: cephadm 2021-03-10T16:42:53.361957+0000 mgr.gibba020.yqfnwy (mgr.34427) 8965 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:42:55.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:54 gibba013 bash[29418]: cephadm 2021-03-10T16:42:53.361989+0000 mgr.gibba020.yqfnwy (mgr.34427) 8966 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:42:55.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:54 gibba013 bash[29418]: cephadm 2021-03-10T16:42:53.363104+0000 mgr.gibba020.yqfnwy (mgr.34427) 8967 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:42:55.387 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:54 gibba013 bash[29418]: cephadm 2021-03-10T16:42:53.363414+0000 mgr.gibba020.yqfnwy (mgr.34427) 8968 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:42:55.387 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:54 gibba013 bash[29418]: cephadm 2021-03-10T16:42:53.364545+0000 mgr.gibba020.yqfnwy (mgr.34427) 8969 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:42:55.388 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:54 gibba013 bash[29418]: cephadm 2021-03-10T16:42:53.364581+0000 mgr.gibba020.yqfnwy (mgr.34427) 8970 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:42:55.388 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:54 gibba013 bash[29418]: cephadm 2021-03-10T16:42:53.364685+0000 mgr.gibba020.yqfnwy (mgr.34427) 8971 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:42:55.389 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:54 gibba013 bash[29418]: cluster 2021-03-10T16:42:53.864528+0000 mgr.gibba020.yqfnwy (mgr.34427) 8972 : cluster [DBG] pgmap v5105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:55.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:54 gibba013 bash[30381]: cephadm 2021-03-10T16:42:53.164191+0000 mgr.gibba020.yqfnwy (mgr.34427) 8956 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:42:55.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:54 gibba013 bash[30381]: cephadm 2021-03-10T16:42:53.164577+0000 mgr.gibba020.yqfnwy (mgr.34427) 8957 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:42:55.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:54 gibba013 bash[30381]: cephadm 2021-03-10T16:42:53.356091+0000 mgr.gibba020.yqfnwy (mgr.34427) 8958 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:42:55.391 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:54 gibba013 bash[30381]: cephadm 2021-03-10T16:42:53.357662+0000 mgr.gibba020.yqfnwy (mgr.34427) 8959 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:42:55.391 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:54 gibba013 bash[30381]: cephadm 2021-03-10T16:42:53.358775+0000 mgr.gibba020.yqfnwy (mgr.34427) 8960 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:42:55.392 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:54 gibba013 bash[30381]: cephadm 2021-03-10T16:42:53.358810+0000 mgr.gibba020.yqfnwy (mgr.34427) 8961 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:42:55.392 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:54 gibba013 bash[30381]: cephadm 2021-03-10T16:42:53.359926+0000 mgr.gibba020.yqfnwy (mgr.34427) 8962 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:42:55.395 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:54 gibba013 bash[30381]: cephadm 2021-03-10T16:42:53.360018+0000 mgr.gibba020.yqfnwy (mgr.34427) 8963 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:42:55.396 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:54 gibba013 bash[30381]: cephadm 2021-03-10T16:42:53.361010+0000 mgr.gibba020.yqfnwy (mgr.34427) 8964 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:42:55.396 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:54 gibba013 bash[30381]: cephadm 2021-03-10T16:42:53.361957+0000 mgr.gibba020.yqfnwy (mgr.34427) 8965 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:42:55.397 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:54 gibba013 bash[30381]: cephadm 2021-03-10T16:42:53.361989+0000 mgr.gibba020.yqfnwy (mgr.34427) 8966 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:42:55.397 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:54 gibba013 bash[30381]: cephadm 2021-03-10T16:42:53.363104+0000 mgr.gibba020.yqfnwy (mgr.34427) 8967 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:42:55.398 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:54 gibba013 bash[30381]: cephadm 2021-03-10T16:42:53.363414+0000 mgr.gibba020.yqfnwy (mgr.34427) 8968 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:42:55.406 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:54 gibba013 bash[30381]: cephadm 2021-03-10T16:42:53.364545+0000 mgr.gibba020.yqfnwy (mgr.34427) 8969 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:42:55.407 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:54 gibba013 bash[30381]: cephadm 2021-03-10T16:42:53.364581+0000 mgr.gibba020.yqfnwy (mgr.34427) 8970 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:42:55.407 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:54 gibba013 bash[30381]: cephadm 2021-03-10T16:42:53.364685+0000 mgr.gibba020.yqfnwy (mgr.34427) 8971 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:42:55.408 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:54 gibba013 bash[30381]: cluster 2021-03-10T16:42:53.864528+0000 mgr.gibba020.yqfnwy (mgr.34427) 8972 : cluster [DBG] pgmap v5105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:57.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:56 gibba020 bash[25448]: cluster 2021-03-10T16:42:55.866447+0000 mgr.gibba020.yqfnwy (mgr.34427) 8973 : cluster [DBG] pgmap v5106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:57.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:56 gibba013 bash[29418]: cluster 2021-03-10T16:42:55.866447+0000 mgr.gibba020.yqfnwy (mgr.34427) 8973 : cluster [DBG] pgmap v5106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:57.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:56 gibba013 bash[30381]: cluster 2021-03-10T16:42:55.866447+0000 mgr.gibba020.yqfnwy (mgr.34427) 8973 : cluster [DBG] pgmap v5106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:59.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:42:58 gibba013 bash[29418]: cluster 2021-03-10T16:42:57.867870+0000 mgr.gibba020.yqfnwy (mgr.34427) 8974 : cluster [DBG] pgmap v5107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:59.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:42:58 gibba013 bash[30381]: cluster 2021-03-10T16:42:57.867870+0000 mgr.gibba020.yqfnwy (mgr.34427) 8974 : cluster [DBG] pgmap v5107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:42:59.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:42:58 gibba020 bash[25448]: cluster 2021-03-10T16:42:57.867870+0000 mgr.gibba020.yqfnwy (mgr.34427) 8974 : cluster [DBG] pgmap v5107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:01.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:00 gibba013 bash[29418]: cluster 2021-03-10T16:42:59.869655+0000 mgr.gibba020.yqfnwy (mgr.34427) 8975 : cluster [DBG] pgmap v5108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:01.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:00 gibba013 bash[30381]: cluster 2021-03-10T16:42:59.869655+0000 mgr.gibba020.yqfnwy (mgr.34427) 8975 : cluster [DBG] pgmap v5108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:01.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:00 gibba020 bash[25448]: cluster 2021-03-10T16:42:59.869655+0000 mgr.gibba020.yqfnwy (mgr.34427) 8975 : cluster [DBG] pgmap v5108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:03.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:02 gibba020 bash[25448]: cluster 2021-03-10T16:43:01.871312+0000 mgr.gibba020.yqfnwy (mgr.34427) 8976 : cluster [DBG] pgmap v5109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:03.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:02 gibba013 bash[29418]: cluster 2021-03-10T16:43:01.871312+0000 mgr.gibba020.yqfnwy (mgr.34427) 8976 : cluster [DBG] pgmap v5109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:03.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:02 gibba013 bash[30381]: cluster 2021-03-10T16:43:01.871312+0000 mgr.gibba020.yqfnwy (mgr.34427) 8976 : cluster [DBG] pgmap v5109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:05.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:04 gibba020 bash[25448]: cluster 2021-03-10T16:43:03.872931+0000 mgr.gibba020.yqfnwy (mgr.34427) 8977 : cluster [DBG] pgmap v5110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:05.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:04 gibba013 bash[29418]: cluster 2021-03-10T16:43:03.872931+0000 mgr.gibba020.yqfnwy (mgr.34427) 8977 : cluster [DBG] pgmap v5110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:05.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:04 gibba013 bash[30381]: cluster 2021-03-10T16:43:03.872931+0000 mgr.gibba020.yqfnwy (mgr.34427) 8977 : cluster [DBG] pgmap v5110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:07.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:06 gibba013 bash[29418]: cluster 2021-03-10T16:43:05.874696+0000 mgr.gibba020.yqfnwy (mgr.34427) 8978 : cluster [DBG] pgmap v5111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:07.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:06 gibba013 bash[29418]: audit 2021-03-10T16:43:06.776862+0000 mon.a (mon.0) 3268 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:43:07.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:06 gibba013 bash[29418]: audit 2021-03-10T16:43:06.943223+0000 mon.a (mon.0) 3269 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:43:07.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:06 gibba013 bash[30381]: cluster 2021-03-10T16:43:05.874696+0000 mgr.gibba020.yqfnwy (mgr.34427) 8978 : cluster [DBG] pgmap v5111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:07.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:06 gibba013 bash[30381]: audit 2021-03-10T16:43:06.776862+0000 mon.a (mon.0) 3268 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:43:07.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:06 gibba013 bash[30381]: audit 2021-03-10T16:43:06.943223+0000 mon.a (mon.0) 3269 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:43:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:06 gibba020 bash[25448]: cluster 2021-03-10T16:43:05.874696+0000 mgr.gibba020.yqfnwy (mgr.34427) 8978 : cluster [DBG] pgmap v5111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:06 gibba020 bash[25448]: audit 2021-03-10T16:43:06.776862+0000 mon.a (mon.0) 3268 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:43:07.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:06 gibba020 bash[25448]: audit 2021-03-10T16:43:06.943223+0000 mon.a (mon.0) 3269 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:43:08.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:07 gibba013 bash[29418]: audit 2021-03-10T16:43:07.296723+0000 mon.a (mon.0) 3270 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:43:08.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:07 gibba013 bash[29418]: audit 2021-03-10T16:43:07.297583+0000 mon.a (mon.0) 3271 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T16:43:08.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:07 gibba013 bash[29418]: audit 2021-03-10T16:43:07.298321+0000 mon.a (mon.0) 3272 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:43:08.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:07 gibba013 bash[29418]: audit 2021-03-10T16:43:07.298979+0000 mon.a (mon.0) 3273 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:43:08.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:07 gibba013 bash[30381]: audit 2021-03-10T16:43:07.296723+0000 mon.a (mon.0) 3270 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:43:08.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:07 gibba013 bash[30381]: audit 2021-03-10T16:43:07.297583+0000 mon.a (mon.0) 3271 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T16:43:08.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:07 gibba013 bash[30381]: audit 2021-03-10T16:43:07.298321+0000 mon.a (mon.0) 3272 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:43:08.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:07 gibba013 bash[30381]: audit 2021-03-10T16:43:07.298979+0000 mon.a (mon.0) 3273 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:43:08.380 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:07 gibba020 bash[25448]: audit 2021-03-10T16:43:07.296723+0000 mon.a (mon.0) 3270 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:43:08.380 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:07 gibba020 bash[25448]: audit 2021-03-10T16:43:07.297583+0000 mon.a (mon.0) 3271 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T16:43:08.380 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:07 gibba020 bash[25448]: audit 2021-03-10T16:43:07.298321+0000 mon.a (mon.0) 3272 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T16:43:08.381 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:07 gibba020 bash[25448]: audit 2021-03-10T16:43:07.298979+0000 mon.a (mon.0) 3273 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:43:09.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:08 gibba013 bash[29418]: cluster 2021-03-10T16:43:07.875988+0000 mgr.gibba020.yqfnwy (mgr.34427) 8979 : cluster [DBG] pgmap v5112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:09.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:08 gibba013 bash[30381]: cluster 2021-03-10T16:43:07.875988+0000 mgr.gibba020.yqfnwy (mgr.34427) 8979 : cluster [DBG] pgmap v5112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:09.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:08 gibba020 bash[25448]: cluster 2021-03-10T16:43:07.875988+0000 mgr.gibba020.yqfnwy (mgr.34427) 8979 : cluster [DBG] pgmap v5112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:10.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:09 gibba013 bash[29418]: cephadm 2021-03-10T16:43:08.380494+0000 mgr.gibba020.yqfnwy (mgr.34427) 8980 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:43:10.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:09 gibba013 bash[30381]: cephadm 2021-03-10T16:43:08.380494+0000 mgr.gibba020.yqfnwy (mgr.34427) 8980 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:43:10.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:09 gibba020 bash[25448]: cephadm 2021-03-10T16:43:08.380494+0000 mgr.gibba020.yqfnwy (mgr.34427) 8980 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:43:11.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:10 gibba013 bash[29418]: cluster 2021-03-10T16:43:09.877749+0000 mgr.gibba020.yqfnwy (mgr.34427) 8981 : cluster [DBG] pgmap v5113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:11.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:10 gibba013 bash[30381]: cluster 2021-03-10T16:43:09.877749+0000 mgr.gibba020.yqfnwy (mgr.34427) 8981 : cluster [DBG] pgmap v5113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:11.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:10 gibba020 bash[25448]: cluster 2021-03-10T16:43:09.877749+0000 mgr.gibba020.yqfnwy (mgr.34427) 8981 : cluster [DBG] pgmap v5113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:13.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:12 gibba013 bash[29418]: cluster 2021-03-10T16:43:11.879344+0000 mgr.gibba020.yqfnwy (mgr.34427) 8982 : cluster [DBG] pgmap v5114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:13.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:12 gibba013 bash[30381]: cluster 2021-03-10T16:43:11.879344+0000 mgr.gibba020.yqfnwy (mgr.34427) 8982 : cluster [DBG] pgmap v5114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:13.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:12 gibba020 bash[25448]: cluster 2021-03-10T16:43:11.879344+0000 mgr.gibba020.yqfnwy (mgr.34427) 8982 : cluster [DBG] pgmap v5114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:15.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:14 gibba013 bash[29418]: cluster 2021-03-10T16:43:13.880746+0000 mgr.gibba020.yqfnwy (mgr.34427) 8983 : cluster [DBG] pgmap v5115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:15.377 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:14 gibba013 bash[30381]: cluster 2021-03-10T16:43:13.880746+0000 mgr.gibba020.yqfnwy (mgr.34427) 8983 : cluster [DBG] pgmap v5115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:15.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:14 gibba020 bash[25448]: cluster 2021-03-10T16:43:13.880746+0000 mgr.gibba020.yqfnwy (mgr.34427) 8983 : cluster [DBG] pgmap v5115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:17.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:17 gibba013 bash[29418]: cluster 2021-03-10T16:43:15.882458+0000 mgr.gibba020.yqfnwy (mgr.34427) 8984 : cluster [DBG] pgmap v5116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:17.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:17 gibba013 bash[30381]: cluster 2021-03-10T16:43:15.882458+0000 mgr.gibba020.yqfnwy (mgr.34427) 8984 : cluster [DBG] pgmap v5116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:17.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:17 gibba020 bash[25448]: cluster 2021-03-10T16:43:15.882458+0000 mgr.gibba020.yqfnwy (mgr.34427) 8984 : cluster [DBG] pgmap v5116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:19.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:19 gibba013 bash[29418]: cluster 2021-03-10T16:43:17.883877+0000 mgr.gibba020.yqfnwy (mgr.34427) 8985 : cluster [DBG] pgmap v5117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:19.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:19 gibba013 bash[30381]: cluster 2021-03-10T16:43:17.883877+0000 mgr.gibba020.yqfnwy (mgr.34427) 8985 : cluster [DBG] pgmap v5117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:19.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:19 gibba020 bash[25448]: cluster 2021-03-10T16:43:17.883877+0000 mgr.gibba020.yqfnwy (mgr.34427) 8985 : cluster [DBG] pgmap v5117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:21.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:20 gibba013 bash[29418]: cluster 2021-03-10T16:43:19.885667+0000 mgr.gibba020.yqfnwy (mgr.34427) 8986 : cluster [DBG] pgmap v5118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:21.127 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:20 gibba013 bash[30381]: cluster 2021-03-10T16:43:19.885667+0000 mgr.gibba020.yqfnwy (mgr.34427) 8986 : cluster [DBG] pgmap v5118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:21.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:20 gibba020 bash[25448]: cluster 2021-03-10T16:43:19.885667+0000 mgr.gibba020.yqfnwy (mgr.34427) 8986 : cluster [DBG] pgmap v5118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:22.784 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:43:23.012 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:43:23.013 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 2m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:43:23.013 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 90s ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:43:23.013 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 90s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:43:23.013 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 90s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:43:23.014 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:43:23.014 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:43:23.014 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 90s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:43:23.014 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:43:23.015 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:43:23.015 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 90s ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:43:23.015 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:43:23.015 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:43:23.016 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:43:23.016 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:43:23.016 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 90s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:43:23.016 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 90s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:43:23.017 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 90s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:43:23.017 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 90s ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:43:23.017 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 90s ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:43:23.017 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 90s ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:43:23.264 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:43:23.264 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:43:23.265 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:43:23.265 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:43:23.265 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:43:23.265 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:43:23.266 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:43:23.266 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:43:23.266 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:43:23.266 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:43:23.267 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:43:23.267 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:43:23.267 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:43:23.267 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:43:23.268 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:43:23.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:22 gibba013 bash[29418]: cluster 2021-03-10T16:43:21.887163+0000 mgr.gibba020.yqfnwy (mgr.34427) 8987 : cluster [DBG] pgmap v5119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:23.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:22 gibba013 bash[30381]: cluster 2021-03-10T16:43:21.887163+0000 mgr.gibba020.yqfnwy (mgr.34427) 8987 : cluster [DBG] pgmap v5119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:23.396 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:22 gibba020 bash[25448]: cluster 2021-03-10T16:43:21.887163+0000 mgr.gibba020.yqfnwy (mgr.34427) 8987 : cluster [DBG] pgmap v5119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:24.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:23 gibba013 bash[29418]: audit 2021-03-10T16:43:22.776153+0000 mgr.gibba020.yqfnwy (mgr.34427) 8988 : audit [DBG] from='client.60064 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:43:24.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:23 gibba013 bash[29418]: audit 2021-03-10T16:43:23.002347+0000 mgr.gibba020.yqfnwy (mgr.34427) 8989 : audit [DBG] from='client.50088 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:43:24.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:23 gibba013 bash[29418]: audit 2021-03-10T16:43:23.266005+0000 mon.a (mon.0) 3274 : audit [DBG] from='client.? 172.21.2.113:0/1835149489' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:24.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:23 gibba013 bash[30381]: audit 2021-03-10T16:43:22.776153+0000 mgr.gibba020.yqfnwy (mgr.34427) 8988 : audit [DBG] from='client.60064 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:43:24.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:23 gibba013 bash[30381]: audit 2021-03-10T16:43:23.002347+0000 mgr.gibba020.yqfnwy (mgr.34427) 8989 : audit [DBG] from='client.50088 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:43:24.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:23 gibba013 bash[30381]: audit 2021-03-10T16:43:23.266005+0000 mon.a (mon.0) 3274 : audit [DBG] from='client.? 172.21.2.113:0/1835149489' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:24.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:23 gibba020 bash[25448]: audit 2021-03-10T16:43:22.776153+0000 mgr.gibba020.yqfnwy (mgr.34427) 8988 : audit [DBG] from='client.60064 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:43:24.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:23 gibba020 bash[25448]: audit 2021-03-10T16:43:23.002347+0000 mgr.gibba020.yqfnwy (mgr.34427) 8989 : audit [DBG] from='client.50088 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:43:24.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:23 gibba020 bash[25448]: audit 2021-03-10T16:43:23.266005+0000 mon.a (mon.0) 3274 : audit [DBG] from='client.? 172.21.2.113:0/1835149489' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:25.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:24 gibba013 bash[29418]: cephadm 2021-03-10T16:43:23.396320+0000 mgr.gibba020.yqfnwy (mgr.34427) 8990 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:43:25.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:24 gibba013 bash[29418]: cluster 2021-03-10T16:43:23.888568+0000 mgr.gibba020.yqfnwy (mgr.34427) 8991 : cluster [DBG] pgmap v5120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:25.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:24 gibba013 bash[30381]: cephadm 2021-03-10T16:43:23.396320+0000 mgr.gibba020.yqfnwy (mgr.34427) 8990 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:43:25.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:24 gibba013 bash[30381]: cluster 2021-03-10T16:43:23.888568+0000 mgr.gibba020.yqfnwy (mgr.34427) 8991 : cluster [DBG] pgmap v5120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:25.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:24 gibba020 bash[25448]: cephadm 2021-03-10T16:43:23.396320+0000 mgr.gibba020.yqfnwy (mgr.34427) 8990 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:43:25.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:24 gibba020 bash[25448]: cluster 2021-03-10T16:43:23.888568+0000 mgr.gibba020.yqfnwy (mgr.34427) 8991 : cluster [DBG] pgmap v5120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:27.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:26 gibba013 bash[29418]: cluster 2021-03-10T16:43:25.890274+0000 mgr.gibba020.yqfnwy (mgr.34427) 8992 : cluster [DBG] pgmap v5121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:27.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:26 gibba013 bash[30381]: cluster 2021-03-10T16:43:25.890274+0000 mgr.gibba020.yqfnwy (mgr.34427) 8992 : cluster [DBG] pgmap v5121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:27.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:26 gibba020 bash[25448]: cluster 2021-03-10T16:43:25.890274+0000 mgr.gibba020.yqfnwy (mgr.34427) 8992 : cluster [DBG] pgmap v5121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:29.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:28 gibba013 bash[29418]: cluster 2021-03-10T16:43:27.891623+0000 mgr.gibba020.yqfnwy (mgr.34427) 8993 : cluster [DBG] pgmap v5122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:29.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:28 gibba013 bash[30381]: cluster 2021-03-10T16:43:27.891623+0000 mgr.gibba020.yqfnwy (mgr.34427) 8993 : cluster [DBG] pgmap v5122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:29.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:28 gibba020 bash[25448]: cluster 2021-03-10T16:43:27.891623+0000 mgr.gibba020.yqfnwy (mgr.34427) 8993 : cluster [DBG] pgmap v5122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:31.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:30 gibba013 bash[29418]: cluster 2021-03-10T16:43:29.893482+0000 mgr.gibba020.yqfnwy (mgr.34427) 8994 : cluster [DBG] pgmap v5123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:31.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:30 gibba013 bash[30381]: cluster 2021-03-10T16:43:29.893482+0000 mgr.gibba020.yqfnwy (mgr.34427) 8994 : cluster [DBG] pgmap v5123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:31.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:30 gibba020 bash[25448]: cluster 2021-03-10T16:43:29.893482+0000 mgr.gibba020.yqfnwy (mgr.34427) 8994 : cluster [DBG] pgmap v5123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:33.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:32 gibba013 bash[29418]: cluster 2021-03-10T16:43:31.895005+0000 mgr.gibba020.yqfnwy (mgr.34427) 8995 : cluster [DBG] pgmap v5124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:33.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:32 gibba013 bash[30381]: cluster 2021-03-10T16:43:31.895005+0000 mgr.gibba020.yqfnwy (mgr.34427) 8995 : cluster [DBG] pgmap v5124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:33.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:32 gibba020 bash[25448]: cluster 2021-03-10T16:43:31.895005+0000 mgr.gibba020.yqfnwy (mgr.34427) 8995 : cluster [DBG] pgmap v5124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:35.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:34 gibba013 bash[29418]: cluster 2021-03-10T16:43:33.896424+0000 mgr.gibba020.yqfnwy (mgr.34427) 8996 : cluster [DBG] pgmap v5125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:35.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:34 gibba013 bash[30381]: cluster 2021-03-10T16:43:33.896424+0000 mgr.gibba020.yqfnwy (mgr.34427) 8996 : cluster [DBG] pgmap v5125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:35.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:34 gibba020 bash[25448]: cluster 2021-03-10T16:43:33.896424+0000 mgr.gibba020.yqfnwy (mgr.34427) 8996 : cluster [DBG] pgmap v5125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:37.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:36 gibba013 bash[29418]: cluster 2021-03-10T16:43:35.898272+0000 mgr.gibba020.yqfnwy (mgr.34427) 8997 : cluster [DBG] pgmap v5126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:37.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:36 gibba013 bash[30381]: cluster 2021-03-10T16:43:35.898272+0000 mgr.gibba020.yqfnwy (mgr.34427) 8997 : cluster [DBG] pgmap v5126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:37.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:36 gibba020 bash[25448]: cluster 2021-03-10T16:43:35.898272+0000 mgr.gibba020.yqfnwy (mgr.34427) 8997 : cluster [DBG] pgmap v5126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:39.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:38 gibba013 bash[29418]: cluster 2021-03-10T16:43:37.899630+0000 mgr.gibba020.yqfnwy (mgr.34427) 8998 : cluster [DBG] pgmap v5127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:39.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:38 gibba013 bash[30381]: cluster 2021-03-10T16:43:37.899630+0000 mgr.gibba020.yqfnwy (mgr.34427) 8998 : cluster [DBG] pgmap v5127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:39.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:38 gibba020 bash[25448]: cluster 2021-03-10T16:43:37.899630+0000 mgr.gibba020.yqfnwy (mgr.34427) 8998 : cluster [DBG] pgmap v5127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:40.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:39 gibba013 bash[29418]: cephadm 2021-03-10T16:43:38.412382+0000 mgr.gibba020.yqfnwy (mgr.34427) 8999 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:43:40.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:39 gibba013 bash[30381]: cephadm 2021-03-10T16:43:38.412382+0000 mgr.gibba020.yqfnwy (mgr.34427) 8999 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:43:40.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:39 gibba020 bash[25448]: cephadm 2021-03-10T16:43:38.412382+0000 mgr.gibba020.yqfnwy (mgr.34427) 8999 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:43:41.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:40 gibba013 bash[29418]: cluster 2021-03-10T16:43:39.901480+0000 mgr.gibba020.yqfnwy (mgr.34427) 9000 : cluster [DBG] pgmap v5128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:41.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:40 gibba013 bash[30381]: cluster 2021-03-10T16:43:39.901480+0000 mgr.gibba020.yqfnwy (mgr.34427) 9000 : cluster [DBG] pgmap v5128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:41.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:40 gibba020 bash[25448]: cluster 2021-03-10T16:43:39.901480+0000 mgr.gibba020.yqfnwy (mgr.34427) 9000 : cluster [DBG] pgmap v5128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:43.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:43 gibba013 bash[29418]: cluster 2021-03-10T16:43:41.903050+0000 mgr.gibba020.yqfnwy (mgr.34427) 9001 : cluster [DBG] pgmap v5129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:43.377 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:43 gibba013 bash[30381]: cluster 2021-03-10T16:43:41.903050+0000 mgr.gibba020.yqfnwy (mgr.34427) 9001 : cluster [DBG] pgmap v5129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:43.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:43 gibba020 bash[25448]: cluster 2021-03-10T16:43:41.903050+0000 mgr.gibba020.yqfnwy (mgr.34427) 9001 : cluster [DBG] pgmap v5129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:45.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:45 gibba013 bash[29418]: cluster 2021-03-10T16:43:43.904455+0000 mgr.gibba020.yqfnwy (mgr.34427) 9002 : cluster [DBG] pgmap v5130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:45.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:45 gibba013 bash[30381]: cluster 2021-03-10T16:43:43.904455+0000 mgr.gibba020.yqfnwy (mgr.34427) 9002 : cluster [DBG] pgmap v5130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:45.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:45 gibba020 bash[25448]: cluster 2021-03-10T16:43:43.904455+0000 mgr.gibba020.yqfnwy (mgr.34427) 9002 : cluster [DBG] pgmap v5130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:47.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:47 gibba013 bash[29418]: cluster 2021-03-10T16:43:45.906292+0000 mgr.gibba020.yqfnwy (mgr.34427) 9003 : cluster [DBG] pgmap v5131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:47.377 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:47 gibba013 bash[30381]: cluster 2021-03-10T16:43:45.906292+0000 mgr.gibba020.yqfnwy (mgr.34427) 9003 : cluster [DBG] pgmap v5131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:47.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:47 gibba020 bash[25448]: cluster 2021-03-10T16:43:45.906292+0000 mgr.gibba020.yqfnwy (mgr.34427) 9003 : cluster [DBG] pgmap v5131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:49.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:49 gibba013 bash[29418]: cluster 2021-03-10T16:43:47.907711+0000 mgr.gibba020.yqfnwy (mgr.34427) 9004 : cluster [DBG] pgmap v5132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:49.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:49 gibba013 bash[30381]: cluster 2021-03-10T16:43:47.907711+0000 mgr.gibba020.yqfnwy (mgr.34427) 9004 : cluster [DBG] pgmap v5132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:49.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:49 gibba020 bash[25448]: cluster 2021-03-10T16:43:47.907711+0000 mgr.gibba020.yqfnwy (mgr.34427) 9004 : cluster [DBG] pgmap v5132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:51.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:50 gibba013 bash[29418]: cluster 2021-03-10T16:43:49.909467+0000 mgr.gibba020.yqfnwy (mgr.34427) 9005 : cluster [DBG] pgmap v5133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:51.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:50 gibba013 bash[30381]: cluster 2021-03-10T16:43:49.909467+0000 mgr.gibba020.yqfnwy (mgr.34427) 9005 : cluster [DBG] pgmap v5133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:51.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:50 gibba020 bash[25448]: cluster 2021-03-10T16:43:49.909467+0000 mgr.gibba020.yqfnwy (mgr.34427) 9005 : cluster [DBG] pgmap v5133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:53.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:52 gibba013 bash[29418]: cluster 2021-03-10T16:43:51.910961+0000 mgr.gibba020.yqfnwy (mgr.34427) 9006 : cluster [DBG] pgmap v5134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:53.377 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:52 gibba013 bash[30381]: cluster 2021-03-10T16:43:51.910961+0000 mgr.gibba020.yqfnwy (mgr.34427) 9006 : cluster [DBG] pgmap v5134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:53.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:52 gibba020 bash[25448]: cluster 2021-03-10T16:43:51.910961+0000 mgr.gibba020.yqfnwy (mgr.34427) 9006 : cluster [DBG] pgmap v5134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:53.511 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:43:53.743 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:43:53.744 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 3m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:43:53.744 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 2m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:43:53.744 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:43:53.744 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:43:53.744 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:43:53.745 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:43:53.745 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:43:53.745 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:43:53.745 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:43:53.746 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:43:53.746 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:43:53.746 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:43:53.746 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:43:53.746 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:43:53.747 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:43:53.747 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:43:53.747 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:43:53.747 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:43:53.748 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 2m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:43:53.748 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:43:53.994 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:43:53.995 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:43:53.995 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:43:53.995 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:43:53.995 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:43:53.996 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:43:53.996 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:43:53.996 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:43:53.996 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:43:53.996 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:43:53.997 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:43:53.997 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:43:53.997 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:43:53.997 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:43:53.998 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:43:54.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:53 gibba013 bash[29418]: audit 2021-03-10T16:43:53.425499+0000 mon.a (mon.0) 3275 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:43:54.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:53 gibba013 bash[29418]: audit 2021-03-10T16:43:53.627597+0000 mon.a (mon.0) 3276 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:43:54.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:53 gibba013 bash[29418]: audit 2021-03-10T16:43:53.630703+0000 mon.a (mon.0) 3277 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:43:54.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:53 gibba013 bash[29418]: audit 2021-03-10T16:43:53.631956+0000 mon.a (mon.0) 3278 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:54.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:53 gibba013 bash[29418]: audit 2021-03-10T16:43:53.633017+0000 mon.a (mon.0) 3279 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:54.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:53 gibba013 bash[29418]: audit 2021-03-10T16:43:53.634135+0000 mon.a (mon.0) 3280 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:54.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:53 gibba013 bash[29418]: audit 2021-03-10T16:43:53.636394+0000 mon.a (mon.0) 3281 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:54.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:53 gibba013 bash[29418]: audit 2021-03-10T16:43:53.637728+0000 mon.a (mon.0) 3282 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:54.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:53 gibba013 bash[30381]: audit 2021-03-10T16:43:53.425499+0000 mon.a (mon.0) 3275 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:43:54.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:53 gibba013 bash[30381]: audit 2021-03-10T16:43:53.627597+0000 mon.a (mon.0) 3276 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:43:54.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:53 gibba013 bash[30381]: audit 2021-03-10T16:43:53.630703+0000 mon.a (mon.0) 3277 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:43:54.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:53 gibba013 bash[30381]: audit 2021-03-10T16:43:53.631956+0000 mon.a (mon.0) 3278 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:54.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:53 gibba013 bash[30381]: audit 2021-03-10T16:43:53.633017+0000 mon.a (mon.0) 3279 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:54.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:53 gibba013 bash[30381]: audit 2021-03-10T16:43:53.634135+0000 mon.a (mon.0) 3280 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:54.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:53 gibba013 bash[30381]: audit 2021-03-10T16:43:53.636394+0000 mon.a (mon.0) 3281 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:54.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:53 gibba013 bash[30381]: audit 2021-03-10T16:43:53.637728+0000 mon.a (mon.0) 3282 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:54.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:53 gibba020 bash[25448]: audit 2021-03-10T16:43:53.425499+0000 mon.a (mon.0) 3275 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:43:54.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:53 gibba020 bash[25448]: audit 2021-03-10T16:43:53.627597+0000 mon.a (mon.0) 3276 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:43:54.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:53 gibba020 bash[25448]: audit 2021-03-10T16:43:53.630703+0000 mon.a (mon.0) 3277 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:43:54.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:53 gibba020 bash[25448]: audit 2021-03-10T16:43:53.631956+0000 mon.a (mon.0) 3278 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:54.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:53 gibba020 bash[25448]: audit 2021-03-10T16:43:53.633017+0000 mon.a (mon.0) 3279 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:54.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:53 gibba020 bash[25448]: audit 2021-03-10T16:43:53.634135+0000 mon.a (mon.0) 3280 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:54.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:53 gibba020 bash[25448]: audit 2021-03-10T16:43:53.636394+0000 mon.a (mon.0) 3281 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:54.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:53 gibba020 bash[25448]: audit 2021-03-10T16:43:53.637728+0000 mon.a (mon.0) 3282 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:55.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:54 gibba013 bash[29418]: cephadm 2021-03-10T16:43:53.428787+0000 mgr.gibba020.yqfnwy (mgr.34427) 9007 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:43:55.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:54 gibba013 bash[29418]: cephadm 2021-03-10T16:43:53.430663+0000 mgr.gibba020.yqfnwy (mgr.34427) 9008 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:43:55.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:54 gibba013 bash[29418]: audit 2021-03-10T16:43:53.503709+0000 mgr.gibba020.yqfnwy (mgr.34427) 9009 : audit [DBG] from='client.60082 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:43:55.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:54 gibba013 bash[29418]: cephadm 2021-03-10T16:43:53.629541+0000 mgr.gibba020.yqfnwy (mgr.34427) 9010 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:43:55.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:54 gibba013 bash[29418]: cephadm 2021-03-10T16:43:53.631157+0000 mgr.gibba020.yqfnwy (mgr.34427) 9011 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:43:55.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:54 gibba013 bash[29418]: cephadm 2021-03-10T16:43:53.632227+0000 mgr.gibba020.yqfnwy (mgr.34427) 9012 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:43:55.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:54 gibba013 bash[29418]: cephadm 2021-03-10T16:43:53.632262+0000 mgr.gibba020.yqfnwy (mgr.34427) 9013 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:43:55.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:54 gibba013 bash[29418]: cephadm 2021-03-10T16:43:53.633306+0000 mgr.gibba020.yqfnwy (mgr.34427) 9014 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:43:55.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:54 gibba013 bash[29418]: cephadm 2021-03-10T16:43:53.633351+0000 mgr.gibba020.yqfnwy (mgr.34427) 9015 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:43:55.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:54 gibba013 bash[29418]: cephadm 2021-03-10T16:43:53.634482+0000 mgr.gibba020.yqfnwy (mgr.34427) 9016 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:43:55.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:54 gibba013 bash[29418]: cephadm 2021-03-10T16:43:53.635473+0000 mgr.gibba020.yqfnwy (mgr.34427) 9017 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:43:55.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:54 gibba013 bash[29418]: cephadm 2021-03-10T16:43:53.635510+0000 mgr.gibba020.yqfnwy (mgr.34427) 9018 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:43:55.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:54 gibba013 bash[29418]: cephadm 2021-03-10T16:43:53.636664+0000 mgr.gibba020.yqfnwy (mgr.34427) 9019 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:43:55.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:54 gibba013 bash[29418]: cephadm 2021-03-10T16:43:53.636988+0000 mgr.gibba020.yqfnwy (mgr.34427) 9020 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:43:55.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:54 gibba013 bash[29418]: cephadm 2021-03-10T16:43:53.637935+0000 mgr.gibba020.yqfnwy (mgr.34427) 9021 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:43:55.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:54 gibba013 bash[29418]: cephadm 2021-03-10T16:43:53.637973+0000 mgr.gibba020.yqfnwy (mgr.34427) 9022 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:43:55.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:54 gibba013 bash[29418]: cephadm 2021-03-10T16:43:53.638078+0000 mgr.gibba020.yqfnwy (mgr.34427) 9023 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:43:55.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:54 gibba013 bash[29418]: audit 2021-03-10T16:43:53.731879+0000 mgr.gibba020.yqfnwy (mgr.34427) 9024 : audit [DBG] from='client.50106 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:43:55.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:54 gibba013 bash[29418]: cluster 2021-03-10T16:43:53.912625+0000 mgr.gibba020.yqfnwy (mgr.34427) 9025 : cluster [DBG] pgmap v5135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:55.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:54 gibba013 bash[29418]: audit 2021-03-10T16:43:53.996218+0000 mon.a (mon.0) 3283 : audit [DBG] from='client.? 172.21.2.113:0/317222144' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:55.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:54 gibba013 bash[30381]: cephadm 2021-03-10T16:43:53.428787+0000 mgr.gibba020.yqfnwy (mgr.34427) 9007 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:43:55.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:54 gibba013 bash[30381]: cephadm 2021-03-10T16:43:53.430663+0000 mgr.gibba020.yqfnwy (mgr.34427) 9008 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:43:55.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:54 gibba013 bash[30381]: audit 2021-03-10T16:43:53.503709+0000 mgr.gibba020.yqfnwy (mgr.34427) 9009 : audit [DBG] from='client.60082 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:43:55.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:54 gibba013 bash[30381]: cephadm 2021-03-10T16:43:53.629541+0000 mgr.gibba020.yqfnwy (mgr.34427) 9010 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:43:55.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:54 gibba013 bash[30381]: cephadm 2021-03-10T16:43:53.631157+0000 mgr.gibba020.yqfnwy (mgr.34427) 9011 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:43:55.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:54 gibba013 bash[30381]: cephadm 2021-03-10T16:43:53.632227+0000 mgr.gibba020.yqfnwy (mgr.34427) 9012 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:43:55.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:54 gibba013 bash[30381]: cephadm 2021-03-10T16:43:53.632262+0000 mgr.gibba020.yqfnwy (mgr.34427) 9013 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:43:55.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:54 gibba013 bash[30381]: cephadm 2021-03-10T16:43:53.633306+0000 mgr.gibba020.yqfnwy (mgr.34427) 9014 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:43:55.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:54 gibba013 bash[30381]: cephadm 2021-03-10T16:43:53.633351+0000 mgr.gibba020.yqfnwy (mgr.34427) 9015 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:43:55.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:54 gibba013 bash[30381]: cephadm 2021-03-10T16:43:53.634482+0000 mgr.gibba020.yqfnwy (mgr.34427) 9016 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:43:55.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:54 gibba013 bash[30381]: cephadm 2021-03-10T16:43:53.635473+0000 mgr.gibba020.yqfnwy (mgr.34427) 9017 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:43:55.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:54 gibba013 bash[30381]: cephadm 2021-03-10T16:43:53.635510+0000 mgr.gibba020.yqfnwy (mgr.34427) 9018 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:43:55.392 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:54 gibba013 bash[30381]: cephadm 2021-03-10T16:43:53.636664+0000 mgr.gibba020.yqfnwy (mgr.34427) 9019 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:43:55.392 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:54 gibba013 bash[30381]: cephadm 2021-03-10T16:43:53.636988+0000 mgr.gibba020.yqfnwy (mgr.34427) 9020 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:43:55.392 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:54 gibba013 bash[30381]: cephadm 2021-03-10T16:43:53.637935+0000 mgr.gibba020.yqfnwy (mgr.34427) 9021 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:43:55.392 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:54 gibba013 bash[30381]: cephadm 2021-03-10T16:43:53.637973+0000 mgr.gibba020.yqfnwy (mgr.34427) 9022 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:43:55.393 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:54 gibba013 bash[30381]: cephadm 2021-03-10T16:43:53.638078+0000 mgr.gibba020.yqfnwy (mgr.34427) 9023 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:43:55.393 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:54 gibba013 bash[30381]: audit 2021-03-10T16:43:53.731879+0000 mgr.gibba020.yqfnwy (mgr.34427) 9024 : audit [DBG] from='client.50106 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:43:55.393 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:54 gibba013 bash[30381]: cluster 2021-03-10T16:43:53.912625+0000 mgr.gibba020.yqfnwy (mgr.34427) 9025 : cluster [DBG] pgmap v5135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:55.393 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:54 gibba013 bash[30381]: audit 2021-03-10T16:43:53.996218+0000 mon.a (mon.0) 3283 : audit [DBG] from='client.? 172.21.2.113:0/317222144' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:55.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:54 gibba020 bash[25448]: cephadm 2021-03-10T16:43:53.428787+0000 mgr.gibba020.yqfnwy (mgr.34427) 9007 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:43:55.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:54 gibba020 bash[25448]: cephadm 2021-03-10T16:43:53.430663+0000 mgr.gibba020.yqfnwy (mgr.34427) 9008 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:43:55.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:54 gibba020 bash[25448]: audit 2021-03-10T16:43:53.503709+0000 mgr.gibba020.yqfnwy (mgr.34427) 9009 : audit [DBG] from='client.60082 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:43:55.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:54 gibba020 bash[25448]: cephadm 2021-03-10T16:43:53.629541+0000 mgr.gibba020.yqfnwy (mgr.34427) 9010 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:43:55.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:54 gibba020 bash[25448]: cephadm 2021-03-10T16:43:53.631157+0000 mgr.gibba020.yqfnwy (mgr.34427) 9011 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:43:55.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:54 gibba020 bash[25448]: cephadm 2021-03-10T16:43:53.632227+0000 mgr.gibba020.yqfnwy (mgr.34427) 9012 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:43:55.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:54 gibba020 bash[25448]: cephadm 2021-03-10T16:43:53.632262+0000 mgr.gibba020.yqfnwy (mgr.34427) 9013 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:43:55.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:54 gibba020 bash[25448]: cephadm 2021-03-10T16:43:53.633306+0000 mgr.gibba020.yqfnwy (mgr.34427) 9014 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:43:55.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:54 gibba020 bash[25448]: cephadm 2021-03-10T16:43:53.633351+0000 mgr.gibba020.yqfnwy (mgr.34427) 9015 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:43:55.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:54 gibba020 bash[25448]: cephadm 2021-03-10T16:43:53.634482+0000 mgr.gibba020.yqfnwy (mgr.34427) 9016 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:43:55.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:54 gibba020 bash[25448]: cephadm 2021-03-10T16:43:53.635473+0000 mgr.gibba020.yqfnwy (mgr.34427) 9017 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:43:55.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:54 gibba020 bash[25448]: cephadm 2021-03-10T16:43:53.635510+0000 mgr.gibba020.yqfnwy (mgr.34427) 9018 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:43:55.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:54 gibba020 bash[25448]: cephadm 2021-03-10T16:43:53.636664+0000 mgr.gibba020.yqfnwy (mgr.34427) 9019 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:43:55.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:54 gibba020 bash[25448]: cephadm 2021-03-10T16:43:53.636988+0000 mgr.gibba020.yqfnwy (mgr.34427) 9020 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:43:55.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:54 gibba020 bash[25448]: cephadm 2021-03-10T16:43:53.637935+0000 mgr.gibba020.yqfnwy (mgr.34427) 9021 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:43:55.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:54 gibba020 bash[25448]: cephadm 2021-03-10T16:43:53.637973+0000 mgr.gibba020.yqfnwy (mgr.34427) 9022 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:43:55.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:54 gibba020 bash[25448]: cephadm 2021-03-10T16:43:53.638078+0000 mgr.gibba020.yqfnwy (mgr.34427) 9023 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:43:55.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:54 gibba020 bash[25448]: audit 2021-03-10T16:43:53.731879+0000 mgr.gibba020.yqfnwy (mgr.34427) 9024 : audit [DBG] from='client.50106 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:43:55.456 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:54 gibba020 bash[25448]: cluster 2021-03-10T16:43:53.912625+0000 mgr.gibba020.yqfnwy (mgr.34427) 9025 : cluster [DBG] pgmap v5135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:55.456 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:54 gibba020 bash[25448]: audit 2021-03-10T16:43:53.996218+0000 mon.a (mon.0) 3283 : audit [DBG] from='client.? 172.21.2.113:0/317222144' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:43:57.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:56 gibba013 bash[29418]: cluster 2021-03-10T16:43:55.914521+0000 mgr.gibba020.yqfnwy (mgr.34427) 9026 : cluster [DBG] pgmap v5136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:57.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:56 gibba013 bash[30381]: cluster 2021-03-10T16:43:55.914521+0000 mgr.gibba020.yqfnwy (mgr.34427) 9026 : cluster [DBG] pgmap v5136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:57.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:56 gibba020 bash[25448]: cluster 2021-03-10T16:43:55.914521+0000 mgr.gibba020.yqfnwy (mgr.34427) 9026 : cluster [DBG] pgmap v5136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:59.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:43:58 gibba013 bash[29418]: cluster 2021-03-10T16:43:57.915935+0000 mgr.gibba020.yqfnwy (mgr.34427) 9027 : cluster [DBG] pgmap v5137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:59.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:43:59 gibba013 bash[30381]: cluster 2021-03-10T16:43:57.915935+0000 mgr.gibba020.yqfnwy (mgr.34427) 9027 : cluster [DBG] pgmap v5137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:43:59.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:43:59 gibba020 bash[25448]: cluster 2021-03-10T16:43:57.915935+0000 mgr.gibba020.yqfnwy (mgr.34427) 9027 : cluster [DBG] pgmap v5137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:01.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:00 gibba013 bash[29418]: cluster 2021-03-10T16:43:59.917901+0000 mgr.gibba020.yqfnwy (mgr.34427) 9028 : cluster [DBG] pgmap v5138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:01.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:00 gibba013 bash[30381]: cluster 2021-03-10T16:43:59.917901+0000 mgr.gibba020.yqfnwy (mgr.34427) 9028 : cluster [DBG] pgmap v5138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:01.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:00 gibba020 bash[25448]: cluster 2021-03-10T16:43:59.917901+0000 mgr.gibba020.yqfnwy (mgr.34427) 9028 : cluster [DBG] pgmap v5138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:03.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:02 gibba013 bash[29418]: cluster 2021-03-10T16:44:01.919339+0000 mgr.gibba020.yqfnwy (mgr.34427) 9029 : cluster [DBG] pgmap v5139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:03.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:02 gibba013 bash[30381]: cluster 2021-03-10T16:44:01.919339+0000 mgr.gibba020.yqfnwy (mgr.34427) 9029 : cluster [DBG] pgmap v5139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:03.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:02 gibba020 bash[25448]: cluster 2021-03-10T16:44:01.919339+0000 mgr.gibba020.yqfnwy (mgr.34427) 9029 : cluster [DBG] pgmap v5139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:05.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:04 gibba013 bash[29418]: cluster 2021-03-10T16:44:03.920718+0000 mgr.gibba020.yqfnwy (mgr.34427) 9030 : cluster [DBG] pgmap v5140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:05.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:04 gibba013 bash[30381]: cluster 2021-03-10T16:44:03.920718+0000 mgr.gibba020.yqfnwy (mgr.34427) 9030 : cluster [DBG] pgmap v5140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:05.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:04 gibba020 bash[25448]: cluster 2021-03-10T16:44:03.920718+0000 mgr.gibba020.yqfnwy (mgr.34427) 9030 : cluster [DBG] pgmap v5140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:07.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:06 gibba013 bash[29418]: cluster 2021-03-10T16:44:05.921438+0000 mgr.gibba020.yqfnwy (mgr.34427) 9031 : cluster [DBG] pgmap v5141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:07.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:06 gibba013 bash[29418]: audit 2021-03-10T16:44:06.781974+0000 mon.a (mon.0) 3284 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:44:07.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:07 gibba013 bash[29418]: audit 2021-03-10T16:44:06.949770+0000 mon.a (mon.0) 3285 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:44:07.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:07 gibba013 bash[30381]: cluster 2021-03-10T16:44:05.921438+0000 mgr.gibba020.yqfnwy (mgr.34427) 9031 : cluster [DBG] pgmap v5141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:07.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:07 gibba013 bash[30381]: audit 2021-03-10T16:44:06.781974+0000 mon.a (mon.0) 3284 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:44:07.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:07 gibba013 bash[30381]: audit 2021-03-10T16:44:06.949770+0000 mon.a (mon.0) 3285 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:44:07.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:07 gibba020 bash[25448]: cluster 2021-03-10T16:44:05.921438+0000 mgr.gibba020.yqfnwy (mgr.34427) 9031 : cluster [DBG] pgmap v5141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:07.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:07 gibba020 bash[25448]: audit 2021-03-10T16:44:06.781974+0000 mon.a (mon.0) 3284 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:44:07.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:07 gibba020 bash[25448]: audit 2021-03-10T16:44:06.949770+0000 mon.a (mon.0) 3285 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:44:08.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:08 gibba013 bash[29418]: audit 2021-03-10T16:44:07.306360+0000 mon.a (mon.0) 3286 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:44:08.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:08 gibba013 bash[29418]: audit 2021-03-10T16:44:07.307130+0000 mon.a (mon.0) 3287 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:44:08.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:08 gibba013 bash[29418]: audit 2021-03-10T16:44:07.307814+0000 mon.a (mon.0) 3288 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:44:08.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:08 gibba013 bash[29418]: audit 2021-03-10T16:44:07.308475+0000 mon.a (mon.0) 3289 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:44:08.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:08 gibba013 bash[30381]: audit 2021-03-10T16:44:07.306360+0000 mon.a (mon.0) 3286 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:44:08.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:08 gibba013 bash[30381]: audit 2021-03-10T16:44:07.307130+0000 mon.a (mon.0) 3287 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:44:08.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:08 gibba013 bash[30381]: audit 2021-03-10T16:44:07.307814+0000 mon.a (mon.0) 3288 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:44:08.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:08 gibba013 bash[30381]: audit 2021-03-10T16:44:07.308475+0000 mon.a (mon.0) 3289 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:44:08.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:08 gibba020 bash[25448]: audit 2021-03-10T16:44:07.306360+0000 mon.a (mon.0) 3286 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:44:08.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:08 gibba020 bash[25448]: audit 2021-03-10T16:44:07.307130+0000 mon.a (mon.0) 3287 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:44:08.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:08 gibba020 bash[25448]: audit 2021-03-10T16:44:07.307814+0000 mon.a (mon.0) 3288 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:44:08.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:08 gibba020 bash[25448]: audit 2021-03-10T16:44:07.308475+0000 mon.a (mon.0) 3289 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:44:09.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:09 gibba013 bash[29418]: cluster 2021-03-10T16:44:07.922674+0000 mgr.gibba020.yqfnwy (mgr.34427) 9032 : cluster [DBG] pgmap v5142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:09.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:09 gibba013 bash[30381]: cluster 2021-03-10T16:44:07.922674+0000 mgr.gibba020.yqfnwy (mgr.34427) 9032 : cluster [DBG] pgmap v5142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:09.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:09 gibba020 bash[25448]: cluster 2021-03-10T16:44:07.922674+0000 mgr.gibba020.yqfnwy (mgr.34427) 9032 : cluster [DBG] pgmap v5142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:10.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:10 gibba013 bash[29418]: cephadm 2021-03-10T16:44:08.652746+0000 mgr.gibba020.yqfnwy (mgr.34427) 9033 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:44:10.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:10 gibba013 bash[30381]: cephadm 2021-03-10T16:44:08.652746+0000 mgr.gibba020.yqfnwy (mgr.34427) 9033 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:44:10.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:10 gibba020 bash[25448]: cephadm 2021-03-10T16:44:08.652746+0000 mgr.gibba020.yqfnwy (mgr.34427) 9033 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:44:11.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:11 gibba013 bash[29418]: cluster 2021-03-10T16:44:09.924376+0000 mgr.gibba020.yqfnwy (mgr.34427) 9034 : cluster [DBG] pgmap v5143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:11.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:11 gibba013 bash[30381]: cluster 2021-03-10T16:44:09.924376+0000 mgr.gibba020.yqfnwy (mgr.34427) 9034 : cluster [DBG] pgmap v5143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:11.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:11 gibba020 bash[25448]: cluster 2021-03-10T16:44:09.924376+0000 mgr.gibba020.yqfnwy (mgr.34427) 9034 : cluster [DBG] pgmap v5143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:13.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:13 gibba013 bash[29418]: cluster 2021-03-10T16:44:11.925790+0000 mgr.gibba020.yqfnwy (mgr.34427) 9035 : cluster [DBG] pgmap v5144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:13.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:13 gibba013 bash[30381]: cluster 2021-03-10T16:44:11.925790+0000 mgr.gibba020.yqfnwy (mgr.34427) 9035 : cluster [DBG] pgmap v5144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:13.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:13 gibba020 bash[25448]: cluster 2021-03-10T16:44:11.925790+0000 mgr.gibba020.yqfnwy (mgr.34427) 9035 : cluster [DBG] pgmap v5144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:15.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:15 gibba013 bash[29418]: cluster 2021-03-10T16:44:13.927322+0000 mgr.gibba020.yqfnwy (mgr.34427) 9036 : cluster [DBG] pgmap v5145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:15.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:15 gibba013 bash[30381]: cluster 2021-03-10T16:44:13.927322+0000 mgr.gibba020.yqfnwy (mgr.34427) 9036 : cluster [DBG] pgmap v5145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:15.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:15 gibba020 bash[25448]: cluster 2021-03-10T16:44:13.927322+0000 mgr.gibba020.yqfnwy (mgr.34427) 9036 : cluster [DBG] pgmap v5145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:17.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:17 gibba013 bash[29418]: cluster 2021-03-10T16:44:15.929211+0000 mgr.gibba020.yqfnwy (mgr.34427) 9037 : cluster [DBG] pgmap v5146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:17.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:17 gibba013 bash[30381]: cluster 2021-03-10T16:44:15.929211+0000 mgr.gibba020.yqfnwy (mgr.34427) 9037 : cluster [DBG] pgmap v5146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:17.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:17 gibba020 bash[25448]: cluster 2021-03-10T16:44:15.929211+0000 mgr.gibba020.yqfnwy (mgr.34427) 9037 : cluster [DBG] pgmap v5146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:19.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:19 gibba013 bash[29418]: cluster 2021-03-10T16:44:17.930540+0000 mgr.gibba020.yqfnwy (mgr.34427) 9038 : cluster [DBG] pgmap v5147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:19.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:19 gibba013 bash[30381]: cluster 2021-03-10T16:44:17.930540+0000 mgr.gibba020.yqfnwy (mgr.34427) 9038 : cluster [DBG] pgmap v5147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:19.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:19 gibba020 bash[25448]: cluster 2021-03-10T16:44:17.930540+0000 mgr.gibba020.yqfnwy (mgr.34427) 9038 : cluster [DBG] pgmap v5147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:21.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:20 gibba013 bash[29418]: cluster 2021-03-10T16:44:19.932574+0000 mgr.gibba020.yqfnwy (mgr.34427) 9039 : cluster [DBG] pgmap v5148: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:21.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:20 gibba013 bash[30381]: cluster 2021-03-10T16:44:19.932574+0000 mgr.gibba020.yqfnwy (mgr.34427) 9039 : cluster [DBG] pgmap v5148: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:21.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:20 gibba020 bash[25448]: cluster 2021-03-10T16:44:19.932574+0000 mgr.gibba020.yqfnwy (mgr.34427) 9039 : cluster [DBG] pgmap v5148: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:23.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:22 gibba013 bash[29418]: cluster 2021-03-10T16:44:21.933983+0000 mgr.gibba020.yqfnwy (mgr.34427) 9040 : cluster [DBG] pgmap v5149: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:23.377 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:22 gibba013 bash[30381]: cluster 2021-03-10T16:44:21.933983+0000 mgr.gibba020.yqfnwy (mgr.34427) 9040 : cluster [DBG] pgmap v5149: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:23.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:22 gibba020 bash[25448]: cluster 2021-03-10T16:44:21.933983+0000 mgr.gibba020.yqfnwy (mgr.34427) 9040 : cluster [DBG] pgmap v5149: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:24.234 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:44:24.463 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:44:24.464 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 3m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:44:24.464 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 2m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:44:24.464 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:44:24.465 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:44:24.465 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:44:24.465 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:44:24.465 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:44:24.465 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:44:24.466 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:44:24.466 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 2m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:44:24.466 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:44:24.466 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:44:24.467 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:44:24.467 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:44:24.467 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:44:24.467 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:44:24.467 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:44:24.468 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 2m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:44:24.468 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 2m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:44:24.468 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:44:24.713 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:44:24.713 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:44:24.713 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:44:24.714 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:44:24.714 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:44:24.714 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:44:24.714 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:44:24.715 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:44:24.715 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:44:24.715 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:44:24.715 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:44:24.715 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:44:24.716 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:44:24.716 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:44:24.716 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:44:25.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:25 gibba013 bash[29418]: cephadm 2021-03-10T16:44:23.668686+0000 mgr.gibba020.yqfnwy (mgr.34427) 9041 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:44:25.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:25 gibba013 bash[29418]: cluster 2021-03-10T16:44:23.935364+0000 mgr.gibba020.yqfnwy (mgr.34427) 9042 : cluster [DBG] pgmap v5150: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:25.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:25 gibba013 bash[29418]: audit 2021-03-10T16:44:24.714810+0000 mon.a (mon.0) 3290 : audit [DBG] from='client.? 172.21.2.113:0/1918132451' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:25.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:25 gibba013 bash[30381]: cephadm 2021-03-10T16:44:23.668686+0000 mgr.gibba020.yqfnwy (mgr.34427) 9041 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:44:25.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:25 gibba013 bash[30381]: cluster 2021-03-10T16:44:23.935364+0000 mgr.gibba020.yqfnwy (mgr.34427) 9042 : cluster [DBG] pgmap v5150: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:25.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:25 gibba013 bash[30381]: audit 2021-03-10T16:44:24.714810+0000 mon.a (mon.0) 3290 : audit [DBG] from='client.? 172.21.2.113:0/1918132451' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:25.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:25 gibba020 bash[25448]: cephadm 2021-03-10T16:44:23.668686+0000 mgr.gibba020.yqfnwy (mgr.34427) 9041 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:44:25.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:25 gibba020 bash[25448]: cluster 2021-03-10T16:44:23.935364+0000 mgr.gibba020.yqfnwy (mgr.34427) 9042 : cluster [DBG] pgmap v5150: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:25.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:25 gibba020 bash[25448]: audit 2021-03-10T16:44:24.714810+0000 mon.a (mon.0) 3290 : audit [DBG] from='client.? 172.21.2.113:0/1918132451' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:26.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:26 gibba013 bash[29418]: audit 2021-03-10T16:44:24.226064+0000 mgr.gibba020.yqfnwy (mgr.34427) 9043 : audit [DBG] from='client.50118 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:44:26.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:26 gibba013 bash[29418]: audit 2021-03-10T16:44:24.452481+0000 mgr.gibba020.yqfnwy (mgr.34427) 9044 : audit [DBG] from='client.60106 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:44:26.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:26 gibba013 bash[30381]: audit 2021-03-10T16:44:24.226064+0000 mgr.gibba020.yqfnwy (mgr.34427) 9043 : audit [DBG] from='client.50118 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:44:26.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:26 gibba013 bash[30381]: audit 2021-03-10T16:44:24.452481+0000 mgr.gibba020.yqfnwy (mgr.34427) 9044 : audit [DBG] from='client.60106 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:44:26.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:26 gibba020 bash[25448]: audit 2021-03-10T16:44:24.226064+0000 mgr.gibba020.yqfnwy (mgr.34427) 9043 : audit [DBG] from='client.50118 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:44:26.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:26 gibba020 bash[25448]: audit 2021-03-10T16:44:24.452481+0000 mgr.gibba020.yqfnwy (mgr.34427) 9044 : audit [DBG] from='client.60106 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:44:27.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:27 gibba013 bash[29418]: cluster 2021-03-10T16:44:25.937276+0000 mgr.gibba020.yqfnwy (mgr.34427) 9045 : cluster [DBG] pgmap v5151: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:27.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:27 gibba013 bash[30381]: cluster 2021-03-10T16:44:25.937276+0000 mgr.gibba020.yqfnwy (mgr.34427) 9045 : cluster [DBG] pgmap v5151: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:27.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:27 gibba020 bash[25448]: cluster 2021-03-10T16:44:25.937276+0000 mgr.gibba020.yqfnwy (mgr.34427) 9045 : cluster [DBG] pgmap v5151: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:29.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:29 gibba013 bash[29418]: cluster 2021-03-10T16:44:27.938510+0000 mgr.gibba020.yqfnwy (mgr.34427) 9046 : cluster [DBG] pgmap v5152: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:29.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:29 gibba013 bash[30381]: cluster 2021-03-10T16:44:27.938510+0000 mgr.gibba020.yqfnwy (mgr.34427) 9046 : cluster [DBG] pgmap v5152: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:29.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:29 gibba020 bash[25448]: cluster 2021-03-10T16:44:27.938510+0000 mgr.gibba020.yqfnwy (mgr.34427) 9046 : cluster [DBG] pgmap v5152: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:31.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:30 gibba013 bash[29418]: cluster 2021-03-10T16:44:29.940550+0000 mgr.gibba020.yqfnwy (mgr.34427) 9047 : cluster [DBG] pgmap v5153: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:31.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:30 gibba013 bash[30381]: cluster 2021-03-10T16:44:29.940550+0000 mgr.gibba020.yqfnwy (mgr.34427) 9047 : cluster [DBG] pgmap v5153: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:31.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:30 gibba020 bash[25448]: cluster 2021-03-10T16:44:29.940550+0000 mgr.gibba020.yqfnwy (mgr.34427) 9047 : cluster [DBG] pgmap v5153: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:33.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:33 gibba013 bash[29418]: cluster 2021-03-10T16:44:31.941898+0000 mgr.gibba020.yqfnwy (mgr.34427) 9048 : cluster [DBG] pgmap v5154: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:33.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:33 gibba013 bash[30381]: cluster 2021-03-10T16:44:31.941898+0000 mgr.gibba020.yqfnwy (mgr.34427) 9048 : cluster [DBG] pgmap v5154: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:33.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:33 gibba020 bash[25448]: cluster 2021-03-10T16:44:31.941898+0000 mgr.gibba020.yqfnwy (mgr.34427) 9048 : cluster [DBG] pgmap v5154: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:35.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:35 gibba013 bash[29418]: cluster 2021-03-10T16:44:33.943440+0000 mgr.gibba020.yqfnwy (mgr.34427) 9049 : cluster [DBG] pgmap v5155: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:35.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:35 gibba013 bash[30381]: cluster 2021-03-10T16:44:33.943440+0000 mgr.gibba020.yqfnwy (mgr.34427) 9049 : cluster [DBG] pgmap v5155: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:35.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:35 gibba020 bash[25448]: cluster 2021-03-10T16:44:33.943440+0000 mgr.gibba020.yqfnwy (mgr.34427) 9049 : cluster [DBG] pgmap v5155: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:37.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:37 gibba013 bash[29418]: cluster 2021-03-10T16:44:35.945325+0000 mgr.gibba020.yqfnwy (mgr.34427) 9050 : cluster [DBG] pgmap v5156: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:37.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:37 gibba013 bash[30381]: cluster 2021-03-10T16:44:35.945325+0000 mgr.gibba020.yqfnwy (mgr.34427) 9050 : cluster [DBG] pgmap v5156: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:37.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:37 gibba020 bash[25448]: cluster 2021-03-10T16:44:35.945325+0000 mgr.gibba020.yqfnwy (mgr.34427) 9050 : cluster [DBG] pgmap v5156: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:39.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:39 gibba013 bash[29418]: cluster 2021-03-10T16:44:37.946691+0000 mgr.gibba020.yqfnwy (mgr.34427) 9051 : cluster [DBG] pgmap v5157: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:39.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:39 gibba013 bash[30381]: cluster 2021-03-10T16:44:37.946691+0000 mgr.gibba020.yqfnwy (mgr.34427) 9051 : cluster [DBG] pgmap v5157: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:39.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:39 gibba020 bash[25448]: cluster 2021-03-10T16:44:37.946691+0000 mgr.gibba020.yqfnwy (mgr.34427) 9051 : cluster [DBG] pgmap v5157: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:40.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:40 gibba013 bash[29418]: cephadm 2021-03-10T16:44:38.684707+0000 mgr.gibba020.yqfnwy (mgr.34427) 9052 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:44:40.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:40 gibba013 bash[30381]: cephadm 2021-03-10T16:44:38.684707+0000 mgr.gibba020.yqfnwy (mgr.34427) 9052 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:44:40.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:40 gibba020 bash[25448]: cephadm 2021-03-10T16:44:38.684707+0000 mgr.gibba020.yqfnwy (mgr.34427) 9052 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:44:41.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:41 gibba013 bash[29418]: cluster 2021-03-10T16:44:39.948573+0000 mgr.gibba020.yqfnwy (mgr.34427) 9053 : cluster [DBG] pgmap v5158: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:41.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:41 gibba013 bash[30381]: cluster 2021-03-10T16:44:39.948573+0000 mgr.gibba020.yqfnwy (mgr.34427) 9053 : cluster [DBG] pgmap v5158: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:41.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:41 gibba020 bash[25448]: cluster 2021-03-10T16:44:39.948573+0000 mgr.gibba020.yqfnwy (mgr.34427) 9053 : cluster [DBG] pgmap v5158: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:43.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:43 gibba013 bash[29418]: cluster 2021-03-10T16:44:41.949687+0000 mgr.gibba020.yqfnwy (mgr.34427) 9054 : cluster [DBG] pgmap v5159: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:43.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:43 gibba013 bash[30381]: cluster 2021-03-10T16:44:41.949687+0000 mgr.gibba020.yqfnwy (mgr.34427) 9054 : cluster [DBG] pgmap v5159: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:43.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:43 gibba020 bash[25448]: cluster 2021-03-10T16:44:41.949687+0000 mgr.gibba020.yqfnwy (mgr.34427) 9054 : cluster [DBG] pgmap v5159: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:45.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:45 gibba013 bash[29418]: cluster 2021-03-10T16:44:43.951044+0000 mgr.gibba020.yqfnwy (mgr.34427) 9055 : cluster [DBG] pgmap v5160: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:45.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:45 gibba013 bash[30381]: cluster 2021-03-10T16:44:43.951044+0000 mgr.gibba020.yqfnwy (mgr.34427) 9055 : cluster [DBG] pgmap v5160: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:45.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:45 gibba020 bash[25448]: cluster 2021-03-10T16:44:43.951044+0000 mgr.gibba020.yqfnwy (mgr.34427) 9055 : cluster [DBG] pgmap v5160: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:47.377 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:47 gibba013 bash[30381]: cluster 2021-03-10T16:44:45.952803+0000 mgr.gibba020.yqfnwy (mgr.34427) 9056 : cluster [DBG] pgmap v5161: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:47.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:47 gibba013 bash[29418]: cluster 2021-03-10T16:44:45.952803+0000 mgr.gibba020.yqfnwy (mgr.34427) 9056 : cluster [DBG] pgmap v5161: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:47.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:47 gibba020 bash[25448]: cluster 2021-03-10T16:44:45.952803+0000 mgr.gibba020.yqfnwy (mgr.34427) 9056 : cluster [DBG] pgmap v5161: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:49.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:49 gibba013 bash[29418]: cluster 2021-03-10T16:44:47.954205+0000 mgr.gibba020.yqfnwy (mgr.34427) 9057 : cluster [DBG] pgmap v5162: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:49.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:49 gibba013 bash[30381]: cluster 2021-03-10T16:44:47.954205+0000 mgr.gibba020.yqfnwy (mgr.34427) 9057 : cluster [DBG] pgmap v5162: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:49.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:49 gibba020 bash[25448]: cluster 2021-03-10T16:44:47.954205+0000 mgr.gibba020.yqfnwy (mgr.34427) 9057 : cluster [DBG] pgmap v5162: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:51.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:50 gibba013 bash[29418]: cluster 2021-03-10T16:44:49.956184+0000 mgr.gibba020.yqfnwy (mgr.34427) 9058 : cluster [DBG] pgmap v5163: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:51.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:50 gibba013 bash[30381]: cluster 2021-03-10T16:44:49.956184+0000 mgr.gibba020.yqfnwy (mgr.34427) 9058 : cluster [DBG] pgmap v5163: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:51.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:50 gibba020 bash[25448]: cluster 2021-03-10T16:44:49.956184+0000 mgr.gibba020.yqfnwy (mgr.34427) 9058 : cluster [DBG] pgmap v5163: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:53.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:53 gibba013 bash[29418]: cluster 2021-03-10T16:44:51.957324+0000 mgr.gibba020.yqfnwy (mgr.34427) 9059 : cluster [DBG] pgmap v5164: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:53.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:53 gibba013 bash[30381]: cluster 2021-03-10T16:44:51.957324+0000 mgr.gibba020.yqfnwy (mgr.34427) 9059 : cluster [DBG] pgmap v5164: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:53.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:53 gibba020 bash[25448]: cluster 2021-03-10T16:44:51.957324+0000 mgr.gibba020.yqfnwy (mgr.34427) 9059 : cluster [DBG] pgmap v5164: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:54.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:54 gibba020 bash[25448]: audit 2021-03-10T16:44:53.701951+0000 mon.a (mon.0) 3291 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:44:54.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:54 gibba020 bash[25448]: audit 2021-03-10T16:44:53.929008+0000 mon.a (mon.0) 3292 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:44:54.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:54 gibba020 bash[25448]: audit 2021-03-10T16:44:53.932346+0000 mon.a (mon.0) 3293 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:44:54.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:54 gibba020 bash[25448]: audit 2021-03-10T16:44:53.933955+0000 mon.a (mon.0) 3294 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:54.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:54 gibba020 bash[25448]: audit 2021-03-10T16:44:53.935952+0000 mon.a (mon.0) 3295 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:54.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:54 gibba020 bash[25448]: audit 2021-03-10T16:44:53.937911+0000 mon.a (mon.0) 3296 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:54.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:54 gibba020 bash[25448]: audit 2021-03-10T16:44:53.941266+0000 mon.a (mon.0) 3297 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:54.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:54 gibba020 bash[25448]: audit 2021-03-10T16:44:53.942999+0000 mon.a (mon.0) 3298 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:54.377 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:54 gibba013 bash[30381]: audit 2021-03-10T16:44:53.701951+0000 mon.a (mon.0) 3291 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:44:54.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:54 gibba013 bash[30381]: audit 2021-03-10T16:44:53.929008+0000 mon.a (mon.0) 3292 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:44:54.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:54 gibba013 bash[30381]: audit 2021-03-10T16:44:53.932346+0000 mon.a (mon.0) 3293 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:44:54.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:54 gibba013 bash[30381]: audit 2021-03-10T16:44:53.933955+0000 mon.a (mon.0) 3294 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:54.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:54 gibba013 bash[30381]: audit 2021-03-10T16:44:53.935952+0000 mon.a (mon.0) 3295 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:54.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:54 gibba013 bash[30381]: audit 2021-03-10T16:44:53.937911+0000 mon.a (mon.0) 3296 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:54.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:54 gibba013 bash[30381]: audit 2021-03-10T16:44:53.941266+0000 mon.a (mon.0) 3297 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:54.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:54 gibba013 bash[30381]: audit 2021-03-10T16:44:53.942999+0000 mon.a (mon.0) 3298 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:54.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:54 gibba013 bash[29418]: audit 2021-03-10T16:44:53.701951+0000 mon.a (mon.0) 3291 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:44:54.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:54 gibba013 bash[29418]: audit 2021-03-10T16:44:53.929008+0000 mon.a (mon.0) 3292 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:44:54.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:54 gibba013 bash[29418]: audit 2021-03-10T16:44:53.932346+0000 mon.a (mon.0) 3293 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:44:54.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:54 gibba013 bash[29418]: audit 2021-03-10T16:44:53.933955+0000 mon.a (mon.0) 3294 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:54.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:54 gibba013 bash[29418]: audit 2021-03-10T16:44:53.935952+0000 mon.a (mon.0) 3295 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:54.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:54 gibba013 bash[29418]: audit 2021-03-10T16:44:53.937911+0000 mon.a (mon.0) 3296 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:54.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:54 gibba013 bash[29418]: audit 2021-03-10T16:44:53.941266+0000 mon.a (mon.0) 3297 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:54.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:54 gibba013 bash[29418]: audit 2021-03-10T16:44:53.942999+0000 mon.a (mon.0) 3298 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:54.999 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:44:55.258 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:44:55.259 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 4m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:44:55.259 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 3m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:44:55.259 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:44:55.259 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:44:55.260 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:44:55.260 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:44:55.260 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:44:55.260 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:44:55.261 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:44:55.261 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:44:55.261 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:44:55.261 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:44:55.262 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:44:55.262 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:44:55.262 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:44:55.262 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:44:55.263 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:44:55.263 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:44:55.263 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 3m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:44:55.263 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 3m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:44:55.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:55 gibba013 bash[29418]: cephadm 2021-03-10T16:44:53.706775+0000 mgr.gibba020.yqfnwy (mgr.34427) 9060 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:44:55.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:55 gibba013 bash[29418]: cephadm 2021-03-10T16:44:53.708535+0000 mgr.gibba020.yqfnwy (mgr.34427) 9061 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:44:55.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:55 gibba013 bash[29418]: cephadm 2021-03-10T16:44:53.930920+0000 mgr.gibba020.yqfnwy (mgr.34427) 9062 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:44:55.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:55 gibba013 bash[29418]: cephadm 2021-03-10T16:44:53.932925+0000 mgr.gibba020.yqfnwy (mgr.34427) 9063 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:44:55.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:55 gibba013 bash[29418]: cephadm 2021-03-10T16:44:53.934689+0000 mgr.gibba020.yqfnwy (mgr.34427) 9064 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:44:55.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:55 gibba013 bash[29418]: cephadm 2021-03-10T16:44:53.934726+0000 mgr.gibba020.yqfnwy (mgr.34427) 9065 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:44:55.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:55 gibba013 bash[29418]: cephadm 2021-03-10T16:44:53.936860+0000 mgr.gibba020.yqfnwy (mgr.34427) 9066 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:44:55.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:55 gibba013 bash[29418]: cephadm 2021-03-10T16:44:53.936901+0000 mgr.gibba020.yqfnwy (mgr.34427) 9067 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:44:55.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:55 gibba013 bash[29418]: cephadm 2021-03-10T16:44:53.938612+0000 mgr.gibba020.yqfnwy (mgr.34427) 9068 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:44:55.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:55 gibba013 bash[29418]: cephadm 2021-03-10T16:44:53.940151+0000 mgr.gibba020.yqfnwy (mgr.34427) 9069 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:44:55.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:55 gibba013 bash[29418]: cephadm 2021-03-10T16:44:53.940192+0000 mgr.gibba020.yqfnwy (mgr.34427) 9070 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:44:55.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:55 gibba013 bash[29418]: cephadm 2021-03-10T16:44:53.941624+0000 mgr.gibba020.yqfnwy (mgr.34427) 9071 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:44:55.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:55 gibba013 bash[29418]: cephadm 2021-03-10T16:44:53.942070+0000 mgr.gibba020.yqfnwy (mgr.34427) 9072 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:44:55.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:55 gibba013 bash[29418]: cephadm 2021-03-10T16:44:53.943435+0000 mgr.gibba020.yqfnwy (mgr.34427) 9073 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:44:55.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:55 gibba013 bash[29418]: cephadm 2021-03-10T16:44:53.943480+0000 mgr.gibba020.yqfnwy (mgr.34427) 9074 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:44:55.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:55 gibba013 bash[29418]: cephadm 2021-03-10T16:44:53.943607+0000 mgr.gibba020.yqfnwy (mgr.34427) 9075 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:44:55.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:55 gibba013 bash[29418]: cluster 2021-03-10T16:44:53.958738+0000 mgr.gibba020.yqfnwy (mgr.34427) 9076 : cluster [DBG] pgmap v5165: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:55.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:55 gibba013 bash[30381]: cephadm 2021-03-10T16:44:53.706775+0000 mgr.gibba020.yqfnwy (mgr.34427) 9060 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:44:55.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:55 gibba013 bash[30381]: cephadm 2021-03-10T16:44:53.708535+0000 mgr.gibba020.yqfnwy (mgr.34427) 9061 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:44:55.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:55 gibba013 bash[30381]: cephadm 2021-03-10T16:44:53.930920+0000 mgr.gibba020.yqfnwy (mgr.34427) 9062 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:44:55.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:55 gibba013 bash[30381]: cephadm 2021-03-10T16:44:53.932925+0000 mgr.gibba020.yqfnwy (mgr.34427) 9063 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:44:55.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:55 gibba013 bash[30381]: cephadm 2021-03-10T16:44:53.934689+0000 mgr.gibba020.yqfnwy (mgr.34427) 9064 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:44:55.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:55 gibba013 bash[30381]: cephadm 2021-03-10T16:44:53.934726+0000 mgr.gibba020.yqfnwy (mgr.34427) 9065 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:44:55.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:55 gibba013 bash[30381]: cephadm 2021-03-10T16:44:53.936860+0000 mgr.gibba020.yqfnwy (mgr.34427) 9066 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:44:55.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:55 gibba013 bash[30381]: cephadm 2021-03-10T16:44:53.936901+0000 mgr.gibba020.yqfnwy (mgr.34427) 9067 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:44:55.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:55 gibba013 bash[30381]: cephadm 2021-03-10T16:44:53.938612+0000 mgr.gibba020.yqfnwy (mgr.34427) 9068 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:44:55.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:55 gibba013 bash[30381]: cephadm 2021-03-10T16:44:53.940151+0000 mgr.gibba020.yqfnwy (mgr.34427) 9069 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:44:55.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:55 gibba013 bash[30381]: cephadm 2021-03-10T16:44:53.940192+0000 mgr.gibba020.yqfnwy (mgr.34427) 9070 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:44:55.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:55 gibba013 bash[30381]: cephadm 2021-03-10T16:44:53.941624+0000 mgr.gibba020.yqfnwy (mgr.34427) 9071 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:44:55.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:55 gibba013 bash[30381]: cephadm 2021-03-10T16:44:53.942070+0000 mgr.gibba020.yqfnwy (mgr.34427) 9072 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:44:55.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:55 gibba013 bash[30381]: cephadm 2021-03-10T16:44:53.943435+0000 mgr.gibba020.yqfnwy (mgr.34427) 9073 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:44:55.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:55 gibba013 bash[30381]: cephadm 2021-03-10T16:44:53.943480+0000 mgr.gibba020.yqfnwy (mgr.34427) 9074 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:44:55.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:55 gibba013 bash[30381]: cephadm 2021-03-10T16:44:53.943607+0000 mgr.gibba020.yqfnwy (mgr.34427) 9075 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:44:55.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:55 gibba013 bash[30381]: cluster 2021-03-10T16:44:53.958738+0000 mgr.gibba020.yqfnwy (mgr.34427) 9076 : cluster [DBG] pgmap v5165: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:55.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:55 gibba020 bash[25448]: cephadm 2021-03-10T16:44:53.706775+0000 mgr.gibba020.yqfnwy (mgr.34427) 9060 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:44:55.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:55 gibba020 bash[25448]: cephadm 2021-03-10T16:44:53.708535+0000 mgr.gibba020.yqfnwy (mgr.34427) 9061 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:44:55.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:55 gibba020 bash[25448]: cephadm 2021-03-10T16:44:53.930920+0000 mgr.gibba020.yqfnwy (mgr.34427) 9062 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:44:55.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:55 gibba020 bash[25448]: cephadm 2021-03-10T16:44:53.932925+0000 mgr.gibba020.yqfnwy (mgr.34427) 9063 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:44:55.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:55 gibba020 bash[25448]: cephadm 2021-03-10T16:44:53.934689+0000 mgr.gibba020.yqfnwy (mgr.34427) 9064 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:44:55.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:55 gibba020 bash[25448]: cephadm 2021-03-10T16:44:53.934726+0000 mgr.gibba020.yqfnwy (mgr.34427) 9065 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:44:55.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:55 gibba020 bash[25448]: cephadm 2021-03-10T16:44:53.936860+0000 mgr.gibba020.yqfnwy (mgr.34427) 9066 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:44:55.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:55 gibba020 bash[25448]: cephadm 2021-03-10T16:44:53.936901+0000 mgr.gibba020.yqfnwy (mgr.34427) 9067 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:44:55.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:55 gibba020 bash[25448]: cephadm 2021-03-10T16:44:53.938612+0000 mgr.gibba020.yqfnwy (mgr.34427) 9068 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:44:55.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:55 gibba020 bash[25448]: cephadm 2021-03-10T16:44:53.940151+0000 mgr.gibba020.yqfnwy (mgr.34427) 9069 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:44:55.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:55 gibba020 bash[25448]: cephadm 2021-03-10T16:44:53.940192+0000 mgr.gibba020.yqfnwy (mgr.34427) 9070 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:44:55.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:55 gibba020 bash[25448]: cephadm 2021-03-10T16:44:53.941624+0000 mgr.gibba020.yqfnwy (mgr.34427) 9071 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:44:55.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:55 gibba020 bash[25448]: cephadm 2021-03-10T16:44:53.942070+0000 mgr.gibba020.yqfnwy (mgr.34427) 9072 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:44:55.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:55 gibba020 bash[25448]: cephadm 2021-03-10T16:44:53.943435+0000 mgr.gibba020.yqfnwy (mgr.34427) 9073 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:44:55.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:55 gibba020 bash[25448]: cephadm 2021-03-10T16:44:53.943480+0000 mgr.gibba020.yqfnwy (mgr.34427) 9074 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:44:55.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:55 gibba020 bash[25448]: cephadm 2021-03-10T16:44:53.943607+0000 mgr.gibba020.yqfnwy (mgr.34427) 9075 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:44:55.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:55 gibba020 bash[25448]: cluster 2021-03-10T16:44:53.958738+0000 mgr.gibba020.yqfnwy (mgr.34427) 9076 : cluster [DBG] pgmap v5165: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:55.511 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:44:55.511 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:44:55.512 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:44:55.512 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:44:55.512 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:44:55.512 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:44:55.513 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:44:55.513 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:44:55.513 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:44:55.513 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:44:55.514 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:44:55.514 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:44:55.514 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:44:55.514 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:44:55.515 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:44:56.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:56 gibba013 bash[29418]: audit 2021-03-10T16:44:54.991392+0000 mgr.gibba020.yqfnwy (mgr.34427) 9077 : audit [DBG] from='client.50136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:44:56.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:56 gibba013 bash[29418]: audit 2021-03-10T16:44:55.512661+0000 mon.c (mon.1) 141 : audit [DBG] from='client.? 172.21.2.113:0/1838892271' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:56.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:56 gibba013 bash[30381]: audit 2021-03-10T16:44:54.991392+0000 mgr.gibba020.yqfnwy (mgr.34427) 9077 : audit [DBG] from='client.50136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:44:56.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:56 gibba013 bash[30381]: audit 2021-03-10T16:44:55.512661+0000 mon.c (mon.1) 141 : audit [DBG] from='client.? 172.21.2.113:0/1838892271' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:56.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:56 gibba020 bash[25448]: audit 2021-03-10T16:44:54.991392+0000 mgr.gibba020.yqfnwy (mgr.34427) 9077 : audit [DBG] from='client.50136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:44:56.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:56 gibba020 bash[25448]: audit 2021-03-10T16:44:55.512661+0000 mon.c (mon.1) 141 : audit [DBG] from='client.? 172.21.2.113:0/1838892271' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:44:57.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:57 gibba013 bash[29418]: audit 2021-03-10T16:44:55.217837+0000 mgr.gibba020.yqfnwy (mgr.34427) 9078 : audit [DBG] from='client.50142 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:44:57.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:57 gibba013 bash[29418]: cluster 2021-03-10T16:44:55.960516+0000 mgr.gibba020.yqfnwy (mgr.34427) 9079 : cluster [DBG] pgmap v5166: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:57.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:57 gibba013 bash[30381]: audit 2021-03-10T16:44:55.217837+0000 mgr.gibba020.yqfnwy (mgr.34427) 9078 : audit [DBG] from='client.50142 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:44:57.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:57 gibba013 bash[30381]: cluster 2021-03-10T16:44:55.960516+0000 mgr.gibba020.yqfnwy (mgr.34427) 9079 : cluster [DBG] pgmap v5166: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:57.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:57 gibba020 bash[25448]: audit 2021-03-10T16:44:55.217837+0000 mgr.gibba020.yqfnwy (mgr.34427) 9078 : audit [DBG] from='client.50142 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:44:57.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:57 gibba020 bash[25448]: cluster 2021-03-10T16:44:55.960516+0000 mgr.gibba020.yqfnwy (mgr.34427) 9079 : cluster [DBG] pgmap v5166: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:59.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:44:59 gibba013 bash[29418]: cluster 2021-03-10T16:44:57.961890+0000 mgr.gibba020.yqfnwy (mgr.34427) 9080 : cluster [DBG] pgmap v5167: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:59.377 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:44:59 gibba013 bash[30381]: cluster 2021-03-10T16:44:57.961890+0000 mgr.gibba020.yqfnwy (mgr.34427) 9080 : cluster [DBG] pgmap v5167: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:44:59.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:44:59 gibba020 bash[25448]: cluster 2021-03-10T16:44:57.961890+0000 mgr.gibba020.yqfnwy (mgr.34427) 9080 : cluster [DBG] pgmap v5167: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:01.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:00 gibba013 bash[29418]: cluster 2021-03-10T16:44:59.963586+0000 mgr.gibba020.yqfnwy (mgr.34427) 9081 : cluster [DBG] pgmap v5168: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:01.127 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:00 gibba013 bash[30381]: cluster 2021-03-10T16:44:59.963586+0000 mgr.gibba020.yqfnwy (mgr.34427) 9081 : cluster [DBG] pgmap v5168: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:01.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:00 gibba020 bash[25448]: cluster 2021-03-10T16:44:59.963586+0000 mgr.gibba020.yqfnwy (mgr.34427) 9081 : cluster [DBG] pgmap v5168: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:03.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:03 gibba013 bash[29418]: cluster 2021-03-10T16:45:01.964293+0000 mgr.gibba020.yqfnwy (mgr.34427) 9082 : cluster [DBG] pgmap v5169: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:03.377 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:03 gibba013 bash[30381]: cluster 2021-03-10T16:45:01.964293+0000 mgr.gibba020.yqfnwy (mgr.34427) 9082 : cluster [DBG] pgmap v5169: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:03.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:03 gibba020 bash[25448]: cluster 2021-03-10T16:45:01.964293+0000 mgr.gibba020.yqfnwy (mgr.34427) 9082 : cluster [DBG] pgmap v5169: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:05.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:05 gibba013 bash[29418]: cluster 2021-03-10T16:45:03.965543+0000 mgr.gibba020.yqfnwy (mgr.34427) 9083 : cluster [DBG] pgmap v5170: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:05.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:05 gibba013 bash[30381]: cluster 2021-03-10T16:45:03.965543+0000 mgr.gibba020.yqfnwy (mgr.34427) 9083 : cluster [DBG] pgmap v5170: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:05.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:05 gibba020 bash[25448]: cluster 2021-03-10T16:45:03.965543+0000 mgr.gibba020.yqfnwy (mgr.34427) 9083 : cluster [DBG] pgmap v5170: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:07.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:07 gibba013 bash[29418]: cluster 2021-03-10T16:45:05.967098+0000 mgr.gibba020.yqfnwy (mgr.34427) 9084 : cluster [DBG] pgmap v5171: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:07.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:07 gibba013 bash[29418]: audit 2021-03-10T16:45:06.786773+0000 mon.a (mon.0) 3299 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:45:07.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:07 gibba013 bash[29418]: audit 2021-03-10T16:45:06.956785+0000 mon.a (mon.0) 3300 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:45:07.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:07 gibba013 bash[30381]: cluster 2021-03-10T16:45:05.967098+0000 mgr.gibba020.yqfnwy (mgr.34427) 9084 : cluster [DBG] pgmap v5171: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:07.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:07 gibba013 bash[30381]: audit 2021-03-10T16:45:06.786773+0000 mon.a (mon.0) 3299 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:45:07.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:07 gibba013 bash[30381]: audit 2021-03-10T16:45:06.956785+0000 mon.a (mon.0) 3300 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:45:07.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:07 gibba020 bash[25448]: cluster 2021-03-10T16:45:05.967098+0000 mgr.gibba020.yqfnwy (mgr.34427) 9084 : cluster [DBG] pgmap v5171: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:07.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:07 gibba020 bash[25448]: audit 2021-03-10T16:45:06.786773+0000 mon.a (mon.0) 3299 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:45:07.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:07 gibba020 bash[25448]: audit 2021-03-10T16:45:06.956785+0000 mon.a (mon.0) 3300 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:45:08.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:08 gibba013 bash[29418]: audit 2021-03-10T16:45:07.314097+0000 mon.a (mon.0) 3301 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:45:08.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:08 gibba013 bash[29418]: audit 2021-03-10T16:45:07.314922+0000 mon.a (mon.0) 3302 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:45:08.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:08 gibba013 bash[29418]: audit 2021-03-10T16:45:07.315721+0000 mon.a (mon.0) 3303 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T16:45:08.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:08 gibba013 bash[29418]: audit 2021-03-10T16:45:07.316490+0000 mon.a (mon.0) 3304 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:45:08.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:08 gibba013 bash[30381]: audit 2021-03-10T16:45:07.314097+0000 mon.a (mon.0) 3301 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:45:08.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:08 gibba013 bash[30381]: audit 2021-03-10T16:45:07.314922+0000 mon.a (mon.0) 3302 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:45:08.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:08 gibba013 bash[30381]: audit 2021-03-10T16:45:07.315721+0000 mon.a (mon.0) 3303 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T16:45:08.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:08 gibba013 bash[30381]: audit 2021-03-10T16:45:07.316490+0000 mon.a (mon.0) 3304 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:45:08.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:08 gibba020 bash[25448]: audit 2021-03-10T16:45:07.314097+0000 mon.a (mon.0) 3301 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T16:45:08.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:08 gibba020 bash[25448]: audit 2021-03-10T16:45:07.314922+0000 mon.a (mon.0) 3302 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:45:08.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:08 gibba020 bash[25448]: audit 2021-03-10T16:45:07.315721+0000 mon.a (mon.0) 3303 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T16:45:08.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:08 gibba020 bash[25448]: audit 2021-03-10T16:45:07.316490+0000 mon.a (mon.0) 3304 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:45:09.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:09 gibba020 bash[25448]: cluster 2021-03-10T16:45:07.968464+0000 mgr.gibba020.yqfnwy (mgr.34427) 9085 : cluster [DBG] pgmap v5172: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:09.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:09 gibba013 bash[29418]: cluster 2021-03-10T16:45:07.968464+0000 mgr.gibba020.yqfnwy (mgr.34427) 9085 : cluster [DBG] pgmap v5172: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:09.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:09 gibba013 bash[30381]: cluster 2021-03-10T16:45:07.968464+0000 mgr.gibba020.yqfnwy (mgr.34427) 9085 : cluster [DBG] pgmap v5172: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:10.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:10 gibba013 bash[29418]: cephadm 2021-03-10T16:45:08.945195+0000 mgr.gibba020.yqfnwy (mgr.34427) 9086 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:45:10.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:10 gibba013 bash[30381]: cephadm 2021-03-10T16:45:08.945195+0000 mgr.gibba020.yqfnwy (mgr.34427) 9086 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:45:10.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:10 gibba020 bash[25448]: cephadm 2021-03-10T16:45:08.945195+0000 mgr.gibba020.yqfnwy (mgr.34427) 9086 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:45:11.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:11 gibba013 bash[29418]: cluster 2021-03-10T16:45:09.970326+0000 mgr.gibba020.yqfnwy (mgr.34427) 9087 : cluster [DBG] pgmap v5173: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:11.377 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:11 gibba013 bash[30381]: cluster 2021-03-10T16:45:09.970326+0000 mgr.gibba020.yqfnwy (mgr.34427) 9087 : cluster [DBG] pgmap v5173: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:11.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:11 gibba020 bash[25448]: cluster 2021-03-10T16:45:09.970326+0000 mgr.gibba020.yqfnwy (mgr.34427) 9087 : cluster [DBG] pgmap v5173: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:13.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:13 gibba013 bash[29418]: cluster 2021-03-10T16:45:11.971593+0000 mgr.gibba020.yqfnwy (mgr.34427) 9088 : cluster [DBG] pgmap v5174: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:13.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:13 gibba013 bash[30381]: cluster 2021-03-10T16:45:11.971593+0000 mgr.gibba020.yqfnwy (mgr.34427) 9088 : cluster [DBG] pgmap v5174: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:13.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:13 gibba020 bash[25448]: cluster 2021-03-10T16:45:11.971593+0000 mgr.gibba020.yqfnwy (mgr.34427) 9088 : cluster [DBG] pgmap v5174: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:15.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:15 gibba013 bash[29418]: cluster 2021-03-10T16:45:13.973006+0000 mgr.gibba020.yqfnwy (mgr.34427) 9089 : cluster [DBG] pgmap v5175: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:15.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:15 gibba013 bash[30381]: cluster 2021-03-10T16:45:13.973006+0000 mgr.gibba020.yqfnwy (mgr.34427) 9089 : cluster [DBG] pgmap v5175: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:15.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:15 gibba020 bash[25448]: cluster 2021-03-10T16:45:13.973006+0000 mgr.gibba020.yqfnwy (mgr.34427) 9089 : cluster [DBG] pgmap v5175: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:17.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:17 gibba013 bash[29418]: cluster 2021-03-10T16:45:15.974809+0000 mgr.gibba020.yqfnwy (mgr.34427) 9090 : cluster [DBG] pgmap v5176: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:17.377 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:17 gibba013 bash[30381]: cluster 2021-03-10T16:45:15.974809+0000 mgr.gibba020.yqfnwy (mgr.34427) 9090 : cluster [DBG] pgmap v5176: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:17.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:17 gibba020 bash[25448]: cluster 2021-03-10T16:45:15.974809+0000 mgr.gibba020.yqfnwy (mgr.34427) 9090 : cluster [DBG] pgmap v5176: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:19.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:19 gibba013 bash[29418]: cluster 2021-03-10T16:45:17.976243+0000 mgr.gibba020.yqfnwy (mgr.34427) 9091 : cluster [DBG] pgmap v5177: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:19.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:19 gibba013 bash[30381]: cluster 2021-03-10T16:45:17.976243+0000 mgr.gibba020.yqfnwy (mgr.34427) 9091 : cluster [DBG] pgmap v5177: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:19.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:19 gibba020 bash[25448]: cluster 2021-03-10T16:45:17.976243+0000 mgr.gibba020.yqfnwy (mgr.34427) 9091 : cluster [DBG] pgmap v5177: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:21.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:20 gibba013 bash[29418]: cluster 2021-03-10T16:45:19.978256+0000 mgr.gibba020.yqfnwy (mgr.34427) 9092 : cluster [DBG] pgmap v5178: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:21.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:20 gibba013 bash[30381]: cluster 2021-03-10T16:45:19.978256+0000 mgr.gibba020.yqfnwy (mgr.34427) 9092 : cluster [DBG] pgmap v5178: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:21.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:20 gibba020 bash[25448]: cluster 2021-03-10T16:45:19.978256+0000 mgr.gibba020.yqfnwy (mgr.34427) 9092 : cluster [DBG] pgmap v5178: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:23.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:23 gibba013 bash[29418]: cluster 2021-03-10T16:45:21.979571+0000 mgr.gibba020.yqfnwy (mgr.34427) 9093 : cluster [DBG] pgmap v5179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:23.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:23 gibba013 bash[30381]: cluster 2021-03-10T16:45:21.979571+0000 mgr.gibba020.yqfnwy (mgr.34427) 9093 : cluster [DBG] pgmap v5179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:23.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:23 gibba020 bash[25448]: cluster 2021-03-10T16:45:21.979571+0000 mgr.gibba020.yqfnwy (mgr.34427) 9093 : cluster [DBG] pgmap v5179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:25.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:25 gibba013 bash[29418]: cephadm 2021-03-10T16:45:23.960981+0000 mgr.gibba020.yqfnwy (mgr.34427) 9094 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:45:25.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:25 gibba013 bash[29418]: cluster 2021-03-10T16:45:23.980981+0000 mgr.gibba020.yqfnwy (mgr.34427) 9095 : cluster [DBG] pgmap v5180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:25.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:25 gibba013 bash[30381]: cephadm 2021-03-10T16:45:23.960981+0000 mgr.gibba020.yqfnwy (mgr.34427) 9094 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:45:25.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:25 gibba013 bash[30381]: cluster 2021-03-10T16:45:23.980981+0000 mgr.gibba020.yqfnwy (mgr.34427) 9095 : cluster [DBG] pgmap v5180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:25.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:25 gibba020 bash[25448]: cephadm 2021-03-10T16:45:23.960981+0000 mgr.gibba020.yqfnwy (mgr.34427) 9094 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:45:25.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:25 gibba020 bash[25448]: cluster 2021-03-10T16:45:23.980981+0000 mgr.gibba020.yqfnwy (mgr.34427) 9095 : cluster [DBG] pgmap v5180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:25.755 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:45:25.983 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:45:25.984 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 4m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:45:25.984 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 3m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:45:25.985 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:45:25.985 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:45:25.985 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:45:25.986 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:45:25.986 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:45:25.986 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:45:25.987 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:45:25.987 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 3m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:45:25.987 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:45:25.987 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:45:25.987 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:45:25.988 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:45:25.988 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:45:25.988 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:45:25.988 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:45:25.989 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 3m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:45:25.989 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 3m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:45:25.989 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 3m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:45:26.233 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:45:26.234 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:45:26.234 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:45:26.234 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:45:26.235 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:45:26.235 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:45:26.235 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:45:26.235 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:45:26.235 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:45:26.236 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:45:26.236 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:45:26.236 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:45:26.236 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:45:26.237 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:45:26.237 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:45:27.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:27 gibba013 bash[29418]: audit 2021-03-10T16:45:25.747906+0000 mgr.gibba020.yqfnwy (mgr.34427) 9096 : audit [DBG] from='client.60136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:45:27.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:27 gibba013 bash[29418]: audit 2021-03-10T16:45:25.972313+0000 mgr.gibba020.yqfnwy (mgr.34427) 9097 : audit [DBG] from='client.60142 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:45:27.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:27 gibba013 bash[29418]: cluster 2021-03-10T16:45:25.981489+0000 mgr.gibba020.yqfnwy (mgr.34427) 9098 : cluster [DBG] pgmap v5181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:27.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:27 gibba013 bash[29418]: audit 2021-03-10T16:45:26.235122+0000 mon.c (mon.1) 142 : audit [DBG] from='client.? 172.21.2.113:0/2549673503' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:27.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:27 gibba013 bash[30381]: audit 2021-03-10T16:45:25.747906+0000 mgr.gibba020.yqfnwy (mgr.34427) 9096 : audit [DBG] from='client.60136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:45:27.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:27 gibba013 bash[30381]: audit 2021-03-10T16:45:25.972313+0000 mgr.gibba020.yqfnwy (mgr.34427) 9097 : audit [DBG] from='client.60142 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:45:27.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:27 gibba013 bash[30381]: cluster 2021-03-10T16:45:25.981489+0000 mgr.gibba020.yqfnwy (mgr.34427) 9098 : cluster [DBG] pgmap v5181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:27.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:27 gibba013 bash[30381]: audit 2021-03-10T16:45:26.235122+0000 mon.c (mon.1) 142 : audit [DBG] from='client.? 172.21.2.113:0/2549673503' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:27.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:27 gibba020 bash[25448]: audit 2021-03-10T16:45:25.747906+0000 mgr.gibba020.yqfnwy (mgr.34427) 9096 : audit [DBG] from='client.60136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:45:27.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:27 gibba020 bash[25448]: audit 2021-03-10T16:45:25.972313+0000 mgr.gibba020.yqfnwy (mgr.34427) 9097 : audit [DBG] from='client.60142 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:45:27.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:27 gibba020 bash[25448]: cluster 2021-03-10T16:45:25.981489+0000 mgr.gibba020.yqfnwy (mgr.34427) 9098 : cluster [DBG] pgmap v5181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:27.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:27 gibba020 bash[25448]: audit 2021-03-10T16:45:26.235122+0000 mon.c (mon.1) 142 : audit [DBG] from='client.? 172.21.2.113:0/2549673503' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:29.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:29 gibba013 bash[29418]: cluster 2021-03-10T16:45:27.982724+0000 mgr.gibba020.yqfnwy (mgr.34427) 9099 : cluster [DBG] pgmap v5182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:29.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:29 gibba013 bash[30381]: cluster 2021-03-10T16:45:27.982724+0000 mgr.gibba020.yqfnwy (mgr.34427) 9099 : cluster [DBG] pgmap v5182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:29.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:29 gibba020 bash[25448]: cluster 2021-03-10T16:45:27.982724+0000 mgr.gibba020.yqfnwy (mgr.34427) 9099 : cluster [DBG] pgmap v5182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:31.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:30 gibba013 bash[29418]: cluster 2021-03-10T16:45:29.984712+0000 mgr.gibba020.yqfnwy (mgr.34427) 9100 : cluster [DBG] pgmap v5183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:31.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:30 gibba013 bash[30381]: cluster 2021-03-10T16:45:29.984712+0000 mgr.gibba020.yqfnwy (mgr.34427) 9100 : cluster [DBG] pgmap v5183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:31.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:30 gibba020 bash[25448]: cluster 2021-03-10T16:45:29.984712+0000 mgr.gibba020.yqfnwy (mgr.34427) 9100 : cluster [DBG] pgmap v5183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:33.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:33 gibba013 bash[29418]: cluster 2021-03-10T16:45:31.985826+0000 mgr.gibba020.yqfnwy (mgr.34427) 9101 : cluster [DBG] pgmap v5184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:33.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:33 gibba013 bash[30381]: cluster 2021-03-10T16:45:31.985826+0000 mgr.gibba020.yqfnwy (mgr.34427) 9101 : cluster [DBG] pgmap v5184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:33.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:33 gibba020 bash[25448]: cluster 2021-03-10T16:45:31.985826+0000 mgr.gibba020.yqfnwy (mgr.34427) 9101 : cluster [DBG] pgmap v5184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:35.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:35 gibba013 bash[29418]: cluster 2021-03-10T16:45:33.987197+0000 mgr.gibba020.yqfnwy (mgr.34427) 9102 : cluster [DBG] pgmap v5185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:35.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:35 gibba013 bash[30381]: cluster 2021-03-10T16:45:33.987197+0000 mgr.gibba020.yqfnwy (mgr.34427) 9102 : cluster [DBG] pgmap v5185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:35.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:35 gibba020 bash[25448]: cluster 2021-03-10T16:45:33.987197+0000 mgr.gibba020.yqfnwy (mgr.34427) 9102 : cluster [DBG] pgmap v5185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:37.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:37 gibba013 bash[29418]: cluster 2021-03-10T16:45:35.988844+0000 mgr.gibba020.yqfnwy (mgr.34427) 9103 : cluster [DBG] pgmap v5186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:37.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:37 gibba013 bash[30381]: cluster 2021-03-10T16:45:35.988844+0000 mgr.gibba020.yqfnwy (mgr.34427) 9103 : cluster [DBG] pgmap v5186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:37.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:37 gibba020 bash[25448]: cluster 2021-03-10T16:45:35.988844+0000 mgr.gibba020.yqfnwy (mgr.34427) 9103 : cluster [DBG] pgmap v5186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:39.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:39 gibba013 bash[29418]: cluster 2021-03-10T16:45:37.990210+0000 mgr.gibba020.yqfnwy (mgr.34427) 9104 : cluster [DBG] pgmap v5187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:39.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:39 gibba013 bash[30381]: cluster 2021-03-10T16:45:37.990210+0000 mgr.gibba020.yqfnwy (mgr.34427) 9104 : cluster [DBG] pgmap v5187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:39.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:39 gibba020 bash[25448]: cluster 2021-03-10T16:45:37.990210+0000 mgr.gibba020.yqfnwy (mgr.34427) 9104 : cluster [DBG] pgmap v5187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:40.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:40 gibba013 bash[29418]: cephadm 2021-03-10T16:45:38.976844+0000 mgr.gibba020.yqfnwy (mgr.34427) 9105 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:45:40.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:40 gibba013 bash[30381]: cephadm 2021-03-10T16:45:38.976844+0000 mgr.gibba020.yqfnwy (mgr.34427) 9105 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:45:40.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:40 gibba020 bash[25448]: cephadm 2021-03-10T16:45:38.976844+0000 mgr.gibba020.yqfnwy (mgr.34427) 9105 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:45:41.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:41 gibba013 bash[29418]: cluster 2021-03-10T16:45:39.992069+0000 mgr.gibba020.yqfnwy (mgr.34427) 9106 : cluster [DBG] pgmap v5188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:41.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:41 gibba013 bash[30381]: cluster 2021-03-10T16:45:39.992069+0000 mgr.gibba020.yqfnwy (mgr.34427) 9106 : cluster [DBG] pgmap v5188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:41.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:41 gibba020 bash[25448]: cluster 2021-03-10T16:45:39.992069+0000 mgr.gibba020.yqfnwy (mgr.34427) 9106 : cluster [DBG] pgmap v5188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:43.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:43 gibba013 bash[29418]: cluster 2021-03-10T16:45:41.993440+0000 mgr.gibba020.yqfnwy (mgr.34427) 9107 : cluster [DBG] pgmap v5189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:43.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:43 gibba013 bash[30381]: cluster 2021-03-10T16:45:41.993440+0000 mgr.gibba020.yqfnwy (mgr.34427) 9107 : cluster [DBG] pgmap v5189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:43.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:43 gibba020 bash[25448]: cluster 2021-03-10T16:45:41.993440+0000 mgr.gibba020.yqfnwy (mgr.34427) 9107 : cluster [DBG] pgmap v5189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:45.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:45 gibba013 bash[29418]: cluster 2021-03-10T16:45:43.994791+0000 mgr.gibba020.yqfnwy (mgr.34427) 9108 : cluster [DBG] pgmap v5190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:45.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:45 gibba013 bash[30381]: cluster 2021-03-10T16:45:43.994791+0000 mgr.gibba020.yqfnwy (mgr.34427) 9108 : cluster [DBG] pgmap v5190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:45.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:45 gibba020 bash[25448]: cluster 2021-03-10T16:45:43.994791+0000 mgr.gibba020.yqfnwy (mgr.34427) 9108 : cluster [DBG] pgmap v5190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:47.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:47 gibba013 bash[29418]: cluster 2021-03-10T16:45:45.996582+0000 mgr.gibba020.yqfnwy (mgr.34427) 9109 : cluster [DBG] pgmap v5191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:47.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:47 gibba013 bash[30381]: cluster 2021-03-10T16:45:45.996582+0000 mgr.gibba020.yqfnwy (mgr.34427) 9109 : cluster [DBG] pgmap v5191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:47.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:47 gibba020 bash[25448]: cluster 2021-03-10T16:45:45.996582+0000 mgr.gibba020.yqfnwy (mgr.34427) 9109 : cluster [DBG] pgmap v5191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:48.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:48 gibba020 bash[25448]: cluster 2021-03-10T16:45:47.997815+0000 mgr.gibba020.yqfnwy (mgr.34427) 9110 : cluster [DBG] pgmap v5192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:48.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:48 gibba013 bash[29418]: cluster 2021-03-10T16:45:47.997815+0000 mgr.gibba020.yqfnwy (mgr.34427) 9110 : cluster [DBG] pgmap v5192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:48.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:48 gibba013 bash[30381]: cluster 2021-03-10T16:45:47.997815+0000 mgr.gibba020.yqfnwy (mgr.34427) 9110 : cluster [DBG] pgmap v5192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:51.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:50 gibba013 bash[29418]: cluster 2021-03-10T16:45:49.999756+0000 mgr.gibba020.yqfnwy (mgr.34427) 9111 : cluster [DBG] pgmap v5193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:51.127 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:50 gibba013 bash[30381]: cluster 2021-03-10T16:45:49.999756+0000 mgr.gibba020.yqfnwy (mgr.34427) 9111 : cluster [DBG] pgmap v5193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:51.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:50 gibba020 bash[25448]: cluster 2021-03-10T16:45:49.999756+0000 mgr.gibba020.yqfnwy (mgr.34427) 9111 : cluster [DBG] pgmap v5193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:53.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:53 gibba013 bash[29418]: cluster 2021-03-10T16:45:52.000993+0000 mgr.gibba020.yqfnwy (mgr.34427) 9112 : cluster [DBG] pgmap v5194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:53.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:53 gibba013 bash[30381]: cluster 2021-03-10T16:45:52.000993+0000 mgr.gibba020.yqfnwy (mgr.34427) 9112 : cluster [DBG] pgmap v5194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:53.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:53 gibba020 bash[25448]: cluster 2021-03-10T16:45:52.000993+0000 mgr.gibba020.yqfnwy (mgr.34427) 9112 : cluster [DBG] pgmap v5194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:54.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:54 gibba013 bash[29418]: audit 2021-03-10T16:45:53.990603+0000 mon.a (mon.0) 3305 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:45:54.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:54 gibba013 bash[30381]: audit 2021-03-10T16:45:53.990603+0000 mon.a (mon.0) 3305 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:45:54.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:54 gibba020 bash[25448]: audit 2021-03-10T16:45:53.990603+0000 mon.a (mon.0) 3305 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:45:55.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:55 gibba013 bash[29418]: cephadm 2021-03-10T16:45:53.994903+0000 mgr.gibba020.yqfnwy (mgr.34427) 9113 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:45:55.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:55 gibba013 bash[29418]: cephadm 2021-03-10T16:45:53.996642+0000 mgr.gibba020.yqfnwy (mgr.34427) 9114 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:45:55.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:55 gibba013 bash[29418]: cluster 2021-03-10T16:45:54.002297+0000 mgr.gibba020.yqfnwy (mgr.34427) 9115 : cluster [DBG] pgmap v5195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:55.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:55 gibba013 bash[29418]: audit 2021-03-10T16:45:54.213095+0000 mon.a (mon.0) 3306 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:45:55.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:55 gibba013 bash[29418]: audit 2021-03-10T16:45:54.216334+0000 mon.a (mon.0) 3307 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:45:55.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:55 gibba013 bash[29418]: audit 2021-03-10T16:45:54.218107+0000 mon.a (mon.0) 3308 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:55.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:55 gibba013 bash[29418]: audit 2021-03-10T16:45:54.220129+0000 mon.a (mon.0) 3309 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:55.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:55 gibba013 bash[29418]: audit 2021-03-10T16:45:54.221322+0000 mon.a (mon.0) 3310 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:55.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:55 gibba013 bash[29418]: audit 2021-03-10T16:45:54.224372+0000 mon.a (mon.0) 3311 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:55.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:55 gibba013 bash[29418]: audit 2021-03-10T16:45:54.226113+0000 mon.a (mon.0) 3312 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:55.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:55 gibba013 bash[30381]: cephadm 2021-03-10T16:45:53.994903+0000 mgr.gibba020.yqfnwy (mgr.34427) 9113 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:45:55.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:55 gibba013 bash[30381]: cephadm 2021-03-10T16:45:53.996642+0000 mgr.gibba020.yqfnwy (mgr.34427) 9114 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:45:55.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:55 gibba013 bash[30381]: cluster 2021-03-10T16:45:54.002297+0000 mgr.gibba020.yqfnwy (mgr.34427) 9115 : cluster [DBG] pgmap v5195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:55.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:55 gibba013 bash[30381]: audit 2021-03-10T16:45:54.213095+0000 mon.a (mon.0) 3306 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:45:55.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:55 gibba013 bash[30381]: audit 2021-03-10T16:45:54.216334+0000 mon.a (mon.0) 3307 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:45:55.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:55 gibba013 bash[30381]: audit 2021-03-10T16:45:54.218107+0000 mon.a (mon.0) 3308 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:55.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:55 gibba013 bash[30381]: audit 2021-03-10T16:45:54.220129+0000 mon.a (mon.0) 3309 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:55.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:55 gibba013 bash[30381]: audit 2021-03-10T16:45:54.221322+0000 mon.a (mon.0) 3310 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:55.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:55 gibba013 bash[30381]: audit 2021-03-10T16:45:54.224372+0000 mon.a (mon.0) 3311 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:55.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:55 gibba013 bash[30381]: audit 2021-03-10T16:45:54.226113+0000 mon.a (mon.0) 3312 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:55.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:55 gibba020 bash[25448]: cephadm 2021-03-10T16:45:53.994903+0000 mgr.gibba020.yqfnwy (mgr.34427) 9113 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:45:55.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:55 gibba020 bash[25448]: cephadm 2021-03-10T16:45:53.996642+0000 mgr.gibba020.yqfnwy (mgr.34427) 9114 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:45:55.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:55 gibba020 bash[25448]: cluster 2021-03-10T16:45:54.002297+0000 mgr.gibba020.yqfnwy (mgr.34427) 9115 : cluster [DBG] pgmap v5195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:55.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:55 gibba020 bash[25448]: audit 2021-03-10T16:45:54.213095+0000 mon.a (mon.0) 3306 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:45:55.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:55 gibba020 bash[25448]: audit 2021-03-10T16:45:54.216334+0000 mon.a (mon.0) 3307 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:45:55.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:55 gibba020 bash[25448]: audit 2021-03-10T16:45:54.218107+0000 mon.a (mon.0) 3308 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:55.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:55 gibba020 bash[25448]: audit 2021-03-10T16:45:54.220129+0000 mon.a (mon.0) 3309 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:55.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:55 gibba020 bash[25448]: audit 2021-03-10T16:45:54.221322+0000 mon.a (mon.0) 3310 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:55.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:55 gibba020 bash[25448]: audit 2021-03-10T16:45:54.224372+0000 mon.a (mon.0) 3311 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:55.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:55 gibba020 bash[25448]: audit 2021-03-10T16:45:54.226113+0000 mon.a (mon.0) 3312 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:56.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:56 gibba013 bash[29418]: cephadm 2021-03-10T16:45:54.215136+0000 mgr.gibba020.yqfnwy (mgr.34427) 9116 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:45:56.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:56 gibba013 bash[29418]: cephadm 2021-03-10T16:45:54.217046+0000 mgr.gibba020.yqfnwy (mgr.34427) 9117 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:45:56.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:56 gibba013 bash[29418]: cephadm 2021-03-10T16:45:54.218999+0000 mgr.gibba020.yqfnwy (mgr.34427) 9118 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:45:56.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:56 gibba013 bash[29418]: cephadm 2021-03-10T16:45:54.219038+0000 mgr.gibba020.yqfnwy (mgr.34427) 9119 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:45:56.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:56 gibba013 bash[29418]: cephadm 2021-03-10T16:45:54.220479+0000 mgr.gibba020.yqfnwy (mgr.34427) 9120 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:45:56.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:56 gibba013 bash[29418]: cephadm 2021-03-10T16:45:54.220517+0000 mgr.gibba020.yqfnwy (mgr.34427) 9121 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:45:56.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:56 gibba013 bash[29418]: cephadm 2021-03-10T16:45:54.221837+0000 mgr.gibba020.yqfnwy (mgr.34427) 9122 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:45:56.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:56 gibba013 bash[29418]: cephadm 2021-03-10T16:45:54.223232+0000 mgr.gibba020.yqfnwy (mgr.34427) 9123 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:45:56.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:56 gibba013 bash[29418]: cephadm 2021-03-10T16:45:54.223272+0000 mgr.gibba020.yqfnwy (mgr.34427) 9124 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:45:56.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:56 gibba013 bash[29418]: cephadm 2021-03-10T16:45:54.224879+0000 mgr.gibba020.yqfnwy (mgr.34427) 9125 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:45:56.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:56 gibba013 bash[29418]: cephadm 2021-03-10T16:45:54.225318+0000 mgr.gibba020.yqfnwy (mgr.34427) 9126 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:45:56.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:56 gibba013 bash[29418]: cephadm 2021-03-10T16:45:54.226703+0000 mgr.gibba020.yqfnwy (mgr.34427) 9127 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:45:56.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:56 gibba013 bash[29418]: cephadm 2021-03-10T16:45:54.226746+0000 mgr.gibba020.yqfnwy (mgr.34427) 9128 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:45:56.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:56 gibba013 bash[29418]: cephadm 2021-03-10T16:45:54.226865+0000 mgr.gibba020.yqfnwy (mgr.34427) 9129 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:45:56.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:56 gibba013 bash[30381]: cephadm 2021-03-10T16:45:54.215136+0000 mgr.gibba020.yqfnwy (mgr.34427) 9116 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:45:56.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:56 gibba013 bash[30381]: cephadm 2021-03-10T16:45:54.217046+0000 mgr.gibba020.yqfnwy (mgr.34427) 9117 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:45:56.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:56 gibba013 bash[30381]: cephadm 2021-03-10T16:45:54.218999+0000 mgr.gibba020.yqfnwy (mgr.34427) 9118 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:45:56.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:56 gibba013 bash[30381]: cephadm 2021-03-10T16:45:54.219038+0000 mgr.gibba020.yqfnwy (mgr.34427) 9119 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:45:56.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:56 gibba013 bash[30381]: cephadm 2021-03-10T16:45:54.220479+0000 mgr.gibba020.yqfnwy (mgr.34427) 9120 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:45:56.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:56 gibba013 bash[30381]: cephadm 2021-03-10T16:45:54.220517+0000 mgr.gibba020.yqfnwy (mgr.34427) 9121 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:45:56.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:56 gibba013 bash[30381]: cephadm 2021-03-10T16:45:54.221837+0000 mgr.gibba020.yqfnwy (mgr.34427) 9122 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:45:56.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:56 gibba013 bash[30381]: cephadm 2021-03-10T16:45:54.223232+0000 mgr.gibba020.yqfnwy (mgr.34427) 9123 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:45:56.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:56 gibba013 bash[30381]: cephadm 2021-03-10T16:45:54.223272+0000 mgr.gibba020.yqfnwy (mgr.34427) 9124 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:45:56.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:56 gibba013 bash[30381]: cephadm 2021-03-10T16:45:54.224879+0000 mgr.gibba020.yqfnwy (mgr.34427) 9125 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:45:56.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:56 gibba013 bash[30381]: cephadm 2021-03-10T16:45:54.225318+0000 mgr.gibba020.yqfnwy (mgr.34427) 9126 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:45:56.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:56 gibba013 bash[30381]: cephadm 2021-03-10T16:45:54.226703+0000 mgr.gibba020.yqfnwy (mgr.34427) 9127 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:45:56.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:56 gibba013 bash[30381]: cephadm 2021-03-10T16:45:54.226746+0000 mgr.gibba020.yqfnwy (mgr.34427) 9128 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:45:56.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:56 gibba013 bash[30381]: cephadm 2021-03-10T16:45:54.226865+0000 mgr.gibba020.yqfnwy (mgr.34427) 9129 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:45:56.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:56 gibba020 bash[25448]: cephadm 2021-03-10T16:45:54.215136+0000 mgr.gibba020.yqfnwy (mgr.34427) 9116 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:45:56.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:56 gibba020 bash[25448]: cephadm 2021-03-10T16:45:54.217046+0000 mgr.gibba020.yqfnwy (mgr.34427) 9117 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:45:56.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:56 gibba020 bash[25448]: cephadm 2021-03-10T16:45:54.218999+0000 mgr.gibba020.yqfnwy (mgr.34427) 9118 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:45:56.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:56 gibba020 bash[25448]: cephadm 2021-03-10T16:45:54.219038+0000 mgr.gibba020.yqfnwy (mgr.34427) 9119 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:45:56.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:56 gibba020 bash[25448]: cephadm 2021-03-10T16:45:54.220479+0000 mgr.gibba020.yqfnwy (mgr.34427) 9120 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:45:56.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:56 gibba020 bash[25448]: cephadm 2021-03-10T16:45:54.220517+0000 mgr.gibba020.yqfnwy (mgr.34427) 9121 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:45:56.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:56 gibba020 bash[25448]: cephadm 2021-03-10T16:45:54.221837+0000 mgr.gibba020.yqfnwy (mgr.34427) 9122 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:45:56.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:56 gibba020 bash[25448]: cephadm 2021-03-10T16:45:54.223232+0000 mgr.gibba020.yqfnwy (mgr.34427) 9123 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:45:56.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:56 gibba020 bash[25448]: cephadm 2021-03-10T16:45:54.223272+0000 mgr.gibba020.yqfnwy (mgr.34427) 9124 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:45:56.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:56 gibba020 bash[25448]: cephadm 2021-03-10T16:45:54.224879+0000 mgr.gibba020.yqfnwy (mgr.34427) 9125 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:45:56.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:56 gibba020 bash[25448]: cephadm 2021-03-10T16:45:54.225318+0000 mgr.gibba020.yqfnwy (mgr.34427) 9126 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:45:56.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:56 gibba020 bash[25448]: cephadm 2021-03-10T16:45:54.226703+0000 mgr.gibba020.yqfnwy (mgr.34427) 9127 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:45:56.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:56 gibba020 bash[25448]: cephadm 2021-03-10T16:45:54.226746+0000 mgr.gibba020.yqfnwy (mgr.34427) 9128 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:45:56.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:56 gibba020 bash[25448]: cephadm 2021-03-10T16:45:54.226865+0000 mgr.gibba020.yqfnwy (mgr.34427) 9129 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:45:56.474 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:45:56.706 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:45:56.706 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 5m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:45:56.706 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 4m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:45:56.706 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:45:56.707 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:45:56.707 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:45:56.707 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:45:56.707 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:45:56.708 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:45:56.708 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:45:56.708 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:45:56.708 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:45:56.709 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:45:56.709 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:45:56.709 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:45:56.709 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:45:56.709 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:45:56.710 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:45:56.710 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:45:56.710 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 4m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:45:56.710 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 4m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:45:56.957 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:45:56.958 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:45:56.958 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:45:56.959 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:45:56.959 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:45:56.960 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:45:56.960 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:45:56.960 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:45:56.960 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:45:56.961 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:45:56.961 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:45:56.961 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:45:56.961 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:45:56.962 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:45:56.962 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:45:57.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:57 gibba013 bash[29418]: cluster 2021-03-10T16:45:56.003870+0000 mgr.gibba020.yqfnwy (mgr.34427) 9130 : cluster [DBG] pgmap v5196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:57.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:57 gibba013 bash[29418]: audit 2021-03-10T16:45:56.959461+0000 mon.a (mon.0) 3313 : audit [DBG] from='client.? 172.21.2.113:0/1238540843' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:57.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:57 gibba013 bash[30381]: cluster 2021-03-10T16:45:56.003870+0000 mgr.gibba020.yqfnwy (mgr.34427) 9130 : cluster [DBG] pgmap v5196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:57.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:57 gibba013 bash[30381]: audit 2021-03-10T16:45:56.959461+0000 mon.a (mon.0) 3313 : audit [DBG] from='client.? 172.21.2.113:0/1238540843' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:57.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:57 gibba020 bash[25448]: cluster 2021-03-10T16:45:56.003870+0000 mgr.gibba020.yqfnwy (mgr.34427) 9130 : cluster [DBG] pgmap v5196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:57.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:57 gibba020 bash[25448]: audit 2021-03-10T16:45:56.959461+0000 mon.a (mon.0) 3313 : audit [DBG] from='client.? 172.21.2.113:0/1238540843' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:45:58.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:58 gibba013 bash[29418]: audit 2021-03-10T16:45:56.466530+0000 mgr.gibba020.yqfnwy (mgr.34427) 9131 : audit [DBG] from='client.50172 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:45:58.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:58 gibba013 bash[29418]: audit 2021-03-10T16:45:56.695675+0000 mgr.gibba020.yqfnwy (mgr.34427) 9132 : audit [DBG] from='client.60160 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:45:58.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:58 gibba013 bash[30381]: audit 2021-03-10T16:45:56.466530+0000 mgr.gibba020.yqfnwy (mgr.34427) 9131 : audit [DBG] from='client.50172 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:45:58.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:58 gibba013 bash[30381]: audit 2021-03-10T16:45:56.695675+0000 mgr.gibba020.yqfnwy (mgr.34427) 9132 : audit [DBG] from='client.60160 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:45:58.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:58 gibba020 bash[25448]: audit 2021-03-10T16:45:56.466530+0000 mgr.gibba020.yqfnwy (mgr.34427) 9131 : audit [DBG] from='client.50172 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:45:58.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:58 gibba020 bash[25448]: audit 2021-03-10T16:45:56.695675+0000 mgr.gibba020.yqfnwy (mgr.34427) 9132 : audit [DBG] from='client.60160 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:45:59.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:45:59 gibba013 bash[29418]: cluster 2021-03-10T16:45:58.005027+0000 mgr.gibba020.yqfnwy (mgr.34427) 9133 : cluster [DBG] pgmap v5197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:59.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:45:59 gibba013 bash[30381]: cluster 2021-03-10T16:45:58.005027+0000 mgr.gibba020.yqfnwy (mgr.34427) 9133 : cluster [DBG] pgmap v5197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:45:59.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:45:59 gibba020 bash[25448]: cluster 2021-03-10T16:45:58.005027+0000 mgr.gibba020.yqfnwy (mgr.34427) 9133 : cluster [DBG] pgmap v5197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:01.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:00 gibba013 bash[29418]: cluster 2021-03-10T16:46:00.006692+0000 mgr.gibba020.yqfnwy (mgr.34427) 9134 : cluster [DBG] pgmap v5198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:01.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:00 gibba013 bash[30381]: cluster 2021-03-10T16:46:00.006692+0000 mgr.gibba020.yqfnwy (mgr.34427) 9134 : cluster [DBG] pgmap v5198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:01.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:00 gibba020 bash[25448]: cluster 2021-03-10T16:46:00.006692+0000 mgr.gibba020.yqfnwy (mgr.34427) 9134 : cluster [DBG] pgmap v5198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:03.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:03 gibba013 bash[29418]: cluster 2021-03-10T16:46:02.007882+0000 mgr.gibba020.yqfnwy (mgr.34427) 9135 : cluster [DBG] pgmap v5199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:03.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:03 gibba013 bash[30381]: cluster 2021-03-10T16:46:02.007882+0000 mgr.gibba020.yqfnwy (mgr.34427) 9135 : cluster [DBG] pgmap v5199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:03.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:03 gibba020 bash[25448]: cluster 2021-03-10T16:46:02.007882+0000 mgr.gibba020.yqfnwy (mgr.34427) 9135 : cluster [DBG] pgmap v5199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:05.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:05 gibba013 bash[29418]: cluster 2021-03-10T16:46:04.009330+0000 mgr.gibba020.yqfnwy (mgr.34427) 9136 : cluster [DBG] pgmap v5200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:05.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:05 gibba013 bash[30381]: cluster 2021-03-10T16:46:04.009330+0000 mgr.gibba020.yqfnwy (mgr.34427) 9136 : cluster [DBG] pgmap v5200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:05.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:05 gibba020 bash[25448]: cluster 2021-03-10T16:46:04.009330+0000 mgr.gibba020.yqfnwy (mgr.34427) 9136 : cluster [DBG] pgmap v5200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:07.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:07 gibba013 bash[29418]: cluster 2021-03-10T16:46:06.010866+0000 mgr.gibba020.yqfnwy (mgr.34427) 9137 : cluster [DBG] pgmap v5201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:07.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:07 gibba013 bash[29418]: audit 2021-03-10T16:46:06.791947+0000 mon.a (mon.0) 3314 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:46:07.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:07 gibba013 bash[29418]: audit 2021-03-10T16:46:06.963533+0000 mon.a (mon.0) 3315 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:46:07.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:07 gibba013 bash[30381]: cluster 2021-03-10T16:46:06.010866+0000 mgr.gibba020.yqfnwy (mgr.34427) 9137 : cluster [DBG] pgmap v5201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:07.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:07 gibba013 bash[30381]: audit 2021-03-10T16:46:06.791947+0000 mon.a (mon.0) 3314 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:46:07.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:07 gibba013 bash[30381]: audit 2021-03-10T16:46:06.963533+0000 mon.a (mon.0) 3315 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:46:07.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:07 gibba020 bash[25448]: cluster 2021-03-10T16:46:06.010866+0000 mgr.gibba020.yqfnwy (mgr.34427) 9137 : cluster [DBG] pgmap v5201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:07.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:07 gibba020 bash[25448]: audit 2021-03-10T16:46:06.791947+0000 mon.a (mon.0) 3314 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:46:07.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:07 gibba020 bash[25448]: audit 2021-03-10T16:46:06.963533+0000 mon.a (mon.0) 3315 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:46:08.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:08 gibba013 bash[29418]: audit 2021-03-10T16:46:07.324331+0000 mon.a (mon.0) 3316 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:46:08.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:08 gibba013 bash[29418]: audit 2021-03-10T16:46:07.325113+0000 mon.a (mon.0) 3317 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:46:08.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:08 gibba013 bash[29418]: audit 2021-03-10T16:46:07.325803+0000 mon.a (mon.0) 3318 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T16:46:08.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:08 gibba013 bash[29418]: audit 2021-03-10T16:46:07.326512+0000 mon.a (mon.0) 3319 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:46:08.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:08 gibba013 bash[30381]: audit 2021-03-10T16:46:07.324331+0000 mon.a (mon.0) 3316 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:46:08.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:08 gibba013 bash[30381]: audit 2021-03-10T16:46:07.325113+0000 mon.a (mon.0) 3317 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:46:08.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:08 gibba013 bash[30381]: audit 2021-03-10T16:46:07.325803+0000 mon.a (mon.0) 3318 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T16:46:08.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:08 gibba013 bash[30381]: audit 2021-03-10T16:46:07.326512+0000 mon.a (mon.0) 3319 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:46:08.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:08 gibba020 bash[25448]: audit 2021-03-10T16:46:07.324331+0000 mon.a (mon.0) 3316 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T16:46:08.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:08 gibba020 bash[25448]: audit 2021-03-10T16:46:07.325113+0000 mon.a (mon.0) 3317 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:46:08.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:08 gibba020 bash[25448]: audit 2021-03-10T16:46:07.325803+0000 mon.a (mon.0) 3318 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T16:46:08.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:08 gibba020 bash[25448]: audit 2021-03-10T16:46:07.326512+0000 mon.a (mon.0) 3319 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:46:09.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:09 gibba013 bash[29418]: cluster 2021-03-10T16:46:08.012009+0000 mgr.gibba020.yqfnwy (mgr.34427) 9138 : cluster [DBG] pgmap v5202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:09.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:09 gibba013 bash[30381]: cluster 2021-03-10T16:46:08.012009+0000 mgr.gibba020.yqfnwy (mgr.34427) 9138 : cluster [DBG] pgmap v5202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:09.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:09 gibba020 bash[25448]: cluster 2021-03-10T16:46:08.012009+0000 mgr.gibba020.yqfnwy (mgr.34427) 9138 : cluster [DBG] pgmap v5202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:11.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:10 gibba013 bash[29418]: cephadm 2021-03-10T16:46:09.242851+0000 mgr.gibba020.yqfnwy (mgr.34427) 9139 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:46:11.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:10 gibba013 bash[29418]: cluster 2021-03-10T16:46:10.012613+0000 mgr.gibba020.yqfnwy (mgr.34427) 9140 : cluster [DBG] pgmap v5203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:11.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:10 gibba013 bash[30381]: cephadm 2021-03-10T16:46:09.242851+0000 mgr.gibba020.yqfnwy (mgr.34427) 9139 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:46:11.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:10 gibba013 bash[30381]: cluster 2021-03-10T16:46:10.012613+0000 mgr.gibba020.yqfnwy (mgr.34427) 9140 : cluster [DBG] pgmap v5203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:11.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:10 gibba020 bash[25448]: cephadm 2021-03-10T16:46:09.242851+0000 mgr.gibba020.yqfnwy (mgr.34427) 9139 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:46:11.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:10 gibba020 bash[25448]: cluster 2021-03-10T16:46:10.012613+0000 mgr.gibba020.yqfnwy (mgr.34427) 9140 : cluster [DBG] pgmap v5203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:13.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:13 gibba013 bash[29418]: cluster 2021-03-10T16:46:12.013618+0000 mgr.gibba020.yqfnwy (mgr.34427) 9141 : cluster [DBG] pgmap v5204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:13.377 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:13 gibba013 bash[30381]: cluster 2021-03-10T16:46:12.013618+0000 mgr.gibba020.yqfnwy (mgr.34427) 9141 : cluster [DBG] pgmap v5204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:13.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:13 gibba020 bash[25448]: cluster 2021-03-10T16:46:12.013618+0000 mgr.gibba020.yqfnwy (mgr.34427) 9141 : cluster [DBG] pgmap v5204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:15.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:15 gibba013 bash[29418]: cluster 2021-03-10T16:46:14.014990+0000 mgr.gibba020.yqfnwy (mgr.34427) 9142 : cluster [DBG] pgmap v5205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:15.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:15 gibba013 bash[30381]: cluster 2021-03-10T16:46:14.014990+0000 mgr.gibba020.yqfnwy (mgr.34427) 9142 : cluster [DBG] pgmap v5205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:15.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:15 gibba020 bash[25448]: cluster 2021-03-10T16:46:14.014990+0000 mgr.gibba020.yqfnwy (mgr.34427) 9142 : cluster [DBG] pgmap v5205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:17.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:17 gibba013 bash[29418]: cluster 2021-03-10T16:46:16.016622+0000 mgr.gibba020.yqfnwy (mgr.34427) 9143 : cluster [DBG] pgmap v5206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:17.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:17 gibba013 bash[30381]: cluster 2021-03-10T16:46:16.016622+0000 mgr.gibba020.yqfnwy (mgr.34427) 9143 : cluster [DBG] pgmap v5206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:17.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:17 gibba020 bash[25448]: cluster 2021-03-10T16:46:16.016622+0000 mgr.gibba020.yqfnwy (mgr.34427) 9143 : cluster [DBG] pgmap v5206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:19.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:19 gibba013 bash[29418]: cluster 2021-03-10T16:46:18.017951+0000 mgr.gibba020.yqfnwy (mgr.34427) 9144 : cluster [DBG] pgmap v5207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:19.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:19 gibba013 bash[30381]: cluster 2021-03-10T16:46:18.017951+0000 mgr.gibba020.yqfnwy (mgr.34427) 9144 : cluster [DBG] pgmap v5207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:19.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:19 gibba020 bash[25448]: cluster 2021-03-10T16:46:18.017951+0000 mgr.gibba020.yqfnwy (mgr.34427) 9144 : cluster [DBG] pgmap v5207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:21.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:20 gibba013 bash[29418]: cluster 2021-03-10T16:46:20.018811+0000 mgr.gibba020.yqfnwy (mgr.34427) 9145 : cluster [DBG] pgmap v5208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:21.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:20 gibba013 bash[30381]: cluster 2021-03-10T16:46:20.018811+0000 mgr.gibba020.yqfnwy (mgr.34427) 9145 : cluster [DBG] pgmap v5208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:21.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:20 gibba020 bash[25448]: cluster 2021-03-10T16:46:20.018811+0000 mgr.gibba020.yqfnwy (mgr.34427) 9145 : cluster [DBG] pgmap v5208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:23.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:23 gibba013 bash[29418]: cluster 2021-03-10T16:46:22.019989+0000 mgr.gibba020.yqfnwy (mgr.34427) 9146 : cluster [DBG] pgmap v5209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:23.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:23 gibba013 bash[30381]: cluster 2021-03-10T16:46:22.019989+0000 mgr.gibba020.yqfnwy (mgr.34427) 9146 : cluster [DBG] pgmap v5209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:23.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:23 gibba020 bash[25448]: cluster 2021-03-10T16:46:22.019989+0000 mgr.gibba020.yqfnwy (mgr.34427) 9146 : cluster [DBG] pgmap v5209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:25.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:25 gibba013 bash[29418]: cluster 2021-03-10T16:46:24.021339+0000 mgr.gibba020.yqfnwy (mgr.34427) 9147 : cluster [DBG] pgmap v5210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:25.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:25 gibba013 bash[30381]: cluster 2021-03-10T16:46:24.021339+0000 mgr.gibba020.yqfnwy (mgr.34427) 9147 : cluster [DBG] pgmap v5210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:25.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:25 gibba020 bash[25448]: cluster 2021-03-10T16:46:24.021339+0000 mgr.gibba020.yqfnwy (mgr.34427) 9147 : cluster [DBG] pgmap v5210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:26.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:26 gibba013 bash[29418]: cephadm 2021-03-10T16:46:24.258888+0000 mgr.gibba020.yqfnwy (mgr.34427) 9148 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:46:26.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:26 gibba013 bash[30381]: cephadm 2021-03-10T16:46:24.258888+0000 mgr.gibba020.yqfnwy (mgr.34427) 9148 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:46:26.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:26 gibba020 bash[25448]: cephadm 2021-03-10T16:46:24.258888+0000 mgr.gibba020.yqfnwy (mgr.34427) 9148 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:46:27.199 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:46:27.376 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:27 gibba013 bash[29418]: cluster 2021-03-10T16:46:26.023034+0000 mgr.gibba020.yqfnwy (mgr.34427) 9149 : cluster [DBG] pgmap v5211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:27.377 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:27 gibba013 bash[30381]: cluster 2021-03-10T16:46:26.023034+0000 mgr.gibba020.yqfnwy (mgr.34427) 9149 : cluster [DBG] pgmap v5211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:27.428 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:46:27.428 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 5m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:46:27.428 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 4m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:46:27.429 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:46:27.429 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:46:27.429 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:46:27.429 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:46:27.430 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:46:27.430 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:46:27.430 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:46:27.430 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 4m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:46:27.430 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:46:27.431 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:46:27.431 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:46:27.431 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:46:27.431 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:46:27.432 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:46:27.432 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:46:27.432 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 4m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:46:27.432 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 4m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:46:27.432 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 4m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:46:27.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:27 gibba020 bash[25448]: cluster 2021-03-10T16:46:26.023034+0000 mgr.gibba020.yqfnwy (mgr.34427) 9149 : cluster [DBG] pgmap v5211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:27.676 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:46:27.676 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:46:27.677 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:46:27.677 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:46:27.677 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:46:27.677 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:46:27.678 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:46:27.678 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:46:27.678 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:46:27.678 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:46:27.678 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:46:27.679 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:46:27.679 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:46:27.679 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:46:27.679 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:46:28.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:28 gibba013 bash[29418]: audit 2021-03-10T16:46:27.678239+0000 mon.a (mon.0) 3320 : audit [DBG] from='client.? 172.21.2.113:0/1723054338' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:28.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:28 gibba013 bash[30381]: audit 2021-03-10T16:46:27.678239+0000 mon.a (mon.0) 3320 : audit [DBG] from='client.? 172.21.2.113:0/1723054338' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:28.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:28 gibba020 bash[25448]: audit 2021-03-10T16:46:27.678239+0000 mon.a (mon.0) 3320 : audit [DBG] from='client.? 172.21.2.113:0/1723054338' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:29.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:29 gibba013 bash[29418]: audit 2021-03-10T16:46:27.192274+0000 mgr.gibba020.yqfnwy (mgr.34427) 9150 : audit [DBG] from='client.50190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:46:29.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:29 gibba013 bash[29418]: audit 2021-03-10T16:46:27.417090+0000 mgr.gibba020.yqfnwy (mgr.34427) 9151 : audit [DBG] from='client.60178 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:46:29.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:29 gibba013 bash[29418]: cluster 2021-03-10T16:46:28.024282+0000 mgr.gibba020.yqfnwy (mgr.34427) 9152 : cluster [DBG] pgmap v5212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:29.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:29 gibba013 bash[30381]: audit 2021-03-10T16:46:27.192274+0000 mgr.gibba020.yqfnwy (mgr.34427) 9150 : audit [DBG] from='client.50190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:46:29.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:29 gibba013 bash[30381]: audit 2021-03-10T16:46:27.417090+0000 mgr.gibba020.yqfnwy (mgr.34427) 9151 : audit [DBG] from='client.60178 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:46:29.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:29 gibba013 bash[30381]: cluster 2021-03-10T16:46:28.024282+0000 mgr.gibba020.yqfnwy (mgr.34427) 9152 : cluster [DBG] pgmap v5212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:29.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:29 gibba020 bash[25448]: audit 2021-03-10T16:46:27.192274+0000 mgr.gibba020.yqfnwy (mgr.34427) 9150 : audit [DBG] from='client.50190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:46:29.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:29 gibba020 bash[25448]: audit 2021-03-10T16:46:27.417090+0000 mgr.gibba020.yqfnwy (mgr.34427) 9151 : audit [DBG] from='client.60178 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:46:29.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:29 gibba020 bash[25448]: cluster 2021-03-10T16:46:28.024282+0000 mgr.gibba020.yqfnwy (mgr.34427) 9152 : cluster [DBG] pgmap v5212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:31.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:30 gibba013 bash[29418]: cluster 2021-03-10T16:46:30.025958+0000 mgr.gibba020.yqfnwy (mgr.34427) 9153 : cluster [DBG] pgmap v5213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:31.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:30 gibba013 bash[30381]: cluster 2021-03-10T16:46:30.025958+0000 mgr.gibba020.yqfnwy (mgr.34427) 9153 : cluster [DBG] pgmap v5213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:31.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:30 gibba020 bash[25448]: cluster 2021-03-10T16:46:30.025958+0000 mgr.gibba020.yqfnwy (mgr.34427) 9153 : cluster [DBG] pgmap v5213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:33.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:33 gibba013 bash[29418]: cluster 2021-03-10T16:46:32.027317+0000 mgr.gibba020.yqfnwy (mgr.34427) 9154 : cluster [DBG] pgmap v5214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:33.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:33 gibba013 bash[30381]: cluster 2021-03-10T16:46:32.027317+0000 mgr.gibba020.yqfnwy (mgr.34427) 9154 : cluster [DBG] pgmap v5214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:33.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:33 gibba020 bash[25448]: cluster 2021-03-10T16:46:32.027317+0000 mgr.gibba020.yqfnwy (mgr.34427) 9154 : cluster [DBG] pgmap v5214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:35.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:35 gibba013 bash[29418]: cluster 2021-03-10T16:46:34.028782+0000 mgr.gibba020.yqfnwy (mgr.34427) 9155 : cluster [DBG] pgmap v5215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:35.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:35 gibba013 bash[30381]: cluster 2021-03-10T16:46:34.028782+0000 mgr.gibba020.yqfnwy (mgr.34427) 9155 : cluster [DBG] pgmap v5215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:35.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:35 gibba020 bash[25448]: cluster 2021-03-10T16:46:34.028782+0000 mgr.gibba020.yqfnwy (mgr.34427) 9155 : cluster [DBG] pgmap v5215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:37.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:37 gibba013 bash[29418]: cluster 2021-03-10T16:46:36.030453+0000 mgr.gibba020.yqfnwy (mgr.34427) 9156 : cluster [DBG] pgmap v5216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:37.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:37 gibba013 bash[30381]: cluster 2021-03-10T16:46:36.030453+0000 mgr.gibba020.yqfnwy (mgr.34427) 9156 : cluster [DBG] pgmap v5216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:37.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:37 gibba020 bash[25448]: cluster 2021-03-10T16:46:36.030453+0000 mgr.gibba020.yqfnwy (mgr.34427) 9156 : cluster [DBG] pgmap v5216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:39.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:39 gibba013 bash[29418]: cluster 2021-03-10T16:46:38.031542+0000 mgr.gibba020.yqfnwy (mgr.34427) 9157 : cluster [DBG] pgmap v5217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:39.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:39 gibba013 bash[30381]: cluster 2021-03-10T16:46:38.031542+0000 mgr.gibba020.yqfnwy (mgr.34427) 9157 : cluster [DBG] pgmap v5217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:39.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:39 gibba020 bash[25448]: cluster 2021-03-10T16:46:38.031542+0000 mgr.gibba020.yqfnwy (mgr.34427) 9157 : cluster [DBG] pgmap v5217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:41.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:40 gibba013 bash[29418]: cephadm 2021-03-10T16:46:39.274628+0000 mgr.gibba020.yqfnwy (mgr.34427) 9158 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:46:41.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:40 gibba013 bash[29418]: cluster 2021-03-10T16:46:40.033240+0000 mgr.gibba020.yqfnwy (mgr.34427) 9159 : cluster [DBG] pgmap v5218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:41.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:40 gibba013 bash[30381]: cephadm 2021-03-10T16:46:39.274628+0000 mgr.gibba020.yqfnwy (mgr.34427) 9158 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:46:41.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:40 gibba013 bash[30381]: cluster 2021-03-10T16:46:40.033240+0000 mgr.gibba020.yqfnwy (mgr.34427) 9159 : cluster [DBG] pgmap v5218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:41.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:40 gibba020 bash[25448]: cephadm 2021-03-10T16:46:39.274628+0000 mgr.gibba020.yqfnwy (mgr.34427) 9158 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:46:41.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:40 gibba020 bash[25448]: cluster 2021-03-10T16:46:40.033240+0000 mgr.gibba020.yqfnwy (mgr.34427) 9159 : cluster [DBG] pgmap v5218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:43.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:43 gibba013 bash[29418]: cluster 2021-03-10T16:46:42.034481+0000 mgr.gibba020.yqfnwy (mgr.34427) 9160 : cluster [DBG] pgmap v5219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:43.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:43 gibba013 bash[30381]: cluster 2021-03-10T16:46:42.034481+0000 mgr.gibba020.yqfnwy (mgr.34427) 9160 : cluster [DBG] pgmap v5219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:43.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:43 gibba020 bash[25448]: cluster 2021-03-10T16:46:42.034481+0000 mgr.gibba020.yqfnwy (mgr.34427) 9160 : cluster [DBG] pgmap v5219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:45.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:45 gibba013 bash[29418]: cluster 2021-03-10T16:46:44.035854+0000 mgr.gibba020.yqfnwy (mgr.34427) 9161 : cluster [DBG] pgmap v5220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:45.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:45 gibba013 bash[30381]: cluster 2021-03-10T16:46:44.035854+0000 mgr.gibba020.yqfnwy (mgr.34427) 9161 : cluster [DBG] pgmap v5220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:45.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:45 gibba020 bash[25448]: cluster 2021-03-10T16:46:44.035854+0000 mgr.gibba020.yqfnwy (mgr.34427) 9161 : cluster [DBG] pgmap v5220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:47.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:47 gibba013 bash[29418]: cluster 2021-03-10T16:46:46.037735+0000 mgr.gibba020.yqfnwy (mgr.34427) 9162 : cluster [DBG] pgmap v5221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:47.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:47 gibba013 bash[30381]: cluster 2021-03-10T16:46:46.037735+0000 mgr.gibba020.yqfnwy (mgr.34427) 9162 : cluster [DBG] pgmap v5221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:47.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:47 gibba020 bash[25448]: cluster 2021-03-10T16:46:46.037735+0000 mgr.gibba020.yqfnwy (mgr.34427) 9162 : cluster [DBG] pgmap v5221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:49.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:49 gibba013 bash[29418]: cluster 2021-03-10T16:46:48.038282+0000 mgr.gibba020.yqfnwy (mgr.34427) 9163 : cluster [DBG] pgmap v5222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:49.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:49 gibba013 bash[30381]: cluster 2021-03-10T16:46:48.038282+0000 mgr.gibba020.yqfnwy (mgr.34427) 9163 : cluster [DBG] pgmap v5222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:49.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:49 gibba020 bash[25448]: cluster 2021-03-10T16:46:48.038282+0000 mgr.gibba020.yqfnwy (mgr.34427) 9163 : cluster [DBG] pgmap v5222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:51.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:50 gibba013 bash[29418]: cluster 2021-03-10T16:46:50.040109+0000 mgr.gibba020.yqfnwy (mgr.34427) 9164 : cluster [DBG] pgmap v5223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:51.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:50 gibba013 bash[30381]: cluster 2021-03-10T16:46:50.040109+0000 mgr.gibba020.yqfnwy (mgr.34427) 9164 : cluster [DBG] pgmap v5223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:51.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:50 gibba020 bash[25448]: cluster 2021-03-10T16:46:50.040109+0000 mgr.gibba020.yqfnwy (mgr.34427) 9164 : cluster [DBG] pgmap v5223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:53.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:53 gibba013 bash[29418]: cluster 2021-03-10T16:46:52.041176+0000 mgr.gibba020.yqfnwy (mgr.34427) 9165 : cluster [DBG] pgmap v5224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:53.377 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:53 gibba013 bash[30381]: cluster 2021-03-10T16:46:52.041176+0000 mgr.gibba020.yqfnwy (mgr.34427) 9165 : cluster [DBG] pgmap v5224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:53.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:53 gibba020 bash[25448]: cluster 2021-03-10T16:46:52.041176+0000 mgr.gibba020.yqfnwy (mgr.34427) 9165 : cluster [DBG] pgmap v5224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:55.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:55 gibba013 bash[29418]: cluster 2021-03-10T16:46:54.042610+0000 mgr.gibba020.yqfnwy (mgr.34427) 9166 : cluster [DBG] pgmap v5225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:55.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:55 gibba013 bash[29418]: audit 2021-03-10T16:46:54.291952+0000 mon.a (mon.0) 3321 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:46:55.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:55 gibba013 bash[29418]: audit 2021-03-10T16:46:54.520176+0000 mon.a (mon.0) 3322 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:46:55.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:55 gibba013 bash[29418]: audit 2021-03-10T16:46:54.524001+0000 mon.a (mon.0) 3323 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:46:55.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:55 gibba013 bash[29418]: audit 2021-03-10T16:46:54.525480+0000 mon.a (mon.0) 3324 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:55.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:55 gibba013 bash[29418]: audit 2021-03-10T16:46:54.527119+0000 mon.a (mon.0) 3325 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:55.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:55 gibba013 bash[29418]: audit 2021-03-10T16:46:54.528630+0000 mon.a (mon.0) 3326 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:55.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:55 gibba013 bash[29418]: audit 2021-03-10T16:46:54.531605+0000 mon.a (mon.0) 3327 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:55.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:55 gibba013 bash[29418]: audit 2021-03-10T16:46:54.533397+0000 mon.a (mon.0) 3328 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:55.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:55 gibba013 bash[30381]: cluster 2021-03-10T16:46:54.042610+0000 mgr.gibba020.yqfnwy (mgr.34427) 9166 : cluster [DBG] pgmap v5225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:55.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:55 gibba013 bash[30381]: audit 2021-03-10T16:46:54.291952+0000 mon.a (mon.0) 3321 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:46:55.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:55 gibba013 bash[30381]: audit 2021-03-10T16:46:54.520176+0000 mon.a (mon.0) 3322 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:46:55.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:55 gibba013 bash[30381]: audit 2021-03-10T16:46:54.524001+0000 mon.a (mon.0) 3323 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:46:55.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:55 gibba013 bash[30381]: audit 2021-03-10T16:46:54.525480+0000 mon.a (mon.0) 3324 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:55.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:55 gibba013 bash[30381]: audit 2021-03-10T16:46:54.527119+0000 mon.a (mon.0) 3325 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:55.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:55 gibba013 bash[30381]: audit 2021-03-10T16:46:54.528630+0000 mon.a (mon.0) 3326 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:55.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:55 gibba013 bash[30381]: audit 2021-03-10T16:46:54.531605+0000 mon.a (mon.0) 3327 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:55.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:55 gibba013 bash[30381]: audit 2021-03-10T16:46:54.533397+0000 mon.a (mon.0) 3328 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:55.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:55 gibba020 bash[25448]: cluster 2021-03-10T16:46:54.042610+0000 mgr.gibba020.yqfnwy (mgr.34427) 9166 : cluster [DBG] pgmap v5225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:55.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:55 gibba020 bash[25448]: audit 2021-03-10T16:46:54.291952+0000 mon.a (mon.0) 3321 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:46:55.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:55 gibba020 bash[25448]: audit 2021-03-10T16:46:54.520176+0000 mon.a (mon.0) 3322 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:46:55.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:55 gibba020 bash[25448]: audit 2021-03-10T16:46:54.524001+0000 mon.a (mon.0) 3323 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:46:55.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:55 gibba020 bash[25448]: audit 2021-03-10T16:46:54.525480+0000 mon.a (mon.0) 3324 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:55.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:55 gibba020 bash[25448]: audit 2021-03-10T16:46:54.527119+0000 mon.a (mon.0) 3325 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:55.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:55 gibba020 bash[25448]: audit 2021-03-10T16:46:54.528630+0000 mon.a (mon.0) 3326 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:55.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:55 gibba020 bash[25448]: audit 2021-03-10T16:46:54.531605+0000 mon.a (mon.0) 3327 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:55.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:55 gibba020 bash[25448]: audit 2021-03-10T16:46:54.533397+0000 mon.a (mon.0) 3328 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:56.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:56 gibba013 bash[29418]: cephadm 2021-03-10T16:46:54.296873+0000 mgr.gibba020.yqfnwy (mgr.34427) 9167 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:46:56.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:56 gibba013 bash[29418]: cephadm 2021-03-10T16:46:54.298743+0000 mgr.gibba020.yqfnwy (mgr.34427) 9168 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:46:56.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:56 gibba013 bash[29418]: cephadm 2021-03-10T16:46:54.522538+0000 mgr.gibba020.yqfnwy (mgr.34427) 9169 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:46:56.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:56 gibba013 bash[29418]: cephadm 2021-03-10T16:46:54.524427+0000 mgr.gibba020.yqfnwy (mgr.34427) 9170 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:46:56.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:56 gibba013 bash[29418]: cephadm 2021-03-10T16:46:54.526023+0000 mgr.gibba020.yqfnwy (mgr.34427) 9171 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:46:56.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:56 gibba013 bash[29418]: cephadm 2021-03-10T16:46:54.526068+0000 mgr.gibba020.yqfnwy (mgr.34427) 9172 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:46:56.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:56 gibba013 bash[29418]: cephadm 2021-03-10T16:46:54.527615+0000 mgr.gibba020.yqfnwy (mgr.34427) 9173 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:46:56.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:56 gibba013 bash[29418]: cephadm 2021-03-10T16:46:54.527658+0000 mgr.gibba020.yqfnwy (mgr.34427) 9174 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:46:56.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:56 gibba013 bash[29418]: cephadm 2021-03-10T16:46:54.529109+0000 mgr.gibba020.yqfnwy (mgr.34427) 9175 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:46:56.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:56 gibba013 bash[29418]: cephadm 2021-03-10T16:46:54.530594+0000 mgr.gibba020.yqfnwy (mgr.34427) 9176 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:46:56.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:56 gibba013 bash[29418]: cephadm 2021-03-10T16:46:54.530647+0000 mgr.gibba020.yqfnwy (mgr.34427) 9177 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:46:56.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:56 gibba013 bash[29418]: cephadm 2021-03-10T16:46:54.532009+0000 mgr.gibba020.yqfnwy (mgr.34427) 9178 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:46:56.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:56 gibba013 bash[29418]: cephadm 2021-03-10T16:46:54.532464+0000 mgr.gibba020.yqfnwy (mgr.34427) 9179 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:46:56.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:56 gibba013 bash[29418]: cephadm 2021-03-10T16:46:54.533832+0000 mgr.gibba020.yqfnwy (mgr.34427) 9180 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:46:56.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:56 gibba013 bash[29418]: cephadm 2021-03-10T16:46:54.533870+0000 mgr.gibba020.yqfnwy (mgr.34427) 9181 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:46:56.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:56 gibba013 bash[29418]: cephadm 2021-03-10T16:46:54.533977+0000 mgr.gibba020.yqfnwy (mgr.34427) 9182 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:46:56.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:56 gibba013 bash[30381]: cephadm 2021-03-10T16:46:54.296873+0000 mgr.gibba020.yqfnwy (mgr.34427) 9167 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:46:56.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:56 gibba013 bash[30381]: cephadm 2021-03-10T16:46:54.298743+0000 mgr.gibba020.yqfnwy (mgr.34427) 9168 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:46:56.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:56 gibba013 bash[30381]: cephadm 2021-03-10T16:46:54.522538+0000 mgr.gibba020.yqfnwy (mgr.34427) 9169 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:46:56.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:56 gibba013 bash[30381]: cephadm 2021-03-10T16:46:54.524427+0000 mgr.gibba020.yqfnwy (mgr.34427) 9170 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:46:56.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:56 gibba013 bash[30381]: cephadm 2021-03-10T16:46:54.526023+0000 mgr.gibba020.yqfnwy (mgr.34427) 9171 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:46:56.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:56 gibba013 bash[30381]: cephadm 2021-03-10T16:46:54.526068+0000 mgr.gibba020.yqfnwy (mgr.34427) 9172 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:46:56.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:56 gibba013 bash[30381]: cephadm 2021-03-10T16:46:54.527615+0000 mgr.gibba020.yqfnwy (mgr.34427) 9173 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:46:56.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:56 gibba013 bash[30381]: cephadm 2021-03-10T16:46:54.527658+0000 mgr.gibba020.yqfnwy (mgr.34427) 9174 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:46:56.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:56 gibba013 bash[30381]: cephadm 2021-03-10T16:46:54.529109+0000 mgr.gibba020.yqfnwy (mgr.34427) 9175 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:46:56.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:56 gibba013 bash[30381]: cephadm 2021-03-10T16:46:54.530594+0000 mgr.gibba020.yqfnwy (mgr.34427) 9176 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:46:56.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:56 gibba013 bash[30381]: cephadm 2021-03-10T16:46:54.530647+0000 mgr.gibba020.yqfnwy (mgr.34427) 9177 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:46:56.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:56 gibba013 bash[30381]: cephadm 2021-03-10T16:46:54.532009+0000 mgr.gibba020.yqfnwy (mgr.34427) 9178 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:46:56.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:56 gibba013 bash[30381]: cephadm 2021-03-10T16:46:54.532464+0000 mgr.gibba020.yqfnwy (mgr.34427) 9179 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:46:56.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:56 gibba013 bash[30381]: cephadm 2021-03-10T16:46:54.533832+0000 mgr.gibba020.yqfnwy (mgr.34427) 9180 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:46:56.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:56 gibba013 bash[30381]: cephadm 2021-03-10T16:46:54.533870+0000 mgr.gibba020.yqfnwy (mgr.34427) 9181 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:46:56.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:56 gibba013 bash[30381]: cephadm 2021-03-10T16:46:54.533977+0000 mgr.gibba020.yqfnwy (mgr.34427) 9182 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:46:56.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:56 gibba020 bash[25448]: cephadm 2021-03-10T16:46:54.296873+0000 mgr.gibba020.yqfnwy (mgr.34427) 9167 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:46:56.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:56 gibba020 bash[25448]: cephadm 2021-03-10T16:46:54.298743+0000 mgr.gibba020.yqfnwy (mgr.34427) 9168 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:46:56.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:56 gibba020 bash[25448]: cephadm 2021-03-10T16:46:54.522538+0000 mgr.gibba020.yqfnwy (mgr.34427) 9169 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:46:56.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:56 gibba020 bash[25448]: cephadm 2021-03-10T16:46:54.524427+0000 mgr.gibba020.yqfnwy (mgr.34427) 9170 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:46:56.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:56 gibba020 bash[25448]: cephadm 2021-03-10T16:46:54.526023+0000 mgr.gibba020.yqfnwy (mgr.34427) 9171 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:46:56.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:56 gibba020 bash[25448]: cephadm 2021-03-10T16:46:54.526068+0000 mgr.gibba020.yqfnwy (mgr.34427) 9172 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:46:56.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:56 gibba020 bash[25448]: cephadm 2021-03-10T16:46:54.527615+0000 mgr.gibba020.yqfnwy (mgr.34427) 9173 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:46:56.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:56 gibba020 bash[25448]: cephadm 2021-03-10T16:46:54.527658+0000 mgr.gibba020.yqfnwy (mgr.34427) 9174 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:46:56.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:56 gibba020 bash[25448]: cephadm 2021-03-10T16:46:54.529109+0000 mgr.gibba020.yqfnwy (mgr.34427) 9175 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:46:56.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:56 gibba020 bash[25448]: cephadm 2021-03-10T16:46:54.530594+0000 mgr.gibba020.yqfnwy (mgr.34427) 9176 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:46:56.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:56 gibba020 bash[25448]: cephadm 2021-03-10T16:46:54.530647+0000 mgr.gibba020.yqfnwy (mgr.34427) 9177 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:46:56.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:56 gibba020 bash[25448]: cephadm 2021-03-10T16:46:54.532009+0000 mgr.gibba020.yqfnwy (mgr.34427) 9178 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:46:56.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:56 gibba020 bash[25448]: cephadm 2021-03-10T16:46:54.532464+0000 mgr.gibba020.yqfnwy (mgr.34427) 9179 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:46:56.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:56 gibba020 bash[25448]: cephadm 2021-03-10T16:46:54.533832+0000 mgr.gibba020.yqfnwy (mgr.34427) 9180 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:46:56.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:56 gibba020 bash[25448]: cephadm 2021-03-10T16:46:54.533870+0000 mgr.gibba020.yqfnwy (mgr.34427) 9181 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:46:56.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:56 gibba020 bash[25448]: cephadm 2021-03-10T16:46:54.533977+0000 mgr.gibba020.yqfnwy (mgr.34427) 9182 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:46:57.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:57 gibba020 bash[25448]: cluster 2021-03-10T16:46:56.044335+0000 mgr.gibba020.yqfnwy (mgr.34427) 9183 : cluster [DBG] pgmap v5226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:57.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:57 gibba013 bash[29418]: cluster 2021-03-10T16:46:56.044335+0000 mgr.gibba020.yqfnwy (mgr.34427) 9183 : cluster [DBG] pgmap v5226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:57.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:57 gibba013 bash[30381]: cluster 2021-03-10T16:46:56.044335+0000 mgr.gibba020.yqfnwy (mgr.34427) 9183 : cluster [DBG] pgmap v5226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:57.917 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:46:58.148 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:46:58.149 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 6m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:46:58.149 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 5m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:46:58.149 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:46:58.150 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:46:58.150 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:46:58.150 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:46:58.151 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:46:58.151 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:46:58.151 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:46:58.151 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:46:58.152 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:46:58.152 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:46:58.152 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:46:58.153 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:46:58.153 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:46:58.153 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:46:58.154 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:46:58.154 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:46:58.155 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 5m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:46:58.155 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 5m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:46:58.396 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:46:58.396 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:46:58.396 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:46:58.396 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:46:58.397 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:46:58.397 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:46:58.397 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:46:58.397 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:46:58.397 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:46:58.398 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:46:58.398 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:46:58.398 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:46:58.398 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:46:58.399 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:46:58.399 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:46:58.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:58 gibba020 bash[25448]: audit 2021-03-10T16:46:57.909620+0000 mgr.gibba020.yqfnwy (mgr.34427) 9184 : audit [DBG] from='client.60190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:46:58.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:58 gibba020 bash[25448]: cluster 2021-03-10T16:46:58.045569+0000 mgr.gibba020.yqfnwy (mgr.34427) 9185 : cluster [DBG] pgmap v5227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:58.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:58 gibba013 bash[29418]: audit 2021-03-10T16:46:57.909620+0000 mgr.gibba020.yqfnwy (mgr.34427) 9184 : audit [DBG] from='client.60190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:46:58.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:58 gibba013 bash[29418]: cluster 2021-03-10T16:46:58.045569+0000 mgr.gibba020.yqfnwy (mgr.34427) 9185 : cluster [DBG] pgmap v5227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:58.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:58 gibba013 bash[30381]: audit 2021-03-10T16:46:57.909620+0000 mgr.gibba020.yqfnwy (mgr.34427) 9184 : audit [DBG] from='client.60190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:46:58.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:58 gibba013 bash[30381]: cluster 2021-03-10T16:46:58.045569+0000 mgr.gibba020.yqfnwy (mgr.34427) 9185 : cluster [DBG] pgmap v5227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:46:59.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:59 gibba020 bash[25448]: audit 2021-03-10T16:46:58.137110+0000 mgr.gibba020.yqfnwy (mgr.34427) 9186 : audit [DBG] from='client.60196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:46:59.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:46:59 gibba020 bash[25448]: audit 2021-03-10T16:46:58.397714+0000 mon.a (mon.0) 3329 : audit [DBG] from='client.? 172.21.2.113:0/2631528566' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:59.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:59 gibba013 bash[29418]: audit 2021-03-10T16:46:58.137110+0000 mgr.gibba020.yqfnwy (mgr.34427) 9186 : audit [DBG] from='client.60196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:46:59.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:46:59 gibba013 bash[29418]: audit 2021-03-10T16:46:58.397714+0000 mon.a (mon.0) 3329 : audit [DBG] from='client.? 172.21.2.113:0/2631528566' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:46:59.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:59 gibba013 bash[30381]: audit 2021-03-10T16:46:58.137110+0000 mgr.gibba020.yqfnwy (mgr.34427) 9186 : audit [DBG] from='client.60196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:46:59.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:46:59 gibba013 bash[30381]: audit 2021-03-10T16:46:58.397714+0000 mon.a (mon.0) 3329 : audit [DBG] from='client.? 172.21.2.113:0/2631528566' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:01.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:00 gibba013 bash[29418]: cluster 2021-03-10T16:47:00.046209+0000 mgr.gibba020.yqfnwy (mgr.34427) 9187 : cluster [DBG] pgmap v5228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:01.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:00 gibba013 bash[30381]: cluster 2021-03-10T16:47:00.046209+0000 mgr.gibba020.yqfnwy (mgr.34427) 9187 : cluster [DBG] pgmap v5228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:01.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:00 gibba020 bash[25448]: cluster 2021-03-10T16:47:00.046209+0000 mgr.gibba020.yqfnwy (mgr.34427) 9187 : cluster [DBG] pgmap v5228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:03.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:03 gibba013 bash[29418]: cluster 2021-03-10T16:47:02.047462+0000 mgr.gibba020.yqfnwy (mgr.34427) 9188 : cluster [DBG] pgmap v5229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:03.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:03 gibba013 bash[30381]: cluster 2021-03-10T16:47:02.047462+0000 mgr.gibba020.yqfnwy (mgr.34427) 9188 : cluster [DBG] pgmap v5229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:03.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:03 gibba020 bash[25448]: cluster 2021-03-10T16:47:02.047462+0000 mgr.gibba020.yqfnwy (mgr.34427) 9188 : cluster [DBG] pgmap v5229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:05.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:05 gibba013 bash[29418]: cluster 2021-03-10T16:47:04.048855+0000 mgr.gibba020.yqfnwy (mgr.34427) 9189 : cluster [DBG] pgmap v5230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:05.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:05 gibba013 bash[30381]: cluster 2021-03-10T16:47:04.048855+0000 mgr.gibba020.yqfnwy (mgr.34427) 9189 : cluster [DBG] pgmap v5230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:05.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:05 gibba020 bash[25448]: cluster 2021-03-10T16:47:04.048855+0000 mgr.gibba020.yqfnwy (mgr.34427) 9189 : cluster [DBG] pgmap v5230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:07.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:07 gibba013 bash[29418]: cluster 2021-03-10T16:47:06.050672+0000 mgr.gibba020.yqfnwy (mgr.34427) 9190 : cluster [DBG] pgmap v5231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:07.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:07 gibba013 bash[29418]: audit 2021-03-10T16:47:06.796793+0000 mon.a (mon.0) 3330 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:47:07.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:07 gibba013 bash[29418]: audit 2021-03-10T16:47:06.970066+0000 mon.a (mon.0) 3331 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:47:07.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:07 gibba013 bash[30381]: cluster 2021-03-10T16:47:06.050672+0000 mgr.gibba020.yqfnwy (mgr.34427) 9190 : cluster [DBG] pgmap v5231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:07.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:07 gibba013 bash[30381]: audit 2021-03-10T16:47:06.796793+0000 mon.a (mon.0) 3330 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:47:07.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:07 gibba013 bash[30381]: audit 2021-03-10T16:47:06.970066+0000 mon.a (mon.0) 3331 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:47:07.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:07 gibba020 bash[25448]: cluster 2021-03-10T16:47:06.050672+0000 mgr.gibba020.yqfnwy (mgr.34427) 9190 : cluster [DBG] pgmap v5231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:07.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:07 gibba020 bash[25448]: audit 2021-03-10T16:47:06.796793+0000 mon.a (mon.0) 3330 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:47:07.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:07 gibba020 bash[25448]: audit 2021-03-10T16:47:06.970066+0000 mon.a (mon.0) 3331 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:47:08.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:08 gibba020 bash[25448]: audit 2021-03-10T16:47:07.331875+0000 mon.a (mon.0) 3332 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T16:47:08.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:08 gibba020 bash[25448]: audit 2021-03-10T16:47:07.332779+0000 mon.a (mon.0) 3333 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:47:08.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:08 gibba020 bash[25448]: audit 2021-03-10T16:47:07.333527+0000 mon.a (mon.0) 3334 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:47:08.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:08 gibba020 bash[25448]: audit 2021-03-10T16:47:07.334280+0000 mon.a (mon.0) 3335 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:47:08.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:08 gibba013 bash[29418]: audit 2021-03-10T16:47:07.331875+0000 mon.a (mon.0) 3332 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T16:47:08.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:08 gibba013 bash[29418]: audit 2021-03-10T16:47:07.332779+0000 mon.a (mon.0) 3333 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:47:08.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:08 gibba013 bash[29418]: audit 2021-03-10T16:47:07.333527+0000 mon.a (mon.0) 3334 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:47:08.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:08 gibba013 bash[29418]: audit 2021-03-10T16:47:07.334280+0000 mon.a (mon.0) 3335 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:47:08.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:08 gibba013 bash[30381]: audit 2021-03-10T16:47:07.331875+0000 mon.a (mon.0) 3332 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T16:47:08.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:08 gibba013 bash[30381]: audit 2021-03-10T16:47:07.332779+0000 mon.a (mon.0) 3333 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:47:08.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:08 gibba013 bash[30381]: audit 2021-03-10T16:47:07.333527+0000 mon.a (mon.0) 3334 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:47:08.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:08 gibba013 bash[30381]: audit 2021-03-10T16:47:07.334280+0000 mon.a (mon.0) 3335 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:47:09.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:09 gibba020 bash[25448]: cluster 2021-03-10T16:47:08.051798+0000 mgr.gibba020.yqfnwy (mgr.34427) 9191 : cluster [DBG] pgmap v5232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:09.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:09 gibba013 bash[29418]: cluster 2021-03-10T16:47:08.051798+0000 mgr.gibba020.yqfnwy (mgr.34427) 9191 : cluster [DBG] pgmap v5232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:09.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:09 gibba013 bash[30381]: cluster 2021-03-10T16:47:08.051798+0000 mgr.gibba020.yqfnwy (mgr.34427) 9191 : cluster [DBG] pgmap v5232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:11.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:10 gibba013 bash[29418]: cephadm 2021-03-10T16:47:09.549808+0000 mgr.gibba020.yqfnwy (mgr.34427) 9192 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:47:11.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:10 gibba013 bash[29418]: cluster 2021-03-10T16:47:10.053650+0000 mgr.gibba020.yqfnwy (mgr.34427) 9193 : cluster [DBG] pgmap v5233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:11.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:10 gibba013 bash[30381]: cephadm 2021-03-10T16:47:09.549808+0000 mgr.gibba020.yqfnwy (mgr.34427) 9192 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:47:11.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:10 gibba013 bash[30381]: cluster 2021-03-10T16:47:10.053650+0000 mgr.gibba020.yqfnwy (mgr.34427) 9193 : cluster [DBG] pgmap v5233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:11.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:10 gibba020 bash[25448]: cephadm 2021-03-10T16:47:09.549808+0000 mgr.gibba020.yqfnwy (mgr.34427) 9192 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:47:11.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:10 gibba020 bash[25448]: cluster 2021-03-10T16:47:10.053650+0000 mgr.gibba020.yqfnwy (mgr.34427) 9193 : cluster [DBG] pgmap v5233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:13.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:13 gibba013 bash[29418]: cluster 2021-03-10T16:47:12.054946+0000 mgr.gibba020.yqfnwy (mgr.34427) 9194 : cluster [DBG] pgmap v5234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:13.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:13 gibba013 bash[30381]: cluster 2021-03-10T16:47:12.054946+0000 mgr.gibba020.yqfnwy (mgr.34427) 9194 : cluster [DBG] pgmap v5234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:13.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:13 gibba020 bash[25448]: cluster 2021-03-10T16:47:12.054946+0000 mgr.gibba020.yqfnwy (mgr.34427) 9194 : cluster [DBG] pgmap v5234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:15.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:15 gibba020 bash[25448]: cluster 2021-03-10T16:47:14.056377+0000 mgr.gibba020.yqfnwy (mgr.34427) 9195 : cluster [DBG] pgmap v5235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:15.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:15 gibba013 bash[29418]: cluster 2021-03-10T16:47:14.056377+0000 mgr.gibba020.yqfnwy (mgr.34427) 9195 : cluster [DBG] pgmap v5235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:15.627 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:15 gibba013 bash[30381]: cluster 2021-03-10T16:47:14.056377+0000 mgr.gibba020.yqfnwy (mgr.34427) 9195 : cluster [DBG] pgmap v5235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:16.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:16 gibba020 bash[25448]: cluster 2021-03-10T16:47:16.057982+0000 mgr.gibba020.yqfnwy (mgr.34427) 9196 : cluster [DBG] pgmap v5236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:16.626 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:16 gibba013 bash[29418]: cluster 2021-03-10T16:47:16.057982+0000 mgr.gibba020.yqfnwy (mgr.34427) 9196 : cluster [DBG] pgmap v5236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:16.627 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:16 gibba013 bash[30381]: cluster 2021-03-10T16:47:16.057982+0000 mgr.gibba020.yqfnwy (mgr.34427) 9196 : cluster [DBG] pgmap v5236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:19.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:19 gibba013 bash[29418]: cluster 2021-03-10T16:47:18.058447+0000 mgr.gibba020.yqfnwy (mgr.34427) 9197 : cluster [DBG] pgmap v5237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:19.377 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:19 gibba013 bash[30381]: cluster 2021-03-10T16:47:18.058447+0000 mgr.gibba020.yqfnwy (mgr.34427) 9197 : cluster [DBG] pgmap v5237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:19.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:19 gibba020 bash[25448]: cluster 2021-03-10T16:47:18.058447+0000 mgr.gibba020.yqfnwy (mgr.34427) 9197 : cluster [DBG] pgmap v5237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:21.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:20 gibba013 bash[29418]: cluster 2021-03-10T16:47:20.060358+0000 mgr.gibba020.yqfnwy (mgr.34427) 9198 : cluster [DBG] pgmap v5238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:21.127 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:20 gibba013 bash[30381]: cluster 2021-03-10T16:47:20.060358+0000 mgr.gibba020.yqfnwy (mgr.34427) 9198 : cluster [DBG] pgmap v5238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:21.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:20 gibba020 bash[25448]: cluster 2021-03-10T16:47:20.060358+0000 mgr.gibba020.yqfnwy (mgr.34427) 9198 : cluster [DBG] pgmap v5238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:23.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:23 gibba013 bash[29418]: cluster 2021-03-10T16:47:22.061719+0000 mgr.gibba020.yqfnwy (mgr.34427) 9199 : cluster [DBG] pgmap v5239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:23.377 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:23 gibba013 bash[30381]: cluster 2021-03-10T16:47:22.061719+0000 mgr.gibba020.yqfnwy (mgr.34427) 9199 : cluster [DBG] pgmap v5239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:23.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:23 gibba020 bash[25448]: cluster 2021-03-10T16:47:22.061719+0000 mgr.gibba020.yqfnwy (mgr.34427) 9199 : cluster [DBG] pgmap v5239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:25.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:25 gibba020 bash[25448]: cluster 2021-03-10T16:47:24.063130+0000 mgr.gibba020.yqfnwy (mgr.34427) 9200 : cluster [DBG] pgmap v5240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:25.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:25 gibba013 bash[29418]: cluster 2021-03-10T16:47:24.063130+0000 mgr.gibba020.yqfnwy (mgr.34427) 9200 : cluster [DBG] pgmap v5240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:25.627 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:25 gibba013 bash[30381]: cluster 2021-03-10T16:47:24.063130+0000 mgr.gibba020.yqfnwy (mgr.34427) 9200 : cluster [DBG] pgmap v5240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:26.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:26 gibba020 bash[25448]: cephadm 2021-03-10T16:47:24.565593+0000 mgr.gibba020.yqfnwy (mgr.34427) 9201 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:47:26.626 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:26 gibba013 bash[29418]: cephadm 2021-03-10T16:47:24.565593+0000 mgr.gibba020.yqfnwy (mgr.34427) 9201 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:47:26.627 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:26 gibba013 bash[30381]: cephadm 2021-03-10T16:47:24.565593+0000 mgr.gibba020.yqfnwy (mgr.34427) 9201 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:47:27.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:27 gibba020 bash[25448]: cluster 2021-03-10T16:47:26.064906+0000 mgr.gibba020.yqfnwy (mgr.34427) 9202 : cluster [DBG] pgmap v5241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:27.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:27 gibba013 bash[29418]: cluster 2021-03-10T16:47:26.064906+0000 mgr.gibba020.yqfnwy (mgr.34427) 9202 : cluster [DBG] pgmap v5241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:27.627 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:27 gibba013 bash[30381]: cluster 2021-03-10T16:47:26.064906+0000 mgr.gibba020.yqfnwy (mgr.34427) 9202 : cluster [DBG] pgmap v5241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:28.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:28 gibba020 bash[25448]: cluster 2021-03-10T16:47:28.065364+0000 mgr.gibba020.yqfnwy (mgr.34427) 9203 : cluster [DBG] pgmap v5242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:28.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:28 gibba013 bash[29418]: cluster 2021-03-10T16:47:28.065364+0000 mgr.gibba020.yqfnwy (mgr.34427) 9203 : cluster [DBG] pgmap v5242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:28.627 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:28 gibba013 bash[30381]: cluster 2021-03-10T16:47:28.065364+0000 mgr.gibba020.yqfnwy (mgr.34427) 9203 : cluster [DBG] pgmap v5242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:28.640 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:47:28.870 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:47:28.871 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 6m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:47:28.871 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 5m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:47:28.871 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:47:28.872 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:47:28.872 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:47:28.873 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:47:28.873 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:47:28.873 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:47:28.874 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (2h) 6m ago 2h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:47:28.874 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (2h) 5m ago 2h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:47:28.875 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:47:28.875 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:47:28.875 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:47:28.876 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:47:28.876 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:47:28.877 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:47:28.877 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:47:28.878 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 5m ago 2h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:47:28.878 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 5m ago 2h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:47:28.878 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 5m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:47:29.120 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:47:29.120 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:47:29.121 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:47:29.121 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:47:29.121 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:47:29.121 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:47:29.121 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:47:29.122 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:47:29.122 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:47:29.122 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:47:29.122 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:47:29.123 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:47:29.123 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:47:29.123 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:47:29.123 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:47:29.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:29 gibba020 bash[25448]: audit 2021-03-10T16:47:28.632293+0000 mgr.gibba020.yqfnwy (mgr.34427) 9204 : audit [DBG] from='client.60208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:47:29.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:29 gibba020 bash[25448]: audit 2021-03-10T16:47:28.858983+0000 mgr.gibba020.yqfnwy (mgr.34427) 9205 : audit [DBG] from='client.60214 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:47:29.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:29 gibba020 bash[25448]: audit 2021-03-10T16:47:29.122048+0000 mon.a (mon.0) 3336 : audit [DBG] from='client.? 172.21.2.113:0/4101441027' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:29.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:29 gibba013 bash[29418]: audit 2021-03-10T16:47:28.632293+0000 mgr.gibba020.yqfnwy (mgr.34427) 9204 : audit [DBG] from='client.60208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:47:29.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:29 gibba013 bash[29418]: audit 2021-03-10T16:47:28.858983+0000 mgr.gibba020.yqfnwy (mgr.34427) 9205 : audit [DBG] from='client.60214 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:47:29.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:29 gibba013 bash[29418]: audit 2021-03-10T16:47:29.122048+0000 mon.a (mon.0) 3336 : audit [DBG] from='client.? 172.21.2.113:0/4101441027' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:29.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:29 gibba013 bash[30381]: audit 2021-03-10T16:47:28.632293+0000 mgr.gibba020.yqfnwy (mgr.34427) 9204 : audit [DBG] from='client.60208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:47:29.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:29 gibba013 bash[30381]: audit 2021-03-10T16:47:28.858983+0000 mgr.gibba020.yqfnwy (mgr.34427) 9205 : audit [DBG] from='client.60214 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:47:29.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:29 gibba013 bash[30381]: audit 2021-03-10T16:47:29.122048+0000 mon.a (mon.0) 3336 : audit [DBG] from='client.? 172.21.2.113:0/4101441027' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:31.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:30 gibba013 bash[29418]: cluster 2021-03-10T16:47:30.066942+0000 mgr.gibba020.yqfnwy (mgr.34427) 9206 : cluster [DBG] pgmap v5243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:31.127 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:30 gibba013 bash[30381]: cluster 2021-03-10T16:47:30.066942+0000 mgr.gibba020.yqfnwy (mgr.34427) 9206 : cluster [DBG] pgmap v5243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:31.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:30 gibba020 bash[25448]: cluster 2021-03-10T16:47:30.066942+0000 mgr.gibba020.yqfnwy (mgr.34427) 9206 : cluster [DBG] pgmap v5243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:33.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:33 gibba020 bash[25448]: cluster 2021-03-10T16:47:32.068232+0000 mgr.gibba020.yqfnwy (mgr.34427) 9207 : cluster [DBG] pgmap v5244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:33.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:33 gibba013 bash[29418]: cluster 2021-03-10T16:47:32.068232+0000 mgr.gibba020.yqfnwy (mgr.34427) 9207 : cluster [DBG] pgmap v5244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:33.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:33 gibba013 bash[30381]: cluster 2021-03-10T16:47:32.068232+0000 mgr.gibba020.yqfnwy (mgr.34427) 9207 : cluster [DBG] pgmap v5244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:35.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:35 gibba020 bash[25448]: cluster 2021-03-10T16:47:34.069637+0000 mgr.gibba020.yqfnwy (mgr.34427) 9208 : cluster [DBG] pgmap v5245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:35.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:35 gibba013 bash[29418]: cluster 2021-03-10T16:47:34.069637+0000 mgr.gibba020.yqfnwy (mgr.34427) 9208 : cluster [DBG] pgmap v5245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:35.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:35 gibba013 bash[30381]: cluster 2021-03-10T16:47:34.069637+0000 mgr.gibba020.yqfnwy (mgr.34427) 9208 : cluster [DBG] pgmap v5245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:36.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:36 gibba020 bash[25448]: cluster 2021-03-10T16:47:36.071208+0000 mgr.gibba020.yqfnwy (mgr.34427) 9209 : cluster [DBG] pgmap v5246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:36.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:36 gibba013 bash[29418]: cluster 2021-03-10T16:47:36.071208+0000 mgr.gibba020.yqfnwy (mgr.34427) 9209 : cluster [DBG] pgmap v5246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:36.627 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:36 gibba013 bash[30381]: cluster 2021-03-10T16:47:36.071208+0000 mgr.gibba020.yqfnwy (mgr.34427) 9209 : cluster [DBG] pgmap v5246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:39.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:39 gibba020 bash[25448]: cluster 2021-03-10T16:47:38.071715+0000 mgr.gibba020.yqfnwy (mgr.34427) 9210 : cluster [DBG] pgmap v5247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:39.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:39 gibba013 bash[29418]: cluster 2021-03-10T16:47:38.071715+0000 mgr.gibba020.yqfnwy (mgr.34427) 9210 : cluster [DBG] pgmap v5247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:39.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:39 gibba013 bash[30381]: cluster 2021-03-10T16:47:38.071715+0000 mgr.gibba020.yqfnwy (mgr.34427) 9210 : cluster [DBG] pgmap v5247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:41.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:40 gibba013 bash[29418]: cephadm 2021-03-10T16:47:39.581640+0000 mgr.gibba020.yqfnwy (mgr.34427) 9211 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:47:41.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:40 gibba013 bash[29418]: cluster 2021-03-10T16:47:40.073548+0000 mgr.gibba020.yqfnwy (mgr.34427) 9212 : cluster [DBG] pgmap v5248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:41.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:40 gibba013 bash[30381]: cephadm 2021-03-10T16:47:39.581640+0000 mgr.gibba020.yqfnwy (mgr.34427) 9211 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:47:41.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:40 gibba013 bash[30381]: cluster 2021-03-10T16:47:40.073548+0000 mgr.gibba020.yqfnwy (mgr.34427) 9212 : cluster [DBG] pgmap v5248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:41.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:40 gibba020 bash[25448]: cephadm 2021-03-10T16:47:39.581640+0000 mgr.gibba020.yqfnwy (mgr.34427) 9211 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:47:41.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:40 gibba020 bash[25448]: cluster 2021-03-10T16:47:40.073548+0000 mgr.gibba020.yqfnwy (mgr.34427) 9212 : cluster [DBG] pgmap v5248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:43.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:43 gibba020 bash[25448]: cluster 2021-03-10T16:47:42.074803+0000 mgr.gibba020.yqfnwy (mgr.34427) 9213 : cluster [DBG] pgmap v5249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:43.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:43 gibba013 bash[29418]: cluster 2021-03-10T16:47:42.074803+0000 mgr.gibba020.yqfnwy (mgr.34427) 9213 : cluster [DBG] pgmap v5249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:43.627 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:43 gibba013 bash[30381]: cluster 2021-03-10T16:47:42.074803+0000 mgr.gibba020.yqfnwy (mgr.34427) 9213 : cluster [DBG] pgmap v5249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:45.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:45 gibba020 bash[25448]: cluster 2021-03-10T16:47:44.076469+0000 mgr.gibba020.yqfnwy (mgr.34427) 9214 : cluster [DBG] pgmap v5250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:45.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:45 gibba013 bash[29418]: cluster 2021-03-10T16:47:44.076469+0000 mgr.gibba020.yqfnwy (mgr.34427) 9214 : cluster [DBG] pgmap v5250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:45.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:45 gibba013 bash[30381]: cluster 2021-03-10T16:47:44.076469+0000 mgr.gibba020.yqfnwy (mgr.34427) 9214 : cluster [DBG] pgmap v5250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:46.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:46 gibba020 bash[25448]: cluster 2021-03-10T16:47:46.078183+0000 mgr.gibba020.yqfnwy (mgr.34427) 9215 : cluster [DBG] pgmap v5251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:46.626 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:46 gibba013 bash[29418]: cluster 2021-03-10T16:47:46.078183+0000 mgr.gibba020.yqfnwy (mgr.34427) 9215 : cluster [DBG] pgmap v5251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:46.627 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:46 gibba013 bash[30381]: cluster 2021-03-10T16:47:46.078183+0000 mgr.gibba020.yqfnwy (mgr.34427) 9215 : cluster [DBG] pgmap v5251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:49.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:49 gibba020 bash[25448]: cluster 2021-03-10T16:47:48.078777+0000 mgr.gibba020.yqfnwy (mgr.34427) 9216 : cluster [DBG] pgmap v5252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:49.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:49 gibba013 bash[29418]: cluster 2021-03-10T16:47:48.078777+0000 mgr.gibba020.yqfnwy (mgr.34427) 9216 : cluster [DBG] pgmap v5252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:49.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:49 gibba013 bash[30381]: cluster 2021-03-10T16:47:48.078777+0000 mgr.gibba020.yqfnwy (mgr.34427) 9216 : cluster [DBG] pgmap v5252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:51.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:50 gibba013 bash[29418]: cluster 2021-03-10T16:47:50.080667+0000 mgr.gibba020.yqfnwy (mgr.34427) 9217 : cluster [DBG] pgmap v5253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:51.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:50 gibba013 bash[30381]: cluster 2021-03-10T16:47:50.080667+0000 mgr.gibba020.yqfnwy (mgr.34427) 9217 : cluster [DBG] pgmap v5253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:51.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:50 gibba020 bash[25448]: cluster 2021-03-10T16:47:50.080667+0000 mgr.gibba020.yqfnwy (mgr.34427) 9217 : cluster [DBG] pgmap v5253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:53.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:53 gibba020 bash[25448]: cluster 2021-03-10T16:47:52.082097+0000 mgr.gibba020.yqfnwy (mgr.34427) 9218 : cluster [DBG] pgmap v5254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:53.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:53 gibba013 bash[29418]: cluster 2021-03-10T16:47:52.082097+0000 mgr.gibba020.yqfnwy (mgr.34427) 9218 : cluster [DBG] pgmap v5254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:53.627 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:53 gibba013 bash[30381]: cluster 2021-03-10T16:47:52.082097+0000 mgr.gibba020.yqfnwy (mgr.34427) 9218 : cluster [DBG] pgmap v5254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:54.627 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:54 gibba013 bash[30381]: cluster 2021-03-10T16:47:54.083754+0000 mgr.gibba020.yqfnwy (mgr.34427) 9219 : cluster [DBG] pgmap v5255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:54.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:54 gibba013 bash[29418]: cluster 2021-03-10T16:47:54.083754+0000 mgr.gibba020.yqfnwy (mgr.34427) 9219 : cluster [DBG] pgmap v5255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:54.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:54 gibba020 bash[25448]: cluster 2021-03-10T16:47:54.083754+0000 mgr.gibba020.yqfnwy (mgr.34427) 9219 : cluster [DBG] pgmap v5255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:55.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:55 gibba020 bash[25448]: audit 2021-03-10T16:47:54.591645+0000 mon.a (mon.0) 3337 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:47:55.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:55 gibba020 bash[25448]: cephadm 2021-03-10T16:47:54.799437+0000 mgr.gibba020.yqfnwy (mgr.34427) 9220 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:47:55.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:55 gibba020 bash[25448]: audit 2021-03-10T16:47:54.799456+0000 mon.a (mon.0) 3338 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:47:55.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:55 gibba020 bash[25448]: audit 2021-03-10T16:47:54.802141+0000 mon.a (mon.0) 3339 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:47:55.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:55 gibba020 bash[25448]: cephadm 2021-03-10T16:47:54.802441+0000 mgr.gibba020.yqfnwy (mgr.34427) 9221 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:47:55.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:55 gibba020 bash[25448]: audit 2021-03-10T16:47:55.013609+0000 mon.a (mon.0) 3340 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:47:55.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:55 gibba020 bash[25448]: cephadm 2021-03-10T16:47:55.015467+0000 mgr.gibba020.yqfnwy (mgr.34427) 9222 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:47:55.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:55 gibba020 bash[25448]: audit 2021-03-10T16:47:55.016633+0000 mon.a (mon.0) 3341 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:47:55.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:55 gibba020 bash[25448]: cephadm 2021-03-10T16:47:55.017372+0000 mgr.gibba020.yqfnwy (mgr.34427) 9223 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:47:55.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:55 gibba020 bash[25448]: audit 2021-03-10T16:47:55.018353+0000 mon.a (mon.0) 3342 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:55.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:55 gibba020 bash[25448]: cephadm 2021-03-10T16:47:55.018835+0000 mgr.gibba020.yqfnwy (mgr.34427) 9224 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:47:55.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:55 gibba020 bash[25448]: cephadm 2021-03-10T16:47:55.018872+0000 mgr.gibba020.yqfnwy (mgr.34427) 9225 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:47:55.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:55 gibba020 bash[25448]: audit 2021-03-10T16:47:55.019897+0000 mon.a (mon.0) 3343 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:55.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:55 gibba020 bash[25448]: cephadm 2021-03-10T16:47:55.020347+0000 mgr.gibba020.yqfnwy (mgr.34427) 9226 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:47:55.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:55 gibba020 bash[25448]: cephadm 2021-03-10T16:47:55.020494+0000 mgr.gibba020.yqfnwy (mgr.34427) 9227 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:47:55.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:55 gibba020 bash[25448]: audit 2021-03-10T16:47:55.021460+0000 mon.a (mon.0) 3344 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:55.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:55 gibba020 bash[25448]: cephadm 2021-03-10T16:47:55.021983+0000 mgr.gibba020.yqfnwy (mgr.34427) 9228 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:47:55.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:55 gibba020 bash[25448]: cephadm 2021-03-10T16:47:55.023375+0000 mgr.gibba020.yqfnwy (mgr.34427) 9229 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:47:55.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:55 gibba020 bash[25448]: cephadm 2021-03-10T16:47:55.023410+0000 mgr.gibba020.yqfnwy (mgr.34427) 9230 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:47:55.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:55 gibba020 bash[25448]: audit 2021-03-10T16:47:55.024310+0000 mon.a (mon.0) 3345 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:55.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:55 gibba020 bash[25448]: cephadm 2021-03-10T16:47:55.024850+0000 mgr.gibba020.yqfnwy (mgr.34427) 9231 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:47:55.456 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:55 gibba020 bash[25448]: cephadm 2021-03-10T16:47:55.025185+0000 mgr.gibba020.yqfnwy (mgr.34427) 9232 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:47:55.456 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:55 gibba020 bash[25448]: audit 2021-03-10T16:47:55.026163+0000 mon.a (mon.0) 3346 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:55.457 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:55 gibba020 bash[25448]: cephadm 2021-03-10T16:47:55.026655+0000 mgr.gibba020.yqfnwy (mgr.34427) 9233 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:47:55.457 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:55 gibba020 bash[25448]: cephadm 2021-03-10T16:47:55.026692+0000 mgr.gibba020.yqfnwy (mgr.34427) 9234 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:47:55.458 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:55 gibba020 bash[25448]: cephadm 2021-03-10T16:47:55.026794+0000 mgr.gibba020.yqfnwy (mgr.34427) 9235 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:47:55.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[29418]: audit 2021-03-10T16:47:54.591645+0000 mon.a (mon.0) 3337 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:47:55.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[29418]: cephadm 2021-03-10T16:47:54.799437+0000 mgr.gibba020.yqfnwy (mgr.34427) 9220 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:47:55.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[29418]: audit 2021-03-10T16:47:54.799456+0000 mon.a (mon.0) 3338 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:47:55.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[29418]: audit 2021-03-10T16:47:54.802141+0000 mon.a (mon.0) 3339 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:47:55.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[29418]: cephadm 2021-03-10T16:47:54.802441+0000 mgr.gibba020.yqfnwy (mgr.34427) 9221 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:47:55.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[29418]: audit 2021-03-10T16:47:55.013609+0000 mon.a (mon.0) 3340 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:47:55.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[29418]: cephadm 2021-03-10T16:47:55.015467+0000 mgr.gibba020.yqfnwy (mgr.34427) 9222 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:47:55.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[29418]: audit 2021-03-10T16:47:55.016633+0000 mon.a (mon.0) 3341 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:47:55.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[29418]: cephadm 2021-03-10T16:47:55.017372+0000 mgr.gibba020.yqfnwy (mgr.34427) 9223 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:47:55.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[29418]: audit 2021-03-10T16:47:55.018353+0000 mon.a (mon.0) 3342 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:55.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[29418]: cephadm 2021-03-10T16:47:55.018835+0000 mgr.gibba020.yqfnwy (mgr.34427) 9224 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:47:55.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[29418]: cephadm 2021-03-10T16:47:55.018872+0000 mgr.gibba020.yqfnwy (mgr.34427) 9225 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:47:55.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[29418]: audit 2021-03-10T16:47:55.019897+0000 mon.a (mon.0) 3343 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:55.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[29418]: cephadm 2021-03-10T16:47:55.020347+0000 mgr.gibba020.yqfnwy (mgr.34427) 9226 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:47:55.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[29418]: cephadm 2021-03-10T16:47:55.020494+0000 mgr.gibba020.yqfnwy (mgr.34427) 9227 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:47:55.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[29418]: audit 2021-03-10T16:47:55.021460+0000 mon.a (mon.0) 3344 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:55.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[29418]: cephadm 2021-03-10T16:47:55.021983+0000 mgr.gibba020.yqfnwy (mgr.34427) 9228 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:47:55.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[29418]: cephadm 2021-03-10T16:47:55.023375+0000 mgr.gibba020.yqfnwy (mgr.34427) 9229 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:47:55.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[29418]: cephadm 2021-03-10T16:47:55.023410+0000 mgr.gibba020.yqfnwy (mgr.34427) 9230 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:47:55.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[29418]: audit 2021-03-10T16:47:55.024310+0000 mon.a (mon.0) 3345 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:55.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[30381]: audit 2021-03-10T16:47:54.591645+0000 mon.a (mon.0) 3337 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:47:55.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[30381]: cephadm 2021-03-10T16:47:54.799437+0000 mgr.gibba020.yqfnwy (mgr.34427) 9220 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:47:55.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[30381]: audit 2021-03-10T16:47:54.799456+0000 mon.a (mon.0) 3338 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:47:55.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[30381]: audit 2021-03-10T16:47:54.802141+0000 mon.a (mon.0) 3339 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:47:55.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[30381]: cephadm 2021-03-10T16:47:54.802441+0000 mgr.gibba020.yqfnwy (mgr.34427) 9221 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:47:55.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[30381]: audit 2021-03-10T16:47:55.013609+0000 mon.a (mon.0) 3340 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:47:55.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[30381]: cephadm 2021-03-10T16:47:55.015467+0000 mgr.gibba020.yqfnwy (mgr.34427) 9222 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:47:55.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[30381]: audit 2021-03-10T16:47:55.016633+0000 mon.a (mon.0) 3341 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:47:55.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[30381]: cephadm 2021-03-10T16:47:55.017372+0000 mgr.gibba020.yqfnwy (mgr.34427) 9223 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:47:55.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[30381]: audit 2021-03-10T16:47:55.018353+0000 mon.a (mon.0) 3342 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:55.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[30381]: cephadm 2021-03-10T16:47:55.018835+0000 mgr.gibba020.yqfnwy (mgr.34427) 9224 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:47:55.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[30381]: cephadm 2021-03-10T16:47:55.018872+0000 mgr.gibba020.yqfnwy (mgr.34427) 9225 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:47:55.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[30381]: audit 2021-03-10T16:47:55.019897+0000 mon.a (mon.0) 3343 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:55.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[30381]: cephadm 2021-03-10T16:47:55.020347+0000 mgr.gibba020.yqfnwy (mgr.34427) 9226 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:47:55.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[30381]: cephadm 2021-03-10T16:47:55.020494+0000 mgr.gibba020.yqfnwy (mgr.34427) 9227 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:47:55.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[30381]: audit 2021-03-10T16:47:55.021460+0000 mon.a (mon.0) 3344 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:55.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[30381]: cephadm 2021-03-10T16:47:55.021983+0000 mgr.gibba020.yqfnwy (mgr.34427) 9228 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:47:55.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[30381]: cephadm 2021-03-10T16:47:55.023375+0000 mgr.gibba020.yqfnwy (mgr.34427) 9229 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:47:55.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[30381]: cephadm 2021-03-10T16:47:55.023410+0000 mgr.gibba020.yqfnwy (mgr.34427) 9230 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:47:55.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[30381]: audit 2021-03-10T16:47:55.024310+0000 mon.a (mon.0) 3345 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:55.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[29418]: cephadm 2021-03-10T16:47:55.024850+0000 mgr.gibba020.yqfnwy (mgr.34427) 9231 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:47:55.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[29418]: cephadm 2021-03-10T16:47:55.025185+0000 mgr.gibba020.yqfnwy (mgr.34427) 9232 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:47:55.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[29418]: audit 2021-03-10T16:47:55.026163+0000 mon.a (mon.0) 3346 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:55.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[29418]: cephadm 2021-03-10T16:47:55.026655+0000 mgr.gibba020.yqfnwy (mgr.34427) 9233 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:47:55.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[29418]: cephadm 2021-03-10T16:47:55.026692+0000 mgr.gibba020.yqfnwy (mgr.34427) 9234 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:47:55.639 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[29418]: cephadm 2021-03-10T16:47:55.026794+0000 mgr.gibba020.yqfnwy (mgr.34427) 9235 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:47:55.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[30381]: cephadm 2021-03-10T16:47:55.024850+0000 mgr.gibba020.yqfnwy (mgr.34427) 9231 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:47:55.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[30381]: cephadm 2021-03-10T16:47:55.025185+0000 mgr.gibba020.yqfnwy (mgr.34427) 9232 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:47:55.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[30381]: audit 2021-03-10T16:47:55.026163+0000 mon.a (mon.0) 3346 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:47:55.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[30381]: cephadm 2021-03-10T16:47:55.026655+0000 mgr.gibba020.yqfnwy (mgr.34427) 9233 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:47:55.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[30381]: cephadm 2021-03-10T16:47:55.026692+0000 mgr.gibba020.yqfnwy (mgr.34427) 9234 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:47:55.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:55 gibba013 bash[30381]: cephadm 2021-03-10T16:47:55.026794+0000 mgr.gibba020.yqfnwy (mgr.34427) 9235 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:47:56.627 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:56 gibba013 bash[30381]: cluster 2021-03-10T16:47:56.085625+0000 mgr.gibba020.yqfnwy (mgr.34427) 9236 : cluster [DBG] pgmap v5256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:56.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:56 gibba013 bash[29418]: cluster 2021-03-10T16:47:56.085625+0000 mgr.gibba020.yqfnwy (mgr.34427) 9236 : cluster [DBG] pgmap v5256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:56.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:56 gibba020 bash[25448]: cluster 2021-03-10T16:47:56.085625+0000 mgr.gibba020.yqfnwy (mgr.34427) 9236 : cluster [DBG] pgmap v5256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:59.365 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:47:59.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:47:59 gibba020 bash[25448]: cluster 2021-03-10T16:47:58.086878+0000 mgr.gibba020.yqfnwy (mgr.34427) 9237 : cluster [DBG] pgmap v5257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:59.593 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:47:59.594 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 7m ago 2h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:47:59.594 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (2h) 6m ago 2h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:47:59.594 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:47:59.594 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:47:59.595 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:47:59.595 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:47:59.595 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:47:59.595 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:47:59.595 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:47:59.596 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:47:59.596 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:47:59.596 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:47:59.596 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:47:59.596 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:47:59.597 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:47:59.597 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:47:59.597 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:47:59.597 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:47:59.597 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 6m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:47:59.598 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 6m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:47:59.626 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:47:59 gibba013 bash[29418]: cluster 2021-03-10T16:47:58.086878+0000 mgr.gibba020.yqfnwy (mgr.34427) 9237 : cluster [DBG] pgmap v5257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:59.627 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:47:59 gibba013 bash[30381]: cluster 2021-03-10T16:47:58.086878+0000 mgr.gibba020.yqfnwy (mgr.34427) 9237 : cluster [DBG] pgmap v5257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:47:59.849 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:47:59.849 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:47:59.849 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:47:59.850 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:47:59.850 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:47:59.850 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:47:59.851 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:47:59.851 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:47:59.853 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:47:59.853 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:47:59.854 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:47:59.854 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:47:59.854 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:47:59.855 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:47:59.855 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:48:01.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:00 gibba013 bash[29418]: audit 2021-03-10T16:47:59.357565+0000 mgr.gibba020.yqfnwy (mgr.34427) 9238 : audit [DBG] from='client.50244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:48:01.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:00 gibba013 bash[29418]: audit 2021-03-10T16:47:59.582739+0000 mgr.gibba020.yqfnwy (mgr.34427) 9239 : audit [DBG] from='client.50250 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:48:01.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:00 gibba013 bash[29418]: audit 2021-03-10T16:47:59.850629+0000 mon.c (mon.1) 143 : audit [DBG] from='client.? 172.21.2.113:0/3600799652' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:01.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:00 gibba013 bash[29418]: cluster 2021-03-10T16:48:00.088893+0000 mgr.gibba020.yqfnwy (mgr.34427) 9240 : cluster [DBG] pgmap v5258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:01.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:00 gibba013 bash[30381]: audit 2021-03-10T16:47:59.357565+0000 mgr.gibba020.yqfnwy (mgr.34427) 9238 : audit [DBG] from='client.50244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:48:01.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:00 gibba013 bash[30381]: audit 2021-03-10T16:47:59.582739+0000 mgr.gibba020.yqfnwy (mgr.34427) 9239 : audit [DBG] from='client.50250 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:48:01.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:00 gibba013 bash[30381]: audit 2021-03-10T16:47:59.850629+0000 mon.c (mon.1) 143 : audit [DBG] from='client.? 172.21.2.113:0/3600799652' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:01.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:00 gibba013 bash[30381]: cluster 2021-03-10T16:48:00.088893+0000 mgr.gibba020.yqfnwy (mgr.34427) 9240 : cluster [DBG] pgmap v5258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:01.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:00 gibba020 bash[25448]: audit 2021-03-10T16:47:59.357565+0000 mgr.gibba020.yqfnwy (mgr.34427) 9238 : audit [DBG] from='client.50244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:48:01.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:00 gibba020 bash[25448]: audit 2021-03-10T16:47:59.582739+0000 mgr.gibba020.yqfnwy (mgr.34427) 9239 : audit [DBG] from='client.50250 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:48:01.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:00 gibba020 bash[25448]: audit 2021-03-10T16:47:59.850629+0000 mon.c (mon.1) 143 : audit [DBG] from='client.? 172.21.2.113:0/3600799652' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:01.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:00 gibba020 bash[25448]: cluster 2021-03-10T16:48:00.088893+0000 mgr.gibba020.yqfnwy (mgr.34427) 9240 : cluster [DBG] pgmap v5258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:03.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:03 gibba020 bash[25448]: cluster 2021-03-10T16:48:02.090226+0000 mgr.gibba020.yqfnwy (mgr.34427) 9241 : cluster [DBG] pgmap v5259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:03.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:03 gibba013 bash[29418]: cluster 2021-03-10T16:48:02.090226+0000 mgr.gibba020.yqfnwy (mgr.34427) 9241 : cluster [DBG] pgmap v5259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:03.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:03 gibba013 bash[30381]: cluster 2021-03-10T16:48:02.090226+0000 mgr.gibba020.yqfnwy (mgr.34427) 9241 : cluster [DBG] pgmap v5259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:04.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:04 gibba020 bash[25448]: cluster 2021-03-10T16:48:04.091777+0000 mgr.gibba020.yqfnwy (mgr.34427) 9242 : cluster [DBG] pgmap v5260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:04.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:04 gibba013 bash[29418]: cluster 2021-03-10T16:48:04.091777+0000 mgr.gibba020.yqfnwy (mgr.34427) 9242 : cluster [DBG] pgmap v5260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:04.627 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:04 gibba013 bash[30381]: cluster 2021-03-10T16:48:04.091777+0000 mgr.gibba020.yqfnwy (mgr.34427) 9242 : cluster [DBG] pgmap v5260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:06.626 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:06 gibba013 bash[29418]: cluster 2021-03-10T16:48:06.093516+0000 mgr.gibba020.yqfnwy (mgr.34427) 9243 : cluster [DBG] pgmap v5261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:06.627 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:06 gibba013 bash[30381]: cluster 2021-03-10T16:48:06.093516+0000 mgr.gibba020.yqfnwy (mgr.34427) 9243 : cluster [DBG] pgmap v5261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:06.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:06 gibba020 bash[25448]: cluster 2021-03-10T16:48:06.093516+0000 mgr.gibba020.yqfnwy (mgr.34427) 9243 : cluster [DBG] pgmap v5261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:07.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:07 gibba013 bash[29418]: audit 2021-03-10T16:48:06.802096+0000 mon.a (mon.0) 3347 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:48:07.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:07 gibba013 bash[29418]: audit 2021-03-10T16:48:06.976620+0000 mon.a (mon.0) 3348 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:48:07.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:07 gibba013 bash[30381]: audit 2021-03-10T16:48:06.802096+0000 mon.a (mon.0) 3347 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:48:07.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:07 gibba013 bash[30381]: audit 2021-03-10T16:48:06.976620+0000 mon.a (mon.0) 3348 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:48:07.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:07 gibba020 bash[25448]: audit 2021-03-10T16:48:06.802096+0000 mon.a (mon.0) 3347 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:48:07.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:07 gibba020 bash[25448]: audit 2021-03-10T16:48:06.976620+0000 mon.a (mon.0) 3348 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:48:08.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:08 gibba013 bash[29418]: audit 2021-03-10T16:48:07.341709+0000 mon.a (mon.0) 3349 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:48:08.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:08 gibba013 bash[29418]: audit 2021-03-10T16:48:07.342482+0000 mon.a (mon.0) 3350 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:48:08.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:08 gibba013 bash[29418]: audit 2021-03-10T16:48:07.343189+0000 mon.a (mon.0) 3351 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:48:08.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:08 gibba013 bash[29418]: audit 2021-03-10T16:48:07.343836+0000 mon.a (mon.0) 3352 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:48:08.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:08 gibba013 bash[29418]: cluster 2021-03-10T16:48:08.094637+0000 mgr.gibba020.yqfnwy (mgr.34427) 9244 : cluster [DBG] pgmap v5262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:08.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:08 gibba013 bash[30381]: audit 2021-03-10T16:48:07.341709+0000 mon.a (mon.0) 3349 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:48:08.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:08 gibba013 bash[30381]: audit 2021-03-10T16:48:07.342482+0000 mon.a (mon.0) 3350 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:48:08.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:08 gibba013 bash[30381]: audit 2021-03-10T16:48:07.343189+0000 mon.a (mon.0) 3351 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:48:08.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:08 gibba013 bash[30381]: audit 2021-03-10T16:48:07.343836+0000 mon.a (mon.0) 3352 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:48:08.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:08 gibba013 bash[30381]: cluster 2021-03-10T16:48:08.094637+0000 mgr.gibba020.yqfnwy (mgr.34427) 9244 : cluster [DBG] pgmap v5262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:08.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:08 gibba020 bash[25448]: audit 2021-03-10T16:48:07.341709+0000 mon.a (mon.0) 3349 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:48:08.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:08 gibba020 bash[25448]: audit 2021-03-10T16:48:07.342482+0000 mon.a (mon.0) 3350 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:48:08.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:08 gibba020 bash[25448]: audit 2021-03-10T16:48:07.343189+0000 mon.a (mon.0) 3351 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:48:08.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:08 gibba020 bash[25448]: audit 2021-03-10T16:48:07.343836+0000 mon.a (mon.0) 3352 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:48:08.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:08 gibba020 bash[25448]: cluster 2021-03-10T16:48:08.094637+0000 mgr.gibba020.yqfnwy (mgr.34427) 9244 : cluster [DBG] pgmap v5262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:11.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:10 gibba013 bash[29418]: cephadm 2021-03-10T16:48:10.042272+0000 mgr.gibba020.yqfnwy (mgr.34427) 9245 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:48:11.128 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:10 gibba013 bash[29418]: cluster 2021-03-10T16:48:10.096298+0000 mgr.gibba020.yqfnwy (mgr.34427) 9246 : cluster [DBG] pgmap v5263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:11.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:10 gibba013 bash[30381]: cephadm 2021-03-10T16:48:10.042272+0000 mgr.gibba020.yqfnwy (mgr.34427) 9245 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:48:11.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:10 gibba013 bash[30381]: cluster 2021-03-10T16:48:10.096298+0000 mgr.gibba020.yqfnwy (mgr.34427) 9246 : cluster [DBG] pgmap v5263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:11.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:10 gibba020 bash[25448]: cephadm 2021-03-10T16:48:10.042272+0000 mgr.gibba020.yqfnwy (mgr.34427) 9245 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:48:11.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:10 gibba020 bash[25448]: cluster 2021-03-10T16:48:10.096298+0000 mgr.gibba020.yqfnwy (mgr.34427) 9246 : cluster [DBG] pgmap v5263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:12.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:12 gibba013 bash[29418]: cluster 2021-03-10T16:48:12.097654+0000 mgr.gibba020.yqfnwy (mgr.34427) 9247 : cluster [DBG] pgmap v5264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:12.627 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:12 gibba013 bash[30381]: cluster 2021-03-10T16:48:12.097654+0000 mgr.gibba020.yqfnwy (mgr.34427) 9247 : cluster [DBG] pgmap v5264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:12.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:12 gibba020 bash[25448]: cluster 2021-03-10T16:48:12.097654+0000 mgr.gibba020.yqfnwy (mgr.34427) 9247 : cluster [DBG] pgmap v5264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:14.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:14 gibba013 bash[29418]: cluster 2021-03-10T16:48:14.099257+0000 mgr.gibba020.yqfnwy (mgr.34427) 9248 : cluster [DBG] pgmap v5265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:14.627 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:14 gibba013 bash[30381]: cluster 2021-03-10T16:48:14.099257+0000 mgr.gibba020.yqfnwy (mgr.34427) 9248 : cluster [DBG] pgmap v5265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:14.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:14 gibba020 bash[25448]: cluster 2021-03-10T16:48:14.099257+0000 mgr.gibba020.yqfnwy (mgr.34427) 9248 : cluster [DBG] pgmap v5265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:16.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:16 gibba013 bash[29418]: cluster 2021-03-10T16:48:16.101119+0000 mgr.gibba020.yqfnwy (mgr.34427) 9249 : cluster [DBG] pgmap v5266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:16.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:16 gibba013 bash[30381]: cluster 2021-03-10T16:48:16.101119+0000 mgr.gibba020.yqfnwy (mgr.34427) 9249 : cluster [DBG] pgmap v5266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:16.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:16 gibba020 bash[25448]: cluster 2021-03-10T16:48:16.101119+0000 mgr.gibba020.yqfnwy (mgr.34427) 9249 : cluster [DBG] pgmap v5266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:18.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:18 gibba013 bash[29418]: cluster 2021-03-10T16:48:18.102239+0000 mgr.gibba020.yqfnwy (mgr.34427) 9250 : cluster [DBG] pgmap v5267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:18.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:18 gibba013 bash[30381]: cluster 2021-03-10T16:48:18.102239+0000 mgr.gibba020.yqfnwy (mgr.34427) 9250 : cluster [DBG] pgmap v5267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:18.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:18 gibba020 bash[25448]: cluster 2021-03-10T16:48:18.102239+0000 mgr.gibba020.yqfnwy (mgr.34427) 9250 : cluster [DBG] pgmap v5267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:21.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:20 gibba013 bash[29418]: cluster 2021-03-10T16:48:20.104242+0000 mgr.gibba020.yqfnwy (mgr.34427) 9251 : cluster [DBG] pgmap v5268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:21.128 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:20 gibba013 bash[30381]: cluster 2021-03-10T16:48:20.104242+0000 mgr.gibba020.yqfnwy (mgr.34427) 9251 : cluster [DBG] pgmap v5268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:21.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:20 gibba020 bash[25448]: cluster 2021-03-10T16:48:20.104242+0000 mgr.gibba020.yqfnwy (mgr.34427) 9251 : cluster [DBG] pgmap v5268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:22.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:22 gibba013 bash[29418]: cluster 2021-03-10T16:48:22.105630+0000 mgr.gibba020.yqfnwy (mgr.34427) 9252 : cluster [DBG] pgmap v5269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:22.627 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:22 gibba013 bash[30381]: cluster 2021-03-10T16:48:22.105630+0000 mgr.gibba020.yqfnwy (mgr.34427) 9252 : cluster [DBG] pgmap v5269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:22.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:22 gibba020 bash[25448]: cluster 2021-03-10T16:48:22.105630+0000 mgr.gibba020.yqfnwy (mgr.34427) 9252 : cluster [DBG] pgmap v5269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:24.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:24 gibba013 bash[29418]: cluster 2021-03-10T16:48:24.107149+0000 mgr.gibba020.yqfnwy (mgr.34427) 9253 : cluster [DBG] pgmap v5270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:24.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:24 gibba013 bash[30381]: cluster 2021-03-10T16:48:24.107149+0000 mgr.gibba020.yqfnwy (mgr.34427) 9253 : cluster [DBG] pgmap v5270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:24.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:24 gibba020 bash[25448]: cluster 2021-03-10T16:48:24.107149+0000 mgr.gibba020.yqfnwy (mgr.34427) 9253 : cluster [DBG] pgmap v5270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:26.127 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:25 gibba013 bash[29418]: cephadm 2021-03-10T16:48:25.058167+0000 mgr.gibba020.yqfnwy (mgr.34427) 9254 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:48:26.127 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:25 gibba013 bash[30381]: cephadm 2021-03-10T16:48:25.058167+0000 mgr.gibba020.yqfnwy (mgr.34427) 9254 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:48:26.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:25 gibba020 bash[25448]: cephadm 2021-03-10T16:48:25.058167+0000 mgr.gibba020.yqfnwy (mgr.34427) 9254 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:48:27.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:26 gibba020 bash[25448]: cluster 2021-03-10T16:48:26.109035+0000 mgr.gibba020.yqfnwy (mgr.34427) 9255 : cluster [DBG] pgmap v5271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:27.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:26 gibba013 bash[29418]: cluster 2021-03-10T16:48:26.109035+0000 mgr.gibba020.yqfnwy (mgr.34427) 9255 : cluster [DBG] pgmap v5271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:27.377 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:26 gibba013 bash[30381]: cluster 2021-03-10T16:48:26.109035+0000 mgr.gibba020.yqfnwy (mgr.34427) 9255 : cluster [DBG] pgmap v5271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:28.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:28 gibba013 bash[29418]: cluster 2021-03-10T16:48:28.110154+0000 mgr.gibba020.yqfnwy (mgr.34427) 9256 : cluster [DBG] pgmap v5272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:28.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:28 gibba013 bash[30381]: cluster 2021-03-10T16:48:28.110154+0000 mgr.gibba020.yqfnwy (mgr.34427) 9256 : cluster [DBG] pgmap v5272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:28.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:28 gibba020 bash[25448]: cluster 2021-03-10T16:48:28.110154+0000 mgr.gibba020.yqfnwy (mgr.34427) 9256 : cluster [DBG] pgmap v5272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:30.095 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:48:30.318 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:48:30.318 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 7m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:48:30.318 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 6m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:48:30.319 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:48:30.319 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:48:30.319 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:48:30.319 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:48:30.320 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:48:30.320 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:48:30.320 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:48:30.320 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:48:30.320 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:48:30.321 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:48:30.321 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:48:30.321 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:48:30.321 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:48:30.322 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:48:30.322 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:48:30.322 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:48:30.322 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (2h) 6m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:48:30.322 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 6m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:48:30.569 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:48:30.569 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:48:30.570 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:48:30.570 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:48:30.570 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:48:30.570 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:48:30.571 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:48:30.571 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:48:30.571 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:48:30.571 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:48:30.572 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:48:30.572 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:48:30.572 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:48:30.572 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:48:30.572 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:48:31.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:30 gibba020 bash[25448]: audit 2021-03-10T16:48:30.087670+0000 mgr.gibba020.yqfnwy (mgr.34427) 9257 : audit [DBG] from='client.50262 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:48:31.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:30 gibba020 bash[25448]: cluster 2021-03-10T16:48:30.112178+0000 mgr.gibba020.yqfnwy (mgr.34427) 9258 : cluster [DBG] pgmap v5273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:31.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:30 gibba020 bash[25448]: audit 2021-03-10T16:48:30.571302+0000 mon.a (mon.0) 3353 : audit [DBG] from='client.? 172.21.2.113:0/2448584852' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:31.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:30 gibba013 bash[29418]: audit 2021-03-10T16:48:30.087670+0000 mgr.gibba020.yqfnwy (mgr.34427) 9257 : audit [DBG] from='client.50262 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:48:31.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:30 gibba013 bash[29418]: cluster 2021-03-10T16:48:30.112178+0000 mgr.gibba020.yqfnwy (mgr.34427) 9258 : cluster [DBG] pgmap v5273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:31.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:30 gibba013 bash[29418]: audit 2021-03-10T16:48:30.571302+0000 mon.a (mon.0) 3353 : audit [DBG] from='client.? 172.21.2.113:0/2448584852' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:31.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:30 gibba013 bash[30381]: audit 2021-03-10T16:48:30.087670+0000 mgr.gibba020.yqfnwy (mgr.34427) 9257 : audit [DBG] from='client.50262 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:48:31.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:30 gibba013 bash[30381]: cluster 2021-03-10T16:48:30.112178+0000 mgr.gibba020.yqfnwy (mgr.34427) 9258 : cluster [DBG] pgmap v5273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:31.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:30 gibba013 bash[30381]: audit 2021-03-10T16:48:30.571302+0000 mon.a (mon.0) 3353 : audit [DBG] from='client.? 172.21.2.113:0/2448584852' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:32.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:31 gibba020 bash[25448]: audit 2021-03-10T16:48:30.309107+0000 mgr.gibba020.yqfnwy (mgr.34427) 9259 : audit [DBG] from='client.50268 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:48:32.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:31 gibba013 bash[29418]: audit 2021-03-10T16:48:30.309107+0000 mgr.gibba020.yqfnwy (mgr.34427) 9259 : audit [DBG] from='client.50268 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:48:32.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:31 gibba013 bash[30381]: audit 2021-03-10T16:48:30.309107+0000 mgr.gibba020.yqfnwy (mgr.34427) 9259 : audit [DBG] from='client.50268 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:48:33.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:32 gibba020 bash[25448]: cluster 2021-03-10T16:48:32.113764+0000 mgr.gibba020.yqfnwy (mgr.34427) 9260 : cluster [DBG] pgmap v5274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:33.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:32 gibba013 bash[29418]: cluster 2021-03-10T16:48:32.113764+0000 mgr.gibba020.yqfnwy (mgr.34427) 9260 : cluster [DBG] pgmap v5274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:33.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:32 gibba013 bash[30381]: cluster 2021-03-10T16:48:32.113764+0000 mgr.gibba020.yqfnwy (mgr.34427) 9260 : cluster [DBG] pgmap v5274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:34.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:34 gibba013 bash[29418]: cluster 2021-03-10T16:48:34.115637+0000 mgr.gibba020.yqfnwy (mgr.34427) 9261 : cluster [DBG] pgmap v5275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:34.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:34 gibba013 bash[30381]: cluster 2021-03-10T16:48:34.115637+0000 mgr.gibba020.yqfnwy (mgr.34427) 9261 : cluster [DBG] pgmap v5275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:34.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:34 gibba020 bash[25448]: cluster 2021-03-10T16:48:34.115637+0000 mgr.gibba020.yqfnwy (mgr.34427) 9261 : cluster [DBG] pgmap v5275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:36.626 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:36 gibba013 bash[29418]: cluster 2021-03-10T16:48:36.117578+0000 mgr.gibba020.yqfnwy (mgr.34427) 9262 : cluster [DBG] pgmap v5276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:36.627 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:36 gibba013 bash[30381]: cluster 2021-03-10T16:48:36.117578+0000 mgr.gibba020.yqfnwy (mgr.34427) 9262 : cluster [DBG] pgmap v5276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:36.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:36 gibba020 bash[25448]: cluster 2021-03-10T16:48:36.117578+0000 mgr.gibba020.yqfnwy (mgr.34427) 9262 : cluster [DBG] pgmap v5276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:38.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:38 gibba013 bash[29418]: cluster 2021-03-10T16:48:38.118977+0000 mgr.gibba020.yqfnwy (mgr.34427) 9263 : cluster [DBG] pgmap v5277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:38.627 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:38 gibba013 bash[30381]: cluster 2021-03-10T16:48:38.118977+0000 mgr.gibba020.yqfnwy (mgr.34427) 9263 : cluster [DBG] pgmap v5277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:38.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:38 gibba020 bash[25448]: cluster 2021-03-10T16:48:38.118977+0000 mgr.gibba020.yqfnwy (mgr.34427) 9263 : cluster [DBG] pgmap v5277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:41.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:40 gibba020 bash[25448]: cephadm 2021-03-10T16:48:40.073898+0000 mgr.gibba020.yqfnwy (mgr.34427) 9264 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:48:41.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:40 gibba020 bash[25448]: cluster 2021-03-10T16:48:40.120813+0000 mgr.gibba020.yqfnwy (mgr.34427) 9265 : cluster [DBG] pgmap v5278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:41.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:40 gibba013 bash[29418]: cephadm 2021-03-10T16:48:40.073898+0000 mgr.gibba020.yqfnwy (mgr.34427) 9264 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:48:41.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:40 gibba013 bash[29418]: cluster 2021-03-10T16:48:40.120813+0000 mgr.gibba020.yqfnwy (mgr.34427) 9265 : cluster [DBG] pgmap v5278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:41.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:40 gibba013 bash[30381]: cephadm 2021-03-10T16:48:40.073898+0000 mgr.gibba020.yqfnwy (mgr.34427) 9264 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:48:41.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:40 gibba013 bash[30381]: cluster 2021-03-10T16:48:40.120813+0000 mgr.gibba020.yqfnwy (mgr.34427) 9265 : cluster [DBG] pgmap v5278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:42.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:42 gibba013 bash[29418]: cluster 2021-03-10T16:48:42.122400+0000 mgr.gibba020.yqfnwy (mgr.34427) 9266 : cluster [DBG] pgmap v5279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:42.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:42 gibba013 bash[30381]: cluster 2021-03-10T16:48:42.122400+0000 mgr.gibba020.yqfnwy (mgr.34427) 9266 : cluster [DBG] pgmap v5279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:42.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:42 gibba020 bash[25448]: cluster 2021-03-10T16:48:42.122400+0000 mgr.gibba020.yqfnwy (mgr.34427) 9266 : cluster [DBG] pgmap v5279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:43.445 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 16:48:43 gibba020 bash[19712]: level=info ts=2021-03-10T16:48:43.091Z caller=compact.go:507 component=tsdb msg="write block" mint=1615384121606 maxt=1615384800000 ulid=01F0EGMRHZJN9JYN5AC8VQ0SQN duration=19.491664ms 2021-03-10T16:48:43.446 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 16:48:43 gibba020 bash[19712]: level=info ts=2021-03-10T16:48:43.092Z caller=head.go:847 component=tsdb msg="Head GC completed" duration=1.153444ms 2021-03-10T16:48:44.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:44 gibba013 bash[29418]: cluster 2021-03-10T16:48:44.124097+0000 mgr.gibba020.yqfnwy (mgr.34427) 9267 : cluster [DBG] pgmap v5280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:44.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:44 gibba013 bash[30381]: cluster 2021-03-10T16:48:44.124097+0000 mgr.gibba020.yqfnwy (mgr.34427) 9267 : cluster [DBG] pgmap v5280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:44.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:44 gibba020 bash[25448]: cluster 2021-03-10T16:48:44.124097+0000 mgr.gibba020.yqfnwy (mgr.34427) 9267 : cluster [DBG] pgmap v5280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:46.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:46 gibba013 bash[29418]: cluster 2021-03-10T16:48:46.125955+0000 mgr.gibba020.yqfnwy (mgr.34427) 9268 : cluster [DBG] pgmap v5281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:46.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:46 gibba013 bash[30381]: cluster 2021-03-10T16:48:46.125955+0000 mgr.gibba020.yqfnwy (mgr.34427) 9268 : cluster [DBG] pgmap v5281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:46.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:46 gibba020 bash[25448]: cluster 2021-03-10T16:48:46.125955+0000 mgr.gibba020.yqfnwy (mgr.34427) 9268 : cluster [DBG] pgmap v5281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:48.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:48 gibba013 bash[29418]: cluster 2021-03-10T16:48:48.127222+0000 mgr.gibba020.yqfnwy (mgr.34427) 9269 : cluster [DBG] pgmap v5282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:48.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:48 gibba013 bash[30381]: cluster 2021-03-10T16:48:48.127222+0000 mgr.gibba020.yqfnwy (mgr.34427) 9269 : cluster [DBG] pgmap v5282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:48.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:48 gibba020 bash[25448]: cluster 2021-03-10T16:48:48.127222+0000 mgr.gibba020.yqfnwy (mgr.34427) 9269 : cluster [DBG] pgmap v5282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:51.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:50 gibba020 bash[25448]: cluster 2021-03-10T16:48:50.128847+0000 mgr.gibba020.yqfnwy (mgr.34427) 9270 : cluster [DBG] pgmap v5283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:51.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:50 gibba013 bash[29418]: cluster 2021-03-10T16:48:50.128847+0000 mgr.gibba020.yqfnwy (mgr.34427) 9270 : cluster [DBG] pgmap v5283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:51.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:50 gibba013 bash[30381]: cluster 2021-03-10T16:48:50.128847+0000 mgr.gibba020.yqfnwy (mgr.34427) 9270 : cluster [DBG] pgmap v5283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:52.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:52 gibba013 bash[29418]: cluster 2021-03-10T16:48:52.130288+0000 mgr.gibba020.yqfnwy (mgr.34427) 9271 : cluster [DBG] pgmap v5284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:52.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:52 gibba013 bash[30381]: cluster 2021-03-10T16:48:52.130288+0000 mgr.gibba020.yqfnwy (mgr.34427) 9271 : cluster [DBG] pgmap v5284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:52.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:52 gibba020 bash[25448]: cluster 2021-03-10T16:48:52.130288+0000 mgr.gibba020.yqfnwy (mgr.34427) 9271 : cluster [DBG] pgmap v5284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:54.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:54 gibba013 bash[29418]: cluster 2021-03-10T16:48:54.132090+0000 mgr.gibba020.yqfnwy (mgr.34427) 9272 : cluster [DBG] pgmap v5285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:54.627 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:54 gibba013 bash[30381]: cluster 2021-03-10T16:48:54.132090+0000 mgr.gibba020.yqfnwy (mgr.34427) 9272 : cluster [DBG] pgmap v5285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:54.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:54 gibba020 bash[25448]: cluster 2021-03-10T16:48:54.132090+0000 mgr.gibba020.yqfnwy (mgr.34427) 9272 : cluster [DBG] pgmap v5285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:56.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:55 gibba020 bash[25448]: audit 2021-03-10T16:48:55.091263+0000 mon.a (mon.0) 3354 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:48:56.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:55 gibba020 bash[25448]: cephadm 2021-03-10T16:48:55.095914+0000 mgr.gibba020.yqfnwy (mgr.34427) 9273 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:48:56.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:55 gibba020 bash[25448]: cephadm 2021-03-10T16:48:55.097792+0000 mgr.gibba020.yqfnwy (mgr.34427) 9274 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:48:56.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:55 gibba020 bash[25448]: audit 2021-03-10T16:48:55.308387+0000 mon.a (mon.0) 3355 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:48:56.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:55 gibba020 bash[25448]: audit 2021-03-10T16:48:55.311519+0000 mon.a (mon.0) 3356 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:48:56.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:55 gibba020 bash[25448]: audit 2021-03-10T16:48:55.313060+0000 mon.a (mon.0) 3357 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:56.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:55 gibba020 bash[25448]: audit 2021-03-10T16:48:55.314326+0000 mon.a (mon.0) 3358 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:56.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:55 gibba020 bash[25448]: audit 2021-03-10T16:48:55.315591+0000 mon.a (mon.0) 3359 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:56.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:55 gibba020 bash[25448]: audit 2021-03-10T16:48:55.318289+0000 mon.a (mon.0) 3360 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:56.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:55 gibba020 bash[25448]: audit 2021-03-10T16:48:55.319888+0000 mon.a (mon.0) 3361 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:56.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:55 gibba013 bash[29418]: audit 2021-03-10T16:48:55.091263+0000 mon.a (mon.0) 3354 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:48:56.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:55 gibba013 bash[29418]: cephadm 2021-03-10T16:48:55.095914+0000 mgr.gibba020.yqfnwy (mgr.34427) 9273 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:48:56.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:55 gibba013 bash[29418]: cephadm 2021-03-10T16:48:55.097792+0000 mgr.gibba020.yqfnwy (mgr.34427) 9274 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:48:56.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:55 gibba013 bash[29418]: audit 2021-03-10T16:48:55.308387+0000 mon.a (mon.0) 3355 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:48:56.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:55 gibba013 bash[29418]: audit 2021-03-10T16:48:55.311519+0000 mon.a (mon.0) 3356 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:48:56.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:55 gibba013 bash[29418]: audit 2021-03-10T16:48:55.313060+0000 mon.a (mon.0) 3357 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:56.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:55 gibba013 bash[29418]: audit 2021-03-10T16:48:55.314326+0000 mon.a (mon.0) 3358 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:56.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:55 gibba013 bash[29418]: audit 2021-03-10T16:48:55.315591+0000 mon.a (mon.0) 3359 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:56.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:55 gibba013 bash[29418]: audit 2021-03-10T16:48:55.318289+0000 mon.a (mon.0) 3360 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:56.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:55 gibba013 bash[29418]: audit 2021-03-10T16:48:55.319888+0000 mon.a (mon.0) 3361 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:56.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:55 gibba013 bash[30381]: audit 2021-03-10T16:48:55.091263+0000 mon.a (mon.0) 3354 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:48:56.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:55 gibba013 bash[30381]: cephadm 2021-03-10T16:48:55.095914+0000 mgr.gibba020.yqfnwy (mgr.34427) 9273 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:48:56.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:55 gibba013 bash[30381]: cephadm 2021-03-10T16:48:55.097792+0000 mgr.gibba020.yqfnwy (mgr.34427) 9274 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:48:56.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:55 gibba013 bash[30381]: audit 2021-03-10T16:48:55.308387+0000 mon.a (mon.0) 3355 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:48:56.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:55 gibba013 bash[30381]: audit 2021-03-10T16:48:55.311519+0000 mon.a (mon.0) 3356 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:48:56.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:55 gibba013 bash[30381]: audit 2021-03-10T16:48:55.313060+0000 mon.a (mon.0) 3357 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:56.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:55 gibba013 bash[30381]: audit 2021-03-10T16:48:55.314326+0000 mon.a (mon.0) 3358 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:56.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:55 gibba013 bash[30381]: audit 2021-03-10T16:48:55.315591+0000 mon.a (mon.0) 3359 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:56.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:55 gibba013 bash[30381]: audit 2021-03-10T16:48:55.318289+0000 mon.a (mon.0) 3360 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:56.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:55 gibba013 bash[30381]: audit 2021-03-10T16:48:55.319888+0000 mon.a (mon.0) 3361 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:48:57.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:56 gibba020 bash[25448]: cephadm 2021-03-10T16:48:55.310348+0000 mgr.gibba020.yqfnwy (mgr.34427) 9275 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:48:57.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:56 gibba020 bash[25448]: cephadm 2021-03-10T16:48:55.312112+0000 mgr.gibba020.yqfnwy (mgr.34427) 9276 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:48:57.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:56 gibba020 bash[25448]: cephadm 2021-03-10T16:48:55.313314+0000 mgr.gibba020.yqfnwy (mgr.34427) 9277 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:48:57.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:56 gibba020 bash[25448]: cephadm 2021-03-10T16:48:55.313352+0000 mgr.gibba020.yqfnwy (mgr.34427) 9278 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:48:57.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:56 gibba020 bash[25448]: cephadm 2021-03-10T16:48:55.314657+0000 mgr.gibba020.yqfnwy (mgr.34427) 9279 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:48:57.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:56 gibba020 bash[25448]: cephadm 2021-03-10T16:48:55.314694+0000 mgr.gibba020.yqfnwy (mgr.34427) 9280 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:48:57.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:56 gibba020 bash[25448]: cephadm 2021-03-10T16:48:55.315917+0000 mgr.gibba020.yqfnwy (mgr.34427) 9281 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:48:57.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:56 gibba020 bash[25448]: cephadm 2021-03-10T16:48:55.317193+0000 mgr.gibba020.yqfnwy (mgr.34427) 9282 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:48:57.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:56 gibba020 bash[25448]: cephadm 2021-03-10T16:48:55.317227+0000 mgr.gibba020.yqfnwy (mgr.34427) 9283 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:48:57.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:56 gibba020 bash[25448]: cephadm 2021-03-10T16:48:55.318661+0000 mgr.gibba020.yqfnwy (mgr.34427) 9284 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:48:57.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:56 gibba020 bash[25448]: cephadm 2021-03-10T16:48:55.318975+0000 mgr.gibba020.yqfnwy (mgr.34427) 9285 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:48:57.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:56 gibba020 bash[25448]: cephadm 2021-03-10T16:48:55.320287+0000 mgr.gibba020.yqfnwy (mgr.34427) 9286 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:48:57.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:56 gibba020 bash[25448]: cephadm 2021-03-10T16:48:55.320325+0000 mgr.gibba020.yqfnwy (mgr.34427) 9287 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:48:57.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:56 gibba020 bash[25448]: cephadm 2021-03-10T16:48:55.320428+0000 mgr.gibba020.yqfnwy (mgr.34427) 9288 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:48:57.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:56 gibba020 bash[25448]: cluster 2021-03-10T16:48:56.133740+0000 mgr.gibba020.yqfnwy (mgr.34427) 9289 : cluster [DBG] pgmap v5286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:57.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:56 gibba013 bash[29418]: cephadm 2021-03-10T16:48:55.310348+0000 mgr.gibba020.yqfnwy (mgr.34427) 9275 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:48:57.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:56 gibba013 bash[29418]: cephadm 2021-03-10T16:48:55.312112+0000 mgr.gibba020.yqfnwy (mgr.34427) 9276 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:48:57.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:56 gibba013 bash[29418]: cephadm 2021-03-10T16:48:55.313314+0000 mgr.gibba020.yqfnwy (mgr.34427) 9277 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:48:57.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:56 gibba013 bash[29418]: cephadm 2021-03-10T16:48:55.313352+0000 mgr.gibba020.yqfnwy (mgr.34427) 9278 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:48:57.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:56 gibba013 bash[29418]: cephadm 2021-03-10T16:48:55.314657+0000 mgr.gibba020.yqfnwy (mgr.34427) 9279 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:48:57.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:56 gibba013 bash[29418]: cephadm 2021-03-10T16:48:55.314694+0000 mgr.gibba020.yqfnwy (mgr.34427) 9280 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:48:57.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:56 gibba013 bash[29418]: cephadm 2021-03-10T16:48:55.315917+0000 mgr.gibba020.yqfnwy (mgr.34427) 9281 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:48:57.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:56 gibba013 bash[29418]: cephadm 2021-03-10T16:48:55.317193+0000 mgr.gibba020.yqfnwy (mgr.34427) 9282 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:48:57.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:56 gibba013 bash[29418]: cephadm 2021-03-10T16:48:55.317227+0000 mgr.gibba020.yqfnwy (mgr.34427) 9283 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:48:57.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:56 gibba013 bash[29418]: cephadm 2021-03-10T16:48:55.318661+0000 mgr.gibba020.yqfnwy (mgr.34427) 9284 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:48:57.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:56 gibba013 bash[29418]: cephadm 2021-03-10T16:48:55.318975+0000 mgr.gibba020.yqfnwy (mgr.34427) 9285 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:48:57.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:56 gibba013 bash[29418]: cephadm 2021-03-10T16:48:55.320287+0000 mgr.gibba020.yqfnwy (mgr.34427) 9286 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:48:57.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:56 gibba013 bash[29418]: cephadm 2021-03-10T16:48:55.320325+0000 mgr.gibba020.yqfnwy (mgr.34427) 9287 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:48:57.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:56 gibba013 bash[29418]: cephadm 2021-03-10T16:48:55.320428+0000 mgr.gibba020.yqfnwy (mgr.34427) 9288 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:48:57.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:56 gibba013 bash[29418]: cluster 2021-03-10T16:48:56.133740+0000 mgr.gibba020.yqfnwy (mgr.34427) 9289 : cluster [DBG] pgmap v5286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:57.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:56 gibba013 bash[30381]: cephadm 2021-03-10T16:48:55.310348+0000 mgr.gibba020.yqfnwy (mgr.34427) 9275 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:48:57.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:56 gibba013 bash[30381]: cephadm 2021-03-10T16:48:55.312112+0000 mgr.gibba020.yqfnwy (mgr.34427) 9276 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:48:57.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:56 gibba013 bash[30381]: cephadm 2021-03-10T16:48:55.313314+0000 mgr.gibba020.yqfnwy (mgr.34427) 9277 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:48:57.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:56 gibba013 bash[30381]: cephadm 2021-03-10T16:48:55.313352+0000 mgr.gibba020.yqfnwy (mgr.34427) 9278 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:48:57.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:56 gibba013 bash[30381]: cephadm 2021-03-10T16:48:55.314657+0000 mgr.gibba020.yqfnwy (mgr.34427) 9279 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:48:57.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:56 gibba013 bash[30381]: cephadm 2021-03-10T16:48:55.314694+0000 mgr.gibba020.yqfnwy (mgr.34427) 9280 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:48:57.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:56 gibba013 bash[30381]: cephadm 2021-03-10T16:48:55.315917+0000 mgr.gibba020.yqfnwy (mgr.34427) 9281 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:48:57.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:56 gibba013 bash[30381]: cephadm 2021-03-10T16:48:55.317193+0000 mgr.gibba020.yqfnwy (mgr.34427) 9282 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:48:57.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:56 gibba013 bash[30381]: cephadm 2021-03-10T16:48:55.317227+0000 mgr.gibba020.yqfnwy (mgr.34427) 9283 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:48:57.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:56 gibba013 bash[30381]: cephadm 2021-03-10T16:48:55.318661+0000 mgr.gibba020.yqfnwy (mgr.34427) 9284 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:48:57.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:56 gibba013 bash[30381]: cephadm 2021-03-10T16:48:55.318975+0000 mgr.gibba020.yqfnwy (mgr.34427) 9285 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:48:57.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:56 gibba013 bash[30381]: cephadm 2021-03-10T16:48:55.320287+0000 mgr.gibba020.yqfnwy (mgr.34427) 9286 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:48:57.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:56 gibba013 bash[30381]: cephadm 2021-03-10T16:48:55.320325+0000 mgr.gibba020.yqfnwy (mgr.34427) 9287 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:48:57.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:56 gibba013 bash[30381]: cephadm 2021-03-10T16:48:55.320428+0000 mgr.gibba020.yqfnwy (mgr.34427) 9288 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:48:57.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:56 gibba013 bash[30381]: cluster 2021-03-10T16:48:56.133740+0000 mgr.gibba020.yqfnwy (mgr.34427) 9289 : cluster [DBG] pgmap v5286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:58.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:48:58 gibba013 bash[29418]: cluster 2021-03-10T16:48:58.135160+0000 mgr.gibba020.yqfnwy (mgr.34427) 9290 : cluster [DBG] pgmap v5287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:58.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:48:58 gibba013 bash[30381]: cluster 2021-03-10T16:48:58.135160+0000 mgr.gibba020.yqfnwy (mgr.34427) 9290 : cluster [DBG] pgmap v5287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:48:58.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:48:58 gibba020 bash[25448]: cluster 2021-03-10T16:48:58.135160+0000 mgr.gibba020.yqfnwy (mgr.34427) 9290 : cluster [DBG] pgmap v5287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:00.812 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:49:01.041 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:49:01.042 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 8m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:49:01.042 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 7m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:49:01.042 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:49:01.043 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:49:01.043 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:49:01.043 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:49:01.044 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:49:01.044 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:49:01.044 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:49:01.045 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:49:01.045 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:49:01.045 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:49:01.045 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:49:01.046 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:49:01.046 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:49:01.047 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:49:01.047 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:49:01.047 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:49:01.048 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 7m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:49:01.048 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 7m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:49:01.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:00 gibba020 bash[25448]: cluster 2021-03-10T16:49:00.137033+0000 mgr.gibba020.yqfnwy (mgr.34427) 9291 : cluster [DBG] pgmap v5288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:01.290 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:49:01.291 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:49:01.291 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:49:01.291 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:49:01.291 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:49:01.292 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:49:01.292 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:49:01.292 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:49:01.293 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:49:01.293 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:49:01.293 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:49:01.293 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:49:01.294 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:49:01.294 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:49:01.294 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:49:01.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:00 gibba013 bash[29418]: cluster 2021-03-10T16:49:00.137033+0000 mgr.gibba020.yqfnwy (mgr.34427) 9291 : cluster [DBG] pgmap v5288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:01.377 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:00 gibba013 bash[30381]: cluster 2021-03-10T16:49:00.137033+0000 mgr.gibba020.yqfnwy (mgr.34427) 9291 : cluster [DBG] pgmap v5288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:02.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:01 gibba020 bash[25448]: audit 2021-03-10T16:49:00.804156+0000 mgr.gibba020.yqfnwy (mgr.34427) 9292 : audit [DBG] from='client.60262 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:49:02.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:01 gibba020 bash[25448]: audit 2021-03-10T16:49:01.032477+0000 mgr.gibba020.yqfnwy (mgr.34427) 9293 : audit [DBG] from='client.50286 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:49:02.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:01 gibba020 bash[25448]: audit 2021-03-10T16:49:01.292084+0000 mon.a (mon.0) 3362 : audit [DBG] from='client.? 172.21.2.113:0/104258321' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:02.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:01 gibba013 bash[29418]: audit 2021-03-10T16:49:00.804156+0000 mgr.gibba020.yqfnwy (mgr.34427) 9292 : audit [DBG] from='client.60262 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:49:02.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:01 gibba013 bash[29418]: audit 2021-03-10T16:49:01.032477+0000 mgr.gibba020.yqfnwy (mgr.34427) 9293 : audit [DBG] from='client.50286 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:49:02.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:01 gibba013 bash[29418]: audit 2021-03-10T16:49:01.292084+0000 mon.a (mon.0) 3362 : audit [DBG] from='client.? 172.21.2.113:0/104258321' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:02.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:01 gibba013 bash[30381]: audit 2021-03-10T16:49:00.804156+0000 mgr.gibba020.yqfnwy (mgr.34427) 9292 : audit [DBG] from='client.60262 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:49:02.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:01 gibba013 bash[30381]: audit 2021-03-10T16:49:01.032477+0000 mgr.gibba020.yqfnwy (mgr.34427) 9293 : audit [DBG] from='client.50286 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:49:02.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:01 gibba013 bash[30381]: audit 2021-03-10T16:49:01.292084+0000 mon.a (mon.0) 3362 : audit [DBG] from='client.? 172.21.2.113:0/104258321' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:03.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:02 gibba020 bash[25448]: cluster 2021-03-10T16:49:02.138197+0000 mgr.gibba020.yqfnwy (mgr.34427) 9294 : cluster [DBG] pgmap v5289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:03.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:02 gibba013 bash[29418]: cluster 2021-03-10T16:49:02.138197+0000 mgr.gibba020.yqfnwy (mgr.34427) 9294 : cluster [DBG] pgmap v5289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:03.377 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:02 gibba013 bash[30381]: cluster 2021-03-10T16:49:02.138197+0000 mgr.gibba020.yqfnwy (mgr.34427) 9294 : cluster [DBG] pgmap v5289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:04.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:04 gibba013 bash[29418]: cluster 2021-03-10T16:49:04.139891+0000 mgr.gibba020.yqfnwy (mgr.34427) 9295 : cluster [DBG] pgmap v5290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:04.627 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:04 gibba013 bash[30381]: cluster 2021-03-10T16:49:04.139891+0000 mgr.gibba020.yqfnwy (mgr.34427) 9295 : cluster [DBG] pgmap v5290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:04.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:04 gibba020 bash[25448]: cluster 2021-03-10T16:49:04.139891+0000 mgr.gibba020.yqfnwy (mgr.34427) 9295 : cluster [DBG] pgmap v5290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:06.626 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:06 gibba013 bash[29418]: cluster 2021-03-10T16:49:06.141469+0000 mgr.gibba020.yqfnwy (mgr.34427) 9296 : cluster [DBG] pgmap v5291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:06.627 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:06 gibba013 bash[30381]: cluster 2021-03-10T16:49:06.141469+0000 mgr.gibba020.yqfnwy (mgr.34427) 9296 : cluster [DBG] pgmap v5291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:06.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:06 gibba020 bash[25448]: cluster 2021-03-10T16:49:06.141469+0000 mgr.gibba020.yqfnwy (mgr.34427) 9296 : cluster [DBG] pgmap v5291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:07.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:07 gibba013 bash[29418]: audit 2021-03-10T16:49:06.806952+0000 mon.a (mon.0) 3363 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:49:07.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:07 gibba013 bash[29418]: audit 2021-03-10T16:49:06.983147+0000 mon.a (mon.0) 3364 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:49:07.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:07 gibba013 bash[30381]: audit 2021-03-10T16:49:06.806952+0000 mon.a (mon.0) 3363 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:49:07.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:07 gibba013 bash[30381]: audit 2021-03-10T16:49:06.983147+0000 mon.a (mon.0) 3364 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:49:07.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:07 gibba020 bash[25448]: audit 2021-03-10T16:49:06.806952+0000 mon.a (mon.0) 3363 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:49:07.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:07 gibba020 bash[25448]: audit 2021-03-10T16:49:06.983147+0000 mon.a (mon.0) 3364 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:49:08.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:08 gibba013 bash[29418]: audit 2021-03-10T16:49:07.351069+0000 mon.a (mon.0) 3365 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:49:08.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:08 gibba013 bash[29418]: audit 2021-03-10T16:49:07.351894+0000 mon.a (mon.0) 3366 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:49:08.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:08 gibba013 bash[29418]: audit 2021-03-10T16:49:07.352559+0000 mon.a (mon.0) 3367 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T16:49:08.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:08 gibba013 bash[29418]: audit 2021-03-10T16:49:07.353203+0000 mon.a (mon.0) 3368 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:49:08.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:08 gibba013 bash[29418]: cluster 2021-03-10T16:49:08.142755+0000 mgr.gibba020.yqfnwy (mgr.34427) 9297 : cluster [DBG] pgmap v5292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:08.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:08 gibba013 bash[30381]: audit 2021-03-10T16:49:07.351069+0000 mon.a (mon.0) 3365 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:49:08.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:08 gibba013 bash[30381]: audit 2021-03-10T16:49:07.351894+0000 mon.a (mon.0) 3366 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:49:08.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:08 gibba013 bash[30381]: audit 2021-03-10T16:49:07.352559+0000 mon.a (mon.0) 3367 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T16:49:08.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:08 gibba013 bash[30381]: audit 2021-03-10T16:49:07.353203+0000 mon.a (mon.0) 3368 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:49:08.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:08 gibba013 bash[30381]: cluster 2021-03-10T16:49:08.142755+0000 mgr.gibba020.yqfnwy (mgr.34427) 9297 : cluster [DBG] pgmap v5292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:08.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:08 gibba020 bash[25448]: audit 2021-03-10T16:49:07.351069+0000 mon.a (mon.0) 3365 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:49:08.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:08 gibba020 bash[25448]: audit 2021-03-10T16:49:07.351894+0000 mon.a (mon.0) 3366 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T16:49:08.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:08 gibba020 bash[25448]: audit 2021-03-10T16:49:07.352559+0000 mon.a (mon.0) 3367 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 5]}]: dispatch 2021-03-10T16:49:08.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:08 gibba020 bash[25448]: audit 2021-03-10T16:49:07.353203+0000 mon.a (mon.0) 3368 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:49:08.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:08 gibba020 bash[25448]: cluster 2021-03-10T16:49:08.142755+0000 mgr.gibba020.yqfnwy (mgr.34427) 9297 : cluster [DBG] pgmap v5292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:11.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:10 gibba020 bash[25448]: cluster 2021-03-10T16:49:10.144604+0000 mgr.gibba020.yqfnwy (mgr.34427) 9298 : cluster [DBG] pgmap v5293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:11.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:10 gibba013 bash[29418]: cluster 2021-03-10T16:49:10.144604+0000 mgr.gibba020.yqfnwy (mgr.34427) 9298 : cluster [DBG] pgmap v5293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:11.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:10 gibba013 bash[30381]: cluster 2021-03-10T16:49:10.144604+0000 mgr.gibba020.yqfnwy (mgr.34427) 9298 : cluster [DBG] pgmap v5293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:12.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:11 gibba020 bash[25448]: cephadm 2021-03-10T16:49:10.325846+0000 mgr.gibba020.yqfnwy (mgr.34427) 9299 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:49:12.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:11 gibba013 bash[29418]: cephadm 2021-03-10T16:49:10.325846+0000 mgr.gibba020.yqfnwy (mgr.34427) 9299 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:49:12.377 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:11 gibba013 bash[30381]: cephadm 2021-03-10T16:49:10.325846+0000 mgr.gibba020.yqfnwy (mgr.34427) 9299 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:49:13.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:12 gibba020 bash[25448]: cluster 2021-03-10T16:49:12.145854+0000 mgr.gibba020.yqfnwy (mgr.34427) 9300 : cluster [DBG] pgmap v5294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:13.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:12 gibba013 bash[29418]: cluster 2021-03-10T16:49:12.145854+0000 mgr.gibba020.yqfnwy (mgr.34427) 9300 : cluster [DBG] pgmap v5294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:13.377 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:12 gibba013 bash[30381]: cluster 2021-03-10T16:49:12.145854+0000 mgr.gibba020.yqfnwy (mgr.34427) 9300 : cluster [DBG] pgmap v5294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:14.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:14 gibba013 bash[29418]: cluster 2021-03-10T16:49:14.147304+0000 mgr.gibba020.yqfnwy (mgr.34427) 9301 : cluster [DBG] pgmap v5295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:14.627 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:14 gibba013 bash[30381]: cluster 2021-03-10T16:49:14.147304+0000 mgr.gibba020.yqfnwy (mgr.34427) 9301 : cluster [DBG] pgmap v5295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:14.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:14 gibba020 bash[25448]: cluster 2021-03-10T16:49:14.147304+0000 mgr.gibba020.yqfnwy (mgr.34427) 9301 : cluster [DBG] pgmap v5295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:16.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:16 gibba013 bash[29418]: cluster 2021-03-10T16:49:16.149178+0000 mgr.gibba020.yqfnwy (mgr.34427) 9302 : cluster [DBG] pgmap v5296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:16.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:16 gibba013 bash[30381]: cluster 2021-03-10T16:49:16.149178+0000 mgr.gibba020.yqfnwy (mgr.34427) 9302 : cluster [DBG] pgmap v5296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:16.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:16 gibba020 bash[25448]: cluster 2021-03-10T16:49:16.149178+0000 mgr.gibba020.yqfnwy (mgr.34427) 9302 : cluster [DBG] pgmap v5296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:18.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:18 gibba013 bash[29418]: cluster 2021-03-10T16:49:18.150556+0000 mgr.gibba020.yqfnwy (mgr.34427) 9303 : cluster [DBG] pgmap v5297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:18.627 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:18 gibba013 bash[30381]: cluster 2021-03-10T16:49:18.150556+0000 mgr.gibba020.yqfnwy (mgr.34427) 9303 : cluster [DBG] pgmap v5297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:18.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:18 gibba020 bash[25448]: cluster 2021-03-10T16:49:18.150556+0000 mgr.gibba020.yqfnwy (mgr.34427) 9303 : cluster [DBG] pgmap v5297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:21.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:20 gibba020 bash[25448]: cluster 2021-03-10T16:49:20.152190+0000 mgr.gibba020.yqfnwy (mgr.34427) 9304 : cluster [DBG] pgmap v5298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:21.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:20 gibba013 bash[29418]: cluster 2021-03-10T16:49:20.152190+0000 mgr.gibba020.yqfnwy (mgr.34427) 9304 : cluster [DBG] pgmap v5298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:21.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:20 gibba013 bash[30381]: cluster 2021-03-10T16:49:20.152190+0000 mgr.gibba020.yqfnwy (mgr.34427) 9304 : cluster [DBG] pgmap v5298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:22.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:22 gibba013 bash[29418]: cluster 2021-03-10T16:49:22.153581+0000 mgr.gibba020.yqfnwy (mgr.34427) 9305 : cluster [DBG] pgmap v5299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:22.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:22 gibba013 bash[30381]: cluster 2021-03-10T16:49:22.153581+0000 mgr.gibba020.yqfnwy (mgr.34427) 9305 : cluster [DBG] pgmap v5299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:22.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:22 gibba020 bash[25448]: cluster 2021-03-10T16:49:22.153581+0000 mgr.gibba020.yqfnwy (mgr.34427) 9305 : cluster [DBG] pgmap v5299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:24.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:24 gibba013 bash[29418]: cluster 2021-03-10T16:49:24.155239+0000 mgr.gibba020.yqfnwy (mgr.34427) 9306 : cluster [DBG] pgmap v5300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:24.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:24 gibba013 bash[30381]: cluster 2021-03-10T16:49:24.155239+0000 mgr.gibba020.yqfnwy (mgr.34427) 9306 : cluster [DBG] pgmap v5300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:24.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:24 gibba020 bash[25448]: cluster 2021-03-10T16:49:24.155239+0000 mgr.gibba020.yqfnwy (mgr.34427) 9306 : cluster [DBG] pgmap v5300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:26.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:26 gibba013 bash[29418]: cephadm 2021-03-10T16:49:25.340724+0000 mgr.gibba020.yqfnwy (mgr.34427) 9307 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:49:26.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:26 gibba013 bash[29418]: cluster 2021-03-10T16:49:26.156203+0000 mgr.gibba020.yqfnwy (mgr.34427) 9308 : cluster [DBG] pgmap v5301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:26.627 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:26 gibba013 bash[30381]: cephadm 2021-03-10T16:49:25.340724+0000 mgr.gibba020.yqfnwy (mgr.34427) 9307 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:49:26.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:26 gibba013 bash[30381]: cluster 2021-03-10T16:49:26.156203+0000 mgr.gibba020.yqfnwy (mgr.34427) 9308 : cluster [DBG] pgmap v5301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:26.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:26 gibba020 bash[25448]: cephadm 2021-03-10T16:49:25.340724+0000 mgr.gibba020.yqfnwy (mgr.34427) 9307 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:49:26.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:26 gibba020 bash[25448]: cluster 2021-03-10T16:49:26.156203+0000 mgr.gibba020.yqfnwy (mgr.34427) 9308 : cluster [DBG] pgmap v5301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:28.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:28 gibba013 bash[29418]: cluster 2021-03-10T16:49:28.157284+0000 mgr.gibba020.yqfnwy (mgr.34427) 9309 : cluster [DBG] pgmap v5302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:28.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:28 gibba013 bash[30381]: cluster 2021-03-10T16:49:28.157284+0000 mgr.gibba020.yqfnwy (mgr.34427) 9309 : cluster [DBG] pgmap v5302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:28.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:28 gibba020 bash[25448]: cluster 2021-03-10T16:49:28.157284+0000 mgr.gibba020.yqfnwy (mgr.34427) 9309 : cluster [DBG] pgmap v5302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:31.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:30 gibba020 bash[25448]: cluster 2021-03-10T16:49:30.159088+0000 mgr.gibba020.yqfnwy (mgr.34427) 9310 : cluster [DBG] pgmap v5303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:31.376 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:30 gibba013 bash[29418]: cluster 2021-03-10T16:49:30.159088+0000 mgr.gibba020.yqfnwy (mgr.34427) 9310 : cluster [DBG] pgmap v5303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:31.377 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:30 gibba013 bash[30381]: cluster 2021-03-10T16:49:30.159088+0000 mgr.gibba020.yqfnwy (mgr.34427) 9310 : cluster [DBG] pgmap v5303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:31.538 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:49:31.773 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:49:31.773 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 8m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:49:31.773 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 7m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:49:31.774 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:49:31.774 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:49:31.774 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:49:31.774 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:49:31.775 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:49:31.775 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:49:31.775 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:49:31.775 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:49:31.775 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:49:31.776 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:49:31.776 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:49:31.776 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:49:31.776 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:49:31.777 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:49:31.777 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:49:31.777 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:49:31.777 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 7m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:49:31.778 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 7m ago 2h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:49:32.024 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:49:32.025 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:49:32.025 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:49:32.025 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:49:32.026 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:49:32.026 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:49:32.026 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:49:32.026 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:49:32.027 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:49:32.027 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:49:32.027 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:49:32.027 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:49:32.028 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:49:32.028 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:49:32.028 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:49:32.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:32 gibba013 bash[29418]: audit 2021-03-10T16:49:32.026681+0000 mon.a (mon.0) 3369 : audit [DBG] from='client.? 172.21.2.113:0/2889168633' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:32.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:32 gibba013 bash[30381]: audit 2021-03-10T16:49:32.026681+0000 mon.a (mon.0) 3369 : audit [DBG] from='client.? 172.21.2.113:0/2889168633' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:32.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:32 gibba020 bash[25448]: audit 2021-03-10T16:49:32.026681+0000 mon.a (mon.0) 3369 : audit [DBG] from='client.? 172.21.2.113:0/2889168633' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:49:33.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:33 gibba013 bash[29418]: audit 2021-03-10T16:49:31.529635+0000 mgr.gibba020.yqfnwy (mgr.34427) 9311 : audit [DBG] from='client.50298 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:49:33.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:33 gibba013 bash[29418]: audit 2021-03-10T16:49:31.762267+0000 mgr.gibba020.yqfnwy (mgr.34427) 9312 : audit [DBG] from='client.60286 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:49:33.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:33 gibba013 bash[29418]: cluster 2021-03-10T16:49:32.160059+0000 mgr.gibba020.yqfnwy (mgr.34427) 9313 : cluster [DBG] pgmap v5304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:33.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:33 gibba013 bash[30381]: audit 2021-03-10T16:49:31.529635+0000 mgr.gibba020.yqfnwy (mgr.34427) 9311 : audit [DBG] from='client.50298 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:49:33.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:33 gibba013 bash[30381]: audit 2021-03-10T16:49:31.762267+0000 mgr.gibba020.yqfnwy (mgr.34427) 9312 : audit [DBG] from='client.60286 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:49:33.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:33 gibba013 bash[30381]: cluster 2021-03-10T16:49:32.160059+0000 mgr.gibba020.yqfnwy (mgr.34427) 9313 : cluster [DBG] pgmap v5304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:33.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:33 gibba020 bash[25448]: audit 2021-03-10T16:49:31.529635+0000 mgr.gibba020.yqfnwy (mgr.34427) 9311 : audit [DBG] from='client.50298 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:49:33.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:33 gibba020 bash[25448]: audit 2021-03-10T16:49:31.762267+0000 mgr.gibba020.yqfnwy (mgr.34427) 9312 : audit [DBG] from='client.60286 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:49:33.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:33 gibba020 bash[25448]: cluster 2021-03-10T16:49:32.160059+0000 mgr.gibba020.yqfnwy (mgr.34427) 9313 : cluster [DBG] pgmap v5304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:34.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:34 gibba013 bash[29418]: cluster 2021-03-10T16:49:34.161350+0000 mgr.gibba020.yqfnwy (mgr.34427) 9314 : cluster [DBG] pgmap v5305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:34.627 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:34 gibba013 bash[30381]: cluster 2021-03-10T16:49:34.161350+0000 mgr.gibba020.yqfnwy (mgr.34427) 9314 : cluster [DBG] pgmap v5305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:34.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:34 gibba020 bash[25448]: cluster 2021-03-10T16:49:34.161350+0000 mgr.gibba020.yqfnwy (mgr.34427) 9314 : cluster [DBG] pgmap v5305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:36.626 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:36 gibba013 bash[29418]: cluster 2021-03-10T16:49:36.163076+0000 mgr.gibba020.yqfnwy (mgr.34427) 9315 : cluster [DBG] pgmap v5306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:36.627 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:36 gibba013 bash[30381]: cluster 2021-03-10T16:49:36.163076+0000 mgr.gibba020.yqfnwy (mgr.34427) 9315 : cluster [DBG] pgmap v5306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:36.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:36 gibba020 bash[25448]: cluster 2021-03-10T16:49:36.163076+0000 mgr.gibba020.yqfnwy (mgr.34427) 9315 : cluster [DBG] pgmap v5306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:38.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:38 gibba013 bash[29418]: cluster 2021-03-10T16:49:38.163543+0000 mgr.gibba020.yqfnwy (mgr.34427) 9316 : cluster [DBG] pgmap v5307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:38.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:38 gibba013 bash[30381]: cluster 2021-03-10T16:49:38.163543+0000 mgr.gibba020.yqfnwy (mgr.34427) 9316 : cluster [DBG] pgmap v5307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:38.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:38 gibba020 bash[25448]: cluster 2021-03-10T16:49:38.163543+0000 mgr.gibba020.yqfnwy (mgr.34427) 9316 : cluster [DBG] pgmap v5307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:41.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:40 gibba020 bash[25448]: cluster 2021-03-10T16:49:40.165262+0000 mgr.gibba020.yqfnwy (mgr.34427) 9317 : cluster [DBG] pgmap v5308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:41.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:40 gibba013 bash[29418]: cluster 2021-03-10T16:49:40.165262+0000 mgr.gibba020.yqfnwy (mgr.34427) 9317 : cluster [DBG] pgmap v5308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:41.377 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:40 gibba013 bash[30381]: cluster 2021-03-10T16:49:40.165262+0000 mgr.gibba020.yqfnwy (mgr.34427) 9317 : cluster [DBG] pgmap v5308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:42.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:41 gibba020 bash[25448]: cephadm 2021-03-10T16:49:40.354287+0000 mgr.gibba020.yqfnwy (mgr.34427) 9318 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:49:42.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:41 gibba013 bash[29418]: cephadm 2021-03-10T16:49:40.354287+0000 mgr.gibba020.yqfnwy (mgr.34427) 9318 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:49:42.377 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:41 gibba013 bash[30381]: cephadm 2021-03-10T16:49:40.354287+0000 mgr.gibba020.yqfnwy (mgr.34427) 9318 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:49:43.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:42 gibba020 bash[25448]: cluster 2021-03-10T16:49:42.166658+0000 mgr.gibba020.yqfnwy (mgr.34427) 9319 : cluster [DBG] pgmap v5309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:43.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:42 gibba013 bash[29418]: cluster 2021-03-10T16:49:42.166658+0000 mgr.gibba020.yqfnwy (mgr.34427) 9319 : cluster [DBG] pgmap v5309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:43.377 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:42 gibba013 bash[30381]: cluster 2021-03-10T16:49:42.166658+0000 mgr.gibba020.yqfnwy (mgr.34427) 9319 : cluster [DBG] pgmap v5309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:44.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:44 gibba013 bash[29418]: cluster 2021-03-10T16:49:44.167426+0000 mgr.gibba020.yqfnwy (mgr.34427) 9320 : cluster [DBG] pgmap v5310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:44.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:44 gibba013 bash[30381]: cluster 2021-03-10T16:49:44.167426+0000 mgr.gibba020.yqfnwy (mgr.34427) 9320 : cluster [DBG] pgmap v5310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:44.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:44 gibba020 bash[25448]: cluster 2021-03-10T16:49:44.167426+0000 mgr.gibba020.yqfnwy (mgr.34427) 9320 : cluster [DBG] pgmap v5310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:46.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:46 gibba013 bash[29418]: cluster 2021-03-10T16:49:46.169154+0000 mgr.gibba020.yqfnwy (mgr.34427) 9321 : cluster [DBG] pgmap v5311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:46.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:46 gibba013 bash[30381]: cluster 2021-03-10T16:49:46.169154+0000 mgr.gibba020.yqfnwy (mgr.34427) 9321 : cluster [DBG] pgmap v5311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:46.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:46 gibba020 bash[25448]: cluster 2021-03-10T16:49:46.169154+0000 mgr.gibba020.yqfnwy (mgr.34427) 9321 : cluster [DBG] pgmap v5311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:48.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:48 gibba013 bash[29418]: cluster 2021-03-10T16:49:48.170523+0000 mgr.gibba020.yqfnwy (mgr.34427) 9322 : cluster [DBG] pgmap v5312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:48.627 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:48 gibba013 bash[30381]: cluster 2021-03-10T16:49:48.170523+0000 mgr.gibba020.yqfnwy (mgr.34427) 9322 : cluster [DBG] pgmap v5312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:48.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:48 gibba020 bash[25448]: cluster 2021-03-10T16:49:48.170523+0000 mgr.gibba020.yqfnwy (mgr.34427) 9322 : cluster [DBG] pgmap v5312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:51.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:50 gibba020 bash[25448]: cluster 2021-03-10T16:49:50.171963+0000 mgr.gibba020.yqfnwy (mgr.34427) 9323 : cluster [DBG] pgmap v5313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:51.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:50 gibba013 bash[29418]: cluster 2021-03-10T16:49:50.171963+0000 mgr.gibba020.yqfnwy (mgr.34427) 9323 : cluster [DBG] pgmap v5313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:51.377 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:50 gibba013 bash[30381]: cluster 2021-03-10T16:49:50.171963+0000 mgr.gibba020.yqfnwy (mgr.34427) 9323 : cluster [DBG] pgmap v5313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:52.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:52 gibba013 bash[29418]: cluster 2021-03-10T16:49:52.173315+0000 mgr.gibba020.yqfnwy (mgr.34427) 9324 : cluster [DBG] pgmap v5314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:52.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:52 gibba013 bash[30381]: cluster 2021-03-10T16:49:52.173315+0000 mgr.gibba020.yqfnwy (mgr.34427) 9324 : cluster [DBG] pgmap v5314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:52.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:52 gibba020 bash[25448]: cluster 2021-03-10T16:49:52.173315+0000 mgr.gibba020.yqfnwy (mgr.34427) 9324 : cluster [DBG] pgmap v5314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:54.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:54 gibba013 bash[29418]: cluster 2021-03-10T16:49:54.174740+0000 mgr.gibba020.yqfnwy (mgr.34427) 9325 : cluster [DBG] pgmap v5315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:54.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:54 gibba013 bash[30381]: cluster 2021-03-10T16:49:54.174740+0000 mgr.gibba020.yqfnwy (mgr.34427) 9325 : cluster [DBG] pgmap v5315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:54.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:54 gibba020 bash[25448]: cluster 2021-03-10T16:49:54.174740+0000 mgr.gibba020.yqfnwy (mgr.34427) 9325 : cluster [DBG] pgmap v5315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:56.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:55 gibba020 bash[25448]: audit 2021-03-10T16:49:55.371306+0000 mon.a (mon.0) 3370 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:49:56.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:55 gibba020 bash[25448]: audit 2021-03-10T16:49:55.378511+0000 mon.a (mon.0) 3371 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T16:49:56.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:55 gibba013 bash[29418]: audit 2021-03-10T16:49:55.371306+0000 mon.a (mon.0) 3370 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:49:56.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:55 gibba013 bash[29418]: audit 2021-03-10T16:49:55.378511+0000 mon.a (mon.0) 3371 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T16:49:56.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:55 gibba013 bash[30381]: audit 2021-03-10T16:49:55.371306+0000 mon.a (mon.0) 3370 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:49:56.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:55 gibba013 bash[30381]: audit 2021-03-10T16:49:55.378511+0000 mon.a (mon.0) 3371 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T16:49:56.979 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:56 gibba013 bash[29418]: cephadm 2021-03-10T16:49:55.377253+0000 mgr.gibba020.yqfnwy (mgr.34427) 9326 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:49:56.980 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:56 gibba013 bash[29418]: cluster 2021-03-10T16:49:56.175559+0000 mgr.gibba020.yqfnwy (mgr.34427) 9327 : cluster [DBG] pgmap v5316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:56.980 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:56 gibba013 bash[30381]: cephadm 2021-03-10T16:49:55.377253+0000 mgr.gibba020.yqfnwy (mgr.34427) 9326 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:49:56.980 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:56 gibba013 bash[30381]: cluster 2021-03-10T16:49:56.175559+0000 mgr.gibba020.yqfnwy (mgr.34427) 9327 : cluster [DBG] pgmap v5316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:57.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:56 gibba020 bash[25448]: cephadm 2021-03-10T16:49:55.377253+0000 mgr.gibba020.yqfnwy (mgr.34427) 9326 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:49:57.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:56 gibba020 bash[25448]: cluster 2021-03-10T16:49:56.175559+0000 mgr.gibba020.yqfnwy (mgr.34427) 9327 : cluster [DBG] pgmap v5316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:58.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:49:58 gibba013 bash[29418]: cluster 2021-03-10T16:49:58.176860+0000 mgr.gibba020.yqfnwy (mgr.34427) 9328 : cluster [DBG] pgmap v5317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:58.627 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:49:58 gibba013 bash[30381]: cluster 2021-03-10T16:49:58.176860+0000 mgr.gibba020.yqfnwy (mgr.34427) 9328 : cluster [DBG] pgmap v5317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:49:58.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:49:58 gibba020 bash[25448]: cluster 2021-03-10T16:49:58.176860+0000 mgr.gibba020.yqfnwy (mgr.34427) 9328 : cluster [DBG] pgmap v5317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:00.376 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:00 gibba013 bash[29418]: debug 2021-03-10T16:49:59.994+0000 7fd718a82700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:50:01.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:00 gibba020 bash[25448]: cluster 2021-03-10T16:50:00.000309+0000 mon.a (mon.0) 3372 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:50:01.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:00 gibba020 bash[25448]: cluster 2021-03-10T16:50:00.178632+0000 mgr.gibba020.yqfnwy (mgr.34427) 9329 : cluster [DBG] pgmap v5318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:01.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:00 gibba020 bash[25448]: audit 2021-03-10T16:50:00.248752+0000 mon.a (mon.0) 3373 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:50:01.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:00 gibba020 bash[25448]: audit 2021-03-10T16:50:00.461795+0000 mon.a (mon.0) 3374 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:50:01.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:00 gibba020 bash[25448]: audit 2021-03-10T16:50:00.656518+0000 mon.a (mon.0) 3375 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:50:01.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:00 gibba020 bash[25448]: audit 2021-03-10T16:50:00.663728+0000 mon.a (mon.0) 3376 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:50:01.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:00 gibba020 bash[25448]: audit 2021-03-10T16:50:00.665697+0000 mon.a (mon.0) 3377 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:01.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:00 gibba020 bash[25448]: audit 2021-03-10T16:50:00.667702+0000 mon.a (mon.0) 3378 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:01.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:00 gibba020 bash[25448]: audit 2021-03-10T16:50:00.669236+0000 mon.a (mon.0) 3379 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:01.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:00 gibba020 bash[25448]: audit 2021-03-10T16:50:00.672420+0000 mon.a (mon.0) 3380 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:01.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:00 gibba020 bash[25448]: audit 2021-03-10T16:50:00.674335+0000 mon.a (mon.0) 3381 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:01.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:00 gibba013 bash[29418]: cluster 2021-03-10T16:50:00.000309+0000 mon.a (mon.0) 3372 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:50:01.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:00 gibba013 bash[29418]: cluster 2021-03-10T16:50:00.178632+0000 mgr.gibba020.yqfnwy (mgr.34427) 9329 : cluster [DBG] pgmap v5318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:01.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:00 gibba013 bash[29418]: audit 2021-03-10T16:50:00.248752+0000 mon.a (mon.0) 3373 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:50:01.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:00 gibba013 bash[29418]: audit 2021-03-10T16:50:00.461795+0000 mon.a (mon.0) 3374 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:50:01.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:00 gibba013 bash[29418]: audit 2021-03-10T16:50:00.656518+0000 mon.a (mon.0) 3375 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:50:01.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:00 gibba013 bash[29418]: audit 2021-03-10T16:50:00.663728+0000 mon.a (mon.0) 3376 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:50:01.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:00 gibba013 bash[29418]: audit 2021-03-10T16:50:00.665697+0000 mon.a (mon.0) 3377 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:01.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:00 gibba013 bash[29418]: audit 2021-03-10T16:50:00.667702+0000 mon.a (mon.0) 3378 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:01.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:00 gibba013 bash[29418]: audit 2021-03-10T16:50:00.669236+0000 mon.a (mon.0) 3379 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:01.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:00 gibba013 bash[29418]: audit 2021-03-10T16:50:00.672420+0000 mon.a (mon.0) 3380 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:01.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:00 gibba013 bash[29418]: audit 2021-03-10T16:50:00.674335+0000 mon.a (mon.0) 3381 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:01.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:00 gibba013 bash[30381]: cluster 2021-03-10T16:50:00.000309+0000 mon.a (mon.0) 3372 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T16:50:01.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:00 gibba013 bash[30381]: cluster 2021-03-10T16:50:00.178632+0000 mgr.gibba020.yqfnwy (mgr.34427) 9329 : cluster [DBG] pgmap v5318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:01.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:00 gibba013 bash[30381]: audit 2021-03-10T16:50:00.248752+0000 mon.a (mon.0) 3373 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:50:01.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:00 gibba013 bash[30381]: audit 2021-03-10T16:50:00.461795+0000 mon.a (mon.0) 3374 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:50:01.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:00 gibba013 bash[30381]: audit 2021-03-10T16:50:00.656518+0000 mon.a (mon.0) 3375 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:50:01.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:00 gibba013 bash[30381]: audit 2021-03-10T16:50:00.663728+0000 mon.a (mon.0) 3376 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:50:01.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:00 gibba013 bash[30381]: audit 2021-03-10T16:50:00.665697+0000 mon.a (mon.0) 3377 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:01.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:00 gibba013 bash[30381]: audit 2021-03-10T16:50:00.667702+0000 mon.a (mon.0) 3378 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:01.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:00 gibba013 bash[30381]: audit 2021-03-10T16:50:00.669236+0000 mon.a (mon.0) 3379 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:01.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:00 gibba013 bash[30381]: audit 2021-03-10T16:50:00.672420+0000 mon.a (mon.0) 3380 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:01.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:00 gibba013 bash[30381]: audit 2021-03-10T16:50:00.674335+0000 mon.a (mon.0) 3381 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:02.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:01 gibba020 bash[25448]: cephadm 2021-03-10T16:50:00.462656+0000 mgr.gibba020.yqfnwy (mgr.34427) 9330 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:50:02.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:01 gibba020 bash[25448]: cephadm 2021-03-10T16:50:00.662146+0000 mgr.gibba020.yqfnwy (mgr.34427) 9331 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:50:02.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:01 gibba020 bash[25448]: cephadm 2021-03-10T16:50:00.664620+0000 mgr.gibba020.yqfnwy (mgr.34427) 9332 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:50:02.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:01 gibba020 bash[25448]: cephadm 2021-03-10T16:50:00.666569+0000 mgr.gibba020.yqfnwy (mgr.34427) 9333 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:50:02.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:01 gibba020 bash[25448]: cephadm 2021-03-10T16:50:00.666608+0000 mgr.gibba020.yqfnwy (mgr.34427) 9334 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:50:02.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:01 gibba020 bash[25448]: cephadm 2021-03-10T16:50:00.668181+0000 mgr.gibba020.yqfnwy (mgr.34427) 9335 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:50:02.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:01 gibba020 bash[25448]: cephadm 2021-03-10T16:50:00.668219+0000 mgr.gibba020.yqfnwy (mgr.34427) 9336 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:50:02.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:01 gibba020 bash[25448]: cephadm 2021-03-10T16:50:00.669722+0000 mgr.gibba020.yqfnwy (mgr.34427) 9337 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:50:02.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:01 gibba020 bash[25448]: cephadm 2021-03-10T16:50:00.671271+0000 mgr.gibba020.yqfnwy (mgr.34427) 9338 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:50:02.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:01 gibba020 bash[25448]: cephadm 2021-03-10T16:50:00.671312+0000 mgr.gibba020.yqfnwy (mgr.34427) 9339 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:50:02.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:01 gibba020 bash[25448]: cephadm 2021-03-10T16:50:00.673062+0000 mgr.gibba020.yqfnwy (mgr.34427) 9340 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:50:02.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:01 gibba020 bash[25448]: cephadm 2021-03-10T16:50:00.673410+0000 mgr.gibba020.yqfnwy (mgr.34427) 9341 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:50:02.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:01 gibba020 bash[25448]: cephadm 2021-03-10T16:50:00.674744+0000 mgr.gibba020.yqfnwy (mgr.34427) 9342 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:50:02.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:01 gibba020 bash[25448]: cephadm 2021-03-10T16:50:00.674790+0000 mgr.gibba020.yqfnwy (mgr.34427) 9343 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:50:02.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:01 gibba020 bash[25448]: cephadm 2021-03-10T16:50:00.674914+0000 mgr.gibba020.yqfnwy (mgr.34427) 9344 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:50:02.270 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:50:02.376 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:01 gibba013 bash[29418]: cephadm 2021-03-10T16:50:00.462656+0000 mgr.gibba020.yqfnwy (mgr.34427) 9330 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:50:02.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:01 gibba013 bash[29418]: cephadm 2021-03-10T16:50:00.662146+0000 mgr.gibba020.yqfnwy (mgr.34427) 9331 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:50:02.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:01 gibba013 bash[29418]: cephadm 2021-03-10T16:50:00.664620+0000 mgr.gibba020.yqfnwy (mgr.34427) 9332 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:50:02.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:01 gibba013 bash[29418]: cephadm 2021-03-10T16:50:00.666569+0000 mgr.gibba020.yqfnwy (mgr.34427) 9333 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:50:02.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:01 gibba013 bash[29418]: cephadm 2021-03-10T16:50:00.666608+0000 mgr.gibba020.yqfnwy (mgr.34427) 9334 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:50:02.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:01 gibba013 bash[29418]: cephadm 2021-03-10T16:50:00.668181+0000 mgr.gibba020.yqfnwy (mgr.34427) 9335 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:50:02.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:01 gibba013 bash[29418]: cephadm 2021-03-10T16:50:00.668219+0000 mgr.gibba020.yqfnwy (mgr.34427) 9336 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:50:02.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:01 gibba013 bash[29418]: cephadm 2021-03-10T16:50:00.669722+0000 mgr.gibba020.yqfnwy (mgr.34427) 9337 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:50:02.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:01 gibba013 bash[29418]: cephadm 2021-03-10T16:50:00.671271+0000 mgr.gibba020.yqfnwy (mgr.34427) 9338 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:50:02.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:01 gibba013 bash[29418]: cephadm 2021-03-10T16:50:00.671312+0000 mgr.gibba020.yqfnwy (mgr.34427) 9339 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:50:02.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:01 gibba013 bash[29418]: cephadm 2021-03-10T16:50:00.673062+0000 mgr.gibba020.yqfnwy (mgr.34427) 9340 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:50:02.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:01 gibba013 bash[29418]: cephadm 2021-03-10T16:50:00.673410+0000 mgr.gibba020.yqfnwy (mgr.34427) 9341 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:50:02.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:01 gibba013 bash[29418]: cephadm 2021-03-10T16:50:00.674744+0000 mgr.gibba020.yqfnwy (mgr.34427) 9342 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:50:02.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:01 gibba013 bash[29418]: cephadm 2021-03-10T16:50:00.674790+0000 mgr.gibba020.yqfnwy (mgr.34427) 9343 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:50:02.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:01 gibba013 bash[29418]: cephadm 2021-03-10T16:50:00.674914+0000 mgr.gibba020.yqfnwy (mgr.34427) 9344 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:50:02.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:01 gibba013 bash[30381]: cephadm 2021-03-10T16:50:00.462656+0000 mgr.gibba020.yqfnwy (mgr.34427) 9330 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:50:02.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:01 gibba013 bash[30381]: cephadm 2021-03-10T16:50:00.662146+0000 mgr.gibba020.yqfnwy (mgr.34427) 9331 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:50:02.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:01 gibba013 bash[30381]: cephadm 2021-03-10T16:50:00.664620+0000 mgr.gibba020.yqfnwy (mgr.34427) 9332 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:50:02.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:01 gibba013 bash[30381]: cephadm 2021-03-10T16:50:00.666569+0000 mgr.gibba020.yqfnwy (mgr.34427) 9333 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:50:02.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:01 gibba013 bash[30381]: cephadm 2021-03-10T16:50:00.666608+0000 mgr.gibba020.yqfnwy (mgr.34427) 9334 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:50:02.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:01 gibba013 bash[30381]: cephadm 2021-03-10T16:50:00.668181+0000 mgr.gibba020.yqfnwy (mgr.34427) 9335 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:50:02.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:01 gibba013 bash[30381]: cephadm 2021-03-10T16:50:00.668219+0000 mgr.gibba020.yqfnwy (mgr.34427) 9336 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:50:02.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:01 gibba013 bash[30381]: cephadm 2021-03-10T16:50:00.669722+0000 mgr.gibba020.yqfnwy (mgr.34427) 9337 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:50:02.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:01 gibba013 bash[30381]: cephadm 2021-03-10T16:50:00.671271+0000 mgr.gibba020.yqfnwy (mgr.34427) 9338 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:50:02.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:01 gibba013 bash[30381]: cephadm 2021-03-10T16:50:00.671312+0000 mgr.gibba020.yqfnwy (mgr.34427) 9339 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:50:02.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:01 gibba013 bash[30381]: cephadm 2021-03-10T16:50:00.673062+0000 mgr.gibba020.yqfnwy (mgr.34427) 9340 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:50:02.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:01 gibba013 bash[30381]: cephadm 2021-03-10T16:50:00.673410+0000 mgr.gibba020.yqfnwy (mgr.34427) 9341 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:50:02.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:01 gibba013 bash[30381]: cephadm 2021-03-10T16:50:00.674744+0000 mgr.gibba020.yqfnwy (mgr.34427) 9342 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:50:02.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:01 gibba013 bash[30381]: cephadm 2021-03-10T16:50:00.674790+0000 mgr.gibba020.yqfnwy (mgr.34427) 9343 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:50:02.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:01 gibba013 bash[30381]: cephadm 2021-03-10T16:50:00.674914+0000 mgr.gibba020.yqfnwy (mgr.34427) 9344 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:50:02.499 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:50:02.499 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 9m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:50:02.500 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 8m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:50:02.500 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:50:02.500 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:50:02.501 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:50:02.501 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:50:02.501 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:50:02.502 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:50:02.502 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:50:02.503 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:50:02.503 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:50:02.503 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:50:02.503 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:50:02.504 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:50:02.505 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:50:02.505 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:50:02.505 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:50:02.506 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:50:02.506 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 8m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:50:02.507 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 8m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:50:02.751 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:50:02.752 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:50:02.752 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:50:02.752 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:50:02.752 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:50:02.753 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:50:02.753 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:50:02.753 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:50:02.753 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:50:02.753 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:50:02.754 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:50:02.754 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:50:02.754 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:50:02.754 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:50:02.755 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:50:03.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:02 gibba020 bash[25448]: cluster 2021-03-10T16:50:02.179348+0000 mgr.gibba020.yqfnwy (mgr.34427) 9345 : cluster [DBG] pgmap v5319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:03.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:02 gibba020 bash[25448]: audit 2021-03-10T16:50:02.753553+0000 mon.a (mon.0) 3382 : audit [DBG] from='client.? 172.21.2.113:0/2634494162' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:03.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:02 gibba013 bash[29418]: cluster 2021-03-10T16:50:02.179348+0000 mgr.gibba020.yqfnwy (mgr.34427) 9345 : cluster [DBG] pgmap v5319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:03.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:02 gibba013 bash[29418]: audit 2021-03-10T16:50:02.753553+0000 mon.a (mon.0) 3382 : audit [DBG] from='client.? 172.21.2.113:0/2634494162' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:03.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:02 gibba013 bash[30381]: cluster 2021-03-10T16:50:02.179348+0000 mgr.gibba020.yqfnwy (mgr.34427) 9345 : cluster [DBG] pgmap v5319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:03.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:02 gibba013 bash[30381]: audit 2021-03-10T16:50:02.753553+0000 mon.a (mon.0) 3382 : audit [DBG] from='client.? 172.21.2.113:0/2634494162' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:04.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:03 gibba013 bash[29418]: audit 2021-03-10T16:50:02.263096+0000 mgr.gibba020.yqfnwy (mgr.34427) 9346 : audit [DBG] from='client.50316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:50:04.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:03 gibba013 bash[29418]: audit 2021-03-10T16:50:02.487415+0000 mgr.gibba020.yqfnwy (mgr.34427) 9347 : audit [DBG] from='client.60304 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:50:04.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:03 gibba013 bash[30381]: audit 2021-03-10T16:50:02.263096+0000 mgr.gibba020.yqfnwy (mgr.34427) 9346 : audit [DBG] from='client.50316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:50:04.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:03 gibba013 bash[30381]: audit 2021-03-10T16:50:02.487415+0000 mgr.gibba020.yqfnwy (mgr.34427) 9347 : audit [DBG] from='client.60304 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:50:04.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:03 gibba020 bash[25448]: audit 2021-03-10T16:50:02.263096+0000 mgr.gibba020.yqfnwy (mgr.34427) 9346 : audit [DBG] from='client.50316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:50:04.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:03 gibba020 bash[25448]: audit 2021-03-10T16:50:02.487415+0000 mgr.gibba020.yqfnwy (mgr.34427) 9347 : audit [DBG] from='client.60304 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:50:05.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:04 gibba013 bash[29418]: cluster 2021-03-10T16:50:04.180624+0000 mgr.gibba020.yqfnwy (mgr.34427) 9348 : cluster [DBG] pgmap v5320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:05.377 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:04 gibba013 bash[30381]: cluster 2021-03-10T16:50:04.180624+0000 mgr.gibba020.yqfnwy (mgr.34427) 9348 : cluster [DBG] pgmap v5320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:05.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:04 gibba020 bash[25448]: cluster 2021-03-10T16:50:04.180624+0000 mgr.gibba020.yqfnwy (mgr.34427) 9348 : cluster [DBG] pgmap v5320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:06.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:06 gibba013 bash[29418]: cluster 2021-03-10T16:50:06.182247+0000 mgr.gibba020.yqfnwy (mgr.34427) 9349 : cluster [DBG] pgmap v5321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:06.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:06 gibba013 bash[30381]: cluster 2021-03-10T16:50:06.182247+0000 mgr.gibba020.yqfnwy (mgr.34427) 9349 : cluster [DBG] pgmap v5321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:06.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:06 gibba020 bash[25448]: cluster 2021-03-10T16:50:06.182247+0000 mgr.gibba020.yqfnwy (mgr.34427) 9349 : cluster [DBG] pgmap v5321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:07.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:07 gibba013 bash[29418]: audit 2021-03-10T16:50:06.812016+0000 mon.a (mon.0) 3383 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:50:07.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:07 gibba013 bash[29418]: audit 2021-03-10T16:50:06.989730+0000 mon.a (mon.0) 3384 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:50:07.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:07 gibba013 bash[30381]: audit 2021-03-10T16:50:06.812016+0000 mon.a (mon.0) 3383 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:50:07.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:07 gibba013 bash[30381]: audit 2021-03-10T16:50:06.989730+0000 mon.a (mon.0) 3384 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:50:07.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:07 gibba020 bash[25448]: audit 2021-03-10T16:50:06.812016+0000 mon.a (mon.0) 3383 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:50:07.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:07 gibba020 bash[25448]: audit 2021-03-10T16:50:06.989730+0000 mon.a (mon.0) 3384 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:50:08.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:08 gibba013 bash[29418]: audit 2021-03-10T16:50:07.358938+0000 mon.a (mon.0) 3385 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:50:08.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:08 gibba013 bash[29418]: audit 2021-03-10T16:50:07.359820+0000 mon.a (mon.0) 3386 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:50:08.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:08 gibba013 bash[29418]: audit 2021-03-10T16:50:07.360567+0000 mon.a (mon.0) 3387 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T16:50:08.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:08 gibba013 bash[29418]: audit 2021-03-10T16:50:07.361262+0000 mon.a (mon.0) 3388 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:50:08.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:08 gibba013 bash[29418]: cluster 2021-03-10T16:50:08.183744+0000 mgr.gibba020.yqfnwy (mgr.34427) 9350 : cluster [DBG] pgmap v5322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:08.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:08 gibba013 bash[30381]: audit 2021-03-10T16:50:07.358938+0000 mon.a (mon.0) 3385 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:50:08.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:08 gibba013 bash[30381]: audit 2021-03-10T16:50:07.359820+0000 mon.a (mon.0) 3386 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:50:08.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:08 gibba013 bash[30381]: audit 2021-03-10T16:50:07.360567+0000 mon.a (mon.0) 3387 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T16:50:08.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:08 gibba013 bash[30381]: audit 2021-03-10T16:50:07.361262+0000 mon.a (mon.0) 3388 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:50:08.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:08 gibba013 bash[30381]: cluster 2021-03-10T16:50:08.183744+0000 mgr.gibba020.yqfnwy (mgr.34427) 9350 : cluster [DBG] pgmap v5322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:08.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:08 gibba020 bash[25448]: audit 2021-03-10T16:50:07.358938+0000 mon.a (mon.0) 3385 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:50:08.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:08 gibba020 bash[25448]: audit 2021-03-10T16:50:07.359820+0000 mon.a (mon.0) 3386 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:50:08.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:08 gibba020 bash[25448]: audit 2021-03-10T16:50:07.360567+0000 mon.a (mon.0) 3387 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T16:50:08.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:08 gibba020 bash[25448]: audit 2021-03-10T16:50:07.361262+0000 mon.a (mon.0) 3388 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:50:08.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:08 gibba020 bash[25448]: cluster 2021-03-10T16:50:08.183744+0000 mgr.gibba020.yqfnwy (mgr.34427) 9350 : cluster [DBG] pgmap v5322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:11.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:10 gibba020 bash[25448]: cluster 2021-03-10T16:50:10.185201+0000 mgr.gibba020.yqfnwy (mgr.34427) 9351 : cluster [DBG] pgmap v5323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:11.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:10 gibba013 bash[29418]: cluster 2021-03-10T16:50:10.185201+0000 mgr.gibba020.yqfnwy (mgr.34427) 9351 : cluster [DBG] pgmap v5323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:11.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:10 gibba013 bash[30381]: cluster 2021-03-10T16:50:10.185201+0000 mgr.gibba020.yqfnwy (mgr.34427) 9351 : cluster [DBG] pgmap v5323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:12.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:12 gibba013 bash[29418]: cluster 2021-03-10T16:50:12.186614+0000 mgr.gibba020.yqfnwy (mgr.34427) 9352 : cluster [DBG] pgmap v5324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:12.627 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:12 gibba013 bash[30381]: cluster 2021-03-10T16:50:12.186614+0000 mgr.gibba020.yqfnwy (mgr.34427) 9352 : cluster [DBG] pgmap v5324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:12.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:12 gibba020 bash[25448]: cluster 2021-03-10T16:50:12.186614+0000 mgr.gibba020.yqfnwy (mgr.34427) 9352 : cluster [DBG] pgmap v5324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:14.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:14 gibba013 bash[29418]: cluster 2021-03-10T16:50:14.187511+0000 mgr.gibba020.yqfnwy (mgr.34427) 9353 : cluster [DBG] pgmap v5325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:14.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:14 gibba013 bash[30381]: cluster 2021-03-10T16:50:14.187511+0000 mgr.gibba020.yqfnwy (mgr.34427) 9353 : cluster [DBG] pgmap v5325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:14.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:14 gibba020 bash[25448]: cluster 2021-03-10T16:50:14.187511+0000 mgr.gibba020.yqfnwy (mgr.34427) 9353 : cluster [DBG] pgmap v5325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:16.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:16 gibba013 bash[29418]: cephadm 2021-03-10T16:50:15.689345+0000 mgr.gibba020.yqfnwy (mgr.34427) 9354 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:50:16.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:16 gibba013 bash[29418]: cluster 2021-03-10T16:50:16.189322+0000 mgr.gibba020.yqfnwy (mgr.34427) 9355 : cluster [DBG] pgmap v5326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:16.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:16 gibba013 bash[30381]: cephadm 2021-03-10T16:50:15.689345+0000 mgr.gibba020.yqfnwy (mgr.34427) 9354 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:50:16.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:16 gibba013 bash[30381]: cluster 2021-03-10T16:50:16.189322+0000 mgr.gibba020.yqfnwy (mgr.34427) 9355 : cluster [DBG] pgmap v5326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:16.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:16 gibba020 bash[25448]: cephadm 2021-03-10T16:50:15.689345+0000 mgr.gibba020.yqfnwy (mgr.34427) 9354 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:50:16.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:16 gibba020 bash[25448]: cluster 2021-03-10T16:50:16.189322+0000 mgr.gibba020.yqfnwy (mgr.34427) 9355 : cluster [DBG] pgmap v5326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:18.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:18 gibba013 bash[29418]: cluster 2021-03-10T16:50:18.190760+0000 mgr.gibba020.yqfnwy (mgr.34427) 9356 : cluster [DBG] pgmap v5327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:18.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:18 gibba013 bash[30381]: cluster 2021-03-10T16:50:18.190760+0000 mgr.gibba020.yqfnwy (mgr.34427) 9356 : cluster [DBG] pgmap v5327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:18.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:18 gibba020 bash[25448]: cluster 2021-03-10T16:50:18.190760+0000 mgr.gibba020.yqfnwy (mgr.34427) 9356 : cluster [DBG] pgmap v5327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:21.195 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:20 gibba020 bash[25448]: cluster 2021-03-10T16:50:20.192253+0000 mgr.gibba020.yqfnwy (mgr.34427) 9357 : cluster [DBG] pgmap v5328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:21.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:20 gibba013 bash[29418]: cluster 2021-03-10T16:50:20.192253+0000 mgr.gibba020.yqfnwy (mgr.34427) 9357 : cluster [DBG] pgmap v5328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:21.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:20 gibba013 bash[30381]: cluster 2021-03-10T16:50:20.192253+0000 mgr.gibba020.yqfnwy (mgr.34427) 9357 : cluster [DBG] pgmap v5328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:22.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:22 gibba013 bash[29418]: cluster 2021-03-10T16:50:22.193635+0000 mgr.gibba020.yqfnwy (mgr.34427) 9358 : cluster [DBG] pgmap v5329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:22.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:22 gibba013 bash[30381]: cluster 2021-03-10T16:50:22.193635+0000 mgr.gibba020.yqfnwy (mgr.34427) 9358 : cluster [DBG] pgmap v5329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:22.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:22 gibba020 bash[25448]: cluster 2021-03-10T16:50:22.193635+0000 mgr.gibba020.yqfnwy (mgr.34427) 9358 : cluster [DBG] pgmap v5329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:24.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:24 gibba013 bash[29418]: cluster 2021-03-10T16:50:24.195038+0000 mgr.gibba020.yqfnwy (mgr.34427) 9359 : cluster [DBG] pgmap v5330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:24.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:24 gibba013 bash[30381]: cluster 2021-03-10T16:50:24.195038+0000 mgr.gibba020.yqfnwy (mgr.34427) 9359 : cluster [DBG] pgmap v5330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:24.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:24 gibba020 bash[25448]: cluster 2021-03-10T16:50:24.195038+0000 mgr.gibba020.yqfnwy (mgr.34427) 9359 : cluster [DBG] pgmap v5330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:27.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:27 gibba013 bash[29418]: cluster 2021-03-10T16:50:26.196137+0000 mgr.gibba020.yqfnwy (mgr.34427) 9360 : cluster [DBG] pgmap v5331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:27.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:27 gibba013 bash[30381]: cluster 2021-03-10T16:50:26.196137+0000 mgr.gibba020.yqfnwy (mgr.34427) 9360 : cluster [DBG] pgmap v5331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:27.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:27 gibba020 bash[25448]: cluster 2021-03-10T16:50:26.196137+0000 mgr.gibba020.yqfnwy (mgr.34427) 9360 : cluster [DBG] pgmap v5331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:29.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:29 gibba013 bash[29418]: cluster 2021-03-10T16:50:28.197408+0000 mgr.gibba020.yqfnwy (mgr.34427) 9361 : cluster [DBG] pgmap v5332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:29.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:29 gibba013 bash[30381]: cluster 2021-03-10T16:50:28.197408+0000 mgr.gibba020.yqfnwy (mgr.34427) 9361 : cluster [DBG] pgmap v5332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:29.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:29 gibba020 bash[25448]: cluster 2021-03-10T16:50:28.197408+0000 mgr.gibba020.yqfnwy (mgr.34427) 9361 : cluster [DBG] pgmap v5332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:32.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:31 gibba020 bash[25448]: cluster 2021-03-10T16:50:30.198969+0000 mgr.gibba020.yqfnwy (mgr.34427) 9362 : cluster [DBG] pgmap v5333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:32.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:31 gibba020 bash[25448]: cephadm 2021-03-10T16:50:30.705213+0000 mgr.gibba020.yqfnwy (mgr.34427) 9363 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:50:32.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:31 gibba013 bash[29418]: cluster 2021-03-10T16:50:30.198969+0000 mgr.gibba020.yqfnwy (mgr.34427) 9362 : cluster [DBG] pgmap v5333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:32.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:31 gibba013 bash[29418]: cephadm 2021-03-10T16:50:30.705213+0000 mgr.gibba020.yqfnwy (mgr.34427) 9363 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:50:32.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:31 gibba013 bash[30381]: cluster 2021-03-10T16:50:30.198969+0000 mgr.gibba020.yqfnwy (mgr.34427) 9362 : cluster [DBG] pgmap v5333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:32.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:31 gibba013 bash[30381]: cephadm 2021-03-10T16:50:30.705213+0000 mgr.gibba020.yqfnwy (mgr.34427) 9363 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:50:32.998 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:50:33.253 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:50:33.253 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 9m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:50:33.254 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 8m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:50:33.254 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:50:33.254 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:50:33.254 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:50:33.255 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:50:33.255 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:50:33.255 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:50:33.255 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:50:33.256 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:50:33.256 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:50:33.256 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:50:33.256 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:50:33.256 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:50:33.257 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:50:33.257 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:50:33.257 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:50:33.257 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:50:33.257 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 8m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:50:33.258 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 8m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:50:33.504 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:50:33.504 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:50:33.504 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:50:33.505 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:50:33.505 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:50:33.505 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:50:33.506 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:50:33.506 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:50:33.507 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:50:33.507 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:50:33.507 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:50:33.508 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:50:33.509 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:50:33.509 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:50:33.510 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:50:34.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:33 gibba013 bash[29418]: cluster 2021-03-10T16:50:32.200304+0000 mgr.gibba020.yqfnwy (mgr.34427) 9364 : cluster [DBG] pgmap v5334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:34.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:33 gibba013 bash[29418]: audit 2021-03-10T16:50:32.990815+0000 mgr.gibba020.yqfnwy (mgr.34427) 9365 : audit [DBG] from='client.50334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:50:34.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:33 gibba013 bash[29418]: audit 2021-03-10T16:50:33.505753+0000 mon.c (mon.1) 144 : audit [DBG] from='client.? 172.21.2.113:0/2883536447' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:34.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:33 gibba013 bash[30381]: cluster 2021-03-10T16:50:32.200304+0000 mgr.gibba020.yqfnwy (mgr.34427) 9364 : cluster [DBG] pgmap v5334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:34.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:33 gibba013 bash[30381]: audit 2021-03-10T16:50:32.990815+0000 mgr.gibba020.yqfnwy (mgr.34427) 9365 : audit [DBG] from='client.50334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:50:34.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:33 gibba013 bash[30381]: audit 2021-03-10T16:50:33.505753+0000 mon.c (mon.1) 144 : audit [DBG] from='client.? 172.21.2.113:0/2883536447' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:34.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:33 gibba020 bash[25448]: cluster 2021-03-10T16:50:32.200304+0000 mgr.gibba020.yqfnwy (mgr.34427) 9364 : cluster [DBG] pgmap v5334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:34.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:33 gibba020 bash[25448]: audit 2021-03-10T16:50:32.990815+0000 mgr.gibba020.yqfnwy (mgr.34427) 9365 : audit [DBG] from='client.50334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:50:34.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:33 gibba020 bash[25448]: audit 2021-03-10T16:50:33.505753+0000 mon.c (mon.1) 144 : audit [DBG] from='client.? 172.21.2.113:0/2883536447' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:50:35.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:34 gibba013 bash[29418]: audit 2021-03-10T16:50:33.213859+0000 mgr.gibba020.yqfnwy (mgr.34427) 9366 : audit [DBG] from='client.50340 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:50:35.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:34 gibba013 bash[30381]: audit 2021-03-10T16:50:33.213859+0000 mgr.gibba020.yqfnwy (mgr.34427) 9366 : audit [DBG] from='client.50340 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:50:35.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:34 gibba020 bash[25448]: audit 2021-03-10T16:50:33.213859+0000 mgr.gibba020.yqfnwy (mgr.34427) 9366 : audit [DBG] from='client.50340 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:50:36.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:35 gibba013 bash[29418]: cluster 2021-03-10T16:50:34.201946+0000 mgr.gibba020.yqfnwy (mgr.34427) 9367 : cluster [DBG] pgmap v5335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:36.377 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:35 gibba013 bash[30381]: cluster 2021-03-10T16:50:34.201946+0000 mgr.gibba020.yqfnwy (mgr.34427) 9367 : cluster [DBG] pgmap v5335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:36.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:35 gibba020 bash[25448]: cluster 2021-03-10T16:50:34.201946+0000 mgr.gibba020.yqfnwy (mgr.34427) 9367 : cluster [DBG] pgmap v5335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:38.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:37 gibba013 bash[29418]: cluster 2021-03-10T16:50:36.203535+0000 mgr.gibba020.yqfnwy (mgr.34427) 9368 : cluster [DBG] pgmap v5336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:38.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:37 gibba013 bash[30381]: cluster 2021-03-10T16:50:36.203535+0000 mgr.gibba020.yqfnwy (mgr.34427) 9368 : cluster [DBG] pgmap v5336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:38.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:37 gibba020 bash[25448]: cluster 2021-03-10T16:50:36.203535+0000 mgr.gibba020.yqfnwy (mgr.34427) 9368 : cluster [DBG] pgmap v5336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:40.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:39 gibba013 bash[29418]: cluster 2021-03-10T16:50:38.204433+0000 mgr.gibba020.yqfnwy (mgr.34427) 9369 : cluster [DBG] pgmap v5337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:40.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:39 gibba013 bash[30381]: cluster 2021-03-10T16:50:38.204433+0000 mgr.gibba020.yqfnwy (mgr.34427) 9369 : cluster [DBG] pgmap v5337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:40.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:39 gibba020 bash[25448]: cluster 2021-03-10T16:50:38.204433+0000 mgr.gibba020.yqfnwy (mgr.34427) 9369 : cluster [DBG] pgmap v5337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:42.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:41 gibba013 bash[29418]: cluster 2021-03-10T16:50:40.206079+0000 mgr.gibba020.yqfnwy (mgr.34427) 9370 : cluster [DBG] pgmap v5338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:42.377 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:41 gibba013 bash[30381]: cluster 2021-03-10T16:50:40.206079+0000 mgr.gibba020.yqfnwy (mgr.34427) 9370 : cluster [DBG] pgmap v5338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:42.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:41 gibba020 bash[25448]: cluster 2021-03-10T16:50:40.206079+0000 mgr.gibba020.yqfnwy (mgr.34427) 9370 : cluster [DBG] pgmap v5338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:44.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:43 gibba013 bash[29418]: cluster 2021-03-10T16:50:42.207442+0000 mgr.gibba020.yqfnwy (mgr.34427) 9371 : cluster [DBG] pgmap v5339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:44.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:43 gibba013 bash[30381]: cluster 2021-03-10T16:50:42.207442+0000 mgr.gibba020.yqfnwy (mgr.34427) 9371 : cluster [DBG] pgmap v5339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:44.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:43 gibba020 bash[25448]: cluster 2021-03-10T16:50:42.207442+0000 mgr.gibba020.yqfnwy (mgr.34427) 9371 : cluster [DBG] pgmap v5339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:46.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:45 gibba013 bash[29418]: cluster 2021-03-10T16:50:44.208449+0000 mgr.gibba020.yqfnwy (mgr.34427) 9372 : cluster [DBG] pgmap v5340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:46.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:46 gibba013 bash[30381]: cluster 2021-03-10T16:50:44.208449+0000 mgr.gibba020.yqfnwy (mgr.34427) 9372 : cluster [DBG] pgmap v5340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:46.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:45 gibba020 bash[25448]: cluster 2021-03-10T16:50:44.208449+0000 mgr.gibba020.yqfnwy (mgr.34427) 9372 : cluster [DBG] pgmap v5340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:47.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:47 gibba013 bash[29418]: cephadm 2021-03-10T16:50:45.715696+0000 mgr.gibba020.yqfnwy (mgr.34427) 9373 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:50:47.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:47 gibba013 bash[30381]: cephadm 2021-03-10T16:50:45.715696+0000 mgr.gibba020.yqfnwy (mgr.34427) 9373 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:50:47.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:47 gibba020 bash[25448]: cephadm 2021-03-10T16:50:45.715696+0000 mgr.gibba020.yqfnwy (mgr.34427) 9373 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:50:48.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:48 gibba013 bash[29418]: cluster 2021-03-10T16:50:46.210004+0000 mgr.gibba020.yqfnwy (mgr.34427) 9374 : cluster [DBG] pgmap v5341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:48.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:48 gibba013 bash[30381]: cluster 2021-03-10T16:50:46.210004+0000 mgr.gibba020.yqfnwy (mgr.34427) 9374 : cluster [DBG] pgmap v5341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:48.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:48 gibba020 bash[25448]: cluster 2021-03-10T16:50:46.210004+0000 mgr.gibba020.yqfnwy (mgr.34427) 9374 : cluster [DBG] pgmap v5341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:50.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:50 gibba013 bash[29418]: cluster 2021-03-10T16:50:48.211391+0000 mgr.gibba020.yqfnwy (mgr.34427) 9375 : cluster [DBG] pgmap v5342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:50.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:50 gibba013 bash[30381]: cluster 2021-03-10T16:50:48.211391+0000 mgr.gibba020.yqfnwy (mgr.34427) 9375 : cluster [DBG] pgmap v5342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:50.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:50 gibba020 bash[25448]: cluster 2021-03-10T16:50:48.211391+0000 mgr.gibba020.yqfnwy (mgr.34427) 9375 : cluster [DBG] pgmap v5342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:52.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:52 gibba013 bash[29418]: cluster 2021-03-10T16:50:50.212431+0000 mgr.gibba020.yqfnwy (mgr.34427) 9376 : cluster [DBG] pgmap v5343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:52.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:52 gibba013 bash[30381]: cluster 2021-03-10T16:50:50.212431+0000 mgr.gibba020.yqfnwy (mgr.34427) 9376 : cluster [DBG] pgmap v5343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:52.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:52 gibba020 bash[25448]: cluster 2021-03-10T16:50:50.212431+0000 mgr.gibba020.yqfnwy (mgr.34427) 9376 : cluster [DBG] pgmap v5343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:54.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:54 gibba013 bash[29418]: cluster 2021-03-10T16:50:52.213501+0000 mgr.gibba020.yqfnwy (mgr.34427) 9377 : cluster [DBG] pgmap v5344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:54.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:54 gibba013 bash[30381]: cluster 2021-03-10T16:50:52.213501+0000 mgr.gibba020.yqfnwy (mgr.34427) 9377 : cluster [DBG] pgmap v5344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:54.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:54 gibba020 bash[25448]: cluster 2021-03-10T16:50:52.213501+0000 mgr.gibba020.yqfnwy (mgr.34427) 9377 : cluster [DBG] pgmap v5344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:56.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:56 gibba013 bash[29418]: cluster 2021-03-10T16:50:54.215150+0000 mgr.gibba020.yqfnwy (mgr.34427) 9378 : cluster [DBG] pgmap v5345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:56.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:56 gibba013 bash[30381]: cluster 2021-03-10T16:50:54.215150+0000 mgr.gibba020.yqfnwy (mgr.34427) 9378 : cluster [DBG] pgmap v5345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:56.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:56 gibba020 bash[25448]: cluster 2021-03-10T16:50:54.215150+0000 mgr.gibba020.yqfnwy (mgr.34427) 9378 : cluster [DBG] pgmap v5345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:58.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:50:58 gibba013 bash[29418]: cluster 2021-03-10T16:50:56.216334+0000 mgr.gibba020.yqfnwy (mgr.34427) 9379 : cluster [DBG] pgmap v5346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:58.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:50:58 gibba013 bash[30381]: cluster 2021-03-10T16:50:56.216334+0000 mgr.gibba020.yqfnwy (mgr.34427) 9379 : cluster [DBG] pgmap v5346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:50:58.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:50:58 gibba020 bash[25448]: cluster 2021-03-10T16:50:56.216334+0000 mgr.gibba020.yqfnwy (mgr.34427) 9379 : cluster [DBG] pgmap v5346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:00.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:00 gibba013 bash[29418]: cluster 2021-03-10T16:50:58.217657+0000 mgr.gibba020.yqfnwy (mgr.34427) 9380 : cluster [DBG] pgmap v5347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:00.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:00 gibba013 bash[30381]: cluster 2021-03-10T16:50:58.217657+0000 mgr.gibba020.yqfnwy (mgr.34427) 9380 : cluster [DBG] pgmap v5347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:00.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:00 gibba020 bash[25448]: cluster 2021-03-10T16:50:58.217657+0000 mgr.gibba020.yqfnwy (mgr.34427) 9380 : cluster [DBG] pgmap v5347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:01.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:01 gibba013 bash[29418]: audit 2021-03-10T16:51:00.718754+0000 mon.a (mon.0) 3389 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:51:01.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:01 gibba013 bash[29418]: audit 2021-03-10T16:51:00.725625+0000 mon.a (mon.0) 3390 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:51:01.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:01 gibba013 bash[30381]: audit 2021-03-10T16:51:00.718754+0000 mon.a (mon.0) 3389 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:51:01.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:01 gibba013 bash[30381]: audit 2021-03-10T16:51:00.725625+0000 mon.a (mon.0) 3390 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:51:01.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:01 gibba020 bash[25448]: audit 2021-03-10T16:51:00.718754+0000 mon.a (mon.0) 3389 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:51:01.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:01 gibba020 bash[25448]: audit 2021-03-10T16:51:00.725625+0000 mon.a (mon.0) 3390 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:51:02.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:02 gibba013 bash[29418]: cluster 2021-03-10T16:51:00.219436+0000 mgr.gibba020.yqfnwy (mgr.34427) 9381 : cluster [DBG] pgmap v5348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:02.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:02 gibba013 bash[29418]: cephadm 2021-03-10T16:51:00.724439+0000 mgr.gibba020.yqfnwy (mgr.34427) 9382 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:51:02.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:02 gibba013 bash[30381]: cluster 2021-03-10T16:51:00.219436+0000 mgr.gibba020.yqfnwy (mgr.34427) 9381 : cluster [DBG] pgmap v5348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:02.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:02 gibba013 bash[30381]: cephadm 2021-03-10T16:51:00.724439+0000 mgr.gibba020.yqfnwy (mgr.34427) 9382 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:51:02.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:02 gibba020 bash[25448]: cluster 2021-03-10T16:51:00.219436+0000 mgr.gibba020.yqfnwy (mgr.34427) 9381 : cluster [DBG] pgmap v5348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:02.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:02 gibba020 bash[25448]: cephadm 2021-03-10T16:51:00.724439+0000 mgr.gibba020.yqfnwy (mgr.34427) 9382 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:51:03.811 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:51:04.054 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:51:04.054 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 10m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:51:04.055 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 9m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:51:04.055 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:51:04.055 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:51:04.055 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:51:04.055 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:51:04.056 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:51:04.056 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:51:04.056 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 10m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:51:04.056 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:51:04.057 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:51:04.057 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:51:04.057 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:51:04.057 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:51:04.058 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:51:04.058 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:51:04.058 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:51:04.058 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:51:04.058 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 9m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:51:04.059 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 9m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:51:04.322 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:51:04.322 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:51:04.323 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:51:04.323 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:51:04.323 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:51:04.323 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:51:04.324 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:51:04.324 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:51:04.324 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:51:04.324 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:51:04.324 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:51:04.325 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:51:04.325 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:51:04.325 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:51:04.325 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:51:04.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:04 gibba013 bash[29418]: cluster 2021-03-10T16:51:02.220843+0000 mgr.gibba020.yqfnwy (mgr.34427) 9383 : cluster [DBG] pgmap v5349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:04.377 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:04 gibba013 bash[30381]: cluster 2021-03-10T16:51:02.220843+0000 mgr.gibba020.yqfnwy (mgr.34427) 9383 : cluster [DBG] pgmap v5349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:04.393 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:04 gibba020 bash[25448]: cluster 2021-03-10T16:51:02.220843+0000 mgr.gibba020.yqfnwy (mgr.34427) 9383 : cluster [DBG] pgmap v5349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:05.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:05 gibba020 bash[25448]: audit 2021-03-10T16:51:03.802294+0000 mgr.gibba020.yqfnwy (mgr.34427) 9384 : audit [DBG] from='client.50352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:51:05.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:05 gibba020 bash[25448]: audit 2021-03-10T16:51:04.042813+0000 mgr.gibba020.yqfnwy (mgr.34427) 9385 : audit [DBG] from='client.50358 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:51:05.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:05 gibba020 bash[25448]: cephadm 2021-03-10T16:51:04.184659+0000 mgr.gibba020.yqfnwy (mgr.34427) 9386 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:51:05.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:05 gibba020 bash[25448]: audit 2021-03-10T16:51:04.184836+0000 mon.a (mon.0) 3391 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:51:05.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:05 gibba020 bash[25448]: audit 2021-03-10T16:51:04.323881+0000 mon.a (mon.0) 3392 : audit [DBG] from='client.? 172.21.2.113:0/26835422' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:05.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:05 gibba020 bash[25448]: audit 2021-03-10T16:51:04.378712+0000 mon.a (mon.0) 3393 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:51:05.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:05 gibba020 bash[25448]: audit 2021-03-10T16:51:04.386113+0000 mon.a (mon.0) 3394 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:51:05.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:05 gibba020 bash[25448]: audit 2021-03-10T16:51:04.387625+0000 mon.a (mon.0) 3395 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:05.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:05 gibba020 bash[25448]: audit 2021-03-10T16:51:04.389121+0000 mon.a (mon.0) 3396 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:05.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:05 gibba020 bash[25448]: audit 2021-03-10T16:51:04.390333+0000 mon.a (mon.0) 3397 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:05.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:05 gibba020 bash[25448]: audit 2021-03-10T16:51:04.392858+0000 mon.a (mon.0) 3398 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:05.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:05 gibba020 bash[25448]: audit 2021-03-10T16:51:04.394779+0000 mon.a (mon.0) 3399 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:05.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:05 gibba013 bash[29418]: audit 2021-03-10T16:51:03.802294+0000 mgr.gibba020.yqfnwy (mgr.34427) 9384 : audit [DBG] from='client.50352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:51:05.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:05 gibba013 bash[29418]: audit 2021-03-10T16:51:04.042813+0000 mgr.gibba020.yqfnwy (mgr.34427) 9385 : audit [DBG] from='client.50358 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:51:05.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:05 gibba013 bash[29418]: cephadm 2021-03-10T16:51:04.184659+0000 mgr.gibba020.yqfnwy (mgr.34427) 9386 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:51:05.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:05 gibba013 bash[29418]: audit 2021-03-10T16:51:04.184836+0000 mon.a (mon.0) 3391 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:51:05.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:05 gibba013 bash[29418]: audit 2021-03-10T16:51:04.323881+0000 mon.a (mon.0) 3392 : audit [DBG] from='client.? 172.21.2.113:0/26835422' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:05.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:05 gibba013 bash[29418]: audit 2021-03-10T16:51:04.378712+0000 mon.a (mon.0) 3393 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:51:05.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:05 gibba013 bash[29418]: audit 2021-03-10T16:51:04.386113+0000 mon.a (mon.0) 3394 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:51:05.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:05 gibba013 bash[29418]: audit 2021-03-10T16:51:04.387625+0000 mon.a (mon.0) 3395 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:05.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:05 gibba013 bash[29418]: audit 2021-03-10T16:51:04.389121+0000 mon.a (mon.0) 3396 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:05.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:05 gibba013 bash[29418]: audit 2021-03-10T16:51:04.390333+0000 mon.a (mon.0) 3397 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:05.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:05 gibba013 bash[29418]: audit 2021-03-10T16:51:04.392858+0000 mon.a (mon.0) 3398 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:05.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:05 gibba013 bash[29418]: audit 2021-03-10T16:51:04.394779+0000 mon.a (mon.0) 3399 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:05.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:05 gibba013 bash[30381]: audit 2021-03-10T16:51:03.802294+0000 mgr.gibba020.yqfnwy (mgr.34427) 9384 : audit [DBG] from='client.50352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:51:05.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:05 gibba013 bash[30381]: audit 2021-03-10T16:51:04.042813+0000 mgr.gibba020.yqfnwy (mgr.34427) 9385 : audit [DBG] from='client.50358 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:51:05.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:05 gibba013 bash[30381]: cephadm 2021-03-10T16:51:04.184659+0000 mgr.gibba020.yqfnwy (mgr.34427) 9386 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:51:05.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:05 gibba013 bash[30381]: audit 2021-03-10T16:51:04.184836+0000 mon.a (mon.0) 3391 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:51:05.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:05 gibba013 bash[30381]: audit 2021-03-10T16:51:04.323881+0000 mon.a (mon.0) 3392 : audit [DBG] from='client.? 172.21.2.113:0/26835422' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:05.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:05 gibba013 bash[30381]: audit 2021-03-10T16:51:04.378712+0000 mon.a (mon.0) 3393 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:51:05.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:05 gibba013 bash[30381]: audit 2021-03-10T16:51:04.386113+0000 mon.a (mon.0) 3394 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:51:05.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:05 gibba013 bash[30381]: audit 2021-03-10T16:51:04.387625+0000 mon.a (mon.0) 3395 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:05.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:05 gibba013 bash[30381]: audit 2021-03-10T16:51:04.389121+0000 mon.a (mon.0) 3396 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:05.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:05 gibba013 bash[30381]: audit 2021-03-10T16:51:04.390333+0000 mon.a (mon.0) 3397 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:05.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:05 gibba013 bash[30381]: audit 2021-03-10T16:51:04.392858+0000 mon.a (mon.0) 3398 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:05.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:05 gibba013 bash[30381]: audit 2021-03-10T16:51:04.394779+0000 mon.a (mon.0) 3399 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:06.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:06 gibba013 bash[29418]: cluster 2021-03-10T16:51:04.221631+0000 mgr.gibba020.yqfnwy (mgr.34427) 9387 : cluster [DBG] pgmap v5350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:06.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:06 gibba013 bash[29418]: cephadm 2021-03-10T16:51:04.384606+0000 mgr.gibba020.yqfnwy (mgr.34427) 9388 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:51:06.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:06 gibba013 bash[29418]: cephadm 2021-03-10T16:51:04.386503+0000 mgr.gibba020.yqfnwy (mgr.34427) 9389 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:51:06.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:06 gibba013 bash[29418]: cephadm 2021-03-10T16:51:04.388062+0000 mgr.gibba020.yqfnwy (mgr.34427) 9390 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:51:06.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:06 gibba013 bash[29418]: cephadm 2021-03-10T16:51:04.388103+0000 mgr.gibba020.yqfnwy (mgr.34427) 9391 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:51:06.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:06 gibba013 bash[29418]: cephadm 2021-03-10T16:51:04.389313+0000 mgr.gibba020.yqfnwy (mgr.34427) 9392 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:51:06.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:06 gibba013 bash[29418]: cephadm 2021-03-10T16:51:04.389355+0000 mgr.gibba020.yqfnwy (mgr.34427) 9393 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:51:06.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:06 gibba013 bash[29418]: cephadm 2021-03-10T16:51:04.390698+0000 mgr.gibba020.yqfnwy (mgr.34427) 9394 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:51:06.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:06 gibba013 bash[29418]: cephadm 2021-03-10T16:51:04.391714+0000 mgr.gibba020.yqfnwy (mgr.34427) 9395 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:51:06.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:06 gibba013 bash[29418]: cephadm 2021-03-10T16:51:04.391755+0000 mgr.gibba020.yqfnwy (mgr.34427) 9396 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:51:06.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:06 gibba013 bash[29418]: cephadm 2021-03-10T16:51:04.393419+0000 mgr.gibba020.yqfnwy (mgr.34427) 9397 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:51:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:06 gibba013 bash[29418]: cephadm 2021-03-10T16:51:04.393800+0000 mgr.gibba020.yqfnwy (mgr.34427) 9398 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:51:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:06 gibba013 bash[29418]: cephadm 2021-03-10T16:51:04.394979+0000 mgr.gibba020.yqfnwy (mgr.34427) 9399 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:51:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:06 gibba013 bash[29418]: cephadm 2021-03-10T16:51:04.395025+0000 mgr.gibba020.yqfnwy (mgr.34427) 9400 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:51:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:06 gibba013 bash[29418]: cephadm 2021-03-10T16:51:04.395149+0000 mgr.gibba020.yqfnwy (mgr.34427) 9401 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:51:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:06 gibba013 bash[30381]: cluster 2021-03-10T16:51:04.221631+0000 mgr.gibba020.yqfnwy (mgr.34427) 9387 : cluster [DBG] pgmap v5350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:06 gibba013 bash[30381]: cephadm 2021-03-10T16:51:04.384606+0000 mgr.gibba020.yqfnwy (mgr.34427) 9388 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:51:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:06 gibba013 bash[30381]: cephadm 2021-03-10T16:51:04.386503+0000 mgr.gibba020.yqfnwy (mgr.34427) 9389 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:51:06.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:06 gibba013 bash[30381]: cephadm 2021-03-10T16:51:04.388062+0000 mgr.gibba020.yqfnwy (mgr.34427) 9390 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:51:06.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:06 gibba013 bash[30381]: cephadm 2021-03-10T16:51:04.388103+0000 mgr.gibba020.yqfnwy (mgr.34427) 9391 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:51:06.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:06 gibba013 bash[30381]: cephadm 2021-03-10T16:51:04.389313+0000 mgr.gibba020.yqfnwy (mgr.34427) 9392 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:51:06.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:06 gibba013 bash[30381]: cephadm 2021-03-10T16:51:04.389355+0000 mgr.gibba020.yqfnwy (mgr.34427) 9393 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:51:06.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:06 gibba013 bash[30381]: cephadm 2021-03-10T16:51:04.390698+0000 mgr.gibba020.yqfnwy (mgr.34427) 9394 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:51:06.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:06 gibba013 bash[30381]: cephadm 2021-03-10T16:51:04.391714+0000 mgr.gibba020.yqfnwy (mgr.34427) 9395 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:51:06.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:06 gibba013 bash[30381]: cephadm 2021-03-10T16:51:04.391755+0000 mgr.gibba020.yqfnwy (mgr.34427) 9396 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:51:06.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:06 gibba013 bash[30381]: cephadm 2021-03-10T16:51:04.393419+0000 mgr.gibba020.yqfnwy (mgr.34427) 9397 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:51:06.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:06 gibba013 bash[30381]: cephadm 2021-03-10T16:51:04.393800+0000 mgr.gibba020.yqfnwy (mgr.34427) 9398 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:51:06.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:06 gibba013 bash[30381]: cephadm 2021-03-10T16:51:04.394979+0000 mgr.gibba020.yqfnwy (mgr.34427) 9399 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:51:06.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:06 gibba013 bash[30381]: cephadm 2021-03-10T16:51:04.395025+0000 mgr.gibba020.yqfnwy (mgr.34427) 9400 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:51:06.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:06 gibba013 bash[30381]: cephadm 2021-03-10T16:51:04.395149+0000 mgr.gibba020.yqfnwy (mgr.34427) 9401 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:51:06.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:06 gibba020 bash[25448]: cluster 2021-03-10T16:51:04.221631+0000 mgr.gibba020.yqfnwy (mgr.34427) 9387 : cluster [DBG] pgmap v5350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:06.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:06 gibba020 bash[25448]: cephadm 2021-03-10T16:51:04.384606+0000 mgr.gibba020.yqfnwy (mgr.34427) 9388 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:51:06.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:06 gibba020 bash[25448]: cephadm 2021-03-10T16:51:04.386503+0000 mgr.gibba020.yqfnwy (mgr.34427) 9389 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:51:06.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:06 gibba020 bash[25448]: cephadm 2021-03-10T16:51:04.388062+0000 mgr.gibba020.yqfnwy (mgr.34427) 9390 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:51:06.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:06 gibba020 bash[25448]: cephadm 2021-03-10T16:51:04.388103+0000 mgr.gibba020.yqfnwy (mgr.34427) 9391 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:51:06.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:06 gibba020 bash[25448]: cephadm 2021-03-10T16:51:04.389313+0000 mgr.gibba020.yqfnwy (mgr.34427) 9392 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:51:06.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:06 gibba020 bash[25448]: cephadm 2021-03-10T16:51:04.389355+0000 mgr.gibba020.yqfnwy (mgr.34427) 9393 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:51:06.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:06 gibba020 bash[25448]: cephadm 2021-03-10T16:51:04.390698+0000 mgr.gibba020.yqfnwy (mgr.34427) 9394 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:51:06.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:06 gibba020 bash[25448]: cephadm 2021-03-10T16:51:04.391714+0000 mgr.gibba020.yqfnwy (mgr.34427) 9395 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:51:06.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:06 gibba020 bash[25448]: cephadm 2021-03-10T16:51:04.391755+0000 mgr.gibba020.yqfnwy (mgr.34427) 9396 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:51:06.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:06 gibba020 bash[25448]: cephadm 2021-03-10T16:51:04.393419+0000 mgr.gibba020.yqfnwy (mgr.34427) 9397 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:51:06.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:06 gibba020 bash[25448]: cephadm 2021-03-10T16:51:04.393800+0000 mgr.gibba020.yqfnwy (mgr.34427) 9398 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:51:06.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:06 gibba020 bash[25448]: cephadm 2021-03-10T16:51:04.394979+0000 mgr.gibba020.yqfnwy (mgr.34427) 9399 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:51:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:06 gibba020 bash[25448]: cephadm 2021-03-10T16:51:04.395025+0000 mgr.gibba020.yqfnwy (mgr.34427) 9400 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:51:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:06 gibba020 bash[25448]: cephadm 2021-03-10T16:51:04.395149+0000 mgr.gibba020.yqfnwy (mgr.34427) 9401 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:51:07.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:07 gibba013 bash[29418]: audit 2021-03-10T16:51:06.817050+0000 mon.a (mon.0) 3400 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:51:07.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:07 gibba013 bash[29418]: audit 2021-03-10T16:51:06.996478+0000 mon.a (mon.0) 3401 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:51:07.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:07 gibba013 bash[30381]: audit 2021-03-10T16:51:06.817050+0000 mon.a (mon.0) 3400 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:51:07.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:07 gibba013 bash[30381]: audit 2021-03-10T16:51:06.996478+0000 mon.a (mon.0) 3401 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:51:07.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:07 gibba020 bash[25448]: audit 2021-03-10T16:51:06.817050+0000 mon.a (mon.0) 3400 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:51:07.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:07 gibba020 bash[25448]: audit 2021-03-10T16:51:06.996478+0000 mon.a (mon.0) 3401 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:51:08.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:08 gibba013 bash[29418]: cluster 2021-03-10T16:51:06.222166+0000 mgr.gibba020.yqfnwy (mgr.34427) 9402 : cluster [DBG] pgmap v5351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:08.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:08 gibba013 bash[29418]: audit 2021-03-10T16:51:07.368343+0000 mon.a (mon.0) 3402 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T16:51:08.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:08 gibba013 bash[29418]: audit 2021-03-10T16:51:07.369106+0000 mon.a (mon.0) 3403 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:51:08.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:08 gibba013 bash[29418]: audit 2021-03-10T16:51:07.369783+0000 mon.a (mon.0) 3404 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:51:08.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:08 gibba013 bash[29418]: audit 2021-03-10T16:51:07.370483+0000 mon.a (mon.0) 3405 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:51:08.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:08 gibba013 bash[30381]: cluster 2021-03-10T16:51:06.222166+0000 mgr.gibba020.yqfnwy (mgr.34427) 9402 : cluster [DBG] pgmap v5351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:08.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:08 gibba013 bash[30381]: audit 2021-03-10T16:51:07.368343+0000 mon.a (mon.0) 3402 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T16:51:08.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:08 gibba013 bash[30381]: audit 2021-03-10T16:51:07.369106+0000 mon.a (mon.0) 3403 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:51:08.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:08 gibba013 bash[30381]: audit 2021-03-10T16:51:07.369783+0000 mon.a (mon.0) 3404 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:51:08.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:08 gibba013 bash[30381]: audit 2021-03-10T16:51:07.370483+0000 mon.a (mon.0) 3405 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:51:08.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:08 gibba020 bash[25448]: cluster 2021-03-10T16:51:06.222166+0000 mgr.gibba020.yqfnwy (mgr.34427) 9402 : cluster [DBG] pgmap v5351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:08.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:08 gibba020 bash[25448]: audit 2021-03-10T16:51:07.368343+0000 mon.a (mon.0) 3402 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T16:51:08.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:08 gibba020 bash[25448]: audit 2021-03-10T16:51:07.369106+0000 mon.a (mon.0) 3403 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:51:08.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:08 gibba020 bash[25448]: audit 2021-03-10T16:51:07.369783+0000 mon.a (mon.0) 3404 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:51:08.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:08 gibba020 bash[25448]: audit 2021-03-10T16:51:07.370483+0000 mon.a (mon.0) 3405 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T16:51:09.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:09 gibba013 bash[29418]: cluster 2021-03-10T16:51:08.223430+0000 mgr.gibba020.yqfnwy (mgr.34427) 9403 : cluster [DBG] pgmap v5352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:09.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:09 gibba013 bash[30381]: cluster 2021-03-10T16:51:08.223430+0000 mgr.gibba020.yqfnwy (mgr.34427) 9403 : cluster [DBG] pgmap v5352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:09.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:09 gibba020 bash[25448]: cluster 2021-03-10T16:51:08.223430+0000 mgr.gibba020.yqfnwy (mgr.34427) 9403 : cluster [DBG] pgmap v5352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:12.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:11 gibba013 bash[29418]: cluster 2021-03-10T16:51:10.224913+0000 mgr.gibba020.yqfnwy (mgr.34427) 9404 : cluster [DBG] pgmap v5353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:12.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:11 gibba013 bash[30381]: cluster 2021-03-10T16:51:10.224913+0000 mgr.gibba020.yqfnwy (mgr.34427) 9404 : cluster [DBG] pgmap v5353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:12.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:11 gibba020 bash[25448]: cluster 2021-03-10T16:51:10.224913+0000 mgr.gibba020.yqfnwy (mgr.34427) 9404 : cluster [DBG] pgmap v5353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:14.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:13 gibba013 bash[29418]: cluster 2021-03-10T16:51:12.226060+0000 mgr.gibba020.yqfnwy (mgr.34427) 9405 : cluster [DBG] pgmap v5354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:14.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:13 gibba013 bash[30381]: cluster 2021-03-10T16:51:12.226060+0000 mgr.gibba020.yqfnwy (mgr.34427) 9405 : cluster [DBG] pgmap v5354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:14.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:13 gibba020 bash[25448]: cluster 2021-03-10T16:51:12.226060+0000 mgr.gibba020.yqfnwy (mgr.34427) 9405 : cluster [DBG] pgmap v5354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:16.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:15 gibba013 bash[29418]: cluster 2021-03-10T16:51:14.227588+0000 mgr.gibba020.yqfnwy (mgr.34427) 9406 : cluster [DBG] pgmap v5355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:16.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:15 gibba013 bash[30381]: cluster 2021-03-10T16:51:14.227588+0000 mgr.gibba020.yqfnwy (mgr.34427) 9406 : cluster [DBG] pgmap v5355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:16.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:15 gibba020 bash[25448]: cluster 2021-03-10T16:51:14.227588+0000 mgr.gibba020.yqfnwy (mgr.34427) 9406 : cluster [DBG] pgmap v5355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:18.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:17 gibba013 bash[29418]: cluster 2021-03-10T16:51:16.229262+0000 mgr.gibba020.yqfnwy (mgr.34427) 9407 : cluster [DBG] pgmap v5356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:18.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:17 gibba013 bash[30381]: cluster 2021-03-10T16:51:16.229262+0000 mgr.gibba020.yqfnwy (mgr.34427) 9407 : cluster [DBG] pgmap v5356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:18.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:17 gibba020 bash[25448]: cluster 2021-03-10T16:51:16.229262+0000 mgr.gibba020.yqfnwy (mgr.34427) 9407 : cluster [DBG] pgmap v5356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:20.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:19 gibba013 bash[29418]: cluster 2021-03-10T16:51:18.230620+0000 mgr.gibba020.yqfnwy (mgr.34427) 9408 : cluster [DBG] pgmap v5357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:20.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:19 gibba013 bash[30381]: cluster 2021-03-10T16:51:18.230620+0000 mgr.gibba020.yqfnwy (mgr.34427) 9408 : cluster [DBG] pgmap v5357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:20.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:19 gibba020 bash[25448]: cluster 2021-03-10T16:51:18.230620+0000 mgr.gibba020.yqfnwy (mgr.34427) 9408 : cluster [DBG] pgmap v5357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:21.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:21 gibba013 bash[29418]: cephadm 2021-03-10T16:51:19.410901+0000 mgr.gibba020.yqfnwy (mgr.34427) 9409 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:51:21.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:21 gibba013 bash[30381]: cephadm 2021-03-10T16:51:19.410901+0000 mgr.gibba020.yqfnwy (mgr.34427) 9409 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:51:21.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:21 gibba020 bash[25448]: cephadm 2021-03-10T16:51:19.410901+0000 mgr.gibba020.yqfnwy (mgr.34427) 9409 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:51:22.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:22 gibba013 bash[29418]: cluster 2021-03-10T16:51:20.232260+0000 mgr.gibba020.yqfnwy (mgr.34427) 9410 : cluster [DBG] pgmap v5358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:22.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:22 gibba013 bash[30381]: cluster 2021-03-10T16:51:20.232260+0000 mgr.gibba020.yqfnwy (mgr.34427) 9410 : cluster [DBG] pgmap v5358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:22.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:22 gibba020 bash[25448]: cluster 2021-03-10T16:51:20.232260+0000 mgr.gibba020.yqfnwy (mgr.34427) 9410 : cluster [DBG] pgmap v5358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:24.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:24 gibba013 bash[29418]: cluster 2021-03-10T16:51:22.233503+0000 mgr.gibba020.yqfnwy (mgr.34427) 9411 : cluster [DBG] pgmap v5359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:24.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:24 gibba013 bash[30381]: cluster 2021-03-10T16:51:22.233503+0000 mgr.gibba020.yqfnwy (mgr.34427) 9411 : cluster [DBG] pgmap v5359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:24.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:24 gibba020 bash[25448]: cluster 2021-03-10T16:51:22.233503+0000 mgr.gibba020.yqfnwy (mgr.34427) 9411 : cluster [DBG] pgmap v5359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:26.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:26 gibba013 bash[29418]: cluster 2021-03-10T16:51:24.235129+0000 mgr.gibba020.yqfnwy (mgr.34427) 9412 : cluster [DBG] pgmap v5360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:26.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:26 gibba013 bash[30381]: cluster 2021-03-10T16:51:24.235129+0000 mgr.gibba020.yqfnwy (mgr.34427) 9412 : cluster [DBG] pgmap v5360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:26.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:26 gibba020 bash[25448]: cluster 2021-03-10T16:51:24.235129+0000 mgr.gibba020.yqfnwy (mgr.34427) 9412 : cluster [DBG] pgmap v5360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:28.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:28 gibba013 bash[29418]: cluster 2021-03-10T16:51:26.236569+0000 mgr.gibba020.yqfnwy (mgr.34427) 9413 : cluster [DBG] pgmap v5361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:28.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:28 gibba013 bash[30381]: cluster 2021-03-10T16:51:26.236569+0000 mgr.gibba020.yqfnwy (mgr.34427) 9413 : cluster [DBG] pgmap v5361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:28.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:28 gibba020 bash[25448]: cluster 2021-03-10T16:51:26.236569+0000 mgr.gibba020.yqfnwy (mgr.34427) 9413 : cluster [DBG] pgmap v5361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:30.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:30 gibba013 bash[29418]: cluster 2021-03-10T16:51:28.237962+0000 mgr.gibba020.yqfnwy (mgr.34427) 9414 : cluster [DBG] pgmap v5362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:30.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:30 gibba013 bash[30381]: cluster 2021-03-10T16:51:28.237962+0000 mgr.gibba020.yqfnwy (mgr.34427) 9414 : cluster [DBG] pgmap v5362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:30.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:30 gibba020 bash[25448]: cluster 2021-03-10T16:51:28.237962+0000 mgr.gibba020.yqfnwy (mgr.34427) 9414 : cluster [DBG] pgmap v5362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:32.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:32 gibba013 bash[29418]: cluster 2021-03-10T16:51:30.239535+0000 mgr.gibba020.yqfnwy (mgr.34427) 9415 : cluster [DBG] pgmap v5363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:32.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:32 gibba013 bash[30381]: cluster 2021-03-10T16:51:30.239535+0000 mgr.gibba020.yqfnwy (mgr.34427) 9415 : cluster [DBG] pgmap v5363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:32.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:32 gibba020 bash[25448]: cluster 2021-03-10T16:51:30.239535+0000 mgr.gibba020.yqfnwy (mgr.34427) 9415 : cluster [DBG] pgmap v5363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:34.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:34 gibba013 bash[29418]: cluster 2021-03-10T16:51:32.240857+0000 mgr.gibba020.yqfnwy (mgr.34427) 9416 : cluster [DBG] pgmap v5364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:34.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:34 gibba013 bash[30381]: cluster 2021-03-10T16:51:32.240857+0000 mgr.gibba020.yqfnwy (mgr.34427) 9416 : cluster [DBG] pgmap v5364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:34.426 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:34 gibba020 bash[25448]: cluster 2021-03-10T16:51:32.240857+0000 mgr.gibba020.yqfnwy (mgr.34427) 9416 : cluster [DBG] pgmap v5364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:34.568 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:51:34.822 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:51:34.822 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 30s ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:51:34.823 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 9m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:51:34.823 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:51:34.823 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:51:34.823 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 30s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:51:34.824 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 30s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:51:34.824 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:51:34.824 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 30s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:51:34.824 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 30s ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:51:34.825 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:51:34.825 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 30s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:51:34.825 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 30s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:51:34.825 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 30s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:51:34.825 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 30s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:51:34.826 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:51:34.826 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:51:34.826 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:51:34.826 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:51:34.827 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 9m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:51:34.827 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 9m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:51:35.081 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:51:35.082 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:51:35.082 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:51:35.082 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:51:35.083 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:51:35.083 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:51:35.083 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:51:35.083 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:51:35.084 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:51:35.084 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:51:35.084 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:51:35.084 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:51:35.084 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:51:35.085 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:51:35.085 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:51:36.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:36 gibba013 bash[29418]: cluster 2021-03-10T16:51:34.242494+0000 mgr.gibba020.yqfnwy (mgr.34427) 9417 : cluster [DBG] pgmap v5365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:36.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:36 gibba013 bash[29418]: cephadm 2021-03-10T16:51:34.426815+0000 mgr.gibba020.yqfnwy (mgr.34427) 9418 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:51:36.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:36 gibba013 bash[29418]: audit 2021-03-10T16:51:34.558320+0000 mgr.gibba020.yqfnwy (mgr.34427) 9419 : audit [DBG] from='client.50370 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:51:36.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:36 gibba013 bash[29418]: audit 2021-03-10T16:51:34.782056+0000 mgr.gibba020.yqfnwy (mgr.34427) 9420 : audit [DBG] from='client.60358 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:51:36.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:36 gibba013 bash[29418]: audit 2021-03-10T16:51:35.083325+0000 mon.a (mon.0) 3406 : audit [DBG] from='client.? 172.21.2.113:0/1658951498' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:36.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:36 gibba013 bash[30381]: cluster 2021-03-10T16:51:34.242494+0000 mgr.gibba020.yqfnwy (mgr.34427) 9417 : cluster [DBG] pgmap v5365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:36.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:36 gibba013 bash[30381]: cephadm 2021-03-10T16:51:34.426815+0000 mgr.gibba020.yqfnwy (mgr.34427) 9418 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:51:36.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:36 gibba013 bash[30381]: audit 2021-03-10T16:51:34.558320+0000 mgr.gibba020.yqfnwy (mgr.34427) 9419 : audit [DBG] from='client.50370 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:51:36.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:36 gibba013 bash[30381]: audit 2021-03-10T16:51:34.782056+0000 mgr.gibba020.yqfnwy (mgr.34427) 9420 : audit [DBG] from='client.60358 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:51:36.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:36 gibba013 bash[30381]: audit 2021-03-10T16:51:35.083325+0000 mon.a (mon.0) 3406 : audit [DBG] from='client.? 172.21.2.113:0/1658951498' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:36.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:36 gibba020 bash[25448]: cluster 2021-03-10T16:51:34.242494+0000 mgr.gibba020.yqfnwy (mgr.34427) 9417 : cluster [DBG] pgmap v5365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:36.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:36 gibba020 bash[25448]: cephadm 2021-03-10T16:51:34.426815+0000 mgr.gibba020.yqfnwy (mgr.34427) 9418 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:51:36.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:36 gibba020 bash[25448]: audit 2021-03-10T16:51:34.558320+0000 mgr.gibba020.yqfnwy (mgr.34427) 9419 : audit [DBG] from='client.50370 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:51:36.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:36 gibba020 bash[25448]: audit 2021-03-10T16:51:34.782056+0000 mgr.gibba020.yqfnwy (mgr.34427) 9420 : audit [DBG] from='client.60358 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:51:36.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:36 gibba020 bash[25448]: audit 2021-03-10T16:51:35.083325+0000 mon.a (mon.0) 3406 : audit [DBG] from='client.? 172.21.2.113:0/1658951498' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:51:38.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:38 gibba013 bash[29418]: cluster 2021-03-10T16:51:36.244150+0000 mgr.gibba020.yqfnwy (mgr.34427) 9421 : cluster [DBG] pgmap v5366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:38.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:38 gibba013 bash[30381]: cluster 2021-03-10T16:51:36.244150+0000 mgr.gibba020.yqfnwy (mgr.34427) 9421 : cluster [DBG] pgmap v5366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:38.445 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:38 gibba020 bash[25448]: cluster 2021-03-10T16:51:36.244150+0000 mgr.gibba020.yqfnwy (mgr.34427) 9421 : cluster [DBG] pgmap v5366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:40.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:40 gibba013 bash[29418]: cluster 2021-03-10T16:51:38.245627+0000 mgr.gibba020.yqfnwy (mgr.34427) 9422 : cluster [DBG] pgmap v5367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:40.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:40 gibba013 bash[30381]: cluster 2021-03-10T16:51:38.245627+0000 mgr.gibba020.yqfnwy (mgr.34427) 9422 : cluster [DBG] pgmap v5367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:40.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:40 gibba020 bash[25448]: cluster 2021-03-10T16:51:38.245627+0000 mgr.gibba020.yqfnwy (mgr.34427) 9422 : cluster [DBG] pgmap v5367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:42.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:42 gibba013 bash[29418]: cluster 2021-03-10T16:51:40.247044+0000 mgr.gibba020.yqfnwy (mgr.34427) 9423 : cluster [DBG] pgmap v5368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:42.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:42 gibba013 bash[30381]: cluster 2021-03-10T16:51:40.247044+0000 mgr.gibba020.yqfnwy (mgr.34427) 9423 : cluster [DBG] pgmap v5368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:42.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:42 gibba020 bash[25448]: cluster 2021-03-10T16:51:40.247044+0000 mgr.gibba020.yqfnwy (mgr.34427) 9423 : cluster [DBG] pgmap v5368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:44.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:44 gibba013 bash[29418]: cluster 2021-03-10T16:51:42.248616+0000 mgr.gibba020.yqfnwy (mgr.34427) 9424 : cluster [DBG] pgmap v5369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:44.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:44 gibba013 bash[30381]: cluster 2021-03-10T16:51:42.248616+0000 mgr.gibba020.yqfnwy (mgr.34427) 9424 : cluster [DBG] pgmap v5369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:44.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:44 gibba020 bash[25448]: cluster 2021-03-10T16:51:42.248616+0000 mgr.gibba020.yqfnwy (mgr.34427) 9424 : cluster [DBG] pgmap v5369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:46.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:46 gibba013 bash[29418]: cluster 2021-03-10T16:51:44.249996+0000 mgr.gibba020.yqfnwy (mgr.34427) 9425 : cluster [DBG] pgmap v5370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:46.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:46 gibba013 bash[30381]: cluster 2021-03-10T16:51:44.249996+0000 mgr.gibba020.yqfnwy (mgr.34427) 9425 : cluster [DBG] pgmap v5370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:46.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:46 gibba020 bash[25448]: cluster 2021-03-10T16:51:44.249996+0000 mgr.gibba020.yqfnwy (mgr.34427) 9425 : cluster [DBG] pgmap v5370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:48.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:48 gibba013 bash[29418]: cluster 2021-03-10T16:51:46.251628+0000 mgr.gibba020.yqfnwy (mgr.34427) 9426 : cluster [DBG] pgmap v5371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:48.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:48 gibba013 bash[30381]: cluster 2021-03-10T16:51:46.251628+0000 mgr.gibba020.yqfnwy (mgr.34427) 9426 : cluster [DBG] pgmap v5371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:48.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:48 gibba020 bash[25448]: cluster 2021-03-10T16:51:46.251628+0000 mgr.gibba020.yqfnwy (mgr.34427) 9426 : cluster [DBG] pgmap v5371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:50.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:50 gibba020 bash[25448]: cluster 2021-03-10T16:51:48.253143+0000 mgr.gibba020.yqfnwy (mgr.34427) 9427 : cluster [DBG] pgmap v5372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:50.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:50 gibba013 bash[29418]: cluster 2021-03-10T16:51:48.253143+0000 mgr.gibba020.yqfnwy (mgr.34427) 9427 : cluster [DBG] pgmap v5372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:50.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:50 gibba013 bash[30381]: cluster 2021-03-10T16:51:48.253143+0000 mgr.gibba020.yqfnwy (mgr.34427) 9427 : cluster [DBG] pgmap v5372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:51.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:51 gibba020 bash[25448]: cephadm 2021-03-10T16:51:49.428958+0000 mgr.gibba020.yqfnwy (mgr.34427) 9428 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:51:51.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:51 gibba013 bash[29418]: cephadm 2021-03-10T16:51:49.428958+0000 mgr.gibba020.yqfnwy (mgr.34427) 9428 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:51:51.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:51 gibba013 bash[30381]: cephadm 2021-03-10T16:51:49.428958+0000 mgr.gibba020.yqfnwy (mgr.34427) 9428 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:51:52.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:52 gibba020 bash[25448]: cluster 2021-03-10T16:51:50.254989+0000 mgr.gibba020.yqfnwy (mgr.34427) 9429 : cluster [DBG] pgmap v5373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:52.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:52 gibba013 bash[29418]: cluster 2021-03-10T16:51:50.254989+0000 mgr.gibba020.yqfnwy (mgr.34427) 9429 : cluster [DBG] pgmap v5373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:52.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:52 gibba013 bash[30381]: cluster 2021-03-10T16:51:50.254989+0000 mgr.gibba020.yqfnwy (mgr.34427) 9429 : cluster [DBG] pgmap v5373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:54.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:54 gibba020 bash[25448]: cluster 2021-03-10T16:51:52.256440+0000 mgr.gibba020.yqfnwy (mgr.34427) 9430 : cluster [DBG] pgmap v5374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:54.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:54 gibba013 bash[29418]: cluster 2021-03-10T16:51:52.256440+0000 mgr.gibba020.yqfnwy (mgr.34427) 9430 : cluster [DBG] pgmap v5374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:54.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:54 gibba013 bash[30381]: cluster 2021-03-10T16:51:52.256440+0000 mgr.gibba020.yqfnwy (mgr.34427) 9430 : cluster [DBG] pgmap v5374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:56.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:56 gibba020 bash[25448]: cluster 2021-03-10T16:51:54.258072+0000 mgr.gibba020.yqfnwy (mgr.34427) 9431 : cluster [DBG] pgmap v5375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:56.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:56 gibba013 bash[29418]: cluster 2021-03-10T16:51:54.258072+0000 mgr.gibba020.yqfnwy (mgr.34427) 9431 : cluster [DBG] pgmap v5375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:56.627 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:56 gibba013 bash[30381]: cluster 2021-03-10T16:51:54.258072+0000 mgr.gibba020.yqfnwy (mgr.34427) 9431 : cluster [DBG] pgmap v5375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:58.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:51:58 gibba020 bash[25448]: cluster 2021-03-10T16:51:56.260221+0000 mgr.gibba020.yqfnwy (mgr.34427) 9432 : cluster [DBG] pgmap v5376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:58.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:51:58 gibba013 bash[29418]: cluster 2021-03-10T16:51:56.260221+0000 mgr.gibba020.yqfnwy (mgr.34427) 9432 : cluster [DBG] pgmap v5376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:51:58.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:51:58 gibba013 bash[30381]: cluster 2021-03-10T16:51:56.260221+0000 mgr.gibba020.yqfnwy (mgr.34427) 9432 : cluster [DBG] pgmap v5376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:00.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:00 gibba020 bash[25448]: cluster 2021-03-10T16:51:58.261781+0000 mgr.gibba020.yqfnwy (mgr.34427) 9433 : cluster [DBG] pgmap v5377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:00.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:00 gibba013 bash[29418]: cluster 2021-03-10T16:51:58.261781+0000 mgr.gibba020.yqfnwy (mgr.34427) 9433 : cluster [DBG] pgmap v5377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:00.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:00 gibba013 bash[30381]: cluster 2021-03-10T16:51:58.261781+0000 mgr.gibba020.yqfnwy (mgr.34427) 9433 : cluster [DBG] pgmap v5377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:02.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:02 gibba020 bash[25448]: cluster 2021-03-10T16:52:00.263629+0000 mgr.gibba020.yqfnwy (mgr.34427) 9434 : cluster [DBG] pgmap v5378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:02.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:02 gibba013 bash[29418]: cluster 2021-03-10T16:52:00.263629+0000 mgr.gibba020.yqfnwy (mgr.34427) 9434 : cluster [DBG] pgmap v5378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:02.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:02 gibba013 bash[30381]: cluster 2021-03-10T16:52:00.263629+0000 mgr.gibba020.yqfnwy (mgr.34427) 9434 : cluster [DBG] pgmap v5378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:04.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:04 gibba013 bash[29418]: cluster 2021-03-10T16:52:02.265196+0000 mgr.gibba020.yqfnwy (mgr.34427) 9435 : cluster [DBG] pgmap v5379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:04.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:04 gibba013 bash[30381]: cluster 2021-03-10T16:52:02.265196+0000 mgr.gibba020.yqfnwy (mgr.34427) 9435 : cluster [DBG] pgmap v5379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:04.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:04 gibba020 bash[25448]: cluster 2021-03-10T16:52:02.265196+0000 mgr.gibba020.yqfnwy (mgr.34427) 9435 : cluster [DBG] pgmap v5379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:05.327 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:52:05.559 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:52:05.559 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 61s ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:52:05.559 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 10m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:52:05.560 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:52:05.560 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:52:05.560 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 61s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:52:05.560 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 61s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:52:05.561 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:52:05.561 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 61s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:52:05.561 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 61s ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:52:05.561 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 10m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:52:05.562 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 61s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:52:05.562 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 61s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:52:05.562 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 61s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:52:05.562 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 61s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:52:05.562 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:52:05.563 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:52:05.563 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:52:05.563 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:52:05.563 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 10m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:52:05.564 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 10m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:52:05.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:05 gibba013 bash[29418]: audit 2021-03-10T16:52:04.436045+0000 mon.a (mon.0) 3407 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:52:05.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:05 gibba013 bash[29418]: audit 2021-03-10T16:52:04.443402+0000 mon.a (mon.0) 3408 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:52:05.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:05 gibba013 bash[30381]: audit 2021-03-10T16:52:04.436045+0000 mon.a (mon.0) 3407 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:52:05.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:05 gibba013 bash[30381]: audit 2021-03-10T16:52:04.443402+0000 mon.a (mon.0) 3408 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:52:05.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:05 gibba020 bash[25448]: audit 2021-03-10T16:52:04.436045+0000 mon.a (mon.0) 3407 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:52:05.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:05 gibba020 bash[25448]: audit 2021-03-10T16:52:04.443402+0000 mon.a (mon.0) 3408 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:52:05.809 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:52:05.809 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:52:05.810 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:52:05.810 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:52:05.810 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:52:05.810 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:52:05.811 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:52:05.811 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:52:05.811 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:52:05.811 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:52:05.812 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:52:05.812 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:52:05.812 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:52:05.812 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:52:05.812 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:52:06.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:06 gibba013 bash[29418]: cluster 2021-03-10T16:52:04.266431+0000 mgr.gibba020.yqfnwy (mgr.34427) 9436 : cluster [DBG] pgmap v5380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:06.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:06 gibba013 bash[29418]: cephadm 2021-03-10T16:52:04.440880+0000 mgr.gibba020.yqfnwy (mgr.34427) 9437 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:52:06.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:06 gibba013 bash[29418]: audit 2021-03-10T16:52:05.810586+0000 mon.a (mon.0) 3409 : audit [DBG] from='client.? 172.21.2.113:0/3784842850' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:06.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:06 gibba013 bash[30381]: cluster 2021-03-10T16:52:04.266431+0000 mgr.gibba020.yqfnwy (mgr.34427) 9436 : cluster [DBG] pgmap v5380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:06.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:06 gibba013 bash[30381]: cephadm 2021-03-10T16:52:04.440880+0000 mgr.gibba020.yqfnwy (mgr.34427) 9437 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:52:06.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:06 gibba013 bash[30381]: audit 2021-03-10T16:52:05.810586+0000 mon.a (mon.0) 3409 : audit [DBG] from='client.? 172.21.2.113:0/3784842850' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:06.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:06 gibba020 bash[25448]: cluster 2021-03-10T16:52:04.266431+0000 mgr.gibba020.yqfnwy (mgr.34427) 9436 : cluster [DBG] pgmap v5380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:06.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:06 gibba020 bash[25448]: cephadm 2021-03-10T16:52:04.440880+0000 mgr.gibba020.yqfnwy (mgr.34427) 9437 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:52:06.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:06 gibba020 bash[25448]: audit 2021-03-10T16:52:05.810586+0000 mon.a (mon.0) 3409 : audit [DBG] from='client.? 172.21.2.113:0/3784842850' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:07.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:07 gibba013 bash[29418]: audit 2021-03-10T16:52:05.319270+0000 mgr.gibba020.yqfnwy (mgr.34427) 9438 : audit [DBG] from='client.50388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:52:07.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:07 gibba013 bash[29418]: audit 2021-03-10T16:52:05.547052+0000 mgr.gibba020.yqfnwy (mgr.34427) 9439 : audit [DBG] from='client.50394 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:52:07.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:07 gibba013 bash[29418]: audit 2021-03-10T16:52:06.822035+0000 mon.a (mon.0) 3410 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:52:07.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:07 gibba013 bash[29418]: audit 2021-03-10T16:52:07.003014+0000 mon.a (mon.0) 3411 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:52:07.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:07 gibba013 bash[30381]: audit 2021-03-10T16:52:05.319270+0000 mgr.gibba020.yqfnwy (mgr.34427) 9438 : audit [DBG] from='client.50388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:52:07.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:07 gibba013 bash[30381]: audit 2021-03-10T16:52:05.547052+0000 mgr.gibba020.yqfnwy (mgr.34427) 9439 : audit [DBG] from='client.50394 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:52:07.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:07 gibba013 bash[30381]: audit 2021-03-10T16:52:06.822035+0000 mon.a (mon.0) 3410 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:52:07.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:07 gibba013 bash[30381]: audit 2021-03-10T16:52:07.003014+0000 mon.a (mon.0) 3411 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:52:07.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:07 gibba020 bash[25448]: audit 2021-03-10T16:52:05.319270+0000 mgr.gibba020.yqfnwy (mgr.34427) 9438 : audit [DBG] from='client.50388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:52:07.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:07 gibba020 bash[25448]: audit 2021-03-10T16:52:05.547052+0000 mgr.gibba020.yqfnwy (mgr.34427) 9439 : audit [DBG] from='client.50394 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:52:07.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:07 gibba020 bash[25448]: audit 2021-03-10T16:52:06.822035+0000 mon.a (mon.0) 3410 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:52:07.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:07 gibba020 bash[25448]: audit 2021-03-10T16:52:07.003014+0000 mon.a (mon.0) 3411 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:52:08.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:08 gibba013 bash[29418]: cluster 2021-03-10T16:52:06.267489+0000 mgr.gibba020.yqfnwy (mgr.34427) 9440 : cluster [DBG] pgmap v5381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:08.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:08 gibba013 bash[29418]: audit 2021-03-10T16:52:07.373797+0000 mon.a (mon.0) 3412 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:52:08.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:08 gibba013 bash[29418]: audit 2021-03-10T16:52:07.374566+0000 mon.a (mon.0) 3413 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:52:08.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:08 gibba013 bash[29418]: audit 2021-03-10T16:52:07.375250+0000 mon.a (mon.0) 3414 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:52:08.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:08 gibba013 bash[29418]: audit 2021-03-10T16:52:07.375890+0000 mon.a (mon.0) 3415 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:52:08.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:08 gibba013 bash[29418]: audit 2021-03-10T16:52:08.121593+0000 mon.a (mon.0) 3416 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:52:08.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:08 gibba013 bash[29418]: audit 2021-03-10T16:52:08.122368+0000 mon.a (mon.0) 3417 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T16:52:08.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:08 gibba013 bash[30381]: cluster 2021-03-10T16:52:06.267489+0000 mgr.gibba020.yqfnwy (mgr.34427) 9440 : cluster [DBG] pgmap v5381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:08.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:08 gibba013 bash[30381]: audit 2021-03-10T16:52:07.373797+0000 mon.a (mon.0) 3412 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:52:08.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:08 gibba013 bash[30381]: audit 2021-03-10T16:52:07.374566+0000 mon.a (mon.0) 3413 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:52:08.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:08 gibba013 bash[30381]: audit 2021-03-10T16:52:07.375250+0000 mon.a (mon.0) 3414 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:52:08.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:08 gibba013 bash[30381]: audit 2021-03-10T16:52:07.375890+0000 mon.a (mon.0) 3415 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:52:08.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:08 gibba013 bash[30381]: audit 2021-03-10T16:52:08.121593+0000 mon.a (mon.0) 3416 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:52:08.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:08 gibba013 bash[30381]: audit 2021-03-10T16:52:08.122368+0000 mon.a (mon.0) 3417 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T16:52:08.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:08 gibba020 bash[25448]: cluster 2021-03-10T16:52:06.267489+0000 mgr.gibba020.yqfnwy (mgr.34427) 9440 : cluster [DBG] pgmap v5381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:08.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:08 gibba020 bash[25448]: audit 2021-03-10T16:52:07.373797+0000 mon.a (mon.0) 3412 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T16:52:08.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:08 gibba020 bash[25448]: audit 2021-03-10T16:52:07.374566+0000 mon.a (mon.0) 3413 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T16:52:08.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:08 gibba020 bash[25448]: audit 2021-03-10T16:52:07.375250+0000 mon.a (mon.0) 3414 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T16:52:08.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:08 gibba020 bash[25448]: audit 2021-03-10T16:52:07.375890+0000 mon.a (mon.0) 3415 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:52:08.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:08 gibba020 bash[25448]: audit 2021-03-10T16:52:08.121593+0000 mon.a (mon.0) 3416 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:52:08.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:08 gibba020 bash[25448]: audit 2021-03-10T16:52:08.122368+0000 mon.a (mon.0) 3417 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T16:52:10.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:10 gibba020 bash[25448]: cluster 2021-03-10T16:52:08.267925+0000 mgr.gibba020.yqfnwy (mgr.34427) 9441 : cluster [DBG] pgmap v5382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:10.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:10 gibba013 bash[29418]: cluster 2021-03-10T16:52:08.267925+0000 mgr.gibba020.yqfnwy (mgr.34427) 9441 : cluster [DBG] pgmap v5382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:10.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:10 gibba013 bash[30381]: cluster 2021-03-10T16:52:08.267925+0000 mgr.gibba020.yqfnwy (mgr.34427) 9441 : cluster [DBG] pgmap v5382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:11.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:11 gibba013 bash[29418]: cluster 2021-03-10T16:52:10.269228+0000 mgr.gibba020.yqfnwy (mgr.34427) 9442 : cluster [DBG] pgmap v5383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:11.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:11 gibba013 bash[30381]: cluster 2021-03-10T16:52:10.269228+0000 mgr.gibba020.yqfnwy (mgr.34427) 9442 : cluster [DBG] pgmap v5383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:11.695 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:11 gibba020 bash[25448]: cluster 2021-03-10T16:52:10.269228+0000 mgr.gibba020.yqfnwy (mgr.34427) 9442 : cluster [DBG] pgmap v5383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:13.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:13 gibba013 bash[29418]: cluster 2021-03-10T16:52:12.269863+0000 mgr.gibba020.yqfnwy (mgr.34427) 9443 : cluster [DBG] pgmap v5384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:13.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:13 gibba013 bash[29418]: audit 2021-03-10T16:52:12.936847+0000 mon.a (mon.0) 3418 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:52:13.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:13 gibba013 bash[29418]: audit 2021-03-10T16:52:13.110428+0000 mon.a (mon.0) 3419 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:52:13.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:13 gibba013 bash[29418]: cephadm 2021-03-10T16:52:13.110554+0000 mgr.gibba020.yqfnwy (mgr.34427) 9444 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:52:13.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:13 gibba013 bash[30381]: cluster 2021-03-10T16:52:12.269863+0000 mgr.gibba020.yqfnwy (mgr.34427) 9443 : cluster [DBG] pgmap v5384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:13.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:13 gibba013 bash[30381]: audit 2021-03-10T16:52:12.936847+0000 mon.a (mon.0) 3418 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:52:13.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:13 gibba013 bash[30381]: audit 2021-03-10T16:52:13.110428+0000 mon.a (mon.0) 3419 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:52:13.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:13 gibba013 bash[30381]: cephadm 2021-03-10T16:52:13.110554+0000 mgr.gibba020.yqfnwy (mgr.34427) 9444 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:52:13.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:13 gibba020 bash[25448]: cluster 2021-03-10T16:52:12.269863+0000 mgr.gibba020.yqfnwy (mgr.34427) 9443 : cluster [DBG] pgmap v5384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:13.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:13 gibba020 bash[25448]: audit 2021-03-10T16:52:12.936847+0000 mon.a (mon.0) 3418 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T16:52:13.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:13 gibba020 bash[25448]: audit 2021-03-10T16:52:13.110428+0000 mon.a (mon.0) 3419 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:52:13.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:13 gibba020 bash[25448]: cephadm 2021-03-10T16:52:13.110554+0000 mgr.gibba020.yqfnwy (mgr.34427) 9444 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:52:14.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:14 gibba013 bash[29418]: audit 2021-03-10T16:52:13.301385+0000 mon.a (mon.0) 3420 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:52:14.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:14 gibba013 bash[29418]: cephadm 2021-03-10T16:52:13.303230+0000 mgr.gibba020.yqfnwy (mgr.34427) 9445 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:52:14.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:14 gibba013 bash[29418]: audit 2021-03-10T16:52:13.304686+0000 mon.a (mon.0) 3421 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:52:14.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:14 gibba013 bash[29418]: cephadm 2021-03-10T16:52:13.305300+0000 mgr.gibba020.yqfnwy (mgr.34427) 9446 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:52:14.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:14 gibba013 bash[29418]: audit 2021-03-10T16:52:13.306384+0000 mon.a (mon.0) 3422 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:14.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:14 gibba013 bash[29418]: cephadm 2021-03-10T16:52:13.306852+0000 mgr.gibba020.yqfnwy (mgr.34427) 9447 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:52:14.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:14 gibba013 bash[29418]: cephadm 2021-03-10T16:52:13.306971+0000 mgr.gibba020.yqfnwy (mgr.34427) 9448 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:52:14.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:14 gibba013 bash[29418]: audit 2021-03-10T16:52:13.308183+0000 mon.a (mon.0) 3423 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:14.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:14 gibba013 bash[29418]: cephadm 2021-03-10T16:52:13.308527+0000 mgr.gibba020.yqfnwy (mgr.34427) 9449 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:52:14.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:14 gibba013 bash[29418]: cephadm 2021-03-10T16:52:13.308622+0000 mgr.gibba020.yqfnwy (mgr.34427) 9450 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:52:14.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:14 gibba013 bash[29418]: audit 2021-03-10T16:52:13.309604+0000 mon.a (mon.0) 3424 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:14.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:14 gibba013 bash[29418]: cephadm 2021-03-10T16:52:13.309690+0000 mgr.gibba020.yqfnwy (mgr.34427) 9451 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:52:14.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:14 gibba013 bash[29418]: cephadm 2021-03-10T16:52:13.310854+0000 mgr.gibba020.yqfnwy (mgr.34427) 9452 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:52:14.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:14 gibba013 bash[29418]: cephadm 2021-03-10T16:52:13.310892+0000 mgr.gibba020.yqfnwy (mgr.34427) 9453 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:52:14.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:14 gibba013 bash[29418]: audit 2021-03-10T16:52:13.311962+0000 mon.a (mon.0) 3425 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:14.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:14 gibba013 bash[29418]: cephadm 2021-03-10T16:52:13.312095+0000 mgr.gibba020.yqfnwy (mgr.34427) 9454 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:52:14.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:14 gibba013 bash[29418]: cephadm 2021-03-10T16:52:13.312414+0000 mgr.gibba020.yqfnwy (mgr.34427) 9455 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:52:14.639 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:14 gibba013 bash[29418]: audit 2021-03-10T16:52:13.313363+0000 mon.a (mon.0) 3426 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:14.640 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:14 gibba013 bash[29418]: cephadm 2021-03-10T16:52:13.313527+0000 mgr.gibba020.yqfnwy (mgr.34427) 9456 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:52:14.640 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:14 gibba013 bash[29418]: cephadm 2021-03-10T16:52:13.313595+0000 mgr.gibba020.yqfnwy (mgr.34427) 9457 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:52:14.641 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:14 gibba013 bash[29418]: cephadm 2021-03-10T16:52:13.313699+0000 mgr.gibba020.yqfnwy (mgr.34427) 9458 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:52:14.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:14 gibba013 bash[30381]: audit 2021-03-10T16:52:13.301385+0000 mon.a (mon.0) 3420 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:52:14.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:14 gibba013 bash[30381]: cephadm 2021-03-10T16:52:13.303230+0000 mgr.gibba020.yqfnwy (mgr.34427) 9445 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:52:14.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:14 gibba013 bash[30381]: audit 2021-03-10T16:52:13.304686+0000 mon.a (mon.0) 3421 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:52:14.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:14 gibba013 bash[30381]: cephadm 2021-03-10T16:52:13.305300+0000 mgr.gibba020.yqfnwy (mgr.34427) 9446 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:52:14.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:14 gibba013 bash[30381]: audit 2021-03-10T16:52:13.306384+0000 mon.a (mon.0) 3422 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:14.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:14 gibba013 bash[30381]: cephadm 2021-03-10T16:52:13.306852+0000 mgr.gibba020.yqfnwy (mgr.34427) 9447 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:52:14.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:14 gibba013 bash[30381]: cephadm 2021-03-10T16:52:13.306971+0000 mgr.gibba020.yqfnwy (mgr.34427) 9448 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:52:14.644 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:14 gibba013 bash[30381]: audit 2021-03-10T16:52:13.308183+0000 mon.a (mon.0) 3423 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:14.644 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:14 gibba013 bash[30381]: cephadm 2021-03-10T16:52:13.308527+0000 mgr.gibba020.yqfnwy (mgr.34427) 9449 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:52:14.644 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:14 gibba013 bash[30381]: cephadm 2021-03-10T16:52:13.308622+0000 mgr.gibba020.yqfnwy (mgr.34427) 9450 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:52:14.645 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:14 gibba013 bash[30381]: audit 2021-03-10T16:52:13.309604+0000 mon.a (mon.0) 3424 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:14.645 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:14 gibba013 bash[30381]: cephadm 2021-03-10T16:52:13.309690+0000 mgr.gibba020.yqfnwy (mgr.34427) 9451 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:52:14.645 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:14 gibba013 bash[30381]: cephadm 2021-03-10T16:52:13.310854+0000 mgr.gibba020.yqfnwy (mgr.34427) 9452 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:52:14.645 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:14 gibba013 bash[30381]: cephadm 2021-03-10T16:52:13.310892+0000 mgr.gibba020.yqfnwy (mgr.34427) 9453 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:52:14.645 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:14 gibba013 bash[30381]: audit 2021-03-10T16:52:13.311962+0000 mon.a (mon.0) 3425 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:14.646 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:14 gibba013 bash[30381]: cephadm 2021-03-10T16:52:13.312095+0000 mgr.gibba020.yqfnwy (mgr.34427) 9454 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:52:14.646 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:14 gibba013 bash[30381]: cephadm 2021-03-10T16:52:13.312414+0000 mgr.gibba020.yqfnwy (mgr.34427) 9455 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:52:14.646 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:14 gibba013 bash[30381]: audit 2021-03-10T16:52:13.313363+0000 mon.a (mon.0) 3426 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:14.646 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:14 gibba013 bash[30381]: cephadm 2021-03-10T16:52:13.313527+0000 mgr.gibba020.yqfnwy (mgr.34427) 9456 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:52:14.647 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:14 gibba013 bash[30381]: cephadm 2021-03-10T16:52:13.313595+0000 mgr.gibba020.yqfnwy (mgr.34427) 9457 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:52:14.647 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:14 gibba013 bash[30381]: cephadm 2021-03-10T16:52:13.313699+0000 mgr.gibba020.yqfnwy (mgr.34427) 9458 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:52:14.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:14 gibba020 bash[25448]: audit 2021-03-10T16:52:13.301385+0000 mon.a (mon.0) 3420 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:52:14.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:14 gibba020 bash[25448]: cephadm 2021-03-10T16:52:13.303230+0000 mgr.gibba020.yqfnwy (mgr.34427) 9445 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:52:14.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:14 gibba020 bash[25448]: audit 2021-03-10T16:52:13.304686+0000 mon.a (mon.0) 3421 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:52:14.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:14 gibba020 bash[25448]: cephadm 2021-03-10T16:52:13.305300+0000 mgr.gibba020.yqfnwy (mgr.34427) 9446 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:52:14.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:14 gibba020 bash[25448]: audit 2021-03-10T16:52:13.306384+0000 mon.a (mon.0) 3422 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:14.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:14 gibba020 bash[25448]: cephadm 2021-03-10T16:52:13.306852+0000 mgr.gibba020.yqfnwy (mgr.34427) 9447 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:52:14.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:14 gibba020 bash[25448]: cephadm 2021-03-10T16:52:13.306971+0000 mgr.gibba020.yqfnwy (mgr.34427) 9448 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:52:14.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:14 gibba020 bash[25448]: audit 2021-03-10T16:52:13.308183+0000 mon.a (mon.0) 3423 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:14.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:14 gibba020 bash[25448]: cephadm 2021-03-10T16:52:13.308527+0000 mgr.gibba020.yqfnwy (mgr.34427) 9449 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:52:14.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:14 gibba020 bash[25448]: cephadm 2021-03-10T16:52:13.308622+0000 mgr.gibba020.yqfnwy (mgr.34427) 9450 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:52:14.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:14 gibba020 bash[25448]: audit 2021-03-10T16:52:13.309604+0000 mon.a (mon.0) 3424 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:14.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:14 gibba020 bash[25448]: cephadm 2021-03-10T16:52:13.309690+0000 mgr.gibba020.yqfnwy (mgr.34427) 9451 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:52:14.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:14 gibba020 bash[25448]: cephadm 2021-03-10T16:52:13.310854+0000 mgr.gibba020.yqfnwy (mgr.34427) 9452 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:52:14.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:14 gibba020 bash[25448]: cephadm 2021-03-10T16:52:13.310892+0000 mgr.gibba020.yqfnwy (mgr.34427) 9453 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:52:14.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:14 gibba020 bash[25448]: audit 2021-03-10T16:52:13.311962+0000 mon.a (mon.0) 3425 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:14.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:14 gibba020 bash[25448]: cephadm 2021-03-10T16:52:13.312095+0000 mgr.gibba020.yqfnwy (mgr.34427) 9454 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:52:14.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:14 gibba020 bash[25448]: cephadm 2021-03-10T16:52:13.312414+0000 mgr.gibba020.yqfnwy (mgr.34427) 9455 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:52:14.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:14 gibba020 bash[25448]: audit 2021-03-10T16:52:13.313363+0000 mon.a (mon.0) 3426 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:14.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:14 gibba020 bash[25448]: cephadm 2021-03-10T16:52:13.313527+0000 mgr.gibba020.yqfnwy (mgr.34427) 9456 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:52:14.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:14 gibba020 bash[25448]: cephadm 2021-03-10T16:52:13.313595+0000 mgr.gibba020.yqfnwy (mgr.34427) 9457 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:52:14.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:14 gibba020 bash[25448]: cephadm 2021-03-10T16:52:13.313699+0000 mgr.gibba020.yqfnwy (mgr.34427) 9458 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:52:16.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:15 gibba013 bash[29418]: cluster 2021-03-10T16:52:14.271276+0000 mgr.gibba020.yqfnwy (mgr.34427) 9459 : cluster [DBG] pgmap v5385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:16.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:15 gibba013 bash[30381]: cluster 2021-03-10T16:52:14.271276+0000 mgr.gibba020.yqfnwy (mgr.34427) 9459 : cluster [DBG] pgmap v5385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:16.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:15 gibba020 bash[25448]: cluster 2021-03-10T16:52:14.271276+0000 mgr.gibba020.yqfnwy (mgr.34427) 9459 : cluster [DBG] pgmap v5385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:18.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:17 gibba013 bash[29418]: cluster 2021-03-10T16:52:16.273233+0000 mgr.gibba020.yqfnwy (mgr.34427) 9460 : cluster [DBG] pgmap v5386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:18.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:17 gibba013 bash[30381]: cluster 2021-03-10T16:52:16.273233+0000 mgr.gibba020.yqfnwy (mgr.34427) 9460 : cluster [DBG] pgmap v5386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:18.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:17 gibba020 bash[25448]: cluster 2021-03-10T16:52:16.273233+0000 mgr.gibba020.yqfnwy (mgr.34427) 9460 : cluster [DBG] pgmap v5386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:20.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:20 gibba013 bash[29418]: cluster 2021-03-10T16:52:18.274670+0000 mgr.gibba020.yqfnwy (mgr.34427) 9461 : cluster [DBG] pgmap v5387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:20.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:20 gibba013 bash[30381]: cluster 2021-03-10T16:52:18.274670+0000 mgr.gibba020.yqfnwy (mgr.34427) 9461 : cluster [DBG] pgmap v5387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:20.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:20 gibba020 bash[25448]: cluster 2021-03-10T16:52:18.274670+0000 mgr.gibba020.yqfnwy (mgr.34427) 9461 : cluster [DBG] pgmap v5387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:22.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:22 gibba013 bash[29418]: cluster 2021-03-10T16:52:20.276223+0000 mgr.gibba020.yqfnwy (mgr.34427) 9462 : cluster [DBG] pgmap v5388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:22.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:22 gibba013 bash[30381]: cluster 2021-03-10T16:52:20.276223+0000 mgr.gibba020.yqfnwy (mgr.34427) 9462 : cluster [DBG] pgmap v5388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:22.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:22 gibba020 bash[25448]: cluster 2021-03-10T16:52:20.276223+0000 mgr.gibba020.yqfnwy (mgr.34427) 9462 : cluster [DBG] pgmap v5388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:24.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:24 gibba013 bash[29418]: cluster 2021-03-10T16:52:22.277690+0000 mgr.gibba020.yqfnwy (mgr.34427) 9463 : cluster [DBG] pgmap v5389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:24.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:24 gibba013 bash[30381]: cluster 2021-03-10T16:52:22.277690+0000 mgr.gibba020.yqfnwy (mgr.34427) 9463 : cluster [DBG] pgmap v5389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:24.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:24 gibba020 bash[25448]: cluster 2021-03-10T16:52:22.277690+0000 mgr.gibba020.yqfnwy (mgr.34427) 9463 : cluster [DBG] pgmap v5389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:26.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:26 gibba013 bash[29418]: cluster 2021-03-10T16:52:24.279419+0000 mgr.gibba020.yqfnwy (mgr.34427) 9464 : cluster [DBG] pgmap v5390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:26.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:26 gibba013 bash[30381]: cluster 2021-03-10T16:52:24.279419+0000 mgr.gibba020.yqfnwy (mgr.34427) 9464 : cluster [DBG] pgmap v5390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:26.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:26 gibba020 bash[25448]: cluster 2021-03-10T16:52:24.279419+0000 mgr.gibba020.yqfnwy (mgr.34427) 9464 : cluster [DBG] pgmap v5390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:28.329 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:28 gibba020 bash[25448]: cluster 2021-03-10T16:52:26.281249+0000 mgr.gibba020.yqfnwy (mgr.34427) 9465 : cluster [DBG] pgmap v5391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:28.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:28 gibba013 bash[29418]: cluster 2021-03-10T16:52:26.281249+0000 mgr.gibba020.yqfnwy (mgr.34427) 9465 : cluster [DBG] pgmap v5391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:28.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:28 gibba013 bash[30381]: cluster 2021-03-10T16:52:26.281249+0000 mgr.gibba020.yqfnwy (mgr.34427) 9465 : cluster [DBG] pgmap v5391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:30.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:30 gibba013 bash[29418]: cluster 2021-03-10T16:52:28.282720+0000 mgr.gibba020.yqfnwy (mgr.34427) 9466 : cluster [DBG] pgmap v5392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:30.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:30 gibba013 bash[29418]: cephadm 2021-03-10T16:52:28.328676+0000 mgr.gibba020.yqfnwy (mgr.34427) 9467 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:52:30.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:30 gibba013 bash[30381]: cluster 2021-03-10T16:52:28.282720+0000 mgr.gibba020.yqfnwy (mgr.34427) 9466 : cluster [DBG] pgmap v5392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:30.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:30 gibba013 bash[30381]: cephadm 2021-03-10T16:52:28.328676+0000 mgr.gibba020.yqfnwy (mgr.34427) 9467 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:52:30.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:30 gibba020 bash[25448]: cluster 2021-03-10T16:52:28.282720+0000 mgr.gibba020.yqfnwy (mgr.34427) 9466 : cluster [DBG] pgmap v5392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:30.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:30 gibba020 bash[25448]: cephadm 2021-03-10T16:52:28.328676+0000 mgr.gibba020.yqfnwy (mgr.34427) 9467 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:52:32.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:32 gibba013 bash[29418]: cluster 2021-03-10T16:52:30.284211+0000 mgr.gibba020.yqfnwy (mgr.34427) 9468 : cluster [DBG] pgmap v5393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:32.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:32 gibba013 bash[30381]: cluster 2021-03-10T16:52:30.284211+0000 mgr.gibba020.yqfnwy (mgr.34427) 9468 : cluster [DBG] pgmap v5393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:32.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:32 gibba020 bash[25448]: cluster 2021-03-10T16:52:30.284211+0000 mgr.gibba020.yqfnwy (mgr.34427) 9468 : cluster [DBG] pgmap v5393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:34.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:34 gibba013 bash[29418]: cluster 2021-03-10T16:52:32.285613+0000 mgr.gibba020.yqfnwy (mgr.34427) 9469 : cluster [DBG] pgmap v5394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:34.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:34 gibba013 bash[30381]: cluster 2021-03-10T16:52:32.285613+0000 mgr.gibba020.yqfnwy (mgr.34427) 9469 : cluster [DBG] pgmap v5394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:34.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:34 gibba020 bash[25448]: cluster 2021-03-10T16:52:32.285613+0000 mgr.gibba020.yqfnwy (mgr.34427) 9469 : cluster [DBG] pgmap v5394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:36.053 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:52:36.281 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:52:36.282 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 92s ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:52:36.282 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 28s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:52:36.283 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (2h) 28s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:52:36.283 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (2h) 28s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:52:36.283 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 92s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:52:36.283 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 92s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:52:36.283 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 28s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:52:36.284 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 92s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:52:36.284 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 92s ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:52:36.284 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 28s ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:52:36.284 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 92s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:52:36.284 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 92s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:52:36.285 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 92s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:52:36.285 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 92s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:52:36.285 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 28s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:52:36.285 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 28s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:52:36.286 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 28s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:52:36.286 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 28s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:52:36.286 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 28s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:52:36.286 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 28s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:52:36.377 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:36 gibba013 bash[29418]: cluster 2021-03-10T16:52:34.287242+0000 mgr.gibba020.yqfnwy (mgr.34427) 9470 : cluster [DBG] pgmap v5395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:36.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:36 gibba013 bash[30381]: cluster 2021-03-10T16:52:34.287242+0000 mgr.gibba020.yqfnwy (mgr.34427) 9470 : cluster [DBG] pgmap v5395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:36.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:36 gibba020 bash[25448]: cluster 2021-03-10T16:52:34.287242+0000 mgr.gibba020.yqfnwy (mgr.34427) 9470 : cluster [DBG] pgmap v5395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:36.531 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:52:36.532 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:52:36.532 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:52:36.532 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:52:36.533 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:52:36.533 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:52:36.533 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:52:36.533 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:52:36.533 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:52:36.534 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:52:36.534 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:52:36.534 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:52:36.534 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:52:36.535 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:52:36.535 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:52:37.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:37 gibba013 bash[29418]: audit 2021-03-10T16:52:36.044525+0000 mgr.gibba020.yqfnwy (mgr.34427) 9471 : audit [DBG] from='client.50406 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:52:37.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:37 gibba013 bash[29418]: audit 2021-03-10T16:52:36.532797+0000 mon.a (mon.0) 3427 : audit [DBG] from='client.? 172.21.2.113:0/1012145558' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:37.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:37 gibba013 bash[30381]: audit 2021-03-10T16:52:36.044525+0000 mgr.gibba020.yqfnwy (mgr.34427) 9471 : audit [DBG] from='client.50406 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:52:37.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:37 gibba013 bash[30381]: audit 2021-03-10T16:52:36.532797+0000 mon.a (mon.0) 3427 : audit [DBG] from='client.? 172.21.2.113:0/1012145558' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:37.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:37 gibba020 bash[25448]: audit 2021-03-10T16:52:36.044525+0000 mgr.gibba020.yqfnwy (mgr.34427) 9471 : audit [DBG] from='client.50406 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:52:37.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:37 gibba020 bash[25448]: audit 2021-03-10T16:52:36.532797+0000 mon.a (mon.0) 3427 : audit [DBG] from='client.? 172.21.2.113:0/1012145558' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:52:38.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:38 gibba013 bash[29418]: audit 2021-03-10T16:52:36.269568+0000 mgr.gibba020.yqfnwy (mgr.34427) 9472 : audit [DBG] from='client.50412 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:52:38.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:38 gibba013 bash[29418]: cluster 2021-03-10T16:52:36.288111+0000 mgr.gibba020.yqfnwy (mgr.34427) 9473 : cluster [DBG] pgmap v5396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:38.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:38 gibba013 bash[30381]: audit 2021-03-10T16:52:36.269568+0000 mgr.gibba020.yqfnwy (mgr.34427) 9472 : audit [DBG] from='client.50412 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:52:38.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:38 gibba013 bash[30381]: cluster 2021-03-10T16:52:36.288111+0000 mgr.gibba020.yqfnwy (mgr.34427) 9473 : cluster [DBG] pgmap v5396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:38.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:38 gibba020 bash[25448]: audit 2021-03-10T16:52:36.269568+0000 mgr.gibba020.yqfnwy (mgr.34427) 9472 : audit [DBG] from='client.50412 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:52:38.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:38 gibba020 bash[25448]: cluster 2021-03-10T16:52:36.288111+0000 mgr.gibba020.yqfnwy (mgr.34427) 9473 : cluster [DBG] pgmap v5396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:40.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:40 gibba013 bash[29418]: cluster 2021-03-10T16:52:38.289386+0000 mgr.gibba020.yqfnwy (mgr.34427) 9474 : cluster [DBG] pgmap v5397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:40.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:40 gibba013 bash[30381]: cluster 2021-03-10T16:52:38.289386+0000 mgr.gibba020.yqfnwy (mgr.34427) 9474 : cluster [DBG] pgmap v5397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:40.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:40 gibba020 bash[25448]: cluster 2021-03-10T16:52:38.289386+0000 mgr.gibba020.yqfnwy (mgr.34427) 9474 : cluster [DBG] pgmap v5397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:42.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:42 gibba013 bash[29418]: cluster 2021-03-10T16:52:40.290827+0000 mgr.gibba020.yqfnwy (mgr.34427) 9475 : cluster [DBG] pgmap v5398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:42.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:42 gibba013 bash[30381]: cluster 2021-03-10T16:52:40.290827+0000 mgr.gibba020.yqfnwy (mgr.34427) 9475 : cluster [DBG] pgmap v5398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:42.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:42 gibba020 bash[25448]: cluster 2021-03-10T16:52:40.290827+0000 mgr.gibba020.yqfnwy (mgr.34427) 9475 : cluster [DBG] pgmap v5398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:44.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:44 gibba013 bash[29418]: cluster 2021-03-10T16:52:42.292248+0000 mgr.gibba020.yqfnwy (mgr.34427) 9476 : cluster [DBG] pgmap v5399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:44.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:44 gibba013 bash[30381]: cluster 2021-03-10T16:52:42.292248+0000 mgr.gibba020.yqfnwy (mgr.34427) 9476 : cluster [DBG] pgmap v5399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:44.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:44 gibba020 bash[25448]: cluster 2021-03-10T16:52:42.292248+0000 mgr.gibba020.yqfnwy (mgr.34427) 9476 : cluster [DBG] pgmap v5399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:45.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:45 gibba013 bash[29418]: cephadm 2021-03-10T16:52:43.344477+0000 mgr.gibba020.yqfnwy (mgr.34427) 9477 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:52:45.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:45 gibba013 bash[30381]: cephadm 2021-03-10T16:52:43.344477+0000 mgr.gibba020.yqfnwy (mgr.34427) 9477 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:52:45.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:45 gibba020 bash[25448]: cephadm 2021-03-10T16:52:43.344477+0000 mgr.gibba020.yqfnwy (mgr.34427) 9477 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:52:46.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:46 gibba013 bash[29418]: cluster 2021-03-10T16:52:44.293960+0000 mgr.gibba020.yqfnwy (mgr.34427) 9478 : cluster [DBG] pgmap v5400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:46.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:46 gibba013 bash[30381]: cluster 2021-03-10T16:52:44.293960+0000 mgr.gibba020.yqfnwy (mgr.34427) 9478 : cluster [DBG] pgmap v5400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:46.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:46 gibba020 bash[25448]: cluster 2021-03-10T16:52:44.293960+0000 mgr.gibba020.yqfnwy (mgr.34427) 9478 : cluster [DBG] pgmap v5400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:48.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:48 gibba020 bash[25448]: cluster 2021-03-10T16:52:46.295873+0000 mgr.gibba020.yqfnwy (mgr.34427) 9479 : cluster [DBG] pgmap v5401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:48.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:48 gibba013 bash[29418]: cluster 2021-03-10T16:52:46.295873+0000 mgr.gibba020.yqfnwy (mgr.34427) 9479 : cluster [DBG] pgmap v5401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:48.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:48 gibba013 bash[30381]: cluster 2021-03-10T16:52:46.295873+0000 mgr.gibba020.yqfnwy (mgr.34427) 9479 : cluster [DBG] pgmap v5401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:50.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:50 gibba020 bash[25448]: cluster 2021-03-10T16:52:48.297268+0000 mgr.gibba020.yqfnwy (mgr.34427) 9480 : cluster [DBG] pgmap v5402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:50.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:50 gibba013 bash[29418]: cluster 2021-03-10T16:52:48.297268+0000 mgr.gibba020.yqfnwy (mgr.34427) 9480 : cluster [DBG] pgmap v5402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:50.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:50 gibba013 bash[30381]: cluster 2021-03-10T16:52:48.297268+0000 mgr.gibba020.yqfnwy (mgr.34427) 9480 : cluster [DBG] pgmap v5402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:52.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:52 gibba020 bash[25448]: cluster 2021-03-10T16:52:50.298722+0000 mgr.gibba020.yqfnwy (mgr.34427) 9481 : cluster [DBG] pgmap v5403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:52.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:52 gibba013 bash[29418]: cluster 2021-03-10T16:52:50.298722+0000 mgr.gibba020.yqfnwy (mgr.34427) 9481 : cluster [DBG] pgmap v5403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:52.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:52 gibba013 bash[30381]: cluster 2021-03-10T16:52:50.298722+0000 mgr.gibba020.yqfnwy (mgr.34427) 9481 : cluster [DBG] pgmap v5403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:54.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:54 gibba020 bash[25448]: cluster 2021-03-10T16:52:52.300226+0000 mgr.gibba020.yqfnwy (mgr.34427) 9482 : cluster [DBG] pgmap v5404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:54.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:54 gibba013 bash[29418]: cluster 2021-03-10T16:52:52.300226+0000 mgr.gibba020.yqfnwy (mgr.34427) 9482 : cluster [DBG] pgmap v5404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:54.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:54 gibba013 bash[30381]: cluster 2021-03-10T16:52:52.300226+0000 mgr.gibba020.yqfnwy (mgr.34427) 9482 : cluster [DBG] pgmap v5404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:56.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:56 gibba020 bash[25448]: cluster 2021-03-10T16:52:54.301884+0000 mgr.gibba020.yqfnwy (mgr.34427) 9483 : cluster [DBG] pgmap v5405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:56.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:56 gibba013 bash[29418]: cluster 2021-03-10T16:52:54.301884+0000 mgr.gibba020.yqfnwy (mgr.34427) 9483 : cluster [DBG] pgmap v5405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:56.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:56 gibba013 bash[30381]: cluster 2021-03-10T16:52:54.301884+0000 mgr.gibba020.yqfnwy (mgr.34427) 9483 : cluster [DBG] pgmap v5405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:58.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:52:58 gibba020 bash[25448]: cluster 2021-03-10T16:52:56.303784+0000 mgr.gibba020.yqfnwy (mgr.34427) 9484 : cluster [DBG] pgmap v5406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:58.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:52:58 gibba013 bash[29418]: cluster 2021-03-10T16:52:56.303784+0000 mgr.gibba020.yqfnwy (mgr.34427) 9484 : cluster [DBG] pgmap v5406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:52:58.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:52:58 gibba013 bash[30381]: cluster 2021-03-10T16:52:56.303784+0000 mgr.gibba020.yqfnwy (mgr.34427) 9484 : cluster [DBG] pgmap v5406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:00.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:00 gibba020 bash[25448]: cluster 2021-03-10T16:52:58.305162+0000 mgr.gibba020.yqfnwy (mgr.34427) 9485 : cluster [DBG] pgmap v5407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:00.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:00 gibba020 bash[25448]: cephadm 2021-03-10T16:52:58.354376+0000 mgr.gibba020.yqfnwy (mgr.34427) 9486 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:53:00.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:00 gibba013 bash[29418]: cluster 2021-03-10T16:52:58.305162+0000 mgr.gibba020.yqfnwy (mgr.34427) 9485 : cluster [DBG] pgmap v5407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:00.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:00 gibba013 bash[29418]: cephadm 2021-03-10T16:52:58.354376+0000 mgr.gibba020.yqfnwy (mgr.34427) 9486 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:53:00.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:00 gibba013 bash[30381]: cluster 2021-03-10T16:52:58.305162+0000 mgr.gibba020.yqfnwy (mgr.34427) 9485 : cluster [DBG] pgmap v5407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:00.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:00 gibba013 bash[30381]: cephadm 2021-03-10T16:52:58.354376+0000 mgr.gibba020.yqfnwy (mgr.34427) 9486 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:53:02.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:02 gibba020 bash[25448]: cluster 2021-03-10T16:53:00.306634+0000 mgr.gibba020.yqfnwy (mgr.34427) 9487 : cluster [DBG] pgmap v5408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:02.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:02 gibba013 bash[29418]: cluster 2021-03-10T16:53:00.306634+0000 mgr.gibba020.yqfnwy (mgr.34427) 9487 : cluster [DBG] pgmap v5408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:02.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:02 gibba013 bash[30381]: cluster 2021-03-10T16:53:00.306634+0000 mgr.gibba020.yqfnwy (mgr.34427) 9487 : cluster [DBG] pgmap v5408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:04.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:04 gibba013 bash[29418]: cluster 2021-03-10T16:53:02.307934+0000 mgr.gibba020.yqfnwy (mgr.34427) 9488 : cluster [DBG] pgmap v5409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:04.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:04 gibba013 bash[30381]: cluster 2021-03-10T16:53:02.307934+0000 mgr.gibba020.yqfnwy (mgr.34427) 9488 : cluster [DBG] pgmap v5409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:04.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:04 gibba020 bash[25448]: cluster 2021-03-10T16:53:02.307934+0000 mgr.gibba020.yqfnwy (mgr.34427) 9488 : cluster [DBG] pgmap v5409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:06.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:06 gibba013 bash[29418]: cluster 2021-03-10T16:53:04.309402+0000 mgr.gibba020.yqfnwy (mgr.34427) 9489 : cluster [DBG] pgmap v5410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:06.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:06 gibba013 bash[30381]: cluster 2021-03-10T16:53:04.309402+0000 mgr.gibba020.yqfnwy (mgr.34427) 9489 : cluster [DBG] pgmap v5410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:06.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:06 gibba020 bash[25448]: cluster 2021-03-10T16:53:04.309402+0000 mgr.gibba020.yqfnwy (mgr.34427) 9489 : cluster [DBG] pgmap v5410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:06.780 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:53:07.012 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:53:07.013 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (2h) 2m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:53:07.013 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 58s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:53:07.014 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 58s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:53:07.014 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 58s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:53:07.014 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:53:07.014 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:53:07.014 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 58s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:53:07.015 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:53:07.015 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:53:07.015 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 58s ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:53:07.015 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:53:07.016 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:53:07.016 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:53:07.017 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:53:07.018 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 58s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:53:07.018 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 58s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:53:07.019 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 58s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:53:07.019 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 58s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:53:07.020 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 58s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:53:07.020 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 58s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:53:07.264 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:53:07.265 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:53:07.265 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:53:07.266 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:53:07.266 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:53:07.266 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:53:07.267 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:53:07.267 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:53:07.268 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:53:07.268 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:53:07.269 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:53:07.271 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:53:07.272 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:53:07.272 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:53:07.272 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:53:07.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:07 gibba013 bash[29418]: audit 2021-03-10T16:53:06.826486+0000 mon.a (mon.0) 3428 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:53:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:07 gibba013 bash[29418]: audit 2021-03-10T16:53:07.012133+0000 mon.a (mon.0) 3429 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:53:07.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:07 gibba013 bash[30381]: audit 2021-03-10T16:53:06.826486+0000 mon.a (mon.0) 3428 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:53:07.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:07 gibba013 bash[30381]: audit 2021-03-10T16:53:07.012133+0000 mon.a (mon.0) 3429 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:53:07.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:07 gibba020 bash[25448]: audit 2021-03-10T16:53:06.826486+0000 mon.a (mon.0) 3428 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:53:07.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:07 gibba020 bash[25448]: audit 2021-03-10T16:53:07.012133+0000 mon.a (mon.0) 3429 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:53:08.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:08 gibba013 bash[30381]: cluster 2021-03-10T16:53:06.311258+0000 mgr.gibba020.yqfnwy (mgr.34427) 9490 : cluster [DBG] pgmap v5411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:08.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:08 gibba013 bash[30381]: audit 2021-03-10T16:53:06.772792+0000 mgr.gibba020.yqfnwy (mgr.34427) 9491 : audit [DBG] from='client.50424 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:53:08.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:08 gibba013 bash[30381]: audit 2021-03-10T16:53:06.999160+0000 mgr.gibba020.yqfnwy (mgr.34427) 9492 : audit [DBG] from='client.50430 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:53:08.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:08 gibba013 bash[30381]: audit 2021-03-10T16:53:07.264756+0000 mon.a (mon.0) 3430 : audit [DBG] from='client.? 172.21.2.113:0/2118928870' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:08.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:08 gibba013 bash[30381]: audit 2021-03-10T16:53:07.383376+0000 mon.a (mon.0) 3431 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T16:53:08.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:08 gibba013 bash[30381]: audit 2021-03-10T16:53:07.384115+0000 mon.a (mon.0) 3432 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:53:08.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:08 gibba013 bash[30381]: audit 2021-03-10T16:53:07.384782+0000 mon.a (mon.0) 3433 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T16:53:08.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:08 gibba013 bash[30381]: audit 2021-03-10T16:53:07.385432+0000 mon.a (mon.0) 3434 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:53:08.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:08 gibba013 bash[29418]: cluster 2021-03-10T16:53:06.311258+0000 mgr.gibba020.yqfnwy (mgr.34427) 9490 : cluster [DBG] pgmap v5411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:08.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:08 gibba013 bash[29418]: audit 2021-03-10T16:53:06.772792+0000 mgr.gibba020.yqfnwy (mgr.34427) 9491 : audit [DBG] from='client.50424 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:53:08.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:08 gibba013 bash[29418]: audit 2021-03-10T16:53:06.999160+0000 mgr.gibba020.yqfnwy (mgr.34427) 9492 : audit [DBG] from='client.50430 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:53:08.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:08 gibba013 bash[29418]: audit 2021-03-10T16:53:07.264756+0000 mon.a (mon.0) 3430 : audit [DBG] from='client.? 172.21.2.113:0/2118928870' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:08.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:08 gibba013 bash[29418]: audit 2021-03-10T16:53:07.383376+0000 mon.a (mon.0) 3431 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T16:53:08.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:08 gibba013 bash[29418]: audit 2021-03-10T16:53:07.384115+0000 mon.a (mon.0) 3432 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:53:08.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:08 gibba013 bash[29418]: audit 2021-03-10T16:53:07.384782+0000 mon.a (mon.0) 3433 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T16:53:08.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:08 gibba013 bash[29418]: audit 2021-03-10T16:53:07.385432+0000 mon.a (mon.0) 3434 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:53:08.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:08 gibba020 bash[25448]: cluster 2021-03-10T16:53:06.311258+0000 mgr.gibba020.yqfnwy (mgr.34427) 9490 : cluster [DBG] pgmap v5411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:08.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:08 gibba020 bash[25448]: audit 2021-03-10T16:53:06.772792+0000 mgr.gibba020.yqfnwy (mgr.34427) 9491 : audit [DBG] from='client.50424 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:53:08.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:08 gibba020 bash[25448]: audit 2021-03-10T16:53:06.999160+0000 mgr.gibba020.yqfnwy (mgr.34427) 9492 : audit [DBG] from='client.50430 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:53:08.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:08 gibba020 bash[25448]: audit 2021-03-10T16:53:07.264756+0000 mon.a (mon.0) 3430 : audit [DBG] from='client.? 172.21.2.113:0/2118928870' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:08.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:08 gibba020 bash[25448]: audit 2021-03-10T16:53:07.383376+0000 mon.a (mon.0) 3431 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T16:53:08.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:08 gibba020 bash[25448]: audit 2021-03-10T16:53:07.384115+0000 mon.a (mon.0) 3432 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:53:08.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:08 gibba020 bash[25448]: audit 2021-03-10T16:53:07.384782+0000 mon.a (mon.0) 3433 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T16:53:08.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:08 gibba020 bash[25448]: audit 2021-03-10T16:53:07.385432+0000 mon.a (mon.0) 3434 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:53:10.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:10 gibba013 bash[29418]: cluster 2021-03-10T16:53:08.312676+0000 mgr.gibba020.yqfnwy (mgr.34427) 9493 : cluster [DBG] pgmap v5412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:10.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:10 gibba013 bash[30381]: cluster 2021-03-10T16:53:08.312676+0000 mgr.gibba020.yqfnwy (mgr.34427) 9493 : cluster [DBG] pgmap v5412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:10.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:10 gibba020 bash[25448]: cluster 2021-03-10T16:53:08.312676+0000 mgr.gibba020.yqfnwy (mgr.34427) 9493 : cluster [DBG] pgmap v5412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:12.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:12 gibba013 bash[29418]: cluster 2021-03-10T16:53:10.314098+0000 mgr.gibba020.yqfnwy (mgr.34427) 9494 : cluster [DBG] pgmap v5413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:12.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:12 gibba013 bash[30381]: cluster 2021-03-10T16:53:10.314098+0000 mgr.gibba020.yqfnwy (mgr.34427) 9494 : cluster [DBG] pgmap v5413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:12.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:12 gibba020 bash[25448]: cluster 2021-03-10T16:53:10.314098+0000 mgr.gibba020.yqfnwy (mgr.34427) 9494 : cluster [DBG] pgmap v5413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:14.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:14 gibba013 bash[29418]: cluster 2021-03-10T16:53:12.315090+0000 mgr.gibba020.yqfnwy (mgr.34427) 9495 : cluster [DBG] pgmap v5414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:14.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:14 gibba013 bash[29418]: audit 2021-03-10T16:53:13.371583+0000 mon.a (mon.0) 3435 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:53:14.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:14 gibba013 bash[29418]: audit 2021-03-10T16:53:13.599969+0000 mon.a (mon.0) 3436 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:53:14.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:14 gibba013 bash[29418]: audit 2021-03-10T16:53:13.602960+0000 mon.a (mon.0) 3437 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:53:14.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:14 gibba013 bash[29418]: audit 2021-03-10T16:53:13.604575+0000 mon.a (mon.0) 3438 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:14.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:14 gibba013 bash[29418]: audit 2021-03-10T16:53:13.606288+0000 mon.a (mon.0) 3439 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:14.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:14 gibba013 bash[29418]: audit 2021-03-10T16:53:13.607931+0000 mon.a (mon.0) 3440 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:14.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:14 gibba013 bash[29418]: audit 2021-03-10T16:53:13.610715+0000 mon.a (mon.0) 3441 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:14.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:14 gibba013 bash[29418]: audit 2021-03-10T16:53:13.612297+0000 mon.a (mon.0) 3442 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:14.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:14 gibba013 bash[30381]: cluster 2021-03-10T16:53:12.315090+0000 mgr.gibba020.yqfnwy (mgr.34427) 9495 : cluster [DBG] pgmap v5414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:14.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:14 gibba013 bash[30381]: audit 2021-03-10T16:53:13.371583+0000 mon.a (mon.0) 3435 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:53:14.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:14 gibba013 bash[30381]: audit 2021-03-10T16:53:13.599969+0000 mon.a (mon.0) 3436 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:53:14.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:14 gibba013 bash[30381]: audit 2021-03-10T16:53:13.602960+0000 mon.a (mon.0) 3437 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:53:14.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:14 gibba013 bash[30381]: audit 2021-03-10T16:53:13.604575+0000 mon.a (mon.0) 3438 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:14.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:14 gibba013 bash[30381]: audit 2021-03-10T16:53:13.606288+0000 mon.a (mon.0) 3439 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:14.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:14 gibba013 bash[30381]: audit 2021-03-10T16:53:13.607931+0000 mon.a (mon.0) 3440 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:14.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:14 gibba013 bash[30381]: audit 2021-03-10T16:53:13.610715+0000 mon.a (mon.0) 3441 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:14.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:14 gibba013 bash[30381]: audit 2021-03-10T16:53:13.612297+0000 mon.a (mon.0) 3442 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:14.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:14 gibba020 bash[25448]: cluster 2021-03-10T16:53:12.315090+0000 mgr.gibba020.yqfnwy (mgr.34427) 9495 : cluster [DBG] pgmap v5414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:14.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:14 gibba020 bash[25448]: audit 2021-03-10T16:53:13.371583+0000 mon.a (mon.0) 3435 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:53:14.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:14 gibba020 bash[25448]: audit 2021-03-10T16:53:13.599969+0000 mon.a (mon.0) 3436 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:53:14.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:14 gibba020 bash[25448]: audit 2021-03-10T16:53:13.602960+0000 mon.a (mon.0) 3437 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:53:14.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:14 gibba020 bash[25448]: audit 2021-03-10T16:53:13.604575+0000 mon.a (mon.0) 3438 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:14.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:14 gibba020 bash[25448]: audit 2021-03-10T16:53:13.606288+0000 mon.a (mon.0) 3439 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:14.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:14 gibba020 bash[25448]: audit 2021-03-10T16:53:13.607931+0000 mon.a (mon.0) 3440 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:14.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:14 gibba020 bash[25448]: audit 2021-03-10T16:53:13.610715+0000 mon.a (mon.0) 3441 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:14.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:14 gibba020 bash[25448]: audit 2021-03-10T16:53:13.612297+0000 mon.a (mon.0) 3442 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:15.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:15 gibba013 bash[29418]: cephadm 2021-03-10T16:53:13.375917+0000 mgr.gibba020.yqfnwy (mgr.34427) 9496 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:53:15.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:15 gibba013 bash[29418]: cephadm 2021-03-10T16:53:13.377856+0000 mgr.gibba020.yqfnwy (mgr.34427) 9497 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:53:15.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:15 gibba013 bash[29418]: cephadm 2021-03-10T16:53:13.601697+0000 mgr.gibba020.yqfnwy (mgr.34427) 9498 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:53:15.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:15 gibba013 bash[29418]: cephadm 2021-03-10T16:53:13.603471+0000 mgr.gibba020.yqfnwy (mgr.34427) 9499 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:53:15.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:15 gibba013 bash[29418]: cephadm 2021-03-10T16:53:13.605155+0000 mgr.gibba020.yqfnwy (mgr.34427) 9500 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:53:15.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:15 gibba013 bash[29418]: cephadm 2021-03-10T16:53:13.605194+0000 mgr.gibba020.yqfnwy (mgr.34427) 9501 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:53:15.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:15 gibba013 bash[29418]: cephadm 2021-03-10T16:53:13.606861+0000 mgr.gibba020.yqfnwy (mgr.34427) 9502 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:53:15.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:15 gibba013 bash[29418]: cephadm 2021-03-10T16:53:13.606902+0000 mgr.gibba020.yqfnwy (mgr.34427) 9503 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:53:15.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:15 gibba013 bash[29418]: cephadm 2021-03-10T16:53:13.608298+0000 mgr.gibba020.yqfnwy (mgr.34427) 9504 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:53:15.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:15 gibba013 bash[29418]: cephadm 2021-03-10T16:53:13.609475+0000 mgr.gibba020.yqfnwy (mgr.34427) 9505 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:53:15.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:15 gibba013 bash[29418]: cephadm 2021-03-10T16:53:13.609518+0000 mgr.gibba020.yqfnwy (mgr.34427) 9506 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:53:15.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:15 gibba013 bash[29418]: cephadm 2021-03-10T16:53:13.611085+0000 mgr.gibba020.yqfnwy (mgr.34427) 9507 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:53:15.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:15 gibba013 bash[29418]: cephadm 2021-03-10T16:53:13.611447+0000 mgr.gibba020.yqfnwy (mgr.34427) 9508 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:53:15.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:15 gibba013 bash[29418]: cephadm 2021-03-10T16:53:13.612881+0000 mgr.gibba020.yqfnwy (mgr.34427) 9509 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:53:15.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:15 gibba013 bash[29418]: cephadm 2021-03-10T16:53:13.612923+0000 mgr.gibba020.yqfnwy (mgr.34427) 9510 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:53:15.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:15 gibba013 bash[29418]: cephadm 2021-03-10T16:53:13.613038+0000 mgr.gibba020.yqfnwy (mgr.34427) 9511 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:53:15.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:15 gibba013 bash[30381]: cephadm 2021-03-10T16:53:13.375917+0000 mgr.gibba020.yqfnwy (mgr.34427) 9496 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:53:15.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:15 gibba013 bash[30381]: cephadm 2021-03-10T16:53:13.377856+0000 mgr.gibba020.yqfnwy (mgr.34427) 9497 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:53:15.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:15 gibba013 bash[30381]: cephadm 2021-03-10T16:53:13.601697+0000 mgr.gibba020.yqfnwy (mgr.34427) 9498 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:53:15.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:15 gibba013 bash[30381]: cephadm 2021-03-10T16:53:13.603471+0000 mgr.gibba020.yqfnwy (mgr.34427) 9499 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:53:15.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:15 gibba013 bash[30381]: cephadm 2021-03-10T16:53:13.605155+0000 mgr.gibba020.yqfnwy (mgr.34427) 9500 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:53:15.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:15 gibba013 bash[30381]: cephadm 2021-03-10T16:53:13.605194+0000 mgr.gibba020.yqfnwy (mgr.34427) 9501 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:53:15.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:15 gibba013 bash[30381]: cephadm 2021-03-10T16:53:13.606861+0000 mgr.gibba020.yqfnwy (mgr.34427) 9502 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:53:15.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:15 gibba013 bash[30381]: cephadm 2021-03-10T16:53:13.606902+0000 mgr.gibba020.yqfnwy (mgr.34427) 9503 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:53:15.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:15 gibba013 bash[30381]: cephadm 2021-03-10T16:53:13.608298+0000 mgr.gibba020.yqfnwy (mgr.34427) 9504 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:53:15.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:15 gibba013 bash[30381]: cephadm 2021-03-10T16:53:13.609475+0000 mgr.gibba020.yqfnwy (mgr.34427) 9505 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:53:15.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:15 gibba013 bash[30381]: cephadm 2021-03-10T16:53:13.609518+0000 mgr.gibba020.yqfnwy (mgr.34427) 9506 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:53:15.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:15 gibba013 bash[30381]: cephadm 2021-03-10T16:53:13.611085+0000 mgr.gibba020.yqfnwy (mgr.34427) 9507 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:53:15.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:15 gibba013 bash[30381]: cephadm 2021-03-10T16:53:13.611447+0000 mgr.gibba020.yqfnwy (mgr.34427) 9508 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:53:15.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:15 gibba013 bash[30381]: cephadm 2021-03-10T16:53:13.612881+0000 mgr.gibba020.yqfnwy (mgr.34427) 9509 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:53:15.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:15 gibba013 bash[30381]: cephadm 2021-03-10T16:53:13.612923+0000 mgr.gibba020.yqfnwy (mgr.34427) 9510 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:53:15.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:15 gibba013 bash[30381]: cephadm 2021-03-10T16:53:13.613038+0000 mgr.gibba020.yqfnwy (mgr.34427) 9511 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:53:15.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:15 gibba020 bash[25448]: cephadm 2021-03-10T16:53:13.375917+0000 mgr.gibba020.yqfnwy (mgr.34427) 9496 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:53:15.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:15 gibba020 bash[25448]: cephadm 2021-03-10T16:53:13.377856+0000 mgr.gibba020.yqfnwy (mgr.34427) 9497 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:53:15.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:15 gibba020 bash[25448]: cephadm 2021-03-10T16:53:13.601697+0000 mgr.gibba020.yqfnwy (mgr.34427) 9498 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:53:15.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:15 gibba020 bash[25448]: cephadm 2021-03-10T16:53:13.603471+0000 mgr.gibba020.yqfnwy (mgr.34427) 9499 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:53:15.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:15 gibba020 bash[25448]: cephadm 2021-03-10T16:53:13.605155+0000 mgr.gibba020.yqfnwy (mgr.34427) 9500 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:53:15.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:15 gibba020 bash[25448]: cephadm 2021-03-10T16:53:13.605194+0000 mgr.gibba020.yqfnwy (mgr.34427) 9501 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:53:15.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:15 gibba020 bash[25448]: cephadm 2021-03-10T16:53:13.606861+0000 mgr.gibba020.yqfnwy (mgr.34427) 9502 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:53:15.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:15 gibba020 bash[25448]: cephadm 2021-03-10T16:53:13.606902+0000 mgr.gibba020.yqfnwy (mgr.34427) 9503 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:53:15.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:15 gibba020 bash[25448]: cephadm 2021-03-10T16:53:13.608298+0000 mgr.gibba020.yqfnwy (mgr.34427) 9504 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:53:15.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:15 gibba020 bash[25448]: cephadm 2021-03-10T16:53:13.609475+0000 mgr.gibba020.yqfnwy (mgr.34427) 9505 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:53:15.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:15 gibba020 bash[25448]: cephadm 2021-03-10T16:53:13.609518+0000 mgr.gibba020.yqfnwy (mgr.34427) 9506 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:53:15.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:15 gibba020 bash[25448]: cephadm 2021-03-10T16:53:13.611085+0000 mgr.gibba020.yqfnwy (mgr.34427) 9507 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:53:15.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:15 gibba020 bash[25448]: cephadm 2021-03-10T16:53:13.611447+0000 mgr.gibba020.yqfnwy (mgr.34427) 9508 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:53:15.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:15 gibba020 bash[25448]: cephadm 2021-03-10T16:53:13.612881+0000 mgr.gibba020.yqfnwy (mgr.34427) 9509 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:53:15.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:15 gibba020 bash[25448]: cephadm 2021-03-10T16:53:13.612923+0000 mgr.gibba020.yqfnwy (mgr.34427) 9510 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:53:15.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:15 gibba020 bash[25448]: cephadm 2021-03-10T16:53:13.613038+0000 mgr.gibba020.yqfnwy (mgr.34427) 9511 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:53:16.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:16 gibba013 bash[29418]: cluster 2021-03-10T16:53:14.316416+0000 mgr.gibba020.yqfnwy (mgr.34427) 9512 : cluster [DBG] pgmap v5415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:16.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:16 gibba013 bash[30381]: cluster 2021-03-10T16:53:14.316416+0000 mgr.gibba020.yqfnwy (mgr.34427) 9512 : cluster [DBG] pgmap v5415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:16.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:16 gibba020 bash[25448]: cluster 2021-03-10T16:53:14.316416+0000 mgr.gibba020.yqfnwy (mgr.34427) 9512 : cluster [DBG] pgmap v5415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:17.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:17 gibba013 bash[29418]: cluster 2021-03-10T16:53:16.317356+0000 mgr.gibba020.yqfnwy (mgr.34427) 9513 : cluster [DBG] pgmap v5416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:17.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:17 gibba013 bash[30381]: cluster 2021-03-10T16:53:16.317356+0000 mgr.gibba020.yqfnwy (mgr.34427) 9513 : cluster [DBG] pgmap v5416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:17.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:17 gibba020 bash[25448]: cluster 2021-03-10T16:53:16.317356+0000 mgr.gibba020.yqfnwy (mgr.34427) 9513 : cluster [DBG] pgmap v5416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:19.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:19 gibba020 bash[25448]: cluster 2021-03-10T16:53:18.318651+0000 mgr.gibba020.yqfnwy (mgr.34427) 9514 : cluster [DBG] pgmap v5417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:19.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:19 gibba013 bash[29418]: cluster 2021-03-10T16:53:18.318651+0000 mgr.gibba020.yqfnwy (mgr.34427) 9514 : cluster [DBG] pgmap v5417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:19.878 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:19 gibba013 bash[30381]: cluster 2021-03-10T16:53:18.318651+0000 mgr.gibba020.yqfnwy (mgr.34427) 9514 : cluster [DBG] pgmap v5417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:22.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:22 gibba013 bash[29418]: cluster 2021-03-10T16:53:20.320146+0000 mgr.gibba020.yqfnwy (mgr.34427) 9515 : cluster [DBG] pgmap v5418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:22.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:22 gibba013 bash[30381]: cluster 2021-03-10T16:53:20.320146+0000 mgr.gibba020.yqfnwy (mgr.34427) 9515 : cluster [DBG] pgmap v5418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:22.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:22 gibba020 bash[25448]: cluster 2021-03-10T16:53:20.320146+0000 mgr.gibba020.yqfnwy (mgr.34427) 9515 : cluster [DBG] pgmap v5418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:24.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:24 gibba013 bash[29418]: cluster 2021-03-10T16:53:22.321271+0000 mgr.gibba020.yqfnwy (mgr.34427) 9516 : cluster [DBG] pgmap v5419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:24.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:24 gibba013 bash[30381]: cluster 2021-03-10T16:53:22.321271+0000 mgr.gibba020.yqfnwy (mgr.34427) 9516 : cluster [DBG] pgmap v5419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:24.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:24 gibba020 bash[25448]: cluster 2021-03-10T16:53:22.321271+0000 mgr.gibba020.yqfnwy (mgr.34427) 9516 : cluster [DBG] pgmap v5419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:26.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:26 gibba013 bash[29418]: cluster 2021-03-10T16:53:24.322865+0000 mgr.gibba020.yqfnwy (mgr.34427) 9517 : cluster [DBG] pgmap v5420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:26.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:26 gibba013 bash[30381]: cluster 2021-03-10T16:53:24.322865+0000 mgr.gibba020.yqfnwy (mgr.34427) 9517 : cluster [DBG] pgmap v5420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:26.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:26 gibba020 bash[25448]: cluster 2021-03-10T16:53:24.322865+0000 mgr.gibba020.yqfnwy (mgr.34427) 9517 : cluster [DBG] pgmap v5420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:28.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:28 gibba013 bash[29418]: cluster 2021-03-10T16:53:26.324728+0000 mgr.gibba020.yqfnwy (mgr.34427) 9518 : cluster [DBG] pgmap v5421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:28.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:28 gibba013 bash[30381]: cluster 2021-03-10T16:53:26.324728+0000 mgr.gibba020.yqfnwy (mgr.34427) 9518 : cluster [DBG] pgmap v5421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:28.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:28 gibba020 bash[25448]: cluster 2021-03-10T16:53:26.324728+0000 mgr.gibba020.yqfnwy (mgr.34427) 9518 : cluster [DBG] pgmap v5421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:30.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:30 gibba013 bash[29418]: cluster 2021-03-10T16:53:28.326072+0000 mgr.gibba020.yqfnwy (mgr.34427) 9519 : cluster [DBG] pgmap v5422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:30.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:30 gibba013 bash[29418]: cephadm 2021-03-10T16:53:28.628751+0000 mgr.gibba020.yqfnwy (mgr.34427) 9520 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:53:30.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:30 gibba013 bash[30381]: cluster 2021-03-10T16:53:28.326072+0000 mgr.gibba020.yqfnwy (mgr.34427) 9519 : cluster [DBG] pgmap v5422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:30.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:30 gibba013 bash[30381]: cephadm 2021-03-10T16:53:28.628751+0000 mgr.gibba020.yqfnwy (mgr.34427) 9520 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:53:30.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:30 gibba020 bash[25448]: cluster 2021-03-10T16:53:28.326072+0000 mgr.gibba020.yqfnwy (mgr.34427) 9519 : cluster [DBG] pgmap v5422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:30.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:30 gibba020 bash[25448]: cephadm 2021-03-10T16:53:28.628751+0000 mgr.gibba020.yqfnwy (mgr.34427) 9520 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:53:32.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:32 gibba013 bash[29418]: cluster 2021-03-10T16:53:30.327519+0000 mgr.gibba020.yqfnwy (mgr.34427) 9521 : cluster [DBG] pgmap v5423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:32.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:32 gibba013 bash[30381]: cluster 2021-03-10T16:53:30.327519+0000 mgr.gibba020.yqfnwy (mgr.34427) 9521 : cluster [DBG] pgmap v5423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:32.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:32 gibba020 bash[25448]: cluster 2021-03-10T16:53:30.327519+0000 mgr.gibba020.yqfnwy (mgr.34427) 9521 : cluster [DBG] pgmap v5423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:34.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:34 gibba013 bash[29418]: cluster 2021-03-10T16:53:32.328798+0000 mgr.gibba020.yqfnwy (mgr.34427) 9522 : cluster [DBG] pgmap v5424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:34.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:34 gibba013 bash[30381]: cluster 2021-03-10T16:53:32.328798+0000 mgr.gibba020.yqfnwy (mgr.34427) 9522 : cluster [DBG] pgmap v5424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:34.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:34 gibba020 bash[25448]: cluster 2021-03-10T16:53:32.328798+0000 mgr.gibba020.yqfnwy (mgr.34427) 9522 : cluster [DBG] pgmap v5424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:36.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:36 gibba013 bash[29418]: cluster 2021-03-10T16:53:34.330205+0000 mgr.gibba020.yqfnwy (mgr.34427) 9523 : cluster [DBG] pgmap v5425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:36.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:36 gibba013 bash[30381]: cluster 2021-03-10T16:53:34.330205+0000 mgr.gibba020.yqfnwy (mgr.34427) 9523 : cluster [DBG] pgmap v5425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:36.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:36 gibba020 bash[25448]: cluster 2021-03-10T16:53:34.330205+0000 mgr.gibba020.yqfnwy (mgr.34427) 9523 : cluster [DBG] pgmap v5425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:37.510 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:53:37.738 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:53:37.738 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 2m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:53:37.739 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 89s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:53:37.739 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 89s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:53:37.739 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 89s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:53:37.739 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:53:37.740 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:53:37.740 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 89s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:53:37.740 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:53:37.740 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:53:37.741 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 89s ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:53:37.741 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:53:37.741 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:53:37.741 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:53:37.742 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:53:37.742 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 89s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:53:37.742 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 89s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:53:37.742 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 89s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:53:37.743 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 89s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:53:37.743 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 89s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:53:37.743 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 89s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:53:37.986 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:53:37.987 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:53:37.987 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:53:37.987 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:53:37.987 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:53:37.988 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:53:37.988 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:53:37.988 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:53:37.988 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:53:37.988 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:53:37.989 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:53:37.989 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:53:37.989 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:53:37.989 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:53:37.990 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:53:38.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:38 gibba013 bash[29418]: cluster 2021-03-10T16:53:36.331927+0000 mgr.gibba020.yqfnwy (mgr.34427) 9524 : cluster [DBG] pgmap v5426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:38.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:38 gibba013 bash[29418]: audit 2021-03-10T16:53:37.987211+0000 mon.c (mon.1) 145 : audit [DBG] from='client.? 172.21.2.113:0/3106150325' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:38.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:38 gibba013 bash[30381]: cluster 2021-03-10T16:53:36.331927+0000 mgr.gibba020.yqfnwy (mgr.34427) 9524 : cluster [DBG] pgmap v5426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:38.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:38 gibba013 bash[30381]: audit 2021-03-10T16:53:37.987211+0000 mon.c (mon.1) 145 : audit [DBG] from='client.? 172.21.2.113:0/3106150325' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:38.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:38 gibba020 bash[25448]: cluster 2021-03-10T16:53:36.331927+0000 mgr.gibba020.yqfnwy (mgr.34427) 9524 : cluster [DBG] pgmap v5426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:38.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:38 gibba020 bash[25448]: audit 2021-03-10T16:53:37.987211+0000 mon.c (mon.1) 145 : audit [DBG] from='client.? 172.21.2.113:0/3106150325' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:53:39.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:39 gibba013 bash[29418]: audit 2021-03-10T16:53:37.501405+0000 mgr.gibba020.yqfnwy (mgr.34427) 9525 : audit [DBG] from='client.50442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:53:39.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:39 gibba013 bash[29418]: audit 2021-03-10T16:53:37.725998+0000 mgr.gibba020.yqfnwy (mgr.34427) 9526 : audit [DBG] from='client.60427 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:53:39.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:39 gibba013 bash[30381]: audit 2021-03-10T16:53:37.501405+0000 mgr.gibba020.yqfnwy (mgr.34427) 9525 : audit [DBG] from='client.50442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:53:39.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:39 gibba013 bash[30381]: audit 2021-03-10T16:53:37.725998+0000 mgr.gibba020.yqfnwy (mgr.34427) 9526 : audit [DBG] from='client.60427 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:53:39.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:39 gibba020 bash[25448]: audit 2021-03-10T16:53:37.501405+0000 mgr.gibba020.yqfnwy (mgr.34427) 9525 : audit [DBG] from='client.50442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:53:39.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:39 gibba020 bash[25448]: audit 2021-03-10T16:53:37.725998+0000 mgr.gibba020.yqfnwy (mgr.34427) 9526 : audit [DBG] from='client.60427 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:53:40.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:40 gibba013 bash[29418]: cluster 2021-03-10T16:53:38.333313+0000 mgr.gibba020.yqfnwy (mgr.34427) 9527 : cluster [DBG] pgmap v5427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:40.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:40 gibba013 bash[30381]: cluster 2021-03-10T16:53:38.333313+0000 mgr.gibba020.yqfnwy (mgr.34427) 9527 : cluster [DBG] pgmap v5427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:40.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:40 gibba020 bash[25448]: cluster 2021-03-10T16:53:38.333313+0000 mgr.gibba020.yqfnwy (mgr.34427) 9527 : cluster [DBG] pgmap v5427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:42.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:42 gibba013 bash[29418]: cluster 2021-03-10T16:53:40.334760+0000 mgr.gibba020.yqfnwy (mgr.34427) 9528 : cluster [DBG] pgmap v5428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:42.378 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:42 gibba013 bash[30381]: cluster 2021-03-10T16:53:40.334760+0000 mgr.gibba020.yqfnwy (mgr.34427) 9528 : cluster [DBG] pgmap v5428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:42.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:42 gibba020 bash[25448]: cluster 2021-03-10T16:53:40.334760+0000 mgr.gibba020.yqfnwy (mgr.34427) 9528 : cluster [DBG] pgmap v5428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:44.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:44 gibba013 bash[29418]: cluster 2021-03-10T16:53:42.335870+0000 mgr.gibba020.yqfnwy (mgr.34427) 9529 : cluster [DBG] pgmap v5429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:44.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:44 gibba013 bash[30381]: cluster 2021-03-10T16:53:42.335870+0000 mgr.gibba020.yqfnwy (mgr.34427) 9529 : cluster [DBG] pgmap v5429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:44.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:44 gibba020 bash[25448]: cluster 2021-03-10T16:53:42.335870+0000 mgr.gibba020.yqfnwy (mgr.34427) 9529 : cluster [DBG] pgmap v5429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:45.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:45 gibba020 bash[25448]: cephadm 2021-03-10T16:53:43.644605+0000 mgr.gibba020.yqfnwy (mgr.34427) 9530 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:53:45.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:45 gibba013 bash[29418]: cephadm 2021-03-10T16:53:43.644605+0000 mgr.gibba020.yqfnwy (mgr.34427) 9530 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:53:45.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:45 gibba013 bash[30381]: cephadm 2021-03-10T16:53:43.644605+0000 mgr.gibba020.yqfnwy (mgr.34427) 9530 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:53:46.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:46 gibba020 bash[25448]: cluster 2021-03-10T16:53:44.337379+0000 mgr.gibba020.yqfnwy (mgr.34427) 9531 : cluster [DBG] pgmap v5430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:46.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:46 gibba013 bash[29418]: cluster 2021-03-10T16:53:44.337379+0000 mgr.gibba020.yqfnwy (mgr.34427) 9531 : cluster [DBG] pgmap v5430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:46.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:46 gibba013 bash[30381]: cluster 2021-03-10T16:53:44.337379+0000 mgr.gibba020.yqfnwy (mgr.34427) 9531 : cluster [DBG] pgmap v5430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:48.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:48 gibba020 bash[25448]: cluster 2021-03-10T16:53:46.339103+0000 mgr.gibba020.yqfnwy (mgr.34427) 9532 : cluster [DBG] pgmap v5431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:48.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:48 gibba013 bash[29418]: cluster 2021-03-10T16:53:46.339103+0000 mgr.gibba020.yqfnwy (mgr.34427) 9532 : cluster [DBG] pgmap v5431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:48.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:48 gibba013 bash[30381]: cluster 2021-03-10T16:53:46.339103+0000 mgr.gibba020.yqfnwy (mgr.34427) 9532 : cluster [DBG] pgmap v5431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:50.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:50 gibba020 bash[25448]: cluster 2021-03-10T16:53:48.340753+0000 mgr.gibba020.yqfnwy (mgr.34427) 9533 : cluster [DBG] pgmap v5432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:50.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:50 gibba013 bash[29418]: cluster 2021-03-10T16:53:48.340753+0000 mgr.gibba020.yqfnwy (mgr.34427) 9533 : cluster [DBG] pgmap v5432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:50.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:50 gibba013 bash[30381]: cluster 2021-03-10T16:53:48.340753+0000 mgr.gibba020.yqfnwy (mgr.34427) 9533 : cluster [DBG] pgmap v5432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:52.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:52 gibba020 bash[25448]: cluster 2021-03-10T16:53:50.342179+0000 mgr.gibba020.yqfnwy (mgr.34427) 9534 : cluster [DBG] pgmap v5433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:52.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:52 gibba013 bash[29418]: cluster 2021-03-10T16:53:50.342179+0000 mgr.gibba020.yqfnwy (mgr.34427) 9534 : cluster [DBG] pgmap v5433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:52.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:52 gibba013 bash[30381]: cluster 2021-03-10T16:53:50.342179+0000 mgr.gibba020.yqfnwy (mgr.34427) 9534 : cluster [DBG] pgmap v5433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:54.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:54 gibba020 bash[25448]: cluster 2021-03-10T16:53:52.343454+0000 mgr.gibba020.yqfnwy (mgr.34427) 9535 : cluster [DBG] pgmap v5434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:54.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:54 gibba013 bash[29418]: cluster 2021-03-10T16:53:52.343454+0000 mgr.gibba020.yqfnwy (mgr.34427) 9535 : cluster [DBG] pgmap v5434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:54.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:54 gibba013 bash[30381]: cluster 2021-03-10T16:53:52.343454+0000 mgr.gibba020.yqfnwy (mgr.34427) 9535 : cluster [DBG] pgmap v5434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:56.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:56 gibba020 bash[25448]: cluster 2021-03-10T16:53:54.344911+0000 mgr.gibba020.yqfnwy (mgr.34427) 9536 : cluster [DBG] pgmap v5435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:56.627 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:56 gibba013 bash[29418]: cluster 2021-03-10T16:53:54.344911+0000 mgr.gibba020.yqfnwy (mgr.34427) 9536 : cluster [DBG] pgmap v5435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:56.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:56 gibba013 bash[30381]: cluster 2021-03-10T16:53:54.344911+0000 mgr.gibba020.yqfnwy (mgr.34427) 9536 : cluster [DBG] pgmap v5435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:58.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:53:58 gibba020 bash[25448]: cluster 2021-03-10T16:53:56.346618+0000 mgr.gibba020.yqfnwy (mgr.34427) 9537 : cluster [DBG] pgmap v5436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:58.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:53:58 gibba013 bash[29418]: cluster 2021-03-10T16:53:56.346618+0000 mgr.gibba020.yqfnwy (mgr.34427) 9537 : cluster [DBG] pgmap v5436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:53:58.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:53:58 gibba013 bash[30381]: cluster 2021-03-10T16:53:56.346618+0000 mgr.gibba020.yqfnwy (mgr.34427) 9537 : cluster [DBG] pgmap v5436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:00.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:00 gibba013 bash[29418]: cluster 2021-03-10T16:53:58.348060+0000 mgr.gibba020.yqfnwy (mgr.34427) 9538 : cluster [DBG] pgmap v5437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:00.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:00 gibba013 bash[29418]: cephadm 2021-03-10T16:53:58.654615+0000 mgr.gibba020.yqfnwy (mgr.34427) 9539 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:54:00.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:00 gibba013 bash[30381]: cluster 2021-03-10T16:53:58.348060+0000 mgr.gibba020.yqfnwy (mgr.34427) 9538 : cluster [DBG] pgmap v5437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:00.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:00 gibba013 bash[30381]: cephadm 2021-03-10T16:53:58.654615+0000 mgr.gibba020.yqfnwy (mgr.34427) 9539 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:54:00.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:00 gibba020 bash[25448]: cluster 2021-03-10T16:53:58.348060+0000 mgr.gibba020.yqfnwy (mgr.34427) 9538 : cluster [DBG] pgmap v5437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:00.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:00 gibba020 bash[25448]: cephadm 2021-03-10T16:53:58.654615+0000 mgr.gibba020.yqfnwy (mgr.34427) 9539 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:54:02.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:02 gibba013 bash[29418]: cluster 2021-03-10T16:54:00.349501+0000 mgr.gibba020.yqfnwy (mgr.34427) 9540 : cluster [DBG] pgmap v5438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:02.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:02 gibba013 bash[30381]: cluster 2021-03-10T16:54:00.349501+0000 mgr.gibba020.yqfnwy (mgr.34427) 9540 : cluster [DBG] pgmap v5438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:02.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:02 gibba020 bash[25448]: cluster 2021-03-10T16:54:00.349501+0000 mgr.gibba020.yqfnwy (mgr.34427) 9540 : cluster [DBG] pgmap v5438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:04.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:04 gibba013 bash[29418]: cluster 2021-03-10T16:54:02.350874+0000 mgr.gibba020.yqfnwy (mgr.34427) 9541 : cluster [DBG] pgmap v5439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:04.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:04 gibba013 bash[30381]: cluster 2021-03-10T16:54:02.350874+0000 mgr.gibba020.yqfnwy (mgr.34427) 9541 : cluster [DBG] pgmap v5439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:04.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:04 gibba020 bash[25448]: cluster 2021-03-10T16:54:02.350874+0000 mgr.gibba020.yqfnwy (mgr.34427) 9541 : cluster [DBG] pgmap v5439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:06.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:06 gibba013 bash[29418]: cluster 2021-03-10T16:54:04.352417+0000 mgr.gibba020.yqfnwy (mgr.34427) 9542 : cluster [DBG] pgmap v5440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:06.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:06 gibba013 bash[30381]: cluster 2021-03-10T16:54:04.352417+0000 mgr.gibba020.yqfnwy (mgr.34427) 9542 : cluster [DBG] pgmap v5440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:06.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:06 gibba020 bash[25448]: cluster 2021-03-10T16:54:04.352417+0000 mgr.gibba020.yqfnwy (mgr.34427) 9542 : cluster [DBG] pgmap v5440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:07 gibba013 bash[29418]: audit 2021-03-10T16:54:06.830848+0000 mon.a (mon.0) 3443 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:54:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:07 gibba013 bash[29418]: audit 2021-03-10T16:54:07.014936+0000 mon.a (mon.0) 3444 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:54:07.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:07 gibba013 bash[30381]: audit 2021-03-10T16:54:06.830848+0000 mon.a (mon.0) 3443 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:54:07.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:07 gibba013 bash[30381]: audit 2021-03-10T16:54:07.014936+0000 mon.a (mon.0) 3444 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:54:07.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:07 gibba020 bash[25448]: audit 2021-03-10T16:54:06.830848+0000 mon.a (mon.0) 3443 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:54:07.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:07 gibba020 bash[25448]: audit 2021-03-10T16:54:07.014936+0000 mon.a (mon.0) 3444 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:54:08.231 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:54:08.458 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:54:08.458 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 3m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:54:08.458 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 2m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:54:08.459 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:54:08.459 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:54:08.459 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:54:08.459 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:54:08.460 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:54:08.461 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:54:08.461 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:54:08.461 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:54:08.461 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:54:08.462 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:54:08.462 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:54:08.462 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:54:08.462 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:54:08.462 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:54:08.463 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:54:08.464 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:54:08.464 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 2m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:54:08.464 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:54:08.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:08 gibba013 bash[29418]: cluster 2021-03-10T16:54:06.354252+0000 mgr.gibba020.yqfnwy (mgr.34427) 9543 : cluster [DBG] pgmap v5441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:08.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:08 gibba013 bash[29418]: audit 2021-03-10T16:54:07.394529+0000 mon.a (mon.0) 3445 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:54:08.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:08 gibba013 bash[29418]: audit 2021-03-10T16:54:07.395260+0000 mon.a (mon.0) 3446 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:54:08.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:08 gibba013 bash[29418]: audit 2021-03-10T16:54:07.395982+0000 mon.a (mon.0) 3447 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:54:08.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:08 gibba013 bash[29418]: audit 2021-03-10T16:54:07.396639+0000 mon.a (mon.0) 3448 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T16:54:08.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:08 gibba013 bash[30381]: cluster 2021-03-10T16:54:06.354252+0000 mgr.gibba020.yqfnwy (mgr.34427) 9543 : cluster [DBG] pgmap v5441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:08.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:08 gibba013 bash[30381]: audit 2021-03-10T16:54:07.394529+0000 mon.a (mon.0) 3445 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:54:08.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:08 gibba013 bash[30381]: audit 2021-03-10T16:54:07.395260+0000 mon.a (mon.0) 3446 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:54:08.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:08 gibba013 bash[30381]: audit 2021-03-10T16:54:07.395982+0000 mon.a (mon.0) 3447 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:54:08.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:08 gibba013 bash[30381]: audit 2021-03-10T16:54:07.396639+0000 mon.a (mon.0) 3448 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T16:54:08.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:08 gibba020 bash[25448]: cluster 2021-03-10T16:54:06.354252+0000 mgr.gibba020.yqfnwy (mgr.34427) 9543 : cluster [DBG] pgmap v5441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:08.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:08 gibba020 bash[25448]: audit 2021-03-10T16:54:07.394529+0000 mon.a (mon.0) 3445 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T16:54:08.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:08 gibba020 bash[25448]: audit 2021-03-10T16:54:07.395260+0000 mon.a (mon.0) 3446 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T16:54:08.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:08 gibba020 bash[25448]: audit 2021-03-10T16:54:07.395982+0000 mon.a (mon.0) 3447 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T16:54:08.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:08 gibba020 bash[25448]: audit 2021-03-10T16:54:07.396639+0000 mon.a (mon.0) 3448 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T16:54:08.711 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:54:08.711 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:54:08.712 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:54:08.712 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:54:08.712 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:54:08.712 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:54:08.713 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:54:08.713 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:54:08.713 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:54:08.713 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:54:08.725 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:54:08.726 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:54:08.726 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:54:08.728 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:54:08.728 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:54:09.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:09 gibba013 bash[29418]: audit 2021-03-10T16:54:08.221540+0000 mgr.gibba020.yqfnwy (mgr.34427) 9544 : audit [DBG] from='client.50460 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:54:09.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:09 gibba013 bash[29418]: audit 2021-03-10T16:54:08.710561+0000 mon.a (mon.0) 3449 : audit [DBG] from='client.? 172.21.2.113:0/1208650897' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:09.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:09 gibba013 bash[30381]: audit 2021-03-10T16:54:08.221540+0000 mgr.gibba020.yqfnwy (mgr.34427) 9544 : audit [DBG] from='client.50460 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:54:09.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:09 gibba013 bash[30381]: audit 2021-03-10T16:54:08.710561+0000 mon.a (mon.0) 3449 : audit [DBG] from='client.? 172.21.2.113:0/1208650897' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:09.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:09 gibba020 bash[25448]: audit 2021-03-10T16:54:08.221540+0000 mgr.gibba020.yqfnwy (mgr.34427) 9544 : audit [DBG] from='client.50460 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:54:09.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:09 gibba020 bash[25448]: audit 2021-03-10T16:54:08.710561+0000 mon.a (mon.0) 3449 : audit [DBG] from='client.? 172.21.2.113:0/1208650897' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:10.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:10 gibba013 bash[29418]: cluster 2021-03-10T16:54:08.355849+0000 mgr.gibba020.yqfnwy (mgr.34427) 9545 : cluster [DBG] pgmap v5442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:10.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:10 gibba013 bash[29418]: audit 2021-03-10T16:54:08.446319+0000 mgr.gibba020.yqfnwy (mgr.34427) 9546 : audit [DBG] from='client.50466 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:54:10.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:10 gibba013 bash[30381]: cluster 2021-03-10T16:54:08.355849+0000 mgr.gibba020.yqfnwy (mgr.34427) 9545 : cluster [DBG] pgmap v5442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:10.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:10 gibba013 bash[30381]: audit 2021-03-10T16:54:08.446319+0000 mgr.gibba020.yqfnwy (mgr.34427) 9546 : audit [DBG] from='client.50466 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:54:10.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:10 gibba020 bash[25448]: cluster 2021-03-10T16:54:08.355849+0000 mgr.gibba020.yqfnwy (mgr.34427) 9545 : cluster [DBG] pgmap v5442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:10.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:10 gibba020 bash[25448]: audit 2021-03-10T16:54:08.446319+0000 mgr.gibba020.yqfnwy (mgr.34427) 9546 : audit [DBG] from='client.50466 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:54:12.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:12 gibba013 bash[29418]: cluster 2021-03-10T16:54:10.357350+0000 mgr.gibba020.yqfnwy (mgr.34427) 9547 : cluster [DBG] pgmap v5443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:12.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:12 gibba013 bash[30381]: cluster 2021-03-10T16:54:10.357350+0000 mgr.gibba020.yqfnwy (mgr.34427) 9547 : cluster [DBG] pgmap v5443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:12.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:12 gibba020 bash[25448]: cluster 2021-03-10T16:54:10.357350+0000 mgr.gibba020.yqfnwy (mgr.34427) 9547 : cluster [DBG] pgmap v5443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:14.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:14 gibba013 bash[29418]: cluster 2021-03-10T16:54:12.358572+0000 mgr.gibba020.yqfnwy (mgr.34427) 9548 : cluster [DBG] pgmap v5444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:14.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:14 gibba013 bash[29418]: audit 2021-03-10T16:54:13.672274+0000 mon.a (mon.0) 3450 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:54:14.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:14 gibba013 bash[29418]: audit 2021-03-10T16:54:13.900387+0000 mon.a (mon.0) 3451 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:54:14.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:14 gibba013 bash[29418]: audit 2021-03-10T16:54:13.903637+0000 mon.a (mon.0) 3452 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:54:14.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:14 gibba013 bash[29418]: audit 2021-03-10T16:54:13.905199+0000 mon.a (mon.0) 3453 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:14.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:14 gibba013 bash[29418]: audit 2021-03-10T16:54:13.906837+0000 mon.a (mon.0) 3454 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:14.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:14 gibba013 bash[29418]: audit 2021-03-10T16:54:13.908489+0000 mon.a (mon.0) 3455 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:14.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:14 gibba013 bash[29418]: audit 2021-03-10T16:54:13.911449+0000 mon.a (mon.0) 3456 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:14.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:14 gibba013 bash[29418]: audit 2021-03-10T16:54:13.912906+0000 mon.a (mon.0) 3457 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:14.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:14 gibba013 bash[30381]: cluster 2021-03-10T16:54:12.358572+0000 mgr.gibba020.yqfnwy (mgr.34427) 9548 : cluster [DBG] pgmap v5444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:14.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:14 gibba013 bash[30381]: audit 2021-03-10T16:54:13.672274+0000 mon.a (mon.0) 3450 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:54:14.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:14 gibba013 bash[30381]: audit 2021-03-10T16:54:13.900387+0000 mon.a (mon.0) 3451 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:54:14.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:14 gibba013 bash[30381]: audit 2021-03-10T16:54:13.903637+0000 mon.a (mon.0) 3452 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:54:14.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:14 gibba013 bash[30381]: audit 2021-03-10T16:54:13.905199+0000 mon.a (mon.0) 3453 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:14.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:14 gibba013 bash[30381]: audit 2021-03-10T16:54:13.906837+0000 mon.a (mon.0) 3454 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:14.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:14 gibba013 bash[30381]: audit 2021-03-10T16:54:13.908489+0000 mon.a (mon.0) 3455 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:14.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:14 gibba013 bash[30381]: audit 2021-03-10T16:54:13.911449+0000 mon.a (mon.0) 3456 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:14.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:14 gibba013 bash[30381]: audit 2021-03-10T16:54:13.912906+0000 mon.a (mon.0) 3457 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:14.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:14 gibba020 bash[25448]: cluster 2021-03-10T16:54:12.358572+0000 mgr.gibba020.yqfnwy (mgr.34427) 9548 : cluster [DBG] pgmap v5444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:14.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:14 gibba020 bash[25448]: audit 2021-03-10T16:54:13.672274+0000 mon.a (mon.0) 3450 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:54:14.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:14 gibba020 bash[25448]: audit 2021-03-10T16:54:13.900387+0000 mon.a (mon.0) 3451 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:54:14.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:14 gibba020 bash[25448]: audit 2021-03-10T16:54:13.903637+0000 mon.a (mon.0) 3452 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:54:14.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:14 gibba020 bash[25448]: audit 2021-03-10T16:54:13.905199+0000 mon.a (mon.0) 3453 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:14.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:14 gibba020 bash[25448]: audit 2021-03-10T16:54:13.906837+0000 mon.a (mon.0) 3454 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:14.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:14 gibba020 bash[25448]: audit 2021-03-10T16:54:13.908489+0000 mon.a (mon.0) 3455 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:14.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:14 gibba020 bash[25448]: audit 2021-03-10T16:54:13.911449+0000 mon.a (mon.0) 3456 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:14.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:14 gibba020 bash[25448]: audit 2021-03-10T16:54:13.912906+0000 mon.a (mon.0) 3457 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:15.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:15 gibba013 bash[29418]: cephadm 2021-03-10T16:54:13.677243+0000 mgr.gibba020.yqfnwy (mgr.34427) 9549 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:54:15.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:15 gibba013 bash[29418]: cephadm 2021-03-10T16:54:13.679029+0000 mgr.gibba020.yqfnwy (mgr.34427) 9550 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:54:15.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:15 gibba013 bash[29418]: cephadm 2021-03-10T16:54:13.902208+0000 mgr.gibba020.yqfnwy (mgr.34427) 9551 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:54:15.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:15 gibba013 bash[29418]: cephadm 2021-03-10T16:54:13.904028+0000 mgr.gibba020.yqfnwy (mgr.34427) 9552 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:54:15.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:15 gibba013 bash[29418]: cephadm 2021-03-10T16:54:13.905635+0000 mgr.gibba020.yqfnwy (mgr.34427) 9553 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:54:15.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:15 gibba013 bash[29418]: cephadm 2021-03-10T16:54:13.905726+0000 mgr.gibba020.yqfnwy (mgr.34427) 9554 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:54:15.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:15 gibba013 bash[29418]: cephadm 2021-03-10T16:54:13.907328+0000 mgr.gibba020.yqfnwy (mgr.34427) 9555 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:54:15.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:15 gibba013 bash[29418]: cephadm 2021-03-10T16:54:13.907366+0000 mgr.gibba020.yqfnwy (mgr.34427) 9556 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:54:15.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:15 gibba013 bash[29418]: cephadm 2021-03-10T16:54:13.908797+0000 mgr.gibba020.yqfnwy (mgr.34427) 9557 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:54:15.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:15 gibba013 bash[29418]: cephadm 2021-03-10T16:54:13.910234+0000 mgr.gibba020.yqfnwy (mgr.34427) 9558 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:54:15.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:15 gibba013 bash[29418]: cephadm 2021-03-10T16:54:13.910273+0000 mgr.gibba020.yqfnwy (mgr.34427) 9559 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:54:15.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:15 gibba013 bash[29418]: cephadm 2021-03-10T16:54:13.911714+0000 mgr.gibba020.yqfnwy (mgr.34427) 9560 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:54:15.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:15 gibba013 bash[29418]: cephadm 2021-03-10T16:54:13.912045+0000 mgr.gibba020.yqfnwy (mgr.34427) 9561 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:54:15.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:15 gibba013 bash[29418]: cephadm 2021-03-10T16:54:13.913250+0000 mgr.gibba020.yqfnwy (mgr.34427) 9562 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:54:15.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:15 gibba013 bash[29418]: cephadm 2021-03-10T16:54:13.913288+0000 mgr.gibba020.yqfnwy (mgr.34427) 9563 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:54:15.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:15 gibba013 bash[29418]: cephadm 2021-03-10T16:54:13.913401+0000 mgr.gibba020.yqfnwy (mgr.34427) 9564 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:54:15.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:15 gibba013 bash[30381]: cephadm 2021-03-10T16:54:13.677243+0000 mgr.gibba020.yqfnwy (mgr.34427) 9549 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:54:15.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:15 gibba013 bash[30381]: cephadm 2021-03-10T16:54:13.679029+0000 mgr.gibba020.yqfnwy (mgr.34427) 9550 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:54:15.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:15 gibba013 bash[30381]: cephadm 2021-03-10T16:54:13.902208+0000 mgr.gibba020.yqfnwy (mgr.34427) 9551 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:54:15.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:15 gibba013 bash[30381]: cephadm 2021-03-10T16:54:13.904028+0000 mgr.gibba020.yqfnwy (mgr.34427) 9552 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:54:15.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:15 gibba013 bash[30381]: cephadm 2021-03-10T16:54:13.905635+0000 mgr.gibba020.yqfnwy (mgr.34427) 9553 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:54:15.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:15 gibba013 bash[30381]: cephadm 2021-03-10T16:54:13.905726+0000 mgr.gibba020.yqfnwy (mgr.34427) 9554 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:54:15.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:15 gibba013 bash[30381]: cephadm 2021-03-10T16:54:13.907328+0000 mgr.gibba020.yqfnwy (mgr.34427) 9555 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:54:15.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:15 gibba013 bash[30381]: cephadm 2021-03-10T16:54:13.907366+0000 mgr.gibba020.yqfnwy (mgr.34427) 9556 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:54:15.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:15 gibba013 bash[30381]: cephadm 2021-03-10T16:54:13.908797+0000 mgr.gibba020.yqfnwy (mgr.34427) 9557 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:54:15.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:15 gibba013 bash[30381]: cephadm 2021-03-10T16:54:13.910234+0000 mgr.gibba020.yqfnwy (mgr.34427) 9558 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:54:15.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:15 gibba013 bash[30381]: cephadm 2021-03-10T16:54:13.910273+0000 mgr.gibba020.yqfnwy (mgr.34427) 9559 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:54:15.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:15 gibba013 bash[30381]: cephadm 2021-03-10T16:54:13.911714+0000 mgr.gibba020.yqfnwy (mgr.34427) 9560 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:54:15.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:15 gibba013 bash[30381]: cephadm 2021-03-10T16:54:13.912045+0000 mgr.gibba020.yqfnwy (mgr.34427) 9561 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:54:15.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:15 gibba013 bash[30381]: cephadm 2021-03-10T16:54:13.913250+0000 mgr.gibba020.yqfnwy (mgr.34427) 9562 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:54:15.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:15 gibba013 bash[30381]: cephadm 2021-03-10T16:54:13.913288+0000 mgr.gibba020.yqfnwy (mgr.34427) 9563 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:54:15.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:15 gibba013 bash[30381]: cephadm 2021-03-10T16:54:13.913401+0000 mgr.gibba020.yqfnwy (mgr.34427) 9564 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:54:15.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:15 gibba020 bash[25448]: cephadm 2021-03-10T16:54:13.677243+0000 mgr.gibba020.yqfnwy (mgr.34427) 9549 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:54:15.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:15 gibba020 bash[25448]: cephadm 2021-03-10T16:54:13.679029+0000 mgr.gibba020.yqfnwy (mgr.34427) 9550 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:54:15.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:15 gibba020 bash[25448]: cephadm 2021-03-10T16:54:13.902208+0000 mgr.gibba020.yqfnwy (mgr.34427) 9551 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:54:15.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:15 gibba020 bash[25448]: cephadm 2021-03-10T16:54:13.904028+0000 mgr.gibba020.yqfnwy (mgr.34427) 9552 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:54:15.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:15 gibba020 bash[25448]: cephadm 2021-03-10T16:54:13.905635+0000 mgr.gibba020.yqfnwy (mgr.34427) 9553 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:54:15.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:15 gibba020 bash[25448]: cephadm 2021-03-10T16:54:13.905726+0000 mgr.gibba020.yqfnwy (mgr.34427) 9554 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:54:15.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:15 gibba020 bash[25448]: cephadm 2021-03-10T16:54:13.907328+0000 mgr.gibba020.yqfnwy (mgr.34427) 9555 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:54:15.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:15 gibba020 bash[25448]: cephadm 2021-03-10T16:54:13.907366+0000 mgr.gibba020.yqfnwy (mgr.34427) 9556 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:54:15.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:15 gibba020 bash[25448]: cephadm 2021-03-10T16:54:13.908797+0000 mgr.gibba020.yqfnwy (mgr.34427) 9557 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:54:15.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:15 gibba020 bash[25448]: cephadm 2021-03-10T16:54:13.910234+0000 mgr.gibba020.yqfnwy (mgr.34427) 9558 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:54:15.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:15 gibba020 bash[25448]: cephadm 2021-03-10T16:54:13.910273+0000 mgr.gibba020.yqfnwy (mgr.34427) 9559 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:54:15.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:15 gibba020 bash[25448]: cephadm 2021-03-10T16:54:13.911714+0000 mgr.gibba020.yqfnwy (mgr.34427) 9560 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:54:15.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:15 gibba020 bash[25448]: cephadm 2021-03-10T16:54:13.912045+0000 mgr.gibba020.yqfnwy (mgr.34427) 9561 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:54:15.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:15 gibba020 bash[25448]: cephadm 2021-03-10T16:54:13.913250+0000 mgr.gibba020.yqfnwy (mgr.34427) 9562 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:54:15.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:15 gibba020 bash[25448]: cephadm 2021-03-10T16:54:13.913288+0000 mgr.gibba020.yqfnwy (mgr.34427) 9563 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:54:15.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:15 gibba020 bash[25448]: cephadm 2021-03-10T16:54:13.913401+0000 mgr.gibba020.yqfnwy (mgr.34427) 9564 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:54:16.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:16 gibba013 bash[29418]: cluster 2021-03-10T16:54:14.360102+0000 mgr.gibba020.yqfnwy (mgr.34427) 9565 : cluster [DBG] pgmap v5445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:16.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:16 gibba013 bash[30381]: cluster 2021-03-10T16:54:14.360102+0000 mgr.gibba020.yqfnwy (mgr.34427) 9565 : cluster [DBG] pgmap v5445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:16.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:16 gibba020 bash[25448]: cluster 2021-03-10T16:54:14.360102+0000 mgr.gibba020.yqfnwy (mgr.34427) 9565 : cluster [DBG] pgmap v5445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:17.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:17 gibba013 bash[29418]: cluster 2021-03-10T16:54:16.361103+0000 mgr.gibba020.yqfnwy (mgr.34427) 9566 : cluster [DBG] pgmap v5446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:17.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:17 gibba013 bash[30381]: cluster 2021-03-10T16:54:16.361103+0000 mgr.gibba020.yqfnwy (mgr.34427) 9566 : cluster [DBG] pgmap v5446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:17.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:17 gibba020 bash[25448]: cluster 2021-03-10T16:54:16.361103+0000 mgr.gibba020.yqfnwy (mgr.34427) 9566 : cluster [DBG] pgmap v5446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:19.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:19 gibba020 bash[25448]: cluster 2021-03-10T16:54:18.362424+0000 mgr.gibba020.yqfnwy (mgr.34427) 9567 : cluster [DBG] pgmap v5447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:19.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:19 gibba013 bash[29418]: cluster 2021-03-10T16:54:18.362424+0000 mgr.gibba020.yqfnwy (mgr.34427) 9567 : cluster [DBG] pgmap v5447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:19.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:19 gibba013 bash[30381]: cluster 2021-03-10T16:54:18.362424+0000 mgr.gibba020.yqfnwy (mgr.34427) 9567 : cluster [DBG] pgmap v5447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:22.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:22 gibba013 bash[29418]: cluster 2021-03-10T16:54:20.364283+0000 mgr.gibba020.yqfnwy (mgr.34427) 9568 : cluster [DBG] pgmap v5448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:22.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:22 gibba013 bash[30381]: cluster 2021-03-10T16:54:20.364283+0000 mgr.gibba020.yqfnwy (mgr.34427) 9568 : cluster [DBG] pgmap v5448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:22.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:22 gibba020 bash[25448]: cluster 2021-03-10T16:54:20.364283+0000 mgr.gibba020.yqfnwy (mgr.34427) 9568 : cluster [DBG] pgmap v5448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:24.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:24 gibba013 bash[29418]: cluster 2021-03-10T16:54:22.365418+0000 mgr.gibba020.yqfnwy (mgr.34427) 9569 : cluster [DBG] pgmap v5449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:24.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:24 gibba013 bash[30381]: cluster 2021-03-10T16:54:22.365418+0000 mgr.gibba020.yqfnwy (mgr.34427) 9569 : cluster [DBG] pgmap v5449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:24.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:24 gibba020 bash[25448]: cluster 2021-03-10T16:54:22.365418+0000 mgr.gibba020.yqfnwy (mgr.34427) 9569 : cluster [DBG] pgmap v5449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:26.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:26 gibba013 bash[29418]: cluster 2021-03-10T16:54:24.367103+0000 mgr.gibba020.yqfnwy (mgr.34427) 9570 : cluster [DBG] pgmap v5450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:26.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:26 gibba013 bash[30381]: cluster 2021-03-10T16:54:24.367103+0000 mgr.gibba020.yqfnwy (mgr.34427) 9570 : cluster [DBG] pgmap v5450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:26.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:26 gibba020 bash[25448]: cluster 2021-03-10T16:54:24.367103+0000 mgr.gibba020.yqfnwy (mgr.34427) 9570 : cluster [DBG] pgmap v5450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:28.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:28 gibba013 bash[29418]: cluster 2021-03-10T16:54:26.368769+0000 mgr.gibba020.yqfnwy (mgr.34427) 9571 : cluster [DBG] pgmap v5451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:28.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:28 gibba013 bash[30381]: cluster 2021-03-10T16:54:26.368769+0000 mgr.gibba020.yqfnwy (mgr.34427) 9571 : cluster [DBG] pgmap v5451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:28.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:28 gibba020 bash[25448]: cluster 2021-03-10T16:54:26.368769+0000 mgr.gibba020.yqfnwy (mgr.34427) 9571 : cluster [DBG] pgmap v5451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:30.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:30 gibba013 bash[29418]: cluster 2021-03-10T16:54:28.370195+0000 mgr.gibba020.yqfnwy (mgr.34427) 9572 : cluster [DBG] pgmap v5452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:30.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:30 gibba013 bash[29418]: cephadm 2021-03-10T16:54:28.929420+0000 mgr.gibba020.yqfnwy (mgr.34427) 9573 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:54:30.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:30 gibba013 bash[30381]: cluster 2021-03-10T16:54:28.370195+0000 mgr.gibba020.yqfnwy (mgr.34427) 9572 : cluster [DBG] pgmap v5452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:30.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:30 gibba013 bash[30381]: cephadm 2021-03-10T16:54:28.929420+0000 mgr.gibba020.yqfnwy (mgr.34427) 9573 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:54:30.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:30 gibba020 bash[25448]: cluster 2021-03-10T16:54:28.370195+0000 mgr.gibba020.yqfnwy (mgr.34427) 9572 : cluster [DBG] pgmap v5452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:30.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:30 gibba020 bash[25448]: cephadm 2021-03-10T16:54:28.929420+0000 mgr.gibba020.yqfnwy (mgr.34427) 9573 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:54:32.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:32 gibba013 bash[29418]: cluster 2021-03-10T16:54:30.371977+0000 mgr.gibba020.yqfnwy (mgr.34427) 9574 : cluster [DBG] pgmap v5453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:32.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:32 gibba013 bash[30381]: cluster 2021-03-10T16:54:30.371977+0000 mgr.gibba020.yqfnwy (mgr.34427) 9574 : cluster [DBG] pgmap v5453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:32.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:32 gibba020 bash[25448]: cluster 2021-03-10T16:54:30.371977+0000 mgr.gibba020.yqfnwy (mgr.34427) 9574 : cluster [DBG] pgmap v5453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:34.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:34 gibba013 bash[29418]: cluster 2021-03-10T16:54:32.373110+0000 mgr.gibba020.yqfnwy (mgr.34427) 9575 : cluster [DBG] pgmap v5454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:34.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:34 gibba013 bash[30381]: cluster 2021-03-10T16:54:32.373110+0000 mgr.gibba020.yqfnwy (mgr.34427) 9575 : cluster [DBG] pgmap v5454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:34.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:34 gibba020 bash[25448]: cluster 2021-03-10T16:54:32.373110+0000 mgr.gibba020.yqfnwy (mgr.34427) 9575 : cluster [DBG] pgmap v5454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:36.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:36 gibba013 bash[29418]: cluster 2021-03-10T16:54:34.374516+0000 mgr.gibba020.yqfnwy (mgr.34427) 9576 : cluster [DBG] pgmap v5455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:36.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:36 gibba013 bash[30381]: cluster 2021-03-10T16:54:34.374516+0000 mgr.gibba020.yqfnwy (mgr.34427) 9576 : cluster [DBG] pgmap v5455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:36.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:36 gibba020 bash[25448]: cluster 2021-03-10T16:54:34.374516+0000 mgr.gibba020.yqfnwy (mgr.34427) 9576 : cluster [DBG] pgmap v5455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:38.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:38 gibba013 bash[29418]: cluster 2021-03-10T16:54:36.376126+0000 mgr.gibba020.yqfnwy (mgr.34427) 9577 : cluster [DBG] pgmap v5456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:38.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:38 gibba013 bash[30381]: cluster 2021-03-10T16:54:36.376126+0000 mgr.gibba020.yqfnwy (mgr.34427) 9577 : cluster [DBG] pgmap v5456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:38.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:38 gibba020 bash[25448]: cluster 2021-03-10T16:54:36.376126+0000 mgr.gibba020.yqfnwy (mgr.34427) 9577 : cluster [DBG] pgmap v5456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:38.956 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:54:39.181 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:54:39.182 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 3m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:54:39.182 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 2m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:54:39.182 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:54:39.182 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:54:39.183 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:54:39.183 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:54:39.183 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:54:39.183 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:54:39.183 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:54:39.184 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:54:39.184 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:54:39.184 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:54:39.184 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:54:39.185 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:54:39.186 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:54:39.186 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:54:39.187 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:54:39.188 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:54:39.188 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 2m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:54:39.188 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:54:39.432 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:54:39.432 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:54:39.432 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:54:39.433 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:54:39.433 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:54:39.433 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:54:39.433 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:54:39.434 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:54:39.434 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:54:39.434 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:54:39.434 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:54:39.435 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:54:39.435 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:54:39.435 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:54:39.435 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:54:40.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:40 gibba013 bash[29418]: cluster 2021-03-10T16:54:38.377610+0000 mgr.gibba020.yqfnwy (mgr.34427) 9578 : cluster [DBG] pgmap v5457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:40.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:40 gibba013 bash[29418]: audit 2021-03-10T16:54:38.945696+0000 mgr.gibba020.yqfnwy (mgr.34427) 9579 : audit [DBG] from='client.50478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:54:40.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:40 gibba013 bash[29418]: audit 2021-03-10T16:54:39.168476+0000 mgr.gibba020.yqfnwy (mgr.34427) 9580 : audit [DBG] from='client.50484 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:54:40.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:40 gibba013 bash[29418]: audit 2021-03-10T16:54:39.432680+0000 mon.c (mon.1) 146 : audit [DBG] from='client.? 172.21.2.113:0/1541489649' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:40.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:40 gibba013 bash[30381]: cluster 2021-03-10T16:54:38.377610+0000 mgr.gibba020.yqfnwy (mgr.34427) 9578 : cluster [DBG] pgmap v5457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:40.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:40 gibba013 bash[30381]: audit 2021-03-10T16:54:38.945696+0000 mgr.gibba020.yqfnwy (mgr.34427) 9579 : audit [DBG] from='client.50478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:54:40.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:40 gibba013 bash[30381]: audit 2021-03-10T16:54:39.168476+0000 mgr.gibba020.yqfnwy (mgr.34427) 9580 : audit [DBG] from='client.50484 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:54:40.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:40 gibba013 bash[30381]: audit 2021-03-10T16:54:39.432680+0000 mon.c (mon.1) 146 : audit [DBG] from='client.? 172.21.2.113:0/1541489649' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:40.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:40 gibba020 bash[25448]: cluster 2021-03-10T16:54:38.377610+0000 mgr.gibba020.yqfnwy (mgr.34427) 9578 : cluster [DBG] pgmap v5457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:40.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:40 gibba020 bash[25448]: audit 2021-03-10T16:54:38.945696+0000 mgr.gibba020.yqfnwy (mgr.34427) 9579 : audit [DBG] from='client.50478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:54:40.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:40 gibba020 bash[25448]: audit 2021-03-10T16:54:39.168476+0000 mgr.gibba020.yqfnwy (mgr.34427) 9580 : audit [DBG] from='client.50484 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:54:40.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:40 gibba020 bash[25448]: audit 2021-03-10T16:54:39.432680+0000 mon.c (mon.1) 146 : audit [DBG] from='client.? 172.21.2.113:0/1541489649' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:54:42.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:42 gibba013 bash[29418]: cluster 2021-03-10T16:54:40.379375+0000 mgr.gibba020.yqfnwy (mgr.34427) 9581 : cluster [DBG] pgmap v5458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:42.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:42 gibba013 bash[30381]: cluster 2021-03-10T16:54:40.379375+0000 mgr.gibba020.yqfnwy (mgr.34427) 9581 : cluster [DBG] pgmap v5458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:42.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:42 gibba020 bash[25448]: cluster 2021-03-10T16:54:40.379375+0000 mgr.gibba020.yqfnwy (mgr.34427) 9581 : cluster [DBG] pgmap v5458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:44.196 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:44 gibba020 bash[25448]: cluster 2021-03-10T16:54:42.380801+0000 mgr.gibba020.yqfnwy (mgr.34427) 9582 : cluster [DBG] pgmap v5459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:44.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:44 gibba013 bash[29418]: cluster 2021-03-10T16:54:42.380801+0000 mgr.gibba020.yqfnwy (mgr.34427) 9582 : cluster [DBG] pgmap v5459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:44.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:44 gibba013 bash[30381]: cluster 2021-03-10T16:54:42.380801+0000 mgr.gibba020.yqfnwy (mgr.34427) 9582 : cluster [DBG] pgmap v5459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:45.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:45 gibba020 bash[25448]: cephadm 2021-03-10T16:54:43.933060+0000 mgr.gibba020.yqfnwy (mgr.34427) 9583 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:54:45.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:45 gibba013 bash[29418]: cephadm 2021-03-10T16:54:43.933060+0000 mgr.gibba020.yqfnwy (mgr.34427) 9583 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:54:45.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:45 gibba013 bash[30381]: cephadm 2021-03-10T16:54:43.933060+0000 mgr.gibba020.yqfnwy (mgr.34427) 9583 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:54:46.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:46 gibba020 bash[25448]: cluster 2021-03-10T16:54:44.382413+0000 mgr.gibba020.yqfnwy (mgr.34427) 9584 : cluster [DBG] pgmap v5460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:46.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:46 gibba013 bash[29418]: cluster 2021-03-10T16:54:44.382413+0000 mgr.gibba020.yqfnwy (mgr.34427) 9584 : cluster [DBG] pgmap v5460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:46.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:46 gibba013 bash[30381]: cluster 2021-03-10T16:54:44.382413+0000 mgr.gibba020.yqfnwy (mgr.34427) 9584 : cluster [DBG] pgmap v5460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:48.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:48 gibba020 bash[25448]: cluster 2021-03-10T16:54:46.384354+0000 mgr.gibba020.yqfnwy (mgr.34427) 9585 : cluster [DBG] pgmap v5461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:48.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:48 gibba013 bash[29418]: cluster 2021-03-10T16:54:46.384354+0000 mgr.gibba020.yqfnwy (mgr.34427) 9585 : cluster [DBG] pgmap v5461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:48.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:48 gibba013 bash[30381]: cluster 2021-03-10T16:54:46.384354+0000 mgr.gibba020.yqfnwy (mgr.34427) 9585 : cluster [DBG] pgmap v5461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:50.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:50 gibba020 bash[25448]: cluster 2021-03-10T16:54:48.386002+0000 mgr.gibba020.yqfnwy (mgr.34427) 9586 : cluster [DBG] pgmap v5462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:50.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:50 gibba013 bash[29418]: cluster 2021-03-10T16:54:48.386002+0000 mgr.gibba020.yqfnwy (mgr.34427) 9586 : cluster [DBG] pgmap v5462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:50.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:50 gibba013 bash[30381]: cluster 2021-03-10T16:54:48.386002+0000 mgr.gibba020.yqfnwy (mgr.34427) 9586 : cluster [DBG] pgmap v5462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:52.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:52 gibba020 bash[25448]: cluster 2021-03-10T16:54:50.387671+0000 mgr.gibba020.yqfnwy (mgr.34427) 9587 : cluster [DBG] pgmap v5463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:52.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:52 gibba013 bash[29418]: cluster 2021-03-10T16:54:50.387671+0000 mgr.gibba020.yqfnwy (mgr.34427) 9587 : cluster [DBG] pgmap v5463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:52.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:52 gibba013 bash[30381]: cluster 2021-03-10T16:54:50.387671+0000 mgr.gibba020.yqfnwy (mgr.34427) 9587 : cluster [DBG] pgmap v5463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:54.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:54 gibba020 bash[25448]: cluster 2021-03-10T16:54:52.388984+0000 mgr.gibba020.yqfnwy (mgr.34427) 9588 : cluster [DBG] pgmap v5464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:54.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:54 gibba013 bash[29418]: cluster 2021-03-10T16:54:52.388984+0000 mgr.gibba020.yqfnwy (mgr.34427) 9588 : cluster [DBG] pgmap v5464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:54.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:54 gibba013 bash[30381]: cluster 2021-03-10T16:54:52.388984+0000 mgr.gibba020.yqfnwy (mgr.34427) 9588 : cluster [DBG] pgmap v5464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:56.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:56 gibba020 bash[25448]: cluster 2021-03-10T16:54:54.390574+0000 mgr.gibba020.yqfnwy (mgr.34427) 9589 : cluster [DBG] pgmap v5465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:56.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:56 gibba013 bash[30381]: cluster 2021-03-10T16:54:54.390574+0000 mgr.gibba020.yqfnwy (mgr.34427) 9589 : cluster [DBG] pgmap v5465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:56.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:56 gibba013 bash[29418]: cluster 2021-03-10T16:54:54.390574+0000 mgr.gibba020.yqfnwy (mgr.34427) 9589 : cluster [DBG] pgmap v5465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:58.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:54:58 gibba013 bash[29418]: cluster 2021-03-10T16:54:56.392451+0000 mgr.gibba020.yqfnwy (mgr.34427) 9590 : cluster [DBG] pgmap v5466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:58.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:54:58 gibba013 bash[30381]: cluster 2021-03-10T16:54:56.392451+0000 mgr.gibba020.yqfnwy (mgr.34427) 9590 : cluster [DBG] pgmap v5466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:54:58.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:54:58 gibba020 bash[25448]: cluster 2021-03-10T16:54:56.392451+0000 mgr.gibba020.yqfnwy (mgr.34427) 9590 : cluster [DBG] pgmap v5466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:00.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:00 gibba013 bash[29418]: cluster 2021-03-10T16:54:58.393808+0000 mgr.gibba020.yqfnwy (mgr.34427) 9591 : cluster [DBG] pgmap v5467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:00.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:00 gibba013 bash[29418]: cephadm 2021-03-10T16:54:58.949015+0000 mgr.gibba020.yqfnwy (mgr.34427) 9592 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:55:00.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:00 gibba013 bash[30381]: cluster 2021-03-10T16:54:58.393808+0000 mgr.gibba020.yqfnwy (mgr.34427) 9591 : cluster [DBG] pgmap v5467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:00.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:00 gibba013 bash[30381]: cephadm 2021-03-10T16:54:58.949015+0000 mgr.gibba020.yqfnwy (mgr.34427) 9592 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:55:00.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:00 gibba020 bash[25448]: cluster 2021-03-10T16:54:58.393808+0000 mgr.gibba020.yqfnwy (mgr.34427) 9591 : cluster [DBG] pgmap v5467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:00.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:00 gibba020 bash[25448]: cephadm 2021-03-10T16:54:58.949015+0000 mgr.gibba020.yqfnwy (mgr.34427) 9592 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:55:02.217 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:02 gibba013 bash[29418]: cluster 2021-03-10T16:55:00.395394+0000 mgr.gibba020.yqfnwy (mgr.34427) 9593 : cluster [DBG] pgmap v5468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:02.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:02 gibba013 bash[30381]: cluster 2021-03-10T16:55:00.395394+0000 mgr.gibba020.yqfnwy (mgr.34427) 9593 : cluster [DBG] pgmap v5468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:02.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:02 gibba020 bash[25448]: cluster 2021-03-10T16:55:00.395394+0000 mgr.gibba020.yqfnwy (mgr.34427) 9593 : cluster [DBG] pgmap v5468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:04.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:04 gibba013 bash[29418]: cluster 2021-03-10T16:55:02.396751+0000 mgr.gibba020.yqfnwy (mgr.34427) 9594 : cluster [DBG] pgmap v5469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:04.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:04 gibba013 bash[30381]: cluster 2021-03-10T16:55:02.396751+0000 mgr.gibba020.yqfnwy (mgr.34427) 9594 : cluster [DBG] pgmap v5469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:04.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:04 gibba020 bash[25448]: cluster 2021-03-10T16:55:02.396751+0000 mgr.gibba020.yqfnwy (mgr.34427) 9594 : cluster [DBG] pgmap v5469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:06.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:06 gibba013 bash[29418]: cluster 2021-03-10T16:55:04.398417+0000 mgr.gibba020.yqfnwy (mgr.34427) 9595 : cluster [DBG] pgmap v5470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:06.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:06 gibba013 bash[30381]: cluster 2021-03-10T16:55:04.398417+0000 mgr.gibba020.yqfnwy (mgr.34427) 9595 : cluster [DBG] pgmap v5470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:06.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:06 gibba020 bash[25448]: cluster 2021-03-10T16:55:04.398417+0000 mgr.gibba020.yqfnwy (mgr.34427) 9595 : cluster [DBG] pgmap v5470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:07.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:07 gibba013 bash[29418]: audit 2021-03-10T16:55:06.835540+0000 mon.a (mon.0) 3458 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:55:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:07 gibba013 bash[29418]: audit 2021-03-10T16:55:07.021171+0000 mon.a (mon.0) 3459 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:55:07.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:07 gibba013 bash[30381]: audit 2021-03-10T16:55:06.835540+0000 mon.a (mon.0) 3458 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:55:07.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:07 gibba013 bash[30381]: audit 2021-03-10T16:55:07.021171+0000 mon.a (mon.0) 3459 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:55:07.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:07 gibba020 bash[25448]: audit 2021-03-10T16:55:06.835540+0000 mon.a (mon.0) 3458 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:55:07.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:07 gibba020 bash[25448]: audit 2021-03-10T16:55:07.021171+0000 mon.a (mon.0) 3459 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:55:08.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:08 gibba013 bash[29418]: cluster 2021-03-10T16:55:06.400323+0000 mgr.gibba020.yqfnwy (mgr.34427) 9596 : cluster [DBG] pgmap v5471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:08.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:08 gibba013 bash[29418]: audit 2021-03-10T16:55:07.405333+0000 mon.a (mon.0) 3460 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T16:55:08.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:08 gibba013 bash[29418]: audit 2021-03-10T16:55:07.406141+0000 mon.a (mon.0) 3461 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:55:08.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:08 gibba013 bash[29418]: audit 2021-03-10T16:55:07.406879+0000 mon.a (mon.0) 3462 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T16:55:08.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:08 gibba013 bash[29418]: audit 2021-03-10T16:55:07.407545+0000 mon.a (mon.0) 3463 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:55:08.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:08 gibba013 bash[30381]: cluster 2021-03-10T16:55:06.400323+0000 mgr.gibba020.yqfnwy (mgr.34427) 9596 : cluster [DBG] pgmap v5471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:08.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:08 gibba013 bash[30381]: audit 2021-03-10T16:55:07.405333+0000 mon.a (mon.0) 3460 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T16:55:08.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:08 gibba013 bash[30381]: audit 2021-03-10T16:55:07.406141+0000 mon.a (mon.0) 3461 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:55:08.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:08 gibba013 bash[30381]: audit 2021-03-10T16:55:07.406879+0000 mon.a (mon.0) 3462 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T16:55:08.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:08 gibba013 bash[30381]: audit 2021-03-10T16:55:07.407545+0000 mon.a (mon.0) 3463 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:55:08.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:08 gibba020 bash[25448]: cluster 2021-03-10T16:55:06.400323+0000 mgr.gibba020.yqfnwy (mgr.34427) 9596 : cluster [DBG] pgmap v5471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:08.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:08 gibba020 bash[25448]: audit 2021-03-10T16:55:07.405333+0000 mon.a (mon.0) 3460 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T16:55:08.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:08 gibba020 bash[25448]: audit 2021-03-10T16:55:07.406141+0000 mon.a (mon.0) 3461 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T16:55:08.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:08 gibba020 bash[25448]: audit 2021-03-10T16:55:07.406879+0000 mon.a (mon.0) 3462 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T16:55:08.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:08 gibba020 bash[25448]: audit 2021-03-10T16:55:07.407545+0000 mon.a (mon.0) 3463 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:55:09.678 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:55:09.906 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:55:09.907 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 4m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:55:09.907 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 3m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:55:09.907 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:55:09.907 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:55:09.908 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:55:09.908 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:55:09.908 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:55:09.908 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:55:09.909 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:55:09.909 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:55:09.909 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:55:09.909 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:55:09.909 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:55:09.910 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:55:09.910 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:55:09.910 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:55:09.910 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:55:09.910 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:55:09.911 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 3m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:55:09.911 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 3m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:55:10.155 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:55:10.156 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:55:10.156 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:55:10.156 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:55:10.156 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:55:10.156 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:55:10.157 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:55:10.157 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:55:10.157 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:55:10.157 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:55:10.158 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:55:10.158 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:55:10.158 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:55:10.158 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:55:10.158 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:55:10.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:10 gibba013 bash[29418]: cluster 2021-03-10T16:55:08.401781+0000 mgr.gibba020.yqfnwy (mgr.34427) 9597 : cluster [DBG] pgmap v5472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:10.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:10 gibba013 bash[29418]: audit 2021-03-10T16:55:10.156049+0000 mon.a (mon.0) 3464 : audit [DBG] from='client.? 172.21.2.113:0/3189531520' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:10.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:10 gibba013 bash[30381]: cluster 2021-03-10T16:55:08.401781+0000 mgr.gibba020.yqfnwy (mgr.34427) 9597 : cluster [DBG] pgmap v5472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:10.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:10 gibba013 bash[30381]: audit 2021-03-10T16:55:10.156049+0000 mon.a (mon.0) 3464 : audit [DBG] from='client.? 172.21.2.113:0/3189531520' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:10.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:10 gibba020 bash[25448]: cluster 2021-03-10T16:55:08.401781+0000 mgr.gibba020.yqfnwy (mgr.34427) 9597 : cluster [DBG] pgmap v5472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:10.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:10 gibba020 bash[25448]: audit 2021-03-10T16:55:10.156049+0000 mon.a (mon.0) 3464 : audit [DBG] from='client.? 172.21.2.113:0/3189531520' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:11.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:11 gibba013 bash[29418]: audit 2021-03-10T16:55:09.670425+0000 mgr.gibba020.yqfnwy (mgr.34427) 9598 : audit [DBG] from='client.50496 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:55:11.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:11 gibba013 bash[29418]: audit 2021-03-10T16:55:09.894560+0000 mgr.gibba020.yqfnwy (mgr.34427) 9599 : audit [DBG] from='client.60481 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:55:11.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:11 gibba013 bash[30381]: audit 2021-03-10T16:55:09.670425+0000 mgr.gibba020.yqfnwy (mgr.34427) 9598 : audit [DBG] from='client.50496 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:55:11.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:11 gibba013 bash[30381]: audit 2021-03-10T16:55:09.894560+0000 mgr.gibba020.yqfnwy (mgr.34427) 9599 : audit [DBG] from='client.60481 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:55:11.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:11 gibba020 bash[25448]: audit 2021-03-10T16:55:09.670425+0000 mgr.gibba020.yqfnwy (mgr.34427) 9598 : audit [DBG] from='client.50496 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:55:11.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:11 gibba020 bash[25448]: audit 2021-03-10T16:55:09.894560+0000 mgr.gibba020.yqfnwy (mgr.34427) 9599 : audit [DBG] from='client.60481 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:55:12.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:12 gibba013 bash[29418]: cluster 2021-03-10T16:55:10.403546+0000 mgr.gibba020.yqfnwy (mgr.34427) 9600 : cluster [DBG] pgmap v5473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:12.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:12 gibba013 bash[30381]: cluster 2021-03-10T16:55:10.403546+0000 mgr.gibba020.yqfnwy (mgr.34427) 9600 : cluster [DBG] pgmap v5473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:12.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:12 gibba020 bash[25448]: cluster 2021-03-10T16:55:10.403546+0000 mgr.gibba020.yqfnwy (mgr.34427) 9600 : cluster [DBG] pgmap v5473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:14.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:14 gibba013 bash[29418]: cluster 2021-03-10T16:55:12.404959+0000 mgr.gibba020.yqfnwy (mgr.34427) 9601 : cluster [DBG] pgmap v5474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:14.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:14 gibba013 bash[29418]: audit 2021-03-10T16:55:13.966137+0000 mon.a (mon.0) 3465 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:55:14.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:14 gibba013 bash[29418]: audit 2021-03-10T16:55:14.188282+0000 mon.a (mon.0) 3466 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:55:14.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:14 gibba013 bash[29418]: audit 2021-03-10T16:55:14.191734+0000 mon.a (mon.0) 3467 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:55:14.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:14 gibba013 bash[29418]: audit 2021-03-10T16:55:14.192962+0000 mon.a (mon.0) 3468 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:14.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:14 gibba013 bash[29418]: audit 2021-03-10T16:55:14.194026+0000 mon.a (mon.0) 3469 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:14.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:14 gibba013 bash[29418]: audit 2021-03-10T16:55:14.195051+0000 mon.a (mon.0) 3470 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:14.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:14 gibba013 bash[29418]: audit 2021-03-10T16:55:14.197167+0000 mon.a (mon.0) 3471 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:14.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:14 gibba013 bash[29418]: audit 2021-03-10T16:55:14.198682+0000 mon.a (mon.0) 3472 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:14.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:14 gibba013 bash[30381]: cluster 2021-03-10T16:55:12.404959+0000 mgr.gibba020.yqfnwy (mgr.34427) 9601 : cluster [DBG] pgmap v5474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:14.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:14 gibba013 bash[30381]: audit 2021-03-10T16:55:13.966137+0000 mon.a (mon.0) 3465 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:55:14.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:14 gibba013 bash[30381]: audit 2021-03-10T16:55:14.188282+0000 mon.a (mon.0) 3466 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:55:14.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:14 gibba013 bash[30381]: audit 2021-03-10T16:55:14.191734+0000 mon.a (mon.0) 3467 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:55:14.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:14 gibba013 bash[30381]: audit 2021-03-10T16:55:14.192962+0000 mon.a (mon.0) 3468 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:14.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:14 gibba013 bash[30381]: audit 2021-03-10T16:55:14.194026+0000 mon.a (mon.0) 3469 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:14.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:14 gibba013 bash[30381]: audit 2021-03-10T16:55:14.195051+0000 mon.a (mon.0) 3470 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:14.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:14 gibba013 bash[30381]: audit 2021-03-10T16:55:14.197167+0000 mon.a (mon.0) 3471 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:14.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:14 gibba013 bash[30381]: audit 2021-03-10T16:55:14.198682+0000 mon.a (mon.0) 3472 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:14.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:14 gibba020 bash[25448]: cluster 2021-03-10T16:55:12.404959+0000 mgr.gibba020.yqfnwy (mgr.34427) 9601 : cluster [DBG] pgmap v5474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:14.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:14 gibba020 bash[25448]: audit 2021-03-10T16:55:13.966137+0000 mon.a (mon.0) 3465 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:55:14.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:14 gibba020 bash[25448]: audit 2021-03-10T16:55:14.188282+0000 mon.a (mon.0) 3466 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:55:14.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:14 gibba020 bash[25448]: audit 2021-03-10T16:55:14.191734+0000 mon.a (mon.0) 3467 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:55:14.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:14 gibba020 bash[25448]: audit 2021-03-10T16:55:14.192962+0000 mon.a (mon.0) 3468 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:14.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:14 gibba020 bash[25448]: audit 2021-03-10T16:55:14.194026+0000 mon.a (mon.0) 3469 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:14.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:14 gibba020 bash[25448]: audit 2021-03-10T16:55:14.195051+0000 mon.a (mon.0) 3470 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:14.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:14 gibba020 bash[25448]: audit 2021-03-10T16:55:14.197167+0000 mon.a (mon.0) 3471 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:14.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:14 gibba020 bash[25448]: audit 2021-03-10T16:55:14.198682+0000 mon.a (mon.0) 3472 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:15.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:15 gibba013 bash[29418]: cephadm 2021-03-10T16:55:13.970456+0000 mgr.gibba020.yqfnwy (mgr.34427) 9602 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:55:15.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:15 gibba013 bash[29418]: cephadm 2021-03-10T16:55:13.972433+0000 mgr.gibba020.yqfnwy (mgr.34427) 9603 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:55:15.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:15 gibba013 bash[29418]: cephadm 2021-03-10T16:55:14.190386+0000 mgr.gibba020.yqfnwy (mgr.34427) 9604 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:55:15.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:15 gibba013 bash[29418]: cephadm 2021-03-10T16:55:14.192064+0000 mgr.gibba020.yqfnwy (mgr.34427) 9605 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:55:15.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:15 gibba013 bash[29418]: cephadm 2021-03-10T16:55:14.193104+0000 mgr.gibba020.yqfnwy (mgr.34427) 9606 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:55:15.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:15 gibba013 bash[29418]: cephadm 2021-03-10T16:55:14.193139+0000 mgr.gibba020.yqfnwy (mgr.34427) 9607 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:55:15.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:15 gibba013 bash[29418]: cephadm 2021-03-10T16:55:14.194143+0000 mgr.gibba020.yqfnwy (mgr.34427) 9608 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:55:15.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:15 gibba013 bash[29418]: cephadm 2021-03-10T16:55:14.194176+0000 mgr.gibba020.yqfnwy (mgr.34427) 9609 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:55:15.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:15 gibba013 bash[29418]: cephadm 2021-03-10T16:55:14.195185+0000 mgr.gibba020.yqfnwy (mgr.34427) 9610 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:55:15.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:15 gibba013 bash[29418]: cephadm 2021-03-10T16:55:14.196124+0000 mgr.gibba020.yqfnwy (mgr.34427) 9611 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:55:15.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:15 gibba013 bash[29418]: cephadm 2021-03-10T16:55:14.196158+0000 mgr.gibba020.yqfnwy (mgr.34427) 9612 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:55:15.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:15 gibba013 bash[29418]: cephadm 2021-03-10T16:55:14.197335+0000 mgr.gibba020.yqfnwy (mgr.34427) 9613 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:55:15.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:15 gibba013 bash[29418]: cephadm 2021-03-10T16:55:14.197646+0000 mgr.gibba020.yqfnwy (mgr.34427) 9614 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:55:15.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:15 gibba013 bash[29418]: cephadm 2021-03-10T16:55:14.199058+0000 mgr.gibba020.yqfnwy (mgr.34427) 9615 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:55:15.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:15 gibba013 bash[29418]: cephadm 2021-03-10T16:55:14.199091+0000 mgr.gibba020.yqfnwy (mgr.34427) 9616 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:55:15.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:15 gibba013 bash[29418]: cephadm 2021-03-10T16:55:14.199213+0000 mgr.gibba020.yqfnwy (mgr.34427) 9617 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:55:15.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:15 gibba013 bash[30381]: cephadm 2021-03-10T16:55:13.970456+0000 mgr.gibba020.yqfnwy (mgr.34427) 9602 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:55:15.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:15 gibba013 bash[30381]: cephadm 2021-03-10T16:55:13.972433+0000 mgr.gibba020.yqfnwy (mgr.34427) 9603 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:55:15.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:15 gibba013 bash[30381]: cephadm 2021-03-10T16:55:14.190386+0000 mgr.gibba020.yqfnwy (mgr.34427) 9604 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:55:15.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:15 gibba013 bash[30381]: cephadm 2021-03-10T16:55:14.192064+0000 mgr.gibba020.yqfnwy (mgr.34427) 9605 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:55:15.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:15 gibba013 bash[30381]: cephadm 2021-03-10T16:55:14.193104+0000 mgr.gibba020.yqfnwy (mgr.34427) 9606 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:55:15.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:15 gibba013 bash[30381]: cephadm 2021-03-10T16:55:14.193139+0000 mgr.gibba020.yqfnwy (mgr.34427) 9607 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:55:15.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:15 gibba013 bash[30381]: cephadm 2021-03-10T16:55:14.194143+0000 mgr.gibba020.yqfnwy (mgr.34427) 9608 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:55:15.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:15 gibba013 bash[30381]: cephadm 2021-03-10T16:55:14.194176+0000 mgr.gibba020.yqfnwy (mgr.34427) 9609 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:55:15.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:15 gibba013 bash[30381]: cephadm 2021-03-10T16:55:14.195185+0000 mgr.gibba020.yqfnwy (mgr.34427) 9610 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:55:15.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:15 gibba013 bash[30381]: cephadm 2021-03-10T16:55:14.196124+0000 mgr.gibba020.yqfnwy (mgr.34427) 9611 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:55:15.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:15 gibba013 bash[30381]: cephadm 2021-03-10T16:55:14.196158+0000 mgr.gibba020.yqfnwy (mgr.34427) 9612 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:55:15.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:15 gibba013 bash[30381]: cephadm 2021-03-10T16:55:14.197335+0000 mgr.gibba020.yqfnwy (mgr.34427) 9613 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:55:15.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:15 gibba013 bash[30381]: cephadm 2021-03-10T16:55:14.197646+0000 mgr.gibba020.yqfnwy (mgr.34427) 9614 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:55:15.647 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:15 gibba013 bash[30381]: cephadm 2021-03-10T16:55:14.199058+0000 mgr.gibba020.yqfnwy (mgr.34427) 9615 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:55:15.647 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:15 gibba013 bash[30381]: cephadm 2021-03-10T16:55:14.199091+0000 mgr.gibba020.yqfnwy (mgr.34427) 9616 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:55:15.648 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:15 gibba013 bash[30381]: cephadm 2021-03-10T16:55:14.199213+0000 mgr.gibba020.yqfnwy (mgr.34427) 9617 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:55:15.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:15 gibba020 bash[25448]: cephadm 2021-03-10T16:55:13.970456+0000 mgr.gibba020.yqfnwy (mgr.34427) 9602 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:55:15.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:15 gibba020 bash[25448]: cephadm 2021-03-10T16:55:13.972433+0000 mgr.gibba020.yqfnwy (mgr.34427) 9603 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:55:15.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:15 gibba020 bash[25448]: cephadm 2021-03-10T16:55:14.190386+0000 mgr.gibba020.yqfnwy (mgr.34427) 9604 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:55:15.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:15 gibba020 bash[25448]: cephadm 2021-03-10T16:55:14.192064+0000 mgr.gibba020.yqfnwy (mgr.34427) 9605 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:55:15.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:15 gibba020 bash[25448]: cephadm 2021-03-10T16:55:14.193104+0000 mgr.gibba020.yqfnwy (mgr.34427) 9606 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:55:15.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:15 gibba020 bash[25448]: cephadm 2021-03-10T16:55:14.193139+0000 mgr.gibba020.yqfnwy (mgr.34427) 9607 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:55:15.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:15 gibba020 bash[25448]: cephadm 2021-03-10T16:55:14.194143+0000 mgr.gibba020.yqfnwy (mgr.34427) 9608 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:55:15.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:15 gibba020 bash[25448]: cephadm 2021-03-10T16:55:14.194176+0000 mgr.gibba020.yqfnwy (mgr.34427) 9609 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:55:15.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:15 gibba020 bash[25448]: cephadm 2021-03-10T16:55:14.195185+0000 mgr.gibba020.yqfnwy (mgr.34427) 9610 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:55:15.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:15 gibba020 bash[25448]: cephadm 2021-03-10T16:55:14.196124+0000 mgr.gibba020.yqfnwy (mgr.34427) 9611 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:55:15.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:15 gibba020 bash[25448]: cephadm 2021-03-10T16:55:14.196158+0000 mgr.gibba020.yqfnwy (mgr.34427) 9612 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:55:15.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:15 gibba020 bash[25448]: cephadm 2021-03-10T16:55:14.197335+0000 mgr.gibba020.yqfnwy (mgr.34427) 9613 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:55:15.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:15 gibba020 bash[25448]: cephadm 2021-03-10T16:55:14.197646+0000 mgr.gibba020.yqfnwy (mgr.34427) 9614 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:55:15.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:15 gibba020 bash[25448]: cephadm 2021-03-10T16:55:14.199058+0000 mgr.gibba020.yqfnwy (mgr.34427) 9615 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:55:15.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:15 gibba020 bash[25448]: cephadm 2021-03-10T16:55:14.199091+0000 mgr.gibba020.yqfnwy (mgr.34427) 9616 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:55:15.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:15 gibba020 bash[25448]: cephadm 2021-03-10T16:55:14.199213+0000 mgr.gibba020.yqfnwy (mgr.34427) 9617 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:55:16.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:16 gibba013 bash[30381]: cluster 2021-03-10T16:55:14.406245+0000 mgr.gibba020.yqfnwy (mgr.34427) 9618 : cluster [DBG] pgmap v5475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:16.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:16 gibba013 bash[29418]: cluster 2021-03-10T16:55:14.406245+0000 mgr.gibba020.yqfnwy (mgr.34427) 9618 : cluster [DBG] pgmap v5475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:16.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:16 gibba020 bash[25448]: cluster 2021-03-10T16:55:14.406245+0000 mgr.gibba020.yqfnwy (mgr.34427) 9618 : cluster [DBG] pgmap v5475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:18.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:18 gibba013 bash[29418]: cluster 2021-03-10T16:55:16.408230+0000 mgr.gibba020.yqfnwy (mgr.34427) 9619 : cluster [DBG] pgmap v5476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:18.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:18 gibba013 bash[30381]: cluster 2021-03-10T16:55:16.408230+0000 mgr.gibba020.yqfnwy (mgr.34427) 9619 : cluster [DBG] pgmap v5476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:18.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:18 gibba020 bash[25448]: cluster 2021-03-10T16:55:16.408230+0000 mgr.gibba020.yqfnwy (mgr.34427) 9619 : cluster [DBG] pgmap v5476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:19.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:19 gibba013 bash[29418]: cluster 2021-03-10T16:55:18.409905+0000 mgr.gibba020.yqfnwy (mgr.34427) 9620 : cluster [DBG] pgmap v5477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:19.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:19 gibba013 bash[30381]: cluster 2021-03-10T16:55:18.409905+0000 mgr.gibba020.yqfnwy (mgr.34427) 9620 : cluster [DBG] pgmap v5477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:19.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:19 gibba020 bash[25448]: cluster 2021-03-10T16:55:18.409905+0000 mgr.gibba020.yqfnwy (mgr.34427) 9620 : cluster [DBG] pgmap v5477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:22.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:22 gibba013 bash[29418]: cluster 2021-03-10T16:55:20.411655+0000 mgr.gibba020.yqfnwy (mgr.34427) 9621 : cluster [DBG] pgmap v5478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:22.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:22 gibba013 bash[30381]: cluster 2021-03-10T16:55:20.411655+0000 mgr.gibba020.yqfnwy (mgr.34427) 9621 : cluster [DBG] pgmap v5478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:22.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:22 gibba020 bash[25448]: cluster 2021-03-10T16:55:20.411655+0000 mgr.gibba020.yqfnwy (mgr.34427) 9621 : cluster [DBG] pgmap v5478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:24.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:24 gibba013 bash[29418]: cluster 2021-03-10T16:55:22.413160+0000 mgr.gibba020.yqfnwy (mgr.34427) 9622 : cluster [DBG] pgmap v5479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:24.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:24 gibba013 bash[30381]: cluster 2021-03-10T16:55:22.413160+0000 mgr.gibba020.yqfnwy (mgr.34427) 9622 : cluster [DBG] pgmap v5479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:24.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:24 gibba020 bash[25448]: cluster 2021-03-10T16:55:22.413160+0000 mgr.gibba020.yqfnwy (mgr.34427) 9622 : cluster [DBG] pgmap v5479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:26.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:26 gibba013 bash[29418]: cluster 2021-03-10T16:55:24.414661+0000 mgr.gibba020.yqfnwy (mgr.34427) 9623 : cluster [DBG] pgmap v5480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:26.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:26 gibba013 bash[30381]: cluster 2021-03-10T16:55:24.414661+0000 mgr.gibba020.yqfnwy (mgr.34427) 9623 : cluster [DBG] pgmap v5480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:26.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:26 gibba020 bash[25448]: cluster 2021-03-10T16:55:24.414661+0000 mgr.gibba020.yqfnwy (mgr.34427) 9623 : cluster [DBG] pgmap v5480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:28.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:28 gibba013 bash[29418]: cluster 2021-03-10T16:55:26.416299+0000 mgr.gibba020.yqfnwy (mgr.34427) 9624 : cluster [DBG] pgmap v5481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:28.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:28 gibba013 bash[30381]: cluster 2021-03-10T16:55:26.416299+0000 mgr.gibba020.yqfnwy (mgr.34427) 9624 : cluster [DBG] pgmap v5481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:28.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:28 gibba020 bash[25448]: cluster 2021-03-10T16:55:26.416299+0000 mgr.gibba020.yqfnwy (mgr.34427) 9624 : cluster [DBG] pgmap v5481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:30.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:30 gibba013 bash[29418]: cluster 2021-03-10T16:55:28.417713+0000 mgr.gibba020.yqfnwy (mgr.34427) 9625 : cluster [DBG] pgmap v5482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:30.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:30 gibba013 bash[29418]: cephadm 2021-03-10T16:55:29.215112+0000 mgr.gibba020.yqfnwy (mgr.34427) 9626 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:55:30.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:30 gibba013 bash[30381]: cluster 2021-03-10T16:55:28.417713+0000 mgr.gibba020.yqfnwy (mgr.34427) 9625 : cluster [DBG] pgmap v5482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:30.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:30 gibba013 bash[30381]: cephadm 2021-03-10T16:55:29.215112+0000 mgr.gibba020.yqfnwy (mgr.34427) 9626 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:55:30.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:30 gibba020 bash[25448]: cluster 2021-03-10T16:55:28.417713+0000 mgr.gibba020.yqfnwy (mgr.34427) 9625 : cluster [DBG] pgmap v5482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:30.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:30 gibba020 bash[25448]: cephadm 2021-03-10T16:55:29.215112+0000 mgr.gibba020.yqfnwy (mgr.34427) 9626 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:55:32.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:32 gibba013 bash[29418]: cluster 2021-03-10T16:55:30.419469+0000 mgr.gibba020.yqfnwy (mgr.34427) 9627 : cluster [DBG] pgmap v5483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:32.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:32 gibba013 bash[30381]: cluster 2021-03-10T16:55:30.419469+0000 mgr.gibba020.yqfnwy (mgr.34427) 9627 : cluster [DBG] pgmap v5483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:32.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:32 gibba020 bash[25448]: cluster 2021-03-10T16:55:30.419469+0000 mgr.gibba020.yqfnwy (mgr.34427) 9627 : cluster [DBG] pgmap v5483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:34.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:34 gibba013 bash[29418]: cluster 2021-03-10T16:55:32.420956+0000 mgr.gibba020.yqfnwy (mgr.34427) 9628 : cluster [DBG] pgmap v5484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:34.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:34 gibba013 bash[30381]: cluster 2021-03-10T16:55:32.420956+0000 mgr.gibba020.yqfnwy (mgr.34427) 9628 : cluster [DBG] pgmap v5484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:34.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:34 gibba020 bash[25448]: cluster 2021-03-10T16:55:32.420956+0000 mgr.gibba020.yqfnwy (mgr.34427) 9628 : cluster [DBG] pgmap v5484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:36.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:36 gibba013 bash[29418]: cluster 2021-03-10T16:55:34.422465+0000 mgr.gibba020.yqfnwy (mgr.34427) 9629 : cluster [DBG] pgmap v5485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:36.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:36 gibba013 bash[30381]: cluster 2021-03-10T16:55:34.422465+0000 mgr.gibba020.yqfnwy (mgr.34427) 9629 : cluster [DBG] pgmap v5485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:36.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:36 gibba020 bash[25448]: cluster 2021-03-10T16:55:34.422465+0000 mgr.gibba020.yqfnwy (mgr.34427) 9629 : cluster [DBG] pgmap v5485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:38.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:38 gibba020 bash[25448]: cluster 2021-03-10T16:55:36.424317+0000 mgr.gibba020.yqfnwy (mgr.34427) 9630 : cluster [DBG] pgmap v5486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:38.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:38 gibba013 bash[29418]: cluster 2021-03-10T16:55:36.424317+0000 mgr.gibba020.yqfnwy (mgr.34427) 9630 : cluster [DBG] pgmap v5486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:38.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:38 gibba013 bash[30381]: cluster 2021-03-10T16:55:36.424317+0000 mgr.gibba020.yqfnwy (mgr.34427) 9630 : cluster [DBG] pgmap v5486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:40.397 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:55:40.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:40 gibba020 bash[25448]: cluster 2021-03-10T16:55:38.425704+0000 mgr.gibba020.yqfnwy (mgr.34427) 9631 : cluster [DBG] pgmap v5487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:40.627 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:55:40.627 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 4m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:55:40.627 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 3m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:55:40.627 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:55:40.628 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:55:40.628 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:55:40.628 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:55:40.628 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:55:40.629 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:55:40.629 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:55:40.629 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:55:40.629 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:55:40.629 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:55:40.630 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:55:40.630 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:55:40.630 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:55:40.630 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:55:40.631 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:55:40.631 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:55:40.631 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 3m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:55:40.631 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 3m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:55:40.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:40 gibba013 bash[29418]: cluster 2021-03-10T16:55:38.425704+0000 mgr.gibba020.yqfnwy (mgr.34427) 9631 : cluster [DBG] pgmap v5487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:40.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:40 gibba013 bash[30381]: cluster 2021-03-10T16:55:38.425704+0000 mgr.gibba020.yqfnwy (mgr.34427) 9631 : cluster [DBG] pgmap v5487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:40.874 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:55:40.875 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:55:40.875 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:55:40.875 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:55:40.875 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:55:40.876 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:55:40.876 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:55:40.876 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:55:40.876 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:55:40.876 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:55:40.877 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:55:40.877 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:55:40.877 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:55:40.877 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:55:40.877 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:55:41.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:41 gibba020 bash[25448]: audit 2021-03-10T16:55:40.875197+0000 mon.c (mon.1) 147 : audit [DBG] from='client.? 172.21.2.113:0/3462092483' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:41.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:41 gibba013 bash[29418]: audit 2021-03-10T16:55:40.875197+0000 mon.c (mon.1) 147 : audit [DBG] from='client.? 172.21.2.113:0/3462092483' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:41.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:41 gibba013 bash[30381]: audit 2021-03-10T16:55:40.875197+0000 mon.c (mon.1) 147 : audit [DBG] from='client.? 172.21.2.113:0/3462092483' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:55:42.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:42 gibba020 bash[25448]: audit 2021-03-10T16:55:40.388335+0000 mgr.gibba020.yqfnwy (mgr.34427) 9632 : audit [DBG] from='client.50514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:55:42.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:42 gibba020 bash[25448]: cluster 2021-03-10T16:55:40.427355+0000 mgr.gibba020.yqfnwy (mgr.34427) 9633 : cluster [DBG] pgmap v5488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:42.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:42 gibba020 bash[25448]: audit 2021-03-10T16:55:40.611324+0000 mgr.gibba020.yqfnwy (mgr.34427) 9634 : audit [DBG] from='client.60499 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:55:42.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:42 gibba013 bash[29418]: audit 2021-03-10T16:55:40.388335+0000 mgr.gibba020.yqfnwy (mgr.34427) 9632 : audit [DBG] from='client.50514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:55:42.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:42 gibba013 bash[29418]: cluster 2021-03-10T16:55:40.427355+0000 mgr.gibba020.yqfnwy (mgr.34427) 9633 : cluster [DBG] pgmap v5488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:42.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:42 gibba013 bash[29418]: audit 2021-03-10T16:55:40.611324+0000 mgr.gibba020.yqfnwy (mgr.34427) 9634 : audit [DBG] from='client.60499 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:55:42.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:42 gibba013 bash[30381]: audit 2021-03-10T16:55:40.388335+0000 mgr.gibba020.yqfnwy (mgr.34427) 9632 : audit [DBG] from='client.50514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:55:42.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:42 gibba013 bash[30381]: cluster 2021-03-10T16:55:40.427355+0000 mgr.gibba020.yqfnwy (mgr.34427) 9633 : cluster [DBG] pgmap v5488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:42.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:42 gibba013 bash[30381]: audit 2021-03-10T16:55:40.611324+0000 mgr.gibba020.yqfnwy (mgr.34427) 9634 : audit [DBG] from='client.60499 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:55:44.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:44 gibba020 bash[25448]: cluster 2021-03-10T16:55:42.428691+0000 mgr.gibba020.yqfnwy (mgr.34427) 9635 : cluster [DBG] pgmap v5489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:44.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:44 gibba013 bash[29418]: cluster 2021-03-10T16:55:42.428691+0000 mgr.gibba020.yqfnwy (mgr.34427) 9635 : cluster [DBG] pgmap v5489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:44.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:44 gibba013 bash[30381]: cluster 2021-03-10T16:55:42.428691+0000 mgr.gibba020.yqfnwy (mgr.34427) 9635 : cluster [DBG] pgmap v5489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:45.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:45 gibba020 bash[25448]: cephadm 2021-03-10T16:55:44.231133+0000 mgr.gibba020.yqfnwy (mgr.34427) 9636 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:55:45.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:45 gibba013 bash[29418]: cephadm 2021-03-10T16:55:44.231133+0000 mgr.gibba020.yqfnwy (mgr.34427) 9636 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:55:45.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:45 gibba013 bash[30381]: cephadm 2021-03-10T16:55:44.231133+0000 mgr.gibba020.yqfnwy (mgr.34427) 9636 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:55:46.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:46 gibba020 bash[25448]: cluster 2021-03-10T16:55:44.430135+0000 mgr.gibba020.yqfnwy (mgr.34427) 9637 : cluster [DBG] pgmap v5490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:46.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:46 gibba013 bash[30381]: cluster 2021-03-10T16:55:44.430135+0000 mgr.gibba020.yqfnwy (mgr.34427) 9637 : cluster [DBG] pgmap v5490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:46.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:46 gibba013 bash[29418]: cluster 2021-03-10T16:55:44.430135+0000 mgr.gibba020.yqfnwy (mgr.34427) 9637 : cluster [DBG] pgmap v5490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:48.446 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:48 gibba020 bash[25448]: cluster 2021-03-10T16:55:46.432029+0000 mgr.gibba020.yqfnwy (mgr.34427) 9638 : cluster [DBG] pgmap v5491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:48.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:48 gibba013 bash[29418]: cluster 2021-03-10T16:55:46.432029+0000 mgr.gibba020.yqfnwy (mgr.34427) 9638 : cluster [DBG] pgmap v5491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:48.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:48 gibba013 bash[30381]: cluster 2021-03-10T16:55:46.432029+0000 mgr.gibba020.yqfnwy (mgr.34427) 9638 : cluster [DBG] pgmap v5491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:50.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:50 gibba013 bash[29418]: cluster 2021-03-10T16:55:48.433454+0000 mgr.gibba020.yqfnwy (mgr.34427) 9639 : cluster [DBG] pgmap v5492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:50.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:50 gibba013 bash[30381]: cluster 2021-03-10T16:55:48.433454+0000 mgr.gibba020.yqfnwy (mgr.34427) 9639 : cluster [DBG] pgmap v5492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:50.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:50 gibba020 bash[25448]: cluster 2021-03-10T16:55:48.433454+0000 mgr.gibba020.yqfnwy (mgr.34427) 9639 : cluster [DBG] pgmap v5492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:52.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:52 gibba013 bash[29418]: cluster 2021-03-10T16:55:50.435135+0000 mgr.gibba020.yqfnwy (mgr.34427) 9640 : cluster [DBG] pgmap v5493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:52.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:52 gibba013 bash[30381]: cluster 2021-03-10T16:55:50.435135+0000 mgr.gibba020.yqfnwy (mgr.34427) 9640 : cluster [DBG] pgmap v5493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:52.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:52 gibba020 bash[25448]: cluster 2021-03-10T16:55:50.435135+0000 mgr.gibba020.yqfnwy (mgr.34427) 9640 : cluster [DBG] pgmap v5493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:54.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:54 gibba013 bash[29418]: cluster 2021-03-10T16:55:52.436617+0000 mgr.gibba020.yqfnwy (mgr.34427) 9641 : cluster [DBG] pgmap v5494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:54.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:54 gibba013 bash[30381]: cluster 2021-03-10T16:55:52.436617+0000 mgr.gibba020.yqfnwy (mgr.34427) 9641 : cluster [DBG] pgmap v5494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:54.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:54 gibba020 bash[25448]: cluster 2021-03-10T16:55:52.436617+0000 mgr.gibba020.yqfnwy (mgr.34427) 9641 : cluster [DBG] pgmap v5494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:56.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:56 gibba013 bash[29418]: cluster 2021-03-10T16:55:54.438123+0000 mgr.gibba020.yqfnwy (mgr.34427) 9642 : cluster [DBG] pgmap v5495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:56.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:56 gibba013 bash[30381]: cluster 2021-03-10T16:55:54.438123+0000 mgr.gibba020.yqfnwy (mgr.34427) 9642 : cluster [DBG] pgmap v5495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:56.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:56 gibba020 bash[25448]: cluster 2021-03-10T16:55:54.438123+0000 mgr.gibba020.yqfnwy (mgr.34427) 9642 : cluster [DBG] pgmap v5495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:58.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:55:58 gibba013 bash[29418]: cluster 2021-03-10T16:55:56.440087+0000 mgr.gibba020.yqfnwy (mgr.34427) 9643 : cluster [DBG] pgmap v5496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:58.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:55:58 gibba013 bash[30381]: cluster 2021-03-10T16:55:56.440087+0000 mgr.gibba020.yqfnwy (mgr.34427) 9643 : cluster [DBG] pgmap v5496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:55:58.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:55:58 gibba020 bash[25448]: cluster 2021-03-10T16:55:56.440087+0000 mgr.gibba020.yqfnwy (mgr.34427) 9643 : cluster [DBG] pgmap v5496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:00.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:00 gibba013 bash[29418]: cluster 2021-03-10T16:55:58.441475+0000 mgr.gibba020.yqfnwy (mgr.34427) 9644 : cluster [DBG] pgmap v5497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:00.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:00 gibba013 bash[29418]: cephadm 2021-03-10T16:55:59.244468+0000 mgr.gibba020.yqfnwy (mgr.34427) 9645 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:56:00.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:00 gibba013 bash[30381]: cluster 2021-03-10T16:55:58.441475+0000 mgr.gibba020.yqfnwy (mgr.34427) 9644 : cluster [DBG] pgmap v5497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:00.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:00 gibba013 bash[30381]: cephadm 2021-03-10T16:55:59.244468+0000 mgr.gibba020.yqfnwy (mgr.34427) 9645 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:56:00.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:00 gibba020 bash[25448]: cluster 2021-03-10T16:55:58.441475+0000 mgr.gibba020.yqfnwy (mgr.34427) 9644 : cluster [DBG] pgmap v5497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:00.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:00 gibba020 bash[25448]: cephadm 2021-03-10T16:55:59.244468+0000 mgr.gibba020.yqfnwy (mgr.34427) 9645 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:56:02.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:02 gibba013 bash[29418]: cluster 2021-03-10T16:56:00.443133+0000 mgr.gibba020.yqfnwy (mgr.34427) 9646 : cluster [DBG] pgmap v5498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:02.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:02 gibba013 bash[30381]: cluster 2021-03-10T16:56:00.443133+0000 mgr.gibba020.yqfnwy (mgr.34427) 9646 : cluster [DBG] pgmap v5498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:02.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:02 gibba020 bash[25448]: cluster 2021-03-10T16:56:00.443133+0000 mgr.gibba020.yqfnwy (mgr.34427) 9646 : cluster [DBG] pgmap v5498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:04.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:04 gibba013 bash[29418]: cluster 2021-03-10T16:56:02.444738+0000 mgr.gibba020.yqfnwy (mgr.34427) 9647 : cluster [DBG] pgmap v5499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:04.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:04 gibba013 bash[30381]: cluster 2021-03-10T16:56:02.444738+0000 mgr.gibba020.yqfnwy (mgr.34427) 9647 : cluster [DBG] pgmap v5499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:04.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:04 gibba020 bash[25448]: cluster 2021-03-10T16:56:02.444738+0000 mgr.gibba020.yqfnwy (mgr.34427) 9647 : cluster [DBG] pgmap v5499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:06.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:06 gibba013 bash[29418]: cluster 2021-03-10T16:56:04.446187+0000 mgr.gibba020.yqfnwy (mgr.34427) 9648 : cluster [DBG] pgmap v5500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:06.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:06 gibba013 bash[30381]: cluster 2021-03-10T16:56:04.446187+0000 mgr.gibba020.yqfnwy (mgr.34427) 9648 : cluster [DBG] pgmap v5500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:06.696 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:06 gibba020 bash[25448]: cluster 2021-03-10T16:56:04.446187+0000 mgr.gibba020.yqfnwy (mgr.34427) 9648 : cluster [DBG] pgmap v5500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:07 gibba013 bash[29418]: audit 2021-03-10T16:56:06.840312+0000 mon.a (mon.0) 3473 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:56:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:07 gibba013 bash[29418]: audit 2021-03-10T16:56:07.027855+0000 mon.a (mon.0) 3474 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:56:07.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:07 gibba013 bash[30381]: audit 2021-03-10T16:56:06.840312+0000 mon.a (mon.0) 3473 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:56:07.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:07 gibba013 bash[30381]: audit 2021-03-10T16:56:07.027855+0000 mon.a (mon.0) 3474 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:56:07.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:07 gibba020 bash[25448]: audit 2021-03-10T16:56:06.840312+0000 mon.a (mon.0) 3473 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:56:07.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:07 gibba020 bash[25448]: audit 2021-03-10T16:56:07.027855+0000 mon.a (mon.0) 3474 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:56:08.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:08 gibba013 bash[29418]: cluster 2021-03-10T16:56:06.448181+0000 mgr.gibba020.yqfnwy (mgr.34427) 9649 : cluster [DBG] pgmap v5501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:08.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:08 gibba013 bash[29418]: audit 2021-03-10T16:56:07.413594+0000 mon.a (mon.0) 3475 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:56:08.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:08 gibba013 bash[29418]: audit 2021-03-10T16:56:07.414394+0000 mon.a (mon.0) 3476 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:56:08.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:08 gibba013 bash[29418]: audit 2021-03-10T16:56:07.415115+0000 mon.a (mon.0) 3477 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:56:08.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:08 gibba013 bash[29418]: audit 2021-03-10T16:56:07.415782+0000 mon.a (mon.0) 3478 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:56:08.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:08 gibba013 bash[30381]: cluster 2021-03-10T16:56:06.448181+0000 mgr.gibba020.yqfnwy (mgr.34427) 9649 : cluster [DBG] pgmap v5501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:08.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:08 gibba013 bash[30381]: audit 2021-03-10T16:56:07.413594+0000 mon.a (mon.0) 3475 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:56:08.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:08 gibba013 bash[30381]: audit 2021-03-10T16:56:07.414394+0000 mon.a (mon.0) 3476 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:56:08.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:08 gibba013 bash[30381]: audit 2021-03-10T16:56:07.415115+0000 mon.a (mon.0) 3477 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:56:08.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:08 gibba013 bash[30381]: audit 2021-03-10T16:56:07.415782+0000 mon.a (mon.0) 3478 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:56:08.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:08 gibba020 bash[25448]: cluster 2021-03-10T16:56:06.448181+0000 mgr.gibba020.yqfnwy (mgr.34427) 9649 : cluster [DBG] pgmap v5501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:08.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:08 gibba020 bash[25448]: audit 2021-03-10T16:56:07.413594+0000 mon.a (mon.0) 3475 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T16:56:08.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:08 gibba020 bash[25448]: audit 2021-03-10T16:56:07.414394+0000 mon.a (mon.0) 3476 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:56:08.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:08 gibba020 bash[25448]: audit 2021-03-10T16:56:07.415115+0000 mon.a (mon.0) 3477 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T16:56:08.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:08 gibba020 bash[25448]: audit 2021-03-10T16:56:07.415782+0000 mon.a (mon.0) 3478 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:56:10.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:10 gibba013 bash[29418]: cluster 2021-03-10T16:56:08.449529+0000 mgr.gibba020.yqfnwy (mgr.34427) 9650 : cluster [DBG] pgmap v5502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:10.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:10 gibba013 bash[30381]: cluster 2021-03-10T16:56:08.449529+0000 mgr.gibba020.yqfnwy (mgr.34427) 9650 : cluster [DBG] pgmap v5502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:10.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:10 gibba020 bash[25448]: cluster 2021-03-10T16:56:08.449529+0000 mgr.gibba020.yqfnwy (mgr.34427) 9650 : cluster [DBG] pgmap v5502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:11.116 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:56:11.345 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:56:11.345 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 5m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:56:11.345 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 4m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:56:11.346 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:56:11.346 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:56:11.346 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:56:11.346 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:56:11.347 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:56:11.347 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:56:11.347 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:56:11.347 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:56:11.348 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:56:11.348 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:56:11.348 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:56:11.348 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:56:11.348 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:56:11.349 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:56:11.349 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:56:11.349 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:56:11.349 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 4m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:56:11.349 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 4m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:56:11.595 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:56:11.595 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:56:11.596 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:56:11.596 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:56:11.596 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:56:11.596 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:56:11.597 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:56:11.597 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:56:11.597 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:56:11.597 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:56:11.597 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:56:11.598 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:56:11.598 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:56:11.598 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:56:11.598 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:56:12.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:12 gibba013 bash[29418]: cluster 2021-03-10T16:56:10.450991+0000 mgr.gibba020.yqfnwy (mgr.34427) 9651 : cluster [DBG] pgmap v5503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:12.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:12 gibba013 bash[29418]: audit 2021-03-10T16:56:11.107861+0000 mgr.gibba020.yqfnwy (mgr.34427) 9652 : audit [DBG] from='client.50532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:56:12.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:12 gibba013 bash[29418]: audit 2021-03-10T16:56:11.595635+0000 mon.a (mon.0) 3479 : audit [DBG] from='client.? 172.21.2.113:0/327998956' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:12.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:12 gibba013 bash[30381]: cluster 2021-03-10T16:56:10.450991+0000 mgr.gibba020.yqfnwy (mgr.34427) 9651 : cluster [DBG] pgmap v5503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:12.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:12 gibba013 bash[30381]: audit 2021-03-10T16:56:11.107861+0000 mgr.gibba020.yqfnwy (mgr.34427) 9652 : audit [DBG] from='client.50532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:56:12.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:12 gibba013 bash[30381]: audit 2021-03-10T16:56:11.595635+0000 mon.a (mon.0) 3479 : audit [DBG] from='client.? 172.21.2.113:0/327998956' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:12.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:12 gibba020 bash[25448]: cluster 2021-03-10T16:56:10.450991+0000 mgr.gibba020.yqfnwy (mgr.34427) 9651 : cluster [DBG] pgmap v5503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:12.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:12 gibba020 bash[25448]: audit 2021-03-10T16:56:11.107861+0000 mgr.gibba020.yqfnwy (mgr.34427) 9652 : audit [DBG] from='client.50532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:56:12.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:12 gibba020 bash[25448]: audit 2021-03-10T16:56:11.595635+0000 mon.a (mon.0) 3479 : audit [DBG] from='client.? 172.21.2.113:0/327998956' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:13.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:13 gibba013 bash[29418]: audit 2021-03-10T16:56:11.332768+0000 mgr.gibba020.yqfnwy (mgr.34427) 9653 : audit [DBG] from='client.60517 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:56:13.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:13 gibba013 bash[30381]: audit 2021-03-10T16:56:11.332768+0000 mgr.gibba020.yqfnwy (mgr.34427) 9653 : audit [DBG] from='client.60517 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:56:13.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:13 gibba020 bash[25448]: audit 2021-03-10T16:56:11.332768+0000 mgr.gibba020.yqfnwy (mgr.34427) 9653 : audit [DBG] from='client.60517 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:56:14.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:14 gibba013 bash[29418]: cluster 2021-03-10T16:56:12.452440+0000 mgr.gibba020.yqfnwy (mgr.34427) 9654 : cluster [DBG] pgmap v5504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:14.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:14 gibba013 bash[29418]: audit 2021-03-10T16:56:14.262086+0000 mon.a (mon.0) 3480 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:56:14.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:14 gibba013 bash[30381]: cluster 2021-03-10T16:56:12.452440+0000 mgr.gibba020.yqfnwy (mgr.34427) 9654 : cluster [DBG] pgmap v5504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:14.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:14 gibba013 bash[30381]: audit 2021-03-10T16:56:14.262086+0000 mon.a (mon.0) 3480 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:56:14.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:14 gibba020 bash[25448]: cluster 2021-03-10T16:56:12.452440+0000 mgr.gibba020.yqfnwy (mgr.34427) 9654 : cluster [DBG] pgmap v5504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:14.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:14 gibba020 bash[25448]: audit 2021-03-10T16:56:14.262086+0000 mon.a (mon.0) 3480 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:56:15.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:15 gibba013 bash[29418]: cephadm 2021-03-10T16:56:14.266994+0000 mgr.gibba020.yqfnwy (mgr.34427) 9655 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:56:15.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:15 gibba013 bash[29418]: cephadm 2021-03-10T16:56:14.268765+0000 mgr.gibba020.yqfnwy (mgr.34427) 9656 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:56:15.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:15 gibba013 bash[29418]: audit 2021-03-10T16:56:14.506252+0000 mon.a (mon.0) 3481 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:56:15.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:15 gibba013 bash[29418]: audit 2021-03-10T16:56:14.510382+0000 mon.a (mon.0) 3482 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:56:15.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:15 gibba013 bash[29418]: audit 2021-03-10T16:56:14.512024+0000 mon.a (mon.0) 3483 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:15.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:15 gibba013 bash[29418]: audit 2021-03-10T16:56:14.513468+0000 mon.a (mon.0) 3484 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:15.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:15 gibba013 bash[29418]: audit 2021-03-10T16:56:14.514811+0000 mon.a (mon.0) 3485 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:15.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:15 gibba013 bash[29418]: audit 2021-03-10T16:56:14.517763+0000 mon.a (mon.0) 3486 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:15.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:15 gibba013 bash[29418]: audit 2021-03-10T16:56:14.519545+0000 mon.a (mon.0) 3487 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:15.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:15 gibba013 bash[30381]: cephadm 2021-03-10T16:56:14.266994+0000 mgr.gibba020.yqfnwy (mgr.34427) 9655 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:56:15.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:15 gibba013 bash[30381]: cephadm 2021-03-10T16:56:14.268765+0000 mgr.gibba020.yqfnwy (mgr.34427) 9656 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:56:15.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:15 gibba013 bash[30381]: audit 2021-03-10T16:56:14.506252+0000 mon.a (mon.0) 3481 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:56:15.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:15 gibba013 bash[30381]: audit 2021-03-10T16:56:14.510382+0000 mon.a (mon.0) 3482 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:56:15.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:15 gibba013 bash[30381]: audit 2021-03-10T16:56:14.512024+0000 mon.a (mon.0) 3483 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:15.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:15 gibba013 bash[30381]: audit 2021-03-10T16:56:14.513468+0000 mon.a (mon.0) 3484 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:15.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:15 gibba013 bash[30381]: audit 2021-03-10T16:56:14.514811+0000 mon.a (mon.0) 3485 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:15.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:15 gibba013 bash[30381]: audit 2021-03-10T16:56:14.517763+0000 mon.a (mon.0) 3486 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:15.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:15 gibba013 bash[30381]: audit 2021-03-10T16:56:14.519545+0000 mon.a (mon.0) 3487 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:15.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:15 gibba020 bash[25448]: cephadm 2021-03-10T16:56:14.266994+0000 mgr.gibba020.yqfnwy (mgr.34427) 9655 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:56:15.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:15 gibba020 bash[25448]: cephadm 2021-03-10T16:56:14.268765+0000 mgr.gibba020.yqfnwy (mgr.34427) 9656 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:56:15.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:15 gibba020 bash[25448]: audit 2021-03-10T16:56:14.506252+0000 mon.a (mon.0) 3481 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:56:15.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:15 gibba020 bash[25448]: audit 2021-03-10T16:56:14.510382+0000 mon.a (mon.0) 3482 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:56:15.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:15 gibba020 bash[25448]: audit 2021-03-10T16:56:14.512024+0000 mon.a (mon.0) 3483 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:15.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:15 gibba020 bash[25448]: audit 2021-03-10T16:56:14.513468+0000 mon.a (mon.0) 3484 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:15.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:15 gibba020 bash[25448]: audit 2021-03-10T16:56:14.514811+0000 mon.a (mon.0) 3485 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:15.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:15 gibba020 bash[25448]: audit 2021-03-10T16:56:14.517763+0000 mon.a (mon.0) 3486 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:15.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:15 gibba020 bash[25448]: audit 2021-03-10T16:56:14.519545+0000 mon.a (mon.0) 3487 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:16.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:16 gibba013 bash[29418]: cluster 2021-03-10T16:56:14.452929+0000 mgr.gibba020.yqfnwy (mgr.34427) 9657 : cluster [DBG] pgmap v5505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:16.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:16 gibba013 bash[29418]: cephadm 2021-03-10T16:56:14.508958+0000 mgr.gibba020.yqfnwy (mgr.34427) 9658 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:56:16.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:16 gibba013 bash[29418]: cephadm 2021-03-10T16:56:14.510933+0000 mgr.gibba020.yqfnwy (mgr.34427) 9659 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:56:16.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:16 gibba013 bash[29418]: cephadm 2021-03-10T16:56:14.512330+0000 mgr.gibba020.yqfnwy (mgr.34427) 9660 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:56:16.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:16 gibba013 bash[29418]: cephadm 2021-03-10T16:56:14.512378+0000 mgr.gibba020.yqfnwy (mgr.34427) 9661 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:56:16.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:16 gibba013 bash[29418]: cephadm 2021-03-10T16:56:14.513751+0000 mgr.gibba020.yqfnwy (mgr.34427) 9662 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:56:16.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:16 gibba013 bash[29418]: cephadm 2021-03-10T16:56:14.513795+0000 mgr.gibba020.yqfnwy (mgr.34427) 9663 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:56:16.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:16 gibba013 bash[29418]: cephadm 2021-03-10T16:56:14.515148+0000 mgr.gibba020.yqfnwy (mgr.34427) 9664 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:56:16.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:16 gibba013 bash[29418]: cephadm 2021-03-10T16:56:14.516504+0000 mgr.gibba020.yqfnwy (mgr.34427) 9665 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:56:16.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:16 gibba013 bash[29418]: cephadm 2021-03-10T16:56:14.516555+0000 mgr.gibba020.yqfnwy (mgr.34427) 9666 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:56:16.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:16 gibba013 bash[29418]: cephadm 2021-03-10T16:56:14.518185+0000 mgr.gibba020.yqfnwy (mgr.34427) 9667 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:56:16.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:16 gibba013 bash[29418]: cephadm 2021-03-10T16:56:14.518538+0000 mgr.gibba020.yqfnwy (mgr.34427) 9668 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:56:16.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:16 gibba013 bash[29418]: cephadm 2021-03-10T16:56:14.519914+0000 mgr.gibba020.yqfnwy (mgr.34427) 9669 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:56:16.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:16 gibba013 bash[29418]: cephadm 2021-03-10T16:56:14.519987+0000 mgr.gibba020.yqfnwy (mgr.34427) 9670 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:56:16.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:16 gibba013 bash[29418]: cephadm 2021-03-10T16:56:14.520136+0000 mgr.gibba020.yqfnwy (mgr.34427) 9671 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:56:16.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:16 gibba013 bash[30381]: cluster 2021-03-10T16:56:14.452929+0000 mgr.gibba020.yqfnwy (mgr.34427) 9657 : cluster [DBG] pgmap v5505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:16.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:16 gibba013 bash[30381]: cephadm 2021-03-10T16:56:14.508958+0000 mgr.gibba020.yqfnwy (mgr.34427) 9658 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:56:16.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:16 gibba013 bash[30381]: cephadm 2021-03-10T16:56:14.510933+0000 mgr.gibba020.yqfnwy (mgr.34427) 9659 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:56:16.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:16 gibba013 bash[30381]: cephadm 2021-03-10T16:56:14.512330+0000 mgr.gibba020.yqfnwy (mgr.34427) 9660 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:56:16.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:16 gibba013 bash[30381]: cephadm 2021-03-10T16:56:14.512378+0000 mgr.gibba020.yqfnwy (mgr.34427) 9661 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:56:16.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:16 gibba013 bash[30381]: cephadm 2021-03-10T16:56:14.513751+0000 mgr.gibba020.yqfnwy (mgr.34427) 9662 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:56:16.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:16 gibba013 bash[30381]: cephadm 2021-03-10T16:56:14.513795+0000 mgr.gibba020.yqfnwy (mgr.34427) 9663 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:56:16.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:16 gibba013 bash[30381]: cephadm 2021-03-10T16:56:14.515148+0000 mgr.gibba020.yqfnwy (mgr.34427) 9664 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:56:16.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:16 gibba013 bash[30381]: cephadm 2021-03-10T16:56:14.516504+0000 mgr.gibba020.yqfnwy (mgr.34427) 9665 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:56:16.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:16 gibba013 bash[30381]: cephadm 2021-03-10T16:56:14.516555+0000 mgr.gibba020.yqfnwy (mgr.34427) 9666 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:56:16.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:16 gibba013 bash[30381]: cephadm 2021-03-10T16:56:14.518185+0000 mgr.gibba020.yqfnwy (mgr.34427) 9667 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:56:16.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:16 gibba013 bash[30381]: cephadm 2021-03-10T16:56:14.518538+0000 mgr.gibba020.yqfnwy (mgr.34427) 9668 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:56:16.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:16 gibba013 bash[30381]: cephadm 2021-03-10T16:56:14.519914+0000 mgr.gibba020.yqfnwy (mgr.34427) 9669 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:56:16.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:16 gibba013 bash[30381]: cephadm 2021-03-10T16:56:14.519987+0000 mgr.gibba020.yqfnwy (mgr.34427) 9670 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:56:16.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:16 gibba013 bash[30381]: cephadm 2021-03-10T16:56:14.520136+0000 mgr.gibba020.yqfnwy (mgr.34427) 9671 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:56:16.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:16 gibba020 bash[25448]: cluster 2021-03-10T16:56:14.452929+0000 mgr.gibba020.yqfnwy (mgr.34427) 9657 : cluster [DBG] pgmap v5505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:16.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:16 gibba020 bash[25448]: cephadm 2021-03-10T16:56:14.508958+0000 mgr.gibba020.yqfnwy (mgr.34427) 9658 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:56:16.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:16 gibba020 bash[25448]: cephadm 2021-03-10T16:56:14.510933+0000 mgr.gibba020.yqfnwy (mgr.34427) 9659 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:56:16.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:16 gibba020 bash[25448]: cephadm 2021-03-10T16:56:14.512330+0000 mgr.gibba020.yqfnwy (mgr.34427) 9660 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:56:16.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:16 gibba020 bash[25448]: cephadm 2021-03-10T16:56:14.512378+0000 mgr.gibba020.yqfnwy (mgr.34427) 9661 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:56:16.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:16 gibba020 bash[25448]: cephadm 2021-03-10T16:56:14.513751+0000 mgr.gibba020.yqfnwy (mgr.34427) 9662 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:56:16.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:16 gibba020 bash[25448]: cephadm 2021-03-10T16:56:14.513795+0000 mgr.gibba020.yqfnwy (mgr.34427) 9663 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:56:16.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:16 gibba020 bash[25448]: cephadm 2021-03-10T16:56:14.515148+0000 mgr.gibba020.yqfnwy (mgr.34427) 9664 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:56:16.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:16 gibba020 bash[25448]: cephadm 2021-03-10T16:56:14.516504+0000 mgr.gibba020.yqfnwy (mgr.34427) 9665 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:56:16.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:16 gibba020 bash[25448]: cephadm 2021-03-10T16:56:14.516555+0000 mgr.gibba020.yqfnwy (mgr.34427) 9666 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:56:16.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:16 gibba020 bash[25448]: cephadm 2021-03-10T16:56:14.518185+0000 mgr.gibba020.yqfnwy (mgr.34427) 9667 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:56:16.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:16 gibba020 bash[25448]: cephadm 2021-03-10T16:56:14.518538+0000 mgr.gibba020.yqfnwy (mgr.34427) 9668 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:56:16.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:16 gibba020 bash[25448]: cephadm 2021-03-10T16:56:14.519914+0000 mgr.gibba020.yqfnwy (mgr.34427) 9669 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:56:16.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:16 gibba020 bash[25448]: cephadm 2021-03-10T16:56:14.519987+0000 mgr.gibba020.yqfnwy (mgr.34427) 9670 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:56:16.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:16 gibba020 bash[25448]: cephadm 2021-03-10T16:56:14.520136+0000 mgr.gibba020.yqfnwy (mgr.34427) 9671 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:56:17.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:17 gibba013 bash[29418]: cluster 2021-03-10T16:56:16.454525+0000 mgr.gibba020.yqfnwy (mgr.34427) 9672 : cluster [DBG] pgmap v5506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:17.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:17 gibba013 bash[30381]: cluster 2021-03-10T16:56:16.454525+0000 mgr.gibba020.yqfnwy (mgr.34427) 9672 : cluster [DBG] pgmap v5506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:17.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:17 gibba020 bash[25448]: cluster 2021-03-10T16:56:16.454525+0000 mgr.gibba020.yqfnwy (mgr.34427) 9672 : cluster [DBG] pgmap v5506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:19.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:19 gibba013 bash[29418]: cluster 2021-03-10T16:56:18.455937+0000 mgr.gibba020.yqfnwy (mgr.34427) 9673 : cluster [DBG] pgmap v5507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:19.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:19 gibba013 bash[30381]: cluster 2021-03-10T16:56:18.455937+0000 mgr.gibba020.yqfnwy (mgr.34427) 9673 : cluster [DBG] pgmap v5507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:19.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:19 gibba020 bash[25448]: cluster 2021-03-10T16:56:18.455937+0000 mgr.gibba020.yqfnwy (mgr.34427) 9673 : cluster [DBG] pgmap v5507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:22.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:22 gibba013 bash[29418]: cluster 2021-03-10T16:56:20.457427+0000 mgr.gibba020.yqfnwy (mgr.34427) 9674 : cluster [DBG] pgmap v5508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:22.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:22 gibba013 bash[30381]: cluster 2021-03-10T16:56:20.457427+0000 mgr.gibba020.yqfnwy (mgr.34427) 9674 : cluster [DBG] pgmap v5508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:22.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:22 gibba020 bash[25448]: cluster 2021-03-10T16:56:20.457427+0000 mgr.gibba020.yqfnwy (mgr.34427) 9674 : cluster [DBG] pgmap v5508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:24.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:24 gibba013 bash[29418]: cluster 2021-03-10T16:56:22.458831+0000 mgr.gibba020.yqfnwy (mgr.34427) 9675 : cluster [DBG] pgmap v5509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:24.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:24 gibba013 bash[30381]: cluster 2021-03-10T16:56:22.458831+0000 mgr.gibba020.yqfnwy (mgr.34427) 9675 : cluster [DBG] pgmap v5509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:24.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:24 gibba020 bash[25448]: cluster 2021-03-10T16:56:22.458831+0000 mgr.gibba020.yqfnwy (mgr.34427) 9675 : cluster [DBG] pgmap v5509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:26.378 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:26 gibba013 bash[29418]: cluster 2021-03-10T16:56:24.460230+0000 mgr.gibba020.yqfnwy (mgr.34427) 9676 : cluster [DBG] pgmap v5510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:26.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:26 gibba013 bash[30381]: cluster 2021-03-10T16:56:24.460230+0000 mgr.gibba020.yqfnwy (mgr.34427) 9676 : cluster [DBG] pgmap v5510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:26.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:26 gibba020 bash[25448]: cluster 2021-03-10T16:56:24.460230+0000 mgr.gibba020.yqfnwy (mgr.34427) 9676 : cluster [DBG] pgmap v5510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:28.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:28 gibba020 bash[25448]: cluster 2021-03-10T16:56:26.461808+0000 mgr.gibba020.yqfnwy (mgr.34427) 9677 : cluster [DBG] pgmap v5511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:28.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:28 gibba013 bash[29418]: cluster 2021-03-10T16:56:26.461808+0000 mgr.gibba020.yqfnwy (mgr.34427) 9677 : cluster [DBG] pgmap v5511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:28.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:28 gibba013 bash[30381]: cluster 2021-03-10T16:56:26.461808+0000 mgr.gibba020.yqfnwy (mgr.34427) 9677 : cluster [DBG] pgmap v5511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:30.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:30 gibba020 bash[25448]: cluster 2021-03-10T16:56:28.463325+0000 mgr.gibba020.yqfnwy (mgr.34427) 9678 : cluster [DBG] pgmap v5512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:30.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:30 gibba013 bash[29418]: cluster 2021-03-10T16:56:28.463325+0000 mgr.gibba020.yqfnwy (mgr.34427) 9678 : cluster [DBG] pgmap v5512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:30.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:30 gibba013 bash[30381]: cluster 2021-03-10T16:56:28.463325+0000 mgr.gibba020.yqfnwy (mgr.34427) 9678 : cluster [DBG] pgmap v5512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:31.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:31 gibba020 bash[25448]: cephadm 2021-03-10T16:56:29.526093+0000 mgr.gibba020.yqfnwy (mgr.34427) 9679 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:56:31.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:31 gibba013 bash[29418]: cephadm 2021-03-10T16:56:29.526093+0000 mgr.gibba020.yqfnwy (mgr.34427) 9679 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:56:31.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:31 gibba013 bash[30381]: cephadm 2021-03-10T16:56:29.526093+0000 mgr.gibba020.yqfnwy (mgr.34427) 9679 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:56:32.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:32 gibba020 bash[25448]: cluster 2021-03-10T16:56:30.464963+0000 mgr.gibba020.yqfnwy (mgr.34427) 9680 : cluster [DBG] pgmap v5513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:32.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:32 gibba013 bash[29418]: cluster 2021-03-10T16:56:30.464963+0000 mgr.gibba020.yqfnwy (mgr.34427) 9680 : cluster [DBG] pgmap v5513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:32.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:32 gibba013 bash[30381]: cluster 2021-03-10T16:56:30.464963+0000 mgr.gibba020.yqfnwy (mgr.34427) 9680 : cluster [DBG] pgmap v5513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:34.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:34 gibba020 bash[25448]: cluster 2021-03-10T16:56:32.466356+0000 mgr.gibba020.yqfnwy (mgr.34427) 9681 : cluster [DBG] pgmap v5514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:34.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:34 gibba013 bash[29418]: cluster 2021-03-10T16:56:32.466356+0000 mgr.gibba020.yqfnwy (mgr.34427) 9681 : cluster [DBG] pgmap v5514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:34.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:34 gibba013 bash[30381]: cluster 2021-03-10T16:56:32.466356+0000 mgr.gibba020.yqfnwy (mgr.34427) 9681 : cluster [DBG] pgmap v5514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:36.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:36 gibba020 bash[25448]: cluster 2021-03-10T16:56:34.467736+0000 mgr.gibba020.yqfnwy (mgr.34427) 9682 : cluster [DBG] pgmap v5515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:36.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:36 gibba013 bash[29418]: cluster 2021-03-10T16:56:34.467736+0000 mgr.gibba020.yqfnwy (mgr.34427) 9682 : cluster [DBG] pgmap v5515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:36.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:36 gibba013 bash[30381]: cluster 2021-03-10T16:56:34.467736+0000 mgr.gibba020.yqfnwy (mgr.34427) 9682 : cluster [DBG] pgmap v5515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:38.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:38 gibba020 bash[25448]: cluster 2021-03-10T16:56:36.469513+0000 mgr.gibba020.yqfnwy (mgr.34427) 9683 : cluster [DBG] pgmap v5516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:38.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:38 gibba013 bash[29418]: cluster 2021-03-10T16:56:36.469513+0000 mgr.gibba020.yqfnwy (mgr.34427) 9683 : cluster [DBG] pgmap v5516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:38.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:38 gibba013 bash[30381]: cluster 2021-03-10T16:56:36.469513+0000 mgr.gibba020.yqfnwy (mgr.34427) 9683 : cluster [DBG] pgmap v5516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:40.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:40 gibba020 bash[25448]: cluster 2021-03-10T16:56:38.470965+0000 mgr.gibba020.yqfnwy (mgr.34427) 9684 : cluster [DBG] pgmap v5517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:40.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:40 gibba013 bash[29418]: cluster 2021-03-10T16:56:38.470965+0000 mgr.gibba020.yqfnwy (mgr.34427) 9684 : cluster [DBG] pgmap v5517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:40.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:40 gibba013 bash[30381]: cluster 2021-03-10T16:56:38.470965+0000 mgr.gibba020.yqfnwy (mgr.34427) 9684 : cluster [DBG] pgmap v5517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:41.847 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:56:42.077 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:56:42.078 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 5m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:56:42.078 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 4m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:56:42.078 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:56:42.079 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:56:42.079 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:56:42.079 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:56:42.079 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:56:42.080 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:56:42.080 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:56:42.080 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:56:42.080 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:56:42.080 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:56:42.081 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:56:42.081 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:56:42.081 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:56:42.081 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:56:42.082 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:56:42.082 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:56:42.082 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 4m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:56:42.083 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 4m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:56:42.329 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:56:42.329 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:56:42.329 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:56:42.330 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:56:42.330 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:56:42.330 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:56:42.330 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:56:42.331 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:56:42.331 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:56:42.331 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:56:42.331 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:56:42.332 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:56:42.332 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:56:42.332 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:56:42.332 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:56:42.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:42 gibba013 bash[29418]: cluster 2021-03-10T16:56:40.472601+0000 mgr.gibba020.yqfnwy (mgr.34427) 9685 : cluster [DBG] pgmap v5518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:42.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:42 gibba013 bash[30381]: cluster 2021-03-10T16:56:40.472601+0000 mgr.gibba020.yqfnwy (mgr.34427) 9685 : cluster [DBG] pgmap v5518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:42.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:42 gibba020 bash[25448]: cluster 2021-03-10T16:56:40.472601+0000 mgr.gibba020.yqfnwy (mgr.34427) 9685 : cluster [DBG] pgmap v5518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:43.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:43 gibba013 bash[29418]: audit 2021-03-10T16:56:41.838334+0000 mgr.gibba020.yqfnwy (mgr.34427) 9686 : audit [DBG] from='client.60529 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:56:43.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:43 gibba013 bash[29418]: audit 2021-03-10T16:56:42.065182+0000 mgr.gibba020.yqfnwy (mgr.34427) 9687 : audit [DBG] from='client.60535 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:56:43.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:43 gibba013 bash[29418]: audit 2021-03-10T16:56:42.329653+0000 mon.a (mon.0) 3488 : audit [DBG] from='client.? 172.21.2.113:0/1658308172' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:43.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:43 gibba013 bash[30381]: audit 2021-03-10T16:56:41.838334+0000 mgr.gibba020.yqfnwy (mgr.34427) 9686 : audit [DBG] from='client.60529 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:56:43.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:43 gibba013 bash[30381]: audit 2021-03-10T16:56:42.065182+0000 mgr.gibba020.yqfnwy (mgr.34427) 9687 : audit [DBG] from='client.60535 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:56:43.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:43 gibba013 bash[30381]: audit 2021-03-10T16:56:42.329653+0000 mon.a (mon.0) 3488 : audit [DBG] from='client.? 172.21.2.113:0/1658308172' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:43.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:43 gibba020 bash[25448]: audit 2021-03-10T16:56:41.838334+0000 mgr.gibba020.yqfnwy (mgr.34427) 9686 : audit [DBG] from='client.60529 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:56:43.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:43 gibba020 bash[25448]: audit 2021-03-10T16:56:42.065182+0000 mgr.gibba020.yqfnwy (mgr.34427) 9687 : audit [DBG] from='client.60535 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:56:43.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:43 gibba020 bash[25448]: audit 2021-03-10T16:56:42.329653+0000 mon.a (mon.0) 3488 : audit [DBG] from='client.? 172.21.2.113:0/1658308172' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:56:44.542 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:44 gibba020 bash[25448]: cluster 2021-03-10T16:56:42.474065+0000 mgr.gibba020.yqfnwy (mgr.34427) 9688 : cluster [DBG] pgmap v5519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:44.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:44 gibba013 bash[29418]: cluster 2021-03-10T16:56:42.474065+0000 mgr.gibba020.yqfnwy (mgr.34427) 9688 : cluster [DBG] pgmap v5519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:44.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:44 gibba013 bash[30381]: cluster 2021-03-10T16:56:42.474065+0000 mgr.gibba020.yqfnwy (mgr.34427) 9688 : cluster [DBG] pgmap v5519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:46.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:46 gibba013 bash[29418]: cluster 2021-03-10T16:56:44.475546+0000 mgr.gibba020.yqfnwy (mgr.34427) 9689 : cluster [DBG] pgmap v5520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:46.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:46 gibba013 bash[29418]: cephadm 2021-03-10T16:56:44.541921+0000 mgr.gibba020.yqfnwy (mgr.34427) 9690 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:56:46.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:46 gibba013 bash[30381]: cluster 2021-03-10T16:56:44.475546+0000 mgr.gibba020.yqfnwy (mgr.34427) 9689 : cluster [DBG] pgmap v5520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:46.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:46 gibba013 bash[30381]: cephadm 2021-03-10T16:56:44.541921+0000 mgr.gibba020.yqfnwy (mgr.34427) 9690 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:56:46.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:46 gibba020 bash[25448]: cluster 2021-03-10T16:56:44.475546+0000 mgr.gibba020.yqfnwy (mgr.34427) 9689 : cluster [DBG] pgmap v5520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:46.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:46 gibba020 bash[25448]: cephadm 2021-03-10T16:56:44.541921+0000 mgr.gibba020.yqfnwy (mgr.34427) 9690 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:56:48.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:48 gibba013 bash[29418]: cluster 2021-03-10T16:56:46.477183+0000 mgr.gibba020.yqfnwy (mgr.34427) 9691 : cluster [DBG] pgmap v5521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:48.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:48 gibba013 bash[30381]: cluster 2021-03-10T16:56:46.477183+0000 mgr.gibba020.yqfnwy (mgr.34427) 9691 : cluster [DBG] pgmap v5521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:48.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:48 gibba020 bash[25448]: cluster 2021-03-10T16:56:46.477183+0000 mgr.gibba020.yqfnwy (mgr.34427) 9691 : cluster [DBG] pgmap v5521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:50.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:50 gibba013 bash[29418]: cluster 2021-03-10T16:56:48.478585+0000 mgr.gibba020.yqfnwy (mgr.34427) 9692 : cluster [DBG] pgmap v5522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:50.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:50 gibba013 bash[30381]: cluster 2021-03-10T16:56:48.478585+0000 mgr.gibba020.yqfnwy (mgr.34427) 9692 : cluster [DBG] pgmap v5522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:50.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:50 gibba020 bash[25448]: cluster 2021-03-10T16:56:48.478585+0000 mgr.gibba020.yqfnwy (mgr.34427) 9692 : cluster [DBG] pgmap v5522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:52.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:52 gibba013 bash[29418]: cluster 2021-03-10T16:56:50.480306+0000 mgr.gibba020.yqfnwy (mgr.34427) 9693 : cluster [DBG] pgmap v5523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:52.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:52 gibba013 bash[30381]: cluster 2021-03-10T16:56:50.480306+0000 mgr.gibba020.yqfnwy (mgr.34427) 9693 : cluster [DBG] pgmap v5523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:52.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:52 gibba020 bash[25448]: cluster 2021-03-10T16:56:50.480306+0000 mgr.gibba020.yqfnwy (mgr.34427) 9693 : cluster [DBG] pgmap v5523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:54.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:54 gibba013 bash[29418]: cluster 2021-03-10T16:56:52.481607+0000 mgr.gibba020.yqfnwy (mgr.34427) 9694 : cluster [DBG] pgmap v5524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:54.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:54 gibba013 bash[30381]: cluster 2021-03-10T16:56:52.481607+0000 mgr.gibba020.yqfnwy (mgr.34427) 9694 : cluster [DBG] pgmap v5524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:54.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:54 gibba020 bash[25448]: cluster 2021-03-10T16:56:52.481607+0000 mgr.gibba020.yqfnwy (mgr.34427) 9694 : cluster [DBG] pgmap v5524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:56.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:56 gibba013 bash[29418]: cluster 2021-03-10T16:56:54.483007+0000 mgr.gibba020.yqfnwy (mgr.34427) 9695 : cluster [DBG] pgmap v5525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:56.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:56 gibba013 bash[30381]: cluster 2021-03-10T16:56:54.483007+0000 mgr.gibba020.yqfnwy (mgr.34427) 9695 : cluster [DBG] pgmap v5525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:56.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:56 gibba020 bash[25448]: cluster 2021-03-10T16:56:54.483007+0000 mgr.gibba020.yqfnwy (mgr.34427) 9695 : cluster [DBG] pgmap v5525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:58.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:56:58 gibba013 bash[29418]: cluster 2021-03-10T16:56:56.484776+0000 mgr.gibba020.yqfnwy (mgr.34427) 9696 : cluster [DBG] pgmap v5526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:58.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:56:58 gibba013 bash[30381]: cluster 2021-03-10T16:56:56.484776+0000 mgr.gibba020.yqfnwy (mgr.34427) 9696 : cluster [DBG] pgmap v5526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:56:58.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:56:58 gibba020 bash[25448]: cluster 2021-03-10T16:56:56.484776+0000 mgr.gibba020.yqfnwy (mgr.34427) 9696 : cluster [DBG] pgmap v5526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:00.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:00 gibba013 bash[29418]: cluster 2021-03-10T16:56:58.486173+0000 mgr.gibba020.yqfnwy (mgr.34427) 9697 : cluster [DBG] pgmap v5527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:00.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:00 gibba013 bash[30381]: cluster 2021-03-10T16:56:58.486173+0000 mgr.gibba020.yqfnwy (mgr.34427) 9697 : cluster [DBG] pgmap v5527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:00.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:00 gibba020 bash[25448]: cluster 2021-03-10T16:56:58.486173+0000 mgr.gibba020.yqfnwy (mgr.34427) 9697 : cluster [DBG] pgmap v5527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:01.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:01 gibba013 bash[29418]: cephadm 2021-03-10T16:56:59.558028+0000 mgr.gibba020.yqfnwy (mgr.34427) 9698 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:57:01.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:01 gibba013 bash[30381]: cephadm 2021-03-10T16:56:59.558028+0000 mgr.gibba020.yqfnwy (mgr.34427) 9698 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:57:01.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:01 gibba020 bash[25448]: cephadm 2021-03-10T16:56:59.558028+0000 mgr.gibba020.yqfnwy (mgr.34427) 9698 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:57:02.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:02 gibba013 bash[29418]: cluster 2021-03-10T16:57:00.487583+0000 mgr.gibba020.yqfnwy (mgr.34427) 9699 : cluster [DBG] pgmap v5528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:02.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:02 gibba013 bash[30381]: cluster 2021-03-10T16:57:00.487583+0000 mgr.gibba020.yqfnwy (mgr.34427) 9699 : cluster [DBG] pgmap v5528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:02.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:02 gibba020 bash[25448]: cluster 2021-03-10T16:57:00.487583+0000 mgr.gibba020.yqfnwy (mgr.34427) 9699 : cluster [DBG] pgmap v5528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:04.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:04 gibba013 bash[29418]: cluster 2021-03-10T16:57:02.489107+0000 mgr.gibba020.yqfnwy (mgr.34427) 9700 : cluster [DBG] pgmap v5529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:04.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:04 gibba013 bash[30381]: cluster 2021-03-10T16:57:02.489107+0000 mgr.gibba020.yqfnwy (mgr.34427) 9700 : cluster [DBG] pgmap v5529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:04.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:04 gibba020 bash[25448]: cluster 2021-03-10T16:57:02.489107+0000 mgr.gibba020.yqfnwy (mgr.34427) 9700 : cluster [DBG] pgmap v5529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:06.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:06 gibba013 bash[29418]: cluster 2021-03-10T16:57:04.490522+0000 mgr.gibba020.yqfnwy (mgr.34427) 9701 : cluster [DBG] pgmap v5530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:06.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:06 gibba013 bash[30381]: cluster 2021-03-10T16:57:04.490522+0000 mgr.gibba020.yqfnwy (mgr.34427) 9701 : cluster [DBG] pgmap v5530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:06.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:06 gibba020 bash[25448]: cluster 2021-03-10T16:57:04.490522+0000 mgr.gibba020.yqfnwy (mgr.34427) 9701 : cluster [DBG] pgmap v5530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:07.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:07 gibba013 bash[29418]: audit 2021-03-10T16:57:06.845403+0000 mon.a (mon.0) 3489 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:57:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:07 gibba013 bash[29418]: audit 2021-03-10T16:57:07.034412+0000 mon.a (mon.0) 3490 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:57:07.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:07 gibba013 bash[30381]: audit 2021-03-10T16:57:06.845403+0000 mon.a (mon.0) 3489 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:57:07.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:07 gibba013 bash[30381]: audit 2021-03-10T16:57:07.034412+0000 mon.a (mon.0) 3490 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:57:07.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:07 gibba020 bash[25448]: audit 2021-03-10T16:57:06.845403+0000 mon.a (mon.0) 3489 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:57:07.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:07 gibba020 bash[25448]: audit 2021-03-10T16:57:07.034412+0000 mon.a (mon.0) 3490 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:57:08.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:08 gibba013 bash[29418]: cluster 2021-03-10T16:57:06.492548+0000 mgr.gibba020.yqfnwy (mgr.34427) 9702 : cluster [DBG] pgmap v5531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:08.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:08 gibba013 bash[29418]: audit 2021-03-10T16:57:07.424260+0000 mon.a (mon.0) 3491 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:57:08.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:08 gibba013 bash[29418]: audit 2021-03-10T16:57:07.425171+0000 mon.a (mon.0) 3492 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:57:08.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:08 gibba013 bash[29418]: audit 2021-03-10T16:57:07.425926+0000 mon.a (mon.0) 3493 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:57:08.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:08 gibba013 bash[29418]: audit 2021-03-10T16:57:07.426732+0000 mon.a (mon.0) 3494 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:57:08.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:08 gibba013 bash[30381]: cluster 2021-03-10T16:57:06.492548+0000 mgr.gibba020.yqfnwy (mgr.34427) 9702 : cluster [DBG] pgmap v5531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:08.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:08 gibba013 bash[30381]: audit 2021-03-10T16:57:07.424260+0000 mon.a (mon.0) 3491 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:57:08.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:08 gibba013 bash[30381]: audit 2021-03-10T16:57:07.425171+0000 mon.a (mon.0) 3492 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:57:08.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:08 gibba013 bash[30381]: audit 2021-03-10T16:57:07.425926+0000 mon.a (mon.0) 3493 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:57:08.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:08 gibba013 bash[30381]: audit 2021-03-10T16:57:07.426732+0000 mon.a (mon.0) 3494 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:57:08.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:08 gibba020 bash[25448]: cluster 2021-03-10T16:57:06.492548+0000 mgr.gibba020.yqfnwy (mgr.34427) 9702 : cluster [DBG] pgmap v5531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:08.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:08 gibba020 bash[25448]: audit 2021-03-10T16:57:07.424260+0000 mon.a (mon.0) 3491 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T16:57:08.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:08 gibba020 bash[25448]: audit 2021-03-10T16:57:07.425171+0000 mon.a (mon.0) 3492 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T16:57:08.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:08 gibba020 bash[25448]: audit 2021-03-10T16:57:07.425926+0000 mon.a (mon.0) 3493 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T16:57:08.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:08 gibba020 bash[25448]: audit 2021-03-10T16:57:07.426732+0000 mon.a (mon.0) 3494 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T16:57:09.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:09 gibba020 bash[25448]: cluster 2021-03-10T16:57:08.493956+0000 mgr.gibba020.yqfnwy (mgr.34427) 9703 : cluster [DBG] pgmap v5532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:09.878 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:09 gibba013 bash[29418]: cluster 2021-03-10T16:57:08.493956+0000 mgr.gibba020.yqfnwy (mgr.34427) 9703 : cluster [DBG] pgmap v5532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:09.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:09 gibba013 bash[30381]: cluster 2021-03-10T16:57:08.493956+0000 mgr.gibba020.yqfnwy (mgr.34427) 9703 : cluster [DBG] pgmap v5532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:12.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:12 gibba013 bash[29418]: cluster 2021-03-10T16:57:10.495703+0000 mgr.gibba020.yqfnwy (mgr.34427) 9704 : cluster [DBG] pgmap v5533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:12.379 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:12 gibba013 bash[30381]: cluster 2021-03-10T16:57:10.495703+0000 mgr.gibba020.yqfnwy (mgr.34427) 9704 : cluster [DBG] pgmap v5533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:12.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:12 gibba020 bash[25448]: cluster 2021-03-10T16:57:10.495703+0000 mgr.gibba020.yqfnwy (mgr.34427) 9704 : cluster [DBG] pgmap v5533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:12.574 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:57:12.802 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:57:12.802 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 6m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:57:12.803 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 5m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:57:12.803 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:57:12.803 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:57:12.803 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:57:12.803 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:57:12.804 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:57:12.804 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:57:12.804 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:57:12.804 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:57:12.805 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:57:12.805 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:57:12.805 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:57:12.805 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:57:12.806 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:57:12.806 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:57:12.806 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:57:12.806 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:57:12.807 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 5m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:57:12.807 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 5m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:57:13.050 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:57:13.050 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:57:13.050 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:57:13.051 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:57:13.051 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:57:13.051 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:57:13.051 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:57:13.052 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:57:13.052 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:57:13.052 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:57:13.052 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:57:13.053 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:57:13.053 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:57:13.053 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:57:13.053 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:57:13.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:13 gibba020 bash[25448]: audit 2021-03-10T16:57:13.050304+0000 mon.c (mon.1) 148 : audit [DBG] from='client.? 172.21.2.113:0/3855199749' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:13.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:13 gibba013 bash[29418]: audit 2021-03-10T16:57:13.050304+0000 mon.c (mon.1) 148 : audit [DBG] from='client.? 172.21.2.113:0/3855199749' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:13.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:13 gibba013 bash[30381]: audit 2021-03-10T16:57:13.050304+0000 mon.c (mon.1) 148 : audit [DBG] from='client.? 172.21.2.113:0/3855199749' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:14.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:14 gibba020 bash[25448]: cluster 2021-03-10T16:57:12.497206+0000 mgr.gibba020.yqfnwy (mgr.34427) 9705 : cluster [DBG] pgmap v5534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:14.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:14 gibba020 bash[25448]: audit 2021-03-10T16:57:12.564562+0000 mgr.gibba020.yqfnwy (mgr.34427) 9706 : audit [DBG] from='client.50568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:57:14.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:14 gibba020 bash[25448]: audit 2021-03-10T16:57:12.789317+0000 mgr.gibba020.yqfnwy (mgr.34427) 9707 : audit [DBG] from='client.50574 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:57:14.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:14 gibba013 bash[29418]: cluster 2021-03-10T16:57:12.497206+0000 mgr.gibba020.yqfnwy (mgr.34427) 9705 : cluster [DBG] pgmap v5534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:14.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:14 gibba013 bash[29418]: audit 2021-03-10T16:57:12.564562+0000 mgr.gibba020.yqfnwy (mgr.34427) 9706 : audit [DBG] from='client.50568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:57:14.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:14 gibba013 bash[29418]: audit 2021-03-10T16:57:12.789317+0000 mgr.gibba020.yqfnwy (mgr.34427) 9707 : audit [DBG] from='client.50574 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:57:14.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:14 gibba013 bash[30381]: cluster 2021-03-10T16:57:12.497206+0000 mgr.gibba020.yqfnwy (mgr.34427) 9705 : cluster [DBG] pgmap v5534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:14.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:14 gibba013 bash[30381]: audit 2021-03-10T16:57:12.564562+0000 mgr.gibba020.yqfnwy (mgr.34427) 9706 : audit [DBG] from='client.50568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:57:14.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:14 gibba013 bash[30381]: audit 2021-03-10T16:57:12.789317+0000 mgr.gibba020.yqfnwy (mgr.34427) 9707 : audit [DBG] from='client.50574 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:57:15.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:15 gibba020 bash[25448]: audit 2021-03-10T16:57:14.575565+0000 mon.a (mon.0) 3495 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:57:15.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:15 gibba020 bash[25448]: audit 2021-03-10T16:57:14.812353+0000 mon.a (mon.0) 3496 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:57:15.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:15 gibba020 bash[25448]: audit 2021-03-10T16:57:14.815451+0000 mon.a (mon.0) 3497 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:57:15.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:15 gibba020 bash[25448]: audit 2021-03-10T16:57:14.817112+0000 mon.a (mon.0) 3498 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:15.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:15 gibba020 bash[25448]: audit 2021-03-10T16:57:14.818869+0000 mon.a (mon.0) 3499 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:15.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:15 gibba020 bash[25448]: audit 2021-03-10T16:57:14.820278+0000 mon.a (mon.0) 3500 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:15.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:15 gibba020 bash[25448]: audit 2021-03-10T16:57:14.823141+0000 mon.a (mon.0) 3501 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:15.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:15 gibba020 bash[25448]: audit 2021-03-10T16:57:14.825051+0000 mon.a (mon.0) 3502 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:15.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:15 gibba013 bash[29418]: audit 2021-03-10T16:57:14.575565+0000 mon.a (mon.0) 3495 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:57:15.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:15 gibba013 bash[29418]: audit 2021-03-10T16:57:14.812353+0000 mon.a (mon.0) 3496 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:57:15.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:15 gibba013 bash[29418]: audit 2021-03-10T16:57:14.815451+0000 mon.a (mon.0) 3497 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:57:15.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:15 gibba013 bash[29418]: audit 2021-03-10T16:57:14.817112+0000 mon.a (mon.0) 3498 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:15.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:15 gibba013 bash[29418]: audit 2021-03-10T16:57:14.818869+0000 mon.a (mon.0) 3499 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:15.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:15 gibba013 bash[29418]: audit 2021-03-10T16:57:14.820278+0000 mon.a (mon.0) 3500 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:15.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:15 gibba013 bash[29418]: audit 2021-03-10T16:57:14.823141+0000 mon.a (mon.0) 3501 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:15.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:15 gibba013 bash[29418]: audit 2021-03-10T16:57:14.825051+0000 mon.a (mon.0) 3502 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:15.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:15 gibba013 bash[30381]: audit 2021-03-10T16:57:14.575565+0000 mon.a (mon.0) 3495 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:57:15.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:15 gibba013 bash[30381]: audit 2021-03-10T16:57:14.812353+0000 mon.a (mon.0) 3496 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:57:15.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:15 gibba013 bash[30381]: audit 2021-03-10T16:57:14.815451+0000 mon.a (mon.0) 3497 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:57:15.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:15 gibba013 bash[30381]: audit 2021-03-10T16:57:14.817112+0000 mon.a (mon.0) 3498 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:15.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:15 gibba013 bash[30381]: audit 2021-03-10T16:57:14.818869+0000 mon.a (mon.0) 3499 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:15.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:15 gibba013 bash[30381]: audit 2021-03-10T16:57:14.820278+0000 mon.a (mon.0) 3500 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:15.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:15 gibba013 bash[30381]: audit 2021-03-10T16:57:14.823141+0000 mon.a (mon.0) 3501 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:15.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:15 gibba013 bash[30381]: audit 2021-03-10T16:57:14.825051+0000 mon.a (mon.0) 3502 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:16.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:16 gibba020 bash[25448]: cluster 2021-03-10T16:57:14.498591+0000 mgr.gibba020.yqfnwy (mgr.34427) 9708 : cluster [DBG] pgmap v5535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:16.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:16 gibba020 bash[25448]: cephadm 2021-03-10T16:57:14.581092+0000 mgr.gibba020.yqfnwy (mgr.34427) 9709 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:57:16.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:16 gibba020 bash[25448]: cephadm 2021-03-10T16:57:14.582627+0000 mgr.gibba020.yqfnwy (mgr.34427) 9710 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:57:16.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:16 gibba020 bash[25448]: cephadm 2021-03-10T16:57:14.814174+0000 mgr.gibba020.yqfnwy (mgr.34427) 9711 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:57:16.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:16 gibba020 bash[25448]: cephadm 2021-03-10T16:57:14.815850+0000 mgr.gibba020.yqfnwy (mgr.34427) 9712 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:57:16.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:16 gibba020 bash[25448]: cephadm 2021-03-10T16:57:14.817605+0000 mgr.gibba020.yqfnwy (mgr.34427) 9713 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:57:16.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:16 gibba020 bash[25448]: cephadm 2021-03-10T16:57:14.817647+0000 mgr.gibba020.yqfnwy (mgr.34427) 9714 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:57:16.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:16 gibba020 bash[25448]: cephadm 2021-03-10T16:57:14.819338+0000 mgr.gibba020.yqfnwy (mgr.34427) 9715 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:57:16.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:16 gibba020 bash[25448]: cephadm 2021-03-10T16:57:14.819382+0000 mgr.gibba020.yqfnwy (mgr.34427) 9716 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:57:16.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:16 gibba020 bash[25448]: cephadm 2021-03-10T16:57:14.820624+0000 mgr.gibba020.yqfnwy (mgr.34427) 9717 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:57:16.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:16 gibba020 bash[25448]: cephadm 2021-03-10T16:57:14.821883+0000 mgr.gibba020.yqfnwy (mgr.34427) 9718 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:57:16.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:16 gibba020 bash[25448]: cephadm 2021-03-10T16:57:14.821929+0000 mgr.gibba020.yqfnwy (mgr.34427) 9719 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:57:16.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:16 gibba020 bash[25448]: cephadm 2021-03-10T16:57:14.823552+0000 mgr.gibba020.yqfnwy (mgr.34427) 9720 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:57:16.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:16 gibba020 bash[25448]: cephadm 2021-03-10T16:57:14.823937+0000 mgr.gibba020.yqfnwy (mgr.34427) 9721 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:57:16.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:16 gibba020 bash[25448]: cephadm 2021-03-10T16:57:14.825469+0000 mgr.gibba020.yqfnwy (mgr.34427) 9722 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:57:16.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:16 gibba020 bash[25448]: cephadm 2021-03-10T16:57:14.825517+0000 mgr.gibba020.yqfnwy (mgr.34427) 9723 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:57:16.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:16 gibba020 bash[25448]: cephadm 2021-03-10T16:57:14.825643+0000 mgr.gibba020.yqfnwy (mgr.34427) 9724 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:57:16.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:16 gibba013 bash[30381]: cluster 2021-03-10T16:57:14.498591+0000 mgr.gibba020.yqfnwy (mgr.34427) 9708 : cluster [DBG] pgmap v5535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:16.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:16 gibba013 bash[30381]: cephadm 2021-03-10T16:57:14.581092+0000 mgr.gibba020.yqfnwy (mgr.34427) 9709 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:57:16.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:16 gibba013 bash[30381]: cephadm 2021-03-10T16:57:14.582627+0000 mgr.gibba020.yqfnwy (mgr.34427) 9710 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:57:16.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:16 gibba013 bash[30381]: cephadm 2021-03-10T16:57:14.814174+0000 mgr.gibba020.yqfnwy (mgr.34427) 9711 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:57:16.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:16 gibba013 bash[30381]: cephadm 2021-03-10T16:57:14.815850+0000 mgr.gibba020.yqfnwy (mgr.34427) 9712 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:57:16.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:16 gibba013 bash[30381]: cephadm 2021-03-10T16:57:14.817605+0000 mgr.gibba020.yqfnwy (mgr.34427) 9713 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:57:16.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:16 gibba013 bash[30381]: cephadm 2021-03-10T16:57:14.817647+0000 mgr.gibba020.yqfnwy (mgr.34427) 9714 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:57:16.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:16 gibba013 bash[30381]: cephadm 2021-03-10T16:57:14.819338+0000 mgr.gibba020.yqfnwy (mgr.34427) 9715 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:57:16.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:16 gibba013 bash[30381]: cephadm 2021-03-10T16:57:14.819382+0000 mgr.gibba020.yqfnwy (mgr.34427) 9716 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:57:16.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:16 gibba013 bash[30381]: cephadm 2021-03-10T16:57:14.820624+0000 mgr.gibba020.yqfnwy (mgr.34427) 9717 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:57:16.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:16 gibba013 bash[30381]: cephadm 2021-03-10T16:57:14.821883+0000 mgr.gibba020.yqfnwy (mgr.34427) 9718 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:57:16.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:16 gibba013 bash[30381]: cephadm 2021-03-10T16:57:14.821929+0000 mgr.gibba020.yqfnwy (mgr.34427) 9719 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:57:16.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:16 gibba013 bash[30381]: cephadm 2021-03-10T16:57:14.823552+0000 mgr.gibba020.yqfnwy (mgr.34427) 9720 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:57:16.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:16 gibba013 bash[30381]: cephadm 2021-03-10T16:57:14.823937+0000 mgr.gibba020.yqfnwy (mgr.34427) 9721 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:57:16.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:16 gibba013 bash[30381]: cephadm 2021-03-10T16:57:14.825469+0000 mgr.gibba020.yqfnwy (mgr.34427) 9722 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:57:16.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:16 gibba013 bash[30381]: cephadm 2021-03-10T16:57:14.825517+0000 mgr.gibba020.yqfnwy (mgr.34427) 9723 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:57:16.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:16 gibba013 bash[30381]: cephadm 2021-03-10T16:57:14.825643+0000 mgr.gibba020.yqfnwy (mgr.34427) 9724 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:57:16.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:16 gibba013 bash[29418]: cluster 2021-03-10T16:57:14.498591+0000 mgr.gibba020.yqfnwy (mgr.34427) 9708 : cluster [DBG] pgmap v5535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:16.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:16 gibba013 bash[29418]: cephadm 2021-03-10T16:57:14.581092+0000 mgr.gibba020.yqfnwy (mgr.34427) 9709 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:57:16.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:16 gibba013 bash[29418]: cephadm 2021-03-10T16:57:14.582627+0000 mgr.gibba020.yqfnwy (mgr.34427) 9710 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:57:16.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:16 gibba013 bash[29418]: cephadm 2021-03-10T16:57:14.814174+0000 mgr.gibba020.yqfnwy (mgr.34427) 9711 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:57:16.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:16 gibba013 bash[29418]: cephadm 2021-03-10T16:57:14.815850+0000 mgr.gibba020.yqfnwy (mgr.34427) 9712 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:57:16.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:16 gibba013 bash[29418]: cephadm 2021-03-10T16:57:14.817605+0000 mgr.gibba020.yqfnwy (mgr.34427) 9713 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:57:16.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:16 gibba013 bash[29418]: cephadm 2021-03-10T16:57:14.817647+0000 mgr.gibba020.yqfnwy (mgr.34427) 9714 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:57:16.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:16 gibba013 bash[29418]: cephadm 2021-03-10T16:57:14.819338+0000 mgr.gibba020.yqfnwy (mgr.34427) 9715 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:57:16.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:16 gibba013 bash[29418]: cephadm 2021-03-10T16:57:14.819382+0000 mgr.gibba020.yqfnwy (mgr.34427) 9716 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:57:16.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:16 gibba013 bash[29418]: cephadm 2021-03-10T16:57:14.820624+0000 mgr.gibba020.yqfnwy (mgr.34427) 9717 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:57:16.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:16 gibba013 bash[29418]: cephadm 2021-03-10T16:57:14.821883+0000 mgr.gibba020.yqfnwy (mgr.34427) 9718 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:57:16.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:16 gibba013 bash[29418]: cephadm 2021-03-10T16:57:14.821929+0000 mgr.gibba020.yqfnwy (mgr.34427) 9719 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:57:16.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:16 gibba013 bash[29418]: cephadm 2021-03-10T16:57:14.823552+0000 mgr.gibba020.yqfnwy (mgr.34427) 9720 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:57:16.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:16 gibba013 bash[29418]: cephadm 2021-03-10T16:57:14.823937+0000 mgr.gibba020.yqfnwy (mgr.34427) 9721 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:57:16.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:16 gibba013 bash[29418]: cephadm 2021-03-10T16:57:14.825469+0000 mgr.gibba020.yqfnwy (mgr.34427) 9722 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:57:16.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:16 gibba013 bash[29418]: cephadm 2021-03-10T16:57:14.825517+0000 mgr.gibba020.yqfnwy (mgr.34427) 9723 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:57:16.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:16 gibba013 bash[29418]: cephadm 2021-03-10T16:57:14.825643+0000 mgr.gibba020.yqfnwy (mgr.34427) 9724 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:57:18.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:18 gibba020 bash[25448]: cluster 2021-03-10T16:57:16.500360+0000 mgr.gibba020.yqfnwy (mgr.34427) 9725 : cluster [DBG] pgmap v5536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:18.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:18 gibba013 bash[30381]: cluster 2021-03-10T16:57:16.500360+0000 mgr.gibba020.yqfnwy (mgr.34427) 9725 : cluster [DBG] pgmap v5536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:18.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:18 gibba013 bash[29418]: cluster 2021-03-10T16:57:16.500360+0000 mgr.gibba020.yqfnwy (mgr.34427) 9725 : cluster [DBG] pgmap v5536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:20.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:20 gibba020 bash[25448]: cluster 2021-03-10T16:57:18.501883+0000 mgr.gibba020.yqfnwy (mgr.34427) 9726 : cluster [DBG] pgmap v5537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:20.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:20 gibba013 bash[30381]: cluster 2021-03-10T16:57:18.501883+0000 mgr.gibba020.yqfnwy (mgr.34427) 9726 : cluster [DBG] pgmap v5537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:20.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:20 gibba013 bash[29418]: cluster 2021-03-10T16:57:18.501883+0000 mgr.gibba020.yqfnwy (mgr.34427) 9726 : cluster [DBG] pgmap v5537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:22.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:22 gibba020 bash[25448]: cluster 2021-03-10T16:57:20.503583+0000 mgr.gibba020.yqfnwy (mgr.34427) 9727 : cluster [DBG] pgmap v5538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:22.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:22 gibba013 bash[29418]: cluster 2021-03-10T16:57:20.503583+0000 mgr.gibba020.yqfnwy (mgr.34427) 9727 : cluster [DBG] pgmap v5538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:22.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:22 gibba013 bash[30381]: cluster 2021-03-10T16:57:20.503583+0000 mgr.gibba020.yqfnwy (mgr.34427) 9727 : cluster [DBG] pgmap v5538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:24.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:24 gibba020 bash[25448]: cluster 2021-03-10T16:57:22.505020+0000 mgr.gibba020.yqfnwy (mgr.34427) 9728 : cluster [DBG] pgmap v5539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:24.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:24 gibba013 bash[29418]: cluster 2021-03-10T16:57:22.505020+0000 mgr.gibba020.yqfnwy (mgr.34427) 9728 : cluster [DBG] pgmap v5539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:24.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:24 gibba013 bash[30381]: cluster 2021-03-10T16:57:22.505020+0000 mgr.gibba020.yqfnwy (mgr.34427) 9728 : cluster [DBG] pgmap v5539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:26.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:26 gibba020 bash[25448]: cluster 2021-03-10T16:57:24.506494+0000 mgr.gibba020.yqfnwy (mgr.34427) 9729 : cluster [DBG] pgmap v5540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:26.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:26 gibba013 bash[29418]: cluster 2021-03-10T16:57:24.506494+0000 mgr.gibba020.yqfnwy (mgr.34427) 9729 : cluster [DBG] pgmap v5540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:26.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:26 gibba013 bash[30381]: cluster 2021-03-10T16:57:24.506494+0000 mgr.gibba020.yqfnwy (mgr.34427) 9729 : cluster [DBG] pgmap v5540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:28.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:28 gibba013 bash[29418]: cluster 2021-03-10T16:57:26.508384+0000 mgr.gibba020.yqfnwy (mgr.34427) 9730 : cluster [DBG] pgmap v5541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:28.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:28 gibba013 bash[30381]: cluster 2021-03-10T16:57:26.508384+0000 mgr.gibba020.yqfnwy (mgr.34427) 9730 : cluster [DBG] pgmap v5541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:28.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:28 gibba020 bash[25448]: cluster 2021-03-10T16:57:26.508384+0000 mgr.gibba020.yqfnwy (mgr.34427) 9730 : cluster [DBG] pgmap v5541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:30.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:30 gibba013 bash[29418]: cluster 2021-03-10T16:57:28.509765+0000 mgr.gibba020.yqfnwy (mgr.34427) 9731 : cluster [DBG] pgmap v5542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:30.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:30 gibba013 bash[30381]: cluster 2021-03-10T16:57:28.509765+0000 mgr.gibba020.yqfnwy (mgr.34427) 9731 : cluster [DBG] pgmap v5542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:30.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:30 gibba020 bash[25448]: cluster 2021-03-10T16:57:28.509765+0000 mgr.gibba020.yqfnwy (mgr.34427) 9731 : cluster [DBG] pgmap v5542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:31.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:31 gibba013 bash[29418]: cephadm 2021-03-10T16:57:29.841649+0000 mgr.gibba020.yqfnwy (mgr.34427) 9732 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:57:31.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:31 gibba013 bash[30381]: cephadm 2021-03-10T16:57:29.841649+0000 mgr.gibba020.yqfnwy (mgr.34427) 9732 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:57:31.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:31 gibba020 bash[25448]: cephadm 2021-03-10T16:57:29.841649+0000 mgr.gibba020.yqfnwy (mgr.34427) 9732 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:57:32.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:32 gibba013 bash[29418]: cluster 2021-03-10T16:57:30.511528+0000 mgr.gibba020.yqfnwy (mgr.34427) 9733 : cluster [DBG] pgmap v5543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:32.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:32 gibba013 bash[30381]: cluster 2021-03-10T16:57:30.511528+0000 mgr.gibba020.yqfnwy (mgr.34427) 9733 : cluster [DBG] pgmap v5543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:32.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:32 gibba020 bash[25448]: cluster 2021-03-10T16:57:30.511528+0000 mgr.gibba020.yqfnwy (mgr.34427) 9733 : cluster [DBG] pgmap v5543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:34.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:34 gibba013 bash[29418]: cluster 2021-03-10T16:57:32.513066+0000 mgr.gibba020.yqfnwy (mgr.34427) 9734 : cluster [DBG] pgmap v5544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:34.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:34 gibba013 bash[30381]: cluster 2021-03-10T16:57:32.513066+0000 mgr.gibba020.yqfnwy (mgr.34427) 9734 : cluster [DBG] pgmap v5544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:34.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:34 gibba020 bash[25448]: cluster 2021-03-10T16:57:32.513066+0000 mgr.gibba020.yqfnwy (mgr.34427) 9734 : cluster [DBG] pgmap v5544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:36.628 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:36 gibba013 bash[30381]: cluster 2021-03-10T16:57:34.514330+0000 mgr.gibba020.yqfnwy (mgr.34427) 9735 : cluster [DBG] pgmap v5545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:36.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:36 gibba013 bash[29418]: cluster 2021-03-10T16:57:34.514330+0000 mgr.gibba020.yqfnwy (mgr.34427) 9735 : cluster [DBG] pgmap v5545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:36.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:36 gibba020 bash[25448]: cluster 2021-03-10T16:57:34.514330+0000 mgr.gibba020.yqfnwy (mgr.34427) 9735 : cluster [DBG] pgmap v5545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:38.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:38 gibba013 bash[29418]: cluster 2021-03-10T16:57:36.516386+0000 mgr.gibba020.yqfnwy (mgr.34427) 9736 : cluster [DBG] pgmap v5546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:38.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:38 gibba013 bash[30381]: cluster 2021-03-10T16:57:36.516386+0000 mgr.gibba020.yqfnwy (mgr.34427) 9736 : cluster [DBG] pgmap v5546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:38.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:38 gibba020 bash[25448]: cluster 2021-03-10T16:57:36.516386+0000 mgr.gibba020.yqfnwy (mgr.34427) 9736 : cluster [DBG] pgmap v5546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:40.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:40 gibba013 bash[29418]: cluster 2021-03-10T16:57:38.517764+0000 mgr.gibba020.yqfnwy (mgr.34427) 9737 : cluster [DBG] pgmap v5547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:40.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:40 gibba013 bash[30381]: cluster 2021-03-10T16:57:38.517764+0000 mgr.gibba020.yqfnwy (mgr.34427) 9737 : cluster [DBG] pgmap v5547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:40.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:40 gibba020 bash[25448]: cluster 2021-03-10T16:57:38.517764+0000 mgr.gibba020.yqfnwy (mgr.34427) 9737 : cluster [DBG] pgmap v5547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:42.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:42 gibba013 bash[29418]: cluster 2021-03-10T16:57:40.519420+0000 mgr.gibba020.yqfnwy (mgr.34427) 9738 : cluster [DBG] pgmap v5548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:42.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:42 gibba013 bash[30381]: cluster 2021-03-10T16:57:40.519420+0000 mgr.gibba020.yqfnwy (mgr.34427) 9738 : cluster [DBG] pgmap v5548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:42.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:42 gibba020 bash[25448]: cluster 2021-03-10T16:57:40.519420+0000 mgr.gibba020.yqfnwy (mgr.34427) 9738 : cluster [DBG] pgmap v5548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:43.293 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:57:43.521 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:57:43.522 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 6m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:57:43.522 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 5m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:57:43.522 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:57:43.523 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:57:43.523 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:57:43.523 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:57:43.523 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:57:43.523 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:57:43.524 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:57:43.524 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:57:43.524 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:57:43.524 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:57:43.525 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:57:43.525 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:57:43.525 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:57:43.525 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:57:43.525 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:57:43.526 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:57:43.526 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 5m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:57:43.526 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 5m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:57:43.770 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:57:43.771 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:57:43.771 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:57:43.771 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:57:43.772 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:57:43.772 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:57:43.772 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:57:43.772 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:57:43.772 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:57:43.773 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:57:43.773 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:57:43.773 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:57:43.773 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:57:43.774 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:57:43.774 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:57:44.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:44 gibba013 bash[29418]: cluster 2021-03-10T16:57:42.520881+0000 mgr.gibba020.yqfnwy (mgr.34427) 9739 : cluster [DBG] pgmap v5549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:44.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:44 gibba013 bash[29418]: audit 2021-03-10T16:57:43.284220+0000 mgr.gibba020.yqfnwy (mgr.34427) 9740 : audit [DBG] from='client.50586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:57:44.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:44 gibba013 bash[29418]: audit 2021-03-10T16:57:43.770951+0000 mon.c (mon.1) 149 : audit [DBG] from='client.? 172.21.2.113:0/641354726' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:44.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:44 gibba013 bash[30381]: cluster 2021-03-10T16:57:42.520881+0000 mgr.gibba020.yqfnwy (mgr.34427) 9739 : cluster [DBG] pgmap v5549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:44.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:44 gibba013 bash[30381]: audit 2021-03-10T16:57:43.284220+0000 mgr.gibba020.yqfnwy (mgr.34427) 9740 : audit [DBG] from='client.50586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:57:44.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:44 gibba013 bash[30381]: audit 2021-03-10T16:57:43.770951+0000 mon.c (mon.1) 149 : audit [DBG] from='client.? 172.21.2.113:0/641354726' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:44.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:44 gibba020 bash[25448]: cluster 2021-03-10T16:57:42.520881+0000 mgr.gibba020.yqfnwy (mgr.34427) 9739 : cluster [DBG] pgmap v5549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:44.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:44 gibba020 bash[25448]: audit 2021-03-10T16:57:43.284220+0000 mgr.gibba020.yqfnwy (mgr.34427) 9740 : audit [DBG] from='client.50586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:57:44.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:44 gibba020 bash[25448]: audit 2021-03-10T16:57:43.770951+0000 mon.c (mon.1) 149 : audit [DBG] from='client.? 172.21.2.113:0/641354726' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:57:45.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:45 gibba013 bash[29418]: audit 2021-03-10T16:57:43.508338+0000 mgr.gibba020.yqfnwy (mgr.34427) 9741 : audit [DBG] from='client.60571 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:57:45.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:45 gibba013 bash[30381]: audit 2021-03-10T16:57:43.508338+0000 mgr.gibba020.yqfnwy (mgr.34427) 9741 : audit [DBG] from='client.60571 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:57:45.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:45 gibba020 bash[25448]: audit 2021-03-10T16:57:43.508338+0000 mgr.gibba020.yqfnwy (mgr.34427) 9741 : audit [DBG] from='client.60571 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:57:46.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:46 gibba013 bash[29418]: cluster 2021-03-10T16:57:44.522423+0000 mgr.gibba020.yqfnwy (mgr.34427) 9742 : cluster [DBG] pgmap v5550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:46.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:46 gibba013 bash[29418]: cephadm 2021-03-10T16:57:44.844930+0000 mgr.gibba020.yqfnwy (mgr.34427) 9743 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:57:46.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:46 gibba013 bash[30381]: cluster 2021-03-10T16:57:44.522423+0000 mgr.gibba020.yqfnwy (mgr.34427) 9742 : cluster [DBG] pgmap v5550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:46.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:46 gibba013 bash[30381]: cephadm 2021-03-10T16:57:44.844930+0000 mgr.gibba020.yqfnwy (mgr.34427) 9743 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:57:46.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:46 gibba020 bash[25448]: cluster 2021-03-10T16:57:44.522423+0000 mgr.gibba020.yqfnwy (mgr.34427) 9742 : cluster [DBG] pgmap v5550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:46.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:46 gibba020 bash[25448]: cephadm 2021-03-10T16:57:44.844930+0000 mgr.gibba020.yqfnwy (mgr.34427) 9743 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:57:48.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:48 gibba013 bash[29418]: cluster 2021-03-10T16:57:46.524183+0000 mgr.gibba020.yqfnwy (mgr.34427) 9744 : cluster [DBG] pgmap v5551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:48.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:48 gibba013 bash[30381]: cluster 2021-03-10T16:57:46.524183+0000 mgr.gibba020.yqfnwy (mgr.34427) 9744 : cluster [DBG] pgmap v5551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:48.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:48 gibba020 bash[25448]: cluster 2021-03-10T16:57:46.524183+0000 mgr.gibba020.yqfnwy (mgr.34427) 9744 : cluster [DBG] pgmap v5551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:50.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:50 gibba013 bash[29418]: cluster 2021-03-10T16:57:48.525565+0000 mgr.gibba020.yqfnwy (mgr.34427) 9745 : cluster [DBG] pgmap v5552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:50.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:50 gibba013 bash[30381]: cluster 2021-03-10T16:57:48.525565+0000 mgr.gibba020.yqfnwy (mgr.34427) 9745 : cluster [DBG] pgmap v5552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:50.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:50 gibba020 bash[25448]: cluster 2021-03-10T16:57:48.525565+0000 mgr.gibba020.yqfnwy (mgr.34427) 9745 : cluster [DBG] pgmap v5552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:52.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:52 gibba013 bash[29418]: cluster 2021-03-10T16:57:50.527251+0000 mgr.gibba020.yqfnwy (mgr.34427) 9746 : cluster [DBG] pgmap v5553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:52.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:52 gibba013 bash[30381]: cluster 2021-03-10T16:57:50.527251+0000 mgr.gibba020.yqfnwy (mgr.34427) 9746 : cluster [DBG] pgmap v5553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:52.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:52 gibba020 bash[25448]: cluster 2021-03-10T16:57:50.527251+0000 mgr.gibba020.yqfnwy (mgr.34427) 9746 : cluster [DBG] pgmap v5553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:54.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:54 gibba013 bash[29418]: cluster 2021-03-10T16:57:52.528816+0000 mgr.gibba020.yqfnwy (mgr.34427) 9747 : cluster [DBG] pgmap v5554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:54.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:54 gibba013 bash[30381]: cluster 2021-03-10T16:57:52.528816+0000 mgr.gibba020.yqfnwy (mgr.34427) 9747 : cluster [DBG] pgmap v5554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:54.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:54 gibba020 bash[25448]: cluster 2021-03-10T16:57:52.528816+0000 mgr.gibba020.yqfnwy (mgr.34427) 9747 : cluster [DBG] pgmap v5554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:56.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:56 gibba013 bash[29418]: cluster 2021-03-10T16:57:54.530310+0000 mgr.gibba020.yqfnwy (mgr.34427) 9748 : cluster [DBG] pgmap v5555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:56.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:56 gibba013 bash[30381]: cluster 2021-03-10T16:57:54.530310+0000 mgr.gibba020.yqfnwy (mgr.34427) 9748 : cluster [DBG] pgmap v5555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:56.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:56 gibba020 bash[25448]: cluster 2021-03-10T16:57:54.530310+0000 mgr.gibba020.yqfnwy (mgr.34427) 9748 : cluster [DBG] pgmap v5555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:58.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:57:58 gibba013 bash[29418]: cluster 2021-03-10T16:57:56.532101+0000 mgr.gibba020.yqfnwy (mgr.34427) 9749 : cluster [DBG] pgmap v5556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:58.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:57:58 gibba013 bash[30381]: cluster 2021-03-10T16:57:56.532101+0000 mgr.gibba020.yqfnwy (mgr.34427) 9749 : cluster [DBG] pgmap v5556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:57:58.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:57:58 gibba020 bash[25448]: cluster 2021-03-10T16:57:56.532101+0000 mgr.gibba020.yqfnwy (mgr.34427) 9749 : cluster [DBG] pgmap v5556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:00.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:00 gibba013 bash[29418]: cluster 2021-03-10T16:57:58.533514+0000 mgr.gibba020.yqfnwy (mgr.34427) 9750 : cluster [DBG] pgmap v5557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:00.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:00 gibba013 bash[30381]: cluster 2021-03-10T16:57:58.533514+0000 mgr.gibba020.yqfnwy (mgr.34427) 9750 : cluster [DBG] pgmap v5557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:00.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:00 gibba020 bash[25448]: cluster 2021-03-10T16:57:58.533514+0000 mgr.gibba020.yqfnwy (mgr.34427) 9750 : cluster [DBG] pgmap v5557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:01.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:01 gibba013 bash[29418]: cephadm 2021-03-10T16:57:59.860936+0000 mgr.gibba020.yqfnwy (mgr.34427) 9751 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:58:01.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:01 gibba013 bash[30381]: cephadm 2021-03-10T16:57:59.860936+0000 mgr.gibba020.yqfnwy (mgr.34427) 9751 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:58:01.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:01 gibba020 bash[25448]: cephadm 2021-03-10T16:57:59.860936+0000 mgr.gibba020.yqfnwy (mgr.34427) 9751 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:58:02.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:02 gibba013 bash[29418]: cluster 2021-03-10T16:58:00.535202+0000 mgr.gibba020.yqfnwy (mgr.34427) 9752 : cluster [DBG] pgmap v5558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:02.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:02 gibba013 bash[30381]: cluster 2021-03-10T16:58:00.535202+0000 mgr.gibba020.yqfnwy (mgr.34427) 9752 : cluster [DBG] pgmap v5558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:02.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:02 gibba020 bash[25448]: cluster 2021-03-10T16:58:00.535202+0000 mgr.gibba020.yqfnwy (mgr.34427) 9752 : cluster [DBG] pgmap v5558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:03.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:03 gibba020 bash[25448]: cluster 2021-03-10T16:58:02.536847+0000 mgr.gibba020.yqfnwy (mgr.34427) 9753 : cluster [DBG] pgmap v5559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:03.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:03 gibba013 bash[29418]: cluster 2021-03-10T16:58:02.536847+0000 mgr.gibba020.yqfnwy (mgr.34427) 9753 : cluster [DBG] pgmap v5559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:03.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:03 gibba013 bash[30381]: cluster 2021-03-10T16:58:02.536847+0000 mgr.gibba020.yqfnwy (mgr.34427) 9753 : cluster [DBG] pgmap v5559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:06.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:06 gibba020 bash[25448]: cluster 2021-03-10T16:58:04.538403+0000 mgr.gibba020.yqfnwy (mgr.34427) 9754 : cluster [DBG] pgmap v5560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:06.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:06 gibba013 bash[29418]: cluster 2021-03-10T16:58:04.538403+0000 mgr.gibba020.yqfnwy (mgr.34427) 9754 : cluster [DBG] pgmap v5560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:06.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:06 gibba013 bash[30381]: cluster 2021-03-10T16:58:04.538403+0000 mgr.gibba020.yqfnwy (mgr.34427) 9754 : cluster [DBG] pgmap v5560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:07.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:07 gibba020 bash[25448]: audit 2021-03-10T16:58:06.850485+0000 mon.a (mon.0) 3503 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:58:07.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:07 gibba020 bash[25448]: audit 2021-03-10T16:58:07.040946+0000 mon.a (mon.0) 3504 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:58:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:07 gibba013 bash[29418]: audit 2021-03-10T16:58:06.850485+0000 mon.a (mon.0) 3503 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:58:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:07 gibba013 bash[29418]: audit 2021-03-10T16:58:07.040946+0000 mon.a (mon.0) 3504 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:58:07.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:07 gibba013 bash[30381]: audit 2021-03-10T16:58:06.850485+0000 mon.a (mon.0) 3503 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:58:07.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:07 gibba013 bash[30381]: audit 2021-03-10T16:58:07.040946+0000 mon.a (mon.0) 3504 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:58:08.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:08 gibba020 bash[25448]: cluster 2021-03-10T16:58:06.540092+0000 mgr.gibba020.yqfnwy (mgr.34427) 9755 : cluster [DBG] pgmap v5561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:08.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:08 gibba020 bash[25448]: audit 2021-03-10T16:58:07.436573+0000 mon.a (mon.0) 3505 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T16:58:08.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:08 gibba020 bash[25448]: audit 2021-03-10T16:58:07.437291+0000 mon.a (mon.0) 3506 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:58:08.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:08 gibba020 bash[25448]: audit 2021-03-10T16:58:07.438009+0000 mon.a (mon.0) 3507 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:58:08.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:08 gibba020 bash[25448]: audit 2021-03-10T16:58:07.438675+0000 mon.a (mon.0) 3508 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:58:08.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:08 gibba013 bash[29418]: cluster 2021-03-10T16:58:06.540092+0000 mgr.gibba020.yqfnwy (mgr.34427) 9755 : cluster [DBG] pgmap v5561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:08.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:08 gibba013 bash[29418]: audit 2021-03-10T16:58:07.436573+0000 mon.a (mon.0) 3505 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T16:58:08.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:08 gibba013 bash[29418]: audit 2021-03-10T16:58:07.437291+0000 mon.a (mon.0) 3506 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:58:08.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:08 gibba013 bash[29418]: audit 2021-03-10T16:58:07.438009+0000 mon.a (mon.0) 3507 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:58:08.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:08 gibba013 bash[29418]: audit 2021-03-10T16:58:07.438675+0000 mon.a (mon.0) 3508 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:58:08.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:08 gibba013 bash[30381]: cluster 2021-03-10T16:58:06.540092+0000 mgr.gibba020.yqfnwy (mgr.34427) 9755 : cluster [DBG] pgmap v5561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:08.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:08 gibba013 bash[30381]: audit 2021-03-10T16:58:07.436573+0000 mon.a (mon.0) 3505 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T16:58:08.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:08 gibba013 bash[30381]: audit 2021-03-10T16:58:07.437291+0000 mon.a (mon.0) 3506 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T16:58:08.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:08 gibba013 bash[30381]: audit 2021-03-10T16:58:07.438009+0000 mon.a (mon.0) 3507 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T16:58:08.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:08 gibba013 bash[30381]: audit 2021-03-10T16:58:07.438675+0000 mon.a (mon.0) 3508 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T16:58:10.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:10 gibba020 bash[25448]: cluster 2021-03-10T16:58:08.541467+0000 mgr.gibba020.yqfnwy (mgr.34427) 9756 : cluster [DBG] pgmap v5562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:10.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:10 gibba013 bash[29418]: cluster 2021-03-10T16:58:08.541467+0000 mgr.gibba020.yqfnwy (mgr.34427) 9756 : cluster [DBG] pgmap v5562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:10.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:10 gibba013 bash[30381]: cluster 2021-03-10T16:58:08.541467+0000 mgr.gibba020.yqfnwy (mgr.34427) 9756 : cluster [DBG] pgmap v5562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:12.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:12 gibba020 bash[25448]: cluster 2021-03-10T16:58:10.543031+0000 mgr.gibba020.yqfnwy (mgr.34427) 9757 : cluster [DBG] pgmap v5563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:12.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:12 gibba013 bash[29418]: cluster 2021-03-10T16:58:10.543031+0000 mgr.gibba020.yqfnwy (mgr.34427) 9757 : cluster [DBG] pgmap v5563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:12.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:12 gibba013 bash[30381]: cluster 2021-03-10T16:58:10.543031+0000 mgr.gibba020.yqfnwy (mgr.34427) 9757 : cluster [DBG] pgmap v5563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:14.014 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:58:14.240 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:58:14.241 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 7m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:58:14.241 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 6m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:58:14.241 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:58:14.241 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:58:14.242 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:58:14.242 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:58:14.242 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:58:14.242 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:58:14.243 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:58:14.243 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:58:14.243 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:58:14.243 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:58:14.243 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:58:14.244 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:58:14.244 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:58:14.244 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:58:14.244 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:58:14.245 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (2h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:58:14.245 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 6m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:58:14.245 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 6m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:58:14.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:14 gibba020 bash[25448]: cluster 2021-03-10T16:58:12.544461+0000 mgr.gibba020.yqfnwy (mgr.34427) 9758 : cluster [DBG] pgmap v5564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:14.493 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:58:14.493 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:58:14.493 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:58:14.493 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:58:14.494 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:58:14.494 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:58:14.494 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:58:14.494 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:58:14.495 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:58:14.495 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:58:14.495 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:58:14.495 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:58:14.496 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:58:14.496 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:58:14.496 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:58:14.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:14 gibba013 bash[29418]: cluster 2021-03-10T16:58:12.544461+0000 mgr.gibba020.yqfnwy (mgr.34427) 9758 : cluster [DBG] pgmap v5564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:14.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:14 gibba013 bash[30381]: cluster 2021-03-10T16:58:12.544461+0000 mgr.gibba020.yqfnwy (mgr.34427) 9758 : cluster [DBG] pgmap v5564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:15.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:15 gibba020 bash[25448]: audit 2021-03-10T16:58:14.004768+0000 mgr.gibba020.yqfnwy (mgr.34427) 9759 : audit [DBG] from='client.60583 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:58:15.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:15 gibba020 bash[25448]: audit 2021-03-10T16:58:14.228521+0000 mgr.gibba020.yqfnwy (mgr.34427) 9760 : audit [DBG] from='client.50610 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:58:15.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:15 gibba020 bash[25448]: audit 2021-03-10T16:58:14.492916+0000 mon.a (mon.0) 3509 : audit [DBG] from='client.? 172.21.2.113:0/1066286673' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:15.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:15 gibba020 bash[25448]: audit 2021-03-10T16:58:14.870649+0000 mon.a (mon.0) 3510 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:58:15.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:15 gibba020 bash[25448]: audit 2021-03-10T16:58:15.073859+0000 mon.a (mon.0) 3511 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:58:15.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:15 gibba020 bash[25448]: audit 2021-03-10T16:58:15.079400+0000 mon.a (mon.0) 3512 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:58:15.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:15 gibba013 bash[29418]: audit 2021-03-10T16:58:14.004768+0000 mgr.gibba020.yqfnwy (mgr.34427) 9759 : audit [DBG] from='client.60583 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:58:15.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:15 gibba013 bash[29418]: audit 2021-03-10T16:58:14.228521+0000 mgr.gibba020.yqfnwy (mgr.34427) 9760 : audit [DBG] from='client.50610 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:58:15.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:15 gibba013 bash[29418]: audit 2021-03-10T16:58:14.492916+0000 mon.a (mon.0) 3509 : audit [DBG] from='client.? 172.21.2.113:0/1066286673' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:15.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:15 gibba013 bash[29418]: audit 2021-03-10T16:58:14.870649+0000 mon.a (mon.0) 3510 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:58:15.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:15 gibba013 bash[29418]: audit 2021-03-10T16:58:15.073859+0000 mon.a (mon.0) 3511 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:58:15.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:15 gibba013 bash[29418]: audit 2021-03-10T16:58:15.079400+0000 mon.a (mon.0) 3512 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:58:15.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:15 gibba013 bash[30381]: audit 2021-03-10T16:58:14.004768+0000 mgr.gibba020.yqfnwy (mgr.34427) 9759 : audit [DBG] from='client.60583 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:58:15.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:15 gibba013 bash[30381]: audit 2021-03-10T16:58:14.228521+0000 mgr.gibba020.yqfnwy (mgr.34427) 9760 : audit [DBG] from='client.50610 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:58:15.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:15 gibba013 bash[30381]: audit 2021-03-10T16:58:14.492916+0000 mon.a (mon.0) 3509 : audit [DBG] from='client.? 172.21.2.113:0/1066286673' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:15.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:15 gibba013 bash[30381]: audit 2021-03-10T16:58:14.870649+0000 mon.a (mon.0) 3510 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:58:15.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:15 gibba013 bash[30381]: audit 2021-03-10T16:58:15.073859+0000 mon.a (mon.0) 3511 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:58:15.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:15 gibba013 bash[30381]: audit 2021-03-10T16:58:15.079400+0000 mon.a (mon.0) 3512 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:58:16.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[29418]: cluster 2021-03-10T16:58:14.545880+0000 mgr.gibba020.yqfnwy (mgr.34427) 9761 : cluster [DBG] pgmap v5565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:16.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[29418]: cephadm 2021-03-10T16:58:15.073902+0000 mgr.gibba020.yqfnwy (mgr.34427) 9762 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:58:16.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[29418]: cephadm 2021-03-10T16:58:15.079447+0000 mgr.gibba020.yqfnwy (mgr.34427) 9763 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:58:16.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[29418]: audit 2021-03-10T16:58:15.284568+0000 mon.a (mon.0) 3513 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:58:16.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[29418]: cephadm 2021-03-10T16:58:15.286536+0000 mgr.gibba020.yqfnwy (mgr.34427) 9764 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:58:16.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[29418]: audit 2021-03-10T16:58:15.287953+0000 mon.a (mon.0) 3514 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:58:16.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[29418]: cephadm 2021-03-10T16:58:15.288548+0000 mgr.gibba020.yqfnwy (mgr.34427) 9765 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:58:16.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[29418]: audit 2021-03-10T16:58:15.289629+0000 mon.a (mon.0) 3515 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:16.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[29418]: cephadm 2021-03-10T16:58:15.290098+0000 mgr.gibba020.yqfnwy (mgr.34427) 9766 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:58:16.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[29418]: cephadm 2021-03-10T16:58:15.290137+0000 mgr.gibba020.yqfnwy (mgr.34427) 9767 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:58:16.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[29418]: audit 2021-03-10T16:58:15.291195+0000 mon.a (mon.0) 3516 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:16.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[29418]: cephadm 2021-03-10T16:58:15.291609+0000 mgr.gibba020.yqfnwy (mgr.34427) 9768 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:58:16.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[29418]: cephadm 2021-03-10T16:58:15.291648+0000 mgr.gibba020.yqfnwy (mgr.34427) 9769 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:58:16.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[29418]: audit 2021-03-10T16:58:15.292656+0000 mon.a (mon.0) 3517 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:16.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[29418]: cephadm 2021-03-10T16:58:15.293069+0000 mgr.gibba020.yqfnwy (mgr.34427) 9770 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:58:16.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[29418]: cephadm 2021-03-10T16:58:15.294501+0000 mgr.gibba020.yqfnwy (mgr.34427) 9771 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:58:16.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[29418]: cephadm 2021-03-10T16:58:15.294542+0000 mgr.gibba020.yqfnwy (mgr.34427) 9772 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:58:16.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[29418]: audit 2021-03-10T16:58:15.295663+0000 mon.a (mon.0) 3518 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:16.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[29418]: cephadm 2021-03-10T16:58:15.296025+0000 mgr.gibba020.yqfnwy (mgr.34427) 9773 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:58:16.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[29418]: cephadm 2021-03-10T16:58:15.296363+0000 mgr.gibba020.yqfnwy (mgr.34427) 9774 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:58:16.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[30381]: cluster 2021-03-10T16:58:14.545880+0000 mgr.gibba020.yqfnwy (mgr.34427) 9761 : cluster [DBG] pgmap v5565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:16.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[30381]: cephadm 2021-03-10T16:58:15.073902+0000 mgr.gibba020.yqfnwy (mgr.34427) 9762 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:58:16.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[30381]: cephadm 2021-03-10T16:58:15.079447+0000 mgr.gibba020.yqfnwy (mgr.34427) 9763 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:58:16.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[30381]: audit 2021-03-10T16:58:15.284568+0000 mon.a (mon.0) 3513 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:58:16.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[30381]: cephadm 2021-03-10T16:58:15.286536+0000 mgr.gibba020.yqfnwy (mgr.34427) 9764 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:58:16.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[30381]: audit 2021-03-10T16:58:15.287953+0000 mon.a (mon.0) 3514 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:58:16.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[30381]: cephadm 2021-03-10T16:58:15.288548+0000 mgr.gibba020.yqfnwy (mgr.34427) 9765 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:58:16.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[30381]: audit 2021-03-10T16:58:15.289629+0000 mon.a (mon.0) 3515 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:16.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[30381]: cephadm 2021-03-10T16:58:15.290098+0000 mgr.gibba020.yqfnwy (mgr.34427) 9766 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:58:16.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[30381]: cephadm 2021-03-10T16:58:15.290137+0000 mgr.gibba020.yqfnwy (mgr.34427) 9767 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:58:16.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[30381]: audit 2021-03-10T16:58:15.291195+0000 mon.a (mon.0) 3516 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:16.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[30381]: cephadm 2021-03-10T16:58:15.291609+0000 mgr.gibba020.yqfnwy (mgr.34427) 9768 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:58:16.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[30381]: cephadm 2021-03-10T16:58:15.291648+0000 mgr.gibba020.yqfnwy (mgr.34427) 9769 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:58:16.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[30381]: audit 2021-03-10T16:58:15.292656+0000 mon.a (mon.0) 3517 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:16.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[30381]: cephadm 2021-03-10T16:58:15.293069+0000 mgr.gibba020.yqfnwy (mgr.34427) 9770 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:58:16.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[30381]: cephadm 2021-03-10T16:58:15.294501+0000 mgr.gibba020.yqfnwy (mgr.34427) 9771 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:58:16.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[30381]: cephadm 2021-03-10T16:58:15.294542+0000 mgr.gibba020.yqfnwy (mgr.34427) 9772 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:58:16.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[30381]: audit 2021-03-10T16:58:15.295663+0000 mon.a (mon.0) 3518 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:16.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[30381]: cephadm 2021-03-10T16:58:15.296025+0000 mgr.gibba020.yqfnwy (mgr.34427) 9773 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:58:16.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[30381]: cephadm 2021-03-10T16:58:15.296363+0000 mgr.gibba020.yqfnwy (mgr.34427) 9774 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:58:16.639 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[29418]: audit 2021-03-10T16:58:15.297349+0000 mon.a (mon.0) 3519 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:16.639 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[29418]: cephadm 2021-03-10T16:58:15.297824+0000 mgr.gibba020.yqfnwy (mgr.34427) 9775 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:58:16.640 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[29418]: cephadm 2021-03-10T16:58:15.297866+0000 mgr.gibba020.yqfnwy (mgr.34427) 9776 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:58:16.640 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[29418]: cephadm 2021-03-10T16:58:15.297977+0000 mgr.gibba020.yqfnwy (mgr.34427) 9777 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:58:16.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[30381]: audit 2021-03-10T16:58:15.297349+0000 mon.a (mon.0) 3519 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:16.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[30381]: cephadm 2021-03-10T16:58:15.297824+0000 mgr.gibba020.yqfnwy (mgr.34427) 9775 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:58:16.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[30381]: cephadm 2021-03-10T16:58:15.297866+0000 mgr.gibba020.yqfnwy (mgr.34427) 9776 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:58:16.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:16 gibba013 bash[30381]: cephadm 2021-03-10T16:58:15.297977+0000 mgr.gibba020.yqfnwy (mgr.34427) 9777 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:58:16.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:16 gibba020 bash[25448]: cluster 2021-03-10T16:58:14.545880+0000 mgr.gibba020.yqfnwy (mgr.34427) 9761 : cluster [DBG] pgmap v5565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:16.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:16 gibba020 bash[25448]: cephadm 2021-03-10T16:58:15.073902+0000 mgr.gibba020.yqfnwy (mgr.34427) 9762 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:58:16.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:16 gibba020 bash[25448]: cephadm 2021-03-10T16:58:15.079447+0000 mgr.gibba020.yqfnwy (mgr.34427) 9763 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:58:16.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:16 gibba020 bash[25448]: audit 2021-03-10T16:58:15.284568+0000 mon.a (mon.0) 3513 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:58:16.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:16 gibba020 bash[25448]: cephadm 2021-03-10T16:58:15.286536+0000 mgr.gibba020.yqfnwy (mgr.34427) 9764 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:58:16.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:16 gibba020 bash[25448]: audit 2021-03-10T16:58:15.287953+0000 mon.a (mon.0) 3514 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:58:16.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:16 gibba020 bash[25448]: cephadm 2021-03-10T16:58:15.288548+0000 mgr.gibba020.yqfnwy (mgr.34427) 9765 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:58:16.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:16 gibba020 bash[25448]: audit 2021-03-10T16:58:15.289629+0000 mon.a (mon.0) 3515 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:16.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:16 gibba020 bash[25448]: cephadm 2021-03-10T16:58:15.290098+0000 mgr.gibba020.yqfnwy (mgr.34427) 9766 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:58:16.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:16 gibba020 bash[25448]: cephadm 2021-03-10T16:58:15.290137+0000 mgr.gibba020.yqfnwy (mgr.34427) 9767 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:58:16.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:16 gibba020 bash[25448]: audit 2021-03-10T16:58:15.291195+0000 mon.a (mon.0) 3516 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:16.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:16 gibba020 bash[25448]: cephadm 2021-03-10T16:58:15.291609+0000 mgr.gibba020.yqfnwy (mgr.34427) 9768 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:58:16.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:16 gibba020 bash[25448]: cephadm 2021-03-10T16:58:15.291648+0000 mgr.gibba020.yqfnwy (mgr.34427) 9769 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:58:16.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:16 gibba020 bash[25448]: audit 2021-03-10T16:58:15.292656+0000 mon.a (mon.0) 3517 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:16.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:16 gibba020 bash[25448]: cephadm 2021-03-10T16:58:15.293069+0000 mgr.gibba020.yqfnwy (mgr.34427) 9770 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:58:16.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:16 gibba020 bash[25448]: cephadm 2021-03-10T16:58:15.294501+0000 mgr.gibba020.yqfnwy (mgr.34427) 9771 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:58:16.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:16 gibba020 bash[25448]: cephadm 2021-03-10T16:58:15.294542+0000 mgr.gibba020.yqfnwy (mgr.34427) 9772 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:58:16.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:16 gibba020 bash[25448]: audit 2021-03-10T16:58:15.295663+0000 mon.a (mon.0) 3518 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:16.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:16 gibba020 bash[25448]: cephadm 2021-03-10T16:58:15.296025+0000 mgr.gibba020.yqfnwy (mgr.34427) 9773 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:58:16.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:16 gibba020 bash[25448]: cephadm 2021-03-10T16:58:15.296363+0000 mgr.gibba020.yqfnwy (mgr.34427) 9774 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:58:16.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:16 gibba020 bash[25448]: audit 2021-03-10T16:58:15.297349+0000 mon.a (mon.0) 3519 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:16.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:16 gibba020 bash[25448]: cephadm 2021-03-10T16:58:15.297824+0000 mgr.gibba020.yqfnwy (mgr.34427) 9775 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:58:16.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:16 gibba020 bash[25448]: cephadm 2021-03-10T16:58:15.297866+0000 mgr.gibba020.yqfnwy (mgr.34427) 9776 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:58:16.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:16 gibba020 bash[25448]: cephadm 2021-03-10T16:58:15.297977+0000 mgr.gibba020.yqfnwy (mgr.34427) 9777 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:58:18.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:18 gibba013 bash[29418]: cluster 2021-03-10T16:58:16.547594+0000 mgr.gibba020.yqfnwy (mgr.34427) 9778 : cluster [DBG] pgmap v5566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:18.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:18 gibba013 bash[30381]: cluster 2021-03-10T16:58:16.547594+0000 mgr.gibba020.yqfnwy (mgr.34427) 9778 : cluster [DBG] pgmap v5566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:18.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:18 gibba020 bash[25448]: cluster 2021-03-10T16:58:16.547594+0000 mgr.gibba020.yqfnwy (mgr.34427) 9778 : cluster [DBG] pgmap v5566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:20.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:20 gibba013 bash[29418]: cluster 2021-03-10T16:58:18.549005+0000 mgr.gibba020.yqfnwy (mgr.34427) 9779 : cluster [DBG] pgmap v5567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:20.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:20 gibba013 bash[30381]: cluster 2021-03-10T16:58:18.549005+0000 mgr.gibba020.yqfnwy (mgr.34427) 9779 : cluster [DBG] pgmap v5567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:20.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:20 gibba020 bash[25448]: cluster 2021-03-10T16:58:18.549005+0000 mgr.gibba020.yqfnwy (mgr.34427) 9779 : cluster [DBG] pgmap v5567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:22.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:22 gibba013 bash[29418]: cluster 2021-03-10T16:58:20.550485+0000 mgr.gibba020.yqfnwy (mgr.34427) 9780 : cluster [DBG] pgmap v5568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:22.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:22 gibba013 bash[30381]: cluster 2021-03-10T16:58:20.550485+0000 mgr.gibba020.yqfnwy (mgr.34427) 9780 : cluster [DBG] pgmap v5568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:22.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:22 gibba020 bash[25448]: cluster 2021-03-10T16:58:20.550485+0000 mgr.gibba020.yqfnwy (mgr.34427) 9780 : cluster [DBG] pgmap v5568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:24.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:24 gibba013 bash[29418]: cluster 2021-03-10T16:58:22.551764+0000 mgr.gibba020.yqfnwy (mgr.34427) 9781 : cluster [DBG] pgmap v5569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:24.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:24 gibba013 bash[30381]: cluster 2021-03-10T16:58:22.551764+0000 mgr.gibba020.yqfnwy (mgr.34427) 9781 : cluster [DBG] pgmap v5569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:24.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:24 gibba020 bash[25448]: cluster 2021-03-10T16:58:22.551764+0000 mgr.gibba020.yqfnwy (mgr.34427) 9781 : cluster [DBG] pgmap v5569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:26.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:26 gibba013 bash[29418]: cluster 2021-03-10T16:58:24.553175+0000 mgr.gibba020.yqfnwy (mgr.34427) 9782 : cluster [DBG] pgmap v5570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:26.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:26 gibba013 bash[30381]: cluster 2021-03-10T16:58:24.553175+0000 mgr.gibba020.yqfnwy (mgr.34427) 9782 : cluster [DBG] pgmap v5570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:26.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:26 gibba020 bash[25448]: cluster 2021-03-10T16:58:24.553175+0000 mgr.gibba020.yqfnwy (mgr.34427) 9782 : cluster [DBG] pgmap v5570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:28.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:28 gibba013 bash[29418]: cluster 2021-03-10T16:58:26.555127+0000 mgr.gibba020.yqfnwy (mgr.34427) 9783 : cluster [DBG] pgmap v5571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:28.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:28 gibba013 bash[30381]: cluster 2021-03-10T16:58:26.555127+0000 mgr.gibba020.yqfnwy (mgr.34427) 9783 : cluster [DBG] pgmap v5571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:28.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:28 gibba020 bash[25448]: cluster 2021-03-10T16:58:26.555127+0000 mgr.gibba020.yqfnwy (mgr.34427) 9783 : cluster [DBG] pgmap v5571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:30.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:30 gibba013 bash[29418]: cluster 2021-03-10T16:58:28.556563+0000 mgr.gibba020.yqfnwy (mgr.34427) 9784 : cluster [DBG] pgmap v5572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:30.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:30 gibba013 bash[30381]: cluster 2021-03-10T16:58:28.556563+0000 mgr.gibba020.yqfnwy (mgr.34427) 9784 : cluster [DBG] pgmap v5572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:30.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:30 gibba020 bash[25448]: cluster 2021-03-10T16:58:28.556563+0000 mgr.gibba020.yqfnwy (mgr.34427) 9784 : cluster [DBG] pgmap v5572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:31.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:31 gibba013 bash[29418]: cephadm 2021-03-10T16:58:30.313787+0000 mgr.gibba020.yqfnwy (mgr.34427) 9785 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:58:31.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:31 gibba013 bash[30381]: cephadm 2021-03-10T16:58:30.313787+0000 mgr.gibba020.yqfnwy (mgr.34427) 9785 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:58:31.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:31 gibba020 bash[25448]: cephadm 2021-03-10T16:58:30.313787+0000 mgr.gibba020.yqfnwy (mgr.34427) 9785 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:58:32.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:32 gibba013 bash[29418]: cluster 2021-03-10T16:58:30.558004+0000 mgr.gibba020.yqfnwy (mgr.34427) 9786 : cluster [DBG] pgmap v5573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:32.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:32 gibba013 bash[30381]: cluster 2021-03-10T16:58:30.558004+0000 mgr.gibba020.yqfnwy (mgr.34427) 9786 : cluster [DBG] pgmap v5573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:32.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:32 gibba020 bash[25448]: cluster 2021-03-10T16:58:30.558004+0000 mgr.gibba020.yqfnwy (mgr.34427) 9786 : cluster [DBG] pgmap v5573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:34.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:34 gibba013 bash[29418]: cluster 2021-03-10T16:58:32.559522+0000 mgr.gibba020.yqfnwy (mgr.34427) 9787 : cluster [DBG] pgmap v5574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:34.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:34 gibba013 bash[30381]: cluster 2021-03-10T16:58:32.559522+0000 mgr.gibba020.yqfnwy (mgr.34427) 9787 : cluster [DBG] pgmap v5574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:34.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:34 gibba020 bash[25448]: cluster 2021-03-10T16:58:32.559522+0000 mgr.gibba020.yqfnwy (mgr.34427) 9787 : cluster [DBG] pgmap v5574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:36.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:36 gibba020 bash[25448]: cluster 2021-03-10T16:58:34.561097+0000 mgr.gibba020.yqfnwy (mgr.34427) 9788 : cluster [DBG] pgmap v5575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:36.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:36 gibba013 bash[29418]: cluster 2021-03-10T16:58:34.561097+0000 mgr.gibba020.yqfnwy (mgr.34427) 9788 : cluster [DBG] pgmap v5575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:36.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:36 gibba013 bash[30381]: cluster 2021-03-10T16:58:34.561097+0000 mgr.gibba020.yqfnwy (mgr.34427) 9788 : cluster [DBG] pgmap v5575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:38.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:38 gibba020 bash[25448]: cluster 2021-03-10T16:58:36.562539+0000 mgr.gibba020.yqfnwy (mgr.34427) 9789 : cluster [DBG] pgmap v5576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:38.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:38 gibba013 bash[29418]: cluster 2021-03-10T16:58:36.562539+0000 mgr.gibba020.yqfnwy (mgr.34427) 9789 : cluster [DBG] pgmap v5576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:38.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:38 gibba013 bash[30381]: cluster 2021-03-10T16:58:36.562539+0000 mgr.gibba020.yqfnwy (mgr.34427) 9789 : cluster [DBG] pgmap v5576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:40.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:40 gibba020 bash[25448]: cluster 2021-03-10T16:58:38.563874+0000 mgr.gibba020.yqfnwy (mgr.34427) 9790 : cluster [DBG] pgmap v5577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:40.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:40 gibba013 bash[29418]: cluster 2021-03-10T16:58:38.563874+0000 mgr.gibba020.yqfnwy (mgr.34427) 9790 : cluster [DBG] pgmap v5577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:40.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:40 gibba013 bash[30381]: cluster 2021-03-10T16:58:38.563874+0000 mgr.gibba020.yqfnwy (mgr.34427) 9790 : cluster [DBG] pgmap v5577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:42.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:42 gibba020 bash[25448]: cluster 2021-03-10T16:58:40.565341+0000 mgr.gibba020.yqfnwy (mgr.34427) 9791 : cluster [DBG] pgmap v5578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:42.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:42 gibba013 bash[29418]: cluster 2021-03-10T16:58:40.565341+0000 mgr.gibba020.yqfnwy (mgr.34427) 9791 : cluster [DBG] pgmap v5578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:42.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:42 gibba013 bash[30381]: cluster 2021-03-10T16:58:40.565341+0000 mgr.gibba020.yqfnwy (mgr.34427) 9791 : cluster [DBG] pgmap v5578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:44.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:44 gibba020 bash[25448]: cluster 2021-03-10T16:58:42.566850+0000 mgr.gibba020.yqfnwy (mgr.34427) 9792 : cluster [DBG] pgmap v5579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:44.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:44 gibba013 bash[29418]: cluster 2021-03-10T16:58:42.566850+0000 mgr.gibba020.yqfnwy (mgr.34427) 9792 : cluster [DBG] pgmap v5579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:44.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:44 gibba013 bash[30381]: cluster 2021-03-10T16:58:42.566850+0000 mgr.gibba020.yqfnwy (mgr.34427) 9792 : cluster [DBG] pgmap v5579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:44.736 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:58:44.965 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:58:44.965 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 7m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:58:44.966 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 6m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:58:44.966 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:58:44.967 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:58:44.967 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:58:44.967 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:58:44.967 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:58:44.968 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:58:44.968 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:58:44.968 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:58:44.968 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:58:44.969 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:58:44.969 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:58:44.969 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:58:44.969 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:58:44.969 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:58:44.970 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:58:44.970 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:58:44.970 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 6m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:58:44.971 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 6m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:58:45.215 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:58:45.216 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:58:45.216 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:58:45.216 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:58:45.217 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:58:45.217 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:58:45.217 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:58:45.217 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:58:45.218 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:58:45.218 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:58:45.218 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:58:45.218 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:58:45.218 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:58:45.219 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:58:45.219 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:58:46.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:46 gibba013 bash[29418]: cluster 2021-03-10T16:58:44.568181+0000 mgr.gibba020.yqfnwy (mgr.34427) 9793 : cluster [DBG] pgmap v5580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:46.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:46 gibba013 bash[29418]: audit 2021-03-10T16:58:44.726449+0000 mgr.gibba020.yqfnwy (mgr.34427) 9794 : audit [DBG] from='client.60601 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:58:46.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:46 gibba013 bash[29418]: audit 2021-03-10T16:58:44.952066+0000 mgr.gibba020.yqfnwy (mgr.34427) 9795 : audit [DBG] from='client.50628 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:58:46.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:46 gibba013 bash[29418]: audit 2021-03-10T16:58:45.215809+0000 mon.c (mon.1) 150 : audit [DBG] from='client.? 172.21.2.113:0/128999170' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:46.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:46 gibba013 bash[29418]: cephadm 2021-03-10T16:58:45.329829+0000 mgr.gibba020.yqfnwy (mgr.34427) 9796 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:58:46.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:46 gibba013 bash[30381]: cluster 2021-03-10T16:58:44.568181+0000 mgr.gibba020.yqfnwy (mgr.34427) 9793 : cluster [DBG] pgmap v5580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:46.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:46 gibba013 bash[30381]: audit 2021-03-10T16:58:44.726449+0000 mgr.gibba020.yqfnwy (mgr.34427) 9794 : audit [DBG] from='client.60601 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:58:46.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:46 gibba013 bash[30381]: audit 2021-03-10T16:58:44.952066+0000 mgr.gibba020.yqfnwy (mgr.34427) 9795 : audit [DBG] from='client.50628 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:58:46.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:46 gibba013 bash[30381]: audit 2021-03-10T16:58:45.215809+0000 mon.c (mon.1) 150 : audit [DBG] from='client.? 172.21.2.113:0/128999170' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:46.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:46 gibba013 bash[30381]: cephadm 2021-03-10T16:58:45.329829+0000 mgr.gibba020.yqfnwy (mgr.34427) 9796 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:58:46.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:46 gibba020 bash[25448]: cluster 2021-03-10T16:58:44.568181+0000 mgr.gibba020.yqfnwy (mgr.34427) 9793 : cluster [DBG] pgmap v5580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:46.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:46 gibba020 bash[25448]: audit 2021-03-10T16:58:44.726449+0000 mgr.gibba020.yqfnwy (mgr.34427) 9794 : audit [DBG] from='client.60601 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:58:46.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:46 gibba020 bash[25448]: audit 2021-03-10T16:58:44.952066+0000 mgr.gibba020.yqfnwy (mgr.34427) 9795 : audit [DBG] from='client.50628 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:58:46.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:46 gibba020 bash[25448]: audit 2021-03-10T16:58:45.215809+0000 mon.c (mon.1) 150 : audit [DBG] from='client.? 172.21.2.113:0/128999170' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:58:46.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:46 gibba020 bash[25448]: cephadm 2021-03-10T16:58:45.329829+0000 mgr.gibba020.yqfnwy (mgr.34427) 9796 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:58:48.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:48 gibba013 bash[29418]: cluster 2021-03-10T16:58:46.569931+0000 mgr.gibba020.yqfnwy (mgr.34427) 9797 : cluster [DBG] pgmap v5581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:48.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:48 gibba013 bash[30381]: cluster 2021-03-10T16:58:46.569931+0000 mgr.gibba020.yqfnwy (mgr.34427) 9797 : cluster [DBG] pgmap v5581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:48.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:48 gibba020 bash[25448]: cluster 2021-03-10T16:58:46.569931+0000 mgr.gibba020.yqfnwy (mgr.34427) 9797 : cluster [DBG] pgmap v5581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:50.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:50 gibba013 bash[29418]: cluster 2021-03-10T16:58:48.571460+0000 mgr.gibba020.yqfnwy (mgr.34427) 9798 : cluster [DBG] pgmap v5582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:50.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:50 gibba013 bash[30381]: cluster 2021-03-10T16:58:48.571460+0000 mgr.gibba020.yqfnwy (mgr.34427) 9798 : cluster [DBG] pgmap v5582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:50.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:50 gibba020 bash[25448]: cluster 2021-03-10T16:58:48.571460+0000 mgr.gibba020.yqfnwy (mgr.34427) 9798 : cluster [DBG] pgmap v5582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:52.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:52 gibba013 bash[29418]: cluster 2021-03-10T16:58:50.572944+0000 mgr.gibba020.yqfnwy (mgr.34427) 9799 : cluster [DBG] pgmap v5583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:52.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:52 gibba013 bash[30381]: cluster 2021-03-10T16:58:50.572944+0000 mgr.gibba020.yqfnwy (mgr.34427) 9799 : cluster [DBG] pgmap v5583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:52.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:52 gibba020 bash[25448]: cluster 2021-03-10T16:58:50.572944+0000 mgr.gibba020.yqfnwy (mgr.34427) 9799 : cluster [DBG] pgmap v5583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:54.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:54 gibba013 bash[29418]: cluster 2021-03-10T16:58:52.574523+0000 mgr.gibba020.yqfnwy (mgr.34427) 9800 : cluster [DBG] pgmap v5584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:54.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:54 gibba013 bash[30381]: cluster 2021-03-10T16:58:52.574523+0000 mgr.gibba020.yqfnwy (mgr.34427) 9800 : cluster [DBG] pgmap v5584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:54.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:54 gibba020 bash[25448]: cluster 2021-03-10T16:58:52.574523+0000 mgr.gibba020.yqfnwy (mgr.34427) 9800 : cluster [DBG] pgmap v5584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:56.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:56 gibba013 bash[29418]: cluster 2021-03-10T16:58:54.576188+0000 mgr.gibba020.yqfnwy (mgr.34427) 9801 : cluster [DBG] pgmap v5585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:56.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:56 gibba013 bash[30381]: cluster 2021-03-10T16:58:54.576188+0000 mgr.gibba020.yqfnwy (mgr.34427) 9801 : cluster [DBG] pgmap v5585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:56.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:56 gibba020 bash[25448]: cluster 2021-03-10T16:58:54.576188+0000 mgr.gibba020.yqfnwy (mgr.34427) 9801 : cluster [DBG] pgmap v5585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:58.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:58:58 gibba013 bash[29418]: cluster 2021-03-10T16:58:56.577912+0000 mgr.gibba020.yqfnwy (mgr.34427) 9802 : cluster [DBG] pgmap v5586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:58.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:58:58 gibba013 bash[30381]: cluster 2021-03-10T16:58:56.577912+0000 mgr.gibba020.yqfnwy (mgr.34427) 9802 : cluster [DBG] pgmap v5586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:58:58.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:58:58 gibba020 bash[25448]: cluster 2021-03-10T16:58:56.577912+0000 mgr.gibba020.yqfnwy (mgr.34427) 9802 : cluster [DBG] pgmap v5586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:00.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:00 gibba013 bash[29418]: cluster 2021-03-10T16:58:58.579277+0000 mgr.gibba020.yqfnwy (mgr.34427) 9803 : cluster [DBG] pgmap v5587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:00.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:00 gibba013 bash[30381]: cluster 2021-03-10T16:58:58.579277+0000 mgr.gibba020.yqfnwy (mgr.34427) 9803 : cluster [DBG] pgmap v5587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:00.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:00 gibba020 bash[25448]: cluster 2021-03-10T16:58:58.579277+0000 mgr.gibba020.yqfnwy (mgr.34427) 9803 : cluster [DBG] pgmap v5587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:01.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:01 gibba013 bash[29418]: cephadm 2021-03-10T16:59:00.345839+0000 mgr.gibba020.yqfnwy (mgr.34427) 9804 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:59:01.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:01 gibba013 bash[30381]: cephadm 2021-03-10T16:59:00.345839+0000 mgr.gibba020.yqfnwy (mgr.34427) 9804 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:59:01.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:01 gibba020 bash[25448]: cephadm 2021-03-10T16:59:00.345839+0000 mgr.gibba020.yqfnwy (mgr.34427) 9804 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:59:02.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:02 gibba013 bash[29418]: cluster 2021-03-10T16:59:00.581049+0000 mgr.gibba020.yqfnwy (mgr.34427) 9805 : cluster [DBG] pgmap v5588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:02.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:02 gibba013 bash[30381]: cluster 2021-03-10T16:59:00.581049+0000 mgr.gibba020.yqfnwy (mgr.34427) 9805 : cluster [DBG] pgmap v5588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:02.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:02 gibba020 bash[25448]: cluster 2021-03-10T16:59:00.581049+0000 mgr.gibba020.yqfnwy (mgr.34427) 9805 : cluster [DBG] pgmap v5588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:04.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:04 gibba013 bash[29418]: cluster 2021-03-10T16:59:02.582959+0000 mgr.gibba020.yqfnwy (mgr.34427) 9806 : cluster [DBG] pgmap v5589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:04.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:04 gibba013 bash[30381]: cluster 2021-03-10T16:59:02.582959+0000 mgr.gibba020.yqfnwy (mgr.34427) 9806 : cluster [DBG] pgmap v5589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:04.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:04 gibba020 bash[25448]: cluster 2021-03-10T16:59:02.582959+0000 mgr.gibba020.yqfnwy (mgr.34427) 9806 : cluster [DBG] pgmap v5589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:06.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:06 gibba013 bash[29418]: cluster 2021-03-10T16:59:04.584697+0000 mgr.gibba020.yqfnwy (mgr.34427) 9807 : cluster [DBG] pgmap v5590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:06.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:06 gibba013 bash[30381]: cluster 2021-03-10T16:59:04.584697+0000 mgr.gibba020.yqfnwy (mgr.34427) 9807 : cluster [DBG] pgmap v5590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:06.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:06 gibba020 bash[25448]: cluster 2021-03-10T16:59:04.584697+0000 mgr.gibba020.yqfnwy (mgr.34427) 9807 : cluster [DBG] pgmap v5590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:07 gibba013 bash[29418]: audit 2021-03-10T16:59:06.855528+0000 mon.a (mon.0) 3520 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:59:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:07 gibba013 bash[29418]: audit 2021-03-10T16:59:07.047463+0000 mon.a (mon.0) 3521 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:59:07.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:07 gibba013 bash[30381]: audit 2021-03-10T16:59:06.855528+0000 mon.a (mon.0) 3520 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:59:07.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:07 gibba013 bash[30381]: audit 2021-03-10T16:59:07.047463+0000 mon.a (mon.0) 3521 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:59:07.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:07 gibba020 bash[25448]: audit 2021-03-10T16:59:06.855528+0000 mon.a (mon.0) 3520 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T16:59:07.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:07 gibba020 bash[25448]: audit 2021-03-10T16:59:07.047463+0000 mon.a (mon.0) 3521 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T16:59:08.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:08 gibba013 bash[29418]: cluster 2021-03-10T16:59:06.586232+0000 mgr.gibba020.yqfnwy (mgr.34427) 9808 : cluster [DBG] pgmap v5591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:08.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:08 gibba013 bash[29418]: audit 2021-03-10T16:59:07.445817+0000 mon.a (mon.0) 3522 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:59:08.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:08 gibba013 bash[29418]: audit 2021-03-10T16:59:07.446639+0000 mon.a (mon.0) 3523 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:59:08.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:08 gibba013 bash[29418]: audit 2021-03-10T16:59:07.447305+0000 mon.a (mon.0) 3524 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:59:08.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:08 gibba013 bash[29418]: audit 2021-03-10T16:59:07.447996+0000 mon.a (mon.0) 3525 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:59:08.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:08 gibba013 bash[30381]: cluster 2021-03-10T16:59:06.586232+0000 mgr.gibba020.yqfnwy (mgr.34427) 9808 : cluster [DBG] pgmap v5591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:08.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:08 gibba013 bash[30381]: audit 2021-03-10T16:59:07.445817+0000 mon.a (mon.0) 3522 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:59:08.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:08 gibba013 bash[30381]: audit 2021-03-10T16:59:07.446639+0000 mon.a (mon.0) 3523 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:59:08.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:08 gibba013 bash[30381]: audit 2021-03-10T16:59:07.447305+0000 mon.a (mon.0) 3524 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:59:08.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:08 gibba013 bash[30381]: audit 2021-03-10T16:59:07.447996+0000 mon.a (mon.0) 3525 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:59:08.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:08 gibba020 bash[25448]: cluster 2021-03-10T16:59:06.586232+0000 mgr.gibba020.yqfnwy (mgr.34427) 9808 : cluster [DBG] pgmap v5591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:08.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:08 gibba020 bash[25448]: audit 2021-03-10T16:59:07.445817+0000 mon.a (mon.0) 3522 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T16:59:08.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:08 gibba020 bash[25448]: audit 2021-03-10T16:59:07.446639+0000 mon.a (mon.0) 3523 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T16:59:08.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:08 gibba020 bash[25448]: audit 2021-03-10T16:59:07.447305+0000 mon.a (mon.0) 3524 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T16:59:08.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:08 gibba020 bash[25448]: audit 2021-03-10T16:59:07.447996+0000 mon.a (mon.0) 3525 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T16:59:10.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:10 gibba013 bash[29418]: cluster 2021-03-10T16:59:08.587648+0000 mgr.gibba020.yqfnwy (mgr.34427) 9809 : cluster [DBG] pgmap v5592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:10.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:10 gibba013 bash[30381]: cluster 2021-03-10T16:59:08.587648+0000 mgr.gibba020.yqfnwy (mgr.34427) 9809 : cluster [DBG] pgmap v5592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:10.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:10 gibba020 bash[25448]: cluster 2021-03-10T16:59:08.587648+0000 mgr.gibba020.yqfnwy (mgr.34427) 9809 : cluster [DBG] pgmap v5592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:12.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:12 gibba013 bash[29418]: cluster 2021-03-10T16:59:10.588207+0000 mgr.gibba020.yqfnwy (mgr.34427) 9810 : cluster [DBG] pgmap v5593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:12.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:12 gibba013 bash[30381]: cluster 2021-03-10T16:59:10.588207+0000 mgr.gibba020.yqfnwy (mgr.34427) 9810 : cluster [DBG] pgmap v5593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:12.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:12 gibba020 bash[25448]: cluster 2021-03-10T16:59:10.588207+0000 mgr.gibba020.yqfnwy (mgr.34427) 9810 : cluster [DBG] pgmap v5593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:14.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:14 gibba013 bash[29418]: cluster 2021-03-10T16:59:12.589644+0000 mgr.gibba020.yqfnwy (mgr.34427) 9811 : cluster [DBG] pgmap v5594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:14.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:14 gibba013 bash[30381]: cluster 2021-03-10T16:59:12.589644+0000 mgr.gibba020.yqfnwy (mgr.34427) 9811 : cluster [DBG] pgmap v5594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:14.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:14 gibba020 bash[25448]: cluster 2021-03-10T16:59:12.589644+0000 mgr.gibba020.yqfnwy (mgr.34427) 9811 : cluster [DBG] pgmap v5594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:15.458 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:59:15.721 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:59:15.721 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 8m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:59:15.721 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 7m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:59:15.721 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:59:15.722 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:59:15.722 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:59:15.722 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:59:15.722 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:59:15.722 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:59:15.723 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:59:15.723 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:59:15.723 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:59:15.723 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:59:15.724 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:59:15.724 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:59:15.724 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:59:15.724 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:59:15.724 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:59:15.725 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:59:15.725 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 7m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:59:15.725 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 7m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:59:15.981 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:59:15.982 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:59:15.982 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:59:15.982 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:59:15.983 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:59:15.983 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:59:15.983 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:59:15.983 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:59:15.983 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:59:15.984 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:59:15.984 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:59:15.984 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:59:15.984 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:59:15.985 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:59:15.985 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:59:16.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:16 gibba013 bash[29418]: cluster 2021-03-10T16:59:14.591245+0000 mgr.gibba020.yqfnwy (mgr.34427) 9812 : cluster [DBG] pgmap v5595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:16.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:16 gibba013 bash[29418]: audit 2021-03-10T16:59:15.362253+0000 mon.a (mon.0) 3526 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:59:16.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:16 gibba013 bash[29418]: cephadm 2021-03-10T16:59:15.363935+0000 mgr.gibba020.yqfnwy (mgr.34427) 9813 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:59:16.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:16 gibba013 bash[29418]: cephadm 2021-03-10T16:59:15.364420+0000 mgr.gibba020.yqfnwy (mgr.34427) 9814 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:59:16.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:16 gibba013 bash[29418]: audit 2021-03-10T16:59:15.554139+0000 mon.a (mon.0) 3527 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:59:16.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:16 gibba013 bash[29418]: audit 2021-03-10T16:59:15.557438+0000 mon.a (mon.0) 3528 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:59:16.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:16 gibba013 bash[29418]: audit 2021-03-10T16:59:15.558712+0000 mon.a (mon.0) 3529 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:16.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:16 gibba013 bash[29418]: audit 2021-03-10T16:59:15.560132+0000 mon.a (mon.0) 3530 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:16.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:16 gibba013 bash[29418]: audit 2021-03-10T16:59:15.561229+0000 mon.a (mon.0) 3531 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:16.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:16 gibba013 bash[29418]: audit 2021-03-10T16:59:15.563643+0000 mon.a (mon.0) 3532 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:16.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:16 gibba013 bash[29418]: audit 2021-03-10T16:59:15.565063+0000 mon.a (mon.0) 3533 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:16.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:16 gibba013 bash[29418]: audit 2021-03-10T16:59:15.981512+0000 mon.a (mon.0) 3534 : audit [DBG] from='client.? 172.21.2.113:0/2912679422' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:16.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:16 gibba013 bash[30381]: cluster 2021-03-10T16:59:14.591245+0000 mgr.gibba020.yqfnwy (mgr.34427) 9812 : cluster [DBG] pgmap v5595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:16.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:16 gibba013 bash[30381]: audit 2021-03-10T16:59:15.362253+0000 mon.a (mon.0) 3526 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:59:16.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:16 gibba013 bash[30381]: cephadm 2021-03-10T16:59:15.363935+0000 mgr.gibba020.yqfnwy (mgr.34427) 9813 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:59:16.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:16 gibba013 bash[30381]: cephadm 2021-03-10T16:59:15.364420+0000 mgr.gibba020.yqfnwy (mgr.34427) 9814 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:59:16.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:16 gibba013 bash[30381]: audit 2021-03-10T16:59:15.554139+0000 mon.a (mon.0) 3527 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:59:16.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:16 gibba013 bash[30381]: audit 2021-03-10T16:59:15.557438+0000 mon.a (mon.0) 3528 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:59:16.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:16 gibba013 bash[30381]: audit 2021-03-10T16:59:15.558712+0000 mon.a (mon.0) 3529 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:16.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:16 gibba013 bash[30381]: audit 2021-03-10T16:59:15.560132+0000 mon.a (mon.0) 3530 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:16.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:16 gibba013 bash[30381]: audit 2021-03-10T16:59:15.561229+0000 mon.a (mon.0) 3531 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:16.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:16 gibba013 bash[30381]: audit 2021-03-10T16:59:15.563643+0000 mon.a (mon.0) 3532 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:16.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:16 gibba013 bash[30381]: audit 2021-03-10T16:59:15.565063+0000 mon.a (mon.0) 3533 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:16.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:16 gibba013 bash[30381]: audit 2021-03-10T16:59:15.981512+0000 mon.a (mon.0) 3534 : audit [DBG] from='client.? 172.21.2.113:0/2912679422' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:16.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:16 gibba020 bash[25448]: cluster 2021-03-10T16:59:14.591245+0000 mgr.gibba020.yqfnwy (mgr.34427) 9812 : cluster [DBG] pgmap v5595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:16.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:16 gibba020 bash[25448]: audit 2021-03-10T16:59:15.362253+0000 mon.a (mon.0) 3526 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:59:16.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:16 gibba020 bash[25448]: cephadm 2021-03-10T16:59:15.363935+0000 mgr.gibba020.yqfnwy (mgr.34427) 9813 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T16:59:16.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:16 gibba020 bash[25448]: cephadm 2021-03-10T16:59:15.364420+0000 mgr.gibba020.yqfnwy (mgr.34427) 9814 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T16:59:16.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:16 gibba020 bash[25448]: audit 2021-03-10T16:59:15.554139+0000 mon.a (mon.0) 3527 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T16:59:16.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:16 gibba020 bash[25448]: audit 2021-03-10T16:59:15.557438+0000 mon.a (mon.0) 3528 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T16:59:16.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:16 gibba020 bash[25448]: audit 2021-03-10T16:59:15.558712+0000 mon.a (mon.0) 3529 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:16.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:16 gibba020 bash[25448]: audit 2021-03-10T16:59:15.560132+0000 mon.a (mon.0) 3530 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:16.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:16 gibba020 bash[25448]: audit 2021-03-10T16:59:15.561229+0000 mon.a (mon.0) 3531 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:16.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:16 gibba020 bash[25448]: audit 2021-03-10T16:59:15.563643+0000 mon.a (mon.0) 3532 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:16.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:16 gibba020 bash[25448]: audit 2021-03-10T16:59:15.565063+0000 mon.a (mon.0) 3533 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:16.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:16 gibba020 bash[25448]: audit 2021-03-10T16:59:15.981512+0000 mon.a (mon.0) 3534 : audit [DBG] from='client.? 172.21.2.113:0/2912679422' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:17.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:17 gibba013 bash[29418]: audit 2021-03-10T16:59:15.449357+0000 mgr.gibba020.yqfnwy (mgr.34427) 9815 : audit [DBG] from='client.50640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:59:17.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:17 gibba013 bash[29418]: cephadm 2021-03-10T16:59:15.556198+0000 mgr.gibba020.yqfnwy (mgr.34427) 9816 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:59:17.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:17 gibba013 bash[29418]: cephadm 2021-03-10T16:59:15.557786+0000 mgr.gibba020.yqfnwy (mgr.34427) 9817 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:59:17.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:17 gibba013 bash[29418]: cephadm 2021-03-10T16:59:15.559068+0000 mgr.gibba020.yqfnwy (mgr.34427) 9818 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:59:17.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:17 gibba013 bash[29418]: cephadm 2021-03-10T16:59:15.559142+0000 mgr.gibba020.yqfnwy (mgr.34427) 9819 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:59:17.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:17 gibba013 bash[29418]: cephadm 2021-03-10T16:59:15.560358+0000 mgr.gibba020.yqfnwy (mgr.34427) 9820 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:59:17.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:17 gibba013 bash[29418]: cephadm 2021-03-10T16:59:15.560394+0000 mgr.gibba020.yqfnwy (mgr.34427) 9821 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:59:17.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:17 gibba013 bash[29418]: cephadm 2021-03-10T16:59:15.561527+0000 mgr.gibba020.yqfnwy (mgr.34427) 9822 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:59:17.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:17 gibba013 bash[29418]: cephadm 2021-03-10T16:59:15.562621+0000 mgr.gibba020.yqfnwy (mgr.34427) 9823 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:59:17.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:17 gibba013 bash[29418]: cephadm 2021-03-10T16:59:15.562659+0000 mgr.gibba020.yqfnwy (mgr.34427) 9824 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:59:17.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:17 gibba013 bash[29418]: cephadm 2021-03-10T16:59:15.563829+0000 mgr.gibba020.yqfnwy (mgr.34427) 9825 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:59:17.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:17 gibba013 bash[29418]: cephadm 2021-03-10T16:59:15.564239+0000 mgr.gibba020.yqfnwy (mgr.34427) 9826 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:59:17.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:17 gibba013 bash[29418]: cephadm 2021-03-10T16:59:15.565705+0000 mgr.gibba020.yqfnwy (mgr.34427) 9827 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:59:17.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:17 gibba013 bash[29418]: cephadm 2021-03-10T16:59:15.565741+0000 mgr.gibba020.yqfnwy (mgr.34427) 9828 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:59:17.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:17 gibba013 bash[29418]: cephadm 2021-03-10T16:59:15.565847+0000 mgr.gibba020.yqfnwy (mgr.34427) 9829 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:59:17.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:17 gibba013 bash[29418]: audit 2021-03-10T16:59:15.678300+0000 mgr.gibba020.yqfnwy (mgr.34427) 9830 : audit [DBG] from='client.50646 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:59:17.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:17 gibba013 bash[30381]: audit 2021-03-10T16:59:15.449357+0000 mgr.gibba020.yqfnwy (mgr.34427) 9815 : audit [DBG] from='client.50640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:59:17.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:17 gibba013 bash[30381]: cephadm 2021-03-10T16:59:15.556198+0000 mgr.gibba020.yqfnwy (mgr.34427) 9816 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:59:17.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:17 gibba013 bash[30381]: cephadm 2021-03-10T16:59:15.557786+0000 mgr.gibba020.yqfnwy (mgr.34427) 9817 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:59:17.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:17 gibba013 bash[30381]: cephadm 2021-03-10T16:59:15.559068+0000 mgr.gibba020.yqfnwy (mgr.34427) 9818 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:59:17.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:17 gibba013 bash[30381]: cephadm 2021-03-10T16:59:15.559142+0000 mgr.gibba020.yqfnwy (mgr.34427) 9819 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:59:17.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:17 gibba013 bash[30381]: cephadm 2021-03-10T16:59:15.560358+0000 mgr.gibba020.yqfnwy (mgr.34427) 9820 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:59:17.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:17 gibba013 bash[30381]: cephadm 2021-03-10T16:59:15.560394+0000 mgr.gibba020.yqfnwy (mgr.34427) 9821 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:59:17.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:17 gibba013 bash[30381]: cephadm 2021-03-10T16:59:15.561527+0000 mgr.gibba020.yqfnwy (mgr.34427) 9822 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:59:17.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:17 gibba013 bash[30381]: cephadm 2021-03-10T16:59:15.562621+0000 mgr.gibba020.yqfnwy (mgr.34427) 9823 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:59:17.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:17 gibba013 bash[30381]: cephadm 2021-03-10T16:59:15.562659+0000 mgr.gibba020.yqfnwy (mgr.34427) 9824 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:59:17.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:17 gibba013 bash[30381]: cephadm 2021-03-10T16:59:15.563829+0000 mgr.gibba020.yqfnwy (mgr.34427) 9825 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:59:17.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:17 gibba013 bash[30381]: cephadm 2021-03-10T16:59:15.564239+0000 mgr.gibba020.yqfnwy (mgr.34427) 9826 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:59:17.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:17 gibba013 bash[30381]: cephadm 2021-03-10T16:59:15.565705+0000 mgr.gibba020.yqfnwy (mgr.34427) 9827 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:59:17.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:17 gibba013 bash[30381]: cephadm 2021-03-10T16:59:15.565741+0000 mgr.gibba020.yqfnwy (mgr.34427) 9828 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:59:17.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:17 gibba013 bash[30381]: cephadm 2021-03-10T16:59:15.565847+0000 mgr.gibba020.yqfnwy (mgr.34427) 9829 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:59:17.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:17 gibba013 bash[30381]: audit 2021-03-10T16:59:15.678300+0000 mgr.gibba020.yqfnwy (mgr.34427) 9830 : audit [DBG] from='client.50646 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:59:17.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:17 gibba020 bash[25448]: audit 2021-03-10T16:59:15.449357+0000 mgr.gibba020.yqfnwy (mgr.34427) 9815 : audit [DBG] from='client.50640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:59:17.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:17 gibba020 bash[25448]: cephadm 2021-03-10T16:59:15.556198+0000 mgr.gibba020.yqfnwy (mgr.34427) 9816 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T16:59:17.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:17 gibba020 bash[25448]: cephadm 2021-03-10T16:59:15.557786+0000 mgr.gibba020.yqfnwy (mgr.34427) 9817 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T16:59:17.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:17 gibba020 bash[25448]: cephadm 2021-03-10T16:59:15.559068+0000 mgr.gibba020.yqfnwy (mgr.34427) 9818 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T16:59:17.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:17 gibba020 bash[25448]: cephadm 2021-03-10T16:59:15.559142+0000 mgr.gibba020.yqfnwy (mgr.34427) 9819 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T16:59:17.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:17 gibba020 bash[25448]: cephadm 2021-03-10T16:59:15.560358+0000 mgr.gibba020.yqfnwy (mgr.34427) 9820 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T16:59:17.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:17 gibba020 bash[25448]: cephadm 2021-03-10T16:59:15.560394+0000 mgr.gibba020.yqfnwy (mgr.34427) 9821 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T16:59:17.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:17 gibba020 bash[25448]: cephadm 2021-03-10T16:59:15.561527+0000 mgr.gibba020.yqfnwy (mgr.34427) 9822 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T16:59:17.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:17 gibba020 bash[25448]: cephadm 2021-03-10T16:59:15.562621+0000 mgr.gibba020.yqfnwy (mgr.34427) 9823 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T16:59:17.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:17 gibba020 bash[25448]: cephadm 2021-03-10T16:59:15.562659+0000 mgr.gibba020.yqfnwy (mgr.34427) 9824 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T16:59:17.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:17 gibba020 bash[25448]: cephadm 2021-03-10T16:59:15.563829+0000 mgr.gibba020.yqfnwy (mgr.34427) 9825 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T16:59:17.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:17 gibba020 bash[25448]: cephadm 2021-03-10T16:59:15.564239+0000 mgr.gibba020.yqfnwy (mgr.34427) 9826 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T16:59:17.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:17 gibba020 bash[25448]: cephadm 2021-03-10T16:59:15.565705+0000 mgr.gibba020.yqfnwy (mgr.34427) 9827 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T16:59:17.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:17 gibba020 bash[25448]: cephadm 2021-03-10T16:59:15.565741+0000 mgr.gibba020.yqfnwy (mgr.34427) 9828 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T16:59:17.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:17 gibba020 bash[25448]: cephadm 2021-03-10T16:59:15.565847+0000 mgr.gibba020.yqfnwy (mgr.34427) 9829 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:59:17.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:17 gibba020 bash[25448]: audit 2021-03-10T16:59:15.678300+0000 mgr.gibba020.yqfnwy (mgr.34427) 9830 : audit [DBG] from='client.50646 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:59:18.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:18 gibba013 bash[29418]: cluster 2021-03-10T16:59:16.593056+0000 mgr.gibba020.yqfnwy (mgr.34427) 9831 : cluster [DBG] pgmap v5596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:18.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:18 gibba013 bash[30381]: cluster 2021-03-10T16:59:16.593056+0000 mgr.gibba020.yqfnwy (mgr.34427) 9831 : cluster [DBG] pgmap v5596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:18.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:18 gibba020 bash[25448]: cluster 2021-03-10T16:59:16.593056+0000 mgr.gibba020.yqfnwy (mgr.34427) 9831 : cluster [DBG] pgmap v5596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:20.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:20 gibba013 bash[29418]: cluster 2021-03-10T16:59:18.593550+0000 mgr.gibba020.yqfnwy (mgr.34427) 9832 : cluster [DBG] pgmap v5597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:20.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:20 gibba013 bash[30381]: cluster 2021-03-10T16:59:18.593550+0000 mgr.gibba020.yqfnwy (mgr.34427) 9832 : cluster [DBG] pgmap v5597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:20.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:20 gibba020 bash[25448]: cluster 2021-03-10T16:59:18.593550+0000 mgr.gibba020.yqfnwy (mgr.34427) 9832 : cluster [DBG] pgmap v5597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:22.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:22 gibba020 bash[25448]: cluster 2021-03-10T16:59:20.595162+0000 mgr.gibba020.yqfnwy (mgr.34427) 9833 : cluster [DBG] pgmap v5598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:22.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:22 gibba013 bash[29418]: cluster 2021-03-10T16:59:20.595162+0000 mgr.gibba020.yqfnwy (mgr.34427) 9833 : cluster [DBG] pgmap v5598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:22.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:22 gibba013 bash[30381]: cluster 2021-03-10T16:59:20.595162+0000 mgr.gibba020.yqfnwy (mgr.34427) 9833 : cluster [DBG] pgmap v5598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:24.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:24 gibba020 bash[25448]: cluster 2021-03-10T16:59:22.596491+0000 mgr.gibba020.yqfnwy (mgr.34427) 9834 : cluster [DBG] pgmap v5599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:24.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:24 gibba013 bash[29418]: cluster 2021-03-10T16:59:22.596491+0000 mgr.gibba020.yqfnwy (mgr.34427) 9834 : cluster [DBG] pgmap v5599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:24.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:24 gibba013 bash[30381]: cluster 2021-03-10T16:59:22.596491+0000 mgr.gibba020.yqfnwy (mgr.34427) 9834 : cluster [DBG] pgmap v5599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:26.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:26 gibba020 bash[25448]: cluster 2021-03-10T16:59:24.598054+0000 mgr.gibba020.yqfnwy (mgr.34427) 9835 : cluster [DBG] pgmap v5600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:26.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:26 gibba013 bash[29418]: cluster 2021-03-10T16:59:24.598054+0000 mgr.gibba020.yqfnwy (mgr.34427) 9835 : cluster [DBG] pgmap v5600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:26.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:26 gibba013 bash[30381]: cluster 2021-03-10T16:59:24.598054+0000 mgr.gibba020.yqfnwy (mgr.34427) 9835 : cluster [DBG] pgmap v5600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:27.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:27 gibba020 bash[25448]: cluster 2021-03-10T16:59:26.598622+0000 mgr.gibba020.yqfnwy (mgr.34427) 9836 : cluster [DBG] pgmap v5601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:27.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:27 gibba013 bash[29418]: cluster 2021-03-10T16:59:26.598622+0000 mgr.gibba020.yqfnwy (mgr.34427) 9836 : cluster [DBG] pgmap v5601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:27.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:27 gibba013 bash[30381]: cluster 2021-03-10T16:59:26.598622+0000 mgr.gibba020.yqfnwy (mgr.34427) 9836 : cluster [DBG] pgmap v5601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:29.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:29 gibba020 bash[25448]: cluster 2021-03-10T16:59:28.599888+0000 mgr.gibba020.yqfnwy (mgr.34427) 9837 : cluster [DBG] pgmap v5602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:30.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:29 gibba013 bash[29418]: cluster 2021-03-10T16:59:28.599888+0000 mgr.gibba020.yqfnwy (mgr.34427) 9837 : cluster [DBG] pgmap v5602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:30.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:29 gibba013 bash[30381]: cluster 2021-03-10T16:59:28.599888+0000 mgr.gibba020.yqfnwy (mgr.34427) 9837 : cluster [DBG] pgmap v5602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:32.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:32 gibba020 bash[25448]: cephadm 2021-03-10T16:59:30.581720+0000 mgr.gibba020.yqfnwy (mgr.34427) 9838 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:59:32.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:32 gibba020 bash[25448]: cluster 2021-03-10T16:59:30.601430+0000 mgr.gibba020.yqfnwy (mgr.34427) 9839 : cluster [DBG] pgmap v5603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:32.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:32 gibba013 bash[29418]: cephadm 2021-03-10T16:59:30.581720+0000 mgr.gibba020.yqfnwy (mgr.34427) 9838 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:59:32.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:32 gibba013 bash[29418]: cluster 2021-03-10T16:59:30.601430+0000 mgr.gibba020.yqfnwy (mgr.34427) 9839 : cluster [DBG] pgmap v5603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:32.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:32 gibba013 bash[30381]: cephadm 2021-03-10T16:59:30.581720+0000 mgr.gibba020.yqfnwy (mgr.34427) 9838 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:59:32.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:32 gibba013 bash[30381]: cluster 2021-03-10T16:59:30.601430+0000 mgr.gibba020.yqfnwy (mgr.34427) 9839 : cluster [DBG] pgmap v5603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:34.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:34 gibba013 bash[29418]: cluster 2021-03-10T16:59:32.602754+0000 mgr.gibba020.yqfnwy (mgr.34427) 9840 : cluster [DBG] pgmap v5604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:34.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:34 gibba013 bash[30381]: cluster 2021-03-10T16:59:32.602754+0000 mgr.gibba020.yqfnwy (mgr.34427) 9840 : cluster [DBG] pgmap v5604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:34.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:34 gibba020 bash[25448]: cluster 2021-03-10T16:59:32.602754+0000 mgr.gibba020.yqfnwy (mgr.34427) 9840 : cluster [DBG] pgmap v5604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:36.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:36 gibba013 bash[29418]: cluster 2021-03-10T16:59:34.603531+0000 mgr.gibba020.yqfnwy (mgr.34427) 9841 : cluster [DBG] pgmap v5605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:36.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:36 gibba013 bash[30381]: cluster 2021-03-10T16:59:34.603531+0000 mgr.gibba020.yqfnwy (mgr.34427) 9841 : cluster [DBG] pgmap v5605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:36.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:36 gibba020 bash[25448]: cluster 2021-03-10T16:59:34.603531+0000 mgr.gibba020.yqfnwy (mgr.34427) 9841 : cluster [DBG] pgmap v5605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:38.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:38 gibba013 bash[29418]: cluster 2021-03-10T16:59:36.605069+0000 mgr.gibba020.yqfnwy (mgr.34427) 9842 : cluster [DBG] pgmap v5606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:38.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:38 gibba013 bash[30381]: cluster 2021-03-10T16:59:36.605069+0000 mgr.gibba020.yqfnwy (mgr.34427) 9842 : cluster [DBG] pgmap v5606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:38.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:38 gibba020 bash[25448]: cluster 2021-03-10T16:59:36.605069+0000 mgr.gibba020.yqfnwy (mgr.34427) 9842 : cluster [DBG] pgmap v5606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:40.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:40 gibba013 bash[29418]: cluster 2021-03-10T16:59:38.606734+0000 mgr.gibba020.yqfnwy (mgr.34427) 9843 : cluster [DBG] pgmap v5607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:40.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:40 gibba013 bash[30381]: cluster 2021-03-10T16:59:38.606734+0000 mgr.gibba020.yqfnwy (mgr.34427) 9843 : cluster [DBG] pgmap v5607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:40.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:40 gibba020 bash[25448]: cluster 2021-03-10T16:59:38.606734+0000 mgr.gibba020.yqfnwy (mgr.34427) 9843 : cluster [DBG] pgmap v5607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:42.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:42 gibba013 bash[29418]: cluster 2021-03-10T16:59:40.608482+0000 mgr.gibba020.yqfnwy (mgr.34427) 9844 : cluster [DBG] pgmap v5608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:42.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:42 gibba013 bash[30381]: cluster 2021-03-10T16:59:40.608482+0000 mgr.gibba020.yqfnwy (mgr.34427) 9844 : cluster [DBG] pgmap v5608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:42.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:42 gibba020 bash[25448]: cluster 2021-03-10T16:59:40.608482+0000 mgr.gibba020.yqfnwy (mgr.34427) 9844 : cluster [DBG] pgmap v5608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:44.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:44 gibba013 bash[29418]: cluster 2021-03-10T16:59:42.609123+0000 mgr.gibba020.yqfnwy (mgr.34427) 9845 : cluster [DBG] pgmap v5609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:44.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:44 gibba013 bash[30381]: cluster 2021-03-10T16:59:42.609123+0000 mgr.gibba020.yqfnwy (mgr.34427) 9845 : cluster [DBG] pgmap v5609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:44.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:44 gibba020 bash[25448]: cluster 2021-03-10T16:59:42.609123+0000 mgr.gibba020.yqfnwy (mgr.34427) 9845 : cluster [DBG] pgmap v5609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:46.227 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T16:59:46.455 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T16:59:46.456 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 8m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T16:59:46.456 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 7m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T16:59:46.456 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T16:59:46.456 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T16:59:46.456 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T16:59:46.457 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T16:59:46.457 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T16:59:46.457 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T16:59:46.457 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T16:59:46.458 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T16:59:46.458 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T16:59:46.458 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T16:59:46.458 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T16:59:46.458 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T16:59:46.459 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T16:59:46.459 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T16:59:46.459 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T16:59:46.459 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T16:59:46.460 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 7m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T16:59:46.460 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 7m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T16:59:46.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:46 gibba013 bash[29418]: cluster 2021-03-10T16:59:44.610569+0000 mgr.gibba020.yqfnwy (mgr.34427) 9846 : cluster [DBG] pgmap v5610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:46.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:46 gibba013 bash[30381]: cluster 2021-03-10T16:59:44.610569+0000 mgr.gibba020.yqfnwy (mgr.34427) 9846 : cluster [DBG] pgmap v5610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:46.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:46 gibba020 bash[25448]: cluster 2021-03-10T16:59:44.610569+0000 mgr.gibba020.yqfnwy (mgr.34427) 9846 : cluster [DBG] pgmap v5610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:46.707 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T16:59:46.707 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T16:59:46.707 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:59:46.708 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:59:46.708 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T16:59:46.708 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T16:59:46.708 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:59:46.708 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T16:59:46.709 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T16:59:46.709 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T16:59:46.709 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T16:59:46.709 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T16:59:46.710 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T16:59:46.710 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T16:59:46.710 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T16:59:47.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:47 gibba013 bash[29418]: cephadm 2021-03-10T16:59:45.592873+0000 mgr.gibba020.yqfnwy (mgr.34427) 9847 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:59:47.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:47 gibba013 bash[29418]: audit 2021-03-10T16:59:46.217027+0000 mgr.gibba020.yqfnwy (mgr.34427) 9848 : audit [DBG] from='client.60637 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:59:47.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:47 gibba013 bash[29418]: audit 2021-03-10T16:59:46.707298+0000 mon.c (mon.1) 151 : audit [DBG] from='client.? 172.21.2.113:0/1004432422' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:47.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:47 gibba013 bash[30381]: cephadm 2021-03-10T16:59:45.592873+0000 mgr.gibba020.yqfnwy (mgr.34427) 9847 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:59:47.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:47 gibba013 bash[30381]: audit 2021-03-10T16:59:46.217027+0000 mgr.gibba020.yqfnwy (mgr.34427) 9848 : audit [DBG] from='client.60637 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:59:47.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:47 gibba013 bash[30381]: audit 2021-03-10T16:59:46.707298+0000 mon.c (mon.1) 151 : audit [DBG] from='client.? 172.21.2.113:0/1004432422' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:47.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:47 gibba020 bash[25448]: cephadm 2021-03-10T16:59:45.592873+0000 mgr.gibba020.yqfnwy (mgr.34427) 9847 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T16:59:47.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:47 gibba020 bash[25448]: audit 2021-03-10T16:59:46.217027+0000 mgr.gibba020.yqfnwy (mgr.34427) 9848 : audit [DBG] from='client.60637 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:59:47.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:47 gibba020 bash[25448]: audit 2021-03-10T16:59:46.707298+0000 mon.c (mon.1) 151 : audit [DBG] from='client.? 172.21.2.113:0/1004432422' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T16:59:48.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:48 gibba013 bash[29418]: audit 2021-03-10T16:59:46.442699+0000 mgr.gibba020.yqfnwy (mgr.34427) 9849 : audit [DBG] from='client.50664 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:59:48.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:48 gibba013 bash[29418]: cluster 2021-03-10T16:59:46.612380+0000 mgr.gibba020.yqfnwy (mgr.34427) 9850 : cluster [DBG] pgmap v5611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:48.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:48 gibba013 bash[30381]: audit 2021-03-10T16:59:46.442699+0000 mgr.gibba020.yqfnwy (mgr.34427) 9849 : audit [DBG] from='client.50664 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:59:48.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:48 gibba013 bash[30381]: cluster 2021-03-10T16:59:46.612380+0000 mgr.gibba020.yqfnwy (mgr.34427) 9850 : cluster [DBG] pgmap v5611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:48.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:48 gibba020 bash[25448]: audit 2021-03-10T16:59:46.442699+0000 mgr.gibba020.yqfnwy (mgr.34427) 9849 : audit [DBG] from='client.50664 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T16:59:48.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:48 gibba020 bash[25448]: cluster 2021-03-10T16:59:46.612380+0000 mgr.gibba020.yqfnwy (mgr.34427) 9850 : cluster [DBG] pgmap v5611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:50.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:50 gibba013 bash[29418]: cluster 2021-03-10T16:59:48.613750+0000 mgr.gibba020.yqfnwy (mgr.34427) 9851 : cluster [DBG] pgmap v5612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:50.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:50 gibba013 bash[30381]: cluster 2021-03-10T16:59:48.613750+0000 mgr.gibba020.yqfnwy (mgr.34427) 9851 : cluster [DBG] pgmap v5612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:50.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:50 gibba020 bash[25448]: cluster 2021-03-10T16:59:48.613750+0000 mgr.gibba020.yqfnwy (mgr.34427) 9851 : cluster [DBG] pgmap v5612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:52.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:52 gibba013 bash[29418]: cluster 2021-03-10T16:59:50.615183+0000 mgr.gibba020.yqfnwy (mgr.34427) 9852 : cluster [DBG] pgmap v5613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:52.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:52 gibba013 bash[30381]: cluster 2021-03-10T16:59:50.615183+0000 mgr.gibba020.yqfnwy (mgr.34427) 9852 : cluster [DBG] pgmap v5613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:52.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:52 gibba020 bash[25448]: cluster 2021-03-10T16:59:50.615183+0000 mgr.gibba020.yqfnwy (mgr.34427) 9852 : cluster [DBG] pgmap v5613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:54.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:54 gibba013 bash[29418]: cluster 2021-03-10T16:59:52.616686+0000 mgr.gibba020.yqfnwy (mgr.34427) 9853 : cluster [DBG] pgmap v5614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:54.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:54 gibba013 bash[30381]: cluster 2021-03-10T16:59:52.616686+0000 mgr.gibba020.yqfnwy (mgr.34427) 9853 : cluster [DBG] pgmap v5614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:54.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:54 gibba020 bash[25448]: cluster 2021-03-10T16:59:52.616686+0000 mgr.gibba020.yqfnwy (mgr.34427) 9853 : cluster [DBG] pgmap v5614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:56.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:56 gibba013 bash[29418]: cluster 2021-03-10T16:59:54.618254+0000 mgr.gibba020.yqfnwy (mgr.34427) 9854 : cluster [DBG] pgmap v5615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:56.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:56 gibba013 bash[30381]: cluster 2021-03-10T16:59:54.618254+0000 mgr.gibba020.yqfnwy (mgr.34427) 9854 : cluster [DBG] pgmap v5615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:56.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:56 gibba020 bash[25448]: cluster 2021-03-10T16:59:54.618254+0000 mgr.gibba020.yqfnwy (mgr.34427) 9854 : cluster [DBG] pgmap v5615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:58.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 16:59:58 gibba013 bash[29418]: cluster 2021-03-10T16:59:56.619736+0000 mgr.gibba020.yqfnwy (mgr.34427) 9855 : cluster [DBG] pgmap v5616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:58.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 16:59:58 gibba013 bash[30381]: cluster 2021-03-10T16:59:56.619736+0000 mgr.gibba020.yqfnwy (mgr.34427) 9855 : cluster [DBG] pgmap v5616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T16:59:58.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 16:59:58 gibba020 bash[25448]: cluster 2021-03-10T16:59:56.619736+0000 mgr.gibba020.yqfnwy (mgr.34427) 9855 : cluster [DBG] pgmap v5616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:00.322 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:00 gibba013 bash[29418]: debug 2021-03-10T16:59:59.998+0000 7fd718a82700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:00:00.610 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:00 gibba020 bash[25448]: cluster 2021-03-10T16:59:58.620706+0000 mgr.gibba020.yqfnwy (mgr.34427) 9856 : cluster [DBG] pgmap v5617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:00.610 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:00 gibba020 bash[25448]: cluster 2021-03-10T17:00:00.000430+0000 mon.a (mon.0) 3535 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:00:00.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:00 gibba013 bash[29418]: cluster 2021-03-10T16:59:58.620706+0000 mgr.gibba020.yqfnwy (mgr.34427) 9856 : cluster [DBG] pgmap v5617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:00.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:00 gibba013 bash[29418]: cluster 2021-03-10T17:00:00.000430+0000 mon.a (mon.0) 3535 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:00:00.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:00 gibba013 bash[30381]: cluster 2021-03-10T16:59:58.620706+0000 mgr.gibba020.yqfnwy (mgr.34427) 9856 : cluster [DBG] pgmap v5617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:00.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:00 gibba013 bash[30381]: cluster 2021-03-10T17:00:00.000430+0000 mon.a (mon.0) 3535 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:00:02.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:02 gibba013 bash[29418]: cephadm 2021-03-10T17:00:00.608953+0000 mgr.gibba020.yqfnwy (mgr.34427) 9857 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:00:02.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:02 gibba013 bash[29418]: cluster 2021-03-10T17:00:00.622061+0000 mgr.gibba020.yqfnwy (mgr.34427) 9858 : cluster [DBG] pgmap v5618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:02.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:02 gibba013 bash[30381]: cephadm 2021-03-10T17:00:00.608953+0000 mgr.gibba020.yqfnwy (mgr.34427) 9857 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:00:02.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:02 gibba013 bash[30381]: cluster 2021-03-10T17:00:00.622061+0000 mgr.gibba020.yqfnwy (mgr.34427) 9858 : cluster [DBG] pgmap v5618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:02.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:02 gibba020 bash[25448]: cephadm 2021-03-10T17:00:00.608953+0000 mgr.gibba020.yqfnwy (mgr.34427) 9857 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:00:02.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:02 gibba020 bash[25448]: cluster 2021-03-10T17:00:00.622061+0000 mgr.gibba020.yqfnwy (mgr.34427) 9858 : cluster [DBG] pgmap v5618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:03.447 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 17:00:03 gibba020 bash[19712]: level=info ts=2021-03-10T17:00:03.134Z caller=compact.go:507 component=tsdb msg="write block" mint=1615384801606 maxt=1615392000000 ulid=01F0EH9GM38CCEJ8FK01CCZY4C duration=58.240551ms 2021-03-10T17:00:03.448 INFO:journalctl@ceph.prometheus.a.gibba020.stdout:Mar 10 17:00:03 gibba020 bash[19712]: level=info ts=2021-03-10T17:00:03.135Z caller=head.go:847 component=tsdb msg="Head GC completed" duration=1.430377ms 2021-03-10T17:00:04.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:04 gibba013 bash[29418]: cluster 2021-03-10T17:00:02.623485+0000 mgr.gibba020.yqfnwy (mgr.34427) 9859 : cluster [DBG] pgmap v5619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:04.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:04 gibba013 bash[30381]: cluster 2021-03-10T17:00:02.623485+0000 mgr.gibba020.yqfnwy (mgr.34427) 9859 : cluster [DBG] pgmap v5619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:04.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:04 gibba020 bash[25448]: cluster 2021-03-10T17:00:02.623485+0000 mgr.gibba020.yqfnwy (mgr.34427) 9859 : cluster [DBG] pgmap v5619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:06.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:06 gibba013 bash[29418]: cluster 2021-03-10T17:00:04.625085+0000 mgr.gibba020.yqfnwy (mgr.34427) 9860 : cluster [DBG] pgmap v5620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:06.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:06 gibba013 bash[30381]: cluster 2021-03-10T17:00:04.625085+0000 mgr.gibba020.yqfnwy (mgr.34427) 9860 : cluster [DBG] pgmap v5620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:06.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:06 gibba020 bash[25448]: cluster 2021-03-10T17:00:04.625085+0000 mgr.gibba020.yqfnwy (mgr.34427) 9860 : cluster [DBG] pgmap v5620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:07 gibba013 bash[29418]: audit 2021-03-10T17:00:06.860930+0000 mon.a (mon.0) 3536 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:00:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:07 gibba013 bash[29418]: audit 2021-03-10T17:00:07.054383+0000 mon.a (mon.0) 3537 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:00:07.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:07 gibba013 bash[30381]: audit 2021-03-10T17:00:06.860930+0000 mon.a (mon.0) 3536 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:00:07.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:07 gibba013 bash[30381]: audit 2021-03-10T17:00:07.054383+0000 mon.a (mon.0) 3537 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:00:07.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:07 gibba020 bash[25448]: audit 2021-03-10T17:00:06.860930+0000 mon.a (mon.0) 3536 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:00:07.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:07 gibba020 bash[25448]: audit 2021-03-10T17:00:07.054383+0000 mon.a (mon.0) 3537 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:00:08.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:08 gibba013 bash[30381]: cluster 2021-03-10T17:00:06.625933+0000 mgr.gibba020.yqfnwy (mgr.34427) 9861 : cluster [DBG] pgmap v5621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:08.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:08 gibba013 bash[30381]: audit 2021-03-10T17:00:07.454434+0000 mon.a (mon.0) 3538 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:00:08.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:08 gibba013 bash[30381]: audit 2021-03-10T17:00:07.455577+0000 mon.a (mon.0) 3539 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:00:08.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:08 gibba013 bash[30381]: audit 2021-03-10T17:00:07.456616+0000 mon.a (mon.0) 3540 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T17:00:08.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:08 gibba013 bash[30381]: audit 2021-03-10T17:00:07.457660+0000 mon.a (mon.0) 3541 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:00:08.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:08 gibba013 bash[29418]: cluster 2021-03-10T17:00:06.625933+0000 mgr.gibba020.yqfnwy (mgr.34427) 9861 : cluster [DBG] pgmap v5621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:08.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:08 gibba013 bash[29418]: audit 2021-03-10T17:00:07.454434+0000 mon.a (mon.0) 3538 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:00:08.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:08 gibba013 bash[29418]: audit 2021-03-10T17:00:07.455577+0000 mon.a (mon.0) 3539 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:00:08.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:08 gibba013 bash[29418]: audit 2021-03-10T17:00:07.456616+0000 mon.a (mon.0) 3540 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T17:00:08.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:08 gibba013 bash[29418]: audit 2021-03-10T17:00:07.457660+0000 mon.a (mon.0) 3541 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:00:08.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:08 gibba020 bash[25448]: cluster 2021-03-10T17:00:06.625933+0000 mgr.gibba020.yqfnwy (mgr.34427) 9861 : cluster [DBG] pgmap v5621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:08.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:08 gibba020 bash[25448]: audit 2021-03-10T17:00:07.454434+0000 mon.a (mon.0) 3538 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:00:08.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:08 gibba020 bash[25448]: audit 2021-03-10T17:00:07.455577+0000 mon.a (mon.0) 3539 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:00:08.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:08 gibba020 bash[25448]: audit 2021-03-10T17:00:07.456616+0000 mon.a (mon.0) 3540 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T17:00:08.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:08 gibba020 bash[25448]: audit 2021-03-10T17:00:07.457660+0000 mon.a (mon.0) 3541 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:00:10.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:10 gibba013 bash[29418]: cluster 2021-03-10T17:00:08.627365+0000 mgr.gibba020.yqfnwy (mgr.34427) 9862 : cluster [DBG] pgmap v5622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:10.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:10 gibba013 bash[30381]: cluster 2021-03-10T17:00:08.627365+0000 mgr.gibba020.yqfnwy (mgr.34427) 9862 : cluster [DBG] pgmap v5622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:10.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:10 gibba020 bash[25448]: cluster 2021-03-10T17:00:08.627365+0000 mgr.gibba020.yqfnwy (mgr.34427) 9862 : cluster [DBG] pgmap v5622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:12.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:12 gibba020 bash[25448]: cluster 2021-03-10T17:00:10.629088+0000 mgr.gibba020.yqfnwy (mgr.34427) 9863 : cluster [DBG] pgmap v5623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:12.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:12 gibba013 bash[29418]: cluster 2021-03-10T17:00:10.629088+0000 mgr.gibba020.yqfnwy (mgr.34427) 9863 : cluster [DBG] pgmap v5623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:12.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:12 gibba013 bash[30381]: cluster 2021-03-10T17:00:10.629088+0000 mgr.gibba020.yqfnwy (mgr.34427) 9863 : cluster [DBG] pgmap v5623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:14.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:14 gibba020 bash[25448]: cluster 2021-03-10T17:00:12.630503+0000 mgr.gibba020.yqfnwy (mgr.34427) 9864 : cluster [DBG] pgmap v5624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:14.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:14 gibba013 bash[29418]: cluster 2021-03-10T17:00:12.630503+0000 mgr.gibba020.yqfnwy (mgr.34427) 9864 : cluster [DBG] pgmap v5624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:14.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:14 gibba013 bash[30381]: cluster 2021-03-10T17:00:12.630503+0000 mgr.gibba020.yqfnwy (mgr.34427) 9864 : cluster [DBG] pgmap v5624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:16.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:16 gibba020 bash[25448]: cluster 2021-03-10T17:00:14.631300+0000 mgr.gibba020.yqfnwy (mgr.34427) 9865 : cluster [DBG] pgmap v5625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:16.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:16 gibba020 bash[25448]: audit 2021-03-10T17:00:15.626256+0000 mon.a (mon.0) 3542 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:00:16.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:16 gibba020 bash[25448]: audit 2021-03-10T17:00:15.828178+0000 mon.a (mon.0) 3543 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:00:16.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:16 gibba020 bash[25448]: audit 2021-03-10T17:00:15.831384+0000 mon.a (mon.0) 3544 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:00:16.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:16 gibba020 bash[25448]: audit 2021-03-10T17:00:15.833052+0000 mon.a (mon.0) 3545 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:16.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:16 gibba020 bash[25448]: audit 2021-03-10T17:00:15.834827+0000 mon.a (mon.0) 3546 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:16.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:16 gibba020 bash[25448]: audit 2021-03-10T17:00:15.836461+0000 mon.a (mon.0) 3547 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:16.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:16 gibba020 bash[25448]: audit 2021-03-10T17:00:15.840050+0000 mon.a (mon.0) 3548 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:16.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:16 gibba020 bash[25448]: audit 2021-03-10T17:00:15.841929+0000 mon.a (mon.0) 3549 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:16.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:16 gibba013 bash[29418]: cluster 2021-03-10T17:00:14.631300+0000 mgr.gibba020.yqfnwy (mgr.34427) 9865 : cluster [DBG] pgmap v5625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:16.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:16 gibba013 bash[29418]: audit 2021-03-10T17:00:15.626256+0000 mon.a (mon.0) 3542 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:00:16.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:16 gibba013 bash[29418]: audit 2021-03-10T17:00:15.828178+0000 mon.a (mon.0) 3543 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:00:16.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:16 gibba013 bash[29418]: audit 2021-03-10T17:00:15.831384+0000 mon.a (mon.0) 3544 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:00:16.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:16 gibba013 bash[29418]: audit 2021-03-10T17:00:15.833052+0000 mon.a (mon.0) 3545 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:16.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:16 gibba013 bash[29418]: audit 2021-03-10T17:00:15.834827+0000 mon.a (mon.0) 3546 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:16.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:16 gibba013 bash[29418]: audit 2021-03-10T17:00:15.836461+0000 mon.a (mon.0) 3547 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:16.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:16 gibba013 bash[29418]: audit 2021-03-10T17:00:15.840050+0000 mon.a (mon.0) 3548 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:16.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:16 gibba013 bash[29418]: audit 2021-03-10T17:00:15.841929+0000 mon.a (mon.0) 3549 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:16.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:16 gibba013 bash[30381]: cluster 2021-03-10T17:00:14.631300+0000 mgr.gibba020.yqfnwy (mgr.34427) 9865 : cluster [DBG] pgmap v5625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:16.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:16 gibba013 bash[30381]: audit 2021-03-10T17:00:15.626256+0000 mon.a (mon.0) 3542 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:00:16.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:16 gibba013 bash[30381]: audit 2021-03-10T17:00:15.828178+0000 mon.a (mon.0) 3543 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:00:16.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:16 gibba013 bash[30381]: audit 2021-03-10T17:00:15.831384+0000 mon.a (mon.0) 3544 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:00:16.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:16 gibba013 bash[30381]: audit 2021-03-10T17:00:15.833052+0000 mon.a (mon.0) 3545 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:16.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:16 gibba013 bash[30381]: audit 2021-03-10T17:00:15.834827+0000 mon.a (mon.0) 3546 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:16.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:16 gibba013 bash[30381]: audit 2021-03-10T17:00:15.836461+0000 mon.a (mon.0) 3547 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:16.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:16 gibba013 bash[30381]: audit 2021-03-10T17:00:15.840050+0000 mon.a (mon.0) 3548 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:16.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:16 gibba013 bash[30381]: audit 2021-03-10T17:00:15.841929+0000 mon.a (mon.0) 3549 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:16.953 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:00:17.177 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:00:17.177 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 9m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:00:17.178 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 8m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:00:17.178 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:00:17.178 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:00:17.178 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:00:17.179 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:00:17.179 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:00:17.179 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:00:17.179 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:00:17.180 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:00:17.184 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:00:17.184 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:00:17.184 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:00:17.185 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:00:17.185 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:00:17.185 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:00:17.185 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:00:17.186 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:00:17.186 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 8m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:00:17.186 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 8m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:00:17.426 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:00:17.426 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:00:17.427 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:00:17.427 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:00:17.427 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:00:17.427 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:00:17.428 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:00:17.428 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:00:17.428 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:00:17.429 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:00:17.429 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:00:17.429 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:00:17.429 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:00:17.430 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:00:17.430 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:00:17.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:17 gibba020 bash[25448]: cephadm 2021-03-10T17:00:15.631258+0000 mgr.gibba020.yqfnwy (mgr.34427) 9866 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:00:17.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:17 gibba020 bash[25448]: cephadm 2021-03-10T17:00:15.633286+0000 mgr.gibba020.yqfnwy (mgr.34427) 9867 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:00:17.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:17 gibba020 bash[25448]: cephadm 2021-03-10T17:00:15.830146+0000 mgr.gibba020.yqfnwy (mgr.34427) 9868 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:00:17.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:17 gibba020 bash[25448]: cephadm 2021-03-10T17:00:15.831932+0000 mgr.gibba020.yqfnwy (mgr.34427) 9869 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:00:17.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:17 gibba020 bash[25448]: cephadm 2021-03-10T17:00:15.833560+0000 mgr.gibba020.yqfnwy (mgr.34427) 9870 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:00:17.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:17 gibba020 bash[25448]: cephadm 2021-03-10T17:00:15.833629+0000 mgr.gibba020.yqfnwy (mgr.34427) 9871 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:00:17.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:17 gibba020 bash[25448]: cephadm 2021-03-10T17:00:15.835429+0000 mgr.gibba020.yqfnwy (mgr.34427) 9872 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:00:17.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:17 gibba020 bash[25448]: cephadm 2021-03-10T17:00:15.835465+0000 mgr.gibba020.yqfnwy (mgr.34427) 9873 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:00:17.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:17 gibba020 bash[25448]: cephadm 2021-03-10T17:00:15.837100+0000 mgr.gibba020.yqfnwy (mgr.34427) 9874 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:00:17.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:17 gibba020 bash[25448]: cephadm 2021-03-10T17:00:15.838894+0000 mgr.gibba020.yqfnwy (mgr.34427) 9875 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:00:17.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:17 gibba020 bash[25448]: cephadm 2021-03-10T17:00:15.838931+0000 mgr.gibba020.yqfnwy (mgr.34427) 9876 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:00:17.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:17 gibba020 bash[25448]: cephadm 2021-03-10T17:00:15.840675+0000 mgr.gibba020.yqfnwy (mgr.34427) 9877 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:00:17.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:17 gibba020 bash[25448]: cephadm 2021-03-10T17:00:15.840992+0000 mgr.gibba020.yqfnwy (mgr.34427) 9878 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:00:17.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:17 gibba020 bash[25448]: cephadm 2021-03-10T17:00:15.842593+0000 mgr.gibba020.yqfnwy (mgr.34427) 9879 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:00:17.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:17 gibba020 bash[25448]: cephadm 2021-03-10T17:00:15.842704+0000 mgr.gibba020.yqfnwy (mgr.34427) 9880 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:00:17.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:17 gibba020 bash[25448]: cephadm 2021-03-10T17:00:15.842815+0000 mgr.gibba020.yqfnwy (mgr.34427) 9881 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:00:17.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:17 gibba013 bash[29418]: cephadm 2021-03-10T17:00:15.631258+0000 mgr.gibba020.yqfnwy (mgr.34427) 9866 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:00:17.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:17 gibba013 bash[29418]: cephadm 2021-03-10T17:00:15.633286+0000 mgr.gibba020.yqfnwy (mgr.34427) 9867 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:00:17.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:17 gibba013 bash[29418]: cephadm 2021-03-10T17:00:15.830146+0000 mgr.gibba020.yqfnwy (mgr.34427) 9868 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:00:17.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:17 gibba013 bash[29418]: cephadm 2021-03-10T17:00:15.831932+0000 mgr.gibba020.yqfnwy (mgr.34427) 9869 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:00:17.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:17 gibba013 bash[29418]: cephadm 2021-03-10T17:00:15.833560+0000 mgr.gibba020.yqfnwy (mgr.34427) 9870 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:00:17.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:17 gibba013 bash[29418]: cephadm 2021-03-10T17:00:15.833629+0000 mgr.gibba020.yqfnwy (mgr.34427) 9871 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:00:17.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:17 gibba013 bash[29418]: cephadm 2021-03-10T17:00:15.835429+0000 mgr.gibba020.yqfnwy (mgr.34427) 9872 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:00:17.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:17 gibba013 bash[29418]: cephadm 2021-03-10T17:00:15.835465+0000 mgr.gibba020.yqfnwy (mgr.34427) 9873 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:00:17.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:17 gibba013 bash[29418]: cephadm 2021-03-10T17:00:15.837100+0000 mgr.gibba020.yqfnwy (mgr.34427) 9874 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:00:17.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:17 gibba013 bash[29418]: cephadm 2021-03-10T17:00:15.838894+0000 mgr.gibba020.yqfnwy (mgr.34427) 9875 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:00:17.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:17 gibba013 bash[29418]: cephadm 2021-03-10T17:00:15.838931+0000 mgr.gibba020.yqfnwy (mgr.34427) 9876 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:00:17.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:17 gibba013 bash[29418]: cephadm 2021-03-10T17:00:15.840675+0000 mgr.gibba020.yqfnwy (mgr.34427) 9877 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:00:17.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:17 gibba013 bash[29418]: cephadm 2021-03-10T17:00:15.840992+0000 mgr.gibba020.yqfnwy (mgr.34427) 9878 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:00:17.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:17 gibba013 bash[29418]: cephadm 2021-03-10T17:00:15.842593+0000 mgr.gibba020.yqfnwy (mgr.34427) 9879 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:00:17.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:17 gibba013 bash[29418]: cephadm 2021-03-10T17:00:15.842704+0000 mgr.gibba020.yqfnwy (mgr.34427) 9880 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:00:17.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:17 gibba013 bash[29418]: cephadm 2021-03-10T17:00:15.842815+0000 mgr.gibba020.yqfnwy (mgr.34427) 9881 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:00:17.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:17 gibba013 bash[30381]: cephadm 2021-03-10T17:00:15.631258+0000 mgr.gibba020.yqfnwy (mgr.34427) 9866 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:00:17.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:17 gibba013 bash[30381]: cephadm 2021-03-10T17:00:15.633286+0000 mgr.gibba020.yqfnwy (mgr.34427) 9867 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:00:17.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:17 gibba013 bash[30381]: cephadm 2021-03-10T17:00:15.830146+0000 mgr.gibba020.yqfnwy (mgr.34427) 9868 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:00:17.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:17 gibba013 bash[30381]: cephadm 2021-03-10T17:00:15.831932+0000 mgr.gibba020.yqfnwy (mgr.34427) 9869 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:00:17.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:17 gibba013 bash[30381]: cephadm 2021-03-10T17:00:15.833560+0000 mgr.gibba020.yqfnwy (mgr.34427) 9870 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:00:17.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:17 gibba013 bash[30381]: cephadm 2021-03-10T17:00:15.833629+0000 mgr.gibba020.yqfnwy (mgr.34427) 9871 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:00:17.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:17 gibba013 bash[30381]: cephadm 2021-03-10T17:00:15.835429+0000 mgr.gibba020.yqfnwy (mgr.34427) 9872 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:00:17.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:17 gibba013 bash[30381]: cephadm 2021-03-10T17:00:15.835465+0000 mgr.gibba020.yqfnwy (mgr.34427) 9873 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:00:17.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:17 gibba013 bash[30381]: cephadm 2021-03-10T17:00:15.837100+0000 mgr.gibba020.yqfnwy (mgr.34427) 9874 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:00:17.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:17 gibba013 bash[30381]: cephadm 2021-03-10T17:00:15.838894+0000 mgr.gibba020.yqfnwy (mgr.34427) 9875 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:00:17.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:17 gibba013 bash[30381]: cephadm 2021-03-10T17:00:15.838931+0000 mgr.gibba020.yqfnwy (mgr.34427) 9876 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:00:17.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:17 gibba013 bash[30381]: cephadm 2021-03-10T17:00:15.840675+0000 mgr.gibba020.yqfnwy (mgr.34427) 9877 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:00:17.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:17 gibba013 bash[30381]: cephadm 2021-03-10T17:00:15.840992+0000 mgr.gibba020.yqfnwy (mgr.34427) 9878 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:00:17.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:17 gibba013 bash[30381]: cephadm 2021-03-10T17:00:15.842593+0000 mgr.gibba020.yqfnwy (mgr.34427) 9879 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:00:17.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:17 gibba013 bash[30381]: cephadm 2021-03-10T17:00:15.842704+0000 mgr.gibba020.yqfnwy (mgr.34427) 9880 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:00:17.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:17 gibba013 bash[30381]: cephadm 2021-03-10T17:00:15.842815+0000 mgr.gibba020.yqfnwy (mgr.34427) 9881 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:00:18.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:18 gibba020 bash[25448]: cluster 2021-03-10T17:00:16.631887+0000 mgr.gibba020.yqfnwy (mgr.34427) 9882 : cluster [DBG] pgmap v5626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:18.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:18 gibba020 bash[25448]: audit 2021-03-10T17:00:16.943569+0000 mgr.gibba020.yqfnwy (mgr.34427) 9883 : audit [DBG] from='client.50676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:00:18.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:18 gibba020 bash[25448]: audit 2021-03-10T17:00:17.167605+0000 mgr.gibba020.yqfnwy (mgr.34427) 9884 : audit [DBG] from='client.50682 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:00:18.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:18 gibba020 bash[25448]: audit 2021-03-10T17:00:17.425852+0000 mon.c (mon.1) 152 : audit [DBG] from='client.? 172.21.2.113:0/3850002021' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:18.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:18 gibba013 bash[29418]: cluster 2021-03-10T17:00:16.631887+0000 mgr.gibba020.yqfnwy (mgr.34427) 9882 : cluster [DBG] pgmap v5626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:18.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:18 gibba013 bash[29418]: audit 2021-03-10T17:00:16.943569+0000 mgr.gibba020.yqfnwy (mgr.34427) 9883 : audit [DBG] from='client.50676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:00:18.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:18 gibba013 bash[29418]: audit 2021-03-10T17:00:17.167605+0000 mgr.gibba020.yqfnwy (mgr.34427) 9884 : audit [DBG] from='client.50682 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:00:18.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:18 gibba013 bash[29418]: audit 2021-03-10T17:00:17.425852+0000 mon.c (mon.1) 152 : audit [DBG] from='client.? 172.21.2.113:0/3850002021' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:18.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:18 gibba013 bash[30381]: cluster 2021-03-10T17:00:16.631887+0000 mgr.gibba020.yqfnwy (mgr.34427) 9882 : cluster [DBG] pgmap v5626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:18.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:18 gibba013 bash[30381]: audit 2021-03-10T17:00:16.943569+0000 mgr.gibba020.yqfnwy (mgr.34427) 9883 : audit [DBG] from='client.50676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:00:18.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:18 gibba013 bash[30381]: audit 2021-03-10T17:00:17.167605+0000 mgr.gibba020.yqfnwy (mgr.34427) 9884 : audit [DBG] from='client.50682 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:00:18.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:18 gibba013 bash[30381]: audit 2021-03-10T17:00:17.425852+0000 mon.c (mon.1) 152 : audit [DBG] from='client.? 172.21.2.113:0/3850002021' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:19.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:19 gibba020 bash[25448]: cluster 2021-03-10T17:00:18.633237+0000 mgr.gibba020.yqfnwy (mgr.34427) 9885 : cluster [DBG] pgmap v5627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:19.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:19 gibba013 bash[29418]: cluster 2021-03-10T17:00:18.633237+0000 mgr.gibba020.yqfnwy (mgr.34427) 9885 : cluster [DBG] pgmap v5627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:19.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:19 gibba013 bash[30381]: cluster 2021-03-10T17:00:18.633237+0000 mgr.gibba020.yqfnwy (mgr.34427) 9885 : cluster [DBG] pgmap v5627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:22.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:22 gibba013 bash[29418]: cluster 2021-03-10T17:00:20.635042+0000 mgr.gibba020.yqfnwy (mgr.34427) 9886 : cluster [DBG] pgmap v5628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:22.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:22 gibba013 bash[30381]: cluster 2021-03-10T17:00:20.635042+0000 mgr.gibba020.yqfnwy (mgr.34427) 9886 : cluster [DBG] pgmap v5628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:22.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:22 gibba020 bash[25448]: cluster 2021-03-10T17:00:20.635042+0000 mgr.gibba020.yqfnwy (mgr.34427) 9886 : cluster [DBG] pgmap v5628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:24.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:24 gibba013 bash[29418]: cluster 2021-03-10T17:00:22.635957+0000 mgr.gibba020.yqfnwy (mgr.34427) 9887 : cluster [DBG] pgmap v5629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:24.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:24 gibba013 bash[30381]: cluster 2021-03-10T17:00:22.635957+0000 mgr.gibba020.yqfnwy (mgr.34427) 9887 : cluster [DBG] pgmap v5629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:24.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:24 gibba020 bash[25448]: cluster 2021-03-10T17:00:22.635957+0000 mgr.gibba020.yqfnwy (mgr.34427) 9887 : cluster [DBG] pgmap v5629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:26.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:26 gibba013 bash[29418]: cluster 2021-03-10T17:00:24.637626+0000 mgr.gibba020.yqfnwy (mgr.34427) 9888 : cluster [DBG] pgmap v5630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:26.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:26 gibba013 bash[30381]: cluster 2021-03-10T17:00:24.637626+0000 mgr.gibba020.yqfnwy (mgr.34427) 9888 : cluster [DBG] pgmap v5630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:26.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:26 gibba020 bash[25448]: cluster 2021-03-10T17:00:24.637626+0000 mgr.gibba020.yqfnwy (mgr.34427) 9888 : cluster [DBG] pgmap v5630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:28.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:28 gibba013 bash[29418]: cluster 2021-03-10T17:00:26.639543+0000 mgr.gibba020.yqfnwy (mgr.34427) 9889 : cluster [DBG] pgmap v5631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:28.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:28 gibba013 bash[30381]: cluster 2021-03-10T17:00:26.639543+0000 mgr.gibba020.yqfnwy (mgr.34427) 9889 : cluster [DBG] pgmap v5631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:28.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:28 gibba020 bash[25448]: cluster 2021-03-10T17:00:26.639543+0000 mgr.gibba020.yqfnwy (mgr.34427) 9889 : cluster [DBG] pgmap v5631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:30.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:30 gibba013 bash[29418]: cluster 2021-03-10T17:00:28.641170+0000 mgr.gibba020.yqfnwy (mgr.34427) 9890 : cluster [DBG] pgmap v5632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:30.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:30 gibba013 bash[30381]: cluster 2021-03-10T17:00:28.641170+0000 mgr.gibba020.yqfnwy (mgr.34427) 9890 : cluster [DBG] pgmap v5632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:30.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:30 gibba020 bash[25448]: cluster 2021-03-10T17:00:28.641170+0000 mgr.gibba020.yqfnwy (mgr.34427) 9890 : cluster [DBG] pgmap v5632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:32.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:32 gibba013 bash[29418]: cluster 2021-03-10T17:00:30.642297+0000 mgr.gibba020.yqfnwy (mgr.34427) 9891 : cluster [DBG] pgmap v5633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:32.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:32 gibba013 bash[29418]: cephadm 2021-03-10T17:00:30.858847+0000 mgr.gibba020.yqfnwy (mgr.34427) 9892 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:00:32.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:32 gibba013 bash[30381]: cluster 2021-03-10T17:00:30.642297+0000 mgr.gibba020.yqfnwy (mgr.34427) 9891 : cluster [DBG] pgmap v5633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:32.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:32 gibba013 bash[30381]: cephadm 2021-03-10T17:00:30.858847+0000 mgr.gibba020.yqfnwy (mgr.34427) 9892 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:00:32.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:32 gibba020 bash[25448]: cluster 2021-03-10T17:00:30.642297+0000 mgr.gibba020.yqfnwy (mgr.34427) 9891 : cluster [DBG] pgmap v5633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:32.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:32 gibba020 bash[25448]: cephadm 2021-03-10T17:00:30.858847+0000 mgr.gibba020.yqfnwy (mgr.34427) 9892 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:00:34.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:34 gibba013 bash[29418]: cluster 2021-03-10T17:00:32.643907+0000 mgr.gibba020.yqfnwy (mgr.34427) 9893 : cluster [DBG] pgmap v5634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:34.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:34 gibba013 bash[30381]: cluster 2021-03-10T17:00:32.643907+0000 mgr.gibba020.yqfnwy (mgr.34427) 9893 : cluster [DBG] pgmap v5634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:34.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:34 gibba020 bash[25448]: cluster 2021-03-10T17:00:32.643907+0000 mgr.gibba020.yqfnwy (mgr.34427) 9893 : cluster [DBG] pgmap v5634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:36.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:36 gibba013 bash[30381]: cluster 2021-03-10T17:00:34.645792+0000 mgr.gibba020.yqfnwy (mgr.34427) 9894 : cluster [DBG] pgmap v5635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:36.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:36 gibba013 bash[29418]: cluster 2021-03-10T17:00:34.645792+0000 mgr.gibba020.yqfnwy (mgr.34427) 9894 : cluster [DBG] pgmap v5635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:36.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:36 gibba020 bash[25448]: cluster 2021-03-10T17:00:34.645792+0000 mgr.gibba020.yqfnwy (mgr.34427) 9894 : cluster [DBG] pgmap v5635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:38.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:38 gibba013 bash[29418]: cluster 2021-03-10T17:00:36.647297+0000 mgr.gibba020.yqfnwy (mgr.34427) 9895 : cluster [DBG] pgmap v5636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:38.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:38 gibba013 bash[30381]: cluster 2021-03-10T17:00:36.647297+0000 mgr.gibba020.yqfnwy (mgr.34427) 9895 : cluster [DBG] pgmap v5636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:38.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:38 gibba020 bash[25448]: cluster 2021-03-10T17:00:36.647297+0000 mgr.gibba020.yqfnwy (mgr.34427) 9895 : cluster [DBG] pgmap v5636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:40.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:40 gibba013 bash[29418]: cluster 2021-03-10T17:00:38.648284+0000 mgr.gibba020.yqfnwy (mgr.34427) 9896 : cluster [DBG] pgmap v5637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:40.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:40 gibba013 bash[30381]: cluster 2021-03-10T17:00:38.648284+0000 mgr.gibba020.yqfnwy (mgr.34427) 9896 : cluster [DBG] pgmap v5637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:40.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:40 gibba020 bash[25448]: cluster 2021-03-10T17:00:38.648284+0000 mgr.gibba020.yqfnwy (mgr.34427) 9896 : cluster [DBG] pgmap v5637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:42.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:42 gibba013 bash[29418]: cluster 2021-03-10T17:00:40.649925+0000 mgr.gibba020.yqfnwy (mgr.34427) 9897 : cluster [DBG] pgmap v5638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:42.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:42 gibba013 bash[30381]: cluster 2021-03-10T17:00:40.649925+0000 mgr.gibba020.yqfnwy (mgr.34427) 9897 : cluster [DBG] pgmap v5638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:42.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:42 gibba020 bash[25448]: cluster 2021-03-10T17:00:40.649925+0000 mgr.gibba020.yqfnwy (mgr.34427) 9897 : cluster [DBG] pgmap v5638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:44.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:44 gibba013 bash[29418]: cluster 2021-03-10T17:00:42.651523+0000 mgr.gibba020.yqfnwy (mgr.34427) 9898 : cluster [DBG] pgmap v5639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:44.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:44 gibba013 bash[30381]: cluster 2021-03-10T17:00:42.651523+0000 mgr.gibba020.yqfnwy (mgr.34427) 9898 : cluster [DBG] pgmap v5639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:44.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:44 gibba020 bash[25448]: cluster 2021-03-10T17:00:42.651523+0000 mgr.gibba020.yqfnwy (mgr.34427) 9898 : cluster [DBG] pgmap v5639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:46.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:46 gibba013 bash[29418]: cluster 2021-03-10T17:00:44.653181+0000 mgr.gibba020.yqfnwy (mgr.34427) 9899 : cluster [DBG] pgmap v5640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:46.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:46 gibba013 bash[30381]: cluster 2021-03-10T17:00:44.653181+0000 mgr.gibba020.yqfnwy (mgr.34427) 9899 : cluster [DBG] pgmap v5640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:46.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:46 gibba020 bash[25448]: cluster 2021-03-10T17:00:44.653181+0000 mgr.gibba020.yqfnwy (mgr.34427) 9899 : cluster [DBG] pgmap v5640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:47.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:47 gibba013 bash[29418]: cephadm 2021-03-10T17:00:45.860253+0000 mgr.gibba020.yqfnwy (mgr.34427) 9900 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:00:47.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:47 gibba013 bash[30381]: cephadm 2021-03-10T17:00:45.860253+0000 mgr.gibba020.yqfnwy (mgr.34427) 9900 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:00:47.678 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:00:47.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:47 gibba020 bash[25448]: cephadm 2021-03-10T17:00:45.860253+0000 mgr.gibba020.yqfnwy (mgr.34427) 9900 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:00:47.907 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:00:47.908 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 9m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:00:47.908 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 8m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:00:47.908 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:00:47.908 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:00:47.909 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:00:47.909 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:00:47.909 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:00:47.909 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:00:47.909 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:00:47.910 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:00:47.910 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:00:47.910 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:00:47.910 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:00:47.911 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:00:47.911 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:00:47.911 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:00:47.911 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:00:47.911 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:00:47.912 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 8m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:00:47.912 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 8m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:00:48.161 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:00:48.161 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:00:48.161 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:00:48.162 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:00:48.162 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:00:48.162 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:00:48.162 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:00:48.163 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:00:48.163 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:00:48.163 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:00:48.163 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:00:48.164 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:00:48.164 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:00:48.164 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:00:48.164 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:00:48.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:48 gibba013 bash[29418]: cluster 2021-03-10T17:00:46.654814+0000 mgr.gibba020.yqfnwy (mgr.34427) 9901 : cluster [DBG] pgmap v5641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:48.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:48 gibba013 bash[29418]: audit 2021-03-10T17:00:48.160929+0000 mon.a (mon.0) 3550 : audit [DBG] from='client.? 172.21.2.113:0/3475092811' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:48.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:48 gibba013 bash[30381]: cluster 2021-03-10T17:00:46.654814+0000 mgr.gibba020.yqfnwy (mgr.34427) 9901 : cluster [DBG] pgmap v5641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:48.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:48 gibba013 bash[30381]: audit 2021-03-10T17:00:48.160929+0000 mon.a (mon.0) 3550 : audit [DBG] from='client.? 172.21.2.113:0/3475092811' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:48.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:48 gibba020 bash[25448]: cluster 2021-03-10T17:00:46.654814+0000 mgr.gibba020.yqfnwy (mgr.34427) 9901 : cluster [DBG] pgmap v5641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:48.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:48 gibba020 bash[25448]: audit 2021-03-10T17:00:48.160929+0000 mon.a (mon.0) 3550 : audit [DBG] from='client.? 172.21.2.113:0/3475092811' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:00:49.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:49 gibba013 bash[29418]: audit 2021-03-10T17:00:47.658788+0000 mgr.gibba020.yqfnwy (mgr.34427) 9902 : audit [DBG] from='client.50694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:00:49.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:49 gibba013 bash[29418]: audit 2021-03-10T17:00:47.894492+0000 mgr.gibba020.yqfnwy (mgr.34427) 9903 : audit [DBG] from='client.50700 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:00:49.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:49 gibba013 bash[30381]: audit 2021-03-10T17:00:47.658788+0000 mgr.gibba020.yqfnwy (mgr.34427) 9902 : audit [DBG] from='client.50694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:00:49.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:49 gibba013 bash[30381]: audit 2021-03-10T17:00:47.894492+0000 mgr.gibba020.yqfnwy (mgr.34427) 9903 : audit [DBG] from='client.50700 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:00:49.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:49 gibba020 bash[25448]: audit 2021-03-10T17:00:47.658788+0000 mgr.gibba020.yqfnwy (mgr.34427) 9902 : audit [DBG] from='client.50694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:00:49.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:49 gibba020 bash[25448]: audit 2021-03-10T17:00:47.894492+0000 mgr.gibba020.yqfnwy (mgr.34427) 9903 : audit [DBG] from='client.50700 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:00:50.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:50 gibba013 bash[29418]: cluster 2021-03-10T17:00:48.656387+0000 mgr.gibba020.yqfnwy (mgr.34427) 9904 : cluster [DBG] pgmap v5642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:50.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:50 gibba013 bash[30381]: cluster 2021-03-10T17:00:48.656387+0000 mgr.gibba020.yqfnwy (mgr.34427) 9904 : cluster [DBG] pgmap v5642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:50.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:50 gibba020 bash[25448]: cluster 2021-03-10T17:00:48.656387+0000 mgr.gibba020.yqfnwy (mgr.34427) 9904 : cluster [DBG] pgmap v5642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:52.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:52 gibba013 bash[29418]: cluster 2021-03-10T17:00:50.658155+0000 mgr.gibba020.yqfnwy (mgr.34427) 9905 : cluster [DBG] pgmap v5643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:52.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:52 gibba013 bash[30381]: cluster 2021-03-10T17:00:50.658155+0000 mgr.gibba020.yqfnwy (mgr.34427) 9905 : cluster [DBG] pgmap v5643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:52.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:52 gibba020 bash[25448]: cluster 2021-03-10T17:00:50.658155+0000 mgr.gibba020.yqfnwy (mgr.34427) 9905 : cluster [DBG] pgmap v5643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:54.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:54 gibba013 bash[29418]: cluster 2021-03-10T17:00:52.659575+0000 mgr.gibba020.yqfnwy (mgr.34427) 9906 : cluster [DBG] pgmap v5644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:54.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:54 gibba013 bash[30381]: cluster 2021-03-10T17:00:52.659575+0000 mgr.gibba020.yqfnwy (mgr.34427) 9906 : cluster [DBG] pgmap v5644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:54.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:54 gibba020 bash[25448]: cluster 2021-03-10T17:00:52.659575+0000 mgr.gibba020.yqfnwy (mgr.34427) 9906 : cluster [DBG] pgmap v5644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:56.628 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:56 gibba013 bash[29418]: cluster 2021-03-10T17:00:54.660734+0000 mgr.gibba020.yqfnwy (mgr.34427) 9907 : cluster [DBG] pgmap v5645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:56.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:56 gibba013 bash[30381]: cluster 2021-03-10T17:00:54.660734+0000 mgr.gibba020.yqfnwy (mgr.34427) 9907 : cluster [DBG] pgmap v5645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:56.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:56 gibba020 bash[25448]: cluster 2021-03-10T17:00:54.660734+0000 mgr.gibba020.yqfnwy (mgr.34427) 9907 : cluster [DBG] pgmap v5645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:58.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:00:58 gibba020 bash[25448]: cluster 2021-03-10T17:00:56.661205+0000 mgr.gibba020.yqfnwy (mgr.34427) 9908 : cluster [DBG] pgmap v5646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:58.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:00:58 gibba013 bash[29418]: cluster 2021-03-10T17:00:56.661205+0000 mgr.gibba020.yqfnwy (mgr.34427) 9908 : cluster [DBG] pgmap v5646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:00:58.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:00:58 gibba013 bash[30381]: cluster 2021-03-10T17:00:56.661205+0000 mgr.gibba020.yqfnwy (mgr.34427) 9908 : cluster [DBG] pgmap v5646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:00.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:00 gibba020 bash[25448]: cluster 2021-03-10T17:00:58.662619+0000 mgr.gibba020.yqfnwy (mgr.34427) 9909 : cluster [DBG] pgmap v5647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:00.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:00 gibba013 bash[29418]: cluster 2021-03-10T17:00:58.662619+0000 mgr.gibba020.yqfnwy (mgr.34427) 9909 : cluster [DBG] pgmap v5647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:00.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:00 gibba013 bash[30381]: cluster 2021-03-10T17:00:58.662619+0000 mgr.gibba020.yqfnwy (mgr.34427) 9909 : cluster [DBG] pgmap v5647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:02.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:02 gibba020 bash[25448]: cluster 2021-03-10T17:01:00.664316+0000 mgr.gibba020.yqfnwy (mgr.34427) 9910 : cluster [DBG] pgmap v5648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:02.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:02 gibba020 bash[25448]: cephadm 2021-03-10T17:01:00.869036+0000 mgr.gibba020.yqfnwy (mgr.34427) 9911 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:01:02.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:02 gibba013 bash[29418]: cluster 2021-03-10T17:01:00.664316+0000 mgr.gibba020.yqfnwy (mgr.34427) 9910 : cluster [DBG] pgmap v5648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:02.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:02 gibba013 bash[29418]: cephadm 2021-03-10T17:01:00.869036+0000 mgr.gibba020.yqfnwy (mgr.34427) 9911 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:01:02.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:02 gibba013 bash[30381]: cluster 2021-03-10T17:01:00.664316+0000 mgr.gibba020.yqfnwy (mgr.34427) 9910 : cluster [DBG] pgmap v5648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:02.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:02 gibba013 bash[30381]: cephadm 2021-03-10T17:01:00.869036+0000 mgr.gibba020.yqfnwy (mgr.34427) 9911 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:01:04.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:04 gibba020 bash[25448]: cluster 2021-03-10T17:01:02.665691+0000 mgr.gibba020.yqfnwy (mgr.34427) 9912 : cluster [DBG] pgmap v5649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:04.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:04 gibba013 bash[29418]: cluster 2021-03-10T17:01:02.665691+0000 mgr.gibba020.yqfnwy (mgr.34427) 9912 : cluster [DBG] pgmap v5649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:04.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:04 gibba013 bash[30381]: cluster 2021-03-10T17:01:02.665691+0000 mgr.gibba020.yqfnwy (mgr.34427) 9912 : cluster [DBG] pgmap v5649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:06.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:06 gibba020 bash[25448]: cluster 2021-03-10T17:01:04.667260+0000 mgr.gibba020.yqfnwy (mgr.34427) 9913 : cluster [DBG] pgmap v5650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:06.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:06 gibba013 bash[29418]: cluster 2021-03-10T17:01:04.667260+0000 mgr.gibba020.yqfnwy (mgr.34427) 9913 : cluster [DBG] pgmap v5650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:06.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:06 gibba013 bash[30381]: cluster 2021-03-10T17:01:04.667260+0000 mgr.gibba020.yqfnwy (mgr.34427) 9913 : cluster [DBG] pgmap v5650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:07.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:07 gibba020 bash[25448]: audit 2021-03-10T17:01:06.866298+0000 mon.a (mon.0) 3551 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:01:07.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:07 gibba020 bash[25448]: audit 2021-03-10T17:01:07.061426+0000 mon.a (mon.0) 3552 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:01:07.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:07 gibba013 bash[29418]: audit 2021-03-10T17:01:06.866298+0000 mon.a (mon.0) 3551 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:01:07.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:07 gibba013 bash[29418]: audit 2021-03-10T17:01:07.061426+0000 mon.a (mon.0) 3552 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:01:07.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:07 gibba013 bash[30381]: audit 2021-03-10T17:01:06.866298+0000 mon.a (mon.0) 3551 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:01:07.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:07 gibba013 bash[30381]: audit 2021-03-10T17:01:07.061426+0000 mon.a (mon.0) 3552 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:01:08.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:08 gibba020 bash[25448]: cluster 2021-03-10T17:01:06.668070+0000 mgr.gibba020.yqfnwy (mgr.34427) 9914 : cluster [DBG] pgmap v5651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:08.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:08 gibba020 bash[25448]: audit 2021-03-10T17:01:07.467166+0000 mon.a (mon.0) 3553 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:01:08.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:08 gibba020 bash[25448]: audit 2021-03-10T17:01:07.467416+0000 mon.a (mon.0) 3554 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:01:08.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:08 gibba020 bash[25448]: audit 2021-03-10T17:01:07.467654+0000 mon.a (mon.0) 3555 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:01:08.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:08 gibba020 bash[25448]: audit 2021-03-10T17:01:07.468070+0000 mon.a (mon.0) 3556 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:01:08.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:08 gibba013 bash[29418]: cluster 2021-03-10T17:01:06.668070+0000 mgr.gibba020.yqfnwy (mgr.34427) 9914 : cluster [DBG] pgmap v5651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:08.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:08 gibba013 bash[29418]: audit 2021-03-10T17:01:07.467166+0000 mon.a (mon.0) 3553 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:01:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:08 gibba013 bash[29418]: audit 2021-03-10T17:01:07.467416+0000 mon.a (mon.0) 3554 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:01:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:08 gibba013 bash[29418]: audit 2021-03-10T17:01:07.467654+0000 mon.a (mon.0) 3555 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:01:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:08 gibba013 bash[29418]: audit 2021-03-10T17:01:07.468070+0000 mon.a (mon.0) 3556 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:01:08.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:08 gibba013 bash[30381]: cluster 2021-03-10T17:01:06.668070+0000 mgr.gibba020.yqfnwy (mgr.34427) 9914 : cluster [DBG] pgmap v5651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:08.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:08 gibba013 bash[30381]: audit 2021-03-10T17:01:07.467166+0000 mon.a (mon.0) 3553 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:01:08.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:08 gibba013 bash[30381]: audit 2021-03-10T17:01:07.467416+0000 mon.a (mon.0) 3554 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:01:08.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:08 gibba013 bash[30381]: audit 2021-03-10T17:01:07.467654+0000 mon.a (mon.0) 3555 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:01:08.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:08 gibba013 bash[30381]: audit 2021-03-10T17:01:07.468070+0000 mon.a (mon.0) 3556 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:01:09.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:09 gibba020 bash[25448]: cluster 2021-03-10T17:01:08.669603+0000 mgr.gibba020.yqfnwy (mgr.34427) 9915 : cluster [DBG] pgmap v5652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:09.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:09 gibba013 bash[29418]: cluster 2021-03-10T17:01:08.669603+0000 mgr.gibba020.yqfnwy (mgr.34427) 9915 : cluster [DBG] pgmap v5652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:09.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:09 gibba013 bash[30381]: cluster 2021-03-10T17:01:08.669603+0000 mgr.gibba020.yqfnwy (mgr.34427) 9915 : cluster [DBG] pgmap v5652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:12.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:12 gibba013 bash[29418]: cluster 2021-03-10T17:01:10.670829+0000 mgr.gibba020.yqfnwy (mgr.34427) 9916 : cluster [DBG] pgmap v5653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:12.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:12 gibba013 bash[30381]: cluster 2021-03-10T17:01:10.670829+0000 mgr.gibba020.yqfnwy (mgr.34427) 9916 : cluster [DBG] pgmap v5653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:12.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:12 gibba020 bash[25448]: cluster 2021-03-10T17:01:10.670829+0000 mgr.gibba020.yqfnwy (mgr.34427) 9916 : cluster [DBG] pgmap v5653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:14.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:14 gibba013 bash[29418]: cluster 2021-03-10T17:01:12.672331+0000 mgr.gibba020.yqfnwy (mgr.34427) 9917 : cluster [DBG] pgmap v5654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:14.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:14 gibba013 bash[30381]: cluster 2021-03-10T17:01:12.672331+0000 mgr.gibba020.yqfnwy (mgr.34427) 9917 : cluster [DBG] pgmap v5654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:14.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:14 gibba020 bash[25448]: cluster 2021-03-10T17:01:12.672331+0000 mgr.gibba020.yqfnwy (mgr.34427) 9917 : cluster [DBG] pgmap v5654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:16.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:16 gibba013 bash[29418]: cluster 2021-03-10T17:01:14.673890+0000 mgr.gibba020.yqfnwy (mgr.34427) 9918 : cluster [DBG] pgmap v5655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:16.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:16 gibba013 bash[29418]: audit 2021-03-10T17:01:15.886458+0000 mon.a (mon.0) 3557 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:01:16.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:16 gibba013 bash[29418]: audit 2021-03-10T17:01:15.893471+0000 mon.a (mon.0) 3558 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:01:16.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:16 gibba013 bash[30381]: cluster 2021-03-10T17:01:14.673890+0000 mgr.gibba020.yqfnwy (mgr.34427) 9918 : cluster [DBG] pgmap v5655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:16.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:16 gibba013 bash[30381]: audit 2021-03-10T17:01:15.886458+0000 mon.a (mon.0) 3557 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:01:16.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:16 gibba013 bash[30381]: audit 2021-03-10T17:01:15.893471+0000 mon.a (mon.0) 3558 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:01:16.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:16 gibba020 bash[25448]: cluster 2021-03-10T17:01:14.673890+0000 mgr.gibba020.yqfnwy (mgr.34427) 9918 : cluster [DBG] pgmap v5655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:16.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:16 gibba020 bash[25448]: audit 2021-03-10T17:01:15.886458+0000 mon.a (mon.0) 3557 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:01:16.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:16 gibba020 bash[25448]: audit 2021-03-10T17:01:15.893471+0000 mon.a (mon.0) 3558 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:01:17.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:17 gibba013 bash[29418]: cephadm 2021-03-10T17:01:15.892356+0000 mgr.gibba020.yqfnwy (mgr.34427) 9919 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:01:17.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:17 gibba013 bash[30381]: cephadm 2021-03-10T17:01:15.892356+0000 mgr.gibba020.yqfnwy (mgr.34427) 9919 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:01:17.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:17 gibba020 bash[25448]: cephadm 2021-03-10T17:01:15.892356+0000 mgr.gibba020.yqfnwy (mgr.34427) 9919 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:01:18.407 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:01:18.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:18 gibba013 bash[29418]: cluster 2021-03-10T17:01:16.674729+0000 mgr.gibba020.yqfnwy (mgr.34427) 9920 : cluster [DBG] pgmap v5656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:18.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:18 gibba013 bash[30381]: cluster 2021-03-10T17:01:16.674729+0000 mgr.gibba020.yqfnwy (mgr.34427) 9920 : cluster [DBG] pgmap v5656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:18.664 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:01:18.664 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 10m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:01:18.664 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 9m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:01:18.665 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:01:18.665 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:01:18.665 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:01:18.665 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:01:18.665 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:01:18.666 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:01:18.666 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 10m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:01:18.666 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:01:18.666 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:01:18.667 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:01:18.667 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:01:18.667 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:01:18.667 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:01:18.667 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:01:18.668 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:01:18.668 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:01:18.668 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 9m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:01:18.668 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 9m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:01:18.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:18 gibba020 bash[25448]: cluster 2021-03-10T17:01:16.674729+0000 mgr.gibba020.yqfnwy (mgr.34427) 9920 : cluster [DBG] pgmap v5656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:18.958 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:01:18.958 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:01:18.958 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:01:18.959 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:01:18.959 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:01:18.959 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:01:18.959 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:01:18.959 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:01:18.960 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:01:18.960 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:01:18.960 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:01:18.960 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:01:18.960 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:01:18.961 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:01:18.961 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:01:19.604 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:19 gibba020 bash[25448]: audit 2021-03-10T17:01:18.397460+0000 mgr.gibba020.yqfnwy (mgr.34427) 9921 : audit [DBG] from='client.50712 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:01:19.605 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:19 gibba020 bash[25448]: audit 2021-03-10T17:01:18.957784+0000 mon.a (mon.0) 3559 : audit [DBG] from='client.? 172.21.2.113:0/2395834836' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:19.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:19 gibba013 bash[29418]: audit 2021-03-10T17:01:18.397460+0000 mgr.gibba020.yqfnwy (mgr.34427) 9921 : audit [DBG] from='client.50712 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:01:19.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:19 gibba013 bash[29418]: audit 2021-03-10T17:01:18.957784+0000 mon.a (mon.0) 3559 : audit [DBG] from='client.? 172.21.2.113:0/2395834836' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:19.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:19 gibba013 bash[30381]: audit 2021-03-10T17:01:18.397460+0000 mgr.gibba020.yqfnwy (mgr.34427) 9921 : audit [DBG] from='client.50712 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:01:19.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:19 gibba013 bash[30381]: audit 2021-03-10T17:01:18.957784+0000 mon.a (mon.0) 3559 : audit [DBG] from='client.? 172.21.2.113:0/2395834836' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:20.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:20 gibba013 bash[29418]: audit 2021-03-10T17:01:18.622789+0000 mgr.gibba020.yqfnwy (mgr.34427) 9922 : audit [DBG] from='client.50718 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:01:20.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:20 gibba013 bash[29418]: cluster 2021-03-10T17:01:18.675530+0000 mgr.gibba020.yqfnwy (mgr.34427) 9923 : cluster [DBG] pgmap v5657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:20.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:20 gibba013 bash[29418]: audit 2021-03-10T17:01:19.372837+0000 mon.a (mon.0) 3560 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:01:20.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:20 gibba013 bash[29418]: cephadm 2021-03-10T17:01:19.372921+0000 mgr.gibba020.yqfnwy (mgr.34427) 9924 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:01:20.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:20 gibba013 bash[29418]: audit 2021-03-10T17:01:19.586738+0000 mon.a (mon.0) 3561 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:01:20.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:20 gibba013 bash[29418]: audit 2021-03-10T17:01:19.594228+0000 mon.a (mon.0) 3562 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:01:20.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:20 gibba013 bash[29418]: audit 2021-03-10T17:01:19.596243+0000 mon.a (mon.0) 3563 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:20.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:20 gibba013 bash[29418]: audit 2021-03-10T17:01:19.598083+0000 mon.a (mon.0) 3564 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:20.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:20 gibba013 bash[29418]: audit 2021-03-10T17:01:19.599482+0000 mon.a (mon.0) 3565 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:20.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:20 gibba013 bash[29418]: audit 2021-03-10T17:01:19.602148+0000 mon.a (mon.0) 3566 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:20.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:20 gibba013 bash[29418]: audit 2021-03-10T17:01:19.603888+0000 mon.a (mon.0) 3567 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:20.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:20 gibba013 bash[30381]: audit 2021-03-10T17:01:18.622789+0000 mgr.gibba020.yqfnwy (mgr.34427) 9922 : audit [DBG] from='client.50718 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:01:20.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:20 gibba013 bash[30381]: cluster 2021-03-10T17:01:18.675530+0000 mgr.gibba020.yqfnwy (mgr.34427) 9923 : cluster [DBG] pgmap v5657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:20.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:20 gibba013 bash[30381]: audit 2021-03-10T17:01:19.372837+0000 mon.a (mon.0) 3560 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:01:20.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:20 gibba013 bash[30381]: cephadm 2021-03-10T17:01:19.372921+0000 mgr.gibba020.yqfnwy (mgr.34427) 9924 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:01:20.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:20 gibba013 bash[30381]: audit 2021-03-10T17:01:19.586738+0000 mon.a (mon.0) 3561 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:01:20.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:20 gibba013 bash[30381]: audit 2021-03-10T17:01:19.594228+0000 mon.a (mon.0) 3562 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:01:20.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:20 gibba013 bash[30381]: audit 2021-03-10T17:01:19.596243+0000 mon.a (mon.0) 3563 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:20.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:20 gibba013 bash[30381]: audit 2021-03-10T17:01:19.598083+0000 mon.a (mon.0) 3564 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:20.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:20 gibba013 bash[30381]: audit 2021-03-10T17:01:19.599482+0000 mon.a (mon.0) 3565 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:20.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:20 gibba013 bash[30381]: audit 2021-03-10T17:01:19.602148+0000 mon.a (mon.0) 3566 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:20.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:20 gibba013 bash[30381]: audit 2021-03-10T17:01:19.603888+0000 mon.a (mon.0) 3567 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:20.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:20 gibba020 bash[25448]: audit 2021-03-10T17:01:18.622789+0000 mgr.gibba020.yqfnwy (mgr.34427) 9922 : audit [DBG] from='client.50718 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:01:20.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:20 gibba020 bash[25448]: cluster 2021-03-10T17:01:18.675530+0000 mgr.gibba020.yqfnwy (mgr.34427) 9923 : cluster [DBG] pgmap v5657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:20.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:20 gibba020 bash[25448]: audit 2021-03-10T17:01:19.372837+0000 mon.a (mon.0) 3560 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:01:20.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:20 gibba020 bash[25448]: cephadm 2021-03-10T17:01:19.372921+0000 mgr.gibba020.yqfnwy (mgr.34427) 9924 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:01:20.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:20 gibba020 bash[25448]: audit 2021-03-10T17:01:19.586738+0000 mon.a (mon.0) 3561 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:01:20.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:20 gibba020 bash[25448]: audit 2021-03-10T17:01:19.594228+0000 mon.a (mon.0) 3562 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:01:20.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:20 gibba020 bash[25448]: audit 2021-03-10T17:01:19.596243+0000 mon.a (mon.0) 3563 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:20.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:20 gibba020 bash[25448]: audit 2021-03-10T17:01:19.598083+0000 mon.a (mon.0) 3564 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:20.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:20 gibba020 bash[25448]: audit 2021-03-10T17:01:19.599482+0000 mon.a (mon.0) 3565 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:20.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:20 gibba020 bash[25448]: audit 2021-03-10T17:01:19.602148+0000 mon.a (mon.0) 3566 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:20.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:20 gibba020 bash[25448]: audit 2021-03-10T17:01:19.603888+0000 mon.a (mon.0) 3567 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:21.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:21 gibba020 bash[25448]: cephadm 2021-03-10T17:01:19.592588+0000 mgr.gibba020.yqfnwy (mgr.34427) 9925 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:01:21.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:21 gibba020 bash[25448]: cephadm 2021-03-10T17:01:19.595140+0000 mgr.gibba020.yqfnwy (mgr.34427) 9926 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:01:21.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:21 gibba020 bash[25448]: cephadm 2021-03-10T17:01:19.596944+0000 mgr.gibba020.yqfnwy (mgr.34427) 9927 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:01:21.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:21 gibba020 bash[25448]: cephadm 2021-03-10T17:01:19.596981+0000 mgr.gibba020.yqfnwy (mgr.34427) 9928 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:01:21.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:21 gibba020 bash[25448]: cephadm 2021-03-10T17:01:19.598634+0000 mgr.gibba020.yqfnwy (mgr.34427) 9929 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:01:21.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:21 gibba020 bash[25448]: cephadm 2021-03-10T17:01:19.598670+0000 mgr.gibba020.yqfnwy (mgr.34427) 9930 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:01:21.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:21 gibba020 bash[25448]: cephadm 2021-03-10T17:01:19.599906+0000 mgr.gibba020.yqfnwy (mgr.34427) 9931 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:01:21.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:21 gibba020 bash[25448]: cephadm 2021-03-10T17:01:19.600969+0000 mgr.gibba020.yqfnwy (mgr.34427) 9932 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:01:21.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:21 gibba020 bash[25448]: cephadm 2021-03-10T17:01:19.601008+0000 mgr.gibba020.yqfnwy (mgr.34427) 9933 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:01:21.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:21 gibba020 bash[25448]: cephadm 2021-03-10T17:01:19.602559+0000 mgr.gibba020.yqfnwy (mgr.34427) 9934 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:01:21.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:21 gibba020 bash[25448]: cephadm 2021-03-10T17:01:19.602904+0000 mgr.gibba020.yqfnwy (mgr.34427) 9935 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:01:21.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:21 gibba020 bash[25448]: cephadm 2021-03-10T17:01:19.604172+0000 mgr.gibba020.yqfnwy (mgr.34427) 9936 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:01:21.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:21 gibba020 bash[25448]: cephadm 2021-03-10T17:01:19.604218+0000 mgr.gibba020.yqfnwy (mgr.34427) 9937 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:01:21.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:21 gibba020 bash[25448]: cephadm 2021-03-10T17:01:19.604320+0000 mgr.gibba020.yqfnwy (mgr.34427) 9938 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:01:21.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:21 gibba013 bash[29418]: cephadm 2021-03-10T17:01:19.592588+0000 mgr.gibba020.yqfnwy (mgr.34427) 9925 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:01:21.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:21 gibba013 bash[29418]: cephadm 2021-03-10T17:01:19.595140+0000 mgr.gibba020.yqfnwy (mgr.34427) 9926 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:01:21.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:21 gibba013 bash[29418]: cephadm 2021-03-10T17:01:19.596944+0000 mgr.gibba020.yqfnwy (mgr.34427) 9927 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:01:21.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:21 gibba013 bash[29418]: cephadm 2021-03-10T17:01:19.596981+0000 mgr.gibba020.yqfnwy (mgr.34427) 9928 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:01:21.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:21 gibba013 bash[29418]: cephadm 2021-03-10T17:01:19.598634+0000 mgr.gibba020.yqfnwy (mgr.34427) 9929 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:01:21.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:21 gibba013 bash[29418]: cephadm 2021-03-10T17:01:19.598670+0000 mgr.gibba020.yqfnwy (mgr.34427) 9930 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:01:21.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:21 gibba013 bash[29418]: cephadm 2021-03-10T17:01:19.599906+0000 mgr.gibba020.yqfnwy (mgr.34427) 9931 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:01:21.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:21 gibba013 bash[29418]: cephadm 2021-03-10T17:01:19.600969+0000 mgr.gibba020.yqfnwy (mgr.34427) 9932 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:01:21.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:21 gibba013 bash[29418]: cephadm 2021-03-10T17:01:19.601008+0000 mgr.gibba020.yqfnwy (mgr.34427) 9933 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:01:21.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:21 gibba013 bash[29418]: cephadm 2021-03-10T17:01:19.602559+0000 mgr.gibba020.yqfnwy (mgr.34427) 9934 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:01:21.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:21 gibba013 bash[29418]: cephadm 2021-03-10T17:01:19.602904+0000 mgr.gibba020.yqfnwy (mgr.34427) 9935 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:01:21.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:21 gibba013 bash[29418]: cephadm 2021-03-10T17:01:19.604172+0000 mgr.gibba020.yqfnwy (mgr.34427) 9936 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:01:21.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:21 gibba013 bash[29418]: cephadm 2021-03-10T17:01:19.604218+0000 mgr.gibba020.yqfnwy (mgr.34427) 9937 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:01:21.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:21 gibba013 bash[29418]: cephadm 2021-03-10T17:01:19.604320+0000 mgr.gibba020.yqfnwy (mgr.34427) 9938 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:01:21.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:21 gibba013 bash[30381]: cephadm 2021-03-10T17:01:19.592588+0000 mgr.gibba020.yqfnwy (mgr.34427) 9925 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:01:21.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:21 gibba013 bash[30381]: cephadm 2021-03-10T17:01:19.595140+0000 mgr.gibba020.yqfnwy (mgr.34427) 9926 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:01:21.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:21 gibba013 bash[30381]: cephadm 2021-03-10T17:01:19.596944+0000 mgr.gibba020.yqfnwy (mgr.34427) 9927 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:01:21.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:21 gibba013 bash[30381]: cephadm 2021-03-10T17:01:19.596981+0000 mgr.gibba020.yqfnwy (mgr.34427) 9928 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:01:21.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:21 gibba013 bash[30381]: cephadm 2021-03-10T17:01:19.598634+0000 mgr.gibba020.yqfnwy (mgr.34427) 9929 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:01:21.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:21 gibba013 bash[30381]: cephadm 2021-03-10T17:01:19.598670+0000 mgr.gibba020.yqfnwy (mgr.34427) 9930 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:01:21.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:21 gibba013 bash[30381]: cephadm 2021-03-10T17:01:19.599906+0000 mgr.gibba020.yqfnwy (mgr.34427) 9931 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:01:21.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:21 gibba013 bash[30381]: cephadm 2021-03-10T17:01:19.600969+0000 mgr.gibba020.yqfnwy (mgr.34427) 9932 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:01:21.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:21 gibba013 bash[30381]: cephadm 2021-03-10T17:01:19.601008+0000 mgr.gibba020.yqfnwy (mgr.34427) 9933 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:01:21.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:21 gibba013 bash[30381]: cephadm 2021-03-10T17:01:19.602559+0000 mgr.gibba020.yqfnwy (mgr.34427) 9934 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:01:21.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:21 gibba013 bash[30381]: cephadm 2021-03-10T17:01:19.602904+0000 mgr.gibba020.yqfnwy (mgr.34427) 9935 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:01:21.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:21 gibba013 bash[30381]: cephadm 2021-03-10T17:01:19.604172+0000 mgr.gibba020.yqfnwy (mgr.34427) 9936 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:01:21.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:21 gibba013 bash[30381]: cephadm 2021-03-10T17:01:19.604218+0000 mgr.gibba020.yqfnwy (mgr.34427) 9937 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:01:21.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:21 gibba013 bash[30381]: cephadm 2021-03-10T17:01:19.604320+0000 mgr.gibba020.yqfnwy (mgr.34427) 9938 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:01:22.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:22 gibba020 bash[25448]: cluster 2021-03-10T17:01:20.677145+0000 mgr.gibba020.yqfnwy (mgr.34427) 9939 : cluster [DBG] pgmap v5658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:22.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:22 gibba013 bash[29418]: cluster 2021-03-10T17:01:20.677145+0000 mgr.gibba020.yqfnwy (mgr.34427) 9939 : cluster [DBG] pgmap v5658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:22.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:22 gibba013 bash[30381]: cluster 2021-03-10T17:01:20.677145+0000 mgr.gibba020.yqfnwy (mgr.34427) 9939 : cluster [DBG] pgmap v5658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:24.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:24 gibba020 bash[25448]: cluster 2021-03-10T17:01:22.678730+0000 mgr.gibba020.yqfnwy (mgr.34427) 9940 : cluster [DBG] pgmap v5659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:24.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:24 gibba013 bash[29418]: cluster 2021-03-10T17:01:22.678730+0000 mgr.gibba020.yqfnwy (mgr.34427) 9940 : cluster [DBG] pgmap v5659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:24.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:24 gibba013 bash[30381]: cluster 2021-03-10T17:01:22.678730+0000 mgr.gibba020.yqfnwy (mgr.34427) 9940 : cluster [DBG] pgmap v5659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:26.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:26 gibba020 bash[25448]: cluster 2021-03-10T17:01:24.680289+0000 mgr.gibba020.yqfnwy (mgr.34427) 9941 : cluster [DBG] pgmap v5660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:26.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:26 gibba013 bash[29418]: cluster 2021-03-10T17:01:24.680289+0000 mgr.gibba020.yqfnwy (mgr.34427) 9941 : cluster [DBG] pgmap v5660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:26.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:26 gibba013 bash[30381]: cluster 2021-03-10T17:01:24.680289+0000 mgr.gibba020.yqfnwy (mgr.34427) 9941 : cluster [DBG] pgmap v5660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:28.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:28 gibba020 bash[25448]: cluster 2021-03-10T17:01:26.682078+0000 mgr.gibba020.yqfnwy (mgr.34427) 9942 : cluster [DBG] pgmap v5661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:28.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:28 gibba013 bash[29418]: cluster 2021-03-10T17:01:26.682078+0000 mgr.gibba020.yqfnwy (mgr.34427) 9942 : cluster [DBG] pgmap v5661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:28.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:28 gibba013 bash[30381]: cluster 2021-03-10T17:01:26.682078+0000 mgr.gibba020.yqfnwy (mgr.34427) 9942 : cluster [DBG] pgmap v5661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:30.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:30 gibba020 bash[25448]: cluster 2021-03-10T17:01:28.683457+0000 mgr.gibba020.yqfnwy (mgr.34427) 9943 : cluster [DBG] pgmap v5662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:30.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:30 gibba013 bash[29418]: cluster 2021-03-10T17:01:28.683457+0000 mgr.gibba020.yqfnwy (mgr.34427) 9943 : cluster [DBG] pgmap v5662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:30.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:30 gibba013 bash[30381]: cluster 2021-03-10T17:01:28.683457+0000 mgr.gibba020.yqfnwy (mgr.34427) 9943 : cluster [DBG] pgmap v5662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:31.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:31 gibba013 bash[29418]: cluster 2021-03-10T17:01:30.685161+0000 mgr.gibba020.yqfnwy (mgr.34427) 9944 : cluster [DBG] pgmap v5663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:31.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:31 gibba013 bash[30381]: cluster 2021-03-10T17:01:30.685161+0000 mgr.gibba020.yqfnwy (mgr.34427) 9944 : cluster [DBG] pgmap v5663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:31.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:31 gibba020 bash[25448]: cluster 2021-03-10T17:01:30.685161+0000 mgr.gibba020.yqfnwy (mgr.34427) 9944 : cluster [DBG] pgmap v5663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:34.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:33 gibba013 bash[29418]: cluster 2021-03-10T17:01:32.686724+0000 mgr.gibba020.yqfnwy (mgr.34427) 9945 : cluster [DBG] pgmap v5664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:34.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:33 gibba013 bash[30381]: cluster 2021-03-10T17:01:32.686724+0000 mgr.gibba020.yqfnwy (mgr.34427) 9945 : cluster [DBG] pgmap v5664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:34.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:33 gibba020 bash[25448]: cluster 2021-03-10T17:01:32.686724+0000 mgr.gibba020.yqfnwy (mgr.34427) 9945 : cluster [DBG] pgmap v5664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:36.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:36 gibba013 bash[29418]: cephadm 2021-03-10T17:01:34.619875+0000 mgr.gibba020.yqfnwy (mgr.34427) 9946 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:01:36.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:36 gibba013 bash[29418]: cluster 2021-03-10T17:01:34.688155+0000 mgr.gibba020.yqfnwy (mgr.34427) 9947 : cluster [DBG] pgmap v5665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:36.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:36 gibba013 bash[30381]: cephadm 2021-03-10T17:01:34.619875+0000 mgr.gibba020.yqfnwy (mgr.34427) 9946 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:01:36.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:36 gibba013 bash[30381]: cluster 2021-03-10T17:01:34.688155+0000 mgr.gibba020.yqfnwy (mgr.34427) 9947 : cluster [DBG] pgmap v5665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:36.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:36 gibba020 bash[25448]: cephadm 2021-03-10T17:01:34.619875+0000 mgr.gibba020.yqfnwy (mgr.34427) 9946 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:01:36.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:36 gibba020 bash[25448]: cluster 2021-03-10T17:01:34.688155+0000 mgr.gibba020.yqfnwy (mgr.34427) 9947 : cluster [DBG] pgmap v5665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:38.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:38 gibba013 bash[29418]: cluster 2021-03-10T17:01:36.689907+0000 mgr.gibba020.yqfnwy (mgr.34427) 9948 : cluster [DBG] pgmap v5666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:38.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:38 gibba013 bash[30381]: cluster 2021-03-10T17:01:36.689907+0000 mgr.gibba020.yqfnwy (mgr.34427) 9948 : cluster [DBG] pgmap v5666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:38.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:38 gibba020 bash[25448]: cluster 2021-03-10T17:01:36.689907+0000 mgr.gibba020.yqfnwy (mgr.34427) 9948 : cluster [DBG] pgmap v5666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:40.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:40 gibba013 bash[29418]: cluster 2021-03-10T17:01:38.691611+0000 mgr.gibba020.yqfnwy (mgr.34427) 9949 : cluster [DBG] pgmap v5667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:40.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:40 gibba013 bash[30381]: cluster 2021-03-10T17:01:38.691611+0000 mgr.gibba020.yqfnwy (mgr.34427) 9949 : cluster [DBG] pgmap v5667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:40.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:40 gibba020 bash[25448]: cluster 2021-03-10T17:01:38.691611+0000 mgr.gibba020.yqfnwy (mgr.34427) 9949 : cluster [DBG] pgmap v5667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:42.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:42 gibba013 bash[29418]: cluster 2021-03-10T17:01:40.693423+0000 mgr.gibba020.yqfnwy (mgr.34427) 9950 : cluster [DBG] pgmap v5668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:42.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:42 gibba013 bash[30381]: cluster 2021-03-10T17:01:40.693423+0000 mgr.gibba020.yqfnwy (mgr.34427) 9950 : cluster [DBG] pgmap v5668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:42.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:42 gibba020 bash[25448]: cluster 2021-03-10T17:01:40.693423+0000 mgr.gibba020.yqfnwy (mgr.34427) 9950 : cluster [DBG] pgmap v5668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:44.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:44 gibba013 bash[29418]: cluster 2021-03-10T17:01:42.695001+0000 mgr.gibba020.yqfnwy (mgr.34427) 9951 : cluster [DBG] pgmap v5669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:44.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:44 gibba013 bash[30381]: cluster 2021-03-10T17:01:42.695001+0000 mgr.gibba020.yqfnwy (mgr.34427) 9951 : cluster [DBG] pgmap v5669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:44.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:44 gibba020 bash[25448]: cluster 2021-03-10T17:01:42.695001+0000 mgr.gibba020.yqfnwy (mgr.34427) 9951 : cluster [DBG] pgmap v5669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:46.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:46 gibba013 bash[29418]: cluster 2021-03-10T17:01:44.696531+0000 mgr.gibba020.yqfnwy (mgr.34427) 9952 : cluster [DBG] pgmap v5670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:46.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:46 gibba013 bash[30381]: cluster 2021-03-10T17:01:44.696531+0000 mgr.gibba020.yqfnwy (mgr.34427) 9952 : cluster [DBG] pgmap v5670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:46.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:46 gibba020 bash[25448]: cluster 2021-03-10T17:01:44.696531+0000 mgr.gibba020.yqfnwy (mgr.34427) 9952 : cluster [DBG] pgmap v5670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:48.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:48 gibba013 bash[29418]: cluster 2021-03-10T17:01:46.697685+0000 mgr.gibba020.yqfnwy (mgr.34427) 9953 : cluster [DBG] pgmap v5671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:48.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:48 gibba013 bash[30381]: cluster 2021-03-10T17:01:46.697685+0000 mgr.gibba020.yqfnwy (mgr.34427) 9953 : cluster [DBG] pgmap v5671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:48.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:48 gibba020 bash[25448]: cluster 2021-03-10T17:01:46.697685+0000 mgr.gibba020.yqfnwy (mgr.34427) 9953 : cluster [DBG] pgmap v5671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:49.203 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:01:49.431 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:01:49.431 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 30s ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:01:49.432 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 9m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:01:49.432 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:01:49.432 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:01:49.432 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 30s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:01:49.433 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 30s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:01:49.433 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:01:49.433 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 30s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:01:49.433 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 30s ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:01:49.433 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:01:49.434 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 30s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:01:49.434 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 30s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:01:49.434 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 30s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:01:49.434 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 30s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:01:49.435 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:01:49.435 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:01:49.438 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:01:49.438 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:01:49.439 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 9m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:01:49.439 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 9m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:01:49.685 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:01:49.685 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:01:49.686 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:01:49.686 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:01:49.686 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:01:49.687 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:01:49.687 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:01:49.687 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:01:49.688 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:01:49.688 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:01:49.688 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:01:49.689 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:01:49.689 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:01:49.690 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:01:49.690 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:01:50.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:50 gibba013 bash[29418]: cluster 2021-03-10T17:01:48.699025+0000 mgr.gibba020.yqfnwy (mgr.34427) 9954 : cluster [DBG] pgmap v5672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:50.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:50 gibba013 bash[29418]: audit 2021-03-10T17:01:49.193063+0000 mgr.gibba020.yqfnwy (mgr.34427) 9955 : audit [DBG] from='client.50730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:01:50.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:50 gibba013 bash[29418]: audit 2021-03-10T17:01:49.417708+0000 mgr.gibba020.yqfnwy (mgr.34427) 9956 : audit [DBG] from='client.50736 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:01:50.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:50 gibba013 bash[29418]: audit 2021-03-10T17:01:49.684782+0000 mon.a (mon.0) 3568 : audit [DBG] from='client.? 172.21.2.113:0/1333593192' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:50.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:50 gibba013 bash[30381]: cluster 2021-03-10T17:01:48.699025+0000 mgr.gibba020.yqfnwy (mgr.34427) 9954 : cluster [DBG] pgmap v5672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:50.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:50 gibba013 bash[30381]: audit 2021-03-10T17:01:49.193063+0000 mgr.gibba020.yqfnwy (mgr.34427) 9955 : audit [DBG] from='client.50730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:01:50.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:50 gibba013 bash[30381]: audit 2021-03-10T17:01:49.417708+0000 mgr.gibba020.yqfnwy (mgr.34427) 9956 : audit [DBG] from='client.50736 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:01:50.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:50 gibba013 bash[30381]: audit 2021-03-10T17:01:49.684782+0000 mon.a (mon.0) 3568 : audit [DBG] from='client.? 172.21.2.113:0/1333593192' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:50.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:50 gibba020 bash[25448]: cluster 2021-03-10T17:01:48.699025+0000 mgr.gibba020.yqfnwy (mgr.34427) 9954 : cluster [DBG] pgmap v5672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:50.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:50 gibba020 bash[25448]: audit 2021-03-10T17:01:49.193063+0000 mgr.gibba020.yqfnwy (mgr.34427) 9955 : audit [DBG] from='client.50730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:01:50.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:50 gibba020 bash[25448]: audit 2021-03-10T17:01:49.417708+0000 mgr.gibba020.yqfnwy (mgr.34427) 9956 : audit [DBG] from='client.50736 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:01:50.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:50 gibba020 bash[25448]: audit 2021-03-10T17:01:49.684782+0000 mon.a (mon.0) 3568 : audit [DBG] from='client.? 172.21.2.113:0/1333593192' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:01:51.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:51 gibba013 bash[29418]: cephadm 2021-03-10T17:01:49.632687+0000 mgr.gibba020.yqfnwy (mgr.34427) 9957 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:01:51.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:51 gibba013 bash[30381]: cephadm 2021-03-10T17:01:49.632687+0000 mgr.gibba020.yqfnwy (mgr.34427) 9957 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:01:51.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:51 gibba020 bash[25448]: cephadm 2021-03-10T17:01:49.632687+0000 mgr.gibba020.yqfnwy (mgr.34427) 9957 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:01:52.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:52 gibba013 bash[29418]: cluster 2021-03-10T17:01:50.700564+0000 mgr.gibba020.yqfnwy (mgr.34427) 9958 : cluster [DBG] pgmap v5673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:52.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:52 gibba013 bash[30381]: cluster 2021-03-10T17:01:50.700564+0000 mgr.gibba020.yqfnwy (mgr.34427) 9958 : cluster [DBG] pgmap v5673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:52.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:52 gibba020 bash[25448]: cluster 2021-03-10T17:01:50.700564+0000 mgr.gibba020.yqfnwy (mgr.34427) 9958 : cluster [DBG] pgmap v5673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:54.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:54 gibba013 bash[29418]: cluster 2021-03-10T17:01:52.701875+0000 mgr.gibba020.yqfnwy (mgr.34427) 9959 : cluster [DBG] pgmap v5674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:54.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:54 gibba013 bash[30381]: cluster 2021-03-10T17:01:52.701875+0000 mgr.gibba020.yqfnwy (mgr.34427) 9959 : cluster [DBG] pgmap v5674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:54.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:54 gibba020 bash[25448]: cluster 2021-03-10T17:01:52.701875+0000 mgr.gibba020.yqfnwy (mgr.34427) 9959 : cluster [DBG] pgmap v5674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:56.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:56 gibba013 bash[30381]: cluster 2021-03-10T17:01:54.703389+0000 mgr.gibba020.yqfnwy (mgr.34427) 9960 : cluster [DBG] pgmap v5675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:56.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:56 gibba013 bash[29418]: cluster 2021-03-10T17:01:54.703389+0000 mgr.gibba020.yqfnwy (mgr.34427) 9960 : cluster [DBG] pgmap v5675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:56.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:56 gibba020 bash[25448]: cluster 2021-03-10T17:01:54.703389+0000 mgr.gibba020.yqfnwy (mgr.34427) 9960 : cluster [DBG] pgmap v5675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:58.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:01:58 gibba013 bash[29418]: cluster 2021-03-10T17:01:56.704452+0000 mgr.gibba020.yqfnwy (mgr.34427) 9961 : cluster [DBG] pgmap v5676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:58.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:01:58 gibba013 bash[30381]: cluster 2021-03-10T17:01:56.704452+0000 mgr.gibba020.yqfnwy (mgr.34427) 9961 : cluster [DBG] pgmap v5676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:01:58.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:01:58 gibba020 bash[25448]: cluster 2021-03-10T17:01:56.704452+0000 mgr.gibba020.yqfnwy (mgr.34427) 9961 : cluster [DBG] pgmap v5676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:00.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:00 gibba013 bash[29418]: cluster 2021-03-10T17:01:58.705773+0000 mgr.gibba020.yqfnwy (mgr.34427) 9962 : cluster [DBG] pgmap v5677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:00.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:00 gibba013 bash[30381]: cluster 2021-03-10T17:01:58.705773+0000 mgr.gibba020.yqfnwy (mgr.34427) 9962 : cluster [DBG] pgmap v5677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:00.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:00 gibba020 bash[25448]: cluster 2021-03-10T17:01:58.705773+0000 mgr.gibba020.yqfnwy (mgr.34427) 9962 : cluster [DBG] pgmap v5677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:02.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:02 gibba013 bash[29418]: cluster 2021-03-10T17:02:00.707218+0000 mgr.gibba020.yqfnwy (mgr.34427) 9963 : cluster [DBG] pgmap v5678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:02.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:02 gibba013 bash[30381]: cluster 2021-03-10T17:02:00.707218+0000 mgr.gibba020.yqfnwy (mgr.34427) 9963 : cluster [DBG] pgmap v5678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:02.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:02 gibba020 bash[25448]: cluster 2021-03-10T17:02:00.707218+0000 mgr.gibba020.yqfnwy (mgr.34427) 9963 : cluster [DBG] pgmap v5678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:04.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:04 gibba013 bash[29418]: cluster 2021-03-10T17:02:02.708687+0000 mgr.gibba020.yqfnwy (mgr.34427) 9964 : cluster [DBG] pgmap v5679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:04.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:04 gibba013 bash[30381]: cluster 2021-03-10T17:02:02.708687+0000 mgr.gibba020.yqfnwy (mgr.34427) 9964 : cluster [DBG] pgmap v5679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:04.650 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:04 gibba020 bash[25448]: cluster 2021-03-10T17:02:02.708687+0000 mgr.gibba020.yqfnwy (mgr.34427) 9964 : cluster [DBG] pgmap v5679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:06.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:06 gibba013 bash[29418]: cephadm 2021-03-10T17:02:04.648732+0000 mgr.gibba020.yqfnwy (mgr.34427) 9965 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:02:06.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:06 gibba013 bash[29418]: cluster 2021-03-10T17:02:04.710165+0000 mgr.gibba020.yqfnwy (mgr.34427) 9966 : cluster [DBG] pgmap v5680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:06.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:06 gibba013 bash[30381]: cephadm 2021-03-10T17:02:04.648732+0000 mgr.gibba020.yqfnwy (mgr.34427) 9965 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:02:06.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:06 gibba013 bash[30381]: cluster 2021-03-10T17:02:04.710165+0000 mgr.gibba020.yqfnwy (mgr.34427) 9966 : cluster [DBG] pgmap v5680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:06.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:06 gibba020 bash[25448]: cephadm 2021-03-10T17:02:04.648732+0000 mgr.gibba020.yqfnwy (mgr.34427) 9965 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:02:06.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:06 gibba020 bash[25448]: cluster 2021-03-10T17:02:04.710165+0000 mgr.gibba020.yqfnwy (mgr.34427) 9966 : cluster [DBG] pgmap v5680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:07.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:07 gibba020 bash[25448]: audit 2021-03-10T17:02:06.870796+0000 mon.a (mon.0) 3569 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:02:07.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:07 gibba020 bash[25448]: audit 2021-03-10T17:02:07.067942+0000 mon.a (mon.0) 3570 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:02:07.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:07 gibba013 bash[29418]: audit 2021-03-10T17:02:06.870796+0000 mon.a (mon.0) 3569 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:02:07.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:07 gibba013 bash[29418]: audit 2021-03-10T17:02:07.067942+0000 mon.a (mon.0) 3570 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:02:07.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:07 gibba013 bash[30381]: audit 2021-03-10T17:02:06.870796+0000 mon.a (mon.0) 3569 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:02:07.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:07 gibba013 bash[30381]: audit 2021-03-10T17:02:07.067942+0000 mon.a (mon.0) 3570 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:02:08.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:08 gibba020 bash[25448]: cluster 2021-03-10T17:02:06.711673+0000 mgr.gibba020.yqfnwy (mgr.34427) 9967 : cluster [DBG] pgmap v5681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:08.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:08 gibba020 bash[25448]: audit 2021-03-10T17:02:07.476020+0000 mon.a (mon.0) 3571 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:02:08.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:08 gibba020 bash[25448]: audit 2021-03-10T17:02:07.476830+0000 mon.a (mon.0) 3572 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:02:08.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:08 gibba020 bash[25448]: audit 2021-03-10T17:02:07.477530+0000 mon.a (mon.0) 3573 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:02:08.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:08 gibba020 bash[25448]: audit 2021-03-10T17:02:07.478221+0000 mon.a (mon.0) 3574 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:02:08.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:08 gibba013 bash[29418]: cluster 2021-03-10T17:02:06.711673+0000 mgr.gibba020.yqfnwy (mgr.34427) 9967 : cluster [DBG] pgmap v5681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:08.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:08 gibba013 bash[29418]: audit 2021-03-10T17:02:07.476020+0000 mon.a (mon.0) 3571 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:02:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:08 gibba013 bash[29418]: audit 2021-03-10T17:02:07.476830+0000 mon.a (mon.0) 3572 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:02:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:08 gibba013 bash[29418]: audit 2021-03-10T17:02:07.477530+0000 mon.a (mon.0) 3573 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:02:08.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:08 gibba013 bash[29418]: audit 2021-03-10T17:02:07.478221+0000 mon.a (mon.0) 3574 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:02:08.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:08 gibba013 bash[30381]: cluster 2021-03-10T17:02:06.711673+0000 mgr.gibba020.yqfnwy (mgr.34427) 9967 : cluster [DBG] pgmap v5681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:08.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:08 gibba013 bash[30381]: audit 2021-03-10T17:02:07.476020+0000 mon.a (mon.0) 3571 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T17:02:08.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:08 gibba013 bash[30381]: audit 2021-03-10T17:02:07.476830+0000 mon.a (mon.0) 3572 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:02:08.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:08 gibba013 bash[30381]: audit 2021-03-10T17:02:07.477530+0000 mon.a (mon.0) 3573 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:02:08.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:08 gibba013 bash[30381]: audit 2021-03-10T17:02:07.478221+0000 mon.a (mon.0) 3574 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:02:10.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:10 gibba020 bash[25448]: cluster 2021-03-10T17:02:08.713260+0000 mgr.gibba020.yqfnwy (mgr.34427) 9968 : cluster [DBG] pgmap v5682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:10.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:10 gibba013 bash[29418]: cluster 2021-03-10T17:02:08.713260+0000 mgr.gibba020.yqfnwy (mgr.34427) 9968 : cluster [DBG] pgmap v5682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:10.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:10 gibba013 bash[30381]: cluster 2021-03-10T17:02:08.713260+0000 mgr.gibba020.yqfnwy (mgr.34427) 9968 : cluster [DBG] pgmap v5682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:12.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:12 gibba020 bash[25448]: cluster 2021-03-10T17:02:10.714867+0000 mgr.gibba020.yqfnwy (mgr.34427) 9969 : cluster [DBG] pgmap v5683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:12.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:12 gibba013 bash[29418]: cluster 2021-03-10T17:02:10.714867+0000 mgr.gibba020.yqfnwy (mgr.34427) 9969 : cluster [DBG] pgmap v5683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:12.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:12 gibba013 bash[30381]: cluster 2021-03-10T17:02:10.714867+0000 mgr.gibba020.yqfnwy (mgr.34427) 9969 : cluster [DBG] pgmap v5683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:14.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:14 gibba020 bash[25448]: cluster 2021-03-10T17:02:12.716329+0000 mgr.gibba020.yqfnwy (mgr.34427) 9970 : cluster [DBG] pgmap v5684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:14.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:14 gibba013 bash[29418]: cluster 2021-03-10T17:02:12.716329+0000 mgr.gibba020.yqfnwy (mgr.34427) 9970 : cluster [DBG] pgmap v5684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:14.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:14 gibba013 bash[30381]: cluster 2021-03-10T17:02:12.716329+0000 mgr.gibba020.yqfnwy (mgr.34427) 9970 : cluster [DBG] pgmap v5684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:16.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:16 gibba020 bash[25448]: cluster 2021-03-10T17:02:14.717712+0000 mgr.gibba020.yqfnwy (mgr.34427) 9971 : cluster [DBG] pgmap v5685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:16.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:16 gibba013 bash[29418]: cluster 2021-03-10T17:02:14.717712+0000 mgr.gibba020.yqfnwy (mgr.34427) 9971 : cluster [DBG] pgmap v5685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:16.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:16 gibba013 bash[30381]: cluster 2021-03-10T17:02:14.717712+0000 mgr.gibba020.yqfnwy (mgr.34427) 9971 : cluster [DBG] pgmap v5685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:18.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:18 gibba020 bash[25448]: cluster 2021-03-10T17:02:16.719386+0000 mgr.gibba020.yqfnwy (mgr.34427) 9972 : cluster [DBG] pgmap v5686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:18.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:18 gibba013 bash[29418]: cluster 2021-03-10T17:02:16.719386+0000 mgr.gibba020.yqfnwy (mgr.34427) 9972 : cluster [DBG] pgmap v5686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:18.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:18 gibba013 bash[30381]: cluster 2021-03-10T17:02:16.719386+0000 mgr.gibba020.yqfnwy (mgr.34427) 9972 : cluster [DBG] pgmap v5686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:19.931 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:02:20.157 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:02:20.158 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 60s ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:02:20.158 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 10m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:02:20.158 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:02:20.159 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:02:20.159 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 60s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:02:20.159 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 60s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:02:20.159 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:02:20.159 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 60s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:02:20.160 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 60s ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:02:20.160 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 10m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:02:20.160 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 60s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:02:20.160 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 60s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:02:20.161 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 60s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:02:20.161 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 60s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:02:20.161 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:02:20.161 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:02:20.161 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:02:20.162 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:02:20.162 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 10m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:02:20.162 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 10m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:02:20.408 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:02:20.409 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:02:20.409 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:02:20.409 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:02:20.409 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:02:20.410 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:02:20.410 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:02:20.410 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:02:20.410 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:02:20.410 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:02:20.411 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:02:20.411 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:02:20.411 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:02:20.411 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:02:20.412 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:02:20.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:20 gibba013 bash[29418]: cluster 2021-03-10T17:02:18.720968+0000 mgr.gibba020.yqfnwy (mgr.34427) 9973 : cluster [DBG] pgmap v5687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:20.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:20 gibba013 bash[29418]: audit 2021-03-10T17:02:19.666322+0000 mon.a (mon.0) 3575 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:02:20.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:20 gibba013 bash[29418]: audit 2021-03-10T17:02:19.674288+0000 mon.a (mon.0) 3576 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:02:20.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:20 gibba013 bash[29418]: audit 2021-03-10T17:02:20.408378+0000 mon.a (mon.0) 3577 : audit [DBG] from='client.? 172.21.2.113:0/3935476226' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:20.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:20 gibba013 bash[30381]: cluster 2021-03-10T17:02:18.720968+0000 mgr.gibba020.yqfnwy (mgr.34427) 9973 : cluster [DBG] pgmap v5687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:20.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:20 gibba013 bash[30381]: audit 2021-03-10T17:02:19.666322+0000 mon.a (mon.0) 3575 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:02:20.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:20 gibba013 bash[30381]: audit 2021-03-10T17:02:19.674288+0000 mon.a (mon.0) 3576 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:02:20.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:20 gibba013 bash[30381]: audit 2021-03-10T17:02:20.408378+0000 mon.a (mon.0) 3577 : audit [DBG] from='client.? 172.21.2.113:0/3935476226' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:20.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:20 gibba020 bash[25448]: cluster 2021-03-10T17:02:18.720968+0000 mgr.gibba020.yqfnwy (mgr.34427) 9973 : cluster [DBG] pgmap v5687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:20.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:20 gibba020 bash[25448]: audit 2021-03-10T17:02:19.666322+0000 mon.a (mon.0) 3575 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:02:20.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:20 gibba020 bash[25448]: audit 2021-03-10T17:02:19.674288+0000 mon.a (mon.0) 3576 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:02:20.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:20 gibba020 bash[25448]: audit 2021-03-10T17:02:20.408378+0000 mon.a (mon.0) 3577 : audit [DBG] from='client.? 172.21.2.113:0/3935476226' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:21.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:21 gibba013 bash[29418]: cephadm 2021-03-10T17:02:19.671670+0000 mgr.gibba020.yqfnwy (mgr.34427) 9974 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:02:21.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:21 gibba013 bash[29418]: audit 2021-03-10T17:02:19.922012+0000 mgr.gibba020.yqfnwy (mgr.34427) 9975 : audit [DBG] from='client.50748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:02:21.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:21 gibba013 bash[29418]: audit 2021-03-10T17:02:20.143888+0000 mgr.gibba020.yqfnwy (mgr.34427) 9976 : audit [DBG] from='client.50754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:02:21.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:21 gibba013 bash[30381]: cephadm 2021-03-10T17:02:19.671670+0000 mgr.gibba020.yqfnwy (mgr.34427) 9974 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:02:21.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:21 gibba013 bash[30381]: audit 2021-03-10T17:02:19.922012+0000 mgr.gibba020.yqfnwy (mgr.34427) 9975 : audit [DBG] from='client.50748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:02:21.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:21 gibba013 bash[30381]: audit 2021-03-10T17:02:20.143888+0000 mgr.gibba020.yqfnwy (mgr.34427) 9976 : audit [DBG] from='client.50754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:02:21.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:21 gibba020 bash[25448]: cephadm 2021-03-10T17:02:19.671670+0000 mgr.gibba020.yqfnwy (mgr.34427) 9974 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:02:21.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:21 gibba020 bash[25448]: audit 2021-03-10T17:02:19.922012+0000 mgr.gibba020.yqfnwy (mgr.34427) 9975 : audit [DBG] from='client.50748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:02:21.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:21 gibba020 bash[25448]: audit 2021-03-10T17:02:20.143888+0000 mgr.gibba020.yqfnwy (mgr.34427) 9976 : audit [DBG] from='client.50754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:02:22.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:22 gibba013 bash[29418]: cluster 2021-03-10T17:02:20.722658+0000 mgr.gibba020.yqfnwy (mgr.34427) 9977 : cluster [DBG] pgmap v5688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:22.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:22 gibba013 bash[30381]: cluster 2021-03-10T17:02:20.722658+0000 mgr.gibba020.yqfnwy (mgr.34427) 9977 : cluster [DBG] pgmap v5688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:22.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:22 gibba020 bash[25448]: cluster 2021-03-10T17:02:20.722658+0000 mgr.gibba020.yqfnwy (mgr.34427) 9977 : cluster [DBG] pgmap v5688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:24.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:24 gibba020 bash[25448]: cluster 2021-03-10T17:02:22.723166+0000 mgr.gibba020.yqfnwy (mgr.34427) 9978 : cluster [DBG] pgmap v5689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:24.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:24 gibba020 bash[25448]: audit 2021-03-10T17:02:23.412583+0000 mon.a (mon.0) 3578 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:02:24.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:24 gibba020 bash[25448]: cephadm 2021-03-10T17:02:23.412796+0000 mgr.gibba020.yqfnwy (mgr.34427) 9979 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:02:24.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:24 gibba020 bash[25448]: audit 2021-03-10T17:02:23.631431+0000 mon.a (mon.0) 3579 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:02:24.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:24 gibba020 bash[25448]: audit 2021-03-10T17:02:23.634918+0000 mon.a (mon.0) 3580 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:02:24.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:24 gibba020 bash[25448]: audit 2021-03-10T17:02:23.636753+0000 mon.a (mon.0) 3581 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:24.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:24 gibba020 bash[25448]: audit 2021-03-10T17:02:23.638291+0000 mon.a (mon.0) 3582 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:24.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:24 gibba020 bash[25448]: audit 2021-03-10T17:02:23.639935+0000 mon.a (mon.0) 3583 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:24.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:24 gibba020 bash[25448]: audit 2021-03-10T17:02:23.642988+0000 mon.a (mon.0) 3584 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:24.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:24 gibba020 bash[25448]: audit 2021-03-10T17:02:23.644924+0000 mon.a (mon.0) 3585 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:24.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:24 gibba013 bash[29418]: cluster 2021-03-10T17:02:22.723166+0000 mgr.gibba020.yqfnwy (mgr.34427) 9978 : cluster [DBG] pgmap v5689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:24.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:24 gibba013 bash[29418]: audit 2021-03-10T17:02:23.412583+0000 mon.a (mon.0) 3578 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:02:24.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:24 gibba013 bash[29418]: cephadm 2021-03-10T17:02:23.412796+0000 mgr.gibba020.yqfnwy (mgr.34427) 9979 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:02:24.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:24 gibba013 bash[29418]: audit 2021-03-10T17:02:23.631431+0000 mon.a (mon.0) 3579 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:02:24.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:24 gibba013 bash[29418]: audit 2021-03-10T17:02:23.634918+0000 mon.a (mon.0) 3580 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:02:24.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:24 gibba013 bash[29418]: audit 2021-03-10T17:02:23.636753+0000 mon.a (mon.0) 3581 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:24.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:24 gibba013 bash[29418]: audit 2021-03-10T17:02:23.638291+0000 mon.a (mon.0) 3582 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:24.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:24 gibba013 bash[29418]: audit 2021-03-10T17:02:23.639935+0000 mon.a (mon.0) 3583 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:24.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:24 gibba013 bash[29418]: audit 2021-03-10T17:02:23.642988+0000 mon.a (mon.0) 3584 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:24.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:24 gibba013 bash[29418]: audit 2021-03-10T17:02:23.644924+0000 mon.a (mon.0) 3585 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:24.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:24 gibba013 bash[30381]: cluster 2021-03-10T17:02:22.723166+0000 mgr.gibba020.yqfnwy (mgr.34427) 9978 : cluster [DBG] pgmap v5689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:24.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:24 gibba013 bash[30381]: audit 2021-03-10T17:02:23.412583+0000 mon.a (mon.0) 3578 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:02:24.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:24 gibba013 bash[30381]: cephadm 2021-03-10T17:02:23.412796+0000 mgr.gibba020.yqfnwy (mgr.34427) 9979 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:02:24.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:24 gibba013 bash[30381]: audit 2021-03-10T17:02:23.631431+0000 mon.a (mon.0) 3579 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:02:24.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:24 gibba013 bash[30381]: audit 2021-03-10T17:02:23.634918+0000 mon.a (mon.0) 3580 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:02:24.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:24 gibba013 bash[30381]: audit 2021-03-10T17:02:23.636753+0000 mon.a (mon.0) 3581 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:24.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:24 gibba013 bash[30381]: audit 2021-03-10T17:02:23.638291+0000 mon.a (mon.0) 3582 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:24.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:24 gibba013 bash[30381]: audit 2021-03-10T17:02:23.639935+0000 mon.a (mon.0) 3583 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:24.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:24 gibba013 bash[30381]: audit 2021-03-10T17:02:23.642988+0000 mon.a (mon.0) 3584 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:24.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:24 gibba013 bash[30381]: audit 2021-03-10T17:02:23.644924+0000 mon.a (mon.0) 3585 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:25.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:25 gibba020 bash[25448]: cephadm 2021-03-10T17:02:23.633424+0000 mgr.gibba020.yqfnwy (mgr.34427) 9980 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:02:25.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:25 gibba020 bash[25448]: cephadm 2021-03-10T17:02:23.635567+0000 mgr.gibba020.yqfnwy (mgr.34427) 9981 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:02:25.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:25 gibba020 bash[25448]: cephadm 2021-03-10T17:02:23.637336+0000 mgr.gibba020.yqfnwy (mgr.34427) 9982 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:02:25.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:25 gibba020 bash[25448]: cephadm 2021-03-10T17:02:23.637372+0000 mgr.gibba020.yqfnwy (mgr.34427) 9983 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:02:25.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:25 gibba020 bash[25448]: cephadm 2021-03-10T17:02:23.638824+0000 mgr.gibba020.yqfnwy (mgr.34427) 9984 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:02:25.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:25 gibba020 bash[25448]: cephadm 2021-03-10T17:02:23.638863+0000 mgr.gibba020.yqfnwy (mgr.34427) 9985 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:02:25.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:25 gibba020 bash[25448]: cephadm 2021-03-10T17:02:23.640455+0000 mgr.gibba020.yqfnwy (mgr.34427) 9986 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:02:25.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:25 gibba020 bash[25448]: cephadm 2021-03-10T17:02:23.641865+0000 mgr.gibba020.yqfnwy (mgr.34427) 9987 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:02:25.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:25 gibba020 bash[25448]: cephadm 2021-03-10T17:02:23.641904+0000 mgr.gibba020.yqfnwy (mgr.34427) 9988 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:02:25.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:25 gibba020 bash[25448]: cephadm 2021-03-10T17:02:23.643459+0000 mgr.gibba020.yqfnwy (mgr.34427) 9989 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:02:25.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:25 gibba020 bash[25448]: cephadm 2021-03-10T17:02:23.643810+0000 mgr.gibba020.yqfnwy (mgr.34427) 9990 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:02:25.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:25 gibba020 bash[25448]: cephadm 2021-03-10T17:02:23.645513+0000 mgr.gibba020.yqfnwy (mgr.34427) 9991 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:02:25.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:25 gibba020 bash[25448]: cephadm 2021-03-10T17:02:23.645556+0000 mgr.gibba020.yqfnwy (mgr.34427) 9992 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:02:25.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:25 gibba020 bash[25448]: cephadm 2021-03-10T17:02:23.645670+0000 mgr.gibba020.yqfnwy (mgr.34427) 9993 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:02:25.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:25 gibba013 bash[29418]: cephadm 2021-03-10T17:02:23.633424+0000 mgr.gibba020.yqfnwy (mgr.34427) 9980 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:02:25.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:25 gibba013 bash[29418]: cephadm 2021-03-10T17:02:23.635567+0000 mgr.gibba020.yqfnwy (mgr.34427) 9981 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:02:25.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:25 gibba013 bash[29418]: cephadm 2021-03-10T17:02:23.637336+0000 mgr.gibba020.yqfnwy (mgr.34427) 9982 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:02:25.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:25 gibba013 bash[29418]: cephadm 2021-03-10T17:02:23.637372+0000 mgr.gibba020.yqfnwy (mgr.34427) 9983 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:02:25.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:25 gibba013 bash[29418]: cephadm 2021-03-10T17:02:23.638824+0000 mgr.gibba020.yqfnwy (mgr.34427) 9984 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:02:25.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:25 gibba013 bash[29418]: cephadm 2021-03-10T17:02:23.638863+0000 mgr.gibba020.yqfnwy (mgr.34427) 9985 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:02:25.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:25 gibba013 bash[29418]: cephadm 2021-03-10T17:02:23.640455+0000 mgr.gibba020.yqfnwy (mgr.34427) 9986 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:02:25.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:25 gibba013 bash[29418]: cephadm 2021-03-10T17:02:23.641865+0000 mgr.gibba020.yqfnwy (mgr.34427) 9987 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:02:25.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:25 gibba013 bash[29418]: cephadm 2021-03-10T17:02:23.641904+0000 mgr.gibba020.yqfnwy (mgr.34427) 9988 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:02:25.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:25 gibba013 bash[29418]: cephadm 2021-03-10T17:02:23.643459+0000 mgr.gibba020.yqfnwy (mgr.34427) 9989 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:02:25.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:25 gibba013 bash[29418]: cephadm 2021-03-10T17:02:23.643810+0000 mgr.gibba020.yqfnwy (mgr.34427) 9990 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:02:25.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:25 gibba013 bash[29418]: cephadm 2021-03-10T17:02:23.645513+0000 mgr.gibba020.yqfnwy (mgr.34427) 9991 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:02:25.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:25 gibba013 bash[29418]: cephadm 2021-03-10T17:02:23.645556+0000 mgr.gibba020.yqfnwy (mgr.34427) 9992 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:02:25.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:25 gibba013 bash[29418]: cephadm 2021-03-10T17:02:23.645670+0000 mgr.gibba020.yqfnwy (mgr.34427) 9993 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:02:25.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:25 gibba013 bash[30381]: cephadm 2021-03-10T17:02:23.633424+0000 mgr.gibba020.yqfnwy (mgr.34427) 9980 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:02:25.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:25 gibba013 bash[30381]: cephadm 2021-03-10T17:02:23.635567+0000 mgr.gibba020.yqfnwy (mgr.34427) 9981 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:02:25.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:25 gibba013 bash[30381]: cephadm 2021-03-10T17:02:23.637336+0000 mgr.gibba020.yqfnwy (mgr.34427) 9982 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:02:25.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:25 gibba013 bash[30381]: cephadm 2021-03-10T17:02:23.637372+0000 mgr.gibba020.yqfnwy (mgr.34427) 9983 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:02:25.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:25 gibba013 bash[30381]: cephadm 2021-03-10T17:02:23.638824+0000 mgr.gibba020.yqfnwy (mgr.34427) 9984 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:02:25.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:25 gibba013 bash[30381]: cephadm 2021-03-10T17:02:23.638863+0000 mgr.gibba020.yqfnwy (mgr.34427) 9985 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:02:25.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:25 gibba013 bash[30381]: cephadm 2021-03-10T17:02:23.640455+0000 mgr.gibba020.yqfnwy (mgr.34427) 9986 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:02:25.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:25 gibba013 bash[30381]: cephadm 2021-03-10T17:02:23.641865+0000 mgr.gibba020.yqfnwy (mgr.34427) 9987 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:02:25.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:25 gibba013 bash[30381]: cephadm 2021-03-10T17:02:23.641904+0000 mgr.gibba020.yqfnwy (mgr.34427) 9988 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:02:25.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:25 gibba013 bash[30381]: cephadm 2021-03-10T17:02:23.643459+0000 mgr.gibba020.yqfnwy (mgr.34427) 9989 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:02:25.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:25 gibba013 bash[30381]: cephadm 2021-03-10T17:02:23.643810+0000 mgr.gibba020.yqfnwy (mgr.34427) 9990 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:02:25.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:25 gibba013 bash[30381]: cephadm 2021-03-10T17:02:23.645513+0000 mgr.gibba020.yqfnwy (mgr.34427) 9991 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:02:25.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:25 gibba013 bash[30381]: cephadm 2021-03-10T17:02:23.645556+0000 mgr.gibba020.yqfnwy (mgr.34427) 9992 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:02:25.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:25 gibba013 bash[30381]: cephadm 2021-03-10T17:02:23.645670+0000 mgr.gibba020.yqfnwy (mgr.34427) 9993 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:02:26.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:26 gibba020 bash[25448]: cluster 2021-03-10T17:02:24.724736+0000 mgr.gibba020.yqfnwy (mgr.34427) 9994 : cluster [DBG] pgmap v5690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:26.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:26 gibba013 bash[29418]: cluster 2021-03-10T17:02:24.724736+0000 mgr.gibba020.yqfnwy (mgr.34427) 9994 : cluster [DBG] pgmap v5690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:26.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:26 gibba013 bash[30381]: cluster 2021-03-10T17:02:24.724736+0000 mgr.gibba020.yqfnwy (mgr.34427) 9994 : cluster [DBG] pgmap v5690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:28.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:28 gibba020 bash[25448]: cluster 2021-03-10T17:02:26.726231+0000 mgr.gibba020.yqfnwy (mgr.34427) 9995 : cluster [DBG] pgmap v5691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:28.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:28 gibba013 bash[29418]: cluster 2021-03-10T17:02:26.726231+0000 mgr.gibba020.yqfnwy (mgr.34427) 9995 : cluster [DBG] pgmap v5691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:28.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:28 gibba013 bash[30381]: cluster 2021-03-10T17:02:26.726231+0000 mgr.gibba020.yqfnwy (mgr.34427) 9995 : cluster [DBG] pgmap v5691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:30.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:30 gibba013 bash[29418]: cluster 2021-03-10T17:02:28.727796+0000 mgr.gibba020.yqfnwy (mgr.34427) 9996 : cluster [DBG] pgmap v5692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:30.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:30 gibba013 bash[30381]: cluster 2021-03-10T17:02:28.727796+0000 mgr.gibba020.yqfnwy (mgr.34427) 9996 : cluster [DBG] pgmap v5692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:30.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:30 gibba020 bash[25448]: cluster 2021-03-10T17:02:28.727796+0000 mgr.gibba020.yqfnwy (mgr.34427) 9996 : cluster [DBG] pgmap v5692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:31.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:31 gibba013 bash[29418]: cluster 2021-03-10T17:02:30.729517+0000 mgr.gibba020.yqfnwy (mgr.34427) 9997 : cluster [DBG] pgmap v5693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:31.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:31 gibba013 bash[30381]: cluster 2021-03-10T17:02:30.729517+0000 mgr.gibba020.yqfnwy (mgr.34427) 9997 : cluster [DBG] pgmap v5693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:31.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:31 gibba020 bash[25448]: cluster 2021-03-10T17:02:30.729517+0000 mgr.gibba020.yqfnwy (mgr.34427) 9997 : cluster [DBG] pgmap v5693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:34.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:33 gibba013 bash[29418]: cluster 2021-03-10T17:02:32.730937+0000 mgr.gibba020.yqfnwy (mgr.34427) 9998 : cluster [DBG] pgmap v5694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:34.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:33 gibba013 bash[30381]: cluster 2021-03-10T17:02:32.730937+0000 mgr.gibba020.yqfnwy (mgr.34427) 9998 : cluster [DBG] pgmap v5694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:34.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:33 gibba020 bash[25448]: cluster 2021-03-10T17:02:32.730937+0000 mgr.gibba020.yqfnwy (mgr.34427) 9998 : cluster [DBG] pgmap v5694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:36.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:36 gibba013 bash[29418]: cluster 2021-03-10T17:02:34.732738+0000 mgr.gibba020.yqfnwy (mgr.34427) 9999 : cluster [DBG] pgmap v5695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:36.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:36 gibba013 bash[30381]: cluster 2021-03-10T17:02:34.732738+0000 mgr.gibba020.yqfnwy (mgr.34427) 9999 : cluster [DBG] pgmap v5695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:36.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:36 gibba020 bash[25448]: cluster 2021-03-10T17:02:34.732738+0000 mgr.gibba020.yqfnwy (mgr.34427) 9999 : cluster [DBG] pgmap v5695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:38.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:38 gibba013 bash[29418]: cluster 2021-03-10T17:02:36.734272+0000 mgr.gibba020.yqfnwy (mgr.34427) 10000 : cluster [DBG] pgmap v5696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:38.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:38 gibba013 bash[30381]: cluster 2021-03-10T17:02:36.734272+0000 mgr.gibba020.yqfnwy (mgr.34427) 10000 : cluster [DBG] pgmap v5696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:38.662 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:38 gibba020 bash[25448]: cluster 2021-03-10T17:02:36.734272+0000 mgr.gibba020.yqfnwy (mgr.34427) 10000 : cluster [DBG] pgmap v5696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:40.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:40 gibba013 bash[29418]: cephadm 2021-03-10T17:02:38.661219+0000 mgr.gibba020.yqfnwy (mgr.34427) 10001 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:02:40.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:40 gibba013 bash[29418]: cluster 2021-03-10T17:02:38.735998+0000 mgr.gibba020.yqfnwy (mgr.34427) 10002 : cluster [DBG] pgmap v5697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:40.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:40 gibba013 bash[30381]: cephadm 2021-03-10T17:02:38.661219+0000 mgr.gibba020.yqfnwy (mgr.34427) 10001 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:02:40.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:40 gibba013 bash[30381]: cluster 2021-03-10T17:02:38.735998+0000 mgr.gibba020.yqfnwy (mgr.34427) 10002 : cluster [DBG] pgmap v5697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:40.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:40 gibba020 bash[25448]: cephadm 2021-03-10T17:02:38.661219+0000 mgr.gibba020.yqfnwy (mgr.34427) 10001 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:02:40.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:40 gibba020 bash[25448]: cluster 2021-03-10T17:02:38.735998+0000 mgr.gibba020.yqfnwy (mgr.34427) 10002 : cluster [DBG] pgmap v5697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:42.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:42 gibba013 bash[29418]: cluster 2021-03-10T17:02:40.737601+0000 mgr.gibba020.yqfnwy (mgr.34427) 10003 : cluster [DBG] pgmap v5698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:42.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:42 gibba013 bash[30381]: cluster 2021-03-10T17:02:40.737601+0000 mgr.gibba020.yqfnwy (mgr.34427) 10003 : cluster [DBG] pgmap v5698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:42.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:42 gibba020 bash[25448]: cluster 2021-03-10T17:02:40.737601+0000 mgr.gibba020.yqfnwy (mgr.34427) 10003 : cluster [DBG] pgmap v5698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:44.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:44 gibba013 bash[29418]: cluster 2021-03-10T17:02:42.739035+0000 mgr.gibba020.yqfnwy (mgr.34427) 10004 : cluster [DBG] pgmap v5699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:44.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:44 gibba013 bash[30381]: cluster 2021-03-10T17:02:42.739035+0000 mgr.gibba020.yqfnwy (mgr.34427) 10004 : cluster [DBG] pgmap v5699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:44.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:44 gibba020 bash[25448]: cluster 2021-03-10T17:02:42.739035+0000 mgr.gibba020.yqfnwy (mgr.34427) 10004 : cluster [DBG] pgmap v5699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:46.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:46 gibba013 bash[29418]: cluster 2021-03-10T17:02:44.740701+0000 mgr.gibba020.yqfnwy (mgr.34427) 10005 : cluster [DBG] pgmap v5700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:46.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:46 gibba013 bash[30381]: cluster 2021-03-10T17:02:44.740701+0000 mgr.gibba020.yqfnwy (mgr.34427) 10005 : cluster [DBG] pgmap v5700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:46.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:46 gibba020 bash[25448]: cluster 2021-03-10T17:02:44.740701+0000 mgr.gibba020.yqfnwy (mgr.34427) 10005 : cluster [DBG] pgmap v5700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:48.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:48 gibba013 bash[29418]: cluster 2021-03-10T17:02:46.742105+0000 mgr.gibba020.yqfnwy (mgr.34427) 10006 : cluster [DBG] pgmap v5701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:48.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:48 gibba013 bash[30381]: cluster 2021-03-10T17:02:46.742105+0000 mgr.gibba020.yqfnwy (mgr.34427) 10006 : cluster [DBG] pgmap v5701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:48.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:48 gibba020 bash[25448]: cluster 2021-03-10T17:02:46.742105+0000 mgr.gibba020.yqfnwy (mgr.34427) 10006 : cluster [DBG] pgmap v5701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:50.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:50 gibba013 bash[29418]: cluster 2021-03-10T17:02:48.743678+0000 mgr.gibba020.yqfnwy (mgr.34427) 10007 : cluster [DBG] pgmap v5702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:50.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:50 gibba013 bash[30381]: cluster 2021-03-10T17:02:48.743678+0000 mgr.gibba020.yqfnwy (mgr.34427) 10007 : cluster [DBG] pgmap v5702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:50.649 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:02:50.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:50 gibba020 bash[25448]: cluster 2021-03-10T17:02:48.743678+0000 mgr.gibba020.yqfnwy (mgr.34427) 10007 : cluster [DBG] pgmap v5702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:50.878 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:02:50.878 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 91s ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:02:50.878 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 27s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:02:50.878 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 27s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:02:50.879 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 27s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:02:50.879 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 91s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:02:50.879 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 91s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:02:50.879 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 27s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:02:50.880 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 91s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:02:50.880 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 91s ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:02:50.880 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 27s ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:02:50.880 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 91s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:02:50.880 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 91s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:02:50.881 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 91s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:02:50.881 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 91s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:02:50.881 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 27s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:02:50.881 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 27s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:02:50.881 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 27s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:02:50.882 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 27s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:02:50.882 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 27s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:02:50.882 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 27s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:02:51.127 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:02:51.127 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:02:51.127 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:02:51.128 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:02:51.128 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:02:51.128 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:02:51.128 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:02:51.129 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:02:51.129 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:02:51.129 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:02:51.129 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:02:51.129 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:02:51.130 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:02:51.130 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:02:51.130 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:02:51.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:51 gibba013 bash[29418]: audit 2021-03-10T17:02:51.126663+0000 mon.a (mon.0) 3586 : audit [DBG] from='client.? 172.21.2.113:0/2261338091' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:51.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:51 gibba013 bash[30381]: audit 2021-03-10T17:02:51.126663+0000 mon.a (mon.0) 3586 : audit [DBG] from='client.? 172.21.2.113:0/2261338091' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:51.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:51 gibba020 bash[25448]: audit 2021-03-10T17:02:51.126663+0000 mon.a (mon.0) 3586 : audit [DBG] from='client.? 172.21.2.113:0/2261338091' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:02:52.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:52 gibba013 bash[29418]: audit 2021-03-10T17:02:50.640174+0000 mgr.gibba020.yqfnwy (mgr.34427) 10008 : audit [DBG] from='client.60745 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:02:52.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:52 gibba013 bash[29418]: cluster 2021-03-10T17:02:50.745330+0000 mgr.gibba020.yqfnwy (mgr.34427) 10009 : cluster [DBG] pgmap v5703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:52.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:52 gibba013 bash[29418]: audit 2021-03-10T17:02:50.864507+0000 mgr.gibba020.yqfnwy (mgr.34427) 10010 : audit [DBG] from='client.50772 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:02:52.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:52 gibba013 bash[30381]: audit 2021-03-10T17:02:50.640174+0000 mgr.gibba020.yqfnwy (mgr.34427) 10008 : audit [DBG] from='client.60745 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:02:52.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:52 gibba013 bash[30381]: cluster 2021-03-10T17:02:50.745330+0000 mgr.gibba020.yqfnwy (mgr.34427) 10009 : cluster [DBG] pgmap v5703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:52.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:52 gibba013 bash[30381]: audit 2021-03-10T17:02:50.864507+0000 mgr.gibba020.yqfnwy (mgr.34427) 10010 : audit [DBG] from='client.50772 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:02:52.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:52 gibba020 bash[25448]: audit 2021-03-10T17:02:50.640174+0000 mgr.gibba020.yqfnwy (mgr.34427) 10008 : audit [DBG] from='client.60745 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:02:52.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:52 gibba020 bash[25448]: cluster 2021-03-10T17:02:50.745330+0000 mgr.gibba020.yqfnwy (mgr.34427) 10009 : cluster [DBG] pgmap v5703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:52.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:52 gibba020 bash[25448]: audit 2021-03-10T17:02:50.864507+0000 mgr.gibba020.yqfnwy (mgr.34427) 10010 : audit [DBG] from='client.50772 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:02:54.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:54 gibba013 bash[29418]: cluster 2021-03-10T17:02:52.746751+0000 mgr.gibba020.yqfnwy (mgr.34427) 10011 : cluster [DBG] pgmap v5704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:54.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:54 gibba013 bash[30381]: cluster 2021-03-10T17:02:52.746751+0000 mgr.gibba020.yqfnwy (mgr.34427) 10011 : cluster [DBG] pgmap v5704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:54.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:54 gibba020 bash[25448]: cluster 2021-03-10T17:02:52.746751+0000 mgr.gibba020.yqfnwy (mgr.34427) 10011 : cluster [DBG] pgmap v5704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:55.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:55 gibba013 bash[29418]: cephadm 2021-03-10T17:02:53.673058+0000 mgr.gibba020.yqfnwy (mgr.34427) 10012 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:02:55.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:55 gibba013 bash[30381]: cephadm 2021-03-10T17:02:53.673058+0000 mgr.gibba020.yqfnwy (mgr.34427) 10012 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:02:55.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:55 gibba020 bash[25448]: cephadm 2021-03-10T17:02:53.673058+0000 mgr.gibba020.yqfnwy (mgr.34427) 10012 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:02:56.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:56 gibba013 bash[29418]: cluster 2021-03-10T17:02:54.748407+0000 mgr.gibba020.yqfnwy (mgr.34427) 10013 : cluster [DBG] pgmap v5705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:56.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:56 gibba013 bash[30381]: cluster 2021-03-10T17:02:54.748407+0000 mgr.gibba020.yqfnwy (mgr.34427) 10013 : cluster [DBG] pgmap v5705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:56.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:56 gibba020 bash[25448]: cluster 2021-03-10T17:02:54.748407+0000 mgr.gibba020.yqfnwy (mgr.34427) 10013 : cluster [DBG] pgmap v5705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:58.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:02:58 gibba020 bash[25448]: cluster 2021-03-10T17:02:56.749794+0000 mgr.gibba020.yqfnwy (mgr.34427) 10014 : cluster [DBG] pgmap v5706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:58.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:02:58 gibba013 bash[29418]: cluster 2021-03-10T17:02:56.749794+0000 mgr.gibba020.yqfnwy (mgr.34427) 10014 : cluster [DBG] pgmap v5706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:02:58.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:02:58 gibba013 bash[30381]: cluster 2021-03-10T17:02:56.749794+0000 mgr.gibba020.yqfnwy (mgr.34427) 10014 : cluster [DBG] pgmap v5706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:00.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:00 gibba020 bash[25448]: cluster 2021-03-10T17:02:58.751349+0000 mgr.gibba020.yqfnwy (mgr.34427) 10015 : cluster [DBG] pgmap v5707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:00.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:00 gibba013 bash[29418]: cluster 2021-03-10T17:02:58.751349+0000 mgr.gibba020.yqfnwy (mgr.34427) 10015 : cluster [DBG] pgmap v5707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:00.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:00 gibba013 bash[30381]: cluster 2021-03-10T17:02:58.751349+0000 mgr.gibba020.yqfnwy (mgr.34427) 10015 : cluster [DBG] pgmap v5707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:02.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:02 gibba020 bash[25448]: cluster 2021-03-10T17:03:00.753009+0000 mgr.gibba020.yqfnwy (mgr.34427) 10016 : cluster [DBG] pgmap v5708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:02.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:02 gibba013 bash[29418]: cluster 2021-03-10T17:03:00.753009+0000 mgr.gibba020.yqfnwy (mgr.34427) 10016 : cluster [DBG] pgmap v5708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:02.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:02 gibba013 bash[30381]: cluster 2021-03-10T17:03:00.753009+0000 mgr.gibba020.yqfnwy (mgr.34427) 10016 : cluster [DBG] pgmap v5708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:04.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:04 gibba020 bash[25448]: cluster 2021-03-10T17:03:02.754279+0000 mgr.gibba020.yqfnwy (mgr.34427) 10017 : cluster [DBG] pgmap v5709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:04.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:04 gibba013 bash[29418]: cluster 2021-03-10T17:03:02.754279+0000 mgr.gibba020.yqfnwy (mgr.34427) 10017 : cluster [DBG] pgmap v5709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:04.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:04 gibba013 bash[30381]: cluster 2021-03-10T17:03:02.754279+0000 mgr.gibba020.yqfnwy (mgr.34427) 10017 : cluster [DBG] pgmap v5709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:06.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:06 gibba020 bash[25448]: cluster 2021-03-10T17:03:04.755735+0000 mgr.gibba020.yqfnwy (mgr.34427) 10018 : cluster [DBG] pgmap v5710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:06.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:06 gibba013 bash[29418]: cluster 2021-03-10T17:03:04.755735+0000 mgr.gibba020.yqfnwy (mgr.34427) 10018 : cluster [DBG] pgmap v5710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:06.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:06 gibba013 bash[30381]: cluster 2021-03-10T17:03:04.755735+0000 mgr.gibba020.yqfnwy (mgr.34427) 10018 : cluster [DBG] pgmap v5710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:07.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:07 gibba020 bash[25448]: audit 2021-03-10T17:03:06.875457+0000 mon.a (mon.0) 3587 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:03:07.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:07 gibba020 bash[25448]: audit 2021-03-10T17:03:07.074522+0000 mon.a (mon.0) 3588 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:03:07.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:07 gibba013 bash[29418]: audit 2021-03-10T17:03:06.875457+0000 mon.a (mon.0) 3587 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:03:07.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:07 gibba013 bash[29418]: audit 2021-03-10T17:03:07.074522+0000 mon.a (mon.0) 3588 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:03:07.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:07 gibba013 bash[30381]: audit 2021-03-10T17:03:06.875457+0000 mon.a (mon.0) 3587 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:03:07.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:07 gibba013 bash[30381]: audit 2021-03-10T17:03:07.074522+0000 mon.a (mon.0) 3588 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:03:08.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:08 gibba020 bash[25448]: cluster 2021-03-10T17:03:06.757428+0000 mgr.gibba020.yqfnwy (mgr.34427) 10019 : cluster [DBG] pgmap v5711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:08.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:08 gibba020 bash[25448]: audit 2021-03-10T17:03:07.483199+0000 mon.a (mon.0) 3589 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T17:03:08.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:08 gibba020 bash[25448]: audit 2021-03-10T17:03:07.483974+0000 mon.a (mon.0) 3590 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:03:08.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:08 gibba020 bash[25448]: audit 2021-03-10T17:03:07.484658+0000 mon.a (mon.0) 3591 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:03:08.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:08 gibba020 bash[25448]: audit 2021-03-10T17:03:07.485324+0000 mon.a (mon.0) 3592 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:03:08.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:08 gibba013 bash[29418]: cluster 2021-03-10T17:03:06.757428+0000 mgr.gibba020.yqfnwy (mgr.34427) 10019 : cluster [DBG] pgmap v5711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:08.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:08 gibba013 bash[29418]: audit 2021-03-10T17:03:07.483199+0000 mon.a (mon.0) 3589 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T17:03:08.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:08 gibba013 bash[29418]: audit 2021-03-10T17:03:07.483974+0000 mon.a (mon.0) 3590 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:03:08.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:08 gibba013 bash[29418]: audit 2021-03-10T17:03:07.484658+0000 mon.a (mon.0) 3591 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:03:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:08 gibba013 bash[29418]: audit 2021-03-10T17:03:07.485324+0000 mon.a (mon.0) 3592 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:03:08.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:08 gibba013 bash[30381]: cluster 2021-03-10T17:03:06.757428+0000 mgr.gibba020.yqfnwy (mgr.34427) 10019 : cluster [DBG] pgmap v5711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:08.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:08 gibba013 bash[30381]: audit 2021-03-10T17:03:07.483199+0000 mon.a (mon.0) 3589 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T17:03:08.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:08 gibba013 bash[30381]: audit 2021-03-10T17:03:07.483974+0000 mon.a (mon.0) 3590 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:03:08.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:08 gibba013 bash[30381]: audit 2021-03-10T17:03:07.484658+0000 mon.a (mon.0) 3591 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:03:08.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:08 gibba013 bash[30381]: audit 2021-03-10T17:03:07.485324+0000 mon.a (mon.0) 3592 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:03:10.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:10 gibba020 bash[25448]: cephadm 2021-03-10T17:03:08.677343+0000 mgr.gibba020.yqfnwy (mgr.34427) 10020 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:03:10.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:10 gibba020 bash[25448]: cluster 2021-03-10T17:03:08.758981+0000 mgr.gibba020.yqfnwy (mgr.34427) 10021 : cluster [DBG] pgmap v5712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:10.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:10 gibba013 bash[29418]: cephadm 2021-03-10T17:03:08.677343+0000 mgr.gibba020.yqfnwy (mgr.34427) 10020 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:03:10.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:10 gibba013 bash[29418]: cluster 2021-03-10T17:03:08.758981+0000 mgr.gibba020.yqfnwy (mgr.34427) 10021 : cluster [DBG] pgmap v5712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:10.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:10 gibba013 bash[30381]: cephadm 2021-03-10T17:03:08.677343+0000 mgr.gibba020.yqfnwy (mgr.34427) 10020 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:03:10.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:10 gibba013 bash[30381]: cluster 2021-03-10T17:03:08.758981+0000 mgr.gibba020.yqfnwy (mgr.34427) 10021 : cluster [DBG] pgmap v5712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:12.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:12 gibba013 bash[29418]: cluster 2021-03-10T17:03:10.760625+0000 mgr.gibba020.yqfnwy (mgr.34427) 10022 : cluster [DBG] pgmap v5713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:12.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:12 gibba013 bash[30381]: cluster 2021-03-10T17:03:10.760625+0000 mgr.gibba020.yqfnwy (mgr.34427) 10022 : cluster [DBG] pgmap v5713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:12.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:12 gibba020 bash[25448]: cluster 2021-03-10T17:03:10.760625+0000 mgr.gibba020.yqfnwy (mgr.34427) 10022 : cluster [DBG] pgmap v5713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:14.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:14 gibba013 bash[29418]: cluster 2021-03-10T17:03:12.762090+0000 mgr.gibba020.yqfnwy (mgr.34427) 10023 : cluster [DBG] pgmap v5714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:14.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:14 gibba013 bash[30381]: cluster 2021-03-10T17:03:12.762090+0000 mgr.gibba020.yqfnwy (mgr.34427) 10023 : cluster [DBG] pgmap v5714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:14.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:14 gibba020 bash[25448]: cluster 2021-03-10T17:03:12.762090+0000 mgr.gibba020.yqfnwy (mgr.34427) 10023 : cluster [DBG] pgmap v5714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:16.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:16 gibba013 bash[29418]: cluster 2021-03-10T17:03:14.763818+0000 mgr.gibba020.yqfnwy (mgr.34427) 10024 : cluster [DBG] pgmap v5715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:16.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:16 gibba013 bash[30381]: cluster 2021-03-10T17:03:14.763818+0000 mgr.gibba020.yqfnwy (mgr.34427) 10024 : cluster [DBG] pgmap v5715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:16.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:16 gibba020 bash[25448]: cluster 2021-03-10T17:03:14.763818+0000 mgr.gibba020.yqfnwy (mgr.34427) 10024 : cluster [DBG] pgmap v5715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:18.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:18 gibba013 bash[30381]: cluster 2021-03-10T17:03:16.765157+0000 mgr.gibba020.yqfnwy (mgr.34427) 10025 : cluster [DBG] pgmap v5716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:18.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:18 gibba013 bash[29418]: cluster 2021-03-10T17:03:16.765157+0000 mgr.gibba020.yqfnwy (mgr.34427) 10025 : cluster [DBG] pgmap v5716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:18.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:18 gibba020 bash[25448]: cluster 2021-03-10T17:03:16.765157+0000 mgr.gibba020.yqfnwy (mgr.34427) 10025 : cluster [DBG] pgmap v5716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:20.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:20 gibba013 bash[29418]: cluster 2021-03-10T17:03:18.766823+0000 mgr.gibba020.yqfnwy (mgr.34427) 10026 : cluster [DBG] pgmap v5717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:20.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:20 gibba013 bash[30381]: cluster 2021-03-10T17:03:18.766823+0000 mgr.gibba020.yqfnwy (mgr.34427) 10026 : cluster [DBG] pgmap v5717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:20.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:20 gibba020 bash[25448]: cluster 2021-03-10T17:03:18.766823+0000 mgr.gibba020.yqfnwy (mgr.34427) 10026 : cluster [DBG] pgmap v5717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:21.371 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:03:21.599 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:03:21.599 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 2m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:03:21.600 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 58s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:03:21.600 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 58s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:03:21.600 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 58s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:03:21.600 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:03:21.601 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:03:21.601 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 58s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:03:21.601 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:03:21.601 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:03:21.601 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 58s ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:03:21.602 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:03:21.602 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:03:21.602 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:03:21.602 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:03:21.603 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 58s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:03:21.603 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 58s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:03:21.603 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 58s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:03:21.603 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 58s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:03:21.603 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 58s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:03:21.604 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 58s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:03:21.859 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:03:21.860 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:03:21.860 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:03:21.860 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:03:21.861 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:03:21.861 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:03:21.861 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:03:21.861 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:03:21.862 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:03:21.862 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:03:21.862 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:03:21.862 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:03:21.863 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:03:21.863 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:03:21.863 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:03:22.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:22 gibba013 bash[29418]: cluster 2021-03-10T17:03:20.768605+0000 mgr.gibba020.yqfnwy (mgr.34427) 10027 : cluster [DBG] pgmap v5718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:22.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:22 gibba013 bash[29418]: audit 2021-03-10T17:03:21.362394+0000 mgr.gibba020.yqfnwy (mgr.34427) 10028 : audit [DBG] from='client.50784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:03:22.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:22 gibba013 bash[29418]: audit 2021-03-10T17:03:21.858824+0000 mon.a (mon.0) 3593 : audit [DBG] from='client.? 172.21.2.113:0/3093388950' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:22.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:22 gibba013 bash[30381]: cluster 2021-03-10T17:03:20.768605+0000 mgr.gibba020.yqfnwy (mgr.34427) 10027 : cluster [DBG] pgmap v5718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:22.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:22 gibba013 bash[30381]: audit 2021-03-10T17:03:21.362394+0000 mgr.gibba020.yqfnwy (mgr.34427) 10028 : audit [DBG] from='client.50784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:03:22.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:22 gibba013 bash[30381]: audit 2021-03-10T17:03:21.858824+0000 mon.a (mon.0) 3593 : audit [DBG] from='client.? 172.21.2.113:0/3093388950' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:22.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:22 gibba020 bash[25448]: cluster 2021-03-10T17:03:20.768605+0000 mgr.gibba020.yqfnwy (mgr.34427) 10027 : cluster [DBG] pgmap v5718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:22.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:22 gibba020 bash[25448]: audit 2021-03-10T17:03:21.362394+0000 mgr.gibba020.yqfnwy (mgr.34427) 10028 : audit [DBG] from='client.50784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:03:22.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:22 gibba020 bash[25448]: audit 2021-03-10T17:03:21.858824+0000 mon.a (mon.0) 3593 : audit [DBG] from='client.? 172.21.2.113:0/3093388950' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:23.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:23 gibba013 bash[29418]: audit 2021-03-10T17:03:21.585648+0000 mgr.gibba020.yqfnwy (mgr.34427) 10029 : audit [DBG] from='client.50790 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:03:23.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:23 gibba013 bash[30381]: audit 2021-03-10T17:03:21.585648+0000 mgr.gibba020.yqfnwy (mgr.34427) 10029 : audit [DBG] from='client.50790 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:03:23.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:23 gibba020 bash[25448]: audit 2021-03-10T17:03:21.585648+0000 mgr.gibba020.yqfnwy (mgr.34427) 10029 : audit [DBG] from='client.50790 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:03:24.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:24 gibba013 bash[29418]: cluster 2021-03-10T17:03:22.769924+0000 mgr.gibba020.yqfnwy (mgr.34427) 10030 : cluster [DBG] pgmap v5719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:24.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:24 gibba013 bash[29418]: audit 2021-03-10T17:03:23.694729+0000 mon.a (mon.0) 3594 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:03:24.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:24 gibba013 bash[29418]: audit 2021-03-10T17:03:23.929048+0000 mon.a (mon.0) 3595 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:03:24.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:24 gibba013 bash[29418]: audit 2021-03-10T17:03:23.932637+0000 mon.a (mon.0) 3596 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:03:24.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:24 gibba013 bash[29418]: audit 2021-03-10T17:03:23.934819+0000 mon.a (mon.0) 3597 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:24.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:24 gibba013 bash[29418]: audit 2021-03-10T17:03:23.936743+0000 mon.a (mon.0) 3598 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:24.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:24 gibba013 bash[29418]: audit 2021-03-10T17:03:23.938356+0000 mon.a (mon.0) 3599 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:24.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:24 gibba013 bash[29418]: audit 2021-03-10T17:03:23.941504+0000 mon.a (mon.0) 3600 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:24.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:24 gibba013 bash[29418]: audit 2021-03-10T17:03:23.943254+0000 mon.a (mon.0) 3601 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:24.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:24 gibba013 bash[30381]: cluster 2021-03-10T17:03:22.769924+0000 mgr.gibba020.yqfnwy (mgr.34427) 10030 : cluster [DBG] pgmap v5719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:24.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:24 gibba013 bash[30381]: audit 2021-03-10T17:03:23.694729+0000 mon.a (mon.0) 3594 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:03:24.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:24 gibba013 bash[30381]: audit 2021-03-10T17:03:23.929048+0000 mon.a (mon.0) 3595 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:03:24.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:24 gibba013 bash[30381]: audit 2021-03-10T17:03:23.932637+0000 mon.a (mon.0) 3596 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:03:24.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:24 gibba013 bash[30381]: audit 2021-03-10T17:03:23.934819+0000 mon.a (mon.0) 3597 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:24.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:24 gibba013 bash[30381]: audit 2021-03-10T17:03:23.936743+0000 mon.a (mon.0) 3598 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:24.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:24 gibba013 bash[30381]: audit 2021-03-10T17:03:23.938356+0000 mon.a (mon.0) 3599 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:24.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:24 gibba013 bash[30381]: audit 2021-03-10T17:03:23.941504+0000 mon.a (mon.0) 3600 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:24.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:24 gibba013 bash[30381]: audit 2021-03-10T17:03:23.943254+0000 mon.a (mon.0) 3601 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:24.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:24 gibba020 bash[25448]: cluster 2021-03-10T17:03:22.769924+0000 mgr.gibba020.yqfnwy (mgr.34427) 10030 : cluster [DBG] pgmap v5719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:24.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:24 gibba020 bash[25448]: audit 2021-03-10T17:03:23.694729+0000 mon.a (mon.0) 3594 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:03:24.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:24 gibba020 bash[25448]: audit 2021-03-10T17:03:23.929048+0000 mon.a (mon.0) 3595 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:03:24.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:24 gibba020 bash[25448]: audit 2021-03-10T17:03:23.932637+0000 mon.a (mon.0) 3596 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:03:24.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:24 gibba020 bash[25448]: audit 2021-03-10T17:03:23.934819+0000 mon.a (mon.0) 3597 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:24.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:24 gibba020 bash[25448]: audit 2021-03-10T17:03:23.936743+0000 mon.a (mon.0) 3598 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:24.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:24 gibba020 bash[25448]: audit 2021-03-10T17:03:23.938356+0000 mon.a (mon.0) 3599 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:24.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:24 gibba020 bash[25448]: audit 2021-03-10T17:03:23.941504+0000 mon.a (mon.0) 3600 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:24.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:24 gibba020 bash[25448]: audit 2021-03-10T17:03:23.943254+0000 mon.a (mon.0) 3601 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:25.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:25 gibba013 bash[29418]: cephadm 2021-03-10T17:03:23.699483+0000 mgr.gibba020.yqfnwy (mgr.34427) 10031 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:03:25.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:25 gibba013 bash[29418]: cephadm 2021-03-10T17:03:23.701304+0000 mgr.gibba020.yqfnwy (mgr.34427) 10032 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:03:25.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:25 gibba013 bash[29418]: cephadm 2021-03-10T17:03:23.931039+0000 mgr.gibba020.yqfnwy (mgr.34427) 10033 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:03:25.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:25 gibba013 bash[29418]: cephadm 2021-03-10T17:03:23.933754+0000 mgr.gibba020.yqfnwy (mgr.34427) 10034 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:03:25.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:25 gibba013 bash[29418]: cephadm 2021-03-10T17:03:23.935617+0000 mgr.gibba020.yqfnwy (mgr.34427) 10035 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:03:25.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:25 gibba013 bash[29418]: cephadm 2021-03-10T17:03:23.935655+0000 mgr.gibba020.yqfnwy (mgr.34427) 10036 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:03:25.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:25 gibba013 bash[29418]: cephadm 2021-03-10T17:03:23.937426+0000 mgr.gibba020.yqfnwy (mgr.34427) 10037 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:03:25.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:25 gibba013 bash[29418]: cephadm 2021-03-10T17:03:23.937466+0000 mgr.gibba020.yqfnwy (mgr.34427) 10038 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:03:25.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:25 gibba013 bash[29418]: cephadm 2021-03-10T17:03:23.938837+0000 mgr.gibba020.yqfnwy (mgr.34427) 10039 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:03:25.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:25 gibba013 bash[29418]: cephadm 2021-03-10T17:03:23.940343+0000 mgr.gibba020.yqfnwy (mgr.34427) 10040 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:03:25.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:25 gibba013 bash[29418]: cephadm 2021-03-10T17:03:23.940384+0000 mgr.gibba020.yqfnwy (mgr.34427) 10041 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:03:25.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:25 gibba013 bash[29418]: cephadm 2021-03-10T17:03:23.941831+0000 mgr.gibba020.yqfnwy (mgr.34427) 10042 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:03:25.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:25 gibba013 bash[29418]: cephadm 2021-03-10T17:03:23.942289+0000 mgr.gibba020.yqfnwy (mgr.34427) 10043 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:03:25.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:25 gibba013 bash[29418]: cephadm 2021-03-10T17:03:23.943776+0000 mgr.gibba020.yqfnwy (mgr.34427) 10044 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:03:25.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:25 gibba013 bash[29418]: cephadm 2021-03-10T17:03:23.943822+0000 mgr.gibba020.yqfnwy (mgr.34427) 10045 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:03:25.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:25 gibba013 bash[29418]: cephadm 2021-03-10T17:03:23.943982+0000 mgr.gibba020.yqfnwy (mgr.34427) 10046 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:03:25.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:25 gibba013 bash[30381]: cephadm 2021-03-10T17:03:23.699483+0000 mgr.gibba020.yqfnwy (mgr.34427) 10031 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:03:25.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:25 gibba013 bash[30381]: cephadm 2021-03-10T17:03:23.701304+0000 mgr.gibba020.yqfnwy (mgr.34427) 10032 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:03:25.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:25 gibba013 bash[30381]: cephadm 2021-03-10T17:03:23.931039+0000 mgr.gibba020.yqfnwy (mgr.34427) 10033 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:03:25.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:25 gibba013 bash[30381]: cephadm 2021-03-10T17:03:23.933754+0000 mgr.gibba020.yqfnwy (mgr.34427) 10034 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:03:25.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:25 gibba013 bash[30381]: cephadm 2021-03-10T17:03:23.935617+0000 mgr.gibba020.yqfnwy (mgr.34427) 10035 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:03:25.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:25 gibba013 bash[30381]: cephadm 2021-03-10T17:03:23.935655+0000 mgr.gibba020.yqfnwy (mgr.34427) 10036 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:03:25.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:25 gibba013 bash[30381]: cephadm 2021-03-10T17:03:23.937426+0000 mgr.gibba020.yqfnwy (mgr.34427) 10037 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:03:25.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:25 gibba013 bash[30381]: cephadm 2021-03-10T17:03:23.937466+0000 mgr.gibba020.yqfnwy (mgr.34427) 10038 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:03:25.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:25 gibba013 bash[30381]: cephadm 2021-03-10T17:03:23.938837+0000 mgr.gibba020.yqfnwy (mgr.34427) 10039 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:03:25.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:25 gibba013 bash[30381]: cephadm 2021-03-10T17:03:23.940343+0000 mgr.gibba020.yqfnwy (mgr.34427) 10040 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:03:25.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:25 gibba013 bash[30381]: cephadm 2021-03-10T17:03:23.940384+0000 mgr.gibba020.yqfnwy (mgr.34427) 10041 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:03:25.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:25 gibba013 bash[30381]: cephadm 2021-03-10T17:03:23.941831+0000 mgr.gibba020.yqfnwy (mgr.34427) 10042 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:03:25.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:25 gibba013 bash[30381]: cephadm 2021-03-10T17:03:23.942289+0000 mgr.gibba020.yqfnwy (mgr.34427) 10043 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:03:25.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:25 gibba013 bash[30381]: cephadm 2021-03-10T17:03:23.943776+0000 mgr.gibba020.yqfnwy (mgr.34427) 10044 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:03:25.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:25 gibba013 bash[30381]: cephadm 2021-03-10T17:03:23.943822+0000 mgr.gibba020.yqfnwy (mgr.34427) 10045 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:03:25.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:25 gibba013 bash[30381]: cephadm 2021-03-10T17:03:23.943982+0000 mgr.gibba020.yqfnwy (mgr.34427) 10046 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:03:25.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:25 gibba020 bash[25448]: cephadm 2021-03-10T17:03:23.699483+0000 mgr.gibba020.yqfnwy (mgr.34427) 10031 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:03:25.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:25 gibba020 bash[25448]: cephadm 2021-03-10T17:03:23.701304+0000 mgr.gibba020.yqfnwy (mgr.34427) 10032 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:03:25.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:25 gibba020 bash[25448]: cephadm 2021-03-10T17:03:23.931039+0000 mgr.gibba020.yqfnwy (mgr.34427) 10033 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:03:25.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:25 gibba020 bash[25448]: cephadm 2021-03-10T17:03:23.933754+0000 mgr.gibba020.yqfnwy (mgr.34427) 10034 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:03:25.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:25 gibba020 bash[25448]: cephadm 2021-03-10T17:03:23.935617+0000 mgr.gibba020.yqfnwy (mgr.34427) 10035 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:03:25.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:25 gibba020 bash[25448]: cephadm 2021-03-10T17:03:23.935655+0000 mgr.gibba020.yqfnwy (mgr.34427) 10036 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:03:25.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:25 gibba020 bash[25448]: cephadm 2021-03-10T17:03:23.937426+0000 mgr.gibba020.yqfnwy (mgr.34427) 10037 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:03:25.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:25 gibba020 bash[25448]: cephadm 2021-03-10T17:03:23.937466+0000 mgr.gibba020.yqfnwy (mgr.34427) 10038 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:03:25.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:25 gibba020 bash[25448]: cephadm 2021-03-10T17:03:23.938837+0000 mgr.gibba020.yqfnwy (mgr.34427) 10039 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:03:25.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:25 gibba020 bash[25448]: cephadm 2021-03-10T17:03:23.940343+0000 mgr.gibba020.yqfnwy (mgr.34427) 10040 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:03:25.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:25 gibba020 bash[25448]: cephadm 2021-03-10T17:03:23.940384+0000 mgr.gibba020.yqfnwy (mgr.34427) 10041 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:03:25.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:25 gibba020 bash[25448]: cephadm 2021-03-10T17:03:23.941831+0000 mgr.gibba020.yqfnwy (mgr.34427) 10042 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:03:25.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:25 gibba020 bash[25448]: cephadm 2021-03-10T17:03:23.942289+0000 mgr.gibba020.yqfnwy (mgr.34427) 10043 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:03:25.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:25 gibba020 bash[25448]: cephadm 2021-03-10T17:03:23.943776+0000 mgr.gibba020.yqfnwy (mgr.34427) 10044 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:03:25.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:25 gibba020 bash[25448]: cephadm 2021-03-10T17:03:23.943822+0000 mgr.gibba020.yqfnwy (mgr.34427) 10045 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:03:25.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:25 gibba020 bash[25448]: cephadm 2021-03-10T17:03:23.943982+0000 mgr.gibba020.yqfnwy (mgr.34427) 10046 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:03:26.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:26 gibba013 bash[30381]: cluster 2021-03-10T17:03:24.771679+0000 mgr.gibba020.yqfnwy (mgr.34427) 10047 : cluster [DBG] pgmap v5720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:26.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:26 gibba013 bash[29418]: cluster 2021-03-10T17:03:24.771679+0000 mgr.gibba020.yqfnwy (mgr.34427) 10047 : cluster [DBG] pgmap v5720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:26.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:26 gibba020 bash[25448]: cluster 2021-03-10T17:03:24.771679+0000 mgr.gibba020.yqfnwy (mgr.34427) 10047 : cluster [DBG] pgmap v5720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:28.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:28 gibba013 bash[29418]: cluster 2021-03-10T17:03:26.773360+0000 mgr.gibba020.yqfnwy (mgr.34427) 10048 : cluster [DBG] pgmap v5721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:28.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:28 gibba013 bash[30381]: cluster 2021-03-10T17:03:26.773360+0000 mgr.gibba020.yqfnwy (mgr.34427) 10048 : cluster [DBG] pgmap v5721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:28.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:28 gibba020 bash[25448]: cluster 2021-03-10T17:03:26.773360+0000 mgr.gibba020.yqfnwy (mgr.34427) 10048 : cluster [DBG] pgmap v5721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:30.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:30 gibba013 bash[29418]: cluster 2021-03-10T17:03:28.774705+0000 mgr.gibba020.yqfnwy (mgr.34427) 10049 : cluster [DBG] pgmap v5722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:30.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:30 gibba013 bash[30381]: cluster 2021-03-10T17:03:28.774705+0000 mgr.gibba020.yqfnwy (mgr.34427) 10049 : cluster [DBG] pgmap v5722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:30.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:30 gibba020 bash[25448]: cluster 2021-03-10T17:03:28.774705+0000 mgr.gibba020.yqfnwy (mgr.34427) 10049 : cluster [DBG] pgmap v5722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:32.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:32 gibba013 bash[29418]: cluster 2021-03-10T17:03:30.776443+0000 mgr.gibba020.yqfnwy (mgr.34427) 10050 : cluster [DBG] pgmap v5723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:32.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:32 gibba013 bash[30381]: cluster 2021-03-10T17:03:30.776443+0000 mgr.gibba020.yqfnwy (mgr.34427) 10050 : cluster [DBG] pgmap v5723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:32.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:32 gibba020 bash[25448]: cluster 2021-03-10T17:03:30.776443+0000 mgr.gibba020.yqfnwy (mgr.34427) 10050 : cluster [DBG] pgmap v5723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:34.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:34 gibba020 bash[25448]: cluster 2021-03-10T17:03:32.777837+0000 mgr.gibba020.yqfnwy (mgr.34427) 10051 : cluster [DBG] pgmap v5724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:34.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:34 gibba013 bash[29418]: cluster 2021-03-10T17:03:32.777837+0000 mgr.gibba020.yqfnwy (mgr.34427) 10051 : cluster [DBG] pgmap v5724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:34.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:34 gibba013 bash[30381]: cluster 2021-03-10T17:03:32.777837+0000 mgr.gibba020.yqfnwy (mgr.34427) 10051 : cluster [DBG] pgmap v5724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:36.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:36 gibba020 bash[25448]: cluster 2021-03-10T17:03:34.779500+0000 mgr.gibba020.yqfnwy (mgr.34427) 10052 : cluster [DBG] pgmap v5725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:36.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:36 gibba013 bash[29418]: cluster 2021-03-10T17:03:34.779500+0000 mgr.gibba020.yqfnwy (mgr.34427) 10052 : cluster [DBG] pgmap v5725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:36.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:36 gibba013 bash[30381]: cluster 2021-03-10T17:03:34.779500+0000 mgr.gibba020.yqfnwy (mgr.34427) 10052 : cluster [DBG] pgmap v5725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:38.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:38 gibba020 bash[25448]: cluster 2021-03-10T17:03:36.781037+0000 mgr.gibba020.yqfnwy (mgr.34427) 10053 : cluster [DBG] pgmap v5726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:38.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:38 gibba013 bash[29418]: cluster 2021-03-10T17:03:36.781037+0000 mgr.gibba020.yqfnwy (mgr.34427) 10053 : cluster [DBG] pgmap v5726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:38.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:38 gibba013 bash[30381]: cluster 2021-03-10T17:03:36.781037+0000 mgr.gibba020.yqfnwy (mgr.34427) 10053 : cluster [DBG] pgmap v5726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:40.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:40 gibba020 bash[25448]: cluster 2021-03-10T17:03:38.782836+0000 mgr.gibba020.yqfnwy (mgr.34427) 10054 : cluster [DBG] pgmap v5727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:40.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:40 gibba020 bash[25448]: cephadm 2021-03-10T17:03:38.960008+0000 mgr.gibba020.yqfnwy (mgr.34427) 10055 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:03:40.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:40 gibba013 bash[29418]: cluster 2021-03-10T17:03:38.782836+0000 mgr.gibba020.yqfnwy (mgr.34427) 10054 : cluster [DBG] pgmap v5727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:40.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:40 gibba013 bash[29418]: cephadm 2021-03-10T17:03:38.960008+0000 mgr.gibba020.yqfnwy (mgr.34427) 10055 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:03:40.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:40 gibba013 bash[30381]: cluster 2021-03-10T17:03:38.782836+0000 mgr.gibba020.yqfnwy (mgr.34427) 10054 : cluster [DBG] pgmap v5727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:40.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:40 gibba013 bash[30381]: cephadm 2021-03-10T17:03:38.960008+0000 mgr.gibba020.yqfnwy (mgr.34427) 10055 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:03:42.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:42 gibba020 bash[25448]: cluster 2021-03-10T17:03:40.784712+0000 mgr.gibba020.yqfnwy (mgr.34427) 10056 : cluster [DBG] pgmap v5728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:42.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:42 gibba013 bash[29418]: cluster 2021-03-10T17:03:40.784712+0000 mgr.gibba020.yqfnwy (mgr.34427) 10056 : cluster [DBG] pgmap v5728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:42.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:42 gibba013 bash[30381]: cluster 2021-03-10T17:03:40.784712+0000 mgr.gibba020.yqfnwy (mgr.34427) 10056 : cluster [DBG] pgmap v5728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:44.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:44 gibba020 bash[25448]: cluster 2021-03-10T17:03:42.786196+0000 mgr.gibba020.yqfnwy (mgr.34427) 10057 : cluster [DBG] pgmap v5729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:44.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:44 gibba013 bash[29418]: cluster 2021-03-10T17:03:42.786196+0000 mgr.gibba020.yqfnwy (mgr.34427) 10057 : cluster [DBG] pgmap v5729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:44.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:44 gibba013 bash[30381]: cluster 2021-03-10T17:03:42.786196+0000 mgr.gibba020.yqfnwy (mgr.34427) 10057 : cluster [DBG] pgmap v5729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:46.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:46 gibba020 bash[25448]: cluster 2021-03-10T17:03:44.787868+0000 mgr.gibba020.yqfnwy (mgr.34427) 10058 : cluster [DBG] pgmap v5730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:46.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:46 gibba013 bash[29418]: cluster 2021-03-10T17:03:44.787868+0000 mgr.gibba020.yqfnwy (mgr.34427) 10058 : cluster [DBG] pgmap v5730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:46.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:46 gibba013 bash[30381]: cluster 2021-03-10T17:03:44.787868+0000 mgr.gibba020.yqfnwy (mgr.34427) 10058 : cluster [DBG] pgmap v5730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:48.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:48 gibba020 bash[25448]: cluster 2021-03-10T17:03:46.789803+0000 mgr.gibba020.yqfnwy (mgr.34427) 10059 : cluster [DBG] pgmap v5731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:48.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:48 gibba013 bash[29418]: cluster 2021-03-10T17:03:46.789803+0000 mgr.gibba020.yqfnwy (mgr.34427) 10059 : cluster [DBG] pgmap v5731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:48.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:48 gibba013 bash[30381]: cluster 2021-03-10T17:03:46.789803+0000 mgr.gibba020.yqfnwy (mgr.34427) 10059 : cluster [DBG] pgmap v5731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:50.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:50 gibba013 bash[29418]: cluster 2021-03-10T17:03:48.791689+0000 mgr.gibba020.yqfnwy (mgr.34427) 10060 : cluster [DBG] pgmap v5732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:50.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:50 gibba013 bash[30381]: cluster 2021-03-10T17:03:48.791689+0000 mgr.gibba020.yqfnwy (mgr.34427) 10060 : cluster [DBG] pgmap v5732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:50.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:50 gibba020 bash[25448]: cluster 2021-03-10T17:03:48.791689+0000 mgr.gibba020.yqfnwy (mgr.34427) 10060 : cluster [DBG] pgmap v5732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:52.103 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:03:52.330 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:03:52.331 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 2m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:03:52.331 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 88s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:03:52.331 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 88s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:03:52.332 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 88s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:03:52.332 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:03:52.332 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:03:52.332 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 88s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:03:52.332 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:03:52.333 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:03:52.333 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 88s ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:03:52.333 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:03:52.333 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:03:52.333 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:03:52.334 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:03:52.334 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 88s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:03:52.334 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 88s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:03:52.334 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 88s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:03:52.335 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 88s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:03:52.335 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 88s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:03:52.335 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 88s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:03:52.578 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:03:52.578 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:03:52.578 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:03:52.578 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:03:52.579 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:03:52.579 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:03:52.579 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:03:52.579 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:03:52.580 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:03:52.580 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:03:52.580 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:03:52.580 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:03:52.580 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:03:52.581 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:03:52.581 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:03:52.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:52 gibba013 bash[29418]: cluster 2021-03-10T17:03:50.793496+0000 mgr.gibba020.yqfnwy (mgr.34427) 10061 : cluster [DBG] pgmap v5733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:52.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:52 gibba013 bash[30381]: cluster 2021-03-10T17:03:50.793496+0000 mgr.gibba020.yqfnwy (mgr.34427) 10061 : cluster [DBG] pgmap v5733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:52.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:52 gibba020 bash[25448]: cluster 2021-03-10T17:03:50.793496+0000 mgr.gibba020.yqfnwy (mgr.34427) 10061 : cluster [DBG] pgmap v5733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:53.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:53 gibba013 bash[29418]: audit 2021-03-10T17:03:52.092624+0000 mgr.gibba020.yqfnwy (mgr.34427) 10062 : audit [DBG] from='client.50802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:03:53.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:53 gibba013 bash[29418]: audit 2021-03-10T17:03:52.317616+0000 mgr.gibba020.yqfnwy (mgr.34427) 10063 : audit [DBG] from='client.50808 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:03:53.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:53 gibba013 bash[29418]: audit 2021-03-10T17:03:52.577614+0000 mon.a (mon.0) 3602 : audit [DBG] from='client.? 172.21.2.113:0/4194287480' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:53.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:53 gibba013 bash[30381]: audit 2021-03-10T17:03:52.092624+0000 mgr.gibba020.yqfnwy (mgr.34427) 10062 : audit [DBG] from='client.50802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:03:53.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:53 gibba013 bash[30381]: audit 2021-03-10T17:03:52.317616+0000 mgr.gibba020.yqfnwy (mgr.34427) 10063 : audit [DBG] from='client.50808 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:03:53.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:53 gibba013 bash[30381]: audit 2021-03-10T17:03:52.577614+0000 mon.a (mon.0) 3602 : audit [DBG] from='client.? 172.21.2.113:0/4194287480' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:53.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:53 gibba020 bash[25448]: audit 2021-03-10T17:03:52.092624+0000 mgr.gibba020.yqfnwy (mgr.34427) 10062 : audit [DBG] from='client.50802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:03:53.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:53 gibba020 bash[25448]: audit 2021-03-10T17:03:52.317616+0000 mgr.gibba020.yqfnwy (mgr.34427) 10063 : audit [DBG] from='client.50808 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:03:53.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:53 gibba020 bash[25448]: audit 2021-03-10T17:03:52.577614+0000 mon.a (mon.0) 3602 : audit [DBG] from='client.? 172.21.2.113:0/4194287480' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:03:54.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:54 gibba013 bash[29418]: cluster 2021-03-10T17:03:52.794931+0000 mgr.gibba020.yqfnwy (mgr.34427) 10064 : cluster [DBG] pgmap v5734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:54.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:54 gibba013 bash[30381]: cluster 2021-03-10T17:03:52.794931+0000 mgr.gibba020.yqfnwy (mgr.34427) 10064 : cluster [DBG] pgmap v5734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:54.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:54 gibba020 bash[25448]: cluster 2021-03-10T17:03:52.794931+0000 mgr.gibba020.yqfnwy (mgr.34427) 10064 : cluster [DBG] pgmap v5734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:55.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:55 gibba013 bash[29418]: cephadm 2021-03-10T17:03:53.972743+0000 mgr.gibba020.yqfnwy (mgr.34427) 10065 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:03:55.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:55 gibba013 bash[30381]: cephadm 2021-03-10T17:03:53.972743+0000 mgr.gibba020.yqfnwy (mgr.34427) 10065 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:03:55.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:55 gibba020 bash[25448]: cephadm 2021-03-10T17:03:53.972743+0000 mgr.gibba020.yqfnwy (mgr.34427) 10065 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:03:56.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:56 gibba013 bash[29418]: cluster 2021-03-10T17:03:54.796659+0000 mgr.gibba020.yqfnwy (mgr.34427) 10066 : cluster [DBG] pgmap v5735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:56.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:56 gibba013 bash[30381]: cluster 2021-03-10T17:03:54.796659+0000 mgr.gibba020.yqfnwy (mgr.34427) 10066 : cluster [DBG] pgmap v5735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:56.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:56 gibba020 bash[25448]: cluster 2021-03-10T17:03:54.796659+0000 mgr.gibba020.yqfnwy (mgr.34427) 10066 : cluster [DBG] pgmap v5735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:57.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:57 gibba013 bash[29418]: cluster 2021-03-10T17:03:56.798205+0000 mgr.gibba020.yqfnwy (mgr.34427) 10067 : cluster [DBG] pgmap v5736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:57.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:57 gibba013 bash[30381]: cluster 2021-03-10T17:03:56.798205+0000 mgr.gibba020.yqfnwy (mgr.34427) 10067 : cluster [DBG] pgmap v5736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:03:57.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:57 gibba020 bash[25448]: cluster 2021-03-10T17:03:56.798205+0000 mgr.gibba020.yqfnwy (mgr.34427) 10067 : cluster [DBG] pgmap v5736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:00.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:03:59 gibba013 bash[29418]: cluster 2021-03-10T17:03:58.799578+0000 mgr.gibba020.yqfnwy (mgr.34427) 10068 : cluster [DBG] pgmap v5737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:00.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:03:59 gibba013 bash[30381]: cluster 2021-03-10T17:03:58.799578+0000 mgr.gibba020.yqfnwy (mgr.34427) 10068 : cluster [DBG] pgmap v5737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:00.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:03:59 gibba020 bash[25448]: cluster 2021-03-10T17:03:58.799578+0000 mgr.gibba020.yqfnwy (mgr.34427) 10068 : cluster [DBG] pgmap v5737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:02.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:02 gibba013 bash[29418]: cluster 2021-03-10T17:04:00.801315+0000 mgr.gibba020.yqfnwy (mgr.34427) 10069 : cluster [DBG] pgmap v5738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:02.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:02 gibba013 bash[30381]: cluster 2021-03-10T17:04:00.801315+0000 mgr.gibba020.yqfnwy (mgr.34427) 10069 : cluster [DBG] pgmap v5738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:02.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:02 gibba020 bash[25448]: cluster 2021-03-10T17:04:00.801315+0000 mgr.gibba020.yqfnwy (mgr.34427) 10069 : cluster [DBG] pgmap v5738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:04.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:04 gibba013 bash[29418]: cluster 2021-03-10T17:04:02.802921+0000 mgr.gibba020.yqfnwy (mgr.34427) 10070 : cluster [DBG] pgmap v5739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:04.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:04 gibba013 bash[30381]: cluster 2021-03-10T17:04:02.802921+0000 mgr.gibba020.yqfnwy (mgr.34427) 10070 : cluster [DBG] pgmap v5739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:04.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:04 gibba020 bash[25448]: cluster 2021-03-10T17:04:02.802921+0000 mgr.gibba020.yqfnwy (mgr.34427) 10070 : cluster [DBG] pgmap v5739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:06.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:06 gibba013 bash[29418]: cluster 2021-03-10T17:04:04.804577+0000 mgr.gibba020.yqfnwy (mgr.34427) 10071 : cluster [DBG] pgmap v5740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:06.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:06 gibba013 bash[30381]: cluster 2021-03-10T17:04:04.804577+0000 mgr.gibba020.yqfnwy (mgr.34427) 10071 : cluster [DBG] pgmap v5740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:06.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:06 gibba020 bash[25448]: cluster 2021-03-10T17:04:04.804577+0000 mgr.gibba020.yqfnwy (mgr.34427) 10071 : cluster [DBG] pgmap v5740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:07.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:07 gibba013 bash[29418]: audit 2021-03-10T17:04:06.880146+0000 mon.a (mon.0) 3603 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:04:07.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:07 gibba013 bash[29418]: audit 2021-03-10T17:04:07.080941+0000 mon.a (mon.0) 3604 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:04:07.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:07 gibba013 bash[30381]: audit 2021-03-10T17:04:06.880146+0000 mon.a (mon.0) 3603 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:04:07.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:07 gibba013 bash[30381]: audit 2021-03-10T17:04:07.080941+0000 mon.a (mon.0) 3604 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:04:07.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:07 gibba020 bash[25448]: audit 2021-03-10T17:04:06.880146+0000 mon.a (mon.0) 3603 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:04:07.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:07 gibba020 bash[25448]: audit 2021-03-10T17:04:07.080941+0000 mon.a (mon.0) 3604 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:04:08.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:08 gibba013 bash[29418]: cluster 2021-03-10T17:04:06.805961+0000 mgr.gibba020.yqfnwy (mgr.34427) 10072 : cluster [DBG] pgmap v5741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:08.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:08 gibba013 bash[29418]: audit 2021-03-10T17:04:07.490815+0000 mon.a (mon.0) 3605 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T17:04:08.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:08 gibba013 bash[29418]: audit 2021-03-10T17:04:07.491570+0000 mon.a (mon.0) 3606 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:04:08.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:08 gibba013 bash[29418]: audit 2021-03-10T17:04:07.492338+0000 mon.a (mon.0) 3607 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:04:08.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:08 gibba013 bash[29418]: audit 2021-03-10T17:04:07.493030+0000 mon.a (mon.0) 3608 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:04:08.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:08 gibba013 bash[30381]: cluster 2021-03-10T17:04:06.805961+0000 mgr.gibba020.yqfnwy (mgr.34427) 10072 : cluster [DBG] pgmap v5741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:08.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:08 gibba013 bash[30381]: audit 2021-03-10T17:04:07.490815+0000 mon.a (mon.0) 3605 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T17:04:08.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:08 gibba013 bash[30381]: audit 2021-03-10T17:04:07.491570+0000 mon.a (mon.0) 3606 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:04:08.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:08 gibba013 bash[30381]: audit 2021-03-10T17:04:07.492338+0000 mon.a (mon.0) 3607 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:04:08.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:08 gibba013 bash[30381]: audit 2021-03-10T17:04:07.493030+0000 mon.a (mon.0) 3608 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:04:08.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:08 gibba020 bash[25448]: cluster 2021-03-10T17:04:06.805961+0000 mgr.gibba020.yqfnwy (mgr.34427) 10072 : cluster [DBG] pgmap v5741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:08.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:08 gibba020 bash[25448]: audit 2021-03-10T17:04:07.490815+0000 mon.a (mon.0) 3605 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T17:04:08.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:08 gibba020 bash[25448]: audit 2021-03-10T17:04:07.491570+0000 mon.a (mon.0) 3606 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:04:08.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:08 gibba020 bash[25448]: audit 2021-03-10T17:04:07.492338+0000 mon.a (mon.0) 3607 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:04:08.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:08 gibba020 bash[25448]: audit 2021-03-10T17:04:07.493030+0000 mon.a (mon.0) 3608 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:04:10.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:10 gibba013 bash[29418]: cluster 2021-03-10T17:04:08.807323+0000 mgr.gibba020.yqfnwy (mgr.34427) 10073 : cluster [DBG] pgmap v5742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:10.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:10 gibba013 bash[29418]: cephadm 2021-03-10T17:04:08.976957+0000 mgr.gibba020.yqfnwy (mgr.34427) 10074 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:04:10.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:10 gibba013 bash[30381]: cluster 2021-03-10T17:04:08.807323+0000 mgr.gibba020.yqfnwy (mgr.34427) 10073 : cluster [DBG] pgmap v5742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:10.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:10 gibba013 bash[30381]: cephadm 2021-03-10T17:04:08.976957+0000 mgr.gibba020.yqfnwy (mgr.34427) 10074 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:04:10.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:10 gibba020 bash[25448]: cluster 2021-03-10T17:04:08.807323+0000 mgr.gibba020.yqfnwy (mgr.34427) 10073 : cluster [DBG] pgmap v5742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:10.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:10 gibba020 bash[25448]: cephadm 2021-03-10T17:04:08.976957+0000 mgr.gibba020.yqfnwy (mgr.34427) 10074 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:04:12.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:12 gibba020 bash[25448]: cluster 2021-03-10T17:04:10.809066+0000 mgr.gibba020.yqfnwy (mgr.34427) 10075 : cluster [DBG] pgmap v5743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:12.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:12 gibba013 bash[29418]: cluster 2021-03-10T17:04:10.809066+0000 mgr.gibba020.yqfnwy (mgr.34427) 10075 : cluster [DBG] pgmap v5743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:12.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:12 gibba013 bash[30381]: cluster 2021-03-10T17:04:10.809066+0000 mgr.gibba020.yqfnwy (mgr.34427) 10075 : cluster [DBG] pgmap v5743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:14.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:14 gibba020 bash[25448]: cluster 2021-03-10T17:04:12.810603+0000 mgr.gibba020.yqfnwy (mgr.34427) 10076 : cluster [DBG] pgmap v5744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:14.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:14 gibba013 bash[29418]: cluster 2021-03-10T17:04:12.810603+0000 mgr.gibba020.yqfnwy (mgr.34427) 10076 : cluster [DBG] pgmap v5744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:14.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:14 gibba013 bash[30381]: cluster 2021-03-10T17:04:12.810603+0000 mgr.gibba020.yqfnwy (mgr.34427) 10076 : cluster [DBG] pgmap v5744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:16.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:16 gibba020 bash[25448]: cluster 2021-03-10T17:04:14.812253+0000 mgr.gibba020.yqfnwy (mgr.34427) 10077 : cluster [DBG] pgmap v5745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:16.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:16 gibba013 bash[29418]: cluster 2021-03-10T17:04:14.812253+0000 mgr.gibba020.yqfnwy (mgr.34427) 10077 : cluster [DBG] pgmap v5745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:16.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:16 gibba013 bash[30381]: cluster 2021-03-10T17:04:14.812253+0000 mgr.gibba020.yqfnwy (mgr.34427) 10077 : cluster [DBG] pgmap v5745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:18.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:18 gibba020 bash[25448]: cluster 2021-03-10T17:04:16.813850+0000 mgr.gibba020.yqfnwy (mgr.34427) 10078 : cluster [DBG] pgmap v5746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:18.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:18 gibba013 bash[29418]: cluster 2021-03-10T17:04:16.813850+0000 mgr.gibba020.yqfnwy (mgr.34427) 10078 : cluster [DBG] pgmap v5746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:18.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:18 gibba013 bash[30381]: cluster 2021-03-10T17:04:16.813850+0000 mgr.gibba020.yqfnwy (mgr.34427) 10078 : cluster [DBG] pgmap v5746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:20.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:20 gibba020 bash[25448]: cluster 2021-03-10T17:04:18.815437+0000 mgr.gibba020.yqfnwy (mgr.34427) 10079 : cluster [DBG] pgmap v5747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:20.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:20 gibba013 bash[29418]: cluster 2021-03-10T17:04:18.815437+0000 mgr.gibba020.yqfnwy (mgr.34427) 10079 : cluster [DBG] pgmap v5747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:20.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:20 gibba013 bash[30381]: cluster 2021-03-10T17:04:18.815437+0000 mgr.gibba020.yqfnwy (mgr.34427) 10079 : cluster [DBG] pgmap v5747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:22.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:22 gibba020 bash[25448]: cluster 2021-03-10T17:04:20.817073+0000 mgr.gibba020.yqfnwy (mgr.34427) 10080 : cluster [DBG] pgmap v5748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:22.824 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:04:22.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:22 gibba013 bash[29418]: cluster 2021-03-10T17:04:20.817073+0000 mgr.gibba020.yqfnwy (mgr.34427) 10080 : cluster [DBG] pgmap v5748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:22.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:22 gibba013 bash[30381]: cluster 2021-03-10T17:04:20.817073+0000 mgr.gibba020.yqfnwy (mgr.34427) 10080 : cluster [DBG] pgmap v5748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:23.050 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:04:23.051 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 3m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:04:23.051 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 119s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:04:23.051 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 119s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:04:23.051 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 119s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:04:23.052 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:04:23.052 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:04:23.052 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 119s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:04:23.052 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:04:23.053 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:04:23.053 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 119s ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:04:23.053 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:04:23.053 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:04:23.053 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:04:23.054 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:04:23.054 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 119s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:04:23.054 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 119s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:04:23.054 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 119s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:04:23.055 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 119s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:04:23.055 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 119s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:04:23.055 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 119s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:04:23.300 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:04:23.300 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:04:23.301 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:04:23.301 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:04:23.301 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:04:23.301 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:04:23.302 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:04:23.302 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:04:23.302 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:04:23.302 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:04:23.303 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:04:23.303 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:04:23.303 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:04:23.304 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:04:23.304 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:04:23.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:23 gibba020 bash[25448]: audit 2021-03-10T17:04:23.299560+0000 mon.c (mon.1) 153 : audit [DBG] from='client.? 172.21.2.113:0/1111844036' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:23.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:23 gibba013 bash[29418]: audit 2021-03-10T17:04:23.299560+0000 mon.c (mon.1) 153 : audit [DBG] from='client.? 172.21.2.113:0/1111844036' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:23.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:23 gibba013 bash[30381]: audit 2021-03-10T17:04:23.299560+0000 mon.c (mon.1) 153 : audit [DBG] from='client.? 172.21.2.113:0/1111844036' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:24.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:24 gibba020 bash[25448]: audit 2021-03-10T17:04:22.813902+0000 mgr.gibba020.yqfnwy (mgr.34427) 10081 : audit [DBG] from='client.60799 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:04:24.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:24 gibba020 bash[25448]: cluster 2021-03-10T17:04:22.818321+0000 mgr.gibba020.yqfnwy (mgr.34427) 10082 : cluster [DBG] pgmap v5749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:24.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:24 gibba020 bash[25448]: audit 2021-03-10T17:04:23.038736+0000 mgr.gibba020.yqfnwy (mgr.34427) 10083 : audit [DBG] from='client.50826 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:04:24.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:24 gibba020 bash[25448]: audit 2021-03-10T17:04:23.994504+0000 mon.a (mon.0) 3609 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:04:24.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:24 gibba020 bash[25448]: audit 2021-03-10T17:04:24.224119+0000 mon.a (mon.0) 3610 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:04:24.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:24 gibba020 bash[25448]: audit 2021-03-10T17:04:24.227517+0000 mon.a (mon.0) 3611 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:04:24.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:24 gibba020 bash[25448]: audit 2021-03-10T17:04:24.229285+0000 mon.a (mon.0) 3612 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:24.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:24 gibba020 bash[25448]: audit 2021-03-10T17:04:24.230879+0000 mon.a (mon.0) 3613 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:24.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:24 gibba020 bash[25448]: audit 2021-03-10T17:04:24.232332+0000 mon.a (mon.0) 3614 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:24.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:24 gibba020 bash[25448]: audit 2021-03-10T17:04:24.235577+0000 mon.a (mon.0) 3615 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:24.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:24 gibba020 bash[25448]: audit 2021-03-10T17:04:24.237236+0000 mon.a (mon.0) 3616 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:24.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:24 gibba013 bash[29418]: audit 2021-03-10T17:04:22.813902+0000 mgr.gibba020.yqfnwy (mgr.34427) 10081 : audit [DBG] from='client.60799 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:04:24.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:24 gibba013 bash[29418]: cluster 2021-03-10T17:04:22.818321+0000 mgr.gibba020.yqfnwy (mgr.34427) 10082 : cluster [DBG] pgmap v5749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:24.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:24 gibba013 bash[29418]: audit 2021-03-10T17:04:23.038736+0000 mgr.gibba020.yqfnwy (mgr.34427) 10083 : audit [DBG] from='client.50826 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:04:24.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:24 gibba013 bash[29418]: audit 2021-03-10T17:04:23.994504+0000 mon.a (mon.0) 3609 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:04:24.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:24 gibba013 bash[29418]: audit 2021-03-10T17:04:24.224119+0000 mon.a (mon.0) 3610 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:04:24.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:24 gibba013 bash[29418]: audit 2021-03-10T17:04:24.227517+0000 mon.a (mon.0) 3611 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:04:24.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:24 gibba013 bash[29418]: audit 2021-03-10T17:04:24.229285+0000 mon.a (mon.0) 3612 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:24.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:24 gibba013 bash[29418]: audit 2021-03-10T17:04:24.230879+0000 mon.a (mon.0) 3613 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:24.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:24 gibba013 bash[29418]: audit 2021-03-10T17:04:24.232332+0000 mon.a (mon.0) 3614 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:24.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:24 gibba013 bash[29418]: audit 2021-03-10T17:04:24.235577+0000 mon.a (mon.0) 3615 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:24.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:24 gibba013 bash[29418]: audit 2021-03-10T17:04:24.237236+0000 mon.a (mon.0) 3616 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:24.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:24 gibba013 bash[30381]: audit 2021-03-10T17:04:22.813902+0000 mgr.gibba020.yqfnwy (mgr.34427) 10081 : audit [DBG] from='client.60799 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:04:24.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:24 gibba013 bash[30381]: cluster 2021-03-10T17:04:22.818321+0000 mgr.gibba020.yqfnwy (mgr.34427) 10082 : cluster [DBG] pgmap v5749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:24.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:24 gibba013 bash[30381]: audit 2021-03-10T17:04:23.038736+0000 mgr.gibba020.yqfnwy (mgr.34427) 10083 : audit [DBG] from='client.50826 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:04:24.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:24 gibba013 bash[30381]: audit 2021-03-10T17:04:23.994504+0000 mon.a (mon.0) 3609 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:04:24.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:24 gibba013 bash[30381]: audit 2021-03-10T17:04:24.224119+0000 mon.a (mon.0) 3610 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:04:24.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:24 gibba013 bash[30381]: audit 2021-03-10T17:04:24.227517+0000 mon.a (mon.0) 3611 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:04:24.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:24 gibba013 bash[30381]: audit 2021-03-10T17:04:24.229285+0000 mon.a (mon.0) 3612 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:24.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:24 gibba013 bash[30381]: audit 2021-03-10T17:04:24.230879+0000 mon.a (mon.0) 3613 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:24.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:24 gibba013 bash[30381]: audit 2021-03-10T17:04:24.232332+0000 mon.a (mon.0) 3614 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:24.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:24 gibba013 bash[30381]: audit 2021-03-10T17:04:24.235577+0000 mon.a (mon.0) 3615 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:24.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:24 gibba013 bash[30381]: audit 2021-03-10T17:04:24.237236+0000 mon.a (mon.0) 3616 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:25.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:25 gibba013 bash[29418]: cephadm 2021-03-10T17:04:24.000265+0000 mgr.gibba020.yqfnwy (mgr.34427) 10084 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:04:25.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:25 gibba013 bash[29418]: cephadm 2021-03-10T17:04:24.001561+0000 mgr.gibba020.yqfnwy (mgr.34427) 10085 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:04:25.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:25 gibba013 bash[29418]: cephadm 2021-03-10T17:04:24.226138+0000 mgr.gibba020.yqfnwy (mgr.34427) 10086 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:04:25.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:25 gibba013 bash[29418]: cephadm 2021-03-10T17:04:24.228289+0000 mgr.gibba020.yqfnwy (mgr.34427) 10087 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:04:25.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:25 gibba013 bash[29418]: cephadm 2021-03-10T17:04:24.229813+0000 mgr.gibba020.yqfnwy (mgr.34427) 10088 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:04:25.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:25 gibba013 bash[29418]: cephadm 2021-03-10T17:04:24.229851+0000 mgr.gibba020.yqfnwy (mgr.34427) 10089 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:04:25.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:25 gibba013 bash[29418]: cephadm 2021-03-10T17:04:24.231337+0000 mgr.gibba020.yqfnwy (mgr.34427) 10090 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:04:25.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:25 gibba013 bash[29418]: cephadm 2021-03-10T17:04:24.231375+0000 mgr.gibba020.yqfnwy (mgr.34427) 10091 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:04:25.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:25 gibba013 bash[29418]: cephadm 2021-03-10T17:04:24.232700+0000 mgr.gibba020.yqfnwy (mgr.34427) 10092 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:04:25.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:25 gibba013 bash[29418]: cephadm 2021-03-10T17:04:24.234430+0000 mgr.gibba020.yqfnwy (mgr.34427) 10093 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:04:25.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:25 gibba013 bash[29418]: cephadm 2021-03-10T17:04:24.234464+0000 mgr.gibba020.yqfnwy (mgr.34427) 10094 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:04:25.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:25 gibba013 bash[29418]: cephadm 2021-03-10T17:04:24.235995+0000 mgr.gibba020.yqfnwy (mgr.34427) 10095 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:04:25.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:25 gibba013 bash[29418]: cephadm 2021-03-10T17:04:24.236324+0000 mgr.gibba020.yqfnwy (mgr.34427) 10096 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:04:25.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:25 gibba013 bash[29418]: cephadm 2021-03-10T17:04:24.237698+0000 mgr.gibba020.yqfnwy (mgr.34427) 10097 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:04:25.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:25 gibba013 bash[29418]: cephadm 2021-03-10T17:04:24.237736+0000 mgr.gibba020.yqfnwy (mgr.34427) 10098 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:04:25.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:25 gibba013 bash[29418]: cephadm 2021-03-10T17:04:24.237839+0000 mgr.gibba020.yqfnwy (mgr.34427) 10099 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:04:25.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:25 gibba013 bash[30381]: cephadm 2021-03-10T17:04:24.000265+0000 mgr.gibba020.yqfnwy (mgr.34427) 10084 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:04:25.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:25 gibba013 bash[30381]: cephadm 2021-03-10T17:04:24.001561+0000 mgr.gibba020.yqfnwy (mgr.34427) 10085 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:04:25.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:25 gibba013 bash[30381]: cephadm 2021-03-10T17:04:24.226138+0000 mgr.gibba020.yqfnwy (mgr.34427) 10086 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:04:25.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:25 gibba013 bash[30381]: cephadm 2021-03-10T17:04:24.228289+0000 mgr.gibba020.yqfnwy (mgr.34427) 10087 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:04:25.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:25 gibba013 bash[30381]: cephadm 2021-03-10T17:04:24.229813+0000 mgr.gibba020.yqfnwy (mgr.34427) 10088 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:04:25.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:25 gibba013 bash[30381]: cephadm 2021-03-10T17:04:24.229851+0000 mgr.gibba020.yqfnwy (mgr.34427) 10089 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:04:25.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:25 gibba013 bash[30381]: cephadm 2021-03-10T17:04:24.231337+0000 mgr.gibba020.yqfnwy (mgr.34427) 10090 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:04:25.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:25 gibba013 bash[30381]: cephadm 2021-03-10T17:04:24.231375+0000 mgr.gibba020.yqfnwy (mgr.34427) 10091 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:04:25.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:25 gibba013 bash[30381]: cephadm 2021-03-10T17:04:24.232700+0000 mgr.gibba020.yqfnwy (mgr.34427) 10092 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:04:25.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:25 gibba013 bash[30381]: cephadm 2021-03-10T17:04:24.234430+0000 mgr.gibba020.yqfnwy (mgr.34427) 10093 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:04:25.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:25 gibba013 bash[30381]: cephadm 2021-03-10T17:04:24.234464+0000 mgr.gibba020.yqfnwy (mgr.34427) 10094 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:04:25.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:25 gibba013 bash[30381]: cephadm 2021-03-10T17:04:24.235995+0000 mgr.gibba020.yqfnwy (mgr.34427) 10095 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:04:25.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:25 gibba013 bash[30381]: cephadm 2021-03-10T17:04:24.236324+0000 mgr.gibba020.yqfnwy (mgr.34427) 10096 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:04:25.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:25 gibba013 bash[30381]: cephadm 2021-03-10T17:04:24.237698+0000 mgr.gibba020.yqfnwy (mgr.34427) 10097 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:04:25.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:25 gibba013 bash[30381]: cephadm 2021-03-10T17:04:24.237736+0000 mgr.gibba020.yqfnwy (mgr.34427) 10098 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:04:25.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:25 gibba013 bash[30381]: cephadm 2021-03-10T17:04:24.237839+0000 mgr.gibba020.yqfnwy (mgr.34427) 10099 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:04:25.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:25 gibba020 bash[25448]: cephadm 2021-03-10T17:04:24.000265+0000 mgr.gibba020.yqfnwy (mgr.34427) 10084 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:04:25.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:25 gibba020 bash[25448]: cephadm 2021-03-10T17:04:24.001561+0000 mgr.gibba020.yqfnwy (mgr.34427) 10085 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:04:25.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:25 gibba020 bash[25448]: cephadm 2021-03-10T17:04:24.226138+0000 mgr.gibba020.yqfnwy (mgr.34427) 10086 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:04:25.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:25 gibba020 bash[25448]: cephadm 2021-03-10T17:04:24.228289+0000 mgr.gibba020.yqfnwy (mgr.34427) 10087 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:04:25.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:25 gibba020 bash[25448]: cephadm 2021-03-10T17:04:24.229813+0000 mgr.gibba020.yqfnwy (mgr.34427) 10088 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:04:25.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:25 gibba020 bash[25448]: cephadm 2021-03-10T17:04:24.229851+0000 mgr.gibba020.yqfnwy (mgr.34427) 10089 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:04:25.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:25 gibba020 bash[25448]: cephadm 2021-03-10T17:04:24.231337+0000 mgr.gibba020.yqfnwy (mgr.34427) 10090 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:04:25.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:25 gibba020 bash[25448]: cephadm 2021-03-10T17:04:24.231375+0000 mgr.gibba020.yqfnwy (mgr.34427) 10091 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:04:25.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:25 gibba020 bash[25448]: cephadm 2021-03-10T17:04:24.232700+0000 mgr.gibba020.yqfnwy (mgr.34427) 10092 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:04:25.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:25 gibba020 bash[25448]: cephadm 2021-03-10T17:04:24.234430+0000 mgr.gibba020.yqfnwy (mgr.34427) 10093 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:04:25.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:25 gibba020 bash[25448]: cephadm 2021-03-10T17:04:24.234464+0000 mgr.gibba020.yqfnwy (mgr.34427) 10094 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:04:25.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:25 gibba020 bash[25448]: cephadm 2021-03-10T17:04:24.235995+0000 mgr.gibba020.yqfnwy (mgr.34427) 10095 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:04:25.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:25 gibba020 bash[25448]: cephadm 2021-03-10T17:04:24.236324+0000 mgr.gibba020.yqfnwy (mgr.34427) 10096 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:04:25.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:25 gibba020 bash[25448]: cephadm 2021-03-10T17:04:24.237698+0000 mgr.gibba020.yqfnwy (mgr.34427) 10097 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:04:25.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:25 gibba020 bash[25448]: cephadm 2021-03-10T17:04:24.237736+0000 mgr.gibba020.yqfnwy (mgr.34427) 10098 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:04:25.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:25 gibba020 bash[25448]: cephadm 2021-03-10T17:04:24.237839+0000 mgr.gibba020.yqfnwy (mgr.34427) 10099 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:04:26.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:26 gibba013 bash[29418]: cluster 2021-03-10T17:04:24.820162+0000 mgr.gibba020.yqfnwy (mgr.34427) 10100 : cluster [DBG] pgmap v5750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:26.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:26 gibba013 bash[30381]: cluster 2021-03-10T17:04:24.820162+0000 mgr.gibba020.yqfnwy (mgr.34427) 10100 : cluster [DBG] pgmap v5750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:26.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:26 gibba020 bash[25448]: cluster 2021-03-10T17:04:24.820162+0000 mgr.gibba020.yqfnwy (mgr.34427) 10100 : cluster [DBG] pgmap v5750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:28.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:28 gibba013 bash[29418]: cluster 2021-03-10T17:04:26.821536+0000 mgr.gibba020.yqfnwy (mgr.34427) 10101 : cluster [DBG] pgmap v5751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:28.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:28 gibba013 bash[30381]: cluster 2021-03-10T17:04:26.821536+0000 mgr.gibba020.yqfnwy (mgr.34427) 10101 : cluster [DBG] pgmap v5751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:28.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:28 gibba020 bash[25448]: cluster 2021-03-10T17:04:26.821536+0000 mgr.gibba020.yqfnwy (mgr.34427) 10101 : cluster [DBG] pgmap v5751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:30.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:30 gibba013 bash[29418]: cluster 2021-03-10T17:04:28.823262+0000 mgr.gibba020.yqfnwy (mgr.34427) 10102 : cluster [DBG] pgmap v5752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:30.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:30 gibba013 bash[30381]: cluster 2021-03-10T17:04:28.823262+0000 mgr.gibba020.yqfnwy (mgr.34427) 10102 : cluster [DBG] pgmap v5752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:30.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:30 gibba020 bash[25448]: cluster 2021-03-10T17:04:28.823262+0000 mgr.gibba020.yqfnwy (mgr.34427) 10102 : cluster [DBG] pgmap v5752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:32.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:32 gibba013 bash[29418]: cluster 2021-03-10T17:04:30.824885+0000 mgr.gibba020.yqfnwy (mgr.34427) 10103 : cluster [DBG] pgmap v5753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:32.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:32 gibba013 bash[30381]: cluster 2021-03-10T17:04:30.824885+0000 mgr.gibba020.yqfnwy (mgr.34427) 10103 : cluster [DBG] pgmap v5753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:32.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:32 gibba020 bash[25448]: cluster 2021-03-10T17:04:30.824885+0000 mgr.gibba020.yqfnwy (mgr.34427) 10103 : cluster [DBG] pgmap v5753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:34.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:34 gibba013 bash[29418]: cluster 2021-03-10T17:04:32.826484+0000 mgr.gibba020.yqfnwy (mgr.34427) 10104 : cluster [DBG] pgmap v5754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:34.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:34 gibba013 bash[30381]: cluster 2021-03-10T17:04:32.826484+0000 mgr.gibba020.yqfnwy (mgr.34427) 10104 : cluster [DBG] pgmap v5754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:34.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:34 gibba020 bash[25448]: cluster 2021-03-10T17:04:32.826484+0000 mgr.gibba020.yqfnwy (mgr.34427) 10104 : cluster [DBG] pgmap v5754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:36.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:36 gibba013 bash[29418]: cluster 2021-03-10T17:04:34.828130+0000 mgr.gibba020.yqfnwy (mgr.34427) 10105 : cluster [DBG] pgmap v5755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:36.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:36 gibba013 bash[30381]: cluster 2021-03-10T17:04:34.828130+0000 mgr.gibba020.yqfnwy (mgr.34427) 10105 : cluster [DBG] pgmap v5755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:36.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:36 gibba020 bash[25448]: cluster 2021-03-10T17:04:34.828130+0000 mgr.gibba020.yqfnwy (mgr.34427) 10105 : cluster [DBG] pgmap v5755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:38.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:38 gibba013 bash[29418]: cluster 2021-03-10T17:04:36.829577+0000 mgr.gibba020.yqfnwy (mgr.34427) 10106 : cluster [DBG] pgmap v5756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:38.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:38 gibba013 bash[30381]: cluster 2021-03-10T17:04:36.829577+0000 mgr.gibba020.yqfnwy (mgr.34427) 10106 : cluster [DBG] pgmap v5756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:38.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:38 gibba020 bash[25448]: cluster 2021-03-10T17:04:36.829577+0000 mgr.gibba020.yqfnwy (mgr.34427) 10106 : cluster [DBG] pgmap v5756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:40.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:40 gibba013 bash[29418]: cluster 2021-03-10T17:04:38.831086+0000 mgr.gibba020.yqfnwy (mgr.34427) 10107 : cluster [DBG] pgmap v5757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:40.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:40 gibba013 bash[29418]: cephadm 2021-03-10T17:04:39.241859+0000 mgr.gibba020.yqfnwy (mgr.34427) 10108 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:04:40.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:40 gibba013 bash[30381]: cluster 2021-03-10T17:04:38.831086+0000 mgr.gibba020.yqfnwy (mgr.34427) 10107 : cluster [DBG] pgmap v5757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:40.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:40 gibba013 bash[30381]: cephadm 2021-03-10T17:04:39.241859+0000 mgr.gibba020.yqfnwy (mgr.34427) 10108 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:04:40.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:40 gibba020 bash[25448]: cluster 2021-03-10T17:04:38.831086+0000 mgr.gibba020.yqfnwy (mgr.34427) 10107 : cluster [DBG] pgmap v5757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:40.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:40 gibba020 bash[25448]: cephadm 2021-03-10T17:04:39.241859+0000 mgr.gibba020.yqfnwy (mgr.34427) 10108 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:04:42.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:42 gibba013 bash[29418]: cluster 2021-03-10T17:04:40.832561+0000 mgr.gibba020.yqfnwy (mgr.34427) 10109 : cluster [DBG] pgmap v5758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:42.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:42 gibba013 bash[30381]: cluster 2021-03-10T17:04:40.832561+0000 mgr.gibba020.yqfnwy (mgr.34427) 10109 : cluster [DBG] pgmap v5758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:42.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:42 gibba020 bash[25448]: cluster 2021-03-10T17:04:40.832561+0000 mgr.gibba020.yqfnwy (mgr.34427) 10109 : cluster [DBG] pgmap v5758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:44.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:44 gibba013 bash[29418]: cluster 2021-03-10T17:04:42.833954+0000 mgr.gibba020.yqfnwy (mgr.34427) 10110 : cluster [DBG] pgmap v5759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:44.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:44 gibba013 bash[30381]: cluster 2021-03-10T17:04:42.833954+0000 mgr.gibba020.yqfnwy (mgr.34427) 10110 : cluster [DBG] pgmap v5759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:44.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:44 gibba020 bash[25448]: cluster 2021-03-10T17:04:42.833954+0000 mgr.gibba020.yqfnwy (mgr.34427) 10110 : cluster [DBG] pgmap v5759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:46.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:46 gibba020 bash[25448]: cluster 2021-03-10T17:04:44.835675+0000 mgr.gibba020.yqfnwy (mgr.34427) 10111 : cluster [DBG] pgmap v5760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:46.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:46 gibba013 bash[29418]: cluster 2021-03-10T17:04:44.835675+0000 mgr.gibba020.yqfnwy (mgr.34427) 10111 : cluster [DBG] pgmap v5760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:46.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:46 gibba013 bash[30381]: cluster 2021-03-10T17:04:44.835675+0000 mgr.gibba020.yqfnwy (mgr.34427) 10111 : cluster [DBG] pgmap v5760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:48.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:48 gibba020 bash[25448]: cluster 2021-03-10T17:04:46.837182+0000 mgr.gibba020.yqfnwy (mgr.34427) 10112 : cluster [DBG] pgmap v5761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:48.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:48 gibba013 bash[29418]: cluster 2021-03-10T17:04:46.837182+0000 mgr.gibba020.yqfnwy (mgr.34427) 10112 : cluster [DBG] pgmap v5761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:48.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:48 gibba013 bash[30381]: cluster 2021-03-10T17:04:46.837182+0000 mgr.gibba020.yqfnwy (mgr.34427) 10112 : cluster [DBG] pgmap v5761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:50.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:50 gibba020 bash[25448]: cluster 2021-03-10T17:04:48.838809+0000 mgr.gibba020.yqfnwy (mgr.34427) 10113 : cluster [DBG] pgmap v5762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:50.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:50 gibba013 bash[29418]: cluster 2021-03-10T17:04:48.838809+0000 mgr.gibba020.yqfnwy (mgr.34427) 10113 : cluster [DBG] pgmap v5762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:50.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:50 gibba013 bash[30381]: cluster 2021-03-10T17:04:48.838809+0000 mgr.gibba020.yqfnwy (mgr.34427) 10113 : cluster [DBG] pgmap v5762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:52.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:52 gibba020 bash[25448]: cluster 2021-03-10T17:04:50.840601+0000 mgr.gibba020.yqfnwy (mgr.34427) 10114 : cluster [DBG] pgmap v5763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:52.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:52 gibba013 bash[29418]: cluster 2021-03-10T17:04:50.840601+0000 mgr.gibba020.yqfnwy (mgr.34427) 10114 : cluster [DBG] pgmap v5763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:52.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:52 gibba013 bash[30381]: cluster 2021-03-10T17:04:50.840601+0000 mgr.gibba020.yqfnwy (mgr.34427) 10114 : cluster [DBG] pgmap v5763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:53.544 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:04:53.775 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:04:53.775 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 3m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:04:53.775 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 2m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:04:53.776 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:04:53.776 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:04:53.776 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:04:53.776 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:04:53.777 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:04:53.777 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:04:53.777 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:04:53.778 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:04:53.778 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:04:53.778 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:04:53.778 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:04:53.779 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:04:53.779 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:04:53.779 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:04:53.779 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:04:53.780 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:04:53.780 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 2m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:04:53.780 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:04:54.021 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:04:54.022 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:04:54.022 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:04:54.022 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:04:54.022 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:04:54.023 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:04:54.023 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:04:54.023 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:04:54.023 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:04:54.024 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:04:54.024 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:04:54.024 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:04:54.024 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:04:54.024 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:04:54.025 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:04:54.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:54 gibba020 bash[25448]: cluster 2021-03-10T17:04:52.842074+0000 mgr.gibba020.yqfnwy (mgr.34427) 10115 : cluster [DBG] pgmap v5764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:54.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:54 gibba020 bash[25448]: audit 2021-03-10T17:04:54.020988+0000 mon.a (mon.0) 3617 : audit [DBG] from='client.? 172.21.2.113:0/2516397257' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:54.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:54 gibba013 bash[29418]: cluster 2021-03-10T17:04:52.842074+0000 mgr.gibba020.yqfnwy (mgr.34427) 10115 : cluster [DBG] pgmap v5764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:54.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:54 gibba013 bash[29418]: audit 2021-03-10T17:04:54.020988+0000 mon.a (mon.0) 3617 : audit [DBG] from='client.? 172.21.2.113:0/2516397257' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:54.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:54 gibba013 bash[30381]: cluster 2021-03-10T17:04:52.842074+0000 mgr.gibba020.yqfnwy (mgr.34427) 10115 : cluster [DBG] pgmap v5764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:54.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:54 gibba013 bash[30381]: audit 2021-03-10T17:04:54.020988+0000 mon.a (mon.0) 3617 : audit [DBG] from='client.? 172.21.2.113:0/2516397257' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:04:55.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:55 gibba020 bash[25448]: audit 2021-03-10T17:04:53.533642+0000 mgr.gibba020.yqfnwy (mgr.34427) 10116 : audit [DBG] from='client.60817 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:04:55.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:55 gibba020 bash[25448]: audit 2021-03-10T17:04:53.761556+0000 mgr.gibba020.yqfnwy (mgr.34427) 10117 : audit [DBG] from='client.60823 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:04:55.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:55 gibba020 bash[25448]: cephadm 2021-03-10T17:04:54.257628+0000 mgr.gibba020.yqfnwy (mgr.34427) 10118 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:04:55.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:55 gibba013 bash[29418]: audit 2021-03-10T17:04:53.533642+0000 mgr.gibba020.yqfnwy (mgr.34427) 10116 : audit [DBG] from='client.60817 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:04:55.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:55 gibba013 bash[29418]: audit 2021-03-10T17:04:53.761556+0000 mgr.gibba020.yqfnwy (mgr.34427) 10117 : audit [DBG] from='client.60823 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:04:55.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:55 gibba013 bash[29418]: cephadm 2021-03-10T17:04:54.257628+0000 mgr.gibba020.yqfnwy (mgr.34427) 10118 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:04:55.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:55 gibba013 bash[30381]: audit 2021-03-10T17:04:53.533642+0000 mgr.gibba020.yqfnwy (mgr.34427) 10116 : audit [DBG] from='client.60817 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:04:55.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:55 gibba013 bash[30381]: audit 2021-03-10T17:04:53.761556+0000 mgr.gibba020.yqfnwy (mgr.34427) 10117 : audit [DBG] from='client.60823 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:04:55.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:55 gibba013 bash[30381]: cephadm 2021-03-10T17:04:54.257628+0000 mgr.gibba020.yqfnwy (mgr.34427) 10118 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:04:56.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:56 gibba020 bash[25448]: cluster 2021-03-10T17:04:54.843854+0000 mgr.gibba020.yqfnwy (mgr.34427) 10119 : cluster [DBG] pgmap v5765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:56.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:56 gibba013 bash[29418]: cluster 2021-03-10T17:04:54.843854+0000 mgr.gibba020.yqfnwy (mgr.34427) 10119 : cluster [DBG] pgmap v5765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:56.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:56 gibba013 bash[30381]: cluster 2021-03-10T17:04:54.843854+0000 mgr.gibba020.yqfnwy (mgr.34427) 10119 : cluster [DBG] pgmap v5765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:58.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:04:58 gibba020 bash[25448]: cluster 2021-03-10T17:04:56.845326+0000 mgr.gibba020.yqfnwy (mgr.34427) 10120 : cluster [DBG] pgmap v5766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:58.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:04:58 gibba013 bash[29418]: cluster 2021-03-10T17:04:56.845326+0000 mgr.gibba020.yqfnwy (mgr.34427) 10120 : cluster [DBG] pgmap v5766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:04:58.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:04:58 gibba013 bash[30381]: cluster 2021-03-10T17:04:56.845326+0000 mgr.gibba020.yqfnwy (mgr.34427) 10120 : cluster [DBG] pgmap v5766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:00.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:00 gibba013 bash[29418]: cluster 2021-03-10T17:04:58.847011+0000 mgr.gibba020.yqfnwy (mgr.34427) 10121 : cluster [DBG] pgmap v5767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:00.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:00 gibba013 bash[30381]: cluster 2021-03-10T17:04:58.847011+0000 mgr.gibba020.yqfnwy (mgr.34427) 10121 : cluster [DBG] pgmap v5767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:00.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:00 gibba020 bash[25448]: cluster 2021-03-10T17:04:58.847011+0000 mgr.gibba020.yqfnwy (mgr.34427) 10121 : cluster [DBG] pgmap v5767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:02.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:02 gibba013 bash[29418]: cluster 2021-03-10T17:05:00.848500+0000 mgr.gibba020.yqfnwy (mgr.34427) 10122 : cluster [DBG] pgmap v5768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:02.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:02 gibba013 bash[30381]: cluster 2021-03-10T17:05:00.848500+0000 mgr.gibba020.yqfnwy (mgr.34427) 10122 : cluster [DBG] pgmap v5768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:02.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:02 gibba020 bash[25448]: cluster 2021-03-10T17:05:00.848500+0000 mgr.gibba020.yqfnwy (mgr.34427) 10122 : cluster [DBG] pgmap v5768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:04.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:04 gibba013 bash[29418]: cluster 2021-03-10T17:05:02.849817+0000 mgr.gibba020.yqfnwy (mgr.34427) 10123 : cluster [DBG] pgmap v5769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:04.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:04 gibba013 bash[30381]: cluster 2021-03-10T17:05:02.849817+0000 mgr.gibba020.yqfnwy (mgr.34427) 10123 : cluster [DBG] pgmap v5769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:04.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:04 gibba020 bash[25448]: cluster 2021-03-10T17:05:02.849817+0000 mgr.gibba020.yqfnwy (mgr.34427) 10123 : cluster [DBG] pgmap v5769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:06.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:06 gibba013 bash[29418]: cluster 2021-03-10T17:05:04.851434+0000 mgr.gibba020.yqfnwy (mgr.34427) 10124 : cluster [DBG] pgmap v5770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:06.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:06 gibba013 bash[30381]: cluster 2021-03-10T17:05:04.851434+0000 mgr.gibba020.yqfnwy (mgr.34427) 10124 : cluster [DBG] pgmap v5770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:06.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:06 gibba020 bash[25448]: cluster 2021-03-10T17:05:04.851434+0000 mgr.gibba020.yqfnwy (mgr.34427) 10124 : cluster [DBG] pgmap v5770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:07.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:07 gibba013 bash[29418]: audit 2021-03-10T17:05:06.884845+0000 mon.a (mon.0) 3618 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:05:07.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:07 gibba013 bash[29418]: audit 2021-03-10T17:05:07.087336+0000 mon.a (mon.0) 3619 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:05:07.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:07 gibba013 bash[30381]: audit 2021-03-10T17:05:06.884845+0000 mon.a (mon.0) 3618 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:05:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:07 gibba013 bash[30381]: audit 2021-03-10T17:05:07.087336+0000 mon.a (mon.0) 3619 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:05:07.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:07 gibba020 bash[25448]: audit 2021-03-10T17:05:06.884845+0000 mon.a (mon.0) 3618 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:05:07.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:07 gibba020 bash[25448]: audit 2021-03-10T17:05:07.087336+0000 mon.a (mon.0) 3619 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:05:08.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:08 gibba013 bash[29418]: cluster 2021-03-10T17:05:06.853035+0000 mgr.gibba020.yqfnwy (mgr.34427) 10125 : cluster [DBG] pgmap v5771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:08.905 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:08 gibba013 bash[29418]: audit 2021-03-10T17:05:07.496211+0000 mon.a (mon.0) 3620 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T17:05:08.905 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:08 gibba013 bash[29418]: audit 2021-03-10T17:05:07.496386+0000 mon.a (mon.0) 3621 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T17:05:08.906 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:08 gibba013 bash[29418]: audit 2021-03-10T17:05:07.496539+0000 mon.a (mon.0) 3622 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:05:08.906 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:08 gibba013 bash[29418]: audit 2021-03-10T17:05:07.496702+0000 mon.a (mon.0) 3623 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:05:08.906 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:08 gibba013 bash[30381]: cluster 2021-03-10T17:05:06.853035+0000 mgr.gibba020.yqfnwy (mgr.34427) 10125 : cluster [DBG] pgmap v5771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:08.907 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:08 gibba013 bash[30381]: audit 2021-03-10T17:05:07.496211+0000 mon.a (mon.0) 3620 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T17:05:08.907 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:08 gibba013 bash[30381]: audit 2021-03-10T17:05:07.496386+0000 mon.a (mon.0) 3621 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T17:05:08.907 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:08 gibba013 bash[30381]: audit 2021-03-10T17:05:07.496539+0000 mon.a (mon.0) 3622 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:05:08.907 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:08 gibba013 bash[30381]: audit 2021-03-10T17:05:07.496702+0000 mon.a (mon.0) 3623 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:05:08.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:08 gibba020 bash[25448]: cluster 2021-03-10T17:05:06.853035+0000 mgr.gibba020.yqfnwy (mgr.34427) 10125 : cluster [DBG] pgmap v5771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:08.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:08 gibba020 bash[25448]: audit 2021-03-10T17:05:07.496211+0000 mon.a (mon.0) 3620 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T17:05:08.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:08 gibba020 bash[25448]: audit 2021-03-10T17:05:07.496386+0000 mon.a (mon.0) 3621 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T17:05:08.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:08 gibba020 bash[25448]: audit 2021-03-10T17:05:07.496539+0000 mon.a (mon.0) 3622 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:05:08.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:08 gibba020 bash[25448]: audit 2021-03-10T17:05:07.496702+0000 mon.a (mon.0) 3623 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:05:10.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:10 gibba013 bash[29418]: cluster 2021-03-10T17:05:08.854628+0000 mgr.gibba020.yqfnwy (mgr.34427) 10126 : cluster [DBG] pgmap v5772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:10.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:10 gibba013 bash[29418]: cephadm 2021-03-10T17:05:09.259010+0000 mgr.gibba020.yqfnwy (mgr.34427) 10127 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:05:10.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:10 gibba013 bash[30381]: cluster 2021-03-10T17:05:08.854628+0000 mgr.gibba020.yqfnwy (mgr.34427) 10126 : cluster [DBG] pgmap v5772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:10.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:10 gibba013 bash[30381]: cephadm 2021-03-10T17:05:09.259010+0000 mgr.gibba020.yqfnwy (mgr.34427) 10127 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:05:10.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:10 gibba020 bash[25448]: cluster 2021-03-10T17:05:08.854628+0000 mgr.gibba020.yqfnwy (mgr.34427) 10126 : cluster [DBG] pgmap v5772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:10.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:10 gibba020 bash[25448]: cephadm 2021-03-10T17:05:09.259010+0000 mgr.gibba020.yqfnwy (mgr.34427) 10127 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:05:11.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:11 gibba013 bash[29418]: cluster 2021-03-10T17:05:10.856103+0000 mgr.gibba020.yqfnwy (mgr.34427) 10128 : cluster [DBG] pgmap v5773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:11.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:11 gibba013 bash[30381]: cluster 2021-03-10T17:05:10.856103+0000 mgr.gibba020.yqfnwy (mgr.34427) 10128 : cluster [DBG] pgmap v5773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:11.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:11 gibba020 bash[25448]: cluster 2021-03-10T17:05:10.856103+0000 mgr.gibba020.yqfnwy (mgr.34427) 10128 : cluster [DBG] pgmap v5773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:14.197 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:13 gibba020 bash[25448]: cluster 2021-03-10T17:05:12.857405+0000 mgr.gibba020.yqfnwy (mgr.34427) 10129 : cluster [DBG] pgmap v5774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:14.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:13 gibba013 bash[29418]: cluster 2021-03-10T17:05:12.857405+0000 mgr.gibba020.yqfnwy (mgr.34427) 10129 : cluster [DBG] pgmap v5774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:14.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:13 gibba013 bash[30381]: cluster 2021-03-10T17:05:12.857405+0000 mgr.gibba020.yqfnwy (mgr.34427) 10129 : cluster [DBG] pgmap v5774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:16.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:16 gibba013 bash[29418]: cluster 2021-03-10T17:05:14.859111+0000 mgr.gibba020.yqfnwy (mgr.34427) 10130 : cluster [DBG] pgmap v5775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:16.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:16 gibba013 bash[30381]: cluster 2021-03-10T17:05:14.859111+0000 mgr.gibba020.yqfnwy (mgr.34427) 10130 : cluster [DBG] pgmap v5775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:16.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:16 gibba020 bash[25448]: cluster 2021-03-10T17:05:14.859111+0000 mgr.gibba020.yqfnwy (mgr.34427) 10130 : cluster [DBG] pgmap v5775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:18.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:18 gibba013 bash[29418]: cluster 2021-03-10T17:05:16.860787+0000 mgr.gibba020.yqfnwy (mgr.34427) 10131 : cluster [DBG] pgmap v5776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:18.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:18 gibba013 bash[30381]: cluster 2021-03-10T17:05:16.860787+0000 mgr.gibba020.yqfnwy (mgr.34427) 10131 : cluster [DBG] pgmap v5776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:18.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:18 gibba020 bash[25448]: cluster 2021-03-10T17:05:16.860787+0000 mgr.gibba020.yqfnwy (mgr.34427) 10131 : cluster [DBG] pgmap v5776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:20.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:20 gibba020 bash[25448]: cluster 2021-03-10T17:05:18.862478+0000 mgr.gibba020.yqfnwy (mgr.34427) 10132 : cluster [DBG] pgmap v5777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:20.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:20 gibba013 bash[29418]: cluster 2021-03-10T17:05:18.862478+0000 mgr.gibba020.yqfnwy (mgr.34427) 10132 : cluster [DBG] pgmap v5777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:20.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:20 gibba013 bash[30381]: cluster 2021-03-10T17:05:18.862478+0000 mgr.gibba020.yqfnwy (mgr.34427) 10132 : cluster [DBG] pgmap v5777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:22.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:22 gibba020 bash[25448]: cluster 2021-03-10T17:05:20.864105+0000 mgr.gibba020.yqfnwy (mgr.34427) 10133 : cluster [DBG] pgmap v5778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:22.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:22 gibba013 bash[29418]: cluster 2021-03-10T17:05:20.864105+0000 mgr.gibba020.yqfnwy (mgr.34427) 10133 : cluster [DBG] pgmap v5778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:22.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:22 gibba013 bash[30381]: cluster 2021-03-10T17:05:20.864105+0000 mgr.gibba020.yqfnwy (mgr.34427) 10133 : cluster [DBG] pgmap v5778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:24.265 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:05:24.489 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:05:24.490 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 4m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:05:24.490 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 3m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:05:24.491 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:05:24.491 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:05:24.492 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:05:24.492 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:05:24.493 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:05:24.493 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:05:24.493 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:05:24.494 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:05:24.494 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:05:24.495 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:05:24.495 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:05:24.496 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:05:24.496 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:05:24.497 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:05:24.497 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:05:24.497 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:05:24.498 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 3m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:05:24.498 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 3m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:05:24.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:24 gibba020 bash[25448]: cluster 2021-03-10T17:05:22.865385+0000 mgr.gibba020.yqfnwy (mgr.34427) 10134 : cluster [DBG] pgmap v5779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:24.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:24 gibba020 bash[25448]: audit 2021-03-10T17:05:24.273540+0000 mon.a (mon.0) 3624 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:05:24.739 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:05:24.739 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:05:24.739 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:05:24.739 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:05:24.740 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:05:24.740 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:05:24.740 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:05:24.740 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:05:24.740 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:05:24.741 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:05:24.741 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:05:24.741 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:05:24.741 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:05:24.742 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:05:24.742 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:05:24.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:24 gibba013 bash[29418]: cluster 2021-03-10T17:05:22.865385+0000 mgr.gibba020.yqfnwy (mgr.34427) 10134 : cluster [DBG] pgmap v5779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:24.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:24 gibba013 bash[29418]: audit 2021-03-10T17:05:24.273540+0000 mon.a (mon.0) 3624 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:05:24.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:24 gibba013 bash[30381]: cluster 2021-03-10T17:05:22.865385+0000 mgr.gibba020.yqfnwy (mgr.34427) 10134 : cluster [DBG] pgmap v5779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:24.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:24 gibba013 bash[30381]: audit 2021-03-10T17:05:24.273540+0000 mon.a (mon.0) 3624 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:05:25.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[30381]: audit 2021-03-10T17:05:24.255825+0000 mgr.gibba020.yqfnwy (mgr.34427) 10135 : audit [DBG] from='client.50856 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:05:25.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[30381]: cephadm 2021-03-10T17:05:24.277145+0000 mgr.gibba020.yqfnwy (mgr.34427) 10136 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:05:25.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[30381]: cephadm 2021-03-10T17:05:24.279090+0000 mgr.gibba020.yqfnwy (mgr.34427) 10137 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:05:25.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[30381]: audit 2021-03-10T17:05:24.474189+0000 mon.a (mon.0) 3625 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:05:25.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[30381]: cephadm 2021-03-10T17:05:24.476151+0000 mgr.gibba020.yqfnwy (mgr.34427) 10138 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:05:25.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[30381]: audit 2021-03-10T17:05:24.477318+0000 mon.a (mon.0) 3626 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:05:25.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[30381]: cephadm 2021-03-10T17:05:24.477722+0000 mgr.gibba020.yqfnwy (mgr.34427) 10139 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:05:25.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[30381]: audit 2021-03-10T17:05:24.478513+0000 mon.a (mon.0) 3627 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:25.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[30381]: cephadm 2021-03-10T17:05:24.479019+0000 mgr.gibba020.yqfnwy (mgr.34427) 10140 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:05:25.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[30381]: cephadm 2021-03-10T17:05:24.479057+0000 mgr.gibba020.yqfnwy (mgr.34427) 10141 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:05:25.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[30381]: audit 2021-03-10T17:05:24.479958+0000 mon.a (mon.0) 3628 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:25.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[30381]: cephadm 2021-03-10T17:05:24.480311+0000 mgr.gibba020.yqfnwy (mgr.34427) 10142 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:05:25.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[30381]: cephadm 2021-03-10T17:05:24.480350+0000 mgr.gibba020.yqfnwy (mgr.34427) 10143 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:05:25.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[30381]: audit 2021-03-10T17:05:24.480551+0000 mgr.gibba020.yqfnwy (mgr.34427) 10144 : audit [DBG] from='client.50862 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:05:25.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[30381]: audit 2021-03-10T17:05:24.481043+0000 mon.a (mon.0) 3629 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:25.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[30381]: cephadm 2021-03-10T17:05:24.488357+0000 mgr.gibba020.yqfnwy (mgr.34427) 10145 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:05:25.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[30381]: cephadm 2021-03-10T17:05:24.490109+0000 mgr.gibba020.yqfnwy (mgr.34427) 10146 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:05:25.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[30381]: cephadm 2021-03-10T17:05:24.490150+0000 mgr.gibba020.yqfnwy (mgr.34427) 10147 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:05:25.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[30381]: audit 2021-03-10T17:05:24.491106+0000 mon.a (mon.0) 3630 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:25.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[30381]: cephadm 2021-03-10T17:05:24.491520+0000 mgr.gibba020.yqfnwy (mgr.34427) 10148 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:05:25.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[30381]: cephadm 2021-03-10T17:05:24.491922+0000 mgr.gibba020.yqfnwy (mgr.34427) 10149 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:05:25.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[30381]: audit 2021-03-10T17:05:24.492698+0000 mon.a (mon.0) 3631 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:25.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[30381]: cephadm 2021-03-10T17:05:24.493160+0000 mgr.gibba020.yqfnwy (mgr.34427) 10150 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:05:25.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[30381]: cephadm 2021-03-10T17:05:24.493198+0000 mgr.gibba020.yqfnwy (mgr.34427) 10151 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:05:25.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[30381]: cephadm 2021-03-10T17:05:24.493323+0000 mgr.gibba020.yqfnwy (mgr.34427) 10152 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:05:25.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[30381]: audit 2021-03-10T17:05:24.738252+0000 mon.c (mon.1) 154 : audit [DBG] from='client.? 172.21.2.113:0/3212921021' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:25.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[29418]: audit 2021-03-10T17:05:24.255825+0000 mgr.gibba020.yqfnwy (mgr.34427) 10135 : audit [DBG] from='client.50856 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:05:25.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[29418]: cephadm 2021-03-10T17:05:24.277145+0000 mgr.gibba020.yqfnwy (mgr.34427) 10136 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:05:25.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[29418]: cephadm 2021-03-10T17:05:24.279090+0000 mgr.gibba020.yqfnwy (mgr.34427) 10137 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:05:25.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[29418]: audit 2021-03-10T17:05:24.474189+0000 mon.a (mon.0) 3625 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:05:25.889 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[29418]: cephadm 2021-03-10T17:05:24.476151+0000 mgr.gibba020.yqfnwy (mgr.34427) 10138 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:05:25.889 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[29418]: audit 2021-03-10T17:05:24.477318+0000 mon.a (mon.0) 3626 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:05:25.889 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[29418]: cephadm 2021-03-10T17:05:24.477722+0000 mgr.gibba020.yqfnwy (mgr.34427) 10139 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:05:25.889 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[29418]: audit 2021-03-10T17:05:24.478513+0000 mon.a (mon.0) 3627 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:25.890 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[29418]: cephadm 2021-03-10T17:05:24.479019+0000 mgr.gibba020.yqfnwy (mgr.34427) 10140 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:05:25.890 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[29418]: cephadm 2021-03-10T17:05:24.479057+0000 mgr.gibba020.yqfnwy (mgr.34427) 10141 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:05:25.890 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[29418]: audit 2021-03-10T17:05:24.479958+0000 mon.a (mon.0) 3628 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:25.890 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[29418]: cephadm 2021-03-10T17:05:24.480311+0000 mgr.gibba020.yqfnwy (mgr.34427) 10142 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:05:25.890 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[29418]: cephadm 2021-03-10T17:05:24.480350+0000 mgr.gibba020.yqfnwy (mgr.34427) 10143 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:05:25.891 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[29418]: audit 2021-03-10T17:05:24.480551+0000 mgr.gibba020.yqfnwy (mgr.34427) 10144 : audit [DBG] from='client.50862 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:05:25.891 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[29418]: audit 2021-03-10T17:05:24.481043+0000 mon.a (mon.0) 3629 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:25.891 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[29418]: cephadm 2021-03-10T17:05:24.488357+0000 mgr.gibba020.yqfnwy (mgr.34427) 10145 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:05:25.891 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[29418]: cephadm 2021-03-10T17:05:24.490109+0000 mgr.gibba020.yqfnwy (mgr.34427) 10146 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:05:25.892 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[29418]: cephadm 2021-03-10T17:05:24.490150+0000 mgr.gibba020.yqfnwy (mgr.34427) 10147 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:05:25.892 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[29418]: audit 2021-03-10T17:05:24.491106+0000 mon.a (mon.0) 3630 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:25.892 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[29418]: cephadm 2021-03-10T17:05:24.491520+0000 mgr.gibba020.yqfnwy (mgr.34427) 10148 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:05:25.892 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[29418]: cephadm 2021-03-10T17:05:24.491922+0000 mgr.gibba020.yqfnwy (mgr.34427) 10149 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:05:25.892 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[29418]: audit 2021-03-10T17:05:24.492698+0000 mon.a (mon.0) 3631 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:25.893 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[29418]: cephadm 2021-03-10T17:05:24.493160+0000 mgr.gibba020.yqfnwy (mgr.34427) 10150 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:05:25.893 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[29418]: cephadm 2021-03-10T17:05:24.493198+0000 mgr.gibba020.yqfnwy (mgr.34427) 10151 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:05:25.893 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[29418]: cephadm 2021-03-10T17:05:24.493323+0000 mgr.gibba020.yqfnwy (mgr.34427) 10152 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:05:25.893 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:25 gibba013 bash[29418]: audit 2021-03-10T17:05:24.738252+0000 mon.c (mon.1) 154 : audit [DBG] from='client.? 172.21.2.113:0/3212921021' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:25.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:25 gibba020 bash[25448]: audit 2021-03-10T17:05:24.255825+0000 mgr.gibba020.yqfnwy (mgr.34427) 10135 : audit [DBG] from='client.50856 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:05:25.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:25 gibba020 bash[25448]: cephadm 2021-03-10T17:05:24.277145+0000 mgr.gibba020.yqfnwy (mgr.34427) 10136 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:05:25.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:25 gibba020 bash[25448]: cephadm 2021-03-10T17:05:24.279090+0000 mgr.gibba020.yqfnwy (mgr.34427) 10137 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:05:25.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:25 gibba020 bash[25448]: audit 2021-03-10T17:05:24.474189+0000 mon.a (mon.0) 3625 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:05:25.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:25 gibba020 bash[25448]: cephadm 2021-03-10T17:05:24.476151+0000 mgr.gibba020.yqfnwy (mgr.34427) 10138 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:05:25.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:25 gibba020 bash[25448]: audit 2021-03-10T17:05:24.477318+0000 mon.a (mon.0) 3626 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:05:25.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:25 gibba020 bash[25448]: cephadm 2021-03-10T17:05:24.477722+0000 mgr.gibba020.yqfnwy (mgr.34427) 10139 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:05:25.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:25 gibba020 bash[25448]: audit 2021-03-10T17:05:24.478513+0000 mon.a (mon.0) 3627 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:25.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:25 gibba020 bash[25448]: cephadm 2021-03-10T17:05:24.479019+0000 mgr.gibba020.yqfnwy (mgr.34427) 10140 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:05:25.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:25 gibba020 bash[25448]: cephadm 2021-03-10T17:05:24.479057+0000 mgr.gibba020.yqfnwy (mgr.34427) 10141 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:05:25.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:25 gibba020 bash[25448]: audit 2021-03-10T17:05:24.479958+0000 mon.a (mon.0) 3628 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:25.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:25 gibba020 bash[25448]: cephadm 2021-03-10T17:05:24.480311+0000 mgr.gibba020.yqfnwy (mgr.34427) 10142 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:05:25.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:25 gibba020 bash[25448]: cephadm 2021-03-10T17:05:24.480350+0000 mgr.gibba020.yqfnwy (mgr.34427) 10143 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:05:25.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:25 gibba020 bash[25448]: audit 2021-03-10T17:05:24.480551+0000 mgr.gibba020.yqfnwy (mgr.34427) 10144 : audit [DBG] from='client.50862 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:05:25.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:25 gibba020 bash[25448]: audit 2021-03-10T17:05:24.481043+0000 mon.a (mon.0) 3629 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:25.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:25 gibba020 bash[25448]: cephadm 2021-03-10T17:05:24.488357+0000 mgr.gibba020.yqfnwy (mgr.34427) 10145 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:05:25.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:25 gibba020 bash[25448]: cephadm 2021-03-10T17:05:24.490109+0000 mgr.gibba020.yqfnwy (mgr.34427) 10146 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:05:25.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:25 gibba020 bash[25448]: cephadm 2021-03-10T17:05:24.490150+0000 mgr.gibba020.yqfnwy (mgr.34427) 10147 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:05:25.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:25 gibba020 bash[25448]: audit 2021-03-10T17:05:24.491106+0000 mon.a (mon.0) 3630 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:25.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:25 gibba020 bash[25448]: cephadm 2021-03-10T17:05:24.491520+0000 mgr.gibba020.yqfnwy (mgr.34427) 10148 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:05:25.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:25 gibba020 bash[25448]: cephadm 2021-03-10T17:05:24.491922+0000 mgr.gibba020.yqfnwy (mgr.34427) 10149 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:05:25.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:25 gibba020 bash[25448]: audit 2021-03-10T17:05:24.492698+0000 mon.a (mon.0) 3631 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:25.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:25 gibba020 bash[25448]: cephadm 2021-03-10T17:05:24.493160+0000 mgr.gibba020.yqfnwy (mgr.34427) 10150 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:05:25.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:25 gibba020 bash[25448]: cephadm 2021-03-10T17:05:24.493198+0000 mgr.gibba020.yqfnwy (mgr.34427) 10151 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:05:25.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:25 gibba020 bash[25448]: cephadm 2021-03-10T17:05:24.493323+0000 mgr.gibba020.yqfnwy (mgr.34427) 10152 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:05:25.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:25 gibba020 bash[25448]: audit 2021-03-10T17:05:24.738252+0000 mon.c (mon.1) 154 : audit [DBG] from='client.? 172.21.2.113:0/3212921021' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:26.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:26 gibba013 bash[29418]: cluster 2021-03-10T17:05:24.866964+0000 mgr.gibba020.yqfnwy (mgr.34427) 10153 : cluster [DBG] pgmap v5780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:26.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:26 gibba013 bash[30381]: cluster 2021-03-10T17:05:24.866964+0000 mgr.gibba020.yqfnwy (mgr.34427) 10153 : cluster [DBG] pgmap v5780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:26.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:26 gibba020 bash[25448]: cluster 2021-03-10T17:05:24.866964+0000 mgr.gibba020.yqfnwy (mgr.34427) 10153 : cluster [DBG] pgmap v5780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:27.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:27 gibba013 bash[29418]: cluster 2021-03-10T17:05:26.868678+0000 mgr.gibba020.yqfnwy (mgr.34427) 10154 : cluster [DBG] pgmap v5781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:27.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:27 gibba013 bash[30381]: cluster 2021-03-10T17:05:26.868678+0000 mgr.gibba020.yqfnwy (mgr.34427) 10154 : cluster [DBG] pgmap v5781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:27.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:27 gibba020 bash[25448]: cluster 2021-03-10T17:05:26.868678+0000 mgr.gibba020.yqfnwy (mgr.34427) 10154 : cluster [DBG] pgmap v5781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:30.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:29 gibba020 bash[25448]: cluster 2021-03-10T17:05:28.870087+0000 mgr.gibba020.yqfnwy (mgr.34427) 10155 : cluster [DBG] pgmap v5782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:30.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:29 gibba013 bash[29418]: cluster 2021-03-10T17:05:28.870087+0000 mgr.gibba020.yqfnwy (mgr.34427) 10155 : cluster [DBG] pgmap v5782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:30.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:29 gibba013 bash[30381]: cluster 2021-03-10T17:05:28.870087+0000 mgr.gibba020.yqfnwy (mgr.34427) 10155 : cluster [DBG] pgmap v5782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:32.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:32 gibba013 bash[29418]: cluster 2021-03-10T17:05:30.871845+0000 mgr.gibba020.yqfnwy (mgr.34427) 10156 : cluster [DBG] pgmap v5783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:32.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:32 gibba013 bash[30381]: cluster 2021-03-10T17:05:30.871845+0000 mgr.gibba020.yqfnwy (mgr.34427) 10156 : cluster [DBG] pgmap v5783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:32.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:32 gibba020 bash[25448]: cluster 2021-03-10T17:05:30.871845+0000 mgr.gibba020.yqfnwy (mgr.34427) 10156 : cluster [DBG] pgmap v5783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:34.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:34 gibba020 bash[25448]: cluster 2021-03-10T17:05:32.873196+0000 mgr.gibba020.yqfnwy (mgr.34427) 10157 : cluster [DBG] pgmap v5784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:34.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:34 gibba013 bash[29418]: cluster 2021-03-10T17:05:32.873196+0000 mgr.gibba020.yqfnwy (mgr.34427) 10157 : cluster [DBG] pgmap v5784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:34.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:34 gibba013 bash[30381]: cluster 2021-03-10T17:05:32.873196+0000 mgr.gibba020.yqfnwy (mgr.34427) 10157 : cluster [DBG] pgmap v5784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:36.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:36 gibba020 bash[25448]: cluster 2021-03-10T17:05:34.874939+0000 mgr.gibba020.yqfnwy (mgr.34427) 10158 : cluster [DBG] pgmap v5785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:36.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:36 gibba013 bash[29418]: cluster 2021-03-10T17:05:34.874939+0000 mgr.gibba020.yqfnwy (mgr.34427) 10158 : cluster [DBG] pgmap v5785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:36.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:36 gibba013 bash[30381]: cluster 2021-03-10T17:05:34.874939+0000 mgr.gibba020.yqfnwy (mgr.34427) 10158 : cluster [DBG] pgmap v5785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:38.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:38 gibba020 bash[25448]: cluster 2021-03-10T17:05:36.876444+0000 mgr.gibba020.yqfnwy (mgr.34427) 10159 : cluster [DBG] pgmap v5786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:38.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:38 gibba013 bash[29418]: cluster 2021-03-10T17:05:36.876444+0000 mgr.gibba020.yqfnwy (mgr.34427) 10159 : cluster [DBG] pgmap v5786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:38.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:38 gibba013 bash[30381]: cluster 2021-03-10T17:05:36.876444+0000 mgr.gibba020.yqfnwy (mgr.34427) 10159 : cluster [DBG] pgmap v5786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:40.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:40 gibba020 bash[25448]: cluster 2021-03-10T17:05:38.878137+0000 mgr.gibba020.yqfnwy (mgr.34427) 10160 : cluster [DBG] pgmap v5787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:40.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:40 gibba013 bash[29418]: cluster 2021-03-10T17:05:38.878137+0000 mgr.gibba020.yqfnwy (mgr.34427) 10160 : cluster [DBG] pgmap v5787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:40.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:40 gibba013 bash[30381]: cluster 2021-03-10T17:05:38.878137+0000 mgr.gibba020.yqfnwy (mgr.34427) 10160 : cluster [DBG] pgmap v5787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:41.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:41 gibba020 bash[25448]: cephadm 2021-03-10T17:05:39.509079+0000 mgr.gibba020.yqfnwy (mgr.34427) 10161 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:05:41.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:41 gibba013 bash[29418]: cephadm 2021-03-10T17:05:39.509079+0000 mgr.gibba020.yqfnwy (mgr.34427) 10161 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:05:41.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:41 gibba013 bash[30381]: cephadm 2021-03-10T17:05:39.509079+0000 mgr.gibba020.yqfnwy (mgr.34427) 10161 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:05:42.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:42 gibba020 bash[25448]: cluster 2021-03-10T17:05:40.879875+0000 mgr.gibba020.yqfnwy (mgr.34427) 10162 : cluster [DBG] pgmap v5788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:42.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:42 gibba013 bash[29418]: cluster 2021-03-10T17:05:40.879875+0000 mgr.gibba020.yqfnwy (mgr.34427) 10162 : cluster [DBG] pgmap v5788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:42.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:42 gibba013 bash[30381]: cluster 2021-03-10T17:05:40.879875+0000 mgr.gibba020.yqfnwy (mgr.34427) 10162 : cluster [DBG] pgmap v5788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:44.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:44 gibba020 bash[25448]: cluster 2021-03-10T17:05:42.881469+0000 mgr.gibba020.yqfnwy (mgr.34427) 10163 : cluster [DBG] pgmap v5789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:44.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:44 gibba013 bash[29418]: cluster 2021-03-10T17:05:42.881469+0000 mgr.gibba020.yqfnwy (mgr.34427) 10163 : cluster [DBG] pgmap v5789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:44.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:44 gibba013 bash[30381]: cluster 2021-03-10T17:05:42.881469+0000 mgr.gibba020.yqfnwy (mgr.34427) 10163 : cluster [DBG] pgmap v5789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:46.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:46 gibba020 bash[25448]: cluster 2021-03-10T17:05:44.883076+0000 mgr.gibba020.yqfnwy (mgr.34427) 10164 : cluster [DBG] pgmap v5790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:46.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:46 gibba013 bash[29418]: cluster 2021-03-10T17:05:44.883076+0000 mgr.gibba020.yqfnwy (mgr.34427) 10164 : cluster [DBG] pgmap v5790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:46.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:46 gibba013 bash[30381]: cluster 2021-03-10T17:05:44.883076+0000 mgr.gibba020.yqfnwy (mgr.34427) 10164 : cluster [DBG] pgmap v5790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:48.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:48 gibba013 bash[29418]: cluster 2021-03-10T17:05:46.884687+0000 mgr.gibba020.yqfnwy (mgr.34427) 10165 : cluster [DBG] pgmap v5791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:48.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:48 gibba013 bash[30381]: cluster 2021-03-10T17:05:46.884687+0000 mgr.gibba020.yqfnwy (mgr.34427) 10165 : cluster [DBG] pgmap v5791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:48.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:48 gibba020 bash[25448]: cluster 2021-03-10T17:05:46.884687+0000 mgr.gibba020.yqfnwy (mgr.34427) 10165 : cluster [DBG] pgmap v5791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:50.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:50 gibba013 bash[29418]: cluster 2021-03-10T17:05:48.886082+0000 mgr.gibba020.yqfnwy (mgr.34427) 10166 : cluster [DBG] pgmap v5792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:50.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:50 gibba013 bash[30381]: cluster 2021-03-10T17:05:48.886082+0000 mgr.gibba020.yqfnwy (mgr.34427) 10166 : cluster [DBG] pgmap v5792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:50.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:50 gibba020 bash[25448]: cluster 2021-03-10T17:05:48.886082+0000 mgr.gibba020.yqfnwy (mgr.34427) 10166 : cluster [DBG] pgmap v5792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:52.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:52 gibba013 bash[29418]: cluster 2021-03-10T17:05:50.887634+0000 mgr.gibba020.yqfnwy (mgr.34427) 10167 : cluster [DBG] pgmap v5793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:52.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:52 gibba013 bash[30381]: cluster 2021-03-10T17:05:50.887634+0000 mgr.gibba020.yqfnwy (mgr.34427) 10167 : cluster [DBG] pgmap v5793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:52.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:52 gibba020 bash[25448]: cluster 2021-03-10T17:05:50.887634+0000 mgr.gibba020.yqfnwy (mgr.34427) 10167 : cluster [DBG] pgmap v5793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:54.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:54 gibba013 bash[29418]: cluster 2021-03-10T17:05:52.889198+0000 mgr.gibba020.yqfnwy (mgr.34427) 10168 : cluster [DBG] pgmap v5794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:54.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:54 gibba013 bash[30381]: cluster 2021-03-10T17:05:52.889198+0000 mgr.gibba020.yqfnwy (mgr.34427) 10168 : cluster [DBG] pgmap v5794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:54.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:54 gibba020 bash[25448]: cluster 2021-03-10T17:05:52.889198+0000 mgr.gibba020.yqfnwy (mgr.34427) 10168 : cluster [DBG] pgmap v5794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:54.978 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:05:55.209 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:05:55.210 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 4m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:05:55.210 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 3m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:05:55.210 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:05:55.210 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:05:55.211 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:05:55.211 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:05:55.211 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:05:55.211 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:05:55.212 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:05:55.212 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:05:55.212 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:05:55.212 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:05:55.213 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:05:55.213 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:05:55.213 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:05:55.213 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:05:55.214 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:05:55.214 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:05:55.214 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 3m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:05:55.214 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 3m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:05:55.458 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:05:55.458 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:05:55.458 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:05:55.459 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:05:55.459 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:05:55.459 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:05:55.459 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:05:55.459 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:05:55.460 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:05:55.460 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:05:55.460 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:05:55.460 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:05:55.460 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:05:55.461 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:05:55.461 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:05:56.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:56 gibba020 bash[25448]: cephadm 2021-03-10T17:05:54.516165+0000 mgr.gibba020.yqfnwy (mgr.34427) 10169 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:05:56.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:56 gibba020 bash[25448]: cluster 2021-03-10T17:05:54.890665+0000 mgr.gibba020.yqfnwy (mgr.34427) 10170 : cluster [DBG] pgmap v5795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:56.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:56 gibba020 bash[25448]: audit 2021-03-10T17:05:54.968778+0000 mgr.gibba020.yqfnwy (mgr.34427) 10171 : audit [DBG] from='client.50874 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:05:56.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:56 gibba020 bash[25448]: audit 2021-03-10T17:05:55.195881+0000 mgr.gibba020.yqfnwy (mgr.34427) 10172 : audit [DBG] from='client.50880 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:05:56.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:56 gibba020 bash[25448]: audit 2021-03-10T17:05:55.457497+0000 mon.c (mon.1) 155 : audit [DBG] from='client.? 172.21.2.113:0/2343426862' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:56.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:56 gibba013 bash[29418]: cephadm 2021-03-10T17:05:54.516165+0000 mgr.gibba020.yqfnwy (mgr.34427) 10169 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:05:56.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:56 gibba013 bash[29418]: cluster 2021-03-10T17:05:54.890665+0000 mgr.gibba020.yqfnwy (mgr.34427) 10170 : cluster [DBG] pgmap v5795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:56.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:56 gibba013 bash[29418]: audit 2021-03-10T17:05:54.968778+0000 mgr.gibba020.yqfnwy (mgr.34427) 10171 : audit [DBG] from='client.50874 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:05:56.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:56 gibba013 bash[29418]: audit 2021-03-10T17:05:55.195881+0000 mgr.gibba020.yqfnwy (mgr.34427) 10172 : audit [DBG] from='client.50880 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:05:56.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:56 gibba013 bash[29418]: audit 2021-03-10T17:05:55.457497+0000 mon.c (mon.1) 155 : audit [DBG] from='client.? 172.21.2.113:0/2343426862' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:56.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:56 gibba013 bash[30381]: cephadm 2021-03-10T17:05:54.516165+0000 mgr.gibba020.yqfnwy (mgr.34427) 10169 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:05:56.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:56 gibba013 bash[30381]: cluster 2021-03-10T17:05:54.890665+0000 mgr.gibba020.yqfnwy (mgr.34427) 10170 : cluster [DBG] pgmap v5795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:56.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:56 gibba013 bash[30381]: audit 2021-03-10T17:05:54.968778+0000 mgr.gibba020.yqfnwy (mgr.34427) 10171 : audit [DBG] from='client.50874 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:05:56.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:56 gibba013 bash[30381]: audit 2021-03-10T17:05:55.195881+0000 mgr.gibba020.yqfnwy (mgr.34427) 10172 : audit [DBG] from='client.50880 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:05:56.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:56 gibba013 bash[30381]: audit 2021-03-10T17:05:55.457497+0000 mon.c (mon.1) 155 : audit [DBG] from='client.? 172.21.2.113:0/2343426862' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:05:58.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:05:58 gibba020 bash[25448]: cluster 2021-03-10T17:05:56.892370+0000 mgr.gibba020.yqfnwy (mgr.34427) 10173 : cluster [DBG] pgmap v5796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:58.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:05:58 gibba013 bash[29418]: cluster 2021-03-10T17:05:56.892370+0000 mgr.gibba020.yqfnwy (mgr.34427) 10173 : cluster [DBG] pgmap v5796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:05:58.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:05:58 gibba013 bash[30381]: cluster 2021-03-10T17:05:56.892370+0000 mgr.gibba020.yqfnwy (mgr.34427) 10173 : cluster [DBG] pgmap v5796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:00.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:00 gibba020 bash[25448]: cluster 2021-03-10T17:05:58.893744+0000 mgr.gibba020.yqfnwy (mgr.34427) 10174 : cluster [DBG] pgmap v5797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:00.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:00 gibba013 bash[29418]: cluster 2021-03-10T17:05:58.893744+0000 mgr.gibba020.yqfnwy (mgr.34427) 10174 : cluster [DBG] pgmap v5797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:00.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:00 gibba013 bash[30381]: cluster 2021-03-10T17:05:58.893744+0000 mgr.gibba020.yqfnwy (mgr.34427) 10174 : cluster [DBG] pgmap v5797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:02.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:02 gibba020 bash[25448]: cluster 2021-03-10T17:06:00.895411+0000 mgr.gibba020.yqfnwy (mgr.34427) 10175 : cluster [DBG] pgmap v5798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:02.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:02 gibba013 bash[29418]: cluster 2021-03-10T17:06:00.895411+0000 mgr.gibba020.yqfnwy (mgr.34427) 10175 : cluster [DBG] pgmap v5798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:02.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:02 gibba013 bash[30381]: cluster 2021-03-10T17:06:00.895411+0000 mgr.gibba020.yqfnwy (mgr.34427) 10175 : cluster [DBG] pgmap v5798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:04.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:04 gibba020 bash[25448]: cluster 2021-03-10T17:06:02.896870+0000 mgr.gibba020.yqfnwy (mgr.34427) 10176 : cluster [DBG] pgmap v5799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:04.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:04 gibba013 bash[29418]: cluster 2021-03-10T17:06:02.896870+0000 mgr.gibba020.yqfnwy (mgr.34427) 10176 : cluster [DBG] pgmap v5799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:04.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:04 gibba013 bash[30381]: cluster 2021-03-10T17:06:02.896870+0000 mgr.gibba020.yqfnwy (mgr.34427) 10176 : cluster [DBG] pgmap v5799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:06.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:06 gibba020 bash[25448]: cluster 2021-03-10T17:06:04.898425+0000 mgr.gibba020.yqfnwy (mgr.34427) 10177 : cluster [DBG] pgmap v5800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:06.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:06 gibba013 bash[29418]: cluster 2021-03-10T17:06:04.898425+0000 mgr.gibba020.yqfnwy (mgr.34427) 10177 : cluster [DBG] pgmap v5800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:06.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:06 gibba013 bash[30381]: cluster 2021-03-10T17:06:04.898425+0000 mgr.gibba020.yqfnwy (mgr.34427) 10177 : cluster [DBG] pgmap v5800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:07.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:07 gibba020 bash[25448]: audit 2021-03-10T17:06:06.889950+0000 mon.a (mon.0) 3632 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:06:07.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:07 gibba020 bash[25448]: audit 2021-03-10T17:06:07.093793+0000 mon.a (mon.0) 3633 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:06:07.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:07 gibba013 bash[29418]: audit 2021-03-10T17:06:06.889950+0000 mon.a (mon.0) 3632 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:06:07.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:07 gibba013 bash[29418]: audit 2021-03-10T17:06:07.093793+0000 mon.a (mon.0) 3633 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:06:07.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:07 gibba013 bash[30381]: audit 2021-03-10T17:06:06.889950+0000 mon.a (mon.0) 3632 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:06:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:07 gibba013 bash[30381]: audit 2021-03-10T17:06:07.093793+0000 mon.a (mon.0) 3633 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:06:08.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:08 gibba020 bash[25448]: cluster 2021-03-10T17:06:06.899924+0000 mgr.gibba020.yqfnwy (mgr.34427) 10178 : cluster [DBG] pgmap v5801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:08.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:08 gibba020 bash[25448]: audit 2021-03-10T17:06:07.501480+0000 mon.a (mon.0) 3634 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T17:06:08.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:08 gibba020 bash[25448]: audit 2021-03-10T17:06:07.501959+0000 mon.a (mon.0) 3635 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:06:08.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:08 gibba020 bash[25448]: audit 2021-03-10T17:06:07.502417+0000 mon.a (mon.0) 3636 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:06:08.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:08 gibba020 bash[25448]: audit 2021-03-10T17:06:07.502844+0000 mon.a (mon.0) 3637 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:06:08.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:08 gibba013 bash[29418]: cluster 2021-03-10T17:06:06.899924+0000 mgr.gibba020.yqfnwy (mgr.34427) 10178 : cluster [DBG] pgmap v5801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:08.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:08 gibba013 bash[29418]: audit 2021-03-10T17:06:07.501480+0000 mon.a (mon.0) 3634 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T17:06:08.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:08 gibba013 bash[29418]: audit 2021-03-10T17:06:07.501959+0000 mon.a (mon.0) 3635 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:06:08.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:08 gibba013 bash[29418]: audit 2021-03-10T17:06:07.502417+0000 mon.a (mon.0) 3636 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:06:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:08 gibba013 bash[29418]: audit 2021-03-10T17:06:07.502844+0000 mon.a (mon.0) 3637 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:06:08.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:08 gibba013 bash[30381]: cluster 2021-03-10T17:06:06.899924+0000 mgr.gibba020.yqfnwy (mgr.34427) 10178 : cluster [DBG] pgmap v5801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:08.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:08 gibba013 bash[30381]: audit 2021-03-10T17:06:07.501480+0000 mon.a (mon.0) 3634 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T17:06:08.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:08 gibba013 bash[30381]: audit 2021-03-10T17:06:07.501959+0000 mon.a (mon.0) 3635 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:06:08.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:08 gibba013 bash[30381]: audit 2021-03-10T17:06:07.502417+0000 mon.a (mon.0) 3636 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:06:08.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:08 gibba013 bash[30381]: audit 2021-03-10T17:06:07.502844+0000 mon.a (mon.0) 3637 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:06:10.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:10 gibba013 bash[29418]: cluster 2021-03-10T17:06:08.901674+0000 mgr.gibba020.yqfnwy (mgr.34427) 10179 : cluster [DBG] pgmap v5802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:10.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:10 gibba013 bash[30381]: cluster 2021-03-10T17:06:08.901674+0000 mgr.gibba020.yqfnwy (mgr.34427) 10179 : cluster [DBG] pgmap v5802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:10.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:10 gibba020 bash[25448]: cluster 2021-03-10T17:06:08.901674+0000 mgr.gibba020.yqfnwy (mgr.34427) 10179 : cluster [DBG] pgmap v5802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:11.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:11 gibba013 bash[29418]: cephadm 2021-03-10T17:06:09.524949+0000 mgr.gibba020.yqfnwy (mgr.34427) 10180 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:06:11.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:11 gibba013 bash[30381]: cephadm 2021-03-10T17:06:09.524949+0000 mgr.gibba020.yqfnwy (mgr.34427) 10180 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:06:11.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:11 gibba020 bash[25448]: cephadm 2021-03-10T17:06:09.524949+0000 mgr.gibba020.yqfnwy (mgr.34427) 10180 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:06:12.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:12 gibba013 bash[29418]: cluster 2021-03-10T17:06:10.903342+0000 mgr.gibba020.yqfnwy (mgr.34427) 10181 : cluster [DBG] pgmap v5803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:12.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:12 gibba013 bash[30381]: cluster 2021-03-10T17:06:10.903342+0000 mgr.gibba020.yqfnwy (mgr.34427) 10181 : cluster [DBG] pgmap v5803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:12.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:12 gibba020 bash[25448]: cluster 2021-03-10T17:06:10.903342+0000 mgr.gibba020.yqfnwy (mgr.34427) 10181 : cluster [DBG] pgmap v5803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:14.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:14 gibba013 bash[29418]: cluster 2021-03-10T17:06:12.904657+0000 mgr.gibba020.yqfnwy (mgr.34427) 10182 : cluster [DBG] pgmap v5804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:14.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:14 gibba013 bash[30381]: cluster 2021-03-10T17:06:12.904657+0000 mgr.gibba020.yqfnwy (mgr.34427) 10182 : cluster [DBG] pgmap v5804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:14.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:14 gibba020 bash[25448]: cluster 2021-03-10T17:06:12.904657+0000 mgr.gibba020.yqfnwy (mgr.34427) 10182 : cluster [DBG] pgmap v5804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:16.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:16 gibba013 bash[29418]: cluster 2021-03-10T17:06:14.906280+0000 mgr.gibba020.yqfnwy (mgr.34427) 10183 : cluster [DBG] pgmap v5805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:16.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:16 gibba013 bash[30381]: cluster 2021-03-10T17:06:14.906280+0000 mgr.gibba020.yqfnwy (mgr.34427) 10183 : cluster [DBG] pgmap v5805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:16.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:16 gibba020 bash[25448]: cluster 2021-03-10T17:06:14.906280+0000 mgr.gibba020.yqfnwy (mgr.34427) 10183 : cluster [DBG] pgmap v5805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:18.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:18 gibba013 bash[29418]: cluster 2021-03-10T17:06:16.908038+0000 mgr.gibba020.yqfnwy (mgr.34427) 10184 : cluster [DBG] pgmap v5806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:18.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:18 gibba013 bash[30381]: cluster 2021-03-10T17:06:16.908038+0000 mgr.gibba020.yqfnwy (mgr.34427) 10184 : cluster [DBG] pgmap v5806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:18.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:18 gibba020 bash[25448]: cluster 2021-03-10T17:06:16.908038+0000 mgr.gibba020.yqfnwy (mgr.34427) 10184 : cluster [DBG] pgmap v5806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:20.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:20 gibba013 bash[29418]: cluster 2021-03-10T17:06:18.909688+0000 mgr.gibba020.yqfnwy (mgr.34427) 10185 : cluster [DBG] pgmap v5807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:20.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:20 gibba013 bash[30381]: cluster 2021-03-10T17:06:18.909688+0000 mgr.gibba020.yqfnwy (mgr.34427) 10185 : cluster [DBG] pgmap v5807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:20.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:20 gibba020 bash[25448]: cluster 2021-03-10T17:06:18.909688+0000 mgr.gibba020.yqfnwy (mgr.34427) 10185 : cluster [DBG] pgmap v5807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:22.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:22 gibba013 bash[29418]: cluster 2021-03-10T17:06:20.911267+0000 mgr.gibba020.yqfnwy (mgr.34427) 10186 : cluster [DBG] pgmap v5808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:22.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:22 gibba013 bash[30381]: cluster 2021-03-10T17:06:20.911267+0000 mgr.gibba020.yqfnwy (mgr.34427) 10186 : cluster [DBG] pgmap v5808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:22.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:22 gibba020 bash[25448]: cluster 2021-03-10T17:06:20.911267+0000 mgr.gibba020.yqfnwy (mgr.34427) 10186 : cluster [DBG] pgmap v5808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:24.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:24 gibba013 bash[29418]: cluster 2021-03-10T17:06:22.912870+0000 mgr.gibba020.yqfnwy (mgr.34427) 10187 : cluster [DBG] pgmap v5809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:24.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:24 gibba013 bash[30381]: cluster 2021-03-10T17:06:22.912870+0000 mgr.gibba020.yqfnwy (mgr.34427) 10187 : cluster [DBG] pgmap v5809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:24.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:24 gibba020 bash[25448]: cluster 2021-03-10T17:06:22.912870+0000 mgr.gibba020.yqfnwy (mgr.34427) 10187 : cluster [DBG] pgmap v5809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:25.702 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:06:25.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[29418]: audit 2021-03-10T17:06:24.541570+0000 mon.a (mon.0) 3638 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:06:25.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[29418]: cephadm 2021-03-10T17:06:24.543025+0000 mgr.gibba020.yqfnwy (mgr.34427) 10188 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:06:25.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[29418]: cephadm 2021-03-10T17:06:24.543455+0000 mgr.gibba020.yqfnwy (mgr.34427) 10189 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:06:25.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[29418]: audit 2021-03-10T17:06:24.732803+0000 mon.a (mon.0) 3639 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:06:25.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[29418]: cephadm 2021-03-10T17:06:24.734775+0000 mgr.gibba020.yqfnwy (mgr.34427) 10190 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:06:25.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[29418]: audit 2021-03-10T17:06:24.736155+0000 mon.a (mon.0) 3640 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:06:25.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[29418]: cephadm 2021-03-10T17:06:24.736937+0000 mgr.gibba020.yqfnwy (mgr.34427) 10191 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:06:25.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[29418]: audit 2021-03-10T17:06:24.738085+0000 mon.a (mon.0) 3641 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:25.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[29418]: cephadm 2021-03-10T17:06:24.738569+0000 mgr.gibba020.yqfnwy (mgr.34427) 10192 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:06:25.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[29418]: cephadm 2021-03-10T17:06:24.738606+0000 mgr.gibba020.yqfnwy (mgr.34427) 10193 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:06:25.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[29418]: audit 2021-03-10T17:06:24.739464+0000 mon.a (mon.0) 3642 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:25.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[29418]: cephadm 2021-03-10T17:06:24.739838+0000 mgr.gibba020.yqfnwy (mgr.34427) 10194 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:06:25.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[29418]: cephadm 2021-03-10T17:06:24.739876+0000 mgr.gibba020.yqfnwy (mgr.34427) 10195 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:06:25.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[29418]: audit 2021-03-10T17:06:24.740854+0000 mon.a (mon.0) 3643 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:25.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[29418]: cephadm 2021-03-10T17:06:24.741172+0000 mgr.gibba020.yqfnwy (mgr.34427) 10196 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:06:25.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[29418]: cephadm 2021-03-10T17:06:24.742449+0000 mgr.gibba020.yqfnwy (mgr.34427) 10197 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:06:25.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[29418]: cephadm 2021-03-10T17:06:24.742486+0000 mgr.gibba020.yqfnwy (mgr.34427) 10198 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:06:25.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[29418]: audit 2021-03-10T17:06:24.743570+0000 mon.a (mon.0) 3644 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:25.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[29418]: cephadm 2021-03-10T17:06:24.744060+0000 mgr.gibba020.yqfnwy (mgr.34427) 10199 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:06:25.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[29418]: cephadm 2021-03-10T17:06:24.744373+0000 mgr.gibba020.yqfnwy (mgr.34427) 10200 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:06:25.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[30381]: audit 2021-03-10T17:06:24.541570+0000 mon.a (mon.0) 3638 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:06:25.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[30381]: cephadm 2021-03-10T17:06:24.543025+0000 mgr.gibba020.yqfnwy (mgr.34427) 10188 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:06:25.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[30381]: cephadm 2021-03-10T17:06:24.543455+0000 mgr.gibba020.yqfnwy (mgr.34427) 10189 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:06:25.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[30381]: audit 2021-03-10T17:06:24.732803+0000 mon.a (mon.0) 3639 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:06:25.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[30381]: cephadm 2021-03-10T17:06:24.734775+0000 mgr.gibba020.yqfnwy (mgr.34427) 10190 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:06:25.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[30381]: audit 2021-03-10T17:06:24.736155+0000 mon.a (mon.0) 3640 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:06:25.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[30381]: cephadm 2021-03-10T17:06:24.736937+0000 mgr.gibba020.yqfnwy (mgr.34427) 10191 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:06:25.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[30381]: audit 2021-03-10T17:06:24.738085+0000 mon.a (mon.0) 3641 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:25.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[30381]: cephadm 2021-03-10T17:06:24.738569+0000 mgr.gibba020.yqfnwy (mgr.34427) 10192 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:06:25.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[30381]: cephadm 2021-03-10T17:06:24.738606+0000 mgr.gibba020.yqfnwy (mgr.34427) 10193 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:06:25.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[30381]: audit 2021-03-10T17:06:24.739464+0000 mon.a (mon.0) 3642 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:25.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[30381]: cephadm 2021-03-10T17:06:24.739838+0000 mgr.gibba020.yqfnwy (mgr.34427) 10194 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:06:25.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[30381]: cephadm 2021-03-10T17:06:24.739876+0000 mgr.gibba020.yqfnwy (mgr.34427) 10195 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:06:25.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[30381]: audit 2021-03-10T17:06:24.740854+0000 mon.a (mon.0) 3643 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:25.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[30381]: cephadm 2021-03-10T17:06:24.741172+0000 mgr.gibba020.yqfnwy (mgr.34427) 10196 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:06:25.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[30381]: cephadm 2021-03-10T17:06:24.742449+0000 mgr.gibba020.yqfnwy (mgr.34427) 10197 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:06:25.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[30381]: cephadm 2021-03-10T17:06:24.742486+0000 mgr.gibba020.yqfnwy (mgr.34427) 10198 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:06:25.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[30381]: audit 2021-03-10T17:06:24.743570+0000 mon.a (mon.0) 3644 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:25.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[30381]: cephadm 2021-03-10T17:06:24.744060+0000 mgr.gibba020.yqfnwy (mgr.34427) 10199 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:06:25.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[30381]: cephadm 2021-03-10T17:06:24.744373+0000 mgr.gibba020.yqfnwy (mgr.34427) 10200 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:06:25.889 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[29418]: audit 2021-03-10T17:06:24.745261+0000 mon.a (mon.0) 3645 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:25.889 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[29418]: cephadm 2021-03-10T17:06:24.745766+0000 mgr.gibba020.yqfnwy (mgr.34427) 10201 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:06:25.889 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[29418]: cephadm 2021-03-10T17:06:24.745808+0000 mgr.gibba020.yqfnwy (mgr.34427) 10202 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:06:25.890 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[29418]: cephadm 2021-03-10T17:06:24.745924+0000 mgr.gibba020.yqfnwy (mgr.34427) 10203 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:06:25.890 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[29418]: cluster 2021-03-10T17:06:24.914327+0000 mgr.gibba020.yqfnwy (mgr.34427) 10204 : cluster [DBG] pgmap v5810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:25.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[30381]: audit 2021-03-10T17:06:24.745261+0000 mon.a (mon.0) 3645 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:25.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[30381]: cephadm 2021-03-10T17:06:24.745766+0000 mgr.gibba020.yqfnwy (mgr.34427) 10201 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:06:25.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[30381]: cephadm 2021-03-10T17:06:24.745808+0000 mgr.gibba020.yqfnwy (mgr.34427) 10202 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:06:25.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[30381]: cephadm 2021-03-10T17:06:24.745924+0000 mgr.gibba020.yqfnwy (mgr.34427) 10203 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:06:25.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:25 gibba013 bash[30381]: cluster 2021-03-10T17:06:24.914327+0000 mgr.gibba020.yqfnwy (mgr.34427) 10204 : cluster [DBG] pgmap v5810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:25.931 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:06:25.931 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 5m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:06:25.931 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 4m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:06:25.932 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:06:25.932 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:06:25.932 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:06:25.932 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:06:25.932 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:06:25.933 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:06:25.933 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:06:25.933 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:06:25.933 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:06:25.933 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:06:25.934 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:06:25.934 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:06:25.934 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:06:25.934 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:06:25.935 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:06:25.935 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:06:25.935 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 4m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:06:25.935 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 4m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:06:25.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:25 gibba020 bash[25448]: audit 2021-03-10T17:06:24.541570+0000 mon.a (mon.0) 3638 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:06:25.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:25 gibba020 bash[25448]: cephadm 2021-03-10T17:06:24.543025+0000 mgr.gibba020.yqfnwy (mgr.34427) 10188 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:06:25.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:25 gibba020 bash[25448]: cephadm 2021-03-10T17:06:24.543455+0000 mgr.gibba020.yqfnwy (mgr.34427) 10189 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:06:25.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:25 gibba020 bash[25448]: audit 2021-03-10T17:06:24.732803+0000 mon.a (mon.0) 3639 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:06:25.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:25 gibba020 bash[25448]: cephadm 2021-03-10T17:06:24.734775+0000 mgr.gibba020.yqfnwy (mgr.34427) 10190 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:06:25.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:25 gibba020 bash[25448]: audit 2021-03-10T17:06:24.736155+0000 mon.a (mon.0) 3640 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:06:25.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:25 gibba020 bash[25448]: cephadm 2021-03-10T17:06:24.736937+0000 mgr.gibba020.yqfnwy (mgr.34427) 10191 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:06:25.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:25 gibba020 bash[25448]: audit 2021-03-10T17:06:24.738085+0000 mon.a (mon.0) 3641 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:25.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:25 gibba020 bash[25448]: cephadm 2021-03-10T17:06:24.738569+0000 mgr.gibba020.yqfnwy (mgr.34427) 10192 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:06:25.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:25 gibba020 bash[25448]: cephadm 2021-03-10T17:06:24.738606+0000 mgr.gibba020.yqfnwy (mgr.34427) 10193 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:06:25.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:25 gibba020 bash[25448]: audit 2021-03-10T17:06:24.739464+0000 mon.a (mon.0) 3642 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:25.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:25 gibba020 bash[25448]: cephadm 2021-03-10T17:06:24.739838+0000 mgr.gibba020.yqfnwy (mgr.34427) 10194 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:06:25.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:25 gibba020 bash[25448]: cephadm 2021-03-10T17:06:24.739876+0000 mgr.gibba020.yqfnwy (mgr.34427) 10195 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:06:25.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:25 gibba020 bash[25448]: audit 2021-03-10T17:06:24.740854+0000 mon.a (mon.0) 3643 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:25.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:25 gibba020 bash[25448]: cephadm 2021-03-10T17:06:24.741172+0000 mgr.gibba020.yqfnwy (mgr.34427) 10196 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:06:25.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:25 gibba020 bash[25448]: cephadm 2021-03-10T17:06:24.742449+0000 mgr.gibba020.yqfnwy (mgr.34427) 10197 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:06:25.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:25 gibba020 bash[25448]: cephadm 2021-03-10T17:06:24.742486+0000 mgr.gibba020.yqfnwy (mgr.34427) 10198 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:06:25.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:25 gibba020 bash[25448]: audit 2021-03-10T17:06:24.743570+0000 mon.a (mon.0) 3644 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:25.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:25 gibba020 bash[25448]: cephadm 2021-03-10T17:06:24.744060+0000 mgr.gibba020.yqfnwy (mgr.34427) 10199 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:06:25.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:25 gibba020 bash[25448]: cephadm 2021-03-10T17:06:24.744373+0000 mgr.gibba020.yqfnwy (mgr.34427) 10200 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:06:25.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:25 gibba020 bash[25448]: audit 2021-03-10T17:06:24.745261+0000 mon.a (mon.0) 3645 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:25.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:25 gibba020 bash[25448]: cephadm 2021-03-10T17:06:24.745766+0000 mgr.gibba020.yqfnwy (mgr.34427) 10201 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:06:25.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:25 gibba020 bash[25448]: cephadm 2021-03-10T17:06:24.745808+0000 mgr.gibba020.yqfnwy (mgr.34427) 10202 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:06:25.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:25 gibba020 bash[25448]: cephadm 2021-03-10T17:06:24.745924+0000 mgr.gibba020.yqfnwy (mgr.34427) 10203 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:06:25.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:25 gibba020 bash[25448]: cluster 2021-03-10T17:06:24.914327+0000 mgr.gibba020.yqfnwy (mgr.34427) 10204 : cluster [DBG] pgmap v5810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:26.179 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:06:26.180 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:06:26.180 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:06:26.180 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:06:26.180 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:06:26.181 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:06:26.181 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:06:26.181 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:06:26.181 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:06:26.181 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:06:26.182 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:06:26.182 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:06:26.182 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:06:26.182 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:06:26.183 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:06:27.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:26 gibba013 bash[29418]: audit 2021-03-10T17:06:25.691771+0000 mgr.gibba020.yqfnwy (mgr.34427) 10205 : audit [DBG] from='client.64736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:06:27.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:26 gibba013 bash[29418]: audit 2021-03-10T17:06:25.917274+0000 mgr.gibba020.yqfnwy (mgr.34427) 10206 : audit [DBG] from='client.60877 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:06:27.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:26 gibba013 bash[29418]: audit 2021-03-10T17:06:26.178906+0000 mon.a (mon.0) 3646 : audit [DBG] from='client.? 172.21.2.113:0/4065935234' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:27.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:26 gibba013 bash[30381]: audit 2021-03-10T17:06:25.691771+0000 mgr.gibba020.yqfnwy (mgr.34427) 10205 : audit [DBG] from='client.64736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:06:27.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:26 gibba013 bash[30381]: audit 2021-03-10T17:06:25.917274+0000 mgr.gibba020.yqfnwy (mgr.34427) 10206 : audit [DBG] from='client.60877 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:06:27.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:26 gibba013 bash[30381]: audit 2021-03-10T17:06:26.178906+0000 mon.a (mon.0) 3646 : audit [DBG] from='client.? 172.21.2.113:0/4065935234' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:27.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:26 gibba020 bash[25448]: audit 2021-03-10T17:06:25.691771+0000 mgr.gibba020.yqfnwy (mgr.34427) 10205 : audit [DBG] from='client.64736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:06:27.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:26 gibba020 bash[25448]: audit 2021-03-10T17:06:25.917274+0000 mgr.gibba020.yqfnwy (mgr.34427) 10206 : audit [DBG] from='client.60877 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:06:27.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:26 gibba020 bash[25448]: audit 2021-03-10T17:06:26.178906+0000 mon.a (mon.0) 3646 : audit [DBG] from='client.? 172.21.2.113:0/4065935234' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:28.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:27 gibba013 bash[29418]: cluster 2021-03-10T17:06:26.915982+0000 mgr.gibba020.yqfnwy (mgr.34427) 10207 : cluster [DBG] pgmap v5811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:28.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:27 gibba013 bash[30381]: cluster 2021-03-10T17:06:26.915982+0000 mgr.gibba020.yqfnwy (mgr.34427) 10207 : cluster [DBG] pgmap v5811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:28.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:27 gibba020 bash[25448]: cluster 2021-03-10T17:06:26.915982+0000 mgr.gibba020.yqfnwy (mgr.34427) 10207 : cluster [DBG] pgmap v5811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:30.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:29 gibba013 bash[29418]: cluster 2021-03-10T17:06:28.917351+0000 mgr.gibba020.yqfnwy (mgr.34427) 10208 : cluster [DBG] pgmap v5812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:30.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:29 gibba013 bash[30381]: cluster 2021-03-10T17:06:28.917351+0000 mgr.gibba020.yqfnwy (mgr.34427) 10208 : cluster [DBG] pgmap v5812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:30.447 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:29 gibba020 bash[25448]: cluster 2021-03-10T17:06:28.917351+0000 mgr.gibba020.yqfnwy (mgr.34427) 10208 : cluster [DBG] pgmap v5812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:32.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:32 gibba020 bash[25448]: cluster 2021-03-10T17:06:30.919084+0000 mgr.gibba020.yqfnwy (mgr.34427) 10209 : cluster [DBG] pgmap v5813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:32.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:32 gibba013 bash[29418]: cluster 2021-03-10T17:06:30.919084+0000 mgr.gibba020.yqfnwy (mgr.34427) 10209 : cluster [DBG] pgmap v5813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:32.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:32 gibba013 bash[30381]: cluster 2021-03-10T17:06:30.919084+0000 mgr.gibba020.yqfnwy (mgr.34427) 10209 : cluster [DBG] pgmap v5813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:34.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:34 gibba020 bash[25448]: cluster 2021-03-10T17:06:32.920740+0000 mgr.gibba020.yqfnwy (mgr.34427) 10210 : cluster [DBG] pgmap v5814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:34.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:34 gibba013 bash[29418]: cluster 2021-03-10T17:06:32.920740+0000 mgr.gibba020.yqfnwy (mgr.34427) 10210 : cluster [DBG] pgmap v5814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:34.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:34 gibba013 bash[30381]: cluster 2021-03-10T17:06:32.920740+0000 mgr.gibba020.yqfnwy (mgr.34427) 10210 : cluster [DBG] pgmap v5814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:36.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:36 gibba020 bash[25448]: cluster 2021-03-10T17:06:34.922417+0000 mgr.gibba020.yqfnwy (mgr.34427) 10211 : cluster [DBG] pgmap v5815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:36.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:36 gibba013 bash[29418]: cluster 2021-03-10T17:06:34.922417+0000 mgr.gibba020.yqfnwy (mgr.34427) 10211 : cluster [DBG] pgmap v5815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:36.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:36 gibba013 bash[30381]: cluster 2021-03-10T17:06:34.922417+0000 mgr.gibba020.yqfnwy (mgr.34427) 10211 : cluster [DBG] pgmap v5815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:38.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:38 gibba020 bash[25448]: cluster 2021-03-10T17:06:36.923899+0000 mgr.gibba020.yqfnwy (mgr.34427) 10212 : cluster [DBG] pgmap v5816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:38.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:38 gibba013 bash[29418]: cluster 2021-03-10T17:06:36.923899+0000 mgr.gibba020.yqfnwy (mgr.34427) 10212 : cluster [DBG] pgmap v5816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:38.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:38 gibba013 bash[30381]: cluster 2021-03-10T17:06:36.923899+0000 mgr.gibba020.yqfnwy (mgr.34427) 10212 : cluster [DBG] pgmap v5816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:40.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:40 gibba020 bash[25448]: cluster 2021-03-10T17:06:38.925614+0000 mgr.gibba020.yqfnwy (mgr.34427) 10213 : cluster [DBG] pgmap v5817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:40.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:40 gibba013 bash[29418]: cluster 2021-03-10T17:06:38.925614+0000 mgr.gibba020.yqfnwy (mgr.34427) 10213 : cluster [DBG] pgmap v5817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:40.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:40 gibba013 bash[30381]: cluster 2021-03-10T17:06:38.925614+0000 mgr.gibba020.yqfnwy (mgr.34427) 10213 : cluster [DBG] pgmap v5817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:41.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:41 gibba013 bash[29418]: cephadm 2021-03-10T17:06:39.748529+0000 mgr.gibba020.yqfnwy (mgr.34427) 10214 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:06:41.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:41 gibba013 bash[30381]: cephadm 2021-03-10T17:06:39.748529+0000 mgr.gibba020.yqfnwy (mgr.34427) 10214 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:06:41.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:41 gibba020 bash[25448]: cephadm 2021-03-10T17:06:39.748529+0000 mgr.gibba020.yqfnwy (mgr.34427) 10214 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:06:42.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:42 gibba013 bash[29418]: cluster 2021-03-10T17:06:40.927364+0000 mgr.gibba020.yqfnwy (mgr.34427) 10215 : cluster [DBG] pgmap v5818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:42.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:42 gibba013 bash[30381]: cluster 2021-03-10T17:06:40.927364+0000 mgr.gibba020.yqfnwy (mgr.34427) 10215 : cluster [DBG] pgmap v5818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:42.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:42 gibba020 bash[25448]: cluster 2021-03-10T17:06:40.927364+0000 mgr.gibba020.yqfnwy (mgr.34427) 10215 : cluster [DBG] pgmap v5818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:44.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:44 gibba013 bash[29418]: cluster 2021-03-10T17:06:42.928923+0000 mgr.gibba020.yqfnwy (mgr.34427) 10216 : cluster [DBG] pgmap v5819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:44.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:44 gibba013 bash[30381]: cluster 2021-03-10T17:06:42.928923+0000 mgr.gibba020.yqfnwy (mgr.34427) 10216 : cluster [DBG] pgmap v5819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:44.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:44 gibba020 bash[25448]: cluster 2021-03-10T17:06:42.928923+0000 mgr.gibba020.yqfnwy (mgr.34427) 10216 : cluster [DBG] pgmap v5819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:46.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:46 gibba013 bash[29418]: cluster 2021-03-10T17:06:44.930657+0000 mgr.gibba020.yqfnwy (mgr.34427) 10217 : cluster [DBG] pgmap v5820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:46.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:46 gibba013 bash[30381]: cluster 2021-03-10T17:06:44.930657+0000 mgr.gibba020.yqfnwy (mgr.34427) 10217 : cluster [DBG] pgmap v5820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:46.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:46 gibba020 bash[25448]: cluster 2021-03-10T17:06:44.930657+0000 mgr.gibba020.yqfnwy (mgr.34427) 10217 : cluster [DBG] pgmap v5820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:48.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:48 gibba013 bash[29418]: cluster 2021-03-10T17:06:46.932247+0000 mgr.gibba020.yqfnwy (mgr.34427) 10218 : cluster [DBG] pgmap v5821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:48.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:48 gibba013 bash[30381]: cluster 2021-03-10T17:06:46.932247+0000 mgr.gibba020.yqfnwy (mgr.34427) 10218 : cluster [DBG] pgmap v5821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:48.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:48 gibba020 bash[25448]: cluster 2021-03-10T17:06:46.932247+0000 mgr.gibba020.yqfnwy (mgr.34427) 10218 : cluster [DBG] pgmap v5821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:50.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:50 gibba013 bash[29418]: cluster 2021-03-10T17:06:48.933890+0000 mgr.gibba020.yqfnwy (mgr.34427) 10219 : cluster [DBG] pgmap v5822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:50.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:50 gibba013 bash[30381]: cluster 2021-03-10T17:06:48.933890+0000 mgr.gibba020.yqfnwy (mgr.34427) 10219 : cluster [DBG] pgmap v5822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:50.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:50 gibba020 bash[25448]: cluster 2021-03-10T17:06:48.933890+0000 mgr.gibba020.yqfnwy (mgr.34427) 10219 : cluster [DBG] pgmap v5822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:52.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:52 gibba013 bash[29418]: cluster 2021-03-10T17:06:50.935566+0000 mgr.gibba020.yqfnwy (mgr.34427) 10220 : cluster [DBG] pgmap v5823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:52.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:52 gibba013 bash[30381]: cluster 2021-03-10T17:06:50.935566+0000 mgr.gibba020.yqfnwy (mgr.34427) 10220 : cluster [DBG] pgmap v5823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:52.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:52 gibba020 bash[25448]: cluster 2021-03-10T17:06:50.935566+0000 mgr.gibba020.yqfnwy (mgr.34427) 10220 : cluster [DBG] pgmap v5823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:54.766 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:54 gibba020 bash[25448]: cluster 2021-03-10T17:06:52.937086+0000 mgr.gibba020.yqfnwy (mgr.34427) 10221 : cluster [DBG] pgmap v5824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:54.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:54 gibba013 bash[29418]: cluster 2021-03-10T17:06:52.937086+0000 mgr.gibba020.yqfnwy (mgr.34427) 10221 : cluster [DBG] pgmap v5824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:54.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:54 gibba013 bash[30381]: cluster 2021-03-10T17:06:52.937086+0000 mgr.gibba020.yqfnwy (mgr.34427) 10221 : cluster [DBG] pgmap v5824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:56.425 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:06:56.651 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:06:56.652 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 5m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:06:56.652 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 4m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:06:56.652 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:06:56.652 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:06:56.653 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:06:56.653 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:06:56.653 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:06:56.653 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:06:56.654 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:06:56.654 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:06:56.654 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:06:56.654 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:06:56.655 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:06:56.655 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:06:56.655 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:06:56.655 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:06:56.655 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:06:56.656 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:06:56.656 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 4m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:06:56.656 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 4m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:06:56.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:56 gibba013 bash[29418]: cephadm 2021-03-10T17:06:54.764553+0000 mgr.gibba020.yqfnwy (mgr.34427) 10222 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:06:56.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:56 gibba013 bash[29418]: cluster 2021-03-10T17:06:54.938589+0000 mgr.gibba020.yqfnwy (mgr.34427) 10223 : cluster [DBG] pgmap v5825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:56.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:56 gibba013 bash[30381]: cephadm 2021-03-10T17:06:54.764553+0000 mgr.gibba020.yqfnwy (mgr.34427) 10222 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:06:56.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:56 gibba013 bash[30381]: cluster 2021-03-10T17:06:54.938589+0000 mgr.gibba020.yqfnwy (mgr.34427) 10223 : cluster [DBG] pgmap v5825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:56.899 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:06:56.900 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:06:56.900 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:06:56.900 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:06:56.900 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:06:56.901 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:06:56.901 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:06:56.901 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:06:56.902 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:06:56.902 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:06:56.902 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:06:56.902 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:06:56.903 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:06:56.903 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:06:56.903 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:06:56.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:56 gibba020 bash[25448]: cephadm 2021-03-10T17:06:54.764553+0000 mgr.gibba020.yqfnwy (mgr.34427) 10222 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:06:56.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:56 gibba020 bash[25448]: cluster 2021-03-10T17:06:54.938589+0000 mgr.gibba020.yqfnwy (mgr.34427) 10223 : cluster [DBG] pgmap v5825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:57.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:57 gibba013 bash[29418]: audit 2021-03-10T17:06:56.414687+0000 mgr.gibba020.yqfnwy (mgr.34427) 10224 : audit [DBG] from='client.50910 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:06:57.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:57 gibba013 bash[29418]: audit 2021-03-10T17:06:56.899150+0000 mon.a (mon.0) 3647 : audit [DBG] from='client.? 172.21.2.113:0/2895293682' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:57.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:57 gibba013 bash[30381]: audit 2021-03-10T17:06:56.414687+0000 mgr.gibba020.yqfnwy (mgr.34427) 10224 : audit [DBG] from='client.50910 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:06:57.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:57 gibba013 bash[30381]: audit 2021-03-10T17:06:56.899150+0000 mon.a (mon.0) 3647 : audit [DBG] from='client.? 172.21.2.113:0/2895293682' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:57.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:57 gibba020 bash[25448]: audit 2021-03-10T17:06:56.414687+0000 mgr.gibba020.yqfnwy (mgr.34427) 10224 : audit [DBG] from='client.50910 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:06:57.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:57 gibba020 bash[25448]: audit 2021-03-10T17:06:56.899150+0000 mon.a (mon.0) 3647 : audit [DBG] from='client.? 172.21.2.113:0/2895293682' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:06:58.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:58 gibba013 bash[29418]: audit 2021-03-10T17:06:56.642036+0000 mgr.gibba020.yqfnwy (mgr.34427) 10225 : audit [DBG] from='client.60895 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:06:58.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:58 gibba013 bash[29418]: cluster 2021-03-10T17:06:56.940259+0000 mgr.gibba020.yqfnwy (mgr.34427) 10226 : cluster [DBG] pgmap v5826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:58.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:58 gibba013 bash[30381]: audit 2021-03-10T17:06:56.642036+0000 mgr.gibba020.yqfnwy (mgr.34427) 10225 : audit [DBG] from='client.60895 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:06:58.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:58 gibba013 bash[30381]: cluster 2021-03-10T17:06:56.940259+0000 mgr.gibba020.yqfnwy (mgr.34427) 10226 : cluster [DBG] pgmap v5826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:58.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:58 gibba020 bash[25448]: audit 2021-03-10T17:06:56.642036+0000 mgr.gibba020.yqfnwy (mgr.34427) 10225 : audit [DBG] from='client.60895 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:06:58.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:58 gibba020 bash[25448]: cluster 2021-03-10T17:06:56.940259+0000 mgr.gibba020.yqfnwy (mgr.34427) 10226 : cluster [DBG] pgmap v5826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:59.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:06:59 gibba013 bash[29418]: cluster 2021-03-10T17:06:58.941809+0000 mgr.gibba020.yqfnwy (mgr.34427) 10227 : cluster [DBG] pgmap v5827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:59.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:06:59 gibba013 bash[30381]: cluster 2021-03-10T17:06:58.941809+0000 mgr.gibba020.yqfnwy (mgr.34427) 10227 : cluster [DBG] pgmap v5827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:06:59.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:06:59 gibba020 bash[25448]: cluster 2021-03-10T17:06:58.941809+0000 mgr.gibba020.yqfnwy (mgr.34427) 10227 : cluster [DBG] pgmap v5827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:02.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:02 gibba020 bash[25448]: cluster 2021-03-10T17:07:00.943427+0000 mgr.gibba020.yqfnwy (mgr.34427) 10228 : cluster [DBG] pgmap v5828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:02.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:02 gibba013 bash[29418]: cluster 2021-03-10T17:07:00.943427+0000 mgr.gibba020.yqfnwy (mgr.34427) 10228 : cluster [DBG] pgmap v5828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:02.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:02 gibba013 bash[30381]: cluster 2021-03-10T17:07:00.943427+0000 mgr.gibba020.yqfnwy (mgr.34427) 10228 : cluster [DBG] pgmap v5828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:04.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:04 gibba020 bash[25448]: cluster 2021-03-10T17:07:02.944736+0000 mgr.gibba020.yqfnwy (mgr.34427) 10229 : cluster [DBG] pgmap v5829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:04.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:04 gibba013 bash[29418]: cluster 2021-03-10T17:07:02.944736+0000 mgr.gibba020.yqfnwy (mgr.34427) 10229 : cluster [DBG] pgmap v5829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:04.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:04 gibba013 bash[30381]: cluster 2021-03-10T17:07:02.944736+0000 mgr.gibba020.yqfnwy (mgr.34427) 10229 : cluster [DBG] pgmap v5829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:06.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:06 gibba020 bash[25448]: cluster 2021-03-10T17:07:04.946451+0000 mgr.gibba020.yqfnwy (mgr.34427) 10230 : cluster [DBG] pgmap v5830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:06.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:06 gibba013 bash[29418]: cluster 2021-03-10T17:07:04.946451+0000 mgr.gibba020.yqfnwy (mgr.34427) 10230 : cluster [DBG] pgmap v5830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:06.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:06 gibba013 bash[30381]: cluster 2021-03-10T17:07:04.946451+0000 mgr.gibba020.yqfnwy (mgr.34427) 10230 : cluster [DBG] pgmap v5830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:07.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:07 gibba013 bash[29418]: audit 2021-03-10T17:07:06.895151+0000 mon.a (mon.0) 3648 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:07:07.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:07 gibba013 bash[29418]: audit 2021-03-10T17:07:07.100480+0000 mon.a (mon.0) 3649 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:07:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:07 gibba013 bash[30381]: audit 2021-03-10T17:07:06.895151+0000 mon.a (mon.0) 3648 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:07:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:07 gibba013 bash[30381]: audit 2021-03-10T17:07:07.100480+0000 mon.a (mon.0) 3649 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:07:07.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:07 gibba020 bash[25448]: audit 2021-03-10T17:07:06.895151+0000 mon.a (mon.0) 3648 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:07:07.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:07 gibba020 bash[25448]: audit 2021-03-10T17:07:07.100480+0000 mon.a (mon.0) 3649 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:07:08.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:08 gibba013 bash[29418]: cluster 2021-03-10T17:07:06.948095+0000 mgr.gibba020.yqfnwy (mgr.34427) 10231 : cluster [DBG] pgmap v5831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:08.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:08 gibba013 bash[29418]: audit 2021-03-10T17:07:07.509243+0000 mon.a (mon.0) 3650 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T17:07:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:08 gibba013 bash[29418]: audit 2021-03-10T17:07:07.509568+0000 mon.a (mon.0) 3651 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:07:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:08 gibba013 bash[29418]: audit 2021-03-10T17:07:07.509852+0000 mon.a (mon.0) 3652 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:07:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:08 gibba013 bash[29418]: audit 2021-03-10T17:07:07.510164+0000 mon.a (mon.0) 3653 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:07:08.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:08 gibba013 bash[30381]: cluster 2021-03-10T17:07:06.948095+0000 mgr.gibba020.yqfnwy (mgr.34427) 10231 : cluster [DBG] pgmap v5831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:08.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:08 gibba013 bash[30381]: audit 2021-03-10T17:07:07.509243+0000 mon.a (mon.0) 3650 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T17:07:08.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:08 gibba013 bash[30381]: audit 2021-03-10T17:07:07.509568+0000 mon.a (mon.0) 3651 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:07:08.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:08 gibba013 bash[30381]: audit 2021-03-10T17:07:07.509852+0000 mon.a (mon.0) 3652 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:07:08.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:08 gibba013 bash[30381]: audit 2021-03-10T17:07:07.510164+0000 mon.a (mon.0) 3653 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:07:08.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:08 gibba020 bash[25448]: cluster 2021-03-10T17:07:06.948095+0000 mgr.gibba020.yqfnwy (mgr.34427) 10231 : cluster [DBG] pgmap v5831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:08.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:08 gibba020 bash[25448]: audit 2021-03-10T17:07:07.509243+0000 mon.a (mon.0) 3650 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T17:07:08.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:08 gibba020 bash[25448]: audit 2021-03-10T17:07:07.509568+0000 mon.a (mon.0) 3651 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:07:08.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:08 gibba020 bash[25448]: audit 2021-03-10T17:07:07.509852+0000 mon.a (mon.0) 3652 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:07:08.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:08 gibba020 bash[25448]: audit 2021-03-10T17:07:07.510164+0000 mon.a (mon.0) 3653 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:07:10.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:10 gibba013 bash[29418]: cluster 2021-03-10T17:07:08.949501+0000 mgr.gibba020.yqfnwy (mgr.34427) 10232 : cluster [DBG] pgmap v5832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:10.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:10 gibba013 bash[30381]: cluster 2021-03-10T17:07:08.949501+0000 mgr.gibba020.yqfnwy (mgr.34427) 10232 : cluster [DBG] pgmap v5832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:10.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:10 gibba020 bash[25448]: cluster 2021-03-10T17:07:08.949501+0000 mgr.gibba020.yqfnwy (mgr.34427) 10232 : cluster [DBG] pgmap v5832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:11.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:11 gibba013 bash[29418]: cephadm 2021-03-10T17:07:09.779345+0000 mgr.gibba020.yqfnwy (mgr.34427) 10233 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:07:11.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:11 gibba013 bash[30381]: cephadm 2021-03-10T17:07:09.779345+0000 mgr.gibba020.yqfnwy (mgr.34427) 10233 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:07:11.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:11 gibba020 bash[25448]: cephadm 2021-03-10T17:07:09.779345+0000 mgr.gibba020.yqfnwy (mgr.34427) 10233 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:07:12.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:12 gibba013 bash[29418]: cluster 2021-03-10T17:07:10.951092+0000 mgr.gibba020.yqfnwy (mgr.34427) 10234 : cluster [DBG] pgmap v5833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:12.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:12 gibba013 bash[30381]: cluster 2021-03-10T17:07:10.951092+0000 mgr.gibba020.yqfnwy (mgr.34427) 10234 : cluster [DBG] pgmap v5833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:12.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:12 gibba020 bash[25448]: cluster 2021-03-10T17:07:10.951092+0000 mgr.gibba020.yqfnwy (mgr.34427) 10234 : cluster [DBG] pgmap v5833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:14.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:14 gibba013 bash[29418]: cluster 2021-03-10T17:07:12.952520+0000 mgr.gibba020.yqfnwy (mgr.34427) 10235 : cluster [DBG] pgmap v5834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:14.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:14 gibba013 bash[30381]: cluster 2021-03-10T17:07:12.952520+0000 mgr.gibba020.yqfnwy (mgr.34427) 10235 : cluster [DBG] pgmap v5834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:14.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:14 gibba020 bash[25448]: cluster 2021-03-10T17:07:12.952520+0000 mgr.gibba020.yqfnwy (mgr.34427) 10235 : cluster [DBG] pgmap v5834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:16.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:16 gibba013 bash[29418]: cluster 2021-03-10T17:07:14.953993+0000 mgr.gibba020.yqfnwy (mgr.34427) 10236 : cluster [DBG] pgmap v5835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:16.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:16 gibba013 bash[30381]: cluster 2021-03-10T17:07:14.953993+0000 mgr.gibba020.yqfnwy (mgr.34427) 10236 : cluster [DBG] pgmap v5835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:16.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:16 gibba020 bash[25448]: cluster 2021-03-10T17:07:14.953993+0000 mgr.gibba020.yqfnwy (mgr.34427) 10236 : cluster [DBG] pgmap v5835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:18.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:18 gibba013 bash[29418]: cluster 2021-03-10T17:07:16.955326+0000 mgr.gibba020.yqfnwy (mgr.34427) 10237 : cluster [DBG] pgmap v5836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:18.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:18 gibba013 bash[30381]: cluster 2021-03-10T17:07:16.955326+0000 mgr.gibba020.yqfnwy (mgr.34427) 10237 : cluster [DBG] pgmap v5836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:18.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:18 gibba020 bash[25448]: cluster 2021-03-10T17:07:16.955326+0000 mgr.gibba020.yqfnwy (mgr.34427) 10237 : cluster [DBG] pgmap v5836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:20.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:20 gibba013 bash[29418]: cluster 2021-03-10T17:07:18.956899+0000 mgr.gibba020.yqfnwy (mgr.34427) 10238 : cluster [DBG] pgmap v5837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:20.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:20 gibba013 bash[30381]: cluster 2021-03-10T17:07:18.956899+0000 mgr.gibba020.yqfnwy (mgr.34427) 10238 : cluster [DBG] pgmap v5837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:20.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:20 gibba020 bash[25448]: cluster 2021-03-10T17:07:18.956899+0000 mgr.gibba020.yqfnwy (mgr.34427) 10238 : cluster [DBG] pgmap v5837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:22.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:22 gibba013 bash[29418]: cluster 2021-03-10T17:07:20.958585+0000 mgr.gibba020.yqfnwy (mgr.34427) 10239 : cluster [DBG] pgmap v5838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:22.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:22 gibba013 bash[30381]: cluster 2021-03-10T17:07:20.958585+0000 mgr.gibba020.yqfnwy (mgr.34427) 10239 : cluster [DBG] pgmap v5838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:22.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:22 gibba020 bash[25448]: cluster 2021-03-10T17:07:20.958585+0000 mgr.gibba020.yqfnwy (mgr.34427) 10239 : cluster [DBG] pgmap v5838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:24.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:24 gibba013 bash[29418]: cluster 2021-03-10T17:07:22.959675+0000 mgr.gibba020.yqfnwy (mgr.34427) 10240 : cluster [DBG] pgmap v5839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:24.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:24 gibba013 bash[30381]: cluster 2021-03-10T17:07:22.959675+0000 mgr.gibba020.yqfnwy (mgr.34427) 10240 : cluster [DBG] pgmap v5839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:24.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:24 gibba020 bash[25448]: cluster 2021-03-10T17:07:22.959675+0000 mgr.gibba020.yqfnwy (mgr.34427) 10240 : cluster [DBG] pgmap v5839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:25.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:25 gibba013 bash[29418]: audit 2021-03-10T17:07:24.796883+0000 mon.a (mon.0) 3654 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:07:25.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:25 gibba013 bash[29418]: audit 2021-03-10T17:07:25.002415+0000 mon.a (mon.0) 3655 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:07:25.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:25 gibba013 bash[29418]: audit 2021-03-10T17:07:25.005727+0000 mon.a (mon.0) 3656 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:07:25.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:25 gibba013 bash[29418]: audit 2021-03-10T17:07:25.007501+0000 mon.a (mon.0) 3657 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:25.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:25 gibba013 bash[29418]: audit 2021-03-10T17:07:25.009085+0000 mon.a (mon.0) 3658 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:25.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:25 gibba013 bash[29418]: audit 2021-03-10T17:07:25.010339+0000 mon.a (mon.0) 3659 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:25.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:25 gibba013 bash[29418]: audit 2021-03-10T17:07:25.013015+0000 mon.a (mon.0) 3660 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:25.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:25 gibba013 bash[29418]: audit 2021-03-10T17:07:25.014559+0000 mon.a (mon.0) 3661 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:25.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:25 gibba013 bash[30381]: audit 2021-03-10T17:07:24.796883+0000 mon.a (mon.0) 3654 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:07:25.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:25 gibba013 bash[30381]: audit 2021-03-10T17:07:25.002415+0000 mon.a (mon.0) 3655 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:07:25.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:25 gibba013 bash[30381]: audit 2021-03-10T17:07:25.005727+0000 mon.a (mon.0) 3656 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:07:25.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:25 gibba013 bash[30381]: audit 2021-03-10T17:07:25.007501+0000 mon.a (mon.0) 3657 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:25.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:25 gibba013 bash[30381]: audit 2021-03-10T17:07:25.009085+0000 mon.a (mon.0) 3658 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:25.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:25 gibba013 bash[30381]: audit 2021-03-10T17:07:25.010339+0000 mon.a (mon.0) 3659 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:25.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:25 gibba013 bash[30381]: audit 2021-03-10T17:07:25.013015+0000 mon.a (mon.0) 3660 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:25.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:25 gibba013 bash[30381]: audit 2021-03-10T17:07:25.014559+0000 mon.a (mon.0) 3661 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:25.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:25 gibba020 bash[25448]: audit 2021-03-10T17:07:24.796883+0000 mon.a (mon.0) 3654 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:07:25.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:25 gibba020 bash[25448]: audit 2021-03-10T17:07:25.002415+0000 mon.a (mon.0) 3655 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:07:25.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:25 gibba020 bash[25448]: audit 2021-03-10T17:07:25.005727+0000 mon.a (mon.0) 3656 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:07:25.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:25 gibba020 bash[25448]: audit 2021-03-10T17:07:25.007501+0000 mon.a (mon.0) 3657 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:25.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:25 gibba020 bash[25448]: audit 2021-03-10T17:07:25.009085+0000 mon.a (mon.0) 3658 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:25.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:25 gibba020 bash[25448]: audit 2021-03-10T17:07:25.010339+0000 mon.a (mon.0) 3659 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:25.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:25 gibba020 bash[25448]: audit 2021-03-10T17:07:25.013015+0000 mon.a (mon.0) 3660 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:25.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:25 gibba020 bash[25448]: audit 2021-03-10T17:07:25.014559+0000 mon.a (mon.0) 3661 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:26.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:26 gibba013 bash[29418]: cephadm 2021-03-10T17:07:24.801610+0000 mgr.gibba020.yqfnwy (mgr.34427) 10241 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:07:26.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:26 gibba013 bash[29418]: cephadm 2021-03-10T17:07:24.803509+0000 mgr.gibba020.yqfnwy (mgr.34427) 10242 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:07:26.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:26 gibba013 bash[29418]: cluster 2021-03-10T17:07:24.960244+0000 mgr.gibba020.yqfnwy (mgr.34427) 10243 : cluster [DBG] pgmap v5840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:26.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:26 gibba013 bash[29418]: cephadm 2021-03-10T17:07:25.004336+0000 mgr.gibba020.yqfnwy (mgr.34427) 10244 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:07:26.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:26 gibba013 bash[29418]: cephadm 2021-03-10T17:07:25.006492+0000 mgr.gibba020.yqfnwy (mgr.34427) 10245 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:07:26.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:26 gibba013 bash[29418]: cephadm 2021-03-10T17:07:25.008032+0000 mgr.gibba020.yqfnwy (mgr.34427) 10246 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:07:26.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:26 gibba013 bash[29418]: cephadm 2021-03-10T17:07:25.008071+0000 mgr.gibba020.yqfnwy (mgr.34427) 10247 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:07:26.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:26 gibba013 bash[29418]: cephadm 2021-03-10T17:07:25.009458+0000 mgr.gibba020.yqfnwy (mgr.34427) 10248 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:07:26.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:26 gibba013 bash[29418]: cephadm 2021-03-10T17:07:25.009496+0000 mgr.gibba020.yqfnwy (mgr.34427) 10249 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:07:26.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:26 gibba013 bash[29418]: cephadm 2021-03-10T17:07:25.010731+0000 mgr.gibba020.yqfnwy (mgr.34427) 10250 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:07:26.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:26 gibba013 bash[29418]: cephadm 2021-03-10T17:07:25.011825+0000 mgr.gibba020.yqfnwy (mgr.34427) 10251 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:07:26.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:26 gibba013 bash[29418]: cephadm 2021-03-10T17:07:25.011876+0000 mgr.gibba020.yqfnwy (mgr.34427) 10252 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:07:26.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:26 gibba013 bash[29418]: cephadm 2021-03-10T17:07:25.013329+0000 mgr.gibba020.yqfnwy (mgr.34427) 10253 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:07:26.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:26 gibba013 bash[29418]: cephadm 2021-03-10T17:07:25.013652+0000 mgr.gibba020.yqfnwy (mgr.34427) 10254 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:07:26.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:26 gibba013 bash[29418]: cephadm 2021-03-10T17:07:25.014904+0000 mgr.gibba020.yqfnwy (mgr.34427) 10255 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:07:26.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:26 gibba013 bash[29418]: cephadm 2021-03-10T17:07:25.014936+0000 mgr.gibba020.yqfnwy (mgr.34427) 10256 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:07:26.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:26 gibba013 bash[29418]: cephadm 2021-03-10T17:07:25.015038+0000 mgr.gibba020.yqfnwy (mgr.34427) 10257 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:07:26.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:26 gibba013 bash[30381]: cephadm 2021-03-10T17:07:24.801610+0000 mgr.gibba020.yqfnwy (mgr.34427) 10241 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:07:26.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:26 gibba013 bash[30381]: cephadm 2021-03-10T17:07:24.803509+0000 mgr.gibba020.yqfnwy (mgr.34427) 10242 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:07:26.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:26 gibba013 bash[30381]: cluster 2021-03-10T17:07:24.960244+0000 mgr.gibba020.yqfnwy (mgr.34427) 10243 : cluster [DBG] pgmap v5840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:26.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:26 gibba013 bash[30381]: cephadm 2021-03-10T17:07:25.004336+0000 mgr.gibba020.yqfnwy (mgr.34427) 10244 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:07:26.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:26 gibba013 bash[30381]: cephadm 2021-03-10T17:07:25.006492+0000 mgr.gibba020.yqfnwy (mgr.34427) 10245 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:07:26.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:26 gibba013 bash[30381]: cephadm 2021-03-10T17:07:25.008032+0000 mgr.gibba020.yqfnwy (mgr.34427) 10246 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:07:26.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:26 gibba013 bash[30381]: cephadm 2021-03-10T17:07:25.008071+0000 mgr.gibba020.yqfnwy (mgr.34427) 10247 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:07:26.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:26 gibba013 bash[30381]: cephadm 2021-03-10T17:07:25.009458+0000 mgr.gibba020.yqfnwy (mgr.34427) 10248 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:07:26.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:26 gibba013 bash[30381]: cephadm 2021-03-10T17:07:25.009496+0000 mgr.gibba020.yqfnwy (mgr.34427) 10249 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:07:26.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:26 gibba013 bash[30381]: cephadm 2021-03-10T17:07:25.010731+0000 mgr.gibba020.yqfnwy (mgr.34427) 10250 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:07:26.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:26 gibba013 bash[30381]: cephadm 2021-03-10T17:07:25.011825+0000 mgr.gibba020.yqfnwy (mgr.34427) 10251 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:07:26.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:26 gibba013 bash[30381]: cephadm 2021-03-10T17:07:25.011876+0000 mgr.gibba020.yqfnwy (mgr.34427) 10252 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:07:26.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:26 gibba013 bash[30381]: cephadm 2021-03-10T17:07:25.013329+0000 mgr.gibba020.yqfnwy (mgr.34427) 10253 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:07:26.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:26 gibba013 bash[30381]: cephadm 2021-03-10T17:07:25.013652+0000 mgr.gibba020.yqfnwy (mgr.34427) 10254 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:07:26.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:26 gibba013 bash[30381]: cephadm 2021-03-10T17:07:25.014904+0000 mgr.gibba020.yqfnwy (mgr.34427) 10255 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:07:26.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:26 gibba013 bash[30381]: cephadm 2021-03-10T17:07:25.014936+0000 mgr.gibba020.yqfnwy (mgr.34427) 10256 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:07:26.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:26 gibba013 bash[30381]: cephadm 2021-03-10T17:07:25.015038+0000 mgr.gibba020.yqfnwy (mgr.34427) 10257 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:07:26.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:26 gibba020 bash[25448]: cephadm 2021-03-10T17:07:24.801610+0000 mgr.gibba020.yqfnwy (mgr.34427) 10241 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:07:26.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:26 gibba020 bash[25448]: cephadm 2021-03-10T17:07:24.803509+0000 mgr.gibba020.yqfnwy (mgr.34427) 10242 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:07:26.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:26 gibba020 bash[25448]: cluster 2021-03-10T17:07:24.960244+0000 mgr.gibba020.yqfnwy (mgr.34427) 10243 : cluster [DBG] pgmap v5840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:26.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:26 gibba020 bash[25448]: cephadm 2021-03-10T17:07:25.004336+0000 mgr.gibba020.yqfnwy (mgr.34427) 10244 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:07:26.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:26 gibba020 bash[25448]: cephadm 2021-03-10T17:07:25.006492+0000 mgr.gibba020.yqfnwy (mgr.34427) 10245 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:07:26.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:26 gibba020 bash[25448]: cephadm 2021-03-10T17:07:25.008032+0000 mgr.gibba020.yqfnwy (mgr.34427) 10246 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:07:26.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:26 gibba020 bash[25448]: cephadm 2021-03-10T17:07:25.008071+0000 mgr.gibba020.yqfnwy (mgr.34427) 10247 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:07:26.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:26 gibba020 bash[25448]: cephadm 2021-03-10T17:07:25.009458+0000 mgr.gibba020.yqfnwy (mgr.34427) 10248 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:07:26.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:26 gibba020 bash[25448]: cephadm 2021-03-10T17:07:25.009496+0000 mgr.gibba020.yqfnwy (mgr.34427) 10249 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:07:26.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:26 gibba020 bash[25448]: cephadm 2021-03-10T17:07:25.010731+0000 mgr.gibba020.yqfnwy (mgr.34427) 10250 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:07:26.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:26 gibba020 bash[25448]: cephadm 2021-03-10T17:07:25.011825+0000 mgr.gibba020.yqfnwy (mgr.34427) 10251 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:07:26.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:26 gibba020 bash[25448]: cephadm 2021-03-10T17:07:25.011876+0000 mgr.gibba020.yqfnwy (mgr.34427) 10252 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:07:26.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:26 gibba020 bash[25448]: cephadm 2021-03-10T17:07:25.013329+0000 mgr.gibba020.yqfnwy (mgr.34427) 10253 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:07:26.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:26 gibba020 bash[25448]: cephadm 2021-03-10T17:07:25.013652+0000 mgr.gibba020.yqfnwy (mgr.34427) 10254 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:07:26.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:26 gibba020 bash[25448]: cephadm 2021-03-10T17:07:25.014904+0000 mgr.gibba020.yqfnwy (mgr.34427) 10255 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:07:26.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:26 gibba020 bash[25448]: cephadm 2021-03-10T17:07:25.014936+0000 mgr.gibba020.yqfnwy (mgr.34427) 10256 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:07:26.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:26 gibba020 bash[25448]: cephadm 2021-03-10T17:07:25.015038+0000 mgr.gibba020.yqfnwy (mgr.34427) 10257 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:07:27.147 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:07:27.372 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:07:27.373 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 6m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:07:27.373 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 5m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:07:27.373 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:07:27.373 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:07:27.373 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:07:27.374 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:07:27.374 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:07:27.374 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:07:27.374 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:07:27.375 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:07:27.375 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:07:27.375 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:07:27.375 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:07:27.376 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:07:27.376 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:07:27.376 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:07:27.376 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:07:27.376 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:07:27.377 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 5m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:07:27.377 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 5m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:07:27.623 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:07:27.624 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:07:27.624 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:07:27.624 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:07:27.624 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:07:27.624 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:07:27.625 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:07:27.625 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:07:27.625 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:07:27.625 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:07:27.625 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:07:27.626 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:07:27.626 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:07:27.626 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:07:27.626 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:07:27.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:27 gibba013 bash[29418]: cluster 2021-03-10T17:07:26.961415+0000 mgr.gibba020.yqfnwy (mgr.34427) 10258 : cluster [DBG] pgmap v5841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:27.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:27 gibba013 bash[29418]: audit 2021-03-10T17:07:27.137215+0000 mgr.gibba020.yqfnwy (mgr.34427) 10259 : audit [DBG] from='client.60907 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:07:27.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:27 gibba013 bash[29418]: audit 2021-03-10T17:07:27.359083+0000 mgr.gibba020.yqfnwy (mgr.34427) 10260 : audit [DBG] from='client.50934 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:07:27.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:27 gibba013 bash[30381]: cluster 2021-03-10T17:07:26.961415+0000 mgr.gibba020.yqfnwy (mgr.34427) 10258 : cluster [DBG] pgmap v5841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:27.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:27 gibba013 bash[30381]: audit 2021-03-10T17:07:27.137215+0000 mgr.gibba020.yqfnwy (mgr.34427) 10259 : audit [DBG] from='client.60907 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:07:27.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:27 gibba013 bash[30381]: audit 2021-03-10T17:07:27.359083+0000 mgr.gibba020.yqfnwy (mgr.34427) 10260 : audit [DBG] from='client.50934 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:07:27.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:27 gibba020 bash[25448]: cluster 2021-03-10T17:07:26.961415+0000 mgr.gibba020.yqfnwy (mgr.34427) 10258 : cluster [DBG] pgmap v5841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:27.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:27 gibba020 bash[25448]: audit 2021-03-10T17:07:27.137215+0000 mgr.gibba020.yqfnwy (mgr.34427) 10259 : audit [DBG] from='client.60907 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:07:27.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:27 gibba020 bash[25448]: audit 2021-03-10T17:07:27.359083+0000 mgr.gibba020.yqfnwy (mgr.34427) 10260 : audit [DBG] from='client.50934 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:07:28.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:28 gibba013 bash[29418]: audit 2021-03-10T17:07:27.622844+0000 mon.a (mon.0) 3662 : audit [DBG] from='client.? 172.21.2.113:0/2987636371' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:28.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:28 gibba013 bash[30381]: audit 2021-03-10T17:07:27.622844+0000 mon.a (mon.0) 3662 : audit [DBG] from='client.? 172.21.2.113:0/2987636371' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:28.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:28 gibba020 bash[25448]: audit 2021-03-10T17:07:27.622844+0000 mon.a (mon.0) 3662 : audit [DBG] from='client.? 172.21.2.113:0/2987636371' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:29.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:29 gibba013 bash[29418]: cluster 2021-03-10T17:07:28.962921+0000 mgr.gibba020.yqfnwy (mgr.34427) 10261 : cluster [DBG] pgmap v5842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:29.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:29 gibba013 bash[30381]: cluster 2021-03-10T17:07:28.962921+0000 mgr.gibba020.yqfnwy (mgr.34427) 10261 : cluster [DBG] pgmap v5842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:29.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:29 gibba020 bash[25448]: cluster 2021-03-10T17:07:28.962921+0000 mgr.gibba020.yqfnwy (mgr.34427) 10261 : cluster [DBG] pgmap v5842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:32.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:32 gibba020 bash[25448]: cluster 2021-03-10T17:07:30.964561+0000 mgr.gibba020.yqfnwy (mgr.34427) 10262 : cluster [DBG] pgmap v5843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:32.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:32 gibba013 bash[29418]: cluster 2021-03-10T17:07:30.964561+0000 mgr.gibba020.yqfnwy (mgr.34427) 10262 : cluster [DBG] pgmap v5843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:32.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:32 gibba013 bash[30381]: cluster 2021-03-10T17:07:30.964561+0000 mgr.gibba020.yqfnwy (mgr.34427) 10262 : cluster [DBG] pgmap v5843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:34.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:34 gibba020 bash[25448]: cluster 2021-03-10T17:07:32.965989+0000 mgr.gibba020.yqfnwy (mgr.34427) 10263 : cluster [DBG] pgmap v5844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:34.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:34 gibba013 bash[29418]: cluster 2021-03-10T17:07:32.965989+0000 mgr.gibba020.yqfnwy (mgr.34427) 10263 : cluster [DBG] pgmap v5844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:34.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:34 gibba013 bash[30381]: cluster 2021-03-10T17:07:32.965989+0000 mgr.gibba020.yqfnwy (mgr.34427) 10263 : cluster [DBG] pgmap v5844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:36.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:36 gibba013 bash[29418]: cluster 2021-03-10T17:07:34.967485+0000 mgr.gibba020.yqfnwy (mgr.34427) 10264 : cluster [DBG] pgmap v5845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:36.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:36 gibba013 bash[30381]: cluster 2021-03-10T17:07:34.967485+0000 mgr.gibba020.yqfnwy (mgr.34427) 10264 : cluster [DBG] pgmap v5845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:36.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:36 gibba020 bash[25448]: cluster 2021-03-10T17:07:34.967485+0000 mgr.gibba020.yqfnwy (mgr.34427) 10264 : cluster [DBG] pgmap v5845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:38.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:38 gibba013 bash[29418]: cluster 2021-03-10T17:07:36.969014+0000 mgr.gibba020.yqfnwy (mgr.34427) 10265 : cluster [DBG] pgmap v5846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:38.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:38 gibba013 bash[30381]: cluster 2021-03-10T17:07:36.969014+0000 mgr.gibba020.yqfnwy (mgr.34427) 10265 : cluster [DBG] pgmap v5846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:38.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:38 gibba020 bash[25448]: cluster 2021-03-10T17:07:36.969014+0000 mgr.gibba020.yqfnwy (mgr.34427) 10265 : cluster [DBG] pgmap v5846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:40.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:40 gibba013 bash[29418]: cluster 2021-03-10T17:07:38.970512+0000 mgr.gibba020.yqfnwy (mgr.34427) 10266 : cluster [DBG] pgmap v5847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:40.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:40 gibba013 bash[30381]: cluster 2021-03-10T17:07:38.970512+0000 mgr.gibba020.yqfnwy (mgr.34427) 10266 : cluster [DBG] pgmap v5847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:40.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:40 gibba020 bash[25448]: cluster 2021-03-10T17:07:38.970512+0000 mgr.gibba020.yqfnwy (mgr.34427) 10266 : cluster [DBG] pgmap v5847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:41.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:41 gibba013 bash[29418]: cephadm 2021-03-10T17:07:40.028415+0000 mgr.gibba020.yqfnwy (mgr.34427) 10267 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:07:41.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:41 gibba013 bash[30381]: cephadm 2021-03-10T17:07:40.028415+0000 mgr.gibba020.yqfnwy (mgr.34427) 10267 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:07:41.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:41 gibba020 bash[25448]: cephadm 2021-03-10T17:07:40.028415+0000 mgr.gibba020.yqfnwy (mgr.34427) 10267 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:07:42.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:42 gibba013 bash[29418]: cluster 2021-03-10T17:07:40.972093+0000 mgr.gibba020.yqfnwy (mgr.34427) 10268 : cluster [DBG] pgmap v5848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:42.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:42 gibba013 bash[30381]: cluster 2021-03-10T17:07:40.972093+0000 mgr.gibba020.yqfnwy (mgr.34427) 10268 : cluster [DBG] pgmap v5848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:42.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:42 gibba020 bash[25448]: cluster 2021-03-10T17:07:40.972093+0000 mgr.gibba020.yqfnwy (mgr.34427) 10268 : cluster [DBG] pgmap v5848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:44.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:44 gibba013 bash[29418]: cluster 2021-03-10T17:07:42.973193+0000 mgr.gibba020.yqfnwy (mgr.34427) 10269 : cluster [DBG] pgmap v5849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:44.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:44 gibba013 bash[30381]: cluster 2021-03-10T17:07:42.973193+0000 mgr.gibba020.yqfnwy (mgr.34427) 10269 : cluster [DBG] pgmap v5849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:44.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:44 gibba020 bash[25448]: cluster 2021-03-10T17:07:42.973193+0000 mgr.gibba020.yqfnwy (mgr.34427) 10269 : cluster [DBG] pgmap v5849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:46.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:46 gibba013 bash[29418]: cluster 2021-03-10T17:07:44.974785+0000 mgr.gibba020.yqfnwy (mgr.34427) 10270 : cluster [DBG] pgmap v5850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:46.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:46 gibba013 bash[30381]: cluster 2021-03-10T17:07:44.974785+0000 mgr.gibba020.yqfnwy (mgr.34427) 10270 : cluster [DBG] pgmap v5850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:46.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:46 gibba020 bash[25448]: cluster 2021-03-10T17:07:44.974785+0000 mgr.gibba020.yqfnwy (mgr.34427) 10270 : cluster [DBG] pgmap v5850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:48.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:48 gibba013 bash[29418]: cluster 2021-03-10T17:07:46.976172+0000 mgr.gibba020.yqfnwy (mgr.34427) 10271 : cluster [DBG] pgmap v5851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:48.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:48 gibba013 bash[30381]: cluster 2021-03-10T17:07:46.976172+0000 mgr.gibba020.yqfnwy (mgr.34427) 10271 : cluster [DBG] pgmap v5851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:48.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:48 gibba020 bash[25448]: cluster 2021-03-10T17:07:46.976172+0000 mgr.gibba020.yqfnwy (mgr.34427) 10271 : cluster [DBG] pgmap v5851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:50.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:50 gibba013 bash[29418]: cluster 2021-03-10T17:07:48.977802+0000 mgr.gibba020.yqfnwy (mgr.34427) 10272 : cluster [DBG] pgmap v5852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:50.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:50 gibba013 bash[30381]: cluster 2021-03-10T17:07:48.977802+0000 mgr.gibba020.yqfnwy (mgr.34427) 10272 : cluster [DBG] pgmap v5852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:50.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:50 gibba020 bash[25448]: cluster 2021-03-10T17:07:48.977802+0000 mgr.gibba020.yqfnwy (mgr.34427) 10272 : cluster [DBG] pgmap v5852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:52.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:52 gibba013 bash[29418]: cluster 2021-03-10T17:07:50.979344+0000 mgr.gibba020.yqfnwy (mgr.34427) 10273 : cluster [DBG] pgmap v5853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:52.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:52 gibba013 bash[30381]: cluster 2021-03-10T17:07:50.979344+0000 mgr.gibba020.yqfnwy (mgr.34427) 10273 : cluster [DBG] pgmap v5853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:52.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:52 gibba020 bash[25448]: cluster 2021-03-10T17:07:50.979344+0000 mgr.gibba020.yqfnwy (mgr.34427) 10273 : cluster [DBG] pgmap v5853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:54.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:54 gibba013 bash[29418]: cluster 2021-03-10T17:07:52.980755+0000 mgr.gibba020.yqfnwy (mgr.34427) 10274 : cluster [DBG] pgmap v5854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:54.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:54 gibba013 bash[30381]: cluster 2021-03-10T17:07:52.980755+0000 mgr.gibba020.yqfnwy (mgr.34427) 10274 : cluster [DBG] pgmap v5854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:54.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:54 gibba020 bash[25448]: cluster 2021-03-10T17:07:52.980755+0000 mgr.gibba020.yqfnwy (mgr.34427) 10274 : cluster [DBG] pgmap v5854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:56.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:56 gibba020 bash[25448]: cluster 2021-03-10T17:07:54.982484+0000 mgr.gibba020.yqfnwy (mgr.34427) 10275 : cluster [DBG] pgmap v5855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:56.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:56 gibba020 bash[25448]: cephadm 2021-03-10T17:07:55.040711+0000 mgr.gibba020.yqfnwy (mgr.34427) 10276 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:07:56.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:56 gibba013 bash[29418]: cluster 2021-03-10T17:07:54.982484+0000 mgr.gibba020.yqfnwy (mgr.34427) 10275 : cluster [DBG] pgmap v5855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:56.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:56 gibba013 bash[29418]: cephadm 2021-03-10T17:07:55.040711+0000 mgr.gibba020.yqfnwy (mgr.34427) 10276 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:07:56.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:56 gibba013 bash[30381]: cluster 2021-03-10T17:07:54.982484+0000 mgr.gibba020.yqfnwy (mgr.34427) 10275 : cluster [DBG] pgmap v5855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:56.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:56 gibba013 bash[30381]: cephadm 2021-03-10T17:07:55.040711+0000 mgr.gibba020.yqfnwy (mgr.34427) 10276 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:07:57.867 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:07:58.120 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:07:58.120 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 6m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:07:58.120 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 5m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:07:58.121 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:07:58.121 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:07:58.121 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:07:58.121 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:07:58.122 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:07:58.122 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:07:58.122 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:07:58.122 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:07:58.123 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:07:58.123 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:07:58.123 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:07:58.123 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:07:58.124 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:07:58.124 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:07:58.124 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:07:58.124 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:07:58.125 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 5m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:07:58.125 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 5m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:07:58.372 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:07:58.372 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:07:58.373 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:07:58.373 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:07:58.373 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:07:58.373 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:07:58.374 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:07:58.374 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:07:58.374 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:07:58.375 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:07:58.375 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:07:58.376 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:07:58.376 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:07:58.376 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:07:58.376 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:07:58.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:58 gibba013 bash[29418]: cluster 2021-03-10T17:07:56.984098+0000 mgr.gibba020.yqfnwy (mgr.34427) 10277 : cluster [DBG] pgmap v5856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:58.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:58 gibba013 bash[29418]: audit 2021-03-10T17:07:58.371657+0000 mon.c (mon.1) 156 : audit [DBG] from='client.? 172.21.2.113:0/863092051' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:58.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:58 gibba013 bash[30381]: cluster 2021-03-10T17:07:56.984098+0000 mgr.gibba020.yqfnwy (mgr.34427) 10277 : cluster [DBG] pgmap v5856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:58.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:58 gibba013 bash[30381]: audit 2021-03-10T17:07:58.371657+0000 mon.c (mon.1) 156 : audit [DBG] from='client.? 172.21.2.113:0/863092051' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:58.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:58 gibba020 bash[25448]: cluster 2021-03-10T17:07:56.984098+0000 mgr.gibba020.yqfnwy (mgr.34427) 10277 : cluster [DBG] pgmap v5856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:07:58.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:58 gibba020 bash[25448]: audit 2021-03-10T17:07:58.371657+0000 mon.c (mon.1) 156 : audit [DBG] from='client.? 172.21.2.113:0/863092051' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:07:59.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:59 gibba013 bash[29418]: audit 2021-03-10T17:07:57.856956+0000 mgr.gibba020.yqfnwy (mgr.34427) 10278 : audit [DBG] from='client.60925 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:07:59.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:07:59 gibba013 bash[29418]: audit 2021-03-10T17:07:58.080809+0000 mgr.gibba020.yqfnwy (mgr.34427) 10279 : audit [DBG] from='client.60931 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:07:59.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:59 gibba013 bash[30381]: audit 2021-03-10T17:07:57.856956+0000 mgr.gibba020.yqfnwy (mgr.34427) 10278 : audit [DBG] from='client.60925 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:07:59.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:07:59 gibba013 bash[30381]: audit 2021-03-10T17:07:58.080809+0000 mgr.gibba020.yqfnwy (mgr.34427) 10279 : audit [DBG] from='client.60931 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:07:59.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:59 gibba020 bash[25448]: audit 2021-03-10T17:07:57.856956+0000 mgr.gibba020.yqfnwy (mgr.34427) 10278 : audit [DBG] from='client.60925 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:07:59.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:07:59 gibba020 bash[25448]: audit 2021-03-10T17:07:58.080809+0000 mgr.gibba020.yqfnwy (mgr.34427) 10279 : audit [DBG] from='client.60931 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:08:00.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:00 gibba013 bash[29418]: cluster 2021-03-10T17:07:58.985445+0000 mgr.gibba020.yqfnwy (mgr.34427) 10280 : cluster [DBG] pgmap v5857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:00.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:00 gibba013 bash[30381]: cluster 2021-03-10T17:07:58.985445+0000 mgr.gibba020.yqfnwy (mgr.34427) 10280 : cluster [DBG] pgmap v5857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:00.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:00 gibba020 bash[25448]: cluster 2021-03-10T17:07:58.985445+0000 mgr.gibba020.yqfnwy (mgr.34427) 10280 : cluster [DBG] pgmap v5857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:02.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:02 gibba013 bash[29418]: cluster 2021-03-10T17:08:00.987173+0000 mgr.gibba020.yqfnwy (mgr.34427) 10281 : cluster [DBG] pgmap v5858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:02.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:02 gibba013 bash[30381]: cluster 2021-03-10T17:08:00.987173+0000 mgr.gibba020.yqfnwy (mgr.34427) 10281 : cluster [DBG] pgmap v5858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:02.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:02 gibba020 bash[25448]: cluster 2021-03-10T17:08:00.987173+0000 mgr.gibba020.yqfnwy (mgr.34427) 10281 : cluster [DBG] pgmap v5858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:04.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:04 gibba013 bash[29418]: cluster 2021-03-10T17:08:02.988420+0000 mgr.gibba020.yqfnwy (mgr.34427) 10282 : cluster [DBG] pgmap v5859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:04.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:04 gibba013 bash[30381]: cluster 2021-03-10T17:08:02.988420+0000 mgr.gibba020.yqfnwy (mgr.34427) 10282 : cluster [DBG] pgmap v5859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:04.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:04 gibba020 bash[25448]: cluster 2021-03-10T17:08:02.988420+0000 mgr.gibba020.yqfnwy (mgr.34427) 10282 : cluster [DBG] pgmap v5859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:06.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:06 gibba013 bash[29418]: cluster 2021-03-10T17:08:04.990014+0000 mgr.gibba020.yqfnwy (mgr.34427) 10283 : cluster [DBG] pgmap v5860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:06.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:06 gibba013 bash[30381]: cluster 2021-03-10T17:08:04.990014+0000 mgr.gibba020.yqfnwy (mgr.34427) 10283 : cluster [DBG] pgmap v5860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:06.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:06 gibba020 bash[25448]: cluster 2021-03-10T17:08:04.990014+0000 mgr.gibba020.yqfnwy (mgr.34427) 10283 : cluster [DBG] pgmap v5860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:07.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:07 gibba013 bash[29418]: audit 2021-03-10T17:08:06.900036+0000 mon.a (mon.0) 3663 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:08:07.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:07 gibba013 bash[29418]: audit 2021-03-10T17:08:07.106908+0000 mon.a (mon.0) 3664 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:08:07.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:07 gibba013 bash[30381]: audit 2021-03-10T17:08:06.900036+0000 mon.a (mon.0) 3663 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:08:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:07 gibba013 bash[30381]: audit 2021-03-10T17:08:07.106908+0000 mon.a (mon.0) 3664 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:08:07.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:07 gibba020 bash[25448]: audit 2021-03-10T17:08:06.900036+0000 mon.a (mon.0) 3663 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:08:07.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:07 gibba020 bash[25448]: audit 2021-03-10T17:08:07.106908+0000 mon.a (mon.0) 3664 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:08:08.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:08 gibba013 bash[29418]: cluster 2021-03-10T17:08:06.991387+0000 mgr.gibba020.yqfnwy (mgr.34427) 10284 : cluster [DBG] pgmap v5861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:08 gibba013 bash[29418]: audit 2021-03-10T17:08:07.513124+0000 mon.a (mon.0) 3665 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T17:08:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:08 gibba013 bash[29418]: audit 2021-03-10T17:08:07.513315+0000 mon.a (mon.0) 3666 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:08:08.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:08 gibba013 bash[29418]: audit 2021-03-10T17:08:07.513477+0000 mon.a (mon.0) 3667 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:08:08.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:08 gibba013 bash[29418]: audit 2021-03-10T17:08:07.513646+0000 mon.a (mon.0) 3668 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:08:08.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:08 gibba013 bash[30381]: cluster 2021-03-10T17:08:06.991387+0000 mgr.gibba020.yqfnwy (mgr.34427) 10284 : cluster [DBG] pgmap v5861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:08.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:08 gibba013 bash[30381]: audit 2021-03-10T17:08:07.513124+0000 mon.a (mon.0) 3665 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T17:08:08.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:08 gibba013 bash[30381]: audit 2021-03-10T17:08:07.513315+0000 mon.a (mon.0) 3666 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:08:08.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:08 gibba013 bash[30381]: audit 2021-03-10T17:08:07.513477+0000 mon.a (mon.0) 3667 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:08:08.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:08 gibba013 bash[30381]: audit 2021-03-10T17:08:07.513646+0000 mon.a (mon.0) 3668 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:08:08.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:08 gibba020 bash[25448]: cluster 2021-03-10T17:08:06.991387+0000 mgr.gibba020.yqfnwy (mgr.34427) 10284 : cluster [DBG] pgmap v5861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:08.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:08 gibba020 bash[25448]: audit 2021-03-10T17:08:07.513124+0000 mon.a (mon.0) 3665 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T17:08:08.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:08 gibba020 bash[25448]: audit 2021-03-10T17:08:07.513315+0000 mon.a (mon.0) 3666 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:08:08.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:08 gibba020 bash[25448]: audit 2021-03-10T17:08:07.513477+0000 mon.a (mon.0) 3667 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:08:08.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:08 gibba020 bash[25448]: audit 2021-03-10T17:08:07.513646+0000 mon.a (mon.0) 3668 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:08:10.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:10 gibba013 bash[29418]: cluster 2021-03-10T17:08:08.993096+0000 mgr.gibba020.yqfnwy (mgr.34427) 10285 : cluster [DBG] pgmap v5862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:10.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:10 gibba013 bash[30381]: cluster 2021-03-10T17:08:08.993096+0000 mgr.gibba020.yqfnwy (mgr.34427) 10285 : cluster [DBG] pgmap v5862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:10.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:10 gibba020 bash[25448]: cluster 2021-03-10T17:08:08.993096+0000 mgr.gibba020.yqfnwy (mgr.34427) 10285 : cluster [DBG] pgmap v5862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:11.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:11 gibba013 bash[29418]: cephadm 2021-03-10T17:08:10.056052+0000 mgr.gibba020.yqfnwy (mgr.34427) 10286 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:08:11.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:11 gibba013 bash[30381]: cephadm 2021-03-10T17:08:10.056052+0000 mgr.gibba020.yqfnwy (mgr.34427) 10286 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:08:11.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:11 gibba020 bash[25448]: cephadm 2021-03-10T17:08:10.056052+0000 mgr.gibba020.yqfnwy (mgr.34427) 10286 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:08:12.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:12 gibba013 bash[29418]: cluster 2021-03-10T17:08:10.994899+0000 mgr.gibba020.yqfnwy (mgr.34427) 10287 : cluster [DBG] pgmap v5863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:12.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:12 gibba013 bash[30381]: cluster 2021-03-10T17:08:10.994899+0000 mgr.gibba020.yqfnwy (mgr.34427) 10287 : cluster [DBG] pgmap v5863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:12.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:12 gibba020 bash[25448]: cluster 2021-03-10T17:08:10.994899+0000 mgr.gibba020.yqfnwy (mgr.34427) 10287 : cluster [DBG] pgmap v5863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:14.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:14 gibba013 bash[29418]: cluster 2021-03-10T17:08:12.996178+0000 mgr.gibba020.yqfnwy (mgr.34427) 10288 : cluster [DBG] pgmap v5864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:14.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:14 gibba013 bash[30381]: cluster 2021-03-10T17:08:12.996178+0000 mgr.gibba020.yqfnwy (mgr.34427) 10288 : cluster [DBG] pgmap v5864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:14.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:14 gibba020 bash[25448]: cluster 2021-03-10T17:08:12.996178+0000 mgr.gibba020.yqfnwy (mgr.34427) 10288 : cluster [DBG] pgmap v5864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:16.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:16 gibba013 bash[29418]: cluster 2021-03-10T17:08:14.997711+0000 mgr.gibba020.yqfnwy (mgr.34427) 10289 : cluster [DBG] pgmap v5865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:16.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:16 gibba013 bash[30381]: cluster 2021-03-10T17:08:14.997711+0000 mgr.gibba020.yqfnwy (mgr.34427) 10289 : cluster [DBG] pgmap v5865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:16.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:16 gibba020 bash[25448]: cluster 2021-03-10T17:08:14.997711+0000 mgr.gibba020.yqfnwy (mgr.34427) 10289 : cluster [DBG] pgmap v5865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:17.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:17 gibba013 bash[29418]: cluster 2021-03-10T17:08:16.998993+0000 mgr.gibba020.yqfnwy (mgr.34427) 10290 : cluster [DBG] pgmap v5866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:17.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:17 gibba013 bash[30381]: cluster 2021-03-10T17:08:16.998993+0000 mgr.gibba020.yqfnwy (mgr.34427) 10290 : cluster [DBG] pgmap v5866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:17.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:17 gibba020 bash[25448]: cluster 2021-03-10T17:08:16.998993+0000 mgr.gibba020.yqfnwy (mgr.34427) 10290 : cluster [DBG] pgmap v5866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:20.379 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:20 gibba013 bash[29418]: cluster 2021-03-10T17:08:19.000615+0000 mgr.gibba020.yqfnwy (mgr.34427) 10291 : cluster [DBG] pgmap v5867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:20.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:20 gibba013 bash[30381]: cluster 2021-03-10T17:08:19.000615+0000 mgr.gibba020.yqfnwy (mgr.34427) 10291 : cluster [DBG] pgmap v5867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:20.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:20 gibba020 bash[25448]: cluster 2021-03-10T17:08:19.000615+0000 mgr.gibba020.yqfnwy (mgr.34427) 10291 : cluster [DBG] pgmap v5867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:22.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:22 gibba013 bash[29418]: cluster 2021-03-10T17:08:21.002426+0000 mgr.gibba020.yqfnwy (mgr.34427) 10292 : cluster [DBG] pgmap v5868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:22.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:22 gibba013 bash[30381]: cluster 2021-03-10T17:08:21.002426+0000 mgr.gibba020.yqfnwy (mgr.34427) 10292 : cluster [DBG] pgmap v5868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:22.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:22 gibba020 bash[25448]: cluster 2021-03-10T17:08:21.002426+0000 mgr.gibba020.yqfnwy (mgr.34427) 10292 : cluster [DBG] pgmap v5868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:24.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:24 gibba013 bash[29418]: cluster 2021-03-10T17:08:23.003777+0000 mgr.gibba020.yqfnwy (mgr.34427) 10293 : cluster [DBG] pgmap v5869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:24.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:24 gibba013 bash[30381]: cluster 2021-03-10T17:08:23.003777+0000 mgr.gibba020.yqfnwy (mgr.34427) 10293 : cluster [DBG] pgmap v5869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:24.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:24 gibba020 bash[25448]: cluster 2021-03-10T17:08:23.003777+0000 mgr.gibba020.yqfnwy (mgr.34427) 10293 : cluster [DBG] pgmap v5869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:25.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:25 gibba013 bash[29418]: audit 2021-03-10T17:08:25.073079+0000 mon.a (mon.0) 3669 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:08:25.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:25 gibba013 bash[29418]: audit 2021-03-10T17:08:25.268032+0000 mon.a (mon.0) 3670 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:08:25.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:25 gibba013 bash[29418]: audit 2021-03-10T17:08:25.271953+0000 mon.a (mon.0) 3671 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:08:25.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:25 gibba013 bash[29418]: audit 2021-03-10T17:08:25.459820+0000 mon.a (mon.0) 3672 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:08:25.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:25 gibba013 bash[29418]: audit 2021-03-10T17:08:25.463267+0000 mon.a (mon.0) 3673 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:08:25.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:25 gibba013 bash[29418]: audit 2021-03-10T17:08:25.465052+0000 mon.a (mon.0) 3674 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:25.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:25 gibba013 bash[29418]: audit 2021-03-10T17:08:25.466663+0000 mon.a (mon.0) 3675 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:25.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:25 gibba013 bash[30381]: audit 2021-03-10T17:08:25.073079+0000 mon.a (mon.0) 3669 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:08:25.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:25 gibba013 bash[30381]: audit 2021-03-10T17:08:25.268032+0000 mon.a (mon.0) 3670 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:08:25.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:25 gibba013 bash[30381]: audit 2021-03-10T17:08:25.271953+0000 mon.a (mon.0) 3671 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:08:25.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:25 gibba013 bash[30381]: audit 2021-03-10T17:08:25.459820+0000 mon.a (mon.0) 3672 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:08:25.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:25 gibba013 bash[30381]: audit 2021-03-10T17:08:25.463267+0000 mon.a (mon.0) 3673 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:08:25.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:25 gibba013 bash[30381]: audit 2021-03-10T17:08:25.465052+0000 mon.a (mon.0) 3674 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:25.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:25 gibba013 bash[30381]: audit 2021-03-10T17:08:25.466663+0000 mon.a (mon.0) 3675 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:25.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:25 gibba020 bash[25448]: audit 2021-03-10T17:08:25.073079+0000 mon.a (mon.0) 3669 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:08:25.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:25 gibba020 bash[25448]: audit 2021-03-10T17:08:25.268032+0000 mon.a (mon.0) 3670 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:08:25.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:25 gibba020 bash[25448]: audit 2021-03-10T17:08:25.271953+0000 mon.a (mon.0) 3671 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:08:25.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:25 gibba020 bash[25448]: audit 2021-03-10T17:08:25.459820+0000 mon.a (mon.0) 3672 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:08:25.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:25 gibba020 bash[25448]: audit 2021-03-10T17:08:25.463267+0000 mon.a (mon.0) 3673 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:08:25.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:25 gibba020 bash[25448]: audit 2021-03-10T17:08:25.465052+0000 mon.a (mon.0) 3674 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:25.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:25 gibba020 bash[25448]: audit 2021-03-10T17:08:25.466663+0000 mon.a (mon.0) 3675 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:26.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:26 gibba013 bash[29418]: cluster 2021-03-10T17:08:25.005577+0000 mgr.gibba020.yqfnwy (mgr.34427) 10294 : cluster [DBG] pgmap v5870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:26.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:26 gibba013 bash[29418]: cephadm 2021-03-10T17:08:25.268086+0000 mgr.gibba020.yqfnwy (mgr.34427) 10295 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:08:26.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:26 gibba013 bash[29418]: cephadm 2021-03-10T17:08:25.271926+0000 mgr.gibba020.yqfnwy (mgr.34427) 10296 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:08:26.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:26 gibba013 bash[29418]: cephadm 2021-03-10T17:08:25.461934+0000 mgr.gibba020.yqfnwy (mgr.34427) 10297 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:08:26.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:26 gibba013 bash[29418]: cephadm 2021-03-10T17:08:25.464022+0000 mgr.gibba020.yqfnwy (mgr.34427) 10298 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:08:26.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:26 gibba013 bash[29418]: cephadm 2021-03-10T17:08:25.465604+0000 mgr.gibba020.yqfnwy (mgr.34427) 10299 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:08:26.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:26 gibba013 bash[29418]: cephadm 2021-03-10T17:08:25.465639+0000 mgr.gibba020.yqfnwy (mgr.34427) 10300 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:08:26.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:26 gibba013 bash[29418]: cephadm 2021-03-10T17:08:25.467750+0000 mgr.gibba020.yqfnwy (mgr.34427) 10301 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:08:26.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:26 gibba013 bash[29418]: cephadm 2021-03-10T17:08:25.467811+0000 mgr.gibba020.yqfnwy (mgr.34427) 10302 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:08:26.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:26 gibba013 bash[29418]: audit 2021-03-10T17:08:25.468556+0000 mon.a (mon.0) 3676 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:26.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:26 gibba013 bash[29418]: cephadm 2021-03-10T17:08:25.470373+0000 mgr.gibba020.yqfnwy (mgr.34427) 10303 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:08:26.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:26 gibba013 bash[29418]: cephadm 2021-03-10T17:08:25.472713+0000 mgr.gibba020.yqfnwy (mgr.34427) 10304 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:08:26.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:26 gibba013 bash[29418]: cephadm 2021-03-10T17:08:25.472753+0000 mgr.gibba020.yqfnwy (mgr.34427) 10305 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:08:26.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:26 gibba013 bash[29418]: audit 2021-03-10T17:08:25.473614+0000 mon.a (mon.0) 3677 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:26.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:26 gibba013 bash[29418]: cephadm 2021-03-10T17:08:25.473960+0000 mgr.gibba020.yqfnwy (mgr.34427) 10306 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:08:26.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:26 gibba013 bash[29418]: cephadm 2021-03-10T17:08:25.474310+0000 mgr.gibba020.yqfnwy (mgr.34427) 10307 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:08:26.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:26 gibba013 bash[29418]: audit 2021-03-10T17:08:25.475105+0000 mon.a (mon.0) 3678 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:26.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:26 gibba013 bash[29418]: cephadm 2021-03-10T17:08:25.475427+0000 mgr.gibba020.yqfnwy (mgr.34427) 10308 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:08:26.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:26 gibba013 bash[29418]: cephadm 2021-03-10T17:08:25.475467+0000 mgr.gibba020.yqfnwy (mgr.34427) 10309 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:08:26.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:26 gibba013 bash[29418]: cephadm 2021-03-10T17:08:25.475576+0000 mgr.gibba020.yqfnwy (mgr.34427) 10310 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:08:26.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:26 gibba013 bash[30381]: cluster 2021-03-10T17:08:25.005577+0000 mgr.gibba020.yqfnwy (mgr.34427) 10294 : cluster [DBG] pgmap v5870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:26.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:26 gibba013 bash[30381]: cephadm 2021-03-10T17:08:25.268086+0000 mgr.gibba020.yqfnwy (mgr.34427) 10295 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:08:26.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:26 gibba013 bash[30381]: cephadm 2021-03-10T17:08:25.271926+0000 mgr.gibba020.yqfnwy (mgr.34427) 10296 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:08:26.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:26 gibba013 bash[30381]: cephadm 2021-03-10T17:08:25.461934+0000 mgr.gibba020.yqfnwy (mgr.34427) 10297 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:08:26.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:26 gibba013 bash[30381]: cephadm 2021-03-10T17:08:25.464022+0000 mgr.gibba020.yqfnwy (mgr.34427) 10298 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:08:26.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:26 gibba013 bash[30381]: cephadm 2021-03-10T17:08:25.465604+0000 mgr.gibba020.yqfnwy (mgr.34427) 10299 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:08:26.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:26 gibba013 bash[30381]: cephadm 2021-03-10T17:08:25.465639+0000 mgr.gibba020.yqfnwy (mgr.34427) 10300 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:08:26.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:26 gibba013 bash[30381]: cephadm 2021-03-10T17:08:25.467750+0000 mgr.gibba020.yqfnwy (mgr.34427) 10301 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:08:26.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:26 gibba013 bash[30381]: cephadm 2021-03-10T17:08:25.467811+0000 mgr.gibba020.yqfnwy (mgr.34427) 10302 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:08:26.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:26 gibba013 bash[30381]: audit 2021-03-10T17:08:25.468556+0000 mon.a (mon.0) 3676 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:26.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:26 gibba013 bash[30381]: cephadm 2021-03-10T17:08:25.470373+0000 mgr.gibba020.yqfnwy (mgr.34427) 10303 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:08:26.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:26 gibba013 bash[30381]: cephadm 2021-03-10T17:08:25.472713+0000 mgr.gibba020.yqfnwy (mgr.34427) 10304 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:08:26.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:26 gibba013 bash[30381]: cephadm 2021-03-10T17:08:25.472753+0000 mgr.gibba020.yqfnwy (mgr.34427) 10305 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:08:26.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:26 gibba013 bash[30381]: audit 2021-03-10T17:08:25.473614+0000 mon.a (mon.0) 3677 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:26.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:26 gibba013 bash[30381]: cephadm 2021-03-10T17:08:25.473960+0000 mgr.gibba020.yqfnwy (mgr.34427) 10306 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:08:26.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:26 gibba013 bash[30381]: cephadm 2021-03-10T17:08:25.474310+0000 mgr.gibba020.yqfnwy (mgr.34427) 10307 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:08:26.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:26 gibba013 bash[30381]: audit 2021-03-10T17:08:25.475105+0000 mon.a (mon.0) 3678 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:26.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:26 gibba013 bash[30381]: cephadm 2021-03-10T17:08:25.475427+0000 mgr.gibba020.yqfnwy (mgr.34427) 10308 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:08:26.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:26 gibba013 bash[30381]: cephadm 2021-03-10T17:08:25.475467+0000 mgr.gibba020.yqfnwy (mgr.34427) 10309 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:08:26.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:26 gibba013 bash[30381]: cephadm 2021-03-10T17:08:25.475576+0000 mgr.gibba020.yqfnwy (mgr.34427) 10310 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:08:26.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:26 gibba020 bash[25448]: cluster 2021-03-10T17:08:25.005577+0000 mgr.gibba020.yqfnwy (mgr.34427) 10294 : cluster [DBG] pgmap v5870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:26.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:26 gibba020 bash[25448]: cephadm 2021-03-10T17:08:25.268086+0000 mgr.gibba020.yqfnwy (mgr.34427) 10295 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:08:26.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:26 gibba020 bash[25448]: cephadm 2021-03-10T17:08:25.271926+0000 mgr.gibba020.yqfnwy (mgr.34427) 10296 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:08:26.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:26 gibba020 bash[25448]: cephadm 2021-03-10T17:08:25.461934+0000 mgr.gibba020.yqfnwy (mgr.34427) 10297 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:08:26.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:26 gibba020 bash[25448]: cephadm 2021-03-10T17:08:25.464022+0000 mgr.gibba020.yqfnwy (mgr.34427) 10298 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:08:26.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:26 gibba020 bash[25448]: cephadm 2021-03-10T17:08:25.465604+0000 mgr.gibba020.yqfnwy (mgr.34427) 10299 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:08:26.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:26 gibba020 bash[25448]: cephadm 2021-03-10T17:08:25.465639+0000 mgr.gibba020.yqfnwy (mgr.34427) 10300 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:08:26.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:26 gibba020 bash[25448]: cephadm 2021-03-10T17:08:25.467750+0000 mgr.gibba020.yqfnwy (mgr.34427) 10301 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:08:26.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:26 gibba020 bash[25448]: cephadm 2021-03-10T17:08:25.467811+0000 mgr.gibba020.yqfnwy (mgr.34427) 10302 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:08:26.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:26 gibba020 bash[25448]: audit 2021-03-10T17:08:25.468556+0000 mon.a (mon.0) 3676 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:26.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:26 gibba020 bash[25448]: cephadm 2021-03-10T17:08:25.470373+0000 mgr.gibba020.yqfnwy (mgr.34427) 10303 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:08:26.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:26 gibba020 bash[25448]: cephadm 2021-03-10T17:08:25.472713+0000 mgr.gibba020.yqfnwy (mgr.34427) 10304 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:08:26.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:26 gibba020 bash[25448]: cephadm 2021-03-10T17:08:25.472753+0000 mgr.gibba020.yqfnwy (mgr.34427) 10305 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:08:26.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:26 gibba020 bash[25448]: audit 2021-03-10T17:08:25.473614+0000 mon.a (mon.0) 3677 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:26.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:26 gibba020 bash[25448]: cephadm 2021-03-10T17:08:25.473960+0000 mgr.gibba020.yqfnwy (mgr.34427) 10306 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:08:26.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:26 gibba020 bash[25448]: cephadm 2021-03-10T17:08:25.474310+0000 mgr.gibba020.yqfnwy (mgr.34427) 10307 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:08:26.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:26 gibba020 bash[25448]: audit 2021-03-10T17:08:25.475105+0000 mon.a (mon.0) 3678 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:26.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:26 gibba020 bash[25448]: cephadm 2021-03-10T17:08:25.475427+0000 mgr.gibba020.yqfnwy (mgr.34427) 10308 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:08:26.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:26 gibba020 bash[25448]: cephadm 2021-03-10T17:08:25.475467+0000 mgr.gibba020.yqfnwy (mgr.34427) 10309 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:08:26.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:26 gibba020 bash[25448]: cephadm 2021-03-10T17:08:25.475576+0000 mgr.gibba020.yqfnwy (mgr.34427) 10310 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:08:28.616 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:08:28.846 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:08:28.847 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 7m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:08:28.847 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 6m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:08:28.847 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:08:28.847 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:08:28.848 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:08:28.848 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:08:28.848 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:08:28.848 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:08:28.848 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:08:28.849 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:08:28.849 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:08:28.849 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:08:28.849 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:08:28.850 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:08:28.850 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:08:28.850 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:08:28.850 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:08:28.850 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:08:28.851 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 6m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:08:28.851 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 6m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:08:28.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:28 gibba013 bash[29418]: cluster 2021-03-10T17:08:27.007008+0000 mgr.gibba020.yqfnwy (mgr.34427) 10311 : cluster [DBG] pgmap v5871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:28.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:28 gibba013 bash[30381]: cluster 2021-03-10T17:08:27.007008+0000 mgr.gibba020.yqfnwy (mgr.34427) 10311 : cluster [DBG] pgmap v5871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:28.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:28 gibba020 bash[25448]: cluster 2021-03-10T17:08:27.007008+0000 mgr.gibba020.yqfnwy (mgr.34427) 10311 : cluster [DBG] pgmap v5871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:29.097 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:08:29.097 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:08:29.098 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:08:29.098 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:08:29.098 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:08:29.098 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:08:29.099 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:08:29.099 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:08:29.099 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:08:29.099 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:08:29.099 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:08:29.100 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:08:29.100 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:08:29.100 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:08:29.100 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:08:29.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:29 gibba013 bash[29418]: audit 2021-03-10T17:08:29.096586+0000 mon.c (mon.1) 157 : audit [DBG] from='client.? 172.21.2.113:0/3166848856' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:29.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:29 gibba013 bash[30381]: audit 2021-03-10T17:08:29.096586+0000 mon.c (mon.1) 157 : audit [DBG] from='client.? 172.21.2.113:0/3166848856' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:29.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:29 gibba020 bash[25448]: audit 2021-03-10T17:08:29.096586+0000 mon.c (mon.1) 157 : audit [DBG] from='client.? 172.21.2.113:0/3166848856' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:08:30.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:30 gibba013 bash[29418]: audit 2021-03-10T17:08:28.605802+0000 mgr.gibba020.yqfnwy (mgr.34427) 10312 : audit [DBG] from='client.60943 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:08:30.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:30 gibba013 bash[29418]: audit 2021-03-10T17:08:28.832460+0000 mgr.gibba020.yqfnwy (mgr.34427) 10313 : audit [DBG] from='client.50970 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:08:30.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:30 gibba013 bash[29418]: cluster 2021-03-10T17:08:29.008675+0000 mgr.gibba020.yqfnwy (mgr.34427) 10314 : cluster [DBG] pgmap v5872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:30.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:30 gibba013 bash[30381]: audit 2021-03-10T17:08:28.605802+0000 mgr.gibba020.yqfnwy (mgr.34427) 10312 : audit [DBG] from='client.60943 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:08:30.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:30 gibba013 bash[30381]: audit 2021-03-10T17:08:28.832460+0000 mgr.gibba020.yqfnwy (mgr.34427) 10313 : audit [DBG] from='client.50970 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:08:30.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:30 gibba013 bash[30381]: cluster 2021-03-10T17:08:29.008675+0000 mgr.gibba020.yqfnwy (mgr.34427) 10314 : cluster [DBG] pgmap v5872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:30.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:30 gibba020 bash[25448]: audit 2021-03-10T17:08:28.605802+0000 mgr.gibba020.yqfnwy (mgr.34427) 10312 : audit [DBG] from='client.60943 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:08:30.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:30 gibba020 bash[25448]: audit 2021-03-10T17:08:28.832460+0000 mgr.gibba020.yqfnwy (mgr.34427) 10313 : audit [DBG] from='client.50970 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:08:30.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:30 gibba020 bash[25448]: cluster 2021-03-10T17:08:29.008675+0000 mgr.gibba020.yqfnwy (mgr.34427) 10314 : cluster [DBG] pgmap v5872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:32.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:32 gibba013 bash[29418]: cluster 2021-03-10T17:08:31.010537+0000 mgr.gibba020.yqfnwy (mgr.34427) 10315 : cluster [DBG] pgmap v5873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:32.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:32 gibba013 bash[30381]: cluster 2021-03-10T17:08:31.010537+0000 mgr.gibba020.yqfnwy (mgr.34427) 10315 : cluster [DBG] pgmap v5873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:32.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:32 gibba020 bash[25448]: cluster 2021-03-10T17:08:31.010537+0000 mgr.gibba020.yqfnwy (mgr.34427) 10315 : cluster [DBG] pgmap v5873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:34.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:34 gibba013 bash[29418]: cluster 2021-03-10T17:08:33.011805+0000 mgr.gibba020.yqfnwy (mgr.34427) 10316 : cluster [DBG] pgmap v5874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:34.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:34 gibba013 bash[30381]: cluster 2021-03-10T17:08:33.011805+0000 mgr.gibba020.yqfnwy (mgr.34427) 10316 : cluster [DBG] pgmap v5874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:34.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:34 gibba020 bash[25448]: cluster 2021-03-10T17:08:33.011805+0000 mgr.gibba020.yqfnwy (mgr.34427) 10316 : cluster [DBG] pgmap v5874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:36.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:36 gibba013 bash[29418]: cluster 2021-03-10T17:08:35.013498+0000 mgr.gibba020.yqfnwy (mgr.34427) 10317 : cluster [DBG] pgmap v5875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:36.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:36 gibba013 bash[30381]: cluster 2021-03-10T17:08:35.013498+0000 mgr.gibba020.yqfnwy (mgr.34427) 10317 : cluster [DBG] pgmap v5875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:36.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:36 gibba020 bash[25448]: cluster 2021-03-10T17:08:35.013498+0000 mgr.gibba020.yqfnwy (mgr.34427) 10317 : cluster [DBG] pgmap v5875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:38.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:38 gibba013 bash[29418]: cluster 2021-03-10T17:08:37.014919+0000 mgr.gibba020.yqfnwy (mgr.34427) 10318 : cluster [DBG] pgmap v5876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:38.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:38 gibba013 bash[30381]: cluster 2021-03-10T17:08:37.014919+0000 mgr.gibba020.yqfnwy (mgr.34427) 10318 : cluster [DBG] pgmap v5876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:38.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:38 gibba020 bash[25448]: cluster 2021-03-10T17:08:37.014919+0000 mgr.gibba020.yqfnwy (mgr.34427) 10318 : cluster [DBG] pgmap v5876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:40.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:40 gibba013 bash[29418]: cluster 2021-03-10T17:08:39.016660+0000 mgr.gibba020.yqfnwy (mgr.34427) 10319 : cluster [DBG] pgmap v5877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:40.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:40 gibba013 bash[30381]: cluster 2021-03-10T17:08:39.016660+0000 mgr.gibba020.yqfnwy (mgr.34427) 10319 : cluster [DBG] pgmap v5877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:40.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:40 gibba020 bash[25448]: cluster 2021-03-10T17:08:39.016660+0000 mgr.gibba020.yqfnwy (mgr.34427) 10319 : cluster [DBG] pgmap v5877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:41.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:41 gibba013 bash[29418]: cephadm 2021-03-10T17:08:40.488410+0000 mgr.gibba020.yqfnwy (mgr.34427) 10320 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:08:41.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:41 gibba013 bash[30381]: cephadm 2021-03-10T17:08:40.488410+0000 mgr.gibba020.yqfnwy (mgr.34427) 10320 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:08:41.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:41 gibba020 bash[25448]: cephadm 2021-03-10T17:08:40.488410+0000 mgr.gibba020.yqfnwy (mgr.34427) 10320 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:08:42.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:42 gibba013 bash[29418]: cluster 2021-03-10T17:08:41.018417+0000 mgr.gibba020.yqfnwy (mgr.34427) 10321 : cluster [DBG] pgmap v5878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:42.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:42 gibba013 bash[30381]: cluster 2021-03-10T17:08:41.018417+0000 mgr.gibba020.yqfnwy (mgr.34427) 10321 : cluster [DBG] pgmap v5878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:42.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:42 gibba020 bash[25448]: cluster 2021-03-10T17:08:41.018417+0000 mgr.gibba020.yqfnwy (mgr.34427) 10321 : cluster [DBG] pgmap v5878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:43.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:43 gibba013 bash[29418]: cluster 2021-03-10T17:08:43.019796+0000 mgr.gibba020.yqfnwy (mgr.34427) 10322 : cluster [DBG] pgmap v5879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:43.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:43 gibba013 bash[30381]: cluster 2021-03-10T17:08:43.019796+0000 mgr.gibba020.yqfnwy (mgr.34427) 10322 : cluster [DBG] pgmap v5879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:43.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:43 gibba020 bash[25448]: cluster 2021-03-10T17:08:43.019796+0000 mgr.gibba020.yqfnwy (mgr.34427) 10322 : cluster [DBG] pgmap v5879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:46.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:46 gibba013 bash[29418]: cluster 2021-03-10T17:08:45.021456+0000 mgr.gibba020.yqfnwy (mgr.34427) 10323 : cluster [DBG] pgmap v5880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:46.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:46 gibba013 bash[30381]: cluster 2021-03-10T17:08:45.021456+0000 mgr.gibba020.yqfnwy (mgr.34427) 10323 : cluster [DBG] pgmap v5880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:46.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:46 gibba020 bash[25448]: cluster 2021-03-10T17:08:45.021456+0000 mgr.gibba020.yqfnwy (mgr.34427) 10323 : cluster [DBG] pgmap v5880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:48.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:48 gibba013 bash[29418]: cluster 2021-03-10T17:08:47.022825+0000 mgr.gibba020.yqfnwy (mgr.34427) 10324 : cluster [DBG] pgmap v5881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:48.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:48 gibba013 bash[30381]: cluster 2021-03-10T17:08:47.022825+0000 mgr.gibba020.yqfnwy (mgr.34427) 10324 : cluster [DBG] pgmap v5881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:48.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:48 gibba020 bash[25448]: cluster 2021-03-10T17:08:47.022825+0000 mgr.gibba020.yqfnwy (mgr.34427) 10324 : cluster [DBG] pgmap v5881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:50.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:50 gibba013 bash[29418]: cluster 2021-03-10T17:08:49.024513+0000 mgr.gibba020.yqfnwy (mgr.34427) 10325 : cluster [DBG] pgmap v5882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:50.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:50 gibba013 bash[30381]: cluster 2021-03-10T17:08:49.024513+0000 mgr.gibba020.yqfnwy (mgr.34427) 10325 : cluster [DBG] pgmap v5882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:50.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:50 gibba020 bash[25448]: cluster 2021-03-10T17:08:49.024513+0000 mgr.gibba020.yqfnwy (mgr.34427) 10325 : cluster [DBG] pgmap v5882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:52.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:52 gibba013 bash[29418]: cluster 2021-03-10T17:08:51.026346+0000 mgr.gibba020.yqfnwy (mgr.34427) 10326 : cluster [DBG] pgmap v5883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:52.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:52 gibba013 bash[30381]: cluster 2021-03-10T17:08:51.026346+0000 mgr.gibba020.yqfnwy (mgr.34427) 10326 : cluster [DBG] pgmap v5883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:52.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:52 gibba020 bash[25448]: cluster 2021-03-10T17:08:51.026346+0000 mgr.gibba020.yqfnwy (mgr.34427) 10326 : cluster [DBG] pgmap v5883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:54.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:54 gibba013 bash[29418]: cluster 2021-03-10T17:08:53.027653+0000 mgr.gibba020.yqfnwy (mgr.34427) 10327 : cluster [DBG] pgmap v5884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:54.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:54 gibba013 bash[30381]: cluster 2021-03-10T17:08:53.027653+0000 mgr.gibba020.yqfnwy (mgr.34427) 10327 : cluster [DBG] pgmap v5884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:54.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:54 gibba020 bash[25448]: cluster 2021-03-10T17:08:53.027653+0000 mgr.gibba020.yqfnwy (mgr.34427) 10327 : cluster [DBG] pgmap v5884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:56.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:56 gibba013 bash[29418]: cluster 2021-03-10T17:08:55.029597+0000 mgr.gibba020.yqfnwy (mgr.34427) 10328 : cluster [DBG] pgmap v5885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:56.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:56 gibba013 bash[29418]: cephadm 2021-03-10T17:08:55.503676+0000 mgr.gibba020.yqfnwy (mgr.34427) 10329 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:08:56.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:56 gibba013 bash[30381]: cluster 2021-03-10T17:08:55.029597+0000 mgr.gibba020.yqfnwy (mgr.34427) 10328 : cluster [DBG] pgmap v5885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:56.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:56 gibba013 bash[30381]: cephadm 2021-03-10T17:08:55.503676+0000 mgr.gibba020.yqfnwy (mgr.34427) 10329 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:08:56.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:56 gibba020 bash[25448]: cluster 2021-03-10T17:08:55.029597+0000 mgr.gibba020.yqfnwy (mgr.34427) 10328 : cluster [DBG] pgmap v5885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:56.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:56 gibba020 bash[25448]: cephadm 2021-03-10T17:08:55.503676+0000 mgr.gibba020.yqfnwy (mgr.34427) 10329 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:08:58.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:08:58 gibba013 bash[29418]: cluster 2021-03-10T17:08:57.030804+0000 mgr.gibba020.yqfnwy (mgr.34427) 10330 : cluster [DBG] pgmap v5886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:58.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:08:58 gibba013 bash[30381]: cluster 2021-03-10T17:08:57.030804+0000 mgr.gibba020.yqfnwy (mgr.34427) 10330 : cluster [DBG] pgmap v5886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:58.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:08:58 gibba020 bash[25448]: cluster 2021-03-10T17:08:57.030804+0000 mgr.gibba020.yqfnwy (mgr.34427) 10330 : cluster [DBG] pgmap v5886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:08:59.340 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:08:59.566 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:08:59.567 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 7m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:08:59.567 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 6m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:08:59.567 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:08:59.567 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:08:59.568 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:08:59.568 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:08:59.568 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:08:59.568 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:08:59.569 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:08:59.569 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:08:59.569 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:08:59.569 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:08:59.569 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:08:59.570 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:08:59.570 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:08:59.570 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:08:59.570 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:08:59.570 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:08:59.571 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 6m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:08:59.571 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 6m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:08:59.815 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:08:59.815 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:08:59.815 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:08:59.816 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:08:59.816 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:08:59.816 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:08:59.817 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:08:59.817 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:08:59.817 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:08:59.817 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:08:59.818 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:08:59.818 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:08:59.818 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:08:59.818 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:08:59.819 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:09:00.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:00 gibba013 bash[29418]: cluster 2021-03-10T17:08:59.032387+0000 mgr.gibba020.yqfnwy (mgr.34427) 10331 : cluster [DBG] pgmap v5887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:00.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:00 gibba013 bash[29418]: audit 2021-03-10T17:08:59.330027+0000 mgr.gibba020.yqfnwy (mgr.34427) 10332 : audit [DBG] from='client.60961 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:09:00.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:00 gibba013 bash[29418]: audit 2021-03-10T17:08:59.555783+0000 mgr.gibba020.yqfnwy (mgr.34427) 10333 : audit [DBG] from='client.60967 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:09:00.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:00 gibba013 bash[29418]: audit 2021-03-10T17:08:59.814137+0000 mon.a (mon.0) 3679 : audit [DBG] from='client.? 172.21.2.113:0/2875579640' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:00.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:00 gibba013 bash[30381]: cluster 2021-03-10T17:08:59.032387+0000 mgr.gibba020.yqfnwy (mgr.34427) 10331 : cluster [DBG] pgmap v5887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:00.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:00 gibba013 bash[30381]: audit 2021-03-10T17:08:59.330027+0000 mgr.gibba020.yqfnwy (mgr.34427) 10332 : audit [DBG] from='client.60961 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:09:00.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:00 gibba013 bash[30381]: audit 2021-03-10T17:08:59.555783+0000 mgr.gibba020.yqfnwy (mgr.34427) 10333 : audit [DBG] from='client.60967 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:09:00.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:00 gibba013 bash[30381]: audit 2021-03-10T17:08:59.814137+0000 mon.a (mon.0) 3679 : audit [DBG] from='client.? 172.21.2.113:0/2875579640' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:00.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:00 gibba020 bash[25448]: cluster 2021-03-10T17:08:59.032387+0000 mgr.gibba020.yqfnwy (mgr.34427) 10331 : cluster [DBG] pgmap v5887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:00.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:00 gibba020 bash[25448]: audit 2021-03-10T17:08:59.330027+0000 mgr.gibba020.yqfnwy (mgr.34427) 10332 : audit [DBG] from='client.60961 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:09:00.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:00 gibba020 bash[25448]: audit 2021-03-10T17:08:59.555783+0000 mgr.gibba020.yqfnwy (mgr.34427) 10333 : audit [DBG] from='client.60967 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:09:00.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:00 gibba020 bash[25448]: audit 2021-03-10T17:08:59.814137+0000 mon.a (mon.0) 3679 : audit [DBG] from='client.? 172.21.2.113:0/2875579640' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:02.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:02 gibba013 bash[29418]: cluster 2021-03-10T17:09:01.034240+0000 mgr.gibba020.yqfnwy (mgr.34427) 10334 : cluster [DBG] pgmap v5888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:02.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:02 gibba013 bash[30381]: cluster 2021-03-10T17:09:01.034240+0000 mgr.gibba020.yqfnwy (mgr.34427) 10334 : cluster [DBG] pgmap v5888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:02.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:02 gibba020 bash[25448]: cluster 2021-03-10T17:09:01.034240+0000 mgr.gibba020.yqfnwy (mgr.34427) 10334 : cluster [DBG] pgmap v5888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:04.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:04 gibba013 bash[29418]: cluster 2021-03-10T17:09:03.035664+0000 mgr.gibba020.yqfnwy (mgr.34427) 10335 : cluster [DBG] pgmap v5889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:04.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:04 gibba013 bash[30381]: cluster 2021-03-10T17:09:03.035664+0000 mgr.gibba020.yqfnwy (mgr.34427) 10335 : cluster [DBG] pgmap v5889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:04.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:04 gibba020 bash[25448]: cluster 2021-03-10T17:09:03.035664+0000 mgr.gibba020.yqfnwy (mgr.34427) 10335 : cluster [DBG] pgmap v5889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:06.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:06 gibba013 bash[29418]: cluster 2021-03-10T17:09:05.037717+0000 mgr.gibba020.yqfnwy (mgr.34427) 10336 : cluster [DBG] pgmap v5890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:06.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:06 gibba013 bash[30381]: cluster 2021-03-10T17:09:05.037717+0000 mgr.gibba020.yqfnwy (mgr.34427) 10336 : cluster [DBG] pgmap v5890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:06.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:06 gibba020 bash[25448]: cluster 2021-03-10T17:09:05.037717+0000 mgr.gibba020.yqfnwy (mgr.34427) 10336 : cluster [DBG] pgmap v5890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:07.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:07 gibba013 bash[29418]: audit 2021-03-10T17:09:06.904991+0000 mon.a (mon.0) 3680 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:09:07.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:07 gibba013 bash[29418]: audit 2021-03-10T17:09:07.113865+0000 mon.a (mon.0) 3681 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:09:07.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:07 gibba013 bash[29418]: audit 2021-03-10T17:09:07.521119+0000 mon.a (mon.0) 3682 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:09:07.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:07 gibba013 bash[29418]: audit 2021-03-10T17:09:07.521930+0000 mon.a (mon.0) 3683 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T17:09:07.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:07 gibba013 bash[29418]: audit 2021-03-10T17:09:07.522762+0000 mon.a (mon.0) 3684 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:09:07.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:07 gibba013 bash[29418]: audit 2021-03-10T17:09:07.523521+0000 mon.a (mon.0) 3685 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:09:07.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:07 gibba013 bash[30381]: audit 2021-03-10T17:09:06.904991+0000 mon.a (mon.0) 3680 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:09:07.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:07 gibba013 bash[30381]: audit 2021-03-10T17:09:07.113865+0000 mon.a (mon.0) 3681 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:09:07.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:07 gibba013 bash[30381]: audit 2021-03-10T17:09:07.521119+0000 mon.a (mon.0) 3682 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:09:07.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:07 gibba013 bash[30381]: audit 2021-03-10T17:09:07.521930+0000 mon.a (mon.0) 3683 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T17:09:07.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:07 gibba013 bash[30381]: audit 2021-03-10T17:09:07.522762+0000 mon.a (mon.0) 3684 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:09:07.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:07 gibba013 bash[30381]: audit 2021-03-10T17:09:07.523521+0000 mon.a (mon.0) 3685 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:09:07.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:07 gibba020 bash[25448]: audit 2021-03-10T17:09:06.904991+0000 mon.a (mon.0) 3680 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:09:07.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:07 gibba020 bash[25448]: audit 2021-03-10T17:09:07.113865+0000 mon.a (mon.0) 3681 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:09:07.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:07 gibba020 bash[25448]: audit 2021-03-10T17:09:07.521119+0000 mon.a (mon.0) 3682 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:09:07.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:07 gibba020 bash[25448]: audit 2021-03-10T17:09:07.521930+0000 mon.a (mon.0) 3683 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T17:09:07.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:07 gibba020 bash[25448]: audit 2021-03-10T17:09:07.522762+0000 mon.a (mon.0) 3684 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:09:07.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:07 gibba020 bash[25448]: audit 2021-03-10T17:09:07.523521+0000 mon.a (mon.0) 3685 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:09:08.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:08 gibba013 bash[29418]: cluster 2021-03-10T17:09:07.038955+0000 mgr.gibba020.yqfnwy (mgr.34427) 10337 : cluster [DBG] pgmap v5891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:08.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:08 gibba013 bash[30381]: cluster 2021-03-10T17:09:07.038955+0000 mgr.gibba020.yqfnwy (mgr.34427) 10337 : cluster [DBG] pgmap v5891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:08.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:08 gibba020 bash[25448]: cluster 2021-03-10T17:09:07.038955+0000 mgr.gibba020.yqfnwy (mgr.34427) 10337 : cluster [DBG] pgmap v5891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:09.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:09 gibba013 bash[29418]: cluster 2021-03-10T17:09:09.040678+0000 mgr.gibba020.yqfnwy (mgr.34427) 10338 : cluster [DBG] pgmap v5892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:09.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:09 gibba013 bash[30381]: cluster 2021-03-10T17:09:09.040678+0000 mgr.gibba020.yqfnwy (mgr.34427) 10338 : cluster [DBG] pgmap v5892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:09.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:09 gibba020 bash[25448]: cluster 2021-03-10T17:09:09.040678+0000 mgr.gibba020.yqfnwy (mgr.34427) 10338 : cluster [DBG] pgmap v5892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:11.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:11 gibba013 bash[29418]: cephadm 2021-03-10T17:09:10.507576+0000 mgr.gibba020.yqfnwy (mgr.34427) 10339 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:09:11.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:11 gibba013 bash[30381]: cephadm 2021-03-10T17:09:10.507576+0000 mgr.gibba020.yqfnwy (mgr.34427) 10339 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:09:11.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:11 gibba020 bash[25448]: cephadm 2021-03-10T17:09:10.507576+0000 mgr.gibba020.yqfnwy (mgr.34427) 10339 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:09:12.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:12 gibba013 bash[29418]: cluster 2021-03-10T17:09:11.042254+0000 mgr.gibba020.yqfnwy (mgr.34427) 10340 : cluster [DBG] pgmap v5893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:12.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:12 gibba013 bash[30381]: cluster 2021-03-10T17:09:11.042254+0000 mgr.gibba020.yqfnwy (mgr.34427) 10340 : cluster [DBG] pgmap v5893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:12.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:12 gibba020 bash[25448]: cluster 2021-03-10T17:09:11.042254+0000 mgr.gibba020.yqfnwy (mgr.34427) 10340 : cluster [DBG] pgmap v5893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:14.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:14 gibba013 bash[29418]: cluster 2021-03-10T17:09:13.042701+0000 mgr.gibba020.yqfnwy (mgr.34427) 10341 : cluster [DBG] pgmap v5894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:14.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:14 gibba013 bash[30381]: cluster 2021-03-10T17:09:13.042701+0000 mgr.gibba020.yqfnwy (mgr.34427) 10341 : cluster [DBG] pgmap v5894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:14.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:14 gibba020 bash[25448]: cluster 2021-03-10T17:09:13.042701+0000 mgr.gibba020.yqfnwy (mgr.34427) 10341 : cluster [DBG] pgmap v5894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:16.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:16 gibba013 bash[29418]: cluster 2021-03-10T17:09:15.044421+0000 mgr.gibba020.yqfnwy (mgr.34427) 10342 : cluster [DBG] pgmap v5895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:16.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:16 gibba013 bash[30381]: cluster 2021-03-10T17:09:15.044421+0000 mgr.gibba020.yqfnwy (mgr.34427) 10342 : cluster [DBG] pgmap v5895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:16.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:16 gibba020 bash[25448]: cluster 2021-03-10T17:09:15.044421+0000 mgr.gibba020.yqfnwy (mgr.34427) 10342 : cluster [DBG] pgmap v5895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:18.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:18 gibba013 bash[29418]: cluster 2021-03-10T17:09:17.045602+0000 mgr.gibba020.yqfnwy (mgr.34427) 10343 : cluster [DBG] pgmap v5896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:18.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:18 gibba013 bash[30381]: cluster 2021-03-10T17:09:17.045602+0000 mgr.gibba020.yqfnwy (mgr.34427) 10343 : cluster [DBG] pgmap v5896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:18.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:18 gibba020 bash[25448]: cluster 2021-03-10T17:09:17.045602+0000 mgr.gibba020.yqfnwy (mgr.34427) 10343 : cluster [DBG] pgmap v5896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:20.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:20 gibba013 bash[29418]: cluster 2021-03-10T17:09:19.047124+0000 mgr.gibba020.yqfnwy (mgr.34427) 10344 : cluster [DBG] pgmap v5897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:20.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:20 gibba013 bash[30381]: cluster 2021-03-10T17:09:19.047124+0000 mgr.gibba020.yqfnwy (mgr.34427) 10344 : cluster [DBG] pgmap v5897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:20.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:20 gibba020 bash[25448]: cluster 2021-03-10T17:09:19.047124+0000 mgr.gibba020.yqfnwy (mgr.34427) 10344 : cluster [DBG] pgmap v5897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:22.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:22 gibba013 bash[29418]: cluster 2021-03-10T17:09:21.048891+0000 mgr.gibba020.yqfnwy (mgr.34427) 10345 : cluster [DBG] pgmap v5898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:22.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:22 gibba013 bash[30381]: cluster 2021-03-10T17:09:21.048891+0000 mgr.gibba020.yqfnwy (mgr.34427) 10345 : cluster [DBG] pgmap v5898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:22.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:22 gibba020 bash[25448]: cluster 2021-03-10T17:09:21.048891+0000 mgr.gibba020.yqfnwy (mgr.34427) 10345 : cluster [DBG] pgmap v5898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:24.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:24 gibba013 bash[29418]: cluster 2021-03-10T17:09:23.049387+0000 mgr.gibba020.yqfnwy (mgr.34427) 10346 : cluster [DBG] pgmap v5899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:24.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:24 gibba013 bash[30381]: cluster 2021-03-10T17:09:23.049387+0000 mgr.gibba020.yqfnwy (mgr.34427) 10346 : cluster [DBG] pgmap v5899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:24.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:24 gibba020 bash[25448]: cluster 2021-03-10T17:09:23.049387+0000 mgr.gibba020.yqfnwy (mgr.34427) 10346 : cluster [DBG] pgmap v5899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:26.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:26 gibba013 bash[30381]: cluster 2021-03-10T17:09:25.050965+0000 mgr.gibba020.yqfnwy (mgr.34427) 10347 : cluster [DBG] pgmap v5900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:26.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:26 gibba013 bash[30381]: audit 2021-03-10T17:09:25.520927+0000 mon.a (mon.0) 3686 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:09:26.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:26 gibba013 bash[30381]: cephadm 2021-03-10T17:09:25.521593+0000 mgr.gibba020.yqfnwy (mgr.34427) 10348 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:09:26.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:26 gibba013 bash[30381]: cephadm 2021-03-10T17:09:25.522295+0000 mgr.gibba020.yqfnwy (mgr.34427) 10349 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:09:26.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:26 gibba013 bash[30381]: audit 2021-03-10T17:09:25.717707+0000 mon.a (mon.0) 3687 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:09:26.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:26 gibba013 bash[30381]: audit 2021-03-10T17:09:25.721007+0000 mon.a (mon.0) 3688 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:09:26.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:26 gibba013 bash[30381]: audit 2021-03-10T17:09:25.722260+0000 mon.a (mon.0) 3689 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:26.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:26 gibba013 bash[30381]: audit 2021-03-10T17:09:25.723793+0000 mon.a (mon.0) 3690 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:26.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:26 gibba013 bash[30381]: audit 2021-03-10T17:09:25.725250+0000 mon.a (mon.0) 3691 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:26.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:26 gibba013 bash[30381]: audit 2021-03-10T17:09:25.728363+0000 mon.a (mon.0) 3692 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:26.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:26 gibba013 bash[30381]: audit 2021-03-10T17:09:25.730319+0000 mon.a (mon.0) 3693 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:26.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:26 gibba013 bash[29418]: cluster 2021-03-10T17:09:25.050965+0000 mgr.gibba020.yqfnwy (mgr.34427) 10347 : cluster [DBG] pgmap v5900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:26.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:26 gibba013 bash[29418]: audit 2021-03-10T17:09:25.520927+0000 mon.a (mon.0) 3686 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:09:26.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:26 gibba013 bash[29418]: cephadm 2021-03-10T17:09:25.521593+0000 mgr.gibba020.yqfnwy (mgr.34427) 10348 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:09:26.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:26 gibba013 bash[29418]: cephadm 2021-03-10T17:09:25.522295+0000 mgr.gibba020.yqfnwy (mgr.34427) 10349 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:09:26.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:26 gibba013 bash[29418]: audit 2021-03-10T17:09:25.717707+0000 mon.a (mon.0) 3687 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:09:26.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:26 gibba013 bash[29418]: audit 2021-03-10T17:09:25.721007+0000 mon.a (mon.0) 3688 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:09:26.888 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:26 gibba013 bash[29418]: audit 2021-03-10T17:09:25.722260+0000 mon.a (mon.0) 3689 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:26.889 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:26 gibba013 bash[29418]: audit 2021-03-10T17:09:25.723793+0000 mon.a (mon.0) 3690 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:26.889 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:26 gibba013 bash[29418]: audit 2021-03-10T17:09:25.725250+0000 mon.a (mon.0) 3691 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:26.889 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:26 gibba013 bash[29418]: audit 2021-03-10T17:09:25.728363+0000 mon.a (mon.0) 3692 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:26.890 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:26 gibba013 bash[29418]: audit 2021-03-10T17:09:25.730319+0000 mon.a (mon.0) 3693 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:26.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:26 gibba020 bash[25448]: cluster 2021-03-10T17:09:25.050965+0000 mgr.gibba020.yqfnwy (mgr.34427) 10347 : cluster [DBG] pgmap v5900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:26.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:26 gibba020 bash[25448]: audit 2021-03-10T17:09:25.520927+0000 mon.a (mon.0) 3686 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:09:26.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:26 gibba020 bash[25448]: cephadm 2021-03-10T17:09:25.521593+0000 mgr.gibba020.yqfnwy (mgr.34427) 10348 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:09:26.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:26 gibba020 bash[25448]: cephadm 2021-03-10T17:09:25.522295+0000 mgr.gibba020.yqfnwy (mgr.34427) 10349 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:09:26.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:26 gibba020 bash[25448]: audit 2021-03-10T17:09:25.717707+0000 mon.a (mon.0) 3687 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:09:26.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:26 gibba020 bash[25448]: audit 2021-03-10T17:09:25.721007+0000 mon.a (mon.0) 3688 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:09:26.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:26 gibba020 bash[25448]: audit 2021-03-10T17:09:25.722260+0000 mon.a (mon.0) 3689 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:26.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:26 gibba020 bash[25448]: audit 2021-03-10T17:09:25.723793+0000 mon.a (mon.0) 3690 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:26.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:26 gibba020 bash[25448]: audit 2021-03-10T17:09:25.725250+0000 mon.a (mon.0) 3691 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:26.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:26 gibba020 bash[25448]: audit 2021-03-10T17:09:25.728363+0000 mon.a (mon.0) 3692 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:26.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:26 gibba020 bash[25448]: audit 2021-03-10T17:09:25.730319+0000 mon.a (mon.0) 3693 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:27.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:27 gibba013 bash[30381]: cephadm 2021-03-10T17:09:25.719711+0000 mgr.gibba020.yqfnwy (mgr.34427) 10350 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:09:27.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:27 gibba013 bash[30381]: cephadm 2021-03-10T17:09:25.721427+0000 mgr.gibba020.yqfnwy (mgr.34427) 10351 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:09:27.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:27 gibba013 bash[30381]: cephadm 2021-03-10T17:09:25.722754+0000 mgr.gibba020.yqfnwy (mgr.34427) 10352 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:09:27.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:27 gibba013 bash[30381]: cephadm 2021-03-10T17:09:25.722793+0000 mgr.gibba020.yqfnwy (mgr.34427) 10353 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:09:27.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:27 gibba013 bash[30381]: cephadm 2021-03-10T17:09:25.724281+0000 mgr.gibba020.yqfnwy (mgr.34427) 10354 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:09:27.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:27 gibba013 bash[30381]: cephadm 2021-03-10T17:09:25.724320+0000 mgr.gibba020.yqfnwy (mgr.34427) 10355 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:09:27.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:27 gibba013 bash[30381]: cephadm 2021-03-10T17:09:25.725669+0000 mgr.gibba020.yqfnwy (mgr.34427) 10356 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:09:27.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:27 gibba013 bash[30381]: cephadm 2021-03-10T17:09:25.727246+0000 mgr.gibba020.yqfnwy (mgr.34427) 10357 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:09:27.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:27 gibba013 bash[30381]: cephadm 2021-03-10T17:09:25.727283+0000 mgr.gibba020.yqfnwy (mgr.34427) 10358 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:09:27.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:27 gibba013 bash[30381]: cephadm 2021-03-10T17:09:25.729114+0000 mgr.gibba020.yqfnwy (mgr.34427) 10359 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:09:27.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:27 gibba013 bash[30381]: cephadm 2021-03-10T17:09:25.729433+0000 mgr.gibba020.yqfnwy (mgr.34427) 10360 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:09:27.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:27 gibba013 bash[30381]: cephadm 2021-03-10T17:09:25.731023+0000 mgr.gibba020.yqfnwy (mgr.34427) 10361 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:09:27.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:27 gibba013 bash[30381]: cephadm 2021-03-10T17:09:25.731060+0000 mgr.gibba020.yqfnwy (mgr.34427) 10362 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:09:27.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:27 gibba013 bash[30381]: cephadm 2021-03-10T17:09:25.731165+0000 mgr.gibba020.yqfnwy (mgr.34427) 10363 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:09:27.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:27 gibba013 bash[29418]: cephadm 2021-03-10T17:09:25.719711+0000 mgr.gibba020.yqfnwy (mgr.34427) 10350 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:09:27.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:27 gibba013 bash[29418]: cephadm 2021-03-10T17:09:25.721427+0000 mgr.gibba020.yqfnwy (mgr.34427) 10351 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:09:27.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:27 gibba013 bash[29418]: cephadm 2021-03-10T17:09:25.722754+0000 mgr.gibba020.yqfnwy (mgr.34427) 10352 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:09:27.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:27 gibba013 bash[29418]: cephadm 2021-03-10T17:09:25.722793+0000 mgr.gibba020.yqfnwy (mgr.34427) 10353 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:09:27.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:27 gibba013 bash[29418]: cephadm 2021-03-10T17:09:25.724281+0000 mgr.gibba020.yqfnwy (mgr.34427) 10354 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:09:27.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:27 gibba013 bash[29418]: cephadm 2021-03-10T17:09:25.724320+0000 mgr.gibba020.yqfnwy (mgr.34427) 10355 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:09:27.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:27 gibba013 bash[29418]: cephadm 2021-03-10T17:09:25.725669+0000 mgr.gibba020.yqfnwy (mgr.34427) 10356 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:09:27.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:27 gibba013 bash[29418]: cephadm 2021-03-10T17:09:25.727246+0000 mgr.gibba020.yqfnwy (mgr.34427) 10357 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:09:27.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:27 gibba013 bash[29418]: cephadm 2021-03-10T17:09:25.727283+0000 mgr.gibba020.yqfnwy (mgr.34427) 10358 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:09:27.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:27 gibba013 bash[29418]: cephadm 2021-03-10T17:09:25.729114+0000 mgr.gibba020.yqfnwy (mgr.34427) 10359 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:09:27.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:27 gibba013 bash[29418]: cephadm 2021-03-10T17:09:25.729433+0000 mgr.gibba020.yqfnwy (mgr.34427) 10360 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:09:27.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:27 gibba013 bash[29418]: cephadm 2021-03-10T17:09:25.731023+0000 mgr.gibba020.yqfnwy (mgr.34427) 10361 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:09:27.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:27 gibba013 bash[29418]: cephadm 2021-03-10T17:09:25.731060+0000 mgr.gibba020.yqfnwy (mgr.34427) 10362 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:09:27.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:27 gibba013 bash[29418]: cephadm 2021-03-10T17:09:25.731165+0000 mgr.gibba020.yqfnwy (mgr.34427) 10363 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:09:27.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:27 gibba020 bash[25448]: cephadm 2021-03-10T17:09:25.719711+0000 mgr.gibba020.yqfnwy (mgr.34427) 10350 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:09:27.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:27 gibba020 bash[25448]: cephadm 2021-03-10T17:09:25.721427+0000 mgr.gibba020.yqfnwy (mgr.34427) 10351 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:09:27.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:27 gibba020 bash[25448]: cephadm 2021-03-10T17:09:25.722754+0000 mgr.gibba020.yqfnwy (mgr.34427) 10352 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:09:27.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:27 gibba020 bash[25448]: cephadm 2021-03-10T17:09:25.722793+0000 mgr.gibba020.yqfnwy (mgr.34427) 10353 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:09:27.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:27 gibba020 bash[25448]: cephadm 2021-03-10T17:09:25.724281+0000 mgr.gibba020.yqfnwy (mgr.34427) 10354 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:09:27.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:27 gibba020 bash[25448]: cephadm 2021-03-10T17:09:25.724320+0000 mgr.gibba020.yqfnwy (mgr.34427) 10355 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:09:27.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:27 gibba020 bash[25448]: cephadm 2021-03-10T17:09:25.725669+0000 mgr.gibba020.yqfnwy (mgr.34427) 10356 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:09:27.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:27 gibba020 bash[25448]: cephadm 2021-03-10T17:09:25.727246+0000 mgr.gibba020.yqfnwy (mgr.34427) 10357 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:09:27.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:27 gibba020 bash[25448]: cephadm 2021-03-10T17:09:25.727283+0000 mgr.gibba020.yqfnwy (mgr.34427) 10358 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:09:27.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:27 gibba020 bash[25448]: cephadm 2021-03-10T17:09:25.729114+0000 mgr.gibba020.yqfnwy (mgr.34427) 10359 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:09:27.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:27 gibba020 bash[25448]: cephadm 2021-03-10T17:09:25.729433+0000 mgr.gibba020.yqfnwy (mgr.34427) 10360 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:09:27.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:27 gibba020 bash[25448]: cephadm 2021-03-10T17:09:25.731023+0000 mgr.gibba020.yqfnwy (mgr.34427) 10361 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:09:27.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:27 gibba020 bash[25448]: cephadm 2021-03-10T17:09:25.731060+0000 mgr.gibba020.yqfnwy (mgr.34427) 10362 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:09:27.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:27 gibba020 bash[25448]: cephadm 2021-03-10T17:09:25.731165+0000 mgr.gibba020.yqfnwy (mgr.34427) 10363 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:09:28.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:28 gibba013 bash[29418]: cluster 2021-03-10T17:09:27.052281+0000 mgr.gibba020.yqfnwy (mgr.34427) 10364 : cluster [DBG] pgmap v5901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:28.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:28 gibba013 bash[30381]: cluster 2021-03-10T17:09:27.052281+0000 mgr.gibba020.yqfnwy (mgr.34427) 10364 : cluster [DBG] pgmap v5901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:28.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:28 gibba020 bash[25448]: cluster 2021-03-10T17:09:27.052281+0000 mgr.gibba020.yqfnwy (mgr.34427) 10364 : cluster [DBG] pgmap v5901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:30.055 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:09:30.282 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:09:30.283 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 8m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:09:30.283 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 7m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:09:30.283 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:09:30.283 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:09:30.283 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:09:30.284 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:09:30.284 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:09:30.284 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:09:30.284 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:09:30.285 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:09:30.285 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:09:30.285 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:09:30.285 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:09:30.285 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:09:30.286 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:09:30.286 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:09:30.286 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:09:30.286 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:09:30.286 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 7m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:09:30.287 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 7m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:09:30.545 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:09:30.545 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:09:30.545 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:09:30.545 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:09:30.546 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:09:30.546 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:09:30.546 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:09:30.546 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:09:30.547 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:09:30.547 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:09:30.547 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:09:30.547 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:09:30.548 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:09:30.548 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:09:30.548 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:09:30.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:30 gibba013 bash[29418]: cluster 2021-03-10T17:09:29.053907+0000 mgr.gibba020.yqfnwy (mgr.34427) 10365 : cluster [DBG] pgmap v5902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:30.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:30 gibba013 bash[30381]: cluster 2021-03-10T17:09:29.053907+0000 mgr.gibba020.yqfnwy (mgr.34427) 10365 : cluster [DBG] pgmap v5902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:30.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:30 gibba020 bash[25448]: cluster 2021-03-10T17:09:29.053907+0000 mgr.gibba020.yqfnwy (mgr.34427) 10365 : cluster [DBG] pgmap v5902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:31.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:31 gibba013 bash[29418]: audit 2021-03-10T17:09:30.046832+0000 mgr.gibba020.yqfnwy (mgr.34427) 10366 : audit [DBG] from='client.60979 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:09:31.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:31 gibba013 bash[29418]: audit 2021-03-10T17:09:30.268891+0000 mgr.gibba020.yqfnwy (mgr.34427) 10367 : audit [DBG] from='client.60985 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:09:31.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:31 gibba013 bash[29418]: audit 2021-03-10T17:09:30.544011+0000 mon.a (mon.0) 3694 : audit [DBG] from='client.? 172.21.2.113:0/872530739' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:31.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:31 gibba013 bash[30381]: audit 2021-03-10T17:09:30.046832+0000 mgr.gibba020.yqfnwy (mgr.34427) 10366 : audit [DBG] from='client.60979 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:09:31.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:31 gibba013 bash[30381]: audit 2021-03-10T17:09:30.268891+0000 mgr.gibba020.yqfnwy (mgr.34427) 10367 : audit [DBG] from='client.60985 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:09:31.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:31 gibba013 bash[30381]: audit 2021-03-10T17:09:30.544011+0000 mon.a (mon.0) 3694 : audit [DBG] from='client.? 172.21.2.113:0/872530739' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:31.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:31 gibba020 bash[25448]: audit 2021-03-10T17:09:30.046832+0000 mgr.gibba020.yqfnwy (mgr.34427) 10366 : audit [DBG] from='client.60979 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:09:31.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:31 gibba020 bash[25448]: audit 2021-03-10T17:09:30.268891+0000 mgr.gibba020.yqfnwy (mgr.34427) 10367 : audit [DBG] from='client.60985 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:09:31.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:31 gibba020 bash[25448]: audit 2021-03-10T17:09:30.544011+0000 mon.a (mon.0) 3694 : audit [DBG] from='client.? 172.21.2.113:0/872530739' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:09:32.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:32 gibba013 bash[29418]: cluster 2021-03-10T17:09:31.055553+0000 mgr.gibba020.yqfnwy (mgr.34427) 10368 : cluster [DBG] pgmap v5903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:32.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:32 gibba013 bash[30381]: cluster 2021-03-10T17:09:31.055553+0000 mgr.gibba020.yqfnwy (mgr.34427) 10368 : cluster [DBG] pgmap v5903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:32.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:32 gibba020 bash[25448]: cluster 2021-03-10T17:09:31.055553+0000 mgr.gibba020.yqfnwy (mgr.34427) 10368 : cluster [DBG] pgmap v5903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:34.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:34 gibba013 bash[29418]: cluster 2021-03-10T17:09:33.056176+0000 mgr.gibba020.yqfnwy (mgr.34427) 10369 : cluster [DBG] pgmap v5904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:34.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:34 gibba013 bash[30381]: cluster 2021-03-10T17:09:33.056176+0000 mgr.gibba020.yqfnwy (mgr.34427) 10369 : cluster [DBG] pgmap v5904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:34.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:34 gibba020 bash[25448]: cluster 2021-03-10T17:09:33.056176+0000 mgr.gibba020.yqfnwy (mgr.34427) 10369 : cluster [DBG] pgmap v5904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:36.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:36 gibba013 bash[29418]: cluster 2021-03-10T17:09:35.057791+0000 mgr.gibba020.yqfnwy (mgr.34427) 10370 : cluster [DBG] pgmap v5905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:36.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:36 gibba013 bash[30381]: cluster 2021-03-10T17:09:35.057791+0000 mgr.gibba020.yqfnwy (mgr.34427) 10370 : cluster [DBG] pgmap v5905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:36.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:36 gibba020 bash[25448]: cluster 2021-03-10T17:09:35.057791+0000 mgr.gibba020.yqfnwy (mgr.34427) 10370 : cluster [DBG] pgmap v5905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:38.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:38 gibba013 bash[29418]: cluster 2021-03-10T17:09:37.059110+0000 mgr.gibba020.yqfnwy (mgr.34427) 10371 : cluster [DBG] pgmap v5906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:38.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:38 gibba013 bash[30381]: cluster 2021-03-10T17:09:37.059110+0000 mgr.gibba020.yqfnwy (mgr.34427) 10371 : cluster [DBG] pgmap v5906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:38.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:38 gibba020 bash[25448]: cluster 2021-03-10T17:09:37.059110+0000 mgr.gibba020.yqfnwy (mgr.34427) 10371 : cluster [DBG] pgmap v5906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:40.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:40 gibba013 bash[29418]: cluster 2021-03-10T17:09:39.060674+0000 mgr.gibba020.yqfnwy (mgr.34427) 10372 : cluster [DBG] pgmap v5907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:40.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:40 gibba013 bash[30381]: cluster 2021-03-10T17:09:39.060674+0000 mgr.gibba020.yqfnwy (mgr.34427) 10372 : cluster [DBG] pgmap v5907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:40.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:40 gibba020 bash[25448]: cluster 2021-03-10T17:09:39.060674+0000 mgr.gibba020.yqfnwy (mgr.34427) 10372 : cluster [DBG] pgmap v5907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:42.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:42 gibba013 bash[29418]: cephadm 2021-03-10T17:09:40.747173+0000 mgr.gibba020.yqfnwy (mgr.34427) 10373 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:09:42.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:42 gibba013 bash[29418]: cluster 2021-03-10T17:09:41.062385+0000 mgr.gibba020.yqfnwy (mgr.34427) 10374 : cluster [DBG] pgmap v5908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:42.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:42 gibba013 bash[30381]: cephadm 2021-03-10T17:09:40.747173+0000 mgr.gibba020.yqfnwy (mgr.34427) 10373 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:09:42.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:42 gibba013 bash[30381]: cluster 2021-03-10T17:09:41.062385+0000 mgr.gibba020.yqfnwy (mgr.34427) 10374 : cluster [DBG] pgmap v5908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:42.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:42 gibba020 bash[25448]: cephadm 2021-03-10T17:09:40.747173+0000 mgr.gibba020.yqfnwy (mgr.34427) 10373 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:09:42.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:42 gibba020 bash[25448]: cluster 2021-03-10T17:09:41.062385+0000 mgr.gibba020.yqfnwy (mgr.34427) 10374 : cluster [DBG] pgmap v5908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:43.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:43 gibba013 bash[29418]: cluster 2021-03-10T17:09:43.062869+0000 mgr.gibba020.yqfnwy (mgr.34427) 10375 : cluster [DBG] pgmap v5909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:43.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:43 gibba013 bash[30381]: cluster 2021-03-10T17:09:43.062869+0000 mgr.gibba020.yqfnwy (mgr.34427) 10375 : cluster [DBG] pgmap v5909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:43.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:43 gibba020 bash[25448]: cluster 2021-03-10T17:09:43.062869+0000 mgr.gibba020.yqfnwy (mgr.34427) 10375 : cluster [DBG] pgmap v5909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:46.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:46 gibba013 bash[29418]: cluster 2021-03-10T17:09:45.064758+0000 mgr.gibba020.yqfnwy (mgr.34427) 10376 : cluster [DBG] pgmap v5910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:46.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:46 gibba013 bash[30381]: cluster 2021-03-10T17:09:45.064758+0000 mgr.gibba020.yqfnwy (mgr.34427) 10376 : cluster [DBG] pgmap v5910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:46.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:46 gibba020 bash[25448]: cluster 2021-03-10T17:09:45.064758+0000 mgr.gibba020.yqfnwy (mgr.34427) 10376 : cluster [DBG] pgmap v5910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:48.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:48 gibba013 bash[29418]: cluster 2021-03-10T17:09:47.065865+0000 mgr.gibba020.yqfnwy (mgr.34427) 10377 : cluster [DBG] pgmap v5911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:48.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:48 gibba013 bash[30381]: cluster 2021-03-10T17:09:47.065865+0000 mgr.gibba020.yqfnwy (mgr.34427) 10377 : cluster [DBG] pgmap v5911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:48.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:48 gibba020 bash[25448]: cluster 2021-03-10T17:09:47.065865+0000 mgr.gibba020.yqfnwy (mgr.34427) 10377 : cluster [DBG] pgmap v5911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:50.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:50 gibba013 bash[29418]: cluster 2021-03-10T17:09:49.067545+0000 mgr.gibba020.yqfnwy (mgr.34427) 10378 : cluster [DBG] pgmap v5912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:50.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:50 gibba013 bash[30381]: cluster 2021-03-10T17:09:49.067545+0000 mgr.gibba020.yqfnwy (mgr.34427) 10378 : cluster [DBG] pgmap v5912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:50.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:50 gibba020 bash[25448]: cluster 2021-03-10T17:09:49.067545+0000 mgr.gibba020.yqfnwy (mgr.34427) 10378 : cluster [DBG] pgmap v5912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:52.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:52 gibba013 bash[29418]: cluster 2021-03-10T17:09:51.069448+0000 mgr.gibba020.yqfnwy (mgr.34427) 10379 : cluster [DBG] pgmap v5913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:52.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:52 gibba013 bash[30381]: cluster 2021-03-10T17:09:51.069448+0000 mgr.gibba020.yqfnwy (mgr.34427) 10379 : cluster [DBG] pgmap v5913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:52.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:52 gibba020 bash[25448]: cluster 2021-03-10T17:09:51.069448+0000 mgr.gibba020.yqfnwy (mgr.34427) 10379 : cluster [DBG] pgmap v5913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:54.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:54 gibba013 bash[29418]: cluster 2021-03-10T17:09:53.069927+0000 mgr.gibba020.yqfnwy (mgr.34427) 10380 : cluster [DBG] pgmap v5914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:54.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:54 gibba013 bash[30381]: cluster 2021-03-10T17:09:53.069927+0000 mgr.gibba020.yqfnwy (mgr.34427) 10380 : cluster [DBG] pgmap v5914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:54.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:54 gibba020 bash[25448]: cluster 2021-03-10T17:09:53.069927+0000 mgr.gibba020.yqfnwy (mgr.34427) 10380 : cluster [DBG] pgmap v5914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:56.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:56 gibba013 bash[29418]: cluster 2021-03-10T17:09:55.071723+0000 mgr.gibba020.yqfnwy (mgr.34427) 10381 : cluster [DBG] pgmap v5915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:56.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:56 gibba013 bash[30381]: cluster 2021-03-10T17:09:55.071723+0000 mgr.gibba020.yqfnwy (mgr.34427) 10381 : cluster [DBG] pgmap v5915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:56.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:56 gibba020 bash[25448]: cluster 2021-03-10T17:09:55.071723+0000 mgr.gibba020.yqfnwy (mgr.34427) 10381 : cluster [DBG] pgmap v5915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:57.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:57 gibba013 bash[29418]: cephadm 2021-03-10T17:09:55.763210+0000 mgr.gibba020.yqfnwy (mgr.34427) 10382 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:09:57.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:57 gibba013 bash[30381]: cephadm 2021-03-10T17:09:55.763210+0000 mgr.gibba020.yqfnwy (mgr.34427) 10382 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:09:57.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:57 gibba020 bash[25448]: cephadm 2021-03-10T17:09:55.763210+0000 mgr.gibba020.yqfnwy (mgr.34427) 10382 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:09:58.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:09:58 gibba013 bash[29418]: cluster 2021-03-10T17:09:57.073018+0000 mgr.gibba020.yqfnwy (mgr.34427) 10383 : cluster [DBG] pgmap v5916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:58.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:09:58 gibba013 bash[30381]: cluster 2021-03-10T17:09:57.073018+0000 mgr.gibba020.yqfnwy (mgr.34427) 10383 : cluster [DBG] pgmap v5916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:09:58.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:09:58 gibba020 bash[25448]: cluster 2021-03-10T17:09:57.073018+0000 mgr.gibba020.yqfnwy (mgr.34427) 10383 : cluster [DBG] pgmap v5916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:00.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:00 gibba013 bash[29418]: debug 2021-03-10T17:09:59.994+0000 7fd718a82700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:10:00.787 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:10:00.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:00 gibba013 bash[29418]: cluster 2021-03-10T17:09:59.074711+0000 mgr.gibba020.yqfnwy (mgr.34427) 10384 : cluster [DBG] pgmap v5917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:00.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:00 gibba013 bash[29418]: cluster 2021-03-10T17:10:00.000290+0000 mon.a (mon.0) 3695 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:10:00.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:00 gibba013 bash[30381]: cluster 2021-03-10T17:09:59.074711+0000 mgr.gibba020.yqfnwy (mgr.34427) 10384 : cluster [DBG] pgmap v5917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:00.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:00 gibba013 bash[30381]: cluster 2021-03-10T17:10:00.000290+0000 mon.a (mon.0) 3695 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:10:00.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:00 gibba020 bash[25448]: cluster 2021-03-10T17:09:59.074711+0000 mgr.gibba020.yqfnwy (mgr.34427) 10384 : cluster [DBG] pgmap v5917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:00.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:00 gibba020 bash[25448]: cluster 2021-03-10T17:10:00.000290+0000 mon.a (mon.0) 3695 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:10:01.015 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:10:01.015 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 8m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:10:01.015 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 7m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:10:01.016 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:10:01.016 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:10:01.016 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:10:01.016 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:10:01.017 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:10:01.017 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:10:01.017 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:10:01.017 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:10:01.018 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:10:01.018 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:10:01.018 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:10:01.018 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:10:01.018 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:10:01.019 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:10:01.019 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:10:01.019 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:10:01.019 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 7m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:10:01.020 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 7m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:10:01.267 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:10:01.267 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:10:01.268 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:10:01.268 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:10:01.269 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:10:01.269 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:10:01.269 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:10:01.270 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:10:01.270 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:10:01.271 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:10:01.271 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:10:01.271 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:10:01.272 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:10:01.272 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:10:01.273 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:10:01.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:01 gibba013 bash[29418]: audit 2021-03-10T17:10:01.266029+0000 mon.c (mon.1) 158 : audit [DBG] from='client.? 172.21.2.113:0/1171004498' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:01.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:01 gibba013 bash[30381]: audit 2021-03-10T17:10:01.266029+0000 mon.c (mon.1) 158 : audit [DBG] from='client.? 172.21.2.113:0/1171004498' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:01.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:01 gibba020 bash[25448]: audit 2021-03-10T17:10:01.266029+0000 mon.c (mon.1) 158 : audit [DBG] from='client.? 172.21.2.113:0/1171004498' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:02.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:02 gibba013 bash[29418]: audit 2021-03-10T17:10:00.776675+0000 mgr.gibba020.yqfnwy (mgr.34427) 10385 : audit [DBG] from='client.51018 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:10:02.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:02 gibba013 bash[29418]: audit 2021-03-10T17:10:01.001915+0000 mgr.gibba020.yqfnwy (mgr.34427) 10386 : audit [DBG] from='client.61003 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:10:02.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:02 gibba013 bash[29418]: cluster 2021-03-10T17:10:01.076076+0000 mgr.gibba020.yqfnwy (mgr.34427) 10387 : cluster [DBG] pgmap v5918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:02.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:02 gibba013 bash[30381]: audit 2021-03-10T17:10:00.776675+0000 mgr.gibba020.yqfnwy (mgr.34427) 10385 : audit [DBG] from='client.51018 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:10:02.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:02 gibba013 bash[30381]: audit 2021-03-10T17:10:01.001915+0000 mgr.gibba020.yqfnwy (mgr.34427) 10386 : audit [DBG] from='client.61003 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:10:02.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:02 gibba013 bash[30381]: cluster 2021-03-10T17:10:01.076076+0000 mgr.gibba020.yqfnwy (mgr.34427) 10387 : cluster [DBG] pgmap v5918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:02.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:02 gibba020 bash[25448]: audit 2021-03-10T17:10:00.776675+0000 mgr.gibba020.yqfnwy (mgr.34427) 10385 : audit [DBG] from='client.51018 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:10:02.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:02 gibba020 bash[25448]: audit 2021-03-10T17:10:01.001915+0000 mgr.gibba020.yqfnwy (mgr.34427) 10386 : audit [DBG] from='client.61003 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:10:02.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:02 gibba020 bash[25448]: cluster 2021-03-10T17:10:01.076076+0000 mgr.gibba020.yqfnwy (mgr.34427) 10387 : cluster [DBG] pgmap v5918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:03.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:03 gibba013 bash[29418]: cluster 2021-03-10T17:10:03.076463+0000 mgr.gibba020.yqfnwy (mgr.34427) 10388 : cluster [DBG] pgmap v5919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:03.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:03 gibba013 bash[30381]: cluster 2021-03-10T17:10:03.076463+0000 mgr.gibba020.yqfnwy (mgr.34427) 10388 : cluster [DBG] pgmap v5919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:03.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:03 gibba020 bash[25448]: cluster 2021-03-10T17:10:03.076463+0000 mgr.gibba020.yqfnwy (mgr.34427) 10388 : cluster [DBG] pgmap v5919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:06.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:06 gibba013 bash[29418]: cluster 2021-03-10T17:10:05.078316+0000 mgr.gibba020.yqfnwy (mgr.34427) 10389 : cluster [DBG] pgmap v5920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:06.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:06 gibba013 bash[30381]: cluster 2021-03-10T17:10:05.078316+0000 mgr.gibba020.yqfnwy (mgr.34427) 10389 : cluster [DBG] pgmap v5920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:06.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:06 gibba020 bash[25448]: cluster 2021-03-10T17:10:05.078316+0000 mgr.gibba020.yqfnwy (mgr.34427) 10389 : cluster [DBG] pgmap v5920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:07.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:07 gibba013 bash[29418]: audit 2021-03-10T17:10:06.910273+0000 mon.a (mon.0) 3696 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:10:07.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:07 gibba013 bash[29418]: audit 2021-03-10T17:10:07.120613+0000 mon.a (mon.0) 3697 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:10:07.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:07 gibba013 bash[30381]: audit 2021-03-10T17:10:06.910273+0000 mon.a (mon.0) 3696 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:10:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:07 gibba013 bash[30381]: audit 2021-03-10T17:10:07.120613+0000 mon.a (mon.0) 3697 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:10:07.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:07 gibba020 bash[25448]: audit 2021-03-10T17:10:06.910273+0000 mon.a (mon.0) 3696 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:10:07.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:07 gibba020 bash[25448]: audit 2021-03-10T17:10:07.120613+0000 mon.a (mon.0) 3697 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:10:08.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:08 gibba013 bash[29418]: cluster 2021-03-10T17:10:07.079619+0000 mgr.gibba020.yqfnwy (mgr.34427) 10390 : cluster [DBG] pgmap v5921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:08.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:08 gibba013 bash[29418]: audit 2021-03-10T17:10:07.526394+0000 mon.a (mon.0) 3698 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T17:10:08.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:08 gibba013 bash[29418]: audit 2021-03-10T17:10:07.526577+0000 mon.a (mon.0) 3699 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:10:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:08 gibba013 bash[29418]: audit 2021-03-10T17:10:07.526734+0000 mon.a (mon.0) 3700 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:10:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:08 gibba013 bash[29418]: audit 2021-03-10T17:10:07.526890+0000 mon.a (mon.0) 3701 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:10:08.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:08 gibba013 bash[30381]: cluster 2021-03-10T17:10:07.079619+0000 mgr.gibba020.yqfnwy (mgr.34427) 10390 : cluster [DBG] pgmap v5921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:08.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:08 gibba013 bash[30381]: audit 2021-03-10T17:10:07.526394+0000 mon.a (mon.0) 3698 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T17:10:08.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:08 gibba013 bash[30381]: audit 2021-03-10T17:10:07.526577+0000 mon.a (mon.0) 3699 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:10:08.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:08 gibba013 bash[30381]: audit 2021-03-10T17:10:07.526734+0000 mon.a (mon.0) 3700 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:10:08.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:08 gibba013 bash[30381]: audit 2021-03-10T17:10:07.526890+0000 mon.a (mon.0) 3701 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:10:08.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:08 gibba020 bash[25448]: cluster 2021-03-10T17:10:07.079619+0000 mgr.gibba020.yqfnwy (mgr.34427) 10390 : cluster [DBG] pgmap v5921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:08.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:08 gibba020 bash[25448]: audit 2021-03-10T17:10:07.526394+0000 mon.a (mon.0) 3698 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T17:10:08.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:08 gibba020 bash[25448]: audit 2021-03-10T17:10:07.526577+0000 mon.a (mon.0) 3699 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:10:08.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:08 gibba020 bash[25448]: audit 2021-03-10T17:10:07.526734+0000 mon.a (mon.0) 3700 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:10:08.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:08 gibba020 bash[25448]: audit 2021-03-10T17:10:07.526890+0000 mon.a (mon.0) 3701 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:10:10.781 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:10 gibba020 bash[25448]: cluster 2021-03-10T17:10:09.081244+0000 mgr.gibba020.yqfnwy (mgr.34427) 10391 : cluster [DBG] pgmap v5922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:10.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:10 gibba013 bash[29418]: cluster 2021-03-10T17:10:09.081244+0000 mgr.gibba020.yqfnwy (mgr.34427) 10391 : cluster [DBG] pgmap v5922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:10.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:10 gibba013 bash[30381]: cluster 2021-03-10T17:10:09.081244+0000 mgr.gibba020.yqfnwy (mgr.34427) 10391 : cluster [DBG] pgmap v5922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:12.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:12 gibba013 bash[29418]: cephadm 2021-03-10T17:10:10.779314+0000 mgr.gibba020.yqfnwy (mgr.34427) 10392 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:10:12.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:12 gibba013 bash[29418]: cluster 2021-03-10T17:10:11.083038+0000 mgr.gibba020.yqfnwy (mgr.34427) 10393 : cluster [DBG] pgmap v5923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:12.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:12 gibba013 bash[30381]: cephadm 2021-03-10T17:10:10.779314+0000 mgr.gibba020.yqfnwy (mgr.34427) 10392 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:10:12.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:12 gibba013 bash[30381]: cluster 2021-03-10T17:10:11.083038+0000 mgr.gibba020.yqfnwy (mgr.34427) 10393 : cluster [DBG] pgmap v5923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:12.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:12 gibba020 bash[25448]: cephadm 2021-03-10T17:10:10.779314+0000 mgr.gibba020.yqfnwy (mgr.34427) 10392 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:10:12.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:12 gibba020 bash[25448]: cluster 2021-03-10T17:10:11.083038+0000 mgr.gibba020.yqfnwy (mgr.34427) 10393 : cluster [DBG] pgmap v5923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:14.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:14 gibba013 bash[29418]: cluster 2021-03-10T17:10:13.083716+0000 mgr.gibba020.yqfnwy (mgr.34427) 10394 : cluster [DBG] pgmap v5924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:14.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:14 gibba013 bash[30381]: cluster 2021-03-10T17:10:13.083716+0000 mgr.gibba020.yqfnwy (mgr.34427) 10394 : cluster [DBG] pgmap v5924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:14.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:14 gibba020 bash[25448]: cluster 2021-03-10T17:10:13.083716+0000 mgr.gibba020.yqfnwy (mgr.34427) 10394 : cluster [DBG] pgmap v5924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:16.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:16 gibba013 bash[29418]: cluster 2021-03-10T17:10:15.085616+0000 mgr.gibba020.yqfnwy (mgr.34427) 10395 : cluster [DBG] pgmap v5925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:16.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:16 gibba013 bash[30381]: cluster 2021-03-10T17:10:15.085616+0000 mgr.gibba020.yqfnwy (mgr.34427) 10395 : cluster [DBG] pgmap v5925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:16.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:16 gibba020 bash[25448]: cluster 2021-03-10T17:10:15.085616+0000 mgr.gibba020.yqfnwy (mgr.34427) 10395 : cluster [DBG] pgmap v5925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:18.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:18 gibba013 bash[29418]: cluster 2021-03-10T17:10:17.087035+0000 mgr.gibba020.yqfnwy (mgr.34427) 10396 : cluster [DBG] pgmap v5926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:18.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:18 gibba013 bash[30381]: cluster 2021-03-10T17:10:17.087035+0000 mgr.gibba020.yqfnwy (mgr.34427) 10396 : cluster [DBG] pgmap v5926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:18.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:18 gibba020 bash[25448]: cluster 2021-03-10T17:10:17.087035+0000 mgr.gibba020.yqfnwy (mgr.34427) 10396 : cluster [DBG] pgmap v5926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:20.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:20 gibba013 bash[29418]: cluster 2021-03-10T17:10:19.088614+0000 mgr.gibba020.yqfnwy (mgr.34427) 10397 : cluster [DBG] pgmap v5927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:20.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:20 gibba013 bash[30381]: cluster 2021-03-10T17:10:19.088614+0000 mgr.gibba020.yqfnwy (mgr.34427) 10397 : cluster [DBG] pgmap v5927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:20.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:20 gibba020 bash[25448]: cluster 2021-03-10T17:10:19.088614+0000 mgr.gibba020.yqfnwy (mgr.34427) 10397 : cluster [DBG] pgmap v5927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:22.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:22 gibba013 bash[29418]: cluster 2021-03-10T17:10:21.090494+0000 mgr.gibba020.yqfnwy (mgr.34427) 10398 : cluster [DBG] pgmap v5928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:22.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:22 gibba013 bash[30381]: cluster 2021-03-10T17:10:21.090494+0000 mgr.gibba020.yqfnwy (mgr.34427) 10398 : cluster [DBG] pgmap v5928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:22.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:22 gibba020 bash[25448]: cluster 2021-03-10T17:10:21.090494+0000 mgr.gibba020.yqfnwy (mgr.34427) 10398 : cluster [DBG] pgmap v5928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:23.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:23 gibba013 bash[29418]: cluster 2021-03-10T17:10:23.091711+0000 mgr.gibba020.yqfnwy (mgr.34427) 10399 : cluster [DBG] pgmap v5929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:23.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:23 gibba013 bash[30381]: cluster 2021-03-10T17:10:23.091711+0000 mgr.gibba020.yqfnwy (mgr.34427) 10399 : cluster [DBG] pgmap v5929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:23.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:23 gibba020 bash[25448]: cluster 2021-03-10T17:10:23.091711+0000 mgr.gibba020.yqfnwy (mgr.34427) 10399 : cluster [DBG] pgmap v5929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:26.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:26 gibba013 bash[29418]: cluster 2021-03-10T17:10:25.093591+0000 mgr.gibba020.yqfnwy (mgr.34427) 10400 : cluster [DBG] pgmap v5930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:26.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:26 gibba013 bash[29418]: audit 2021-03-10T17:10:25.791359+0000 mon.a (mon.0) 3702 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:10:26.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:26 gibba013 bash[29418]: audit 2021-03-10T17:10:26.020579+0000 mon.a (mon.0) 3703 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:10:26.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:26 gibba013 bash[29418]: audit 2021-03-10T17:10:26.023552+0000 mon.a (mon.0) 3704 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:10:26.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:26 gibba013 bash[29418]: audit 2021-03-10T17:10:26.024945+0000 mon.a (mon.0) 3705 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:26.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:26 gibba013 bash[29418]: audit 2021-03-10T17:10:26.026292+0000 mon.a (mon.0) 3706 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:26.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:26 gibba013 bash[29418]: audit 2021-03-10T17:10:26.027361+0000 mon.a (mon.0) 3707 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:26.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:26 gibba013 bash[29418]: audit 2021-03-10T17:10:26.030307+0000 mon.a (mon.0) 3708 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:26.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:26 gibba013 bash[29418]: audit 2021-03-10T17:10:26.032086+0000 mon.a (mon.0) 3709 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:26.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:26 gibba013 bash[30381]: cluster 2021-03-10T17:10:25.093591+0000 mgr.gibba020.yqfnwy (mgr.34427) 10400 : cluster [DBG] pgmap v5930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:26.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:26 gibba013 bash[30381]: audit 2021-03-10T17:10:25.791359+0000 mon.a (mon.0) 3702 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:10:26.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:26 gibba013 bash[30381]: audit 2021-03-10T17:10:26.020579+0000 mon.a (mon.0) 3703 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:10:26.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:26 gibba013 bash[30381]: audit 2021-03-10T17:10:26.023552+0000 mon.a (mon.0) 3704 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:10:26.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:26 gibba013 bash[30381]: audit 2021-03-10T17:10:26.024945+0000 mon.a (mon.0) 3705 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:26.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:26 gibba013 bash[30381]: audit 2021-03-10T17:10:26.026292+0000 mon.a (mon.0) 3706 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:26.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:26 gibba013 bash[30381]: audit 2021-03-10T17:10:26.027361+0000 mon.a (mon.0) 3707 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:26.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:26 gibba013 bash[30381]: audit 2021-03-10T17:10:26.030307+0000 mon.a (mon.0) 3708 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:26.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:26 gibba013 bash[30381]: audit 2021-03-10T17:10:26.032086+0000 mon.a (mon.0) 3709 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:26.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:26 gibba020 bash[25448]: cluster 2021-03-10T17:10:25.093591+0000 mgr.gibba020.yqfnwy (mgr.34427) 10400 : cluster [DBG] pgmap v5930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:26.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:26 gibba020 bash[25448]: audit 2021-03-10T17:10:25.791359+0000 mon.a (mon.0) 3702 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:10:26.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:26 gibba020 bash[25448]: audit 2021-03-10T17:10:26.020579+0000 mon.a (mon.0) 3703 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:10:26.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:26 gibba020 bash[25448]: audit 2021-03-10T17:10:26.023552+0000 mon.a (mon.0) 3704 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:10:26.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:26 gibba020 bash[25448]: audit 2021-03-10T17:10:26.024945+0000 mon.a (mon.0) 3705 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:26.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:26 gibba020 bash[25448]: audit 2021-03-10T17:10:26.026292+0000 mon.a (mon.0) 3706 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:26.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:26 gibba020 bash[25448]: audit 2021-03-10T17:10:26.027361+0000 mon.a (mon.0) 3707 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:26.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:26 gibba020 bash[25448]: audit 2021-03-10T17:10:26.030307+0000 mon.a (mon.0) 3708 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:26.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:26 gibba020 bash[25448]: audit 2021-03-10T17:10:26.032086+0000 mon.a (mon.0) 3709 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:27.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:27 gibba013 bash[29418]: cephadm 2021-03-10T17:10:25.795851+0000 mgr.gibba020.yqfnwy (mgr.34427) 10401 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:10:27.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:27 gibba013 bash[29418]: cephadm 2021-03-10T17:10:25.797745+0000 mgr.gibba020.yqfnwy (mgr.34427) 10402 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:10:27.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:27 gibba013 bash[29418]: cephadm 2021-03-10T17:10:26.022395+0000 mgr.gibba020.yqfnwy (mgr.34427) 10403 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:10:27.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:27 gibba013 bash[29418]: cephadm 2021-03-10T17:10:26.024153+0000 mgr.gibba020.yqfnwy (mgr.34427) 10404 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:10:27.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:27 gibba013 bash[29418]: cephadm 2021-03-10T17:10:26.025469+0000 mgr.gibba020.yqfnwy (mgr.34427) 10405 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:10:27.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:27 gibba013 bash[29418]: cephadm 2021-03-10T17:10:26.025507+0000 mgr.gibba020.yqfnwy (mgr.34427) 10406 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:10:27.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:27 gibba013 bash[29418]: cephadm 2021-03-10T17:10:26.026608+0000 mgr.gibba020.yqfnwy (mgr.34427) 10407 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:10:27.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:27 gibba013 bash[29418]: cephadm 2021-03-10T17:10:26.026647+0000 mgr.gibba020.yqfnwy (mgr.34427) 10408 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:10:27.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:27 gibba013 bash[29418]: cephadm 2021-03-10T17:10:26.027702+0000 mgr.gibba020.yqfnwy (mgr.34427) 10409 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:10:27.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:27 gibba013 bash[29418]: cephadm 2021-03-10T17:10:26.029090+0000 mgr.gibba020.yqfnwy (mgr.34427) 10410 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:10:27.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:27 gibba013 bash[29418]: cephadm 2021-03-10T17:10:26.029135+0000 mgr.gibba020.yqfnwy (mgr.34427) 10411 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:10:27.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:27 gibba013 bash[29418]: cephadm 2021-03-10T17:10:26.030832+0000 mgr.gibba020.yqfnwy (mgr.34427) 10412 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:10:27.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:27 gibba013 bash[29418]: cephadm 2021-03-10T17:10:26.031169+0000 mgr.gibba020.yqfnwy (mgr.34427) 10413 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:10:27.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:27 gibba013 bash[29418]: cephadm 2021-03-10T17:10:26.032560+0000 mgr.gibba020.yqfnwy (mgr.34427) 10414 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:10:27.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:27 gibba013 bash[29418]: cephadm 2021-03-10T17:10:26.032605+0000 mgr.gibba020.yqfnwy (mgr.34427) 10415 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:10:27.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:27 gibba013 bash[29418]: cephadm 2021-03-10T17:10:26.032723+0000 mgr.gibba020.yqfnwy (mgr.34427) 10416 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:10:27.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:27 gibba013 bash[30381]: cephadm 2021-03-10T17:10:25.795851+0000 mgr.gibba020.yqfnwy (mgr.34427) 10401 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:10:27.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:27 gibba013 bash[30381]: cephadm 2021-03-10T17:10:25.797745+0000 mgr.gibba020.yqfnwy (mgr.34427) 10402 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:10:27.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:27 gibba013 bash[30381]: cephadm 2021-03-10T17:10:26.022395+0000 mgr.gibba020.yqfnwy (mgr.34427) 10403 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:10:27.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:27 gibba013 bash[30381]: cephadm 2021-03-10T17:10:26.024153+0000 mgr.gibba020.yqfnwy (mgr.34427) 10404 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:10:27.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:27 gibba013 bash[30381]: cephadm 2021-03-10T17:10:26.025469+0000 mgr.gibba020.yqfnwy (mgr.34427) 10405 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:10:27.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:27 gibba013 bash[30381]: cephadm 2021-03-10T17:10:26.025507+0000 mgr.gibba020.yqfnwy (mgr.34427) 10406 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:10:27.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:27 gibba013 bash[30381]: cephadm 2021-03-10T17:10:26.026608+0000 mgr.gibba020.yqfnwy (mgr.34427) 10407 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:10:27.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:27 gibba013 bash[30381]: cephadm 2021-03-10T17:10:26.026647+0000 mgr.gibba020.yqfnwy (mgr.34427) 10408 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:10:27.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:27 gibba013 bash[30381]: cephadm 2021-03-10T17:10:26.027702+0000 mgr.gibba020.yqfnwy (mgr.34427) 10409 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:10:27.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:27 gibba013 bash[30381]: cephadm 2021-03-10T17:10:26.029090+0000 mgr.gibba020.yqfnwy (mgr.34427) 10410 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:10:27.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:27 gibba013 bash[30381]: cephadm 2021-03-10T17:10:26.029135+0000 mgr.gibba020.yqfnwy (mgr.34427) 10411 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:10:27.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:27 gibba013 bash[30381]: cephadm 2021-03-10T17:10:26.030832+0000 mgr.gibba020.yqfnwy (mgr.34427) 10412 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:10:27.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:27 gibba013 bash[30381]: cephadm 2021-03-10T17:10:26.031169+0000 mgr.gibba020.yqfnwy (mgr.34427) 10413 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:10:27.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:27 gibba013 bash[30381]: cephadm 2021-03-10T17:10:26.032560+0000 mgr.gibba020.yqfnwy (mgr.34427) 10414 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:10:27.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:27 gibba013 bash[30381]: cephadm 2021-03-10T17:10:26.032605+0000 mgr.gibba020.yqfnwy (mgr.34427) 10415 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:10:27.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:27 gibba013 bash[30381]: cephadm 2021-03-10T17:10:26.032723+0000 mgr.gibba020.yqfnwy (mgr.34427) 10416 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:10:27.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:27 gibba020 bash[25448]: cephadm 2021-03-10T17:10:25.795851+0000 mgr.gibba020.yqfnwy (mgr.34427) 10401 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:10:27.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:27 gibba020 bash[25448]: cephadm 2021-03-10T17:10:25.797745+0000 mgr.gibba020.yqfnwy (mgr.34427) 10402 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:10:27.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:27 gibba020 bash[25448]: cephadm 2021-03-10T17:10:26.022395+0000 mgr.gibba020.yqfnwy (mgr.34427) 10403 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:10:27.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:27 gibba020 bash[25448]: cephadm 2021-03-10T17:10:26.024153+0000 mgr.gibba020.yqfnwy (mgr.34427) 10404 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:10:27.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:27 gibba020 bash[25448]: cephadm 2021-03-10T17:10:26.025469+0000 mgr.gibba020.yqfnwy (mgr.34427) 10405 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:10:27.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:27 gibba020 bash[25448]: cephadm 2021-03-10T17:10:26.025507+0000 mgr.gibba020.yqfnwy (mgr.34427) 10406 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:10:27.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:27 gibba020 bash[25448]: cephadm 2021-03-10T17:10:26.026608+0000 mgr.gibba020.yqfnwy (mgr.34427) 10407 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:10:27.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:27 gibba020 bash[25448]: cephadm 2021-03-10T17:10:26.026647+0000 mgr.gibba020.yqfnwy (mgr.34427) 10408 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:10:27.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:27 gibba020 bash[25448]: cephadm 2021-03-10T17:10:26.027702+0000 mgr.gibba020.yqfnwy (mgr.34427) 10409 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:10:27.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:27 gibba020 bash[25448]: cephadm 2021-03-10T17:10:26.029090+0000 mgr.gibba020.yqfnwy (mgr.34427) 10410 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:10:27.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:27 gibba020 bash[25448]: cephadm 2021-03-10T17:10:26.029135+0000 mgr.gibba020.yqfnwy (mgr.34427) 10411 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:10:27.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:27 gibba020 bash[25448]: cephadm 2021-03-10T17:10:26.030832+0000 mgr.gibba020.yqfnwy (mgr.34427) 10412 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:10:27.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:27 gibba020 bash[25448]: cephadm 2021-03-10T17:10:26.031169+0000 mgr.gibba020.yqfnwy (mgr.34427) 10413 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:10:27.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:27 gibba020 bash[25448]: cephadm 2021-03-10T17:10:26.032560+0000 mgr.gibba020.yqfnwy (mgr.34427) 10414 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:10:27.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:27 gibba020 bash[25448]: cephadm 2021-03-10T17:10:26.032605+0000 mgr.gibba020.yqfnwy (mgr.34427) 10415 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:10:27.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:27 gibba020 bash[25448]: cephadm 2021-03-10T17:10:26.032723+0000 mgr.gibba020.yqfnwy (mgr.34427) 10416 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:10:28.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:28 gibba013 bash[29418]: cluster 2021-03-10T17:10:27.094866+0000 mgr.gibba020.yqfnwy (mgr.34427) 10417 : cluster [DBG] pgmap v5931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:28.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:28 gibba013 bash[30381]: cluster 2021-03-10T17:10:27.094866+0000 mgr.gibba020.yqfnwy (mgr.34427) 10417 : cluster [DBG] pgmap v5931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:28.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:28 gibba020 bash[25448]: cluster 2021-03-10T17:10:27.094866+0000 mgr.gibba020.yqfnwy (mgr.34427) 10417 : cluster [DBG] pgmap v5931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:30.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:30 gibba013 bash[29418]: cluster 2021-03-10T17:10:29.096489+0000 mgr.gibba020.yqfnwy (mgr.34427) 10418 : cluster [DBG] pgmap v5932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:30.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:30 gibba013 bash[30381]: cluster 2021-03-10T17:10:29.096489+0000 mgr.gibba020.yqfnwy (mgr.34427) 10418 : cluster [DBG] pgmap v5932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:30.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:30 gibba020 bash[25448]: cluster 2021-03-10T17:10:29.096489+0000 mgr.gibba020.yqfnwy (mgr.34427) 10418 : cluster [DBG] pgmap v5932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:31.504 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:10:31.738 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:10:31.738 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 9m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:10:31.739 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 8m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:10:31.739 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:10:31.739 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:10:31.739 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:10:31.739 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:10:31.740 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:10:31.740 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:10:31.740 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:10:31.740 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:10:31.741 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:10:31.741 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:10:31.741 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:10:31.741 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:10:31.741 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:10:31.742 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:10:31.742 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:10:31.742 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:10:31.742 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 8m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:10:31.742 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 8m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:10:31.988 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:10:31.988 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:10:31.988 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:10:31.989 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:10:31.989 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:10:31.989 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:10:31.989 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:10:31.989 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:10:31.990 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:10:31.990 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:10:31.990 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:10:31.990 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:10:31.991 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:10:31.991 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:10:31.991 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:10:32.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:32 gibba013 bash[29418]: cluster 2021-03-10T17:10:31.098186+0000 mgr.gibba020.yqfnwy (mgr.34427) 10419 : cluster [DBG] pgmap v5933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:32.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:32 gibba013 bash[29418]: audit 2021-03-10T17:10:31.493465+0000 mgr.gibba020.yqfnwy (mgr.34427) 10420 : audit [DBG] from='client.51036 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:10:32.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:32 gibba013 bash[29418]: audit 2021-03-10T17:10:31.987147+0000 mon.a (mon.0) 3710 : audit [DBG] from='client.? 172.21.2.113:0/1252441941' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:32.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:32 gibba013 bash[30381]: cluster 2021-03-10T17:10:31.098186+0000 mgr.gibba020.yqfnwy (mgr.34427) 10419 : cluster [DBG] pgmap v5933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:32.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:32 gibba013 bash[30381]: audit 2021-03-10T17:10:31.493465+0000 mgr.gibba020.yqfnwy (mgr.34427) 10420 : audit [DBG] from='client.51036 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:10:32.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:32 gibba013 bash[30381]: audit 2021-03-10T17:10:31.987147+0000 mon.a (mon.0) 3710 : audit [DBG] from='client.? 172.21.2.113:0/1252441941' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:32.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:32 gibba020 bash[25448]: cluster 2021-03-10T17:10:31.098186+0000 mgr.gibba020.yqfnwy (mgr.34427) 10419 : cluster [DBG] pgmap v5933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:32.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:32 gibba020 bash[25448]: audit 2021-03-10T17:10:31.493465+0000 mgr.gibba020.yqfnwy (mgr.34427) 10420 : audit [DBG] from='client.51036 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:10:32.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:32 gibba020 bash[25448]: audit 2021-03-10T17:10:31.987147+0000 mon.a (mon.0) 3710 : audit [DBG] from='client.? 172.21.2.113:0/1252441941' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:10:33.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:33 gibba013 bash[29418]: audit 2021-03-10T17:10:31.726073+0000 mgr.gibba020.yqfnwy (mgr.34427) 10421 : audit [DBG] from='client.51042 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:10:33.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:33 gibba013 bash[30381]: audit 2021-03-10T17:10:31.726073+0000 mgr.gibba020.yqfnwy (mgr.34427) 10421 : audit [DBG] from='client.51042 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:10:33.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:33 gibba020 bash[25448]: audit 2021-03-10T17:10:31.726073+0000 mgr.gibba020.yqfnwy (mgr.34427) 10421 : audit [DBG] from='client.51042 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:10:34.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:34 gibba013 bash[29418]: cluster 2021-03-10T17:10:33.098658+0000 mgr.gibba020.yqfnwy (mgr.34427) 10422 : cluster [DBG] pgmap v5934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:34.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:34 gibba013 bash[30381]: cluster 2021-03-10T17:10:33.098658+0000 mgr.gibba020.yqfnwy (mgr.34427) 10422 : cluster [DBG] pgmap v5934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:34.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:34 gibba020 bash[25448]: cluster 2021-03-10T17:10:33.098658+0000 mgr.gibba020.yqfnwy (mgr.34427) 10422 : cluster [DBG] pgmap v5934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:36.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:36 gibba013 bash[29418]: cluster 2021-03-10T17:10:35.100237+0000 mgr.gibba020.yqfnwy (mgr.34427) 10423 : cluster [DBG] pgmap v5935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:36.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:36 gibba013 bash[30381]: cluster 2021-03-10T17:10:35.100237+0000 mgr.gibba020.yqfnwy (mgr.34427) 10423 : cluster [DBG] pgmap v5935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:36.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:36 gibba020 bash[25448]: cluster 2021-03-10T17:10:35.100237+0000 mgr.gibba020.yqfnwy (mgr.34427) 10423 : cluster [DBG] pgmap v5935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:38.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:38 gibba013 bash[29418]: cluster 2021-03-10T17:10:37.101527+0000 mgr.gibba020.yqfnwy (mgr.34427) 10424 : cluster [DBG] pgmap v5936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:38.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:38 gibba013 bash[30381]: cluster 2021-03-10T17:10:37.101527+0000 mgr.gibba020.yqfnwy (mgr.34427) 10424 : cluster [DBG] pgmap v5936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:38.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:38 gibba020 bash[25448]: cluster 2021-03-10T17:10:37.101527+0000 mgr.gibba020.yqfnwy (mgr.34427) 10424 : cluster [DBG] pgmap v5936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:39.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:39 gibba020 bash[25448]: cluster 2021-03-10T17:10:39.103056+0000 mgr.gibba020.yqfnwy (mgr.34427) 10425 : cluster [DBG] pgmap v5937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:40.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:39 gibba013 bash[29418]: cluster 2021-03-10T17:10:39.103056+0000 mgr.gibba020.yqfnwy (mgr.34427) 10425 : cluster [DBG] pgmap v5937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:40.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:39 gibba013 bash[30381]: cluster 2021-03-10T17:10:39.103056+0000 mgr.gibba020.yqfnwy (mgr.34427) 10425 : cluster [DBG] pgmap v5937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:42.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:42 gibba013 bash[29418]: cephadm 2021-03-10T17:10:41.048761+0000 mgr.gibba020.yqfnwy (mgr.34427) 10426 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:10:42.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:42 gibba013 bash[29418]: cluster 2021-03-10T17:10:41.104972+0000 mgr.gibba020.yqfnwy (mgr.34427) 10427 : cluster [DBG] pgmap v5938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:42.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:42 gibba013 bash[30381]: cephadm 2021-03-10T17:10:41.048761+0000 mgr.gibba020.yqfnwy (mgr.34427) 10426 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:10:42.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:42 gibba013 bash[30381]: cluster 2021-03-10T17:10:41.104972+0000 mgr.gibba020.yqfnwy (mgr.34427) 10427 : cluster [DBG] pgmap v5938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:42.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:42 gibba020 bash[25448]: cephadm 2021-03-10T17:10:41.048761+0000 mgr.gibba020.yqfnwy (mgr.34427) 10426 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:10:42.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:42 gibba020 bash[25448]: cluster 2021-03-10T17:10:41.104972+0000 mgr.gibba020.yqfnwy (mgr.34427) 10427 : cluster [DBG] pgmap v5938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:44.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:44 gibba013 bash[29418]: cluster 2021-03-10T17:10:43.106181+0000 mgr.gibba020.yqfnwy (mgr.34427) 10428 : cluster [DBG] pgmap v5939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:44.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:44 gibba013 bash[30381]: cluster 2021-03-10T17:10:43.106181+0000 mgr.gibba020.yqfnwy (mgr.34427) 10428 : cluster [DBG] pgmap v5939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:44.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:44 gibba020 bash[25448]: cluster 2021-03-10T17:10:43.106181+0000 mgr.gibba020.yqfnwy (mgr.34427) 10428 : cluster [DBG] pgmap v5939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:46.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:46 gibba013 bash[29418]: cluster 2021-03-10T17:10:45.107873+0000 mgr.gibba020.yqfnwy (mgr.34427) 10429 : cluster [DBG] pgmap v5940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:46.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:46 gibba013 bash[30381]: cluster 2021-03-10T17:10:45.107873+0000 mgr.gibba020.yqfnwy (mgr.34427) 10429 : cluster [DBG] pgmap v5940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:46.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:46 gibba020 bash[25448]: cluster 2021-03-10T17:10:45.107873+0000 mgr.gibba020.yqfnwy (mgr.34427) 10429 : cluster [DBG] pgmap v5940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:48.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:48 gibba013 bash[29418]: cluster 2021-03-10T17:10:47.109396+0000 mgr.gibba020.yqfnwy (mgr.34427) 10430 : cluster [DBG] pgmap v5941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:48.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:48 gibba013 bash[30381]: cluster 2021-03-10T17:10:47.109396+0000 mgr.gibba020.yqfnwy (mgr.34427) 10430 : cluster [DBG] pgmap v5941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:48.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:48 gibba020 bash[25448]: cluster 2021-03-10T17:10:47.109396+0000 mgr.gibba020.yqfnwy (mgr.34427) 10430 : cluster [DBG] pgmap v5941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:50.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:50 gibba013 bash[29418]: cluster 2021-03-10T17:10:49.111074+0000 mgr.gibba020.yqfnwy (mgr.34427) 10431 : cluster [DBG] pgmap v5942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:50.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:50 gibba013 bash[30381]: cluster 2021-03-10T17:10:49.111074+0000 mgr.gibba020.yqfnwy (mgr.34427) 10431 : cluster [DBG] pgmap v5942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:50.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:50 gibba020 bash[25448]: cluster 2021-03-10T17:10:49.111074+0000 mgr.gibba020.yqfnwy (mgr.34427) 10431 : cluster [DBG] pgmap v5942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:52.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:52 gibba013 bash[29418]: cluster 2021-03-10T17:10:51.112996+0000 mgr.gibba020.yqfnwy (mgr.34427) 10432 : cluster [DBG] pgmap v5943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:52.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:52 gibba013 bash[30381]: cluster 2021-03-10T17:10:51.112996+0000 mgr.gibba020.yqfnwy (mgr.34427) 10432 : cluster [DBG] pgmap v5943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:52.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:52 gibba020 bash[25448]: cluster 2021-03-10T17:10:51.112996+0000 mgr.gibba020.yqfnwy (mgr.34427) 10432 : cluster [DBG] pgmap v5943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:54.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:54 gibba013 bash[29418]: cluster 2021-03-10T17:10:53.113726+0000 mgr.gibba020.yqfnwy (mgr.34427) 10433 : cluster [DBG] pgmap v5944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:54.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:54 gibba013 bash[30381]: cluster 2021-03-10T17:10:53.113726+0000 mgr.gibba020.yqfnwy (mgr.34427) 10433 : cluster [DBG] pgmap v5944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:54.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:54 gibba020 bash[25448]: cluster 2021-03-10T17:10:53.113726+0000 mgr.gibba020.yqfnwy (mgr.34427) 10433 : cluster [DBG] pgmap v5944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:56.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:56 gibba013 bash[29418]: cluster 2021-03-10T17:10:55.115318+0000 mgr.gibba020.yqfnwy (mgr.34427) 10434 : cluster [DBG] pgmap v5945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:56.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:56 gibba013 bash[30381]: cluster 2021-03-10T17:10:55.115318+0000 mgr.gibba020.yqfnwy (mgr.34427) 10434 : cluster [DBG] pgmap v5945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:56.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:56 gibba020 bash[25448]: cluster 2021-03-10T17:10:55.115318+0000 mgr.gibba020.yqfnwy (mgr.34427) 10434 : cluster [DBG] pgmap v5945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:57.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:57 gibba013 bash[29418]: cephadm 2021-03-10T17:10:56.062173+0000 mgr.gibba020.yqfnwy (mgr.34427) 10435 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:10:57.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:57 gibba013 bash[30381]: cephadm 2021-03-10T17:10:56.062173+0000 mgr.gibba020.yqfnwy (mgr.34427) 10435 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:10:57.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:57 gibba020 bash[25448]: cephadm 2021-03-10T17:10:56.062173+0000 mgr.gibba020.yqfnwy (mgr.34427) 10435 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:10:58.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:10:58 gibba013 bash[29418]: cluster 2021-03-10T17:10:57.116733+0000 mgr.gibba020.yqfnwy (mgr.34427) 10436 : cluster [DBG] pgmap v5946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:58.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:10:58 gibba013 bash[30381]: cluster 2021-03-10T17:10:57.116733+0000 mgr.gibba020.yqfnwy (mgr.34427) 10436 : cluster [DBG] pgmap v5946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:10:58.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:10:58 gibba020 bash[25448]: cluster 2021-03-10T17:10:57.116733+0000 mgr.gibba020.yqfnwy (mgr.34427) 10436 : cluster [DBG] pgmap v5946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:00.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:00 gibba013 bash[29418]: cluster 2021-03-10T17:10:59.118161+0000 mgr.gibba020.yqfnwy (mgr.34427) 10437 : cluster [DBG] pgmap v5947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:00.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:00 gibba013 bash[30381]: cluster 2021-03-10T17:10:59.118161+0000 mgr.gibba020.yqfnwy (mgr.34427) 10437 : cluster [DBG] pgmap v5947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:00.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:00 gibba020 bash[25448]: cluster 2021-03-10T17:10:59.118161+0000 mgr.gibba020.yqfnwy (mgr.34427) 10437 : cluster [DBG] pgmap v5947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:02.238 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:11:02.469 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:11:02.469 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 9m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:11:02.469 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 8m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:11:02.470 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:11:02.470 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:11:02.470 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:11:02.470 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:11:02.471 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:11:02.471 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:11:02.471 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:11:02.471 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:11:02.471 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:11:02.472 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:11:02.472 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:11:02.472 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:11:02.472 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:11:02.472 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:11:02.473 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:11:02.473 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:11:02.473 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 8m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:11:02.473 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 8m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:11:02.727 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:11:02.796 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:11:02.797 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:11:02.797 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:11:02.797 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:11:02.797 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:11:02.798 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:11:02.798 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:11:02.798 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:11:02.798 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:11:02.799 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:11:02.799 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:11:02.799 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:11:02.799 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:11:02.799 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:11:02.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:02 gibba013 bash[29418]: cluster 2021-03-10T17:11:01.119916+0000 mgr.gibba020.yqfnwy (mgr.34427) 10438 : cluster [DBG] pgmap v5948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:02.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:02 gibba013 bash[30381]: cluster 2021-03-10T17:11:01.119916+0000 mgr.gibba020.yqfnwy (mgr.34427) 10438 : cluster [DBG] pgmap v5948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:02.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:02 gibba020 bash[25448]: cluster 2021-03-10T17:11:01.119916+0000 mgr.gibba020.yqfnwy (mgr.34427) 10438 : cluster [DBG] pgmap v5948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:03.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:03 gibba013 bash[29418]: audit 2021-03-10T17:11:02.228420+0000 mgr.gibba020.yqfnwy (mgr.34427) 10439 : audit [DBG] from='client.61033 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:11:03.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:03 gibba013 bash[29418]: audit 2021-03-10T17:11:02.455594+0000 mgr.gibba020.yqfnwy (mgr.34427) 10440 : audit [DBG] from='client.61039 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:11:03.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:03 gibba013 bash[29418]: audit 2021-03-10T17:11:02.726030+0000 mon.a (mon.0) 3711 : audit [DBG] from='client.? 172.21.2.113:0/3139008723' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:03.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:03 gibba013 bash[30381]: audit 2021-03-10T17:11:02.228420+0000 mgr.gibba020.yqfnwy (mgr.34427) 10439 : audit [DBG] from='client.61033 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:11:03.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:03 gibba013 bash[30381]: audit 2021-03-10T17:11:02.455594+0000 mgr.gibba020.yqfnwy (mgr.34427) 10440 : audit [DBG] from='client.61039 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:11:03.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:03 gibba013 bash[30381]: audit 2021-03-10T17:11:02.726030+0000 mon.a (mon.0) 3711 : audit [DBG] from='client.? 172.21.2.113:0/3139008723' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:03.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:03 gibba020 bash[25448]: audit 2021-03-10T17:11:02.228420+0000 mgr.gibba020.yqfnwy (mgr.34427) 10439 : audit [DBG] from='client.61033 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:11:03.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:03 gibba020 bash[25448]: audit 2021-03-10T17:11:02.455594+0000 mgr.gibba020.yqfnwy (mgr.34427) 10440 : audit [DBG] from='client.61039 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:11:03.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:03 gibba020 bash[25448]: audit 2021-03-10T17:11:02.726030+0000 mon.a (mon.0) 3711 : audit [DBG] from='client.? 172.21.2.113:0/3139008723' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:04.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:04 gibba013 bash[29418]: cluster 2021-03-10T17:11:03.121443+0000 mgr.gibba020.yqfnwy (mgr.34427) 10441 : cluster [DBG] pgmap v5949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:04.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:04 gibba013 bash[30381]: cluster 2021-03-10T17:11:03.121443+0000 mgr.gibba020.yqfnwy (mgr.34427) 10441 : cluster [DBG] pgmap v5949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:04.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:04 gibba020 bash[25448]: cluster 2021-03-10T17:11:03.121443+0000 mgr.gibba020.yqfnwy (mgr.34427) 10441 : cluster [DBG] pgmap v5949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:06.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:06 gibba013 bash[29418]: cluster 2021-03-10T17:11:05.123258+0000 mgr.gibba020.yqfnwy (mgr.34427) 10442 : cluster [DBG] pgmap v5950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:06.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:06 gibba013 bash[30381]: cluster 2021-03-10T17:11:05.123258+0000 mgr.gibba020.yqfnwy (mgr.34427) 10442 : cluster [DBG] pgmap v5950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:06.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:06 gibba020 bash[25448]: cluster 2021-03-10T17:11:05.123258+0000 mgr.gibba020.yqfnwy (mgr.34427) 10442 : cluster [DBG] pgmap v5950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:07.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:07 gibba013 bash[29418]: audit 2021-03-10T17:11:06.915411+0000 mon.a (mon.0) 3712 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:11:07.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:07 gibba013 bash[29418]: audit 2021-03-10T17:11:07.127759+0000 mon.a (mon.0) 3713 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:11:07.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:07 gibba013 bash[29418]: audit 2021-03-10T17:11:07.534279+0000 mon.a (mon.0) 3714 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:11:07.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:07 gibba013 bash[29418]: audit 2021-03-10T17:11:07.535019+0000 mon.a (mon.0) 3715 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:11:07.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:07 gibba013 bash[29418]: audit 2021-03-10T17:11:07.535672+0000 mon.a (mon.0) 3716 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:11:07.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:07 gibba013 bash[29418]: audit 2021-03-10T17:11:07.536324+0000 mon.a (mon.0) 3717 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:11:07.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:07 gibba013 bash[30381]: audit 2021-03-10T17:11:06.915411+0000 mon.a (mon.0) 3712 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:11:07.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:07 gibba013 bash[30381]: audit 2021-03-10T17:11:07.127759+0000 mon.a (mon.0) 3713 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:11:07.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:07 gibba013 bash[30381]: audit 2021-03-10T17:11:07.534279+0000 mon.a (mon.0) 3714 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:11:07.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:07 gibba013 bash[30381]: audit 2021-03-10T17:11:07.535019+0000 mon.a (mon.0) 3715 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:11:07.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:07 gibba013 bash[30381]: audit 2021-03-10T17:11:07.535672+0000 mon.a (mon.0) 3716 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:11:07.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:07 gibba013 bash[30381]: audit 2021-03-10T17:11:07.536324+0000 mon.a (mon.0) 3717 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:11:07.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:07 gibba020 bash[25448]: audit 2021-03-10T17:11:06.915411+0000 mon.a (mon.0) 3712 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:11:07.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:07 gibba020 bash[25448]: audit 2021-03-10T17:11:07.127759+0000 mon.a (mon.0) 3713 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:11:07.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:07 gibba020 bash[25448]: audit 2021-03-10T17:11:07.534279+0000 mon.a (mon.0) 3714 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:11:07.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:07 gibba020 bash[25448]: audit 2021-03-10T17:11:07.535019+0000 mon.a (mon.0) 3715 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:11:07.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:07 gibba020 bash[25448]: audit 2021-03-10T17:11:07.535672+0000 mon.a (mon.0) 3716 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:11:07.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:07 gibba020 bash[25448]: audit 2021-03-10T17:11:07.536324+0000 mon.a (mon.0) 3717 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:11:08.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:08 gibba013 bash[29418]: cluster 2021-03-10T17:11:07.124658+0000 mgr.gibba020.yqfnwy (mgr.34427) 10443 : cluster [DBG] pgmap v5951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:08.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:08 gibba013 bash[30381]: cluster 2021-03-10T17:11:07.124658+0000 mgr.gibba020.yqfnwy (mgr.34427) 10443 : cluster [DBG] pgmap v5951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:08.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:08 gibba020 bash[25448]: cluster 2021-03-10T17:11:07.124658+0000 mgr.gibba020.yqfnwy (mgr.34427) 10443 : cluster [DBG] pgmap v5951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:10.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:10 gibba013 bash[29418]: cluster 2021-03-10T17:11:09.126313+0000 mgr.gibba020.yqfnwy (mgr.34427) 10444 : cluster [DBG] pgmap v5952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:10.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:10 gibba013 bash[30381]: cluster 2021-03-10T17:11:09.126313+0000 mgr.gibba020.yqfnwy (mgr.34427) 10444 : cluster [DBG] pgmap v5952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:10.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:10 gibba020 bash[25448]: cluster 2021-03-10T17:11:09.126313+0000 mgr.gibba020.yqfnwy (mgr.34427) 10444 : cluster [DBG] pgmap v5952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:12.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:12 gibba013 bash[29418]: cephadm 2021-03-10T17:11:11.078272+0000 mgr.gibba020.yqfnwy (mgr.34427) 10445 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:11:12.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:12 gibba013 bash[29418]: cluster 2021-03-10T17:11:11.128167+0000 mgr.gibba020.yqfnwy (mgr.34427) 10446 : cluster [DBG] pgmap v5953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:12.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:12 gibba013 bash[30381]: cephadm 2021-03-10T17:11:11.078272+0000 mgr.gibba020.yqfnwy (mgr.34427) 10445 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:11:12.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:12 gibba013 bash[30381]: cluster 2021-03-10T17:11:11.128167+0000 mgr.gibba020.yqfnwy (mgr.34427) 10446 : cluster [DBG] pgmap v5953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:12.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:12 gibba020 bash[25448]: cephadm 2021-03-10T17:11:11.078272+0000 mgr.gibba020.yqfnwy (mgr.34427) 10445 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:11:12.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:12 gibba020 bash[25448]: cluster 2021-03-10T17:11:11.128167+0000 mgr.gibba020.yqfnwy (mgr.34427) 10446 : cluster [DBG] pgmap v5953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:14.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:14 gibba013 bash[29418]: cluster 2021-03-10T17:11:13.129372+0000 mgr.gibba020.yqfnwy (mgr.34427) 10447 : cluster [DBG] pgmap v5954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:14.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:14 gibba013 bash[30381]: cluster 2021-03-10T17:11:13.129372+0000 mgr.gibba020.yqfnwy (mgr.34427) 10447 : cluster [DBG] pgmap v5954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:14.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:14 gibba020 bash[25448]: cluster 2021-03-10T17:11:13.129372+0000 mgr.gibba020.yqfnwy (mgr.34427) 10447 : cluster [DBG] pgmap v5954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:16.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:16 gibba013 bash[29418]: cluster 2021-03-10T17:11:15.131080+0000 mgr.gibba020.yqfnwy (mgr.34427) 10448 : cluster [DBG] pgmap v5955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:16.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:16 gibba013 bash[30381]: cluster 2021-03-10T17:11:15.131080+0000 mgr.gibba020.yqfnwy (mgr.34427) 10448 : cluster [DBG] pgmap v5955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:16.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:16 gibba020 bash[25448]: cluster 2021-03-10T17:11:15.131080+0000 mgr.gibba020.yqfnwy (mgr.34427) 10448 : cluster [DBG] pgmap v5955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:17.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:17 gibba020 bash[25448]: cluster 2021-03-10T17:11:17.132389+0000 mgr.gibba020.yqfnwy (mgr.34427) 10449 : cluster [DBG] pgmap v5956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:18.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:17 gibba013 bash[29418]: cluster 2021-03-10T17:11:17.132389+0000 mgr.gibba020.yqfnwy (mgr.34427) 10449 : cluster [DBG] pgmap v5956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:18.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:17 gibba013 bash[30381]: cluster 2021-03-10T17:11:17.132389+0000 mgr.gibba020.yqfnwy (mgr.34427) 10449 : cluster [DBG] pgmap v5956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:20.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:20 gibba020 bash[25448]: cluster 2021-03-10T17:11:19.133831+0000 mgr.gibba020.yqfnwy (mgr.34427) 10450 : cluster [DBG] pgmap v5957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:20.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:20 gibba013 bash[29418]: cluster 2021-03-10T17:11:19.133831+0000 mgr.gibba020.yqfnwy (mgr.34427) 10450 : cluster [DBG] pgmap v5957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:20.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:20 gibba013 bash[30381]: cluster 2021-03-10T17:11:19.133831+0000 mgr.gibba020.yqfnwy (mgr.34427) 10450 : cluster [DBG] pgmap v5957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:22.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:22 gibba013 bash[29418]: cluster 2021-03-10T17:11:21.135564+0000 mgr.gibba020.yqfnwy (mgr.34427) 10451 : cluster [DBG] pgmap v5958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:22.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:22 gibba013 bash[30381]: cluster 2021-03-10T17:11:21.135564+0000 mgr.gibba020.yqfnwy (mgr.34427) 10451 : cluster [DBG] pgmap v5958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:22.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:22 gibba020 bash[25448]: cluster 2021-03-10T17:11:21.135564+0000 mgr.gibba020.yqfnwy (mgr.34427) 10451 : cluster [DBG] pgmap v5958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:24.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:24 gibba013 bash[29418]: cluster 2021-03-10T17:11:23.136756+0000 mgr.gibba020.yqfnwy (mgr.34427) 10452 : cluster [DBG] pgmap v5959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:24.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:24 gibba013 bash[30381]: cluster 2021-03-10T17:11:23.136756+0000 mgr.gibba020.yqfnwy (mgr.34427) 10452 : cluster [DBG] pgmap v5959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:24.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:24 gibba020 bash[25448]: cluster 2021-03-10T17:11:23.136756+0000 mgr.gibba020.yqfnwy (mgr.34427) 10452 : cluster [DBG] pgmap v5959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:26.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:26 gibba013 bash[29418]: cluster 2021-03-10T17:11:25.138345+0000 mgr.gibba020.yqfnwy (mgr.34427) 10453 : cluster [DBG] pgmap v5960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:26.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:26 gibba013 bash[29418]: audit 2021-03-10T17:11:26.089009+0000 mon.a (mon.0) 3718 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:11:26.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:26 gibba013 bash[29418]: audit 2021-03-10T17:11:26.096215+0000 mon.a (mon.0) 3719 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:11:26.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:26 gibba013 bash[30381]: cluster 2021-03-10T17:11:25.138345+0000 mgr.gibba020.yqfnwy (mgr.34427) 10453 : cluster [DBG] pgmap v5960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:26.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:26 gibba013 bash[30381]: audit 2021-03-10T17:11:26.089009+0000 mon.a (mon.0) 3718 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:11:26.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:26 gibba013 bash[30381]: audit 2021-03-10T17:11:26.096215+0000 mon.a (mon.0) 3719 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:11:26.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:26 gibba020 bash[25448]: cluster 2021-03-10T17:11:25.138345+0000 mgr.gibba020.yqfnwy (mgr.34427) 10453 : cluster [DBG] pgmap v5960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:26.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:26 gibba020 bash[25448]: audit 2021-03-10T17:11:26.089009+0000 mon.a (mon.0) 3718 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:11:26.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:26 gibba020 bash[25448]: audit 2021-03-10T17:11:26.096215+0000 mon.a (mon.0) 3719 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:11:27.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:27 gibba013 bash[29418]: cephadm 2021-03-10T17:11:26.095096+0000 mgr.gibba020.yqfnwy (mgr.34427) 10454 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:11:27.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:27 gibba013 bash[30381]: cephadm 2021-03-10T17:11:26.095096+0000 mgr.gibba020.yqfnwy (mgr.34427) 10454 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:11:27.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:27 gibba020 bash[25448]: cephadm 2021-03-10T17:11:26.095096+0000 mgr.gibba020.yqfnwy (mgr.34427) 10454 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:11:28.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:28 gibba013 bash[29418]: cluster 2021-03-10T17:11:27.139494+0000 mgr.gibba020.yqfnwy (mgr.34427) 10455 : cluster [DBG] pgmap v5961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:28.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:28 gibba013 bash[30381]: cluster 2021-03-10T17:11:27.139494+0000 mgr.gibba020.yqfnwy (mgr.34427) 10455 : cluster [DBG] pgmap v5961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:28.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:28 gibba020 bash[25448]: cluster 2021-03-10T17:11:27.139494+0000 mgr.gibba020.yqfnwy (mgr.34427) 10455 : cluster [DBG] pgmap v5961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:30.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:30 gibba013 bash[29418]: cluster 2021-03-10T17:11:29.140952+0000 mgr.gibba020.yqfnwy (mgr.34427) 10456 : cluster [DBG] pgmap v5962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:30.892 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:30 gibba013 bash[29418]: audit 2021-03-10T17:11:29.534911+0000 mon.a (mon.0) 3720 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:11:30.893 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:30 gibba013 bash[29418]: cephadm 2021-03-10T17:11:29.534979+0000 mgr.gibba020.yqfnwy (mgr.34427) 10457 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:11:30.893 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:30 gibba013 bash[29418]: audit 2021-03-10T17:11:29.743166+0000 mon.a (mon.0) 3721 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:11:30.893 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:30 gibba013 bash[29418]: audit 2021-03-10T17:11:29.750905+0000 mon.a (mon.0) 3722 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:11:30.893 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:30 gibba013 bash[29418]: audit 2021-03-10T17:11:29.752764+0000 mon.a (mon.0) 3723 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:30.894 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:30 gibba013 bash[29418]: audit 2021-03-10T17:11:29.754624+0000 mon.a (mon.0) 3724 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:30.894 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:30 gibba013 bash[29418]: audit 2021-03-10T17:11:29.756014+0000 mon.a (mon.0) 3725 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:30.894 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:30 gibba013 bash[29418]: audit 2021-03-10T17:11:29.758805+0000 mon.a (mon.0) 3726 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:30.894 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:30 gibba013 bash[29418]: audit 2021-03-10T17:11:29.760513+0000 mon.a (mon.0) 3727 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:30.895 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:30 gibba013 bash[30381]: cluster 2021-03-10T17:11:29.140952+0000 mgr.gibba020.yqfnwy (mgr.34427) 10456 : cluster [DBG] pgmap v5962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:30.895 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:30 gibba013 bash[30381]: audit 2021-03-10T17:11:29.534911+0000 mon.a (mon.0) 3720 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:11:30.895 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:30 gibba013 bash[30381]: cephadm 2021-03-10T17:11:29.534979+0000 mgr.gibba020.yqfnwy (mgr.34427) 10457 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:11:30.895 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:30 gibba013 bash[30381]: audit 2021-03-10T17:11:29.743166+0000 mon.a (mon.0) 3721 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:11:30.896 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:30 gibba013 bash[30381]: audit 2021-03-10T17:11:29.750905+0000 mon.a (mon.0) 3722 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:11:30.896 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:30 gibba013 bash[30381]: audit 2021-03-10T17:11:29.752764+0000 mon.a (mon.0) 3723 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:30.896 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:30 gibba013 bash[30381]: audit 2021-03-10T17:11:29.754624+0000 mon.a (mon.0) 3724 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:30.896 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:30 gibba013 bash[30381]: audit 2021-03-10T17:11:29.756014+0000 mon.a (mon.0) 3725 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:30.896 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:30 gibba013 bash[30381]: audit 2021-03-10T17:11:29.758805+0000 mon.a (mon.0) 3726 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:30.897 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:30 gibba013 bash[30381]: audit 2021-03-10T17:11:29.760513+0000 mon.a (mon.0) 3727 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:30.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:30 gibba020 bash[25448]: cluster 2021-03-10T17:11:29.140952+0000 mgr.gibba020.yqfnwy (mgr.34427) 10456 : cluster [DBG] pgmap v5962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:30.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:30 gibba020 bash[25448]: audit 2021-03-10T17:11:29.534911+0000 mon.a (mon.0) 3720 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:11:30.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:30 gibba020 bash[25448]: cephadm 2021-03-10T17:11:29.534979+0000 mgr.gibba020.yqfnwy (mgr.34427) 10457 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:11:30.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:30 gibba020 bash[25448]: audit 2021-03-10T17:11:29.743166+0000 mon.a (mon.0) 3721 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:11:30.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:30 gibba020 bash[25448]: audit 2021-03-10T17:11:29.750905+0000 mon.a (mon.0) 3722 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:11:30.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:30 gibba020 bash[25448]: audit 2021-03-10T17:11:29.752764+0000 mon.a (mon.0) 3723 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:30.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:30 gibba020 bash[25448]: audit 2021-03-10T17:11:29.754624+0000 mon.a (mon.0) 3724 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:30.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:30 gibba020 bash[25448]: audit 2021-03-10T17:11:29.756014+0000 mon.a (mon.0) 3725 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:30.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:30 gibba020 bash[25448]: audit 2021-03-10T17:11:29.758805+0000 mon.a (mon.0) 3726 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:30.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:30 gibba020 bash[25448]: audit 2021-03-10T17:11:29.760513+0000 mon.a (mon.0) 3727 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:31.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:31 gibba013 bash[29418]: cephadm 2021-03-10T17:11:29.749518+0000 mgr.gibba020.yqfnwy (mgr.34427) 10458 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:11:31.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:31 gibba013 bash[29418]: cephadm 2021-03-10T17:11:29.751802+0000 mgr.gibba020.yqfnwy (mgr.34427) 10459 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:11:31.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:31 gibba013 bash[29418]: cephadm 2021-03-10T17:11:29.753500+0000 mgr.gibba020.yqfnwy (mgr.34427) 10460 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:11:31.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:31 gibba013 bash[29418]: cephadm 2021-03-10T17:11:29.753541+0000 mgr.gibba020.yqfnwy (mgr.34427) 10461 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:11:31.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:31 gibba013 bash[29418]: cephadm 2021-03-10T17:11:29.755099+0000 mgr.gibba020.yqfnwy (mgr.34427) 10462 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:11:31.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:31 gibba013 bash[29418]: cephadm 2021-03-10T17:11:29.755135+0000 mgr.gibba020.yqfnwy (mgr.34427) 10463 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:11:31.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:31 gibba013 bash[29418]: cephadm 2021-03-10T17:11:29.756484+0000 mgr.gibba020.yqfnwy (mgr.34427) 10464 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:11:31.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:31 gibba013 bash[29418]: cephadm 2021-03-10T17:11:29.757727+0000 mgr.gibba020.yqfnwy (mgr.34427) 10465 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:11:31.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:31 gibba013 bash[29418]: cephadm 2021-03-10T17:11:29.757766+0000 mgr.gibba020.yqfnwy (mgr.34427) 10466 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:11:31.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:31 gibba013 bash[29418]: cephadm 2021-03-10T17:11:29.759280+0000 mgr.gibba020.yqfnwy (mgr.34427) 10467 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:11:31.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:31 gibba013 bash[29418]: cephadm 2021-03-10T17:11:29.759629+0000 mgr.gibba020.yqfnwy (mgr.34427) 10468 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:11:31.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:31 gibba013 bash[29418]: cephadm 2021-03-10T17:11:29.760852+0000 mgr.gibba020.yqfnwy (mgr.34427) 10469 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:11:31.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:31 gibba013 bash[29418]: cephadm 2021-03-10T17:11:29.760892+0000 mgr.gibba020.yqfnwy (mgr.34427) 10470 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:11:31.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:31 gibba013 bash[29418]: cephadm 2021-03-10T17:11:29.761007+0000 mgr.gibba020.yqfnwy (mgr.34427) 10471 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:11:31.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:31 gibba013 bash[30381]: cephadm 2021-03-10T17:11:29.749518+0000 mgr.gibba020.yqfnwy (mgr.34427) 10458 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:11:31.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:31 gibba013 bash[30381]: cephadm 2021-03-10T17:11:29.751802+0000 mgr.gibba020.yqfnwy (mgr.34427) 10459 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:11:31.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:31 gibba013 bash[30381]: cephadm 2021-03-10T17:11:29.753500+0000 mgr.gibba020.yqfnwy (mgr.34427) 10460 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:11:31.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:31 gibba013 bash[30381]: cephadm 2021-03-10T17:11:29.753541+0000 mgr.gibba020.yqfnwy (mgr.34427) 10461 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:11:31.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:31 gibba013 bash[30381]: cephadm 2021-03-10T17:11:29.755099+0000 mgr.gibba020.yqfnwy (mgr.34427) 10462 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:11:31.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:31 gibba013 bash[30381]: cephadm 2021-03-10T17:11:29.755135+0000 mgr.gibba020.yqfnwy (mgr.34427) 10463 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:11:31.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:31 gibba013 bash[30381]: cephadm 2021-03-10T17:11:29.756484+0000 mgr.gibba020.yqfnwy (mgr.34427) 10464 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:11:31.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:31 gibba013 bash[30381]: cephadm 2021-03-10T17:11:29.757727+0000 mgr.gibba020.yqfnwy (mgr.34427) 10465 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:11:31.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:31 gibba013 bash[30381]: cephadm 2021-03-10T17:11:29.757766+0000 mgr.gibba020.yqfnwy (mgr.34427) 10466 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:11:31.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:31 gibba013 bash[30381]: cephadm 2021-03-10T17:11:29.759280+0000 mgr.gibba020.yqfnwy (mgr.34427) 10467 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:11:31.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:31 gibba013 bash[30381]: cephadm 2021-03-10T17:11:29.759629+0000 mgr.gibba020.yqfnwy (mgr.34427) 10468 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:11:31.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:31 gibba013 bash[30381]: cephadm 2021-03-10T17:11:29.760852+0000 mgr.gibba020.yqfnwy (mgr.34427) 10469 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:11:31.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:31 gibba013 bash[30381]: cephadm 2021-03-10T17:11:29.760892+0000 mgr.gibba020.yqfnwy (mgr.34427) 10470 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:11:31.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:31 gibba013 bash[30381]: cephadm 2021-03-10T17:11:29.761007+0000 mgr.gibba020.yqfnwy (mgr.34427) 10471 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:11:31.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:31 gibba020 bash[25448]: cephadm 2021-03-10T17:11:29.749518+0000 mgr.gibba020.yqfnwy (mgr.34427) 10458 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:11:31.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:31 gibba020 bash[25448]: cephadm 2021-03-10T17:11:29.751802+0000 mgr.gibba020.yqfnwy (mgr.34427) 10459 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:11:31.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:31 gibba020 bash[25448]: cephadm 2021-03-10T17:11:29.753500+0000 mgr.gibba020.yqfnwy (mgr.34427) 10460 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:11:31.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:31 gibba020 bash[25448]: cephadm 2021-03-10T17:11:29.753541+0000 mgr.gibba020.yqfnwy (mgr.34427) 10461 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:11:31.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:31 gibba020 bash[25448]: cephadm 2021-03-10T17:11:29.755099+0000 mgr.gibba020.yqfnwy (mgr.34427) 10462 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:11:31.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:31 gibba020 bash[25448]: cephadm 2021-03-10T17:11:29.755135+0000 mgr.gibba020.yqfnwy (mgr.34427) 10463 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:11:31.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:31 gibba020 bash[25448]: cephadm 2021-03-10T17:11:29.756484+0000 mgr.gibba020.yqfnwy (mgr.34427) 10464 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:11:31.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:31 gibba020 bash[25448]: cephadm 2021-03-10T17:11:29.757727+0000 mgr.gibba020.yqfnwy (mgr.34427) 10465 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:11:31.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:31 gibba020 bash[25448]: cephadm 2021-03-10T17:11:29.757766+0000 mgr.gibba020.yqfnwy (mgr.34427) 10466 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:11:31.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:31 gibba020 bash[25448]: cephadm 2021-03-10T17:11:29.759280+0000 mgr.gibba020.yqfnwy (mgr.34427) 10467 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:11:31.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:31 gibba020 bash[25448]: cephadm 2021-03-10T17:11:29.759629+0000 mgr.gibba020.yqfnwy (mgr.34427) 10468 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:11:31.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:31 gibba020 bash[25448]: cephadm 2021-03-10T17:11:29.760852+0000 mgr.gibba020.yqfnwy (mgr.34427) 10469 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:11:31.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:31 gibba020 bash[25448]: cephadm 2021-03-10T17:11:29.760892+0000 mgr.gibba020.yqfnwy (mgr.34427) 10470 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:11:31.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:31 gibba020 bash[25448]: cephadm 2021-03-10T17:11:29.761007+0000 mgr.gibba020.yqfnwy (mgr.34427) 10471 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:11:32.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:32 gibba013 bash[29418]: cluster 2021-03-10T17:11:31.142486+0000 mgr.gibba020.yqfnwy (mgr.34427) 10472 : cluster [DBG] pgmap v5963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:32.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:32 gibba013 bash[30381]: cluster 2021-03-10T17:11:31.142486+0000 mgr.gibba020.yqfnwy (mgr.34427) 10472 : cluster [DBG] pgmap v5963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:32.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:32 gibba020 bash[25448]: cluster 2021-03-10T17:11:31.142486+0000 mgr.gibba020.yqfnwy (mgr.34427) 10472 : cluster [DBG] pgmap v5963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:32.973 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:11:33.196 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:11:33.197 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 3s ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:11:33.197 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 9m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:11:33.197 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:11:33.198 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:11:33.198 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 3s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:11:33.198 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 3s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:11:33.198 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:11:33.199 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 3s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:11:33.199 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 3s ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:11:33.199 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:11:33.199 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 3s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:11:33.199 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 3s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:11:33.200 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 3s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:11:33.200 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 3s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:11:33.200 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:11:33.200 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:11:33.200 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:11:33.201 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:11:33.201 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 9m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:11:33.201 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 9m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:11:33.446 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:11:33.447 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:11:33.447 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:11:33.447 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:11:33.447 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:11:33.448 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:11:33.448 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:11:33.448 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:11:33.448 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:11:33.448 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:11:33.449 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:11:33.449 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:11:33.449 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:11:33.449 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:11:33.450 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:11:33.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:33 gibba013 bash[29418]: audit 2021-03-10T17:11:33.445745+0000 mon.a (mon.0) 3728 : audit [DBG] from='client.? 172.21.2.113:0/2698199637' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:33.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:33 gibba013 bash[30381]: audit 2021-03-10T17:11:33.445745+0000 mon.a (mon.0) 3728 : audit [DBG] from='client.? 172.21.2.113:0/2698199637' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:33.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:33 gibba020 bash[25448]: audit 2021-03-10T17:11:33.445745+0000 mon.a (mon.0) 3728 : audit [DBG] from='client.? 172.21.2.113:0/2698199637' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:11:34.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:34 gibba013 bash[29418]: audit 2021-03-10T17:11:32.960112+0000 mgr.gibba020.yqfnwy (mgr.34427) 10473 : audit [DBG] from='client.51072 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:11:34.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:34 gibba013 bash[29418]: cluster 2021-03-10T17:11:33.143783+0000 mgr.gibba020.yqfnwy (mgr.34427) 10474 : cluster [DBG] pgmap v5964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:34.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:34 gibba013 bash[29418]: audit 2021-03-10T17:11:33.182586+0000 mgr.gibba020.yqfnwy (mgr.34427) 10475 : audit [DBG] from='client.51078 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:11:34.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:34 gibba013 bash[30381]: audit 2021-03-10T17:11:32.960112+0000 mgr.gibba020.yqfnwy (mgr.34427) 10473 : audit [DBG] from='client.51072 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:11:34.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:34 gibba013 bash[30381]: cluster 2021-03-10T17:11:33.143783+0000 mgr.gibba020.yqfnwy (mgr.34427) 10474 : cluster [DBG] pgmap v5964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:34.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:34 gibba013 bash[30381]: audit 2021-03-10T17:11:33.182586+0000 mgr.gibba020.yqfnwy (mgr.34427) 10475 : audit [DBG] from='client.51078 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:11:34.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:34 gibba020 bash[25448]: audit 2021-03-10T17:11:32.960112+0000 mgr.gibba020.yqfnwy (mgr.34427) 10473 : audit [DBG] from='client.51072 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:11:34.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:34 gibba020 bash[25448]: cluster 2021-03-10T17:11:33.143783+0000 mgr.gibba020.yqfnwy (mgr.34427) 10474 : cluster [DBG] pgmap v5964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:34.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:34 gibba020 bash[25448]: audit 2021-03-10T17:11:33.182586+0000 mgr.gibba020.yqfnwy (mgr.34427) 10475 : audit [DBG] from='client.51078 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:11:36.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:36 gibba013 bash[29418]: cluster 2021-03-10T17:11:35.145643+0000 mgr.gibba020.yqfnwy (mgr.34427) 10476 : cluster [DBG] pgmap v5965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:36.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:36 gibba013 bash[30381]: cluster 2021-03-10T17:11:35.145643+0000 mgr.gibba020.yqfnwy (mgr.34427) 10476 : cluster [DBG] pgmap v5965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:36.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:36 gibba020 bash[25448]: cluster 2021-03-10T17:11:35.145643+0000 mgr.gibba020.yqfnwy (mgr.34427) 10476 : cluster [DBG] pgmap v5965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:38.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:38 gibba013 bash[29418]: cluster 2021-03-10T17:11:37.146944+0000 mgr.gibba020.yqfnwy (mgr.34427) 10477 : cluster [DBG] pgmap v5966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:38.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:38 gibba013 bash[30381]: cluster 2021-03-10T17:11:37.146944+0000 mgr.gibba020.yqfnwy (mgr.34427) 10477 : cluster [DBG] pgmap v5966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:38.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:38 gibba020 bash[25448]: cluster 2021-03-10T17:11:37.146944+0000 mgr.gibba020.yqfnwy (mgr.34427) 10477 : cluster [DBG] pgmap v5966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:39.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:39 gibba013 bash[29418]: cluster 2021-03-10T17:11:39.148649+0000 mgr.gibba020.yqfnwy (mgr.34427) 10478 : cluster [DBG] pgmap v5967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:39.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:39 gibba013 bash[30381]: cluster 2021-03-10T17:11:39.148649+0000 mgr.gibba020.yqfnwy (mgr.34427) 10478 : cluster [DBG] pgmap v5967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:39.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:39 gibba020 bash[25448]: cluster 2021-03-10T17:11:39.148649+0000 mgr.gibba020.yqfnwy (mgr.34427) 10478 : cluster [DBG] pgmap v5967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:42.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:42 gibba013 bash[29418]: cluster 2021-03-10T17:11:41.150278+0000 mgr.gibba020.yqfnwy (mgr.34427) 10479 : cluster [DBG] pgmap v5968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:42.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:42 gibba013 bash[30381]: cluster 2021-03-10T17:11:41.150278+0000 mgr.gibba020.yqfnwy (mgr.34427) 10479 : cluster [DBG] pgmap v5968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:42.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:42 gibba020 bash[25448]: cluster 2021-03-10T17:11:41.150278+0000 mgr.gibba020.yqfnwy (mgr.34427) 10479 : cluster [DBG] pgmap v5968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:44.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:44 gibba013 bash[29418]: cluster 2021-03-10T17:11:43.151509+0000 mgr.gibba020.yqfnwy (mgr.34427) 10480 : cluster [DBG] pgmap v5969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:44.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:44 gibba013 bash[30381]: cluster 2021-03-10T17:11:43.151509+0000 mgr.gibba020.yqfnwy (mgr.34427) 10480 : cluster [DBG] pgmap v5969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:44.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:44 gibba020 bash[25448]: cluster 2021-03-10T17:11:43.151509+0000 mgr.gibba020.yqfnwy (mgr.34427) 10480 : cluster [DBG] pgmap v5969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:46.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:46 gibba013 bash[29418]: cephadm 2021-03-10T17:11:44.777022+0000 mgr.gibba020.yqfnwy (mgr.34427) 10481 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:11:46.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:46 gibba013 bash[29418]: cluster 2021-03-10T17:11:45.153378+0000 mgr.gibba020.yqfnwy (mgr.34427) 10482 : cluster [DBG] pgmap v5970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:46.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:46 gibba013 bash[30381]: cephadm 2021-03-10T17:11:44.777022+0000 mgr.gibba020.yqfnwy (mgr.34427) 10481 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:11:46.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:46 gibba013 bash[30381]: cluster 2021-03-10T17:11:45.153378+0000 mgr.gibba020.yqfnwy (mgr.34427) 10482 : cluster [DBG] pgmap v5970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:46.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:46 gibba020 bash[25448]: cephadm 2021-03-10T17:11:44.777022+0000 mgr.gibba020.yqfnwy (mgr.34427) 10481 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:11:46.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:46 gibba020 bash[25448]: cluster 2021-03-10T17:11:45.153378+0000 mgr.gibba020.yqfnwy (mgr.34427) 10482 : cluster [DBG] pgmap v5970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:48.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:48 gibba013 bash[29418]: cluster 2021-03-10T17:11:47.153916+0000 mgr.gibba020.yqfnwy (mgr.34427) 10483 : cluster [DBG] pgmap v5971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:48.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:48 gibba013 bash[30381]: cluster 2021-03-10T17:11:47.153916+0000 mgr.gibba020.yqfnwy (mgr.34427) 10483 : cluster [DBG] pgmap v5971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:48.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:48 gibba020 bash[25448]: cluster 2021-03-10T17:11:47.153916+0000 mgr.gibba020.yqfnwy (mgr.34427) 10483 : cluster [DBG] pgmap v5971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:50.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:50 gibba013 bash[29418]: cluster 2021-03-10T17:11:49.155403+0000 mgr.gibba020.yqfnwy (mgr.34427) 10484 : cluster [DBG] pgmap v5972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:50.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:50 gibba013 bash[30381]: cluster 2021-03-10T17:11:49.155403+0000 mgr.gibba020.yqfnwy (mgr.34427) 10484 : cluster [DBG] pgmap v5972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:50.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:50 gibba020 bash[25448]: cluster 2021-03-10T17:11:49.155403+0000 mgr.gibba020.yqfnwy (mgr.34427) 10484 : cluster [DBG] pgmap v5972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:52.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:52 gibba013 bash[29418]: cluster 2021-03-10T17:11:51.157001+0000 mgr.gibba020.yqfnwy (mgr.34427) 10485 : cluster [DBG] pgmap v5973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:52.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:52 gibba013 bash[30381]: cluster 2021-03-10T17:11:51.157001+0000 mgr.gibba020.yqfnwy (mgr.34427) 10485 : cluster [DBG] pgmap v5973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:52.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:52 gibba020 bash[25448]: cluster 2021-03-10T17:11:51.157001+0000 mgr.gibba020.yqfnwy (mgr.34427) 10485 : cluster [DBG] pgmap v5973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:53.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:53 gibba013 bash[29418]: cluster 2021-03-10T17:11:53.157661+0000 mgr.gibba020.yqfnwy (mgr.34427) 10486 : cluster [DBG] pgmap v5974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:53.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:53 gibba013 bash[30381]: cluster 2021-03-10T17:11:53.157661+0000 mgr.gibba020.yqfnwy (mgr.34427) 10486 : cluster [DBG] pgmap v5974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:53.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:53 gibba020 bash[25448]: cluster 2021-03-10T17:11:53.157661+0000 mgr.gibba020.yqfnwy (mgr.34427) 10486 : cluster [DBG] pgmap v5974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:56.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:56 gibba013 bash[29418]: cluster 2021-03-10T17:11:55.159407+0000 mgr.gibba020.yqfnwy (mgr.34427) 10487 : cluster [DBG] pgmap v5975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:56.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:56 gibba013 bash[30381]: cluster 2021-03-10T17:11:55.159407+0000 mgr.gibba020.yqfnwy (mgr.34427) 10487 : cluster [DBG] pgmap v5975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:56.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:56 gibba020 bash[25448]: cluster 2021-03-10T17:11:55.159407+0000 mgr.gibba020.yqfnwy (mgr.34427) 10487 : cluster [DBG] pgmap v5975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:58.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:11:58 gibba013 bash[29418]: cluster 2021-03-10T17:11:57.160807+0000 mgr.gibba020.yqfnwy (mgr.34427) 10488 : cluster [DBG] pgmap v5976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:58.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:11:58 gibba013 bash[30381]: cluster 2021-03-10T17:11:57.160807+0000 mgr.gibba020.yqfnwy (mgr.34427) 10488 : cluster [DBG] pgmap v5976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:11:58.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:11:58 gibba020 bash[25448]: cluster 2021-03-10T17:11:57.160807+0000 mgr.gibba020.yqfnwy (mgr.34427) 10488 : cluster [DBG] pgmap v5976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:00.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:00 gibba013 bash[29418]: cluster 2021-03-10T17:11:59.161463+0000 mgr.gibba020.yqfnwy (mgr.34427) 10489 : cluster [DBG] pgmap v5977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:00.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:00 gibba013 bash[30381]: cluster 2021-03-10T17:11:59.161463+0000 mgr.gibba020.yqfnwy (mgr.34427) 10489 : cluster [DBG] pgmap v5977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:00.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:00 gibba020 bash[25448]: cluster 2021-03-10T17:11:59.161463+0000 mgr.gibba020.yqfnwy (mgr.34427) 10489 : cluster [DBG] pgmap v5977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:01.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:01 gibba013 bash[29418]: cephadm 2021-03-10T17:11:59.792853+0000 mgr.gibba020.yqfnwy (mgr.34427) 10490 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:12:01.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:01 gibba013 bash[30381]: cephadm 2021-03-10T17:11:59.792853+0000 mgr.gibba020.yqfnwy (mgr.34427) 10490 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:12:01.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:01 gibba020 bash[25448]: cephadm 2021-03-10T17:11:59.792853+0000 mgr.gibba020.yqfnwy (mgr.34427) 10490 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:12:02.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:02 gibba013 bash[29418]: cluster 2021-03-10T17:12:01.163260+0000 mgr.gibba020.yqfnwy (mgr.34427) 10491 : cluster [DBG] pgmap v5978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:02.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:02 gibba013 bash[30381]: cluster 2021-03-10T17:12:01.163260+0000 mgr.gibba020.yqfnwy (mgr.34427) 10491 : cluster [DBG] pgmap v5978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:02.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:02 gibba020 bash[25448]: cluster 2021-03-10T17:12:01.163260+0000 mgr.gibba020.yqfnwy (mgr.34427) 10491 : cluster [DBG] pgmap v5978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:03.693 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:12:03.921 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:12:03.921 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 34s ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:12:03.922 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 9m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:12:03.922 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:12:03.922 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:12:03.922 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 34s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:12:03.922 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 34s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:12:03.923 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:12:03.923 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 34s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:12:03.923 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 34s ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:12:03.923 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:12:03.924 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 34s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:12:03.924 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 34s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:12:03.924 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 34s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:12:03.924 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 34s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:12:03.924 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:12:03.925 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:12:03.925 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:12:03.925 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:12:03.926 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 9m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:12:03.926 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 9m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:12:04.172 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:12:04.172 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:12:04.173 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:12:04.173 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:12:04.173 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:12:04.173 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:12:04.173 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:12:04.174 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:12:04.174 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:12:04.174 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:12:04.174 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:12:04.175 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:12:04.175 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:12:04.175 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:12:04.175 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:12:04.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:04 gibba013 bash[29418]: cluster 2021-03-10T17:12:03.164533+0000 mgr.gibba020.yqfnwy (mgr.34427) 10492 : cluster [DBG] pgmap v5979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:04.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:04 gibba013 bash[29418]: audit 2021-03-10T17:12:04.171306+0000 mon.a (mon.0) 3729 : audit [DBG] from='client.? 172.21.2.113:0/814372510' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:04.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:04 gibba013 bash[30381]: cluster 2021-03-10T17:12:03.164533+0000 mgr.gibba020.yqfnwy (mgr.34427) 10492 : cluster [DBG] pgmap v5979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:04.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:04 gibba013 bash[30381]: audit 2021-03-10T17:12:04.171306+0000 mon.a (mon.0) 3729 : audit [DBG] from='client.? 172.21.2.113:0/814372510' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:04.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:04 gibba020 bash[25448]: cluster 2021-03-10T17:12:03.164533+0000 mgr.gibba020.yqfnwy (mgr.34427) 10492 : cluster [DBG] pgmap v5979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:04.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:04 gibba020 bash[25448]: audit 2021-03-10T17:12:04.171306+0000 mon.a (mon.0) 3729 : audit [DBG] from='client.? 172.21.2.113:0/814372510' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:05.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:05 gibba013 bash[29418]: audit 2021-03-10T17:12:03.682425+0000 mgr.gibba020.yqfnwy (mgr.34427) 10493 : audit [DBG] from='client.61069 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:12:05.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:05 gibba013 bash[29418]: audit 2021-03-10T17:12:03.906461+0000 mgr.gibba020.yqfnwy (mgr.34427) 10494 : audit [DBG] from='client.51096 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:12:05.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:05 gibba013 bash[29418]: cluster 2021-03-10T17:12:05.165318+0000 mgr.gibba020.yqfnwy (mgr.34427) 10495 : cluster [DBG] pgmap v5980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:05.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:05 gibba013 bash[30381]: audit 2021-03-10T17:12:03.682425+0000 mgr.gibba020.yqfnwy (mgr.34427) 10493 : audit [DBG] from='client.61069 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:12:05.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:05 gibba013 bash[30381]: audit 2021-03-10T17:12:03.906461+0000 mgr.gibba020.yqfnwy (mgr.34427) 10494 : audit [DBG] from='client.51096 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:12:05.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:05 gibba013 bash[30381]: cluster 2021-03-10T17:12:05.165318+0000 mgr.gibba020.yqfnwy (mgr.34427) 10495 : cluster [DBG] pgmap v5980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:05.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:05 gibba020 bash[25448]: audit 2021-03-10T17:12:03.682425+0000 mgr.gibba020.yqfnwy (mgr.34427) 10493 : audit [DBG] from='client.61069 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:12:05.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:05 gibba020 bash[25448]: audit 2021-03-10T17:12:03.906461+0000 mgr.gibba020.yqfnwy (mgr.34427) 10494 : audit [DBG] from='client.51096 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:12:05.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:05 gibba020 bash[25448]: cluster 2021-03-10T17:12:05.165318+0000 mgr.gibba020.yqfnwy (mgr.34427) 10495 : cluster [DBG] pgmap v5980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:07.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:06 gibba013 bash[29418]: audit 2021-03-10T17:12:06.920451+0000 mon.a (mon.0) 3730 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:12:07.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:06 gibba013 bash[30381]: audit 2021-03-10T17:12:06.920451+0000 mon.a (mon.0) 3730 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:12:07.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:06 gibba020 bash[25448]: audit 2021-03-10T17:12:06.920451+0000 mon.a (mon.0) 3730 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:12:08.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:07 gibba013 bash[29418]: audit 2021-03-10T17:12:07.134331+0000 mon.a (mon.0) 3731 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:12:08.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:07 gibba013 bash[29418]: cluster 2021-03-10T17:12:07.166452+0000 mgr.gibba020.yqfnwy (mgr.34427) 10496 : cluster [DBG] pgmap v5981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:08.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:07 gibba013 bash[29418]: audit 2021-03-10T17:12:07.543220+0000 mon.a (mon.0) 3732 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:12:08.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:07 gibba013 bash[29418]: audit 2021-03-10T17:12:07.544016+0000 mon.a (mon.0) 3733 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:12:08.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:07 gibba013 bash[29418]: audit 2021-03-10T17:12:07.544788+0000 mon.a (mon.0) 3734 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:12:08.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:07 gibba013 bash[29418]: audit 2021-03-10T17:12:07.545555+0000 mon.a (mon.0) 3735 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:12:08.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:07 gibba013 bash[30381]: audit 2021-03-10T17:12:07.134331+0000 mon.a (mon.0) 3731 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:12:08.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:07 gibba013 bash[30381]: cluster 2021-03-10T17:12:07.166452+0000 mgr.gibba020.yqfnwy (mgr.34427) 10496 : cluster [DBG] pgmap v5981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:08.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:07 gibba013 bash[30381]: audit 2021-03-10T17:12:07.543220+0000 mon.a (mon.0) 3732 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:12:08.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:07 gibba013 bash[30381]: audit 2021-03-10T17:12:07.544016+0000 mon.a (mon.0) 3733 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:12:08.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:07 gibba013 bash[30381]: audit 2021-03-10T17:12:07.544788+0000 mon.a (mon.0) 3734 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:12:08.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:07 gibba013 bash[30381]: audit 2021-03-10T17:12:07.545555+0000 mon.a (mon.0) 3735 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:12:08.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:07 gibba020 bash[25448]: audit 2021-03-10T17:12:07.134331+0000 mon.a (mon.0) 3731 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:12:08.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:07 gibba020 bash[25448]: cluster 2021-03-10T17:12:07.166452+0000 mgr.gibba020.yqfnwy (mgr.34427) 10496 : cluster [DBG] pgmap v5981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:08.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:07 gibba020 bash[25448]: audit 2021-03-10T17:12:07.543220+0000 mon.a (mon.0) 3732 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T17:12:08.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:07 gibba020 bash[25448]: audit 2021-03-10T17:12:07.544016+0000 mon.a (mon.0) 3733 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:12:08.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:07 gibba020 bash[25448]: audit 2021-03-10T17:12:07.544788+0000 mon.a (mon.0) 3734 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:12:08.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:07 gibba020 bash[25448]: audit 2021-03-10T17:12:07.545555+0000 mon.a (mon.0) 3735 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:12:10.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:10 gibba013 bash[29418]: cluster 2021-03-10T17:12:09.168192+0000 mgr.gibba020.yqfnwy (mgr.34427) 10497 : cluster [DBG] pgmap v5982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:10.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:10 gibba013 bash[30381]: cluster 2021-03-10T17:12:09.168192+0000 mgr.gibba020.yqfnwy (mgr.34427) 10497 : cluster [DBG] pgmap v5982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:10.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:10 gibba020 bash[25448]: cluster 2021-03-10T17:12:09.168192+0000 mgr.gibba020.yqfnwy (mgr.34427) 10497 : cluster [DBG] pgmap v5982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:12.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:12 gibba013 bash[29418]: cluster 2021-03-10T17:12:11.168959+0000 mgr.gibba020.yqfnwy (mgr.34427) 10498 : cluster [DBG] pgmap v5983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:12.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:12 gibba013 bash[30381]: cluster 2021-03-10T17:12:11.168959+0000 mgr.gibba020.yqfnwy (mgr.34427) 10498 : cluster [DBG] pgmap v5983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:12.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:12 gibba020 bash[25448]: cluster 2021-03-10T17:12:11.168959+0000 mgr.gibba020.yqfnwy (mgr.34427) 10498 : cluster [DBG] pgmap v5983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:14.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:14 gibba013 bash[29418]: cluster 2021-03-10T17:12:13.170205+0000 mgr.gibba020.yqfnwy (mgr.34427) 10499 : cluster [DBG] pgmap v5984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:14.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:14 gibba013 bash[30381]: cluster 2021-03-10T17:12:13.170205+0000 mgr.gibba020.yqfnwy (mgr.34427) 10499 : cluster [DBG] pgmap v5984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:14.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:14 gibba020 bash[25448]: cluster 2021-03-10T17:12:13.170205+0000 mgr.gibba020.yqfnwy (mgr.34427) 10499 : cluster [DBG] pgmap v5984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:16.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:16 gibba013 bash[29418]: cephadm 2021-03-10T17:12:14.805042+0000 mgr.gibba020.yqfnwy (mgr.34427) 10500 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:12:16.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:16 gibba013 bash[29418]: cluster 2021-03-10T17:12:15.171987+0000 mgr.gibba020.yqfnwy (mgr.34427) 10501 : cluster [DBG] pgmap v5985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:16.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:16 gibba013 bash[30381]: cephadm 2021-03-10T17:12:14.805042+0000 mgr.gibba020.yqfnwy (mgr.34427) 10500 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:12:16.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:16 gibba013 bash[30381]: cluster 2021-03-10T17:12:15.171987+0000 mgr.gibba020.yqfnwy (mgr.34427) 10501 : cluster [DBG] pgmap v5985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:16.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:16 gibba020 bash[25448]: cephadm 2021-03-10T17:12:14.805042+0000 mgr.gibba020.yqfnwy (mgr.34427) 10500 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:12:16.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:16 gibba020 bash[25448]: cluster 2021-03-10T17:12:15.171987+0000 mgr.gibba020.yqfnwy (mgr.34427) 10501 : cluster [DBG] pgmap v5985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:18.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:18 gibba013 bash[29418]: cluster 2021-03-10T17:12:17.172493+0000 mgr.gibba020.yqfnwy (mgr.34427) 10502 : cluster [DBG] pgmap v5986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:18.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:18 gibba013 bash[30381]: cluster 2021-03-10T17:12:17.172493+0000 mgr.gibba020.yqfnwy (mgr.34427) 10502 : cluster [DBG] pgmap v5986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:18.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:18 gibba020 bash[25448]: cluster 2021-03-10T17:12:17.172493+0000 mgr.gibba020.yqfnwy (mgr.34427) 10502 : cluster [DBG] pgmap v5986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:20.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:20 gibba013 bash[29418]: cluster 2021-03-10T17:12:19.173988+0000 mgr.gibba020.yqfnwy (mgr.34427) 10503 : cluster [DBG] pgmap v5987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:20.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:20 gibba013 bash[30381]: cluster 2021-03-10T17:12:19.173988+0000 mgr.gibba020.yqfnwy (mgr.34427) 10503 : cluster [DBG] pgmap v5987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:20.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:20 gibba020 bash[25448]: cluster 2021-03-10T17:12:19.173988+0000 mgr.gibba020.yqfnwy (mgr.34427) 10503 : cluster [DBG] pgmap v5987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:21.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:21 gibba013 bash[29418]: cluster 2021-03-10T17:12:21.175566+0000 mgr.gibba020.yqfnwy (mgr.34427) 10504 : cluster [DBG] pgmap v5988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:21.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:21 gibba013 bash[30381]: cluster 2021-03-10T17:12:21.175566+0000 mgr.gibba020.yqfnwy (mgr.34427) 10504 : cluster [DBG] pgmap v5988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:21.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:21 gibba020 bash[25448]: cluster 2021-03-10T17:12:21.175566+0000 mgr.gibba020.yqfnwy (mgr.34427) 10504 : cluster [DBG] pgmap v5988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:24.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:24 gibba013 bash[29418]: cluster 2021-03-10T17:12:23.176850+0000 mgr.gibba020.yqfnwy (mgr.34427) 10505 : cluster [DBG] pgmap v5989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:24.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:24 gibba013 bash[30381]: cluster 2021-03-10T17:12:23.176850+0000 mgr.gibba020.yqfnwy (mgr.34427) 10505 : cluster [DBG] pgmap v5989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:24.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:24 gibba020 bash[25448]: cluster 2021-03-10T17:12:23.176850+0000 mgr.gibba020.yqfnwy (mgr.34427) 10505 : cluster [DBG] pgmap v5989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:26.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:26 gibba013 bash[29418]: cluster 2021-03-10T17:12:25.178488+0000 mgr.gibba020.yqfnwy (mgr.34427) 10506 : cluster [DBG] pgmap v5990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:26.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:26 gibba013 bash[30381]: cluster 2021-03-10T17:12:25.178488+0000 mgr.gibba020.yqfnwy (mgr.34427) 10506 : cluster [DBG] pgmap v5990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:26.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:26 gibba020 bash[25448]: cluster 2021-03-10T17:12:25.178488+0000 mgr.gibba020.yqfnwy (mgr.34427) 10506 : cluster [DBG] pgmap v5990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:28.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:28 gibba013 bash[29418]: cluster 2021-03-10T17:12:27.179880+0000 mgr.gibba020.yqfnwy (mgr.34427) 10507 : cluster [DBG] pgmap v5991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:28.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:28 gibba013 bash[30381]: cluster 2021-03-10T17:12:27.179880+0000 mgr.gibba020.yqfnwy (mgr.34427) 10507 : cluster [DBG] pgmap v5991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:28.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:28 gibba020 bash[25448]: cluster 2021-03-10T17:12:27.179880+0000 mgr.gibba020.yqfnwy (mgr.34427) 10507 : cluster [DBG] pgmap v5991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:30.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:30 gibba013 bash[29418]: cluster 2021-03-10T17:12:29.180691+0000 mgr.gibba020.yqfnwy (mgr.34427) 10508 : cluster [DBG] pgmap v5992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:30.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:30 gibba013 bash[29418]: audit 2021-03-10T17:12:29.814446+0000 mon.a (mon.0) 3736 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:12:30.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:30 gibba013 bash[29418]: audit 2021-03-10T17:12:29.822236+0000 mon.a (mon.0) 3737 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:12:30.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:30 gibba013 bash[30381]: cluster 2021-03-10T17:12:29.180691+0000 mgr.gibba020.yqfnwy (mgr.34427) 10508 : cluster [DBG] pgmap v5992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:30.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:30 gibba013 bash[30381]: audit 2021-03-10T17:12:29.814446+0000 mon.a (mon.0) 3736 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:12:30.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:30 gibba013 bash[30381]: audit 2021-03-10T17:12:29.822236+0000 mon.a (mon.0) 3737 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:12:30.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:30 gibba020 bash[25448]: cluster 2021-03-10T17:12:29.180691+0000 mgr.gibba020.yqfnwy (mgr.34427) 10508 : cluster [DBG] pgmap v5992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:30.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:30 gibba020 bash[25448]: audit 2021-03-10T17:12:29.814446+0000 mon.a (mon.0) 3736 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:12:30.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:30 gibba020 bash[25448]: audit 2021-03-10T17:12:29.822236+0000 mon.a (mon.0) 3737 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:12:31.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:31 gibba013 bash[29418]: cephadm 2021-03-10T17:12:29.819985+0000 mgr.gibba020.yqfnwy (mgr.34427) 10509 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:12:31.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:31 gibba013 bash[30381]: cephadm 2021-03-10T17:12:29.819985+0000 mgr.gibba020.yqfnwy (mgr.34427) 10509 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:12:31.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:31 gibba020 bash[25448]: cephadm 2021-03-10T17:12:29.819985+0000 mgr.gibba020.yqfnwy (mgr.34427) 10509 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:12:32.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:32 gibba013 bash[29418]: cluster 2021-03-10T17:12:31.182178+0000 mgr.gibba020.yqfnwy (mgr.34427) 10510 : cluster [DBG] pgmap v5993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:32.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:32 gibba013 bash[30381]: cluster 2021-03-10T17:12:31.182178+0000 mgr.gibba020.yqfnwy (mgr.34427) 10510 : cluster [DBG] pgmap v5993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:32.947 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:32 gibba020 bash[25448]: cluster 2021-03-10T17:12:31.182178+0000 mgr.gibba020.yqfnwy (mgr.34427) 10510 : cluster [DBG] pgmap v5993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:34.416 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:12:34.647 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:12:34.647 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 65s ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:12:34.647 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 1s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:12:34.648 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 1s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:12:34.648 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 1s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:12:34.648 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 65s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:12:34.648 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 65s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:12:34.649 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 1s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:12:34.649 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 65s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:12:34.649 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 65s ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:12:34.649 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 1s ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:12:34.649 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 65s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:12:34.650 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 65s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:12:34.650 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 65s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:12:34.650 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 65s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:12:34.650 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 1s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:12:34.651 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 1s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:12:34.651 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 1s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:12:34.651 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 1s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:12:34.651 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 1s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:12:34.652 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 1s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:12:34.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:34 gibba013 bash[29418]: cluster 2021-03-10T17:12:33.182749+0000 mgr.gibba020.yqfnwy (mgr.34427) 10511 : cluster [DBG] pgmap v5994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:34.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:34 gibba013 bash[29418]: audit 2021-03-10T17:12:33.528915+0000 mon.a (mon.0) 3738 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:12:34.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:34 gibba013 bash[29418]: cephadm 2021-03-10T17:12:33.529125+0000 mgr.gibba020.yqfnwy (mgr.34427) 10512 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:12:34.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:34 gibba013 bash[29418]: audit 2021-03-10T17:12:33.726944+0000 mon.a (mon.0) 3739 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:12:34.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:34 gibba013 bash[29418]: audit 2021-03-10T17:12:33.730829+0000 mon.a (mon.0) 3740 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:12:34.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:34 gibba013 bash[29418]: audit 2021-03-10T17:12:33.734546+0000 mon.a (mon.0) 3741 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:34.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:34 gibba013 bash[29418]: audit 2021-03-10T17:12:33.739076+0000 mon.a (mon.0) 3742 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:34.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:34 gibba013 bash[29418]: audit 2021-03-10T17:12:33.743121+0000 mon.a (mon.0) 3743 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:34.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:34 gibba013 bash[29418]: audit 2021-03-10T17:12:33.751032+0000 mon.a (mon.0) 3744 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:34.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:34 gibba013 bash[29418]: audit 2021-03-10T17:12:33.757143+0000 mon.a (mon.0) 3745 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:34.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:34 gibba013 bash[30381]: cluster 2021-03-10T17:12:33.182749+0000 mgr.gibba020.yqfnwy (mgr.34427) 10511 : cluster [DBG] pgmap v5994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:34.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:34 gibba013 bash[30381]: audit 2021-03-10T17:12:33.528915+0000 mon.a (mon.0) 3738 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:12:34.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:34 gibba013 bash[30381]: cephadm 2021-03-10T17:12:33.529125+0000 mgr.gibba020.yqfnwy (mgr.34427) 10512 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:12:34.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:34 gibba013 bash[30381]: audit 2021-03-10T17:12:33.726944+0000 mon.a (mon.0) 3739 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:12:34.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:34 gibba013 bash[30381]: audit 2021-03-10T17:12:33.730829+0000 mon.a (mon.0) 3740 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:12:34.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:34 gibba013 bash[30381]: audit 2021-03-10T17:12:33.734546+0000 mon.a (mon.0) 3741 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:34.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:34 gibba013 bash[30381]: audit 2021-03-10T17:12:33.739076+0000 mon.a (mon.0) 3742 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:34.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:34 gibba013 bash[30381]: audit 2021-03-10T17:12:33.743121+0000 mon.a (mon.0) 3743 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:34.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:34 gibba013 bash[30381]: audit 2021-03-10T17:12:33.751032+0000 mon.a (mon.0) 3744 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:34.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:34 gibba013 bash[30381]: audit 2021-03-10T17:12:33.757143+0000 mon.a (mon.0) 3745 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:34.894 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:12:34.894 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:12:34.895 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:12:34.895 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:12:34.895 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:12:34.895 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:12:34.895 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:12:34.896 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:12:34.896 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:12:34.896 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:12:34.897 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:12:34.897 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:12:34.897 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:12:34.897 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:12:34.898 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:12:34.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:34 gibba020 bash[25448]: cluster 2021-03-10T17:12:33.182749+0000 mgr.gibba020.yqfnwy (mgr.34427) 10511 : cluster [DBG] pgmap v5994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:34.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:34 gibba020 bash[25448]: audit 2021-03-10T17:12:33.528915+0000 mon.a (mon.0) 3738 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:12:34.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:34 gibba020 bash[25448]: cephadm 2021-03-10T17:12:33.529125+0000 mgr.gibba020.yqfnwy (mgr.34427) 10512 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:12:34.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:34 gibba020 bash[25448]: audit 2021-03-10T17:12:33.726944+0000 mon.a (mon.0) 3739 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:12:34.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:34 gibba020 bash[25448]: audit 2021-03-10T17:12:33.730829+0000 mon.a (mon.0) 3740 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:12:34.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:34 gibba020 bash[25448]: audit 2021-03-10T17:12:33.734546+0000 mon.a (mon.0) 3741 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:34.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:34 gibba020 bash[25448]: audit 2021-03-10T17:12:33.739076+0000 mon.a (mon.0) 3742 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:34.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:34 gibba020 bash[25448]: audit 2021-03-10T17:12:33.743121+0000 mon.a (mon.0) 3743 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:34.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:34 gibba020 bash[25448]: audit 2021-03-10T17:12:33.751032+0000 mon.a (mon.0) 3744 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:34.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:34 gibba020 bash[25448]: audit 2021-03-10T17:12:33.757143+0000 mon.a (mon.0) 3745 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:35.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:35 gibba013 bash[29418]: cephadm 2021-03-10T17:12:33.729334+0000 mgr.gibba020.yqfnwy (mgr.34427) 10513 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:12:35.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:35 gibba013 bash[29418]: cephadm 2021-03-10T17:12:33.732843+0000 mgr.gibba020.yqfnwy (mgr.34427) 10514 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:12:35.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:35 gibba013 bash[29418]: cephadm 2021-03-10T17:12:33.736608+0000 mgr.gibba020.yqfnwy (mgr.34427) 10515 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:12:35.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:35 gibba013 bash[29418]: cephadm 2021-03-10T17:12:33.737100+0000 mgr.gibba020.yqfnwy (mgr.34427) 10516 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:12:35.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:35 gibba013 bash[29418]: cephadm 2021-03-10T17:12:33.741112+0000 mgr.gibba020.yqfnwy (mgr.34427) 10517 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:12:35.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:35 gibba013 bash[29418]: cephadm 2021-03-10T17:12:33.741608+0000 mgr.gibba020.yqfnwy (mgr.34427) 10518 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:12:35.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:35 gibba013 bash[29418]: cephadm 2021-03-10T17:12:33.745108+0000 mgr.gibba020.yqfnwy (mgr.34427) 10519 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:12:35.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:35 gibba013 bash[29418]: cephadm 2021-03-10T17:12:33.748213+0000 mgr.gibba020.yqfnwy (mgr.34427) 10520 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:12:35.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:35 gibba013 bash[29418]: cephadm 2021-03-10T17:12:33.748709+0000 mgr.gibba020.yqfnwy (mgr.34427) 10521 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:12:35.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:35 gibba013 bash[29418]: cephadm 2021-03-10T17:12:33.753447+0000 mgr.gibba020.yqfnwy (mgr.34427) 10522 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:12:35.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:35 gibba013 bash[29418]: cephadm 2021-03-10T17:12:33.755745+0000 mgr.gibba020.yqfnwy (mgr.34427) 10523 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:12:35.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:35 gibba013 bash[29418]: cephadm 2021-03-10T17:12:33.758880+0000 mgr.gibba020.yqfnwy (mgr.34427) 10524 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:12:35.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:35 gibba013 bash[29418]: cephadm 2021-03-10T17:12:33.759163+0000 mgr.gibba020.yqfnwy (mgr.34427) 10525 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:12:35.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:35 gibba013 bash[29418]: cephadm 2021-03-10T17:12:33.759762+0000 mgr.gibba020.yqfnwy (mgr.34427) 10526 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:12:35.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:35 gibba013 bash[29418]: audit 2021-03-10T17:12:34.406350+0000 mgr.gibba020.yqfnwy (mgr.34427) 10527 : audit [DBG] from='client.51108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:12:35.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:35 gibba013 bash[29418]: audit 2021-03-10T17:12:34.893303+0000 mon.c (mon.1) 159 : audit [DBG] from='client.? 172.21.2.113:0/2508005339' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:35.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:35 gibba013 bash[30381]: cephadm 2021-03-10T17:12:33.729334+0000 mgr.gibba020.yqfnwy (mgr.34427) 10513 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:12:35.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:35 gibba013 bash[30381]: cephadm 2021-03-10T17:12:33.732843+0000 mgr.gibba020.yqfnwy (mgr.34427) 10514 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:12:35.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:35 gibba013 bash[30381]: cephadm 2021-03-10T17:12:33.736608+0000 mgr.gibba020.yqfnwy (mgr.34427) 10515 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:12:35.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:35 gibba013 bash[30381]: cephadm 2021-03-10T17:12:33.737100+0000 mgr.gibba020.yqfnwy (mgr.34427) 10516 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:12:35.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:35 gibba013 bash[30381]: cephadm 2021-03-10T17:12:33.741112+0000 mgr.gibba020.yqfnwy (mgr.34427) 10517 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:12:35.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:35 gibba013 bash[30381]: cephadm 2021-03-10T17:12:33.741608+0000 mgr.gibba020.yqfnwy (mgr.34427) 10518 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:12:35.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:35 gibba013 bash[30381]: cephadm 2021-03-10T17:12:33.745108+0000 mgr.gibba020.yqfnwy (mgr.34427) 10519 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:12:35.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:35 gibba013 bash[30381]: cephadm 2021-03-10T17:12:33.748213+0000 mgr.gibba020.yqfnwy (mgr.34427) 10520 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:12:35.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:35 gibba013 bash[30381]: cephadm 2021-03-10T17:12:33.748709+0000 mgr.gibba020.yqfnwy (mgr.34427) 10521 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:12:35.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:35 gibba013 bash[30381]: cephadm 2021-03-10T17:12:33.753447+0000 mgr.gibba020.yqfnwy (mgr.34427) 10522 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:12:35.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:35 gibba013 bash[30381]: cephadm 2021-03-10T17:12:33.755745+0000 mgr.gibba020.yqfnwy (mgr.34427) 10523 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:12:35.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:35 gibba013 bash[30381]: cephadm 2021-03-10T17:12:33.758880+0000 mgr.gibba020.yqfnwy (mgr.34427) 10524 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:12:35.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:35 gibba013 bash[30381]: cephadm 2021-03-10T17:12:33.759163+0000 mgr.gibba020.yqfnwy (mgr.34427) 10525 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:12:35.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:35 gibba013 bash[30381]: cephadm 2021-03-10T17:12:33.759762+0000 mgr.gibba020.yqfnwy (mgr.34427) 10526 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:12:35.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:35 gibba013 bash[30381]: audit 2021-03-10T17:12:34.406350+0000 mgr.gibba020.yqfnwy (mgr.34427) 10527 : audit [DBG] from='client.51108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:12:35.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:35 gibba013 bash[30381]: audit 2021-03-10T17:12:34.893303+0000 mon.c (mon.1) 159 : audit [DBG] from='client.? 172.21.2.113:0/2508005339' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:35.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:35 gibba020 bash[25448]: cephadm 2021-03-10T17:12:33.729334+0000 mgr.gibba020.yqfnwy (mgr.34427) 10513 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:12:35.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:35 gibba020 bash[25448]: cephadm 2021-03-10T17:12:33.732843+0000 mgr.gibba020.yqfnwy (mgr.34427) 10514 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:12:35.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:35 gibba020 bash[25448]: cephadm 2021-03-10T17:12:33.736608+0000 mgr.gibba020.yqfnwy (mgr.34427) 10515 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:12:35.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:35 gibba020 bash[25448]: cephadm 2021-03-10T17:12:33.737100+0000 mgr.gibba020.yqfnwy (mgr.34427) 10516 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:12:35.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:35 gibba020 bash[25448]: cephadm 2021-03-10T17:12:33.741112+0000 mgr.gibba020.yqfnwy (mgr.34427) 10517 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:12:35.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:35 gibba020 bash[25448]: cephadm 2021-03-10T17:12:33.741608+0000 mgr.gibba020.yqfnwy (mgr.34427) 10518 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:12:35.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:35 gibba020 bash[25448]: cephadm 2021-03-10T17:12:33.745108+0000 mgr.gibba020.yqfnwy (mgr.34427) 10519 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:12:35.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:35 gibba020 bash[25448]: cephadm 2021-03-10T17:12:33.748213+0000 mgr.gibba020.yqfnwy (mgr.34427) 10520 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:12:35.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:35 gibba020 bash[25448]: cephadm 2021-03-10T17:12:33.748709+0000 mgr.gibba020.yqfnwy (mgr.34427) 10521 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:12:35.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:35 gibba020 bash[25448]: cephadm 2021-03-10T17:12:33.753447+0000 mgr.gibba020.yqfnwy (mgr.34427) 10522 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:12:35.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:35 gibba020 bash[25448]: cephadm 2021-03-10T17:12:33.755745+0000 mgr.gibba020.yqfnwy (mgr.34427) 10523 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:12:35.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:35 gibba020 bash[25448]: cephadm 2021-03-10T17:12:33.758880+0000 mgr.gibba020.yqfnwy (mgr.34427) 10524 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:12:35.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:35 gibba020 bash[25448]: cephadm 2021-03-10T17:12:33.759163+0000 mgr.gibba020.yqfnwy (mgr.34427) 10525 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:12:35.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:35 gibba020 bash[25448]: cephadm 2021-03-10T17:12:33.759762+0000 mgr.gibba020.yqfnwy (mgr.34427) 10526 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:12:35.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:35 gibba020 bash[25448]: audit 2021-03-10T17:12:34.406350+0000 mgr.gibba020.yqfnwy (mgr.34427) 10527 : audit [DBG] from='client.51108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:12:35.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:35 gibba020 bash[25448]: audit 2021-03-10T17:12:34.893303+0000 mon.c (mon.1) 159 : audit [DBG] from='client.? 172.21.2.113:0/2508005339' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:12:36.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:36 gibba013 bash[29418]: audit 2021-03-10T17:12:34.633097+0000 mgr.gibba020.yqfnwy (mgr.34427) 10528 : audit [DBG] from='client.51114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:12:36.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:36 gibba013 bash[29418]: cluster 2021-03-10T17:12:35.183547+0000 mgr.gibba020.yqfnwy (mgr.34427) 10529 : cluster [DBG] pgmap v5995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:36.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:36 gibba013 bash[30381]: audit 2021-03-10T17:12:34.633097+0000 mgr.gibba020.yqfnwy (mgr.34427) 10528 : audit [DBG] from='client.51114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:12:36.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:36 gibba013 bash[30381]: cluster 2021-03-10T17:12:35.183547+0000 mgr.gibba020.yqfnwy (mgr.34427) 10529 : cluster [DBG] pgmap v5995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:36.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:36 gibba020 bash[25448]: audit 2021-03-10T17:12:34.633097+0000 mgr.gibba020.yqfnwy (mgr.34427) 10528 : audit [DBG] from='client.51114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:12:36.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:36 gibba020 bash[25448]: cluster 2021-03-10T17:12:35.183547+0000 mgr.gibba020.yqfnwy (mgr.34427) 10529 : cluster [DBG] pgmap v5995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:38.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:38 gibba013 bash[29418]: cluster 2021-03-10T17:12:37.184849+0000 mgr.gibba020.yqfnwy (mgr.34427) 10530 : cluster [DBG] pgmap v5996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:38.982 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:38 gibba013 bash[30381]: cluster 2021-03-10T17:12:37.184849+0000 mgr.gibba020.yqfnwy (mgr.34427) 10530 : cluster [DBG] pgmap v5996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:38.983 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:38 gibba020 bash[25448]: cluster 2021-03-10T17:12:37.184849+0000 mgr.gibba020.yqfnwy (mgr.34427) 10530 : cluster [DBG] pgmap v5996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:40.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:40 gibba013 bash[29418]: cluster 2021-03-10T17:12:39.186344+0000 mgr.gibba020.yqfnwy (mgr.34427) 10531 : cluster [DBG] pgmap v5997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:40.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:40 gibba013 bash[30381]: cluster 2021-03-10T17:12:39.186344+0000 mgr.gibba020.yqfnwy (mgr.34427) 10531 : cluster [DBG] pgmap v5997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:40.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:40 gibba020 bash[25448]: cluster 2021-03-10T17:12:39.186344+0000 mgr.gibba020.yqfnwy (mgr.34427) 10531 : cluster [DBG] pgmap v5997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:42.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:42 gibba013 bash[29418]: cluster 2021-03-10T17:12:41.187981+0000 mgr.gibba020.yqfnwy (mgr.34427) 10532 : cluster [DBG] pgmap v5998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:42.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:42 gibba013 bash[30381]: cluster 2021-03-10T17:12:41.187981+0000 mgr.gibba020.yqfnwy (mgr.34427) 10532 : cluster [DBG] pgmap v5998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:42.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:42 gibba020 bash[25448]: cluster 2021-03-10T17:12:41.187981+0000 mgr.gibba020.yqfnwy (mgr.34427) 10532 : cluster [DBG] pgmap v5998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:43.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:43 gibba020 bash[25448]: cluster 2021-03-10T17:12:43.189341+0000 mgr.gibba020.yqfnwy (mgr.34427) 10533 : cluster [DBG] pgmap v5999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:44.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:43 gibba013 bash[29418]: cluster 2021-03-10T17:12:43.189341+0000 mgr.gibba020.yqfnwy (mgr.34427) 10533 : cluster [DBG] pgmap v5999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:44.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:43 gibba013 bash[30381]: cluster 2021-03-10T17:12:43.189341+0000 mgr.gibba020.yqfnwy (mgr.34427) 10533 : cluster [DBG] pgmap v5999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:46.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:46 gibba013 bash[29418]: cluster 2021-03-10T17:12:45.191084+0000 mgr.gibba020.yqfnwy (mgr.34427) 10534 : cluster [DBG] pgmap v6000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:46.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:46 gibba013 bash[30381]: cluster 2021-03-10T17:12:45.191084+0000 mgr.gibba020.yqfnwy (mgr.34427) 10534 : cluster [DBG] pgmap v6000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:46.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:46 gibba020 bash[25448]: cluster 2021-03-10T17:12:45.191084+0000 mgr.gibba020.yqfnwy (mgr.34427) 10534 : cluster [DBG] pgmap v6000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:48.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:48 gibba013 bash[29418]: cluster 2021-03-10T17:12:47.191834+0000 mgr.gibba020.yqfnwy (mgr.34427) 10535 : cluster [DBG] pgmap v6001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:48.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:48 gibba013 bash[30381]: cluster 2021-03-10T17:12:47.191834+0000 mgr.gibba020.yqfnwy (mgr.34427) 10535 : cluster [DBG] pgmap v6001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:48.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:48 gibba020 bash[25448]: cluster 2021-03-10T17:12:47.191834+0000 mgr.gibba020.yqfnwy (mgr.34427) 10535 : cluster [DBG] pgmap v6001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:50.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:50 gibba013 bash[29418]: cephadm 2021-03-10T17:12:48.775738+0000 mgr.gibba020.yqfnwy (mgr.34427) 10536 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:12:50.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:50 gibba013 bash[29418]: cluster 2021-03-10T17:12:49.193305+0000 mgr.gibba020.yqfnwy (mgr.34427) 10537 : cluster [DBG] pgmap v6002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:50.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:50 gibba013 bash[30381]: cephadm 2021-03-10T17:12:48.775738+0000 mgr.gibba020.yqfnwy (mgr.34427) 10536 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:12:50.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:50 gibba013 bash[30381]: cluster 2021-03-10T17:12:49.193305+0000 mgr.gibba020.yqfnwy (mgr.34427) 10537 : cluster [DBG] pgmap v6002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:50.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:50 gibba020 bash[25448]: cephadm 2021-03-10T17:12:48.775738+0000 mgr.gibba020.yqfnwy (mgr.34427) 10536 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:12:50.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:50 gibba020 bash[25448]: cluster 2021-03-10T17:12:49.193305+0000 mgr.gibba020.yqfnwy (mgr.34427) 10537 : cluster [DBG] pgmap v6002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:52.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:52 gibba013 bash[29418]: cluster 2021-03-10T17:12:51.194923+0000 mgr.gibba020.yqfnwy (mgr.34427) 10538 : cluster [DBG] pgmap v6003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:52.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:52 gibba013 bash[30381]: cluster 2021-03-10T17:12:51.194923+0000 mgr.gibba020.yqfnwy (mgr.34427) 10538 : cluster [DBG] pgmap v6003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:52.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:52 gibba020 bash[25448]: cluster 2021-03-10T17:12:51.194923+0000 mgr.gibba020.yqfnwy (mgr.34427) 10538 : cluster [DBG] pgmap v6003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:53.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:53 gibba020 bash[25448]: cluster 2021-03-10T17:12:53.195718+0000 mgr.gibba020.yqfnwy (mgr.34427) 10539 : cluster [DBG] pgmap v6004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:54.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:53 gibba013 bash[29418]: cluster 2021-03-10T17:12:53.195718+0000 mgr.gibba020.yqfnwy (mgr.34427) 10539 : cluster [DBG] pgmap v6004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:54.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:53 gibba013 bash[30381]: cluster 2021-03-10T17:12:53.195718+0000 mgr.gibba020.yqfnwy (mgr.34427) 10539 : cluster [DBG] pgmap v6004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:56.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:56 gibba013 bash[29418]: cluster 2021-03-10T17:12:55.197266+0000 mgr.gibba020.yqfnwy (mgr.34427) 10540 : cluster [DBG] pgmap v6005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:56.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:56 gibba013 bash[30381]: cluster 2021-03-10T17:12:55.197266+0000 mgr.gibba020.yqfnwy (mgr.34427) 10540 : cluster [DBG] pgmap v6005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:56.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:56 gibba020 bash[25448]: cluster 2021-03-10T17:12:55.197266+0000 mgr.gibba020.yqfnwy (mgr.34427) 10540 : cluster [DBG] pgmap v6005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:58.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:12:58 gibba013 bash[29418]: cluster 2021-03-10T17:12:57.198607+0000 mgr.gibba020.yqfnwy (mgr.34427) 10541 : cluster [DBG] pgmap v6006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:58.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:12:58 gibba013 bash[30381]: cluster 2021-03-10T17:12:57.198607+0000 mgr.gibba020.yqfnwy (mgr.34427) 10541 : cluster [DBG] pgmap v6006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:12:58.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:12:58 gibba020 bash[25448]: cluster 2021-03-10T17:12:57.198607+0000 mgr.gibba020.yqfnwy (mgr.34427) 10541 : cluster [DBG] pgmap v6006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:00.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:00 gibba013 bash[29418]: cluster 2021-03-10T17:12:59.199310+0000 mgr.gibba020.yqfnwy (mgr.34427) 10542 : cluster [DBG] pgmap v6007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:00.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:00 gibba013 bash[30381]: cluster 2021-03-10T17:12:59.199310+0000 mgr.gibba020.yqfnwy (mgr.34427) 10542 : cluster [DBG] pgmap v6007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:00.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:00 gibba020 bash[25448]: cluster 2021-03-10T17:12:59.199310+0000 mgr.gibba020.yqfnwy (mgr.34427) 10542 : cluster [DBG] pgmap v6007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:01.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:01 gibba020 bash[25448]: cluster 2021-03-10T17:13:01.201083+0000 mgr.gibba020.yqfnwy (mgr.34427) 10543 : cluster [DBG] pgmap v6008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:02.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:01 gibba013 bash[29418]: cluster 2021-03-10T17:13:01.201083+0000 mgr.gibba020.yqfnwy (mgr.34427) 10543 : cluster [DBG] pgmap v6008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:02.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:01 gibba013 bash[30381]: cluster 2021-03-10T17:13:01.201083+0000 mgr.gibba020.yqfnwy (mgr.34427) 10543 : cluster [DBG] pgmap v6008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:04.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:04 gibba013 bash[29418]: cluster 2021-03-10T17:13:03.202504+0000 mgr.gibba020.yqfnwy (mgr.34427) 10544 : cluster [DBG] pgmap v6009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:04.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:04 gibba013 bash[30381]: cluster 2021-03-10T17:13:03.202504+0000 mgr.gibba020.yqfnwy (mgr.34427) 10544 : cluster [DBG] pgmap v6009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:04.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:04 gibba020 bash[25448]: cluster 2021-03-10T17:13:03.202504+0000 mgr.gibba020.yqfnwy (mgr.34427) 10544 : cluster [DBG] pgmap v6009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:05.138 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:13:05.369 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:13:05.369 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 95s ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:13:05.370 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 31s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:13:05.370 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 31s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:13:05.370 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 31s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:13:05.370 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 95s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:13:05.371 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 95s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:13:05.371 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 31s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:13:05.371 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 95s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:13:05.371 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 95s ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:13:05.371 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 31s ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:13:05.372 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 95s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:13:05.372 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 95s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:13:05.372 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 95s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:13:05.372 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 95s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:13:05.372 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 31s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:13:05.373 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 31s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:13:05.373 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 31s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:13:05.373 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 31s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:13:05.373 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 31s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:13:05.374 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 31s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:13:05.621 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:13:05.621 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:13:05.621 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:13:05.622 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:13:05.622 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:13:05.622 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:13:05.622 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:13:05.623 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:13:05.623 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:13:05.623 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:13:05.623 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:13:05.623 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:13:05.624 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:13:05.624 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:13:05.624 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:13:05.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:05 gibba013 bash[29418]: cephadm 2021-03-10T17:13:03.791525+0000 mgr.gibba020.yqfnwy (mgr.34427) 10545 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:13:05.629 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:05 gibba013 bash[30381]: cephadm 2021-03-10T17:13:03.791525+0000 mgr.gibba020.yqfnwy (mgr.34427) 10545 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:13:05.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:05 gibba020 bash[25448]: cephadm 2021-03-10T17:13:03.791525+0000 mgr.gibba020.yqfnwy (mgr.34427) 10545 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:13:06.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:06 gibba013 bash[29418]: audit 2021-03-10T17:13:05.127736+0000 mgr.gibba020.yqfnwy (mgr.34427) 10546 : audit [DBG] from='client.61105 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:13:06.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:06 gibba013 bash[29418]: cluster 2021-03-10T17:13:05.203360+0000 mgr.gibba020.yqfnwy (mgr.34427) 10547 : cluster [DBG] pgmap v6010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:06.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:06 gibba013 bash[29418]: audit 2021-03-10T17:13:05.355802+0000 mgr.gibba020.yqfnwy (mgr.34427) 10548 : audit [DBG] from='client.61111 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:13:06.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:06 gibba013 bash[29418]: audit 2021-03-10T17:13:05.620376+0000 mon.a (mon.0) 3746 : audit [DBG] from='client.? 172.21.2.113:0/1135794274' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:06.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:06 gibba013 bash[30381]: audit 2021-03-10T17:13:05.127736+0000 mgr.gibba020.yqfnwy (mgr.34427) 10546 : audit [DBG] from='client.61105 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:13:06.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:06 gibba013 bash[30381]: cluster 2021-03-10T17:13:05.203360+0000 mgr.gibba020.yqfnwy (mgr.34427) 10547 : cluster [DBG] pgmap v6010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:06.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:06 gibba013 bash[30381]: audit 2021-03-10T17:13:05.355802+0000 mgr.gibba020.yqfnwy (mgr.34427) 10548 : audit [DBG] from='client.61111 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:13:06.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:06 gibba013 bash[30381]: audit 2021-03-10T17:13:05.620376+0000 mon.a (mon.0) 3746 : audit [DBG] from='client.? 172.21.2.113:0/1135794274' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:06.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:06 gibba020 bash[25448]: audit 2021-03-10T17:13:05.127736+0000 mgr.gibba020.yqfnwy (mgr.34427) 10546 : audit [DBG] from='client.61105 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:13:06.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:06 gibba020 bash[25448]: cluster 2021-03-10T17:13:05.203360+0000 mgr.gibba020.yqfnwy (mgr.34427) 10547 : cluster [DBG] pgmap v6010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:06.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:06 gibba020 bash[25448]: audit 2021-03-10T17:13:05.355802+0000 mgr.gibba020.yqfnwy (mgr.34427) 10548 : audit [DBG] from='client.61111 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:13:06.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:06 gibba020 bash[25448]: audit 2021-03-10T17:13:05.620376+0000 mon.a (mon.0) 3746 : audit [DBG] from='client.? 172.21.2.113:0/1135794274' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:07.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:07 gibba013 bash[29418]: audit 2021-03-10T17:13:06.925559+0000 mon.a (mon.0) 3747 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:13:07.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:07 gibba013 bash[29418]: audit 2021-03-10T17:13:07.140864+0000 mon.a (mon.0) 3748 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:13:07.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:07 gibba013 bash[29418]: audit 2021-03-10T17:13:07.553588+0000 mon.a (mon.0) 3749 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T17:13:07.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:07 gibba013 bash[29418]: audit 2021-03-10T17:13:07.554350+0000 mon.a (mon.0) 3750 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:13:07.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:07 gibba013 bash[29418]: audit 2021-03-10T17:13:07.554979+0000 mon.a (mon.0) 3751 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T17:13:07.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:07 gibba013 bash[29418]: audit 2021-03-10T17:13:07.555615+0000 mon.a (mon.0) 3752 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:13:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:07 gibba013 bash[30381]: audit 2021-03-10T17:13:06.925559+0000 mon.a (mon.0) 3747 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:13:07.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:07 gibba013 bash[30381]: audit 2021-03-10T17:13:07.140864+0000 mon.a (mon.0) 3748 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:13:07.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:07 gibba013 bash[30381]: audit 2021-03-10T17:13:07.553588+0000 mon.a (mon.0) 3749 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T17:13:07.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:07 gibba013 bash[30381]: audit 2021-03-10T17:13:07.554350+0000 mon.a (mon.0) 3750 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:13:07.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:07 gibba013 bash[30381]: audit 2021-03-10T17:13:07.554979+0000 mon.a (mon.0) 3751 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T17:13:07.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:07 gibba013 bash[30381]: audit 2021-03-10T17:13:07.555615+0000 mon.a (mon.0) 3752 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:13:07.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:07 gibba020 bash[25448]: audit 2021-03-10T17:13:06.925559+0000 mon.a (mon.0) 3747 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:13:07.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:07 gibba020 bash[25448]: audit 2021-03-10T17:13:07.140864+0000 mon.a (mon.0) 3748 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:13:07.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:07 gibba020 bash[25448]: audit 2021-03-10T17:13:07.553588+0000 mon.a (mon.0) 3749 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T17:13:07.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:07 gibba020 bash[25448]: audit 2021-03-10T17:13:07.554350+0000 mon.a (mon.0) 3750 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:13:07.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:07 gibba020 bash[25448]: audit 2021-03-10T17:13:07.554979+0000 mon.a (mon.0) 3751 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T17:13:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:07 gibba020 bash[25448]: audit 2021-03-10T17:13:07.555615+0000 mon.a (mon.0) 3752 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:13:08.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:08 gibba013 bash[29418]: cluster 2021-03-10T17:13:07.204741+0000 mgr.gibba020.yqfnwy (mgr.34427) 10549 : cluster [DBG] pgmap v6011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:08.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:08 gibba013 bash[30381]: cluster 2021-03-10T17:13:07.204741+0000 mgr.gibba020.yqfnwy (mgr.34427) 10549 : cluster [DBG] pgmap v6011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:08.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:08 gibba020 bash[25448]: cluster 2021-03-10T17:13:07.204741+0000 mgr.gibba020.yqfnwy (mgr.34427) 10549 : cluster [DBG] pgmap v6011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:09.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:09 gibba020 bash[25448]: cluster 2021-03-10T17:13:09.206238+0000 mgr.gibba020.yqfnwy (mgr.34427) 10550 : cluster [DBG] pgmap v6012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:10.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:09 gibba013 bash[29418]: cluster 2021-03-10T17:13:09.206238+0000 mgr.gibba020.yqfnwy (mgr.34427) 10550 : cluster [DBG] pgmap v6012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:10.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:09 gibba013 bash[30381]: cluster 2021-03-10T17:13:09.206238+0000 mgr.gibba020.yqfnwy (mgr.34427) 10550 : cluster [DBG] pgmap v6012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:12.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:12 gibba013 bash[29418]: cluster 2021-03-10T17:13:11.207381+0000 mgr.gibba020.yqfnwy (mgr.34427) 10551 : cluster [DBG] pgmap v6013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:12.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:12 gibba013 bash[30381]: cluster 2021-03-10T17:13:11.207381+0000 mgr.gibba020.yqfnwy (mgr.34427) 10551 : cluster [DBG] pgmap v6013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:12.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:12 gibba020 bash[25448]: cluster 2021-03-10T17:13:11.207381+0000 mgr.gibba020.yqfnwy (mgr.34427) 10551 : cluster [DBG] pgmap v6013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:14.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:14 gibba013 bash[29418]: cluster 2021-03-10T17:13:13.208692+0000 mgr.gibba020.yqfnwy (mgr.34427) 10552 : cluster [DBG] pgmap v6014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:14.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:14 gibba013 bash[30381]: cluster 2021-03-10T17:13:13.208692+0000 mgr.gibba020.yqfnwy (mgr.34427) 10552 : cluster [DBG] pgmap v6014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:14.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:14 gibba020 bash[25448]: cluster 2021-03-10T17:13:13.208692+0000 mgr.gibba020.yqfnwy (mgr.34427) 10552 : cluster [DBG] pgmap v6014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:16.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:16 gibba013 bash[29418]: cluster 2021-03-10T17:13:15.210393+0000 mgr.gibba020.yqfnwy (mgr.34427) 10553 : cluster [DBG] pgmap v6015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:16.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:16 gibba013 bash[30381]: cluster 2021-03-10T17:13:15.210393+0000 mgr.gibba020.yqfnwy (mgr.34427) 10553 : cluster [DBG] pgmap v6015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:16.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:16 gibba020 bash[25448]: cluster 2021-03-10T17:13:15.210393+0000 mgr.gibba020.yqfnwy (mgr.34427) 10553 : cluster [DBG] pgmap v6015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:18.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:18 gibba013 bash[29418]: cluster 2021-03-10T17:13:17.211738+0000 mgr.gibba020.yqfnwy (mgr.34427) 10554 : cluster [DBG] pgmap v6016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:18.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:18 gibba013 bash[30381]: cluster 2021-03-10T17:13:17.211738+0000 mgr.gibba020.yqfnwy (mgr.34427) 10554 : cluster [DBG] pgmap v6016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:18.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:18 gibba020 bash[25448]: cluster 2021-03-10T17:13:17.211738+0000 mgr.gibba020.yqfnwy (mgr.34427) 10554 : cluster [DBG] pgmap v6016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:20.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:20 gibba013 bash[29418]: cephadm 2021-03-10T17:13:18.796725+0000 mgr.gibba020.yqfnwy (mgr.34427) 10555 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:13:20.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:20 gibba013 bash[29418]: cluster 2021-03-10T17:13:19.213400+0000 mgr.gibba020.yqfnwy (mgr.34427) 10556 : cluster [DBG] pgmap v6017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:20.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:20 gibba013 bash[30381]: cephadm 2021-03-10T17:13:18.796725+0000 mgr.gibba020.yqfnwy (mgr.34427) 10555 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:13:20.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:20 gibba013 bash[30381]: cluster 2021-03-10T17:13:19.213400+0000 mgr.gibba020.yqfnwy (mgr.34427) 10556 : cluster [DBG] pgmap v6017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:20.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:20 gibba020 bash[25448]: cephadm 2021-03-10T17:13:18.796725+0000 mgr.gibba020.yqfnwy (mgr.34427) 10555 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:13:20.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:20 gibba020 bash[25448]: cluster 2021-03-10T17:13:19.213400+0000 mgr.gibba020.yqfnwy (mgr.34427) 10556 : cluster [DBG] pgmap v6017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:21.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:21 gibba013 bash[29418]: cluster 2021-03-10T17:13:21.215203+0000 mgr.gibba020.yqfnwy (mgr.34427) 10557 : cluster [DBG] pgmap v6018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:21.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:21 gibba013 bash[30381]: cluster 2021-03-10T17:13:21.215203+0000 mgr.gibba020.yqfnwy (mgr.34427) 10557 : cluster [DBG] pgmap v6018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:21.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:21 gibba020 bash[25448]: cluster 2021-03-10T17:13:21.215203+0000 mgr.gibba020.yqfnwy (mgr.34427) 10557 : cluster [DBG] pgmap v6018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:24.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:24 gibba013 bash[29418]: cluster 2021-03-10T17:13:23.216578+0000 mgr.gibba020.yqfnwy (mgr.34427) 10558 : cluster [DBG] pgmap v6019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:24.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:24 gibba013 bash[30381]: cluster 2021-03-10T17:13:23.216578+0000 mgr.gibba020.yqfnwy (mgr.34427) 10558 : cluster [DBG] pgmap v6019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:24.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:24 gibba020 bash[25448]: cluster 2021-03-10T17:13:23.216578+0000 mgr.gibba020.yqfnwy (mgr.34427) 10558 : cluster [DBG] pgmap v6019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:26.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:26 gibba013 bash[29418]: cluster 2021-03-10T17:13:25.218224+0000 mgr.gibba020.yqfnwy (mgr.34427) 10559 : cluster [DBG] pgmap v6020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:26.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:26 gibba013 bash[30381]: cluster 2021-03-10T17:13:25.218224+0000 mgr.gibba020.yqfnwy (mgr.34427) 10559 : cluster [DBG] pgmap v6020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:26.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:26 gibba020 bash[25448]: cluster 2021-03-10T17:13:25.218224+0000 mgr.gibba020.yqfnwy (mgr.34427) 10559 : cluster [DBG] pgmap v6020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:28.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:28 gibba013 bash[29418]: cluster 2021-03-10T17:13:27.219468+0000 mgr.gibba020.yqfnwy (mgr.34427) 10560 : cluster [DBG] pgmap v6021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:28.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:28 gibba013 bash[30381]: cluster 2021-03-10T17:13:27.219468+0000 mgr.gibba020.yqfnwy (mgr.34427) 10560 : cluster [DBG] pgmap v6021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:28.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:28 gibba020 bash[25448]: cluster 2021-03-10T17:13:27.219468+0000 mgr.gibba020.yqfnwy (mgr.34427) 10560 : cluster [DBG] pgmap v6021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:29.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:29 gibba020 bash[25448]: cluster 2021-03-10T17:13:29.220882+0000 mgr.gibba020.yqfnwy (mgr.34427) 10561 : cluster [DBG] pgmap v6022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:30.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:29 gibba013 bash[29418]: cluster 2021-03-10T17:13:29.220882+0000 mgr.gibba020.yqfnwy (mgr.34427) 10561 : cluster [DBG] pgmap v6022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:30.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:29 gibba013 bash[30381]: cluster 2021-03-10T17:13:29.220882+0000 mgr.gibba020.yqfnwy (mgr.34427) 10561 : cluster [DBG] pgmap v6022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:32.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:32 gibba013 bash[29418]: cluster 2021-03-10T17:13:31.222682+0000 mgr.gibba020.yqfnwy (mgr.34427) 10562 : cluster [DBG] pgmap v6023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:32.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:32 gibba013 bash[30381]: cluster 2021-03-10T17:13:31.222682+0000 mgr.gibba020.yqfnwy (mgr.34427) 10562 : cluster [DBG] pgmap v6023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:32.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:32 gibba020 bash[25448]: cluster 2021-03-10T17:13:31.222682+0000 mgr.gibba020.yqfnwy (mgr.34427) 10562 : cluster [DBG] pgmap v6023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:34.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:34 gibba013 bash[29418]: cluster 2021-03-10T17:13:33.224113+0000 mgr.gibba020.yqfnwy (mgr.34427) 10563 : cluster [DBG] pgmap v6024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:34.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:34 gibba013 bash[29418]: audit 2021-03-10T17:13:33.804811+0000 mon.a (mon.0) 3753 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:13:34.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:34 gibba013 bash[29418]: audit 2021-03-10T17:13:34.050823+0000 mon.a (mon.0) 3754 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:13:34.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:34 gibba013 bash[29418]: audit 2021-03-10T17:13:34.054186+0000 mon.a (mon.0) 3755 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:13:34.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:34 gibba013 bash[29418]: audit 2021-03-10T17:13:34.055787+0000 mon.a (mon.0) 3756 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:34.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:34 gibba013 bash[29418]: audit 2021-03-10T17:13:34.057344+0000 mon.a (mon.0) 3757 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:34.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:34 gibba013 bash[29418]: audit 2021-03-10T17:13:34.058903+0000 mon.a (mon.0) 3758 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:34.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:34 gibba013 bash[29418]: audit 2021-03-10T17:13:34.062303+0000 mon.a (mon.0) 3759 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:34.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:34 gibba013 bash[29418]: audit 2021-03-10T17:13:34.064084+0000 mon.a (mon.0) 3760 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:34.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:34 gibba013 bash[30381]: cluster 2021-03-10T17:13:33.224113+0000 mgr.gibba020.yqfnwy (mgr.34427) 10563 : cluster [DBG] pgmap v6024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:34.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:34 gibba013 bash[30381]: audit 2021-03-10T17:13:33.804811+0000 mon.a (mon.0) 3753 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:13:34.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:34 gibba013 bash[30381]: audit 2021-03-10T17:13:34.050823+0000 mon.a (mon.0) 3754 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:13:34.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:34 gibba013 bash[30381]: audit 2021-03-10T17:13:34.054186+0000 mon.a (mon.0) 3755 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:13:34.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:34 gibba013 bash[30381]: audit 2021-03-10T17:13:34.055787+0000 mon.a (mon.0) 3756 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:34.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:34 gibba013 bash[30381]: audit 2021-03-10T17:13:34.057344+0000 mon.a (mon.0) 3757 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:34.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:34 gibba013 bash[30381]: audit 2021-03-10T17:13:34.058903+0000 mon.a (mon.0) 3758 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:34.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:34 gibba013 bash[30381]: audit 2021-03-10T17:13:34.062303+0000 mon.a (mon.0) 3759 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:34.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:34 gibba013 bash[30381]: audit 2021-03-10T17:13:34.064084+0000 mon.a (mon.0) 3760 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:34.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:34 gibba020 bash[25448]: cluster 2021-03-10T17:13:33.224113+0000 mgr.gibba020.yqfnwy (mgr.34427) 10563 : cluster [DBG] pgmap v6024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:34.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:34 gibba020 bash[25448]: audit 2021-03-10T17:13:33.804811+0000 mon.a (mon.0) 3753 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:13:34.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:34 gibba020 bash[25448]: audit 2021-03-10T17:13:34.050823+0000 mon.a (mon.0) 3754 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:13:34.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:34 gibba020 bash[25448]: audit 2021-03-10T17:13:34.054186+0000 mon.a (mon.0) 3755 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:13:34.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:34 gibba020 bash[25448]: audit 2021-03-10T17:13:34.055787+0000 mon.a (mon.0) 3756 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:34.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:34 gibba020 bash[25448]: audit 2021-03-10T17:13:34.057344+0000 mon.a (mon.0) 3757 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:34.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:34 gibba020 bash[25448]: audit 2021-03-10T17:13:34.058903+0000 mon.a (mon.0) 3758 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:34.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:34 gibba020 bash[25448]: audit 2021-03-10T17:13:34.062303+0000 mon.a (mon.0) 3759 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:34.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:34 gibba020 bash[25448]: audit 2021-03-10T17:13:34.064084+0000 mon.a (mon.0) 3760 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:35.864 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:13:35.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:35 gibba020 bash[25448]: cephadm 2021-03-10T17:13:33.809764+0000 mgr.gibba020.yqfnwy (mgr.34427) 10564 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:13:35.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:35 gibba020 bash[25448]: cephadm 2021-03-10T17:13:33.811580+0000 mgr.gibba020.yqfnwy (mgr.34427) 10565 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:13:35.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:35 gibba020 bash[25448]: cephadm 2021-03-10T17:13:34.052920+0000 mgr.gibba020.yqfnwy (mgr.34427) 10566 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:13:35.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:35 gibba020 bash[25448]: cephadm 2021-03-10T17:13:34.054699+0000 mgr.gibba020.yqfnwy (mgr.34427) 10567 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:13:35.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:35 gibba020 bash[25448]: cephadm 2021-03-10T17:13:34.056388+0000 mgr.gibba020.yqfnwy (mgr.34427) 10568 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:13:35.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:35 gibba020 bash[25448]: cephadm 2021-03-10T17:13:34.056424+0000 mgr.gibba020.yqfnwy (mgr.34427) 10569 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:13:35.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:35 gibba020 bash[25448]: cephadm 2021-03-10T17:13:34.057923+0000 mgr.gibba020.yqfnwy (mgr.34427) 10570 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:13:35.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:35 gibba020 bash[25448]: cephadm 2021-03-10T17:13:34.057958+0000 mgr.gibba020.yqfnwy (mgr.34427) 10571 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:13:35.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:35 gibba020 bash[25448]: cephadm 2021-03-10T17:13:34.059674+0000 mgr.gibba020.yqfnwy (mgr.34427) 10572 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:13:35.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:35 gibba020 bash[25448]: cephadm 2021-03-10T17:13:34.061189+0000 mgr.gibba020.yqfnwy (mgr.34427) 10573 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:13:35.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:35 gibba020 bash[25448]: cephadm 2021-03-10T17:13:34.061224+0000 mgr.gibba020.yqfnwy (mgr.34427) 10574 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:13:35.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:35 gibba020 bash[25448]: cephadm 2021-03-10T17:13:34.062826+0000 mgr.gibba020.yqfnwy (mgr.34427) 10575 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:13:35.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:35 gibba020 bash[25448]: cephadm 2021-03-10T17:13:34.063143+0000 mgr.gibba020.yqfnwy (mgr.34427) 10576 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:13:35.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:35 gibba020 bash[25448]: cephadm 2021-03-10T17:13:34.064787+0000 mgr.gibba020.yqfnwy (mgr.34427) 10577 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:13:35.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:35 gibba020 bash[25448]: cephadm 2021-03-10T17:13:34.064825+0000 mgr.gibba020.yqfnwy (mgr.34427) 10578 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:13:35.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:35 gibba020 bash[25448]: cephadm 2021-03-10T17:13:34.065020+0000 mgr.gibba020.yqfnwy (mgr.34427) 10579 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:13:35.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:35 gibba020 bash[25448]: cluster 2021-03-10T17:13:35.225436+0000 mgr.gibba020.yqfnwy (mgr.34427) 10580 : cluster [DBG] pgmap v6025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:36.094 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:13:36.094 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 2m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:13:36.094 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 62s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:13:36.094 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 62s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:13:36.095 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 62s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:13:36.095 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:13:36.095 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:13:36.095 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 62s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:13:36.096 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:13:36.096 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:13:36.096 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 62s ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:13:36.096 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:13:36.096 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:13:36.097 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:13:36.097 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:13:36.097 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 62s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:13:36.097 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 62s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:13:36.098 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 62s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:13:36.098 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 62s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:13:36.098 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 62s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:13:36.098 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 62s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:13:36.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:35 gibba013 bash[29418]: cephadm 2021-03-10T17:13:33.809764+0000 mgr.gibba020.yqfnwy (mgr.34427) 10564 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:13:36.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:35 gibba013 bash[29418]: cephadm 2021-03-10T17:13:33.811580+0000 mgr.gibba020.yqfnwy (mgr.34427) 10565 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:13:36.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:35 gibba013 bash[29418]: cephadm 2021-03-10T17:13:34.052920+0000 mgr.gibba020.yqfnwy (mgr.34427) 10566 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:13:36.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:35 gibba013 bash[29418]: cephadm 2021-03-10T17:13:34.054699+0000 mgr.gibba020.yqfnwy (mgr.34427) 10567 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:13:36.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:35 gibba013 bash[29418]: cephadm 2021-03-10T17:13:34.056388+0000 mgr.gibba020.yqfnwy (mgr.34427) 10568 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:13:36.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:35 gibba013 bash[29418]: cephadm 2021-03-10T17:13:34.056424+0000 mgr.gibba020.yqfnwy (mgr.34427) 10569 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:13:36.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:35 gibba013 bash[29418]: cephadm 2021-03-10T17:13:34.057923+0000 mgr.gibba020.yqfnwy (mgr.34427) 10570 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:13:36.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:35 gibba013 bash[29418]: cephadm 2021-03-10T17:13:34.057958+0000 mgr.gibba020.yqfnwy (mgr.34427) 10571 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:13:36.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:35 gibba013 bash[29418]: cephadm 2021-03-10T17:13:34.059674+0000 mgr.gibba020.yqfnwy (mgr.34427) 10572 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:13:36.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:35 gibba013 bash[29418]: cephadm 2021-03-10T17:13:34.061189+0000 mgr.gibba020.yqfnwy (mgr.34427) 10573 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:13:36.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:35 gibba013 bash[29418]: cephadm 2021-03-10T17:13:34.061224+0000 mgr.gibba020.yqfnwy (mgr.34427) 10574 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:13:36.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:35 gibba013 bash[29418]: cephadm 2021-03-10T17:13:34.062826+0000 mgr.gibba020.yqfnwy (mgr.34427) 10575 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:13:36.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:35 gibba013 bash[29418]: cephadm 2021-03-10T17:13:34.063143+0000 mgr.gibba020.yqfnwy (mgr.34427) 10576 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:13:36.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:35 gibba013 bash[29418]: cephadm 2021-03-10T17:13:34.064787+0000 mgr.gibba020.yqfnwy (mgr.34427) 10577 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:13:36.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:35 gibba013 bash[29418]: cephadm 2021-03-10T17:13:34.064825+0000 mgr.gibba020.yqfnwy (mgr.34427) 10578 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:13:36.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:35 gibba013 bash[29418]: cephadm 2021-03-10T17:13:34.065020+0000 mgr.gibba020.yqfnwy (mgr.34427) 10579 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:13:36.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:35 gibba013 bash[29418]: cluster 2021-03-10T17:13:35.225436+0000 mgr.gibba020.yqfnwy (mgr.34427) 10580 : cluster [DBG] pgmap v6025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:36.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:35 gibba013 bash[30381]: cephadm 2021-03-10T17:13:33.809764+0000 mgr.gibba020.yqfnwy (mgr.34427) 10564 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:13:36.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:35 gibba013 bash[30381]: cephadm 2021-03-10T17:13:33.811580+0000 mgr.gibba020.yqfnwy (mgr.34427) 10565 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:13:36.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:35 gibba013 bash[30381]: cephadm 2021-03-10T17:13:34.052920+0000 mgr.gibba020.yqfnwy (mgr.34427) 10566 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:13:36.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:35 gibba013 bash[30381]: cephadm 2021-03-10T17:13:34.054699+0000 mgr.gibba020.yqfnwy (mgr.34427) 10567 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:13:36.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:35 gibba013 bash[30381]: cephadm 2021-03-10T17:13:34.056388+0000 mgr.gibba020.yqfnwy (mgr.34427) 10568 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:13:36.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:35 gibba013 bash[30381]: cephadm 2021-03-10T17:13:34.056424+0000 mgr.gibba020.yqfnwy (mgr.34427) 10569 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:13:36.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:35 gibba013 bash[30381]: cephadm 2021-03-10T17:13:34.057923+0000 mgr.gibba020.yqfnwy (mgr.34427) 10570 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:13:36.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:35 gibba013 bash[30381]: cephadm 2021-03-10T17:13:34.057958+0000 mgr.gibba020.yqfnwy (mgr.34427) 10571 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:13:36.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:35 gibba013 bash[30381]: cephadm 2021-03-10T17:13:34.059674+0000 mgr.gibba020.yqfnwy (mgr.34427) 10572 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:13:36.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:35 gibba013 bash[30381]: cephadm 2021-03-10T17:13:34.061189+0000 mgr.gibba020.yqfnwy (mgr.34427) 10573 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:13:36.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:35 gibba013 bash[30381]: cephadm 2021-03-10T17:13:34.061224+0000 mgr.gibba020.yqfnwy (mgr.34427) 10574 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:13:36.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:35 gibba013 bash[30381]: cephadm 2021-03-10T17:13:34.062826+0000 mgr.gibba020.yqfnwy (mgr.34427) 10575 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:13:36.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:35 gibba013 bash[30381]: cephadm 2021-03-10T17:13:34.063143+0000 mgr.gibba020.yqfnwy (mgr.34427) 10576 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:13:36.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:35 gibba013 bash[30381]: cephadm 2021-03-10T17:13:34.064787+0000 mgr.gibba020.yqfnwy (mgr.34427) 10577 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:13:36.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:35 gibba013 bash[30381]: cephadm 2021-03-10T17:13:34.064825+0000 mgr.gibba020.yqfnwy (mgr.34427) 10578 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:13:36.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:35 gibba013 bash[30381]: cephadm 2021-03-10T17:13:34.065020+0000 mgr.gibba020.yqfnwy (mgr.34427) 10579 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:13:36.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:35 gibba013 bash[30381]: cluster 2021-03-10T17:13:35.225436+0000 mgr.gibba020.yqfnwy (mgr.34427) 10580 : cluster [DBG] pgmap v6025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:36.359 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:13:36.359 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:13:36.360 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:13:36.360 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:13:36.360 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:13:36.360 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:13:36.361 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:13:36.361 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:13:36.361 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:13:36.361 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:13:36.361 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:13:36.362 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:13:36.362 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:13:36.362 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:13:36.362 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:13:36.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:36 gibba020 bash[25448]: audit 2021-03-10T17:13:35.853792+0000 mgr.gibba020.yqfnwy (mgr.34427) 10581 : audit [DBG] from='client.51144 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:13:36.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:36 gibba020 bash[25448]: audit 2021-03-10T17:13:36.077902+0000 mgr.gibba020.yqfnwy (mgr.34427) 10582 : audit [DBG] from='client.51150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:13:36.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:36 gibba020 bash[25448]: audit 2021-03-10T17:13:36.358601+0000 mon.a (mon.0) 3761 : audit [DBG] from='client.? 172.21.2.113:0/2276448778' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:37.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:36 gibba013 bash[29418]: audit 2021-03-10T17:13:35.853792+0000 mgr.gibba020.yqfnwy (mgr.34427) 10581 : audit [DBG] from='client.51144 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:13:37.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:36 gibba013 bash[29418]: audit 2021-03-10T17:13:36.077902+0000 mgr.gibba020.yqfnwy (mgr.34427) 10582 : audit [DBG] from='client.51150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:13:37.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:36 gibba013 bash[29418]: audit 2021-03-10T17:13:36.358601+0000 mon.a (mon.0) 3761 : audit [DBG] from='client.? 172.21.2.113:0/2276448778' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:37.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:36 gibba013 bash[30381]: audit 2021-03-10T17:13:35.853792+0000 mgr.gibba020.yqfnwy (mgr.34427) 10581 : audit [DBG] from='client.51144 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:13:37.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:36 gibba013 bash[30381]: audit 2021-03-10T17:13:36.077902+0000 mgr.gibba020.yqfnwy (mgr.34427) 10582 : audit [DBG] from='client.51150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:13:37.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:36 gibba013 bash[30381]: audit 2021-03-10T17:13:36.358601+0000 mon.a (mon.0) 3761 : audit [DBG] from='client.? 172.21.2.113:0/2276448778' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:13:37.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:37 gibba020 bash[25448]: cluster 2021-03-10T17:13:37.226818+0000 mgr.gibba020.yqfnwy (mgr.34427) 10583 : cluster [DBG] pgmap v6026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:38.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:37 gibba013 bash[29418]: cluster 2021-03-10T17:13:37.226818+0000 mgr.gibba020.yqfnwy (mgr.34427) 10583 : cluster [DBG] pgmap v6026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:38.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:37 gibba013 bash[30381]: cluster 2021-03-10T17:13:37.226818+0000 mgr.gibba020.yqfnwy (mgr.34427) 10583 : cluster [DBG] pgmap v6026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:40.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:40 gibba013 bash[29418]: cluster 2021-03-10T17:13:39.228673+0000 mgr.gibba020.yqfnwy (mgr.34427) 10584 : cluster [DBG] pgmap v6027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:40.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:40 gibba013 bash[30381]: cluster 2021-03-10T17:13:39.228673+0000 mgr.gibba020.yqfnwy (mgr.34427) 10584 : cluster [DBG] pgmap v6027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:40.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:40 gibba020 bash[25448]: cluster 2021-03-10T17:13:39.228673+0000 mgr.gibba020.yqfnwy (mgr.34427) 10584 : cluster [DBG] pgmap v6027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:42.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:42 gibba013 bash[29418]: cluster 2021-03-10T17:13:41.230239+0000 mgr.gibba020.yqfnwy (mgr.34427) 10585 : cluster [DBG] pgmap v6028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:42.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:42 gibba013 bash[30381]: cluster 2021-03-10T17:13:41.230239+0000 mgr.gibba020.yqfnwy (mgr.34427) 10585 : cluster [DBG] pgmap v6028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:42.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:42 gibba020 bash[25448]: cluster 2021-03-10T17:13:41.230239+0000 mgr.gibba020.yqfnwy (mgr.34427) 10585 : cluster [DBG] pgmap v6028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:44.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:44 gibba020 bash[25448]: cluster 2021-03-10T17:13:43.231670+0000 mgr.gibba020.yqfnwy (mgr.34427) 10586 : cluster [DBG] pgmap v6029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:45.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:44 gibba013 bash[29418]: cluster 2021-03-10T17:13:43.231670+0000 mgr.gibba020.yqfnwy (mgr.34427) 10586 : cluster [DBG] pgmap v6029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:45.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:44 gibba013 bash[30381]: cluster 2021-03-10T17:13:43.231670+0000 mgr.gibba020.yqfnwy (mgr.34427) 10586 : cluster [DBG] pgmap v6029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:46.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:46 gibba013 bash[29418]: cluster 2021-03-10T17:13:45.233096+0000 mgr.gibba020.yqfnwy (mgr.34427) 10587 : cluster [DBG] pgmap v6030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:46.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:46 gibba013 bash[30381]: cluster 2021-03-10T17:13:45.233096+0000 mgr.gibba020.yqfnwy (mgr.34427) 10587 : cluster [DBG] pgmap v6030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:46.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:46 gibba020 bash[25448]: cluster 2021-03-10T17:13:45.233096+0000 mgr.gibba020.yqfnwy (mgr.34427) 10587 : cluster [DBG] pgmap v6030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:48.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:48 gibba013 bash[29418]: cluster 2021-03-10T17:13:47.234355+0000 mgr.gibba020.yqfnwy (mgr.34427) 10588 : cluster [DBG] pgmap v6031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:48.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:48 gibba013 bash[30381]: cluster 2021-03-10T17:13:47.234355+0000 mgr.gibba020.yqfnwy (mgr.34427) 10588 : cluster [DBG] pgmap v6031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:48.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:48 gibba020 bash[25448]: cluster 2021-03-10T17:13:47.234355+0000 mgr.gibba020.yqfnwy (mgr.34427) 10588 : cluster [DBG] pgmap v6031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:49.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:49 gibba020 bash[25448]: cephadm 2021-03-10T17:13:49.081022+0000 mgr.gibba020.yqfnwy (mgr.34427) 10589 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:13:49.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:49 gibba020 bash[25448]: cluster 2021-03-10T17:13:49.235879+0000 mgr.gibba020.yqfnwy (mgr.34427) 10590 : cluster [DBG] pgmap v6032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:50.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:49 gibba013 bash[29418]: cephadm 2021-03-10T17:13:49.081022+0000 mgr.gibba020.yqfnwy (mgr.34427) 10589 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:13:50.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:49 gibba013 bash[29418]: cluster 2021-03-10T17:13:49.235879+0000 mgr.gibba020.yqfnwy (mgr.34427) 10590 : cluster [DBG] pgmap v6032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:50.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:49 gibba013 bash[30381]: cephadm 2021-03-10T17:13:49.081022+0000 mgr.gibba020.yqfnwy (mgr.34427) 10589 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:13:50.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:49 gibba013 bash[30381]: cluster 2021-03-10T17:13:49.235879+0000 mgr.gibba020.yqfnwy (mgr.34427) 10590 : cluster [DBG] pgmap v6032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:52.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:52 gibba013 bash[29418]: cluster 2021-03-10T17:13:51.237626+0000 mgr.gibba020.yqfnwy (mgr.34427) 10591 : cluster [DBG] pgmap v6033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:52.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:52 gibba013 bash[30381]: cluster 2021-03-10T17:13:51.237626+0000 mgr.gibba020.yqfnwy (mgr.34427) 10591 : cluster [DBG] pgmap v6033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:52.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:52 gibba020 bash[25448]: cluster 2021-03-10T17:13:51.237626+0000 mgr.gibba020.yqfnwy (mgr.34427) 10591 : cluster [DBG] pgmap v6033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:53.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:53 gibba020 bash[25448]: cluster 2021-03-10T17:13:53.239001+0000 mgr.gibba020.yqfnwy (mgr.34427) 10592 : cluster [DBG] pgmap v6034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:54.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:53 gibba013 bash[29418]: cluster 2021-03-10T17:13:53.239001+0000 mgr.gibba020.yqfnwy (mgr.34427) 10592 : cluster [DBG] pgmap v6034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:54.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:53 gibba013 bash[30381]: cluster 2021-03-10T17:13:53.239001+0000 mgr.gibba020.yqfnwy (mgr.34427) 10592 : cluster [DBG] pgmap v6034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:56.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:56 gibba013 bash[29418]: cluster 2021-03-10T17:13:55.240643+0000 mgr.gibba020.yqfnwy (mgr.34427) 10593 : cluster [DBG] pgmap v6035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:56.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:56 gibba013 bash[30381]: cluster 2021-03-10T17:13:55.240643+0000 mgr.gibba020.yqfnwy (mgr.34427) 10593 : cluster [DBG] pgmap v6035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:56.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:56 gibba020 bash[25448]: cluster 2021-03-10T17:13:55.240643+0000 mgr.gibba020.yqfnwy (mgr.34427) 10593 : cluster [DBG] pgmap v6035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:58.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:58 gibba020 bash[25448]: cluster 2021-03-10T17:13:57.241791+0000 mgr.gibba020.yqfnwy (mgr.34427) 10594 : cluster [DBG] pgmap v6036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:59.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:58 gibba013 bash[29418]: cluster 2021-03-10T17:13:57.241791+0000 mgr.gibba020.yqfnwy (mgr.34427) 10594 : cluster [DBG] pgmap v6036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:59.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:58 gibba013 bash[30381]: cluster 2021-03-10T17:13:57.241791+0000 mgr.gibba020.yqfnwy (mgr.34427) 10594 : cluster [DBG] pgmap v6036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:13:59.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:13:59 gibba020 bash[25448]: cluster 2021-03-10T17:13:59.243334+0000 mgr.gibba020.yqfnwy (mgr.34427) 10595 : cluster [DBG] pgmap v6037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:00.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:13:59 gibba013 bash[29418]: cluster 2021-03-10T17:13:59.243334+0000 mgr.gibba020.yqfnwy (mgr.34427) 10595 : cluster [DBG] pgmap v6037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:00.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:13:59 gibba013 bash[30381]: cluster 2021-03-10T17:13:59.243334+0000 mgr.gibba020.yqfnwy (mgr.34427) 10595 : cluster [DBG] pgmap v6037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:02.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:02 gibba020 bash[25448]: cluster 2021-03-10T17:14:01.244912+0000 mgr.gibba020.yqfnwy (mgr.34427) 10596 : cluster [DBG] pgmap v6038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:03.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:02 gibba013 bash[29418]: cluster 2021-03-10T17:14:01.244912+0000 mgr.gibba020.yqfnwy (mgr.34427) 10596 : cluster [DBG] pgmap v6038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:03.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:02 gibba013 bash[30381]: cluster 2021-03-10T17:14:01.244912+0000 mgr.gibba020.yqfnwy (mgr.34427) 10596 : cluster [DBG] pgmap v6038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:03.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:03 gibba020 bash[25448]: cluster 2021-03-10T17:14:03.246294+0000 mgr.gibba020.yqfnwy (mgr.34427) 10597 : cluster [DBG] pgmap v6039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:04.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:03 gibba013 bash[29418]: cluster 2021-03-10T17:14:03.246294+0000 mgr.gibba020.yqfnwy (mgr.34427) 10597 : cluster [DBG] pgmap v6039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:04.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:03 gibba013 bash[30381]: cluster 2021-03-10T17:14:03.246294+0000 mgr.gibba020.yqfnwy (mgr.34427) 10597 : cluster [DBG] pgmap v6039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:04.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:04 gibba020 bash[25448]: cephadm 2021-03-10T17:14:04.097178+0000 mgr.gibba020.yqfnwy (mgr.34427) 10598 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:14:05.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:04 gibba013 bash[29418]: cephadm 2021-03-10T17:14:04.097178+0000 mgr.gibba020.yqfnwy (mgr.34427) 10598 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:14:05.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:04 gibba013 bash[30381]: cephadm 2021-03-10T17:14:04.097178+0000 mgr.gibba020.yqfnwy (mgr.34427) 10598 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:14:06.604 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:14:06.847 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:14:06.847 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 2m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:14:06.847 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 93s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:14:06.848 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 93s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:14:06.848 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 93s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:14:06.848 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:14:06.848 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:14:06.848 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 93s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:14:06.849 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:14:06.849 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:14:06.849 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 93s ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:14:06.849 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:14:06.849 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:14:06.850 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:14:06.850 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:14:06.850 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 93s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:14:06.850 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 93s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:14:06.851 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 93s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:14:06.851 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 93s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:14:06.851 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 93s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:14:06.851 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 93s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:14:06.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:06 gibba013 bash[29418]: cluster 2021-03-10T17:14:05.248100+0000 mgr.gibba020.yqfnwy (mgr.34427) 10599 : cluster [DBG] pgmap v6040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:06.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:06 gibba013 bash[30381]: cluster 2021-03-10T17:14:05.248100+0000 mgr.gibba020.yqfnwy (mgr.34427) 10599 : cluster [DBG] pgmap v6040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:06.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:06 gibba020 bash[25448]: cluster 2021-03-10T17:14:05.248100+0000 mgr.gibba020.yqfnwy (mgr.34427) 10599 : cluster [DBG] pgmap v6040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:07.096 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:14:07.097 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:14:07.097 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:14:07.097 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:14:07.098 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:14:07.098 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:14:07.098 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:14:07.098 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:14:07.099 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:14:07.099 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:14:07.099 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:14:07.100 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:14:07.100 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:14:07.100 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:14:07.102 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:14:07.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:07 gibba020 bash[25448]: audit 2021-03-10T17:14:06.593003+0000 mgr.gibba020.yqfnwy (mgr.34427) 10600 : audit [DBG] from='client.51162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:14:07.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:07 gibba020 bash[25448]: audit 2021-03-10T17:14:06.930088+0000 mon.a (mon.0) 3762 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:14:07.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:07 gibba020 bash[25448]: audit 2021-03-10T17:14:07.095709+0000 mon.c (mon.1) 160 : audit [DBG] from='client.? 172.21.2.113:0/3881253635' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:07.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:07 gibba020 bash[25448]: audit 2021-03-10T17:14:07.147294+0000 mon.a (mon.0) 3763 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:14:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:07 gibba020 bash[25448]: audit 2021-03-10T17:14:07.563646+0000 mon.a (mon.0) 3764 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T17:14:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:07 gibba020 bash[25448]: audit 2021-03-10T17:14:07.564426+0000 mon.a (mon.0) 3765 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:14:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:07 gibba020 bash[25448]: audit 2021-03-10T17:14:07.565111+0000 mon.a (mon.0) 3766 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T17:14:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:07 gibba020 bash[25448]: audit 2021-03-10T17:14:07.565757+0000 mon.a (mon.0) 3767 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:14:08.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:07 gibba013 bash[29418]: audit 2021-03-10T17:14:06.593003+0000 mgr.gibba020.yqfnwy (mgr.34427) 10600 : audit [DBG] from='client.51162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:14:08.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:07 gibba013 bash[29418]: audit 2021-03-10T17:14:06.930088+0000 mon.a (mon.0) 3762 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:14:08.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:07 gibba013 bash[29418]: audit 2021-03-10T17:14:07.095709+0000 mon.c (mon.1) 160 : audit [DBG] from='client.? 172.21.2.113:0/3881253635' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:08.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:07 gibba013 bash[29418]: audit 2021-03-10T17:14:07.147294+0000 mon.a (mon.0) 3763 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:14:08.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:07 gibba013 bash[29418]: audit 2021-03-10T17:14:07.563646+0000 mon.a (mon.0) 3764 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T17:14:08.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:07 gibba013 bash[29418]: audit 2021-03-10T17:14:07.564426+0000 mon.a (mon.0) 3765 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:14:08.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:07 gibba013 bash[29418]: audit 2021-03-10T17:14:07.565111+0000 mon.a (mon.0) 3766 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T17:14:08.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:07 gibba013 bash[29418]: audit 2021-03-10T17:14:07.565757+0000 mon.a (mon.0) 3767 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:14:08.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:07 gibba013 bash[30381]: audit 2021-03-10T17:14:06.593003+0000 mgr.gibba020.yqfnwy (mgr.34427) 10600 : audit [DBG] from='client.51162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:14:08.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:07 gibba013 bash[30381]: audit 2021-03-10T17:14:06.930088+0000 mon.a (mon.0) 3762 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:14:08.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:07 gibba013 bash[30381]: audit 2021-03-10T17:14:07.095709+0000 mon.c (mon.1) 160 : audit [DBG] from='client.? 172.21.2.113:0/3881253635' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:08.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:07 gibba013 bash[30381]: audit 2021-03-10T17:14:07.147294+0000 mon.a (mon.0) 3763 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:14:08.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:07 gibba013 bash[30381]: audit 2021-03-10T17:14:07.563646+0000 mon.a (mon.0) 3764 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T17:14:08.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:07 gibba013 bash[30381]: audit 2021-03-10T17:14:07.564426+0000 mon.a (mon.0) 3765 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:14:08.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:07 gibba013 bash[30381]: audit 2021-03-10T17:14:07.565111+0000 mon.a (mon.0) 3766 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T17:14:08.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:07 gibba013 bash[30381]: audit 2021-03-10T17:14:07.565757+0000 mon.a (mon.0) 3767 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:14:08.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:08 gibba020 bash[25448]: audit 2021-03-10T17:14:06.833102+0000 mgr.gibba020.yqfnwy (mgr.34427) 10601 : audit [DBG] from='client.51168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:14:08.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:08 gibba020 bash[25448]: cluster 2021-03-10T17:14:07.249495+0000 mgr.gibba020.yqfnwy (mgr.34427) 10602 : cluster [DBG] pgmap v6041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:09.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:08 gibba013 bash[29418]: audit 2021-03-10T17:14:06.833102+0000 mgr.gibba020.yqfnwy (mgr.34427) 10601 : audit [DBG] from='client.51168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:14:09.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:08 gibba013 bash[29418]: cluster 2021-03-10T17:14:07.249495+0000 mgr.gibba020.yqfnwy (mgr.34427) 10602 : cluster [DBG] pgmap v6041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:09.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:08 gibba013 bash[30381]: audit 2021-03-10T17:14:06.833102+0000 mgr.gibba020.yqfnwy (mgr.34427) 10601 : audit [DBG] from='client.51168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:14:09.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:08 gibba013 bash[30381]: cluster 2021-03-10T17:14:07.249495+0000 mgr.gibba020.yqfnwy (mgr.34427) 10602 : cluster [DBG] pgmap v6041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:09.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:09 gibba020 bash[25448]: cluster 2021-03-10T17:14:09.250914+0000 mgr.gibba020.yqfnwy (mgr.34427) 10603 : cluster [DBG] pgmap v6042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:10.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:09 gibba013 bash[29418]: cluster 2021-03-10T17:14:09.250914+0000 mgr.gibba020.yqfnwy (mgr.34427) 10603 : cluster [DBG] pgmap v6042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:10.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:09 gibba013 bash[30381]: cluster 2021-03-10T17:14:09.250914+0000 mgr.gibba020.yqfnwy (mgr.34427) 10603 : cluster [DBG] pgmap v6042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:12.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:12 gibba020 bash[25448]: cluster 2021-03-10T17:14:11.253003+0000 mgr.gibba020.yqfnwy (mgr.34427) 10604 : cluster [DBG] pgmap v6043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:13.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:12 gibba013 bash[29418]: cluster 2021-03-10T17:14:11.253003+0000 mgr.gibba020.yqfnwy (mgr.34427) 10604 : cluster [DBG] pgmap v6043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:13.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:12 gibba013 bash[30381]: cluster 2021-03-10T17:14:11.253003+0000 mgr.gibba020.yqfnwy (mgr.34427) 10604 : cluster [DBG] pgmap v6043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:13.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:13 gibba020 bash[25448]: cluster 2021-03-10T17:14:13.254583+0000 mgr.gibba020.yqfnwy (mgr.34427) 10605 : cluster [DBG] pgmap v6044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:14.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:13 gibba013 bash[29418]: cluster 2021-03-10T17:14:13.254583+0000 mgr.gibba020.yqfnwy (mgr.34427) 10605 : cluster [DBG] pgmap v6044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:14.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:13 gibba013 bash[30381]: cluster 2021-03-10T17:14:13.254583+0000 mgr.gibba020.yqfnwy (mgr.34427) 10605 : cluster [DBG] pgmap v6044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:16.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:16 gibba020 bash[25448]: cluster 2021-03-10T17:14:15.256525+0000 mgr.gibba020.yqfnwy (mgr.34427) 10606 : cluster [DBG] pgmap v6045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:17.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:16 gibba013 bash[29418]: cluster 2021-03-10T17:14:15.256525+0000 mgr.gibba020.yqfnwy (mgr.34427) 10606 : cluster [DBG] pgmap v6045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:17.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:16 gibba013 bash[30381]: cluster 2021-03-10T17:14:15.256525+0000 mgr.gibba020.yqfnwy (mgr.34427) 10606 : cluster [DBG] pgmap v6045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:17.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:17 gibba020 bash[25448]: cluster 2021-03-10T17:14:17.257926+0000 mgr.gibba020.yqfnwy (mgr.34427) 10607 : cluster [DBG] pgmap v6046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:18.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:17 gibba013 bash[29418]: cluster 2021-03-10T17:14:17.257926+0000 mgr.gibba020.yqfnwy (mgr.34427) 10607 : cluster [DBG] pgmap v6046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:18.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:17 gibba013 bash[30381]: cluster 2021-03-10T17:14:17.257926+0000 mgr.gibba020.yqfnwy (mgr.34427) 10607 : cluster [DBG] pgmap v6046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:20.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:20 gibba013 bash[29418]: cephadm 2021-03-10T17:14:19.100925+0000 mgr.gibba020.yqfnwy (mgr.34427) 10608 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:14:20.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:20 gibba013 bash[29418]: cluster 2021-03-10T17:14:19.259546+0000 mgr.gibba020.yqfnwy (mgr.34427) 10609 : cluster [DBG] pgmap v6047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:20.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:20 gibba013 bash[30381]: cephadm 2021-03-10T17:14:19.100925+0000 mgr.gibba020.yqfnwy (mgr.34427) 10608 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:14:20.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:20 gibba013 bash[30381]: cluster 2021-03-10T17:14:19.259546+0000 mgr.gibba020.yqfnwy (mgr.34427) 10609 : cluster [DBG] pgmap v6047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:20.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:20 gibba020 bash[25448]: cephadm 2021-03-10T17:14:19.100925+0000 mgr.gibba020.yqfnwy (mgr.34427) 10608 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:14:20.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:20 gibba020 bash[25448]: cluster 2021-03-10T17:14:19.259546+0000 mgr.gibba020.yqfnwy (mgr.34427) 10609 : cluster [DBG] pgmap v6047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:21.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:21 gibba020 bash[25448]: cluster 2021-03-10T17:14:21.261457+0000 mgr.gibba020.yqfnwy (mgr.34427) 10610 : cluster [DBG] pgmap v6048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:22.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:21 gibba013 bash[29418]: cluster 2021-03-10T17:14:21.261457+0000 mgr.gibba020.yqfnwy (mgr.34427) 10610 : cluster [DBG] pgmap v6048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:22.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:21 gibba013 bash[30381]: cluster 2021-03-10T17:14:21.261457+0000 mgr.gibba020.yqfnwy (mgr.34427) 10610 : cluster [DBG] pgmap v6048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:24.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:24 gibba013 bash[29418]: cluster 2021-03-10T17:14:23.262966+0000 mgr.gibba020.yqfnwy (mgr.34427) 10611 : cluster [DBG] pgmap v6049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:24.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:24 gibba013 bash[30381]: cluster 2021-03-10T17:14:23.262966+0000 mgr.gibba020.yqfnwy (mgr.34427) 10611 : cluster [DBG] pgmap v6049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:24.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:24 gibba020 bash[25448]: cluster 2021-03-10T17:14:23.262966+0000 mgr.gibba020.yqfnwy (mgr.34427) 10611 : cluster [DBG] pgmap v6049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:26.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:26 gibba013 bash[29418]: cluster 2021-03-10T17:14:25.264649+0000 mgr.gibba020.yqfnwy (mgr.34427) 10612 : cluster [DBG] pgmap v6050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:26.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:26 gibba013 bash[30381]: cluster 2021-03-10T17:14:25.264649+0000 mgr.gibba020.yqfnwy (mgr.34427) 10612 : cluster [DBG] pgmap v6050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:26.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:26 gibba020 bash[25448]: cluster 2021-03-10T17:14:25.264649+0000 mgr.gibba020.yqfnwy (mgr.34427) 10612 : cluster [DBG] pgmap v6050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:28.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:28 gibba013 bash[29418]: cluster 2021-03-10T17:14:27.266223+0000 mgr.gibba020.yqfnwy (mgr.34427) 10613 : cluster [DBG] pgmap v6051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:28.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:28 gibba013 bash[30381]: cluster 2021-03-10T17:14:27.266223+0000 mgr.gibba020.yqfnwy (mgr.34427) 10613 : cluster [DBG] pgmap v6051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:28.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:28 gibba020 bash[25448]: cluster 2021-03-10T17:14:27.266223+0000 mgr.gibba020.yqfnwy (mgr.34427) 10613 : cluster [DBG] pgmap v6051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:30.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:30 gibba013 bash[29418]: cluster 2021-03-10T17:14:29.267733+0000 mgr.gibba020.yqfnwy (mgr.34427) 10614 : cluster [DBG] pgmap v6052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:30.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:30 gibba013 bash[30381]: cluster 2021-03-10T17:14:29.267733+0000 mgr.gibba020.yqfnwy (mgr.34427) 10614 : cluster [DBG] pgmap v6052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:30.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:30 gibba020 bash[25448]: cluster 2021-03-10T17:14:29.267733+0000 mgr.gibba020.yqfnwy (mgr.34427) 10614 : cluster [DBG] pgmap v6052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:31.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:31 gibba020 bash[25448]: cluster 2021-03-10T17:14:31.269760+0000 mgr.gibba020.yqfnwy (mgr.34427) 10615 : cluster [DBG] pgmap v6053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:32.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:31 gibba013 bash[29418]: cluster 2021-03-10T17:14:31.269760+0000 mgr.gibba020.yqfnwy (mgr.34427) 10615 : cluster [DBG] pgmap v6053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:32.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:31 gibba013 bash[30381]: cluster 2021-03-10T17:14:31.269760+0000 mgr.gibba020.yqfnwy (mgr.34427) 10615 : cluster [DBG] pgmap v6053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:34.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:34 gibba013 bash[29418]: cluster 2021-03-10T17:14:33.271446+0000 mgr.gibba020.yqfnwy (mgr.34427) 10616 : cluster [DBG] pgmap v6054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:34.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:34 gibba013 bash[29418]: audit 2021-03-10T17:14:34.118317+0000 mon.a (mon.0) 3768 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:14:34.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:34 gibba013 bash[30381]: cluster 2021-03-10T17:14:33.271446+0000 mgr.gibba020.yqfnwy (mgr.34427) 10616 : cluster [DBG] pgmap v6054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:34.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:34 gibba013 bash[30381]: audit 2021-03-10T17:14:34.118317+0000 mon.a (mon.0) 3768 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:14:34.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:34 gibba020 bash[25448]: cluster 2021-03-10T17:14:33.271446+0000 mgr.gibba020.yqfnwy (mgr.34427) 10616 : cluster [DBG] pgmap v6054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:34.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:34 gibba020 bash[25448]: audit 2021-03-10T17:14:34.118317+0000 mon.a (mon.0) 3768 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:14:35.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[29418]: cephadm 2021-03-10T17:14:34.123130+0000 mgr.gibba020.yqfnwy (mgr.34427) 10617 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:14:35.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[29418]: cephadm 2021-03-10T17:14:34.125050+0000 mgr.gibba020.yqfnwy (mgr.34427) 10618 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:14:35.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[29418]: audit 2021-03-10T17:14:34.330709+0000 mon.a (mon.0) 3769 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:14:35.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[29418]: cephadm 2021-03-10T17:14:34.333174+0000 mgr.gibba020.yqfnwy (mgr.34427) 10619 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:14:35.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[29418]: audit 2021-03-10T17:14:34.334380+0000 mon.a (mon.0) 3770 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:14:35.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[29418]: cephadm 2021-03-10T17:14:34.334917+0000 mgr.gibba020.yqfnwy (mgr.34427) 10620 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:14:35.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[29418]: audit 2021-03-10T17:14:34.335750+0000 mon.a (mon.0) 3771 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:35.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[29418]: cephadm 2021-03-10T17:14:34.336103+0000 mgr.gibba020.yqfnwy (mgr.34427) 10621 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:14:35.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[29418]: cephadm 2021-03-10T17:14:34.336140+0000 mgr.gibba020.yqfnwy (mgr.34427) 10622 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:14:35.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[29418]: audit 2021-03-10T17:14:34.336888+0000 mon.a (mon.0) 3772 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:35.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[29418]: cephadm 2021-03-10T17:14:34.337320+0000 mgr.gibba020.yqfnwy (mgr.34427) 10623 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:14:35.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[29418]: cephadm 2021-03-10T17:14:34.337358+0000 mgr.gibba020.yqfnwy (mgr.34427) 10624 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:14:35.639 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[29418]: audit 2021-03-10T17:14:34.338290+0000 mon.a (mon.0) 3773 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:35.639 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[29418]: cephadm 2021-03-10T17:14:34.338775+0000 mgr.gibba020.yqfnwy (mgr.34427) 10625 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:14:35.639 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[29418]: cephadm 2021-03-10T17:14:34.340099+0000 mgr.gibba020.yqfnwy (mgr.34427) 10626 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:14:35.639 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[29418]: cephadm 2021-03-10T17:14:34.340136+0000 mgr.gibba020.yqfnwy (mgr.34427) 10627 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:14:35.640 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[29418]: audit 2021-03-10T17:14:34.341171+0000 mon.a (mon.0) 3774 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:35.640 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[29418]: cephadm 2021-03-10T17:14:34.341660+0000 mgr.gibba020.yqfnwy (mgr.34427) 10628 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:14:35.640 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[29418]: cephadm 2021-03-10T17:14:34.341977+0000 mgr.gibba020.yqfnwy (mgr.34427) 10629 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:14:35.640 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[29418]: audit 2021-03-10T17:14:34.342891+0000 mon.a (mon.0) 3775 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:35.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[30381]: cephadm 2021-03-10T17:14:34.123130+0000 mgr.gibba020.yqfnwy (mgr.34427) 10617 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:14:35.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[30381]: cephadm 2021-03-10T17:14:34.125050+0000 mgr.gibba020.yqfnwy (mgr.34427) 10618 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:14:35.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[30381]: audit 2021-03-10T17:14:34.330709+0000 mon.a (mon.0) 3769 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:14:35.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[30381]: cephadm 2021-03-10T17:14:34.333174+0000 mgr.gibba020.yqfnwy (mgr.34427) 10619 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:14:35.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[30381]: audit 2021-03-10T17:14:34.334380+0000 mon.a (mon.0) 3770 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:14:35.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[30381]: cephadm 2021-03-10T17:14:34.334917+0000 mgr.gibba020.yqfnwy (mgr.34427) 10620 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:14:35.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[30381]: audit 2021-03-10T17:14:34.335750+0000 mon.a (mon.0) 3771 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:35.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[30381]: cephadm 2021-03-10T17:14:34.336103+0000 mgr.gibba020.yqfnwy (mgr.34427) 10621 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:14:35.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[30381]: cephadm 2021-03-10T17:14:34.336140+0000 mgr.gibba020.yqfnwy (mgr.34427) 10622 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:14:35.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[30381]: audit 2021-03-10T17:14:34.336888+0000 mon.a (mon.0) 3772 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:35.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[30381]: cephadm 2021-03-10T17:14:34.337320+0000 mgr.gibba020.yqfnwy (mgr.34427) 10623 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:14:35.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[30381]: cephadm 2021-03-10T17:14:34.337358+0000 mgr.gibba020.yqfnwy (mgr.34427) 10624 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:14:35.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[30381]: audit 2021-03-10T17:14:34.338290+0000 mon.a (mon.0) 3773 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:35.644 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[30381]: cephadm 2021-03-10T17:14:34.338775+0000 mgr.gibba020.yqfnwy (mgr.34427) 10625 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:14:35.644 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[30381]: cephadm 2021-03-10T17:14:34.340099+0000 mgr.gibba020.yqfnwy (mgr.34427) 10626 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:14:35.648 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[30381]: cephadm 2021-03-10T17:14:34.340136+0000 mgr.gibba020.yqfnwy (mgr.34427) 10627 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:14:35.648 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[30381]: audit 2021-03-10T17:14:34.341171+0000 mon.a (mon.0) 3774 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:35.649 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[30381]: cephadm 2021-03-10T17:14:34.341660+0000 mgr.gibba020.yqfnwy (mgr.34427) 10628 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:14:35.649 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[30381]: cephadm 2021-03-10T17:14:34.341977+0000 mgr.gibba020.yqfnwy (mgr.34427) 10629 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:14:35.649 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[30381]: audit 2021-03-10T17:14:34.342891+0000 mon.a (mon.0) 3775 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:35.652 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[29418]: cephadm 2021-03-10T17:14:34.343372+0000 mgr.gibba020.yqfnwy (mgr.34427) 10630 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:14:35.652 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[29418]: cephadm 2021-03-10T17:14:34.343408+0000 mgr.gibba020.yqfnwy (mgr.34427) 10631 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:14:35.652 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[29418]: cephadm 2021-03-10T17:14:34.343509+0000 mgr.gibba020.yqfnwy (mgr.34427) 10632 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:14:35.653 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[30381]: cephadm 2021-03-10T17:14:34.343372+0000 mgr.gibba020.yqfnwy (mgr.34427) 10630 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:14:35.653 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[30381]: cephadm 2021-03-10T17:14:34.343408+0000 mgr.gibba020.yqfnwy (mgr.34427) 10631 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:14:35.653 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:35 gibba013 bash[30381]: cephadm 2021-03-10T17:14:34.343509+0000 mgr.gibba020.yqfnwy (mgr.34427) 10632 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:14:35.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:35 gibba020 bash[25448]: cephadm 2021-03-10T17:14:34.123130+0000 mgr.gibba020.yqfnwy (mgr.34427) 10617 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:14:35.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:35 gibba020 bash[25448]: cephadm 2021-03-10T17:14:34.125050+0000 mgr.gibba020.yqfnwy (mgr.34427) 10618 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:14:35.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:35 gibba020 bash[25448]: audit 2021-03-10T17:14:34.330709+0000 mon.a (mon.0) 3769 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:14:35.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:35 gibba020 bash[25448]: cephadm 2021-03-10T17:14:34.333174+0000 mgr.gibba020.yqfnwy (mgr.34427) 10619 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:14:35.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:35 gibba020 bash[25448]: audit 2021-03-10T17:14:34.334380+0000 mon.a (mon.0) 3770 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:14:35.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:35 gibba020 bash[25448]: cephadm 2021-03-10T17:14:34.334917+0000 mgr.gibba020.yqfnwy (mgr.34427) 10620 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:14:35.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:35 gibba020 bash[25448]: audit 2021-03-10T17:14:34.335750+0000 mon.a (mon.0) 3771 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:35.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:35 gibba020 bash[25448]: cephadm 2021-03-10T17:14:34.336103+0000 mgr.gibba020.yqfnwy (mgr.34427) 10621 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:14:35.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:35 gibba020 bash[25448]: cephadm 2021-03-10T17:14:34.336140+0000 mgr.gibba020.yqfnwy (mgr.34427) 10622 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:14:35.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:35 gibba020 bash[25448]: audit 2021-03-10T17:14:34.336888+0000 mon.a (mon.0) 3772 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:35.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:35 gibba020 bash[25448]: cephadm 2021-03-10T17:14:34.337320+0000 mgr.gibba020.yqfnwy (mgr.34427) 10623 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:14:35.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:35 gibba020 bash[25448]: cephadm 2021-03-10T17:14:34.337358+0000 mgr.gibba020.yqfnwy (mgr.34427) 10624 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:14:35.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:35 gibba020 bash[25448]: audit 2021-03-10T17:14:34.338290+0000 mon.a (mon.0) 3773 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:35.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:35 gibba020 bash[25448]: cephadm 2021-03-10T17:14:34.338775+0000 mgr.gibba020.yqfnwy (mgr.34427) 10625 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:14:35.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:35 gibba020 bash[25448]: cephadm 2021-03-10T17:14:34.340099+0000 mgr.gibba020.yqfnwy (mgr.34427) 10626 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:14:35.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:35 gibba020 bash[25448]: cephadm 2021-03-10T17:14:34.340136+0000 mgr.gibba020.yqfnwy (mgr.34427) 10627 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:14:35.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:35 gibba020 bash[25448]: audit 2021-03-10T17:14:34.341171+0000 mon.a (mon.0) 3774 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:35.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:35 gibba020 bash[25448]: cephadm 2021-03-10T17:14:34.341660+0000 mgr.gibba020.yqfnwy (mgr.34427) 10628 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:14:35.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:35 gibba020 bash[25448]: cephadm 2021-03-10T17:14:34.341977+0000 mgr.gibba020.yqfnwy (mgr.34427) 10629 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:14:35.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:35 gibba020 bash[25448]: audit 2021-03-10T17:14:34.342891+0000 mon.a (mon.0) 3775 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:35.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:35 gibba020 bash[25448]: cephadm 2021-03-10T17:14:34.343372+0000 mgr.gibba020.yqfnwy (mgr.34427) 10630 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:14:35.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:35 gibba020 bash[25448]: cephadm 2021-03-10T17:14:34.343408+0000 mgr.gibba020.yqfnwy (mgr.34427) 10631 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:14:35.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:35 gibba020 bash[25448]: cephadm 2021-03-10T17:14:34.343509+0000 mgr.gibba020.yqfnwy (mgr.34427) 10632 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:14:36.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:36 gibba013 bash[29418]: cluster 2021-03-10T17:14:35.273209+0000 mgr.gibba020.yqfnwy (mgr.34427) 10633 : cluster [DBG] pgmap v6055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:36.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:36 gibba013 bash[30381]: cluster 2021-03-10T17:14:35.273209+0000 mgr.gibba020.yqfnwy (mgr.34427) 10633 : cluster [DBG] pgmap v6055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:36.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:36 gibba020 bash[25448]: cluster 2021-03-10T17:14:35.273209+0000 mgr.gibba020.yqfnwy (mgr.34427) 10633 : cluster [DBG] pgmap v6055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:37.340 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:14:37.564 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:14:37.564 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 3m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:14:37.564 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 2m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:14:37.565 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:14:37.565 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:14:37.565 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:14:37.565 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:14:37.565 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:14:37.566 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:14:37.566 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:14:37.566 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:14:37.566 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:14:37.567 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:14:37.567 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:14:37.567 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:14:37.567 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:14:37.567 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:14:37.568 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:14:37.568 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:14:37.568 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 2m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:14:37.568 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:14:37.815 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:14:37.815 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:14:37.815 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:14:37.816 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:14:37.816 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:14:37.816 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:14:37.816 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:14:37.817 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:14:37.817 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:14:37.817 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:14:37.817 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:14:37.817 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:14:37.818 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:14:37.818 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:14:37.818 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:14:38.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:38 gibba013 bash[29418]: cluster 2021-03-10T17:14:37.274634+0000 mgr.gibba020.yqfnwy (mgr.34427) 10634 : cluster [DBG] pgmap v6056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:38.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:38 gibba013 bash[29418]: audit 2021-03-10T17:14:37.329738+0000 mgr.gibba020.yqfnwy (mgr.34427) 10635 : audit [DBG] from='client.61159 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:14:38.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:38 gibba013 bash[29418]: audit 2021-03-10T17:14:37.553361+0000 mgr.gibba020.yqfnwy (mgr.34427) 10636 : audit [DBG] from='client.61165 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:14:38.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:38 gibba013 bash[29418]: audit 2021-03-10T17:14:37.813420+0000 mon.a (mon.0) 3776 : audit [DBG] from='client.? 172.21.2.113:0/91922284' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:38.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:38 gibba013 bash[30381]: cluster 2021-03-10T17:14:37.274634+0000 mgr.gibba020.yqfnwy (mgr.34427) 10634 : cluster [DBG] pgmap v6056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:38.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:38 gibba013 bash[30381]: audit 2021-03-10T17:14:37.329738+0000 mgr.gibba020.yqfnwy (mgr.34427) 10635 : audit [DBG] from='client.61159 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:14:38.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:38 gibba013 bash[30381]: audit 2021-03-10T17:14:37.553361+0000 mgr.gibba020.yqfnwy (mgr.34427) 10636 : audit [DBG] from='client.61165 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:14:38.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:38 gibba013 bash[30381]: audit 2021-03-10T17:14:37.813420+0000 mon.a (mon.0) 3776 : audit [DBG] from='client.? 172.21.2.113:0/91922284' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:38.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:38 gibba020 bash[25448]: cluster 2021-03-10T17:14:37.274634+0000 mgr.gibba020.yqfnwy (mgr.34427) 10634 : cluster [DBG] pgmap v6056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:38.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:38 gibba020 bash[25448]: audit 2021-03-10T17:14:37.329738+0000 mgr.gibba020.yqfnwy (mgr.34427) 10635 : audit [DBG] from='client.61159 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:14:38.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:38 gibba020 bash[25448]: audit 2021-03-10T17:14:37.553361+0000 mgr.gibba020.yqfnwy (mgr.34427) 10636 : audit [DBG] from='client.61165 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:14:38.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:38 gibba020 bash[25448]: audit 2021-03-10T17:14:37.813420+0000 mon.a (mon.0) 3776 : audit [DBG] from='client.? 172.21.2.113:0/91922284' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:14:40.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:40 gibba013 bash[29418]: cluster 2021-03-10T17:14:39.276315+0000 mgr.gibba020.yqfnwy (mgr.34427) 10637 : cluster [DBG] pgmap v6057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:40.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:40 gibba013 bash[30381]: cluster 2021-03-10T17:14:39.276315+0000 mgr.gibba020.yqfnwy (mgr.34427) 10637 : cluster [DBG] pgmap v6057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:40.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:40 gibba020 bash[25448]: cluster 2021-03-10T17:14:39.276315+0000 mgr.gibba020.yqfnwy (mgr.34427) 10637 : cluster [DBG] pgmap v6057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:41.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:41 gibba020 bash[25448]: cluster 2021-03-10T17:14:41.277933+0000 mgr.gibba020.yqfnwy (mgr.34427) 10638 : cluster [DBG] pgmap v6058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:42.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:41 gibba013 bash[29418]: cluster 2021-03-10T17:14:41.277933+0000 mgr.gibba020.yqfnwy (mgr.34427) 10638 : cluster [DBG] pgmap v6058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:42.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:41 gibba013 bash[30381]: cluster 2021-03-10T17:14:41.277933+0000 mgr.gibba020.yqfnwy (mgr.34427) 10638 : cluster [DBG] pgmap v6058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:44.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:44 gibba013 bash[29418]: cluster 2021-03-10T17:14:43.279302+0000 mgr.gibba020.yqfnwy (mgr.34427) 10639 : cluster [DBG] pgmap v6059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:44.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:44 gibba013 bash[30381]: cluster 2021-03-10T17:14:43.279302+0000 mgr.gibba020.yqfnwy (mgr.34427) 10639 : cluster [DBG] pgmap v6059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:44.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:44 gibba020 bash[25448]: cluster 2021-03-10T17:14:43.279302+0000 mgr.gibba020.yqfnwy (mgr.34427) 10639 : cluster [DBG] pgmap v6059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:46.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:46 gibba013 bash[29418]: cluster 2021-03-10T17:14:45.281037+0000 mgr.gibba020.yqfnwy (mgr.34427) 10640 : cluster [DBG] pgmap v6060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:46.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:46 gibba013 bash[30381]: cluster 2021-03-10T17:14:45.281037+0000 mgr.gibba020.yqfnwy (mgr.34427) 10640 : cluster [DBG] pgmap v6060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:46.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:46 gibba020 bash[25448]: cluster 2021-03-10T17:14:45.281037+0000 mgr.gibba020.yqfnwy (mgr.34427) 10640 : cluster [DBG] pgmap v6060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:48.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:48 gibba013 bash[29418]: cluster 2021-03-10T17:14:47.282299+0000 mgr.gibba020.yqfnwy (mgr.34427) 10641 : cluster [DBG] pgmap v6061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:48.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:48 gibba013 bash[30381]: cluster 2021-03-10T17:14:47.282299+0000 mgr.gibba020.yqfnwy (mgr.34427) 10641 : cluster [DBG] pgmap v6061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:48.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:48 gibba020 bash[25448]: cluster 2021-03-10T17:14:47.282299+0000 mgr.gibba020.yqfnwy (mgr.34427) 10641 : cluster [DBG] pgmap v6061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:50.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:50 gibba013 bash[29418]: cluster 2021-03-10T17:14:49.283923+0000 mgr.gibba020.yqfnwy (mgr.34427) 10642 : cluster [DBG] pgmap v6062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:50.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:50 gibba013 bash[29418]: cephadm 2021-03-10T17:14:49.359588+0000 mgr.gibba020.yqfnwy (mgr.34427) 10643 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:14:50.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:50 gibba013 bash[30381]: cluster 2021-03-10T17:14:49.283923+0000 mgr.gibba020.yqfnwy (mgr.34427) 10642 : cluster [DBG] pgmap v6062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:50.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:50 gibba013 bash[30381]: cephadm 2021-03-10T17:14:49.359588+0000 mgr.gibba020.yqfnwy (mgr.34427) 10643 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:14:50.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:50 gibba020 bash[25448]: cluster 2021-03-10T17:14:49.283923+0000 mgr.gibba020.yqfnwy (mgr.34427) 10642 : cluster [DBG] pgmap v6062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:50.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:50 gibba020 bash[25448]: cephadm 2021-03-10T17:14:49.359588+0000 mgr.gibba020.yqfnwy (mgr.34427) 10643 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:14:51.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:51 gibba020 bash[25448]: cluster 2021-03-10T17:14:51.285521+0000 mgr.gibba020.yqfnwy (mgr.34427) 10644 : cluster [DBG] pgmap v6063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:52.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:51 gibba013 bash[29418]: cluster 2021-03-10T17:14:51.285521+0000 mgr.gibba020.yqfnwy (mgr.34427) 10644 : cluster [DBG] pgmap v6063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:52.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:51 gibba013 bash[30381]: cluster 2021-03-10T17:14:51.285521+0000 mgr.gibba020.yqfnwy (mgr.34427) 10644 : cluster [DBG] pgmap v6063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:54.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:54 gibba013 bash[29418]: cluster 2021-03-10T17:14:53.286875+0000 mgr.gibba020.yqfnwy (mgr.34427) 10645 : cluster [DBG] pgmap v6064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:54.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:54 gibba013 bash[30381]: cluster 2021-03-10T17:14:53.286875+0000 mgr.gibba020.yqfnwy (mgr.34427) 10645 : cluster [DBG] pgmap v6064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:54.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:54 gibba020 bash[25448]: cluster 2021-03-10T17:14:53.286875+0000 mgr.gibba020.yqfnwy (mgr.34427) 10645 : cluster [DBG] pgmap v6064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:56.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:56 gibba013 bash[29418]: cluster 2021-03-10T17:14:55.288370+0000 mgr.gibba020.yqfnwy (mgr.34427) 10646 : cluster [DBG] pgmap v6065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:56.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:56 gibba013 bash[30381]: cluster 2021-03-10T17:14:55.288370+0000 mgr.gibba020.yqfnwy (mgr.34427) 10646 : cluster [DBG] pgmap v6065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:56.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:56 gibba020 bash[25448]: cluster 2021-03-10T17:14:55.288370+0000 mgr.gibba020.yqfnwy (mgr.34427) 10646 : cluster [DBG] pgmap v6065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:58.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:14:58 gibba013 bash[29418]: cluster 2021-03-10T17:14:57.289475+0000 mgr.gibba020.yqfnwy (mgr.34427) 10647 : cluster [DBG] pgmap v6066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:58.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:14:58 gibba013 bash[30381]: cluster 2021-03-10T17:14:57.289475+0000 mgr.gibba020.yqfnwy (mgr.34427) 10647 : cluster [DBG] pgmap v6066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:14:58.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:14:58 gibba020 bash[25448]: cluster 2021-03-10T17:14:57.289475+0000 mgr.gibba020.yqfnwy (mgr.34427) 10647 : cluster [DBG] pgmap v6066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:00.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:00 gibba013 bash[29418]: cluster 2021-03-10T17:14:59.290964+0000 mgr.gibba020.yqfnwy (mgr.34427) 10648 : cluster [DBG] pgmap v6067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:00.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:00 gibba013 bash[30381]: cluster 2021-03-10T17:14:59.290964+0000 mgr.gibba020.yqfnwy (mgr.34427) 10648 : cluster [DBG] pgmap v6067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:00.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:00 gibba020 bash[25448]: cluster 2021-03-10T17:14:59.290964+0000 mgr.gibba020.yqfnwy (mgr.34427) 10648 : cluster [DBG] pgmap v6067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:01.915 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:01 gibba013 bash[29418]: cluster 2021-03-10T17:15:01.292852+0000 mgr.gibba020.yqfnwy (mgr.34427) 10649 : cluster [DBG] pgmap v6068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:01.915 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:01 gibba013 bash[30381]: cluster 2021-03-10T17:15:01.292852+0000 mgr.gibba020.yqfnwy (mgr.34427) 10649 : cluster [DBG] pgmap v6068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:01.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:01 gibba020 bash[25448]: cluster 2021-03-10T17:15:01.292852+0000 mgr.gibba020.yqfnwy (mgr.34427) 10649 : cluster [DBG] pgmap v6068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:04.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:04 gibba013 bash[29418]: cluster 2021-03-10T17:15:03.294258+0000 mgr.gibba020.yqfnwy (mgr.34427) 10650 : cluster [DBG] pgmap v6069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:04.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:04 gibba013 bash[30381]: cluster 2021-03-10T17:15:03.294258+0000 mgr.gibba020.yqfnwy (mgr.34427) 10650 : cluster [DBG] pgmap v6069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:04.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:04 gibba020 bash[25448]: cluster 2021-03-10T17:15:03.294258+0000 mgr.gibba020.yqfnwy (mgr.34427) 10650 : cluster [DBG] pgmap v6069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:05.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:05 gibba013 bash[29418]: cephadm 2021-03-10T17:15:04.372449+0000 mgr.gibba020.yqfnwy (mgr.34427) 10651 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:15:05.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:05 gibba013 bash[30381]: cephadm 2021-03-10T17:15:04.372449+0000 mgr.gibba020.yqfnwy (mgr.34427) 10651 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:15:05.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:05 gibba020 bash[25448]: cephadm 2021-03-10T17:15:04.372449+0000 mgr.gibba020.yqfnwy (mgr.34427) 10651 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:15:06.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:06 gibba013 bash[29418]: cluster 2021-03-10T17:15:05.295871+0000 mgr.gibba020.yqfnwy (mgr.34427) 10652 : cluster [DBG] pgmap v6070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:06.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:06 gibba013 bash[30381]: cluster 2021-03-10T17:15:05.295871+0000 mgr.gibba020.yqfnwy (mgr.34427) 10652 : cluster [DBG] pgmap v6070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:06.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:06 gibba020 bash[25448]: cluster 2021-03-10T17:15:05.295871+0000 mgr.gibba020.yqfnwy (mgr.34427) 10652 : cluster [DBG] pgmap v6070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:07.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:07 gibba020 bash[25448]: audit 2021-03-10T17:15:06.934988+0000 mon.a (mon.0) 3777 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:15:07.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:07 gibba020 bash[25448]: audit 2021-03-10T17:15:07.153655+0000 mon.a (mon.0) 3778 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:15:07.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:07 gibba013 bash[29418]: audit 2021-03-10T17:15:06.934988+0000 mon.a (mon.0) 3777 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:15:07.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:07 gibba013 bash[29418]: audit 2021-03-10T17:15:07.153655+0000 mon.a (mon.0) 3778 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:15:07.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:07 gibba013 bash[30381]: audit 2021-03-10T17:15:06.934988+0000 mon.a (mon.0) 3777 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:15:07.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:07 gibba013 bash[30381]: audit 2021-03-10T17:15:07.153655+0000 mon.a (mon.0) 3778 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:15:08.057 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:15:08.286 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:15:08.287 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 3m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:15:08.287 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 2m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:15:08.287 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:15:08.288 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:15:08.288 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:15:08.288 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:15:08.288 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:15:08.288 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:15:08.289 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:15:08.289 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:15:08.289 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:15:08.289 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:15:08.290 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:15:08.290 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:15:08.290 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:15:08.291 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:15:08.291 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:15:08.291 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:15:08.291 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 2m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:15:08.291 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:15:08.539 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:15:08.540 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:15:08.540 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:15:08.540 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:15:08.540 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:15:08.541 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:15:08.541 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:15:08.541 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:15:08.541 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:15:08.541 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:15:08.542 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:15:08.542 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:15:08.542 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:15:08.542 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:15:08.543 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:15:08.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:08 gibba020 bash[25448]: cluster 2021-03-10T17:15:07.297456+0000 mgr.gibba020.yqfnwy (mgr.34427) 10653 : cluster [DBG] pgmap v6071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:08.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:08 gibba020 bash[25448]: audit 2021-03-10T17:15:07.574183+0000 mon.a (mon.0) 3779 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T17:15:08.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:08 gibba020 bash[25448]: audit 2021-03-10T17:15:07.574913+0000 mon.a (mon.0) 3780 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:15:08.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:08 gibba020 bash[25448]: audit 2021-03-10T17:15:07.575565+0000 mon.a (mon.0) 3781 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:15:08.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:08 gibba020 bash[25448]: audit 2021-03-10T17:15:07.576246+0000 mon.a (mon.0) 3782 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:15:08.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:08 gibba013 bash[29418]: cluster 2021-03-10T17:15:07.297456+0000 mgr.gibba020.yqfnwy (mgr.34427) 10653 : cluster [DBG] pgmap v6071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:08 gibba013 bash[29418]: audit 2021-03-10T17:15:07.574183+0000 mon.a (mon.0) 3779 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T17:15:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:08 gibba013 bash[29418]: audit 2021-03-10T17:15:07.574913+0000 mon.a (mon.0) 3780 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:15:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:08 gibba013 bash[29418]: audit 2021-03-10T17:15:07.575565+0000 mon.a (mon.0) 3781 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:15:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:08 gibba013 bash[29418]: audit 2021-03-10T17:15:07.576246+0000 mon.a (mon.0) 3782 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:15:08.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:08 gibba013 bash[30381]: cluster 2021-03-10T17:15:07.297456+0000 mgr.gibba020.yqfnwy (mgr.34427) 10653 : cluster [DBG] pgmap v6071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:08.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:08 gibba013 bash[30381]: audit 2021-03-10T17:15:07.574183+0000 mon.a (mon.0) 3779 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T17:15:08.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:08 gibba013 bash[30381]: audit 2021-03-10T17:15:07.574913+0000 mon.a (mon.0) 3780 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:15:08.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:08 gibba013 bash[30381]: audit 2021-03-10T17:15:07.575565+0000 mon.a (mon.0) 3781 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:15:08.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:08 gibba013 bash[30381]: audit 2021-03-10T17:15:07.576246+0000 mon.a (mon.0) 3782 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:15:09.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:09 gibba020 bash[25448]: audit 2021-03-10T17:15:08.047441+0000 mgr.gibba020.yqfnwy (mgr.34427) 10654 : audit [DBG] from='client.51198 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:15:09.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:09 gibba020 bash[25448]: audit 2021-03-10T17:15:08.272953+0000 mgr.gibba020.yqfnwy (mgr.34427) 10655 : audit [DBG] from='client.61183 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:15:09.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:09 gibba020 bash[25448]: audit 2021-03-10T17:15:08.538819+0000 mon.a (mon.0) 3783 : audit [DBG] from='client.? 172.21.2.113:0/1130353783' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:09.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:09 gibba013 bash[29418]: audit 2021-03-10T17:15:08.047441+0000 mgr.gibba020.yqfnwy (mgr.34427) 10654 : audit [DBG] from='client.51198 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:15:09.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:09 gibba013 bash[29418]: audit 2021-03-10T17:15:08.272953+0000 mgr.gibba020.yqfnwy (mgr.34427) 10655 : audit [DBG] from='client.61183 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:15:09.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:09 gibba013 bash[29418]: audit 2021-03-10T17:15:08.538819+0000 mon.a (mon.0) 3783 : audit [DBG] from='client.? 172.21.2.113:0/1130353783' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:09.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:09 gibba013 bash[30381]: audit 2021-03-10T17:15:08.047441+0000 mgr.gibba020.yqfnwy (mgr.34427) 10654 : audit [DBG] from='client.51198 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:15:09.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:09 gibba013 bash[30381]: audit 2021-03-10T17:15:08.272953+0000 mgr.gibba020.yqfnwy (mgr.34427) 10655 : audit [DBG] from='client.61183 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:15:09.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:09 gibba013 bash[30381]: audit 2021-03-10T17:15:08.538819+0000 mon.a (mon.0) 3783 : audit [DBG] from='client.? 172.21.2.113:0/1130353783' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:10.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:10 gibba020 bash[25448]: cluster 2021-03-10T17:15:09.298847+0000 mgr.gibba020.yqfnwy (mgr.34427) 10656 : cluster [DBG] pgmap v6072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:10.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:10 gibba013 bash[29418]: cluster 2021-03-10T17:15:09.298847+0000 mgr.gibba020.yqfnwy (mgr.34427) 10656 : cluster [DBG] pgmap v6072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:10.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:10 gibba013 bash[30381]: cluster 2021-03-10T17:15:09.298847+0000 mgr.gibba020.yqfnwy (mgr.34427) 10656 : cluster [DBG] pgmap v6072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:11.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:11 gibba020 bash[25448]: cluster 2021-03-10T17:15:11.300596+0000 mgr.gibba020.yqfnwy (mgr.34427) 10657 : cluster [DBG] pgmap v6073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:12.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:11 gibba013 bash[29418]: cluster 2021-03-10T17:15:11.300596+0000 mgr.gibba020.yqfnwy (mgr.34427) 10657 : cluster [DBG] pgmap v6073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:12.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:11 gibba013 bash[30381]: cluster 2021-03-10T17:15:11.300596+0000 mgr.gibba020.yqfnwy (mgr.34427) 10657 : cluster [DBG] pgmap v6073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:14.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:14 gibba013 bash[29418]: cluster 2021-03-10T17:15:13.302112+0000 mgr.gibba020.yqfnwy (mgr.34427) 10658 : cluster [DBG] pgmap v6074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:14.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:14 gibba013 bash[30381]: cluster 2021-03-10T17:15:13.302112+0000 mgr.gibba020.yqfnwy (mgr.34427) 10658 : cluster [DBG] pgmap v6074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:14.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:14 gibba020 bash[25448]: cluster 2021-03-10T17:15:13.302112+0000 mgr.gibba020.yqfnwy (mgr.34427) 10658 : cluster [DBG] pgmap v6074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:16.629 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:16 gibba013 bash[29418]: cluster 2021-03-10T17:15:15.303769+0000 mgr.gibba020.yqfnwy (mgr.34427) 10659 : cluster [DBG] pgmap v6075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:16.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:16 gibba013 bash[30381]: cluster 2021-03-10T17:15:15.303769+0000 mgr.gibba020.yqfnwy (mgr.34427) 10659 : cluster [DBG] pgmap v6075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:16.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:16 gibba020 bash[25448]: cluster 2021-03-10T17:15:15.303769+0000 mgr.gibba020.yqfnwy (mgr.34427) 10659 : cluster [DBG] pgmap v6075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:18.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:18 gibba020 bash[25448]: cluster 2021-03-10T17:15:17.305296+0000 mgr.gibba020.yqfnwy (mgr.34427) 10660 : cluster [DBG] pgmap v6076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:18.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:18 gibba013 bash[29418]: cluster 2021-03-10T17:15:17.305296+0000 mgr.gibba020.yqfnwy (mgr.34427) 10660 : cluster [DBG] pgmap v6076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:18.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:18 gibba013 bash[30381]: cluster 2021-03-10T17:15:17.305296+0000 mgr.gibba020.yqfnwy (mgr.34427) 10660 : cluster [DBG] pgmap v6076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:20.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:20 gibba020 bash[25448]: cluster 2021-03-10T17:15:19.306660+0000 mgr.gibba020.yqfnwy (mgr.34427) 10661 : cluster [DBG] pgmap v6077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:20.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:20 gibba020 bash[25448]: cephadm 2021-03-10T17:15:19.388242+0000 mgr.gibba020.yqfnwy (mgr.34427) 10662 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:15:20.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:20 gibba013 bash[29418]: cluster 2021-03-10T17:15:19.306660+0000 mgr.gibba020.yqfnwy (mgr.34427) 10661 : cluster [DBG] pgmap v6077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:20.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:20 gibba013 bash[29418]: cephadm 2021-03-10T17:15:19.388242+0000 mgr.gibba020.yqfnwy (mgr.34427) 10662 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:15:20.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:20 gibba013 bash[30381]: cluster 2021-03-10T17:15:19.306660+0000 mgr.gibba020.yqfnwy (mgr.34427) 10661 : cluster [DBG] pgmap v6077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:20.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:20 gibba013 bash[30381]: cephadm 2021-03-10T17:15:19.388242+0000 mgr.gibba020.yqfnwy (mgr.34427) 10662 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:15:21.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:21 gibba020 bash[25448]: cluster 2021-03-10T17:15:21.308602+0000 mgr.gibba020.yqfnwy (mgr.34427) 10663 : cluster [DBG] pgmap v6078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:22.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:21 gibba013 bash[29418]: cluster 2021-03-10T17:15:21.308602+0000 mgr.gibba020.yqfnwy (mgr.34427) 10663 : cluster [DBG] pgmap v6078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:22.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:21 gibba013 bash[30381]: cluster 2021-03-10T17:15:21.308602+0000 mgr.gibba020.yqfnwy (mgr.34427) 10663 : cluster [DBG] pgmap v6078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:24.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:24 gibba013 bash[29418]: cluster 2021-03-10T17:15:23.309977+0000 mgr.gibba020.yqfnwy (mgr.34427) 10664 : cluster [DBG] pgmap v6079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:24.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:24 gibba013 bash[30381]: cluster 2021-03-10T17:15:23.309977+0000 mgr.gibba020.yqfnwy (mgr.34427) 10664 : cluster [DBG] pgmap v6079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:24.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:24 gibba020 bash[25448]: cluster 2021-03-10T17:15:23.309977+0000 mgr.gibba020.yqfnwy (mgr.34427) 10664 : cluster [DBG] pgmap v6079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:26.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:26 gibba020 bash[25448]: cluster 2021-03-10T17:15:25.311736+0000 mgr.gibba020.yqfnwy (mgr.34427) 10665 : cluster [DBG] pgmap v6080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:26.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:26 gibba013 bash[29418]: cluster 2021-03-10T17:15:25.311736+0000 mgr.gibba020.yqfnwy (mgr.34427) 10665 : cluster [DBG] pgmap v6080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:26.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:26 gibba013 bash[30381]: cluster 2021-03-10T17:15:25.311736+0000 mgr.gibba020.yqfnwy (mgr.34427) 10665 : cluster [DBG] pgmap v6080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:28.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:28 gibba020 bash[25448]: cluster 2021-03-10T17:15:27.313177+0000 mgr.gibba020.yqfnwy (mgr.34427) 10666 : cluster [DBG] pgmap v6081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:28.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:28 gibba013 bash[29418]: cluster 2021-03-10T17:15:27.313177+0000 mgr.gibba020.yqfnwy (mgr.34427) 10666 : cluster [DBG] pgmap v6081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:28.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:28 gibba013 bash[30381]: cluster 2021-03-10T17:15:27.313177+0000 mgr.gibba020.yqfnwy (mgr.34427) 10666 : cluster [DBG] pgmap v6081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:30.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:30 gibba020 bash[25448]: cluster 2021-03-10T17:15:29.314675+0000 mgr.gibba020.yqfnwy (mgr.34427) 10667 : cluster [DBG] pgmap v6082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:30.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:30 gibba013 bash[29418]: cluster 2021-03-10T17:15:29.314675+0000 mgr.gibba020.yqfnwy (mgr.34427) 10667 : cluster [DBG] pgmap v6082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:30.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:30 gibba013 bash[30381]: cluster 2021-03-10T17:15:29.314675+0000 mgr.gibba020.yqfnwy (mgr.34427) 10667 : cluster [DBG] pgmap v6082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:31.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:31 gibba020 bash[25448]: cluster 2021-03-10T17:15:31.316605+0000 mgr.gibba020.yqfnwy (mgr.34427) 10668 : cluster [DBG] pgmap v6083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:32.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:31 gibba013 bash[29418]: cluster 2021-03-10T17:15:31.316605+0000 mgr.gibba020.yqfnwy (mgr.34427) 10668 : cluster [DBG] pgmap v6083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:32.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:31 gibba013 bash[30381]: cluster 2021-03-10T17:15:31.316605+0000 mgr.gibba020.yqfnwy (mgr.34427) 10668 : cluster [DBG] pgmap v6083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:34.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:34 gibba020 bash[25448]: cluster 2021-03-10T17:15:33.317962+0000 mgr.gibba020.yqfnwy (mgr.34427) 10669 : cluster [DBG] pgmap v6084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:34.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:34 gibba013 bash[29418]: cluster 2021-03-10T17:15:33.317962+0000 mgr.gibba020.yqfnwy (mgr.34427) 10669 : cluster [DBG] pgmap v6084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:34.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:34 gibba013 bash[30381]: cluster 2021-03-10T17:15:33.317962+0000 mgr.gibba020.yqfnwy (mgr.34427) 10669 : cluster [DBG] pgmap v6084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:35.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:35 gibba020 bash[25448]: audit 2021-03-10T17:15:34.404839+0000 mon.a (mon.0) 3784 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:15:35.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:35 gibba020 bash[25448]: cephadm 2021-03-10T17:15:34.406332+0000 mgr.gibba020.yqfnwy (mgr.34427) 10670 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:15:35.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:35 gibba020 bash[25448]: cephadm 2021-03-10T17:15:34.407000+0000 mgr.gibba020.yqfnwy (mgr.34427) 10671 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:15:35.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:35 gibba020 bash[25448]: audit 2021-03-10T17:15:34.598873+0000 mon.a (mon.0) 3785 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:15:35.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:35 gibba020 bash[25448]: cephadm 2021-03-10T17:15:34.601122+0000 mgr.gibba020.yqfnwy (mgr.34427) 10672 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:15:35.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:35 gibba020 bash[25448]: audit 2021-03-10T17:15:34.602314+0000 mon.a (mon.0) 3786 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:15:35.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:35 gibba020 bash[25448]: cephadm 2021-03-10T17:15:34.602820+0000 mgr.gibba020.yqfnwy (mgr.34427) 10673 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:15:35.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:35 gibba020 bash[25448]: audit 2021-03-10T17:15:34.603791+0000 mon.a (mon.0) 3787 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:35.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:35 gibba020 bash[25448]: cephadm 2021-03-10T17:15:34.604199+0000 mgr.gibba020.yqfnwy (mgr.34427) 10674 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:15:35.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:35 gibba020 bash[25448]: cephadm 2021-03-10T17:15:34.604237+0000 mgr.gibba020.yqfnwy (mgr.34427) 10675 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:15:35.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:35 gibba020 bash[25448]: audit 2021-03-10T17:15:34.605154+0000 mon.a (mon.0) 3788 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:35.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:35 gibba020 bash[25448]: cephadm 2021-03-10T17:15:34.605435+0000 mgr.gibba020.yqfnwy (mgr.34427) 10676 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:15:35.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:35 gibba020 bash[25448]: cephadm 2021-03-10T17:15:34.605473+0000 mgr.gibba020.yqfnwy (mgr.34427) 10677 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:15:35.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:35 gibba020 bash[25448]: audit 2021-03-10T17:15:34.606189+0000 mon.a (mon.0) 3789 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:35.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:35 gibba020 bash[25448]: cephadm 2021-03-10T17:15:34.606543+0000 mgr.gibba020.yqfnwy (mgr.34427) 10678 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:15:35.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:35 gibba020 bash[25448]: cephadm 2021-03-10T17:15:34.607470+0000 mgr.gibba020.yqfnwy (mgr.34427) 10679 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:15:35.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:35 gibba020 bash[25448]: cephadm 2021-03-10T17:15:34.607507+0000 mgr.gibba020.yqfnwy (mgr.34427) 10680 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:15:35.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:35 gibba020 bash[25448]: audit 2021-03-10T17:15:34.608510+0000 mon.a (mon.0) 3790 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:35.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:35 gibba020 bash[25448]: cephadm 2021-03-10T17:15:34.608968+0000 mgr.gibba020.yqfnwy (mgr.34427) 10681 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:15:35.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:35 gibba020 bash[25448]: cephadm 2021-03-10T17:15:34.609364+0000 mgr.gibba020.yqfnwy (mgr.34427) 10682 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:15:35.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:35 gibba020 bash[25448]: audit 2021-03-10T17:15:34.610371+0000 mon.a (mon.0) 3791 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:35.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:35 gibba020 bash[25448]: cephadm 2021-03-10T17:15:34.610831+0000 mgr.gibba020.yqfnwy (mgr.34427) 10683 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:15:35.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:35 gibba020 bash[25448]: cephadm 2021-03-10T17:15:34.610945+0000 mgr.gibba020.yqfnwy (mgr.34427) 10684 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:15:35.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:35 gibba020 bash[25448]: cephadm 2021-03-10T17:15:34.611072+0000 mgr.gibba020.yqfnwy (mgr.34427) 10685 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:15:35.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[29418]: audit 2021-03-10T17:15:34.404839+0000 mon.a (mon.0) 3784 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:15:35.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[29418]: cephadm 2021-03-10T17:15:34.406332+0000 mgr.gibba020.yqfnwy (mgr.34427) 10670 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:15:35.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[29418]: cephadm 2021-03-10T17:15:34.407000+0000 mgr.gibba020.yqfnwy (mgr.34427) 10671 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:15:35.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[29418]: audit 2021-03-10T17:15:34.598873+0000 mon.a (mon.0) 3785 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:15:35.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[29418]: cephadm 2021-03-10T17:15:34.601122+0000 mgr.gibba020.yqfnwy (mgr.34427) 10672 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:15:35.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[29418]: audit 2021-03-10T17:15:34.602314+0000 mon.a (mon.0) 3786 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:15:35.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[29418]: cephadm 2021-03-10T17:15:34.602820+0000 mgr.gibba020.yqfnwy (mgr.34427) 10673 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:15:35.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[29418]: audit 2021-03-10T17:15:34.603791+0000 mon.a (mon.0) 3787 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:35.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[29418]: cephadm 2021-03-10T17:15:34.604199+0000 mgr.gibba020.yqfnwy (mgr.34427) 10674 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:15:35.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[29418]: cephadm 2021-03-10T17:15:34.604237+0000 mgr.gibba020.yqfnwy (mgr.34427) 10675 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:15:35.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[29418]: audit 2021-03-10T17:15:34.605154+0000 mon.a (mon.0) 3788 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:35.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[29418]: cephadm 2021-03-10T17:15:34.605435+0000 mgr.gibba020.yqfnwy (mgr.34427) 10676 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:15:35.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[29418]: cephadm 2021-03-10T17:15:34.605473+0000 mgr.gibba020.yqfnwy (mgr.34427) 10677 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:15:35.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[29418]: audit 2021-03-10T17:15:34.606189+0000 mon.a (mon.0) 3789 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:35.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[29418]: cephadm 2021-03-10T17:15:34.606543+0000 mgr.gibba020.yqfnwy (mgr.34427) 10678 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:15:35.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[29418]: cephadm 2021-03-10T17:15:34.607470+0000 mgr.gibba020.yqfnwy (mgr.34427) 10679 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:15:35.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[29418]: cephadm 2021-03-10T17:15:34.607507+0000 mgr.gibba020.yqfnwy (mgr.34427) 10680 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:15:35.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[29418]: audit 2021-03-10T17:15:34.608510+0000 mon.a (mon.0) 3790 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:35.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[29418]: cephadm 2021-03-10T17:15:34.608968+0000 mgr.gibba020.yqfnwy (mgr.34427) 10681 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:15:35.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[29418]: cephadm 2021-03-10T17:15:34.609364+0000 mgr.gibba020.yqfnwy (mgr.34427) 10682 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:15:35.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[30381]: audit 2021-03-10T17:15:34.404839+0000 mon.a (mon.0) 3784 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:15:35.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[30381]: cephadm 2021-03-10T17:15:34.406332+0000 mgr.gibba020.yqfnwy (mgr.34427) 10670 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:15:35.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[30381]: cephadm 2021-03-10T17:15:34.407000+0000 mgr.gibba020.yqfnwy (mgr.34427) 10671 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:15:35.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[30381]: audit 2021-03-10T17:15:34.598873+0000 mon.a (mon.0) 3785 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:15:35.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[30381]: cephadm 2021-03-10T17:15:34.601122+0000 mgr.gibba020.yqfnwy (mgr.34427) 10672 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:15:35.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[30381]: audit 2021-03-10T17:15:34.602314+0000 mon.a (mon.0) 3786 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:15:35.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[30381]: cephadm 2021-03-10T17:15:34.602820+0000 mgr.gibba020.yqfnwy (mgr.34427) 10673 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:15:35.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[30381]: audit 2021-03-10T17:15:34.603791+0000 mon.a (mon.0) 3787 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:35.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[30381]: cephadm 2021-03-10T17:15:34.604199+0000 mgr.gibba020.yqfnwy (mgr.34427) 10674 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:15:35.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[30381]: cephadm 2021-03-10T17:15:34.604237+0000 mgr.gibba020.yqfnwy (mgr.34427) 10675 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:15:35.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[30381]: audit 2021-03-10T17:15:34.605154+0000 mon.a (mon.0) 3788 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:35.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[30381]: cephadm 2021-03-10T17:15:34.605435+0000 mgr.gibba020.yqfnwy (mgr.34427) 10676 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:15:35.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[30381]: cephadm 2021-03-10T17:15:34.605473+0000 mgr.gibba020.yqfnwy (mgr.34427) 10677 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:15:35.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[30381]: audit 2021-03-10T17:15:34.606189+0000 mon.a (mon.0) 3789 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:35.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[30381]: cephadm 2021-03-10T17:15:34.606543+0000 mgr.gibba020.yqfnwy (mgr.34427) 10678 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:15:35.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[30381]: cephadm 2021-03-10T17:15:34.607470+0000 mgr.gibba020.yqfnwy (mgr.34427) 10679 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:15:35.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[30381]: cephadm 2021-03-10T17:15:34.607507+0000 mgr.gibba020.yqfnwy (mgr.34427) 10680 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:15:35.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[30381]: audit 2021-03-10T17:15:34.608510+0000 mon.a (mon.0) 3790 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:35.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[30381]: cephadm 2021-03-10T17:15:34.608968+0000 mgr.gibba020.yqfnwy (mgr.34427) 10681 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:15:35.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[30381]: cephadm 2021-03-10T17:15:34.609364+0000 mgr.gibba020.yqfnwy (mgr.34427) 10682 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:15:35.890 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[29418]: audit 2021-03-10T17:15:34.610371+0000 mon.a (mon.0) 3791 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:35.890 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[29418]: cephadm 2021-03-10T17:15:34.610831+0000 mgr.gibba020.yqfnwy (mgr.34427) 10683 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:15:35.891 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[29418]: cephadm 2021-03-10T17:15:34.610945+0000 mgr.gibba020.yqfnwy (mgr.34427) 10684 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:15:35.891 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[29418]: cephadm 2021-03-10T17:15:34.611072+0000 mgr.gibba020.yqfnwy (mgr.34427) 10685 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:15:35.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[30381]: audit 2021-03-10T17:15:34.610371+0000 mon.a (mon.0) 3791 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:35.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[30381]: cephadm 2021-03-10T17:15:34.610831+0000 mgr.gibba020.yqfnwy (mgr.34427) 10683 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:15:35.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[30381]: cephadm 2021-03-10T17:15:34.610945+0000 mgr.gibba020.yqfnwy (mgr.34427) 10684 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:15:35.892 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:35 gibba013 bash[30381]: cephadm 2021-03-10T17:15:34.611072+0000 mgr.gibba020.yqfnwy (mgr.34427) 10685 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:15:36.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:36 gibba013 bash[29418]: cluster 2021-03-10T17:15:35.319540+0000 mgr.gibba020.yqfnwy (mgr.34427) 10686 : cluster [DBG] pgmap v6085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:36.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:36 gibba013 bash[30381]: cluster 2021-03-10T17:15:35.319540+0000 mgr.gibba020.yqfnwy (mgr.34427) 10686 : cluster [DBG] pgmap v6085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:36.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:36 gibba020 bash[25448]: cluster 2021-03-10T17:15:35.319540+0000 mgr.gibba020.yqfnwy (mgr.34427) 10686 : cluster [DBG] pgmap v6085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:38.784 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:15:38.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:38 gibba013 bash[29418]: cluster 2021-03-10T17:15:37.320931+0000 mgr.gibba020.yqfnwy (mgr.34427) 10687 : cluster [DBG] pgmap v6086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:38.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:38 gibba013 bash[30381]: cluster 2021-03-10T17:15:37.320931+0000 mgr.gibba020.yqfnwy (mgr.34427) 10687 : cluster [DBG] pgmap v6086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:38.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:38 gibba020 bash[25448]: cluster 2021-03-10T17:15:37.320931+0000 mgr.gibba020.yqfnwy (mgr.34427) 10687 : cluster [DBG] pgmap v6086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:39.010 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:15:39.011 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 4m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:15:39.011 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 3m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:15:39.011 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:15:39.011 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:15:39.011 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:15:39.012 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:15:39.012 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:15:39.012 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:15:39.012 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:15:39.013 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:15:39.013 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:15:39.013 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:15:39.013 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:15:39.013 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:15:39.014 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:15:39.014 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:15:39.014 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:15:39.014 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:15:39.015 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 3m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:15:39.015 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 3m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:15:39.259 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:15:39.259 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:15:39.260 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:15:39.260 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:15:39.260 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:15:39.260 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:15:39.260 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:15:39.261 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:15:39.261 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:15:39.261 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:15:39.261 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:15:39.262 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:15:39.262 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:15:39.262 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:15:39.262 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:15:39.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:39 gibba013 bash[29418]: audit 2021-03-10T17:15:39.258427+0000 mon.a (mon.0) 3792 : audit [DBG] from='client.? 172.21.2.113:0/2067400451' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:39.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:39 gibba013 bash[30381]: audit 2021-03-10T17:15:39.258427+0000 mon.a (mon.0) 3792 : audit [DBG] from='client.? 172.21.2.113:0/2067400451' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:39.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:39 gibba020 bash[25448]: audit 2021-03-10T17:15:39.258427+0000 mon.a (mon.0) 3792 : audit [DBG] from='client.? 172.21.2.113:0/2067400451' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:15:40.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:40 gibba020 bash[25448]: audit 2021-03-10T17:15:38.773706+0000 mgr.gibba020.yqfnwy (mgr.34427) 10688 : audit [DBG] from='client.51216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:15:40.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:40 gibba020 bash[25448]: audit 2021-03-10T17:15:38.996415+0000 mgr.gibba020.yqfnwy (mgr.34427) 10689 : audit [DBG] from='client.51222 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:15:40.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:40 gibba020 bash[25448]: cluster 2021-03-10T17:15:39.322184+0000 mgr.gibba020.yqfnwy (mgr.34427) 10690 : cluster [DBG] pgmap v6087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:41.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:40 gibba013 bash[29418]: audit 2021-03-10T17:15:38.773706+0000 mgr.gibba020.yqfnwy (mgr.34427) 10688 : audit [DBG] from='client.51216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:15:41.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:40 gibba013 bash[29418]: audit 2021-03-10T17:15:38.996415+0000 mgr.gibba020.yqfnwy (mgr.34427) 10689 : audit [DBG] from='client.51222 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:15:41.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:40 gibba013 bash[29418]: cluster 2021-03-10T17:15:39.322184+0000 mgr.gibba020.yqfnwy (mgr.34427) 10690 : cluster [DBG] pgmap v6087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:41.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:40 gibba013 bash[30381]: audit 2021-03-10T17:15:38.773706+0000 mgr.gibba020.yqfnwy (mgr.34427) 10688 : audit [DBG] from='client.51216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:15:41.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:40 gibba013 bash[30381]: audit 2021-03-10T17:15:38.996415+0000 mgr.gibba020.yqfnwy (mgr.34427) 10689 : audit [DBG] from='client.51222 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:15:41.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:40 gibba013 bash[30381]: cluster 2021-03-10T17:15:39.322184+0000 mgr.gibba020.yqfnwy (mgr.34427) 10690 : cluster [DBG] pgmap v6087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:41.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:41 gibba020 bash[25448]: cluster 2021-03-10T17:15:41.324124+0000 mgr.gibba020.yqfnwy (mgr.34427) 10691 : cluster [DBG] pgmap v6088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:42.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:41 gibba013 bash[29418]: cluster 2021-03-10T17:15:41.324124+0000 mgr.gibba020.yqfnwy (mgr.34427) 10691 : cluster [DBG] pgmap v6088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:42.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:41 gibba013 bash[30381]: cluster 2021-03-10T17:15:41.324124+0000 mgr.gibba020.yqfnwy (mgr.34427) 10691 : cluster [DBG] pgmap v6088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:44.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:44 gibba020 bash[25448]: cluster 2021-03-10T17:15:43.325521+0000 mgr.gibba020.yqfnwy (mgr.34427) 10692 : cluster [DBG] pgmap v6089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:44.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:44 gibba013 bash[29418]: cluster 2021-03-10T17:15:43.325521+0000 mgr.gibba020.yqfnwy (mgr.34427) 10692 : cluster [DBG] pgmap v6089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:44.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:44 gibba013 bash[30381]: cluster 2021-03-10T17:15:43.325521+0000 mgr.gibba020.yqfnwy (mgr.34427) 10692 : cluster [DBG] pgmap v6089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:46.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:46 gibba020 bash[25448]: cluster 2021-03-10T17:15:45.327274+0000 mgr.gibba020.yqfnwy (mgr.34427) 10693 : cluster [DBG] pgmap v6090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:46.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:46 gibba013 bash[29418]: cluster 2021-03-10T17:15:45.327274+0000 mgr.gibba020.yqfnwy (mgr.34427) 10693 : cluster [DBG] pgmap v6090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:46.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:46 gibba013 bash[30381]: cluster 2021-03-10T17:15:45.327274+0000 mgr.gibba020.yqfnwy (mgr.34427) 10693 : cluster [DBG] pgmap v6090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:48.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:48 gibba020 bash[25448]: cluster 2021-03-10T17:15:47.328999+0000 mgr.gibba020.yqfnwy (mgr.34427) 10694 : cluster [DBG] pgmap v6091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:48.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:48 gibba013 bash[29418]: cluster 2021-03-10T17:15:47.328999+0000 mgr.gibba020.yqfnwy (mgr.34427) 10694 : cluster [DBG] pgmap v6091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:48.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:48 gibba013 bash[30381]: cluster 2021-03-10T17:15:47.328999+0000 mgr.gibba020.yqfnwy (mgr.34427) 10694 : cluster [DBG] pgmap v6091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:50.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:50 gibba020 bash[25448]: cluster 2021-03-10T17:15:49.330265+0000 mgr.gibba020.yqfnwy (mgr.34427) 10695 : cluster [DBG] pgmap v6092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:50.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:50 gibba020 bash[25448]: cephadm 2021-03-10T17:15:49.616605+0000 mgr.gibba020.yqfnwy (mgr.34427) 10696 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:15:50.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:50 gibba013 bash[29418]: cluster 2021-03-10T17:15:49.330265+0000 mgr.gibba020.yqfnwy (mgr.34427) 10695 : cluster [DBG] pgmap v6092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:50.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:50 gibba013 bash[29418]: cephadm 2021-03-10T17:15:49.616605+0000 mgr.gibba020.yqfnwy (mgr.34427) 10696 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:15:50.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:50 gibba013 bash[30381]: cluster 2021-03-10T17:15:49.330265+0000 mgr.gibba020.yqfnwy (mgr.34427) 10695 : cluster [DBG] pgmap v6092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:50.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:50 gibba013 bash[30381]: cephadm 2021-03-10T17:15:49.616605+0000 mgr.gibba020.yqfnwy (mgr.34427) 10696 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:15:51.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:51 gibba020 bash[25448]: cluster 2021-03-10T17:15:51.332061+0000 mgr.gibba020.yqfnwy (mgr.34427) 10697 : cluster [DBG] pgmap v6093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:52.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:51 gibba013 bash[29418]: cluster 2021-03-10T17:15:51.332061+0000 mgr.gibba020.yqfnwy (mgr.34427) 10697 : cluster [DBG] pgmap v6093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:52.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:51 gibba013 bash[30381]: cluster 2021-03-10T17:15:51.332061+0000 mgr.gibba020.yqfnwy (mgr.34427) 10697 : cluster [DBG] pgmap v6093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:54.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:54 gibba020 bash[25448]: cluster 2021-03-10T17:15:53.333455+0000 mgr.gibba020.yqfnwy (mgr.34427) 10698 : cluster [DBG] pgmap v6094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:54.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:54 gibba013 bash[29418]: cluster 2021-03-10T17:15:53.333455+0000 mgr.gibba020.yqfnwy (mgr.34427) 10698 : cluster [DBG] pgmap v6094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:54.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:54 gibba013 bash[30381]: cluster 2021-03-10T17:15:53.333455+0000 mgr.gibba020.yqfnwy (mgr.34427) 10698 : cluster [DBG] pgmap v6094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:56.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:56 gibba020 bash[25448]: cluster 2021-03-10T17:15:55.334904+0000 mgr.gibba020.yqfnwy (mgr.34427) 10699 : cluster [DBG] pgmap v6095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:56.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:56 gibba013 bash[29418]: cluster 2021-03-10T17:15:55.334904+0000 mgr.gibba020.yqfnwy (mgr.34427) 10699 : cluster [DBG] pgmap v6095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:56.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:56 gibba013 bash[30381]: cluster 2021-03-10T17:15:55.334904+0000 mgr.gibba020.yqfnwy (mgr.34427) 10699 : cluster [DBG] pgmap v6095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:58.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:15:58 gibba020 bash[25448]: cluster 2021-03-10T17:15:57.336533+0000 mgr.gibba020.yqfnwy (mgr.34427) 10700 : cluster [DBG] pgmap v6096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:58.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:15:58 gibba013 bash[29418]: cluster 2021-03-10T17:15:57.336533+0000 mgr.gibba020.yqfnwy (mgr.34427) 10700 : cluster [DBG] pgmap v6096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:15:58.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:15:58 gibba013 bash[30381]: cluster 2021-03-10T17:15:57.336533+0000 mgr.gibba020.yqfnwy (mgr.34427) 10700 : cluster [DBG] pgmap v6096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:00.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:00 gibba020 bash[25448]: cluster 2021-03-10T17:15:59.337936+0000 mgr.gibba020.yqfnwy (mgr.34427) 10701 : cluster [DBG] pgmap v6097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:00.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:00 gibba013 bash[29418]: cluster 2021-03-10T17:15:59.337936+0000 mgr.gibba020.yqfnwy (mgr.34427) 10701 : cluster [DBG] pgmap v6097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:00.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:00 gibba013 bash[30381]: cluster 2021-03-10T17:15:59.337936+0000 mgr.gibba020.yqfnwy (mgr.34427) 10701 : cluster [DBG] pgmap v6097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:01.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:01 gibba020 bash[25448]: cluster 2021-03-10T17:16:01.339502+0000 mgr.gibba020.yqfnwy (mgr.34427) 10702 : cluster [DBG] pgmap v6098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:02.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:01 gibba013 bash[29418]: cluster 2021-03-10T17:16:01.339502+0000 mgr.gibba020.yqfnwy (mgr.34427) 10702 : cluster [DBG] pgmap v6098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:02.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:01 gibba013 bash[30381]: cluster 2021-03-10T17:16:01.339502+0000 mgr.gibba020.yqfnwy (mgr.34427) 10702 : cluster [DBG] pgmap v6098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:04.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:04 gibba020 bash[25448]: cluster 2021-03-10T17:16:03.340917+0000 mgr.gibba020.yqfnwy (mgr.34427) 10703 : cluster [DBG] pgmap v6099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:04.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:04 gibba013 bash[29418]: cluster 2021-03-10T17:16:03.340917+0000 mgr.gibba020.yqfnwy (mgr.34427) 10703 : cluster [DBG] pgmap v6099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:04.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:04 gibba013 bash[30381]: cluster 2021-03-10T17:16:03.340917+0000 mgr.gibba020.yqfnwy (mgr.34427) 10703 : cluster [DBG] pgmap v6099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:05.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:05 gibba020 bash[25448]: cephadm 2021-03-10T17:16:04.632425+0000 mgr.gibba020.yqfnwy (mgr.34427) 10704 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:16:05.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:05 gibba013 bash[29418]: cephadm 2021-03-10T17:16:04.632425+0000 mgr.gibba020.yqfnwy (mgr.34427) 10704 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:16:05.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:05 gibba013 bash[30381]: cephadm 2021-03-10T17:16:04.632425+0000 mgr.gibba020.yqfnwy (mgr.34427) 10704 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:16:06.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:06 gibba020 bash[25448]: cluster 2021-03-10T17:16:05.342547+0000 mgr.gibba020.yqfnwy (mgr.34427) 10705 : cluster [DBG] pgmap v6100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:06.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:06 gibba013 bash[29418]: cluster 2021-03-10T17:16:05.342547+0000 mgr.gibba020.yqfnwy (mgr.34427) 10705 : cluster [DBG] pgmap v6100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:06.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:06 gibba013 bash[30381]: cluster 2021-03-10T17:16:05.342547+0000 mgr.gibba020.yqfnwy (mgr.34427) 10705 : cluster [DBG] pgmap v6100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:07.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:07 gibba020 bash[25448]: audit 2021-03-10T17:16:06.940203+0000 mon.a (mon.0) 3793 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:16:07.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:07 gibba020 bash[25448]: audit 2021-03-10T17:16:07.160131+0000 mon.a (mon.0) 3794 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:16:07.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:07 gibba013 bash[29418]: audit 2021-03-10T17:16:06.940203+0000 mon.a (mon.0) 3793 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:16:07.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:07 gibba013 bash[29418]: audit 2021-03-10T17:16:07.160131+0000 mon.a (mon.0) 3794 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:16:07.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:07 gibba013 bash[30381]: audit 2021-03-10T17:16:06.940203+0000 mon.a (mon.0) 3793 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:16:07.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:07 gibba013 bash[30381]: audit 2021-03-10T17:16:07.160131+0000 mon.a (mon.0) 3794 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:16:08.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:08 gibba020 bash[25448]: cluster 2021-03-10T17:16:07.343814+0000 mgr.gibba020.yqfnwy (mgr.34427) 10706 : cluster [DBG] pgmap v6101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:08.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:08 gibba020 bash[25448]: audit 2021-03-10T17:16:07.583577+0000 mon.a (mon.0) 3795 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T17:16:08.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:08 gibba020 bash[25448]: audit 2021-03-10T17:16:07.584318+0000 mon.a (mon.0) 3796 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:16:08.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:08 gibba020 bash[25448]: audit 2021-03-10T17:16:07.584976+0000 mon.a (mon.0) 3797 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:16:08.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:08 gibba020 bash[25448]: audit 2021-03-10T17:16:07.585638+0000 mon.a (mon.0) 3798 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:16:08.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:08 gibba013 bash[29418]: cluster 2021-03-10T17:16:07.343814+0000 mgr.gibba020.yqfnwy (mgr.34427) 10706 : cluster [DBG] pgmap v6101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:08 gibba013 bash[29418]: audit 2021-03-10T17:16:07.583577+0000 mon.a (mon.0) 3795 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T17:16:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:08 gibba013 bash[29418]: audit 2021-03-10T17:16:07.584318+0000 mon.a (mon.0) 3796 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:16:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:08 gibba013 bash[29418]: audit 2021-03-10T17:16:07.584976+0000 mon.a (mon.0) 3797 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:16:08.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:08 gibba013 bash[29418]: audit 2021-03-10T17:16:07.585638+0000 mon.a (mon.0) 3798 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:16:08.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:08 gibba013 bash[30381]: cluster 2021-03-10T17:16:07.343814+0000 mgr.gibba020.yqfnwy (mgr.34427) 10706 : cluster [DBG] pgmap v6101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:08.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:08 gibba013 bash[30381]: audit 2021-03-10T17:16:07.583577+0000 mon.a (mon.0) 3795 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T17:16:08.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:08 gibba013 bash[30381]: audit 2021-03-10T17:16:07.584318+0000 mon.a (mon.0) 3796 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:16:08.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:08 gibba013 bash[30381]: audit 2021-03-10T17:16:07.584976+0000 mon.a (mon.0) 3797 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:16:08.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:08 gibba013 bash[30381]: audit 2021-03-10T17:16:07.585638+0000 mon.a (mon.0) 3798 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:16:09.502 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:16:09.729 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:16:09.730 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 4m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:16:09.730 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 3m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:16:09.730 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:16:09.730 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:16:09.731 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:16:09.731 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:16:09.731 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:16:09.731 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:16:09.732 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:16:09.732 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:16:09.732 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:16:09.732 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:16:09.733 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:16:09.733 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:16:09.733 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:16:09.733 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:16:09.734 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:16:09.734 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:16:09.734 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 3m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:16:09.734 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 3m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:16:09.979 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:16:09.979 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:16:09.979 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:16:09.980 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:16:09.980 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:16:09.980 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:16:09.980 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:16:09.981 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:16:09.981 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:16:09.981 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:16:09.981 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:16:09.981 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:16:09.982 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:16:09.982 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:16:09.982 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:16:10.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:10 gibba020 bash[25448]: cluster 2021-03-10T17:16:09.345149+0000 mgr.gibba020.yqfnwy (mgr.34427) 10707 : cluster [DBG] pgmap v6102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:10.756 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:10 gibba020 bash[25448]: audit 2021-03-10T17:16:09.491768+0000 mgr.gibba020.yqfnwy (mgr.34427) 10708 : audit [DBG] from='client.61213 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:16:10.757 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:10 gibba020 bash[25448]: audit 2021-03-10T17:16:09.977973+0000 mon.a (mon.0) 3799 : audit [DBG] from='client.? 172.21.2.113:0/1736740368' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:10.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:10 gibba013 bash[29418]: cluster 2021-03-10T17:16:09.345149+0000 mgr.gibba020.yqfnwy (mgr.34427) 10707 : cluster [DBG] pgmap v6102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:10.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:10 gibba013 bash[29418]: audit 2021-03-10T17:16:09.491768+0000 mgr.gibba020.yqfnwy (mgr.34427) 10708 : audit [DBG] from='client.61213 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:16:10.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:10 gibba013 bash[29418]: audit 2021-03-10T17:16:09.977973+0000 mon.a (mon.0) 3799 : audit [DBG] from='client.? 172.21.2.113:0/1736740368' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:10.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:10 gibba013 bash[30381]: cluster 2021-03-10T17:16:09.345149+0000 mgr.gibba020.yqfnwy (mgr.34427) 10707 : cluster [DBG] pgmap v6102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:10.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:10 gibba013 bash[30381]: audit 2021-03-10T17:16:09.491768+0000 mgr.gibba020.yqfnwy (mgr.34427) 10708 : audit [DBG] from='client.61213 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:16:10.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:10 gibba013 bash[30381]: audit 2021-03-10T17:16:09.977973+0000 mon.a (mon.0) 3799 : audit [DBG] from='client.? 172.21.2.113:0/1736740368' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:11.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:11 gibba013 bash[29418]: audit 2021-03-10T17:16:09.715141+0000 mgr.gibba020.yqfnwy (mgr.34427) 10709 : audit [DBG] from='client.51240 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:16:11.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:11 gibba013 bash[30381]: audit 2021-03-10T17:16:09.715141+0000 mgr.gibba020.yqfnwy (mgr.34427) 10709 : audit [DBG] from='client.51240 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:16:11.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:11 gibba020 bash[25448]: audit 2021-03-10T17:16:09.715141+0000 mgr.gibba020.yqfnwy (mgr.34427) 10709 : audit [DBG] from='client.51240 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:16:12.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:12 gibba013 bash[29418]: cluster 2021-03-10T17:16:11.347066+0000 mgr.gibba020.yqfnwy (mgr.34427) 10710 : cluster [DBG] pgmap v6103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:12.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:12 gibba013 bash[30381]: cluster 2021-03-10T17:16:11.347066+0000 mgr.gibba020.yqfnwy (mgr.34427) 10710 : cluster [DBG] pgmap v6103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:12.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:12 gibba020 bash[25448]: cluster 2021-03-10T17:16:11.347066+0000 mgr.gibba020.yqfnwy (mgr.34427) 10710 : cluster [DBG] pgmap v6103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:14.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:14 gibba013 bash[29418]: cluster 2021-03-10T17:16:13.348493+0000 mgr.gibba020.yqfnwy (mgr.34427) 10711 : cluster [DBG] pgmap v6104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:14.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:14 gibba013 bash[30381]: cluster 2021-03-10T17:16:13.348493+0000 mgr.gibba020.yqfnwy (mgr.34427) 10711 : cluster [DBG] pgmap v6104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:14.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:14 gibba020 bash[25448]: cluster 2021-03-10T17:16:13.348493+0000 mgr.gibba020.yqfnwy (mgr.34427) 10711 : cluster [DBG] pgmap v6104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:16.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:16 gibba013 bash[29418]: cluster 2021-03-10T17:16:15.350240+0000 mgr.gibba020.yqfnwy (mgr.34427) 10712 : cluster [DBG] pgmap v6105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:16.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:16 gibba013 bash[30381]: cluster 2021-03-10T17:16:15.350240+0000 mgr.gibba020.yqfnwy (mgr.34427) 10712 : cluster [DBG] pgmap v6105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:16.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:16 gibba020 bash[25448]: cluster 2021-03-10T17:16:15.350240+0000 mgr.gibba020.yqfnwy (mgr.34427) 10712 : cluster [DBG] pgmap v6105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:18.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:18 gibba013 bash[29418]: cluster 2021-03-10T17:16:17.351506+0000 mgr.gibba020.yqfnwy (mgr.34427) 10713 : cluster [DBG] pgmap v6106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:18.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:18 gibba013 bash[30381]: cluster 2021-03-10T17:16:17.351506+0000 mgr.gibba020.yqfnwy (mgr.34427) 10713 : cluster [DBG] pgmap v6106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:18.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:18 gibba020 bash[25448]: cluster 2021-03-10T17:16:17.351506+0000 mgr.gibba020.yqfnwy (mgr.34427) 10713 : cluster [DBG] pgmap v6106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:20.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:20 gibba013 bash[29418]: cluster 2021-03-10T17:16:19.353059+0000 mgr.gibba020.yqfnwy (mgr.34427) 10714 : cluster [DBG] pgmap v6107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:20.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:20 gibba013 bash[29418]: cephadm 2021-03-10T17:16:19.648246+0000 mgr.gibba020.yqfnwy (mgr.34427) 10715 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:16:20.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:20 gibba013 bash[30381]: cluster 2021-03-10T17:16:19.353059+0000 mgr.gibba020.yqfnwy (mgr.34427) 10714 : cluster [DBG] pgmap v6107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:20.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:20 gibba013 bash[30381]: cephadm 2021-03-10T17:16:19.648246+0000 mgr.gibba020.yqfnwy (mgr.34427) 10715 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:16:20.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:20 gibba020 bash[25448]: cluster 2021-03-10T17:16:19.353059+0000 mgr.gibba020.yqfnwy (mgr.34427) 10714 : cluster [DBG] pgmap v6107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:20.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:20 gibba020 bash[25448]: cephadm 2021-03-10T17:16:19.648246+0000 mgr.gibba020.yqfnwy (mgr.34427) 10715 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:16:22.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:21 gibba013 bash[29418]: cluster 2021-03-10T17:16:21.354877+0000 mgr.gibba020.yqfnwy (mgr.34427) 10716 : cluster [DBG] pgmap v6108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:22.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:21 gibba013 bash[30381]: cluster 2021-03-10T17:16:21.354877+0000 mgr.gibba020.yqfnwy (mgr.34427) 10716 : cluster [DBG] pgmap v6108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:22.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:21 gibba020 bash[25448]: cluster 2021-03-10T17:16:21.354877+0000 mgr.gibba020.yqfnwy (mgr.34427) 10716 : cluster [DBG] pgmap v6108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:24.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:24 gibba020 bash[25448]: cluster 2021-03-10T17:16:23.356272+0000 mgr.gibba020.yqfnwy (mgr.34427) 10717 : cluster [DBG] pgmap v6109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:24.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:24 gibba013 bash[29418]: cluster 2021-03-10T17:16:23.356272+0000 mgr.gibba020.yqfnwy (mgr.34427) 10717 : cluster [DBG] pgmap v6109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:24.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:24 gibba013 bash[30381]: cluster 2021-03-10T17:16:23.356272+0000 mgr.gibba020.yqfnwy (mgr.34427) 10717 : cluster [DBG] pgmap v6109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:26.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:26 gibba020 bash[25448]: cluster 2021-03-10T17:16:25.357757+0000 mgr.gibba020.yqfnwy (mgr.34427) 10718 : cluster [DBG] pgmap v6110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:26.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:26 gibba013 bash[29418]: cluster 2021-03-10T17:16:25.357757+0000 mgr.gibba020.yqfnwy (mgr.34427) 10718 : cluster [DBG] pgmap v6110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:26.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:26 gibba013 bash[30381]: cluster 2021-03-10T17:16:25.357757+0000 mgr.gibba020.yqfnwy (mgr.34427) 10718 : cluster [DBG] pgmap v6110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:28.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:28 gibba020 bash[25448]: cluster 2021-03-10T17:16:27.359262+0000 mgr.gibba020.yqfnwy (mgr.34427) 10719 : cluster [DBG] pgmap v6111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:28.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:28 gibba013 bash[29418]: cluster 2021-03-10T17:16:27.359262+0000 mgr.gibba020.yqfnwy (mgr.34427) 10719 : cluster [DBG] pgmap v6111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:28.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:28 gibba013 bash[30381]: cluster 2021-03-10T17:16:27.359262+0000 mgr.gibba020.yqfnwy (mgr.34427) 10719 : cluster [DBG] pgmap v6111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:30.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:30 gibba020 bash[25448]: cluster 2021-03-10T17:16:29.360698+0000 mgr.gibba020.yqfnwy (mgr.34427) 10720 : cluster [DBG] pgmap v6112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:30.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:30 gibba013 bash[29418]: cluster 2021-03-10T17:16:29.360698+0000 mgr.gibba020.yqfnwy (mgr.34427) 10720 : cluster [DBG] pgmap v6112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:30.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:30 gibba013 bash[30381]: cluster 2021-03-10T17:16:29.360698+0000 mgr.gibba020.yqfnwy (mgr.34427) 10720 : cluster [DBG] pgmap v6112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:32.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:31 gibba013 bash[29418]: cluster 2021-03-10T17:16:31.362544+0000 mgr.gibba020.yqfnwy (mgr.34427) 10721 : cluster [DBG] pgmap v6113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:32.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:31 gibba013 bash[30381]: cluster 2021-03-10T17:16:31.362544+0000 mgr.gibba020.yqfnwy (mgr.34427) 10721 : cluster [DBG] pgmap v6113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:32.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:31 gibba020 bash[25448]: cluster 2021-03-10T17:16:31.362544+0000 mgr.gibba020.yqfnwy (mgr.34427) 10721 : cluster [DBG] pgmap v6113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:34.697 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:34 gibba020 bash[25448]: cluster 2021-03-10T17:16:33.363903+0000 mgr.gibba020.yqfnwy (mgr.34427) 10722 : cluster [DBG] pgmap v6114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:34.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:34 gibba013 bash[29418]: cluster 2021-03-10T17:16:33.363903+0000 mgr.gibba020.yqfnwy (mgr.34427) 10722 : cluster [DBG] pgmap v6114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:34.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:34 gibba013 bash[30381]: cluster 2021-03-10T17:16:33.363903+0000 mgr.gibba020.yqfnwy (mgr.34427) 10722 : cluster [DBG] pgmap v6114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:35.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:35 gibba020 bash[25448]: audit 2021-03-10T17:16:34.665785+0000 mon.a (mon.0) 3800 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:16:35.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:35 gibba020 bash[25448]: cephadm 2021-03-10T17:16:34.671129+0000 mgr.gibba020.yqfnwy (mgr.34427) 10723 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:16:35.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:35 gibba020 bash[25448]: cephadm 2021-03-10T17:16:34.673047+0000 mgr.gibba020.yqfnwy (mgr.34427) 10724 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:16:35.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:35 gibba020 bash[25448]: audit 2021-03-10T17:16:34.896968+0000 mon.a (mon.0) 3801 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:16:35.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:35 gibba020 bash[25448]: audit 2021-03-10T17:16:34.900389+0000 mon.a (mon.0) 3802 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:16:35.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:35 gibba020 bash[25448]: audit 2021-03-10T17:16:34.902340+0000 mon.a (mon.0) 3803 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:35.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:35 gibba020 bash[25448]: audit 2021-03-10T17:16:34.904001+0000 mon.a (mon.0) 3804 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:35.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:35 gibba020 bash[25448]: audit 2021-03-10T17:16:34.905961+0000 mon.a (mon.0) 3805 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:35.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:35 gibba020 bash[25448]: audit 2021-03-10T17:16:34.909258+0000 mon.a (mon.0) 3806 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:35.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:35 gibba020 bash[25448]: audit 2021-03-10T17:16:34.911347+0000 mon.a (mon.0) 3807 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:35.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:35 gibba013 bash[29418]: audit 2021-03-10T17:16:34.665785+0000 mon.a (mon.0) 3800 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:16:35.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:35 gibba013 bash[29418]: cephadm 2021-03-10T17:16:34.671129+0000 mgr.gibba020.yqfnwy (mgr.34427) 10723 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:16:35.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:35 gibba013 bash[29418]: cephadm 2021-03-10T17:16:34.673047+0000 mgr.gibba020.yqfnwy (mgr.34427) 10724 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:16:35.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:35 gibba013 bash[29418]: audit 2021-03-10T17:16:34.896968+0000 mon.a (mon.0) 3801 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:16:35.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:35 gibba013 bash[29418]: audit 2021-03-10T17:16:34.900389+0000 mon.a (mon.0) 3802 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:16:35.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:35 gibba013 bash[29418]: audit 2021-03-10T17:16:34.902340+0000 mon.a (mon.0) 3803 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:35.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:35 gibba013 bash[29418]: audit 2021-03-10T17:16:34.904001+0000 mon.a (mon.0) 3804 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:35.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:35 gibba013 bash[29418]: audit 2021-03-10T17:16:34.905961+0000 mon.a (mon.0) 3805 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:35.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:35 gibba013 bash[29418]: audit 2021-03-10T17:16:34.909258+0000 mon.a (mon.0) 3806 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:35.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:35 gibba013 bash[29418]: audit 2021-03-10T17:16:34.911347+0000 mon.a (mon.0) 3807 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:35.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:35 gibba013 bash[30381]: audit 2021-03-10T17:16:34.665785+0000 mon.a (mon.0) 3800 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:16:35.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:35 gibba013 bash[30381]: cephadm 2021-03-10T17:16:34.671129+0000 mgr.gibba020.yqfnwy (mgr.34427) 10723 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:16:35.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:35 gibba013 bash[30381]: cephadm 2021-03-10T17:16:34.673047+0000 mgr.gibba020.yqfnwy (mgr.34427) 10724 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:16:35.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:35 gibba013 bash[30381]: audit 2021-03-10T17:16:34.896968+0000 mon.a (mon.0) 3801 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:16:35.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:35 gibba013 bash[30381]: audit 2021-03-10T17:16:34.900389+0000 mon.a (mon.0) 3802 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:16:35.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:35 gibba013 bash[30381]: audit 2021-03-10T17:16:34.902340+0000 mon.a (mon.0) 3803 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:35.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:35 gibba013 bash[30381]: audit 2021-03-10T17:16:34.904001+0000 mon.a (mon.0) 3804 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:35.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:35 gibba013 bash[30381]: audit 2021-03-10T17:16:34.905961+0000 mon.a (mon.0) 3805 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:35.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:35 gibba013 bash[30381]: audit 2021-03-10T17:16:34.909258+0000 mon.a (mon.0) 3806 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:35.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:35 gibba013 bash[30381]: audit 2021-03-10T17:16:34.911347+0000 mon.a (mon.0) 3807 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:36.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:36 gibba020 bash[25448]: cephadm 2021-03-10T17:16:34.899002+0000 mgr.gibba020.yqfnwy (mgr.34427) 10725 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:16:36.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:36 gibba020 bash[25448]: cephadm 2021-03-10T17:16:34.901440+0000 mgr.gibba020.yqfnwy (mgr.34427) 10726 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:16:36.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:36 gibba020 bash[25448]: cephadm 2021-03-10T17:16:34.902987+0000 mgr.gibba020.yqfnwy (mgr.34427) 10727 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:16:36.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:36 gibba020 bash[25448]: cephadm 2021-03-10T17:16:34.903028+0000 mgr.gibba020.yqfnwy (mgr.34427) 10728 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:16:36.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:36 gibba020 bash[25448]: cephadm 2021-03-10T17:16:34.904954+0000 mgr.gibba020.yqfnwy (mgr.34427) 10729 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:16:36.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:36 gibba020 bash[25448]: cephadm 2021-03-10T17:16:34.904999+0000 mgr.gibba020.yqfnwy (mgr.34427) 10730 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:16:36.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:36 gibba020 bash[25448]: cephadm 2021-03-10T17:16:34.906652+0000 mgr.gibba020.yqfnwy (mgr.34427) 10731 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:16:36.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:36 gibba020 bash[25448]: cephadm 2021-03-10T17:16:34.908141+0000 mgr.gibba020.yqfnwy (mgr.34427) 10732 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:16:36.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:36 gibba020 bash[25448]: cephadm 2021-03-10T17:16:34.908184+0000 mgr.gibba020.yqfnwy (mgr.34427) 10733 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:16:36.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:36 gibba020 bash[25448]: cephadm 2021-03-10T17:16:34.909946+0000 mgr.gibba020.yqfnwy (mgr.34427) 10734 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:16:36.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:36 gibba020 bash[25448]: cephadm 2021-03-10T17:16:34.910443+0000 mgr.gibba020.yqfnwy (mgr.34427) 10735 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:16:36.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:36 gibba020 bash[25448]: cephadm 2021-03-10T17:16:34.912019+0000 mgr.gibba020.yqfnwy (mgr.34427) 10736 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:16:36.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:36 gibba020 bash[25448]: cephadm 2021-03-10T17:16:34.912067+0000 mgr.gibba020.yqfnwy (mgr.34427) 10737 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:16:36.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:36 gibba020 bash[25448]: cephadm 2021-03-10T17:16:34.912209+0000 mgr.gibba020.yqfnwy (mgr.34427) 10738 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:16:36.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:36 gibba020 bash[25448]: cluster 2021-03-10T17:16:35.365412+0000 mgr.gibba020.yqfnwy (mgr.34427) 10739 : cluster [DBG] pgmap v6115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:36.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:36 gibba013 bash[29418]: cephadm 2021-03-10T17:16:34.899002+0000 mgr.gibba020.yqfnwy (mgr.34427) 10725 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:16:36.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:36 gibba013 bash[29418]: cephadm 2021-03-10T17:16:34.901440+0000 mgr.gibba020.yqfnwy (mgr.34427) 10726 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:16:36.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:36 gibba013 bash[29418]: cephadm 2021-03-10T17:16:34.902987+0000 mgr.gibba020.yqfnwy (mgr.34427) 10727 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:16:36.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:36 gibba013 bash[29418]: cephadm 2021-03-10T17:16:34.903028+0000 mgr.gibba020.yqfnwy (mgr.34427) 10728 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:16:36.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:36 gibba013 bash[29418]: cephadm 2021-03-10T17:16:34.904954+0000 mgr.gibba020.yqfnwy (mgr.34427) 10729 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:16:36.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:36 gibba013 bash[29418]: cephadm 2021-03-10T17:16:34.904999+0000 mgr.gibba020.yqfnwy (mgr.34427) 10730 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:16:36.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:36 gibba013 bash[29418]: cephadm 2021-03-10T17:16:34.906652+0000 mgr.gibba020.yqfnwy (mgr.34427) 10731 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:16:36.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:36 gibba013 bash[29418]: cephadm 2021-03-10T17:16:34.908141+0000 mgr.gibba020.yqfnwy (mgr.34427) 10732 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:16:36.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:36 gibba013 bash[29418]: cephadm 2021-03-10T17:16:34.908184+0000 mgr.gibba020.yqfnwy (mgr.34427) 10733 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:16:36.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:36 gibba013 bash[29418]: cephadm 2021-03-10T17:16:34.909946+0000 mgr.gibba020.yqfnwy (mgr.34427) 10734 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:16:36.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:36 gibba013 bash[29418]: cephadm 2021-03-10T17:16:34.910443+0000 mgr.gibba020.yqfnwy (mgr.34427) 10735 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:16:36.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:36 gibba013 bash[29418]: cephadm 2021-03-10T17:16:34.912019+0000 mgr.gibba020.yqfnwy (mgr.34427) 10736 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:16:36.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:36 gibba013 bash[29418]: cephadm 2021-03-10T17:16:34.912067+0000 mgr.gibba020.yqfnwy (mgr.34427) 10737 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:16:36.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:36 gibba013 bash[29418]: cephadm 2021-03-10T17:16:34.912209+0000 mgr.gibba020.yqfnwy (mgr.34427) 10738 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:16:36.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:36 gibba013 bash[29418]: cluster 2021-03-10T17:16:35.365412+0000 mgr.gibba020.yqfnwy (mgr.34427) 10739 : cluster [DBG] pgmap v6115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:36.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:36 gibba013 bash[30381]: cephadm 2021-03-10T17:16:34.899002+0000 mgr.gibba020.yqfnwy (mgr.34427) 10725 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:16:36.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:36 gibba013 bash[30381]: cephadm 2021-03-10T17:16:34.901440+0000 mgr.gibba020.yqfnwy (mgr.34427) 10726 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:16:36.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:36 gibba013 bash[30381]: cephadm 2021-03-10T17:16:34.902987+0000 mgr.gibba020.yqfnwy (mgr.34427) 10727 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:16:36.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:36 gibba013 bash[30381]: cephadm 2021-03-10T17:16:34.903028+0000 mgr.gibba020.yqfnwy (mgr.34427) 10728 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:16:36.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:36 gibba013 bash[30381]: cephadm 2021-03-10T17:16:34.904954+0000 mgr.gibba020.yqfnwy (mgr.34427) 10729 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:16:36.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:36 gibba013 bash[30381]: cephadm 2021-03-10T17:16:34.904999+0000 mgr.gibba020.yqfnwy (mgr.34427) 10730 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:16:36.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:36 gibba013 bash[30381]: cephadm 2021-03-10T17:16:34.906652+0000 mgr.gibba020.yqfnwy (mgr.34427) 10731 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:16:36.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:36 gibba013 bash[30381]: cephadm 2021-03-10T17:16:34.908141+0000 mgr.gibba020.yqfnwy (mgr.34427) 10732 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:16:36.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:36 gibba013 bash[30381]: cephadm 2021-03-10T17:16:34.908184+0000 mgr.gibba020.yqfnwy (mgr.34427) 10733 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:16:36.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:36 gibba013 bash[30381]: cephadm 2021-03-10T17:16:34.909946+0000 mgr.gibba020.yqfnwy (mgr.34427) 10734 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:16:36.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:36 gibba013 bash[30381]: cephadm 2021-03-10T17:16:34.910443+0000 mgr.gibba020.yqfnwy (mgr.34427) 10735 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:16:36.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:36 gibba013 bash[30381]: cephadm 2021-03-10T17:16:34.912019+0000 mgr.gibba020.yqfnwy (mgr.34427) 10736 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:16:36.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:36 gibba013 bash[30381]: cephadm 2021-03-10T17:16:34.912067+0000 mgr.gibba020.yqfnwy (mgr.34427) 10737 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:16:36.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:36 gibba013 bash[30381]: cephadm 2021-03-10T17:16:34.912209+0000 mgr.gibba020.yqfnwy (mgr.34427) 10738 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:16:36.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:36 gibba013 bash[30381]: cluster 2021-03-10T17:16:35.365412+0000 mgr.gibba020.yqfnwy (mgr.34427) 10739 : cluster [DBG] pgmap v6115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:38.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:38 gibba020 bash[25448]: cluster 2021-03-10T17:16:37.366978+0000 mgr.gibba020.yqfnwy (mgr.34427) 10740 : cluster [DBG] pgmap v6116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:38.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:38 gibba013 bash[29418]: cluster 2021-03-10T17:16:37.366978+0000 mgr.gibba020.yqfnwy (mgr.34427) 10740 : cluster [DBG] pgmap v6116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:38.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:38 gibba013 bash[30381]: cluster 2021-03-10T17:16:37.366978+0000 mgr.gibba020.yqfnwy (mgr.34427) 10740 : cluster [DBG] pgmap v6116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:40.227 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:16:40.453 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:16:40.453 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 5m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:16:40.453 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 4m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:16:40.454 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:16:40.454 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:16:40.454 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:16:40.454 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:16:40.455 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:16:40.455 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:16:40.455 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:16:40.455 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:16:40.455 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:16:40.456 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:16:40.456 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:16:40.456 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:16:40.456 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:16:40.457 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:16:40.457 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:16:40.457 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:16:40.457 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 4m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:16:40.457 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 4m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:16:40.702 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:16:40.702 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:16:40.703 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:16:40.703 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:16:40.704 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:16:40.704 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:16:40.705 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:16:40.705 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:16:40.705 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:16:40.706 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:16:40.706 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:16:40.708 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:16:40.708 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:16:40.709 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:16:40.709 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:16:40.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:40 gibba013 bash[29418]: cluster 2021-03-10T17:16:39.368543+0000 mgr.gibba020.yqfnwy (mgr.34427) 10741 : cluster [DBG] pgmap v6117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:40.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:40 gibba013 bash[30381]: cluster 2021-03-10T17:16:39.368543+0000 mgr.gibba020.yqfnwy (mgr.34427) 10741 : cluster [DBG] pgmap v6117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:40.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:40 gibba020 bash[25448]: cluster 2021-03-10T17:16:39.368543+0000 mgr.gibba020.yqfnwy (mgr.34427) 10741 : cluster [DBG] pgmap v6117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:41.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:41 gibba013 bash[29418]: audit 2021-03-10T17:16:40.217130+0000 mgr.gibba020.yqfnwy (mgr.34427) 10742 : audit [DBG] from='client.61231 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:16:41.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:41 gibba013 bash[29418]: audit 2021-03-10T17:16:40.439580+0000 mgr.gibba020.yqfnwy (mgr.34427) 10743 : audit [DBG] from='client.61237 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:16:41.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:41 gibba013 bash[29418]: audit 2021-03-10T17:16:40.701065+0000 mon.c (mon.1) 161 : audit [DBG] from='client.? 172.21.2.113:0/3629666181' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:41.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:41 gibba013 bash[30381]: audit 2021-03-10T17:16:40.217130+0000 mgr.gibba020.yqfnwy (mgr.34427) 10742 : audit [DBG] from='client.61231 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:16:41.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:41 gibba013 bash[30381]: audit 2021-03-10T17:16:40.439580+0000 mgr.gibba020.yqfnwy (mgr.34427) 10743 : audit [DBG] from='client.61237 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:16:41.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:41 gibba013 bash[30381]: audit 2021-03-10T17:16:40.701065+0000 mon.c (mon.1) 161 : audit [DBG] from='client.? 172.21.2.113:0/3629666181' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:41.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:41 gibba020 bash[25448]: audit 2021-03-10T17:16:40.217130+0000 mgr.gibba020.yqfnwy (mgr.34427) 10742 : audit [DBG] from='client.61231 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:16:41.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:41 gibba020 bash[25448]: audit 2021-03-10T17:16:40.439580+0000 mgr.gibba020.yqfnwy (mgr.34427) 10743 : audit [DBG] from='client.61237 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:16:41.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:41 gibba020 bash[25448]: audit 2021-03-10T17:16:40.701065+0000 mon.c (mon.1) 161 : audit [DBG] from='client.? 172.21.2.113:0/3629666181' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:16:42.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:42 gibba013 bash[29418]: cluster 2021-03-10T17:16:41.370378+0000 mgr.gibba020.yqfnwy (mgr.34427) 10744 : cluster [DBG] pgmap v6118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:42.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:42 gibba013 bash[30381]: cluster 2021-03-10T17:16:41.370378+0000 mgr.gibba020.yqfnwy (mgr.34427) 10744 : cluster [DBG] pgmap v6118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:42.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:42 gibba020 bash[25448]: cluster 2021-03-10T17:16:41.370378+0000 mgr.gibba020.yqfnwy (mgr.34427) 10744 : cluster [DBG] pgmap v6118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:44.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:44 gibba013 bash[29418]: cluster 2021-03-10T17:16:43.371779+0000 mgr.gibba020.yqfnwy (mgr.34427) 10745 : cluster [DBG] pgmap v6119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:44.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:44 gibba013 bash[30381]: cluster 2021-03-10T17:16:43.371779+0000 mgr.gibba020.yqfnwy (mgr.34427) 10745 : cluster [DBG] pgmap v6119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:44.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:44 gibba020 bash[25448]: cluster 2021-03-10T17:16:43.371779+0000 mgr.gibba020.yqfnwy (mgr.34427) 10745 : cluster [DBG] pgmap v6119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:46.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:46 gibba013 bash[29418]: cluster 2021-03-10T17:16:45.373411+0000 mgr.gibba020.yqfnwy (mgr.34427) 10746 : cluster [DBG] pgmap v6120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:46.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:46 gibba013 bash[30381]: cluster 2021-03-10T17:16:45.373411+0000 mgr.gibba020.yqfnwy (mgr.34427) 10746 : cluster [DBG] pgmap v6120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:46.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:46 gibba020 bash[25448]: cluster 2021-03-10T17:16:45.373411+0000 mgr.gibba020.yqfnwy (mgr.34427) 10746 : cluster [DBG] pgmap v6120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:48.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:48 gibba013 bash[29418]: cluster 2021-03-10T17:16:47.374842+0000 mgr.gibba020.yqfnwy (mgr.34427) 10747 : cluster [DBG] pgmap v6121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:48.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:48 gibba013 bash[30381]: cluster 2021-03-10T17:16:47.374842+0000 mgr.gibba020.yqfnwy (mgr.34427) 10747 : cluster [DBG] pgmap v6121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:48.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:48 gibba020 bash[25448]: cluster 2021-03-10T17:16:47.374842+0000 mgr.gibba020.yqfnwy (mgr.34427) 10747 : cluster [DBG] pgmap v6121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:50.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:50 gibba013 bash[29418]: cluster 2021-03-10T17:16:49.376438+0000 mgr.gibba020.yqfnwy (mgr.34427) 10748 : cluster [DBG] pgmap v6122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:50.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:50 gibba013 bash[30381]: cluster 2021-03-10T17:16:49.376438+0000 mgr.gibba020.yqfnwy (mgr.34427) 10748 : cluster [DBG] pgmap v6122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:50.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:50 gibba020 bash[25448]: cluster 2021-03-10T17:16:49.376438+0000 mgr.gibba020.yqfnwy (mgr.34427) 10748 : cluster [DBG] pgmap v6122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:51.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:51 gibba013 bash[29418]: cephadm 2021-03-10T17:16:49.926195+0000 mgr.gibba020.yqfnwy (mgr.34427) 10749 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:16:51.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:51 gibba013 bash[30381]: cephadm 2021-03-10T17:16:49.926195+0000 mgr.gibba020.yqfnwy (mgr.34427) 10749 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:16:51.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:51 gibba020 bash[25448]: cephadm 2021-03-10T17:16:49.926195+0000 mgr.gibba020.yqfnwy (mgr.34427) 10749 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:16:52.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:52 gibba013 bash[29418]: cluster 2021-03-10T17:16:51.378285+0000 mgr.gibba020.yqfnwy (mgr.34427) 10750 : cluster [DBG] pgmap v6123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:52.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:52 gibba013 bash[30381]: cluster 2021-03-10T17:16:51.378285+0000 mgr.gibba020.yqfnwy (mgr.34427) 10750 : cluster [DBG] pgmap v6123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:52.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:52 gibba020 bash[25448]: cluster 2021-03-10T17:16:51.378285+0000 mgr.gibba020.yqfnwy (mgr.34427) 10750 : cluster [DBG] pgmap v6123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:54.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:54 gibba013 bash[29418]: cluster 2021-03-10T17:16:53.379996+0000 mgr.gibba020.yqfnwy (mgr.34427) 10751 : cluster [DBG] pgmap v6124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:54.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:54 gibba013 bash[30381]: cluster 2021-03-10T17:16:53.379996+0000 mgr.gibba020.yqfnwy (mgr.34427) 10751 : cluster [DBG] pgmap v6124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:54.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:54 gibba020 bash[25448]: cluster 2021-03-10T17:16:53.379996+0000 mgr.gibba020.yqfnwy (mgr.34427) 10751 : cluster [DBG] pgmap v6124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:56.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:56 gibba013 bash[29418]: cluster 2021-03-10T17:16:55.381405+0000 mgr.gibba020.yqfnwy (mgr.34427) 10752 : cluster [DBG] pgmap v6125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:56.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:56 gibba013 bash[30381]: cluster 2021-03-10T17:16:55.381405+0000 mgr.gibba020.yqfnwy (mgr.34427) 10752 : cluster [DBG] pgmap v6125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:56.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:56 gibba020 bash[25448]: cluster 2021-03-10T17:16:55.381405+0000 mgr.gibba020.yqfnwy (mgr.34427) 10752 : cluster [DBG] pgmap v6125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:58.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:16:58 gibba013 bash[29418]: cluster 2021-03-10T17:16:57.382917+0000 mgr.gibba020.yqfnwy (mgr.34427) 10753 : cluster [DBG] pgmap v6126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:58.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:16:58 gibba013 bash[30381]: cluster 2021-03-10T17:16:57.382917+0000 mgr.gibba020.yqfnwy (mgr.34427) 10753 : cluster [DBG] pgmap v6126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:16:58.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:16:58 gibba020 bash[25448]: cluster 2021-03-10T17:16:57.382917+0000 mgr.gibba020.yqfnwy (mgr.34427) 10753 : cluster [DBG] pgmap v6126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:00.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:00 gibba013 bash[29418]: cluster 2021-03-10T17:16:59.384512+0000 mgr.gibba020.yqfnwy (mgr.34427) 10754 : cluster [DBG] pgmap v6127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:00.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:00 gibba013 bash[30381]: cluster 2021-03-10T17:16:59.384512+0000 mgr.gibba020.yqfnwy (mgr.34427) 10754 : cluster [DBG] pgmap v6127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:00.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:00 gibba020 bash[25448]: cluster 2021-03-10T17:16:59.384512+0000 mgr.gibba020.yqfnwy (mgr.34427) 10754 : cluster [DBG] pgmap v6127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:01.979 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:01 gibba020 bash[25448]: cluster 2021-03-10T17:17:01.386264+0000 mgr.gibba020.yqfnwy (mgr.34427) 10755 : cluster [DBG] pgmap v6128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:02.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:01 gibba013 bash[29418]: cluster 2021-03-10T17:17:01.386264+0000 mgr.gibba020.yqfnwy (mgr.34427) 10755 : cluster [DBG] pgmap v6128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:02.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:01 gibba013 bash[30381]: cluster 2021-03-10T17:17:01.386264+0000 mgr.gibba020.yqfnwy (mgr.34427) 10755 : cluster [DBG] pgmap v6128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:04.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:04 gibba013 bash[29418]: cluster 2021-03-10T17:17:03.387665+0000 mgr.gibba020.yqfnwy (mgr.34427) 10756 : cluster [DBG] pgmap v6129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:04.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:04 gibba013 bash[30381]: cluster 2021-03-10T17:17:03.387665+0000 mgr.gibba020.yqfnwy (mgr.34427) 10756 : cluster [DBG] pgmap v6129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:04.944 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:04 gibba020 bash[25448]: cluster 2021-03-10T17:17:03.387665+0000 mgr.gibba020.yqfnwy (mgr.34427) 10756 : cluster [DBG] pgmap v6129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:06.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:06 gibba013 bash[29418]: cephadm 2021-03-10T17:17:04.942267+0000 mgr.gibba020.yqfnwy (mgr.34427) 10757 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:17:06.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:06 gibba013 bash[29418]: cluster 2021-03-10T17:17:05.389297+0000 mgr.gibba020.yqfnwy (mgr.34427) 10758 : cluster [DBG] pgmap v6130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:06.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:06 gibba013 bash[30381]: cephadm 2021-03-10T17:17:04.942267+0000 mgr.gibba020.yqfnwy (mgr.34427) 10757 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:17:06.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:06 gibba013 bash[30381]: cluster 2021-03-10T17:17:05.389297+0000 mgr.gibba020.yqfnwy (mgr.34427) 10758 : cluster [DBG] pgmap v6130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:06.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:06 gibba020 bash[25448]: cephadm 2021-03-10T17:17:04.942267+0000 mgr.gibba020.yqfnwy (mgr.34427) 10757 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:17:06.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:06 gibba020 bash[25448]: cluster 2021-03-10T17:17:05.389297+0000 mgr.gibba020.yqfnwy (mgr.34427) 10758 : cluster [DBG] pgmap v6130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:07.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:07 gibba013 bash[29418]: audit 2021-03-10T17:17:06.945082+0000 mon.a (mon.0) 3808 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:17:07.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:07 gibba013 bash[29418]: audit 2021-03-10T17:17:07.166874+0000 mon.a (mon.0) 3809 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:17:07.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:07 gibba013 bash[30381]: audit 2021-03-10T17:17:06.945082+0000 mon.a (mon.0) 3808 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:17:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:07 gibba013 bash[30381]: audit 2021-03-10T17:17:07.166874+0000 mon.a (mon.0) 3809 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:17:07.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:07 gibba020 bash[25448]: audit 2021-03-10T17:17:06.945082+0000 mon.a (mon.0) 3808 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:17:07.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:07 gibba020 bash[25448]: audit 2021-03-10T17:17:07.166874+0000 mon.a (mon.0) 3809 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:17:08.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:08 gibba013 bash[29418]: cluster 2021-03-10T17:17:07.390751+0000 mgr.gibba020.yqfnwy (mgr.34427) 10759 : cluster [DBG] pgmap v6131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:08.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:08 gibba013 bash[29418]: audit 2021-03-10T17:17:07.591688+0000 mon.a (mon.0) 3810 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T17:17:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:08 gibba013 bash[29418]: audit 2021-03-10T17:17:07.592558+0000 mon.a (mon.0) 3811 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:17:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:08 gibba013 bash[29418]: audit 2021-03-10T17:17:07.593305+0000 mon.a (mon.0) 3812 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:17:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:08 gibba013 bash[29418]: audit 2021-03-10T17:17:07.594107+0000 mon.a (mon.0) 3813 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T17:17:08.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:08 gibba013 bash[30381]: cluster 2021-03-10T17:17:07.390751+0000 mgr.gibba020.yqfnwy (mgr.34427) 10759 : cluster [DBG] pgmap v6131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:08.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:08 gibba013 bash[30381]: audit 2021-03-10T17:17:07.591688+0000 mon.a (mon.0) 3810 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T17:17:08.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:08 gibba013 bash[30381]: audit 2021-03-10T17:17:07.592558+0000 mon.a (mon.0) 3811 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:17:08.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:08 gibba013 bash[30381]: audit 2021-03-10T17:17:07.593305+0000 mon.a (mon.0) 3812 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:17:08.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:08 gibba013 bash[30381]: audit 2021-03-10T17:17:07.594107+0000 mon.a (mon.0) 3813 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T17:17:08.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:08 gibba020 bash[25448]: cluster 2021-03-10T17:17:07.390751+0000 mgr.gibba020.yqfnwy (mgr.34427) 10759 : cluster [DBG] pgmap v6131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:08.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:08 gibba020 bash[25448]: audit 2021-03-10T17:17:07.591688+0000 mon.a (mon.0) 3810 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T17:17:08.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:08 gibba020 bash[25448]: audit 2021-03-10T17:17:07.592558+0000 mon.a (mon.0) 3811 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:17:08.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:08 gibba020 bash[25448]: audit 2021-03-10T17:17:07.593305+0000 mon.a (mon.0) 3812 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:17:08.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:08 gibba020 bash[25448]: audit 2021-03-10T17:17:07.594107+0000 mon.a (mon.0) 3813 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T17:17:10.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:10 gibba013 bash[29418]: cluster 2021-03-10T17:17:09.392303+0000 mgr.gibba020.yqfnwy (mgr.34427) 10760 : cluster [DBG] pgmap v6132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:10.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:10 gibba013 bash[30381]: cluster 2021-03-10T17:17:09.392303+0000 mgr.gibba020.yqfnwy (mgr.34427) 10760 : cluster [DBG] pgmap v6132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:10.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:10 gibba020 bash[25448]: cluster 2021-03-10T17:17:09.392303+0000 mgr.gibba020.yqfnwy (mgr.34427) 10760 : cluster [DBG] pgmap v6132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:10.963 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:17:11.186 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:17:11.187 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 5m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:17:11.187 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 4m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:17:11.187 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:17:11.187 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:17:11.188 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:17:11.188 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:17:11.188 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:17:11.188 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:17:11.189 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:17:11.189 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:17:11.189 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:17:11.190 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:17:11.190 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:17:11.190 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:17:11.190 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:17:11.191 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:17:11.191 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:17:11.191 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:17:11.191 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 4m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:17:11.192 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 4m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:17:11.436 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:17:11.436 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:17:11.437 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:17:11.437 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:17:11.437 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:17:11.437 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:17:11.437 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:17:11.438 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:17:11.438 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:17:11.439 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:17:11.439 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:17:11.439 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:17:11.439 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:17:11.439 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:17:11.440 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:17:12.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:11 gibba013 bash[29418]: audit 2021-03-10T17:17:10.952531+0000 mgr.gibba020.yqfnwy (mgr.34427) 10761 : audit [DBG] from='client.51270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:17:12.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:11 gibba013 bash[29418]: audit 2021-03-10T17:17:11.175818+0000 mgr.gibba020.yqfnwy (mgr.34427) 10762 : audit [DBG] from='client.51276 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:17:12.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:11 gibba013 bash[29418]: cluster 2021-03-10T17:17:11.394136+0000 mgr.gibba020.yqfnwy (mgr.34427) 10763 : cluster [DBG] pgmap v6133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:12.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:11 gibba013 bash[29418]: audit 2021-03-10T17:17:11.435096+0000 mon.a (mon.0) 3814 : audit [DBG] from='client.? 172.21.2.113:0/2514526006' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:12.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:11 gibba013 bash[30381]: audit 2021-03-10T17:17:10.952531+0000 mgr.gibba020.yqfnwy (mgr.34427) 10761 : audit [DBG] from='client.51270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:17:12.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:11 gibba013 bash[30381]: audit 2021-03-10T17:17:11.175818+0000 mgr.gibba020.yqfnwy (mgr.34427) 10762 : audit [DBG] from='client.51276 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:17:12.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:11 gibba013 bash[30381]: cluster 2021-03-10T17:17:11.394136+0000 mgr.gibba020.yqfnwy (mgr.34427) 10763 : cluster [DBG] pgmap v6133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:12.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:11 gibba013 bash[30381]: audit 2021-03-10T17:17:11.435096+0000 mon.a (mon.0) 3814 : audit [DBG] from='client.? 172.21.2.113:0/2514526006' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:12.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:11 gibba020 bash[25448]: audit 2021-03-10T17:17:10.952531+0000 mgr.gibba020.yqfnwy (mgr.34427) 10761 : audit [DBG] from='client.51270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:17:12.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:11 gibba020 bash[25448]: audit 2021-03-10T17:17:11.175818+0000 mgr.gibba020.yqfnwy (mgr.34427) 10762 : audit [DBG] from='client.51276 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:17:12.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:11 gibba020 bash[25448]: cluster 2021-03-10T17:17:11.394136+0000 mgr.gibba020.yqfnwy (mgr.34427) 10763 : cluster [DBG] pgmap v6133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:12.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:11 gibba020 bash[25448]: audit 2021-03-10T17:17:11.435096+0000 mon.a (mon.0) 3814 : audit [DBG] from='client.? 172.21.2.113:0/2514526006' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:14.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:14 gibba013 bash[29418]: cluster 2021-03-10T17:17:13.395850+0000 mgr.gibba020.yqfnwy (mgr.34427) 10764 : cluster [DBG] pgmap v6134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:14.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:14 gibba013 bash[30381]: cluster 2021-03-10T17:17:13.395850+0000 mgr.gibba020.yqfnwy (mgr.34427) 10764 : cluster [DBG] pgmap v6134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:14.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:14 gibba020 bash[25448]: cluster 2021-03-10T17:17:13.395850+0000 mgr.gibba020.yqfnwy (mgr.34427) 10764 : cluster [DBG] pgmap v6134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:16.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:16 gibba013 bash[29418]: cluster 2021-03-10T17:17:15.397605+0000 mgr.gibba020.yqfnwy (mgr.34427) 10765 : cluster [DBG] pgmap v6135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:16.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:16 gibba013 bash[30381]: cluster 2021-03-10T17:17:15.397605+0000 mgr.gibba020.yqfnwy (mgr.34427) 10765 : cluster [DBG] pgmap v6135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:16.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:16 gibba020 bash[25448]: cluster 2021-03-10T17:17:15.397605+0000 mgr.gibba020.yqfnwy (mgr.34427) 10765 : cluster [DBG] pgmap v6135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:18.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:18 gibba013 bash[29418]: cluster 2021-03-10T17:17:17.399152+0000 mgr.gibba020.yqfnwy (mgr.34427) 10766 : cluster [DBG] pgmap v6136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:18.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:18 gibba013 bash[30381]: cluster 2021-03-10T17:17:17.399152+0000 mgr.gibba020.yqfnwy (mgr.34427) 10766 : cluster [DBG] pgmap v6136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:18.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:18 gibba020 bash[25448]: cluster 2021-03-10T17:17:17.399152+0000 mgr.gibba020.yqfnwy (mgr.34427) 10766 : cluster [DBG] pgmap v6136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:20.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:20 gibba013 bash[29418]: cluster 2021-03-10T17:17:19.400429+0000 mgr.gibba020.yqfnwy (mgr.34427) 10767 : cluster [DBG] pgmap v6137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:20.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:20 gibba013 bash[30381]: cluster 2021-03-10T17:17:19.400429+0000 mgr.gibba020.yqfnwy (mgr.34427) 10767 : cluster [DBG] pgmap v6137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:20.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:20 gibba020 bash[25448]: cluster 2021-03-10T17:17:19.400429+0000 mgr.gibba020.yqfnwy (mgr.34427) 10767 : cluster [DBG] pgmap v6137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:21.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:21 gibba013 bash[29418]: cephadm 2021-03-10T17:17:19.958288+0000 mgr.gibba020.yqfnwy (mgr.34427) 10768 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:17:21.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:21 gibba013 bash[30381]: cephadm 2021-03-10T17:17:19.958288+0000 mgr.gibba020.yqfnwy (mgr.34427) 10768 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:17:21.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:21 gibba020 bash[25448]: cephadm 2021-03-10T17:17:19.958288+0000 mgr.gibba020.yqfnwy (mgr.34427) 10768 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:17:22.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:22 gibba013 bash[29418]: cluster 2021-03-10T17:17:21.402171+0000 mgr.gibba020.yqfnwy (mgr.34427) 10769 : cluster [DBG] pgmap v6138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:22.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:22 gibba013 bash[30381]: cluster 2021-03-10T17:17:21.402171+0000 mgr.gibba020.yqfnwy (mgr.34427) 10769 : cluster [DBG] pgmap v6138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:22.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:22 gibba020 bash[25448]: cluster 2021-03-10T17:17:21.402171+0000 mgr.gibba020.yqfnwy (mgr.34427) 10769 : cluster [DBG] pgmap v6138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:24.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:24 gibba013 bash[29418]: cluster 2021-03-10T17:17:23.403816+0000 mgr.gibba020.yqfnwy (mgr.34427) 10770 : cluster [DBG] pgmap v6139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:24.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:24 gibba013 bash[30381]: cluster 2021-03-10T17:17:23.403816+0000 mgr.gibba020.yqfnwy (mgr.34427) 10770 : cluster [DBG] pgmap v6139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:24.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:24 gibba020 bash[25448]: cluster 2021-03-10T17:17:23.403816+0000 mgr.gibba020.yqfnwy (mgr.34427) 10770 : cluster [DBG] pgmap v6139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:26.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:26 gibba013 bash[29418]: cluster 2021-03-10T17:17:25.405554+0000 mgr.gibba020.yqfnwy (mgr.34427) 10771 : cluster [DBG] pgmap v6140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:26.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:26 gibba013 bash[30381]: cluster 2021-03-10T17:17:25.405554+0000 mgr.gibba020.yqfnwy (mgr.34427) 10771 : cluster [DBG] pgmap v6140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:26.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:26 gibba020 bash[25448]: cluster 2021-03-10T17:17:25.405554+0000 mgr.gibba020.yqfnwy (mgr.34427) 10771 : cluster [DBG] pgmap v6140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:28.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:28 gibba013 bash[29418]: cluster 2021-03-10T17:17:27.406864+0000 mgr.gibba020.yqfnwy (mgr.34427) 10772 : cluster [DBG] pgmap v6141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:28.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:28 gibba013 bash[30381]: cluster 2021-03-10T17:17:27.406864+0000 mgr.gibba020.yqfnwy (mgr.34427) 10772 : cluster [DBG] pgmap v6141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:28.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:28 gibba020 bash[25448]: cluster 2021-03-10T17:17:27.406864+0000 mgr.gibba020.yqfnwy (mgr.34427) 10772 : cluster [DBG] pgmap v6141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:30.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:30 gibba013 bash[29418]: cluster 2021-03-10T17:17:29.408404+0000 mgr.gibba020.yqfnwy (mgr.34427) 10773 : cluster [DBG] pgmap v6142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:30.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:30 gibba013 bash[30381]: cluster 2021-03-10T17:17:29.408404+0000 mgr.gibba020.yqfnwy (mgr.34427) 10773 : cluster [DBG] pgmap v6142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:30.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:30 gibba020 bash[25448]: cluster 2021-03-10T17:17:29.408404+0000 mgr.gibba020.yqfnwy (mgr.34427) 10773 : cluster [DBG] pgmap v6142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:32.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:31 gibba013 bash[29418]: cluster 2021-03-10T17:17:31.410251+0000 mgr.gibba020.yqfnwy (mgr.34427) 10774 : cluster [DBG] pgmap v6143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:32.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:31 gibba013 bash[30381]: cluster 2021-03-10T17:17:31.410251+0000 mgr.gibba020.yqfnwy (mgr.34427) 10774 : cluster [DBG] pgmap v6143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:32.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:31 gibba020 bash[25448]: cluster 2021-03-10T17:17:31.410251+0000 mgr.gibba020.yqfnwy (mgr.34427) 10774 : cluster [DBG] pgmap v6143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:34.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:34 gibba013 bash[29418]: cluster 2021-03-10T17:17:33.411596+0000 mgr.gibba020.yqfnwy (mgr.34427) 10775 : cluster [DBG] pgmap v6144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:34.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:34 gibba013 bash[30381]: cluster 2021-03-10T17:17:33.411596+0000 mgr.gibba020.yqfnwy (mgr.34427) 10775 : cluster [DBG] pgmap v6144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:34.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:34 gibba020 bash[25448]: cluster 2021-03-10T17:17:33.411596+0000 mgr.gibba020.yqfnwy (mgr.34427) 10775 : cluster [DBG] pgmap v6144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:35.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:35 gibba020 bash[25448]: audit 2021-03-10T17:17:34.974413+0000 mon.a (mon.0) 3815 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:17:35.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:35 gibba020 bash[25448]: audit 2021-03-10T17:17:35.270559+0000 mon.a (mon.0) 3816 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:17:35.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:35 gibba020 bash[25448]: audit 2021-03-10T17:17:35.277806+0000 mon.a (mon.0) 3817 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:17:35.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:35 gibba020 bash[25448]: audit 2021-03-10T17:17:35.279494+0000 mon.a (mon.0) 3818 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:35.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:35 gibba020 bash[25448]: audit 2021-03-10T17:17:35.281318+0000 mon.a (mon.0) 3819 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:35.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:35 gibba020 bash[25448]: audit 2021-03-10T17:17:35.282661+0000 mon.a (mon.0) 3820 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:35.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:35 gibba020 bash[25448]: audit 2021-03-10T17:17:35.285513+0000 mon.a (mon.0) 3821 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:35.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:35 gibba020 bash[25448]: audit 2021-03-10T17:17:35.287398+0000 mon.a (mon.0) 3822 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:35.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:35 gibba013 bash[29418]: audit 2021-03-10T17:17:34.974413+0000 mon.a (mon.0) 3815 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:17:35.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:35 gibba013 bash[29418]: audit 2021-03-10T17:17:35.270559+0000 mon.a (mon.0) 3816 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:17:35.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:35 gibba013 bash[29418]: audit 2021-03-10T17:17:35.277806+0000 mon.a (mon.0) 3817 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:17:35.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:35 gibba013 bash[29418]: audit 2021-03-10T17:17:35.279494+0000 mon.a (mon.0) 3818 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:35.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:35 gibba013 bash[29418]: audit 2021-03-10T17:17:35.281318+0000 mon.a (mon.0) 3819 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:35.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:35 gibba013 bash[29418]: audit 2021-03-10T17:17:35.282661+0000 mon.a (mon.0) 3820 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:35.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:35 gibba013 bash[29418]: audit 2021-03-10T17:17:35.285513+0000 mon.a (mon.0) 3821 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:35.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:35 gibba013 bash[29418]: audit 2021-03-10T17:17:35.287398+0000 mon.a (mon.0) 3822 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:35.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:35 gibba013 bash[30381]: audit 2021-03-10T17:17:34.974413+0000 mon.a (mon.0) 3815 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:17:35.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:35 gibba013 bash[30381]: audit 2021-03-10T17:17:35.270559+0000 mon.a (mon.0) 3816 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:17:35.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:35 gibba013 bash[30381]: audit 2021-03-10T17:17:35.277806+0000 mon.a (mon.0) 3817 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:17:35.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:35 gibba013 bash[30381]: audit 2021-03-10T17:17:35.279494+0000 mon.a (mon.0) 3818 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:35.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:35 gibba013 bash[30381]: audit 2021-03-10T17:17:35.281318+0000 mon.a (mon.0) 3819 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:35.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:35 gibba013 bash[30381]: audit 2021-03-10T17:17:35.282661+0000 mon.a (mon.0) 3820 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:35.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:35 gibba013 bash[30381]: audit 2021-03-10T17:17:35.285513+0000 mon.a (mon.0) 3821 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:35.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:35 gibba013 bash[30381]: audit 2021-03-10T17:17:35.287398+0000 mon.a (mon.0) 3822 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:36.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:36 gibba013 bash[29418]: cephadm 2021-03-10T17:17:34.980261+0000 mgr.gibba020.yqfnwy (mgr.34427) 10776 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:17:36.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:36 gibba013 bash[29418]: cephadm 2021-03-10T17:17:34.981904+0000 mgr.gibba020.yqfnwy (mgr.34427) 10777 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:17:36.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:36 gibba013 bash[29418]: cephadm 2021-03-10T17:17:35.276281+0000 mgr.gibba020.yqfnwy (mgr.34427) 10778 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:17:36.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:36 gibba013 bash[29418]: cephadm 2021-03-10T17:17:35.278660+0000 mgr.gibba020.yqfnwy (mgr.34427) 10779 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:17:36.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:36 gibba013 bash[29418]: cephadm 2021-03-10T17:17:35.280286+0000 mgr.gibba020.yqfnwy (mgr.34427) 10780 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:17:36.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:36 gibba013 bash[29418]: cephadm 2021-03-10T17:17:35.280360+0000 mgr.gibba020.yqfnwy (mgr.34427) 10781 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:17:36.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:36 gibba013 bash[29418]: cephadm 2021-03-10T17:17:35.281756+0000 mgr.gibba020.yqfnwy (mgr.34427) 10782 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:17:36.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:36 gibba013 bash[29418]: cephadm 2021-03-10T17:17:35.281811+0000 mgr.gibba020.yqfnwy (mgr.34427) 10783 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:17:36.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:36 gibba013 bash[29418]: cephadm 2021-03-10T17:17:35.283157+0000 mgr.gibba020.yqfnwy (mgr.34427) 10784 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:17:36.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:36 gibba013 bash[29418]: cephadm 2021-03-10T17:17:35.284446+0000 mgr.gibba020.yqfnwy (mgr.34427) 10785 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:17:36.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:36 gibba013 bash[29418]: cephadm 2021-03-10T17:17:35.284490+0000 mgr.gibba020.yqfnwy (mgr.34427) 10786 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:17:36.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:36 gibba013 bash[29418]: cephadm 2021-03-10T17:17:35.286024+0000 mgr.gibba020.yqfnwy (mgr.34427) 10787 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:17:36.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:36 gibba013 bash[29418]: cephadm 2021-03-10T17:17:35.286483+0000 mgr.gibba020.yqfnwy (mgr.34427) 10788 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:17:36.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:36 gibba013 bash[29418]: cephadm 2021-03-10T17:17:35.287994+0000 mgr.gibba020.yqfnwy (mgr.34427) 10789 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:17:36.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:36 gibba013 bash[29418]: cephadm 2021-03-10T17:17:35.288040+0000 mgr.gibba020.yqfnwy (mgr.34427) 10790 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:17:36.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:36 gibba013 bash[29418]: cephadm 2021-03-10T17:17:35.288171+0000 mgr.gibba020.yqfnwy (mgr.34427) 10791 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:17:36.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:36 gibba013 bash[29418]: cluster 2021-03-10T17:17:35.413174+0000 mgr.gibba020.yqfnwy (mgr.34427) 10792 : cluster [DBG] pgmap v6145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:36.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:36 gibba013 bash[30381]: cephadm 2021-03-10T17:17:34.980261+0000 mgr.gibba020.yqfnwy (mgr.34427) 10776 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:17:36.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:36 gibba013 bash[30381]: cephadm 2021-03-10T17:17:34.981904+0000 mgr.gibba020.yqfnwy (mgr.34427) 10777 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:17:36.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:36 gibba013 bash[30381]: cephadm 2021-03-10T17:17:35.276281+0000 mgr.gibba020.yqfnwy (mgr.34427) 10778 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:17:36.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:36 gibba013 bash[30381]: cephadm 2021-03-10T17:17:35.278660+0000 mgr.gibba020.yqfnwy (mgr.34427) 10779 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:17:36.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:36 gibba013 bash[30381]: cephadm 2021-03-10T17:17:35.280286+0000 mgr.gibba020.yqfnwy (mgr.34427) 10780 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:17:36.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:36 gibba013 bash[30381]: cephadm 2021-03-10T17:17:35.280360+0000 mgr.gibba020.yqfnwy (mgr.34427) 10781 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:17:36.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:36 gibba013 bash[30381]: cephadm 2021-03-10T17:17:35.281756+0000 mgr.gibba020.yqfnwy (mgr.34427) 10782 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:17:36.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:36 gibba013 bash[30381]: cephadm 2021-03-10T17:17:35.281811+0000 mgr.gibba020.yqfnwy (mgr.34427) 10783 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:17:36.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:36 gibba013 bash[30381]: cephadm 2021-03-10T17:17:35.283157+0000 mgr.gibba020.yqfnwy (mgr.34427) 10784 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:17:36.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:36 gibba013 bash[30381]: cephadm 2021-03-10T17:17:35.284446+0000 mgr.gibba020.yqfnwy (mgr.34427) 10785 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:17:36.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:36 gibba013 bash[30381]: cephadm 2021-03-10T17:17:35.284490+0000 mgr.gibba020.yqfnwy (mgr.34427) 10786 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:17:36.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:36 gibba013 bash[30381]: cephadm 2021-03-10T17:17:35.286024+0000 mgr.gibba020.yqfnwy (mgr.34427) 10787 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:17:36.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:36 gibba013 bash[30381]: cephadm 2021-03-10T17:17:35.286483+0000 mgr.gibba020.yqfnwy (mgr.34427) 10788 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:17:36.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:36 gibba013 bash[30381]: cephadm 2021-03-10T17:17:35.287994+0000 mgr.gibba020.yqfnwy (mgr.34427) 10789 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:17:36.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:36 gibba013 bash[30381]: cephadm 2021-03-10T17:17:35.288040+0000 mgr.gibba020.yqfnwy (mgr.34427) 10790 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:17:36.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:36 gibba013 bash[30381]: cephadm 2021-03-10T17:17:35.288171+0000 mgr.gibba020.yqfnwy (mgr.34427) 10791 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:17:36.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:36 gibba013 bash[30381]: cluster 2021-03-10T17:17:35.413174+0000 mgr.gibba020.yqfnwy (mgr.34427) 10792 : cluster [DBG] pgmap v6145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:36.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:36 gibba020 bash[25448]: cephadm 2021-03-10T17:17:34.980261+0000 mgr.gibba020.yqfnwy (mgr.34427) 10776 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:17:36.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:36 gibba020 bash[25448]: cephadm 2021-03-10T17:17:34.981904+0000 mgr.gibba020.yqfnwy (mgr.34427) 10777 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:17:36.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:36 gibba020 bash[25448]: cephadm 2021-03-10T17:17:35.276281+0000 mgr.gibba020.yqfnwy (mgr.34427) 10778 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:17:36.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:36 gibba020 bash[25448]: cephadm 2021-03-10T17:17:35.278660+0000 mgr.gibba020.yqfnwy (mgr.34427) 10779 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:17:36.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:36 gibba020 bash[25448]: cephadm 2021-03-10T17:17:35.280286+0000 mgr.gibba020.yqfnwy (mgr.34427) 10780 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:17:36.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:36 gibba020 bash[25448]: cephadm 2021-03-10T17:17:35.280360+0000 mgr.gibba020.yqfnwy (mgr.34427) 10781 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:17:36.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:36 gibba020 bash[25448]: cephadm 2021-03-10T17:17:35.281756+0000 mgr.gibba020.yqfnwy (mgr.34427) 10782 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:17:36.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:36 gibba020 bash[25448]: cephadm 2021-03-10T17:17:35.281811+0000 mgr.gibba020.yqfnwy (mgr.34427) 10783 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:17:36.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:36 gibba020 bash[25448]: cephadm 2021-03-10T17:17:35.283157+0000 mgr.gibba020.yqfnwy (mgr.34427) 10784 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:17:36.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:36 gibba020 bash[25448]: cephadm 2021-03-10T17:17:35.284446+0000 mgr.gibba020.yqfnwy (mgr.34427) 10785 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:17:36.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:36 gibba020 bash[25448]: cephadm 2021-03-10T17:17:35.284490+0000 mgr.gibba020.yqfnwy (mgr.34427) 10786 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:17:36.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:36 gibba020 bash[25448]: cephadm 2021-03-10T17:17:35.286024+0000 mgr.gibba020.yqfnwy (mgr.34427) 10787 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:17:36.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:36 gibba020 bash[25448]: cephadm 2021-03-10T17:17:35.286483+0000 mgr.gibba020.yqfnwy (mgr.34427) 10788 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:17:36.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:36 gibba020 bash[25448]: cephadm 2021-03-10T17:17:35.287994+0000 mgr.gibba020.yqfnwy (mgr.34427) 10789 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:17:36.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:36 gibba020 bash[25448]: cephadm 2021-03-10T17:17:35.288040+0000 mgr.gibba020.yqfnwy (mgr.34427) 10790 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:17:36.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:36 gibba020 bash[25448]: cephadm 2021-03-10T17:17:35.288171+0000 mgr.gibba020.yqfnwy (mgr.34427) 10791 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:17:36.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:36 gibba020 bash[25448]: cluster 2021-03-10T17:17:35.413174+0000 mgr.gibba020.yqfnwy (mgr.34427) 10792 : cluster [DBG] pgmap v6145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:38.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:38 gibba013 bash[29418]: cluster 2021-03-10T17:17:37.414735+0000 mgr.gibba020.yqfnwy (mgr.34427) 10793 : cluster [DBG] pgmap v6146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:38.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:38 gibba013 bash[30381]: cluster 2021-03-10T17:17:37.414735+0000 mgr.gibba020.yqfnwy (mgr.34427) 10793 : cluster [DBG] pgmap v6146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:38.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:38 gibba020 bash[25448]: cluster 2021-03-10T17:17:37.414735+0000 mgr.gibba020.yqfnwy (mgr.34427) 10793 : cluster [DBG] pgmap v6146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:40.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:40 gibba013 bash[29418]: cluster 2021-03-10T17:17:39.416024+0000 mgr.gibba020.yqfnwy (mgr.34427) 10794 : cluster [DBG] pgmap v6147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:40.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:40 gibba013 bash[30381]: cluster 2021-03-10T17:17:39.416024+0000 mgr.gibba020.yqfnwy (mgr.34427) 10794 : cluster [DBG] pgmap v6147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:40.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:40 gibba020 bash[25448]: cluster 2021-03-10T17:17:39.416024+0000 mgr.gibba020.yqfnwy (mgr.34427) 10794 : cluster [DBG] pgmap v6147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:41.682 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:17:41.948 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:17:41.948 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 6m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:17:41.949 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 5m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:17:41.949 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:17:41.949 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:17:41.949 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:17:41.950 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:17:41.950 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:17:41.950 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:17:41.950 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:17:41.951 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:17:41.951 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:17:41.951 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:17:41.951 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:17:41.952 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:17:41.952 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:17:41.952 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:17:41.952 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:17:41.952 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:17:41.953 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 5m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:17:41.953 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 5m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:17:42.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:41 gibba013 bash[29418]: cluster 2021-03-10T17:17:41.417810+0000 mgr.gibba020.yqfnwy (mgr.34427) 10795 : cluster [DBG] pgmap v6148: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:42.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:41 gibba013 bash[29418]: audit 2021-03-10T17:17:41.673274+0000 mgr.gibba020.yqfnwy (mgr.34427) 10796 : audit [DBG] from='client.51288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:17:42.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:41 gibba013 bash[30381]: cluster 2021-03-10T17:17:41.417810+0000 mgr.gibba020.yqfnwy (mgr.34427) 10795 : cluster [DBG] pgmap v6148: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:42.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:41 gibba013 bash[30381]: audit 2021-03-10T17:17:41.673274+0000 mgr.gibba020.yqfnwy (mgr.34427) 10796 : audit [DBG] from='client.51288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:17:42.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:41 gibba020 bash[25448]: cluster 2021-03-10T17:17:41.417810+0000 mgr.gibba020.yqfnwy (mgr.34427) 10795 : cluster [DBG] pgmap v6148: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:42.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:41 gibba020 bash[25448]: audit 2021-03-10T17:17:41.673274+0000 mgr.gibba020.yqfnwy (mgr.34427) 10796 : audit [DBG] from='client.51288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:17:42.220 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:17:42.221 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:17:42.221 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:17:42.221 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:17:42.221 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:17:42.222 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:17:42.222 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:17:42.222 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:17:42.222 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:17:42.223 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:17:42.223 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:17:42.223 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:17:42.223 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:17:42.223 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:17:42.224 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:17:43.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:42 gibba013 bash[29418]: audit 2021-03-10T17:17:41.905125+0000 mgr.gibba020.yqfnwy (mgr.34427) 10797 : audit [DBG] from='client.51294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:17:43.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:42 gibba013 bash[29418]: audit 2021-03-10T17:17:42.219761+0000 mon.a (mon.0) 3823 : audit [DBG] from='client.? 172.21.2.113:0/1737853231' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:43.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:42 gibba013 bash[30381]: audit 2021-03-10T17:17:41.905125+0000 mgr.gibba020.yqfnwy (mgr.34427) 10797 : audit [DBG] from='client.51294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:17:43.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:42 gibba013 bash[30381]: audit 2021-03-10T17:17:42.219761+0000 mon.a (mon.0) 3823 : audit [DBG] from='client.? 172.21.2.113:0/1737853231' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:43.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:42 gibba020 bash[25448]: audit 2021-03-10T17:17:41.905125+0000 mgr.gibba020.yqfnwy (mgr.34427) 10797 : audit [DBG] from='client.51294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:17:43.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:42 gibba020 bash[25448]: audit 2021-03-10T17:17:42.219761+0000 mon.a (mon.0) 3823 : audit [DBG] from='client.? 172.21.2.113:0/1737853231' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:17:44.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:43 gibba013 bash[29418]: cluster 2021-03-10T17:17:43.419430+0000 mgr.gibba020.yqfnwy (mgr.34427) 10798 : cluster [DBG] pgmap v6149: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:44.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:43 gibba013 bash[30381]: cluster 2021-03-10T17:17:43.419430+0000 mgr.gibba020.yqfnwy (mgr.34427) 10798 : cluster [DBG] pgmap v6149: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:44.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:43 gibba020 bash[25448]: cluster 2021-03-10T17:17:43.419430+0000 mgr.gibba020.yqfnwy (mgr.34427) 10798 : cluster [DBG] pgmap v6149: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:46.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:46 gibba013 bash[29418]: cluster 2021-03-10T17:17:45.420980+0000 mgr.gibba020.yqfnwy (mgr.34427) 10799 : cluster [DBG] pgmap v6150: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:46.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:46 gibba013 bash[30381]: cluster 2021-03-10T17:17:45.420980+0000 mgr.gibba020.yqfnwy (mgr.34427) 10799 : cluster [DBG] pgmap v6150: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:46.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:46 gibba020 bash[25448]: cluster 2021-03-10T17:17:45.420980+0000 mgr.gibba020.yqfnwy (mgr.34427) 10799 : cluster [DBG] pgmap v6150: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:48.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:48 gibba013 bash[29418]: cluster 2021-03-10T17:17:47.422481+0000 mgr.gibba020.yqfnwy (mgr.34427) 10800 : cluster [DBG] pgmap v6151: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:48.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:48 gibba013 bash[30381]: cluster 2021-03-10T17:17:47.422481+0000 mgr.gibba020.yqfnwy (mgr.34427) 10800 : cluster [DBG] pgmap v6151: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:48.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:48 gibba020 bash[25448]: cluster 2021-03-10T17:17:47.422481+0000 mgr.gibba020.yqfnwy (mgr.34427) 10800 : cluster [DBG] pgmap v6151: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:50.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:50 gibba020 bash[25448]: cluster 2021-03-10T17:17:49.423999+0000 mgr.gibba020.yqfnwy (mgr.34427) 10801 : cluster [DBG] pgmap v6152: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:50.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:50 gibba013 bash[29418]: cluster 2021-03-10T17:17:49.423999+0000 mgr.gibba020.yqfnwy (mgr.34427) 10801 : cluster [DBG] pgmap v6152: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:50.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:50 gibba013 bash[30381]: cluster 2021-03-10T17:17:49.423999+0000 mgr.gibba020.yqfnwy (mgr.34427) 10801 : cluster [DBG] pgmap v6152: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:51.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:51 gibba013 bash[29418]: cephadm 2021-03-10T17:17:50.304292+0000 mgr.gibba020.yqfnwy (mgr.34427) 10802 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:17:51.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:51 gibba013 bash[30381]: cephadm 2021-03-10T17:17:50.304292+0000 mgr.gibba020.yqfnwy (mgr.34427) 10802 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:17:51.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:51 gibba020 bash[25448]: cephadm 2021-03-10T17:17:50.304292+0000 mgr.gibba020.yqfnwy (mgr.34427) 10802 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:17:52.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:52 gibba013 bash[29418]: cluster 2021-03-10T17:17:51.425818+0000 mgr.gibba020.yqfnwy (mgr.34427) 10803 : cluster [DBG] pgmap v6153: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:52.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:52 gibba013 bash[30381]: cluster 2021-03-10T17:17:51.425818+0000 mgr.gibba020.yqfnwy (mgr.34427) 10803 : cluster [DBG] pgmap v6153: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:52.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:52 gibba020 bash[25448]: cluster 2021-03-10T17:17:51.425818+0000 mgr.gibba020.yqfnwy (mgr.34427) 10803 : cluster [DBG] pgmap v6153: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:54.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:54 gibba013 bash[29418]: cluster 2021-03-10T17:17:53.427348+0000 mgr.gibba020.yqfnwy (mgr.34427) 10804 : cluster [DBG] pgmap v6154: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:54.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:54 gibba013 bash[30381]: cluster 2021-03-10T17:17:53.427348+0000 mgr.gibba020.yqfnwy (mgr.34427) 10804 : cluster [DBG] pgmap v6154: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:54.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:54 gibba020 bash[25448]: cluster 2021-03-10T17:17:53.427348+0000 mgr.gibba020.yqfnwy (mgr.34427) 10804 : cluster [DBG] pgmap v6154: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:56.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:56 gibba013 bash[29418]: cluster 2021-03-10T17:17:55.428940+0000 mgr.gibba020.yqfnwy (mgr.34427) 10805 : cluster [DBG] pgmap v6155: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:56.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:56 gibba013 bash[30381]: cluster 2021-03-10T17:17:55.428940+0000 mgr.gibba020.yqfnwy (mgr.34427) 10805 : cluster [DBG] pgmap v6155: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:56.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:56 gibba020 bash[25448]: cluster 2021-03-10T17:17:55.428940+0000 mgr.gibba020.yqfnwy (mgr.34427) 10805 : cluster [DBG] pgmap v6155: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:58.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:17:58 gibba013 bash[29418]: cluster 2021-03-10T17:17:57.430476+0000 mgr.gibba020.yqfnwy (mgr.34427) 10806 : cluster [DBG] pgmap v6156: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:58.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:17:58 gibba013 bash[30381]: cluster 2021-03-10T17:17:57.430476+0000 mgr.gibba020.yqfnwy (mgr.34427) 10806 : cluster [DBG] pgmap v6156: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:17:58.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:17:58 gibba020 bash[25448]: cluster 2021-03-10T17:17:57.430476+0000 mgr.gibba020.yqfnwy (mgr.34427) 10806 : cluster [DBG] pgmap v6156: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:00.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:00 gibba013 bash[29418]: cluster 2021-03-10T17:17:59.432002+0000 mgr.gibba020.yqfnwy (mgr.34427) 10807 : cluster [DBG] pgmap v6157: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:00.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:00 gibba013 bash[30381]: cluster 2021-03-10T17:17:59.432002+0000 mgr.gibba020.yqfnwy (mgr.34427) 10807 : cluster [DBG] pgmap v6157: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:00.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:00 gibba020 bash[25448]: cluster 2021-03-10T17:17:59.432002+0000 mgr.gibba020.yqfnwy (mgr.34427) 10807 : cluster [DBG] pgmap v6157: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:02.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:01 gibba013 bash[29418]: cluster 2021-03-10T17:18:01.434027+0000 mgr.gibba020.yqfnwy (mgr.34427) 10808 : cluster [DBG] pgmap v6158: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:02.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:01 gibba013 bash[30381]: cluster 2021-03-10T17:18:01.434027+0000 mgr.gibba020.yqfnwy (mgr.34427) 10808 : cluster [DBG] pgmap v6158: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:02.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:01 gibba020 bash[25448]: cluster 2021-03-10T17:18:01.434027+0000 mgr.gibba020.yqfnwy (mgr.34427) 10808 : cluster [DBG] pgmap v6158: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:04.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:04 gibba013 bash[29418]: cluster 2021-03-10T17:18:03.435665+0000 mgr.gibba020.yqfnwy (mgr.34427) 10809 : cluster [DBG] pgmap v6159: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:04.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:04 gibba013 bash[30381]: cluster 2021-03-10T17:18:03.435665+0000 mgr.gibba020.yqfnwy (mgr.34427) 10809 : cluster [DBG] pgmap v6159: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:04.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:04 gibba020 bash[25448]: cluster 2021-03-10T17:18:03.435665+0000 mgr.gibba020.yqfnwy (mgr.34427) 10809 : cluster [DBG] pgmap v6159: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:06.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:06 gibba013 bash[29418]: cephadm 2021-03-10T17:18:05.320519+0000 mgr.gibba020.yqfnwy (mgr.34427) 10810 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:18:06.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:06 gibba013 bash[29418]: cluster 2021-03-10T17:18:05.437269+0000 mgr.gibba020.yqfnwy (mgr.34427) 10811 : cluster [DBG] pgmap v6160: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:06.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:06 gibba013 bash[30381]: cephadm 2021-03-10T17:18:05.320519+0000 mgr.gibba020.yqfnwy (mgr.34427) 10810 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:18:06.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:06 gibba013 bash[30381]: cluster 2021-03-10T17:18:05.437269+0000 mgr.gibba020.yqfnwy (mgr.34427) 10811 : cluster [DBG] pgmap v6160: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:06.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:06 gibba020 bash[25448]: cephadm 2021-03-10T17:18:05.320519+0000 mgr.gibba020.yqfnwy (mgr.34427) 10810 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:18:06.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:06 gibba020 bash[25448]: cluster 2021-03-10T17:18:05.437269+0000 mgr.gibba020.yqfnwy (mgr.34427) 10811 : cluster [DBG] pgmap v6160: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:07.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:07 gibba013 bash[29418]: audit 2021-03-10T17:18:06.949761+0000 mon.a (mon.0) 3824 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:18:07.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:07 gibba013 bash[29418]: audit 2021-03-10T17:18:07.173656+0000 mon.a (mon.0) 3825 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:18:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:07 gibba013 bash[30381]: audit 2021-03-10T17:18:06.949761+0000 mon.a (mon.0) 3824 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:18:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:07 gibba013 bash[30381]: audit 2021-03-10T17:18:07.173656+0000 mon.a (mon.0) 3825 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:18:07.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:07 gibba020 bash[25448]: audit 2021-03-10T17:18:06.949761+0000 mon.a (mon.0) 3824 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:18:07.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:07 gibba020 bash[25448]: audit 2021-03-10T17:18:07.173656+0000 mon.a (mon.0) 3825 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:18:08.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:08 gibba013 bash[29418]: cluster 2021-03-10T17:18:07.438698+0000 mgr.gibba020.yqfnwy (mgr.34427) 10812 : cluster [DBG] pgmap v6161: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:08 gibba013 bash[29418]: audit 2021-03-10T17:18:07.600729+0000 mon.a (mon.0) 3826 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T17:18:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:08 gibba013 bash[29418]: audit 2021-03-10T17:18:07.601316+0000 mon.a (mon.0) 3827 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:18:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:08 gibba013 bash[29418]: audit 2021-03-10T17:18:07.601834+0000 mon.a (mon.0) 3828 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:18:08.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:08 gibba013 bash[29418]: audit 2021-03-10T17:18:07.602375+0000 mon.a (mon.0) 3829 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:18:08.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:08 gibba013 bash[30381]: cluster 2021-03-10T17:18:07.438698+0000 mgr.gibba020.yqfnwy (mgr.34427) 10812 : cluster [DBG] pgmap v6161: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:08.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:08 gibba013 bash[30381]: audit 2021-03-10T17:18:07.600729+0000 mon.a (mon.0) 3826 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T17:18:08.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:08 gibba013 bash[30381]: audit 2021-03-10T17:18:07.601316+0000 mon.a (mon.0) 3827 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:18:08.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:08 gibba013 bash[30381]: audit 2021-03-10T17:18:07.601834+0000 mon.a (mon.0) 3828 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:18:08.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:08 gibba013 bash[30381]: audit 2021-03-10T17:18:07.602375+0000 mon.a (mon.0) 3829 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:18:08.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:08 gibba020 bash[25448]: cluster 2021-03-10T17:18:07.438698+0000 mgr.gibba020.yqfnwy (mgr.34427) 10812 : cluster [DBG] pgmap v6161: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:08.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:08 gibba020 bash[25448]: audit 2021-03-10T17:18:07.600729+0000 mon.a (mon.0) 3826 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T17:18:08.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:08 gibba020 bash[25448]: audit 2021-03-10T17:18:07.601316+0000 mon.a (mon.0) 3827 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:18:08.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:08 gibba020 bash[25448]: audit 2021-03-10T17:18:07.601834+0000 mon.a (mon.0) 3828 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:18:08.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:08 gibba020 bash[25448]: audit 2021-03-10T17:18:07.602375+0000 mon.a (mon.0) 3829 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:18:10.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:10 gibba013 bash[29418]: cluster 2021-03-10T17:18:09.440284+0000 mgr.gibba020.yqfnwy (mgr.34427) 10813 : cluster [DBG] pgmap v6162: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:10.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:10 gibba013 bash[30381]: cluster 2021-03-10T17:18:09.440284+0000 mgr.gibba020.yqfnwy (mgr.34427) 10813 : cluster [DBG] pgmap v6162: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:10.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:10 gibba020 bash[25448]: cluster 2021-03-10T17:18:09.440284+0000 mgr.gibba020.yqfnwy (mgr.34427) 10813 : cluster [DBG] pgmap v6162: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:12.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:11 gibba013 bash[29418]: cluster 2021-03-10T17:18:11.442190+0000 mgr.gibba020.yqfnwy (mgr.34427) 10814 : cluster [DBG] pgmap v6163: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:12.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:11 gibba013 bash[30381]: cluster 2021-03-10T17:18:11.442190+0000 mgr.gibba020.yqfnwy (mgr.34427) 10814 : cluster [DBG] pgmap v6163: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:12.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:11 gibba020 bash[25448]: cluster 2021-03-10T17:18:11.442190+0000 mgr.gibba020.yqfnwy (mgr.34427) 10814 : cluster [DBG] pgmap v6163: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:12.465 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:18:12.694 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:18:12.694 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 6m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:18:12.695 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 5m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:18:12.695 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:18:12.695 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:18:12.695 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:18:12.695 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:18:12.696 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:18:12.696 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:18:12.696 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:18:12.696 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:18:12.697 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:18:12.697 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:18:12.697 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:18:12.697 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:18:12.697 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:18:12.698 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:18:12.698 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:18:12.698 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:18:12.698 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 5m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:18:12.698 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 5m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:18:12.943 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:18:12.943 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:18:12.944 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:18:12.944 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:18:12.944 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:18:12.944 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:18:12.945 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:18:12.945 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:18:12.945 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:18:12.945 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:18:12.945 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:18:12.946 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:18:12.946 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:18:12.946 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:18:12.946 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:18:13.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:12 gibba013 bash[29418]: audit 2021-03-10T17:18:12.454340+0000 mgr.gibba020.yqfnwy (mgr.34427) 10815 : audit [DBG] from='client.61285 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:18:13.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:12 gibba013 bash[29418]: audit 2021-03-10T17:18:12.680207+0000 mgr.gibba020.yqfnwy (mgr.34427) 10816 : audit [DBG] from='client.61291 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:18:13.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:12 gibba013 bash[30381]: audit 2021-03-10T17:18:12.454340+0000 mgr.gibba020.yqfnwy (mgr.34427) 10815 : audit [DBG] from='client.61285 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:18:13.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:12 gibba013 bash[30381]: audit 2021-03-10T17:18:12.680207+0000 mgr.gibba020.yqfnwy (mgr.34427) 10816 : audit [DBG] from='client.61291 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:18:13.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:12 gibba020 bash[25448]: audit 2021-03-10T17:18:12.454340+0000 mgr.gibba020.yqfnwy (mgr.34427) 10815 : audit [DBG] from='client.61285 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:18:13.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:12 gibba020 bash[25448]: audit 2021-03-10T17:18:12.680207+0000 mgr.gibba020.yqfnwy (mgr.34427) 10816 : audit [DBG] from='client.61291 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:18:14.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:13 gibba013 bash[29418]: audit 2021-03-10T17:18:12.942431+0000 mon.c (mon.1) 162 : audit [DBG] from='client.? 172.21.2.113:0/2685208593' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:14.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:13 gibba013 bash[29418]: cluster 2021-03-10T17:18:13.443586+0000 mgr.gibba020.yqfnwy (mgr.34427) 10817 : cluster [DBG] pgmap v6164: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:14.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:13 gibba013 bash[30381]: audit 2021-03-10T17:18:12.942431+0000 mon.c (mon.1) 162 : audit [DBG] from='client.? 172.21.2.113:0/2685208593' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:14.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:13 gibba013 bash[30381]: cluster 2021-03-10T17:18:13.443586+0000 mgr.gibba020.yqfnwy (mgr.34427) 10817 : cluster [DBG] pgmap v6164: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:14.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:13 gibba020 bash[25448]: audit 2021-03-10T17:18:12.942431+0000 mon.c (mon.1) 162 : audit [DBG] from='client.? 172.21.2.113:0/2685208593' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:14.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:13 gibba020 bash[25448]: cluster 2021-03-10T17:18:13.443586+0000 mgr.gibba020.yqfnwy (mgr.34427) 10817 : cluster [DBG] pgmap v6164: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:16.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:16 gibba013 bash[29418]: cluster 2021-03-10T17:18:15.445267+0000 mgr.gibba020.yqfnwy (mgr.34427) 10818 : cluster [DBG] pgmap v6165: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:16.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:16 gibba013 bash[30381]: cluster 2021-03-10T17:18:15.445267+0000 mgr.gibba020.yqfnwy (mgr.34427) 10818 : cluster [DBG] pgmap v6165: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:16.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:16 gibba020 bash[25448]: cluster 2021-03-10T17:18:15.445267+0000 mgr.gibba020.yqfnwy (mgr.34427) 10818 : cluster [DBG] pgmap v6165: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:18.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:18 gibba013 bash[29418]: cluster 2021-03-10T17:18:17.446778+0000 mgr.gibba020.yqfnwy (mgr.34427) 10819 : cluster [DBG] pgmap v6166: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:18.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:18 gibba013 bash[30381]: cluster 2021-03-10T17:18:17.446778+0000 mgr.gibba020.yqfnwy (mgr.34427) 10819 : cluster [DBG] pgmap v6166: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:18.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:18 gibba020 bash[25448]: cluster 2021-03-10T17:18:17.446778+0000 mgr.gibba020.yqfnwy (mgr.34427) 10819 : cluster [DBG] pgmap v6166: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:20.698 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:20 gibba020 bash[25448]: cluster 2021-03-10T17:18:19.448166+0000 mgr.gibba020.yqfnwy (mgr.34427) 10820 : cluster [DBG] pgmap v6167: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:20.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:20 gibba013 bash[29418]: cluster 2021-03-10T17:18:19.448166+0000 mgr.gibba020.yqfnwy (mgr.34427) 10820 : cluster [DBG] pgmap v6167: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:20.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:20 gibba013 bash[30381]: cluster 2021-03-10T17:18:19.448166+0000 mgr.gibba020.yqfnwy (mgr.34427) 10820 : cluster [DBG] pgmap v6167: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:21.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:21 gibba013 bash[29418]: cephadm 2021-03-10T17:18:20.336528+0000 mgr.gibba020.yqfnwy (mgr.34427) 10821 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:18:21.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:21 gibba013 bash[30381]: cephadm 2021-03-10T17:18:20.336528+0000 mgr.gibba020.yqfnwy (mgr.34427) 10821 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:18:21.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:21 gibba020 bash[25448]: cephadm 2021-03-10T17:18:20.336528+0000 mgr.gibba020.yqfnwy (mgr.34427) 10821 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:18:22.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:22 gibba013 bash[29418]: cluster 2021-03-10T17:18:21.449999+0000 mgr.gibba020.yqfnwy (mgr.34427) 10822 : cluster [DBG] pgmap v6168: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:22.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:22 gibba013 bash[30381]: cluster 2021-03-10T17:18:21.449999+0000 mgr.gibba020.yqfnwy (mgr.34427) 10822 : cluster [DBG] pgmap v6168: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:22.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:22 gibba020 bash[25448]: cluster 2021-03-10T17:18:21.449999+0000 mgr.gibba020.yqfnwy (mgr.34427) 10822 : cluster [DBG] pgmap v6168: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:24.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:24 gibba013 bash[29418]: cluster 2021-03-10T17:18:23.451407+0000 mgr.gibba020.yqfnwy (mgr.34427) 10823 : cluster [DBG] pgmap v6169: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:24.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:24 gibba013 bash[30381]: cluster 2021-03-10T17:18:23.451407+0000 mgr.gibba020.yqfnwy (mgr.34427) 10823 : cluster [DBG] pgmap v6169: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:24.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:24 gibba020 bash[25448]: cluster 2021-03-10T17:18:23.451407+0000 mgr.gibba020.yqfnwy (mgr.34427) 10823 : cluster [DBG] pgmap v6169: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:26.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:26 gibba013 bash[29418]: cluster 2021-03-10T17:18:25.452909+0000 mgr.gibba020.yqfnwy (mgr.34427) 10824 : cluster [DBG] pgmap v6170: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:26.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:26 gibba013 bash[30381]: cluster 2021-03-10T17:18:25.452909+0000 mgr.gibba020.yqfnwy (mgr.34427) 10824 : cluster [DBG] pgmap v6170: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:26.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:26 gibba020 bash[25448]: cluster 2021-03-10T17:18:25.452909+0000 mgr.gibba020.yqfnwy (mgr.34427) 10824 : cluster [DBG] pgmap v6170: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:28.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:28 gibba013 bash[29418]: cluster 2021-03-10T17:18:27.454411+0000 mgr.gibba020.yqfnwy (mgr.34427) 10825 : cluster [DBG] pgmap v6171: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:28.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:28 gibba013 bash[30381]: cluster 2021-03-10T17:18:27.454411+0000 mgr.gibba020.yqfnwy (mgr.34427) 10825 : cluster [DBG] pgmap v6171: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:28.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:28 gibba020 bash[25448]: cluster 2021-03-10T17:18:27.454411+0000 mgr.gibba020.yqfnwy (mgr.34427) 10825 : cluster [DBG] pgmap v6171: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:30.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:30 gibba013 bash[29418]: cluster 2021-03-10T17:18:29.455778+0000 mgr.gibba020.yqfnwy (mgr.34427) 10826 : cluster [DBG] pgmap v6172: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:30.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:30 gibba013 bash[30381]: cluster 2021-03-10T17:18:29.455778+0000 mgr.gibba020.yqfnwy (mgr.34427) 10826 : cluster [DBG] pgmap v6172: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:30.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:30 gibba020 bash[25448]: cluster 2021-03-10T17:18:29.455778+0000 mgr.gibba020.yqfnwy (mgr.34427) 10826 : cluster [DBG] pgmap v6172: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:32.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:31 gibba013 bash[29418]: cluster 2021-03-10T17:18:31.457683+0000 mgr.gibba020.yqfnwy (mgr.34427) 10827 : cluster [DBG] pgmap v6173: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:32.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:31 gibba013 bash[30381]: cluster 2021-03-10T17:18:31.457683+0000 mgr.gibba020.yqfnwy (mgr.34427) 10827 : cluster [DBG] pgmap v6173: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:32.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:31 gibba020 bash[25448]: cluster 2021-03-10T17:18:31.457683+0000 mgr.gibba020.yqfnwy (mgr.34427) 10827 : cluster [DBG] pgmap v6173: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:34.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:34 gibba013 bash[29418]: cluster 2021-03-10T17:18:33.459071+0000 mgr.gibba020.yqfnwy (mgr.34427) 10828 : cluster [DBG] pgmap v6174: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:34.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:34 gibba013 bash[30381]: cluster 2021-03-10T17:18:33.459071+0000 mgr.gibba020.yqfnwy (mgr.34427) 10828 : cluster [DBG] pgmap v6174: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:34.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:34 gibba020 bash[25448]: cluster 2021-03-10T17:18:33.459071+0000 mgr.gibba020.yqfnwy (mgr.34427) 10828 : cluster [DBG] pgmap v6174: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:35.790 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:35 gibba020 bash[25448]: audit 2021-03-10T17:18:35.353210+0000 mon.a (mon.0) 3830 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:18:35.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:35 gibba013 bash[29418]: audit 2021-03-10T17:18:35.353210+0000 mon.a (mon.0) 3830 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:18:35.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:35 gibba013 bash[30381]: audit 2021-03-10T17:18:35.353210+0000 mon.a (mon.0) 3830 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:18:36.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:36 gibba013 bash[29418]: cluster 2021-03-10T17:18:35.459605+0000 mgr.gibba020.yqfnwy (mgr.34427) 10829 : cluster [DBG] pgmap v6175: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:36.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:36 gibba013 bash[29418]: audit 2021-03-10T17:18:35.561322+0000 mon.a (mon.0) 3831 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:18:36.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:36 gibba013 bash[29418]: cephadm 2021-03-10T17:18:35.561514+0000 mgr.gibba020.yqfnwy (mgr.34427) 10830 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:18:36.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:36 gibba013 bash[29418]: audit 2021-03-10T17:18:35.564189+0000 mon.a (mon.0) 3832 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:18:36.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:36 gibba013 bash[29418]: cephadm 2021-03-10T17:18:35.564487+0000 mgr.gibba020.yqfnwy (mgr.34427) 10831 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:18:36.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:36 gibba013 bash[29418]: audit 2021-03-10T17:18:35.772978+0000 mon.a (mon.0) 3833 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:18:36.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:36 gibba013 bash[29418]: audit 2021-03-10T17:18:35.778892+0000 mon.a (mon.0) 3834 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:18:36.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:36 gibba013 bash[29418]: audit 2021-03-10T17:18:35.780369+0000 mon.a (mon.0) 3835 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:36.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:36 gibba013 bash[29418]: audit 2021-03-10T17:18:35.781878+0000 mon.a (mon.0) 3836 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:36.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:36 gibba013 bash[29418]: audit 2021-03-10T17:18:35.783464+0000 mon.a (mon.0) 3837 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:36.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:36 gibba013 bash[29418]: audit 2021-03-10T17:18:35.786343+0000 mon.a (mon.0) 3838 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:36.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:36 gibba013 bash[29418]: audit 2021-03-10T17:18:35.788042+0000 mon.a (mon.0) 3839 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:36.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:36 gibba013 bash[30381]: cluster 2021-03-10T17:18:35.459605+0000 mgr.gibba020.yqfnwy (mgr.34427) 10829 : cluster [DBG] pgmap v6175: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:36.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:36 gibba013 bash[30381]: audit 2021-03-10T17:18:35.561322+0000 mon.a (mon.0) 3831 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:18:36.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:36 gibba013 bash[30381]: cephadm 2021-03-10T17:18:35.561514+0000 mgr.gibba020.yqfnwy (mgr.34427) 10830 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:18:36.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:36 gibba013 bash[30381]: audit 2021-03-10T17:18:35.564189+0000 mon.a (mon.0) 3832 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:18:36.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:36 gibba013 bash[30381]: cephadm 2021-03-10T17:18:35.564487+0000 mgr.gibba020.yqfnwy (mgr.34427) 10831 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:18:36.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:36 gibba013 bash[30381]: audit 2021-03-10T17:18:35.772978+0000 mon.a (mon.0) 3833 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:18:36.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:36 gibba013 bash[30381]: audit 2021-03-10T17:18:35.778892+0000 mon.a (mon.0) 3834 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:18:36.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:36 gibba013 bash[30381]: audit 2021-03-10T17:18:35.780369+0000 mon.a (mon.0) 3835 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:36.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:36 gibba013 bash[30381]: audit 2021-03-10T17:18:35.781878+0000 mon.a (mon.0) 3836 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:36.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:36 gibba013 bash[30381]: audit 2021-03-10T17:18:35.783464+0000 mon.a (mon.0) 3837 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:36.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:36 gibba013 bash[30381]: audit 2021-03-10T17:18:35.786343+0000 mon.a (mon.0) 3838 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:36.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:36 gibba013 bash[30381]: audit 2021-03-10T17:18:35.788042+0000 mon.a (mon.0) 3839 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:36.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:36 gibba020 bash[25448]: cluster 2021-03-10T17:18:35.459605+0000 mgr.gibba020.yqfnwy (mgr.34427) 10829 : cluster [DBG] pgmap v6175: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:36.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:36 gibba020 bash[25448]: audit 2021-03-10T17:18:35.561322+0000 mon.a (mon.0) 3831 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:18:36.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:36 gibba020 bash[25448]: cephadm 2021-03-10T17:18:35.561514+0000 mgr.gibba020.yqfnwy (mgr.34427) 10830 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:18:36.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:36 gibba020 bash[25448]: audit 2021-03-10T17:18:35.564189+0000 mon.a (mon.0) 3832 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:18:36.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:36 gibba020 bash[25448]: cephadm 2021-03-10T17:18:35.564487+0000 mgr.gibba020.yqfnwy (mgr.34427) 10831 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:18:36.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:36 gibba020 bash[25448]: audit 2021-03-10T17:18:35.772978+0000 mon.a (mon.0) 3833 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:18:36.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:36 gibba020 bash[25448]: audit 2021-03-10T17:18:35.778892+0000 mon.a (mon.0) 3834 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:18:36.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:36 gibba020 bash[25448]: audit 2021-03-10T17:18:35.780369+0000 mon.a (mon.0) 3835 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:36.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:36 gibba020 bash[25448]: audit 2021-03-10T17:18:35.781878+0000 mon.a (mon.0) 3836 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:36.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:36 gibba020 bash[25448]: audit 2021-03-10T17:18:35.783464+0000 mon.a (mon.0) 3837 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:36.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:36 gibba020 bash[25448]: audit 2021-03-10T17:18:35.786343+0000 mon.a (mon.0) 3838 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:36.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:36 gibba020 bash[25448]: audit 2021-03-10T17:18:35.788042+0000 mon.a (mon.0) 3839 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:37.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:37 gibba013 bash[29418]: cephadm 2021-03-10T17:18:35.777650+0000 mgr.gibba020.yqfnwy (mgr.34427) 10832 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:18:37.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:37 gibba013 bash[29418]: cephadm 2021-03-10T17:18:35.779447+0000 mgr.gibba020.yqfnwy (mgr.34427) 10833 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:18:37.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:37 gibba013 bash[29418]: cephadm 2021-03-10T17:18:35.780849+0000 mgr.gibba020.yqfnwy (mgr.34427) 10834 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:18:37.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:37 gibba013 bash[29418]: cephadm 2021-03-10T17:18:35.780887+0000 mgr.gibba020.yqfnwy (mgr.34427) 10835 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:18:37.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:37 gibba013 bash[29418]: cephadm 2021-03-10T17:18:35.782614+0000 mgr.gibba020.yqfnwy (mgr.34427) 10836 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:18:37.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:37 gibba013 bash[29418]: cephadm 2021-03-10T17:18:35.782650+0000 mgr.gibba020.yqfnwy (mgr.34427) 10837 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:18:37.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:37 gibba013 bash[29418]: cephadm 2021-03-10T17:18:35.784189+0000 mgr.gibba020.yqfnwy (mgr.34427) 10838 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:18:37.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:37 gibba013 bash[29418]: cephadm 2021-03-10T17:18:35.785458+0000 mgr.gibba020.yqfnwy (mgr.34427) 10839 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:18:37.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:37 gibba013 bash[29418]: cephadm 2021-03-10T17:18:35.785515+0000 mgr.gibba020.yqfnwy (mgr.34427) 10840 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:18:37.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:37 gibba013 bash[29418]: cephadm 2021-03-10T17:18:35.786871+0000 mgr.gibba020.yqfnwy (mgr.34427) 10841 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:18:37.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:37 gibba013 bash[29418]: cephadm 2021-03-10T17:18:35.787187+0000 mgr.gibba020.yqfnwy (mgr.34427) 10842 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:18:37.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:37 gibba013 bash[29418]: cephadm 2021-03-10T17:18:35.788670+0000 mgr.gibba020.yqfnwy (mgr.34427) 10843 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:18:37.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:37 gibba013 bash[29418]: cephadm 2021-03-10T17:18:35.788705+0000 mgr.gibba020.yqfnwy (mgr.34427) 10844 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:18:37.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:37 gibba013 bash[29418]: cephadm 2021-03-10T17:18:35.788897+0000 mgr.gibba020.yqfnwy (mgr.34427) 10845 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:18:37.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:37 gibba013 bash[30381]: cephadm 2021-03-10T17:18:35.777650+0000 mgr.gibba020.yqfnwy (mgr.34427) 10832 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:18:37.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:37 gibba013 bash[30381]: cephadm 2021-03-10T17:18:35.779447+0000 mgr.gibba020.yqfnwy (mgr.34427) 10833 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:18:37.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:37 gibba013 bash[30381]: cephadm 2021-03-10T17:18:35.780849+0000 mgr.gibba020.yqfnwy (mgr.34427) 10834 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:18:37.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:37 gibba013 bash[30381]: cephadm 2021-03-10T17:18:35.780887+0000 mgr.gibba020.yqfnwy (mgr.34427) 10835 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:18:37.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:37 gibba013 bash[30381]: cephadm 2021-03-10T17:18:35.782614+0000 mgr.gibba020.yqfnwy (mgr.34427) 10836 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:18:37.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:37 gibba013 bash[30381]: cephadm 2021-03-10T17:18:35.782650+0000 mgr.gibba020.yqfnwy (mgr.34427) 10837 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:18:37.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:37 gibba013 bash[30381]: cephadm 2021-03-10T17:18:35.784189+0000 mgr.gibba020.yqfnwy (mgr.34427) 10838 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:18:37.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:37 gibba013 bash[30381]: cephadm 2021-03-10T17:18:35.785458+0000 mgr.gibba020.yqfnwy (mgr.34427) 10839 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:18:37.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:37 gibba013 bash[30381]: cephadm 2021-03-10T17:18:35.785515+0000 mgr.gibba020.yqfnwy (mgr.34427) 10840 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:18:37.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:37 gibba013 bash[30381]: cephadm 2021-03-10T17:18:35.786871+0000 mgr.gibba020.yqfnwy (mgr.34427) 10841 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:18:37.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:37 gibba013 bash[30381]: cephadm 2021-03-10T17:18:35.787187+0000 mgr.gibba020.yqfnwy (mgr.34427) 10842 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:18:37.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:37 gibba013 bash[30381]: cephadm 2021-03-10T17:18:35.788670+0000 mgr.gibba020.yqfnwy (mgr.34427) 10843 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:18:37.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:37 gibba013 bash[30381]: cephadm 2021-03-10T17:18:35.788705+0000 mgr.gibba020.yqfnwy (mgr.34427) 10844 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:18:37.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:37 gibba013 bash[30381]: cephadm 2021-03-10T17:18:35.788897+0000 mgr.gibba020.yqfnwy (mgr.34427) 10845 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:18:37.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:37 gibba020 bash[25448]: cephadm 2021-03-10T17:18:35.777650+0000 mgr.gibba020.yqfnwy (mgr.34427) 10832 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:18:37.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:37 gibba020 bash[25448]: cephadm 2021-03-10T17:18:35.779447+0000 mgr.gibba020.yqfnwy (mgr.34427) 10833 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:18:37.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:37 gibba020 bash[25448]: cephadm 2021-03-10T17:18:35.780849+0000 mgr.gibba020.yqfnwy (mgr.34427) 10834 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:18:37.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:37 gibba020 bash[25448]: cephadm 2021-03-10T17:18:35.780887+0000 mgr.gibba020.yqfnwy (mgr.34427) 10835 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:18:37.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:37 gibba020 bash[25448]: cephadm 2021-03-10T17:18:35.782614+0000 mgr.gibba020.yqfnwy (mgr.34427) 10836 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:18:37.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:37 gibba020 bash[25448]: cephadm 2021-03-10T17:18:35.782650+0000 mgr.gibba020.yqfnwy (mgr.34427) 10837 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:18:37.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:37 gibba020 bash[25448]: cephadm 2021-03-10T17:18:35.784189+0000 mgr.gibba020.yqfnwy (mgr.34427) 10838 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:18:37.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:37 gibba020 bash[25448]: cephadm 2021-03-10T17:18:35.785458+0000 mgr.gibba020.yqfnwy (mgr.34427) 10839 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:18:37.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:37 gibba020 bash[25448]: cephadm 2021-03-10T17:18:35.785515+0000 mgr.gibba020.yqfnwy (mgr.34427) 10840 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:18:37.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:37 gibba020 bash[25448]: cephadm 2021-03-10T17:18:35.786871+0000 mgr.gibba020.yqfnwy (mgr.34427) 10841 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:18:37.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:37 gibba020 bash[25448]: cephadm 2021-03-10T17:18:35.787187+0000 mgr.gibba020.yqfnwy (mgr.34427) 10842 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:18:37.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:37 gibba020 bash[25448]: cephadm 2021-03-10T17:18:35.788670+0000 mgr.gibba020.yqfnwy (mgr.34427) 10843 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:18:37.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:37 gibba020 bash[25448]: cephadm 2021-03-10T17:18:35.788705+0000 mgr.gibba020.yqfnwy (mgr.34427) 10844 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:18:37.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:37 gibba020 bash[25448]: cephadm 2021-03-10T17:18:35.788897+0000 mgr.gibba020.yqfnwy (mgr.34427) 10845 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:18:38.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:38 gibba013 bash[29418]: cluster 2021-03-10T17:18:37.461076+0000 mgr.gibba020.yqfnwy (mgr.34427) 10846 : cluster [DBG] pgmap v6176: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:38.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:38 gibba013 bash[30381]: cluster 2021-03-10T17:18:37.461076+0000 mgr.gibba020.yqfnwy (mgr.34427) 10846 : cluster [DBG] pgmap v6176: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:38.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:38 gibba020 bash[25448]: cluster 2021-03-10T17:18:37.461076+0000 mgr.gibba020.yqfnwy (mgr.34427) 10846 : cluster [DBG] pgmap v6176: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:40.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:40 gibba013 bash[29418]: cluster 2021-03-10T17:18:39.462407+0000 mgr.gibba020.yqfnwy (mgr.34427) 10847 : cluster [DBG] pgmap v6177: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:40.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:40 gibba013 bash[30381]: cluster 2021-03-10T17:18:39.462407+0000 mgr.gibba020.yqfnwy (mgr.34427) 10847 : cluster [DBG] pgmap v6177: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:40.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:40 gibba020 bash[25448]: cluster 2021-03-10T17:18:39.462407+0000 mgr.gibba020.yqfnwy (mgr.34427) 10847 : cluster [DBG] pgmap v6177: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:42.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:41 gibba013 bash[29418]: cluster 2021-03-10T17:18:41.464170+0000 mgr.gibba020.yqfnwy (mgr.34427) 10848 : cluster [DBG] pgmap v6178: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:42.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:41 gibba013 bash[30381]: cluster 2021-03-10T17:18:41.464170+0000 mgr.gibba020.yqfnwy (mgr.34427) 10848 : cluster [DBG] pgmap v6178: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:42.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:41 gibba020 bash[25448]: cluster 2021-03-10T17:18:41.464170+0000 mgr.gibba020.yqfnwy (mgr.34427) 10848 : cluster [DBG] pgmap v6178: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:43.189 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:18:43.420 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:18:43.420 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 7m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:18:43.420 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 6m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:18:43.421 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:18:43.421 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:18:43.421 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:18:43.421 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:18:43.421 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:18:43.422 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:18:43.422 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:18:43.422 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:18:43.422 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:18:43.423 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:18:43.423 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:18:43.423 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:18:43.423 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:18:43.423 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:18:43.424 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:18:43.424 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:18:43.424 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 6m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:18:43.424 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 6m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:18:43.667 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:18:43.667 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:18:43.667 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:18:43.668 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:18:43.668 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:18:43.668 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:18:43.668 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:18:43.668 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:18:43.669 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:18:43.669 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:18:43.669 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:18:43.669 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:18:43.670 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:18:43.670 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:18:43.670 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:18:44.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:44 gibba013 bash[29418]: audit 2021-03-10T17:18:43.178589+0000 mgr.gibba020.yqfnwy (mgr.34427) 10849 : audit [DBG] from='client.61303 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:18:44.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:44 gibba013 bash[29418]: audit 2021-03-10T17:18:43.405900+0000 mgr.gibba020.yqfnwy (mgr.34427) 10850 : audit [DBG] from='client.51330 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:18:44.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:44 gibba013 bash[29418]: cluster 2021-03-10T17:18:43.464866+0000 mgr.gibba020.yqfnwy (mgr.34427) 10851 : cluster [DBG] pgmap v6179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:44.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:44 gibba013 bash[29418]: audit 2021-03-10T17:18:43.666082+0000 mon.a (mon.0) 3840 : audit [DBG] from='client.? 172.21.2.113:0/81071195' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:44.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:44 gibba013 bash[30381]: audit 2021-03-10T17:18:43.178589+0000 mgr.gibba020.yqfnwy (mgr.34427) 10849 : audit [DBG] from='client.61303 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:18:44.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:44 gibba013 bash[30381]: audit 2021-03-10T17:18:43.405900+0000 mgr.gibba020.yqfnwy (mgr.34427) 10850 : audit [DBG] from='client.51330 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:18:44.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:44 gibba013 bash[30381]: cluster 2021-03-10T17:18:43.464866+0000 mgr.gibba020.yqfnwy (mgr.34427) 10851 : cluster [DBG] pgmap v6179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:44.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:44 gibba013 bash[30381]: audit 2021-03-10T17:18:43.666082+0000 mon.a (mon.0) 3840 : audit [DBG] from='client.? 172.21.2.113:0/81071195' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:44.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:44 gibba020 bash[25448]: audit 2021-03-10T17:18:43.178589+0000 mgr.gibba020.yqfnwy (mgr.34427) 10849 : audit [DBG] from='client.61303 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:18:44.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:44 gibba020 bash[25448]: audit 2021-03-10T17:18:43.405900+0000 mgr.gibba020.yqfnwy (mgr.34427) 10850 : audit [DBG] from='client.51330 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:18:44.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:44 gibba020 bash[25448]: cluster 2021-03-10T17:18:43.464866+0000 mgr.gibba020.yqfnwy (mgr.34427) 10851 : cluster [DBG] pgmap v6179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:44.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:44 gibba020 bash[25448]: audit 2021-03-10T17:18:43.666082+0000 mon.a (mon.0) 3840 : audit [DBG] from='client.? 172.21.2.113:0/81071195' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:18:46.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:46 gibba013 bash[29418]: cluster 2021-03-10T17:18:45.466232+0000 mgr.gibba020.yqfnwy (mgr.34427) 10852 : cluster [DBG] pgmap v6180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:46.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:46 gibba013 bash[30381]: cluster 2021-03-10T17:18:45.466232+0000 mgr.gibba020.yqfnwy (mgr.34427) 10852 : cluster [DBG] pgmap v6180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:46.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:46 gibba020 bash[25448]: cluster 2021-03-10T17:18:45.466232+0000 mgr.gibba020.yqfnwy (mgr.34427) 10852 : cluster [DBG] pgmap v6180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:48.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:48 gibba013 bash[29418]: cluster 2021-03-10T17:18:47.467755+0000 mgr.gibba020.yqfnwy (mgr.34427) 10853 : cluster [DBG] pgmap v6181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:48.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:48 gibba013 bash[30381]: cluster 2021-03-10T17:18:47.467755+0000 mgr.gibba020.yqfnwy (mgr.34427) 10853 : cluster [DBG] pgmap v6181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:48.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:48 gibba020 bash[25448]: cluster 2021-03-10T17:18:47.467755+0000 mgr.gibba020.yqfnwy (mgr.34427) 10853 : cluster [DBG] pgmap v6181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:50.805 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:50 gibba020 bash[25448]: cluster 2021-03-10T17:18:49.469153+0000 mgr.gibba020.yqfnwy (mgr.34427) 10854 : cluster [DBG] pgmap v6182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:50.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:50 gibba013 bash[29418]: cluster 2021-03-10T17:18:49.469153+0000 mgr.gibba020.yqfnwy (mgr.34427) 10854 : cluster [DBG] pgmap v6182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:50.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:50 gibba013 bash[30381]: cluster 2021-03-10T17:18:49.469153+0000 mgr.gibba020.yqfnwy (mgr.34427) 10854 : cluster [DBG] pgmap v6182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:52.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:51 gibba013 bash[29418]: cephadm 2021-03-10T17:18:50.804486+0000 mgr.gibba020.yqfnwy (mgr.34427) 10855 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:18:52.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:51 gibba013 bash[29418]: cluster 2021-03-10T17:18:51.471037+0000 mgr.gibba020.yqfnwy (mgr.34427) 10856 : cluster [DBG] pgmap v6183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:52.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:51 gibba013 bash[30381]: cephadm 2021-03-10T17:18:50.804486+0000 mgr.gibba020.yqfnwy (mgr.34427) 10855 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:18:52.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:51 gibba013 bash[30381]: cluster 2021-03-10T17:18:51.471037+0000 mgr.gibba020.yqfnwy (mgr.34427) 10856 : cluster [DBG] pgmap v6183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:52.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:51 gibba020 bash[25448]: cephadm 2021-03-10T17:18:50.804486+0000 mgr.gibba020.yqfnwy (mgr.34427) 10855 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:18:52.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:51 gibba020 bash[25448]: cluster 2021-03-10T17:18:51.471037+0000 mgr.gibba020.yqfnwy (mgr.34427) 10856 : cluster [DBG] pgmap v6183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:54.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:54 gibba013 bash[29418]: cluster 2021-03-10T17:18:53.472500+0000 mgr.gibba020.yqfnwy (mgr.34427) 10857 : cluster [DBG] pgmap v6184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:54.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:54 gibba013 bash[30381]: cluster 2021-03-10T17:18:53.472500+0000 mgr.gibba020.yqfnwy (mgr.34427) 10857 : cluster [DBG] pgmap v6184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:54.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:54 gibba020 bash[25448]: cluster 2021-03-10T17:18:53.472500+0000 mgr.gibba020.yqfnwy (mgr.34427) 10857 : cluster [DBG] pgmap v6184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:56.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:56 gibba013 bash[29418]: cluster 2021-03-10T17:18:55.473966+0000 mgr.gibba020.yqfnwy (mgr.34427) 10858 : cluster [DBG] pgmap v6185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:56.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:56 gibba013 bash[30381]: cluster 2021-03-10T17:18:55.473966+0000 mgr.gibba020.yqfnwy (mgr.34427) 10858 : cluster [DBG] pgmap v6185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:56.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:56 gibba020 bash[25448]: cluster 2021-03-10T17:18:55.473966+0000 mgr.gibba020.yqfnwy (mgr.34427) 10858 : cluster [DBG] pgmap v6185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:58.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:18:58 gibba013 bash[29418]: cluster 2021-03-10T17:18:57.475234+0000 mgr.gibba020.yqfnwy (mgr.34427) 10859 : cluster [DBG] pgmap v6186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:58.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:18:58 gibba013 bash[30381]: cluster 2021-03-10T17:18:57.475234+0000 mgr.gibba020.yqfnwy (mgr.34427) 10859 : cluster [DBG] pgmap v6186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:18:58.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:18:58 gibba020 bash[25448]: cluster 2021-03-10T17:18:57.475234+0000 mgr.gibba020.yqfnwy (mgr.34427) 10859 : cluster [DBG] pgmap v6186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:00.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:00 gibba013 bash[29418]: cluster 2021-03-10T17:18:59.476857+0000 mgr.gibba020.yqfnwy (mgr.34427) 10860 : cluster [DBG] pgmap v6187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:00.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:00 gibba013 bash[30381]: cluster 2021-03-10T17:18:59.476857+0000 mgr.gibba020.yqfnwy (mgr.34427) 10860 : cluster [DBG] pgmap v6187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:00.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:00 gibba020 bash[25448]: cluster 2021-03-10T17:18:59.476857+0000 mgr.gibba020.yqfnwy (mgr.34427) 10860 : cluster [DBG] pgmap v6187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:02.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:01 gibba013 bash[29418]: cluster 2021-03-10T17:19:01.478740+0000 mgr.gibba020.yqfnwy (mgr.34427) 10861 : cluster [DBG] pgmap v6188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:02.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:01 gibba013 bash[30381]: cluster 2021-03-10T17:19:01.478740+0000 mgr.gibba020.yqfnwy (mgr.34427) 10861 : cluster [DBG] pgmap v6188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:02.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:01 gibba020 bash[25448]: cluster 2021-03-10T17:19:01.478740+0000 mgr.gibba020.yqfnwy (mgr.34427) 10861 : cluster [DBG] pgmap v6188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:04.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:04 gibba013 bash[29418]: cluster 2021-03-10T17:19:03.480194+0000 mgr.gibba020.yqfnwy (mgr.34427) 10862 : cluster [DBG] pgmap v6189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:04.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:04 gibba013 bash[30381]: cluster 2021-03-10T17:19:03.480194+0000 mgr.gibba020.yqfnwy (mgr.34427) 10862 : cluster [DBG] pgmap v6189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:04.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:04 gibba020 bash[25448]: cluster 2021-03-10T17:19:03.480194+0000 mgr.gibba020.yqfnwy (mgr.34427) 10862 : cluster [DBG] pgmap v6189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:06.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:06 gibba013 bash[29418]: cluster 2021-03-10T17:19:05.481951+0000 mgr.gibba020.yqfnwy (mgr.34427) 10863 : cluster [DBG] pgmap v6190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:06.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:06 gibba013 bash[30381]: cluster 2021-03-10T17:19:05.481951+0000 mgr.gibba020.yqfnwy (mgr.34427) 10863 : cluster [DBG] pgmap v6190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:06.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:06 gibba020 bash[25448]: cluster 2021-03-10T17:19:05.481951+0000 mgr.gibba020.yqfnwy (mgr.34427) 10863 : cluster [DBG] pgmap v6190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:07.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:07 gibba013 bash[29418]: cephadm 2021-03-10T17:19:05.819996+0000 mgr.gibba020.yqfnwy (mgr.34427) 10864 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:19:07.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:07 gibba013 bash[29418]: audit 2021-03-10T17:19:06.954323+0000 mon.a (mon.0) 3841 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:19:07.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:07 gibba013 bash[29418]: audit 2021-03-10T17:19:07.180435+0000 mon.a (mon.0) 3842 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:19:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:07 gibba013 bash[30381]: cephadm 2021-03-10T17:19:05.819996+0000 mgr.gibba020.yqfnwy (mgr.34427) 10864 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:19:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:07 gibba013 bash[30381]: audit 2021-03-10T17:19:06.954323+0000 mon.a (mon.0) 3841 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:19:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:07 gibba013 bash[30381]: audit 2021-03-10T17:19:07.180435+0000 mon.a (mon.0) 3842 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:19:07.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:07 gibba020 bash[25448]: cephadm 2021-03-10T17:19:05.819996+0000 mgr.gibba020.yqfnwy (mgr.34427) 10864 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:19:07.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:07 gibba020 bash[25448]: audit 2021-03-10T17:19:06.954323+0000 mon.a (mon.0) 3841 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:19:07.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:07 gibba020 bash[25448]: audit 2021-03-10T17:19:07.180435+0000 mon.a (mon.0) 3842 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:19:08.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:08 gibba013 bash[29418]: cluster 2021-03-10T17:19:07.483366+0000 mgr.gibba020.yqfnwy (mgr.34427) 10865 : cluster [DBG] pgmap v6191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:08.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:08 gibba013 bash[29418]: audit 2021-03-10T17:19:07.605187+0000 mon.a (mon.0) 3843 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:19:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:08 gibba013 bash[29418]: audit 2021-03-10T17:19:07.605352+0000 mon.a (mon.0) 3844 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:19:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:08 gibba013 bash[29418]: audit 2021-03-10T17:19:07.605483+0000 mon.a (mon.0) 3845 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:19:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:08 gibba013 bash[29418]: audit 2021-03-10T17:19:07.605607+0000 mon.a (mon.0) 3846 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:19:08.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:08 gibba013 bash[30381]: cluster 2021-03-10T17:19:07.483366+0000 mgr.gibba020.yqfnwy (mgr.34427) 10865 : cluster [DBG] pgmap v6191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:08.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:08 gibba013 bash[30381]: audit 2021-03-10T17:19:07.605187+0000 mon.a (mon.0) 3843 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:19:08.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:08 gibba013 bash[30381]: audit 2021-03-10T17:19:07.605352+0000 mon.a (mon.0) 3844 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:19:08.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:08 gibba013 bash[30381]: audit 2021-03-10T17:19:07.605483+0000 mon.a (mon.0) 3845 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:19:08.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:08 gibba013 bash[30381]: audit 2021-03-10T17:19:07.605607+0000 mon.a (mon.0) 3846 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:19:08.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:08 gibba020 bash[25448]: cluster 2021-03-10T17:19:07.483366+0000 mgr.gibba020.yqfnwy (mgr.34427) 10865 : cluster [DBG] pgmap v6191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:08.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:08 gibba020 bash[25448]: audit 2021-03-10T17:19:07.605187+0000 mon.a (mon.0) 3843 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:19:08.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:08 gibba020 bash[25448]: audit 2021-03-10T17:19:07.605352+0000 mon.a (mon.0) 3844 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:19:08.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:08 gibba020 bash[25448]: audit 2021-03-10T17:19:07.605483+0000 mon.a (mon.0) 3845 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:19:08.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:08 gibba020 bash[25448]: audit 2021-03-10T17:19:07.605607+0000 mon.a (mon.0) 3846 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:19:10.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:10 gibba013 bash[29418]: cluster 2021-03-10T17:19:09.484836+0000 mgr.gibba020.yqfnwy (mgr.34427) 10866 : cluster [DBG] pgmap v6192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:10.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:10 gibba013 bash[30381]: cluster 2021-03-10T17:19:09.484836+0000 mgr.gibba020.yqfnwy (mgr.34427) 10866 : cluster [DBG] pgmap v6192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:10.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:10 gibba020 bash[25448]: cluster 2021-03-10T17:19:09.484836+0000 mgr.gibba020.yqfnwy (mgr.34427) 10866 : cluster [DBG] pgmap v6192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:12.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:11 gibba013 bash[29418]: cluster 2021-03-10T17:19:11.486696+0000 mgr.gibba020.yqfnwy (mgr.34427) 10867 : cluster [DBG] pgmap v6193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:12.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:11 gibba013 bash[30381]: cluster 2021-03-10T17:19:11.486696+0000 mgr.gibba020.yqfnwy (mgr.34427) 10867 : cluster [DBG] pgmap v6193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:12.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:11 gibba020 bash[25448]: cluster 2021-03-10T17:19:11.486696+0000 mgr.gibba020.yqfnwy (mgr.34427) 10867 : cluster [DBG] pgmap v6193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:13.908 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:19:14.134 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:19:14.135 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 7m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:19:14.135 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 6m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:19:14.135 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:19:14.136 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:19:14.136 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:19:14.136 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:19:14.136 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:19:14.137 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:19:14.137 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:19:14.137 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:19:14.137 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:19:14.137 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:19:14.138 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:19:14.138 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:19:14.138 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:19:14.138 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:19:14.139 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:19:14.139 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:19:14.139 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 6m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:19:14.139 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 6m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:19:14.381 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:19:14.381 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:19:14.381 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:19:14.382 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:19:14.382 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:19:14.382 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:19:14.382 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:19:14.382 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:19:14.383 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:19:14.383 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:19:14.383 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:19:14.383 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:19:14.384 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:19:14.384 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:19:14.384 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:19:14.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:14 gibba013 bash[29418]: cluster 2021-03-10T17:19:13.488123+0000 mgr.gibba020.yqfnwy (mgr.34427) 10868 : cluster [DBG] pgmap v6194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:14.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:14 gibba013 bash[29418]: audit 2021-03-10T17:19:14.379865+0000 mon.c (mon.1) 163 : audit [DBG] from='client.? 172.21.2.113:0/2887972249' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:14.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:14 gibba013 bash[30381]: cluster 2021-03-10T17:19:13.488123+0000 mgr.gibba020.yqfnwy (mgr.34427) 10868 : cluster [DBG] pgmap v6194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:14.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:14 gibba013 bash[30381]: audit 2021-03-10T17:19:14.379865+0000 mon.c (mon.1) 163 : audit [DBG] from='client.? 172.21.2.113:0/2887972249' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:14.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:14 gibba020 bash[25448]: cluster 2021-03-10T17:19:13.488123+0000 mgr.gibba020.yqfnwy (mgr.34427) 10868 : cluster [DBG] pgmap v6194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:14.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:14 gibba020 bash[25448]: audit 2021-03-10T17:19:14.379865+0000 mon.c (mon.1) 163 : audit [DBG] from='client.? 172.21.2.113:0/2887972249' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:15.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:15 gibba013 bash[29418]: audit 2021-03-10T17:19:13.898165+0000 mgr.gibba020.yqfnwy (mgr.34427) 10869 : audit [DBG] from='client.51342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:19:15.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:15 gibba013 bash[29418]: audit 2021-03-10T17:19:14.121115+0000 mgr.gibba020.yqfnwy (mgr.34427) 10870 : audit [DBG] from='client.51348 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:19:15.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:15 gibba013 bash[30381]: audit 2021-03-10T17:19:13.898165+0000 mgr.gibba020.yqfnwy (mgr.34427) 10869 : audit [DBG] from='client.51342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:19:15.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:15 gibba013 bash[30381]: audit 2021-03-10T17:19:14.121115+0000 mgr.gibba020.yqfnwy (mgr.34427) 10870 : audit [DBG] from='client.51348 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:19:15.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:15 gibba020 bash[25448]: audit 2021-03-10T17:19:13.898165+0000 mgr.gibba020.yqfnwy (mgr.34427) 10869 : audit [DBG] from='client.51342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:19:15.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:15 gibba020 bash[25448]: audit 2021-03-10T17:19:14.121115+0000 mgr.gibba020.yqfnwy (mgr.34427) 10870 : audit [DBG] from='client.51348 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:19:16.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:16 gibba013 bash[29418]: cluster 2021-03-10T17:19:15.489569+0000 mgr.gibba020.yqfnwy (mgr.34427) 10871 : cluster [DBG] pgmap v6195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:16.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:16 gibba013 bash[30381]: cluster 2021-03-10T17:19:15.489569+0000 mgr.gibba020.yqfnwy (mgr.34427) 10871 : cluster [DBG] pgmap v6195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:16.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:16 gibba020 bash[25448]: cluster 2021-03-10T17:19:15.489569+0000 mgr.gibba020.yqfnwy (mgr.34427) 10871 : cluster [DBG] pgmap v6195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:18.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:18 gibba013 bash[29418]: cluster 2021-03-10T17:19:17.490964+0000 mgr.gibba020.yqfnwy (mgr.34427) 10872 : cluster [DBG] pgmap v6196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:18.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:18 gibba013 bash[30381]: cluster 2021-03-10T17:19:17.490964+0000 mgr.gibba020.yqfnwy (mgr.34427) 10872 : cluster [DBG] pgmap v6196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:18.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:18 gibba020 bash[25448]: cluster 2021-03-10T17:19:17.490964+0000 mgr.gibba020.yqfnwy (mgr.34427) 10872 : cluster [DBG] pgmap v6196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:20.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:20 gibba013 bash[29418]: cluster 2021-03-10T17:19:19.492658+0000 mgr.gibba020.yqfnwy (mgr.34427) 10873 : cluster [DBG] pgmap v6197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:20.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:20 gibba013 bash[30381]: cluster 2021-03-10T17:19:19.492658+0000 mgr.gibba020.yqfnwy (mgr.34427) 10873 : cluster [DBG] pgmap v6197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:20.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:20 gibba020 bash[25448]: cluster 2021-03-10T17:19:19.492658+0000 mgr.gibba020.yqfnwy (mgr.34427) 10873 : cluster [DBG] pgmap v6197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:22.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:21 gibba013 bash[29418]: cephadm 2021-03-10T17:19:20.835616+0000 mgr.gibba020.yqfnwy (mgr.34427) 10874 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:19:22.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:21 gibba013 bash[29418]: cluster 2021-03-10T17:19:21.494654+0000 mgr.gibba020.yqfnwy (mgr.34427) 10875 : cluster [DBG] pgmap v6198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:22.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:21 gibba013 bash[30381]: cephadm 2021-03-10T17:19:20.835616+0000 mgr.gibba020.yqfnwy (mgr.34427) 10874 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:19:22.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:21 gibba013 bash[30381]: cluster 2021-03-10T17:19:21.494654+0000 mgr.gibba020.yqfnwy (mgr.34427) 10875 : cluster [DBG] pgmap v6198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:22.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:21 gibba020 bash[25448]: cephadm 2021-03-10T17:19:20.835616+0000 mgr.gibba020.yqfnwy (mgr.34427) 10874 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:19:22.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:21 gibba020 bash[25448]: cluster 2021-03-10T17:19:21.494654+0000 mgr.gibba020.yqfnwy (mgr.34427) 10875 : cluster [DBG] pgmap v6198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:24.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:24 gibba013 bash[29418]: cluster 2021-03-10T17:19:23.496125+0000 mgr.gibba020.yqfnwy (mgr.34427) 10876 : cluster [DBG] pgmap v6199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:24.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:24 gibba013 bash[30381]: cluster 2021-03-10T17:19:23.496125+0000 mgr.gibba020.yqfnwy (mgr.34427) 10876 : cluster [DBG] pgmap v6199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:24.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:24 gibba020 bash[25448]: cluster 2021-03-10T17:19:23.496125+0000 mgr.gibba020.yqfnwy (mgr.34427) 10876 : cluster [DBG] pgmap v6199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:26.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:26 gibba013 bash[29418]: cluster 2021-03-10T17:19:25.497789+0000 mgr.gibba020.yqfnwy (mgr.34427) 10877 : cluster [DBG] pgmap v6200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:26.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:26 gibba013 bash[30381]: cluster 2021-03-10T17:19:25.497789+0000 mgr.gibba020.yqfnwy (mgr.34427) 10877 : cluster [DBG] pgmap v6200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:26.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:26 gibba020 bash[25448]: cluster 2021-03-10T17:19:25.497789+0000 mgr.gibba020.yqfnwy (mgr.34427) 10877 : cluster [DBG] pgmap v6200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:28.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:28 gibba013 bash[29418]: cluster 2021-03-10T17:19:27.499517+0000 mgr.gibba020.yqfnwy (mgr.34427) 10878 : cluster [DBG] pgmap v6201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:28.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:28 gibba013 bash[30381]: cluster 2021-03-10T17:19:27.499517+0000 mgr.gibba020.yqfnwy (mgr.34427) 10878 : cluster [DBG] pgmap v6201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:28.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:28 gibba020 bash[25448]: cluster 2021-03-10T17:19:27.499517+0000 mgr.gibba020.yqfnwy (mgr.34427) 10878 : cluster [DBG] pgmap v6201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:30.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:30 gibba013 bash[29418]: cluster 2021-03-10T17:19:29.501072+0000 mgr.gibba020.yqfnwy (mgr.34427) 10879 : cluster [DBG] pgmap v6202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:30.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:30 gibba013 bash[30381]: cluster 2021-03-10T17:19:29.501072+0000 mgr.gibba020.yqfnwy (mgr.34427) 10879 : cluster [DBG] pgmap v6202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:30.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:30 gibba020 bash[25448]: cluster 2021-03-10T17:19:29.501072+0000 mgr.gibba020.yqfnwy (mgr.34427) 10879 : cluster [DBG] pgmap v6202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:32.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:31 gibba013 bash[29418]: cluster 2021-03-10T17:19:31.502875+0000 mgr.gibba020.yqfnwy (mgr.34427) 10880 : cluster [DBG] pgmap v6203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:32.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:31 gibba013 bash[30381]: cluster 2021-03-10T17:19:31.502875+0000 mgr.gibba020.yqfnwy (mgr.34427) 10880 : cluster [DBG] pgmap v6203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:32.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:31 gibba020 bash[25448]: cluster 2021-03-10T17:19:31.502875+0000 mgr.gibba020.yqfnwy (mgr.34427) 10880 : cluster [DBG] pgmap v6203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:34.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:34 gibba013 bash[29418]: cluster 2021-03-10T17:19:33.504327+0000 mgr.gibba020.yqfnwy (mgr.34427) 10881 : cluster [DBG] pgmap v6204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:34.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:34 gibba013 bash[30381]: cluster 2021-03-10T17:19:33.504327+0000 mgr.gibba020.yqfnwy (mgr.34427) 10881 : cluster [DBG] pgmap v6204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:34.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:34 gibba020 bash[25448]: cluster 2021-03-10T17:19:33.504327+0000 mgr.gibba020.yqfnwy (mgr.34427) 10881 : cluster [DBG] pgmap v6204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:36.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:36 gibba013 bash[29418]: cluster 2021-03-10T17:19:35.505790+0000 mgr.gibba020.yqfnwy (mgr.34427) 10882 : cluster [DBG] pgmap v6205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:36.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:36 gibba013 bash[29418]: audit 2021-03-10T17:19:35.852278+0000 mon.a (mon.0) 3847 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:19:36.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:36 gibba013 bash[29418]: audit 2021-03-10T17:19:36.064186+0000 mon.a (mon.0) 3848 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:19:36.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:36 gibba013 bash[29418]: audit 2021-03-10T17:19:36.067653+0000 mon.a (mon.0) 3849 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:19:36.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:36 gibba013 bash[29418]: audit 2021-03-10T17:19:36.069575+0000 mon.a (mon.0) 3850 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:36.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:36 gibba013 bash[29418]: audit 2021-03-10T17:19:36.073879+0000 mon.a (mon.0) 3851 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:36.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:36 gibba013 bash[29418]: audit 2021-03-10T17:19:36.077280+0000 mon.a (mon.0) 3852 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:36.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:36 gibba013 bash[29418]: audit 2021-03-10T17:19:36.084585+0000 mon.a (mon.0) 3853 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:36.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:36 gibba013 bash[29418]: audit 2021-03-10T17:19:36.089791+0000 mon.a (mon.0) 3854 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:36.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:36 gibba013 bash[30381]: cluster 2021-03-10T17:19:35.505790+0000 mgr.gibba020.yqfnwy (mgr.34427) 10882 : cluster [DBG] pgmap v6205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:36.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:36 gibba013 bash[30381]: audit 2021-03-10T17:19:35.852278+0000 mon.a (mon.0) 3847 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:19:36.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:36 gibba013 bash[30381]: audit 2021-03-10T17:19:36.064186+0000 mon.a (mon.0) 3848 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:19:36.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:36 gibba013 bash[30381]: audit 2021-03-10T17:19:36.067653+0000 mon.a (mon.0) 3849 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:19:36.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:36 gibba013 bash[30381]: audit 2021-03-10T17:19:36.069575+0000 mon.a (mon.0) 3850 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:36.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:36 gibba013 bash[30381]: audit 2021-03-10T17:19:36.073879+0000 mon.a (mon.0) 3851 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:36.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:36 gibba013 bash[30381]: audit 2021-03-10T17:19:36.077280+0000 mon.a (mon.0) 3852 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:36.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:36 gibba013 bash[30381]: audit 2021-03-10T17:19:36.084585+0000 mon.a (mon.0) 3853 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:36.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:36 gibba013 bash[30381]: audit 2021-03-10T17:19:36.089791+0000 mon.a (mon.0) 3854 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:36.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:36 gibba020 bash[25448]: cluster 2021-03-10T17:19:35.505790+0000 mgr.gibba020.yqfnwy (mgr.34427) 10882 : cluster [DBG] pgmap v6205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:36.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:36 gibba020 bash[25448]: audit 2021-03-10T17:19:35.852278+0000 mon.a (mon.0) 3847 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:19:36.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:36 gibba020 bash[25448]: audit 2021-03-10T17:19:36.064186+0000 mon.a (mon.0) 3848 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:19:36.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:36 gibba020 bash[25448]: audit 2021-03-10T17:19:36.067653+0000 mon.a (mon.0) 3849 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:19:36.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:36 gibba020 bash[25448]: audit 2021-03-10T17:19:36.069575+0000 mon.a (mon.0) 3850 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:36.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:36 gibba020 bash[25448]: audit 2021-03-10T17:19:36.073879+0000 mon.a (mon.0) 3851 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:36.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:36 gibba020 bash[25448]: audit 2021-03-10T17:19:36.077280+0000 mon.a (mon.0) 3852 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:36.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:36 gibba020 bash[25448]: audit 2021-03-10T17:19:36.084585+0000 mon.a (mon.0) 3853 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:36.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:36 gibba020 bash[25448]: audit 2021-03-10T17:19:36.089791+0000 mon.a (mon.0) 3854 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:37.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:37 gibba013 bash[29418]: cephadm 2021-03-10T17:19:35.853476+0000 mgr.gibba020.yqfnwy (mgr.34427) 10883 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:19:37.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:37 gibba013 bash[29418]: cephadm 2021-03-10T17:19:35.854083+0000 mgr.gibba020.yqfnwy (mgr.34427) 10884 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:19:37.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:37 gibba013 bash[29418]: cephadm 2021-03-10T17:19:36.066138+0000 mgr.gibba020.yqfnwy (mgr.34427) 10885 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:19:37.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:37 gibba013 bash[29418]: cephadm 2021-03-10T17:19:36.068602+0000 mgr.gibba020.yqfnwy (mgr.34427) 10886 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:19:37.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:37 gibba013 bash[29418]: cephadm 2021-03-10T17:19:36.071399+0000 mgr.gibba020.yqfnwy (mgr.34427) 10887 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:19:37.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:37 gibba013 bash[29418]: cephadm 2021-03-10T17:19:36.071907+0000 mgr.gibba020.yqfnwy (mgr.34427) 10888 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:19:37.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:37 gibba013 bash[29418]: cephadm 2021-03-10T17:19:36.075694+0000 mgr.gibba020.yqfnwy (mgr.34427) 10889 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:19:37.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:37 gibba013 bash[29418]: cephadm 2021-03-10T17:19:36.075902+0000 mgr.gibba020.yqfnwy (mgr.34427) 10890 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:19:37.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:37 gibba013 bash[29418]: cephadm 2021-03-10T17:19:36.078752+0000 mgr.gibba020.yqfnwy (mgr.34427) 10891 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:19:37.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:37 gibba013 bash[29418]: cephadm 2021-03-10T17:19:36.082068+0000 mgr.gibba020.yqfnwy (mgr.34427) 10892 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:19:37.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:37 gibba013 bash[29418]: cephadm 2021-03-10T17:19:36.082424+0000 mgr.gibba020.yqfnwy (mgr.34427) 10893 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:19:37.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:37 gibba013 bash[29418]: cephadm 2021-03-10T17:19:36.086175+0000 mgr.gibba020.yqfnwy (mgr.34427) 10894 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:19:37.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:37 gibba013 bash[29418]: cephadm 2021-03-10T17:19:36.088448+0000 mgr.gibba020.yqfnwy (mgr.34427) 10895 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:19:37.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:37 gibba013 bash[29418]: cephadm 2021-03-10T17:19:36.091263+0000 mgr.gibba020.yqfnwy (mgr.34427) 10896 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:19:37.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:37 gibba013 bash[29418]: cephadm 2021-03-10T17:19:36.091477+0000 mgr.gibba020.yqfnwy (mgr.34427) 10897 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:19:37.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:37 gibba013 bash[29418]: cephadm 2021-03-10T17:19:36.092334+0000 mgr.gibba020.yqfnwy (mgr.34427) 10898 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:19:37.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:37 gibba013 bash[30381]: cephadm 2021-03-10T17:19:35.853476+0000 mgr.gibba020.yqfnwy (mgr.34427) 10883 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:19:37.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:37 gibba013 bash[30381]: cephadm 2021-03-10T17:19:35.854083+0000 mgr.gibba020.yqfnwy (mgr.34427) 10884 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:19:37.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:37 gibba013 bash[30381]: cephadm 2021-03-10T17:19:36.066138+0000 mgr.gibba020.yqfnwy (mgr.34427) 10885 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:19:37.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:37 gibba013 bash[30381]: cephadm 2021-03-10T17:19:36.068602+0000 mgr.gibba020.yqfnwy (mgr.34427) 10886 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:19:37.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:37 gibba013 bash[30381]: cephadm 2021-03-10T17:19:36.071399+0000 mgr.gibba020.yqfnwy (mgr.34427) 10887 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:19:37.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:37 gibba013 bash[30381]: cephadm 2021-03-10T17:19:36.071907+0000 mgr.gibba020.yqfnwy (mgr.34427) 10888 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:19:37.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:37 gibba013 bash[30381]: cephadm 2021-03-10T17:19:36.075694+0000 mgr.gibba020.yqfnwy (mgr.34427) 10889 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:19:37.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:37 gibba013 bash[30381]: cephadm 2021-03-10T17:19:36.075902+0000 mgr.gibba020.yqfnwy (mgr.34427) 10890 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:19:37.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:37 gibba013 bash[30381]: cephadm 2021-03-10T17:19:36.078752+0000 mgr.gibba020.yqfnwy (mgr.34427) 10891 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:19:37.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:37 gibba013 bash[30381]: cephadm 2021-03-10T17:19:36.082068+0000 mgr.gibba020.yqfnwy (mgr.34427) 10892 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:19:37.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:37 gibba013 bash[30381]: cephadm 2021-03-10T17:19:36.082424+0000 mgr.gibba020.yqfnwy (mgr.34427) 10893 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:19:37.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:37 gibba013 bash[30381]: cephadm 2021-03-10T17:19:36.086175+0000 mgr.gibba020.yqfnwy (mgr.34427) 10894 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:19:37.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:37 gibba013 bash[30381]: cephadm 2021-03-10T17:19:36.088448+0000 mgr.gibba020.yqfnwy (mgr.34427) 10895 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:19:37.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:37 gibba013 bash[30381]: cephadm 2021-03-10T17:19:36.091263+0000 mgr.gibba020.yqfnwy (mgr.34427) 10896 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:19:37.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:37 gibba013 bash[30381]: cephadm 2021-03-10T17:19:36.091477+0000 mgr.gibba020.yqfnwy (mgr.34427) 10897 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:19:37.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:37 gibba013 bash[30381]: cephadm 2021-03-10T17:19:36.092334+0000 mgr.gibba020.yqfnwy (mgr.34427) 10898 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:19:37.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:37 gibba020 bash[25448]: cephadm 2021-03-10T17:19:35.853476+0000 mgr.gibba020.yqfnwy (mgr.34427) 10883 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:19:37.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:37 gibba020 bash[25448]: cephadm 2021-03-10T17:19:35.854083+0000 mgr.gibba020.yqfnwy (mgr.34427) 10884 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:19:37.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:37 gibba020 bash[25448]: cephadm 2021-03-10T17:19:36.066138+0000 mgr.gibba020.yqfnwy (mgr.34427) 10885 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:19:37.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:37 gibba020 bash[25448]: cephadm 2021-03-10T17:19:36.068602+0000 mgr.gibba020.yqfnwy (mgr.34427) 10886 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:19:37.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:37 gibba020 bash[25448]: cephadm 2021-03-10T17:19:36.071399+0000 mgr.gibba020.yqfnwy (mgr.34427) 10887 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:19:37.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:37 gibba020 bash[25448]: cephadm 2021-03-10T17:19:36.071907+0000 mgr.gibba020.yqfnwy (mgr.34427) 10888 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:19:37.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:37 gibba020 bash[25448]: cephadm 2021-03-10T17:19:36.075694+0000 mgr.gibba020.yqfnwy (mgr.34427) 10889 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:19:37.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:37 gibba020 bash[25448]: cephadm 2021-03-10T17:19:36.075902+0000 mgr.gibba020.yqfnwy (mgr.34427) 10890 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:19:37.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:37 gibba020 bash[25448]: cephadm 2021-03-10T17:19:36.078752+0000 mgr.gibba020.yqfnwy (mgr.34427) 10891 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:19:37.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:37 gibba020 bash[25448]: cephadm 2021-03-10T17:19:36.082068+0000 mgr.gibba020.yqfnwy (mgr.34427) 10892 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:19:37.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:37 gibba020 bash[25448]: cephadm 2021-03-10T17:19:36.082424+0000 mgr.gibba020.yqfnwy (mgr.34427) 10893 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:19:37.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:37 gibba020 bash[25448]: cephadm 2021-03-10T17:19:36.086175+0000 mgr.gibba020.yqfnwy (mgr.34427) 10894 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:19:37.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:37 gibba020 bash[25448]: cephadm 2021-03-10T17:19:36.088448+0000 mgr.gibba020.yqfnwy (mgr.34427) 10895 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:19:37.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:37 gibba020 bash[25448]: cephadm 2021-03-10T17:19:36.091263+0000 mgr.gibba020.yqfnwy (mgr.34427) 10896 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:19:37.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:37 gibba020 bash[25448]: cephadm 2021-03-10T17:19:36.091477+0000 mgr.gibba020.yqfnwy (mgr.34427) 10897 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:19:37.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:37 gibba020 bash[25448]: cephadm 2021-03-10T17:19:36.092334+0000 mgr.gibba020.yqfnwy (mgr.34427) 10898 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:19:38.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:38 gibba013 bash[29418]: cluster 2021-03-10T17:19:37.507131+0000 mgr.gibba020.yqfnwy (mgr.34427) 10899 : cluster [DBG] pgmap v6206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:38.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:38 gibba013 bash[30381]: cluster 2021-03-10T17:19:37.507131+0000 mgr.gibba020.yqfnwy (mgr.34427) 10899 : cluster [DBG] pgmap v6206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:38.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:38 gibba020 bash[25448]: cluster 2021-03-10T17:19:37.507131+0000 mgr.gibba020.yqfnwy (mgr.34427) 10899 : cluster [DBG] pgmap v6206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:40.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:40 gibba013 bash[29418]: cluster 2021-03-10T17:19:39.508397+0000 mgr.gibba020.yqfnwy (mgr.34427) 10900 : cluster [DBG] pgmap v6207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:40.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:40 gibba013 bash[30381]: cluster 2021-03-10T17:19:39.508397+0000 mgr.gibba020.yqfnwy (mgr.34427) 10900 : cluster [DBG] pgmap v6207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:40.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:40 gibba020 bash[25448]: cluster 2021-03-10T17:19:39.508397+0000 mgr.gibba020.yqfnwy (mgr.34427) 10900 : cluster [DBG] pgmap v6207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:42.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:41 gibba013 bash[29418]: cluster 2021-03-10T17:19:41.510077+0000 mgr.gibba020.yqfnwy (mgr.34427) 10901 : cluster [DBG] pgmap v6208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:42.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:41 gibba013 bash[30381]: cluster 2021-03-10T17:19:41.510077+0000 mgr.gibba020.yqfnwy (mgr.34427) 10901 : cluster [DBG] pgmap v6208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:42.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:41 gibba020 bash[25448]: cluster 2021-03-10T17:19:41.510077+0000 mgr.gibba020.yqfnwy (mgr.34427) 10901 : cluster [DBG] pgmap v6208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:44.621 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:19:44.847 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:19:44.848 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 8m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:19:44.848 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 7m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:19:44.848 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:19:44.849 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:19:44.849 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:19:44.849 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:19:44.849 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:19:44.849 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:19:44.850 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:19:44.850 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:19:44.850 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:19:44.850 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:19:44.851 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:19:44.851 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:19:44.851 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:19:44.851 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:19:44.851 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:19:44.852 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:19:44.852 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 7m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:19:44.852 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 7m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:19:44.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:44 gibba013 bash[29418]: cluster 2021-03-10T17:19:43.511453+0000 mgr.gibba020.yqfnwy (mgr.34427) 10902 : cluster [DBG] pgmap v6209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:44.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:44 gibba013 bash[30381]: cluster 2021-03-10T17:19:43.511453+0000 mgr.gibba020.yqfnwy (mgr.34427) 10902 : cluster [DBG] pgmap v6209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:44.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:44 gibba020 bash[25448]: cluster 2021-03-10T17:19:43.511453+0000 mgr.gibba020.yqfnwy (mgr.34427) 10902 : cluster [DBG] pgmap v6209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:45.104 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:19:45.105 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:19:45.105 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:19:45.105 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:19:45.106 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:19:45.106 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:19:45.106 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:19:45.106 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:19:45.107 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:19:45.107 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:19:45.107 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:19:45.107 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:19:45.108 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:19:45.108 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:19:45.108 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:19:45.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:45 gibba013 bash[29418]: audit 2021-03-10T17:19:44.610468+0000 mgr.gibba020.yqfnwy (mgr.34427) 10903 : audit [DBG] from='client.51360 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:19:45.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:45 gibba013 bash[29418]: audit 2021-03-10T17:19:45.103573+0000 mon.a (mon.0) 3855 : audit [DBG] from='client.? 172.21.2.113:0/4038583860' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:45.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:45 gibba013 bash[30381]: audit 2021-03-10T17:19:44.610468+0000 mgr.gibba020.yqfnwy (mgr.34427) 10903 : audit [DBG] from='client.51360 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:19:45.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:45 gibba013 bash[30381]: audit 2021-03-10T17:19:45.103573+0000 mon.a (mon.0) 3855 : audit [DBG] from='client.? 172.21.2.113:0/4038583860' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:45.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:45 gibba020 bash[25448]: audit 2021-03-10T17:19:44.610468+0000 mgr.gibba020.yqfnwy (mgr.34427) 10903 : audit [DBG] from='client.51360 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:19:45.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:45 gibba020 bash[25448]: audit 2021-03-10T17:19:45.103573+0000 mon.a (mon.0) 3855 : audit [DBG] from='client.? 172.21.2.113:0/4038583860' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:19:46.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:46 gibba013 bash[29418]: audit 2021-03-10T17:19:44.833666+0000 mgr.gibba020.yqfnwy (mgr.34427) 10904 : audit [DBG] from='client.61345 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:19:46.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:46 gibba013 bash[29418]: cluster 2021-03-10T17:19:45.513198+0000 mgr.gibba020.yqfnwy (mgr.34427) 10905 : cluster [DBG] pgmap v6210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:46.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:46 gibba013 bash[30381]: audit 2021-03-10T17:19:44.833666+0000 mgr.gibba020.yqfnwy (mgr.34427) 10904 : audit [DBG] from='client.61345 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:19:46.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:46 gibba013 bash[30381]: cluster 2021-03-10T17:19:45.513198+0000 mgr.gibba020.yqfnwy (mgr.34427) 10905 : cluster [DBG] pgmap v6210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:46.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:46 gibba020 bash[25448]: audit 2021-03-10T17:19:44.833666+0000 mgr.gibba020.yqfnwy (mgr.34427) 10904 : audit [DBG] from='client.61345 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:19:46.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:46 gibba020 bash[25448]: cluster 2021-03-10T17:19:45.513198+0000 mgr.gibba020.yqfnwy (mgr.34427) 10905 : cluster [DBG] pgmap v6210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:48.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:48 gibba013 bash[29418]: cluster 2021-03-10T17:19:47.514564+0000 mgr.gibba020.yqfnwy (mgr.34427) 10906 : cluster [DBG] pgmap v6211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:48.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:48 gibba013 bash[30381]: cluster 2021-03-10T17:19:47.514564+0000 mgr.gibba020.yqfnwy (mgr.34427) 10906 : cluster [DBG] pgmap v6211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:48.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:48 gibba020 bash[25448]: cluster 2021-03-10T17:19:47.514564+0000 mgr.gibba020.yqfnwy (mgr.34427) 10906 : cluster [DBG] pgmap v6211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:50.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:50 gibba013 bash[29418]: cluster 2021-03-10T17:19:49.516068+0000 mgr.gibba020.yqfnwy (mgr.34427) 10907 : cluster [DBG] pgmap v6212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:50.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:50 gibba013 bash[30381]: cluster 2021-03-10T17:19:49.516068+0000 mgr.gibba020.yqfnwy (mgr.34427) 10907 : cluster [DBG] pgmap v6212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:50.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:50 gibba020 bash[25448]: cluster 2021-03-10T17:19:49.516068+0000 mgr.gibba020.yqfnwy (mgr.34427) 10907 : cluster [DBG] pgmap v6212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:52.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:51 gibba013 bash[29418]: cephadm 2021-03-10T17:19:51.104725+0000 mgr.gibba020.yqfnwy (mgr.34427) 10908 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:19:52.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:51 gibba013 bash[29418]: cluster 2021-03-10T17:19:51.517846+0000 mgr.gibba020.yqfnwy (mgr.34427) 10909 : cluster [DBG] pgmap v6213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:52.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:51 gibba013 bash[30381]: cephadm 2021-03-10T17:19:51.104725+0000 mgr.gibba020.yqfnwy (mgr.34427) 10908 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:19:52.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:51 gibba013 bash[30381]: cluster 2021-03-10T17:19:51.517846+0000 mgr.gibba020.yqfnwy (mgr.34427) 10909 : cluster [DBG] pgmap v6213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:52.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:51 gibba020 bash[25448]: cephadm 2021-03-10T17:19:51.104725+0000 mgr.gibba020.yqfnwy (mgr.34427) 10908 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:19:52.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:51 gibba020 bash[25448]: cluster 2021-03-10T17:19:51.517846+0000 mgr.gibba020.yqfnwy (mgr.34427) 10909 : cluster [DBG] pgmap v6213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:54.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:54 gibba013 bash[29418]: cluster 2021-03-10T17:19:53.519204+0000 mgr.gibba020.yqfnwy (mgr.34427) 10910 : cluster [DBG] pgmap v6214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:54.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:54 gibba013 bash[30381]: cluster 2021-03-10T17:19:53.519204+0000 mgr.gibba020.yqfnwy (mgr.34427) 10910 : cluster [DBG] pgmap v6214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:54.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:54 gibba020 bash[25448]: cluster 2021-03-10T17:19:53.519204+0000 mgr.gibba020.yqfnwy (mgr.34427) 10910 : cluster [DBG] pgmap v6214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:56.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:56 gibba013 bash[29418]: cluster 2021-03-10T17:19:55.520795+0000 mgr.gibba020.yqfnwy (mgr.34427) 10911 : cluster [DBG] pgmap v6215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:56.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:56 gibba013 bash[30381]: cluster 2021-03-10T17:19:55.520795+0000 mgr.gibba020.yqfnwy (mgr.34427) 10911 : cluster [DBG] pgmap v6215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:56.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:56 gibba020 bash[25448]: cluster 2021-03-10T17:19:55.520795+0000 mgr.gibba020.yqfnwy (mgr.34427) 10911 : cluster [DBG] pgmap v6215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:58.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:19:58 gibba013 bash[29418]: cluster 2021-03-10T17:19:57.522274+0000 mgr.gibba020.yqfnwy (mgr.34427) 10912 : cluster [DBG] pgmap v6216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:58.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:19:58 gibba013 bash[30381]: cluster 2021-03-10T17:19:57.522274+0000 mgr.gibba020.yqfnwy (mgr.34427) 10912 : cluster [DBG] pgmap v6216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:19:58.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:19:58 gibba020 bash[25448]: cluster 2021-03-10T17:19:57.522274+0000 mgr.gibba020.yqfnwy (mgr.34427) 10912 : cluster [DBG] pgmap v6216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:00.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:00 gibba013 bash[29418]: debug 2021-03-10T17:19:59.995+0000 7fd718a82700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:20:00.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:00 gibba013 bash[29418]: cluster 2021-03-10T17:19:59.523810+0000 mgr.gibba020.yqfnwy (mgr.34427) 10913 : cluster [DBG] pgmap v6217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:00.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:00 gibba013 bash[29418]: cluster 2021-03-10T17:20:00.000304+0000 mon.a (mon.0) 3856 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:20:00.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:00 gibba013 bash[30381]: cluster 2021-03-10T17:19:59.523810+0000 mgr.gibba020.yqfnwy (mgr.34427) 10913 : cluster [DBG] pgmap v6217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:00.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:00 gibba013 bash[30381]: cluster 2021-03-10T17:20:00.000304+0000 mon.a (mon.0) 3856 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:20:00.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:00 gibba020 bash[25448]: cluster 2021-03-10T17:19:59.523810+0000 mgr.gibba020.yqfnwy (mgr.34427) 10913 : cluster [DBG] pgmap v6217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:00.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:00 gibba020 bash[25448]: cluster 2021-03-10T17:20:00.000304+0000 mon.a (mon.0) 3856 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:20:02.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:01 gibba013 bash[29418]: cluster 2021-03-10T17:20:01.525612+0000 mgr.gibba020.yqfnwy (mgr.34427) 10914 : cluster [DBG] pgmap v6218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:02.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:01 gibba013 bash[30381]: cluster 2021-03-10T17:20:01.525612+0000 mgr.gibba020.yqfnwy (mgr.34427) 10914 : cluster [DBG] pgmap v6218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:02.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:01 gibba020 bash[25448]: cluster 2021-03-10T17:20:01.525612+0000 mgr.gibba020.yqfnwy (mgr.34427) 10914 : cluster [DBG] pgmap v6218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:04.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:04 gibba013 bash[29418]: cluster 2021-03-10T17:20:03.527112+0000 mgr.gibba020.yqfnwy (mgr.34427) 10915 : cluster [DBG] pgmap v6219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:04.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:04 gibba013 bash[30381]: cluster 2021-03-10T17:20:03.527112+0000 mgr.gibba020.yqfnwy (mgr.34427) 10915 : cluster [DBG] pgmap v6219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:04.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:04 gibba020 bash[25448]: cluster 2021-03-10T17:20:03.527112+0000 mgr.gibba020.yqfnwy (mgr.34427) 10915 : cluster [DBG] pgmap v6219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:06.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:06 gibba013 bash[29418]: cluster 2021-03-10T17:20:05.528926+0000 mgr.gibba020.yqfnwy (mgr.34427) 10916 : cluster [DBG] pgmap v6220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:06.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:06 gibba013 bash[30381]: cluster 2021-03-10T17:20:05.528926+0000 mgr.gibba020.yqfnwy (mgr.34427) 10916 : cluster [DBG] pgmap v6220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:06.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:06 gibba020 bash[25448]: cluster 2021-03-10T17:20:05.528926+0000 mgr.gibba020.yqfnwy (mgr.34427) 10916 : cluster [DBG] pgmap v6220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:07.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:07 gibba013 bash[29418]: cephadm 2021-03-10T17:20:06.118014+0000 mgr.gibba020.yqfnwy (mgr.34427) 10917 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:20:07.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:07 gibba013 bash[29418]: audit 2021-03-10T17:20:06.959184+0000 mon.a (mon.0) 3857 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:20:07.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:07 gibba013 bash[29418]: audit 2021-03-10T17:20:07.186996+0000 mon.a (mon.0) 3858 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:20:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:07 gibba013 bash[30381]: cephadm 2021-03-10T17:20:06.118014+0000 mgr.gibba020.yqfnwy (mgr.34427) 10917 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:20:07.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:07 gibba013 bash[30381]: audit 2021-03-10T17:20:06.959184+0000 mon.a (mon.0) 3857 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:20:07.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:07 gibba013 bash[30381]: audit 2021-03-10T17:20:07.186996+0000 mon.a (mon.0) 3858 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:20:07.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:07 gibba020 bash[25448]: cephadm 2021-03-10T17:20:06.118014+0000 mgr.gibba020.yqfnwy (mgr.34427) 10917 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:20:07.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:07 gibba020 bash[25448]: audit 2021-03-10T17:20:06.959184+0000 mon.a (mon.0) 3857 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:20:07.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:07 gibba020 bash[25448]: audit 2021-03-10T17:20:07.186996+0000 mon.a (mon.0) 3858 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:20:08.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:08 gibba013 bash[29418]: cluster 2021-03-10T17:20:07.530355+0000 mgr.gibba020.yqfnwy (mgr.34427) 10918 : cluster [DBG] pgmap v6221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:08.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:08 gibba013 bash[29418]: audit 2021-03-10T17:20:07.610495+0000 mon.a (mon.0) 3859 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T17:20:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:08 gibba013 bash[29418]: audit 2021-03-10T17:20:07.610665+0000 mon.a (mon.0) 3860 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:20:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:08 gibba013 bash[29418]: audit 2021-03-10T17:20:07.610960+0000 mon.a (mon.0) 3861 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:20:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:08 gibba013 bash[29418]: audit 2021-03-10T17:20:07.611128+0000 mon.a (mon.0) 3862 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:20:08.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:08 gibba013 bash[30381]: cluster 2021-03-10T17:20:07.530355+0000 mgr.gibba020.yqfnwy (mgr.34427) 10918 : cluster [DBG] pgmap v6221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:08.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:08 gibba013 bash[30381]: audit 2021-03-10T17:20:07.610495+0000 mon.a (mon.0) 3859 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T17:20:08.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:08 gibba013 bash[30381]: audit 2021-03-10T17:20:07.610665+0000 mon.a (mon.0) 3860 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:20:08.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:08 gibba013 bash[30381]: audit 2021-03-10T17:20:07.610960+0000 mon.a (mon.0) 3861 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:20:08.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:08 gibba013 bash[30381]: audit 2021-03-10T17:20:07.611128+0000 mon.a (mon.0) 3862 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:20:08.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:08 gibba020 bash[25448]: cluster 2021-03-10T17:20:07.530355+0000 mgr.gibba020.yqfnwy (mgr.34427) 10918 : cluster [DBG] pgmap v6221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:08.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:08 gibba020 bash[25448]: audit 2021-03-10T17:20:07.610495+0000 mon.a (mon.0) 3859 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T17:20:08.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:08 gibba020 bash[25448]: audit 2021-03-10T17:20:07.610665+0000 mon.a (mon.0) 3860 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:20:08.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:08 gibba020 bash[25448]: audit 2021-03-10T17:20:07.610960+0000 mon.a (mon.0) 3861 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:20:08.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:08 gibba020 bash[25448]: audit 2021-03-10T17:20:07.611128+0000 mon.a (mon.0) 3862 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:20:10.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:10 gibba013 bash[29418]: cluster 2021-03-10T17:20:09.531904+0000 mgr.gibba020.yqfnwy (mgr.34427) 10919 : cluster [DBG] pgmap v6222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:10.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:10 gibba013 bash[30381]: cluster 2021-03-10T17:20:09.531904+0000 mgr.gibba020.yqfnwy (mgr.34427) 10919 : cluster [DBG] pgmap v6222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:10.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:10 gibba020 bash[25448]: cluster 2021-03-10T17:20:09.531904+0000 mgr.gibba020.yqfnwy (mgr.34427) 10919 : cluster [DBG] pgmap v6222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:12.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:11 gibba013 bash[29418]: cluster 2021-03-10T17:20:11.533636+0000 mgr.gibba020.yqfnwy (mgr.34427) 10920 : cluster [DBG] pgmap v6223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:12.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:11 gibba013 bash[30381]: cluster 2021-03-10T17:20:11.533636+0000 mgr.gibba020.yqfnwy (mgr.34427) 10920 : cluster [DBG] pgmap v6223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:12.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:11 gibba020 bash[25448]: cluster 2021-03-10T17:20:11.533636+0000 mgr.gibba020.yqfnwy (mgr.34427) 10920 : cluster [DBG] pgmap v6223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:14.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:14 gibba013 bash[29418]: cluster 2021-03-10T17:20:13.535024+0000 mgr.gibba020.yqfnwy (mgr.34427) 10921 : cluster [DBG] pgmap v6224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:14.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:14 gibba013 bash[30381]: cluster 2021-03-10T17:20:13.535024+0000 mgr.gibba020.yqfnwy (mgr.34427) 10921 : cluster [DBG] pgmap v6224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:14.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:14 gibba020 bash[25448]: cluster 2021-03-10T17:20:13.535024+0000 mgr.gibba020.yqfnwy (mgr.34427) 10921 : cluster [DBG] pgmap v6224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:15.344 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:20:15.574 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:20:15.576 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 8m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:20:15.576 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 7m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:20:15.576 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:20:15.576 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:20:15.577 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:20:15.577 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:20:15.577 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:20:15.577 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:20:15.578 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:20:15.578 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:20:15.578 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:20:15.578 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:20:15.579 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:20:15.579 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:20:15.579 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:20:15.579 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:20:15.580 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:20:15.580 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:20:15.580 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 7m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:20:15.580 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 7m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:20:15.824 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:20:15.824 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:20:15.824 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:20:15.824 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:20:15.825 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:20:15.825 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:20:15.825 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:20:15.825 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:20:15.826 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:20:15.826 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:20:15.826 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:20:15.826 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:20:15.826 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:20:15.827 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:20:15.827 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:20:16.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:16 gibba013 bash[29418]: audit 2021-03-10T17:20:15.333519+0000 mgr.gibba020.yqfnwy (mgr.34427) 10922 : audit [DBG] from='client.61357 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:20:16.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:16 gibba013 bash[29418]: cluster 2021-03-10T17:20:15.536803+0000 mgr.gibba020.yqfnwy (mgr.34427) 10923 : cluster [DBG] pgmap v6225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:16.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:16 gibba013 bash[29418]: audit 2021-03-10T17:20:15.560023+0000 mgr.gibba020.yqfnwy (mgr.34427) 10924 : audit [DBG] from='client.51384 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:20:16.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:16 gibba013 bash[29418]: audit 2021-03-10T17:20:15.822798+0000 mon.a (mon.0) 3863 : audit [DBG] from='client.? 172.21.2.113:0/3700509708' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:16.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:16 gibba013 bash[30381]: audit 2021-03-10T17:20:15.333519+0000 mgr.gibba020.yqfnwy (mgr.34427) 10922 : audit [DBG] from='client.61357 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:20:16.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:16 gibba013 bash[30381]: cluster 2021-03-10T17:20:15.536803+0000 mgr.gibba020.yqfnwy (mgr.34427) 10923 : cluster [DBG] pgmap v6225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:16.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:16 gibba013 bash[30381]: audit 2021-03-10T17:20:15.560023+0000 mgr.gibba020.yqfnwy (mgr.34427) 10924 : audit [DBG] from='client.51384 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:20:16.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:16 gibba013 bash[30381]: audit 2021-03-10T17:20:15.822798+0000 mon.a (mon.0) 3863 : audit [DBG] from='client.? 172.21.2.113:0/3700509708' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:16.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:16 gibba020 bash[25448]: audit 2021-03-10T17:20:15.333519+0000 mgr.gibba020.yqfnwy (mgr.34427) 10922 : audit [DBG] from='client.61357 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:20:16.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:16 gibba020 bash[25448]: cluster 2021-03-10T17:20:15.536803+0000 mgr.gibba020.yqfnwy (mgr.34427) 10923 : cluster [DBG] pgmap v6225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:16.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:16 gibba020 bash[25448]: audit 2021-03-10T17:20:15.560023+0000 mgr.gibba020.yqfnwy (mgr.34427) 10924 : audit [DBG] from='client.51384 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:20:16.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:16 gibba020 bash[25448]: audit 2021-03-10T17:20:15.822798+0000 mon.a (mon.0) 3863 : audit [DBG] from='client.? 172.21.2.113:0/3700509708' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:18.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:18 gibba013 bash[29418]: cluster 2021-03-10T17:20:17.538370+0000 mgr.gibba020.yqfnwy (mgr.34427) 10925 : cluster [DBG] pgmap v6226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:18.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:18 gibba013 bash[30381]: cluster 2021-03-10T17:20:17.538370+0000 mgr.gibba020.yqfnwy (mgr.34427) 10925 : cluster [DBG] pgmap v6226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:18.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:18 gibba020 bash[25448]: cluster 2021-03-10T17:20:17.538370+0000 mgr.gibba020.yqfnwy (mgr.34427) 10925 : cluster [DBG] pgmap v6226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:20.879 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:20 gibba013 bash[29418]: cluster 2021-03-10T17:20:19.539854+0000 mgr.gibba020.yqfnwy (mgr.34427) 10926 : cluster [DBG] pgmap v6227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:20.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:20 gibba013 bash[30381]: cluster 2021-03-10T17:20:19.539854+0000 mgr.gibba020.yqfnwy (mgr.34427) 10926 : cluster [DBG] pgmap v6227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:20.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:20 gibba020 bash[25448]: cluster 2021-03-10T17:20:19.539854+0000 mgr.gibba020.yqfnwy (mgr.34427) 10926 : cluster [DBG] pgmap v6227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:22.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:21 gibba013 bash[29418]: cephadm 2021-03-10T17:20:21.134174+0000 mgr.gibba020.yqfnwy (mgr.34427) 10927 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:20:22.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:21 gibba013 bash[29418]: cluster 2021-03-10T17:20:21.541746+0000 mgr.gibba020.yqfnwy (mgr.34427) 10928 : cluster [DBG] pgmap v6228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:22.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:21 gibba013 bash[30381]: cephadm 2021-03-10T17:20:21.134174+0000 mgr.gibba020.yqfnwy (mgr.34427) 10927 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:20:22.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:21 gibba013 bash[30381]: cluster 2021-03-10T17:20:21.541746+0000 mgr.gibba020.yqfnwy (mgr.34427) 10928 : cluster [DBG] pgmap v6228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:22.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:21 gibba020 bash[25448]: cephadm 2021-03-10T17:20:21.134174+0000 mgr.gibba020.yqfnwy (mgr.34427) 10927 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:20:22.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:21 gibba020 bash[25448]: cluster 2021-03-10T17:20:21.541746+0000 mgr.gibba020.yqfnwy (mgr.34427) 10928 : cluster [DBG] pgmap v6228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:24.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:24 gibba013 bash[29418]: cluster 2021-03-10T17:20:23.543184+0000 mgr.gibba020.yqfnwy (mgr.34427) 10929 : cluster [DBG] pgmap v6229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:24.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:24 gibba013 bash[30381]: cluster 2021-03-10T17:20:23.543184+0000 mgr.gibba020.yqfnwy (mgr.34427) 10929 : cluster [DBG] pgmap v6229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:24.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:24 gibba020 bash[25448]: cluster 2021-03-10T17:20:23.543184+0000 mgr.gibba020.yqfnwy (mgr.34427) 10929 : cluster [DBG] pgmap v6229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:26.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:26 gibba013 bash[29418]: cluster 2021-03-10T17:20:25.544833+0000 mgr.gibba020.yqfnwy (mgr.34427) 10930 : cluster [DBG] pgmap v6230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:26.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:26 gibba013 bash[30381]: cluster 2021-03-10T17:20:25.544833+0000 mgr.gibba020.yqfnwy (mgr.34427) 10930 : cluster [DBG] pgmap v6230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:26.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:26 gibba020 bash[25448]: cluster 2021-03-10T17:20:25.544833+0000 mgr.gibba020.yqfnwy (mgr.34427) 10930 : cluster [DBG] pgmap v6230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:28.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:28 gibba013 bash[29418]: cluster 2021-03-10T17:20:27.546346+0000 mgr.gibba020.yqfnwy (mgr.34427) 10931 : cluster [DBG] pgmap v6231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:28.880 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:28 gibba013 bash[30381]: cluster 2021-03-10T17:20:27.546346+0000 mgr.gibba020.yqfnwy (mgr.34427) 10931 : cluster [DBG] pgmap v6231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:28.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:28 gibba020 bash[25448]: cluster 2021-03-10T17:20:27.546346+0000 mgr.gibba020.yqfnwy (mgr.34427) 10931 : cluster [DBG] pgmap v6231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:30.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:30 gibba020 bash[25448]: cluster 2021-03-10T17:20:29.547884+0000 mgr.gibba020.yqfnwy (mgr.34427) 10932 : cluster [DBG] pgmap v6232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:31.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:30 gibba013 bash[29418]: cluster 2021-03-10T17:20:29.547884+0000 mgr.gibba020.yqfnwy (mgr.34427) 10932 : cluster [DBG] pgmap v6232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:31.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:30 gibba013 bash[30381]: cluster 2021-03-10T17:20:29.547884+0000 mgr.gibba020.yqfnwy (mgr.34427) 10932 : cluster [DBG] pgmap v6232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:32.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:31 gibba013 bash[29418]: cluster 2021-03-10T17:20:31.549564+0000 mgr.gibba020.yqfnwy (mgr.34427) 10933 : cluster [DBG] pgmap v6233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:32.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:31 gibba013 bash[30381]: cluster 2021-03-10T17:20:31.549564+0000 mgr.gibba020.yqfnwy (mgr.34427) 10933 : cluster [DBG] pgmap v6233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:32.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:31 gibba020 bash[25448]: cluster 2021-03-10T17:20:31.549564+0000 mgr.gibba020.yqfnwy (mgr.34427) 10933 : cluster [DBG] pgmap v6233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:34.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:34 gibba013 bash[29418]: cluster 2021-03-10T17:20:33.550983+0000 mgr.gibba020.yqfnwy (mgr.34427) 10934 : cluster [DBG] pgmap v6234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:34.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:34 gibba013 bash[30381]: cluster 2021-03-10T17:20:33.550983+0000 mgr.gibba020.yqfnwy (mgr.34427) 10934 : cluster [DBG] pgmap v6234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:34.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:34 gibba020 bash[25448]: cluster 2021-03-10T17:20:33.550983+0000 mgr.gibba020.yqfnwy (mgr.34427) 10934 : cluster [DBG] pgmap v6234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:36.890 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:36 gibba013 bash[29418]: cluster 2021-03-10T17:20:35.552702+0000 mgr.gibba020.yqfnwy (mgr.34427) 10935 : cluster [DBG] pgmap v6235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:36.890 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:36 gibba013 bash[29418]: audit 2021-03-10T17:20:36.151603+0000 mon.a (mon.0) 3864 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:20:36.891 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:36 gibba013 bash[29418]: audit 2021-03-10T17:20:36.158860+0000 mon.a (mon.0) 3865 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T17:20:36.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:36 gibba013 bash[30381]: cluster 2021-03-10T17:20:35.552702+0000 mgr.gibba020.yqfnwy (mgr.34427) 10935 : cluster [DBG] pgmap v6235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:36.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:36 gibba013 bash[30381]: audit 2021-03-10T17:20:36.151603+0000 mon.a (mon.0) 3864 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:20:36.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:36 gibba013 bash[30381]: audit 2021-03-10T17:20:36.158860+0000 mon.a (mon.0) 3865 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T17:20:36.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:36 gibba020 bash[25448]: cluster 2021-03-10T17:20:35.552702+0000 mgr.gibba020.yqfnwy (mgr.34427) 10935 : cluster [DBG] pgmap v6235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:36.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:36 gibba020 bash[25448]: audit 2021-03-10T17:20:36.151603+0000 mon.a (mon.0) 3864 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:20:36.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:36 gibba020 bash[25448]: audit 2021-03-10T17:20:36.158860+0000 mon.a (mon.0) 3865 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T17:20:37.859 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:37 gibba013 bash[29418]: cephadm 2021-03-10T17:20:36.157774+0000 mgr.gibba020.yqfnwy (mgr.34427) 10936 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:20:37.860 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:37 gibba013 bash[30381]: cephadm 2021-03-10T17:20:36.157774+0000 mgr.gibba020.yqfnwy (mgr.34427) 10936 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:20:37.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:37 gibba020 bash[25448]: cephadm 2021-03-10T17:20:36.157774+0000 mgr.gibba020.yqfnwy (mgr.34427) 10936 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:20:38.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:38 gibba013 bash[29418]: cluster 2021-03-10T17:20:37.553982+0000 mgr.gibba020.yqfnwy (mgr.34427) 10937 : cluster [DBG] pgmap v6236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:38.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:38 gibba020 bash[25448]: cluster 2021-03-10T17:20:37.553982+0000 mgr.gibba020.yqfnwy (mgr.34427) 10937 : cluster [DBG] pgmap v6236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:39.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:38 gibba013 bash[30381]: cluster 2021-03-10T17:20:37.553982+0000 mgr.gibba020.yqfnwy (mgr.34427) 10937 : cluster [DBG] pgmap v6236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:40.879 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:40 gibba013 bash[30381]: cluster 2021-03-10T17:20:39.555451+0000 mgr.gibba020.yqfnwy (mgr.34427) 10938 : cluster [DBG] pgmap v6237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:40.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:40 gibba013 bash[29418]: cluster 2021-03-10T17:20:39.555451+0000 mgr.gibba020.yqfnwy (mgr.34427) 10938 : cluster [DBG] pgmap v6237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:40.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:40 gibba020 bash[25448]: cluster 2021-03-10T17:20:39.555451+0000 mgr.gibba020.yqfnwy (mgr.34427) 10938 : cluster [DBG] pgmap v6237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:42.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[29418]: audit 2021-03-10T17:20:41.307448+0000 mon.a (mon.0) 3866 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:20:42.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[29418]: audit 2021-03-10T17:20:41.487400+0000 mon.a (mon.0) 3867 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:20:42.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[29418]: cephadm 2021-03-10T17:20:41.488501+0000 mgr.gibba020.yqfnwy (mgr.34427) 10939 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:20:42.138 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[29418]: cluster 2021-03-10T17:20:41.557323+0000 mgr.gibba020.yqfnwy (mgr.34427) 10940 : cluster [DBG] pgmap v6238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:42.138 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[29418]: audit 2021-03-10T17:20:41.682916+0000 mon.a (mon.0) 3868 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:20:42.139 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[29418]: cephadm 2021-03-10T17:20:41.688903+0000 mgr.gibba020.yqfnwy (mgr.34427) 10941 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:20:42.139 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[29418]: audit 2021-03-10T17:20:41.690105+0000 mon.a (mon.0) 3869 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:20:42.140 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[29418]: cephadm 2021-03-10T17:20:41.690662+0000 mgr.gibba020.yqfnwy (mgr.34427) 10942 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:20:42.140 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[29418]: audit 2021-03-10T17:20:41.691447+0000 mon.a (mon.0) 3870 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:42.141 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[29418]: cephadm 2021-03-10T17:20:41.691808+0000 mgr.gibba020.yqfnwy (mgr.34427) 10943 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:20:42.141 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[29418]: cephadm 2021-03-10T17:20:41.691848+0000 mgr.gibba020.yqfnwy (mgr.34427) 10944 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:20:42.141 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[29418]: audit 2021-03-10T17:20:41.692711+0000 mon.a (mon.0) 3871 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:42.142 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[29418]: cephadm 2021-03-10T17:20:41.693097+0000 mgr.gibba020.yqfnwy (mgr.34427) 10945 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:20:42.142 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[29418]: cephadm 2021-03-10T17:20:41.693137+0000 mgr.gibba020.yqfnwy (mgr.34427) 10946 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:20:42.143 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[29418]: audit 2021-03-10T17:20:41.693852+0000 mon.a (mon.0) 3872 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:42.143 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[29418]: cephadm 2021-03-10T17:20:41.694187+0000 mgr.gibba020.yqfnwy (mgr.34427) 10947 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:20:42.144 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[29418]: cephadm 2021-03-10T17:20:41.695182+0000 mgr.gibba020.yqfnwy (mgr.34427) 10948 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:20:42.144 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[29418]: cephadm 2021-03-10T17:20:41.695224+0000 mgr.gibba020.yqfnwy (mgr.34427) 10949 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:20:42.144 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[29418]: audit 2021-03-10T17:20:41.696123+0000 mon.a (mon.0) 3873 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:42.145 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[29418]: cephadm 2021-03-10T17:20:41.696649+0000 mgr.gibba020.yqfnwy (mgr.34427) 10950 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:20:42.146 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[30381]: audit 2021-03-10T17:20:41.307448+0000 mon.a (mon.0) 3866 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:20:42.146 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[30381]: audit 2021-03-10T17:20:41.487400+0000 mon.a (mon.0) 3867 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:20:42.147 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[30381]: cephadm 2021-03-10T17:20:41.488501+0000 mgr.gibba020.yqfnwy (mgr.34427) 10939 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:20:42.147 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[30381]: cluster 2021-03-10T17:20:41.557323+0000 mgr.gibba020.yqfnwy (mgr.34427) 10940 : cluster [DBG] pgmap v6238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:42.148 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[30381]: audit 2021-03-10T17:20:41.682916+0000 mon.a (mon.0) 3868 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:20:42.148 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[30381]: cephadm 2021-03-10T17:20:41.688903+0000 mgr.gibba020.yqfnwy (mgr.34427) 10941 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:20:42.148 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[30381]: audit 2021-03-10T17:20:41.690105+0000 mon.a (mon.0) 3869 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:20:42.149 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[30381]: cephadm 2021-03-10T17:20:41.690662+0000 mgr.gibba020.yqfnwy (mgr.34427) 10942 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:20:42.149 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[30381]: audit 2021-03-10T17:20:41.691447+0000 mon.a (mon.0) 3870 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:42.149 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[30381]: cephadm 2021-03-10T17:20:41.691808+0000 mgr.gibba020.yqfnwy (mgr.34427) 10943 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:20:42.149 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[30381]: cephadm 2021-03-10T17:20:41.691848+0000 mgr.gibba020.yqfnwy (mgr.34427) 10944 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:20:42.150 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[30381]: audit 2021-03-10T17:20:41.692711+0000 mon.a (mon.0) 3871 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:42.151 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[30381]: cephadm 2021-03-10T17:20:41.693097+0000 mgr.gibba020.yqfnwy (mgr.34427) 10945 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:20:42.151 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[30381]: cephadm 2021-03-10T17:20:41.693137+0000 mgr.gibba020.yqfnwy (mgr.34427) 10946 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:20:42.151 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[30381]: audit 2021-03-10T17:20:41.693852+0000 mon.a (mon.0) 3872 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:42.152 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[30381]: cephadm 2021-03-10T17:20:41.694187+0000 mgr.gibba020.yqfnwy (mgr.34427) 10947 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:20:42.152 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[30381]: cephadm 2021-03-10T17:20:41.695182+0000 mgr.gibba020.yqfnwy (mgr.34427) 10948 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:20:42.153 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[30381]: cephadm 2021-03-10T17:20:41.695224+0000 mgr.gibba020.yqfnwy (mgr.34427) 10949 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:20:42.153 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[30381]: audit 2021-03-10T17:20:41.696123+0000 mon.a (mon.0) 3873 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:42.153 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[30381]: cephadm 2021-03-10T17:20:41.696649+0000 mgr.gibba020.yqfnwy (mgr.34427) 10950 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:20:42.155 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[29418]: cephadm 2021-03-10T17:20:41.697004+0000 mgr.gibba020.yqfnwy (mgr.34427) 10951 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:20:42.155 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[29418]: audit 2021-03-10T17:20:41.697709+0000 mon.a (mon.0) 3874 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:42.155 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[29418]: cephadm 2021-03-10T17:20:41.698301+0000 mgr.gibba020.yqfnwy (mgr.34427) 10952 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:20:42.156 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[29418]: cephadm 2021-03-10T17:20:41.698346+0000 mgr.gibba020.yqfnwy (mgr.34427) 10953 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:20:42.157 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[29418]: cephadm 2021-03-10T17:20:41.698471+0000 mgr.gibba020.yqfnwy (mgr.34427) 10954 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:20:42.157 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[30381]: cephadm 2021-03-10T17:20:41.697004+0000 mgr.gibba020.yqfnwy (mgr.34427) 10951 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:20:42.158 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[30381]: audit 2021-03-10T17:20:41.697709+0000 mon.a (mon.0) 3874 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:42.158 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[30381]: cephadm 2021-03-10T17:20:41.698301+0000 mgr.gibba020.yqfnwy (mgr.34427) 10952 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:20:42.159 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[30381]: cephadm 2021-03-10T17:20:41.698346+0000 mgr.gibba020.yqfnwy (mgr.34427) 10953 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:20:42.159 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:41 gibba013 bash[30381]: cephadm 2021-03-10T17:20:41.698471+0000 mgr.gibba020.yqfnwy (mgr.34427) 10954 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:20:42.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:41 gibba020 bash[25448]: audit 2021-03-10T17:20:41.307448+0000 mon.a (mon.0) 3866 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:20:42.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:41 gibba020 bash[25448]: audit 2021-03-10T17:20:41.487400+0000 mon.a (mon.0) 3867 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:20:42.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:41 gibba020 bash[25448]: cephadm 2021-03-10T17:20:41.488501+0000 mgr.gibba020.yqfnwy (mgr.34427) 10939 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:20:42.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:41 gibba020 bash[25448]: cluster 2021-03-10T17:20:41.557323+0000 mgr.gibba020.yqfnwy (mgr.34427) 10940 : cluster [DBG] pgmap v6238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:42.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:41 gibba020 bash[25448]: audit 2021-03-10T17:20:41.682916+0000 mon.a (mon.0) 3868 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:20:42.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:41 gibba020 bash[25448]: cephadm 2021-03-10T17:20:41.688903+0000 mgr.gibba020.yqfnwy (mgr.34427) 10941 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:20:42.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:41 gibba020 bash[25448]: audit 2021-03-10T17:20:41.690105+0000 mon.a (mon.0) 3869 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:20:42.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:41 gibba020 bash[25448]: cephadm 2021-03-10T17:20:41.690662+0000 mgr.gibba020.yqfnwy (mgr.34427) 10942 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:20:42.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:41 gibba020 bash[25448]: audit 2021-03-10T17:20:41.691447+0000 mon.a (mon.0) 3870 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:42.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:41 gibba020 bash[25448]: cephadm 2021-03-10T17:20:41.691808+0000 mgr.gibba020.yqfnwy (mgr.34427) 10943 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:20:42.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:41 gibba020 bash[25448]: cephadm 2021-03-10T17:20:41.691848+0000 mgr.gibba020.yqfnwy (mgr.34427) 10944 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:20:42.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:41 gibba020 bash[25448]: audit 2021-03-10T17:20:41.692711+0000 mon.a (mon.0) 3871 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:42.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:41 gibba020 bash[25448]: cephadm 2021-03-10T17:20:41.693097+0000 mgr.gibba020.yqfnwy (mgr.34427) 10945 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:20:42.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:41 gibba020 bash[25448]: cephadm 2021-03-10T17:20:41.693137+0000 mgr.gibba020.yqfnwy (mgr.34427) 10946 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:20:42.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:41 gibba020 bash[25448]: audit 2021-03-10T17:20:41.693852+0000 mon.a (mon.0) 3872 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:42.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:41 gibba020 bash[25448]: cephadm 2021-03-10T17:20:41.694187+0000 mgr.gibba020.yqfnwy (mgr.34427) 10947 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:20:42.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:41 gibba020 bash[25448]: cephadm 2021-03-10T17:20:41.695182+0000 mgr.gibba020.yqfnwy (mgr.34427) 10948 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:20:42.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:41 gibba020 bash[25448]: cephadm 2021-03-10T17:20:41.695224+0000 mgr.gibba020.yqfnwy (mgr.34427) 10949 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:20:42.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:41 gibba020 bash[25448]: audit 2021-03-10T17:20:41.696123+0000 mon.a (mon.0) 3873 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:42.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:41 gibba020 bash[25448]: cephadm 2021-03-10T17:20:41.696649+0000 mgr.gibba020.yqfnwy (mgr.34427) 10950 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:20:42.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:41 gibba020 bash[25448]: cephadm 2021-03-10T17:20:41.697004+0000 mgr.gibba020.yqfnwy (mgr.34427) 10951 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:20:42.206 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:41 gibba020 bash[25448]: audit 2021-03-10T17:20:41.697709+0000 mon.a (mon.0) 3874 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:42.206 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:41 gibba020 bash[25448]: cephadm 2021-03-10T17:20:41.698301+0000 mgr.gibba020.yqfnwy (mgr.34427) 10952 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:20:42.207 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:41 gibba020 bash[25448]: cephadm 2021-03-10T17:20:41.698346+0000 mgr.gibba020.yqfnwy (mgr.34427) 10953 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:20:42.207 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:41 gibba020 bash[25448]: cephadm 2021-03-10T17:20:41.698471+0000 mgr.gibba020.yqfnwy (mgr.34427) 10954 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:20:44.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:44 gibba013 bash[29418]: cluster 2021-03-10T17:20:43.558811+0000 mgr.gibba020.yqfnwy (mgr.34427) 10955 : cluster [DBG] pgmap v6239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:44.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:44 gibba013 bash[30381]: cluster 2021-03-10T17:20:43.558811+0000 mgr.gibba020.yqfnwy (mgr.34427) 10955 : cluster [DBG] pgmap v6239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:44.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:44 gibba020 bash[25448]: cluster 2021-03-10T17:20:43.558811+0000 mgr.gibba020.yqfnwy (mgr.34427) 10955 : cluster [DBG] pgmap v6239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:46.069 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:20:46.298 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:20:46.298 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 9m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:20:46.298 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 8m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:20:46.299 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:20:46.299 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:20:46.299 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:20:46.299 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:20:46.300 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:20:46.300 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:20:46.300 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:20:46.300 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:20:46.301 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:20:46.301 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:20:46.301 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:20:46.301 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:20:46.302 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:20:46.302 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:20:46.302 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:20:46.302 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:20:46.303 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 8m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:20:46.303 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 8m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:20:46.548 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:20:46.549 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:20:46.549 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:20:46.550 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:20:46.550 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:20:46.550 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:20:46.551 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:20:46.551 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:20:46.551 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:20:46.552 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:20:46.552 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:20:46.553 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:20:46.554 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:20:46.554 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:20:46.554 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:20:46.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:46 gibba020 bash[25448]: cluster 2021-03-10T17:20:45.560498+0000 mgr.gibba020.yqfnwy (mgr.34427) 10956 : cluster [DBG] pgmap v6240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:46.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:46 gibba020 bash[25448]: audit 2021-03-10T17:20:46.547746+0000 mon.c (mon.1) 164 : audit [DBG] from='client.? 172.21.2.113:0/2317826724' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:47.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:46 gibba013 bash[30381]: cluster 2021-03-10T17:20:45.560498+0000 mgr.gibba020.yqfnwy (mgr.34427) 10956 : cluster [DBG] pgmap v6240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:47.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:46 gibba013 bash[30381]: audit 2021-03-10T17:20:46.547746+0000 mon.c (mon.1) 164 : audit [DBG] from='client.? 172.21.2.113:0/2317826724' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:47.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:46 gibba013 bash[29418]: cluster 2021-03-10T17:20:45.560498+0000 mgr.gibba020.yqfnwy (mgr.34427) 10956 : cluster [DBG] pgmap v6240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:47.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:46 gibba013 bash[29418]: audit 2021-03-10T17:20:46.547746+0000 mon.c (mon.1) 164 : audit [DBG] from='client.? 172.21.2.113:0/2317826724' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:20:47.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:47 gibba020 bash[25448]: audit 2021-03-10T17:20:46.059059+0000 mgr.gibba020.yqfnwy (mgr.34427) 10957 : audit [DBG] from='client.51396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:20:47.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:47 gibba020 bash[25448]: audit 2021-03-10T17:20:46.284403+0000 mgr.gibba020.yqfnwy (mgr.34427) 10958 : audit [DBG] from='client.61381 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:20:48.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:47 gibba013 bash[29418]: audit 2021-03-10T17:20:46.059059+0000 mgr.gibba020.yqfnwy (mgr.34427) 10957 : audit [DBG] from='client.51396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:20:48.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:47 gibba013 bash[29418]: audit 2021-03-10T17:20:46.284403+0000 mgr.gibba020.yqfnwy (mgr.34427) 10958 : audit [DBG] from='client.61381 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:20:48.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:47 gibba013 bash[30381]: audit 2021-03-10T17:20:46.059059+0000 mgr.gibba020.yqfnwy (mgr.34427) 10957 : audit [DBG] from='client.51396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:20:48.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:47 gibba013 bash[30381]: audit 2021-03-10T17:20:46.284403+0000 mgr.gibba020.yqfnwy (mgr.34427) 10958 : audit [DBG] from='client.61381 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:20:48.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:48 gibba020 bash[25448]: cluster 2021-03-10T17:20:47.562026+0000 mgr.gibba020.yqfnwy (mgr.34427) 10959 : cluster [DBG] pgmap v6241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:49.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:48 gibba013 bash[29418]: cluster 2021-03-10T17:20:47.562026+0000 mgr.gibba020.yqfnwy (mgr.34427) 10959 : cluster [DBG] pgmap v6241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:49.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:48 gibba013 bash[30381]: cluster 2021-03-10T17:20:47.562026+0000 mgr.gibba020.yqfnwy (mgr.34427) 10959 : cluster [DBG] pgmap v6241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:50.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:50 gibba020 bash[25448]: cluster 2021-03-10T17:20:49.563424+0000 mgr.gibba020.yqfnwy (mgr.34427) 10960 : cluster [DBG] pgmap v6242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:51.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:50 gibba013 bash[29418]: cluster 2021-03-10T17:20:49.563424+0000 mgr.gibba020.yqfnwy (mgr.34427) 10960 : cluster [DBG] pgmap v6242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:51.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:50 gibba013 bash[30381]: cluster 2021-03-10T17:20:49.563424+0000 mgr.gibba020.yqfnwy (mgr.34427) 10960 : cluster [DBG] pgmap v6242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:52.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:51 gibba013 bash[29418]: cluster 2021-03-10T17:20:51.565295+0000 mgr.gibba020.yqfnwy (mgr.34427) 10961 : cluster [DBG] pgmap v6243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:52.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:51 gibba013 bash[30381]: cluster 2021-03-10T17:20:51.565295+0000 mgr.gibba020.yqfnwy (mgr.34427) 10961 : cluster [DBG] pgmap v6243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:52.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:51 gibba020 bash[25448]: cluster 2021-03-10T17:20:51.565295+0000 mgr.gibba020.yqfnwy (mgr.34427) 10961 : cluster [DBG] pgmap v6243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:54.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:54 gibba013 bash[29418]: cluster 2021-03-10T17:20:53.566720+0000 mgr.gibba020.yqfnwy (mgr.34427) 10962 : cluster [DBG] pgmap v6244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:54.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:54 gibba013 bash[30381]: cluster 2021-03-10T17:20:53.566720+0000 mgr.gibba020.yqfnwy (mgr.34427) 10962 : cluster [DBG] pgmap v6244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:54.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:54 gibba020 bash[25448]: cluster 2021-03-10T17:20:53.566720+0000 mgr.gibba020.yqfnwy (mgr.34427) 10962 : cluster [DBG] pgmap v6244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:56.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:56 gibba020 bash[25448]: cluster 2021-03-10T17:20:55.568491+0000 mgr.gibba020.yqfnwy (mgr.34427) 10963 : cluster [DBG] pgmap v6245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:57.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:56 gibba013 bash[29418]: cluster 2021-03-10T17:20:55.568491+0000 mgr.gibba020.yqfnwy (mgr.34427) 10963 : cluster [DBG] pgmap v6245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:57.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:56 gibba013 bash[30381]: cluster 2021-03-10T17:20:55.568491+0000 mgr.gibba020.yqfnwy (mgr.34427) 10963 : cluster [DBG] pgmap v6245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:57.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:57 gibba020 bash[25448]: cephadm 2021-03-10T17:20:56.708322+0000 mgr.gibba020.yqfnwy (mgr.34427) 10964 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:20:58.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:57 gibba013 bash[29418]: cephadm 2021-03-10T17:20:56.708322+0000 mgr.gibba020.yqfnwy (mgr.34427) 10964 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:20:58.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:57 gibba013 bash[30381]: cephadm 2021-03-10T17:20:56.708322+0000 mgr.gibba020.yqfnwy (mgr.34427) 10964 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:20:58.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:20:58 gibba020 bash[25448]: cluster 2021-03-10T17:20:57.569774+0000 mgr.gibba020.yqfnwy (mgr.34427) 10965 : cluster [DBG] pgmap v6246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:59.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:20:58 gibba013 bash[29418]: cluster 2021-03-10T17:20:57.569774+0000 mgr.gibba020.yqfnwy (mgr.34427) 10965 : cluster [DBG] pgmap v6246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:20:59.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:20:58 gibba013 bash[30381]: cluster 2021-03-10T17:20:57.569774+0000 mgr.gibba020.yqfnwy (mgr.34427) 10965 : cluster [DBG] pgmap v6246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:00.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:00 gibba020 bash[25448]: cluster 2021-03-10T17:20:59.571310+0000 mgr.gibba020.yqfnwy (mgr.34427) 10966 : cluster [DBG] pgmap v6247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:01.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:00 gibba013 bash[29418]: cluster 2021-03-10T17:20:59.571310+0000 mgr.gibba020.yqfnwy (mgr.34427) 10966 : cluster [DBG] pgmap v6247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:01.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:00 gibba013 bash[30381]: cluster 2021-03-10T17:20:59.571310+0000 mgr.gibba020.yqfnwy (mgr.34427) 10966 : cluster [DBG] pgmap v6247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:02.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:01 gibba013 bash[29418]: cluster 2021-03-10T17:21:01.573170+0000 mgr.gibba020.yqfnwy (mgr.34427) 10967 : cluster [DBG] pgmap v6248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:02.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:01 gibba013 bash[30381]: cluster 2021-03-10T17:21:01.573170+0000 mgr.gibba020.yqfnwy (mgr.34427) 10967 : cluster [DBG] pgmap v6248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:02.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:01 gibba020 bash[25448]: cluster 2021-03-10T17:21:01.573170+0000 mgr.gibba020.yqfnwy (mgr.34427) 10967 : cluster [DBG] pgmap v6248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:04.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:04 gibba020 bash[25448]: cluster 2021-03-10T17:21:03.574560+0000 mgr.gibba020.yqfnwy (mgr.34427) 10968 : cluster [DBG] pgmap v6249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:05.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:04 gibba013 bash[29418]: cluster 2021-03-10T17:21:03.574560+0000 mgr.gibba020.yqfnwy (mgr.34427) 10968 : cluster [DBG] pgmap v6249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:05.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:04 gibba013 bash[30381]: cluster 2021-03-10T17:21:03.574560+0000 mgr.gibba020.yqfnwy (mgr.34427) 10968 : cluster [DBG] pgmap v6249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:06.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:06 gibba020 bash[25448]: cluster 2021-03-10T17:21:05.576353+0000 mgr.gibba020.yqfnwy (mgr.34427) 10969 : cluster [DBG] pgmap v6250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:07.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:06 gibba013 bash[29418]: cluster 2021-03-10T17:21:05.576353+0000 mgr.gibba020.yqfnwy (mgr.34427) 10969 : cluster [DBG] pgmap v6250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:07.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:06 gibba013 bash[30381]: cluster 2021-03-10T17:21:05.576353+0000 mgr.gibba020.yqfnwy (mgr.34427) 10969 : cluster [DBG] pgmap v6250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:07.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:07 gibba020 bash[25448]: audit 2021-03-10T17:21:06.964038+0000 mon.a (mon.0) 3875 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:21:07.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:07 gibba020 bash[25448]: audit 2021-03-10T17:21:07.193642+0000 mon.a (mon.0) 3876 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:21:07.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:07 gibba020 bash[25448]: audit 2021-03-10T17:21:07.618101+0000 mon.a (mon.0) 3877 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T17:21:07.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:07 gibba020 bash[25448]: audit 2021-03-10T17:21:07.618812+0000 mon.a (mon.0) 3878 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:21:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:07 gibba020 bash[25448]: audit 2021-03-10T17:21:07.619506+0000 mon.a (mon.0) 3879 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T17:21:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:07 gibba020 bash[25448]: audit 2021-03-10T17:21:07.620149+0000 mon.a (mon.0) 3880 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:21:08.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:07 gibba013 bash[29418]: audit 2021-03-10T17:21:06.964038+0000 mon.a (mon.0) 3875 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:21:08.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:07 gibba013 bash[29418]: audit 2021-03-10T17:21:07.193642+0000 mon.a (mon.0) 3876 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:21:08.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:07 gibba013 bash[29418]: audit 2021-03-10T17:21:07.618101+0000 mon.a (mon.0) 3877 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T17:21:08.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:07 gibba013 bash[29418]: audit 2021-03-10T17:21:07.618812+0000 mon.a (mon.0) 3878 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:21:08.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:07 gibba013 bash[29418]: audit 2021-03-10T17:21:07.619506+0000 mon.a (mon.0) 3879 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T17:21:08.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:07 gibba013 bash[29418]: audit 2021-03-10T17:21:07.620149+0000 mon.a (mon.0) 3880 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:21:08.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:07 gibba013 bash[30381]: audit 2021-03-10T17:21:06.964038+0000 mon.a (mon.0) 3875 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:21:08.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:07 gibba013 bash[30381]: audit 2021-03-10T17:21:07.193642+0000 mon.a (mon.0) 3876 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:21:08.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:07 gibba013 bash[30381]: audit 2021-03-10T17:21:07.618101+0000 mon.a (mon.0) 3877 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T17:21:08.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:07 gibba013 bash[30381]: audit 2021-03-10T17:21:07.618812+0000 mon.a (mon.0) 3878 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:21:08.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:07 gibba013 bash[30381]: audit 2021-03-10T17:21:07.619506+0000 mon.a (mon.0) 3879 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T17:21:08.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:07 gibba013 bash[30381]: audit 2021-03-10T17:21:07.620149+0000 mon.a (mon.0) 3880 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:21:08.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:08 gibba020 bash[25448]: cluster 2021-03-10T17:21:07.577641+0000 mgr.gibba020.yqfnwy (mgr.34427) 10970 : cluster [DBG] pgmap v6251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:09.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:08 gibba013 bash[29418]: cluster 2021-03-10T17:21:07.577641+0000 mgr.gibba020.yqfnwy (mgr.34427) 10970 : cluster [DBG] pgmap v6251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:09.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:08 gibba013 bash[30381]: cluster 2021-03-10T17:21:07.577641+0000 mgr.gibba020.yqfnwy (mgr.34427) 10970 : cluster [DBG] pgmap v6251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:10.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:10 gibba020 bash[25448]: cluster 2021-03-10T17:21:09.578816+0000 mgr.gibba020.yqfnwy (mgr.34427) 10971 : cluster [DBG] pgmap v6252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:11.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:10 gibba013 bash[29418]: cluster 2021-03-10T17:21:09.578816+0000 mgr.gibba020.yqfnwy (mgr.34427) 10971 : cluster [DBG] pgmap v6252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:11.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:10 gibba013 bash[30381]: cluster 2021-03-10T17:21:09.578816+0000 mgr.gibba020.yqfnwy (mgr.34427) 10971 : cluster [DBG] pgmap v6252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:12.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:11 gibba013 bash[29418]: cluster 2021-03-10T17:21:11.580372+0000 mgr.gibba020.yqfnwy (mgr.34427) 10972 : cluster [DBG] pgmap v6253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:12.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:11 gibba013 bash[29418]: cephadm 2021-03-10T17:21:11.724453+0000 mgr.gibba020.yqfnwy (mgr.34427) 10973 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:21:12.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:11 gibba013 bash[30381]: cluster 2021-03-10T17:21:11.580372+0000 mgr.gibba020.yqfnwy (mgr.34427) 10972 : cluster [DBG] pgmap v6253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:12.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:11 gibba013 bash[30381]: cephadm 2021-03-10T17:21:11.724453+0000 mgr.gibba020.yqfnwy (mgr.34427) 10973 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:21:12.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:11 gibba020 bash[25448]: cluster 2021-03-10T17:21:11.580372+0000 mgr.gibba020.yqfnwy (mgr.34427) 10972 : cluster [DBG] pgmap v6253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:12.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:11 gibba020 bash[25448]: cephadm 2021-03-10T17:21:11.724453+0000 mgr.gibba020.yqfnwy (mgr.34427) 10973 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:21:14.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:14 gibba020 bash[25448]: cluster 2021-03-10T17:21:13.581878+0000 mgr.gibba020.yqfnwy (mgr.34427) 10974 : cluster [DBG] pgmap v6254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:15.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:14 gibba013 bash[29418]: cluster 2021-03-10T17:21:13.581878+0000 mgr.gibba020.yqfnwy (mgr.34427) 10974 : cluster [DBG] pgmap v6254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:15.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:14 gibba013 bash[30381]: cluster 2021-03-10T17:21:13.581878+0000 mgr.gibba020.yqfnwy (mgr.34427) 10974 : cluster [DBG] pgmap v6254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:16.802 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:21:16.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:16 gibba020 bash[25448]: cluster 2021-03-10T17:21:15.583312+0000 mgr.gibba020.yqfnwy (mgr.34427) 10975 : cluster [DBG] pgmap v6255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:17.027 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:21:17.028 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 9m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:21:17.028 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 8m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:21:17.028 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:21:17.028 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:21:17.029 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:21:17.029 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:21:17.029 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:21:17.029 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:21:17.030 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:21:17.030 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:21:17.030 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:21:17.030 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:21:17.030 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:21:17.031 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:21:17.031 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:21:17.031 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:21:17.031 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:21:17.032 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:21:17.032 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 8m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:21:17.032 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 8m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:21:17.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:16 gibba013 bash[29418]: cluster 2021-03-10T17:21:15.583312+0000 mgr.gibba020.yqfnwy (mgr.34427) 10975 : cluster [DBG] pgmap v6255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:17.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:16 gibba013 bash[30381]: cluster 2021-03-10T17:21:15.583312+0000 mgr.gibba020.yqfnwy (mgr.34427) 10975 : cluster [DBG] pgmap v6255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:17.277 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:21:17.278 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:21:17.278 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:21:17.279 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:21:17.279 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:21:17.280 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:21:17.280 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:21:17.280 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:21:17.281 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:21:17.281 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:21:17.282 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:21:17.282 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:21:17.283 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:21:17.283 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:21:17.283 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:21:17.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:17 gibba020 bash[25448]: audit 2021-03-10T17:21:16.791712+0000 mgr.gibba020.yqfnwy (mgr.34427) 10976 : audit [DBG] from='client.51414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:21:17.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:17 gibba020 bash[25448]: audit 2021-03-10T17:21:17.276172+0000 mon.c (mon.1) 165 : audit [DBG] from='client.? 172.21.2.113:0/4128797710' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:18.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:17 gibba013 bash[29418]: audit 2021-03-10T17:21:16.791712+0000 mgr.gibba020.yqfnwy (mgr.34427) 10976 : audit [DBG] from='client.51414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:21:18.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:17 gibba013 bash[29418]: audit 2021-03-10T17:21:17.276172+0000 mon.c (mon.1) 165 : audit [DBG] from='client.? 172.21.2.113:0/4128797710' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:18.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:17 gibba013 bash[30381]: audit 2021-03-10T17:21:16.791712+0000 mgr.gibba020.yqfnwy (mgr.34427) 10976 : audit [DBG] from='client.51414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:21:18.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:17 gibba013 bash[30381]: audit 2021-03-10T17:21:17.276172+0000 mon.c (mon.1) 165 : audit [DBG] from='client.? 172.21.2.113:0/4128797710' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:18.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:18 gibba020 bash[25448]: audit 2021-03-10T17:21:17.015525+0000 mgr.gibba020.yqfnwy (mgr.34427) 10977 : audit [DBG] from='client.61399 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:21:18.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:18 gibba020 bash[25448]: cluster 2021-03-10T17:21:17.584587+0000 mgr.gibba020.yqfnwy (mgr.34427) 10978 : cluster [DBG] pgmap v6256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:19.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:18 gibba013 bash[29418]: audit 2021-03-10T17:21:17.015525+0000 mgr.gibba020.yqfnwy (mgr.34427) 10977 : audit [DBG] from='client.61399 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:21:19.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:18 gibba013 bash[29418]: cluster 2021-03-10T17:21:17.584587+0000 mgr.gibba020.yqfnwy (mgr.34427) 10978 : cluster [DBG] pgmap v6256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:19.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:18 gibba013 bash[30381]: audit 2021-03-10T17:21:17.015525+0000 mgr.gibba020.yqfnwy (mgr.34427) 10977 : audit [DBG] from='client.61399 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:21:19.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:18 gibba013 bash[30381]: cluster 2021-03-10T17:21:17.584587+0000 mgr.gibba020.yqfnwy (mgr.34427) 10978 : cluster [DBG] pgmap v6256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:20.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:20 gibba020 bash[25448]: cluster 2021-03-10T17:21:19.586124+0000 mgr.gibba020.yqfnwy (mgr.34427) 10979 : cluster [DBG] pgmap v6257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:21.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:20 gibba013 bash[29418]: cluster 2021-03-10T17:21:19.586124+0000 mgr.gibba020.yqfnwy (mgr.34427) 10979 : cluster [DBG] pgmap v6257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:21.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:20 gibba013 bash[30381]: cluster 2021-03-10T17:21:19.586124+0000 mgr.gibba020.yqfnwy (mgr.34427) 10979 : cluster [DBG] pgmap v6257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:22.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:21 gibba013 bash[29418]: cluster 2021-03-10T17:21:21.587846+0000 mgr.gibba020.yqfnwy (mgr.34427) 10980 : cluster [DBG] pgmap v6258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:22.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:21 gibba013 bash[30381]: cluster 2021-03-10T17:21:21.587846+0000 mgr.gibba020.yqfnwy (mgr.34427) 10980 : cluster [DBG] pgmap v6258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:22.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:21 gibba020 bash[25448]: cluster 2021-03-10T17:21:21.587846+0000 mgr.gibba020.yqfnwy (mgr.34427) 10980 : cluster [DBG] pgmap v6258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:24.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:24 gibba020 bash[25448]: cluster 2021-03-10T17:21:23.589217+0000 mgr.gibba020.yqfnwy (mgr.34427) 10981 : cluster [DBG] pgmap v6259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:25.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:24 gibba013 bash[29418]: cluster 2021-03-10T17:21:23.589217+0000 mgr.gibba020.yqfnwy (mgr.34427) 10981 : cluster [DBG] pgmap v6259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:25.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:24 gibba013 bash[30381]: cluster 2021-03-10T17:21:23.589217+0000 mgr.gibba020.yqfnwy (mgr.34427) 10981 : cluster [DBG] pgmap v6259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:26.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:26 gibba020 bash[25448]: cluster 2021-03-10T17:21:25.590608+0000 mgr.gibba020.yqfnwy (mgr.34427) 10982 : cluster [DBG] pgmap v6260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:27.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:26 gibba013 bash[29418]: cluster 2021-03-10T17:21:25.590608+0000 mgr.gibba020.yqfnwy (mgr.34427) 10982 : cluster [DBG] pgmap v6260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:27.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:26 gibba013 bash[30381]: cluster 2021-03-10T17:21:25.590608+0000 mgr.gibba020.yqfnwy (mgr.34427) 10982 : cluster [DBG] pgmap v6260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:27.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:27 gibba020 bash[25448]: cephadm 2021-03-10T17:21:26.740407+0000 mgr.gibba020.yqfnwy (mgr.34427) 10983 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:21:28.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:27 gibba013 bash[29418]: cephadm 2021-03-10T17:21:26.740407+0000 mgr.gibba020.yqfnwy (mgr.34427) 10983 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:21:28.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:27 gibba013 bash[30381]: cephadm 2021-03-10T17:21:26.740407+0000 mgr.gibba020.yqfnwy (mgr.34427) 10983 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:21:28.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:28 gibba020 bash[25448]: cluster 2021-03-10T17:21:27.592058+0000 mgr.gibba020.yqfnwy (mgr.34427) 10984 : cluster [DBG] pgmap v6261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:29.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:28 gibba013 bash[29418]: cluster 2021-03-10T17:21:27.592058+0000 mgr.gibba020.yqfnwy (mgr.34427) 10984 : cluster [DBG] pgmap v6261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:29.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:28 gibba013 bash[30381]: cluster 2021-03-10T17:21:27.592058+0000 mgr.gibba020.yqfnwy (mgr.34427) 10984 : cluster [DBG] pgmap v6261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:30.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:30 gibba020 bash[25448]: cluster 2021-03-10T17:21:29.593251+0000 mgr.gibba020.yqfnwy (mgr.34427) 10985 : cluster [DBG] pgmap v6262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:31.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:30 gibba013 bash[29418]: cluster 2021-03-10T17:21:29.593251+0000 mgr.gibba020.yqfnwy (mgr.34427) 10985 : cluster [DBG] pgmap v6262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:31.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:30 gibba013 bash[30381]: cluster 2021-03-10T17:21:29.593251+0000 mgr.gibba020.yqfnwy (mgr.34427) 10985 : cluster [DBG] pgmap v6262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:32.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:31 gibba013 bash[29418]: cluster 2021-03-10T17:21:31.594789+0000 mgr.gibba020.yqfnwy (mgr.34427) 10986 : cluster [DBG] pgmap v6263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:32.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:31 gibba013 bash[30381]: cluster 2021-03-10T17:21:31.594789+0000 mgr.gibba020.yqfnwy (mgr.34427) 10986 : cluster [DBG] pgmap v6263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:32.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:31 gibba020 bash[25448]: cluster 2021-03-10T17:21:31.594789+0000 mgr.gibba020.yqfnwy (mgr.34427) 10986 : cluster [DBG] pgmap v6263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:34.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:34 gibba020 bash[25448]: cluster 2021-03-10T17:21:33.595399+0000 mgr.gibba020.yqfnwy (mgr.34427) 10987 : cluster [DBG] pgmap v6264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:35.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:34 gibba013 bash[29418]: cluster 2021-03-10T17:21:33.595399+0000 mgr.gibba020.yqfnwy (mgr.34427) 10987 : cluster [DBG] pgmap v6264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:35.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:34 gibba013 bash[30381]: cluster 2021-03-10T17:21:33.595399+0000 mgr.gibba020.yqfnwy (mgr.34427) 10987 : cluster [DBG] pgmap v6264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:36.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:36 gibba020 bash[25448]: cluster 2021-03-10T17:21:35.596727+0000 mgr.gibba020.yqfnwy (mgr.34427) 10988 : cluster [DBG] pgmap v6265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:37.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:36 gibba013 bash[29418]: cluster 2021-03-10T17:21:35.596727+0000 mgr.gibba020.yqfnwy (mgr.34427) 10988 : cluster [DBG] pgmap v6265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:37.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:36 gibba013 bash[30381]: cluster 2021-03-10T17:21:35.596727+0000 mgr.gibba020.yqfnwy (mgr.34427) 10988 : cluster [DBG] pgmap v6265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:38.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:38 gibba020 bash[25448]: cluster 2021-03-10T17:21:37.597969+0000 mgr.gibba020.yqfnwy (mgr.34427) 10989 : cluster [DBG] pgmap v6266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:39.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:38 gibba013 bash[29418]: cluster 2021-03-10T17:21:37.597969+0000 mgr.gibba020.yqfnwy (mgr.34427) 10989 : cluster [DBG] pgmap v6266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:39.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:38 gibba013 bash[30381]: cluster 2021-03-10T17:21:37.597969+0000 mgr.gibba020.yqfnwy (mgr.34427) 10989 : cluster [DBG] pgmap v6266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:40.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:40 gibba020 bash[25448]: cluster 2021-03-10T17:21:39.599492+0000 mgr.gibba020.yqfnwy (mgr.34427) 10990 : cluster [DBG] pgmap v6267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:41.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:40 gibba013 bash[29418]: cluster 2021-03-10T17:21:39.599492+0000 mgr.gibba020.yqfnwy (mgr.34427) 10990 : cluster [DBG] pgmap v6267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:41.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:40 gibba013 bash[30381]: cluster 2021-03-10T17:21:39.599492+0000 mgr.gibba020.yqfnwy (mgr.34427) 10990 : cluster [DBG] pgmap v6267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:42.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:41 gibba013 bash[29418]: cluster 2021-03-10T17:21:41.601196+0000 mgr.gibba020.yqfnwy (mgr.34427) 10991 : cluster [DBG] pgmap v6268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:42.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:41 gibba013 bash[29418]: audit 2021-03-10T17:21:41.754876+0000 mon.a (mon.0) 3881 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:21:42.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:41 gibba013 bash[29418]: cephadm 2021-03-10T17:21:41.760980+0000 mgr.gibba020.yqfnwy (mgr.34427) 10992 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:21:42.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:41 gibba013 bash[29418]: audit 2021-03-10T17:21:41.762102+0000 mon.a (mon.0) 3882 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:21:42.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:41 gibba013 bash[30381]: cluster 2021-03-10T17:21:41.601196+0000 mgr.gibba020.yqfnwy (mgr.34427) 10991 : cluster [DBG] pgmap v6268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:42.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:41 gibba013 bash[30381]: audit 2021-03-10T17:21:41.754876+0000 mon.a (mon.0) 3881 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:21:42.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:41 gibba013 bash[30381]: cephadm 2021-03-10T17:21:41.760980+0000 mgr.gibba020.yqfnwy (mgr.34427) 10992 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:21:42.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:41 gibba013 bash[30381]: audit 2021-03-10T17:21:41.762102+0000 mon.a (mon.0) 3882 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:21:42.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:41 gibba020 bash[25448]: cluster 2021-03-10T17:21:41.601196+0000 mgr.gibba020.yqfnwy (mgr.34427) 10991 : cluster [DBG] pgmap v6268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:42.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:41 gibba020 bash[25448]: audit 2021-03-10T17:21:41.754876+0000 mon.a (mon.0) 3881 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:21:42.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:41 gibba020 bash[25448]: cephadm 2021-03-10T17:21:41.760980+0000 mgr.gibba020.yqfnwy (mgr.34427) 10992 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:21:42.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:41 gibba020 bash[25448]: audit 2021-03-10T17:21:41.762102+0000 mon.a (mon.0) 3882 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:21:44.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:44 gibba020 bash[25448]: cluster 2021-03-10T17:21:43.602573+0000 mgr.gibba020.yqfnwy (mgr.34427) 10993 : cluster [DBG] pgmap v6269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:45.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:44 gibba013 bash[30381]: cluster 2021-03-10T17:21:43.602573+0000 mgr.gibba020.yqfnwy (mgr.34427) 10993 : cluster [DBG] pgmap v6269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:45.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:44 gibba013 bash[29418]: cluster 2021-03-10T17:21:43.602573+0000 mgr.gibba020.yqfnwy (mgr.34427) 10993 : cluster [DBG] pgmap v6269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:46.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[30381]: audit 2021-03-10T17:21:45.240890+0000 mon.a (mon.0) 3883 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:21:46.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[30381]: cephadm 2021-03-10T17:21:45.241051+0000 mgr.gibba020.yqfnwy (mgr.34427) 10994 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:21:46.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[30381]: audit 2021-03-10T17:21:45.439887+0000 mon.a (mon.0) 3884 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:21:46.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[30381]: cephadm 2021-03-10T17:21:45.446601+0000 mgr.gibba020.yqfnwy (mgr.34427) 10995 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:21:46.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[30381]: audit 2021-03-10T17:21:45.447789+0000 mon.a (mon.0) 3885 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:21:46.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[30381]: cephadm 2021-03-10T17:21:45.448396+0000 mgr.gibba020.yqfnwy (mgr.34427) 10996 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:21:46.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[30381]: audit 2021-03-10T17:21:45.449189+0000 mon.a (mon.0) 3886 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:46.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[30381]: cephadm 2021-03-10T17:21:45.449944+0000 mgr.gibba020.yqfnwy (mgr.34427) 10997 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:21:46.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[30381]: cephadm 2021-03-10T17:21:45.450070+0000 mgr.gibba020.yqfnwy (mgr.34427) 10998 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:21:46.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[30381]: audit 2021-03-10T17:21:45.450843+0000 mon.a (mon.0) 3887 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:46.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[30381]: cephadm 2021-03-10T17:21:45.451325+0000 mgr.gibba020.yqfnwy (mgr.34427) 10999 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:21:46.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[30381]: cephadm 2021-03-10T17:21:45.451362+0000 mgr.gibba020.yqfnwy (mgr.34427) 11000 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:21:46.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[30381]: audit 2021-03-10T17:21:45.452150+0000 mon.a (mon.0) 3888 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:46.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[30381]: cephadm 2021-03-10T17:21:45.452487+0000 mgr.gibba020.yqfnwy (mgr.34427) 11001 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:21:46.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[30381]: cephadm 2021-03-10T17:21:45.453518+0000 mgr.gibba020.yqfnwy (mgr.34427) 11002 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:21:46.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[30381]: cephadm 2021-03-10T17:21:45.453556+0000 mgr.gibba020.yqfnwy (mgr.34427) 11003 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:21:46.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[30381]: audit 2021-03-10T17:21:45.454377+0000 mon.a (mon.0) 3889 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:46.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[30381]: cephadm 2021-03-10T17:21:45.454673+0000 mgr.gibba020.yqfnwy (mgr.34427) 11004 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:21:46.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[30381]: cephadm 2021-03-10T17:21:45.455124+0000 mgr.gibba020.yqfnwy (mgr.34427) 11005 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:21:46.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[30381]: audit 2021-03-10T17:21:45.455915+0000 mon.a (mon.0) 3890 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:46.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[29418]: audit 2021-03-10T17:21:45.240890+0000 mon.a (mon.0) 3883 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:21:46.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[29418]: cephadm 2021-03-10T17:21:45.241051+0000 mgr.gibba020.yqfnwy (mgr.34427) 10994 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:21:46.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[29418]: audit 2021-03-10T17:21:45.439887+0000 mon.a (mon.0) 3884 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:21:46.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[29418]: cephadm 2021-03-10T17:21:45.446601+0000 mgr.gibba020.yqfnwy (mgr.34427) 10995 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:21:46.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[29418]: audit 2021-03-10T17:21:45.447789+0000 mon.a (mon.0) 3885 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:21:46.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[29418]: cephadm 2021-03-10T17:21:45.448396+0000 mgr.gibba020.yqfnwy (mgr.34427) 10996 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:21:46.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[29418]: audit 2021-03-10T17:21:45.449189+0000 mon.a (mon.0) 3886 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:46.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[29418]: cephadm 2021-03-10T17:21:45.449944+0000 mgr.gibba020.yqfnwy (mgr.34427) 10997 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:21:46.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[29418]: cephadm 2021-03-10T17:21:45.450070+0000 mgr.gibba020.yqfnwy (mgr.34427) 10998 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:21:46.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[29418]: audit 2021-03-10T17:21:45.450843+0000 mon.a (mon.0) 3887 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:46.639 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[29418]: cephadm 2021-03-10T17:21:45.451325+0000 mgr.gibba020.yqfnwy (mgr.34427) 10999 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:21:46.640 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[29418]: cephadm 2021-03-10T17:21:45.451362+0000 mgr.gibba020.yqfnwy (mgr.34427) 11000 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:21:46.640 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[29418]: audit 2021-03-10T17:21:45.452150+0000 mon.a (mon.0) 3888 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:46.640 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[29418]: cephadm 2021-03-10T17:21:45.452487+0000 mgr.gibba020.yqfnwy (mgr.34427) 11001 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:21:46.640 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[29418]: cephadm 2021-03-10T17:21:45.453518+0000 mgr.gibba020.yqfnwy (mgr.34427) 11002 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:21:46.641 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[29418]: cephadm 2021-03-10T17:21:45.453556+0000 mgr.gibba020.yqfnwy (mgr.34427) 11003 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:21:46.641 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[29418]: audit 2021-03-10T17:21:45.454377+0000 mon.a (mon.0) 3889 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:46.641 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[29418]: cephadm 2021-03-10T17:21:45.454673+0000 mgr.gibba020.yqfnwy (mgr.34427) 11004 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:21:46.642 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[29418]: cephadm 2021-03-10T17:21:45.455124+0000 mgr.gibba020.yqfnwy (mgr.34427) 11005 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:21:46.642 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[29418]: audit 2021-03-10T17:21:45.455915+0000 mon.a (mon.0) 3890 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:46.642 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[29418]: cephadm 2021-03-10T17:21:45.456120+0000 mgr.gibba020.yqfnwy (mgr.34427) 11006 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:21:46.642 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[29418]: cephadm 2021-03-10T17:21:45.456164+0000 mgr.gibba020.yqfnwy (mgr.34427) 11007 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:21:46.643 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[29418]: cephadm 2021-03-10T17:21:45.456287+0000 mgr.gibba020.yqfnwy (mgr.34427) 11008 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:21:46.643 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[29418]: cluster 2021-03-10T17:21:45.604194+0000 mgr.gibba020.yqfnwy (mgr.34427) 11009 : cluster [DBG] pgmap v6270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:46.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[30381]: cephadm 2021-03-10T17:21:45.456120+0000 mgr.gibba020.yqfnwy (mgr.34427) 11006 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:21:46.644 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[30381]: cephadm 2021-03-10T17:21:45.456164+0000 mgr.gibba020.yqfnwy (mgr.34427) 11007 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:21:46.644 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[30381]: cephadm 2021-03-10T17:21:45.456287+0000 mgr.gibba020.yqfnwy (mgr.34427) 11008 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:21:46.644 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:46 gibba013 bash[30381]: cluster 2021-03-10T17:21:45.604194+0000 mgr.gibba020.yqfnwy (mgr.34427) 11009 : cluster [DBG] pgmap v6270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:46.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:46 gibba020 bash[25448]: audit 2021-03-10T17:21:45.240890+0000 mon.a (mon.0) 3883 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:21:46.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:46 gibba020 bash[25448]: cephadm 2021-03-10T17:21:45.241051+0000 mgr.gibba020.yqfnwy (mgr.34427) 10994 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:21:46.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:46 gibba020 bash[25448]: audit 2021-03-10T17:21:45.439887+0000 mon.a (mon.0) 3884 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:21:46.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:46 gibba020 bash[25448]: cephadm 2021-03-10T17:21:45.446601+0000 mgr.gibba020.yqfnwy (mgr.34427) 10995 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:21:46.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:46 gibba020 bash[25448]: audit 2021-03-10T17:21:45.447789+0000 mon.a (mon.0) 3885 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:21:46.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:46 gibba020 bash[25448]: cephadm 2021-03-10T17:21:45.448396+0000 mgr.gibba020.yqfnwy (mgr.34427) 10996 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:21:46.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:46 gibba020 bash[25448]: audit 2021-03-10T17:21:45.449189+0000 mon.a (mon.0) 3886 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:46.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:46 gibba020 bash[25448]: cephadm 2021-03-10T17:21:45.449944+0000 mgr.gibba020.yqfnwy (mgr.34427) 10997 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:21:46.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:46 gibba020 bash[25448]: cephadm 2021-03-10T17:21:45.450070+0000 mgr.gibba020.yqfnwy (mgr.34427) 10998 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:21:46.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:46 gibba020 bash[25448]: audit 2021-03-10T17:21:45.450843+0000 mon.a (mon.0) 3887 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:46.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:46 gibba020 bash[25448]: cephadm 2021-03-10T17:21:45.451325+0000 mgr.gibba020.yqfnwy (mgr.34427) 10999 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:21:46.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:46 gibba020 bash[25448]: cephadm 2021-03-10T17:21:45.451362+0000 mgr.gibba020.yqfnwy (mgr.34427) 11000 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:21:46.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:46 gibba020 bash[25448]: audit 2021-03-10T17:21:45.452150+0000 mon.a (mon.0) 3888 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:46.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:46 gibba020 bash[25448]: cephadm 2021-03-10T17:21:45.452487+0000 mgr.gibba020.yqfnwy (mgr.34427) 11001 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:21:46.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:46 gibba020 bash[25448]: cephadm 2021-03-10T17:21:45.453518+0000 mgr.gibba020.yqfnwy (mgr.34427) 11002 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:21:46.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:46 gibba020 bash[25448]: cephadm 2021-03-10T17:21:45.453556+0000 mgr.gibba020.yqfnwy (mgr.34427) 11003 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:21:46.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:46 gibba020 bash[25448]: audit 2021-03-10T17:21:45.454377+0000 mon.a (mon.0) 3889 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:46.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:46 gibba020 bash[25448]: cephadm 2021-03-10T17:21:45.454673+0000 mgr.gibba020.yqfnwy (mgr.34427) 11004 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:21:46.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:46 gibba020 bash[25448]: cephadm 2021-03-10T17:21:45.455124+0000 mgr.gibba020.yqfnwy (mgr.34427) 11005 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:21:46.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:46 gibba020 bash[25448]: audit 2021-03-10T17:21:45.455915+0000 mon.a (mon.0) 3890 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:46.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:46 gibba020 bash[25448]: cephadm 2021-03-10T17:21:45.456120+0000 mgr.gibba020.yqfnwy (mgr.34427) 11006 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:21:46.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:46 gibba020 bash[25448]: cephadm 2021-03-10T17:21:45.456164+0000 mgr.gibba020.yqfnwy (mgr.34427) 11007 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:21:46.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:46 gibba020 bash[25448]: cephadm 2021-03-10T17:21:45.456287+0000 mgr.gibba020.yqfnwy (mgr.34427) 11008 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:21:46.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:46 gibba020 bash[25448]: cluster 2021-03-10T17:21:45.604194+0000 mgr.gibba020.yqfnwy (mgr.34427) 11009 : cluster [DBG] pgmap v6270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:47.522 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:21:47.749 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:21:47.749 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 2s ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:21:47.750 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 9m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:21:47.750 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:21:47.750 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:21:47.750 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 2s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:21:47.751 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 2s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:21:47.751 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:21:47.751 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 2s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:21:47.751 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 2s ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:21:47.751 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:21:47.752 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 2s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:21:47.752 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 2s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:21:47.752 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 2s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:21:47.752 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 2s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:21:47.753 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:21:47.753 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:21:47.753 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:21:47.753 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:21:47.753 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 9m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:21:47.754 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 9m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:21:47.998 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:21:47.999 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:21:47.999 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:21:47.999 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:21:48.000 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:21:48.000 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:21:48.000 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:21:48.000 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:21:48.000 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:21:48.001 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:21:48.001 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:21:48.001 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:21:48.001 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:21:48.002 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:21:48.002 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:21:48.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:48 gibba020 bash[25448]: audit 2021-03-10T17:21:47.511548+0000 mgr.gibba020.yqfnwy (mgr.34427) 11010 : audit [DBG] from='client.51432 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:21:48.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:48 gibba020 bash[25448]: cluster 2021-03-10T17:21:47.605485+0000 mgr.gibba020.yqfnwy (mgr.34427) 11011 : cluster [DBG] pgmap v6271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:48.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:48 gibba020 bash[25448]: audit 2021-03-10T17:21:47.736298+0000 mgr.gibba020.yqfnwy (mgr.34427) 11012 : audit [DBG] from='client.61417 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:21:48.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:48 gibba020 bash[25448]: audit 2021-03-10T17:21:47.997470+0000 mon.c (mon.1) 166 : audit [DBG] from='client.? 172.21.2.113:0/3931804405' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:49.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:48 gibba013 bash[29418]: audit 2021-03-10T17:21:47.511548+0000 mgr.gibba020.yqfnwy (mgr.34427) 11010 : audit [DBG] from='client.51432 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:21:49.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:48 gibba013 bash[29418]: cluster 2021-03-10T17:21:47.605485+0000 mgr.gibba020.yqfnwy (mgr.34427) 11011 : cluster [DBG] pgmap v6271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:49.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:48 gibba013 bash[29418]: audit 2021-03-10T17:21:47.736298+0000 mgr.gibba020.yqfnwy (mgr.34427) 11012 : audit [DBG] from='client.61417 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:21:49.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:48 gibba013 bash[29418]: audit 2021-03-10T17:21:47.997470+0000 mon.c (mon.1) 166 : audit [DBG] from='client.? 172.21.2.113:0/3931804405' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:49.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:48 gibba013 bash[30381]: audit 2021-03-10T17:21:47.511548+0000 mgr.gibba020.yqfnwy (mgr.34427) 11010 : audit [DBG] from='client.51432 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:21:49.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:48 gibba013 bash[30381]: cluster 2021-03-10T17:21:47.605485+0000 mgr.gibba020.yqfnwy (mgr.34427) 11011 : cluster [DBG] pgmap v6271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:49.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:48 gibba013 bash[30381]: audit 2021-03-10T17:21:47.736298+0000 mgr.gibba020.yqfnwy (mgr.34427) 11012 : audit [DBG] from='client.61417 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:21:49.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:48 gibba013 bash[30381]: audit 2021-03-10T17:21:47.997470+0000 mon.c (mon.1) 166 : audit [DBG] from='client.? 172.21.2.113:0/3931804405' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:21:50.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:50 gibba020 bash[25448]: cluster 2021-03-10T17:21:49.606038+0000 mgr.gibba020.yqfnwy (mgr.34427) 11013 : cluster [DBG] pgmap v6272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:51.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:50 gibba013 bash[29418]: cluster 2021-03-10T17:21:49.606038+0000 mgr.gibba020.yqfnwy (mgr.34427) 11013 : cluster [DBG] pgmap v6272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:51.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:50 gibba013 bash[30381]: cluster 2021-03-10T17:21:49.606038+0000 mgr.gibba020.yqfnwy (mgr.34427) 11013 : cluster [DBG] pgmap v6272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:52.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:51 gibba020 bash[25448]: cluster 2021-03-10T17:21:51.607658+0000 mgr.gibba020.yqfnwy (mgr.34427) 11014 : cluster [DBG] pgmap v6273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:52.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:51 gibba013 bash[29418]: cluster 2021-03-10T17:21:51.607658+0000 mgr.gibba020.yqfnwy (mgr.34427) 11014 : cluster [DBG] pgmap v6273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:52.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:51 gibba013 bash[30381]: cluster 2021-03-10T17:21:51.607658+0000 mgr.gibba020.yqfnwy (mgr.34427) 11014 : cluster [DBG] pgmap v6273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:54.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:54 gibba020 bash[25448]: cluster 2021-03-10T17:21:53.609281+0000 mgr.gibba020.yqfnwy (mgr.34427) 11015 : cluster [DBG] pgmap v6274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:55.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:54 gibba013 bash[29418]: cluster 2021-03-10T17:21:53.609281+0000 mgr.gibba020.yqfnwy (mgr.34427) 11015 : cluster [DBG] pgmap v6274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:55.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:54 gibba013 bash[30381]: cluster 2021-03-10T17:21:53.609281+0000 mgr.gibba020.yqfnwy (mgr.34427) 11015 : cluster [DBG] pgmap v6274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:56.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:56 gibba020 bash[25448]: cluster 2021-03-10T17:21:55.610911+0000 mgr.gibba020.yqfnwy (mgr.34427) 11016 : cluster [DBG] pgmap v6275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:57.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:56 gibba013 bash[29418]: cluster 2021-03-10T17:21:55.610911+0000 mgr.gibba020.yqfnwy (mgr.34427) 11016 : cluster [DBG] pgmap v6275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:57.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:56 gibba013 bash[30381]: cluster 2021-03-10T17:21:55.610911+0000 mgr.gibba020.yqfnwy (mgr.34427) 11016 : cluster [DBG] pgmap v6275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:58.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:21:58 gibba020 bash[25448]: cluster 2021-03-10T17:21:57.612344+0000 mgr.gibba020.yqfnwy (mgr.34427) 11017 : cluster [DBG] pgmap v6276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:59.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:21:58 gibba013 bash[29418]: cluster 2021-03-10T17:21:57.612344+0000 mgr.gibba020.yqfnwy (mgr.34427) 11017 : cluster [DBG] pgmap v6276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:21:59.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:21:58 gibba013 bash[30381]: cluster 2021-03-10T17:21:57.612344+0000 mgr.gibba020.yqfnwy (mgr.34427) 11017 : cluster [DBG] pgmap v6276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:00.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:00 gibba020 bash[25448]: cluster 2021-03-10T17:21:59.613869+0000 mgr.gibba020.yqfnwy (mgr.34427) 11018 : cluster [DBG] pgmap v6277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:01.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:00 gibba013 bash[29418]: cluster 2021-03-10T17:21:59.613869+0000 mgr.gibba020.yqfnwy (mgr.34427) 11018 : cluster [DBG] pgmap v6277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:01.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:00 gibba013 bash[30381]: cluster 2021-03-10T17:21:59.613869+0000 mgr.gibba020.yqfnwy (mgr.34427) 11018 : cluster [DBG] pgmap v6277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:02.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:01 gibba013 bash[29418]: cephadm 2021-03-10T17:22:00.472239+0000 mgr.gibba020.yqfnwy (mgr.34427) 11019 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:22:02.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:01 gibba013 bash[30381]: cephadm 2021-03-10T17:22:00.472239+0000 mgr.gibba020.yqfnwy (mgr.34427) 11019 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:22:02.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:01 gibba020 bash[25448]: cephadm 2021-03-10T17:22:00.472239+0000 mgr.gibba020.yqfnwy (mgr.34427) 11019 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:22:03.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:02 gibba013 bash[29418]: cluster 2021-03-10T17:22:01.615587+0000 mgr.gibba020.yqfnwy (mgr.34427) 11020 : cluster [DBG] pgmap v6278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:03.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:02 gibba013 bash[30381]: cluster 2021-03-10T17:22:01.615587+0000 mgr.gibba020.yqfnwy (mgr.34427) 11020 : cluster [DBG] pgmap v6278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:03.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:02 gibba020 bash[25448]: cluster 2021-03-10T17:22:01.615587+0000 mgr.gibba020.yqfnwy (mgr.34427) 11020 : cluster [DBG] pgmap v6278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:05.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:04 gibba013 bash[29418]: cluster 2021-03-10T17:22:03.617044+0000 mgr.gibba020.yqfnwy (mgr.34427) 11021 : cluster [DBG] pgmap v6279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:05.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:04 gibba013 bash[30381]: cluster 2021-03-10T17:22:03.617044+0000 mgr.gibba020.yqfnwy (mgr.34427) 11021 : cluster [DBG] pgmap v6279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:05.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:04 gibba020 bash[25448]: cluster 2021-03-10T17:22:03.617044+0000 mgr.gibba020.yqfnwy (mgr.34427) 11021 : cluster [DBG] pgmap v6279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:07.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:06 gibba013 bash[29418]: cluster 2021-03-10T17:22:05.617871+0000 mgr.gibba020.yqfnwy (mgr.34427) 11022 : cluster [DBG] pgmap v6280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:06 gibba013 bash[30381]: cluster 2021-03-10T17:22:05.617871+0000 mgr.gibba020.yqfnwy (mgr.34427) 11022 : cluster [DBG] pgmap v6280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:07.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:06 gibba020 bash[25448]: cluster 2021-03-10T17:22:05.617871+0000 mgr.gibba020.yqfnwy (mgr.34427) 11022 : cluster [DBG] pgmap v6280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:08.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:07 gibba013 bash[29418]: audit 2021-03-10T17:22:06.968625+0000 mon.a (mon.0) 3891 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:22:08.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:07 gibba013 bash[29418]: audit 2021-03-10T17:22:07.200301+0000 mon.a (mon.0) 3892 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:22:08.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:07 gibba013 bash[29418]: audit 2021-03-10T17:22:07.627860+0000 mon.a (mon.0) 3893 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:22:08.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:07 gibba013 bash[29418]: audit 2021-03-10T17:22:07.628676+0000 mon.a (mon.0) 3894 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:22:08.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:07 gibba013 bash[29418]: audit 2021-03-10T17:22:07.629510+0000 mon.a (mon.0) 3895 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:22:08.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:07 gibba013 bash[29418]: audit 2021-03-10T17:22:07.630295+0000 mon.a (mon.0) 3896 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.11", "id": [3, 2]}]: dispatch 2021-03-10T17:22:08.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:07 gibba013 bash[29418]: audit 2021-03-10T17:22:07.631072+0000 mon.a (mon.0) 3897 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 0]}]: dispatch 2021-03-10T17:22:08.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:07 gibba013 bash[30381]: audit 2021-03-10T17:22:06.968625+0000 mon.a (mon.0) 3891 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:22:08.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:07 gibba013 bash[30381]: audit 2021-03-10T17:22:07.200301+0000 mon.a (mon.0) 3892 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:22:08.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:07 gibba013 bash[30381]: audit 2021-03-10T17:22:07.627860+0000 mon.a (mon.0) 3893 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:22:08.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:07 gibba013 bash[30381]: audit 2021-03-10T17:22:07.628676+0000 mon.a (mon.0) 3894 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:22:08.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:07 gibba013 bash[30381]: audit 2021-03-10T17:22:07.629510+0000 mon.a (mon.0) 3895 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:22:08.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:07 gibba013 bash[30381]: audit 2021-03-10T17:22:07.630295+0000 mon.a (mon.0) 3896 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.11", "id": [3, 2]}]: dispatch 2021-03-10T17:22:08.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:07 gibba013 bash[30381]: audit 2021-03-10T17:22:07.631072+0000 mon.a (mon.0) 3897 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 0]}]: dispatch 2021-03-10T17:22:08.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:07 gibba020 bash[25448]: audit 2021-03-10T17:22:06.968625+0000 mon.a (mon.0) 3891 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:22:08.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:07 gibba020 bash[25448]: audit 2021-03-10T17:22:07.200301+0000 mon.a (mon.0) 3892 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:22:08.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:07 gibba020 bash[25448]: audit 2021-03-10T17:22:07.627860+0000 mon.a (mon.0) 3893 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:22:08.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:07 gibba020 bash[25448]: audit 2021-03-10T17:22:07.628676+0000 mon.a (mon.0) 3894 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:22:08.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:07 gibba020 bash[25448]: audit 2021-03-10T17:22:07.629510+0000 mon.a (mon.0) 3895 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:22:08.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:07 gibba020 bash[25448]: audit 2021-03-10T17:22:07.630295+0000 mon.a (mon.0) 3896 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.11", "id": [3, 2]}]: dispatch 2021-03-10T17:22:08.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:07 gibba020 bash[25448]: audit 2021-03-10T17:22:07.631072+0000 mon.a (mon.0) 3897 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 0]}]: dispatch 2021-03-10T17:22:09.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:08 gibba013 bash[29418]: cluster 2021-03-10T17:22:07.619247+0000 mgr.gibba020.yqfnwy (mgr.34427) 11023 : cluster [DBG] pgmap v6281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:09.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:08 gibba013 bash[30381]: cluster 2021-03-10T17:22:07.619247+0000 mgr.gibba020.yqfnwy (mgr.34427) 11023 : cluster [DBG] pgmap v6281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:09.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:08 gibba020 bash[25448]: cluster 2021-03-10T17:22:07.619247+0000 mgr.gibba020.yqfnwy (mgr.34427) 11023 : cluster [DBG] pgmap v6281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:11.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:10 gibba013 bash[29418]: cluster 2021-03-10T17:22:09.620727+0000 mgr.gibba020.yqfnwy (mgr.34427) 11024 : cluster [DBG] pgmap v6282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:11.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:10 gibba013 bash[30381]: cluster 2021-03-10T17:22:09.620727+0000 mgr.gibba020.yqfnwy (mgr.34427) 11024 : cluster [DBG] pgmap v6282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:11.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:10 gibba020 bash[25448]: cluster 2021-03-10T17:22:09.620727+0000 mgr.gibba020.yqfnwy (mgr.34427) 11024 : cluster [DBG] pgmap v6282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:12.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:11 gibba020 bash[25448]: cluster 2021-03-10T17:22:11.622557+0000 mgr.gibba020.yqfnwy (mgr.34427) 11025 : cluster [DBG] pgmap v6283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:12.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:11 gibba013 bash[29418]: cluster 2021-03-10T17:22:11.622557+0000 mgr.gibba020.yqfnwy (mgr.34427) 11025 : cluster [DBG] pgmap v6283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:12.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:11 gibba013 bash[30381]: cluster 2021-03-10T17:22:11.622557+0000 mgr.gibba020.yqfnwy (mgr.34427) 11025 : cluster [DBG] pgmap v6283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:14.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:14 gibba020 bash[25448]: cluster 2021-03-10T17:22:13.623222+0000 mgr.gibba020.yqfnwy (mgr.34427) 11026 : cluster [DBG] pgmap v6284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:15.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:14 gibba013 bash[29418]: cluster 2021-03-10T17:22:13.623222+0000 mgr.gibba020.yqfnwy (mgr.34427) 11026 : cluster [DBG] pgmap v6284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:15.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:14 gibba013 bash[30381]: cluster 2021-03-10T17:22:13.623222+0000 mgr.gibba020.yqfnwy (mgr.34427) 11026 : cluster [DBG] pgmap v6284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:16.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:16 gibba020 bash[25448]: cephadm 2021-03-10T17:22:15.488093+0000 mgr.gibba020.yqfnwy (mgr.34427) 11027 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:22:16.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:16 gibba020 bash[25448]: cluster 2021-03-10T17:22:15.624896+0000 mgr.gibba020.yqfnwy (mgr.34427) 11028 : cluster [DBG] pgmap v6285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:17.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:16 gibba013 bash[29418]: cephadm 2021-03-10T17:22:15.488093+0000 mgr.gibba020.yqfnwy (mgr.34427) 11027 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:22:17.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:16 gibba013 bash[29418]: cluster 2021-03-10T17:22:15.624896+0000 mgr.gibba020.yqfnwy (mgr.34427) 11028 : cluster [DBG] pgmap v6285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:17.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:16 gibba013 bash[30381]: cephadm 2021-03-10T17:22:15.488093+0000 mgr.gibba020.yqfnwy (mgr.34427) 11027 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:22:17.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:16 gibba013 bash[30381]: cluster 2021-03-10T17:22:15.624896+0000 mgr.gibba020.yqfnwy (mgr.34427) 11028 : cluster [DBG] pgmap v6285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:18.244 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:22:18.473 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:22:18.473 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 33s ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:22:18.474 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 9m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:22:18.474 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:22:18.474 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:22:18.474 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 33s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:22:18.475 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 33s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:22:18.475 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:22:18.475 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 33s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:22:18.475 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 33s ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:22:18.476 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:22:18.476 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 33s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:22:18.476 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 33s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:22:18.476 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 33s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:22:18.476 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 33s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:22:18.477 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:22:18.477 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:22:18.477 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:22:18.477 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:22:18.477 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 9m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:22:18.478 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 9m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:22:18.723 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:22:18.724 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:22:18.724 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:22:18.724 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:22:18.724 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:22:18.725 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:22:18.725 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:22:18.725 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:22:18.725 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:22:18.726 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:22:18.726 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:22:18.726 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:22:18.726 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:22:18.726 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:22:18.727 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:22:19.129 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:18 gibba013 bash[30381]: cluster 2021-03-10T17:22:17.626477+0000 mgr.gibba020.yqfnwy (mgr.34427) 11029 : cluster [DBG] pgmap v6286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:19.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:18 gibba013 bash[29418]: cluster 2021-03-10T17:22:17.626477+0000 mgr.gibba020.yqfnwy (mgr.34427) 11029 : cluster [DBG] pgmap v6286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:19.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:18 gibba020 bash[25448]: cluster 2021-03-10T17:22:17.626477+0000 mgr.gibba020.yqfnwy (mgr.34427) 11029 : cluster [DBG] pgmap v6286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:20.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:19 gibba013 bash[29418]: audit 2021-03-10T17:22:18.233664+0000 mgr.gibba020.yqfnwy (mgr.34427) 11030 : audit [DBG] from='client.61429 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:22:20.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:19 gibba013 bash[29418]: audit 2021-03-10T17:22:18.459518+0000 mgr.gibba020.yqfnwy (mgr.34427) 11031 : audit [DBG] from='client.51456 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:22:20.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:19 gibba013 bash[29418]: audit 2021-03-10T17:22:18.722663+0000 mon.c (mon.1) 167 : audit [DBG] from='client.? 172.21.2.113:0/443697636' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:20.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:19 gibba013 bash[30381]: audit 2021-03-10T17:22:18.233664+0000 mgr.gibba020.yqfnwy (mgr.34427) 11030 : audit [DBG] from='client.61429 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:22:20.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:19 gibba013 bash[30381]: audit 2021-03-10T17:22:18.459518+0000 mgr.gibba020.yqfnwy (mgr.34427) 11031 : audit [DBG] from='client.51456 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:22:20.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:19 gibba013 bash[30381]: audit 2021-03-10T17:22:18.722663+0000 mon.c (mon.1) 167 : audit [DBG] from='client.? 172.21.2.113:0/443697636' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:20.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:19 gibba020 bash[25448]: audit 2021-03-10T17:22:18.233664+0000 mgr.gibba020.yqfnwy (mgr.34427) 11030 : audit [DBG] from='client.61429 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:22:20.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:19 gibba020 bash[25448]: audit 2021-03-10T17:22:18.459518+0000 mgr.gibba020.yqfnwy (mgr.34427) 11031 : audit [DBG] from='client.51456 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:22:20.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:19 gibba020 bash[25448]: audit 2021-03-10T17:22:18.722663+0000 mon.c (mon.1) 167 : audit [DBG] from='client.? 172.21.2.113:0/443697636' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:21.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:20 gibba013 bash[29418]: cluster 2021-03-10T17:22:19.627718+0000 mgr.gibba020.yqfnwy (mgr.34427) 11032 : cluster [DBG] pgmap v6287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:21.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:20 gibba013 bash[30381]: cluster 2021-03-10T17:22:19.627718+0000 mgr.gibba020.yqfnwy (mgr.34427) 11032 : cluster [DBG] pgmap v6287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:21.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:20 gibba020 bash[25448]: cluster 2021-03-10T17:22:19.627718+0000 mgr.gibba020.yqfnwy (mgr.34427) 11032 : cluster [DBG] pgmap v6287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:22.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:21 gibba020 bash[25448]: cluster 2021-03-10T17:22:21.629446+0000 mgr.gibba020.yqfnwy (mgr.34427) 11033 : cluster [DBG] pgmap v6288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:22.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:21 gibba013 bash[29418]: cluster 2021-03-10T17:22:21.629446+0000 mgr.gibba020.yqfnwy (mgr.34427) 11033 : cluster [DBG] pgmap v6288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:22.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:21 gibba013 bash[30381]: cluster 2021-03-10T17:22:21.629446+0000 mgr.gibba020.yqfnwy (mgr.34427) 11033 : cluster [DBG] pgmap v6288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:24.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:24 gibba020 bash[25448]: cluster 2021-03-10T17:22:23.630827+0000 mgr.gibba020.yqfnwy (mgr.34427) 11034 : cluster [DBG] pgmap v6289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:25.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:24 gibba013 bash[29418]: cluster 2021-03-10T17:22:23.630827+0000 mgr.gibba020.yqfnwy (mgr.34427) 11034 : cluster [DBG] pgmap v6289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:25.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:24 gibba013 bash[30381]: cluster 2021-03-10T17:22:23.630827+0000 mgr.gibba020.yqfnwy (mgr.34427) 11034 : cluster [DBG] pgmap v6289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:27.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:26 gibba013 bash[29418]: cluster 2021-03-10T17:22:25.632561+0000 mgr.gibba020.yqfnwy (mgr.34427) 11035 : cluster [DBG] pgmap v6290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:27.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:26 gibba013 bash[30381]: cluster 2021-03-10T17:22:25.632561+0000 mgr.gibba020.yqfnwy (mgr.34427) 11035 : cluster [DBG] pgmap v6290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:27.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:26 gibba020 bash[25448]: cluster 2021-03-10T17:22:25.632561+0000 mgr.gibba020.yqfnwy (mgr.34427) 11035 : cluster [DBG] pgmap v6290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:29.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:28 gibba013 bash[29418]: cluster 2021-03-10T17:22:27.633852+0000 mgr.gibba020.yqfnwy (mgr.34427) 11036 : cluster [DBG] pgmap v6291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:29.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:28 gibba013 bash[30381]: cluster 2021-03-10T17:22:27.633852+0000 mgr.gibba020.yqfnwy (mgr.34427) 11036 : cluster [DBG] pgmap v6291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:29.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:28 gibba020 bash[25448]: cluster 2021-03-10T17:22:27.633852+0000 mgr.gibba020.yqfnwy (mgr.34427) 11036 : cluster [DBG] pgmap v6291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:30.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:30 gibba020 bash[25448]: cluster 2021-03-10T17:22:29.635219+0000 mgr.gibba020.yqfnwy (mgr.34427) 11037 : cluster [DBG] pgmap v6292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:31.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:30 gibba013 bash[29418]: cluster 2021-03-10T17:22:29.635219+0000 mgr.gibba020.yqfnwy (mgr.34427) 11037 : cluster [DBG] pgmap v6292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:31.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:30 gibba013 bash[30381]: cluster 2021-03-10T17:22:29.635219+0000 mgr.gibba020.yqfnwy (mgr.34427) 11037 : cluster [DBG] pgmap v6292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:32.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:31 gibba013 bash[29418]: cephadm 2021-03-10T17:22:30.504165+0000 mgr.gibba020.yqfnwy (mgr.34427) 11038 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:22:32.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:31 gibba013 bash[30381]: cephadm 2021-03-10T17:22:30.504165+0000 mgr.gibba020.yqfnwy (mgr.34427) 11038 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:22:32.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:31 gibba020 bash[25448]: cephadm 2021-03-10T17:22:30.504165+0000 mgr.gibba020.yqfnwy (mgr.34427) 11038 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:22:33.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:32 gibba013 bash[29418]: cluster 2021-03-10T17:22:31.637144+0000 mgr.gibba020.yqfnwy (mgr.34427) 11039 : cluster [DBG] pgmap v6293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:33.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:32 gibba013 bash[30381]: cluster 2021-03-10T17:22:31.637144+0000 mgr.gibba020.yqfnwy (mgr.34427) 11039 : cluster [DBG] pgmap v6293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:33.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:32 gibba020 bash[25448]: cluster 2021-03-10T17:22:31.637144+0000 mgr.gibba020.yqfnwy (mgr.34427) 11039 : cluster [DBG] pgmap v6293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:35.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:34 gibba013 bash[29418]: cluster 2021-03-10T17:22:33.638788+0000 mgr.gibba020.yqfnwy (mgr.34427) 11040 : cluster [DBG] pgmap v6294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:35.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:34 gibba013 bash[30381]: cluster 2021-03-10T17:22:33.638788+0000 mgr.gibba020.yqfnwy (mgr.34427) 11040 : cluster [DBG] pgmap v6294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:35.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:34 gibba020 bash[25448]: cluster 2021-03-10T17:22:33.638788+0000 mgr.gibba020.yqfnwy (mgr.34427) 11040 : cluster [DBG] pgmap v6294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:37.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:36 gibba013 bash[29418]: cluster 2021-03-10T17:22:35.640507+0000 mgr.gibba020.yqfnwy (mgr.34427) 11041 : cluster [DBG] pgmap v6295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:37.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:36 gibba013 bash[30381]: cluster 2021-03-10T17:22:35.640507+0000 mgr.gibba020.yqfnwy (mgr.34427) 11041 : cluster [DBG] pgmap v6295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:37.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:36 gibba020 bash[25448]: cluster 2021-03-10T17:22:35.640507+0000 mgr.gibba020.yqfnwy (mgr.34427) 11041 : cluster [DBG] pgmap v6295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:39.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:38 gibba013 bash[29418]: cluster 2021-03-10T17:22:37.641799+0000 mgr.gibba020.yqfnwy (mgr.34427) 11042 : cluster [DBG] pgmap v6296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:39.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:38 gibba013 bash[30381]: cluster 2021-03-10T17:22:37.641799+0000 mgr.gibba020.yqfnwy (mgr.34427) 11042 : cluster [DBG] pgmap v6296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:39.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:38 gibba020 bash[25448]: cluster 2021-03-10T17:22:37.641799+0000 mgr.gibba020.yqfnwy (mgr.34427) 11042 : cluster [DBG] pgmap v6296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:41.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:40 gibba013 bash[29418]: cluster 2021-03-10T17:22:39.643339+0000 mgr.gibba020.yqfnwy (mgr.34427) 11043 : cluster [DBG] pgmap v6297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:41.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:40 gibba013 bash[30381]: cluster 2021-03-10T17:22:39.643339+0000 mgr.gibba020.yqfnwy (mgr.34427) 11043 : cluster [DBG] pgmap v6297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:41.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:40 gibba020 bash[25448]: cluster 2021-03-10T17:22:39.643339+0000 mgr.gibba020.yqfnwy (mgr.34427) 11043 : cluster [DBG] pgmap v6297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:42.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:41 gibba020 bash[25448]: cluster 2021-03-10T17:22:41.644979+0000 mgr.gibba020.yqfnwy (mgr.34427) 11044 : cluster [DBG] pgmap v6298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:42.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:41 gibba013 bash[29418]: cluster 2021-03-10T17:22:41.644979+0000 mgr.gibba020.yqfnwy (mgr.34427) 11044 : cluster [DBG] pgmap v6298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:42.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:41 gibba013 bash[30381]: cluster 2021-03-10T17:22:41.644979+0000 mgr.gibba020.yqfnwy (mgr.34427) 11044 : cluster [DBG] pgmap v6298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:45.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:44 gibba013 bash[29418]: cluster 2021-03-10T17:22:43.646421+0000 mgr.gibba020.yqfnwy (mgr.34427) 11045 : cluster [DBG] pgmap v6299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:45.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:44 gibba013 bash[30381]: cluster 2021-03-10T17:22:43.646421+0000 mgr.gibba020.yqfnwy (mgr.34427) 11045 : cluster [DBG] pgmap v6299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:45.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:44 gibba020 bash[25448]: cluster 2021-03-10T17:22:43.646421+0000 mgr.gibba020.yqfnwy (mgr.34427) 11045 : cluster [DBG] pgmap v6299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:46.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:45 gibba013 bash[29418]: audit 2021-03-10T17:22:45.521555+0000 mon.a (mon.0) 3898 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:22:46.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:45 gibba013 bash[29418]: audit 2021-03-10T17:22:45.530056+0000 mon.a (mon.0) 3899 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:22:46.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:45 gibba013 bash[30381]: audit 2021-03-10T17:22:45.521555+0000 mon.a (mon.0) 3898 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:22:46.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:45 gibba013 bash[30381]: audit 2021-03-10T17:22:45.530056+0000 mon.a (mon.0) 3899 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:22:46.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:45 gibba020 bash[25448]: audit 2021-03-10T17:22:45.521555+0000 mon.a (mon.0) 3898 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:22:46.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:45 gibba020 bash[25448]: audit 2021-03-10T17:22:45.530056+0000 mon.a (mon.0) 3899 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:22:47.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:46 gibba013 bash[29418]: cephadm 2021-03-10T17:22:45.526390+0000 mgr.gibba020.yqfnwy (mgr.34427) 11046 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:22:47.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:46 gibba013 bash[29418]: cluster 2021-03-10T17:22:45.646959+0000 mgr.gibba020.yqfnwy (mgr.34427) 11047 : cluster [DBG] pgmap v6300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:47.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:46 gibba013 bash[30381]: cephadm 2021-03-10T17:22:45.526390+0000 mgr.gibba020.yqfnwy (mgr.34427) 11046 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:22:47.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:46 gibba013 bash[30381]: cluster 2021-03-10T17:22:45.646959+0000 mgr.gibba020.yqfnwy (mgr.34427) 11047 : cluster [DBG] pgmap v6300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:47.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:46 gibba020 bash[25448]: cephadm 2021-03-10T17:22:45.526390+0000 mgr.gibba020.yqfnwy (mgr.34427) 11046 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:22:47.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:46 gibba020 bash[25448]: cluster 2021-03-10T17:22:45.646959+0000 mgr.gibba020.yqfnwy (mgr.34427) 11047 : cluster [DBG] pgmap v6300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:48.960 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:22:49.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:48 gibba013 bash[29418]: cluster 2021-03-10T17:22:47.648459+0000 mgr.gibba020.yqfnwy (mgr.34427) 11048 : cluster [DBG] pgmap v6301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:49.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:48 gibba013 bash[30381]: cluster 2021-03-10T17:22:47.648459+0000 mgr.gibba020.yqfnwy (mgr.34427) 11048 : cluster [DBG] pgmap v6301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:49.189 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:22:49.189 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 63s ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:22:49.189 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 10m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:22:49.190 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:22:49.190 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:22:49.190 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 63s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:22:49.190 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 63s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:22:49.191 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:22:49.191 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 63s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:22:49.191 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 63s ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:22:49.191 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 10m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:22:49.191 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 63s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:22:49.192 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 63s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:22:49.192 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 63s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:22:49.192 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 63s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:22:49.192 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:22:49.192 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:22:49.193 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:22:49.193 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:22:49.193 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 10m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:22:49.193 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 10m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:22:49.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:48 gibba020 bash[25448]: cluster 2021-03-10T17:22:47.648459+0000 mgr.gibba020.yqfnwy (mgr.34427) 11048 : cluster [DBG] pgmap v6301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:49.437 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:22:49.437 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:22:49.438 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:22:49.438 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:22:49.438 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:22:49.438 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:22:49.439 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:22:49.439 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:22:49.439 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:22:49.439 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:22:49.439 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:22:49.440 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:22:49.440 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:22:49.440 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:22:49.440 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:22:50.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:50 gibba013 bash[29418]: audit 2021-03-10T17:22:48.950841+0000 mgr.gibba020.yqfnwy (mgr.34427) 11049 : audit [DBG] from='client.51468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:22:50.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:50 gibba013 bash[29418]: audit 2021-03-10T17:22:49.174511+0000 mgr.gibba020.yqfnwy (mgr.34427) 11050 : audit [DBG] from='client.51474 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:22:50.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:50 gibba013 bash[29418]: audit 2021-03-10T17:22:49.374853+0000 mon.a (mon.0) 3900 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:22:50.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:50 gibba013 bash[29418]: audit 2021-03-10T17:22:49.375963+0000 mon.a (mon.0) 3901 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T17:22:50.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:50 gibba013 bash[29418]: audit 2021-03-10T17:22:49.436268+0000 mon.a (mon.0) 3902 : audit [DBG] from='client.? 172.21.2.113:0/1620385583' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:50.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:50 gibba013 bash[29418]: cluster 2021-03-10T17:22:49.649722+0000 mgr.gibba020.yqfnwy (mgr.34427) 11051 : cluster [DBG] pgmap v6302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:50.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:50 gibba013 bash[30381]: audit 2021-03-10T17:22:48.950841+0000 mgr.gibba020.yqfnwy (mgr.34427) 11049 : audit [DBG] from='client.51468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:22:50.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:50 gibba013 bash[30381]: audit 2021-03-10T17:22:49.174511+0000 mgr.gibba020.yqfnwy (mgr.34427) 11050 : audit [DBG] from='client.51474 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:22:50.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:50 gibba013 bash[30381]: audit 2021-03-10T17:22:49.374853+0000 mon.a (mon.0) 3900 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:22:50.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:50 gibba013 bash[30381]: audit 2021-03-10T17:22:49.375963+0000 mon.a (mon.0) 3901 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T17:22:50.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:50 gibba013 bash[30381]: audit 2021-03-10T17:22:49.436268+0000 mon.a (mon.0) 3902 : audit [DBG] from='client.? 172.21.2.113:0/1620385583' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:50.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:50 gibba013 bash[30381]: cluster 2021-03-10T17:22:49.649722+0000 mgr.gibba020.yqfnwy (mgr.34427) 11051 : cluster [DBG] pgmap v6302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:50.685 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:50 gibba020 bash[25448]: audit 2021-03-10T17:22:48.950841+0000 mgr.gibba020.yqfnwy (mgr.34427) 11049 : audit [DBG] from='client.51468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:22:50.685 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:50 gibba020 bash[25448]: audit 2021-03-10T17:22:49.174511+0000 mgr.gibba020.yqfnwy (mgr.34427) 11050 : audit [DBG] from='client.51474 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:22:50.686 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:50 gibba020 bash[25448]: audit 2021-03-10T17:22:49.374853+0000 mon.a (mon.0) 3900 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:22:50.686 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:50 gibba020 bash[25448]: audit 2021-03-10T17:22:49.375963+0000 mon.a (mon.0) 3901 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T17:22:50.686 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:50 gibba020 bash[25448]: audit 2021-03-10T17:22:49.436268+0000 mon.a (mon.0) 3902 : audit [DBG] from='client.? 172.21.2.113:0/1620385583' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:50.686 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:50 gibba020 bash[25448]: cluster 2021-03-10T17:22:49.649722+0000 mgr.gibba020.yqfnwy (mgr.34427) 11051 : cluster [DBG] pgmap v6302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:52.191 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:51 gibba020 bash[25448]: cluster 2021-03-10T17:22:51.651344+0000 mgr.gibba020.yqfnwy (mgr.34427) 11052 : cluster [DBG] pgmap v6303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:52.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:51 gibba013 bash[29418]: cluster 2021-03-10T17:22:51.651344+0000 mgr.gibba020.yqfnwy (mgr.34427) 11052 : cluster [DBG] pgmap v6303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:52.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:51 gibba013 bash[30381]: cluster 2021-03-10T17:22:51.651344+0000 mgr.gibba020.yqfnwy (mgr.34427) 11052 : cluster [DBG] pgmap v6303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:54.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:54 gibba020 bash[25448]: cluster 2021-03-10T17:22:53.652724+0000 mgr.gibba020.yqfnwy (mgr.34427) 11053 : cluster [DBG] pgmap v6304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:54.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:54 gibba020 bash[25448]: audit 2021-03-10T17:22:54.268976+0000 mon.a (mon.0) 3903 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:22:54.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:54 gibba020 bash[25448]: audit 2021-03-10T17:22:54.437839+0000 mon.a (mon.0) 3904 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:22:54.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:54 gibba020 bash[25448]: audit 2021-03-10T17:22:54.624547+0000 mon.a (mon.0) 3905 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:22:54.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:54 gibba020 bash[25448]: audit 2021-03-10T17:22:54.627816+0000 mon.a (mon.0) 3906 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:22:54.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:54 gibba020 bash[25448]: audit 2021-03-10T17:22:54.629133+0000 mon.a (mon.0) 3907 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:54.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:54 gibba020 bash[25448]: audit 2021-03-10T17:22:54.630488+0000 mon.a (mon.0) 3908 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:54.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:54 gibba020 bash[25448]: audit 2021-03-10T17:22:54.631536+0000 mon.a (mon.0) 3909 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:54.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:54 gibba020 bash[25448]: audit 2021-03-10T17:22:54.633744+0000 mon.a (mon.0) 3910 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:54.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:54 gibba020 bash[25448]: audit 2021-03-10T17:22:54.635296+0000 mon.a (mon.0) 3911 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:55.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:54 gibba013 bash[29418]: cluster 2021-03-10T17:22:53.652724+0000 mgr.gibba020.yqfnwy (mgr.34427) 11053 : cluster [DBG] pgmap v6304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:55.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:54 gibba013 bash[29418]: audit 2021-03-10T17:22:54.268976+0000 mon.a (mon.0) 3903 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:22:55.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:54 gibba013 bash[29418]: audit 2021-03-10T17:22:54.437839+0000 mon.a (mon.0) 3904 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:22:55.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:54 gibba013 bash[29418]: audit 2021-03-10T17:22:54.624547+0000 mon.a (mon.0) 3905 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:22:55.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:54 gibba013 bash[29418]: audit 2021-03-10T17:22:54.627816+0000 mon.a (mon.0) 3906 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:22:55.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:54 gibba013 bash[29418]: audit 2021-03-10T17:22:54.629133+0000 mon.a (mon.0) 3907 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:55.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:54 gibba013 bash[29418]: audit 2021-03-10T17:22:54.630488+0000 mon.a (mon.0) 3908 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:55.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:54 gibba013 bash[29418]: audit 2021-03-10T17:22:54.631536+0000 mon.a (mon.0) 3909 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:55.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:54 gibba013 bash[29418]: audit 2021-03-10T17:22:54.633744+0000 mon.a (mon.0) 3910 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:55.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:54 gibba013 bash[29418]: audit 2021-03-10T17:22:54.635296+0000 mon.a (mon.0) 3911 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:55.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:54 gibba013 bash[30381]: cluster 2021-03-10T17:22:53.652724+0000 mgr.gibba020.yqfnwy (mgr.34427) 11053 : cluster [DBG] pgmap v6304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:55.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:54 gibba013 bash[30381]: audit 2021-03-10T17:22:54.268976+0000 mon.a (mon.0) 3903 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:22:55.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:54 gibba013 bash[30381]: audit 2021-03-10T17:22:54.437839+0000 mon.a (mon.0) 3904 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:22:55.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:54 gibba013 bash[30381]: audit 2021-03-10T17:22:54.624547+0000 mon.a (mon.0) 3905 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:22:55.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:54 gibba013 bash[30381]: audit 2021-03-10T17:22:54.627816+0000 mon.a (mon.0) 3906 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:22:55.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:54 gibba013 bash[30381]: audit 2021-03-10T17:22:54.629133+0000 mon.a (mon.0) 3907 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:55.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:54 gibba013 bash[30381]: audit 2021-03-10T17:22:54.630488+0000 mon.a (mon.0) 3908 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:55.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:54 gibba013 bash[30381]: audit 2021-03-10T17:22:54.631536+0000 mon.a (mon.0) 3909 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:55.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:54 gibba013 bash[30381]: audit 2021-03-10T17:22:54.633744+0000 mon.a (mon.0) 3910 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:55.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:54 gibba013 bash[30381]: audit 2021-03-10T17:22:54.635296+0000 mon.a (mon.0) 3911 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:22:56.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:55 gibba013 bash[29418]: cephadm 2021-03-10T17:22:54.438019+0000 mgr.gibba020.yqfnwy (mgr.34427) 11054 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:22:56.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:55 gibba013 bash[29418]: cephadm 2021-03-10T17:22:54.626724+0000 mgr.gibba020.yqfnwy (mgr.34427) 11055 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:22:56.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:55 gibba013 bash[29418]: cephadm 2021-03-10T17:22:54.628348+0000 mgr.gibba020.yqfnwy (mgr.34427) 11056 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:22:56.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:55 gibba013 bash[29418]: cephadm 2021-03-10T17:22:54.629661+0000 mgr.gibba020.yqfnwy (mgr.34427) 11057 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:22:56.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:55 gibba013 bash[29418]: cephadm 2021-03-10T17:22:54.629708+0000 mgr.gibba020.yqfnwy (mgr.34427) 11058 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:22:56.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:55 gibba013 bash[29418]: cephadm 2021-03-10T17:22:54.630782+0000 mgr.gibba020.yqfnwy (mgr.34427) 11059 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:22:56.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:55 gibba013 bash[29418]: cephadm 2021-03-10T17:22:54.630826+0000 mgr.gibba020.yqfnwy (mgr.34427) 11060 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:22:56.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:55 gibba013 bash[29418]: cephadm 2021-03-10T17:22:54.631848+0000 mgr.gibba020.yqfnwy (mgr.34427) 11061 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:22:56.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:55 gibba013 bash[29418]: cephadm 2021-03-10T17:22:54.632818+0000 mgr.gibba020.yqfnwy (mgr.34427) 11062 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:22:56.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:55 gibba013 bash[29418]: cephadm 2021-03-10T17:22:54.632862+0000 mgr.gibba020.yqfnwy (mgr.34427) 11063 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:22:56.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:55 gibba013 bash[29418]: cephadm 2021-03-10T17:22:54.634145+0000 mgr.gibba020.yqfnwy (mgr.34427) 11064 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:22:56.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:55 gibba013 bash[29418]: cephadm 2021-03-10T17:22:54.634465+0000 mgr.gibba020.yqfnwy (mgr.34427) 11065 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:22:56.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:55 gibba013 bash[29418]: cephadm 2021-03-10T17:22:54.635880+0000 mgr.gibba020.yqfnwy (mgr.34427) 11066 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:22:56.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:55 gibba013 bash[29418]: cephadm 2021-03-10T17:22:54.635986+0000 mgr.gibba020.yqfnwy (mgr.34427) 11067 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:22:56.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:55 gibba013 bash[29418]: cephadm 2021-03-10T17:22:54.636152+0000 mgr.gibba020.yqfnwy (mgr.34427) 11068 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:22:56.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:55 gibba013 bash[30381]: cephadm 2021-03-10T17:22:54.438019+0000 mgr.gibba020.yqfnwy (mgr.34427) 11054 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:22:56.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:55 gibba013 bash[30381]: cephadm 2021-03-10T17:22:54.626724+0000 mgr.gibba020.yqfnwy (mgr.34427) 11055 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:22:56.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:55 gibba013 bash[30381]: cephadm 2021-03-10T17:22:54.628348+0000 mgr.gibba020.yqfnwy (mgr.34427) 11056 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:22:56.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:55 gibba013 bash[30381]: cephadm 2021-03-10T17:22:54.629661+0000 mgr.gibba020.yqfnwy (mgr.34427) 11057 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:22:56.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:55 gibba013 bash[30381]: cephadm 2021-03-10T17:22:54.629708+0000 mgr.gibba020.yqfnwy (mgr.34427) 11058 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:22:56.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:55 gibba013 bash[30381]: cephadm 2021-03-10T17:22:54.630782+0000 mgr.gibba020.yqfnwy (mgr.34427) 11059 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:22:56.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:55 gibba013 bash[30381]: cephadm 2021-03-10T17:22:54.630826+0000 mgr.gibba020.yqfnwy (mgr.34427) 11060 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:22:56.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:55 gibba013 bash[30381]: cephadm 2021-03-10T17:22:54.631848+0000 mgr.gibba020.yqfnwy (mgr.34427) 11061 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:22:56.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:55 gibba013 bash[30381]: cephadm 2021-03-10T17:22:54.632818+0000 mgr.gibba020.yqfnwy (mgr.34427) 11062 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:22:56.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:55 gibba013 bash[30381]: cephadm 2021-03-10T17:22:54.632862+0000 mgr.gibba020.yqfnwy (mgr.34427) 11063 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:22:56.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:55 gibba013 bash[30381]: cephadm 2021-03-10T17:22:54.634145+0000 mgr.gibba020.yqfnwy (mgr.34427) 11064 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:22:56.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:55 gibba013 bash[30381]: cephadm 2021-03-10T17:22:54.634465+0000 mgr.gibba020.yqfnwy (mgr.34427) 11065 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:22:56.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:55 gibba013 bash[30381]: cephadm 2021-03-10T17:22:54.635880+0000 mgr.gibba020.yqfnwy (mgr.34427) 11066 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:22:56.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:55 gibba013 bash[30381]: cephadm 2021-03-10T17:22:54.635986+0000 mgr.gibba020.yqfnwy (mgr.34427) 11067 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:22:56.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:55 gibba013 bash[30381]: cephadm 2021-03-10T17:22:54.636152+0000 mgr.gibba020.yqfnwy (mgr.34427) 11068 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:22:56.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:55 gibba020 bash[25448]: cephadm 2021-03-10T17:22:54.438019+0000 mgr.gibba020.yqfnwy (mgr.34427) 11054 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:22:56.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:55 gibba020 bash[25448]: cephadm 2021-03-10T17:22:54.626724+0000 mgr.gibba020.yqfnwy (mgr.34427) 11055 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:22:56.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:55 gibba020 bash[25448]: cephadm 2021-03-10T17:22:54.628348+0000 mgr.gibba020.yqfnwy (mgr.34427) 11056 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:22:56.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:55 gibba020 bash[25448]: cephadm 2021-03-10T17:22:54.629661+0000 mgr.gibba020.yqfnwy (mgr.34427) 11057 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:22:56.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:55 gibba020 bash[25448]: cephadm 2021-03-10T17:22:54.629708+0000 mgr.gibba020.yqfnwy (mgr.34427) 11058 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:22:56.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:55 gibba020 bash[25448]: cephadm 2021-03-10T17:22:54.630782+0000 mgr.gibba020.yqfnwy (mgr.34427) 11059 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:22:56.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:55 gibba020 bash[25448]: cephadm 2021-03-10T17:22:54.630826+0000 mgr.gibba020.yqfnwy (mgr.34427) 11060 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:22:56.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:55 gibba020 bash[25448]: cephadm 2021-03-10T17:22:54.631848+0000 mgr.gibba020.yqfnwy (mgr.34427) 11061 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:22:56.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:55 gibba020 bash[25448]: cephadm 2021-03-10T17:22:54.632818+0000 mgr.gibba020.yqfnwy (mgr.34427) 11062 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:22:56.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:55 gibba020 bash[25448]: cephadm 2021-03-10T17:22:54.632862+0000 mgr.gibba020.yqfnwy (mgr.34427) 11063 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:22:56.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:55 gibba020 bash[25448]: cephadm 2021-03-10T17:22:54.634145+0000 mgr.gibba020.yqfnwy (mgr.34427) 11064 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:22:56.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:55 gibba020 bash[25448]: cephadm 2021-03-10T17:22:54.634465+0000 mgr.gibba020.yqfnwy (mgr.34427) 11065 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:22:56.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:55 gibba020 bash[25448]: cephadm 2021-03-10T17:22:54.635880+0000 mgr.gibba020.yqfnwy (mgr.34427) 11066 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:22:56.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:55 gibba020 bash[25448]: cephadm 2021-03-10T17:22:54.635986+0000 mgr.gibba020.yqfnwy (mgr.34427) 11067 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:22:56.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:55 gibba020 bash[25448]: cephadm 2021-03-10T17:22:54.636152+0000 mgr.gibba020.yqfnwy (mgr.34427) 11068 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:22:57.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:56 gibba013 bash[29418]: cluster 2021-03-10T17:22:55.654489+0000 mgr.gibba020.yqfnwy (mgr.34427) 11069 : cluster [DBG] pgmap v6305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:57.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:56 gibba013 bash[30381]: cluster 2021-03-10T17:22:55.654489+0000 mgr.gibba020.yqfnwy (mgr.34427) 11069 : cluster [DBG] pgmap v6305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:57.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:56 gibba020 bash[25448]: cluster 2021-03-10T17:22:55.654489+0000 mgr.gibba020.yqfnwy (mgr.34427) 11069 : cluster [DBG] pgmap v6305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:59.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:22:58 gibba013 bash[29418]: cluster 2021-03-10T17:22:57.655910+0000 mgr.gibba020.yqfnwy (mgr.34427) 11070 : cluster [DBG] pgmap v6306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:59.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:22:58 gibba013 bash[30381]: cluster 2021-03-10T17:22:57.655910+0000 mgr.gibba020.yqfnwy (mgr.34427) 11070 : cluster [DBG] pgmap v6306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:22:59.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:22:58 gibba020 bash[25448]: cluster 2021-03-10T17:22:57.655910+0000 mgr.gibba020.yqfnwy (mgr.34427) 11070 : cluster [DBG] pgmap v6306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:01.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:00 gibba013 bash[29418]: cluster 2021-03-10T17:22:59.657395+0000 mgr.gibba020.yqfnwy (mgr.34427) 11071 : cluster [DBG] pgmap v6307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:01.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:00 gibba013 bash[30381]: cluster 2021-03-10T17:22:59.657395+0000 mgr.gibba020.yqfnwy (mgr.34427) 11071 : cluster [DBG] pgmap v6307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:01.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:00 gibba020 bash[25448]: cluster 2021-03-10T17:22:59.657395+0000 mgr.gibba020.yqfnwy (mgr.34427) 11071 : cluster [DBG] pgmap v6307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:02.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:01 gibba020 bash[25448]: cluster 2021-03-10T17:23:01.659215+0000 mgr.gibba020.yqfnwy (mgr.34427) 11072 : cluster [DBG] pgmap v6308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:02.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:01 gibba013 bash[29418]: cluster 2021-03-10T17:23:01.659215+0000 mgr.gibba020.yqfnwy (mgr.34427) 11072 : cluster [DBG] pgmap v6308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:02.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:01 gibba013 bash[30381]: cluster 2021-03-10T17:23:01.659215+0000 mgr.gibba020.yqfnwy (mgr.34427) 11072 : cluster [DBG] pgmap v6308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:05.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:04 gibba013 bash[29418]: cluster 2021-03-10T17:23:03.660588+0000 mgr.gibba020.yqfnwy (mgr.34427) 11073 : cluster [DBG] pgmap v6309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:05.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:04 gibba013 bash[30381]: cluster 2021-03-10T17:23:03.660588+0000 mgr.gibba020.yqfnwy (mgr.34427) 11073 : cluster [DBG] pgmap v6309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:05.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:04 gibba020 bash[25448]: cluster 2021-03-10T17:23:03.660588+0000 mgr.gibba020.yqfnwy (mgr.34427) 11073 : cluster [DBG] pgmap v6309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:07.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:06 gibba013 bash[29418]: cluster 2021-03-10T17:23:05.662496+0000 mgr.gibba020.yqfnwy (mgr.34427) 11074 : cluster [DBG] pgmap v6310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:07.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:06 gibba013 bash[30381]: cluster 2021-03-10T17:23:05.662496+0000 mgr.gibba020.yqfnwy (mgr.34427) 11074 : cluster [DBG] pgmap v6310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:07.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:06 gibba020 bash[25448]: cluster 2021-03-10T17:23:05.662496+0000 mgr.gibba020.yqfnwy (mgr.34427) 11074 : cluster [DBG] pgmap v6310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:08.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:07 gibba013 bash[29418]: audit 2021-03-10T17:23:06.973710+0000 mon.a (mon.0) 3912 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:23:08.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:07 gibba013 bash[29418]: audit 2021-03-10T17:23:07.206699+0000 mon.a (mon.0) 3913 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:23:08.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:07 gibba013 bash[29418]: audit 2021-03-10T17:23:07.639038+0000 mon.a (mon.0) 3914 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T17:23:08.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:07 gibba013 bash[29418]: audit 2021-03-10T17:23:07.639847+0000 mon.a (mon.0) 3915 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:23:08.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:07 gibba013 bash[29418]: audit 2021-03-10T17:23:07.640518+0000 mon.a (mon.0) 3916 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:23:08.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:07 gibba013 bash[29418]: audit 2021-03-10T17:23:07.641172+0000 mon.a (mon.0) 3917 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:23:08.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:07 gibba013 bash[30381]: audit 2021-03-10T17:23:06.973710+0000 mon.a (mon.0) 3912 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:23:08.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:07 gibba013 bash[30381]: audit 2021-03-10T17:23:07.206699+0000 mon.a (mon.0) 3913 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:23:08.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:07 gibba013 bash[30381]: audit 2021-03-10T17:23:07.639038+0000 mon.a (mon.0) 3914 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T17:23:08.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:07 gibba013 bash[30381]: audit 2021-03-10T17:23:07.639847+0000 mon.a (mon.0) 3915 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:23:08.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:07 gibba013 bash[30381]: audit 2021-03-10T17:23:07.640518+0000 mon.a (mon.0) 3916 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:23:08.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:07 gibba013 bash[30381]: audit 2021-03-10T17:23:07.641172+0000 mon.a (mon.0) 3917 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:23:08.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:07 gibba020 bash[25448]: audit 2021-03-10T17:23:06.973710+0000 mon.a (mon.0) 3912 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:23:08.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:07 gibba020 bash[25448]: audit 2021-03-10T17:23:07.206699+0000 mon.a (mon.0) 3913 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:23:08.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:07 gibba020 bash[25448]: audit 2021-03-10T17:23:07.639038+0000 mon.a (mon.0) 3914 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T17:23:08.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:07 gibba020 bash[25448]: audit 2021-03-10T17:23:07.639847+0000 mon.a (mon.0) 3915 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:23:08.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:07 gibba020 bash[25448]: audit 2021-03-10T17:23:07.640518+0000 mon.a (mon.0) 3916 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:23:08.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:07 gibba020 bash[25448]: audit 2021-03-10T17:23:07.641172+0000 mon.a (mon.0) 3917 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:23:09.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:08 gibba013 bash[29418]: cluster 2021-03-10T17:23:07.663902+0000 mgr.gibba020.yqfnwy (mgr.34427) 11075 : cluster [DBG] pgmap v6311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:09.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:08 gibba013 bash[30381]: cluster 2021-03-10T17:23:07.663902+0000 mgr.gibba020.yqfnwy (mgr.34427) 11075 : cluster [DBG] pgmap v6311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:09.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:08 gibba020 bash[25448]: cluster 2021-03-10T17:23:07.663902+0000 mgr.gibba020.yqfnwy (mgr.34427) 11075 : cluster [DBG] pgmap v6311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:11.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:10 gibba013 bash[29418]: cephadm 2021-03-10T17:23:09.651890+0000 mgr.gibba020.yqfnwy (mgr.34427) 11076 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:23:11.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:10 gibba013 bash[29418]: cluster 2021-03-10T17:23:09.665053+0000 mgr.gibba020.yqfnwy (mgr.34427) 11077 : cluster [DBG] pgmap v6312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:11.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:10 gibba013 bash[30381]: cephadm 2021-03-10T17:23:09.651890+0000 mgr.gibba020.yqfnwy (mgr.34427) 11076 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:23:11.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:10 gibba013 bash[30381]: cluster 2021-03-10T17:23:09.665053+0000 mgr.gibba020.yqfnwy (mgr.34427) 11077 : cluster [DBG] pgmap v6312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:11.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:10 gibba020 bash[25448]: cephadm 2021-03-10T17:23:09.651890+0000 mgr.gibba020.yqfnwy (mgr.34427) 11076 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:23:11.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:10 gibba020 bash[25448]: cluster 2021-03-10T17:23:09.665053+0000 mgr.gibba020.yqfnwy (mgr.34427) 11077 : cluster [DBG] pgmap v6312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:12.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:11 gibba020 bash[25448]: cluster 2021-03-10T17:23:11.666037+0000 mgr.gibba020.yqfnwy (mgr.34427) 11078 : cluster [DBG] pgmap v6313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:12.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:11 gibba013 bash[29418]: cluster 2021-03-10T17:23:11.666037+0000 mgr.gibba020.yqfnwy (mgr.34427) 11078 : cluster [DBG] pgmap v6313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:12.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:11 gibba013 bash[30381]: cluster 2021-03-10T17:23:11.666037+0000 mgr.gibba020.yqfnwy (mgr.34427) 11078 : cluster [DBG] pgmap v6313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:15.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:14 gibba013 bash[29418]: cluster 2021-03-10T17:23:13.667440+0000 mgr.gibba020.yqfnwy (mgr.34427) 11079 : cluster [DBG] pgmap v6314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:15.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:14 gibba013 bash[30381]: cluster 2021-03-10T17:23:13.667440+0000 mgr.gibba020.yqfnwy (mgr.34427) 11079 : cluster [DBG] pgmap v6314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:15.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:14 gibba020 bash[25448]: cluster 2021-03-10T17:23:13.667440+0000 mgr.gibba020.yqfnwy (mgr.34427) 11079 : cluster [DBG] pgmap v6314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:17.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:16 gibba013 bash[29418]: cluster 2021-03-10T17:23:15.669304+0000 mgr.gibba020.yqfnwy (mgr.34427) 11080 : cluster [DBG] pgmap v6315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:17.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:16 gibba013 bash[30381]: cluster 2021-03-10T17:23:15.669304+0000 mgr.gibba020.yqfnwy (mgr.34427) 11080 : cluster [DBG] pgmap v6315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:17.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:16 gibba020 bash[25448]: cluster 2021-03-10T17:23:15.669304+0000 mgr.gibba020.yqfnwy (mgr.34427) 11080 : cluster [DBG] pgmap v6315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:19.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:18 gibba013 bash[29418]: cluster 2021-03-10T17:23:17.670884+0000 mgr.gibba020.yqfnwy (mgr.34427) 11081 : cluster [DBG] pgmap v6316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:19.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:18 gibba013 bash[30381]: cluster 2021-03-10T17:23:17.670884+0000 mgr.gibba020.yqfnwy (mgr.34427) 11081 : cluster [DBG] pgmap v6316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:19.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:18 gibba020 bash[25448]: cluster 2021-03-10T17:23:17.670884+0000 mgr.gibba020.yqfnwy (mgr.34427) 11081 : cluster [DBG] pgmap v6316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:19.683 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:23:19.909 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:23:19.909 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 94s ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:23:19.909 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 30s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:23:19.909 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 30s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:23:19.910 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 30s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:23:19.910 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 94s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:23:19.910 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 94s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:23:19.910 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 30s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:23:19.910 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 94s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:23:19.911 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 94s ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:23:19.911 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 30s ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:23:19.911 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 94s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:23:19.911 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 94s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:23:19.912 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 94s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:23:19.912 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 94s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:23:19.912 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 30s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:23:19.912 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 30s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:23:19.912 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 30s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:23:19.913 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 30s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:23:19.913 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 30s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:23:19.913 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 30s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:23:20.156 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:23:20.157 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:23:20.157 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:23:20.157 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:23:20.157 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:23:20.158 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:23:20.158 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:23:20.158 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:23:20.158 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:23:20.159 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:23:20.159 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:23:20.159 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:23:20.159 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:23:20.159 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:23:20.160 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:23:21.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:20 gibba013 bash[29418]: audit 2021-03-10T17:23:19.671746+0000 mgr.gibba020.yqfnwy (mgr.34427) 11082 : audit [DBG] from='client.51486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:23:21.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:20 gibba013 bash[29418]: cluster 2021-03-10T17:23:19.672929+0000 mgr.gibba020.yqfnwy (mgr.34427) 11083 : cluster [DBG] pgmap v6317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:21.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:20 gibba013 bash[29418]: audit 2021-03-10T17:23:20.155589+0000 mon.c (mon.1) 168 : audit [DBG] from='client.? 172.21.2.113:0/1549224214' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:21.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:20 gibba013 bash[30381]: audit 2021-03-10T17:23:19.671746+0000 mgr.gibba020.yqfnwy (mgr.34427) 11082 : audit [DBG] from='client.51486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:23:21.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:20 gibba013 bash[30381]: cluster 2021-03-10T17:23:19.672929+0000 mgr.gibba020.yqfnwy (mgr.34427) 11083 : cluster [DBG] pgmap v6317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:21.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:20 gibba013 bash[30381]: audit 2021-03-10T17:23:20.155589+0000 mon.c (mon.1) 168 : audit [DBG] from='client.? 172.21.2.113:0/1549224214' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:21.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:20 gibba020 bash[25448]: audit 2021-03-10T17:23:19.671746+0000 mgr.gibba020.yqfnwy (mgr.34427) 11082 : audit [DBG] from='client.51486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:23:21.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:20 gibba020 bash[25448]: cluster 2021-03-10T17:23:19.672929+0000 mgr.gibba020.yqfnwy (mgr.34427) 11083 : cluster [DBG] pgmap v6317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:21.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:20 gibba020 bash[25448]: audit 2021-03-10T17:23:20.155589+0000 mon.c (mon.1) 168 : audit [DBG] from='client.? 172.21.2.113:0/1549224214' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:22.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:21 gibba013 bash[29418]: audit 2021-03-10T17:23:19.894283+0000 mgr.gibba020.yqfnwy (mgr.34427) 11084 : audit [DBG] from='client.51492 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:23:22.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:21 gibba013 bash[30381]: audit 2021-03-10T17:23:19.894283+0000 mgr.gibba020.yqfnwy (mgr.34427) 11084 : audit [DBG] from='client.51492 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:23:22.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:21 gibba020 bash[25448]: audit 2021-03-10T17:23:19.894283+0000 mgr.gibba020.yqfnwy (mgr.34427) 11084 : audit [DBG] from='client.51492 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:23:23.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:22 gibba013 bash[29418]: cluster 2021-03-10T17:23:21.673994+0000 mgr.gibba020.yqfnwy (mgr.34427) 11085 : cluster [DBG] pgmap v6318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:23.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:22 gibba013 bash[30381]: cluster 2021-03-10T17:23:21.673994+0000 mgr.gibba020.yqfnwy (mgr.34427) 11085 : cluster [DBG] pgmap v6318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:23.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:22 gibba020 bash[25448]: cluster 2021-03-10T17:23:21.673994+0000 mgr.gibba020.yqfnwy (mgr.34427) 11085 : cluster [DBG] pgmap v6318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:24.948 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:24 gibba020 bash[25448]: cluster 2021-03-10T17:23:23.675510+0000 mgr.gibba020.yqfnwy (mgr.34427) 11086 : cluster [DBG] pgmap v6319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:25.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:24 gibba013 bash[29418]: cluster 2021-03-10T17:23:23.675510+0000 mgr.gibba020.yqfnwy (mgr.34427) 11086 : cluster [DBG] pgmap v6319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:25.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:24 gibba013 bash[30381]: cluster 2021-03-10T17:23:23.675510+0000 mgr.gibba020.yqfnwy (mgr.34427) 11086 : cluster [DBG] pgmap v6319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:26.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:25 gibba013 bash[29418]: cephadm 2021-03-10T17:23:24.667897+0000 mgr.gibba020.yqfnwy (mgr.34427) 11087 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:23:26.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:25 gibba013 bash[30381]: cephadm 2021-03-10T17:23:24.667897+0000 mgr.gibba020.yqfnwy (mgr.34427) 11087 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:23:26.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:25 gibba020 bash[25448]: cephadm 2021-03-10T17:23:24.667897+0000 mgr.gibba020.yqfnwy (mgr.34427) 11087 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:23:27.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:26 gibba013 bash[29418]: cluster 2021-03-10T17:23:25.677143+0000 mgr.gibba020.yqfnwy (mgr.34427) 11088 : cluster [DBG] pgmap v6320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:27.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:26 gibba013 bash[30381]: cluster 2021-03-10T17:23:25.677143+0000 mgr.gibba020.yqfnwy (mgr.34427) 11088 : cluster [DBG] pgmap v6320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:27.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:26 gibba020 bash[25448]: cluster 2021-03-10T17:23:25.677143+0000 mgr.gibba020.yqfnwy (mgr.34427) 11088 : cluster [DBG] pgmap v6320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:29.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:28 gibba013 bash[29418]: cluster 2021-03-10T17:23:27.678544+0000 mgr.gibba020.yqfnwy (mgr.34427) 11089 : cluster [DBG] pgmap v6321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:29.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:28 gibba013 bash[30381]: cluster 2021-03-10T17:23:27.678544+0000 mgr.gibba020.yqfnwy (mgr.34427) 11089 : cluster [DBG] pgmap v6321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:29.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:28 gibba020 bash[25448]: cluster 2021-03-10T17:23:27.678544+0000 mgr.gibba020.yqfnwy (mgr.34427) 11089 : cluster [DBG] pgmap v6321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:31.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:30 gibba013 bash[29418]: cluster 2021-03-10T17:23:29.679978+0000 mgr.gibba020.yqfnwy (mgr.34427) 11090 : cluster [DBG] pgmap v6322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:31.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:30 gibba013 bash[30381]: cluster 2021-03-10T17:23:29.679978+0000 mgr.gibba020.yqfnwy (mgr.34427) 11090 : cluster [DBG] pgmap v6322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:31.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:30 gibba020 bash[25448]: cluster 2021-03-10T17:23:29.679978+0000 mgr.gibba020.yqfnwy (mgr.34427) 11090 : cluster [DBG] pgmap v6322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:32.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:31 gibba020 bash[25448]: cluster 2021-03-10T17:23:31.680616+0000 mgr.gibba020.yqfnwy (mgr.34427) 11091 : cluster [DBG] pgmap v6323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:32.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:31 gibba013 bash[29418]: cluster 2021-03-10T17:23:31.680616+0000 mgr.gibba020.yqfnwy (mgr.34427) 11091 : cluster [DBG] pgmap v6323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:32.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:31 gibba013 bash[30381]: cluster 2021-03-10T17:23:31.680616+0000 mgr.gibba020.yqfnwy (mgr.34427) 11091 : cluster [DBG] pgmap v6323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:35.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:34 gibba013 bash[29418]: cluster 2021-03-10T17:23:33.681861+0000 mgr.gibba020.yqfnwy (mgr.34427) 11092 : cluster [DBG] pgmap v6324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:35.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:34 gibba013 bash[30381]: cluster 2021-03-10T17:23:33.681861+0000 mgr.gibba020.yqfnwy (mgr.34427) 11092 : cluster [DBG] pgmap v6324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:35.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:34 gibba020 bash[25448]: cluster 2021-03-10T17:23:33.681861+0000 mgr.gibba020.yqfnwy (mgr.34427) 11092 : cluster [DBG] pgmap v6324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:37.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:36 gibba013 bash[29418]: cluster 2021-03-10T17:23:35.683296+0000 mgr.gibba020.yqfnwy (mgr.34427) 11093 : cluster [DBG] pgmap v6325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:37.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:36 gibba013 bash[30381]: cluster 2021-03-10T17:23:35.683296+0000 mgr.gibba020.yqfnwy (mgr.34427) 11093 : cluster [DBG] pgmap v6325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:37.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:36 gibba020 bash[25448]: cluster 2021-03-10T17:23:35.683296+0000 mgr.gibba020.yqfnwy (mgr.34427) 11093 : cluster [DBG] pgmap v6325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:39.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:38 gibba013 bash[29418]: cluster 2021-03-10T17:23:37.684819+0000 mgr.gibba020.yqfnwy (mgr.34427) 11094 : cluster [DBG] pgmap v6326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:39.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:38 gibba013 bash[30381]: cluster 2021-03-10T17:23:37.684819+0000 mgr.gibba020.yqfnwy (mgr.34427) 11094 : cluster [DBG] pgmap v6326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:39.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:38 gibba020 bash[25448]: cluster 2021-03-10T17:23:37.684819+0000 mgr.gibba020.yqfnwy (mgr.34427) 11094 : cluster [DBG] pgmap v6326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:41.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:40 gibba013 bash[29418]: cephadm 2021-03-10T17:23:39.680851+0000 mgr.gibba020.yqfnwy (mgr.34427) 11095 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:23:41.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:40 gibba013 bash[29418]: cluster 2021-03-10T17:23:39.686067+0000 mgr.gibba020.yqfnwy (mgr.34427) 11096 : cluster [DBG] pgmap v6327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:41.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:40 gibba013 bash[30381]: cephadm 2021-03-10T17:23:39.680851+0000 mgr.gibba020.yqfnwy (mgr.34427) 11095 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:23:41.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:40 gibba013 bash[30381]: cluster 2021-03-10T17:23:39.686067+0000 mgr.gibba020.yqfnwy (mgr.34427) 11096 : cluster [DBG] pgmap v6327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:41.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:40 gibba020 bash[25448]: cephadm 2021-03-10T17:23:39.680851+0000 mgr.gibba020.yqfnwy (mgr.34427) 11095 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:23:41.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:40 gibba020 bash[25448]: cluster 2021-03-10T17:23:39.686067+0000 mgr.gibba020.yqfnwy (mgr.34427) 11096 : cluster [DBG] pgmap v6327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:42.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:41 gibba020 bash[25448]: cluster 2021-03-10T17:23:41.687910+0000 mgr.gibba020.yqfnwy (mgr.34427) 11097 : cluster [DBG] pgmap v6328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:42.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:41 gibba013 bash[29418]: cluster 2021-03-10T17:23:41.687910+0000 mgr.gibba020.yqfnwy (mgr.34427) 11097 : cluster [DBG] pgmap v6328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:42.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:41 gibba013 bash[30381]: cluster 2021-03-10T17:23:41.687910+0000 mgr.gibba020.yqfnwy (mgr.34427) 11097 : cluster [DBG] pgmap v6328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:45.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:44 gibba013 bash[29418]: cluster 2021-03-10T17:23:43.689278+0000 mgr.gibba020.yqfnwy (mgr.34427) 11098 : cluster [DBG] pgmap v6329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:45.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:44 gibba013 bash[30381]: cluster 2021-03-10T17:23:43.689278+0000 mgr.gibba020.yqfnwy (mgr.34427) 11098 : cluster [DBG] pgmap v6329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:45.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:44 gibba020 bash[25448]: cluster 2021-03-10T17:23:43.689278+0000 mgr.gibba020.yqfnwy (mgr.34427) 11098 : cluster [DBG] pgmap v6329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:47.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:46 gibba013 bash[29418]: cluster 2021-03-10T17:23:45.690991+0000 mgr.gibba020.yqfnwy (mgr.34427) 11099 : cluster [DBG] pgmap v6330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:47.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:46 gibba013 bash[30381]: cluster 2021-03-10T17:23:45.690991+0000 mgr.gibba020.yqfnwy (mgr.34427) 11099 : cluster [DBG] pgmap v6330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:47.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:46 gibba020 bash[25448]: cluster 2021-03-10T17:23:45.690991+0000 mgr.gibba020.yqfnwy (mgr.34427) 11099 : cluster [DBG] pgmap v6330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:49.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:48 gibba013 bash[29418]: cluster 2021-03-10T17:23:47.692284+0000 mgr.gibba020.yqfnwy (mgr.34427) 11100 : cluster [DBG] pgmap v6331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:49.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:48 gibba013 bash[30381]: cluster 2021-03-10T17:23:47.692284+0000 mgr.gibba020.yqfnwy (mgr.34427) 11100 : cluster [DBG] pgmap v6331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:49.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:48 gibba020 bash[25448]: cluster 2021-03-10T17:23:47.692284+0000 mgr.gibba020.yqfnwy (mgr.34427) 11100 : cluster [DBG] pgmap v6331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:50.397 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:23:50.624 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:23:50.624 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 2m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:23:50.625 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 61s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:23:50.625 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 61s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:23:50.626 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 61s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:23:50.626 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:23:50.626 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:23:50.627 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 61s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:23:50.627 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:23:50.628 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:23:50.628 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 61s ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:23:50.628 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:23:50.629 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:23:50.629 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:23:50.630 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:23:50.630 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 61s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:23:50.630 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 61s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:23:50.631 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 61s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:23:50.631 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 61s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:23:50.632 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 61s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:23:50.632 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 61s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:23:50.878 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:23:50.878 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:23:50.878 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:23:50.879 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:23:50.879 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:23:50.879 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:23:50.879 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:23:50.880 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:23:50.880 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:23:50.880 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:23:50.880 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:23:50.880 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:23:50.881 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:23:50.881 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:23:50.881 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:23:51.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:50 gibba013 bash[29418]: cluster 2021-03-10T17:23:49.693767+0000 mgr.gibba020.yqfnwy (mgr.34427) 11101 : cluster [DBG] pgmap v6332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:51.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:50 gibba013 bash[30381]: cluster 2021-03-10T17:23:49.693767+0000 mgr.gibba020.yqfnwy (mgr.34427) 11101 : cluster [DBG] pgmap v6332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:51.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:50 gibba020 bash[25448]: cluster 2021-03-10T17:23:49.693767+0000 mgr.gibba020.yqfnwy (mgr.34427) 11101 : cluster [DBG] pgmap v6332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:52.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:51 gibba013 bash[29418]: audit 2021-03-10T17:23:50.386306+0000 mgr.gibba020.yqfnwy (mgr.34427) 11102 : audit [DBG] from='client.51504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:23:52.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:51 gibba013 bash[29418]: audit 2021-03-10T17:23:50.609758+0000 mgr.gibba020.yqfnwy (mgr.34427) 11103 : audit [DBG] from='client.51510 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:23:52.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:51 gibba013 bash[29418]: audit 2021-03-10T17:23:50.877188+0000 mon.a (mon.0) 3918 : audit [DBG] from='client.? 172.21.2.113:0/3607231694' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:52.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:51 gibba013 bash[30381]: audit 2021-03-10T17:23:50.386306+0000 mgr.gibba020.yqfnwy (mgr.34427) 11102 : audit [DBG] from='client.51504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:23:52.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:51 gibba013 bash[30381]: audit 2021-03-10T17:23:50.609758+0000 mgr.gibba020.yqfnwy (mgr.34427) 11103 : audit [DBG] from='client.51510 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:23:52.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:51 gibba013 bash[30381]: audit 2021-03-10T17:23:50.877188+0000 mon.a (mon.0) 3918 : audit [DBG] from='client.? 172.21.2.113:0/3607231694' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:52.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:51 gibba020 bash[25448]: audit 2021-03-10T17:23:50.386306+0000 mgr.gibba020.yqfnwy (mgr.34427) 11102 : audit [DBG] from='client.51504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:23:52.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:51 gibba020 bash[25448]: audit 2021-03-10T17:23:50.609758+0000 mgr.gibba020.yqfnwy (mgr.34427) 11103 : audit [DBG] from='client.51510 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:23:52.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:51 gibba020 bash[25448]: audit 2021-03-10T17:23:50.877188+0000 mon.a (mon.0) 3918 : audit [DBG] from='client.? 172.21.2.113:0/3607231694' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:53.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:52 gibba013 bash[29418]: cluster 2021-03-10T17:23:51.694640+0000 mgr.gibba020.yqfnwy (mgr.34427) 11104 : cluster [DBG] pgmap v6333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:53.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:52 gibba013 bash[30381]: cluster 2021-03-10T17:23:51.694640+0000 mgr.gibba020.yqfnwy (mgr.34427) 11104 : cluster [DBG] pgmap v6333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:53.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:52 gibba020 bash[25448]: cluster 2021-03-10T17:23:51.694640+0000 mgr.gibba020.yqfnwy (mgr.34427) 11104 : cluster [DBG] pgmap v6333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:55.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:54 gibba013 bash[29418]: cluster 2021-03-10T17:23:53.696278+0000 mgr.gibba020.yqfnwy (mgr.34427) 11105 : cluster [DBG] pgmap v6334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:55.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:54 gibba013 bash[29418]: audit 2021-03-10T17:23:54.698295+0000 mon.a (mon.0) 3919 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:23:55.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:54 gibba013 bash[30381]: cluster 2021-03-10T17:23:53.696278+0000 mgr.gibba020.yqfnwy (mgr.34427) 11105 : cluster [DBG] pgmap v6334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:55.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:54 gibba013 bash[30381]: audit 2021-03-10T17:23:54.698295+0000 mon.a (mon.0) 3919 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:23:55.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:54 gibba020 bash[25448]: cluster 2021-03-10T17:23:53.696278+0000 mgr.gibba020.yqfnwy (mgr.34427) 11105 : cluster [DBG] pgmap v6334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:55.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:54 gibba020 bash[25448]: audit 2021-03-10T17:23:54.698295+0000 mon.a (mon.0) 3919 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:23:56.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:55 gibba013 bash[29418]: cephadm 2021-03-10T17:23:54.703070+0000 mgr.gibba020.yqfnwy (mgr.34427) 11106 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:23:56.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:55 gibba013 bash[29418]: cephadm 2021-03-10T17:23:54.704989+0000 mgr.gibba020.yqfnwy (mgr.34427) 11107 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:23:56.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:55 gibba013 bash[29418]: audit 2021-03-10T17:23:54.911032+0000 mon.a (mon.0) 3920 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:23:56.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:55 gibba013 bash[29418]: audit 2021-03-10T17:23:54.914171+0000 mon.a (mon.0) 3921 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:23:56.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:55 gibba013 bash[29418]: audit 2021-03-10T17:23:54.915529+0000 mon.a (mon.0) 3922 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:56.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:55 gibba013 bash[29418]: audit 2021-03-10T17:23:54.916995+0000 mon.a (mon.0) 3923 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:56.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:55 gibba013 bash[29418]: audit 2021-03-10T17:23:54.918509+0000 mon.a (mon.0) 3924 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:56.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:55 gibba013 bash[29418]: audit 2021-03-10T17:23:54.921231+0000 mon.a (mon.0) 3925 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:56.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:55 gibba013 bash[29418]: audit 2021-03-10T17:23:54.922761+0000 mon.a (mon.0) 3926 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:56.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:55 gibba013 bash[30381]: cephadm 2021-03-10T17:23:54.703070+0000 mgr.gibba020.yqfnwy (mgr.34427) 11106 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:23:56.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:55 gibba013 bash[30381]: cephadm 2021-03-10T17:23:54.704989+0000 mgr.gibba020.yqfnwy (mgr.34427) 11107 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:23:56.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:55 gibba013 bash[30381]: audit 2021-03-10T17:23:54.911032+0000 mon.a (mon.0) 3920 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:23:56.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:55 gibba013 bash[30381]: audit 2021-03-10T17:23:54.914171+0000 mon.a (mon.0) 3921 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:23:56.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:55 gibba013 bash[30381]: audit 2021-03-10T17:23:54.915529+0000 mon.a (mon.0) 3922 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:56.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:55 gibba013 bash[30381]: audit 2021-03-10T17:23:54.916995+0000 mon.a (mon.0) 3923 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:56.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:55 gibba013 bash[30381]: audit 2021-03-10T17:23:54.918509+0000 mon.a (mon.0) 3924 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:56.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:55 gibba013 bash[30381]: audit 2021-03-10T17:23:54.921231+0000 mon.a (mon.0) 3925 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:56.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:55 gibba013 bash[30381]: audit 2021-03-10T17:23:54.922761+0000 mon.a (mon.0) 3926 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:56.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:55 gibba020 bash[25448]: cephadm 2021-03-10T17:23:54.703070+0000 mgr.gibba020.yqfnwy (mgr.34427) 11106 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:23:56.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:55 gibba020 bash[25448]: cephadm 2021-03-10T17:23:54.704989+0000 mgr.gibba020.yqfnwy (mgr.34427) 11107 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:23:56.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:55 gibba020 bash[25448]: audit 2021-03-10T17:23:54.911032+0000 mon.a (mon.0) 3920 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:23:56.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:55 gibba020 bash[25448]: audit 2021-03-10T17:23:54.914171+0000 mon.a (mon.0) 3921 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:23:56.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:55 gibba020 bash[25448]: audit 2021-03-10T17:23:54.915529+0000 mon.a (mon.0) 3922 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:56.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:55 gibba020 bash[25448]: audit 2021-03-10T17:23:54.916995+0000 mon.a (mon.0) 3923 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:56.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:55 gibba020 bash[25448]: audit 2021-03-10T17:23:54.918509+0000 mon.a (mon.0) 3924 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:56.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:55 gibba020 bash[25448]: audit 2021-03-10T17:23:54.921231+0000 mon.a (mon.0) 3925 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:56.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:55 gibba020 bash[25448]: audit 2021-03-10T17:23:54.922761+0000 mon.a (mon.0) 3926 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:23:57.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:56 gibba013 bash[29418]: cephadm 2021-03-10T17:23:54.913077+0000 mgr.gibba020.yqfnwy (mgr.34427) 11108 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:23:57.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:56 gibba013 bash[29418]: cephadm 2021-03-10T17:23:54.914777+0000 mgr.gibba020.yqfnwy (mgr.34427) 11109 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:23:57.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:56 gibba013 bash[29418]: cephadm 2021-03-10T17:23:54.916028+0000 mgr.gibba020.yqfnwy (mgr.34427) 11110 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:23:57.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:56 gibba013 bash[29418]: cephadm 2021-03-10T17:23:54.916076+0000 mgr.gibba020.yqfnwy (mgr.34427) 11111 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:23:57.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:56 gibba013 bash[29418]: cephadm 2021-03-10T17:23:54.917533+0000 mgr.gibba020.yqfnwy (mgr.34427) 11112 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:23:57.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:56 gibba013 bash[29418]: cephadm 2021-03-10T17:23:54.917571+0000 mgr.gibba020.yqfnwy (mgr.34427) 11113 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:23:57.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:56 gibba013 bash[29418]: cephadm 2021-03-10T17:23:54.918950+0000 mgr.gibba020.yqfnwy (mgr.34427) 11114 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:23:57.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:56 gibba013 bash[29418]: cephadm 2021-03-10T17:23:54.920259+0000 mgr.gibba020.yqfnwy (mgr.34427) 11115 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:23:57.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:56 gibba013 bash[29418]: cephadm 2021-03-10T17:23:54.920296+0000 mgr.gibba020.yqfnwy (mgr.34427) 11116 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:23:57.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:56 gibba013 bash[29418]: cephadm 2021-03-10T17:23:54.921593+0000 mgr.gibba020.yqfnwy (mgr.34427) 11117 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:23:57.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:56 gibba013 bash[29418]: cephadm 2021-03-10T17:23:54.921913+0000 mgr.gibba020.yqfnwy (mgr.34427) 11118 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:23:57.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:56 gibba013 bash[29418]: cephadm 2021-03-10T17:23:54.923161+0000 mgr.gibba020.yqfnwy (mgr.34427) 11119 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:23:57.138 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:56 gibba013 bash[29418]: cephadm 2021-03-10T17:23:54.923233+0000 mgr.gibba020.yqfnwy (mgr.34427) 11120 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:23:57.138 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:56 gibba013 bash[29418]: cephadm 2021-03-10T17:23:54.923456+0000 mgr.gibba020.yqfnwy (mgr.34427) 11121 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:23:57.138 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:56 gibba013 bash[29418]: cluster 2021-03-10T17:23:55.697982+0000 mgr.gibba020.yqfnwy (mgr.34427) 11122 : cluster [DBG] pgmap v6335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:57.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:56 gibba013 bash[30381]: cephadm 2021-03-10T17:23:54.913077+0000 mgr.gibba020.yqfnwy (mgr.34427) 11108 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:23:57.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:56 gibba013 bash[30381]: cephadm 2021-03-10T17:23:54.914777+0000 mgr.gibba020.yqfnwy (mgr.34427) 11109 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:23:57.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:56 gibba013 bash[30381]: cephadm 2021-03-10T17:23:54.916028+0000 mgr.gibba020.yqfnwy (mgr.34427) 11110 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:23:57.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:56 gibba013 bash[30381]: cephadm 2021-03-10T17:23:54.916076+0000 mgr.gibba020.yqfnwy (mgr.34427) 11111 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:23:57.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:56 gibba013 bash[30381]: cephadm 2021-03-10T17:23:54.917533+0000 mgr.gibba020.yqfnwy (mgr.34427) 11112 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:23:57.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:56 gibba013 bash[30381]: cephadm 2021-03-10T17:23:54.917571+0000 mgr.gibba020.yqfnwy (mgr.34427) 11113 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:23:57.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:56 gibba013 bash[30381]: cephadm 2021-03-10T17:23:54.918950+0000 mgr.gibba020.yqfnwy (mgr.34427) 11114 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:23:57.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:56 gibba013 bash[30381]: cephadm 2021-03-10T17:23:54.920259+0000 mgr.gibba020.yqfnwy (mgr.34427) 11115 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:23:57.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:56 gibba013 bash[30381]: cephadm 2021-03-10T17:23:54.920296+0000 mgr.gibba020.yqfnwy (mgr.34427) 11116 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:23:57.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:56 gibba013 bash[30381]: cephadm 2021-03-10T17:23:54.921593+0000 mgr.gibba020.yqfnwy (mgr.34427) 11117 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:23:57.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:56 gibba013 bash[30381]: cephadm 2021-03-10T17:23:54.921913+0000 mgr.gibba020.yqfnwy (mgr.34427) 11118 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:23:57.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:56 gibba013 bash[30381]: cephadm 2021-03-10T17:23:54.923161+0000 mgr.gibba020.yqfnwy (mgr.34427) 11119 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:23:57.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:56 gibba013 bash[30381]: cephadm 2021-03-10T17:23:54.923233+0000 mgr.gibba020.yqfnwy (mgr.34427) 11120 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:23:57.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:56 gibba013 bash[30381]: cephadm 2021-03-10T17:23:54.923456+0000 mgr.gibba020.yqfnwy (mgr.34427) 11121 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:23:57.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:56 gibba013 bash[30381]: cluster 2021-03-10T17:23:55.697982+0000 mgr.gibba020.yqfnwy (mgr.34427) 11122 : cluster [DBG] pgmap v6335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:57.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:56 gibba020 bash[25448]: cephadm 2021-03-10T17:23:54.913077+0000 mgr.gibba020.yqfnwy (mgr.34427) 11108 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:23:57.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:56 gibba020 bash[25448]: cephadm 2021-03-10T17:23:54.914777+0000 mgr.gibba020.yqfnwy (mgr.34427) 11109 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:23:57.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:56 gibba020 bash[25448]: cephadm 2021-03-10T17:23:54.916028+0000 mgr.gibba020.yqfnwy (mgr.34427) 11110 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:23:57.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:56 gibba020 bash[25448]: cephadm 2021-03-10T17:23:54.916076+0000 mgr.gibba020.yqfnwy (mgr.34427) 11111 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:23:57.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:56 gibba020 bash[25448]: cephadm 2021-03-10T17:23:54.917533+0000 mgr.gibba020.yqfnwy (mgr.34427) 11112 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:23:57.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:56 gibba020 bash[25448]: cephadm 2021-03-10T17:23:54.917571+0000 mgr.gibba020.yqfnwy (mgr.34427) 11113 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:23:57.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:56 gibba020 bash[25448]: cephadm 2021-03-10T17:23:54.918950+0000 mgr.gibba020.yqfnwy (mgr.34427) 11114 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:23:57.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:56 gibba020 bash[25448]: cephadm 2021-03-10T17:23:54.920259+0000 mgr.gibba020.yqfnwy (mgr.34427) 11115 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:23:57.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:56 gibba020 bash[25448]: cephadm 2021-03-10T17:23:54.920296+0000 mgr.gibba020.yqfnwy (mgr.34427) 11116 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:23:57.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:56 gibba020 bash[25448]: cephadm 2021-03-10T17:23:54.921593+0000 mgr.gibba020.yqfnwy (mgr.34427) 11117 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:23:57.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:56 gibba020 bash[25448]: cephadm 2021-03-10T17:23:54.921913+0000 mgr.gibba020.yqfnwy (mgr.34427) 11118 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:23:57.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:56 gibba020 bash[25448]: cephadm 2021-03-10T17:23:54.923161+0000 mgr.gibba020.yqfnwy (mgr.34427) 11119 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:23:57.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:56 gibba020 bash[25448]: cephadm 2021-03-10T17:23:54.923233+0000 mgr.gibba020.yqfnwy (mgr.34427) 11120 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:23:57.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:56 gibba020 bash[25448]: cephadm 2021-03-10T17:23:54.923456+0000 mgr.gibba020.yqfnwy (mgr.34427) 11121 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:23:57.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:56 gibba020 bash[25448]: cluster 2021-03-10T17:23:55.697982+0000 mgr.gibba020.yqfnwy (mgr.34427) 11122 : cluster [DBG] pgmap v6335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:59.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:23:58 gibba013 bash[29418]: cluster 2021-03-10T17:23:57.699241+0000 mgr.gibba020.yqfnwy (mgr.34427) 11123 : cluster [DBG] pgmap v6336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:59.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:23:58 gibba013 bash[30381]: cluster 2021-03-10T17:23:57.699241+0000 mgr.gibba020.yqfnwy (mgr.34427) 11123 : cluster [DBG] pgmap v6336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:23:59.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:23:58 gibba020 bash[25448]: cluster 2021-03-10T17:23:57.699241+0000 mgr.gibba020.yqfnwy (mgr.34427) 11123 : cluster [DBG] pgmap v6336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:01.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:00 gibba013 bash[29418]: cluster 2021-03-10T17:23:59.700727+0000 mgr.gibba020.yqfnwy (mgr.34427) 11124 : cluster [DBG] pgmap v6337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:01.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:00 gibba013 bash[30381]: cluster 2021-03-10T17:23:59.700727+0000 mgr.gibba020.yqfnwy (mgr.34427) 11124 : cluster [DBG] pgmap v6337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:01.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:00 gibba020 bash[25448]: cluster 2021-03-10T17:23:59.700727+0000 mgr.gibba020.yqfnwy (mgr.34427) 11124 : cluster [DBG] pgmap v6337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:02.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:01 gibba020 bash[25448]: cluster 2021-03-10T17:24:01.701872+0000 mgr.gibba020.yqfnwy (mgr.34427) 11125 : cluster [DBG] pgmap v6338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:02.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:01 gibba013 bash[29418]: cluster 2021-03-10T17:24:01.701872+0000 mgr.gibba020.yqfnwy (mgr.34427) 11125 : cluster [DBG] pgmap v6338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:02.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:01 gibba013 bash[30381]: cluster 2021-03-10T17:24:01.701872+0000 mgr.gibba020.yqfnwy (mgr.34427) 11125 : cluster [DBG] pgmap v6338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:05.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:04 gibba013 bash[29418]: cluster 2021-03-10T17:24:03.703263+0000 mgr.gibba020.yqfnwy (mgr.34427) 11126 : cluster [DBG] pgmap v6339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:05.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:04 gibba013 bash[30381]: cluster 2021-03-10T17:24:03.703263+0000 mgr.gibba020.yqfnwy (mgr.34427) 11126 : cluster [DBG] pgmap v6339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:05.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:04 gibba020 bash[25448]: cluster 2021-03-10T17:24:03.703263+0000 mgr.gibba020.yqfnwy (mgr.34427) 11126 : cluster [DBG] pgmap v6339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:07.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:06 gibba013 bash[29418]: cluster 2021-03-10T17:24:05.704795+0000 mgr.gibba020.yqfnwy (mgr.34427) 11127 : cluster [DBG] pgmap v6340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:07.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:06 gibba013 bash[30381]: cluster 2021-03-10T17:24:05.704795+0000 mgr.gibba020.yqfnwy (mgr.34427) 11127 : cluster [DBG] pgmap v6340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:07.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:06 gibba020 bash[25448]: cluster 2021-03-10T17:24:05.704795+0000 mgr.gibba020.yqfnwy (mgr.34427) 11127 : cluster [DBG] pgmap v6340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:08.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:07 gibba013 bash[29418]: audit 2021-03-10T17:24:06.978646+0000 mon.a (mon.0) 3927 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:24:08.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:07 gibba013 bash[29418]: audit 2021-03-10T17:24:07.212650+0000 mon.a (mon.0) 3928 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:24:08.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:07 gibba013 bash[29418]: audit 2021-03-10T17:24:07.648354+0000 mon.a (mon.0) 3929 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T17:24:08.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:07 gibba013 bash[29418]: audit 2021-03-10T17:24:07.649133+0000 mon.a (mon.0) 3930 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:24:08.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:07 gibba013 bash[29418]: audit 2021-03-10T17:24:07.649874+0000 mon.a (mon.0) 3931 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:24:08.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:07 gibba013 bash[29418]: audit 2021-03-10T17:24:07.650627+0000 mon.a (mon.0) 3932 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:24:08.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:07 gibba013 bash[30381]: audit 2021-03-10T17:24:06.978646+0000 mon.a (mon.0) 3927 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:24:08.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:07 gibba013 bash[30381]: audit 2021-03-10T17:24:07.212650+0000 mon.a (mon.0) 3928 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:24:08.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:07 gibba013 bash[30381]: audit 2021-03-10T17:24:07.648354+0000 mon.a (mon.0) 3929 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T17:24:08.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:07 gibba013 bash[30381]: audit 2021-03-10T17:24:07.649133+0000 mon.a (mon.0) 3930 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:24:08.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:07 gibba013 bash[30381]: audit 2021-03-10T17:24:07.649874+0000 mon.a (mon.0) 3931 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:24:08.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:07 gibba013 bash[30381]: audit 2021-03-10T17:24:07.650627+0000 mon.a (mon.0) 3932 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:24:08.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:07 gibba020 bash[25448]: audit 2021-03-10T17:24:06.978646+0000 mon.a (mon.0) 3927 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:24:08.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:07 gibba020 bash[25448]: audit 2021-03-10T17:24:07.212650+0000 mon.a (mon.0) 3928 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:24:08.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:07 gibba020 bash[25448]: audit 2021-03-10T17:24:07.648354+0000 mon.a (mon.0) 3929 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T17:24:08.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:07 gibba020 bash[25448]: audit 2021-03-10T17:24:07.649133+0000 mon.a (mon.0) 3930 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:24:08.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:07 gibba020 bash[25448]: audit 2021-03-10T17:24:07.649874+0000 mon.a (mon.0) 3931 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:24:08.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:07 gibba020 bash[25448]: audit 2021-03-10T17:24:07.650627+0000 mon.a (mon.0) 3932 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:24:09.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:08 gibba013 bash[29418]: cluster 2021-03-10T17:24:07.706317+0000 mgr.gibba020.yqfnwy (mgr.34427) 11128 : cluster [DBG] pgmap v6341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:09.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:08 gibba013 bash[30381]: cluster 2021-03-10T17:24:07.706317+0000 mgr.gibba020.yqfnwy (mgr.34427) 11128 : cluster [DBG] pgmap v6341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:09.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:08 gibba020 bash[25448]: cluster 2021-03-10T17:24:07.706317+0000 mgr.gibba020.yqfnwy (mgr.34427) 11128 : cluster [DBG] pgmap v6341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:11.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:10 gibba013 bash[29418]: cluster 2021-03-10T17:24:09.707812+0000 mgr.gibba020.yqfnwy (mgr.34427) 11129 : cluster [DBG] pgmap v6342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:11.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:10 gibba013 bash[30381]: cluster 2021-03-10T17:24:09.707812+0000 mgr.gibba020.yqfnwy (mgr.34427) 11129 : cluster [DBG] pgmap v6342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:11.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:10 gibba020 bash[25448]: cluster 2021-03-10T17:24:09.707812+0000 mgr.gibba020.yqfnwy (mgr.34427) 11129 : cluster [DBG] pgmap v6342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:12.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:11 gibba013 bash[29418]: cephadm 2021-03-10T17:24:09.938610+0000 mgr.gibba020.yqfnwy (mgr.34427) 11130 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:24:12.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:11 gibba013 bash[30381]: cephadm 2021-03-10T17:24:09.938610+0000 mgr.gibba020.yqfnwy (mgr.34427) 11130 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:24:12.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:11 gibba020 bash[25448]: cephadm 2021-03-10T17:24:09.938610+0000 mgr.gibba020.yqfnwy (mgr.34427) 11130 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:24:13.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:12 gibba013 bash[29418]: cluster 2021-03-10T17:24:11.708748+0000 mgr.gibba020.yqfnwy (mgr.34427) 11131 : cluster [DBG] pgmap v6343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:13.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:12 gibba013 bash[30381]: cluster 2021-03-10T17:24:11.708748+0000 mgr.gibba020.yqfnwy (mgr.34427) 11131 : cluster [DBG] pgmap v6343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:13.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:12 gibba020 bash[25448]: cluster 2021-03-10T17:24:11.708748+0000 mgr.gibba020.yqfnwy (mgr.34427) 11131 : cluster [DBG] pgmap v6343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:15.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:14 gibba013 bash[29418]: cluster 2021-03-10T17:24:13.710148+0000 mgr.gibba020.yqfnwy (mgr.34427) 11132 : cluster [DBG] pgmap v6344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:15.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:14 gibba013 bash[30381]: cluster 2021-03-10T17:24:13.710148+0000 mgr.gibba020.yqfnwy (mgr.34427) 11132 : cluster [DBG] pgmap v6344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:15.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:14 gibba020 bash[25448]: cluster 2021-03-10T17:24:13.710148+0000 mgr.gibba020.yqfnwy (mgr.34427) 11132 : cluster [DBG] pgmap v6344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:17.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:16 gibba013 bash[30381]: cluster 2021-03-10T17:24:15.711839+0000 mgr.gibba020.yqfnwy (mgr.34427) 11133 : cluster [DBG] pgmap v6345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:17.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:16 gibba013 bash[29418]: cluster 2021-03-10T17:24:15.711839+0000 mgr.gibba020.yqfnwy (mgr.34427) 11133 : cluster [DBG] pgmap v6345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:17.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:16 gibba020 bash[25448]: cluster 2021-03-10T17:24:15.711839+0000 mgr.gibba020.yqfnwy (mgr.34427) 11133 : cluster [DBG] pgmap v6345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:19.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:18 gibba013 bash[29418]: cluster 2021-03-10T17:24:17.713269+0000 mgr.gibba020.yqfnwy (mgr.34427) 11134 : cluster [DBG] pgmap v6346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:19.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:18 gibba013 bash[30381]: cluster 2021-03-10T17:24:17.713269+0000 mgr.gibba020.yqfnwy (mgr.34427) 11134 : cluster [DBG] pgmap v6346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:19.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:18 gibba020 bash[25448]: cluster 2021-03-10T17:24:17.713269+0000 mgr.gibba020.yqfnwy (mgr.34427) 11134 : cluster [DBG] pgmap v6346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:21.121 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:24:21.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:20 gibba013 bash[29418]: cluster 2021-03-10T17:24:19.714641+0000 mgr.gibba020.yqfnwy (mgr.34427) 11135 : cluster [DBG] pgmap v6347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:21.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:20 gibba013 bash[30381]: cluster 2021-03-10T17:24:19.714641+0000 mgr.gibba020.yqfnwy (mgr.34427) 11135 : cluster [DBG] pgmap v6347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:21.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:20 gibba020 bash[25448]: cluster 2021-03-10T17:24:19.714641+0000 mgr.gibba020.yqfnwy (mgr.34427) 11135 : cluster [DBG] pgmap v6347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:21.349 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:24:21.349 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 2m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:24:21.349 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 91s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:24:21.349 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 91s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:24:21.350 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 91s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:24:21.350 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:24:21.350 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:24:21.351 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 91s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:24:21.351 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:24:21.351 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:24:21.351 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 91s ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:24:21.352 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:24:21.352 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:24:21.352 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:24:21.352 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:24:21.353 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 91s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:24:21.353 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 91s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:24:21.353 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 91s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:24:21.353 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 91s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:24:21.353 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 91s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:24:21.354 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 91s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:24:21.602 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:24:21.603 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:24:21.603 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:24:21.603 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:24:21.604 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:24:21.604 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:24:21.604 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:24:21.604 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:24:21.604 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:24:21.605 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:24:21.605 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:24:21.605 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:24:21.606 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:24:21.607 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:24:21.607 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:24:22.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:21 gibba020 bash[25448]: audit 2021-03-10T17:24:21.110781+0000 mgr.gibba020.yqfnwy (mgr.34427) 11136 : audit [DBG] from='client.51522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:24:22.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:21 gibba020 bash[25448]: audit 2021-03-10T17:24:21.334738+0000 mgr.gibba020.yqfnwy (mgr.34427) 11137 : audit [DBG] from='client.61507 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:24:22.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:21 gibba020 bash[25448]: audit 2021-03-10T17:24:21.601698+0000 mon.c (mon.1) 169 : audit [DBG] from='client.? 172.21.2.113:0/620747849' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:22.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:21 gibba020 bash[25448]: cluster 2021-03-10T17:24:21.716375+0000 mgr.gibba020.yqfnwy (mgr.34427) 11138 : cluster [DBG] pgmap v6348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:22.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:21 gibba013 bash[29418]: audit 2021-03-10T17:24:21.110781+0000 mgr.gibba020.yqfnwy (mgr.34427) 11136 : audit [DBG] from='client.51522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:24:22.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:21 gibba013 bash[29418]: audit 2021-03-10T17:24:21.334738+0000 mgr.gibba020.yqfnwy (mgr.34427) 11137 : audit [DBG] from='client.61507 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:24:22.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:21 gibba013 bash[29418]: audit 2021-03-10T17:24:21.601698+0000 mon.c (mon.1) 169 : audit [DBG] from='client.? 172.21.2.113:0/620747849' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:22.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:21 gibba013 bash[29418]: cluster 2021-03-10T17:24:21.716375+0000 mgr.gibba020.yqfnwy (mgr.34427) 11138 : cluster [DBG] pgmap v6348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:22.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:21 gibba013 bash[30381]: audit 2021-03-10T17:24:21.110781+0000 mgr.gibba020.yqfnwy (mgr.34427) 11136 : audit [DBG] from='client.51522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:24:22.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:21 gibba013 bash[30381]: audit 2021-03-10T17:24:21.334738+0000 mgr.gibba020.yqfnwy (mgr.34427) 11137 : audit [DBG] from='client.61507 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:24:22.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:21 gibba013 bash[30381]: audit 2021-03-10T17:24:21.601698+0000 mon.c (mon.1) 169 : audit [DBG] from='client.? 172.21.2.113:0/620747849' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:22.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:21 gibba013 bash[30381]: cluster 2021-03-10T17:24:21.716375+0000 mgr.gibba020.yqfnwy (mgr.34427) 11138 : cluster [DBG] pgmap v6348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:25.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:24 gibba013 bash[29418]: cluster 2021-03-10T17:24:23.717791+0000 mgr.gibba020.yqfnwy (mgr.34427) 11139 : cluster [DBG] pgmap v6349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:25.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:24 gibba013 bash[30381]: cluster 2021-03-10T17:24:23.717791+0000 mgr.gibba020.yqfnwy (mgr.34427) 11139 : cluster [DBG] pgmap v6349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:25.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:24 gibba020 bash[25448]: cluster 2021-03-10T17:24:23.717791+0000 mgr.gibba020.yqfnwy (mgr.34427) 11139 : cluster [DBG] pgmap v6349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:27.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:26 gibba013 bash[29418]: cephadm 2021-03-10T17:24:24.954759+0000 mgr.gibba020.yqfnwy (mgr.34427) 11140 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:24:27.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:26 gibba013 bash[29418]: cluster 2021-03-10T17:24:25.719453+0000 mgr.gibba020.yqfnwy (mgr.34427) 11141 : cluster [DBG] pgmap v6350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:27.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:26 gibba013 bash[30381]: cephadm 2021-03-10T17:24:24.954759+0000 mgr.gibba020.yqfnwy (mgr.34427) 11140 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:24:27.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:26 gibba013 bash[30381]: cluster 2021-03-10T17:24:25.719453+0000 mgr.gibba020.yqfnwy (mgr.34427) 11141 : cluster [DBG] pgmap v6350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:27.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:26 gibba020 bash[25448]: cephadm 2021-03-10T17:24:24.954759+0000 mgr.gibba020.yqfnwy (mgr.34427) 11140 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:24:27.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:26 gibba020 bash[25448]: cluster 2021-03-10T17:24:25.719453+0000 mgr.gibba020.yqfnwy (mgr.34427) 11141 : cluster [DBG] pgmap v6350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:29.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:28 gibba013 bash[29418]: cluster 2021-03-10T17:24:27.721006+0000 mgr.gibba020.yqfnwy (mgr.34427) 11142 : cluster [DBG] pgmap v6351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:29.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:28 gibba013 bash[30381]: cluster 2021-03-10T17:24:27.721006+0000 mgr.gibba020.yqfnwy (mgr.34427) 11142 : cluster [DBG] pgmap v6351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:29.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:28 gibba020 bash[25448]: cluster 2021-03-10T17:24:27.721006+0000 mgr.gibba020.yqfnwy (mgr.34427) 11142 : cluster [DBG] pgmap v6351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:31.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:30 gibba013 bash[29418]: cluster 2021-03-10T17:24:29.722246+0000 mgr.gibba020.yqfnwy (mgr.34427) 11143 : cluster [DBG] pgmap v6352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:31.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:30 gibba013 bash[30381]: cluster 2021-03-10T17:24:29.722246+0000 mgr.gibba020.yqfnwy (mgr.34427) 11143 : cluster [DBG] pgmap v6352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:31.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:30 gibba020 bash[25448]: cluster 2021-03-10T17:24:29.722246+0000 mgr.gibba020.yqfnwy (mgr.34427) 11143 : cluster [DBG] pgmap v6352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:32.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:31 gibba013 bash[29418]: cluster 2021-03-10T17:24:31.724189+0000 mgr.gibba020.yqfnwy (mgr.34427) 11144 : cluster [DBG] pgmap v6353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:32.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:31 gibba013 bash[30381]: cluster 2021-03-10T17:24:31.724189+0000 mgr.gibba020.yqfnwy (mgr.34427) 11144 : cluster [DBG] pgmap v6353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:32.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:31 gibba020 bash[25448]: cluster 2021-03-10T17:24:31.724189+0000 mgr.gibba020.yqfnwy (mgr.34427) 11144 : cluster [DBG] pgmap v6353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:35.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:34 gibba013 bash[29418]: cluster 2021-03-10T17:24:33.725698+0000 mgr.gibba020.yqfnwy (mgr.34427) 11145 : cluster [DBG] pgmap v6354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:35.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:34 gibba013 bash[30381]: cluster 2021-03-10T17:24:33.725698+0000 mgr.gibba020.yqfnwy (mgr.34427) 11145 : cluster [DBG] pgmap v6354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:35.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:34 gibba020 bash[25448]: cluster 2021-03-10T17:24:33.725698+0000 mgr.gibba020.yqfnwy (mgr.34427) 11145 : cluster [DBG] pgmap v6354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:37.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:36 gibba013 bash[29418]: cluster 2021-03-10T17:24:35.727356+0000 mgr.gibba020.yqfnwy (mgr.34427) 11146 : cluster [DBG] pgmap v6355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:37.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:36 gibba013 bash[30381]: cluster 2021-03-10T17:24:35.727356+0000 mgr.gibba020.yqfnwy (mgr.34427) 11146 : cluster [DBG] pgmap v6355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:37.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:36 gibba020 bash[25448]: cluster 2021-03-10T17:24:35.727356+0000 mgr.gibba020.yqfnwy (mgr.34427) 11146 : cluster [DBG] pgmap v6355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:39.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:38 gibba013 bash[29418]: cluster 2021-03-10T17:24:37.728626+0000 mgr.gibba020.yqfnwy (mgr.34427) 11147 : cluster [DBG] pgmap v6356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:39.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:38 gibba013 bash[30381]: cluster 2021-03-10T17:24:37.728626+0000 mgr.gibba020.yqfnwy (mgr.34427) 11147 : cluster [DBG] pgmap v6356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:39.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:38 gibba020 bash[25448]: cluster 2021-03-10T17:24:37.728626+0000 mgr.gibba020.yqfnwy (mgr.34427) 11147 : cluster [DBG] pgmap v6356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:41.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:40 gibba013 bash[29418]: cluster 2021-03-10T17:24:39.729899+0000 mgr.gibba020.yqfnwy (mgr.34427) 11148 : cluster [DBG] pgmap v6357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:41.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:40 gibba013 bash[30381]: cluster 2021-03-10T17:24:39.729899+0000 mgr.gibba020.yqfnwy (mgr.34427) 11148 : cluster [DBG] pgmap v6357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:41.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:40 gibba020 bash[25448]: cluster 2021-03-10T17:24:39.729899+0000 mgr.gibba020.yqfnwy (mgr.34427) 11148 : cluster [DBG] pgmap v6357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:42.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:41 gibba013 bash[29418]: cephadm 2021-03-10T17:24:39.968851+0000 mgr.gibba020.yqfnwy (mgr.34427) 11149 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:24:42.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:41 gibba013 bash[30381]: cephadm 2021-03-10T17:24:39.968851+0000 mgr.gibba020.yqfnwy (mgr.34427) 11149 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:24:42.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:41 gibba020 bash[25448]: cephadm 2021-03-10T17:24:39.968851+0000 mgr.gibba020.yqfnwy (mgr.34427) 11149 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:24:43.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:42 gibba013 bash[29418]: cluster 2021-03-10T17:24:41.731714+0000 mgr.gibba020.yqfnwy (mgr.34427) 11150 : cluster [DBG] pgmap v6358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:43.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:42 gibba013 bash[30381]: cluster 2021-03-10T17:24:41.731714+0000 mgr.gibba020.yqfnwy (mgr.34427) 11150 : cluster [DBG] pgmap v6358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:43.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:42 gibba020 bash[25448]: cluster 2021-03-10T17:24:41.731714+0000 mgr.gibba020.yqfnwy (mgr.34427) 11150 : cluster [DBG] pgmap v6358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:45.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:44 gibba013 bash[29418]: cluster 2021-03-10T17:24:43.733364+0000 mgr.gibba020.yqfnwy (mgr.34427) 11151 : cluster [DBG] pgmap v6359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:45.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:44 gibba013 bash[30381]: cluster 2021-03-10T17:24:43.733364+0000 mgr.gibba020.yqfnwy (mgr.34427) 11151 : cluster [DBG] pgmap v6359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:45.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:44 gibba020 bash[25448]: cluster 2021-03-10T17:24:43.733364+0000 mgr.gibba020.yqfnwy (mgr.34427) 11151 : cluster [DBG] pgmap v6359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:47.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:46 gibba013 bash[29418]: cluster 2021-03-10T17:24:45.734984+0000 mgr.gibba020.yqfnwy (mgr.34427) 11152 : cluster [DBG] pgmap v6360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:47.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:46 gibba013 bash[30381]: cluster 2021-03-10T17:24:45.734984+0000 mgr.gibba020.yqfnwy (mgr.34427) 11152 : cluster [DBG] pgmap v6360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:47.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:46 gibba020 bash[25448]: cluster 2021-03-10T17:24:45.734984+0000 mgr.gibba020.yqfnwy (mgr.34427) 11152 : cluster [DBG] pgmap v6360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:49.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:48 gibba013 bash[29418]: cluster 2021-03-10T17:24:47.736452+0000 mgr.gibba020.yqfnwy (mgr.34427) 11153 : cluster [DBG] pgmap v6361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:49.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:48 gibba013 bash[30381]: cluster 2021-03-10T17:24:47.736452+0000 mgr.gibba020.yqfnwy (mgr.34427) 11153 : cluster [DBG] pgmap v6361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:49.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:48 gibba020 bash[25448]: cluster 2021-03-10T17:24:47.736452+0000 mgr.gibba020.yqfnwy (mgr.34427) 11153 : cluster [DBG] pgmap v6361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:51.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:50 gibba013 bash[29418]: cluster 2021-03-10T17:24:49.738022+0000 mgr.gibba020.yqfnwy (mgr.34427) 11154 : cluster [DBG] pgmap v6362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:51.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:50 gibba013 bash[30381]: cluster 2021-03-10T17:24:49.738022+0000 mgr.gibba020.yqfnwy (mgr.34427) 11154 : cluster [DBG] pgmap v6362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:51.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:50 gibba020 bash[25448]: cluster 2021-03-10T17:24:49.738022+0000 mgr.gibba020.yqfnwy (mgr.34427) 11154 : cluster [DBG] pgmap v6362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:51.854 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:24:52.087 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:24:52.088 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 3m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:24:52.088 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 2m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:24:52.088 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:24:52.088 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:24:52.089 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:24:52.089 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:24:52.089 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:24:52.089 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:24:52.090 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:24:52.090 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:24:52.090 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:24:52.090 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:24:52.090 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:24:52.091 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:24:52.091 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:24:52.091 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:24:52.091 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:24:52.092 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:24:52.092 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 2m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:24:52.092 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:24:52.336 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:24:52.336 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:24:52.337 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:24:52.337 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:24:52.337 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:24:52.337 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:24:52.338 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:24:52.338 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:24:52.338 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:24:52.338 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:24:52.338 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:24:52.339 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:24:52.339 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:24:52.339 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:24:52.339 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:24:52.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:51 gibba013 bash[30381]: cluster 2021-03-10T17:24:51.739934+0000 mgr.gibba020.yqfnwy (mgr.34427) 11155 : cluster [DBG] pgmap v6363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:52.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:51 gibba013 bash[30381]: audit 2021-03-10T17:24:51.843713+0000 mgr.gibba020.yqfnwy (mgr.34427) 11156 : audit [DBG] from='client.51540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:24:52.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:51 gibba013 bash[29418]: cluster 2021-03-10T17:24:51.739934+0000 mgr.gibba020.yqfnwy (mgr.34427) 11155 : cluster [DBG] pgmap v6363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:52.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:51 gibba013 bash[29418]: audit 2021-03-10T17:24:51.843713+0000 mgr.gibba020.yqfnwy (mgr.34427) 11156 : audit [DBG] from='client.51540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:24:52.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:51 gibba020 bash[25448]: cluster 2021-03-10T17:24:51.739934+0000 mgr.gibba020.yqfnwy (mgr.34427) 11155 : cluster [DBG] pgmap v6363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:52.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:51 gibba020 bash[25448]: audit 2021-03-10T17:24:51.843713+0000 mgr.gibba020.yqfnwy (mgr.34427) 11156 : audit [DBG] from='client.51540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:24:53.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:52 gibba013 bash[29418]: audit 2021-03-10T17:24:52.073645+0000 mgr.gibba020.yqfnwy (mgr.34427) 11157 : audit [DBG] from='client.51546 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:24:53.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:52 gibba013 bash[29418]: audit 2021-03-10T17:24:52.334996+0000 mon.c (mon.1) 170 : audit [DBG] from='client.? 172.21.2.113:0/2072605708' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:53.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:52 gibba013 bash[30381]: audit 2021-03-10T17:24:52.073645+0000 mgr.gibba020.yqfnwy (mgr.34427) 11157 : audit [DBG] from='client.51546 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:24:53.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:52 gibba013 bash[30381]: audit 2021-03-10T17:24:52.334996+0000 mon.c (mon.1) 170 : audit [DBG] from='client.? 172.21.2.113:0/2072605708' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:53.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:52 gibba020 bash[25448]: audit 2021-03-10T17:24:52.073645+0000 mgr.gibba020.yqfnwy (mgr.34427) 11157 : audit [DBG] from='client.51546 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:24:53.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:52 gibba020 bash[25448]: audit 2021-03-10T17:24:52.334996+0000 mon.c (mon.1) 170 : audit [DBG] from='client.? 172.21.2.113:0/2072605708' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:54.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:53 gibba013 bash[29418]: cluster 2021-03-10T17:24:53.741655+0000 mgr.gibba020.yqfnwy (mgr.34427) 11158 : cluster [DBG] pgmap v6364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:54.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:53 gibba013 bash[30381]: cluster 2021-03-10T17:24:53.741655+0000 mgr.gibba020.yqfnwy (mgr.34427) 11158 : cluster [DBG] pgmap v6364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:54.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:53 gibba020 bash[25448]: cluster 2021-03-10T17:24:53.741655+0000 mgr.gibba020.yqfnwy (mgr.34427) 11158 : cluster [DBG] pgmap v6364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:55.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:54 gibba013 bash[29418]: audit 2021-03-10T17:24:54.976996+0000 mon.a (mon.0) 3933 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:24:55.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:54 gibba013 bash[30381]: audit 2021-03-10T17:24:54.976996+0000 mon.a (mon.0) 3933 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:24:55.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:54 gibba020 bash[25448]: audit 2021-03-10T17:24:54.976996+0000 mon.a (mon.0) 3933 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:24:56.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:56 gibba020 bash[25448]: cephadm 2021-03-10T17:24:54.982391+0000 mgr.gibba020.yqfnwy (mgr.34427) 11159 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:24:56.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:56 gibba020 bash[25448]: cephadm 2021-03-10T17:24:54.984174+0000 mgr.gibba020.yqfnwy (mgr.34427) 11160 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:24:56.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:56 gibba020 bash[25448]: audit 2021-03-10T17:24:55.184888+0000 mon.a (mon.0) 3934 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:24:56.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:56 gibba020 bash[25448]: cephadm 2021-03-10T17:24:55.186990+0000 mgr.gibba020.yqfnwy (mgr.34427) 11161 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:24:56.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:56 gibba020 bash[25448]: audit 2021-03-10T17:24:55.188430+0000 mon.a (mon.0) 3935 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:24:56.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:56 gibba020 bash[25448]: cephadm 2021-03-10T17:24:55.189633+0000 mgr.gibba020.yqfnwy (mgr.34427) 11162 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:24:56.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:56 gibba020 bash[25448]: audit 2021-03-10T17:24:55.190627+0000 mon.a (mon.0) 3936 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:56.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:56 gibba020 bash[25448]: cephadm 2021-03-10T17:24:55.191589+0000 mgr.gibba020.yqfnwy (mgr.34427) 11163 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:24:56.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:56 gibba020 bash[25448]: cephadm 2021-03-10T17:24:55.191625+0000 mgr.gibba020.yqfnwy (mgr.34427) 11164 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:24:56.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:56 gibba020 bash[25448]: audit 2021-03-10T17:24:55.192609+0000 mon.a (mon.0) 3937 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:56.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:56 gibba020 bash[25448]: cephadm 2021-03-10T17:24:55.193727+0000 mgr.gibba020.yqfnwy (mgr.34427) 11165 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:24:56.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:56 gibba020 bash[25448]: cephadm 2021-03-10T17:24:55.193764+0000 mgr.gibba020.yqfnwy (mgr.34427) 11166 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:24:56.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:56 gibba020 bash[25448]: audit 2021-03-10T17:24:55.194701+0000 mon.a (mon.0) 3938 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:56.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:56 gibba020 bash[25448]: cephadm 2021-03-10T17:24:55.195676+0000 mgr.gibba020.yqfnwy (mgr.34427) 11167 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:24:56.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:56 gibba020 bash[25448]: cephadm 2021-03-10T17:24:55.197878+0000 mgr.gibba020.yqfnwy (mgr.34427) 11168 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:24:56.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:56 gibba020 bash[25448]: cephadm 2021-03-10T17:24:55.198008+0000 mgr.gibba020.yqfnwy (mgr.34427) 11169 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:24:56.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:56 gibba020 bash[25448]: audit 2021-03-10T17:24:55.199361+0000 mon.a (mon.0) 3939 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:56.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:56 gibba020 bash[25448]: cephadm 2021-03-10T17:24:55.200869+0000 mgr.gibba020.yqfnwy (mgr.34427) 11170 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:24:56.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:56 gibba020 bash[25448]: cephadm 2021-03-10T17:24:55.201312+0000 mgr.gibba020.yqfnwy (mgr.34427) 11171 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:24:56.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:56 gibba020 bash[25448]: audit 2021-03-10T17:24:55.202406+0000 mon.a (mon.0) 3940 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:56.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:56 gibba020 bash[25448]: cephadm 2021-03-10T17:24:55.203636+0000 mgr.gibba020.yqfnwy (mgr.34427) 11172 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:24:56.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:56 gibba020 bash[25448]: cephadm 2021-03-10T17:24:55.203678+0000 mgr.gibba020.yqfnwy (mgr.34427) 11173 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:24:56.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:56 gibba020 bash[25448]: cephadm 2021-03-10T17:24:55.203855+0000 mgr.gibba020.yqfnwy (mgr.34427) 11174 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:24:56.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:56 gibba020 bash[25448]: cluster 2021-03-10T17:24:55.743234+0000 mgr.gibba020.yqfnwy (mgr.34427) 11175 : cluster [DBG] pgmap v6365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:56.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[29418]: cephadm 2021-03-10T17:24:54.982391+0000 mgr.gibba020.yqfnwy (mgr.34427) 11159 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:24:56.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[29418]: cephadm 2021-03-10T17:24:54.984174+0000 mgr.gibba020.yqfnwy (mgr.34427) 11160 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:24:56.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[29418]: audit 2021-03-10T17:24:55.184888+0000 mon.a (mon.0) 3934 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:24:56.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[29418]: cephadm 2021-03-10T17:24:55.186990+0000 mgr.gibba020.yqfnwy (mgr.34427) 11161 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:24:56.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[29418]: audit 2021-03-10T17:24:55.188430+0000 mon.a (mon.0) 3935 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:24:56.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[29418]: cephadm 2021-03-10T17:24:55.189633+0000 mgr.gibba020.yqfnwy (mgr.34427) 11162 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:24:56.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[29418]: audit 2021-03-10T17:24:55.190627+0000 mon.a (mon.0) 3936 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:56.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[29418]: cephadm 2021-03-10T17:24:55.191589+0000 mgr.gibba020.yqfnwy (mgr.34427) 11163 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:24:56.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[29418]: cephadm 2021-03-10T17:24:55.191625+0000 mgr.gibba020.yqfnwy (mgr.34427) 11164 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:24:56.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[29418]: audit 2021-03-10T17:24:55.192609+0000 mon.a (mon.0) 3937 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:56.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[29418]: cephadm 2021-03-10T17:24:55.193727+0000 mgr.gibba020.yqfnwy (mgr.34427) 11165 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:24:56.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[29418]: cephadm 2021-03-10T17:24:55.193764+0000 mgr.gibba020.yqfnwy (mgr.34427) 11166 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:24:56.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[29418]: audit 2021-03-10T17:24:55.194701+0000 mon.a (mon.0) 3938 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:56.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[29418]: cephadm 2021-03-10T17:24:55.195676+0000 mgr.gibba020.yqfnwy (mgr.34427) 11167 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:24:56.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[29418]: cephadm 2021-03-10T17:24:55.197878+0000 mgr.gibba020.yqfnwy (mgr.34427) 11168 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:24:56.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[29418]: cephadm 2021-03-10T17:24:55.198008+0000 mgr.gibba020.yqfnwy (mgr.34427) 11169 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:24:56.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[29418]: audit 2021-03-10T17:24:55.199361+0000 mon.a (mon.0) 3939 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:56.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[29418]: cephadm 2021-03-10T17:24:55.200869+0000 mgr.gibba020.yqfnwy (mgr.34427) 11170 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:24:56.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[29418]: cephadm 2021-03-10T17:24:55.201312+0000 mgr.gibba020.yqfnwy (mgr.34427) 11171 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:24:56.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[29418]: audit 2021-03-10T17:24:55.202406+0000 mon.a (mon.0) 3940 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:56.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[29418]: cephadm 2021-03-10T17:24:55.203636+0000 mgr.gibba020.yqfnwy (mgr.34427) 11172 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:24:56.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[29418]: cephadm 2021-03-10T17:24:55.203678+0000 mgr.gibba020.yqfnwy (mgr.34427) 11173 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:24:56.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[29418]: cephadm 2021-03-10T17:24:55.203855+0000 mgr.gibba020.yqfnwy (mgr.34427) 11174 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:24:56.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[29418]: cluster 2021-03-10T17:24:55.743234+0000 mgr.gibba020.yqfnwy (mgr.34427) 11175 : cluster [DBG] pgmap v6365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:56.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[30381]: cephadm 2021-03-10T17:24:54.982391+0000 mgr.gibba020.yqfnwy (mgr.34427) 11159 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:24:56.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[30381]: cephadm 2021-03-10T17:24:54.984174+0000 mgr.gibba020.yqfnwy (mgr.34427) 11160 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:24:56.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[30381]: audit 2021-03-10T17:24:55.184888+0000 mon.a (mon.0) 3934 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:24:56.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[30381]: cephadm 2021-03-10T17:24:55.186990+0000 mgr.gibba020.yqfnwy (mgr.34427) 11161 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:24:56.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[30381]: audit 2021-03-10T17:24:55.188430+0000 mon.a (mon.0) 3935 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:24:56.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[30381]: cephadm 2021-03-10T17:24:55.189633+0000 mgr.gibba020.yqfnwy (mgr.34427) 11162 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:24:56.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[30381]: audit 2021-03-10T17:24:55.190627+0000 mon.a (mon.0) 3936 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:56.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[30381]: cephadm 2021-03-10T17:24:55.191589+0000 mgr.gibba020.yqfnwy (mgr.34427) 11163 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:24:56.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[30381]: cephadm 2021-03-10T17:24:55.191625+0000 mgr.gibba020.yqfnwy (mgr.34427) 11164 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:24:56.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[30381]: audit 2021-03-10T17:24:55.192609+0000 mon.a (mon.0) 3937 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:56.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[30381]: cephadm 2021-03-10T17:24:55.193727+0000 mgr.gibba020.yqfnwy (mgr.34427) 11165 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:24:56.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[30381]: cephadm 2021-03-10T17:24:55.193764+0000 mgr.gibba020.yqfnwy (mgr.34427) 11166 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:24:56.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[30381]: audit 2021-03-10T17:24:55.194701+0000 mon.a (mon.0) 3938 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:56.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[30381]: cephadm 2021-03-10T17:24:55.195676+0000 mgr.gibba020.yqfnwy (mgr.34427) 11167 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:24:56.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[30381]: cephadm 2021-03-10T17:24:55.197878+0000 mgr.gibba020.yqfnwy (mgr.34427) 11168 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:24:56.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[30381]: cephadm 2021-03-10T17:24:55.198008+0000 mgr.gibba020.yqfnwy (mgr.34427) 11169 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:24:56.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[30381]: audit 2021-03-10T17:24:55.199361+0000 mon.a (mon.0) 3939 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:56.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[30381]: cephadm 2021-03-10T17:24:55.200869+0000 mgr.gibba020.yqfnwy (mgr.34427) 11170 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:24:56.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[30381]: cephadm 2021-03-10T17:24:55.201312+0000 mgr.gibba020.yqfnwy (mgr.34427) 11171 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:24:56.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[30381]: audit 2021-03-10T17:24:55.202406+0000 mon.a (mon.0) 3940 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:24:56.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[30381]: cephadm 2021-03-10T17:24:55.203636+0000 mgr.gibba020.yqfnwy (mgr.34427) 11172 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:24:56.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[30381]: cephadm 2021-03-10T17:24:55.203678+0000 mgr.gibba020.yqfnwy (mgr.34427) 11173 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:24:56.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[30381]: cephadm 2021-03-10T17:24:55.203855+0000 mgr.gibba020.yqfnwy (mgr.34427) 11174 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:24:56.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:56 gibba013 bash[30381]: cluster 2021-03-10T17:24:55.743234+0000 mgr.gibba020.yqfnwy (mgr.34427) 11175 : cluster [DBG] pgmap v6365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:59.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:24:58 gibba013 bash[29418]: cluster 2021-03-10T17:24:57.744804+0000 mgr.gibba020.yqfnwy (mgr.34427) 11176 : cluster [DBG] pgmap v6366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:59.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:24:58 gibba013 bash[30381]: cluster 2021-03-10T17:24:57.744804+0000 mgr.gibba020.yqfnwy (mgr.34427) 11176 : cluster [DBG] pgmap v6366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:24:59.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:24:58 gibba020 bash[25448]: cluster 2021-03-10T17:24:57.744804+0000 mgr.gibba020.yqfnwy (mgr.34427) 11176 : cluster [DBG] pgmap v6366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:01.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:00 gibba013 bash[29418]: cluster 2021-03-10T17:24:59.746367+0000 mgr.gibba020.yqfnwy (mgr.34427) 11177 : cluster [DBG] pgmap v6367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:01.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:00 gibba013 bash[30381]: cluster 2021-03-10T17:24:59.746367+0000 mgr.gibba020.yqfnwy (mgr.34427) 11177 : cluster [DBG] pgmap v6367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:01.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:00 gibba020 bash[25448]: cluster 2021-03-10T17:24:59.746367+0000 mgr.gibba020.yqfnwy (mgr.34427) 11177 : cluster [DBG] pgmap v6367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:02.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:01 gibba013 bash[29418]: cluster 2021-03-10T17:25:01.748336+0000 mgr.gibba020.yqfnwy (mgr.34427) 11178 : cluster [DBG] pgmap v6368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:02.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:01 gibba013 bash[30381]: cluster 2021-03-10T17:25:01.748336+0000 mgr.gibba020.yqfnwy (mgr.34427) 11178 : cluster [DBG] pgmap v6368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:02.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:01 gibba020 bash[25448]: cluster 2021-03-10T17:25:01.748336+0000 mgr.gibba020.yqfnwy (mgr.34427) 11178 : cluster [DBG] pgmap v6368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:05.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:04 gibba013 bash[29418]: cluster 2021-03-10T17:25:03.749848+0000 mgr.gibba020.yqfnwy (mgr.34427) 11179 : cluster [DBG] pgmap v6369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:05.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:04 gibba013 bash[30381]: cluster 2021-03-10T17:25:03.749848+0000 mgr.gibba020.yqfnwy (mgr.34427) 11179 : cluster [DBG] pgmap v6369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:05.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:04 gibba020 bash[25448]: cluster 2021-03-10T17:25:03.749848+0000 mgr.gibba020.yqfnwy (mgr.34427) 11179 : cluster [DBG] pgmap v6369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:07.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:06 gibba013 bash[29418]: cluster 2021-03-10T17:25:05.751340+0000 mgr.gibba020.yqfnwy (mgr.34427) 11180 : cluster [DBG] pgmap v6370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:07.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:06 gibba013 bash[30381]: cluster 2021-03-10T17:25:05.751340+0000 mgr.gibba020.yqfnwy (mgr.34427) 11180 : cluster [DBG] pgmap v6370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:07.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:06 gibba020 bash[25448]: cluster 2021-03-10T17:25:05.751340+0000 mgr.gibba020.yqfnwy (mgr.34427) 11180 : cluster [DBG] pgmap v6370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:08.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:07 gibba013 bash[29418]: audit 2021-03-10T17:25:06.983423+0000 mon.a (mon.0) 3941 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:25:08.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:07 gibba013 bash[29418]: audit 2021-03-10T17:25:07.218702+0000 mon.a (mon.0) 3942 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:25:08.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:07 gibba013 bash[29418]: audit 2021-03-10T17:25:07.658494+0000 mon.a (mon.0) 3943 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T17:25:08.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:07 gibba013 bash[29418]: audit 2021-03-10T17:25:07.659290+0000 mon.a (mon.0) 3944 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:25:08.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:07 gibba013 bash[29418]: audit 2021-03-10T17:25:07.659957+0000 mon.a (mon.0) 3945 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:25:08.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:07 gibba013 bash[29418]: audit 2021-03-10T17:25:07.660625+0000 mon.a (mon.0) 3946 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T17:25:08.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:07 gibba013 bash[30381]: audit 2021-03-10T17:25:06.983423+0000 mon.a (mon.0) 3941 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:25:08.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:07 gibba013 bash[30381]: audit 2021-03-10T17:25:07.218702+0000 mon.a (mon.0) 3942 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:25:08.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:07 gibba013 bash[30381]: audit 2021-03-10T17:25:07.658494+0000 mon.a (mon.0) 3943 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T17:25:08.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:07 gibba013 bash[30381]: audit 2021-03-10T17:25:07.659290+0000 mon.a (mon.0) 3944 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:25:08.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:07 gibba013 bash[30381]: audit 2021-03-10T17:25:07.659957+0000 mon.a (mon.0) 3945 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:25:08.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:07 gibba013 bash[30381]: audit 2021-03-10T17:25:07.660625+0000 mon.a (mon.0) 3946 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T17:25:08.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:07 gibba020 bash[25448]: audit 2021-03-10T17:25:06.983423+0000 mon.a (mon.0) 3941 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:25:08.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:07 gibba020 bash[25448]: audit 2021-03-10T17:25:07.218702+0000 mon.a (mon.0) 3942 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:25:08.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:07 gibba020 bash[25448]: audit 2021-03-10T17:25:07.658494+0000 mon.a (mon.0) 3943 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T17:25:08.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:07 gibba020 bash[25448]: audit 2021-03-10T17:25:07.659290+0000 mon.a (mon.0) 3944 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:25:08.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:07 gibba020 bash[25448]: audit 2021-03-10T17:25:07.659957+0000 mon.a (mon.0) 3945 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T17:25:08.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:07 gibba020 bash[25448]: audit 2021-03-10T17:25:07.660625+0000 mon.a (mon.0) 3946 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T17:25:09.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:08 gibba013 bash[29418]: cluster 2021-03-10T17:25:07.752677+0000 mgr.gibba020.yqfnwy (mgr.34427) 11181 : cluster [DBG] pgmap v6371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:09.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:08 gibba013 bash[30381]: cluster 2021-03-10T17:25:07.752677+0000 mgr.gibba020.yqfnwy (mgr.34427) 11181 : cluster [DBG] pgmap v6371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:09.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:08 gibba020 bash[25448]: cluster 2021-03-10T17:25:07.752677+0000 mgr.gibba020.yqfnwy (mgr.34427) 11181 : cluster [DBG] pgmap v6371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:11.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:10 gibba013 bash[29418]: cluster 2021-03-10T17:25:09.754247+0000 mgr.gibba020.yqfnwy (mgr.34427) 11182 : cluster [DBG] pgmap v6372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:11.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:10 gibba013 bash[30381]: cluster 2021-03-10T17:25:09.754247+0000 mgr.gibba020.yqfnwy (mgr.34427) 11182 : cluster [DBG] pgmap v6372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:11.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:10 gibba020 bash[25448]: cluster 2021-03-10T17:25:09.754247+0000 mgr.gibba020.yqfnwy (mgr.34427) 11182 : cluster [DBG] pgmap v6372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:12.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:11 gibba013 bash[29418]: cephadm 2021-03-10T17:25:10.219890+0000 mgr.gibba020.yqfnwy (mgr.34427) 11183 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:25:12.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:11 gibba013 bash[30381]: cephadm 2021-03-10T17:25:10.219890+0000 mgr.gibba020.yqfnwy (mgr.34427) 11183 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:25:12.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:11 gibba020 bash[25448]: cephadm 2021-03-10T17:25:10.219890+0000 mgr.gibba020.yqfnwy (mgr.34427) 11183 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:25:13.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:12 gibba013 bash[29418]: cluster 2021-03-10T17:25:11.756140+0000 mgr.gibba020.yqfnwy (mgr.34427) 11184 : cluster [DBG] pgmap v6373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:13.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:12 gibba013 bash[30381]: cluster 2021-03-10T17:25:11.756140+0000 mgr.gibba020.yqfnwy (mgr.34427) 11184 : cluster [DBG] pgmap v6373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:13.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:12 gibba020 bash[25448]: cluster 2021-03-10T17:25:11.756140+0000 mgr.gibba020.yqfnwy (mgr.34427) 11184 : cluster [DBG] pgmap v6373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:15.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:14 gibba013 bash[29418]: cluster 2021-03-10T17:25:13.757643+0000 mgr.gibba020.yqfnwy (mgr.34427) 11185 : cluster [DBG] pgmap v6374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:15.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:14 gibba013 bash[30381]: cluster 2021-03-10T17:25:13.757643+0000 mgr.gibba020.yqfnwy (mgr.34427) 11185 : cluster [DBG] pgmap v6374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:15.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:14 gibba020 bash[25448]: cluster 2021-03-10T17:25:13.757643+0000 mgr.gibba020.yqfnwy (mgr.34427) 11185 : cluster [DBG] pgmap v6374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:17.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:16 gibba013 bash[29418]: cluster 2021-03-10T17:25:15.759239+0000 mgr.gibba020.yqfnwy (mgr.34427) 11186 : cluster [DBG] pgmap v6375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:17.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:16 gibba013 bash[30381]: cluster 2021-03-10T17:25:15.759239+0000 mgr.gibba020.yqfnwy (mgr.34427) 11186 : cluster [DBG] pgmap v6375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:17.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:16 gibba020 bash[25448]: cluster 2021-03-10T17:25:15.759239+0000 mgr.gibba020.yqfnwy (mgr.34427) 11186 : cluster [DBG] pgmap v6375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:19.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:18 gibba020 bash[25448]: cluster 2021-03-10T17:25:17.760843+0000 mgr.gibba020.yqfnwy (mgr.34427) 11187 : cluster [DBG] pgmap v6376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:19.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:18 gibba013 bash[29418]: cluster 2021-03-10T17:25:17.760843+0000 mgr.gibba020.yqfnwy (mgr.34427) 11187 : cluster [DBG] pgmap v6376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:19.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:18 gibba013 bash[30381]: cluster 2021-03-10T17:25:17.760843+0000 mgr.gibba020.yqfnwy (mgr.34427) 11187 : cluster [DBG] pgmap v6376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:21.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:20 gibba020 bash[25448]: cluster 2021-03-10T17:25:19.762339+0000 mgr.gibba020.yqfnwy (mgr.34427) 11188 : cluster [DBG] pgmap v6377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:21.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:20 gibba013 bash[29418]: cluster 2021-03-10T17:25:19.762339+0000 mgr.gibba020.yqfnwy (mgr.34427) 11188 : cluster [DBG] pgmap v6377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:21.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:20 gibba013 bash[30381]: cluster 2021-03-10T17:25:19.762339+0000 mgr.gibba020.yqfnwy (mgr.34427) 11188 : cluster [DBG] pgmap v6377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:22.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:21 gibba013 bash[29418]: cluster 2021-03-10T17:25:21.764229+0000 mgr.gibba020.yqfnwy (mgr.34427) 11189 : cluster [DBG] pgmap v6378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:22.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:21 gibba013 bash[30381]: cluster 2021-03-10T17:25:21.764229+0000 mgr.gibba020.yqfnwy (mgr.34427) 11189 : cluster [DBG] pgmap v6378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:22.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:21 gibba020 bash[25448]: cluster 2021-03-10T17:25:21.764229+0000 mgr.gibba020.yqfnwy (mgr.34427) 11189 : cluster [DBG] pgmap v6378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:22.579 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:25:22.809 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:25:22.810 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 3m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:25:22.810 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 2m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:25:22.810 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:25:22.810 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:25:22.811 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:25:22.811 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:25:22.811 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:25:22.811 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:25:22.811 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:25:22.812 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:25:22.812 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:25:22.812 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:25:22.812 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:25:22.813 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:25:22.813 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:25:22.813 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:25:22.813 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:25:22.813 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:25:22.814 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 2m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:25:22.814 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:25:23.059 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:25:23.059 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:25:23.059 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:25:23.059 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:25:23.060 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:25:23.060 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:25:23.060 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:25:23.060 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:25:23.061 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:25:23.061 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:25:23.061 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:25:23.061 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:25:23.061 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:25:23.062 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:25:23.062 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:25:23.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:22 gibba013 bash[29418]: audit 2021-03-10T17:25:22.568284+0000 mgr.gibba020.yqfnwy (mgr.34427) 11190 : audit [DBG] from='client.51558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:25:23.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:22 gibba013 bash[29418]: audit 2021-03-10T17:25:22.795015+0000 mgr.gibba020.yqfnwy (mgr.34427) 11191 : audit [DBG] from='client.51564 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:25:23.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:23 gibba013 bash[30381]: audit 2021-03-10T17:25:22.568284+0000 mgr.gibba020.yqfnwy (mgr.34427) 11190 : audit [DBG] from='client.51558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:25:23.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:23 gibba013 bash[30381]: audit 2021-03-10T17:25:22.795015+0000 mgr.gibba020.yqfnwy (mgr.34427) 11191 : audit [DBG] from='client.51564 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:25:23.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:23 gibba020 bash[25448]: audit 2021-03-10T17:25:22.568284+0000 mgr.gibba020.yqfnwy (mgr.34427) 11190 : audit [DBG] from='client.51558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:25:23.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:23 gibba020 bash[25448]: audit 2021-03-10T17:25:22.795015+0000 mgr.gibba020.yqfnwy (mgr.34427) 11191 : audit [DBG] from='client.51564 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:25:24.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:24 gibba013 bash[29418]: audit 2021-03-10T17:25:23.057744+0000 mon.a (mon.0) 3947 : audit [DBG] from='client.? 172.21.2.113:0/1280120466' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:24.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:24 gibba013 bash[29418]: cluster 2021-03-10T17:25:23.765653+0000 mgr.gibba020.yqfnwy (mgr.34427) 11192 : cluster [DBG] pgmap v6379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:24.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:24 gibba013 bash[30381]: audit 2021-03-10T17:25:23.057744+0000 mon.a (mon.0) 3947 : audit [DBG] from='client.? 172.21.2.113:0/1280120466' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:24.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:24 gibba013 bash[30381]: cluster 2021-03-10T17:25:23.765653+0000 mgr.gibba020.yqfnwy (mgr.34427) 11192 : cluster [DBG] pgmap v6379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:24.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:24 gibba020 bash[25448]: audit 2021-03-10T17:25:23.057744+0000 mon.a (mon.0) 3947 : audit [DBG] from='client.? 172.21.2.113:0/1280120466' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:24.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:24 gibba020 bash[25448]: cluster 2021-03-10T17:25:23.765653+0000 mgr.gibba020.yqfnwy (mgr.34427) 11192 : cluster [DBG] pgmap v6379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:27.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:26 gibba013 bash[29418]: cephadm 2021-03-10T17:25:25.221011+0000 mgr.gibba020.yqfnwy (mgr.34427) 11193 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:25:27.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:26 gibba013 bash[29418]: cluster 2021-03-10T17:25:25.767243+0000 mgr.gibba020.yqfnwy (mgr.34427) 11194 : cluster [DBG] pgmap v6380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:27.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:26 gibba013 bash[30381]: cephadm 2021-03-10T17:25:25.221011+0000 mgr.gibba020.yqfnwy (mgr.34427) 11193 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:25:27.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:26 gibba013 bash[30381]: cluster 2021-03-10T17:25:25.767243+0000 mgr.gibba020.yqfnwy (mgr.34427) 11194 : cluster [DBG] pgmap v6380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:27.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:26 gibba020 bash[25448]: cephadm 2021-03-10T17:25:25.221011+0000 mgr.gibba020.yqfnwy (mgr.34427) 11193 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:25:27.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:26 gibba020 bash[25448]: cluster 2021-03-10T17:25:25.767243+0000 mgr.gibba020.yqfnwy (mgr.34427) 11194 : cluster [DBG] pgmap v6380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:29.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:28 gibba013 bash[29418]: cluster 2021-03-10T17:25:27.768540+0000 mgr.gibba020.yqfnwy (mgr.34427) 11195 : cluster [DBG] pgmap v6381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:29.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:28 gibba013 bash[30381]: cluster 2021-03-10T17:25:27.768540+0000 mgr.gibba020.yqfnwy (mgr.34427) 11195 : cluster [DBG] pgmap v6381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:29.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:28 gibba020 bash[25448]: cluster 2021-03-10T17:25:27.768540+0000 mgr.gibba020.yqfnwy (mgr.34427) 11195 : cluster [DBG] pgmap v6381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:31.129 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:30 gibba013 bash[29418]: cluster 2021-03-10T17:25:29.769786+0000 mgr.gibba020.yqfnwy (mgr.34427) 11196 : cluster [DBG] pgmap v6382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:31.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:30 gibba013 bash[30381]: cluster 2021-03-10T17:25:29.769786+0000 mgr.gibba020.yqfnwy (mgr.34427) 11196 : cluster [DBG] pgmap v6382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:31.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:30 gibba020 bash[25448]: cluster 2021-03-10T17:25:29.769786+0000 mgr.gibba020.yqfnwy (mgr.34427) 11196 : cluster [DBG] pgmap v6382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:32.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:31 gibba013 bash[29418]: cluster 2021-03-10T17:25:31.771654+0000 mgr.gibba020.yqfnwy (mgr.34427) 11197 : cluster [DBG] pgmap v6383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:32.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:31 gibba013 bash[30381]: cluster 2021-03-10T17:25:31.771654+0000 mgr.gibba020.yqfnwy (mgr.34427) 11197 : cluster [DBG] pgmap v6383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:32.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:31 gibba020 bash[25448]: cluster 2021-03-10T17:25:31.771654+0000 mgr.gibba020.yqfnwy (mgr.34427) 11197 : cluster [DBG] pgmap v6383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:35.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:34 gibba013 bash[29418]: cluster 2021-03-10T17:25:33.773196+0000 mgr.gibba020.yqfnwy (mgr.34427) 11198 : cluster [DBG] pgmap v6384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:35.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:34 gibba013 bash[30381]: cluster 2021-03-10T17:25:33.773196+0000 mgr.gibba020.yqfnwy (mgr.34427) 11198 : cluster [DBG] pgmap v6384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:35.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:34 gibba020 bash[25448]: cluster 2021-03-10T17:25:33.773196+0000 mgr.gibba020.yqfnwy (mgr.34427) 11198 : cluster [DBG] pgmap v6384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:37.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:36 gibba013 bash[29418]: cluster 2021-03-10T17:25:35.774787+0000 mgr.gibba020.yqfnwy (mgr.34427) 11199 : cluster [DBG] pgmap v6385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:37.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:36 gibba013 bash[30381]: cluster 2021-03-10T17:25:35.774787+0000 mgr.gibba020.yqfnwy (mgr.34427) 11199 : cluster [DBG] pgmap v6385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:37.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:36 gibba020 bash[25448]: cluster 2021-03-10T17:25:35.774787+0000 mgr.gibba020.yqfnwy (mgr.34427) 11199 : cluster [DBG] pgmap v6385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:39.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:38 gibba013 bash[29418]: cluster 2021-03-10T17:25:37.776241+0000 mgr.gibba020.yqfnwy (mgr.34427) 11200 : cluster [DBG] pgmap v6386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:39.130 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:38 gibba013 bash[30381]: cluster 2021-03-10T17:25:37.776241+0000 mgr.gibba020.yqfnwy (mgr.34427) 11200 : cluster [DBG] pgmap v6386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:39.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:38 gibba020 bash[25448]: cluster 2021-03-10T17:25:37.776241+0000 mgr.gibba020.yqfnwy (mgr.34427) 11200 : cluster [DBG] pgmap v6386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:41.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:40 gibba013 bash[29418]: cluster 2021-03-10T17:25:39.777812+0000 mgr.gibba020.yqfnwy (mgr.34427) 11201 : cluster [DBG] pgmap v6387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:41.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:40 gibba013 bash[30381]: cluster 2021-03-10T17:25:39.777812+0000 mgr.gibba020.yqfnwy (mgr.34427) 11201 : cluster [DBG] pgmap v6387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:41.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:40 gibba020 bash[25448]: cluster 2021-03-10T17:25:39.777812+0000 mgr.gibba020.yqfnwy (mgr.34427) 11201 : cluster [DBG] pgmap v6387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:42.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:41 gibba013 bash[29418]: cephadm 2021-03-10T17:25:40.224052+0000 mgr.gibba020.yqfnwy (mgr.34427) 11202 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:25:42.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:41 gibba013 bash[30381]: cephadm 2021-03-10T17:25:40.224052+0000 mgr.gibba020.yqfnwy (mgr.34427) 11202 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:25:42.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:41 gibba020 bash[25448]: cephadm 2021-03-10T17:25:40.224052+0000 mgr.gibba020.yqfnwy (mgr.34427) 11202 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:25:43.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:42 gibba013 bash[29418]: cluster 2021-03-10T17:25:41.779616+0000 mgr.gibba020.yqfnwy (mgr.34427) 11203 : cluster [DBG] pgmap v6388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:43.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:42 gibba013 bash[30381]: cluster 2021-03-10T17:25:41.779616+0000 mgr.gibba020.yqfnwy (mgr.34427) 11203 : cluster [DBG] pgmap v6388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:43.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:42 gibba020 bash[25448]: cluster 2021-03-10T17:25:41.779616+0000 mgr.gibba020.yqfnwy (mgr.34427) 11203 : cluster [DBG] pgmap v6388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:45.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:44 gibba020 bash[25448]: cluster 2021-03-10T17:25:43.781046+0000 mgr.gibba020.yqfnwy (mgr.34427) 11204 : cluster [DBG] pgmap v6389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:45.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:44 gibba013 bash[29418]: cluster 2021-03-10T17:25:43.781046+0000 mgr.gibba020.yqfnwy (mgr.34427) 11204 : cluster [DBG] pgmap v6389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:45.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:44 gibba013 bash[30381]: cluster 2021-03-10T17:25:43.781046+0000 mgr.gibba020.yqfnwy (mgr.34427) 11204 : cluster [DBG] pgmap v6389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:47.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:46 gibba020 bash[25448]: cluster 2021-03-10T17:25:45.782613+0000 mgr.gibba020.yqfnwy (mgr.34427) 11205 : cluster [DBG] pgmap v6390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:47.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:46 gibba013 bash[29418]: cluster 2021-03-10T17:25:45.782613+0000 mgr.gibba020.yqfnwy (mgr.34427) 11205 : cluster [DBG] pgmap v6390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:47.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:46 gibba013 bash[30381]: cluster 2021-03-10T17:25:45.782613+0000 mgr.gibba020.yqfnwy (mgr.34427) 11205 : cluster [DBG] pgmap v6390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:49.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:48 gibba020 bash[25448]: cluster 2021-03-10T17:25:47.783862+0000 mgr.gibba020.yqfnwy (mgr.34427) 11206 : cluster [DBG] pgmap v6391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:49.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:48 gibba013 bash[29418]: cluster 2021-03-10T17:25:47.783862+0000 mgr.gibba020.yqfnwy (mgr.34427) 11206 : cluster [DBG] pgmap v6391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:49.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:48 gibba013 bash[30381]: cluster 2021-03-10T17:25:47.783862+0000 mgr.gibba020.yqfnwy (mgr.34427) 11206 : cluster [DBG] pgmap v6391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:51.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:50 gibba020 bash[25448]: cluster 2021-03-10T17:25:49.785265+0000 mgr.gibba020.yqfnwy (mgr.34427) 11207 : cluster [DBG] pgmap v6392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:51.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:50 gibba013 bash[29418]: cluster 2021-03-10T17:25:49.785265+0000 mgr.gibba020.yqfnwy (mgr.34427) 11207 : cluster [DBG] pgmap v6392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:51.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:50 gibba013 bash[30381]: cluster 2021-03-10T17:25:49.785265+0000 mgr.gibba020.yqfnwy (mgr.34427) 11207 : cluster [DBG] pgmap v6392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:52.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:52 gibba013 bash[29418]: cluster 2021-03-10T17:25:51.787084+0000 mgr.gibba020.yqfnwy (mgr.34427) 11208 : cluster [DBG] pgmap v6393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:52.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:52 gibba013 bash[30381]: cluster 2021-03-10T17:25:51.787084+0000 mgr.gibba020.yqfnwy (mgr.34427) 11208 : cluster [DBG] pgmap v6393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:52.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:52 gibba020 bash[25448]: cluster 2021-03-10T17:25:51.787084+0000 mgr.gibba020.yqfnwy (mgr.34427) 11208 : cluster [DBG] pgmap v6393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:53.307 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:25:53.533 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:25:53.533 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 4m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:25:53.533 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 3m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:25:53.534 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:25:53.534 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:25:53.534 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:25:53.534 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:25:53.534 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:25:53.535 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:25:53.535 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:25:53.535 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:25:53.535 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:25:53.536 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:25:53.536 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:25:53.536 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:25:53.536 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:25:53.536 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:25:53.537 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:25:53.537 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:25:53.537 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 3m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:25:53.537 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 3m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:25:53.790 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:25:53.791 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:25:53.791 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:25:53.791 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:25:53.791 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:25:53.792 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:25:53.792 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:25:53.792 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:25:53.792 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:25:53.792 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:25:53.793 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:25:53.793 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:25:53.793 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:25:53.793 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:25:53.793 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:25:54.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:53 gibba013 bash[29418]: audit 2021-03-10T17:25:53.788973+0000 mon.c (mon.1) 171 : audit [DBG] from='client.? 172.21.2.113:0/1213656219' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:54.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:53 gibba013 bash[30381]: audit 2021-03-10T17:25:53.788973+0000 mon.c (mon.1) 171 : audit [DBG] from='client.? 172.21.2.113:0/1213656219' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:54.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:53 gibba020 bash[25448]: audit 2021-03-10T17:25:53.788973+0000 mon.c (mon.1) 171 : audit [DBG] from='client.? 172.21.2.113:0/1213656219' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:55.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:54 gibba013 bash[29418]: audit 2021-03-10T17:25:53.296789+0000 mgr.gibba020.yqfnwy (mgr.34427) 11209 : audit [DBG] from='client.51576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:25:55.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:54 gibba013 bash[29418]: audit 2021-03-10T17:25:53.518594+0000 mgr.gibba020.yqfnwy (mgr.34427) 11210 : audit [DBG] from='client.51582 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:25:55.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:54 gibba013 bash[29418]: cluster 2021-03-10T17:25:53.788716+0000 mgr.gibba020.yqfnwy (mgr.34427) 11211 : cluster [DBG] pgmap v6394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:55.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:54 gibba013 bash[30381]: audit 2021-03-10T17:25:53.296789+0000 mgr.gibba020.yqfnwy (mgr.34427) 11209 : audit [DBG] from='client.51576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:25:55.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:54 gibba013 bash[30381]: audit 2021-03-10T17:25:53.518594+0000 mgr.gibba020.yqfnwy (mgr.34427) 11210 : audit [DBG] from='client.51582 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:25:55.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:54 gibba013 bash[30381]: cluster 2021-03-10T17:25:53.788716+0000 mgr.gibba020.yqfnwy (mgr.34427) 11211 : cluster [DBG] pgmap v6394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:55.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:54 gibba020 bash[25448]: audit 2021-03-10T17:25:53.296789+0000 mgr.gibba020.yqfnwy (mgr.34427) 11209 : audit [DBG] from='client.51576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:25:55.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:54 gibba020 bash[25448]: audit 2021-03-10T17:25:53.518594+0000 mgr.gibba020.yqfnwy (mgr.34427) 11210 : audit [DBG] from='client.51582 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:25:55.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:54 gibba020 bash[25448]: cluster 2021-03-10T17:25:53.788716+0000 mgr.gibba020.yqfnwy (mgr.34427) 11211 : cluster [DBG] pgmap v6394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:56.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:55 gibba013 bash[29418]: audit 2021-03-10T17:25:55.227716+0000 mon.a (mon.0) 3948 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:25:56.140 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:55 gibba013 bash[29418]: audit 2021-03-10T17:25:55.438777+0000 mon.a (mon.0) 3949 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:25:56.141 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:55 gibba013 bash[29418]: audit 2021-03-10T17:25:55.442362+0000 mon.a (mon.0) 3950 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:25:56.141 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:55 gibba013 bash[29418]: audit 2021-03-10T17:25:55.443998+0000 mon.a (mon.0) 3951 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:56.142 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:55 gibba013 bash[29418]: audit 2021-03-10T17:25:55.445521+0000 mon.a (mon.0) 3952 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:56.143 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:55 gibba013 bash[29418]: audit 2021-03-10T17:25:55.446999+0000 mon.a (mon.0) 3953 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:56.144 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:55 gibba013 bash[29418]: audit 2021-03-10T17:25:55.450089+0000 mon.a (mon.0) 3954 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:56.144 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:55 gibba013 bash[29418]: audit 2021-03-10T17:25:55.451524+0000 mon.a (mon.0) 3955 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:56.146 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:55 gibba013 bash[30381]: audit 2021-03-10T17:25:55.227716+0000 mon.a (mon.0) 3948 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:25:56.147 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:55 gibba013 bash[30381]: audit 2021-03-10T17:25:55.438777+0000 mon.a (mon.0) 3949 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:25:56.148 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:55 gibba013 bash[30381]: audit 2021-03-10T17:25:55.442362+0000 mon.a (mon.0) 3950 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:25:56.148 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:55 gibba013 bash[30381]: audit 2021-03-10T17:25:55.443998+0000 mon.a (mon.0) 3951 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:56.149 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:55 gibba013 bash[30381]: audit 2021-03-10T17:25:55.445521+0000 mon.a (mon.0) 3952 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:56.149 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:55 gibba013 bash[30381]: audit 2021-03-10T17:25:55.446999+0000 mon.a (mon.0) 3953 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:56.150 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:55 gibba013 bash[30381]: audit 2021-03-10T17:25:55.450089+0000 mon.a (mon.0) 3954 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:56.150 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:55 gibba013 bash[30381]: audit 2021-03-10T17:25:55.451524+0000 mon.a (mon.0) 3955 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:56.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:55 gibba020 bash[25448]: audit 2021-03-10T17:25:55.227716+0000 mon.a (mon.0) 3948 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:25:56.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:55 gibba020 bash[25448]: audit 2021-03-10T17:25:55.438777+0000 mon.a (mon.0) 3949 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:25:56.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:55 gibba020 bash[25448]: audit 2021-03-10T17:25:55.442362+0000 mon.a (mon.0) 3950 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:25:56.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:55 gibba020 bash[25448]: audit 2021-03-10T17:25:55.443998+0000 mon.a (mon.0) 3951 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:56.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:55 gibba020 bash[25448]: audit 2021-03-10T17:25:55.445521+0000 mon.a (mon.0) 3952 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:56.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:55 gibba020 bash[25448]: audit 2021-03-10T17:25:55.446999+0000 mon.a (mon.0) 3953 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:56.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:55 gibba020 bash[25448]: audit 2021-03-10T17:25:55.450089+0000 mon.a (mon.0) 3954 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:56.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:55 gibba020 bash[25448]: audit 2021-03-10T17:25:55.451524+0000 mon.a (mon.0) 3955 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:25:57.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:56 gibba013 bash[29418]: cephadm 2021-03-10T17:25:55.232827+0000 mgr.gibba020.yqfnwy (mgr.34427) 11212 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:25:57.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:56 gibba013 bash[29418]: cephadm 2021-03-10T17:25:55.234166+0000 mgr.gibba020.yqfnwy (mgr.34427) 11213 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:25:57.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:56 gibba013 bash[29418]: cephadm 2021-03-10T17:25:55.441087+0000 mgr.gibba020.yqfnwy (mgr.34427) 11214 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:25:57.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:56 gibba013 bash[29418]: cephadm 2021-03-10T17:25:55.443030+0000 mgr.gibba020.yqfnwy (mgr.34427) 11215 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:25:57.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:56 gibba013 bash[29418]: cephadm 2021-03-10T17:25:55.444540+0000 mgr.gibba020.yqfnwy (mgr.34427) 11216 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:25:57.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:56 gibba013 bash[29418]: cephadm 2021-03-10T17:25:55.444579+0000 mgr.gibba020.yqfnwy (mgr.34427) 11217 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:25:57.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:56 gibba013 bash[29418]: cephadm 2021-03-10T17:25:55.446057+0000 mgr.gibba020.yqfnwy (mgr.34427) 11218 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:25:57.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:56 gibba013 bash[29418]: cephadm 2021-03-10T17:25:55.446095+0000 mgr.gibba020.yqfnwy (mgr.34427) 11219 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:25:57.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:56 gibba013 bash[29418]: cephadm 2021-03-10T17:25:55.447428+0000 mgr.gibba020.yqfnwy (mgr.34427) 11220 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:25:57.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:56 gibba013 bash[29418]: cephadm 2021-03-10T17:25:55.448824+0000 mgr.gibba020.yqfnwy (mgr.34427) 11221 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:25:57.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:56 gibba013 bash[29418]: cephadm 2021-03-10T17:25:55.448961+0000 mgr.gibba020.yqfnwy (mgr.34427) 11222 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:25:57.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:56 gibba013 bash[29418]: cephadm 2021-03-10T17:25:55.450367+0000 mgr.gibba020.yqfnwy (mgr.34427) 11223 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:25:57.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:56 gibba013 bash[29418]: cephadm 2021-03-10T17:25:55.450692+0000 mgr.gibba020.yqfnwy (mgr.34427) 11224 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:25:57.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:56 gibba013 bash[29418]: cephadm 2021-03-10T17:25:55.451971+0000 mgr.gibba020.yqfnwy (mgr.34427) 11225 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:25:57.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:56 gibba013 bash[29418]: cephadm 2021-03-10T17:25:55.452054+0000 mgr.gibba020.yqfnwy (mgr.34427) 11226 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:25:57.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:56 gibba013 bash[29418]: cephadm 2021-03-10T17:25:55.452160+0000 mgr.gibba020.yqfnwy (mgr.34427) 11227 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:25:57.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:56 gibba013 bash[29418]: cluster 2021-03-10T17:25:55.790103+0000 mgr.gibba020.yqfnwy (mgr.34427) 11228 : cluster [DBG] pgmap v6395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:57.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:56 gibba013 bash[30381]: cephadm 2021-03-10T17:25:55.232827+0000 mgr.gibba020.yqfnwy (mgr.34427) 11212 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:25:57.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:56 gibba013 bash[30381]: cephadm 2021-03-10T17:25:55.234166+0000 mgr.gibba020.yqfnwy (mgr.34427) 11213 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:25:57.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:56 gibba013 bash[30381]: cephadm 2021-03-10T17:25:55.441087+0000 mgr.gibba020.yqfnwy (mgr.34427) 11214 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:25:57.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:56 gibba013 bash[30381]: cephadm 2021-03-10T17:25:55.443030+0000 mgr.gibba020.yqfnwy (mgr.34427) 11215 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:25:57.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:56 gibba013 bash[30381]: cephadm 2021-03-10T17:25:55.444540+0000 mgr.gibba020.yqfnwy (mgr.34427) 11216 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:25:57.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:56 gibba013 bash[30381]: cephadm 2021-03-10T17:25:55.444579+0000 mgr.gibba020.yqfnwy (mgr.34427) 11217 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:25:57.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:56 gibba013 bash[30381]: cephadm 2021-03-10T17:25:55.446057+0000 mgr.gibba020.yqfnwy (mgr.34427) 11218 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:25:57.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:56 gibba013 bash[30381]: cephadm 2021-03-10T17:25:55.446095+0000 mgr.gibba020.yqfnwy (mgr.34427) 11219 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:25:57.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:56 gibba013 bash[30381]: cephadm 2021-03-10T17:25:55.447428+0000 mgr.gibba020.yqfnwy (mgr.34427) 11220 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:25:57.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:56 gibba013 bash[30381]: cephadm 2021-03-10T17:25:55.448824+0000 mgr.gibba020.yqfnwy (mgr.34427) 11221 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:25:57.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:56 gibba013 bash[30381]: cephadm 2021-03-10T17:25:55.448961+0000 mgr.gibba020.yqfnwy (mgr.34427) 11222 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:25:57.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:56 gibba013 bash[30381]: cephadm 2021-03-10T17:25:55.450367+0000 mgr.gibba020.yqfnwy (mgr.34427) 11223 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:25:57.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:56 gibba013 bash[30381]: cephadm 2021-03-10T17:25:55.450692+0000 mgr.gibba020.yqfnwy (mgr.34427) 11224 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:25:57.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:56 gibba013 bash[30381]: cephadm 2021-03-10T17:25:55.451971+0000 mgr.gibba020.yqfnwy (mgr.34427) 11225 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:25:57.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:56 gibba013 bash[30381]: cephadm 2021-03-10T17:25:55.452054+0000 mgr.gibba020.yqfnwy (mgr.34427) 11226 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:25:57.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:56 gibba013 bash[30381]: cephadm 2021-03-10T17:25:55.452160+0000 mgr.gibba020.yqfnwy (mgr.34427) 11227 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:25:57.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:56 gibba013 bash[30381]: cluster 2021-03-10T17:25:55.790103+0000 mgr.gibba020.yqfnwy (mgr.34427) 11228 : cluster [DBG] pgmap v6395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:57.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:56 gibba020 bash[25448]: cephadm 2021-03-10T17:25:55.232827+0000 mgr.gibba020.yqfnwy (mgr.34427) 11212 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:25:57.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:56 gibba020 bash[25448]: cephadm 2021-03-10T17:25:55.234166+0000 mgr.gibba020.yqfnwy (mgr.34427) 11213 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:25:57.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:56 gibba020 bash[25448]: cephadm 2021-03-10T17:25:55.441087+0000 mgr.gibba020.yqfnwy (mgr.34427) 11214 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:25:57.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:56 gibba020 bash[25448]: cephadm 2021-03-10T17:25:55.443030+0000 mgr.gibba020.yqfnwy (mgr.34427) 11215 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:25:57.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:56 gibba020 bash[25448]: cephadm 2021-03-10T17:25:55.444540+0000 mgr.gibba020.yqfnwy (mgr.34427) 11216 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:25:57.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:56 gibba020 bash[25448]: cephadm 2021-03-10T17:25:55.444579+0000 mgr.gibba020.yqfnwy (mgr.34427) 11217 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:25:57.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:56 gibba020 bash[25448]: cephadm 2021-03-10T17:25:55.446057+0000 mgr.gibba020.yqfnwy (mgr.34427) 11218 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:25:57.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:56 gibba020 bash[25448]: cephadm 2021-03-10T17:25:55.446095+0000 mgr.gibba020.yqfnwy (mgr.34427) 11219 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:25:57.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:56 gibba020 bash[25448]: cephadm 2021-03-10T17:25:55.447428+0000 mgr.gibba020.yqfnwy (mgr.34427) 11220 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:25:57.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:56 gibba020 bash[25448]: cephadm 2021-03-10T17:25:55.448824+0000 mgr.gibba020.yqfnwy (mgr.34427) 11221 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:25:57.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:56 gibba020 bash[25448]: cephadm 2021-03-10T17:25:55.448961+0000 mgr.gibba020.yqfnwy (mgr.34427) 11222 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:25:57.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:56 gibba020 bash[25448]: cephadm 2021-03-10T17:25:55.450367+0000 mgr.gibba020.yqfnwy (mgr.34427) 11223 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:25:57.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:56 gibba020 bash[25448]: cephadm 2021-03-10T17:25:55.450692+0000 mgr.gibba020.yqfnwy (mgr.34427) 11224 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:25:57.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:56 gibba020 bash[25448]: cephadm 2021-03-10T17:25:55.451971+0000 mgr.gibba020.yqfnwy (mgr.34427) 11225 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:25:57.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:56 gibba020 bash[25448]: cephadm 2021-03-10T17:25:55.452054+0000 mgr.gibba020.yqfnwy (mgr.34427) 11226 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:25:57.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:56 gibba020 bash[25448]: cephadm 2021-03-10T17:25:55.452160+0000 mgr.gibba020.yqfnwy (mgr.34427) 11227 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:25:57.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:56 gibba020 bash[25448]: cluster 2021-03-10T17:25:55.790103+0000 mgr.gibba020.yqfnwy (mgr.34427) 11228 : cluster [DBG] pgmap v6395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:59.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:25:58 gibba013 bash[29418]: cluster 2021-03-10T17:25:57.791689+0000 mgr.gibba020.yqfnwy (mgr.34427) 11229 : cluster [DBG] pgmap v6396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:59.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:25:58 gibba013 bash[30381]: cluster 2021-03-10T17:25:57.791689+0000 mgr.gibba020.yqfnwy (mgr.34427) 11229 : cluster [DBG] pgmap v6396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:25:59.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:25:58 gibba020 bash[25448]: cluster 2021-03-10T17:25:57.791689+0000 mgr.gibba020.yqfnwy (mgr.34427) 11229 : cluster [DBG] pgmap v6396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:01.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:00 gibba020 bash[25448]: cluster 2021-03-10T17:25:59.793237+0000 mgr.gibba020.yqfnwy (mgr.34427) 11230 : cluster [DBG] pgmap v6397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:01.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:00 gibba013 bash[29418]: cluster 2021-03-10T17:25:59.793237+0000 mgr.gibba020.yqfnwy (mgr.34427) 11230 : cluster [DBG] pgmap v6397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:01.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:00 gibba013 bash[30381]: cluster 2021-03-10T17:25:59.793237+0000 mgr.gibba020.yqfnwy (mgr.34427) 11230 : cluster [DBG] pgmap v6397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:02.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:02 gibba013 bash[29418]: cluster 2021-03-10T17:26:01.795137+0000 mgr.gibba020.yqfnwy (mgr.34427) 11231 : cluster [DBG] pgmap v6398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:02.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:02 gibba013 bash[30381]: cluster 2021-03-10T17:26:01.795137+0000 mgr.gibba020.yqfnwy (mgr.34427) 11231 : cluster [DBG] pgmap v6398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:02.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:02 gibba020 bash[25448]: cluster 2021-03-10T17:26:01.795137+0000 mgr.gibba020.yqfnwy (mgr.34427) 11231 : cluster [DBG] pgmap v6398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:05.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:04 gibba013 bash[29418]: cluster 2021-03-10T17:26:03.796821+0000 mgr.gibba020.yqfnwy (mgr.34427) 11232 : cluster [DBG] pgmap v6399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:05.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:04 gibba013 bash[30381]: cluster 2021-03-10T17:26:03.796821+0000 mgr.gibba020.yqfnwy (mgr.34427) 11232 : cluster [DBG] pgmap v6399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:05.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:04 gibba020 bash[25448]: cluster 2021-03-10T17:26:03.796821+0000 mgr.gibba020.yqfnwy (mgr.34427) 11232 : cluster [DBG] pgmap v6399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:07.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:06 gibba013 bash[29418]: cluster 2021-03-10T17:26:05.798275+0000 mgr.gibba020.yqfnwy (mgr.34427) 11233 : cluster [DBG] pgmap v6400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:07.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:06 gibba013 bash[30381]: cluster 2021-03-10T17:26:05.798275+0000 mgr.gibba020.yqfnwy (mgr.34427) 11233 : cluster [DBG] pgmap v6400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:07.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:06 gibba020 bash[25448]: cluster 2021-03-10T17:26:05.798275+0000 mgr.gibba020.yqfnwy (mgr.34427) 11233 : cluster [DBG] pgmap v6400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:08.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:07 gibba020 bash[25448]: audit 2021-03-10T17:26:06.988418+0000 mon.a (mon.0) 3956 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:26:08.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:07 gibba020 bash[25448]: audit 2021-03-10T17:26:07.225706+0000 mon.a (mon.0) 3957 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:26:08.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:07 gibba020 bash[25448]: audit 2021-03-10T17:26:07.667563+0000 mon.a (mon.0) 3958 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T17:26:08.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:07 gibba020 bash[25448]: audit 2021-03-10T17:26:07.668299+0000 mon.a (mon.0) 3959 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:26:08.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:07 gibba020 bash[25448]: audit 2021-03-10T17:26:07.668960+0000 mon.a (mon.0) 3960 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:26:08.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:07 gibba020 bash[25448]: audit 2021-03-10T17:26:07.669610+0000 mon.a (mon.0) 3961 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:26:08.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:07 gibba013 bash[29418]: audit 2021-03-10T17:26:06.988418+0000 mon.a (mon.0) 3956 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:26:08.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:07 gibba013 bash[29418]: audit 2021-03-10T17:26:07.225706+0000 mon.a (mon.0) 3957 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:26:08.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:07 gibba013 bash[29418]: audit 2021-03-10T17:26:07.667563+0000 mon.a (mon.0) 3958 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T17:26:08.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:07 gibba013 bash[29418]: audit 2021-03-10T17:26:07.668299+0000 mon.a (mon.0) 3959 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:26:08.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:07 gibba013 bash[29418]: audit 2021-03-10T17:26:07.668960+0000 mon.a (mon.0) 3960 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:26:08.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:07 gibba013 bash[29418]: audit 2021-03-10T17:26:07.669610+0000 mon.a (mon.0) 3961 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:26:08.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:07 gibba013 bash[30381]: audit 2021-03-10T17:26:06.988418+0000 mon.a (mon.0) 3956 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:26:08.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:07 gibba013 bash[30381]: audit 2021-03-10T17:26:07.225706+0000 mon.a (mon.0) 3957 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:26:08.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:07 gibba013 bash[30381]: audit 2021-03-10T17:26:07.667563+0000 mon.a (mon.0) 3958 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T17:26:08.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:07 gibba013 bash[30381]: audit 2021-03-10T17:26:07.668299+0000 mon.a (mon.0) 3959 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:26:08.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:07 gibba013 bash[30381]: audit 2021-03-10T17:26:07.668960+0000 mon.a (mon.0) 3960 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:26:08.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:07 gibba013 bash[30381]: audit 2021-03-10T17:26:07.669610+0000 mon.a (mon.0) 3961 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:26:09.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:08 gibba020 bash[25448]: cluster 2021-03-10T17:26:07.799716+0000 mgr.gibba020.yqfnwy (mgr.34427) 11234 : cluster [DBG] pgmap v6401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:09.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:08 gibba013 bash[29418]: cluster 2021-03-10T17:26:07.799716+0000 mgr.gibba020.yqfnwy (mgr.34427) 11234 : cluster [DBG] pgmap v6401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:09.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:08 gibba013 bash[30381]: cluster 2021-03-10T17:26:07.799716+0000 mgr.gibba020.yqfnwy (mgr.34427) 11234 : cluster [DBG] pgmap v6401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:11.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:10 gibba020 bash[25448]: cluster 2021-03-10T17:26:09.801038+0000 mgr.gibba020.yqfnwy (mgr.34427) 11235 : cluster [DBG] pgmap v6402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:11.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:10 gibba013 bash[29418]: cluster 2021-03-10T17:26:09.801038+0000 mgr.gibba020.yqfnwy (mgr.34427) 11235 : cluster [DBG] pgmap v6402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:11.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:10 gibba013 bash[30381]: cluster 2021-03-10T17:26:09.801038+0000 mgr.gibba020.yqfnwy (mgr.34427) 11235 : cluster [DBG] pgmap v6402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:12.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:11 gibba020 bash[25448]: cephadm 2021-03-10T17:26:10.465779+0000 mgr.gibba020.yqfnwy (mgr.34427) 11236 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:26:12.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:11 gibba013 bash[29418]: cephadm 2021-03-10T17:26:10.465779+0000 mgr.gibba020.yqfnwy (mgr.34427) 11236 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:26:12.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:11 gibba013 bash[30381]: cephadm 2021-03-10T17:26:10.465779+0000 mgr.gibba020.yqfnwy (mgr.34427) 11236 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:26:13.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:12 gibba020 bash[25448]: cluster 2021-03-10T17:26:11.802760+0000 mgr.gibba020.yqfnwy (mgr.34427) 11237 : cluster [DBG] pgmap v6403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:13.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:12 gibba013 bash[29418]: cluster 2021-03-10T17:26:11.802760+0000 mgr.gibba020.yqfnwy (mgr.34427) 11237 : cluster [DBG] pgmap v6403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:13.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:12 gibba013 bash[30381]: cluster 2021-03-10T17:26:11.802760+0000 mgr.gibba020.yqfnwy (mgr.34427) 11237 : cluster [DBG] pgmap v6403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:15.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:14 gibba020 bash[25448]: cluster 2021-03-10T17:26:13.804395+0000 mgr.gibba020.yqfnwy (mgr.34427) 11238 : cluster [DBG] pgmap v6404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:15.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:14 gibba013 bash[29418]: cluster 2021-03-10T17:26:13.804395+0000 mgr.gibba020.yqfnwy (mgr.34427) 11238 : cluster [DBG] pgmap v6404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:15.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:14 gibba013 bash[30381]: cluster 2021-03-10T17:26:13.804395+0000 mgr.gibba020.yqfnwy (mgr.34427) 11238 : cluster [DBG] pgmap v6404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:16.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:15 gibba013 bash[29418]: cluster 2021-03-10T17:26:15.805874+0000 mgr.gibba020.yqfnwy (mgr.34427) 11239 : cluster [DBG] pgmap v6405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:16.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:15 gibba013 bash[30381]: cluster 2021-03-10T17:26:15.805874+0000 mgr.gibba020.yqfnwy (mgr.34427) 11239 : cluster [DBG] pgmap v6405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:16.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:15 gibba020 bash[25448]: cluster 2021-03-10T17:26:15.805874+0000 mgr.gibba020.yqfnwy (mgr.34427) 11239 : cluster [DBG] pgmap v6405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:19.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:18 gibba013 bash[29418]: cluster 2021-03-10T17:26:17.807153+0000 mgr.gibba020.yqfnwy (mgr.34427) 11240 : cluster [DBG] pgmap v6406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:19.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:18 gibba013 bash[30381]: cluster 2021-03-10T17:26:17.807153+0000 mgr.gibba020.yqfnwy (mgr.34427) 11240 : cluster [DBG] pgmap v6406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:19.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:18 gibba020 bash[25448]: cluster 2021-03-10T17:26:17.807153+0000 mgr.gibba020.yqfnwy (mgr.34427) 11240 : cluster [DBG] pgmap v6406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:21.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:20 gibba013 bash[29418]: cluster 2021-03-10T17:26:19.808713+0000 mgr.gibba020.yqfnwy (mgr.34427) 11241 : cluster [DBG] pgmap v6407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:21.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:20 gibba013 bash[30381]: cluster 2021-03-10T17:26:19.808713+0000 mgr.gibba020.yqfnwy (mgr.34427) 11241 : cluster [DBG] pgmap v6407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:21.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:20 gibba020 bash[25448]: cluster 2021-03-10T17:26:19.808713+0000 mgr.gibba020.yqfnwy (mgr.34427) 11241 : cluster [DBG] pgmap v6407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:22.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:22 gibba013 bash[29418]: cluster 2021-03-10T17:26:21.810360+0000 mgr.gibba020.yqfnwy (mgr.34427) 11242 : cluster [DBG] pgmap v6408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:22.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:22 gibba013 bash[30381]: cluster 2021-03-10T17:26:21.810360+0000 mgr.gibba020.yqfnwy (mgr.34427) 11242 : cluster [DBG] pgmap v6408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:22.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:22 gibba020 bash[25448]: cluster 2021-03-10T17:26:21.810360+0000 mgr.gibba020.yqfnwy (mgr.34427) 11242 : cluster [DBG] pgmap v6408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:24.036 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:26:24.265 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:26:24.265 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 4m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:26:24.265 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 3m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:26:24.265 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:26:24.266 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:26:24.266 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:26:24.266 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:26:24.266 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:26:24.267 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:26:24.267 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:26:24.267 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:26:24.267 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:26:24.267 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:26:24.268 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:26:24.268 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:26:24.268 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:26:24.268 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:26:24.269 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:26:24.269 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:26:24.269 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 3m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:26:24.269 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 3m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:26:24.513 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:26:24.513 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:26:24.513 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:26:24.514 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:26:24.514 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:26:24.514 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:26:24.514 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:26:24.515 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:26:24.515 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:26:24.515 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:26:24.515 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:26:24.516 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:26:24.516 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:26:24.516 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:26:24.516 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:26:25.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:24 gibba013 bash[29418]: cluster 2021-03-10T17:26:23.812317+0000 mgr.gibba020.yqfnwy (mgr.34427) 11243 : cluster [DBG] pgmap v6409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:25.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:24 gibba013 bash[29418]: audit 2021-03-10T17:26:24.511653+0000 mon.c (mon.1) 172 : audit [DBG] from='client.? 172.21.2.113:0/2766435431' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:25.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:24 gibba013 bash[30381]: cluster 2021-03-10T17:26:23.812317+0000 mgr.gibba020.yqfnwy (mgr.34427) 11243 : cluster [DBG] pgmap v6409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:25.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:24 gibba013 bash[30381]: audit 2021-03-10T17:26:24.511653+0000 mon.c (mon.1) 172 : audit [DBG] from='client.? 172.21.2.113:0/2766435431' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:25.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:24 gibba020 bash[25448]: cluster 2021-03-10T17:26:23.812317+0000 mgr.gibba020.yqfnwy (mgr.34427) 11243 : cluster [DBG] pgmap v6409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:25.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:24 gibba020 bash[25448]: audit 2021-03-10T17:26:24.511653+0000 mon.c (mon.1) 172 : audit [DBG] from='client.? 172.21.2.113:0/2766435431' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:26.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:25 gibba020 bash[25448]: audit 2021-03-10T17:26:24.025314+0000 mgr.gibba020.yqfnwy (mgr.34427) 11244 : audit [DBG] from='client.61573 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:26:26.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:25 gibba020 bash[25448]: audit 2021-03-10T17:26:24.250283+0000 mgr.gibba020.yqfnwy (mgr.34427) 11245 : audit [DBG] from='client.61579 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:26:26.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:25 gibba013 bash[29418]: audit 2021-03-10T17:26:24.025314+0000 mgr.gibba020.yqfnwy (mgr.34427) 11244 : audit [DBG] from='client.61573 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:26:26.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:25 gibba013 bash[29418]: audit 2021-03-10T17:26:24.250283+0000 mgr.gibba020.yqfnwy (mgr.34427) 11245 : audit [DBG] from='client.61579 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:26:26.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:25 gibba013 bash[30381]: audit 2021-03-10T17:26:24.025314+0000 mgr.gibba020.yqfnwy (mgr.34427) 11244 : audit [DBG] from='client.61573 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:26:26.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:25 gibba013 bash[30381]: audit 2021-03-10T17:26:24.250283+0000 mgr.gibba020.yqfnwy (mgr.34427) 11245 : audit [DBG] from='client.61579 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:26:27.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:26 gibba020 bash[25448]: cephadm 2021-03-10T17:26:25.481790+0000 mgr.gibba020.yqfnwy (mgr.34427) 11246 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:26:27.213 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:26 gibba020 bash[25448]: cluster 2021-03-10T17:26:25.813825+0000 mgr.gibba020.yqfnwy (mgr.34427) 11247 : cluster [DBG] pgmap v6410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:27.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:26 gibba013 bash[29418]: cephadm 2021-03-10T17:26:25.481790+0000 mgr.gibba020.yqfnwy (mgr.34427) 11246 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:26:27.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:26 gibba013 bash[29418]: cluster 2021-03-10T17:26:25.813825+0000 mgr.gibba020.yqfnwy (mgr.34427) 11247 : cluster [DBG] pgmap v6410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:27.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:26 gibba013 bash[30381]: cephadm 2021-03-10T17:26:25.481790+0000 mgr.gibba020.yqfnwy (mgr.34427) 11246 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:26:27.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:26 gibba013 bash[30381]: cluster 2021-03-10T17:26:25.813825+0000 mgr.gibba020.yqfnwy (mgr.34427) 11247 : cluster [DBG] pgmap v6410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:29.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:28 gibba020 bash[25448]: cluster 2021-03-10T17:26:27.815139+0000 mgr.gibba020.yqfnwy (mgr.34427) 11248 : cluster [DBG] pgmap v6411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:29.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:28 gibba013 bash[29418]: cluster 2021-03-10T17:26:27.815139+0000 mgr.gibba020.yqfnwy (mgr.34427) 11248 : cluster [DBG] pgmap v6411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:29.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:28 gibba013 bash[30381]: cluster 2021-03-10T17:26:27.815139+0000 mgr.gibba020.yqfnwy (mgr.34427) 11248 : cluster [DBG] pgmap v6411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:31.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:30 gibba020 bash[25448]: cluster 2021-03-10T17:26:29.816753+0000 mgr.gibba020.yqfnwy (mgr.34427) 11249 : cluster [DBG] pgmap v6412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:31.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:30 gibba013 bash[29418]: cluster 2021-03-10T17:26:29.816753+0000 mgr.gibba020.yqfnwy (mgr.34427) 11249 : cluster [DBG] pgmap v6412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:31.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:30 gibba013 bash[30381]: cluster 2021-03-10T17:26:29.816753+0000 mgr.gibba020.yqfnwy (mgr.34427) 11249 : cluster [DBG] pgmap v6412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:32.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:32 gibba013 bash[29418]: cluster 2021-03-10T17:26:31.818513+0000 mgr.gibba020.yqfnwy (mgr.34427) 11250 : cluster [DBG] pgmap v6413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:32.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:32 gibba013 bash[30381]: cluster 2021-03-10T17:26:31.818513+0000 mgr.gibba020.yqfnwy (mgr.34427) 11250 : cluster [DBG] pgmap v6413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:32.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:32 gibba020 bash[25448]: cluster 2021-03-10T17:26:31.818513+0000 mgr.gibba020.yqfnwy (mgr.34427) 11250 : cluster [DBG] pgmap v6413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:35.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:34 gibba020 bash[25448]: cluster 2021-03-10T17:26:33.820197+0000 mgr.gibba020.yqfnwy (mgr.34427) 11251 : cluster [DBG] pgmap v6414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:35.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:34 gibba013 bash[29418]: cluster 2021-03-10T17:26:33.820197+0000 mgr.gibba020.yqfnwy (mgr.34427) 11251 : cluster [DBG] pgmap v6414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:35.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:34 gibba013 bash[30381]: cluster 2021-03-10T17:26:33.820197+0000 mgr.gibba020.yqfnwy (mgr.34427) 11251 : cluster [DBG] pgmap v6414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:37.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:36 gibba020 bash[25448]: cluster 2021-03-10T17:26:35.821678+0000 mgr.gibba020.yqfnwy (mgr.34427) 11252 : cluster [DBG] pgmap v6415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:37.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:36 gibba013 bash[29418]: cluster 2021-03-10T17:26:35.821678+0000 mgr.gibba020.yqfnwy (mgr.34427) 11252 : cluster [DBG] pgmap v6415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:37.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:36 gibba013 bash[30381]: cluster 2021-03-10T17:26:35.821678+0000 mgr.gibba020.yqfnwy (mgr.34427) 11252 : cluster [DBG] pgmap v6415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:39.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:38 gibba020 bash[25448]: cluster 2021-03-10T17:26:37.823123+0000 mgr.gibba020.yqfnwy (mgr.34427) 11253 : cluster [DBG] pgmap v6416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:39.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:38 gibba013 bash[29418]: cluster 2021-03-10T17:26:37.823123+0000 mgr.gibba020.yqfnwy (mgr.34427) 11253 : cluster [DBG] pgmap v6416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:39.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:38 gibba013 bash[30381]: cluster 2021-03-10T17:26:37.823123+0000 mgr.gibba020.yqfnwy (mgr.34427) 11253 : cluster [DBG] pgmap v6416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:41.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:40 gibba020 bash[25448]: cluster 2021-03-10T17:26:39.824861+0000 mgr.gibba020.yqfnwy (mgr.34427) 11254 : cluster [DBG] pgmap v6417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:41.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:40 gibba013 bash[29418]: cluster 2021-03-10T17:26:39.824861+0000 mgr.gibba020.yqfnwy (mgr.34427) 11254 : cluster [DBG] pgmap v6417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:41.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:40 gibba013 bash[30381]: cluster 2021-03-10T17:26:39.824861+0000 mgr.gibba020.yqfnwy (mgr.34427) 11254 : cluster [DBG] pgmap v6417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:42.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:41 gibba020 bash[25448]: cephadm 2021-03-10T17:26:40.497909+0000 mgr.gibba020.yqfnwy (mgr.34427) 11255 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:26:42.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:41 gibba013 bash[29418]: cephadm 2021-03-10T17:26:40.497909+0000 mgr.gibba020.yqfnwy (mgr.34427) 11255 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:26:42.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:41 gibba013 bash[30381]: cephadm 2021-03-10T17:26:40.497909+0000 mgr.gibba020.yqfnwy (mgr.34427) 11255 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:26:43.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:42 gibba020 bash[25448]: cluster 2021-03-10T17:26:41.826636+0000 mgr.gibba020.yqfnwy (mgr.34427) 11256 : cluster [DBG] pgmap v6418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:43.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:42 gibba013 bash[29418]: cluster 2021-03-10T17:26:41.826636+0000 mgr.gibba020.yqfnwy (mgr.34427) 11256 : cluster [DBG] pgmap v6418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:43.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:42 gibba013 bash[30381]: cluster 2021-03-10T17:26:41.826636+0000 mgr.gibba020.yqfnwy (mgr.34427) 11256 : cluster [DBG] pgmap v6418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:45.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:44 gibba020 bash[25448]: cluster 2021-03-10T17:26:43.828424+0000 mgr.gibba020.yqfnwy (mgr.34427) 11257 : cluster [DBG] pgmap v6419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:45.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:44 gibba013 bash[29418]: cluster 2021-03-10T17:26:43.828424+0000 mgr.gibba020.yqfnwy (mgr.34427) 11257 : cluster [DBG] pgmap v6419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:45.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:44 gibba013 bash[30381]: cluster 2021-03-10T17:26:43.828424+0000 mgr.gibba020.yqfnwy (mgr.34427) 11257 : cluster [DBG] pgmap v6419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:46.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:45 gibba013 bash[29418]: cluster 2021-03-10T17:26:45.829938+0000 mgr.gibba020.yqfnwy (mgr.34427) 11258 : cluster [DBG] pgmap v6420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:46.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:45 gibba013 bash[30381]: cluster 2021-03-10T17:26:45.829938+0000 mgr.gibba020.yqfnwy (mgr.34427) 11258 : cluster [DBG] pgmap v6420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:46.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:45 gibba020 bash[25448]: cluster 2021-03-10T17:26:45.829938+0000 mgr.gibba020.yqfnwy (mgr.34427) 11258 : cluster [DBG] pgmap v6420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:49.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:48 gibba020 bash[25448]: cluster 2021-03-10T17:26:47.831226+0000 mgr.gibba020.yqfnwy (mgr.34427) 11259 : cluster [DBG] pgmap v6421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:49.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:48 gibba013 bash[29418]: cluster 2021-03-10T17:26:47.831226+0000 mgr.gibba020.yqfnwy (mgr.34427) 11259 : cluster [DBG] pgmap v6421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:49.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:48 gibba013 bash[30381]: cluster 2021-03-10T17:26:47.831226+0000 mgr.gibba020.yqfnwy (mgr.34427) 11259 : cluster [DBG] pgmap v6421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:51.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:50 gibba020 bash[25448]: cluster 2021-03-10T17:26:49.832825+0000 mgr.gibba020.yqfnwy (mgr.34427) 11260 : cluster [DBG] pgmap v6422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:51.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:50 gibba013 bash[29418]: cluster 2021-03-10T17:26:49.832825+0000 mgr.gibba020.yqfnwy (mgr.34427) 11260 : cluster [DBG] pgmap v6422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:51.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:50 gibba013 bash[30381]: cluster 2021-03-10T17:26:49.832825+0000 mgr.gibba020.yqfnwy (mgr.34427) 11260 : cluster [DBG] pgmap v6422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:52.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:52 gibba013 bash[29418]: cluster 2021-03-10T17:26:51.834321+0000 mgr.gibba020.yqfnwy (mgr.34427) 11261 : cluster [DBG] pgmap v6423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:52.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:52 gibba013 bash[30381]: cluster 2021-03-10T17:26:51.834321+0000 mgr.gibba020.yqfnwy (mgr.34427) 11261 : cluster [DBG] pgmap v6423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:52.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:52 gibba020 bash[25448]: cluster 2021-03-10T17:26:51.834321+0000 mgr.gibba020.yqfnwy (mgr.34427) 11261 : cluster [DBG] pgmap v6423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:54.757 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:26:55.014 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:26:55.015 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 5m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:26:55.015 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 4m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:26:55.015 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:26:55.015 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:26:55.016 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:26:55.016 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:26:55.016 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:26:55.016 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:26:55.017 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:26:55.017 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:26:55.017 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:26:55.017 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:26:55.017 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:26:55.018 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:26:55.018 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:26:55.018 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:26:55.018 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:26:55.018 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:26:55.019 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 4m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:26:55.019 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 4m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:26:55.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:54 gibba020 bash[25448]: cluster 2021-03-10T17:26:53.835773+0000 mgr.gibba020.yqfnwy (mgr.34427) 11262 : cluster [DBG] pgmap v6424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:55.273 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:26:55.274 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:26:55.274 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:26:55.274 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:26:55.274 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:26:55.275 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:26:55.275 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:26:55.275 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:26:55.275 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:26:55.275 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:26:55.276 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:26:55.276 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:26:55.276 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:26:55.276 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:26:55.276 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:26:55.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:54 gibba013 bash[29418]: cluster 2021-03-10T17:26:53.835773+0000 mgr.gibba020.yqfnwy (mgr.34427) 11262 : cluster [DBG] pgmap v6424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:55.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:54 gibba013 bash[30381]: cluster 2021-03-10T17:26:53.835773+0000 mgr.gibba020.yqfnwy (mgr.34427) 11262 : cluster [DBG] pgmap v6424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:56.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:55 gibba020 bash[25448]: audit 2021-03-10T17:26:54.745806+0000 mgr.gibba020.yqfnwy (mgr.34427) 11263 : audit [DBG] from='client.51612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:26:56.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:55 gibba020 bash[25448]: audit 2021-03-10T17:26:55.271982+0000 mon.c (mon.1) 173 : audit [DBG] from='client.? 172.21.2.113:0/796028710' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:56.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:55 gibba020 bash[25448]: audit 2021-03-10T17:26:55.510442+0000 mon.a (mon.0) 3962 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:26:56.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:55 gibba020 bash[25448]: audit 2021-03-10T17:26:55.731168+0000 mon.a (mon.0) 3963 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:26:56.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:55 gibba020 bash[25448]: audit 2021-03-10T17:26:55.734381+0000 mon.a (mon.0) 3964 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:26:56.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:55 gibba020 bash[25448]: audit 2021-03-10T17:26:55.735739+0000 mon.a (mon.0) 3965 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:56.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:55 gibba020 bash[25448]: audit 2021-03-10T17:26:55.737076+0000 mon.a (mon.0) 3966 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:56.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:55 gibba020 bash[25448]: audit 2021-03-10T17:26:55.737960+0000 mon.a (mon.0) 3967 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:56.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:55 gibba020 bash[25448]: audit 2021-03-10T17:26:55.740742+0000 mon.a (mon.0) 3968 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:56.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:55 gibba020 bash[25448]: audit 2021-03-10T17:26:55.742209+0000 mon.a (mon.0) 3969 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:56.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:55 gibba013 bash[29418]: audit 2021-03-10T17:26:54.745806+0000 mgr.gibba020.yqfnwy (mgr.34427) 11263 : audit [DBG] from='client.51612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:26:56.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:55 gibba013 bash[29418]: audit 2021-03-10T17:26:55.271982+0000 mon.c (mon.1) 173 : audit [DBG] from='client.? 172.21.2.113:0/796028710' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:56.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:55 gibba013 bash[29418]: audit 2021-03-10T17:26:55.510442+0000 mon.a (mon.0) 3962 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:26:56.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:55 gibba013 bash[29418]: audit 2021-03-10T17:26:55.731168+0000 mon.a (mon.0) 3963 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:26:56.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:55 gibba013 bash[29418]: audit 2021-03-10T17:26:55.734381+0000 mon.a (mon.0) 3964 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:26:56.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:55 gibba013 bash[29418]: audit 2021-03-10T17:26:55.735739+0000 mon.a (mon.0) 3965 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:56.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:55 gibba013 bash[29418]: audit 2021-03-10T17:26:55.737076+0000 mon.a (mon.0) 3966 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:56.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:55 gibba013 bash[29418]: audit 2021-03-10T17:26:55.737960+0000 mon.a (mon.0) 3967 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:56.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:55 gibba013 bash[29418]: audit 2021-03-10T17:26:55.740742+0000 mon.a (mon.0) 3968 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:56.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:55 gibba013 bash[29418]: audit 2021-03-10T17:26:55.742209+0000 mon.a (mon.0) 3969 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:56.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:55 gibba013 bash[30381]: audit 2021-03-10T17:26:54.745806+0000 mgr.gibba020.yqfnwy (mgr.34427) 11263 : audit [DBG] from='client.51612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:26:56.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:55 gibba013 bash[30381]: audit 2021-03-10T17:26:55.271982+0000 mon.c (mon.1) 173 : audit [DBG] from='client.? 172.21.2.113:0/796028710' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:56.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:55 gibba013 bash[30381]: audit 2021-03-10T17:26:55.510442+0000 mon.a (mon.0) 3962 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:26:56.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:55 gibba013 bash[30381]: audit 2021-03-10T17:26:55.731168+0000 mon.a (mon.0) 3963 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:26:56.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:55 gibba013 bash[30381]: audit 2021-03-10T17:26:55.734381+0000 mon.a (mon.0) 3964 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:26:56.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:55 gibba013 bash[30381]: audit 2021-03-10T17:26:55.735739+0000 mon.a (mon.0) 3965 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:56.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:55 gibba013 bash[30381]: audit 2021-03-10T17:26:55.737076+0000 mon.a (mon.0) 3966 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:56.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:55 gibba013 bash[30381]: audit 2021-03-10T17:26:55.737960+0000 mon.a (mon.0) 3967 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:56.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:55 gibba013 bash[30381]: audit 2021-03-10T17:26:55.740742+0000 mon.a (mon.0) 3968 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:56.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:55 gibba013 bash[30381]: audit 2021-03-10T17:26:55.742209+0000 mon.a (mon.0) 3969 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:26:57.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:56 gibba020 bash[25448]: audit 2021-03-10T17:26:54.972065+0000 mgr.gibba020.yqfnwy (mgr.34427) 11264 : audit [DBG] from='client.51618 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:26:57.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:56 gibba020 bash[25448]: cephadm 2021-03-10T17:26:55.515910+0000 mgr.gibba020.yqfnwy (mgr.34427) 11265 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:26:57.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:56 gibba020 bash[25448]: cephadm 2021-03-10T17:26:55.517487+0000 mgr.gibba020.yqfnwy (mgr.34427) 11266 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:26:57.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:56 gibba020 bash[25448]: cephadm 2021-03-10T17:26:55.733190+0000 mgr.gibba020.yqfnwy (mgr.34427) 11267 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:26:57.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:56 gibba020 bash[25448]: cephadm 2021-03-10T17:26:55.734926+0000 mgr.gibba020.yqfnwy (mgr.34427) 11268 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:26:57.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:56 gibba020 bash[25448]: cephadm 2021-03-10T17:26:55.736191+0000 mgr.gibba020.yqfnwy (mgr.34427) 11269 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:26:57.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:56 gibba020 bash[25448]: cephadm 2021-03-10T17:26:55.736304+0000 mgr.gibba020.yqfnwy (mgr.34427) 11270 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:26:57.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:56 gibba020 bash[25448]: cephadm 2021-03-10T17:26:55.737272+0000 mgr.gibba020.yqfnwy (mgr.34427) 11271 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:26:57.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:56 gibba020 bash[25448]: cephadm 2021-03-10T17:26:55.737308+0000 mgr.gibba020.yqfnwy (mgr.34427) 11272 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:26:57.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:56 gibba020 bash[25448]: cephadm 2021-03-10T17:26:55.738448+0000 mgr.gibba020.yqfnwy (mgr.34427) 11273 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:26:57.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:56 gibba020 bash[25448]: cephadm 2021-03-10T17:26:55.739693+0000 mgr.gibba020.yqfnwy (mgr.34427) 11274 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:26:57.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:56 gibba020 bash[25448]: cephadm 2021-03-10T17:26:55.739730+0000 mgr.gibba020.yqfnwy (mgr.34427) 11275 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:26:57.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:56 gibba020 bash[25448]: cephadm 2021-03-10T17:26:55.740948+0000 mgr.gibba020.yqfnwy (mgr.34427) 11276 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:26:57.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:56 gibba020 bash[25448]: cephadm 2021-03-10T17:26:55.741263+0000 mgr.gibba020.yqfnwy (mgr.34427) 11277 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:26:57.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:56 gibba020 bash[25448]: cephadm 2021-03-10T17:26:55.742633+0000 mgr.gibba020.yqfnwy (mgr.34427) 11278 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:26:57.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:56 gibba020 bash[25448]: cephadm 2021-03-10T17:26:55.742670+0000 mgr.gibba020.yqfnwy (mgr.34427) 11279 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:26:57.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:56 gibba020 bash[25448]: cephadm 2021-03-10T17:26:55.742772+0000 mgr.gibba020.yqfnwy (mgr.34427) 11280 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:26:57.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:56 gibba020 bash[25448]: cluster 2021-03-10T17:26:55.837336+0000 mgr.gibba020.yqfnwy (mgr.34427) 11281 : cluster [DBG] pgmap v6425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:57.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:56 gibba013 bash[29418]: audit 2021-03-10T17:26:54.972065+0000 mgr.gibba020.yqfnwy (mgr.34427) 11264 : audit [DBG] from='client.51618 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:26:57.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:56 gibba013 bash[29418]: cephadm 2021-03-10T17:26:55.515910+0000 mgr.gibba020.yqfnwy (mgr.34427) 11265 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:26:57.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:56 gibba013 bash[29418]: cephadm 2021-03-10T17:26:55.517487+0000 mgr.gibba020.yqfnwy (mgr.34427) 11266 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:26:57.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:56 gibba013 bash[29418]: cephadm 2021-03-10T17:26:55.733190+0000 mgr.gibba020.yqfnwy (mgr.34427) 11267 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:26:57.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:56 gibba013 bash[29418]: cephadm 2021-03-10T17:26:55.734926+0000 mgr.gibba020.yqfnwy (mgr.34427) 11268 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:26:57.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:56 gibba013 bash[29418]: cephadm 2021-03-10T17:26:55.736191+0000 mgr.gibba020.yqfnwy (mgr.34427) 11269 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:26:57.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:56 gibba013 bash[29418]: cephadm 2021-03-10T17:26:55.736304+0000 mgr.gibba020.yqfnwy (mgr.34427) 11270 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:26:57.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:56 gibba013 bash[29418]: cephadm 2021-03-10T17:26:55.737272+0000 mgr.gibba020.yqfnwy (mgr.34427) 11271 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:26:57.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:56 gibba013 bash[29418]: cephadm 2021-03-10T17:26:55.737308+0000 mgr.gibba020.yqfnwy (mgr.34427) 11272 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:26:57.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:56 gibba013 bash[29418]: cephadm 2021-03-10T17:26:55.738448+0000 mgr.gibba020.yqfnwy (mgr.34427) 11273 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:26:57.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:56 gibba013 bash[29418]: cephadm 2021-03-10T17:26:55.739693+0000 mgr.gibba020.yqfnwy (mgr.34427) 11274 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:26:57.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:56 gibba013 bash[29418]: cephadm 2021-03-10T17:26:55.739730+0000 mgr.gibba020.yqfnwy (mgr.34427) 11275 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:26:57.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:56 gibba013 bash[29418]: cephadm 2021-03-10T17:26:55.740948+0000 mgr.gibba020.yqfnwy (mgr.34427) 11276 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:26:57.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:56 gibba013 bash[29418]: cephadm 2021-03-10T17:26:55.741263+0000 mgr.gibba020.yqfnwy (mgr.34427) 11277 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:26:57.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:56 gibba013 bash[29418]: cephadm 2021-03-10T17:26:55.742633+0000 mgr.gibba020.yqfnwy (mgr.34427) 11278 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:26:57.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:56 gibba013 bash[29418]: cephadm 2021-03-10T17:26:55.742670+0000 mgr.gibba020.yqfnwy (mgr.34427) 11279 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:26:57.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:56 gibba013 bash[29418]: cephadm 2021-03-10T17:26:55.742772+0000 mgr.gibba020.yqfnwy (mgr.34427) 11280 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:26:57.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:56 gibba013 bash[29418]: cluster 2021-03-10T17:26:55.837336+0000 mgr.gibba020.yqfnwy (mgr.34427) 11281 : cluster [DBG] pgmap v6425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:57.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:56 gibba013 bash[30381]: audit 2021-03-10T17:26:54.972065+0000 mgr.gibba020.yqfnwy (mgr.34427) 11264 : audit [DBG] from='client.51618 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:26:57.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:56 gibba013 bash[30381]: cephadm 2021-03-10T17:26:55.515910+0000 mgr.gibba020.yqfnwy (mgr.34427) 11265 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:26:57.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:56 gibba013 bash[30381]: cephadm 2021-03-10T17:26:55.517487+0000 mgr.gibba020.yqfnwy (mgr.34427) 11266 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:26:57.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:56 gibba013 bash[30381]: cephadm 2021-03-10T17:26:55.733190+0000 mgr.gibba020.yqfnwy (mgr.34427) 11267 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:26:57.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:56 gibba013 bash[30381]: cephadm 2021-03-10T17:26:55.734926+0000 mgr.gibba020.yqfnwy (mgr.34427) 11268 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:26:57.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:56 gibba013 bash[30381]: cephadm 2021-03-10T17:26:55.736191+0000 mgr.gibba020.yqfnwy (mgr.34427) 11269 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:26:57.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:56 gibba013 bash[30381]: cephadm 2021-03-10T17:26:55.736304+0000 mgr.gibba020.yqfnwy (mgr.34427) 11270 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:26:57.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:56 gibba013 bash[30381]: cephadm 2021-03-10T17:26:55.737272+0000 mgr.gibba020.yqfnwy (mgr.34427) 11271 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:26:57.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:56 gibba013 bash[30381]: cephadm 2021-03-10T17:26:55.737308+0000 mgr.gibba020.yqfnwy (mgr.34427) 11272 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:26:57.394 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:56 gibba013 bash[30381]: cephadm 2021-03-10T17:26:55.738448+0000 mgr.gibba020.yqfnwy (mgr.34427) 11273 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:26:57.394 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:56 gibba013 bash[30381]: cephadm 2021-03-10T17:26:55.739693+0000 mgr.gibba020.yqfnwy (mgr.34427) 11274 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:26:57.395 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:56 gibba013 bash[30381]: cephadm 2021-03-10T17:26:55.739730+0000 mgr.gibba020.yqfnwy (mgr.34427) 11275 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:26:57.395 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:56 gibba013 bash[30381]: cephadm 2021-03-10T17:26:55.740948+0000 mgr.gibba020.yqfnwy (mgr.34427) 11276 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:26:57.395 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:56 gibba013 bash[30381]: cephadm 2021-03-10T17:26:55.741263+0000 mgr.gibba020.yqfnwy (mgr.34427) 11277 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:26:57.395 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:56 gibba013 bash[30381]: cephadm 2021-03-10T17:26:55.742633+0000 mgr.gibba020.yqfnwy (mgr.34427) 11278 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:26:57.396 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:56 gibba013 bash[30381]: cephadm 2021-03-10T17:26:55.742670+0000 mgr.gibba020.yqfnwy (mgr.34427) 11279 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:26:57.396 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:56 gibba013 bash[30381]: cephadm 2021-03-10T17:26:55.742772+0000 mgr.gibba020.yqfnwy (mgr.34427) 11280 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:26:57.396 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:56 gibba013 bash[30381]: cluster 2021-03-10T17:26:55.837336+0000 mgr.gibba020.yqfnwy (mgr.34427) 11281 : cluster [DBG] pgmap v6425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:59.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:26:58 gibba020 bash[25448]: cluster 2021-03-10T17:26:57.838756+0000 mgr.gibba020.yqfnwy (mgr.34427) 11282 : cluster [DBG] pgmap v6426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:59.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:26:58 gibba013 bash[29418]: cluster 2021-03-10T17:26:57.838756+0000 mgr.gibba020.yqfnwy (mgr.34427) 11282 : cluster [DBG] pgmap v6426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:26:59.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:26:58 gibba013 bash[30381]: cluster 2021-03-10T17:26:57.838756+0000 mgr.gibba020.yqfnwy (mgr.34427) 11282 : cluster [DBG] pgmap v6426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:01.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:00 gibba020 bash[25448]: cluster 2021-03-10T17:26:59.840204+0000 mgr.gibba020.yqfnwy (mgr.34427) 11283 : cluster [DBG] pgmap v6427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:01.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:00 gibba013 bash[29418]: cluster 2021-03-10T17:26:59.840204+0000 mgr.gibba020.yqfnwy (mgr.34427) 11283 : cluster [DBG] pgmap v6427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:01.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:00 gibba013 bash[30381]: cluster 2021-03-10T17:26:59.840204+0000 mgr.gibba020.yqfnwy (mgr.34427) 11283 : cluster [DBG] pgmap v6427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:02.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:02 gibba013 bash[29418]: cluster 2021-03-10T17:27:01.841943+0000 mgr.gibba020.yqfnwy (mgr.34427) 11284 : cluster [DBG] pgmap v6428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:02.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:02 gibba013 bash[30381]: cluster 2021-03-10T17:27:01.841943+0000 mgr.gibba020.yqfnwy (mgr.34427) 11284 : cluster [DBG] pgmap v6428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:02.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:02 gibba020 bash[25448]: cluster 2021-03-10T17:27:01.841943+0000 mgr.gibba020.yqfnwy (mgr.34427) 11284 : cluster [DBG] pgmap v6428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:05.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:04 gibba020 bash[25448]: cluster 2021-03-10T17:27:03.843365+0000 mgr.gibba020.yqfnwy (mgr.34427) 11285 : cluster [DBG] pgmap v6429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:05.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:04 gibba013 bash[29418]: cluster 2021-03-10T17:27:03.843365+0000 mgr.gibba020.yqfnwy (mgr.34427) 11285 : cluster [DBG] pgmap v6429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:05.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:04 gibba013 bash[30381]: cluster 2021-03-10T17:27:03.843365+0000 mgr.gibba020.yqfnwy (mgr.34427) 11285 : cluster [DBG] pgmap v6429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:07.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:06 gibba020 bash[25448]: cluster 2021-03-10T17:27:05.845133+0000 mgr.gibba020.yqfnwy (mgr.34427) 11286 : cluster [DBG] pgmap v6430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:06 gibba013 bash[29418]: cluster 2021-03-10T17:27:05.845133+0000 mgr.gibba020.yqfnwy (mgr.34427) 11286 : cluster [DBG] pgmap v6430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:07.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:06 gibba013 bash[30381]: cluster 2021-03-10T17:27:05.845133+0000 mgr.gibba020.yqfnwy (mgr.34427) 11286 : cluster [DBG] pgmap v6430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:08.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:07 gibba020 bash[25448]: audit 2021-03-10T17:27:06.993383+0000 mon.a (mon.0) 3970 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:27:08.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:07 gibba020 bash[25448]: audit 2021-03-10T17:27:07.232447+0000 mon.a (mon.0) 3971 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:27:08.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:07 gibba020 bash[25448]: audit 2021-03-10T17:27:07.676475+0000 mon.a (mon.0) 3972 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T17:27:08.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:07 gibba020 bash[25448]: audit 2021-03-10T17:27:07.677178+0000 mon.a (mon.0) 3973 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:27:08.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:07 gibba020 bash[25448]: audit 2021-03-10T17:27:07.677846+0000 mon.a (mon.0) 3974 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:27:08.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:07 gibba020 bash[25448]: audit 2021-03-10T17:27:07.678536+0000 mon.a (mon.0) 3975 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:27:08.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:07 gibba013 bash[29418]: audit 2021-03-10T17:27:06.993383+0000 mon.a (mon.0) 3970 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:27:08.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:07 gibba013 bash[29418]: audit 2021-03-10T17:27:07.232447+0000 mon.a (mon.0) 3971 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:27:08.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:07 gibba013 bash[29418]: audit 2021-03-10T17:27:07.676475+0000 mon.a (mon.0) 3972 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T17:27:08.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:07 gibba013 bash[29418]: audit 2021-03-10T17:27:07.677178+0000 mon.a (mon.0) 3973 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:27:08.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:07 gibba013 bash[29418]: audit 2021-03-10T17:27:07.677846+0000 mon.a (mon.0) 3974 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:27:08.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:07 gibba013 bash[29418]: audit 2021-03-10T17:27:07.678536+0000 mon.a (mon.0) 3975 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:27:08.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:07 gibba013 bash[30381]: audit 2021-03-10T17:27:06.993383+0000 mon.a (mon.0) 3970 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:27:08.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:07 gibba013 bash[30381]: audit 2021-03-10T17:27:07.232447+0000 mon.a (mon.0) 3971 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:27:08.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:07 gibba013 bash[30381]: audit 2021-03-10T17:27:07.676475+0000 mon.a (mon.0) 3972 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T17:27:08.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:07 gibba013 bash[30381]: audit 2021-03-10T17:27:07.677178+0000 mon.a (mon.0) 3973 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:27:08.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:07 gibba013 bash[30381]: audit 2021-03-10T17:27:07.677846+0000 mon.a (mon.0) 3974 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:27:08.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:07 gibba013 bash[30381]: audit 2021-03-10T17:27:07.678536+0000 mon.a (mon.0) 3975 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:27:09.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:08 gibba020 bash[25448]: cluster 2021-03-10T17:27:07.846436+0000 mgr.gibba020.yqfnwy (mgr.34427) 11287 : cluster [DBG] pgmap v6431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:09.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:08 gibba013 bash[29418]: cluster 2021-03-10T17:27:07.846436+0000 mgr.gibba020.yqfnwy (mgr.34427) 11287 : cluster [DBG] pgmap v6431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:09.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:08 gibba013 bash[30381]: cluster 2021-03-10T17:27:07.846436+0000 mgr.gibba020.yqfnwy (mgr.34427) 11287 : cluster [DBG] pgmap v6431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:10.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:09 gibba013 bash[29418]: cluster 2021-03-10T17:27:09.848094+0000 mgr.gibba020.yqfnwy (mgr.34427) 11288 : cluster [DBG] pgmap v6432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:10.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:09 gibba013 bash[30381]: cluster 2021-03-10T17:27:09.848094+0000 mgr.gibba020.yqfnwy (mgr.34427) 11288 : cluster [DBG] pgmap v6432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:10.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:09 gibba020 bash[25448]: cluster 2021-03-10T17:27:09.848094+0000 mgr.gibba020.yqfnwy (mgr.34427) 11288 : cluster [DBG] pgmap v6432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:11.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:10 gibba020 bash[25448]: cephadm 2021-03-10T17:27:10.758365+0000 mgr.gibba020.yqfnwy (mgr.34427) 11289 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:27:11.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:10 gibba013 bash[29418]: cephadm 2021-03-10T17:27:10.758365+0000 mgr.gibba020.yqfnwy (mgr.34427) 11289 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:27:11.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:10 gibba013 bash[30381]: cephadm 2021-03-10T17:27:10.758365+0000 mgr.gibba020.yqfnwy (mgr.34427) 11289 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:27:12.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:12 gibba013 bash[29418]: cluster 2021-03-10T17:27:11.849812+0000 mgr.gibba020.yqfnwy (mgr.34427) 11290 : cluster [DBG] pgmap v6433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:12.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:12 gibba013 bash[30381]: cluster 2021-03-10T17:27:11.849812+0000 mgr.gibba020.yqfnwy (mgr.34427) 11290 : cluster [DBG] pgmap v6433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:12.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:12 gibba020 bash[25448]: cluster 2021-03-10T17:27:11.849812+0000 mgr.gibba020.yqfnwy (mgr.34427) 11290 : cluster [DBG] pgmap v6433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:15.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:14 gibba020 bash[25448]: cluster 2021-03-10T17:27:13.851229+0000 mgr.gibba020.yqfnwy (mgr.34427) 11291 : cluster [DBG] pgmap v6434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:15.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:14 gibba013 bash[29418]: cluster 2021-03-10T17:27:13.851229+0000 mgr.gibba020.yqfnwy (mgr.34427) 11291 : cluster [DBG] pgmap v6434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:15.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:14 gibba013 bash[30381]: cluster 2021-03-10T17:27:13.851229+0000 mgr.gibba020.yqfnwy (mgr.34427) 11291 : cluster [DBG] pgmap v6434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:17.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:16 gibba020 bash[25448]: cluster 2021-03-10T17:27:15.853040+0000 mgr.gibba020.yqfnwy (mgr.34427) 11292 : cluster [DBG] pgmap v6435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:17.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:16 gibba013 bash[29418]: cluster 2021-03-10T17:27:15.853040+0000 mgr.gibba020.yqfnwy (mgr.34427) 11292 : cluster [DBG] pgmap v6435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:17.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:16 gibba013 bash[30381]: cluster 2021-03-10T17:27:15.853040+0000 mgr.gibba020.yqfnwy (mgr.34427) 11292 : cluster [DBG] pgmap v6435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:19.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:18 gibba020 bash[25448]: cluster 2021-03-10T17:27:17.854289+0000 mgr.gibba020.yqfnwy (mgr.34427) 11293 : cluster [DBG] pgmap v6436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:19.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:18 gibba013 bash[29418]: cluster 2021-03-10T17:27:17.854289+0000 mgr.gibba020.yqfnwy (mgr.34427) 11293 : cluster [DBG] pgmap v6436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:19.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:18 gibba013 bash[30381]: cluster 2021-03-10T17:27:17.854289+0000 mgr.gibba020.yqfnwy (mgr.34427) 11293 : cluster [DBG] pgmap v6436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:21.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:20 gibba020 bash[25448]: cluster 2021-03-10T17:27:19.855706+0000 mgr.gibba020.yqfnwy (mgr.34427) 11294 : cluster [DBG] pgmap v6437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:21.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:20 gibba013 bash[29418]: cluster 2021-03-10T17:27:19.855706+0000 mgr.gibba020.yqfnwy (mgr.34427) 11294 : cluster [DBG] pgmap v6437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:21.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:20 gibba013 bash[30381]: cluster 2021-03-10T17:27:19.855706+0000 mgr.gibba020.yqfnwy (mgr.34427) 11294 : cluster [DBG] pgmap v6437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:22.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:22 gibba013 bash[29418]: cluster 2021-03-10T17:27:21.857405+0000 mgr.gibba020.yqfnwy (mgr.34427) 11295 : cluster [DBG] pgmap v6438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:22.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:22 gibba013 bash[30381]: cluster 2021-03-10T17:27:21.857405+0000 mgr.gibba020.yqfnwy (mgr.34427) 11295 : cluster [DBG] pgmap v6438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:22.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:22 gibba020 bash[25448]: cluster 2021-03-10T17:27:21.857405+0000 mgr.gibba020.yqfnwy (mgr.34427) 11295 : cluster [DBG] pgmap v6438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:25.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:24 gibba020 bash[25448]: cluster 2021-03-10T17:27:23.858778+0000 mgr.gibba020.yqfnwy (mgr.34427) 11296 : cluster [DBG] pgmap v6439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:25.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:24 gibba013 bash[29418]: cluster 2021-03-10T17:27:23.858778+0000 mgr.gibba020.yqfnwy (mgr.34427) 11296 : cluster [DBG] pgmap v6439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:25.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:24 gibba013 bash[30381]: cluster 2021-03-10T17:27:23.858778+0000 mgr.gibba020.yqfnwy (mgr.34427) 11296 : cluster [DBG] pgmap v6439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:25.521 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:27:25.756 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:27:25.757 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 5m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:27:25.757 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 4m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:27:25.757 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:27:25.757 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:27:25.758 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:27:25.758 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:27:25.758 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:27:25.758 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:27:25.759 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:27:25.759 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:27:25.759 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:27:25.759 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:27:25.759 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:27:25.760 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:27:25.760 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:27:25.760 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:27:25.760 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:27:25.761 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:27:25.761 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 4m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:27:25.761 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 4m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:27:26.007 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:27:26.008 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:27:26.008 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:27:26.008 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:27:26.008 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:27:26.008 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:27:26.009 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:27:26.009 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:27:26.009 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:27:26.009 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:27:26.010 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:27:26.010 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:27:26.010 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:27:26.010 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:27:26.010 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:27:27.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:26 gibba020 bash[25448]: audit 2021-03-10T17:27:25.509385+0000 mgr.gibba020.yqfnwy (mgr.34427) 11297 : audit [DBG] from='client.51630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:27:27.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:26 gibba020 bash[25448]: audit 2021-03-10T17:27:25.742305+0000 mgr.gibba020.yqfnwy (mgr.34427) 11298 : audit [DBG] from='client.51636 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:27:27.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:26 gibba020 bash[25448]: cephadm 2021-03-10T17:27:25.773843+0000 mgr.gibba020.yqfnwy (mgr.34427) 11299 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:27:27.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:26 gibba020 bash[25448]: cluster 2021-03-10T17:27:25.860559+0000 mgr.gibba020.yqfnwy (mgr.34427) 11300 : cluster [DBG] pgmap v6440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:27.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:26 gibba020 bash[25448]: audit 2021-03-10T17:27:26.005941+0000 mon.a (mon.0) 3976 : audit [DBG] from='client.? 172.21.2.113:0/3402229291' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:27.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:26 gibba013 bash[29418]: audit 2021-03-10T17:27:25.509385+0000 mgr.gibba020.yqfnwy (mgr.34427) 11297 : audit [DBG] from='client.51630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:27:27.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:26 gibba013 bash[29418]: audit 2021-03-10T17:27:25.742305+0000 mgr.gibba020.yqfnwy (mgr.34427) 11298 : audit [DBG] from='client.51636 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:27:27.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:26 gibba013 bash[29418]: cephadm 2021-03-10T17:27:25.773843+0000 mgr.gibba020.yqfnwy (mgr.34427) 11299 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:27:27.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:26 gibba013 bash[29418]: cluster 2021-03-10T17:27:25.860559+0000 mgr.gibba020.yqfnwy (mgr.34427) 11300 : cluster [DBG] pgmap v6440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:27.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:26 gibba013 bash[29418]: audit 2021-03-10T17:27:26.005941+0000 mon.a (mon.0) 3976 : audit [DBG] from='client.? 172.21.2.113:0/3402229291' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:27.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:26 gibba013 bash[30381]: audit 2021-03-10T17:27:25.509385+0000 mgr.gibba020.yqfnwy (mgr.34427) 11297 : audit [DBG] from='client.51630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:27:27.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:26 gibba013 bash[30381]: audit 2021-03-10T17:27:25.742305+0000 mgr.gibba020.yqfnwy (mgr.34427) 11298 : audit [DBG] from='client.51636 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:27:27.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:26 gibba013 bash[30381]: cephadm 2021-03-10T17:27:25.773843+0000 mgr.gibba020.yqfnwy (mgr.34427) 11299 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:27:27.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:26 gibba013 bash[30381]: cluster 2021-03-10T17:27:25.860559+0000 mgr.gibba020.yqfnwy (mgr.34427) 11300 : cluster [DBG] pgmap v6440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:27.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:26 gibba013 bash[30381]: audit 2021-03-10T17:27:26.005941+0000 mon.a (mon.0) 3976 : audit [DBG] from='client.? 172.21.2.113:0/3402229291' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:29.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:28 gibba020 bash[25448]: cluster 2021-03-10T17:27:27.862091+0000 mgr.gibba020.yqfnwy (mgr.34427) 11301 : cluster [DBG] pgmap v6441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:29.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:28 gibba013 bash[29418]: cluster 2021-03-10T17:27:27.862091+0000 mgr.gibba020.yqfnwy (mgr.34427) 11301 : cluster [DBG] pgmap v6441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:29.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:28 gibba013 bash[30381]: cluster 2021-03-10T17:27:27.862091+0000 mgr.gibba020.yqfnwy (mgr.34427) 11301 : cluster [DBG] pgmap v6441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:31.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:30 gibba013 bash[29418]: cluster 2021-03-10T17:27:29.863921+0000 mgr.gibba020.yqfnwy (mgr.34427) 11302 : cluster [DBG] pgmap v6442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:31.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:30 gibba013 bash[30381]: cluster 2021-03-10T17:27:29.863921+0000 mgr.gibba020.yqfnwy (mgr.34427) 11302 : cluster [DBG] pgmap v6442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:31.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:30 gibba020 bash[25448]: cluster 2021-03-10T17:27:29.863921+0000 mgr.gibba020.yqfnwy (mgr.34427) 11302 : cluster [DBG] pgmap v6442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:32.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:32 gibba013 bash[29418]: cluster 2021-03-10T17:27:31.865684+0000 mgr.gibba020.yqfnwy (mgr.34427) 11303 : cluster [DBG] pgmap v6443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:32.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:32 gibba013 bash[30381]: cluster 2021-03-10T17:27:31.865684+0000 mgr.gibba020.yqfnwy (mgr.34427) 11303 : cluster [DBG] pgmap v6443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:32.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:32 gibba020 bash[25448]: cluster 2021-03-10T17:27:31.865684+0000 mgr.gibba020.yqfnwy (mgr.34427) 11303 : cluster [DBG] pgmap v6443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:35.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:34 gibba020 bash[25448]: cluster 2021-03-10T17:27:33.867359+0000 mgr.gibba020.yqfnwy (mgr.34427) 11304 : cluster [DBG] pgmap v6444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:35.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:34 gibba013 bash[29418]: cluster 2021-03-10T17:27:33.867359+0000 mgr.gibba020.yqfnwy (mgr.34427) 11304 : cluster [DBG] pgmap v6444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:35.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:34 gibba013 bash[30381]: cluster 2021-03-10T17:27:33.867359+0000 mgr.gibba020.yqfnwy (mgr.34427) 11304 : cluster [DBG] pgmap v6444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:37.198 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:36 gibba020 bash[25448]: cluster 2021-03-10T17:27:35.869341+0000 mgr.gibba020.yqfnwy (mgr.34427) 11305 : cluster [DBG] pgmap v6445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:37.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:36 gibba013 bash[29418]: cluster 2021-03-10T17:27:35.869341+0000 mgr.gibba020.yqfnwy (mgr.34427) 11305 : cluster [DBG] pgmap v6445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:37.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:36 gibba013 bash[30381]: cluster 2021-03-10T17:27:35.869341+0000 mgr.gibba020.yqfnwy (mgr.34427) 11305 : cluster [DBG] pgmap v6445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:39.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:38 gibba013 bash[29418]: cluster 2021-03-10T17:27:37.870613+0000 mgr.gibba020.yqfnwy (mgr.34427) 11306 : cluster [DBG] pgmap v6446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:39.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:38 gibba013 bash[30381]: cluster 2021-03-10T17:27:37.870613+0000 mgr.gibba020.yqfnwy (mgr.34427) 11306 : cluster [DBG] pgmap v6446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:39.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:38 gibba020 bash[25448]: cluster 2021-03-10T17:27:37.870613+0000 mgr.gibba020.yqfnwy (mgr.34427) 11306 : cluster [DBG] pgmap v6446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:40.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:39 gibba013 bash[29418]: cluster 2021-03-10T17:27:39.872408+0000 mgr.gibba020.yqfnwy (mgr.34427) 11307 : cluster [DBG] pgmap v6447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:40.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:39 gibba013 bash[30381]: cluster 2021-03-10T17:27:39.872408+0000 mgr.gibba020.yqfnwy (mgr.34427) 11307 : cluster [DBG] pgmap v6447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:40.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:39 gibba020 bash[25448]: cluster 2021-03-10T17:27:39.872408+0000 mgr.gibba020.yqfnwy (mgr.34427) 11307 : cluster [DBG] pgmap v6447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:41.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:40 gibba020 bash[25448]: cephadm 2021-03-10T17:27:40.789899+0000 mgr.gibba020.yqfnwy (mgr.34427) 11308 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:27:41.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:40 gibba013 bash[29418]: cephadm 2021-03-10T17:27:40.789899+0000 mgr.gibba020.yqfnwy (mgr.34427) 11308 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:27:41.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:40 gibba013 bash[30381]: cephadm 2021-03-10T17:27:40.789899+0000 mgr.gibba020.yqfnwy (mgr.34427) 11308 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:27:42.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:42 gibba013 bash[29418]: cluster 2021-03-10T17:27:41.873984+0000 mgr.gibba020.yqfnwy (mgr.34427) 11309 : cluster [DBG] pgmap v6448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:42.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:42 gibba013 bash[30381]: cluster 2021-03-10T17:27:41.873984+0000 mgr.gibba020.yqfnwy (mgr.34427) 11309 : cluster [DBG] pgmap v6448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:42.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:42 gibba020 bash[25448]: cluster 2021-03-10T17:27:41.873984+0000 mgr.gibba020.yqfnwy (mgr.34427) 11309 : cluster [DBG] pgmap v6448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:45.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:44 gibba020 bash[25448]: cluster 2021-03-10T17:27:43.875361+0000 mgr.gibba020.yqfnwy (mgr.34427) 11310 : cluster [DBG] pgmap v6449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:45.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:44 gibba013 bash[29418]: cluster 2021-03-10T17:27:43.875361+0000 mgr.gibba020.yqfnwy (mgr.34427) 11310 : cluster [DBG] pgmap v6449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:45.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:44 gibba013 bash[30381]: cluster 2021-03-10T17:27:43.875361+0000 mgr.gibba020.yqfnwy (mgr.34427) 11310 : cluster [DBG] pgmap v6449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:47.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:46 gibba013 bash[29418]: cluster 2021-03-10T17:27:45.876964+0000 mgr.gibba020.yqfnwy (mgr.34427) 11311 : cluster [DBG] pgmap v6450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:47.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:46 gibba013 bash[30381]: cluster 2021-03-10T17:27:45.876964+0000 mgr.gibba020.yqfnwy (mgr.34427) 11311 : cluster [DBG] pgmap v6450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:47.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:46 gibba020 bash[25448]: cluster 2021-03-10T17:27:45.876964+0000 mgr.gibba020.yqfnwy (mgr.34427) 11311 : cluster [DBG] pgmap v6450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:48.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:48 gibba013 bash[29418]: cluster 2021-03-10T17:27:47.878310+0000 mgr.gibba020.yqfnwy (mgr.34427) 11312 : cluster [DBG] pgmap v6451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:48.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:48 gibba013 bash[30381]: cluster 2021-03-10T17:27:47.878310+0000 mgr.gibba020.yqfnwy (mgr.34427) 11312 : cluster [DBG] pgmap v6451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:48.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:48 gibba020 bash[25448]: cluster 2021-03-10T17:27:47.878310+0000 mgr.gibba020.yqfnwy (mgr.34427) 11312 : cluster [DBG] pgmap v6451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:51.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:50 gibba020 bash[25448]: cluster 2021-03-10T17:27:49.880099+0000 mgr.gibba020.yqfnwy (mgr.34427) 11313 : cluster [DBG] pgmap v6452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:51.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:50 gibba013 bash[29418]: cluster 2021-03-10T17:27:49.880099+0000 mgr.gibba020.yqfnwy (mgr.34427) 11313 : cluster [DBG] pgmap v6452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:51.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:50 gibba013 bash[30381]: cluster 2021-03-10T17:27:49.880099+0000 mgr.gibba020.yqfnwy (mgr.34427) 11313 : cluster [DBG] pgmap v6452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:52.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:52 gibba013 bash[29418]: cluster 2021-03-10T17:27:51.881483+0000 mgr.gibba020.yqfnwy (mgr.34427) 11314 : cluster [DBG] pgmap v6453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:52.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:52 gibba013 bash[30381]: cluster 2021-03-10T17:27:51.881483+0000 mgr.gibba020.yqfnwy (mgr.34427) 11314 : cluster [DBG] pgmap v6453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:52.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:52 gibba020 bash[25448]: cluster 2021-03-10T17:27:51.881483+0000 mgr.gibba020.yqfnwy (mgr.34427) 11314 : cluster [DBG] pgmap v6453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:55.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:54 gibba013 bash[29418]: cluster 2021-03-10T17:27:53.883150+0000 mgr.gibba020.yqfnwy (mgr.34427) 11315 : cluster [DBG] pgmap v6454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:55.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:54 gibba013 bash[30381]: cluster 2021-03-10T17:27:53.883150+0000 mgr.gibba020.yqfnwy (mgr.34427) 11315 : cluster [DBG] pgmap v6454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:55.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:54 gibba020 bash[25448]: cluster 2021-03-10T17:27:53.883150+0000 mgr.gibba020.yqfnwy (mgr.34427) 11315 : cluster [DBG] pgmap v6454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:56.249 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:27:56.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:55 gibba013 bash[29418]: audit 2021-03-10T17:27:55.807336+0000 mon.a (mon.0) 3977 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:27:56.380 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:55 gibba013 bash[30381]: audit 2021-03-10T17:27:55.807336+0000 mon.a (mon.0) 3977 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:27:56.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:55 gibba020 bash[25448]: audit 2021-03-10T17:27:55.807336+0000 mon.a (mon.0) 3977 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:27:56.509 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:27:56.509 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 6m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:27:56.509 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 5m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:27:56.510 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:27:56.510 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:27:56.510 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:27:56.510 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:27:56.511 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:27:56.511 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:27:56.511 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:27:56.511 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:27:56.511 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:27:56.512 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:27:56.512 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:27:56.512 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:27:56.512 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:27:56.512 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:27:56.513 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:27:56.513 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:27:56.513 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 5m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:27:56.513 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 5m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:27:56.771 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:27:56.771 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:27:56.771 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:27:56.771 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:27:56.772 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:27:56.772 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:27:56.772 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:27:56.772 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:27:56.773 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:27:56.773 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:27:56.773 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:27:56.773 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:27:56.773 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:27:56.774 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:27:56.774 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:27:57.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:56 gibba013 bash[29418]: cephadm 2021-03-10T17:27:55.812885+0000 mgr.gibba020.yqfnwy (mgr.34427) 11316 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:27:57.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:56 gibba013 bash[29418]: cephadm 2021-03-10T17:27:55.814249+0000 mgr.gibba020.yqfnwy (mgr.34427) 11317 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:27:57.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:56 gibba013 bash[29418]: cluster 2021-03-10T17:27:55.883688+0000 mgr.gibba020.yqfnwy (mgr.34427) 11318 : cluster [DBG] pgmap v6455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:57.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:56 gibba013 bash[29418]: audit 2021-03-10T17:27:56.028462+0000 mon.a (mon.0) 3978 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:27:57.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:56 gibba013 bash[29418]: audit 2021-03-10T17:27:56.031659+0000 mon.a (mon.0) 3979 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:27:57.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:56 gibba013 bash[29418]: audit 2021-03-10T17:27:56.032947+0000 mon.a (mon.0) 3980 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:57.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:56 gibba013 bash[29418]: audit 2021-03-10T17:27:56.034149+0000 mon.a (mon.0) 3981 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:57.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:56 gibba013 bash[29418]: audit 2021-03-10T17:27:56.035227+0000 mon.a (mon.0) 3982 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:57.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:56 gibba013 bash[29418]: audit 2021-03-10T17:27:56.037487+0000 mon.a (mon.0) 3983 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:57.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:56 gibba013 bash[29418]: audit 2021-03-10T17:27:56.038803+0000 mon.a (mon.0) 3984 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:57.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:56 gibba013 bash[29418]: audit 2021-03-10T17:27:56.769089+0000 mon.a (mon.0) 3985 : audit [DBG] from='client.? 172.21.2.113:0/4112969842' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:57.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:56 gibba013 bash[30381]: cephadm 2021-03-10T17:27:55.812885+0000 mgr.gibba020.yqfnwy (mgr.34427) 11316 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:27:57.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:56 gibba013 bash[30381]: cephadm 2021-03-10T17:27:55.814249+0000 mgr.gibba020.yqfnwy (mgr.34427) 11317 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:27:57.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:56 gibba013 bash[30381]: cluster 2021-03-10T17:27:55.883688+0000 mgr.gibba020.yqfnwy (mgr.34427) 11318 : cluster [DBG] pgmap v6455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:57.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:56 gibba013 bash[30381]: audit 2021-03-10T17:27:56.028462+0000 mon.a (mon.0) 3978 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:27:57.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:56 gibba013 bash[30381]: audit 2021-03-10T17:27:56.031659+0000 mon.a (mon.0) 3979 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:27:57.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:56 gibba013 bash[30381]: audit 2021-03-10T17:27:56.032947+0000 mon.a (mon.0) 3980 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:57.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:56 gibba013 bash[30381]: audit 2021-03-10T17:27:56.034149+0000 mon.a (mon.0) 3981 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:57.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:56 gibba013 bash[30381]: audit 2021-03-10T17:27:56.035227+0000 mon.a (mon.0) 3982 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:57.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:56 gibba013 bash[30381]: audit 2021-03-10T17:27:56.037487+0000 mon.a (mon.0) 3983 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:57.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:56 gibba013 bash[30381]: audit 2021-03-10T17:27:56.038803+0000 mon.a (mon.0) 3984 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:57.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:56 gibba013 bash[30381]: audit 2021-03-10T17:27:56.769089+0000 mon.a (mon.0) 3985 : audit [DBG] from='client.? 172.21.2.113:0/4112969842' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:57.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:56 gibba020 bash[25448]: cephadm 2021-03-10T17:27:55.812885+0000 mgr.gibba020.yqfnwy (mgr.34427) 11316 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:27:57.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:56 gibba020 bash[25448]: cephadm 2021-03-10T17:27:55.814249+0000 mgr.gibba020.yqfnwy (mgr.34427) 11317 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:27:57.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:56 gibba020 bash[25448]: cluster 2021-03-10T17:27:55.883688+0000 mgr.gibba020.yqfnwy (mgr.34427) 11318 : cluster [DBG] pgmap v6455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:57.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:56 gibba020 bash[25448]: audit 2021-03-10T17:27:56.028462+0000 mon.a (mon.0) 3978 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:27:57.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:56 gibba020 bash[25448]: audit 2021-03-10T17:27:56.031659+0000 mon.a (mon.0) 3979 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:27:57.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:56 gibba020 bash[25448]: audit 2021-03-10T17:27:56.032947+0000 mon.a (mon.0) 3980 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:57.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:56 gibba020 bash[25448]: audit 2021-03-10T17:27:56.034149+0000 mon.a (mon.0) 3981 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:57.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:56 gibba020 bash[25448]: audit 2021-03-10T17:27:56.035227+0000 mon.a (mon.0) 3982 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:57.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:56 gibba020 bash[25448]: audit 2021-03-10T17:27:56.037487+0000 mon.a (mon.0) 3983 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:57.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:56 gibba020 bash[25448]: audit 2021-03-10T17:27:56.038803+0000 mon.a (mon.0) 3984 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:57.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:56 gibba020 bash[25448]: audit 2021-03-10T17:27:56.769089+0000 mon.a (mon.0) 3985 : audit [DBG] from='client.? 172.21.2.113:0/4112969842' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:27:58.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:57 gibba013 bash[29418]: cephadm 2021-03-10T17:27:56.030481+0000 mgr.gibba020.yqfnwy (mgr.34427) 11319 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:27:58.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:57 gibba013 bash[29418]: cephadm 2021-03-10T17:27:56.032141+0000 mgr.gibba020.yqfnwy (mgr.34427) 11320 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:27:58.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:57 gibba013 bash[29418]: cephadm 2021-03-10T17:27:56.033277+0000 mgr.gibba020.yqfnwy (mgr.34427) 11321 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:27:58.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:57 gibba013 bash[29418]: cephadm 2021-03-10T17:27:56.033317+0000 mgr.gibba020.yqfnwy (mgr.34427) 11322 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:27:58.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:57 gibba013 bash[29418]: cephadm 2021-03-10T17:27:56.034426+0000 mgr.gibba020.yqfnwy (mgr.34427) 11323 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:27:58.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:57 gibba013 bash[29418]: cephadm 2021-03-10T17:27:56.034492+0000 mgr.gibba020.yqfnwy (mgr.34427) 11324 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:27:58.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:57 gibba013 bash[29418]: cephadm 2021-03-10T17:27:56.035508+0000 mgr.gibba020.yqfnwy (mgr.34427) 11325 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:27:58.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:57 gibba013 bash[29418]: cephadm 2021-03-10T17:27:56.036580+0000 mgr.gibba020.yqfnwy (mgr.34427) 11326 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:27:58.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:57 gibba013 bash[29418]: cephadm 2021-03-10T17:27:56.036616+0000 mgr.gibba020.yqfnwy (mgr.34427) 11327 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:27:58.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:57 gibba013 bash[29418]: cephadm 2021-03-10T17:27:56.037754+0000 mgr.gibba020.yqfnwy (mgr.34427) 11328 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:27:58.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:57 gibba013 bash[29418]: cephadm 2021-03-10T17:27:56.038072+0000 mgr.gibba020.yqfnwy (mgr.34427) 11329 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:27:58.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:57 gibba013 bash[29418]: cephadm 2021-03-10T17:27:56.039048+0000 mgr.gibba020.yqfnwy (mgr.34427) 11330 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:27:58.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:57 gibba013 bash[29418]: cephadm 2021-03-10T17:27:56.039087+0000 mgr.gibba020.yqfnwy (mgr.34427) 11331 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:27:58.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:57 gibba013 bash[29418]: cephadm 2021-03-10T17:27:56.039191+0000 mgr.gibba020.yqfnwy (mgr.34427) 11332 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:27:58.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:57 gibba013 bash[29418]: audit 2021-03-10T17:27:56.239070+0000 mgr.gibba020.yqfnwy (mgr.34427) 11333 : audit [DBG] from='client.51648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:27:58.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:57 gibba013 bash[29418]: audit 2021-03-10T17:27:56.465022+0000 mgr.gibba020.yqfnwy (mgr.34427) 11334 : audit [DBG] from='client.61633 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:27:58.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:27:57 gibba013 bash[29418]: cluster 2021-03-10T17:27:57.885064+0000 mgr.gibba020.yqfnwy (mgr.34427) 11335 : cluster [DBG] pgmap v6456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:58.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:57 gibba013 bash[30381]: cephadm 2021-03-10T17:27:56.030481+0000 mgr.gibba020.yqfnwy (mgr.34427) 11319 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:27:58.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:57 gibba013 bash[30381]: cephadm 2021-03-10T17:27:56.032141+0000 mgr.gibba020.yqfnwy (mgr.34427) 11320 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:27:58.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:57 gibba013 bash[30381]: cephadm 2021-03-10T17:27:56.033277+0000 mgr.gibba020.yqfnwy (mgr.34427) 11321 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:27:58.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:57 gibba013 bash[30381]: cephadm 2021-03-10T17:27:56.033317+0000 mgr.gibba020.yqfnwy (mgr.34427) 11322 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:27:58.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:57 gibba013 bash[30381]: cephadm 2021-03-10T17:27:56.034426+0000 mgr.gibba020.yqfnwy (mgr.34427) 11323 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:27:58.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:57 gibba013 bash[30381]: cephadm 2021-03-10T17:27:56.034492+0000 mgr.gibba020.yqfnwy (mgr.34427) 11324 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:27:58.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:57 gibba013 bash[30381]: cephadm 2021-03-10T17:27:56.035508+0000 mgr.gibba020.yqfnwy (mgr.34427) 11325 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:27:58.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:57 gibba013 bash[30381]: cephadm 2021-03-10T17:27:56.036580+0000 mgr.gibba020.yqfnwy (mgr.34427) 11326 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:27:58.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:57 gibba013 bash[30381]: cephadm 2021-03-10T17:27:56.036616+0000 mgr.gibba020.yqfnwy (mgr.34427) 11327 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:27:58.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:57 gibba013 bash[30381]: cephadm 2021-03-10T17:27:56.037754+0000 mgr.gibba020.yqfnwy (mgr.34427) 11328 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:27:58.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:57 gibba013 bash[30381]: cephadm 2021-03-10T17:27:56.038072+0000 mgr.gibba020.yqfnwy (mgr.34427) 11329 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:27:58.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:57 gibba013 bash[30381]: cephadm 2021-03-10T17:27:56.039048+0000 mgr.gibba020.yqfnwy (mgr.34427) 11330 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:27:58.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:57 gibba013 bash[30381]: cephadm 2021-03-10T17:27:56.039087+0000 mgr.gibba020.yqfnwy (mgr.34427) 11331 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:27:58.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:57 gibba013 bash[30381]: cephadm 2021-03-10T17:27:56.039191+0000 mgr.gibba020.yqfnwy (mgr.34427) 11332 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:27:58.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:57 gibba013 bash[30381]: audit 2021-03-10T17:27:56.239070+0000 mgr.gibba020.yqfnwy (mgr.34427) 11333 : audit [DBG] from='client.51648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:27:58.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:57 gibba013 bash[30381]: audit 2021-03-10T17:27:56.465022+0000 mgr.gibba020.yqfnwy (mgr.34427) 11334 : audit [DBG] from='client.61633 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:27:58.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:27:57 gibba013 bash[30381]: cluster 2021-03-10T17:27:57.885064+0000 mgr.gibba020.yqfnwy (mgr.34427) 11335 : cluster [DBG] pgmap v6456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:27:58.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:57 gibba020 bash[25448]: cephadm 2021-03-10T17:27:56.030481+0000 mgr.gibba020.yqfnwy (mgr.34427) 11319 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:27:58.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:57 gibba020 bash[25448]: cephadm 2021-03-10T17:27:56.032141+0000 mgr.gibba020.yqfnwy (mgr.34427) 11320 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:27:58.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:57 gibba020 bash[25448]: cephadm 2021-03-10T17:27:56.033277+0000 mgr.gibba020.yqfnwy (mgr.34427) 11321 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:27:58.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:57 gibba020 bash[25448]: cephadm 2021-03-10T17:27:56.033317+0000 mgr.gibba020.yqfnwy (mgr.34427) 11322 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:27:58.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:57 gibba020 bash[25448]: cephadm 2021-03-10T17:27:56.034426+0000 mgr.gibba020.yqfnwy (mgr.34427) 11323 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:27:58.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:57 gibba020 bash[25448]: cephadm 2021-03-10T17:27:56.034492+0000 mgr.gibba020.yqfnwy (mgr.34427) 11324 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:27:58.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:57 gibba020 bash[25448]: cephadm 2021-03-10T17:27:56.035508+0000 mgr.gibba020.yqfnwy (mgr.34427) 11325 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:27:58.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:57 gibba020 bash[25448]: cephadm 2021-03-10T17:27:56.036580+0000 mgr.gibba020.yqfnwy (mgr.34427) 11326 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:27:58.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:57 gibba020 bash[25448]: cephadm 2021-03-10T17:27:56.036616+0000 mgr.gibba020.yqfnwy (mgr.34427) 11327 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:27:58.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:57 gibba020 bash[25448]: cephadm 2021-03-10T17:27:56.037754+0000 mgr.gibba020.yqfnwy (mgr.34427) 11328 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:27:58.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:57 gibba020 bash[25448]: cephadm 2021-03-10T17:27:56.038072+0000 mgr.gibba020.yqfnwy (mgr.34427) 11329 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:27:58.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:57 gibba020 bash[25448]: cephadm 2021-03-10T17:27:56.039048+0000 mgr.gibba020.yqfnwy (mgr.34427) 11330 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:27:58.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:57 gibba020 bash[25448]: cephadm 2021-03-10T17:27:56.039087+0000 mgr.gibba020.yqfnwy (mgr.34427) 11331 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:27:58.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:57 gibba020 bash[25448]: cephadm 2021-03-10T17:27:56.039191+0000 mgr.gibba020.yqfnwy (mgr.34427) 11332 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:27:58.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:57 gibba020 bash[25448]: audit 2021-03-10T17:27:56.239070+0000 mgr.gibba020.yqfnwy (mgr.34427) 11333 : audit [DBG] from='client.51648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:27:58.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:57 gibba020 bash[25448]: audit 2021-03-10T17:27:56.465022+0000 mgr.gibba020.yqfnwy (mgr.34427) 11334 : audit [DBG] from='client.61633 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:27:58.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:27:57 gibba020 bash[25448]: cluster 2021-03-10T17:27:57.885064+0000 mgr.gibba020.yqfnwy (mgr.34427) 11335 : cluster [DBG] pgmap v6456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:01.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:00 gibba013 bash[29418]: cluster 2021-03-10T17:27:59.886873+0000 mgr.gibba020.yqfnwy (mgr.34427) 11336 : cluster [DBG] pgmap v6457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:01.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:00 gibba013 bash[30381]: cluster 2021-03-10T17:27:59.886873+0000 mgr.gibba020.yqfnwy (mgr.34427) 11336 : cluster [DBG] pgmap v6457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:01.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:00 gibba020 bash[25448]: cluster 2021-03-10T17:27:59.886873+0000 mgr.gibba020.yqfnwy (mgr.34427) 11336 : cluster [DBG] pgmap v6457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:02.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:02 gibba013 bash[29418]: cluster 2021-03-10T17:28:01.888547+0000 mgr.gibba020.yqfnwy (mgr.34427) 11337 : cluster [DBG] pgmap v6458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:02.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:02 gibba013 bash[30381]: cluster 2021-03-10T17:28:01.888547+0000 mgr.gibba020.yqfnwy (mgr.34427) 11337 : cluster [DBG] pgmap v6458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:02.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:02 gibba020 bash[25448]: cluster 2021-03-10T17:28:01.888547+0000 mgr.gibba020.yqfnwy (mgr.34427) 11337 : cluster [DBG] pgmap v6458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:05.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:04 gibba013 bash[29418]: cluster 2021-03-10T17:28:03.890306+0000 mgr.gibba020.yqfnwy (mgr.34427) 11338 : cluster [DBG] pgmap v6459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:05.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:04 gibba013 bash[30381]: cluster 2021-03-10T17:28:03.890306+0000 mgr.gibba020.yqfnwy (mgr.34427) 11338 : cluster [DBG] pgmap v6459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:05.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:04 gibba020 bash[25448]: cluster 2021-03-10T17:28:03.890306+0000 mgr.gibba020.yqfnwy (mgr.34427) 11338 : cluster [DBG] pgmap v6459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:06.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:06 gibba013 bash[29418]: cluster 2021-03-10T17:28:05.892197+0000 mgr.gibba020.yqfnwy (mgr.34427) 11339 : cluster [DBG] pgmap v6460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:06.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:06 gibba013 bash[30381]: cluster 2021-03-10T17:28:05.892197+0000 mgr.gibba020.yqfnwy (mgr.34427) 11339 : cluster [DBG] pgmap v6460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:06.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:06 gibba020 bash[25448]: cluster 2021-03-10T17:28:05.892197+0000 mgr.gibba020.yqfnwy (mgr.34427) 11339 : cluster [DBG] pgmap v6460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:07.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:07 gibba013 bash[29418]: audit 2021-03-10T17:28:06.998056+0000 mon.a (mon.0) 3986 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:28:07.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:07 gibba013 bash[30381]: audit 2021-03-10T17:28:06.998056+0000 mon.a (mon.0) 3986 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:28:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:07 gibba020 bash[25448]: audit 2021-03-10T17:28:06.998056+0000 mon.a (mon.0) 3986 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:28:08.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:08 gibba013 bash[29418]: audit 2021-03-10T17:28:07.239359+0000 mon.a (mon.0) 3987 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:28:08.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:08 gibba013 bash[29418]: audit 2021-03-10T17:28:07.686779+0000 mon.a (mon.0) 3988 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T17:28:08.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:08 gibba013 bash[29418]: audit 2021-03-10T17:28:07.687605+0000 mon.a (mon.0) 3989 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:28:08.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:08 gibba013 bash[29418]: audit 2021-03-10T17:28:07.688319+0000 mon.a (mon.0) 3990 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T17:28:08.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:08 gibba013 bash[29418]: audit 2021-03-10T17:28:07.689072+0000 mon.a (mon.0) 3991 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:28:08.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:08 gibba013 bash[29418]: cluster 2021-03-10T17:28:07.893248+0000 mgr.gibba020.yqfnwy (mgr.34427) 11340 : cluster [DBG] pgmap v6461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:08.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:08 gibba013 bash[30381]: audit 2021-03-10T17:28:07.239359+0000 mon.a (mon.0) 3987 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:28:08.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:08 gibba013 bash[30381]: audit 2021-03-10T17:28:07.686779+0000 mon.a (mon.0) 3988 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T17:28:08.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:08 gibba013 bash[30381]: audit 2021-03-10T17:28:07.687605+0000 mon.a (mon.0) 3989 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:28:08.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:08 gibba013 bash[30381]: audit 2021-03-10T17:28:07.688319+0000 mon.a (mon.0) 3990 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T17:28:08.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:08 gibba013 bash[30381]: audit 2021-03-10T17:28:07.689072+0000 mon.a (mon.0) 3991 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:28:08.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:08 gibba013 bash[30381]: cluster 2021-03-10T17:28:07.893248+0000 mgr.gibba020.yqfnwy (mgr.34427) 11340 : cluster [DBG] pgmap v6461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:08.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:08 gibba020 bash[25448]: audit 2021-03-10T17:28:07.239359+0000 mon.a (mon.0) 3987 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:28:08.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:08 gibba020 bash[25448]: audit 2021-03-10T17:28:07.686779+0000 mon.a (mon.0) 3988 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T17:28:08.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:08 gibba020 bash[25448]: audit 2021-03-10T17:28:07.687605+0000 mon.a (mon.0) 3989 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:28:08.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:08 gibba020 bash[25448]: audit 2021-03-10T17:28:07.688319+0000 mon.a (mon.0) 3990 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 5]}]: dispatch 2021-03-10T17:28:08.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:08 gibba020 bash[25448]: audit 2021-03-10T17:28:07.689072+0000 mon.a (mon.0) 3991 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:28:08.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:08 gibba020 bash[25448]: cluster 2021-03-10T17:28:07.893248+0000 mgr.gibba020.yqfnwy (mgr.34427) 11340 : cluster [DBG] pgmap v6461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:11.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:10 gibba013 bash[29418]: cluster 2021-03-10T17:28:09.895030+0000 mgr.gibba020.yqfnwy (mgr.34427) 11341 : cluster [DBG] pgmap v6462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:11.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:10 gibba013 bash[30381]: cluster 2021-03-10T17:28:09.895030+0000 mgr.gibba020.yqfnwy (mgr.34427) 11341 : cluster [DBG] pgmap v6462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:11.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:10 gibba020 bash[25448]: cluster 2021-03-10T17:28:09.895030+0000 mgr.gibba020.yqfnwy (mgr.34427) 11341 : cluster [DBG] pgmap v6462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:12.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:12 gibba013 bash[29418]: cephadm 2021-03-10T17:28:11.060114+0000 mgr.gibba020.yqfnwy (mgr.34427) 11342 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:28:12.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:12 gibba013 bash[29418]: cluster 2021-03-10T17:28:11.896652+0000 mgr.gibba020.yqfnwy (mgr.34427) 11343 : cluster [DBG] pgmap v6463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:12.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:12 gibba013 bash[30381]: cephadm 2021-03-10T17:28:11.060114+0000 mgr.gibba020.yqfnwy (mgr.34427) 11342 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:28:12.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:12 gibba013 bash[30381]: cluster 2021-03-10T17:28:11.896652+0000 mgr.gibba020.yqfnwy (mgr.34427) 11343 : cluster [DBG] pgmap v6463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:12.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:12 gibba020 bash[25448]: cephadm 2021-03-10T17:28:11.060114+0000 mgr.gibba020.yqfnwy (mgr.34427) 11342 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:28:12.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:12 gibba020 bash[25448]: cluster 2021-03-10T17:28:11.896652+0000 mgr.gibba020.yqfnwy (mgr.34427) 11343 : cluster [DBG] pgmap v6463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:15.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:14 gibba013 bash[29418]: cluster 2021-03-10T17:28:13.898371+0000 mgr.gibba020.yqfnwy (mgr.34427) 11344 : cluster [DBG] pgmap v6464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:15.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:14 gibba013 bash[30381]: cluster 2021-03-10T17:28:13.898371+0000 mgr.gibba020.yqfnwy (mgr.34427) 11344 : cluster [DBG] pgmap v6464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:15.448 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:14 gibba020 bash[25448]: cluster 2021-03-10T17:28:13.898371+0000 mgr.gibba020.yqfnwy (mgr.34427) 11344 : cluster [DBG] pgmap v6464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:16.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:15 gibba013 bash[29418]: cluster 2021-03-10T17:28:15.900172+0000 mgr.gibba020.yqfnwy (mgr.34427) 11345 : cluster [DBG] pgmap v6465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:16.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:15 gibba013 bash[30381]: cluster 2021-03-10T17:28:15.900172+0000 mgr.gibba020.yqfnwy (mgr.34427) 11345 : cluster [DBG] pgmap v6465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:16.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:15 gibba020 bash[25448]: cluster 2021-03-10T17:28:15.900172+0000 mgr.gibba020.yqfnwy (mgr.34427) 11345 : cluster [DBG] pgmap v6465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:19.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:18 gibba013 bash[29418]: cluster 2021-03-10T17:28:17.901227+0000 mgr.gibba020.yqfnwy (mgr.34427) 11346 : cluster [DBG] pgmap v6466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:19.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:18 gibba013 bash[30381]: cluster 2021-03-10T17:28:17.901227+0000 mgr.gibba020.yqfnwy (mgr.34427) 11346 : cluster [DBG] pgmap v6466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:19.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:18 gibba020 bash[25448]: cluster 2021-03-10T17:28:17.901227+0000 mgr.gibba020.yqfnwy (mgr.34427) 11346 : cluster [DBG] pgmap v6466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:20.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:19 gibba013 bash[29418]: cluster 2021-03-10T17:28:19.903084+0000 mgr.gibba020.yqfnwy (mgr.34427) 11347 : cluster [DBG] pgmap v6467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:20.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:19 gibba013 bash[30381]: cluster 2021-03-10T17:28:19.903084+0000 mgr.gibba020.yqfnwy (mgr.34427) 11347 : cluster [DBG] pgmap v6467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:20.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:19 gibba020 bash[25448]: cluster 2021-03-10T17:28:19.903084+0000 mgr.gibba020.yqfnwy (mgr.34427) 11347 : cluster [DBG] pgmap v6467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:22.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:22 gibba013 bash[29418]: cluster 2021-03-10T17:28:21.904714+0000 mgr.gibba020.yqfnwy (mgr.34427) 11348 : cluster [DBG] pgmap v6468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:22.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:22 gibba013 bash[30381]: cluster 2021-03-10T17:28:21.904714+0000 mgr.gibba020.yqfnwy (mgr.34427) 11348 : cluster [DBG] pgmap v6468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:22.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:22 gibba020 bash[25448]: cluster 2021-03-10T17:28:21.904714+0000 mgr.gibba020.yqfnwy (mgr.34427) 11348 : cluster [DBG] pgmap v6468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:24.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:24 gibba013 bash[29418]: cluster 2021-03-10T17:28:23.906208+0000 mgr.gibba020.yqfnwy (mgr.34427) 11349 : cluster [DBG] pgmap v6469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:24.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:24 gibba013 bash[30381]: cluster 2021-03-10T17:28:23.906208+0000 mgr.gibba020.yqfnwy (mgr.34427) 11349 : cluster [DBG] pgmap v6469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:24.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:24 gibba020 bash[25448]: cluster 2021-03-10T17:28:23.906208+0000 mgr.gibba020.yqfnwy (mgr.34427) 11349 : cluster [DBG] pgmap v6469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:26.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:26 gibba013 bash[29418]: cluster 2021-03-10T17:28:25.908152+0000 mgr.gibba020.yqfnwy (mgr.34427) 11350 : cluster [DBG] pgmap v6470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:26.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:26 gibba013 bash[30381]: cluster 2021-03-10T17:28:25.908152+0000 mgr.gibba020.yqfnwy (mgr.34427) 11350 : cluster [DBG] pgmap v6470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:26.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:26 gibba020 bash[25448]: cluster 2021-03-10T17:28:25.908152+0000 mgr.gibba020.yqfnwy (mgr.34427) 11350 : cluster [DBG] pgmap v6470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:27.022 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:28:27.255 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:28:27.255 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 6m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:28:27.255 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 5m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:28:27.256 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:28:27.256 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:28:27.256 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:28:27.256 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:28:27.257 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:28:27.257 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:28:27.257 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:28:27.257 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:28:27.257 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:28:27.258 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:28:27.258 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:28:27.258 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:28:27.258 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:28:27.258 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:28:27.259 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:28:27.259 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:28:27.259 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 5m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:28:27.259 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 5m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:28:27.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:27 gibba013 bash[29418]: cephadm 2021-03-10T17:28:26.075678+0000 mgr.gibba020.yqfnwy (mgr.34427) 11351 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:28:27.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:27 gibba013 bash[30381]: cephadm 2021-03-10T17:28:26.075678+0000 mgr.gibba020.yqfnwy (mgr.34427) 11351 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:28:27.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:27 gibba020 bash[25448]: cephadm 2021-03-10T17:28:26.075678+0000 mgr.gibba020.yqfnwy (mgr.34427) 11351 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:28:27.505 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:28:27.505 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:28:27.506 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:28:27.506 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:28:27.506 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:28:27.506 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:28:27.507 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:28:27.507 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:28:27.507 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:28:27.507 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:28:27.507 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:28:27.508 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:28:27.508 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:28:27.508 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:28:27.508 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:28:28.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:28 gibba013 bash[29418]: audit 2021-03-10T17:28:27.010886+0000 mgr.gibba020.yqfnwy (mgr.34427) 11352 : audit [DBG] from='client.61645 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:28:28.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:28 gibba013 bash[29418]: audit 2021-03-10T17:28:27.240748+0000 mgr.gibba020.yqfnwy (mgr.34427) 11353 : audit [DBG] from='client.61651 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:28:28.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:28 gibba013 bash[29418]: audit 2021-03-10T17:28:27.503701+0000 mon.a (mon.0) 3992 : audit [DBG] from='client.? 172.21.2.113:0/1047344505' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:28.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:28 gibba013 bash[29418]: cluster 2021-03-10T17:28:27.909581+0000 mgr.gibba020.yqfnwy (mgr.34427) 11354 : cluster [DBG] pgmap v6471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:28.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:28 gibba013 bash[30381]: audit 2021-03-10T17:28:27.010886+0000 mgr.gibba020.yqfnwy (mgr.34427) 11352 : audit [DBG] from='client.61645 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:28:28.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:28 gibba013 bash[30381]: audit 2021-03-10T17:28:27.240748+0000 mgr.gibba020.yqfnwy (mgr.34427) 11353 : audit [DBG] from='client.61651 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:28:28.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:28 gibba013 bash[30381]: audit 2021-03-10T17:28:27.503701+0000 mon.a (mon.0) 3992 : audit [DBG] from='client.? 172.21.2.113:0/1047344505' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:28.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:28 gibba013 bash[30381]: cluster 2021-03-10T17:28:27.909581+0000 mgr.gibba020.yqfnwy (mgr.34427) 11354 : cluster [DBG] pgmap v6471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:28.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:28 gibba020 bash[25448]: audit 2021-03-10T17:28:27.010886+0000 mgr.gibba020.yqfnwy (mgr.34427) 11352 : audit [DBG] from='client.61645 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:28:28.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:28 gibba020 bash[25448]: audit 2021-03-10T17:28:27.240748+0000 mgr.gibba020.yqfnwy (mgr.34427) 11353 : audit [DBG] from='client.61651 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:28:28.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:28 gibba020 bash[25448]: audit 2021-03-10T17:28:27.503701+0000 mon.a (mon.0) 3992 : audit [DBG] from='client.? 172.21.2.113:0/1047344505' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:28.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:28 gibba020 bash[25448]: cluster 2021-03-10T17:28:27.909581+0000 mgr.gibba020.yqfnwy (mgr.34427) 11354 : cluster [DBG] pgmap v6471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:30.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:30 gibba013 bash[29418]: cluster 2021-03-10T17:28:29.911336+0000 mgr.gibba020.yqfnwy (mgr.34427) 11355 : cluster [DBG] pgmap v6472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:30.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:30 gibba013 bash[30381]: cluster 2021-03-10T17:28:29.911336+0000 mgr.gibba020.yqfnwy (mgr.34427) 11355 : cluster [DBG] pgmap v6472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:30.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:30 gibba020 bash[25448]: cluster 2021-03-10T17:28:29.911336+0000 mgr.gibba020.yqfnwy (mgr.34427) 11355 : cluster [DBG] pgmap v6472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:32.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:32 gibba013 bash[29418]: cluster 2021-03-10T17:28:31.912860+0000 mgr.gibba020.yqfnwy (mgr.34427) 11356 : cluster [DBG] pgmap v6473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:32.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:32 gibba013 bash[30381]: cluster 2021-03-10T17:28:31.912860+0000 mgr.gibba020.yqfnwy (mgr.34427) 11356 : cluster [DBG] pgmap v6473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:32.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:32 gibba020 bash[25448]: cluster 2021-03-10T17:28:31.912860+0000 mgr.gibba020.yqfnwy (mgr.34427) 11356 : cluster [DBG] pgmap v6473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:34.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:34 gibba013 bash[29418]: cluster 2021-03-10T17:28:33.914492+0000 mgr.gibba020.yqfnwy (mgr.34427) 11357 : cluster [DBG] pgmap v6474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:34.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:34 gibba013 bash[30381]: cluster 2021-03-10T17:28:33.914492+0000 mgr.gibba020.yqfnwy (mgr.34427) 11357 : cluster [DBG] pgmap v6474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:34.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:34 gibba020 bash[25448]: cluster 2021-03-10T17:28:33.914492+0000 mgr.gibba020.yqfnwy (mgr.34427) 11357 : cluster [DBG] pgmap v6474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:36.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:36 gibba013 bash[29418]: cluster 2021-03-10T17:28:35.916411+0000 mgr.gibba020.yqfnwy (mgr.34427) 11358 : cluster [DBG] pgmap v6475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:36.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:36 gibba013 bash[30381]: cluster 2021-03-10T17:28:35.916411+0000 mgr.gibba020.yqfnwy (mgr.34427) 11358 : cluster [DBG] pgmap v6475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:36.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:36 gibba020 bash[25448]: cluster 2021-03-10T17:28:35.916411+0000 mgr.gibba020.yqfnwy (mgr.34427) 11358 : cluster [DBG] pgmap v6475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:38.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:38 gibba013 bash[29418]: cluster 2021-03-10T17:28:37.917510+0000 mgr.gibba020.yqfnwy (mgr.34427) 11359 : cluster [DBG] pgmap v6476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:38.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:38 gibba013 bash[30381]: cluster 2021-03-10T17:28:37.917510+0000 mgr.gibba020.yqfnwy (mgr.34427) 11359 : cluster [DBG] pgmap v6476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:38.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:38 gibba020 bash[25448]: cluster 2021-03-10T17:28:37.917510+0000 mgr.gibba020.yqfnwy (mgr.34427) 11359 : cluster [DBG] pgmap v6476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:40.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:40 gibba013 bash[29418]: cluster 2021-03-10T17:28:39.919506+0000 mgr.gibba020.yqfnwy (mgr.34427) 11360 : cluster [DBG] pgmap v6477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:40.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:40 gibba013 bash[30381]: cluster 2021-03-10T17:28:39.919506+0000 mgr.gibba020.yqfnwy (mgr.34427) 11360 : cluster [DBG] pgmap v6477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:40.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:40 gibba020 bash[25448]: cluster 2021-03-10T17:28:39.919506+0000 mgr.gibba020.yqfnwy (mgr.34427) 11360 : cluster [DBG] pgmap v6477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:42.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:42 gibba013 bash[29418]: cephadm 2021-03-10T17:28:41.091262+0000 mgr.gibba020.yqfnwy (mgr.34427) 11361 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:28:42.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:42 gibba013 bash[29418]: cluster 2021-03-10T17:28:41.920866+0000 mgr.gibba020.yqfnwy (mgr.34427) 11362 : cluster [DBG] pgmap v6478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:42.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:42 gibba013 bash[30381]: cephadm 2021-03-10T17:28:41.091262+0000 mgr.gibba020.yqfnwy (mgr.34427) 11361 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:28:42.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:42 gibba013 bash[30381]: cluster 2021-03-10T17:28:41.920866+0000 mgr.gibba020.yqfnwy (mgr.34427) 11362 : cluster [DBG] pgmap v6478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:42.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:42 gibba020 bash[25448]: cephadm 2021-03-10T17:28:41.091262+0000 mgr.gibba020.yqfnwy (mgr.34427) 11361 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:28:42.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:42 gibba020 bash[25448]: cluster 2021-03-10T17:28:41.920866+0000 mgr.gibba020.yqfnwy (mgr.34427) 11362 : cluster [DBG] pgmap v6478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:44.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:44 gibba013 bash[29418]: cluster 2021-03-10T17:28:43.922284+0000 mgr.gibba020.yqfnwy (mgr.34427) 11363 : cluster [DBG] pgmap v6479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:44.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:44 gibba013 bash[30381]: cluster 2021-03-10T17:28:43.922284+0000 mgr.gibba020.yqfnwy (mgr.34427) 11363 : cluster [DBG] pgmap v6479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:44.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:44 gibba020 bash[25448]: cluster 2021-03-10T17:28:43.922284+0000 mgr.gibba020.yqfnwy (mgr.34427) 11363 : cluster [DBG] pgmap v6479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:46.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:46 gibba013 bash[29418]: cluster 2021-03-10T17:28:45.924137+0000 mgr.gibba020.yqfnwy (mgr.34427) 11364 : cluster [DBG] pgmap v6480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:46.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:46 gibba013 bash[30381]: cluster 2021-03-10T17:28:45.924137+0000 mgr.gibba020.yqfnwy (mgr.34427) 11364 : cluster [DBG] pgmap v6480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:46.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:46 gibba020 bash[25448]: cluster 2021-03-10T17:28:45.924137+0000 mgr.gibba020.yqfnwy (mgr.34427) 11364 : cluster [DBG] pgmap v6480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:48.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:48 gibba013 bash[29418]: cluster 2021-03-10T17:28:47.925255+0000 mgr.gibba020.yqfnwy (mgr.34427) 11365 : cluster [DBG] pgmap v6481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:48.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:48 gibba013 bash[30381]: cluster 2021-03-10T17:28:47.925255+0000 mgr.gibba020.yqfnwy (mgr.34427) 11365 : cluster [DBG] pgmap v6481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:48.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:48 gibba020 bash[25448]: cluster 2021-03-10T17:28:47.925255+0000 mgr.gibba020.yqfnwy (mgr.34427) 11365 : cluster [DBG] pgmap v6481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:50.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:50 gibba013 bash[29418]: cluster 2021-03-10T17:28:49.927115+0000 mgr.gibba020.yqfnwy (mgr.34427) 11366 : cluster [DBG] pgmap v6482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:50.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:50 gibba013 bash[30381]: cluster 2021-03-10T17:28:49.927115+0000 mgr.gibba020.yqfnwy (mgr.34427) 11366 : cluster [DBG] pgmap v6482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:50.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:50 gibba020 bash[25448]: cluster 2021-03-10T17:28:49.927115+0000 mgr.gibba020.yqfnwy (mgr.34427) 11366 : cluster [DBG] pgmap v6482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:52.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:52 gibba013 bash[29418]: cluster 2021-03-10T17:28:51.928467+0000 mgr.gibba020.yqfnwy (mgr.34427) 11367 : cluster [DBG] pgmap v6483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:52.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:52 gibba013 bash[30381]: cluster 2021-03-10T17:28:51.928467+0000 mgr.gibba020.yqfnwy (mgr.34427) 11367 : cluster [DBG] pgmap v6483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:52.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:52 gibba020 bash[25448]: cluster 2021-03-10T17:28:51.928467+0000 mgr.gibba020.yqfnwy (mgr.34427) 11367 : cluster [DBG] pgmap v6483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:54.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:54 gibba013 bash[29418]: cluster 2021-03-10T17:28:53.930182+0000 mgr.gibba020.yqfnwy (mgr.34427) 11368 : cluster [DBG] pgmap v6484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:54.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:54 gibba013 bash[30381]: cluster 2021-03-10T17:28:53.930182+0000 mgr.gibba020.yqfnwy (mgr.34427) 11368 : cluster [DBG] pgmap v6484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:54.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:54 gibba020 bash[25448]: cluster 2021-03-10T17:28:53.930182+0000 mgr.gibba020.yqfnwy (mgr.34427) 11368 : cluster [DBG] pgmap v6484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:56.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:56 gibba013 bash[29418]: cluster 2021-03-10T17:28:55.932004+0000 mgr.gibba020.yqfnwy (mgr.34427) 11369 : cluster [DBG] pgmap v6485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:56.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:56 gibba013 bash[30381]: cluster 2021-03-10T17:28:55.932004+0000 mgr.gibba020.yqfnwy (mgr.34427) 11369 : cluster [DBG] pgmap v6485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:56.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:56 gibba020 bash[25448]: cluster 2021-03-10T17:28:55.932004+0000 mgr.gibba020.yqfnwy (mgr.34427) 11369 : cluster [DBG] pgmap v6485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:57.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[29418]: audit 2021-03-10T17:28:56.105762+0000 mon.a (mon.0) 3993 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:28:57.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[29418]: audit 2021-03-10T17:28:56.294210+0000 mon.a (mon.0) 3994 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:28:57.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[29418]: cephadm 2021-03-10T17:28:56.294258+0000 mgr.gibba020.yqfnwy (mgr.34427) 11370 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:28:57.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[29418]: audit 2021-03-10T17:28:56.301818+0000 mon.a (mon.0) 3995 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:28:57.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[29418]: cephadm 2021-03-10T17:28:56.301841+0000 mgr.gibba020.yqfnwy (mgr.34427) 11371 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:28:57.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[29418]: audit 2021-03-10T17:28:56.505129+0000 mon.a (mon.0) 3996 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:28:57.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[29418]: cephadm 2021-03-10T17:28:56.507409+0000 mgr.gibba020.yqfnwy (mgr.34427) 11372 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:28:57.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[29418]: audit 2021-03-10T17:28:56.508658+0000 mon.a (mon.0) 3997 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:28:57.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[29418]: cephadm 2021-03-10T17:28:56.509592+0000 mgr.gibba020.yqfnwy (mgr.34427) 11373 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:28:57.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[29418]: audit 2021-03-10T17:28:56.510418+0000 mon.a (mon.0) 3998 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:57.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[29418]: cephadm 2021-03-10T17:28:56.511001+0000 mgr.gibba020.yqfnwy (mgr.34427) 11374 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:28:57.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[29418]: cephadm 2021-03-10T17:28:56.511040+0000 mgr.gibba020.yqfnwy (mgr.34427) 11375 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:28:57.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[29418]: audit 2021-03-10T17:28:56.511978+0000 mon.a (mon.0) 3999 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:57.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[29418]: cephadm 2021-03-10T17:28:56.512458+0000 mgr.gibba020.yqfnwy (mgr.34427) 11376 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:28:57.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[29418]: cephadm 2021-03-10T17:28:56.512497+0000 mgr.gibba020.yqfnwy (mgr.34427) 11377 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:28:57.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[29418]: audit 2021-03-10T17:28:56.513369+0000 mon.a (mon.0) 4000 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:57.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[29418]: cephadm 2021-03-10T17:28:56.513930+0000 mgr.gibba020.yqfnwy (mgr.34427) 11378 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:28:57.387 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[29418]: cephadm 2021-03-10T17:28:56.515462+0000 mgr.gibba020.yqfnwy (mgr.34427) 11379 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:28:57.387 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[29418]: cephadm 2021-03-10T17:28:56.515501+0000 mgr.gibba020.yqfnwy (mgr.34427) 11380 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:28:57.387 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[29418]: audit 2021-03-10T17:28:56.516500+0000 mon.a (mon.0) 4001 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:57.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[30381]: audit 2021-03-10T17:28:56.105762+0000 mon.a (mon.0) 3993 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:28:57.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[30381]: audit 2021-03-10T17:28:56.294210+0000 mon.a (mon.0) 3994 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:28:57.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[30381]: cephadm 2021-03-10T17:28:56.294258+0000 mgr.gibba020.yqfnwy (mgr.34427) 11370 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:28:57.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[30381]: audit 2021-03-10T17:28:56.301818+0000 mon.a (mon.0) 3995 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:28:57.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[30381]: cephadm 2021-03-10T17:28:56.301841+0000 mgr.gibba020.yqfnwy (mgr.34427) 11371 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:28:57.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[30381]: audit 2021-03-10T17:28:56.505129+0000 mon.a (mon.0) 3996 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:28:57.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[30381]: cephadm 2021-03-10T17:28:56.507409+0000 mgr.gibba020.yqfnwy (mgr.34427) 11372 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:28:57.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[30381]: audit 2021-03-10T17:28:56.508658+0000 mon.a (mon.0) 3997 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:28:57.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[30381]: cephadm 2021-03-10T17:28:56.509592+0000 mgr.gibba020.yqfnwy (mgr.34427) 11373 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:28:57.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[30381]: audit 2021-03-10T17:28:56.510418+0000 mon.a (mon.0) 3998 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:57.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[30381]: cephadm 2021-03-10T17:28:56.511001+0000 mgr.gibba020.yqfnwy (mgr.34427) 11374 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:28:57.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[30381]: cephadm 2021-03-10T17:28:56.511040+0000 mgr.gibba020.yqfnwy (mgr.34427) 11375 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:28:57.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[30381]: audit 2021-03-10T17:28:56.511978+0000 mon.a (mon.0) 3999 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:57.391 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[30381]: cephadm 2021-03-10T17:28:56.512458+0000 mgr.gibba020.yqfnwy (mgr.34427) 11376 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:28:57.391 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[30381]: cephadm 2021-03-10T17:28:56.512497+0000 mgr.gibba020.yqfnwy (mgr.34427) 11377 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:28:57.391 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[30381]: audit 2021-03-10T17:28:56.513369+0000 mon.a (mon.0) 4000 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:57.391 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[30381]: cephadm 2021-03-10T17:28:56.513930+0000 mgr.gibba020.yqfnwy (mgr.34427) 11378 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:28:57.391 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[30381]: cephadm 2021-03-10T17:28:56.515462+0000 mgr.gibba020.yqfnwy (mgr.34427) 11379 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:28:57.392 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[30381]: cephadm 2021-03-10T17:28:56.515501+0000 mgr.gibba020.yqfnwy (mgr.34427) 11380 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:28:57.392 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[30381]: audit 2021-03-10T17:28:56.516500+0000 mon.a (mon.0) 4001 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:57.392 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[29418]: cephadm 2021-03-10T17:28:56.517147+0000 mgr.gibba020.yqfnwy (mgr.34427) 11381 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:28:57.393 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[29418]: cephadm 2021-03-10T17:28:56.517492+0000 mgr.gibba020.yqfnwy (mgr.34427) 11382 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:28:57.393 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[29418]: audit 2021-03-10T17:28:56.518197+0000 mon.a (mon.0) 4002 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:57.393 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[29418]: cephadm 2021-03-10T17:28:56.518836+0000 mgr.gibba020.yqfnwy (mgr.34427) 11383 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:28:57.393 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[29418]: cephadm 2021-03-10T17:28:56.518873+0000 mgr.gibba020.yqfnwy (mgr.34427) 11384 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:28:57.393 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[29418]: cephadm 2021-03-10T17:28:56.518980+0000 mgr.gibba020.yqfnwy (mgr.34427) 11385 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:28:57.394 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[30381]: cephadm 2021-03-10T17:28:56.517147+0000 mgr.gibba020.yqfnwy (mgr.34427) 11381 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:28:57.394 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[30381]: cephadm 2021-03-10T17:28:56.517492+0000 mgr.gibba020.yqfnwy (mgr.34427) 11382 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:28:57.394 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[30381]: audit 2021-03-10T17:28:56.518197+0000 mon.a (mon.0) 4002 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:57.395 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[30381]: cephadm 2021-03-10T17:28:56.518836+0000 mgr.gibba020.yqfnwy (mgr.34427) 11383 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:28:57.395 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[30381]: cephadm 2021-03-10T17:28:56.518873+0000 mgr.gibba020.yqfnwy (mgr.34427) 11384 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:28:57.395 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:57 gibba013 bash[30381]: cephadm 2021-03-10T17:28:56.518980+0000 mgr.gibba020.yqfnwy (mgr.34427) 11385 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:28:57.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:57 gibba020 bash[25448]: audit 2021-03-10T17:28:56.105762+0000 mon.a (mon.0) 3993 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:28:57.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:57 gibba020 bash[25448]: audit 2021-03-10T17:28:56.294210+0000 mon.a (mon.0) 3994 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:28:57.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:57 gibba020 bash[25448]: cephadm 2021-03-10T17:28:56.294258+0000 mgr.gibba020.yqfnwy (mgr.34427) 11370 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:28:57.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:57 gibba020 bash[25448]: audit 2021-03-10T17:28:56.301818+0000 mon.a (mon.0) 3995 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:28:57.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:57 gibba020 bash[25448]: cephadm 2021-03-10T17:28:56.301841+0000 mgr.gibba020.yqfnwy (mgr.34427) 11371 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:28:57.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:57 gibba020 bash[25448]: audit 2021-03-10T17:28:56.505129+0000 mon.a (mon.0) 3996 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:28:57.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:57 gibba020 bash[25448]: cephadm 2021-03-10T17:28:56.507409+0000 mgr.gibba020.yqfnwy (mgr.34427) 11372 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:28:57.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:57 gibba020 bash[25448]: audit 2021-03-10T17:28:56.508658+0000 mon.a (mon.0) 3997 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:28:57.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:57 gibba020 bash[25448]: cephadm 2021-03-10T17:28:56.509592+0000 mgr.gibba020.yqfnwy (mgr.34427) 11373 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:28:57.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:57 gibba020 bash[25448]: audit 2021-03-10T17:28:56.510418+0000 mon.a (mon.0) 3998 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:57.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:57 gibba020 bash[25448]: cephadm 2021-03-10T17:28:56.511001+0000 mgr.gibba020.yqfnwy (mgr.34427) 11374 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:28:57.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:57 gibba020 bash[25448]: cephadm 2021-03-10T17:28:56.511040+0000 mgr.gibba020.yqfnwy (mgr.34427) 11375 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:28:57.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:57 gibba020 bash[25448]: audit 2021-03-10T17:28:56.511978+0000 mon.a (mon.0) 3999 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:57.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:57 gibba020 bash[25448]: cephadm 2021-03-10T17:28:56.512458+0000 mgr.gibba020.yqfnwy (mgr.34427) 11376 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:28:57.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:57 gibba020 bash[25448]: cephadm 2021-03-10T17:28:56.512497+0000 mgr.gibba020.yqfnwy (mgr.34427) 11377 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:28:57.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:57 gibba020 bash[25448]: audit 2021-03-10T17:28:56.513369+0000 mon.a (mon.0) 4000 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:57.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:57 gibba020 bash[25448]: cephadm 2021-03-10T17:28:56.513930+0000 mgr.gibba020.yqfnwy (mgr.34427) 11378 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:28:57.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:57 gibba020 bash[25448]: cephadm 2021-03-10T17:28:56.515462+0000 mgr.gibba020.yqfnwy (mgr.34427) 11379 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:28:57.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:57 gibba020 bash[25448]: cephadm 2021-03-10T17:28:56.515501+0000 mgr.gibba020.yqfnwy (mgr.34427) 11380 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:28:57.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:57 gibba020 bash[25448]: audit 2021-03-10T17:28:56.516500+0000 mon.a (mon.0) 4001 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:57.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:57 gibba020 bash[25448]: cephadm 2021-03-10T17:28:56.517147+0000 mgr.gibba020.yqfnwy (mgr.34427) 11381 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:28:57.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:57 gibba020 bash[25448]: cephadm 2021-03-10T17:28:56.517492+0000 mgr.gibba020.yqfnwy (mgr.34427) 11382 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:28:57.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:57 gibba020 bash[25448]: audit 2021-03-10T17:28:56.518197+0000 mon.a (mon.0) 4002 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:57.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:57 gibba020 bash[25448]: cephadm 2021-03-10T17:28:56.518836+0000 mgr.gibba020.yqfnwy (mgr.34427) 11383 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:28:57.456 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:57 gibba020 bash[25448]: cephadm 2021-03-10T17:28:56.518873+0000 mgr.gibba020.yqfnwy (mgr.34427) 11384 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:28:57.456 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:57 gibba020 bash[25448]: cephadm 2021-03-10T17:28:56.518980+0000 mgr.gibba020.yqfnwy (mgr.34427) 11385 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:28:57.752 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:28:57.981 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:28:57.981 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 7m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:28:57.981 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 6m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:28:57.981 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:28:57.982 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:28:57.982 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:28:57.982 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:28:57.982 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:28:57.983 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:28:57.983 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:28:57.983 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:28:57.983 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:28:57.983 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:28:57.984 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:28:57.984 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:28:57.984 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:28:57.984 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:28:57.985 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:28:57.985 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:28:57.985 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 6m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:28:57.985 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 6m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:28:58.234 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:28:58.235 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:28:58.235 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:28:58.235 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:28:58.235 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:28:58.236 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:28:58.236 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:28:58.236 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:28:58.236 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:28:58.236 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:28:58.237 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:28:58.237 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:28:58.237 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:28:58.237 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:28:58.238 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:28:58.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:58 gibba013 bash[29418]: audit 2021-03-10T17:28:57.741015+0000 mgr.gibba020.yqfnwy (mgr.34427) 11386 : audit [DBG] from='client.51684 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:28:58.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:58 gibba013 bash[29418]: cluster 2021-03-10T17:28:57.933161+0000 mgr.gibba020.yqfnwy (mgr.34427) 11387 : cluster [DBG] pgmap v6486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:58.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:58 gibba013 bash[29418]: audit 2021-03-10T17:28:57.966331+0000 mgr.gibba020.yqfnwy (mgr.34427) 11388 : audit [DBG] from='client.61669 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:28:58.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:58 gibba013 bash[30381]: audit 2021-03-10T17:28:57.741015+0000 mgr.gibba020.yqfnwy (mgr.34427) 11386 : audit [DBG] from='client.51684 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:28:58.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:58 gibba013 bash[30381]: cluster 2021-03-10T17:28:57.933161+0000 mgr.gibba020.yqfnwy (mgr.34427) 11387 : cluster [DBG] pgmap v6486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:58.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:58 gibba013 bash[30381]: audit 2021-03-10T17:28:57.966331+0000 mgr.gibba020.yqfnwy (mgr.34427) 11388 : audit [DBG] from='client.61669 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:28:58.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:58 gibba020 bash[25448]: audit 2021-03-10T17:28:57.741015+0000 mgr.gibba020.yqfnwy (mgr.34427) 11386 : audit [DBG] from='client.51684 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:28:58.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:58 gibba020 bash[25448]: cluster 2021-03-10T17:28:57.933161+0000 mgr.gibba020.yqfnwy (mgr.34427) 11387 : cluster [DBG] pgmap v6486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:28:58.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:58 gibba020 bash[25448]: audit 2021-03-10T17:28:57.966331+0000 mgr.gibba020.yqfnwy (mgr.34427) 11388 : audit [DBG] from='client.61669 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:28:59.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:28:59 gibba013 bash[29418]: audit 2021-03-10T17:28:58.232935+0000 mon.c (mon.1) 174 : audit [DBG] from='client.? 172.21.2.113:0/393959296' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:59.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:28:59 gibba013 bash[30381]: audit 2021-03-10T17:28:58.232935+0000 mon.c (mon.1) 174 : audit [DBG] from='client.? 172.21.2.113:0/393959296' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:28:59.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:28:59 gibba020 bash[25448]: audit 2021-03-10T17:28:58.232935+0000 mon.c (mon.1) 174 : audit [DBG] from='client.? 172.21.2.113:0/393959296' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:00.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:00 gibba013 bash[29418]: cluster 2021-03-10T17:28:59.935113+0000 mgr.gibba020.yqfnwy (mgr.34427) 11389 : cluster [DBG] pgmap v6487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:00.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:00 gibba013 bash[30381]: cluster 2021-03-10T17:28:59.935113+0000 mgr.gibba020.yqfnwy (mgr.34427) 11389 : cluster [DBG] pgmap v6487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:00.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:00 gibba020 bash[25448]: cluster 2021-03-10T17:28:59.935113+0000 mgr.gibba020.yqfnwy (mgr.34427) 11389 : cluster [DBG] pgmap v6487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:02.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:02 gibba013 bash[29418]: cluster 2021-03-10T17:29:01.936554+0000 mgr.gibba020.yqfnwy (mgr.34427) 11390 : cluster [DBG] pgmap v6488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:02.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:02 gibba013 bash[30381]: cluster 2021-03-10T17:29:01.936554+0000 mgr.gibba020.yqfnwy (mgr.34427) 11390 : cluster [DBG] pgmap v6488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:02.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:02 gibba020 bash[25448]: cluster 2021-03-10T17:29:01.936554+0000 mgr.gibba020.yqfnwy (mgr.34427) 11390 : cluster [DBG] pgmap v6488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:04.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:04 gibba013 bash[29418]: cluster 2021-03-10T17:29:03.937976+0000 mgr.gibba020.yqfnwy (mgr.34427) 11391 : cluster [DBG] pgmap v6489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:04.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:04 gibba013 bash[30381]: cluster 2021-03-10T17:29:03.937976+0000 mgr.gibba020.yqfnwy (mgr.34427) 11391 : cluster [DBG] pgmap v6489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:04.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:04 gibba020 bash[25448]: cluster 2021-03-10T17:29:03.937976+0000 mgr.gibba020.yqfnwy (mgr.34427) 11391 : cluster [DBG] pgmap v6489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:06.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:06 gibba013 bash[29418]: cluster 2021-03-10T17:29:05.939828+0000 mgr.gibba020.yqfnwy (mgr.34427) 11392 : cluster [DBG] pgmap v6490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:06.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:06 gibba013 bash[30381]: cluster 2021-03-10T17:29:05.939828+0000 mgr.gibba020.yqfnwy (mgr.34427) 11392 : cluster [DBG] pgmap v6490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:06.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:06 gibba020 bash[25448]: cluster 2021-03-10T17:29:05.939828+0000 mgr.gibba020.yqfnwy (mgr.34427) 11392 : cluster [DBG] pgmap v6490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:07 gibba013 bash[29418]: audit 2021-03-10T17:29:07.002706+0000 mon.a (mon.0) 4003 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:29:07.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:07 gibba013 bash[30381]: audit 2021-03-10T17:29:07.002706+0000 mon.a (mon.0) 4003 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:29:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:07 gibba020 bash[25448]: audit 2021-03-10T17:29:07.002706+0000 mon.a (mon.0) 4003 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:29:08.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:08 gibba013 bash[29418]: audit 2021-03-10T17:29:07.246255+0000 mon.a (mon.0) 4004 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:29:08.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:08 gibba013 bash[29418]: audit 2021-03-10T17:29:07.695337+0000 mon.a (mon.0) 4005 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:29:08.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:08 gibba013 bash[29418]: audit 2021-03-10T17:29:07.696439+0000 mon.a (mon.0) 4006 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:29:08.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:08 gibba013 bash[29418]: audit 2021-03-10T17:29:07.697444+0000 mon.a (mon.0) 4007 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:29:08.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:08 gibba013 bash[29418]: audit 2021-03-10T17:29:07.698478+0000 mon.a (mon.0) 4008 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:29:08.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:08 gibba013 bash[29418]: cluster 2021-03-10T17:29:07.941223+0000 mgr.gibba020.yqfnwy (mgr.34427) 11393 : cluster [DBG] pgmap v6491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:08.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:08 gibba013 bash[30381]: audit 2021-03-10T17:29:07.246255+0000 mon.a (mon.0) 4004 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:29:08.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:08 gibba013 bash[30381]: audit 2021-03-10T17:29:07.695337+0000 mon.a (mon.0) 4005 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:29:08.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:08 gibba013 bash[30381]: audit 2021-03-10T17:29:07.696439+0000 mon.a (mon.0) 4006 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:29:08.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:08 gibba013 bash[30381]: audit 2021-03-10T17:29:07.697444+0000 mon.a (mon.0) 4007 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:29:08.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:08 gibba013 bash[30381]: audit 2021-03-10T17:29:07.698478+0000 mon.a (mon.0) 4008 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:29:08.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:08 gibba013 bash[30381]: cluster 2021-03-10T17:29:07.941223+0000 mgr.gibba020.yqfnwy (mgr.34427) 11393 : cluster [DBG] pgmap v6491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:08.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:08 gibba020 bash[25448]: audit 2021-03-10T17:29:07.246255+0000 mon.a (mon.0) 4004 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:29:08.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:08 gibba020 bash[25448]: audit 2021-03-10T17:29:07.695337+0000 mon.a (mon.0) 4005 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:29:08.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:08 gibba020 bash[25448]: audit 2021-03-10T17:29:07.696439+0000 mon.a (mon.0) 4006 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:29:08.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:08 gibba020 bash[25448]: audit 2021-03-10T17:29:07.697444+0000 mon.a (mon.0) 4007 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:29:08.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:08 gibba020 bash[25448]: audit 2021-03-10T17:29:07.698478+0000 mon.a (mon.0) 4008 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:29:08.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:08 gibba020 bash[25448]: cluster 2021-03-10T17:29:07.941223+0000 mgr.gibba020.yqfnwy (mgr.34427) 11393 : cluster [DBG] pgmap v6491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:10.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:10 gibba013 bash[29418]: cluster 2021-03-10T17:29:09.943064+0000 mgr.gibba020.yqfnwy (mgr.34427) 11394 : cluster [DBG] pgmap v6492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:10.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:10 gibba013 bash[30381]: cluster 2021-03-10T17:29:09.943064+0000 mgr.gibba020.yqfnwy (mgr.34427) 11394 : cluster [DBG] pgmap v6492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:10.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:10 gibba020 bash[25448]: cluster 2021-03-10T17:29:09.943064+0000 mgr.gibba020.yqfnwy (mgr.34427) 11394 : cluster [DBG] pgmap v6492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:12.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:12 gibba013 bash[29418]: cephadm 2021-03-10T17:29:11.521205+0000 mgr.gibba020.yqfnwy (mgr.34427) 11395 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:29:12.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:12 gibba013 bash[29418]: cluster 2021-03-10T17:29:11.944553+0000 mgr.gibba020.yqfnwy (mgr.34427) 11396 : cluster [DBG] pgmap v6493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:12.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:12 gibba013 bash[30381]: cephadm 2021-03-10T17:29:11.521205+0000 mgr.gibba020.yqfnwy (mgr.34427) 11395 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:29:12.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:12 gibba013 bash[30381]: cluster 2021-03-10T17:29:11.944553+0000 mgr.gibba020.yqfnwy (mgr.34427) 11396 : cluster [DBG] pgmap v6493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:12.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:12 gibba020 bash[25448]: cephadm 2021-03-10T17:29:11.521205+0000 mgr.gibba020.yqfnwy (mgr.34427) 11395 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:29:12.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:12 gibba020 bash[25448]: cluster 2021-03-10T17:29:11.944553+0000 mgr.gibba020.yqfnwy (mgr.34427) 11396 : cluster [DBG] pgmap v6493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:14.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:14 gibba013 bash[29418]: cluster 2021-03-10T17:29:13.945992+0000 mgr.gibba020.yqfnwy (mgr.34427) 11397 : cluster [DBG] pgmap v6494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:14.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:14 gibba013 bash[30381]: cluster 2021-03-10T17:29:13.945992+0000 mgr.gibba020.yqfnwy (mgr.34427) 11397 : cluster [DBG] pgmap v6494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:14.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:14 gibba020 bash[25448]: cluster 2021-03-10T17:29:13.945992+0000 mgr.gibba020.yqfnwy (mgr.34427) 11397 : cluster [DBG] pgmap v6494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:16.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:16 gibba013 bash[29418]: cluster 2021-03-10T17:29:15.947752+0000 mgr.gibba020.yqfnwy (mgr.34427) 11398 : cluster [DBG] pgmap v6495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:16.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:16 gibba013 bash[30381]: cluster 2021-03-10T17:29:15.947752+0000 mgr.gibba020.yqfnwy (mgr.34427) 11398 : cluster [DBG] pgmap v6495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:16.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:16 gibba020 bash[25448]: cluster 2021-03-10T17:29:15.947752+0000 mgr.gibba020.yqfnwy (mgr.34427) 11398 : cluster [DBG] pgmap v6495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:18.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:18 gibba013 bash[29418]: cluster 2021-03-10T17:29:17.949016+0000 mgr.gibba020.yqfnwy (mgr.34427) 11399 : cluster [DBG] pgmap v6496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:18.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:18 gibba013 bash[30381]: cluster 2021-03-10T17:29:17.949016+0000 mgr.gibba020.yqfnwy (mgr.34427) 11399 : cluster [DBG] pgmap v6496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:18.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:18 gibba020 bash[25448]: cluster 2021-03-10T17:29:17.949016+0000 mgr.gibba020.yqfnwy (mgr.34427) 11399 : cluster [DBG] pgmap v6496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:20.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:20 gibba013 bash[29418]: cluster 2021-03-10T17:29:19.950785+0000 mgr.gibba020.yqfnwy (mgr.34427) 11400 : cluster [DBG] pgmap v6497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:20.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:20 gibba013 bash[30381]: cluster 2021-03-10T17:29:19.950785+0000 mgr.gibba020.yqfnwy (mgr.34427) 11400 : cluster [DBG] pgmap v6497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:20.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:20 gibba020 bash[25448]: cluster 2021-03-10T17:29:19.950785+0000 mgr.gibba020.yqfnwy (mgr.34427) 11400 : cluster [DBG] pgmap v6497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:22.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:22 gibba013 bash[29418]: cluster 2021-03-10T17:29:21.952075+0000 mgr.gibba020.yqfnwy (mgr.34427) 11401 : cluster [DBG] pgmap v6498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:22.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:22 gibba013 bash[30381]: cluster 2021-03-10T17:29:21.952075+0000 mgr.gibba020.yqfnwy (mgr.34427) 11401 : cluster [DBG] pgmap v6498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:22.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:22 gibba020 bash[25448]: cluster 2021-03-10T17:29:21.952075+0000 mgr.gibba020.yqfnwy (mgr.34427) 11401 : cluster [DBG] pgmap v6498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:24.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:24 gibba013 bash[29418]: cluster 2021-03-10T17:29:23.953431+0000 mgr.gibba020.yqfnwy (mgr.34427) 11402 : cluster [DBG] pgmap v6499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:24.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:24 gibba013 bash[30381]: cluster 2021-03-10T17:29:23.953431+0000 mgr.gibba020.yqfnwy (mgr.34427) 11402 : cluster [DBG] pgmap v6499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:24.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:24 gibba020 bash[25448]: cluster 2021-03-10T17:29:23.953431+0000 mgr.gibba020.yqfnwy (mgr.34427) 11402 : cluster [DBG] pgmap v6499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:26.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:26 gibba013 bash[29418]: cluster 2021-03-10T17:29:25.955186+0000 mgr.gibba020.yqfnwy (mgr.34427) 11403 : cluster [DBG] pgmap v6500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:26.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:26 gibba013 bash[30381]: cluster 2021-03-10T17:29:25.955186+0000 mgr.gibba020.yqfnwy (mgr.34427) 11403 : cluster [DBG] pgmap v6500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:26.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:26 gibba020 bash[25448]: cluster 2021-03-10T17:29:25.955186+0000 mgr.gibba020.yqfnwy (mgr.34427) 11403 : cluster [DBG] pgmap v6500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:27.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:27 gibba013 bash[29418]: cephadm 2021-03-10T17:29:26.536117+0000 mgr.gibba020.yqfnwy (mgr.34427) 11404 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:29:27.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:27 gibba013 bash[30381]: cephadm 2021-03-10T17:29:26.536117+0000 mgr.gibba020.yqfnwy (mgr.34427) 11404 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:29:27.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:27 gibba020 bash[25448]: cephadm 2021-03-10T17:29:26.536117+0000 mgr.gibba020.yqfnwy (mgr.34427) 11404 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:29:28.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:28 gibba013 bash[29418]: cluster 2021-03-10T17:29:27.956469+0000 mgr.gibba020.yqfnwy (mgr.34427) 11405 : cluster [DBG] pgmap v6501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:28.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:28 gibba013 bash[30381]: cluster 2021-03-10T17:29:27.956469+0000 mgr.gibba020.yqfnwy (mgr.34427) 11405 : cluster [DBG] pgmap v6501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:28.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:28 gibba020 bash[25448]: cluster 2021-03-10T17:29:27.956469+0000 mgr.gibba020.yqfnwy (mgr.34427) 11405 : cluster [DBG] pgmap v6501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:28.478 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:29:28.706 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:29:28.707 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 7m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:29:28.707 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 6m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:29:28.707 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:29:28.707 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:29:28.708 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:29:28.708 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:29:28.708 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:29:28.708 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:29:28.708 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:29:28.709 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:29:28.709 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:29:28.709 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:29:28.709 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:29:28.710 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:29:28.710 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:29:28.710 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:29:28.710 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:29:28.710 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:29:28.711 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 6m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:29:28.711 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 6m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:29:28.956 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:29:28.957 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:29:28.957 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:29:28.957 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:29:28.958 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:29:28.958 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:29:28.958 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:29:28.958 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:29:28.959 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:29:28.959 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:29:28.959 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:29:28.959 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:29:28.959 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:29:28.960 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:29:28.960 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:29:29.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:29 gibba013 bash[29418]: audit 2021-03-10T17:29:28.467074+0000 mgr.gibba020.yqfnwy (mgr.34427) 11406 : audit [DBG] from='client.51702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:29:29.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:29 gibba013 bash[29418]: audit 2021-03-10T17:29:28.691540+0000 mgr.gibba020.yqfnwy (mgr.34427) 11407 : audit [DBG] from='client.61687 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:29:29.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:29 gibba013 bash[29418]: audit 2021-03-10T17:29:28.955079+0000 mon.a (mon.0) 4009 : audit [DBG] from='client.? 172.21.2.113:0/3628709328' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:29.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:29 gibba013 bash[30381]: audit 2021-03-10T17:29:28.467074+0000 mgr.gibba020.yqfnwy (mgr.34427) 11406 : audit [DBG] from='client.51702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:29:29.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:29 gibba013 bash[30381]: audit 2021-03-10T17:29:28.691540+0000 mgr.gibba020.yqfnwy (mgr.34427) 11407 : audit [DBG] from='client.61687 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:29:29.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:29 gibba013 bash[30381]: audit 2021-03-10T17:29:28.955079+0000 mon.a (mon.0) 4009 : audit [DBG] from='client.? 172.21.2.113:0/3628709328' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:29.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:29 gibba020 bash[25448]: audit 2021-03-10T17:29:28.467074+0000 mgr.gibba020.yqfnwy (mgr.34427) 11406 : audit [DBG] from='client.51702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:29:29.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:29 gibba020 bash[25448]: audit 2021-03-10T17:29:28.691540+0000 mgr.gibba020.yqfnwy (mgr.34427) 11407 : audit [DBG] from='client.61687 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:29:29.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:29 gibba020 bash[25448]: audit 2021-03-10T17:29:28.955079+0000 mon.a (mon.0) 4009 : audit [DBG] from='client.? 172.21.2.113:0/3628709328' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:30.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:30 gibba013 bash[29418]: cluster 2021-03-10T17:29:29.958204+0000 mgr.gibba020.yqfnwy (mgr.34427) 11408 : cluster [DBG] pgmap v6502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:30.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:30 gibba013 bash[30381]: cluster 2021-03-10T17:29:29.958204+0000 mgr.gibba020.yqfnwy (mgr.34427) 11408 : cluster [DBG] pgmap v6502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:30.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:30 gibba020 bash[25448]: cluster 2021-03-10T17:29:29.958204+0000 mgr.gibba020.yqfnwy (mgr.34427) 11408 : cluster [DBG] pgmap v6502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:32.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:32 gibba013 bash[29418]: cluster 2021-03-10T17:29:31.959492+0000 mgr.gibba020.yqfnwy (mgr.34427) 11409 : cluster [DBG] pgmap v6503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:32.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:32 gibba013 bash[30381]: cluster 2021-03-10T17:29:31.959492+0000 mgr.gibba020.yqfnwy (mgr.34427) 11409 : cluster [DBG] pgmap v6503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:32.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:32 gibba020 bash[25448]: cluster 2021-03-10T17:29:31.959492+0000 mgr.gibba020.yqfnwy (mgr.34427) 11409 : cluster [DBG] pgmap v6503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:34.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:34 gibba013 bash[29418]: cluster 2021-03-10T17:29:33.960949+0000 mgr.gibba020.yqfnwy (mgr.34427) 11410 : cluster [DBG] pgmap v6504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:34.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:34 gibba013 bash[30381]: cluster 2021-03-10T17:29:33.960949+0000 mgr.gibba020.yqfnwy (mgr.34427) 11410 : cluster [DBG] pgmap v6504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:34.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:34 gibba020 bash[25448]: cluster 2021-03-10T17:29:33.960949+0000 mgr.gibba020.yqfnwy (mgr.34427) 11410 : cluster [DBG] pgmap v6504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:36.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:36 gibba013 bash[29418]: cluster 2021-03-10T17:29:35.962812+0000 mgr.gibba020.yqfnwy (mgr.34427) 11411 : cluster [DBG] pgmap v6505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:36.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:36 gibba013 bash[30381]: cluster 2021-03-10T17:29:35.962812+0000 mgr.gibba020.yqfnwy (mgr.34427) 11411 : cluster [DBG] pgmap v6505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:36.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:36 gibba020 bash[25448]: cluster 2021-03-10T17:29:35.962812+0000 mgr.gibba020.yqfnwy (mgr.34427) 11411 : cluster [DBG] pgmap v6505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:38.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:38 gibba013 bash[29418]: cluster 2021-03-10T17:29:37.964244+0000 mgr.gibba020.yqfnwy (mgr.34427) 11412 : cluster [DBG] pgmap v6506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:38.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:38 gibba013 bash[30381]: cluster 2021-03-10T17:29:37.964244+0000 mgr.gibba020.yqfnwy (mgr.34427) 11412 : cluster [DBG] pgmap v6506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:38.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:38 gibba020 bash[25448]: cluster 2021-03-10T17:29:37.964244+0000 mgr.gibba020.yqfnwy (mgr.34427) 11412 : cluster [DBG] pgmap v6506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:40.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:40 gibba013 bash[29418]: cluster 2021-03-10T17:29:39.966052+0000 mgr.gibba020.yqfnwy (mgr.34427) 11413 : cluster [DBG] pgmap v6507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:40.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:40 gibba013 bash[30381]: cluster 2021-03-10T17:29:39.966052+0000 mgr.gibba020.yqfnwy (mgr.34427) 11413 : cluster [DBG] pgmap v6507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:40.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:40 gibba020 bash[25448]: cluster 2021-03-10T17:29:39.966052+0000 mgr.gibba020.yqfnwy (mgr.34427) 11413 : cluster [DBG] pgmap v6507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:42.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:42 gibba013 bash[29418]: cephadm 2021-03-10T17:29:41.552229+0000 mgr.gibba020.yqfnwy (mgr.34427) 11414 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:29:42.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:42 gibba013 bash[29418]: cluster 2021-03-10T17:29:41.967302+0000 mgr.gibba020.yqfnwy (mgr.34427) 11415 : cluster [DBG] pgmap v6508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:42.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:42 gibba013 bash[30381]: cephadm 2021-03-10T17:29:41.552229+0000 mgr.gibba020.yqfnwy (mgr.34427) 11414 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:29:42.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:42 gibba013 bash[30381]: cluster 2021-03-10T17:29:41.967302+0000 mgr.gibba020.yqfnwy (mgr.34427) 11415 : cluster [DBG] pgmap v6508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:42.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:42 gibba020 bash[25448]: cephadm 2021-03-10T17:29:41.552229+0000 mgr.gibba020.yqfnwy (mgr.34427) 11414 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:29:42.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:42 gibba020 bash[25448]: cluster 2021-03-10T17:29:41.967302+0000 mgr.gibba020.yqfnwy (mgr.34427) 11415 : cluster [DBG] pgmap v6508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:44.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:44 gibba013 bash[29418]: cluster 2021-03-10T17:29:43.968875+0000 mgr.gibba020.yqfnwy (mgr.34427) 11416 : cluster [DBG] pgmap v6509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:44.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:44 gibba013 bash[30381]: cluster 2021-03-10T17:29:43.968875+0000 mgr.gibba020.yqfnwy (mgr.34427) 11416 : cluster [DBG] pgmap v6509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:44.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:44 gibba020 bash[25448]: cluster 2021-03-10T17:29:43.968875+0000 mgr.gibba020.yqfnwy (mgr.34427) 11416 : cluster [DBG] pgmap v6509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:46.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:46 gibba013 bash[29418]: cluster 2021-03-10T17:29:45.970729+0000 mgr.gibba020.yqfnwy (mgr.34427) 11417 : cluster [DBG] pgmap v6510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:46.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:46 gibba013 bash[30381]: cluster 2021-03-10T17:29:45.970729+0000 mgr.gibba020.yqfnwy (mgr.34427) 11417 : cluster [DBG] pgmap v6510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:46.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:46 gibba020 bash[25448]: cluster 2021-03-10T17:29:45.970729+0000 mgr.gibba020.yqfnwy (mgr.34427) 11417 : cluster [DBG] pgmap v6510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:48.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:48 gibba013 bash[29418]: cluster 2021-03-10T17:29:47.972128+0000 mgr.gibba020.yqfnwy (mgr.34427) 11418 : cluster [DBG] pgmap v6511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:48.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:48 gibba013 bash[30381]: cluster 2021-03-10T17:29:47.972128+0000 mgr.gibba020.yqfnwy (mgr.34427) 11418 : cluster [DBG] pgmap v6511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:48.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:48 gibba020 bash[25448]: cluster 2021-03-10T17:29:47.972128+0000 mgr.gibba020.yqfnwy (mgr.34427) 11418 : cluster [DBG] pgmap v6511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:50.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:50 gibba013 bash[29418]: cluster 2021-03-10T17:29:49.973921+0000 mgr.gibba020.yqfnwy (mgr.34427) 11419 : cluster [DBG] pgmap v6512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:50.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:50 gibba013 bash[30381]: cluster 2021-03-10T17:29:49.973921+0000 mgr.gibba020.yqfnwy (mgr.34427) 11419 : cluster [DBG] pgmap v6512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:50.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:50 gibba020 bash[25448]: cluster 2021-03-10T17:29:49.973921+0000 mgr.gibba020.yqfnwy (mgr.34427) 11419 : cluster [DBG] pgmap v6512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:52.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:52 gibba013 bash[29418]: cluster 2021-03-10T17:29:51.975268+0000 mgr.gibba020.yqfnwy (mgr.34427) 11420 : cluster [DBG] pgmap v6513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:52.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:52 gibba013 bash[30381]: cluster 2021-03-10T17:29:51.975268+0000 mgr.gibba020.yqfnwy (mgr.34427) 11420 : cluster [DBG] pgmap v6513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:52.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:52 gibba020 bash[25448]: cluster 2021-03-10T17:29:51.975268+0000 mgr.gibba020.yqfnwy (mgr.34427) 11420 : cluster [DBG] pgmap v6513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:54.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:54 gibba013 bash[29418]: cluster 2021-03-10T17:29:53.976912+0000 mgr.gibba020.yqfnwy (mgr.34427) 11421 : cluster [DBG] pgmap v6514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:54.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:54 gibba013 bash[30381]: cluster 2021-03-10T17:29:53.976912+0000 mgr.gibba020.yqfnwy (mgr.34427) 11421 : cluster [DBG] pgmap v6514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:54.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:54 gibba020 bash[25448]: cluster 2021-03-10T17:29:53.976912+0000 mgr.gibba020.yqfnwy (mgr.34427) 11421 : cluster [DBG] pgmap v6514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:56.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:56 gibba013 bash[29418]: cluster 2021-03-10T17:29:55.978638+0000 mgr.gibba020.yqfnwy (mgr.34427) 11422 : cluster [DBG] pgmap v6515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:56.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:56 gibba013 bash[30381]: cluster 2021-03-10T17:29:55.978638+0000 mgr.gibba020.yqfnwy (mgr.34427) 11422 : cluster [DBG] pgmap v6515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:56.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:56 gibba020 bash[25448]: cluster 2021-03-10T17:29:55.978638+0000 mgr.gibba020.yqfnwy (mgr.34427) 11422 : cluster [DBG] pgmap v6515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:57.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[29418]: audit 2021-03-10T17:29:56.562081+0000 mon.a (mon.0) 4010 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:29:57.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[29418]: cephadm 2021-03-10T17:29:56.567269+0000 mgr.gibba020.yqfnwy (mgr.34427) 11423 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:29:57.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[29418]: cephadm 2021-03-10T17:29:56.569024+0000 mgr.gibba020.yqfnwy (mgr.34427) 11424 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:29:57.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[29418]: audit 2021-03-10T17:29:56.795376+0000 mon.a (mon.0) 4011 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:29:57.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[29418]: cephadm 2021-03-10T17:29:56.797387+0000 mgr.gibba020.yqfnwy (mgr.34427) 11425 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:29:57.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[29418]: audit 2021-03-10T17:29:56.798763+0000 mon.a (mon.0) 4012 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:29:57.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[29418]: cephadm 2021-03-10T17:29:56.799608+0000 mgr.gibba020.yqfnwy (mgr.34427) 11426 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:29:57.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[29418]: audit 2021-03-10T17:29:56.800604+0000 mon.a (mon.0) 4013 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:57.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[29418]: cephadm 2021-03-10T17:29:56.801334+0000 mgr.gibba020.yqfnwy (mgr.34427) 11427 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:29:57.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[29418]: cephadm 2021-03-10T17:29:56.801371+0000 mgr.gibba020.yqfnwy (mgr.34427) 11428 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:29:57.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[29418]: audit 2021-03-10T17:29:56.802362+0000 mon.a (mon.0) 4014 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:57.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[29418]: cephadm 2021-03-10T17:29:56.803000+0000 mgr.gibba020.yqfnwy (mgr.34427) 11429 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:29:57.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[29418]: cephadm 2021-03-10T17:29:56.803035+0000 mgr.gibba020.yqfnwy (mgr.34427) 11430 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:29:57.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[29418]: audit 2021-03-10T17:29:56.803954+0000 mon.a (mon.0) 4015 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:57.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[29418]: cephadm 2021-03-10T17:29:56.804685+0000 mgr.gibba020.yqfnwy (mgr.34427) 11431 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:29:57.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[29418]: cephadm 2021-03-10T17:29:56.806329+0000 mgr.gibba020.yqfnwy (mgr.34427) 11432 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:29:57.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[29418]: cephadm 2021-03-10T17:29:56.806367+0000 mgr.gibba020.yqfnwy (mgr.34427) 11433 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:29:57.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[29418]: audit 2021-03-10T17:29:56.807437+0000 mon.a (mon.0) 4016 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:57.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[29418]: cephadm 2021-03-10T17:29:56.808068+0000 mgr.gibba020.yqfnwy (mgr.34427) 11434 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:29:57.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[29418]: cephadm 2021-03-10T17:29:56.808395+0000 mgr.gibba020.yqfnwy (mgr.34427) 11435 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:29:57.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[30381]: audit 2021-03-10T17:29:56.562081+0000 mon.a (mon.0) 4010 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:29:57.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[30381]: cephadm 2021-03-10T17:29:56.567269+0000 mgr.gibba020.yqfnwy (mgr.34427) 11423 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:29:57.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[30381]: cephadm 2021-03-10T17:29:56.569024+0000 mgr.gibba020.yqfnwy (mgr.34427) 11424 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:29:57.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[30381]: audit 2021-03-10T17:29:56.795376+0000 mon.a (mon.0) 4011 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:29:57.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[30381]: cephadm 2021-03-10T17:29:56.797387+0000 mgr.gibba020.yqfnwy (mgr.34427) 11425 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:29:57.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[30381]: audit 2021-03-10T17:29:56.798763+0000 mon.a (mon.0) 4012 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:29:57.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[30381]: cephadm 2021-03-10T17:29:56.799608+0000 mgr.gibba020.yqfnwy (mgr.34427) 11426 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:29:57.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[30381]: audit 2021-03-10T17:29:56.800604+0000 mon.a (mon.0) 4013 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:57.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[30381]: cephadm 2021-03-10T17:29:56.801334+0000 mgr.gibba020.yqfnwy (mgr.34427) 11427 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:29:57.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[30381]: cephadm 2021-03-10T17:29:56.801371+0000 mgr.gibba020.yqfnwy (mgr.34427) 11428 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:29:57.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[30381]: audit 2021-03-10T17:29:56.802362+0000 mon.a (mon.0) 4014 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:57.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[30381]: cephadm 2021-03-10T17:29:56.803000+0000 mgr.gibba020.yqfnwy (mgr.34427) 11429 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:29:57.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[30381]: cephadm 2021-03-10T17:29:56.803035+0000 mgr.gibba020.yqfnwy (mgr.34427) 11430 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:29:57.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[30381]: audit 2021-03-10T17:29:56.803954+0000 mon.a (mon.0) 4015 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:57.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[30381]: cephadm 2021-03-10T17:29:56.804685+0000 mgr.gibba020.yqfnwy (mgr.34427) 11431 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:29:57.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[30381]: cephadm 2021-03-10T17:29:56.806329+0000 mgr.gibba020.yqfnwy (mgr.34427) 11432 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:29:57.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[30381]: cephadm 2021-03-10T17:29:56.806367+0000 mgr.gibba020.yqfnwy (mgr.34427) 11433 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:29:57.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[30381]: audit 2021-03-10T17:29:56.807437+0000 mon.a (mon.0) 4016 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:57.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[30381]: cephadm 2021-03-10T17:29:56.808068+0000 mgr.gibba020.yqfnwy (mgr.34427) 11434 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:29:57.391 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[30381]: cephadm 2021-03-10T17:29:56.808395+0000 mgr.gibba020.yqfnwy (mgr.34427) 11435 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:29:57.391 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[29418]: audit 2021-03-10T17:29:56.809362+0000 mon.a (mon.0) 4017 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:57.391 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[29418]: cephadm 2021-03-10T17:29:56.809917+0000 mgr.gibba020.yqfnwy (mgr.34427) 11436 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:29:57.392 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[29418]: cephadm 2021-03-10T17:29:56.809955+0000 mgr.gibba020.yqfnwy (mgr.34427) 11437 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:29:57.392 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[29418]: cephadm 2021-03-10T17:29:56.810100+0000 mgr.gibba020.yqfnwy (mgr.34427) 11438 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:29:57.392 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[30381]: audit 2021-03-10T17:29:56.809362+0000 mon.a (mon.0) 4017 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:57.392 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[30381]: cephadm 2021-03-10T17:29:56.809917+0000 mgr.gibba020.yqfnwy (mgr.34427) 11436 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:29:57.393 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[30381]: cephadm 2021-03-10T17:29:56.809955+0000 mgr.gibba020.yqfnwy (mgr.34427) 11437 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:29:57.393 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:57 gibba013 bash[30381]: cephadm 2021-03-10T17:29:56.810100+0000 mgr.gibba020.yqfnwy (mgr.34427) 11438 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:29:57.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:57 gibba020 bash[25448]: audit 2021-03-10T17:29:56.562081+0000 mon.a (mon.0) 4010 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:29:57.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:57 gibba020 bash[25448]: cephadm 2021-03-10T17:29:56.567269+0000 mgr.gibba020.yqfnwy (mgr.34427) 11423 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:29:57.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:57 gibba020 bash[25448]: cephadm 2021-03-10T17:29:56.569024+0000 mgr.gibba020.yqfnwy (mgr.34427) 11424 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:29:57.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:57 gibba020 bash[25448]: audit 2021-03-10T17:29:56.795376+0000 mon.a (mon.0) 4011 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:29:57.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:57 gibba020 bash[25448]: cephadm 2021-03-10T17:29:56.797387+0000 mgr.gibba020.yqfnwy (mgr.34427) 11425 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:29:57.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:57 gibba020 bash[25448]: audit 2021-03-10T17:29:56.798763+0000 mon.a (mon.0) 4012 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:29:57.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:57 gibba020 bash[25448]: cephadm 2021-03-10T17:29:56.799608+0000 mgr.gibba020.yqfnwy (mgr.34427) 11426 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:29:57.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:57 gibba020 bash[25448]: audit 2021-03-10T17:29:56.800604+0000 mon.a (mon.0) 4013 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:57.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:57 gibba020 bash[25448]: cephadm 2021-03-10T17:29:56.801334+0000 mgr.gibba020.yqfnwy (mgr.34427) 11427 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:29:57.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:57 gibba020 bash[25448]: cephadm 2021-03-10T17:29:56.801371+0000 mgr.gibba020.yqfnwy (mgr.34427) 11428 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:29:57.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:57 gibba020 bash[25448]: audit 2021-03-10T17:29:56.802362+0000 mon.a (mon.0) 4014 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:57.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:57 gibba020 bash[25448]: cephadm 2021-03-10T17:29:56.803000+0000 mgr.gibba020.yqfnwy (mgr.34427) 11429 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:29:57.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:57 gibba020 bash[25448]: cephadm 2021-03-10T17:29:56.803035+0000 mgr.gibba020.yqfnwy (mgr.34427) 11430 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:29:57.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:57 gibba020 bash[25448]: audit 2021-03-10T17:29:56.803954+0000 mon.a (mon.0) 4015 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:57.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:57 gibba020 bash[25448]: cephadm 2021-03-10T17:29:56.804685+0000 mgr.gibba020.yqfnwy (mgr.34427) 11431 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:29:57.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:57 gibba020 bash[25448]: cephadm 2021-03-10T17:29:56.806329+0000 mgr.gibba020.yqfnwy (mgr.34427) 11432 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:29:57.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:57 gibba020 bash[25448]: cephadm 2021-03-10T17:29:56.806367+0000 mgr.gibba020.yqfnwy (mgr.34427) 11433 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:29:57.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:57 gibba020 bash[25448]: audit 2021-03-10T17:29:56.807437+0000 mon.a (mon.0) 4016 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:57.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:57 gibba020 bash[25448]: cephadm 2021-03-10T17:29:56.808068+0000 mgr.gibba020.yqfnwy (mgr.34427) 11434 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:29:57.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:57 gibba020 bash[25448]: cephadm 2021-03-10T17:29:56.808395+0000 mgr.gibba020.yqfnwy (mgr.34427) 11435 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:29:57.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:57 gibba020 bash[25448]: audit 2021-03-10T17:29:56.809362+0000 mon.a (mon.0) 4017 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:29:57.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:57 gibba020 bash[25448]: cephadm 2021-03-10T17:29:56.809917+0000 mgr.gibba020.yqfnwy (mgr.34427) 11436 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:29:57.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:57 gibba020 bash[25448]: cephadm 2021-03-10T17:29:56.809955+0000 mgr.gibba020.yqfnwy (mgr.34427) 11437 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:29:57.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:57 gibba020 bash[25448]: cephadm 2021-03-10T17:29:56.810100+0000 mgr.gibba020.yqfnwy (mgr.34427) 11438 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:29:58.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:58 gibba013 bash[29418]: cluster 2021-03-10T17:29:57.980057+0000 mgr.gibba020.yqfnwy (mgr.34427) 11439 : cluster [DBG] pgmap v6516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:58.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:58 gibba013 bash[30381]: cluster 2021-03-10T17:29:57.980057+0000 mgr.gibba020.yqfnwy (mgr.34427) 11439 : cluster [DBG] pgmap v6516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:58.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:58 gibba020 bash[25448]: cluster 2021-03-10T17:29:57.980057+0000 mgr.gibba020.yqfnwy (mgr.34427) 11439 : cluster [DBG] pgmap v6516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:29:59.239 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:29:59.469 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:29:59.470 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 8m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:29:59.470 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 7m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:29:59.470 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:29:59.470 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:29:59.471 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:29:59.471 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:29:59.471 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:29:59.471 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:29:59.472 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:29:59.472 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:29:59.472 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:29:59.472 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:29:59.472 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:29:59.473 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:29:59.473 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:29:59.473 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:29:59.473 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:29:59.473 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:29:59.474 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 7m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:29:59.474 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 7m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:29:59.720 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:29:59.720 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:29:59.720 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:29:59.720 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:29:59.721 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:29:59.721 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:29:59.721 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:29:59.721 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:29:59.722 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:29:59.722 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:29:59.722 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:29:59.722 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:29:59.723 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:29:59.723 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:29:59.723 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:30:00.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:29:59 gibba013 bash[29418]: audit 2021-03-10T17:29:59.717527+0000 mon.a (mon.0) 4018 : audit [DBG] from='client.? 172.21.2.113:0/3444254815' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:00.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:00 gibba013 bash[29418]: debug 2021-03-10T17:29:59.995+0000 7fd718a82700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:30:00.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:29:59 gibba013 bash[30381]: audit 2021-03-10T17:29:59.717527+0000 mon.a (mon.0) 4018 : audit [DBG] from='client.? 172.21.2.113:0/3444254815' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:00.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:29:59 gibba020 bash[25448]: audit 2021-03-10T17:29:59.717527+0000 mon.a (mon.0) 4018 : audit [DBG] from='client.? 172.21.2.113:0/3444254815' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:01.130 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:00 gibba013 bash[29418]: audit 2021-03-10T17:29:59.228553+0000 mgr.gibba020.yqfnwy (mgr.34427) 11440 : audit [DBG] from='client.61699 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:30:01.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:00 gibba013 bash[29418]: audit 2021-03-10T17:29:59.455191+0000 mgr.gibba020.yqfnwy (mgr.34427) 11441 : audit [DBG] from='client.51726 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:30:01.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:00 gibba013 bash[29418]: cluster 2021-03-10T17:29:59.981917+0000 mgr.gibba020.yqfnwy (mgr.34427) 11442 : cluster [DBG] pgmap v6517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:01.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:00 gibba013 bash[29418]: cluster 2021-03-10T17:30:00.000300+0000 mon.a (mon.0) 4019 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:30:01.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:00 gibba013 bash[30381]: audit 2021-03-10T17:29:59.228553+0000 mgr.gibba020.yqfnwy (mgr.34427) 11440 : audit [DBG] from='client.61699 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:30:01.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:00 gibba013 bash[30381]: audit 2021-03-10T17:29:59.455191+0000 mgr.gibba020.yqfnwy (mgr.34427) 11441 : audit [DBG] from='client.51726 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:30:01.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:00 gibba013 bash[30381]: cluster 2021-03-10T17:29:59.981917+0000 mgr.gibba020.yqfnwy (mgr.34427) 11442 : cluster [DBG] pgmap v6517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:01.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:00 gibba013 bash[30381]: cluster 2021-03-10T17:30:00.000300+0000 mon.a (mon.0) 4019 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:30:01.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:00 gibba020 bash[25448]: audit 2021-03-10T17:29:59.228553+0000 mgr.gibba020.yqfnwy (mgr.34427) 11440 : audit [DBG] from='client.61699 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:30:01.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:00 gibba020 bash[25448]: audit 2021-03-10T17:29:59.455191+0000 mgr.gibba020.yqfnwy (mgr.34427) 11441 : audit [DBG] from='client.51726 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:30:01.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:00 gibba020 bash[25448]: cluster 2021-03-10T17:29:59.981917+0000 mgr.gibba020.yqfnwy (mgr.34427) 11442 : cluster [DBG] pgmap v6517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:01.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:00 gibba020 bash[25448]: cluster 2021-03-10T17:30:00.000300+0000 mon.a (mon.0) 4019 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:30:02.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:02 gibba013 bash[29418]: cluster 2021-03-10T17:30:01.983332+0000 mgr.gibba020.yqfnwy (mgr.34427) 11443 : cluster [DBG] pgmap v6518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:02.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:02 gibba013 bash[30381]: cluster 2021-03-10T17:30:01.983332+0000 mgr.gibba020.yqfnwy (mgr.34427) 11443 : cluster [DBG] pgmap v6518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:02.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:02 gibba020 bash[25448]: cluster 2021-03-10T17:30:01.983332+0000 mgr.gibba020.yqfnwy (mgr.34427) 11443 : cluster [DBG] pgmap v6518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:04.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:04 gibba013 bash[29418]: cluster 2021-03-10T17:30:03.984979+0000 mgr.gibba020.yqfnwy (mgr.34427) 11444 : cluster [DBG] pgmap v6519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:04.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:04 gibba013 bash[30381]: cluster 2021-03-10T17:30:03.984979+0000 mgr.gibba020.yqfnwy (mgr.34427) 11444 : cluster [DBG] pgmap v6519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:04.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:04 gibba020 bash[25448]: cluster 2021-03-10T17:30:03.984979+0000 mgr.gibba020.yqfnwy (mgr.34427) 11444 : cluster [DBG] pgmap v6519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:06.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:06 gibba013 bash[29418]: cluster 2021-03-10T17:30:05.986543+0000 mgr.gibba020.yqfnwy (mgr.34427) 11445 : cluster [DBG] pgmap v6520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:06.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:06 gibba013 bash[30381]: cluster 2021-03-10T17:30:05.986543+0000 mgr.gibba020.yqfnwy (mgr.34427) 11445 : cluster [DBG] pgmap v6520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:06.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:06 gibba020 bash[25448]: cluster 2021-03-10T17:30:05.986543+0000 mgr.gibba020.yqfnwy (mgr.34427) 11445 : cluster [DBG] pgmap v6520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:07 gibba013 bash[29418]: audit 2021-03-10T17:30:07.007624+0000 mon.a (mon.0) 4020 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:30:07.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:07 gibba013 bash[30381]: audit 2021-03-10T17:30:07.007624+0000 mon.a (mon.0) 4020 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:30:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:07 gibba020 bash[25448]: audit 2021-03-10T17:30:07.007624+0000 mon.a (mon.0) 4020 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:30:08.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:08 gibba013 bash[29418]: audit 2021-03-10T17:30:07.253181+0000 mon.a (mon.0) 4021 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:30:08.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:08 gibba013 bash[29418]: audit 2021-03-10T17:30:07.705407+0000 mon.a (mon.0) 4022 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:30:08.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:08 gibba013 bash[29418]: audit 2021-03-10T17:30:07.706206+0000 mon.a (mon.0) 4023 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:30:08.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:08 gibba013 bash[29418]: audit 2021-03-10T17:30:07.706934+0000 mon.a (mon.0) 4024 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:30:08.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:08 gibba013 bash[29418]: audit 2021-03-10T17:30:07.707617+0000 mon.a (mon.0) 4025 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:30:08.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:08 gibba013 bash[29418]: cluster 2021-03-10T17:30:07.988089+0000 mgr.gibba020.yqfnwy (mgr.34427) 11446 : cluster [DBG] pgmap v6521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:08.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:08 gibba013 bash[30381]: audit 2021-03-10T17:30:07.253181+0000 mon.a (mon.0) 4021 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:30:08.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:08 gibba013 bash[30381]: audit 2021-03-10T17:30:07.705407+0000 mon.a (mon.0) 4022 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:30:08.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:08 gibba013 bash[30381]: audit 2021-03-10T17:30:07.706206+0000 mon.a (mon.0) 4023 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:30:08.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:08 gibba013 bash[30381]: audit 2021-03-10T17:30:07.706934+0000 mon.a (mon.0) 4024 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:30:08.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:08 gibba013 bash[30381]: audit 2021-03-10T17:30:07.707617+0000 mon.a (mon.0) 4025 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:30:08.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:08 gibba013 bash[30381]: cluster 2021-03-10T17:30:07.988089+0000 mgr.gibba020.yqfnwy (mgr.34427) 11446 : cluster [DBG] pgmap v6521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:08.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:08 gibba020 bash[25448]: audit 2021-03-10T17:30:07.253181+0000 mon.a (mon.0) 4021 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:30:08.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:08 gibba020 bash[25448]: audit 2021-03-10T17:30:07.705407+0000 mon.a (mon.0) 4022 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T17:30:08.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:08 gibba020 bash[25448]: audit 2021-03-10T17:30:07.706206+0000 mon.a (mon.0) 4023 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:30:08.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:08 gibba020 bash[25448]: audit 2021-03-10T17:30:07.706934+0000 mon.a (mon.0) 4024 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:30:08.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:08 gibba020 bash[25448]: audit 2021-03-10T17:30:07.707617+0000 mon.a (mon.0) 4025 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:30:08.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:08 gibba020 bash[25448]: cluster 2021-03-10T17:30:07.988089+0000 mgr.gibba020.yqfnwy (mgr.34427) 11446 : cluster [DBG] pgmap v6521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:10.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:10 gibba013 bash[29418]: cluster 2021-03-10T17:30:09.989883+0000 mgr.gibba020.yqfnwy (mgr.34427) 11447 : cluster [DBG] pgmap v6522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:10.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:10 gibba013 bash[30381]: cluster 2021-03-10T17:30:09.989883+0000 mgr.gibba020.yqfnwy (mgr.34427) 11447 : cluster [DBG] pgmap v6522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:10.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:10 gibba020 bash[25448]: cluster 2021-03-10T17:30:09.989883+0000 mgr.gibba020.yqfnwy (mgr.34427) 11447 : cluster [DBG] pgmap v6522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:12.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:12 gibba013 bash[29418]: cephadm 2021-03-10T17:30:11.819936+0000 mgr.gibba020.yqfnwy (mgr.34427) 11448 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:30:12.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:12 gibba013 bash[29418]: cluster 2021-03-10T17:30:11.991016+0000 mgr.gibba020.yqfnwy (mgr.34427) 11449 : cluster [DBG] pgmap v6523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:12.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:12 gibba013 bash[30381]: cephadm 2021-03-10T17:30:11.819936+0000 mgr.gibba020.yqfnwy (mgr.34427) 11448 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:30:12.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:12 gibba013 bash[30381]: cluster 2021-03-10T17:30:11.991016+0000 mgr.gibba020.yqfnwy (mgr.34427) 11449 : cluster [DBG] pgmap v6523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:12.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:12 gibba020 bash[25448]: cephadm 2021-03-10T17:30:11.819936+0000 mgr.gibba020.yqfnwy (mgr.34427) 11448 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:30:12.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:12 gibba020 bash[25448]: cluster 2021-03-10T17:30:11.991016+0000 mgr.gibba020.yqfnwy (mgr.34427) 11449 : cluster [DBG] pgmap v6523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:14.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:14 gibba013 bash[29418]: cluster 2021-03-10T17:30:13.992742+0000 mgr.gibba020.yqfnwy (mgr.34427) 11450 : cluster [DBG] pgmap v6524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:14.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:14 gibba013 bash[30381]: cluster 2021-03-10T17:30:13.992742+0000 mgr.gibba020.yqfnwy (mgr.34427) 11450 : cluster [DBG] pgmap v6524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:14.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:14 gibba020 bash[25448]: cluster 2021-03-10T17:30:13.992742+0000 mgr.gibba020.yqfnwy (mgr.34427) 11450 : cluster [DBG] pgmap v6524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:16.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:16 gibba013 bash[29418]: cluster 2021-03-10T17:30:15.994569+0000 mgr.gibba020.yqfnwy (mgr.34427) 11451 : cluster [DBG] pgmap v6525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:16.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:16 gibba013 bash[30381]: cluster 2021-03-10T17:30:15.994569+0000 mgr.gibba020.yqfnwy (mgr.34427) 11451 : cluster [DBG] pgmap v6525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:16.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:16 gibba020 bash[25448]: cluster 2021-03-10T17:30:15.994569+0000 mgr.gibba020.yqfnwy (mgr.34427) 11451 : cluster [DBG] pgmap v6525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:18.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:18 gibba013 bash[29418]: cluster 2021-03-10T17:30:17.995803+0000 mgr.gibba020.yqfnwy (mgr.34427) 11452 : cluster [DBG] pgmap v6526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:18.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:18 gibba013 bash[30381]: cluster 2021-03-10T17:30:17.995803+0000 mgr.gibba020.yqfnwy (mgr.34427) 11452 : cluster [DBG] pgmap v6526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:18.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:18 gibba020 bash[25448]: cluster 2021-03-10T17:30:17.995803+0000 mgr.gibba020.yqfnwy (mgr.34427) 11452 : cluster [DBG] pgmap v6526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:20.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:20 gibba013 bash[29418]: cluster 2021-03-10T17:30:19.997830+0000 mgr.gibba020.yqfnwy (mgr.34427) 11453 : cluster [DBG] pgmap v6527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:20.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:20 gibba013 bash[30381]: cluster 2021-03-10T17:30:19.997830+0000 mgr.gibba020.yqfnwy (mgr.34427) 11453 : cluster [DBG] pgmap v6527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:20.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:20 gibba020 bash[25448]: cluster 2021-03-10T17:30:19.997830+0000 mgr.gibba020.yqfnwy (mgr.34427) 11453 : cluster [DBG] pgmap v6527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:22.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:22 gibba013 bash[29418]: cluster 2021-03-10T17:30:21.999077+0000 mgr.gibba020.yqfnwy (mgr.34427) 11454 : cluster [DBG] pgmap v6528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:22.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:22 gibba013 bash[30381]: cluster 2021-03-10T17:30:21.999077+0000 mgr.gibba020.yqfnwy (mgr.34427) 11454 : cluster [DBG] pgmap v6528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:22.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:22 gibba020 bash[25448]: cluster 2021-03-10T17:30:21.999077+0000 mgr.gibba020.yqfnwy (mgr.34427) 11454 : cluster [DBG] pgmap v6528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:24.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:24 gibba013 bash[29418]: cluster 2021-03-10T17:30:24.000464+0000 mgr.gibba020.yqfnwy (mgr.34427) 11455 : cluster [DBG] pgmap v6529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:24.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:24 gibba013 bash[30381]: cluster 2021-03-10T17:30:24.000464+0000 mgr.gibba020.yqfnwy (mgr.34427) 11455 : cluster [DBG] pgmap v6529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:24.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:24 gibba020 bash[25448]: cluster 2021-03-10T17:30:24.000464+0000 mgr.gibba020.yqfnwy (mgr.34427) 11455 : cluster [DBG] pgmap v6529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:26.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:26 gibba013 bash[29418]: cluster 2021-03-10T17:30:26.002185+0000 mgr.gibba020.yqfnwy (mgr.34427) 11456 : cluster [DBG] pgmap v6530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:26.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:26 gibba013 bash[30381]: cluster 2021-03-10T17:30:26.002185+0000 mgr.gibba020.yqfnwy (mgr.34427) 11456 : cluster [DBG] pgmap v6530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:26.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:26 gibba020 bash[25448]: cluster 2021-03-10T17:30:26.002185+0000 mgr.gibba020.yqfnwy (mgr.34427) 11456 : cluster [DBG] pgmap v6530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:27.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:27 gibba013 bash[29418]: cephadm 2021-03-10T17:30:26.822255+0000 mgr.gibba020.yqfnwy (mgr.34427) 11457 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:30:27.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:27 gibba013 bash[30381]: cephadm 2021-03-10T17:30:26.822255+0000 mgr.gibba020.yqfnwy (mgr.34427) 11457 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:30:27.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:27 gibba020 bash[25448]: cephadm 2021-03-10T17:30:26.822255+0000 mgr.gibba020.yqfnwy (mgr.34427) 11457 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:30:28.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:28 gibba013 bash[29418]: cluster 2021-03-10T17:30:28.003558+0000 mgr.gibba020.yqfnwy (mgr.34427) 11458 : cluster [DBG] pgmap v6531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:28.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:28 gibba013 bash[30381]: cluster 2021-03-10T17:30:28.003558+0000 mgr.gibba020.yqfnwy (mgr.34427) 11458 : cluster [DBG] pgmap v6531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:28.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:28 gibba020 bash[25448]: cluster 2021-03-10T17:30:28.003558+0000 mgr.gibba020.yqfnwy (mgr.34427) 11458 : cluster [DBG] pgmap v6531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:29.963 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:30:30.195 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:30:30.196 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 8m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:30:30.196 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 7m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:30:30.196 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:30:30.196 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:30:30.196 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:30:30.197 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:30:30.197 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:30:30.197 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:30:30.197 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:30:30.198 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:30:30.198 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:30:30.198 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:30:30.198 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:30:30.199 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:30:30.199 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:30:30.199 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:30:30.199 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:30:30.199 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:30:30.200 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 7m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:30:30.200 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 7m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:30:30.380 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:30 gibba013 bash[29418]: audit 2021-03-10T17:30:29.952518+0000 mgr.gibba020.yqfnwy (mgr.34427) 11459 : audit [DBG] from='client.61717 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:30:30.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:30 gibba013 bash[29418]: cluster 2021-03-10T17:30:30.005311+0000 mgr.gibba020.yqfnwy (mgr.34427) 11460 : cluster [DBG] pgmap v6532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:30.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:30 gibba013 bash[30381]: audit 2021-03-10T17:30:29.952518+0000 mgr.gibba020.yqfnwy (mgr.34427) 11459 : audit [DBG] from='client.61717 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:30:30.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:30 gibba013 bash[30381]: cluster 2021-03-10T17:30:30.005311+0000 mgr.gibba020.yqfnwy (mgr.34427) 11460 : cluster [DBG] pgmap v6532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:30.440 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:30:30.440 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:30:30.441 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:30:30.441 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:30:30.441 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:30:30.441 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:30:30.442 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:30:30.442 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:30:30.442 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:30:30.442 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:30:30.443 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:30:30.443 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:30:30.443 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:30:30.443 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:30:30.443 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:30:30.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:30 gibba020 bash[25448]: audit 2021-03-10T17:30:29.952518+0000 mgr.gibba020.yqfnwy (mgr.34427) 11459 : audit [DBG] from='client.61717 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:30:30.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:30 gibba020 bash[25448]: cluster 2021-03-10T17:30:30.005311+0000 mgr.gibba020.yqfnwy (mgr.34427) 11460 : cluster [DBG] pgmap v6532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:31.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:31 gibba013 bash[29418]: audit 2021-03-10T17:30:30.180834+0000 mgr.gibba020.yqfnwy (mgr.34427) 11461 : audit [DBG] from='client.51744 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:30:31.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:31 gibba013 bash[29418]: audit 2021-03-10T17:30:30.438355+0000 mon.c (mon.1) 175 : audit [DBG] from='client.? 172.21.2.113:0/1817672360' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:31.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:31 gibba013 bash[30381]: audit 2021-03-10T17:30:30.180834+0000 mgr.gibba020.yqfnwy (mgr.34427) 11461 : audit [DBG] from='client.51744 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:30:31.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:31 gibba013 bash[30381]: audit 2021-03-10T17:30:30.438355+0000 mon.c (mon.1) 175 : audit [DBG] from='client.? 172.21.2.113:0/1817672360' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:31.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:31 gibba020 bash[25448]: audit 2021-03-10T17:30:30.180834+0000 mgr.gibba020.yqfnwy (mgr.34427) 11461 : audit [DBG] from='client.51744 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:30:31.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:31 gibba020 bash[25448]: audit 2021-03-10T17:30:30.438355+0000 mon.c (mon.1) 175 : audit [DBG] from='client.? 172.21.2.113:0/1817672360' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:32.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:32 gibba013 bash[29418]: cluster 2021-03-10T17:30:32.006722+0000 mgr.gibba020.yqfnwy (mgr.34427) 11462 : cluster [DBG] pgmap v6533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:32.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:32 gibba013 bash[30381]: cluster 2021-03-10T17:30:32.006722+0000 mgr.gibba020.yqfnwy (mgr.34427) 11462 : cluster [DBG] pgmap v6533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:32.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:32 gibba020 bash[25448]: cluster 2021-03-10T17:30:32.006722+0000 mgr.gibba020.yqfnwy (mgr.34427) 11462 : cluster [DBG] pgmap v6533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:34.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:34 gibba013 bash[29418]: cluster 2021-03-10T17:30:34.008305+0000 mgr.gibba020.yqfnwy (mgr.34427) 11463 : cluster [DBG] pgmap v6534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:34.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:34 gibba013 bash[30381]: cluster 2021-03-10T17:30:34.008305+0000 mgr.gibba020.yqfnwy (mgr.34427) 11463 : cluster [DBG] pgmap v6534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:34.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:34 gibba020 bash[25448]: cluster 2021-03-10T17:30:34.008305+0000 mgr.gibba020.yqfnwy (mgr.34427) 11463 : cluster [DBG] pgmap v6534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:36.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:36 gibba013 bash[29418]: cluster 2021-03-10T17:30:36.010138+0000 mgr.gibba020.yqfnwy (mgr.34427) 11464 : cluster [DBG] pgmap v6535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:36.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:36 gibba013 bash[30381]: cluster 2021-03-10T17:30:36.010138+0000 mgr.gibba020.yqfnwy (mgr.34427) 11464 : cluster [DBG] pgmap v6535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:36.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:36 gibba020 bash[25448]: cluster 2021-03-10T17:30:36.010138+0000 mgr.gibba020.yqfnwy (mgr.34427) 11464 : cluster [DBG] pgmap v6535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:38.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:38 gibba013 bash[29418]: cluster 2021-03-10T17:30:38.011469+0000 mgr.gibba020.yqfnwy (mgr.34427) 11465 : cluster [DBG] pgmap v6536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:38.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:38 gibba013 bash[30381]: cluster 2021-03-10T17:30:38.011469+0000 mgr.gibba020.yqfnwy (mgr.34427) 11465 : cluster [DBG] pgmap v6536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:38.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:38 gibba020 bash[25448]: cluster 2021-03-10T17:30:38.011469+0000 mgr.gibba020.yqfnwy (mgr.34427) 11465 : cluster [DBG] pgmap v6536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:40.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:40 gibba013 bash[29418]: cluster 2021-03-10T17:30:40.012368+0000 mgr.gibba020.yqfnwy (mgr.34427) 11466 : cluster [DBG] pgmap v6537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:40.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:40 gibba013 bash[30381]: cluster 2021-03-10T17:30:40.012368+0000 mgr.gibba020.yqfnwy (mgr.34427) 11466 : cluster [DBG] pgmap v6537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:40.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:40 gibba020 bash[25448]: cluster 2021-03-10T17:30:40.012368+0000 mgr.gibba020.yqfnwy (mgr.34427) 11466 : cluster [DBG] pgmap v6537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:42.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:42 gibba013 bash[29418]: cephadm 2021-03-10T17:30:41.838290+0000 mgr.gibba020.yqfnwy (mgr.34427) 11467 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:30:42.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:42 gibba013 bash[29418]: cluster 2021-03-10T17:30:42.013560+0000 mgr.gibba020.yqfnwy (mgr.34427) 11468 : cluster [DBG] pgmap v6538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:42.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:42 gibba013 bash[30381]: cephadm 2021-03-10T17:30:41.838290+0000 mgr.gibba020.yqfnwy (mgr.34427) 11467 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:30:42.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:42 gibba013 bash[30381]: cluster 2021-03-10T17:30:42.013560+0000 mgr.gibba020.yqfnwy (mgr.34427) 11468 : cluster [DBG] pgmap v6538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:42.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:42 gibba020 bash[25448]: cephadm 2021-03-10T17:30:41.838290+0000 mgr.gibba020.yqfnwy (mgr.34427) 11467 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:30:42.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:42 gibba020 bash[25448]: cluster 2021-03-10T17:30:42.013560+0000 mgr.gibba020.yqfnwy (mgr.34427) 11468 : cluster [DBG] pgmap v6538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:44.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:44 gibba013 bash[29418]: cluster 2021-03-10T17:30:44.015260+0000 mgr.gibba020.yqfnwy (mgr.34427) 11469 : cluster [DBG] pgmap v6539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:44.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:44 gibba013 bash[30381]: cluster 2021-03-10T17:30:44.015260+0000 mgr.gibba020.yqfnwy (mgr.34427) 11469 : cluster [DBG] pgmap v6539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:44.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:44 gibba020 bash[25448]: cluster 2021-03-10T17:30:44.015260+0000 mgr.gibba020.yqfnwy (mgr.34427) 11469 : cluster [DBG] pgmap v6539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:46.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:46 gibba013 bash[29418]: cluster 2021-03-10T17:30:46.017225+0000 mgr.gibba020.yqfnwy (mgr.34427) 11470 : cluster [DBG] pgmap v6540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:46.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:46 gibba013 bash[30381]: cluster 2021-03-10T17:30:46.017225+0000 mgr.gibba020.yqfnwy (mgr.34427) 11470 : cluster [DBG] pgmap v6540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:46.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:46 gibba020 bash[25448]: cluster 2021-03-10T17:30:46.017225+0000 mgr.gibba020.yqfnwy (mgr.34427) 11470 : cluster [DBG] pgmap v6540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:48.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:48 gibba013 bash[29418]: cluster 2021-03-10T17:30:48.018583+0000 mgr.gibba020.yqfnwy (mgr.34427) 11471 : cluster [DBG] pgmap v6541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:48.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:48 gibba013 bash[30381]: cluster 2021-03-10T17:30:48.018583+0000 mgr.gibba020.yqfnwy (mgr.34427) 11471 : cluster [DBG] pgmap v6541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:48.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:48 gibba020 bash[25448]: cluster 2021-03-10T17:30:48.018583+0000 mgr.gibba020.yqfnwy (mgr.34427) 11471 : cluster [DBG] pgmap v6541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:50.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:50 gibba013 bash[29418]: cluster 2021-03-10T17:30:50.019427+0000 mgr.gibba020.yqfnwy (mgr.34427) 11472 : cluster [DBG] pgmap v6542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:50.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:50 gibba013 bash[30381]: cluster 2021-03-10T17:30:50.019427+0000 mgr.gibba020.yqfnwy (mgr.34427) 11472 : cluster [DBG] pgmap v6542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:50.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:50 gibba020 bash[25448]: cluster 2021-03-10T17:30:50.019427+0000 mgr.gibba020.yqfnwy (mgr.34427) 11472 : cluster [DBG] pgmap v6542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:52.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:52 gibba020 bash[25448]: cluster 2021-03-10T17:30:52.020783+0000 mgr.gibba020.yqfnwy (mgr.34427) 11473 : cluster [DBG] pgmap v6543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:52.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:52 gibba013 bash[29418]: cluster 2021-03-10T17:30:52.020783+0000 mgr.gibba020.yqfnwy (mgr.34427) 11473 : cluster [DBG] pgmap v6543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:52.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:52 gibba013 bash[30381]: cluster 2021-03-10T17:30:52.020783+0000 mgr.gibba020.yqfnwy (mgr.34427) 11473 : cluster [DBG] pgmap v6543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:54.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:54 gibba013 bash[29418]: cluster 2021-03-10T17:30:54.022492+0000 mgr.gibba020.yqfnwy (mgr.34427) 11474 : cluster [DBG] pgmap v6544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:54.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:54 gibba013 bash[30381]: cluster 2021-03-10T17:30:54.022492+0000 mgr.gibba020.yqfnwy (mgr.34427) 11474 : cluster [DBG] pgmap v6544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:54.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:54 gibba020 bash[25448]: cluster 2021-03-10T17:30:54.022492+0000 mgr.gibba020.yqfnwy (mgr.34427) 11474 : cluster [DBG] pgmap v6544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:56.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:56 gibba013 bash[29418]: cluster 2021-03-10T17:30:56.024495+0000 mgr.gibba020.yqfnwy (mgr.34427) 11475 : cluster [DBG] pgmap v6545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:56.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:56 gibba013 bash[30381]: cluster 2021-03-10T17:30:56.024495+0000 mgr.gibba020.yqfnwy (mgr.34427) 11475 : cluster [DBG] pgmap v6545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:56.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:56 gibba020 bash[25448]: cluster 2021-03-10T17:30:56.024495+0000 mgr.gibba020.yqfnwy (mgr.34427) 11475 : cluster [DBG] pgmap v6545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:57.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:57 gibba013 bash[29418]: audit 2021-03-10T17:30:56.854222+0000 mon.a (mon.0) 4026 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:30:57.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:57 gibba013 bash[29418]: cephadm 2021-03-10T17:30:56.859090+0000 mgr.gibba020.yqfnwy (mgr.34427) 11476 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:30:57.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:57 gibba013 bash[29418]: cephadm 2021-03-10T17:30:56.861035+0000 mgr.gibba020.yqfnwy (mgr.34427) 11477 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:30:57.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:57 gibba013 bash[29418]: audit 2021-03-10T17:30:57.082915+0000 mon.a (mon.0) 4027 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:30:57.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:57 gibba013 bash[29418]: audit 2021-03-10T17:30:57.086200+0000 mon.a (mon.0) 4028 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:30:57.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:57 gibba013 bash[29418]: audit 2021-03-10T17:30:57.087834+0000 mon.a (mon.0) 4029 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:57.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:57 gibba013 bash[29418]: audit 2021-03-10T17:30:57.089020+0000 mon.a (mon.0) 4030 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:57.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:57 gibba013 bash[29418]: audit 2021-03-10T17:30:57.090026+0000 mon.a (mon.0) 4031 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:57.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:57 gibba013 bash[29418]: audit 2021-03-10T17:30:57.092472+0000 mon.a (mon.0) 4032 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:57.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:57 gibba013 bash[29418]: audit 2021-03-10T17:30:57.094068+0000 mon.a (mon.0) 4033 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:57.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:57 gibba013 bash[30381]: audit 2021-03-10T17:30:56.854222+0000 mon.a (mon.0) 4026 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:30:57.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:57 gibba013 bash[30381]: cephadm 2021-03-10T17:30:56.859090+0000 mgr.gibba020.yqfnwy (mgr.34427) 11476 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:30:57.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:57 gibba013 bash[30381]: cephadm 2021-03-10T17:30:56.861035+0000 mgr.gibba020.yqfnwy (mgr.34427) 11477 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:30:57.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:57 gibba013 bash[30381]: audit 2021-03-10T17:30:57.082915+0000 mon.a (mon.0) 4027 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:30:57.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:57 gibba013 bash[30381]: audit 2021-03-10T17:30:57.086200+0000 mon.a (mon.0) 4028 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:30:57.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:57 gibba013 bash[30381]: audit 2021-03-10T17:30:57.087834+0000 mon.a (mon.0) 4029 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:57.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:57 gibba013 bash[30381]: audit 2021-03-10T17:30:57.089020+0000 mon.a (mon.0) 4030 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:57.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:57 gibba013 bash[30381]: audit 2021-03-10T17:30:57.090026+0000 mon.a (mon.0) 4031 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:57.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:57 gibba013 bash[30381]: audit 2021-03-10T17:30:57.092472+0000 mon.a (mon.0) 4032 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:57.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:57 gibba013 bash[30381]: audit 2021-03-10T17:30:57.094068+0000 mon.a (mon.0) 4033 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:57.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:57 gibba020 bash[25448]: audit 2021-03-10T17:30:56.854222+0000 mon.a (mon.0) 4026 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:30:57.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:57 gibba020 bash[25448]: cephadm 2021-03-10T17:30:56.859090+0000 mgr.gibba020.yqfnwy (mgr.34427) 11476 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:30:57.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:57 gibba020 bash[25448]: cephadm 2021-03-10T17:30:56.861035+0000 mgr.gibba020.yqfnwy (mgr.34427) 11477 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:30:57.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:57 gibba020 bash[25448]: audit 2021-03-10T17:30:57.082915+0000 mon.a (mon.0) 4027 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:30:57.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:57 gibba020 bash[25448]: audit 2021-03-10T17:30:57.086200+0000 mon.a (mon.0) 4028 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:30:57.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:57 gibba020 bash[25448]: audit 2021-03-10T17:30:57.087834+0000 mon.a (mon.0) 4029 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:57.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:57 gibba020 bash[25448]: audit 2021-03-10T17:30:57.089020+0000 mon.a (mon.0) 4030 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:57.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:57 gibba020 bash[25448]: audit 2021-03-10T17:30:57.090026+0000 mon.a (mon.0) 4031 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:57.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:57 gibba020 bash[25448]: audit 2021-03-10T17:30:57.092472+0000 mon.a (mon.0) 4032 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:57.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:57 gibba020 bash[25448]: audit 2021-03-10T17:30:57.094068+0000 mon.a (mon.0) 4033 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:30:58.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:58 gibba020 bash[25448]: cephadm 2021-03-10T17:30:57.084862+0000 mgr.gibba020.yqfnwy (mgr.34427) 11478 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:30:58.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:58 gibba020 bash[25448]: cephadm 2021-03-10T17:30:57.086869+0000 mgr.gibba020.yqfnwy (mgr.34427) 11479 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:30:58.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:58 gibba020 bash[25448]: cephadm 2021-03-10T17:30:57.088179+0000 mgr.gibba020.yqfnwy (mgr.34427) 11480 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:30:58.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:58 gibba020 bash[25448]: cephadm 2021-03-10T17:30:57.088218+0000 mgr.gibba020.yqfnwy (mgr.34427) 11481 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:30:58.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:58 gibba020 bash[25448]: cephadm 2021-03-10T17:30:57.089263+0000 mgr.gibba020.yqfnwy (mgr.34427) 11482 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:30:58.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:58 gibba020 bash[25448]: cephadm 2021-03-10T17:30:57.089301+0000 mgr.gibba020.yqfnwy (mgr.34427) 11483 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:30:58.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:58 gibba020 bash[25448]: cephadm 2021-03-10T17:30:57.090273+0000 mgr.gibba020.yqfnwy (mgr.34427) 11484 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:30:58.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:58 gibba020 bash[25448]: cephadm 2021-03-10T17:30:57.091569+0000 mgr.gibba020.yqfnwy (mgr.34427) 11485 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:30:58.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:58 gibba020 bash[25448]: cephadm 2021-03-10T17:30:57.091606+0000 mgr.gibba020.yqfnwy (mgr.34427) 11486 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:30:58.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:58 gibba020 bash[25448]: cephadm 2021-03-10T17:30:57.092796+0000 mgr.gibba020.yqfnwy (mgr.34427) 11487 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:30:58.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:58 gibba020 bash[25448]: cephadm 2021-03-10T17:30:57.093116+0000 mgr.gibba020.yqfnwy (mgr.34427) 11488 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:30:58.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:58 gibba020 bash[25448]: cephadm 2021-03-10T17:30:57.094505+0000 mgr.gibba020.yqfnwy (mgr.34427) 11489 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:30:58.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:58 gibba020 bash[25448]: cephadm 2021-03-10T17:30:57.094544+0000 mgr.gibba020.yqfnwy (mgr.34427) 11490 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:30:58.456 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:58 gibba020 bash[25448]: cephadm 2021-03-10T17:30:57.094648+0000 mgr.gibba020.yqfnwy (mgr.34427) 11491 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:30:58.456 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:30:58 gibba020 bash[25448]: cluster 2021-03-10T17:30:58.025892+0000 mgr.gibba020.yqfnwy (mgr.34427) 11492 : cluster [DBG] pgmap v6546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:58.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:58 gibba013 bash[29418]: cephadm 2021-03-10T17:30:57.084862+0000 mgr.gibba020.yqfnwy (mgr.34427) 11478 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:30:58.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:58 gibba013 bash[29418]: cephadm 2021-03-10T17:30:57.086869+0000 mgr.gibba020.yqfnwy (mgr.34427) 11479 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:30:58.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:58 gibba013 bash[29418]: cephadm 2021-03-10T17:30:57.088179+0000 mgr.gibba020.yqfnwy (mgr.34427) 11480 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:30:58.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:58 gibba013 bash[29418]: cephadm 2021-03-10T17:30:57.088218+0000 mgr.gibba020.yqfnwy (mgr.34427) 11481 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:30:58.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:58 gibba013 bash[29418]: cephadm 2021-03-10T17:30:57.089263+0000 mgr.gibba020.yqfnwy (mgr.34427) 11482 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:30:58.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:58 gibba013 bash[29418]: cephadm 2021-03-10T17:30:57.089301+0000 mgr.gibba020.yqfnwy (mgr.34427) 11483 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:30:58.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:58 gibba013 bash[29418]: cephadm 2021-03-10T17:30:57.090273+0000 mgr.gibba020.yqfnwy (mgr.34427) 11484 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:30:58.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:58 gibba013 bash[29418]: cephadm 2021-03-10T17:30:57.091569+0000 mgr.gibba020.yqfnwy (mgr.34427) 11485 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:30:58.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:58 gibba013 bash[29418]: cephadm 2021-03-10T17:30:57.091606+0000 mgr.gibba020.yqfnwy (mgr.34427) 11486 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:30:58.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:58 gibba013 bash[29418]: cephadm 2021-03-10T17:30:57.092796+0000 mgr.gibba020.yqfnwy (mgr.34427) 11487 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:30:58.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:58 gibba013 bash[29418]: cephadm 2021-03-10T17:30:57.093116+0000 mgr.gibba020.yqfnwy (mgr.34427) 11488 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:30:58.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:58 gibba013 bash[29418]: cephadm 2021-03-10T17:30:57.094505+0000 mgr.gibba020.yqfnwy (mgr.34427) 11489 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:30:58.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:58 gibba013 bash[29418]: cephadm 2021-03-10T17:30:57.094544+0000 mgr.gibba020.yqfnwy (mgr.34427) 11490 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:30:58.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:58 gibba013 bash[29418]: cephadm 2021-03-10T17:30:57.094648+0000 mgr.gibba020.yqfnwy (mgr.34427) 11491 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:30:58.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:30:58 gibba013 bash[29418]: cluster 2021-03-10T17:30:58.025892+0000 mgr.gibba020.yqfnwy (mgr.34427) 11492 : cluster [DBG] pgmap v6546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:30:58.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:58 gibba013 bash[30381]: cephadm 2021-03-10T17:30:57.084862+0000 mgr.gibba020.yqfnwy (mgr.34427) 11478 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:30:58.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:58 gibba013 bash[30381]: cephadm 2021-03-10T17:30:57.086869+0000 mgr.gibba020.yqfnwy (mgr.34427) 11479 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:30:58.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:58 gibba013 bash[30381]: cephadm 2021-03-10T17:30:57.088179+0000 mgr.gibba020.yqfnwy (mgr.34427) 11480 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:30:58.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:58 gibba013 bash[30381]: cephadm 2021-03-10T17:30:57.088218+0000 mgr.gibba020.yqfnwy (mgr.34427) 11481 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:30:58.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:58 gibba013 bash[30381]: cephadm 2021-03-10T17:30:57.089263+0000 mgr.gibba020.yqfnwy (mgr.34427) 11482 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:30:58.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:58 gibba013 bash[30381]: cephadm 2021-03-10T17:30:57.089301+0000 mgr.gibba020.yqfnwy (mgr.34427) 11483 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:30:58.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:58 gibba013 bash[30381]: cephadm 2021-03-10T17:30:57.090273+0000 mgr.gibba020.yqfnwy (mgr.34427) 11484 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:30:58.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:58 gibba013 bash[30381]: cephadm 2021-03-10T17:30:57.091569+0000 mgr.gibba020.yqfnwy (mgr.34427) 11485 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:30:58.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:58 gibba013 bash[30381]: cephadm 2021-03-10T17:30:57.091606+0000 mgr.gibba020.yqfnwy (mgr.34427) 11486 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:30:58.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:58 gibba013 bash[30381]: cephadm 2021-03-10T17:30:57.092796+0000 mgr.gibba020.yqfnwy (mgr.34427) 11487 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:30:58.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:58 gibba013 bash[30381]: cephadm 2021-03-10T17:30:57.093116+0000 mgr.gibba020.yqfnwy (mgr.34427) 11488 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:30:58.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:58 gibba013 bash[30381]: cephadm 2021-03-10T17:30:57.094505+0000 mgr.gibba020.yqfnwy (mgr.34427) 11489 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:30:58.644 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:58 gibba013 bash[30381]: cephadm 2021-03-10T17:30:57.094544+0000 mgr.gibba020.yqfnwy (mgr.34427) 11490 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:30:58.644 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:58 gibba013 bash[30381]: cephadm 2021-03-10T17:30:57.094648+0000 mgr.gibba020.yqfnwy (mgr.34427) 11491 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:30:58.644 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:30:58 gibba013 bash[30381]: cluster 2021-03-10T17:30:58.025892+0000 mgr.gibba020.yqfnwy (mgr.34427) 11492 : cluster [DBG] pgmap v6546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:00.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:00 gibba013 bash[29418]: cluster 2021-03-10T17:31:00.026460+0000 mgr.gibba020.yqfnwy (mgr.34427) 11493 : cluster [DBG] pgmap v6547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:00.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:00 gibba013 bash[30381]: cluster 2021-03-10T17:31:00.026460+0000 mgr.gibba020.yqfnwy (mgr.34427) 11493 : cluster [DBG] pgmap v6547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:00.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:00 gibba020 bash[25448]: cluster 2021-03-10T17:31:00.026460+0000 mgr.gibba020.yqfnwy (mgr.34427) 11493 : cluster [DBG] pgmap v6547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:00.689 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:31:00.917 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:31:00.918 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 9m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:31:00.918 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 8m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:31:00.918 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:31:00.919 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:31:00.919 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:31:00.919 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:31:00.919 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:31:00.919 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:31:00.920 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:31:00.920 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:31:00.920 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:31:00.920 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:31:00.920 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:31:00.921 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:31:00.921 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:31:00.921 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:31:00.922 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:31:00.922 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:31:00.922 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 8m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:31:00.922 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 8m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:31:01.167 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:31:01.167 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:31:01.167 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:31:01.167 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:31:01.168 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:31:01.168 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:31:01.168 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:31:01.168 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:31:01.169 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:31:01.169 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:31:01.169 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:31:01.169 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:31:01.169 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:31:01.170 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:31:01.170 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:31:01.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:01 gibba013 bash[29418]: audit 2021-03-10T17:31:00.677673+0000 mgr.gibba020.yqfnwy (mgr.34427) 11494 : audit [DBG] from='client.51756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:31:01.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:01 gibba013 bash[29418]: audit 2021-03-10T17:31:00.902598+0000 mgr.gibba020.yqfnwy (mgr.34427) 11495 : audit [DBG] from='client.61741 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:31:01.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:01 gibba013 bash[30381]: audit 2021-03-10T17:31:00.677673+0000 mgr.gibba020.yqfnwy (mgr.34427) 11494 : audit [DBG] from='client.51756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:31:01.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:01 gibba013 bash[30381]: audit 2021-03-10T17:31:00.902598+0000 mgr.gibba020.yqfnwy (mgr.34427) 11495 : audit [DBG] from='client.61741 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:31:01.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:01 gibba020 bash[25448]: audit 2021-03-10T17:31:00.677673+0000 mgr.gibba020.yqfnwy (mgr.34427) 11494 : audit [DBG] from='client.51756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:31:01.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:01 gibba020 bash[25448]: audit 2021-03-10T17:31:00.902598+0000 mgr.gibba020.yqfnwy (mgr.34427) 11495 : audit [DBG] from='client.61741 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:31:02.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:02 gibba013 bash[29418]: audit 2021-03-10T17:31:01.164942+0000 mon.c (mon.1) 176 : audit [DBG] from='client.? 172.21.2.113:0/991564444' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:02.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:02 gibba013 bash[29418]: cluster 2021-03-10T17:31:02.027676+0000 mgr.gibba020.yqfnwy (mgr.34427) 11496 : cluster [DBG] pgmap v6548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:02.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:02 gibba013 bash[30381]: audit 2021-03-10T17:31:01.164942+0000 mon.c (mon.1) 176 : audit [DBG] from='client.? 172.21.2.113:0/991564444' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:02.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:02 gibba013 bash[30381]: cluster 2021-03-10T17:31:02.027676+0000 mgr.gibba020.yqfnwy (mgr.34427) 11496 : cluster [DBG] pgmap v6548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:02.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:02 gibba020 bash[25448]: audit 2021-03-10T17:31:01.164942+0000 mon.c (mon.1) 176 : audit [DBG] from='client.? 172.21.2.113:0/991564444' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:02.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:02 gibba020 bash[25448]: cluster 2021-03-10T17:31:02.027676+0000 mgr.gibba020.yqfnwy (mgr.34427) 11496 : cluster [DBG] pgmap v6548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:05.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:05 gibba013 bash[29418]: cluster 2021-03-10T17:31:04.029111+0000 mgr.gibba020.yqfnwy (mgr.34427) 11497 : cluster [DBG] pgmap v6549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:05.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:05 gibba013 bash[30381]: cluster 2021-03-10T17:31:04.029111+0000 mgr.gibba020.yqfnwy (mgr.34427) 11497 : cluster [DBG] pgmap v6549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:05.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:05 gibba020 bash[25448]: cluster 2021-03-10T17:31:04.029111+0000 mgr.gibba020.yqfnwy (mgr.34427) 11497 : cluster [DBG] pgmap v6549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:07 gibba013 bash[29418]: cluster 2021-03-10T17:31:06.030816+0000 mgr.gibba020.yqfnwy (mgr.34427) 11498 : cluster [DBG] pgmap v6550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:07.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:07 gibba013 bash[29418]: audit 2021-03-10T17:31:07.012660+0000 mon.a (mon.0) 4034 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:31:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:07 gibba013 bash[30381]: cluster 2021-03-10T17:31:06.030816+0000 mgr.gibba020.yqfnwy (mgr.34427) 11498 : cluster [DBG] pgmap v6550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:07.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:07 gibba013 bash[30381]: audit 2021-03-10T17:31:07.012660+0000 mon.a (mon.0) 4034 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:31:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:07 gibba020 bash[25448]: cluster 2021-03-10T17:31:06.030816+0000 mgr.gibba020.yqfnwy (mgr.34427) 11498 : cluster [DBG] pgmap v6550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:07.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:07 gibba020 bash[25448]: audit 2021-03-10T17:31:07.012660+0000 mon.a (mon.0) 4034 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:31:08.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:08 gibba020 bash[25448]: audit 2021-03-10T17:31:07.259873+0000 mon.a (mon.0) 4035 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:31:08.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:08 gibba020 bash[25448]: audit 2021-03-10T17:31:07.713344+0000 mon.a (mon.0) 4036 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T17:31:08.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:08 gibba020 bash[25448]: audit 2021-03-10T17:31:07.714097+0000 mon.a (mon.0) 4037 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:31:08.457 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:08 gibba020 bash[25448]: audit 2021-03-10T17:31:07.714821+0000 mon.a (mon.0) 4038 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:31:08.457 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:08 gibba020 bash[25448]: audit 2021-03-10T17:31:07.715474+0000 mon.a (mon.0) 4039 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:31:08.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:08 gibba013 bash[29418]: audit 2021-03-10T17:31:07.259873+0000 mon.a (mon.0) 4035 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:31:08.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:08 gibba013 bash[29418]: audit 2021-03-10T17:31:07.713344+0000 mon.a (mon.0) 4036 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T17:31:08.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:08 gibba013 bash[29418]: audit 2021-03-10T17:31:07.714097+0000 mon.a (mon.0) 4037 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:31:08.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:08 gibba013 bash[29418]: audit 2021-03-10T17:31:07.714821+0000 mon.a (mon.0) 4038 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:31:08.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:08 gibba013 bash[29418]: audit 2021-03-10T17:31:07.715474+0000 mon.a (mon.0) 4039 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:31:08.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:08 gibba013 bash[30381]: audit 2021-03-10T17:31:07.259873+0000 mon.a (mon.0) 4035 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:31:08.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:08 gibba013 bash[30381]: audit 2021-03-10T17:31:07.713344+0000 mon.a (mon.0) 4036 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T17:31:08.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:08 gibba013 bash[30381]: audit 2021-03-10T17:31:07.714097+0000 mon.a (mon.0) 4037 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:31:08.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:08 gibba013 bash[30381]: audit 2021-03-10T17:31:07.714821+0000 mon.a (mon.0) 4038 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:31:08.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:08 gibba013 bash[30381]: audit 2021-03-10T17:31:07.715474+0000 mon.a (mon.0) 4039 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T17:31:09.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:09 gibba020 bash[25448]: cluster 2021-03-10T17:31:08.031888+0000 mgr.gibba020.yqfnwy (mgr.34427) 11499 : cluster [DBG] pgmap v6551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:09.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:09 gibba013 bash[29418]: cluster 2021-03-10T17:31:08.031888+0000 mgr.gibba020.yqfnwy (mgr.34427) 11499 : cluster [DBG] pgmap v6551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:09.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:09 gibba013 bash[30381]: cluster 2021-03-10T17:31:08.031888+0000 mgr.gibba020.yqfnwy (mgr.34427) 11499 : cluster [DBG] pgmap v6551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:11.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:11 gibba020 bash[25448]: cluster 2021-03-10T17:31:10.032482+0000 mgr.gibba020.yqfnwy (mgr.34427) 11500 : cluster [DBG] pgmap v6552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:11.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:11 gibba013 bash[29418]: cluster 2021-03-10T17:31:10.032482+0000 mgr.gibba020.yqfnwy (mgr.34427) 11500 : cluster [DBG] pgmap v6552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:11.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:11 gibba013 bash[30381]: cluster 2021-03-10T17:31:10.032482+0000 mgr.gibba020.yqfnwy (mgr.34427) 11500 : cluster [DBG] pgmap v6552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:13.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:13 gibba020 bash[25448]: cluster 2021-03-10T17:31:12.033489+0000 mgr.gibba020.yqfnwy (mgr.34427) 11501 : cluster [DBG] pgmap v6553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:13.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:13 gibba020 bash[25448]: cephadm 2021-03-10T17:31:12.110654+0000 mgr.gibba020.yqfnwy (mgr.34427) 11502 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:31:13.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:13 gibba013 bash[29418]: cluster 2021-03-10T17:31:12.033489+0000 mgr.gibba020.yqfnwy (mgr.34427) 11501 : cluster [DBG] pgmap v6553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:13.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:13 gibba013 bash[29418]: cephadm 2021-03-10T17:31:12.110654+0000 mgr.gibba020.yqfnwy (mgr.34427) 11502 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:31:13.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:13 gibba013 bash[30381]: cluster 2021-03-10T17:31:12.033489+0000 mgr.gibba020.yqfnwy (mgr.34427) 11501 : cluster [DBG] pgmap v6553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:13.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:13 gibba013 bash[30381]: cephadm 2021-03-10T17:31:12.110654+0000 mgr.gibba020.yqfnwy (mgr.34427) 11502 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:31:15.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:15 gibba020 bash[25448]: cluster 2021-03-10T17:31:14.035078+0000 mgr.gibba020.yqfnwy (mgr.34427) 11503 : cluster [DBG] pgmap v6554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:15.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:15 gibba013 bash[29418]: cluster 2021-03-10T17:31:14.035078+0000 mgr.gibba020.yqfnwy (mgr.34427) 11503 : cluster [DBG] pgmap v6554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:15.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:15 gibba013 bash[30381]: cluster 2021-03-10T17:31:14.035078+0000 mgr.gibba020.yqfnwy (mgr.34427) 11503 : cluster [DBG] pgmap v6554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:17.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:17 gibba020 bash[25448]: cluster 2021-03-10T17:31:16.036940+0000 mgr.gibba020.yqfnwy (mgr.34427) 11504 : cluster [DBG] pgmap v6555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:17.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:17 gibba013 bash[29418]: cluster 2021-03-10T17:31:16.036940+0000 mgr.gibba020.yqfnwy (mgr.34427) 11504 : cluster [DBG] pgmap v6555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:17.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:17 gibba013 bash[30381]: cluster 2021-03-10T17:31:16.036940+0000 mgr.gibba020.yqfnwy (mgr.34427) 11504 : cluster [DBG] pgmap v6555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:19.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:19 gibba020 bash[25448]: cluster 2021-03-10T17:31:18.038147+0000 mgr.gibba020.yqfnwy (mgr.34427) 11505 : cluster [DBG] pgmap v6556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:19.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:19 gibba013 bash[29418]: cluster 2021-03-10T17:31:18.038147+0000 mgr.gibba020.yqfnwy (mgr.34427) 11505 : cluster [DBG] pgmap v6556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:19.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:19 gibba013 bash[30381]: cluster 2021-03-10T17:31:18.038147+0000 mgr.gibba020.yqfnwy (mgr.34427) 11505 : cluster [DBG] pgmap v6556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:21.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:21 gibba020 bash[25448]: cluster 2021-03-10T17:31:20.039058+0000 mgr.gibba020.yqfnwy (mgr.34427) 11506 : cluster [DBG] pgmap v6557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:21.630 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:21 gibba013 bash[30381]: cluster 2021-03-10T17:31:20.039058+0000 mgr.gibba020.yqfnwy (mgr.34427) 11506 : cluster [DBG] pgmap v6557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:21.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:21 gibba013 bash[29418]: cluster 2021-03-10T17:31:20.039058+0000 mgr.gibba020.yqfnwy (mgr.34427) 11506 : cluster [DBG] pgmap v6557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:23.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:23 gibba013 bash[29418]: cluster 2021-03-10T17:31:22.040351+0000 mgr.gibba020.yqfnwy (mgr.34427) 11507 : cluster [DBG] pgmap v6558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:23.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:23 gibba013 bash[30381]: cluster 2021-03-10T17:31:22.040351+0000 mgr.gibba020.yqfnwy (mgr.34427) 11507 : cluster [DBG] pgmap v6558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:23.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:23 gibba020 bash[25448]: cluster 2021-03-10T17:31:22.040351+0000 mgr.gibba020.yqfnwy (mgr.34427) 11507 : cluster [DBG] pgmap v6558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:25.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:25 gibba013 bash[29418]: cluster 2021-03-10T17:31:24.041963+0000 mgr.gibba020.yqfnwy (mgr.34427) 11508 : cluster [DBG] pgmap v6559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:25.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:25 gibba013 bash[30381]: cluster 2021-03-10T17:31:24.041963+0000 mgr.gibba020.yqfnwy (mgr.34427) 11508 : cluster [DBG] pgmap v6559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:25.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:25 gibba020 bash[25448]: cluster 2021-03-10T17:31:24.041963+0000 mgr.gibba020.yqfnwy (mgr.34427) 11508 : cluster [DBG] pgmap v6559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:27.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:27 gibba020 bash[25448]: cluster 2021-03-10T17:31:26.043836+0000 mgr.gibba020.yqfnwy (mgr.34427) 11509 : cluster [DBG] pgmap v6560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:27.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:27 gibba013 bash[29418]: cluster 2021-03-10T17:31:26.043836+0000 mgr.gibba020.yqfnwy (mgr.34427) 11509 : cluster [DBG] pgmap v6560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:27.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:27 gibba013 bash[30381]: cluster 2021-03-10T17:31:26.043836+0000 mgr.gibba020.yqfnwy (mgr.34427) 11509 : cluster [DBG] pgmap v6560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:28.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:28 gibba013 bash[29418]: cephadm 2021-03-10T17:31:27.126483+0000 mgr.gibba020.yqfnwy (mgr.34427) 11510 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:31:28.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:28 gibba013 bash[30381]: cephadm 2021-03-10T17:31:27.126483+0000 mgr.gibba020.yqfnwy (mgr.34427) 11510 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:31:28.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:28 gibba020 bash[25448]: cephadm 2021-03-10T17:31:27.126483+0000 mgr.gibba020.yqfnwy (mgr.34427) 11510 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:31:29.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:29 gibba013 bash[29418]: cluster 2021-03-10T17:31:28.044344+0000 mgr.gibba020.yqfnwy (mgr.34427) 11511 : cluster [DBG] pgmap v6561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:29.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:29 gibba013 bash[30381]: cluster 2021-03-10T17:31:28.044344+0000 mgr.gibba020.yqfnwy (mgr.34427) 11511 : cluster [DBG] pgmap v6561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:29.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:29 gibba020 bash[25448]: cluster 2021-03-10T17:31:28.044344+0000 mgr.gibba020.yqfnwy (mgr.34427) 11511 : cluster [DBG] pgmap v6561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:31.411 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:31:31.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:31 gibba013 bash[29418]: cluster 2021-03-10T17:31:30.045250+0000 mgr.gibba020.yqfnwy (mgr.34427) 11512 : cluster [DBG] pgmap v6562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:31.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:31 gibba013 bash[30381]: cluster 2021-03-10T17:31:30.045250+0000 mgr.gibba020.yqfnwy (mgr.34427) 11512 : cluster [DBG] pgmap v6562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:31.642 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:31:31.642 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 9m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:31:31.643 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 8m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:31:31.643 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:31:31.643 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:31:31.643 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:31:31.644 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:31:31.644 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:31:31.644 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:31:31.644 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:31:31.644 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:31:31.645 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:31:31.645 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:31:31.645 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:31:31.645 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:31:31.645 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:31:31.646 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:31:31.646 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:31:31.646 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:31:31.646 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 8m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:31:31.647 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 8m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:31:31.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:31 gibba020 bash[25448]: cluster 2021-03-10T17:31:30.045250+0000 mgr.gibba020.yqfnwy (mgr.34427) 11512 : cluster [DBG] pgmap v6562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:31.895 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:31:31.896 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:31:31.896 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:31:31.896 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:31:31.897 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:31:31.897 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:31:31.897 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:31:31.897 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:31:31.897 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:31:31.898 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:31:31.898 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:31:31.898 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:31:31.898 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:31:31.899 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:31:31.899 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:31:32.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:32 gibba013 bash[29418]: audit 2021-03-10T17:31:31.398930+0000 mgr.gibba020.yqfnwy (mgr.34427) 11513 : audit [DBG] from='client.51774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:31:32.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:32 gibba013 bash[29418]: audit 2021-03-10T17:31:31.627469+0000 mgr.gibba020.yqfnwy (mgr.34427) 11514 : audit [DBG] from='client.61759 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:31:32.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:32 gibba013 bash[29418]: audit 2021-03-10T17:31:31.893257+0000 mon.c (mon.1) 177 : audit [DBG] from='client.? 172.21.2.113:0/751442614' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:32.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:32 gibba013 bash[30381]: audit 2021-03-10T17:31:31.398930+0000 mgr.gibba020.yqfnwy (mgr.34427) 11513 : audit [DBG] from='client.51774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:31:32.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:32 gibba013 bash[30381]: audit 2021-03-10T17:31:31.627469+0000 mgr.gibba020.yqfnwy (mgr.34427) 11514 : audit [DBG] from='client.61759 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:31:32.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:32 gibba013 bash[30381]: audit 2021-03-10T17:31:31.893257+0000 mon.c (mon.1) 177 : audit [DBG] from='client.? 172.21.2.113:0/751442614' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:32.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:32 gibba020 bash[25448]: audit 2021-03-10T17:31:31.398930+0000 mgr.gibba020.yqfnwy (mgr.34427) 11513 : audit [DBG] from='client.51774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:31:32.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:32 gibba020 bash[25448]: audit 2021-03-10T17:31:31.627469+0000 mgr.gibba020.yqfnwy (mgr.34427) 11514 : audit [DBG] from='client.61759 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:31:32.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:32 gibba020 bash[25448]: audit 2021-03-10T17:31:31.893257+0000 mon.c (mon.1) 177 : audit [DBG] from='client.? 172.21.2.113:0/751442614' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:31:33.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:33 gibba013 bash[29418]: cluster 2021-03-10T17:31:32.046427+0000 mgr.gibba020.yqfnwy (mgr.34427) 11515 : cluster [DBG] pgmap v6563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:33.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:33 gibba013 bash[30381]: cluster 2021-03-10T17:31:32.046427+0000 mgr.gibba020.yqfnwy (mgr.34427) 11515 : cluster [DBG] pgmap v6563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:33.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:33 gibba020 bash[25448]: cluster 2021-03-10T17:31:32.046427+0000 mgr.gibba020.yqfnwy (mgr.34427) 11515 : cluster [DBG] pgmap v6563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:35.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:35 gibba013 bash[29418]: cluster 2021-03-10T17:31:34.048132+0000 mgr.gibba020.yqfnwy (mgr.34427) 11516 : cluster [DBG] pgmap v6564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:35.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:35 gibba013 bash[30381]: cluster 2021-03-10T17:31:34.048132+0000 mgr.gibba020.yqfnwy (mgr.34427) 11516 : cluster [DBG] pgmap v6564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:35.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:35 gibba020 bash[25448]: cluster 2021-03-10T17:31:34.048132+0000 mgr.gibba020.yqfnwy (mgr.34427) 11516 : cluster [DBG] pgmap v6564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:37.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:37 gibba013 bash[29418]: cluster 2021-03-10T17:31:36.049758+0000 mgr.gibba020.yqfnwy (mgr.34427) 11517 : cluster [DBG] pgmap v6565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:37.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:37 gibba013 bash[30381]: cluster 2021-03-10T17:31:36.049758+0000 mgr.gibba020.yqfnwy (mgr.34427) 11517 : cluster [DBG] pgmap v6565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:37.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:37 gibba020 bash[25448]: cluster 2021-03-10T17:31:36.049758+0000 mgr.gibba020.yqfnwy (mgr.34427) 11517 : cluster [DBG] pgmap v6565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:39.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:39 gibba013 bash[29418]: cluster 2021-03-10T17:31:38.050219+0000 mgr.gibba020.yqfnwy (mgr.34427) 11518 : cluster [DBG] pgmap v6566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:39.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:39 gibba013 bash[30381]: cluster 2021-03-10T17:31:38.050219+0000 mgr.gibba020.yqfnwy (mgr.34427) 11518 : cluster [DBG] pgmap v6566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:39.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:39 gibba020 bash[25448]: cluster 2021-03-10T17:31:38.050219+0000 mgr.gibba020.yqfnwy (mgr.34427) 11518 : cluster [DBG] pgmap v6566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:41.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:41 gibba013 bash[29418]: cluster 2021-03-10T17:31:40.051140+0000 mgr.gibba020.yqfnwy (mgr.34427) 11519 : cluster [DBG] pgmap v6567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:41.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:41 gibba013 bash[30381]: cluster 2021-03-10T17:31:40.051140+0000 mgr.gibba020.yqfnwy (mgr.34427) 11519 : cluster [DBG] pgmap v6567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:41.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:41 gibba020 bash[25448]: cluster 2021-03-10T17:31:40.051140+0000 mgr.gibba020.yqfnwy (mgr.34427) 11519 : cluster [DBG] pgmap v6567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:43.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:43 gibba013 bash[29418]: cluster 2021-03-10T17:31:42.052268+0000 mgr.gibba020.yqfnwy (mgr.34427) 11520 : cluster [DBG] pgmap v6568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:43.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:43 gibba013 bash[29418]: cephadm 2021-03-10T17:31:42.142743+0000 mgr.gibba020.yqfnwy (mgr.34427) 11521 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:31:43.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:43 gibba013 bash[30381]: cluster 2021-03-10T17:31:42.052268+0000 mgr.gibba020.yqfnwy (mgr.34427) 11520 : cluster [DBG] pgmap v6568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:43.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:43 gibba013 bash[30381]: cephadm 2021-03-10T17:31:42.142743+0000 mgr.gibba020.yqfnwy (mgr.34427) 11521 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:31:43.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:43 gibba020 bash[25448]: cluster 2021-03-10T17:31:42.052268+0000 mgr.gibba020.yqfnwy (mgr.34427) 11520 : cluster [DBG] pgmap v6568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:43.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:43 gibba020 bash[25448]: cephadm 2021-03-10T17:31:42.142743+0000 mgr.gibba020.yqfnwy (mgr.34427) 11521 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:31:45.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:45 gibba013 bash[29418]: cluster 2021-03-10T17:31:44.053662+0000 mgr.gibba020.yqfnwy (mgr.34427) 11522 : cluster [DBG] pgmap v6569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:45.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:45 gibba013 bash[30381]: cluster 2021-03-10T17:31:44.053662+0000 mgr.gibba020.yqfnwy (mgr.34427) 11522 : cluster [DBG] pgmap v6569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:45.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:45 gibba020 bash[25448]: cluster 2021-03-10T17:31:44.053662+0000 mgr.gibba020.yqfnwy (mgr.34427) 11522 : cluster [DBG] pgmap v6569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:47.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:47 gibba013 bash[29418]: cluster 2021-03-10T17:31:46.055526+0000 mgr.gibba020.yqfnwy (mgr.34427) 11523 : cluster [DBG] pgmap v6570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:47.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:47 gibba013 bash[30381]: cluster 2021-03-10T17:31:46.055526+0000 mgr.gibba020.yqfnwy (mgr.34427) 11523 : cluster [DBG] pgmap v6570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:47.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:47 gibba020 bash[25448]: cluster 2021-03-10T17:31:46.055526+0000 mgr.gibba020.yqfnwy (mgr.34427) 11523 : cluster [DBG] pgmap v6570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:49.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:49 gibba013 bash[29418]: cluster 2021-03-10T17:31:48.056087+0000 mgr.gibba020.yqfnwy (mgr.34427) 11524 : cluster [DBG] pgmap v6571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:49.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:49 gibba013 bash[30381]: cluster 2021-03-10T17:31:48.056087+0000 mgr.gibba020.yqfnwy (mgr.34427) 11524 : cluster [DBG] pgmap v6571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:49.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:49 gibba020 bash[25448]: cluster 2021-03-10T17:31:48.056087+0000 mgr.gibba020.yqfnwy (mgr.34427) 11524 : cluster [DBG] pgmap v6571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:51.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:51 gibba013 bash[29418]: cluster 2021-03-10T17:31:50.057003+0000 mgr.gibba020.yqfnwy (mgr.34427) 11525 : cluster [DBG] pgmap v6572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:51.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:51 gibba013 bash[30381]: cluster 2021-03-10T17:31:50.057003+0000 mgr.gibba020.yqfnwy (mgr.34427) 11525 : cluster [DBG] pgmap v6572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:51.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:51 gibba020 bash[25448]: cluster 2021-03-10T17:31:50.057003+0000 mgr.gibba020.yqfnwy (mgr.34427) 11525 : cluster [DBG] pgmap v6572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:53.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:53 gibba013 bash[29418]: cluster 2021-03-10T17:31:52.058065+0000 mgr.gibba020.yqfnwy (mgr.34427) 11526 : cluster [DBG] pgmap v6573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:53.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:53 gibba013 bash[30381]: cluster 2021-03-10T17:31:52.058065+0000 mgr.gibba020.yqfnwy (mgr.34427) 11526 : cluster [DBG] pgmap v6573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:53.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:53 gibba020 bash[25448]: cluster 2021-03-10T17:31:52.058065+0000 mgr.gibba020.yqfnwy (mgr.34427) 11526 : cluster [DBG] pgmap v6573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:55.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:55 gibba013 bash[29418]: cluster 2021-03-10T17:31:54.059753+0000 mgr.gibba020.yqfnwy (mgr.34427) 11527 : cluster [DBG] pgmap v6574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:55.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:55 gibba013 bash[30381]: cluster 2021-03-10T17:31:54.059753+0000 mgr.gibba020.yqfnwy (mgr.34427) 11527 : cluster [DBG] pgmap v6574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:55.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:55 gibba020 bash[25448]: cluster 2021-03-10T17:31:54.059753+0000 mgr.gibba020.yqfnwy (mgr.34427) 11527 : cluster [DBG] pgmap v6574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:57.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:57 gibba013 bash[29418]: cluster 2021-03-10T17:31:56.061619+0000 mgr.gibba020.yqfnwy (mgr.34427) 11528 : cluster [DBG] pgmap v6575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:57.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:57 gibba013 bash[29418]: audit 2021-03-10T17:31:57.160437+0000 mon.a (mon.0) 4040 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:31:57.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:57 gibba013 bash[29418]: audit 2021-03-10T17:31:57.166675+0000 mon.a (mon.0) 4041 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:31:57.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:57 gibba013 bash[30381]: cluster 2021-03-10T17:31:56.061619+0000 mgr.gibba020.yqfnwy (mgr.34427) 11528 : cluster [DBG] pgmap v6575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:57.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:57 gibba013 bash[30381]: audit 2021-03-10T17:31:57.160437+0000 mon.a (mon.0) 4040 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:31:57.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:57 gibba013 bash[30381]: audit 2021-03-10T17:31:57.166675+0000 mon.a (mon.0) 4041 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:31:57.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:57 gibba020 bash[25448]: cluster 2021-03-10T17:31:56.061619+0000 mgr.gibba020.yqfnwy (mgr.34427) 11528 : cluster [DBG] pgmap v6575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:57.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:57 gibba020 bash[25448]: audit 2021-03-10T17:31:57.160437+0000 mon.a (mon.0) 4040 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:31:57.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:57 gibba020 bash[25448]: audit 2021-03-10T17:31:57.166675+0000 mon.a (mon.0) 4041 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:31:58.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:58 gibba013 bash[29418]: cephadm 2021-03-10T17:31:57.165882+0000 mgr.gibba020.yqfnwy (mgr.34427) 11529 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:31:58.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:58 gibba013 bash[30381]: cephadm 2021-03-10T17:31:57.165882+0000 mgr.gibba020.yqfnwy (mgr.34427) 11529 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:31:58.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:58 gibba020 bash[25448]: cephadm 2021-03-10T17:31:57.165882+0000 mgr.gibba020.yqfnwy (mgr.34427) 11529 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:31:59.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:31:59 gibba013 bash[29418]: cluster 2021-03-10T17:31:58.062112+0000 mgr.gibba020.yqfnwy (mgr.34427) 11530 : cluster [DBG] pgmap v6576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:59.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:31:59 gibba013 bash[30381]: cluster 2021-03-10T17:31:58.062112+0000 mgr.gibba020.yqfnwy (mgr.34427) 11530 : cluster [DBG] pgmap v6576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:31:59.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:31:59 gibba020 bash[25448]: cluster 2021-03-10T17:31:58.062112+0000 mgr.gibba020.yqfnwy (mgr.34427) 11530 : cluster [DBG] pgmap v6576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:02.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[29418]: cluster 2021-03-10T17:32:00.062534+0000 mgr.gibba020.yqfnwy (mgr.34427) 11531 : cluster [DBG] pgmap v6577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:02.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[29418]: audit 2021-03-10T17:32:00.695359+0000 mon.a (mon.0) 4042 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:32:02.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[29418]: cephadm 2021-03-10T17:32:00.696396+0000 mgr.gibba020.yqfnwy (mgr.34427) 11532 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:32:02.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[29418]: audit 2021-03-10T17:32:00.912538+0000 mon.a (mon.0) 4043 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:32:02.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[29418]: cephadm 2021-03-10T17:32:00.918333+0000 mgr.gibba020.yqfnwy (mgr.34427) 11533 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:32:02.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[29418]: audit 2021-03-10T17:32:00.920116+0000 mon.a (mon.0) 4044 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:32:02.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[29418]: cephadm 2021-03-10T17:32:00.921774+0000 mgr.gibba020.yqfnwy (mgr.34427) 11534 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:32:02.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[29418]: audit 2021-03-10T17:32:00.923097+0000 mon.a (mon.0) 4045 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:02.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[29418]: cephadm 2021-03-10T17:32:00.924490+0000 mgr.gibba020.yqfnwy (mgr.34427) 11535 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:32:02.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[29418]: cephadm 2021-03-10T17:32:00.924528+0000 mgr.gibba020.yqfnwy (mgr.34427) 11536 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:32:02.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[29418]: audit 2021-03-10T17:32:00.925660+0000 mon.a (mon.0) 4046 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:02.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[29418]: cephadm 2021-03-10T17:32:00.927247+0000 mgr.gibba020.yqfnwy (mgr.34427) 11537 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:32:02.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[29418]: cephadm 2021-03-10T17:32:00.927291+0000 mgr.gibba020.yqfnwy (mgr.34427) 11538 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:32:02.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[29418]: audit 2021-03-10T17:32:00.928352+0000 mon.a (mon.0) 4047 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:02.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[29418]: cephadm 2021-03-10T17:32:00.930015+0000 mgr.gibba020.yqfnwy (mgr.34427) 11539 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:32:02.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[29418]: cephadm 2021-03-10T17:32:00.932458+0000 mgr.gibba020.yqfnwy (mgr.34427) 11540 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:32:02.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[29418]: cephadm 2021-03-10T17:32:00.932503+0000 mgr.gibba020.yqfnwy (mgr.34427) 11541 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:32:02.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[29418]: audit 2021-03-10T17:32:00.933768+0000 mon.a (mon.0) 4048 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:02.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[29418]: cephadm 2021-03-10T17:32:00.935146+0000 mgr.gibba020.yqfnwy (mgr.34427) 11542 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:32:02.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[29418]: cephadm 2021-03-10T17:32:00.935636+0000 mgr.gibba020.yqfnwy (mgr.34427) 11543 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:32:02.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[29418]: audit 2021-03-10T17:32:00.936709+0000 mon.a (mon.0) 4049 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:02.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[29418]: cephadm 2021-03-10T17:32:00.938790+0000 mgr.gibba020.yqfnwy (mgr.34427) 11544 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:32:02.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[29418]: cephadm 2021-03-10T17:32:00.938843+0000 mgr.gibba020.yqfnwy (mgr.34427) 11545 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:32:02.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[29418]: cephadm 2021-03-10T17:32:00.939000+0000 mgr.gibba020.yqfnwy (mgr.34427) 11546 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:32:02.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[30381]: cluster 2021-03-10T17:32:00.062534+0000 mgr.gibba020.yqfnwy (mgr.34427) 11531 : cluster [DBG] pgmap v6577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:02.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[30381]: audit 2021-03-10T17:32:00.695359+0000 mon.a (mon.0) 4042 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:32:02.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[30381]: cephadm 2021-03-10T17:32:00.696396+0000 mgr.gibba020.yqfnwy (mgr.34427) 11532 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:32:02.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[30381]: audit 2021-03-10T17:32:00.912538+0000 mon.a (mon.0) 4043 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:32:02.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[30381]: cephadm 2021-03-10T17:32:00.918333+0000 mgr.gibba020.yqfnwy (mgr.34427) 11533 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:32:02.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[30381]: audit 2021-03-10T17:32:00.920116+0000 mon.a (mon.0) 4044 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:32:02.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[30381]: cephadm 2021-03-10T17:32:00.921774+0000 mgr.gibba020.yqfnwy (mgr.34427) 11534 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:32:02.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[30381]: audit 2021-03-10T17:32:00.923097+0000 mon.a (mon.0) 4045 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:02.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[30381]: cephadm 2021-03-10T17:32:00.924490+0000 mgr.gibba020.yqfnwy (mgr.34427) 11535 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:32:02.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[30381]: cephadm 2021-03-10T17:32:00.924528+0000 mgr.gibba020.yqfnwy (mgr.34427) 11536 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:32:02.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[30381]: audit 2021-03-10T17:32:00.925660+0000 mon.a (mon.0) 4046 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:02.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[30381]: cephadm 2021-03-10T17:32:00.927247+0000 mgr.gibba020.yqfnwy (mgr.34427) 11537 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:32:02.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[30381]: cephadm 2021-03-10T17:32:00.927291+0000 mgr.gibba020.yqfnwy (mgr.34427) 11538 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:32:02.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[30381]: audit 2021-03-10T17:32:00.928352+0000 mon.a (mon.0) 4047 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:02.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[30381]: cephadm 2021-03-10T17:32:00.930015+0000 mgr.gibba020.yqfnwy (mgr.34427) 11539 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:32:02.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[30381]: cephadm 2021-03-10T17:32:00.932458+0000 mgr.gibba020.yqfnwy (mgr.34427) 11540 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:32:02.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[30381]: cephadm 2021-03-10T17:32:00.932503+0000 mgr.gibba020.yqfnwy (mgr.34427) 11541 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:32:02.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[30381]: audit 2021-03-10T17:32:00.933768+0000 mon.a (mon.0) 4048 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:02.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[30381]: cephadm 2021-03-10T17:32:00.935146+0000 mgr.gibba020.yqfnwy (mgr.34427) 11542 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:32:02.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[30381]: cephadm 2021-03-10T17:32:00.935636+0000 mgr.gibba020.yqfnwy (mgr.34427) 11543 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:32:02.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[30381]: audit 2021-03-10T17:32:00.936709+0000 mon.a (mon.0) 4049 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:02.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[30381]: cephadm 2021-03-10T17:32:00.938790+0000 mgr.gibba020.yqfnwy (mgr.34427) 11544 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:32:02.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[30381]: cephadm 2021-03-10T17:32:00.938843+0000 mgr.gibba020.yqfnwy (mgr.34427) 11545 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:32:02.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:01 gibba013 bash[30381]: cephadm 2021-03-10T17:32:00.939000+0000 mgr.gibba020.yqfnwy (mgr.34427) 11546 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:32:02.142 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:32:02.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:01 gibba020 bash[25448]: cluster 2021-03-10T17:32:00.062534+0000 mgr.gibba020.yqfnwy (mgr.34427) 11531 : cluster [DBG] pgmap v6577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:02.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:01 gibba020 bash[25448]: audit 2021-03-10T17:32:00.695359+0000 mon.a (mon.0) 4042 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:32:02.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:01 gibba020 bash[25448]: cephadm 2021-03-10T17:32:00.696396+0000 mgr.gibba020.yqfnwy (mgr.34427) 11532 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:32:02.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:01 gibba020 bash[25448]: audit 2021-03-10T17:32:00.912538+0000 mon.a (mon.0) 4043 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:32:02.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:01 gibba020 bash[25448]: cephadm 2021-03-10T17:32:00.918333+0000 mgr.gibba020.yqfnwy (mgr.34427) 11533 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:32:02.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:01 gibba020 bash[25448]: audit 2021-03-10T17:32:00.920116+0000 mon.a (mon.0) 4044 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:32:02.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:01 gibba020 bash[25448]: cephadm 2021-03-10T17:32:00.921774+0000 mgr.gibba020.yqfnwy (mgr.34427) 11534 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:32:02.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:01 gibba020 bash[25448]: audit 2021-03-10T17:32:00.923097+0000 mon.a (mon.0) 4045 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:02.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:01 gibba020 bash[25448]: cephadm 2021-03-10T17:32:00.924490+0000 mgr.gibba020.yqfnwy (mgr.34427) 11535 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:32:02.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:01 gibba020 bash[25448]: cephadm 2021-03-10T17:32:00.924528+0000 mgr.gibba020.yqfnwy (mgr.34427) 11536 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:32:02.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:01 gibba020 bash[25448]: audit 2021-03-10T17:32:00.925660+0000 mon.a (mon.0) 4046 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:02.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:01 gibba020 bash[25448]: cephadm 2021-03-10T17:32:00.927247+0000 mgr.gibba020.yqfnwy (mgr.34427) 11537 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:32:02.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:01 gibba020 bash[25448]: cephadm 2021-03-10T17:32:00.927291+0000 mgr.gibba020.yqfnwy (mgr.34427) 11538 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:32:02.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:01 gibba020 bash[25448]: audit 2021-03-10T17:32:00.928352+0000 mon.a (mon.0) 4047 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:02.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:01 gibba020 bash[25448]: cephadm 2021-03-10T17:32:00.930015+0000 mgr.gibba020.yqfnwy (mgr.34427) 11539 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:32:02.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:01 gibba020 bash[25448]: cephadm 2021-03-10T17:32:00.932458+0000 mgr.gibba020.yqfnwy (mgr.34427) 11540 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:32:02.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:01 gibba020 bash[25448]: cephadm 2021-03-10T17:32:00.932503+0000 mgr.gibba020.yqfnwy (mgr.34427) 11541 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:32:02.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:01 gibba020 bash[25448]: audit 2021-03-10T17:32:00.933768+0000 mon.a (mon.0) 4048 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:02.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:01 gibba020 bash[25448]: cephadm 2021-03-10T17:32:00.935146+0000 mgr.gibba020.yqfnwy (mgr.34427) 11542 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:32:02.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:01 gibba020 bash[25448]: cephadm 2021-03-10T17:32:00.935636+0000 mgr.gibba020.yqfnwy (mgr.34427) 11543 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:32:02.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:01 gibba020 bash[25448]: audit 2021-03-10T17:32:00.936709+0000 mon.a (mon.0) 4049 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:02.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:01 gibba020 bash[25448]: cephadm 2021-03-10T17:32:00.938790+0000 mgr.gibba020.yqfnwy (mgr.34427) 11544 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:32:02.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:01 gibba020 bash[25448]: cephadm 2021-03-10T17:32:00.938843+0000 mgr.gibba020.yqfnwy (mgr.34427) 11545 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:32:02.206 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:01 gibba020 bash[25448]: cephadm 2021-03-10T17:32:00.939000+0000 mgr.gibba020.yqfnwy (mgr.34427) 11546 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:32:02.375 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:32:02.375 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 1s ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:32:02.375 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 9m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:32:02.376 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:32:02.376 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:32:02.376 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 1s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:32:02.376 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 1s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:32:02.376 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:32:02.377 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 1s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:32:02.377 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 1s ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:32:02.377 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:32:02.377 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 1s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:32:02.378 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 1s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:32:02.378 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 1s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:32:02.378 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 1s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:32:02.378 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:32:02.378 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:32:02.379 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:32:02.379 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:32:02.379 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 9m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:32:02.379 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 9m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:32:02.626 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:32:02.626 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:32:02.626 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:32:02.626 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:32:02.627 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:32:02.627 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:32:02.627 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:32:02.627 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:32:02.627 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:32:02.628 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:32:02.628 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:32:02.628 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:32:02.628 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:32:02.629 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:32:02.629 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:32:03.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:02 gibba013 bash[29418]: audit 2021-03-10T17:32:02.623759+0000 mon.a (mon.0) 4050 : audit [DBG] from='client.? 172.21.2.113:0/2197606328' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:03.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:02 gibba013 bash[30381]: audit 2021-03-10T17:32:02.623759+0000 mon.a (mon.0) 4050 : audit [DBG] from='client.? 172.21.2.113:0/2197606328' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:03.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:02 gibba020 bash[25448]: audit 2021-03-10T17:32:02.623759+0000 mon.a (mon.0) 4050 : audit [DBG] from='client.? 172.21.2.113:0/2197606328' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:04.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:03 gibba013 bash[29418]: cluster 2021-03-10T17:32:02.063849+0000 mgr.gibba020.yqfnwy (mgr.34427) 11547 : cluster [DBG] pgmap v6578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:04.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:03 gibba013 bash[29418]: audit 2021-03-10T17:32:02.131243+0000 mgr.gibba020.yqfnwy (mgr.34427) 11548 : audit [DBG] from='client.61771 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:32:04.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:03 gibba013 bash[29418]: audit 2021-03-10T17:32:02.360098+0000 mgr.gibba020.yqfnwy (mgr.34427) 11549 : audit [DBG] from='client.51798 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:32:04.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:03 gibba013 bash[30381]: cluster 2021-03-10T17:32:02.063849+0000 mgr.gibba020.yqfnwy (mgr.34427) 11547 : cluster [DBG] pgmap v6578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:04.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:03 gibba013 bash[30381]: audit 2021-03-10T17:32:02.131243+0000 mgr.gibba020.yqfnwy (mgr.34427) 11548 : audit [DBG] from='client.61771 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:32:04.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:03 gibba013 bash[30381]: audit 2021-03-10T17:32:02.360098+0000 mgr.gibba020.yqfnwy (mgr.34427) 11549 : audit [DBG] from='client.51798 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:32:04.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:03 gibba020 bash[25448]: cluster 2021-03-10T17:32:02.063849+0000 mgr.gibba020.yqfnwy (mgr.34427) 11547 : cluster [DBG] pgmap v6578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:04.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:03 gibba020 bash[25448]: audit 2021-03-10T17:32:02.131243+0000 mgr.gibba020.yqfnwy (mgr.34427) 11548 : audit [DBG] from='client.61771 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:32:04.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:03 gibba020 bash[25448]: audit 2021-03-10T17:32:02.360098+0000 mgr.gibba020.yqfnwy (mgr.34427) 11549 : audit [DBG] from='client.51798 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:32:06.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:05 gibba013 bash[29418]: cluster 2021-03-10T17:32:04.065406+0000 mgr.gibba020.yqfnwy (mgr.34427) 11550 : cluster [DBG] pgmap v6579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:06.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:05 gibba013 bash[30381]: cluster 2021-03-10T17:32:04.065406+0000 mgr.gibba020.yqfnwy (mgr.34427) 11550 : cluster [DBG] pgmap v6579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:06.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:05 gibba020 bash[25448]: cluster 2021-03-10T17:32:04.065406+0000 mgr.gibba020.yqfnwy (mgr.34427) 11550 : cluster [DBG] pgmap v6579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:08.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:07 gibba013 bash[29418]: cluster 2021-03-10T17:32:06.067135+0000 mgr.gibba020.yqfnwy (mgr.34427) 11551 : cluster [DBG] pgmap v6580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:08.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:07 gibba013 bash[29418]: audit 2021-03-10T17:32:07.018057+0000 mon.a (mon.0) 4051 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:32:08.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:07 gibba013 bash[29418]: audit 2021-03-10T17:32:07.266486+0000 mon.a (mon.0) 4052 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:32:08.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:07 gibba013 bash[29418]: audit 2021-03-10T17:32:07.723415+0000 mon.a (mon.0) 4053 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T17:32:08.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:07 gibba013 bash[29418]: audit 2021-03-10T17:32:07.724192+0000 mon.a (mon.0) 4054 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T17:32:08.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:07 gibba013 bash[29418]: audit 2021-03-10T17:32:07.724913+0000 mon.a (mon.0) 4055 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:32:08.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:07 gibba013 bash[30381]: cluster 2021-03-10T17:32:06.067135+0000 mgr.gibba020.yqfnwy (mgr.34427) 11551 : cluster [DBG] pgmap v6580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:08.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:07 gibba013 bash[30381]: audit 2021-03-10T17:32:07.018057+0000 mon.a (mon.0) 4051 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:32:08.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:07 gibba013 bash[30381]: audit 2021-03-10T17:32:07.266486+0000 mon.a (mon.0) 4052 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:32:08.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:07 gibba013 bash[30381]: audit 2021-03-10T17:32:07.723415+0000 mon.a (mon.0) 4053 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T17:32:08.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:07 gibba013 bash[30381]: audit 2021-03-10T17:32:07.724192+0000 mon.a (mon.0) 4054 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T17:32:08.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:07 gibba013 bash[30381]: audit 2021-03-10T17:32:07.724913+0000 mon.a (mon.0) 4055 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:32:08.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:07 gibba020 bash[25448]: cluster 2021-03-10T17:32:06.067135+0000 mgr.gibba020.yqfnwy (mgr.34427) 11551 : cluster [DBG] pgmap v6580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:08.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:07 gibba020 bash[25448]: audit 2021-03-10T17:32:07.018057+0000 mon.a (mon.0) 4051 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:32:08.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:07 gibba020 bash[25448]: audit 2021-03-10T17:32:07.266486+0000 mon.a (mon.0) 4052 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:32:08.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:07 gibba020 bash[25448]: audit 2021-03-10T17:32:07.723415+0000 mon.a (mon.0) 4053 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T17:32:08.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:07 gibba020 bash[25448]: audit 2021-03-10T17:32:07.724192+0000 mon.a (mon.0) 4054 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T17:32:08.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:07 gibba020 bash[25448]: audit 2021-03-10T17:32:07.724913+0000 mon.a (mon.0) 4055 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:32:09.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:08 gibba013 bash[29418]: audit 2021-03-10T17:32:07.727044+0000 mon.a (mon.0) 4056 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:32:09.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:08 gibba013 bash[30381]: audit 2021-03-10T17:32:07.727044+0000 mon.a (mon.0) 4056 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:32:09.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:08 gibba020 bash[25448]: audit 2021-03-10T17:32:07.727044+0000 mon.a (mon.0) 4056 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:32:10.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:09 gibba013 bash[29418]: cluster 2021-03-10T17:32:08.067587+0000 mgr.gibba020.yqfnwy (mgr.34427) 11552 : cluster [DBG] pgmap v6581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:10.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:09 gibba013 bash[30381]: cluster 2021-03-10T17:32:08.067587+0000 mgr.gibba020.yqfnwy (mgr.34427) 11552 : cluster [DBG] pgmap v6581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:10.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:09 gibba020 bash[25448]: cluster 2021-03-10T17:32:08.067587+0000 mgr.gibba020.yqfnwy (mgr.34427) 11552 : cluster [DBG] pgmap v6581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:12.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:11 gibba013 bash[29418]: cluster 2021-03-10T17:32:10.068577+0000 mgr.gibba020.yqfnwy (mgr.34427) 11553 : cluster [DBG] pgmap v6582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:12.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:11 gibba013 bash[30381]: cluster 2021-03-10T17:32:10.068577+0000 mgr.gibba020.yqfnwy (mgr.34427) 11553 : cluster [DBG] pgmap v6582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:12.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:11 gibba020 bash[25448]: cluster 2021-03-10T17:32:10.068577+0000 mgr.gibba020.yqfnwy (mgr.34427) 11553 : cluster [DBG] pgmap v6582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:14.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:13 gibba013 bash[29418]: cluster 2021-03-10T17:32:12.069623+0000 mgr.gibba020.yqfnwy (mgr.34427) 11554 : cluster [DBG] pgmap v6583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:14.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:13 gibba013 bash[30381]: cluster 2021-03-10T17:32:12.069623+0000 mgr.gibba020.yqfnwy (mgr.34427) 11554 : cluster [DBG] pgmap v6583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:14.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:13 gibba020 bash[25448]: cluster 2021-03-10T17:32:12.069623+0000 mgr.gibba020.yqfnwy (mgr.34427) 11554 : cluster [DBG] pgmap v6583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:16.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:15 gibba013 bash[29418]: cluster 2021-03-10T17:32:14.071373+0000 mgr.gibba020.yqfnwy (mgr.34427) 11555 : cluster [DBG] pgmap v6584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:16.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:15 gibba013 bash[30381]: cluster 2021-03-10T17:32:14.071373+0000 mgr.gibba020.yqfnwy (mgr.34427) 11555 : cluster [DBG] pgmap v6584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:16.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:15 gibba020 bash[25448]: cluster 2021-03-10T17:32:14.071373+0000 mgr.gibba020.yqfnwy (mgr.34427) 11555 : cluster [DBG] pgmap v6584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:17.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:16 gibba013 bash[29418]: cephadm 2021-03-10T17:32:15.954912+0000 mgr.gibba020.yqfnwy (mgr.34427) 11556 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:32:17.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:16 gibba013 bash[30381]: cephadm 2021-03-10T17:32:15.954912+0000 mgr.gibba020.yqfnwy (mgr.34427) 11556 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:32:17.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:16 gibba020 bash[25448]: cephadm 2021-03-10T17:32:15.954912+0000 mgr.gibba020.yqfnwy (mgr.34427) 11556 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:32:18.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:17 gibba013 bash[29418]: cluster 2021-03-10T17:32:16.073261+0000 mgr.gibba020.yqfnwy (mgr.34427) 11557 : cluster [DBG] pgmap v6585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:18.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:17 gibba013 bash[30381]: cluster 2021-03-10T17:32:16.073261+0000 mgr.gibba020.yqfnwy (mgr.34427) 11557 : cluster [DBG] pgmap v6585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:18.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:17 gibba020 bash[25448]: cluster 2021-03-10T17:32:16.073261+0000 mgr.gibba020.yqfnwy (mgr.34427) 11557 : cluster [DBG] pgmap v6585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:20.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:19 gibba013 bash[29418]: cluster 2021-03-10T17:32:18.073775+0000 mgr.gibba020.yqfnwy (mgr.34427) 11558 : cluster [DBG] pgmap v6586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:20.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:19 gibba013 bash[30381]: cluster 2021-03-10T17:32:18.073775+0000 mgr.gibba020.yqfnwy (mgr.34427) 11558 : cluster [DBG] pgmap v6586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:20.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:19 gibba020 bash[25448]: cluster 2021-03-10T17:32:18.073775+0000 mgr.gibba020.yqfnwy (mgr.34427) 11558 : cluster [DBG] pgmap v6586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:22.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:21 gibba013 bash[29418]: cluster 2021-03-10T17:32:20.074889+0000 mgr.gibba020.yqfnwy (mgr.34427) 11559 : cluster [DBG] pgmap v6587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:22.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:21 gibba013 bash[30381]: cluster 2021-03-10T17:32:20.074889+0000 mgr.gibba020.yqfnwy (mgr.34427) 11559 : cluster [DBG] pgmap v6587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:22.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:21 gibba020 bash[25448]: cluster 2021-03-10T17:32:20.074889+0000 mgr.gibba020.yqfnwy (mgr.34427) 11559 : cluster [DBG] pgmap v6587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:24.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:23 gibba013 bash[29418]: cluster 2021-03-10T17:32:22.075909+0000 mgr.gibba020.yqfnwy (mgr.34427) 11560 : cluster [DBG] pgmap v6588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:24.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:23 gibba013 bash[30381]: cluster 2021-03-10T17:32:22.075909+0000 mgr.gibba020.yqfnwy (mgr.34427) 11560 : cluster [DBG] pgmap v6588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:24.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:23 gibba020 bash[25448]: cluster 2021-03-10T17:32:22.075909+0000 mgr.gibba020.yqfnwy (mgr.34427) 11560 : cluster [DBG] pgmap v6588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:26.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:25 gibba013 bash[29418]: cluster 2021-03-10T17:32:24.077258+0000 mgr.gibba020.yqfnwy (mgr.34427) 11561 : cluster [DBG] pgmap v6589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:26.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:25 gibba013 bash[30381]: cluster 2021-03-10T17:32:24.077258+0000 mgr.gibba020.yqfnwy (mgr.34427) 11561 : cluster [DBG] pgmap v6589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:26.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:25 gibba020 bash[25448]: cluster 2021-03-10T17:32:24.077258+0000 mgr.gibba020.yqfnwy (mgr.34427) 11561 : cluster [DBG] pgmap v6589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:28.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:27 gibba013 bash[29418]: cluster 2021-03-10T17:32:26.078980+0000 mgr.gibba020.yqfnwy (mgr.34427) 11562 : cluster [DBG] pgmap v6590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:28.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:27 gibba013 bash[30381]: cluster 2021-03-10T17:32:26.078980+0000 mgr.gibba020.yqfnwy (mgr.34427) 11562 : cluster [DBG] pgmap v6590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:28.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:27 gibba020 bash[25448]: cluster 2021-03-10T17:32:26.078980+0000 mgr.gibba020.yqfnwy (mgr.34427) 11562 : cluster [DBG] pgmap v6590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:30.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:29 gibba013 bash[29418]: cluster 2021-03-10T17:32:28.079459+0000 mgr.gibba020.yqfnwy (mgr.34427) 11563 : cluster [DBG] pgmap v6591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:30.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:29 gibba013 bash[30381]: cluster 2021-03-10T17:32:28.079459+0000 mgr.gibba020.yqfnwy (mgr.34427) 11563 : cluster [DBG] pgmap v6591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:30.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:29 gibba020 bash[25448]: cluster 2021-03-10T17:32:28.079459+0000 mgr.gibba020.yqfnwy (mgr.34427) 11563 : cluster [DBG] pgmap v6591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:32.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:31 gibba013 bash[29418]: cluster 2021-03-10T17:32:30.080540+0000 mgr.gibba020.yqfnwy (mgr.34427) 11564 : cluster [DBG] pgmap v6592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:32.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:31 gibba013 bash[29418]: cephadm 2021-03-10T17:32:30.961090+0000 mgr.gibba020.yqfnwy (mgr.34427) 11565 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:32:32.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:31 gibba013 bash[30381]: cluster 2021-03-10T17:32:30.080540+0000 mgr.gibba020.yqfnwy (mgr.34427) 11564 : cluster [DBG] pgmap v6592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:32.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:31 gibba013 bash[30381]: cephadm 2021-03-10T17:32:30.961090+0000 mgr.gibba020.yqfnwy (mgr.34427) 11565 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:32:32.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:31 gibba020 bash[25448]: cluster 2021-03-10T17:32:30.080540+0000 mgr.gibba020.yqfnwy (mgr.34427) 11564 : cluster [DBG] pgmap v6592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:32.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:31 gibba020 bash[25448]: cephadm 2021-03-10T17:32:30.961090+0000 mgr.gibba020.yqfnwy (mgr.34427) 11565 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:32:32.868 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:32:33.094 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:32:33.095 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 32s ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:32:33.095 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 9m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:32:33.096 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:32:33.096 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:32:33.097 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 32s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:32:33.098 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 32s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:32:33.098 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:32:33.099 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 32s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:32:33.099 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 32s ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:32:33.100 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:32:33.100 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 32s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:32:33.100 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 32s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:32:33.101 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 32s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:32:33.102 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 32s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:32:33.103 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:32:33.103 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:32:33.103 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:32:33.103 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:32:33.104 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 9m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:32:33.104 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 9m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:32:33.344 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:32:33.344 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:32:33.344 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:32:33.344 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:32:33.345 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:32:33.345 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:32:33.345 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:32:33.345 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:32:33.346 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:32:33.346 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:32:33.346 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:32:33.346 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:32:33.346 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:32:33.347 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:32:33.347 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:32:34.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:33 gibba013 bash[29418]: cluster 2021-03-10T17:32:32.081712+0000 mgr.gibba020.yqfnwy (mgr.34427) 11566 : cluster [DBG] pgmap v6593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:34.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:33 gibba013 bash[29418]: audit 2021-03-10T17:32:32.856506+0000 mgr.gibba020.yqfnwy (mgr.34427) 11567 : audit [DBG] from='client.51810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:32:34.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:33 gibba013 bash[29418]: audit 2021-03-10T17:32:33.341718+0000 mon.a (mon.0) 4057 : audit [DBG] from='client.? 172.21.2.113:0/398686965' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:34.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:33 gibba013 bash[30381]: cluster 2021-03-10T17:32:32.081712+0000 mgr.gibba020.yqfnwy (mgr.34427) 11566 : cluster [DBG] pgmap v6593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:34.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:33 gibba013 bash[30381]: audit 2021-03-10T17:32:32.856506+0000 mgr.gibba020.yqfnwy (mgr.34427) 11567 : audit [DBG] from='client.51810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:32:34.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:33 gibba013 bash[30381]: audit 2021-03-10T17:32:33.341718+0000 mon.a (mon.0) 4057 : audit [DBG] from='client.? 172.21.2.113:0/398686965' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:34.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:33 gibba020 bash[25448]: cluster 2021-03-10T17:32:32.081712+0000 mgr.gibba020.yqfnwy (mgr.34427) 11566 : cluster [DBG] pgmap v6593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:34.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:33 gibba020 bash[25448]: audit 2021-03-10T17:32:32.856506+0000 mgr.gibba020.yqfnwy (mgr.34427) 11567 : audit [DBG] from='client.51810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:32:34.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:33 gibba020 bash[25448]: audit 2021-03-10T17:32:33.341718+0000 mon.a (mon.0) 4057 : audit [DBG] from='client.? 172.21.2.113:0/398686965' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:32:35.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:34 gibba013 bash[29418]: audit 2021-03-10T17:32:33.080688+0000 mgr.gibba020.yqfnwy (mgr.34427) 11568 : audit [DBG] from='client.61795 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:32:35.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:34 gibba013 bash[30381]: audit 2021-03-10T17:32:33.080688+0000 mgr.gibba020.yqfnwy (mgr.34427) 11568 : audit [DBG] from='client.61795 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:32:35.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:34 gibba020 bash[25448]: audit 2021-03-10T17:32:33.080688+0000 mgr.gibba020.yqfnwy (mgr.34427) 11568 : audit [DBG] from='client.61795 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:32:36.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:35 gibba013 bash[29418]: cluster 2021-03-10T17:32:34.083337+0000 mgr.gibba020.yqfnwy (mgr.34427) 11569 : cluster [DBG] pgmap v6594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:36.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:35 gibba013 bash[30381]: cluster 2021-03-10T17:32:34.083337+0000 mgr.gibba020.yqfnwy (mgr.34427) 11569 : cluster [DBG] pgmap v6594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:36.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:35 gibba020 bash[25448]: cluster 2021-03-10T17:32:34.083337+0000 mgr.gibba020.yqfnwy (mgr.34427) 11569 : cluster [DBG] pgmap v6594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:38.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:37 gibba020 bash[25448]: cluster 2021-03-10T17:32:36.085085+0000 mgr.gibba020.yqfnwy (mgr.34427) 11570 : cluster [DBG] pgmap v6595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:38.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:37 gibba013 bash[29418]: cluster 2021-03-10T17:32:36.085085+0000 mgr.gibba020.yqfnwy (mgr.34427) 11570 : cluster [DBG] pgmap v6595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:38.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:37 gibba013 bash[30381]: cluster 2021-03-10T17:32:36.085085+0000 mgr.gibba020.yqfnwy (mgr.34427) 11570 : cluster [DBG] pgmap v6595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:40.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:39 gibba020 bash[25448]: cluster 2021-03-10T17:32:38.086166+0000 mgr.gibba020.yqfnwy (mgr.34427) 11571 : cluster [DBG] pgmap v6596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:40.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:39 gibba013 bash[29418]: cluster 2021-03-10T17:32:38.086166+0000 mgr.gibba020.yqfnwy (mgr.34427) 11571 : cluster [DBG] pgmap v6596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:40.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:39 gibba013 bash[30381]: cluster 2021-03-10T17:32:38.086166+0000 mgr.gibba020.yqfnwy (mgr.34427) 11571 : cluster [DBG] pgmap v6596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:42.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:41 gibba020 bash[25448]: cluster 2021-03-10T17:32:40.087544+0000 mgr.gibba020.yqfnwy (mgr.34427) 11572 : cluster [DBG] pgmap v6597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:42.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:41 gibba013 bash[29418]: cluster 2021-03-10T17:32:40.087544+0000 mgr.gibba020.yqfnwy (mgr.34427) 11572 : cluster [DBG] pgmap v6597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:42.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:41 gibba013 bash[30381]: cluster 2021-03-10T17:32:40.087544+0000 mgr.gibba020.yqfnwy (mgr.34427) 11572 : cluster [DBG] pgmap v6597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:44.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:43 gibba020 bash[25448]: cluster 2021-03-10T17:32:42.088822+0000 mgr.gibba020.yqfnwy (mgr.34427) 11573 : cluster [DBG] pgmap v6598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:44.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:43 gibba013 bash[29418]: cluster 2021-03-10T17:32:42.088822+0000 mgr.gibba020.yqfnwy (mgr.34427) 11573 : cluster [DBG] pgmap v6598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:44.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:43 gibba013 bash[30381]: cluster 2021-03-10T17:32:42.088822+0000 mgr.gibba020.yqfnwy (mgr.34427) 11573 : cluster [DBG] pgmap v6598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:46.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:45 gibba020 bash[25448]: cluster 2021-03-10T17:32:44.090465+0000 mgr.gibba020.yqfnwy (mgr.34427) 11574 : cluster [DBG] pgmap v6599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:46.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:45 gibba013 bash[29418]: cluster 2021-03-10T17:32:44.090465+0000 mgr.gibba020.yqfnwy (mgr.34427) 11574 : cluster [DBG] pgmap v6599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:46.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:45 gibba013 bash[30381]: cluster 2021-03-10T17:32:44.090465+0000 mgr.gibba020.yqfnwy (mgr.34427) 11574 : cluster [DBG] pgmap v6599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:47.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:46 gibba020 bash[25448]: cephadm 2021-03-10T17:32:45.976483+0000 mgr.gibba020.yqfnwy (mgr.34427) 11575 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:32:47.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:46 gibba013 bash[29418]: cephadm 2021-03-10T17:32:45.976483+0000 mgr.gibba020.yqfnwy (mgr.34427) 11575 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:32:47.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:46 gibba013 bash[30381]: cephadm 2021-03-10T17:32:45.976483+0000 mgr.gibba020.yqfnwy (mgr.34427) 11575 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:32:48.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:47 gibba020 bash[25448]: cluster 2021-03-10T17:32:46.092236+0000 mgr.gibba020.yqfnwy (mgr.34427) 11576 : cluster [DBG] pgmap v6600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:48.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:47 gibba013 bash[29418]: cluster 2021-03-10T17:32:46.092236+0000 mgr.gibba020.yqfnwy (mgr.34427) 11576 : cluster [DBG] pgmap v6600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:48.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:47 gibba013 bash[30381]: cluster 2021-03-10T17:32:46.092236+0000 mgr.gibba020.yqfnwy (mgr.34427) 11576 : cluster [DBG] pgmap v6600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:50.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:49 gibba020 bash[25448]: cluster 2021-03-10T17:32:48.092733+0000 mgr.gibba020.yqfnwy (mgr.34427) 11577 : cluster [DBG] pgmap v6601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:50.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:49 gibba013 bash[29418]: cluster 2021-03-10T17:32:48.092733+0000 mgr.gibba020.yqfnwy (mgr.34427) 11577 : cluster [DBG] pgmap v6601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:50.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:49 gibba013 bash[30381]: cluster 2021-03-10T17:32:48.092733+0000 mgr.gibba020.yqfnwy (mgr.34427) 11577 : cluster [DBG] pgmap v6601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:52.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:51 gibba013 bash[29418]: cluster 2021-03-10T17:32:50.093770+0000 mgr.gibba020.yqfnwy (mgr.34427) 11578 : cluster [DBG] pgmap v6602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:52.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:51 gibba013 bash[30381]: cluster 2021-03-10T17:32:50.093770+0000 mgr.gibba020.yqfnwy (mgr.34427) 11578 : cluster [DBG] pgmap v6602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:52.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:51 gibba020 bash[25448]: cluster 2021-03-10T17:32:50.093770+0000 mgr.gibba020.yqfnwy (mgr.34427) 11578 : cluster [DBG] pgmap v6602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:54.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:53 gibba013 bash[29418]: cluster 2021-03-10T17:32:52.095128+0000 mgr.gibba020.yqfnwy (mgr.34427) 11579 : cluster [DBG] pgmap v6603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:54.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:53 gibba013 bash[30381]: cluster 2021-03-10T17:32:52.095128+0000 mgr.gibba020.yqfnwy (mgr.34427) 11579 : cluster [DBG] pgmap v6603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:54.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:53 gibba020 bash[25448]: cluster 2021-03-10T17:32:52.095128+0000 mgr.gibba020.yqfnwy (mgr.34427) 11579 : cluster [DBG] pgmap v6603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:56.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:55 gibba013 bash[29418]: cluster 2021-03-10T17:32:54.096786+0000 mgr.gibba020.yqfnwy (mgr.34427) 11580 : cluster [DBG] pgmap v6604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:56.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:55 gibba013 bash[30381]: cluster 2021-03-10T17:32:54.096786+0000 mgr.gibba020.yqfnwy (mgr.34427) 11580 : cluster [DBG] pgmap v6604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:56.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:55 gibba020 bash[25448]: cluster 2021-03-10T17:32:54.096786+0000 mgr.gibba020.yqfnwy (mgr.34427) 11580 : cluster [DBG] pgmap v6604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:58.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:57 gibba013 bash[29418]: cluster 2021-03-10T17:32:56.098742+0000 mgr.gibba020.yqfnwy (mgr.34427) 11581 : cluster [DBG] pgmap v6605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:58.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:57 gibba013 bash[30381]: cluster 2021-03-10T17:32:56.098742+0000 mgr.gibba020.yqfnwy (mgr.34427) 11581 : cluster [DBG] pgmap v6605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:32:58.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:57 gibba020 bash[25448]: cluster 2021-03-10T17:32:56.098742+0000 mgr.gibba020.yqfnwy (mgr.34427) 11581 : cluster [DBG] pgmap v6605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:00.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:32:59 gibba013 bash[29418]: cluster 2021-03-10T17:32:58.099884+0000 mgr.gibba020.yqfnwy (mgr.34427) 11582 : cluster [DBG] pgmap v6606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:00.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:32:59 gibba013 bash[30381]: cluster 2021-03-10T17:32:58.099884+0000 mgr.gibba020.yqfnwy (mgr.34427) 11582 : cluster [DBG] pgmap v6606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:00.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:32:59 gibba020 bash[25448]: cluster 2021-03-10T17:32:58.099884+0000 mgr.gibba020.yqfnwy (mgr.34427) 11582 : cluster [DBG] pgmap v6606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:02.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:01 gibba013 bash[29418]: cluster 2021-03-10T17:33:00.100533+0000 mgr.gibba020.yqfnwy (mgr.34427) 11583 : cluster [DBG] pgmap v6607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:02.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:01 gibba013 bash[29418]: audit 2021-03-10T17:33:00.992981+0000 mon.a (mon.0) 4058 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:33:02.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:01 gibba013 bash[29418]: cephadm 2021-03-10T17:33:00.994690+0000 mgr.gibba020.yqfnwy (mgr.34427) 11584 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:33:02.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:01 gibba013 bash[29418]: audit 2021-03-10T17:33:00.995863+0000 mon.a (mon.0) 4059 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:33:02.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:01 gibba013 bash[30381]: cluster 2021-03-10T17:33:00.100533+0000 mgr.gibba020.yqfnwy (mgr.34427) 11583 : cluster [DBG] pgmap v6607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:02.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:01 gibba013 bash[30381]: audit 2021-03-10T17:33:00.992981+0000 mon.a (mon.0) 4058 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:33:02.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:01 gibba013 bash[30381]: cephadm 2021-03-10T17:33:00.994690+0000 mgr.gibba020.yqfnwy (mgr.34427) 11584 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:33:02.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:01 gibba013 bash[30381]: audit 2021-03-10T17:33:00.995863+0000 mon.a (mon.0) 4059 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:33:02.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:01 gibba020 bash[25448]: cluster 2021-03-10T17:33:00.100533+0000 mgr.gibba020.yqfnwy (mgr.34427) 11583 : cluster [DBG] pgmap v6607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:02.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:01 gibba020 bash[25448]: audit 2021-03-10T17:33:00.992981+0000 mon.a (mon.0) 4058 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:33:02.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:01 gibba020 bash[25448]: cephadm 2021-03-10T17:33:00.994690+0000 mgr.gibba020.yqfnwy (mgr.34427) 11584 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:33:02.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:01 gibba020 bash[25448]: audit 2021-03-10T17:33:00.995863+0000 mon.a (mon.0) 4059 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:33:03.588 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:33:03.811 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:33:03.811 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 63s ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:33:03.812 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 10m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:33:03.812 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:33:03.812 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:33:03.812 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 63s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:33:03.813 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 63s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:33:03.813 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:33:03.813 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 63s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:33:03.814 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 63s ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:33:03.814 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 10m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:33:03.814 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 63s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:33:03.814 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 63s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:33:03.815 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 63s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:33:03.815 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 63s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:33:03.815 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:33:03.816 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:33:03.816 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:33:03.816 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 10m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:33:03.816 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 10m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:33:03.817 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 10m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:33:04.067 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:33:04.067 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:33:04.068 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:33:04.068 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:33:04.068 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:33:04.068 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:33:04.069 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:33:04.069 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:33:04.069 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:33:04.069 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:33:04.069 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:33:04.070 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:33:04.070 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:33:04.070 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:33:04.070 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:33:04.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:03 gibba013 bash[29418]: cluster 2021-03-10T17:33:02.101542+0000 mgr.gibba020.yqfnwy (mgr.34427) 11585 : cluster [DBG] pgmap v6608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:04.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:03 gibba013 bash[30381]: cluster 2021-03-10T17:33:02.101542+0000 mgr.gibba020.yqfnwy (mgr.34427) 11585 : cluster [DBG] pgmap v6608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:04.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:03 gibba020 bash[25448]: cluster 2021-03-10T17:33:02.101542+0000 mgr.gibba020.yqfnwy (mgr.34427) 11585 : cluster [DBG] pgmap v6608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:05.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:05 gibba013 bash[29418]: audit 2021-03-10T17:33:03.576554+0000 mgr.gibba020.yqfnwy (mgr.34427) 11586 : audit [DBG] from='client.51828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:33:05.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:05 gibba013 bash[29418]: audit 2021-03-10T17:33:03.800186+0000 mgr.gibba020.yqfnwy (mgr.34427) 11587 : audit [DBG] from='client.61813 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:33:05.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:05 gibba013 bash[29418]: audit 2021-03-10T17:33:04.065404+0000 mon.a (mon.0) 4060 : audit [DBG] from='client.? 172.21.2.113:0/490172318' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:05.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:05 gibba013 bash[29418]: audit 2021-03-10T17:33:04.778591+0000 mon.a (mon.0) 4061 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:33:05.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:05 gibba013 bash[29418]: audit 2021-03-10T17:33:04.995868+0000 mon.a (mon.0) 4062 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:33:05.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:05 gibba013 bash[30381]: audit 2021-03-10T17:33:03.576554+0000 mgr.gibba020.yqfnwy (mgr.34427) 11586 : audit [DBG] from='client.51828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:33:05.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:05 gibba013 bash[30381]: audit 2021-03-10T17:33:03.800186+0000 mgr.gibba020.yqfnwy (mgr.34427) 11587 : audit [DBG] from='client.61813 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:33:05.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:05 gibba013 bash[30381]: audit 2021-03-10T17:33:04.065404+0000 mon.a (mon.0) 4060 : audit [DBG] from='client.? 172.21.2.113:0/490172318' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:05.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:05 gibba013 bash[30381]: audit 2021-03-10T17:33:04.778591+0000 mon.a (mon.0) 4061 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:33:05.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:05 gibba013 bash[30381]: audit 2021-03-10T17:33:04.995868+0000 mon.a (mon.0) 4062 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:33:05.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:05 gibba020 bash[25448]: audit 2021-03-10T17:33:03.576554+0000 mgr.gibba020.yqfnwy (mgr.34427) 11586 : audit [DBG] from='client.51828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:33:05.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:05 gibba020 bash[25448]: audit 2021-03-10T17:33:03.800186+0000 mgr.gibba020.yqfnwy (mgr.34427) 11587 : audit [DBG] from='client.61813 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:33:05.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:05 gibba020 bash[25448]: audit 2021-03-10T17:33:04.065404+0000 mon.a (mon.0) 4060 : audit [DBG] from='client.? 172.21.2.113:0/490172318' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:05.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:05 gibba020 bash[25448]: audit 2021-03-10T17:33:04.778591+0000 mon.a (mon.0) 4061 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:33:05.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:05 gibba020 bash[25448]: audit 2021-03-10T17:33:04.995868+0000 mon.a (mon.0) 4062 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:33:06.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:06 gibba013 bash[29418]: cluster 2021-03-10T17:33:04.102040+0000 mgr.gibba020.yqfnwy (mgr.34427) 11588 : cluster [DBG] pgmap v6609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:06.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:06 gibba013 bash[29418]: cephadm 2021-03-10T17:33:04.778823+0000 mgr.gibba020.yqfnwy (mgr.34427) 11589 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:33:06.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:06 gibba013 bash[29418]: cephadm 2021-03-10T17:33:04.998176+0000 mgr.gibba020.yqfnwy (mgr.34427) 11590 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:33:06.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:06 gibba013 bash[29418]: audit 2021-03-10T17:33:05.000054+0000 mon.a (mon.0) 4063 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:33:06.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:06 gibba013 bash[29418]: cephadm 2021-03-10T17:33:05.000610+0000 mgr.gibba020.yqfnwy (mgr.34427) 11591 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:33:06.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:06 gibba013 bash[29418]: audit 2021-03-10T17:33:05.001371+0000 mon.a (mon.0) 4064 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:06.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:06 gibba013 bash[29418]: cephadm 2021-03-10T17:33:05.002687+0000 mgr.gibba020.yqfnwy (mgr.34427) 11592 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:33:06.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:06 gibba013 bash[29418]: cephadm 2021-03-10T17:33:05.002724+0000 mgr.gibba020.yqfnwy (mgr.34427) 11593 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:33:06.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:06 gibba013 bash[29418]: audit 2021-03-10T17:33:05.003494+0000 mon.a (mon.0) 4065 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:06.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:06 gibba013 bash[29418]: cephadm 2021-03-10T17:33:05.003736+0000 mgr.gibba020.yqfnwy (mgr.34427) 11594 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:33:06.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:06 gibba013 bash[29418]: cephadm 2021-03-10T17:33:05.003774+0000 mgr.gibba020.yqfnwy (mgr.34427) 11595 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:33:06.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:06 gibba013 bash[29418]: audit 2021-03-10T17:33:05.004477+0000 mon.a (mon.0) 4066 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:06.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:06 gibba013 bash[29418]: cephadm 2021-03-10T17:33:05.004781+0000 mgr.gibba020.yqfnwy (mgr.34427) 11596 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:33:06.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:06 gibba013 bash[29418]: cephadm 2021-03-10T17:33:05.005603+0000 mgr.gibba020.yqfnwy (mgr.34427) 11597 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:33:06.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:06 gibba013 bash[29418]: cephadm 2021-03-10T17:33:05.005641+0000 mgr.gibba020.yqfnwy (mgr.34427) 11598 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:33:06.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:06 gibba013 bash[29418]: audit 2021-03-10T17:33:05.006533+0000 mon.a (mon.0) 4067 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:06.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:06 gibba013 bash[29418]: cephadm 2021-03-10T17:33:05.006820+0000 mgr.gibba020.yqfnwy (mgr.34427) 11599 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:33:06.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:06 gibba013 bash[29418]: cephadm 2021-03-10T17:33:05.007151+0000 mgr.gibba020.yqfnwy (mgr.34427) 11600 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:33:06.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:06 gibba013 bash[29418]: audit 2021-03-10T17:33:05.007824+0000 mon.a (mon.0) 4068 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:06.386 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:06 gibba013 bash[29418]: cephadm 2021-03-10T17:33:05.008062+0000 mgr.gibba020.yqfnwy (mgr.34427) 11601 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:33:06.387 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:06 gibba013 bash[29418]: cephadm 2021-03-10T17:33:05.008098+0000 mgr.gibba020.yqfnwy (mgr.34427) 11602 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:33:06.387 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:06 gibba013 bash[29418]: cephadm 2021-03-10T17:33:05.008204+0000 mgr.gibba020.yqfnwy (mgr.34427) 11603 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:33:06.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:06 gibba013 bash[30381]: cluster 2021-03-10T17:33:04.102040+0000 mgr.gibba020.yqfnwy (mgr.34427) 11588 : cluster [DBG] pgmap v6609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:06.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:06 gibba013 bash[30381]: cephadm 2021-03-10T17:33:04.778823+0000 mgr.gibba020.yqfnwy (mgr.34427) 11589 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:33:06.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:06 gibba013 bash[30381]: cephadm 2021-03-10T17:33:04.998176+0000 mgr.gibba020.yqfnwy (mgr.34427) 11590 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:33:06.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:06 gibba013 bash[30381]: audit 2021-03-10T17:33:05.000054+0000 mon.a (mon.0) 4063 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:33:06.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:06 gibba013 bash[30381]: cephadm 2021-03-10T17:33:05.000610+0000 mgr.gibba020.yqfnwy (mgr.34427) 11591 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:33:06.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:06 gibba013 bash[30381]: audit 2021-03-10T17:33:05.001371+0000 mon.a (mon.0) 4064 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:06.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:06 gibba013 bash[30381]: cephadm 2021-03-10T17:33:05.002687+0000 mgr.gibba020.yqfnwy (mgr.34427) 11592 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:33:06.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:06 gibba013 bash[30381]: cephadm 2021-03-10T17:33:05.002724+0000 mgr.gibba020.yqfnwy (mgr.34427) 11593 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:33:06.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:06 gibba013 bash[30381]: audit 2021-03-10T17:33:05.003494+0000 mon.a (mon.0) 4065 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:06.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:06 gibba013 bash[30381]: cephadm 2021-03-10T17:33:05.003736+0000 mgr.gibba020.yqfnwy (mgr.34427) 11594 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:33:06.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:06 gibba013 bash[30381]: cephadm 2021-03-10T17:33:05.003774+0000 mgr.gibba020.yqfnwy (mgr.34427) 11595 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:33:06.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:06 gibba013 bash[30381]: audit 2021-03-10T17:33:05.004477+0000 mon.a (mon.0) 4066 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:06.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:06 gibba013 bash[30381]: cephadm 2021-03-10T17:33:05.004781+0000 mgr.gibba020.yqfnwy (mgr.34427) 11596 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:33:06.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:06 gibba013 bash[30381]: cephadm 2021-03-10T17:33:05.005603+0000 mgr.gibba020.yqfnwy (mgr.34427) 11597 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:33:06.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:06 gibba013 bash[30381]: cephadm 2021-03-10T17:33:05.005641+0000 mgr.gibba020.yqfnwy (mgr.34427) 11598 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:33:06.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:06 gibba013 bash[30381]: audit 2021-03-10T17:33:05.006533+0000 mon.a (mon.0) 4067 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:06.391 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:06 gibba013 bash[30381]: cephadm 2021-03-10T17:33:05.006820+0000 mgr.gibba020.yqfnwy (mgr.34427) 11599 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:33:06.391 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:06 gibba013 bash[30381]: cephadm 2021-03-10T17:33:05.007151+0000 mgr.gibba020.yqfnwy (mgr.34427) 11600 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:33:06.391 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:06 gibba013 bash[30381]: audit 2021-03-10T17:33:05.007824+0000 mon.a (mon.0) 4068 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:06.391 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:06 gibba013 bash[30381]: cephadm 2021-03-10T17:33:05.008062+0000 mgr.gibba020.yqfnwy (mgr.34427) 11601 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:33:06.392 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:06 gibba013 bash[30381]: cephadm 2021-03-10T17:33:05.008098+0000 mgr.gibba020.yqfnwy (mgr.34427) 11602 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:33:06.392 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:06 gibba013 bash[30381]: cephadm 2021-03-10T17:33:05.008204+0000 mgr.gibba020.yqfnwy (mgr.34427) 11603 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:33:06.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:06 gibba020 bash[25448]: cluster 2021-03-10T17:33:04.102040+0000 mgr.gibba020.yqfnwy (mgr.34427) 11588 : cluster [DBG] pgmap v6609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:06.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:06 gibba020 bash[25448]: cephadm 2021-03-10T17:33:04.778823+0000 mgr.gibba020.yqfnwy (mgr.34427) 11589 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:33:06.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:06 gibba020 bash[25448]: cephadm 2021-03-10T17:33:04.998176+0000 mgr.gibba020.yqfnwy (mgr.34427) 11590 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:33:06.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:06 gibba020 bash[25448]: audit 2021-03-10T17:33:05.000054+0000 mon.a (mon.0) 4063 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:33:06.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:06 gibba020 bash[25448]: cephadm 2021-03-10T17:33:05.000610+0000 mgr.gibba020.yqfnwy (mgr.34427) 11591 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:33:06.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:06 gibba020 bash[25448]: audit 2021-03-10T17:33:05.001371+0000 mon.a (mon.0) 4064 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:06.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:06 gibba020 bash[25448]: cephadm 2021-03-10T17:33:05.002687+0000 mgr.gibba020.yqfnwy (mgr.34427) 11592 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:33:06.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:06 gibba020 bash[25448]: cephadm 2021-03-10T17:33:05.002724+0000 mgr.gibba020.yqfnwy (mgr.34427) 11593 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:33:06.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:06 gibba020 bash[25448]: audit 2021-03-10T17:33:05.003494+0000 mon.a (mon.0) 4065 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:06.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:06 gibba020 bash[25448]: cephadm 2021-03-10T17:33:05.003736+0000 mgr.gibba020.yqfnwy (mgr.34427) 11594 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:33:06.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:06 gibba020 bash[25448]: cephadm 2021-03-10T17:33:05.003774+0000 mgr.gibba020.yqfnwy (mgr.34427) 11595 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:33:06.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:06 gibba020 bash[25448]: audit 2021-03-10T17:33:05.004477+0000 mon.a (mon.0) 4066 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:06.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:06 gibba020 bash[25448]: cephadm 2021-03-10T17:33:05.004781+0000 mgr.gibba020.yqfnwy (mgr.34427) 11596 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:33:06.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:06 gibba020 bash[25448]: cephadm 2021-03-10T17:33:05.005603+0000 mgr.gibba020.yqfnwy (mgr.34427) 11597 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:33:06.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:06 gibba020 bash[25448]: cephadm 2021-03-10T17:33:05.005641+0000 mgr.gibba020.yqfnwy (mgr.34427) 11598 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:33:06.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:06 gibba020 bash[25448]: audit 2021-03-10T17:33:05.006533+0000 mon.a (mon.0) 4067 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:06.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:06 gibba020 bash[25448]: cephadm 2021-03-10T17:33:05.006820+0000 mgr.gibba020.yqfnwy (mgr.34427) 11599 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:33:06.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:06 gibba020 bash[25448]: cephadm 2021-03-10T17:33:05.007151+0000 mgr.gibba020.yqfnwy (mgr.34427) 11600 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:33:06.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:06 gibba020 bash[25448]: audit 2021-03-10T17:33:05.007824+0000 mon.a (mon.0) 4068 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:06.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:06 gibba020 bash[25448]: cephadm 2021-03-10T17:33:05.008062+0000 mgr.gibba020.yqfnwy (mgr.34427) 11601 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:33:06.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:06 gibba020 bash[25448]: cephadm 2021-03-10T17:33:05.008098+0000 mgr.gibba020.yqfnwy (mgr.34427) 11602 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:33:06.455 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:06 gibba020 bash[25448]: cephadm 2021-03-10T17:33:05.008204+0000 mgr.gibba020.yqfnwy (mgr.34427) 11603 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:33:08.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:08 gibba013 bash[29418]: cluster 2021-03-10T17:33:06.103743+0000 mgr.gibba020.yqfnwy (mgr.34427) 11604 : cluster [DBG] pgmap v6610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:08.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:08 gibba013 bash[29418]: audit 2021-03-10T17:33:07.021796+0000 mon.a (mon.0) 4069 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:33:08.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:08 gibba013 bash[29418]: audit 2021-03-10T17:33:07.273640+0000 mon.a (mon.0) 4070 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:33:08.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:08 gibba013 bash[29418]: audit 2021-03-10T17:33:07.736115+0000 mon.a (mon.0) 4071 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:33:08.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:08 gibba013 bash[29418]: audit 2021-03-10T17:33:07.736840+0000 mon.a (mon.0) 4072 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:33:08.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:08 gibba013 bash[29418]: audit 2021-03-10T17:33:07.737559+0000 mon.a (mon.0) 4073 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T17:33:08.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:08 gibba013 bash[29418]: audit 2021-03-10T17:33:07.738241+0000 mon.a (mon.0) 4074 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:33:08.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:08 gibba013 bash[30381]: cluster 2021-03-10T17:33:06.103743+0000 mgr.gibba020.yqfnwy (mgr.34427) 11604 : cluster [DBG] pgmap v6610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:08.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:08 gibba013 bash[30381]: audit 2021-03-10T17:33:07.021796+0000 mon.a (mon.0) 4069 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:33:08.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:08 gibba013 bash[30381]: audit 2021-03-10T17:33:07.273640+0000 mon.a (mon.0) 4070 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:33:08.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:08 gibba013 bash[30381]: audit 2021-03-10T17:33:07.736115+0000 mon.a (mon.0) 4071 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:33:08.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:08 gibba013 bash[30381]: audit 2021-03-10T17:33:07.736840+0000 mon.a (mon.0) 4072 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:33:08.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:08 gibba013 bash[30381]: audit 2021-03-10T17:33:07.737559+0000 mon.a (mon.0) 4073 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T17:33:08.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:08 gibba013 bash[30381]: audit 2021-03-10T17:33:07.738241+0000 mon.a (mon.0) 4074 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:33:08.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:08 gibba020 bash[25448]: cluster 2021-03-10T17:33:06.103743+0000 mgr.gibba020.yqfnwy (mgr.34427) 11604 : cluster [DBG] pgmap v6610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:08.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:08 gibba020 bash[25448]: audit 2021-03-10T17:33:07.021796+0000 mon.a (mon.0) 4069 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:33:08.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:08 gibba020 bash[25448]: audit 2021-03-10T17:33:07.273640+0000 mon.a (mon.0) 4070 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:33:08.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:08 gibba020 bash[25448]: audit 2021-03-10T17:33:07.736115+0000 mon.a (mon.0) 4071 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:33:08.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:08 gibba020 bash[25448]: audit 2021-03-10T17:33:07.736840+0000 mon.a (mon.0) 4072 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T17:33:08.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:08 gibba020 bash[25448]: audit 2021-03-10T17:33:07.737559+0000 mon.a (mon.0) 4073 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T17:33:08.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:08 gibba020 bash[25448]: audit 2021-03-10T17:33:07.738241+0000 mon.a (mon.0) 4074 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:33:10.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:10 gibba013 bash[29418]: cluster 2021-03-10T17:33:08.104850+0000 mgr.gibba020.yqfnwy (mgr.34427) 11605 : cluster [DBG] pgmap v6611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:10.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:10 gibba013 bash[30381]: cluster 2021-03-10T17:33:08.104850+0000 mgr.gibba020.yqfnwy (mgr.34427) 11605 : cluster [DBG] pgmap v6611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:10.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:10 gibba020 bash[25448]: cluster 2021-03-10T17:33:08.104850+0000 mgr.gibba020.yqfnwy (mgr.34427) 11605 : cluster [DBG] pgmap v6611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:12.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:12 gibba013 bash[29418]: cluster 2021-03-10T17:33:10.106678+0000 mgr.gibba020.yqfnwy (mgr.34427) 11606 : cluster [DBG] pgmap v6612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:12.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:12 gibba013 bash[30381]: cluster 2021-03-10T17:33:10.106678+0000 mgr.gibba020.yqfnwy (mgr.34427) 11606 : cluster [DBG] pgmap v6612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:12.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:12 gibba020 bash[25448]: cluster 2021-03-10T17:33:10.106678+0000 mgr.gibba020.yqfnwy (mgr.34427) 11606 : cluster [DBG] pgmap v6612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:14.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:14 gibba013 bash[29418]: cluster 2021-03-10T17:33:12.107637+0000 mgr.gibba020.yqfnwy (mgr.34427) 11607 : cluster [DBG] pgmap v6613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:14.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:14 gibba013 bash[30381]: cluster 2021-03-10T17:33:12.107637+0000 mgr.gibba020.yqfnwy (mgr.34427) 11607 : cluster [DBG] pgmap v6613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:14.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:14 gibba020 bash[25448]: cluster 2021-03-10T17:33:12.107637+0000 mgr.gibba020.yqfnwy (mgr.34427) 11607 : cluster [DBG] pgmap v6613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:16.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:16 gibba013 bash[29418]: cluster 2021-03-10T17:33:14.108489+0000 mgr.gibba020.yqfnwy (mgr.34427) 11608 : cluster [DBG] pgmap v6614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:16.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:16 gibba013 bash[30381]: cluster 2021-03-10T17:33:14.108489+0000 mgr.gibba020.yqfnwy (mgr.34427) 11608 : cluster [DBG] pgmap v6614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:16.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:16 gibba020 bash[25448]: cluster 2021-03-10T17:33:14.108489+0000 mgr.gibba020.yqfnwy (mgr.34427) 11608 : cluster [DBG] pgmap v6614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:18.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:18 gibba013 bash[29418]: cluster 2021-03-10T17:33:16.109211+0000 mgr.gibba020.yqfnwy (mgr.34427) 11609 : cluster [DBG] pgmap v6615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:18.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:18 gibba013 bash[30381]: cluster 2021-03-10T17:33:16.109211+0000 mgr.gibba020.yqfnwy (mgr.34427) 11609 : cluster [DBG] pgmap v6615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:18.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:18 gibba020 bash[25448]: cluster 2021-03-10T17:33:16.109211+0000 mgr.gibba020.yqfnwy (mgr.34427) 11609 : cluster [DBG] pgmap v6615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:20.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:20 gibba013 bash[29418]: cluster 2021-03-10T17:33:18.110201+0000 mgr.gibba020.yqfnwy (mgr.34427) 11610 : cluster [DBG] pgmap v6616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:20.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:20 gibba013 bash[30381]: cluster 2021-03-10T17:33:18.110201+0000 mgr.gibba020.yqfnwy (mgr.34427) 11610 : cluster [DBG] pgmap v6616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:20.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:20 gibba020 bash[25448]: cluster 2021-03-10T17:33:18.110201+0000 mgr.gibba020.yqfnwy (mgr.34427) 11610 : cluster [DBG] pgmap v6616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:21.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:21 gibba013 bash[29418]: cephadm 2021-03-10T17:33:20.015801+0000 mgr.gibba020.yqfnwy (mgr.34427) 11611 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:33:21.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:21 gibba013 bash[30381]: cephadm 2021-03-10T17:33:20.015801+0000 mgr.gibba020.yqfnwy (mgr.34427) 11611 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:33:21.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:21 gibba020 bash[25448]: cephadm 2021-03-10T17:33:20.015801+0000 mgr.gibba020.yqfnwy (mgr.34427) 11611 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:33:22.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:22 gibba013 bash[29418]: cluster 2021-03-10T17:33:20.112212+0000 mgr.gibba020.yqfnwy (mgr.34427) 11612 : cluster [DBG] pgmap v6617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:22.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:22 gibba013 bash[30381]: cluster 2021-03-10T17:33:20.112212+0000 mgr.gibba020.yqfnwy (mgr.34427) 11612 : cluster [DBG] pgmap v6617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:22.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:22 gibba020 bash[25448]: cluster 2021-03-10T17:33:20.112212+0000 mgr.gibba020.yqfnwy (mgr.34427) 11612 : cluster [DBG] pgmap v6617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:24.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:24 gibba013 bash[29418]: cluster 2021-03-10T17:33:22.113020+0000 mgr.gibba020.yqfnwy (mgr.34427) 11613 : cluster [DBG] pgmap v6618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:24.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:24 gibba013 bash[30381]: cluster 2021-03-10T17:33:22.113020+0000 mgr.gibba020.yqfnwy (mgr.34427) 11613 : cluster [DBG] pgmap v6618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:24.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:24 gibba020 bash[25448]: cluster 2021-03-10T17:33:22.113020+0000 mgr.gibba020.yqfnwy (mgr.34427) 11613 : cluster [DBG] pgmap v6618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:25.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:25 gibba013 bash[29418]: cluster 2021-03-10T17:33:24.113670+0000 mgr.gibba020.yqfnwy (mgr.34427) 11614 : cluster [DBG] pgmap v6619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:25.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:25 gibba013 bash[30381]: cluster 2021-03-10T17:33:24.113670+0000 mgr.gibba020.yqfnwy (mgr.34427) 11614 : cluster [DBG] pgmap v6619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:25.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:25 gibba020 bash[25448]: cluster 2021-03-10T17:33:24.113670+0000 mgr.gibba020.yqfnwy (mgr.34427) 11614 : cluster [DBG] pgmap v6619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:27.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:27 gibba013 bash[29418]: cluster 2021-03-10T17:33:26.115340+0000 mgr.gibba020.yqfnwy (mgr.34427) 11615 : cluster [DBG] pgmap v6620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:27.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:27 gibba013 bash[30381]: cluster 2021-03-10T17:33:26.115340+0000 mgr.gibba020.yqfnwy (mgr.34427) 11615 : cluster [DBG] pgmap v6620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:27.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:27 gibba020 bash[25448]: cluster 2021-03-10T17:33:26.115340+0000 mgr.gibba020.yqfnwy (mgr.34427) 11615 : cluster [DBG] pgmap v6620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:29.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:29 gibba013 bash[29418]: cluster 2021-03-10T17:33:28.116463+0000 mgr.gibba020.yqfnwy (mgr.34427) 11616 : cluster [DBG] pgmap v6621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:29.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:29 gibba013 bash[30381]: cluster 2021-03-10T17:33:28.116463+0000 mgr.gibba020.yqfnwy (mgr.34427) 11616 : cluster [DBG] pgmap v6621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:29.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:29 gibba020 bash[25448]: cluster 2021-03-10T17:33:28.116463+0000 mgr.gibba020.yqfnwy (mgr.34427) 11616 : cluster [DBG] pgmap v6621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:31.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:31 gibba013 bash[29418]: cluster 2021-03-10T17:33:30.118440+0000 mgr.gibba020.yqfnwy (mgr.34427) 11617 : cluster [DBG] pgmap v6622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:31.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:31 gibba013 bash[30381]: cluster 2021-03-10T17:33:30.118440+0000 mgr.gibba020.yqfnwy (mgr.34427) 11617 : cluster [DBG] pgmap v6622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:31.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:31 gibba020 bash[25448]: cluster 2021-03-10T17:33:30.118440+0000 mgr.gibba020.yqfnwy (mgr.34427) 11617 : cluster [DBG] pgmap v6622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:33.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:33 gibba013 bash[29418]: cluster 2021-03-10T17:33:32.119774+0000 mgr.gibba020.yqfnwy (mgr.34427) 11618 : cluster [DBG] pgmap v6623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:33.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:33 gibba013 bash[30381]: cluster 2021-03-10T17:33:32.119774+0000 mgr.gibba020.yqfnwy (mgr.34427) 11618 : cluster [DBG] pgmap v6623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:33.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:33 gibba020 bash[25448]: cluster 2021-03-10T17:33:32.119774+0000 mgr.gibba020.yqfnwy (mgr.34427) 11618 : cluster [DBG] pgmap v6623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:34.312 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:33:34.540 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:33:34.541 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 93s ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:33:34.541 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 29s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:33:34.541 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 29s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:33:34.541 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 29s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:33:34.542 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 93s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:33:34.542 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 93s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:33:34.542 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 29s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:33:34.542 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 93s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:33:34.543 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 93s ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:33:34.543 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 29s ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:33:34.543 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 93s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:33:34.543 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 93s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:33:34.543 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 93s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:33:34.544 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 93s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:33:34.544 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 29s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:33:34.544 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 29s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:33:34.544 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 29s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:33:34.545 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 29s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:33:34.545 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 29s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:33:34.545 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 29s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:33:34.790 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:33:34.916 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:33:34.917 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:33:34.917 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:33:34.917 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:33:34.917 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:33:34.918 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:33:34.918 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:33:34.918 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:33:34.918 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:33:34.919 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:33:34.919 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:33:34.919 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:33:34.919 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:33:34.919 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:33:35.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:35 gibba020 bash[25448]: cluster 2021-03-10T17:33:34.121266+0000 mgr.gibba020.yqfnwy (mgr.34427) 11619 : cluster [DBG] pgmap v6624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:35.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:35 gibba020 bash[25448]: audit 2021-03-10T17:33:34.300359+0000 mgr.gibba020.yqfnwy (mgr.34427) 11620 : audit [DBG] from='client.51846 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:33:35.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:35 gibba020 bash[25448]: audit 2021-03-10T17:33:34.525777+0000 mgr.gibba020.yqfnwy (mgr.34427) 11621 : audit [DBG] from='client.61831 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:33:35.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:35 gibba020 bash[25448]: audit 2021-03-10T17:33:34.788440+0000 mon.a (mon.0) 4075 : audit [DBG] from='client.? 172.21.2.113:0/986803965' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:35.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:35 gibba020 bash[25448]: cephadm 2021-03-10T17:33:35.022115+0000 mgr.gibba020.yqfnwy (mgr.34427) 11622 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:33:35.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:35 gibba013 bash[29418]: cluster 2021-03-10T17:33:34.121266+0000 mgr.gibba020.yqfnwy (mgr.34427) 11619 : cluster [DBG] pgmap v6624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:35.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:35 gibba013 bash[29418]: audit 2021-03-10T17:33:34.300359+0000 mgr.gibba020.yqfnwy (mgr.34427) 11620 : audit [DBG] from='client.51846 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:33:35.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:35 gibba013 bash[29418]: audit 2021-03-10T17:33:34.525777+0000 mgr.gibba020.yqfnwy (mgr.34427) 11621 : audit [DBG] from='client.61831 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:33:35.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:35 gibba013 bash[29418]: audit 2021-03-10T17:33:34.788440+0000 mon.a (mon.0) 4075 : audit [DBG] from='client.? 172.21.2.113:0/986803965' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:35.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:35 gibba013 bash[29418]: cephadm 2021-03-10T17:33:35.022115+0000 mgr.gibba020.yqfnwy (mgr.34427) 11622 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:33:35.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:35 gibba013 bash[30381]: cluster 2021-03-10T17:33:34.121266+0000 mgr.gibba020.yqfnwy (mgr.34427) 11619 : cluster [DBG] pgmap v6624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:35.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:35 gibba013 bash[30381]: audit 2021-03-10T17:33:34.300359+0000 mgr.gibba020.yqfnwy (mgr.34427) 11620 : audit [DBG] from='client.51846 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:33:35.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:35 gibba013 bash[30381]: audit 2021-03-10T17:33:34.525777+0000 mgr.gibba020.yqfnwy (mgr.34427) 11621 : audit [DBG] from='client.61831 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:33:35.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:35 gibba013 bash[30381]: audit 2021-03-10T17:33:34.788440+0000 mon.a (mon.0) 4075 : audit [DBG] from='client.? 172.21.2.113:0/986803965' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:33:35.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:35 gibba013 bash[30381]: cephadm 2021-03-10T17:33:35.022115+0000 mgr.gibba020.yqfnwy (mgr.34427) 11622 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:33:37.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:37 gibba013 bash[29418]: cluster 2021-03-10T17:33:36.123104+0000 mgr.gibba020.yqfnwy (mgr.34427) 11623 : cluster [DBG] pgmap v6625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:37.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:37 gibba013 bash[30381]: cluster 2021-03-10T17:33:36.123104+0000 mgr.gibba020.yqfnwy (mgr.34427) 11623 : cluster [DBG] pgmap v6625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:37.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:37 gibba020 bash[25448]: cluster 2021-03-10T17:33:36.123104+0000 mgr.gibba020.yqfnwy (mgr.34427) 11623 : cluster [DBG] pgmap v6625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:39.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:39 gibba013 bash[29418]: cluster 2021-03-10T17:33:38.124395+0000 mgr.gibba020.yqfnwy (mgr.34427) 11624 : cluster [DBG] pgmap v6626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:39.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:39 gibba013 bash[30381]: cluster 2021-03-10T17:33:38.124395+0000 mgr.gibba020.yqfnwy (mgr.34427) 11624 : cluster [DBG] pgmap v6626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:39.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:39 gibba020 bash[25448]: cluster 2021-03-10T17:33:38.124395+0000 mgr.gibba020.yqfnwy (mgr.34427) 11624 : cluster [DBG] pgmap v6626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:41.630 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:41 gibba013 bash[29418]: cluster 2021-03-10T17:33:40.126131+0000 mgr.gibba020.yqfnwy (mgr.34427) 11625 : cluster [DBG] pgmap v6627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:41.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:41 gibba013 bash[30381]: cluster 2021-03-10T17:33:40.126131+0000 mgr.gibba020.yqfnwy (mgr.34427) 11625 : cluster [DBG] pgmap v6627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:41.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:41 gibba020 bash[25448]: cluster 2021-03-10T17:33:40.126131+0000 mgr.gibba020.yqfnwy (mgr.34427) 11625 : cluster [DBG] pgmap v6627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:43.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:43 gibba013 bash[29418]: cluster 2021-03-10T17:33:42.127532+0000 mgr.gibba020.yqfnwy (mgr.34427) 11626 : cluster [DBG] pgmap v6628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:43.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:43 gibba013 bash[30381]: cluster 2021-03-10T17:33:42.127532+0000 mgr.gibba020.yqfnwy (mgr.34427) 11626 : cluster [DBG] pgmap v6628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:43.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:43 gibba020 bash[25448]: cluster 2021-03-10T17:33:42.127532+0000 mgr.gibba020.yqfnwy (mgr.34427) 11626 : cluster [DBG] pgmap v6628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:45.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:45 gibba013 bash[29418]: cluster 2021-03-10T17:33:44.129222+0000 mgr.gibba020.yqfnwy (mgr.34427) 11627 : cluster [DBG] pgmap v6629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:45.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:45 gibba013 bash[30381]: cluster 2021-03-10T17:33:44.129222+0000 mgr.gibba020.yqfnwy (mgr.34427) 11627 : cluster [DBG] pgmap v6629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:45.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:45 gibba020 bash[25448]: cluster 2021-03-10T17:33:44.129222+0000 mgr.gibba020.yqfnwy (mgr.34427) 11627 : cluster [DBG] pgmap v6629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:47.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:47 gibba013 bash[29418]: cluster 2021-03-10T17:33:46.130795+0000 mgr.gibba020.yqfnwy (mgr.34427) 11628 : cluster [DBG] pgmap v6630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:47.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:47 gibba013 bash[30381]: cluster 2021-03-10T17:33:46.130795+0000 mgr.gibba020.yqfnwy (mgr.34427) 11628 : cluster [DBG] pgmap v6630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:47.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:47 gibba020 bash[25448]: cluster 2021-03-10T17:33:46.130795+0000 mgr.gibba020.yqfnwy (mgr.34427) 11628 : cluster [DBG] pgmap v6630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:49.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:49 gibba013 bash[29418]: cluster 2021-03-10T17:33:48.131877+0000 mgr.gibba020.yqfnwy (mgr.34427) 11629 : cluster [DBG] pgmap v6631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:49.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:49 gibba013 bash[30381]: cluster 2021-03-10T17:33:48.131877+0000 mgr.gibba020.yqfnwy (mgr.34427) 11629 : cluster [DBG] pgmap v6631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:49.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:49 gibba020 bash[25448]: cluster 2021-03-10T17:33:48.131877+0000 mgr.gibba020.yqfnwy (mgr.34427) 11629 : cluster [DBG] pgmap v6631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:50.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:50 gibba013 bash[29418]: cephadm 2021-03-10T17:33:50.037695+0000 mgr.gibba020.yqfnwy (mgr.34427) 11630 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:33:50.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:50 gibba013 bash[30381]: cephadm 2021-03-10T17:33:50.037695+0000 mgr.gibba020.yqfnwy (mgr.34427) 11630 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:33:50.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:50 gibba020 bash[25448]: cephadm 2021-03-10T17:33:50.037695+0000 mgr.gibba020.yqfnwy (mgr.34427) 11630 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:33:51.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:51 gibba013 bash[29418]: cluster 2021-03-10T17:33:50.133662+0000 mgr.gibba020.yqfnwy (mgr.34427) 11631 : cluster [DBG] pgmap v6632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:51.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:51 gibba013 bash[30381]: cluster 2021-03-10T17:33:50.133662+0000 mgr.gibba020.yqfnwy (mgr.34427) 11631 : cluster [DBG] pgmap v6632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:51.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:51 gibba020 bash[25448]: cluster 2021-03-10T17:33:50.133662+0000 mgr.gibba020.yqfnwy (mgr.34427) 11631 : cluster [DBG] pgmap v6632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:53.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:53 gibba013 bash[29418]: cluster 2021-03-10T17:33:52.135040+0000 mgr.gibba020.yqfnwy (mgr.34427) 11632 : cluster [DBG] pgmap v6633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:53.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:53 gibba013 bash[30381]: cluster 2021-03-10T17:33:52.135040+0000 mgr.gibba020.yqfnwy (mgr.34427) 11632 : cluster [DBG] pgmap v6633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:53.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:53 gibba020 bash[25448]: cluster 2021-03-10T17:33:52.135040+0000 mgr.gibba020.yqfnwy (mgr.34427) 11632 : cluster [DBG] pgmap v6633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:55.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:55 gibba013 bash[29418]: cluster 2021-03-10T17:33:54.136729+0000 mgr.gibba020.yqfnwy (mgr.34427) 11633 : cluster [DBG] pgmap v6634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:55.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:55 gibba013 bash[30381]: cluster 2021-03-10T17:33:54.136729+0000 mgr.gibba020.yqfnwy (mgr.34427) 11633 : cluster [DBG] pgmap v6634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:55.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:55 gibba020 bash[25448]: cluster 2021-03-10T17:33:54.136729+0000 mgr.gibba020.yqfnwy (mgr.34427) 11633 : cluster [DBG] pgmap v6634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:57.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:57 gibba013 bash[29418]: cluster 2021-03-10T17:33:56.138474+0000 mgr.gibba020.yqfnwy (mgr.34427) 11634 : cluster [DBG] pgmap v6635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:57.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:57 gibba013 bash[30381]: cluster 2021-03-10T17:33:56.138474+0000 mgr.gibba020.yqfnwy (mgr.34427) 11634 : cluster [DBG] pgmap v6635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:57.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:57 gibba020 bash[25448]: cluster 2021-03-10T17:33:56.138474+0000 mgr.gibba020.yqfnwy (mgr.34427) 11634 : cluster [DBG] pgmap v6635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:59.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:33:59 gibba013 bash[29418]: cluster 2021-03-10T17:33:58.139597+0000 mgr.gibba020.yqfnwy (mgr.34427) 11635 : cluster [DBG] pgmap v6636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:59.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:33:59 gibba013 bash[30381]: cluster 2021-03-10T17:33:58.139597+0000 mgr.gibba020.yqfnwy (mgr.34427) 11635 : cluster [DBG] pgmap v6636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:33:59.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:33:59 gibba020 bash[25448]: cluster 2021-03-10T17:33:58.139597+0000 mgr.gibba020.yqfnwy (mgr.34427) 11635 : cluster [DBG] pgmap v6636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:01.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:01 gibba013 bash[29418]: cluster 2021-03-10T17:34:00.140701+0000 mgr.gibba020.yqfnwy (mgr.34427) 11636 : cluster [DBG] pgmap v6637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:01.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:01 gibba013 bash[30381]: cluster 2021-03-10T17:34:00.140701+0000 mgr.gibba020.yqfnwy (mgr.34427) 11636 : cluster [DBG] pgmap v6637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:01.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:01 gibba020 bash[25448]: cluster 2021-03-10T17:34:00.140701+0000 mgr.gibba020.yqfnwy (mgr.34427) 11636 : cluster [DBG] pgmap v6637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:03.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:03 gibba013 bash[29418]: cluster 2021-03-10T17:34:02.141947+0000 mgr.gibba020.yqfnwy (mgr.34427) 11637 : cluster [DBG] pgmap v6638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:03.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:03 gibba013 bash[30381]: cluster 2021-03-10T17:34:02.141947+0000 mgr.gibba020.yqfnwy (mgr.34427) 11637 : cluster [DBG] pgmap v6638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:03.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:03 gibba020 bash[25448]: cluster 2021-03-10T17:34:02.141947+0000 mgr.gibba020.yqfnwy (mgr.34427) 11637 : cluster [DBG] pgmap v6638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:05.033 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:34:05.258 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:34:05.259 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 2m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:34:05.259 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 60s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:34:05.259 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 60s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:34:05.259 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 60s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:34:05.260 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:34:05.260 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:34:05.260 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 60s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:34:05.260 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:34:05.260 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:34:05.261 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 60s ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:34:05.261 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:34:05.261 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:34:05.261 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:34:05.261 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:34:05.262 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 60s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:34:05.262 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 60s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:34:05.262 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 60s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:34:05.262 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 60s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:34:05.263 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 60s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:34:05.263 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 60s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:34:05.510 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:34:05.510 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:34:05.511 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:34:05.511 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:34:05.511 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:34:05.512 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:34:05.512 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:34:05.512 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:34:05.512 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:34:05.512 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:34:05.513 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:34:05.513 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:34:05.513 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:34:05.513 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:34:05.513 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:34:05.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:05 gibba013 bash[29418]: cluster 2021-03-10T17:34:04.143637+0000 mgr.gibba020.yqfnwy (mgr.34427) 11638 : cluster [DBG] pgmap v6639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:05.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:05 gibba013 bash[29418]: audit 2021-03-10T17:34:05.021593+0000 mgr.gibba020.yqfnwy (mgr.34427) 11639 : audit [DBG] from='client.61843 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:34:05.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:05 gibba013 bash[29418]: audit 2021-03-10T17:34:05.054532+0000 mon.a (mon.0) 4076 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:34:05.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:05 gibba013 bash[29418]: cephadm 2021-03-10T17:34:05.058050+0000 mgr.gibba020.yqfnwy (mgr.34427) 11640 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:34:05.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:05 gibba013 bash[29418]: cephadm 2021-03-10T17:34:05.059847+0000 mgr.gibba020.yqfnwy (mgr.34427) 11641 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:34:05.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:05 gibba013 bash[29418]: audit 2021-03-10T17:34:05.281507+0000 mon.a (mon.0) 4077 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:34:05.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:05 gibba013 bash[29418]: audit 2021-03-10T17:34:05.284874+0000 mon.a (mon.0) 4078 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:34:05.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:05 gibba013 bash[29418]: audit 2021-03-10T17:34:05.286237+0000 mon.a (mon.0) 4079 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:05.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:05 gibba013 bash[29418]: audit 2021-03-10T17:34:05.287499+0000 mon.a (mon.0) 4080 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:05.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:05 gibba013 bash[29418]: audit 2021-03-10T17:34:05.288716+0000 mon.a (mon.0) 4081 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:05.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:05 gibba013 bash[29418]: audit 2021-03-10T17:34:05.290980+0000 mon.a (mon.0) 4082 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:05.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:05 gibba013 bash[29418]: audit 2021-03-10T17:34:05.292440+0000 mon.a (mon.0) 4083 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:05.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:05 gibba013 bash[30381]: cluster 2021-03-10T17:34:04.143637+0000 mgr.gibba020.yqfnwy (mgr.34427) 11638 : cluster [DBG] pgmap v6639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:05.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:05 gibba013 bash[30381]: audit 2021-03-10T17:34:05.021593+0000 mgr.gibba020.yqfnwy (mgr.34427) 11639 : audit [DBG] from='client.61843 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:34:05.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:05 gibba013 bash[30381]: audit 2021-03-10T17:34:05.054532+0000 mon.a (mon.0) 4076 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:34:05.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:05 gibba013 bash[30381]: cephadm 2021-03-10T17:34:05.058050+0000 mgr.gibba020.yqfnwy (mgr.34427) 11640 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:34:05.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:05 gibba013 bash[30381]: cephadm 2021-03-10T17:34:05.059847+0000 mgr.gibba020.yqfnwy (mgr.34427) 11641 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:34:05.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:05 gibba013 bash[30381]: audit 2021-03-10T17:34:05.281507+0000 mon.a (mon.0) 4077 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:34:05.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:05 gibba013 bash[30381]: audit 2021-03-10T17:34:05.284874+0000 mon.a (mon.0) 4078 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:34:05.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:05 gibba013 bash[30381]: audit 2021-03-10T17:34:05.286237+0000 mon.a (mon.0) 4079 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:05.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:05 gibba013 bash[30381]: audit 2021-03-10T17:34:05.287499+0000 mon.a (mon.0) 4080 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:05.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:05 gibba013 bash[30381]: audit 2021-03-10T17:34:05.288716+0000 mon.a (mon.0) 4081 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:05.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:05 gibba013 bash[30381]: audit 2021-03-10T17:34:05.290980+0000 mon.a (mon.0) 4082 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:05.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:05 gibba013 bash[30381]: audit 2021-03-10T17:34:05.292440+0000 mon.a (mon.0) 4083 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:05.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:05 gibba020 bash[25448]: cluster 2021-03-10T17:34:04.143637+0000 mgr.gibba020.yqfnwy (mgr.34427) 11638 : cluster [DBG] pgmap v6639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:05.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:05 gibba020 bash[25448]: audit 2021-03-10T17:34:05.021593+0000 mgr.gibba020.yqfnwy (mgr.34427) 11639 : audit [DBG] from='client.61843 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:34:05.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:05 gibba020 bash[25448]: audit 2021-03-10T17:34:05.054532+0000 mon.a (mon.0) 4076 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:34:05.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:05 gibba020 bash[25448]: cephadm 2021-03-10T17:34:05.058050+0000 mgr.gibba020.yqfnwy (mgr.34427) 11640 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:34:05.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:05 gibba020 bash[25448]: cephadm 2021-03-10T17:34:05.059847+0000 mgr.gibba020.yqfnwy (mgr.34427) 11641 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:34:05.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:05 gibba020 bash[25448]: audit 2021-03-10T17:34:05.281507+0000 mon.a (mon.0) 4077 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:34:05.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:05 gibba020 bash[25448]: audit 2021-03-10T17:34:05.284874+0000 mon.a (mon.0) 4078 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:34:05.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:05 gibba020 bash[25448]: audit 2021-03-10T17:34:05.286237+0000 mon.a (mon.0) 4079 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:05.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:05 gibba020 bash[25448]: audit 2021-03-10T17:34:05.287499+0000 mon.a (mon.0) 4080 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:05.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:05 gibba020 bash[25448]: audit 2021-03-10T17:34:05.288716+0000 mon.a (mon.0) 4081 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:05.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:05 gibba020 bash[25448]: audit 2021-03-10T17:34:05.290980+0000 mon.a (mon.0) 4082 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:05.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:05 gibba020 bash[25448]: audit 2021-03-10T17:34:05.292440+0000 mon.a (mon.0) 4083 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:06.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:06 gibba013 bash[30381]: audit 2021-03-10T17:34:05.248080+0000 mgr.gibba020.yqfnwy (mgr.34427) 11642 : audit [DBG] from='client.61849 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:34:06.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:06 gibba013 bash[30381]: cephadm 2021-03-10T17:34:05.283560+0000 mgr.gibba020.yqfnwy (mgr.34427) 11643 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:34:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:06 gibba013 bash[30381]: cephadm 2021-03-10T17:34:05.285325+0000 mgr.gibba020.yqfnwy (mgr.34427) 11644 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:34:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:06 gibba013 bash[30381]: cephadm 2021-03-10T17:34:05.286567+0000 mgr.gibba020.yqfnwy (mgr.34427) 11645 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:34:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:06 gibba013 bash[30381]: cephadm 2021-03-10T17:34:05.286657+0000 mgr.gibba020.yqfnwy (mgr.34427) 11646 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:34:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:06 gibba013 bash[30381]: cephadm 2021-03-10T17:34:05.287825+0000 mgr.gibba020.yqfnwy (mgr.34427) 11647 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:34:06.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:06 gibba013 bash[30381]: cephadm 2021-03-10T17:34:05.287890+0000 mgr.gibba020.yqfnwy (mgr.34427) 11648 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:34:06.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:06 gibba013 bash[30381]: cephadm 2021-03-10T17:34:05.289021+0000 mgr.gibba020.yqfnwy (mgr.34427) 11649 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:34:06.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:06 gibba013 bash[30381]: cephadm 2021-03-10T17:34:05.290017+0000 mgr.gibba020.yqfnwy (mgr.34427) 11650 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:34:06.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:06 gibba013 bash[30381]: cephadm 2021-03-10T17:34:05.290075+0000 mgr.gibba020.yqfnwy (mgr.34427) 11651 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:34:06.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:06 gibba013 bash[30381]: cephadm 2021-03-10T17:34:05.291267+0000 mgr.gibba020.yqfnwy (mgr.34427) 11652 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:34:06.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:06 gibba013 bash[30381]: cephadm 2021-03-10T17:34:05.291663+0000 mgr.gibba020.yqfnwy (mgr.34427) 11653 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:34:06.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:06 gibba013 bash[30381]: cephadm 2021-03-10T17:34:05.292700+0000 mgr.gibba020.yqfnwy (mgr.34427) 11654 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:34:06.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:06 gibba013 bash[30381]: cephadm 2021-03-10T17:34:05.292766+0000 mgr.gibba020.yqfnwy (mgr.34427) 11655 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:34:06.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:06 gibba013 bash[30381]: cephadm 2021-03-10T17:34:05.292916+0000 mgr.gibba020.yqfnwy (mgr.34427) 11656 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:34:06.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:06 gibba013 bash[30381]: audit 2021-03-10T17:34:05.508138+0000 mon.a (mon.0) 4084 : audit [DBG] from='client.? 172.21.2.113:0/3664775854' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:06.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:06 gibba013 bash[29418]: audit 2021-03-10T17:34:05.248080+0000 mgr.gibba020.yqfnwy (mgr.34427) 11642 : audit [DBG] from='client.61849 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:34:06.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:06 gibba013 bash[29418]: cephadm 2021-03-10T17:34:05.283560+0000 mgr.gibba020.yqfnwy (mgr.34427) 11643 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:34:06.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:06 gibba013 bash[29418]: cephadm 2021-03-10T17:34:05.285325+0000 mgr.gibba020.yqfnwy (mgr.34427) 11644 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:34:06.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:06 gibba013 bash[29418]: cephadm 2021-03-10T17:34:05.286567+0000 mgr.gibba020.yqfnwy (mgr.34427) 11645 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:34:06.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:06 gibba013 bash[29418]: cephadm 2021-03-10T17:34:05.286657+0000 mgr.gibba020.yqfnwy (mgr.34427) 11646 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:34:06.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:06 gibba013 bash[29418]: cephadm 2021-03-10T17:34:05.287825+0000 mgr.gibba020.yqfnwy (mgr.34427) 11647 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:34:06.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:06 gibba013 bash[29418]: cephadm 2021-03-10T17:34:05.287890+0000 mgr.gibba020.yqfnwy (mgr.34427) 11648 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:34:06.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:06 gibba013 bash[29418]: cephadm 2021-03-10T17:34:05.289021+0000 mgr.gibba020.yqfnwy (mgr.34427) 11649 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:34:06.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:06 gibba013 bash[29418]: cephadm 2021-03-10T17:34:05.290017+0000 mgr.gibba020.yqfnwy (mgr.34427) 11650 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:34:06.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:06 gibba013 bash[29418]: cephadm 2021-03-10T17:34:05.290075+0000 mgr.gibba020.yqfnwy (mgr.34427) 11651 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:34:06.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:06 gibba013 bash[29418]: cephadm 2021-03-10T17:34:05.291267+0000 mgr.gibba020.yqfnwy (mgr.34427) 11652 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:34:06.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:06 gibba013 bash[29418]: cephadm 2021-03-10T17:34:05.291663+0000 mgr.gibba020.yqfnwy (mgr.34427) 11653 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:34:06.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:06 gibba013 bash[29418]: cephadm 2021-03-10T17:34:05.292700+0000 mgr.gibba020.yqfnwy (mgr.34427) 11654 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:34:06.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:06 gibba013 bash[29418]: cephadm 2021-03-10T17:34:05.292766+0000 mgr.gibba020.yqfnwy (mgr.34427) 11655 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:34:06.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:06 gibba013 bash[29418]: cephadm 2021-03-10T17:34:05.292916+0000 mgr.gibba020.yqfnwy (mgr.34427) 11656 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:34:06.639 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:06 gibba013 bash[29418]: audit 2021-03-10T17:34:05.508138+0000 mon.a (mon.0) 4084 : audit [DBG] from='client.? 172.21.2.113:0/3664775854' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:06.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:06 gibba020 bash[25448]: audit 2021-03-10T17:34:05.248080+0000 mgr.gibba020.yqfnwy (mgr.34427) 11642 : audit [DBG] from='client.61849 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:34:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:06 gibba020 bash[25448]: cephadm 2021-03-10T17:34:05.283560+0000 mgr.gibba020.yqfnwy (mgr.34427) 11643 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:34:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:06 gibba020 bash[25448]: cephadm 2021-03-10T17:34:05.285325+0000 mgr.gibba020.yqfnwy (mgr.34427) 11644 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:34:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:06 gibba020 bash[25448]: cephadm 2021-03-10T17:34:05.286567+0000 mgr.gibba020.yqfnwy (mgr.34427) 11645 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:34:06.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:06 gibba020 bash[25448]: cephadm 2021-03-10T17:34:05.286657+0000 mgr.gibba020.yqfnwy (mgr.34427) 11646 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:34:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:06 gibba020 bash[25448]: cephadm 2021-03-10T17:34:05.287825+0000 mgr.gibba020.yqfnwy (mgr.34427) 11647 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:34:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:06 gibba020 bash[25448]: cephadm 2021-03-10T17:34:05.287890+0000 mgr.gibba020.yqfnwy (mgr.34427) 11648 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:34:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:06 gibba020 bash[25448]: cephadm 2021-03-10T17:34:05.289021+0000 mgr.gibba020.yqfnwy (mgr.34427) 11649 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:34:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:06 gibba020 bash[25448]: cephadm 2021-03-10T17:34:05.290017+0000 mgr.gibba020.yqfnwy (mgr.34427) 11650 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:34:06.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:06 gibba020 bash[25448]: cephadm 2021-03-10T17:34:05.290075+0000 mgr.gibba020.yqfnwy (mgr.34427) 11651 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:34:06.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:06 gibba020 bash[25448]: cephadm 2021-03-10T17:34:05.291267+0000 mgr.gibba020.yqfnwy (mgr.34427) 11652 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:34:06.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:06 gibba020 bash[25448]: cephadm 2021-03-10T17:34:05.291663+0000 mgr.gibba020.yqfnwy (mgr.34427) 11653 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:34:06.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:06 gibba020 bash[25448]: cephadm 2021-03-10T17:34:05.292700+0000 mgr.gibba020.yqfnwy (mgr.34427) 11654 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:34:06.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:06 gibba020 bash[25448]: cephadm 2021-03-10T17:34:05.292766+0000 mgr.gibba020.yqfnwy (mgr.34427) 11655 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:34:06.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:06 gibba020 bash[25448]: cephadm 2021-03-10T17:34:05.292916+0000 mgr.gibba020.yqfnwy (mgr.34427) 11656 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:34:06.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:06 gibba020 bash[25448]: audit 2021-03-10T17:34:05.508138+0000 mon.a (mon.0) 4084 : audit [DBG] from='client.? 172.21.2.113:0/3664775854' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:07.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:07 gibba013 bash[29418]: cluster 2021-03-10T17:34:06.145601+0000 mgr.gibba020.yqfnwy (mgr.34427) 11657 : cluster [DBG] pgmap v6640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:07.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:07 gibba013 bash[29418]: audit 2021-03-10T17:34:07.024456+0000 mon.a (mon.0) 4085 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:34:07.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:07 gibba013 bash[29418]: audit 2021-03-10T17:34:07.280370+0000 mon.a (mon.0) 4086 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:34:07.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:07 gibba013 bash[30381]: cluster 2021-03-10T17:34:06.145601+0000 mgr.gibba020.yqfnwy (mgr.34427) 11657 : cluster [DBG] pgmap v6640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:07.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:07 gibba013 bash[30381]: audit 2021-03-10T17:34:07.024456+0000 mon.a (mon.0) 4085 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:34:07.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:07 gibba013 bash[30381]: audit 2021-03-10T17:34:07.280370+0000 mon.a (mon.0) 4086 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:34:07.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:07 gibba020 bash[25448]: cluster 2021-03-10T17:34:06.145601+0000 mgr.gibba020.yqfnwy (mgr.34427) 11657 : cluster [DBG] pgmap v6640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:07.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:07 gibba020 bash[25448]: audit 2021-03-10T17:34:07.024456+0000 mon.a (mon.0) 4085 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:34:07.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:07 gibba020 bash[25448]: audit 2021-03-10T17:34:07.280370+0000 mon.a (mon.0) 4086 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:34:08.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:08 gibba020 bash[25448]: audit 2021-03-10T17:34:07.746463+0000 mon.a (mon.0) 4087 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T17:34:08.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:08 gibba020 bash[25448]: audit 2021-03-10T17:34:07.747206+0000 mon.a (mon.0) 4088 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:34:08.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:08 gibba020 bash[25448]: audit 2021-03-10T17:34:07.747884+0000 mon.a (mon.0) 4089 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T17:34:08.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:08 gibba020 bash[25448]: audit 2021-03-10T17:34:07.748545+0000 mon.a (mon.0) 4090 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:34:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:08 gibba013 bash[29418]: audit 2021-03-10T17:34:07.746463+0000 mon.a (mon.0) 4087 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T17:34:08.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:08 gibba013 bash[29418]: audit 2021-03-10T17:34:07.747206+0000 mon.a (mon.0) 4088 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:34:08.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:08 gibba013 bash[29418]: audit 2021-03-10T17:34:07.747884+0000 mon.a (mon.0) 4089 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T17:34:08.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:08 gibba013 bash[29418]: audit 2021-03-10T17:34:07.748545+0000 mon.a (mon.0) 4090 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:34:08.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:08 gibba013 bash[30381]: audit 2021-03-10T17:34:07.746463+0000 mon.a (mon.0) 4087 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T17:34:08.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:08 gibba013 bash[30381]: audit 2021-03-10T17:34:07.747206+0000 mon.a (mon.0) 4088 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:34:08.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:08 gibba013 bash[30381]: audit 2021-03-10T17:34:07.747884+0000 mon.a (mon.0) 4089 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T17:34:08.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:08 gibba013 bash[30381]: audit 2021-03-10T17:34:07.748545+0000 mon.a (mon.0) 4090 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:34:09.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:09 gibba020 bash[25448]: cluster 2021-03-10T17:34:08.146768+0000 mgr.gibba020.yqfnwy (mgr.34427) 11658 : cluster [DBG] pgmap v6641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:09.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:09 gibba013 bash[29418]: cluster 2021-03-10T17:34:08.146768+0000 mgr.gibba020.yqfnwy (mgr.34427) 11658 : cluster [DBG] pgmap v6641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:09.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:09 gibba013 bash[30381]: cluster 2021-03-10T17:34:08.146768+0000 mgr.gibba020.yqfnwy (mgr.34427) 11658 : cluster [DBG] pgmap v6641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:11.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:11 gibba020 bash[25448]: cluster 2021-03-10T17:34:10.148647+0000 mgr.gibba020.yqfnwy (mgr.34427) 11659 : cluster [DBG] pgmap v6642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:11.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:11 gibba013 bash[29418]: cluster 2021-03-10T17:34:10.148647+0000 mgr.gibba020.yqfnwy (mgr.34427) 11659 : cluster [DBG] pgmap v6642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:11.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:11 gibba013 bash[30381]: cluster 2021-03-10T17:34:10.148647+0000 mgr.gibba020.yqfnwy (mgr.34427) 11659 : cluster [DBG] pgmap v6642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:13.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:13 gibba020 bash[25448]: cluster 2021-03-10T17:34:12.149974+0000 mgr.gibba020.yqfnwy (mgr.34427) 11660 : cluster [DBG] pgmap v6643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:13.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:13 gibba013 bash[29418]: cluster 2021-03-10T17:34:12.149974+0000 mgr.gibba020.yqfnwy (mgr.34427) 11660 : cluster [DBG] pgmap v6643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:13.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:13 gibba013 bash[30381]: cluster 2021-03-10T17:34:12.149974+0000 mgr.gibba020.yqfnwy (mgr.34427) 11660 : cluster [DBG] pgmap v6643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:15.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:15 gibba020 bash[25448]: cluster 2021-03-10T17:34:14.151042+0000 mgr.gibba020.yqfnwy (mgr.34427) 11661 : cluster [DBG] pgmap v6644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:15.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:15 gibba013 bash[29418]: cluster 2021-03-10T17:34:14.151042+0000 mgr.gibba020.yqfnwy (mgr.34427) 11661 : cluster [DBG] pgmap v6644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:15.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:15 gibba013 bash[30381]: cluster 2021-03-10T17:34:14.151042+0000 mgr.gibba020.yqfnwy (mgr.34427) 11661 : cluster [DBG] pgmap v6644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:17.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:17 gibba020 bash[25448]: cluster 2021-03-10T17:34:16.152654+0000 mgr.gibba020.yqfnwy (mgr.34427) 11662 : cluster [DBG] pgmap v6645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:17.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:17 gibba013 bash[29418]: cluster 2021-03-10T17:34:16.152654+0000 mgr.gibba020.yqfnwy (mgr.34427) 11662 : cluster [DBG] pgmap v6645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:17.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:17 gibba013 bash[30381]: cluster 2021-03-10T17:34:16.152654+0000 mgr.gibba020.yqfnwy (mgr.34427) 11662 : cluster [DBG] pgmap v6645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:19.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:19 gibba020 bash[25448]: cluster 2021-03-10T17:34:18.153735+0000 mgr.gibba020.yqfnwy (mgr.34427) 11663 : cluster [DBG] pgmap v6646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:19.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:19 gibba013 bash[29418]: cluster 2021-03-10T17:34:18.153735+0000 mgr.gibba020.yqfnwy (mgr.34427) 11663 : cluster [DBG] pgmap v6646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:19.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:19 gibba013 bash[30381]: cluster 2021-03-10T17:34:18.153735+0000 mgr.gibba020.yqfnwy (mgr.34427) 11663 : cluster [DBG] pgmap v6646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:21.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:21 gibba013 bash[29418]: cluster 2021-03-10T17:34:20.154595+0000 mgr.gibba020.yqfnwy (mgr.34427) 11664 : cluster [DBG] pgmap v6647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:21.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:21 gibba013 bash[29418]: cephadm 2021-03-10T17:34:20.308924+0000 mgr.gibba020.yqfnwy (mgr.34427) 11665 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:34:21.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:21 gibba013 bash[30381]: cluster 2021-03-10T17:34:20.154595+0000 mgr.gibba020.yqfnwy (mgr.34427) 11664 : cluster [DBG] pgmap v6647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:21.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:21 gibba013 bash[30381]: cephadm 2021-03-10T17:34:20.308924+0000 mgr.gibba020.yqfnwy (mgr.34427) 11665 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:34:21.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:21 gibba020 bash[25448]: cluster 2021-03-10T17:34:20.154595+0000 mgr.gibba020.yqfnwy (mgr.34427) 11664 : cluster [DBG] pgmap v6647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:21.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:21 gibba020 bash[25448]: cephadm 2021-03-10T17:34:20.308924+0000 mgr.gibba020.yqfnwy (mgr.34427) 11665 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:34:23.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:23 gibba013 bash[29418]: cluster 2021-03-10T17:34:22.155831+0000 mgr.gibba020.yqfnwy (mgr.34427) 11666 : cluster [DBG] pgmap v6648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:23.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:23 gibba013 bash[30381]: cluster 2021-03-10T17:34:22.155831+0000 mgr.gibba020.yqfnwy (mgr.34427) 11666 : cluster [DBG] pgmap v6648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:23.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:23 gibba020 bash[25448]: cluster 2021-03-10T17:34:22.155831+0000 mgr.gibba020.yqfnwy (mgr.34427) 11666 : cluster [DBG] pgmap v6648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:25.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:25 gibba013 bash[29418]: cluster 2021-03-10T17:34:24.157507+0000 mgr.gibba020.yqfnwy (mgr.34427) 11667 : cluster [DBG] pgmap v6649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:25.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:25 gibba013 bash[30381]: cluster 2021-03-10T17:34:24.157507+0000 mgr.gibba020.yqfnwy (mgr.34427) 11667 : cluster [DBG] pgmap v6649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:25.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:25 gibba020 bash[25448]: cluster 2021-03-10T17:34:24.157507+0000 mgr.gibba020.yqfnwy (mgr.34427) 11667 : cluster [DBG] pgmap v6649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:27.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:27 gibba013 bash[29418]: cluster 2021-03-10T17:34:26.158205+0000 mgr.gibba020.yqfnwy (mgr.34427) 11668 : cluster [DBG] pgmap v6650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:27.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:27 gibba013 bash[30381]: cluster 2021-03-10T17:34:26.158205+0000 mgr.gibba020.yqfnwy (mgr.34427) 11668 : cluster [DBG] pgmap v6650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:27.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:27 gibba020 bash[25448]: cluster 2021-03-10T17:34:26.158205+0000 mgr.gibba020.yqfnwy (mgr.34427) 11668 : cluster [DBG] pgmap v6650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:29.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:29 gibba013 bash[29418]: cluster 2021-03-10T17:34:28.159205+0000 mgr.gibba020.yqfnwy (mgr.34427) 11669 : cluster [DBG] pgmap v6651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:29.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:29 gibba013 bash[30381]: cluster 2021-03-10T17:34:28.159205+0000 mgr.gibba020.yqfnwy (mgr.34427) 11669 : cluster [DBG] pgmap v6651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:29.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:29 gibba020 bash[25448]: cluster 2021-03-10T17:34:28.159205+0000 mgr.gibba020.yqfnwy (mgr.34427) 11669 : cluster [DBG] pgmap v6651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:31.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:31 gibba013 bash[29418]: cluster 2021-03-10T17:34:30.160980+0000 mgr.gibba020.yqfnwy (mgr.34427) 11670 : cluster [DBG] pgmap v6652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:31.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:31 gibba013 bash[30381]: cluster 2021-03-10T17:34:30.160980+0000 mgr.gibba020.yqfnwy (mgr.34427) 11670 : cluster [DBG] pgmap v6652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:31.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:31 gibba020 bash[25448]: cluster 2021-03-10T17:34:30.160980+0000 mgr.gibba020.yqfnwy (mgr.34427) 11670 : cluster [DBG] pgmap v6652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:33.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:33 gibba013 bash[29418]: cluster 2021-03-10T17:34:32.161671+0000 mgr.gibba020.yqfnwy (mgr.34427) 11671 : cluster [DBG] pgmap v6653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:33.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:33 gibba013 bash[30381]: cluster 2021-03-10T17:34:32.161671+0000 mgr.gibba020.yqfnwy (mgr.34427) 11671 : cluster [DBG] pgmap v6653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:33.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:33 gibba020 bash[25448]: cluster 2021-03-10T17:34:32.161671+0000 mgr.gibba020.yqfnwy (mgr.34427) 11671 : cluster [DBG] pgmap v6653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:35.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:35 gibba020 bash[25448]: cluster 2021-03-10T17:34:34.163181+0000 mgr.gibba020.yqfnwy (mgr.34427) 11672 : cluster [DBG] pgmap v6654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:35.751 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:34:35.880 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:35 gibba013 bash[29418]: cluster 2021-03-10T17:34:34.163181+0000 mgr.gibba020.yqfnwy (mgr.34427) 11672 : cluster [DBG] pgmap v6654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:35.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:35 gibba013 bash[30381]: cluster 2021-03-10T17:34:34.163181+0000 mgr.gibba020.yqfnwy (mgr.34427) 11672 : cluster [DBG] pgmap v6654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:35.977 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:34:35.977 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 2m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:34:35.977 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 91s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:34:35.978 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 91s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:34:35.978 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 91s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:34:35.978 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:34:35.978 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:34:35.979 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 91s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:34:35.979 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:34:35.979 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:34:35.979 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 91s ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:34:35.979 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:34:35.980 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:34:35.980 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:34:35.980 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:34:35.980 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 91s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:34:35.980 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 91s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:34:35.981 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 91s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:34:35.981 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 91s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:34:35.981 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 91s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:34:35.981 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 91s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:34:36.225 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:34:36.225 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:34:36.225 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:34:36.226 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:34:36.226 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:34:36.226 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:34:36.226 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:34:36.227 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:34:36.227 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:34:36.227 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:34:36.227 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:34:36.227 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:34:36.228 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:34:36.228 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:34:36.228 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:34:36.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:36 gibba013 bash[29418]: cephadm 2021-03-10T17:34:35.316976+0000 mgr.gibba020.yqfnwy (mgr.34427) 11673 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:34:37.001 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:36 gibba013 bash[29418]: audit 2021-03-10T17:34:35.738937+0000 mgr.gibba020.yqfnwy (mgr.34427) 11674 : audit [DBG] from='client.61861 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:34:37.001 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:36 gibba013 bash[29418]: audit 2021-03-10T17:34:35.962010+0000 mgr.gibba020.yqfnwy (mgr.34427) 11675 : audit [DBG] from='client.51888 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:34:37.001 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:36 gibba013 bash[29418]: audit 2021-03-10T17:34:36.222800+0000 mon.c (mon.1) 178 : audit [DBG] from='client.? 172.21.2.113:0/820862224' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:37.002 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:36 gibba013 bash[30381]: cephadm 2021-03-10T17:34:35.316976+0000 mgr.gibba020.yqfnwy (mgr.34427) 11673 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:34:37.002 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:36 gibba013 bash[30381]: audit 2021-03-10T17:34:35.738937+0000 mgr.gibba020.yqfnwy (mgr.34427) 11674 : audit [DBG] from='client.61861 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:34:37.002 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:36 gibba013 bash[30381]: audit 2021-03-10T17:34:35.962010+0000 mgr.gibba020.yqfnwy (mgr.34427) 11675 : audit [DBG] from='client.51888 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:34:37.003 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:36 gibba013 bash[30381]: audit 2021-03-10T17:34:36.222800+0000 mon.c (mon.1) 178 : audit [DBG] from='client.? 172.21.2.113:0/820862224' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:37.003 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:36 gibba020 bash[25448]: cephadm 2021-03-10T17:34:35.316976+0000 mgr.gibba020.yqfnwy (mgr.34427) 11673 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:34:37.003 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:36 gibba020 bash[25448]: audit 2021-03-10T17:34:35.738937+0000 mgr.gibba020.yqfnwy (mgr.34427) 11674 : audit [DBG] from='client.61861 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:34:37.004 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:36 gibba020 bash[25448]: audit 2021-03-10T17:34:35.962010+0000 mgr.gibba020.yqfnwy (mgr.34427) 11675 : audit [DBG] from='client.51888 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:34:37.004 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:36 gibba020 bash[25448]: audit 2021-03-10T17:34:36.222800+0000 mon.c (mon.1) 178 : audit [DBG] from='client.? 172.21.2.113:0/820862224' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:34:37.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:37 gibba013 bash[29418]: cluster 2021-03-10T17:34:36.165038+0000 mgr.gibba020.yqfnwy (mgr.34427) 11676 : cluster [DBG] pgmap v6655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:37.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:37 gibba013 bash[30381]: cluster 2021-03-10T17:34:36.165038+0000 mgr.gibba020.yqfnwy (mgr.34427) 11676 : cluster [DBG] pgmap v6655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:37.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:37 gibba020 bash[25448]: cluster 2021-03-10T17:34:36.165038+0000 mgr.gibba020.yqfnwy (mgr.34427) 11676 : cluster [DBG] pgmap v6655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:39.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:39 gibba013 bash[29418]: cluster 2021-03-10T17:34:38.166155+0000 mgr.gibba020.yqfnwy (mgr.34427) 11677 : cluster [DBG] pgmap v6656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:39.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:39 gibba013 bash[30381]: cluster 2021-03-10T17:34:38.166155+0000 mgr.gibba020.yqfnwy (mgr.34427) 11677 : cluster [DBG] pgmap v6656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:39.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:39 gibba020 bash[25448]: cluster 2021-03-10T17:34:38.166155+0000 mgr.gibba020.yqfnwy (mgr.34427) 11677 : cluster [DBG] pgmap v6656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:41.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:41 gibba013 bash[29418]: cluster 2021-03-10T17:34:40.168103+0000 mgr.gibba020.yqfnwy (mgr.34427) 11678 : cluster [DBG] pgmap v6657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:41.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:41 gibba013 bash[30381]: cluster 2021-03-10T17:34:40.168103+0000 mgr.gibba020.yqfnwy (mgr.34427) 11678 : cluster [DBG] pgmap v6657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:41.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:41 gibba020 bash[25448]: cluster 2021-03-10T17:34:40.168103+0000 mgr.gibba020.yqfnwy (mgr.34427) 11678 : cluster [DBG] pgmap v6657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:43.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:43 gibba013 bash[29418]: cluster 2021-03-10T17:34:42.169193+0000 mgr.gibba020.yqfnwy (mgr.34427) 11679 : cluster [DBG] pgmap v6658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:43.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:43 gibba013 bash[30381]: cluster 2021-03-10T17:34:42.169193+0000 mgr.gibba020.yqfnwy (mgr.34427) 11679 : cluster [DBG] pgmap v6658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:43.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:43 gibba020 bash[25448]: cluster 2021-03-10T17:34:42.169193+0000 mgr.gibba020.yqfnwy (mgr.34427) 11679 : cluster [DBG] pgmap v6658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:45.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:45 gibba013 bash[29418]: cluster 2021-03-10T17:34:44.169964+0000 mgr.gibba020.yqfnwy (mgr.34427) 11680 : cluster [DBG] pgmap v6659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:45.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:45 gibba013 bash[30381]: cluster 2021-03-10T17:34:44.169964+0000 mgr.gibba020.yqfnwy (mgr.34427) 11680 : cluster [DBG] pgmap v6659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:45.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:45 gibba020 bash[25448]: cluster 2021-03-10T17:34:44.169964+0000 mgr.gibba020.yqfnwy (mgr.34427) 11680 : cluster [DBG] pgmap v6659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:47.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:47 gibba013 bash[29418]: cluster 2021-03-10T17:34:46.171741+0000 mgr.gibba020.yqfnwy (mgr.34427) 11681 : cluster [DBG] pgmap v6660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:47.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:47 gibba013 bash[30381]: cluster 2021-03-10T17:34:46.171741+0000 mgr.gibba020.yqfnwy (mgr.34427) 11681 : cluster [DBG] pgmap v6660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:47.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:47 gibba020 bash[25448]: cluster 2021-03-10T17:34:46.171741+0000 mgr.gibba020.yqfnwy (mgr.34427) 11681 : cluster [DBG] pgmap v6660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:49.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:49 gibba013 bash[29418]: cluster 2021-03-10T17:34:48.172926+0000 mgr.gibba020.yqfnwy (mgr.34427) 11682 : cluster [DBG] pgmap v6661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:49.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:49 gibba013 bash[30381]: cluster 2021-03-10T17:34:48.172926+0000 mgr.gibba020.yqfnwy (mgr.34427) 11682 : cluster [DBG] pgmap v6661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:49.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:49 gibba020 bash[25448]: cluster 2021-03-10T17:34:48.172926+0000 mgr.gibba020.yqfnwy (mgr.34427) 11682 : cluster [DBG] pgmap v6661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:51.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:51 gibba013 bash[29418]: cluster 2021-03-10T17:34:50.173861+0000 mgr.gibba020.yqfnwy (mgr.34427) 11683 : cluster [DBG] pgmap v6662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:51.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:51 gibba013 bash[29418]: cephadm 2021-03-10T17:34:50.333037+0000 mgr.gibba020.yqfnwy (mgr.34427) 11684 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:34:51.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:51 gibba013 bash[30381]: cluster 2021-03-10T17:34:50.173861+0000 mgr.gibba020.yqfnwy (mgr.34427) 11683 : cluster [DBG] pgmap v6662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:51.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:51 gibba013 bash[30381]: cephadm 2021-03-10T17:34:50.333037+0000 mgr.gibba020.yqfnwy (mgr.34427) 11684 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:34:51.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:51 gibba020 bash[25448]: cluster 2021-03-10T17:34:50.173861+0000 mgr.gibba020.yqfnwy (mgr.34427) 11683 : cluster [DBG] pgmap v6662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:51.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:51 gibba020 bash[25448]: cephadm 2021-03-10T17:34:50.333037+0000 mgr.gibba020.yqfnwy (mgr.34427) 11684 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:34:53.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:53 gibba013 bash[29418]: cluster 2021-03-10T17:34:52.175143+0000 mgr.gibba020.yqfnwy (mgr.34427) 11685 : cluster [DBG] pgmap v6663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:53.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:53 gibba013 bash[30381]: cluster 2021-03-10T17:34:52.175143+0000 mgr.gibba020.yqfnwy (mgr.34427) 11685 : cluster [DBG] pgmap v6663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:53.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:53 gibba020 bash[25448]: cluster 2021-03-10T17:34:52.175143+0000 mgr.gibba020.yqfnwy (mgr.34427) 11685 : cluster [DBG] pgmap v6663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:55.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:55 gibba013 bash[29418]: cluster 2021-03-10T17:34:54.176563+0000 mgr.gibba020.yqfnwy (mgr.34427) 11686 : cluster [DBG] pgmap v6664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:55.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:55 gibba013 bash[30381]: cluster 2021-03-10T17:34:54.176563+0000 mgr.gibba020.yqfnwy (mgr.34427) 11686 : cluster [DBG] pgmap v6664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:55.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:55 gibba020 bash[25448]: cluster 2021-03-10T17:34:54.176563+0000 mgr.gibba020.yqfnwy (mgr.34427) 11686 : cluster [DBG] pgmap v6664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:57.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:57 gibba013 bash[29418]: cluster 2021-03-10T17:34:56.177410+0000 mgr.gibba020.yqfnwy (mgr.34427) 11687 : cluster [DBG] pgmap v6665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:57.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:57 gibba013 bash[30381]: cluster 2021-03-10T17:34:56.177410+0000 mgr.gibba020.yqfnwy (mgr.34427) 11687 : cluster [DBG] pgmap v6665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:57.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:57 gibba020 bash[25448]: cluster 2021-03-10T17:34:56.177410+0000 mgr.gibba020.yqfnwy (mgr.34427) 11687 : cluster [DBG] pgmap v6665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:59.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:34:59 gibba013 bash[29418]: cluster 2021-03-10T17:34:58.178410+0000 mgr.gibba020.yqfnwy (mgr.34427) 11688 : cluster [DBG] pgmap v6666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:59.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:34:59 gibba013 bash[30381]: cluster 2021-03-10T17:34:58.178410+0000 mgr.gibba020.yqfnwy (mgr.34427) 11688 : cluster [DBG] pgmap v6666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:34:59.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:34:59 gibba020 bash[25448]: cluster 2021-03-10T17:34:58.178410+0000 mgr.gibba020.yqfnwy (mgr.34427) 11688 : cluster [DBG] pgmap v6666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:01.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:01 gibba020 bash[25448]: cluster 2021-03-10T17:35:00.180451+0000 mgr.gibba020.yqfnwy (mgr.34427) 11689 : cluster [DBG] pgmap v6667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:01.953 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:01 gibba013 bash[29418]: cluster 2021-03-10T17:35:00.180451+0000 mgr.gibba020.yqfnwy (mgr.34427) 11689 : cluster [DBG] pgmap v6667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:01.953 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:01 gibba013 bash[30381]: cluster 2021-03-10T17:35:00.180451+0000 mgr.gibba020.yqfnwy (mgr.34427) 11689 : cluster [DBG] pgmap v6667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:03.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:03 gibba020 bash[25448]: cluster 2021-03-10T17:35:02.181307+0000 mgr.gibba020.yqfnwy (mgr.34427) 11690 : cluster [DBG] pgmap v6668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:04.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:03 gibba013 bash[29418]: cluster 2021-03-10T17:35:02.181307+0000 mgr.gibba020.yqfnwy (mgr.34427) 11690 : cluster [DBG] pgmap v6668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:04.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:03 gibba013 bash[30381]: cluster 2021-03-10T17:35:02.181307+0000 mgr.gibba020.yqfnwy (mgr.34427) 11690 : cluster [DBG] pgmap v6668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:05.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:05 gibba020 bash[25448]: cluster 2021-03-10T17:35:04.182578+0000 mgr.gibba020.yqfnwy (mgr.34427) 11691 : cluster [DBG] pgmap v6669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:05.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:05 gibba020 bash[25448]: audit 2021-03-10T17:35:05.349453+0000 mon.a (mon.0) 4091 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:35:05.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:05 gibba020 bash[25448]: audit 2021-03-10T17:35:05.564841+0000 mon.a (mon.0) 4092 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:35:05.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:05 gibba020 bash[25448]: audit 2021-03-10T17:35:05.568672+0000 mon.a (mon.0) 4093 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:35:05.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:05 gibba020 bash[25448]: audit 2021-03-10T17:35:05.570254+0000 mon.a (mon.0) 4094 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:05.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:05 gibba020 bash[25448]: audit 2021-03-10T17:35:05.571691+0000 mon.a (mon.0) 4095 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:05.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:05 gibba020 bash[25448]: audit 2021-03-10T17:35:05.572818+0000 mon.a (mon.0) 4096 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:05.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:05 gibba020 bash[25448]: audit 2021-03-10T17:35:05.575318+0000 mon.a (mon.0) 4097 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:05.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:05 gibba020 bash[25448]: audit 2021-03-10T17:35:05.576756+0000 mon.a (mon.0) 4098 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:06.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:05 gibba013 bash[29418]: cluster 2021-03-10T17:35:04.182578+0000 mgr.gibba020.yqfnwy (mgr.34427) 11691 : cluster [DBG] pgmap v6669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:06.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:05 gibba013 bash[29418]: audit 2021-03-10T17:35:05.349453+0000 mon.a (mon.0) 4091 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:35:06.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:05 gibba013 bash[29418]: audit 2021-03-10T17:35:05.564841+0000 mon.a (mon.0) 4092 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:35:06.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:05 gibba013 bash[29418]: audit 2021-03-10T17:35:05.568672+0000 mon.a (mon.0) 4093 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:35:06.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:05 gibba013 bash[29418]: audit 2021-03-10T17:35:05.570254+0000 mon.a (mon.0) 4094 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:06.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:05 gibba013 bash[29418]: audit 2021-03-10T17:35:05.571691+0000 mon.a (mon.0) 4095 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:06.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:05 gibba013 bash[29418]: audit 2021-03-10T17:35:05.572818+0000 mon.a (mon.0) 4096 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:06.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:05 gibba013 bash[29418]: audit 2021-03-10T17:35:05.575318+0000 mon.a (mon.0) 4097 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:06.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:05 gibba013 bash[29418]: audit 2021-03-10T17:35:05.576756+0000 mon.a (mon.0) 4098 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:06.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:05 gibba013 bash[30381]: cluster 2021-03-10T17:35:04.182578+0000 mgr.gibba020.yqfnwy (mgr.34427) 11691 : cluster [DBG] pgmap v6669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:06.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:05 gibba013 bash[30381]: audit 2021-03-10T17:35:05.349453+0000 mon.a (mon.0) 4091 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:35:06.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:05 gibba013 bash[30381]: audit 2021-03-10T17:35:05.564841+0000 mon.a (mon.0) 4092 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:35:06.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:05 gibba013 bash[30381]: audit 2021-03-10T17:35:05.568672+0000 mon.a (mon.0) 4093 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:35:06.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:05 gibba013 bash[30381]: audit 2021-03-10T17:35:05.570254+0000 mon.a (mon.0) 4094 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:06.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:05 gibba013 bash[30381]: audit 2021-03-10T17:35:05.571691+0000 mon.a (mon.0) 4095 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:06.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:05 gibba013 bash[30381]: audit 2021-03-10T17:35:05.572818+0000 mon.a (mon.0) 4096 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:06.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:05 gibba013 bash[30381]: audit 2021-03-10T17:35:05.575318+0000 mon.a (mon.0) 4097 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:06.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:05 gibba013 bash[30381]: audit 2021-03-10T17:35:05.576756+0000 mon.a (mon.0) 4098 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:06.471 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:35:06.727 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:35:06.727 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 3m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:35:06.727 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 2m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:35:06.728 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:35:06.728 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:35:06.728 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:35:06.728 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:35:06.728 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:35:06.729 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:35:06.729 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:35:06.729 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:35:06.729 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:35:06.730 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:35:06.730 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:35:06.730 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:35:06.730 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:35:06.730 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:35:06.731 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:35:06.731 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:35:06.731 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 2m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:35:06.731 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:35:06.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:06 gibba020 bash[25448]: cephadm 2021-03-10T17:35:05.353016+0000 mgr.gibba020.yqfnwy (mgr.34427) 11692 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:35:06.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:06 gibba020 bash[25448]: cephadm 2021-03-10T17:35:05.354765+0000 mgr.gibba020.yqfnwy (mgr.34427) 11693 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:35:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:06 gibba020 bash[25448]: cephadm 2021-03-10T17:35:05.567096+0000 mgr.gibba020.yqfnwy (mgr.34427) 11694 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:35:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:06 gibba020 bash[25448]: cephadm 2021-03-10T17:35:05.569276+0000 mgr.gibba020.yqfnwy (mgr.34427) 11695 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:35:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:06 gibba020 bash[25448]: cephadm 2021-03-10T17:35:05.570591+0000 mgr.gibba020.yqfnwy (mgr.34427) 11696 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:35:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:06 gibba020 bash[25448]: cephadm 2021-03-10T17:35:05.570636+0000 mgr.gibba020.yqfnwy (mgr.34427) 11697 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:35:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:06 gibba020 bash[25448]: cephadm 2021-03-10T17:35:05.572016+0000 mgr.gibba020.yqfnwy (mgr.34427) 11698 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:35:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:06 gibba020 bash[25448]: cephadm 2021-03-10T17:35:05.572059+0000 mgr.gibba020.yqfnwy (mgr.34427) 11699 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:35:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:06 gibba020 bash[25448]: cephadm 2021-03-10T17:35:05.573166+0000 mgr.gibba020.yqfnwy (mgr.34427) 11700 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:35:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:06 gibba020 bash[25448]: cephadm 2021-03-10T17:35:05.574129+0000 mgr.gibba020.yqfnwy (mgr.34427) 11701 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:35:06.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:06 gibba020 bash[25448]: cephadm 2021-03-10T17:35:05.574174+0000 mgr.gibba020.yqfnwy (mgr.34427) 11702 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:35:06.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:06 gibba020 bash[25448]: cephadm 2021-03-10T17:35:05.575550+0000 mgr.gibba020.yqfnwy (mgr.34427) 11703 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:35:06.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:06 gibba020 bash[25448]: cephadm 2021-03-10T17:35:05.575948+0000 mgr.gibba020.yqfnwy (mgr.34427) 11704 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:35:06.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:06 gibba020 bash[25448]: cephadm 2021-03-10T17:35:05.577004+0000 mgr.gibba020.yqfnwy (mgr.34427) 11705 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:35:06.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:06 gibba020 bash[25448]: cephadm 2021-03-10T17:35:05.577051+0000 mgr.gibba020.yqfnwy (mgr.34427) 11706 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:35:06.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:06 gibba020 bash[25448]: cephadm 2021-03-10T17:35:05.577173+0000 mgr.gibba020.yqfnwy (mgr.34427) 11707 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:35:07.039 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:35:07.039 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:35:07.040 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:35:07.040 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:35:07.040 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:35:07.040 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:35:07.041 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:35:07.041 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:35:07.041 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:35:07.041 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:35:07.041 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:35:07.042 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:35:07.042 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:35:07.042 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:35:07.042 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:35:07.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:06 gibba013 bash[29418]: cephadm 2021-03-10T17:35:05.353016+0000 mgr.gibba020.yqfnwy (mgr.34427) 11692 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:35:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:06 gibba013 bash[29418]: cephadm 2021-03-10T17:35:05.354765+0000 mgr.gibba020.yqfnwy (mgr.34427) 11693 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:35:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:06 gibba013 bash[29418]: cephadm 2021-03-10T17:35:05.567096+0000 mgr.gibba020.yqfnwy (mgr.34427) 11694 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:35:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:06 gibba013 bash[29418]: cephadm 2021-03-10T17:35:05.569276+0000 mgr.gibba020.yqfnwy (mgr.34427) 11695 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:35:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:06 gibba013 bash[29418]: cephadm 2021-03-10T17:35:05.570591+0000 mgr.gibba020.yqfnwy (mgr.34427) 11696 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:35:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:06 gibba013 bash[29418]: cephadm 2021-03-10T17:35:05.570636+0000 mgr.gibba020.yqfnwy (mgr.34427) 11697 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:35:07.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:06 gibba013 bash[29418]: cephadm 2021-03-10T17:35:05.572016+0000 mgr.gibba020.yqfnwy (mgr.34427) 11698 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:35:07.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:06 gibba013 bash[29418]: cephadm 2021-03-10T17:35:05.572059+0000 mgr.gibba020.yqfnwy (mgr.34427) 11699 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:35:07.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:06 gibba013 bash[29418]: cephadm 2021-03-10T17:35:05.573166+0000 mgr.gibba020.yqfnwy (mgr.34427) 11700 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:35:07.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:06 gibba013 bash[29418]: cephadm 2021-03-10T17:35:05.574129+0000 mgr.gibba020.yqfnwy (mgr.34427) 11701 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:35:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:06 gibba013 bash[29418]: cephadm 2021-03-10T17:35:05.574174+0000 mgr.gibba020.yqfnwy (mgr.34427) 11702 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:35:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:06 gibba013 bash[29418]: cephadm 2021-03-10T17:35:05.575550+0000 mgr.gibba020.yqfnwy (mgr.34427) 11703 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:35:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:06 gibba013 bash[29418]: cephadm 2021-03-10T17:35:05.575948+0000 mgr.gibba020.yqfnwy (mgr.34427) 11704 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:35:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:06 gibba013 bash[29418]: cephadm 2021-03-10T17:35:05.577004+0000 mgr.gibba020.yqfnwy (mgr.34427) 11705 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:35:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:06 gibba013 bash[29418]: cephadm 2021-03-10T17:35:05.577051+0000 mgr.gibba020.yqfnwy (mgr.34427) 11706 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:35:07.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:06 gibba013 bash[29418]: cephadm 2021-03-10T17:35:05.577173+0000 mgr.gibba020.yqfnwy (mgr.34427) 11707 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:35:07.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:06 gibba013 bash[30381]: cephadm 2021-03-10T17:35:05.353016+0000 mgr.gibba020.yqfnwy (mgr.34427) 11692 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:35:07.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:06 gibba013 bash[30381]: cephadm 2021-03-10T17:35:05.354765+0000 mgr.gibba020.yqfnwy (mgr.34427) 11693 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:35:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:06 gibba013 bash[30381]: cephadm 2021-03-10T17:35:05.567096+0000 mgr.gibba020.yqfnwy (mgr.34427) 11694 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:35:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:06 gibba013 bash[30381]: cephadm 2021-03-10T17:35:05.569276+0000 mgr.gibba020.yqfnwy (mgr.34427) 11695 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:35:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:06 gibba013 bash[30381]: cephadm 2021-03-10T17:35:05.570591+0000 mgr.gibba020.yqfnwy (mgr.34427) 11696 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:35:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:06 gibba013 bash[30381]: cephadm 2021-03-10T17:35:05.570636+0000 mgr.gibba020.yqfnwy (mgr.34427) 11697 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:35:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:06 gibba013 bash[30381]: cephadm 2021-03-10T17:35:05.572016+0000 mgr.gibba020.yqfnwy (mgr.34427) 11698 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:35:07.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:06 gibba013 bash[30381]: cephadm 2021-03-10T17:35:05.572059+0000 mgr.gibba020.yqfnwy (mgr.34427) 11699 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:35:07.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:06 gibba013 bash[30381]: cephadm 2021-03-10T17:35:05.573166+0000 mgr.gibba020.yqfnwy (mgr.34427) 11700 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:35:07.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:06 gibba013 bash[30381]: cephadm 2021-03-10T17:35:05.574129+0000 mgr.gibba020.yqfnwy (mgr.34427) 11701 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:35:07.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:06 gibba013 bash[30381]: cephadm 2021-03-10T17:35:05.574174+0000 mgr.gibba020.yqfnwy (mgr.34427) 11702 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:35:07.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:06 gibba013 bash[30381]: cephadm 2021-03-10T17:35:05.575550+0000 mgr.gibba020.yqfnwy (mgr.34427) 11703 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:35:07.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:06 gibba013 bash[30381]: cephadm 2021-03-10T17:35:05.575948+0000 mgr.gibba020.yqfnwy (mgr.34427) 11704 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:35:07.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:06 gibba013 bash[30381]: cephadm 2021-03-10T17:35:05.577004+0000 mgr.gibba020.yqfnwy (mgr.34427) 11705 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:35:07.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:06 gibba013 bash[30381]: cephadm 2021-03-10T17:35:05.577051+0000 mgr.gibba020.yqfnwy (mgr.34427) 11706 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:35:07.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:06 gibba013 bash[30381]: cephadm 2021-03-10T17:35:05.577173+0000 mgr.gibba020.yqfnwy (mgr.34427) 11707 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:35:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:07 gibba020 bash[25448]: cluster 2021-03-10T17:35:06.184143+0000 mgr.gibba020.yqfnwy (mgr.34427) 11708 : cluster [DBG] pgmap v6670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:07 gibba020 bash[25448]: audit 2021-03-10T17:35:06.459321+0000 mgr.gibba020.yqfnwy (mgr.34427) 11709 : audit [DBG] from='client.61879 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:35:07.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:07 gibba020 bash[25448]: audit 2021-03-10T17:35:06.685210+0000 mgr.gibba020.yqfnwy (mgr.34427) 11710 : audit [DBG] from='client.61885 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:35:07.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:07 gibba020 bash[25448]: audit 2021-03-10T17:35:07.028956+0000 mon.a (mon.0) 4099 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:35:07.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:07 gibba020 bash[25448]: audit 2021-03-10T17:35:07.037140+0000 mon.a (mon.0) 4100 : audit [DBG] from='client.? 172.21.2.113:0/179483318' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:07.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:07 gibba020 bash[25448]: audit 2021-03-10T17:35:07.287000+0000 mon.a (mon.0) 4101 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:35:08.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:07 gibba013 bash[29418]: cluster 2021-03-10T17:35:06.184143+0000 mgr.gibba020.yqfnwy (mgr.34427) 11708 : cluster [DBG] pgmap v6670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:08.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:07 gibba013 bash[29418]: audit 2021-03-10T17:35:06.459321+0000 mgr.gibba020.yqfnwy (mgr.34427) 11709 : audit [DBG] from='client.61879 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:35:08.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:07 gibba013 bash[29418]: audit 2021-03-10T17:35:06.685210+0000 mgr.gibba020.yqfnwy (mgr.34427) 11710 : audit [DBG] from='client.61885 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:35:08.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:07 gibba013 bash[29418]: audit 2021-03-10T17:35:07.028956+0000 mon.a (mon.0) 4099 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:35:08.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:07 gibba013 bash[29418]: audit 2021-03-10T17:35:07.037140+0000 mon.a (mon.0) 4100 : audit [DBG] from='client.? 172.21.2.113:0/179483318' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:08.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:07 gibba013 bash[29418]: audit 2021-03-10T17:35:07.287000+0000 mon.a (mon.0) 4101 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:35:08.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:07 gibba013 bash[30381]: cluster 2021-03-10T17:35:06.184143+0000 mgr.gibba020.yqfnwy (mgr.34427) 11708 : cluster [DBG] pgmap v6670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:08.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:07 gibba013 bash[30381]: audit 2021-03-10T17:35:06.459321+0000 mgr.gibba020.yqfnwy (mgr.34427) 11709 : audit [DBG] from='client.61879 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:35:08.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:07 gibba013 bash[30381]: audit 2021-03-10T17:35:06.685210+0000 mgr.gibba020.yqfnwy (mgr.34427) 11710 : audit [DBG] from='client.61885 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:35:08.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:07 gibba013 bash[30381]: audit 2021-03-10T17:35:07.028956+0000 mon.a (mon.0) 4099 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:35:08.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:07 gibba013 bash[30381]: audit 2021-03-10T17:35:07.037140+0000 mon.a (mon.0) 4100 : audit [DBG] from='client.? 172.21.2.113:0/179483318' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:08.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:07 gibba013 bash[30381]: audit 2021-03-10T17:35:07.287000+0000 mon.a (mon.0) 4101 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:35:08.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:08 gibba020 bash[25448]: audit 2021-03-10T17:35:07.756054+0000 mon.a (mon.0) 4102 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T17:35:08.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:08 gibba020 bash[25448]: audit 2021-03-10T17:35:07.756893+0000 mon.a (mon.0) 4103 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:35:08.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:08 gibba020 bash[25448]: audit 2021-03-10T17:35:07.757740+0000 mon.a (mon.0) 4104 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:35:08.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:08 gibba020 bash[25448]: audit 2021-03-10T17:35:07.758733+0000 mon.a (mon.0) 4105 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:35:09.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:08 gibba013 bash[29418]: audit 2021-03-10T17:35:07.756054+0000 mon.a (mon.0) 4102 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T17:35:09.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:08 gibba013 bash[29418]: audit 2021-03-10T17:35:07.756893+0000 mon.a (mon.0) 4103 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:35:09.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:08 gibba013 bash[29418]: audit 2021-03-10T17:35:07.757740+0000 mon.a (mon.0) 4104 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:35:09.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:08 gibba013 bash[29418]: audit 2021-03-10T17:35:07.758733+0000 mon.a (mon.0) 4105 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:35:09.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:08 gibba013 bash[30381]: audit 2021-03-10T17:35:07.756054+0000 mon.a (mon.0) 4102 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T17:35:09.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:08 gibba013 bash[30381]: audit 2021-03-10T17:35:07.756893+0000 mon.a (mon.0) 4103 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:35:09.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:08 gibba013 bash[30381]: audit 2021-03-10T17:35:07.757740+0000 mon.a (mon.0) 4104 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:35:09.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:08 gibba013 bash[30381]: audit 2021-03-10T17:35:07.758733+0000 mon.a (mon.0) 4105 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:35:09.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:09 gibba020 bash[25448]: cluster 2021-03-10T17:35:08.185230+0000 mgr.gibba020.yqfnwy (mgr.34427) 11711 : cluster [DBG] pgmap v6671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:10.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:09 gibba013 bash[29418]: cluster 2021-03-10T17:35:08.185230+0000 mgr.gibba020.yqfnwy (mgr.34427) 11711 : cluster [DBG] pgmap v6671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:10.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:09 gibba013 bash[30381]: cluster 2021-03-10T17:35:08.185230+0000 mgr.gibba020.yqfnwy (mgr.34427) 11711 : cluster [DBG] pgmap v6671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:11.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:11 gibba020 bash[25448]: cluster 2021-03-10T17:35:10.187010+0000 mgr.gibba020.yqfnwy (mgr.34427) 11712 : cluster [DBG] pgmap v6672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:12.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:11 gibba013 bash[29418]: cluster 2021-03-10T17:35:10.187010+0000 mgr.gibba020.yqfnwy (mgr.34427) 11712 : cluster [DBG] pgmap v6672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:12.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:11 gibba013 bash[30381]: cluster 2021-03-10T17:35:10.187010+0000 mgr.gibba020.yqfnwy (mgr.34427) 11712 : cluster [DBG] pgmap v6672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:14.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:13 gibba013 bash[29418]: cluster 2021-03-10T17:35:12.188184+0000 mgr.gibba020.yqfnwy (mgr.34427) 11713 : cluster [DBG] pgmap v6673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:14.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:13 gibba013 bash[30381]: cluster 2021-03-10T17:35:12.188184+0000 mgr.gibba020.yqfnwy (mgr.34427) 11713 : cluster [DBG] pgmap v6673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:14.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:13 gibba020 bash[25448]: cluster 2021-03-10T17:35:12.188184+0000 mgr.gibba020.yqfnwy (mgr.34427) 11713 : cluster [DBG] pgmap v6673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:16.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:15 gibba013 bash[29418]: cluster 2021-03-10T17:35:14.188875+0000 mgr.gibba020.yqfnwy (mgr.34427) 11714 : cluster [DBG] pgmap v6674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:16.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:15 gibba013 bash[30381]: cluster 2021-03-10T17:35:14.188875+0000 mgr.gibba020.yqfnwy (mgr.34427) 11714 : cluster [DBG] pgmap v6674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:16.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:15 gibba020 bash[25448]: cluster 2021-03-10T17:35:14.188875+0000 mgr.gibba020.yqfnwy (mgr.34427) 11714 : cluster [DBG] pgmap v6674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:18.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:17 gibba013 bash[29418]: cluster 2021-03-10T17:35:16.190478+0000 mgr.gibba020.yqfnwy (mgr.34427) 11715 : cluster [DBG] pgmap v6675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:18.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:17 gibba013 bash[30381]: cluster 2021-03-10T17:35:16.190478+0000 mgr.gibba020.yqfnwy (mgr.34427) 11715 : cluster [DBG] pgmap v6675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:18.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:17 gibba020 bash[25448]: cluster 2021-03-10T17:35:16.190478+0000 mgr.gibba020.yqfnwy (mgr.34427) 11715 : cluster [DBG] pgmap v6675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:20.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:19 gibba013 bash[29418]: cluster 2021-03-10T17:35:18.191825+0000 mgr.gibba020.yqfnwy (mgr.34427) 11716 : cluster [DBG] pgmap v6676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:20.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:19 gibba013 bash[30381]: cluster 2021-03-10T17:35:18.191825+0000 mgr.gibba020.yqfnwy (mgr.34427) 11716 : cluster [DBG] pgmap v6676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:20.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:19 gibba020 bash[25448]: cluster 2021-03-10T17:35:18.191825+0000 mgr.gibba020.yqfnwy (mgr.34427) 11716 : cluster [DBG] pgmap v6676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:22.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:21 gibba013 bash[29418]: cluster 2021-03-10T17:35:20.193547+0000 mgr.gibba020.yqfnwy (mgr.34427) 11717 : cluster [DBG] pgmap v6677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:22.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:21 gibba013 bash[29418]: cephadm 2021-03-10T17:35:20.593259+0000 mgr.gibba020.yqfnwy (mgr.34427) 11718 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:35:22.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:21 gibba013 bash[30381]: cluster 2021-03-10T17:35:20.193547+0000 mgr.gibba020.yqfnwy (mgr.34427) 11717 : cluster [DBG] pgmap v6677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:22.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:21 gibba013 bash[30381]: cephadm 2021-03-10T17:35:20.593259+0000 mgr.gibba020.yqfnwy (mgr.34427) 11718 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:35:22.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:21 gibba020 bash[25448]: cluster 2021-03-10T17:35:20.193547+0000 mgr.gibba020.yqfnwy (mgr.34427) 11717 : cluster [DBG] pgmap v6677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:22.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:21 gibba020 bash[25448]: cephadm 2021-03-10T17:35:20.593259+0000 mgr.gibba020.yqfnwy (mgr.34427) 11718 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:35:24.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:23 gibba013 bash[29418]: cluster 2021-03-10T17:35:22.194935+0000 mgr.gibba020.yqfnwy (mgr.34427) 11719 : cluster [DBG] pgmap v6678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:24.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:23 gibba013 bash[30381]: cluster 2021-03-10T17:35:22.194935+0000 mgr.gibba020.yqfnwy (mgr.34427) 11719 : cluster [DBG] pgmap v6678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:24.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:23 gibba020 bash[25448]: cluster 2021-03-10T17:35:22.194935+0000 mgr.gibba020.yqfnwy (mgr.34427) 11719 : cluster [DBG] pgmap v6678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:26.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:25 gibba013 bash[29418]: cluster 2021-03-10T17:35:24.196336+0000 mgr.gibba020.yqfnwy (mgr.34427) 11720 : cluster [DBG] pgmap v6679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:26.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:25 gibba013 bash[30381]: cluster 2021-03-10T17:35:24.196336+0000 mgr.gibba020.yqfnwy (mgr.34427) 11720 : cluster [DBG] pgmap v6679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:26.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:25 gibba020 bash[25448]: cluster 2021-03-10T17:35:24.196336+0000 mgr.gibba020.yqfnwy (mgr.34427) 11720 : cluster [DBG] pgmap v6679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:28.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:27 gibba013 bash[29418]: cluster 2021-03-10T17:35:26.197160+0000 mgr.gibba020.yqfnwy (mgr.34427) 11721 : cluster [DBG] pgmap v6680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:28.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:27 gibba013 bash[30381]: cluster 2021-03-10T17:35:26.197160+0000 mgr.gibba020.yqfnwy (mgr.34427) 11721 : cluster [DBG] pgmap v6680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:28.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:27 gibba020 bash[25448]: cluster 2021-03-10T17:35:26.197160+0000 mgr.gibba020.yqfnwy (mgr.34427) 11721 : cluster [DBG] pgmap v6680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:30.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:29 gibba013 bash[29418]: cluster 2021-03-10T17:35:28.198273+0000 mgr.gibba020.yqfnwy (mgr.34427) 11722 : cluster [DBG] pgmap v6681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:30.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:29 gibba013 bash[30381]: cluster 2021-03-10T17:35:28.198273+0000 mgr.gibba020.yqfnwy (mgr.34427) 11722 : cluster [DBG] pgmap v6681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:30.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:29 gibba020 bash[25448]: cluster 2021-03-10T17:35:28.198273+0000 mgr.gibba020.yqfnwy (mgr.34427) 11722 : cluster [DBG] pgmap v6681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:32.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:31 gibba013 bash[29418]: cluster 2021-03-10T17:35:30.199861+0000 mgr.gibba020.yqfnwy (mgr.34427) 11723 : cluster [DBG] pgmap v6682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:32.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:31 gibba013 bash[30381]: cluster 2021-03-10T17:35:30.199861+0000 mgr.gibba020.yqfnwy (mgr.34427) 11723 : cluster [DBG] pgmap v6682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:32.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:31 gibba020 bash[25448]: cluster 2021-03-10T17:35:30.199861+0000 mgr.gibba020.yqfnwy (mgr.34427) 11723 : cluster [DBG] pgmap v6682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:34.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:33 gibba013 bash[29418]: cluster 2021-03-10T17:35:32.200418+0000 mgr.gibba020.yqfnwy (mgr.34427) 11724 : cluster [DBG] pgmap v6683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:34.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:33 gibba013 bash[30381]: cluster 2021-03-10T17:35:32.200418+0000 mgr.gibba020.yqfnwy (mgr.34427) 11724 : cluster [DBG] pgmap v6683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:34.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:33 gibba020 bash[25448]: cluster 2021-03-10T17:35:32.200418+0000 mgr.gibba020.yqfnwy (mgr.34427) 11724 : cluster [DBG] pgmap v6683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:35.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:35 gibba020 bash[25448]: cluster 2021-03-10T17:35:34.201710+0000 mgr.gibba020.yqfnwy (mgr.34427) 11725 : cluster [DBG] pgmap v6684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:36.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:35 gibba013 bash[29418]: cluster 2021-03-10T17:35:34.201710+0000 mgr.gibba020.yqfnwy (mgr.34427) 11725 : cluster [DBG] pgmap v6684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:36.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:35 gibba013 bash[30381]: cluster 2021-03-10T17:35:34.201710+0000 mgr.gibba020.yqfnwy (mgr.34427) 11725 : cluster [DBG] pgmap v6684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:37.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:36 gibba013 bash[29418]: cephadm 2021-03-10T17:35:35.609045+0000 mgr.gibba020.yqfnwy (mgr.34427) 11726 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:35:37.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:36 gibba013 bash[30381]: cephadm 2021-03-10T17:35:35.609045+0000 mgr.gibba020.yqfnwy (mgr.34427) 11726 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:35:37.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:36 gibba020 bash[25448]: cephadm 2021-03-10T17:35:35.609045+0000 mgr.gibba020.yqfnwy (mgr.34427) 11726 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:35:37.282 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:35:37.511 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:35:37.512 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 3m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:35:37.512 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 2m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:35:37.512 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:35:37.512 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:35:37.513 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:35:37.513 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:35:37.513 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:35:37.513 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:35:37.513 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:35:37.514 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:35:37.514 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:35:37.514 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:35:37.514 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:35:37.515 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:35:37.515 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:35:37.515 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:35:37.515 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:35:37.515 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:35:37.516 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 2m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:35:37.516 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:35:37.759 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:35:37.760 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:35:37.760 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:35:37.760 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:35:37.760 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:35:37.761 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:35:37.761 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:35:37.761 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:35:37.761 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:35:37.762 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:35:37.762 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:35:37.763 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:35:37.763 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:35:37.763 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:35:37.764 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:35:38.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:37 gibba013 bash[29418]: cluster 2021-03-10T17:35:36.203246+0000 mgr.gibba020.yqfnwy (mgr.34427) 11727 : cluster [DBG] pgmap v6685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:38.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:37 gibba013 bash[29418]: audit 2021-03-10T17:35:37.756984+0000 mon.a (mon.0) 4106 : audit [DBG] from='client.? 172.21.2.113:0/1598787954' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:38.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:37 gibba013 bash[30381]: cluster 2021-03-10T17:35:36.203246+0000 mgr.gibba020.yqfnwy (mgr.34427) 11727 : cluster [DBG] pgmap v6685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:38.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:37 gibba013 bash[30381]: audit 2021-03-10T17:35:37.756984+0000 mon.a (mon.0) 4106 : audit [DBG] from='client.? 172.21.2.113:0/1598787954' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:38.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:37 gibba020 bash[25448]: cluster 2021-03-10T17:35:36.203246+0000 mgr.gibba020.yqfnwy (mgr.34427) 11727 : cluster [DBG] pgmap v6685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:38.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:37 gibba020 bash[25448]: audit 2021-03-10T17:35:37.756984+0000 mon.a (mon.0) 4106 : audit [DBG] from='client.? 172.21.2.113:0/1598787954' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:35:39.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:38 gibba013 bash[29418]: audit 2021-03-10T17:35:37.270829+0000 mgr.gibba020.yqfnwy (mgr.34427) 11728 : audit [DBG] from='client.51918 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:35:39.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:38 gibba013 bash[29418]: audit 2021-03-10T17:35:37.496730+0000 mgr.gibba020.yqfnwy (mgr.34427) 11729 : audit [DBG] from='client.51924 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:35:39.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:38 gibba013 bash[30381]: audit 2021-03-10T17:35:37.270829+0000 mgr.gibba020.yqfnwy (mgr.34427) 11728 : audit [DBG] from='client.51918 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:35:39.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:38 gibba013 bash[30381]: audit 2021-03-10T17:35:37.496730+0000 mgr.gibba020.yqfnwy (mgr.34427) 11729 : audit [DBG] from='client.51924 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:35:39.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:38 gibba020 bash[25448]: audit 2021-03-10T17:35:37.270829+0000 mgr.gibba020.yqfnwy (mgr.34427) 11728 : audit [DBG] from='client.51918 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:35:39.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:38 gibba020 bash[25448]: audit 2021-03-10T17:35:37.496730+0000 mgr.gibba020.yqfnwy (mgr.34427) 11729 : audit [DBG] from='client.51924 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:35:40.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:39 gibba013 bash[29418]: cluster 2021-03-10T17:35:38.204646+0000 mgr.gibba020.yqfnwy (mgr.34427) 11730 : cluster [DBG] pgmap v6686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:40.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:39 gibba013 bash[30381]: cluster 2021-03-10T17:35:38.204646+0000 mgr.gibba020.yqfnwy (mgr.34427) 11730 : cluster [DBG] pgmap v6686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:40.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:39 gibba020 bash[25448]: cluster 2021-03-10T17:35:38.204646+0000 mgr.gibba020.yqfnwy (mgr.34427) 11730 : cluster [DBG] pgmap v6686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:42.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:41 gibba013 bash[29418]: cluster 2021-03-10T17:35:40.206227+0000 mgr.gibba020.yqfnwy (mgr.34427) 11731 : cluster [DBG] pgmap v6687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:42.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:41 gibba013 bash[30381]: cluster 2021-03-10T17:35:40.206227+0000 mgr.gibba020.yqfnwy (mgr.34427) 11731 : cluster [DBG] pgmap v6687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:42.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:41 gibba020 bash[25448]: cluster 2021-03-10T17:35:40.206227+0000 mgr.gibba020.yqfnwy (mgr.34427) 11731 : cluster [DBG] pgmap v6687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:44.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:43 gibba013 bash[29418]: cluster 2021-03-10T17:35:42.207485+0000 mgr.gibba020.yqfnwy (mgr.34427) 11732 : cluster [DBG] pgmap v6688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:44.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:43 gibba013 bash[30381]: cluster 2021-03-10T17:35:42.207485+0000 mgr.gibba020.yqfnwy (mgr.34427) 11732 : cluster [DBG] pgmap v6688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:44.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:43 gibba020 bash[25448]: cluster 2021-03-10T17:35:42.207485+0000 mgr.gibba020.yqfnwy (mgr.34427) 11732 : cluster [DBG] pgmap v6688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:46.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:45 gibba013 bash[29418]: cluster 2021-03-10T17:35:44.208401+0000 mgr.gibba020.yqfnwy (mgr.34427) 11733 : cluster [DBG] pgmap v6689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:46.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:45 gibba013 bash[30381]: cluster 2021-03-10T17:35:44.208401+0000 mgr.gibba020.yqfnwy (mgr.34427) 11733 : cluster [DBG] pgmap v6689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:46.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:45 gibba020 bash[25448]: cluster 2021-03-10T17:35:44.208401+0000 mgr.gibba020.yqfnwy (mgr.34427) 11733 : cluster [DBG] pgmap v6689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:48.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:47 gibba013 bash[29418]: cluster 2021-03-10T17:35:46.210081+0000 mgr.gibba020.yqfnwy (mgr.34427) 11734 : cluster [DBG] pgmap v6690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:48.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:47 gibba013 bash[30381]: cluster 2021-03-10T17:35:46.210081+0000 mgr.gibba020.yqfnwy (mgr.34427) 11734 : cluster [DBG] pgmap v6690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:48.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:47 gibba020 bash[25448]: cluster 2021-03-10T17:35:46.210081+0000 mgr.gibba020.yqfnwy (mgr.34427) 11734 : cluster [DBG] pgmap v6690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:50.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:49 gibba013 bash[29418]: cluster 2021-03-10T17:35:48.210652+0000 mgr.gibba020.yqfnwy (mgr.34427) 11735 : cluster [DBG] pgmap v6691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:50.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:49 gibba013 bash[30381]: cluster 2021-03-10T17:35:48.210652+0000 mgr.gibba020.yqfnwy (mgr.34427) 11735 : cluster [DBG] pgmap v6691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:50.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:49 gibba020 bash[25448]: cluster 2021-03-10T17:35:48.210652+0000 mgr.gibba020.yqfnwy (mgr.34427) 11735 : cluster [DBG] pgmap v6691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:52.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:51 gibba013 bash[29418]: cluster 2021-03-10T17:35:50.211548+0000 mgr.gibba020.yqfnwy (mgr.34427) 11736 : cluster [DBG] pgmap v6692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:52.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:51 gibba013 bash[29418]: cephadm 2021-03-10T17:35:50.620458+0000 mgr.gibba020.yqfnwy (mgr.34427) 11737 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:35:52.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:51 gibba013 bash[30381]: cluster 2021-03-10T17:35:50.211548+0000 mgr.gibba020.yqfnwy (mgr.34427) 11736 : cluster [DBG] pgmap v6692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:52.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:51 gibba013 bash[30381]: cephadm 2021-03-10T17:35:50.620458+0000 mgr.gibba020.yqfnwy (mgr.34427) 11737 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:35:52.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:51 gibba020 bash[25448]: cluster 2021-03-10T17:35:50.211548+0000 mgr.gibba020.yqfnwy (mgr.34427) 11736 : cluster [DBG] pgmap v6692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:52.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:51 gibba020 bash[25448]: cephadm 2021-03-10T17:35:50.620458+0000 mgr.gibba020.yqfnwy (mgr.34427) 11737 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:35:54.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:53 gibba020 bash[25448]: cluster 2021-03-10T17:35:52.212802+0000 mgr.gibba020.yqfnwy (mgr.34427) 11738 : cluster [DBG] pgmap v6693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:54.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:53 gibba013 bash[29418]: cluster 2021-03-10T17:35:52.212802+0000 mgr.gibba020.yqfnwy (mgr.34427) 11738 : cluster [DBG] pgmap v6693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:54.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:53 gibba013 bash[30381]: cluster 2021-03-10T17:35:52.212802+0000 mgr.gibba020.yqfnwy (mgr.34427) 11738 : cluster [DBG] pgmap v6693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:56.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:55 gibba020 bash[25448]: cluster 2021-03-10T17:35:54.214188+0000 mgr.gibba020.yqfnwy (mgr.34427) 11739 : cluster [DBG] pgmap v6694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:56.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:55 gibba013 bash[29418]: cluster 2021-03-10T17:35:54.214188+0000 mgr.gibba020.yqfnwy (mgr.34427) 11739 : cluster [DBG] pgmap v6694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:56.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:55 gibba013 bash[30381]: cluster 2021-03-10T17:35:54.214188+0000 mgr.gibba020.yqfnwy (mgr.34427) 11739 : cluster [DBG] pgmap v6694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:58.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:57 gibba020 bash[25448]: cluster 2021-03-10T17:35:56.215301+0000 mgr.gibba020.yqfnwy (mgr.34427) 11740 : cluster [DBG] pgmap v6695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:58.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:57 gibba013 bash[29418]: cluster 2021-03-10T17:35:56.215301+0000 mgr.gibba020.yqfnwy (mgr.34427) 11740 : cluster [DBG] pgmap v6695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:35:58.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:57 gibba013 bash[30381]: cluster 2021-03-10T17:35:56.215301+0000 mgr.gibba020.yqfnwy (mgr.34427) 11740 : cluster [DBG] pgmap v6695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:00.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:35:59 gibba020 bash[25448]: cluster 2021-03-10T17:35:58.216520+0000 mgr.gibba020.yqfnwy (mgr.34427) 11741 : cluster [DBG] pgmap v6696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:00.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:35:59 gibba013 bash[29418]: cluster 2021-03-10T17:35:58.216520+0000 mgr.gibba020.yqfnwy (mgr.34427) 11741 : cluster [DBG] pgmap v6696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:00.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:35:59 gibba013 bash[30381]: cluster 2021-03-10T17:35:58.216520+0000 mgr.gibba020.yqfnwy (mgr.34427) 11741 : cluster [DBG] pgmap v6696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:02.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:01 gibba020 bash[25448]: cluster 2021-03-10T17:36:00.218274+0000 mgr.gibba020.yqfnwy (mgr.34427) 11742 : cluster [DBG] pgmap v6697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:02.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:01 gibba013 bash[29418]: cluster 2021-03-10T17:36:00.218274+0000 mgr.gibba020.yqfnwy (mgr.34427) 11742 : cluster [DBG] pgmap v6697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:02.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:01 gibba013 bash[30381]: cluster 2021-03-10T17:36:00.218274+0000 mgr.gibba020.yqfnwy (mgr.34427) 11742 : cluster [DBG] pgmap v6697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:04.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:03 gibba020 bash[25448]: cluster 2021-03-10T17:36:02.219259+0000 mgr.gibba020.yqfnwy (mgr.34427) 11743 : cluster [DBG] pgmap v6698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:04.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:03 gibba013 bash[29418]: cluster 2021-03-10T17:36:02.219259+0000 mgr.gibba020.yqfnwy (mgr.34427) 11743 : cluster [DBG] pgmap v6698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:04.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:03 gibba013 bash[30381]: cluster 2021-03-10T17:36:02.219259+0000 mgr.gibba020.yqfnwy (mgr.34427) 11743 : cluster [DBG] pgmap v6698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:06.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:05 gibba020 bash[25448]: cluster 2021-03-10T17:36:04.220749+0000 mgr.gibba020.yqfnwy (mgr.34427) 11744 : cluster [DBG] pgmap v6699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:06.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:05 gibba020 bash[25448]: audit 2021-03-10T17:36:05.634336+0000 mon.a (mon.0) 4107 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:36:06.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:05 gibba020 bash[25448]: audit 2021-03-10T17:36:05.864809+0000 mon.a (mon.0) 4108 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:36:06.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:05 gibba020 bash[25448]: audit 2021-03-10T17:36:05.868193+0000 mon.a (mon.0) 4109 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:36:06.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:05 gibba020 bash[25448]: audit 2021-03-10T17:36:05.869754+0000 mon.a (mon.0) 4110 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:06.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:05 gibba020 bash[25448]: audit 2021-03-10T17:36:05.870840+0000 mon.a (mon.0) 4111 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:06.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:05 gibba020 bash[25448]: audit 2021-03-10T17:36:05.871889+0000 mon.a (mon.0) 4112 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:06.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:05 gibba020 bash[25448]: audit 2021-03-10T17:36:05.874258+0000 mon.a (mon.0) 4113 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:06.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:05 gibba020 bash[25448]: audit 2021-03-10T17:36:05.875943+0000 mon.a (mon.0) 4114 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:06.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:05 gibba013 bash[29418]: cluster 2021-03-10T17:36:04.220749+0000 mgr.gibba020.yqfnwy (mgr.34427) 11744 : cluster [DBG] pgmap v6699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:06.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:05 gibba013 bash[29418]: audit 2021-03-10T17:36:05.634336+0000 mon.a (mon.0) 4107 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:36:06.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:05 gibba013 bash[29418]: audit 2021-03-10T17:36:05.864809+0000 mon.a (mon.0) 4108 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:36:06.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:05 gibba013 bash[29418]: audit 2021-03-10T17:36:05.868193+0000 mon.a (mon.0) 4109 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:36:06.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:05 gibba013 bash[29418]: audit 2021-03-10T17:36:05.869754+0000 mon.a (mon.0) 4110 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:06.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:05 gibba013 bash[29418]: audit 2021-03-10T17:36:05.870840+0000 mon.a (mon.0) 4111 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:06.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:05 gibba013 bash[29418]: audit 2021-03-10T17:36:05.871889+0000 mon.a (mon.0) 4112 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:06.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:05 gibba013 bash[29418]: audit 2021-03-10T17:36:05.874258+0000 mon.a (mon.0) 4113 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:06.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:05 gibba013 bash[29418]: audit 2021-03-10T17:36:05.875943+0000 mon.a (mon.0) 4114 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:06.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:05 gibba013 bash[30381]: cluster 2021-03-10T17:36:04.220749+0000 mgr.gibba020.yqfnwy (mgr.34427) 11744 : cluster [DBG] pgmap v6699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:06.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:05 gibba013 bash[30381]: audit 2021-03-10T17:36:05.634336+0000 mon.a (mon.0) 4107 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:36:06.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:05 gibba013 bash[30381]: audit 2021-03-10T17:36:05.864809+0000 mon.a (mon.0) 4108 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:36:06.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:05 gibba013 bash[30381]: audit 2021-03-10T17:36:05.868193+0000 mon.a (mon.0) 4109 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:36:06.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:05 gibba013 bash[30381]: audit 2021-03-10T17:36:05.869754+0000 mon.a (mon.0) 4110 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:06.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:05 gibba013 bash[30381]: audit 2021-03-10T17:36:05.870840+0000 mon.a (mon.0) 4111 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:06.385 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:05 gibba013 bash[30381]: audit 2021-03-10T17:36:05.871889+0000 mon.a (mon.0) 4112 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:06.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:05 gibba013 bash[30381]: audit 2021-03-10T17:36:05.874258+0000 mon.a (mon.0) 4113 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:06.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:05 gibba013 bash[30381]: audit 2021-03-10T17:36:05.875943+0000 mon.a (mon.0) 4114 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:07.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:06 gibba013 bash[29418]: cephadm 2021-03-10T17:36:05.639381+0000 mgr.gibba020.yqfnwy (mgr.34427) 11745 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:36:07.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:06 gibba013 bash[29418]: cephadm 2021-03-10T17:36:05.640980+0000 mgr.gibba020.yqfnwy (mgr.34427) 11746 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:36:07.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:06 gibba013 bash[29418]: cephadm 2021-03-10T17:36:05.866984+0000 mgr.gibba020.yqfnwy (mgr.34427) 11747 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:36:07.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:06 gibba013 bash[29418]: cephadm 2021-03-10T17:36:05.868819+0000 mgr.gibba020.yqfnwy (mgr.34427) 11748 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:36:07.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:06 gibba013 bash[29418]: cephadm 2021-03-10T17:36:05.870020+0000 mgr.gibba020.yqfnwy (mgr.34427) 11749 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:36:07.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:06 gibba013 bash[29418]: cephadm 2021-03-10T17:36:05.870055+0000 mgr.gibba020.yqfnwy (mgr.34427) 11750 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:36:07.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:06 gibba013 bash[29418]: cephadm 2021-03-10T17:36:05.871018+0000 mgr.gibba020.yqfnwy (mgr.34427) 11751 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:36:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:06 gibba013 bash[29418]: cephadm 2021-03-10T17:36:05.871056+0000 mgr.gibba020.yqfnwy (mgr.34427) 11752 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:36:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:06 gibba013 bash[29418]: cephadm 2021-03-10T17:36:05.872127+0000 mgr.gibba020.yqfnwy (mgr.34427) 11753 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:36:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:06 gibba013 bash[29418]: cephadm 2021-03-10T17:36:05.873061+0000 mgr.gibba020.yqfnwy (mgr.34427) 11754 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:36:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:06 gibba013 bash[29418]: cephadm 2021-03-10T17:36:05.873097+0000 mgr.gibba020.yqfnwy (mgr.34427) 11755 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:36:07.384 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:06 gibba013 bash[29418]: cephadm 2021-03-10T17:36:05.874671+0000 mgr.gibba020.yqfnwy (mgr.34427) 11756 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:36:07.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:06 gibba013 bash[29418]: cephadm 2021-03-10T17:36:05.875000+0000 mgr.gibba020.yqfnwy (mgr.34427) 11757 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:36:07.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:06 gibba013 bash[29418]: cephadm 2021-03-10T17:36:05.876595+0000 mgr.gibba020.yqfnwy (mgr.34427) 11758 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:36:07.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:06 gibba013 bash[29418]: cephadm 2021-03-10T17:36:05.876639+0000 mgr.gibba020.yqfnwy (mgr.34427) 11759 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:36:07.385 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:06 gibba013 bash[29418]: cephadm 2021-03-10T17:36:05.876764+0000 mgr.gibba020.yqfnwy (mgr.34427) 11760 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:36:07.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:06 gibba013 bash[30381]: cephadm 2021-03-10T17:36:05.639381+0000 mgr.gibba020.yqfnwy (mgr.34427) 11745 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:36:07.386 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:06 gibba013 bash[30381]: cephadm 2021-03-10T17:36:05.640980+0000 mgr.gibba020.yqfnwy (mgr.34427) 11746 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:36:07.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:06 gibba013 bash[30381]: cephadm 2021-03-10T17:36:05.866984+0000 mgr.gibba020.yqfnwy (mgr.34427) 11747 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:36:07.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:06 gibba013 bash[30381]: cephadm 2021-03-10T17:36:05.868819+0000 mgr.gibba020.yqfnwy (mgr.34427) 11748 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:36:07.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:06 gibba013 bash[30381]: cephadm 2021-03-10T17:36:05.870020+0000 mgr.gibba020.yqfnwy (mgr.34427) 11749 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:36:07.387 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:06 gibba013 bash[30381]: cephadm 2021-03-10T17:36:05.870055+0000 mgr.gibba020.yqfnwy (mgr.34427) 11750 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:36:07.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:06 gibba013 bash[30381]: cephadm 2021-03-10T17:36:05.871018+0000 mgr.gibba020.yqfnwy (mgr.34427) 11751 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:36:07.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:06 gibba013 bash[30381]: cephadm 2021-03-10T17:36:05.871056+0000 mgr.gibba020.yqfnwy (mgr.34427) 11752 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:36:07.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:06 gibba013 bash[30381]: cephadm 2021-03-10T17:36:05.872127+0000 mgr.gibba020.yqfnwy (mgr.34427) 11753 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:36:07.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:06 gibba013 bash[30381]: cephadm 2021-03-10T17:36:05.873061+0000 mgr.gibba020.yqfnwy (mgr.34427) 11754 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:36:07.388 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:06 gibba013 bash[30381]: cephadm 2021-03-10T17:36:05.873097+0000 mgr.gibba020.yqfnwy (mgr.34427) 11755 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:36:07.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:06 gibba013 bash[30381]: cephadm 2021-03-10T17:36:05.874671+0000 mgr.gibba020.yqfnwy (mgr.34427) 11756 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:36:07.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:06 gibba013 bash[30381]: cephadm 2021-03-10T17:36:05.875000+0000 mgr.gibba020.yqfnwy (mgr.34427) 11757 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:36:07.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:06 gibba013 bash[30381]: cephadm 2021-03-10T17:36:05.876595+0000 mgr.gibba020.yqfnwy (mgr.34427) 11758 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:36:07.389 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:06 gibba013 bash[30381]: cephadm 2021-03-10T17:36:05.876639+0000 mgr.gibba020.yqfnwy (mgr.34427) 11759 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:36:07.390 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:06 gibba013 bash[30381]: cephadm 2021-03-10T17:36:05.876764+0000 mgr.gibba020.yqfnwy (mgr.34427) 11760 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:36:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:06 gibba020 bash[25448]: cephadm 2021-03-10T17:36:05.639381+0000 mgr.gibba020.yqfnwy (mgr.34427) 11745 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:36:07.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:06 gibba020 bash[25448]: cephadm 2021-03-10T17:36:05.640980+0000 mgr.gibba020.yqfnwy (mgr.34427) 11746 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:36:07.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:06 gibba020 bash[25448]: cephadm 2021-03-10T17:36:05.866984+0000 mgr.gibba020.yqfnwy (mgr.34427) 11747 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:36:07.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:06 gibba020 bash[25448]: cephadm 2021-03-10T17:36:05.868819+0000 mgr.gibba020.yqfnwy (mgr.34427) 11748 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:36:07.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:06 gibba020 bash[25448]: cephadm 2021-03-10T17:36:05.870020+0000 mgr.gibba020.yqfnwy (mgr.34427) 11749 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:36:07.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:06 gibba020 bash[25448]: cephadm 2021-03-10T17:36:05.870055+0000 mgr.gibba020.yqfnwy (mgr.34427) 11750 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:36:07.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:06 gibba020 bash[25448]: cephadm 2021-03-10T17:36:05.871018+0000 mgr.gibba020.yqfnwy (mgr.34427) 11751 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:36:07.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:06 gibba020 bash[25448]: cephadm 2021-03-10T17:36:05.871056+0000 mgr.gibba020.yqfnwy (mgr.34427) 11752 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:36:07.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:06 gibba020 bash[25448]: cephadm 2021-03-10T17:36:05.872127+0000 mgr.gibba020.yqfnwy (mgr.34427) 11753 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:36:07.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:06 gibba020 bash[25448]: cephadm 2021-03-10T17:36:05.873061+0000 mgr.gibba020.yqfnwy (mgr.34427) 11754 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:36:07.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:06 gibba020 bash[25448]: cephadm 2021-03-10T17:36:05.873097+0000 mgr.gibba020.yqfnwy (mgr.34427) 11755 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:36:07.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:06 gibba020 bash[25448]: cephadm 2021-03-10T17:36:05.874671+0000 mgr.gibba020.yqfnwy (mgr.34427) 11756 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:36:07.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:06 gibba020 bash[25448]: cephadm 2021-03-10T17:36:05.875000+0000 mgr.gibba020.yqfnwy (mgr.34427) 11757 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:36:07.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:06 gibba020 bash[25448]: cephadm 2021-03-10T17:36:05.876595+0000 mgr.gibba020.yqfnwy (mgr.34427) 11758 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:36:07.453 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:06 gibba020 bash[25448]: cephadm 2021-03-10T17:36:05.876639+0000 mgr.gibba020.yqfnwy (mgr.34427) 11759 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:36:07.454 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:06 gibba020 bash[25448]: cephadm 2021-03-10T17:36:05.876764+0000 mgr.gibba020.yqfnwy (mgr.34427) 11760 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:36:08.002 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:36:08.257 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:36:08.257 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 4m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:36:08.257 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 3m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:36:08.258 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:36:08.258 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:36:08.258 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:36:08.258 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:36:08.259 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:36:08.259 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:36:08.259 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:36:08.259 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:36:08.259 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:36:08.260 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:36:08.260 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:36:08.260 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:36:08.260 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:36:08.261 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:36:08.261 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:36:08.261 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:36:08.262 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 3m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:36:08.262 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 3m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:36:08.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:07 gibba013 bash[29418]: cluster 2021-03-10T17:36:06.222373+0000 mgr.gibba020.yqfnwy (mgr.34427) 11761 : cluster [DBG] pgmap v6700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:08.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:07 gibba013 bash[29418]: audit 2021-03-10T17:36:07.033800+0000 mon.a (mon.0) 4115 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:36:08.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:07 gibba013 bash[29418]: audit 2021-03-10T17:36:07.293859+0000 mon.a (mon.0) 4116 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:36:08.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:07 gibba013 bash[29418]: audit 2021-03-10T17:36:07.766947+0000 mon.a (mon.0) 4117 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T17:36:08.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:07 gibba013 bash[29418]: audit 2021-03-10T17:36:07.767749+0000 mon.a (mon.0) 4118 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T17:36:08.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:07 gibba013 bash[29418]: audit 2021-03-10T17:36:07.768406+0000 mon.a (mon.0) 4119 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:36:08.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:07 gibba013 bash[29418]: audit 2021-03-10T17:36:07.769074+0000 mon.a (mon.0) 4120 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:36:08.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:07 gibba013 bash[30381]: cluster 2021-03-10T17:36:06.222373+0000 mgr.gibba020.yqfnwy (mgr.34427) 11761 : cluster [DBG] pgmap v6700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:08.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:07 gibba013 bash[30381]: audit 2021-03-10T17:36:07.033800+0000 mon.a (mon.0) 4115 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:36:08.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:07 gibba013 bash[30381]: audit 2021-03-10T17:36:07.293859+0000 mon.a (mon.0) 4116 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:36:08.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:07 gibba013 bash[30381]: audit 2021-03-10T17:36:07.766947+0000 mon.a (mon.0) 4117 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T17:36:08.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:07 gibba013 bash[30381]: audit 2021-03-10T17:36:07.767749+0000 mon.a (mon.0) 4118 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T17:36:08.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:07 gibba013 bash[30381]: audit 2021-03-10T17:36:07.768406+0000 mon.a (mon.0) 4119 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:36:08.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:07 gibba013 bash[30381]: audit 2021-03-10T17:36:07.769074+0000 mon.a (mon.0) 4120 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:36:08.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:07 gibba020 bash[25448]: cluster 2021-03-10T17:36:06.222373+0000 mgr.gibba020.yqfnwy (mgr.34427) 11761 : cluster [DBG] pgmap v6700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:08.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:07 gibba020 bash[25448]: audit 2021-03-10T17:36:07.033800+0000 mon.a (mon.0) 4115 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:36:08.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:07 gibba020 bash[25448]: audit 2021-03-10T17:36:07.293859+0000 mon.a (mon.0) 4116 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:36:08.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:07 gibba020 bash[25448]: audit 2021-03-10T17:36:07.766947+0000 mon.a (mon.0) 4117 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T17:36:08.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:07 gibba020 bash[25448]: audit 2021-03-10T17:36:07.767749+0000 mon.a (mon.0) 4118 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T17:36:08.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:07 gibba020 bash[25448]: audit 2021-03-10T17:36:07.768406+0000 mon.a (mon.0) 4119 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:36:08.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:07 gibba020 bash[25448]: audit 2021-03-10T17:36:07.769074+0000 mon.a (mon.0) 4120 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:36:08.517 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:36:08.517 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:36:08.518 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:36:08.518 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:36:08.518 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:36:08.518 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:36:08.519 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:36:08.519 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:36:08.519 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:36:08.519 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:36:08.519 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:36:08.520 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:36:08.520 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:36:08.520 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:36:08.520 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:36:09.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:08 gibba013 bash[29418]: audit 2021-03-10T17:36:07.991374+0000 mgr.gibba020.yqfnwy (mgr.34427) 11762 : audit [DBG] from='client.51936 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:36:09.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:08 gibba013 bash[29418]: audit 2021-03-10T17:36:08.515037+0000 mon.a (mon.0) 4121 : audit [DBG] from='client.? 172.21.2.113:0/1483433500' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:09.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:08 gibba013 bash[30381]: audit 2021-03-10T17:36:07.991374+0000 mgr.gibba020.yqfnwy (mgr.34427) 11762 : audit [DBG] from='client.51936 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:36:09.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:08 gibba013 bash[30381]: audit 2021-03-10T17:36:08.515037+0000 mon.a (mon.0) 4121 : audit [DBG] from='client.? 172.21.2.113:0/1483433500' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:09.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:08 gibba020 bash[25448]: audit 2021-03-10T17:36:07.991374+0000 mgr.gibba020.yqfnwy (mgr.34427) 11762 : audit [DBG] from='client.51936 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:36:09.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:08 gibba020 bash[25448]: audit 2021-03-10T17:36:08.515037+0000 mon.a (mon.0) 4121 : audit [DBG] from='client.? 172.21.2.113:0/1483433500' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:10.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:09 gibba013 bash[29418]: audit 2021-03-10T17:36:08.213249+0000 mgr.gibba020.yqfnwy (mgr.34427) 11763 : audit [DBG] from='client.51942 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:36:10.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:09 gibba013 bash[29418]: cluster 2021-03-10T17:36:08.223559+0000 mgr.gibba020.yqfnwy (mgr.34427) 11764 : cluster [DBG] pgmap v6701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:10.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:09 gibba013 bash[30381]: audit 2021-03-10T17:36:08.213249+0000 mgr.gibba020.yqfnwy (mgr.34427) 11763 : audit [DBG] from='client.51942 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:36:10.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:09 gibba013 bash[30381]: cluster 2021-03-10T17:36:08.223559+0000 mgr.gibba020.yqfnwy (mgr.34427) 11764 : cluster [DBG] pgmap v6701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:10.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:09 gibba020 bash[25448]: audit 2021-03-10T17:36:08.213249+0000 mgr.gibba020.yqfnwy (mgr.34427) 11763 : audit [DBG] from='client.51942 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:36:10.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:09 gibba020 bash[25448]: cluster 2021-03-10T17:36:08.223559+0000 mgr.gibba020.yqfnwy (mgr.34427) 11764 : cluster [DBG] pgmap v6701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:12.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:11 gibba013 bash[29418]: cluster 2021-03-10T17:36:10.225453+0000 mgr.gibba020.yqfnwy (mgr.34427) 11765 : cluster [DBG] pgmap v6702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:12.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:11 gibba013 bash[30381]: cluster 2021-03-10T17:36:10.225453+0000 mgr.gibba020.yqfnwy (mgr.34427) 11765 : cluster [DBG] pgmap v6702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:12.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:11 gibba020 bash[25448]: cluster 2021-03-10T17:36:10.225453+0000 mgr.gibba020.yqfnwy (mgr.34427) 11765 : cluster [DBG] pgmap v6702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:14.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:13 gibba013 bash[29418]: cluster 2021-03-10T17:36:12.226827+0000 mgr.gibba020.yqfnwy (mgr.34427) 11766 : cluster [DBG] pgmap v6703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:14.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:13 gibba013 bash[30381]: cluster 2021-03-10T17:36:12.226827+0000 mgr.gibba020.yqfnwy (mgr.34427) 11766 : cluster [DBG] pgmap v6703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:14.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:13 gibba020 bash[25448]: cluster 2021-03-10T17:36:12.226827+0000 mgr.gibba020.yqfnwy (mgr.34427) 11766 : cluster [DBG] pgmap v6703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:16.383 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:15 gibba013 bash[29418]: cluster 2021-03-10T17:36:14.228018+0000 mgr.gibba020.yqfnwy (mgr.34427) 11767 : cluster [DBG] pgmap v6704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:16.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:15 gibba013 bash[30381]: cluster 2021-03-10T17:36:14.228018+0000 mgr.gibba020.yqfnwy (mgr.34427) 11767 : cluster [DBG] pgmap v6704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:16.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:15 gibba020 bash[25448]: cluster 2021-03-10T17:36:14.228018+0000 mgr.gibba020.yqfnwy (mgr.34427) 11767 : cluster [DBG] pgmap v6704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:18.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:18 gibba013 bash[29418]: cluster 2021-03-10T17:36:16.229650+0000 mgr.gibba020.yqfnwy (mgr.34427) 11768 : cluster [DBG] pgmap v6705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:18.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:18 gibba013 bash[30381]: cluster 2021-03-10T17:36:16.229650+0000 mgr.gibba020.yqfnwy (mgr.34427) 11768 : cluster [DBG] pgmap v6705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:18.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:18 gibba020 bash[25448]: cluster 2021-03-10T17:36:16.229650+0000 mgr.gibba020.yqfnwy (mgr.34427) 11768 : cluster [DBG] pgmap v6705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:20.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:20 gibba013 bash[29418]: cluster 2021-03-10T17:36:18.230895+0000 mgr.gibba020.yqfnwy (mgr.34427) 11769 : cluster [DBG] pgmap v6706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:20.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:20 gibba013 bash[30381]: cluster 2021-03-10T17:36:18.230895+0000 mgr.gibba020.yqfnwy (mgr.34427) 11769 : cluster [DBG] pgmap v6706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:20.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:20 gibba020 bash[25448]: cluster 2021-03-10T17:36:18.230895+0000 mgr.gibba020.yqfnwy (mgr.34427) 11769 : cluster [DBG] pgmap v6706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:22.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:22 gibba013 bash[29418]: cluster 2021-03-10T17:36:20.232320+0000 mgr.gibba020.yqfnwy (mgr.34427) 11770 : cluster [DBG] pgmap v6707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:22.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:22 gibba013 bash[29418]: cephadm 2021-03-10T17:36:20.892744+0000 mgr.gibba020.yqfnwy (mgr.34427) 11771 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:36:22.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:22 gibba013 bash[30381]: cluster 2021-03-10T17:36:20.232320+0000 mgr.gibba020.yqfnwy (mgr.34427) 11770 : cluster [DBG] pgmap v6707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:22.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:22 gibba013 bash[30381]: cephadm 2021-03-10T17:36:20.892744+0000 mgr.gibba020.yqfnwy (mgr.34427) 11771 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:36:22.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:22 gibba020 bash[25448]: cluster 2021-03-10T17:36:20.232320+0000 mgr.gibba020.yqfnwy (mgr.34427) 11770 : cluster [DBG] pgmap v6707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:22.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:22 gibba020 bash[25448]: cephadm 2021-03-10T17:36:20.892744+0000 mgr.gibba020.yqfnwy (mgr.34427) 11771 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:36:24.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:24 gibba013 bash[29418]: cluster 2021-03-10T17:36:22.233510+0000 mgr.gibba020.yqfnwy (mgr.34427) 11772 : cluster [DBG] pgmap v6708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:24.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:24 gibba013 bash[30381]: cluster 2021-03-10T17:36:22.233510+0000 mgr.gibba020.yqfnwy (mgr.34427) 11772 : cluster [DBG] pgmap v6708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:24.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:24 gibba020 bash[25448]: cluster 2021-03-10T17:36:22.233510+0000 mgr.gibba020.yqfnwy (mgr.34427) 11772 : cluster [DBG] pgmap v6708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:26.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:26 gibba013 bash[29418]: cluster 2021-03-10T17:36:24.235129+0000 mgr.gibba020.yqfnwy (mgr.34427) 11773 : cluster [DBG] pgmap v6709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:26.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:26 gibba013 bash[30381]: cluster 2021-03-10T17:36:24.235129+0000 mgr.gibba020.yqfnwy (mgr.34427) 11773 : cluster [DBG] pgmap v6709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:26.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:26 gibba020 bash[25448]: cluster 2021-03-10T17:36:24.235129+0000 mgr.gibba020.yqfnwy (mgr.34427) 11773 : cluster [DBG] pgmap v6709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:28.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:28 gibba013 bash[29418]: cluster 2021-03-10T17:36:26.237011+0000 mgr.gibba020.yqfnwy (mgr.34427) 11774 : cluster [DBG] pgmap v6710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:28.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:28 gibba013 bash[30381]: cluster 2021-03-10T17:36:26.237011+0000 mgr.gibba020.yqfnwy (mgr.34427) 11774 : cluster [DBG] pgmap v6710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:28.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:28 gibba020 bash[25448]: cluster 2021-03-10T17:36:26.237011+0000 mgr.gibba020.yqfnwy (mgr.34427) 11774 : cluster [DBG] pgmap v6710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:30.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:30 gibba013 bash[29418]: cluster 2021-03-10T17:36:28.238276+0000 mgr.gibba020.yqfnwy (mgr.34427) 11775 : cluster [DBG] pgmap v6711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:30.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:30 gibba013 bash[30381]: cluster 2021-03-10T17:36:28.238276+0000 mgr.gibba020.yqfnwy (mgr.34427) 11775 : cluster [DBG] pgmap v6711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:30.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:30 gibba020 bash[25448]: cluster 2021-03-10T17:36:28.238276+0000 mgr.gibba020.yqfnwy (mgr.34427) 11775 : cluster [DBG] pgmap v6711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:32.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:32 gibba013 bash[29418]: cluster 2021-03-10T17:36:30.240049+0000 mgr.gibba020.yqfnwy (mgr.34427) 11776 : cluster [DBG] pgmap v6712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:32.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:32 gibba013 bash[30381]: cluster 2021-03-10T17:36:30.240049+0000 mgr.gibba020.yqfnwy (mgr.34427) 11776 : cluster [DBG] pgmap v6712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:32.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:32 gibba020 bash[25448]: cluster 2021-03-10T17:36:30.240049+0000 mgr.gibba020.yqfnwy (mgr.34427) 11776 : cluster [DBG] pgmap v6712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:34.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:34 gibba013 bash[29418]: cluster 2021-03-10T17:36:32.241192+0000 mgr.gibba020.yqfnwy (mgr.34427) 11777 : cluster [DBG] pgmap v6713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:34.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:34 gibba013 bash[30381]: cluster 2021-03-10T17:36:32.241192+0000 mgr.gibba020.yqfnwy (mgr.34427) 11777 : cluster [DBG] pgmap v6713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:34.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:34 gibba020 bash[25448]: cluster 2021-03-10T17:36:32.241192+0000 mgr.gibba020.yqfnwy (mgr.34427) 11777 : cluster [DBG] pgmap v6713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:36.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:36 gibba020 bash[25448]: cluster 2021-03-10T17:36:34.242508+0000 mgr.gibba020.yqfnwy (mgr.34427) 11778 : cluster [DBG] pgmap v6714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:36.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:36 gibba013 bash[29418]: cluster 2021-03-10T17:36:34.242508+0000 mgr.gibba020.yqfnwy (mgr.34427) 11778 : cluster [DBG] pgmap v6714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:36.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:36 gibba013 bash[30381]: cluster 2021-03-10T17:36:34.242508+0000 mgr.gibba020.yqfnwy (mgr.34427) 11778 : cluster [DBG] pgmap v6714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:37.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:37 gibba013 bash[29418]: cephadm 2021-03-10T17:36:35.908573+0000 mgr.gibba020.yqfnwy (mgr.34427) 11779 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:36:37.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:37 gibba013 bash[30381]: cephadm 2021-03-10T17:36:35.908573+0000 mgr.gibba020.yqfnwy (mgr.34427) 11779 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:36:37.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:37 gibba020 bash[25448]: cephadm 2021-03-10T17:36:35.908573+0000 mgr.gibba020.yqfnwy (mgr.34427) 11779 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:36:38.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:38 gibba013 bash[29418]: cluster 2021-03-10T17:36:36.244284+0000 mgr.gibba020.yqfnwy (mgr.34427) 11780 : cluster [DBG] pgmap v6715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:38.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:38 gibba013 bash[30381]: cluster 2021-03-10T17:36:36.244284+0000 mgr.gibba020.yqfnwy (mgr.34427) 11780 : cluster [DBG] pgmap v6715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:38.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:38 gibba020 bash[25448]: cluster 2021-03-10T17:36:36.244284+0000 mgr.gibba020.yqfnwy (mgr.34427) 11780 : cluster [DBG] pgmap v6715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:38.759 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:36:39.020 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:36:39.021 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 4m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:36:39.021 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 3m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:36:39.021 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:36:39.021 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:36:39.022 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:36:39.022 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:36:39.022 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:36:39.022 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:36:39.023 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:36:39.023 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:36:39.023 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:36:39.023 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:36:39.023 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:36:39.024 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:36:39.024 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:36:39.024 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:36:39.024 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:36:39.024 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:36:39.025 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 3m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:36:39.025 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 3m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:36:39.283 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:36:39.283 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:36:39.283 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:36:39.283 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:36:39.284 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:36:39.284 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:36:39.284 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:36:39.284 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:36:39.285 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:36:39.285 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:36:39.285 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:36:39.285 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:36:39.285 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:36:39.286 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:36:39.286 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:36:40.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:40 gibba013 bash[29418]: cluster 2021-03-10T17:36:38.245487+0000 mgr.gibba020.yqfnwy (mgr.34427) 11781 : cluster [DBG] pgmap v6716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:40.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:40 gibba013 bash[29418]: audit 2021-03-10T17:36:38.747538+0000 mgr.gibba020.yqfnwy (mgr.34427) 11782 : audit [DBG] from='client.61933 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:36:40.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:40 gibba013 bash[29418]: audit 2021-03-10T17:36:38.975738+0000 mgr.gibba020.yqfnwy (mgr.34427) 11783 : audit [DBG] from='client.51960 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:36:40.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:40 gibba013 bash[29418]: audit 2021-03-10T17:36:39.280337+0000 mon.a (mon.0) 4122 : audit [DBG] from='client.? 172.21.2.113:0/2019794993' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:40.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:40 gibba013 bash[30381]: cluster 2021-03-10T17:36:38.245487+0000 mgr.gibba020.yqfnwy (mgr.34427) 11781 : cluster [DBG] pgmap v6716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:40.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:40 gibba013 bash[30381]: audit 2021-03-10T17:36:38.747538+0000 mgr.gibba020.yqfnwy (mgr.34427) 11782 : audit [DBG] from='client.61933 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:36:40.383 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:40 gibba013 bash[30381]: audit 2021-03-10T17:36:38.975738+0000 mgr.gibba020.yqfnwy (mgr.34427) 11783 : audit [DBG] from='client.51960 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:36:40.384 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:40 gibba013 bash[30381]: audit 2021-03-10T17:36:39.280337+0000 mon.a (mon.0) 4122 : audit [DBG] from='client.? 172.21.2.113:0/2019794993' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:40.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:40 gibba020 bash[25448]: cluster 2021-03-10T17:36:38.245487+0000 mgr.gibba020.yqfnwy (mgr.34427) 11781 : cluster [DBG] pgmap v6716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:40.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:40 gibba020 bash[25448]: audit 2021-03-10T17:36:38.747538+0000 mgr.gibba020.yqfnwy (mgr.34427) 11782 : audit [DBG] from='client.61933 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:36:40.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:40 gibba020 bash[25448]: audit 2021-03-10T17:36:38.975738+0000 mgr.gibba020.yqfnwy (mgr.34427) 11783 : audit [DBG] from='client.51960 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:36:40.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:40 gibba020 bash[25448]: audit 2021-03-10T17:36:39.280337+0000 mon.a (mon.0) 4122 : audit [DBG] from='client.? 172.21.2.113:0/2019794993' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:36:42.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:42 gibba013 bash[29418]: cluster 2021-03-10T17:36:40.247028+0000 mgr.gibba020.yqfnwy (mgr.34427) 11784 : cluster [DBG] pgmap v6717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:42.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:42 gibba013 bash[30381]: cluster 2021-03-10T17:36:40.247028+0000 mgr.gibba020.yqfnwy (mgr.34427) 11784 : cluster [DBG] pgmap v6717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:42.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:42 gibba020 bash[25448]: cluster 2021-03-10T17:36:40.247028+0000 mgr.gibba020.yqfnwy (mgr.34427) 11784 : cluster [DBG] pgmap v6717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:44.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:44 gibba013 bash[29418]: cluster 2021-03-10T17:36:42.248319+0000 mgr.gibba020.yqfnwy (mgr.34427) 11785 : cluster [DBG] pgmap v6718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:44.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:44 gibba013 bash[30381]: cluster 2021-03-10T17:36:42.248319+0000 mgr.gibba020.yqfnwy (mgr.34427) 11785 : cluster [DBG] pgmap v6718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:44.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:44 gibba020 bash[25448]: cluster 2021-03-10T17:36:42.248319+0000 mgr.gibba020.yqfnwy (mgr.34427) 11785 : cluster [DBG] pgmap v6718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:46.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:46 gibba013 bash[29418]: cluster 2021-03-10T17:36:44.249983+0000 mgr.gibba020.yqfnwy (mgr.34427) 11786 : cluster [DBG] pgmap v6719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:46.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:46 gibba013 bash[30381]: cluster 2021-03-10T17:36:44.249983+0000 mgr.gibba020.yqfnwy (mgr.34427) 11786 : cluster [DBG] pgmap v6719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:46.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:46 gibba020 bash[25448]: cluster 2021-03-10T17:36:44.249983+0000 mgr.gibba020.yqfnwy (mgr.34427) 11786 : cluster [DBG] pgmap v6719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:48.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:48 gibba020 bash[25448]: cluster 2021-03-10T17:36:46.251708+0000 mgr.gibba020.yqfnwy (mgr.34427) 11787 : cluster [DBG] pgmap v6720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:48.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:48 gibba013 bash[29418]: cluster 2021-03-10T17:36:46.251708+0000 mgr.gibba020.yqfnwy (mgr.34427) 11787 : cluster [DBG] pgmap v6720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:48.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:48 gibba013 bash[30381]: cluster 2021-03-10T17:36:46.251708+0000 mgr.gibba020.yqfnwy (mgr.34427) 11787 : cluster [DBG] pgmap v6720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:50.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:50 gibba020 bash[25448]: cluster 2021-03-10T17:36:48.252934+0000 mgr.gibba020.yqfnwy (mgr.34427) 11788 : cluster [DBG] pgmap v6721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:50.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:50 gibba013 bash[29418]: cluster 2021-03-10T17:36:48.252934+0000 mgr.gibba020.yqfnwy (mgr.34427) 11788 : cluster [DBG] pgmap v6721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:50.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:50 gibba013 bash[30381]: cluster 2021-03-10T17:36:48.252934+0000 mgr.gibba020.yqfnwy (mgr.34427) 11788 : cluster [DBG] pgmap v6721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:52.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:52 gibba020 bash[25448]: cluster 2021-03-10T17:36:50.254767+0000 mgr.gibba020.yqfnwy (mgr.34427) 11789 : cluster [DBG] pgmap v6722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:52.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:52 gibba020 bash[25448]: cephadm 2021-03-10T17:36:50.917332+0000 mgr.gibba020.yqfnwy (mgr.34427) 11790 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:36:52.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:52 gibba013 bash[29418]: cluster 2021-03-10T17:36:50.254767+0000 mgr.gibba020.yqfnwy (mgr.34427) 11789 : cluster [DBG] pgmap v6722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:52.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:52 gibba013 bash[29418]: cephadm 2021-03-10T17:36:50.917332+0000 mgr.gibba020.yqfnwy (mgr.34427) 11790 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:36:52.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:52 gibba013 bash[30381]: cluster 2021-03-10T17:36:50.254767+0000 mgr.gibba020.yqfnwy (mgr.34427) 11789 : cluster [DBG] pgmap v6722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:52.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:52 gibba013 bash[30381]: cephadm 2021-03-10T17:36:50.917332+0000 mgr.gibba020.yqfnwy (mgr.34427) 11790 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:36:54.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:54 gibba020 bash[25448]: cluster 2021-03-10T17:36:52.255848+0000 mgr.gibba020.yqfnwy (mgr.34427) 11791 : cluster [DBG] pgmap v6723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:54.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:54 gibba013 bash[29418]: cluster 2021-03-10T17:36:52.255848+0000 mgr.gibba020.yqfnwy (mgr.34427) 11791 : cluster [DBG] pgmap v6723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:54.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:54 gibba013 bash[30381]: cluster 2021-03-10T17:36:52.255848+0000 mgr.gibba020.yqfnwy (mgr.34427) 11791 : cluster [DBG] pgmap v6723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:56.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:56 gibba020 bash[25448]: cluster 2021-03-10T17:36:54.257187+0000 mgr.gibba020.yqfnwy (mgr.34427) 11792 : cluster [DBG] pgmap v6724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:56.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:56 gibba013 bash[29418]: cluster 2021-03-10T17:36:54.257187+0000 mgr.gibba020.yqfnwy (mgr.34427) 11792 : cluster [DBG] pgmap v6724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:56.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:56 gibba013 bash[30381]: cluster 2021-03-10T17:36:54.257187+0000 mgr.gibba020.yqfnwy (mgr.34427) 11792 : cluster [DBG] pgmap v6724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:58.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:58 gibba020 bash[25448]: cluster 2021-03-10T17:36:56.259027+0000 mgr.gibba020.yqfnwy (mgr.34427) 11793 : cluster [DBG] pgmap v6725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:58.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:58 gibba013 bash[29418]: cluster 2021-03-10T17:36:56.259027+0000 mgr.gibba020.yqfnwy (mgr.34427) 11793 : cluster [DBG] pgmap v6725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:58.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:58 gibba013 bash[30381]: cluster 2021-03-10T17:36:56.259027+0000 mgr.gibba020.yqfnwy (mgr.34427) 11793 : cluster [DBG] pgmap v6725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:59.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:36:59 gibba020 bash[25448]: cluster 2021-03-10T17:36:58.260334+0000 mgr.gibba020.yqfnwy (mgr.34427) 11794 : cluster [DBG] pgmap v6726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:59.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:36:59 gibba013 bash[29418]: cluster 2021-03-10T17:36:58.260334+0000 mgr.gibba020.yqfnwy (mgr.34427) 11794 : cluster [DBG] pgmap v6726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:36:59.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:36:59 gibba013 bash[30381]: cluster 2021-03-10T17:36:58.260334+0000 mgr.gibba020.yqfnwy (mgr.34427) 11794 : cluster [DBG] pgmap v6726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:01.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:01 gibba013 bash[29418]: cluster 2021-03-10T17:37:00.262207+0000 mgr.gibba020.yqfnwy (mgr.34427) 11795 : cluster [DBG] pgmap v6727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:01.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:01 gibba013 bash[30381]: cluster 2021-03-10T17:37:00.262207+0000 mgr.gibba020.yqfnwy (mgr.34427) 11795 : cluster [DBG] pgmap v6727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:01.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:01 gibba020 bash[25448]: cluster 2021-03-10T17:37:00.262207+0000 mgr.gibba020.yqfnwy (mgr.34427) 11795 : cluster [DBG] pgmap v6727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:03.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:03 gibba013 bash[29418]: cluster 2021-03-10T17:37:02.263597+0000 mgr.gibba020.yqfnwy (mgr.34427) 11796 : cluster [DBG] pgmap v6728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:03.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:03 gibba013 bash[30381]: cluster 2021-03-10T17:37:02.263597+0000 mgr.gibba020.yqfnwy (mgr.34427) 11796 : cluster [DBG] pgmap v6728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:03.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:03 gibba020 bash[25448]: cluster 2021-03-10T17:37:02.263597+0000 mgr.gibba020.yqfnwy (mgr.34427) 11796 : cluster [DBG] pgmap v6728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:05.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:05 gibba013 bash[29418]: cluster 2021-03-10T17:37:04.265190+0000 mgr.gibba020.yqfnwy (mgr.34427) 11797 : cluster [DBG] pgmap v6729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:05.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:05 gibba013 bash[30381]: cluster 2021-03-10T17:37:04.265190+0000 mgr.gibba020.yqfnwy (mgr.34427) 11797 : cluster [DBG] pgmap v6729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:05.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:05 gibba020 bash[25448]: cluster 2021-03-10T17:37:04.265190+0000 mgr.gibba020.yqfnwy (mgr.34427) 11797 : cluster [DBG] pgmap v6729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:06.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:06 gibba020 bash[25448]: audit 2021-03-10T17:37:05.935080+0000 mon.a (mon.0) 4123 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:37:06.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:06 gibba020 bash[25448]: cephadm 2021-03-10T17:37:05.940105+0000 mgr.gibba020.yqfnwy (mgr.34427) 11798 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:37:06.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:06 gibba020 bash[25448]: cephadm 2021-03-10T17:37:05.941926+0000 mgr.gibba020.yqfnwy (mgr.34427) 11799 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:37:06.450 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:06 gibba020 bash[25448]: audit 2021-03-10T17:37:06.168433+0000 mon.a (mon.0) 4124 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:37:06.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:06 gibba020 bash[25448]: cephadm 2021-03-10T17:37:06.174841+0000 mgr.gibba020.yqfnwy (mgr.34427) 11800 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:37:06.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:06 gibba020 bash[25448]: audit 2021-03-10T17:37:06.176425+0000 mon.a (mon.0) 4125 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:37:06.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:06 gibba020 bash[25448]: audit 2021-03-10T17:37:06.177964+0000 mon.a (mon.0) 4126 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:06.451 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:06 gibba020 bash[25448]: audit 2021-03-10T17:37:06.179941+0000 mon.a (mon.0) 4127 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:06.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:06 gibba020 bash[25448]: audit 2021-03-10T17:37:06.181302+0000 mon.a (mon.0) 4128 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:06.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:06 gibba020 bash[25448]: audit 2021-03-10T17:37:06.183817+0000 mon.a (mon.0) 4129 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:06.452 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:06 gibba020 bash[25448]: audit 2021-03-10T17:37:06.185508+0000 mon.a (mon.0) 4130 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:06 gibba013 bash[29418]: audit 2021-03-10T17:37:05.935080+0000 mon.a (mon.0) 4123 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:37:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:06 gibba013 bash[29418]: cephadm 2021-03-10T17:37:05.940105+0000 mgr.gibba020.yqfnwy (mgr.34427) 11798 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:37:06.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:06 gibba013 bash[29418]: cephadm 2021-03-10T17:37:05.941926+0000 mgr.gibba020.yqfnwy (mgr.34427) 11799 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:37:06.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:06 gibba013 bash[29418]: audit 2021-03-10T17:37:06.168433+0000 mon.a (mon.0) 4124 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:37:06.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:06 gibba013 bash[29418]: cephadm 2021-03-10T17:37:06.174841+0000 mgr.gibba020.yqfnwy (mgr.34427) 11800 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:37:06.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:06 gibba013 bash[29418]: audit 2021-03-10T17:37:06.176425+0000 mon.a (mon.0) 4125 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:37:06.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:06 gibba013 bash[29418]: audit 2021-03-10T17:37:06.177964+0000 mon.a (mon.0) 4126 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:06.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:06 gibba013 bash[29418]: audit 2021-03-10T17:37:06.179941+0000 mon.a (mon.0) 4127 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:06.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:06 gibba013 bash[29418]: audit 2021-03-10T17:37:06.181302+0000 mon.a (mon.0) 4128 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:06.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:06 gibba013 bash[29418]: audit 2021-03-10T17:37:06.183817+0000 mon.a (mon.0) 4129 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:06.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:06 gibba013 bash[29418]: audit 2021-03-10T17:37:06.185508+0000 mon.a (mon.0) 4130 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:06.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:06 gibba013 bash[30381]: audit 2021-03-10T17:37:05.935080+0000 mon.a (mon.0) 4123 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:37:06.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:06 gibba013 bash[30381]: cephadm 2021-03-10T17:37:05.940105+0000 mgr.gibba020.yqfnwy (mgr.34427) 11798 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:37:06.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:06 gibba013 bash[30381]: cephadm 2021-03-10T17:37:05.941926+0000 mgr.gibba020.yqfnwy (mgr.34427) 11799 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:37:06.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:06 gibba013 bash[30381]: audit 2021-03-10T17:37:06.168433+0000 mon.a (mon.0) 4124 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:37:06.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:06 gibba013 bash[30381]: cephadm 2021-03-10T17:37:06.174841+0000 mgr.gibba020.yqfnwy (mgr.34427) 11800 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:37:06.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:06 gibba013 bash[30381]: audit 2021-03-10T17:37:06.176425+0000 mon.a (mon.0) 4125 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:37:06.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:06 gibba013 bash[30381]: audit 2021-03-10T17:37:06.177964+0000 mon.a (mon.0) 4126 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:06.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:06 gibba013 bash[30381]: audit 2021-03-10T17:37:06.179941+0000 mon.a (mon.0) 4127 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:06.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:06 gibba013 bash[30381]: audit 2021-03-10T17:37:06.181302+0000 mon.a (mon.0) 4128 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:06.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:06 gibba013 bash[30381]: audit 2021-03-10T17:37:06.183817+0000 mon.a (mon.0) 4129 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:06.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:06 gibba013 bash[30381]: audit 2021-03-10T17:37:06.185508+0000 mon.a (mon.0) 4130 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:07.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:07 gibba013 bash[29418]: cephadm 2021-03-10T17:37:06.176876+0000 mgr.gibba020.yqfnwy (mgr.34427) 11801 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:37:07.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:07 gibba013 bash[29418]: cephadm 2021-03-10T17:37:06.178689+0000 mgr.gibba020.yqfnwy (mgr.34427) 11802 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:37:07.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:07 gibba013 bash[29418]: cephadm 2021-03-10T17:37:06.178729+0000 mgr.gibba020.yqfnwy (mgr.34427) 11803 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:37:07.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:07 gibba013 bash[29418]: cephadm 2021-03-10T17:37:06.180288+0000 mgr.gibba020.yqfnwy (mgr.34427) 11804 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:37:07.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:07 gibba013 bash[29418]: cephadm 2021-03-10T17:37:06.180325+0000 mgr.gibba020.yqfnwy (mgr.34427) 11805 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:37:07.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:07 gibba013 bash[29418]: cephadm 2021-03-10T17:37:06.181551+0000 mgr.gibba020.yqfnwy (mgr.34427) 11806 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:37:07.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:07 gibba013 bash[29418]: cephadm 2021-03-10T17:37:06.182690+0000 mgr.gibba020.yqfnwy (mgr.34427) 11807 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:37:07.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:07 gibba013 bash[29418]: cephadm 2021-03-10T17:37:06.182727+0000 mgr.gibba020.yqfnwy (mgr.34427) 11808 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:37:07.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:07 gibba013 bash[29418]: cephadm 2021-03-10T17:37:06.184189+0000 mgr.gibba020.yqfnwy (mgr.34427) 11809 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:37:07.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:07 gibba013 bash[29418]: cephadm 2021-03-10T17:37:06.184540+0000 mgr.gibba020.yqfnwy (mgr.34427) 11810 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:37:07.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:07 gibba013 bash[29418]: cephadm 2021-03-10T17:37:06.186056+0000 mgr.gibba020.yqfnwy (mgr.34427) 11811 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:37:07.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:07 gibba013 bash[29418]: cephadm 2021-03-10T17:37:06.186097+0000 mgr.gibba020.yqfnwy (mgr.34427) 11812 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:37:07.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:07 gibba013 bash[29418]: cephadm 2021-03-10T17:37:06.186213+0000 mgr.gibba020.yqfnwy (mgr.34427) 11813 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:37:07.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:07 gibba013 bash[29418]: cluster 2021-03-10T17:37:06.266996+0000 mgr.gibba020.yqfnwy (mgr.34427) 11814 : cluster [DBG] pgmap v6730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:07.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:07 gibba013 bash[29418]: audit 2021-03-10T17:37:07.038915+0000 mon.a (mon.0) 4131 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:37:07.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:07 gibba013 bash[29418]: audit 2021-03-10T17:37:07.300982+0000 mon.a (mon.0) 4132 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:37:07.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:07 gibba013 bash[30381]: cephadm 2021-03-10T17:37:06.176876+0000 mgr.gibba020.yqfnwy (mgr.34427) 11801 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:37:07.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:07 gibba013 bash[30381]: cephadm 2021-03-10T17:37:06.178689+0000 mgr.gibba020.yqfnwy (mgr.34427) 11802 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:37:07.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:07 gibba013 bash[30381]: cephadm 2021-03-10T17:37:06.178729+0000 mgr.gibba020.yqfnwy (mgr.34427) 11803 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:37:07.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:07 gibba013 bash[30381]: cephadm 2021-03-10T17:37:06.180288+0000 mgr.gibba020.yqfnwy (mgr.34427) 11804 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:37:07.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:07 gibba013 bash[30381]: cephadm 2021-03-10T17:37:06.180325+0000 mgr.gibba020.yqfnwy (mgr.34427) 11805 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:37:07.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:07 gibba013 bash[30381]: cephadm 2021-03-10T17:37:06.181551+0000 mgr.gibba020.yqfnwy (mgr.34427) 11806 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:37:07.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:07 gibba013 bash[30381]: cephadm 2021-03-10T17:37:06.182690+0000 mgr.gibba020.yqfnwy (mgr.34427) 11807 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:37:07.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:07 gibba013 bash[30381]: cephadm 2021-03-10T17:37:06.182727+0000 mgr.gibba020.yqfnwy (mgr.34427) 11808 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:37:07.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:07 gibba013 bash[30381]: cephadm 2021-03-10T17:37:06.184189+0000 mgr.gibba020.yqfnwy (mgr.34427) 11809 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:37:07.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:07 gibba013 bash[30381]: cephadm 2021-03-10T17:37:06.184540+0000 mgr.gibba020.yqfnwy (mgr.34427) 11810 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:37:07.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:07 gibba013 bash[30381]: cephadm 2021-03-10T17:37:06.186056+0000 mgr.gibba020.yqfnwy (mgr.34427) 11811 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:37:07.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:07 gibba013 bash[30381]: cephadm 2021-03-10T17:37:06.186097+0000 mgr.gibba020.yqfnwy (mgr.34427) 11812 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:37:07.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:07 gibba013 bash[30381]: cephadm 2021-03-10T17:37:06.186213+0000 mgr.gibba020.yqfnwy (mgr.34427) 11813 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:37:07.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:07 gibba013 bash[30381]: cluster 2021-03-10T17:37:06.266996+0000 mgr.gibba020.yqfnwy (mgr.34427) 11814 : cluster [DBG] pgmap v6730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:07.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:07 gibba013 bash[30381]: audit 2021-03-10T17:37:07.038915+0000 mon.a (mon.0) 4131 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:37:07.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:07 gibba013 bash[30381]: audit 2021-03-10T17:37:07.300982+0000 mon.a (mon.0) 4132 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:37:07.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:07 gibba020 bash[25448]: cephadm 2021-03-10T17:37:06.176876+0000 mgr.gibba020.yqfnwy (mgr.34427) 11801 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:37:07.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:07 gibba020 bash[25448]: cephadm 2021-03-10T17:37:06.178689+0000 mgr.gibba020.yqfnwy (mgr.34427) 11802 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:37:07.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:07 gibba020 bash[25448]: cephadm 2021-03-10T17:37:06.178729+0000 mgr.gibba020.yqfnwy (mgr.34427) 11803 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:37:07.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:07 gibba020 bash[25448]: cephadm 2021-03-10T17:37:06.180288+0000 mgr.gibba020.yqfnwy (mgr.34427) 11804 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:37:07.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:07 gibba020 bash[25448]: cephadm 2021-03-10T17:37:06.180325+0000 mgr.gibba020.yqfnwy (mgr.34427) 11805 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:37:07.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:07 gibba020 bash[25448]: cephadm 2021-03-10T17:37:06.181551+0000 mgr.gibba020.yqfnwy (mgr.34427) 11806 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:37:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:07 gibba020 bash[25448]: cephadm 2021-03-10T17:37:06.182690+0000 mgr.gibba020.yqfnwy (mgr.34427) 11807 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:37:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:07 gibba020 bash[25448]: cephadm 2021-03-10T17:37:06.182727+0000 mgr.gibba020.yqfnwy (mgr.34427) 11808 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:37:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:07 gibba020 bash[25448]: cephadm 2021-03-10T17:37:06.184189+0000 mgr.gibba020.yqfnwy (mgr.34427) 11809 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:37:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:07 gibba020 bash[25448]: cephadm 2021-03-10T17:37:06.184540+0000 mgr.gibba020.yqfnwy (mgr.34427) 11810 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:37:07.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:07 gibba020 bash[25448]: cephadm 2021-03-10T17:37:06.186056+0000 mgr.gibba020.yqfnwy (mgr.34427) 11811 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:37:07.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:07 gibba020 bash[25448]: cephadm 2021-03-10T17:37:06.186097+0000 mgr.gibba020.yqfnwy (mgr.34427) 11812 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:37:07.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:07 gibba020 bash[25448]: cephadm 2021-03-10T17:37:06.186213+0000 mgr.gibba020.yqfnwy (mgr.34427) 11813 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:37:07.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:07 gibba020 bash[25448]: cluster 2021-03-10T17:37:06.266996+0000 mgr.gibba020.yqfnwy (mgr.34427) 11814 : cluster [DBG] pgmap v6730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:07.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:07 gibba020 bash[25448]: audit 2021-03-10T17:37:07.038915+0000 mon.a (mon.0) 4131 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:37:07.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:07 gibba020 bash[25448]: audit 2021-03-10T17:37:07.300982+0000 mon.a (mon.0) 4132 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:37:08.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:08 gibba013 bash[29418]: audit 2021-03-10T17:37:07.774790+0000 mon.a (mon.0) 4133 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T17:37:08.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:08 gibba013 bash[29418]: audit 2021-03-10T17:37:07.775599+0000 mon.a (mon.0) 4134 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:37:08.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:08 gibba013 bash[29418]: audit 2021-03-10T17:37:07.776274+0000 mon.a (mon.0) 4135 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:37:08.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:08 gibba013 bash[29418]: audit 2021-03-10T17:37:07.776885+0000 mon.a (mon.0) 4136 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:37:08.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:08 gibba013 bash[30381]: audit 2021-03-10T17:37:07.774790+0000 mon.a (mon.0) 4133 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T17:37:08.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:08 gibba013 bash[30381]: audit 2021-03-10T17:37:07.775599+0000 mon.a (mon.0) 4134 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:37:08.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:08 gibba013 bash[30381]: audit 2021-03-10T17:37:07.776274+0000 mon.a (mon.0) 4135 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:37:08.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:08 gibba013 bash[30381]: audit 2021-03-10T17:37:07.776885+0000 mon.a (mon.0) 4136 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:37:08.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:08 gibba020 bash[25448]: audit 2021-03-10T17:37:07.774790+0000 mon.a (mon.0) 4133 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T17:37:08.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:08 gibba020 bash[25448]: audit 2021-03-10T17:37:07.775599+0000 mon.a (mon.0) 4134 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:37:08.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:08 gibba020 bash[25448]: audit 2021-03-10T17:37:07.776274+0000 mon.a (mon.0) 4135 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:37:08.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:08 gibba020 bash[25448]: audit 2021-03-10T17:37:07.776885+0000 mon.a (mon.0) 4136 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:37:09.527 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:37:09.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:09 gibba013 bash[29418]: cluster 2021-03-10T17:37:08.268294+0000 mgr.gibba020.yqfnwy (mgr.34427) 11815 : cluster [DBG] pgmap v6731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:09.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:09 gibba013 bash[30381]: cluster 2021-03-10T17:37:08.268294+0000 mgr.gibba020.yqfnwy (mgr.34427) 11815 : cluster [DBG] pgmap v6731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:09.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:09 gibba020 bash[25448]: cluster 2021-03-10T17:37:08.268294+0000 mgr.gibba020.yqfnwy (mgr.34427) 11815 : cluster [DBG] pgmap v6731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:09.757 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:37:09.757 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 5m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:37:09.757 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 4m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:37:09.758 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:37:09.758 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:37:09.758 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:37:09.758 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:37:09.759 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:37:09.759 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:37:09.759 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:37:09.759 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:37:09.759 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:37:09.760 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:37:09.760 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:37:09.760 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:37:09.760 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:37:09.761 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:37:09.761 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:37:09.761 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:37:09.761 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 4m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:37:09.761 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 4m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:37:10.006 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:37:10.006 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:37:10.006 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:37:10.006 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:37:10.007 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:37:10.007 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:37:10.007 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:37:10.007 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:37:10.008 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:37:10.008 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:37:10.008 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:37:10.008 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:37:10.008 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:37:10.009 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:37:10.009 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:37:10.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:10 gibba013 bash[29418]: audit 2021-03-10T17:37:09.514539+0000 mgr.gibba020.yqfnwy (mgr.34427) 11816 : audit [DBG] from='client.61951 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:37:10.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:10 gibba013 bash[29418]: audit 2021-03-10T17:37:09.742120+0000 mgr.gibba020.yqfnwy (mgr.34427) 11817 : audit [DBG] from='client.61957 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:37:10.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:10 gibba013 bash[29418]: audit 2021-03-10T17:37:10.003497+0000 mon.a (mon.0) 4137 : audit [DBG] from='client.? 172.21.2.113:0/2415993591' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:10.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:10 gibba013 bash[30381]: audit 2021-03-10T17:37:09.514539+0000 mgr.gibba020.yqfnwy (mgr.34427) 11816 : audit [DBG] from='client.61951 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:37:10.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:10 gibba013 bash[30381]: audit 2021-03-10T17:37:09.742120+0000 mgr.gibba020.yqfnwy (mgr.34427) 11817 : audit [DBG] from='client.61957 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:37:10.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:10 gibba013 bash[30381]: audit 2021-03-10T17:37:10.003497+0000 mon.a (mon.0) 4137 : audit [DBG] from='client.? 172.21.2.113:0/2415993591' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:10.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:10 gibba020 bash[25448]: audit 2021-03-10T17:37:09.514539+0000 mgr.gibba020.yqfnwy (mgr.34427) 11816 : audit [DBG] from='client.61951 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:37:10.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:10 gibba020 bash[25448]: audit 2021-03-10T17:37:09.742120+0000 mgr.gibba020.yqfnwy (mgr.34427) 11817 : audit [DBG] from='client.61957 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:37:10.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:10 gibba020 bash[25448]: audit 2021-03-10T17:37:10.003497+0000 mon.a (mon.0) 4137 : audit [DBG] from='client.? 172.21.2.113:0/2415993591' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:11.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:11 gibba020 bash[25448]: cluster 2021-03-10T17:37:10.270181+0000 mgr.gibba020.yqfnwy (mgr.34427) 11818 : cluster [DBG] pgmap v6732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:11.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:11 gibba013 bash[29418]: cluster 2021-03-10T17:37:10.270181+0000 mgr.gibba020.yqfnwy (mgr.34427) 11818 : cluster [DBG] pgmap v6732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:11.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:11 gibba013 bash[30381]: cluster 2021-03-10T17:37:10.270181+0000 mgr.gibba020.yqfnwy (mgr.34427) 11818 : cluster [DBG] pgmap v6732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:13.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:13 gibba020 bash[25448]: cluster 2021-03-10T17:37:12.271553+0000 mgr.gibba020.yqfnwy (mgr.34427) 11819 : cluster [DBG] pgmap v6733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:13.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:13 gibba013 bash[29418]: cluster 2021-03-10T17:37:12.271553+0000 mgr.gibba020.yqfnwy (mgr.34427) 11819 : cluster [DBG] pgmap v6733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:13.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:13 gibba013 bash[30381]: cluster 2021-03-10T17:37:12.271553+0000 mgr.gibba020.yqfnwy (mgr.34427) 11819 : cluster [DBG] pgmap v6733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:15.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:15 gibba020 bash[25448]: cluster 2021-03-10T17:37:14.273190+0000 mgr.gibba020.yqfnwy (mgr.34427) 11820 : cluster [DBG] pgmap v6734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:15.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:15 gibba013 bash[29418]: cluster 2021-03-10T17:37:14.273190+0000 mgr.gibba020.yqfnwy (mgr.34427) 11820 : cluster [DBG] pgmap v6734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:15.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:15 gibba013 bash[30381]: cluster 2021-03-10T17:37:14.273190+0000 mgr.gibba020.yqfnwy (mgr.34427) 11820 : cluster [DBG] pgmap v6734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:17.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:17 gibba020 bash[25448]: cluster 2021-03-10T17:37:16.275043+0000 mgr.gibba020.yqfnwy (mgr.34427) 11821 : cluster [DBG] pgmap v6735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:17.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:17 gibba013 bash[29418]: cluster 2021-03-10T17:37:16.275043+0000 mgr.gibba020.yqfnwy (mgr.34427) 11821 : cluster [DBG] pgmap v6735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:17.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:17 gibba013 bash[30381]: cluster 2021-03-10T17:37:16.275043+0000 mgr.gibba020.yqfnwy (mgr.34427) 11821 : cluster [DBG] pgmap v6735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:19.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:19 gibba020 bash[25448]: cluster 2021-03-10T17:37:18.276462+0000 mgr.gibba020.yqfnwy (mgr.34427) 11822 : cluster [DBG] pgmap v6736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:19.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:19 gibba013 bash[29418]: cluster 2021-03-10T17:37:18.276462+0000 mgr.gibba020.yqfnwy (mgr.34427) 11822 : cluster [DBG] pgmap v6736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:19.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:19 gibba013 bash[30381]: cluster 2021-03-10T17:37:18.276462+0000 mgr.gibba020.yqfnwy (mgr.34427) 11822 : cluster [DBG] pgmap v6736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:21.449 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:21 gibba020 bash[25448]: cluster 2021-03-10T17:37:20.278292+0000 mgr.gibba020.yqfnwy (mgr.34427) 11823 : cluster [DBG] pgmap v6737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:21.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:21 gibba013 bash[29418]: cluster 2021-03-10T17:37:20.278292+0000 mgr.gibba020.yqfnwy (mgr.34427) 11823 : cluster [DBG] pgmap v6737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:21.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:21 gibba013 bash[30381]: cluster 2021-03-10T17:37:20.278292+0000 mgr.gibba020.yqfnwy (mgr.34427) 11823 : cluster [DBG] pgmap v6737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:22.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:22 gibba020 bash[25448]: cephadm 2021-03-10T17:37:21.188906+0000 mgr.gibba020.yqfnwy (mgr.34427) 11824 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:37:22.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:22 gibba013 bash[29418]: cephadm 2021-03-10T17:37:21.188906+0000 mgr.gibba020.yqfnwy (mgr.34427) 11824 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:37:22.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:22 gibba013 bash[30381]: cephadm 2021-03-10T17:37:21.188906+0000 mgr.gibba020.yqfnwy (mgr.34427) 11824 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:37:23.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:23 gibba020 bash[25448]: cluster 2021-03-10T17:37:22.279529+0000 mgr.gibba020.yqfnwy (mgr.34427) 11825 : cluster [DBG] pgmap v6738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:23.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:23 gibba013 bash[29418]: cluster 2021-03-10T17:37:22.279529+0000 mgr.gibba020.yqfnwy (mgr.34427) 11825 : cluster [DBG] pgmap v6738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:23.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:23 gibba013 bash[30381]: cluster 2021-03-10T17:37:22.279529+0000 mgr.gibba020.yqfnwy (mgr.34427) 11825 : cluster [DBG] pgmap v6738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:25.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:25 gibba013 bash[29418]: cluster 2021-03-10T17:37:24.281162+0000 mgr.gibba020.yqfnwy (mgr.34427) 11826 : cluster [DBG] pgmap v6739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:25.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:25 gibba013 bash[30381]: cluster 2021-03-10T17:37:24.281162+0000 mgr.gibba020.yqfnwy (mgr.34427) 11826 : cluster [DBG] pgmap v6739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:25.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:25 gibba020 bash[25448]: cluster 2021-03-10T17:37:24.281162+0000 mgr.gibba020.yqfnwy (mgr.34427) 11826 : cluster [DBG] pgmap v6739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:27.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:27 gibba013 bash[29418]: cluster 2021-03-10T17:37:26.282974+0000 mgr.gibba020.yqfnwy (mgr.34427) 11827 : cluster [DBG] pgmap v6740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:27.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:27 gibba013 bash[30381]: cluster 2021-03-10T17:37:26.282974+0000 mgr.gibba020.yqfnwy (mgr.34427) 11827 : cluster [DBG] pgmap v6740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:27.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:27 gibba020 bash[25448]: cluster 2021-03-10T17:37:26.282974+0000 mgr.gibba020.yqfnwy (mgr.34427) 11827 : cluster [DBG] pgmap v6740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:29.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:29 gibba013 bash[29418]: cluster 2021-03-10T17:37:28.284317+0000 mgr.gibba020.yqfnwy (mgr.34427) 11828 : cluster [DBG] pgmap v6741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:29.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:29 gibba013 bash[30381]: cluster 2021-03-10T17:37:28.284317+0000 mgr.gibba020.yqfnwy (mgr.34427) 11828 : cluster [DBG] pgmap v6741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:29.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:29 gibba020 bash[25448]: cluster 2021-03-10T17:37:28.284317+0000 mgr.gibba020.yqfnwy (mgr.34427) 11828 : cluster [DBG] pgmap v6741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:31.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:31 gibba013 bash[29418]: cluster 2021-03-10T17:37:30.286033+0000 mgr.gibba020.yqfnwy (mgr.34427) 11829 : cluster [DBG] pgmap v6742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:31.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:31 gibba013 bash[30381]: cluster 2021-03-10T17:37:30.286033+0000 mgr.gibba020.yqfnwy (mgr.34427) 11829 : cluster [DBG] pgmap v6742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:31.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:31 gibba020 bash[25448]: cluster 2021-03-10T17:37:30.286033+0000 mgr.gibba020.yqfnwy (mgr.34427) 11829 : cluster [DBG] pgmap v6742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:33.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:33 gibba013 bash[29418]: cluster 2021-03-10T17:37:32.287345+0000 mgr.gibba020.yqfnwy (mgr.34427) 11830 : cluster [DBG] pgmap v6743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:33.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:33 gibba013 bash[30381]: cluster 2021-03-10T17:37:32.287345+0000 mgr.gibba020.yqfnwy (mgr.34427) 11830 : cluster [DBG] pgmap v6743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:33.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:33 gibba020 bash[25448]: cluster 2021-03-10T17:37:32.287345+0000 mgr.gibba020.yqfnwy (mgr.34427) 11830 : cluster [DBG] pgmap v6743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:35.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:35 gibba013 bash[29418]: cluster 2021-03-10T17:37:34.289180+0000 mgr.gibba020.yqfnwy (mgr.34427) 11831 : cluster [DBG] pgmap v6744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:35.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:35 gibba013 bash[30381]: cluster 2021-03-10T17:37:34.289180+0000 mgr.gibba020.yqfnwy (mgr.34427) 11831 : cluster [DBG] pgmap v6744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:35.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:35 gibba020 bash[25448]: cluster 2021-03-10T17:37:34.289180+0000 mgr.gibba020.yqfnwy (mgr.34427) 11831 : cluster [DBG] pgmap v6744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:37.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:37 gibba013 bash[29418]: cephadm 2021-03-10T17:37:36.205054+0000 mgr.gibba020.yqfnwy (mgr.34427) 11832 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:37:37.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:37 gibba013 bash[29418]: cluster 2021-03-10T17:37:36.291149+0000 mgr.gibba020.yqfnwy (mgr.34427) 11833 : cluster [DBG] pgmap v6745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:37.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:37 gibba013 bash[30381]: cephadm 2021-03-10T17:37:36.205054+0000 mgr.gibba020.yqfnwy (mgr.34427) 11832 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:37:37.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:37 gibba013 bash[30381]: cluster 2021-03-10T17:37:36.291149+0000 mgr.gibba020.yqfnwy (mgr.34427) 11833 : cluster [DBG] pgmap v6745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:37.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:37 gibba020 bash[25448]: cephadm 2021-03-10T17:37:36.205054+0000 mgr.gibba020.yqfnwy (mgr.34427) 11832 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:37:37.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:37 gibba020 bash[25448]: cluster 2021-03-10T17:37:36.291149+0000 mgr.gibba020.yqfnwy (mgr.34427) 11833 : cluster [DBG] pgmap v6745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:39.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:39 gibba013 bash[29418]: cluster 2021-03-10T17:37:38.292477+0000 mgr.gibba020.yqfnwy (mgr.34427) 11834 : cluster [DBG] pgmap v6746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:39.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:39 gibba013 bash[30381]: cluster 2021-03-10T17:37:38.292477+0000 mgr.gibba020.yqfnwy (mgr.34427) 11834 : cluster [DBG] pgmap v6746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:39.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:39 gibba020 bash[25448]: cluster 2021-03-10T17:37:38.292477+0000 mgr.gibba020.yqfnwy (mgr.34427) 11834 : cluster [DBG] pgmap v6746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:40.248 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:37:40.474 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:37:40.475 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 5m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:37:40.475 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 4m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:37:40.475 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:37:40.475 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:37:40.476 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:37:40.476 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:37:40.476 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:37:40.476 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:37:40.477 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:37:40.477 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:37:40.477 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:37:40.477 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:37:40.477 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:37:40.478 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:37:40.478 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:37:40.478 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:37:40.478 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:37:40.479 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 4m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:37:40.479 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 4m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:37:40.479 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 4m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:37:40.723 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:37:40.723 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:37:40.723 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:37:40.724 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:37:40.724 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:37:40.724 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:37:40.724 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:37:40.725 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:37:40.725 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:37:40.725 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:37:40.725 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:37:40.726 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:37:40.726 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:37:40.726 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:37:40.726 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:37:41.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:41 gibba013 bash[29418]: audit 2021-03-10T17:37:40.236415+0000 mgr.gibba020.yqfnwy (mgr.34427) 11835 : audit [DBG] from='client.51990 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:37:41.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:41 gibba013 bash[29418]: cluster 2021-03-10T17:37:40.294255+0000 mgr.gibba020.yqfnwy (mgr.34427) 11836 : cluster [DBG] pgmap v6747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:41.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:41 gibba013 bash[29418]: audit 2021-03-10T17:37:40.458494+0000 mgr.gibba020.yqfnwy (mgr.34427) 11837 : audit [DBG] from='client.51996 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:37:41.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:41 gibba013 bash[29418]: audit 2021-03-10T17:37:40.720817+0000 mon.a (mon.0) 4138 : audit [DBG] from='client.? 172.21.2.113:0/126693037' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:41.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:41 gibba013 bash[30381]: audit 2021-03-10T17:37:40.236415+0000 mgr.gibba020.yqfnwy (mgr.34427) 11835 : audit [DBG] from='client.51990 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:37:41.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:41 gibba013 bash[30381]: cluster 2021-03-10T17:37:40.294255+0000 mgr.gibba020.yqfnwy (mgr.34427) 11836 : cluster [DBG] pgmap v6747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:41.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:41 gibba013 bash[30381]: audit 2021-03-10T17:37:40.458494+0000 mgr.gibba020.yqfnwy (mgr.34427) 11837 : audit [DBG] from='client.51996 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:37:41.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:41 gibba013 bash[30381]: audit 2021-03-10T17:37:40.720817+0000 mon.a (mon.0) 4138 : audit [DBG] from='client.? 172.21.2.113:0/126693037' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:41.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:41 gibba020 bash[25448]: audit 2021-03-10T17:37:40.236415+0000 mgr.gibba020.yqfnwy (mgr.34427) 11835 : audit [DBG] from='client.51990 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:37:41.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:41 gibba020 bash[25448]: cluster 2021-03-10T17:37:40.294255+0000 mgr.gibba020.yqfnwy (mgr.34427) 11836 : cluster [DBG] pgmap v6747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:41.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:41 gibba020 bash[25448]: audit 2021-03-10T17:37:40.458494+0000 mgr.gibba020.yqfnwy (mgr.34427) 11837 : audit [DBG] from='client.51996 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:37:41.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:41 gibba020 bash[25448]: audit 2021-03-10T17:37:40.720817+0000 mon.a (mon.0) 4138 : audit [DBG] from='client.? 172.21.2.113:0/126693037' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:37:43.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:43 gibba013 bash[29418]: cluster 2021-03-10T17:37:42.295683+0000 mgr.gibba020.yqfnwy (mgr.34427) 11838 : cluster [DBG] pgmap v6748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:43.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:43 gibba013 bash[30381]: cluster 2021-03-10T17:37:42.295683+0000 mgr.gibba020.yqfnwy (mgr.34427) 11838 : cluster [DBG] pgmap v6748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:43.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:43 gibba020 bash[25448]: cluster 2021-03-10T17:37:42.295683+0000 mgr.gibba020.yqfnwy (mgr.34427) 11838 : cluster [DBG] pgmap v6748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:45.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:45 gibba013 bash[29418]: cluster 2021-03-10T17:37:44.297376+0000 mgr.gibba020.yqfnwy (mgr.34427) 11839 : cluster [DBG] pgmap v6749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:45.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:45 gibba013 bash[30381]: cluster 2021-03-10T17:37:44.297376+0000 mgr.gibba020.yqfnwy (mgr.34427) 11839 : cluster [DBG] pgmap v6749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:45.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:45 gibba020 bash[25448]: cluster 2021-03-10T17:37:44.297376+0000 mgr.gibba020.yqfnwy (mgr.34427) 11839 : cluster [DBG] pgmap v6749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:47.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:47 gibba013 bash[29418]: cluster 2021-03-10T17:37:46.299291+0000 mgr.gibba020.yqfnwy (mgr.34427) 11840 : cluster [DBG] pgmap v6750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:47.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:47 gibba013 bash[30381]: cluster 2021-03-10T17:37:46.299291+0000 mgr.gibba020.yqfnwy (mgr.34427) 11840 : cluster [DBG] pgmap v6750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:47.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:47 gibba020 bash[25448]: cluster 2021-03-10T17:37:46.299291+0000 mgr.gibba020.yqfnwy (mgr.34427) 11840 : cluster [DBG] pgmap v6750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:49.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:49 gibba013 bash[29418]: cluster 2021-03-10T17:37:48.300531+0000 mgr.gibba020.yqfnwy (mgr.34427) 11841 : cluster [DBG] pgmap v6751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:49.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:49 gibba013 bash[30381]: cluster 2021-03-10T17:37:48.300531+0000 mgr.gibba020.yqfnwy (mgr.34427) 11841 : cluster [DBG] pgmap v6751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:49.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:49 gibba020 bash[25448]: cluster 2021-03-10T17:37:48.300531+0000 mgr.gibba020.yqfnwy (mgr.34427) 11841 : cluster [DBG] pgmap v6751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:51.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:51 gibba013 bash[29418]: cluster 2021-03-10T17:37:50.302383+0000 mgr.gibba020.yqfnwy (mgr.34427) 11842 : cluster [DBG] pgmap v6752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:51.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:51 gibba013 bash[30381]: cluster 2021-03-10T17:37:50.302383+0000 mgr.gibba020.yqfnwy (mgr.34427) 11842 : cluster [DBG] pgmap v6752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:51.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:51 gibba020 bash[25448]: cluster 2021-03-10T17:37:50.302383+0000 mgr.gibba020.yqfnwy (mgr.34427) 11842 : cluster [DBG] pgmap v6752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:52.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:52 gibba013 bash[29418]: cephadm 2021-03-10T17:37:51.221024+0000 mgr.gibba020.yqfnwy (mgr.34427) 11843 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:37:52.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:52 gibba013 bash[30381]: cephadm 2021-03-10T17:37:51.221024+0000 mgr.gibba020.yqfnwy (mgr.34427) 11843 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:37:52.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:52 gibba020 bash[25448]: cephadm 2021-03-10T17:37:51.221024+0000 mgr.gibba020.yqfnwy (mgr.34427) 11843 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:37:53.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:53 gibba013 bash[29418]: cluster 2021-03-10T17:37:52.303807+0000 mgr.gibba020.yqfnwy (mgr.34427) 11844 : cluster [DBG] pgmap v6753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:53.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:53 gibba013 bash[30381]: cluster 2021-03-10T17:37:52.303807+0000 mgr.gibba020.yqfnwy (mgr.34427) 11844 : cluster [DBG] pgmap v6753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:53.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:53 gibba020 bash[25448]: cluster 2021-03-10T17:37:52.303807+0000 mgr.gibba020.yqfnwy (mgr.34427) 11844 : cluster [DBG] pgmap v6753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:55.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:55 gibba013 bash[29418]: cluster 2021-03-10T17:37:54.305468+0000 mgr.gibba020.yqfnwy (mgr.34427) 11845 : cluster [DBG] pgmap v6754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:55.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:55 gibba013 bash[30381]: cluster 2021-03-10T17:37:54.305468+0000 mgr.gibba020.yqfnwy (mgr.34427) 11845 : cluster [DBG] pgmap v6754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:55.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:55 gibba020 bash[25448]: cluster 2021-03-10T17:37:54.305468+0000 mgr.gibba020.yqfnwy (mgr.34427) 11845 : cluster [DBG] pgmap v6754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:57.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:57 gibba013 bash[29418]: cluster 2021-03-10T17:37:56.307369+0000 mgr.gibba020.yqfnwy (mgr.34427) 11846 : cluster [DBG] pgmap v6755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:57.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:57 gibba013 bash[30381]: cluster 2021-03-10T17:37:56.307369+0000 mgr.gibba020.yqfnwy (mgr.34427) 11846 : cluster [DBG] pgmap v6755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:57.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:57 gibba020 bash[25448]: cluster 2021-03-10T17:37:56.307369+0000 mgr.gibba020.yqfnwy (mgr.34427) 11846 : cluster [DBG] pgmap v6755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:59.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:37:59 gibba013 bash[29418]: cluster 2021-03-10T17:37:58.308611+0000 mgr.gibba020.yqfnwy (mgr.34427) 11847 : cluster [DBG] pgmap v6756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:59.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:37:59 gibba013 bash[30381]: cluster 2021-03-10T17:37:58.308611+0000 mgr.gibba020.yqfnwy (mgr.34427) 11847 : cluster [DBG] pgmap v6756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:37:59.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:37:59 gibba020 bash[25448]: cluster 2021-03-10T17:37:58.308611+0000 mgr.gibba020.yqfnwy (mgr.34427) 11847 : cluster [DBG] pgmap v6756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:01.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:01 gibba013 bash[29418]: cluster 2021-03-10T17:38:00.310183+0000 mgr.gibba020.yqfnwy (mgr.34427) 11848 : cluster [DBG] pgmap v6757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:01.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:01 gibba013 bash[30381]: cluster 2021-03-10T17:38:00.310183+0000 mgr.gibba020.yqfnwy (mgr.34427) 11848 : cluster [DBG] pgmap v6757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:01.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:01 gibba020 bash[25448]: cluster 2021-03-10T17:38:00.310183+0000 mgr.gibba020.yqfnwy (mgr.34427) 11848 : cluster [DBG] pgmap v6757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:03.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:03 gibba013 bash[29418]: cluster 2021-03-10T17:38:02.311567+0000 mgr.gibba020.yqfnwy (mgr.34427) 11849 : cluster [DBG] pgmap v6758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:03.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:03 gibba013 bash[30381]: cluster 2021-03-10T17:38:02.311567+0000 mgr.gibba020.yqfnwy (mgr.34427) 11849 : cluster [DBG] pgmap v6758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:03.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:03 gibba020 bash[25448]: cluster 2021-03-10T17:38:02.311567+0000 mgr.gibba020.yqfnwy (mgr.34427) 11849 : cluster [DBG] pgmap v6758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:05.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:05 gibba020 bash[25448]: cluster 2021-03-10T17:38:04.313137+0000 mgr.gibba020.yqfnwy (mgr.34427) 11850 : cluster [DBG] pgmap v6759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:06.138 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:05 gibba013 bash[29418]: cluster 2021-03-10T17:38:04.313137+0000 mgr.gibba020.yqfnwy (mgr.34427) 11850 : cluster [DBG] pgmap v6759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:06.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:05 gibba013 bash[30381]: cluster 2021-03-10T17:38:04.313137+0000 mgr.gibba020.yqfnwy (mgr.34427) 11850 : cluster [DBG] pgmap v6759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:06.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:06 gibba020 bash[25448]: audit 2021-03-10T17:38:06.238586+0000 mon.a (mon.0) 4139 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:38:06.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:06 gibba020 bash[25448]: audit 2021-03-10T17:38:06.477007+0000 mon.a (mon.0) 4140 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:38:06.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:06 gibba020 bash[25448]: audit 2021-03-10T17:38:06.480269+0000 mon.a (mon.0) 4141 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:38:06.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:06 gibba020 bash[25448]: audit 2021-03-10T17:38:06.481731+0000 mon.a (mon.0) 4142 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:06.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:06 gibba020 bash[25448]: audit 2021-03-10T17:38:06.483339+0000 mon.a (mon.0) 4143 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:06.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:06 gibba020 bash[25448]: audit 2021-03-10T17:38:06.484738+0000 mon.a (mon.0) 4144 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:06.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:06 gibba020 bash[25448]: audit 2021-03-10T17:38:06.487888+0000 mon.a (mon.0) 4145 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:06.957 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:06 gibba020 bash[25448]: audit 2021-03-10T17:38:06.489691+0000 mon.a (mon.0) 4146 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:06 gibba013 bash[29418]: audit 2021-03-10T17:38:06.238586+0000 mon.a (mon.0) 4139 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:38:07.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:06 gibba013 bash[29418]: audit 2021-03-10T17:38:06.477007+0000 mon.a (mon.0) 4140 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:38:07.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:06 gibba013 bash[29418]: audit 2021-03-10T17:38:06.480269+0000 mon.a (mon.0) 4141 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:38:07.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:06 gibba013 bash[29418]: audit 2021-03-10T17:38:06.481731+0000 mon.a (mon.0) 4142 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:07.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:06 gibba013 bash[29418]: audit 2021-03-10T17:38:06.483339+0000 mon.a (mon.0) 4143 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:07.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:06 gibba013 bash[29418]: audit 2021-03-10T17:38:06.484738+0000 mon.a (mon.0) 4144 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:06 gibba013 bash[29418]: audit 2021-03-10T17:38:06.487888+0000 mon.a (mon.0) 4145 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:07.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:06 gibba013 bash[29418]: audit 2021-03-10T17:38:06.489691+0000 mon.a (mon.0) 4146 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:07.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:06 gibba013 bash[30381]: audit 2021-03-10T17:38:06.238586+0000 mon.a (mon.0) 4139 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:38:07.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:06 gibba013 bash[30381]: audit 2021-03-10T17:38:06.477007+0000 mon.a (mon.0) 4140 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:38:07.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:06 gibba013 bash[30381]: audit 2021-03-10T17:38:06.480269+0000 mon.a (mon.0) 4141 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:38:07.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:06 gibba013 bash[30381]: audit 2021-03-10T17:38:06.481731+0000 mon.a (mon.0) 4142 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:07.135 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:06 gibba013 bash[30381]: audit 2021-03-10T17:38:06.483339+0000 mon.a (mon.0) 4143 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:06 gibba013 bash[30381]: audit 2021-03-10T17:38:06.484738+0000 mon.a (mon.0) 4144 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:06 gibba013 bash[30381]: audit 2021-03-10T17:38:06.487888+0000 mon.a (mon.0) 4145 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:07.136 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:06 gibba013 bash[30381]: audit 2021-03-10T17:38:06.489691+0000 mon.a (mon.0) 4146 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:07.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:07 gibba020 bash[25448]: cephadm 2021-03-10T17:38:06.243985+0000 mgr.gibba020.yqfnwy (mgr.34427) 11851 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:38:07.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:07 gibba020 bash[25448]: cephadm 2021-03-10T17:38:06.245480+0000 mgr.gibba020.yqfnwy (mgr.34427) 11852 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:38:07.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:07 gibba020 bash[25448]: cluster 2021-03-10T17:38:06.313676+0000 mgr.gibba020.yqfnwy (mgr.34427) 11853 : cluster [DBG] pgmap v6760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:07.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:07 gibba020 bash[25448]: cephadm 2021-03-10T17:38:06.478850+0000 mgr.gibba020.yqfnwy (mgr.34427) 11854 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:38:07.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:07 gibba020 bash[25448]: cephadm 2021-03-10T17:38:06.480787+0000 mgr.gibba020.yqfnwy (mgr.34427) 11855 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:38:07.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:07 gibba020 bash[25448]: cephadm 2021-03-10T17:38:06.482229+0000 mgr.gibba020.yqfnwy (mgr.34427) 11856 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:38:07.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:07 gibba020 bash[25448]: cephadm 2021-03-10T17:38:06.482269+0000 mgr.gibba020.yqfnwy (mgr.34427) 11857 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:38:07.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:07 gibba020 bash[25448]: cephadm 2021-03-10T17:38:06.483688+0000 mgr.gibba020.yqfnwy (mgr.34427) 11858 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:38:07.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:07 gibba020 bash[25448]: cephadm 2021-03-10T17:38:06.483728+0000 mgr.gibba020.yqfnwy (mgr.34427) 11859 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:38:07.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:07 gibba020 bash[25448]: cephadm 2021-03-10T17:38:06.485083+0000 mgr.gibba020.yqfnwy (mgr.34427) 11860 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:38:07.957 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:07 gibba020 bash[25448]: cephadm 2021-03-10T17:38:06.486698+0000 mgr.gibba020.yqfnwy (mgr.34427) 11861 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:38:07.957 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:07 gibba020 bash[25448]: cephadm 2021-03-10T17:38:06.486741+0000 mgr.gibba020.yqfnwy (mgr.34427) 11862 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:38:07.957 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:07 gibba020 bash[25448]: cephadm 2021-03-10T17:38:06.488331+0000 mgr.gibba020.yqfnwy (mgr.34427) 11863 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:38:07.957 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:07 gibba020 bash[25448]: cephadm 2021-03-10T17:38:06.488692+0000 mgr.gibba020.yqfnwy (mgr.34427) 11864 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:38:07.957 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:07 gibba020 bash[25448]: cephadm 2021-03-10T17:38:06.490489+0000 mgr.gibba020.yqfnwy (mgr.34427) 11865 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:38:07.958 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:07 gibba020 bash[25448]: cephadm 2021-03-10T17:38:06.490537+0000 mgr.gibba020.yqfnwy (mgr.34427) 11866 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:38:07.958 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:07 gibba020 bash[25448]: cephadm 2021-03-10T17:38:06.490664+0000 mgr.gibba020.yqfnwy (mgr.34427) 11867 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:38:07.966 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:07 gibba020 bash[25448]: audit 2021-03-10T17:38:07.043894+0000 mon.a (mon.0) 4147 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:38:07.966 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:07 gibba020 bash[25448]: audit 2021-03-10T17:38:07.307770+0000 mon.a (mon.0) 4148 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:38:08.143 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:07 gibba013 bash[29418]: cephadm 2021-03-10T17:38:06.243985+0000 mgr.gibba020.yqfnwy (mgr.34427) 11851 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:38:08.144 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:07 gibba013 bash[29418]: cephadm 2021-03-10T17:38:06.245480+0000 mgr.gibba020.yqfnwy (mgr.34427) 11852 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:38:08.144 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:07 gibba013 bash[29418]: cluster 2021-03-10T17:38:06.313676+0000 mgr.gibba020.yqfnwy (mgr.34427) 11853 : cluster [DBG] pgmap v6760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:08.144 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:07 gibba013 bash[29418]: cephadm 2021-03-10T17:38:06.478850+0000 mgr.gibba020.yqfnwy (mgr.34427) 11854 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:38:08.144 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:07 gibba013 bash[29418]: cephadm 2021-03-10T17:38:06.480787+0000 mgr.gibba020.yqfnwy (mgr.34427) 11855 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:38:08.144 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:07 gibba013 bash[29418]: cephadm 2021-03-10T17:38:06.482229+0000 mgr.gibba020.yqfnwy (mgr.34427) 11856 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:38:08.145 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:07 gibba013 bash[29418]: cephadm 2021-03-10T17:38:06.482269+0000 mgr.gibba020.yqfnwy (mgr.34427) 11857 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:38:08.145 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:07 gibba013 bash[29418]: cephadm 2021-03-10T17:38:06.483688+0000 mgr.gibba020.yqfnwy (mgr.34427) 11858 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:38:08.145 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:07 gibba013 bash[29418]: cephadm 2021-03-10T17:38:06.483728+0000 mgr.gibba020.yqfnwy (mgr.34427) 11859 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:38:08.145 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:07 gibba013 bash[29418]: cephadm 2021-03-10T17:38:06.485083+0000 mgr.gibba020.yqfnwy (mgr.34427) 11860 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:38:08.146 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:07 gibba013 bash[29418]: cephadm 2021-03-10T17:38:06.486698+0000 mgr.gibba020.yqfnwy (mgr.34427) 11861 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:38:08.146 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:07 gibba013 bash[29418]: cephadm 2021-03-10T17:38:06.486741+0000 mgr.gibba020.yqfnwy (mgr.34427) 11862 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:38:08.146 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:07 gibba013 bash[29418]: cephadm 2021-03-10T17:38:06.488331+0000 mgr.gibba020.yqfnwy (mgr.34427) 11863 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:38:08.146 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:07 gibba013 bash[29418]: cephadm 2021-03-10T17:38:06.488692+0000 mgr.gibba020.yqfnwy (mgr.34427) 11864 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:38:08.146 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:07 gibba013 bash[29418]: cephadm 2021-03-10T17:38:06.490489+0000 mgr.gibba020.yqfnwy (mgr.34427) 11865 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:38:08.147 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:07 gibba013 bash[29418]: cephadm 2021-03-10T17:38:06.490537+0000 mgr.gibba020.yqfnwy (mgr.34427) 11866 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:38:08.147 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:07 gibba013 bash[29418]: cephadm 2021-03-10T17:38:06.490664+0000 mgr.gibba020.yqfnwy (mgr.34427) 11867 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:38:08.147 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:07 gibba013 bash[29418]: audit 2021-03-10T17:38:07.043894+0000 mon.a (mon.0) 4147 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:38:08.147 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:07 gibba013 bash[29418]: audit 2021-03-10T17:38:07.307770+0000 mon.a (mon.0) 4148 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:38:08.148 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:07 gibba013 bash[30381]: cephadm 2021-03-10T17:38:06.243985+0000 mgr.gibba020.yqfnwy (mgr.34427) 11851 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:38:08.148 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:07 gibba013 bash[30381]: cephadm 2021-03-10T17:38:06.245480+0000 mgr.gibba020.yqfnwy (mgr.34427) 11852 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:38:08.148 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:07 gibba013 bash[30381]: cluster 2021-03-10T17:38:06.313676+0000 mgr.gibba020.yqfnwy (mgr.34427) 11853 : cluster [DBG] pgmap v6760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:08.148 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:07 gibba013 bash[30381]: cephadm 2021-03-10T17:38:06.478850+0000 mgr.gibba020.yqfnwy (mgr.34427) 11854 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:38:08.149 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:07 gibba013 bash[30381]: cephadm 2021-03-10T17:38:06.480787+0000 mgr.gibba020.yqfnwy (mgr.34427) 11855 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:38:08.149 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:07 gibba013 bash[30381]: cephadm 2021-03-10T17:38:06.482229+0000 mgr.gibba020.yqfnwy (mgr.34427) 11856 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:38:08.149 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:07 gibba013 bash[30381]: cephadm 2021-03-10T17:38:06.482269+0000 mgr.gibba020.yqfnwy (mgr.34427) 11857 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:38:08.149 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:07 gibba013 bash[30381]: cephadm 2021-03-10T17:38:06.483688+0000 mgr.gibba020.yqfnwy (mgr.34427) 11858 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:38:08.150 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:07 gibba013 bash[30381]: cephadm 2021-03-10T17:38:06.483728+0000 mgr.gibba020.yqfnwy (mgr.34427) 11859 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:38:08.150 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:07 gibba013 bash[30381]: cephadm 2021-03-10T17:38:06.485083+0000 mgr.gibba020.yqfnwy (mgr.34427) 11860 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:38:08.150 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:07 gibba013 bash[30381]: cephadm 2021-03-10T17:38:06.486698+0000 mgr.gibba020.yqfnwy (mgr.34427) 11861 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:38:08.150 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:07 gibba013 bash[30381]: cephadm 2021-03-10T17:38:06.486741+0000 mgr.gibba020.yqfnwy (mgr.34427) 11862 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:38:08.150 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:07 gibba013 bash[30381]: cephadm 2021-03-10T17:38:06.488331+0000 mgr.gibba020.yqfnwy (mgr.34427) 11863 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:38:08.151 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:07 gibba013 bash[30381]: cephadm 2021-03-10T17:38:06.488692+0000 mgr.gibba020.yqfnwy (mgr.34427) 11864 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:38:08.151 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:07 gibba013 bash[30381]: cephadm 2021-03-10T17:38:06.490489+0000 mgr.gibba020.yqfnwy (mgr.34427) 11865 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:38:08.151 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:07 gibba013 bash[30381]: cephadm 2021-03-10T17:38:06.490537+0000 mgr.gibba020.yqfnwy (mgr.34427) 11866 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:38:08.151 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:07 gibba013 bash[30381]: cephadm 2021-03-10T17:38:06.490664+0000 mgr.gibba020.yqfnwy (mgr.34427) 11867 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:38:08.152 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:07 gibba013 bash[30381]: audit 2021-03-10T17:38:07.043894+0000 mon.a (mon.0) 4147 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:38:08.152 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:07 gibba013 bash[30381]: audit 2021-03-10T17:38:07.307770+0000 mon.a (mon.0) 4148 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:38:08.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:08 gibba020 bash[25448]: audit 2021-03-10T17:38:07.785915+0000 mon.a (mon.0) 4149 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T17:38:08.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:08 gibba020 bash[25448]: audit 2021-03-10T17:38:07.786693+0000 mon.a (mon.0) 4150 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T17:38:08.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:08 gibba020 bash[25448]: audit 2021-03-10T17:38:07.787353+0000 mon.a (mon.0) 4151 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:38:08.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:08 gibba020 bash[25448]: audit 2021-03-10T17:38:07.787998+0000 mon.a (mon.0) 4152 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:38:09.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:08 gibba013 bash[29418]: audit 2021-03-10T17:38:07.785915+0000 mon.a (mon.0) 4149 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T17:38:09.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:08 gibba013 bash[29418]: audit 2021-03-10T17:38:07.786693+0000 mon.a (mon.0) 4150 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T17:38:09.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:08 gibba013 bash[29418]: audit 2021-03-10T17:38:07.787353+0000 mon.a (mon.0) 4151 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:38:09.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:08 gibba013 bash[29418]: audit 2021-03-10T17:38:07.787998+0000 mon.a (mon.0) 4152 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:38:09.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:08 gibba013 bash[30381]: audit 2021-03-10T17:38:07.785915+0000 mon.a (mon.0) 4149 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T17:38:09.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:08 gibba013 bash[30381]: audit 2021-03-10T17:38:07.786693+0000 mon.a (mon.0) 4150 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T17:38:09.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:08 gibba013 bash[30381]: audit 2021-03-10T17:38:07.787353+0000 mon.a (mon.0) 4151 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:38:09.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:08 gibba013 bash[30381]: audit 2021-03-10T17:38:07.787998+0000 mon.a (mon.0) 4152 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:38:09.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:09 gibba020 bash[25448]: cluster 2021-03-10T17:38:08.314814+0000 mgr.gibba020.yqfnwy (mgr.34427) 11868 : cluster [DBG] pgmap v6761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:10.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:09 gibba013 bash[29418]: cluster 2021-03-10T17:38:08.314814+0000 mgr.gibba020.yqfnwy (mgr.34427) 11868 : cluster [DBG] pgmap v6761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:10.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:09 gibba013 bash[30381]: cluster 2021-03-10T17:38:08.314814+0000 mgr.gibba020.yqfnwy (mgr.34427) 11868 : cluster [DBG] pgmap v6761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:10.970 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:38:11.199 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:38:11.199 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 6m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:38:11.199 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 5m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:38:11.199 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:38:11.200 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:38:11.200 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:38:11.200 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:38:11.200 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:38:11.200 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:38:11.201 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:38:11.201 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:38:11.201 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:38:11.201 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:38:11.202 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:38:11.202 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:38:11.202 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:38:11.202 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:38:11.202 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:38:11.203 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:38:11.203 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 5m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:38:11.204 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 5m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:38:11.450 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:38:11.450 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:38:11.450 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:38:11.451 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:38:11.451 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:38:11.451 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:38:11.451 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:38:11.452 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:38:11.452 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:38:11.452 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:38:11.452 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:38:11.452 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:38:11.453 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:38:11.453 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:38:11.453 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:38:11.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:11 gibba020 bash[25448]: cluster 2021-03-10T17:38:10.316448+0000 mgr.gibba020.yqfnwy (mgr.34427) 11869 : cluster [DBG] pgmap v6762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:11.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:11 gibba020 bash[25448]: audit 2021-03-10T17:38:10.952815+0000 mgr.gibba020.yqfnwy (mgr.34427) 11870 : audit [DBG] from='client.52008 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:38:11.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:11 gibba020 bash[25448]: audit 2021-03-10T17:38:11.183018+0000 mgr.gibba020.yqfnwy (mgr.34427) 11871 : audit [DBG] from='client.52014 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:38:11.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:11 gibba020 bash[25448]: audit 2021-03-10T17:38:11.447747+0000 mon.c (mon.1) 179 : audit [DBG] from='client.? 172.21.2.113:0/517139856' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:12.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:11 gibba013 bash[29418]: cluster 2021-03-10T17:38:10.316448+0000 mgr.gibba020.yqfnwy (mgr.34427) 11869 : cluster [DBG] pgmap v6762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:12.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:11 gibba013 bash[29418]: audit 2021-03-10T17:38:10.952815+0000 mgr.gibba020.yqfnwy (mgr.34427) 11870 : audit [DBG] from='client.52008 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:38:12.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:11 gibba013 bash[29418]: audit 2021-03-10T17:38:11.183018+0000 mgr.gibba020.yqfnwy (mgr.34427) 11871 : audit [DBG] from='client.52014 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:38:12.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:11 gibba013 bash[29418]: audit 2021-03-10T17:38:11.447747+0000 mon.c (mon.1) 179 : audit [DBG] from='client.? 172.21.2.113:0/517139856' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:12.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:11 gibba013 bash[30381]: cluster 2021-03-10T17:38:10.316448+0000 mgr.gibba020.yqfnwy (mgr.34427) 11869 : cluster [DBG] pgmap v6762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:12.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:11 gibba013 bash[30381]: audit 2021-03-10T17:38:10.952815+0000 mgr.gibba020.yqfnwy (mgr.34427) 11870 : audit [DBG] from='client.52008 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:38:12.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:11 gibba013 bash[30381]: audit 2021-03-10T17:38:11.183018+0000 mgr.gibba020.yqfnwy (mgr.34427) 11871 : audit [DBG] from='client.52014 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:38:12.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:11 gibba013 bash[30381]: audit 2021-03-10T17:38:11.447747+0000 mon.c (mon.1) 179 : audit [DBG] from='client.? 172.21.2.113:0/517139856' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:13.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:13 gibba020 bash[25448]: cluster 2021-03-10T17:38:12.317572+0000 mgr.gibba020.yqfnwy (mgr.34427) 11872 : cluster [DBG] pgmap v6763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:14.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:13 gibba013 bash[29418]: cluster 2021-03-10T17:38:12.317572+0000 mgr.gibba020.yqfnwy (mgr.34427) 11872 : cluster [DBG] pgmap v6763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:14.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:13 gibba013 bash[30381]: cluster 2021-03-10T17:38:12.317572+0000 mgr.gibba020.yqfnwy (mgr.34427) 11872 : cluster [DBG] pgmap v6763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:15.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:15 gibba020 bash[25448]: cluster 2021-03-10T17:38:14.319156+0000 mgr.gibba020.yqfnwy (mgr.34427) 11873 : cluster [DBG] pgmap v6764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:16.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:15 gibba013 bash[29418]: cluster 2021-03-10T17:38:14.319156+0000 mgr.gibba020.yqfnwy (mgr.34427) 11873 : cluster [DBG] pgmap v6764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:16.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:15 gibba013 bash[30381]: cluster 2021-03-10T17:38:14.319156+0000 mgr.gibba020.yqfnwy (mgr.34427) 11873 : cluster [DBG] pgmap v6764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:18.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:17 gibba013 bash[29418]: cluster 2021-03-10T17:38:16.321055+0000 mgr.gibba020.yqfnwy (mgr.34427) 11874 : cluster [DBG] pgmap v6765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:18.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:17 gibba013 bash[30381]: cluster 2021-03-10T17:38:16.321055+0000 mgr.gibba020.yqfnwy (mgr.34427) 11874 : cluster [DBG] pgmap v6765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:18.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:17 gibba020 bash[25448]: cluster 2021-03-10T17:38:16.321055+0000 mgr.gibba020.yqfnwy (mgr.34427) 11874 : cluster [DBG] pgmap v6765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:20.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:19 gibba013 bash[29418]: cluster 2021-03-10T17:38:18.322422+0000 mgr.gibba020.yqfnwy (mgr.34427) 11875 : cluster [DBG] pgmap v6766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:20.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:19 gibba013 bash[30381]: cluster 2021-03-10T17:38:18.322422+0000 mgr.gibba020.yqfnwy (mgr.34427) 11875 : cluster [DBG] pgmap v6766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:20.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:19 gibba020 bash[25448]: cluster 2021-03-10T17:38:18.322422+0000 mgr.gibba020.yqfnwy (mgr.34427) 11875 : cluster [DBG] pgmap v6766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:21.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:21 gibba020 bash[25448]: cluster 2021-03-10T17:38:20.324243+0000 mgr.gibba020.yqfnwy (mgr.34427) 11876 : cluster [DBG] pgmap v6767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:22.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:21 gibba013 bash[29418]: cluster 2021-03-10T17:38:20.324243+0000 mgr.gibba020.yqfnwy (mgr.34427) 11876 : cluster [DBG] pgmap v6767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:22.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:21 gibba013 bash[30381]: cluster 2021-03-10T17:38:20.324243+0000 mgr.gibba020.yqfnwy (mgr.34427) 11876 : cluster [DBG] pgmap v6767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:23.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:22 gibba013 bash[29418]: cephadm 2021-03-10T17:38:21.506432+0000 mgr.gibba020.yqfnwy (mgr.34427) 11877 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:38:23.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:22 gibba013 bash[30381]: cephadm 2021-03-10T17:38:21.506432+0000 mgr.gibba020.yqfnwy (mgr.34427) 11877 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:38:23.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:22 gibba020 bash[25448]: cephadm 2021-03-10T17:38:21.506432+0000 mgr.gibba020.yqfnwy (mgr.34427) 11877 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:38:24.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:23 gibba013 bash[29418]: cluster 2021-03-10T17:38:22.325652+0000 mgr.gibba020.yqfnwy (mgr.34427) 11878 : cluster [DBG] pgmap v6768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:24.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:23 gibba013 bash[30381]: cluster 2021-03-10T17:38:22.325652+0000 mgr.gibba020.yqfnwy (mgr.34427) 11878 : cluster [DBG] pgmap v6768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:24.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:23 gibba020 bash[25448]: cluster 2021-03-10T17:38:22.325652+0000 mgr.gibba020.yqfnwy (mgr.34427) 11878 : cluster [DBG] pgmap v6768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:26.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:25 gibba013 bash[29418]: cluster 2021-03-10T17:38:24.327243+0000 mgr.gibba020.yqfnwy (mgr.34427) 11879 : cluster [DBG] pgmap v6769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:26.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:25 gibba013 bash[30381]: cluster 2021-03-10T17:38:24.327243+0000 mgr.gibba020.yqfnwy (mgr.34427) 11879 : cluster [DBG] pgmap v6769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:26.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:25 gibba020 bash[25448]: cluster 2021-03-10T17:38:24.327243+0000 mgr.gibba020.yqfnwy (mgr.34427) 11879 : cluster [DBG] pgmap v6769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:28.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:27 gibba013 bash[29418]: cluster 2021-03-10T17:38:26.329208+0000 mgr.gibba020.yqfnwy (mgr.34427) 11880 : cluster [DBG] pgmap v6770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:28.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:27 gibba013 bash[30381]: cluster 2021-03-10T17:38:26.329208+0000 mgr.gibba020.yqfnwy (mgr.34427) 11880 : cluster [DBG] pgmap v6770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:28.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:27 gibba020 bash[25448]: cluster 2021-03-10T17:38:26.329208+0000 mgr.gibba020.yqfnwy (mgr.34427) 11880 : cluster [DBG] pgmap v6770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:30.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:29 gibba013 bash[29418]: cluster 2021-03-10T17:38:28.330464+0000 mgr.gibba020.yqfnwy (mgr.34427) 11881 : cluster [DBG] pgmap v6771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:30.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:29 gibba013 bash[30381]: cluster 2021-03-10T17:38:28.330464+0000 mgr.gibba020.yqfnwy (mgr.34427) 11881 : cluster [DBG] pgmap v6771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:30.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:29 gibba020 bash[25448]: cluster 2021-03-10T17:38:28.330464+0000 mgr.gibba020.yqfnwy (mgr.34427) 11881 : cluster [DBG] pgmap v6771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:32.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:31 gibba013 bash[29418]: cluster 2021-03-10T17:38:30.332315+0000 mgr.gibba020.yqfnwy (mgr.34427) 11882 : cluster [DBG] pgmap v6772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:32.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:31 gibba013 bash[30381]: cluster 2021-03-10T17:38:30.332315+0000 mgr.gibba020.yqfnwy (mgr.34427) 11882 : cluster [DBG] pgmap v6772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:32.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:31 gibba020 bash[25448]: cluster 2021-03-10T17:38:30.332315+0000 mgr.gibba020.yqfnwy (mgr.34427) 11882 : cluster [DBG] pgmap v6772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:34.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:33 gibba013 bash[29418]: cluster 2021-03-10T17:38:32.333766+0000 mgr.gibba020.yqfnwy (mgr.34427) 11883 : cluster [DBG] pgmap v6773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:34.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:33 gibba013 bash[30381]: cluster 2021-03-10T17:38:32.333766+0000 mgr.gibba020.yqfnwy (mgr.34427) 11883 : cluster [DBG] pgmap v6773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:34.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:33 gibba020 bash[25448]: cluster 2021-03-10T17:38:32.333766+0000 mgr.gibba020.yqfnwy (mgr.34427) 11883 : cluster [DBG] pgmap v6773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:36.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:35 gibba013 bash[29418]: cluster 2021-03-10T17:38:34.335245+0000 mgr.gibba020.yqfnwy (mgr.34427) 11884 : cluster [DBG] pgmap v6774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:36.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:35 gibba013 bash[30381]: cluster 2021-03-10T17:38:34.335245+0000 mgr.gibba020.yqfnwy (mgr.34427) 11884 : cluster [DBG] pgmap v6774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:36.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:35 gibba020 bash[25448]: cluster 2021-03-10T17:38:34.335245+0000 mgr.gibba020.yqfnwy (mgr.34427) 11884 : cluster [DBG] pgmap v6774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:38.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:37 gibba013 bash[29418]: cluster 2021-03-10T17:38:36.337126+0000 mgr.gibba020.yqfnwy (mgr.34427) 11885 : cluster [DBG] pgmap v6775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:38.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:37 gibba013 bash[29418]: cephadm 2021-03-10T17:38:36.522393+0000 mgr.gibba020.yqfnwy (mgr.34427) 11886 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:38:38.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:37 gibba013 bash[30381]: cluster 2021-03-10T17:38:36.337126+0000 mgr.gibba020.yqfnwy (mgr.34427) 11885 : cluster [DBG] pgmap v6775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:38.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:37 gibba013 bash[30381]: cephadm 2021-03-10T17:38:36.522393+0000 mgr.gibba020.yqfnwy (mgr.34427) 11886 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:38:38.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:37 gibba020 bash[25448]: cluster 2021-03-10T17:38:36.337126+0000 mgr.gibba020.yqfnwy (mgr.34427) 11885 : cluster [DBG] pgmap v6775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:38.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:37 gibba020 bash[25448]: cephadm 2021-03-10T17:38:36.522393+0000 mgr.gibba020.yqfnwy (mgr.34427) 11886 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:38:40.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:39 gibba013 bash[29418]: cluster 2021-03-10T17:38:38.338409+0000 mgr.gibba020.yqfnwy (mgr.34427) 11887 : cluster [DBG] pgmap v6776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:40.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:39 gibba013 bash[30381]: cluster 2021-03-10T17:38:38.338409+0000 mgr.gibba020.yqfnwy (mgr.34427) 11887 : cluster [DBG] pgmap v6776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:40.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:39 gibba020 bash[25448]: cluster 2021-03-10T17:38:38.338409+0000 mgr.gibba020.yqfnwy (mgr.34427) 11887 : cluster [DBG] pgmap v6776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:41.698 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:38:41.933 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:38:41.933 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 6m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:38:41.933 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 5m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:38:41.934 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:38:41.934 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:38:41.934 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:38:41.934 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:38:41.934 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:38:41.935 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:38:41.935 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:38:41.935 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 5m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:38:41.935 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:38:41.936 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:38:41.936 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:38:41.936 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:38:41.936 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:38:41.936 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:38:41.937 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:38:41.937 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 5m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:38:41.937 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 5m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:38:41.937 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 5m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:38:42.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:41 gibba013 bash[29418]: cluster 2021-03-10T17:38:40.340176+0000 mgr.gibba020.yqfnwy (mgr.34427) 11888 : cluster [DBG] pgmap v6777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:42.131 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:41 gibba013 bash[30381]: cluster 2021-03-10T17:38:40.340176+0000 mgr.gibba020.yqfnwy (mgr.34427) 11888 : cluster [DBG] pgmap v6777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:42.181 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:38:42.181 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:38:42.181 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:38:42.182 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:38:42.182 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:38:42.182 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:38:42.182 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:38:42.183 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:38:42.183 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:38:42.183 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:38:42.183 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:38:42.183 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:38:42.184 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:38:42.184 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:38:42.184 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:38:42.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:41 gibba020 bash[25448]: cluster 2021-03-10T17:38:40.340176+0000 mgr.gibba020.yqfnwy (mgr.34427) 11888 : cluster [DBG] pgmap v6777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:43.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:42 gibba013 bash[29418]: audit 2021-03-10T17:38:41.686493+0000 mgr.gibba020.yqfnwy (mgr.34427) 11889 : audit [DBG] from='client.52026 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:38:43.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:42 gibba013 bash[29418]: audit 2021-03-10T17:38:41.916875+0000 mgr.gibba020.yqfnwy (mgr.34427) 11890 : audit [DBG] from='client.52032 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:38:43.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:42 gibba013 bash[29418]: audit 2021-03-10T17:38:42.178653+0000 mon.c (mon.1) 180 : audit [DBG] from='client.? 172.21.2.113:0/506982125' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:43.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:42 gibba013 bash[30381]: audit 2021-03-10T17:38:41.686493+0000 mgr.gibba020.yqfnwy (mgr.34427) 11889 : audit [DBG] from='client.52026 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:38:43.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:42 gibba013 bash[30381]: audit 2021-03-10T17:38:41.916875+0000 mgr.gibba020.yqfnwy (mgr.34427) 11890 : audit [DBG] from='client.52032 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:38:43.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:42 gibba013 bash[30381]: audit 2021-03-10T17:38:42.178653+0000 mon.c (mon.1) 180 : audit [DBG] from='client.? 172.21.2.113:0/506982125' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:43.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:42 gibba020 bash[25448]: audit 2021-03-10T17:38:41.686493+0000 mgr.gibba020.yqfnwy (mgr.34427) 11889 : audit [DBG] from='client.52026 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:38:43.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:42 gibba020 bash[25448]: audit 2021-03-10T17:38:41.916875+0000 mgr.gibba020.yqfnwy (mgr.34427) 11890 : audit [DBG] from='client.52032 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:38:43.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:42 gibba020 bash[25448]: audit 2021-03-10T17:38:42.178653+0000 mon.c (mon.1) 180 : audit [DBG] from='client.? 172.21.2.113:0/506982125' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:38:44.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:43 gibba013 bash[29418]: cluster 2021-03-10T17:38:42.341428+0000 mgr.gibba020.yqfnwy (mgr.34427) 11891 : cluster [DBG] pgmap v6778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:44.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:43 gibba013 bash[30381]: cluster 2021-03-10T17:38:42.341428+0000 mgr.gibba020.yqfnwy (mgr.34427) 11891 : cluster [DBG] pgmap v6778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:44.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:43 gibba020 bash[25448]: cluster 2021-03-10T17:38:42.341428+0000 mgr.gibba020.yqfnwy (mgr.34427) 11891 : cluster [DBG] pgmap v6778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:46.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:45 gibba013 bash[29418]: cluster 2021-03-10T17:38:44.343058+0000 mgr.gibba020.yqfnwy (mgr.34427) 11892 : cluster [DBG] pgmap v6779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:46.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:45 gibba013 bash[30381]: cluster 2021-03-10T17:38:44.343058+0000 mgr.gibba020.yqfnwy (mgr.34427) 11892 : cluster [DBG] pgmap v6779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:46.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:45 gibba020 bash[25448]: cluster 2021-03-10T17:38:44.343058+0000 mgr.gibba020.yqfnwy (mgr.34427) 11892 : cluster [DBG] pgmap v6779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:48.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:47 gibba013 bash[29418]: cluster 2021-03-10T17:38:46.344831+0000 mgr.gibba020.yqfnwy (mgr.34427) 11893 : cluster [DBG] pgmap v6780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:48.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:47 gibba013 bash[30381]: cluster 2021-03-10T17:38:46.344831+0000 mgr.gibba020.yqfnwy (mgr.34427) 11893 : cluster [DBG] pgmap v6780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:48.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:47 gibba020 bash[25448]: cluster 2021-03-10T17:38:46.344831+0000 mgr.gibba020.yqfnwy (mgr.34427) 11893 : cluster [DBG] pgmap v6780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:50.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:49 gibba013 bash[29418]: cluster 2021-03-10T17:38:48.346084+0000 mgr.gibba020.yqfnwy (mgr.34427) 11894 : cluster [DBG] pgmap v6781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:50.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:49 gibba013 bash[30381]: cluster 2021-03-10T17:38:48.346084+0000 mgr.gibba020.yqfnwy (mgr.34427) 11894 : cluster [DBG] pgmap v6781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:50.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:49 gibba020 bash[25448]: cluster 2021-03-10T17:38:48.346084+0000 mgr.gibba020.yqfnwy (mgr.34427) 11894 : cluster [DBG] pgmap v6781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:52.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:51 gibba013 bash[29418]: cluster 2021-03-10T17:38:50.347640+0000 mgr.gibba020.yqfnwy (mgr.34427) 11895 : cluster [DBG] pgmap v6782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:52.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:51 gibba013 bash[30381]: cluster 2021-03-10T17:38:50.347640+0000 mgr.gibba020.yqfnwy (mgr.34427) 11895 : cluster [DBG] pgmap v6782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:52.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:51 gibba020 bash[25448]: cluster 2021-03-10T17:38:50.347640+0000 mgr.gibba020.yqfnwy (mgr.34427) 11895 : cluster [DBG] pgmap v6782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:53.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:52 gibba020 bash[25448]: cephadm 2021-03-10T17:38:51.533136+0000 mgr.gibba020.yqfnwy (mgr.34427) 11896 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:38:53.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:52 gibba013 bash[29418]: cephadm 2021-03-10T17:38:51.533136+0000 mgr.gibba020.yqfnwy (mgr.34427) 11896 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:38:53.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:52 gibba013 bash[30381]: cephadm 2021-03-10T17:38:51.533136+0000 mgr.gibba020.yqfnwy (mgr.34427) 11896 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:38:54.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:53 gibba020 bash[25448]: cluster 2021-03-10T17:38:52.348922+0000 mgr.gibba020.yqfnwy (mgr.34427) 11897 : cluster [DBG] pgmap v6783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:54.382 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:53 gibba013 bash[29418]: cluster 2021-03-10T17:38:52.348922+0000 mgr.gibba020.yqfnwy (mgr.34427) 11897 : cluster [DBG] pgmap v6783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:54.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:53 gibba013 bash[30381]: cluster 2021-03-10T17:38:52.348922+0000 mgr.gibba020.yqfnwy (mgr.34427) 11897 : cluster [DBG] pgmap v6783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:56.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:55 gibba020 bash[25448]: cluster 2021-03-10T17:38:54.350565+0000 mgr.gibba020.yqfnwy (mgr.34427) 11898 : cluster [DBG] pgmap v6784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:56.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:55 gibba013 bash[29418]: cluster 2021-03-10T17:38:54.350565+0000 mgr.gibba020.yqfnwy (mgr.34427) 11898 : cluster [DBG] pgmap v6784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:56.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:55 gibba013 bash[30381]: cluster 2021-03-10T17:38:54.350565+0000 mgr.gibba020.yqfnwy (mgr.34427) 11898 : cluster [DBG] pgmap v6784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:58.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:57 gibba020 bash[25448]: cluster 2021-03-10T17:38:56.352341+0000 mgr.gibba020.yqfnwy (mgr.34427) 11899 : cluster [DBG] pgmap v6785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:58.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:57 gibba013 bash[29418]: cluster 2021-03-10T17:38:56.352341+0000 mgr.gibba020.yqfnwy (mgr.34427) 11899 : cluster [DBG] pgmap v6785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:38:58.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:57 gibba013 bash[30381]: cluster 2021-03-10T17:38:56.352341+0000 mgr.gibba020.yqfnwy (mgr.34427) 11899 : cluster [DBG] pgmap v6785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:00.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:38:59 gibba020 bash[25448]: cluster 2021-03-10T17:38:58.353836+0000 mgr.gibba020.yqfnwy (mgr.34427) 11900 : cluster [DBG] pgmap v6786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:00.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:38:59 gibba013 bash[29418]: cluster 2021-03-10T17:38:58.353836+0000 mgr.gibba020.yqfnwy (mgr.34427) 11900 : cluster [DBG] pgmap v6786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:00.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:38:59 gibba013 bash[30381]: cluster 2021-03-10T17:38:58.353836+0000 mgr.gibba020.yqfnwy (mgr.34427) 11900 : cluster [DBG] pgmap v6786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:02.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:01 gibba020 bash[25448]: cluster 2021-03-10T17:39:00.355547+0000 mgr.gibba020.yqfnwy (mgr.34427) 11901 : cluster [DBG] pgmap v6787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:02.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:01 gibba013 bash[29418]: cluster 2021-03-10T17:39:00.355547+0000 mgr.gibba020.yqfnwy (mgr.34427) 11901 : cluster [DBG] pgmap v6787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:02.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:01 gibba013 bash[30381]: cluster 2021-03-10T17:39:00.355547+0000 mgr.gibba020.yqfnwy (mgr.34427) 11901 : cluster [DBG] pgmap v6787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:04.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:03 gibba020 bash[25448]: cluster 2021-03-10T17:39:02.356944+0000 mgr.gibba020.yqfnwy (mgr.34427) 11902 : cluster [DBG] pgmap v6788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:04.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:03 gibba013 bash[29418]: cluster 2021-03-10T17:39:02.356944+0000 mgr.gibba020.yqfnwy (mgr.34427) 11902 : cluster [DBG] pgmap v6788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:04.382 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:03 gibba013 bash[30381]: cluster 2021-03-10T17:39:02.356944+0000 mgr.gibba020.yqfnwy (mgr.34427) 11902 : cluster [DBG] pgmap v6788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:06.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:05 gibba020 bash[25448]: cluster 2021-03-10T17:39:04.358624+0000 mgr.gibba020.yqfnwy (mgr.34427) 11903 : cluster [DBG] pgmap v6789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:06.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:05 gibba013 bash[29418]: cluster 2021-03-10T17:39:04.358624+0000 mgr.gibba020.yqfnwy (mgr.34427) 11903 : cluster [DBG] pgmap v6789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:06.381 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:05 gibba013 bash[30381]: cluster 2021-03-10T17:39:04.358624+0000 mgr.gibba020.yqfnwy (mgr.34427) 11903 : cluster [DBG] pgmap v6789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:07.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[29418]: cluster 2021-03-10T17:39:06.360550+0000 mgr.gibba020.yqfnwy (mgr.34427) 11904 : cluster [DBG] pgmap v6790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:07.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[29418]: audit 2021-03-10T17:39:06.542423+0000 mon.a (mon.0) 4153 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:39:07.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[29418]: audit 2021-03-10T17:39:06.748319+0000 mon.a (mon.0) 4154 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:39:07.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[29418]: cephadm 2021-03-10T17:39:06.749140+0000 mgr.gibba020.yqfnwy (mgr.34427) 11905 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:39:07.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[29418]: audit 2021-03-10T17:39:06.752966+0000 mon.a (mon.0) 4155 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:39:07.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[29418]: cephadm 2021-03-10T17:39:06.753119+0000 mgr.gibba020.yqfnwy (mgr.34427) 11906 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:39:07.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[29418]: audit 2021-03-10T17:39:06.941167+0000 mon.a (mon.0) 4156 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:39:07.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[29418]: cephadm 2021-03-10T17:39:06.943074+0000 mgr.gibba020.yqfnwy (mgr.34427) 11907 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:39:07.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[29418]: audit 2021-03-10T17:39:06.944450+0000 mon.a (mon.0) 4157 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:39:07.636 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[29418]: cephadm 2021-03-10T17:39:06.944825+0000 mgr.gibba020.yqfnwy (mgr.34427) 11908 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:39:07.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[29418]: audit 2021-03-10T17:39:06.945740+0000 mon.a (mon.0) 4158 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:07.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[29418]: cephadm 2021-03-10T17:39:06.946256+0000 mgr.gibba020.yqfnwy (mgr.34427) 11909 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:39:07.637 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[29418]: cephadm 2021-03-10T17:39:06.946334+0000 mgr.gibba020.yqfnwy (mgr.34427) 11910 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:39:07.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[29418]: audit 2021-03-10T17:39:06.947601+0000 mon.a (mon.0) 4159 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:07.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[29418]: cephadm 2021-03-10T17:39:06.948294+0000 mgr.gibba020.yqfnwy (mgr.34427) 11911 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:39:07.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[29418]: cephadm 2021-03-10T17:39:06.948331+0000 mgr.gibba020.yqfnwy (mgr.34427) 11912 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:39:07.638 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[29418]: audit 2021-03-10T17:39:06.949454+0000 mon.a (mon.0) 4160 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:07.639 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[29418]: cephadm 2021-03-10T17:39:06.950107+0000 mgr.gibba020.yqfnwy (mgr.34427) 11913 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:39:07.639 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[29418]: cephadm 2021-03-10T17:39:06.951683+0000 mgr.gibba020.yqfnwy (mgr.34427) 11914 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:39:07.639 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[29418]: cephadm 2021-03-10T17:39:06.951718+0000 mgr.gibba020.yqfnwy (mgr.34427) 11915 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:39:07.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[30381]: cluster 2021-03-10T17:39:06.360550+0000 mgr.gibba020.yqfnwy (mgr.34427) 11904 : cluster [DBG] pgmap v6790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:07.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[30381]: audit 2021-03-10T17:39:06.542423+0000 mon.a (mon.0) 4153 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:39:07.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[30381]: audit 2021-03-10T17:39:06.748319+0000 mon.a (mon.0) 4154 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:39:07.640 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[30381]: cephadm 2021-03-10T17:39:06.749140+0000 mgr.gibba020.yqfnwy (mgr.34427) 11905 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:39:07.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[30381]: audit 2021-03-10T17:39:06.752966+0000 mon.a (mon.0) 4155 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:39:07.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[30381]: cephadm 2021-03-10T17:39:06.753119+0000 mgr.gibba020.yqfnwy (mgr.34427) 11906 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:39:07.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[30381]: audit 2021-03-10T17:39:06.941167+0000 mon.a (mon.0) 4156 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:39:07.641 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[30381]: cephadm 2021-03-10T17:39:06.943074+0000 mgr.gibba020.yqfnwy (mgr.34427) 11907 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:39:07.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[30381]: audit 2021-03-10T17:39:06.944450+0000 mon.a (mon.0) 4157 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:39:07.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[30381]: cephadm 2021-03-10T17:39:06.944825+0000 mgr.gibba020.yqfnwy (mgr.34427) 11908 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:39:07.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[30381]: audit 2021-03-10T17:39:06.945740+0000 mon.a (mon.0) 4158 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:07.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[30381]: cephadm 2021-03-10T17:39:06.946256+0000 mgr.gibba020.yqfnwy (mgr.34427) 11909 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:39:07.642 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[30381]: cephadm 2021-03-10T17:39:06.946334+0000 mgr.gibba020.yqfnwy (mgr.34427) 11910 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:39:07.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[30381]: audit 2021-03-10T17:39:06.947601+0000 mon.a (mon.0) 4159 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:07.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[30381]: cephadm 2021-03-10T17:39:06.948294+0000 mgr.gibba020.yqfnwy (mgr.34427) 11911 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:39:07.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[30381]: cephadm 2021-03-10T17:39:06.948331+0000 mgr.gibba020.yqfnwy (mgr.34427) 11912 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:39:07.643 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[30381]: audit 2021-03-10T17:39:06.949454+0000 mon.a (mon.0) 4160 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:07.644 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[30381]: cephadm 2021-03-10T17:39:06.950107+0000 mgr.gibba020.yqfnwy (mgr.34427) 11913 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:39:07.644 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[30381]: cephadm 2021-03-10T17:39:06.951683+0000 mgr.gibba020.yqfnwy (mgr.34427) 11914 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:39:07.644 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[30381]: cephadm 2021-03-10T17:39:06.951718+0000 mgr.gibba020.yqfnwy (mgr.34427) 11915 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:39:07.644 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[30381]: audit 2021-03-10T17:39:06.952961+0000 mon.a (mon.0) 4161 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:07.644 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[30381]: cephadm 2021-03-10T17:39:06.953520+0000 mgr.gibba020.yqfnwy (mgr.34427) 11916 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:39:07.645 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[30381]: cephadm 2021-03-10T17:39:06.953840+0000 mgr.gibba020.yqfnwy (mgr.34427) 11917 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:39:07.645 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[30381]: audit 2021-03-10T17:39:06.954958+0000 mon.a (mon.0) 4162 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:07.645 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[30381]: cephadm 2021-03-10T17:39:06.955735+0000 mgr.gibba020.yqfnwy (mgr.34427) 11918 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:39:07.645 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[30381]: cephadm 2021-03-10T17:39:06.955771+0000 mgr.gibba020.yqfnwy (mgr.34427) 11919 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:39:07.646 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[30381]: cephadm 2021-03-10T17:39:06.955905+0000 mgr.gibba020.yqfnwy (mgr.34427) 11920 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:39:07.646 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[30381]: audit 2021-03-10T17:39:07.049312+0000 mon.a (mon.0) 4163 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:39:07.646 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[30381]: audit 2021-03-10T17:39:07.314636+0000 mon.a (mon.0) 4164 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:39:07.646 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[29418]: audit 2021-03-10T17:39:06.952961+0000 mon.a (mon.0) 4161 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:07.647 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[29418]: cephadm 2021-03-10T17:39:06.953520+0000 mgr.gibba020.yqfnwy (mgr.34427) 11916 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:39:07.647 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[29418]: cephadm 2021-03-10T17:39:06.953840+0000 mgr.gibba020.yqfnwy (mgr.34427) 11917 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:39:07.647 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[29418]: audit 2021-03-10T17:39:06.954958+0000 mon.a (mon.0) 4162 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:07.647 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[29418]: cephadm 2021-03-10T17:39:06.955735+0000 mgr.gibba020.yqfnwy (mgr.34427) 11918 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:39:07.648 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[29418]: cephadm 2021-03-10T17:39:06.955771+0000 mgr.gibba020.yqfnwy (mgr.34427) 11919 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:39:07.648 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[29418]: cephadm 2021-03-10T17:39:06.955905+0000 mgr.gibba020.yqfnwy (mgr.34427) 11920 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:39:07.648 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[29418]: audit 2021-03-10T17:39:07.049312+0000 mon.a (mon.0) 4163 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:39:07.648 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:07 gibba013 bash[29418]: audit 2021-03-10T17:39:07.314636+0000 mon.a (mon.0) 4164 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:39:07.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:07 gibba020 bash[25448]: cluster 2021-03-10T17:39:06.360550+0000 mgr.gibba020.yqfnwy (mgr.34427) 11904 : cluster [DBG] pgmap v6790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:07.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:07 gibba020 bash[25448]: audit 2021-03-10T17:39:06.542423+0000 mon.a (mon.0) 4153 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:39:07.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:07 gibba020 bash[25448]: audit 2021-03-10T17:39:06.748319+0000 mon.a (mon.0) 4154 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:39:07.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:07 gibba020 bash[25448]: cephadm 2021-03-10T17:39:06.749140+0000 mgr.gibba020.yqfnwy (mgr.34427) 11905 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:39:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:07 gibba020 bash[25448]: audit 2021-03-10T17:39:06.752966+0000 mon.a (mon.0) 4155 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:39:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:07 gibba020 bash[25448]: cephadm 2021-03-10T17:39:06.753119+0000 mgr.gibba020.yqfnwy (mgr.34427) 11906 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:39:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:07 gibba020 bash[25448]: audit 2021-03-10T17:39:06.941167+0000 mon.a (mon.0) 4156 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:39:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:07 gibba020 bash[25448]: cephadm 2021-03-10T17:39:06.943074+0000 mgr.gibba020.yqfnwy (mgr.34427) 11907 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:39:07.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:07 gibba020 bash[25448]: audit 2021-03-10T17:39:06.944450+0000 mon.a (mon.0) 4157 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:39:07.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:07 gibba020 bash[25448]: cephadm 2021-03-10T17:39:06.944825+0000 mgr.gibba020.yqfnwy (mgr.34427) 11908 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:39:07.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:07 gibba020 bash[25448]: audit 2021-03-10T17:39:06.945740+0000 mon.a (mon.0) 4158 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:07.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:07 gibba020 bash[25448]: cephadm 2021-03-10T17:39:06.946256+0000 mgr.gibba020.yqfnwy (mgr.34427) 11909 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:39:07.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:07 gibba020 bash[25448]: cephadm 2021-03-10T17:39:06.946334+0000 mgr.gibba020.yqfnwy (mgr.34427) 11910 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:39:07.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:07 gibba020 bash[25448]: audit 2021-03-10T17:39:06.947601+0000 mon.a (mon.0) 4159 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:07.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:07 gibba020 bash[25448]: cephadm 2021-03-10T17:39:06.948294+0000 mgr.gibba020.yqfnwy (mgr.34427) 11911 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:39:07.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:07 gibba020 bash[25448]: cephadm 2021-03-10T17:39:06.948331+0000 mgr.gibba020.yqfnwy (mgr.34427) 11912 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:39:07.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:07 gibba020 bash[25448]: audit 2021-03-10T17:39:06.949454+0000 mon.a (mon.0) 4160 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:07.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:07 gibba020 bash[25448]: cephadm 2021-03-10T17:39:06.950107+0000 mgr.gibba020.yqfnwy (mgr.34427) 11913 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:39:07.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:07 gibba020 bash[25448]: cephadm 2021-03-10T17:39:06.951683+0000 mgr.gibba020.yqfnwy (mgr.34427) 11914 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:39:07.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:07 gibba020 bash[25448]: cephadm 2021-03-10T17:39:06.951718+0000 mgr.gibba020.yqfnwy (mgr.34427) 11915 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:39:07.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:07 gibba020 bash[25448]: audit 2021-03-10T17:39:06.952961+0000 mon.a (mon.0) 4161 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:07.706 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:07 gibba020 bash[25448]: cephadm 2021-03-10T17:39:06.953520+0000 mgr.gibba020.yqfnwy (mgr.34427) 11916 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:39:07.706 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:07 gibba020 bash[25448]: cephadm 2021-03-10T17:39:06.953840+0000 mgr.gibba020.yqfnwy (mgr.34427) 11917 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:39:07.706 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:07 gibba020 bash[25448]: audit 2021-03-10T17:39:06.954958+0000 mon.a (mon.0) 4162 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:07.706 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:07 gibba020 bash[25448]: cephadm 2021-03-10T17:39:06.955735+0000 mgr.gibba020.yqfnwy (mgr.34427) 11918 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:39:07.707 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:07 gibba020 bash[25448]: cephadm 2021-03-10T17:39:06.955771+0000 mgr.gibba020.yqfnwy (mgr.34427) 11919 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:39:07.707 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:07 gibba020 bash[25448]: cephadm 2021-03-10T17:39:06.955905+0000 mgr.gibba020.yqfnwy (mgr.34427) 11920 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:39:07.707 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:07 gibba020 bash[25448]: audit 2021-03-10T17:39:07.049312+0000 mon.a (mon.0) 4163 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:39:07.707 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:07 gibba020 bash[25448]: audit 2021-03-10T17:39:07.314636+0000 mon.a (mon.0) 4164 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:39:08.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:08 gibba020 bash[25448]: audit 2021-03-10T17:39:07.796704+0000 mon.a (mon.0) 4165 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:39:08.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:08 gibba020 bash[25448]: audit 2021-03-10T17:39:07.797447+0000 mon.a (mon.0) 4166 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:39:08.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:08 gibba020 bash[25448]: audit 2021-03-10T17:39:07.798135+0000 mon.a (mon.0) 4167 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:39:08.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:08 gibba020 bash[25448]: audit 2021-03-10T17:39:07.798796+0000 mon.a (mon.0) 4168 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:39:08.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:08 gibba013 bash[29418]: audit 2021-03-10T17:39:07.796704+0000 mon.a (mon.0) 4165 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:39:08.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:08 gibba013 bash[29418]: audit 2021-03-10T17:39:07.797447+0000 mon.a (mon.0) 4166 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:39:08.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:08 gibba013 bash[29418]: audit 2021-03-10T17:39:07.798135+0000 mon.a (mon.0) 4167 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:39:08.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:08 gibba013 bash[29418]: audit 2021-03-10T17:39:07.798796+0000 mon.a (mon.0) 4168 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:39:08.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:08 gibba013 bash[30381]: audit 2021-03-10T17:39:07.796704+0000 mon.a (mon.0) 4165 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:39:08.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:08 gibba013 bash[30381]: audit 2021-03-10T17:39:07.797447+0000 mon.a (mon.0) 4166 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T17:39:08.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:08 gibba013 bash[30381]: audit 2021-03-10T17:39:07.798135+0000 mon.a (mon.0) 4167 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T17:39:08.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:08 gibba013 bash[30381]: audit 2021-03-10T17:39:07.798796+0000 mon.a (mon.0) 4168 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:39:09.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:09 gibba020 bash[25448]: cluster 2021-03-10T17:39:08.362092+0000 mgr.gibba020.yqfnwy (mgr.34427) 11921 : cluster [DBG] pgmap v6791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:09.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:09 gibba013 bash[29418]: cluster 2021-03-10T17:39:08.362092+0000 mgr.gibba020.yqfnwy (mgr.34427) 11921 : cluster [DBG] pgmap v6791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:09.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:09 gibba013 bash[30381]: cluster 2021-03-10T17:39:08.362092+0000 mgr.gibba020.yqfnwy (mgr.34427) 11921 : cluster [DBG] pgmap v6791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:11.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:11 gibba020 bash[25448]: cluster 2021-03-10T17:39:10.363765+0000 mgr.gibba020.yqfnwy (mgr.34427) 11922 : cluster [DBG] pgmap v6792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:11.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:11 gibba013 bash[29418]: cluster 2021-03-10T17:39:10.363765+0000 mgr.gibba020.yqfnwy (mgr.34427) 11922 : cluster [DBG] pgmap v6792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:11.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:11 gibba013 bash[30381]: cluster 2021-03-10T17:39:10.363765+0000 mgr.gibba020.yqfnwy (mgr.34427) 11922 : cluster [DBG] pgmap v6792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:12.426 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:39:12.654 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:39:12.655 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 7m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:39:12.655 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 6m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:39:12.655 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:39:12.655 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:39:12.655 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:39:12.656 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:39:12.656 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:39:12.656 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:39:12.656 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:39:12.657 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:39:12.657 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:39:12.657 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:39:12.657 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:39:12.657 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:39:12.658 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:39:12.658 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:39:12.658 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:39:12.658 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:39:12.658 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 6m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:39:12.659 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 6m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:39:12.903 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:39:12.903 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:39:12.904 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:39:12.904 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:39:12.904 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:39:12.904 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:39:12.905 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:39:12.905 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:39:12.905 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:39:12.905 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:39:12.905 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:39:12.906 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:39:12.906 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:39:12.906 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:39:12.906 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:39:13.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:13 gibba020 bash[25448]: cluster 2021-03-10T17:39:12.365001+0000 mgr.gibba020.yqfnwy (mgr.34427) 11923 : cluster [DBG] pgmap v6793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:13.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:13 gibba020 bash[25448]: audit 2021-03-10T17:39:12.415177+0000 mgr.gibba020.yqfnwy (mgr.34427) 11924 : audit [DBG] from='client.52044 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:39:13.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:13 gibba020 bash[25448]: audit 2021-03-10T17:39:12.639294+0000 mgr.gibba020.yqfnwy (mgr.34427) 11925 : audit [DBG] from='client.52050 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:39:13.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:13 gibba020 bash[25448]: audit 2021-03-10T17:39:12.900862+0000 mon.c (mon.1) 181 : audit [DBG] from='client.? 172.21.2.113:0/684310242' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:13.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:13 gibba013 bash[29418]: cluster 2021-03-10T17:39:12.365001+0000 mgr.gibba020.yqfnwy (mgr.34427) 11923 : cluster [DBG] pgmap v6793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:13.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:13 gibba013 bash[29418]: audit 2021-03-10T17:39:12.415177+0000 mgr.gibba020.yqfnwy (mgr.34427) 11924 : audit [DBG] from='client.52044 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:39:13.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:13 gibba013 bash[29418]: audit 2021-03-10T17:39:12.639294+0000 mgr.gibba020.yqfnwy (mgr.34427) 11925 : audit [DBG] from='client.52050 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:39:13.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:13 gibba013 bash[29418]: audit 2021-03-10T17:39:12.900862+0000 mon.c (mon.1) 181 : audit [DBG] from='client.? 172.21.2.113:0/684310242' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:13.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:13 gibba013 bash[30381]: cluster 2021-03-10T17:39:12.365001+0000 mgr.gibba020.yqfnwy (mgr.34427) 11923 : cluster [DBG] pgmap v6793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:13.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:13 gibba013 bash[30381]: audit 2021-03-10T17:39:12.415177+0000 mgr.gibba020.yqfnwy (mgr.34427) 11924 : audit [DBG] from='client.52044 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:39:13.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:13 gibba013 bash[30381]: audit 2021-03-10T17:39:12.639294+0000 mgr.gibba020.yqfnwy (mgr.34427) 11925 : audit [DBG] from='client.52050 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:39:13.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:13 gibba013 bash[30381]: audit 2021-03-10T17:39:12.900862+0000 mon.c (mon.1) 181 : audit [DBG] from='client.? 172.21.2.113:0/684310242' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:15.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:15 gibba020 bash[25448]: cluster 2021-03-10T17:39:14.366594+0000 mgr.gibba020.yqfnwy (mgr.34427) 11926 : cluster [DBG] pgmap v6794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:15.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:15 gibba013 bash[29418]: cluster 2021-03-10T17:39:14.366594+0000 mgr.gibba020.yqfnwy (mgr.34427) 11926 : cluster [DBG] pgmap v6794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:15.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:15 gibba013 bash[30381]: cluster 2021-03-10T17:39:14.366594+0000 mgr.gibba020.yqfnwy (mgr.34427) 11926 : cluster [DBG] pgmap v6794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:17.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:17 gibba020 bash[25448]: cluster 2021-03-10T17:39:16.368190+0000 mgr.gibba020.yqfnwy (mgr.34427) 11927 : cluster [DBG] pgmap v6795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:17.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:17 gibba013 bash[29418]: cluster 2021-03-10T17:39:16.368190+0000 mgr.gibba020.yqfnwy (mgr.34427) 11927 : cluster [DBG] pgmap v6795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:17.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:17 gibba013 bash[30381]: cluster 2021-03-10T17:39:16.368190+0000 mgr.gibba020.yqfnwy (mgr.34427) 11927 : cluster [DBG] pgmap v6795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:19.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:19 gibba020 bash[25448]: cluster 2021-03-10T17:39:18.377329+0000 mgr.gibba020.yqfnwy (mgr.34427) 11928 : cluster [DBG] pgmap v6796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:19.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:19 gibba013 bash[29418]: cluster 2021-03-10T17:39:18.377329+0000 mgr.gibba020.yqfnwy (mgr.34427) 11928 : cluster [DBG] pgmap v6796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:19.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:19 gibba013 bash[30381]: cluster 2021-03-10T17:39:18.377329+0000 mgr.gibba020.yqfnwy (mgr.34427) 11928 : cluster [DBG] pgmap v6796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:21.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:21 gibba013 bash[29418]: cluster 2021-03-10T17:39:20.379100+0000 mgr.gibba020.yqfnwy (mgr.34427) 11929 : cluster [DBG] pgmap v6797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:21.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:21 gibba013 bash[30381]: cluster 2021-03-10T17:39:20.379100+0000 mgr.gibba020.yqfnwy (mgr.34427) 11929 : cluster [DBG] pgmap v6797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:21.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:21 gibba020 bash[25448]: cluster 2021-03-10T17:39:20.379100+0000 mgr.gibba020.yqfnwy (mgr.34427) 11929 : cluster [DBG] pgmap v6797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:22.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:22 gibba013 bash[29418]: cephadm 2021-03-10T17:39:21.968889+0000 mgr.gibba020.yqfnwy (mgr.34427) 11930 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:39:22.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:22 gibba013 bash[30381]: cephadm 2021-03-10T17:39:21.968889+0000 mgr.gibba020.yqfnwy (mgr.34427) 11930 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:39:22.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:22 gibba020 bash[25448]: cephadm 2021-03-10T17:39:21.968889+0000 mgr.gibba020.yqfnwy (mgr.34427) 11930 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:39:23.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:23 gibba013 bash[29418]: cluster 2021-03-10T17:39:22.380584+0000 mgr.gibba020.yqfnwy (mgr.34427) 11931 : cluster [DBG] pgmap v6798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:23.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:23 gibba013 bash[30381]: cluster 2021-03-10T17:39:22.380584+0000 mgr.gibba020.yqfnwy (mgr.34427) 11931 : cluster [DBG] pgmap v6798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:23.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:23 gibba020 bash[25448]: cluster 2021-03-10T17:39:22.380584+0000 mgr.gibba020.yqfnwy (mgr.34427) 11931 : cluster [DBG] pgmap v6798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:25.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:25 gibba013 bash[29418]: cluster 2021-03-10T17:39:24.382030+0000 mgr.gibba020.yqfnwy (mgr.34427) 11932 : cluster [DBG] pgmap v6799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:25.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:25 gibba013 bash[30381]: cluster 2021-03-10T17:39:24.382030+0000 mgr.gibba020.yqfnwy (mgr.34427) 11932 : cluster [DBG] pgmap v6799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:25.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:25 gibba020 bash[25448]: cluster 2021-03-10T17:39:24.382030+0000 mgr.gibba020.yqfnwy (mgr.34427) 11932 : cluster [DBG] pgmap v6799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:27.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:27 gibba020 bash[25448]: cluster 2021-03-10T17:39:26.382835+0000 mgr.gibba020.yqfnwy (mgr.34427) 11933 : cluster [DBG] pgmap v6800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:27.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:27 gibba013 bash[29418]: cluster 2021-03-10T17:39:26.382835+0000 mgr.gibba020.yqfnwy (mgr.34427) 11933 : cluster [DBG] pgmap v6800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:27.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:27 gibba013 bash[30381]: cluster 2021-03-10T17:39:26.382835+0000 mgr.gibba020.yqfnwy (mgr.34427) 11933 : cluster [DBG] pgmap v6800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:29.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:29 gibba013 bash[29418]: cluster 2021-03-10T17:39:28.384284+0000 mgr.gibba020.yqfnwy (mgr.34427) 11934 : cluster [DBG] pgmap v6801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:29.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:29 gibba013 bash[30381]: cluster 2021-03-10T17:39:28.384284+0000 mgr.gibba020.yqfnwy (mgr.34427) 11934 : cluster [DBG] pgmap v6801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:29.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:29 gibba020 bash[25448]: cluster 2021-03-10T17:39:28.384284+0000 mgr.gibba020.yqfnwy (mgr.34427) 11934 : cluster [DBG] pgmap v6801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:31.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:31 gibba013 bash[29418]: cluster 2021-03-10T17:39:30.385969+0000 mgr.gibba020.yqfnwy (mgr.34427) 11935 : cluster [DBG] pgmap v6802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:31.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:31 gibba013 bash[30381]: cluster 2021-03-10T17:39:30.385969+0000 mgr.gibba020.yqfnwy (mgr.34427) 11935 : cluster [DBG] pgmap v6802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:31.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:31 gibba020 bash[25448]: cluster 2021-03-10T17:39:30.385969+0000 mgr.gibba020.yqfnwy (mgr.34427) 11935 : cluster [DBG] pgmap v6802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:33.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:33 gibba013 bash[29418]: cluster 2021-03-10T17:39:32.387237+0000 mgr.gibba020.yqfnwy (mgr.34427) 11936 : cluster [DBG] pgmap v6803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:33.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:33 gibba013 bash[30381]: cluster 2021-03-10T17:39:32.387237+0000 mgr.gibba020.yqfnwy (mgr.34427) 11936 : cluster [DBG] pgmap v6803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:33.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:33 gibba020 bash[25448]: cluster 2021-03-10T17:39:32.387237+0000 mgr.gibba020.yqfnwy (mgr.34427) 11936 : cluster [DBG] pgmap v6803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:35.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:35 gibba013 bash[29418]: cluster 2021-03-10T17:39:34.388976+0000 mgr.gibba020.yqfnwy (mgr.34427) 11937 : cluster [DBG] pgmap v6804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:35.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:35 gibba013 bash[30381]: cluster 2021-03-10T17:39:34.388976+0000 mgr.gibba020.yqfnwy (mgr.34427) 11937 : cluster [DBG] pgmap v6804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:35.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:35 gibba020 bash[25448]: cluster 2021-03-10T17:39:34.388976+0000 mgr.gibba020.yqfnwy (mgr.34427) 11937 : cluster [DBG] pgmap v6804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:37.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:37 gibba020 bash[25448]: cluster 2021-03-10T17:39:36.389901+0000 mgr.gibba020.yqfnwy (mgr.34427) 11938 : cluster [DBG] pgmap v6805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:37.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:37 gibba020 bash[25448]: cephadm 2021-03-10T17:39:36.984933+0000 mgr.gibba020.yqfnwy (mgr.34427) 11939 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:39:37.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:37 gibba013 bash[29418]: cluster 2021-03-10T17:39:36.389901+0000 mgr.gibba020.yqfnwy (mgr.34427) 11938 : cluster [DBG] pgmap v6805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:37.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:37 gibba013 bash[29418]: cephadm 2021-03-10T17:39:36.984933+0000 mgr.gibba020.yqfnwy (mgr.34427) 11939 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:39:37.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:37 gibba013 bash[30381]: cluster 2021-03-10T17:39:36.389901+0000 mgr.gibba020.yqfnwy (mgr.34427) 11938 : cluster [DBG] pgmap v6805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:37.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:37 gibba013 bash[30381]: cephadm 2021-03-10T17:39:36.984933+0000 mgr.gibba020.yqfnwy (mgr.34427) 11939 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:39:39.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:39 gibba013 bash[29418]: cluster 2021-03-10T17:39:38.391132+0000 mgr.gibba020.yqfnwy (mgr.34427) 11940 : cluster [DBG] pgmap v6806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:39.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:39 gibba013 bash[30381]: cluster 2021-03-10T17:39:38.391132+0000 mgr.gibba020.yqfnwy (mgr.34427) 11940 : cluster [DBG] pgmap v6806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:39.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:39 gibba020 bash[25448]: cluster 2021-03-10T17:39:38.391132+0000 mgr.gibba020.yqfnwy (mgr.34427) 11940 : cluster [DBG] pgmap v6806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:41.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:41 gibba013 bash[29418]: cluster 2021-03-10T17:39:40.392599+0000 mgr.gibba020.yqfnwy (mgr.34427) 11941 : cluster [DBG] pgmap v6807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:41.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:41 gibba013 bash[30381]: cluster 2021-03-10T17:39:40.392599+0000 mgr.gibba020.yqfnwy (mgr.34427) 11941 : cluster [DBG] pgmap v6807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:41.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:41 gibba020 bash[25448]: cluster 2021-03-10T17:39:40.392599+0000 mgr.gibba020.yqfnwy (mgr.34427) 11941 : cluster [DBG] pgmap v6807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:43.146 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:39:43.371 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:39:43.372 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 7m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:39:43.372 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 6m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:39:43.372 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:39:43.373 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:39:43.373 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:39:43.373 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:39:43.373 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:39:43.373 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:39:43.374 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:39:43.374 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 6m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:39:43.374 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:39:43.374 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:39:43.375 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:39:43.375 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:39:43.375 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:39:43.375 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:39:43.375 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:39:43.376 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 6m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:39:43.376 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 6m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:39:43.376 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 6m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:39:43.621 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:39:43.621 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:39:43.622 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:39:43.622 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:39:43.622 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:39:43.622 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:39:43.623 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:39:43.623 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:39:43.623 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:39:43.623 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:39:43.623 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:39:43.624 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:39:43.624 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:39:43.624 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:39:43.624 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:39:43.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:43 gibba013 bash[29418]: cluster 2021-03-10T17:39:42.393979+0000 mgr.gibba020.yqfnwy (mgr.34427) 11942 : cluster [DBG] pgmap v6808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:43.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:43 gibba013 bash[29418]: audit 2021-03-10T17:39:43.134046+0000 mgr.gibba020.yqfnwy (mgr.34427) 11943 : audit [DBG] from='client.62041 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:39:43.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:43 gibba013 bash[30381]: cluster 2021-03-10T17:39:42.393979+0000 mgr.gibba020.yqfnwy (mgr.34427) 11942 : cluster [DBG] pgmap v6808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:43.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:43 gibba013 bash[30381]: audit 2021-03-10T17:39:43.134046+0000 mgr.gibba020.yqfnwy (mgr.34427) 11943 : audit [DBG] from='client.62041 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:39:43.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:43 gibba020 bash[25448]: cluster 2021-03-10T17:39:42.393979+0000 mgr.gibba020.yqfnwy (mgr.34427) 11942 : cluster [DBG] pgmap v6808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:43.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:43 gibba020 bash[25448]: audit 2021-03-10T17:39:43.134046+0000 mgr.gibba020.yqfnwy (mgr.34427) 11943 : audit [DBG] from='client.62041 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:39:44.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:44 gibba013 bash[29418]: audit 2021-03-10T17:39:43.357413+0000 mgr.gibba020.yqfnwy (mgr.34427) 11944 : audit [DBG] from='client.52068 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:39:44.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:44 gibba013 bash[29418]: audit 2021-03-10T17:39:43.618768+0000 mon.a (mon.0) 4169 : audit [DBG] from='client.? 172.21.2.113:0/2814278465' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:44.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:44 gibba013 bash[30381]: audit 2021-03-10T17:39:43.357413+0000 mgr.gibba020.yqfnwy (mgr.34427) 11944 : audit [DBG] from='client.52068 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:39:44.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:44 gibba013 bash[30381]: audit 2021-03-10T17:39:43.618768+0000 mon.a (mon.0) 4169 : audit [DBG] from='client.? 172.21.2.113:0/2814278465' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:44.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:44 gibba020 bash[25448]: audit 2021-03-10T17:39:43.357413+0000 mgr.gibba020.yqfnwy (mgr.34427) 11944 : audit [DBG] from='client.52068 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:39:44.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:44 gibba020 bash[25448]: audit 2021-03-10T17:39:43.618768+0000 mon.a (mon.0) 4169 : audit [DBG] from='client.? 172.21.2.113:0/2814278465' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:39:45.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:45 gibba013 bash[29418]: cluster 2021-03-10T17:39:44.395555+0000 mgr.gibba020.yqfnwy (mgr.34427) 11945 : cluster [DBG] pgmap v6809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:45.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:45 gibba013 bash[30381]: cluster 2021-03-10T17:39:44.395555+0000 mgr.gibba020.yqfnwy (mgr.34427) 11945 : cluster [DBG] pgmap v6809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:45.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:45 gibba020 bash[25448]: cluster 2021-03-10T17:39:44.395555+0000 mgr.gibba020.yqfnwy (mgr.34427) 11945 : cluster [DBG] pgmap v6809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:47.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:47 gibba020 bash[25448]: cluster 2021-03-10T17:39:46.396107+0000 mgr.gibba020.yqfnwy (mgr.34427) 11946 : cluster [DBG] pgmap v6810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:47.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:47 gibba013 bash[29418]: cluster 2021-03-10T17:39:46.396107+0000 mgr.gibba020.yqfnwy (mgr.34427) 11946 : cluster [DBG] pgmap v6810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:47.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:47 gibba013 bash[30381]: cluster 2021-03-10T17:39:46.396107+0000 mgr.gibba020.yqfnwy (mgr.34427) 11946 : cluster [DBG] pgmap v6810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:49.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:49 gibba013 bash[29418]: cluster 2021-03-10T17:39:48.397344+0000 mgr.gibba020.yqfnwy (mgr.34427) 11947 : cluster [DBG] pgmap v6811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:49.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:49 gibba013 bash[30381]: cluster 2021-03-10T17:39:48.397344+0000 mgr.gibba020.yqfnwy (mgr.34427) 11947 : cluster [DBG] pgmap v6811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:49.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:49 gibba020 bash[25448]: cluster 2021-03-10T17:39:48.397344+0000 mgr.gibba020.yqfnwy (mgr.34427) 11947 : cluster [DBG] pgmap v6811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:51.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:51 gibba013 bash[29418]: cluster 2021-03-10T17:39:50.399042+0000 mgr.gibba020.yqfnwy (mgr.34427) 11948 : cluster [DBG] pgmap v6812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:51.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:51 gibba013 bash[30381]: cluster 2021-03-10T17:39:50.399042+0000 mgr.gibba020.yqfnwy (mgr.34427) 11948 : cluster [DBG] pgmap v6812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:51.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:51 gibba020 bash[25448]: cluster 2021-03-10T17:39:50.399042+0000 mgr.gibba020.yqfnwy (mgr.34427) 11948 : cluster [DBG] pgmap v6812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:52.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:52 gibba013 bash[29418]: cephadm 2021-03-10T17:39:52.000926+0000 mgr.gibba020.yqfnwy (mgr.34427) 11949 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:39:52.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:52 gibba013 bash[30381]: cephadm 2021-03-10T17:39:52.000926+0000 mgr.gibba020.yqfnwy (mgr.34427) 11949 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:39:52.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:52 gibba020 bash[25448]: cephadm 2021-03-10T17:39:52.000926+0000 mgr.gibba020.yqfnwy (mgr.34427) 11949 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:39:53.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:53 gibba013 bash[29418]: cluster 2021-03-10T17:39:52.400477+0000 mgr.gibba020.yqfnwy (mgr.34427) 11950 : cluster [DBG] pgmap v6813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:53.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:53 gibba013 bash[30381]: cluster 2021-03-10T17:39:52.400477+0000 mgr.gibba020.yqfnwy (mgr.34427) 11950 : cluster [DBG] pgmap v6813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:53.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:53 gibba020 bash[25448]: cluster 2021-03-10T17:39:52.400477+0000 mgr.gibba020.yqfnwy (mgr.34427) 11950 : cluster [DBG] pgmap v6813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:55.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:55 gibba013 bash[29418]: cluster 2021-03-10T17:39:54.402206+0000 mgr.gibba020.yqfnwy (mgr.34427) 11951 : cluster [DBG] pgmap v6814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:55.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:55 gibba013 bash[30381]: cluster 2021-03-10T17:39:54.402206+0000 mgr.gibba020.yqfnwy (mgr.34427) 11951 : cluster [DBG] pgmap v6814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:55.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:55 gibba020 bash[25448]: cluster 2021-03-10T17:39:54.402206+0000 mgr.gibba020.yqfnwy (mgr.34427) 11951 : cluster [DBG] pgmap v6814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:57.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:57 gibba020 bash[25448]: cluster 2021-03-10T17:39:56.403245+0000 mgr.gibba020.yqfnwy (mgr.34427) 11952 : cluster [DBG] pgmap v6815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:57.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:57 gibba013 bash[29418]: cluster 2021-03-10T17:39:56.403245+0000 mgr.gibba020.yqfnwy (mgr.34427) 11952 : cluster [DBG] pgmap v6815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:57.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:57 gibba013 bash[30381]: cluster 2021-03-10T17:39:56.403245+0000 mgr.gibba020.yqfnwy (mgr.34427) 11952 : cluster [DBG] pgmap v6815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:59.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:39:59 gibba013 bash[29418]: cluster 2021-03-10T17:39:58.404694+0000 mgr.gibba020.yqfnwy (mgr.34427) 11953 : cluster [DBG] pgmap v6816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:59.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:39:59 gibba013 bash[30381]: cluster 2021-03-10T17:39:58.404694+0000 mgr.gibba020.yqfnwy (mgr.34427) 11953 : cluster [DBG] pgmap v6816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:39:59.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:39:59 gibba020 bash[25448]: cluster 2021-03-10T17:39:58.404694+0000 mgr.gibba020.yqfnwy (mgr.34427) 11953 : cluster [DBG] pgmap v6816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:00.381 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:00 gibba013 bash[29418]: debug 2021-03-10T17:39:59.999+0000 7fd718a82700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:40:00.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:00 gibba013 bash[29418]: cluster 2021-03-10T17:40:00.000474+0000 mon.a (mon.0) 4170 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:40:00.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:00 gibba013 bash[30381]: cluster 2021-03-10T17:40:00.000474+0000 mon.a (mon.0) 4170 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:40:00.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:00 gibba020 bash[25448]: cluster 2021-03-10T17:40:00.000474+0000 mon.a (mon.0) 4170 : cluster [ERR] overall HEALTH_ERR 1 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T17:40:01.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:01 gibba013 bash[29418]: cluster 2021-03-10T17:40:00.406539+0000 mgr.gibba020.yqfnwy (mgr.34427) 11954 : cluster [DBG] pgmap v6817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:01.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:01 gibba013 bash[30381]: cluster 2021-03-10T17:40:00.406539+0000 mgr.gibba020.yqfnwy (mgr.34427) 11954 : cluster [DBG] pgmap v6817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:01.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:01 gibba020 bash[25448]: cluster 2021-03-10T17:40:00.406539+0000 mgr.gibba020.yqfnwy (mgr.34427) 11954 : cluster [DBG] pgmap v6817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:03.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:03 gibba013 bash[29418]: cluster 2021-03-10T17:40:02.407816+0000 mgr.gibba020.yqfnwy (mgr.34427) 11955 : cluster [DBG] pgmap v6818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:03.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:03 gibba013 bash[30381]: cluster 2021-03-10T17:40:02.407816+0000 mgr.gibba020.yqfnwy (mgr.34427) 11955 : cluster [DBG] pgmap v6818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:03.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:03 gibba020 bash[25448]: cluster 2021-03-10T17:40:02.407816+0000 mgr.gibba020.yqfnwy (mgr.34427) 11955 : cluster [DBG] pgmap v6818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:05.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:05 gibba013 bash[29418]: cluster 2021-03-10T17:40:04.409402+0000 mgr.gibba020.yqfnwy (mgr.34427) 11956 : cluster [DBG] pgmap v6819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:05.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:05 gibba013 bash[30381]: cluster 2021-03-10T17:40:04.409402+0000 mgr.gibba020.yqfnwy (mgr.34427) 11956 : cluster [DBG] pgmap v6819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:05.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:05 gibba020 bash[25448]: cluster 2021-03-10T17:40:04.409402+0000 mgr.gibba020.yqfnwy (mgr.34427) 11956 : cluster [DBG] pgmap v6819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:07.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:07 gibba020 bash[25448]: cluster 2021-03-10T17:40:06.410319+0000 mgr.gibba020.yqfnwy (mgr.34427) 11957 : cluster [DBG] pgmap v6820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:07.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:07 gibba020 bash[25448]: audit 2021-03-10T17:40:07.018273+0000 mon.a (mon.0) 4171 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:40:07.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:07 gibba020 bash[25448]: cephadm 2021-03-10T17:40:07.023139+0000 mgr.gibba020.yqfnwy (mgr.34427) 11958 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:40:07.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:07 gibba020 bash[25448]: cephadm 2021-03-10T17:40:07.024983+0000 mgr.gibba020.yqfnwy (mgr.34427) 11959 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:40:07.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:07 gibba020 bash[25448]: audit 2021-03-10T17:40:07.054250+0000 mon.a (mon.0) 4172 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:40:07.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:07 gibba020 bash[25448]: audit 2021-03-10T17:40:07.305752+0000 mon.a (mon.0) 4173 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:40:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:07 gibba020 bash[25448]: audit 2021-03-10T17:40:07.309281+0000 mon.a (mon.0) 4174 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:40:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:07 gibba020 bash[25448]: audit 2021-03-10T17:40:07.310848+0000 mon.a (mon.0) 4175 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:07 gibba020 bash[25448]: audit 2021-03-10T17:40:07.312422+0000 mon.a (mon.0) 4176 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:07.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:07 gibba020 bash[25448]: audit 2021-03-10T17:40:07.313886+0000 mon.a (mon.0) 4177 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:07.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:07 gibba020 bash[25448]: audit 2021-03-10T17:40:07.317047+0000 mon.a (mon.0) 4178 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:07.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:07 gibba020 bash[25448]: audit 2021-03-10T17:40:07.318840+0000 mon.a (mon.0) 4179 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:07.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:07 gibba020 bash[25448]: audit 2021-03-10T17:40:07.319983+0000 mon.a (mon.0) 4180 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:40:07.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:07 gibba013 bash[29418]: cluster 2021-03-10T17:40:06.410319+0000 mgr.gibba020.yqfnwy (mgr.34427) 11957 : cluster [DBG] pgmap v6820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:07.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:07 gibba013 bash[29418]: audit 2021-03-10T17:40:07.018273+0000 mon.a (mon.0) 4171 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:40:07.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:07 gibba013 bash[29418]: cephadm 2021-03-10T17:40:07.023139+0000 mgr.gibba020.yqfnwy (mgr.34427) 11958 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:40:07.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:07 gibba013 bash[29418]: cephadm 2021-03-10T17:40:07.024983+0000 mgr.gibba020.yqfnwy (mgr.34427) 11959 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:40:07.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:07 gibba013 bash[29418]: audit 2021-03-10T17:40:07.054250+0000 mon.a (mon.0) 4172 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:40:07.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:07 gibba013 bash[29418]: audit 2021-03-10T17:40:07.305752+0000 mon.a (mon.0) 4173 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:40:07.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:07 gibba013 bash[29418]: audit 2021-03-10T17:40:07.309281+0000 mon.a (mon.0) 4174 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:40:07.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:07 gibba013 bash[29418]: audit 2021-03-10T17:40:07.310848+0000 mon.a (mon.0) 4175 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:07.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:07 gibba013 bash[29418]: audit 2021-03-10T17:40:07.312422+0000 mon.a (mon.0) 4176 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:07.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:07 gibba013 bash[29418]: audit 2021-03-10T17:40:07.313886+0000 mon.a (mon.0) 4177 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:07.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:07 gibba013 bash[29418]: audit 2021-03-10T17:40:07.317047+0000 mon.a (mon.0) 4178 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:07.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:07 gibba013 bash[29418]: audit 2021-03-10T17:40:07.318840+0000 mon.a (mon.0) 4179 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:07.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:07 gibba013 bash[29418]: audit 2021-03-10T17:40:07.319983+0000 mon.a (mon.0) 4180 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:40:07.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:07 gibba013 bash[30381]: cluster 2021-03-10T17:40:06.410319+0000 mgr.gibba020.yqfnwy (mgr.34427) 11957 : cluster [DBG] pgmap v6820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:07.886 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:07 gibba013 bash[30381]: audit 2021-03-10T17:40:07.018273+0000 mon.a (mon.0) 4171 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:40:07.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:07 gibba013 bash[30381]: cephadm 2021-03-10T17:40:07.023139+0000 mgr.gibba020.yqfnwy (mgr.34427) 11958 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:40:07.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:07 gibba013 bash[30381]: cephadm 2021-03-10T17:40:07.024983+0000 mgr.gibba020.yqfnwy (mgr.34427) 11959 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:40:07.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:07 gibba013 bash[30381]: audit 2021-03-10T17:40:07.054250+0000 mon.a (mon.0) 4172 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:40:07.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:07 gibba013 bash[30381]: audit 2021-03-10T17:40:07.305752+0000 mon.a (mon.0) 4173 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:40:07.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:07 gibba013 bash[30381]: audit 2021-03-10T17:40:07.309281+0000 mon.a (mon.0) 4174 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:40:07.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:07 gibba013 bash[30381]: audit 2021-03-10T17:40:07.310848+0000 mon.a (mon.0) 4175 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:07.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:07 gibba013 bash[30381]: audit 2021-03-10T17:40:07.312422+0000 mon.a (mon.0) 4176 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:07.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:07 gibba013 bash[30381]: audit 2021-03-10T17:40:07.313886+0000 mon.a (mon.0) 4177 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:07.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:07 gibba013 bash[30381]: audit 2021-03-10T17:40:07.317047+0000 mon.a (mon.0) 4178 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:07.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:07 gibba013 bash[30381]: audit 2021-03-10T17:40:07.318840+0000 mon.a (mon.0) 4179 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:07.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:07 gibba013 bash[30381]: audit 2021-03-10T17:40:07.319983+0000 mon.a (mon.0) 4180 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:40:08.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:08 gibba020 bash[25448]: cephadm 2021-03-10T17:40:07.307810+0000 mgr.gibba020.yqfnwy (mgr.34427) 11960 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:40:08.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:08 gibba020 bash[25448]: cephadm 2021-03-10T17:40:07.309711+0000 mgr.gibba020.yqfnwy (mgr.34427) 11961 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:40:08.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:08 gibba020 bash[25448]: cephadm 2021-03-10T17:40:07.311361+0000 mgr.gibba020.yqfnwy (mgr.34427) 11962 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:40:08.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:08 gibba020 bash[25448]: cephadm 2021-03-10T17:40:07.311407+0000 mgr.gibba020.yqfnwy (mgr.34427) 11963 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:40:08.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:08 gibba020 bash[25448]: cephadm 2021-03-10T17:40:07.312905+0000 mgr.gibba020.yqfnwy (mgr.34427) 11964 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:40:08.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:08 gibba020 bash[25448]: cephadm 2021-03-10T17:40:07.312951+0000 mgr.gibba020.yqfnwy (mgr.34427) 11965 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:40:08.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:08 gibba020 bash[25448]: cephadm 2021-03-10T17:40:07.314438+0000 mgr.gibba020.yqfnwy (mgr.34427) 11966 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:40:08.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:08 gibba020 bash[25448]: cephadm 2021-03-10T17:40:07.315835+0000 mgr.gibba020.yqfnwy (mgr.34427) 11967 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:40:08.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:08 gibba020 bash[25448]: cephadm 2021-03-10T17:40:07.315884+0000 mgr.gibba020.yqfnwy (mgr.34427) 11968 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:40:08.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:08 gibba020 bash[25448]: cephadm 2021-03-10T17:40:07.317480+0000 mgr.gibba020.yqfnwy (mgr.34427) 11969 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:40:08.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:08 gibba020 bash[25448]: cephadm 2021-03-10T17:40:07.317896+0000 mgr.gibba020.yqfnwy (mgr.34427) 11970 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:40:08.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:08 gibba020 bash[25448]: cephadm 2021-03-10T17:40:07.319369+0000 mgr.gibba020.yqfnwy (mgr.34427) 11971 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:40:08.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:08 gibba020 bash[25448]: cephadm 2021-03-10T17:40:07.319424+0000 mgr.gibba020.yqfnwy (mgr.34427) 11972 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:40:08.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:08 gibba020 bash[25448]: cephadm 2021-03-10T17:40:07.319587+0000 mgr.gibba020.yqfnwy (mgr.34427) 11973 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:40:08.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:08 gibba020 bash[25448]: audit 2021-03-10T17:40:07.805757+0000 mon.a (mon.0) 4181 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:40:08.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:08 gibba020 bash[25448]: audit 2021-03-10T17:40:07.806571+0000 mon.a (mon.0) 4182 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:40:08.704 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:08 gibba020 bash[25448]: audit 2021-03-10T17:40:07.807226+0000 mon.a (mon.0) 4183 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:40:08.705 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:08 gibba020 bash[25448]: audit 2021-03-10T17:40:07.807880+0000 mon.a (mon.0) 4184 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:40:08.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:08 gibba013 bash[29418]: cephadm 2021-03-10T17:40:07.307810+0000 mgr.gibba020.yqfnwy (mgr.34427) 11960 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:40:08.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:08 gibba013 bash[29418]: cephadm 2021-03-10T17:40:07.309711+0000 mgr.gibba020.yqfnwy (mgr.34427) 11961 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:40:08.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:08 gibba013 bash[29418]: cephadm 2021-03-10T17:40:07.311361+0000 mgr.gibba020.yqfnwy (mgr.34427) 11962 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:40:08.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:08 gibba013 bash[29418]: cephadm 2021-03-10T17:40:07.311407+0000 mgr.gibba020.yqfnwy (mgr.34427) 11963 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:40:08.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:08 gibba013 bash[29418]: cephadm 2021-03-10T17:40:07.312905+0000 mgr.gibba020.yqfnwy (mgr.34427) 11964 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:40:08.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:08 gibba013 bash[29418]: cephadm 2021-03-10T17:40:07.312951+0000 mgr.gibba020.yqfnwy (mgr.34427) 11965 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:40:08.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:08 gibba013 bash[29418]: cephadm 2021-03-10T17:40:07.314438+0000 mgr.gibba020.yqfnwy (mgr.34427) 11966 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:40:08.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:08 gibba013 bash[29418]: cephadm 2021-03-10T17:40:07.315835+0000 mgr.gibba020.yqfnwy (mgr.34427) 11967 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:40:08.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:08 gibba013 bash[29418]: cephadm 2021-03-10T17:40:07.315884+0000 mgr.gibba020.yqfnwy (mgr.34427) 11968 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:40:08.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:08 gibba013 bash[29418]: cephadm 2021-03-10T17:40:07.317480+0000 mgr.gibba020.yqfnwy (mgr.34427) 11969 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:40:08.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:08 gibba013 bash[29418]: cephadm 2021-03-10T17:40:07.317896+0000 mgr.gibba020.yqfnwy (mgr.34427) 11970 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:40:08.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:08 gibba013 bash[29418]: cephadm 2021-03-10T17:40:07.319369+0000 mgr.gibba020.yqfnwy (mgr.34427) 11971 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:40:08.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:08 gibba013 bash[29418]: cephadm 2021-03-10T17:40:07.319424+0000 mgr.gibba020.yqfnwy (mgr.34427) 11972 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:40:08.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:08 gibba013 bash[29418]: cephadm 2021-03-10T17:40:07.319587+0000 mgr.gibba020.yqfnwy (mgr.34427) 11973 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:40:08.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:08 gibba013 bash[29418]: audit 2021-03-10T17:40:07.805757+0000 mon.a (mon.0) 4181 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:40:08.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:08 gibba013 bash[29418]: audit 2021-03-10T17:40:07.806571+0000 mon.a (mon.0) 4182 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:40:08.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:08 gibba013 bash[29418]: audit 2021-03-10T17:40:07.807226+0000 mon.a (mon.0) 4183 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:40:08.887 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:08 gibba013 bash[29418]: audit 2021-03-10T17:40:07.807880+0000 mon.a (mon.0) 4184 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:40:08.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:08 gibba013 bash[30381]: cephadm 2021-03-10T17:40:07.307810+0000 mgr.gibba020.yqfnwy (mgr.34427) 11960 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:40:08.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:08 gibba013 bash[30381]: cephadm 2021-03-10T17:40:07.309711+0000 mgr.gibba020.yqfnwy (mgr.34427) 11961 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:40:08.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:08 gibba013 bash[30381]: cephadm 2021-03-10T17:40:07.311361+0000 mgr.gibba020.yqfnwy (mgr.34427) 11962 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:40:08.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:08 gibba013 bash[30381]: cephadm 2021-03-10T17:40:07.311407+0000 mgr.gibba020.yqfnwy (mgr.34427) 11963 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:40:08.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:08 gibba013 bash[30381]: cephadm 2021-03-10T17:40:07.312905+0000 mgr.gibba020.yqfnwy (mgr.34427) 11964 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:40:08.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:08 gibba013 bash[30381]: cephadm 2021-03-10T17:40:07.312951+0000 mgr.gibba020.yqfnwy (mgr.34427) 11965 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:40:08.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:08 gibba013 bash[30381]: cephadm 2021-03-10T17:40:07.314438+0000 mgr.gibba020.yqfnwy (mgr.34427) 11966 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:40:08.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:08 gibba013 bash[30381]: cephadm 2021-03-10T17:40:07.315835+0000 mgr.gibba020.yqfnwy (mgr.34427) 11967 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:40:08.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:08 gibba013 bash[30381]: cephadm 2021-03-10T17:40:07.315884+0000 mgr.gibba020.yqfnwy (mgr.34427) 11968 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:40:08.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:08 gibba013 bash[30381]: cephadm 2021-03-10T17:40:07.317480+0000 mgr.gibba020.yqfnwy (mgr.34427) 11969 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:40:08.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:08 gibba013 bash[30381]: cephadm 2021-03-10T17:40:07.317896+0000 mgr.gibba020.yqfnwy (mgr.34427) 11970 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:40:08.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:08 gibba013 bash[30381]: cephadm 2021-03-10T17:40:07.319369+0000 mgr.gibba020.yqfnwy (mgr.34427) 11971 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:40:08.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:08 gibba013 bash[30381]: cephadm 2021-03-10T17:40:07.319424+0000 mgr.gibba020.yqfnwy (mgr.34427) 11972 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:40:08.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:08 gibba013 bash[30381]: cephadm 2021-03-10T17:40:07.319587+0000 mgr.gibba020.yqfnwy (mgr.34427) 11973 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:40:08.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:08 gibba013 bash[30381]: audit 2021-03-10T17:40:07.805757+0000 mon.a (mon.0) 4181 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T17:40:08.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:08 gibba013 bash[30381]: audit 2021-03-10T17:40:07.806571+0000 mon.a (mon.0) 4182 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T17:40:08.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:08 gibba013 bash[30381]: audit 2021-03-10T17:40:07.807226+0000 mon.a (mon.0) 4183 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:40:08.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:08 gibba013 bash[30381]: audit 2021-03-10T17:40:07.807880+0000 mon.a (mon.0) 4184 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:40:09.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:09 gibba020 bash[25448]: cluster 2021-03-10T17:40:08.411627+0000 mgr.gibba020.yqfnwy (mgr.34427) 11974 : cluster [DBG] pgmap v6821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:09.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:09 gibba013 bash[29418]: cluster 2021-03-10T17:40:08.411627+0000 mgr.gibba020.yqfnwy (mgr.34427) 11974 : cluster [DBG] pgmap v6821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:09.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:09 gibba013 bash[30381]: cluster 2021-03-10T17:40:08.411627+0000 mgr.gibba020.yqfnwy (mgr.34427) 11974 : cluster [DBG] pgmap v6821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:11.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:11 gibba020 bash[25448]: cluster 2021-03-10T17:40:10.413230+0000 mgr.gibba020.yqfnwy (mgr.34427) 11975 : cluster [DBG] pgmap v6822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:11.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:11 gibba013 bash[29418]: cluster 2021-03-10T17:40:10.413230+0000 mgr.gibba020.yqfnwy (mgr.34427) 11975 : cluster [DBG] pgmap v6822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:11.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:11 gibba013 bash[30381]: cluster 2021-03-10T17:40:10.413230+0000 mgr.gibba020.yqfnwy (mgr.34427) 11975 : cluster [DBG] pgmap v6822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:13.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:13 gibba020 bash[25448]: cluster 2021-03-10T17:40:12.414773+0000 mgr.gibba020.yqfnwy (mgr.34427) 11976 : cluster [DBG] pgmap v6823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:13.866 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:40:13.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:13 gibba013 bash[29418]: cluster 2021-03-10T17:40:12.414773+0000 mgr.gibba020.yqfnwy (mgr.34427) 11976 : cluster [DBG] pgmap v6823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:13.881 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:13 gibba013 bash[30381]: cluster 2021-03-10T17:40:12.414773+0000 mgr.gibba020.yqfnwy (mgr.34427) 11976 : cluster [DBG] pgmap v6823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:14.095 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:40:14.095 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 8m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:40:14.096 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 7m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:40:14.096 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:40:14.096 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:40:14.096 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:40:14.097 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:40:14.097 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:40:14.097 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:40:14.097 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:40:14.097 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:40:14.098 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:40:14.098 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:40:14.098 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:40:14.098 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:40:14.099 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:40:14.099 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:40:14.099 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:40:14.099 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:40:14.099 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 7m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:40:14.100 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 7m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:40:14.343 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:40:14.343 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:40:14.344 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:40:14.344 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:40:14.344 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:40:14.344 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:40:14.345 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:40:14.345 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:40:14.345 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:40:14.345 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:40:14.346 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:40:14.346 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:40:14.346 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:40:14.346 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:40:14.346 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:40:14.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:14 gibba013 bash[29418]: audit 2021-03-10T17:40:13.854150+0000 mgr.gibba020.yqfnwy (mgr.34427) 11977 : audit [DBG] from='client.52080 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:40:14.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:14 gibba013 bash[29418]: audit 2021-03-10T17:40:14.079883+0000 mgr.gibba020.yqfnwy (mgr.34427) 11978 : audit [DBG] from='client.62065 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:40:14.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:14 gibba013 bash[29418]: audit 2021-03-10T17:40:14.340808+0000 mon.a (mon.0) 4185 : audit [DBG] from='client.? 172.21.2.113:0/942605249' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:14.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:14 gibba013 bash[30381]: audit 2021-03-10T17:40:13.854150+0000 mgr.gibba020.yqfnwy (mgr.34427) 11977 : audit [DBG] from='client.52080 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:40:14.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:14 gibba013 bash[30381]: audit 2021-03-10T17:40:14.079883+0000 mgr.gibba020.yqfnwy (mgr.34427) 11978 : audit [DBG] from='client.62065 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:40:14.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:14 gibba013 bash[30381]: audit 2021-03-10T17:40:14.340808+0000 mon.a (mon.0) 4185 : audit [DBG] from='client.? 172.21.2.113:0/942605249' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:14.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:14 gibba020 bash[25448]: audit 2021-03-10T17:40:13.854150+0000 mgr.gibba020.yqfnwy (mgr.34427) 11977 : audit [DBG] from='client.52080 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:40:14.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:14 gibba020 bash[25448]: audit 2021-03-10T17:40:14.079883+0000 mgr.gibba020.yqfnwy (mgr.34427) 11978 : audit [DBG] from='client.62065 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:40:14.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:14 gibba020 bash[25448]: audit 2021-03-10T17:40:14.340808+0000 mon.a (mon.0) 4185 : audit [DBG] from='client.? 172.21.2.113:0/942605249' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:15.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:15 gibba013 bash[29418]: cluster 2021-03-10T17:40:14.416357+0000 mgr.gibba020.yqfnwy (mgr.34427) 11979 : cluster [DBG] pgmap v6824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:15.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:15 gibba013 bash[30381]: cluster 2021-03-10T17:40:14.416357+0000 mgr.gibba020.yqfnwy (mgr.34427) 11979 : cluster [DBG] pgmap v6824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:15.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:15 gibba020 bash[25448]: cluster 2021-03-10T17:40:14.416357+0000 mgr.gibba020.yqfnwy (mgr.34427) 11979 : cluster [DBG] pgmap v6824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:17.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:17 gibba020 bash[25448]: cluster 2021-03-10T17:40:16.417284+0000 mgr.gibba020.yqfnwy (mgr.34427) 11980 : cluster [DBG] pgmap v6825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:17.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:17 gibba013 bash[29418]: cluster 2021-03-10T17:40:16.417284+0000 mgr.gibba020.yqfnwy (mgr.34427) 11980 : cluster [DBG] pgmap v6825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:17.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:17 gibba013 bash[30381]: cluster 2021-03-10T17:40:16.417284+0000 mgr.gibba020.yqfnwy (mgr.34427) 11980 : cluster [DBG] pgmap v6825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:19.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:19 gibba013 bash[29418]: cluster 2021-03-10T17:40:18.418693+0000 mgr.gibba020.yqfnwy (mgr.34427) 11981 : cluster [DBG] pgmap v6826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:19.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:19 gibba013 bash[30381]: cluster 2021-03-10T17:40:18.418693+0000 mgr.gibba020.yqfnwy (mgr.34427) 11981 : cluster [DBG] pgmap v6826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:19.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:19 gibba020 bash[25448]: cluster 2021-03-10T17:40:18.418693+0000 mgr.gibba020.yqfnwy (mgr.34427) 11981 : cluster [DBG] pgmap v6826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:21.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:21 gibba013 bash[29418]: cluster 2021-03-10T17:40:20.420353+0000 mgr.gibba020.yqfnwy (mgr.34427) 11982 : cluster [DBG] pgmap v6827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:21.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:21 gibba013 bash[30381]: cluster 2021-03-10T17:40:20.420353+0000 mgr.gibba020.yqfnwy (mgr.34427) 11982 : cluster [DBG] pgmap v6827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:21.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:21 gibba020 bash[25448]: cluster 2021-03-10T17:40:20.420353+0000 mgr.gibba020.yqfnwy (mgr.34427) 11982 : cluster [DBG] pgmap v6827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:23.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:23 gibba013 bash[29418]: cephadm 2021-03-10T17:40:22.335505+0000 mgr.gibba020.yqfnwy (mgr.34427) 11983 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:40:23.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:23 gibba013 bash[29418]: cluster 2021-03-10T17:40:22.421635+0000 mgr.gibba020.yqfnwy (mgr.34427) 11984 : cluster [DBG] pgmap v6828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:23.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:23 gibba013 bash[30381]: cephadm 2021-03-10T17:40:22.335505+0000 mgr.gibba020.yqfnwy (mgr.34427) 11983 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:40:23.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:23 gibba013 bash[30381]: cluster 2021-03-10T17:40:22.421635+0000 mgr.gibba020.yqfnwy (mgr.34427) 11984 : cluster [DBG] pgmap v6828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:23.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:23 gibba020 bash[25448]: cephadm 2021-03-10T17:40:22.335505+0000 mgr.gibba020.yqfnwy (mgr.34427) 11983 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:40:23.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:23 gibba020 bash[25448]: cluster 2021-03-10T17:40:22.421635+0000 mgr.gibba020.yqfnwy (mgr.34427) 11984 : cluster [DBG] pgmap v6828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:25.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:25 gibba013 bash[29418]: cluster 2021-03-10T17:40:24.422961+0000 mgr.gibba020.yqfnwy (mgr.34427) 11985 : cluster [DBG] pgmap v6829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:25.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:25 gibba013 bash[30381]: cluster 2021-03-10T17:40:24.422961+0000 mgr.gibba020.yqfnwy (mgr.34427) 11985 : cluster [DBG] pgmap v6829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:25.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:25 gibba020 bash[25448]: cluster 2021-03-10T17:40:24.422961+0000 mgr.gibba020.yqfnwy (mgr.34427) 11985 : cluster [DBG] pgmap v6829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:27.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:27 gibba020 bash[25448]: cluster 2021-03-10T17:40:26.424744+0000 mgr.gibba020.yqfnwy (mgr.34427) 11986 : cluster [DBG] pgmap v6830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:27.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:27 gibba013 bash[29418]: cluster 2021-03-10T17:40:26.424744+0000 mgr.gibba020.yqfnwy (mgr.34427) 11986 : cluster [DBG] pgmap v6830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:27.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:27 gibba013 bash[30381]: cluster 2021-03-10T17:40:26.424744+0000 mgr.gibba020.yqfnwy (mgr.34427) 11986 : cluster [DBG] pgmap v6830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:29.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:29 gibba013 bash[29418]: cluster 2021-03-10T17:40:28.426359+0000 mgr.gibba020.yqfnwy (mgr.34427) 11987 : cluster [DBG] pgmap v6831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:29.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:29 gibba013 bash[30381]: cluster 2021-03-10T17:40:28.426359+0000 mgr.gibba020.yqfnwy (mgr.34427) 11987 : cluster [DBG] pgmap v6831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:29.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:29 gibba020 bash[25448]: cluster 2021-03-10T17:40:28.426359+0000 mgr.gibba020.yqfnwy (mgr.34427) 11987 : cluster [DBG] pgmap v6831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:31.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:31 gibba013 bash[29418]: cluster 2021-03-10T17:40:30.427800+0000 mgr.gibba020.yqfnwy (mgr.34427) 11988 : cluster [DBG] pgmap v6832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:31.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:31 gibba013 bash[30381]: cluster 2021-03-10T17:40:30.427800+0000 mgr.gibba020.yqfnwy (mgr.34427) 11988 : cluster [DBG] pgmap v6832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:31.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:31 gibba020 bash[25448]: cluster 2021-03-10T17:40:30.427800+0000 mgr.gibba020.yqfnwy (mgr.34427) 11988 : cluster [DBG] pgmap v6832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:33.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:33 gibba013 bash[29418]: cluster 2021-03-10T17:40:32.429291+0000 mgr.gibba020.yqfnwy (mgr.34427) 11989 : cluster [DBG] pgmap v6833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:33.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:33 gibba013 bash[30381]: cluster 2021-03-10T17:40:32.429291+0000 mgr.gibba020.yqfnwy (mgr.34427) 11989 : cluster [DBG] pgmap v6833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:33.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:33 gibba020 bash[25448]: cluster 2021-03-10T17:40:32.429291+0000 mgr.gibba020.yqfnwy (mgr.34427) 11989 : cluster [DBG] pgmap v6833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:35.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:35 gibba013 bash[29418]: cluster 2021-03-10T17:40:34.430555+0000 mgr.gibba020.yqfnwy (mgr.34427) 11990 : cluster [DBG] pgmap v6834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:35.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:35 gibba013 bash[30381]: cluster 2021-03-10T17:40:34.430555+0000 mgr.gibba020.yqfnwy (mgr.34427) 11990 : cluster [DBG] pgmap v6834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:35.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:35 gibba020 bash[25448]: cluster 2021-03-10T17:40:34.430555+0000 mgr.gibba020.yqfnwy (mgr.34427) 11990 : cluster [DBG] pgmap v6834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:37.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:37 gibba020 bash[25448]: cluster 2021-03-10T17:40:36.431531+0000 mgr.gibba020.yqfnwy (mgr.34427) 11991 : cluster [DBG] pgmap v6835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:37.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:37 gibba013 bash[29418]: cluster 2021-03-10T17:40:36.431531+0000 mgr.gibba020.yqfnwy (mgr.34427) 11991 : cluster [DBG] pgmap v6835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:37.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:37 gibba013 bash[30381]: cluster 2021-03-10T17:40:36.431531+0000 mgr.gibba020.yqfnwy (mgr.34427) 11991 : cluster [DBG] pgmap v6835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:38.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:38 gibba020 bash[25448]: cephadm 2021-03-10T17:40:37.351517+0000 mgr.gibba020.yqfnwy (mgr.34427) 11992 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:40:38.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:38 gibba013 bash[29418]: cephadm 2021-03-10T17:40:37.351517+0000 mgr.gibba020.yqfnwy (mgr.34427) 11992 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:40:38.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:38 gibba013 bash[30381]: cephadm 2021-03-10T17:40:37.351517+0000 mgr.gibba020.yqfnwy (mgr.34427) 11992 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:40:39.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:39 gibba020 bash[25448]: cluster 2021-03-10T17:40:38.432779+0000 mgr.gibba020.yqfnwy (mgr.34427) 11993 : cluster [DBG] pgmap v6836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:39.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:39 gibba013 bash[29418]: cluster 2021-03-10T17:40:38.432779+0000 mgr.gibba020.yqfnwy (mgr.34427) 11993 : cluster [DBG] pgmap v6836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:39.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:39 gibba013 bash[30381]: cluster 2021-03-10T17:40:38.432779+0000 mgr.gibba020.yqfnwy (mgr.34427) 11993 : cluster [DBG] pgmap v6836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:41.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:41 gibba013 bash[29418]: cluster 2021-03-10T17:40:40.434508+0000 mgr.gibba020.yqfnwy (mgr.34427) 11994 : cluster [DBG] pgmap v6837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:41.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:41 gibba013 bash[30381]: cluster 2021-03-10T17:40:40.434508+0000 mgr.gibba020.yqfnwy (mgr.34427) 11994 : cluster [DBG] pgmap v6837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:41.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:41 gibba020 bash[25448]: cluster 2021-03-10T17:40:40.434508+0000 mgr.gibba020.yqfnwy (mgr.34427) 11994 : cluster [DBG] pgmap v6837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:43.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:43 gibba013 bash[29418]: cluster 2021-03-10T17:40:42.436110+0000 mgr.gibba020.yqfnwy (mgr.34427) 11995 : cluster [DBG] pgmap v6838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:43.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:43 gibba013 bash[30381]: cluster 2021-03-10T17:40:42.436110+0000 mgr.gibba020.yqfnwy (mgr.34427) 11995 : cluster [DBG] pgmap v6838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:43.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:43 gibba020 bash[25448]: cluster 2021-03-10T17:40:42.436110+0000 mgr.gibba020.yqfnwy (mgr.34427) 11995 : cluster [DBG] pgmap v6838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:44.586 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:40:44.816 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:40:44.816 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 8m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:40:44.816 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 7m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:40:44.817 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:40:44.817 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:40:44.817 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:40:44.817 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:40:44.817 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:40:44.818 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:40:44.818 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:40:44.818 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 7m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:40:44.818 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:40:44.819 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:40:44.819 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:40:44.819 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:40:44.820 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:40:44.820 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:40:44.820 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:40:44.820 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 7m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:40:44.821 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 7m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:40:44.821 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 7m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:40:45.064 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:40:45.064 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:40:45.064 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:40:45.065 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:40:45.065 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:40:45.066 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:40:45.066 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:40:45.067 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:40:45.067 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:40:45.067 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:40:45.068 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:40:45.068 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:40:45.069 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:40:45.069 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:40:45.069 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:40:45.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:45 gibba013 bash[29418]: cluster 2021-03-10T17:40:44.437348+0000 mgr.gibba020.yqfnwy (mgr.34427) 11996 : cluster [DBG] pgmap v6839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:45.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:45 gibba013 bash[29418]: audit 2021-03-10T17:40:44.574172+0000 mgr.gibba020.yqfnwy (mgr.34427) 11997 : audit [DBG] from='client.62077 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:40:45.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:45 gibba013 bash[29418]: audit 2021-03-10T17:40:44.800349+0000 mgr.gibba020.yqfnwy (mgr.34427) 11998 : audit [DBG] from='client.62083 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:40:45.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:45 gibba013 bash[29418]: audit 2021-03-10T17:40:45.061310+0000 mon.a (mon.0) 4186 : audit [DBG] from='client.? 172.21.2.113:0/3249912714' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:45.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:45 gibba013 bash[30381]: cluster 2021-03-10T17:40:44.437348+0000 mgr.gibba020.yqfnwy (mgr.34427) 11996 : cluster [DBG] pgmap v6839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:45.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:45 gibba013 bash[30381]: audit 2021-03-10T17:40:44.574172+0000 mgr.gibba020.yqfnwy (mgr.34427) 11997 : audit [DBG] from='client.62077 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:40:45.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:45 gibba013 bash[30381]: audit 2021-03-10T17:40:44.800349+0000 mgr.gibba020.yqfnwy (mgr.34427) 11998 : audit [DBG] from='client.62083 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:40:45.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:45 gibba013 bash[30381]: audit 2021-03-10T17:40:45.061310+0000 mon.a (mon.0) 4186 : audit [DBG] from='client.? 172.21.2.113:0/3249912714' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:45.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:45 gibba020 bash[25448]: cluster 2021-03-10T17:40:44.437348+0000 mgr.gibba020.yqfnwy (mgr.34427) 11996 : cluster [DBG] pgmap v6839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:45.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:45 gibba020 bash[25448]: audit 2021-03-10T17:40:44.574172+0000 mgr.gibba020.yqfnwy (mgr.34427) 11997 : audit [DBG] from='client.62077 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:40:45.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:45 gibba020 bash[25448]: audit 2021-03-10T17:40:44.800349+0000 mgr.gibba020.yqfnwy (mgr.34427) 11998 : audit [DBG] from='client.62083 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:40:45.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:45 gibba020 bash[25448]: audit 2021-03-10T17:40:45.061310+0000 mon.a (mon.0) 4186 : audit [DBG] from='client.? 172.21.2.113:0/3249912714' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:40:47.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:47 gibba020 bash[25448]: cluster 2021-03-10T17:40:46.438261+0000 mgr.gibba020.yqfnwy (mgr.34427) 11999 : cluster [DBG] pgmap v6840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:47.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:47 gibba013 bash[29418]: cluster 2021-03-10T17:40:46.438261+0000 mgr.gibba020.yqfnwy (mgr.34427) 11999 : cluster [DBG] pgmap v6840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:47.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:47 gibba013 bash[30381]: cluster 2021-03-10T17:40:46.438261+0000 mgr.gibba020.yqfnwy (mgr.34427) 11999 : cluster [DBG] pgmap v6840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:49.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:49 gibba013 bash[29418]: cluster 2021-03-10T17:40:48.439552+0000 mgr.gibba020.yqfnwy (mgr.34427) 12000 : cluster [DBG] pgmap v6841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:49.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:49 gibba013 bash[30381]: cluster 2021-03-10T17:40:48.439552+0000 mgr.gibba020.yqfnwy (mgr.34427) 12000 : cluster [DBG] pgmap v6841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:49.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:49 gibba020 bash[25448]: cluster 2021-03-10T17:40:48.439552+0000 mgr.gibba020.yqfnwy (mgr.34427) 12000 : cluster [DBG] pgmap v6841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:51.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:51 gibba013 bash[29418]: cluster 2021-03-10T17:40:50.441023+0000 mgr.gibba020.yqfnwy (mgr.34427) 12001 : cluster [DBG] pgmap v6842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:51.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:51 gibba013 bash[30381]: cluster 2021-03-10T17:40:50.441023+0000 mgr.gibba020.yqfnwy (mgr.34427) 12001 : cluster [DBG] pgmap v6842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:51.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:51 gibba020 bash[25448]: cluster 2021-03-10T17:40:50.441023+0000 mgr.gibba020.yqfnwy (mgr.34427) 12001 : cluster [DBG] pgmap v6842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:53.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:53 gibba013 bash[29418]: cephadm 2021-03-10T17:40:52.367399+0000 mgr.gibba020.yqfnwy (mgr.34427) 12002 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:40:53.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:53 gibba013 bash[29418]: cluster 2021-03-10T17:40:52.442547+0000 mgr.gibba020.yqfnwy (mgr.34427) 12003 : cluster [DBG] pgmap v6843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:53.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:53 gibba013 bash[30381]: cephadm 2021-03-10T17:40:52.367399+0000 mgr.gibba020.yqfnwy (mgr.34427) 12002 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:40:53.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:53 gibba013 bash[30381]: cluster 2021-03-10T17:40:52.442547+0000 mgr.gibba020.yqfnwy (mgr.34427) 12003 : cluster [DBG] pgmap v6843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:53.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:53 gibba020 bash[25448]: cephadm 2021-03-10T17:40:52.367399+0000 mgr.gibba020.yqfnwy (mgr.34427) 12002 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:40:53.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:53 gibba020 bash[25448]: cluster 2021-03-10T17:40:52.442547+0000 mgr.gibba020.yqfnwy (mgr.34427) 12003 : cluster [DBG] pgmap v6843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:55.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:55 gibba013 bash[29418]: cluster 2021-03-10T17:40:54.443809+0000 mgr.gibba020.yqfnwy (mgr.34427) 12004 : cluster [DBG] pgmap v6844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:55.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:55 gibba013 bash[30381]: cluster 2021-03-10T17:40:54.443809+0000 mgr.gibba020.yqfnwy (mgr.34427) 12004 : cluster [DBG] pgmap v6844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:55.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:55 gibba020 bash[25448]: cluster 2021-03-10T17:40:54.443809+0000 mgr.gibba020.yqfnwy (mgr.34427) 12004 : cluster [DBG] pgmap v6844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:57.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:57 gibba020 bash[25448]: cluster 2021-03-10T17:40:56.445663+0000 mgr.gibba020.yqfnwy (mgr.34427) 12005 : cluster [DBG] pgmap v6845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:57.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:57 gibba013 bash[29418]: cluster 2021-03-10T17:40:56.445663+0000 mgr.gibba020.yqfnwy (mgr.34427) 12005 : cluster [DBG] pgmap v6845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:57.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:57 gibba013 bash[30381]: cluster 2021-03-10T17:40:56.445663+0000 mgr.gibba020.yqfnwy (mgr.34427) 12005 : cluster [DBG] pgmap v6845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:59.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:40:59 gibba013 bash[29418]: cluster 2021-03-10T17:40:58.447018+0000 mgr.gibba020.yqfnwy (mgr.34427) 12006 : cluster [DBG] pgmap v6846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:59.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:40:59 gibba013 bash[30381]: cluster 2021-03-10T17:40:58.447018+0000 mgr.gibba020.yqfnwy (mgr.34427) 12006 : cluster [DBG] pgmap v6846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:40:59.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:40:59 gibba020 bash[25448]: cluster 2021-03-10T17:40:58.447018+0000 mgr.gibba020.yqfnwy (mgr.34427) 12006 : cluster [DBG] pgmap v6846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:01.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:01 gibba013 bash[29418]: cluster 2021-03-10T17:41:00.448637+0000 mgr.gibba020.yqfnwy (mgr.34427) 12007 : cluster [DBG] pgmap v6847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:01.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:01 gibba013 bash[30381]: cluster 2021-03-10T17:41:00.448637+0000 mgr.gibba020.yqfnwy (mgr.34427) 12007 : cluster [DBG] pgmap v6847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:01.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:01 gibba020 bash[25448]: cluster 2021-03-10T17:41:00.448637+0000 mgr.gibba020.yqfnwy (mgr.34427) 12007 : cluster [DBG] pgmap v6847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:03.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:03 gibba013 bash[29418]: cluster 2021-03-10T17:41:02.449864+0000 mgr.gibba020.yqfnwy (mgr.34427) 12008 : cluster [DBG] pgmap v6848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:03.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:03 gibba013 bash[30381]: cluster 2021-03-10T17:41:02.449864+0000 mgr.gibba020.yqfnwy (mgr.34427) 12008 : cluster [DBG] pgmap v6848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:03.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:03 gibba020 bash[25448]: cluster 2021-03-10T17:41:02.449864+0000 mgr.gibba020.yqfnwy (mgr.34427) 12008 : cluster [DBG] pgmap v6848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:05.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:05 gibba013 bash[29418]: cluster 2021-03-10T17:41:04.451396+0000 mgr.gibba020.yqfnwy (mgr.34427) 12009 : cluster [DBG] pgmap v6849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:05.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:05 gibba013 bash[30381]: cluster 2021-03-10T17:41:04.451396+0000 mgr.gibba020.yqfnwy (mgr.34427) 12009 : cluster [DBG] pgmap v6849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:05.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:05 gibba020 bash[25448]: cluster 2021-03-10T17:41:04.451396+0000 mgr.gibba020.yqfnwy (mgr.34427) 12009 : cluster [DBG] pgmap v6849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:07.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:07 gibba020 bash[25448]: cluster 2021-03-10T17:41:06.452301+0000 mgr.gibba020.yqfnwy (mgr.34427) 12010 : cluster [DBG] pgmap v6850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:07.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:07 gibba020 bash[25448]: audit 2021-03-10T17:41:07.059099+0000 mon.a (mon.0) 4187 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:41:07.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:07 gibba020 bash[25448]: audit 2021-03-10T17:41:07.323154+0000 mon.a (mon.0) 4188 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:41:07.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:07 gibba020 bash[25448]: audit 2021-03-10T17:41:07.384912+0000 mon.a (mon.0) 4189 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:41:07.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:07 gibba013 bash[29418]: cluster 2021-03-10T17:41:06.452301+0000 mgr.gibba020.yqfnwy (mgr.34427) 12010 : cluster [DBG] pgmap v6850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:07.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:07 gibba013 bash[29418]: audit 2021-03-10T17:41:07.059099+0000 mon.a (mon.0) 4187 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:41:07.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:07 gibba013 bash[29418]: audit 2021-03-10T17:41:07.323154+0000 mon.a (mon.0) 4188 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:41:07.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:07 gibba013 bash[29418]: audit 2021-03-10T17:41:07.384912+0000 mon.a (mon.0) 4189 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:41:07.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:07 gibba013 bash[30381]: cluster 2021-03-10T17:41:06.452301+0000 mgr.gibba020.yqfnwy (mgr.34427) 12010 : cluster [DBG] pgmap v6850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:07.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:07 gibba013 bash[30381]: audit 2021-03-10T17:41:07.059099+0000 mon.a (mon.0) 4187 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:41:07.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:07 gibba013 bash[30381]: audit 2021-03-10T17:41:07.323154+0000 mon.a (mon.0) 4188 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:41:07.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:07 gibba013 bash[30381]: audit 2021-03-10T17:41:07.384912+0000 mon.a (mon.0) 4189 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:41:08.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[29418]: cephadm 2021-03-10T17:41:07.390046+0000 mgr.gibba020.yqfnwy (mgr.34427) 12011 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:41:08.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[29418]: cephadm 2021-03-10T17:41:07.391968+0000 mgr.gibba020.yqfnwy (mgr.34427) 12012 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:41:08.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[29418]: audit 2021-03-10T17:41:07.621575+0000 mon.a (mon.0) 4190 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:41:08.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[29418]: cephadm 2021-03-10T17:41:07.628704+0000 mgr.gibba020.yqfnwy (mgr.34427) 12013 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:41:08.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[29418]: audit 2021-03-10T17:41:07.630172+0000 mon.a (mon.0) 4191 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:41:08.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[29418]: cephadm 2021-03-10T17:41:07.631059+0000 mgr.gibba020.yqfnwy (mgr.34427) 12014 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:41:08.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[29418]: audit 2021-03-10T17:41:07.632173+0000 mon.a (mon.0) 4192 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:08.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[29418]: cephadm 2021-03-10T17:41:07.632683+0000 mgr.gibba020.yqfnwy (mgr.34427) 12015 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:41:08.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[29418]: cephadm 2021-03-10T17:41:07.632722+0000 mgr.gibba020.yqfnwy (mgr.34427) 12016 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:41:08.884 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[29418]: audit 2021-03-10T17:41:07.633717+0000 mon.a (mon.0) 4193 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:08.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[29418]: cephadm 2021-03-10T17:41:07.634348+0000 mgr.gibba020.yqfnwy (mgr.34427) 12017 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:41:08.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[29418]: cephadm 2021-03-10T17:41:07.634388+0000 mgr.gibba020.yqfnwy (mgr.34427) 12018 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:41:08.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[29418]: audit 2021-03-10T17:41:07.635535+0000 mon.a (mon.0) 4194 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:08.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[29418]: cephadm 2021-03-10T17:41:07.636220+0000 mgr.gibba020.yqfnwy (mgr.34427) 12019 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:41:08.885 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[29418]: cephadm 2021-03-10T17:41:07.637809+0000 mgr.gibba020.yqfnwy (mgr.34427) 12020 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:41:08.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[29418]: cephadm 2021-03-10T17:41:07.637850+0000 mgr.gibba020.yqfnwy (mgr.34427) 12021 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:41:08.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[29418]: audit 2021-03-10T17:41:07.638996+0000 mon.a (mon.0) 4195 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:08.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[29418]: cephadm 2021-03-10T17:41:07.639505+0000 mgr.gibba020.yqfnwy (mgr.34427) 12022 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:41:08.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[29418]: cephadm 2021-03-10T17:41:07.639874+0000 mgr.gibba020.yqfnwy (mgr.34427) 12023 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:41:08.886 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[29418]: audit 2021-03-10T17:41:07.640842+0000 mon.a (mon.0) 4196 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:08.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[30381]: cephadm 2021-03-10T17:41:07.390046+0000 mgr.gibba020.yqfnwy (mgr.34427) 12011 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:41:08.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[30381]: cephadm 2021-03-10T17:41:07.391968+0000 mgr.gibba020.yqfnwy (mgr.34427) 12012 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:41:08.887 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[30381]: audit 2021-03-10T17:41:07.621575+0000 mon.a (mon.0) 4190 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:41:08.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[30381]: cephadm 2021-03-10T17:41:07.628704+0000 mgr.gibba020.yqfnwy (mgr.34427) 12013 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:41:08.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[30381]: audit 2021-03-10T17:41:07.630172+0000 mon.a (mon.0) 4191 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:41:08.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[30381]: cephadm 2021-03-10T17:41:07.631059+0000 mgr.gibba020.yqfnwy (mgr.34427) 12014 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:41:08.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[30381]: audit 2021-03-10T17:41:07.632173+0000 mon.a (mon.0) 4192 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:08.888 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[30381]: cephadm 2021-03-10T17:41:07.632683+0000 mgr.gibba020.yqfnwy (mgr.34427) 12015 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:41:08.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[30381]: cephadm 2021-03-10T17:41:07.632722+0000 mgr.gibba020.yqfnwy (mgr.34427) 12016 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:41:08.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[30381]: audit 2021-03-10T17:41:07.633717+0000 mon.a (mon.0) 4193 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:08.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[30381]: cephadm 2021-03-10T17:41:07.634348+0000 mgr.gibba020.yqfnwy (mgr.34427) 12017 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:41:08.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[30381]: cephadm 2021-03-10T17:41:07.634388+0000 mgr.gibba020.yqfnwy (mgr.34427) 12018 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:41:08.889 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[30381]: audit 2021-03-10T17:41:07.635535+0000 mon.a (mon.0) 4194 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:08.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[30381]: cephadm 2021-03-10T17:41:07.636220+0000 mgr.gibba020.yqfnwy (mgr.34427) 12019 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:41:08.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[30381]: cephadm 2021-03-10T17:41:07.637809+0000 mgr.gibba020.yqfnwy (mgr.34427) 12020 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:41:08.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[30381]: cephadm 2021-03-10T17:41:07.637850+0000 mgr.gibba020.yqfnwy (mgr.34427) 12021 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:41:08.890 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[30381]: audit 2021-03-10T17:41:07.638996+0000 mon.a (mon.0) 4195 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:08.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[30381]: cephadm 2021-03-10T17:41:07.639505+0000 mgr.gibba020.yqfnwy (mgr.34427) 12022 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:41:08.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[30381]: cephadm 2021-03-10T17:41:07.639874+0000 mgr.gibba020.yqfnwy (mgr.34427) 12023 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:41:08.891 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[30381]: audit 2021-03-10T17:41:07.640842+0000 mon.a (mon.0) 4196 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:08.892 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[29418]: cephadm 2021-03-10T17:41:07.641368+0000 mgr.gibba020.yqfnwy (mgr.34427) 12024 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:41:08.892 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[29418]: cephadm 2021-03-10T17:41:07.641415+0000 mgr.gibba020.yqfnwy (mgr.34427) 12025 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:41:08.892 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[29418]: cephadm 2021-03-10T17:41:07.641557+0000 mgr.gibba020.yqfnwy (mgr.34427) 12026 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:41:08.893 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[29418]: audit 2021-03-10T17:41:07.817814+0000 mon.a (mon.0) 4197 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:41:08.893 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[29418]: audit 2021-03-10T17:41:07.818624+0000 mon.a (mon.0) 4198 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:41:08.893 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[29418]: audit 2021-03-10T17:41:07.819516+0000 mon.a (mon.0) 4199 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T17:41:08.893 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[29418]: audit 2021-03-10T17:41:07.820165+0000 mon.a (mon.0) 4200 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:41:08.894 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[30381]: cephadm 2021-03-10T17:41:07.641368+0000 mgr.gibba020.yqfnwy (mgr.34427) 12024 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:41:08.894 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[30381]: cephadm 2021-03-10T17:41:07.641415+0000 mgr.gibba020.yqfnwy (mgr.34427) 12025 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:41:08.894 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[30381]: cephadm 2021-03-10T17:41:07.641557+0000 mgr.gibba020.yqfnwy (mgr.34427) 12026 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:41:08.894 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[30381]: audit 2021-03-10T17:41:07.817814+0000 mon.a (mon.0) 4197 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:41:08.895 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[30381]: audit 2021-03-10T17:41:07.818624+0000 mon.a (mon.0) 4198 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:41:08.895 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[30381]: audit 2021-03-10T17:41:07.819516+0000 mon.a (mon.0) 4199 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T17:41:08.895 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:08 gibba013 bash[30381]: audit 2021-03-10T17:41:07.820165+0000 mon.a (mon.0) 4200 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:41:08.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:08 gibba020 bash[25448]: cephadm 2021-03-10T17:41:07.390046+0000 mgr.gibba020.yqfnwy (mgr.34427) 12011 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:41:08.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:08 gibba020 bash[25448]: cephadm 2021-03-10T17:41:07.391968+0000 mgr.gibba020.yqfnwy (mgr.34427) 12012 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:41:08.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:08 gibba020 bash[25448]: audit 2021-03-10T17:41:07.621575+0000 mon.a (mon.0) 4190 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:41:08.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:08 gibba020 bash[25448]: cephadm 2021-03-10T17:41:07.628704+0000 mgr.gibba020.yqfnwy (mgr.34427) 12013 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:41:08.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:08 gibba020 bash[25448]: audit 2021-03-10T17:41:07.630172+0000 mon.a (mon.0) 4191 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:41:08.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:08 gibba020 bash[25448]: cephadm 2021-03-10T17:41:07.631059+0000 mgr.gibba020.yqfnwy (mgr.34427) 12014 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:41:08.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:08 gibba020 bash[25448]: audit 2021-03-10T17:41:07.632173+0000 mon.a (mon.0) 4192 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:08.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:08 gibba020 bash[25448]: cephadm 2021-03-10T17:41:07.632683+0000 mgr.gibba020.yqfnwy (mgr.34427) 12015 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:41:08.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:08 gibba020 bash[25448]: cephadm 2021-03-10T17:41:07.632722+0000 mgr.gibba020.yqfnwy (mgr.34427) 12016 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:41:08.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:08 gibba020 bash[25448]: audit 2021-03-10T17:41:07.633717+0000 mon.a (mon.0) 4193 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:08.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:08 gibba020 bash[25448]: cephadm 2021-03-10T17:41:07.634348+0000 mgr.gibba020.yqfnwy (mgr.34427) 12017 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:41:08.953 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:08 gibba020 bash[25448]: cephadm 2021-03-10T17:41:07.634388+0000 mgr.gibba020.yqfnwy (mgr.34427) 12018 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:41:08.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:08 gibba020 bash[25448]: audit 2021-03-10T17:41:07.635535+0000 mon.a (mon.0) 4194 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:08.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:08 gibba020 bash[25448]: cephadm 2021-03-10T17:41:07.636220+0000 mgr.gibba020.yqfnwy (mgr.34427) 12019 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:41:08.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:08 gibba020 bash[25448]: cephadm 2021-03-10T17:41:07.637809+0000 mgr.gibba020.yqfnwy (mgr.34427) 12020 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:41:08.954 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:08 gibba020 bash[25448]: cephadm 2021-03-10T17:41:07.637850+0000 mgr.gibba020.yqfnwy (mgr.34427) 12021 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:41:08.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:08 gibba020 bash[25448]: audit 2021-03-10T17:41:07.638996+0000 mon.a (mon.0) 4195 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:08.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:08 gibba020 bash[25448]: cephadm 2021-03-10T17:41:07.639505+0000 mgr.gibba020.yqfnwy (mgr.34427) 12022 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:41:08.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:08 gibba020 bash[25448]: cephadm 2021-03-10T17:41:07.639874+0000 mgr.gibba020.yqfnwy (mgr.34427) 12023 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:41:08.955 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:08 gibba020 bash[25448]: audit 2021-03-10T17:41:07.640842+0000 mon.a (mon.0) 4196 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:08.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:08 gibba020 bash[25448]: cephadm 2021-03-10T17:41:07.641368+0000 mgr.gibba020.yqfnwy (mgr.34427) 12024 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:41:08.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:08 gibba020 bash[25448]: cephadm 2021-03-10T17:41:07.641415+0000 mgr.gibba020.yqfnwy (mgr.34427) 12025 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:41:08.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:08 gibba020 bash[25448]: cephadm 2021-03-10T17:41:07.641557+0000 mgr.gibba020.yqfnwy (mgr.34427) 12026 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:41:08.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:08 gibba020 bash[25448]: audit 2021-03-10T17:41:07.817814+0000 mon.a (mon.0) 4197 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T17:41:08.956 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:08 gibba020 bash[25448]: audit 2021-03-10T17:41:07.818624+0000 mon.a (mon.0) 4198 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T17:41:08.957 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:08 gibba020 bash[25448]: audit 2021-03-10T17:41:07.819516+0000 mon.a (mon.0) 4199 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T17:41:08.957 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:08 gibba020 bash[25448]: audit 2021-03-10T17:41:07.820165+0000 mon.a (mon.0) 4200 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T17:41:09.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:09 gibba020 bash[25448]: cluster 2021-03-10T17:41:08.453620+0000 mgr.gibba020.yqfnwy (mgr.34427) 12027 : cluster [DBG] pgmap v6851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:10.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:09 gibba013 bash[29418]: cluster 2021-03-10T17:41:08.453620+0000 mgr.gibba020.yqfnwy (mgr.34427) 12027 : cluster [DBG] pgmap v6851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:10.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:09 gibba013 bash[30381]: cluster 2021-03-10T17:41:08.453620+0000 mgr.gibba020.yqfnwy (mgr.34427) 12027 : cluster [DBG] pgmap v6851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:11.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:11 gibba020 bash[25448]: cluster 2021-03-10T17:41:10.455129+0000 mgr.gibba020.yqfnwy (mgr.34427) 12028 : cluster [DBG] pgmap v6852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:12.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:11 gibba013 bash[29418]: cluster 2021-03-10T17:41:10.455129+0000 mgr.gibba020.yqfnwy (mgr.34427) 12028 : cluster [DBG] pgmap v6852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:12.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:11 gibba013 bash[30381]: cluster 2021-03-10T17:41:10.455129+0000 mgr.gibba020.yqfnwy (mgr.34427) 12028 : cluster [DBG] pgmap v6852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:13.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:13 gibba020 bash[25448]: cluster 2021-03-10T17:41:12.456547+0000 mgr.gibba020.yqfnwy (mgr.34427) 12029 : cluster [DBG] pgmap v6853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:14.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:13 gibba013 bash[29418]: cluster 2021-03-10T17:41:12.456547+0000 mgr.gibba020.yqfnwy (mgr.34427) 12029 : cluster [DBG] pgmap v6853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:14.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:13 gibba013 bash[30381]: cluster 2021-03-10T17:41:12.456547+0000 mgr.gibba020.yqfnwy (mgr.34427) 12029 : cluster [DBG] pgmap v6853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:15.306 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:41:15.534 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:41:15.534 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 9m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:41:15.535 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 8m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:41:15.535 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:41:15.535 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:41:15.535 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:41:15.536 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:41:15.536 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:41:15.536 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:41:15.536 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:41:15.537 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:41:15.537 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:41:15.537 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:41:15.537 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:41:15.537 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:41:15.538 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:41:15.538 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:41:15.538 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:41:15.538 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:41:15.539 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 8m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:41:15.539 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 8m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:41:15.803 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:41:15.804 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:41:15.804 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:41:15.805 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:41:15.805 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:41:15.805 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:41:15.806 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:41:15.806 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:41:15.807 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:41:15.807 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:41:15.808 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:41:15.808 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:41:15.808 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:41:15.809 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:41:15.809 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:41:15.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:15 gibba020 bash[25448]: cluster 2021-03-10T17:41:14.457766+0000 mgr.gibba020.yqfnwy (mgr.34427) 12030 : cluster [DBG] pgmap v6854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:16.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:15 gibba013 bash[29418]: cluster 2021-03-10T17:41:14.457766+0000 mgr.gibba020.yqfnwy (mgr.34427) 12030 : cluster [DBG] pgmap v6854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:16.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:15 gibba013 bash[30381]: cluster 2021-03-10T17:41:14.457766+0000 mgr.gibba020.yqfnwy (mgr.34427) 12030 : cluster [DBG] pgmap v6854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:16.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:16 gibba020 bash[25448]: audit 2021-03-10T17:41:15.294411+0000 mgr.gibba020.yqfnwy (mgr.34427) 12031 : audit [DBG] from='client.62095 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:41:16.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:16 gibba020 bash[25448]: audit 2021-03-10T17:41:15.518922+0000 mgr.gibba020.yqfnwy (mgr.34427) 12032 : audit [DBG] from='client.52122 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:41:16.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:16 gibba020 bash[25448]: audit 2021-03-10T17:41:15.800425+0000 mon.a (mon.0) 4201 : audit [DBG] from='client.? 172.21.2.113:0/1696129278' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:17.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:16 gibba013 bash[29418]: audit 2021-03-10T17:41:15.294411+0000 mgr.gibba020.yqfnwy (mgr.34427) 12031 : audit [DBG] from='client.62095 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:41:17.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:16 gibba013 bash[29418]: audit 2021-03-10T17:41:15.518922+0000 mgr.gibba020.yqfnwy (mgr.34427) 12032 : audit [DBG] from='client.52122 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:41:17.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:16 gibba013 bash[29418]: audit 2021-03-10T17:41:15.800425+0000 mon.a (mon.0) 4201 : audit [DBG] from='client.? 172.21.2.113:0/1696129278' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:17.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:16 gibba013 bash[30381]: audit 2021-03-10T17:41:15.294411+0000 mgr.gibba020.yqfnwy (mgr.34427) 12031 : audit [DBG] from='client.62095 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:41:17.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:16 gibba013 bash[30381]: audit 2021-03-10T17:41:15.518922+0000 mgr.gibba020.yqfnwy (mgr.34427) 12032 : audit [DBG] from='client.52122 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:41:17.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:16 gibba013 bash[30381]: audit 2021-03-10T17:41:15.800425+0000 mon.a (mon.0) 4201 : audit [DBG] from='client.? 172.21.2.113:0/1696129278' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:17.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:17 gibba020 bash[25448]: cluster 2021-03-10T17:41:16.458608+0000 mgr.gibba020.yqfnwy (mgr.34427) 12033 : cluster [DBG] pgmap v6855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:18.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:17 gibba013 bash[29418]: cluster 2021-03-10T17:41:16.458608+0000 mgr.gibba020.yqfnwy (mgr.34427) 12033 : cluster [DBG] pgmap v6855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:18.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:17 gibba013 bash[30381]: cluster 2021-03-10T17:41:16.458608+0000 mgr.gibba020.yqfnwy (mgr.34427) 12033 : cluster [DBG] pgmap v6855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:19.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:19 gibba020 bash[25448]: cluster 2021-03-10T17:41:18.460061+0000 mgr.gibba020.yqfnwy (mgr.34427) 12034 : cluster [DBG] pgmap v6856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:20.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:19 gibba013 bash[29418]: cluster 2021-03-10T17:41:18.460061+0000 mgr.gibba020.yqfnwy (mgr.34427) 12034 : cluster [DBG] pgmap v6856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:20.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:19 gibba013 bash[30381]: cluster 2021-03-10T17:41:18.460061+0000 mgr.gibba020.yqfnwy (mgr.34427) 12034 : cluster [DBG] pgmap v6856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:21.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:21 gibba020 bash[25448]: cluster 2021-03-10T17:41:20.461709+0000 mgr.gibba020.yqfnwy (mgr.34427) 12035 : cluster [DBG] pgmap v6857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:22.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:21 gibba013 bash[29418]: cluster 2021-03-10T17:41:20.461709+0000 mgr.gibba020.yqfnwy (mgr.34427) 12035 : cluster [DBG] pgmap v6857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:22.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:21 gibba013 bash[30381]: cluster 2021-03-10T17:41:20.461709+0000 mgr.gibba020.yqfnwy (mgr.34427) 12035 : cluster [DBG] pgmap v6857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:23.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:23 gibba020 bash[25448]: cluster 2021-03-10T17:41:22.463206+0000 mgr.gibba020.yqfnwy (mgr.34427) 12036 : cluster [DBG] pgmap v6858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:23.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:23 gibba020 bash[25448]: cephadm 2021-03-10T17:41:22.645282+0000 mgr.gibba020.yqfnwy (mgr.34427) 12037 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:41:24.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:23 gibba013 bash[29418]: cluster 2021-03-10T17:41:22.463206+0000 mgr.gibba020.yqfnwy (mgr.34427) 12036 : cluster [DBG] pgmap v6858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:24.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:23 gibba013 bash[29418]: cephadm 2021-03-10T17:41:22.645282+0000 mgr.gibba020.yqfnwy (mgr.34427) 12037 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:41:24.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:23 gibba013 bash[30381]: cluster 2021-03-10T17:41:22.463206+0000 mgr.gibba020.yqfnwy (mgr.34427) 12036 : cluster [DBG] pgmap v6858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:24.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:23 gibba013 bash[30381]: cephadm 2021-03-10T17:41:22.645282+0000 mgr.gibba020.yqfnwy (mgr.34427) 12037 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:41:26.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:25 gibba013 bash[29418]: cluster 2021-03-10T17:41:24.464740+0000 mgr.gibba020.yqfnwy (mgr.34427) 12038 : cluster [DBG] pgmap v6859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:26.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:25 gibba013 bash[30381]: cluster 2021-03-10T17:41:24.464740+0000 mgr.gibba020.yqfnwy (mgr.34427) 12038 : cluster [DBG] pgmap v6859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:26.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:25 gibba020 bash[25448]: cluster 2021-03-10T17:41:24.464740+0000 mgr.gibba020.yqfnwy (mgr.34427) 12038 : cluster [DBG] pgmap v6859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:27.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:27 gibba013 bash[29418]: cluster 2021-03-10T17:41:26.465549+0000 mgr.gibba020.yqfnwy (mgr.34427) 12039 : cluster [DBG] pgmap v6860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:27.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:27 gibba013 bash[30381]: cluster 2021-03-10T17:41:26.465549+0000 mgr.gibba020.yqfnwy (mgr.34427) 12039 : cluster [DBG] pgmap v6860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:27.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:27 gibba020 bash[25448]: cluster 2021-03-10T17:41:26.465549+0000 mgr.gibba020.yqfnwy (mgr.34427) 12039 : cluster [DBG] pgmap v6860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:29.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:29 gibba013 bash[29418]: cluster 2021-03-10T17:41:28.466833+0000 mgr.gibba020.yqfnwy (mgr.34427) 12040 : cluster [DBG] pgmap v6861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:29.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:29 gibba013 bash[30381]: cluster 2021-03-10T17:41:28.466833+0000 mgr.gibba020.yqfnwy (mgr.34427) 12040 : cluster [DBG] pgmap v6861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:29.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:29 gibba020 bash[25448]: cluster 2021-03-10T17:41:28.466833+0000 mgr.gibba020.yqfnwy (mgr.34427) 12040 : cluster [DBG] pgmap v6861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:31.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:31 gibba013 bash[29418]: cluster 2021-03-10T17:41:30.468494+0000 mgr.gibba020.yqfnwy (mgr.34427) 12041 : cluster [DBG] pgmap v6862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:31.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:31 gibba013 bash[30381]: cluster 2021-03-10T17:41:30.468494+0000 mgr.gibba020.yqfnwy (mgr.34427) 12041 : cluster [DBG] pgmap v6862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:31.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:31 gibba020 bash[25448]: cluster 2021-03-10T17:41:30.468494+0000 mgr.gibba020.yqfnwy (mgr.34427) 12041 : cluster [DBG] pgmap v6862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:33.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:33 gibba013 bash[29418]: cluster 2021-03-10T17:41:32.469895+0000 mgr.gibba020.yqfnwy (mgr.34427) 12042 : cluster [DBG] pgmap v6863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:33.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:33 gibba013 bash[30381]: cluster 2021-03-10T17:41:32.469895+0000 mgr.gibba020.yqfnwy (mgr.34427) 12042 : cluster [DBG] pgmap v6863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:33.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:33 gibba020 bash[25448]: cluster 2021-03-10T17:41:32.469895+0000 mgr.gibba020.yqfnwy (mgr.34427) 12042 : cluster [DBG] pgmap v6863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:35.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:35 gibba013 bash[29418]: cluster 2021-03-10T17:41:34.471156+0000 mgr.gibba020.yqfnwy (mgr.34427) 12043 : cluster [DBG] pgmap v6864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:35.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:35 gibba013 bash[30381]: cluster 2021-03-10T17:41:34.471156+0000 mgr.gibba020.yqfnwy (mgr.34427) 12043 : cluster [DBG] pgmap v6864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:35.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:35 gibba020 bash[25448]: cluster 2021-03-10T17:41:34.471156+0000 mgr.gibba020.yqfnwy (mgr.34427) 12043 : cluster [DBG] pgmap v6864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:37.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:37 gibba013 bash[29418]: cluster 2021-03-10T17:41:36.472026+0000 mgr.gibba020.yqfnwy (mgr.34427) 12044 : cluster [DBG] pgmap v6865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:37.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:37 gibba013 bash[30381]: cluster 2021-03-10T17:41:36.472026+0000 mgr.gibba020.yqfnwy (mgr.34427) 12044 : cluster [DBG] pgmap v6865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:37.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:37 gibba020 bash[25448]: cluster 2021-03-10T17:41:36.472026+0000 mgr.gibba020.yqfnwy (mgr.34427) 12044 : cluster [DBG] pgmap v6865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:38.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:38 gibba013 bash[29418]: cephadm 2021-03-10T17:41:37.661042+0000 mgr.gibba020.yqfnwy (mgr.34427) 12045 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:41:38.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:38 gibba013 bash[30381]: cephadm 2021-03-10T17:41:37.661042+0000 mgr.gibba020.yqfnwy (mgr.34427) 12045 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:41:38.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:38 gibba020 bash[25448]: cephadm 2021-03-10T17:41:37.661042+0000 mgr.gibba020.yqfnwy (mgr.34427) 12045 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:41:39.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:39 gibba013 bash[29418]: cluster 2021-03-10T17:41:38.472379+0000 mgr.gibba020.yqfnwy (mgr.34427) 12046 : cluster [DBG] pgmap v6866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:39.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:39 gibba013 bash[30381]: cluster 2021-03-10T17:41:38.472379+0000 mgr.gibba020.yqfnwy (mgr.34427) 12046 : cluster [DBG] pgmap v6866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:39.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:39 gibba020 bash[25448]: cluster 2021-03-10T17:41:38.472379+0000 mgr.gibba020.yqfnwy (mgr.34427) 12046 : cluster [DBG] pgmap v6866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:41.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:41 gibba013 bash[29418]: cluster 2021-03-10T17:41:40.473737+0000 mgr.gibba020.yqfnwy (mgr.34427) 12047 : cluster [DBG] pgmap v6867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:41.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:41 gibba013 bash[30381]: cluster 2021-03-10T17:41:40.473737+0000 mgr.gibba020.yqfnwy (mgr.34427) 12047 : cluster [DBG] pgmap v6867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:41.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:41 gibba020 bash[25448]: cluster 2021-03-10T17:41:40.473737+0000 mgr.gibba020.yqfnwy (mgr.34427) 12047 : cluster [DBG] pgmap v6867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:43.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:43 gibba013 bash[29418]: cluster 2021-03-10T17:41:42.474984+0000 mgr.gibba020.yqfnwy (mgr.34427) 12048 : cluster [DBG] pgmap v6868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:43.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:43 gibba013 bash[30381]: cluster 2021-03-10T17:41:42.474984+0000 mgr.gibba020.yqfnwy (mgr.34427) 12048 : cluster [DBG] pgmap v6868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:43.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:43 gibba020 bash[25448]: cluster 2021-03-10T17:41:42.474984+0000 mgr.gibba020.yqfnwy (mgr.34427) 12048 : cluster [DBG] pgmap v6868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:45.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:45 gibba013 bash[29418]: cluster 2021-03-10T17:41:44.476424+0000 mgr.gibba020.yqfnwy (mgr.34427) 12049 : cluster [DBG] pgmap v6869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:45.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:45 gibba013 bash[30381]: cluster 2021-03-10T17:41:44.476424+0000 mgr.gibba020.yqfnwy (mgr.34427) 12049 : cluster [DBG] pgmap v6869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:45.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:45 gibba020 bash[25448]: cluster 2021-03-10T17:41:44.476424+0000 mgr.gibba020.yqfnwy (mgr.34427) 12049 : cluster [DBG] pgmap v6869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:46.047 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:41:46.274 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:41:46.274 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 9m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:41:46.275 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 8m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:41:46.275 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:41:46.275 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:41:46.275 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:41:46.276 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:41:46.276 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:41:46.276 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:41:46.276 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:41:46.276 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 8m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:41:46.277 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:41:46.277 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:41:46.277 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:41:46.277 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:41:46.278 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:41:46.278 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:41:46.278 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:41:46.278 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 8m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:41:46.278 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 8m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:41:46.279 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 8m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:41:46.525 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:41:46.525 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:41:46.525 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:41:46.525 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:41:46.526 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:41:46.526 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:41:46.526 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:41:46.526 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:41:46.527 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:41:46.527 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:41:46.527 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:41:46.527 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:41:46.527 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:41:46.528 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:41:46.528 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:41:46.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:46 gibba013 bash[29418]: audit 2021-03-10T17:41:46.035123+0000 mgr.gibba020.yqfnwy (mgr.34427) 12050 : audit [DBG] from='client.52134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:41:46.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:46 gibba013 bash[29418]: audit 2021-03-10T17:41:46.257771+0000 mgr.gibba020.yqfnwy (mgr.34427) 12051 : audit [DBG] from='client.52140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:41:46.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:46 gibba013 bash[29418]: audit 2021-03-10T17:41:46.522311+0000 mon.a (mon.0) 4202 : audit [DBG] from='client.? 172.21.2.113:0/789627218' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:46.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:46 gibba013 bash[30381]: audit 2021-03-10T17:41:46.035123+0000 mgr.gibba020.yqfnwy (mgr.34427) 12050 : audit [DBG] from='client.52134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:41:46.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:46 gibba013 bash[30381]: audit 2021-03-10T17:41:46.257771+0000 mgr.gibba020.yqfnwy (mgr.34427) 12051 : audit [DBG] from='client.52140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:41:46.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:46 gibba013 bash[30381]: audit 2021-03-10T17:41:46.522311+0000 mon.a (mon.0) 4202 : audit [DBG] from='client.? 172.21.2.113:0/789627218' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:46.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:46 gibba020 bash[25448]: audit 2021-03-10T17:41:46.035123+0000 mgr.gibba020.yqfnwy (mgr.34427) 12050 : audit [DBG] from='client.52134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:41:46.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:46 gibba020 bash[25448]: audit 2021-03-10T17:41:46.257771+0000 mgr.gibba020.yqfnwy (mgr.34427) 12051 : audit [DBG] from='client.52140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:41:46.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:46 gibba020 bash[25448]: audit 2021-03-10T17:41:46.522311+0000 mon.a (mon.0) 4202 : audit [DBG] from='client.? 172.21.2.113:0/789627218' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:41:47.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:47 gibba013 bash[29418]: cluster 2021-03-10T17:41:46.477156+0000 mgr.gibba020.yqfnwy (mgr.34427) 12052 : cluster [DBG] pgmap v6870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:47.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:47 gibba013 bash[30381]: cluster 2021-03-10T17:41:46.477156+0000 mgr.gibba020.yqfnwy (mgr.34427) 12052 : cluster [DBG] pgmap v6870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:47.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:47 gibba020 bash[25448]: cluster 2021-03-10T17:41:46.477156+0000 mgr.gibba020.yqfnwy (mgr.34427) 12052 : cluster [DBG] pgmap v6870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:49.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:49 gibba013 bash[29418]: cluster 2021-03-10T17:41:48.478691+0000 mgr.gibba020.yqfnwy (mgr.34427) 12053 : cluster [DBG] pgmap v6871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:49.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:49 gibba013 bash[30381]: cluster 2021-03-10T17:41:48.478691+0000 mgr.gibba020.yqfnwy (mgr.34427) 12053 : cluster [DBG] pgmap v6871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:49.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:49 gibba020 bash[25448]: cluster 2021-03-10T17:41:48.478691+0000 mgr.gibba020.yqfnwy (mgr.34427) 12053 : cluster [DBG] pgmap v6871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:51.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:51 gibba013 bash[29418]: cluster 2021-03-10T17:41:50.480287+0000 mgr.gibba020.yqfnwy (mgr.34427) 12054 : cluster [DBG] pgmap v6872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:51.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:51 gibba013 bash[30381]: cluster 2021-03-10T17:41:50.480287+0000 mgr.gibba020.yqfnwy (mgr.34427) 12054 : cluster [DBG] pgmap v6872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:51.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:51 gibba020 bash[25448]: cluster 2021-03-10T17:41:50.480287+0000 mgr.gibba020.yqfnwy (mgr.34427) 12054 : cluster [DBG] pgmap v6872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:53.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:53 gibba013 bash[29418]: cluster 2021-03-10T17:41:52.481849+0000 mgr.gibba020.yqfnwy (mgr.34427) 12055 : cluster [DBG] pgmap v6873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:53.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:53 gibba013 bash[29418]: cephadm 2021-03-10T17:41:52.669597+0000 mgr.gibba020.yqfnwy (mgr.34427) 12056 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:41:53.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:53 gibba013 bash[30381]: cluster 2021-03-10T17:41:52.481849+0000 mgr.gibba020.yqfnwy (mgr.34427) 12055 : cluster [DBG] pgmap v6873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:53.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:53 gibba013 bash[30381]: cephadm 2021-03-10T17:41:52.669597+0000 mgr.gibba020.yqfnwy (mgr.34427) 12056 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:41:53.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:53 gibba020 bash[25448]: cluster 2021-03-10T17:41:52.481849+0000 mgr.gibba020.yqfnwy (mgr.34427) 12055 : cluster [DBG] pgmap v6873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:53.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:53 gibba020 bash[25448]: cephadm 2021-03-10T17:41:52.669597+0000 mgr.gibba020.yqfnwy (mgr.34427) 12056 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:41:55.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:55 gibba013 bash[29418]: cluster 2021-03-10T17:41:54.483227+0000 mgr.gibba020.yqfnwy (mgr.34427) 12057 : cluster [DBG] pgmap v6874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:55.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:55 gibba013 bash[30381]: cluster 2021-03-10T17:41:54.483227+0000 mgr.gibba020.yqfnwy (mgr.34427) 12057 : cluster [DBG] pgmap v6874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:55.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:55 gibba020 bash[25448]: cluster 2021-03-10T17:41:54.483227+0000 mgr.gibba020.yqfnwy (mgr.34427) 12057 : cluster [DBG] pgmap v6874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:57.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:57 gibba013 bash[29418]: cluster 2021-03-10T17:41:56.484168+0000 mgr.gibba020.yqfnwy (mgr.34427) 12058 : cluster [DBG] pgmap v6875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:57.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:57 gibba013 bash[30381]: cluster 2021-03-10T17:41:56.484168+0000 mgr.gibba020.yqfnwy (mgr.34427) 12058 : cluster [DBG] pgmap v6875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:57.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:57 gibba020 bash[25448]: cluster 2021-03-10T17:41:56.484168+0000 mgr.gibba020.yqfnwy (mgr.34427) 12058 : cluster [DBG] pgmap v6875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:59.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:41:59 gibba013 bash[29418]: cluster 2021-03-10T17:41:58.485422+0000 mgr.gibba020.yqfnwy (mgr.34427) 12059 : cluster [DBG] pgmap v6876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:59.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:41:59 gibba013 bash[30381]: cluster 2021-03-10T17:41:58.485422+0000 mgr.gibba020.yqfnwy (mgr.34427) 12059 : cluster [DBG] pgmap v6876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:41:59.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:41:59 gibba020 bash[25448]: cluster 2021-03-10T17:41:58.485422+0000 mgr.gibba020.yqfnwy (mgr.34427) 12059 : cluster [DBG] pgmap v6876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:01.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:01 gibba013 bash[29418]: cluster 2021-03-10T17:42:00.487186+0000 mgr.gibba020.yqfnwy (mgr.34427) 12060 : cluster [DBG] pgmap v6877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:01.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:01 gibba013 bash[30381]: cluster 2021-03-10T17:42:00.487186+0000 mgr.gibba020.yqfnwy (mgr.34427) 12060 : cluster [DBG] pgmap v6877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:01.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:01 gibba020 bash[25448]: cluster 2021-03-10T17:42:00.487186+0000 mgr.gibba020.yqfnwy (mgr.34427) 12060 : cluster [DBG] pgmap v6877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:03.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:03 gibba013 bash[29418]: cluster 2021-03-10T17:42:02.488640+0000 mgr.gibba020.yqfnwy (mgr.34427) 12061 : cluster [DBG] pgmap v6878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:03.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:03 gibba013 bash[30381]: cluster 2021-03-10T17:42:02.488640+0000 mgr.gibba020.yqfnwy (mgr.34427) 12061 : cluster [DBG] pgmap v6878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:03.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:03 gibba020 bash[25448]: cluster 2021-03-10T17:42:02.488640+0000 mgr.gibba020.yqfnwy (mgr.34427) 12061 : cluster [DBG] pgmap v6878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:05.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:05 gibba013 bash[29418]: cluster 2021-03-10T17:42:04.489906+0000 mgr.gibba020.yqfnwy (mgr.34427) 12062 : cluster [DBG] pgmap v6879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:05.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:05 gibba013 bash[30381]: cluster 2021-03-10T17:42:04.489906+0000 mgr.gibba020.yqfnwy (mgr.34427) 12062 : cluster [DBG] pgmap v6879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:05.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:05 gibba020 bash[25448]: cluster 2021-03-10T17:42:04.489906+0000 mgr.gibba020.yqfnwy (mgr.34427) 12062 : cluster [DBG] pgmap v6879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:07.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:07 gibba013 bash[29418]: cluster 2021-03-10T17:42:06.490955+0000 mgr.gibba020.yqfnwy (mgr.34427) 12063 : cluster [DBG] pgmap v6880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:07.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:07 gibba013 bash[29418]: audit 2021-03-10T17:42:07.064143+0000 mon.a (mon.0) 4203 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:42:07.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:07 gibba013 bash[29418]: audit 2021-03-10T17:42:07.330174+0000 mon.a (mon.0) 4204 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:42:07.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:07 gibba013 bash[30381]: cluster 2021-03-10T17:42:06.490955+0000 mgr.gibba020.yqfnwy (mgr.34427) 12063 : cluster [DBG] pgmap v6880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:07.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:07 gibba013 bash[30381]: audit 2021-03-10T17:42:07.064143+0000 mon.a (mon.0) 4203 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:42:07.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:07 gibba013 bash[30381]: audit 2021-03-10T17:42:07.330174+0000 mon.a (mon.0) 4204 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:42:07.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:07 gibba020 bash[25448]: cluster 2021-03-10T17:42:06.490955+0000 mgr.gibba020.yqfnwy (mgr.34427) 12063 : cluster [DBG] pgmap v6880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:07 gibba020 bash[25448]: audit 2021-03-10T17:42:07.064143+0000 mon.a (mon.0) 4203 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:42:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:07 gibba020 bash[25448]: audit 2021-03-10T17:42:07.330174+0000 mon.a (mon.0) 4204 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:42:08.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:08 gibba013 bash[29418]: audit 2021-03-10T17:42:07.682211+0000 mon.a (mon.0) 4205 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:42:08.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:08 gibba013 bash[29418]: cephadm 2021-03-10T17:42:07.688692+0000 mgr.gibba020.yqfnwy (mgr.34427) 12064 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:42:08.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:08 gibba013 bash[29418]: audit 2021-03-10T17:42:07.689690+0000 mon.a (mon.0) 4206 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:42:08.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:08 gibba013 bash[29418]: audit 2021-03-10T17:42:07.823639+0000 mon.a (mon.0) 4207 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T17:42:08.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:08 gibba013 bash[29418]: audit 2021-03-10T17:42:07.823872+0000 mon.a (mon.0) 4208 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:42:08.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:08 gibba013 bash[29418]: audit 2021-03-10T17:42:07.824015+0000 mon.a (mon.0) 4209 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:42:08.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:08 gibba013 bash[29418]: audit 2021-03-10T17:42:07.824158+0000 mon.a (mon.0) 4210 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:42:08.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:08 gibba013 bash[30381]: audit 2021-03-10T17:42:07.682211+0000 mon.a (mon.0) 4205 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:42:08.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:08 gibba013 bash[30381]: cephadm 2021-03-10T17:42:07.688692+0000 mgr.gibba020.yqfnwy (mgr.34427) 12064 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:42:08.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:08 gibba013 bash[30381]: audit 2021-03-10T17:42:07.689690+0000 mon.a (mon.0) 4206 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:42:08.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:08 gibba013 bash[30381]: audit 2021-03-10T17:42:07.823639+0000 mon.a (mon.0) 4207 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T17:42:08.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:08 gibba013 bash[30381]: audit 2021-03-10T17:42:07.823872+0000 mon.a (mon.0) 4208 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:42:08.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:08 gibba013 bash[30381]: audit 2021-03-10T17:42:07.824015+0000 mon.a (mon.0) 4209 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:42:08.885 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:08 gibba013 bash[30381]: audit 2021-03-10T17:42:07.824158+0000 mon.a (mon.0) 4210 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:42:08.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:08 gibba020 bash[25448]: audit 2021-03-10T17:42:07.682211+0000 mon.a (mon.0) 4205 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:42:08.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:08 gibba020 bash[25448]: cephadm 2021-03-10T17:42:07.688692+0000 mgr.gibba020.yqfnwy (mgr.34427) 12064 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:42:08.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:08 gibba020 bash[25448]: audit 2021-03-10T17:42:07.689690+0000 mon.a (mon.0) 4206 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:42:08.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:08 gibba020 bash[25448]: audit 2021-03-10T17:42:07.823639+0000 mon.a (mon.0) 4207 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T17:42:08.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:08 gibba020 bash[25448]: audit 2021-03-10T17:42:07.823872+0000 mon.a (mon.0) 4208 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T17:42:08.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:08 gibba020 bash[25448]: audit 2021-03-10T17:42:07.824015+0000 mon.a (mon.0) 4209 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T17:42:08.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:08 gibba020 bash[25448]: audit 2021-03-10T17:42:07.824158+0000 mon.a (mon.0) 4210 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T17:42:09.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:09 gibba013 bash[29418]: cluster 2021-03-10T17:42:08.492383+0000 mgr.gibba020.yqfnwy (mgr.34427) 12065 : cluster [DBG] pgmap v6881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:09.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:09 gibba013 bash[30381]: cluster 2021-03-10T17:42:08.492383+0000 mgr.gibba020.yqfnwy (mgr.34427) 12065 : cluster [DBG] pgmap v6881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:09.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:09 gibba020 bash[25448]: cluster 2021-03-10T17:42:08.492383+0000 mgr.gibba020.yqfnwy (mgr.34427) 12065 : cluster [DBG] pgmap v6881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:12.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:12 gibba013 bash[29418]: cluster 2021-03-10T17:42:10.494175+0000 mgr.gibba020.yqfnwy (mgr.34427) 12066 : cluster [DBG] pgmap v6882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:12.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:12 gibba013 bash[29418]: cephadm 2021-03-10T17:42:11.245412+0000 mgr.gibba020.yqfnwy (mgr.34427) 12067 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:42:12.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:12 gibba013 bash[29418]: audit 2021-03-10T17:42:11.245416+0000 mon.a (mon.0) 4211 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:42:12.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:12 gibba013 bash[29418]: audit 2021-03-10T17:42:11.456486+0000 mon.a (mon.0) 4212 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:42:12.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:12 gibba013 bash[29418]: audit 2021-03-10T17:42:11.465764+0000 mon.a (mon.0) 4213 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:42:12.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:12 gibba013 bash[29418]: audit 2021-03-10T17:42:11.467837+0000 mon.a (mon.0) 4214 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:12.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:12 gibba013 bash[29418]: audit 2021-03-10T17:42:11.469504+0000 mon.a (mon.0) 4215 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:12.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:12 gibba013 bash[29418]: audit 2021-03-10T17:42:11.471070+0000 mon.a (mon.0) 4216 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:12.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:12 gibba013 bash[29418]: audit 2021-03-10T17:42:11.474916+0000 mon.a (mon.0) 4217 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:12.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:12 gibba013 bash[29418]: audit 2021-03-10T17:42:11.476992+0000 mon.a (mon.0) 4218 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:12.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:12 gibba013 bash[30381]: cluster 2021-03-10T17:42:10.494175+0000 mgr.gibba020.yqfnwy (mgr.34427) 12066 : cluster [DBG] pgmap v6882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:12.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:12 gibba013 bash[30381]: cephadm 2021-03-10T17:42:11.245412+0000 mgr.gibba020.yqfnwy (mgr.34427) 12067 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:42:12.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:12 gibba013 bash[30381]: audit 2021-03-10T17:42:11.245416+0000 mon.a (mon.0) 4211 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:42:12.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:12 gibba013 bash[30381]: audit 2021-03-10T17:42:11.456486+0000 mon.a (mon.0) 4212 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:42:12.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:12 gibba013 bash[30381]: audit 2021-03-10T17:42:11.465764+0000 mon.a (mon.0) 4213 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:42:12.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:12 gibba013 bash[30381]: audit 2021-03-10T17:42:11.467837+0000 mon.a (mon.0) 4214 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:12.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:12 gibba013 bash[30381]: audit 2021-03-10T17:42:11.469504+0000 mon.a (mon.0) 4215 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:12.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:12 gibba013 bash[30381]: audit 2021-03-10T17:42:11.471070+0000 mon.a (mon.0) 4216 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:12.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:12 gibba013 bash[30381]: audit 2021-03-10T17:42:11.474916+0000 mon.a (mon.0) 4217 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:12.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:12 gibba013 bash[30381]: audit 2021-03-10T17:42:11.476992+0000 mon.a (mon.0) 4218 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:12.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:12 gibba020 bash[25448]: cluster 2021-03-10T17:42:10.494175+0000 mgr.gibba020.yqfnwy (mgr.34427) 12066 : cluster [DBG] pgmap v6882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:12.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:12 gibba020 bash[25448]: cephadm 2021-03-10T17:42:11.245412+0000 mgr.gibba020.yqfnwy (mgr.34427) 12067 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:42:12.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:12 gibba020 bash[25448]: audit 2021-03-10T17:42:11.245416+0000 mon.a (mon.0) 4211 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:42:12.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:12 gibba020 bash[25448]: audit 2021-03-10T17:42:11.456486+0000 mon.a (mon.0) 4212 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:42:12.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:12 gibba020 bash[25448]: audit 2021-03-10T17:42:11.465764+0000 mon.a (mon.0) 4213 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:42:12.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:12 gibba020 bash[25448]: audit 2021-03-10T17:42:11.467837+0000 mon.a (mon.0) 4214 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:12.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:12 gibba020 bash[25448]: audit 2021-03-10T17:42:11.469504+0000 mon.a (mon.0) 4215 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:12.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:12 gibba020 bash[25448]: audit 2021-03-10T17:42:11.471070+0000 mon.a (mon.0) 4216 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:12.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:12 gibba020 bash[25448]: audit 2021-03-10T17:42:11.474916+0000 mon.a (mon.0) 4217 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:12.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:12 gibba020 bash[25448]: audit 2021-03-10T17:42:11.476992+0000 mon.a (mon.0) 4218 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:13.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:13 gibba013 bash[29418]: cephadm 2021-03-10T17:42:11.464231+0000 mgr.gibba020.yqfnwy (mgr.34427) 12068 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:42:13.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:13 gibba013 bash[29418]: cephadm 2021-03-10T17:42:11.466784+0000 mgr.gibba020.yqfnwy (mgr.34427) 12069 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:42:13.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:13 gibba013 bash[29418]: cephadm 2021-03-10T17:42:11.468416+0000 mgr.gibba020.yqfnwy (mgr.34427) 12070 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:42:13.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:13 gibba013 bash[29418]: cephadm 2021-03-10T17:42:11.468462+0000 mgr.gibba020.yqfnwy (mgr.34427) 12071 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:42:13.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:13 gibba013 bash[29418]: cephadm 2021-03-10T17:42:11.470041+0000 mgr.gibba020.yqfnwy (mgr.34427) 12072 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:42:13.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:13 gibba013 bash[29418]: cephadm 2021-03-10T17:42:11.470088+0000 mgr.gibba020.yqfnwy (mgr.34427) 12073 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:42:13.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:13 gibba013 bash[29418]: cephadm 2021-03-10T17:42:11.471735+0000 mgr.gibba020.yqfnwy (mgr.34427) 12074 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:42:13.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:13 gibba013 bash[29418]: cephadm 2021-03-10T17:42:11.473681+0000 mgr.gibba020.yqfnwy (mgr.34427) 12075 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:42:13.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:13 gibba013 bash[29418]: cephadm 2021-03-10T17:42:11.473730+0000 mgr.gibba020.yqfnwy (mgr.34427) 12076 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:42:13.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:13 gibba013 bash[29418]: cephadm 2021-03-10T17:42:11.475508+0000 mgr.gibba020.yqfnwy (mgr.34427) 12077 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:42:13.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:13 gibba013 bash[29418]: cephadm 2021-03-10T17:42:11.476030+0000 mgr.gibba020.yqfnwy (mgr.34427) 12078 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:42:13.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:13 gibba013 bash[29418]: cephadm 2021-03-10T17:42:11.477406+0000 mgr.gibba020.yqfnwy (mgr.34427) 12079 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:42:13.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:13 gibba013 bash[29418]: cephadm 2021-03-10T17:42:11.477451+0000 mgr.gibba020.yqfnwy (mgr.34427) 12080 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:42:13.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:13 gibba013 bash[29418]: cephadm 2021-03-10T17:42:11.477609+0000 mgr.gibba020.yqfnwy (mgr.34427) 12081 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:42:13.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:13 gibba013 bash[30381]: cephadm 2021-03-10T17:42:11.464231+0000 mgr.gibba020.yqfnwy (mgr.34427) 12068 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:42:13.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:13 gibba013 bash[30381]: cephadm 2021-03-10T17:42:11.466784+0000 mgr.gibba020.yqfnwy (mgr.34427) 12069 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:42:13.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:13 gibba013 bash[30381]: cephadm 2021-03-10T17:42:11.468416+0000 mgr.gibba020.yqfnwy (mgr.34427) 12070 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:42:13.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:13 gibba013 bash[30381]: cephadm 2021-03-10T17:42:11.468462+0000 mgr.gibba020.yqfnwy (mgr.34427) 12071 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:42:13.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:13 gibba013 bash[30381]: cephadm 2021-03-10T17:42:11.470041+0000 mgr.gibba020.yqfnwy (mgr.34427) 12072 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:42:13.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:13 gibba013 bash[30381]: cephadm 2021-03-10T17:42:11.470088+0000 mgr.gibba020.yqfnwy (mgr.34427) 12073 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:42:13.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:13 gibba013 bash[30381]: cephadm 2021-03-10T17:42:11.471735+0000 mgr.gibba020.yqfnwy (mgr.34427) 12074 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:42:13.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:13 gibba013 bash[30381]: cephadm 2021-03-10T17:42:11.473681+0000 mgr.gibba020.yqfnwy (mgr.34427) 12075 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:42:13.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:13 gibba013 bash[30381]: cephadm 2021-03-10T17:42:11.473730+0000 mgr.gibba020.yqfnwy (mgr.34427) 12076 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:42:13.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:13 gibba013 bash[30381]: cephadm 2021-03-10T17:42:11.475508+0000 mgr.gibba020.yqfnwy (mgr.34427) 12077 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:42:13.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:13 gibba013 bash[30381]: cephadm 2021-03-10T17:42:11.476030+0000 mgr.gibba020.yqfnwy (mgr.34427) 12078 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:42:13.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:13 gibba013 bash[30381]: cephadm 2021-03-10T17:42:11.477406+0000 mgr.gibba020.yqfnwy (mgr.34427) 12079 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:42:13.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:13 gibba013 bash[30381]: cephadm 2021-03-10T17:42:11.477451+0000 mgr.gibba020.yqfnwy (mgr.34427) 12080 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:42:13.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:13 gibba013 bash[30381]: cephadm 2021-03-10T17:42:11.477609+0000 mgr.gibba020.yqfnwy (mgr.34427) 12081 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:42:13.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:13 gibba020 bash[25448]: cephadm 2021-03-10T17:42:11.464231+0000 mgr.gibba020.yqfnwy (mgr.34427) 12068 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:42:13.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:13 gibba020 bash[25448]: cephadm 2021-03-10T17:42:11.466784+0000 mgr.gibba020.yqfnwy (mgr.34427) 12069 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:42:13.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:13 gibba020 bash[25448]: cephadm 2021-03-10T17:42:11.468416+0000 mgr.gibba020.yqfnwy (mgr.34427) 12070 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:42:13.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:13 gibba020 bash[25448]: cephadm 2021-03-10T17:42:11.468462+0000 mgr.gibba020.yqfnwy (mgr.34427) 12071 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:42:13.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:13 gibba020 bash[25448]: cephadm 2021-03-10T17:42:11.470041+0000 mgr.gibba020.yqfnwy (mgr.34427) 12072 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:42:13.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:13 gibba020 bash[25448]: cephadm 2021-03-10T17:42:11.470088+0000 mgr.gibba020.yqfnwy (mgr.34427) 12073 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:42:13.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:13 gibba020 bash[25448]: cephadm 2021-03-10T17:42:11.471735+0000 mgr.gibba020.yqfnwy (mgr.34427) 12074 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:42:13.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:13 gibba020 bash[25448]: cephadm 2021-03-10T17:42:11.473681+0000 mgr.gibba020.yqfnwy (mgr.34427) 12075 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:42:13.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:13 gibba020 bash[25448]: cephadm 2021-03-10T17:42:11.473730+0000 mgr.gibba020.yqfnwy (mgr.34427) 12076 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:42:13.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:13 gibba020 bash[25448]: cephadm 2021-03-10T17:42:11.475508+0000 mgr.gibba020.yqfnwy (mgr.34427) 12077 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:42:13.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:13 gibba020 bash[25448]: cephadm 2021-03-10T17:42:11.476030+0000 mgr.gibba020.yqfnwy (mgr.34427) 12078 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:42:13.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:13 gibba020 bash[25448]: cephadm 2021-03-10T17:42:11.477406+0000 mgr.gibba020.yqfnwy (mgr.34427) 12079 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:42:13.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:13 gibba020 bash[25448]: cephadm 2021-03-10T17:42:11.477451+0000 mgr.gibba020.yqfnwy (mgr.34427) 12080 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:42:13.703 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:13 gibba020 bash[25448]: cephadm 2021-03-10T17:42:11.477609+0000 mgr.gibba020.yqfnwy (mgr.34427) 12081 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:42:14.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:14 gibba013 bash[29418]: cluster 2021-03-10T17:42:12.495730+0000 mgr.gibba020.yqfnwy (mgr.34427) 12082 : cluster [DBG] pgmap v6883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:14.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:14 gibba013 bash[30381]: cluster 2021-03-10T17:42:12.495730+0000 mgr.gibba020.yqfnwy (mgr.34427) 12082 : cluster [DBG] pgmap v6883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:14.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:14 gibba020 bash[25448]: cluster 2021-03-10T17:42:12.495730+0000 mgr.gibba020.yqfnwy (mgr.34427) 12082 : cluster [DBG] pgmap v6883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:16.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:16 gibba013 bash[30381]: cluster 2021-03-10T17:42:14.497242+0000 mgr.gibba020.yqfnwy (mgr.34427) 12083 : cluster [DBG] pgmap v6884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:16.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:16 gibba013 bash[29418]: cluster 2021-03-10T17:42:14.497242+0000 mgr.gibba020.yqfnwy (mgr.34427) 12083 : cluster [DBG] pgmap v6884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:16.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:16 gibba020 bash[25448]: cluster 2021-03-10T17:42:14.497242+0000 mgr.gibba020.yqfnwy (mgr.34427) 12083 : cluster [DBG] pgmap v6884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:16.772 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:42:16.996 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:42:16.996 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 5s ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:42:16.997 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 9m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:42:16.997 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:42:16.997 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:42:16.997 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 5s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:42:16.998 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 5s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:42:16.998 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:42:16.998 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 5s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:42:16.998 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 5s ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:42:16.998 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:42:16.999 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 5s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:42:16.999 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 5s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:42:16.999 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 5s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:42:16.999 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 5s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:42:16.999 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:42:17.000 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:42:17.000 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:42:17.000 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:42:17.000 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 9m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:42:17.001 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 9m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:42:17.243 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:42:17.243 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:42:17.243 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:42:17.244 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:42:17.244 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:42:17.244 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:42:17.244 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:42:17.245 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:42:17.245 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:42:17.245 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:42:17.245 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:42:17.246 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:42:17.246 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:42:17.246 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:42:17.246 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:42:17.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:17 gibba013 bash[29418]: cluster 2021-03-10T17:42:16.498132+0000 mgr.gibba020.yqfnwy (mgr.34427) 12084 : cluster [DBG] pgmap v6885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:17.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:17 gibba013 bash[29418]: audit 2021-03-10T17:42:16.760267+0000 mgr.gibba020.yqfnwy (mgr.34427) 12085 : audit [DBG] from='client.62131 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:42:17.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:17 gibba013 bash[29418]: audit 2021-03-10T17:42:16.982194+0000 mgr.gibba020.yqfnwy (mgr.34427) 12086 : audit [DBG] from='client.62137 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:42:17.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:17 gibba013 bash[29418]: audit 2021-03-10T17:42:17.240443+0000 mon.a (mon.0) 4219 : audit [DBG] from='client.? 172.21.2.113:0/149079374' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:17.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:17 gibba013 bash[30381]: cluster 2021-03-10T17:42:16.498132+0000 mgr.gibba020.yqfnwy (mgr.34427) 12084 : cluster [DBG] pgmap v6885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:17.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:17 gibba013 bash[30381]: audit 2021-03-10T17:42:16.760267+0000 mgr.gibba020.yqfnwy (mgr.34427) 12085 : audit [DBG] from='client.62131 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:42:17.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:17 gibba013 bash[30381]: audit 2021-03-10T17:42:16.982194+0000 mgr.gibba020.yqfnwy (mgr.34427) 12086 : audit [DBG] from='client.62137 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:42:17.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:17 gibba013 bash[30381]: audit 2021-03-10T17:42:17.240443+0000 mon.a (mon.0) 4219 : audit [DBG] from='client.? 172.21.2.113:0/149079374' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:17.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:17 gibba020 bash[25448]: cluster 2021-03-10T17:42:16.498132+0000 mgr.gibba020.yqfnwy (mgr.34427) 12084 : cluster [DBG] pgmap v6885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:17.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:17 gibba020 bash[25448]: audit 2021-03-10T17:42:16.760267+0000 mgr.gibba020.yqfnwy (mgr.34427) 12085 : audit [DBG] from='client.62131 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:42:17.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:17 gibba020 bash[25448]: audit 2021-03-10T17:42:16.982194+0000 mgr.gibba020.yqfnwy (mgr.34427) 12086 : audit [DBG] from='client.62137 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:42:17.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:17 gibba020 bash[25448]: audit 2021-03-10T17:42:17.240443+0000 mon.a (mon.0) 4219 : audit [DBG] from='client.? 172.21.2.113:0/149079374' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:19.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:19 gibba013 bash[29418]: cluster 2021-03-10T17:42:18.499530+0000 mgr.gibba020.yqfnwy (mgr.34427) 12087 : cluster [DBG] pgmap v6886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:19.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:19 gibba013 bash[30381]: cluster 2021-03-10T17:42:18.499530+0000 mgr.gibba020.yqfnwy (mgr.34427) 12087 : cluster [DBG] pgmap v6886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:19.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:19 gibba020 bash[25448]: cluster 2021-03-10T17:42:18.499530+0000 mgr.gibba020.yqfnwy (mgr.34427) 12087 : cluster [DBG] pgmap v6886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:21.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:21 gibba013 bash[29418]: cluster 2021-03-10T17:42:20.501327+0000 mgr.gibba020.yqfnwy (mgr.34427) 12088 : cluster [DBG] pgmap v6887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:21.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:21 gibba013 bash[30381]: cluster 2021-03-10T17:42:20.501327+0000 mgr.gibba020.yqfnwy (mgr.34427) 12088 : cluster [DBG] pgmap v6887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:21.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:21 gibba020 bash[25448]: cluster 2021-03-10T17:42:20.501327+0000 mgr.gibba020.yqfnwy (mgr.34427) 12088 : cluster [DBG] pgmap v6887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:23.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:23 gibba013 bash[29418]: cluster 2021-03-10T17:42:22.502743+0000 mgr.gibba020.yqfnwy (mgr.34427) 12089 : cluster [DBG] pgmap v6888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:23.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:23 gibba013 bash[30381]: cluster 2021-03-10T17:42:22.502743+0000 mgr.gibba020.yqfnwy (mgr.34427) 12089 : cluster [DBG] pgmap v6888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:23.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:23 gibba020 bash[25448]: cluster 2021-03-10T17:42:22.502743+0000 mgr.gibba020.yqfnwy (mgr.34427) 12089 : cluster [DBG] pgmap v6888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:25.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:25 gibba013 bash[29418]: cluster 2021-03-10T17:42:24.504277+0000 mgr.gibba020.yqfnwy (mgr.34427) 12090 : cluster [DBG] pgmap v6889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:25.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:25 gibba013 bash[30381]: cluster 2021-03-10T17:42:24.504277+0000 mgr.gibba020.yqfnwy (mgr.34427) 12090 : cluster [DBG] pgmap v6889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:25.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:25 gibba020 bash[25448]: cluster 2021-03-10T17:42:24.504277+0000 mgr.gibba020.yqfnwy (mgr.34427) 12090 : cluster [DBG] pgmap v6889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:27.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:27 gibba013 bash[29418]: cephadm 2021-03-10T17:42:26.493453+0000 mgr.gibba020.yqfnwy (mgr.34427) 12091 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:42:27.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:27 gibba013 bash[29418]: cluster 2021-03-10T17:42:26.506148+0000 mgr.gibba020.yqfnwy (mgr.34427) 12092 : cluster [DBG] pgmap v6890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:27.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:27 gibba013 bash[30381]: cephadm 2021-03-10T17:42:26.493453+0000 mgr.gibba020.yqfnwy (mgr.34427) 12091 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:42:27.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:27 gibba013 bash[30381]: cluster 2021-03-10T17:42:26.506148+0000 mgr.gibba020.yqfnwy (mgr.34427) 12092 : cluster [DBG] pgmap v6890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:27.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:27 gibba020 bash[25448]: cephadm 2021-03-10T17:42:26.493453+0000 mgr.gibba020.yqfnwy (mgr.34427) 12091 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:42:27.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:27 gibba020 bash[25448]: cluster 2021-03-10T17:42:26.506148+0000 mgr.gibba020.yqfnwy (mgr.34427) 12092 : cluster [DBG] pgmap v6890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:29.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:29 gibba013 bash[29418]: cluster 2021-03-10T17:42:28.507582+0000 mgr.gibba020.yqfnwy (mgr.34427) 12093 : cluster [DBG] pgmap v6891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:29.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:29 gibba013 bash[30381]: cluster 2021-03-10T17:42:28.507582+0000 mgr.gibba020.yqfnwy (mgr.34427) 12093 : cluster [DBG] pgmap v6891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:29.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:29 gibba020 bash[25448]: cluster 2021-03-10T17:42:28.507582+0000 mgr.gibba020.yqfnwy (mgr.34427) 12093 : cluster [DBG] pgmap v6891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:31.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:31 gibba013 bash[29418]: cluster 2021-03-10T17:42:30.509400+0000 mgr.gibba020.yqfnwy (mgr.34427) 12094 : cluster [DBG] pgmap v6892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:31.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:31 gibba013 bash[30381]: cluster 2021-03-10T17:42:30.509400+0000 mgr.gibba020.yqfnwy (mgr.34427) 12094 : cluster [DBG] pgmap v6892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:31.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:31 gibba020 bash[25448]: cluster 2021-03-10T17:42:30.509400+0000 mgr.gibba020.yqfnwy (mgr.34427) 12094 : cluster [DBG] pgmap v6892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:33.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:33 gibba013 bash[29418]: cluster 2021-03-10T17:42:32.511164+0000 mgr.gibba020.yqfnwy (mgr.34427) 12095 : cluster [DBG] pgmap v6893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:33.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:33 gibba013 bash[30381]: cluster 2021-03-10T17:42:32.511164+0000 mgr.gibba020.yqfnwy (mgr.34427) 12095 : cluster [DBG] pgmap v6893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:33.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:33 gibba020 bash[25448]: cluster 2021-03-10T17:42:32.511164+0000 mgr.gibba020.yqfnwy (mgr.34427) 12095 : cluster [DBG] pgmap v6893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:35.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:35 gibba013 bash[29418]: cluster 2021-03-10T17:42:34.512743+0000 mgr.gibba020.yqfnwy (mgr.34427) 12096 : cluster [DBG] pgmap v6894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:35.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:35 gibba013 bash[30381]: cluster 2021-03-10T17:42:34.512743+0000 mgr.gibba020.yqfnwy (mgr.34427) 12096 : cluster [DBG] pgmap v6894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:35.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:35 gibba020 bash[25448]: cluster 2021-03-10T17:42:34.512743+0000 mgr.gibba020.yqfnwy (mgr.34427) 12096 : cluster [DBG] pgmap v6894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:37.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:37 gibba013 bash[29418]: cluster 2021-03-10T17:42:36.513566+0000 mgr.gibba020.yqfnwy (mgr.34427) 12097 : cluster [DBG] pgmap v6895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:37.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:37 gibba013 bash[30381]: cluster 2021-03-10T17:42:36.513566+0000 mgr.gibba020.yqfnwy (mgr.34427) 12097 : cluster [DBG] pgmap v6895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:37.952 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:37 gibba020 bash[25448]: cluster 2021-03-10T17:42:36.513566+0000 mgr.gibba020.yqfnwy (mgr.34427) 12097 : cluster [DBG] pgmap v6895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:39.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:39 gibba013 bash[29418]: cluster 2021-03-10T17:42:38.514869+0000 mgr.gibba020.yqfnwy (mgr.34427) 12098 : cluster [DBG] pgmap v6896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:39.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:39 gibba013 bash[30381]: cluster 2021-03-10T17:42:38.514869+0000 mgr.gibba020.yqfnwy (mgr.34427) 12098 : cluster [DBG] pgmap v6896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:39.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:39 gibba020 bash[25448]: cluster 2021-03-10T17:42:38.514869+0000 mgr.gibba020.yqfnwy (mgr.34427) 12098 : cluster [DBG] pgmap v6896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:41.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:41 gibba013 bash[29418]: cluster 2021-03-10T17:42:40.516660+0000 mgr.gibba020.yqfnwy (mgr.34427) 12099 : cluster [DBG] pgmap v6897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:41.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:41 gibba013 bash[30381]: cluster 2021-03-10T17:42:40.516660+0000 mgr.gibba020.yqfnwy (mgr.34427) 12099 : cluster [DBG] pgmap v6897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:41.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:41 gibba020 bash[25448]: cluster 2021-03-10T17:42:40.516660+0000 mgr.gibba020.yqfnwy (mgr.34427) 12099 : cluster [DBG] pgmap v6897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:42.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:42 gibba013 bash[29418]: cephadm 2021-03-10T17:42:41.500242+0000 mgr.gibba020.yqfnwy (mgr.34427) 12100 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:42:42.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:42 gibba013 bash[30381]: cephadm 2021-03-10T17:42:41.500242+0000 mgr.gibba020.yqfnwy (mgr.34427) 12100 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:42:42.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:42 gibba020 bash[25448]: cephadm 2021-03-10T17:42:41.500242+0000 mgr.gibba020.yqfnwy (mgr.34427) 12100 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:42:43.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:43 gibba013 bash[29418]: cluster 2021-03-10T17:42:42.517944+0000 mgr.gibba020.yqfnwy (mgr.34427) 12101 : cluster [DBG] pgmap v6898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:43.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:43 gibba013 bash[30381]: cluster 2021-03-10T17:42:42.517944+0000 mgr.gibba020.yqfnwy (mgr.34427) 12101 : cluster [DBG] pgmap v6898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:43.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:43 gibba020 bash[25448]: cluster 2021-03-10T17:42:42.517944+0000 mgr.gibba020.yqfnwy (mgr.34427) 12101 : cluster [DBG] pgmap v6898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:45.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:45 gibba013 bash[29418]: cluster 2021-03-10T17:42:44.519189+0000 mgr.gibba020.yqfnwy (mgr.34427) 12102 : cluster [DBG] pgmap v6899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:45.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:45 gibba013 bash[30381]: cluster 2021-03-10T17:42:44.519189+0000 mgr.gibba020.yqfnwy (mgr.34427) 12102 : cluster [DBG] pgmap v6899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:45.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:45 gibba020 bash[25448]: cluster 2021-03-10T17:42:44.519189+0000 mgr.gibba020.yqfnwy (mgr.34427) 12102 : cluster [DBG] pgmap v6899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:47.488 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:42:47.746 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:42:47.747 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 36s ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:42:47.747 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 9m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:42:47.747 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:42:47.747 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:42:47.748 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 36s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:42:47.748 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 36s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:42:47.748 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:42:47.748 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 36s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:42:47.749 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 36s ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:42:47.749 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 9m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:42:47.749 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 36s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:42:47.749 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 36s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:42:47.749 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 36s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:42:47.750 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 36s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:42:47.750 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:42:47.750 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:42:47.750 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:42:47.750 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 9m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:42:47.751 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 9m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:42:47.751 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 9m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:42:47.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:47 gibba013 bash[29418]: cluster 2021-03-10T17:42:46.520175+0000 mgr.gibba020.yqfnwy (mgr.34427) 12103 : cluster [DBG] pgmap v6900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:47.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:47 gibba013 bash[30381]: cluster 2021-03-10T17:42:46.520175+0000 mgr.gibba020.yqfnwy (mgr.34427) 12103 : cluster [DBG] pgmap v6900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:47.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:47 gibba020 bash[25448]: cluster 2021-03-10T17:42:46.520175+0000 mgr.gibba020.yqfnwy (mgr.34427) 12103 : cluster [DBG] pgmap v6900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:47.995 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:42:47.995 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:42:47.995 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:42:47.996 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:42:47.996 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:42:47.996 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:42:47.996 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:42:47.996 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:42:47.997 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:42:47.997 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:42:47.997 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:42:47.997 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:42:47.998 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:42:47.998 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:42:47.998 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:42:48.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:48 gibba013 bash[29418]: audit 2021-03-10T17:42:47.474920+0000 mgr.gibba020.yqfnwy (mgr.34427) 12104 : audit [DBG] from='client.52170 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:42:48.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:48 gibba013 bash[29418]: audit 2021-03-10T17:42:47.702891+0000 mgr.gibba020.yqfnwy (mgr.34427) 12105 : audit [DBG] from='client.52176 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:42:48.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:48 gibba013 bash[29418]: audit 2021-03-10T17:42:47.992373+0000 mon.a (mon.0) 4220 : audit [DBG] from='client.? 172.21.2.113:0/482004461' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:48.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:48 gibba013 bash[30381]: audit 2021-03-10T17:42:47.474920+0000 mgr.gibba020.yqfnwy (mgr.34427) 12104 : audit [DBG] from='client.52170 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:42:48.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:48 gibba013 bash[30381]: audit 2021-03-10T17:42:47.702891+0000 mgr.gibba020.yqfnwy (mgr.34427) 12105 : audit [DBG] from='client.52176 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:42:48.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:48 gibba013 bash[30381]: audit 2021-03-10T17:42:47.992373+0000 mon.a (mon.0) 4220 : audit [DBG] from='client.? 172.21.2.113:0/482004461' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:48.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:48 gibba020 bash[25448]: audit 2021-03-10T17:42:47.474920+0000 mgr.gibba020.yqfnwy (mgr.34427) 12104 : audit [DBG] from='client.52170 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:42:48.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:48 gibba020 bash[25448]: audit 2021-03-10T17:42:47.702891+0000 mgr.gibba020.yqfnwy (mgr.34427) 12105 : audit [DBG] from='client.52176 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:42:48.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:48 gibba020 bash[25448]: audit 2021-03-10T17:42:47.992373+0000 mon.a (mon.0) 4220 : audit [DBG] from='client.? 172.21.2.113:0/482004461' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:42:49.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:49 gibba013 bash[29418]: cluster 2021-03-10T17:42:48.520607+0000 mgr.gibba020.yqfnwy (mgr.34427) 12106 : cluster [DBG] pgmap v6901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:49.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:49 gibba013 bash[30381]: cluster 2021-03-10T17:42:48.520607+0000 mgr.gibba020.yqfnwy (mgr.34427) 12106 : cluster [DBG] pgmap v6901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:49.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:49 gibba020 bash[25448]: cluster 2021-03-10T17:42:48.520607+0000 mgr.gibba020.yqfnwy (mgr.34427) 12106 : cluster [DBG] pgmap v6901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:51.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:51 gibba013 bash[29418]: cluster 2021-03-10T17:42:50.522029+0000 mgr.gibba020.yqfnwy (mgr.34427) 12107 : cluster [DBG] pgmap v6902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:51.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:51 gibba013 bash[30381]: cluster 2021-03-10T17:42:50.522029+0000 mgr.gibba020.yqfnwy (mgr.34427) 12107 : cluster [DBG] pgmap v6902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:51.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:51 gibba020 bash[25448]: cluster 2021-03-10T17:42:50.522029+0000 mgr.gibba020.yqfnwy (mgr.34427) 12107 : cluster [DBG] pgmap v6902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:53.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:53 gibba013 bash[29418]: cluster 2021-03-10T17:42:52.523572+0000 mgr.gibba020.yqfnwy (mgr.34427) 12108 : cluster [DBG] pgmap v6903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:53.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:53 gibba013 bash[30381]: cluster 2021-03-10T17:42:52.523572+0000 mgr.gibba020.yqfnwy (mgr.34427) 12108 : cluster [DBG] pgmap v6903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:53.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:53 gibba020 bash[25448]: cluster 2021-03-10T17:42:52.523572+0000 mgr.gibba020.yqfnwy (mgr.34427) 12108 : cluster [DBG] pgmap v6903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:55.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:55 gibba013 bash[29418]: cluster 2021-03-10T17:42:54.525100+0000 mgr.gibba020.yqfnwy (mgr.34427) 12109 : cluster [DBG] pgmap v6904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:55.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:55 gibba013 bash[30381]: cluster 2021-03-10T17:42:54.525100+0000 mgr.gibba020.yqfnwy (mgr.34427) 12109 : cluster [DBG] pgmap v6904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:55.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:55 gibba020 bash[25448]: cluster 2021-03-10T17:42:54.525100+0000 mgr.gibba020.yqfnwy (mgr.34427) 12109 : cluster [DBG] pgmap v6904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:57.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:57 gibba013 bash[29418]: cephadm 2021-03-10T17:42:56.515832+0000 mgr.gibba020.yqfnwy (mgr.34427) 12110 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:42:57.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:57 gibba013 bash[29418]: cluster 2021-03-10T17:42:56.525882+0000 mgr.gibba020.yqfnwy (mgr.34427) 12111 : cluster [DBG] pgmap v6905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:57.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:57 gibba013 bash[30381]: cephadm 2021-03-10T17:42:56.515832+0000 mgr.gibba020.yqfnwy (mgr.34427) 12110 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:42:57.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:57 gibba013 bash[30381]: cluster 2021-03-10T17:42:56.525882+0000 mgr.gibba020.yqfnwy (mgr.34427) 12111 : cluster [DBG] pgmap v6905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:57.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:57 gibba020 bash[25448]: cephadm 2021-03-10T17:42:56.515832+0000 mgr.gibba020.yqfnwy (mgr.34427) 12110 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:42:57.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:57 gibba020 bash[25448]: cluster 2021-03-10T17:42:56.525882+0000 mgr.gibba020.yqfnwy (mgr.34427) 12111 : cluster [DBG] pgmap v6905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:59.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:42:59 gibba013 bash[29418]: cluster 2021-03-10T17:42:58.527151+0000 mgr.gibba020.yqfnwy (mgr.34427) 12112 : cluster [DBG] pgmap v6906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:59.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:42:59 gibba013 bash[30381]: cluster 2021-03-10T17:42:58.527151+0000 mgr.gibba020.yqfnwy (mgr.34427) 12112 : cluster [DBG] pgmap v6906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:42:59.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:42:59 gibba020 bash[25448]: cluster 2021-03-10T17:42:58.527151+0000 mgr.gibba020.yqfnwy (mgr.34427) 12112 : cluster [DBG] pgmap v6906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:01.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:01 gibba013 bash[29418]: cluster 2021-03-10T17:43:00.528945+0000 mgr.gibba020.yqfnwy (mgr.34427) 12113 : cluster [DBG] pgmap v6907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:01.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:01 gibba013 bash[30381]: cluster 2021-03-10T17:43:00.528945+0000 mgr.gibba020.yqfnwy (mgr.34427) 12113 : cluster [DBG] pgmap v6907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:01.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:01 gibba020 bash[25448]: cluster 2021-03-10T17:43:00.528945+0000 mgr.gibba020.yqfnwy (mgr.34427) 12113 : cluster [DBG] pgmap v6907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:03.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:03 gibba013 bash[29418]: cluster 2021-03-10T17:43:02.530301+0000 mgr.gibba020.yqfnwy (mgr.34427) 12114 : cluster [DBG] pgmap v6908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:03.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:03 gibba013 bash[30381]: cluster 2021-03-10T17:43:02.530301+0000 mgr.gibba020.yqfnwy (mgr.34427) 12114 : cluster [DBG] pgmap v6908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:03.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:03 gibba020 bash[25448]: cluster 2021-03-10T17:43:02.530301+0000 mgr.gibba020.yqfnwy (mgr.34427) 12114 : cluster [DBG] pgmap v6908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:05.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:05 gibba013 bash[29418]: cluster 2021-03-10T17:43:04.531806+0000 mgr.gibba020.yqfnwy (mgr.34427) 12115 : cluster [DBG] pgmap v6909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:05.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:05 gibba013 bash[30381]: cluster 2021-03-10T17:43:04.531806+0000 mgr.gibba020.yqfnwy (mgr.34427) 12115 : cluster [DBG] pgmap v6909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:05.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:05 gibba020 bash[25448]: cluster 2021-03-10T17:43:04.531806+0000 mgr.gibba020.yqfnwy (mgr.34427) 12115 : cluster [DBG] pgmap v6909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:07.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:07 gibba013 bash[29418]: cluster 2021-03-10T17:43:06.532869+0000 mgr.gibba020.yqfnwy (mgr.34427) 12116 : cluster [DBG] pgmap v6910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:07.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:07 gibba013 bash[29418]: audit 2021-03-10T17:43:07.069256+0000 mon.a (mon.0) 4221 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:43:07.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:07 gibba013 bash[29418]: audit 2021-03-10T17:43:07.337255+0000 mon.a (mon.0) 4222 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:43:07.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:07 gibba013 bash[30381]: cluster 2021-03-10T17:43:06.532869+0000 mgr.gibba020.yqfnwy (mgr.34427) 12116 : cluster [DBG] pgmap v6910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:07.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:07 gibba013 bash[30381]: audit 2021-03-10T17:43:07.069256+0000 mon.a (mon.0) 4221 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:43:07.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:07 gibba013 bash[30381]: audit 2021-03-10T17:43:07.337255+0000 mon.a (mon.0) 4222 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:43:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:07 gibba020 bash[25448]: cluster 2021-03-10T17:43:06.532869+0000 mgr.gibba020.yqfnwy (mgr.34427) 12116 : cluster [DBG] pgmap v6910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:07 gibba020 bash[25448]: audit 2021-03-10T17:43:07.069256+0000 mon.a (mon.0) 4221 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:43:07.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:07 gibba020 bash[25448]: audit 2021-03-10T17:43:07.337255+0000 mon.a (mon.0) 4222 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:43:08.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:08 gibba013 bash[29418]: audit 2021-03-10T17:43:07.830120+0000 mon.a (mon.0) 4223 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:43:08.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:08 gibba013 bash[29418]: audit 2021-03-10T17:43:07.830875+0000 mon.a (mon.0) 4224 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:43:08.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:08 gibba013 bash[29418]: audit 2021-03-10T17:43:07.831530+0000 mon.a (mon.0) 4225 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:43:08.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:08 gibba013 bash[29418]: audit 2021-03-10T17:43:07.832193+0000 mon.a (mon.0) 4226 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:43:08.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:08 gibba013 bash[30381]: audit 2021-03-10T17:43:07.830120+0000 mon.a (mon.0) 4223 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:43:08.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:08 gibba013 bash[30381]: audit 2021-03-10T17:43:07.830875+0000 mon.a (mon.0) 4224 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:43:08.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:08 gibba013 bash[30381]: audit 2021-03-10T17:43:07.831530+0000 mon.a (mon.0) 4225 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:43:08.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:08 gibba013 bash[30381]: audit 2021-03-10T17:43:07.832193+0000 mon.a (mon.0) 4226 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:43:08.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:08 gibba020 bash[25448]: audit 2021-03-10T17:43:07.830120+0000 mon.a (mon.0) 4223 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T17:43:08.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:08 gibba020 bash[25448]: audit 2021-03-10T17:43:07.830875+0000 mon.a (mon.0) 4224 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T17:43:08.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:08 gibba020 bash[25448]: audit 2021-03-10T17:43:07.831530+0000 mon.a (mon.0) 4225 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:43:08.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:08 gibba020 bash[25448]: audit 2021-03-10T17:43:07.832193+0000 mon.a (mon.0) 4226 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T17:43:09.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:09 gibba013 bash[29418]: cluster 2021-03-10T17:43:08.533551+0000 mgr.gibba020.yqfnwy (mgr.34427) 12117 : cluster [DBG] pgmap v6911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:09.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:09 gibba013 bash[30381]: cluster 2021-03-10T17:43:08.533551+0000 mgr.gibba020.yqfnwy (mgr.34427) 12117 : cluster [DBG] pgmap v6911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:09.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:09 gibba020 bash[25448]: cluster 2021-03-10T17:43:08.533551+0000 mgr.gibba020.yqfnwy (mgr.34427) 12117 : cluster [DBG] pgmap v6911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:11.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:11 gibba013 bash[29418]: cluster 2021-03-10T17:43:10.535152+0000 mgr.gibba020.yqfnwy (mgr.34427) 12118 : cluster [DBG] pgmap v6912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:11.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:11 gibba013 bash[29418]: audit 2021-03-10T17:43:11.532495+0000 mon.a (mon.0) 4227 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:43:11.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:11 gibba013 bash[29418]: audit 2021-03-10T17:43:11.535890+0000 mon.a (mon.0) 4228 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:43:11.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:11 gibba013 bash[30381]: cluster 2021-03-10T17:43:10.535152+0000 mgr.gibba020.yqfnwy (mgr.34427) 12118 : cluster [DBG] pgmap v6912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:11.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:11 gibba013 bash[30381]: audit 2021-03-10T17:43:11.532495+0000 mon.a (mon.0) 4227 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:43:11.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:11 gibba013 bash[30381]: audit 2021-03-10T17:43:11.535890+0000 mon.a (mon.0) 4228 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:43:11.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:11 gibba020 bash[25448]: cluster 2021-03-10T17:43:10.535152+0000 mgr.gibba020.yqfnwy (mgr.34427) 12118 : cluster [DBG] pgmap v6912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:11.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:11 gibba020 bash[25448]: audit 2021-03-10T17:43:11.532495+0000 mon.a (mon.0) 4227 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:43:11.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:11 gibba020 bash[25448]: audit 2021-03-10T17:43:11.535890+0000 mon.a (mon.0) 4228 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T17:43:12.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:12 gibba013 bash[29418]: cephadm 2021-03-10T17:43:11.534193+0000 mgr.gibba020.yqfnwy (mgr.34427) 12119 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:43:12.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:12 gibba013 bash[30381]: cephadm 2021-03-10T17:43:11.534193+0000 mgr.gibba020.yqfnwy (mgr.34427) 12119 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:43:12.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:12 gibba020 bash[25448]: cephadm 2021-03-10T17:43:11.534193+0000 mgr.gibba020.yqfnwy (mgr.34427) 12119 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:43:13.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:13 gibba013 bash[29418]: cluster 2021-03-10T17:43:12.536942+0000 mgr.gibba020.yqfnwy (mgr.34427) 12120 : cluster [DBG] pgmap v6913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:13.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:13 gibba013 bash[30381]: cluster 2021-03-10T17:43:12.536942+0000 mgr.gibba020.yqfnwy (mgr.34427) 12120 : cluster [DBG] pgmap v6913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:13.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:13 gibba020 bash[25448]: cluster 2021-03-10T17:43:12.536942+0000 mgr.gibba020.yqfnwy (mgr.34427) 12120 : cluster [DBG] pgmap v6913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:16.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:16 gibba013 bash[29418]: cluster 2021-03-10T17:43:14.537475+0000 mgr.gibba020.yqfnwy (mgr.34427) 12121 : cluster [DBG] pgmap v6914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:16.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:16 gibba013 bash[29418]: audit 2021-03-10T17:43:15.260777+0000 mon.a (mon.0) 4229 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:43:16.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:16 gibba013 bash[29418]: cephadm 2021-03-10T17:43:15.261883+0000 mgr.gibba020.yqfnwy (mgr.34427) 12122 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:43:16.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:16 gibba013 bash[29418]: audit 2021-03-10T17:43:15.471603+0000 mon.a (mon.0) 4230 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:43:16.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:16 gibba013 bash[29418]: audit 2021-03-10T17:43:15.474928+0000 mon.a (mon.0) 4231 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:43:16.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:16 gibba013 bash[29418]: audit 2021-03-10T17:43:15.476366+0000 mon.a (mon.0) 4232 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:16.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:16 gibba013 bash[29418]: audit 2021-03-10T17:43:15.477662+0000 mon.a (mon.0) 4233 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:16.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:16 gibba013 bash[29418]: audit 2021-03-10T17:43:15.478827+0000 mon.a (mon.0) 4234 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:16.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:16 gibba013 bash[29418]: audit 2021-03-10T17:43:15.481075+0000 mon.a (mon.0) 4235 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:16.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:16 gibba013 bash[29418]: audit 2021-03-10T17:43:15.482625+0000 mon.a (mon.0) 4236 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:16.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:16 gibba013 bash[30381]: cluster 2021-03-10T17:43:14.537475+0000 mgr.gibba020.yqfnwy (mgr.34427) 12121 : cluster [DBG] pgmap v6914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:16.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:16 gibba013 bash[30381]: audit 2021-03-10T17:43:15.260777+0000 mon.a (mon.0) 4229 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:43:16.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:16 gibba013 bash[30381]: cephadm 2021-03-10T17:43:15.261883+0000 mgr.gibba020.yqfnwy (mgr.34427) 12122 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:43:16.634 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:16 gibba013 bash[30381]: audit 2021-03-10T17:43:15.471603+0000 mon.a (mon.0) 4230 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:43:16.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:16 gibba013 bash[30381]: audit 2021-03-10T17:43:15.474928+0000 mon.a (mon.0) 4231 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:43:16.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:16 gibba013 bash[30381]: audit 2021-03-10T17:43:15.476366+0000 mon.a (mon.0) 4232 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:16.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:16 gibba013 bash[30381]: audit 2021-03-10T17:43:15.477662+0000 mon.a (mon.0) 4233 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:16.635 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:16 gibba013 bash[30381]: audit 2021-03-10T17:43:15.478827+0000 mon.a (mon.0) 4234 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:16.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:16 gibba013 bash[30381]: audit 2021-03-10T17:43:15.481075+0000 mon.a (mon.0) 4235 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:16.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:16 gibba013 bash[30381]: audit 2021-03-10T17:43:15.482625+0000 mon.a (mon.0) 4236 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:16.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:16 gibba020 bash[25448]: cluster 2021-03-10T17:43:14.537475+0000 mgr.gibba020.yqfnwy (mgr.34427) 12121 : cluster [DBG] pgmap v6914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:16.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:16 gibba020 bash[25448]: audit 2021-03-10T17:43:15.260777+0000 mon.a (mon.0) 4229 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:43:16.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:16 gibba020 bash[25448]: cephadm 2021-03-10T17:43:15.261883+0000 mgr.gibba020.yqfnwy (mgr.34427) 12122 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:43:16.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:16 gibba020 bash[25448]: audit 2021-03-10T17:43:15.471603+0000 mon.a (mon.0) 4230 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:43:16.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:16 gibba020 bash[25448]: audit 2021-03-10T17:43:15.474928+0000 mon.a (mon.0) 4231 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:43:16.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:16 gibba020 bash[25448]: audit 2021-03-10T17:43:15.476366+0000 mon.a (mon.0) 4232 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:16.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:16 gibba020 bash[25448]: audit 2021-03-10T17:43:15.477662+0000 mon.a (mon.0) 4233 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:16.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:16 gibba020 bash[25448]: audit 2021-03-10T17:43:15.478827+0000 mon.a (mon.0) 4234 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:16.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:16 gibba020 bash[25448]: audit 2021-03-10T17:43:15.481075+0000 mon.a (mon.0) 4235 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:16.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:16 gibba020 bash[25448]: audit 2021-03-10T17:43:15.482625+0000 mon.a (mon.0) 4236 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:17.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:17 gibba013 bash[29418]: cephadm 2021-03-10T17:43:15.473737+0000 mgr.gibba020.yqfnwy (mgr.34427) 12123 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:43:17.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:17 gibba013 bash[29418]: cephadm 2021-03-10T17:43:15.475530+0000 mgr.gibba020.yqfnwy (mgr.34427) 12124 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:43:17.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:17 gibba013 bash[29418]: cephadm 2021-03-10T17:43:15.476787+0000 mgr.gibba020.yqfnwy (mgr.34427) 12125 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:43:17.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:17 gibba013 bash[29418]: cephadm 2021-03-10T17:43:15.476823+0000 mgr.gibba020.yqfnwy (mgr.34427) 12126 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:43:17.633 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:17 gibba013 bash[29418]: cephadm 2021-03-10T17:43:15.478070+0000 mgr.gibba020.yqfnwy (mgr.34427) 12127 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:43:17.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:17 gibba013 bash[29418]: cephadm 2021-03-10T17:43:15.478105+0000 mgr.gibba020.yqfnwy (mgr.34427) 12128 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:43:17.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:17 gibba013 bash[29418]: cephadm 2021-03-10T17:43:15.479198+0000 mgr.gibba020.yqfnwy (mgr.34427) 12129 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:43:17.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:17 gibba013 bash[29418]: cephadm 2021-03-10T17:43:15.480183+0000 mgr.gibba020.yqfnwy (mgr.34427) 12130 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:43:17.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:17 gibba013 bash[29418]: cephadm 2021-03-10T17:43:15.480218+0000 mgr.gibba020.yqfnwy (mgr.34427) 12131 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:43:17.634 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:17 gibba013 bash[29418]: cephadm 2021-03-10T17:43:15.481477+0000 mgr.gibba020.yqfnwy (mgr.34427) 12132 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:43:17.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:17 gibba013 bash[29418]: cephadm 2021-03-10T17:43:15.481791+0000 mgr.gibba020.yqfnwy (mgr.34427) 12133 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:43:17.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:17 gibba013 bash[29418]: cephadm 2021-03-10T17:43:15.483102+0000 mgr.gibba020.yqfnwy (mgr.34427) 12134 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:43:17.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:17 gibba013 bash[29418]: cephadm 2021-03-10T17:43:15.483139+0000 mgr.gibba020.yqfnwy (mgr.34427) 12135 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:43:17.635 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:17 gibba013 bash[29418]: cephadm 2021-03-10T17:43:15.483243+0000 mgr.gibba020.yqfnwy (mgr.34427) 12136 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:43:17.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:17 gibba013 bash[30381]: cephadm 2021-03-10T17:43:15.473737+0000 mgr.gibba020.yqfnwy (mgr.34427) 12123 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:43:17.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:17 gibba013 bash[30381]: cephadm 2021-03-10T17:43:15.475530+0000 mgr.gibba020.yqfnwy (mgr.34427) 12124 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:43:17.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:17 gibba013 bash[30381]: cephadm 2021-03-10T17:43:15.476787+0000 mgr.gibba020.yqfnwy (mgr.34427) 12125 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:43:17.636 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:17 gibba013 bash[30381]: cephadm 2021-03-10T17:43:15.476823+0000 mgr.gibba020.yqfnwy (mgr.34427) 12126 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:43:17.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:17 gibba013 bash[30381]: cephadm 2021-03-10T17:43:15.478070+0000 mgr.gibba020.yqfnwy (mgr.34427) 12127 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:43:17.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:17 gibba013 bash[30381]: cephadm 2021-03-10T17:43:15.478105+0000 mgr.gibba020.yqfnwy (mgr.34427) 12128 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:43:17.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:17 gibba013 bash[30381]: cephadm 2021-03-10T17:43:15.479198+0000 mgr.gibba020.yqfnwy (mgr.34427) 12129 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:43:17.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:17 gibba013 bash[30381]: cephadm 2021-03-10T17:43:15.480183+0000 mgr.gibba020.yqfnwy (mgr.34427) 12130 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:43:17.637 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:17 gibba013 bash[30381]: cephadm 2021-03-10T17:43:15.480218+0000 mgr.gibba020.yqfnwy (mgr.34427) 12131 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:43:17.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:17 gibba013 bash[30381]: cephadm 2021-03-10T17:43:15.481477+0000 mgr.gibba020.yqfnwy (mgr.34427) 12132 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:43:17.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:17 gibba013 bash[30381]: cephadm 2021-03-10T17:43:15.481791+0000 mgr.gibba020.yqfnwy (mgr.34427) 12133 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:43:17.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:17 gibba013 bash[30381]: cephadm 2021-03-10T17:43:15.483102+0000 mgr.gibba020.yqfnwy (mgr.34427) 12134 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:43:17.638 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:17 gibba013 bash[30381]: cephadm 2021-03-10T17:43:15.483139+0000 mgr.gibba020.yqfnwy (mgr.34427) 12135 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:43:17.639 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:17 gibba013 bash[30381]: cephadm 2021-03-10T17:43:15.483243+0000 mgr.gibba020.yqfnwy (mgr.34427) 12136 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:43:17.699 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:17 gibba020 bash[25448]: cephadm 2021-03-10T17:43:15.473737+0000 mgr.gibba020.yqfnwy (mgr.34427) 12123 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:43:17.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:17 gibba020 bash[25448]: cephadm 2021-03-10T17:43:15.475530+0000 mgr.gibba020.yqfnwy (mgr.34427) 12124 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:43:17.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:17 gibba020 bash[25448]: cephadm 2021-03-10T17:43:15.476787+0000 mgr.gibba020.yqfnwy (mgr.34427) 12125 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:43:17.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:17 gibba020 bash[25448]: cephadm 2021-03-10T17:43:15.476823+0000 mgr.gibba020.yqfnwy (mgr.34427) 12126 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:43:17.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:17 gibba020 bash[25448]: cephadm 2021-03-10T17:43:15.478070+0000 mgr.gibba020.yqfnwy (mgr.34427) 12127 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:43:17.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:17 gibba020 bash[25448]: cephadm 2021-03-10T17:43:15.478105+0000 mgr.gibba020.yqfnwy (mgr.34427) 12128 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:43:17.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:17 gibba020 bash[25448]: cephadm 2021-03-10T17:43:15.479198+0000 mgr.gibba020.yqfnwy (mgr.34427) 12129 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:43:17.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:17 gibba020 bash[25448]: cephadm 2021-03-10T17:43:15.480183+0000 mgr.gibba020.yqfnwy (mgr.34427) 12130 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:43:17.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:17 gibba020 bash[25448]: cephadm 2021-03-10T17:43:15.480218+0000 mgr.gibba020.yqfnwy (mgr.34427) 12131 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:43:17.701 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:17 gibba020 bash[25448]: cephadm 2021-03-10T17:43:15.481477+0000 mgr.gibba020.yqfnwy (mgr.34427) 12132 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:43:17.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:17 gibba020 bash[25448]: cephadm 2021-03-10T17:43:15.481791+0000 mgr.gibba020.yqfnwy (mgr.34427) 12133 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:43:17.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:17 gibba020 bash[25448]: cephadm 2021-03-10T17:43:15.483102+0000 mgr.gibba020.yqfnwy (mgr.34427) 12134 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:43:17.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:17 gibba020 bash[25448]: cephadm 2021-03-10T17:43:15.483139+0000 mgr.gibba020.yqfnwy (mgr.34427) 12135 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:43:17.702 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:17 gibba020 bash[25448]: cephadm 2021-03-10T17:43:15.483243+0000 mgr.gibba020.yqfnwy (mgr.34427) 12136 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:43:18.239 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:43:18.465 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:43:18.466 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 67s ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:43:18.466 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 3s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:43:18.466 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 3s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:43:18.467 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 3s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:43:18.467 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 67s ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:43:18.467 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 67s ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:43:18.467 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 3s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:43:18.467 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 67s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:43:18.468 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 67s ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:43:18.468 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 3s ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:43:18.468 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 67s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:43:18.468 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 67s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:43:18.469 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 67s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:43:18.469 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 67s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:43:18.469 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 3s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:43:18.469 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 3s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:43:18.469 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 3s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:43:18.470 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 3s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:43:18.470 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 3s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:43:18.470 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 3s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:43:18.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:18 gibba013 bash[29418]: cluster 2021-03-10T17:43:16.538246+0000 mgr.gibba020.yqfnwy (mgr.34427) 12137 : cluster [DBG] pgmap v6915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:18.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:18 gibba013 bash[30381]: cluster 2021-03-10T17:43:16.538246+0000 mgr.gibba020.yqfnwy (mgr.34427) 12137 : cluster [DBG] pgmap v6915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:18.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:18 gibba020 bash[25448]: cluster 2021-03-10T17:43:16.538246+0000 mgr.gibba020.yqfnwy (mgr.34427) 12137 : cluster [DBG] pgmap v6915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:18.718 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:43:18.718 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:43:18.718 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:43:18.719 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:43:18.719 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:43:18.719 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:43:18.719 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:43:18.719 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:43:18.720 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:43:18.720 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:43:18.720 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:43:18.720 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:43:18.721 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:43:18.721 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:43:18.721 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:43:19.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:19 gibba013 bash[29418]: audit 2021-03-10T17:43:18.226942+0000 mgr.gibba020.yqfnwy (mgr.34427) 12138 : audit [DBG] from='client.62167 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:43:19.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:19 gibba013 bash[29418]: audit 2021-03-10T17:43:18.715285+0000 mon.c (mon.1) 182 : audit [DBG] from='client.? 172.21.2.113:0/2575931648' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:19.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:19 gibba013 bash[30381]: audit 2021-03-10T17:43:18.226942+0000 mgr.gibba020.yqfnwy (mgr.34427) 12138 : audit [DBG] from='client.62167 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:43:19.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:19 gibba013 bash[30381]: audit 2021-03-10T17:43:18.715285+0000 mon.c (mon.1) 182 : audit [DBG] from='client.? 172.21.2.113:0/2575931648' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:19.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:19 gibba020 bash[25448]: audit 2021-03-10T17:43:18.226942+0000 mgr.gibba020.yqfnwy (mgr.34427) 12138 : audit [DBG] from='client.62167 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:43:19.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:19 gibba020 bash[25448]: audit 2021-03-10T17:43:18.715285+0000 mon.c (mon.1) 182 : audit [DBG] from='client.? 172.21.2.113:0/2575931648' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:20.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:20 gibba013 bash[29418]: audit 2021-03-10T17:43:18.450179+0000 mgr.gibba020.yqfnwy (mgr.34427) 12139 : audit [DBG] from='client.52194 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:43:20.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:20 gibba013 bash[29418]: cluster 2021-03-10T17:43:18.539654+0000 mgr.gibba020.yqfnwy (mgr.34427) 12140 : cluster [DBG] pgmap v6916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:20.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:20 gibba013 bash[30381]: audit 2021-03-10T17:43:18.450179+0000 mgr.gibba020.yqfnwy (mgr.34427) 12139 : audit [DBG] from='client.52194 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:43:20.633 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:20 gibba013 bash[30381]: cluster 2021-03-10T17:43:18.539654+0000 mgr.gibba020.yqfnwy (mgr.34427) 12140 : cluster [DBG] pgmap v6916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:20.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:20 gibba020 bash[25448]: audit 2021-03-10T17:43:18.450179+0000 mgr.gibba020.yqfnwy (mgr.34427) 12139 : audit [DBG] from='client.52194 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:43:20.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:20 gibba020 bash[25448]: cluster 2021-03-10T17:43:18.539654+0000 mgr.gibba020.yqfnwy (mgr.34427) 12140 : cluster [DBG] pgmap v6916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:22.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:22 gibba013 bash[29418]: cluster 2021-03-10T17:43:20.541404+0000 mgr.gibba020.yqfnwy (mgr.34427) 12141 : cluster [DBG] pgmap v6917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:22.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:22 gibba013 bash[30381]: cluster 2021-03-10T17:43:20.541404+0000 mgr.gibba020.yqfnwy (mgr.34427) 12141 : cluster [DBG] pgmap v6917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:22.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:22 gibba020 bash[25448]: cluster 2021-03-10T17:43:20.541404+0000 mgr.gibba020.yqfnwy (mgr.34427) 12141 : cluster [DBG] pgmap v6917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:24.632 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:24 gibba013 bash[29418]: cluster 2021-03-10T17:43:22.542947+0000 mgr.gibba020.yqfnwy (mgr.34427) 12142 : cluster [DBG] pgmap v6918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:24.632 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:24 gibba013 bash[30381]: cluster 2021-03-10T17:43:22.542947+0000 mgr.gibba020.yqfnwy (mgr.34427) 12142 : cluster [DBG] pgmap v6918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:24.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:24 gibba020 bash[25448]: cluster 2021-03-10T17:43:22.542947+0000 mgr.gibba020.yqfnwy (mgr.34427) 12142 : cluster [DBG] pgmap v6918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:26.631 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:26 gibba013 bash[29418]: cluster 2021-03-10T17:43:24.544540+0000 mgr.gibba020.yqfnwy (mgr.34427) 12143 : cluster [DBG] pgmap v6919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:26.631 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:26 gibba013 bash[30381]: cluster 2021-03-10T17:43:24.544540+0000 mgr.gibba020.yqfnwy (mgr.34427) 12143 : cluster [DBG] pgmap v6919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:26.700 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:26 gibba020 bash[25448]: cluster 2021-03-10T17:43:24.544540+0000 mgr.gibba020.yqfnwy (mgr.34427) 12143 : cluster [DBG] pgmap v6919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:27.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:27 gibba013 bash[29418]: cluster 2021-03-10T17:43:26.545367+0000 mgr.gibba020.yqfnwy (mgr.34427) 12144 : cluster [DBG] pgmap v6920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:27.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:27 gibba013 bash[30381]: cluster 2021-03-10T17:43:26.545367+0000 mgr.gibba020.yqfnwy (mgr.34427) 12144 : cluster [DBG] pgmap v6920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:27.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:27 gibba020 bash[25448]: cluster 2021-03-10T17:43:26.545367+0000 mgr.gibba020.yqfnwy (mgr.34427) 12144 : cluster [DBG] pgmap v6920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:29.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:29 gibba013 bash[29418]: cluster 2021-03-10T17:43:28.546791+0000 mgr.gibba020.yqfnwy (mgr.34427) 12145 : cluster [DBG] pgmap v6921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:29.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:29 gibba013 bash[30381]: cluster 2021-03-10T17:43:28.546791+0000 mgr.gibba020.yqfnwy (mgr.34427) 12145 : cluster [DBG] pgmap v6921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:29.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:29 gibba020 bash[25448]: cluster 2021-03-10T17:43:28.546791+0000 mgr.gibba020.yqfnwy (mgr.34427) 12145 : cluster [DBG] pgmap v6921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:31.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:31 gibba013 bash[29418]: cephadm 2021-03-10T17:43:30.496433+0000 mgr.gibba020.yqfnwy (mgr.34427) 12146 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:43:31.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:31 gibba013 bash[29418]: cluster 2021-03-10T17:43:30.548331+0000 mgr.gibba020.yqfnwy (mgr.34427) 12147 : cluster [DBG] pgmap v6922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:31.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:31 gibba013 bash[30381]: cephadm 2021-03-10T17:43:30.496433+0000 mgr.gibba020.yqfnwy (mgr.34427) 12146 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:43:31.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:31 gibba013 bash[30381]: cluster 2021-03-10T17:43:30.548331+0000 mgr.gibba020.yqfnwy (mgr.34427) 12147 : cluster [DBG] pgmap v6922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:31.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:31 gibba020 bash[25448]: cephadm 2021-03-10T17:43:30.496433+0000 mgr.gibba020.yqfnwy (mgr.34427) 12146 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:43:31.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:31 gibba020 bash[25448]: cluster 2021-03-10T17:43:30.548331+0000 mgr.gibba020.yqfnwy (mgr.34427) 12147 : cluster [DBG] pgmap v6922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:33.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:33 gibba013 bash[29418]: cluster 2021-03-10T17:43:32.549784+0000 mgr.gibba020.yqfnwy (mgr.34427) 12148 : cluster [DBG] pgmap v6923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:33.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:33 gibba013 bash[30381]: cluster 2021-03-10T17:43:32.549784+0000 mgr.gibba020.yqfnwy (mgr.34427) 12148 : cluster [DBG] pgmap v6923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:33.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:33 gibba020 bash[25448]: cluster 2021-03-10T17:43:32.549784+0000 mgr.gibba020.yqfnwy (mgr.34427) 12148 : cluster [DBG] pgmap v6923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:35.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:35 gibba020 bash[25448]: cluster 2021-03-10T17:43:34.551230+0000 mgr.gibba020.yqfnwy (mgr.34427) 12149 : cluster [DBG] pgmap v6924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:36.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:35 gibba013 bash[29418]: cluster 2021-03-10T17:43:34.551230+0000 mgr.gibba020.yqfnwy (mgr.34427) 12149 : cluster [DBG] pgmap v6924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:36.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:35 gibba013 bash[30381]: cluster 2021-03-10T17:43:34.551230+0000 mgr.gibba020.yqfnwy (mgr.34427) 12149 : cluster [DBG] pgmap v6924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:37.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:37 gibba013 bash[29418]: cluster 2021-03-10T17:43:36.552200+0000 mgr.gibba020.yqfnwy (mgr.34427) 12150 : cluster [DBG] pgmap v6925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:37.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:37 gibba013 bash[30381]: cluster 2021-03-10T17:43:36.552200+0000 mgr.gibba020.yqfnwy (mgr.34427) 12150 : cluster [DBG] pgmap v6925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:37.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:37 gibba020 bash[25448]: cluster 2021-03-10T17:43:36.552200+0000 mgr.gibba020.yqfnwy (mgr.34427) 12150 : cluster [DBG] pgmap v6925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:39.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:39 gibba013 bash[29418]: cluster 2021-03-10T17:43:38.553662+0000 mgr.gibba020.yqfnwy (mgr.34427) 12151 : cluster [DBG] pgmap v6926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:39.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:39 gibba013 bash[30381]: cluster 2021-03-10T17:43:38.553662+0000 mgr.gibba020.yqfnwy (mgr.34427) 12151 : cluster [DBG] pgmap v6926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:39.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:39 gibba020 bash[25448]: cluster 2021-03-10T17:43:38.553662+0000 mgr.gibba020.yqfnwy (mgr.34427) 12151 : cluster [DBG] pgmap v6926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:41.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:41 gibba013 bash[29418]: cluster 2021-03-10T17:43:40.555444+0000 mgr.gibba020.yqfnwy (mgr.34427) 12152 : cluster [DBG] pgmap v6927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:41.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:41 gibba013 bash[30381]: cluster 2021-03-10T17:43:40.555444+0000 mgr.gibba020.yqfnwy (mgr.34427) 12152 : cluster [DBG] pgmap v6927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:41.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:41 gibba020 bash[25448]: cluster 2021-03-10T17:43:40.555444+0000 mgr.gibba020.yqfnwy (mgr.34427) 12152 : cluster [DBG] pgmap v6927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:43.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:43 gibba020 bash[25448]: cluster 2021-03-10T17:43:42.557142+0000 mgr.gibba020.yqfnwy (mgr.34427) 12153 : cluster [DBG] pgmap v6928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:44.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:43 gibba013 bash[29418]: cluster 2021-03-10T17:43:42.557142+0000 mgr.gibba020.yqfnwy (mgr.34427) 12153 : cluster [DBG] pgmap v6928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:44.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:43 gibba013 bash[30381]: cluster 2021-03-10T17:43:42.557142+0000 mgr.gibba020.yqfnwy (mgr.34427) 12153 : cluster [DBG] pgmap v6928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:45.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:45 gibba020 bash[25448]: cluster 2021-03-10T17:43:44.558578+0000 mgr.gibba020.yqfnwy (mgr.34427) 12154 : cluster [DBG] pgmap v6929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:46.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:45 gibba013 bash[29418]: cluster 2021-03-10T17:43:44.558578+0000 mgr.gibba020.yqfnwy (mgr.34427) 12154 : cluster [DBG] pgmap v6929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:46.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:45 gibba013 bash[30381]: cluster 2021-03-10T17:43:44.558578+0000 mgr.gibba020.yqfnwy (mgr.34427) 12154 : cluster [DBG] pgmap v6929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:46.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:46 gibba020 bash[25448]: cephadm 2021-03-10T17:43:45.512414+0000 mgr.gibba020.yqfnwy (mgr.34427) 12155 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:43:47.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:46 gibba013 bash[29418]: cephadm 2021-03-10T17:43:45.512414+0000 mgr.gibba020.yqfnwy (mgr.34427) 12155 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:43:47.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:46 gibba013 bash[30381]: cephadm 2021-03-10T17:43:45.512414+0000 mgr.gibba020.yqfnwy (mgr.34427) 12155 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:43:47.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:47 gibba020 bash[25448]: cluster 2021-03-10T17:43:46.560191+0000 mgr.gibba020.yqfnwy (mgr.34427) 12156 : cluster [DBG] pgmap v6930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:48.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:47 gibba013 bash[29418]: cluster 2021-03-10T17:43:46.560191+0000 mgr.gibba020.yqfnwy (mgr.34427) 12156 : cluster [DBG] pgmap v6930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:48.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:47 gibba013 bash[30381]: cluster 2021-03-10T17:43:46.560191+0000 mgr.gibba020.yqfnwy (mgr.34427) 12156 : cluster [DBG] pgmap v6930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:48.957 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:43:49.186 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:43:49.187 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 97s ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:43:49.187 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 33s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:43:49.187 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 33s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:43:49.187 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 33s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:43:49.188 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 97s ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:43:49.188 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 97s ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:43:49.188 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 33s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:43:49.188 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 97s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:43:49.188 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 97s ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:43:49.189 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 33s ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:43:49.189 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 97s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:43:49.189 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 97s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:43:49.189 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 97s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:43:49.189 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 97s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:43:49.190 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 33s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:43:49.190 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 33s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:43:49.190 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 33s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:43:49.190 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 33s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:43:49.192 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 33s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:43:49.192 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 33s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:43:49.435 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:43:49.435 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:43:49.435 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:43:49.435 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:43:49.436 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:43:49.436 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:43:49.436 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:43:49.436 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:43:49.437 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:43:49.437 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:43:49.437 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:43:49.437 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:43:49.437 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:43:49.438 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:43:49.438 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:43:49.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:49 gibba020 bash[25448]: cluster 2021-03-10T17:43:48.561612+0000 mgr.gibba020.yqfnwy (mgr.34427) 12157 : cluster [DBG] pgmap v6931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:49.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:49 gibba020 bash[25448]: audit 2021-03-10T17:43:48.945974+0000 mgr.gibba020.yqfnwy (mgr.34427) 12158 : audit [DBG] from='client.52206 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:43:49.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:49 gibba020 bash[25448]: audit 2021-03-10T17:43:49.170207+0000 mgr.gibba020.yqfnwy (mgr.34427) 12159 : audit [DBG] from='client.52212 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:43:49.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:49 gibba020 bash[25448]: audit 2021-03-10T17:43:49.432301+0000 mon.a (mon.0) 4237 : audit [DBG] from='client.? 172.21.2.113:0/700582189' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:50.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:49 gibba013 bash[29418]: cluster 2021-03-10T17:43:48.561612+0000 mgr.gibba020.yqfnwy (mgr.34427) 12157 : cluster [DBG] pgmap v6931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:50.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:49 gibba013 bash[29418]: audit 2021-03-10T17:43:48.945974+0000 mgr.gibba020.yqfnwy (mgr.34427) 12158 : audit [DBG] from='client.52206 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:43:50.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:49 gibba013 bash[29418]: audit 2021-03-10T17:43:49.170207+0000 mgr.gibba020.yqfnwy (mgr.34427) 12159 : audit [DBG] from='client.52212 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:43:50.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:49 gibba013 bash[29418]: audit 2021-03-10T17:43:49.432301+0000 mon.a (mon.0) 4237 : audit [DBG] from='client.? 172.21.2.113:0/700582189' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:50.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:49 gibba013 bash[30381]: cluster 2021-03-10T17:43:48.561612+0000 mgr.gibba020.yqfnwy (mgr.34427) 12157 : cluster [DBG] pgmap v6931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:50.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:49 gibba013 bash[30381]: audit 2021-03-10T17:43:48.945974+0000 mgr.gibba020.yqfnwy (mgr.34427) 12158 : audit [DBG] from='client.52206 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:43:50.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:49 gibba013 bash[30381]: audit 2021-03-10T17:43:49.170207+0000 mgr.gibba020.yqfnwy (mgr.34427) 12159 : audit [DBG] from='client.52212 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:43:50.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:49 gibba013 bash[30381]: audit 2021-03-10T17:43:49.432301+0000 mon.a (mon.0) 4237 : audit [DBG] from='client.? 172.21.2.113:0/700582189' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:43:51.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:51 gibba020 bash[25448]: cluster 2021-03-10T17:43:50.563296+0000 mgr.gibba020.yqfnwy (mgr.34427) 12160 : cluster [DBG] pgmap v6932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:52.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:51 gibba013 bash[29418]: cluster 2021-03-10T17:43:50.563296+0000 mgr.gibba020.yqfnwy (mgr.34427) 12160 : cluster [DBG] pgmap v6932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:52.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:51 gibba013 bash[30381]: cluster 2021-03-10T17:43:50.563296+0000 mgr.gibba020.yqfnwy (mgr.34427) 12160 : cluster [DBG] pgmap v6932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:53.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:53 gibba020 bash[25448]: cluster 2021-03-10T17:43:52.564803+0000 mgr.gibba020.yqfnwy (mgr.34427) 12161 : cluster [DBG] pgmap v6933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:54.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:53 gibba013 bash[29418]: cluster 2021-03-10T17:43:52.564803+0000 mgr.gibba020.yqfnwy (mgr.34427) 12161 : cluster [DBG] pgmap v6933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:54.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:53 gibba013 bash[30381]: cluster 2021-03-10T17:43:52.564803+0000 mgr.gibba020.yqfnwy (mgr.34427) 12161 : cluster [DBG] pgmap v6933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:55.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:55 gibba020 bash[25448]: cluster 2021-03-10T17:43:54.566265+0000 mgr.gibba020.yqfnwy (mgr.34427) 12162 : cluster [DBG] pgmap v6934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:56.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:55 gibba013 bash[29418]: cluster 2021-03-10T17:43:54.566265+0000 mgr.gibba020.yqfnwy (mgr.34427) 12162 : cluster [DBG] pgmap v6934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:56.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:55 gibba013 bash[30381]: cluster 2021-03-10T17:43:54.566265+0000 mgr.gibba020.yqfnwy (mgr.34427) 12162 : cluster [DBG] pgmap v6934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:57.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:57 gibba013 bash[29418]: cluster 2021-03-10T17:43:56.567153+0000 mgr.gibba020.yqfnwy (mgr.34427) 12163 : cluster [DBG] pgmap v6935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:57.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:57 gibba013 bash[30381]: cluster 2021-03-10T17:43:56.567153+0000 mgr.gibba020.yqfnwy (mgr.34427) 12163 : cluster [DBG] pgmap v6935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:57.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:57 gibba020 bash[25448]: cluster 2021-03-10T17:43:56.567153+0000 mgr.gibba020.yqfnwy (mgr.34427) 12163 : cluster [DBG] pgmap v6935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:43:59.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:43:59 gibba020 bash[25448]: cluster 2021-03-10T17:43:58.568620+0000 mgr.gibba020.yqfnwy (mgr.34427) 12164 : cluster [DBG] pgmap v6936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:00.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:43:59 gibba013 bash[29418]: cluster 2021-03-10T17:43:58.568620+0000 mgr.gibba020.yqfnwy (mgr.34427) 12164 : cluster [DBG] pgmap v6936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:00.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:43:59 gibba013 bash[30381]: cluster 2021-03-10T17:43:58.568620+0000 mgr.gibba020.yqfnwy (mgr.34427) 12164 : cluster [DBG] pgmap v6936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:01.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:01 gibba020 bash[25448]: cephadm 2021-03-10T17:44:00.528485+0000 mgr.gibba020.yqfnwy (mgr.34427) 12165 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:44:01.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:01 gibba020 bash[25448]: cluster 2021-03-10T17:44:00.570340+0000 mgr.gibba020.yqfnwy (mgr.34427) 12166 : cluster [DBG] pgmap v6937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:02.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:01 gibba013 bash[29418]: cephadm 2021-03-10T17:44:00.528485+0000 mgr.gibba020.yqfnwy (mgr.34427) 12165 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:44:02.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:01 gibba013 bash[29418]: cluster 2021-03-10T17:44:00.570340+0000 mgr.gibba020.yqfnwy (mgr.34427) 12166 : cluster [DBG] pgmap v6937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:02.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:01 gibba013 bash[30381]: cephadm 2021-03-10T17:44:00.528485+0000 mgr.gibba020.yqfnwy (mgr.34427) 12165 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:44:02.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:01 gibba013 bash[30381]: cluster 2021-03-10T17:44:00.570340+0000 mgr.gibba020.yqfnwy (mgr.34427) 12166 : cluster [DBG] pgmap v6937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:03.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:03 gibba020 bash[25448]: cluster 2021-03-10T17:44:02.571891+0000 mgr.gibba020.yqfnwy (mgr.34427) 12167 : cluster [DBG] pgmap v6938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:04.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:03 gibba013 bash[29418]: cluster 2021-03-10T17:44:02.571891+0000 mgr.gibba020.yqfnwy (mgr.34427) 12167 : cluster [DBG] pgmap v6938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:04.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:03 gibba013 bash[30381]: cluster 2021-03-10T17:44:02.571891+0000 mgr.gibba020.yqfnwy (mgr.34427) 12167 : cluster [DBG] pgmap v6938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:05.949 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:05 gibba020 bash[25448]: cluster 2021-03-10T17:44:04.573503+0000 mgr.gibba020.yqfnwy (mgr.34427) 12168 : cluster [DBG] pgmap v6939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:06.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:05 gibba013 bash[29418]: cluster 2021-03-10T17:44:04.573503+0000 mgr.gibba020.yqfnwy (mgr.34427) 12168 : cluster [DBG] pgmap v6939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:06.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:05 gibba013 bash[30381]: cluster 2021-03-10T17:44:04.573503+0000 mgr.gibba020.yqfnwy (mgr.34427) 12168 : cluster [DBG] pgmap v6939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:07.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:07 gibba013 bash[29418]: cluster 2021-03-10T17:44:06.574530+0000 mgr.gibba020.yqfnwy (mgr.34427) 12169 : cluster [DBG] pgmap v6940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:07.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:07 gibba013 bash[29418]: audit 2021-03-10T17:44:07.074128+0000 mon.a (mon.0) 4238 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:44:07.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:07 gibba013 bash[29418]: audit 2021-03-10T17:44:07.343852+0000 mon.a (mon.0) 4239 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:44:07.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:07 gibba013 bash[30381]: cluster 2021-03-10T17:44:06.574530+0000 mgr.gibba020.yqfnwy (mgr.34427) 12169 : cluster [DBG] pgmap v6940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:07.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:07 gibba013 bash[30381]: audit 2021-03-10T17:44:07.074128+0000 mon.a (mon.0) 4238 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:44:07.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:07 gibba013 bash[30381]: audit 2021-03-10T17:44:07.343852+0000 mon.a (mon.0) 4239 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:44:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:07 gibba020 bash[25448]: cluster 2021-03-10T17:44:06.574530+0000 mgr.gibba020.yqfnwy (mgr.34427) 12169 : cluster [DBG] pgmap v6940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:07 gibba020 bash[25448]: audit 2021-03-10T17:44:07.074128+0000 mon.a (mon.0) 4238 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:44:07.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:07 gibba020 bash[25448]: audit 2021-03-10T17:44:07.343852+0000 mon.a (mon.0) 4239 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:44:08.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:08 gibba013 bash[29418]: audit 2021-03-10T17:44:07.840147+0000 mon.a (mon.0) 4240 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T17:44:08.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:08 gibba013 bash[29418]: audit 2021-03-10T17:44:07.840967+0000 mon.a (mon.0) 4241 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:44:08.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:08 gibba013 bash[29418]: audit 2021-03-10T17:44:07.841636+0000 mon.a (mon.0) 4242 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:44:08.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:08 gibba013 bash[29418]: audit 2021-03-10T17:44:07.842365+0000 mon.a (mon.0) 4243 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:44:08.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:08 gibba013 bash[30381]: audit 2021-03-10T17:44:07.840147+0000 mon.a (mon.0) 4240 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T17:44:08.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:08 gibba013 bash[30381]: audit 2021-03-10T17:44:07.840967+0000 mon.a (mon.0) 4241 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:44:08.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:08 gibba013 bash[30381]: audit 2021-03-10T17:44:07.841636+0000 mon.a (mon.0) 4242 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:44:08.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:08 gibba013 bash[30381]: audit 2021-03-10T17:44:07.842365+0000 mon.a (mon.0) 4243 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:44:08.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:08 gibba020 bash[25448]: audit 2021-03-10T17:44:07.840147+0000 mon.a (mon.0) 4240 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2021-03-10T17:44:08.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:08 gibba020 bash[25448]: audit 2021-03-10T17:44:07.840967+0000 mon.a (mon.0) 4241 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:44:08.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:08 gibba020 bash[25448]: audit 2021-03-10T17:44:07.841636+0000 mon.a (mon.0) 4242 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:44:08.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:08 gibba020 bash[25448]: audit 2021-03-10T17:44:07.842365+0000 mon.a (mon.0) 4243 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T17:44:09.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:09 gibba013 bash[29418]: cluster 2021-03-10T17:44:08.576126+0000 mgr.gibba020.yqfnwy (mgr.34427) 12170 : cluster [DBG] pgmap v6941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:09.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:09 gibba013 bash[30381]: cluster 2021-03-10T17:44:08.576126+0000 mgr.gibba020.yqfnwy (mgr.34427) 12170 : cluster [DBG] pgmap v6941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:09.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:09 gibba020 bash[25448]: cluster 2021-03-10T17:44:08.576126+0000 mgr.gibba020.yqfnwy (mgr.34427) 12170 : cluster [DBG] pgmap v6941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:11.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:11 gibba020 bash[25448]: cluster 2021-03-10T17:44:10.577562+0000 mgr.gibba020.yqfnwy (mgr.34427) 12171 : cluster [DBG] pgmap v6942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:12.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:11 gibba013 bash[29418]: cluster 2021-03-10T17:44:10.577562+0000 mgr.gibba020.yqfnwy (mgr.34427) 12171 : cluster [DBG] pgmap v6942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:12.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:11 gibba013 bash[30381]: cluster 2021-03-10T17:44:10.577562+0000 mgr.gibba020.yqfnwy (mgr.34427) 12171 : cluster [DBG] pgmap v6942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:13.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:13 gibba020 bash[25448]: cluster 2021-03-10T17:44:12.579162+0000 mgr.gibba020.yqfnwy (mgr.34427) 12172 : cluster [DBG] pgmap v6943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:14.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:13 gibba013 bash[29418]: cluster 2021-03-10T17:44:12.579162+0000 mgr.gibba020.yqfnwy (mgr.34427) 12172 : cluster [DBG] pgmap v6943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:14.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:13 gibba013 bash[30381]: cluster 2021-03-10T17:44:12.579162+0000 mgr.gibba020.yqfnwy (mgr.34427) 12172 : cluster [DBG] pgmap v6943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:15.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:15 gibba020 bash[25448]: cluster 2021-03-10T17:44:14.580878+0000 mgr.gibba020.yqfnwy (mgr.34427) 12173 : cluster [DBG] pgmap v6944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:15.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:15 gibba020 bash[25448]: audit 2021-03-10T17:44:15.545767+0000 mon.a (mon.0) 4244 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:44:16.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:15 gibba013 bash[29418]: cluster 2021-03-10T17:44:14.580878+0000 mgr.gibba020.yqfnwy (mgr.34427) 12173 : cluster [DBG] pgmap v6944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:16.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:15 gibba013 bash[29418]: audit 2021-03-10T17:44:15.545767+0000 mon.a (mon.0) 4244 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:44:16.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:15 gibba013 bash[30381]: cluster 2021-03-10T17:44:14.580878+0000 mgr.gibba020.yqfnwy (mgr.34427) 12173 : cluster [DBG] pgmap v6944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:16.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:15 gibba013 bash[30381]: audit 2021-03-10T17:44:15.545767+0000 mon.a (mon.0) 4244 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:44:17.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[29418]: cephadm 2021-03-10T17:44:15.550538+0000 mgr.gibba020.yqfnwy (mgr.34427) 12174 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:44:17.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[29418]: cephadm 2021-03-10T17:44:15.552489+0000 mgr.gibba020.yqfnwy (mgr.34427) 12175 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:44:17.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[29418]: audit 2021-03-10T17:44:15.781451+0000 mon.a (mon.0) 4245 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:44:17.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[29418]: cephadm 2021-03-10T17:44:15.783460+0000 mgr.gibba020.yqfnwy (mgr.34427) 12176 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:44:17.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[29418]: audit 2021-03-10T17:44:15.784646+0000 mon.a (mon.0) 4246 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:44:17.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[29418]: cephadm 2021-03-10T17:44:15.785153+0000 mgr.gibba020.yqfnwy (mgr.34427) 12177 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:44:17.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[29418]: audit 2021-03-10T17:44:15.785942+0000 mon.a (mon.0) 4247 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:17.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[29418]: cephadm 2021-03-10T17:44:15.786410+0000 mgr.gibba020.yqfnwy (mgr.34427) 12178 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:44:17.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[29418]: cephadm 2021-03-10T17:44:15.786452+0000 mgr.gibba020.yqfnwy (mgr.34427) 12179 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:44:17.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[29418]: audit 2021-03-10T17:44:15.787251+0000 mon.a (mon.0) 4248 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:17.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[29418]: cephadm 2021-03-10T17:44:15.787601+0000 mgr.gibba020.yqfnwy (mgr.34427) 12180 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:44:17.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[29418]: cephadm 2021-03-10T17:44:15.787644+0000 mgr.gibba020.yqfnwy (mgr.34427) 12181 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:44:17.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[29418]: audit 2021-03-10T17:44:15.788376+0000 mon.a (mon.0) 4249 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:17.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[29418]: cephadm 2021-03-10T17:44:15.788840+0000 mgr.gibba020.yqfnwy (mgr.34427) 12182 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:44:17.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[29418]: cephadm 2021-03-10T17:44:15.789856+0000 mgr.gibba020.yqfnwy (mgr.34427) 12183 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:44:17.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[29418]: cephadm 2021-03-10T17:44:15.789896+0000 mgr.gibba020.yqfnwy (mgr.34427) 12184 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:44:17.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[29418]: audit 2021-03-10T17:44:15.790942+0000 mon.a (mon.0) 4250 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:17.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[29418]: cephadm 2021-03-10T17:44:15.791406+0000 mgr.gibba020.yqfnwy (mgr.34427) 12185 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:44:17.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[29418]: cephadm 2021-03-10T17:44:15.791786+0000 mgr.gibba020.yqfnwy (mgr.34427) 12186 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:44:17.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[29418]: audit 2021-03-10T17:44:15.792684+0000 mon.a (mon.0) 4251 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:17.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[29418]: cephadm 2021-03-10T17:44:15.793153+0000 mgr.gibba020.yqfnwy (mgr.34427) 12187 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:44:17.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[29418]: cephadm 2021-03-10T17:44:15.793198+0000 mgr.gibba020.yqfnwy (mgr.34427) 12188 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:44:17.138 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[29418]: cephadm 2021-03-10T17:44:15.793322+0000 mgr.gibba020.yqfnwy (mgr.34427) 12189 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:44:17.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[30381]: cephadm 2021-03-10T17:44:15.550538+0000 mgr.gibba020.yqfnwy (mgr.34427) 12174 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:44:17.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[30381]: cephadm 2021-03-10T17:44:15.552489+0000 mgr.gibba020.yqfnwy (mgr.34427) 12175 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:44:17.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[30381]: audit 2021-03-10T17:44:15.781451+0000 mon.a (mon.0) 4245 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:44:17.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[30381]: cephadm 2021-03-10T17:44:15.783460+0000 mgr.gibba020.yqfnwy (mgr.34427) 12176 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:44:17.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[30381]: audit 2021-03-10T17:44:15.784646+0000 mon.a (mon.0) 4246 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:44:17.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[30381]: cephadm 2021-03-10T17:44:15.785153+0000 mgr.gibba020.yqfnwy (mgr.34427) 12177 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:44:17.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[30381]: audit 2021-03-10T17:44:15.785942+0000 mon.a (mon.0) 4247 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:17.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[30381]: cephadm 2021-03-10T17:44:15.786410+0000 mgr.gibba020.yqfnwy (mgr.34427) 12178 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:44:17.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[30381]: cephadm 2021-03-10T17:44:15.786452+0000 mgr.gibba020.yqfnwy (mgr.34427) 12179 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:44:17.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[30381]: audit 2021-03-10T17:44:15.787251+0000 mon.a (mon.0) 4248 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:17.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[30381]: cephadm 2021-03-10T17:44:15.787601+0000 mgr.gibba020.yqfnwy (mgr.34427) 12180 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:44:17.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[30381]: cephadm 2021-03-10T17:44:15.787644+0000 mgr.gibba020.yqfnwy (mgr.34427) 12181 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:44:17.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[30381]: audit 2021-03-10T17:44:15.788376+0000 mon.a (mon.0) 4249 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:17.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[30381]: cephadm 2021-03-10T17:44:15.788840+0000 mgr.gibba020.yqfnwy (mgr.34427) 12182 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:44:17.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[30381]: cephadm 2021-03-10T17:44:15.789856+0000 mgr.gibba020.yqfnwy (mgr.34427) 12183 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:44:17.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[30381]: cephadm 2021-03-10T17:44:15.789896+0000 mgr.gibba020.yqfnwy (mgr.34427) 12184 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:44:17.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[30381]: audit 2021-03-10T17:44:15.790942+0000 mon.a (mon.0) 4250 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:17.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[30381]: cephadm 2021-03-10T17:44:15.791406+0000 mgr.gibba020.yqfnwy (mgr.34427) 12185 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:44:17.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[30381]: cephadm 2021-03-10T17:44:15.791786+0000 mgr.gibba020.yqfnwy (mgr.34427) 12186 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:44:17.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[30381]: audit 2021-03-10T17:44:15.792684+0000 mon.a (mon.0) 4251 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:17.143 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[30381]: cephadm 2021-03-10T17:44:15.793153+0000 mgr.gibba020.yqfnwy (mgr.34427) 12187 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:44:17.143 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[30381]: cephadm 2021-03-10T17:44:15.793198+0000 mgr.gibba020.yqfnwy (mgr.34427) 12188 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:44:17.143 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:16 gibba013 bash[30381]: cephadm 2021-03-10T17:44:15.793322+0000 mgr.gibba020.yqfnwy (mgr.34427) 12189 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:44:17.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:16 gibba020 bash[25448]: cephadm 2021-03-10T17:44:15.550538+0000 mgr.gibba020.yqfnwy (mgr.34427) 12174 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:44:17.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:16 gibba020 bash[25448]: cephadm 2021-03-10T17:44:15.552489+0000 mgr.gibba020.yqfnwy (mgr.34427) 12175 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:44:17.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:16 gibba020 bash[25448]: audit 2021-03-10T17:44:15.781451+0000 mon.a (mon.0) 4245 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:44:17.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:16 gibba020 bash[25448]: cephadm 2021-03-10T17:44:15.783460+0000 mgr.gibba020.yqfnwy (mgr.34427) 12176 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:44:17.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:16 gibba020 bash[25448]: audit 2021-03-10T17:44:15.784646+0000 mon.a (mon.0) 4246 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:44:17.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:16 gibba020 bash[25448]: cephadm 2021-03-10T17:44:15.785153+0000 mgr.gibba020.yqfnwy (mgr.34427) 12177 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:44:17.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:16 gibba020 bash[25448]: audit 2021-03-10T17:44:15.785942+0000 mon.a (mon.0) 4247 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:17.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:16 gibba020 bash[25448]: cephadm 2021-03-10T17:44:15.786410+0000 mgr.gibba020.yqfnwy (mgr.34427) 12178 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:44:17.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:16 gibba020 bash[25448]: cephadm 2021-03-10T17:44:15.786452+0000 mgr.gibba020.yqfnwy (mgr.34427) 12179 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:44:17.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:16 gibba020 bash[25448]: audit 2021-03-10T17:44:15.787251+0000 mon.a (mon.0) 4248 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:17.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:16 gibba020 bash[25448]: cephadm 2021-03-10T17:44:15.787601+0000 mgr.gibba020.yqfnwy (mgr.34427) 12180 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:44:17.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:16 gibba020 bash[25448]: cephadm 2021-03-10T17:44:15.787644+0000 mgr.gibba020.yqfnwy (mgr.34427) 12181 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:44:17.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:16 gibba020 bash[25448]: audit 2021-03-10T17:44:15.788376+0000 mon.a (mon.0) 4249 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:17.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:16 gibba020 bash[25448]: cephadm 2021-03-10T17:44:15.788840+0000 mgr.gibba020.yqfnwy (mgr.34427) 12182 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:44:17.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:16 gibba020 bash[25448]: cephadm 2021-03-10T17:44:15.789856+0000 mgr.gibba020.yqfnwy (mgr.34427) 12183 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:44:17.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:16 gibba020 bash[25448]: cephadm 2021-03-10T17:44:15.789896+0000 mgr.gibba020.yqfnwy (mgr.34427) 12184 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:44:17.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:16 gibba020 bash[25448]: audit 2021-03-10T17:44:15.790942+0000 mon.a (mon.0) 4250 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:17.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:16 gibba020 bash[25448]: cephadm 2021-03-10T17:44:15.791406+0000 mgr.gibba020.yqfnwy (mgr.34427) 12185 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:44:17.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:16 gibba020 bash[25448]: cephadm 2021-03-10T17:44:15.791786+0000 mgr.gibba020.yqfnwy (mgr.34427) 12186 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:44:17.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:16 gibba020 bash[25448]: audit 2021-03-10T17:44:15.792684+0000 mon.a (mon.0) 4251 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:17.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:16 gibba020 bash[25448]: cephadm 2021-03-10T17:44:15.793153+0000 mgr.gibba020.yqfnwy (mgr.34427) 12187 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:44:17.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:16 gibba020 bash[25448]: cephadm 2021-03-10T17:44:15.793198+0000 mgr.gibba020.yqfnwy (mgr.34427) 12188 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:44:17.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:16 gibba020 bash[25448]: cephadm 2021-03-10T17:44:15.793322+0000 mgr.gibba020.yqfnwy (mgr.34427) 12189 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:44:18.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:17 gibba013 bash[29418]: cluster 2021-03-10T17:44:16.581675+0000 mgr.gibba020.yqfnwy (mgr.34427) 12190 : cluster [DBG] pgmap v6945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:18.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:17 gibba013 bash[30381]: cluster 2021-03-10T17:44:16.581675+0000 mgr.gibba020.yqfnwy (mgr.34427) 12190 : cluster [DBG] pgmap v6945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:18.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:17 gibba020 bash[25448]: cluster 2021-03-10T17:44:16.581675+0000 mgr.gibba020.yqfnwy (mgr.34427) 12190 : cluster [DBG] pgmap v6945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:19.676 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:44:19.904 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:44:19.904 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 2m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:44:19.905 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 64s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:44:19.905 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 64s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:44:19.905 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 64s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:44:19.905 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 2m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:44:19.906 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 2m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:44:19.906 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 64s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:44:19.906 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 2m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:44:19.906 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:44:19.907 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 64s ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:44:19.907 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:44:19.907 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:44:19.907 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:44:19.907 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:44:19.908 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 64s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:44:19.908 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 64s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:44:19.908 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 64s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:44:19.908 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 64s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:44:19.909 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 64s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:44:19.909 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 64s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:44:20.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:19 gibba013 bash[29418]: cluster 2021-03-10T17:44:18.583017+0000 mgr.gibba020.yqfnwy (mgr.34427) 12191 : cluster [DBG] pgmap v6946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:20.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:19 gibba013 bash[30381]: cluster 2021-03-10T17:44:18.583017+0000 mgr.gibba020.yqfnwy (mgr.34427) 12191 : cluster [DBG] pgmap v6946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:20.155 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:44:20.155 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:44:20.155 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:44:20.156 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:44:20.156 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:44:20.156 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:44:20.156 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:44:20.157 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:44:20.157 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:44:20.157 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:44:20.157 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:44:20.157 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:44:20.158 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:44:20.158 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:44:20.158 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:44:20.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:19 gibba020 bash[25448]: cluster 2021-03-10T17:44:18.583017+0000 mgr.gibba020.yqfnwy (mgr.34427) 12191 : cluster [DBG] pgmap v6946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:21.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:20 gibba013 bash[29418]: audit 2021-03-10T17:44:19.664444+0000 mgr.gibba020.yqfnwy (mgr.34427) 12192 : audit [DBG] from='client.62203 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:44:21.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:20 gibba013 bash[29418]: audit 2021-03-10T17:44:19.888667+0000 mgr.gibba020.yqfnwy (mgr.34427) 12193 : audit [DBG] from='client.52230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:44:21.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:20 gibba013 bash[29418]: audit 2021-03-10T17:44:20.152424+0000 mon.a (mon.0) 4252 : audit [DBG] from='client.? 172.21.2.113:0/3276475188' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:21.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:20 gibba013 bash[30381]: audit 2021-03-10T17:44:19.664444+0000 mgr.gibba020.yqfnwy (mgr.34427) 12192 : audit [DBG] from='client.62203 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:44:21.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:20 gibba013 bash[30381]: audit 2021-03-10T17:44:19.888667+0000 mgr.gibba020.yqfnwy (mgr.34427) 12193 : audit [DBG] from='client.52230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:44:21.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:20 gibba013 bash[30381]: audit 2021-03-10T17:44:20.152424+0000 mon.a (mon.0) 4252 : audit [DBG] from='client.? 172.21.2.113:0/3276475188' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:21.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:20 gibba020 bash[25448]: audit 2021-03-10T17:44:19.664444+0000 mgr.gibba020.yqfnwy (mgr.34427) 12192 : audit [DBG] from='client.62203 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:44:21.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:20 gibba020 bash[25448]: audit 2021-03-10T17:44:19.888667+0000 mgr.gibba020.yqfnwy (mgr.34427) 12193 : audit [DBG] from='client.52230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:44:21.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:20 gibba020 bash[25448]: audit 2021-03-10T17:44:20.152424+0000 mon.a (mon.0) 4252 : audit [DBG] from='client.? 172.21.2.113:0/3276475188' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:22.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:21 gibba013 bash[29418]: cluster 2021-03-10T17:44:20.584822+0000 mgr.gibba020.yqfnwy (mgr.34427) 12194 : cluster [DBG] pgmap v6947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:22.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:21 gibba013 bash[30381]: cluster 2021-03-10T17:44:20.584822+0000 mgr.gibba020.yqfnwy (mgr.34427) 12194 : cluster [DBG] pgmap v6947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:22.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:21 gibba020 bash[25448]: cluster 2021-03-10T17:44:20.584822+0000 mgr.gibba020.yqfnwy (mgr.34427) 12194 : cluster [DBG] pgmap v6947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:24.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:23 gibba013 bash[29418]: cluster 2021-03-10T17:44:22.586099+0000 mgr.gibba020.yqfnwy (mgr.34427) 12195 : cluster [DBG] pgmap v6948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:24.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:23 gibba013 bash[30381]: cluster 2021-03-10T17:44:22.586099+0000 mgr.gibba020.yqfnwy (mgr.34427) 12195 : cluster [DBG] pgmap v6948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:24.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:23 gibba020 bash[25448]: cluster 2021-03-10T17:44:22.586099+0000 mgr.gibba020.yqfnwy (mgr.34427) 12195 : cluster [DBG] pgmap v6948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:26.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:25 gibba013 bash[29418]: cluster 2021-03-10T17:44:24.587684+0000 mgr.gibba020.yqfnwy (mgr.34427) 12196 : cluster [DBG] pgmap v6949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:26.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:25 gibba013 bash[30381]: cluster 2021-03-10T17:44:24.587684+0000 mgr.gibba020.yqfnwy (mgr.34427) 12196 : cluster [DBG] pgmap v6949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:26.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:25 gibba020 bash[25448]: cluster 2021-03-10T17:44:24.587684+0000 mgr.gibba020.yqfnwy (mgr.34427) 12196 : cluster [DBG] pgmap v6949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:27.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:27 gibba013 bash[29418]: cluster 2021-03-10T17:44:26.589485+0000 mgr.gibba020.yqfnwy (mgr.34427) 12197 : cluster [DBG] pgmap v6950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:27.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:27 gibba013 bash[30381]: cluster 2021-03-10T17:44:26.589485+0000 mgr.gibba020.yqfnwy (mgr.34427) 12197 : cluster [DBG] pgmap v6950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:27.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:27 gibba020 bash[25448]: cluster 2021-03-10T17:44:26.589485+0000 mgr.gibba020.yqfnwy (mgr.34427) 12197 : cluster [DBG] pgmap v6950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:29.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:29 gibba020 bash[25448]: cluster 2021-03-10T17:44:28.590874+0000 mgr.gibba020.yqfnwy (mgr.34427) 12198 : cluster [DBG] pgmap v6951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:30.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:29 gibba013 bash[29418]: cluster 2021-03-10T17:44:28.590874+0000 mgr.gibba020.yqfnwy (mgr.34427) 12198 : cluster [DBG] pgmap v6951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:30.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:29 gibba013 bash[30381]: cluster 2021-03-10T17:44:28.590874+0000 mgr.gibba020.yqfnwy (mgr.34427) 12198 : cluster [DBG] pgmap v6951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:31.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:31 gibba020 bash[25448]: cluster 2021-03-10T17:44:30.592526+0000 mgr.gibba020.yqfnwy (mgr.34427) 12199 : cluster [DBG] pgmap v6952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:31.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:31 gibba020 bash[25448]: cephadm 2021-03-10T17:44:30.804935+0000 mgr.gibba020.yqfnwy (mgr.34427) 12200 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:44:32.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:31 gibba013 bash[29418]: cluster 2021-03-10T17:44:30.592526+0000 mgr.gibba020.yqfnwy (mgr.34427) 12199 : cluster [DBG] pgmap v6952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:32.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:31 gibba013 bash[29418]: cephadm 2021-03-10T17:44:30.804935+0000 mgr.gibba020.yqfnwy (mgr.34427) 12200 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:44:32.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:31 gibba013 bash[30381]: cluster 2021-03-10T17:44:30.592526+0000 mgr.gibba020.yqfnwy (mgr.34427) 12199 : cluster [DBG] pgmap v6952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:32.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:31 gibba013 bash[30381]: cephadm 2021-03-10T17:44:30.804935+0000 mgr.gibba020.yqfnwy (mgr.34427) 12200 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:44:33.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:33 gibba020 bash[25448]: cluster 2021-03-10T17:44:32.593834+0000 mgr.gibba020.yqfnwy (mgr.34427) 12201 : cluster [DBG] pgmap v6953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:34.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:33 gibba013 bash[29418]: cluster 2021-03-10T17:44:32.593834+0000 mgr.gibba020.yqfnwy (mgr.34427) 12201 : cluster [DBG] pgmap v6953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:34.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:33 gibba013 bash[30381]: cluster 2021-03-10T17:44:32.593834+0000 mgr.gibba020.yqfnwy (mgr.34427) 12201 : cluster [DBG] pgmap v6953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:35.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:35 gibba020 bash[25448]: cluster 2021-03-10T17:44:34.595325+0000 mgr.gibba020.yqfnwy (mgr.34427) 12202 : cluster [DBG] pgmap v6954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:36.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:35 gibba013 bash[29418]: cluster 2021-03-10T17:44:34.595325+0000 mgr.gibba020.yqfnwy (mgr.34427) 12202 : cluster [DBG] pgmap v6954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:36.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:35 gibba013 bash[30381]: cluster 2021-03-10T17:44:34.595325+0000 mgr.gibba020.yqfnwy (mgr.34427) 12202 : cluster [DBG] pgmap v6954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:37.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:37 gibba013 bash[29418]: cluster 2021-03-10T17:44:36.596865+0000 mgr.gibba020.yqfnwy (mgr.34427) 12203 : cluster [DBG] pgmap v6955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:37.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:37 gibba013 bash[30381]: cluster 2021-03-10T17:44:36.596865+0000 mgr.gibba020.yqfnwy (mgr.34427) 12203 : cluster [DBG] pgmap v6955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:37.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:37 gibba020 bash[25448]: cluster 2021-03-10T17:44:36.596865+0000 mgr.gibba020.yqfnwy (mgr.34427) 12203 : cluster [DBG] pgmap v6955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:39.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:39 gibba020 bash[25448]: cluster 2021-03-10T17:44:38.598253+0000 mgr.gibba020.yqfnwy (mgr.34427) 12204 : cluster [DBG] pgmap v6956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:40.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:39 gibba013 bash[29418]: cluster 2021-03-10T17:44:38.598253+0000 mgr.gibba020.yqfnwy (mgr.34427) 12204 : cluster [DBG] pgmap v6956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:40.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:39 gibba013 bash[30381]: cluster 2021-03-10T17:44:38.598253+0000 mgr.gibba020.yqfnwy (mgr.34427) 12204 : cluster [DBG] pgmap v6956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:41.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:41 gibba020 bash[25448]: cluster 2021-03-10T17:44:40.599990+0000 mgr.gibba020.yqfnwy (mgr.34427) 12205 : cluster [DBG] pgmap v6957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:42.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:41 gibba013 bash[29418]: cluster 2021-03-10T17:44:40.599990+0000 mgr.gibba020.yqfnwy (mgr.34427) 12205 : cluster [DBG] pgmap v6957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:42.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:41 gibba013 bash[30381]: cluster 2021-03-10T17:44:40.599990+0000 mgr.gibba020.yqfnwy (mgr.34427) 12205 : cluster [DBG] pgmap v6957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:43.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:43 gibba020 bash[25448]: cluster 2021-03-10T17:44:42.601526+0000 mgr.gibba020.yqfnwy (mgr.34427) 12206 : cluster [DBG] pgmap v6958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:44.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:43 gibba013 bash[29418]: cluster 2021-03-10T17:44:42.601526+0000 mgr.gibba020.yqfnwy (mgr.34427) 12206 : cluster [DBG] pgmap v6958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:44.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:43 gibba013 bash[30381]: cluster 2021-03-10T17:44:42.601526+0000 mgr.gibba020.yqfnwy (mgr.34427) 12206 : cluster [DBG] pgmap v6958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:45.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:45 gibba020 bash[25448]: cluster 2021-03-10T17:44:44.603236+0000 mgr.gibba020.yqfnwy (mgr.34427) 12207 : cluster [DBG] pgmap v6959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:46.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:45 gibba013 bash[29418]: cluster 2021-03-10T17:44:44.603236+0000 mgr.gibba020.yqfnwy (mgr.34427) 12207 : cluster [DBG] pgmap v6959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:46.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:45 gibba013 bash[30381]: cluster 2021-03-10T17:44:44.603236+0000 mgr.gibba020.yqfnwy (mgr.34427) 12207 : cluster [DBG] pgmap v6959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:46.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:46 gibba020 bash[25448]: cephadm 2021-03-10T17:44:45.820999+0000 mgr.gibba020.yqfnwy (mgr.34427) 12208 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:44:47.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:46 gibba013 bash[29418]: cephadm 2021-03-10T17:44:45.820999+0000 mgr.gibba020.yqfnwy (mgr.34427) 12208 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:44:47.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:46 gibba013 bash[30381]: cephadm 2021-03-10T17:44:45.820999+0000 mgr.gibba020.yqfnwy (mgr.34427) 12208 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:44:47.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:47 gibba020 bash[25448]: cluster 2021-03-10T17:44:46.604922+0000 mgr.gibba020.yqfnwy (mgr.34427) 12209 : cluster [DBG] pgmap v6960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:48.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:47 gibba013 bash[29418]: cluster 2021-03-10T17:44:46.604922+0000 mgr.gibba020.yqfnwy (mgr.34427) 12209 : cluster [DBG] pgmap v6960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:48.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:47 gibba013 bash[30381]: cluster 2021-03-10T17:44:46.604922+0000 mgr.gibba020.yqfnwy (mgr.34427) 12209 : cluster [DBG] pgmap v6960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:50.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:49 gibba013 bash[29418]: cluster 2021-03-10T17:44:48.606299+0000 mgr.gibba020.yqfnwy (mgr.34427) 12210 : cluster [DBG] pgmap v6961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:50.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:49 gibba013 bash[30381]: cluster 2021-03-10T17:44:48.606299+0000 mgr.gibba020.yqfnwy (mgr.34427) 12210 : cluster [DBG] pgmap v6961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:50.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:49 gibba020 bash[25448]: cluster 2021-03-10T17:44:48.606299+0000 mgr.gibba020.yqfnwy (mgr.34427) 12210 : cluster [DBG] pgmap v6961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:50.398 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:44:50.627 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:44:50.628 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 2m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:44:50.628 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 95s ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:44:50.628 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 95s ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:44:50.628 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 95s ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:44:50.628 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 2m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:44:50.629 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 2m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:44:50.629 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 95s ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:44:50.629 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 2m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:44:50.629 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:44:50.630 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 95s ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:44:50.630 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:44:50.630 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:44:50.630 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:44:50.631 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:44:50.631 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 95s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:44:50.631 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 95s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:44:50.631 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 95s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:44:50.631 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 95s ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:44:50.632 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 95s ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:44:50.632 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 95s ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:44:50.874 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:44:50.875 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:44:50.875 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:44:50.876 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:44:50.876 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:44:50.876 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:44:50.876 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:44:50.877 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:44:50.877 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:44:50.878 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:44:50.878 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:44:50.878 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:44:50.879 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:44:50.880 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:44:50.880 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:44:52.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:51 gibba013 bash[29418]: audit 2021-03-10T17:44:50.385503+0000 mgr.gibba020.yqfnwy (mgr.34427) 12211 : audit [DBG] from='client.62221 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:44:52.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:51 gibba013 bash[29418]: cluster 2021-03-10T17:44:50.607830+0000 mgr.gibba020.yqfnwy (mgr.34427) 12212 : cluster [DBG] pgmap v6962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:52.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:51 gibba013 bash[29418]: audit 2021-03-10T17:44:50.611632+0000 mgr.gibba020.yqfnwy (mgr.34427) 12213 : audit [DBG] from='client.52248 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:44:52.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:51 gibba013 bash[29418]: audit 2021-03-10T17:44:50.871664+0000 mon.c (mon.1) 183 : audit [DBG] from='client.? 172.21.2.113:0/1600386740' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:52.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:51 gibba013 bash[30381]: audit 2021-03-10T17:44:50.385503+0000 mgr.gibba020.yqfnwy (mgr.34427) 12211 : audit [DBG] from='client.62221 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:44:52.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:51 gibba013 bash[30381]: cluster 2021-03-10T17:44:50.607830+0000 mgr.gibba020.yqfnwy (mgr.34427) 12212 : cluster [DBG] pgmap v6962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:52.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:51 gibba013 bash[30381]: audit 2021-03-10T17:44:50.611632+0000 mgr.gibba020.yqfnwy (mgr.34427) 12213 : audit [DBG] from='client.52248 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:44:52.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:51 gibba013 bash[30381]: audit 2021-03-10T17:44:50.871664+0000 mon.c (mon.1) 183 : audit [DBG] from='client.? 172.21.2.113:0/1600386740' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:52.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:51 gibba020 bash[25448]: audit 2021-03-10T17:44:50.385503+0000 mgr.gibba020.yqfnwy (mgr.34427) 12211 : audit [DBG] from='client.62221 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:44:52.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:51 gibba020 bash[25448]: cluster 2021-03-10T17:44:50.607830+0000 mgr.gibba020.yqfnwy (mgr.34427) 12212 : cluster [DBG] pgmap v6962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:52.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:51 gibba020 bash[25448]: audit 2021-03-10T17:44:50.611632+0000 mgr.gibba020.yqfnwy (mgr.34427) 12213 : audit [DBG] from='client.52248 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:44:52.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:51 gibba020 bash[25448]: audit 2021-03-10T17:44:50.871664+0000 mon.c (mon.1) 183 : audit [DBG] from='client.? 172.21.2.113:0/1600386740' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:44:54.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:53 gibba013 bash[29418]: cluster 2021-03-10T17:44:52.609248+0000 mgr.gibba020.yqfnwy (mgr.34427) 12214 : cluster [DBG] pgmap v6963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:54.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:53 gibba013 bash[30381]: cluster 2021-03-10T17:44:52.609248+0000 mgr.gibba020.yqfnwy (mgr.34427) 12214 : cluster [DBG] pgmap v6963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:54.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:53 gibba020 bash[25448]: cluster 2021-03-10T17:44:52.609248+0000 mgr.gibba020.yqfnwy (mgr.34427) 12214 : cluster [DBG] pgmap v6963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:56.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:55 gibba013 bash[29418]: cluster 2021-03-10T17:44:54.610839+0000 mgr.gibba020.yqfnwy (mgr.34427) 12215 : cluster [DBG] pgmap v6964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:56.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:55 gibba013 bash[30381]: cluster 2021-03-10T17:44:54.610839+0000 mgr.gibba020.yqfnwy (mgr.34427) 12215 : cluster [DBG] pgmap v6964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:56.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:55 gibba020 bash[25448]: cluster 2021-03-10T17:44:54.610839+0000 mgr.gibba020.yqfnwy (mgr.34427) 12215 : cluster [DBG] pgmap v6964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:57.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:57 gibba013 bash[29418]: cluster 2021-03-10T17:44:56.611836+0000 mgr.gibba020.yqfnwy (mgr.34427) 12216 : cluster [DBG] pgmap v6965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:57.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:57 gibba013 bash[30381]: cluster 2021-03-10T17:44:56.611836+0000 mgr.gibba020.yqfnwy (mgr.34427) 12216 : cluster [DBG] pgmap v6965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:57.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:57 gibba020 bash[25448]: cluster 2021-03-10T17:44:56.611836+0000 mgr.gibba020.yqfnwy (mgr.34427) 12216 : cluster [DBG] pgmap v6965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:44:59.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:44:59 gibba020 bash[25448]: cluster 2021-03-10T17:44:58.613167+0000 mgr.gibba020.yqfnwy (mgr.34427) 12217 : cluster [DBG] pgmap v6966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:00.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:44:59 gibba013 bash[29418]: cluster 2021-03-10T17:44:58.613167+0000 mgr.gibba020.yqfnwy (mgr.34427) 12217 : cluster [DBG] pgmap v6966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:00.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:44:59 gibba013 bash[30381]: cluster 2021-03-10T17:44:58.613167+0000 mgr.gibba020.yqfnwy (mgr.34427) 12217 : cluster [DBG] pgmap v6966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:01.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:01 gibba020 bash[25448]: cluster 2021-03-10T17:45:00.614902+0000 mgr.gibba020.yqfnwy (mgr.34427) 12218 : cluster [DBG] pgmap v6967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:01.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:01 gibba020 bash[25448]: cephadm 2021-03-10T17:45:00.829684+0000 mgr.gibba020.yqfnwy (mgr.34427) 12219 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:45:01.965 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:01 gibba013 bash[29418]: cluster 2021-03-10T17:45:00.614902+0000 mgr.gibba020.yqfnwy (mgr.34427) 12218 : cluster [DBG] pgmap v6967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:01.966 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:01 gibba013 bash[29418]: cephadm 2021-03-10T17:45:00.829684+0000 mgr.gibba020.yqfnwy (mgr.34427) 12219 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:45:01.966 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:01 gibba013 bash[30381]: cluster 2021-03-10T17:45:00.614902+0000 mgr.gibba020.yqfnwy (mgr.34427) 12218 : cluster [DBG] pgmap v6967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:01.967 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:01 gibba013 bash[30381]: cephadm 2021-03-10T17:45:00.829684+0000 mgr.gibba020.yqfnwy (mgr.34427) 12219 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:45:03.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:03 gibba020 bash[25448]: cluster 2021-03-10T17:45:02.616368+0000 mgr.gibba020.yqfnwy (mgr.34427) 12220 : cluster [DBG] pgmap v6968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:04.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:03 gibba013 bash[29418]: cluster 2021-03-10T17:45:02.616368+0000 mgr.gibba020.yqfnwy (mgr.34427) 12220 : cluster [DBG] pgmap v6968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:04.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:03 gibba013 bash[30381]: cluster 2021-03-10T17:45:02.616368+0000 mgr.gibba020.yqfnwy (mgr.34427) 12220 : cluster [DBG] pgmap v6968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:06.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:05 gibba013 bash[29418]: cluster 2021-03-10T17:45:04.617982+0000 mgr.gibba020.yqfnwy (mgr.34427) 12221 : cluster [DBG] pgmap v6969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:06.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:05 gibba013 bash[30381]: cluster 2021-03-10T17:45:04.617982+0000 mgr.gibba020.yqfnwy (mgr.34427) 12221 : cluster [DBG] pgmap v6969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:06.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:05 gibba020 bash[25448]: cluster 2021-03-10T17:45:04.617982+0000 mgr.gibba020.yqfnwy (mgr.34427) 12221 : cluster [DBG] pgmap v6969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:07.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:07 gibba013 bash[29418]: cluster 2021-03-10T17:45:06.619034+0000 mgr.gibba020.yqfnwy (mgr.34427) 12222 : cluster [DBG] pgmap v6970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:07.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:07 gibba013 bash[29418]: audit 2021-03-10T17:45:07.079455+0000 mon.a (mon.0) 4253 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:45:07.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:07 gibba013 bash[29418]: audit 2021-03-10T17:45:07.350593+0000 mon.a (mon.0) 4254 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:45:07.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:07 gibba013 bash[30381]: cluster 2021-03-10T17:45:06.619034+0000 mgr.gibba020.yqfnwy (mgr.34427) 12222 : cluster [DBG] pgmap v6970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:07.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:07 gibba013 bash[30381]: audit 2021-03-10T17:45:07.079455+0000 mon.a (mon.0) 4253 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:45:07.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:07 gibba013 bash[30381]: audit 2021-03-10T17:45:07.350593+0000 mon.a (mon.0) 4254 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:45:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:07 gibba020 bash[25448]: cluster 2021-03-10T17:45:06.619034+0000 mgr.gibba020.yqfnwy (mgr.34427) 12222 : cluster [DBG] pgmap v6970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:07 gibba020 bash[25448]: audit 2021-03-10T17:45:07.079455+0000 mon.a (mon.0) 4253 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:45:07.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:07 gibba020 bash[25448]: audit 2021-03-10T17:45:07.350593+0000 mon.a (mon.0) 4254 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:45:08.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:08 gibba013 bash[29418]: audit 2021-03-10T17:45:07.848476+0000 mon.a (mon.0) 4255 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T17:45:08.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:08 gibba013 bash[29418]: audit 2021-03-10T17:45:07.849323+0000 mon.a (mon.0) 4256 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T17:45:08.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:08 gibba013 bash[29418]: audit 2021-03-10T17:45:07.850204+0000 mon.a (mon.0) 4257 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:45:08.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:08 gibba013 bash[29418]: audit 2021-03-10T17:45:07.850945+0000 mon.a (mon.0) 4258 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:45:08.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:08 gibba013 bash[30381]: audit 2021-03-10T17:45:07.848476+0000 mon.a (mon.0) 4255 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T17:45:08.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:08 gibba013 bash[30381]: audit 2021-03-10T17:45:07.849323+0000 mon.a (mon.0) 4256 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T17:45:08.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:08 gibba013 bash[30381]: audit 2021-03-10T17:45:07.850204+0000 mon.a (mon.0) 4257 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:45:08.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:08 gibba013 bash[30381]: audit 2021-03-10T17:45:07.850945+0000 mon.a (mon.0) 4258 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:45:08.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:08 gibba020 bash[25448]: audit 2021-03-10T17:45:07.848476+0000 mon.a (mon.0) 4255 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T17:45:08.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:08 gibba020 bash[25448]: audit 2021-03-10T17:45:07.849323+0000 mon.a (mon.0) 4256 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T17:45:08.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:08 gibba020 bash[25448]: audit 2021-03-10T17:45:07.850204+0000 mon.a (mon.0) 4257 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T17:45:08.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:08 gibba020 bash[25448]: audit 2021-03-10T17:45:07.850945+0000 mon.a (mon.0) 4258 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T17:45:09.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:09 gibba013 bash[29418]: cluster 2021-03-10T17:45:08.619772+0000 mgr.gibba020.yqfnwy (mgr.34427) 12223 : cluster [DBG] pgmap v6971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:09.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:09 gibba013 bash[30381]: cluster 2021-03-10T17:45:08.619772+0000 mgr.gibba020.yqfnwy (mgr.34427) 12223 : cluster [DBG] pgmap v6971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:09.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:09 gibba020 bash[25448]: cluster 2021-03-10T17:45:08.619772+0000 mgr.gibba020.yqfnwy (mgr.34427) 12223 : cluster [DBG] pgmap v6971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:11.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:11 gibba020 bash[25448]: cluster 2021-03-10T17:45:10.621361+0000 mgr.gibba020.yqfnwy (mgr.34427) 12224 : cluster [DBG] pgmap v6972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:12.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:11 gibba013 bash[29418]: cluster 2021-03-10T17:45:10.621361+0000 mgr.gibba020.yqfnwy (mgr.34427) 12224 : cluster [DBG] pgmap v6972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:12.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:11 gibba013 bash[30381]: cluster 2021-03-10T17:45:10.621361+0000 mgr.gibba020.yqfnwy (mgr.34427) 12224 : cluster [DBG] pgmap v6972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:13.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:13 gibba020 bash[25448]: cluster 2021-03-10T17:45:12.622865+0000 mgr.gibba020.yqfnwy (mgr.34427) 12225 : cluster [DBG] pgmap v6973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:14.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:13 gibba013 bash[29418]: cluster 2021-03-10T17:45:12.622865+0000 mgr.gibba020.yqfnwy (mgr.34427) 12225 : cluster [DBG] pgmap v6973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:14.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:13 gibba013 bash[30381]: cluster 2021-03-10T17:45:12.622865+0000 mgr.gibba020.yqfnwy (mgr.34427) 12225 : cluster [DBG] pgmap v6973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:16.070 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:15 gibba020 bash[25448]: cluster 2021-03-10T17:45:14.624537+0000 mgr.gibba020.yqfnwy (mgr.34427) 12226 : cluster [DBG] pgmap v6974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:16.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:15 gibba013 bash[29418]: cluster 2021-03-10T17:45:14.624537+0000 mgr.gibba020.yqfnwy (mgr.34427) 12226 : cluster [DBG] pgmap v6974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:16.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:15 gibba013 bash[30381]: cluster 2021-03-10T17:45:14.624537+0000 mgr.gibba020.yqfnwy (mgr.34427) 12226 : cluster [DBG] pgmap v6974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:17.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[29418]: audit 2021-03-10T17:45:15.834883+0000 mon.a (mon.0) 4259 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:45:17.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[29418]: cephadm 2021-03-10T17:45:15.840282+0000 mgr.gibba020.yqfnwy (mgr.34427) 12227 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:45:17.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[29418]: cephadm 2021-03-10T17:45:15.841643+0000 mgr.gibba020.yqfnwy (mgr.34427) 12228 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:45:17.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[29418]: audit 2021-03-10T17:45:16.053423+0000 mon.a (mon.0) 4260 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:45:17.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[29418]: cephadm 2021-03-10T17:45:16.055742+0000 mgr.gibba020.yqfnwy (mgr.34427) 12229 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:45:17.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[29418]: audit 2021-03-10T17:45:16.057013+0000 mon.a (mon.0) 4261 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:45:17.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[29418]: cephadm 2021-03-10T17:45:16.057660+0000 mgr.gibba020.yqfnwy (mgr.34427) 12230 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:45:17.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[29418]: audit 2021-03-10T17:45:16.058547+0000 mon.a (mon.0) 4262 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:17.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[29418]: cephadm 2021-03-10T17:45:16.058985+0000 mgr.gibba020.yqfnwy (mgr.34427) 12231 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:45:17.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[29418]: cephadm 2021-03-10T17:45:16.059020+0000 mgr.gibba020.yqfnwy (mgr.34427) 12232 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:45:17.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[29418]: audit 2021-03-10T17:45:16.059819+0000 mon.a (mon.0) 4263 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:17.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[29418]: cephadm 2021-03-10T17:45:16.060365+0000 mgr.gibba020.yqfnwy (mgr.34427) 12233 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:45:17.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[29418]: cephadm 2021-03-10T17:45:16.060454+0000 mgr.gibba020.yqfnwy (mgr.34427) 12234 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:45:17.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[29418]: audit 2021-03-10T17:45:16.061423+0000 mon.a (mon.0) 4264 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:17.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[29418]: cephadm 2021-03-10T17:45:16.061985+0000 mgr.gibba020.yqfnwy (mgr.34427) 12235 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:45:17.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[29418]: cephadm 2021-03-10T17:45:16.063404+0000 mgr.gibba020.yqfnwy (mgr.34427) 12236 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:45:17.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[29418]: cephadm 2021-03-10T17:45:16.063442+0000 mgr.gibba020.yqfnwy (mgr.34427) 12237 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:45:17.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[29418]: audit 2021-03-10T17:45:16.064493+0000 mon.a (mon.0) 4265 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:17.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[29418]: cephadm 2021-03-10T17:45:16.065177+0000 mgr.gibba020.yqfnwy (mgr.34427) 12238 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:45:17.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[29418]: cephadm 2021-03-10T17:45:16.065512+0000 mgr.gibba020.yqfnwy (mgr.34427) 12239 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:45:17.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[30381]: audit 2021-03-10T17:45:15.834883+0000 mon.a (mon.0) 4259 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:45:17.137 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[30381]: cephadm 2021-03-10T17:45:15.840282+0000 mgr.gibba020.yqfnwy (mgr.34427) 12227 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:45:17.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[30381]: cephadm 2021-03-10T17:45:15.841643+0000 mgr.gibba020.yqfnwy (mgr.34427) 12228 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:45:17.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[30381]: audit 2021-03-10T17:45:16.053423+0000 mon.a (mon.0) 4260 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:45:17.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[30381]: cephadm 2021-03-10T17:45:16.055742+0000 mgr.gibba020.yqfnwy (mgr.34427) 12229 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:45:17.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[30381]: audit 2021-03-10T17:45:16.057013+0000 mon.a (mon.0) 4261 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:45:17.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[30381]: cephadm 2021-03-10T17:45:16.057660+0000 mgr.gibba020.yqfnwy (mgr.34427) 12230 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:45:17.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[30381]: audit 2021-03-10T17:45:16.058547+0000 mon.a (mon.0) 4262 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:17.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[30381]: cephadm 2021-03-10T17:45:16.058985+0000 mgr.gibba020.yqfnwy (mgr.34427) 12231 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:45:17.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[30381]: cephadm 2021-03-10T17:45:16.059020+0000 mgr.gibba020.yqfnwy (mgr.34427) 12232 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:45:17.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[30381]: audit 2021-03-10T17:45:16.059819+0000 mon.a (mon.0) 4263 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:17.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[30381]: cephadm 2021-03-10T17:45:16.060365+0000 mgr.gibba020.yqfnwy (mgr.34427) 12233 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:45:17.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[30381]: cephadm 2021-03-10T17:45:16.060454+0000 mgr.gibba020.yqfnwy (mgr.34427) 12234 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:45:17.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[30381]: audit 2021-03-10T17:45:16.061423+0000 mon.a (mon.0) 4264 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:17.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[30381]: cephadm 2021-03-10T17:45:16.061985+0000 mgr.gibba020.yqfnwy (mgr.34427) 12235 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:45:17.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[30381]: cephadm 2021-03-10T17:45:16.063404+0000 mgr.gibba020.yqfnwy (mgr.34427) 12236 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:45:17.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[30381]: cephadm 2021-03-10T17:45:16.063442+0000 mgr.gibba020.yqfnwy (mgr.34427) 12237 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:45:17.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[30381]: audit 2021-03-10T17:45:16.064493+0000 mon.a (mon.0) 4265 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:17.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[30381]: cephadm 2021-03-10T17:45:16.065177+0000 mgr.gibba020.yqfnwy (mgr.34427) 12238 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:45:17.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[30381]: cephadm 2021-03-10T17:45:16.065512+0000 mgr.gibba020.yqfnwy (mgr.34427) 12239 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:45:17.142 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[29418]: audit 2021-03-10T17:45:16.066286+0000 mon.a (mon.0) 4266 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:17.142 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[29418]: cephadm 2021-03-10T17:45:16.066979+0000 mgr.gibba020.yqfnwy (mgr.34427) 12240 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:45:17.142 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[29418]: cephadm 2021-03-10T17:45:16.067019+0000 mgr.gibba020.yqfnwy (mgr.34427) 12241 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:45:17.143 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[29418]: cephadm 2021-03-10T17:45:16.067128+0000 mgr.gibba020.yqfnwy (mgr.34427) 12242 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:45:17.143 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[30381]: audit 2021-03-10T17:45:16.066286+0000 mon.a (mon.0) 4266 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:17.143 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[30381]: cephadm 2021-03-10T17:45:16.066979+0000 mgr.gibba020.yqfnwy (mgr.34427) 12240 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:45:17.143 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[30381]: cephadm 2021-03-10T17:45:16.067019+0000 mgr.gibba020.yqfnwy (mgr.34427) 12241 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:45:17.144 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:16 gibba013 bash[30381]: cephadm 2021-03-10T17:45:16.067128+0000 mgr.gibba020.yqfnwy (mgr.34427) 12242 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:45:17.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:16 gibba020 bash[25448]: audit 2021-03-10T17:45:15.834883+0000 mon.a (mon.0) 4259 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:45:17.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:16 gibba020 bash[25448]: cephadm 2021-03-10T17:45:15.840282+0000 mgr.gibba020.yqfnwy (mgr.34427) 12227 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:45:17.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:16 gibba020 bash[25448]: cephadm 2021-03-10T17:45:15.841643+0000 mgr.gibba020.yqfnwy (mgr.34427) 12228 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:45:17.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:16 gibba020 bash[25448]: audit 2021-03-10T17:45:16.053423+0000 mon.a (mon.0) 4260 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:45:17.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:16 gibba020 bash[25448]: cephadm 2021-03-10T17:45:16.055742+0000 mgr.gibba020.yqfnwy (mgr.34427) 12229 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:45:17.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:16 gibba020 bash[25448]: audit 2021-03-10T17:45:16.057013+0000 mon.a (mon.0) 4261 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:45:17.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:16 gibba020 bash[25448]: cephadm 2021-03-10T17:45:16.057660+0000 mgr.gibba020.yqfnwy (mgr.34427) 12230 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:45:17.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:16 gibba020 bash[25448]: audit 2021-03-10T17:45:16.058547+0000 mon.a (mon.0) 4262 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:17.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:16 gibba020 bash[25448]: cephadm 2021-03-10T17:45:16.058985+0000 mgr.gibba020.yqfnwy (mgr.34427) 12231 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:45:17.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:16 gibba020 bash[25448]: cephadm 2021-03-10T17:45:16.059020+0000 mgr.gibba020.yqfnwy (mgr.34427) 12232 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:45:17.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:16 gibba020 bash[25448]: audit 2021-03-10T17:45:16.059819+0000 mon.a (mon.0) 4263 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:17.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:16 gibba020 bash[25448]: cephadm 2021-03-10T17:45:16.060365+0000 mgr.gibba020.yqfnwy (mgr.34427) 12233 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:45:17.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:16 gibba020 bash[25448]: cephadm 2021-03-10T17:45:16.060454+0000 mgr.gibba020.yqfnwy (mgr.34427) 12234 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:45:17.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:16 gibba020 bash[25448]: audit 2021-03-10T17:45:16.061423+0000 mon.a (mon.0) 4264 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:17.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:16 gibba020 bash[25448]: cephadm 2021-03-10T17:45:16.061985+0000 mgr.gibba020.yqfnwy (mgr.34427) 12235 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:45:17.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:16 gibba020 bash[25448]: cephadm 2021-03-10T17:45:16.063404+0000 mgr.gibba020.yqfnwy (mgr.34427) 12236 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:45:17.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:16 gibba020 bash[25448]: cephadm 2021-03-10T17:45:16.063442+0000 mgr.gibba020.yqfnwy (mgr.34427) 12237 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:45:17.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:16 gibba020 bash[25448]: audit 2021-03-10T17:45:16.064493+0000 mon.a (mon.0) 4265 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:17.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:16 gibba020 bash[25448]: cephadm 2021-03-10T17:45:16.065177+0000 mgr.gibba020.yqfnwy (mgr.34427) 12238 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:45:17.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:16 gibba020 bash[25448]: cephadm 2021-03-10T17:45:16.065512+0000 mgr.gibba020.yqfnwy (mgr.34427) 12239 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:45:17.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:16 gibba020 bash[25448]: audit 2021-03-10T17:45:16.066286+0000 mon.a (mon.0) 4266 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:17.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:16 gibba020 bash[25448]: cephadm 2021-03-10T17:45:16.066979+0000 mgr.gibba020.yqfnwy (mgr.34427) 12240 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:45:17.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:16 gibba020 bash[25448]: cephadm 2021-03-10T17:45:16.067019+0000 mgr.gibba020.yqfnwy (mgr.34427) 12241 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:45:17.206 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:16 gibba020 bash[25448]: cephadm 2021-03-10T17:45:16.067128+0000 mgr.gibba020.yqfnwy (mgr.34427) 12242 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:45:18.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:17 gibba013 bash[29418]: cluster 2021-03-10T17:45:16.626297+0000 mgr.gibba020.yqfnwy (mgr.34427) 12243 : cluster [DBG] pgmap v6975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:18.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:17 gibba013 bash[30381]: cluster 2021-03-10T17:45:16.626297+0000 mgr.gibba020.yqfnwy (mgr.34427) 12243 : cluster [DBG] pgmap v6975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:18.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:17 gibba020 bash[25448]: cluster 2021-03-10T17:45:16.626297+0000 mgr.gibba020.yqfnwy (mgr.34427) 12243 : cluster [DBG] pgmap v6975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:20.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:19 gibba013 bash[29418]: cluster 2021-03-10T17:45:18.627721+0000 mgr.gibba020.yqfnwy (mgr.34427) 12244 : cluster [DBG] pgmap v6976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:20.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:19 gibba013 bash[30381]: cluster 2021-03-10T17:45:18.627721+0000 mgr.gibba020.yqfnwy (mgr.34427) 12244 : cluster [DBG] pgmap v6976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:20.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:19 gibba020 bash[25448]: cluster 2021-03-10T17:45:18.627721+0000 mgr.gibba020.yqfnwy (mgr.34427) 12244 : cluster [DBG] pgmap v6976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:21.115 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:45:21.342 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:45:21.342 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 3m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:45:21.343 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 2m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:45:21.343 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 2m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:45:21.343 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 2m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:45:21.343 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:45:21.343 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:45:21.344 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 2m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:45:21.344 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:45:21.344 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:45:21.344 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:45:21.344 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:45:21.345 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:45:21.345 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:45:21.345 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:45:21.345 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:45:21.345 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:45:21.346 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:45:21.346 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:45:21.346 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 2m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:45:21.346 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:45:21.597 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:45:21.597 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:45:21.597 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:45:21.598 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:45:21.598 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:45:21.598 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:45:21.598 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:45:21.599 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:45:21.599 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:45:21.599 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:45:21.599 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:45:21.599 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:45:21.600 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:45:21.600 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:45:21.600 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:45:22.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:21 gibba013 bash[29418]: cluster 2021-03-10T17:45:20.629506+0000 mgr.gibba020.yqfnwy (mgr.34427) 12245 : cluster [DBG] pgmap v6977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:22.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:21 gibba013 bash[29418]: audit 2021-03-10T17:45:21.104037+0000 mgr.gibba020.yqfnwy (mgr.34427) 12246 : audit [DBG] from='client.52260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:45:22.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:21 gibba013 bash[29418]: audit 2021-03-10T17:45:21.328503+0000 mgr.gibba020.yqfnwy (mgr.34427) 12247 : audit [DBG] from='client.52266 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:45:22.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:21 gibba013 bash[29418]: audit 2021-03-10T17:45:21.594378+0000 mon.c (mon.1) 184 : audit [DBG] from='client.? 172.21.2.113:0/1385643399' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:22.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:21 gibba013 bash[30381]: cluster 2021-03-10T17:45:20.629506+0000 mgr.gibba020.yqfnwy (mgr.34427) 12245 : cluster [DBG] pgmap v6977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:22.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:21 gibba013 bash[30381]: audit 2021-03-10T17:45:21.104037+0000 mgr.gibba020.yqfnwy (mgr.34427) 12246 : audit [DBG] from='client.52260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:45:22.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:21 gibba013 bash[30381]: audit 2021-03-10T17:45:21.328503+0000 mgr.gibba020.yqfnwy (mgr.34427) 12247 : audit [DBG] from='client.52266 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:45:22.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:21 gibba013 bash[30381]: audit 2021-03-10T17:45:21.594378+0000 mon.c (mon.1) 184 : audit [DBG] from='client.? 172.21.2.113:0/1385643399' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:22.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:21 gibba020 bash[25448]: cluster 2021-03-10T17:45:20.629506+0000 mgr.gibba020.yqfnwy (mgr.34427) 12245 : cluster [DBG] pgmap v6977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:22.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:21 gibba020 bash[25448]: audit 2021-03-10T17:45:21.104037+0000 mgr.gibba020.yqfnwy (mgr.34427) 12246 : audit [DBG] from='client.52260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:45:22.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:21 gibba020 bash[25448]: audit 2021-03-10T17:45:21.328503+0000 mgr.gibba020.yqfnwy (mgr.34427) 12247 : audit [DBG] from='client.52266 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:45:22.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:21 gibba020 bash[25448]: audit 2021-03-10T17:45:21.594378+0000 mon.c (mon.1) 184 : audit [DBG] from='client.? 172.21.2.113:0/1385643399' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:24.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:23 gibba013 bash[29418]: cluster 2021-03-10T17:45:22.631086+0000 mgr.gibba020.yqfnwy (mgr.34427) 12248 : cluster [DBG] pgmap v6978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:24.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:23 gibba013 bash[30381]: cluster 2021-03-10T17:45:22.631086+0000 mgr.gibba020.yqfnwy (mgr.34427) 12248 : cluster [DBG] pgmap v6978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:24.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:23 gibba020 bash[25448]: cluster 2021-03-10T17:45:22.631086+0000 mgr.gibba020.yqfnwy (mgr.34427) 12248 : cluster [DBG] pgmap v6978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:26.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:25 gibba013 bash[29418]: cluster 2021-03-10T17:45:24.632643+0000 mgr.gibba020.yqfnwy (mgr.34427) 12249 : cluster [DBG] pgmap v6979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:26.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:25 gibba013 bash[30381]: cluster 2021-03-10T17:45:24.632643+0000 mgr.gibba020.yqfnwy (mgr.34427) 12249 : cluster [DBG] pgmap v6979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:26.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:25 gibba020 bash[25448]: cluster 2021-03-10T17:45:24.632643+0000 mgr.gibba020.yqfnwy (mgr.34427) 12249 : cluster [DBG] pgmap v6979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:27.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:27 gibba013 bash[29418]: cluster 2021-03-10T17:45:26.634411+0000 mgr.gibba020.yqfnwy (mgr.34427) 12250 : cluster [DBG] pgmap v6980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:27.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:27 gibba013 bash[30381]: cluster 2021-03-10T17:45:26.634411+0000 mgr.gibba020.yqfnwy (mgr.34427) 12250 : cluster [DBG] pgmap v6980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:27.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:27 gibba020 bash[25448]: cluster 2021-03-10T17:45:26.634411+0000 mgr.gibba020.yqfnwy (mgr.34427) 12250 : cluster [DBG] pgmap v6980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:30.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:29 gibba013 bash[29418]: cluster 2021-03-10T17:45:28.635807+0000 mgr.gibba020.yqfnwy (mgr.34427) 12251 : cluster [DBG] pgmap v6981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:30.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:29 gibba013 bash[30381]: cluster 2021-03-10T17:45:28.635807+0000 mgr.gibba020.yqfnwy (mgr.34427) 12251 : cluster [DBG] pgmap v6981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:30.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:29 gibba020 bash[25448]: cluster 2021-03-10T17:45:28.635807+0000 mgr.gibba020.yqfnwy (mgr.34427) 12251 : cluster [DBG] pgmap v6981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:32.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:31 gibba013 bash[29418]: cluster 2021-03-10T17:45:30.637364+0000 mgr.gibba020.yqfnwy (mgr.34427) 12252 : cluster [DBG] pgmap v6982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:32.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:31 gibba013 bash[29418]: cephadm 2021-03-10T17:45:31.083138+0000 mgr.gibba020.yqfnwy (mgr.34427) 12253 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:45:32.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:31 gibba013 bash[30381]: cluster 2021-03-10T17:45:30.637364+0000 mgr.gibba020.yqfnwy (mgr.34427) 12252 : cluster [DBG] pgmap v6982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:32.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:31 gibba013 bash[30381]: cephadm 2021-03-10T17:45:31.083138+0000 mgr.gibba020.yqfnwy (mgr.34427) 12253 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:45:32.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:31 gibba020 bash[25448]: cluster 2021-03-10T17:45:30.637364+0000 mgr.gibba020.yqfnwy (mgr.34427) 12252 : cluster [DBG] pgmap v6982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:32.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:31 gibba020 bash[25448]: cephadm 2021-03-10T17:45:31.083138+0000 mgr.gibba020.yqfnwy (mgr.34427) 12253 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:45:34.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:33 gibba013 bash[29418]: cluster 2021-03-10T17:45:32.638783+0000 mgr.gibba020.yqfnwy (mgr.34427) 12254 : cluster [DBG] pgmap v6983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:34.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:33 gibba013 bash[30381]: cluster 2021-03-10T17:45:32.638783+0000 mgr.gibba020.yqfnwy (mgr.34427) 12254 : cluster [DBG] pgmap v6983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:34.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:33 gibba020 bash[25448]: cluster 2021-03-10T17:45:32.638783+0000 mgr.gibba020.yqfnwy (mgr.34427) 12254 : cluster [DBG] pgmap v6983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:36.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:35 gibba013 bash[29418]: cluster 2021-03-10T17:45:34.640439+0000 mgr.gibba020.yqfnwy (mgr.34427) 12255 : cluster [DBG] pgmap v6984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:36.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:35 gibba013 bash[30381]: cluster 2021-03-10T17:45:34.640439+0000 mgr.gibba020.yqfnwy (mgr.34427) 12255 : cluster [DBG] pgmap v6984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:36.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:35 gibba020 bash[25448]: cluster 2021-03-10T17:45:34.640439+0000 mgr.gibba020.yqfnwy (mgr.34427) 12255 : cluster [DBG] pgmap v6984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:37.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:37 gibba013 bash[29418]: cluster 2021-03-10T17:45:36.641261+0000 mgr.gibba020.yqfnwy (mgr.34427) 12256 : cluster [DBG] pgmap v6985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:37.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:37 gibba013 bash[30381]: cluster 2021-03-10T17:45:36.641261+0000 mgr.gibba020.yqfnwy (mgr.34427) 12256 : cluster [DBG] pgmap v6985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:37.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:37 gibba020 bash[25448]: cluster 2021-03-10T17:45:36.641261+0000 mgr.gibba020.yqfnwy (mgr.34427) 12256 : cluster [DBG] pgmap v6985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:40.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:39 gibba013 bash[29418]: cluster 2021-03-10T17:45:38.642593+0000 mgr.gibba020.yqfnwy (mgr.34427) 12257 : cluster [DBG] pgmap v6986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:40.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:39 gibba013 bash[30381]: cluster 2021-03-10T17:45:38.642593+0000 mgr.gibba020.yqfnwy (mgr.34427) 12257 : cluster [DBG] pgmap v6986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:40.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:39 gibba020 bash[25448]: cluster 2021-03-10T17:45:38.642593+0000 mgr.gibba020.yqfnwy (mgr.34427) 12257 : cluster [DBG] pgmap v6986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:42.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:41 gibba013 bash[29418]: cluster 2021-03-10T17:45:40.644222+0000 mgr.gibba020.yqfnwy (mgr.34427) 12258 : cluster [DBG] pgmap v6987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:42.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:41 gibba013 bash[30381]: cluster 2021-03-10T17:45:40.644222+0000 mgr.gibba020.yqfnwy (mgr.34427) 12258 : cluster [DBG] pgmap v6987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:42.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:41 gibba020 bash[25448]: cluster 2021-03-10T17:45:40.644222+0000 mgr.gibba020.yqfnwy (mgr.34427) 12258 : cluster [DBG] pgmap v6987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:44.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:43 gibba013 bash[29418]: cluster 2021-03-10T17:45:42.645499+0000 mgr.gibba020.yqfnwy (mgr.34427) 12259 : cluster [DBG] pgmap v6988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:44.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:43 gibba013 bash[30381]: cluster 2021-03-10T17:45:42.645499+0000 mgr.gibba020.yqfnwy (mgr.34427) 12259 : cluster [DBG] pgmap v6988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:44.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:43 gibba020 bash[25448]: cluster 2021-03-10T17:45:42.645499+0000 mgr.gibba020.yqfnwy (mgr.34427) 12259 : cluster [DBG] pgmap v6988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:46.102 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:45 gibba020 bash[25448]: cluster 2021-03-10T17:45:44.647000+0000 mgr.gibba020.yqfnwy (mgr.34427) 12260 : cluster [DBG] pgmap v6989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:46.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:45 gibba013 bash[29418]: cluster 2021-03-10T17:45:44.647000+0000 mgr.gibba020.yqfnwy (mgr.34427) 12260 : cluster [DBG] pgmap v6989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:46.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:45 gibba013 bash[30381]: cluster 2021-03-10T17:45:44.647000+0000 mgr.gibba020.yqfnwy (mgr.34427) 12260 : cluster [DBG] pgmap v6989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:47.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:46 gibba013 bash[29418]: cephadm 2021-03-10T17:45:46.099135+0000 mgr.gibba020.yqfnwy (mgr.34427) 12261 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:45:47.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:46 gibba013 bash[30381]: cephadm 2021-03-10T17:45:46.099135+0000 mgr.gibba020.yqfnwy (mgr.34427) 12261 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:45:47.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:46 gibba020 bash[25448]: cephadm 2021-03-10T17:45:46.099135+0000 mgr.gibba020.yqfnwy (mgr.34427) 12261 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:45:48.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:47 gibba013 bash[29418]: cluster 2021-03-10T17:45:46.647964+0000 mgr.gibba020.yqfnwy (mgr.34427) 12262 : cluster [DBG] pgmap v6990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:48.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:47 gibba013 bash[30381]: cluster 2021-03-10T17:45:46.647964+0000 mgr.gibba020.yqfnwy (mgr.34427) 12262 : cluster [DBG] pgmap v6990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:48.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:47 gibba020 bash[25448]: cluster 2021-03-10T17:45:46.647964+0000 mgr.gibba020.yqfnwy (mgr.34427) 12262 : cluster [DBG] pgmap v6990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:50.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:49 gibba013 bash[29418]: cluster 2021-03-10T17:45:48.649292+0000 mgr.gibba020.yqfnwy (mgr.34427) 12263 : cluster [DBG] pgmap v6991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:50.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:49 gibba013 bash[30381]: cluster 2021-03-10T17:45:48.649292+0000 mgr.gibba020.yqfnwy (mgr.34427) 12263 : cluster [DBG] pgmap v6991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:50.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:49 gibba020 bash[25448]: cluster 2021-03-10T17:45:48.649292+0000 mgr.gibba020.yqfnwy (mgr.34427) 12263 : cluster [DBG] pgmap v6991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:51.849 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:45:52.079 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:45:52.079 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 3m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:45:52.079 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 2m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:45:52.080 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 2m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:45:52.080 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 2m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:45:52.080 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:45:52.080 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:45:52.080 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 2m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:45:52.081 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:45:52.081 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:45:52.081 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 2m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:45:52.081 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:45:52.082 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:45:52.082 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:45:52.082 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:45:52.083 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:45:52.083 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:45:52.083 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:45:52.084 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 2m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:45:52.084 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 2m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:45:52.084 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 2m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:45:52.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:51 gibba013 bash[29418]: cluster 2021-03-10T17:45:50.650691+0000 mgr.gibba020.yqfnwy (mgr.34427) 12264 : cluster [DBG] pgmap v6992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:52.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:51 gibba013 bash[30381]: cluster 2021-03-10T17:45:50.650691+0000 mgr.gibba020.yqfnwy (mgr.34427) 12264 : cluster [DBG] pgmap v6992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:52.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:51 gibba020 bash[25448]: cluster 2021-03-10T17:45:50.650691+0000 mgr.gibba020.yqfnwy (mgr.34427) 12264 : cluster [DBG] pgmap v6992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:52.330 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:45:52.331 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:45:52.331 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:45:52.331 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:45:52.332 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:45:52.332 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:45:52.332 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:45:52.332 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:45:52.332 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:45:52.333 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:45:52.333 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:45:52.333 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:45:52.333 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:45:52.334 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:45:52.334 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:45:53.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:52 gibba013 bash[29418]: audit 2021-03-10T17:45:51.837246+0000 mgr.gibba020.yqfnwy (mgr.34427) 12265 : audit [DBG] from='client.62257 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:45:53.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:52 gibba013 bash[29418]: audit 2021-03-10T17:45:52.063161+0000 mgr.gibba020.yqfnwy (mgr.34427) 12266 : audit [DBG] from='client.62263 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:45:53.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:52 gibba013 bash[29418]: audit 2021-03-10T17:45:52.327832+0000 mon.a (mon.0) 4267 : audit [DBG] from='client.? 172.21.2.113:0/2479768410' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:53.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:52 gibba013 bash[30381]: audit 2021-03-10T17:45:51.837246+0000 mgr.gibba020.yqfnwy (mgr.34427) 12265 : audit [DBG] from='client.62257 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:45:53.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:52 gibba013 bash[30381]: audit 2021-03-10T17:45:52.063161+0000 mgr.gibba020.yqfnwy (mgr.34427) 12266 : audit [DBG] from='client.62263 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:45:53.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:52 gibba013 bash[30381]: audit 2021-03-10T17:45:52.327832+0000 mon.a (mon.0) 4267 : audit [DBG] from='client.? 172.21.2.113:0/2479768410' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:53.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:52 gibba020 bash[25448]: audit 2021-03-10T17:45:51.837246+0000 mgr.gibba020.yqfnwy (mgr.34427) 12265 : audit [DBG] from='client.62257 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:45:53.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:52 gibba020 bash[25448]: audit 2021-03-10T17:45:52.063161+0000 mgr.gibba020.yqfnwy (mgr.34427) 12266 : audit [DBG] from='client.62263 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:45:53.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:52 gibba020 bash[25448]: audit 2021-03-10T17:45:52.327832+0000 mon.a (mon.0) 4267 : audit [DBG] from='client.? 172.21.2.113:0/2479768410' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:45:54.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:53 gibba013 bash[29418]: cluster 2021-03-10T17:45:52.652195+0000 mgr.gibba020.yqfnwy (mgr.34427) 12267 : cluster [DBG] pgmap v6993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:54.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:53 gibba013 bash[30381]: cluster 2021-03-10T17:45:52.652195+0000 mgr.gibba020.yqfnwy (mgr.34427) 12267 : cluster [DBG] pgmap v6993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:54.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:53 gibba020 bash[25448]: cluster 2021-03-10T17:45:52.652195+0000 mgr.gibba020.yqfnwy (mgr.34427) 12267 : cluster [DBG] pgmap v6993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:56.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:55 gibba013 bash[29418]: cluster 2021-03-10T17:45:54.653616+0000 mgr.gibba020.yqfnwy (mgr.34427) 12268 : cluster [DBG] pgmap v6994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:56.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:55 gibba013 bash[30381]: cluster 2021-03-10T17:45:54.653616+0000 mgr.gibba020.yqfnwy (mgr.34427) 12268 : cluster [DBG] pgmap v6994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:56.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:55 gibba020 bash[25448]: cluster 2021-03-10T17:45:54.653616+0000 mgr.gibba020.yqfnwy (mgr.34427) 12268 : cluster [DBG] pgmap v6994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:57.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:57 gibba013 bash[29418]: cluster 2021-03-10T17:45:56.655267+0000 mgr.gibba020.yqfnwy (mgr.34427) 12269 : cluster [DBG] pgmap v6995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:57.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:57 gibba013 bash[30381]: cluster 2021-03-10T17:45:56.655267+0000 mgr.gibba020.yqfnwy (mgr.34427) 12269 : cluster [DBG] pgmap v6995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:45:57.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:57 gibba020 bash[25448]: cluster 2021-03-10T17:45:56.655267+0000 mgr.gibba020.yqfnwy (mgr.34427) 12269 : cluster [DBG] pgmap v6995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:00.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:45:59 gibba013 bash[29418]: cluster 2021-03-10T17:45:58.656716+0000 mgr.gibba020.yqfnwy (mgr.34427) 12270 : cluster [DBG] pgmap v6996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:00.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:45:59 gibba013 bash[30381]: cluster 2021-03-10T17:45:58.656716+0000 mgr.gibba020.yqfnwy (mgr.34427) 12270 : cluster [DBG] pgmap v6996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:00.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:45:59 gibba020 bash[25448]: cluster 2021-03-10T17:45:58.656716+0000 mgr.gibba020.yqfnwy (mgr.34427) 12270 : cluster [DBG] pgmap v6996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:02.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:01 gibba013 bash[29418]: cluster 2021-03-10T17:46:00.658319+0000 mgr.gibba020.yqfnwy (mgr.34427) 12271 : cluster [DBG] pgmap v6997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:02.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:01 gibba013 bash[29418]: cephadm 2021-03-10T17:46:01.115119+0000 mgr.gibba020.yqfnwy (mgr.34427) 12272 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:46:02.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:01 gibba013 bash[30381]: cluster 2021-03-10T17:46:00.658319+0000 mgr.gibba020.yqfnwy (mgr.34427) 12271 : cluster [DBG] pgmap v6997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:02.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:01 gibba013 bash[30381]: cephadm 2021-03-10T17:46:01.115119+0000 mgr.gibba020.yqfnwy (mgr.34427) 12272 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:46:02.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:01 gibba020 bash[25448]: cluster 2021-03-10T17:46:00.658319+0000 mgr.gibba020.yqfnwy (mgr.34427) 12271 : cluster [DBG] pgmap v6997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:02.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:01 gibba020 bash[25448]: cephadm 2021-03-10T17:46:01.115119+0000 mgr.gibba020.yqfnwy (mgr.34427) 12272 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:46:04.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:03 gibba013 bash[29418]: cluster 2021-03-10T17:46:02.659932+0000 mgr.gibba020.yqfnwy (mgr.34427) 12273 : cluster [DBG] pgmap v6998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:04.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:03 gibba013 bash[30381]: cluster 2021-03-10T17:46:02.659932+0000 mgr.gibba020.yqfnwy (mgr.34427) 12273 : cluster [DBG] pgmap v6998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:04.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:03 gibba020 bash[25448]: cluster 2021-03-10T17:46:02.659932+0000 mgr.gibba020.yqfnwy (mgr.34427) 12273 : cluster [DBG] pgmap v6998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:06.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:05 gibba013 bash[29418]: cluster 2021-03-10T17:46:04.661651+0000 mgr.gibba020.yqfnwy (mgr.34427) 12274 : cluster [DBG] pgmap v6999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:06.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:05 gibba013 bash[30381]: cluster 2021-03-10T17:46:04.661651+0000 mgr.gibba020.yqfnwy (mgr.34427) 12274 : cluster [DBG] pgmap v6999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:06.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:05 gibba020 bash[25448]: cluster 2021-03-10T17:46:04.661651+0000 mgr.gibba020.yqfnwy (mgr.34427) 12274 : cluster [DBG] pgmap v6999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:07.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:07 gibba013 bash[29418]: cluster 2021-03-10T17:46:06.663308+0000 mgr.gibba020.yqfnwy (mgr.34427) 12275 : cluster [DBG] pgmap v7000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:07.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:07 gibba013 bash[29418]: audit 2021-03-10T17:46:07.084075+0000 mon.a (mon.0) 4268 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:46:07.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:07 gibba013 bash[29418]: audit 2021-03-10T17:46:07.357559+0000 mon.a (mon.0) 4269 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:46:07.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:07 gibba013 bash[30381]: cluster 2021-03-10T17:46:06.663308+0000 mgr.gibba020.yqfnwy (mgr.34427) 12275 : cluster [DBG] pgmap v7000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:07.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:07 gibba013 bash[30381]: audit 2021-03-10T17:46:07.084075+0000 mon.a (mon.0) 4268 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:46:07.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:07 gibba013 bash[30381]: audit 2021-03-10T17:46:07.357559+0000 mon.a (mon.0) 4269 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:46:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:07 gibba020 bash[25448]: cluster 2021-03-10T17:46:06.663308+0000 mgr.gibba020.yqfnwy (mgr.34427) 12275 : cluster [DBG] pgmap v7000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:07.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:07 gibba020 bash[25448]: audit 2021-03-10T17:46:07.084075+0000 mon.a (mon.0) 4268 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/mirror_snapshot_schedule"}]: dispatch 2021-03-10T17:46:07.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:07 gibba020 bash[25448]: audit 2021-03-10T17:46:07.357559+0000 mon.a (mon.0) 4269 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba020.yqfnwy/trash_purge_schedule"}]: dispatch 2021-03-10T17:46:08.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:08 gibba013 bash[29418]: audit 2021-03-10T17:46:07.858417+0000 mon.a (mon.0) 4270 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T17:46:08.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:08 gibba013 bash[29418]: audit 2021-03-10T17:46:07.859209+0000 mon.a (mon.0) 4271 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:46:08.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:08 gibba013 bash[29418]: audit 2021-03-10T17:46:07.859838+0000 mon.a (mon.0) 4272 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:46:08.883 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:08 gibba013 bash[29418]: audit 2021-03-10T17:46:07.860484+0000 mon.a (mon.0) 4273 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:46:08.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:08 gibba013 bash[30381]: audit 2021-03-10T17:46:07.858417+0000 mon.a (mon.0) 4270 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T17:46:08.883 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:08 gibba013 bash[30381]: audit 2021-03-10T17:46:07.859209+0000 mon.a (mon.0) 4271 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:46:08.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:08 gibba013 bash[30381]: audit 2021-03-10T17:46:07.859838+0000 mon.a (mon.0) 4272 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:46:08.884 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:08 gibba013 bash[30381]: audit 2021-03-10T17:46:07.860484+0000 mon.a (mon.0) 4273 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:46:08.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:08 gibba020 bash[25448]: audit 2021-03-10T17:46:07.858417+0000 mon.a (mon.0) 4270 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T17:46:08.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:08 gibba020 bash[25448]: audit 2021-03-10T17:46:07.859209+0000 mon.a (mon.0) 4271 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T17:46:08.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:08 gibba020 bash[25448]: audit 2021-03-10T17:46:07.859838+0000 mon.a (mon.0) 4272 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T17:46:08.951 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:08 gibba020 bash[25448]: audit 2021-03-10T17:46:07.860484+0000 mon.a (mon.0) 4273 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T17:46:09.881 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:09 gibba013 bash[29418]: cluster 2021-03-10T17:46:08.664360+0000 mgr.gibba020.yqfnwy (mgr.34427) 12276 : cluster [DBG] pgmap v7001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:09.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:09 gibba013 bash[30381]: cluster 2021-03-10T17:46:08.664360+0000 mgr.gibba020.yqfnwy (mgr.34427) 12276 : cluster [DBG] pgmap v7001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:09.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:09 gibba020 bash[25448]: cluster 2021-03-10T17:46:08.664360+0000 mgr.gibba020.yqfnwy (mgr.34427) 12276 : cluster [DBG] pgmap v7001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:12.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:11 gibba013 bash[29418]: cluster 2021-03-10T17:46:10.665752+0000 mgr.gibba020.yqfnwy (mgr.34427) 12277 : cluster [DBG] pgmap v7002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:12.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:11 gibba013 bash[30381]: cluster 2021-03-10T17:46:10.665752+0000 mgr.gibba020.yqfnwy (mgr.34427) 12277 : cluster [DBG] pgmap v7002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:12.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:11 gibba020 bash[25448]: cluster 2021-03-10T17:46:10.665752+0000 mgr.gibba020.yqfnwy (mgr.34427) 12277 : cluster [DBG] pgmap v7002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:14.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:13 gibba013 bash[29418]: cluster 2021-03-10T17:46:12.667337+0000 mgr.gibba020.yqfnwy (mgr.34427) 12278 : cluster [DBG] pgmap v7003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:14.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:13 gibba013 bash[30381]: cluster 2021-03-10T17:46:12.667337+0000 mgr.gibba020.yqfnwy (mgr.34427) 12278 : cluster [DBG] pgmap v7003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:14.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:13 gibba020 bash[25448]: cluster 2021-03-10T17:46:12.667337+0000 mgr.gibba020.yqfnwy (mgr.34427) 12278 : cluster [DBG] pgmap v7003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:16.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:15 gibba013 bash[29418]: cluster 2021-03-10T17:46:14.669053+0000 mgr.gibba020.yqfnwy (mgr.34427) 12279 : cluster [DBG] pgmap v7004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:16.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:15 gibba013 bash[30381]: cluster 2021-03-10T17:46:14.669053+0000 mgr.gibba020.yqfnwy (mgr.34427) 12279 : cluster [DBG] pgmap v7004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:16.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:15 gibba020 bash[25448]: cluster 2021-03-10T17:46:14.669053+0000 mgr.gibba020.yqfnwy (mgr.34427) 12279 : cluster [DBG] pgmap v7004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:17.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[29418]: audit 2021-03-10T17:46:16.132227+0000 mon.a (mon.0) 4274 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:46:17.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[29418]: cephadm 2021-03-10T17:46:16.137274+0000 mgr.gibba020.yqfnwy (mgr.34427) 12280 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:46:17.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[29418]: cephadm 2021-03-10T17:46:16.139164+0000 mgr.gibba020.yqfnwy (mgr.34427) 12281 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:46:17.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[29418]: audit 2021-03-10T17:46:16.360046+0000 mon.a (mon.0) 4275 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:46:17.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[29418]: cephadm 2021-03-10T17:46:16.362041+0000 mgr.gibba020.yqfnwy (mgr.34427) 12282 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:46:17.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[29418]: audit 2021-03-10T17:46:16.363190+0000 mon.a (mon.0) 4276 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:46:17.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[29418]: cephadm 2021-03-10T17:46:16.363782+0000 mgr.gibba020.yqfnwy (mgr.34427) 12283 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:46:17.134 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[29418]: audit 2021-03-10T17:46:16.364555+0000 mon.a (mon.0) 4277 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:17.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[29418]: cephadm 2021-03-10T17:46:16.364971+0000 mgr.gibba020.yqfnwy (mgr.34427) 12284 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:46:17.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[29418]: cephadm 2021-03-10T17:46:16.365065+0000 mgr.gibba020.yqfnwy (mgr.34427) 12285 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:46:17.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[29418]: audit 2021-03-10T17:46:16.366045+0000 mon.a (mon.0) 4278 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:17.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[29418]: cephadm 2021-03-10T17:46:16.366476+0000 mgr.gibba020.yqfnwy (mgr.34427) 12286 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:46:17.135 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[29418]: cephadm 2021-03-10T17:46:16.366567+0000 mgr.gibba020.yqfnwy (mgr.34427) 12287 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:46:17.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[29418]: audit 2021-03-10T17:46:16.367391+0000 mon.a (mon.0) 4279 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:17.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[29418]: cephadm 2021-03-10T17:46:16.367739+0000 mgr.gibba020.yqfnwy (mgr.34427) 12288 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:46:17.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[29418]: cephadm 2021-03-10T17:46:16.368838+0000 mgr.gibba020.yqfnwy (mgr.34427) 12289 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:46:17.136 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[29418]: cephadm 2021-03-10T17:46:16.368874+0000 mgr.gibba020.yqfnwy (mgr.34427) 12290 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:46:17.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[29418]: audit 2021-03-10T17:46:16.369730+0000 mon.a (mon.0) 4280 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:17.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[29418]: cephadm 2021-03-10T17:46:16.369950+0000 mgr.gibba020.yqfnwy (mgr.34427) 12291 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:46:17.137 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[29418]: cephadm 2021-03-10T17:46:16.370266+0000 mgr.gibba020.yqfnwy (mgr.34427) 12292 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:46:17.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[30381]: audit 2021-03-10T17:46:16.132227+0000 mon.a (mon.0) 4274 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:46:17.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[30381]: cephadm 2021-03-10T17:46:16.137274+0000 mgr.gibba020.yqfnwy (mgr.34427) 12280 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:46:17.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[30381]: cephadm 2021-03-10T17:46:16.139164+0000 mgr.gibba020.yqfnwy (mgr.34427) 12281 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:46:17.138 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[30381]: audit 2021-03-10T17:46:16.360046+0000 mon.a (mon.0) 4275 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:46:17.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[30381]: cephadm 2021-03-10T17:46:16.362041+0000 mgr.gibba020.yqfnwy (mgr.34427) 12282 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:46:17.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[30381]: audit 2021-03-10T17:46:16.363190+0000 mon.a (mon.0) 4276 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:46:17.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[30381]: cephadm 2021-03-10T17:46:16.363782+0000 mgr.gibba020.yqfnwy (mgr.34427) 12283 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:46:17.139 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[30381]: audit 2021-03-10T17:46:16.364555+0000 mon.a (mon.0) 4277 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:17.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[30381]: cephadm 2021-03-10T17:46:16.364971+0000 mgr.gibba020.yqfnwy (mgr.34427) 12284 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:46:17.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[30381]: cephadm 2021-03-10T17:46:16.365065+0000 mgr.gibba020.yqfnwy (mgr.34427) 12285 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:46:17.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[30381]: audit 2021-03-10T17:46:16.366045+0000 mon.a (mon.0) 4278 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:17.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[30381]: cephadm 2021-03-10T17:46:16.366476+0000 mgr.gibba020.yqfnwy (mgr.34427) 12286 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:46:17.140 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[30381]: cephadm 2021-03-10T17:46:16.366567+0000 mgr.gibba020.yqfnwy (mgr.34427) 12287 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:46:17.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[30381]: audit 2021-03-10T17:46:16.367391+0000 mon.a (mon.0) 4279 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:17.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[30381]: cephadm 2021-03-10T17:46:16.367739+0000 mgr.gibba020.yqfnwy (mgr.34427) 12288 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:46:17.141 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[30381]: cephadm 2021-03-10T17:46:16.368838+0000 mgr.gibba020.yqfnwy (mgr.34427) 12289 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:46:17.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[30381]: cephadm 2021-03-10T17:46:16.368874+0000 mgr.gibba020.yqfnwy (mgr.34427) 12290 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:46:17.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[30381]: audit 2021-03-10T17:46:16.369730+0000 mon.a (mon.0) 4280 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:17.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[30381]: cephadm 2021-03-10T17:46:16.369950+0000 mgr.gibba020.yqfnwy (mgr.34427) 12291 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:46:17.142 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[30381]: cephadm 2021-03-10T17:46:16.370266+0000 mgr.gibba020.yqfnwy (mgr.34427) 12292 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:46:17.143 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[29418]: audit 2021-03-10T17:46:16.371130+0000 mon.a (mon.0) 4281 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:17.143 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[29418]: cephadm 2021-03-10T17:46:16.371510+0000 mgr.gibba020.yqfnwy (mgr.34427) 12293 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:46:17.143 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[29418]: cephadm 2021-03-10T17:46:16.371544+0000 mgr.gibba020.yqfnwy (mgr.34427) 12294 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:46:17.144 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[29418]: cephadm 2021-03-10T17:46:16.371643+0000 mgr.gibba020.yqfnwy (mgr.34427) 12295 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:46:17.144 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[30381]: audit 2021-03-10T17:46:16.371130+0000 mon.a (mon.0) 4281 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:17.144 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[30381]: cephadm 2021-03-10T17:46:16.371510+0000 mgr.gibba020.yqfnwy (mgr.34427) 12293 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:46:17.144 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[30381]: cephadm 2021-03-10T17:46:16.371544+0000 mgr.gibba020.yqfnwy (mgr.34427) 12294 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:46:17.145 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:16 gibba013 bash[30381]: cephadm 2021-03-10T17:46:16.371643+0000 mgr.gibba020.yqfnwy (mgr.34427) 12295 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:46:17.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:16 gibba020 bash[25448]: audit 2021-03-10T17:46:16.132227+0000 mon.a (mon.0) 4274 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:46:17.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:16 gibba020 bash[25448]: cephadm 2021-03-10T17:46:16.137274+0000 mgr.gibba020.yqfnwy (mgr.34427) 12280 : cephadm [INF] Refreshing gibba013 facts 2021-03-10T17:46:17.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:16 gibba020 bash[25448]: cephadm 2021-03-10T17:46:16.139164+0000 mgr.gibba020.yqfnwy (mgr.34427) 12281 : cephadm [INF] Refreshing gibba020 facts 2021-03-10T17:46:17.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:16 gibba020 bash[25448]: audit 2021-03-10T17:46:16.360046+0000 mon.a (mon.0) 4275 : audit [INF] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' 2021-03-10T17:46:17.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:16 gibba020 bash[25448]: cephadm 2021-03-10T17:46:16.362041+0000 mgr.gibba020.yqfnwy (mgr.34427) 12282 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T17:46:17.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:16 gibba020 bash[25448]: audit 2021-03-10T17:46:16.363190+0000 mon.a (mon.0) 4276 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T17:46:17.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:16 gibba020 bash[25448]: cephadm 2021-03-10T17:46:16.363782+0000 mgr.gibba020.yqfnwy (mgr.34427) 12283 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T17:46:17.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:16 gibba020 bash[25448]: audit 2021-03-10T17:46:16.364555+0000 mon.a (mon.0) 4277 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:17.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:16 gibba020 bash[25448]: cephadm 2021-03-10T17:46:16.364971+0000 mgr.gibba020.yqfnwy (mgr.34427) 12284 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T17:46:17.202 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:16 gibba020 bash[25448]: cephadm 2021-03-10T17:46:16.365065+0000 mgr.gibba020.yqfnwy (mgr.34427) 12285 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T17:46:17.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:16 gibba020 bash[25448]: audit 2021-03-10T17:46:16.366045+0000 mon.a (mon.0) 4278 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:17.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:16 gibba020 bash[25448]: cephadm 2021-03-10T17:46:16.366476+0000 mgr.gibba020.yqfnwy (mgr.34427) 12286 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T17:46:17.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:16 gibba020 bash[25448]: cephadm 2021-03-10T17:46:16.366567+0000 mgr.gibba020.yqfnwy (mgr.34427) 12287 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T17:46:17.203 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:16 gibba020 bash[25448]: audit 2021-03-10T17:46:16.367391+0000 mon.a (mon.0) 4279 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:17.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:16 gibba020 bash[25448]: cephadm 2021-03-10T17:46:16.367739+0000 mgr.gibba020.yqfnwy (mgr.34427) 12288 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T17:46:17.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:16 gibba020 bash[25448]: cephadm 2021-03-10T17:46:16.368838+0000 mgr.gibba020.yqfnwy (mgr.34427) 12289 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T17:46:17.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:16 gibba020 bash[25448]: cephadm 2021-03-10T17:46:16.368874+0000 mgr.gibba020.yqfnwy (mgr.34427) 12290 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T17:46:17.204 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:16 gibba020 bash[25448]: audit 2021-03-10T17:46:16.369730+0000 mon.a (mon.0) 4280 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:17.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:16 gibba020 bash[25448]: cephadm 2021-03-10T17:46:16.369950+0000 mgr.gibba020.yqfnwy (mgr.34427) 12291 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T17:46:17.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:16 gibba020 bash[25448]: cephadm 2021-03-10T17:46:16.370266+0000 mgr.gibba020.yqfnwy (mgr.34427) 12292 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T17:46:17.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:16 gibba020 bash[25448]: audit 2021-03-10T17:46:16.371130+0000 mon.a (mon.0) 4281 : audit [DBG] from='mgr.34427 172.21.2.120:0/3744713098' entity='mgr.gibba020.yqfnwy' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:17.205 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:16 gibba020 bash[25448]: cephadm 2021-03-10T17:46:16.371510+0000 mgr.gibba020.yqfnwy (mgr.34427) 12293 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T17:46:17.206 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:16 gibba020 bash[25448]: cephadm 2021-03-10T17:46:16.371544+0000 mgr.gibba020.yqfnwy (mgr.34427) 12294 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T17:46:17.206 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:16 gibba020 bash[25448]: cephadm 2021-03-10T17:46:16.371643+0000 mgr.gibba020.yqfnwy (mgr.34427) 12295 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:46:18.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:17 gibba013 bash[29418]: cluster 2021-03-10T17:46:16.670029+0000 mgr.gibba020.yqfnwy (mgr.34427) 12296 : cluster [DBG] pgmap v7005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:18.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:17 gibba013 bash[30381]: cluster 2021-03-10T17:46:16.670029+0000 mgr.gibba020.yqfnwy (mgr.34427) 12296 : cluster [DBG] pgmap v7005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:18.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:17 gibba020 bash[25448]: cluster 2021-03-10T17:46:16.670029+0000 mgr.gibba020.yqfnwy (mgr.34427) 12296 : cluster [DBG] pgmap v7005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:20.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:19 gibba013 bash[29418]: cluster 2021-03-10T17:46:18.671616+0000 mgr.gibba020.yqfnwy (mgr.34427) 12297 : cluster [DBG] pgmap v7006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:20.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:19 gibba013 bash[30381]: cluster 2021-03-10T17:46:18.671616+0000 mgr.gibba020.yqfnwy (mgr.34427) 12297 : cluster [DBG] pgmap v7006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:20.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:19 gibba020 bash[25448]: cluster 2021-03-10T17:46:18.671616+0000 mgr.gibba020.yqfnwy (mgr.34427) 12297 : cluster [DBG] pgmap v7006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:22.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:21 gibba013 bash[29418]: cluster 2021-03-10T17:46:20.673310+0000 mgr.gibba020.yqfnwy (mgr.34427) 12298 : cluster [DBG] pgmap v7007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:22.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:21 gibba013 bash[30381]: cluster 2021-03-10T17:46:20.673310+0000 mgr.gibba020.yqfnwy (mgr.34427) 12298 : cluster [DBG] pgmap v7007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:22.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:21 gibba020 bash[25448]: cluster 2021-03-10T17:46:20.673310+0000 mgr.gibba020.yqfnwy (mgr.34427) 12298 : cluster [DBG] pgmap v7007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:22.572 INFO:teuthology.orchestra.run.gibba013.stdout:true 2021-03-10T17:46:22.796 INFO:teuthology.orchestra.run.gibba013.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T17:46:22.796 INFO:teuthology.orchestra.run.gibba013.stdout:alertmanager.a gibba013 running (3h) 4m ago 3h 0.21.0 prom/alertmanager c876f5897d7b a7c14b180bbc 2021-03-10T17:46:22.796 INFO:teuthology.orchestra.run.gibba013.stdout:grafana.a gibba020 running (3h) 3m ago 3h 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c 8add9188497a 2021-03-10T17:46:22.796 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.gibba020.yqfnwy gibba020 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 24f623ad250b 2021-03-10T17:46:22.797 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.x gibba020 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 7268fb51c46b 2021-03-10T17:46:22.797 INFO:teuthology.orchestra.run.gibba013.stdout:mgr.y gibba013 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 7609af74159c 2021-03-10T17:46:22.797 INFO:teuthology.orchestra.run.gibba013.stdout:mon.a gibba013 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 656fb288b68f 2021-03-10T17:46:22.797 INFO:teuthology.orchestra.run.gibba013.stdout:mon.b gibba020 running (3h) 3m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da c458332a4809 2021-03-10T17:46:22.798 INFO:teuthology.orchestra.run.gibba013.stdout:mon.c gibba013 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 693539cc5eb6 2021-03-10T17:46:22.798 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.a gibba013 running (3h) 4m ago 3h 1.1.2 prom/node-exporter c19ae228f069 f7b56637bd4e 2021-03-10T17:46:22.798 INFO:teuthology.orchestra.run.gibba013.stdout:node-exporter.b gibba020 running (3h) 3m ago 3h 1.1.2 prom/node-exporter c19ae228f069 486e0c838f13 2021-03-10T17:46:22.798 INFO:teuthology.orchestra.run.gibba013.stdout:osd.0 gibba013 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 34bdbb499870 2021-03-10T17:46:22.798 INFO:teuthology.orchestra.run.gibba013.stdout:osd.1 gibba013 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975614fd71d6 2021-03-10T17:46:22.799 INFO:teuthology.orchestra.run.gibba013.stdout:osd.2 gibba013 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da a922f40ac059 2021-03-10T17:46:22.799 INFO:teuthology.orchestra.run.gibba013.stdout:osd.3 gibba013 running (3h) 4m ago 4h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 21150d1d6a19 2021-03-10T17:46:22.799 INFO:teuthology.orchestra.run.gibba013.stdout:osd.4 gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 5b3c987cdfa4 2021-03-10T17:46:22.799 INFO:teuthology.orchestra.run.gibba013.stdout:osd.5 gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da b87c8d3fef79 2021-03-10T17:46:22.799 INFO:teuthology.orchestra.run.gibba013.stdout:osd.6 gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 975d19c6676f 2021-03-10T17:46:22.800 INFO:teuthology.orchestra.run.gibba013.stdout:osd.7 gibba020 running (3h) 3m ago 3h 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54 d4615e7085da 1bf47ed08eca 2021-03-10T17:46:22.800 INFO:teuthology.orchestra.run.gibba013.stdout:prometheus.a gibba020 running (3h) 3m ago 3h 2.25.0 prom/prometheus:latest a618f5685492 f231d37f1a20 2021-03-10T17:46:22.800 INFO:teuthology.orchestra.run.gibba013.stdout:rgw.r.z.gibba020.txcybs gibba020 error 3m ago 3h docker.io/ceph/ceph:v15.2.0 2021-03-10T17:46:23.049 INFO:teuthology.orchestra.run.gibba013.stdout:{ 2021-03-10T17:46:23.049 INFO:teuthology.orchestra.run.gibba013.stdout: "mon": { 2021-03-10T17:46:23.049 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:46:23.050 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:46:23.050 INFO:teuthology.orchestra.run.gibba013.stdout: "mgr": { 2021-03-10T17:46:23.050 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T17:46:23.050 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:46:23.051 INFO:teuthology.orchestra.run.gibba013.stdout: "osd": { 2021-03-10T17:46:23.051 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T17:46:23.051 INFO:teuthology.orchestra.run.gibba013.stdout: }, 2021-03-10T17:46:23.051 INFO:teuthology.orchestra.run.gibba013.stdout: "mds": {}, 2021-03-10T17:46:23.052 INFO:teuthology.orchestra.run.gibba013.stdout: "overall": { 2021-03-10T17:46:23.052 INFO:teuthology.orchestra.run.gibba013.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T17:46:23.052 INFO:teuthology.orchestra.run.gibba013.stdout: } 2021-03-10T17:46:23.052 INFO:teuthology.orchestra.run.gibba013.stdout:} 2021-03-10T17:46:24.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:23 gibba013 bash[29418]: audit 2021-03-10T17:46:22.559350+0000 mgr.gibba020.yqfnwy (mgr.34427) 12299 : audit [DBG] from='client.62275 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:46:24.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:23 gibba013 bash[29418]: cluster 2021-03-10T17:46:22.674839+0000 mgr.gibba020.yqfnwy (mgr.34427) 12300 : cluster [DBG] pgmap v7008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:24.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:23 gibba013 bash[29418]: audit 2021-03-10T17:46:22.784621+0000 mgr.gibba020.yqfnwy (mgr.34427) 12301 : audit [DBG] from='client.52302 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:46:24.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:23 gibba013 bash[29418]: audit 2021-03-10T17:46:23.046448+0000 mon.c (mon.1) 185 : audit [DBG] from='client.? 172.21.2.113:0/750935848' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:24.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:23 gibba013 bash[30381]: audit 2021-03-10T17:46:22.559350+0000 mgr.gibba020.yqfnwy (mgr.34427) 12299 : audit [DBG] from='client.62275 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:46:24.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:23 gibba013 bash[30381]: cluster 2021-03-10T17:46:22.674839+0000 mgr.gibba020.yqfnwy (mgr.34427) 12300 : cluster [DBG] pgmap v7008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:24.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:23 gibba013 bash[30381]: audit 2021-03-10T17:46:22.784621+0000 mgr.gibba020.yqfnwy (mgr.34427) 12301 : audit [DBG] from='client.52302 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:46:24.134 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:23 gibba013 bash[30381]: audit 2021-03-10T17:46:23.046448+0000 mon.c (mon.1) 185 : audit [DBG] from='client.? 172.21.2.113:0/750935848' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:24.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:23 gibba020 bash[25448]: audit 2021-03-10T17:46:22.559350+0000 mgr.gibba020.yqfnwy (mgr.34427) 12299 : audit [DBG] from='client.62275 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:46:24.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:23 gibba020 bash[25448]: cluster 2021-03-10T17:46:22.674839+0000 mgr.gibba020.yqfnwy (mgr.34427) 12300 : cluster [DBG] pgmap v7008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:24.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:23 gibba020 bash[25448]: audit 2021-03-10T17:46:22.784621+0000 mgr.gibba020.yqfnwy (mgr.34427) 12301 : audit [DBG] from='client.52302 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T17:46:24.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:23 gibba020 bash[25448]: audit 2021-03-10T17:46:23.046448+0000 mon.c (mon.1) 185 : audit [DBG] from='client.? 172.21.2.113:0/750935848' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T17:46:26.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:25 gibba013 bash[29418]: cluster 2021-03-10T17:46:24.676545+0000 mgr.gibba020.yqfnwy (mgr.34427) 12302 : cluster [DBG] pgmap v7009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:26.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:25 gibba013 bash[30381]: cluster 2021-03-10T17:46:24.676545+0000 mgr.gibba020.yqfnwy (mgr.34427) 12302 : cluster [DBG] pgmap v7009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:26.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:25 gibba020 bash[25448]: cluster 2021-03-10T17:46:24.676545+0000 mgr.gibba020.yqfnwy (mgr.34427) 12302 : cluster [DBG] pgmap v7009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:27.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:27 gibba013 bash[29418]: cluster 2021-03-10T17:46:26.678231+0000 mgr.gibba020.yqfnwy (mgr.34427) 12303 : cluster [DBG] pgmap v7010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:27.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:27 gibba013 bash[30381]: cluster 2021-03-10T17:46:26.678231+0000 mgr.gibba020.yqfnwy (mgr.34427) 12303 : cluster [DBG] pgmap v7010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:27.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:27 gibba020 bash[25448]: cluster 2021-03-10T17:46:26.678231+0000 mgr.gibba020.yqfnwy (mgr.34427) 12303 : cluster [DBG] pgmap v7010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:30.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:29 gibba013 bash[29418]: cluster 2021-03-10T17:46:28.679858+0000 mgr.gibba020.yqfnwy (mgr.34427) 12304 : cluster [DBG] pgmap v7011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:30.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:29 gibba013 bash[30381]: cluster 2021-03-10T17:46:28.679858+0000 mgr.gibba020.yqfnwy (mgr.34427) 12304 : cluster [DBG] pgmap v7011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:30.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:29 gibba020 bash[25448]: cluster 2021-03-10T17:46:28.679858+0000 mgr.gibba020.yqfnwy (mgr.34427) 12304 : cluster [DBG] pgmap v7011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:32.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:31 gibba013 bash[29418]: cluster 2021-03-10T17:46:30.681434+0000 mgr.gibba020.yqfnwy (mgr.34427) 12305 : cluster [DBG] pgmap v7012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:32.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:31 gibba013 bash[29418]: cephadm 2021-03-10T17:46:31.387548+0000 mgr.gibba020.yqfnwy (mgr.34427) 12306 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:46:32.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:31 gibba013 bash[30381]: cluster 2021-03-10T17:46:30.681434+0000 mgr.gibba020.yqfnwy (mgr.34427) 12305 : cluster [DBG] pgmap v7012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:32.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:31 gibba013 bash[30381]: cephadm 2021-03-10T17:46:31.387548+0000 mgr.gibba020.yqfnwy (mgr.34427) 12306 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:46:32.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:31 gibba020 bash[25448]: cluster 2021-03-10T17:46:30.681434+0000 mgr.gibba020.yqfnwy (mgr.34427) 12305 : cluster [DBG] pgmap v7012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:32.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:31 gibba020 bash[25448]: cephadm 2021-03-10T17:46:31.387548+0000 mgr.gibba020.yqfnwy (mgr.34427) 12306 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:46:34.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:33 gibba013 bash[29418]: cluster 2021-03-10T17:46:32.682710+0000 mgr.gibba020.yqfnwy (mgr.34427) 12307 : cluster [DBG] pgmap v7013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:34.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:33 gibba013 bash[30381]: cluster 2021-03-10T17:46:32.682710+0000 mgr.gibba020.yqfnwy (mgr.34427) 12307 : cluster [DBG] pgmap v7013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:34.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:33 gibba020 bash[25448]: cluster 2021-03-10T17:46:32.682710+0000 mgr.gibba020.yqfnwy (mgr.34427) 12307 : cluster [DBG] pgmap v7013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:36.131 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:35 gibba013 bash[29418]: cluster 2021-03-10T17:46:34.684401+0000 mgr.gibba020.yqfnwy (mgr.34427) 12308 : cluster [DBG] pgmap v7014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:36.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:35 gibba013 bash[30381]: cluster 2021-03-10T17:46:34.684401+0000 mgr.gibba020.yqfnwy (mgr.34427) 12308 : cluster [DBG] pgmap v7014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:36.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:35 gibba020 bash[25448]: cluster 2021-03-10T17:46:34.684401+0000 mgr.gibba020.yqfnwy (mgr.34427) 12308 : cluster [DBG] pgmap v7014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:37.882 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:37 gibba013 bash[29418]: cluster 2021-03-10T17:46:36.686196+0000 mgr.gibba020.yqfnwy (mgr.34427) 12309 : cluster [DBG] pgmap v7015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:37.882 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:37 gibba013 bash[30381]: cluster 2021-03-10T17:46:36.686196+0000 mgr.gibba020.yqfnwy (mgr.34427) 12309 : cluster [DBG] pgmap v7015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:37.950 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:37 gibba020 bash[25448]: cluster 2021-03-10T17:46:36.686196+0000 mgr.gibba020.yqfnwy (mgr.34427) 12309 : cluster [DBG] pgmap v7015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:40.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:39 gibba013 bash[29418]: cluster 2021-03-10T17:46:38.687909+0000 mgr.gibba020.yqfnwy (mgr.34427) 12310 : cluster [DBG] pgmap v7016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:40.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:39 gibba013 bash[30381]: cluster 2021-03-10T17:46:38.687909+0000 mgr.gibba020.yqfnwy (mgr.34427) 12310 : cluster [DBG] pgmap v7016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:40.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:39 gibba020 bash[25448]: cluster 2021-03-10T17:46:38.687909+0000 mgr.gibba020.yqfnwy (mgr.34427) 12310 : cluster [DBG] pgmap v7016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:42.133 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:41 gibba013 bash[29418]: cluster 2021-03-10T17:46:40.689604+0000 mgr.gibba020.yqfnwy (mgr.34427) 12311 : cluster [DBG] pgmap v7017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:42.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:41 gibba013 bash[30381]: cluster 2021-03-10T17:46:40.689604+0000 mgr.gibba020.yqfnwy (mgr.34427) 12311 : cluster [DBG] pgmap v7017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:42.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:41 gibba020 bash[25448]: cluster 2021-03-10T17:46:40.689604+0000 mgr.gibba020.yqfnwy (mgr.34427) 12311 : cluster [DBG] pgmap v7017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:44.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:43 gibba013 bash[29418]: cluster 2021-03-10T17:46:42.691154+0000 mgr.gibba020.yqfnwy (mgr.34427) 12312 : cluster [DBG] pgmap v7018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:44.186 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:43 gibba013 bash[30381]: cluster 2021-03-10T17:46:42.691154+0000 mgr.gibba020.yqfnwy (mgr.34427) 12312 : cluster [DBG] pgmap v7018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:44.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:43 gibba020 bash[25448]: cluster 2021-03-10T17:46:42.691154+0000 mgr.gibba020.yqfnwy (mgr.34427) 12312 : cluster [DBG] pgmap v7018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:46.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:45 gibba013 bash[29418]: cluster 2021-03-10T17:46:44.692891+0000 mgr.gibba020.yqfnwy (mgr.34427) 12313 : cluster [DBG] pgmap v7019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:46.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:45 gibba013 bash[30381]: cluster 2021-03-10T17:46:44.692891+0000 mgr.gibba020.yqfnwy (mgr.34427) 12313 : cluster [DBG] pgmap v7019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:46.201 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:45 gibba020 bash[25448]: cluster 2021-03-10T17:46:44.692891+0000 mgr.gibba020.yqfnwy (mgr.34427) 12313 : cluster [DBG] pgmap v7019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:47.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:46 gibba013 bash[29418]: cephadm 2021-03-10T17:46:46.403663+0000 mgr.gibba020.yqfnwy (mgr.34427) 12314 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:46:47.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:46 gibba013 bash[30381]: cephadm 2021-03-10T17:46:46.403663+0000 mgr.gibba020.yqfnwy (mgr.34427) 12314 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:46:47.199 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:46 gibba020 bash[25448]: cephadm 2021-03-10T17:46:46.403663+0000 mgr.gibba020.yqfnwy (mgr.34427) 12314 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba020.txcybs'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba020.txcybs']. 2021-03-10T17:46:48.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:47 gibba013 bash[29418]: cluster 2021-03-10T17:46:46.694609+0000 mgr.gibba020.yqfnwy (mgr.34427) 12315 : cluster [DBG] pgmap v7020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:48.132 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:47 gibba013 bash[30381]: cluster 2021-03-10T17:46:46.694609+0000 mgr.gibba020.yqfnwy (mgr.34427) 12315 : cluster [DBG] pgmap v7020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:48.200 INFO:journalctl@ceph.mon.b.gibba020.stdout:Mar 10 17:46:47 gibba020 bash[25448]: cluster 2021-03-10T17:46:46.694609+0000 mgr.gibba020.yqfnwy (mgr.34427) 12315 : cluster [DBG] pgmap v7020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:50.132 INFO:journalctl@ceph.mon.a.gibba013.stdout:Mar 10 17:46:49 gibba013 bash[29418]: cluster 2021-03-10T17:46:48.696241+0000 mgr.gibba020.yqfnwy (mgr.34427) 12316 : cluster [DBG] pgmap v7021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:50.133 INFO:journalctl@ceph.mon.c.gibba013.stdout:Mar 10 17:46:49 gibba013 bash[30381]: cluster 2021-03-10T17:46:48.696241+0000 mgr.gibba020.yqfnwy (mgr.34427) 12316 : cluster [DBG] pgmap v7021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T17:46:50.144 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2021-03-10T17:46:50.146 DEBUG:teuthology.task.console_log:Killing console logger for gibba013 2021-03-10T17:46:50.147 DEBUG:teuthology.task.console_log:Killing console logger for gibba020 2021-03-10T17:46:50.147 DEBUG:teuthology.exit:Finished running handlers